2024-04-21T10:02:36.605 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-21T10:02:36.606 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi/7666572 --owner scheduled_leonidus@teuthology --name leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} -- /home/teuthworker/archive/leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi/7666572/orig.config.yaml 2024-04-21T10:02:36.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-21T10:02:36.769 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi/7666572 branch: wip-lusov-quiescer description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: null first_in_suite: false job_id: '7666572' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: b8ddeda347de6c45510a6df67440a1d298c37030 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1331 sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_b8ddeda347de6c45510a6df67440a1d298c37030/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: b8ddeda347de6c45510a6df67440a1d298c37030 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1RqEBzpn1zQ5/fh+Lo/za3S6B2q1j5QhkefaRvYLTmNZR1agPqPijTkPuxV+OMQbsdrEtD80ur1dSnZG8VP3Y= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7PVlXEMNsO999mjwGYax7ypEC16wbcNLhqzWpnV8XmRzB58MKgUSpsXJldOulPZb3lbYwqMgPk0eOjnBJTxVo= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwGT8KrM532/tV94g99v0zoi78Ok11znzsueiMg/d9wsvGrUtZm4sVI2VeYJR7HKCxpvWgF3mDBZkD6ZECbq1E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-21_09:54:56 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-21T10:02:36.769 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_b8ddeda347de6c45510a6df67440a1d298c37030/qa; will attempt to use it 2024-04-21T10:02:36.770 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_b8ddeda347de6c45510a6df67440a1d298c37030/qa/tasks 2024-04-21T10:02:36.770 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-21T10:02:36.772 INFO:teuthology.task.internal:Checking packages... 2024-04-21T10:02:36.793 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a630765c1f93c6e61d9b40c4b76437611d5ef29e' 2024-04-21T10:02:36.793 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-21T10:02:36.793 INFO:teuthology.packaging:ref: None 2024-04-21T10:02:36.793 INFO:teuthology.packaging:tag: None 2024-04-21T10:02:36.793 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-21T10:02:36.793 INFO:teuthology.packaging:sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:02:36.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-21T10:02:36.947 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154.ga630765c 2024-04-21T10:02:36.949 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-21T10:02:36.956 INFO:teuthology.task.internal:no buildpackages task found 2024-04-21T10:02:36.956 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-21T10:02:36.963 INFO:teuthology.task.internal:Saving configuration 2024-04-21T10:02:36.987 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-21T10:02:36.993 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T10:02:37.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi/7666572', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 09:57:36.338494', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1RqEBzpn1zQ5/fh+Lo/za3S6B2q1j5QhkefaRvYLTmNZR1agPqPijTkPuxV+OMQbsdrEtD80ur1dSnZG8VP3Y='} 2024-04-21T10:02:37.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi/7666572', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 09:57:36.340475', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7PVlXEMNsO999mjwGYax7ypEC16wbcNLhqzWpnV8XmRzB58MKgUSpsXJldOulPZb3lbYwqMgPk0eOjnBJTxVo='} 2024-04-21T10:02:37.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_09:54:56-fs-wip-lusov-quiescer-distro-default-smithi/7666572', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 09:57:36.341955', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwGT8KrM532/tV94g99v0zoi78Ok11znzsueiMg/d9wsvGrUtZm4sVI2VeYJR7HKCxpvWgF3mDBZkD6ZECbq1E='} 2024-04-21T10:02:37.061 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-21T10:02:37.068 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-21T10:02:37.068 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-21T10:02:37.068 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-21T10:02:37.068 INFO:teuthology.run_tasks:Running task console_log... 2024-04-21T10:02:37.248 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c54a0f0d0>, signals=[15]) 2024-04-21T10:02:37.249 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-21T10:02:37.256 INFO:teuthology.task.internal:Opening connections... 2024-04-21T10:02:37.256 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:02:37.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T10:02:37.332 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-04-21T10:02:37.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T10:02:37.405 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-21T10:02:37.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T10:02:37.476 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-21T10:02:37.484 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-04-21T10:02:37.501 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-04-21T10:02:37.501 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-21T10:02:37.557 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-04-21T10:02:37.557 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-04-21T10:02:37.557 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-04-21T10:02:37.557 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-04-21T10:02:37.557 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-21T10:02:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-21T10:02:37.559 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-21T10:02:37.584 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-04-21T10:02:37.602 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-04-21T10:02:37.602 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-04-21T10:02:37.658 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-04-21T10:02:37.658 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-04-21T10:02:37.658 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-04-21T10:02:37.658 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-04-21T10:02:37.658 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-21T10:02:37.659 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-21T10:02:37.659 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-04-21T10:02:37.685 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-21T10:02:37.703 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-21T10:02:37.703 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-21T10:02:37.759 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-21T10:02:37.760 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-21T10:02:37.760 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-21T10:02:37.760 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-21T10:02:37.760 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-21T10:02:37.760 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-21T10:02:37.786 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-21T10:02:37.797 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-21T10:02:37.810 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-21T10:02:37.811 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-04-21T10:02:37.813 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-04-21T10:02:37.815 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-21T10:02:37.831 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-21T10:02:37.838 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-21T10:02:37.838 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-04-21T10:02:37.871 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-04-21T10:02:37.873 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-21T10:02:37.981 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-21T10:02:38.051 INFO:teuthology.run_tasks:Running task kernel... 2024-04-21T10:02:38.065 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-21T10:02:38.065 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-21T10:02:38.065 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-21T10:02:38.066 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T10:02:38.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:02:38.082 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-04-21T10:02:38.140 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-437.el9.x86_64 2024-04-21T10:02:38.140 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-437.el9.x86_64 2024-04-21T10:02:38.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-04-21T10:02:41.484 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.0 MB 00:01 2024-04-21T10:02:45.252 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 19 MB 00:02 2024-04-21T10:02:50.311 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-04-21T10:02:51.845 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-21T10:02:53.549 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-21T10:02:58.455 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-21T10:03:00.353 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-21T10:03:00.353 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-21T10:03:00.443 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-21T10:03:00.444 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-21T10:03:00.444 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-21T10:03:00.571 DEBUG:teuthology.orchestra.run.smithi077:> echo no | sudo yum reinstall kernel || true 2024-04-21T10:03:01.065 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Apr 2024 10:02:58 AM UTC. 2024-04-21T10:03:01.191 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-21T10:03:01.197 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-21T10:03:01.197 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-21T10:03:01.197 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-21T10:03:01.198 INFO:teuthology.orchestra.run.smithi077.stderr:Operation aborted. 2024-04-21T10:03:01.257 INFO:teuthology.orchestra.run.smithi077.stdout:Is this ok [y/N]: 2024-04-21T10:03:01.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum reinstall -y kernel || true 2024-04-21T10:03:01.749 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Apr 2024 10:02:58 AM UTC. 2024-04-21T10:03:01.864 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:03:01.865 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-21T10:03:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-21T10:03:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:03:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-21T10:03:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-21T10:03:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-21T10:03:02.866 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64.rpm 274 kB/s | 255 kB 00:00 2024-04-21T10:03:02.866 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-21T10:03:02.866 INFO:teuthology.orchestra.run.smithi077.stdout:Total 255 kB/s | 255 kB 00:01 2024-04-21T10:03:02.883 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-21T10:03:03.080 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-21T10:03:03.081 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-21T10:03:03.086 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-21T10:03:03.086 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-21T10:03:03.214 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-21T10:03:03.275 INFO:teuthology.orchestra.run.smithi077.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-21T10:03:03.275 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-21T10:03:04.015 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-21T10:03:04.016 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-21T10:03:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-21T10:03:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:03:04.726 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalled: 2024-04-21T10:03:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-21T10:03:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:03:04.726 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-21T10:03:04.877 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-04-21T10:03:04.924 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-21T10:03:04.924 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-21T10:03:04.924 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-21T10:03:04.925 DEBUG:teuthology.parallel:result is None 2024-04-21T10:03:04.925 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-21T10:03:04.936 INFO:teuthology.task.internal:Creating test directory... 2024-04-21T10:03:04.936 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T10:03:04.939 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T10:03:04.941 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T10:03:04.959 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-21T10:03:04.966 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-21T10:03:04.972 INFO:teuthology.task.internal:Creating archive directory... 2024-04-21T10:03:04.972 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T10:03:04.993 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T10:03:04.999 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T10:03:05.036 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-21T10:03:05.042 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-21T10:03:05.042 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T10:03:05.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:03:05.085 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T10:03:05.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:03:05.102 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T10:03:05.104 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T10:03:05.127 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T10:03:05.141 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T10:03:05.158 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T10:03:05.159 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T10:03:05.176 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T10:03:05.192 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T10:03:05.195 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T10:03:05.197 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-21T10:03:05.204 INFO:teuthology.task.internal:Configuring sudo... 2024-04-21T10:03:05.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T10:03:05.207 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T10:03:05.237 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T10:03:05.263 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-21T10:03:05.272 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-21T10:03:05.272 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T10:03:05.274 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T10:03:05.302 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T10:03:05.319 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T10:03:05.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T10:03:05.412 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T10:03:05.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T10:03:05.532 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:03:05.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T10:03:05.595 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T10:03:05.637 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T10:03:05.685 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T10:03:05.765 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T10:03:05.806 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:03:05.806 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T10:03:05.869 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T10:03:05.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T10:03:05.959 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T10:03:06.044 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T10:03:06.084 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:03:06.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T10:03:06.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-04-21T10:03:06.152 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-04-21T10:03:06.155 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-21T10:03:06.186 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T10:03:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T10:03:06.224 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T10:03:06.676 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-21T10:03:06.684 INFO:teuthology.task.internal:Starting timer... 2024-04-21T10:03:06.684 INFO:teuthology.run_tasks:Running task pcp... 2024-04-21T10:03:06.693 INFO:teuthology.run_tasks:Running task selinux... 2024-04-21T10:03:06.702 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-21T10:03:06.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-04-21T10:03:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-04-21T10:03:06.771 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-04-21T10:03:06.829 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-04-21T10:03:06.831 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-04-21T10:03:06.895 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-04-21T10:03:06.897 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-21T10:03:06.897 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-04-21T10:03:06.919 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-04-21T10:03:06.919 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-04-21T10:03:06.943 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-04-21T10:03:06.943 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-04-21T10:03:06.987 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-04-21T10:03:06.987 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-04-21T10:03:06.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T10:03:07.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:03:07.014 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T10:03:07.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:03:07.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T10:03:07.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:03:07.064 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-21T10:03:07.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-04-21T10:03:07.089 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-04-21T10:03:07.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-04-21T10:03:07.137 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-21T10:03:07.146 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-21T10:03:07.160 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-21T10:03:07.162 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi170.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-21T10:07:02.690 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-21T10:07:02.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-21T10:07:02.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T10:07:02.767 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-21T10:07:02.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-21T10:07:02.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-21T10:07:02.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T10:07:02.925 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-04-21T10:07:03.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-21T10:07:03.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-21T10:07:03.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T10:07:03.089 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-21T10:07:03.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-21T10:07:03.171 INFO:teuthology.run_tasks:Running task clock... 2024-04-21T10:07:03.183 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-21T10:07:03.183 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T10:07:03.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T10:07:03.186 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T10:07:03.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T10:07:03.188 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T10:07:03.188 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T10:07:03.211 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-21T10:07:03.216 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-21T10:07:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-21T10:07:03.230 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-21T10:07:03.240 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-21T10:07:03.246 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-04-21T10:07:03.254 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-21T10:07:03.254 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-04-21T10:07:03.256 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-04-21T10:07:03.265 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-04-21T10:07:03.268 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-21T10:07:03.278 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-04-21T10:07:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-21T10:07:03.281 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-21T10:07:03.289 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-04-21T10:07:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-21T10:07:03.302 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-21T10:07:03.315 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-21T10:07:03.332 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-21T10:07:03.335 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T10:07:03.335 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-21T10:07:03.336 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.336 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.336 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.336 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-21T10:07:03.349 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T10:07:03.349 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-21T10:07:03.349 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.349 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.349 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.350 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.372 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-21T10:07:03.375 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T10:07:03.375 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-21T10:07:03.375 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.375 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.375 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.376 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T10:07:03.376 INFO:teuthology.run_tasks:Running task install... 2024-04-21T10:07:03.384 DEBUG:teuthology.task.install:project ceph 2024-04-21T10:07:03.384 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'}} 2024-04-21T10:07:03.385 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'} 2024-04-21T10:07:03.385 INFO:teuthology.task.install:Using flavor: default 2024-04-21T10:07:03.390 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-21T10:07:03.390 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-21T10:07:03.391 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'tag': None, 'wait_for_package': False} 2024-04-21T10:07:03.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:07:03.393 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'tag': None, 'wait_for_package': False} 2024-04-21T10:07:03.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:07:03.395 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'tag': None, 'wait_for_package': False} 2024-04-21T10:07:03.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:07:03.537 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/ 2024-04-21T10:07:03.537 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.ga630765c 2024-04-21T10:07:03.545 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/ 2024-04-21T10:07:03.545 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.ga630765c 2024-04-21T10:07:03.560 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/ 2024-04-21T10:07:03.560 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.ga630765c 2024-04-21T10:07:03.655 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-21T10:07:03.655 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:07:03.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-21T10:07:03.680 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-21T10:07:03.681 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a630765c1f93c6e61d9b40c4b76437611d5ef29e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-21T10:07:03.721 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-21T10:07:03.722 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:07:03.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-21T10:07:03.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-21T10:07:03.746 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-21T10:07:03.747 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a630765c1f93c6e61d9b40c4b76437611d5ef29e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-21T10:07:03.749 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-21T10:07:03.749 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:07:03.749 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-21T10:07:03.775 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-21T10:07:03.775 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a630765c1f93c6e61d9b40c4b76437611d5ef29e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-21T10:07:03.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-21T10:07:03.819 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-21T10:07:03.840 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-21T10:07:03.882 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-04-21T10:07:03.883 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-04-21T10:07:03.884 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-21T10:07:03.915 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-21T10:07:03.948 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-04-21T10:07:03.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-04-21T10:07:03.978 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-04-21T10:07:03.980 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-04-21T10:07:04.106 INFO:teuthology.orchestra.run.smithi191.stdout:48 files removed 2024-04-21T10:07:04.133 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-21T10:07:04.174 INFO:teuthology.orchestra.run.smithi077.stdout:48 files removed 2024-04-21T10:07:04.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-21T10:07:04.203 INFO:teuthology.orchestra.run.smithi170.stdout:48 files removed 2024-04-21T10:07:04.231 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-21T10:07:04.860 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-04-21T10:07:04.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 184 kB/s | 83 kB 00:00 2024-04-21T10:07:04.949 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 182 kB/s | 83 kB 00:00 2024-04-21T10:07:05.306 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-04-21T10:07:05.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-21T10:07:05.375 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-21T10:07:05.611 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-04-21T10:07:05.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 7.1 kB/s | 1.9 kB 00:00 2024-04-21T10:07:05.759 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-04-21T10:07:06.453 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.0 MB 00:00 2024-04-21T10:07:06.482 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.0 MB 00:00 2024-04-21T10:07:07.236 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-04-21T10:07:09.334 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-04-21T10:07:09.355 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-04-21T10:07:13.451 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-21T10:07:13.539 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-21T10:07:14.865 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 16 kB 00:00 2024-04-21T10:07:15.169 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-21T10:07:16.370 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-21T10:07:17.717 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-04-21T10:07:21.304 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-21T10:07:22.866 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-21T10:07:23.446 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T10:07:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T10:07:23.457 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-21T10:07:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-21T10:07:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-21T10:07:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-21T10:07:23.461 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-21T10:07:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-21T10:07:23.464 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-21T10:07:23.522 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-21T10:07:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-21T10:07:23.531 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-21T10:07:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-21T10:07:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-21T10:07:23.531 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-21T10:07:23.531 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.0.0-3154.ga630765c.el9 ceph 6.6 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.0.0-3154.ga630765c.el9 ceph 5.4 M 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 890 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.ga630765c.el9 ceph 145 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.0.0-3154.ga630765c.el9 ceph 1.5 M 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 142 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 3.5 M 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 7.4 M 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 49 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.0.0-3154.ga630765c.el9 ceph 11 M 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.0.0-3154.ga630765c.el9 ceph 49 M 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 273 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 762 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.0.0-3154.ga630765c.el9 ceph 225 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.0.0-3154.ga630765c.el9 ceph 27 k 2024-04-21T10:07:23.532 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 18 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.0.0-3154.ga630765c.el9 ceph 32 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 746 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.0.0-3154.ga630765c.el9 ceph 127 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-21T10:07:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.0.0-3154.ga630765c.el9 ceph 162 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.0.0-3154.ga630765c.el9 ceph 321 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 298 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.0.0-3154.ga630765c.el9 ceph 100 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 85 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.1 M 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 171 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-04-21T10:07:23.534 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.4 M 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.1 M 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.0.0-3154.ga630765c.el9 ceph 21 M 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 34 k 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.0.0-3154.ga630765c.el9 ceph 2.4 M 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 249 k 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.0.0-3154.ga630765c.el9 ceph 4.7 M 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 17 M 2024-04-21T10:07:23.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 16 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.0.0-3154.ga630765c.el9 ceph 25 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.0.0-3154.ga630765c.el9 ceph 163 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-21T10:07:23.536 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 501 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 5.4 M 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-21T10:07:23.537 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-21T10:07:23.538 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 45 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.0.0-3154.ga630765c.el9 ceph 135 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-21T10:07:23.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-21T10:07:23.540 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-21T10:07:23.541 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-21T10:07:23.542 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-21T10:07:23.543 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-21T10:07:23.544 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-04-21T10:07:23.545 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:07:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 218 M 2024-04-21T10:07:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-21T10:07:24.413 INFO:teuthology.orchestra.run.smithi077.stdout:(1/150): ceph-19.0.0-3154.ga630765c.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-04-21T10:07:25.025 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T10:07:25.026 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T10:07:25.037 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-21T10:07:25.038 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-21T10:07:25.039 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-21T10:07:25.040 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-21T10:07:25.041 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-21T10:07:25.044 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-21T10:07:25.044 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-21T10:07:25.104 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-21T10:07:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:(2/150): ceph-fuse-19.0.0-3154.ga630765c.el9.x8 1.2 MB/s | 890 kB 00:00 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.0.0-3154.ga630765c.el9 ceph 6.6 k 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.0.0-3154.ga630765c.el9 ceph 5.4 M 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 890 k 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.ga630765c.el9 ceph 145 k 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.0.0-3154.ga630765c.el9 ceph 1.5 M 2024-04-21T10:07:25.123 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 142 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 3.5 M 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 7.4 M 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 49 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.0.0-3154.ga630765c.el9 ceph 11 M 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.0.0-3154.ga630765c.el9 ceph 49 M 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 273 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 762 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:19.0.0-3154.ga630765c.el9 ceph 225 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell x86_64 2:19.0.0-3154.ga630765c.el9 ceph 27 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 18 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-21T10:07:25.124 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.0.0-3154.ga630765c.el9 ceph 32 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 746 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.0.0-3154.ga630765c.el9 ceph 127 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.0.0-3154.ga630765c.el9 ceph 162 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.0.0-3154.ga630765c.el9 ceph 321 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 298 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.0.0-3154.ga630765c.el9 ceph 100 k 2024-04-21T10:07:25.125 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 85 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.1 M 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 171 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.4 M 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.1 M 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.0.0-3154.ga630765c.el9 ceph 21 M 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 34 k 2024-04-21T10:07:25.126 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.0.0-3154.ga630765c.el9 ceph 2.4 M 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 249 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.0.0-3154.ga630765c.el9 ceph 4.7 M 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 17 M 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 16 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.0.0-3154.ga630765c.el9 ceph 25 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.0.0-3154.ga630765c.el9 ceph 163 k 2024-04-21T10:07:25.127 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 501 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 5.4 M 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-21T10:07:25.128 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-21T10:07:25.129 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 45 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.0.0-3154.ga630765c.el9 ceph 135 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-21T10:07:25.130 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-21T10:07:25.131 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-21T10:07:25.132 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-21T10:07:25.133 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-21T10:07:25.134 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-21T10:07:25.135 INFO:teuthology.orchestra.run.smithi191.stdout:Install 148 Packages 2024-04-21T10:07:25.136 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 2 Packages 2024-04-21T10:07:25.136 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:07:25.136 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 218 M 2024-04-21T10:07:25.136 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-21T10:07:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 1.3 MB/s | 145 kB 00:00 2024-04-21T10:07:25.939 INFO:teuthology.orchestra.run.smithi077.stdout:(4/150): ceph-mds-19.0.0-3154.ga630765c.el9.x86 3.3 MB/s | 2.4 MB 00:00 2024-04-21T10:07:26.001 INFO:teuthology.orchestra.run.smithi191.stdout:(1/150): ceph-19.0.0-3154.ga630765c.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-21T10:07:26.898 INFO:teuthology.orchestra.run.smithi077.stdout:(5/150): ceph-mgr-19.0.0-3154.ga630765c.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-04-21T10:07:27.676 INFO:teuthology.orchestra.run.smithi191.stdout:(2/150): ceph-base-19.0.0-3154.ga630765c.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-04-21T10:07:27.776 INFO:teuthology.orchestra.run.smithi191.stdout:(3/150): ceph-fuse-19.0.0-3154.ga630765c.el9.x8 501 kB/s | 890 kB 00:01 2024-04-21T10:07:27.801 INFO:teuthology.orchestra.run.smithi191.stdout:(4/150): ceph-immutable-object-cache-19.0.0-315 1.1 MB/s | 145 kB 00:00 2024-04-21T10:07:28.193 INFO:teuthology.orchestra.run.smithi191.stdout:(5/150): ceph-mgr-19.0.0-3154.ga630765c.el9.x86 3.8 MB/s | 1.5 MB 00:00 2024-04-21T10:07:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:(6/150): ceph-mon-19.0.0-3154.ga630765c.el9.x86 2.2 MB/s | 4.7 MB 00:02 2024-04-21T10:07:29.202 INFO:teuthology.orchestra.run.smithi191.stdout:(6/150): ceph-mon-19.0.0-3154.ga630765c.el9.x86 4.7 MB/s | 4.7 MB 00:01 2024-04-21T10:07:30.666 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 871 kB/s | 19 MB 00:22 2024-04-21T10:07:31.335 INFO:teuthology.orchestra.run.smithi191.stdout:(7/150): ceph-mds-19.0.0-3154.ga630765c.el9.x86 679 kB/s | 2.4 MB 00:03 2024-04-21T10:07:33.656 INFO:teuthology.orchestra.run.smithi077.stdout:(7/150): ceph-common-19.0.0-3154.ga630765c.el9. 2.2 MB/s | 21 MB 00:09 2024-04-21T10:07:33.827 INFO:teuthology.orchestra.run.smithi191.stdout:(8/150): ceph-osd-19.0.0-3154.ga630765c.el9.x86 3.6 MB/s | 17 MB 00:04 2024-04-21T10:07:33.943 INFO:teuthology.orchestra.run.smithi191.stdout:(9/150): ceph-selinux-19.0.0-3154.ga630765c.el9 216 kB/s | 25 kB 00:00 2024-04-21T10:07:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:(8/150): ceph-base-19.0.0-3154.ga630765c.el9.x8 525 kB/s | 5.4 MB 00:10 2024-04-21T10:07:34.515 INFO:teuthology.orchestra.run.smithi077.stdout:(9/150): ceph-selinux-19.0.0-3154.ga630765c.el9 252 kB/s | 25 kB 00:00 2024-04-21T10:07:35.810 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-04-21T10:07:37.517 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-21T10:07:39.021 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-21T10:07:39.210 INFO:teuthology.orchestra.run.smithi191.stdout:(10/150): ceph-common-19.0.0-3154.ga630765c.el9 1.6 MB/s | 21 MB 00:13 2024-04-21T10:07:39.402 INFO:teuthology.orchestra.run.smithi191.stdout:(11/150): cephfs-mirror-19.0.0-3154.ga630765c.e 1.1 MB/s | 225 kB 00:00 2024-04-21T10:07:39.502 INFO:teuthology.orchestra.run.smithi191.stdout:(12/150): cephfs-shell-19.0.0-3154.ga630765c.el 270 kB/s | 27 kB 00:00 2024-04-21T10:07:39.602 INFO:teuthology.orchestra.run.smithi191.stdout:(13/150): libcephfs-devel-19.0.0-3154.ga630765c 318 kB/s | 32 kB 00:00 2024-04-21T10:07:40.019 INFO:teuthology.orchestra.run.smithi191.stdout:(14/150): libcephfs2-19.0.0-3154.ga630765c.el9. 1.7 MB/s | 746 kB 00:00 2024-04-21T10:07:40.081 INFO:teuthology.orchestra.run.smithi077.stdout:(10/150): ceph-osd-19.0.0-3154.ga630765c.el9.x8 1.5 MB/s | 17 MB 00:11 2024-04-21T10:07:40.128 INFO:teuthology.orchestra.run.smithi191.stdout:(15/150): libcephsqlite-19.0.0-3154.ga630765c.e 1.5 MB/s | 163 kB 00:00 2024-04-21T10:07:40.228 INFO:teuthology.orchestra.run.smithi191.stdout:(16/150): librados-devel-19.0.0-3154.ga630765c. 1.2 MB/s | 127 kB 00:00 2024-04-21T10:07:40.231 INFO:teuthology.orchestra.run.smithi077.stdout:(11/150): cephfs-mirror-19.0.0-3154.ga630765c.e 1.5 MB/s | 225 kB 00:00 2024-04-21T10:07:40.331 INFO:teuthology.orchestra.run.smithi077.stdout:(12/150): cephfs-shell-19.0.0-3154.ga630765c.el 270 kB/s | 27 kB 00:00 2024-04-21T10:07:40.440 INFO:teuthology.orchestra.run.smithi077.stdout:(13/150): libcephfs-devel-19.0.0-3154.ga630765c 293 kB/s | 32 kB 00:00 2024-04-21T10:07:40.478 INFO:teuthology.orchestra.run.smithi191.stdout:(17/150): libradosstriper1-19.0.0-3154.ga630765 2.0 MB/s | 501 kB 00:00 2024-04-21T10:07:40.907 INFO:teuthology.orchestra.run.smithi077.stdout:(14/150): libcephfs2-19.0.0-3154.ga630765c.el9. 1.6 MB/s | 746 kB 00:00 2024-04-21T10:07:41.099 INFO:teuthology.orchestra.run.smithi077.stdout:(15/150): libcephsqlite-19.0.0-3154.ga630765c.e 853 kB/s | 163 kB 00:00 2024-04-21T10:07:41.207 INFO:teuthology.orchestra.run.smithi077.stdout:(16/150): librados-devel-19.0.0-3154.ga630765c. 1.1 MB/s | 127 kB 00:00 2024-04-21T10:07:41.558 INFO:teuthology.orchestra.run.smithi077.stdout:(17/150): libradosstriper1-19.0.0-3154.ga630765 1.4 MB/s | 501 kB 00:00 2024-04-21T10:07:42.820 INFO:teuthology.orchestra.run.smithi191.stdout:(18/150): librgw2-19.0.0-3154.ga630765c.el9.x86 2.3 MB/s | 5.4 MB 00:02 2024-04-21T10:07:42.945 INFO:teuthology.orchestra.run.smithi191.stdout:(19/150): python3-ceph-argparse-19.0.0-3154.ga6 362 kB/s | 45 kB 00:00 2024-04-21T10:07:43.062 INFO:teuthology.orchestra.run.smithi191.stdout:(20/150): python3-ceph-common-19.0.0-3154.ga630 1.1 MB/s | 135 kB 00:00 2024-04-21T10:07:43.108 INFO:teuthology.orchestra.run.smithi077.stdout:(18/150): ceph-radosgw-19.0.0-3154.ga630765c.el 1.1 MB/s | 11 MB 00:09 2024-04-21T10:07:43.188 INFO:teuthology.orchestra.run.smithi191.stdout:(21/150): python3-cephfs-19.0.0-3154.ga630765c. 1.3 MB/s | 162 kB 00:00 2024-04-21T10:07:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:(19/150): python3-ceph-argparse-19.0.0-3154.ga6 362 kB/s | 45 kB 00:00 2024-04-21T10:07:43.397 INFO:teuthology.orchestra.run.smithi191.stdout:(22/150): python3-rados-19.0.0-3154.ga630765c.e 1.5 MB/s | 321 kB 00:00 2024-04-21T10:07:43.705 INFO:teuthology.orchestra.run.smithi191.stdout:(23/150): python3-rbd-19.0.0-3154.ga630765c.el9 967 kB/s | 298 kB 00:00 2024-04-21T10:07:43.717 INFO:teuthology.orchestra.run.smithi077.stdout:(20/150): python3-ceph-common-19.0.0-3154.ga630 279 kB/s | 135 kB 00:00 2024-04-21T10:07:43.831 INFO:teuthology.orchestra.run.smithi191.stdout:(24/150): python3-rgw-19.0.0-3154.ga630765c.el9 797 kB/s | 100 kB 00:00 2024-04-21T10:07:43.950 INFO:teuthology.orchestra.run.smithi077.stdout:(21/150): python3-cephfs-19.0.0-3154.ga630765c. 693 kB/s | 162 kB 00:00 2024-04-21T10:07:43.998 INFO:teuthology.orchestra.run.smithi191.stdout:(25/150): rbd-fuse-19.0.0-3154.ga630765c.el9.x8 512 kB/s | 85 kB 00:00 2024-04-21T10:07:44.027 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-04-21T10:07:44.392 INFO:teuthology.orchestra.run.smithi077.stdout:(22/150): python3-rados-19.0.0-3154.ga630765c.e 727 kB/s | 321 kB 00:00 2024-04-21T10:07:44.776 INFO:teuthology.orchestra.run.smithi077.stdout:(23/150): python3-rbd-19.0.0-3154.ga630765c.el9 778 kB/s | 298 kB 00:00 2024-04-21T10:07:44.901 INFO:teuthology.orchestra.run.smithi077.stdout:(24/150): python3-rgw-19.0.0-3154.ga630765c.el9 798 kB/s | 100 kB 00:00 2024-04-21T10:07:45.027 INFO:teuthology.orchestra.run.smithi077.stdout:(25/150): rbd-fuse-19.0.0-3154.ga630765c.el9.x8 684 kB/s | 85 kB 00:00 2024-04-21T10:07:45.190 INFO:teuthology.orchestra.run.smithi191.stdout:(26/150): ceph-radosgw-19.0.0-3154.ga630765c.el 783 kB/s | 11 MB 00:13 2024-04-21T10:07:45.556 INFO:teuthology.orchestra.run.smithi191.stdout:(27/150): rbd-nbd-19.0.0-3154.ga630765c.el9.x86 467 kB/s | 171 kB 00:00 2024-04-21T10:07:45.665 INFO:teuthology.orchestra.run.smithi191.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3154.g 316 kB/s | 34 kB 00:00 2024-04-21T10:07:45.907 INFO:teuthology.orchestra.run.smithi191.stdout:(29/150): rbd-mirror-19.0.0-3154.ga630765c.el9. 1.6 MB/s | 3.1 MB 00:01 2024-04-21T10:07:46.007 INFO:teuthology.orchestra.run.smithi191.stdout:(30/150): ceph-mgr-cephadm-19.0.0-3154.ga630765 416 kB/s | 142 kB 00:00 2024-04-21T10:07:46.169 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T10:07:46.170 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T10:07:46.181 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-21T10:07:46.182 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-21T10:07:46.182 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-21T10:07:46.183 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-21T10:07:46.185 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-21T10:07:46.187 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-21T10:07:46.188 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-21T10:07:46.247 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-3154.ga630765c.el9 ceph 6.6 k 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-3154.ga630765c.el9 ceph 5.4 M 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 890 k 2024-04-21T10:07:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.ga630765c.el9 ceph 145 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-3154.ga630765c.el9 ceph 1.5 M 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 142 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 3.5 M 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 7.4 M 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 49 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-3154.ga630765c.el9 ceph 11 M 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-3154.ga630765c.el9 ceph 49 M 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 273 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 762 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:19.0.0-3154.ga630765c.el9 ceph 225 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell x86_64 2:19.0.0-3154.ga630765c.el9 ceph 27 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 18 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-21T10:07:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-3154.ga630765c.el9 ceph 32 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 746 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-3154.ga630765c.el9 ceph 127 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-3154.ga630765c.el9 ceph 162 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-3154.ga630765c.el9 ceph 321 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 298 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-3154.ga630765c.el9 ceph 100 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 85 k 2024-04-21T10:07:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.1 M 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 171 k 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.4 M 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 3.1 M 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-3154.ga630765c.el9 ceph 21 M 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 34 k 2024-04-21T10:07:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-3154.ga630765c.el9 ceph 2.4 M 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 249 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-3154.ga630765c.el9 ceph 4.7 M 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-3154.ga630765c.el9 ceph 17 M 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.ga630765c.el9 ceph-noarch 16 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-3154.ga630765c.el9 ceph 25 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-3154.ga630765c.el9 ceph 163 k 2024-04-21T10:07:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 501 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-3154.ga630765c.el9 ceph 5.4 M 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-21T10:07:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.ga630765c.el9 ceph 45 k 2024-04-21T10:07:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-3154.ga630765c.el9 ceph 135 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-21T10:07:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-21T10:07:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-21T10:07:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-21T10:07:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout:Install 148 Packages 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-04-21T10:07:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:07:46.275 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 218 M 2024-04-21T10:07:46.275 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-21T10:07:47.336 INFO:teuthology.orchestra.run.smithi170.stdout:(1/150): ceph-19.0.0-3154.ga630765c.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-04-21T10:07:47.518 INFO:teuthology.orchestra.run.smithi077.stdout:(26/150): rbd-mirror-19.0.0-3154.ga630765c.el9. 1.2 MB/s | 3.1 MB 00:02 2024-04-21T10:07:47.668 INFO:teuthology.orchestra.run.smithi077.stdout:(27/150): librgw2-19.0.0-3154.ga630765c.el9.x86 900 kB/s | 5.4 MB 00:06 2024-04-21T10:07:47.727 INFO:teuthology.orchestra.run.smithi077.stdout:(28/150): rbd-nbd-19.0.0-3154.ga630765c.el9.x86 822 kB/s | 171 kB 00:00 2024-04-21T10:07:47.761 INFO:teuthology.orchestra.run.smithi077.stdout:(29/150): ceph-grafana-dashboards-19.0.0-3154.g 372 kB/s | 34 kB 00:00 2024-04-21T10:07:47.928 INFO:teuthology.orchestra.run.smithi077.stdout:(30/150): ceph-mgr-cephadm-19.0.0-3154.ga630765 709 kB/s | 142 kB 00:00 2024-04-21T10:07:48.116 INFO:teuthology.orchestra.run.smithi191.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3154.ga6307 1.6 MB/s | 3.5 MB 00:02 2024-04-21T10:07:48.516 INFO:teuthology.orchestra.run.smithi191.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3154.ga6 623 kB/s | 249 kB 00:00 2024-04-21T10:07:48.616 INFO:teuthology.orchestra.run.smithi191.stdout:(33/150): ceph-mgr-rook-19.0.0-3154.ga630765c.e 493 kB/s | 49 kB 00:00 2024-04-21T10:07:48.728 INFO:teuthology.orchestra.run.smithi170.stdout:(2/150): ceph-fuse-19.0.0-3154.ga630765c.el9.x8 640 kB/s | 890 kB 00:01 2024-04-21T10:07:48.733 INFO:teuthology.orchestra.run.smithi191.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3154.ga 141 kB/s | 16 kB 00:00 2024-04-21T10:07:48.961 INFO:teuthology.orchestra.run.smithi170.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 622 kB/s | 145 kB 00:00 2024-04-21T10:07:49.417 INFO:teuthology.orchestra.run.smithi191.stdout:(35/150): ceph-volume-19.0.0-3154.ga630765c.el9 400 kB/s | 273 kB 00:00 2024-04-21T10:07:50.353 INFO:teuthology.orchestra.run.smithi170.stdout:(4/150): ceph-base-19.0.0-3154.ga630765c.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-04-21T10:07:50.508 INFO:teuthology.orchestra.run.smithi191.stdout:(36/150): cephadm-19.0.0-3154.ga630765c.el9.noa 698 kB/s | 762 kB 00:01 2024-04-21T10:07:50.650 INFO:teuthology.orchestra.run.smithi191.stdout:(37/150): cephfs-top-19.0.0-3154.ga630765c.el9. 129 kB/s | 18 kB 00:00 2024-04-21T10:07:50.801 INFO:teuthology.orchestra.run.smithi191.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-04-21T10:07:50.895 INFO:teuthology.orchestra.run.smithi170.stdout:(5/150): ceph-mgr-19.0.0-3154.ga630765c.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-04-21T10:07:50.918 INFO:teuthology.orchestra.run.smithi191.stdout:(39/150): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-21T10:07:50.968 INFO:teuthology.orchestra.run.smithi191.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-21T10:07:51.018 INFO:teuthology.orchestra.run.smithi191.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-21T10:07:51.127 INFO:teuthology.orchestra.run.smithi191.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-21T10:07:51.211 INFO:teuthology.orchestra.run.smithi191.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-21T10:07:51.261 INFO:teuthology.orchestra.run.smithi191.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-21T10:07:51.311 INFO:teuthology.orchestra.run.smithi191.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-21T10:07:51.362 INFO:teuthology.orchestra.run.smithi191.stdout:(46/150): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-21T10:07:51.395 INFO:teuthology.orchestra.run.smithi170.stdout:(6/150): ceph-mds-19.0.0-3154.ga630765c.el9.x86 993 kB/s | 2.4 MB 00:02 2024-04-21T10:07:51.478 INFO:teuthology.orchestra.run.smithi191.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-04-21T10:07:51.604 INFO:teuthology.orchestra.run.smithi191.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 7.4 MB/s | 943 kB 00:00 2024-04-21T10:07:51.671 INFO:teuthology.orchestra.run.smithi191.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-21T10:07:51.721 INFO:teuthology.orchestra.run.smithi191.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-04-21T10:07:51.796 INFO:teuthology.orchestra.run.smithi191.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-21T10:07:51.847 INFO:teuthology.orchestra.run.smithi191.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-04-21T10:07:52.081 INFO:teuthology.orchestra.run.smithi191.stdout:(53/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-21T10:07:52.131 INFO:teuthology.orchestra.run.smithi191.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-04-21T10:07:52.173 INFO:teuthology.orchestra.run.smithi191.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-04-21T10:07:52.240 INFO:teuthology.orchestra.run.smithi191.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-04-21T10:07:52.298 INFO:teuthology.orchestra.run.smithi191.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-04-21T10:07:52.370 INFO:teuthology.orchestra.run.smithi170.stdout:(7/150): ceph-mon-19.0.0-3154.ga630765c.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-04-21T10:07:52.398 INFO:teuthology.orchestra.run.smithi191.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-21T10:07:52.507 INFO:teuthology.orchestra.run.smithi191.stdout:(59/150): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 582 kB 00:00 2024-04-21T10:07:52.566 INFO:teuthology.orchestra.run.smithi191.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-04-21T10:07:52.625 INFO:teuthology.orchestra.run.smithi191.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-04-21T10:07:52.717 INFO:teuthology.orchestra.run.smithi191.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-21T10:07:52.783 INFO:teuthology.orchestra.run.smithi191.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-21T10:07:52.834 INFO:teuthology.orchestra.run.smithi191.stdout:(64/150): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-04-21T10:07:53.143 INFO:teuthology.orchestra.run.smithi191.stdout:(65/150): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-04-21T10:07:53.385 INFO:teuthology.orchestra.run.smithi191.stdout:(66/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 17 MB/s | 4.1 MB 00:00 2024-04-21T10:07:53.535 INFO:teuthology.orchestra.run.smithi191.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-21T10:07:53.710 INFO:teuthology.orchestra.run.smithi191.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 5.1 MB/s | 911 kB 00:00 2024-04-21T10:07:53.777 INFO:teuthology.orchestra.run.smithi191.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-04-21T10:07:54.069 INFO:teuthology.orchestra.run.smithi191.stdout:(70/150): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-04-21T10:07:54.086 INFO:teuthology.orchestra.run.smithi077.stdout:(31/150): ceph-mgr-diskprediction-local-19.0.0- 1.2 MB/s | 7.4 MB 00:06 2024-04-21T10:07:54.170 INFO:teuthology.orchestra.run.smithi077.stdout:(32/150): ceph-mgr-dashboard-19.0.0-3154.ga6307 565 kB/s | 3.5 MB 00:06 2024-04-21T10:07:54.186 INFO:teuthology.orchestra.run.smithi191.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-04-21T10:07:54.245 INFO:teuthology.orchestra.run.smithi191.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-21T10:07:54.295 INFO:teuthology.orchestra.run.smithi077.stdout:(33/150): ceph-mgr-rook-19.0.0-3154.ga630765c.e 394 kB/s | 49 kB 00:00 2024-04-21T10:07:54.421 INFO:teuthology.orchestra.run.smithi077.stdout:(34/150): ceph-mgr-modules-core-19.0.0-3154.ga6 745 kB/s | 249 kB 00:00 2024-04-21T10:07:54.446 INFO:teuthology.orchestra.run.smithi077.stdout:(35/150): ceph-prometheus-alerts-19.0.0-3154.ga 109 kB/s | 16 kB 00:00 2024-04-21T10:07:54.512 INFO:teuthology.orchestra.run.smithi191.stdout:(73/150): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-21T10:07:54.603 INFO:teuthology.orchestra.run.smithi191.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-21T10:07:54.679 INFO:teuthology.orchestra.run.smithi191.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-04-21T10:07:54.705 INFO:teuthology.orchestra.run.smithi077.stdout:(36/150): ceph-volume-19.0.0-3154.ga630765c.el9 964 kB/s | 273 kB 00:00 2024-04-21T10:07:54.729 INFO:teuthology.orchestra.run.smithi191.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-04-21T10:07:54.779 INFO:teuthology.orchestra.run.smithi191.stdout:(77/150): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-04-21T10:07:54.822 INFO:teuthology.orchestra.run.smithi077.stdout:(37/150): cephfs-top-19.0.0-3154.ga630765c.el9. 156 kB/s | 18 kB 00:00 2024-04-21T10:07:54.846 INFO:teuthology.orchestra.run.smithi191.stdout:(78/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-21T10:07:54.897 INFO:teuthology.orchestra.run.smithi191.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-04-21T10:07:55.164 INFO:teuthology.orchestra.run.smithi077.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 235 kB/s | 80 kB 00:00 2024-04-21T10:07:55.289 INFO:teuthology.orchestra.run.smithi191.stdout:(80/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-04-21T10:07:55.364 INFO:teuthology.orchestra.run.smithi191.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-21T10:07:55.448 INFO:teuthology.orchestra.run.smithi191.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-21T10:07:55.506 INFO:teuthology.orchestra.run.smithi191.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-21T10:07:55.594 INFO:teuthology.orchestra.run.smithi191.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 485 kB/s | 42 kB 00:00 2024-04-21T10:07:55.605 INFO:teuthology.orchestra.run.smithi077.stdout:(39/150): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-04-21T10:07:55.647 INFO:teuthology.orchestra.run.smithi077.stdout:(40/150): cephadm-19.0.0-3154.ga630765c.el9.noa 635 kB/s | 762 kB 00:01 2024-04-21T10:07:55.674 INFO:teuthology.orchestra.run.smithi191.stdout:(85/150): python3-protobuf-3.14.0-13.el9.noarch 3.3 MB/s | 269 kB 00:00 2024-04-21T10:07:55.714 INFO:teuthology.orchestra.run.smithi077.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-21T10:07:55.741 INFO:teuthology.orchestra.run.smithi191.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-21T10:07:55.816 INFO:teuthology.orchestra.run.smithi191.stdout:(87/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-21T10:07:55.900 INFO:teuthology.orchestra.run.smithi191.stdout:(88/150): python3-pytz-2021.1-5.el9.noarch.rpm 612 kB/s | 51 kB 00:00 2024-04-21T10:07:55.958 INFO:teuthology.orchestra.run.smithi191.stdout:(89/150): python3-requests-oauthlib-1.3.0-12.el 922 kB/s | 54 kB 00:00 2024-04-21T10:07:55.990 INFO:teuthology.orchestra.run.smithi077.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 4.5 MB/s | 1.2 MB 00:00 2024-04-21T10:07:56.098 INFO:teuthology.orchestra.run.smithi077.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-04-21T10:07:56.207 INFO:teuthology.orchestra.run.smithi077.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-04-21T10:07:56.257 INFO:teuthology.orchestra.run.smithi077.stdout:(45/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 415 kB/s | 253 kB 00:00 2024-04-21T10:07:56.316 INFO:teuthology.orchestra.run.smithi077.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-04-21T10:07:56.366 INFO:teuthology.orchestra.run.smithi077.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-04-21T10:07:56.491 INFO:teuthology.orchestra.run.smithi077.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-04-21T10:07:56.492 INFO:teuthology.orchestra.run.smithi191.stdout:(90/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-04-21T10:07:56.512 INFO:teuthology.orchestra.run.smithi170.stdout:(8/150): ceph-radosgw-19.0.0-3154.ga630765c.el9 2.6 MB/s | 11 MB 00:04 2024-04-21T10:07:56.542 INFO:teuthology.orchestra.run.smithi077.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-21T10:07:56.551 INFO:teuthology.orchestra.run.smithi191.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 717 kB/s | 42 kB 00:00 2024-04-21T10:07:56.584 INFO:teuthology.orchestra.run.smithi077.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-04-21T10:07:56.601 INFO:teuthology.orchestra.run.smithi077.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-21T10:07:56.609 INFO:teuthology.orchestra.run.smithi191.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-04-21T10:07:56.628 INFO:teuthology.orchestra.run.smithi170.stdout:(9/150): ceph-selinux-19.0.0-3154.ga630765c.el9 216 kB/s | 25 kB 00:00 2024-04-21T10:07:56.668 INFO:teuthology.orchestra.run.smithi077.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-21T10:07:56.684 INFO:teuthology.orchestra.run.smithi077.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-04-21T10:07:56.685 INFO:teuthology.orchestra.run.smithi191.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-21T10:07:56.718 INFO:teuthology.orchestra.run.smithi077.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 546 kB/s | 18 kB 00:00 2024-04-21T10:07:56.743 INFO:teuthology.orchestra.run.smithi191.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-04-21T10:07:56.785 INFO:teuthology.orchestra.run.smithi077.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-21T10:07:56.793 INFO:teuthology.orchestra.run.smithi191.stdout:(95/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-04-21T10:07:56.811 INFO:teuthology.orchestra.run.smithi077.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-04-21T10:07:56.836 INFO:teuthology.orchestra.run.smithi077.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-21T10:07:56.861 INFO:teuthology.orchestra.run.smithi077.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-04-21T10:07:56.886 INFO:teuthology.orchestra.run.smithi191.stdout:(96/150): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-04-21T10:07:56.895 INFO:teuthology.orchestra.run.smithi077.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-21T10:07:56.920 INFO:teuthology.orchestra.run.smithi077.stdout:(60/150): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-04-21T10:07:56.944 INFO:teuthology.orchestra.run.smithi191.stdout:(97/150): uuid-1.6.2-55.el9.x86_64.rpm 992 kB/s | 58 kB 00:00 2024-04-21T10:07:56.962 INFO:teuthology.orchestra.run.smithi077.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-21T10:07:56.988 INFO:teuthology.orchestra.run.smithi077.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-21T10:07:57.012 INFO:teuthology.orchestra.run.smithi191.stdout:(98/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-21T10:07:57.013 INFO:teuthology.orchestra.run.smithi077.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-21T10:07:57.038 INFO:teuthology.orchestra.run.smithi077.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-21T10:07:57.063 INFO:teuthology.orchestra.run.smithi077.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-04-21T10:07:57.070 INFO:teuthology.orchestra.run.smithi191.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-21T10:07:57.128 INFO:teuthology.orchestra.run.smithi191.stdout:(100/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-04-21T10:07:57.179 INFO:teuthology.orchestra.run.smithi191.stdout:(101/150): lua-devel-5.4.4-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2024-04-21T10:07:57.279 INFO:teuthology.orchestra.run.smithi191.stdout:(102/150): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-04-21T10:07:57.539 INFO:teuthology.orchestra.run.smithi077.stdout:(66/150): openblas-openmp-0.3.21-2.el9.x86_64.r 9.5 MB/s | 4.7 MB 00:00 2024-04-21T10:07:57.597 INFO:teuthology.orchestra.run.smithi077.stdout:(67/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 7.7 MB/s | 4.1 MB 00:00 2024-04-21T10:07:57.804 INFO:teuthology.orchestra.run.smithi191.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-04-21T10:07:57.848 INFO:teuthology.orchestra.run.smithi077.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 3.6 MB/s | 911 kB 00:00 2024-04-21T10:07:57.904 INFO:teuthology.orchestra.run.smithi191.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-04-21T10:07:57.964 INFO:teuthology.orchestra.run.smithi077.stdout:(69/150): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-04-21T10:07:57.990 INFO:teuthology.orchestra.run.smithi077.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 940 kB/s | 133 kB 00:00 2024-04-21T10:07:58.005 INFO:teuthology.orchestra.run.smithi191.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-21T10:07:58.090 INFO:teuthology.orchestra.run.smithi077.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-21T10:07:58.182 INFO:teuthology.orchestra.run.smithi077.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-04-21T10:07:58.216 INFO:teuthology.orchestra.run.smithi077.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 699 kB/s | 87 kB 00:00 2024-04-21T10:07:58.358 INFO:teuthology.orchestra.run.smithi077.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-21T10:07:58.405 INFO:teuthology.orchestra.run.smithi191.stdout:(106/150): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-21T10:07:58.497 INFO:teuthology.orchestra.run.smithi191.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-04-21T10:07:58.597 INFO:teuthology.orchestra.run.smithi191.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-04-21T10:07:58.675 INFO:teuthology.orchestra.run.smithi077.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-04-21T10:07:58.698 INFO:teuthology.orchestra.run.smithi191.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 673 kB/s | 67 kB 00:00 2024-04-21T10:07:58.700 INFO:teuthology.orchestra.run.smithi077.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 725 kB/s | 248 kB 00:00 2024-04-21T10:07:58.725 INFO:teuthology.orchestra.run.smithi077.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-21T10:07:58.750 INFO:teuthology.orchestra.run.smithi077.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-21T10:07:58.776 INFO:teuthology.orchestra.run.smithi077.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-21T10:07:58.789 INFO:teuthology.orchestra.run.smithi191.stdout:(110/150): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-21T10:07:58.801 INFO:teuthology.orchestra.run.smithi077.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-04-21T10:07:58.898 INFO:teuthology.orchestra.run.smithi191.stdout:(111/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2024-04-21T10:07:58.901 INFO:teuthology.orchestra.run.smithi077.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-21T10:07:59.007 INFO:teuthology.orchestra.run.smithi191.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-04-21T10:07:59.068 INFO:teuthology.orchestra.run.smithi077.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-04-21T10:07:59.099 INFO:teuthology.orchestra.run.smithi191.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 475 kB/s | 43 kB 00:00 2024-04-21T10:07:59.169 INFO:teuthology.orchestra.run.smithi077.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 773 kB/s | 77 kB 00:00 2024-04-21T10:07:59.182 INFO:teuthology.orchestra.run.smithi191.stdout:(114/150): python3-cachetools-4.2.4-1.el9.noarc 386 kB/s | 32 kB 00:00 2024-04-21T10:07:59.244 INFO:teuthology.orchestra.run.smithi077.stdout:(84/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-04-21T10:07:59.266 INFO:teuthology.orchestra.run.smithi191.stdout:(115/150): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2024-04-21T10:07:59.269 INFO:teuthology.orchestra.run.smithi077.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-04-21T10:07:59.303 INFO:teuthology.orchestra.run.smithi077.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-04-21T10:07:59.345 INFO:teuthology.orchestra.run.smithi077.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-21T10:07:59.366 INFO:teuthology.orchestra.run.smithi191.stdout:(116/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-21T10:07:59.370 INFO:teuthology.orchestra.run.smithi077.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-21T10:07:59.396 INFO:teuthology.orchestra.run.smithi077.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-21T10:07:59.421 INFO:teuthology.orchestra.run.smithi077.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-21T10:07:59.467 INFO:teuthology.orchestra.run.smithi191.stdout:(117/150): ceph-mgr-diskprediction-local-19.0.0 564 kB/s | 7.4 MB 00:13 2024-04-21T10:07:59.471 INFO:teuthology.orchestra.run.smithi077.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-04-21T10:07:59.492 INFO:teuthology.orchestra.run.smithi191.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-21T10:07:59.546 INFO:teuthology.orchestra.run.smithi077.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-04-21T10:07:59.592 INFO:teuthology.orchestra.run.smithi191.stdout:(119/150): python3-colorama-0.4.4-12.el9.noarch 354 kB/s | 35 kB 00:00 2024-04-21T10:07:59.613 INFO:teuthology.orchestra.run.smithi077.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-21T10:07:59.672 INFO:teuthology.orchestra.run.smithi077.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 618 kB/s | 36 kB 00:00 2024-04-21T10:07:59.693 INFO:teuthology.orchestra.run.smithi191.stdout:(120/150): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-04-21T10:07:59.872 INFO:teuthology.orchestra.run.smithi077.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-21T10:07:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 210 kB/s | 47 kB 00:00 2024-04-21T10:07:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-21T10:07:59.935 INFO:teuthology.orchestra.run.smithi191.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 649 kB/s | 303 kB 00:00 2024-04-21T10:07:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-21T10:07:59.985 INFO:teuthology.orchestra.run.smithi191.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 7.0 MB/s | 2.0 MB 00:00 2024-04-21T10:07:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-21T10:08:00.024 INFO:teuthology.orchestra.run.smithi077.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-04-21T10:08:00.035 INFO:teuthology.orchestra.run.smithi191.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-21T10:08:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-04-21T10:08:00.077 INFO:teuthology.orchestra.run.smithi191.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-21T10:08:00.124 INFO:teuthology.orchestra.run.smithi077.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-04-21T10:08:00.128 INFO:teuthology.orchestra.run.smithi191.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-21T10:08:00.178 INFO:teuthology.orchestra.run.smithi191.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-04-21T10:08:00.220 INFO:teuthology.orchestra.run.smithi191.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-04-21T10:08:00.233 INFO:teuthology.orchestra.run.smithi077.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-04-21T10:08:00.270 INFO:teuthology.orchestra.run.smithi191.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-04-21T10:08:00.379 INFO:teuthology.orchestra.run.smithi191.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2024-04-21T10:08:00.471 INFO:teuthology.orchestra.run.smithi191.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 861 kB/s | 79 kB 00:00 2024-04-21T10:08:00.504 INFO:teuthology.orchestra.run.smithi191.stdout:(131/150): python3-kubernetes-26.1.0-2.el9.noar 3.6 MB/s | 1.0 MB 00:00 2024-04-21T10:08:00.563 INFO:teuthology.orchestra.run.smithi191.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-04-21T10:08:00.605 INFO:teuthology.orchestra.run.smithi191.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-21T10:08:00.655 INFO:teuthology.orchestra.run.smithi191.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-04-21T10:08:00.730 INFO:teuthology.orchestra.run.smithi191.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 718 kB/s | 90 kB 00:00 2024-04-21T10:08:00.756 INFO:teuthology.orchestra.run.smithi191.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-04-21T10:08:00.800 INFO:teuthology.orchestra.run.smithi077.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 545 kB/s | 309 kB 00:00 2024-04-21T10:08:00.823 INFO:teuthology.orchestra.run.smithi191.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-21T10:08:00.856 INFO:teuthology.orchestra.run.smithi191.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-21T10:08:00.900 INFO:teuthology.orchestra.run.smithi077.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-21T10:08:00.915 INFO:teuthology.orchestra.run.smithi191.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-04-21T10:08:00.933 INFO:teuthology.orchestra.run.smithi077.stdout:(106/150): abseil-cpp-20211102.0-3.el9.x86_64.r 677 kB/s | 548 kB 00:00 2024-04-21T10:08:00.948 INFO:teuthology.orchestra.run.smithi191.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2024-04-21T10:08:01.007 INFO:teuthology.orchestra.run.smithi191.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2024-04-21T10:08:01.034 INFO:teuthology.orchestra.run.smithi077.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-04-21T10:08:01.049 INFO:teuthology.orchestra.run.smithi191.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-21T10:08:01.099 INFO:teuthology.orchestra.run.smithi191.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2024-04-21T10:08:01.134 INFO:teuthology.orchestra.run.smithi077.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-04-21T10:08:01.158 INFO:teuthology.orchestra.run.smithi191.stdout:(144/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-21T10:08:01.200 INFO:teuthology.orchestra.run.smithi191.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-04-21T10:08:01.243 INFO:teuthology.orchestra.run.smithi077.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2024-04-21T10:08:01.259 INFO:teuthology.orchestra.run.smithi191.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-21T10:08:01.302 INFO:teuthology.orchestra.run.smithi077.stdout:(110/150): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-21T10:08:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-21T10:08:01.401 INFO:teuthology.orchestra.run.smithi191.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-04-21T10:08:01.410 INFO:teuthology.orchestra.run.smithi077.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2024-04-21T10:08:01.461 INFO:teuthology.orchestra.run.smithi077.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-04-21T10:08:01.503 INFO:teuthology.orchestra.run.smithi077.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-04-21T10:08:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-04-21T10:08:01.595 INFO:teuthology.orchestra.run.smithi077.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-04-21T10:08:01.671 INFO:teuthology.orchestra.run.smithi077.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-21T10:08:01.754 INFO:teuthology.orchestra.run.smithi077.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-04-21T10:08:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-21T10:08:01.846 INFO:teuthology.orchestra.run.smithi077.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 384 kB/s | 35 kB 00:00 2024-04-21T10:08:01.880 INFO:teuthology.orchestra.run.smithi077.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-04-21T10:08:01.988 INFO:teuthology.orchestra.run.smithi077.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-21T10:08:02.080 INFO:teuthology.orchestra.run.smithi077.stdout:(123/150): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-04-21T10:08:02.097 INFO:teuthology.orchestra.run.smithi077.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-04-21T10:08:02.164 INFO:teuthology.orchestra.run.smithi077.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2024-04-21T10:08:02.181 INFO:teuthology.orchestra.run.smithi077.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-04-21T10:08:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-04-21T10:08:02.290 INFO:teuthology.orchestra.run.smithi077.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-21T10:08:02.382 INFO:teuthology.orchestra.run.smithi077.stdout:(129/150): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-21T10:08:02.407 INFO:teuthology.orchestra.run.smithi077.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-04-21T10:08:02.462 INFO:teuthology.orchestra.run.smithi170.stdout:(10/150): ceph-osd-19.0.0-3154.ga630765c.el9.x8 1.5 MB/s | 17 MB 00:11 2024-04-21T10:08:02.491 INFO:teuthology.orchestra.run.smithi077.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-04-21T10:08:02.516 INFO:teuthology.orchestra.run.smithi077.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 531 kB/s | 58 kB 00:00 2024-04-21T10:08:02.641 INFO:teuthology.orchestra.run.smithi077.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-04-21T10:08:02.675 INFO:teuthology.orchestra.run.smithi077.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-04-21T10:08:02.759 INFO:teuthology.orchestra.run.smithi077.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 769 kB/s | 90 kB 00:00 2024-04-21T10:08:02.792 INFO:teuthology.orchestra.run.smithi077.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 242 kB/s | 28 kB 00:00 2024-04-21T10:08:02.876 INFO:teuthology.orchestra.run.smithi077.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2024-04-21T10:08:02.901 INFO:teuthology.orchestra.run.smithi077.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-21T10:08:02.993 INFO:teuthology.orchestra.run.smithi077.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2024-04-21T10:08:03.018 INFO:teuthology.orchestra.run.smithi077.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2024-04-21T10:08:03.020 INFO:teuthology.orchestra.run.smithi170.stdout:(11/150): cephfs-mirror-19.0.0-3154.ga630765c.e 403 kB/s | 225 kB 00:00 2024-04-21T10:08:03.104 INFO:teuthology.orchestra.run.smithi077.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 460 kB/s | 51 kB 00:00 2024-04-21T10:08:03.112 INFO:teuthology.orchestra.run.smithi170.stdout:(12/150): cephfs-shell-19.0.0-3154.ga630765c.el 295 kB/s | 27 kB 00:00 2024-04-21T10:08:03.171 INFO:teuthology.orchestra.run.smithi077.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-21T10:08:03.205 INFO:teuthology.orchestra.run.smithi077.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 897 kB/s | 90 kB 00:00 2024-04-21T10:08:03.229 INFO:teuthology.orchestra.run.smithi170.stdout:(13/150): libcephfs-devel-19.0.0-3154.ga630765c 272 kB/s | 32 kB 00:00 2024-04-21T10:08:03.305 INFO:teuthology.orchestra.run.smithi077.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-04-21T10:08:03.330 INFO:teuthology.orchestra.run.smithi077.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-04-21T10:08:03.449 INFO:teuthology.orchestra.run.smithi077.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-04-21T10:08:03.556 INFO:teuthology.orchestra.run.smithi077.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-04-21T10:08:04.938 INFO:teuthology.orchestra.run.smithi170.stdout:(14/150): libcephfs2-19.0.0-3154.ga630765c.el9. 437 kB/s | 746 kB 00:01 2024-04-21T10:08:05.346 INFO:teuthology.orchestra.run.smithi170.stdout:(15/150): libcephsqlite-19.0.0-3154.ga630765c.e 400 kB/s | 163 kB 00:00 2024-04-21T10:08:05.688 INFO:teuthology.orchestra.run.smithi170.stdout:(16/150): librados-devel-19.0.0-3154.ga630765c. 371 kB/s | 127 kB 00:00 2024-04-21T10:08:06.098 INFO:teuthology.orchestra.run.smithi077.stdout:(148/150): librbd1-19.0.0-3154.ga630765c.el9.x8 1.2 MB/s | 3.1 MB 00:02 2024-04-21T10:08:06.159 INFO:teuthology.orchestra.run.smithi191.stdout:(148/150): librados2-19.0.0-3154.ga630765c.el9. 709 kB/s | 3.4 MB 00:04 2024-04-21T10:08:06.530 INFO:teuthology.orchestra.run.smithi170.stdout:(17/150): libradosstriper1-19.0.0-3154.ga630765 595 kB/s | 501 kB 00:00 2024-04-21T10:08:07.001 INFO:teuthology.orchestra.run.smithi191.stdout:(149/150): librbd1-19.0.0-3154.ga630765c.el9.x8 575 kB/s | 3.1 MB 00:05 2024-04-21T10:08:08.623 INFO:teuthology.orchestra.run.smithi077.stdout:(149/150): librados2-19.0.0-3154.ga630765c.el9. 672 kB/s | 3.4 MB 00:05 2024-04-21T10:08:10.080 INFO:teuthology.orchestra.run.smithi170.stdout:(18/150): ceph-common-19.0.0-3154.ga630765c.el9 936 kB/s | 21 MB 00:23 2024-04-21T10:08:10.272 INFO:teuthology.orchestra.run.smithi170.stdout:(19/150): python3-ceph-argparse-19.0.0-3154.ga6 236 kB/s | 45 kB 00:00 2024-04-21T10:08:10.564 INFO:teuthology.orchestra.run.smithi170.stdout:(20/150): python3-ceph-common-19.0.0-3154.ga630 460 kB/s | 135 kB 00:00 2024-04-21T10:08:10.873 INFO:teuthology.orchestra.run.smithi170.stdout:(21/150): python3-cephfs-19.0.0-3154.ga630765c. 524 kB/s | 162 kB 00:00 2024-04-21T10:08:11.323 INFO:teuthology.orchestra.run.smithi170.stdout:(22/150): python3-rados-19.0.0-3154.ga630765c.e 714 kB/s | 321 kB 00:00 2024-04-21T10:08:11.748 INFO:teuthology.orchestra.run.smithi170.stdout:(23/150): python3-rbd-19.0.0-3154.ga630765c.el9 702 kB/s | 298 kB 00:00 2024-04-21T10:08:11.932 INFO:teuthology.orchestra.run.smithi170.stdout:(24/150): python3-rgw-19.0.0-3154.ga630765c.el9 543 kB/s | 100 kB 00:00 2024-04-21T10:08:12.107 INFO:teuthology.orchestra.run.smithi170.stdout:(25/150): rbd-fuse-19.0.0-3154.ga630765c.el9.x8 488 kB/s | 85 kB 00:00 2024-04-21T10:08:13.516 INFO:teuthology.orchestra.run.smithi170.stdout:(26/150): librgw2-19.0.0-3154.ga630765c.el9.x86 787 kB/s | 5.4 MB 00:06 2024-04-21T10:08:13.758 INFO:teuthology.orchestra.run.smithi170.stdout:(27/150): rbd-nbd-19.0.0-3154.ga630765c.el9.x86 709 kB/s | 171 kB 00:00 2024-04-21T10:08:13.866 INFO:teuthology.orchestra.run.smithi170.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3154.g 316 kB/s | 34 kB 00:00 2024-04-21T10:08:14.050 INFO:teuthology.orchestra.run.smithi170.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3154.ga630765 776 kB/s | 142 kB 00:00 2024-04-21T10:08:16.008 INFO:teuthology.orchestra.run.smithi170.stdout:(30/150): rbd-mirror-19.0.0-3154.ga630765c.el9. 811 kB/s | 3.1 MB 00:03 2024-04-21T10:08:17.425 INFO:teuthology.orchestra.run.smithi170.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3154.ga6307 1.0 MB/s | 3.5 MB 00:03 2024-04-21T10:08:17.759 INFO:teuthology.orchestra.run.smithi170.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3154.ga6 747 kB/s | 249 kB 00:00 2024-04-21T10:08:17.884 INFO:teuthology.orchestra.run.smithi170.stdout:(33/150): ceph-mgr-rook-19.0.0-3154.ga630765c.e 395 kB/s | 49 kB 00:00 2024-04-21T10:08:17.984 INFO:teuthology.orchestra.run.smithi170.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3154.ga 164 kB/s | 16 kB 00:00 2024-04-21T10:08:18.268 INFO:teuthology.orchestra.run.smithi170.stdout:(35/150): ceph-volume-19.0.0-3154.ga630765c.el9 964 kB/s | 273 kB 00:00 2024-04-21T10:08:19.101 INFO:teuthology.orchestra.run.smithi170.stdout:(36/150): cephadm-19.0.0-3154.ga630765c.el9.noa 915 kB/s | 762 kB 00:00 2024-04-21T10:08:19.194 INFO:teuthology.orchestra.run.smithi170.stdout:(37/150): cephfs-top-19.0.0-3154.ga630765c.el9. 199 kB/s | 18 kB 00:00 2024-04-21T10:08:19.377 INFO:teuthology.orchestra.run.smithi170.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 439 kB/s | 80 kB 00:00 2024-04-21T10:08:19.494 INFO:teuthology.orchestra.run.smithi170.stdout:(39/150): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-21T10:08:19.561 INFO:teuthology.orchestra.run.smithi170.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-21T10:08:19.628 INFO:teuthology.orchestra.run.smithi170.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-21T10:08:19.719 INFO:teuthology.orchestra.run.smithi170.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-04-21T10:08:19.787 INFO:teuthology.orchestra.run.smithi170.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-21T10:08:19.853 INFO:teuthology.orchestra.run.smithi170.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-21T10:08:19.920 INFO:teuthology.orchestra.run.smithi170.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-21T10:08:19.988 INFO:teuthology.orchestra.run.smithi170.stdout:(46/150): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-21T10:08:20.080 INFO:teuthology.orchestra.run.smithi170.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 7.4 MB/s | 689 kB 00:00 2024-04-21T10:08:20.180 INFO:teuthology.orchestra.run.smithi170.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 9.2 MB/s | 943 kB 00:00 2024-04-21T10:08:20.247 INFO:teuthology.orchestra.run.smithi170.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-21T10:08:20.289 INFO:teuthology.orchestra.run.smithi170.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 516 kB/s | 21 kB 00:00 2024-04-21T10:08:20.364 INFO:teuthology.orchestra.run.smithi170.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-21T10:08:20.406 INFO:teuthology.orchestra.run.smithi170.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 788 kB/s | 33 kB 00:00 2024-04-21T10:08:20.548 INFO:teuthology.orchestra.run.smithi170.stdout:(53/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-21T10:08:20.599 INFO:teuthology.orchestra.run.smithi170.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-21T10:08:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-04-21T10:08:20.707 INFO:teuthology.orchestra.run.smithi170.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-21T10:08:20.766 INFO:teuthology.orchestra.run.smithi170.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-04-21T10:08:20.875 INFO:teuthology.orchestra.run.smithi170.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-04-21T10:08:20.958 INFO:teuthology.orchestra.run.smithi170.stdout:(59/150): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-04-21T10:08:21.009 INFO:teuthology.orchestra.run.smithi170.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-04-21T10:08:21.067 INFO:teuthology.orchestra.run.smithi170.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-04-21T10:08:21.143 INFO:teuthology.orchestra.run.smithi170.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-21T10:08:21.210 INFO:teuthology.orchestra.run.smithi170.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-21T10:08:21.302 INFO:teuthology.orchestra.run.smithi170.stdout:(64/150): openblas-0.3.21-2.el9.x86_64.rpm 384 kB/s | 35 kB 00:00 2024-04-21T10:08:21.494 INFO:teuthology.orchestra.run.smithi170.stdout:(65/150): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-04-21T10:08:21.532 INFO:teuthology.orchestra.run.smithi191.stdout:(150/150): ceph-test-19.0.0-3154.ga630765c.el9. 1.0 MB/s | 49 MB 00:47 2024-04-21T10:08:21.535 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-21T10:08:21.535 INFO:teuthology.orchestra.run.smithi191.stdout:Total 3.9 MB/s | 218 MB 00:56 2024-04-21T10:08:21.669 INFO:teuthology.orchestra.run.smithi170.stdout:(66/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 24 MB/s | 4.1 MB 00:00 2024-04-21T10:08:21.777 INFO:teuthology.orchestra.run.smithi170.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-21T10:08:21.878 INFO:teuthology.orchestra.run.smithi170.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-21T10:08:21.945 INFO:teuthology.orchestra.run.smithi170.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-21T10:08:22.153 INFO:teuthology.orchestra.run.smithi170.stdout:(70/150): postgresql-server-13.14-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-04-21T10:08:22.262 INFO:teuthology.orchestra.run.smithi170.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-21T10:08:22.331 INFO:teuthology.orchestra.run.smithi170.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 87 kB 00:00 2024-04-21T10:08:22.556 INFO:teuthology.orchestra.run.smithi170.stdout:(73/150): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-04-21T10:08:22.566 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-21T10:08:22.631 INFO:teuthology.orchestra.run.smithi170.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-21T10:08:22.690 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-21T10:08:22.691 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-21T10:08:22.715 INFO:teuthology.orchestra.run.smithi170.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-21T10:08:22.757 INFO:teuthology.orchestra.run.smithi170.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-04-21T10:08:22.807 INFO:teuthology.orchestra.run.smithi170.stdout:(77/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-21T10:08:22.874 INFO:teuthology.orchestra.run.smithi170.stdout:(78/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-21T10:08:22.925 INFO:teuthology.orchestra.run.smithi170.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-04-21T10:08:23.201 INFO:teuthology.orchestra.run.smithi170.stdout:(80/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-04-21T10:08:23.276 INFO:teuthology.orchestra.run.smithi170.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-21T10:08:23.351 INFO:teuthology.orchestra.run.smithi170.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-21T10:08:23.409 INFO:teuthology.orchestra.run.smithi170.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-21T10:08:23.468 INFO:teuthology.orchestra.run.smithi170.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-04-21T10:08:23.543 INFO:teuthology.orchestra.run.smithi170.stdout:(85/150): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-21T10:08:23.610 INFO:teuthology.orchestra.run.smithi170.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-21T10:08:23.685 INFO:teuthology.orchestra.run.smithi170.stdout:(87/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-21T10:08:23.744 INFO:teuthology.orchestra.run.smithi170.stdout:(88/150): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-04-21T10:08:23.828 INFO:teuthology.orchestra.run.smithi170.stdout:(89/150): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-04-21T10:08:24.353 INFO:teuthology.orchestra.run.smithi170.stdout:(90/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-21T10:08:24.398 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-21T10:08:24.399 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-21T10:08:24.412 INFO:teuthology.orchestra.run.smithi170.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 718 kB/s | 42 kB 00:00 2024-04-21T10:08:24.470 INFO:teuthology.orchestra.run.smithi170.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-21T10:08:24.545 INFO:teuthology.orchestra.run.smithi170.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-21T10:08:24.596 INFO:teuthology.orchestra.run.smithi170.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-04-21T10:08:24.655 INFO:teuthology.orchestra.run.smithi170.stdout:(95/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-04-21T10:08:24.730 INFO:teuthology.orchestra.run.smithi170.stdout:(96/150): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-21T10:08:24.788 INFO:teuthology.orchestra.run.smithi170.stdout:(97/150): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-04-21T10:08:24.855 INFO:teuthology.orchestra.run.smithi170.stdout:(98/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-21T10:08:24.914 INFO:teuthology.orchestra.run.smithi170.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-21T10:08:24.973 INFO:teuthology.orchestra.run.smithi170.stdout:(100/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-04-21T10:08:25.548 INFO:teuthology.orchestra.run.smithi170.stdout:(101/150): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-04-21T10:08:26.449 INFO:teuthology.orchestra.run.smithi170.stdout:(102/150): ceph-mgr-diskprediction-local-19.0.0 727 kB/s | 7.4 MB 00:10 2024-04-21T10:08:27.032 INFO:teuthology.orchestra.run.smithi170.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 940 kB/s | 548 kB 00:00 2024-04-21T10:08:27.249 INFO:teuthology.orchestra.run.smithi170.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 508 kB/s | 863 kB 00:01 2024-04-21T10:08:27.507 INFO:teuthology.orchestra.run.smithi170.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-21T10:08:27.534 INFO:teuthology.orchestra.run.smithi170.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 617 kB/s | 309 kB 00:00 2024-04-21T10:08:27.792 INFO:teuthology.orchestra.run.smithi170.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 100 kB/s | 26 kB 00:00 2024-04-21T10:08:28.133 INFO:teuthology.orchestra.run.smithi170.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-04-21T10:08:28.483 INFO:teuthology.orchestra.run.smithi170.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-21T10:08:28.625 INFO:teuthology.orchestra.run.smithi170.stdout:(110/150): libarrow-9.0.0-10.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-04-21T10:08:28.909 INFO:teuthology.orchestra.run.smithi170.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-21T10:08:29.292 INFO:teuthology.orchestra.run.smithi170.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-21T10:08:29.501 INFO:teuthology.orchestra.run.smithi170.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 926 kB/s | 548 kB 00:00 2024-04-21T10:08:29.643 INFO:teuthology.orchestra.run.smithi170.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 124 kB/s | 43 kB 00:00 2024-04-21T10:08:29.760 INFO:teuthology.orchestra.run.smithi170.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 124 kB/s | 32 kB 00:00 2024-04-21T10:08:29.902 INFO:teuthology.orchestra.run.smithi170.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 58 kB/s | 15 kB 00:00 2024-04-21T10:08:30.194 INFO:teuthology.orchestra.run.smithi170.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 396 kB/s | 172 kB 00:00 2024-04-21T10:08:30.210 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-21T10:08:30.292 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-21T10:08:30.317 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-21T10:08:30.360 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-21T10:08:30.411 INFO:teuthology.orchestra.run.smithi170.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 705 kB/s | 358 kB 00:00 2024-04-21T10:08:30.677 INFO:teuthology.orchestra.run.smithi170.stdout:(119/150): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-04-21T10:08:30.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-21T10:08:30.711 INFO:teuthology.orchestra.run.smithi170.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 586 kB/s | 303 kB 00:00 2024-04-21T10:08:30.793 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.0.0-3154.ga630765c.el9.x86_64 5/152 2024-04-21T10:08:30.914 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.0.0-3154.ga630765c.el9.x86_64 5/152 2024-04-21T10:08:30.936 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:08:31.020 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:08:31.061 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 7/152 2024-04-21T10:08:31.090 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-21T10:08:31.116 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-21T10:08:31.195 INFO:teuthology.orchestra.run.smithi170.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 392 kB/s | 203 kB 00:00 2024-04-21T10:08:31.272 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-21T10:08:31.331 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-21T10:08:31.358 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:08:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:08:31.488 INFO:teuthology.orchestra.run.smithi077.stdout:(150/150): ceph-test-19.0.0-3154.ga630765c.el9. 882 kB/s | 49 MB 00:56 2024-04-21T10:08:31.493 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-21T10:08:31.494 INFO:teuthology.orchestra.run.smithi077.stdout:Total 3.2 MB/s | 218 MB 01:07 2024-04-21T10:08:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 13/152 2024-04-21T10:08:31.539 INFO:teuthology.orchestra.run.smithi170.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.5 MB/s | 2.0 MB 00:00 2024-04-21T10:08:31.563 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 13/152 2024-04-21T10:08:31.585 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T10:08:31.606 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T10:08:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T10:08:31.803 INFO:teuthology.orchestra.run.smithi170.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 237 kB/s | 144 kB 00:00 2024-04-21T10:08:31.810 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T10:08:31.912 INFO:teuthology.orchestra.run.smithi170.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 29 kB/s | 11 kB 00:00 2024-04-21T10:08:31.925 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-21T10:08:32.025 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-21T10:08:32.068 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-21T10:08:32.103 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-21T10:08:32.104 INFO:teuthology.orchestra.run.smithi170.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 59 kB/s | 18 kB 00:00 2024-04-21T10:08:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-21T10:08:32.179 INFO:teuthology.orchestra.run.smithi170.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-21T10:08:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-21T10:08:32.254 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-21T10:08:32.287 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-21T10:08:32.323 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-21T10:08:32.371 INFO:teuthology.orchestra.run.smithi170.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-04-21T10:08:32.393 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-21T10:08:32.446 INFO:teuthology.orchestra.run.smithi170.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-21T10:08:32.463 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-21T10:08:32.492 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-21T10:08:32.499 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-21T10:08:32.528 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-21T10:08:32.605 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-21T10:08:32.622 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-21T10:08:32.622 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-21T10:08:32.639 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.0.0-3154.ga630765c.el9. 30/152 2024-04-21T10:08:32.682 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.ga630765c.el 31/152 2024-04-21T10:08:32.711 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_6 32/152 2024-04-21T10:08:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-21T10:08:32.796 INFO:teuthology.orchestra.run.smithi170.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-04-21T10:08:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-21T10:08:32.910 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-21T10:08:33.047 INFO:teuthology.orchestra.run.smithi170.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-21T10:08:33.064 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-21T10:08:33.129 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-21T10:08:33.222 INFO:teuthology.orchestra.run.smithi170.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 185 kB/s | 79 kB 00:00 2024-04-21T10:08:33.406 INFO:teuthology.orchestra.run.smithi170.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 161 kB/s | 58 kB 00:00 2024-04-21T10:08:33.667 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-21T10:08:33.698 INFO:teuthology.orchestra.run.smithi170.stdout:(133/150): ceph-test-19.0.0-3154.ga630765c.el9. 1.3 MB/s | 49 MB 00:37 2024-04-21T10:08:33.723 INFO:teuthology.orchestra.run.smithi170.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 52 kB/s | 16 kB 00:00 2024-04-21T10:08:33.751 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-21T10:08:33.765 INFO:teuthology.orchestra.run.smithi170.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 502 kB/s | 272 kB 00:00 2024-04-21T10:08:33.786 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-21T10:08:33.829 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-21T10:08:33.868 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.0.0-3154.ga630765c.el9.x86_6 42/152 2024-04-21T10:08:33.901 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-21T10:08:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-21T10:08:33.990 INFO:teuthology.orchestra.run.smithi170.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-21T10:08:34.032 INFO:teuthology.orchestra.run.smithi170.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-21T10:08:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-21T10:08:34.057 INFO:teuthology.orchestra.run.smithi170.stdout:(138/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 250 kB/s | 90 kB 00:00 2024-04-21T10:08:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-21T10:08:34.114 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-21T10:08:34.161 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-21T10:08:34.196 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-21T10:08:34.240 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-21T10:08:34.282 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-21T10:08:34.316 INFO:teuthology.orchestra.run.smithi170.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 138 kB/s | 36 kB 00:00 2024-04-21T10:08:34.334 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-21T10:08:34.335 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-21T10:08:34.366 INFO:teuthology.orchestra.run.smithi170.stdout:(140/150): python3-rsa-4.9-2.el9.noarch.rpm 177 kB/s | 59 kB 00:00 2024-04-21T10:08:34.421 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-21T10:08:34.471 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-21T10:08:34.500 INFO:teuthology.orchestra.run.smithi170.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 370 kB/s | 188 kB 00:00 2024-04-21T10:08:34.501 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-21T10:08:34.542 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-21T10:08:34.639 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-21T10:08:34.658 INFO:teuthology.orchestra.run.smithi170.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-21T10:08:34.676 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-21T10:08:34.717 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-21T10:08:34.750 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-21T10:08:34.775 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-21T10:08:34.851 INFO:teuthology.orchestra.run.smithi170.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 256 kB/s | 90 kB 00:00 2024-04-21T10:08:34.852 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-21T10:08:34.867 INFO:teuthology.orchestra.run.smithi170.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 458 kB/s | 230 kB 00:00 2024-04-21T10:08:34.983 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-21T10:08:35.026 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-21T10:08:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-21T10:08:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-21T10:08:35.126 INFO:teuthology.orchestra.run.smithi170.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 73 kB/s | 20 kB 00:00 2024-04-21T10:08:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-21T10:08:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-21T10:08:35.218 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-21T10:08:35.248 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-21T10:08:35.260 INFO:teuthology.orchestra.run.smithi170.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 711 kB/s | 427 kB 00:00 2024-04-21T10:08:35.283 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-21T10:08:35.316 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-21T10:08:35.358 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-21T10:08:35.385 INFO:teuthology.orchestra.run.smithi170.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 371 kB/s | 192 kB 00:00 2024-04-21T10:08:35.392 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-21T10:08:35.473 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-21T10:08:35.523 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-21T10:08:35.554 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-21T10:08:35.602 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-21T10:08:35.711 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-21T10:08:35.773 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-21T10:08:35.877 INFO:teuthology.orchestra.run.smithi170.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-04-21T10:08:36.525 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-21T10:08:36.578 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-21T10:08:36.612 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-21T10:08:36.643 INFO:teuthology.orchestra.run.smithi170.stdout:(149/150): librbd1-19.0.0-3154.ga630765c.el9.x8 2.5 MB/s | 3.1 MB 00:01 2024-04-21T10:08:36.731 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-21T10:08:36.787 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-21T10:08:36.875 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-21T10:08:36.894 INFO:teuthology.orchestra.run.smithi170.stdout:(150/150): librados2-19.0.0-3154.ga630765c.el9. 2.1 MB/s | 3.4 MB 00:01 2024-04-21T10:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-21T10:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout:Total 4.3 MB/s | 218 MB 00:50 2024-04-21T10:08:36.905 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-21T10:08:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-21T10:08:37.353 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-21T10:08:37.431 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-21T10:08:37.938 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-21T10:08:38.061 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-21T10:08:38.062 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-21T10:08:38.088 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-21T10:08:38.204 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-21T10:08:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-21T10:08:39.551 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-21T10:08:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-21T10:08:39.611 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-21T10:08:39.778 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-21T10:08:39.778 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-21T10:08:39.915 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-21T10:08:39.966 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 97/152 2024-04-21T10:08:40.057 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 97/152 2024-04-21T10:08:40.074 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-21T10:08:40.087 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 98/152 2024-04-21T10:08:40.123 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-21T10:08:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-21T10:08:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-21T10:08:40.224 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-21T10:08:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-21T10:08:40.600 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-21T10:08:40.627 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 101/152 2024-04-21T10:08:40.683 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.0.0-3154.ga630765c.el9.x86_64 5/152 2024-04-21T10:08:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 101/152 2024-04-21T10:08:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 102/152 2024-04-21T10:08:40.805 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.0.0-3154.ga630765c.el9.x86_64 5/152 2024-04-21T10:08:40.834 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:08:40.908 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:08:40.951 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 7/152 2024-04-21T10:08:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-21T10:08:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-21T10:08:41.164 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-21T10:08:41.228 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-21T10:08:41.256 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:08:41.376 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:08:41.399 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 13/152 2024-04-21T10:08:41.461 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 13/152 2024-04-21T10:08:41.484 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T10:08:41.502 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T10:08:41.700 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T10:08:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T10:08:41.840 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-21T10:08:41.939 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-21T10:08:41.974 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-21T10:08:42.009 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-21T10:08:42.084 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-21T10:08:42.134 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-21T10:08:42.178 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-21T10:08:42.210 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-21T10:08:42.238 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-21T10:08:42.309 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-21T10:08:42.369 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-21T10:08:42.399 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-21T10:08:42.443 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-21T10:08:42.521 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-21T10:08:42.554 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.0.0-3154.ga630765c.el9. 30/152 2024-04-21T10:08:42.597 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.ga630765c.el 31/152 2024-04-21T10:08:42.625 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_6 32/152 2024-04-21T10:08:42.697 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-21T10:08:42.740 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-21T10:08:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-21T10:08:42.954 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-21T10:08:42.986 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:43.010 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-21T10:08:43.025 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:43.536 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-21T10:08:43.563 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 104/152 2024-04-21T10:08:43.630 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-21T10:08:43.659 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-21T10:08:43.702 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-21T10:08:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 104/152 2024-04-21T10:08:43.707 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-21T10:08:43.708 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-21T10:08:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:08:43.739 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 105/152 2024-04-21T10:08:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.0.0-3154.ga630765c.el9.x86_6 42/152 2024-04-21T10:08:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-21T10:08:43.828 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-21T10:08:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-21T10:08:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-21T10:08:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-21T10:08:44.033 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-21T10:08:44.068 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-21T10:08:44.111 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-21T10:08:44.154 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-21T10:08:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-21T10:08:44.343 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-21T10:08:44.372 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-21T10:08:44.414 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-21T10:08:44.510 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-21T10:08:44.547 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-21T10:08:44.588 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-21T10:08:44.613 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-21T10:08:44.638 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-21T10:08:44.713 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-21T10:08:44.840 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-21T10:08:44.879 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-21T10:08:44.907 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-21T10:08:44.941 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-21T10:08:44.985 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-21T10:08:45.023 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-21T10:08:45.071 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-21T10:08:45.101 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-21T10:08:45.135 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-21T10:08:45.168 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-21T10:08:45.210 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-21T10:08:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-21T10:08:45.332 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-21T10:08:45.375 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-21T10:08:45.431 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-21T10:08:45.479 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-21T10:08:45.578 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-21T10:08:45.625 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-21T10:08:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-21T10:08:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-21T10:08:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-21T10:08:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-21T10:08:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-21T10:08:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-3154.ga630765c.el9.x86_64 5/152 2024-04-21T10:08:46.349 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-21T10:08:46.397 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-21T10:08:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-3154.ga630765c.el9.x86_64 5/152 2024-04-21T10:08:46.431 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-21T10:08:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:08:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:08:46.534 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-21T10:08:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 7/152 2024-04-21T10:08:46.588 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-21T10:08:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-21T10:08:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-21T10:08:46.678 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-21T10:08:46.716 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-21T10:08:46.785 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-21T10:08:46.842 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-21T10:08:46.870 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:08:46.892 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-21T10:08:46.922 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-21T10:08:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:08:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 13/152 2024-04-21T10:08:47.016 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-21T10:08:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 13/152 2024-04-21T10:08:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T10:08:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T10:08:47.323 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T10:08:47.355 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T10:08:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-21T10:08:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-21T10:08:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-21T10:08:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-21T10:08:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-21T10:08:47.697 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-21T10:08:47.738 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-21T10:08:47.780 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-21T10:08:47.781 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-21T10:08:47.815 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-21T10:08:47.842 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-21T10:08:47.912 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-21T10:08:47.974 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-21T10:08:48.004 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-21T10:08:48.047 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-21T10:08:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-21T10:08:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-3154.ga630765c.el9. 30/152 2024-04-21T10:08:48.210 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.ga630765c.el 31/152 2024-04-21T10:08:48.238 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_6 32/152 2024-04-21T10:08:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-21T10:08:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-21T10:08:48.438 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-21T10:08:48.575 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-21T10:08:48.632 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-21T10:08:49.017 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-21T10:08:49.128 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-21T10:08:49.156 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-21T10:08:49.182 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-21T10:08:49.188 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-21T10:08:49.287 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-21T10:08:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-21T10:08:49.365 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-21T10:08:49.404 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-3154.ga630765c.el9.x86_6 42/152 2024-04-21T10:08:49.437 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-21T10:08:49.492 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-21T10:08:49.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-21T10:08:49.551 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 97/152 2024-04-21T10:08:49.566 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-21T10:08:49.596 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-21T10:08:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-21T10:08:49.642 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 97/152 2024-04-21T10:08:49.665 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 98/152 2024-04-21T10:08:49.672 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-21T10:08:49.701 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-21T10:08:49.707 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-21T10:08:49.750 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-21T10:08:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-21T10:08:49.932 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-21T10:08:49.973 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-21T10:08:50.003 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-21T10:08:50.045 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-21T10:08:50.142 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-21T10:08:50.180 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-21T10:08:50.186 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-21T10:08:50.213 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 101/152 2024-04-21T10:08:50.226 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-21T10:08:50.252 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-21T10:08:50.276 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-21T10:08:50.284 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 101/152 2024-04-21T10:08:50.306 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 102/152 2024-04-21T10:08:50.353 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-21T10:08:50.489 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-21T10:08:50.526 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-21T10:08:50.553 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-21T10:08:50.588 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-21T10:08:50.632 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-21T10:08:50.670 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-21T10:08:50.710 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-21T10:08:50.739 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-21T10:08:50.774 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-21T10:08:50.807 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-21T10:08:50.849 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-21T10:08:50.883 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-21T10:08:50.972 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-21T10:08:51.014 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-21T10:08:51.045 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-21T10:08:51.093 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-21T10:08:51.202 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-21T10:08:51.256 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-21T10:08:52.007 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-21T10:08:52.060 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-21T10:08:52.094 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-21T10:08:52.197 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-21T10:08:52.261 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-21T10:08:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-21T10:08:52.397 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-21T10:08:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:52.574 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-21T10:08:52.602 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-21T10:08:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:52.681 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-21T10:08:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:53.181 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 104/152 2024-04-21T10:08:53.275 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 104/152 2024-04-21T10:08:53.275 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-21T10:08:53.275 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-21T10:08:53.275 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:08:53.308 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 105/152 2024-04-21T10:08:53.349 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-21T10:08:53.462 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-21T10:08:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-21T10:08:54.832 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-21T10:08:54.860 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-21T10:08:54.893 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-21T10:08:55.205 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-21T10:08:55.248 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 97/152 2024-04-21T10:08:55.294 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 105/152 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-04-21T10:08:55.295 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:08:55.338 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 97/152 2024-04-21T10:08:55.369 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 98/152 2024-04-21T10:08:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-21T10:08:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 106/152 2024-04-21T10:08:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 106/152 2024-04-21T10:08:55.503 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:08:55.503 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-21T10:08:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:08:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-21T10:08:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 101/152 2024-04-21T10:08:55.980 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 101/152 2024-04-21T10:08:56.002 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 102/152 2024-04-21T10:08:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 107/152 2024-04-21T10:08:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 107/152 2024-04-21T10:08:57.015 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:08:57.015 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-21T10:08:57.015 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T10:08:57.015 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T10:08:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:08:57.231 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 108/152 2024-04-21T10:08:57.254 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 108/152 2024-04-21T10:08:57.254 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:08:57.254 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-21T10:08:57.254 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T10:08:57.254 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T10:08:57.254 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:08:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 109/152 2024-04-21T10:08:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 109/152 2024-04-21T10:08:57.721 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:08:57.721 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-21T10:08:57.722 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T10:08:57.722 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T10:08:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:08:57.846 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-21T10:08:57.903 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-21T10:08:57.958 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-21T10:08:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-21T10:08:58.208 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-21T10:08:58.296 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-21T10:08:58.296 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:58.341 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:58.384 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-21T10:08:58.526 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-21T10:08:58.576 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-21T10:08:58.607 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-21T10:08:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-21T10:08:58.875 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 103/152 2024-04-21T10:08:58.919 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 104/152 2024-04-21T10:08:59.002 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 104/152 2024-04-21T10:08:59.002 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-21T10:08:59.002 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-21T10:08:59.002 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:08:59.030 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-3154.ga630765c.el9.noarch 121/152 2024-04-21T10:08:59.036 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 105/152 2024-04-21T10:08:59.101 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.0.0-3154.ga630765c.el9.noarch 121/152 2024-04-21T10:08:59.133 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.e 122/152 2024-04-21T10:08:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.ga630765c. 123/152 2024-04-21T10:08:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 124/152 2024-04-21T10:09:00.254 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 124/152 2024-04-21T10:09:00.292 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 125/152 2024-04-21T10:09:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 125/152 2024-04-21T10:09:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 126/152 2024-04-21T10:09:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 126/152 2024-04-21T10:09:01.538 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el 127/152 2024-04-21T10:09:01.570 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 128/152 2024-04-21T10:09:01.592 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 128/152 2024-04-21T10:09:01.592 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:01.592 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-21T10:09:01.593 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T10:09:01.593 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T10:09:01.593 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:01.637 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 129/152 2024-04-21T10:09:01.648 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 129/152 2024-04-21T10:09:01.746 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.0.0-3154.ga630765c.el9.x86_64 130/152 2024-04-21T10:09:01.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 131/152 2024-04-21T10:09:02.712 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-21T10:09:02.748 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 133/152 2024-04-21T10:09:02.770 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 133/152 2024-04-21T10:09:02.770 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:02.770 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-21T10:09:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T10:09:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T10:09:02.771 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:02.815 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.ga6307 134/152 2024-04-21T10:09:02.837 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.ga6307 134/152 2024-04-21T10:09:02.837 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:02.837 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-21T10:09:02.837 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:02.883 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 135/152 2024-04-21T10:09:02.905 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 135/152 2024-04-21T10:09:02.905 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:02.905 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-21T10:09:02.905 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T10:09:02.905 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T10:09:02.905 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:03.208 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 136/152 2024-04-21T10:09:03.231 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 136/152 2024-04-21T10:09:03.231 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:03.231 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-21T10:09:03.231 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T10:09:03.231 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T10:09:03.231 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 105/152 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-04-21T10:09:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:04.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 106/152 2024-04-21T10:09:04.879 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 106/152 2024-04-21T10:09:04.880 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:04.880 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-21T10:09:04.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:06.367 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 107/152 2024-04-21T10:09:06.392 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 107/152 2024-04-21T10:09:06.392 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:06.392 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-21T10:09:06.392 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T10:09:06.392 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T10:09:06.392 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:06.617 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 108/152 2024-04-21T10:09:06.639 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 108/152 2024-04-21T10:09:06.640 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:06.640 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-21T10:09:06.640 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T10:09:06.640 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T10:09:06.640 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:07.085 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 109/152 2024-04-21T10:09:07.107 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 109/152 2024-04-21T10:09:07.107 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:07.107 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-21T10:09:07.107 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T10:09:07.107 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T10:09:07.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:07.215 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-21T10:09:07.263 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-21T10:09:07.319 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-21T10:09:07.502 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-21T10:09:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-21T10:09:07.630 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-21T10:09:07.726 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-21T10:09:07.806 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 137/152 2024-04-21T10:09:07.856 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 138/152 2024-04-21T10:09:07.877 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-21T10:09:07.898 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 139/152 2024-04-21T10:09:07.920 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-21T10:09:07.930 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-21T10:09:07.951 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-21T10:09:07.957 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-21T10:09:07.979 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-21T10:09:08.145 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 142/152 2024-04-21T10:09:08.197 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-21T10:09:08.227 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_ 144/152 2024-04-21T10:09:08.389 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-3154.ga630765c.el9.noarch 121/152 2024-04-21T10:09:08.420 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.0.0-3154.ga630765c.el9.noarch 121/152 2024-04-21T10:09:08.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.e 122/152 2024-04-21T10:09:08.515 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.ga630765c. 123/152 2024-04-21T10:09:08.543 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 124/152 2024-04-21T10:09:08.816 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:08.862 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:08.881 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 124/152 2024-04-21T10:09:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 125/152 2024-04-21T10:09:09.665 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 146/152 2024-04-21T10:09:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-21T10:09:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-21T10:09:09.877 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-21T10:09:09.909 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-21T10:09:09.909 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T10:09:09.976 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T10:09:09.976 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:10.568 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 125/152 2024-04-21T10:09:10.587 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 126/152 2024-04-21T10:09:10.608 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 105/152 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-04-21T10:09:10.609 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 126/152 2024-04-21T10:09:10.783 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 106/152 2024-04-21T10:09:10.799 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 106/152 2024-04-21T10:09:10.799 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:10.799 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-21T10:09:10.799 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el 127/152 2024-04-21T10:09:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 128/152 2024-04-21T10:09:10.920 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 128/152 2024-04-21T10:09:10.920 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:10.920 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-21T10:09:10.920 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T10:09:10.920 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T10:09:10.920 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:10.965 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 129/152 2024-04-21T10:09:10.975 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 129/152 2024-04-21T10:09:11.074 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.0.0-3154.ga630765c.el9.x86_64 130/152 2024-04-21T10:09:11.129 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 131/152 2024-04-21T10:09:12.052 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-21T10:09:12.084 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 133/152 2024-04-21T10:09:12.106 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 133/152 2024-04-21T10:09:12.107 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:12.107 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-21T10:09:12.107 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T10:09:12.107 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T10:09:12.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:12.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.ga6307 134/152 2024-04-21T10:09:12.173 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.ga6307 134/152 2024-04-21T10:09:12.173 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:12.174 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-21T10:09:12.174 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:12.227 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 135/152 2024-04-21T10:09:12.250 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 135/152 2024-04-21T10:09:12.250 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:12.250 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-21T10:09:12.250 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T10:09:12.250 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T10:09:12.250 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:12.286 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 107/152 2024-04-21T10:09:12.312 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 107/152 2024-04-21T10:09:12.312 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:12.312 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-21T10:09:12.312 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T10:09:12.313 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T10:09:12.313 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:12.537 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 108/152 2024-04-21T10:09:12.553 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 136/152 2024-04-21T10:09:12.559 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 108/152 2024-04-21T10:09:12.559 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:12.559 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-21T10:09:12.559 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T10:09:12.559 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T10:09:12.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:12.575 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 136/152 2024-04-21T10:09:12.575 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:12.575 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-21T10:09:12.575 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T10:09:12.575 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T10:09:12.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:12.996 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 109/152 2024-04-21T10:09:13.018 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 109/152 2024-04-21T10:09:13.018 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:13.019 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-21T10:09:13.019 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T10:09:13.019 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T10:09:13.019 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:13.126 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-21T10:09:13.183 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-21T10:09:13.239 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-21T10:09:13.424 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-21T10:09:13.481 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-21T10:09:13.557 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-21T10:09:13.647 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-21T10:09:13.787 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-21T10:09:13.830 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-21T10:09:13.870 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-21T10:09:13.898 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-21T10:09:14.316 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-3154.ga630765c.el9.noarch 121/152 2024-04-21T10:09:14.347 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-3154.ga630765c.el9.noarch 121/152 2024-04-21T10:09:14.378 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.e 122/152 2024-04-21T10:09:14.439 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.ga630765c. 123/152 2024-04-21T10:09:14.505 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 124/152 2024-04-21T10:09:15.547 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 124/152 2024-04-21T10:09:15.588 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 125/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.0.0-3154.ga630765c.el9.x86_64 1/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 2/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 3/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 4/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.ga6307 5/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 7/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 8/152 2024-04-21T10:09:16.054 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 9/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 10/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 11/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 13/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 14/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_ 15/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 16/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 17/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.0.0-3154.ga630765c.el9.x86_6 18/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 19/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 20/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.ga630765c.el 21/152 2024-04-21T10:09:16.055 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.ga630765c.el9. 22/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_6 23/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 24/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 25/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 26/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 27/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 28/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 29/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.ga630765c. 30/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 31/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 32/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 33/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el 34/152 2024-04-21T10:09:16.056 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 35/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.e 36/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 37/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.0.0-3154.ga630765c.el9.noarch 38/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 39/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-21T10:09:16.057 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-21T10:09:16.058 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-21T10:09:16.059 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-21T10:09:16.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-21T10:09:16.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-21T10:09:16.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-21T10:09:16.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-21T10:09:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-21T10:09:16.065 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-21T10:09:16.066 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-21T10:09:16.067 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-21T10:09:16.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-21T10:09:16.069 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-21T10:09:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.0.0-3154.ga630765c.el9.x86_64 149/152 2024-04-21T10:09:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-21T10:09:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 151/152 2024-04-21T10:09:16.552 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 125/152 2024-04-21T10:09:16.581 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 126/152 2024-04-21T10:09:16.684 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 126/152 2024-04-21T10:09:16.862 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el 127/152 2024-04-21T10:09:16.891 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 128/152 2024-04-21T10:09:16.914 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 128/152 2024-04-21T10:09:16.914 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:16.914 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-21T10:09:16.914 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T10:09:16.914 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T10:09:16.915 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:16.958 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 129/152 2024-04-21T10:09:16.969 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 129/152 2024-04-21T10:09:17.069 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-3154.ga630765c.el9.x86_64 130/152 2024-04-21T10:09:17.115 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 131/152 2024-04-21T10:09:17.148 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 137/152 2024-04-21T10:09:17.190 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 138/152 2024-04-21T10:09:17.231 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 139/152 2024-04-21T10:09:17.262 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-21T10:09:17.298 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-21T10:09:17.478 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 142/152 2024-04-21T10:09:17.519 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-21T10:09:17.550 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_ 144/152 2024-04-21T10:09:18.037 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-21T10:09:18.069 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 133/152 2024-04-21T10:09:18.091 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 133/152 2024-04-21T10:09:18.092 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:18.092 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-21T10:09:18.092 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T10:09:18.092 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T10:09:18.092 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:18.103 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-04-21T10:09:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-21T10:09:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-21T10:09:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-21T10:09:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-13.14-1.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-21T10:09:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-21T10:09:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-21T10:09:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-21T10:09:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-21T10:09:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-3.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-21T10:09:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-21T10:09:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-21T10:09:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-21T10:09:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:09:18.116 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-21T10:09:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:18.145 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.ga6307 134/152 2024-04-21T10:09:18.166 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.ga6307 134/152 2024-04-21T10:09:18.167 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:18.167 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-21T10:09:18.167 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:18.187 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:18.206 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:18.212 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 135/152 2024-04-21T10:09:18.235 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 135/152 2024-04-21T10:09:18.235 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:18.235 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-21T10:09:18.235 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T10:09:18.235 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T10:09:18.235 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:18.487 DEBUG:teuthology.parallel:result is None 2024-04-21T10:09:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 136/152 2024-04-21T10:09:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 136/152 2024-04-21T10:09:18.560 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T10:09:18.560 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-21T10:09:18.560 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T10:09:18.560 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T10:09:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:18.978 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 146/152 2024-04-21T10:09:19.069 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-21T10:09:19.109 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-21T10:09:19.190 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-21T10:09:19.223 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-21T10:09:19.223 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T10:09:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T10:09:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:23.133 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 137/152 2024-04-21T10:09:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 138/152 2024-04-21T10:09:23.215 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 139/152 2024-04-21T10:09:23.247 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-21T10:09:23.275 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-21T10:09:23.450 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 142/152 2024-04-21T10:09:23.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-21T10:09:23.525 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_ 144/152 2024-04-21T10:09:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T10:09:25.002 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 146/152 2024-04-21T10:09:25.086 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-21T10:09:25.127 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-21T10:09:25.199 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:25.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.0.0-3154.ga630765c.el9.x86_64 1/152 2024-04-21T10:09:25.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 2/152 2024-04-21T10:09:25.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 3/152 2024-04-21T10:09:25.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 4/152 2024-04-21T10:09:25.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.ga6307 5/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 7/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 8/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 9/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 10/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 11/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 13/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 14/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_ 15/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 16/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 17/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.0.0-3154.ga630765c.el9.x86_6 18/152 2024-04-21T10:09:25.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 19/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 20/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.ga630765c.el 21/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.ga630765c.el9. 22/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_6 23/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 24/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 25/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 26/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 27/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 28/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 29/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.ga630765c. 30/152 2024-04-21T10:09:25.201 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 31/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 32/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 33/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el 34/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 35/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.e 36/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 37/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.0.0-3154.ga630765c.el9.noarch 38/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 39/152 2024-04-21T10:09:25.202 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-21T10:09:25.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-21T10:09:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-21T10:09:25.205 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-21T10:09:25.206 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-21T10:09:25.207 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-21T10:09:25.208 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-21T10:09:25.209 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-21T10:09:25.210 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-21T10:09:25.211 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-21T10:09:25.211 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.0.0-3154.ga630765c.el9.x86_64 149/152 2024-04-21T10:09:25.211 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-21T10:09:25.211 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 151/152 2024-04-21T10:09:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-21T10:09:25.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-21T10:09:25.257 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T10:09:25.324 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T10:09:25.324 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-04-21T10:09:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-21T10:09:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-21T10:09:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.14-1.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-21T10:09:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-21T10:09:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-21T10:09:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-21T10:09:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-21T10:09:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-21T10:09:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-21T10:09:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:09:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-21T10:09:27.697 DEBUG:teuthology.parallel:result is None 2024-04-21T10:09:31.246 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:31.246 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-3154.ga630765c.el9.x86_64 1/152 2024-04-21T10:09:31.246 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 2/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 3/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 4/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.ga6307 5/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 6/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 7/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 8/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 9/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 10/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 11/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 12/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 13/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 14/152 2024-04-21T10:09:31.247 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_ 15/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 16/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 17/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-3154.ga630765c.el9.x86_6 18/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86 19/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 20/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.ga630765c.el 21/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.ga630765c.el9. 22/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_6 23/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 24/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 25/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 26/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 27/152 2024-04-21T10:09:31.248 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 28/152 2024-04-21T10:09:31.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 29/152 2024-04-21T10:09:31.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.ga630765c. 30/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noa 31/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.n 32/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.ga63 33/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el 34/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 35/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.e 36/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 37/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-3154.ga630765c.el9.noarch 38/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 39/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-21T10:09:31.268 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-21T10:09:31.269 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-21T10:09:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-21T10:09:31.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-21T10:09:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-21T10:09:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-21T10:09:31.274 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-21T10:09:31.275 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-3154.ga630765c.el9.x86_64 149/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-21T10:09:31.276 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 151/152 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.2-8.el9.noarch 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.7.4-5.el9.x86_64 2024-04-21T10:09:33.362 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.363 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:19.0.0-3154.ga630765c.el9.noarch 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.4-9.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-21T10:09:33.364 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-21T10:09:33.365 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-21T10:09:33.366 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-13.14-1.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-21T10:09:33.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-21T10:09:33.368 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-21T10:09:33.369 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-21T10:09:33.370 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-21T10:09:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-3154.ga630765c.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-21T10:09:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-21T10:09:33.373 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-21T10:09:33.373 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-21T10:09:33.373 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-21T10:09:33.373 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-21T10:09:33.746 DEBUG:teuthology.parallel:result is None 2024-04-21T10:09:33.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:09:33.889 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-21T10:09:33.914 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-3154.ga630765c.el9 2024-04-21T10:09:33.915 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.ga630765c.el9 2024-04-21T10:09:33.915 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.ga630765c is installed. 2024-04-21T10:09:33.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:09:34.059 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-21T10:09:34.080 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-3154.ga630765c.el9 2024-04-21T10:09:34.081 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.ga630765c.el9 2024-04-21T10:09:34.081 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.ga630765c is installed. 2024-04-21T10:09:34.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:09:34.366 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-21T10:09:34.393 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-3154.ga630765c.el9 2024-04-21T10:09:34.393 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.ga630765c.el9 2024-04-21T10:09:34.394 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.ga630765c is installed. 2024-04-21T10:09:34.396 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-21T10:09:34.396 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:09:34.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T10:09:34.428 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:09:34.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T10:09:34.463 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:09:34.463 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T10:09:34.495 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-21T10:09:34.496 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:09:34.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T10:09:34.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T10:09:34.592 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:09:34.592 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T10:09:34.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T10:09:34.679 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:09:34.680 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T10:09:34.708 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T10:09:34.775 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-21T10:09:34.776 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:09:34.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T10:09:34.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T10:09:34.874 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:09:34.874 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T10:09:34.901 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T10:09:34.973 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:09:34.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T10:09:35.001 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T10:09:35.068 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-21T10:09:35.069 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:09:35.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T10:09:35.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T10:09:35.164 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:09:35.164 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T10:09:35.187 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T10:09:35.251 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:09:35.251 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T10:09:35.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T10:09:35.347 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-21T10:09:35.554 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'subvols': {'create': 2}} 2024-04-21T10:09:35.554 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:09:35.554 INFO:tasks.cephadm:Cluster fsid is 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:09:35.554 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-21T10:09:35.555 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.77', 'mon.b': '172.21.15.170', 'mon.c': '172.21.15.191'} 2024-04-21T10:09:35.555 INFO:tasks.cephadm:First mon is mon.a on smithi077 2024-04-21T10:09:35.555 INFO:tasks.cephadm:First mgr is x 2024-04-21T10:09:35.555 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-21T10:09:35.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-04-21T10:09:35.584 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname $(hostname -s) 2024-04-21T10:09:35.608 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-04-21T10:09:35.635 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-21T10:09:35.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:09:35.935 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78740/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3154-ga630765c', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3154.ga630765c'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-19 11:13:53.331234', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiescer', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-21T10:09:36.079 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-lusov-quiescer, sha1 a630765c1f93c6e61d9b40c4b76437611d5ef29e from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:09:36.081 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/x86_64/flavors/default/cephadm 2024-04-21T10:09:36.081 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:36.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 781532 Apr 21 10:09 /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:36.522 DEBUG:teuthology.orchestra.run.smithi170:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.366 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r--. 1 ubuntu ubuntu 781532 Apr 21 10:09 /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.366 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.845 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-r--r--. 1 ubuntu ubuntu 781532 Apr 21 10:09 /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.845 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.864 DEBUG:teuthology.orchestra.run.smithi170:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.884 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-21T10:09:37.919 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e on all hosts... 2024-04-21T10:09:37.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e pull 2024-04-21T10:09:37.921 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e pull 2024-04-21T10:09:37.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e pull 2024-04-21T10:09:39.575 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e... 2024-04-21T10:09:39.618 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e... 2024-04-21T10:09:39.705 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e... 2024-04-21T10:10:07.736 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-21T10:10:07.737 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev)", 2024-04-21T10:10:07.737 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192", 2024-04-21T10:10:07.737 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-04-21T10:10:07.737 INFO:teuthology.orchestra.run.smithi191.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda" 2024-04-21T10:10:07.737 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-21T10:10:07.737 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-21T10:11:01.072 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-21T10:11:01.072 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev)", 2024-04-21T10:11:01.072 INFO:teuthology.orchestra.run.smithi170.stdout: "image_id": "b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192", 2024-04-21T10:11:01.072 INFO:teuthology.orchestra.run.smithi170.stdout: "repo_digests": [ 2024-04-21T10:11:01.072 INFO:teuthology.orchestra.run.smithi170.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda" 2024-04-21T10:11:01.073 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-21T10:11:01.073 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev)", 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192", 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda" 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-21T10:11:04.798 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:11:04.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-04-21T10:11:04.874 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph 2024-04-21T10:11:04.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-04-21T10:11:04.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-04-21T10:11:04.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /etc/ceph 2024-04-21T10:11:04.991 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-04-21T10:11:05.017 INFO:tasks.cephadm:Writing seed config... 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-21T10:11:05.019 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-21T10:11:05.020 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-21T10:11:05.021 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-21T10:11:05.022 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-21T10:11:05.023 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:11:05.023 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-21T10:11:05.038 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 41617fb2-ffc7-11ee-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-21T10:11:05.039 DEBUG:teuthology.orchestra.run.smithi077:mon.a> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.a.service 2024-04-21T10:11:05.081 DEBUG:teuthology.orchestra.run.smithi077:mgr.x> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.x.service 2024-04-21T10:11:05.124 INFO:tasks.cephadm:Bootstrapping... 2024-04-21T10:11:05.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e -v bootstrap --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.77 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-21T10:11:05.311 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-21T10:11:05.312 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e', '-v', 'bootstrap', '--fsid', '41617fb2-ffc7-11ee-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.77', '--skip-admin-label'] 2024-04-21T10:11:05.312 INFO:teuthology.orchestra.run.smithi077.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-21T10:11:05.312 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying podman|docker is present... 2024-04-21T10:11:05.337 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-21T10:11:05.337 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying lvm2 is present... 2024-04-21T10:11:05.337 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying time synchronization is in place... 2024-04-21T10:11:05.345 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-21T10:11:05.345 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-21T10:11:05.350 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-21T10:11:05.351 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-21T10:11:05.357 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-04-21T10:11:05.363 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-04-21T10:11:05.363 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-04-21T10:11:05.363 INFO:teuthology.orchestra.run.smithi077.stdout:Repeating the final host check... 2024-04-21T10:11:05.387 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-21T10:11:05.387 INFO:teuthology.orchestra.run.smithi077.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-21T10:11:05.387 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl is present 2024-04-21T10:11:05.387 INFO:teuthology.orchestra.run.smithi077.stdout:lvcreate is present 2024-04-21T10:11:05.393 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-21T10:11:05.393 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-21T10:11:05.399 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-21T10:11:05.399 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-21T10:11:05.405 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-04-21T10:11:05.411 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-04-21T10:11:05.411 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-04-21T10:11:05.411 INFO:teuthology.orchestra.run.smithi077.stdout:Host looks OK 2024-04-21T10:11:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Cluster fsid: 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Acquiring lock 140528023125968 on /run/cephadm/41617fb2-ffc7-11ee-bc93-c7b262605968.lock 2024-04-21T10:11:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Lock 140528023125968 acquired on /run/cephadm/41617fb2-ffc7-11ee-bc93-c7b262605968.lock 2024-04-21T10:11:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 3300 ... 2024-04-21T10:11:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 6789 ... 2024-04-21T10:11:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Base mon IP(s) is [172.21.15.77:3300, 172.21.15.77:6789], mon addrv is [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-04-21T10:11:05.415 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.77 metric 100 2024-04-21T10:11:05.416 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.77 metric 100 2024-04-21T10:11:05.418 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-21T10:11:05.418 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-21T10:11:05.418 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-21T10:11:05.420 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-21T10:11:05.421 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-21T10:11:05.421 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-21T10:11:05.421 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-21T10:11:05.421 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 fe80::bd99:3607:3039:b3f4/64 scope link noprefixroute 2024-04-21T10:11:05.421 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-21T10:11:05.421 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-04-21T10:11:05.422 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-04-21T10:11:05.422 INFO:teuthology.orchestra.run.smithi077.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-21T10:11:05.422 INFO:teuthology.orchestra.run.smithi077.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-21T10:11:05.423 INFO:teuthology.orchestra.run.smithi077.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e... 2024-04-21T10:11:05.891 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 2024-04-21T10:11:05.892 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e... 2024-04-21T10:11:05.892 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Getting image source signatures 2024-04-21T10:11:05.892 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:7eab8a2da10d06ac88aea1fd8998a2559b4de9d07c585e3b1e6ee6c4d35fc119 2024-04-21T10:11:05.892 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-21T10:11:05.892 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying config sha256:b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 2024-04-21T10:11:05.892 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-21T10:11:06.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph: stdout ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev) 2024-04-21T10:11:06.847 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph version: ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev) 2024-04-21T10:11:06.847 INFO:teuthology.orchestra.run.smithi077.stdout:Extracting ceph user uid/gid from container image... 2024-04-21T10:11:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:stat: stdout 167 167 2024-04-21T10:11:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial keys... 2024-04-21T10:11:08.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQA85iRmdkS0AxAA7wcyrzn5aUvdQM7WS4khQg== 2024-04-21T10:11:09.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQA95iRmMrvPARAAvY3zMWbkMGAAgiQ41nrFDQ== 2024-04-21T10:11:10.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQA95iRm1cQmNBAALPExJC2ykUJCdIXodEws1w== 2024-04-21T10:11:10.479 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial monmap... 2024-04-21T10:11:11.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-21T10:11:11.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-21T10:11:11.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool for a [v2:172.21.15.77:3300,v1:172.21.15.77:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: set fsid to 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:11:11.654 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mon... 2024-04-21T10:11:12.567 INFO:teuthology.orchestra.run.smithi077.stdout:create mon.a on 2024-04-21T10:11:12.760 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-21T10:11:12.903 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-21T10:11:13.096 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968.target → /etc/systemd/system/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968.target. 2024-04-21T10:11:13.096 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968.target → /etc/systemd/system/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968.target. 2024-04-21T10:11:13.327 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.a 2024-04-21T10:11:13.327 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.a.service: Unit ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.a.service not loaded. 2024-04-21T10:11:13.487 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968.target.wants/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@.service. 2024-04-21T10:11:14.009 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T10:11:14.009 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-21T10:11:14.015 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T10:11:14.016 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-21T10:11:14.016 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-21T10:11:14.016 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-04-21T10:11:14.016 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon to start... 2024-04-21T10:11:14.016 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon... 2024-04-21T10:11:15.077 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:14 smithi077 ceph-mon[27517]: from='client.? 172.21.15.77:0/883311673' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-21T10:11:15.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout cluster: 2024-04-21T10:11:15.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout id: 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:15.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-21T10:11:15.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:15.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout services: 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.532544s) 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout data: 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pgs: 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.441+0000 7fc726d73700 1 Processor -- start 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.441+0000 7fc726d73700 1 -- start start 2024-04-21T10:11:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.441+0000 7fc726d73700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc720107090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.441+0000 7fc726d73700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc72007be00 con 0x7fc720106c70 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.441+0000 7fc724b0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc720107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.441+0000 7fc724b0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc720107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45934/0 (socket says 172.21.15.77:45934) 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.442+0000 7fc724b0f700 1 -- 172.21.15.77:0/1689157214 learned_addr learned my addr 172.21.15.77:0/1689157214 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.442+0000 7fc724b0f700 1 -- 172.21.15.77:0/1689157214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7201075d0 con 0x7fc720106c70 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.442+0000 7fc724b0f700 1 --2- 172.21.15.77:0/1689157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc720107090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098a0 tx=0x7fc714009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c286b6822a589f9a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.442+0000 7fc71f7fe700 1 -- 172.21.15.77:0/1689157214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc714004160 con 0x7fc720106c70 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.442+0000 7fc71f7fe700 1 -- 172.21.15.77:0/1689157214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714004300 con 0x7fc720106c70 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.442+0000 7fc71f7fe700 1 -- 172.21.15.77:0/1689157214 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7140036a0 con 0x7fc720106c70 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 -- 172.21.15.77:0/1689157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 msgr2=0x7fc720107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 --2- 172.21.15.77:0/1689157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc720107090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098a0 tx=0x7fc714009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 -- 172.21.15.77:0/1689157214 shutdown_connections 2024-04-21T10:11:15.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 --2- 172.21.15.77:0/1689157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc720107090 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 -- 172.21.15.77:0/1689157214 >> 172.21.15.77:0/1689157214 conn(0x7fc720102830 msgr2=0x7fc720104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 -- 172.21.15.77:0/1689157214 shutdown_connections 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 -- 172.21.15.77:0/1689157214 wait complete. 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 Processor -- start 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 -- start start 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.443+0000 7fc726d73700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc72019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc726d73700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc720107b00 con 0x7fc720106c70 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc724b0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc72019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc724b0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc72019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45948/0 (socket says 172.21.15.77:45948) 2024-04-21T10:11:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc724b0f700 1 -- 172.21.15.77:0/883311673 learned_addr learned my addr 172.21.15.77:0/883311673 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc724b0f700 1 -- 172.21.15.77:0/883311673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72019e0b0 con 0x7fc720106c70 2024-04-21T10:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc724b0f700 1 --2- 172.21.15.77:0/883311673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc72019db70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc714000c00 tx=0x7fc714004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc714003db0 con 0x7fc720106c70 2024-04-21T10:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714011630 con 0x7fc720106c70 2024-04-21T10:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72019e340 con 0x7fc720106c70 2024-04-21T10:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc714011950 con 0x7fc720106c70 2024-04-21T10:11:15.091 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.444+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7201a1030 con 0x7fc720106c70 2024-04-21T10:11:15.091 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.445+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc714011af0 con 0x7fc720106c70 2024-04-21T10:11:15.091 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.445+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc71401c450 con 0x7fc720106c70 2024-04-21T10:11:15.091 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.445+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7200640a0 con 0x7fc720106c70 2024-04-21T10:11:15.091 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.448+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc714032020 con 0x7fc720106c70 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.521+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc7201a1520 con 0x7fc720106c70 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.522+0000 7fc71dffb700 1 -- 172.21.15.77:0/883311673 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc714011de0 con 0x7fc720106c70 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 msgr2=0x7fc72019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 --2- 172.21.15.77:0/883311673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc72019db70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc714000c00 tx=0x7fc714004750 comp rx=0 tx=0).stop 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 shutdown_connections 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 --2- 172.21.15.77:0/883311673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc720106c70 0x7fc72019db70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 >> 172.21.15.77:0/883311673 conn(0x7fc720102830 msgr2=0x7fc720194190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:15.092 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 shutdown_connections 2024-04-21T10:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:14.523+0000 7fc726d73700 1 -- 172.21.15.77:0/883311673 wait complete. 2024-04-21T10:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout:mon is available 2024-04-21T10:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout:Assimilating anything we can from ceph.conf... 2024-04-21T10:11:16.193 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:15 smithi077 ceph-mon[27517]: from='client.? 172.21.15.77:0/3517555080' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-21T10:11:16.193 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:15 smithi077 ceph-mon[27517]: from='client.? 172.21.15.77:0/3517555080' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-21T10:11:16.204 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.520+0000 7f1f8efb0700 1 Processor -- start 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.520+0000 7f1f8efb0700 1 -- start start 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8efb0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f88107660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8efb0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88107c30 con 0x7f1f88107240 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8cd4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f88107660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8cd4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f88107660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45962/0 (socket says 172.21.15.77:45962) 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8cd4c700 1 -- 172.21.15.77:0/353197657 learned_addr learned my addr 172.21.15.77:0/353197657 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8cd4c700 1 -- 172.21.15.77:0/353197657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f88108440 con 0x7f1f88107240 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f8cd4c700 1 --2- 172.21.15.77:0/353197657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f88107660 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009e80 tx=0x7f1f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927877f5fc37f0e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f877fe700 1 -- 172.21.15.77:0/353197657 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f80017070 con 0x7f1f88107240 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.521+0000 7f1f877fe700 1 -- 172.21.15.77:0/353197657 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f80003a20 con 0x7f1f88107240 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f877fe700 1 -- 172.21.15.77:0/353197657 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f80003d20 con 0x7f1f88107240 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 -- 172.21.15.77:0/353197657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 msgr2=0x7f1f88107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 --2- 172.21.15.77:0/353197657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f88107660 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009e80 tx=0x7f1f8000b330 comp rx=0 tx=0).stop 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 -- 172.21.15.77:0/353197657 shutdown_connections 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 --2- 172.21.15.77:0/353197657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f88107660 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 -- 172.21.15.77:0/353197657 >> 172.21.15.77:0/353197657 conn(0x7f1f88102820 msgr2=0x7f1f88104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 -- 172.21.15.77:0/353197657 shutdown_connections 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.522+0000 7f1f8efb0700 1 -- 172.21.15.77:0/353197657 wait complete. 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8efb0700 1 Processor -- start 2024-04-21T10:11:16.206 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8efb0700 1 -- start start 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8efb0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f8819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8efb0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88108970 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8cd4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f8819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8cd4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f8819ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45970/0 (socket says 172.21.15.77:45970) 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8cd4c700 1 -- 172.21.15.77:0/3517555080 learned_addr learned my addr 172.21.15.77:0/3517555080 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8cd4c700 1 -- 172.21.15.77:0/3517555080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8819bf60 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8cd4c700 1 --2- 172.21.15.77:0/3517555080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f8819ba20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1f80004000 tx=0x7f1f80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f80022020 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f80018040 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8819c1f0 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.523+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f80017070 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.524+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8819eee0 con 0x7f1f88107240 2024-04-21T10:11:16.207 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.524+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f80025020 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.524+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f8000f050 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.525+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f880640a0 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.527+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1f8002c030 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.594+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1f8802e150 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.597+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f1f8001e480 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.598+0000 7f1f85ffb700 1 -- 172.21.15.77:0/3517555080 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1f80003a20 con 0x7f1f88107240 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 msgr2=0x7f1f8819ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 --2- 172.21.15.77:0/3517555080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f8819ba20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1f80004000 tx=0x7f1f80004ad0 comp rx=0 tx=0).stop 2024-04-21T10:11:16.208 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 shutdown_connections 2024-04-21T10:11:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 --2- 172.21.15.77:0/3517555080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88107240 0x7f1f8819ba20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 >> 172.21.15.77:0/3517555080 conn(0x7f1f88102820 msgr2=0x7f1f881926b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 shutdown_connections 2024-04-21T10:11:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:15.599+0000 7f1f8efb0700 1 -- 172.21.15.77:0/3517555080 wait complete. 2024-04-21T10:11:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:Generating new minimal ceph.conf... 2024-04-21T10:11:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:17 smithi077 ceph-mon[27517]: from='client.? 172.21.15.77:0/2931913394' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.458+0000 7fde9bf07700 1 Processor -- start 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.458+0000 7fde9bf07700 1 -- start start 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.458+0000 7fde9bf07700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9410b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde9bf07700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde9407bdc0 con 0x7fde94108e90 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde99ca3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9410b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde99ca3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9410b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45972/0 (socket says 172.21.15.77:45972) 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde99ca3700 1 -- 172.21.15.77:0/1296911388 learned_addr learned my addr 172.21.15.77:0/1296911388 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde99ca3700 1 -- 172.21.15.77:0/1296911388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9410b7c0 con 0x7fde94108e90 2024-04-21T10:11:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde99ca3700 1 --2- 172.21.15.77:0/1296911388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9410b280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e80 tx=0x7fde8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148134c38b59a1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.459+0000 7fde98ca1700 1 -- 172.21.15.77:0/1296911388 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde8c017070 con 0x7fde94108e90 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde98ca1700 1 -- 172.21.15.77:0/1296911388 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fde8c00b8c0 con 0x7fde94108e90 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde98ca1700 1 -- 172.21.15.77:0/1296911388 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde8c004490 con 0x7fde94108e90 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 -- 172.21.15.77:0/1296911388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 msgr2=0x7fde9410b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 --2- 172.21.15.77:0/1296911388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9410b280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e80 tx=0x7fde8c00b330 comp rx=0 tx=0).stop 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 -- 172.21.15.77:0/1296911388 shutdown_connections 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 --2- 172.21.15.77:0/1296911388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9410b280 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 -- 172.21.15.77:0/1296911388 >> 172.21.15.77:0/1296911388 conn(0x7fde94102820 msgr2=0x7fde94104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 -- 172.21.15.77:0/1296911388 shutdown_connections 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.460+0000 7fde9bf07700 1 -- 172.21.15.77:0/1296911388 wait complete. 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde9bf07700 1 Processor -- start 2024-04-21T10:11:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde9bf07700 1 -- start start 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde9bf07700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9419c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde9bf07700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde9410c6c0 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde99ca3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9419c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde99ca3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9419c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45974/0 (socket says 172.21.15.77:45974) 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde99ca3700 1 -- 172.21.15.77:0/2931913394 learned_addr learned my addr 172.21.15.77:0/2931913394 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde99ca3700 1 -- 172.21.15.77:0/2931913394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9419c710 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.461+0000 7fde99ca3700 1 --2- 172.21.15.77:0/2931913394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9419c1d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b7b0 tx=0x7fde8c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde8c020020 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9419c9a0 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fde8c012430 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde8c017040 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9419f690 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fde8c023020 con 0x7fde94108e90 2024-04-21T10:11:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.462+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fde8c00f050 con 0x7fde94108e90 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.463+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde940640a0 con 0x7fde94108e90 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.465+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fde8c02a020 con 0x7fde94108e90 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.532+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fde9419f860 con 0x7fde94108e90 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.533+0000 7fde92ffd700 1 -- 172.21.15.77:0/2931913394 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fde8c0125e0 con 0x7fde94108e90 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 msgr2=0x7fde9419c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 --2- 172.21.15.77:0/2931913394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9419c1d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b7b0 tx=0x7fde8c00be20 comp rx=0 tx=0).stop 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 shutdown_connections 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 --2- 172.21.15.77:0/2931913394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde94108e90 0x7fde9419c1d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 >> 172.21.15.77:0/2931913394 conn(0x7fde94102820 msgr2=0x7fde941032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 shutdown_connections 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:17.534+0000 7fde9bf07700 1 -- 172.21.15.77:0/2931913394 wait complete. 2024-04-21T10:11:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:Restarting the monitor... 2024-04-21T10:11:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:23 smithi077 systemd[1]: Stopping Ceph mon.a for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:11:24.874 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a[27513]: 2024-04-21T10:11:24.407+0000 7f576d964700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T10:11:24.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a[27513]: 2024-04-21T10:11:24.407+0000 7f576d964700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-21T10:11:24.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:24 smithi077 podman[27774]: 2024-04-21 10:11:24.602519838 +0000 UTC m=+0.865984500 container died bc0e6e5a8593cdbd4b3660b6d150218b20406a33b5ecf7c9b6e9015b90902418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T10:11:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:24 smithi077 podman[27774]: 2024-04-21 10:11:24.948558312 +0000 UTC m=+1.212022972 container cleanup bc0e6e5a8593cdbd4b3660b6d150218b20406a33b5ecf7c9b6e9015b90902418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T10:11:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:24 smithi077 bash[27774]: ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a 2024-04-21T10:11:25.529 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 podman[27788]: 2024-04-21 10:11:25.249579645 +0000 UTC m=+0.648409607 container remove bc0e6e5a8593cdbd4b3660b6d150218b20406a33b5ecf7c9b6e9015b90902418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416) 2024-04-21T10:11:25.529 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 systemd[1]: ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-21T10:11:25.530 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 systemd[1]: Stopped Ceph mon.a for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:11:25.530 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 systemd[1]: Starting Ceph mon.a for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:11:25.844 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 podman[27883]: 2024-04-21 10:11:25.641914953 +0000 UTC m=+0.112607928 container create d3416ecaa58247ab917e2c621dd34095e8c026f92ae99c9b8301d70aeec4a6d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-a630765, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-21T10:11:25.845 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 podman[27883]: 2024-04-21 10:11:25.554551602 +0000 UTC m=+0.025244578 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:11:25.845 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 podman[27883]: 2024-04-21 10:11:25.845822882 +0000 UTC m=+0.316515861 container init d3416ecaa58247ab917e2c621dd34095e8c026f92ae99c9b8301d70aeec4a6d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-a630765, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-21T10:11:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-21T10:11:26.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 podman[27883]: 2024-04-21 10:11:25.848981412 +0000 UTC m=+0.319674388 container start d3416ecaa58247ab917e2c621dd34095e8c026f92ae99c9b8301d70aeec4a6d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-a630765, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-04-21T10:11:26.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: set uid:gid to 167:167 (ceph:ceph) 2024-04-21T10:11:26.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev), process ceph-mon, pid 2 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: pidfile_write: ignore empty --pid-file 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: load: jerasure load: lrc 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: RocksDB version: 7.9.2 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Git sha 0 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Compile date 2024-04-19 14:19:22 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: DB SUMMARY 2024-04-21T10:11:26.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: DB Session ID: GYDC7ZSDFZLUQDJEN68G 2024-04-21T10:11:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: CURRENT file: CURRENT 2024-04-21T10:11:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: IDENTITY file: IDENTITY 2024-04-21T10:11:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-21T10:11:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-21T10:11:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104530 ; 2024-04-21T10:11:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.error_if_exists: 0 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.create_if_missing: 0 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.paranoid_checks: 1 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.env: 0x564f788a7cc0 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.fs: PosixFileSystem 2024-04-21T10:11:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.info_log: 0x564f7ab93be0 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_file_opening_threads: 16 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.statistics: (nil) 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.use_fsync: 0 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_log_file_size: 0 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.keep_log_file_num: 1000 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.recycle_log_file_num: 0 2024-04-21T10:11:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.allow_fallocate: 1 2024-04-21T10:11:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.allow_mmap_reads: 0 2024-04-21T10:11:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.allow_mmap_writes: 0 2024-04-21T10:11:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.use_direct_reads: 0 2024-04-21T10:11:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.create_missing_column_families: 0 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.db_log_dir: 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.wal_dir: 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-21T10:11:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.advise_random_on_open: 1 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.db_write_buffer_size: 0 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.write_buffer_manager: 0x564f7ab270e0 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.rate_limiter: (nil) 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.wal_recovery_mode: 2 2024-04-21T10:11:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.enable_thread_tracking: 0 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.enable_pipelined_write: 0 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.unordered_write: 0 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.row_cache: None 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.wal_filter: None 2024-04-21T10:11:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.allow_ingest_behind: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.two_write_queues: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.manual_wal_flush: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.wal_compression: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.atomic_flush: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.log_readahead_size: 0 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-21T10:11:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.best_efforts_recovery: 0 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.allow_data_in_errors: 0 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.db_host_id: __hostname__ 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_background_jobs: 2 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_background_compactions: -1 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_subcompactions: 1 2024-04-21T10:11:26.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_total_wal_size: 0 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_open_files: -1 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bytes_per_sync: 0 2024-04-21T10:11:26.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_readahead_size: 0 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_background_flushes: -1 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Compression algorithms supported: 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kZSTD supported: 0 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kXpressCompression supported: 0 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kLZ4HCCompression supported: 1 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kZlibCompression supported: 1 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kSnappyCompression supported: 1 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kLZ4Compression supported: 1 2024-04-21T10:11:26.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: kBZip2Compression supported: 0 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.merge_operator: 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_filter: None 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_filter_factory: None 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.sst_partitioner_factory: None 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-21T10:11:26.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564f7ab93dc0) 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: index_type: 0 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: data_block_index_type: 0 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: index_shortening: 1 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-21T10:11:26.146 INFO:journalctl@ceph.mon.a.smithi077.stdout: checksum: 4 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: no_block_cache: 0 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache: 0x564f7ab591f0 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache_options: 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: capacity : 536870912 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: num_shard_bits : 4 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: strict_capacity_limit : 0 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache_compressed: (nil) 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: persistent_cache: (nil) 2024-04-21T10:11:26.147 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_size: 4096 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_size_deviation: 10 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_restart_interval: 16 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: index_block_restart_interval: 1 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: metadata_block_size: 4096 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: partition_filters: 0 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: use_delta_encoding: 1 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: filter_policy: bloomfilter 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: whole_key_filtering: 1 2024-04-21T10:11:26.148 INFO:journalctl@ceph.mon.a.smithi077.stdout: verify_compression: 0 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: format_version: 5 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: enable_index_compression: 1 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_align: 0 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: max_auto_readahead_size: 262144 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: prepopulate_block_cache: 0 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: initial_auto_readahead_size: 8192 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout: num_file_reads_for_auto_readahead: 2 2024-04-21T10:11:26.149 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.write_buffer_size: 33554432 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_write_buffer_number: 2 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression: NoCompression 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression: Disabled 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.prefix_extractor: nullptr 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.num_levels: 7 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-21T10:11:26.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.level: 32767 2024-04-21T10:11:26.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.strategy: 0 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.enabled: false 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.target_file_size_base: 67108864 2024-04-21T10:11:26.152 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-21T10:11:26.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.arena_block_size: 1048576 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.disable_auto_compactions: 0 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-21T10:11:26.154 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.inplace_update_support: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.bloom_locality: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.max_successive_merges: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.paranoid_file_checks: 0 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.force_consistency_checks: 1 2024-04-21T10:11:26.155 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.report_bg_io_stats: 0 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.ttl: 2592000 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.enable_blob_files: false 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.min_blob_size: 0 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.blob_file_size: 268435456 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-21T10:11:26.156 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.blob_file_starting_level: 0 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f3c16d4b-5695-4288-ba01-a62e238b7731 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713694285877587, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713694285878594, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99757, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97639, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14028, "raw_average_key_size": 49, "raw_value_size": 89997, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713694285, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f3c16d4b-5695-4288-ba01-a62e238b7731", "db_session_id": "GYDC7ZSDFZLUQDJEN68G", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713694285878652, "job": 1, "event": "recovery_finished"} 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-21T10:11:26.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564f7ac6e000 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: DB pointer 0x564f7ac58000 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** DB Stats ** 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T10:11:26.158 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: L0 2/0 99.28 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: Sum 2/0 99.28 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-21T10:11:26.159 INFO:journalctl@ceph.mon.a.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-21T10:11:26.160 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative compaction: 0.00 GB write, 32.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval compaction: 0.00 GB write, 32.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: Block cache BinnedLRUCache@0x564f7ab591f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-21T10:11:26.161 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: starting mon.a rank 0 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???) e1 preinit fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).mds e1 new map 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).mds e1 print_map 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout: e1 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout: legacy client fscid: -1 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout: No filesystems configured 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T10:11:26.162 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 bash[27883]: d3416ecaa58247ab917e2c621dd34095e8c026f92ae99c9b8301d70aeec4a6d1 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 systemd[1]: Started Ceph mon.a for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: monmap epoch 1 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: last_changed 2024-04-21T10:11:10.795935+0000 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: created 2024-04-21T10:11:10.795935+0000 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: min_mon_release 19 (squid) 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: election_strategy: 1 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: fsmap 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: osdmap e1: 0 total, 0 up, 0 in 2024-04-21T10:11:26.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:25 smithi077 ceph-mon[27902]: mgrmap e1: no daemons active 2024-04-21T10:11:26.971 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.323+0000 7fe590ed5700 1 Processor -- start 2024-04-21T10:11:26.976 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.323+0000 7fe590ed5700 1 -- start start 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.323+0000 7fe590ed5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c108830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.323+0000 7fe590ed5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c108e00 con 0x7fe58c108410 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c108830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c108830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36840/0 (socket says 172.21.15.77:36840) 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58a59c700 1 -- 172.21.15.77:0/1040913961 learned_addr learned my addr 172.21.15.77:0/1040913961 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58a59c700 1 -- 172.21.15.77:0/1040913961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c109610 con 0x7fe58c108410 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58a59c700 1 --2- 172.21.15.77:0/1040913961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c108830 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009e80 tx=0x7fe57c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139a142382d85285 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58959a700 1 -- 172.21.15.77:0/1040913961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c017070 con 0x7fe58c108410 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58959a700 1 -- 172.21.15.77:0/1040913961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe57c00b8c0 con 0x7fe58c108410 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.324+0000 7fe58959a700 1 -- 172.21.15.77:0/1040913961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c004490 con 0x7fe58c108410 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 -- 172.21.15.77:0/1040913961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 msgr2=0x7fe58c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 --2- 172.21.15.77:0/1040913961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c108830 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009e80 tx=0x7fe57c00b330 comp rx=0 tx=0).stop 2024-04-21T10:11:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 -- 172.21.15.77:0/1040913961 shutdown_connections 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 --2- 172.21.15.77:0/1040913961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c108830 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 -- 172.21.15.77:0/1040913961 >> 172.21.15.77:0/1040913961 conn(0x7fe58c103990 msgr2=0x7fe58c105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 -- 172.21.15.77:0/1040913961 shutdown_connections 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.325+0000 7fe590ed5700 1 -- 172.21.15.77:0/1040913961 wait complete. 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe590ed5700 1 Processor -- start 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe590ed5700 1 -- start start 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe590ed5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe590ed5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c07c0d0 con 0x7fe58c108410 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe58a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe58a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36850/0 (socket says 172.21.15.77:36850) 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe58a59c700 1 -- 172.21.15.77:0/2363706567 learned_addr learned my addr 172.21.15.77:0/2363706567 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe58a59c700 1 -- 172.21.15.77:0/2363706567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c19a5d0 con 0x7fe58c108410 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.326+0000 7fe58a59c700 1 --2- 172.21.15.77:0/2363706567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c19a090 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe57c004a60 tx=0x7fe57c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c020020 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe57c003c60 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58c19a860 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c017040 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58c19d550 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe57c023020 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.327+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe57c00f050 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.328+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58c0640a0 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.330+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe57c02a020 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.399+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fe58c02e130 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.401+0000 7fe5837fe700 1 -- 172.21.15.77:0/2363706567 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fe57c00b860 con 0x7fe58c108410 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 msgr2=0x7fe58c19a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 --2- 172.21.15.77:0/2363706567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c19a090 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe57c004a60 tx=0x7fe57c00bd50 comp rx=0 tx=0).stop 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 shutdown_connections 2024-04-21T10:11:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 --2- 172.21.15.77:0/2363706567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe58c108410 0x7fe58c19a090 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 >> 172.21.15.77:0/2363706567 conn(0x7fe58c103990 msgr2=0x7fe58c105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 shutdown_connections 2024-04-21T10:11:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:26.402+0000 7fe590ed5700 1 -- 172.21.15.77:0/2363706567 wait complete. 2024-04-21T10:11:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-21T10:11:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-21T10:11:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mgr... 2024-04-21T10:11:27.003 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-21T10:11:27.003 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-21T10:11:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.x 2024-04-21T10:11:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.x.service: Unit ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-21T10:11:27.387 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968.target.wants/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@.service. 2024-04-21T10:11:27.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:27 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2363706567' entity='client.admin' 2024-04-21T10:11:27.621 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 systemd[1]: Starting Ceph mgr.x for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:11:27.881 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 podman[28121]: 2024-04-21 10:11:27.524575579 +0000 UTC m=+0.017606283 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T10:11:27.882 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 podman[28121]: 2024-04-21 10:11:27.630501796 +0000 UTC m=+0.123532468 container create f60ebce81d7fc63e2cafe330081712b38c06ff0001ebaff81f8df0f87b9d79ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-a630765, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T10:11:27.882 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 podman[28121]: 2024-04-21 10:11:27.807840796 +0000 UTC m=+0.300871469 container init f60ebce81d7fc63e2cafe330081712b38c06ff0001ebaff81f8df0f87b9d79ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-04-21T10:11:27.882 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 podman[28121]: 2024-04-21 10:11:27.810593327 +0000 UTC m=+0.303624010 container start f60ebce81d7fc63e2cafe330081712b38c06ff0001ebaff81f8df0f87b9d79ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-a630765, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-21T10:11:27.882 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 bash[28121]: f60ebce81d7fc63e2cafe330081712b38c06ff0001ebaff81f8df0f87b9d79ac 2024-04-21T10:11:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T10:11:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-21T10:11:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T10:11:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-21T10:11:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-21T10:11:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-04-21T10:11:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T10:11:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-21T10:11:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T10:11:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-21T10:11:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-21T10:11:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-21T10:11:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr to start... 2024-04-21T10:11:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr... 2024-04-21T10:11:28.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 systemd[1]: Started Ceph mgr.x for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:11:28.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:27 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:27.964+0000 7fc1894b0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:11:28.467 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:28 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:28.151+0000 7fc1894b0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:11:28.467 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:28 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:28.256+0000 7fc1894b0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:11:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:28 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2109919839' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T10:11:28.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:28 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:28.582+0000 7fc1894b0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:11:28.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:28 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:28.668+0000 7fc1894b0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:11:30.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:29 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:29.872+0000 7fc1894b0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:11:30.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:30 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:30.041+0000 7fc1894b0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:11:30.499 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:30 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:30.210+0000 7fc1894b0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:11:30.499 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:30 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:30.499+0000 7fc1894b0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:11:30.799 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:30 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:30.592+0000 7fc1894b0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:11:30.799 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:30 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:30.794+0000 7fc1894b0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:11:31.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:30 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:30.985+0000 7fc1894b0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:11:31.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:31 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:31.583+0000 7fc1894b0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:11:32.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:32.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:11:32.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:11:32.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T10:11:32.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T10:11:32.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:32.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T10:11:32.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T10:11:32.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T10:11:32.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T10:11:13.991952+0000", 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T10:11:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.384+0000 7fc36c27b700 1 Processor -- start 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.384+0000 7fc36c27b700 1 -- start start 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.385+0000 7fc36c27b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36410b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.385+0000 7fc36c27b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc36407be60 con 0x7fc364108df0 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.385+0000 7fc36a017700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36410b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.385+0000 7fc36a017700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36410b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36898/0 (socket says 172.21.15.77:36898) 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.385+0000 7fc36a017700 1 -- 172.21.15.77:0/333059444 learned_addr learned my addr 172.21.15.77:0/333059444 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.385+0000 7fc36a017700 1 -- 172.21.15.77:0/333059444 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36410b720 con 0x7fc364108df0 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.386+0000 7fc36a017700 1 --2- 172.21.15.77:0/333059444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36410b1e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc3600098a0 tx=0x7fc360009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a023fd3fb501644f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.386+0000 7fc369015700 1 -- 172.21.15.77:0/333059444 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360004160 con 0x7fc364108df0 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.386+0000 7fc369015700 1 -- 172.21.15.77:0/333059444 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc360004300 con 0x7fc364108df0 2024-04-21T10:11:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.386+0000 7fc369015700 1 -- 172.21.15.77:0/333059444 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360011af0 con 0x7fc364108df0 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.386+0000 7fc36c27b700 1 -- 172.21.15.77:0/333059444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 msgr2=0x7fc36410b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.386+0000 7fc36c27b700 1 --2- 172.21.15.77:0/333059444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36410b1e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc3600098a0 tx=0x7fc360009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 -- 172.21.15.77:0/333059444 shutdown_connections 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 --2- 172.21.15.77:0/333059444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36410b1e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 -- 172.21.15.77:0/333059444 >> 172.21.15.77:0/333059444 conn(0x7fc364102820 msgr2=0x7fc364104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 -- 172.21.15.77:0/333059444 shutdown_connections 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 -- 172.21.15.77:0/333059444 wait complete. 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 Processor -- start 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 -- start start 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36c27b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc36410c6e0 con 0x7fc364108df0 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36a017700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.387+0000 7fc36a017700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36912/0 (socket says 172.21.15.77:36912) 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc36a017700 1 -- 172.21.15.77:0/2109919839 learned_addr learned my addr 172.21.15.77:0/2109919839 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:32.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc36a017700 1 -- 172.21.15.77:0/2109919839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36419c740 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc36a017700 1 --2- 172.21.15.77:0/2109919839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36419c200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc360011ac0 tx=0x7fc360011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360003b20 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36419c9d0 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc36001a8c0 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3600248d0 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36419f6c0 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc360022020 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.388+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc3600193c0 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.389+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3640640a0 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.393+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc360042e50 con 0x7fc364108df0 2024-04-21T10:11:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.467+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc36419fc00 con 0x7fc364108df0 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.467+0000 7fc35b7fe700 1 -- 172.21.15.77:0/2109919839 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fc360031020 con 0x7fc364108df0 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.468+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 msgr2=0x7fc36419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.468+0000 7fc36c27b700 1 --2- 172.21.15.77:0/2109919839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36419c200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc360011ac0 tx=0x7fc360011ba0 comp rx=0 tx=0).stop 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.468+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 shutdown_connections 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.468+0000 7fc36c27b700 1 --2- 172.21.15.77:0/2109919839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc364108df0 0x7fc36419c200 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.468+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 >> 172.21.15.77:0/2109919839 conn(0x7fc364102820 msgr2=0x7fc3641032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.468+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 shutdown_connections 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:28.469+0000 7fc36c27b700 1 -- 172.21.15.77:0/2109919839 wait complete. 2024-04-21T10:11:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (1/15)... 2024-04-21T10:11:32.308 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:32 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:32.002+0000 7fc1894b0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:11:32.308 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:32 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:32.106+0000 7fc1894b0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:11:32.308 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:32 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:32.308+0000 7fc1894b0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:11:33.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:32 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:32.849+0000 7fc1894b0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:11:33.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:32 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:32.940+0000 7fc1894b0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:11:33.407 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:33 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:33.185+0000 7fc1894b0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:11:33.407 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:33 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:33.320+0000 7fc1894b0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:11:33.852 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:33 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:33.419+0000 7fc1894b0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:11:33.853 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:33 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:33.539+0000 7fc1894b0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:11:33.853 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:33 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:33.852+0000 7fc1894b0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:11:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:34 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3332619382' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T10:11:34.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:34 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:34.485+0000 7fc1894b0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:11:34.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:34 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:34.711+0000 7fc1894b0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:11:35.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:35.217 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:11:35.217 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:11:35.217 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T10:11:35.217 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T10:11:35.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T10:11:35.226 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T10:11:35.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T10:11:13.991952+0000", 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6eea361700 1 Processor -- start 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6eea361700 1 -- start start 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6eea361700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee410b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6eea361700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee407be60 con 0x7f6ee4108de0 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee410b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee410b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36878/0 (socket says 172.21.15.77:36878) 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.517+0000 7f6ee3fff700 1 -- 172.21.15.77:0/139418741 learned_addr learned my addr 172.21.15.77:0/139418741 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.518+0000 7f6ee3fff700 1 -- 172.21.15.77:0/139418741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee410b710 con 0x7f6ee4108de0 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.518+0000 7f6ee3fff700 1 --2- 172.21.15.77:0/139418741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee410b1d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40098a0 tx=0x7f6ed4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4b4f470158ac69 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.518+0000 7f6ee2ffd700 1 -- 172.21.15.77:0/139418741 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ed4004160 con 0x7f6ee4108de0 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.518+0000 7f6ee2ffd700 1 -- 172.21.15.77:0/139418741 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6ed4004300 con 0x7f6ee4108de0 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.518+0000 7f6ee2ffd700 1 -- 172.21.15.77:0/139418741 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ed4011af0 con 0x7f6ee4108de0 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 -- 172.21.15.77:0/139418741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 msgr2=0x7f6ee410b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 --2- 172.21.15.77:0/139418741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee410b1d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40098a0 tx=0x7f6ed4009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 -- 172.21.15.77:0/139418741 shutdown_connections 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 --2- 172.21.15.77:0/139418741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee410b1d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 -- 172.21.15.77:0/139418741 >> 172.21.15.77:0/139418741 conn(0x7f6ee41027d0 msgr2=0x7f6ee4104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 -- 172.21.15.77:0/139418741 shutdown_connections 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 -- 172.21.15.77:0/139418741 wait complete. 2024-04-21T10:11:35.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 Processor -- start 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.519+0000 7f6eea361700 1 -- start start 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6eea361700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee419c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6eea361700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee410c6d0 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee419c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee419c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36884/0 (socket says 172.21.15.77:36884) 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6ee3fff700 1 -- 172.21.15.77:0/3332619382 learned_addr learned my addr 172.21.15.77:0/3332619382 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6ee3fff700 1 -- 172.21.15.77:0/3332619382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee419c700 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6ee3fff700 1 --2- 172.21.15.77:0/3332619382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee419c1c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4011ac0 tx=0x7f6ed4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.520+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ed4003b20 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6ed401a8c0 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee419c990 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ed40248d0 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee419f680 con 0x7f6ee4108de0 2024-04-21T10:11:35.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ed4022020 con 0x7f6ee4108de0 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ed40193c0 con 0x7f6ee4108de0 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.521+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee419ce70 con 0x7f6ee4108de0 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.524+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ee419ce70 con 0x7f6ee4108de0 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.597+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6ee419f850 con 0x7f6ee4108de0 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.597+0000 7f6ee17fa700 1 -- 172.21.15.77:0/3332619382 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6ed402ddf0 con 0x7f6ee4108de0 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.598+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 msgr2=0x7f6ee419c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.598+0000 7f6eea361700 1 --2- 172.21.15.77:0/3332619382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee419c1c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4011ac0 tx=0x7f6ed4011ba0 comp rx=0 tx=0).stop 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.599+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 shutdown_connections 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.599+0000 7f6eea361700 1 --2- 172.21.15.77:0/3332619382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee4108de0 0x7f6ee419c1c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.599+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 >> 172.21.15.77:0/3332619382 conn(0x7f6ee41027d0 msgr2=0x7f6ee4103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.599+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 shutdown_connections 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:34.599+0000 7f6eea361700 1 -- 172.21.15.77:0/3332619382 wait complete. 2024-04-21T10:11:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (2/15)... 2024-04-21T10:11:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: Activating manager daemon x 2024-04-21T10:11:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: mgrmap e2: x(active, starting, since 0.00292977s) 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: Manager daemon x is now available 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T10:11:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T10:11:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' 2024-04-21T10:11:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' 2024-04-21T10:11:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:35 smithi077 ceph-mon[27902]: from='mgr.14100 172.21.15.77:0/3125622955' entity='mgr.x' 2024-04-21T10:11:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:36 smithi077 ceph-mon[27902]: mgrmap e3: x(active, since 1.00692s) 2024-04-21T10:11:37.953 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:37 smithi077 ceph-mon[27902]: mgrmap e4: x(active, since 2s) 2024-04-21T10:11:38.555 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:38.556 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T10:11:38.557 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T10:11:38.558 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T10:11:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T10:11:13.991952+0000", 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.664+0000 7f8b40b44700 1 Processor -- start 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b40b44700 1 -- start start 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b40b44700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c1087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b40b44700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c108da0 con 0x7f8b3c1083b0 2024-04-21T10:11:38.560 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b3a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c1087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b3a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c1087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36962/0 (socket says 172.21.15.77:36962) 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b3a59c700 1 -- 172.21.15.77:0/727291226 learned_addr learned my addr 172.21.15.77:0/727291226 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.665+0000 7f8b3a59c700 1 -- 172.21.15.77:0/727291226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c109560 con 0x7f8b3c1083b0 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b3a59c700 1 --2- 172.21.15.77:0/727291226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c1087d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8b300098a0 tx=0x7f8b30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571cc60767a8749f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b3959a700 1 -- 172.21.15.77:0/727291226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b30004160 con 0x7f8b3c1083b0 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b3959a700 1 -- 172.21.15.77:0/727291226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8b30004300 con 0x7f8b3c1083b0 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b3959a700 1 -- 172.21.15.77:0/727291226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b30011af0 con 0x7f8b3c1083b0 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b40b44700 1 -- 172.21.15.77:0/727291226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 msgr2=0x7f8b3c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b40b44700 1 --2- 172.21.15.77:0/727291226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c1087d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8b300098a0 tx=0x7f8b30009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.666+0000 7f8b40b44700 1 -- 172.21.15.77:0/727291226 shutdown_connections 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.667+0000 7f8b40b44700 1 --2- 172.21.15.77:0/727291226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c1087d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.667+0000 7f8b40b44700 1 -- 172.21.15.77:0/727291226 >> 172.21.15.77:0/727291226 conn(0x7f8b3c1039b0 msgr2=0x7f8b3c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:38.561 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.667+0000 7f8b40b44700 1 -- 172.21.15.77:0/727291226 shutdown_connections 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.667+0000 7f8b40b44700 1 -- 172.21.15.77:0/727291226 wait complete. 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.667+0000 7f8b40b44700 1 Processor -- start 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.667+0000 7f8b40b44700 1 -- start start 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b40b44700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b40b44700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c10c910 con 0x7f8b3c1083b0 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b3a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b3a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c19c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36970/0 (socket says 172.21.15.77:36970) 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b3a59c700 1 -- 172.21.15.77:0/3377725956 learned_addr learned my addr 172.21.15.77:0/3377725956 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b3a59c700 1 -- 172.21.15.77:0/3377725956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c19c790 con 0x7f8b3c1083b0 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b3a59c700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c19c250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000c00 tx=0x7f8b30011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b300039e0 con 0x7f8b3c1083b0 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c19ca20 con 0x7f8b3c1083b0 2024-04-21T10:11:38.562 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8b30003b80 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b30024730 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.668+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c19f710 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.669+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f8b30022020 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.669+0000 7f8b2b7fe700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f8b24039620 0x7f8b2403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.669+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8b3001a430 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.669+0000 7f8b39d9b700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f8b24039620 0x7f8b2403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.669+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3c0640a0 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.670+0000 7f8b39d9b700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f8b24039620 0x7f8b2403bae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c006fd0 tx=0x7f8b2c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.675+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8b3000e260 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.953+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8b3c19fc30 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.954+0000 7f8b2b7fe700 1 -- 172.21.15.77:0/3377725956 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f8b3000b5a0 con 0x7f8b3c1083b0 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f8b24039620 msgr2=0x7f8b2403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f8b24039620 0x7f8b2403bae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c006fd0 tx=0x7f8b2c006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:38.563 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 msgr2=0x7f8b3c19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c19c250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000c00 tx=0x7f8b30011b70 comp rx=0 tx=0).stop 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 shutdown_connections 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f8b24039620 0x7f8b2403bae0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 --2- 172.21.15.77:0/3377725956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c1083b0 0x7f8b3c19c250 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 >> 172.21.15.77:0/3377725956 conn(0x7f8b3c1039b0 msgr2=0x7f8b3c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 shutdown_connections 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:37.956+0000 7f8b40b44700 1 -- 172.21.15.77:0/3377725956 wait complete. 2024-04-21T10:11:38.564 INFO:teuthology.orchestra.run.smithi077.stdout:mgr is available 2024-04-21T10:11:38.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:38 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3377725956' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T10:11:39.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-21T10:11:39.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.959+0000 7f0cefbef700 1 Processor -- start 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0cefbef700 1 -- start start 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0cefbef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0cefbef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce807c810 con 0x7f0ce807de20 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0ced98b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0ced98b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36980/0 (socket says 172.21.15.77:36980) 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0ced98b700 1 -- 172.21.15.77:0/2049271087 learned_addr learned my addr 172.21.15.77:0/2049271087 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0ced98b700 1 -- 172.21.15.77:0/2049271087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce807c990 con 0x7f0ce807de20 2024-04-21T10:11:39.776 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0ced98b700 1 --2- 172.21.15.77:0/2049271087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce807c2d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80098a0 tx=0x7f0cd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c7abe0a4afdff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0cec989700 1 -- 172.21.15.77:0/2049271087 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd8004160 con 0x7f0ce807de20 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0cec989700 1 -- 172.21.15.77:0/2049271087 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0cd8004300 con 0x7f0ce807de20 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.960+0000 7f0cec989700 1 -- 172.21.15.77:0/2049271087 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd8011af0 con 0x7f0ce807de20 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 -- 172.21.15.77:0/2049271087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 msgr2=0x7f0ce807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 --2- 172.21.15.77:0/2049271087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce807c2d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80098a0 tx=0x7f0cd8009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 -- 172.21.15.77:0/2049271087 shutdown_connections 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 --2- 172.21.15.77:0/2049271087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce807c2d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 -- 172.21.15.77:0/2049271087 >> 172.21.15.77:0/2049271087 conn(0x7f0ce81039b0 msgr2=0x7f0ce8105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 -- 172.21.15.77:0/2049271087 shutdown_connections 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.961+0000 7f0cefbef700 1 -- 172.21.15.77:0/2049271087 wait complete. 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0cefbef700 1 Processor -- start 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0cefbef700 1 -- start start 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0cefbef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce819e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:39.777 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0cefbef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce810e920 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0ced98b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce819e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0ced98b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce819e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36994/0 (socket says 172.21.15.77:36994) 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0ced98b700 1 -- 172.21.15.77:0/910466574 learned_addr learned my addr 172.21.15.77:0/910466574 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0ced98b700 1 -- 172.21.15.77:0/910466574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce819e930 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.962+0000 7f0ced98b700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce819e3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8011ac0 tx=0x7f0cd8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.963+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd8003b20 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.963+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0cd801a8c0 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.963+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce819ebc0 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.963+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd80248d0 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.963+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81a18b0 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.963+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f0cd8022020 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.964+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce80640a0 con 0x7f0ce807de20 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.964+0000 7f0cdeffd700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f0cd4039620 0x7f0cd403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.964+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0cd804d660 con 0x7f0ce807de20 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.964+0000 7f0ced18a700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f0cd4039620 0x7f0cd403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.964+0000 7f0ced18a700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f0cd4039620 0x7f0cd403bae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4006fd0 tx=0x7f0ce4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:38.969+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0cd804d3c0 con 0x7f0ce807de20 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.165+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0ce81a1a80 con 0x7f0ce807de20 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.166+0000 7f0cdeffd700 1 -- 172.21.15.77:0/910466574 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f0ce81a1a80 con 0x7f0ce807de20 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f0cd4039620 msgr2=0x7f0cd403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f0cd4039620 0x7f0cd403bae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4006fd0 tx=0x7f0ce4006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 msgr2=0x7f0ce819e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce819e3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8011ac0 tx=0x7f0cd8011ba0 comp rx=0 tx=0).stop 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 shutdown_connections 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f0cd4039620 0x7f0cd403bae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 --2- 172.21.15.77:0/910466574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce807de20 0x7f0ce819e3f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 >> 172.21.15.77:0/910466574 conn(0x7f0ce81039b0 msgr2=0x7f0ce8104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 shutdown_connections 2024-04-21T10:11:39.780 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:39.169+0000 7f0cefbef700 1 -- 172.21.15.77:0/910466574 wait complete. 2024-04-21T10:11:39.780 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling cephadm module... 2024-04-21T10:11:40.002 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:39 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/910466574' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-21T10:11:40.737 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:40 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/894757369' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-21T10:11:41.014 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:40 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: ignoring --setuser ceph since I am not root 2024-04-21T10:11:41.015 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:40 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: ignoring --setgroup ceph since I am not root 2024-04-21T10:11:41.015 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:40 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:40.889+0000 7fef5b26c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:11:41.296 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:41 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:41.073+0000 7fef5b26c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:11:41.296 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:41 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:41.174+0000 7fef5b26c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f571b5bd700 1 Processor -- start 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f571b5bd700 1 -- start start 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f571b5bd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f5714108760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f571b5bd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5714108d30 con 0x7f5714108340 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f5719359700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f5714108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f5719359700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f5714108760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37008/0 (socket says 172.21.15.77:37008) 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.225+0000 7f5719359700 1 -- 172.21.15.77:0/443221399 learned_addr learned my addr 172.21.15.77:0/443221399 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f5719359700 1 -- 172.21.15.77:0/443221399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5714109540 con 0x7f5714108340 2024-04-21T10:11:41.303 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f5719359700 1 --2- 172.21.15.77:0/443221399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f5714108760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f57100098a0 tx=0x7f5710009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f2368cb7eff9ec server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:41.303 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f570bfff700 1 -- 172.21.15.77:0/443221399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5710004160 con 0x7f5714108340 2024-04-21T10:11:41.303 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f570bfff700 1 -- 172.21.15.77:0/443221399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5710004300 con 0x7f5714108340 2024-04-21T10:11:41.303 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f570bfff700 1 -- 172.21.15.77:0/443221399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5710011af0 con 0x7f5714108340 2024-04-21T10:11:41.303 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f571b5bd700 1 -- 172.21.15.77:0/443221399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 msgr2=0x7f5714108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.226+0000 7f571b5bd700 1 --2- 172.21.15.77:0/443221399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f5714108760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f57100098a0 tx=0x7f5710009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 -- 172.21.15.77:0/443221399 shutdown_connections 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 --2- 172.21.15.77:0/443221399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f5714108760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 -- 172.21.15.77:0/443221399 >> 172.21.15.77:0/443221399 conn(0x7f57141038e0 msgr2=0x7f5714105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 -- 172.21.15.77:0/443221399 shutdown_connections 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 -- 172.21.15.77:0/443221399 wait complete. 2024-04-21T10:11:41.304 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 Processor -- start 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 -- start start 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f571419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.227+0000 7f571b5bd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f571410c8f0 con 0x7f5714108340 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f5719359700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f571419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f5719359700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f571419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37010/0 (socket says 172.21.15.77:37010) 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f5719359700 1 -- 172.21.15.77:0/894757369 learned_addr learned my addr 172.21.15.77:0/894757369 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f5719359700 1 -- 172.21.15.77:0/894757369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571419c770 con 0x7f5714108340 2024-04-21T10:11:41.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f5719359700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f571419c230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5710003f40 tx=0x7f5710011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57100038b0 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5710003a50 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571419ca00 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f571001a5c0 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.228+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571419f6f0 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.229+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f571001a8c0 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.229+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57140640a0 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.229+0000 7f570a7fc700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f57000395d0 0x7f570003ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.229+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f571004dba0 con 0x7f5714108340 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.229+0000 7f5718b58700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f57000395d0 0x7f570003ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.230+0000 7f5718b58700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f57000395d0 0x7f570003ba90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5704006fd0 tx=0x7f5704006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:41.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.234+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5710019c70 con 0x7f5714108340 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.487+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f571419f8c0 con 0x7f5714108340 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.723+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f571419f8c0 con 0x7f5714108340 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.725+0000 7f570a7fc700 1 -- 172.21.15.77:0/894757369 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f571002d910 con 0x7f5714108340 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f57000395d0 msgr2=0x7f570003ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f57000395d0 0x7f570003ba90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5704006fd0 tx=0x7f5704006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 msgr2=0x7f571419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f571419c230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5710003f40 tx=0x7f5710011890 comp rx=0 tx=0).stop 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 shutdown_connections 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f57000395d0 0x7f570003ba90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 --2- 172.21.15.77:0/894757369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714108340 0x7f571419c230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:41.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 >> 172.21.15.77:0/894757369 conn(0x7f57141038e0 msgr2=0x7f57141043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:41.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 shutdown_connections 2024-04-21T10:11:41.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:40.726+0000 7f571b5bd700 1 -- 172.21.15.77:0/894757369 wait complete. 2024-04-21T10:11:41.547 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:41 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:41.488+0000 7fef5b26c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:11:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:41 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/894757369' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-21T10:11:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:41 smithi077 ceph-mon[27902]: mgrmap e5: x(active, since 6s) 2024-04-21T10:11:41.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:41 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:41.575+0000 7fef5b26c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.766+0000 7f3757abe700 1 Processor -- start 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.766+0000 7f3757abe700 1 -- start start 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.766+0000 7f3757abe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375010b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.766+0000 7f3757abe700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f375007bea0 con 0x7f3750108dc0 2024-04-21T10:11:42.669 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f375585a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375010b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f375585a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375010b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53804/0 (socket says 172.21.15.77:53804) 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f375585a700 1 -- 172.21.15.77:0/934309230 learned_addr learned my addr 172.21.15.77:0/934309230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f375585a700 1 -- 172.21.15.77:0/934309230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375010b6f0 con 0x7f3750108dc0 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f375585a700 1 --2- 172.21.15.77:0/934309230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375010b1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f374c0098a0 tx=0x7f374c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65588d3c9be07930 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f3754858700 1 -- 172.21.15.77:0/934309230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f374c004160 con 0x7f3750108dc0 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f3754858700 1 -- 172.21.15.77:0/934309230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f374c004300 con 0x7f3750108dc0 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.767+0000 7f3754858700 1 -- 172.21.15.77:0/934309230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f374c011af0 con 0x7f3750108dc0 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 -- 172.21.15.77:0/934309230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 msgr2=0x7f375010b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 --2- 172.21.15.77:0/934309230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375010b1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f374c0098a0 tx=0x7f374c009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 -- 172.21.15.77:0/934309230 shutdown_connections 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 --2- 172.21.15.77:0/934309230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375010b1b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 -- 172.21.15.77:0/934309230 >> 172.21.15.77:0/934309230 conn(0x7f3750102890 msgr2=0x7f3750104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:42.670 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 -- 172.21.15.77:0/934309230 shutdown_connections 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.768+0000 7f3757abe700 1 -- 172.21.15.77:0/934309230 wait complete. 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f3757abe700 1 Processor -- start 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f3757abe700 1 -- start start 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f3757abe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f3757abe700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f375010c6c0 con 0x7f3750108dc0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f375585a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f375585a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375019c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53812/0 (socket says 172.21.15.77:53812) 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f375585a700 1 -- 172.21.15.77:0/2642073779 learned_addr learned my addr 172.21.15.77:0/2642073779 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.769+0000 7f375585a700 1 -- 172.21.15.77:0/2642073779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375019c6e0 con 0x7f3750108dc0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.770+0000 7f375585a700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375019c1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f374c003f40 tx=0x7f374c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.770+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f374c0038b0 con 0x7f3750108dc0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.770+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375019c970 con 0x7f3750108dc0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.770+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f374c003a50 con 0x7f3750108dc0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.770+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f374c01a5c0 con 0x7f3750108dc0 2024-04-21T10:11:42.671 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.770+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375019f660 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.771+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37500640a0 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.771+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f374c024430 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.771+0000 7f3746ffd700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 0x7f373c03bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.771+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f374c04daa0 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.771+0000 7f3755059700 1 -- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 msgr2=0x7f373c03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.771+0000 7f3755059700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 0x7f373c03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.776+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f374c04d4c0 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.972+0000 7f3755059700 1 -- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 msgr2=0x7f373c03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:41.972+0000 7f3755059700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 0x7f373c03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.072+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f375019f830 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.073+0000 7f3746ffd700 1 -- 172.21.15.77:0/2642073779 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f375019f830 con 0x7f3750108dc0 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 msgr2=0x7f373c03bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 0x7f373c03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:42.672 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 msgr2=0x7f375019c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375019c1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f374c003f40 tx=0x7f374c011890 comp rx=0 tx=0).stop 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 shutdown_connections 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f373c039670 0x7f373c03bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 --2- 172.21.15.77:0/2642073779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3750108dc0 0x7f375019c1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 >> 172.21.15.77:0/2642073779 conn(0x7f3750102890 msgr2=0x7f37501032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 shutdown_connections 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:42.075+0000 7f3757abe700 1 -- 172.21.15.77:0/2642073779 wait complete. 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-04-21T10:11:42.673 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 5... 2024-04-21T10:11:42.911 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:42 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2642073779' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-21T10:11:42.912 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:42 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:42.781+0000 7fef5b26c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:11:43.305 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:42 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:42.956+0000 7fef5b26c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:11:43.305 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:43 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:43.132+0000 7fef5b26c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:11:43.635 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:43 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:43.419+0000 7fef5b26c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:11:43.635 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:43 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:43.510+0000 7fef5b26c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:11:44.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:43 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:43.711+0000 7fef5b26c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:11:44.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:43 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:43.921+0000 7fef5b26c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:11:44.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:44 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:44.529+0000 7fef5b26c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:11:45.244 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:44 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:44.948+0000 7fef5b26c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:11:45.245 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:45 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:45.043+0000 7fef5b26c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:11:45.245 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:45 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:45.245+0000 7fef5b26c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:11:46.108 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:45 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:45.782+0000 7fef5b26c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:11:46.108 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:45 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:45.874+0000 7fef5b26c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:11:46.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:46 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:46.117+0000 7fef5b26c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:11:46.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:46 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:46.248+0000 7fef5b26c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:11:46.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:46 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:46.341+0000 7fef5b26c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:11:46.750 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:46 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:46.454+0000 7fef5b26c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:11:46.750 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:46 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:46.750+0000 7fef5b26c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:11:47.599 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:47.336+0000 7fef5b26c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:11:47.599 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:11:47.546+0000 7fef5b26c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:11:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: Active manager daemon x restarted 2024-04-21T10:11:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: Activating manager daemon x 2024-04-21T10:11:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: osdmap e2: 0 total, 0 up, 0 in 2024-04-21T10:11:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: mgrmap e6: x(active, starting, since 0.00337368s) 2024-04-21T10:11:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: Manager daemon x is now available 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T10:11:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:47 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T10:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:48 smithi077 ceph-mon[27902]: Found migration_current of "None". Setting to last migration. 2024-04-21T10:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:48 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:48 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:48 smithi077 ceph-mon[27902]: mgrmap e7: x(active, since 1.00608s) 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282ee6f700 1 Processor -- start 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282ee6f700 1 -- start start 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282ee6f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f282810b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282ee6f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f282807be60 con 0x7f2828108df0 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282cc0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f282810b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282cc0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f282810b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53814/0 (socket says 172.21.15.77:53814) 2024-04-21T10:11:49.169 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.099+0000 7f282cc0b700 1 -- 172.21.15.77:0/609953984 learned_addr learned my addr 172.21.15.77:0/609953984 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.100+0000 7f282cc0b700 1 -- 172.21.15.77:0/609953984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282810b720 con 0x7f2828108df0 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.100+0000 7f282cc0b700 1 --2- 172.21.15.77:0/609953984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f282810b1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f281c0098a0 tx=0x7f281c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a5736a17e45982 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.100+0000 7f28277fe700 1 -- 172.21.15.77:0/609953984 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c004160 con 0x7f2828108df0 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.100+0000 7f28277fe700 1 -- 172.21.15.77:0/609953984 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f281c004300 con 0x7f2828108df0 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.100+0000 7f28277fe700 1 -- 172.21.15.77:0/609953984 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c011af0 con 0x7f2828108df0 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- 172.21.15.77:0/609953984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 msgr2=0x7f282810b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 --2- 172.21.15.77:0/609953984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f282810b1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f281c0098a0 tx=0x7f281c009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- 172.21.15.77:0/609953984 shutdown_connections 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 --2- 172.21.15.77:0/609953984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f282810b1e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- 172.21.15.77:0/609953984 >> 172.21.15.77:0/609953984 conn(0x7f2828102820 msgr2=0x7f2828104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- 172.21.15.77:0/609953984 shutdown_connections 2024-04-21T10:11:49.170 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- 172.21.15.77:0/609953984 wait complete. 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 Processor -- start 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- start start 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f2828108670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.101+0000 7f282ee6f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f282810c6e0 con 0x7f2828108df0 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282cc0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f2828108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282cc0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f2828108670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53830/0 (socket says 172.21.15.77:53830) 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282cc0b700 1 -- 172.21.15.77:0/1418285012 learned_addr learned my addr 172.21.15.77:0/1418285012 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282cc0b700 1 -- 172.21.15.77:0/1418285012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2828108bb0 con 0x7f2828108df0 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282cc0b700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f2828108670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f281c003f40 tx=0x7f281c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:49.171 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c0038b0 con 0x7f2828108df0 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f281c003a50 con 0x7f2828108df0 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2828106da0 con 0x7f2828108df0 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c01a5c0 con 0x7f2828108df0 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.102+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28281072e0 con 0x7f2828108df0 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.103+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f281c01a870 con 0x7f2828108df0 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.103+0000 7f2825ffb700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:49.172 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.103+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 --> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f281803c240 con 0x7f2818039670 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.103+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f281c04dbe0 con 0x7f2828108df0 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.103+0000 7f2827fff700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 msgr2=0x7f281803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.104+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.305+0000 7f2827fff700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 msgr2=0x7f281803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.305+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.706+0000 7f2827fff700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 msgr2=0x7f281803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:43.706+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:44.507+0000 7f2827fff700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 msgr2=0x7f281803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:44.507+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:46.108+0000 7f2827fff700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 msgr2=0x7f281803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1648486673 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:46.108+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-21T10:11:49.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:47.549+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f281c01abb0 con 0x7f2828108df0 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:47.549+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 msgr2=0x7f281803bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:47.549+0000 7f2825ffb700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.551+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f281c04f820 con 0x7f2828108df0 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.551+0000 7f2825ffb700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f281803cf60 0x7f281803f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.551+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f281c02cc70 con 0x7f281803cf60 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.552+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f281803cf60 0x7f281803f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.552+0000 7f2827fff700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f281803cf60 0x7f281803f350 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2814003a10 tx=0x7f28140092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.553+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f281c02cc70 con 0x7f281803cf60 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.559+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2828069b50 con 0x7f281803cf60 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.559+0000 7f2825ffb700 1 -- 172.21.15.77:0/1418285012 <== mgr.14118 v2:172.21.15.77:6800/1650379483 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f2828069b50 con 0x7f281803cf60 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f281803cf60 msgr2=0x7f281803f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f281803cf60 0x7f281803f350 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2814003a10 tx=0x7f28140092b0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 msgr2=0x7f2828108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f2828108670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f281c003f40 tx=0x7f281c011890 comp rx=0 tx=0).stop 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 shutdown_connections 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f281803cf60 0x7f281803f350 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2828108df0 0x7f2828108670 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 --2- 172.21.15.77:0/1418285012 >> [v2:172.21.15.77:6800/1648486673,v1:172.21.15.77:6801/1648486673] conn(0x7f2818039670 0x7f281803bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 >> 172.21.15.77:0/1418285012 conn(0x7f2828102820 msgr2=0x7f2828103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 shutdown_connections 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:48.560+0000 7f282ee6f700 1 -- 172.21.15.77:0/1418285012 wait complete. 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 5 is available 2024-04-21T10:11:49.175 INFO:teuthology.orchestra.run.smithi077.stdout:Setting orchestrator backend to cephadm... 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: [21/Apr/2024:10:11:48] ENGINE Bus STARTING 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: [21/Apr/2024:10:11:48] ENGINE Serving on http://172.21.15.77:8765 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: [21/Apr/2024:10:11:48] ENGINE Serving on https://172.21.15.77:7150 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: [21/Apr/2024:10:11:48] ENGINE Bus STARTED 2024-04-21T10:11:49.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:49 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:11:50.396 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0c9a1700 1 Processor -- start 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0c9a1700 1 -- start start 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0c9a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb081076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0c9a1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08107c70 con 0x7fcb08107280 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb081076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb081076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53902/0 (socket says 172.21.15.77:53902) 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.564+0000 7fcb0659c700 1 -- 172.21.15.77:0/3270371819 learned_addr learned my addr 172.21.15.77:0/3270371819 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.565+0000 7fcb0659c700 1 -- 172.21.15.77:0/3270371819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb08108480 con 0x7fcb08107280 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.565+0000 7fcb0659c700 1 --2- 172.21.15.77:0/3270371819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb081076a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80098a0 tx=0x7fcaf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f9ef5cb3bee3da server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.565+0000 7fcb0559a700 1 -- 172.21.15.77:0/3270371819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaf8004160 con 0x7fcb08107280 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.565+0000 7fcb0559a700 1 -- 172.21.15.77:0/3270371819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcaf8004300 con 0x7fcb08107280 2024-04-21T10:11:50.397 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.565+0000 7fcb0559a700 1 -- 172.21.15.77:0/3270371819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaf8011af0 con 0x7fcb08107280 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/3270371819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 msgr2=0x7fcb081076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 --2- 172.21.15.77:0/3270371819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb081076a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80098a0 tx=0x7fcaf8009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/3270371819 shutdown_connections 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 --2- 172.21.15.77:0/3270371819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb081076a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/3270371819 >> 172.21.15.77:0/3270371819 conn(0x7fcb08102820 msgr2=0x7fcb08104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/3270371819 shutdown_connections 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/3270371819 wait complete. 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 Processor -- start 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.566+0000 7fcb0c9a1700 1 -- start start 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0c9a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb0819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0c9a1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0810b830 con 0x7fcb08107280 2024-04-21T10:11:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb0819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb0819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53918/0 (socket says 172.21.15.77:53918) 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0659c700 1 -- 172.21.15.77:0/1034746200 learned_addr learned my addr 172.21.15.77:0/1034746200 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0659c700 1 -- 172.21.15.77:0/1034746200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0819c770 con 0x7fcb08107280 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0659c700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb0819c230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8003f40 tx=0x7fcaf8011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaf80038b0 con 0x7fcb08107280 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcaf8003a50 con 0x7fcb08107280 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0819ca00 con 0x7fcb08107280 2024-04-21T10:11:50.399 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaf801a5c0 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.567+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0819f6f0 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.568+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7fcaf801a870 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.568+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb080640a0 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.568+0000 7fcaf77fe700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fcaf0039560 0x7fcaf003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.568+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcaf804db40 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.569+0000 7fcb05d9b700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fcaf0039560 0x7fcaf003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.569+0000 7fcb05d9b700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fcaf0039560 0x7fcaf003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcafc006fd0 tx=0x7fcafc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.574+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcaf8019c70 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.602+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fcaf801ac60 con 0x7fcb08107280 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.789+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fcb08103ac0 con 0x7fcaf0039560 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.794+0000 7fcaf77fe700 1 -- 172.21.15.77:0/1034746200 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb08103ac0 con 0x7fcaf0039560 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fcaf0039560 msgr2=0x7fcaf003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:50.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fcaf0039560 0x7fcaf003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcafc006fd0 tx=0x7fcafc006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 msgr2=0x7fcb0819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb0819c230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8003f40 tx=0x7fcaf8011890 comp rx=0 tx=0).stop 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 shutdown_connections 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fcaf0039560 0x7fcaf003ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 --2- 172.21.15.77:0/1034746200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb08107280 0x7fcb0819c230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 >> 172.21.15.77:0/1034746200 conn(0x7fcb08102820 msgr2=0x7fcb081033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 shutdown_connections 2024-04-21T10:11:50.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:49.796+0000 7fcb0c9a1700 1 -- 172.21.15.77:0/1034746200 wait complete. 2024-04-21T10:11:50.708 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:50 smithi077 ceph-mon[27902]: mgrmap e8: x(active, since 2s) 2024-04-21T10:11:50.708 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:50 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:50.708 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:50 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b91799700 1 Processor -- start 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b91799700 1 -- start start 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b91799700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b91799700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c07c8c0 con 0x7f5b8c07de90 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:51.569 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43804/0 (socket says 172.21.15.77:43804) 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.812+0000 7f5b8affd700 1 -- 172.21.15.77:0/3164211063 learned_addr learned my addr 172.21.15.77:0/3164211063 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b8affd700 1 -- 172.21.15.77:0/3164211063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c07ca40 con 0x7f5b8c07de90 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b8affd700 1 --2- 172.21.15.77:0/3164211063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c07c2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0098a0 tx=0x7f5b7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a5247a17a2f27 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b8a7fc700 1 -- 172.21.15.77:0/3164211063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c004160 con 0x7f5b8c07de90 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b8a7fc700 1 -- 172.21.15.77:0/3164211063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5b7c004300 con 0x7f5b8c07de90 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b8a7fc700 1 -- 172.21.15.77:0/3164211063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c011af0 con 0x7f5b8c07de90 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b91799700 1 -- 172.21.15.77:0/3164211063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 msgr2=0x7f5b8c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.813+0000 7f5b91799700 1 --2- 172.21.15.77:0/3164211063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c07c2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0098a0 tx=0x7f5b7c009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 -- 172.21.15.77:0/3164211063 shutdown_connections 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 --2- 172.21.15.77:0/3164211063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c07c2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 -- 172.21.15.77:0/3164211063 >> 172.21.15.77:0/3164211063 conn(0x7f5b8c1038e0 msgr2=0x7f5b8c105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 -- 172.21.15.77:0/3164211063 shutdown_connections 2024-04-21T10:11:51.570 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 -- 172.21.15.77:0/3164211063 wait complete. 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 Processor -- start 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 -- start start 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.814+0000 7f5b91799700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c10e8f0 con 0x7f5b8c07de90 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c19e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43818/0 (socket says 172.21.15.77:43818) 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b8affd700 1 -- 172.21.15.77:0/3187698140 learned_addr learned my addr 172.21.15.77:0/3187698140 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b8affd700 1 -- 172.21.15.77:0/3187698140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c19e930 con 0x7f5b8c07de90 2024-04-21T10:11:51.571 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b8affd700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c19e3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c000c00 tx=0x7f5b7c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c003b20 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5b7c01a8c0 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c19ebc0 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c024940 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.815+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c1a18b0 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.816+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f5b7c022020 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.816+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c069b50 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.816+0000 7f5b88ff9700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f5b780396c0 0x7f5b7803bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.816+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5b7c04d800 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.816+0000 7f5b827fc700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f5b780396c0 0x7f5b7803bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.817+0000 7f5b827fc700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f5b780396c0 0x7f5b7803bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b74006fd0 tx=0x7f5b74006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:50.821+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5b7c00b3e0 con 0x7f5b8c07de90 2024-04-21T10:11:51.572 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.019+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5b8c104ac0 con 0x7f5b780396c0 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.020+0000 7f5b88ff9700 1 -- 172.21.15.77:0/3187698140 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5b8c104ac0 con 0x7f5b780396c0 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f5b780396c0 msgr2=0x7f5b7803bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f5b780396c0 0x7f5b7803bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b74006fd0 tx=0x7f5b74006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 msgr2=0x7f5b8c19e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c19e3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c000c00 tx=0x7f5b7c011b70 comp rx=0 tx=0).stop 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 shutdown_connections 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f5b780396c0 0x7f5b7803bb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 --2- 172.21.15.77:0/3187698140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b8c07de90 0x7f5b8c19e3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 >> 172.21.15.77:0/3187698140 conn(0x7f5b8c1038e0 msgr2=0x7f5b8c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 shutdown_connections 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:51.022+0000 7f5b91799700 1 -- 172.21.15.77:0/3187698140 wait complete. 2024-04-21T10:11:51.573 INFO:teuthology.orchestra.run.smithi077.stdout:Generating ssh key... 2024-04-21T10:11:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:51 smithi077 ceph-mon[27902]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: Generating public/private rsa key pair. 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: Your identification has been saved in /tmp/tmphcx52qrw/key. 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: Your public key has been saved in /tmp/tmphcx52qrw/key.pub. 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: The key fingerprint is: 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: SHA256:efmVkHuWxeCHLHqlN9FQ1nkdq7Ckea1U98uNDvksGdc ceph-41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: The key's randomart image is: 2024-04-21T10:11:52.606 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: +---[RSA 3072]----+ 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | ooB| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | + O=| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | o+.*o*| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | .+o=*o*.| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | So+++oO..| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | .ooo*ooE| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | .++.o.| 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | o= | 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: | .+ | 2024-04-21T10:11:52.607 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: +----[SHA256]-----+ 2024-04-21T10:11:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-mon[27902]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:11:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:52 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:11:53.066 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9ca13be700 1 Processor -- start 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9ca13be700 1 -- start start 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9ca13be700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c1087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9ca13be700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c108da0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9c9affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c1087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9c9affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c1087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43832/0 (socket says 172.21.15.77:43832) 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9c9affd700 1 -- 172.21.15.77:0/131578823 learned_addr learned my addr 172.21.15.77:0/131578823 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9c9affd700 1 -- 172.21.15.77:0/131578823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c109560 con 0x7f9c9c1083b0 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.032+0000 7f9c9affd700 1 --2- 172.21.15.77:0/131578823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c1087d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0098a0 tx=0x7f9c8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6458123c92cbea29 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9c99ffb700 1 -- 172.21.15.77:0/131578823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c004160 con 0x7f9c9c1083b0 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9c99ffb700 1 -- 172.21.15.77:0/131578823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9c8c004300 con 0x7f9c9c1083b0 2024-04-21T10:11:53.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9c99ffb700 1 -- 172.21.15.77:0/131578823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c011af0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 -- 172.21.15.77:0/131578823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 msgr2=0x7f9c9c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 --2- 172.21.15.77:0/131578823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c1087d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0098a0 tx=0x7f9c8c009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 -- 172.21.15.77:0/131578823 shutdown_connections 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 --2- 172.21.15.77:0/131578823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c1087d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 -- 172.21.15.77:0/131578823 >> 172.21.15.77:0/131578823 conn(0x7f9c9c1039b0 msgr2=0x7f9c9c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 -- 172.21.15.77:0/131578823 shutdown_connections 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.033+0000 7f9ca13be700 1 -- 172.21.15.77:0/131578823 wait complete. 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9ca13be700 1 Processor -- start 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9ca13be700 1 -- start start 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9ca13be700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9ca13be700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c10c910 con 0x7f9c9c1083b0 2024-04-21T10:11:53.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9c9affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9c9affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c19c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43840/0 (socket says 172.21.15.77:43840) 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9c9affd700 1 -- 172.21.15.77:0/266479237 learned_addr learned my addr 172.21.15.77:0/266479237 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.034+0000 7f9c9affd700 1 -- 172.21.15.77:0/266479237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c19c790 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.035+0000 7f9c9affd700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c19c250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c003f40 tx=0x7f9c8c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.035+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c0036a0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.035+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9c19ca20 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.035+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9c8c024430 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.035+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8c01a5c0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.035+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9c19f710 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.036+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f9c8c01a8c0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.036+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9c0640a0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.036+0000 7f9c83fff700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9c84039620 0x7f9c8403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.036+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9c8c04d7c0 con 0x7f9c9c1083b0 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.036+0000 7f9c9a7fc700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9c84039620 0x7f9c8403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.036+0000 7f9c9a7fc700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9c84039620 0x7f9c8403bae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006fd0 tx=0x7f9c90006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.041+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9c8c020240 con 0x7f9c9c1083b0 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.239+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f9c9c104bb0 con 0x7f9c84039620 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.435+0000 7f9c83fff700 1 -- 172.21.15.77:0/266479237 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9c9c104bb0 con 0x7f9c84039620 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9c84039620 msgr2=0x7f9c8403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9c84039620 0x7f9c8403bae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006fd0 tx=0x7f9c90006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 msgr2=0x7f9c9c19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c19c250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c003f40 tx=0x7f9c8c004790 comp rx=0 tx=0).stop 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 shutdown_connections 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9c84039620 0x7f9c8403bae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 --2- 172.21.15.77:0/266479237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9c1083b0 0x7f9c9c19c250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:53.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 >> 172.21.15.77:0/266479237 conn(0x7f9c9c1039b0 msgr2=0x7f9c9c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:53.071 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 shutdown_connections 2024-04-21T10:11:53.071 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:52.438+0000 7f9ca13be700 1 -- 172.21.15.77:0/266479237 wait complete. 2024-04-21T10:11:53.695 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:53 smithi077 ceph-mon[27902]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:11:53.695 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:53 smithi077 ceph-mon[27902]: Generating ssh key... 2024-04-21T10:11:54.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:11:54.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.486+0000 7fd228177700 1 Processor -- start 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd228177700 1 -- start start 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd228177700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22010b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd228177700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd22007be60 con 0x7fd220108e20 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd225f13700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22010b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd225f13700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22010b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43844/0 (socket says 172.21.15.77:43844) 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd225f13700 1 -- 172.21.15.77:0/3959977953 learned_addr learned my addr 172.21.15.77:0/3959977953 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd225f13700 1 -- 172.21.15.77:0/3959977953 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22010b750 con 0x7fd220108e20 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd225f13700 1 --2- 172.21.15.77:0/3959977953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22010b210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2100098a0 tx=0x7fd210009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6635b7a188806a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.487+0000 7fd224f11700 1 -- 172.21.15.77:0/3959977953 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd210004160 con 0x7fd220108e20 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd224f11700 1 -- 172.21.15.77:0/3959977953 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd210004300 con 0x7fd220108e20 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd224f11700 1 -- 172.21.15.77:0/3959977953 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd210011af0 con 0x7fd220108e20 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 -- 172.21.15.77:0/3959977953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 msgr2=0x7fd22010b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 --2- 172.21.15.77:0/3959977953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22010b210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2100098a0 tx=0x7fd210009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 -- 172.21.15.77:0/3959977953 shutdown_connections 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 --2- 172.21.15.77:0/3959977953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22010b210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 -- 172.21.15.77:0/3959977953 >> 172.21.15.77:0/3959977953 conn(0x7fd220102850 msgr2=0x7fd220104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 -- 172.21.15.77:0/3959977953 shutdown_connections 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.488+0000 7fd228177700 1 -- 172.21.15.77:0/3959977953 wait complete. 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd228177700 1 Processor -- start 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd228177700 1 -- start start 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd228177700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd228177700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd22010c710 con 0x7fd220108e20 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd225f13700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd225f13700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22019c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43858/0 (socket says 172.21.15.77:43858) 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd225f13700 1 -- 172.21.15.77:0/3669257328 learned_addr learned my addr 172.21.15.77:0/3669257328 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.489+0000 7fd225f13700 1 -- 172.21.15.77:0/3669257328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22019c730 con 0x7fd220108e20 2024-04-21T10:11:54.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.490+0000 7fd225f13700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22019c1f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd210003f40 tx=0x7fd210011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.490+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2100038b0 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.490+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd210003a50 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.490+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22019c9c0 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.490+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21001a5c0 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.490+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22019f6b0 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.491+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd210024430 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.491+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2200640a0 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.491+0000 7fd216ffd700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fd20c039620 0x7fd20c03bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.491+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd21004db20 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.491+0000 7fd225712700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fd20c039620 0x7fd20c03bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.491+0000 7fd225712700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fd20c039620 0x7fd20c03bae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd21c006fd0 tx=0x7fd21c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.496+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd21002d910 con 0x7fd220108e20 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.695+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fd2201039e0 con 0x7fd20c039620 2024-04-21T10:11:54.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.696+0000 7fd216ffd700 1 -- 172.21.15.77:0/3669257328 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fd2201039e0 con 0x7fd20c039620 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.698+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fd20c039620 msgr2=0x7fd20c03bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.698+0000 7fd228177700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fd20c039620 0x7fd20c03bae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd21c006fd0 tx=0x7fd21c006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.698+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 msgr2=0x7fd22019c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.698+0000 7fd228177700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22019c1f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd210003f40 tx=0x7fd210011890 comp rx=0 tx=0).stop 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.699+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 shutdown_connections 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.699+0000 7fd228177700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fd20c039620 0x7fd20c03bae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.699+0000 7fd228177700 1 --2- 172.21.15.77:0/3669257328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd220108e20 0x7fd22019c1f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.699+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 >> 172.21.15.77:0/3669257328 conn(0x7fd220102850 msgr2=0x7fd2201032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.699+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 shutdown_connections 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:53.699+0000 7fd228177700 1 -- 172.21.15.77:0/3669257328 wait complete. 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:Adding key to root@localhost authorized_keys... 2024-04-21T10:11:54.335 INFO:teuthology.orchestra.run.smithi077.stdout:Adding host smithi077... 2024-04-21T10:11:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:54 smithi077 ceph-mon[27902]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:11:55.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:55 smithi077 ceph-mon[27902]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:11:55.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:11:55 smithi077 ceph-mon[27902]: Deploying cephadm binary to smithi077 2024-04-21T10:11:59.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Added host 'smithi077' with addr '172.21.15.77' 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.799+0000 7f1308c4c700 1 Processor -- start 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.799+0000 7f1308c4c700 1 -- start start 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f1308c4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130407c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f1308c4c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f130407c8a0 con 0x7f130407de70 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130407c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130407c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43874/0 (socket says 172.21.15.77:43874) 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130259c700 1 -- 172.21.15.77:0/1773271418 learned_addr learned my addr 172.21.15.77:0/1773271418 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130259c700 1 -- 172.21.15.77:0/1773271418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130407ca20 con 0x7f130407de70 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130259c700 1 --2- 172.21.15.77:0/1773271418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130407c2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098a0 tx=0x7f12f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ace7e40ca77652 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130159a700 1 -- 172.21.15.77:0/1773271418 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f4004160 con 0x7f130407de70 2024-04-21T10:11:59.688 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130159a700 1 -- 172.21.15.77:0/1773271418 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f12f4004300 con 0x7f130407de70 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.800+0000 7f130159a700 1 -- 172.21.15.77:0/1773271418 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f4011af0 con 0x7f130407de70 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 -- 172.21.15.77:0/1773271418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 msgr2=0x7f130407c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 --2- 172.21.15.77:0/1773271418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130407c2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098a0 tx=0x7f12f4009bb0 comp rx=0 tx=0).stop 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 -- 172.21.15.77:0/1773271418 shutdown_connections 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 --2- 172.21.15.77:0/1773271418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130407c2d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 -- 172.21.15.77:0/1773271418 >> 172.21.15.77:0/1773271418 conn(0x7f13041038e0 msgr2=0x7f1304105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 -- 172.21.15.77:0/1773271418 shutdown_connections 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.801+0000 7f1308c4c700 1 -- 172.21.15.77:0/1773271418 wait complete. 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f1308c4c700 1 Processor -- start 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f1308c4c700 1 -- start start 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f1308c4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130419e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f1308c4c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f130410e910 con 0x7f130407de70 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f130259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130419e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f130259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130419e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43882/0 (socket says 172.21.15.77:43882) 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f130259c700 1 -- 172.21.15.77:0/4016476210 learned_addr learned my addr 172.21.15.77:0/4016476210 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f130259c700 1 -- 172.21.15.77:0/4016476210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130419e900 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.802+0000 7f130259c700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130419e3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12f4011ac0 tx=0x7f12f4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.803+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f4003b20 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.803+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f12f401a8c0 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.803+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130419eb90 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.803+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f40248d0 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.803+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13041a1880 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.803+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f12f4022020 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.804+0000 7f12f37fe700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f12ec039670 0x7f12ec03bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.804+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f12f404e810 con 0x7f130407de70 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.804+0000 7f1301d9b700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f12ec039670 0x7f12ec03bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:11:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.804+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13040640a0 con 0x7f130407de70 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.804+0000 7f1301d9b700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f12ec039670 0x7f12ec03bb30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:54.809+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f12f400b5a0 con 0x7f130407de70 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:55.018+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}) -- 0x7f1304104ab0 con 0x7f12ec039670 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.051+0000 7f12f37fe700 1 -- 172.21.15.77:0/4016476210 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f1304104ab0 con 0x7f12ec039670 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.053+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f12ec039670 msgr2=0x7f12ec03bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.053+0000 7f1308c4c700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f12ec039670 0x7f12ec03bb30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8006e40 comp rx=0 tx=0).stop 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 msgr2=0x7f130419e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130419e3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12f4011ac0 tx=0x7f12f4011ba0 comp rx=0 tx=0).stop 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 shutdown_connections 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f12ec039670 0x7f12ec03bb30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 --2- 172.21.15.77:0/4016476210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f130407de70 0x7f130419e3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 >> 172.21.15.77:0/4016476210 conn(0x7f13041038e0 msgr2=0x7f13041043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:11:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 shutdown_connections 2024-04-21T10:11:59.692 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:11:59.054+0000 7f1308c4c700 1 -- 172.21.15.77:0/4016476210 wait complete. 2024-04-21T10:11:59.692 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying unmanaged mon service... 2024-04-21T10:12:00.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:00 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:00.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:00 smithi077 ceph-mon[27902]: Added host smithi077 2024-04-21T10:12:00.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:00 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:01 smithi077 ceph-mon[27902]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:01 smithi077 ceph-mon[27902]: Saving service mon spec with placement count:5 2024-04-21T10:12:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:01 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:01 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.245+0000 7f3ff1e9d700 1 Processor -- start 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.245+0000 7f3ff1e9d700 1 -- start start 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.245+0000 7f3ff1e9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec1087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.245+0000 7f3ff1e9d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec108d90 con 0x7f3fec1083a0 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.245+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec1087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec1087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43894/0 (socket says 172.21.15.77:43894) 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3feb7fe700 1 -- 172.21.15.77:0/3695851073 learned_addr learned my addr 172.21.15.77:0/3695851073 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3feb7fe700 1 -- 172.21.15.77:0/3695851073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec109550 con 0x7f3fec1083a0 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3feb7fe700 1 --2- 172.21.15.77:0/3695851073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec1087c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0098a0 tx=0x7f3fdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af43e75e6922610 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3fea7fc700 1 -- 172.21.15.77:0/3695851073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc004160 con 0x7f3fec1083a0 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3fea7fc700 1 -- 172.21.15.77:0/3695851073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3fdc004300 con 0x7f3fec1083a0 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.246+0000 7f3fea7fc700 1 -- 172.21.15.77:0/3695851073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc011af0 con 0x7f3fec1083a0 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/3695851073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 msgr2=0x7f3fec1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 --2- 172.21.15.77:0/3695851073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec1087c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0098a0 tx=0x7f3fdc009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/3695851073 shutdown_connections 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 --2- 172.21.15.77:0/3695851073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec1087c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/3695851073 >> 172.21.15.77:0/3695851073 conn(0x7f3fec103940 msgr2=0x7f3fec105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/3695851073 shutdown_connections 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/3695851073 wait complete. 2024-04-21T10:12:02.004 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 Processor -- start 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.247+0000 7f3ff1e9d700 1 -- start start 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3ff1e9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec19c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3ff1e9d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec10c900 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec19c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec19c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43898/0 (socket says 172.21.15.77:43898) 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3feb7fe700 1 -- 172.21.15.77:0/1667742204 learned_addr learned my addr 172.21.15.77:0/1667742204 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3feb7fe700 1 -- 172.21.15.77:0/1667742204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec19c710 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3feb7fe700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec19c1d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc003f40 tx=0x7f3fdc011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc0038b0 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3fdc003a50 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fec19c9a0 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc01a5c0 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.248+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fec19f690 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.249+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3fdc024430 con 0x7f3fec1083a0 2024-04-21T10:12:02.005 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.249+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fec0640a0 con 0x7f3fec1083a0 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.249+0000 7f3fe8ff9700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f3fd4039620 0x7f3fd403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.249+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3fdc04db50 con 0x7f3fec1083a0 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.249+0000 7f3feaffd700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f3fd4039620 0x7f3fd403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.250+0000 7f3feaffd700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f3fd4039620 0x7f3fd403bae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0006fd0 tx=0x7f3fe0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.254+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3fdc04d4e0 con 0x7f3fec1083a0 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.474+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3fec104ab0 con 0x7f3fd4039620 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.479+0000 7f3fe8ff9700 1 -- 172.21.15.77:0/1667742204 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3fec104ab0 con 0x7f3fd4039620 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f3fd4039620 msgr2=0x7f3fd403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f3fd4039620 0x7f3fd403bae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0006fd0 tx=0x7f3fe0006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 msgr2=0x7f3fec19c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec19c1d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc003f40 tx=0x7f3fdc011890 comp rx=0 tx=0).stop 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 shutdown_connections 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f3fd4039620 0x7f3fd403bae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 --2- 172.21.15.77:0/1667742204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1083a0 0x7f3fec19c1d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 >> 172.21.15.77:0/1667742204 conn(0x7f3fec103940 msgr2=0x7f3fec1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 shutdown_connections 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:00.481+0000 7f3ff1e9d700 1 -- 172.21.15.77:0/1667742204 wait complete. 2024-04-21T10:12:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying unmanaged mgr service... 2024-04-21T10:12:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:03 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:03 smithi077 ceph-mon[27902]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:03 smithi077 ceph-mon[27902]: Saving service mgr spec with placement count:2 2024-04-21T10:12:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:03 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:03.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-21T10:12:03.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.483+0000 7fbcd012c700 1 Processor -- start 2024-04-21T10:12:03.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.483+0000 7fbcd012c700 1 -- start start 2024-04-21T10:12:03.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.483+0000 7fbcd012c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc810b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:03.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.483+0000 7fbcd012c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc807be60 con 0x7fbcc8108df0 2024-04-21T10:12:03.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbccdec8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc810b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbccdec8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc810b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38730/0 (socket says 172.21.15.77:38730) 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbccdec8700 1 -- 172.21.15.77:0/379604000 learned_addr learned my addr 172.21.15.77:0/379604000 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbccdec8700 1 -- 172.21.15.77:0/379604000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc810b720 con 0x7fbcc8108df0 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbccdec8700 1 --2- 172.21.15.77:0/379604000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc810b1e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098a0 tx=0x7fbcb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998fbedcf23aabf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbcccec6700 1 -- 172.21.15.77:0/379604000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb8004160 con 0x7fbcc8108df0 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbcccec6700 1 -- 172.21.15.77:0/379604000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcb8004300 con 0x7fbcc8108df0 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.484+0000 7fbcccec6700 1 -- 172.21.15.77:0/379604000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb8011a20 con 0x7fbcc8108df0 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 -- 172.21.15.77:0/379604000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 msgr2=0x7fbcc810b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 --2- 172.21.15.77:0/379604000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc810b1e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098a0 tx=0x7fbcb8009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 -- 172.21.15.77:0/379604000 shutdown_connections 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 --2- 172.21.15.77:0/379604000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc810b1e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 -- 172.21.15.77:0/379604000 >> 172.21.15.77:0/379604000 conn(0x7fbcc8102820 msgr2=0x7fbcc8104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 -- 172.21.15.77:0/379604000 shutdown_connections 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 -- 172.21.15.77:0/379604000 wait complete. 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.485+0000 7fbcd012c700 1 Processor -- start 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcd012c700 1 -- start start 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcd012c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc8108670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcd012c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810c720 con 0x7fbcc8108df0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbccdec8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc8108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbccdec8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc8108670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38744/0 (socket says 172.21.15.77:38744) 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbccdec8700 1 -- 172.21.15.77:0/2561714906 learned_addr learned my addr 172.21.15.77:0/2561714906 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbccdec8700 1 -- 172.21.15.77:0/2561714906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc8108bb0 con 0x7fbcc8108df0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbccdec8700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc8108670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80116e0 tx=0x7fbcb8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb8003a60 con 0x7fbcc8108df0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcb801b8f0 con 0x7fbcc8108df0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc8106da0 con 0x7fbcc8108df0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.486+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc81072e0 con 0x7fbcc8108df0 2024-04-21T10:12:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.487+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb8019860 con 0x7fbcc8108df0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.487+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fbcb8019ba0 con 0x7fbcc8108df0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.487+0000 7fbcbeffd700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fbcb40396d0 0x7fbcb403bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.487+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbcb804ee30 con 0x7fbcc8108df0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.487+0000 7fbccd6c7700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fbcb40396d0 0x7fbcb403bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.488+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac005360 con 0x7fbcc8108df0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.488+0000 7fbccd6c7700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fbcb40396d0 0x7fbcb403bb90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4006fd0 tx=0x7fbcc4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.493+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbcb801f030 con 0x7fbcc8108df0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.746+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbcac000bf0 con 0x7fbcb40396d0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.751+0000 7fbcbeffd700 1 -- 172.21.15.77:0/2561714906 <== mgr.14118 v2:172.21.15.77:6800/1650379483 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbcac000bf0 con 0x7fbcb40396d0 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fbcb40396d0 msgr2=0x7fbcb403bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fbcb40396d0 0x7fbcb403bb90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4006fd0 tx=0x7fbcc4006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 msgr2=0x7fbcc8108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc8108670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80116e0 tx=0x7fbcb8011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:03.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 shutdown_connections 2024-04-21T10:12:03.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7fbcb40396d0 0x7fbcb403bb90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:03.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 --2- 172.21.15.77:0/2561714906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc8108df0 0x7fbcc8108670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:03.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 >> 172.21.15.77:0/2561714906 conn(0x7fbcc8102820 msgr2=0x7fbcc8103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:03.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 shutdown_connections 2024-04-21T10:12:03.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:02.753+0000 7fbcd012c700 1 -- 172.21.15.77:0/2561714906 wait complete. 2024-04-21T10:12:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045abbf700 1 Processor -- start 2024-04-21T10:12:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045abbf700 1 -- start start 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045abbf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f0454106a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045abbf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0454107020 con 0x7f0454106630 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045895b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f0454106a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045895b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f0454106a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38750/0 (socket says 172.21.15.77:38750) 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.354+0000 7f045895b700 1 -- 172.21.15.77:0/1178275411 learned_addr learned my addr 172.21.15.77:0/1178275411 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.355+0000 7f045895b700 1 -- 172.21.15.77:0/1178275411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0454109660 con 0x7f0454106630 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.355+0000 7f045895b700 1 --2- 172.21.15.77:0/1178275411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f0454106a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f04480098a0 tx=0x7f0448009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b788adf97e8bc012 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.355+0000 7f04537fe700 1 -- 172.21.15.77:0/1178275411 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0448004160 con 0x7f0454106630 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.355+0000 7f04537fe700 1 -- 172.21.15.77:0/1178275411 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0448004300 con 0x7f0454106630 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.355+0000 7f04537fe700 1 -- 172.21.15.77:0/1178275411 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0448011a20 con 0x7f0454106630 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 -- 172.21.15.77:0/1178275411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 msgr2=0x7f0454106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 --2- 172.21.15.77:0/1178275411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f0454106a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f04480098a0 tx=0x7f0448009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 -- 172.21.15.77:0/1178275411 shutdown_connections 2024-04-21T10:12:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 --2- 172.21.15.77:0/1178275411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f0454106a50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 -- 172.21.15.77:0/1178275411 >> 172.21.15.77:0/1178275411 conn(0x7f0454101fa0 msgr2=0x7f04541043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 -- 172.21.15.77:0/1178275411 shutdown_connections 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.356+0000 7f045abbf700 1 -- 172.21.15.77:0/1178275411 wait complete. 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045abbf700 1 Processor -- start 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045abbf700 1 -- start start 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045abbf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f045419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045abbf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f045410c890 con 0x7f0454106630 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045895b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f045419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045895b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f045419c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38758/0 (socket says 172.21.15.77:38758) 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045895b700 1 -- 172.21.15.77:0/2162702819 learned_addr learned my addr 172.21.15.77:0/2162702819 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.357+0000 7f045895b700 1 -- 172.21.15.77:0/2162702819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045419c6e0 con 0x7f0454106630 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.358+0000 7f045895b700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f045419c1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f04480116e0 tx=0x7f0448011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.358+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04480039e0 con 0x7f0454106630 2024-04-21T10:12:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.358+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045419c970 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.358+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f044801b8f0 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.358+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0448023760 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.358+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045419f660 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.359+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f04480239d0 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.359+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04540640a0 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.359+0000 7f0451ffb700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f0444039620 0x7f044403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.359+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f044804dfb0 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.359+0000 7f0453fff700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f0444039620 0x7f044403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.360+0000 7f0453fff700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f0444039620 0x7f044403bae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0440006fd0 tx=0x7f0440006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.365+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f044801f030 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.572+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f045419fc30 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.576+0000 7f0451ffb700 1 -- 172.21.15.77:0/2162702819 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f044804d940 con 0x7f0454106630 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f0444039620 msgr2=0x7f044403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f0444039620 0x7f044403bae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0440006fd0 tx=0x7f0440006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 msgr2=0x7f045419c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f045419c1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f04480116e0 tx=0x7f0448011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 shutdown_connections 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f0444039620 0x7f044403bae0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 --2- 172.21.15.77:0/2162702819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0454106630 0x7f045419c1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 >> 172.21.15.77:0/2162702819 conn(0x7f0454101fa0 msgr2=0x7f04541029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 shutdown_connections 2024-04-21T10:12:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:04.580+0000 7f045abbf700 1 -- 172.21.15.77:0/2162702819 wait complete. 2024-04-21T10:12:05.554 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:05 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:05.554 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:05 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2162702819' entity='client.admin' 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.659+0000 7f2ad4cf3700 1 Processor -- start 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.659+0000 7f2ad4cf3700 1 -- start start 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.659+0000 7f2ad4cf3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad010b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.659+0000 7f2ad4cf3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad007be40 con 0x7f2ad0108e00 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2ace59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad010b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2ace59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad010b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38768/0 (socket says 172.21.15.77:38768) 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2ace59c700 1 -- 172.21.15.77:0/746126095 learned_addr learned my addr 172.21.15.77:0/746126095 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2ace59c700 1 -- 172.21.15.77:0/746126095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad010b730 con 0x7f2ad0108e00 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2ace59c700 1 --2- 172.21.15.77:0/746126095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad010b1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00098a0 tx=0x7f2ac0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60fcda9d6d28b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2acd59a700 1 -- 172.21.15.77:0/746126095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0004160 con 0x7f2ad0108e00 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2acd59a700 1 -- 172.21.15.77:0/746126095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac0004300 con 0x7f2ad0108e00 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.660+0000 7f2acd59a700 1 -- 172.21.15.77:0/746126095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0011a20 con 0x7f2ad0108e00 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/746126095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 msgr2=0x7f2ad010b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 --2- 172.21.15.77:0/746126095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad010b1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00098a0 tx=0x7f2ac0009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/746126095 shutdown_connections 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 --2- 172.21.15.77:0/746126095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad010b1f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/746126095 >> 172.21.15.77:0/746126095 conn(0x7f2ad01027d0 msgr2=0x7f2ad0104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/746126095 shutdown_connections 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.661+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/746126095 wait complete. 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ad4cf3700 1 Processor -- start 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ad4cf3700 1 -- start start 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ad4cf3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ad4cf3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010c6e0 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ace59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ace59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad019c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38778/0 (socket says 172.21.15.77:38778) 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ace59c700 1 -- 172.21.15.77:0/3575364996 learned_addr learned my addr 172.21.15.77:0/3575364996 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ace59c700 1 -- 172.21.15.77:0/3575364996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad019c6c0 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ace59c700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad019c180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00116e0 tx=0x7f2ac0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0003a60 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac001b8f0 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0019860 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad019c950 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.662+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad019f640 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.663+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f2ac0019b10 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.663+0000 7f2abf7fe700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2ab8039670 0x7f2ab803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.663+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2ac004dd70 con 0x7f2ad0108e00 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.663+0000 7f2acdd9b700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2ab8039670 0x7f2ab803bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:06.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.663+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad00640a0 con 0x7f2ad0108e00 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.664+0000 7f2acdd9b700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2ab8039670 0x7f2ab803bb30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4006fd0 tx=0x7f2ac4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.668+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2ac001f030 con 0x7f2ad0108e00 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.885+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f2ad019fc00 con 0x7f2ad0108e00 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.888+0000 7f2abf7fe700 1 -- 172.21.15.77:0/3575364996 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f2ac001b440 con 0x7f2ad0108e00 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.890+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2ab8039670 msgr2=0x7f2ab803bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.890+0000 7f2ad4cf3700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2ab8039670 0x7f2ab803bb30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4006fd0 tx=0x7f2ac4006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 msgr2=0x7f2ad019c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad019c180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00116e0 tx=0x7f2ac0011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 shutdown_connections 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2ab8039670 0x7f2ab803bb30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 --2- 172.21.15.77:0/3575364996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ad0108e00 0x7f2ad019c180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 >> 172.21.15.77:0/3575364996 conn(0x7f2ad01027d0 msgr2=0x7f2ad01031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 shutdown_connections 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:05.891+0000 7f2ad4cf3700 1 -- 172.21.15.77:0/3575364996 wait complete. 2024-04-21T10:12:06.461 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling the dashboard module... 2024-04-21T10:12:06.826 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:06 smithi077 ceph-mon[27902]: from='mgr.14118 172.21.15.77:0/675939541' entity='mgr.x' 2024-04-21T10:12:06.827 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:06 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3575364996' entity='client.admin' 2024-04-21T10:12:08.066 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:07 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3140941962' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-21T10:12:08.067 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:07 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: ignoring --setuser ceph since I am not root 2024-04-21T10:12:08.067 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:07 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: ignoring --setgroup ceph since I am not root 2024-04-21T10:12:08.067 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:07 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:07.929+0000 7fad9d68f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:12:08.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:08 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:08.115+0000 7fad9d68f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:12:08.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:08 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:08.217+0000 7fad9d68f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:12:08.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.852+0000 7f9dbe4ef700 1 Processor -- start 2024-04-21T10:12:08.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.852+0000 7f9dbe4ef700 1 -- start start 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.852+0000 7f9dbe4ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.852+0000 7f9dbe4ef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9db807bea0 con 0x7f9db8108de0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db810b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38784/0 (socket says 172.21.15.77:38784) 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db7fff700 1 -- 172.21.15.77:0/1737144887 learned_addr learned my addr 172.21.15.77:0/1737144887 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db7fff700 1 -- 172.21.15.77:0/1737144887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db810b710 con 0x7f9db8108de0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db7fff700 1 --2- 172.21.15.77:0/1737144887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db810b1d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9da80098a0 tx=0x7f9da8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262b426fab80ed2e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db6ffd700 1 -- 172.21.15.77:0/1737144887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da8004160 con 0x7f9db8108de0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db6ffd700 1 -- 172.21.15.77:0/1737144887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da8004300 con 0x7f9db8108de0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.853+0000 7f9db6ffd700 1 -- 172.21.15.77:0/1737144887 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da8011a20 con 0x7f9db8108de0 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/1737144887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 msgr2=0x7f9db810b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 --2- 172.21.15.77:0/1737144887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db810b1d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9da80098a0 tx=0x7f9da8009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/1737144887 shutdown_connections 2024-04-21T10:12:08.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 --2- 172.21.15.77:0/1737144887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db810b1d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/1737144887 >> 172.21.15.77:0/1737144887 conn(0x7f9db8102850 msgr2=0x7f9db8104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/1737144887 shutdown_connections 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/1737144887 wait complete. 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 Processor -- start 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.854+0000 7f9dbe4ef700 1 -- start start 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9dbe4ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db8108660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9dbe4ef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810c720 con 0x7f9db8108de0 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db8108660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db8108660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38796/0 (socket says 172.21.15.77:38796) 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db7fff700 1 -- 172.21.15.77:0/3140941962 learned_addr learned my addr 172.21.15.77:0/3140941962 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db7fff700 1 -- 172.21.15.77:0/3140941962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db8108ba0 con 0x7f9db8108de0 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db7fff700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db8108660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000c00 tx=0x7f9da8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da8003aa0 con 0x7f9db8108de0 2024-04-21T10:12:08.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da801b8f0 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db8106d90 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da8023870 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.855+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db81072d0 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.856+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db80640a0 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.857+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f9da8023b70 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.857+0000 7f9db57fa700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9da0039670 0x7f9da003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.857+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9da804e280 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.857+0000 7f9db77fe700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9da0039670 0x7f9da003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.858+0000 7f9db77fe700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9da0039670 0x7f9da003bb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9dac006fd0 tx=0x7f9dac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:06.862+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9da801f030 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.129+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f9db8107610 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.742+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f9da801a3d0 con 0x7f9db8108de0 2024-04-21T10:12:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.743+0000 7f9db57fa700 1 -- 172.21.15.77:0/3140941962 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f9da804cd30 con 0x7f9db8108de0 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9da0039670 msgr2=0x7f9da003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9da0039670 0x7f9da003bb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9dac006fd0 tx=0x7f9dac006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 msgr2=0x7f9db8108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db8108660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000c00 tx=0x7f9da8011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 shutdown_connections 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f9da0039670 0x7f9da003bb30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 --2- 172.21.15.77:0/3140941962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db8108de0 0x7f9db8108660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 >> 172.21.15.77:0/3140941962 conn(0x7f9db8102850 msgr2=0x7f9db8103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 shutdown_connections 2024-04-21T10:12:08.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:07.746+0000 7f9dbe4ef700 1 -- 172.21.15.77:0/3140941962 wait complete. 2024-04-21T10:12:08.830 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:08 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3140941962' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-21T10:12:08.831 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:08 smithi077 ceph-mon[27902]: mgrmap e9: x(active, since 20s) 2024-04-21T10:12:08.831 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:08 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:08.528+0000 7fad9d68f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:12:08.831 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:08 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:08.612+0000 7fad9d68f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.141+0000 7f22fab05700 1 Processor -- start 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.141+0000 7f22fab05700 1 -- start start 2024-04-21T10:12:09.942 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.141+0000 7f22fab05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f4108760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.141+0000 7f22fab05700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22f4108d30 con 0x7f22f4108340 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f88a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f4108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f88a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f4108760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38808/0 (socket says 172.21.15.77:38808) 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f88a1700 1 -- 172.21.15.77:0/3342932775 learned_addr learned my addr 172.21.15.77:0/3342932775 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f88a1700 1 -- 172.21.15.77:0/3342932775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f4109540 con 0x7f22f4108340 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f88a1700 1 --2- 172.21.15.77:0/3342932775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f4108760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22e80098a0 tx=0x7f22e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37dbba73961ba39 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f37fe700 1 -- 172.21.15.77:0/3342932775 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e8004160 con 0x7f22f4108340 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f37fe700 1 -- 172.21.15.77:0/3342932775 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e8004300 con 0x7f22f4108340 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.142+0000 7f22f37fe700 1 -- 172.21.15.77:0/3342932775 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e8011a20 con 0x7f22f4108340 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 -- 172.21.15.77:0/3342932775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 msgr2=0x7f22f4108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 --2- 172.21.15.77:0/3342932775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f4108760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22e80098a0 tx=0x7f22e8009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 -- 172.21.15.77:0/3342932775 shutdown_connections 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 --2- 172.21.15.77:0/3342932775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f4108760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:09.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 -- 172.21.15.77:0/3342932775 >> 172.21.15.77:0/3342932775 conn(0x7f22f41038c0 msgr2=0x7f22f4105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 -- 172.21.15.77:0/3342932775 shutdown_connections 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 -- 172.21.15.77:0/3342932775 wait complete. 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 Processor -- start 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.143+0000 7f22fab05700 1 -- start start 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22fab05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f407db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22fab05700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22f410c8f0 con 0x7f22f4108340 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f88a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f407db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f88a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f407db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38820/0 (socket says 172.21.15.77:38820) 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f88a1700 1 -- 172.21.15.77:0/3237954862 learned_addr learned my addr 172.21.15.77:0/3237954862 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f88a1700 1 -- 172.21.15.77:0/3237954862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f407e0a0 con 0x7f22f4108340 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f88a1700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f407db60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22e80116e0 tx=0x7f22e8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e80039e0 con 0x7f22f4108340 2024-04-21T10:12:09.944 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e801b8f0 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e8023760 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f407c290 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.144+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f407c7d0 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.145+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f22e801b440 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.145+0000 7f22f1ffb700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 0x7f22e403bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.145+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f22e804dec0 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.145+0000 7f22f3fff700 1 -- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 msgr2=0x7f22e403bb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.145+0000 7f22f3fff700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 0x7f22e403bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.146+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f40640a0 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.151+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f22e801f030 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.346+0000 7f22f3fff700 1 -- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 msgr2=0x7f22e403bb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.346+0000 7f22f3fff700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 0x7f22e403bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.412+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f22f407ce50 con 0x7f22f4108340 2024-04-21T10:12:09.945 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.412+0000 7f22f1ffb700 1 -- 172.21.15.77:0/3237954862 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f22e800e260 con 0x7f22f4108340 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 msgr2=0x7f22e403bb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 0x7f22e403bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 msgr2=0x7f22f407db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f407db60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22e80116e0 tx=0x7f22e8011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 shutdown_connections 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f22e40396d0 0x7f22e403bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 --2- 172.21.15.77:0/3237954862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4108340 0x7f22f407db60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 >> 172.21.15.77:0/3237954862 conn(0x7f22f41038c0 msgr2=0x7f22f4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 shutdown_connections 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:09.415+0000 7f22fab05700 1 -- 172.21.15.77:0/3237954862 wait complete. 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-04-21T10:12:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 9... 2024-04-21T10:12:09.996 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:09 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3237954862' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-21T10:12:09.996 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:09 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:09.821+0000 7fad9d68f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:12:10.294 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:09 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:09.996+0000 7fad9d68f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:12:10.294 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:10 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:10.167+0000 7fad9d68f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:12:10.559 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:10 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:10.465+0000 7fad9d68f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:12:10.559 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:10 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:10.559+0000 7fad9d68f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:12:10.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:10 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:10.764+0000 7fad9d68f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:12:11.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:10 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:10.958+0000 7fad9d68f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:12:11.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:11 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:11.563+0000 7fad9d68f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:12:12.280 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:11 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:11.985+0000 7fad9d68f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:12:12.280 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:12 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:12.081+0000 7fad9d68f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:12:12.281 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:12 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:12.280+0000 7fad9d68f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:12:13.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:12 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:12.802+0000 7fad9d68f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:12:13.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:12 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:12.892+0000 7fad9d68f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:12:13.404 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:13 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:13.135+0000 7fad9d68f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:12:13.404 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:13 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:13.267+0000 7fad9d68f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:12:13.404 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:13 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:13.363+0000 7fad9d68f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:12:13.778 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:13 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:13.479+0000 7fad9d68f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:12:13.778 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:13 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:13.778+0000 7fad9d68f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:12:14.635 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:14.374+0000 7fad9d68f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:12:14.635 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:12:14.589+0000 7fad9d68f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:12:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: Active manager daemon x restarted 2024-04-21T10:12:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: Activating manager daemon x 2024-04-21T10:12:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: osdmap e3: 0 total, 0 up, 0 in 2024-04-21T10:12:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: mgrmap e10: x(active, starting, since 0.0034136s) 2024-04-21T10:12:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:12:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T10:12:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T10:12:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T10:12:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T10:12:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: Manager daemon x is now available 2024-04-21T10:12:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T10:12:15.809 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T10:12:15.809 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:15 smithi077 ceph-mon[27902]: mgrmap e11: x(active, since 1.00572s) 2024-04-21T10:12:16.592 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.394+0000 7f201f6d9700 1 Processor -- start 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.394+0000 7f201f6d9700 1 -- start start 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201f6d9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f201810b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201f6d9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f201807be40 con 0x7f2018108e20 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201d475700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f201810b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201d475700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f201810b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38836/0 (socket says 172.21.15.77:38836) 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201d475700 1 -- 172.21.15.77:0/3588798428 learned_addr learned my addr 172.21.15.77:0/3588798428 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:16.593 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201d475700 1 -- 172.21.15.77:0/3588798428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201810b750 con 0x7f2018108e20 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f201d475700 1 --2- 172.21.15.77:0/3588798428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f201810b210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20140098a0 tx=0x7f2014009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9c9bc90900a7f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f200ffff700 1 -- 172.21.15.77:0/3588798428 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2014004160 con 0x7f2018108e20 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f200ffff700 1 -- 172.21.15.77:0/3588798428 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2014004300 con 0x7f2018108e20 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.395+0000 7f200ffff700 1 -- 172.21.15.77:0/3588798428 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2014011a20 con 0x7f2018108e20 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 -- 172.21.15.77:0/3588798428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 msgr2=0x7f201810b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3588798428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f201810b210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20140098a0 tx=0x7f2014009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 -- 172.21.15.77:0/3588798428 shutdown_connections 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3588798428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f201810b210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 -- 172.21.15.77:0/3588798428 >> 172.21.15.77:0/3588798428 conn(0x7f2018102890 msgr2=0x7f2018104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 -- 172.21.15.77:0/3588798428 shutdown_connections 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.396+0000 7f201f6d9700 1 -- 172.21.15.77:0/3588798428 wait complete. 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201f6d9700 1 Processor -- start 2024-04-21T10:12:16.594 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201f6d9700 1 -- start start 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201f6d9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f20181086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201f6d9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f201810c700 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201d475700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f20181086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201d475700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f20181086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38846/0 (socket says 172.21.15.77:38846) 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201d475700 1 -- 172.21.15.77:0/3134354320 learned_addr learned my addr 172.21.15.77:0/3134354320 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201d475700 1 -- 172.21.15.77:0/3134354320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2018108be0 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.397+0000 7f201d475700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f20181086a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20140116e0 tx=0x7f2014011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.398+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2014003a60 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.398+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f201401b8f0 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.398+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2018106dd0 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.398+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2014019860 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.398+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2018107310 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.399+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f2014019b80 con 0x7f2018108e20 2024-04-21T10:12:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.399+0000 7f200e7fc700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.399+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 --> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f200403c240 con 0x7f2004039670 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.399+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f201404dec0 con 0x7f2018108e20 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.399+0000 7f201cc74700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 msgr2=0x7f200403bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.399+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.600+0000 7f201cc74700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 msgr2=0x7f200403bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:10.600+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:11.001+0000 7f201cc74700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 msgr2=0x7f200403bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:11.001+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:11.802+0000 7f201cc74700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 msgr2=0x7f200403bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:11.802+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:13.403+0000 7f201cc74700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 msgr2=0x7f200403bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/1650379483 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:13.403+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-21T10:12:16.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:14.593+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7f201401a8a0 con 0x7f2018108e20 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:14.593+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 msgr2=0x7f200403bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:14.593+0000 7f200e7fc700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.594+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f201401a3d0 con 0x7f2018108e20 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.595+0000 7f200e7fc700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f200403cfb0 0x7f200403f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.595+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2014027e50 con 0x7f200403cfb0 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.595+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f200403cfb0 0x7f200403f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.596+0000 7f201cc74700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f200403cfb0 0x7f200403f3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2008003a10 tx=0x7f20080092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.596+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f2014027e50 con 0x7f200403cfb0 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2018069b50 con 0x7f200403cfb0 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f200e7fc700 1 -- 172.21.15.77:0/3134354320 <== mgr.14150 v2:172.21.15.77:6800/3235809387 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f2018069b50 con 0x7f200403cfb0 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f200403cfb0 msgr2=0x7f200403f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f200403cfb0 0x7f200403f3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2008003a10 tx=0x7f20080092b0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 msgr2=0x7f20181086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f20181086a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20140116e0 tx=0x7f2014011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 shutdown_connections 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f200403cfb0 0x7f200403f3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2018108e20 0x7f20181086a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 --2- 172.21.15.77:0/3134354320 >> [v2:172.21.15.77:6800/1650379483,v1:172.21.15.77:6801/1650379483] conn(0x7f2004039670 0x7f200403bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 >> 172.21.15.77:0/3134354320 conn(0x7f2018102890 msgr2=0x7f20181032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 shutdown_connections 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:15.603+0000 7f201f6d9700 1 -- 172.21.15.77:0/3134354320 wait complete. 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 9 is available 2024-04-21T10:12:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:Generating a dashboard self-signed certificate... 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: [21/Apr/2024:10:12:15] ENGINE Bus STARTING 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: [21/Apr/2024:10:12:15] ENGINE Serving on https://172.21.15.77:7150 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: [21/Apr/2024:10:12:15] ENGINE Serving on http://172.21.15.77:8765 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: [21/Apr/2024:10:12:15] ENGINE Bus STARTED 2024-04-21T10:12:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-21T10:12:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.003+0000 7fb149f15700 1 Processor -- start 2024-04-21T10:12:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.003+0000 7fb149f15700 1 -- start start 2024-04-21T10:12:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.003+0000 7fb149f15700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb14410b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.003+0000 7fb149f15700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb14407bdc0 con 0x7fb144108ea0 2024-04-21T10:12:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1437fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb14410b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1437fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb14410b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38876/0 (socket says 172.21.15.77:38876) 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1437fe700 1 -- 172.21.15.77:0/2123916711 learned_addr learned my addr 172.21.15.77:0/2123916711 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1437fe700 1 -- 172.21.15.77:0/2123916711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14410b7d0 con 0x7fb144108ea0 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1437fe700 1 --2- 172.21.15.77:0/2123916711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb14410b290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1340098a0 tx=0x7fb134009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4f523c64069302 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1427fc700 1 -- 172.21.15.77:0/2123916711 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb134004160 con 0x7fb144108ea0 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1427fc700 1 -- 172.21.15.77:0/2123916711 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb134004300 con 0x7fb144108ea0 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.004+0000 7fb1427fc700 1 -- 172.21.15.77:0/2123916711 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb134011a20 con 0x7fb144108ea0 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 -- 172.21.15.77:0/2123916711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 msgr2=0x7fb14410b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 --2- 172.21.15.77:0/2123916711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb14410b290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1340098a0 tx=0x7fb134009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 -- 172.21.15.77:0/2123916711 shutdown_connections 2024-04-21T10:12:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 --2- 172.21.15.77:0/2123916711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb14410b290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 -- 172.21.15.77:0/2123916711 >> 172.21.15.77:0/2123916711 conn(0x7fb144102890 msgr2=0x7fb144104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 -- 172.21.15.77:0/2123916711 shutdown_connections 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.005+0000 7fb149f15700 1 -- 172.21.15.77:0/2123916711 wait complete. 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb149f15700 1 Processor -- start 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb149f15700 1 -- start start 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb149f15700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb144108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb149f15700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410c710 con 0x7fb144108ea0 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb1437fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb144108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb1437fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb144108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38882/0 (socket says 172.21.15.77:38882) 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb1437fe700 1 -- 172.21.15.77:0/471071225 learned_addr learned my addr 172.21.15.77:0/471071225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb1437fe700 1 -- 172.21.15.77:0/471071225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb144108c60 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.006+0000 7fb1437fe700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb144108720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1340116e0 tx=0x7fb134011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.007+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb134003a60 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.007+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb144106e50 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.007+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb13401b8f0 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.007+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb144107390 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.007+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb134019860 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.008+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1440640a0 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.008+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7fb134019b80 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.008+0000 7fb140ff9700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb12c039560 0x7fb12c03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.008+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb13404ded0 con 0x7fb144108ea0 2024-04-21T10:12:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.008+0000 7fb142ffd700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb12c039560 0x7fb12c03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.009+0000 7fb142ffd700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb12c039560 0x7fb12c03ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb138006fd0 tx=0x7fb138006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.018+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb13401f030 con 0x7fb144108ea0 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.198+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fb13401a8f0 con 0x7fb144108ea0 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.230+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fb144107ca0 con 0x7fb12c039560 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.283+0000 7fb140ff9700 1 -- 172.21.15.77:0/471071225 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fb144107ca0 con 0x7fb12c039560 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb12c039560 msgr2=0x7fb12c03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb12c039560 0x7fb12c03ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb138006fd0 tx=0x7fb138006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 msgr2=0x7fb144108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb144108720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1340116e0 tx=0x7fb134011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 shutdown_connections 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb12c039560 0x7fb12c03ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 --2- 172.21.15.77:0/471071225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb144108ea0 0x7fb144108720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 >> 172.21.15.77:0/471071225 conn(0x7fb144102890 msgr2=0x7fb1441032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 shutdown_connections 2024-04-21T10:12:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:17.285+0000 7fb149f15700 1 -- 172.21.15.77:0/471071225 wait complete. 2024-04-21T10:12:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial admin user... 2024-04-21T10:12:18.318 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:18 smithi077 ceph-mon[27902]: mgrmap e12: x(active, since 2s) 2024-04-21T10:12:18.319 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:18 smithi077 ceph-mon[27902]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:18.319 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:18 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:18.319 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:18 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:18.319 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:18 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$tzbCYDFdzJJlFFBFM8oYtuP6gjSM2ICMiMW.FHvcsApobfKjdqstm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713694338, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-21T10:12:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.339+0000 7f611551c700 1 Processor -- start 2024-04-21T10:12:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.339+0000 7f611551c700 1 -- start start 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f611551c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f6110106df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f611551c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61101073c0 con 0x7f61101069d0 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f6110106df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f6110106df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38892/0 (socket says 172.21.15.77:38892) 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610effd700 1 -- 172.21.15.77:0/3745958435 learned_addr learned my addr 172.21.15.77:0/3745958435 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610effd700 1 -- 172.21.15.77:0/3745958435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6110107bd0 con 0x7f61101069d0 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610effd700 1 --2- 172.21.15.77:0/3745958435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f6110106df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61000098a0 tx=0x7f6100009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83372d5d2a6221e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610dffb700 1 -- 172.21.15.77:0/3745958435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6100004160 con 0x7f61101069d0 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.340+0000 7f610dffb700 1 -- 172.21.15.77:0/3745958435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6100004300 con 0x7f61101069d0 2024-04-21T10:12:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f610dffb700 1 -- 172.21.15.77:0/3745958435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6100011a20 con 0x7f61101069d0 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 -- 172.21.15.77:0/3745958435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 msgr2=0x7f6110106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 --2- 172.21.15.77:0/3745958435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f6110106df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61000098a0 tx=0x7f6100009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 -- 172.21.15.77:0/3745958435 shutdown_connections 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 --2- 172.21.15.77:0/3745958435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f6110106df0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 -- 172.21.15.77:0/3745958435 >> 172.21.15.77:0/3745958435 conn(0x7f6110101fb0 msgr2=0x7f61101043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 -- 172.21.15.77:0/3745958435 shutdown_connections 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.341+0000 7f611551c700 1 -- 172.21.15.77:0/3745958435 wait complete. 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f611551c700 1 Processor -- start 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f611551c700 1 -- start start 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f611551c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f611019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f611551c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6110108340 con 0x7f61101069d0 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f610effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f611019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f610effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f611019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38898/0 (socket says 172.21.15.77:38898) 2024-04-21T10:12:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.342+0000 7f610effd700 1 -- 172.21.15.77:0/2544673944 learned_addr learned my addr 172.21.15.77:0/2544673944 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f610effd700 1 -- 172.21.15.77:0/2544673944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611019e8d0 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f610effd700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f611019e390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6100009520 tx=0x7f6100011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61000039e0 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f610001b8f0 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611019eb60 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6100019770 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.343+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61101a1850 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.344+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f6100019a70 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.344+0000 7f60f7fff700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f80396b0 0x7f60f803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.344+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f610004efc0 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.344+0000 7f610e7fc700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f80396b0 0x7f60f803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.344+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61100640a0 con 0x7f61101069d0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.345+0000 7f610e7fc700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f80396b0 0x7f60f803bb70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6104006fd0 tx=0x7f6104006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.350+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f610001f030 con 0x7f61101069d0 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.570+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f611002e020 con 0x7f60f80396b0 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.793+0000 7f60f7fff700 1 -- 172.21.15.77:0/2544673944 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f611002e020 con 0x7f60f80396b0 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f80396b0 msgr2=0x7f60f803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f80396b0 0x7f60f803bb70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6104006fd0 tx=0x7f6104006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 msgr2=0x7f611019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f611019e390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6100009520 tx=0x7f6100011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 shutdown_connections 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f80396b0 0x7f60f803bb70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 --2- 172.21.15.77:0/2544673944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61101069d0 0x7f611019e390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.795+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 >> 172.21.15.77:0/2544673944 conn(0x7f6110101fb0 msgr2=0x7f6110190bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.796+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 shutdown_connections 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:18.796+0000 7f611551c700 1 -- 172.21.15.77:0/2544673944 wait complete. 2024-04-21T10:12:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:Fetching dashboard port number... 2024-04-21T10:12:20.054 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:19 smithi077 ceph-mon[27902]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:20.054 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 8443 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.958+0000 7f1d46951700 1 Processor -- start 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.958+0000 7f1d46951700 1 -- start start 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d46951700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d401087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d46951700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40108da0 con 0x7f1d401083b0 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d401087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d401087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38912/0 (socket says 172.21.15.77:38912) 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3ffff700 1 -- 172.21.15.77:0/3870359092 learned_addr learned my addr 172.21.15.77:0/3870359092 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3ffff700 1 -- 172.21.15.77:0/3870359092 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d40109560 con 0x7f1d401083b0 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3ffff700 1 --2- 172.21.15.77:0/3870359092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d401087d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d300098a0 tx=0x7f1d30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25479a38ea9e275e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3effd700 1 -- 172.21.15.77:0/3870359092 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d30004160 con 0x7f1d401083b0 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3effd700 1 -- 172.21.15.77:0/3870359092 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d30004300 con 0x7f1d401083b0 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.959+0000 7f1d3effd700 1 -- 172.21.15.77:0/3870359092 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d30011a20 con 0x7f1d401083b0 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 -- 172.21.15.77:0/3870359092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 msgr2=0x7f1d401087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 --2- 172.21.15.77:0/3870359092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d401087d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d300098a0 tx=0x7f1d30009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 -- 172.21.15.77:0/3870359092 shutdown_connections 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 --2- 172.21.15.77:0/3870359092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d401087d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 -- 172.21.15.77:0/3870359092 >> 172.21.15.77:0/3870359092 conn(0x7f1d401039b0 msgr2=0x7f1d40105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 -- 172.21.15.77:0/3870359092 shutdown_connections 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.960+0000 7f1d46951700 1 -- 172.21.15.77:0/3870359092 wait complete. 2024-04-21T10:12:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d46951700 1 Processor -- start 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d46951700 1 -- start start 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d46951700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d4019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d46951700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4010c910 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d4019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d4019c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38926/0 (socket says 172.21.15.77:38926) 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d3ffff700 1 -- 172.21.15.77:0/927496026 learned_addr learned my addr 172.21.15.77:0/927496026 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.961+0000 7f1d3ffff700 1 -- 172.21.15.77:0/927496026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4019c6f0 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.962+0000 7f1d3ffff700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d4019c1b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d300116e0 tx=0x7f1d30011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.962+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d300039e0 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.962+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4019c980 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.962+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d3001b8f0 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.962+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d30023760 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.962+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4019f670 con 0x7f1d401083b0 2024-04-21T10:12:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.963+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f1d3001b440 con 0x7f1d401083b0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.963+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d400640a0 con 0x7f1d401083b0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.963+0000 7f1d3d7fa700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1d28039670 0x7f1d2803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.963+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1d3004e040 con 0x7f1d401083b0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.963+0000 7f1d3f7fe700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1d28039670 0x7f1d2803bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.963+0000 7f1d3f7fe700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1d28039670 0x7f1d2803bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d34006fd0 tx=0x7f1d34006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:19.968+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1d3001f030 con 0x7f1d401083b0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.171+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f1d4019fc20 con 0x7f1d401083b0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.171+0000 7f1d3d7fa700 1 -- 172.21.15.77:0/927496026 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f1d300292a0 con 0x7f1d401083b0 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1d28039670 msgr2=0x7f1d2803bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1d28039670 0x7f1d2803bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d34006fd0 tx=0x7f1d34006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 msgr2=0x7f1d4019c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d4019c1b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d300116e0 tx=0x7f1d30011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 shutdown_connections 2024-04-21T10:12:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1d28039670 0x7f1d2803bb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 --2- 172.21.15.77:0/927496026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d401083b0 0x7f1d4019c1b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 >> 172.21.15.77:0/927496026 conn(0x7f1d401039b0 msgr2=0x7f1d401043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 shutdown_connections 2024-04-21T10:12:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:20.173+0000 7f1d46951700 1 -- 172.21.15.77:0/927496026 wait complete. 2024-04-21T10:12:20.988 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T10:12:20.988 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-21T10:12:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T10:12:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-21T10:12:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-21T10:12:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-21T10:12:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph Dashboard is now available at: 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: URL: https://smithi077:8443/ 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: User: admin 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: Password: 0uaxo14go1 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:Saving cluster configuration to /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config directory 2024-04-21T10:12:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling autotune for osd_memory_target 2024-04-21T10:12:21.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/927496026' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-21T10:12:21.929 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:21 smithi077 ceph-mon[27902]: mgrmap e13: x(active, since 6s) 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.420+0000 7fd007346700 1 Processor -- start 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.420+0000 7fd007346700 1 -- start start 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.420+0000 7fd007346700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd0001087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.420+0000 7fd007346700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd000108da0 con 0x7fd0001083b0 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fd0050e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd0001087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fd0050e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd0001087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35586/0 (socket says 172.21.15.77:35586) 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fd0050e2700 1 -- 172.21.15.77:0/1888677811 learned_addr learned my addr 172.21.15.77:0/1888677811 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fd0050e2700 1 -- 172.21.15.77:0/1888677811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000109560 con 0x7fd0001083b0 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fd0050e2700 1 --2- 172.21.15.77:0/1888677811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd0001087d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0098a0 tx=0x7fcffc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5e1538e20f0fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fcff7fff700 1 -- 172.21.15.77:0/1888677811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcffc004160 con 0x7fd0001083b0 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fcff7fff700 1 -- 172.21.15.77:0/1888677811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcffc004300 con 0x7fd0001083b0 2024-04-21T10:12:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.421+0000 7fcff7fff700 1 -- 172.21.15.77:0/1888677811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcffc011a20 con 0x7fd0001083b0 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 -- 172.21.15.77:0/1888677811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 msgr2=0x7fd0001087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 --2- 172.21.15.77:0/1888677811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd0001087d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0098a0 tx=0x7fcffc009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 -- 172.21.15.77:0/1888677811 shutdown_connections 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 --2- 172.21.15.77:0/1888677811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd0001087d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 -- 172.21.15.77:0/1888677811 >> 172.21.15.77:0/1888677811 conn(0x7fd0001039b0 msgr2=0x7fd000105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 -- 172.21.15.77:0/1888677811 shutdown_connections 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 -- 172.21.15.77:0/1888677811 wait complete. 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 Processor -- start 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.422+0000 7fd007346700 1 -- start start 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd007346700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd00019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd007346700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd00010c910 con 0x7fd0001083b0 2024-04-21T10:12:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd0050e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd00019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd0050e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd00019c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35590/0 (socket says 172.21.15.77:35590) 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd0050e2700 1 -- 172.21.15.77:0/841930471 learned_addr learned my addr 172.21.15.77:0/841930471 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd0050e2700 1 -- 172.21.15.77:0/841930471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00019c6e0 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd0050e2700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd00019c1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0116e0 tx=0x7fcffc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcffc0039e0 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00019c970 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcffc01b8f0 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcffc023760 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.423+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00019f660 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.424+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fcffc0239d0 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.424+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0000640a0 con 0x7fd0001083b0 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.424+0000 7fcff67fc700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcfec039710 0x7fcfec03bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.424+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcffc04e290 con 0x7fd0001083b0 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.424+0000 7fd0048e1700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcfec039710 0x7fcfec03bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.425+0000 7fd0048e1700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcfec039710 0x7fcfec03bbd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcff0006fd0 tx=0x7fcff0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.429+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcffc01f030 con 0x7fd0001083b0 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.624+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fd00019fc80 con 0x7fd0001083b0 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.625+0000 7fcff67fc700 1 -- 172.21.15.77:0/841930471 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fcffc018c10 con 0x7fd0001083b0 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcfec039710 msgr2=0x7fcfec03bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcfec039710 0x7fcfec03bbd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcff0006fd0 tx=0x7fcff0006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 msgr2=0x7fd00019c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd00019c1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0116e0 tx=0x7fcffc011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 shutdown_connections 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcfec039710 0x7fcfec03bbd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 --2- 172.21.15.77:0/841930471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0001083b0 0x7fd00019c1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 >> 172.21.15.77:0/841930471 conn(0x7fd0001039b0 msgr2=0x7fd000104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 shutdown_connections 2024-04-21T10:12:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:21.627+0000 7fd007346700 1 -- 172.21.15.77:0/841930471 wait complete. 2024-04-21T10:12:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c99202700 1 Processor -- start 2024-04-21T10:12:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c99202700 1 -- start start 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c99202700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9407c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c99202700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9407c8e0 con 0x7f3c9407de60 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c92d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9407c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c92d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9407c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35598/0 (socket says 172.21.15.77:35598) 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.667+0000 7f3c92d9d700 1 -- 172.21.15.77:0/1649175715 learned_addr learned my addr 172.21.15.77:0/1649175715 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.668+0000 7f3c92d9d700 1 -- 172.21.15.77:0/1649175715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9407ca60 con 0x7f3c9407de60 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.668+0000 7f3c92d9d700 1 --2- 172.21.15.77:0/1649175715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9407c310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c840098a0 tx=0x7f3c84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee03a7d12bf23bb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.668+0000 7f3c9259c700 1 -- 172.21.15.77:0/1649175715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c84004160 con 0x7f3c9407de60 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.668+0000 7f3c9259c700 1 -- 172.21.15.77:0/1649175715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c84004300 con 0x7f3c9407de60 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.668+0000 7f3c9259c700 1 -- 172.21.15.77:0/1649175715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c84011a20 con 0x7f3c9407de60 2024-04-21T10:12:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 -- 172.21.15.77:0/1649175715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 msgr2=0x7f3c9407c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 --2- 172.21.15.77:0/1649175715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9407c310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c840098a0 tx=0x7f3c84009bb0 comp rx=0 tx=0).stop 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 -- 172.21.15.77:0/1649175715 shutdown_connections 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 --2- 172.21.15.77:0/1649175715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9407c310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 -- 172.21.15.77:0/1649175715 >> 172.21.15.77:0/1649175715 conn(0x7f3c941039b0 msgr2=0x7f3c94105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 -- 172.21.15.77:0/1649175715 shutdown_connections 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 -- 172.21.15.77:0/1649175715 wait complete. 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 Processor -- start 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.669+0000 7f3c99202700 1 -- start start 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c99202700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c99202700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9410e930 con 0x7f3c9407de60 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c92d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c92d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9419e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35608/0 (socket says 172.21.15.77:35608) 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c92d9d700 1 -- 172.21.15.77:0/1526372723 learned_addr learned my addr 172.21.15.77:0/1526372723 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c92d9d700 1 -- 172.21.15.77:0/1526372723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9419e8b0 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c92d9d700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9419e370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c840116e0 tx=0x7f3c84011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c84003a60 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c8401b8f0 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c84019860 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9419eb40 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.670+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c941a1830 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.671+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f3c84019b60 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.671+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c940640a0 con 0x7f3c9407de60 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.671+0000 7f3c90d99700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3c80039710 0x7f3c8003bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.671+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3c8404dee0 con 0x7f3c9407de60 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.671+0000 7f3c8bfff700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3c80039710 0x7f3c8003bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.672+0000 7f3c8bfff700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3c80039710 0x7f3c8003bbd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c006fd0 tx=0x7f3c7c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.676+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c8401f030 con 0x7f3c9407de60 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.989+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f3c941a1de0 con 0x7f3c9407de60 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.991+0000 7f3c90d99700 1 -- 172.21.15.77:0/1526372723 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f3c84029260 con 0x7f3c9407de60 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3c80039710 msgr2=0x7f3c8003bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3c80039710 0x7f3c8003bbd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c006fd0 tx=0x7f3c7c006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 msgr2=0x7f3c9419e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9419e370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c840116e0 tx=0x7f3c84011aa0 comp rx=0 tx=0).stop 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 shutdown_connections 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3c80039710 0x7f3c8003bbd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 --2- 172.21.15.77:0/1526372723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c9407de60 0x7f3c9419e370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 >> 172.21.15.77:0/1526372723 conn(0x7f3c941039b0 msgr2=0x7f3c941043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.993+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 shutdown_connections 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-21T10:12:22.994+0000 7f3c99202700 1 -- 172.21.15.77:0/1526372723 wait complete. 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:Or, if you are only running a single cluster on this host: 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout: ceph telemetry on 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:For more information see: 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:Bootstrap complete. 2024-04-21T10:12:23.581 INFO:tasks.cephadm:Fetching config... 2024-04-21T10:12:23.581 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:12:23.581 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-21T10:12:23.596 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-21T10:12:23.596 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:12:23.597 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-21T10:12:23.651 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-21T10:12:23.651 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:12:23.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-21T10:12:23.715 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-21T10:12:23.715 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:12:23.715 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-21T10:12:23.770 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-21T10:12:23.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-21T10:12:23.841 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:12:23.852 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-21T10:12:23.890 INFO:teuthology.orchestra.run.smithi170.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:12:23.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-21T10:12:23.940 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpENDbKFeJim9TJhN9radTBwBuLKhmqyfQMP0lo9XsutG05FoLEc5HKKXdUooeKKzl71E304NK4HRah4CD+GrgOCnq+YSHp7xKYEZvPI3LvuAkzMQXuC6IsUSlZ87M6XyvlU5mXTBIuUhGGVciNAJibhG55v1m4nu8+T7rOswtVCEqXZ6HvM8tKWLChkH5Prp+tTnLf6oUs6+mHrBq5BfDX+7QNwJqBYrRPS6wFNUEJ5pgfgM36/beokXpVuP5vXsYJBt1Jw3Rh0xU33sVWg8Xn47okMoKJ4VXancxToFFjmIgewEpcdmkiHOQ5EPi8cTt4YxBzTRgPILYv7CCVjfo5R6ez0NWe2t+aSEsiGAOwyO62W3VDSXSV6eoXxeWjdpFTia92j5JqYYy8f3TZoohjWJfrWblAdsi98PRq61lQ5q7dr0+iuQLud6mzvXLPF407Yb4LD05Me1UyeCKlbwz2LEohhwTe/F3YyRXa4MhqtPVEY6tOZTZ8Ivugbrmqlc= ceph-41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:12:23.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-21T10:12:24.081 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:23 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1526372723' entity='client.admin' 2024-04-21T10:12:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:26.754 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:26.754 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:26.754 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:12:26.754 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:26.754 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:26.754 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 -- 172.21.15.77:0/3858352750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 msgr2=0x7ff9401028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 --2- 172.21.15.77:0/3858352750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff9401028e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff930009910 tx=0x7ff930009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 -- 172.21.15.77:0/3858352750 shutdown_connections 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 --2- 172.21.15.77:0/3858352750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff9401028e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 -- 172.21.15.77:0/3858352750 >> 172.21.15.77:0/3858352750 conn(0x7ff9400fda60 msgr2=0x7ff9400ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 -- 172.21.15.77:0/3858352750 shutdown_connections 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 -- 172.21.15.77:0/3858352750 wait complete. 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.880+0000 7ff945af5700 1 Processor -- start 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff945af5700 1 -- start start 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff945af5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff940197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff945af5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff940108400 con 0x7ff9401024c0 2024-04-21T10:12:26.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff93f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff940197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:26.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff93f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff940197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35632/0 (socket says 172.21.15.77:35632) 2024-04-21T10:12:26.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff93f7fe700 1 -- 172.21.15.77:0/1586085520 learned_addr learned my addr 172.21.15.77:0/1586085520 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:26.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff93f7fe700 1 -- 172.21.15.77:0/1586085520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff940198050 con 0x7ff9401024c0 2024-04-21T10:12:26.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff93f7fe700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff940197b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff930005800 tx=0x7ff930009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:26.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.881+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff930027070 con 0x7ff9401024c0 2024-04-21T10:12:26.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.882+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9401982e0 con 0x7ff9401024c0 2024-04-21T10:12:26.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.882+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff93000be10 con 0x7ff9401024c0 2024-04-21T10:12:26.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.882+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94019af80 con 0x7ff9401024c0 2024-04-21T10:12:26.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.882+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff930022e60 con 0x7ff9401024c0 2024-04-21T10:12:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.882+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7ff93002a070 con 0x7ff9401024c0 2024-04-21T10:12:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.883+0000 7ff93cff9700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff928039650 0x7ff92803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.883+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff940108b80 con 0x7ff9401024c0 2024-04-21T10:12:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.883+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff93001e030 con 0x7ff9401024c0 2024-04-21T10:12:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.883+0000 7ff93effd700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff928039650 0x7ff92803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.883+0000 7ff93effd700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff928039650 0x7ff92803bb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff934006fd0 tx=0x7ff934006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:26.888+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff930013070 con 0x7ff9401024c0 2024-04-21T10:12:27.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.093+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff94002e090 con 0x7ff9401024c0 2024-04-21T10:12:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.095+0000 7ff93cff9700 1 -- 172.21.15.77:0/1586085520 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff930022470 con 0x7ff9401024c0 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff928039650 msgr2=0x7ff92803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff928039650 0x7ff92803bb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff934006fd0 tx=0x7ff934006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 msgr2=0x7ff940197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff940197b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff930005800 tx=0x7ff930009f60 comp rx=0 tx=0).stop 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 shutdown_connections 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff928039650 0x7ff92803bb10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 --2- 172.21.15.77:0/1586085520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9401024c0 0x7ff940197b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 >> 172.21.15.77:0/1586085520 conn(0x7ff9400fda60 msgr2=0x7ff9400fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 shutdown_connections 2024-04-21T10:12:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:27.097+0000 7ff945af5700 1 -- 172.21.15.77:0/1586085520 wait complete. 2024-04-21T10:12:28.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:28 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1586085520' entity='client.admin' 2024-04-21T10:12:28.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:28.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:28.180 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-21T10:12:28.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-21T10:12:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:30.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 -- 172.21.15.77:0/1324311399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 msgr2=0x7f73d4105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:30.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 --2- 172.21.15.77:0/1324311399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4105320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009910 tx=0x7f73c8009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:30.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 -- 172.21.15.77:0/1324311399 shutdown_connections 2024-04-21T10:12:30.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 --2- 172.21.15.77:0/1324311399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4105320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:30.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 -- 172.21.15.77:0/1324311399 >> 172.21.15.77:0/1324311399 conn(0x7f73d40fc940 msgr2=0x7f73d40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:30.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 -- 172.21.15.77:0/1324311399 shutdown_connections 2024-04-21T10:12:30.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.023+0000 7f73daddc700 1 -- 172.21.15.77:0/1324311399 wait complete. 2024-04-21T10:12:30.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73daddc700 1 Processor -- start 2024-04-21T10:12:30.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73daddc700 1 -- start start 2024-04-21T10:12:30.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73daddc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:30.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73daddc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4108380 con 0x7f73d4102f30 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73d8b78700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73d8b78700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4102760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35654/0 (socket says 172.21.15.77:35654) 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73d8b78700 1 -- 172.21.15.77:0/3853269155 learned_addr learned my addr 172.21.15.77:0/3853269155 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73d8b78700 1 -- 172.21.15.77:0/3853269155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d4102ca0 con 0x7f73d4102f30 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73d8b78700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4102760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73c8005190 tx=0x7f73c8004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.024+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c8027070 con 0x7f73d4102f30 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.025+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c8022470 con 0x7f73d4102f30 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.025+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d4100ee0 con 0x7f73d4102f30 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.025+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c800f5f0 con 0x7f73d4102f30 2024-04-21T10:12:30.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.025+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d4101420 con 0x7f73d4102f30 2024-04-21T10:12:30.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.025+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f73c802a070 con 0x7f73d4102f30 2024-04-21T10:12:30.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.026+0000 7f73d1ffb700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f73c4039650 0x7f73c403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:30.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.026+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f73c801e030 con 0x7f73d4102f30 2024-04-21T10:12:30.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.026+0000 7f73d3fff700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f73c4039650 0x7f73c403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:30.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.026+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d4108b00 con 0x7f73d4102f30 2024-04-21T10:12:30.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.026+0000 7f73d3fff700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f73c4039650 0x7f73c403bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73c0006fd0 tx=0x7f73c0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:30.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.031+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f73c8031070 con 0x7f73d4102f30 2024-04-21T10:12:30.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.231+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f73d4190cf0 con 0x7f73c4039650 2024-04-21T10:12:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.235+0000 7f73d1ffb700 1 -- 172.21.15.77:0/3853269155 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f73d4190cf0 con 0x7f73c4039650 2024-04-21T10:12:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f73c4039650 msgr2=0x7f73c403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f73c4039650 0x7f73c403bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f73c0006fd0 tx=0x7f73c0006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 msgr2=0x7f73d4102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4102760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73c8005190 tx=0x7f73c8004f80 comp rx=0 tx=0).stop 2024-04-21T10:12:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 shutdown_connections 2024-04-21T10:12:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f73c4039650 0x7f73c403bb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 --2- 172.21.15.77:0/3853269155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73d4102f30 0x7f73d4102760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 >> 172.21.15.77:0/3853269155 conn(0x7f73d40fc940 msgr2=0x7f73d40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 shutdown_connections 2024-04-21T10:12:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:30.237+0000 7f73daddc700 1 -- 172.21.15.77:0/3853269155 wait complete. 2024-04-21T10:12:30.988 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi170 2024-04-21T10:12:30.988 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:12:30.988 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/etc/ceph/ceph.conf 2024-04-21T10:12:31.007 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:12:31.007 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:12:31.064 INFO:tasks.cephadm:Adding host smithi170 to orchestrator... 2024-04-21T10:12:31.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch host add smithi170 2024-04-21T10:12:31.301 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:12:31.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:12:31.520 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:12:31.520 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:31.520 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:31.520 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:32.467 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:32 smithi077 ceph-mon[27902]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:12:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.686+0000 7f1817764700 1 -- 172.21.15.77:0/574088374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 msgr2=0x7f1810101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 --2- 172.21.15.77:0/574088374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810101990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f180c009910 tx=0x7f180c009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 -- 172.21.15.77:0/574088374 shutdown_connections 2024-04-21T10:12:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 --2- 172.21.15.77:0/574088374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810101990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 -- 172.21.15.77:0/574088374 >> 172.21.15.77:0/574088374 conn(0x7f18100fce60 msgr2=0x7f18100ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 -- 172.21.15.77:0/574088374 shutdown_connections 2024-04-21T10:12:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 -- 172.21.15.77:0/574088374 wait complete. 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 Processor -- start 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 -- start start 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.687+0000 7f1817764700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f181010b830 con 0x7f18101015b0 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1815500700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1815500700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33630/0 (socket says 172.21.15.77:33630) 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1815500700 1 -- 172.21.15.77:0/1824976212 learned_addr learned my addr 172.21.15.77:0/1824976212 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1815500700 1 -- 172.21.15.77:0/1824976212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1810199210 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1815500700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810198cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f180c0056d0 tx=0x7f180c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c026070 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1810199500 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f180c00bba0 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c003920 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.688+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101999c0 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.689+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f180c029070 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.689+0000 7f18067fc700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f17fc039650 0x7f17fc03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.689+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1810102a90 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.689+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f180c01e070 con 0x7f18101015b0 2024-04-21T10:12:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.689+0000 7f1814cff700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f17fc039650 0x7f17fc03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:32.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.690+0000 7f1814cff700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f17fc039650 0x7f17fc03bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1800006fd0 tx=0x7f1800006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:32.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.694+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f180c013070 con 0x7f18101015b0 2024-04-21T10:12:32.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:32.894+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}) -- 0x7f181006aee0 con 0x7f17fc039650 2024-04-21T10:12:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:33 smithi077 ceph-mon[27902]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:33 smithi077 ceph-mon[27902]: Deploying cephadm binary to smithi170 2024-04-21T10:12:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:34 smithi077 ceph-mon[27902]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:36.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.993+0000 7f18067fc700 1 -- 172.21.15.77:0/1824976212 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f181006aee0 con 0x7f17fc039650 2024-04-21T10:12:36.993 INFO:teuthology.orchestra.run.smithi077.stdout:Added host 'smithi170' with addr '172.21.15.170' 2024-04-21T10:12:36.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f17fc039650 msgr2=0x7f17fc03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:36.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f17fc039650 0x7f17fc03bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1800006fd0 tx=0x7f1800006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:36.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 msgr2=0x7f1810198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:36.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810198cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f180c0056d0 tx=0x7f180c0057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:36.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 shutdown_connections 2024-04-21T10:12:36.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f17fc039650 0x7f17fc03bb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:36.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 --2- 172.21.15.77:0/1824976212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18101015b0 0x7f1810198cd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:36.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 >> 172.21.15.77:0/1824976212 conn(0x7f18100fce60 msgr2=0x7f1810102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:36.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 shutdown_connections 2024-04-21T10:12:36.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:36.996+0000 7f1817764700 1 -- 172.21.15.77:0/1824976212 wait complete. 2024-04-21T10:12:37.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-21T10:12:37.868 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:37 smithi077 ceph-mon[27902]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:38.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:38 smithi077 ceph-mon[27902]: Added host smithi170 2024-04-21T10:12:38.929 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.398+0000 7feda3295700 1 -- 172.21.15.77:0/1304961893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 msgr2=0x7fed9c0751c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.398+0000 7feda3295700 1 --2- 172.21.15.77:0/1304961893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c0751c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed94009910 tx=0x7fed94009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 -- 172.21.15.77:0/1304961893 shutdown_connections 2024-04-21T10:12:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 --2- 172.21.15.77:0/1304961893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c0751c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 -- 172.21.15.77:0/1304961893 >> 172.21.15.77:0/1304961893 conn(0x7fed9c0fdf80 msgr2=0x7fed9c1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 -- 172.21.15.77:0/1304961893 shutdown_connections 2024-04-21T10:12:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 -- 172.21.15.77:0/1304961893 wait complete. 2024-04-21T10:12:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 Processor -- start 2024-04-21T10:12:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.399+0000 7feda3295700 1 -- start start 2024-04-21T10:12:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda3295700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c19e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda3295700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c112fa0 con 0x7fed9c074de0 2024-04-21T10:12:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda1031700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c19e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda1031700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c19e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33650/0 (socket says 172.21.15.77:33650) 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda1031700 1 -- 172.21.15.77:0/2365012643 learned_addr learned my addr 172.21.15.77:0/2365012643 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda1031700 1 -- 172.21.15.77:0/2365012643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c19ea80 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda1031700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c19e540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed940056d0 tx=0x7fed940057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed94026070 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed94004370 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c19ed10 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed940039b0 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.400+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c19f170 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.401+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fed94029070 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.401+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c076520 con 0x7fed9c074de0 2024-04-21T10:12:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.401+0000 7fed927fc700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fed88039650 0x7fed8803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.401+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fed9401e070 con 0x7fed9c074de0 2024-04-21T10:12:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.401+0000 7feda0830700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fed88039650 0x7fed8803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.402+0000 7feda0830700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fed88039650 0x7fed8803bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed8c006fd0 tx=0x7fed8c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:39.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.406+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fed94013070 con 0x7fed9c074de0 2024-04-21T10:12:39.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.607+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed9c19f8a0 con 0x7fed88039650 2024-04-21T10:12:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.608+0000 7fed927fc700 1 -- 172.21.15.77:0/2365012643 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fed9c19f8a0 con 0x7fed88039650 2024-04-21T10:12:39.608 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:39.608 INFO:teuthology.orchestra.run.smithi077.stdout:[{"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}] 2024-04-21T10:12:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fed88039650 msgr2=0x7fed8803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fed88039650 0x7fed8803bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed8c006fd0 tx=0x7fed8c006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 msgr2=0x7fed9c19e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c19e540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed940056d0 tx=0x7fed940057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 shutdown_connections 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fed88039650 0x7fed8803bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 --2- 172.21.15.77:0/2365012643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed9c074de0 0x7fed9c19e540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 >> 172.21.15.77:0/2365012643 conn(0x7fed9c0fdf80 msgr2=0x7fed9c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.610+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 shutdown_connections 2024-04-21T10:12:39.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:39.611+0000 7feda3295700 1 -- 172.21.15.77:0/2365012643 wait complete. 2024-04-21T10:12:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:39 smithi077 ceph-mon[27902]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:39 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:40.224 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-04-21T10:12:40.225 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:12:40.225 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-04-21T10:12:40.243 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:12:40.243 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:12:40.300 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-04-21T10:12:40.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch host add smithi191 2024-04-21T10:12:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:40.979 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:40 smithi077 ceph-mon[27902]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:12:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:41 smithi077 ceph-mon[27902]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 -- 172.21.15.77:0/1050018470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 msgr2=0x7ff4441019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 --2- 172.21.15.77:0/1050018470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff4441019d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff434009910 tx=0x7ff434009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 -- 172.21.15.77:0/1050018470 shutdown_connections 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 --2- 172.21.15.77:0/1050018470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff4441019d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 -- 172.21.15.77:0/1050018470 >> 172.21.15.77:0/1050018470 conn(0x7ff4440fcea0 msgr2=0x7ff4440ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 -- 172.21.15.77:0/1050018470 shutdown_connections 2024-04-21T10:12:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 -- 172.21.15.77:0/1050018470 wait complete. 2024-04-21T10:12:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.128+0000 7ff448d05700 1 Processor -- start 2024-04-21T10:12:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff448d05700 1 -- start start 2024-04-21T10:12:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff448d05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff444198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff448d05700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff44410b870 con 0x7ff4441015f0 2024-04-21T10:12:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff44259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff444198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff44259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff444198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42988/0 (socket says 172.21.15.77:42988) 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff44259c700 1 -- 172.21.15.77:0/3916742144 learned_addr learned my addr 172.21.15.77:0/3916742144 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff44259c700 1 -- 172.21.15.77:0/3916742144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff444199230 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff44259c700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff444198cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4340056d0 tx=0x7ff4340057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff434026070 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff43400bba0 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff444199520 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff434003920 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.129+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4441999e0 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.130+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff444102ad0 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.130+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7ff434029070 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.131+0000 7ff4337fe700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff42c0396b0 0x7ff42c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.131+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff43401e070 con 0x7ff4441015f0 2024-04-21T10:12:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.131+0000 7ff441d9b700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff42c0396b0 0x7ff42c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:42.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.131+0000 7ff441d9b700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff42c0396b0 0x7ff42c03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff438006fd0 tx=0x7ff438006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.135+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff434013070 con 0x7ff4441015f0 2024-04-21T10:12:42.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:42.335+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}) -- 0x7ff44406af00 con 0x7ff42c0396b0 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:12:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:12:44.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:12:44.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:43 smithi077 ceph-mon[27902]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:12:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:44 smithi077 ceph-mon[27902]: Deploying cephadm binary to smithi191 2024-04-21T10:12:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:44 smithi077 ceph-mon[27902]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:12:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:44 smithi077 ceph-mon[27902]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:12:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:45 smithi077 ceph-mon[27902]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:46.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.410+0000 7ff4337fe700 1 -- 172.21.15.77:0/3916742144 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ff44406af00 con 0x7ff42c0396b0 2024-04-21T10:12:46.411 INFO:teuthology.orchestra.run.smithi077.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-04-21T10:12:46.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.412+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff42c0396b0 msgr2=0x7ff42c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:46.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.412+0000 7ff448d05700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff42c0396b0 0x7ff42c03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff438006fd0 tx=0x7ff438006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:46.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.412+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 msgr2=0x7ff444198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.412+0000 7ff448d05700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff444198cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4340056d0 tx=0x7ff4340057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.413+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 shutdown_connections 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.413+0000 7ff448d05700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff42c0396b0 0x7ff42c03bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.413+0000 7ff448d05700 1 --2- 172.21.15.77:0/3916742144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4441015f0 0x7ff444198cf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.413+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 >> 172.21.15.77:0/3916742144 conn(0x7ff4440fcea0 msgr2=0x7ff444102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.413+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 shutdown_connections 2024-04-21T10:12:46.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:46.413+0000 7ff448d05700 1 -- 172.21.15.77:0/3916742144 wait complete. 2024-04-21T10:12:47.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:46 smithi077 ceph-mon[27902]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:12:47.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:47.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:47.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:47.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:47.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:47.030 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-21T10:12:47.260 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:48.051 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:47 smithi077 ceph-mon[27902]: Added host smithi191 2024-04-21T10:12:48.051 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:47 smithi077 ceph-mon[27902]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:48.051 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:48.051 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 -- 172.21.15.77:0/3765277750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 msgr2=0x7fa0781088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 --2- 172.21.15.77:0/3765277750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa0781088c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa074009910 tx=0x7fa074009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 -- 172.21.15.77:0/3765277750 shutdown_connections 2024-04-21T10:12:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 --2- 172.21.15.77:0/3765277750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa0781088c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 -- 172.21.15.77:0/3765277750 >> 172.21.15.77:0/3765277750 conn(0x7fa0780fdf80 msgr2=0x7fa0781003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 -- 172.21.15.77:0/3765277750 shutdown_connections 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.830+0000 7fa07f51c700 1 -- 172.21.15.77:0/3765277750 wait complete. 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07f51c700 1 Processor -- start 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07f51c700 1 -- start start 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07f51c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa078197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07f51c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa07810c940 con 0x7fa0781084e0 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07d2b8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa078197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:48.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07d2b8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa078197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43012/0 (socket says 172.21.15.77:43012) 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.831+0000 7fa07d2b8700 1 -- 172.21.15.77:0/2476698299 learned_addr learned my addr 172.21.15.77:0/2476698299 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa07d2b8700 1 -- 172.21.15.77:0/2476698299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa078198420 con 0x7fa0781084e0 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa07d2b8700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa078197ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0740056d0 tx=0x7fa0740057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa074026070 con 0x7fa0781084e0 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa07400bba0 con 0x7fa0781084e0 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa078198710 con 0x7fa0781084e0 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa074003920 con 0x7fa0781084e0 2024-04-21T10:12:48.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.832+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07819c7b0 con 0x7fa0781084e0 2024-04-21T10:12:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.833+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fa074029070 con 0x7fa0781084e0 2024-04-21T10:12:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.833+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa078103b90 con 0x7fa0781084e0 2024-04-21T10:12:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.833+0000 7fa06e7fc700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa0640396b0 0x7fa06403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.833+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa07401e070 con 0x7fa0781084e0 2024-04-21T10:12:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.833+0000 7fa07cab7700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa0640396b0 0x7fa06403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.834+0000 7fa07cab7700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa0640396b0 0x7fa06403bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa068006fd0 tx=0x7fa068006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:48.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:48.839+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa074013070 con 0x7fa0781084e0 2024-04-21T10:12:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.041+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa078199240 con 0x7fa0640396b0 2024-04-21T10:12:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.043+0000 7fa06e7fc700 1 -- 172.21.15.77:0/2476698299 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fa078199240 con 0x7fa0640396b0 2024-04-21T10:12:49.042 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:12:49.042 INFO:teuthology.orchestra.run.smithi077.stdout:[{"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-04-21T10:12:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.044+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa0640396b0 msgr2=0x7fa06403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.044+0000 7fa07f51c700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa0640396b0 0x7fa06403bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa068006fd0 tx=0x7fa068006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.044+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 msgr2=0x7fa078197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.044+0000 7fa07f51c700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa078197ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0740056d0 tx=0x7fa0740057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.045+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 shutdown_connections 2024-04-21T10:12:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.045+0000 7fa07f51c700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa0640396b0 0x7fa06403bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.045+0000 7fa07f51c700 1 --2- 172.21.15.77:0/2476698299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0781084e0 0x7fa078197ee0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.045+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 >> 172.21.15.77:0/2476698299 conn(0x7fa0780fdf80 msgr2=0x7fa0780fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.045+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 shutdown_connections 2024-04-21T10:12:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:49.045+0000 7fa07f51c700 1 -- 172.21.15.77:0/2476698299 wait complete. 2024-04-21T10:12:49.702 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-21T10:12:49.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-21T10:12:49.937 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:12:50.059 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:49 smithi077 ceph-mon[27902]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:50.059 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:51.086 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:50 smithi077 ceph-mon[27902]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 -- 172.21.15.77:0/2696810649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 msgr2=0x7ff2281088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 --2- 172.21.15.77:0/2696810649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff2281088c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff218009910 tx=0x7ff218009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 -- 172.21.15.77:0/2696810649 shutdown_connections 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 --2- 172.21.15.77:0/2696810649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff2281088c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 -- 172.21.15.77:0/2696810649 >> 172.21.15.77:0/2696810649 conn(0x7ff2280fdf80 msgr2=0x7ff2281003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 -- 172.21.15.77:0/2696810649 shutdown_connections 2024-04-21T10:12:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.435+0000 7ff22ea07700 1 -- 172.21.15.77:0/2696810649 wait complete. 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.436+0000 7ff22ea07700 1 Processor -- start 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.436+0000 7ff22ea07700 1 -- start start 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.436+0000 7ff22ea07700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff228197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.436+0000 7ff22ea07700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff22810c940 con 0x7ff2281084e0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff227fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff228197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff227fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff228197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58422/0 (socket says 172.21.15.77:58422) 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff227fff700 1 -- 172.21.15.77:0/3354538026 learned_addr learned my addr 172.21.15.77:0/3354538026 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff227fff700 1 -- 172.21.15.77:0/3354538026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281983f0 con 0x7ff2281084e0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff227fff700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff228197eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2180056d0 tx=0x7ff2180057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218026070 con 0x7ff2281084e0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2281986e0 con 0x7ff2281084e0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff21800bba0 con 0x7ff2281084e0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218003920 con 0x7ff2281084e0 2024-04-21T10:12:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.437+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22819c780 con 0x7ff2281084e0 2024-04-21T10:12:51.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.438+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7ff218029070 con 0x7ff2281084e0 2024-04-21T10:12:51.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.438+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228103b90 con 0x7ff2281084e0 2024-04-21T10:12:51.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.438+0000 7ff2257fa700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2100396b0 0x7ff21003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:51.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.438+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff21801e070 con 0x7ff2281084e0 2024-04-21T10:12:51.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.438+0000 7ff2277fe700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2100396b0 0x7ff21003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:51.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.439+0000 7ff2277fe700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2100396b0 0x7ff21003bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff21c006fd0 tx=0x7ff21c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:51.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.443+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff218013070 con 0x7ff2281084e0 2024-04-21T10:12:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.645+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff228199210 con 0x7ff2281084e0 2024-04-21T10:12:51.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.796+0000 7ff2257fa700 1 -- 172.21.15.77:0/3354538026 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7ff218004390 con 0x7ff2281084e0 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2100396b0 msgr2=0x7ff21003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2100396b0 0x7ff21003bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff21c006fd0 tx=0x7ff21c006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 msgr2=0x7ff228197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff228197eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2180056d0 tx=0x7ff2180057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 shutdown_connections 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2100396b0 0x7ff21003bb70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 --2- 172.21.15.77:0/3354538026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2281084e0 0x7ff228197eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 >> 172.21.15.77:0/3354538026 conn(0x7ff2280fdf80 msgr2=0x7ff22810a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 shutdown_connections 2024-04-21T10:12:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:12:51.799+0000 7ff22ea07700 1 -- 172.21.15.77:0/3354538026 wait complete. 2024-04-21T10:12:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-04-21T10:12:52.093 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:51 smithi077 ceph-mon[27902]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:52.094 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:51 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3354538026' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-21T10:12:52.421 INFO:tasks.cephadm:Adding mon.a on smithi077 2024-04-21T10:12:52.421 INFO:tasks.cephadm:Adding mon.b on smithi170 2024-04-21T10:12:52.421 INFO:tasks.cephadm:Adding mon.c on smithi191 2024-04-21T10:12:52.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch apply mon '3;smithi077:172.21.15.77=a;smithi170:172.21.15.170=b;smithi191:172.21.15.191=c' 2024-04-21T10:12:52.659 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3354538026' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:12:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:12:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:12:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:12:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:12:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:12:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:54.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.264+0000 7fe36b778700 1 -- 172.21.15.191:0/2380761468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 msgr2=0x7fe364108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:54.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.264+0000 7fe36b778700 1 --2- 172.21.15.191:0/2380761468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364108930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe354009910 tx=0x7fe354009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:54.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 -- 172.21.15.191:0/2380761468 shutdown_connections 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 --2- 172.21.15.191:0/2380761468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364108930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 -- 172.21.15.191:0/2380761468 >> 172.21.15.191:0/2380761468 conn(0x7fe3640fdf90 msgr2=0x7fe3641003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 -- 172.21.15.191:0/2380761468 shutdown_connections 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 -- 172.21.15.191:0/2380761468 wait complete. 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 Processor -- start 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 -- start start 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:54.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.265+0000 7fe36b778700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe36410c9c0 con 0x7fe364108550 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe369514700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe369514700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.191:52310/0 (socket says 172.21.15.191:52310) 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe369514700 1 -- 172.21.15.191:0/1259391034 learned_addr learned my addr 172.21.15.191:0/1259391034 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe369514700 1 -- 172.21.15.191:0/1259391034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe364076be0 con 0x7fe364108550 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe369514700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364074d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3540056d0 tx=0x7fe3540057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe354026070 con 0x7fe364108550 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe364075280 con 0x7fe364108550 2024-04-21T10:12:54.267 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe35400bc00 con 0x7fe364108550 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe354003920 con 0x7fe364108550 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.266+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe364075740 con 0x7fe364108550 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.267+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fe354029070 con 0x7fe364108550 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.267+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe364103bc0 con 0x7fe364108550 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.268+0000 7fe35a7fc700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500396b0 0x7fe35003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.268+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe35401e070 con 0x7fe364108550 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.268+0000 7fe368d13700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500396b0 0x7fe35003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:54.268 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.268+0000 7fe368d13700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500396b0 0x7fe35003bb70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe360006fd0 tx=0x7fe360006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:54.272 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.273+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe354013070 con 0x7fe364108550 2024-04-21T10:12:54.480 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.480+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi077:172.21.15.77=a;smithi170:172.21.15.170=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}) -- 0x7fe364076270 con 0x7fe3500396b0 2024-04-21T10:12:54.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.487+0000 7fe35a7fc700 1 -- 172.21.15.191:0/1259391034 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe364076270 con 0x7fe3500396b0 2024-04-21T10:12:54.486 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-04-21T10:12:54.488 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500396b0 msgr2=0x7fe35003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500396b0 0x7fe35003bb70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe360006fd0 tx=0x7fe360006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 msgr2=0x7fe364074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364074d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3540056d0 tx=0x7fe3540057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 shutdown_connections 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500396b0 0x7fe35003bb70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 --2- 172.21.15.191:0/1259391034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe364108550 0x7fe364074d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 >> 172.21.15.191:0/1259391034 conn(0x7fe3640fdf90 msgr2=0x7fe3640fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 shutdown_connections 2024-04-21T10:12:54.489 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:54.489+0000 7fe36b778700 1 -- 172.21.15.191:0/1259391034 wait complete. 2024-04-21T10:12:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:12:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:12:55.139 DEBUG:teuthology.orchestra.run.smithi170:mon.b> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.b.service 2024-04-21T10:12:55.141 DEBUG:teuthology.orchestra.run.smithi191:mon.c> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mon.c.service 2024-04-21T10:12:55.143 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T10:12:55.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T10:12:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:55 smithi077 ceph-mon[27902]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi077:172.21.15.77=a;smithi170:172.21.15.170=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:12:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:55 smithi077 ceph-mon[27902]: Saving service mon spec with placement smithi077:172.21.15.77=a;smithi170:172.21.15.170=b;smithi191:172.21.15.191=c;count:3 2024-04-21T10:12:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:55 smithi077 ceph-mon[27902]: Deploying daemon mon.c on smithi191 2024-04-21T10:12:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:55 smithi077 ceph-mon[27902]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:56.298 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:12:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:12:57 smithi077 ceph-mon[27902]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:12:58.964 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 -- 172.21.15.191:0/1239694785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 msgr2=0x7f840c10aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:58.964 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 --2- 172.21.15.191:0/1239694785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c10aa40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009910 tx=0x7f83fc009c20 comp rx=0 tx=0).stop 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 -- 172.21.15.191:0/1239694785 shutdown_connections 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 --2- 172.21.15.191:0/1239694785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c10aa40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 -- 172.21.15.191:0/1239694785 >> 172.21.15.191:0/1239694785 conn(0x7f840c100190 msgr2=0x7f840c1025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 -- 172.21.15.191:0/1239694785 shutdown_connections 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.963+0000 7f84125bf700 1 -- 172.21.15.191:0/1239694785 wait complete. 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f84125bf700 1 Processor -- start 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f84125bf700 1 -- start start 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f84125bf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f84125bf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f840c10eb50 con 0x7f840c10a660 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f840bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f840bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c19a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.191:52322/0 (socket says 172.21.15.191:52322) 2024-04-21T10:12:58.965 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.964+0000 7f840bfff700 1 -- 172.21.15.191:0/282971564 learned_addr learned my addr 172.21.15.191:0/282971564 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f840bfff700 1 -- 172.21.15.191:0/282971564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840c19a5f0 con 0x7f840c10a660 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f840bfff700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c19a0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0056d0 tx=0x7f83fc0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83fc026070 con 0x7f840c10a660 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83fc00bba0 con 0x7f840c10a660 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840c19a8e0 con 0x7f840c10a660 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83fc003920 con 0x7f840c10a660 2024-04-21T10:12:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.965+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840c19e980 con 0x7f840c10a660 2024-04-21T10:12:58.967 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.966+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f83fc029070 con 0x7f840c10a660 2024-04-21T10:12:58.967 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.966+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f840c105da0 con 0x7f840c10a660 2024-04-21T10:12:58.967 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.966+0000 7f84097fa700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f83f4039650 0x7f83f403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:12:58.967 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.966+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f83fc01e070 con 0x7f840c10a660 2024-04-21T10:12:58.967 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.967+0000 7f840b7fe700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f83f4039650 0x7f83f403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:12:58.967 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.967+0000 7f840b7fe700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f83f4039650 0x7f83f403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8400006fd0 tx=0x7f8400006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:12:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:58.972+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f83fc013070 con 0x7f840c10a660 2024-04-21T10:12:59.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.262+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f840c19b410 con 0x7f840c10a660 2024-04-21T10:12:59.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.263+0000 7f84097fa700 1 -- 172.21.15.191:0/282971564 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f83fc030020 con 0x7f840c10a660 2024-04-21T10:12:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:12:59.262 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","modified":"2024-04-21T10:11:10.795935Z","created":"2024-04-21T10:11:10.795935Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f83f4039650 msgr2=0x7f83f403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f83f4039650 0x7f83f403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8400006fd0 tx=0x7f8400006e40 comp rx=0 tx=0).stop 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 msgr2=0x7f840c19a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c19a0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0056d0 tx=0x7f83fc0057b0 comp rx=0 tx=0).stop 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 shutdown_connections 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f83f4039650 0x7f83f403bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 --2- 172.21.15.191:0/282971564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c10a660 0x7f840c19a0b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:12:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 >> 172.21.15.191:0/282971564 conn(0x7f840c100190 msgr2=0x7f840c10c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:12:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 shutdown_connections 2024-04-21T10:12:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:12:59.265+0000 7f84125bf700 1 -- 172.21.15.191:0/282971564 wait complete. 2024-04-21T10:12:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-04-21T10:13:00.986 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T10:13:00.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T10:13:01.230 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:13:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:13:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: mon.a calling monitor election 2024-04-21T10:13:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: mon.c calling monitor election 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: monmap epoch 2 2024-04-21T10:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:13:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: last_changed 2024-04-21T10:12:59.567470+0000 2024-04-21T10:13:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: created 2024-04-21T10:11:10.795935+0000 2024-04-21T10:13:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: min_mon_release 19 (squid) 2024-04-21T10:13:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: election_strategy: 1 2024-04-21T10:13:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-21T10:13:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-04-21T10:13:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: fsmap 2024-04-21T10:13:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T10:13:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: mgrmap e13: x(active, since 49s) 2024-04-21T10:13:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: overall HEALTH_OK 2024-04-21T10:13:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:04.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:04.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:04.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:04 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:04.981 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:04 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:05.753 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 -- 172.21.15.191:0/1088121247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01036e0 msgr2=0x7f229c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:05.753 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 --2- 172.21.15.191:0/1088121247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01036e0 0x7f229c005610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22a0005fa0 tx=0x7f22a000ffc0 comp rx=0 tx=0).stop 2024-04-21T10:13:05.753 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 -- 172.21.15.191:0/1088121247 shutdown_connections 2024-04-21T10:13:05.753 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 --2- 172.21.15.191:0/1088121247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01036e0 0x7f229c005610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:05.754 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 -- 172.21.15.191:0/1088121247 >> 172.21.15.191:0/1088121247 conn(0x7f22b00fcef0 msgr2=0x7f22b00ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:05.754 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 -- 172.21.15.191:0/1088121247 shutdown_connections 2024-04-21T10:13:05.754 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.752+0000 7f22b71c1700 1 -- 172.21.15.191:0/1088121247 wait complete. 2024-04-21T10:13:05.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.753+0000 7f22b71c1700 1 Processor -- start 2024-04-21T10:13:05.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.753+0000 7f22b71c1700 1 -- start start 2024-04-21T10:13:05.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b71c1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:05.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b71c1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01984f0 0x7f22b019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:05.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b71c1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010a470 con 0x7f22b01984f0 2024-04-21T10:13:05.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b71c1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010a2f0 con 0x7f22b01036e0 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49686/0 (socket says 172.21.15.191:49686) 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 -- 172.21.15.191:0/4065324848 learned_addr learned my addr 172.21.15.191:0/4065324848 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22affff700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01984f0 0x7f22b019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 -- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 msgr2=0x7f22b0197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 -- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 msgr2=0x7f22b0197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22b4f5d700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22affff700 1 -- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 msgr2=0x7f22b0197fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:13:05.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22affff700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:05.759 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.754+0000 7f22affff700 1 -- 172.21.15.191:0/4065324848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b0198b30 con 0x7f22b01984f0 2024-04-21T10:13:05.759 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.755+0000 7f22affff700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01984f0 0x7f22b019c880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f229800b4d0 tx=0x7f229800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:05.759 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.755+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2298011630 con 0x7f22b01984f0 2024-04-21T10:13:05.759 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.755+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b019cdc0 con 0x7f22b01984f0 2024-04-21T10:13:05.759 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.755+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2298011c80 con 0x7f22b01984f0 2024-04-21T10:13:05.759 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.755+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2298019c30 con 0x7f22b01984f0 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.755+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b019d320 con 0x7f22b01984f0 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.756+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2298018020 con 0x7f22b01984f0 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.756+0000 7f22adffb700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2290039410 0x7f229003b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.756+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f229804c860 con 0x7f22b01984f0 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.756+0000 7f22b4f5d700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2290039410 0x7f229003b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.756+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b006b530 con 0x7f22b01984f0 2024-04-21T10:13:05.760 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.757+0000 7f22b4f5d700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2290039410 0x7f229003b8d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22a000fb20 tx=0x7f22a001d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:05.762 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:05.762+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f229801f4a0 con 0x7f22b01984f0 2024-04-21T10:13:05.906 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:05 smithi077 ceph-mon[27902]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:05.906 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:05 smithi077 ceph-mon[27902]: Deploying daemon mon.b on smithi170 2024-04-21T10:13:05.906 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:05.922 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:05 smithi191 ceph-mon[31636]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:05.922 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:05 smithi191 ceph-mon[31636]: Deploying daemon mon.b on smithi170 2024-04-21T10:13:05.922 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:06.046 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.045+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f22b0199310 con 0x7f22b01984f0 2024-04-21T10:13:06.046 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.046+0000 7f22adffb700 1 -- 172.21.15.191:0/4065324848 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f229800ea80 con 0x7f22b01984f0 2024-04-21T10:13:06.047 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:13:06.047 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","modified":"2024-04-21T10:12:59.567470Z","created":"2024-04-21T10:11:10.795935Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-21T10:13:06.049 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2290039410 msgr2=0x7f229003b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:06.049 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2290039410 0x7f229003b8d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22a000fb20 tx=0x7f22a001d040 comp rx=0 tx=0).stop 2024-04-21T10:13:06.049 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01984f0 msgr2=0x7f22b019c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:06.049 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01984f0 0x7f22b019c880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f229800b4d0 tx=0x7f229800b890 comp rx=0 tx=0).stop 2024-04-21T10:13:06.049 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 shutdown_connections 2024-04-21T10:13:06.049 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2290039410 0x7f229003b8d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:06.050 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b01036e0 0x7f22b0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:06.050 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 --2- 172.21.15.191:0/4065324848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b01984f0 0x7f22b019c880 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:06.050 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 >> 172.21.15.191:0/4065324848 conn(0x7f22b00fcef0 msgr2=0x7f22b00feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:06.050 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 shutdown_connections 2024-04-21T10:13:06.050 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:06.048+0000 7f22b71c1700 1 -- 172.21.15.191:0/4065324848 wait complete. 2024-04-21T10:13:06.050 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-04-21T10:13:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:06 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/4065324848' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T10:13:07.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:06 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/4065324848' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T10:13:07.574 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T10:13:07.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T10:13:07.816 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:13:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:07 smithi191 ceph-mon[31636]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:07 smithi077 ceph-mon[27902]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:08 smithi170 systemd[1]: Started Ceph mon.b for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:13:13.646 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 -- 172.21.15.191:0/4233571787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f779c0035c0 msgr2=0x7f779c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:13.646 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4233571787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f779c0035c0 0x7f779c005a50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77b0102490 tx=0x7f77a8009e80 comp rx=0 tx=0).stop 2024-04-21T10:13:13.646 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 -- 172.21.15.191:0/4233571787 shutdown_connections 2024-04-21T10:13:13.646 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4233571787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f779c0035c0 0x7f779c005a50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.646 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 -- 172.21.15.191:0/4233571787 >> 172.21.15.191:0/4233571787 conn(0x7f77b00fe050 msgr2=0x7f77b0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:13.646 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 -- 172.21.15.191:0/4233571787 shutdown_connections 2024-04-21T10:13:13.647 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.645+0000 7f77b6bde700 1 -- 172.21.15.191:0/4233571787 wait complete. 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.646+0000 7f77b6bde700 1 Processor -- start 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 -- start start 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 0x7f77b019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b019ce50 0x7f77b019d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77b010a460 con 0x7f77b019ce50 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f77b010a2e0 con 0x7f77b0198580 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b6bde700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77b010a5e0 con 0x7f779c0035c0 2024-04-21T10:13:13.649 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:35932/0 (socket says 172.21.15.191:35932) 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 -- 172.21.15.191:0/4048267850 learned_addr learned my addr 172.21.15.191:0/4048267850 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77affff700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 0x7f77b019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 msgr2=0x7f77b0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 msgr2=0x7f77b0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b497a700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77b517b700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b019ce50 0x7f77b019d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77affff700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 msgr2=0x7f77b019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77affff700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 msgr2=0x7f77b019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77affff700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 0x7f77b019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T10:13:13.650 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.647+0000 7f77affff700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 0x7f77b019c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b517b700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 msgr2=0x7f77b0198040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b517b700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b517b700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 msgr2=0x7f77b019c910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b517b700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 0x7f77b019c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b517b700 1 -- 172.21.15.191:0/4048267850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b01a4bc0 con 0x7f77b019ce50 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b517b700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b019ce50 0x7f77b019d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7798006fd0 tx=0x7f779800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798015020 con 0x7f77b019ce50 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7798011ce0 con 0x7f77b019ce50 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b01a4df0 con 0x7f77b019ce50 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.648+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798010d40 con 0x7f77b019ce50 2024-04-21T10:13:13.651 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.649+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b01a53a0 con 0x7f77b019ce50 2024-04-21T10:13:13.652 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.649+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f7798018020 con 0x7f77b019ce50 2024-04-21T10:13:13.652 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.650+0000 7f77adffb700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7790039ae0 0x7f779003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:13.652 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.650+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f779804c1c0 con 0x7f77b019ce50 2024-04-21T10:13:13.652 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.650+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b00640a0 con 0x7f77b019ce50 2024-04-21T10:13:13.652 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.650+0000 7f77b497a700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7790039ae0 0x7f779003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:13.652 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.650+0000 7f77b497a700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7790039ae0 0x7f779003bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77a80098a0 tx=0x7f77a800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:13.656 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.656+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f779801f020 con 0x7f77b019ce50 2024-04-21T10:13:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: mon.a calling monitor election 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: mon.c calling monitor election 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: mon.b calling monitor election 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: monmap epoch 3 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: last_changed 2024-04-21T10:13:08.476849+0000 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: created 2024-04-21T10:11:10.795935+0000 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: min_mon_release 19 (squid) 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: election_strategy: 1 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-21T10:13:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: 2: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: fsmap 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: mgrmap e13: x(active, since 58s) 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: overall HEALTH_OK 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: mon.a calling monitor election 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: mon.c calling monitor election 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: mon.b calling monitor election 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: monmap epoch 3 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: last_changed 2024-04-21T10:13:08.476849+0000 2024-04-21T10:13:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: created 2024-04-21T10:11:10.795935+0000 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: min_mon_release 19 (squid) 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: election_strategy: 1 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: 2: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: fsmap 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: mgrmap e13: x(active, since 58s) 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: overall HEALTH_OK 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:13.951 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.951+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f77b002df80 con 0x7f77b019ce50 2024-04-21T10:13:13.951 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.952+0000 7f77adffb700 1 -- 172.21.15.191:0/4048267850 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f7798010380 con 0x7f77b019ce50 2024-04-21T10:13:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-21T10:13:13.952 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","modified":"2024-04-21T10:13:08.476849Z","created":"2024-04-21T10:11:10.795935Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-21T10:13:13.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:13:13.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: mon.a calling monitor election 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: mon.c calling monitor election 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: mon.b calling monitor election 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: monmap epoch 3 2024-04-21T10:13:13.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: last_changed 2024-04-21T10:13:08.476849+0000 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: created 2024-04-21T10:11:10.795935+0000 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: min_mon_release 19 (squid) 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: election_strategy: 1 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: 2: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: fsmap 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: mgrmap e13: x(active, since 58s) 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: overall HEALTH_OK 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:13.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:13.955 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7790039ae0 msgr2=0x7f779003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:13.955 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7790039ae0 0x7f779003bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77a80098a0 tx=0x7f77a800b040 comp rx=0 tx=0).stop 2024-04-21T10:13:13.955 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b019ce50 msgr2=0x7f77b019d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b019ce50 0x7f77b019d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7798006fd0 tx=0x7f779800b7e0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 shutdown_connections 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7790039ae0 0x7f779003bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b019ce50 0x7f77b019d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f779c0035c0 0x7f77b0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 --2- 172.21.15.191:0/4048267850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77b0198580 0x7f77b019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 >> 172.21.15.191:0/4048267850 conn(0x7f77b00fe050 msgr2=0x7f77b0107110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 shutdown_connections 2024-04-21T10:13:13.956 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:13.955+0000 7f77b6bde700 1 -- 172.21.15.191:0/4048267850 wait complete. 2024-04-21T10:13:13.957 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2024-04-21T10:13:14.521 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-21T10:13:14.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-21T10:13:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:13:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/4048267850' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T10:13:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:14.855 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:14.856 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:14.856 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:14.856 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/4048267850' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T10:13:14.856 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/4048267850' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T10:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:13:15.917 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:15.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:16.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 -- 172.21.15.77:0/708792228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28601084e0 msgr2=0x7f28601088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:16.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 --2- 172.21.15.77:0/708792228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28601084e0 0x7f28601088c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2850009910 tx=0x7f2850009c20 comp rx=0 tx=0).stop 2024-04-21T10:13:16.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 -- 172.21.15.77:0/708792228 shutdown_connections 2024-04-21T10:13:16.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 --2- 172.21.15.77:0/708792228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28601084e0 0x7f28601088c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 -- 172.21.15.77:0/708792228 >> 172.21.15.77:0/708792228 conn(0x7f28600fdf60 msgr2=0x7f2860100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:16.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 -- 172.21.15.77:0/708792228 shutdown_connections 2024-04-21T10:13:16.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.385+0000 7f2864826700 1 -- 172.21.15.77:0/708792228 wait complete. 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.386+0000 7f2864826700 1 Processor -- start 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.386+0000 7f2864826700 1 -- start start 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.386+0000 7f2864826700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28601084e0 0x7f2860198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f2864826700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2860198650 0x7f286019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f2864826700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 0x7f286019d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f2864826700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f286010c940 con 0x7f286019cf20 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f2864826700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f286010c7c0 con 0x7f2860198650 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f2864826700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f286010cac0 con 0x7f28601084e0 2024-04-21T10:13:16.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 0x7f286019d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 0x7f286019d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54026/0 (socket says 172.21.15.77:54026) 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 -- 172.21.15.77:0/2638829941 learned_addr learned my addr 172.21.15.77:0/2638829941 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285e59c700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28601084e0 0x7f2860198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285dd9b700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2860198650 0x7f286019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 -- 172.21.15.77:0/2638829941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28601084e0 msgr2=0x7f2860198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28601084e0 0x7f2860198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 -- 172.21.15.77:0/2638829941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2860198650 msgr2=0x7f286019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2860198650 0x7f286019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 -- 172.21.15.77:0/2638829941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28601a4c90 con 0x7f286019cf20 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285dd9b700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2860198650 0x7f286019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f285ed9d700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 0x7f286019d3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f285800ba50 tx=0x7f285800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858019070 con 0x7f286019cf20 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2858014440 con 0x7f286019cf20 2024-04-21T10:13:16.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.387+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28601a4ec0 con 0x7f286019cf20 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.388+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858007590 con 0x7f286019cf20 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.388+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28601a5370 con 0x7f286019cf20 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.388+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f285801c070 con 0x7f286019cf20 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.389+0000 7f284f7fe700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2848039ae0 0x7f284803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.389+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f285804bec0 con 0x7f286019cf20 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.389+0000 7f285e59c700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2848039ae0 0x7f284803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.389+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28600640a0 con 0x7f286019cf20 2024-04-21T10:13:16.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.389+0000 7f285e59c700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2848039ae0 0x7f284803bfa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2850009750 tx=0x7f285001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:16.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.394+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2858014710 con 0x7f286019cf20 2024-04-21T10:13:16.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.613+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f28601a5680 con 0x7f286019cf20 2024-04-21T10:13:16.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.614+0000 7f284f7fe700 1 -- 172.21.15.77:0/2638829941 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f2858027030 con 0x7f286019cf20 2024-04-21T10:13:16.614 INFO:teuthology.orchestra.run.smithi077.stdout:# minimal ceph.conf for 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:13:16.614 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-04-21T10:13:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:13:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: mon_host = [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-04-21T10:13:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2848039ae0 msgr2=0x7f284803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2848039ae0 0x7f284803bfa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2850009750 tx=0x7f285001a040 comp rx=0 tx=0).stop 2024-04-21T10:13:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 msgr2=0x7f286019d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 0x7f286019d3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f285800ba50 tx=0x7f285800be10 comp rx=0 tx=0).stop 2024-04-21T10:13:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 shutdown_connections 2024-04-21T10:13:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2848039ae0 0x7f284803bfa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f286019cf20 0x7f286019d3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28601084e0 0x7f2860198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 --2- 172.21.15.77:0/2638829941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2860198650 0x7f286019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 >> 172.21.15.77:0/2638829941 conn(0x7f28600fdf60 msgr2=0x7f2860103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 shutdown_connections 2024-04-21T10:13:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:16.616+0000 7f2864826700 1 -- 172.21.15.77:0/2638829941 wait complete. 2024-04-21T10:13:17.056 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.057 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:17.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:16 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2638829941' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:16 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2638829941' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:13:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:13:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:13:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:16 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2638829941' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:17.701 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-21T10:13:17.701 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:13:17.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-04-21T10:13:17.727 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:13:17.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:13:17.791 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:13:17.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.conf 2024-04-21T10:13:17.822 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:13:17.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:13:17.890 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:13:17.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-04-21T10:13:17.921 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:13:17.921 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:13:17.989 INFO:tasks.cephadm:Adding mgr.x on smithi077 2024-04-21T10:13:17.990 INFO:tasks.cephadm:Adding mgr.y on smithi170 2024-04-21T10:13:17.990 INFO:tasks.cephadm:Adding mgr.z on smithi191 2024-04-21T10:13:17.990 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi077=x;smithi170=y;smithi191=z' 2024-04-21T10:13:18.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:17 smithi191 ceph-mon[31636]: Reconfiguring mon.a (unknown last config time)... 2024-04-21T10:13:18.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:17 smithi191 ceph-mon[31636]: Reconfiguring daemon mon.a on smithi077 2024-04-21T10:13:18.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:17 smithi191 ceph-mon[31636]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:17 smithi170 ceph-mon[31212]: Reconfiguring mon.a (unknown last config time)... 2024-04-21T10:13:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:17 smithi170 ceph-mon[31212]: Reconfiguring daemon mon.a on smithi077 2024-04-21T10:13:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:17 smithi170 ceph-mon[31212]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:18.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:17 smithi077 ceph-mon[27902]: Reconfiguring mon.a (unknown last config time)... 2024-04-21T10:13:18.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:17 smithi077 ceph-mon[27902]: Reconfiguring daemon mon.a on smithi077 2024-04-21T10:13:18.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:17 smithi077 ceph-mon[27902]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:18.262 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:13:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: Reconfiguring mon.b (monmap changed)... 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: Reconfiguring daemon mon.b on smithi170 2024-04-21T10:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:19 smithi170 ceph-mon[31212]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:19.413 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:19.413 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:19.413 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: Reconfiguring mon.b (monmap changed)... 2024-04-21T10:13:19.413 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:19.414 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:19.414 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:19.414 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: Reconfiguring daemon mon.b on smithi170 2024-04-21T10:13:19.414 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:19 smithi191 ceph-mon[31636]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: Reconfiguring mon.b (monmap changed)... 2024-04-21T10:13:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: Reconfiguring daemon mon.b on smithi170 2024-04-21T10:13:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:19 smithi077 ceph-mon[27902]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 -- 172.21.15.191:0/870265141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41023e0 msgr2=0x7f9fa4102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/870265141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41023e0 0x7f9fa4102800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009910 tx=0x7f9f94009c20 comp rx=0 tx=0).stop 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 -- 172.21.15.191:0/870265141 shutdown_connections 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/870265141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41023e0 0x7f9fa4102800 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 -- 172.21.15.191:0/870265141 >> 172.21.15.191:0/870265141 conn(0x7f9fa40fd9c0 msgr2=0x7f9fa40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 -- 172.21.15.191:0/870265141 shutdown_connections 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.743+0000 7f9fa91a0700 1 -- 172.21.15.191:0/870265141 wait complete. 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 Processor -- start 2024-04-21T10:13:19.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 -- start start 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 0x7f9fa4197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41980a0 0x7f9fa419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa4198520 0x7f9fa419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4108320 con 0x7f9fa41980a0 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41081a0 con 0x7f9fa4198520 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa91a0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41084a0 con 0x7f9fa41023e0 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa3fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 0x7f9fa4197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa3fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 0x7f9fa4197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:35938/0 (socket says 172.21.15.191:35938) 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa3fff700 1 -- 172.21.15.191:0/3756379215 learned_addr learned my addr 172.21.15.191:0/3756379215 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa37fe700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41980a0 0x7f9fa419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:19.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.744+0000 7f9fa899f700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa4198520 0x7f9fa419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa3fff700 1 -- 172.21.15.191:0/3756379215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa4198520 msgr2=0x7f9fa419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa3fff700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa4198520 0x7f9fa419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa3fff700 1 -- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41980a0 msgr2=0x7f9fa419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa3fff700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41980a0 0x7f9fa419d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa3fff700 1 -- 172.21.15.191:0/3756379215 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa419ff70 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa37fe700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41980a0 0x7f9fa419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa3fff700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 0x7f9fa4197b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f94005e00 tx=0x7f9f94004f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94026070 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f9400b750 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa41a0200 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f940038e0 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.745+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41a0760 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.746+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f9f94029070 con 0x7f9fa41023e0 2024-04-21T10:13:19.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.746+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa40640a0 con 0x7f9fa41023e0 2024-04-21T10:13:19.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.746+0000 7f9fa17fa700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9f8c039ae0 0x7f9f8c03bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:19.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.746+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9f9404d4a0 con 0x7f9fa41023e0 2024-04-21T10:13:19.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.746+0000 7f9fa37fe700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9f8c039ae0 0x7f9f8c03bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:19.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.747+0000 7f9fa37fe700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9f8c039ae0 0x7f9f8c03bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009ec0 tx=0x7f9f98009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:19.751 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.751+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9f94013070 con 0x7f9fa41023e0 2024-04-21T10:13:19.970 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.970+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi170=y;smithi191=z", "target": ["mon-mgr", ""]}) -- 0x7f9fa4062f10 con 0x7f9f8c039ae0 2024-04-21T10:13:19.979 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.979+0000 7f9fa17fa700 1 -- 172.21.15.191:0/3756379215 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9fa4062f10 con 0x7f9f8c039ae0 2024-04-21T10:13:19.979 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2024-04-21T10:13:19.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9f8c039ae0 msgr2=0x7f9f8c03bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:19.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9f8c039ae0 0x7f9f8c03bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009ec0 tx=0x7f9f98009210 comp rx=0 tx=0).stop 2024-04-21T10:13:19.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 msgr2=0x7f9fa4197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:19.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 0x7f9fa4197b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f94005e00 tx=0x7f9f94004f80 comp rx=0 tx=0).stop 2024-04-21T10:13:19.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 shutdown_connections 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9f8c039ae0 0x7f9f8c03bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa4198520 0x7f9fa419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fa41023e0 0x7f9fa4197b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 --2- 172.21.15.191:0/3756379215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa41980a0 0x7f9fa419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 >> 172.21.15.191:0/3756379215 conn(0x7f9fa40fd9c0 msgr2=0x7f9fa40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 shutdown_connections 2024-04-21T10:13:19.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:13:19.981+0000 7f9fa91a0700 1 -- 172.21.15.191:0/3756379215 wait complete. 2024-04-21T10:13:20.528 DEBUG:teuthology.orchestra.run.smithi170:mgr.y> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.y.service 2024-04-21T10:13:20.533 DEBUG:teuthology.orchestra.run.smithi191:mgr.z> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mgr.z.service 2024-04-21T10:13:20.574 INFO:tasks.cephadm:Deploying OSDs... 2024-04-21T10:13:20.575 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:13:20.575 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T10:13:20.595 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T10:13:20.595 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-21 10:12:26.828539638 +0000 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-21 10:06:15.799709358 +0000 2024-04-21T10:13:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-21 10:06:15.799709358 +0000 2024-04-21T10:13:20.656 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-21 10:06:15.799709358 +0000 2024-04-21T10:13:20.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T10:13:20.726 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-21T10:13:20.726 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-21T10:13:20.726 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000301143 s, 1.7 MB/s 2024-04-21T10:13:20.728 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T10:13:20.793 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-04-21T10:13:20.853 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T10:13:20.853 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-21T10:13:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-21 10:12:26.854539128 +0000 2024-04-21T10:13:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-21 10:06:16.130702608 +0000 2024-04-21T10:13:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-21 10:06:16.130702608 +0000 2024-04-21T10:13:20.854 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-21 10:06:16.130702608 +0000 2024-04-21T10:13:20.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T10:13:20.920 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-21T10:13:20.921 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-21T10:13:20.921 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000198773 s, 2.6 MB/s 2024-04-21T10:13:20.922 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T10:13:20.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: Reconfiguring mon.c (monmap changed)... 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: Reconfiguring daemon mon.c on smithi191 2024-04-21T10:13:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:20.979 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-04-21T10:13:21.035 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-21 10:12:26.879538638 +0000 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-21 10:06:16.473695612 +0000 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-21 10:06:16.473695612 +0000 2024-04-21T10:13:21.036 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-21 10:06:16.473695612 +0000 2024-04-21T10:13:21.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T10:13:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: Reconfiguring mon.c (monmap changed)... 2024-04-21T10:13:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: Reconfiguring daemon mon.c on smithi191 2024-04-21T10:13:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.096 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: Reconfiguring mon.c (monmap changed)... 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: Reconfiguring daemon mon.c on smithi191 2024-04-21T10:13:21.097 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.099 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-21T10:13:21.099 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-21T10:13:21.099 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000197804 s, 2.6 MB/s 2024-04-21T10:13:21.100 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T10:13:21.157 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-04-21T10:13:21.213 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T10:13:21.213 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-21T10:13:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-21 10:12:26.905538129 +0000 2024-04-21T10:13:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-21 10:06:16.823688474 +0000 2024-04-21T10:13:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-21 10:06:16.823688474 +0000 2024-04-21T10:13:21.214 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-21 10:06:16.823688474 +0000 2024-04-21T10:13:21.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T10:13:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-21T10:13:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-21T10:13:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000231304 s, 2.2 MB/s 2024-04-21T10:13:21.277 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T10:13:21.333 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-21T10:13:21.333 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T10:13:21.353 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T10:13:21.353 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-04-21T10:13:21.412 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T10:13:21.412 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:21.412 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-21T10:13:21.412 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:21.412 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:21.412 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-21 10:13:07.958920265 +0000 2024-04-21T10:13:21.413 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-21 10:06:44.756576105 +0000 2024-04-21T10:13:21.413 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-21 10:06:44.756576105 +0000 2024-04-21T10:13:21.413 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-21 10:06:44.756576105 +0000 2024-04-21T10:13:21.413 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T10:13:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-21T10:13:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-21T10:13:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.00012979 s, 3.9 MB/s 2024-04-21T10:13:21.481 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T10:13:21.539 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-04-21T10:13:21.595 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T10:13:21.595 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-21 10:13:07.958920265 +0000 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-21 10:06:45.068568581 +0000 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-21 10:06:45.068568581 +0000 2024-04-21T10:13:21.596 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-21 10:06:45.068568581 +0000 2024-04-21T10:13:21.596 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T10:13:21.660 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-21T10:13:21.661 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-21T10:13:21.661 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000125196 s, 4.1 MB/s 2024-04-21T10:13:21.662 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T10:13:21.720 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-04-21T10:13:21.777 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T10:13:21.777 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-21 10:13:07.959920241 +0000 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-21 10:06:45.394560718 +0000 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-21 10:06:45.394560718 +0000 2024-04-21T10:13:21.778 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-21 10:06:45.394560718 +0000 2024-04-21T10:13:21.778 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T10:13:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-21T10:13:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-21T10:13:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000123692 s, 4.1 MB/s 2024-04-21T10:13:21.844 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T10:13:21.903 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-21 10:13:07.959920241 +0000 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-21 10:06:45.727552687 +0000 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-21 10:06:45.727552687 +0000 2024-04-21T10:13:21.959 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-21 10:06:45.727552687 +0000 2024-04-21T10:13:21.960 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T10:13:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:21 smithi191 ceph-mon[31636]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi170=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:21 smithi191 ceph-mon[31636]: Saving service mgr spec with placement smithi077=x;smithi170=y;smithi191=z;count:3 2024-04-21T10:13:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:21 smithi191 ceph-mon[31636]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:21 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:21 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:21 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:22.021 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:21 smithi170 ceph-mon[31212]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi170=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:22.021 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:21 smithi170 ceph-mon[31212]: Saving service mgr spec with placement smithi077=x;smithi170=y;smithi191=z;count:3 2024-04-21T10:13:22.021 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:21 smithi170 ceph-mon[31212]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:22.021 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:21 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:22.021 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:21 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:22.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:21 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-21T10:13:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-21T10:13:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.0075e-05 s, 5.7 MB/s 2024-04-21T10:13:22.024 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T10:13:22.081 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-21T10:13:22.081 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T10:13:22.097 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T10:13:22.098 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-04-21T10:13:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:21 smithi077 ceph-mon[27902]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi170=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:21 smithi077 ceph-mon[27902]: Saving service mgr spec with placement smithi077=x;smithi170=y;smithi191=z;count:3 2024-04-21T10:13:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:21 smithi077 ceph-mon[27902]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:21 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:21 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:21 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-21 10:12:58.457039164 +0000 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-21 10:06:36.799869224 +0000 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-21 10:06:36.799869224 +0000 2024-04-21T10:13:22.153 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-21 10:06:36.799869224 +0000 2024-04-21T10:13:22.154 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T10:13:22.216 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-21T10:13:22.216 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-21T10:13:22.216 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000285683 s, 1.8 MB/s 2024-04-21T10:13:22.217 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T10:13:22.273 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-04-21T10:13:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T10:13:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:22.328 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-21T10:13:22.328 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:22.328 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:22.329 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-21 10:12:58.458039147 +0000 2024-04-21T10:13:22.329 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-21 10:06:37.142862982 +0000 2024-04-21T10:13:22.329 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-21 10:06:37.142862982 +0000 2024-04-21T10:13:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-21 10:06:37.142862982 +0000 2024-04-21T10:13:22.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T10:13:22.393 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-21T10:13:22.393 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-21T10:13:22.393 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000178429 s, 2.9 MB/s 2024-04-21T10:13:22.394 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T10:13:22.451 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-04-21T10:13:22.505 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T10:13:22.505 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:22.505 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-21T10:13:22.505 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:22.506 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:22.506 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-21 10:12:58.458039147 +0000 2024-04-21T10:13:22.506 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-21 10:06:37.480856830 +0000 2024-04-21T10:13:22.506 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-21 10:06:37.480856830 +0000 2024-04-21T10:13:22.506 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-21 10:06:37.480856830 +0000 2024-04-21T10:13:22.506 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T10:13:22.568 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-21T10:13:22.568 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-21T10:13:22.568 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000184591 s, 2.8 MB/s 2024-04-21T10:13:22.569 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T10:13:22.626 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-04-21T10:13:22.681 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T10:13:22.681 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T10:13:22.681 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-21T10:13:22.682 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T10:13:22.682 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T10:13:22.682 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-21 10:12:58.459039130 +0000 2024-04-21T10:13:22.682 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-21 10:06:37.826850533 +0000 2024-04-21T10:13:22.682 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-21 10:06:37.826850533 +0000 2024-04-21T10:13:22.682 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-21 10:06:37.826850533 +0000 2024-04-21T10:13:22.682 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T10:13:22.746 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-21T10:13:22.746 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-21T10:13:22.746 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000182941 s, 2.8 MB/s 2024-04-21T10:13:22.747 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T10:13:22.804 INFO:tasks.cephadm:Deploying osd.0 on smithi077 with /dev/vg_nvme/lv_4... 2024-04-21T10:13:22.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-21T10:13:22.916 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:22.916 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:22.917 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:22.917 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:22.917 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T10:13:22.918 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:22.918 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:23.033 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:13:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T10:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:23.884 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:23 smithi191 ceph-mon[31636]: Deploying daemon mgr.z on smithi191 2024-04-21T10:13:23.884 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:23 smithi191 ceph-mon[31636]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:23 smithi077 ceph-mon[27902]: Deploying daemon mgr.z on smithi191 2024-04-21T10:13:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:23 smithi077 ceph-mon[27902]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:23 smithi170 ceph-mon[31212]: Deploying daemon mgr.z on smithi191 2024-04-21T10:13:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:23 smithi170 ceph-mon[31212]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:24.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 systemd[1]: Starting Ceph mgr.z for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:13:24.517 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 podman[33468]: 2024-04-21 10:13:24.184607811 +0000 UTC m=+0.031552778 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:13:24.517 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 podman[33468]: 2024-04-21 10:13:24.325083994 +0000 UTC m=+0.172028981 container create 87918d745da11bf07d31efee6dc9a1fb1535b5f3238c5b25536125b0c919579f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z, org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-a630765) 2024-04-21T10:13:24.518 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 podman[33468]: 2024-04-21 10:13:24.518793929 +0000 UTC m=+0.365738874 container init 87918d745da11bf07d31efee6dc9a1fb1535b5f3238c5b25536125b0c919579f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-a630765, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-21T10:13:24.865 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 podman[33468]: 2024-04-21 10:13:24.521398388 +0000 UTC m=+0.368343336 container start 87918d745da11bf07d31efee6dc9a1fb1535b5f3238c5b25536125b0c919579f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-a630765, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-21T10:13:24.865 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 ceph-mgr[33487]: -- 172.21.15.191:0/1588364572 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632d0a565a0 con 0x5632d0a2b000 2024-04-21T10:13:24.865 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 bash[33468]: 87918d745da11bf07d31efee6dc9a1fb1535b5f3238c5b25536125b0c919579f 2024-04-21T10:13:24.865 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 systemd[1]: Started Ceph mgr.z for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:13:24.865 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:24.682+0000 7ff20e6f9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:13:24.865 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:24.864+0000 7ff20e6f9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:13:24.880 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-21T10:13:24.881 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-21T10:13:24.881 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-21T10:13:24.881 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-21T10:13:24.881 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0164881 s, 636 MB/s 2024-04-21T10:13:24.881 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-21T10:13:25.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:24 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:24.968+0000 7ff20e6f9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:13:25.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-04-21T10:13:25.657 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:25.274+0000 7ff20e6f9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:13:25.658 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:25.357+0000 7ff20e6f9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:13:25.769 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:13:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T10:13:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:25 smithi077 ceph-mon[27902]: Deploying daemon mgr.y on smithi170 2024-04-21T10:13:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T10:13:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:25 smithi191 ceph-mon[31636]: Deploying daemon mgr.y on smithi170 2024-04-21T10:13:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:25 smithi170 ceph-mon[31212]: Deploying daemon mgr.y on smithi170 2024-04-21T10:13:26.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:26 smithi170 systemd[1]: Starting Ceph mgr.y for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:13:26.890 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:26 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:26.540+0000 7ff20e6f9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:13:26.890 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:26 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:26.712+0000 7ff20e6f9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:13:26.890 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:26 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:26.889+0000 7ff20e6f9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:13:27.135 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:26 smithi170 podman[32578]: 2024-04-21 10:13:26.85096926 +0000 UTC m=+0.100178359 container create 28ecb3bb40459cc83ee125a2da6cdc1e0902f5cfe1cb224a5b5ff0df957aa685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-a630765, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-21T10:13:27.135 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:26 smithi170 podman[32578]: 2024-04-21 10:13:26.768672252 +0000 UTC m=+0.017881364 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:13:27.135 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 podman[32578]: 2024-04-21 10:13:27.069845909 +0000 UTC m=+0.319055008 container init 28ecb3bb40459cc83ee125a2da6cdc1e0902f5cfe1cb224a5b5ff0df957aa685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-a630765) 2024-04-21T10:13:27.135 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 podman[32578]: 2024-04-21 10:13:27.072443361 +0000 UTC m=+0.321652466 container start 28ecb3bb40459cc83ee125a2da6cdc1e0902f5cfe1cb224a5b5ff0df957aa685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-a630765, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-21T10:13:27.135 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mgr[32597]: -- 172.21.15.170:0/526840872 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a08e9c25a0 con 0x55a08e997000 2024-04-21T10:13:27.135 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 bash[32578]: 28ecb3bb40459cc83ee125a2da6cdc1e0902f5cfe1cb224a5b5ff0df957aa685 2024-04-21T10:13:27.193 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:27.193+0000 7ff20e6f9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 -- 172.21.15.77:0/3930789434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 msgr2=0x7f2b44104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 --2- 172.21.15.77:0/3930789434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44104100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b380099c0 tx=0x7f2b38009cd0 comp rx=0 tx=0).stop 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 -- 172.21.15.77:0/3930789434 shutdown_connections 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 --2- 172.21.15.77:0/3930789434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b44102aa0 0x7f2b44102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 --2- 172.21.15.77:0/3930789434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b44104640 0x7f2b4410aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 --2- 172.21.15.77:0/3930789434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44104100 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 -- 172.21.15.77:0/3930789434 >> 172.21.15.77:0/3930789434 conn(0x7f2b440fe040 msgr2=0x7f2b44100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 -- 172.21.15.77:0/3930789434 shutdown_connections 2024-04-21T10:13:27.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.238+0000 7f2b49013700 1 -- 172.21.15.77:0/3930789434 wait complete. 2024-04-21T10:13:27.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 Processor -- start 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 -- start start 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b44102aa0 0x7f2b44198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b44104640 0x7f2b441a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4410e590 con 0x7f2b44103ca0 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4410e410 con 0x7f2b44102aa0 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b49013700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4410e710 con 0x7f2b44104640 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.239+0000 7f2b4259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52186/0 (socket says 172.21.15.77:52186) 2024-04-21T10:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 -- 172.21.15.77:0/3679841479 learned_addr learned my addr 172.21.15.77:0/3679841479 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b42d9d700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b44102aa0 0x7f2b44198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4359e700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b44104640 0x7f2b441a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 -- 172.21.15.77:0/3679841479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b44104640 msgr2=0x7f2b441a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b44104640 0x7f2b441a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 -- 172.21.15.77:0/3679841479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b44102aa0 msgr2=0x7f2b44198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b44102aa0 0x7f2b44198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 -- 172.21.15.77:0/3679841479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441a08a0 con 0x7f2b44103ca0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b4259c700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44199190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800fa00 tx=0x7f2b3800fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38027070 con 0x7f2b44103ca0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441a0b30 con 0x7f2b44103ca0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b38022920 con 0x7f2b44103ca0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38009e60 con 0x7f2b44103ca0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.240+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441a0fe0 con 0x7f2b44103ca0 2024-04-21T10:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.241+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2b3802a070 con 0x7f2b44103ca0 2024-04-21T10:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.241+0000 7f2b2bfff700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2b2c039890 0x7f2b2c03bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.241+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4402df80 con 0x7f2b44103ca0 2024-04-21T10:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.241+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2b3804d7d0 con 0x7f2b44103ca0 2024-04-21T10:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.241+0000 7f2b42d9d700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2b2c039890 0x7f2b2c03bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.242+0000 7f2b42d9d700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2b2c039890 0x7f2b2c03bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b4419a130 tx=0x7f2b3400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.246+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2b38013070 con 0x7f2b44103ca0 2024-04-21T10:13:27.413 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 systemd[1]: Started Ceph mgr.y for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:13:27.413 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:27.238+0000 7f71af41c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:13:27.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:27.461+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2b44062e80 con 0x7f2b2c039890 2024-04-21T10:13:27.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:27.288+0000 7ff20e6f9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:13:27.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:27.436+0000 7f71af41c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:27.549+0000 7f71af41c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:13:27.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:27.842 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:27.842 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:13:27.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:27.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:27.501+0000 7ff20e6f9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:13:27.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:27.704+0000 7ff20e6f9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:13:27.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:27.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:13:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:13:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:28.223 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:27 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:27.895+0000 7f71af41c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:13:28.224 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:28 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:28.001+0000 7f71af41c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:13:28.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:28.343+0000 7ff20e6f9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:13:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:28 smithi170 ceph-mon[31212]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:28 smithi191 ceph-mon[31636]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:28.969 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:28.773+0000 7ff20e6f9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:13:28.969 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:28.869+0000 7ff20e6f9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:13:29.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:28 smithi077 ceph-mon[27902]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:29.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:29.073+0000 7ff20e6f9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:13:29.556 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:29.242+0000 7f71af41c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:13:29.556 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:29.411+0000 7f71af41c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:13:29.871 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:29.582+0000 7f71af41c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:29.871+0000 7f71af41c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:29.872 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:29.592+0000 7ff20e6f9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:29.684+0000 7ff20e6f9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:29.926 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:29.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:29.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:29.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T10:13:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T10:13:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:30.168 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:29 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:29.964+0000 7f71af41c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:13:30.168 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:30.168+0000 7f71af41c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:13:30.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:29 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:29.925+0000 7ff20e6f9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:13:30.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:30.057+0000 7ff20e6f9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:13:30.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:30.151+0000 7ff20e6f9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:13:30.556 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:30.360+0000 7f71af41c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:13:30.569 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:30.266+0000 7ff20e6f9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:13:30.569 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:30.569+0000 7ff20e6f9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: Reconfiguring mgr.x (unknown last config time)... 2024-04-21T10:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: Reconfiguring daemon mgr.x on smithi077 2024-04-21T10:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/37740013' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e82e5ffc-2406-48be-b12a-30c6972b3df6"}]: dispatch 2024-04-21T10:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/37740013' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e82e5ffc-2406-48be-b12a-30c6972b3df6"}]': finished 2024-04-21T10:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: osdmap e5: 1 total, 0 up, 1 in 2024-04-21T10:13:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:30 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2202678219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:13:31.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:30.963+0000 7f71af41c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: Reconfiguring mgr.x (unknown last config time)... 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: Reconfiguring daemon mgr.x on smithi077 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/37740013' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e82e5ffc-2406-48be-b12a-30c6972b3df6"}]: dispatch 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/37740013' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e82e5ffc-2406-48be-b12a-30c6972b3df6"}]': finished 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: osdmap e5: 1 total, 0 up, 1 in 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:30 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2202678219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:13:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: Reconfiguring mgr.x (unknown last config time)... 2024-04-21T10:13:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: Reconfiguring daemon mgr.x on smithi077 2024-04-21T10:13:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/37740013' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e82e5ffc-2406-48be-b12a-30c6972b3df6"}]: dispatch 2024-04-21T10:13:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/37740013' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e82e5ffc-2406-48be-b12a-30c6972b3df6"}]': finished 2024-04-21T10:13:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: osdmap e5: 1 total, 0 up, 1 in 2024-04-21T10:13:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:30 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2202678219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:13:31.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:31.164+0000 7ff20e6f9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:13:31.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:13:31.377+0000 7ff20e6f9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:13:31.680 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:31.383+0000 7f71af41c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:13:31.680 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:31.478+0000 7f71af41c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:13:31.680 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:31.680+0000 7f71af41c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:13:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-mon[31212]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-mon[31212]: Standby manager daemon z started 2024-04-21T10:13:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T10:13:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:13:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T10:13:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:31 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:13:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:31 smithi077 ceph-mon[27902]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:31 smithi077 ceph-mon[27902]: Standby manager daemon z started 2024-04-21T10:13:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:31 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T10:13:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:31 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:13:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:31 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T10:13:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:31 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:13:32.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:32.151+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7f2b38026d60 con 0x7f2b44103ca0 2024-04-21T10:13:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-mon[31636]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-mon[31636]: Standby manager daemon z started 2024-04-21T10:13:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T10:13:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:13:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T10:13:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:31 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/1407899138' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:13:32.544 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:32 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:32.213+0000 7f71af41c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:13:32.544 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:32 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:32.304+0000 7f71af41c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:13:32.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:32 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:32.544+0000 7f71af41c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:13:32.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:32 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:32.676+0000 7f71af41c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:13:32.807 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:32 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:32.770+0000 7f71af41c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:13:33.153 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:32 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:32.885+0000 7f71af41c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:13:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:33 smithi191 ceph-mon[31636]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-21T10:13:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T10:13:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:33 smithi191 ceph-mon[31636]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:33.556 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:33 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:33.190+0000 7f71af41c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:13:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:33 smithi170 ceph-mon[31212]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-21T10:13:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T10:13:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:33 smithi170 ceph-mon[31212]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:33 smithi077 ceph-mon[27902]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-21T10:13:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T10:13:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:33 smithi077 ceph-mon[27902]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:34.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:33 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:33.785+0000 7f71af41c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:13:34.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:13:34 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:13:34.001+0000 7f71af41c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:13:34.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:34.165+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f2b38017650 con 0x7f2b44103ca0 2024-04-21T10:13:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:34 smithi077 ceph-mon[27902]: Standby manager daemon y started 2024-04-21T10:13:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:34 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T10:13:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:34 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:13:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:34 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T10:13:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:34 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:34 smithi191 ceph-mon[31636]: Standby manager daemon y started 2024-04-21T10:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:34 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T10:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:34 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:34 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T10:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:34 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:13:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:34 smithi170 ceph-mon[31212]: Standby manager daemon y started 2024-04-21T10:13:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:34 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T10:13:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:34 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:13:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:34 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T10:13:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:34 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/2694228159' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:13:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:35 smithi191 ceph-mon[31636]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-21T10:13:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:35 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T10:13:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:35 smithi191 ceph-mon[31636]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:35 smithi170 ceph-mon[31212]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-21T10:13:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:35 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T10:13:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:35 smithi170 ceph-mon[31212]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:35.579 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:35 smithi077 ceph-mon[27902]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-21T10:13:35.579 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:35 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T10:13:35.579 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:35 smithi077 ceph-mon[27902]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:36.795 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:36.796 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:36.796 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:36.796 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:36.796 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:36.796 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:37 smithi077 ceph-mon[27902]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:37 smithi191 ceph-mon[31636]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:37 smithi170 ceph-mon[31212]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-21T10:13:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-21T10:13:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:39.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-21T10:13:39.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:39 smithi191 ceph-mon[31636]: Deploying daemon osd.0 on smithi077 2024-04-21T10:13:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:39 smithi191 ceph-mon[31636]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:39.968 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:39 smithi077 ceph-mon[27902]: Deploying daemon osd.0 on smithi077 2024-04-21T10:13:39.969 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:39 smithi077 ceph-mon[27902]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:39 smithi170 ceph-mon[31212]: Deploying daemon osd.0 on smithi077 2024-04-21T10:13:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:39 smithi170 ceph-mon[31212]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:41 smithi191 ceph-mon[31636]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:41 smithi170 ceph-mon[31212]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:41 smithi077 ceph-mon[27902]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:43 smithi191 ceph-mon[31636]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:43 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:43 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:43 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:43 smithi170 ceph-mon[31212]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:43 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:43 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:43 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:43 smithi077 ceph-mon[27902]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:45 smithi191 ceph-mon[31636]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:45.989 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:45 smithi077 ceph-mon[27902]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:45 smithi170 ceph-mon[31212]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:47.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.022+0000 7f2b2bfff700 1 -- 172.21.15.77:0/3679841479 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2b44062e80 con 0x7f2b2c039890 2024-04-21T10:13:47.022 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 0 on host 'smithi077' 2024-04-21T10:13:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2b2c039890 msgr2=0x7f2b2c03bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2b2c039890 0x7f2b2c03bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b4419a130 tx=0x7f2b3400b410 comp rx=0 tx=0).stop 2024-04-21T10:13:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 msgr2=0x7f2b44199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44199190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800fa00 tx=0x7f2b3800fa30 comp rx=0 tx=0).stop 2024-04-21T10:13:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 shutdown_connections 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2b2c039890 0x7f2b2c03bd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b44102aa0 0x7f2b44198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b44104640 0x7f2b441a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 --2- 172.21.15.77:0/3679841479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b44103ca0 0x7f2b44199190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 >> 172.21.15.77:0/3679841479 conn(0x7f2b440fe040 msgr2=0x7f2b44107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 shutdown_connections 2024-04-21T10:13:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:13:47.024+0000 7f2b49013700 1 -- 172.21.15.77:0/3679841479 wait complete. 2024-04-21T10:13:47.654 DEBUG:teuthology.orchestra.run.smithi077:osd.0> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.0.service 2024-04-21T10:13:47.656 INFO:tasks.cephadm:Deploying osd.1 on smithi170 with /dev/vg_nvme/lv_4... 2024-04-21T10:13:47.656 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-21T10:13:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:47 smithi077 ceph-mon[27902]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:47 smithi077 ceph-mon[27902]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T10:13:47.900 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:47 smithi191 ceph-mon[31636]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:47 smithi191 ceph-mon[31636]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T10:13:48.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:47 smithi170 ceph-mon[31212]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:48.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:48.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:48.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:48.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:48.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:47 smithi170 ceph-mon[31212]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T10:13:49.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:49 smithi170 ceph-mon[31212]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-21T10:13:49.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:49 smithi170 ceph-mon[31212]: osdmap e6: 1 total, 0 up, 1 in 2024-04-21T10:13:49.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:49 smithi170 ceph-mon[31212]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:13:49.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:49.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:49 smithi170 ceph-mon[31212]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-mon[27902]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-21T10:13:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-mon[27902]: osdmap e6: 1 total, 0 up, 1 in 2024-04-21T10:13:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-mon[27902]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:13:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-mon[27902]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:49 smithi191 ceph-mon[31636]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-21T10:13:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:49 smithi191 ceph-mon[31636]: osdmap e6: 1 total, 0 up, 1 in 2024-04-21T10:13:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:49 smithi191 ceph-mon[31636]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:13:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:49 smithi191 ceph-mon[31636]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-21T10:13:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-21T10:13:49.727 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-04-21T10:13:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-04-21T10:13:49.727 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00846879 s, 1.2 GB/s 2024-04-21T10:13:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-04-21T10:13:49.886 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-0[42350]: 2024-04-21T10:13:49.546+0000 7fd87242a700 -1 osd.0 0 waiting for initial osdmap 2024-04-21T10:13:49.886 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:13:49 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-0[42350]: 2024-04-21T10:13:49.550+0000 7fd869a14700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:13:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:50 smithi170 ceph-mon[31212]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:13:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:50 smithi170 ceph-mon[31212]: osdmap e7: 1 total, 0 up, 1 in 2024-04-21T10:13:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:50 smithi170 ceph-mon[31212]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' 2024-04-21T10:13:50.337 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:50 smithi077 ceph-mon[27902]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:13:50.337 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:50 smithi077 ceph-mon[27902]: osdmap e7: 1 total, 0 up, 1 in 2024-04-21T10:13:50.337 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:50.337 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:50.337 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:50 smithi077 ceph-mon[27902]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' 2024-04-21T10:13:50.374 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_4 2024-04-21T10:13:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:50 smithi191 ceph-mon[31636]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:13:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:50 smithi191 ceph-mon[31636]: osdmap e7: 1 total, 0 up, 1 in 2024-04-21T10:13:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:50 smithi191 ceph-mon[31636]: from='osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112]' entity='osd.0' 2024-04-21T10:13:50.617 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:13:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:13:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:13:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] boot 2024-04-21T10:13:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: osdmap e8: 1 total, 1 up, 1 in 2024-04-21T10:13:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi077 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 17088M 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] boot 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: osdmap e8: 1 total, 1 up, 1 in 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi077 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 17088M 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:13:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:13:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: osd.0 [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] boot 2024-04-21T10:13:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: osdmap e8: 1 total, 1 up, 1 in 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi077 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 17088M 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:13:52.124 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:52 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:52.124 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:52 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:52.124 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:52 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:52.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 -- 172.21.15.170:0/1668002210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134102ac0 msgr2=0x7f8134102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:52.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 --2- 172.21.15.170:0/1668002210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134102ac0 0x7f8134102ee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81240099c0 tx=0x7f8124009cd0 comp rx=0 tx=0).stop 2024-04-21T10:13:52.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 -- 172.21.15.170:0/1668002210 shutdown_connections 2024-04-21T10:13:52.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 --2- 172.21.15.170:0/1668002210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134102ac0 0x7f8134102ee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 --2- 172.21.15.170:0/1668002210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8134104660 0x7f813410af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 --2- 172.21.15.170:0/1668002210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134103cc0 0x7f8134104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 -- 172.21.15.170:0/1668002210 >> 172.21.15.170:0/1668002210 conn(0x7f81340fe060 msgr2=0x7f81341004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 -- 172.21.15.170:0/1668002210 shutdown_connections 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 -- 172.21.15.170:0/1668002210 wait complete. 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.146+0000 7f813a54a700 1 Processor -- start 2024-04-21T10:13:52.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 -- start start 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8134102ac0 0x7f8134076790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 0x7f8134074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134104660 0x7f8134075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f813410e600 con 0x7f8134104660 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f813410e480 con 0x7f8134103cc0 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f813a54a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f813410e780 con 0x7f8134102ac0 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 0x7f8134074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 0x7f8134074e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51636/0 (socket says 172.21.15.170:51636) 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 -- 172.21.15.170:0/2190090199 learned_addr learned my addr 172.21.15.170:0/2190090199 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-21T10:13:52.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f8133fff700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8134102ac0 0x7f8134076790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f8138ae7700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134104660 0x7f8134075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 -- 172.21.15.170:0/2190090199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8134102ac0 msgr2=0x7f8134076790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8134102ac0 0x7f8134076790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 -- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134104660 msgr2=0x7f8134075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134104660 0x7f8134075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 -- 172.21.15.170:0/2190090199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8134075c40 con 0x7f8134103cc0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.147+0000 7f81337fe700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 0x7f8134074e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f812800c920 tx=0x7f812800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.148+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128004a30 con 0x7f8134103cc0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.148+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81280054d0 con 0x7f8134103cc0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.148+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128007c70 con 0x7f8134103cc0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.148+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81341a2e00 con 0x7f8134103cc0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.148+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341a3200 con 0x7f8134103cc0 2024-04-21T10:13:52.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.149+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8134069730 con 0x7f8134103cc0 2024-04-21T10:13:52.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.150+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f8128004c60 con 0x7f8134103cc0 2024-04-21T10:13:52.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.150+0000 7f81317fa700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f811c0a3bb0 0x7f811c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:13:52.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.150+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f81280ce820 con 0x7f8134103cc0 2024-04-21T10:13:52.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.150+0000 7f8133fff700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f811c0a3bb0 0x7f811c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:13:52.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.151+0000 7f8133fff700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f811c0a3bb0 0x7f811c0a6070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8124009f50 tx=0x7f812400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:13:52.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.155+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8128014030 con 0x7f8134103cc0 2024-04-21T10:13:52.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:13:52.361+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8134062e80 con 0x7f811c0a3bb0 2024-04-21T10:13:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:52 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:52 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:13:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:52 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:13:53.251 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:53 smithi170 ceph-mon[31212]: osdmap e9: 1 total, 1 up, 1 in 2024-04-21T10:13:53.251 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:53 smithi170 ceph-mon[31212]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:53.251 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:53 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:13:53.251 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:53 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:13:53.251 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:53 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:53.251 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:53 smithi170 ceph-mon[31212]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:53 smithi077 ceph-mon[27902]: osdmap e9: 1 total, 1 up, 1 in 2024-04-21T10:13:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:53 smithi077 ceph-mon[27902]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:13:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:13:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:53 smithi077 ceph-mon[27902]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:53 smithi191 ceph-mon[31636]: osdmap e9: 1 total, 1 up, 1 in 2024-04-21T10:13:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:53 smithi191 ceph-mon[31636]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:13:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:53 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:13:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:53 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:13:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:53 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:13:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:53 smithi191 ceph-mon[31636]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/1955583075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]: dispatch 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]: dispatch 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]': finished 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: osdmap e10: 2 total, 1 up, 2 in 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:13:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:55 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/632224579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:13:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/1955583075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]: dispatch 2024-04-21T10:13:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]: dispatch 2024-04-21T10:13:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]': finished 2024-04-21T10:13:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: osdmap e10: 2 total, 1 up, 2 in 2024-04-21T10:13:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:13:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:55 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/632224579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:13:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/1955583075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]: dispatch 2024-04-21T10:13:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]: dispatch 2024-04-21T10:13:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "692cfb0a-b71d-41b3-bc8f-f99352c085e3"}]': finished 2024-04-21T10:13:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: osdmap e10: 2 total, 1 up, 2 in 2024-04-21T10:13:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:13:56.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:55 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/632224579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:13:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:57 smithi191 ceph-mon[31636]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:57 smithi170 ceph-mon[31212]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:57 smithi077 ceph-mon[27902]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:13:59 smithi191 ceph-mon[31636]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:13:59.990 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:13:59 smithi170 ceph-mon[31212]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:13:59 smithi077 ceph-mon[27902]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:01.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:01 smithi170 ceph-mon[31212]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:01 smithi191 ceph-mon[31636]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:01.988 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:01 smithi077 ceph-mon[27902]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:02.911 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:02 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-21T10:14:02.911 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:02 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:02 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-21T10:14:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:02 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:02 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-21T10:14:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:02 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:03 smithi170 ceph-mon[31212]: Deploying daemon osd.1 on smithi170 2024-04-21T10:14:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:03 smithi170 ceph-mon[31212]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:03 smithi191 ceph-mon[31636]: Deploying daemon osd.1 on smithi170 2024-04-21T10:14:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:03 smithi191 ceph-mon[31636]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:04.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:03 smithi077 ceph-mon[27902]: Deploying daemon osd.1 on smithi170 2024-04-21T10:14:04.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:03 smithi077 ceph-mon[27902]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:05 smithi191 ceph-mon[31636]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:05 smithi170 ceph-mon[31212]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:05 smithi077 ceph-mon[27902]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:07.863 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:07 smithi170 ceph-mon[31212]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:07.864 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:07.864 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:07.864 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:07 smithi191 ceph-mon[31636]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:07 smithi077 ceph-mon[27902]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:09.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:09 smithi170 ceph-mon[31212]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:09 smithi191 ceph-mon[31636]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:09 smithi077 ceph-mon[27902]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:10.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.922+0000 7f81317fa700 1 -- 172.21.15.170:0/2190090199 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8134062e80 con 0x7f811c0a3bb0 2024-04-21T10:14:10.923 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 1 on host 'smithi170' 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f811c0a3bb0 msgr2=0x7f811c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f811c0a3bb0 0x7f811c0a6070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8124009f50 tx=0x7f812400b540 comp rx=0 tx=0).stop 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 msgr2=0x7f8134074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 0x7f8134074e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f812800c920 tx=0x7f812800cc30 comp rx=0 tx=0).stop 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 shutdown_connections 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f811c0a3bb0 0x7f811c0a6070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134104660 0x7f8134075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8134102ac0 0x7f8134076790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 --2- 172.21.15.170:0/2190090199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8134103cc0 0x7f8134074e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 >> 172.21.15.170:0/2190090199 conn(0x7f81340fe060 msgr2=0x7f8134106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 shutdown_connections 2024-04-21T10:14:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:14:10.925+0000 7f813a54a700 1 -- 172.21.15.170:0/2190090199 wait complete. 2024-04-21T10:14:11.134 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.134 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.135 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:11.589 DEBUG:teuthology.orchestra.run.smithi170:osd.1> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.1.service 2024-04-21T10:14:11.592 INFO:tasks.cephadm:Deploying osd.2 on smithi191 with /dev/vg_nvme/lv_4... 2024-04-21T10:14:11.592 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-21T10:14:11.837 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:14:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:12 smithi191 ceph-mon[31636]: from='osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T10:14:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:12 smithi191 ceph-mon[31636]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T10:14:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:12 smithi170 ceph-mon[31212]: from='osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T10:14:12.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:12 smithi170 ceph-mon[31212]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T10:14:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:12 smithi077 ceph-mon[27902]: from='osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T10:14:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:12 smithi077 ceph-mon[27902]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T10:14:13.171 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:13 smithi191 ceph-mon[31636]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-21T10:14:13.171 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:13 smithi191 ceph-mon[31636]: from='osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:14:13.171 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:13 smithi191 ceph-mon[31636]: osdmap e11: 2 total, 1 up, 2 in 2024-04-21T10:14:13.171 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:13.171 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:13 smithi191 ceph-mon[31636]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:14:13.172 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:13 smithi191 ceph-mon[31636]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-mon[31212]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-21T10:14:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-mon[31212]: from='osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:14:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-mon[31212]: osdmap e11: 2 total, 1 up, 2 in 2024-04-21T10:14:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-mon[31212]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:14:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-mon[31212]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:13.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-1[35812]: 2024-04-21T10:14:13.032+0000 7f874c592700 -1 osd.1 0 waiting for initial osdmap 2024-04-21T10:14:13.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:13 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-1[35812]: 2024-04-21T10:14:13.036+0000 7f8748385700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:14:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:13 smithi077 ceph-mon[27902]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-21T10:14:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:13 smithi077 ceph-mon[27902]: from='osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:14:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:13 smithi077 ceph-mon[27902]: osdmap e11: 2 total, 1 up, 2 in 2024-04-21T10:14:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:13 smithi077 ceph-mon[27902]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:14:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:13 smithi077 ceph-mon[27902]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:13.739 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-21T10:14:13.739 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-21T10:14:13.740 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-04-21T10:14:13.740 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-04-21T10:14:13.740 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112389 s, 933 MB/s 2024-04-21T10:14:13.740 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-04-21T10:14:14.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:14 smithi191 ceph-mon[31636]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:14:14.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:14 smithi191 ceph-mon[31636]: osdmap e12: 2 total, 1 up, 2 in 2024-04-21T10:14:14.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:14 smithi170 ceph-mon[31212]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:14:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:14 smithi170 ceph-mon[31212]: osdmap e12: 2 total, 1 up, 2 in 2024-04-21T10:14:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-04-21T10:14:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:14 smithi077 ceph-mon[27902]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:14:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:14 smithi077 ceph-mon[27902]: osdmap e12: 2 total, 1 up, 2 in 2024-04-21T10:14:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:14.562 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:14:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:14:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:14:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] boot 2024-04-21T10:14:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: osdmap e13: 2 total, 2 up, 2 in 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi170 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 17088M 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:15 smithi191 ceph-mon[31636]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] boot 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: osdmap e13: 2 total, 2 up, 2 in 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi170 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 17088M 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:15 smithi170 ceph-mon[31212]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:14:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:14:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: osd.1 [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] boot 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: osdmap e13: 2 total, 2 up, 2 in 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi170 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 17088M 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:15 smithi077 ceph-mon[27902]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-21T10:14:16.009 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 -- 172.21.15.191:0/2368008725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 msgr2=0x7f68e010ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:16.009 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 --2- 172.21.15.191:0/2368008725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e010ac00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b0a0 tx=0x7f68d800b3b0 comp rx=0 tx=0).stop 2024-04-21T10:14:16.009 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 -- 172.21.15.191:0/2368008725 shutdown_connections 2024-04-21T10:14:16.009 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 --2- 172.21.15.191:0/2368008725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e0103570 0x7f68e0105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:16.009 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 --2- 172.21.15.191:0/2368008725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e010ac00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:16.009 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 --2- 172.21.15.191:0/2368008725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68e0105ea0 0x7f68e0108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 -- 172.21.15.191:0/2368008725 >> 172.21.15.191:0/2368008725 conn(0x7f68e00fcf40 msgr2=0x7f68e00ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 -- 172.21.15.191:0/2368008725 shutdown_connections 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 -- 172.21.15.191:0/2368008725 wait complete. 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 Processor -- start 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.007+0000 7f68e6370700 1 -- start start 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e6370700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e0103570 0x7f68e0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e6370700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68e0105ea0 0x7f68e0199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e6370700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e01a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e6370700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68e010e580 con 0x7f68e0105ea0 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e6370700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f68e010e400 con 0x7f68e0103570 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e6370700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68e010e700 con 0x7f68e01087d0 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e01a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:16.010 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e01a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49582/0 (socket says 172.21.15.191:49582) 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 -- 172.21.15.191:0/698012898 learned_addr learned my addr 172.21.15.191:0/698012898 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68dffff700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e0103570 0x7f68e0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68df7fe700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68e0105ea0 0x7f68e0199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 -- 172.21.15.191:0/698012898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e0103570 msgr2=0x7f68e0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e0103570 0x7f68e0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 -- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68e0105ea0 msgr2=0x7f68e0199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68e0105ea0 0x7f68e0199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 -- 172.21.15.191:0/698012898 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e01a0790 con 0x7f68e01087d0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68e490d700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e01a00f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68d800ced0 tx=0x7f68d800cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.008+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8021070 con 0x7f68e01087d0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.009+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68d8007d00 con 0x7f68e01087d0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.009+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e01a0a20 con 0x7f68e01087d0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.009+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d801d450 con 0x7f68e01087d0 2024-04-21T10:14:16.011 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.009+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e01a0fe0 con 0x7f68e01087d0 2024-04-21T10:14:16.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.010+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e0069730 con 0x7f68e01087d0 2024-04-21T10:14:16.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.011+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f68d8004000 con 0x7f68e01087d0 2024-04-21T10:14:16.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.012+0000 7f68dd7fa700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f68c80a3bb0 0x7f68c80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:16.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.012+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f68d800f020 con 0x7f68e01087d0 2024-04-21T10:14:16.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.012+0000 7f68dffff700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f68c80a3bb0 0x7f68c80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:16.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.013+0000 7f68dffff700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f68c80a3bb0 0x7f68c80a6070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68d000ac50 tx=0x7f68d000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:14:16.016 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.016+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f68d802a020 con 0x7f68e01087d0 2024-04-21T10:14:16.221 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:16.221+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f68e0062e80 con 0x7f68c80a3bb0 2024-04-21T10:14:16.302 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:16 smithi077 ceph-mon[27902]: osdmap e14: 2 total, 2 up, 2 in 2024-04-21T10:14:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:16 smithi170 ceph-mon[31212]: osdmap e14: 2 total, 2 up, 2 in 2024-04-21T10:14:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:16 smithi191 ceph-mon[31636]: osdmap e14: 2 total, 2 up, 2 in 2024-04-21T10:14:17.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:17 smithi191 ceph-mon[31636]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:14:17.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:14:17.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:14:17.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:17.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:17 smithi191 ceph-mon[31636]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:17 smithi170 ceph-mon[31212]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:14:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:14:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:14:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:17 smithi170 ceph-mon[31212]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:17 smithi077 ceph-mon[27902]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:14:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:14:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:14:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:17 smithi077 ceph-mon[27902]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/2216669891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]: dispatch 2024-04-21T10:14:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]: dispatch 2024-04-21T10:14:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]': finished 2024-04-21T10:14:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: osdmap e15: 3 total, 2 up, 3 in 2024-04-21T10:14:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:19 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/3828660952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:14:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/2216669891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]: dispatch 2024-04-21T10:14:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]: dispatch 2024-04-21T10:14:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]': finished 2024-04-21T10:14:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: osdmap e15: 3 total, 2 up, 3 in 2024-04-21T10:14:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:19 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/3828660952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/2216669891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]: dispatch 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]: dispatch 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c585bc66-98a9-4126-8208-11fb8b8d16ad"}]': finished 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: osdmap e15: 3 total, 2 up, 3 in 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:19 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/3828660952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:14:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:21 smithi191 ceph-mon[31636]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:21 smithi170 ceph-mon[31212]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:21 smithi077 ceph-mon[27902]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:23.920 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:23 smithi191 ceph-mon[31636]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:23 smithi170 ceph-mon[31212]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:23 smithi077 ceph-mon[27902]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:25 smithi191 ceph-mon[31636]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:25 smithi170 ceph-mon[31212]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:25 smithi077 ceph-mon[27902]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:26.924 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:26 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-21T10:14:26.924 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:26 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:26 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-21T10:14:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:26 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-21T10:14:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:27 smithi191 ceph-mon[31636]: Deploying daemon osd.2 on smithi191 2024-04-21T10:14:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:27 smithi191 ceph-mon[31636]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:27 smithi170 ceph-mon[31212]: Deploying daemon osd.2 on smithi191 2024-04-21T10:14:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:27 smithi170 ceph-mon[31212]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:27 smithi077 ceph-mon[27902]: Deploying daemon osd.2 on smithi191 2024-04-21T10:14:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:27 smithi077 ceph-mon[27902]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:29.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:29 smithi191 ceph-mon[31636]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:29 smithi170 ceph-mon[31212]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:29 smithi077 ceph-mon[27902]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:31 smithi191 ceph-mon[31636]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:31 smithi170 ceph-mon[31212]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:31 smithi077 ceph-mon[27902]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:33 smithi191 ceph-mon[31636]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:33.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:33.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:33 smithi170 ceph-mon[31212]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:33 smithi077 ceph-mon[27902]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:34.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.987+0000 7f68dd7fa700 1 -- 172.21.15.191:0/698012898 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f68e0062e80 con 0x7f68c80a3bb0 2024-04-21T10:14:34.987 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 2 on host 'smithi191' 2024-04-21T10:14:34.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f68c80a3bb0 msgr2=0x7f68c80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:34.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f68c80a3bb0 0x7f68c80a6070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68d000ac50 tx=0x7f68d000a380 comp rx=0 tx=0).stop 2024-04-21T10:14:34.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 msgr2=0x7f68e01a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:34.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e01a00f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68d800ced0 tx=0x7f68d800cf00 comp rx=0 tx=0).stop 2024-04-21T10:14:34.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 shutdown_connections 2024-04-21T10:14:34.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f68c80a3bb0 0x7f68c80a6070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:34.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e0103570 0x7f68e0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:34.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01087d0 0x7f68e01a00f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:34.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 --2- 172.21.15.191:0/698012898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68e0105ea0 0x7f68e0199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:34.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 >> 172.21.15.191:0/698012898 conn(0x7f68e00fcf40 msgr2=0x7f68e0103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:14:34.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 shutdown_connections 2024-04-21T10:14:34.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:14:34.990+0000 7f68e6370700 1 -- 172.21.15.191:0/698012898 wait complete. 2024-04-21T10:14:35.622 DEBUG:teuthology.orchestra.run.smithi191:osd.2> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.2.service 2024-04-21T10:14:35.625 INFO:tasks.cephadm:Deploying osd.3 on smithi077 with /dev/vg_nvme/lv_3... 2024-04-21T10:14:35.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-21T10:14:35.872 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:14:35.913 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:35 smithi191 ceph-mon[31636]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:35.913 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:35 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:35.914 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:35 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:35.914 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:35 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:35.914 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:35 smithi191 ceph-mon[31636]: from='osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T10:14:35.914 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:35 smithi191 ceph-mon[31636]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T10:14:35.994 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:35 smithi077 ceph-mon[27902]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:35.994 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:35 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:35.994 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:35 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:35.994 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:35 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:35.994 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:35 smithi077 ceph-mon[27902]: from='osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T10:14:35.994 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:35 smithi077 ceph-mon[27902]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T10:14:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:35 smithi170 ceph-mon[31212]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:35 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:35 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:35 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:36.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:35 smithi170 ceph-mon[31212]: from='osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T10:14:36.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:35 smithi170 ceph-mon[31212]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T10:14:37.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-mon[31636]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-21T10:14:37.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-mon[31636]: osdmap e16: 3 total, 2 up, 3 in 2024-04-21T10:14:37.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:37.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-mon[31636]: from='osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:14:37.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-mon[31636]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:14:37.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-mon[31636]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:37.033 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-2[36761]: 2024-04-21T10:14:36.989+0000 7f9983af7700 -1 osd.2 0 waiting for initial osdmap 2024-04-21T10:14:37.033 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:36 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-2[36761]: 2024-04-21T10:14:36.993+0000 7f997f8ea700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:14:37.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:36 smithi077 ceph-mon[27902]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-21T10:14:37.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:36 smithi077 ceph-mon[27902]: osdmap e16: 3 total, 2 up, 3 in 2024-04-21T10:14:37.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:37.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:36 smithi077 ceph-mon[27902]: from='osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:14:37.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:36 smithi077 ceph-mon[27902]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:14:37.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:36 smithi077 ceph-mon[27902]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:36 smithi170 ceph-mon[31212]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-21T10:14:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:36 smithi170 ceph-mon[31212]: osdmap e16: 3 total, 2 up, 3 in 2024-04-21T10:14:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:36 smithi170 ceph-mon[31212]: from='osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:14:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:36 smithi170 ceph-mon[31212]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:14:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:36 smithi170 ceph-mon[31212]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-21T10:14:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-21T10:14:37.804 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-21T10:14:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-21T10:14:37.805 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114265 s, 918 MB/s 2024-04-21T10:14:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-21T10:14:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:37 smithi191 ceph-mon[31636]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:14:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:37 smithi191 ceph-mon[31636]: osdmap e17: 3 total, 2 up, 3 in 2024-04-21T10:14:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:37 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:37 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:37 smithi170 ceph-mon[31212]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:14:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:37 smithi170 ceph-mon[31212]: osdmap e17: 3 total, 2 up, 3 in 2024-04-21T10:14:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:37 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:37 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:38.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:37 smithi077 ceph-mon[27902]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:14:38.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:37 smithi077 ceph-mon[27902]: osdmap e17: 3 total, 2 up, 3 in 2024-04-21T10:14:38.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:38.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:38.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-04-21T10:14:38.636 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:14:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] boot 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: osdmap e18: 3 total, 3 up, 3 in 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi191 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 17088M 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:39.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-21T10:14:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] boot 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: osdmap e18: 3 total, 3 up, 3 in 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi191 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 17088M 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-21T10:14:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:14:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: osd.2 [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] boot 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: osdmap e18: 3 total, 3 up, 3 in 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi191 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 17088M 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-21T10:14:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-21T10:14:40.258 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-21T10:14:40.259 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 ceph-mon[27902]: osdmap e19: 3 total, 3 up, 3 in 2024-04-21T10:14:40.259 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46586]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46586]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46586]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46586]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46592]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46592]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.259 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46592]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.260 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46592]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 -- 172.21.15.77:0/1273900406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f541019a0 msgr2=0x7f4f54101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 --2- 172.21.15.77:0/1273900406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f541019a0 0x7f4f54101dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4f500099c0 tx=0x7f4f50009cd0 comp rx=0 tx=0).stop 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 -- 172.21.15.77:0/1273900406 shutdown_connections 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 --2- 172.21.15.77:0/1273900406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f54103540 0x7f4f54109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 --2- 172.21.15.77:0/1273900406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f541019a0 0x7f4f54101dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 --2- 172.21.15.77:0/1273900406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 0x7f4f54103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 -- 172.21.15.77:0/1273900406 >> 172.21.15.77:0/1273900406 conn(0x7f4f540fcf40 msgr2=0x7f4f540ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:14:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 -- 172.21.15.77:0/1273900406 shutdown_connections 2024-04-21T10:14:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.272+0000 7f4f5c668700 1 -- 172.21.15.77:0/1273900406 wait complete. 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 Processor -- start 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 -- start start 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f541019a0 0x7f4f5406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 0x7f4f5419d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 0x7f4f5419ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5410d430 con 0x7f4f54103540 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5410d2b0 con 0x7f4f54102ba0 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5c668700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5410d5b0 con 0x7f4f541019a0 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5ac05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 0x7f4f5419ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5ac05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 0x7f4f5419ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55064/0 (socket says 172.21.15.77:55064) 2024-04-21T10:14:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5ac05700 1 -- 172.21.15.77:0/400251667 learned_addr learned my addr 172.21.15.77:0/400251667 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.273+0000 7f4f5a404700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f541019a0 0x7f4f5406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f59c03700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 0x7f4f5419d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5ac05700 1 -- 172.21.15.77:0/400251667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f541019a0 msgr2=0x7f4f5406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5ac05700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f541019a0 0x7f4f5406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5ac05700 1 -- 172.21.15.77:0/400251667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 msgr2=0x7f4f5419d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5ac05700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 0x7f4f5419d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5ac05700 1 -- 172.21.15.77:0/400251667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f541a0880 con 0x7f4f54103540 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f59c03700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 0x7f4f5419d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5ac05700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 0x7f4f5419ffb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00ef30 tx=0x7f4f4c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0092e0 con 0x7f4f54103540 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c004bb0 con 0x7f4f54103540 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c004280 con 0x7f4f54103540 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f541a0b10 con 0x7f4f54103540 2024-04-21T10:14:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.274+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f541a1050 con 0x7f4f54103540 2024-04-21T10:14:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.275+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f54069730 con 0x7f4f54103540 2024-04-21T10:14:40.277 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-21T10:14:40.277 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 ceph-mon[31636]: osdmap e19: 3 total, 3 up, 3 in 2024-04-21T10:14:40.277 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T10:14:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.276+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f4f4c01b030 con 0x7f4f54103540 2024-04-21T10:14:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.277+0000 7f4f4b7fe700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f400a3bb0 0x7f4f400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:14:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.277+0000 7f4f5a404700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f400a3bb0 0x7f4f400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:14:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.277+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3237+0+0 (secure 0 0 0) 0x7f4f4c0cf430 con 0x7f4f54103540 2024-04-21T10:14:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.277+0000 7f4f5a404700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f400a3bb0 0x7f4f400a6070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c00 tx=0x7f4f50005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:14:40.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.280+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4f4c022020 con 0x7f4f54103540 2024-04-21T10:14:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-21T10:14:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 ceph-mon[31212]: osdmap e19: 3 total, 3 up, 3 in 2024-04-21T10:14:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T10:14:40.306 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39804]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39804]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39804]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39804]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39807]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39807]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39807]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.307 INFO:journalctl@ceph.osd.1.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39807]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:40.498+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4f54062e80 con 0x7f4f400a3bb0 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46615]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46615]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46615]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46615]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46618]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46618]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46618]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:40 smithi077 sudo[46618]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40372]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40372]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40372]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40375]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40375]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40366]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40366]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40366]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40366]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40369]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40369]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.719 INFO:journalctl@ceph.osd.2.smithi191.stdout:Apr 21 10:14:40 smithi191 sudo[40369]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39810]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39810]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39810]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39810]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39813]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39813]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39813]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T10:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:40 smithi170 sudo[39813]: pam_unix(sudo:session): session closed for user root 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: osdmap e20: 3 total, 3 up, 3 in 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:41 smithi170 ceph-mon[31212]: pgmap v83: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:41.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:14:41.342+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4f4c012050 con 0x7f4f54103540 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: osdmap e20: 3 total, 3 up, 3 in 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.344 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:14:41.344 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:14:41.344 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:14:41.344 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:41.344 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:41 smithi077 ceph-mon[27902]: pgmap v83: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-21T10:14:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: osdmap e20: 3 total, 3 up, 3 in 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:41 smithi191 ceph-mon[31636]: pgmap v83: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:42.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:42 smithi077 ceph-mon[27902]: osdmap e21: 3 total, 3 up, 3 in 2024-04-21T10:14:42.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:42 smithi077 ceph-mon[27902]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-21T10:14:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:42 smithi170 ceph-mon[31212]: osdmap e21: 3 total, 3 up, 3 in 2024-04-21T10:14:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:42 smithi170 ceph-mon[31212]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-21T10:14:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:42 smithi191 ceph-mon[31636]: osdmap e21: 3 total, 3 up, 3 in 2024-04-21T10:14:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:42 smithi191 ceph-mon[31636]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-21T10:14:43.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:43 smithi170 ceph-mon[31212]: pgmap v85: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:43 smithi077 ceph-mon[27902]: pgmap v85: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:43 smithi191 ceph-mon[31636]: pgmap v85: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:44 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2405927084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81c05614-2d27-42d3-8f3a-27ac4d5aa6cb"}]: dispatch 2024-04-21T10:14:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:44 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2405927084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81c05614-2d27-42d3-8f3a-27ac4d5aa6cb"}]': finished 2024-04-21T10:14:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:44 smithi170 ceph-mon[31212]: osdmap e22: 4 total, 3 up, 4 in 2024-04-21T10:14:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:44 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:14:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:44 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3381606416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:14:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:44 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2405927084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81c05614-2d27-42d3-8f3a-27ac4d5aa6cb"}]: dispatch 2024-04-21T10:14:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:44 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2405927084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81c05614-2d27-42d3-8f3a-27ac4d5aa6cb"}]': finished 2024-04-21T10:14:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:44 smithi077 ceph-mon[27902]: osdmap e22: 4 total, 3 up, 4 in 2024-04-21T10:14:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:44 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:14:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:44 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3381606416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:14:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:44 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2405927084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81c05614-2d27-42d3-8f3a-27ac4d5aa6cb"}]: dispatch 2024-04-21T10:14:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:44 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2405927084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81c05614-2d27-42d3-8f3a-27ac4d5aa6cb"}]': finished 2024-04-21T10:14:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:44 smithi191 ceph-mon[31636]: osdmap e22: 4 total, 3 up, 4 in 2024-04-21T10:14:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:44 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:14:44.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:44 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3381606416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:14:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:45 smithi170 ceph-mon[31212]: pgmap v87: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:45 smithi077 ceph-mon[27902]: pgmap v87: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:45 smithi191 ceph-mon[31636]: pgmap v87: 1 pgs: 1 active+clean; 128 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:47 smithi077 ceph-mon[27902]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 468 KiB/s wr, 42 op/s 2024-04-21T10:14:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:47 smithi191 ceph-mon[31636]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 468 KiB/s wr, 42 op/s 2024-04-21T10:14:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:47 smithi170 ceph-mon[31212]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 468 KiB/s wr, 42 op/s 2024-04-21T10:14:49.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:49 smithi077 ceph-mon[27902]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 351 KiB/s wr, 32 op/s 2024-04-21T10:14:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:49 smithi191 ceph-mon[31636]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 351 KiB/s wr, 32 op/s 2024-04-21T10:14:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:49 smithi170 ceph-mon[31212]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 351 KiB/s wr, 32 op/s 2024-04-21T10:14:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-21T10:14:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-21T10:14:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-21T10:14:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:51.835 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:51 smithi077 ceph-mon[27902]: Deploying daemon osd.3 on smithi077 2024-04-21T10:14:51.835 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:51 smithi077 ceph-mon[27902]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 292 KiB/s wr, 26 op/s 2024-04-21T10:14:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:51 smithi191 ceph-mon[31636]: Deploying daemon osd.3 on smithi077 2024-04-21T10:14:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:51 smithi191 ceph-mon[31636]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 292 KiB/s wr, 26 op/s 2024-04-21T10:14:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:51 smithi170 ceph-mon[31212]: Deploying daemon osd.3 on smithi077 2024-04-21T10:14:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:51 smithi170 ceph-mon[31212]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 292 KiB/s wr, 26 op/s 2024-04-21T10:14:53.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:53 smithi077 ceph-mon[27902]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 281 KiB/s wr, 25 op/s 2024-04-21T10:14:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:53 smithi191 ceph-mon[31636]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 281 KiB/s wr, 25 op/s 2024-04-21T10:14:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:53 smithi170 ceph-mon[31212]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 281 KiB/s wr, 25 op/s 2024-04-21T10:14:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:55 smithi077 ceph-mon[27902]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 8.8 KiB/s rd, 247 KiB/s wr, 22 op/s 2024-04-21T10:14:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:55 smithi191 ceph-mon[31636]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 8.8 KiB/s rd, 247 KiB/s wr, 22 op/s 2024-04-21T10:14:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:55 smithi170 ceph-mon[31212]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 8.8 KiB/s rd, 247 KiB/s wr, 22 op/s 2024-04-21T10:14:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:57 smithi170 ceph-mon[31212]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 234 KiB/s wr, 21 op/s 2024-04-21T10:14:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:57 smithi077 ceph-mon[27902]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 234 KiB/s wr, 21 op/s 2024-04-21T10:14:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:14:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:57 smithi191 ceph-mon[31636]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 234 KiB/s wr, 21 op/s 2024-04-21T10:14:59.933 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:59 smithi077 ceph-mon[27902]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:59.933 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:59.933 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:59.933 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:59.933 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:59.933 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:14:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:59 smithi191 ceph-mon[31636]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:14:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:00.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.004+0000 7f4f4b7fe700 1 -- 172.21.15.77:0/400251667 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f54062e80 con 0x7f4f400a3bb0 2024-04-21T10:15:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 3 on host 'smithi077' 2024-04-21T10:15:00.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f400a3bb0 msgr2=0x7f4f400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:00.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f400a3bb0 0x7f4f400a6070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c00 tx=0x7f4f50005fb0 comp rx=0 tx=0).stop 2024-04-21T10:15:00.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 msgr2=0x7f4f5419ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:00.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 0x7f4f5419ffb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00ef30 tx=0x7f4f4c00c3a0 comp rx=0 tx=0).stop 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 shutdown_connections 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f400a3bb0 0x7f4f400a6070 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f54103540 0x7f4f5419ffb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f541019a0 0x7f4f5406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 --2- 172.21.15.77:0/400251667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f54102ba0 0x7f4f5419d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 >> 172.21.15.77:0/400251667 conn(0x7f4f540fcf40 msgr2=0x7f4f54105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 shutdown_connections 2024-04-21T10:15:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:00.006+0000 7f4f5c668700 1 -- 172.21.15.77:0/400251667 wait complete. 2024-04-21T10:15:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:59 smithi170 ceph-mon[31212]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:14:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:00.705 DEBUG:teuthology.orchestra.run.smithi077:osd.3> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.3.service 2024-04-21T10:15:00.708 INFO:tasks.cephadm:Deploying osd.4 on smithi170 with /dev/vg_nvme/lv_3... 2024-04-21T10:15:00.708 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-21T10:15:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:15:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:00 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:00 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:00 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:00 smithi170 ceph-mon[31212]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T10:15:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:00 smithi170 ceph-mon[31212]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:00 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:00 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:00 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:00 smithi191 ceph-mon[31636]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T10:15:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:00 smithi191 ceph-mon[31636]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:01.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:00 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:01.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:00 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:01.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:00 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:01.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:00 smithi077 ceph-mon[27902]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T10:15:01.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:00 smithi077 ceph-mon[27902]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:02.271 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:01 smithi170 ceph-mon[31212]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-21T10:15:02.271 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:01 smithi170 ceph-mon[31212]: osdmap e23: 4 total, 3 up, 4 in 2024-04-21T10:15:02.271 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:01 smithi170 ceph-mon[31212]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:15:02.271 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:01 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:02.281 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:01 smithi077 ceph-mon[27902]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-21T10:15:02.281 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:01 smithi077 ceph-mon[27902]: osdmap e23: 4 total, 3 up, 4 in 2024-04-21T10:15:02.281 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:01 smithi077 ceph-mon[27902]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:15:02.281 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:01 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:01 smithi191 ceph-mon[31636]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-21T10:15:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:01 smithi191 ceph-mon[31636]: osdmap e23: 4 total, 3 up, 4 in 2024-04-21T10:15:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:01 smithi191 ceph-mon[31636]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:15:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:01 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:02.635 INFO:journalctl@ceph.osd.3.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-3[48866]: 2024-04-21T10:15:02.443+0000 7ff838d0d700 -1 osd.3 0 waiting for initial osdmap 2024-04-21T10:15:02.635 INFO:journalctl@ceph.osd.3.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-3[48866]: 2024-04-21T10:15:02.449+0000 7ff8302f7700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:15:02.806 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-21T10:15:02.806 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-21T10:15:02.806 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-04-21T10:15:02.806 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-04-21T10:15:02.806 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00883517 s, 1.2 GB/s 2024-04-21T10:15:02.807 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-04-21T10:15:03.125 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:02 smithi170 ceph-mon[31212]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:15:03.125 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:02 smithi170 ceph-mon[31212]: osdmap e24: 4 total, 3 up, 4 in 2024-04-21T10:15:03.125 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:02 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:03.125 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:02 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:03.125 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:02 smithi170 ceph-mon[31212]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' 2024-04-21T10:15:03.125 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:02 smithi170 ceph-mon[31212]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-mon[27902]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-mon[27902]: osdmap e24: 4 total, 3 up, 4 in 2024-04-21T10:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-mon[27902]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' 2024-04-21T10:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:02 smithi077 ceph-mon[27902]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:03.444 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_3 2024-04-21T10:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:02 smithi191 ceph-mon[31636]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:02 smithi191 ceph-mon[31636]: osdmap e24: 4 total, 3 up, 4 in 2024-04-21T10:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:02 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:02 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:02 smithi191 ceph-mon[31636]: from='osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341]' entity='osd.3' 2024-04-21T10:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:02 smithi191 ceph-mon[31636]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T10:15:03.684 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:15:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] boot 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: osdmap e25: 4 total, 4 up, 4 in 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi077 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 8544M 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:04.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:04.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:03 smithi170 ceph-mon[31212]: osdmap e26: 4 total, 4 up, 4 in 2024-04-21T10:15:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:15:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:15:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] boot 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: osdmap e25: 4 total, 4 up, 4 in 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi077 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 8544M 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:03 smithi077 ceph-mon[27902]: osdmap e26: 4 total, 4 up, 4 in 2024-04-21T10:15:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:15:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: osd.3 [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] boot 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: osdmap e25: 4 total, 4 up, 4 in 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi077 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 8544M 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:03 smithi191 ceph-mon[31636]: osdmap e26: 4 total, 4 up, 4 in 2024-04-21T10:15:05.078 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:04 smithi170 ceph-mon[31212]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:05.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:04 smithi077 ceph-mon[27902]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 -- 172.21.15.170:0/1750616253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 msgr2=0x7f24dc109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 --2- 172.21.15.170:0/1750616253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc109df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f24d400b0d0 tx=0x7f24d400b3e0 comp rx=0 tx=0).stop 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 -- 172.21.15.170:0/1750616253 shutdown_connections 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 --2- 172.21.15.170:0/1750616253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc109df0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 --2- 172.21.15.170:0/1750616253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24dc1019a0 0x7f24dc101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 --2- 172.21.15.170:0/1750616253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24dc102ba0 0x7f24dc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 -- 172.21.15.170:0/1750616253 >> 172.21.15.170:0/1750616253 conn(0x7f24dc0fcf40 msgr2=0x7f24dc0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:15:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 -- 172.21.15.170:0/1750616253 shutdown_connections 2024-04-21T10:15:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 -- 172.21.15.170:0/1750616253 wait complete. 2024-04-21T10:15:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.315+0000 7f24e166e700 1 Processor -- start 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 -- start start 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24dc1019a0 0x7f24dc105a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24dc102ba0 0x7f24dc104050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc104590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10d420 con 0x7f24dc102ba0 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10d2a0 con 0x7f24dc103540 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24e166e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10d5a0 con 0x7f24dc1019a0 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc104590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc104590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38080/0 (socket says 172.21.15.170:38080) 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 -- 172.21.15.170:0/2956475452 learned_addr learned my addr 172.21.15.170:0/2956475452 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24daffd700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24dc1019a0 0x7f24dc105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24d27fc700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24dc102ba0 0x7f24dc104050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 -- 172.21.15.170:0/2956475452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24dc1019a0 msgr2=0x7f24dc105a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24dc1019a0 0x7f24dc105a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 -- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24dc102ba0 msgr2=0x7f24dc104050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24dc102ba0 0x7f24dc104050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 -- 172.21.15.170:0/2956475452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc104e40 con 0x7f24dc103540 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.316+0000 7f24db7fe700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc104590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d010 tx=0x7f24d4007a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.317+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4021070 con 0x7f24dc103540 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.317+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24d401db00 con 0x7f24dc103540 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.317+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24dc1a2c50 con 0x7f24dc103540 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.317+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d401bbc0 con 0x7f24dc103540 2024-04-21T10:15:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.317+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24dc1a3100 con 0x7f24dc103540 2024-04-21T10:15:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.318+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24dc069730 con 0x7f24dc103540 2024-04-21T10:15:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.319+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f24d4024070 con 0x7f24dc103540 2024-04-21T10:15:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.319+0000 7f24d8ff9700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24c80a3cc0 0x7f24c80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.319+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f24d400f020 con 0x7f24dc103540 2024-04-21T10:15:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.320+0000 7f24daffd700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24c80a3cc0 0x7f24c80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.320+0000 7f24daffd700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24c80a3cc0 0x7f24c80a6180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24dc102a00 tx=0x7f24cc00a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:15:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.324+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f24d402b020 con 0x7f24dc103540 2024-04-21T10:15:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:04 smithi191 ceph-mon[31636]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:05.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:05.531+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f24dc06ae30 con 0x7f24c80a3cc0 2024-04-21T10:15:06.252 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:05 smithi170 ceph-mon[31212]: osdmap e27: 4 total, 4 up, 4 in 2024-04-21T10:15:06.252 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:05 smithi170 ceph-mon[31212]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:06.252 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:06.252 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:06.252 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:06.252 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:05 smithi170 ceph-mon[31212]: osdmap e28: 4 total, 4 up, 4 in 2024-04-21T10:15:06.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:05 smithi077 ceph-mon[27902]: osdmap e27: 4 total, 4 up, 4 in 2024-04-21T10:15:06.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:05 smithi077 ceph-mon[27902]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:06.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:06.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:06.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:06.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:05 smithi077 ceph-mon[27902]: osdmap e28: 4 total, 4 up, 4 in 2024-04-21T10:15:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:05 smithi191 ceph-mon[31636]: osdmap e27: 4 total, 4 up, 4 in 2024-04-21T10:15:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:05 smithi191 ceph-mon[31636]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:05 smithi191 ceph-mon[31636]: osdmap e28: 4 total, 4 up, 4 in 2024-04-21T10:15:07.110 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:06 smithi170 ceph-mon[31212]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:15:07.110 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:06 smithi170 ceph-mon[31212]: osdmap e29: 4 total, 4 up, 4 in 2024-04-21T10:15:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:06 smithi077 ceph-mon[27902]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:15:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:06 smithi077 ceph-mon[27902]: osdmap e29: 4 total, 4 up, 4 in 2024-04-21T10:15:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:07 smithi191 ceph-mon[31636]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:15:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:07 smithi191 ceph-mon[31636]: osdmap e29: 4 total, 4 up, 4 in 2024-04-21T10:15:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:08 smithi170 ceph-mon[31212]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-21T10:15:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:08 smithi077 ceph-mon[27902]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-21T10:15:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:08 smithi191 ceph-mon[31636]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-21T10:15:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/1236217935' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]: dispatch 2024-04-21T10:15:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]: dispatch 2024-04-21T10:15:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]': finished 2024-04-21T10:15:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: osdmap e30: 5 total, 4 up, 5 in 2024-04-21T10:15:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:15:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:09 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/1258963201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/1236217935' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]: dispatch 2024-04-21T10:15:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]: dispatch 2024-04-21T10:15:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]': finished 2024-04-21T10:15:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: osdmap e30: 5 total, 4 up, 5 in 2024-04-21T10:15:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:15:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:09 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/1258963201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/1236217935' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]: dispatch 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]: dispatch 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cab5e375-2471-41e0-84bb-afee83e3a6a8"}]': finished 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: osdmap e30: 5 total, 4 up, 5 in 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:15:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:09 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/1258963201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:10 smithi170 ceph-mon[31212]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-21T10:15:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:10 smithi170 ceph-mon[31212]: Cluster is now healthy 2024-04-21T10:15:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:10 smithi077 ceph-mon[27902]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-21T10:15:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:10 smithi077 ceph-mon[27902]: Cluster is now healthy 2024-04-21T10:15:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:10 smithi191 ceph-mon[31636]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-21T10:15:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:10 smithi191 ceph-mon[31636]: Cluster is now healthy 2024-04-21T10:15:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:11 smithi170 ceph-mon[31212]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-21T10:15:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:11 smithi077 ceph-mon[27902]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-21T10:15:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:11 smithi191 ceph-mon[31636]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-21T10:15:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:13 smithi170 ceph-mon[31212]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-21T10:15:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:13 smithi077 ceph-mon[27902]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-21T10:15:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:13 smithi191 ceph-mon[31636]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-21T10:15:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:15 smithi170 ceph-mon[31212]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:15:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-21T10:15:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:15 smithi077 ceph-mon[27902]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:15:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-21T10:15:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:15 smithi191 ceph-mon[31636]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:15:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-21T10:15:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:16.996 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:16 smithi077 ceph-mon[27902]: Deploying daemon osd.4 on smithi170 2024-04-21T10:15:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:16 smithi170 ceph-mon[31212]: Deploying daemon osd.4 on smithi170 2024-04-21T10:15:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:16 smithi191 ceph-mon[31636]: Deploying daemon osd.4 on smithi170 2024-04-21T10:15:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:17 smithi077 ceph-mon[27902]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-21T10:15:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:17 smithi170 ceph-mon[31212]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-21T10:15:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:17 smithi191 ceph-mon[31636]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-21T10:15:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:19 smithi170 ceph-mon[31212]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-21T10:15:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:19 smithi077 ceph-mon[27902]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-21T10:15:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:19 smithi191 ceph-mon[31636]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-21T10:15:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:21 smithi170 ceph-mon[31212]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:15:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:21 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:21 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:21 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:21 smithi077 ceph-mon[27902]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:15:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:21 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:21 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:21 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:21 smithi191 ceph-mon[31636]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:15:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:21 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:21 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:21 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:23.846 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:23 smithi170 ceph-mon[31212]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:23 smithi077 ceph-mon[27902]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:23 smithi191 ceph-mon[31636]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:24.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.945+0000 7f24d8ff9700 1 -- 172.21.15.170:0/2956475452 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24dc06ae30 con 0x7f24c80a3cc0 2024-04-21T10:15:24.947 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 4 on host 'smithi170' 2024-04-21T10:15:24.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24c80a3cc0 msgr2=0x7f24c80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:24.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24c80a3cc0 0x7f24c80a6180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24dc102a00 tx=0x7f24cc00a380 comp rx=0 tx=0).stop 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 msgr2=0x7f24dc104590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc104590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d010 tx=0x7f24d4007a90 comp rx=0 tx=0).stop 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 shutdown_connections 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24c80a3cc0 0x7f24c80a6180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24dc103540 0x7f24dc104590 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24dc1019a0 0x7f24dc105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 --2- 172.21.15.170:0/2956475452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24dc102ba0 0x7f24dc104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 >> 172.21.15.170:0/2956475452 conn(0x7f24dc0fcf40 msgr2=0x7f24dc06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 shutdown_connections 2024-04-21T10:15:24.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:15:24.948+0000 7f24e166e700 1 -- 172.21.15.170:0/2956475452 wait complete. 2024-04-21T10:15:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T10:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:25 smithi077 ceph-mon[27902]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T10:15:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T10:15:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:25 smithi191 ceph-mon[31636]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T10:15:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T10:15:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:25 smithi170 ceph-mon[31212]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T10:15:25.655 DEBUG:teuthology.orchestra.run.smithi170:osd.4> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.4.service 2024-04-21T10:15:25.658 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_3... 2024-04-21T10:15:25.658 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-21T10:15:25.906 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:15:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:26 smithi191 ceph-mon[31636]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-21T10:15:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:26 smithi191 ceph-mon[31636]: from='osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:15:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:26 smithi191 ceph-mon[31636]: osdmap e31: 5 total, 4 up, 5 in 2024-04-21T10:15:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:26 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:26 smithi191 ceph-mon[31636]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:15:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:26 smithi191 ceph-mon[31636]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:27.255 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-mon[31212]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-21T10:15:27.255 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-mon[31212]: from='osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:15:27.255 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-mon[31212]: osdmap e31: 5 total, 4 up, 5 in 2024-04-21T10:15:27.255 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:27.255 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-mon[31212]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:15:27.255 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-mon[31212]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:27.256 INFO:journalctl@ceph.osd.4.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-4[42615]: 2024-04-21T10:15:26.921+0000 7f3d13fff700 -1 osd.4 0 waiting for initial osdmap 2024-04-21T10:15:27.256 INFO:journalctl@ceph.osd.4.smithi170.stdout:Apr 21 10:15:26 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-4[42615]: 2024-04-21T10:15:26.927+0000 7f3d0fdf2700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:15:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:26 smithi077 ceph-mon[27902]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-21T10:15:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:26 smithi077 ceph-mon[27902]: from='osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:15:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:26 smithi077 ceph-mon[27902]: osdmap e31: 5 total, 4 up, 5 in 2024-04-21T10:15:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:26 smithi077 ceph-mon[27902]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:15:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:26 smithi077 ceph-mon[27902]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-21T10:15:28.081 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-21T10:15:28.081 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-21T10:15:28.081 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-04-21T10:15:28.081 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-04-21T10:15:28.081 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111759 s, 938 MB/s 2024-04-21T10:15:28.081 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-04-21T10:15:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:27 smithi191 ceph-mon[31636]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:15:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:27 smithi191 ceph-mon[31636]: osdmap e32: 5 total, 4 up, 5 in 2024-04-21T10:15:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:27 smithi170 ceph-mon[31212]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:15:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:27 smithi170 ceph-mon[31212]: osdmap e32: 5 total, 4 up, 5 in 2024-04-21T10:15:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:27 smithi077 ceph-mon[27902]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:15:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:27 smithi077 ceph-mon[27902]: osdmap e32: 5 total, 4 up, 5 in 2024-04-21T10:15:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.728 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2024-04-21T10:15:28.964 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] boot 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: osdmap e33: 5 total, 5 up, 5 in 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi170 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 8544M 2024-04-21T10:15:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] boot 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: osdmap e33: 5 total, 5 up, 5 in 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi170 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 8544M 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: osd.4 [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] boot 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: osdmap e33: 5 total, 5 up, 5 in 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi170 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 8544M 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:29 smithi191 ceph-mon[31636]: osdmap e34: 5 total, 5 up, 5 in 2024-04-21T10:15:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:29 smithi170 ceph-mon[31212]: osdmap e34: 5 total, 5 up, 5 in 2024-04-21T10:15:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:29 smithi077 ceph-mon[27902]: osdmap e34: 5 total, 5 up, 5 in 2024-04-21T10:15:30.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 -- 172.21.15.191:0/1260759157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190103d90 msgr2=0x7f81901041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:30.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 --2- 172.21.15.191:0/1260759157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190103d90 0x7f81901041f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8180009990 tx=0x7f8180009ca0 comp rx=0 tx=0).stop 2024-04-21T10:15:30.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 -- 172.21.15.191:0/1260759157 shutdown_connections 2024-04-21T10:15:30.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 --2- 172.21.15.191:0/1260759157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8190104730 0x7f819010afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:30.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 --2- 172.21.15.191:0/1260759157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 0x7f81901011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:30.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 --2- 172.21.15.191:0/1260759157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190103d90 0x7f81901041f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 -- 172.21.15.191:0/1260759157 >> 172.21.15.191:0/1260759157 conn(0x7f81900fc710 msgr2=0x7f81900feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 -- 172.21.15.191:0/1260759157 shutdown_connections 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.408+0000 7f8198514700 1 -- 172.21.15.191:0/1260759157 wait complete. 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 Processor -- start 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 -- start start 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 0x7f8190198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8190103d90 0x7f81901990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 0x7f81901a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f819010e550 con 0x7f8190100db0 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f819010e3d0 con 0x7f8190103d90 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8198514700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f819010e6d0 con 0x7f8190104730 2024-04-21T10:15:30.410 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 0x7f81901a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 0x7f81901a0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:58746/0 (socket says 172.21.15.191:58746) 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 -- 172.21.15.191:0/1413568242 learned_addr learned my addr 172.21.15.191:0/1413568242 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8195aaf700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8190103d90 0x7f81901990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f81962b0700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 0x7f8190198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 -- 172.21.15.191:0/1413568242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8190103d90 msgr2=0x7f81901990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8190103d90 0x7f81901990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 -- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 msgr2=0x7f8190198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 0x7f8190198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 -- 172.21.15.191:0/1413568242 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81901a07f0 con 0x7f8190104730 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f81962b0700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 0x7f8190198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.409+0000 7f8196ab1700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 0x7f81901a0150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f818800ef60 tx=0x7f818800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.410+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880092e0 con 0x7f8190104730 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.410+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81901a0a80 con 0x7f8190104730 2024-04-21T10:15:30.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.410+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8188004bb0 con 0x7f8190104730 2024-04-21T10:15:30.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.410+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188004280 con 0x7f8190104730 2024-04-21T10:15:30.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.410+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81901a0fc0 con 0x7f8190104730 2024-04-21T10:15:30.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.410+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8190069730 con 0x7f8190104730 2024-04-21T10:15:30.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.411+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f818801b030 con 0x7f8190104730 2024-04-21T10:15:30.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.412+0000 7f81877fe700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f817c0a3c40 0x7f817c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:30.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.412+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f81880ceef0 con 0x7f8190104730 2024-04-21T10:15:30.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.412+0000 7f81962b0700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f817c0a3c40 0x7f817c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:30.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.413+0000 7f81962b0700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f817c0a3c40 0x7f817c0a6100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f819006af90 tx=0x7f818c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:15:30.416 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.417+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8188022020 con 0x7f8190104730 2024-04-21T10:15:30.620 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:30.621+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8190062e80 con 0x7f817c0a3c40 2024-04-21T10:15:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:30 smithi191 ceph-mon[31636]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:30 smithi191 ceph-mon[31636]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:30 smithi170 ceph-mon[31212]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:30 smithi170 ceph-mon[31212]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:30 smithi077 ceph-mon[27902]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:30 smithi077 ceph-mon[27902]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:33 smithi191 ceph-mon[31636]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:33 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/2354028335' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]: dispatch 2024-04-21T10:15:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:33 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]: dispatch 2024-04-21T10:15:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:33 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]': finished 2024-04-21T10:15:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:33 smithi191 ceph-mon[31636]: osdmap e35: 6 total, 5 up, 6 in 2024-04-21T10:15:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:33 smithi170 ceph-mon[31212]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:33 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/2354028335' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]: dispatch 2024-04-21T10:15:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:33 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]: dispatch 2024-04-21T10:15:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:33 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]': finished 2024-04-21T10:15:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:33 smithi170 ceph-mon[31212]: osdmap e35: 6 total, 5 up, 6 in 2024-04-21T10:15:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:33 smithi077 ceph-mon[27902]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:33 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/2354028335' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]: dispatch 2024-04-21T10:15:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:33 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]: dispatch 2024-04-21T10:15:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:33 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a658a938-5f51-414f-a216-bbc79584570d"}]': finished 2024-04-21T10:15:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:33 smithi077 ceph-mon[27902]: osdmap e35: 6 total, 5 up, 6 in 2024-04-21T10:15:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:34 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/4294357119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:35.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:34 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/4294357119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:34 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/4294357119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:35 smithi191 ceph-mon[31636]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:35 smithi170 ceph-mon[31212]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:35 smithi077 ceph-mon[27902]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:37 smithi191 ceph-mon[31636]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:37 smithi170 ceph-mon[31212]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:37 smithi077 ceph-mon[27902]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:39 smithi191 ceph-mon[31636]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:39 smithi170 ceph-mon[31212]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:39 smithi077 ceph-mon[27902]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:41.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:41 smithi191 ceph-mon[31636]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:41.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-21T10:15:41.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:41 smithi170 ceph-mon[31212]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-21T10:15:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:41 smithi077 ceph-mon[27902]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-21T10:15:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:42.799 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:42 smithi191 ceph-mon[31636]: Deploying daemon osd.5 on smithi191 2024-04-21T10:15:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:42 smithi170 ceph-mon[31212]: Deploying daemon osd.5 on smithi191 2024-04-21T10:15:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:42 smithi077 ceph-mon[27902]: Deploying daemon osd.5 on smithi191 2024-04-21T10:15:43.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:43 smithi191 ceph-mon[31636]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:43 smithi170 ceph-mon[31212]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:43 smithi077 ceph-mon[27902]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:45 smithi191 ceph-mon[31636]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:45 smithi170 ceph-mon[31212]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:45 smithi077 ceph-mon[27902]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:47 smithi191 ceph-mon[31636]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:47 smithi170 ceph-mon[31212]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:47 smithi077 ceph-mon[27902]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:49.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:49 smithi191 ceph-mon[31636]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:49 smithi170 ceph-mon[31212]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:49 smithi077 ceph-mon[27902]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:50.189 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2024-04-21T10:15:50.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.189+0000 7f81877fe700 1 -- 172.21.15.191:0/1413568242 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8190062e80 con 0x7f817c0a3c40 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f817c0a3c40 msgr2=0x7f817c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f817c0a3c40 0x7f817c0a6100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f819006af90 tx=0x7f818c009260 comp rx=0 tx=0).stop 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 msgr2=0x7f81901a0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 0x7f81901a0150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f818800ef60 tx=0x7f818800ef90 comp rx=0 tx=0).stop 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 shutdown_connections 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f817c0a3c40 0x7f817c0a6100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8190104730 0x7f81901a0150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8190100db0 0x7f8190198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 --2- 172.21.15.191:0/1413568242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8190103d90 0x7f81901990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 >> 172.21.15.191:0/1413568242 conn(0x7f81900fc710 msgr2=0x7f8190107090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:15:50.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 shutdown_connections 2024-04-21T10:15:50.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:15:50.192+0000 7f8198514700 1 -- 172.21.15.191:0/1413568242 wait complete. 2024-04-21T10:15:50.908 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.5.service 2024-04-21T10:15:50.911 INFO:tasks.cephadm:Deploying osd.6 on smithi077 with /dev/vg_nvme/lv_2... 2024-04-21T10:15:50.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-21T10:15:51.155 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: from='osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T10:15:51.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:51 smithi077 ceph-mon[27902]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: from='osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T10:15:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T10:15:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:51 smithi191 ceph-mon[31636]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: from='osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T10:15:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T10:15:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:51 smithi170 ceph-mon[31212]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-mon[31636]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-21T10:15:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-mon[31636]: osdmap e36: 6 total, 5 up, 6 in 2024-04-21T10:15:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-mon[31636]: from='osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:15:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-mon[31636]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:15:52.719 INFO:journalctl@ceph.osd.5.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-5[43234]: 2024-04-21T10:15:52.560+0000 7f2737271700 -1 osd.5 0 waiting for initial osdmap 2024-04-21T10:15:52.719 INFO:journalctl@ceph.osd.5.smithi191.stdout:Apr 21 10:15:52 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-5[43234]: 2024-04-21T10:15:52.566+0000 7f2733064700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:15:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:52 smithi170 ceph-mon[31212]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-21T10:15:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:52 smithi170 ceph-mon[31212]: osdmap e36: 6 total, 5 up, 6 in 2024-04-21T10:15:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:52 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:52 smithi170 ceph-mon[31212]: from='osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:15:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:52 smithi170 ceph-mon[31212]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:15:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:52 smithi077 ceph-mon[27902]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-21T10:15:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:52 smithi077 ceph-mon[27902]: osdmap e36: 6 total, 5 up, 6 in 2024-04-21T10:15:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:52 smithi077 ceph-mon[27902]: from='osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:15:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:52 smithi077 ceph-mon[27902]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:15:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-21T10:15:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-21T10:15:53.169 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-21T10:15:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-21T10:15:53.169 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114836 s, 913 MB/s 2024-04-21T10:15:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-21T10:15:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:53 smithi077 ceph-mon[27902]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:15:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:53 smithi077 ceph-mon[27902]: osdmap e37: 6 total, 5 up, 6 in 2024-04-21T10:15:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:53 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:53 smithi077 ceph-mon[27902]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:53.893 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:53 smithi191 ceph-mon[31636]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:15:53.893 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:53 smithi191 ceph-mon[31636]: osdmap e37: 6 total, 5 up, 6 in 2024-04-21T10:15:53.893 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:53 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:53.893 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:53 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:53.893 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:53 smithi191 ceph-mon[31636]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:53.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-04-21T10:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:53 smithi170 ceph-mon[31212]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:15:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:53 smithi170 ceph-mon[31212]: osdmap e37: 6 total, 5 up, 6 in 2024-04-21T10:15:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:53 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:53 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:53 smithi170 ceph-mon[31212]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-21T10:15:54.172 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:15:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:15:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:15:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] boot 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: osdmap e38: 6 total, 6 up, 6 in 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] boot 2024-04-21T10:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: osdmap e38: 6 total, 6 up, 6 in 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: osd.5 [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] boot 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: osdmap e38: 6 total, 6 up, 6 in 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:15:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:15:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:15:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 -- 172.21.15.77:0/3127283157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102600 msgr2=0x7f5428109ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 --2- 172.21.15.77:0/3127283157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102600 0x7f5428109ec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f542000b0a0 tx=0x7f542000b3b0 comp rx=0 tx=0).stop 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 -- 172.21.15.77:0/3127283157 shutdown_connections 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 --2- 172.21.15.77:0/3127283157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5428102fb0 0x7f54281033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 --2- 172.21.15.77:0/3127283157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102600 0x7f5428109ec0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 --2- 172.21.15.77:0/3127283157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5428101c60 0x7f54281020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 -- 172.21.15.77:0/3127283157 >> 172.21.15.77:0/3127283157 conn(0x7f54280fc6f0 msgr2=0x7f54280feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 -- 172.21.15.77:0/3127283157 shutdown_connections 2024-04-21T10:15:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.823+0000 7f542d260700 1 -- 172.21.15.77:0/3127283157 wait complete. 2024-04-21T10:15:55.825 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:55 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi191 2024-04-21T10:15:55.825 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:55 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 8544M 2024-04-21T10:15:55.825 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:55 smithi077 ceph-mon[27902]: osdmap e39: 6 total, 6 up, 6 in 2024-04-21T10:15:55.825 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:55 smithi077 ceph-mon[27902]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 Processor -- start 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 -- start start 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5428101c60 0x7f5428197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5428102600 0x7f5428197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 0x7f542819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f542810d4b0 con 0x7f5428102fb0 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f542810d330 con 0x7f5428102600 2024-04-21T10:15:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.824+0000 7f542d260700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f542810d630 con 0x7f5428101c60 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 0x7f542819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 0x7f542819efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54626/0 (socket says 172.21.15.77:54626) 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 -- 172.21.15.77:0/4142227605 learned_addr learned my addr 172.21.15.77:0/4142227605 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f5426d9d700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5428101c60 0x7f5428197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542659c700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5428102600 0x7f5428197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 -- 172.21.15.77:0/4142227605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5428101c60 msgr2=0x7f5428197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5428101c60 0x7f5428197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 -- 172.21.15.77:0/4142227605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5428102600 msgr2=0x7f5428197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5428102600 0x7f5428197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 -- 172.21.15.77:0/4142227605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5428100b50 con 0x7f5428102fb0 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542759e700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 0x7f542819efc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f542000cf00 tx=0x7f542000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:15:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420021070 con 0x7f5428102fb0 2024-04-21T10:15:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5428100de0 con 0x7f5428102fb0 2024-04-21T10:15:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f542001d900 con 0x7f5428102fb0 2024-04-21T10:15:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281013f0 con 0x7f5428102fb0 2024-04-21T10:15:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.825+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420005350 con 0x7f5428102fb0 2024-04-21T10:15:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.827+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5428069730 con 0x7f5428102fb0 2024-04-21T10:15:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.828+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5420024070 con 0x7f5428102fb0 2024-04-21T10:15:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.829+0000 7f540ffff700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f54100a3c40 0x7f54100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:15:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.829+0000 7f5426d9d700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f54100a3c40 0x7f54100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:15:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.829+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7f542000f020 con 0x7f5428102fb0 2024-04-21T10:15:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.829+0000 7f5426d9d700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f54100a3c40 0x7f54100a6100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f542806af70 tx=0x7f541c00a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:15:55.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:55.833+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f542002b020 con 0x7f5428102fb0 2024-04-21T10:15:55.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:55 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi191 2024-04-21T10:15:55.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:55 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 8544M 2024-04-21T10:15:55.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:55 smithi191 ceph-mon[31636]: osdmap e39: 6 total, 6 up, 6 in 2024-04-21T10:15:55.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:55 smithi191 ceph-mon[31636]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:55.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:55 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi191 2024-04-21T10:15:55.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:55 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 8544M 2024-04-21T10:15:55.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:55 smithi170 ceph-mon[31212]: osdmap e39: 6 total, 6 up, 6 in 2024-04-21T10:15:55.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:55 smithi170 ceph-mon[31212]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:56.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:15:56.041+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5428062e80 con 0x7f54100a3c40 2024-04-21T10:15:56.832 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:56 smithi077 ceph-mon[27902]: osdmap e40: 6 total, 6 up, 6 in 2024-04-21T10:15:56.832 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:56 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:56.832 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:56 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:56.832 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:56 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:56.887 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:56 smithi191 ceph-mon[31636]: osdmap e40: 6 total, 6 up, 6 in 2024-04-21T10:15:56.887 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:56 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:56.887 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:56 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:56.887 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:56 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:56.970 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:56 smithi170 ceph-mon[31212]: osdmap e40: 6 total, 6 up, 6 in 2024-04-21T10:15:56.970 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:56 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:15:56.970 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:56 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:15:56.970 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:56 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:15:57.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:57 smithi077 ceph-mon[27902]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:57.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:57 smithi077 ceph-mon[27902]: osdmap e41: 6 total, 6 up, 6 in 2024-04-21T10:15:57.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:57 smithi077 ceph-mon[27902]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:57 smithi191 ceph-mon[31636]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:57 smithi191 ceph-mon[31636]: osdmap e41: 6 total, 6 up, 6 in 2024-04-21T10:15:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:57 smithi191 ceph-mon[31636]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:57 smithi170 ceph-mon[31212]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:15:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:57 smithi170 ceph-mon[31212]: osdmap e41: 6 total, 6 up, 6 in 2024-04-21T10:15:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:57 smithi170 ceph-mon[31212]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:58 smithi077 ceph-mon[27902]: osdmap e42: 6 total, 6 up, 6 in 2024-04-21T10:15:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:58 smithi191 ceph-mon[31636]: osdmap e42: 6 total, 6 up, 6 in 2024-04-21T10:15:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:58 smithi170 ceph-mon[31212]: osdmap e42: 6 total, 6 up, 6 in 2024-04-21T10:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:59 smithi077 ceph-mon[27902]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:59 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/487846868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d435ee1-0bb9-4cf2-b897-3a5297c8ed62"}]: dispatch 2024-04-21T10:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:59 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/487846868' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d435ee1-0bb9-4cf2-b897-3a5297c8ed62"}]': finished 2024-04-21T10:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:59 smithi077 ceph-mon[27902]: osdmap e43: 7 total, 6 up, 7 in 2024-04-21T10:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:15:59 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/774125005' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:59 smithi191 ceph-mon[31636]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:59 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/487846868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d435ee1-0bb9-4cf2-b897-3a5297c8ed62"}]: dispatch 2024-04-21T10:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:59 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/487846868' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d435ee1-0bb9-4cf2-b897-3a5297c8ed62"}]': finished 2024-04-21T10:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:59 smithi191 ceph-mon[31636]: osdmap e43: 7 total, 6 up, 7 in 2024-04-21T10:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:15:59 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/774125005' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:59 smithi170 ceph-mon[31212]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:59 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/487846868' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d435ee1-0bb9-4cf2-b897-3a5297c8ed62"}]: dispatch 2024-04-21T10:16:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:59 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/487846868' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d435ee1-0bb9-4cf2-b897-3a5297c8ed62"}]': finished 2024-04-21T10:16:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:59 smithi170 ceph-mon[31212]: osdmap e43: 7 total, 6 up, 7 in 2024-04-21T10:16:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:15:59 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/774125005' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:01 smithi191 ceph-mon[31636]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-04-21T10:16:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:01 smithi170 ceph-mon[31212]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-04-21T10:16:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:01 smithi077 ceph-mon[27902]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-04-21T10:16:03.958 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:03 smithi077 ceph-mon[27902]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-04-21T10:16:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:03 smithi191 ceph-mon[31636]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-04-21T10:16:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:03 smithi170 ceph-mon[31212]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-04-21T10:16:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:05 smithi191 ceph-mon[31636]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:16:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:05 smithi170 ceph-mon[31212]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:16:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:05 smithi077 ceph-mon[27902]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:16:06.950 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:06 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-21T10:16:06.950 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:06 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:06 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-21T10:16:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:06 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:06 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-21T10:16:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:06 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:07 smithi191 ceph-mon[31636]: Deploying daemon osd.6 on smithi077 2024-04-21T10:16:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:07 smithi191 ceph-mon[31636]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T10:16:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:07 smithi170 ceph-mon[31212]: Deploying daemon osd.6 on smithi077 2024-04-21T10:16:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:07 smithi170 ceph-mon[31212]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T10:16:08.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:07 smithi077 ceph-mon[27902]: Deploying daemon osd.6 on smithi077 2024-04-21T10:16:08.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:07 smithi077 ceph-mon[27902]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T10:16:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:09 smithi191 ceph-mon[31636]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:16:10.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:09 smithi077 ceph-mon[27902]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:16:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:09 smithi170 ceph-mon[31212]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:16:11.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:11 smithi077 ceph-mon[27902]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:16:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:11 smithi191 ceph-mon[31636]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:16:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:11 smithi170 ceph-mon[31212]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:16:12.780 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:12 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:12.781 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:12 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:12.781 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:12 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:12 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:12 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:12 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:12 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:12 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:12 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:13 smithi191 ceph-mon[31636]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:13 smithi170 ceph-mon[31212]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:14.086 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:13 smithi077 ceph-mon[27902]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:15 smithi191 ceph-mon[31636]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.033 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:15 smithi077 ceph-mon[27902]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:16.033 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.033 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.033 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:16.033 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:16.033 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:15 smithi170 ceph-mon[31212]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.197 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 6 on host 'smithi077' 2024-04-21T10:16:16.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.197+0000 7f540ffff700 1 -- 172.21.15.77:0/4142227605 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5428062e80 con 0x7f54100a3c40 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f54100a3c40 msgr2=0x7f54100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f54100a3c40 0x7f54100a6100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f542806af70 tx=0x7f541c00a3b0 comp rx=0 tx=0).stop 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 msgr2=0x7f542819efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 0x7f542819efc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f542000cf00 tx=0x7f542000cf30 comp rx=0 tx=0).stop 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 shutdown_connections 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f54100a3c40 0x7f54100a6100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5428102fb0 0x7f542819efc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5428101c60 0x7f5428197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 --2- 172.21.15.77:0/4142227605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5428102600 0x7f5428197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 >> 172.21.15.77:0/4142227605 conn(0x7f54280fc6f0 msgr2=0x7f5428105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:16:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 shutdown_connections 2024-04-21T10:16:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:16:16.199+0000 7f542d260700 1 -- 172.21.15.77:0/4142227605 wait complete. 2024-04-21T10:16:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:16 smithi191 ceph-mon[31636]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T10:16:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:16.970 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:16 smithi077 ceph-mon[27902]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T10:16:16.970 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.970 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:16.970 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:16.998 DEBUG:teuthology.orchestra.run.smithi077:osd.6> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.6.service 2024-04-21T10:16:17.001 INFO:tasks.cephadm:Deploying osd.7 on smithi170 with /dev/vg_nvme/lv_2... 2024-04-21T10:16:17.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-21T10:16:17.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:16 smithi170 ceph-mon[31212]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T10:16:17.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:17.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:17.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:17.247 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:16:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-mon[27902]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-mon[27902]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-21T10:16:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-mon[27902]: osdmap e44: 7 total, 6 up, 7 in 2024-04-21T10:16:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-mon[27902]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:16:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:17.886 INFO:journalctl@ceph.osd.6.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-6[55578]: 2024-04-21T10:16:17.721+0000 7f5a64974700 -1 osd.6 0 waiting for initial osdmap 2024-04-21T10:16:17.886 INFO:journalctl@ceph.osd.6.smithi077.stdout:Apr 21 10:16:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-6[55578]: 2024-04-21T10:16:17.730+0000 7f5a60767700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:16:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:17 smithi191 ceph-mon[31636]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:17 smithi191 ceph-mon[31636]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-21T10:16:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:17 smithi191 ceph-mon[31636]: osdmap e44: 7 total, 6 up, 7 in 2024-04-21T10:16:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:17 smithi191 ceph-mon[31636]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:16:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:17 smithi170 ceph-mon[31212]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:17 smithi170 ceph-mon[31212]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-21T10:16:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:17 smithi170 ceph-mon[31212]: osdmap e44: 7 total, 6 up, 7 in 2024-04-21T10:16:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:17 smithi170 ceph-mon[31212]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:16:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:18.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:18 smithi170 ceph-mon[31212]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:16:18.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:18 smithi170 ceph-mon[31212]: osdmap e45: 7 total, 6 up, 7 in 2024-04-21T10:16:18.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:18 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:18.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:18 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:18 smithi077 ceph-mon[27902]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:16:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:18 smithi077 ceph-mon[27902]: osdmap e45: 7 total, 6 up, 7 in 2024-04-21T10:16:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:18 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:18 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:18 smithi191 ceph-mon[31636]: from='osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:16:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:18 smithi191 ceph-mon[31636]: osdmap e45: 7 total, 6 up, 7 in 2024-04-21T10:16:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:18 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:18 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:19.353 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-21T10:16:19.353 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-21T10:16:19.353 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-04-21T10:16:19.353 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-04-21T10:16:19.354 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00854429 s, 1.2 GB/s 2024-04-21T10:16:19.354 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-04-21T10:16:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:19 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:16:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:19 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:16:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:19 smithi077 ceph-mon[27902]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:19 smithi077 ceph-mon[27902]: osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] boot 2024-04-21T10:16:19.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:19 smithi077 ceph-mon[27902]: osdmap e46: 7 total, 7 up, 7 in 2024-04-21T10:16:19.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:19 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:16:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:19 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:16:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:19 smithi170 ceph-mon[31212]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:19 smithi170 ceph-mon[31212]: osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] boot 2024-04-21T10:16:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:19 smithi170 ceph-mon[31212]: osdmap e46: 7 total, 7 up, 7 in 2024-04-21T10:16:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:20.066 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_2 2024-04-21T10:16:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:19 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:16:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:19 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:16:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:19 smithi191 ceph-mon[31636]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-21T10:16:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:19 smithi191 ceph-mon[31636]: osd.6 [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] boot 2024-04-21T10:16:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:19 smithi191 ceph-mon[31636]: osdmap e46: 7 total, 7 up, 7 in 2024-04-21T10:16:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:16:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:16:20.752 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: osdmap e47: 7 total, 7 up, 7 in 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:20.753 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: osdmap e47: 7 total, 7 up, 7 in 2024-04-21T10:16:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: osdmap e47: 7 total, 7 up, 7 in 2024-04-21T10:16:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 -- 172.21.15.170:0/1109240517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec102a90 msgr2=0x7f85ec102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/1109240517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec102a90 0x7f85ec102eb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0099c0 tx=0x7f85dc009cd0 comp rx=0 tx=0).stop 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 -- 172.21.15.170:0/1109240517 shutdown_connections 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/1109240517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec102a90 0x7f85ec102eb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/1109240517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec104630 0x7f85ec10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/1109240517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85ec103c90 0x7f85ec1040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.980+0000 7f85f1d7f700 1 -- 172.21.15.170:0/1109240517 >> 172.21.15.170:0/1109240517 conn(0x7f85ec0fe030 msgr2=0x7f85ec100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:16:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 -- 172.21.15.170:0/1109240517 shutdown_connections 2024-04-21T10:16:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 -- 172.21.15.170:0/1109240517 wait complete. 2024-04-21T10:16:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 Processor -- start 2024-04-21T10:16:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 -- start start 2024-04-21T10:16:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85ec102a90 0x7f85ec198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec103c90 0x7f85ec1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 0x7f85ec1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10e570 con 0x7f85ec103c90 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10e3f0 con 0x7f85ec104630 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.981+0000 7f85f1d7f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10e6f0 con 0x7f85ec102a90 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 0x7f85ec1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 0x7f85ec1a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54626/0 (socket says 172.21.15.170:54626) 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 -- 172.21.15.170:0/3615325250 learned_addr learned my addr 172.21.15.170:0/3615325250 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85eb7fe700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85ec102a90 0x7f85ec198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:21.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85eaffd700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec103c90 0x7f85ec1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:21.984 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:21 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi077 2024-04-21T10:16:21.984 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 5696M 2024-04-21T10:16:21.984 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:21 smithi170 ceph-mon[31212]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:21.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 -- 172.21.15.170:0/3615325250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85ec102a90 msgr2=0x7f85ec198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:21.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85ec102a90 0x7f85ec198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:21.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 -- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec103c90 msgr2=0x7f85ec1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:21.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec103c90 0x7f85ec1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:21.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 -- 172.21.15.170:0/3615325250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec074c70 con 0x7f85ec104630 2024-04-21T10:16:21.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85eaffd700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec103c90 0x7f85ec1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85ebfff700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 0x7f85ec1a0260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85e4007ee0 tx=0x7f85e400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e400dbd0 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85e400dd70 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec074f60 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4005990 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.982+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec0754c0 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.983+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ec069730 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.985+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f85e401a020 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.985+0000 7f85e8ff9700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f85d40a3cc0 0x7f85d40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.985+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f85e40cf480 con 0x7f85ec104630 2024-04-21T10:16:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.986+0000 7f85eb7fe700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f85d40a3cc0 0x7f85d40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.986+0000 7f85eb7fe700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f85d40a3cc0 0x7f85d40a6180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009f50 tx=0x7f85dc00b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:16:21.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:21.990+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f85e4010070 con 0x7f85ec104630 2024-04-21T10:16:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:21 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi077 2024-04-21T10:16:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 5696M 2024-04-21T10:16:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:21 smithi077 ceph-mon[27902]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:22.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:22.195+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f85ec109ae0 con 0x7f85d40a3cc0 2024-04-21T10:16:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:21 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi077 2024-04-21T10:16:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 5696M 2024-04-21T10:16:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:21 smithi191 ceph-mon[31636]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:16:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:16:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:16:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:16:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:16:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:16:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:24.002 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:23 smithi170 ceph-mon[31212]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:16:24.003 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:23 smithi170 ceph-mon[31212]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:23 smithi077 ceph-mon[27902]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:16:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:23 smithi077 ceph-mon[27902]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:23 smithi191 ceph-mon[31636]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:16:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:23 smithi191 ceph-mon[31636]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:26.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:26.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/1612495418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]: dispatch 2024-04-21T10:16:26.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]: dispatch 2024-04-21T10:16:26.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]': finished 2024-04-21T10:16:26.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: osdmap e48: 8 total, 7 up, 8 in 2024-04-21T10:16:26.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:26.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:25 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/3125219261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/1612495418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]: dispatch 2024-04-21T10:16:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]: dispatch 2024-04-21T10:16:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]': finished 2024-04-21T10:16:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: osdmap e48: 8 total, 7 up, 8 in 2024-04-21T10:16:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:25 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/3125219261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/1612495418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]: dispatch 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]: dispatch 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70"}]': finished 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: osdmap e48: 8 total, 7 up, 8 in 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:25 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/3125219261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:27 smithi170 ceph-mon[31212]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:27 smithi077 ceph-mon[27902]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:27 smithi191 ceph-mon[31636]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:29 smithi170 ceph-mon[31212]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:29 smithi077 ceph-mon[27902]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:29 smithi191 ceph-mon[31636]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:32.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:31 smithi170 ceph-mon[31212]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:31 smithi077 ceph-mon[27902]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:31 smithi191 ceph-mon[31636]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:33.008 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:32 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-21T10:16:33.008 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:32 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:32 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-21T10:16:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:32 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:32 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-21T10:16:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:32 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:33 smithi170 ceph-mon[31212]: Deploying daemon osd.7 on smithi170 2024-04-21T10:16:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:33 smithi170 ceph-mon[31212]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:33 smithi077 ceph-mon[27902]: Deploying daemon osd.7 on smithi170 2024-04-21T10:16:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:33 smithi077 ceph-mon[27902]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:33 smithi191 ceph-mon[31636]: Deploying daemon osd.7 on smithi170 2024-04-21T10:16:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:33 smithi191 ceph-mon[31636]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:35 smithi170 ceph-mon[31212]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:35 smithi077 ceph-mon[27902]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:35 smithi191 ceph-mon[31636]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:37 smithi170 ceph-mon[31212]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:37 smithi077 ceph-mon[27902]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:37 smithi191 ceph-mon[31636]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:39 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:39 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:39 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:39 smithi170 ceph-mon[31212]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:39 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:39 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:39 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:39 smithi077 ceph-mon[27902]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:39 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:39 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:39 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:39 smithi191 ceph-mon[31636]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:41.912 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:41 smithi170 ceph-mon[31212]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:41.912 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:41.912 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:41.912 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:41.912 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:41.912 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:41.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.960+0000 7f85e8ff9700 1 -- 172.21.15.170:0/3615325250 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f85ec109ae0 con 0x7f85d40a3cc0 2024-04-21T10:16:41.960 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 7 on host 'smithi170' 2024-04-21T10:16:41.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.962+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f85d40a3cc0 msgr2=0x7f85d40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.962+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f85d40a3cc0 0x7f85d40a6180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009f50 tx=0x7f85dc00b540 comp rx=0 tx=0).stop 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 msgr2=0x7f85ec1a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 0x7f85ec1a0260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85e4007ee0 tx=0x7f85e400d3b0 comp rx=0 tx=0).stop 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 shutdown_connections 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f85d40a3cc0 0x7f85d40a6180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85ec104630 0x7f85ec1a0260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85ec102a90 0x7f85ec198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 --2- 172.21.15.170:0/3615325250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ec103c90 0x7f85ec1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 >> 172.21.15.170:0/3615325250 conn(0x7f85ec0fe030 msgr2=0x7f85ec1070d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 shutdown_connections 2024-04-21T10:16:41.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:16:41.963+0000 7f85f1d7f700 1 -- 172.21.15.170:0/3615325250 wait complete. 2024-04-21T10:16:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:41 smithi191 ceph-mon[31636]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:41 smithi077 ceph-mon[27902]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.639 DEBUG:teuthology.orchestra.run.smithi170:osd.7> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.7.service 2024-04-21T10:16:42.642 INFO:tasks.cephadm:Deploying osd.8 on smithi191 with /dev/vg_nvme/lv_2... 2024-04-21T10:16:42.642 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-21T10:16:42.901 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:16:42.940 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:42 smithi170 ceph-mon[31212]: from='osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T10:16:42.941 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:42 smithi170 ceph-mon[31212]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T10:16:42.941 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:42.941 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.941 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:42 smithi191 ceph-mon[31636]: from='osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T10:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:42 smithi191 ceph-mon[31636]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T10:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:42 smithi077 ceph-mon[27902]: from='osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T10:16:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:42 smithi077 ceph-mon[27902]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T10:16:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:16:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:43 smithi170 ceph-mon[31212]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:43 smithi170 ceph-mon[31212]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-21T10:16:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:43 smithi170 ceph-mon[31212]: osdmap e49: 8 total, 7 up, 8 in 2024-04-21T10:16:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:43 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:43 smithi170 ceph-mon[31212]: from='osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:16:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:43 smithi170 ceph-mon[31212]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:16:43.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:43 smithi191 ceph-mon[31636]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:43 smithi191 ceph-mon[31636]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-21T10:16:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:43 smithi191 ceph-mon[31636]: osdmap e49: 8 total, 7 up, 8 in 2024-04-21T10:16:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:43 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:43 smithi191 ceph-mon[31636]: from='osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:16:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:43 smithi191 ceph-mon[31636]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:16:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:43 smithi077 ceph-mon[27902]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:43 smithi077 ceph-mon[27902]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-21T10:16:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:43 smithi077 ceph-mon[27902]: osdmap e49: 8 total, 7 up, 8 in 2024-04-21T10:16:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:43 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:43 smithi077 ceph-mon[27902]: from='osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:16:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:43 smithi077 ceph-mon[27902]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:16:44.557 INFO:journalctl@ceph.osd.7.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-7[49589]: 2024-04-21T10:16:44.176+0000 7f2b93d2e700 -1 osd.7 0 waiting for initial osdmap 2024-04-21T10:16:44.557 INFO:journalctl@ceph.osd.7.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-7[49589]: 2024-04-21T10:16:44.186+0000 7f2b8b318700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:16:44.863 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-21T10:16:44.863 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-21T10:16:44.863 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-04-21T10:16:44.864 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-04-21T10:16:44.864 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128503 s, 816 MB/s 2024-04-21T10:16:44.864 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-04-21T10:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:44 smithi191 ceph-mon[31636]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:44 smithi191 ceph-mon[31636]: osdmap e50: 8 total, 7 up, 8 in 2024-04-21T10:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:44 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:44 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:44 smithi191 ceph-mon[31636]: from='osd.7 ' entity='osd.7' 2024-04-21T10:16:44.976 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-mon[31212]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:16:44.976 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-mon[31212]: osdmap e50: 8 total, 7 up, 8 in 2024-04-21T10:16:44.976 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:44.976 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:44.976 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:44 smithi170 ceph-mon[31212]: from='osd.7 ' entity='osd.7' 2024-04-21T10:16:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:44 smithi077 ceph-mon[27902]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:16:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:44 smithi077 ceph-mon[27902]: osdmap e50: 8 total, 7 up, 8 in 2024-04-21T10:16:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:44 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:44 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:44 smithi077 ceph-mon[27902]: from='osd.7 ' entity='osd.7' 2024-04-21T10:16:45.513 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2024-04-21T10:16:45.755 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] boot 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: osdmap e51: 8 total, 8 up, 8 in 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:45.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:45 smithi191 ceph-mon[31636]: osdmap e52: 8 total, 8 up, 8 in 2024-04-21T10:16:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:16:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:16:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] boot 2024-04-21T10:16:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: osdmap e51: 8 total, 8 up, 8 in 2024-04-21T10:16:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:45 smithi170 ceph-mon[31212]: osdmap e52: 8 total, 8 up, 8 in 2024-04-21T10:16:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:16:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:16:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-04-21T10:16:46.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: osd.7 [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] boot 2024-04-21T10:16:46.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: osdmap e51: 8 total, 8 up, 8 in 2024-04-21T10:16:46.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:16:46.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:45 smithi077 ceph-mon[27902]: osdmap e52: 8 total, 8 up, 8 in 2024-04-21T10:16:46.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi170 2024-04-21T10:16:46.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 5696M 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:46 smithi191 ceph-mon[31636]: osdmap e53: 8 total, 8 up, 8 in 2024-04-21T10:16:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi170 2024-04-21T10:16:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 5696M 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:46 smithi170 ceph-mon[31212]: osdmap e53: 8 total, 8 up, 8 in 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi170 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:16:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 5696M 2024-04-21T10:16:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:16:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:16:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:46 smithi077 ceph-mon[27902]: osdmap e53: 8 total, 8 up, 8 in 2024-04-21T10:16:47.421 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.421+0000 7f9a1908b700 1 -- 172.21.15.191:0/1145311909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 msgr2=0x7f9a14104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:47.421 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.421+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1145311909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14104100 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009990 tx=0x7f9a08009ca0 comp rx=0 tx=0).stop 2024-04-21T10:16:47.421 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 -- 172.21.15.191:0/1145311909 shutdown_connections 2024-04-21T10:16:47.421 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1145311909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 0x7f9a1410aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:47.421 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1145311909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a14102aa0 0x7f9a14102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:47.422 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1145311909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14104100 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:47.422 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 -- 172.21.15.191:0/1145311909 >> 172.21.15.191:0/1145311909 conn(0x7f9a140fe040 msgr2=0x7f9a14100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:16:47.422 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 -- 172.21.15.191:0/1145311909 shutdown_connections 2024-04-21T10:16:47.422 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 -- 172.21.15.191:0/1145311909 wait complete. 2024-04-21T10:16:47.422 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.422+0000 7f9a1908b700 1 Processor -- start 2024-04-21T10:16:47.424 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 -- start start 2024-04-21T10:16:47.424 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a14102aa0 0x7f9a14076790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:47.424 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 0x7f9a14075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1410e510 con 0x7f9a14102aa0 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1410e390 con 0x7f9a14104640 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1908b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1410e690 con 0x7f9a14103ca0 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14074e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:45920/0 (socket says 172.21.15.191:45920) 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 -- 172.21.15.191:0/1733478144 learned_addr learned my addr 172.21.15.191:0/1733478144 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a12d9d700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a14102aa0 0x7f9a14076790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1359e700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 0x7f9a14075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 -- 172.21.15.191:0/1733478144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 msgr2=0x7f9a14075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 0x7f9a14075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 -- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a14102aa0 msgr2=0x7f9a14076790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a14102aa0 0x7f9a14076790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:16:47.425 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 -- 172.21.15.191:0/1733478144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a14075c40 con 0x7f9a14103ca0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1359e700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 0x7f9a14075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.423+0000 7f9a1259c700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14074e30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006010 tx=0x7f9a080047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.424+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08027070 con 0x7f9a14103ca0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.424+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a141a2d00 con 0x7f9a14103ca0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.424+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a08004100 con 0x7f9a14103ca0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.424+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08022d70 con 0x7f9a14103ca0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.424+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a141a31b0 con 0x7f9a14103ca0 2024-04-21T10:16:47.426 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.425+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a14069730 con 0x7f9a14103ca0 2024-04-21T10:16:47.427 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.426+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9a0802a070 con 0x7f9a14103ca0 2024-04-21T10:16:47.427 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.426+0000 7f99fbfff700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f99fc0a3c40 0x7f99fc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:16:47.427 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.426+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f9a080d0730 con 0x7f9a14103ca0 2024-04-21T10:16:47.427 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.426+0000 7f9a12d9d700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f99fc0a3c40 0x7f99fc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:16:47.427 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.427+0000 7f9a12d9d700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f99fc0a3c40 0x7f99fc0a6100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a14103b00 tx=0x7f9a0400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:16:47.430 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.431+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9a0805eff0 con 0x7f9a14103ca0 2024-04-21T10:16:47.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:16:47.639+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9a14062e80 con 0x7f99fc0a3c40 2024-04-21T10:16:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:47 smithi191 ceph-mon[31636]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:16:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:16:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:47 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:47 smithi191 ceph-mon[31636]: osdmap e54: 8 total, 8 up, 8 in 2024-04-21T10:16:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:47 smithi170 ceph-mon[31212]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:16:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:16:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:47 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:47 smithi170 ceph-mon[31212]: osdmap e54: 8 total, 8 up, 8 in 2024-04-21T10:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:47 smithi077 ceph-mon[27902]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:47 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:47 smithi077 ceph-mon[27902]: osdmap e54: 8 total, 8 up, 8 in 2024-04-21T10:16:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:48 smithi191 ceph-mon[31636]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:16:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:48 smithi191 ceph-mon[31636]: osdmap e55: 8 total, 8 up, 8 in 2024-04-21T10:16:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:48 smithi170 ceph-mon[31212]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:16:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:48 smithi170 ceph-mon[31212]: osdmap e55: 8 total, 8 up, 8 in 2024-04-21T10:16:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:48 smithi077 ceph-mon[27902]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:16:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:48 smithi077 ceph-mon[27902]: osdmap e55: 8 total, 8 up, 8 in 2024-04-21T10:16:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:49 smithi191 ceph-mon[31636]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:49 smithi170 ceph-mon[31212]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:49 smithi077 ceph-mon[27902]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:50 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/3641649104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]: dispatch 2024-04-21T10:16:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:50 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]: dispatch 2024-04-21T10:16:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:50 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]': finished 2024-04-21T10:16:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:50 smithi170 ceph-mon[31212]: osdmap e56: 9 total, 8 up, 9 in 2024-04-21T10:16:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:16:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:50 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/3641649104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]: dispatch 2024-04-21T10:16:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:50 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]: dispatch 2024-04-21T10:16:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:50 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]': finished 2024-04-21T10:16:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:50 smithi077 ceph-mon[27902]: osdmap e56: 9 total, 8 up, 9 in 2024-04-21T10:16:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:16:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:50 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/3641649104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]: dispatch 2024-04-21T10:16:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:50 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]: dispatch 2024-04-21T10:16:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:50 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e52a3152-3a86-4b87-b14d-dae9955549a4"}]': finished 2024-04-21T10:16:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:50 smithi191 ceph-mon[31636]: osdmap e56: 9 total, 8 up, 9 in 2024-04-21T10:16:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:16:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:51 smithi170 ceph-mon[31212]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:51 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/4005067135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:51 smithi077 ceph-mon[27902]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:51 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/4005067135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:51 smithi191 ceph-mon[31636]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:51 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/4005067135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:16:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:53 smithi170 ceph-mon[31212]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:54.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:53 smithi191 ceph-mon[31636]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:53 smithi077 ceph-mon[27902]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:55 smithi170 ceph-mon[31212]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:55 smithi077 ceph-mon[27902]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:55 smithi191 ceph-mon[31636]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:58.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:57 smithi170 ceph-mon[31212]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:57 smithi077 ceph-mon[27902]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:57 smithi191 ceph-mon[31636]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:16:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:58 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-21T10:16:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:58 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:58 smithi191 ceph-mon[31636]: Deploying daemon osd.8 on smithi191 2024-04-21T10:16:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:58 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-21T10:16:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:58 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:58 smithi170 ceph-mon[31212]: Deploying daemon osd.8 on smithi191 2024-04-21T10:16:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:58 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-21T10:16:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:58 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:16:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:58 smithi077 ceph-mon[27902]: Deploying daemon osd.8 on smithi191 2024-04-21T10:17:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:16:59 smithi170 ceph-mon[31212]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:16:59 smithi077 ceph-mon[27902]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:00.147 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:16:59 smithi191 ceph-mon[31636]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:01 smithi170 ceph-mon[31212]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:01 smithi077 ceph-mon[27902]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:01 smithi191 ceph-mon[31636]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:03 smithi170 ceph-mon[31212]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:04.079 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:03 smithi191 ceph-mon[31636]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:04.079 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:04.079 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:04.079 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:03 smithi077 ceph-mon[27902]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:05 smithi170 ceph-mon[31212]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:05 smithi077 ceph-mon[27902]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:05 smithi191 ceph-mon[31636]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:07.451 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.450+0000 7f99fbfff700 1 -- 172.21.15.191:0/1733478144 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a14062e80 con 0x7f99fc0a3c40 2024-04-21T10:17:07.451 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 8 on host 'smithi191' 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f99fc0a3c40 msgr2=0x7f99fc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f99fc0a3c40 0x7f99fc0a6100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a14103b00 tx=0x7f9a0400b410 comp rx=0 tx=0).stop 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 msgr2=0x7f9a14074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14074e30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006010 tx=0x7f9a080047b0 comp rx=0 tx=0).stop 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 shutdown_connections 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f99fc0a3c40 0x7f99fc0a6100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a14104640 0x7f9a14075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a14102aa0 0x7f9a14076790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 --2- 172.21.15.191:0/1733478144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a14103ca0 0x7f9a14074e30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.452+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 >> 172.21.15.191:0/1733478144 conn(0x7f9a140fe040 msgr2=0x7f9a141070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.453+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 shutdown_connections 2024-04-21T10:17:07.453 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:17:07.453+0000 7f9a1908b700 1 -- 172.21.15.191:0/1733478144 wait complete. 2024-04-21T10:17:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:07 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:07 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:08.043 DEBUG:teuthology.orchestra.run.smithi191:osd.8> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.8.service 2024-04-21T10:17:08.046 INFO:tasks.cephadm:Deploying osd.9 on smithi077 with /dev/vg_nvme/lv_1... 2024-04-21T10:17:08.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-21T10:17:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:07 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:08.281 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:17:08.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:08 smithi077 ceph-mon[27902]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-21T10:17:08.660 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:08 smithi077 ceph-mon[27902]: osdmap e57: 9 total, 8 up, 9 in 2024-04-21T10:17:08.660 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:08 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:08.660 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:08 smithi077 ceph-mon[27902]: from='osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:17:08.660 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:08 smithi077 ceph-mon[27902]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:17:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-mon[31636]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-21T10:17:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-mon[31636]: osdmap e57: 9 total, 8 up, 9 in 2024-04-21T10:17:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-mon[31636]: from='osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:17:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-mon[31636]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:17:08.938 INFO:journalctl@ceph.osd.8.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-8[49783]: 2024-04-21T10:17:08.622+0000 7f58f8c47700 -1 osd.8 0 waiting for initial osdmap 2024-04-21T10:17:08.938 INFO:journalctl@ceph.osd.8.smithi191.stdout:Apr 21 10:17:08 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-8[49783]: 2024-04-21T10:17:08.631+0000 7f58f4a3a700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:17:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:08 smithi170 ceph-mon[31212]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-21T10:17:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:08 smithi170 ceph-mon[31212]: osdmap e57: 9 total, 8 up, 9 in 2024-04-21T10:17:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:08 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:08 smithi170 ceph-mon[31212]: from='osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:17:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:08 smithi170 ceph-mon[31212]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:17:09.770 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:09 smithi077 ceph-mon[27902]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:17:09.770 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:09 smithi077 ceph-mon[27902]: osdmap e58: 9 total, 8 up, 9 in 2024-04-21T10:17:09.770 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:09.770 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:09.770 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:09 smithi077 ceph-mon[27902]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:09 smithi191 ceph-mon[31636]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:17:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:09 smithi191 ceph-mon[31636]: osdmap e58: 9 total, 8 up, 9 in 2024-04-21T10:17:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:09 smithi191 ceph-mon[31636]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:09 smithi170 ceph-mon[31212]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:17:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:09 smithi170 ceph-mon[31212]: osdmap e58: 9 total, 8 up, 9 in 2024-04-21T10:17:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:09 smithi170 ceph-mon[31212]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-21T10:17:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-21T10:17:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-21T10:17:10.350 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-21T10:17:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-21T10:17:10.350 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113347 s, 925 MB/s 2024-04-21T10:17:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-21T10:17:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:10 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:17:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:10 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:17:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:10 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:10 smithi191 ceph-mon[31636]: osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] boot 2024-04-21T10:17:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:10 smithi191 ceph-mon[31636]: osdmap e59: 9 total, 9 up, 9 in 2024-04-21T10:17:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:10 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:10 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:10 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:10 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:10 smithi077 ceph-mon[27902]: osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] boot 2024-04-21T10:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:10 smithi077 ceph-mon[27902]: osdmap e59: 9 total, 9 up, 9 in 2024-04-21T10:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:10 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:11.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_1 2024-04-21T10:17:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:10 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:17:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:10 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:17:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:10 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:10 smithi170 ceph-mon[31212]: osd.8 [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] boot 2024-04-21T10:17:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:10 smithi170 ceph-mon[31212]: osdmap e59: 9 total, 9 up, 9 in 2024-04-21T10:17:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:10 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:17:11.274 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:17:11.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: osdmap e60: 9 total, 9 up, 9 in 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:11.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: osdmap e60: 9 total, 9 up, 9 in 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: osdmap e60: 9 total, 9 up, 9 in 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:12.715 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:12 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi191 2024-04-21T10:17:12.715 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 5696M 2024-04-21T10:17:12.715 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:12 smithi077 ceph-mon[27902]: osdmap e61: 9 total, 9 up, 9 in 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- 172.21.15.77:0/1574471787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30103540 msgr2=0x7fef30109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- 172.21.15.77:0/1574471787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30103540 0x7fef30109df0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef2800b0d0 tx=0x7fef2800b3e0 comp rx=0 tx=0).stop 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- 172.21.15.77:0/1574471787 shutdown_connections 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- 172.21.15.77:0/1574471787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef301019a0 0x7fef30101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- 172.21.15.77:0/1574471787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30103540 0x7fef30109df0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- 172.21.15.77:0/1574471787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef30102ba0 0x7fef30103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- 172.21.15.77:0/1574471787 >> 172.21.15.77:0/1574471787 conn(0x7fef300fcf40 msgr2=0x7fef300ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- 172.21.15.77:0/1574471787 shutdown_connections 2024-04-21T10:17:12.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- 172.21.15.77:0/1574471787 wait complete. 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 Processor -- start 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- start start 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef301019a0 0x7fef30198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 0x7fef30199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30103540 0x7fef301a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef3010d490 con 0x7fef30102ba0 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fef3010d310 con 0x7fef30103540 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.935+0000 7fef36f48700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef3010d610 con 0x7fef301019a0 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 0x7fef30199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 0x7fef30199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58616/0 (socket says 172.21.15.77:58616) 2024-04-21T10:17:12.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 -- 172.21.15.77:0/316795517 learned_addr learned my addr 172.21.15.77:0/316795517 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef354e5700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30103540 0x7fef301a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef34ce4700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef301019a0 0x7fef30198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 -- 172.21.15.77:0/316795517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef301019a0 msgr2=0x7fef30198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef301019a0 0x7fef30198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 -- 172.21.15.77:0/316795517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30103540 msgr2=0x7fef301a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30103540 0x7fef301a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 -- 172.21.15.77:0/316795517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef301a0820 con 0x7fef30102ba0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2ffff700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 0x7fef30199100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00b560 tx=0x7fef1c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c015020 con 0x7fef30102ba0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef1c011ce0 con 0x7fef30102ba0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c010d20 con 0x7fef30102ba0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301a0b10 con 0x7fef30102ba0 2024-04-21T10:17:12.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.936+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301a1000 con 0x7fef30102ba0 2024-04-21T10:17:12.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.937+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30069760 con 0x7fef30102ba0 2024-04-21T10:17:12.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.938+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fef1c018020 con 0x7fef30102ba0 2024-04-21T10:17:12.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.939+0000 7fef2dffb700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fef200a3c40 0x7fef200a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:12.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.939+0000 7fef34ce4700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fef200a3c40 0x7fef200a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:12.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.939+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5829+0+0 (secure 0 0 0) 0x7fef1c0cf800 con 0x7fef30102ba0 2024-04-21T10:17:12.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.939+0000 7fef34ce4700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fef200a3c40 0x7fef200a6100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fef30102a00 tx=0x7fef24005d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:17:12.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:12.943+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef30069760 con 0x7fef30102ba0 2024-04-21T10:17:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:12 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi191 2024-04-21T10:17:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 5696M 2024-04-21T10:17:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:12 smithi191 ceph-mon[31636]: osdmap e61: 9 total, 9 up, 9 in 2024-04-21T10:17:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:12 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi191 2024-04-21T10:17:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 5696M 2024-04-21T10:17:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:12 smithi170 ceph-mon[31212]: osdmap e61: 9 total, 9 up, 9 in 2024-04-21T10:17:13.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:13.148+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fef300ff0b0 con 0x7fef200a3c40 2024-04-21T10:17:13.919 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:13 smithi077 ceph-mon[27902]: osdmap e62: 9 total, 9 up, 9 in 2024-04-21T10:17:13.919 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:13 smithi077 ceph-mon[27902]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:13.919 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:17:13.919 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:17:13.919 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:13 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:13 smithi191 ceph-mon[31636]: osdmap e62: 9 total, 9 up, 9 in 2024-04-21T10:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:13 smithi191 ceph-mon[31636]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:13 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:13 smithi170 ceph-mon[31212]: osdmap e62: 9 total, 9 up, 9 in 2024-04-21T10:17:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:13 smithi170 ceph-mon[31212]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:17:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:17:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:13 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:14.815 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:14 smithi077 ceph-mon[27902]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:17:14.815 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:14 smithi077 ceph-mon[27902]: osdmap e63: 9 total, 9 up, 9 in 2024-04-21T10:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:14 smithi191 ceph-mon[31636]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:14 smithi191 ceph-mon[31636]: osdmap e63: 9 total, 9 up, 9 in 2024-04-21T10:17:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:14 smithi170 ceph-mon[31212]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:17:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:14 smithi170 ceph-mon[31212]: osdmap e63: 9 total, 9 up, 9 in 2024-04-21T10:17:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:15 smithi191 ceph-mon[31636]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:15 smithi170 ceph-mon[31212]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:15 smithi077 ceph-mon[27902]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:16 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/9873394' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e43bf362-1689-4a04-8dc2-eba9baedc9bd"}]: dispatch 2024-04-21T10:17:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:16 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/9873394' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e43bf362-1689-4a04-8dc2-eba9baedc9bd"}]': finished 2024-04-21T10:17:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:16 smithi191 ceph-mon[31636]: osdmap e64: 10 total, 9 up, 10 in 2024-04-21T10:17:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:16 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2632852476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:17:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:16 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/9873394' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e43bf362-1689-4a04-8dc2-eba9baedc9bd"}]: dispatch 2024-04-21T10:17:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:16 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/9873394' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e43bf362-1689-4a04-8dc2-eba9baedc9bd"}]': finished 2024-04-21T10:17:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:16 smithi170 ceph-mon[31212]: osdmap e64: 10 total, 9 up, 10 in 2024-04-21T10:17:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:16 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2632852476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:17:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:16 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/9873394' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e43bf362-1689-4a04-8dc2-eba9baedc9bd"}]: dispatch 2024-04-21T10:17:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:16 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/9873394' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e43bf362-1689-4a04-8dc2-eba9baedc9bd"}]': finished 2024-04-21T10:17:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:16 smithi077 ceph-mon[27902]: osdmap e64: 10 total, 9 up, 10 in 2024-04-21T10:17:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:16 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2632852476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:17:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:17 smithi191 ceph-mon[31636]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-21T10:17:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:17 smithi170 ceph-mon[31212]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-21T10:17:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:17 smithi077 ceph-mon[27902]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-21T10:17:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:19 smithi077 ceph-mon[27902]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T10:17:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:19 smithi191 ceph-mon[31636]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T10:17:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:19 smithi170 ceph-mon[31212]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T10:17:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:21 smithi191 ceph-mon[31636]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:17:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:21 smithi170 ceph-mon[31212]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:17:22.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:21 smithi077 ceph-mon[27902]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:17:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:23 smithi191 ceph-mon[31636]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T10:17:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:23 smithi170 ceph-mon[31212]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T10:17:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:23 smithi077 ceph-mon[27902]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T10:17:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:24 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-21T10:17:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:24 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:24 smithi191 ceph-mon[31636]: Deploying daemon osd.9 on smithi077 2024-04-21T10:17:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:24 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-21T10:17:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:24 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:24 smithi170 ceph-mon[31212]: Deploying daemon osd.9 on smithi077 2024-04-21T10:17:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:24 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-21T10:17:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:24 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:24 smithi077 ceph-mon[27902]: Deploying daemon osd.9 on smithi077 2024-04-21T10:17:25.772 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:25 smithi077 ceph-mon[27902]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:17:25.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:25 smithi170 ceph-mon[31212]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:17:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:25 smithi191 ceph-mon[31636]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:17:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:27 smithi191 ceph-mon[31636]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:27.979 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:27 smithi077 ceph-mon[27902]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:27 smithi170 ceph-mon[31212]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:29 smithi077 ceph-mon[27902]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:29 smithi191 ceph-mon[31636]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:29 smithi170 ceph-mon[31212]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:30 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:30 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:30 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:32.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:31 smithi077 ceph-mon[27902]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:31 smithi191 ceph-mon[31636]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:31 smithi170 ceph-mon[31212]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:33.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.862+0000 7fef2dffb700 1 -- 172.21.15.77:0/316795517 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fef300ff0b0 con 0x7fef200a3c40 2024-04-21T10:17:33.862 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 9 on host 'smithi077' 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fef200a3c40 msgr2=0x7fef200a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fef200a3c40 0x7fef200a6100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fef30102a00 tx=0x7fef24005d70 comp rx=0 tx=0).stop 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 msgr2=0x7fef30199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 0x7fef30199100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00b560 tx=0x7fef1c00b870 comp rx=0 tx=0).stop 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 shutdown_connections 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fef200a3c40 0x7fef200a6100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30103540 0x7fef301a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef301019a0 0x7fef30198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 --2- 172.21.15.77:0/316795517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef30102ba0 0x7fef30199100 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 >> 172.21.15.77:0/316795517 conn(0x7fef300fcf40 msgr2=0x7fef300fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 shutdown_connections 2024-04-21T10:17:33.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:17:33.864+0000 7fef36f48700 1 -- 172.21.15.77:0/316795517 wait complete. 2024-04-21T10:17:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T10:17:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:33 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:33 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:33 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:34.584 DEBUG:teuthology.orchestra.run.smithi077:osd.9> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.9.service 2024-04-21T10:17:34.587 INFO:tasks.cephadm:Deploying osd.10 on smithi170 with /dev/vg_nvme/lv_1... 2024-04-21T10:17:34.587 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-21T10:17:34.834 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:17:35.086 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:34 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:35.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:34 smithi077 ceph-mon[27902]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-21T10:17:35.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:34 smithi077 ceph-mon[27902]: osdmap e65: 10 total, 9 up, 10 in 2024-04-21T10:17:35.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:34 smithi077 ceph-mon[27902]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:17:35.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:34 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:35.191 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:34 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:35.191 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:34 smithi170 ceph-mon[31212]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-21T10:17:35.191 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:34 smithi170 ceph-mon[31212]: osdmap e65: 10 total, 9 up, 10 in 2024-04-21T10:17:35.191 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:34 smithi170 ceph-mon[31212]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:17:35.191 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:34 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:34 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:34 smithi191 ceph-mon[31636]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-21T10:17:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:34 smithi191 ceph-mon[31636]: osdmap e65: 10 total, 9 up, 10 in 2024-04-21T10:17:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:34 smithi191 ceph-mon[31636]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-21T10:17:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:34 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:35.851 INFO:journalctl@ceph.osd.9.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-9[62645]: 2024-04-21T10:17:35.558+0000 7fdd726a1700 -1 osd.9 0 waiting for initial osdmap 2024-04-21T10:17:35.851 INFO:journalctl@ceph.osd.9.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-9[62645]: 2024-04-21T10:17:35.575+0000 7fdd6a48c700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:17:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-mon[27902]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-mon[27902]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:17:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-mon[27902]: osdmap e66: 10 total, 9 up, 10 in 2024-04-21T10:17:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:35 smithi077 ceph-mon[27902]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' 2024-04-21T10:17:36.185 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:35 smithi170 ceph-mon[31212]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:36.185 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:35 smithi170 ceph-mon[31212]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:17:36.185 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:35 smithi170 ceph-mon[31212]: osdmap e66: 10 total, 9 up, 10 in 2024-04-21T10:17:36.186 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:35 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:36.186 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:35 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:36.186 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:35 smithi170 ceph-mon[31212]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' 2024-04-21T10:17:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:35 smithi191 ceph-mon[31636]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:35 smithi191 ceph-mon[31636]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-21T10:17:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:35 smithi191 ceph-mon[31636]: osdmap e66: 10 total, 9 up, 10 in 2024-04-21T10:17:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:35 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:35 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:35 smithi191 ceph-mon[31636]: from='osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344]' entity='osd.9' 2024-04-21T10:17:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-21T10:17:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-21T10:17:36.760 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-04-21T10:17:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-04-21T10:17:36.760 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00853137 s, 1.2 GB/s 2024-04-21T10:17:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-04-21T10:17:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:17:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:17:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] boot 2024-04-21T10:17:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: osdmap e67: 10 total, 10 up, 10 in 2024-04-21T10:17:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:36 smithi077 ceph-mon[27902]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:17:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:17:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] boot 2024-04-21T10:17:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: osdmap e67: 10 total, 10 up, 10 in 2024-04-21T10:17:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:36 smithi191 ceph-mon[31636]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:17:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:17:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: osd.9 [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] boot 2024-04-21T10:17:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: osdmap e67: 10 total, 10 up, 10 in 2024-04-21T10:17:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:17:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:36 smithi170 ceph-mon[31212]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T10:17:37.416 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_1 2024-04-21T10:17:37.664 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.b/config 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: osdmap e68: 10 total, 10 up, 10 in 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi077 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 4272M 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:38 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: osdmap e68: 10 total, 10 up, 10 in 2024-04-21T10:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi077 2024-04-21T10:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 4272M 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:38 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: osdmap e68: 10 total, 10 up, 10 in 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi077 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 4272M 2024-04-21T10:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:17:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:38 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:39.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 -- 172.21.15.170:0/3682502706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43841019a0 msgr2=0x7f4384101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 --2- 172.21.15.170:0/3682502706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43841019a0 0x7f4384101dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43800099c0 tx=0x7f4380009cd0 comp rx=0 tx=0).stop 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 -- 172.21.15.170:0/3682502706 shutdown_connections 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 --2- 172.21.15.170:0/3682502706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43841019a0 0x7f4384101dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 --2- 172.21.15.170:0/3682502706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4384103540 0x7f4384109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 --2- 172.21.15.170:0/3682502706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 0x7f4384103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 -- 172.21.15.170:0/3682502706 >> 172.21.15.170:0/3682502706 conn(0x7f43840fcf60 msgr2=0x7f43840ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 -- 172.21.15.170:0/3682502706 shutdown_connections 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.359+0000 7f438be66700 1 -- 172.21.15.170:0/3682502706 wait complete. 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 Processor -- start 2024-04-21T10:17:39.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 -- start start 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43841019a0 0x7f43841058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 0x7f4384103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 0x7f43841044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f438410d430 con 0x7f4384102ba0 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f438410d2b0 con 0x7f4384103540 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438be66700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f438410d5b0 con 0x7f43841019a0 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438a403700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 0x7f43841044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438a403700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 0x7f43841044c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47604/0 (socket says 172.21.15.170:47604) 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f438a403700 1 -- 172.21.15.170:0/2876668552 learned_addr learned my addr 172.21.15.170:0/2876668552 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f4389c02700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43841019a0 0x7f43841058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.360+0000 7f4389401700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 0x7f4384103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438a403700 1 -- 172.21.15.170:0/2876668552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43841019a0 msgr2=0x7f43841058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438a403700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43841019a0 0x7f43841058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:39.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438a403700 1 -- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 msgr2=0x7f4384103f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438a403700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 0x7f4384103f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438a403700 1 -- 172.21.15.170:0/2876668552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4384104d90 con 0x7f4384103540 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f4389401700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 0x7f4384103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438a403700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 0x7f43841044c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f437c007ee0 tx=0x7f437c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c00dbd0 con 0x7f4384103540 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43841a2da0 con 0x7f4384103540 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f437c00dd70 con 0x7f4384103540 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c005990 con 0x7f4384103540 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.361+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43841a31f0 con 0x7f4384103540 2024-04-21T10:17:39.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.362+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4384069760 con 0x7f4384103540 2024-04-21T10:17:39.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.363+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f437c01a020 con 0x7f4384103540 2024-04-21T10:17:39.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.364+0000 7f437affd700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f43700a3c40 0x7f43700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:17:39.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.364+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f437c0cf970 con 0x7f4384103540 2024-04-21T10:17:39.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.364+0000 7f4389c02700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f43700a3c40 0x7f43700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:17:39.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.365+0000 7f4389c02700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f43700a3c40 0x7f43700a6100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43800038c0 tx=0x7f438000b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:17:39.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.367+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4384069760 con 0x7f4384103540 2024-04-21T10:17:39.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:39.578+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f43840ff180 con 0x7f43700a3c40 2024-04-21T10:17:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:39 smithi077 ceph-mon[27902]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:39 smithi191 ceph-mon[31636]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:39 smithi170 ceph-mon[31212]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:40 smithi170 ceph-mon[31212]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:17:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:40 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:17:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:40 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:17:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:40 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:40 smithi077 ceph-mon[27902]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:17:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:40 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:17:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:40 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:17:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:40 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:40 smithi191 ceph-mon[31636]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:17:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:40 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:17:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:40 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:17:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:40 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:41 smithi077 ceph-mon[27902]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:41 smithi191 ceph-mon[31636]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:41 smithi170 ceph-mon[31212]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:42 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/2349593104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]: dispatch 2024-04-21T10:17:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:42 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]: dispatch 2024-04-21T10:17:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:42 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]': finished 2024-04-21T10:17:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:42 smithi077 ceph-mon[27902]: osdmap e69: 11 total, 10 up, 11 in 2024-04-21T10:17:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:42 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/2349593104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]: dispatch 2024-04-21T10:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:42 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]: dispatch 2024-04-21T10:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:42 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]': finished 2024-04-21T10:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:42 smithi191 ceph-mon[31636]: osdmap e69: 11 total, 10 up, 11 in 2024-04-21T10:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:17:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:42 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/2349593104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]: dispatch 2024-04-21T10:17:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:42 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]: dispatch 2024-04-21T10:17:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:42 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97e854a6-998b-40c5-82c6-fa7ceb23400e"}]': finished 2024-04-21T10:17:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:42 smithi170 ceph-mon[31212]: osdmap e69: 11 total, 10 up, 11 in 2024-04-21T10:17:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:17:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:43 smithi077 ceph-mon[27902]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:43 smithi077 ceph-mon[27902]: from='client.? 172.21.15.170:0/2347412490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:17:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:43 smithi191 ceph-mon[31636]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:43 smithi191 ceph-mon[31636]: from='client.? 172.21.15.170:0/2347412490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:17:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:43 smithi170 ceph-mon[31212]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:43 smithi170 ceph-mon[31212]: from='client.? 172.21.15.170:0/2347412490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:17:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:45 smithi191 ceph-mon[31636]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:45 smithi170 ceph-mon[31212]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:45 smithi077 ceph-mon[27902]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:47 smithi170 ceph-mon[31212]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:47 smithi191 ceph-mon[31636]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:47 smithi077 ceph-mon[27902]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:49.964 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:49 smithi170 ceph-mon[31212]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:49 smithi191 ceph-mon[31636]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:49 smithi077 ceph-mon[27902]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:50.884 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-21T10:17:50.884 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:50 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-21T10:17:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:50 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-21T10:17:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:50 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:17:51.994 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:51 smithi170 ceph-mon[31212]: Deploying daemon osd.10 on smithi170 2024-04-21T10:17:51.994 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:51 smithi170 ceph-mon[31212]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:51 smithi077 ceph-mon[27902]: Deploying daemon osd.10 on smithi170 2024-04-21T10:17:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:51 smithi077 ceph-mon[27902]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:51 smithi191 ceph-mon[31636]: Deploying daemon osd.10 on smithi170 2024-04-21T10:17:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:51 smithi191 ceph-mon[31636]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:53 smithi170 ceph-mon[31212]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:53 smithi077 ceph-mon[27902]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:53 smithi191 ceph-mon[31636]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:55 smithi170 ceph-mon[31212]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:55 smithi077 ceph-mon[27902]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:55 smithi191 ceph-mon[31636]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:56 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:56 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:56 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:57.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:56 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:57.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:56 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:57.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:56 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:56 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:56 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:17:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:56 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:17:57.963 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:57 smithi170 ceph-mon[31212]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:57 smithi077 ceph-mon[27902]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:57 smithi191 ceph-mon[31636]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:17:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.698+0000 7f437affd700 1 -- 172.21.15.170:0/2876668552 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f43840ff180 con 0x7f43700a3c40 2024-04-21T10:17:59.698 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 10 on host 'smithi170' 2024-04-21T10:17:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f43700a3c40 msgr2=0x7f43700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f43700a3c40 0x7f43700a6100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43800038c0 tx=0x7f438000b540 comp rx=0 tx=0).stop 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 msgr2=0x7f43841044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 0x7f43841044c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f437c007ee0 tx=0x7f437c00d3b0 comp rx=0 tx=0).stop 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 shutdown_connections 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f43700a3c40 0x7f43700a6100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4384103540 0x7f43841044c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43841019a0 0x7f43841058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 --2- 172.21.15.170:0/2876668552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384102ba0 0x7f4384103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 >> 172.21.15.170:0/2876668552 conn(0x7f43840fcf60 msgr2=0x7f43840fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:17:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 shutdown_connections 2024-04-21T10:17:59.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-21T10:17:59.701+0000 7f438be66700 1 -- 172.21.15.170:0/2876668552 wait complete. 2024-04-21T10:18:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T10:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:17:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T10:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T10:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:17:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T10:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:17:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:00.420 DEBUG:teuthology.orchestra.run.smithi170:osd.10> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.10.service 2024-04-21T10:18:00.422 INFO:tasks.cephadm:Deploying osd.11 on smithi191 with /dev/vg_nvme/lv_1... 2024-04-21T10:18:00.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-21T10:18:00.669 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:18:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:01 smithi191 ceph-mon[31636]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:01 smithi191 ceph-mon[31636]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-21T10:18:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:01 smithi191 ceph-mon[31636]: from='osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:18:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:01 smithi191 ceph-mon[31636]: osdmap e70: 11 total, 10 up, 11 in 2024-04-21T10:18:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:01 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:01 smithi191 ceph-mon[31636]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:18:02.006 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-mon[31212]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:02.006 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-mon[31212]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-21T10:18:02.006 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-mon[31212]: from='osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:18:02.007 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-mon[31212]: osdmap e70: 11 total, 10 up, 11 in 2024-04-21T10:18:02.007 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:02.007 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-mon[31212]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:18:02.007 INFO:journalctl@ceph.osd.10.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-10[56642]: 2024-04-21T10:18:01.678+0000 7fec30395700 -1 osd.10 0 waiting for initial osdmap 2024-04-21T10:18:02.007 INFO:journalctl@ceph.osd.10.smithi170.stdout:Apr 21 10:18:01 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-10[56642]: 2024-04-21T10:18:01.692+0000 7fec2c188700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:18:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:01 smithi077 ceph-mon[27902]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:01 smithi077 ceph-mon[27902]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-21T10:18:02.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:01 smithi077 ceph-mon[27902]: from='osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:18:02.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:01 smithi077 ceph-mon[27902]: osdmap e70: 11 total, 10 up, 11 in 2024-04-21T10:18:02.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:01 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:02.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:01 smithi077 ceph-mon[27902]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-04-21T10:18:02.815 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-21T10:18:02.815 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-21T10:18:02.815 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-04-21T10:18:02.815 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-04-21T10:18:02.815 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127731 s, 821 MB/s 2024-04-21T10:18:02.816 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-04-21T10:18:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:02 smithi191 ceph-mon[31636]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:18:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:02 smithi191 ceph-mon[31636]: osdmap e71: 11 total, 10 up, 11 in 2024-04-21T10:18:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:02 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:02 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:02 smithi170 ceph-mon[31212]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:18:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:02 smithi170 ceph-mon[31212]: osdmap e71: 11 total, 10 up, 11 in 2024-04-21T10:18:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:02 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:02 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:02 smithi077 ceph-mon[27902]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-04-21T10:18:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:02 smithi077 ceph-mon[27902]: osdmap e71: 11 total, 10 up, 11 in 2024-04-21T10:18:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:02 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:02 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_1 2024-04-21T10:18:03.705 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:18:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:18:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:18:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] boot 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: osdmap e72: 11 total, 11 up, 11 in 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] boot 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: osdmap e72: 11 total, 11 up, 11 in 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:18:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:18:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-21T10:18:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: osd.10 [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] boot 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: osdmap e72: 11 total, 11 up, 11 in 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:04.878 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:04 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi170 2024-04-21T10:18:04.878 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:04 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 4272M 2024-04-21T10:18:04.878 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:04 smithi191 ceph-mon[31636]: osdmap e73: 11 total, 11 up, 11 in 2024-04-21T10:18:05.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:04 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi170 2024-04-21T10:18:05.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:04 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 4272M 2024-04-21T10:18:05.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:04 smithi077 ceph-mon[27902]: osdmap e73: 11 total, 11 up, 11 in 2024-04-21T10:18:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:04 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi170 2024-04-21T10:18:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:04 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 4272M 2024-04-21T10:18:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:04 smithi170 ceph-mon[31212]: osdmap e73: 11 total, 11 up, 11 in 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 -- 172.21.15.191:0/2594885370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 msgr2=0x7f6108109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 --2- 172.21.15.191:0/2594885370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108109df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f610000b0a0 tx=0x7f610000b3b0 comp rx=0 tx=0).stop 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 -- 172.21.15.191:0/2594885370 shutdown_connections 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 --2- 172.21.15.191:0/2594885370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108109df0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 --2- 172.21.15.191:0/2594885370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61081019a0 0x7f6108101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 --2- 172.21.15.191:0/2594885370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6108102ba0 0x7f6108103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 -- 172.21.15.191:0/2594885370 >> 172.21.15.191:0/2594885370 conn(0x7f61080fcf40 msgr2=0x7f61080ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 -- 172.21.15.191:0/2594885370 shutdown_connections 2024-04-21T10:18:05.409 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.408+0000 7f610cb0b700 1 -- 172.21.15.191:0/2594885370 wait complete. 2024-04-21T10:18:05.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 Processor -- start 2024-04-21T10:18:05.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 -- start start 2024-04-21T10:18:05.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61081019a0 0x7f6108105a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:05.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6108102ba0 0x7f6108104120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:05.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108104660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:05.411 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f610810d440 con 0x7f6108102ba0 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.409+0000 7f610cb0b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f610810d2c0 con 0x7f61081019a0 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f610cb0b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f610810d5c0 con 0x7f6108103540 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108104660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f610659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61081019a0 0x7f6108105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f610659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61081019a0 0x7f6108105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.191:45478/0 (socket says 172.21.15.191:45478) 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108104660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:36446/0 (socket says 172.21.15.191:36446) 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f610659c700 1 -- 172.21.15.191:0/3798449231 learned_addr learned my addr 172.21.15.191:0/3798449231 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6105d9b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6108102ba0 0x7f6108104120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 -- 172.21.15.191:0/3798449231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61081019a0 msgr2=0x7f6108105a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61081019a0 0x7f6108105a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 -- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6108102ba0 msgr2=0x7f6108104120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6108102ba0 0x7f6108104120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:05.412 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 -- 172.21.15.191:0/3798449231 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6108104f30 con 0x7f6108103540 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f6106d9d700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108104660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f610000b070 tx=0x7f6100004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100021070 con 0x7f6108103540 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6100007b80 con 0x7f6108103540 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61081a2ce0 con 0x7f6108103540 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000052a0 con 0x7f6108103540 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.410+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61081a31a0 con 0x7f6108103540 2024-04-21T10:18:05.413 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.411+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6108069730 con 0x7f6108103540 2024-04-21T10:18:05.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.413+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6100024070 con 0x7f6108103540 2024-04-21T10:18:05.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.413+0000 7f60f77fe700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f00a3c40 0x7f60f00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:05.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.413+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6723+0+0 (secure 0 0 0) 0x7f610000f020 con 0x7f6108103540 2024-04-21T10:18:05.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.413+0000 7f610659c700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f00a3c40 0x7f60f00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:05.414 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.414+0000 7f610659c700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f00a3c40 0x7f60f00a6100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f60f8007cf0 tx=0x7f60f8007480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:05.417 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.417+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f610002b020 con 0x7f6108103540 2024-04-21T10:18:05.626 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:05.625+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f61081a3430 con 0x7f60f00a3c40 2024-04-21T10:18:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:05 smithi191 ceph-mon[31636]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:05 smithi191 ceph-mon[31636]: osdmap e74: 11 total, 11 up, 11 in 2024-04-21T10:18:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:18:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:18:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:05 smithi170 ceph-mon[31212]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:05 smithi170 ceph-mon[31212]: osdmap e74: 11 total, 11 up, 11 in 2024-04-21T10:18:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:18:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:18:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:05 smithi077 ceph-mon[27902]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:05 smithi077 ceph-mon[27902]: osdmap e74: 11 total, 11 up, 11 in 2024-04-21T10:18:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T10:18:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T10:18:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:06 smithi191 ceph-mon[31636]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:18:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:06 smithi191 ceph-mon[31636]: osdmap e75: 11 total, 11 up, 11 in 2024-04-21T10:18:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:06 smithi170 ceph-mon[31212]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:18:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:06 smithi170 ceph-mon[31212]: osdmap e75: 11 total, 11 up, 11 in 2024-04-21T10:18:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:06 smithi077 ceph-mon[27902]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:18:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:06 smithi077 ceph-mon[27902]: osdmap e75: 11 total, 11 up, 11 in 2024-04-21T10:18:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:07 smithi191 ceph-mon[31636]: pgmap v241: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:18:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:07 smithi191 ceph-mon[31636]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-21T10:18:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:07 smithi191 ceph-mon[31636]: osdmap e76: 11 total, 11 up, 11 in 2024-04-21T10:18:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:07 smithi170 ceph-mon[31212]: pgmap v241: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:18:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:07 smithi170 ceph-mon[31212]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-21T10:18:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:07 smithi170 ceph-mon[31212]: osdmap e76: 11 total, 11 up, 11 in 2024-04-21T10:18:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:07 smithi077 ceph-mon[27902]: pgmap v241: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:18:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:07 smithi077 ceph-mon[27902]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-21T10:18:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:07 smithi077 ceph-mon[27902]: osdmap e76: 11 total, 11 up, 11 in 2024-04-21T10:18:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:08 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/1884163604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]: dispatch 2024-04-21T10:18:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:08 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]: dispatch 2024-04-21T10:18:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:08 smithi191 ceph-mon[31636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]': finished 2024-04-21T10:18:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:08 smithi191 ceph-mon[31636]: osdmap e77: 12 total, 11 up, 12 in 2024-04-21T10:18:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:08 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:08 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/1884163604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]: dispatch 2024-04-21T10:18:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:08 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]: dispatch 2024-04-21T10:18:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:08 smithi170 ceph-mon[31212]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]': finished 2024-04-21T10:18:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:08 smithi170 ceph-mon[31212]: osdmap e77: 12 total, 11 up, 12 in 2024-04-21T10:18:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:08 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:08 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/1884163604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]: dispatch 2024-04-21T10:18:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:08 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]: dispatch 2024-04-21T10:18:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:08 smithi077 ceph-mon[27902]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a84fddf-e9d1-45a2-a805-b1a92bd9a379"}]': finished 2024-04-21T10:18:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:08 smithi077 ceph-mon[27902]: osdmap e77: 12 total, 11 up, 12 in 2024-04-21T10:18:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:08 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:09 smithi191 ceph-mon[31636]: pgmap v244: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:18:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:09 smithi191 ceph-mon[31636]: from='client.? 172.21.15.191:0/2518307418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:18:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:09 smithi170 ceph-mon[31212]: pgmap v244: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:18:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:09 smithi170 ceph-mon[31212]: from='client.? 172.21.15.191:0/2518307418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:18:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:09 smithi077 ceph-mon[27902]: pgmap v244: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-21T10:18:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:09 smithi077 ceph-mon[27902]: from='client.? 172.21.15.191:0/2518307418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T10:18:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:10 smithi170 ceph-mon[31212]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-21T10:18:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:10 smithi170 ceph-mon[31212]: Cluster is now healthy 2024-04-21T10:18:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:10 smithi077 ceph-mon[27902]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-21T10:18:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:10 smithi077 ceph-mon[27902]: Cluster is now healthy 2024-04-21T10:18:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:10 smithi191 ceph-mon[31636]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-21T10:18:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:10 smithi191 ceph-mon[31636]: Cluster is now healthy 2024-04-21T10:18:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:11 smithi170 ceph-mon[31212]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-21T10:18:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:11 smithi077 ceph-mon[27902]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-21T10:18:12.138 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:11 smithi191 ceph-mon[31636]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-21T10:18:13.813 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:13 smithi191 ceph-mon[31636]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-21T10:18:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:13 smithi170 ceph-mon[31212]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-21T10:18:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:13 smithi077 ceph-mon[27902]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-21T10:18:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:15 smithi191 ceph-mon[31636]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:18:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:15 smithi170 ceph-mon[31212]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:18:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:15 smithi077 ceph-mon[27902]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T10:18:16.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-21T10:18:16.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:16 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-21T10:18:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:16 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-21T10:18:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:16 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:17 smithi191 ceph-mon[31636]: Deploying daemon osd.11 on smithi191 2024-04-21T10:18:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:17 smithi191 ceph-mon[31636]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:18:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:17 smithi170 ceph-mon[31212]: Deploying daemon osd.11 on smithi191 2024-04-21T10:18:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:17 smithi170 ceph-mon[31212]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:18:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:17 smithi077 ceph-mon[27902]: Deploying daemon osd.11 on smithi191 2024-04-21T10:18:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:17 smithi077 ceph-mon[27902]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T10:18:20.030 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:19 smithi191 ceph-mon[31636]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-04-21T10:18:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:19 smithi170 ceph-mon[31212]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-04-21T10:18:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:19 smithi077 ceph-mon[27902]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-04-21T10:18:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:21 smithi170 ceph-mon[31212]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:18:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:21 smithi077 ceph-mon[27902]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:18:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:21 smithi191 ceph-mon[31636]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-21T10:18:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:22 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:22 smithi191 ceph-mon[31636]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:22 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:22 smithi170 ceph-mon[31212]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:22 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:22 smithi077 ceph-mon[27902]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:25.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:25 smithi191 ceph-mon[31636]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:25.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:25.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:25.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:25.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:25.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:25 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:25.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.000+0000 7f60f77fe700 1 -- 172.21.15.191:0/3798449231 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f61081a3430 con 0x7f60f00a3c40 2024-04-21T10:18:25.999 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 11 on host 'smithi191' 2024-04-21T10:18:26.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f00a3c40 msgr2=0x7f60f00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:26.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f00a3c40 0x7f60f00a6100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f60f8007cf0 tx=0x7f60f8007480 comp rx=0 tx=0).stop 2024-04-21T10:18:26.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 msgr2=0x7f6108104660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:26.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108104660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f610000b070 tx=0x7f6100004dc0 comp rx=0 tx=0).stop 2024-04-21T10:18:26.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 shutdown_connections 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f60f00a3c40 0x7f60f00a6100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61081019a0 0x7f6108105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6108103540 0x7f6108104660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 --2- 172.21.15.191:0/3798449231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6108102ba0 0x7f6108104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 >> 172.21.15.191:0/3798449231 conn(0x7f61080fcf40 msgr2=0x7f610806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 shutdown_connections 2024-04-21T10:18:26.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:26.002+0000 7f610cb0b700 1 -- 172.21.15.191:0/3798449231 wait complete. 2024-04-21T10:18:26.010 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:25 smithi170 ceph-mon[31212]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:26.010 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.010 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.010 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:26.010 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:26.010 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:25 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:25 smithi077 ceph-mon[27902]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:26.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:25 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.701 DEBUG:teuthology.orchestra.run.smithi191:osd.11> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@osd.11.service 2024-04-21T10:18:26.704 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-21T10:18:26.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-21T10:18:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:18:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:26 smithi191 ceph-mon[31636]: from='osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T10:18:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:26 smithi191 ceph-mon[31636]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T10:18:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:26 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:26 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:26 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:26 smithi170 ceph-mon[31212]: from='osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T10:18:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:26 smithi170 ceph-mon[31212]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T10:18:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:26 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:26 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:26 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:27.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:26 smithi077 ceph-mon[27902]: from='osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T10:18:27.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:26 smithi077 ceph-mon[27902]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T10:18:27.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:27.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:27.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:26 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:27 smithi170 ceph-mon[31212]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:27 smithi170 ceph-mon[31212]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-21T10:18:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:27 smithi170 ceph-mon[31212]: osdmap e78: 12 total, 11 up, 12 in 2024-04-21T10:18:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:27 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:27 smithi170 ceph-mon[31212]: from='osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:18:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:27 smithi170 ceph-mon[31212]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:18:28.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:27 smithi191 ceph-mon[31636]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:28.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:27 smithi191 ceph-mon[31636]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-21T10:18:28.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:27 smithi191 ceph-mon[31636]: osdmap e78: 12 total, 11 up, 12 in 2024-04-21T10:18:28.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:27 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:28.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:27 smithi191 ceph-mon[31636]: from='osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:18:28.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:27 smithi191 ceph-mon[31636]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:27 smithi077 ceph-mon[27902]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:27 smithi077 ceph-mon[27902]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-21T10:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:27 smithi077 ceph-mon[27902]: osdmap e78: 12 total, 11 up, 12 in 2024-04-21T10:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:27 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:27 smithi077 ceph-mon[27902]: from='osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:27 smithi077 ceph-mon[27902]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-04-21T10:18:28.349 INFO:journalctl@ceph.osd.11.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-11[56832]: 2024-04-21T10:18:28.148+0000 7fb4d6143700 -1 osd.11 0 waiting for initial osdmap 2024-04-21T10:18:28.349 INFO:journalctl@ceph.osd.11.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-osd-11[56832]: 2024-04-21T10:18:28.161+0000 7fb4cd72d700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 -- 172.21.15.77:0/600276957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 msgr2=0x7f88a0109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 --2- 172.21.15.77:0/600276957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a0109e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f889800b0d0 tx=0x7f889800b3e0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 -- 172.21.15.77:0/600276957 shutdown_connections 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 --2- 172.21.15.77:0/600276957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a01019b0 0x7f88a0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 --2- 172.21.15.77:0/600276957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a0109e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 --2- 172.21.15.77:0/600276957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a0102bb0 0x7f88a0103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 -- 172.21.15.77:0/600276957 >> 172.21.15.77:0/600276957 conn(0x7f88a00fcf70 msgr2=0x7f88a00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 -- 172.21.15.77:0/600276957 shutdown_connections 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 -- 172.21.15.77:0/600276957 wait complete. 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 Processor -- start 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.681+0000 7f88a83a4700 1 -- start start 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a01019b0 0x7f88a006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a0102bb0 0x7f88a019d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a019ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88a010d430 con 0x7f88a0103550 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88a010d2b0 con 0x7f88a0102bb0 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f88a010d5b0 con 0x7f88a01019b0 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a019ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a019ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37014/0 (socket says 172.21.15.77:37014) 2024-04-21T10:18:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 -- 172.21.15.77:0/3726745534 learned_addr learned my addr 172.21.15.77:0/3726745534 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6140700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a01019b0 0x7f88a006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a593f700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a0102bb0 0x7f88a019d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 -- 172.21.15.77:0/3726745534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a01019b0 msgr2=0x7f88a006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a01019b0 0x7f88a006bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 -- 172.21.15.77:0/3726745534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a0102bb0 msgr2=0x7f88a019d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a0102bb0 0x7f88a019d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 -- 172.21.15.77:0/3726745534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a01976c0 con 0x7f88a0103550 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6140700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a01019b0 0x7f88a006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a593f700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a0102bb0 0x7f88a019d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a6941700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a019ff40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f889800d010 tx=0x7f8898007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898021070 con 0x7f88a0103550 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889801db00 con 0x7f88a0103550 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889801bca0 con 0x7f88a0103550 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a0197950 con 0x7f88a0103550 2024-04-21T10:18:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.682+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a0197ee0 con 0x7f88a0103550 2024-04-21T10:18:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.683+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a0069730 con 0x7f88a0103550 2024-04-21T10:18:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.685+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8898024070 con 0x7f88a0103550 2024-04-21T10:18:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.685+0000 7f88977fe700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f888c0a3cc0 0x7f888c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.685+0000 7f88a6140700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f888c0a3cc0 0x7f888c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.685+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7f889800f020 con 0x7f88a0103550 2024-04-21T10:18:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.686+0000 7f88a6140700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f888c0a3cc0 0x7f888c0a6180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f889c005950 tx=0x7f889c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.689+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f889802b020 con 0x7f88a0103550 2024-04-21T10:18:28.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.891+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f88a0108860 con 0x7f88a0103550 2024-04-21T10:18:28.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.891+0000 7f88977fe700 1 -- 172.21.15.77:0/3726745534 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f889809eb90 con 0x7f88a0103550 2024-04-21T10:18:28.891 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f888c0a3cc0 msgr2=0x7f888c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f888c0a3cc0 0x7f888c0a6180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f889c005950 tx=0x7f889c0058e0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 msgr2=0x7f88a019ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a019ff40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f889800d010 tx=0x7f8898007ad0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 shutdown_connections 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f888c0a3cc0 0x7f888c0a6180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a0103550 0x7f88a019ff40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88a01019b0 0x7f88a006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 --2- 172.21.15.77:0/3726745534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a0102bb0 0x7f88a019d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:28.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 >> 172.21.15.77:0/3726745534 conn(0x7f88a00fcf70 msgr2=0x7f88a0105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:28.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 shutdown_connections 2024-04-21T10:18:28.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:28.893+0000 7f88a83a4700 1 -- 172.21.15.77:0/3726745534 wait complete. 2024-04-21T10:18:29.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-mon[31636]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:18:29.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-mon[31636]: osdmap e79: 12 total, 11 up, 12 in 2024-04-21T10:18:29.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:28 smithi191 ceph-mon[31636]: from='osd.11 ' entity='osd.11' 2024-04-21T10:18:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:28 smithi170 ceph-mon[31212]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:18:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:28 smithi170 ceph-mon[31212]: osdmap e79: 12 total, 11 up, 12 in 2024-04-21T10:18:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:28 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:28 smithi170 ceph-mon[31212]: from='osd.11 ' entity='osd.11' 2024-04-21T10:18:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:28 smithi077 ceph-mon[27902]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-04-21T10:18:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:28 smithi077 ceph-mon[27902]: osdmap e79: 12 total, 11 up, 12 in 2024-04-21T10:18:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:28 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:28 smithi077 ceph-mon[27902]: from='osd.11 ' entity='osd.11' 2024-04-21T10:18:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1713694682,"num_in_osds":12,"osd_in_since":1713694688,"num_remapped_pgs":0} 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: purged_snaps scrub starts 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: purged_snaps scrub ok 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3726745534' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] boot 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: osdmap e80: 12 total, 12 up, 12 in 2024-04-21T10:18:29.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:29 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: purged_snaps scrub starts 2024-04-21T10:18:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: purged_snaps scrub ok 2024-04-21T10:18:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3726745534' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T10:18:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] boot 2024-04-21T10:18:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: osdmap e80: 12 total, 12 up, 12 in 2024-04-21T10:18:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:29 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: purged_snaps scrub starts 2024-04-21T10:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: purged_snaps scrub ok 2024-04-21T10:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-21T10:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3726745534' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T10:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: osd.11 [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] boot 2024-04-21T10:18:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: osdmap e80: 12 total, 12 up, 12 in 2024-04-21T10:18:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:29 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:18:30.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-21T10:18:30.915 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: Detected new or changed devices on smithi191 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 4272M 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:31.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:31 smithi077 ceph-mon[27902]: osdmap e81: 12 total, 12 up, 12 in 2024-04-21T10:18:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: Detected new or changed devices on smithi191 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 4272M 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:31 smithi170 ceph-mon[31212]: osdmap e81: 12 total, 12 up, 12 in 2024-04-21T10:18:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: Detected new or changed devices on smithi191 2024-04-21T10:18:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 4272M 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:31 smithi191 ceph-mon[31636]: osdmap e81: 12 total, 12 up, 12 in 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3682885161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102620 msgr2=0x7fe304109ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3682885161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102620 0x7fe304109ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00b0d0 tx=0x7fe2fc00b3e0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3682885161 shutdown_connections 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3682885161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe304102f40 0x7fe304103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3682885161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102620 0x7fe304109ee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3682885161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe304101c80 0x7fe3041020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3682885161 >> 172.21.15.77:0/3682885161 conn(0x7fe3040fc6b0 msgr2=0x7fe3040feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3682885161 shutdown_connections 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.531+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3682885161 wait complete. 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 Processor -- start 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 -- start start 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe304101c80 0x7fe304105a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe304102620 0x7fe304104070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 0x7fe3041045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410d4a0 con 0x7fe304102f40 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410d320 con 0x7fe304102620 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30b0ad700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410d620 con 0x7fe304101c80 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 0x7fe3041045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 0x7fe3041045b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50718/0 (socket says 172.21.15.77:50718) 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 -- 172.21.15.77:0/3044908175 learned_addr learned my addr 172.21.15.77:0/3044908175 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 -- 172.21.15.77:0/3044908175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe304101c80 msgr2=0x7fe304105a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe304101c80 0x7fe304105a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 -- 172.21.15.77:0/3044908175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe304102620 msgr2=0x7fe304104070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe304102620 0x7fe304104070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 -- 172.21.15.77:0/3044908175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe304104e60 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.532+0000 7fe30964a700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 0x7fe3041045b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009fd0 tx=0x7fe2fc004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.533+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc01f030 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.533+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3041a2c10 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.533+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2fc007bb0 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.533+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc004820 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.533+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3041a30e0 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.534+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3041a32b0 con 0x7fe304102f40 2024-04-21T10:18:32.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.535+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe2fc003a00 con 0x7fe304102f40 2024-04-21T10:18:32.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.536+0000 7fe301ffb700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe2f40a3c40 0x7fe2f40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:32.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.536+0000 7fe308e49700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe2f40a3c40 0x7fe2f40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:32.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.536+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe2fc0d0f20 con 0x7fe304102f40 2024-04-21T10:18:32.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.536+0000 7fe308e49700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe2f40a3c40 0x7fe2f40a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe30406af70 tx=0x7fe2f8005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:32.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.541+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe2fc09de30 con 0x7fe304102f40 2024-04-21T10:18:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.742+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe3041a3640 con 0x7fe304102f40 2024-04-21T10:18:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.742+0000 7fe301ffb700 1 -- 172.21.15.77:0/3044908175 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7fe2fc09d730 con 0x7fe304102f40 2024-04-21T10:18:32.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:32.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe2f40a3c40 msgr2=0x7fe2f40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe2f40a3c40 0x7fe2f40a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe30406af70 tx=0x7fe2f8005d20 comp rx=0 tx=0).stop 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 msgr2=0x7fe3041045b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 0x7fe3041045b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009fd0 tx=0x7fe2fc004ef0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 shutdown_connections 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe2f40a3c40 0x7fe2f40a6100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe304102f40 0x7fe3041045b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe304101c80 0x7fe304105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 --2- 172.21.15.77:0/3044908175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe304102620 0x7fe304104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 >> 172.21.15.77:0/3044908175 conn(0x7fe3040fc6b0 msgr2=0x7fe3040fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 shutdown_connections 2024-04-21T10:18:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:32.745+0000 7fe30b0ad700 1 -- 172.21.15.77:0/3044908175 wait complete. 2024-04-21T10:18:33.544 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1713694709,"num_in_osds":12,"osd_in_since":1713694688,"num_remapped_pgs":0} 2024-04-21T10:18:33.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-21T10:18:33.779 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:18:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:33 smithi077 ceph-mon[27902]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:33 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3044908175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T10:18:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:33 smithi191 ceph-mon[31636]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:33 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3044908175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T10:18:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:33 smithi170 ceph-mon[31212]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:33 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3044908175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T10:18:35.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 -- 172.21.15.77:0/3962741874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268107990 msgr2=0x7f9268107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:35.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 --2- 172.21.15.77:0/3962741874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268107990 0x7f9268107d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f925c009990 tx=0x7f925c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 -- 172.21.15.77:0/3962741874 shutdown_connections 2024-04-21T10:18:35.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 --2- 172.21.15.77:0/3962741874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9268102300 0x7f926810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 --2- 172.21.15.77:0/3962741874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268107990 0x7f9268107d70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 --2- 172.21.15.77:0/3962741874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9268101940 0x7f9268101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 -- 172.21.15.77:0/3962741874 >> 172.21.15.77:0/3962741874 conn(0x7f92680788f0 msgr2=0x7f9268078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:35.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 -- 172.21.15.77:0/3962741874 shutdown_connections 2024-04-21T10:18:35.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.574+0000 7f926cf0d700 1 -- 172.21.15.77:0/3962741874 wait complete. 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 Processor -- start 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 -- start start 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 0x7f9268197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9268102300 0x7f92681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9268107990 0x7f926819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9268111b00 con 0x7f9268101940 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9268111980 con 0x7f9268107990 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.575+0000 7f926cf0d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9268111c80 con 0x7f9268102300 2024-04-21T10:18:35.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 0x7f9268197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 0x7f9268197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50732/0 (socket says 172.21.15.77:50732) 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 -- 172.21.15.77:0/2984647102 learned_addr learned my addr 172.21.15.77:0/2984647102 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f9266d9d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9268107990 0x7f926819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f9265d9b700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9268102300 0x7f92681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 -- 172.21.15.77:0/2984647102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9268102300 msgr2=0x7f92681984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9268102300 0x7f92681984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 -- 172.21.15.77:0/2984647102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9268107990 msgr2=0x7f926819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9268107990 0x7f926819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 -- 172.21.15.77:0/2984647102 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926819cfc0 con 0x7f9268101940 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926659c700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 0x7f9268197fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f925c000c00 tx=0x7f925c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c029070 con 0x7f9268101940 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f925c019cc0 con 0x7f9268101940 2024-04-21T10:18:35.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926819d250 con 0x7f9268101940 2024-04-21T10:18:35.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c024470 con 0x7f9268101940 2024-04-21T10:18:35.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.576+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926806a720 con 0x7f9268101940 2024-04-21T10:18:35.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.577+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9268103060 con 0x7f9268101940 2024-04-21T10:18:35.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.579+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f925c02c070 con 0x7f9268101940 2024-04-21T10:18:35.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.579+0000 7f92577fe700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f92500a3c40 0x7f92500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:35.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.580+0000 7f9265d9b700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f92500a3c40 0x7f92500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:35.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.580+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f925c0d2c60 con 0x7f9268101940 2024-04-21T10:18:35.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.580+0000 7f9265d9b700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f92500a3c40 0x7f92500a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9258005950 tx=0x7f92580058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:35.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.584+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f925c013070 con 0x7f9268101940 2024-04-21T10:18:35.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.789+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9268199310 con 0x7f9268101940 2024-04-21T10:18:35.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.790+0000 7f92577fe700 1 -- 172.21.15.77:0/2984647102 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18466 (secure 0 0 0) 0x7f925c09fb70 con 0x7f9268101940 2024-04-21T10:18:35.790 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:35.790 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":81,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:18:30.729988+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f92500a3c40 msgr2=0x7f92500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f92500a3c40 0x7f92500a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9258005950 tx=0x7f92580058e0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 msgr2=0x7f9268197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 0x7f9268197fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f925c000c00 tx=0x7f925c0047b0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 shutdown_connections 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f92500a3c40 0x7f92500a6100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9268107990 0x7f926819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9268101940 0x7f9268197fb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 --2- 172.21.15.77:0/2984647102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9268102300 0x7f92681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 >> 172.21.15.77:0/2984647102 conn(0x7f92680788f0 msgr2=0x7f92681007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 shutdown_connections 2024-04-21T10:18:35.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:35.792+0000 7f926cf0d700 1 -- 172.21.15.77:0/2984647102 wait complete. 2024-04-21T10:18:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:35 smithi077 ceph-mon[27902]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:35 smithi170 ceph-mon[31212]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:35 smithi191 ceph-mon[31636]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:36.574 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:18:36.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-21T10:18:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:18:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:36 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2984647102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:18:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:36 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2984647102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:18:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:36 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2984647102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:18:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:37 smithi170 ceph-mon[31212]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:38.062 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:37 smithi077 ceph-mon[27902]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:37 smithi191 ceph-mon[31636]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:38.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 -- 172.21.15.77:0/2559296941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 msgr2=0x7fc1a010f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:38.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/2559296941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a010f830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b0a0 tx=0x7fc19800b3b0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 -- 172.21.15.77:0/2559296941 shutdown_connections 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/2559296941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a0107b20 0x7fc1a0107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/2559296941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a010f830 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/2559296941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 0x7fc1a0101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.649+0000 7fc1a7fea700 1 -- 172.21.15.77:0/2559296941 >> 172.21.15.77:0/2559296941 conn(0x7fc1a0076c60 msgr2=0x7fc1a0077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 -- 172.21.15.77:0/2559296941 shutdown_connections 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 -- 172.21.15.77:0/2559296941 wait complete. 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 Processor -- start 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 -- start start 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 0x7fc1a0199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a01995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a0107b20 0x7fc1a019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0112c50 con 0x7fc1a0101dc0 2024-04-21T10:18:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0112ad0 con 0x7fc1a0107b20 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a7fea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0112dd0 con 0x7fc1a0101400 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a5585700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a01995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a5585700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a01995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50744/0 (socket says 172.21.15.77:50744) 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.650+0000 7fc1a5585700 1 -- 172.21.15.77:0/254677471 learned_addr learned my addr 172.21.15.77:0/254677471 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a6587700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a0107b20 0x7fc1a019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5585700 1 -- 172.21.15.77:0/254677471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 msgr2=0x7fc1a0199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5d86700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 0x7fc1a0199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5585700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 0x7fc1a0199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5585700 1 -- 172.21.15.77:0/254677471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a0107b20 msgr2=0x7fc1a019d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5585700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a0107b20 0x7fc1a019d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5585700 1 -- 172.21.15.77:0/254677471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a019e070 con 0x7fc1a0101dc0 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5d86700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 0x7fc1a0199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a5585700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a01995a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c920 tx=0x7fc19400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194007b00 con 0x7fc1a0101dc0 2024-04-21T10:18:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a019e360 con 0x7fc1a0101dc0 2024-04-21T10:18:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc194004ce0 con 0x7fc1a0101dc0 2024-04-21T10:18:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194005650 con 0x7fc1a0101dc0 2024-04-21T10:18:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.651+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a01a5be0 con 0x7fc1a0101dc0 2024-04-21T10:18:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.652+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a0069730 con 0x7fc1a0101dc0 2024-04-21T10:18:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.653+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc194007ca0 con 0x7fc1a0101dc0 2024-04-21T10:18:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.654+0000 7fc192ffd700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc18c0a3cc0 0x7fc18c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.654+0000 7fc1a5d86700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc18c0a3cc0 0x7fc18c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.654+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc1940cfe70 con 0x7fc1a0101dc0 2024-04-21T10:18:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.654+0000 7fc1a5d86700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc18c0a3cc0 0x7fc18c0a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc19c005fd0 tx=0x7fc19c005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.658+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc194014030 con 0x7fc1a0101dc0 2024-04-21T10:18:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.857+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1a002df80 con 0x7fc1a0101dc0 2024-04-21T10:18:38.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.857+0000 7fc192ffd700 1 -- 172.21.15.77:0/254677471 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fc19409ccf0 con 0x7fc1a0101dc0 2024-04-21T10:18:38.857 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:18:38.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc18c0a3cc0 msgr2=0x7fc18c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:38.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc18c0a3cc0 0x7fc18c0a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc19c005fd0 tx=0x7fc19c005dc0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 msgr2=0x7fc1a01995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a01995a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c920 tx=0x7fc19400cce0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 shutdown_connections 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc18c0a3cc0 0x7fc18c0a6180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a0107b20 0x7fc1a019d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1a0101400 0x7fc1a0199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 --2- 172.21.15.77:0/254677471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1a0101dc0 0x7fc1a01995a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 >> 172.21.15.77:0/254677471 conn(0x7fc1a0076c60 msgr2=0x7fc1a00ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 shutdown_connections 2024-04-21T10:18:38.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:38.860+0000 7fc1a7fea700 1 -- 172.21.15.77:0/254677471 wait complete. 2024-04-21T10:18:39.584 INFO:tasks.cephadm:Adding mds.a on smithi077 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.d on smithi077 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.g on smithi077 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.j on smithi077 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.b on smithi170 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.e on smithi170 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.h on smithi170 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.k on smithi170 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.c on smithi191 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.f on smithi191 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.i on smithi191 2024-04-21T10:18:39.585 INFO:tasks.cephadm:Adding mds.l on smithi191 2024-04-21T10:18:39.586 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l' 2024-04-21T10:18:39.840 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.c/config 2024-04-21T10:18:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:39 smithi077 ceph-mon[27902]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:39 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/254677471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:18:39.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:39 smithi191 ceph-mon[31636]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:39.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:39 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/254677471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:18:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:39 smithi170 ceph-mon[31212]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:39 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/254677471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:18:41.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 -- 172.21.15.191:0/1008285657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900101990 msgr2=0x7f8900101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:41.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 --2- 172.21.15.191:0/1008285657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900101990 0x7f8900101db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009990 tx=0x7f88f0009ca0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 -- 172.21.15.191:0/1008285657 shutdown_connections 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 --2- 172.21.15.191:0/1008285657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 0x7f8900109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 --2- 172.21.15.191:0/1008285657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900101990 0x7f8900101db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 --2- 172.21.15.191:0/1008285657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8900102b90 0x7f8900102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 -- 172.21.15.191:0/1008285657 >> 172.21.15.191:0/1008285657 conn(0x7f89000fcf30 msgr2=0x7f89000ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 -- 172.21.15.191:0/1008285657 shutdown_connections 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.462+0000 7f8904bd7700 1 -- 172.21.15.191:0/1008285657 wait complete. 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 Processor -- start 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 -- start start 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8900101990 0x7f8900197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 0x7f8900198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 0x7f890019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:41.464 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f890010d400 con 0x7f8900101990 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f890010d280 con 0x7f8900103530 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f8904bd7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f890010d580 con 0x7f8900102b90 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f88fdd9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 0x7f8900198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f88fdd9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 0x7f8900198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57324/0 (socket says 172.21.15.191:57324) 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.463+0000 7f88fdd9b700 1 -- 172.21.15.191:0/356616585 learned_addr learned my addr 172.21.15.191:0/356616585 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fe59c700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8900101990 0x7f8900197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fed9d700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 0x7f890019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fdd9b700 1 -- 172.21.15.191:0/356616585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 msgr2=0x7f890019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fdd9b700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 0x7f890019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fdd9b700 1 -- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8900101990 msgr2=0x7f8900197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fdd9b700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8900101990 0x7f8900197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fdd9b700 1 -- 172.21.15.191:0/356616585 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890019f760 con 0x7f8900102b90 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fed9d700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 0x7f890019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88fdd9b700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 0x7f8900198040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88f400d980 tx=0x7f88f400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:41.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4016070 con 0x7f8900102b90 2024-04-21T10:18:41.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f400de70 con 0x7f8900102b90 2024-04-21T10:18:41.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890019fa50 con 0x7f8900102b90 2024-04-21T10:18:41.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f400f3c0 con 0x7f8900102b90 2024-04-21T10:18:41.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.464+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890019ff90 con 0x7f8900102b90 2024-04-21T10:18:41.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.465+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900069730 con 0x7f8900102b90 2024-04-21T10:18:41.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.466+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f88f4019070 con 0x7f8900102b90 2024-04-21T10:18:41.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.467+0000 7f88ef7fe700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f88e80a3c40 0x7f88e80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:41.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.467+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f88f40cfa80 con 0x7f8900102b90 2024-04-21T10:18:41.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.467+0000 7f88fe59c700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f88e80a3c40 0x7f88e80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:41.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.468+0000 7f88fe59c700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f88e80a3c40 0x7f88e80a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f88f000b720 tx=0x7f88f0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:41.469 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.471+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f88f409c900 con 0x7f8900102b90 2024-04-21T10:18:41.676 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.677+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}) -- 0x7f890006b270 con 0x7f88e80a3c40 2024-04-21T10:18:41.683 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.685+0000 7f88ef7fe700 1 -- 172.21.15.191:0/356616585 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f890006b270 con 0x7f88e80a3c40 2024-04-21T10:18:41.684 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mds.all update... 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f88e80a3c40 msgr2=0x7f88e80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f88e80a3c40 0x7f88e80a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f88f000b720 tx=0x7f88f0005fd0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 msgr2=0x7f8900198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 0x7f8900198040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88f400d980 tx=0x7f88f400dc90 comp rx=0 tx=0).stop 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 shutdown_connections 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f88e80a3c40 0x7f88e80a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8900103530 0x7f890019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8900101990 0x7f8900197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.686 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 --2- 172.21.15.191:0/356616585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8900102b90 0x7f8900198040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:41.687 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 >> 172.21.15.191:0/356616585 conn(0x7f89000fcf30 msgr2=0x7f8900105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:41.687 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 shutdown_connections 2024-04-21T10:18:41.687 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-21T10:18:41.687+0000 7f8904bd7700 1 -- 172.21.15.191:0/356616585 wait complete. 2024-04-21T10:18:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:41 smithi191 ceph-mon[31636]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:41 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:41 smithi170 ceph-mon[31212]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:41 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:41 smithi077 ceph-mon[27902]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:41 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:18:42.342 DEBUG:teuthology.orchestra.run.smithi077:mds.a> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.a.service 2024-04-21T10:18:42.344 DEBUG:teuthology.orchestra.run.smithi077:mds.d> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.d.service 2024-04-21T10:18:42.388 DEBUG:teuthology.orchestra.run.smithi077:mds.g> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.g.service 2024-04-21T10:18:42.430 DEBUG:teuthology.orchestra.run.smithi077:mds.j> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.j.service 2024-04-21T10:18:42.474 DEBUG:teuthology.orchestra.run.smithi170:mds.b> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.b.service 2024-04-21T10:18:42.476 DEBUG:teuthology.orchestra.run.smithi170:mds.e> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.e.service 2024-04-21T10:18:42.519 DEBUG:teuthology.orchestra.run.smithi170:mds.h> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.h.service 2024-04-21T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi170:mds.k> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.k.service 2024-04-21T10:18:42.605 DEBUG:teuthology.orchestra.run.smithi191:mds.c> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.c.service 2024-04-21T10:18:42.608 DEBUG:teuthology.orchestra.run.smithi191:mds.f> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.f.service 2024-04-21T10:18:42.651 DEBUG:teuthology.orchestra.run.smithi191:mds.i> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.i.service 2024-04-21T10:18:42.694 DEBUG:teuthology.orchestra.run.smithi191:mds.l> sudo journalctl -f -n 0 -u ceph-41617fb2-ffc7-11ee-bc93-c7b262605968@mds.l.service 2024-04-21T10:18:42.737 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-21T10:18:42.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:18:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: Saving service mds.all spec with placement smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:42 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 -- 172.21.15.77:0/3595458467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198100e70 msgr2=0x7f3198101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 --2- 172.21.15.77:0/3595458467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198100e70 0x7f3198101290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3190009ca0 tx=0x7f319002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 -- 172.21.15.77:0/3595458467 shutdown_connections 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 --2- 172.21.15.77:0/3595458467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3198102980 0x7f31981092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 --2- 172.21.15.77:0/3595458467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3198101fc0 0x7f3198102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 --2- 172.21.15.77:0/3595458467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198100e70 0x7f3198101290 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 -- 172.21.15.77:0/3595458467 >> 172.21.15.77:0/3595458467 conn(0x7f31980fc3e0 msgr2=0x7f31980fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 -- 172.21.15.77:0/3595458467 shutdown_connections 2024-04-21T10:18:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 -- 172.21.15.77:0/3595458467 wait complete. 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 Processor -- start 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.848+0000 7f319ffa4640 1 -- start start 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3198100e70 0x7f3198069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3198101fc0 0x7f319819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 0x7f31981a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f319810c9a0 con 0x7f3198102980 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f319810c820 con 0x7f3198100e70 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f319810cb20 con 0x7f3198101fc0 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 0x7f31981a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 0x7f31981a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48548/0 (socket says 172.21.15.77:48548) 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 -- 172.21.15.77:0/754953607 learned_addr learned my addr 172.21.15.77:0/754953607 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319dd40640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3198100e70 0x7f3198069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319d53f640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3198101fc0 0x7f319819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 -- 172.21.15.77:0/754953607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3198101fc0 msgr2=0x7f319819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3198101fc0 0x7f319819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 -- 172.21.15.77:0/754953607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3198100e70 msgr2=0x7f3198069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3198100e70 0x7f3198069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 -- 172.21.15.77:0/754953607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31981a2050 con 0x7f3198102980 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319e541640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 0x7f31981a1860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f318800d950 tx=0x7f318800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188017030 con 0x7f3198102980 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3188004020 con 0x7f3198102980 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31981a22e0 con 0x7f3198102980 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188003b50 con 0x7f3198102980 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.849+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981a27e0 con 0x7f3198102980 2024-04-21T10:18:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.850+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31981082a0 con 0x7f3198102980 2024-04-21T10:18:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.851+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f318801a070 con 0x7f3198102980 2024-04-21T10:18:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.852+0000 7f3196ffd640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f31800a3be0 0x7f31800a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.852+0000 7f319dd40640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f31800a3be0 0x7f31800a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.852+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f31880cf630 con 0x7f3198102980 2024-04-21T10:18:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.852+0000 7f319dd40640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f31800a3be0 0x7f31800a60a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3190005e30 tx=0x7f3190000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:42.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:42.856+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3188021070 con 0x7f3198102980 2024-04-21T10:18:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:18:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: Saving service mds.all spec with placement smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-04-21T10:18:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:42 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.036+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f319802d7c0 con 0x7f3198102980 2024-04-21T10:18:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.037+0000 7f3196ffd640 1 -- 172.21.15.77:0/754953607 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18466 (secure 0 0 0) 0x7f318809c4b0 con 0x7f3198102980 2024-04-21T10:18:43.037 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:43.037 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":81,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:18:30.729988+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:18:43.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f31800a3be0 msgr2=0x7f31800a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f31800a3be0 0x7f31800a60a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3190005e30 tx=0x7f3190000f40 comp rx=0 tx=0).stop 2024-04-21T10:18:43.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 msgr2=0x7f31981a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 0x7f31981a1860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f318800d950 tx=0x7f318800de10 comp rx=0 tx=0).stop 2024-04-21T10:18:43.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 shutdown_connections 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f31800a3be0 0x7f31800a60a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198102980 0x7f31981a1860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3198101fc0 0x7f319819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 --2- 172.21.15.77:0/754953607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3198100e70 0x7f3198069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 >> 172.21.15.77:0/754953607 conn(0x7f31980fc3e0 msgr2=0x7f3198105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 shutdown_connections 2024-04-21T10:18:43.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.039+0000 7f319ffa4640 1 -- 172.21.15.77:0/754953607 wait complete. 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: Saving service mds.all spec with placement smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:43.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:42 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:43.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:18:43.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 -- 172.21.15.77:0/1518658851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 msgr2=0x7f8bd01023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1518658851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd01023c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009900 tx=0x7f8bc002bc30 comp rx=0 tx=0).stop 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 -- 172.21.15.77:0/1518658851 shutdown_connections 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1518658851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103b50 0x7f8bd010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1518658851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd0103190 0x7f8bd0103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1518658851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd01023c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 -- 172.21.15.77:0/1518658851 >> 172.21.15.77:0/1518658851 conn(0x7f8bd00fd530 msgr2=0x7f8bd00ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 -- 172.21.15.77:0/1518658851 shutdown_connections 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 -- 172.21.15.77:0/1518658851 wait complete. 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.152+0000 7f8bd608c640 1 Processor -- start 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 -- start start 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd0198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103190 0x7f8bd0198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd0103b50 0x7f8bd019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd010dae0 con 0x7f8bd0101fa0 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd010d960 con 0x7f8bd0103190 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd010dc60 con 0x7f8bd0103b50 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd0198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd0198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48564/0 (socket says 172.21.15.77:48564) 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 -- 172.21.15.77:0/1842843201 learned_addr learned my addr 172.21.15.77:0/1842843201 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcffff640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd0103b50 0x7f8bd019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bceffd640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103190 0x7f8bd0198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 -- 172.21.15.77:0/1842843201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd0103b50 msgr2=0x7f8bd019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd0103b50 0x7f8bd019f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 -- 172.21.15.77:0/1842843201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103190 msgr2=0x7f8bd0198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103190 0x7f8bd0198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 -- 172.21.15.77:0/1842843201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd019fe70 con 0x7f8bd0101fa0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bceffd640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103190 0x7f8bd0198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bcf7fe640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd0198250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0000c00 tx=0x7f8bc0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0043020 con 0x7f8bd0101fa0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc0004440 con 0x7f8bd0101fa0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd01a0100 con 0x7f8bd0101fa0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0003c90 con 0x7f8bd0101fa0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.153+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd01a0650 con 0x7f8bd0101fa0 2024-04-21T10:18:43.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.154+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd01093d0 con 0x7f8bd0101fa0 2024-04-21T10:18:43.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.155+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8bc0046020 con 0x7f8bd0101fa0 2024-04-21T10:18:43.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.156+0000 7f8bccff9640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8bb80a3bb0 0x7f8bb80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.156+0000 7f8bceffd640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8bb80a3bb0 0x7f8bb80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.156+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8bc00f26d0 con 0x7f8bd0101fa0 2024-04-21T10:18:43.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.156+0000 7f8bceffd640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8bb80a3bb0 0x7f8bb80a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0199760 tx=0x7f8bc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:43.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.160+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8bc004d020 con 0x7f8bd0101fa0 2024-04-21T10:18:43.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.338+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8bd0062b50 con 0x7f8bd0101fa0 2024-04-21T10:18:43.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.338+0000 7f8bccff9640 1 -- 172.21.15.77:0/1842843201 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f8bc00bf550 con 0x7f8bd0101fa0 2024-04-21T10:18:43.338 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:18:43.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.340+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8bb80a3bb0 msgr2=0x7f8bb80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.340+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8bb80a3bb0 0x7f8bb80a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0199760 tx=0x7f8bc4005f90 comp rx=0 tx=0).stop 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.340+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 msgr2=0x7f8bd0198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.340+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd0198250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0000c00 tx=0x7f8bc0004040 comp rx=0 tx=0).stop 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 shutdown_connections 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8bb80a3bb0 0x7f8bb80a6070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd0103b50 0x7f8bd019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bd0103190 0x7f8bd0198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 --2- 172.21.15.77:0/1842843201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bd0101fa0 0x7f8bd0198250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 >> 172.21.15.77:0/1842843201 conn(0x7f8bd00fd530 msgr2=0x7f8bd01065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 shutdown_connections 2024-04-21T10:18:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.341+0000 7f8bd608c640 1 -- 172.21.15.77:0/1842843201 wait complete. 2024-04-21T10:18:43.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.448+0000 7f24bf670640 1 -- 172.21.15.77:0/864893725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 msgr2=0x7f24b8101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.448+0000 7f24bf670640 1 --2- 172.21.15.77:0/864893725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8101290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009900 tx=0x7f24b002bc30 comp rx=0 tx=0).stop 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- 172.21.15.77:0/864893725 shutdown_connections 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 --2- 172.21.15.77:0/864893725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24b8102980 0x7f24b81092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 --2- 172.21.15.77:0/864893725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8101fc0 0x7f24b8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 --2- 172.21.15.77:0/864893725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8101290 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- 172.21.15.77:0/864893725 >> 172.21.15.77:0/864893725 conn(0x7f24b80fc3e0 msgr2=0x7f24b80fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- 172.21.15.77:0/864893725 shutdown_connections 2024-04-21T10:18:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- 172.21.15.77:0/864893725 wait complete. 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 Processor -- start 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- start start 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24b8101fc0 0x7f24b8197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8102980 0x7f24b819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24b810c9c0 con 0x7f24b8100e70 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f24b810c840 con 0x7f24b8102980 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bf670640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f24b810cb40 con 0x7f24b8101fc0 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bd40c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bd40c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48582/0 (socket says 172.21.15.77:48582) 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bd40c640 1 -- 172.21.15.77:0/4123637361 learned_addr learned my addr 172.21.15.77:0/4123637361 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.449+0000 7f24bcc0b640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24b8101fc0 0x7f24b8197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bd40c640 1 -- 172.21.15.77:0/4123637361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24b8101fc0 msgr2=0x7f24b8197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bd40c640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24b8101fc0 0x7f24b8197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bdc0d640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8102980 0x7f24b819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bd40c640 1 -- 172.21.15.77:0/4123637361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8102980 msgr2=0x7f24b819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bd40c640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8102980 0x7f24b819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bd40c640 1 -- 172.21.15.77:0/4123637361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b819ec50 con 0x7f24b8100e70 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bdc0d640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8102980 0x7f24b819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bd40c640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8197030 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24b0006010 tx=0x7f24b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0043020 con 0x7f24b8100e70 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24b0004aa0 con 0x7f24b8100e70 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b819eee0 con 0x7f24b8100e70 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0003c70 con 0x7f24b8100e70 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.450+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b819f340 con 0x7f24b8100e70 2024-04-21T10:18:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.451+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8108180 con 0x7f24b8100e70 2024-04-21T10:18:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.453+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f24b0046020 con 0x7f24b8100e70 2024-04-21T10:18:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.453+0000 7f24aa7fc640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24a40a3bb0 0x7f24a40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.453+0000 7f24bcc0b640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24a40a3bb0 0x7f24a40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.453+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f24b00f29b0 con 0x7f24b8100e70 2024-04-21T10:18:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.454+0000 7f24bcc0b640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24a40a3bb0 0x7f24a40a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f24b8198540 tx=0x7f24ac007600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:43.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.457+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f24b004d020 con 0x7f24b8100e70 2024-04-21T10:18:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.673+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24b802d830 con 0x7f24b8100e70 2024-04-21T10:18:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.673+0000 7f24aa7fc640 1 -- 172.21.15.77:0/4123637361 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f24b00bf830 con 0x7f24b8100e70 2024-04-21T10:18:43.673 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:43.673 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-21T10:18:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 1 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24a40a3bb0 msgr2=0x7f24a40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24a40a3bb0 0x7f24a40a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f24b8198540 tx=0x7f24ac007600 comp rx=0 tx=0).stop 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 msgr2=0x7f24b8197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8197030 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24b0006010 tx=0x7f24b00042f0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 shutdown_connections 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f24a40a3bb0 0x7f24a40a6070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24b8102980 0x7f24b819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24b8101fc0 0x7f24b8197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 --2- 172.21.15.77:0/4123637361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8100e70 0x7f24b8197030 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:43.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 >> 172.21.15.77:0/4123637361 conn(0x7f24b80fc3e0 msgr2=0x7f24b8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:43.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 shutdown_connections 2024-04-21T10:18:43.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:43.675+0000 7f24bf670640 1 -- 172.21.15.77:0/4123637361 wait complete. 2024-04-21T10:18:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:43 smithi170 ceph-mon[31212]: Deploying daemon mds.l on smithi191 2024-04-21T10:18:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:43 smithi170 ceph-mon[31212]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:43 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/754953607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:18:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:43 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1842843201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:18:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:43 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4123637361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:43 smithi077 ceph-mon[27902]: Deploying daemon mds.l on smithi191 2024-04-21T10:18:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:43 smithi077 ceph-mon[27902]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:43 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/754953607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:18:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:43 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1842843201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:18:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:43 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4123637361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:43 smithi191 ceph-mon[31636]: Deploying daemon mds.l on smithi191 2024-04-21T10:18:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:43 smithi191 ceph-mon[31636]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:43 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/754953607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:18:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:43 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1842843201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:18:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:43 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4123637361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:44.718 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:44 smithi191 systemd[1]: Starting Ceph mds.l for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:18:45.090 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:44 smithi191 podman[61366]: 2024-04-21 10:18:44.742820727 +0000 UTC m=+0.018243050 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:18:45.090 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:44 smithi191 podman[61366]: 2024-04-21 10:18:44.852008025 +0000 UTC m=+0.127430377 container create 552dc808c9580efd9f5d046daef3a93c35a93fe126bd99dd4f36aeb70dbced5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-a630765, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-21T10:18:45.090 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:45 smithi191 podman[61366]: 2024-04-21 10:18:45.088167094 +0000 UTC m=+0.363589401 container init 552dc808c9580efd9f5d046daef3a93c35a93fe126bd99dd4f36aeb70dbced5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-l, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-a630765, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-21T10:18:45.090 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:45 smithi191 podman[61366]: 2024-04-21 10:18:45.09105771 +0000 UTC m=+0.366480018 container start 552dc808c9580efd9f5d046daef3a93c35a93fe126bd99dd4f36aeb70dbced5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T10:18:45.468 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mds[61385]: -- 172.21.15.191:0/2655426183 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566585efa40 con 0x5566585c2800 2024-04-21T10:18:45.468 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-l[61381]: starting mds.l at 2024-04-21T10:18:45.468 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:45 smithi191 bash[61366]: 552dc808c9580efd9f5d046daef3a93c35a93fe126bd99dd4f36aeb70dbced5b 2024-04-21T10:18:45.468 INFO:journalctl@ceph.mds.l.smithi191.stdout:Apr 21 10:18:45 smithi191 systemd[1]: Started Ceph mds.l for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:18:45.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:45.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 -- 172.21.15.77:0/3426986005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e4107c50 msgr2=0x7fa2e410a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/3426986005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e4107c50 0x7fa2e410a0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009ca0 tx=0x7fa2dc02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 -- 172.21.15.77:0/3426986005 shutdown_connections 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/3426986005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e4107c50 0x7fa2e410a0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/3426986005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2e4105320 0x7fa2e4107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/3426986005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2e41029f0 0x7fa2e4104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 -- 172.21.15.77:0/3426986005 >> 172.21.15.77:0/3426986005 conn(0x7fa2e40fc3c0 msgr2=0x7fa2e40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 -- 172.21.15.77:0/3426986005 shutdown_connections 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.798+0000 7fa2eaceb640 1 -- 172.21.15.77:0/3426986005 wait complete. 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 Processor -- start 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 -- start start 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 0x7fa2e4198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2e4105320 0x7fa2e41986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2e4107c50 0x7fa2e419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e410dab0 con 0x7fa2e41029f0 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e410d930 con 0x7fa2e4107c50 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2eaceb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e410dc30 con 0x7fa2e4105320 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 0x7fa2e4198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 0x7fa2e4198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48598/0 (socket says 172.21.15.77:48598) 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 -- 172.21.15.77:0/427518437 learned_addr learned my addr 172.21.15.77:0/427518437 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e9288640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2e4107c50 0x7fa2e419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e3fff640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2e4105320 0x7fa2e41986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 -- 172.21.15.77:0/427518437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2e4105320 msgr2=0x7fa2e41986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2e4105320 0x7fa2e41986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 -- 172.21.15.77:0/427518437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2e4107c50 msgr2=0x7fa2e419f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.799+0000 7fa2e8a87640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2e4107c50 0x7fa2e419f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2e8a87640 1 -- 172.21.15.77:0/427518437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e419fda0 con 0x7fa2e41029f0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2e8a87640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 0x7fa2e4198180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d950 tx=0x7fa2d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8017030 con 0x7fa2e41029f0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e41a0090 con 0x7fa2e41029f0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d8004020 con 0x7fa2e41029f0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80047a0 con 0x7fa2e41029f0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.800+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e41a05e0 con 0x7fa2e41029f0 2024-04-21T10:18:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.801+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e40fdeb0 con 0x7fa2e41029f0 2024-04-21T10:18:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.802+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa2d8009a30 con 0x7fa2e41029f0 2024-04-21T10:18:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.803+0000 7fa2e1ffb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2d40a3bb0 0x7fa2d40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.803+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa2d80cfa20 con 0x7fa2e41029f0 2024-04-21T10:18:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.803+0000 7fa2e3fff640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2d40a3bb0 0x7fa2d40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.803+0000 7fa2e3fff640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2d40a3bb0 0x7fa2d40a6070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005d80 tx=0x7fa2d0005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:45.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:45.807+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa2d809c8a0 con 0x7fa2e41029f0 2024-04-21T10:18:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.023+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2e4062b50 con 0x7fa2e41029f0 2024-04-21T10:18:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.024+0000 7fa2e1ffb640 1 -- 172.21.15.77:0/427518437 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fa2d809c1a0 con 0x7fa2e41029f0 2024-04-21T10:18:46.024 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:46.024 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T10:18:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2d40a3bb0 msgr2=0x7fa2d40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2d40a3bb0 0x7fa2d40a6070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005d80 tx=0x7fa2d0005c90 comp rx=0 tx=0).stop 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 msgr2=0x7fa2e4198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 0x7fa2e4198180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d950 tx=0x7fa2d800de10 comp rx=0 tx=0).stop 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 shutdown_connections 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2d40a3bb0 0x7fa2d40a6070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2e4107c50 0x7fa2e419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2e4105320 0x7fa2e41986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 --2- 172.21.15.77:0/427518437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e41029f0 0x7fa2e4198180 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 >> 172.21.15.77:0/427518437 conn(0x7fa2e40fc3c0 msgr2=0x7fa2e4103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 shutdown_connections 2024-04-21T10:18:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:46.027+0000 7fa2eaceb640 1 -- 172.21.15.77:0/427518437 wait complete. 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6832/2131093525,v1:172.21.15.191:6833/2131093525] up:boot 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: fsmap 1 up:standby 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:45 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6832/2131093525,v1:172.21.15.191:6833/2131093525] up:boot 2024-04-21T10:18:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: fsmap 1 up:standby 2024-04-21T10:18:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T10:18:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:45 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6832/2131093525,v1:172.21.15.191:6833/2131093525] up:boot 2024-04-21T10:18:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: fsmap 1 up:standby 2024-04-21T10:18:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T10:18:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:45 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:46 smithi077 ceph-mon[27902]: Deploying daemon mds.k on smithi170 2024-04-21T10:18:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:46 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/427518437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:46 smithi170 ceph-mon[31212]: Deploying daemon mds.k on smithi170 2024-04-21T10:18:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:46 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/427518437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:46 smithi191 ceph-mon[31636]: Deploying daemon mds.k on smithi170 2024-04-21T10:18:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:46 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/427518437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:47.750 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:47 smithi170 systemd[1]: Starting Ceph mds.k for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:18:48.000 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:47 smithi170 ceph-mon[31212]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:48.001 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:47 smithi170 podman[61058]: 2024-04-21 10:18:47.659178201 +0000 UTC m=+0.018205557 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:18:48.001 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:47 smithi170 podman[61058]: 2024-04-21 10:18:47.763960331 +0000 UTC m=+0.122987732 container create 8e79c792727f8b2784457e7e4bd2333b690b92fabe3d4d84495861fd28655863 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-a630765, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T10:18:48.001 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:47 smithi170 podman[61058]: 2024-04-21 10:18:47.974978461 +0000 UTC m=+0.334005817 container init 8e79c792727f8b2784457e7e4bd2333b690b92fabe3d4d84495861fd28655863 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-a630765, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-21T10:18:48.001 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:47 smithi170 podman[61058]: 2024-04-21 10:18:47.97756716 +0000 UTC m=+0.336594517 container start 8e79c792727f8b2784457e7e4bd2333b690b92fabe3d4d84495861fd28655863 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-a630765, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T10:18:48.001 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:48 smithi170 ceph-mds[61077]: -- 172.21.15.170:0/1352289636 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f89ecf9a40 con 0x55f89eccd000 2024-04-21T10:18:48.001 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:48 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-k[61073]: starting mds.k at 2024-04-21T10:18:48.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:48.063 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:47 smithi077 ceph-mon[27902]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 -- 172.21.15.77:0/663350755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 msgr2=0x7f3dd01023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 --2- 172.21.15.77:0/663350755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd01023b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002bc30 comp rx=0 tx=0).stop 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 -- 172.21.15.77:0/663350755 shutdown_connections 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 --2- 172.21.15.77:0/663350755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 0x7f3dd010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 --2- 172.21.15.77:0/663350755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 0x7f3dd0103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 --2- 172.21.15.77:0/663350755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd01023b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 -- 172.21.15.77:0/663350755 >> 172.21.15.77:0/663350755 conn(0x7f3dd00fd500 msgr2=0x7f3dd00ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 -- 172.21.15.77:0/663350755 shutdown_connections 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.150+0000 7f3dd652b640 1 -- 172.21.15.77:0/663350755 wait complete. 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 Processor -- start 2024-04-21T10:18:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 -- start start 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd0198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 0x7f3dd0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 0x7f3dd019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd010dad0 con 0x7f3dd0101f90 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd010d950 con 0x7f3dd0103180 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dd652b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd010dc50 con 0x7f3dd0103b40 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dcffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd0198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dcffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd0198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48614/0 (socket says 172.21.15.77:48614) 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.151+0000 7f3dcffff640 1 -- 172.21.15.77:0/342836433 learned_addr learned my addr 172.21.15.77:0/342836433 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dd4ac8640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 0x7f3dd019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcf7fe640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 0x7f3dd0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcffff640 1 -- 172.21.15.77:0/342836433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 msgr2=0x7f3dd019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcffff640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 0x7f3dd019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcffff640 1 -- 172.21.15.77:0/342836433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 msgr2=0x7f3dd0198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcffff640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 0x7f3dd0198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcffff640 1 -- 172.21.15.77:0/342836433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd019fd50 con 0x7f3dd0101f90 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dd4ac8640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 0x7f3dd019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcf7fe640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 0x7f3dd0198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcffff640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd0198130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000c00 tx=0x7f3dc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0043020 con 0x7f3dd0101f90 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc0004aa0 con 0x7f3dd0101f90 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd019ffe0 con 0x7f3dd0101f90 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0003d00 con 0x7f3dd0101f90 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.152+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01a0440 con 0x7f3dd0101f90 2024-04-21T10:18:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.153+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd01092b0 con 0x7f3dd0101f90 2024-04-21T10:18:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.154+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3dc0046020 con 0x7f3dd0101f90 2024-04-21T10:18:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.155+0000 7f3dcd7fa640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3db80a3c30 0x7f3db80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.155+0000 7f3dcf7fe640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3db80a3c30 0x7f3db80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.155+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3dc00f2640 con 0x7f3dd0101f90 2024-04-21T10:18:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.155+0000 7f3dcf7fe640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3db80a3c30 0x7f3db80a60f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0199640 tx=0x7f3dc4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:48.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.160+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3dc004d020 con 0x7f3dd0101f90 2024-04-21T10:18:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:47 smithi191 ceph-mon[31636]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:48.306 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:48 smithi170 bash[61058]: 8e79c792727f8b2784457e7e4bd2333b690b92fabe3d4d84495861fd28655863 2024-04-21T10:18:48.307 INFO:journalctl@ceph.mds.k.smithi170.stdout:Apr 21 10:18:48 smithi170 systemd[1]: Started Ceph mds.k for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:18:48.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.386+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dd002d5c0 con 0x7f3dd0101f90 2024-04-21T10:18:48.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.386+0000 7f3dcd7fa640 1 -- 172.21.15.77:0/342836433 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f3dc00bf420 con 0x7f3dd0101f90 2024-04-21T10:18:48.385 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:48.385 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T10:18:48.386 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-04-21T10:18:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.389+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3db80a3c30 msgr2=0x7f3db80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.389+0000 7f3dd652b640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3db80a3c30 0x7f3db80a60f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0199640 tx=0x7f3dc4005d90 comp rx=0 tx=0).stop 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.389+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 msgr2=0x7f3dd0198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.389+0000 7f3dd652b640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd0198130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000c00 tx=0x7f3dc0004270 comp rx=0 tx=0).stop 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 shutdown_connections 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3db80a3c30 0x7f3db80a60f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd0103b40 0x7f3dd019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dd0103180 0x7f3dd0198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 --2- 172.21.15.77:0/342836433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dd0101f90 0x7f3dd0198130 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 >> 172.21.15.77:0/342836433 conn(0x7f3dd00fd500 msgr2=0x7f3dd0106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 shutdown_connections 2024-04-21T10:18:48.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:48.390+0000 7f3dd652b640 1 -- 172.21.15.77:0/342836433 wait complete. 2024-04-21T10:18:49.376 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: Deploying daemon mds.j on smithi077 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/342836433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6832/1764258640,v1:172.21.15.170:6833/1764258640] up:boot 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: fsmap 2 up:standby 2024-04-21T10:18:49.377 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:49 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T10:18:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: Deploying daemon mds.j on smithi077 2024-04-21T10:18:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/342836433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6832/1764258640,v1:172.21.15.170:6833/1764258640] up:boot 2024-04-21T10:18:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: fsmap 2 up:standby 2024-04-21T10:18:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:49 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T10:18:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: Deploying daemon mds.j on smithi077 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/342836433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6832/1764258640,v1:172.21.15.170:6833/1764258640] up:boot 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: fsmap 2 up:standby 2024-04-21T10:18:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:49 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T10:18:50.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 -- 172.21.15.77:0/1182185259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 msgr2=0x7f41ec1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 --2- 172.21.15.77:0/1182185259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec1023c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009900 tx=0x7f41e402bc30 comp rx=0 tx=0).stop 2024-04-21T10:18:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 -- 172.21.15.77:0/1182185259 shutdown_connections 2024-04-21T10:18:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 --2- 172.21.15.77:0/1182185259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41ec103b50 0x7f41ec10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 --2- 172.21.15.77:0/1182185259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 0x7f41ec103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 --2- 172.21.15.77:0/1182185259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec1023c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 -- 172.21.15.77:0/1182185259 >> 172.21.15.77:0/1182185259 conn(0x7f41ec0fd530 msgr2=0x7f41ec0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 -- 172.21.15.77:0/1182185259 shutdown_connections 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.513+0000 7f41f425c640 1 -- 172.21.15.77:0/1182185259 wait complete. 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 Processor -- start 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 -- start start 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec075cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 0x7f41ec074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41ec103b50 0x7f41ec074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec10dae0 con 0x7f41ec101fa0 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec10d960 con 0x7f41ec103b50 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f425c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec10dc60 con 0x7f41ec103190 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec075cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec075cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48630/0 (socket says 172.21.15.77:48630) 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 -- 172.21.15.77:0/4171356634 learned_addr learned my addr 172.21.15.77:0/4171356634 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f27f9640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41ec103b50 0x7f41ec074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f17f7640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 0x7f41ec074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 -- 172.21.15.77:0/4171356634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 msgr2=0x7f41ec074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 0x7f41ec074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 -- 172.21.15.77:0/4171356634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41ec103b50 msgr2=0x7f41ec074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41ec103b50 0x7f41ec074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f1ff8640 1 -- 172.21.15.77:0/4171356634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ec075140 con 0x7f41ec101fa0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.514+0000 7f41f17f7640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 0x7f41ec074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.515+0000 7f41f1ff8640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec075cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000c00 tx=0x7f41e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.515+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4043020 con 0x7f41ec101fa0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.515+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e4004aa0 con 0x7f41ec101fa0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.515+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41ec1a2320 con 0x7f41ec101fa0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.515+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4003d00 con 0x7f41ec101fa0 2024-04-21T10:18:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.515+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41ec1a2840 con 0x7f41ec101fa0 2024-04-21T10:18:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.516+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41ec068de0 con 0x7f41ec101fa0 2024-04-21T10:18:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.517+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f41e4046020 con 0x7f41ec101fa0 2024-04-21T10:18:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.517+0000 7f41eaffd640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41d40a3bb0 0x7f41d40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.517+0000 7f41f17f7640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41d40a3bb0 0x7f41d40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.517+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f41e40f2310 con 0x7f41ec101fa0 2024-04-21T10:18:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.518+0000 7f41f17f7640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41d40a3bb0 0x7f41d40a6070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41e0005fd0 tx=0x7f41e0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.522+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f41e404d020 con 0x7f41ec101fa0 2024-04-21T10:18:50.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.748+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41ec02d5c0 con 0x7f41ec101fa0 2024-04-21T10:18:50.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.748+0000 7f41eaffd640 1 -- 172.21.15.77:0/4171356634 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f41e40bf190 con 0x7f41ec101fa0 2024-04-21T10:18:50.747 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:50.747 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T10:18:50.748 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41d40a3bb0 msgr2=0x7f41d40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41d40a3bb0 0x7f41d40a6070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41e0005fd0 tx=0x7f41e0005ea0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 msgr2=0x7f41ec075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec075cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000c00 tx=0x7f41e4004270 comp rx=0 tx=0).stop 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 shutdown_connections 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41d40a3bb0 0x7f41d40a6070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41ec103b50 0x7f41ec074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41ec103190 0x7f41ec074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 --2- 172.21.15.77:0/4171356634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41ec101fa0 0x7f41ec075cb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:50.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 >> 172.21.15.77:0/4171356634 conn(0x7f41ec0fd530 msgr2=0x7f41ec106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:50.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 shutdown_connections 2024-04-21T10:18:50.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:50.750+0000 7f41f425c640 1 -- 172.21.15.77:0/4171356634 wait complete. 2024-04-21T10:18:51.135 INFO:journalctl@ceph.mds.j.smithi077.stdout:Apr 21 10:18:50 smithi077 systemd[1]: Started Ceph mds.j for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:18:51.920 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:51.920 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4171356634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:51.920 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:51.921 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:51.921 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:51.921 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:51.921 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:51.921 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:51 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4171356634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:51 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4171356634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:51 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:52.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:52.965 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:52 smithi077 ceph-mon[27902]: Deploying daemon mds.d on smithi077 2024-04-21T10:18:52.966 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:52 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.77:6834/3612886708,v1:172.21.15.77:6835/3612886708] up:boot 2024-04-21T10:18:52.966 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:52 smithi077 ceph-mon[27902]: fsmap 3 up:standby 2024-04-21T10:18:52.966 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:52 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 -- 172.21.15.77:0/284602065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c101fc0 msgr2=0x7f0c5c102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 --2- 172.21.15.77:0/284602065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c101fc0 0x7f0c5c102440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009900 tx=0x7f0c4802bc30 comp rx=0 tx=0).stop 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 -- 172.21.15.77:0/284602065 shutdown_connections 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 --2- 172.21.15.77:0/284602065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c101fc0 0x7f0c5c102440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 --2- 172.21.15.77:0/284602065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c5c102980 0x7f0c5c1092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 --2- 172.21.15.77:0/284602065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c100e70 0x7f0c5c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 -- 172.21.15.77:0/284602065 >> 172.21.15.77:0/284602065 conn(0x7f0c5c0fc3e0 msgr2=0x7f0c5c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 -- 172.21.15.77:0/284602065 shutdown_connections 2024-04-21T10:18:53.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.026+0000 7f0c6303f640 1 -- 172.21.15.77:0/284602065 wait complete. 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 Processor -- start 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 -- start start 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 0x7f0c5c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c5c101fc0 0x7f0c5c1975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c102980 0x7f0c5c19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c10c9a0 con 0x7f0c5c100e70 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c10c820 con 0x7f0c5c102980 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c6303f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c10cb20 con 0x7f0c5c101fc0 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 0x7f0c5c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 0x7f0c5c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35128/0 (socket says 172.21.15.77:35128) 2024-04-21T10:18:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 -- 172.21.15.77:0/3099296245 learned_addr learned my addr 172.21.15.77:0/3099296245 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c615dc640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c102980 0x7f0c5c19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 -- 172.21.15.77:0/3099296245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c5c101fc0 msgr2=0x7f0c5c1975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c5c101fc0 0x7f0c5c1975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 -- 172.21.15.77:0/3099296245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c102980 msgr2=0x7f0c5c19e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c102980 0x7f0c5c19e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c60ddb640 1 -- 172.21.15.77:0/3099296245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c19ecc0 con 0x7f0c5c100e70 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.027+0000 7f0c615dc640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c102980 0x7f0c5c19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.028+0000 7f0c60ddb640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 0x7f0c5c1970a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d950 tx=0x7f0c5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.028+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50017070 con 0x7f0c5c100e70 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.028+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c50009c30 con 0x7f0c5c100e70 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.028+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5c19efb0 con 0x7f0c5c100e70 2024-04-21T10:18:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.028+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000f620 con 0x7f0c5c100e70 2024-04-21T10:18:53.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.028+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5c19f470 con 0x7f0c5c100e70 2024-04-21T10:18:53.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.029+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5c108250 con 0x7f0c5c100e70 2024-04-21T10:18:53.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.030+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0c50010460 con 0x7f0c5c100e70 2024-04-21T10:18:53.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.031+0000 7f0c59ffb640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0c4c0a3bb0 0x7f0c4c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:53.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.031+0000 7f0c5bfff640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0c4c0a3bb0 0x7f0c4c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:53.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.031+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0c500cfc80 con 0x7f0c5c100e70 2024-04-21T10:18:53.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.031+0000 7f0c5bfff640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0c4c0a3bb0 0x7f0c4c0a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c48036040 tx=0x7f0c48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:53.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.035+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0c500d6080 con 0x7f0c5c100e70 2024-04-21T10:18:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:52 smithi170 ceph-mon[31212]: Deploying daemon mds.d on smithi077 2024-04-21T10:18:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:52 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.77:6834/3612886708,v1:172.21.15.77:6835/3612886708] up:boot 2024-04-21T10:18:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:52 smithi170 ceph-mon[31212]: fsmap 3 up:standby 2024-04-21T10:18:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:52 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T10:18:53.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:52 smithi191 ceph-mon[31636]: Deploying daemon mds.d on smithi077 2024-04-21T10:18:53.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:52 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.77:6834/3612886708,v1:172.21.15.77:6835/3612886708] up:boot 2024-04-21T10:18:53.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:52 smithi191 ceph-mon[31636]: fsmap 3 up:standby 2024-04-21T10:18:53.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:52 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T10:18:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.287+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c5c062c50 con 0x7f0c5c100e70 2024-04-21T10:18:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.288+0000 7f0c59ffb640 1 -- 172.21.15.77:0/3099296245 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7f0c5009caa0 con 0x7f0c5c100e70 2024-04-21T10:18:53.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:53.288 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T10:18:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 4 2024-04-21T10:18:53.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0c4c0a3bb0 msgr2=0x7f0c4c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0c4c0a3bb0 0x7f0c4c0a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c48036040 tx=0x7f0c48000bc0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 msgr2=0x7f0c5c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 0x7f0c5c1970a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d950 tx=0x7f0c5000de10 comp rx=0 tx=0).stop 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 shutdown_connections 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0c4c0a3bb0 0x7f0c4c0a6070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c102980 0x7f0c5c19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c5c101fc0 0x7f0c5c1975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 --2- 172.21.15.77:0/3099296245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c5c100e70 0x7f0c5c1970a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 >> 172.21.15.77:0/3099296245 conn(0x7f0c5c0fc3e0 msgr2=0x7f0c5c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 shutdown_connections 2024-04-21T10:18:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:53.291+0000 7f0c6303f640 1 -- 172.21.15.77:0/3099296245 wait complete. 2024-04-21T10:18:53.301 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 systemd[1]: Starting Ceph mds.d for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:18:53.555 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 podman[68422]: 2024-04-21 10:18:53.292919782 +0000 UTC m=+0.022116013 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:18:53.555 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 podman[68422]: 2024-04-21 10:18:53.41996975 +0000 UTC m=+0.149165959 container create 124a63c41e9d10cf17bb7da24977f24ef95490b797491d6bedd0a7969ee56d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-a630765, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-21T10:18:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:53 smithi191 ceph-mon[31636]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:53 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3099296245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:53 smithi170 ceph-mon[31212]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:53 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3099296245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:53 smithi077 ceph-mon[27902]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:53 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3099296245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:54.135 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 podman[68422]: 2024-04-21 10:18:53.693422018 +0000 UTC m=+0.422618229 container init 124a63c41e9d10cf17bb7da24977f24ef95490b797491d6bedd0a7969ee56d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-d, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-21T10:18:54.135 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 podman[68422]: 2024-04-21 10:18:53.696105301 +0000 UTC m=+0.425301514 container start 124a63c41e9d10cf17bb7da24977f24ef95490b797491d6bedd0a7969ee56d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-d, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-a630765) 2024-04-21T10:18:54.135 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 ceph-mds[68443]: -- 172.21.15.77:0/3173201691 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559031e85a40 con 0x559031e59000 2024-04-21T10:18:54.136 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-d[68439]: starting mds.d at 2024-04-21T10:18:54.136 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 bash[68422]: 124a63c41e9d10cf17bb7da24977f24ef95490b797491d6bedd0a7969ee56d7a 2024-04-21T10:18:54.136 INFO:journalctl@ceph.mds.d.smithi077.stdout:Apr 21 10:18:53 smithi077 systemd[1]: Started Ceph mds.d for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.77:6836/1731345826,v1:172.21.15.77:6837/1731345826] up:boot 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: fsmap 4 up:standby 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:54 smithi170 ceph-mon[31212]: Deploying daemon mds.e on smithi170 2024-04-21T10:18:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.77:6836/1731345826,v1:172.21.15.77:6837/1731345826] up:boot 2024-04-21T10:18:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: fsmap 4 up:standby 2024-04-21T10:18:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:54 smithi077 ceph-mon[27902]: Deploying daemon mds.e on smithi170 2024-04-21T10:18:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.77:6836/1731345826,v1:172.21.15.77:6837/1731345826] up:boot 2024-04-21T10:18:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: fsmap 4 up:standby 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:54 smithi191 ceph-mon[31636]: Deploying daemon mds.e on smithi170 2024-04-21T10:18:55.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:55.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 -- 172.21.15.77:0/2792091840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944102aa0 msgr2=0x7f9944104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 --2- 172.21.15.77:0/2792091840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944102aa0 0x7f9944104e90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9934009ca0 tx=0x7f993402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 -- 172.21.15.77:0/2792091840 shutdown_connections 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 --2- 172.21.15.77:0/2792091840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9944107d00 0x7f994410a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 --2- 172.21.15.77:0/2792091840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99441053d0 0x7f99441077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 --2- 172.21.15.77:0/2792091840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944102aa0 0x7f9944104e90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 -- 172.21.15.77:0/2792091840 >> 172.21.15.77:0/2792091840 conn(0x7f99440fc410 msgr2=0x7f99440fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 -- 172.21.15.77:0/2792091840 shutdown_connections 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 -- 172.21.15.77:0/2792091840 wait complete. 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 Processor -- start 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.417+0000 7f99492d2640 1 -- start start 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9944102aa0 0x7f99441981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:55.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99441053d0 0x7f9944198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 0x7f994419f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f994410dae0 con 0x7f9944107d00 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f994410d960 con 0x7f9944102aa0 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f994410dc60 con 0x7f99441053d0 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 0x7f994419f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 0x7f994419f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35172/0 (socket says 172.21.15.77:35172) 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 -- 172.21.15.77:0/106653960 learned_addr learned my addr 172.21.15.77:0/106653960 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99427fc640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99441053d0 0x7f9944198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f9942ffd640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9944102aa0 0x7f99441981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 -- 172.21.15.77:0/106653960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99441053d0 msgr2=0x7f9944198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99441053d0 0x7f9944198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 -- 172.21.15.77:0/106653960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9944102aa0 msgr2=0x7f99441981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9944102aa0 0x7f99441981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 -- 172.21.15.77:0/106653960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994419fdf0 con 0x7f9944107d00 2024-04-21T10:18:55.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99437fe640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 0x7f994419f780 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c970 tx=0x7f993c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:55.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c007bb0 con 0x7f9944107d00 2024-04-21T10:18:55.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99441a00e0 con 0x7f9944107d00 2024-04-21T10:18:55.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f993c007d50 con 0x7f9944107d00 2024-04-21T10:18:55.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.418+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c018770 con 0x7f9944107d00 2024-04-21T10:18:55.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.419+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a05e0 con 0x7f9944107d00 2024-04-21T10:18:55.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.419+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99440fdf00 con 0x7f9944107d00 2024-04-21T10:18:55.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.421+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f993c00f990 con 0x7f9944107d00 2024-04-21T10:18:55.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.421+0000 7f992bfff640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f992c0a3bb0 0x7f992c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:55.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.421+0000 7f9942ffd640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f992c0a3bb0 0x7f992c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:55.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.421+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f993c0d0020 con 0x7f9944107d00 2024-04-21T10:18:55.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.422+0000 7f9942ffd640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f992c0a3bb0 0x7f992c0a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9934000f80 tx=0x7f9934009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:55.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.426+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f993c014030 con 0x7f9944107d00 2024-04-21T10:18:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.643+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9944062b50 con 0x7f9944107d00 2024-04-21T10:18:55.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.644+0000 7f992bfff640 1 -- 172.21.15.77:0/106653960 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f993c09cea0 con 0x7f9944107d00 2024-04-21T10:18:55.644 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:55.644 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T10:18:55.644 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 5 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f992c0a3bb0 msgr2=0x7f992c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f992c0a3bb0 0x7f992c0a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9934000f80 tx=0x7f9934009360 comp rx=0 tx=0).stop 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 msgr2=0x7f994419f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 0x7f994419f780 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c970 tx=0x7f993c00ce30 comp rx=0 tx=0).stop 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 shutdown_connections 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f992c0a3bb0 0x7f992c0a6070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944107d00 0x7f994419f780 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99441053d0 0x7f9944198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 --2- 172.21.15.77:0/106653960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9944102aa0 0x7f99441981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 >> 172.21.15.77:0/106653960 conn(0x7f99440fc410 msgr2=0x7f9944103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 shutdown_connections 2024-04-21T10:18:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:55.646+0000 7f99492d2640 1 -- 172.21.15.77:0/106653960 wait complete. 2024-04-21T10:18:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:55 smithi077 ceph-mon[27902]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:55 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/106653960' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:56.148 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:55 smithi170 ceph-mon[31212]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:56.148 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:55 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/106653960' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:56.148 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 systemd[1]: Starting Ceph mds.e for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:18:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:55 smithi191 ceph-mon[31636]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:55 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/106653960' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:56.400 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 podman[61378]: 2024-04-21 10:18:56.26821639 +0000 UTC m=+0.018005166 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:18:56.400 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 podman[61378]: 2024-04-21 10:18:56.400935525 +0000 UTC m=+0.150724326 container create aabf9088ef7191edeb4d49aa6d6a315e261a88881f878dd3b61ff78a15c7bd0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-a630765, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True) 2024-04-21T10:18:57.056 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 podman[61378]: 2024-04-21 10:18:56.686991385 +0000 UTC m=+0.436780143 container init aabf9088ef7191edeb4d49aa6d6a315e261a88881f878dd3b61ff78a15c7bd0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-a630765, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-21T10:18:57.057 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 podman[61378]: 2024-04-21 10:18:56.689805188 +0000 UTC m=+0.439593955 container start aabf9088ef7191edeb4d49aa6d6a315e261a88881f878dd3b61ff78a15c7bd0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-e, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-a630765, ceph=True, org.label-schema.license=GPLv2) 2024-04-21T10:18:57.057 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 ceph-mds[61397]: -- 172.21.15.170:0/368509596 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e69bf3a40 con 0x559e69bc6c00 2024-04-21T10:18:57.057 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-e[61393]: starting mds.e at 2024-04-21T10:18:57.057 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 bash[61378]: aabf9088ef7191edeb4d49aa6d6a315e261a88881f878dd3b61ff78a15c7bd0a 2024-04-21T10:18:57.057 INFO:journalctl@ceph.mds.e.smithi170.stdout:Apr 21 10:18:56 smithi170 systemd[1]: Started Ceph mds.e for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:18:57.658 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.768+0000 7fe258426640 1 -- 172.21.15.77:0/281012201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250102a00 msgr2=0x7fe250104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.768+0000 7fe258426640 1 --2- 172.21.15.77:0/281012201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250102a00 0x7fe250104df0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009900 tx=0x7fe24c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- 172.21.15.77:0/281012201 shutdown_connections 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 --2- 172.21.15.77:0/281012201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe250107c60 0x7fe25010a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 --2- 172.21.15.77:0/281012201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250105330 0x7fe250107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 --2- 172.21.15.77:0/281012201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250102a00 0x7fe250104df0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- 172.21.15.77:0/281012201 >> 172.21.15.77:0/281012201 conn(0x7fe2500fc410 msgr2=0x7fe2500fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- 172.21.15.77:0/281012201 shutdown_connections 2024-04-21T10:18:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- 172.21.15.77:0/281012201 wait complete. 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 Processor -- start 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- start start 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe250102a00 0x7fe2501981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 0x7fe250198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250107c60 0x7fe25019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe25010dad0 con 0x7fe250105330 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe25010d950 con 0x7fe250107c60 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe258426640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe25010dc50 con 0x7fe250102a00 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.769+0000 7fe2559c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 0x7fe250198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 0x7fe250198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35180/0 (socket says 172.21.15.77:35180) 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 -- 172.21.15.77:0/2456095315 learned_addr learned my addr 172.21.15.77:0/2456095315 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2569c3640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250107c60 0x7fe25019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 -- 172.21.15.77:0/2456095315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe250102a00 msgr2=0x7fe2501981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe250102a00 0x7fe2501981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 -- 172.21.15.77:0/2456095315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250107c60 msgr2=0x7fe25019f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250107c60 0x7fe25019f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 -- 172.21.15.77:0/2456095315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25019fdf0 con 0x7fe250105330 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2569c3640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250107c60 0x7fe25019f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2559c1640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 0x7fe250198710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe24000d770 tx=0x7fe24000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240017070 con 0x7fe250105330 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe240009c30 con 0x7fe250105330 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24000f620 con 0x7fe250105330 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2501a00e0 con 0x7fe250105330 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.770+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2501a0630 con 0x7fe250105330 2024-04-21T10:18:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.771+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2500fdf00 con 0x7fe250105330 2024-04-21T10:18:57.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.772+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe24001a070 con 0x7fe250105330 2024-04-21T10:18:57.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.773+0000 7fe2477fe640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe23c0a3bb0 0x7fe23c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:18:57.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.773+0000 7fe2561c2640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe23c0a3bb0 0x7fe23c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:18:57.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.773+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe2400cfb70 con 0x7fe250105330 2024-04-21T10:18:57.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.773+0000 7fe2561c2640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe23c0a3bb0 0x7fe23c0a6070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe24c036040 tx=0x7fe24c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:18:57.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.777+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe240009de0 con 0x7fe250105330 2024-04-21T10:18:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.995+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe25002d5c0 con 0x7fe250105330 2024-04-21T10:18:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.996+0000 7fe2477fe640 1 -- 172.21.15.77:0/2456095315 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7fe24009c9f0 con 0x7fe250105330 2024-04-21T10:18:57.996 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:18:57.996 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T10:18:57.996 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 6 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe23c0a3bb0 msgr2=0x7fe23c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe23c0a3bb0 0x7fe23c0a6070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe24c036040 tx=0x7fe24c000bc0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 msgr2=0x7fe250198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 0x7fe250198710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe24000d770 tx=0x7fe24000dc30 comp rx=0 tx=0).stop 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 shutdown_connections 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe23c0a3bb0 0x7fe23c0a6070 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe250105330 0x7fe250198710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe250107c60 0x7fe25019f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 --2- 172.21.15.77:0/2456095315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe250102a00 0x7fe2501981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 >> 172.21.15.77:0/2456095315 conn(0x7fe2500fc410 msgr2=0x7fe2501034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 shutdown_connections 2024-04-21T10:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:18:57.998+0000 7fe258426640 1 -- 172.21.15.77:0/2456095315 wait complete. 2024-04-21T10:18:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6834/2565539323,v1:172.21.15.170:6835/2565539323] up:boot 2024-04-21T10:18:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: fsmap 5 up:standby 2024-04-21T10:18:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T10:18:58.010 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.010 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:58.010 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:58.010 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:57 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:58.069 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:58.069 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6834/2565539323,v1:172.21.15.170:6835/2565539323] up:boot 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: fsmap 5 up:standby 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:58.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:57 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:18:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6834/2565539323,v1:172.21.15.170:6835/2565539323] up:boot 2024-04-21T10:18:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: fsmap 5 up:standby 2024-04-21T10:18:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T10:18:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:18:58.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:18:58.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:18:58.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:57 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:18:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:58 smithi077 ceph-mon[27902]: Deploying daemon mds.f on smithi191 2024-04-21T10:18:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:58 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2456095315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:58 smithi191 ceph-mon[31636]: Deploying daemon mds.f on smithi191 2024-04-21T10:18:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:58 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2456095315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:59.219 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 systemd[1]: Starting Ceph mds.f for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:18:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:58 smithi170 ceph-mon[31212]: Deploying daemon mds.f on smithi191 2024-04-21T10:18:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:58 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2456095315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:18:59.588 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 podman[61687]: 2024-04-21 10:18:59.22212071 +0000 UTC m=+0.018064989 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:18:59.588 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 podman[61687]: 2024-04-21 10:18:59.360061703 +0000 UTC m=+0.156005978 container create 2111e919df1670f8121551bd43b41ae1e4cc214d1a6ced79ab58d89f7b0667c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-a630765, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T10:18:59.588 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 podman[61687]: 2024-04-21 10:18:59.588608386 +0000 UTC m=+0.384552677 container init 2111e919df1670f8121551bd43b41ae1e4cc214d1a6ced79ab58d89f7b0667c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-a630765, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-21T10:18:59.854 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 podman[61687]: 2024-04-21 10:18:59.591461247 +0000 UTC m=+0.387405521 container start 2111e919df1670f8121551bd43b41ae1e4cc214d1a6ced79ab58d89f7b0667c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-21T10:18:59.854 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mds[61706]: -- 172.21.15.191:0/3240273072 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646cbfe7a40 con 0x5646cbfbb000 2024-04-21T10:18:59.854 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-f[61702]: starting mds.f at 2024-04-21T10:18:59.854 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 bash[61687]: 2111e919df1670f8121551bd43b41ae1e4cc214d1a6ced79ab58d89f7b0667c1 2024-04-21T10:18:59.854 INFO:journalctl@ceph.mds.f.smithi191.stdout:Apr 21 10:18:59 smithi191 systemd[1]: Started Ceph mds.f for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:00.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:18:59 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 -- 172.21.15.77:0/2373388921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118101f90 msgr2=0x7f41181023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 --2- 172.21.15.77:0/2373388921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118101f90 0x7f41181023b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f410c009900 tx=0x7f410c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 -- 172.21.15.77:0/2373388921 shutdown_connections 2024-04-21T10:19:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 --2- 172.21.15.77:0/2373388921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4118103b40 0x7f411810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 --2- 172.21.15.77:0/2373388921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4118103180 0x7f4118103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 --2- 172.21.15.77:0/2373388921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118101f90 0x7f41181023b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 -- 172.21.15.77:0/2373388921 >> 172.21.15.77:0/2373388921 conn(0x7f41180fd500 msgr2=0x7f41180ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 -- 172.21.15.77:0/2373388921 shutdown_connections 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 -- 172.21.15.77:0/2373388921 wait complete. 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 Processor -- start 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.120+0000 7f411ee11640 1 -- start start 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4118101f90 0x7f4118198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4118103180 0x7f4118198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 0x7f411819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f411810db30 con 0x7f4118103b40 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f411810d9b0 con 0x7f4118101f90 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f411810dcb0 con 0x7f4118103180 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 0x7f411819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 0x7f411819f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35188/0 (socket says 172.21.15.77:35188) 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 -- 172.21.15.77:0/3844584233 learned_addr learned my addr 172.21.15.77:0/3844584233 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411cbad640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4118101f90 0x7f4118198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f4117fff640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4118103180 0x7f4118198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 -- 172.21.15.77:0/3844584233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4118103180 msgr2=0x7f4118198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4118103180 0x7f4118198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 -- 172.21.15.77:0/3844584233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4118101f90 msgr2=0x7f4118198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4118101f90 0x7f4118198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 -- 172.21.15.77:0/3844584233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411819fe30 con 0x7f4118103b40 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411d3ae640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 0x7f411819f7c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f411000eaa0 tx=0x7f411000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110004d20 con 0x7f4118103b40 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4110005020 con 0x7f4118103b40 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41100116b0 con 0x7f4118103b40 2024-04-21T10:19:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.121+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41181a0120 con 0x7f4118103b40 2024-04-21T10:19:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.122+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41181a0740 con 0x7f4118103b40 2024-04-21T10:19:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.123+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4118109330 con 0x7f4118103b40 2024-04-21T10:19:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.124+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f41100051d0 con 0x7f4118103b40 2024-04-21T10:19:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.124+0000 7f4115ffb640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41080a3c30 0x7f41080a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.124+0000 7f411cbad640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41080a3c30 0x7f41080a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.124+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f41100d0040 con 0x7f4118103b40 2024-04-21T10:19:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.125+0000 7f411cbad640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41080a3c30 0x7f41080a60f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f410c005ab0 tx=0x7f410c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.129+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4110016030 con 0x7f4118103b40 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:18:59 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:18:59 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:00.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.345+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4118062b50 con 0x7f4118103b40 2024-04-21T10:19:00.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.345+0000 7f4115ffb640 1 -- 172.21.15.77:0/3844584233 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7f411009cec0 con 0x7f4118103b40 2024-04-21T10:19:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:00.345 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-21T10:19:00.346 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.347+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41080a3c30 msgr2=0x7f41080a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.347+0000 7f411ee11640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41080a3c30 0x7f41080a60f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f410c005ab0 tx=0x7f410c005fd0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.347+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 msgr2=0x7f411819f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.347+0000 7f411ee11640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 0x7f411819f7c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f411000eaa0 tx=0x7f411000eea0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 shutdown_connections 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f41080a3c30 0x7f41080a60f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4118103b40 0x7f411819f7c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4118103180 0x7f4118198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 --2- 172.21.15.77:0/3844584233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4118101f90 0x7f4118198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 >> 172.21.15.77:0/3844584233 conn(0x7f41180fd500 msgr2=0x7f4118106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:00.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 shutdown_connections 2024-04-21T10:19:00.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:00.348+0000 7f411ee11640 1 -- 172.21.15.77:0/3844584233 wait complete. 2024-04-21T10:19:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:00 smithi191 ceph-mon[31636]: Deploying daemon mds.c on smithi191 2024-04-21T10:19:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:00 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6834/2650789974,v1:172.21.15.191:6835/2650789974] up:boot 2024-04-21T10:19:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:00 smithi191 ceph-mon[31636]: fsmap 6 up:standby 2024-04-21T10:19:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:00 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T10:19:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:00 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3844584233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:00 smithi077 ceph-mon[27902]: Deploying daemon mds.c on smithi191 2024-04-21T10:19:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:00 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6834/2650789974,v1:172.21.15.191:6835/2650789974] up:boot 2024-04-21T10:19:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:00 smithi077 ceph-mon[27902]: fsmap 6 up:standby 2024-04-21T10:19:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:00 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T10:19:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:00 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3844584233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:00 smithi170 ceph-mon[31212]: Deploying daemon mds.c on smithi191 2024-04-21T10:19:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:00 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6834/2650789974,v1:172.21.15.191:6835/2650789974] up:boot 2024-04-21T10:19:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:00 smithi170 ceph-mon[31212]: fsmap 6 up:standby 2024-04-21T10:19:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:00 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T10:19:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:00 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3844584233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:01 smithi077 ceph-mon[27902]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:02.146 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:01 smithi191 ceph-mon[31636]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:02.146 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:01 smithi191 systemd[1]: Starting Ceph mds.c for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:19:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:01 smithi170 ceph-mon[31212]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:02.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:02.465 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 podman[61998]: 2024-04-21 10:19:02.049887519 +0000 UTC m=+0.017999936 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:19:02.466 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 podman[61998]: 2024-04-21 10:19:02.213275291 +0000 UTC m=+0.181387694 container create 949befae87e9bec468d26120bc02e512203df9f1114cf4b6ba0115e5491ec9c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiescer-a630765, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 -- 172.21.15.77:0/1960795085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4103180 msgr2=0x7fc8d4103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 --2- 172.21.15.77:0/1960795085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4103180 0x7fc8d4103600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009900 tx=0x7fc8c802bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 -- 172.21.15.77:0/1960795085 shutdown_connections 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 --2- 172.21.15.77:0/1960795085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4103180 0x7fc8d4103600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 --2- 172.21.15.77:0/1960795085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8d4103b40 0x7fc8d410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 --2- 172.21.15.77:0/1960795085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8d4101f90 0x7fc8d41023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 -- 172.21.15.77:0/1960795085 >> 172.21.15.77:0/1960795085 conn(0x7fc8d40fd500 msgr2=0x7fc8d40ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 -- 172.21.15.77:0/1960795085 shutdown_connections 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.471+0000 7fc8db826640 1 -- 172.21.15.77:0/1960795085 wait complete. 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 Processor -- start 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 -- start start 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 0x7fc8d41981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8d4103180 0x7fc8d41986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8d4103b40 0x7fc8d419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d410dad0 con 0x7fc8d4101f90 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d410d950 con 0x7fc8d4103180 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8db826640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d410dc50 con 0x7fc8d4103b40 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 0x7fc8d41981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 0x7fc8d41981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37478/0 (socket says 172.21.15.77:37478) 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 -- 172.21.15.77:0/867173963 learned_addr learned my addr 172.21.15.77:0/867173963 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d9dc3640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8d4103b40 0x7fc8d419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d8dc1640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8d4103180 0x7fc8d41986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 -- 172.21.15.77:0/867173963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8d4103b40 msgr2=0x7fc8d419f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8d4103b40 0x7fc8d419f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 -- 172.21.15.77:0/867173963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8d4103180 msgr2=0x7fc8d41986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8d4103180 0x7fc8d41986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 -- 172.21.15.77:0/867173963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d419fdd0 con 0x7fc8d4101f90 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.472+0000 7fc8d95c2640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 0x7fc8d41981b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00e9c0 tx=0x7fc8cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.473+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00cd80 con 0x7fc8d4101f90 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.473+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d41a00c0 con 0x7fc8d4101f90 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.473+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8cc0035f0 con 0x7fc8d4101f90 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.473+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc010690 con 0x7fc8d4101f90 2024-04-21T10:19:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.473+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41a05c0 con 0x7fc8d4101f90 2024-04-21T10:19:02.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.474+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d4109330 con 0x7fc8d4101f90 2024-04-21T10:19:02.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.475+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc8cc004000 con 0x7fc8d4101f90 2024-04-21T10:19:02.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.475+0000 7fc8d27fc640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8bc0a3bb0 0x7fc8bc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:02.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.475+0000 7fc8d8dc1640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8bc0a3bb0 0x7fc8bc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:02.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.476+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc8cc0d0500 con 0x7fc8d4101f90 2024-04-21T10:19:02.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.476+0000 7fc8d8dc1640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8bc0a3bb0 0x7fc8bc0a6070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8d41996c0 tx=0x7fc8c8005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:02.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.480+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc8cc09d380 con 0x7fc8d4101f90 2024-04-21T10:19:02.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.700+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8d402d5c0 con 0x7fc8d4101f90 2024-04-21T10:19:02.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.700+0000 7fc8d27fc640 1 -- 172.21.15.77:0/867173963 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7fc8cc09cc80 con 0x7fc8d4101f90 2024-04-21T10:19:02.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:02.700 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-21T10:19:02.701 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-21T10:19:02.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8bc0a3bb0 msgr2=0x7fc8bc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:02.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8bc0a3bb0 0x7fc8bc0a6070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8d41996c0 tx=0x7fc8c8005be0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 msgr2=0x7fc8d41981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:02.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 0x7fc8d41981b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00e9c0 tx=0x7fc8cc00ee80 comp rx=0 tx=0).stop 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 shutdown_connections 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8bc0a3bb0 0x7fc8bc0a6070 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8d4103b40 0x7fc8d419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8d4103180 0x7fc8d41986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 --2- 172.21.15.77:0/867173963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d4101f90 0x7fc8d41981b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 >> 172.21.15.77:0/867173963 conn(0x7fc8d40fd500 msgr2=0x7fc8d4106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 shutdown_connections 2024-04-21T10:19:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:02.702+0000 7fc8db826640 1 -- 172.21.15.77:0/867173963 wait complete. 2024-04-21T10:19:02.718 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 podman[61998]: 2024-04-21 10:19:02.467026214 +0000 UTC m=+0.435138617 container init 949befae87e9bec468d26120bc02e512203df9f1114cf4b6ba0115e5491ec9c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T10:19:02.718 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 podman[61998]: 2024-04-21 10:19:02.469579089 +0000 UTC m=+0.437691493 container start 949befae87e9bec468d26120bc02e512203df9f1114cf4b6ba0115e5491ec9c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-a630765, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-21T10:19:02.718 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 ceph-mds[62017]: -- 172.21.15.191:0/1735521435 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b96bdfa40 con 0x556b96bb2800 2024-04-21T10:19:02.718 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-c[62013]: starting mds.c at 2024-04-21T10:19:02.718 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 bash[61998]: 949befae87e9bec468d26120bc02e512203df9f1114cf4b6ba0115e5491ec9c4 2024-04-21T10:19:02.718 INFO:journalctl@ceph.mds.c.smithi191.stdout:Apr 21 10:19:02 smithi191 systemd[1]: Started Ceph mds.c for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: Deploying daemon mds.h on smithi170 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/867173963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6836/2009641600,v1:172.21.15.191:6837/2009641600] up:boot 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: fsmap 7 up:standby 2024-04-21T10:19:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:03 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T10:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: Deploying daemon mds.h on smithi170 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/867173963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6836/2009641600,v1:172.21.15.191:6837/2009641600] up:boot 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: fsmap 7 up:standby 2024-04-21T10:19:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:03 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T10:19:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: Deploying daemon mds.h on smithi170 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/867173963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6836/2009641600,v1:172.21.15.191:6837/2009641600] up:boot 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: fsmap 7 up:standby 2024-04-21T10:19:04.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:03 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T10:19:04.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 -- 172.21.15.77:0/264027681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 msgr2=0x7f6ee8104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/264027681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8104e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009900 tx=0x7f6ee402bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 -- 172.21.15.77:0/264027681 shutdown_connections 2024-04-21T10:19:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/264027681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ee8107cc0 0x7f6ee810a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/264027681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8105390 0x7f6ee8107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/264027681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8104e50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 -- 172.21.15.77:0/264027681 >> 172.21.15.77:0/264027681 conn(0x7f6ee80fc410 msgr2=0x7f6ee80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 -- 172.21.15.77:0/264027681 shutdown_connections 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.824+0000 7f6ef02ba640 1 -- 172.21.15.77:0/264027681 wait complete. 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 Processor -- start 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 -- start start 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ee8105390 0x7f6ee81987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8107cc0 0x7f6ee819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810db20 con 0x7f6ee8102a60 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810d9a0 con 0x7f6ee8105390 2024-04-21T10:19:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6ef02ba640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810dca0 con 0x7f6ee8107cc0 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37490/0 (socket says 172.21.15.77:37490) 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 -- 172.21.15.77:0/3133612023 learned_addr learned my addr 172.21.15.77:0/3133612023 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eed855640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ee8105390 0x7f6ee81987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee857640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8107cc0 0x7f6ee819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 -- 172.21.15.77:0/3133612023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8107cc0 msgr2=0x7f6ee819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8107cc0 0x7f6ee819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 -- 172.21.15.77:0/3133612023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ee8105390 msgr2=0x7f6ee81987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ee8105390 0x7f6ee81987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee056640 1 -- 172.21.15.77:0/3133612023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee819fe90 con 0x7f6ee8102a60 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.825+0000 7f6eee857640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8107cc0 0x7f6ee819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.826+0000 7f6eee056640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8198270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4006010 tx=0x7f6ee40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.826+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4043020 con 0x7f6ee8102a60 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.826+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee4004aa0 con 0x7f6ee8102a60 2024-04-21T10:19:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.826+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee81a0120 con 0x7f6ee8102a60 2024-04-21T10:19:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.826+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4003bb0 con 0x7f6ee8102a60 2024-04-21T10:19:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.826+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81a0670 con 0x7f6ee8102a60 2024-04-21T10:19:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.827+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee80fdf00 con 0x7f6ee8102a60 2024-04-21T10:19:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.828+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6ee4046020 con 0x7f6ee8102a60 2024-04-21T10:19:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.828+0000 7f6edf7fe640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6ed40a3bb0 0x7f6ed40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.829+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6ee40f2a00 con 0x7f6ee8102a60 2024-04-21T10:19:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.829+0000 7f6eed855640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6ed40a3bb0 0x7f6ed40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.829+0000 7f6eed855640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6ed40a3bb0 0x7f6ed40a6070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8199780 tx=0x7f6ed8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:04.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:04.832+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ee404d020 con 0x7f6ee8102a60 2024-04-21T10:19:05.030 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:04 smithi170 systemd[1]: Starting Ceph mds.h for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:19:05.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.047+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ee802d5c0 con 0x7f6ee8102a60 2024-04-21T10:19:05.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.048+0000 7f6edf7fe640 1 -- 172.21.15.77:0/3133612023 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7f6ee40bf880 con 0x7f6ee8102a60 2024-04-21T10:19:05.047 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:05.047 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-21T10:19:05.048 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6ed40a3bb0 msgr2=0x7f6ed40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6ed40a3bb0 0x7f6ed40a6070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8199780 tx=0x7f6ed8009110 comp rx=0 tx=0).stop 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 msgr2=0x7f6ee8198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8198270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4006010 tx=0x7f6ee40042f0 comp rx=0 tx=0).stop 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 shutdown_connections 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6ed40a3bb0 0x7f6ed40a6070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ee8107cc0 0x7f6ee819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ee8105390 0x7f6ee81987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 --2- 172.21.15.77:0/3133612023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8102a60 0x7f6ee8198270 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 >> 172.21.15.77:0/3133612023 conn(0x7f6ee80fc410 msgr2=0x7f6ee81033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 shutdown_connections 2024-04-21T10:19:05.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:05.050+0000 7f6ef02ba640 1 -- 172.21.15.77:0/3133612023 wait complete. 2024-04-21T10:19:05.307 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 podman[61684]: 2024-04-21 10:19:04.93325841 +0000 UTC m=+0.018106674 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:19:05.307 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 podman[61684]: 2024-04-21 10:19:05.056968959 +0000 UTC m=+0.141817223 container create c53718f14098058b31e4cfe1c038eb96f1b436c677a130ffc28fdc71bbe5bbcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-21T10:19:05.726 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 podman[61684]: 2024-04-21 10:19:05.318495586 +0000 UTC m=+0.403343851 container init c53718f14098058b31e4cfe1c038eb96f1b436c677a130ffc28fdc71bbe5bbcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T10:19:05.727 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 podman[61684]: 2024-04-21 10:19:05.321072423 +0000 UTC m=+0.405920688 container start c53718f14098058b31e4cfe1c038eb96f1b436c677a130ffc28fdc71bbe5bbcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T10:19:05.727 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mds[61704]: -- 172.21.15.170:0/2915378140 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e172dfa40 con 0x561e172b2800 2024-04-21T10:19:05.727 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-h[61700]: starting mds.h at 2024-04-21T10:19:05.727 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 bash[61684]: c53718f14098058b31e4cfe1c038eb96f1b436c677a130ffc28fdc71bbe5bbcc 2024-04-21T10:19:05.727 INFO:journalctl@ceph.mds.h.smithi170.stdout:Apr 21 10:19:05 smithi170 systemd[1]: Started Ceph mds.h for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3133612023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:05 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:06.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:06.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3133612023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:06.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:06.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:06.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:05 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3133612023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:05 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:06 smithi077 ceph-mon[27902]: Deploying daemon mds.i on smithi191 2024-04-21T10:19:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:06 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] up:boot 2024-04-21T10:19:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:06 smithi077 ceph-mon[27902]: fsmap 8 up:standby 2024-04-21T10:19:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:06 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T10:19:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:06 smithi170 ceph-mon[31212]: Deploying daemon mds.i on smithi191 2024-04-21T10:19:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:06 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] up:boot 2024-04-21T10:19:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:06 smithi170 ceph-mon[31212]: fsmap 8 up:standby 2024-04-21T10:19:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:06 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T10:19:07.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:07.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:06 smithi191 ceph-mon[31636]: Deploying daemon mds.i on smithi191 2024-04-21T10:19:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:06 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] up:boot 2024-04-21T10:19:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:06 smithi191 ceph-mon[31636]: fsmap 8 up:standby 2024-04-21T10:19:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:06 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T10:19:07.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- 172.21.15.77:0/3753038964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 msgr2=0x7fef001092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:07.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- 172.21.15.77:0/3753038964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef001092a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feee8009900 tx=0x7feee802bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:07.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- 172.21.15.77:0/3753038964 shutdown_connections 2024-04-21T10:19:07.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- 172.21.15.77:0/3753038964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef001092a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- 172.21.15.77:0/3753038964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef00101fc0 0x7fef00102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- 172.21.15.77:0/3753038964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00100e70 0x7fef00101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- 172.21.15.77:0/3753038964 >> 172.21.15.77:0/3753038964 conn(0x7fef000fc3e0 msgr2=0x7fef000fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- 172.21.15.77:0/3753038964 shutdown_connections 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- 172.21.15.77:0/3753038964 wait complete. 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 Processor -- start 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- start start 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef00100e70 0x7fef00197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00101fc0 0x7fef00197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef0019e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010c9c0 con 0x7fef00102980 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010c840 con 0x7fef00100e70 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef06db2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010cb40 con 0x7fef00101fc0 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.164+0000 7fef0534f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef0019e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef0019e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37504/0 (socket says 172.21.15.77:37504) 2024-04-21T10:19:07.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 -- 172.21.15.77:0/723525343 learned_addr learned my addr 172.21.15.77:0/723525343 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef04b4e640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef00100e70 0x7fef00197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7feefffff640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00101fc0 0x7fef00197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 -- 172.21.15.77:0/723525343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00101fc0 msgr2=0x7fef00197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00101fc0 0x7fef00197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 -- 172.21.15.77:0/723525343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef00100e70 msgr2=0x7fef00197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef00100e70 0x7fef00197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 -- 172.21.15.77:0/723525343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0019ec30 con 0x7fef00102980 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7feefffff640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00101fc0 0x7fef00197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef0534f640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef0019e5c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feee8009230 tx=0x7feee80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8043020 con 0x7fef00102980 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee8004aa0 con 0x7fef00102980 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0019eec0 con 0x7fef00102980 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8003c70 con 0x7fef00102980 2024-04-21T10:19:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.165+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0019f380 con 0x7fef00102980 2024-04-21T10:19:07.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.166+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef00108180 con 0x7fef00102980 2024-04-21T10:19:07.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.167+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7feee8046020 con 0x7fef00102980 2024-04-21T10:19:07.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.168+0000 7feefdffb640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feeec0a3bb0 0x7feeec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:07.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.168+0000 7fef04b4e640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feeec0a3bb0 0x7feeec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:07.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.168+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7feee80f2320 con 0x7fef00102980 2024-04-21T10:19:07.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.168+0000 7fef04b4e640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feeec0a3bb0 0x7feeec0a6070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feef8005fd0 tx=0x7feef8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:07.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.172+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feee804d020 con 0x7fef00102980 2024-04-21T10:19:07.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.385+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef0002d5c0 con 0x7fef00102980 2024-04-21T10:19:07.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.386+0000 7feefdffb640 1 -- 172.21.15.77:0/723525343 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7186 (secure 0 0 0) 0x7feee80bf1a0 con 0x7fef00102980 2024-04-21T10:19:07.386 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:07.386 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-21T10:19:07.386 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feeec0a3bb0 msgr2=0x7feeec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feeec0a3bb0 0x7feeec0a6070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feef8005fd0 tx=0x7feef8009680 comp rx=0 tx=0).stop 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 msgr2=0x7fef0019e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef0019e5c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feee8009230 tx=0x7feee80042f0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 shutdown_connections 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feeec0a3bb0 0x7feeec0a6070 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef00102980 0x7fef0019e5c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef00101fc0 0x7fef00197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 --2- 172.21.15.77:0/723525343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef00100e70 0x7fef00197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 >> 172.21.15.77:0/723525343 conn(0x7fef000fc3e0 msgr2=0x7fef00105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 shutdown_connections 2024-04-21T10:19:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:07.388+0000 7fef06db2640 1 -- 172.21.15.77:0/723525343 wait complete. 2024-04-21T10:19:07.718 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:07 smithi191 systemd[1]: Starting Ceph mds.i for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:19:07.995 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:07 smithi191 ceph-mon[31636]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:07.995 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:07 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/723525343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:07.995 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:07 smithi191 podman[62307]: 2024-04-21 10:19:07.710280448 +0000 UTC m=+0.017943959 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:19:07.996 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:07 smithi191 podman[62307]: 2024-04-21 10:19:07.849594684 +0000 UTC m=+0.157258226 container create 011dfd7e118574a97c414231dc7881dd39c651816991803786f4d38c12d14c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-a630765) 2024-04-21T10:19:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:07 smithi170 ceph-mon[31212]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:07 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/723525343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:07 smithi077 ceph-mon[27902]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:07 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/723525343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:08.469 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:08 smithi191 podman[62307]: 2024-04-21 10:19:08.094771897 +0000 UTC m=+0.402435396 container init 011dfd7e118574a97c414231dc7881dd39c651816991803786f4d38c12d14c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-21T10:19:08.469 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:08 smithi191 podman[62307]: 2024-04-21 10:19:08.097372205 +0000 UTC m=+0.405035705 container start 011dfd7e118574a97c414231dc7881dd39c651816991803786f4d38c12d14c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-21T10:19:08.469 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:08 smithi191 ceph-mds[62326]: -- 172.21.15.191:0/1401171126 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf5a4f1a40 con 0x55cf5a4c4c00 2024-04-21T10:19:08.469 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:08 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i[62322]: starting mds.i at 2024-04-21T10:19:08.469 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:08 smithi191 bash[62307]: 011dfd7e118574a97c414231dc7881dd39c651816991803786f4d38c12d14c5c 2024-04-21T10:19:08.469 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:08 smithi191 systemd[1]: Started Ceph mds.i for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:09.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: Deploying daemon mds.g on smithi077 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:boot 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: fsmap 9 up:standby 2024-04-21T10:19:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:09 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T10:19:09.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 -- 172.21.15.77:0/143648655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880101f20 msgr2=0x7f1880102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:09.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 --2- 172.21.15.77:0/143648655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880101f20 0x7f1880102360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1870009900 tx=0x7f187002bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:09.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 -- 172.21.15.77:0/143648655 shutdown_connections 2024-04-21T10:19:09.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 --2- 172.21.15.77:0/143648655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1880103ab0 0x7f188010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 --2- 172.21.15.77:0/143648655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 0x7f1880103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 --2- 172.21.15.77:0/143648655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880101f20 0x7f1880102360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 -- 172.21.15.77:0/143648655 >> 172.21.15.77:0/143648655 conn(0x7f18800fd500 msgr2=0x7f18800ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 -- 172.21.15.77:0/143648655 shutdown_connections 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.504+0000 7f1884c8c640 1 -- 172.21.15.77:0/143648655 wait complete. 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 Processor -- start 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 -- start start 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1880101f20 0x7f1880198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 0x7f1880198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 0x7f188019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f188010db20 con 0x7f1880103ab0 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f188010d9a0 con 0x7f1880101f20 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f1884c8c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f188010dca0 con 0x7f18801030f0 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 0x7f188019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 0x7f188019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37522/0 (socket says 172.21.15.77:37522) 2024-04-21T10:19:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 -- 172.21.15.77:0/3327647363 learned_addr learned my addr 172.21.15.77:0/3327647363 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187dd9b640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 0x7f1880198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187e59c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1880101f20 0x7f1880198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 -- 172.21.15.77:0/3327647363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 msgr2=0x7f1880198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 0x7f1880198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 -- 172.21.15.77:0/3327647363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1880101f20 msgr2=0x7f1880198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1880101f20 0x7f1880198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187ed9d640 1 -- 172.21.15.77:0/3327647363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188019fe50 con 0x7f1880103ab0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.505+0000 7f187dd9b640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 0x7f1880198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.506+0000 7f187ed9d640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 0x7f188019f7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f187800b970 tx=0x7f187800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.506+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878019070 con 0x7f1880103ab0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.506+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18801a0140 con 0x7f1880103ab0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.506+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1878014440 con 0x7f1880103ab0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.506+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780075d0 con 0x7f1880103ab0 2024-04-21T10:19:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.506+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801a06c0 con 0x7f1880103ab0 2024-04-21T10:19:09.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.507+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1880109330 con 0x7f1880103ab0 2024-04-21T10:19:09.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.508+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f187801c070 con 0x7f1880103ab0 2024-04-21T10:19:09.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.508+0000 7f186f7fe640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f18680a3bb0 0x7f18680a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.509+0000 7f187e59c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f18680a3bb0 0x7f18680a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.509+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f18780cf5b0 con 0x7f1880103ab0 2024-04-21T10:19:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.509+0000 7f187e59c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f18680a3bb0 0x7f18680a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1870006010 tx=0x7f1870005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:09.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.513+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f187809c430 con 0x7f1880103ab0 2024-04-21T10:19:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: Deploying daemon mds.g on smithi077 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:boot 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: fsmap 9 up:standby 2024-04-21T10:19:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:09 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: Deploying daemon mds.g on smithi077 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:boot 2024-04-21T10:19:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: fsmap 9 up:standby 2024-04-21T10:19:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:09 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T10:19:09.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.735+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1880062b50 con 0x7f1880103ab0 2024-04-21T10:19:09.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.736+0000 7f186f7fe640 1 -- 172.21.15.77:0/3327647363 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8016 (secure 0 0 0) 0x7f187809bd30 con 0x7f1880103ab0 2024-04-21T10:19:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:09.736 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T10:19:09.736 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 10 2024-04-21T10:19:09.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f18680a3bb0 msgr2=0x7f18680a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:09.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f18680a3bb0 0x7f18680a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1870006010 tx=0x7f1870005be0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 msgr2=0x7f188019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 0x7f188019f7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f187800b970 tx=0x7f187800be30 comp rx=0 tx=0).stop 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 shutdown_connections 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f18680a3bb0 0x7f18680a6070 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880103ab0 0x7f188019f7e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18801030f0 0x7f1880198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 --2- 172.21.15.77:0/3327647363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1880101f20 0x7f1880198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 >> 172.21.15.77:0/3327647363 conn(0x7f18800fd500 msgr2=0x7f1880106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 shutdown_connections 2024-04-21T10:19:09.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:09.738+0000 7f1884c8c640 1 -- 172.21.15.77:0/3327647363 wait complete. 2024-04-21T10:19:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:10 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3327647363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:10 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3327647363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:10 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3327647363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:11.135 INFO:journalctl@ceph.mds.g.smithi077.stdout:Apr 21 10:19:10 smithi077 systemd[1]: Started Ceph mds.g for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:11 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:11 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:11 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:11.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2962661349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04101fc0 msgr2=0x7fcd04102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2962661349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04101fc0 0x7fcd04102440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009900 tx=0x7fccf402bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2962661349 shutdown_connections 2024-04-21T10:19:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2962661349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04101fc0 0x7fcd04102440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2962661349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd04102980 0x7fcd041092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2962661349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd04100e70 0x7fcd04101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2962661349 >> 172.21.15.77:0/2962661349 conn(0x7fcd040fc3e0 msgr2=0x7fcd040fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2962661349 shutdown_connections 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2962661349 wait complete. 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 Processor -- start 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.857+0000 7fcd0ac69640 1 -- start start 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 0x7fcd04198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd04101fc0 0x7fcd04198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd04102980 0x7fcd0419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0410c9c0 con 0x7fcd04100e70 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0410c840 con 0x7fcd04102980 2024-04-21T10:19:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0410cb40 con 0x7fcd04101fc0 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 0x7fcd04198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 0x7fcd04198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35036/0 (socket says 172.21.15.77:35036) 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 -- 172.21.15.77:0/2407488532 learned_addr learned my addr 172.21.15.77:0/2407488532 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd09206640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd04102980 0x7fcd0419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 -- 172.21.15.77:0/2407488532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd04101fc0 msgr2=0x7fcd04198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd04101fc0 0x7fcd04198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 -- 172.21.15.77:0/2407488532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd04102980 msgr2=0x7fcd0419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd04102980 0x7fcd0419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 -- 172.21.15.77:0/2407488532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0419fe60 con 0x7fcd04100e70 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd08a05640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 0x7fcd04198240 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00ea80 tx=0x7fccfc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00ce40 con 0x7fcd04100e70 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccfc005020 con 0x7fcd04100e70 2024-04-21T10:19:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd041a0150 con 0x7fcd04100e70 2024-04-21T10:19:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.858+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0116d0 con 0x7fcd04100e70 2024-04-21T10:19:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.859+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd041a0650 con 0x7fcd04100e70 2024-04-21T10:19:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.859+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd041a0910 con 0x7fcd04100e70 2024-04-21T10:19:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.860+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fccfc0054d0 con 0x7fcd04100e70 2024-04-21T10:19:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.861+0000 7fcd01ffb640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccf00a3bb0 0x7fccf00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.861+0000 7fcd03fff640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccf00a3bb0 0x7fccf00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.861+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fccfc0d02e0 con 0x7fcd04100e70 2024-04-21T10:19:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.861+0000 7fcd03fff640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccf00a3bb0 0x7fccf00a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccf4036040 tx=0x7fccf4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:11.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:11.866+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fccfc016030 con 0x7fcd04100e70 2024-04-21T10:19:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.095+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd041a0ae0 con 0x7fcd04100e70 2024-04-21T10:19:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.096+0000 7fcd01ffb640 1 -- 172.21.15.77:0/2407488532 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8842 (secure 0 0 0) 0x7fccfc09d160 con 0x7fcd04100e70 2024-04-21T10:19:12.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:12.096 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T10:19:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 11 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccf00a3bb0 msgr2=0x7fccf00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccf00a3bb0 0x7fccf00a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccf4036040 tx=0x7fccf4000bc0 comp rx=0 tx=0).stop 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 msgr2=0x7fcd04198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 0x7fcd04198240 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00ea80 tx=0x7fccfc00ef40 comp rx=0 tx=0).stop 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 shutdown_connections 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccf00a3bb0 0x7fccf00a6070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd04102980 0x7fcd0419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd04101fc0 0x7fcd04198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 --2- 172.21.15.77:0/2407488532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd04100e70 0x7fcd04198240 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 >> 172.21.15.77:0/2407488532 conn(0x7fcd040fc3e0 msgr2=0x7fcd04069130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 shutdown_connections 2024-04-21T10:19:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:12.098+0000 7fcd0ac69640 1 -- 172.21.15.77:0/2407488532 wait complete. 2024-04-21T10:19:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:12 smithi170 ceph-mon[31212]: Deploying daemon mds.a on smithi077 2024-04-21T10:19:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:12 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.77:6838/3489435011,v1:172.21.15.77:6839/3489435011] up:boot 2024-04-21T10:19:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:12 smithi170 ceph-mon[31212]: fsmap 10 up:standby 2024-04-21T10:19:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:12 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T10:19:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:12 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2407488532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:12.578 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:12 smithi077 ceph-mon[27902]: Deploying daemon mds.a on smithi077 2024-04-21T10:19:12.578 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:12 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.77:6838/3489435011,v1:172.21.15.77:6839/3489435011] up:boot 2024-04-21T10:19:12.579 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:12 smithi077 ceph-mon[27902]: fsmap 10 up:standby 2024-04-21T10:19:12.579 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:12 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T10:19:12.579 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:12 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2407488532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:12 smithi191 ceph-mon[31636]: Deploying daemon mds.a on smithi077 2024-04-21T10:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:12 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.77:6838/3489435011,v1:172.21.15.77:6839/3489435011] up:boot 2024-04-21T10:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:12 smithi191 ceph-mon[31636]: fsmap 10 up:standby 2024-04-21T10:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:12 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T10:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:12 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2407488532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:13.135 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 systemd[1]: Starting Ceph mds.a for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:19:13.517 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:13 smithi077 ceph-mon[27902]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:13.517 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 podman[69376]: 2024-04-21 10:19:13.153627097 +0000 UTC m=+0.018462836 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:19:13.517 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 podman[69376]: 2024-04-21 10:19:13.273780969 +0000 UTC m=+0.138616715 container create f09409db8a65e4ec9a4b401753039907ff9f8c9125f4520ed765e6f335448329 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-a, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-21T10:19:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:13 smithi170 ceph-mon[31212]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:13 smithi191 ceph-mon[31636]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:13.885 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 podman[69376]: 2024-04-21 10:19:13.517857966 +0000 UTC m=+0.382693671 container init f09409db8a65e4ec9a4b401753039907ff9f8c9125f4520ed765e6f335448329 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-a630765, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T10:19:13.885 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 podman[69376]: 2024-04-21 10:19:13.520504791 +0000 UTC m=+0.385340498 container start f09409db8a65e4ec9a4b401753039907ff9f8c9125f4520ed765e6f335448329 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-a630765, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-21T10:19:13.885 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 ceph-mds[69395]: -- 172.21.15.77:0/1319826768 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b558c7fa40 con 0x55b558c52800 2024-04-21T10:19:13.885 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-a[69391]: starting mds.a at 2024-04-21T10:19:13.886 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 bash[69376]: f09409db8a65e4ec9a4b401753039907ff9f8c9125f4520ed765e6f335448329 2024-04-21T10:19:13.886 INFO:journalctl@ceph.mds.a.smithi077.stdout:Apr 21 10:19:13 smithi077 systemd[1]: Started Ceph mds.a for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:14.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 -- 172.21.15.77:0/556189860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0101fd0 msgr2=0x7f96a0102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 --2- 172.21.15.77:0/556189860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0101fd0 0x7f96a0102450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f969c009900 tx=0x7f969c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 -- 172.21.15.77:0/556189860 shutdown_connections 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 --2- 172.21.15.77:0/556189860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0101fd0 0x7f96a0102450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 --2- 172.21.15.77:0/556189860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a0102990 0x7f96a01092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 --2- 172.21.15.77:0/556189860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96a0100e80 0x7f96a01012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 -- 172.21.15.77:0/556189860 >> 172.21.15.77:0/556189860 conn(0x7f96a00fc410 msgr2=0x7f96a00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 -- 172.21.15.77:0/556189860 shutdown_connections 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.214+0000 7f96a8715640 1 -- 172.21.15.77:0/556189860 wait complete. 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 Processor -- start 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 -- start start 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96a0100e80 0x7f96a006b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a0101fd0 0x7f96a019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 0x7f96a01a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010ca20 con 0x7f96a0102990 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010c8a0 con 0x7f96a0100e80 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a8715640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010cba0 con 0x7f96a0101fd0 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 0x7f96a01a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 0x7f96a01a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35068/0 (socket says 172.21.15.77:35068) 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 -- 172.21.15.77:0/1264618359 learned_addr learned my addr 172.21.15.77:0/1264618359 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a64b1640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96a0100e80 0x7f96a006b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a5cb0640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a0101fd0 0x7f96a019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 -- 172.21.15.77:0/1264618359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a0101fd0 msgr2=0x7f96a019f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a0101fd0 0x7f96a019f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 -- 172.21.15.77:0/1264618359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96a0100e80 msgr2=0x7f96a006b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96a0100e80 0x7f96a006b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 -- 172.21.15.77:0/1264618359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01a2030 con 0x7f96a0102990 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96a6cb2640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 0x7f96a01a1840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f969800eaa0 tx=0x7f969800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.215+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969800cdb0 con 0x7f96a0102990 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.216+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a01a22c0 con 0x7f96a0102990 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.216+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9698005020 con 0x7f96a0102990 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.216+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980116d0 con 0x7f96a0102990 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.216+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a01a2810 con 0x7f96a0102990 2024-04-21T10:19:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.216+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0108210 con 0x7f96a0102990 2024-04-21T10:19:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.218+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f96980054a0 con 0x7f96a0102990 2024-04-21T10:19:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.218+0000 7f96977fe640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f968c0a3be0 0x7f968c0a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.218+0000 7f96a64b1640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f968c0a3be0 0x7f968c0a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.218+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f96980d0470 con 0x7f96a0102990 2024-04-21T10:19:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.219+0000 7f96a64b1640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f968c0a3be0 0x7f968c0a60a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9690009bd0 tx=0x7f9690005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.222+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9698016030 con 0x7f96a0102990 2024-04-21T10:19:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.439+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96a002d5c0 con 0x7f96a0102990 2024-04-21T10:19:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.440+0000 7f96977fe640 1 -- 172.21.15.77:0/1264618359 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7f969809d2f0 con 0x7f96a0102990 2024-04-21T10:19:14.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:14.440 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T10:19:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-21T10:19:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f968c0a3be0 msgr2=0x7f968c0a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f968c0a3be0 0x7f968c0a60a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9690009bd0 tx=0x7f9690005f90 comp rx=0 tx=0).stop 2024-04-21T10:19:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 msgr2=0x7f96a01a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 0x7f96a01a1840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f969800eaa0 tx=0x7f969800ef60 comp rx=0 tx=0).stop 2024-04-21T10:19:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 shutdown_connections 2024-04-21T10:19:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f968c0a3be0 0x7f968c0a60a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a0102990 0x7f96a01a1840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a0101fd0 0x7f96a019f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 --2- 172.21.15.77:0/1264618359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96a0100e80 0x7f96a006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 >> 172.21.15.77:0/1264618359 conn(0x7f96a00fc410 msgr2=0x7f96a01053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 shutdown_connections 2024-04-21T10:19:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:14.442+0000 7f96a8715640 1 -- 172.21.15.77:0/1264618359 wait complete. 2024-04-21T10:19:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: Deploying daemon mds.b on smithi170 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.77:6840/3790434755,v1:172.21.15.77:6841/3790434755] up:boot 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: fsmap 11 up:standby 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T10:19:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1264618359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: Deploying daemon mds.b on smithi170 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.77:6840/3790434755,v1:172.21.15.77:6841/3790434755] up:boot 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: fsmap 11 up:standby 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T10:19:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1264618359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: Deploying daemon mds.b on smithi170 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.77:6840/3790434755,v1:172.21.15.77:6841/3790434755] up:boot 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: fsmap 11 up:standby 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T10:19:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1264618359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:15 smithi191 ceph-mon[31636]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:15 smithi170 ceph-mon[31212]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:16.057 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:15 smithi170 systemd[1]: Starting Ceph mds.b for 41617fb2-ffc7-11ee-bc93-c7b262605968... 2024-04-21T10:19:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:15 smithi077 ceph-mon[27902]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:16.357 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 podman[61996]: 2024-04-21 10:19:15.992645121 +0000 UTC m=+0.018504657 image pull b45a994450e2a16d2cd2438b86c3e132853c7dd0b34f48fede9705dbcfa91192 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda 2024-04-21T10:19:16.357 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 podman[61996]: 2024-04-21 10:19:16.113247155 +0000 UTC m=+0.139106692 container create 82a9fc62c242bc88ddd5a336c21ce1975de5c1f4bff02821a390aae2f884cd7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-a630765, org.label-schema.schema-version=1.0) 2024-04-21T10:19:16.357 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 podman[61996]: 2024-04-21 10:19:16.332932632 +0000 UTC m=+0.358792165 container init 82a9fc62c242bc88ddd5a336c21ce1975de5c1f4bff02821a390aae2f884cd7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-21T10:19:16.358 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 podman[61996]: 2024-04-21 10:19:16.335502817 +0000 UTC m=+0.361362353 container start 82a9fc62c242bc88ddd5a336c21ce1975de5c1f4bff02821a390aae2f884cd7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:36ea816f637ab0eb3aba78ac1a5e79acaf4ee67536fe53155c0137fedf936fda, name=ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-a630765, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-21T10:19:16.358 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 ceph-mds[62015]: -- 172.21.15.170:0/2187778565 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd57489a40 con 0x55bd5745cc00 2024-04-21T10:19:16.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 -- 172.21.15.77:0/2348775559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 msgr2=0x7fc8f010a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/2348775559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f010a0e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009ca0 tx=0x7fc8e802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 -- 172.21.15.77:0/2348775559 shutdown_connections 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/2348775559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f010a0e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/2348775559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f01053c0 0x7fc8f01077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/2348775559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8f0102a90 0x7fc8f0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 -- 172.21.15.77:0/2348775559 >> 172.21.15.77:0/2348775559 conn(0x7fc8f00fc420 msgr2=0x7fc8f00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 -- 172.21.15.77:0/2348775559 shutdown_connections 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.574+0000 7fc8f75ef640 1 -- 172.21.15.77:0/2348775559 wait complete. 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 Processor -- start 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 -- start start 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f0102a90 0x7fc8f0102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8f01053c0 0x7fc8f0100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f0100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f010daf0 con 0x7fc8f0107cf0 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f010d970 con 0x7fc8f0102a90 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f75ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f010dc70 con 0x7fc8f01053c0 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f0100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f0100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35088/0 (socket says 172.21.15.77:35088) 2024-04-21T10:19:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 -- 172.21.15.77:0/3624811624 learned_addr learned my addr 172.21.15.77:0/3624811624 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f4b8a640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8f01053c0 0x7fc8f0100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f538b640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f0102a90 0x7fc8f0102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 -- 172.21.15.77:0/3624811624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8f01053c0 msgr2=0x7fc8f0100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8f01053c0 0x7fc8f0100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 -- 172.21.15.77:0/3624811624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f0102a90 msgr2=0x7fc8f0102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f0102a90 0x7fc8f0102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f5b8c640 1 -- 172.21.15.77:0/3624811624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f0101810 con 0x7fc8f0107cf0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.575+0000 7fc8f538b640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f0102a90 0x7fc8f0102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.576+0000 7fc8f5b8c640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f0100f80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc8e802c700 tx=0x7fc8e80093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.576+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8041020 con 0x7fc8f0107cf0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.576+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8e8034d60 con 0x7fc8f0107cf0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.576+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8039040 con 0x7fc8f0107cf0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.576+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f01a2270 con 0x7fc8f0107cf0 2024-04-21T10:19:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.576+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f01a2810 con 0x7fc8f0107cf0 2024-04-21T10:19:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.577+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f00fdf10 con 0x7fc8f0107cf0 2024-04-21T10:19:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.578+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc8e8044020 con 0x7fc8f0107cf0 2024-04-21T10:19:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.578+0000 7fc8e67fc640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8dc0a3c30 0x7fc8dc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.578+0000 7fc8f538b640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8dc0a3c30 0x7fc8dc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.578+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc8e80f1ee0 con 0x7fc8f0107cf0 2024-04-21T10:19:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.579+0000 7fc8f538b640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8dc0a3c30 0x7fc8dc0a60f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005d00 tx=0x7fc8ec005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:16.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.584+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc8e804b020 con 0x7fc8f0107cf0 2024-04-21T10:19:16.806 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-b[62011]: starting mds.b at 2024-04-21T10:19:16.806 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 bash[61996]: 82a9fc62c242bc88ddd5a336c21ce1975de5c1f4bff02821a390aae2f884cd7f 2024-04-21T10:19:16.807 INFO:journalctl@ceph.mds.b.smithi170.stdout:Apr 21 10:19:16 smithi170 systemd[1]: Started Ceph mds.b for 41617fb2-ffc7-11ee-bc93-c7b262605968. 2024-04-21T10:19:16.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.835+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8f0062b50 con 0x7fc8f0107cf0 2024-04-21T10:19:16.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.836+0000 7fc8e67fc640 1 -- 172.21.15.77:0/3624811624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7fc8e80becc0 con 0x7fc8f0107cf0 2024-04-21T10:19:16.836 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T10:19:16.837 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-21T10:19:16.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8dc0a3c30 msgr2=0x7fc8dc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:16.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8dc0a3c30 0x7fc8dc0a60f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005d00 tx=0x7fc8ec005c70 comp rx=0 tx=0).stop 2024-04-21T10:19:16.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 msgr2=0x7fc8f0100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:16.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f0100f80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc8e802c700 tx=0x7fc8e80093f0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 shutdown_connections 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc8dc0a3c30 0x7fc8dc0a60f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8f0107cf0 0x7fc8f0100f80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8f01053c0 0x7fc8f0100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 --2- 172.21.15.77:0/3624811624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f0102a90 0x7fc8f0102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 >> 172.21.15.77:0/3624811624 conn(0x7fc8f00fc420 msgr2=0x7fc8f01033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 shutdown_connections 2024-04-21T10:19:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:16.839+0000 7fc8f75ef640 1 -- 172.21.15.77:0/3624811624 wait complete. 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3624811624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:boot 2024-04-21T10:19:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: fsmap 12 up:standby 2024-04-21T10:19:17.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:17 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:17.812 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:19:17.813 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3624811624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:17.813 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:boot 2024-04-21T10:19:17.813 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: fsmap 12 up:standby 2024-04-21T10:19:17.813 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:17 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T10:19:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:19:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3624811624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:boot 2024-04-21T10:19:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: fsmap 12 up:standby 2024-04-21T10:19:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:17 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T10:19:18.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 -- 172.21.15.77:0/863523739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 msgr2=0x7fe7b4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 --2- 172.21.15.77:0/863523739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b4102000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009c90 tx=0x7fe7ac02c130 comp rx=0 tx=0).stop 2024-04-21T10:19:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 -- 172.21.15.77:0/863523739 shutdown_connections 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 --2- 172.21.15.77:0/863523739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b4102000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 --2- 172.21.15.77:0/863523739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 0x7fe7b4101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 --2- 172.21.15.77:0/863523739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 0x7fe7b4100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 -- 172.21.15.77:0/863523739 >> 172.21.15.77:0/863523739 conn(0x7fe7b40fc420 msgr2=0x7fe7b40fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 -- 172.21.15.77:0/863523739 shutdown_connections 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.958+0000 7fe7b9367640 1 -- 172.21.15.77:0/863523739 wait complete. 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 Processor -- start 2024-04-21T10:19:18.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 -- start start 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 0x7fe7b419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 0x7fe7b419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b41a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b410fcd0 con 0x7fe7b4101b80 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b410fb50 con 0x7fe7b41011e0 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b9367640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b410fe50 con 0x7fe7b4100880 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b41a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:18.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b2ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 0x7fe7b419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b41a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35110/0 (socket says 172.21.15.77:35110) 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b37fe640 1 -- 172.21.15.77:0/3261907697 learned_addr learned my addr 172.21.15.77:0/3261907697 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b27fc640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 0x7fe7b419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b2ffd640 1 -- 172.21.15.77:0/3261907697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 msgr2=0x7fe7b419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b2ffd640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 0x7fe7b419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b2ffd640 1 -- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 msgr2=0x7fe7b41a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b2ffd640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b41a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b2ffd640 1 -- 172.21.15.77:0/3261907697 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b41a1fb0 con 0x7fe7b4100880 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b37fe640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b41a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.959+0000 7fe7b27fc640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 0x7fe7b419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.960+0000 7fe7b2ffd640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 0x7fe7b419a390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400e9f0 tx=0x7fe7a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.960+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400ccc0 con 0x7fe7b4100880 2024-04-21T10:19:18.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.960+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b41a22a0 con 0x7fe7b4100880 2024-04-21T10:19:18.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.960+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7a40108e0 con 0x7fe7b4100880 2024-04-21T10:19:18.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.960+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b41a2840 con 0x7fe7b4100880 2024-04-21T10:19:18.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.960+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4018820 con 0x7fe7b4100880 2024-04-21T10:19:18.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.961+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b410b860 con 0x7fe7b4100880 2024-04-21T10:19:18.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.962+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe7a4010430 con 0x7fe7b4100880 2024-04-21T10:19:18.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.962+0000 7fe79bfff640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe79c0a3bb0 0x7fe79c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:18.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.963+0000 7fe7b27fc640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe79c0a3bb0 0x7fe79c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:18.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.963+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe7a40d0200 con 0x7fe7b4100880 2024-04-21T10:19:18.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.963+0000 7fe7b27fc640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe79c0a3bb0 0x7fe79c0a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80095f0 tx=0x7fe7a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:18.967+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe7a409ca30 con 0x7fe7b4100880 2024-04-21T10:19:19.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.232+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7b402d5c0 con 0x7fe7b4100880 2024-04-21T10:19:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.233+0000 7fe79bfff640 1 -- 172.21.15.77:0/3261907697 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10497 (secure 0 0 0) 0x7fe7a40a0d30 con 0x7fe7b4100880 2024-04-21T10:19:19.233 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:19.233 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T10:19:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe79c0a3bb0 msgr2=0x7fe79c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe79c0a3bb0 0x7fe79c0a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80095f0 tx=0x7fe7a8005f90 comp rx=0 tx=0).stop 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 msgr2=0x7fe7b419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 0x7fe7b419a390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400e9f0 tx=0x7fe7a400eeb0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 shutdown_connections 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe79c0a3bb0 0x7fe79c0a6070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4101b80 0x7fe7b41a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7b41011e0 0x7fe7b419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 --2- 172.21.15.77:0/3261907697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b4100880 0x7fe7b419a390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 >> 172.21.15.77:0/3261907697 conn(0x7fe7b40fc420 msgr2=0x7fe7b40fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 shutdown_connections 2024-04-21T10:19:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.235+0000 7fe7b9367640 1 -- 172.21.15.77:0/3261907697 wait complete. 2024-04-21T10:19:19.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 -- 172.21.15.77:0/2730220746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864103180 msgr2=0x7f0864103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 --2- 172.21.15.77:0/2730220746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864103180 0x7f0864103600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0858009900 tx=0x7f085802bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 -- 172.21.15.77:0/2730220746 shutdown_connections 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 --2- 172.21.15.77:0/2730220746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864103180 0x7f0864103600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 --2- 172.21.15.77:0/2730220746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864103b40 0x7f086410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 --2- 172.21.15.77:0/2730220746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0864101f90 0x7f08641023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 -- 172.21.15.77:0/2730220746 >> 172.21.15.77:0/2730220746 conn(0x7f08640fd500 msgr2=0x7f08640ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 -- 172.21.15.77:0/2730220746 shutdown_connections 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 -- 172.21.15.77:0/2730220746 wait complete. 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 Processor -- start 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.344+0000 7f0869715640 1 -- start start 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 0x7f0864198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864103180 0x7f08641986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0864103b40 0x7f086419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f086410dad0 con 0x7f0864101f90 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f086410d950 con 0x7f0864103b40 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f086410dc50 con 0x7f0864103180 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 0x7f0864198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 0x7f0864198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35140/0 (socket says 172.21.15.77:35140) 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 -- 172.21.15.77:0/2005069687 learned_addr learned my addr 172.21.15.77:0/2005069687 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f08637fe640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0864103b40 0x7f086419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f08627fc640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864103180 0x7f08641986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 -- 172.21.15.77:0/2005069687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864103180 msgr2=0x7f08641986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864103180 0x7f08641986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 -- 172.21.15.77:0/2005069687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0864103b40 msgr2=0x7f086419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0864103b40 0x7f086419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 -- 172.21.15.77:0/2005069687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086419fd80 con 0x7f0864101f90 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0862ffd640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 0x7f0864198160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f085400ea80 tx=0x7f085400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085400ce40 con 0x7f0864101f90 2024-04-21T10:19:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0854011920 con 0x7f0864101f90 2024-04-21T10:19:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08641a0070 con 0x7f0864101f90 2024-04-21T10:19:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085401aaa0 con 0x7f0864101f90 2024-04-21T10:19:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.345+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08641a0590 con 0x7f0864101f90 2024-04-21T10:19:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.346+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08641092b0 con 0x7f0864101f90 2024-04-21T10:19:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.347+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f085401ac40 con 0x7f0864101f90 2024-04-21T10:19:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.348+0000 7f084bfff640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f084c0a3bb0 0x7f084c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.348+0000 7f08627fc640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f084c0a3bb0 0x7f084c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.348+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f08540d0470 con 0x7f0864101f90 2024-04-21T10:19:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.348+0000 7f08627fc640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f084c0a3bb0 0x7f084c0a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0858009230 tx=0x7f0858005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:19.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.352+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0854016030 con 0x7f0864101f90 2024-04-21T10:19:19.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.539+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0864062b50 con 0x7f0864101f90 2024-04-21T10:19:19.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.540+0000 7f084bfff640 1 -- 172.21.15.77:0/2005069687 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18466 (secure 0 0 0) 0x7f085409d2f0 con 0x7f0864101f90 2024-04-21T10:19:19.540 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:19.541 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":81,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:18:30.729988+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:19:19.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f084c0a3bb0 msgr2=0x7f084c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f084c0a3bb0 0x7f084c0a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0858009230 tx=0x7f0858005fd0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 msgr2=0x7f0864198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 0x7f0864198160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f085400ea80 tx=0x7f085400ef40 comp rx=0 tx=0).stop 2024-04-21T10:19:19.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 shutdown_connections 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f084c0a3bb0 0x7f084c0a6070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0864103b40 0x7f086419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864103180 0x7f08641986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 --2- 172.21.15.77:0/2005069687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0864101f90 0x7f0864198160 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 >> 172.21.15.77:0/2005069687 conn(0x7f08640fd500 msgr2=0x7f0864106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 shutdown_connections 2024-04-21T10:19:19.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.542+0000 7f0869715640 1 -- 172.21.15.77:0/2005069687 wait complete. 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:19:19.552 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.553 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:19:19.553 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:19.553 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:19 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3261907697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:19.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:19:19.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:19:19.638 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:19.639 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:19 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3261907697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 -- 172.21.15.77:0/2490243643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664101fe0 msgr2=0x7f3664102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 --2- 172.21.15.77:0/2490243643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664101fe0 0x7f3664102460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3654009900 tx=0x7f365402bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 -- 172.21.15.77:0/2490243643 shutdown_connections 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 --2- 172.21.15.77:0/2490243643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664101fe0 0x7f3664102460 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 --2- 172.21.15.77:0/2490243643 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 0x7f36641092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 --2- 172.21.15.77:0/2490243643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664100e90 0x7f36641012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 -- 172.21.15.77:0/2490243643 >> 172.21.15.77:0/2490243643 conn(0x7f36640fc400 msgr2=0x7f36640fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 -- 172.21.15.77:0/2490243643 shutdown_connections 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.656+0000 7f366c23e640 1 -- 172.21.15.77:0/2490243643 wait complete. 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 Processor -- start 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 -- start start 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 0x7f3664197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664101fe0 0x7f3664197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 0x7f366419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f366410cb10 con 0x7f3664100e90 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f366410c990 con 0x7f3664101fe0 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366c23e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f366410cc90 con 0x7f36641029a0 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 0x7f3664197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 0x7f3664197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35160/0 (socket says 172.21.15.77:35160) 2024-04-21T10:19:19.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 -- 172.21.15.77:0/4035268808 learned_addr learned my addr 172.21.15.77:0/4035268808 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366a7db640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 0x7f366419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 -- 172.21.15.77:0/4035268808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 msgr2=0x7f366419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 0x7f366419e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f36697d9640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664101fe0 0x7f3664197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 -- 172.21.15.77:0/4035268808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664101fe0 msgr2=0x7f3664197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664101fe0 0x7f3664197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f3669fda640 1 -- 172.21.15.77:0/4035268808 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366419ee60 con 0x7f3664100e90 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.657+0000 7f366a7db640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 0x7f366419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.658+0000 7f3669fda640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 0x7f3664197240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f366000d990 tx=0x7f366000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.658+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366001b070 con 0x7f3664100e90 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.658+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3664069140 con 0x7f3664100e90 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.658+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f366000edf0 con 0x7f3664100e90 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.658+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660014800 con 0x7f3664100e90 2024-04-21T10:19:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.658+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3664069710 con 0x7f3664100e90 2024-04-21T10:19:19.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.659+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3664107d80 con 0x7f3664100e90 2024-04-21T10:19:19.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.660+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f366001e070 con 0x7f3664100e90 2024-04-21T10:19:19.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.661+0000 7f365affd640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f36500a3bb0 0x7f36500a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.661+0000 7f36697d9640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f36500a3bb0 0x7f36500a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.661+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f36600d1840 con 0x7f3664100e90 2024-04-21T10:19:19.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.662+0000 7f36697d9640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f36500a3bb0 0x7f36500a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3654036040 tx=0x7f3654005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:19.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.666+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f366009e6c0 con 0x7f3664100e90 2024-04-21T10:19:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:19.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:19 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3261907697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:19.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.847+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f366419f030 con 0x7f3664100e90 2024-04-21T10:19:19.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.847+0000 7f365affd640 1 -- 172.21.15.77:0/4035268808 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f366009dfc0 con 0x7f3664100e90 2024-04-21T10:19:19.847 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f36500a3bb0 msgr2=0x7f36500a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f36500a3bb0 0x7f36500a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3654036040 tx=0x7f3654005fd0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 msgr2=0x7f3664197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 0x7f3664197240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f366000d990 tx=0x7f366000de50 comp rx=0 tx=0).stop 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 shutdown_connections 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f36500a3bb0 0x7f36500a6070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36641029a0 0x7f366419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664101fe0 0x7f3664197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 --2- 172.21.15.77:0/4035268808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3664100e90 0x7f3664197240 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 >> 172.21.15.77:0/4035268808 conn(0x7f36640fc400 msgr2=0x7f36641054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 shutdown_connections 2024-04-21T10:19:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.849+0000 7f366c23e640 1 -- 172.21.15.77:0/4035268808 wait complete. 2024-04-21T10:19:19.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-21T10:19:19.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 -- 172.21.15.77:0/3356181747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8105380 msgr2=0x7f01d8107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/3356181747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8105380 0x7f01d8107770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009900 tx=0x7f01c802bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 -- 172.21.15.77:0/3356181747 shutdown_connections 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/3356181747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8105380 0x7f01d8107770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/3356181747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01d8107cb0 0x7f01d810a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/3356181747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d8102a50 0x7f01d8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 -- 172.21.15.77:0/3356181747 >> 172.21.15.77:0/3356181747 conn(0x7f01d80fc400 msgr2=0x7f01d80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 -- 172.21.15.77:0/3356181747 shutdown_connections 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 -- 172.21.15.77:0/3356181747 wait complete. 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 Processor -- start 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.975+0000 7f01dfcc0640 1 -- start start 2024-04-21T10:19:19.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d8102a50 0x7f01d8195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01d8105380 0x7f01d8196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 0x7f01d819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01d810b900 con 0x7f01d8107cb0 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01d810b780 con 0x7f01d8102a50 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01d810ba80 con 0x7f01d8105380 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 0x7f01d819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 0x7f01d819d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35174/0 (socket says 172.21.15.77:35174) 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 -- 172.21.15.77:0/471932349 learned_addr learned my addr 172.21.15.77:0/471932349 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dda5c640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d8102a50 0x7f01d8195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dd25b640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01d8105380 0x7f01d8196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 -- 172.21.15.77:0/471932349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01d8105380 msgr2=0x7f01d8196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01d8105380 0x7f01d8196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 -- 172.21.15.77:0/471932349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d8102a50 msgr2=0x7f01d8195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:19.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d8102a50 0x7f01d8195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 -- 172.21.15.77:0/471932349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d819dc00 con 0x7f01d8107cb0 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01de25d640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 0x7f01d819d590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01d0003fd0 tx=0x7f01d000fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0004830 con 0x7f01d8107cb0 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d0005020 con 0x7f01d8107cb0 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d819def0 con 0x7f01d8107cb0 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0018680 con 0x7f01d8107cb0 2024-04-21T10:19:19.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.976+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d819e360 con 0x7f01d8107cb0 2024-04-21T10:19:19.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.978+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d80fdef0 con 0x7f01d8107cb0 2024-04-21T10:19:19.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.978+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f01d001f020 con 0x7f01d8107cb0 2024-04-21T10:19:19.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.979+0000 7f01ceffd640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f01c40a3bb0 0x7f01c40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:19.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.979+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f01d00d3b10 con 0x7f01d8107cb0 2024-04-21T10:19:19.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.979+0000 7f01dda5c640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f01c40a3bb0 0x7f01c40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:19.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.980+0000 7f01dda5c640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f01c40a3bb0 0x7f01c40a6070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009bd0 tx=0x7f01d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:19.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:19.984+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f01d00a0990 con 0x7f01d8107cb0 2024-04-21T10:19:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.196+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f01d802d770 con 0x7f01d8107cb0 2024-04-21T10:19:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.196+0000 7f01ceffd640 1 -- 172.21.15.77:0/471932349 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f01d00a0290 con 0x7f01d8107cb0 2024-04-21T10:19:20.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-04-21T10:19:20.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-21T10:19:20.197 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-04-21T10:19:20.197 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-04-21T10:19:20.197 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:19:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f01c40a3bb0 msgr2=0x7f01c40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f01c40a3bb0 0x7f01c40a6070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009bd0 tx=0x7f01d4005f90 comp rx=0 tx=0).stop 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 msgr2=0x7f01d819d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 0x7f01d819d590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01d0003fd0 tx=0x7f01d000fd80 comp rx=0 tx=0).stop 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 shutdown_connections 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f01c40a3bb0 0x7f01c40a6070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d8107cb0 0x7f01d819d590 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01d8105380 0x7f01d8196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 --2- 172.21.15.77:0/471932349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d8102a50 0x7f01d8195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 >> 172.21.15.77:0/471932349 conn(0x7f01d80fc400 msgr2=0x7f01d81048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 shutdown_connections 2024-04-21T10:19:20.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.199+0000 7f01dfcc0640 1 -- 172.21.15.77:0/471932349 wait complete. 2024-04-21T10:19:20.210 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-21T10:19:20.210 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-21T10:19:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 -- 172.21.15.77:0/1676566842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 msgr2=0x7fabd01077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/1676566842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd01077f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009900 tx=0x7fabbc02bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 -- 172.21.15.77:0/1676566842 shutdown_connections 2024-04-21T10:19:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/1676566842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd01077f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/1676566842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabd0107d30 0x7fabd010a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/1676566842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabd0102ad0 0x7fabd0104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 -- 172.21.15.77:0/1676566842 >> 172.21.15.77:0/1676566842 conn(0x7fabd00fc440 msgr2=0x7fabd00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 -- 172.21.15.77:0/1676566842 shutdown_connections 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.323+0000 7fabd6a6a640 1 -- 172.21.15.77:0/1676566842 wait complete. 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 Processor -- start 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 -- start start 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabd0102ad0 0x7fabd0102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd0100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabd0107d30 0x7fabd0100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010db10 con 0x7fabd0105400 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010d990 con 0x7fabd0102ad0 2024-04-21T10:19:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd6a6a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010dc90 con 0x7fabd0107d30 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd0100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd0100a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35190/0 (socket says 172.21.15.77:35190) 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 -- 172.21.15.77:0/2737754203 learned_addr learned my addr 172.21.15.77:0/2737754203 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd4806640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabd0102ad0 0x7fabd0102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabd5007640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabd0107d30 0x7fabd0100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 -- 172.21.15.77:0/2737754203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabd0107d30 msgr2=0x7fabd0100fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabd0107d30 0x7fabd0100fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 -- 172.21.15.77:0/2737754203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabd0102ad0 msgr2=0x7fabd0102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabd0102ad0 0x7fabd0102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 -- 172.21.15.77:0/2737754203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd0101850 con 0x7fabd0105400 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.324+0000 7fabcffff640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd0100a80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fabbc000c00 tx=0x7fabbc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.325+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc043020 con 0x7fabd0105400 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.325+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabbc004440 con 0x7fabd0105400 2024-04-21T10:19:20.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.325+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc003c60 con 0x7fabd0105400 2024-04-21T10:19:20.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.325+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd01a23e0 con 0x7fabd0105400 2024-04-21T10:19:20.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.325+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd01a2980 con 0x7fabd0105400 2024-04-21T10:19:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.326+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd00fdf30 con 0x7fabd0105400 2024-04-21T10:19:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.328+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fabbc046020 con 0x7fabd0105400 2024-04-21T10:19:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.328+0000 7fabcdffb640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fabc00a3c30 0x7fabc00a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.329+0000 7fabd4806640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fabc00a3c30 0x7fabc00a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.329+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fabbc0f2530 con 0x7fabd0105400 2024-04-21T10:19:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.329+0000 7fabd4806640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fabc00a3c30 0x7fabc00a60f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fabc400bbe0 tx=0x7fabc400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:20.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.332+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fabbc04d020 con 0x7fabd0105400 2024-04-21T10:19:20.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:20.518+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fabd002d810 con 0x7fabd0105400 2024-04-21T10:19:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2005069687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4035268808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/471932349' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:19:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2005069687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4035268808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/471932349' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:19:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2005069687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4035268808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/471932349' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-21T10:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:19:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:19:21.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.478+0000 7fabcdffb640 1 -- 172.21.15.77:0/2737754203 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7fabbc0bf3b0 con 0x7fabd0105400 2024-04-21T10:19:21.478 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2024-04-21T10:19:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.480+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fabc00a3c30 msgr2=0x7fabc00a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.480+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fabc00a3c30 0x7fabc00a60f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fabc400bbe0 tx=0x7fabc400b390 comp rx=0 tx=0).stop 2024-04-21T10:19:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.480+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 msgr2=0x7fabd0100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.480+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd0100a80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fabbc000c00 tx=0x7fabbc004040 comp rx=0 tx=0).stop 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 shutdown_connections 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fabc00a3c30 0x7fabc00a60f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabd0105400 0x7fabd0100a80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabd0107d30 0x7fabd0100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 --2- 172.21.15.77:0/2737754203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabd0102ad0 0x7fabd0102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 >> 172.21.15.77:0/2737754203 conn(0x7fabd00fc440 msgr2=0x7fabd01049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 shutdown_connections 2024-04-21T10:19:21.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.481+0000 7fabd6a6a640 1 -- 172.21.15.77:0/2737754203 wait complete. 2024-04-21T10:19:21.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 -- 172.21.15.77:0/2190104902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c1053c0 msgr2=0x7f2e1c1077b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 --2- 172.21.15.77:0/2190104902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c1053c0 0x7f2e1c1077b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009900 tx=0x7f2e0c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 -- 172.21.15.77:0/2190104902 shutdown_connections 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 --2- 172.21.15.77:0/2190104902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c1053c0 0x7f2e1c1077b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 --2- 172.21.15.77:0/2190104902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 --2- 172.21.15.77:0/2190104902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e1c102a90 0x7f2e1c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 -- 172.21.15.77:0/2190104902 >> 172.21.15.77:0/2190104902 conn(0x7f2e1c0fc420 msgr2=0x7f2e1c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 -- 172.21.15.77:0/2190104902 shutdown_connections 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.604+0000 7f2e24443640 1 -- 172.21.15.77:0/2190104902 wait complete. 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 Processor -- start 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 -- start start 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c102a90 0x7f2e1c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e1c1053c0 0x7f2e1c198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c10daf0 con 0x7f2e1c107cf0 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c10d970 con 0x7f2e1c1053c0 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e24443640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c10dc70 con 0x7f2e1c102a90 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59402/0 (socket says 172.21.15.77:59402) 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 -- 172.21.15.77:0/1776815988 learned_addr learned my addr 172.21.15.77:0/1776815988 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:21.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e221df640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c102a90 0x7f2e1c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e219de640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e1c1053c0 0x7f2e1c198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 -- 172.21.15.77:0/1776815988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c102a90 msgr2=0x7f2e1c198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c102a90 0x7f2e1c198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 -- 172.21.15.77:0/1776815988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e1c1053c0 msgr2=0x7f2e1c198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e1c1053c0 0x7f2e1c198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e229e0640 1 -- 172.21.15.77:0/1776815988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c19fe60 con 0x7f2e1c107cf0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.605+0000 7f2e221df640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c102a90 0x7f2e1c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.606+0000 7f2e229e0640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c19f7f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400cad0 tx=0x7f2e1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.606+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400ae20 con 0x7f2e1c107cf0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.606+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c1a0150 con 0x7f2e1c107cf0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.606+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e14005020 con 0x7f2e1c107cf0 2024-04-21T10:19:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.606+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400f6b0 con 0x7f2e1c107cf0 2024-04-21T10:19:21.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.606+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c1a06a0 con 0x7f2e1c107cf0 2024-04-21T10:19:21.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.607+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1c0fdf10 con 0x7f2e1c107cf0 2024-04-21T10:19:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.608+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2e140051d0 con 0x7f2e1c107cf0 2024-04-21T10:19:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.609+0000 7f2e137fe640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2e080a3bb0 0x7f2e080a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.609+0000 7f2e221df640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2e080a3bb0 0x7f2e080a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.609+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f2e140d0540 con 0x7f2e1c107cf0 2024-04-21T10:19:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.609+0000 7f2e221df640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2e080a3bb0 0x7f2e080a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2e180058c0 tx=0x7f2e18005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.613+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2e14014030 con 0x7f2e1c107cf0 2024-04-21T10:19:21.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:21.792+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e1c02d5c0 con 0x7f2e1c107cf0 2024-04-21T10:19:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:21 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2737754203' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T10:19:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:21 smithi170 ceph-mon[31212]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:21 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2737754203' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T10:19:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:21 smithi077 ceph-mon[27902]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:21 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2737754203' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T10:19:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:21 smithi191 ceph-mon[31636]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.480+0000 7f2e137fe640 1 -- 172.21.15.77:0/1776815988 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7f2e1409d250 con 0x7f2e1c107cf0 2024-04-21T10:19:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2024-04-21T10:19:22.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2e080a3bb0 msgr2=0x7f2e080a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:22.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2e080a3bb0 0x7f2e080a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2e180058c0 tx=0x7f2e18005850 comp rx=0 tx=0).stop 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 msgr2=0x7f2e1c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c19f7f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400cad0 tx=0x7f2e1400cf90 comp rx=0 tx=0).stop 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 shutdown_connections 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f2e080a3bb0 0x7f2e080a6070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e1c107cf0 0x7f2e1c19f7f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e1c1053c0 0x7f2e1c198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 --2- 172.21.15.77:0/1776815988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e1c102a90 0x7f2e1c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 >> 172.21.15.77:0/1776815988 conn(0x7f2e1c0fc420 msgr2=0x7f2e1c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 shutdown_connections 2024-04-21T10:19:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.482+0000 7f2e24443640 1 -- 172.21.15.77:0/1776815988 wait complete. 2024-04-21T10:19:22.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- 172.21.15.77:0/3096335761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06601053a0 msgr2=0x7f0660107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- 172.21.15.77:0/3096335761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06601053a0 0x7f0660107790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f064c009900 tx=0x7f064c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- 172.21.15.77:0/3096335761 shutdown_connections 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- 172.21.15.77:0/3096335761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06601053a0 0x7f0660107790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- 172.21.15.77:0/3096335761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0660107cd0 0x7f066010a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- 172.21.15.77:0/3096335761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0660102a70 0x7f0660104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- 172.21.15.77:0/3096335761 >> 172.21.15.77:0/3096335761 conn(0x7f06600fc400 msgr2=0x7f06600fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- 172.21.15.77:0/3096335761 shutdown_connections 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- 172.21.15.77:0/3096335761 wait complete. 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 Processor -- start 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- start start 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0660102a70 0x7f06601981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601053a0 0x7f0660198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 0x7f066019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f066010dac0 con 0x7f0660107cd0 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f066010d940 con 0x7f0660102a70 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.603+0000 7f06670c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f066010dc40 con 0x7f06601053a0 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 0x7f066019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 0x7f066019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59420/0 (socket says 172.21.15.77:59420) 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 -- 172.21.15.77:0/3214714508 learned_addr learned my addr 172.21.15.77:0/3214714508 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:22.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0664e64640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0660102a70 0x7f06601981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f065ffff640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601053a0 0x7f0660198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 -- 172.21.15.77:0/3214714508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601053a0 msgr2=0x7f0660198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601053a0 0x7f0660198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 -- 172.21.15.77:0/3214714508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0660102a70 msgr2=0x7f06601981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0660102a70 0x7f06601981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 -- 172.21.15.77:0/3214714508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066019fe10 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f0665665640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 0x7f066019f7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f065800eb10 tx=0x7f065800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658004b20 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0658004cc0 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658010670 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06601a0100 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.604+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06601a0620 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.605+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06600fdef0 con 0x7f0660107cd0 2024-04-21T10:19:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.606+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0658005020 con 0x7f0660107cd0 2024-04-21T10:19:22.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.607+0000 7f065dffb640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06500a3c30 0x7f06500a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:22.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.607+0000 7f0664e64640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06500a3c30 0x7f06500a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:22.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.607+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f06580d0780 con 0x7f0660107cd0 2024-04-21T10:19:22.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.607+0000 7f0664e64640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06500a3c30 0x7f06500a60f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0654005fd0 tx=0x7f065400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:22.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.611+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f065809d310 con 0x7f0660107cd0 2024-04-21T10:19:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:22 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2737754203' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-21T10:19:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:22 smithi170 ceph-mon[31212]: osdmap e82: 12 total, 12 up, 12 in 2024-04-21T10:19:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:22 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1776815988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T10:19:22.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:22.827+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0660062b50 con 0x7f0660107cd0 2024-04-21T10:19:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:22 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2737754203' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-21T10:19:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:22 smithi077 ceph-mon[27902]: osdmap e82: 12 total, 12 up, 12 in 2024-04-21T10:19:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:22 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1776815988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T10:19:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:22 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2737754203' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-21T10:19:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:22 smithi191 ceph-mon[31636]: osdmap e82: 12 total, 12 up, 12 in 2024-04-21T10:19:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:22 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1776815988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T10:19:23.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.501+0000 7f065dffb640 1 -- 172.21.15.77:0/3214714508 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f065809cc10 con 0x7f0660107cd0 2024-04-21T10:19:23.501 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2024-04-21T10:19:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06500a3c30 msgr2=0x7f06500a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06500a3c30 0x7f06500a60f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0654005fd0 tx=0x7f065400b390 comp rx=0 tx=0).stop 2024-04-21T10:19:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 msgr2=0x7f066019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 0x7f066019f7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f065800eb10 tx=0x7f065800c2d0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 shutdown_connections 2024-04-21T10:19:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06500a3c30 0x7f06500a60f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0660107cd0 0x7f066019f7a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601053a0 0x7f0660198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 --2- 172.21.15.77:0/3214714508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0660102a70 0x7f06601981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 >> 172.21.15.77:0/3214714508 conn(0x7f06600fc400 msgr2=0x7f06601034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 shutdown_connections 2024-04-21T10:19:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.505+0000 7f06670c8640 1 -- 172.21.15.77:0/3214714508 wait complete. 2024-04-21T10:19:23.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:19:23.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 -- 172.21.15.77:0/4289733282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 msgr2=0x7f210810a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 --2- 172.21.15.77:0/4289733282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210810a490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2100009cd0 tx=0x7f210002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 -- 172.21.15.77:0/4289733282 shutdown_connections 2024-04-21T10:19:23.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 --2- 172.21.15.77:0/4289733282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210810a490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 --2- 172.21.15.77:0/4289733282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2108103240 0x7f21081036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 --2- 172.21.15.77:0/4289733282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2108100270 0x7f2108100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 -- 172.21.15.77:0/4289733282 >> 172.21.15.77:0/4289733282 conn(0x7f21080fbba0 msgr2=0x7f21080fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 -- 172.21.15.77:0/4289733282 shutdown_connections 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.623+0000 7f210d4c8640 1 -- 172.21.15.77:0/4289733282 wait complete. 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 Processor -- start 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 -- start start 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2108100270 0x7f2108198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2108103240 0x7f21081986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f210810db10 con 0x7f2108103c00 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f210810d990 con 0x7f2108103240 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f210d4c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f210810dc90 con 0x7f2108100270 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210819f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59430/0 (socket says 172.21.15.77:59430) 2024-04-21T10:19:23.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 -- 172.21.15.77:0/735056803 learned_addr learned my addr 172.21.15.77:0/735056803 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f2106ffd640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2108100270 0x7f2108198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f20fffff640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2108103240 0x7f21081986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 -- 172.21.15.77:0/735056803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2108100270 msgr2=0x7f2108198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2108100270 0x7f2108198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 -- 172.21.15.77:0/735056803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2108103240 msgr2=0x7f21081986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2108103240 0x7f21081986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 -- 172.21.15.77:0/735056803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210819fd90 con 0x7f2108103c00 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f21077fe640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210819f720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2100009ca0 tx=0x7f21000346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.624+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100041020 con 0x7f2108103c00 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.625+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21000327c0 con 0x7f2108103c00 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.625+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21081a0020 con 0x7f2108103c00 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.625+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100039040 con 0x7f2108103c00 2024-04-21T10:19:23.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.625+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21081a0560 con 0x7f2108103c00 2024-04-21T10:19:23.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.626+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21081093f0 con 0x7f2108103c00 2024-04-21T10:19:23.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.626+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2100044020 con 0x7f2108103c00 2024-04-21T10:19:23.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.627+0000 7f2104ff9640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20f40a3c30 0x7f20f40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.627+0000 7f2106ffd640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20f40a3c30 0x7f20f40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.627+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f21000f2090 con 0x7f2108103c00 2024-04-21T10:19:23.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.627+0000 7f2106ffd640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20f40a3c30 0x7f20f40a60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f210806a460 tx=0x7f20f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:23.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.631+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f210004b020 con 0x7f2108103c00 2024-04-21T10:19:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:23 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1776815988' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-21T10:19:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:23 smithi170 ceph-mon[31212]: osdmap e83: 12 total, 12 up, 12 in 2024-04-21T10:19:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:23 smithi170 ceph-mon[31212]: pgmap v287: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:23 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3214714508' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T10:19:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:23 smithi170 ceph-mon[31212]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-21T10:19:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.810+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2108062b50 con 0x7f2108103c00 2024-04-21T10:19:23.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.811+0000 7f2104ff9640 1 -- 172.21.15.77:0/735056803 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22242 (secure 0 0 0) 0x7f21000bebc0 con 0x7f2108103c00 2024-04-21T10:19:23.811 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:23.811 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:19:22.828899+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:19:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20f40a3c30 msgr2=0x7f20f40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20f40a3c30 0x7f20f40a60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f210806a460 tx=0x7f20f8005f90 comp rx=0 tx=0).stop 2024-04-21T10:19:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 msgr2=0x7f210819f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210819f720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2100009ca0 tx=0x7f21000346d0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 shutdown_connections 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20f40a3c30 0x7f20f40a60f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2108103c00 0x7f210819f720 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2108103240 0x7f21081986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 --2- 172.21.15.77:0/735056803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2108100270 0x7f2108198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 >> 172.21.15.77:0/735056803 conn(0x7f21080fbba0 msgr2=0x7f21081065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 shutdown_connections 2024-04-21T10:19:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.813+0000 7f210d4c8640 1 -- 172.21.15.77:0/735056803 wait complete. 2024-04-21T10:19:23.823 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:23 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1776815988' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-21T10:19:23.823 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:23 smithi077 ceph-mon[27902]: osdmap e83: 12 total, 12 up, 12 in 2024-04-21T10:19:23.823 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:23 smithi077 ceph-mon[27902]: pgmap v287: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:23.823 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:23 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3214714508' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T10:19:23.823 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:23 smithi077 ceph-mon[27902]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-21T10:19:23.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 -- 172.21.15.77:0/2388815676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110100e70 msgr2=0x7f9110101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 --2- 172.21.15.77:0/2388815676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110100e70 0x7f9110101290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9108009ca0 tx=0x7f910802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 -- 172.21.15.77:0/2388815676 shutdown_connections 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 --2- 172.21.15.77:0/2388815676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110102980 0x7f91101092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 --2- 172.21.15.77:0/2388815676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9110101fc0 0x7f9110102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 --2- 172.21.15.77:0/2388815676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110100e70 0x7f9110101290 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.922+0000 7f9117b52640 1 -- 172.21.15.77:0/2388815676 >> 172.21.15.77:0/2388815676 conn(0x7f91100fc3e0 msgr2=0x7f91100fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 -- 172.21.15.77:0/2388815676 shutdown_connections 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 -- 172.21.15.77:0/2388815676 wait complete. 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 Processor -- start 2024-04-21T10:19:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 -- start start 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9110100e70 0x7f9110069c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110101fc0 0x7f911019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 0x7f911019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f911010ca20 con 0x7f9110102980 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f911010c8a0 con 0x7f9110100e70 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f9117b52640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f911010cba0 con 0x7f9110101fc0 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f91160ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 0x7f911019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f91160ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 0x7f911019f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59438/0 (socket says 172.21.15.77:59438) 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f91160ef640 1 -- 172.21.15.77:0/2040220272 learned_addr learned my addr 172.21.15.77:0/2040220272 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f91158ee640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9110100e70 0x7f9110069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.923+0000 7f91150ed640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110101fc0 0x7f911019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91160ef640 1 -- 172.21.15.77:0/2040220272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110101fc0 msgr2=0x7f911019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91160ef640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110101fc0 0x7f911019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91160ef640 1 -- 172.21.15.77:0/2040220272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9110100e70 msgr2=0x7f9110069c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91160ef640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9110100e70 0x7f9110069c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91160ef640 1 -- 172.21.15.77:0/2040220272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911019fda0 con 0x7f9110102980 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91150ed640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110101fc0 0x7f911019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f91160ef640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 0x7f911019f4e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9100009fd0 tx=0x7f910000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100011830 con 0x7f9110102980 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101a0090 con 0x7f9110102980 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9100016070 con 0x7f9110102980 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100010de0 con 0x7f9110102980 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.924+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91101a0630 con 0x7f9110102980 2024-04-21T10:19:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.925+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9110108180 con 0x7f9110102980 2024-04-21T10:19:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.926+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f91000119d0 con 0x7f9110102980 2024-04-21T10:19:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.927+0000 7f910effd640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90f80a3bb0 0x7f90f80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.927+0000 7f91158ee640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90f80a3bb0 0x7f90f80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.927+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f91000cf960 con 0x7f9110102980 2024-04-21T10:19:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.927+0000 7f91158ee640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90f80a3bb0 0x7f90f80a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9108032520 tx=0x7f9108000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:23.931+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f910009c490 con 0x7f9110102980 2024-04-21T10:19:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:23 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1776815988' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-21T10:19:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:23 smithi191 ceph-mon[31636]: osdmap e83: 12 total, 12 up, 12 in 2024-04-21T10:19:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:23 smithi191 ceph-mon[31636]: pgmap v287: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:19:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:23 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3214714508' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T10:19:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:23 smithi191 ceph-mon[31636]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-21T10:19:24.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.111+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f911002d810 con 0x7f9110102980 2024-04-21T10:19:24.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.112+0000 7f910effd640 1 -- 172.21.15.77:0/2040220272 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22242 (secure 0 0 0) 0x7f910009bd90 con 0x7f9110102980 2024-04-21T10:19:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:24.112 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:19:22.828899+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:19:24.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90f80a3bb0 msgr2=0x7f90f80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90f80a3bb0 0x7f90f80a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9108032520 tx=0x7f9108000f40 comp rx=0 tx=0).stop 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 msgr2=0x7f911019f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 0x7f911019f4e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9100009fd0 tx=0x7f910000b8e0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 shutdown_connections 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90f80a3bb0 0x7f90f80a6070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110102980 0x7f911019f4e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9110101fc0 0x7f911019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 --2- 172.21.15.77:0/2040220272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9110100e70 0x7f9110069c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 >> 172.21.15.77:0/2040220272 conn(0x7f91100fc3e0 msgr2=0x7f9110105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 shutdown_connections 2024-04-21T10:19:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.114+0000 7f9117b52640 1 -- 172.21.15.77:0/2040220272 wait complete. 2024-04-21T10:19:24.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-21T10:19:24.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.226+0000 7fbd8e304640 1 -- 172.21.15.77:0/1000909051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 msgr2=0x7fbd88074d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.226+0000 7fbd8e304640 1 --2- 172.21.15.77:0/1000909051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd88074d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009900 tx=0x7fbd7c02bcd0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- 172.21.15.77:0/1000909051 shutdown_connections 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 --2- 172.21.15.77:0/1000909051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd88074d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 --2- 172.21.15.77:0/1000909051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd88109e50 0x7fbd8810c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 --2- 172.21.15.77:0/1000909051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88075f10 0x7fbd88074360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- 172.21.15.77:0/1000909051 >> 172.21.15.77:0/1000909051 conn(0x7fbd880fd530 msgr2=0x7fbd880ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- 172.21.15.77:0/1000909051 shutdown_connections 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- 172.21.15.77:0/1000909051 wait complete. 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 Processor -- start 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- start start 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd8819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd88075f10 0x7fbd8819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88109e50 0x7fbd881a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8810fcf0 con 0x7fbd88074930 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8810fb70 con 0x7fbd88109e50 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.227+0000 7fbd8e304640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8810fe70 con 0x7fbd88075f10 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd8819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd8819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59446/0 (socket says 172.21.15.77:59446) 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 -- 172.21.15.77:0/934473252 learned_addr learned my addr 172.21.15.77:0/934473252 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd877fe640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd88075f10 0x7fbd8819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd8c8a1640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88109e50 0x7fbd881a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 -- 172.21.15.77:0/934473252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd88075f10 msgr2=0x7fbd8819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd88075f10 0x7fbd8819a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 -- 172.21.15.77:0/934473252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88109e50 msgr2=0x7fbd881a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88109e50 0x7fbd881a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 -- 172.21.15.77:0/934473252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd881a1ff0 con 0x7fbd88074930 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd8c8a1640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88109e50 0x7fbd881a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd87fff640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd8819a3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800e9f0 tx=0x7fbd7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800cd80 con 0x7fbd88074930 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd780108e0 con 0x7fbd88074930 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd881a22e0 con 0x7fbd88074930 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78018980 con 0x7fbd88074930 2024-04-21T10:19:24.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.228+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd881a2830 con 0x7fbd88074930 2024-04-21T10:19:24.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.229+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd88108c10 con 0x7fbd88074930 2024-04-21T10:19:24.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.230+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbd78010430 con 0x7fbd88074930 2024-04-21T10:19:24.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.231+0000 7fbd857fa640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fbd700a3bb0 0x7fbd700a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.231+0000 7fbd877fe640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fbd700a3bb0 0x7fbd700a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.231+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fbd780d06e0 con 0x7fbd88074930 2024-04-21T10:19:24.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.231+0000 7fbd877fe640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fbd700a3bb0 0x7fbd700a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd8819b8e0 tx=0x7fbd7c005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:24.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.235+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd7809d210 con 0x7fbd88074930 2024-04-21T10:19:24.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.451+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbd8802d5c0 con 0x7fbd88074930 2024-04-21T10:19:24.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.508+0000 7fbd857fa640 1 -- 172.21.15.77:0/934473252 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fbd7809cb10 con 0x7fbd88074930 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fbd700a3bb0 msgr2=0x7fbd700a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fbd700a3bb0 0x7fbd700a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd8819b8e0 tx=0x7fbd7c005be0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 msgr2=0x7fbd8819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd8819a3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800e9f0 tx=0x7fbd7800eeb0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 shutdown_connections 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fbd700a3bb0 0x7fbd700a6070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd88109e50 0x7fbd881a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd88075f10 0x7fbd8819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 --2- 172.21.15.77:0/934473252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd88074930 0x7fbd8819a3d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 >> 172.21.15.77:0/934473252 conn(0x7fbd880fd530 msgr2=0x7fbd88105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 shutdown_connections 2024-04-21T10:19:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.511+0000 7fbd8e304640 1 -- 172.21.15.77:0/934473252 wait complete. 2024-04-21T10:19:24.522 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-04-21T10:19:24.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 -- 172.21.15.77:0/1974995287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 msgr2=0x7f1b7410a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 --2- 172.21.15.77:0/1974995287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7410a0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009ca0 tx=0x7f1b6c02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 -- 172.21.15.77:0/1974995287 shutdown_connections 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 --2- 172.21.15.77:0/1974995287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7410a0e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 --2- 172.21.15.77:0/1974995287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b741053c0 0x7f1b741077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 --2- 172.21.15.77:0/1974995287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 0x7f1b74104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 -- 172.21.15.77:0/1974995287 >> 172.21.15.77:0/1974995287 conn(0x7f1b740fc440 msgr2=0x7f1b740fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 -- 172.21.15.77:0/1974995287 shutdown_connections 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.623+0000 7f1b7b985640 1 -- 172.21.15.77:0/1974995287 wait complete. 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 Processor -- start 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 -- start start 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 0x7f1b74198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b741053c0 0x7f1b741987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410db70 con 0x7f1b74107cf0 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410d9f0 con 0x7f1b74102a90 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410dcf0 con 0x7f1b741053c0 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59460/0 (socket says 172.21.15.77:59460) 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 -- 172.21.15.77:0/3984974979 learned_addr learned my addr 172.21.15.77:0/3984974979 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:24.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b78f20640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b741053c0 0x7f1b741987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79721640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 0x7f1b74198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 -- 172.21.15.77:0/3984974979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b741053c0 msgr2=0x7f1b741987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b741053c0 0x7f1b741987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 -- 172.21.15.77:0/3984974979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 msgr2=0x7f1b74198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 0x7f1b74198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 -- 172.21.15.77:0/3984974979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7419fe80 con 0x7f1b74107cf0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79721640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 0x7f1b74198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b79f22640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7419f810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c02c700 tx=0x7f1b6c034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c039040 con 0x7f1b74107cf0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b6c044070 con 0x7f1b74107cf0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b741a0110 con 0x7f1b74107cf0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.624+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0042a0 con 0x7f1b74107cf0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.625+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b741a0600 con 0x7f1b74107cf0 2024-04-21T10:19:24.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.625+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b740fdf30 con 0x7f1b74107cf0 2024-04-21T10:19:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.626+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1b6c003970 con 0x7f1b74107cf0 2024-04-21T10:19:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.627+0000 7f1b6a7fc640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1b600a3bb0 0x7f1b600a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.627+0000 7f1b79721640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1b600a3bb0 0x7f1b600a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.627+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f1b6c0f3240 con 0x7f1b74107cf0 2024-04-21T10:19:24.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.627+0000 7f1b79721640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1b600a3bb0 0x7f1b600a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b70006fd0 tx=0x7f1b70008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.631+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1b6c0bfd70 con 0x7f1b74107cf0 2024-04-21T10:19:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-21T10:19:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: osdmap e84: 12 total, 12 up, 12 in 2024-04-21T10:19:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3214714508' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-21T10:19:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-21T10:19:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-21T10:19:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/735056803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2040220272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:24 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/934473252' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T10:19:24.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:24.850+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f1b7402d5c0 con 0x7f1b74107cf0 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: osdmap e84: 12 total, 12 up, 12 in 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3214714508' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/735056803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2040220272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:24 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/934473252' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T10:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-21T10:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: osdmap e84: 12 total, 12 up, 12 in 2024-04-21T10:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3214714508' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-21T10:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-21T10:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-21T10:19:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/735056803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2040220272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:24 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/934473252' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T10:19:25.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.514+0000 7f1b6a7fc640 1 -- 172.21.15.77:0/3984974979 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v16) ==== 105+0+0 (secure 0 0 0) 0x7f1b6c0bf670 con 0x7f1b74107cf0 2024-04-21T10:19:25.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1b600a3bb0 msgr2=0x7f1b600a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1b600a3bb0 0x7f1b600a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b70006fd0 tx=0x7f1b70008040 comp rx=0 tx=0).stop 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 msgr2=0x7f1b7419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7419f810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c02c700 tx=0x7f1b6c034760 comp rx=0 tx=0).stop 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 shutdown_connections 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1b600a3bb0 0x7f1b600a6070 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b74107cf0 0x7f1b7419f810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b741053c0 0x7f1b741987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 --2- 172.21.15.77:0/3984974979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74102a90 0x7f1b74198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.517+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 >> 172.21.15.77:0/3984974979 conn(0x7f1b740fc440 msgr2=0x7f1b741033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.518+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 shutdown_connections 2024-04-21T10:19:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.518+0000 7f1b7b985640 1 -- 172.21.15.77:0/3984974979 wait complete. 2024-04-21T10:19:25.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-21T10:19:25.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 -- 172.21.15.77:0/2689433787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258100820 msgr2=0x7fa258102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/2689433787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258100820 0x7fa258102c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa250009900 tx=0x7fa25002bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:25.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 -- 172.21.15.77:0/2689433787 shutdown_connections 2024-04-21T10:19:25.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/2689433787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa258105b40 0x7fa258105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/2689433787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258103190 0x7fa258105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/2689433787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258100820 0x7fa258102c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 -- 172.21.15.77:0/2689433787 >> 172.21.15.77:0/2689433787 conn(0x7fa2580fc440 msgr2=0x7fa2580fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 -- 172.21.15.77:0/2689433787 shutdown_connections 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.639+0000 7fa25ffa4640 1 -- 172.21.15.77:0/2689433787 wait complete. 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 Processor -- start 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 -- start start 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258100820 0x7fa25819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa258103190 0x7fa25819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 0x7fa2581a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa258114120 con 0x7fa258105b40 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa258113fa0 con 0x7fa258100820 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581142a0 con 0x7fa258103190 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 0x7fa2581a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 0x7fa2581a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59476/0 (socket says 172.21.15.77:59476) 2024-04-21T10:19:25.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 -- 172.21.15.77:0/1320082753 learned_addr learned my addr 172.21.15.77:0/1320082753 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25dd40640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258100820 0x7fa25819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25d53f640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa258103190 0x7fa25819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 -- 172.21.15.77:0/1320082753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa258103190 msgr2=0x7fa25819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa258103190 0x7fa25819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 -- 172.21.15.77:0/1320082753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258100820 msgr2=0x7fa25819e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258100820 0x7fa25819e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 -- 172.21.15.77:0/1320082753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2581a6450 con 0x7fa258105b40 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25dd40640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258100820 0x7fa25819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25e541640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 0x7fa2581a5de0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa25400b970 tx=0x7fa25400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254019070 con 0x7fa258105b40 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2581a6740 con 0x7fa258105b40 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.640+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa254014440 con 0x7fa258105b40 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.641+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2540075d0 con 0x7fa258105b40 2024-04-21T10:19:25.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.641+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2581a6d60 con 0x7fa258105b40 2024-04-21T10:19:25.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.641+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2580fdf30 con 0x7fa258105b40 2024-04-21T10:19:25.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.642+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa25401c070 con 0x7fa258105b40 2024-04-21T10:19:25.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.643+0000 7fa24effd640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2440a3bb0 0x7fa2440a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:25.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.643+0000 7fa25dd40640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2440a3bb0 0x7fa2440a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:25.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.643+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fa2540cfd40 con 0x7fa258105b40 2024-04-21T10:19:25.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.643+0000 7fa25dd40640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2440a3bb0 0x7fa2440a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa2500095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:25.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.647+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa25409c870 con 0x7fa258105b40 2024-04-21T10:19:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:25 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/934473252' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-21T10:19:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:25 smithi170 ceph-mon[31212]: osdmap e85: 12 total, 12 up, 12 in 2024-04-21T10:19:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:25 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:19:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:25 smithi170 ceph-mon[31212]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-21T10:19:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:25 smithi170 ceph-mon[31212]: pgmap v290: 97 pgs: 5 creating+peering, 38 active+clean, 54 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 3 op/s 2024-04-21T10:19:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:25 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3984974979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-21T10:19:25.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.864+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa25802d7c0 con 0x7fa258105b40 2024-04-21T10:19:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:25 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/934473252' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-21T10:19:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:25 smithi077 ceph-mon[27902]: osdmap e85: 12 total, 12 up, 12 in 2024-04-21T10:19:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:25 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:19:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:25 smithi077 ceph-mon[27902]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-21T10:19:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:25 smithi077 ceph-mon[27902]: pgmap v290: 97 pgs: 5 creating+peering, 38 active+clean, 54 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 3 op/s 2024-04-21T10:19:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:25 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3984974979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-21T10:19:25.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.967+0000 7fa24effd640 1 -- 172.21.15.77:0/1320082753 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fa25409c170 con 0x7fa258105b40 2024-04-21T10:19:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:25 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/934473252' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-21T10:19:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:25 smithi191 ceph-mon[31636]: osdmap e85: 12 total, 12 up, 12 in 2024-04-21T10:19:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:25 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:19:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:25 smithi191 ceph-mon[31636]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-21T10:19:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:25 smithi191 ceph-mon[31636]: pgmap v290: 97 pgs: 5 creating+peering, 38 active+clean, 54 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 3 op/s 2024-04-21T10:19:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:25 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3984974979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-21T10:19:25.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2440a3bb0 msgr2=0x7fa2440a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2440a3bb0 0x7fa2440a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa2500095f0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 msgr2=0x7fa2581a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:25.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 0x7fa2581a5de0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa25400b970 tx=0x7fa25400be30 comp rx=0 tx=0).stop 2024-04-21T10:19:25.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 shutdown_connections 2024-04-21T10:19:25.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa2440a3bb0 0x7fa2440a6070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa258105b40 0x7fa2581a5de0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa258103190 0x7fa25819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 --2- 172.21.15.77:0/1320082753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa258100820 0x7fa25819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 >> 172.21.15.77:0/1320082753 conn(0x7fa2580fc440 msgr2=0x7fa258103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 shutdown_connections 2024-04-21T10:19:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:25.969+0000 7fa25ffa4640 1 -- 172.21.15.77:0/1320082753 wait complete. 2024-04-21T10:19:25.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 -- 172.21.15.77:0/1420373764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48107c70 msgr2=0x7f9d4810a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 --2- 172.21.15.77:0/1420373764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48107c70 0x7f9d4810a0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009ca0 tx=0x7f9d4002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 -- 172.21.15.77:0/1420373764 shutdown_connections 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 --2- 172.21.15.77:0/1420373764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48107c70 0x7f9d4810a0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 --2- 172.21.15.77:0/1420373764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d48105340 0x7f9d48107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 --2- 172.21.15.77:0/1420373764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d48102a10 0x7f9d48104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 -- 172.21.15.77:0/1420373764 >> 172.21.15.77:0/1420373764 conn(0x7f9d480fc400 msgr2=0x7f9d480fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:26.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 -- 172.21.15.77:0/1420373764 shutdown_connections 2024-04-21T10:19:26.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.085+0000 7f9d4d167640 1 -- 172.21.15.77:0/1420373764 wait complete. 2024-04-21T10:19:26.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 Processor -- start 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 -- start start 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 0x7f9d48198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d48105340 0x7f9d48198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d48107c70 0x7f9d4819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4810db30 con 0x7f9d48102a10 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4810d9b0 con 0x7f9d48107c70 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4d167640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4810dcb0 con 0x7f9d48105340 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 0x7f9d48198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 0x7f9d48198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59480/0 (socket says 172.21.15.77:59480) 2024-04-21T10:19:26.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 -- 172.21.15.77:0/3783271122 learned_addr learned my addr 172.21.15.77:0/3783271122 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4659c640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d48105340 0x7f9d48198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d4759e640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d48107c70 0x7f9d4819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 -- 172.21.15.77:0/3783271122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d48105340 msgr2=0x7f9d48198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d48105340 0x7f9d48198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 -- 172.21.15.77:0/3783271122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d48107c70 msgr2=0x7f9d4819f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d48107c70 0x7f9d4819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.086+0000 7f9d46d9d640 1 -- 172.21.15.77:0/3783271122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4819fe20 con 0x7f9d48102a10 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.087+0000 7f9d46d9d640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 0x7f9d48198200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800d950 tx=0x7f9d3800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.087+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38017070 con 0x7f9d48102a10 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.087+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d3800de80 con 0x7f9d48102a10 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.087+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d481a0110 con 0x7f9d48102a10 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.087+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800f620 con 0x7f9d48102a10 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.087+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d481a0660 con 0x7f9d48102a10 2024-04-21T10:19:26.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.088+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d480fdef0 con 0x7f9d48102a10 2024-04-21T10:19:26.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.089+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9d38009c30 con 0x7f9d48102a10 2024-04-21T10:19:26.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.089+0000 7f9d2ffff640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9d300a3bb0 0x7f9d300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:26.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.090+0000 7f9d4659c640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9d300a3bb0 0x7f9d300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:26.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.090+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f9d380cff20 con 0x7f9d48102a10 2024-04-21T10:19:26.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.090+0000 7f9d4659c640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9d300a3bb0 0x7f9d300a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d48199710 tx=0x7f9d3c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:26.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.093+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9d3809ca50 con 0x7f9d48102a10 2024-04-21T10:19:26.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.311+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9d4802d5c0 con 0x7f9d48102a10 2024-04-21T10:19:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: Cluster is now healthy 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3984974979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1320082753' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1320082753' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-21T10:19:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-21T10:19:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: Cluster is now healthy 2024-04-21T10:19:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 2 up:standby-replay 8 up:standby 2024-04-21T10:19:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:creating} 2 up:standby-replay 7 up:standby 2024-04-21T10:19:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-21T10:19:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:26 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3783271122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T10:19:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: Cluster is now healthy 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3984974979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1320082753' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1320082753' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:19:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-21T10:19:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-21T10:19:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: Cluster is now healthy 2024-04-21T10:19:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 2 up:standby-replay 8 up:standby 2024-04-21T10:19:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:creating} 2 up:standby-replay 7 up:standby 2024-04-21T10:19:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-21T10:19:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:26 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3783271122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T10:19:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-21T10:19:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: Cluster is now healthy 2024-04-21T10:19:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3984974979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1320082753' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1320082753' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: Cluster is now healthy 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 2 up:standby-replay 8 up:standby 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:creating} 2 up:standby-replay 7 up:standby 2024-04-21T10:19:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-21T10:19:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:26 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3783271122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T10:19:26.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.973+0000 7f9d2ffff640 1 -- 172.21.15.77:0/3783271122 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f9d3809c350 con 0x7f9d48102a10 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9d300a3bb0 msgr2=0x7f9d300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9d300a3bb0 0x7f9d300a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d48199710 tx=0x7f9d3c009110 comp rx=0 tx=0).stop 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 msgr2=0x7f9d48198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 0x7f9d48198200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800d950 tx=0x7f9d3800dd50 comp rx=0 tx=0).stop 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 shutdown_connections 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9d300a3bb0 0x7f9d300a6070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d48107c70 0x7f9d4819f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d48105340 0x7f9d48198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 --2- 172.21.15.77:0/3783271122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d48102a10 0x7f9d48198200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 >> 172.21.15.77:0/3783271122 conn(0x7f9d480fc400 msgr2=0x7f9d48103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 shutdown_connections 2024-04-21T10:19:26.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:26.976+0000 7f9d4d167640 1 -- 172.21.15.77:0/3783271122 wait complete. 2024-04-21T10:19:26.989 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-04-21T10:19:26.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.093+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/1639892905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4107c70 msgr2=0x7fc6f410a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.093+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/1639892905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4107c70 0x7fc6f410a0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009ca0 tx=0x7fc6ec02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/1639892905 shutdown_connections 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/1639892905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4107c70 0x7fc6f410a0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/1639892905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6f4105340 0x7fc6f4107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/1639892905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4102a10 0x7fc6f4104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/1639892905 >> 172.21.15.77:0/1639892905 conn(0x7fc6f40fc400 msgr2=0x7fc6f40fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/1639892905 shutdown_connections 2024-04-21T10:19:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/1639892905 wait complete. 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 Processor -- start 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- start start 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6f4102a10 0x7fc6f4198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 0x7fc6f41986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4107c70 0x7fc6f419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f410dad0 con 0x7fc6f4105340 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f410d950 con 0x7fc6f4107c70 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6f9b0e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f410dc50 con 0x7fc6f4102a10 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 0x7fc6f41986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 0x7fc6f41986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59498/0 (socket says 172.21.15.77:59498) 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.094+0000 7fc6ebfff640 1 -- 172.21.15.77:0/2345629160 learned_addr learned my addr 172.21.15.77:0/2345629160 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f37fe640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6f4102a10 0x7fc6f4198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f3fff640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4107c70 0x7fc6f419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6ebfff640 1 -- 172.21.15.77:0/2345629160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6f4102a10 msgr2=0x7fc6f4198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6ebfff640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6f4102a10 0x7fc6f4198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6ebfff640 1 -- 172.21.15.77:0/2345629160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4107c70 msgr2=0x7fc6f419f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6ebfff640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4107c70 0x7fc6f419f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6ebfff640 1 -- 172.21.15.77:0/2345629160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f419fd90 con 0x7fc6f4105340 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f3fff640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4107c70 0x7fc6f419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6ebfff640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 0x7fc6f41986b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e9f0 tx=0x7fc6dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00ccc0 con 0x7fc6f4105340 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6dc0054d0 con 0x7fc6f4105340 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f41a0080 con 0x7fc6f4105340 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc010430 con 0x7fc6f4105340 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.095+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f41a05d0 con 0x7fc6f4105340 2024-04-21T10:19:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.096+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f40fdef0 con 0x7fc6f4105340 2024-04-21T10:19:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.097+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc6dc0046c0 con 0x7fc6f4105340 2024-04-21T10:19:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.098+0000 7fc6f17fa640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6e00a3c30 0x7fc6e00a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.098+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc6dc0d0830 con 0x7fc6f4105340 2024-04-21T10:19:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.098+0000 7fc6f37fe640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6e00a3c30 0x7fc6e00a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.098+0000 7fc6f37fe640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6e00a3c30 0x7fc6e00a60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400abe0 tx=0x7fc6e400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.101+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6dc053ff0 con 0x7fc6f4105340 2024-04-21T10:19:27.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.304+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc6f4062390 con 0x7fc6e00a3c30 2024-04-21T10:19:27.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.330+0000 7fc6f17fa640 1 -- 172.21.15.77:0/2345629160 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc6f4062390 con 0x7fc6e00a3c30 2024-04-21T10:19:27.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6e00a3c30 msgr2=0x7fc6e00a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6e00a3c30 0x7fc6e00a60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400abe0 tx=0x7fc6e400a2d0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 msgr2=0x7fc6f41986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 0x7fc6f41986b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e9f0 tx=0x7fc6dc00edf0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 shutdown_connections 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6e00a3c30 0x7fc6e00a60f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6f4105340 0x7fc6f41986b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6f4107c70 0x7fc6f419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 --2- 172.21.15.77:0/2345629160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6f4102a10 0x7fc6f4198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 >> 172.21.15.77:0/2345629160 conn(0x7fc6f40fc400 msgr2=0x7fc6f4103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 shutdown_connections 2024-04-21T10:19:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.332+0000 7fc6f9b0e640 1 -- 172.21.15.77:0/2345629160 wait complete. 2024-04-21T10:19:27.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-21T10:19:27.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 -- 172.21.15.77:0/3087905555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850103bf0 msgr2=0x7fc85010a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 --2- 172.21.15.77:0/3087905555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850103bf0 0x7fc85010a480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc848009cd0 tx=0x7fc84802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 -- 172.21.15.77:0/3087905555 shutdown_connections 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 --2- 172.21.15.77:0/3087905555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850103bf0 0x7fc85010a480 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 --2- 172.21.15.77:0/3087905555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc850103230 0x7fc8501036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 --2- 172.21.15.77:0/3087905555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850100260 0x7fc850100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 -- 172.21.15.77:0/3087905555 >> 172.21.15.77:0/3087905555 conn(0x7fc8500fbb90 msgr2=0x7fc8500fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 -- 172.21.15.77:0/3087905555 shutdown_connections 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.446+0000 7fc857a32640 1 -- 172.21.15.77:0/3087905555 wait complete. 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 Processor -- start 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 -- start start 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 0x7fc850102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850103230 0x7fc8501011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc850103bf0 0x7fc850101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc85010db80 con 0x7fc850100260 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc85010da00 con 0x7fc850103230 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc857a32640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc85010dd00 con 0x7fc850103bf0 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 0x7fc850102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 0x7fc850102ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59514/0 (socket says 172.21.15.77:59514) 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 -- 172.21.15.77:0/1005666252 learned_addr learned my addr 172.21.15.77:0/1005666252 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc855fcf640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc850103bf0 0x7fc850101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc854fcd640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850103230 0x7fc8501011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 -- 172.21.15.77:0/1005666252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc850103bf0 msgr2=0x7fc850101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc850103bf0 0x7fc850101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 -- 172.21.15.77:0/1005666252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850103230 msgr2=0x7fc8501011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850103230 0x7fc8501011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 -- 172.21.15.77:0/1005666252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc850101fb0 con 0x7fc850100260 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc854fcd640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850103230 0x7fc8501011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.447+0000 7fc8557ce640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 0x7fc850102ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00b450 tx=0x7fc84c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.448+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c015020 con 0x7fc850100260 2024-04-21T10:19:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.448+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc84c011d40 con 0x7fc850100260 2024-04-21T10:19:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.448+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8501a2350 con 0x7fc850100260 2024-04-21T10:19:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.448+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00f340 con 0x7fc850100260 2024-04-21T10:19:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.448+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8501a28f0 con 0x7fc850100260 2024-04-21T10:19:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.449+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc850109360 con 0x7fc850100260 2024-04-21T10:19:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.450+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc84c018020 con 0x7fc850100260 2024-04-21T10:19:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.450+0000 7fc8467fc640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc83c0a3c30 0x7fc83c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.450+0000 7fc854fcd640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc83c0a3c30 0x7fc83c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.451+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc84c0cfd30 con 0x7fc850100260 2024-04-21T10:19:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.451+0000 7fc854fcd640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc83c0a3c30 0x7fc83c0a60f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc850102910 tx=0x7fc840005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.455+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc84c01f020 con 0x7fc850100260 2024-04-21T10:19:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-mon[27902]: pgmap v291: 97 pgs: 5 creating+peering, 90 active+clean, 2 unknown; 578 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-04-21T10:19:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3783271122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-21T10:19:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] up:active 2024-04-21T10:19:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-04-21T10:19:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:19:27.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:19:27.309+0000 7facffab2700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:19:27.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:19:27.309+0000 7facffab2700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:19:27.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:19:27.309+0000 7facffab2700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:19:27.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:19:27.309+0000 7facffab2700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:19:27.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:19:27 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:19:27.309+0000 7facffab2700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:19:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.664+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc850062420 con 0x7fc83c0a3c30 2024-04-21T10:19:27.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.690+0000 7fc8467fc640 1 -- 172.21.15.77:0/1005666252 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc850062420 con 0x7fc83c0a3c30 2024-04-21T10:19:27.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc83c0a3c30 msgr2=0x7fc83c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc83c0a3c30 0x7fc83c0a60f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc850102910 tx=0x7fc840005f90 comp rx=0 tx=0).stop 2024-04-21T10:19:27.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 msgr2=0x7fc850102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 0x7fc850102ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00b450 tx=0x7fc84c00b910 comp rx=0 tx=0).stop 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 shutdown_connections 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc83c0a3c30 0x7fc83c0a60f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc850103bf0 0x7fc850101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850103230 0x7fc8501011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 --2- 172.21.15.77:0/1005666252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc850100260 0x7fc850102ba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 >> 172.21.15.77:0/1005666252 conn(0x7fc8500fbb90 msgr2=0x7fc850106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 shutdown_connections 2024-04-21T10:19:27.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.693+0000 7fc857a32640 1 -- 172.21.15.77:0/1005666252 wait complete. 2024-04-21T10:19:27.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-21T10:19:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 -- 172.21.15.77:0/986973041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380102040 msgr2=0x7f83801024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 --2- 172.21.15.77:0/986973041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380102040 0x7f83801024c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8370009900 tx=0x7f837002bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 -- 172.21.15.77:0/986973041 shutdown_connections 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 --2- 172.21.15.77:0/986973041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380102040 0x7f83801024c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 --2- 172.21.15.77:0/986973041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380102a00 0x7f8380109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 --2- 172.21.15.77:0/986973041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380100e60 0x7f8380101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 -- 172.21.15.77:0/986973041 >> 172.21.15.77:0/986973041 conn(0x7f83800fc440 msgr2=0x7f83800fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 -- 172.21.15.77:0/986973041 shutdown_connections 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.806+0000 7f8387da4640 1 -- 172.21.15.77:0/986973041 wait complete. 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 Processor -- start 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 -- start start 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 0x7f8380198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380102040 0x7f83801986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380102a00 0x7f838019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f838010db90 con 0x7f8380100e60 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f838010da10 con 0x7f8380102a00 2024-04-21T10:19:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f838010dd10 con 0x7f8380102040 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 0x7f8380198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 0x7f8380198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59528/0 (socket says 172.21.15.77:59528) 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 -- 172.21.15.77:0/2429676090 learned_addr learned my addr 172.21.15.77:0/2429676090 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f838533f640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380102040 0x7f83801986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8386341640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380102a00 0x7f838019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 -- 172.21.15.77:0/2429676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380102040 msgr2=0x7f83801986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380102040 0x7f83801986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 -- 172.21.15.77:0/2429676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380102a00 msgr2=0x7f838019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380102a00 0x7f838019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 -- 172.21.15.77:0/2429676090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838019fdb0 con 0x7f8380100e60 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8386341640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380102a00 0x7f838019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8385b40640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 0x7f8380198190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f837c00e9c0 tx=0x7f837c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c00cd80 con 0x7f8380100e60 2024-04-21T10:19:27.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f837c0035f0 con 0x7f8380100e60 2024-04-21T10:19:27.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.807+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83801a00a0 con 0x7f8380100e60 2024-04-21T10:19:27.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.808+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c010690 con 0x7f8380100e60 2024-04-21T10:19:27.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.808+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83801a0610 con 0x7f8380100e60 2024-04-21T10:19:27.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.808+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83801081a0 con 0x7f8380100e60 2024-04-21T10:19:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:27 smithi170 ceph-mon[31212]: pgmap v291: 97 pgs: 5 creating+peering, 90 active+clean, 2 unknown; 578 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-04-21T10:19:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:27 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3783271122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-21T10:19:27.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:27 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] up:active 2024-04-21T10:19:27.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:27 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-04-21T10:19:27.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:27 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:19:27.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.810+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f837c0037a0 con 0x7f8380100e60 2024-04-21T10:19:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.810+0000 7f8376ffd640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f836c0a3c30 0x7f836c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.810+0000 7f838533f640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f836c0a3c30 0x7f836c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.810+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f837c0d0750 con 0x7f8380100e60 2024-04-21T10:19:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.811+0000 7f838533f640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f836c0a3c30 0x7f836c0a60f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8370000c00 tx=0x7f837002c7e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:27.814+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f837c09d280 con 0x7f8380100e60 2024-04-21T10:19:27.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:27 smithi191 ceph-mon[31636]: pgmap v291: 97 pgs: 5 creating+peering, 90 active+clean, 2 unknown; 578 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-04-21T10:19:27.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:27 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3783271122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-21T10:19:27.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:27 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] up:active 2024-04-21T10:19:27.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:27 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-04-21T10:19:27.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:27 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:19:28.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.022+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8380062390 con 0x7f836c0a3c30 2024-04-21T10:19:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.028+0000 7f8376ffd640 1 -- 172.21.15.77:0/2429676090 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8380062390 con 0x7f836c0a3c30 2024-04-21T10:19:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/qa/sv_0/8671bd0f-2684-4aec-be6f-89aa65269dc4 2024-04-21T10:19:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f836c0a3c30 msgr2=0x7f836c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f836c0a3c30 0x7f836c0a60f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8370000c00 tx=0x7f837002c7e0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 msgr2=0x7f8380198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 0x7f8380198190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f837c00e9c0 tx=0x7f837c00ee80 comp rx=0 tx=0).stop 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 shutdown_connections 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f836c0a3c30 0x7f836c0a60f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8380102a00 0x7f838019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380102040 0x7f83801986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 --2- 172.21.15.77:0/2429676090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8380100e60 0x7f8380198190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 >> 172.21.15.77:0/2429676090 conn(0x7f83800fc440 msgr2=0x7f8380105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 shutdown_connections 2024-04-21T10:19:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.030+0000 7f8387da4640 1 -- 172.21.15.77:0/2429676090 wait complete. 2024-04-21T10:19:28.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-21T10:19:28.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 -- 172.21.15.77:0/565228829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a0103580 msgr2=0x7fb9a01039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 --2- 172.21.15.77:0/565228829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a0103580 0x7fb9a01039a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb990009900 tx=0x7fb99002bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 -- 172.21.15.77:0/565228829 shutdown_connections 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 --2- 172.21.15.77:0/565228829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9a01009b0 0x7fb9a010a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 --2- 172.21.15.77:0/565228829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a00ffff0 0x7fb9a0100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 --2- 172.21.15.77:0/565228829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a0103580 0x7fb9a01039a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.143+0000 7fb9a5359640 1 -- 172.21.15.77:0/565228829 >> 172.21.15.77:0/565228829 conn(0x7fb9a00fbb90 msgr2=0x7fb9a00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 -- 172.21.15.77:0/565228829 shutdown_connections 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 -- 172.21.15.77:0/565228829 wait complete. 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 Processor -- start 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 -- start start 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9a00ffff0 0x7fb9a0102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 0x7fb9a01012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a0103580 0x7fb9a0101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a010db30 con 0x7fb9a01009b0 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a010d9b0 con 0x7fb9a00ffff0 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb9a5359640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a010dcb0 con 0x7fb9a0103580 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.144+0000 7fb99e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 0x7fb9a01012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 0x7fb9a01012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59534/0 (socket says 172.21.15.77:59534) 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 -- 172.21.15.77:0/1920737556 learned_addr learned my addr 172.21.15.77:0/1920737556 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99effd640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9a00ffff0 0x7fb9a0102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99f7fe640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a0103580 0x7fb9a0101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 -- 172.21.15.77:0/1920737556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a0103580 msgr2=0x7fb9a0101800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a0103580 0x7fb9a0101800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 -- 172.21.15.77:0/1920737556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9a00ffff0 msgr2=0x7fb9a0102c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9a00ffff0 0x7fb9a0102c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 -- 172.21.15.77:0/1920737556 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a0102090 con 0x7fb9a01009b0 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99f7fe640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a0103580 0x7fb9a0101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb99e7fc640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 0x7fb9a01012c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b4a0 tx=0x7fb99400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994014070 con 0x7fb9a01009b0 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb994010ac0 con 0x7fb9a01009b0 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a01a23d0 con 0x7fb9a01009b0 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994017c30 con 0x7fb9a01009b0 2024-04-21T10:19:28.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.145+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a01a28d0 con 0x7fb9a01009b0 2024-04-21T10:19:28.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.146+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a01094b0 con 0x7fb9a01009b0 2024-04-21T10:19:28.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.147+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb994017070 con 0x7fb9a01009b0 2024-04-21T10:19:28.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.148+0000 7fb987fff640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb9880a3bb0 0x7fb9880a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.148+0000 7fb99effd640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb9880a3bb0 0x7fb9880a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.148+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb9940cf690 con 0x7fb9a01009b0 2024-04-21T10:19:28.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.149+0000 7fb99effd640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb9880a3bb0 0x7fb9880a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb990005ab0 tx=0x7fb990005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:28.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.153+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb99409c1c0 con 0x7fb9a01009b0 2024-04-21T10:19:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.357+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb9a0062390 con 0x7fb9880a3bb0 2024-04-21T10:19:28.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.380+0000 7fb987fff640 1 -- 172.21.15.77:0/1920737556 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb9a0062390 con 0x7fb9880a3bb0 2024-04-21T10:19:28.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb9880a3bb0 msgr2=0x7fb9880a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb9880a3bb0 0x7fb9880a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb990005ab0 tx=0x7fb990005fd0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 msgr2=0x7fb9a01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 0x7fb9a01012c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b4a0 tx=0x7fb99400b960 comp rx=0 tx=0).stop 2024-04-21T10:19:28.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 shutdown_connections 2024-04-21T10:19:28.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb9880a3bb0 0x7fb9880a6070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a01009b0 0x7fb9a01012c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9a0103580 0x7fb9a0101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 --2- 172.21.15.77:0/1920737556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9a00ffff0 0x7fb9a0102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 >> 172.21.15.77:0/1920737556 conn(0x7fb9a00fbb90 msgr2=0x7fb9a0106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:28.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 shutdown_connections 2024-04-21T10:19:28.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.382+0000 7fb9a5359640 1 -- 172.21.15.77:0/1920737556 wait complete. 2024-04-21T10:19:28.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-21T10:19:28.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 -- 172.21.15.77:0/4198727727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664102a20 msgr2=0x7f8664104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 --2- 172.21.15.77:0/4198727727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664102a20 0x7f8664104e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8658009900 tx=0x7f865802bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:28.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 -- 172.21.15.77:0/4198727727 shutdown_connections 2024-04-21T10:19:28.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 --2- 172.21.15.77:0/4198727727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8664107c80 0x7f866410a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 --2- 172.21.15.77:0/4198727727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8664105350 0x7f8664107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 --2- 172.21.15.77:0/4198727727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664102a20 0x7f8664104e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 -- 172.21.15.77:0/4198727727 >> 172.21.15.77:0/4198727727 conn(0x7f86640fc430 msgr2=0x7f86640fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 -- 172.21.15.77:0/4198727727 shutdown_connections 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 -- 172.21.15.77:0/4198727727 wait complete. 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.497+0000 7f866ab87640 1 Processor -- start 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 -- start start 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8664102a20 0x7f8664198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8664105350 0x7f8664198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 0x7f866419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f866410dae0 con 0x7f8664107c80 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f866410d960 con 0x7f8664105350 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f866410dc60 con 0x7f8664102a20 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 0x7f866419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 0x7f866419f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59550/0 (socket says 172.21.15.77:59550) 2024-04-21T10:19:28.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 -- 172.21.15.77:0/1936580672 learned_addr learned my addr 172.21.15.77:0/1936580672 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8663fff640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8664105350 0x7f8664198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8668923640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8664102a20 0x7f8664198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 -- 172.21.15.77:0/1936580672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8664102a20 msgr2=0x7f8664198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8664102a20 0x7f8664198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 -- 172.21.15.77:0/1936580672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8664105350 msgr2=0x7f8664198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8664105350 0x7f8664198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 -- 172.21.15.77:0/1936580672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866419fe30 con 0x7f8664107c80 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8669124640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 0x7f866419f7c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f865c00eb10 tx=0x7f865c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:28.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c004b20 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86641a0120 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f865c004cc0 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.498+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c010670 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.499+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86641a0620 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.500+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86640fdf20 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.501+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f865c005020 con 0x7f8664107c80 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.501+0000 7f8661ffb640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f86540a3bb0 0x7f86540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.501+0000 7f8668923640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f86540a3bb0 0x7f86540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.502+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f865c0d0860 con 0x7f8664107c80 2024-04-21T10:19:28.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.502+0000 7f8668923640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f86540a3bb0 0x7f86540a6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8658009230 tx=0x7f8658005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:28.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.506+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f865c09d390 con 0x7f8664107c80 2024-04-21T10:19:28.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.715+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f8664062390 con 0x7f86540a3bb0 2024-04-21T10:19:28.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.720+0000 7f8661ffb640 1 -- 172.21.15.77:0/1936580672 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8664062390 con 0x7f86540a3bb0 2024-04-21T10:19:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/qa/sv_1/0d601c45-51df-451f-bb5e-994bae49327f 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f86540a3bb0 msgr2=0x7f86540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f86540a3bb0 0x7f86540a6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8658009230 tx=0x7f8658005fd0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 msgr2=0x7f866419f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 0x7f866419f7c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f865c00eb10 tx=0x7f865c00c2d0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 shutdown_connections 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f86540a3bb0 0x7f86540a6070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8664107c80 0x7f866419f7c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8664105350 0x7f8664198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 --2- 172.21.15.77:0/1936580672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8664102a20 0x7f8664198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 >> 172.21.15.77:0/1936580672 conn(0x7f86640fc430 msgr2=0x7f86641035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:28.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 shutdown_connections 2024-04-21T10:19:28.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.722+0000 7f866ab87640 1 -- 172.21.15.77:0/1936580672 wait complete. 2024-04-21T10:19:28.732 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:28 smithi077 ceph-mon[27902]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:28.732 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:28 smithi077 ceph-mon[27902]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:28.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:19:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:28 smithi170 ceph-mon[31212]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:28 smithi170 ceph-mon[31212]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:28.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 -- 172.21.15.77:0/1239802129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4100e70 msgr2=0x7f7fb4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/1239802129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4100e70 0x7f7fb4101290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009ca0 tx=0x7f7fac02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 -- 172.21.15.77:0/1239802129 shutdown_connections 2024-04-21T10:19:28.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/1239802129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fb4102980 0x7f7fb41092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/1239802129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb4101fc0 0x7f7fb4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/1239802129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4100e70 0x7f7fb4101290 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.830+0000 7f7fbb86d640 1 -- 172.21.15.77:0/1239802129 >> 172.21.15.77:0/1239802129 conn(0x7f7fb40fc3e0 msgr2=0x7f7fb40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 -- 172.21.15.77:0/1239802129 shutdown_connections 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 -- 172.21.15.77:0/1239802129 wait complete. 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 Processor -- start 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 -- start start 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fb4100e70 0x7f7fb4069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 0x7f7fb419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb4102980 0x7f7fb419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb410c9a0 con 0x7f7fb4101fc0 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb410c820 con 0x7f7fb4100e70 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fbb86d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb410cb20 con 0x7f7fb4102980 2024-04-21T10:19:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fb8e08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 0x7f7fb419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fb8e08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 0x7f7fb419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59566/0 (socket says 172.21.15.77:59566) 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fb8e08640 1 -- 172.21.15.77:0/2165635100 learned_addr learned my addr 172.21.15.77:0/2165635100 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.831+0000 7f7fb9609640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fb4100e70 0x7f7fb4069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fb8e08640 1 -- 172.21.15.77:0/2165635100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb4102980 msgr2=0x7f7fb419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fb8e08640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb4102980 0x7f7fb419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fb8e08640 1 -- 172.21.15.77:0/2165635100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fb4100e70 msgr2=0x7f7fb4069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fb8e08640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fb4100e70 0x7f7fb4069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fb8e08640 1 -- 172.21.15.77:0/2165635100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb419fdc0 con 0x7f7fb4101fc0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fb8e08640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 0x7f7fb419ce90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c970 tx=0x7f7fa400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4007c10 con 0x7f7fb4101fc0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa4007db0 con 0x7f7fb4101fc0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400f870 con 0x7f7fb4101fc0 2024-04-21T10:19:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb419fff0 con 0x7f7fb4101fc0 2024-04-21T10:19:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.832+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb41a0510 con 0x7f7fb4101fc0 2024-04-21T10:19:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.833+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb4108180 con 0x7f7fb4101fc0 2024-04-21T10:19:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.834+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7fa400fa10 con 0x7f7fb4101fc0 2024-04-21T10:19:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.834+0000 7f7faa7fc640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7fa00a3bb0 0x7f7fa00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:28.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.834+0000 7f7fb9609640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7fa00a3bb0 0x7f7fa00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:28.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.835+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f7fa40d0610 con 0x7f7fb4101fc0 2024-04-21T10:19:28.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.835+0000 7f7fb9609640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7fa00a3bb0 0x7f7fa00a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7fac000f80 tx=0x7f7fac032340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:28.839+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7fa409d1d0 con 0x7f7fb4101fc0 2024-04-21T10:19:28.885 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:28 smithi191 ceph-mon[31636]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:28.885 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:28 smithi191 ceph-mon[31636]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:28.885 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i[62322]: 2024-04-21T10:19:28.742+0000 7ff25bcff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-21T10:19:28.885 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i[62322]: 2024-04-21T10:19:28.742+0000 7ff25bcff700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-21T10:19:28.885 INFO:journalctl@ceph.mds.i.smithi191.stdout:Apr 21 10:19:28 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mds-i[62322]: 2024-04-21T10:19:28.742+0000 7ff25bcff700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-21T10:19:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.054+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fb402d810 con 0x7f7fb4101fc0 2024-04-21T10:19:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.054+0000 7f7faa7fc640 1 -- 172.21.15.77:0/2165635100 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f7fa409cad0 con 0x7f7fb4101fc0 2024-04-21T10:19:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:29.055 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:19:26.977992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:19:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:19:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7fa00a3bb0 msgr2=0x7f7fa00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7fa00a3bb0 0x7f7fa00a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7fac000f80 tx=0x7f7fac032340 comp rx=0 tx=0).stop 2024-04-21T10:19:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 msgr2=0x7f7fb419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 0x7f7fb419ce90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c970 tx=0x7f7fa400ce30 comp rx=0 tx=0).stop 2024-04-21T10:19:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 shutdown_connections 2024-04-21T10:19:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7fa00a3bb0 0x7f7fa00a6070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fb4101fc0 0x7f7fb419ce90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb4102980 0x7f7fb419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 --2- 172.21.15.77:0/2165635100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fb4100e70 0x7f7fb4069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 >> 172.21.15.77:0/2165635100 conn(0x7f7fb40fc3e0 msgr2=0x7f7fb4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 shutdown_connections 2024-04-21T10:19:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.057+0000 7f7fbb86d640 1 -- 172.21.15.77:0/2165635100 wait complete. 2024-04-21T10:19:29.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:19:29.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 -- 172.21.15.77:0/3106165428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103b40 msgr2=0x7f854410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 --2- 172.21.15.77:0/3106165428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103b40 0x7f854410a3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8534009900 tx=0x7f853402bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 -- 172.21.15.77:0/3106165428 shutdown_connections 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 --2- 172.21.15.77:0/3106165428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103b40 0x7f854410a3d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 --2- 172.21.15.77:0/3106165428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8544103180 0x7f8544103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 --2- 172.21.15.77:0/3106165428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8544101f90 0x7f85441023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 -- 172.21.15.77:0/3106165428 >> 172.21.15.77:0/3106165428 conn(0x7f85440fd500 msgr2=0x7f85440ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 -- 172.21.15.77:0/3106165428 shutdown_connections 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 -- 172.21.15.77:0/3106165428 wait complete. 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.166+0000 7f854906d640 1 Processor -- start 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 -- start start 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8544101f90 0x7f8544198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 0x7f8544198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8544103b40 0x7f854419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f854410dad0 con 0x7f8544103180 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f854410d950 con 0x7f8544103b40 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f854410dc50 con 0x7f8544101f90 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 0x7f8544198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 0x7f8544198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59584/0 (socket says 172.21.15.77:59584) 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 -- 172.21.15.77:0/3706075801 learned_addr learned my addr 172.21.15.77:0/3706075801 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f8542d9d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8544101f90 0x7f8544198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854359e640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8544103b40 0x7f854419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 -- 172.21.15.77:0/3706075801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8544101f90 msgr2=0x7f8544198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8544101f90 0x7f8544198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 -- 172.21.15.77:0/3706075801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8544103b40 msgr2=0x7f854419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8544103b40 0x7f854419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 -- 172.21.15.77:0/3706075801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854419fd50 con 0x7f8544103180 2024-04-21T10:19:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854259c640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 0x7f8544198670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f853800e9f0 tx=0x7f853800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853800cd80 con 0x7f8544103180 2024-04-21T10:19:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85380108e0 con 0x7f8544103180 2024-04-21T10:19:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854419ffe0 con 0x7f8544103180 2024-04-21T10:19:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.167+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538018980 con 0x7f8544103180 2024-04-21T10:19:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.168+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85441a0500 con 0x7f8544103180 2024-04-21T10:19:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.169+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85441092b0 con 0x7f8544103180 2024-04-21T10:19:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.170+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8538010430 con 0x7f8544103180 2024-04-21T10:19:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.170+0000 7f852bfff640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f852c0a3bb0 0x7f852c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.170+0000 7f8542d9d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f852c0a3bb0 0x7f852c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.171+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f85380d0560 con 0x7f8544103180 2024-04-21T10:19:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.171+0000 7f8542d9d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f852c0a3bb0 0x7f852c0a6070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8544102fe0 tx=0x7f853c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:29.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.175+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f853809ca40 con 0x7f8544103180 2024-04-21T10:19:29.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.353+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f854402d810 con 0x7f8544103180 2024-04-21T10:19:29.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.355+0000 7f852bfff640 1 -- 172.21.15.77:0/3706075801 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22229 (secure 0 0 0) 0x7f85380a0d40 con 0x7f8544103180 2024-04-21T10:19:29.355 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":85,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:19:24.501547+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f852c0a3bb0 msgr2=0x7f852c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f852c0a3bb0 0x7f852c0a6070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8544102fe0 tx=0x7f853c009500 comp rx=0 tx=0).stop 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 msgr2=0x7f8544198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 0x7f8544198670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f853800e9f0 tx=0x7f853800eeb0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 shutdown_connections 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f852c0a3bb0 0x7f852c0a6070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8544103180 0x7f8544198670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8544103b40 0x7f854419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 --2- 172.21.15.77:0/3706075801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8544101f90 0x7f8544198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 >> 172.21.15.77:0/3706075801 conn(0x7f85440fd500 msgr2=0x7f8544106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:29.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 shutdown_connections 2024-04-21T10:19:29.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.357+0000 7f854906d640 1 -- 172.21.15.77:0/3706075801 wait complete. 2024-04-21T10:19:29.368 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-21T10:19:29.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 -- 172.21.15.77:0/1978504253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 msgr2=0x7fb1e81023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/1978504253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e81023b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009900 tx=0x7fb1d802bc30 comp rx=0 tx=0).stop 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 -- 172.21.15.77:0/1978504253 shutdown_connections 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/1978504253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1e8103b40 0x7fb1e810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/1978504253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 0x7fb1e8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/1978504253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e81023b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 -- 172.21.15.77:0/1978504253 >> 172.21.15.77:0/1978504253 conn(0x7fb1e80fd500 msgr2=0x7fb1e80ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 -- 172.21.15.77:0/1978504253 shutdown_connections 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 -- 172.21.15.77:0/1978504253 wait complete. 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 Processor -- start 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.467+0000 7fb1ed49a640 1 -- start start 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e8198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 0x7fb1e81986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1e8103b40 0x7fb1e819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e810dad0 con 0x7fb1e8101f90 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e810d950 con 0x7fb1e8103180 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e810dc50 con 0x7fb1e8103b40 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e8198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e8198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59604/0 (socket says 172.21.15.77:59604) 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 -- 172.21.15.77:0/88257058 learned_addr learned my addr 172.21.15.77:0/88257058 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:29.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1dffff640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 0x7fb1e81986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e77fe640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1e8103b40 0x7fb1e819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 -- 172.21.15.77:0/88257058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1e8103b40 msgr2=0x7fb1e819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1e8103b40 0x7fb1e819f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 -- 172.21.15.77:0/88257058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 msgr2=0x7fb1e81986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 0x7fb1e81986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 -- 172.21.15.77:0/88257058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e819fdb0 con 0x7fb1e8101f90 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1dffff640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 0x7fb1e81986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e6ffd640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e8198190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000c00 tx=0x7fb1d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8043020 con 0x7fb1e8101f90 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1d8004aa0 con 0x7fb1e8101f90 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8003d00 con 0x7fb1e8101f90 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e81a0040 con 0x7fb1e8101f90 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.468+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e81a0590 con 0x7fb1e8101f90 2024-04-21T10:19:29.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.469+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e8109330 con 0x7fb1e8101f90 2024-04-21T10:19:29.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.470+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb1d8046020 con 0x7fb1e8101f90 2024-04-21T10:19:29.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.471+0000 7fb1e4ff9640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb1d40a3bb0 0x7fb1d40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.471+0000 7fb1dffff640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb1d40a3bb0 0x7fb1d40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.471+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb1d80f2da0 con 0x7fb1e8101f90 2024-04-21T10:19:29.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.471+0000 7fb1dffff640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb1d40a3bb0 0x7fb1d40a6070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1e81996a0 tx=0x7fb1d0005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.474+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1d804d020 con 0x7fb1e8101f90 2024-04-21T10:19:29.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.541+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb1d80bb840 con 0x7fb1e8101f90 2024-04-21T10:19:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:29 smithi077 ceph-mon[27902]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:29 smithi077 ceph-mon[27902]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:29 smithi077 ceph-mon[27902]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-04-21T10:19:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:29 smithi077 ceph-mon[27902]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:29 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2165635100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:29 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3706075801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:29.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.656+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1e8062390 con 0x7fb1d40a3bb0 2024-04-21T10:19:29.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.664+0000 7fb1e4ff9640 1 -- 172.21.15.77:0/88257058 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258877 (secure 0 0 0) 0x7fb1e8062390 con 0x7fb1d40a3bb0 2024-04-21T10:19:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:29.669 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:19:29.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb1d40a3bb0 msgr2=0x7fb1d40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb1d40a3bb0 0x7fb1d40a6070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1e81996a0 tx=0x7fb1d0005ec0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 msgr2=0x7fb1e8198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e8198190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000c00 tx=0x7fb1d8004270 comp rx=0 tx=0).stop 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 shutdown_connections 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb1d40a3bb0 0x7fb1d40a6070 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1e8103b40 0x7fb1e819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8103180 0x7fb1e81986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 --2- 172.21.15.77:0/88257058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e8101f90 0x7fb1e8198190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 >> 172.21.15.77:0/88257058 conn(0x7fb1e80fd500 msgr2=0x7fb1e8106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 shutdown_connections 2024-04-21T10:19:29.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.667+0000 7fb1ed49a640 1 -- 172.21.15.77:0/88257058 wait complete. 2024-04-21T10:19:29.678 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-04-21T10:19:28.673794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593813,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":252,"num_write_kb":2962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360076,"kb_used_data":10832,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581748,"statfs":{"total":1151940427776,"available":1151571709952,"internally_reserved":0,"allocated":11091968,"data_stored":6962310,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19137,"internal_metadata":357414207},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3445,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.192025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.513982+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:19:23.513982+0000","last_peered":"2024-04-21T10:19:23.513982+0000","last_clean":"2024-04-21T10:19:23.513982+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:19:23.513982+0000","last_undegraded":"2024-04-21T10:19:23.513982+0000","last_fullsized":"2024-04-21T10:19:23.513982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:39:24.360318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549334+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:19:24.549334+0000","last_peered":"2024-04-21T10:19:24.549334+0000","last_clean":"2024-04-21T10:19:24.549334+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:19:24.549334+0000","last_undegraded":"2024-04-21T10:19:24.549334+0000","last_fullsized":"2024-04-21T10:19:24.549334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549373+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:19:24.549373+0000","last_peered":"2024-04-21T10:19:24.549373+0000","last_clean":"2024-04-21T10:19:24.549373+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:19:24.549373+0000","last_undegraded":"2024-04-21T10:19:24.549373+0000","last_fullsized":"2024-04-21T10:19:24.549373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.534275+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:19:25.534275+0000","last_peered":"2024-04-21T10:19:25.534275+0000","last_clean":"2024-04-21T10:19:25.534275+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:19:25.534275+0000","last_undegraded":"2024-04-21T10:19:25.534275+0000","last_fullsized":"2024-04-21T10:19:25.534275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518493+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:19:25.518493+0000","last_peered":"2024-04-21T10:19:25.518493+0000","last_clean":"2024-04-21T10:19:25.518493+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:19:25.518493+0000","last_undegraded":"2024-04-21T10:19:25.518493+0000","last_fullsized":"2024-04-21T10:19:25.518493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.520080+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:19:23.520080+0000","last_peered":"2024-04-21T10:19:23.520080+0000","last_clean":"2024-04-21T10:19:23.520080+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:19:23.520080+0000","last_undegraded":"2024-04-21T10:19:23.520080+0000","last_fullsized":"2024-04-21T10:19:23.520080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:38:27.587800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529666+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:19:23.529666+0000","last_peered":"2024-04-21T10:19:23.529666+0000","last_clean":"2024-04-21T10:19:23.529666+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:19:23.529666+0000","last_undegraded":"2024-04-21T10:19:23.529666+0000","last_fullsized":"2024-04-21T10:19:23.529666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:04.080901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.509143+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:19:23.509143+0000","last_peered":"2024-04-21T10:19:23.509143+0000","last_clean":"2024-04-21T10:19:23.509143+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:19:23.509143+0000","last_undegraded":"2024-04-21T10:19:23.509143+0000","last_fullsized":"2024-04-21T10:19:23.509143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:04:06.596148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.510114+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:19:23.510114+0000","last_peered":"2024-04-21T10:19:23.510114+0000","last_clean":"2024-04-21T10:19:23.510114+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:19:23.510114+0000","last_undegraded":"2024-04-21T10:19:23.510114+0000","last_fullsized":"2024-04-21T10:19:23.510114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:46:00.114135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.520176+0000","last_change":"2024-04-21T10:19:23.516740+0000","last_active":"2024-04-21T10:19:23.520176+0000","last_peered":"2024-04-21T10:19:23.520176+0000","last_clean":"2024-04-21T10:19:23.520176+0000","last_became_active":"2024-04-21T10:19:23.516124+0000","last_became_peered":"2024-04-21T10:19:23.516124+0000","last_unstale":"2024-04-21T10:19:23.520176+0000","last_undegraded":"2024-04-21T10:19:23.520176+0000","last_fullsized":"2024-04-21T10:19:23.520176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:04:42.033113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529920+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:19:23.529920+0000","last_peered":"2024-04-21T10:19:23.529920+0000","last_clean":"2024-04-21T10:19:23.529920+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:19:23.529920+0000","last_undegraded":"2024-04-21T10:19:23.529920+0000","last_fullsized":"2024-04-21T10:19:23.529920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:36:00.164015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.534111+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:19:25.534111+0000","last_peered":"2024-04-21T10:19:25.534111+0000","last_clean":"2024-04-21T10:19:25.534111+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:19:25.534111+0000","last_undegraded":"2024-04-21T10:19:25.534111+0000","last_fullsized":"2024-04-21T10:19:25.534111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511753+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:19:24.511753+0000","last_peered":"2024-04-21T10:19:24.511753+0000","last_clean":"2024-04-21T10:19:24.511753+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:19:24.511753+0000","last_undegraded":"2024-04-21T10:19:24.511753+0000","last_fullsized":"2024-04-21T10:19:24.511753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549204+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:19:24.549204+0000","last_peered":"2024-04-21T10:19:24.549204+0000","last_clean":"2024-04-21T10:19:24.549204+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:19:24.549204+0000","last_undegraded":"2024-04-21T10:19:24.549204+0000","last_fullsized":"2024-04-21T10:19:24.549204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549230+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:19:24.549230+0000","last_peered":"2024-04-21T10:19:24.549230+0000","last_clean":"2024-04-21T10:19:24.549230+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:19:24.549230+0000","last_undegraded":"2024-04-21T10:19:24.549230+0000","last_fullsized":"2024-04-21T10:19:24.549230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.516078+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:19:23.516078+0000","last_peered":"2024-04-21T10:19:23.516078+0000","last_clean":"2024-04-21T10:19:23.516078+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:19:23.516078+0000","last_undegraded":"2024-04-21T10:19:23.516078+0000","last_fullsized":"2024-04-21T10:19:23.516078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:08:11.450465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.514413+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:19:23.514413+0000","last_peered":"2024-04-21T10:19:23.514413+0000","last_clean":"2024-04-21T10:19:23.514413+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:19:23.514413+0000","last_undegraded":"2024-04-21T10:19:23.514413+0000","last_fullsized":"2024-04-21T10:19:23.514413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:35.712851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.516080+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:19:25.516080+0000","last_peered":"2024-04-21T10:19:25.516080+0000","last_clean":"2024-04-21T10:19:25.516080+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:19:25.516080+0000","last_undegraded":"2024-04-21T10:19:25.516080+0000","last_fullsized":"2024-04-21T10:19:25.516080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.524791+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:19:23.524791+0000","last_peered":"2024-04-21T10:19:23.524791+0000","last_clean":"2024-04-21T10:19:23.524791+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:19:23.524791+0000","last_undegraded":"2024-04-21T10:19:23.524791+0000","last_fullsized":"2024-04-21T10:19:23.524791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:46.921899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.984687+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:19:25.984687+0000","last_peered":"2024-04-21T10:19:25.984687+0000","last_clean":"2024-04-21T10:19:25.984687+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:19:25.984687+0000","last_undegraded":"2024-04-21T10:19:25.984687+0000","last_fullsized":"2024-04-21T10:19:25.984687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521969+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:19:23.521969+0000","last_peered":"2024-04-21T10:19:23.521969+0000","last_clean":"2024-04-21T10:19:23.521969+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:19:23.521969+0000","last_undegraded":"2024-04-21T10:19:23.521969+0000","last_fullsized":"2024-04-21T10:19:23.521969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:41:08.475374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.531059+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:19:23.531059+0000","last_peered":"2024-04-21T10:19:23.531059+0000","last_clean":"2024-04-21T10:19:23.531059+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:19:23.531059+0000","last_undegraded":"2024-04-21T10:19:23.531059+0000","last_fullsized":"2024-04-21T10:19:23.531059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549518+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:19:24.549518+0000","last_peered":"2024-04-21T10:19:24.549518+0000","last_clean":"2024-04-21T10:19:24.549518+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:19:24.549518+0000","last_undegraded":"2024-04-21T10:19:24.549518+0000","last_fullsized":"2024-04-21T10:19:24.549518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518910+0000","last_change":"2024-04-21T10:19:22.498942+0000","last_active":"2024-04-21T10:19:25.518910+0000","last_peered":"2024-04-21T10:19:25.518910+0000","last_clean":"2024-04-21T10:19:25.518910+0000","last_became_active":"2024-04-21T10:19:22.498566+0000","last_became_peered":"2024-04-21T10:19:22.498566+0000","last_unstale":"2024-04-21T10:19:25.518910+0000","last_undegraded":"2024-04-21T10:19:25.518910+0000","last_fullsized":"2024-04-21T10:19:25.518910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:38:20.461678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.518061+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:19:23.518061+0000","last_peered":"2024-04-21T10:19:23.518061+0000","last_clean":"2024-04-21T10:19:23.518061+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:19:23.518061+0000","last_undegraded":"2024-04-21T10:19:23.518061+0000","last_fullsized":"2024-04-21T10:19:23.518061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:46:38.864878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518736+0000","last_change":"2024-04-21T10:19:22.499002+0000","last_active":"2024-04-21T10:19:25.518736+0000","last_peered":"2024-04-21T10:19:25.518736+0000","last_clean":"2024-04-21T10:19:25.518736+0000","last_became_active":"2024-04-21T10:19:22.498627+0000","last_became_peered":"2024-04-21T10:19:22.498627+0000","last_unstale":"2024-04-21T10:19:25.518736+0000","last_undegraded":"2024-04-21T10:19:25.518736+0000","last_fullsized":"2024-04-21T10:19:25.518736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:42:35.249277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529496+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:19:23.529496+0000","last_peered":"2024-04-21T10:19:23.529496+0000","last_clean":"2024-04-21T10:19:23.529496+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:19:23.529496+0000","last_undegraded":"2024-04-21T10:19:23.529496+0000","last_fullsized":"2024-04-21T10:19:23.529496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:29.779272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.532847+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:19:23.532847+0000","last_peered":"2024-04-21T10:19:23.532847+0000","last_clean":"2024-04-21T10:19:23.532847+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:19:23.532847+0000","last_undegraded":"2024-04-21T10:19:23.532847+0000","last_fullsized":"2024-04-21T10:19:23.532847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518456+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:19:25.518456+0000","last_peered":"2024-04-21T10:19:25.518456+0000","last_clean":"2024-04-21T10:19:25.518456+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:19:25.518456+0000","last_undegraded":"2024-04-21T10:19:25.518456+0000","last_fullsized":"2024-04-21T10:19:25.518456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.534344+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:19:23.534344+0000","last_peered":"2024-04-21T10:19:23.534344+0000","last_clean":"2024-04-21T10:19:23.534344+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:19:23.534344+0000","last_undegraded":"2024-04-21T10:19:23.534344+0000","last_fullsized":"2024-04-21T10:19:23.534344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529558+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:19:23.529558+0000","last_peered":"2024-04-21T10:19:23.529558+0000","last_clean":"2024-04-21T10:19:23.529558+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:19:23.529558+0000","last_undegraded":"2024-04-21T10:19:23.529558+0000","last_fullsized":"2024-04-21T10:19:23.529558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:15:35.415045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511510+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:19:24.511510+0000","last_peered":"2024-04-21T10:19:24.511510+0000","last_clean":"2024-04-21T10:19:24.511510+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:19:24.511510+0000","last_undegraded":"2024-04-21T10:19:24.511510+0000","last_fullsized":"2024-04-21T10:19:24.511510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.509503+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:19:23.509503+0000","last_peered":"2024-04-21T10:19:23.509503+0000","last_clean":"2024-04-21T10:19:23.509503+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:19:23.509503+0000","last_undegraded":"2024-04-21T10:19:23.509503+0000","last_fullsized":"2024-04-21T10:19:23.509503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:13:29.672555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.497748+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:19:23.497748+0000","last_peered":"2024-04-21T10:19:23.497748+0000","last_clean":"2024-04-21T10:19:23.497748+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:19:23.497748+0000","last_undegraded":"2024-04-21T10:19:23.497748+0000","last_fullsized":"2024-04-21T10:19:23.497748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.516009+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:19:25.516009+0000","last_peered":"2024-04-21T10:19:25.516009+0000","last_clean":"2024-04-21T10:19:25.516009+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:19:25.516009+0000","last_undegraded":"2024-04-21T10:19:25.516009+0000","last_fullsized":"2024-04-21T10:19:25.516009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.507144+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:19:23.507144+0000","last_peered":"2024-04-21T10:19:23.507144+0000","last_clean":"2024-04-21T10:19:23.507144+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:19:23.507144+0000","last_undegraded":"2024-04-21T10:19:23.507144+0000","last_fullsized":"2024-04-21T10:19:23.507144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521877+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:19:23.521877+0000","last_peered":"2024-04-21T10:19:23.521877+0000","last_clean":"2024-04-21T10:19:23.521877+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:19:23.521877+0000","last_undegraded":"2024-04-21T10:19:23.521877+0000","last_fullsized":"2024-04-21T10:19:23.521877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:32:49.384749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.512681+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:19:23.512681+0000","last_peered":"2024-04-21T10:19:23.512681+0000","last_clean":"2024-04-21T10:19:23.512681+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:19:23.512681+0000","last_undegraded":"2024-04-21T10:19:23.512681+0000","last_fullsized":"2024-04-21T10:19:23.512681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549443+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:19:24.549443+0000","last_peered":"2024-04-21T10:19:24.549443+0000","last_clean":"2024-04-21T10:19:24.549443+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:19:24.549443+0000","last_undegraded":"2024-04-21T10:19:24.549443+0000","last_fullsized":"2024-04-21T10:19:24.549443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.533442+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:19:23.533442+0000","last_peered":"2024-04-21T10:19:23.533442+0000","last_clean":"2024-04-21T10:19:23.533442+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:19:23.533442+0000","last_undegraded":"2024-04-21T10:19:23.533442+0000","last_fullsized":"2024-04-21T10:19:23.533442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.512003+0000","last_change":"2024-04-21T10:19:23.511406+0000","last_active":"2024-04-21T10:19:23.512003+0000","last_peered":"2024-04-21T10:19:23.512003+0000","last_clean":"2024-04-21T10:19:23.512003+0000","last_became_active":"2024-04-21T10:19:23.511040+0000","last_became_peered":"2024-04-21T10:19:23.511040+0000","last_unstale":"2024-04-21T10:19:23.512003+0000","last_undegraded":"2024-04-21T10:19:23.512003+0000","last_fullsized":"2024-04-21T10:19:23.512003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:21.453646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'6","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.534907+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:19:23.534907+0000","last_peered":"2024-04-21T10:19:23.534907+0000","last_clean":"2024-04-21T10:19:23.534907+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:19:23.534907+0000","last_undegraded":"2024-04-21T10:19:23.534907+0000","last_fullsized":"2024-04-21T10:19:23.534907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518765+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:19:25.518765+0000","last_peered":"2024-04-21T10:19:25.518765+0000","last_clean":"2024-04-21T10:19:25.518765+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:19:25.518765+0000","last_undegraded":"2024-04-21T10:19:25.518765+0000","last_fullsized":"2024-04-21T10:19:25.518765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.532100+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:19:23.532100+0000","last_peered":"2024-04-21T10:19:23.532100+0000","last_clean":"2024-04-21T10:19:23.532100+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:19:23.532100+0000","last_undegraded":"2024-04-21T10:19:23.532100+0000","last_fullsized":"2024-04-21T10:19:23.532100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511853+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:19:24.511853+0000","last_peered":"2024-04-21T10:19:24.511853+0000","last_clean":"2024-04-21T10:19:24.511853+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:19:24.511853+0000","last_undegraded":"2024-04-21T10:19:24.511853+0000","last_fullsized":"2024-04-21T10:19:24.511853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.497713+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:19:23.497713+0000","last_peered":"2024-04-21T10:19:23.497713+0000","last_clean":"2024-04-21T10:19:23.497713+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:19:23.497713+0000","last_undegraded":"2024-04-21T10:19:23.497713+0000","last_fullsized":"2024-04-21T10:19:23.497713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529035+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:19:23.529035+0000","last_peered":"2024-04-21T10:19:23.529035+0000","last_clean":"2024-04-21T10:19:23.529035+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:19:23.529035+0000","last_undegraded":"2024-04-21T10:19:23.529035+0000","last_fullsized":"2024-04-21T10:19:23.529035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:36:05.269587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:26.989434+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:19:26.989434+0000","last_peered":"2024-04-21T10:19:26.989434+0000","last_clean":"2024-04-21T10:19:26.989434+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:19:26.989434+0000","last_undegraded":"2024-04-21T10:19:26.989434+0000","last_fullsized":"2024-04-21T10:19:26.989434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529631+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:19:23.529631+0000","last_peered":"2024-04-21T10:19:23.529631+0000","last_clean":"2024-04-21T10:19:23.529631+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:19:23.529631+0000","last_undegraded":"2024-04-21T10:19:23.529631+0000","last_fullsized":"2024-04-21T10:19:23.529631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:48:23.338670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'10","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.529375+0000","last_change":"2024-04-21T10:19:22.500911+0000","last_active":"2024-04-21T10:19:25.529375+0000","last_peered":"2024-04-21T10:19:25.529375+0000","last_clean":"2024-04-21T10:19:25.529375+0000","last_became_active":"2024-04-21T10:19:22.499854+0000","last_became_peered":"2024-04-21T10:19:22.499854+0000","last_unstale":"2024-04-21T10:19:25.529375+0000","last_undegraded":"2024-04-21T10:19:25.529375+0000","last_fullsized":"2024-04-21T10:19:25.529375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:18:58.701765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529504+0000","last_change":"2024-04-21T10:19:23.527048+0000","last_active":"2024-04-21T10:19:23.529504+0000","last_peered":"2024-04-21T10:19:23.529504+0000","last_clean":"2024-04-21T10:19:23.529504+0000","last_became_active":"2024-04-21T10:19:23.526673+0000","last_became_peered":"2024-04-21T10:19:23.526673+0000","last_unstale":"2024-04-21T10:19:23.529504+0000","last_undegraded":"2024-04-21T10:19:23.529504+0000","last_fullsized":"2024-04-21T10:19:23.529504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:02:50.390812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518850+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:19:25.518850+0000","last_peered":"2024-04-21T10:19:25.518850+0000","last_clean":"2024-04-21T10:19:25.518850+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:19:25.518850+0000","last_undegraded":"2024-04-21T10:19:25.518850+0000","last_fullsized":"2024-04-21T10:19:25.518850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.522046+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:19:23.522046+0000","last_peered":"2024-04-21T10:19:23.522046+0000","last_clean":"2024-04-21T10:19:23.522046+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:19:23.522046+0000","last_undegraded":"2024-04-21T10:19:23.522046+0000","last_fullsized":"2024-04-21T10:19:23.522046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:38:19.314156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.515805+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:19:25.515805+0000","last_peered":"2024-04-21T10:19:25.515805+0000","last_clean":"2024-04-21T10:19:25.515805+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:19:25.515805+0000","last_undegraded":"2024-04-21T10:19:25.515805+0000","last_fullsized":"2024-04-21T10:19:25.515805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.522359+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:19:23.522359+0000","last_peered":"2024-04-21T10:19:23.522359+0000","last_clean":"2024-04-21T10:19:23.522359+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:19:23.522359+0000","last_undegraded":"2024-04-21T10:19:23.522359+0000","last_fullsized":"2024-04-21T10:19:23.522359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:04:30.264594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.515153+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:19:23.515153+0000","last_peered":"2024-04-21T10:19:23.515153+0000","last_clean":"2024-04-21T10:19:23.515153+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:19:23.515153+0000","last_undegraded":"2024-04-21T10:19:23.515153+0000","last_fullsized":"2024-04-21T10:19:23.515153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.520116+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:19:23.520116+0000","last_peered":"2024-04-21T10:19:23.520116+0000","last_clean":"2024-04-21T10:19:23.520116+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:19:23.520116+0000","last_undegraded":"2024-04-21T10:19:23.520116+0000","last_fullsized":"2024-04-21T10:19:23.520116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:26:20.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521223+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:19:23.521223+0000","last_peered":"2024-04-21T10:19:23.521223+0000","last_clean":"2024-04-21T10:19:23.521223+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:19:23.521223+0000","last_undegraded":"2024-04-21T10:19:23.521223+0000","last_fullsized":"2024-04-21T10:19:23.521223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:35:07.479141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511399+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:19:24.511399+0000","last_peered":"2024-04-21T10:19:24.511399+0000","last_clean":"2024-04-21T10:19:24.511399+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:19:24.511399+0000","last_undegraded":"2024-04-21T10:19:24.511399+0000","last_fullsized":"2024-04-21T10:19:24.511399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.508512+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:19:23.508512+0000","last_peered":"2024-04-21T10:19:23.508512+0000","last_clean":"2024-04-21T10:19:23.508512+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:19:23.508512+0000","last_undegraded":"2024-04-21T10:19:23.508512+0000","last_fullsized":"2024-04-21T10:19:23.508512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:46:07.412566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.983261+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:19:25.983261+0000","last_peered":"2024-04-21T10:19:25.983261+0000","last_clean":"2024-04-21T10:19:25.983261+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:19:25.983261+0000","last_undegraded":"2024-04-21T10:19:25.983261+0000","last_fullsized":"2024-04-21T10:19:25.983261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":347,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.513447+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:19:23.513447+0000","last_peered":"2024-04-21T10:19:23.513447+0000","last_clean":"2024-04-21T10:19:23.513447+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:19:23.513447+0000","last_undegraded":"2024-04-21T10:19:23.513447+0000","last_fullsized":"2024-04-21T10:19:23.513447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511469+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:19:24.511469+0000","last_peered":"2024-04-21T10:19:24.511469+0000","last_clean":"2024-04-21T10:19:24.511469+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:19:24.511469+0000","last_undegraded":"2024-04-21T10:19:24.511469+0000","last_fullsized":"2024-04-21T10:19:24.511469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.513797+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:19:23.513797+0000","last_peered":"2024-04-21T10:19:23.513797+0000","last_clean":"2024-04-21T10:19:23.513797+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:19:23.513797+0000","last_undegraded":"2024-04-21T10:19:23.513797+0000","last_fullsized":"2024-04-21T10:19:23.513797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.529637+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:19:25.529637+0000","last_peered":"2024-04-21T10:19:25.529637+0000","last_clean":"2024-04-21T10:19:25.529637+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:19:25.529637+0000","last_undegraded":"2024-04-21T10:19:25.529637+0000","last_fullsized":"2024-04-21T10:19:25.529637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511782+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:19:24.511782+0000","last_peered":"2024-04-21T10:19:24.511782+0000","last_clean":"2024-04-21T10:19:24.511782+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:19:24.511782+0000","last_undegraded":"2024-04-21T10:19:24.511782+0000","last_fullsized":"2024-04-21T10:19:24.511782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.984017+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:19:25.984017+0000","last_peered":"2024-04-21T10:19:25.984017+0000","last_clean":"2024-04-21T10:19:25.984017+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:19:25.984017+0000","last_undegraded":"2024-04-21T10:19:25.984017+0000","last_fullsized":"2024-04-21T10:19:25.984017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521934+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:19:23.521934+0000","last_peered":"2024-04-21T10:19:23.521934+0000","last_clean":"2024-04-21T10:19:23.521934+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:19:23.521934+0000","last_undegraded":"2024-04-21T10:19:23.521934+0000","last_fullsized":"2024-04-21T10:19:23.521934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:05:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.536544+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:19:25.536544+0000","last_peered":"2024-04-21T10:19:25.536544+0000","last_clean":"2024-04-21T10:19:25.536544+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:19:25.536544+0000","last_undegraded":"2024-04-21T10:19:25.536544+0000","last_fullsized":"2024-04-21T10:19:25.536544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549414+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:19:24.549414+0000","last_peered":"2024-04-21T10:19:24.549414+0000","last_clean":"2024-04-21T10:19:24.549414+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:19:24.549414+0000","last_undegraded":"2024-04-21T10:19:24.549414+0000","last_fullsized":"2024-04-21T10:19:24.549414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.498115+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:19:23.498115+0000","last_peered":"2024-04-21T10:19:23.498115+0000","last_clean":"2024-04-21T10:19:23.498115+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:19:23.498115+0000","last_undegraded":"2024-04-21T10:19:23.498115+0000","last_fullsized":"2024-04-21T10:19:23.498115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518343+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:19:25.518343+0000","last_peered":"2024-04-21T10:19:25.518343+0000","last_clean":"2024-04-21T10:19:25.518343+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:19:25.518343+0000","last_undegraded":"2024-04-21T10:19:25.518343+0000","last_fullsized":"2024-04-21T10:19:25.518343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.500171+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:19:23.500171+0000","last_peered":"2024-04-21T10:19:23.500171+0000","last_clean":"2024-04-21T10:19:23.500171+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:19:23.500171+0000","last_undegraded":"2024-04-21T10:19:23.500171+0000","last_fullsized":"2024-04-21T10:19:23.500171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.517501+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:19:23.517501+0000","last_peered":"2024-04-21T10:19:23.517501+0000","last_clean":"2024-04-21T10:19:23.517501+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:19:23.517501+0000","last_undegraded":"2024-04-21T10:19:23.517501+0000","last_fullsized":"2024-04-21T10:19:23.517501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:41:30.517074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.503697+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:19:23.503697+0000","last_peered":"2024-04-21T10:19:23.503697+0000","last_clean":"2024-04-21T10:19:23.503697+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:19:23.503697+0000","last_undegraded":"2024-04-21T10:19:23.503697+0000","last_fullsized":"2024-04-21T10:19:23.503697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.515489+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:19:23.515489+0000","last_peered":"2024-04-21T10:19:23.515489+0000","last_clean":"2024-04-21T10:19:23.515489+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:19:23.515489+0000","last_undegraded":"2024-04-21T10:19:23.515489+0000","last_fullsized":"2024-04-21T10:19:23.515489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:57:48.972501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.529958+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:19:25.529958+0000","last_peered":"2024-04-21T10:19:25.529958+0000","last_clean":"2024-04-21T10:19:25.529958+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:19:25.529958+0000","last_undegraded":"2024-04-21T10:19:25.529958+0000","last_fullsized":"2024-04-21T10:19:25.529958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521822+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:19:23.521822+0000","last_peered":"2024-04-21T10:19:23.521822+0000","last_clean":"2024-04-21T10:19:23.521822+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:19:23.521822+0000","last_undegraded":"2024-04-21T10:19:23.521822+0000","last_fullsized":"2024-04-21T10:19:23.521822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:32:18.504454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.504802+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:19:23.504802+0000","last_peered":"2024-04-21T10:19:23.504802+0000","last_clean":"2024-04-21T10:19:23.504802+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:19:23.504802+0000","last_undegraded":"2024-04-21T10:19:23.504802+0000","last_fullsized":"2024-04-21T10:19:23.504802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529609+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:19:23.529609+0000","last_peered":"2024-04-21T10:19:23.529609+0000","last_clean":"2024-04-21T10:19:23.529609+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:19:23.529609+0000","last_undegraded":"2024-04-21T10:19:23.529609+0000","last_fullsized":"2024-04-21T10:19:23.529609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:17:51.567521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.533649+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:19:23.533649+0000","last_peered":"2024-04-21T10:19:23.533649+0000","last_clean":"2024-04-21T10:19:23.533649+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:19:23.533649+0000","last_undegraded":"2024-04-21T10:19:23.533649+0000","last_fullsized":"2024-04-21T10:19:23.533649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.530288+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:19:23.530288+0000","last_peered":"2024-04-21T10:19:23.530288+0000","last_clean":"2024-04-21T10:19:23.530288+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:19:23.530288+0000","last_undegraded":"2024-04-21T10:19:23.530288+0000","last_fullsized":"2024-04-21T10:19:23.530288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:50:15.178268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511873+0000","last_change":"2024-04-21T10:19:22.499969+0000","last_active":"2024-04-21T10:19:24.511873+0000","last_peered":"2024-04-21T10:19:24.511873+0000","last_clean":"2024-04-21T10:19:24.511873+0000","last_became_active":"2024-04-21T10:19:22.498895+0000","last_became_peered":"2024-04-21T10:19:22.498895+0000","last_unstale":"2024-04-21T10:19:24.511873+0000","last_undegraded":"2024-04-21T10:19:24.511873+0000","last_fullsized":"2024-04-21T10:19:24.511873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:06:11.124328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529142+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:19:23.529142+0000","last_peered":"2024-04-21T10:19:23.529142+0000","last_clean":"2024-04-21T10:19:23.529142+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:19:23.529142+0000","last_undegraded":"2024-04-21T10:19:23.529142+0000","last_fullsized":"2024-04-21T10:19:23.529142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:35.903757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.527640+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:19:23.527640+0000","last_peered":"2024-04-21T10:19:23.527640+0000","last_clean":"2024-04-21T10:19:23.527640+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:19:23.527640+0000","last_undegraded":"2024-04-21T10:19:23.527640+0000","last_fullsized":"2024-04-21T10:19:23.527640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:15:09.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.522795+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:19:23.522795+0000","last_peered":"2024-04-21T10:19:23.522795+0000","last_clean":"2024-04-21T10:19:23.522795+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:19:23.522795+0000","last_undegraded":"2024-04-21T10:19:23.522795+0000","last_fullsized":"2024-04-21T10:19:23.522795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:08:04.571137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.518560+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:19:23.518560+0000","last_peered":"2024-04-21T10:19:23.518560+0000","last_clean":"2024-04-21T10:19:23.518560+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:19:23.518560+0000","last_undegraded":"2024-04-21T10:19:23.518560+0000","last_fullsized":"2024-04-21T10:19:23.518560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:51.610695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549453+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:19:24.549453+0000","last_peered":"2024-04-21T10:19:24.549453+0000","last_clean":"2024-04-21T10:19:24.549453+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:19:24.549453+0000","last_undegraded":"2024-04-21T10:19:24.549453+0000","last_fullsized":"2024-04-21T10:19:24.549453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511883+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:19:24.511883+0000","last_peered":"2024-04-21T10:19:24.511883+0000","last_clean":"2024-04-21T10:19:24.511883+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:19:24.511883+0000","last_undegraded":"2024-04-21T10:19:24.511883+0000","last_fullsized":"2024-04-21T10:19:24.511883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.511103+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:19:23.511103+0000","last_peered":"2024-04-21T10:19:23.511103+0000","last_clean":"2024-04-21T10:19:23.511103+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:19:23.511103+0000","last_undegraded":"2024-04-21T10:19:23.511103+0000","last_fullsized":"2024-04-21T10:19:23.511103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:51.140777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.514183+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:19:23.514183+0000","last_peered":"2024-04-21T10:19:23.514183+0000","last_clean":"2024-04-21T10:19:23.514183+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:19:23.514183+0000","last_undegraded":"2024-04-21T10:19:23.514183+0000","last_fullsized":"2024-04-21T10:19:23.514183+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:18:12.306361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521186+0000","last_change":"2024-04-21T10:19:23.516771+0000","last_active":"2024-04-21T10:19:23.521186+0000","last_peered":"2024-04-21T10:19:23.521186+0000","last_clean":"2024-04-21T10:19:23.521186+0000","last_became_active":"2024-04-21T10:19:23.516290+0000","last_became_peered":"2024-04-21T10:19:23.516290+0000","last_unstale":"2024-04-21T10:19:23.521186+0000","last_undegraded":"2024-04-21T10:19:23.521186+0000","last_fullsized":"2024-04-21T10:19:23.521186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:58.055233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.514555+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:19:23.514555+0000","last_peered":"2024-04-21T10:19:23.514555+0000","last_clean":"2024-04-21T10:19:23.514555+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:19:23.514555+0000","last_undegraded":"2024-04-21T10:19:23.514555+0000","last_fullsized":"2024-04-21T10:19:23.514555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:02:54.458777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521295+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:19:23.521295+0000","last_peered":"2024-04-21T10:19:23.521295+0000","last_clean":"2024-04-21T10:19:23.521295+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:19:23.521295+0000","last_undegraded":"2024-04-21T10:19:23.521295+0000","last_fullsized":"2024-04-21T10:19:23.521295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:51:00.302540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.515474+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:19:23.515474+0000","last_peered":"2024-04-21T10:19:23.515474+0000","last_clean":"2024-04-21T10:19:23.515474+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:19:23.515474+0000","last_undegraded":"2024-04-21T10:19:23.515474+0000","last_fullsized":"2024-04-21T10:19:23.515474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:33:31.508607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511839+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:19:24.511839+0000","last_peered":"2024-04-21T10:19:24.511839+0000","last_clean":"2024-04-21T10:19:24.511839+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:19:24.511839+0000","last_undegraded":"2024-04-21T10:19:24.511839+0000","last_fullsized":"2024-04-21T10:19:24.511839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521690+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:19:23.521690+0000","last_peered":"2024-04-21T10:19:23.521690+0000","last_clean":"2024-04-21T10:19:23.521690+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:19:23.521690+0000","last_undegraded":"2024-04-21T10:19:23.521690+0000","last_fullsized":"2024-04-21T10:19:23.521690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:40:10.425729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249634,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3445,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":9889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":429951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645331,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1011242,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":933888,"data_stored":439339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":439147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":954368,"data_stored":1020901,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":429951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":431563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":431597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":429951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":439556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1020501,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:19:29.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T10:19:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:29 smithi170 ceph-mon[31212]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:29 smithi170 ceph-mon[31212]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:29 smithi170 ceph-mon[31212]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-04-21T10:19:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:29 smithi170 ceph-mon[31212]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:29 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2165635100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:29 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3706075801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:29.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 -- 172.21.15.77:0/4265793691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778103b40 msgr2=0x7fd77810a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 --2- 172.21.15.77:0/4265793691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778103b40 0x7fd77810a3d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd770009ca0 tx=0x7fd77002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 -- 172.21.15.77:0/4265793691 shutdown_connections 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 --2- 172.21.15.77:0/4265793691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778103b40 0x7fd77810a3d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 --2- 172.21.15.77:0/4265793691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd778103180 0x7fd778103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 --2- 172.21.15.77:0/4265793691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778101f90 0x7fd7781023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 -- 172.21.15.77:0/4265793691 >> 172.21.15.77:0/4265793691 conn(0x7fd7780fd500 msgr2=0x7fd7780ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 -- 172.21.15.77:0/4265793691 shutdown_connections 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 -- 172.21.15.77:0/4265793691 wait complete. 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.815+0000 7fd77dec8640 1 Processor -- start 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 -- start start 2024-04-21T10:19:29.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 0x7fd7781981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778103180 0x7fd7781986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd778103b40 0x7fd77819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810db30 con 0x7fd778101f90 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810d9b0 con 0x7fd778103b40 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810dcb0 con 0x7fd778103180 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 0x7fd7781981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 0x7fd7781981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59612/0 (socket says 172.21.15.77:59612) 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 -- 172.21.15.77:0/3277122153 learned_addr learned my addr 172.21.15.77:0/3277122153 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd776ffd640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778103180 0x7fd7781986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 -- 172.21.15.77:0/3277122153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778103180 msgr2=0x7fd7781986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778103180 0x7fd7781986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 -- 172.21.15.77:0/3277122153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd778103b40 msgr2=0x7fd77819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd778103b40 0x7fd77819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 -- 172.21.15.77:0/3277122153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77819fdd0 con 0x7fd778101f90 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd776ffd640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778103180 0x7fd7781986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd7777fe640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 0x7fd7781981b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e9c0 tx=0x7fd76c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00cd80 con 0x7fd778101f90 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7781a00c0 con 0x7fd778101f90 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd76c0035f0 con 0x7fd778101f90 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c010690 con 0x7fd778101f90 2024-04-21T10:19:29.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.816+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7781a0610 con 0x7fd778101f90 2024-04-21T10:19:29.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.817+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7781092b0 con 0x7fd778101f90 2024-04-21T10:19:29.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.818+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd76c004000 con 0x7fd778101f90 2024-04-21T10:19:29.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.819+0000 7fd774ff9640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7600a3c40 0x7fd7600a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:29.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.819+0000 7fd776ffd640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7600a3c40 0x7fd7600a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:29.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.819+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fd76c0d0a40 con 0x7fd778101f90 2024-04-21T10:19:29.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.819+0000 7fd776ffd640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7600a3c40 0x7fd7600a6100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7781996c0 tx=0x7fd768008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:29.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.824+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd76c09d470 con 0x7fd778101f90 2024-04-21T10:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:29 smithi191 ceph-mon[31636]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:29 smithi191 ceph-mon[31636]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:29 smithi191 ceph-mon[31636]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-04-21T10:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:29 smithi191 ceph-mon[31636]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:29 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2165635100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:29 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3706075801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:29.999+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd778062390 con 0x7fd7600a3c40 2024-04-21T10:19:30.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.006+0000 7fd774ff9640 1 -- 172.21.15.77:0/3277122153 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258877 (secure 0 0 0) 0x7fd778062390 con 0x7fd7600a3c40 2024-04-21T10:19:30.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:30.010 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7600a3c40 msgr2=0x7fd7600a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7600a3c40 0x7fd7600a6100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7781996c0 tx=0x7fd768008040 comp rx=0 tx=0).stop 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 msgr2=0x7fd7781981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 0x7fd7781981b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e9c0 tx=0x7fd76c00ee80 comp rx=0 tx=0).stop 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 shutdown_connections 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7600a3c40 0x7fd7600a6100 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd778103b40 0x7fd77819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd778103180 0x7fd7781986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 --2- 172.21.15.77:0/3277122153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd778101f90 0x7fd7781981b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 >> 172.21.15.77:0/3277122153 conn(0x7fd7780fd500 msgr2=0x7fd778106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:30.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 shutdown_connections 2024-04-21T10:19:30.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:30.009+0000 7fd77dec8640 1 -- 172.21.15.77:0/3277122153 wait complete. 2024-04-21T10:19:30.020 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-04-21T10:19:28.673794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593813,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":252,"num_write_kb":2962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360076,"kb_used_data":10832,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581748,"statfs":{"total":1151940427776,"available":1151571709952,"internally_reserved":0,"allocated":11091968,"data_stored":6962310,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19137,"internal_metadata":357414207},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3445,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.192025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.513982+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:19:23.513982+0000","last_peered":"2024-04-21T10:19:23.513982+0000","last_clean":"2024-04-21T10:19:23.513982+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:19:23.513982+0000","last_undegraded":"2024-04-21T10:19:23.513982+0000","last_fullsized":"2024-04-21T10:19:23.513982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:39:24.360318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549334+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:19:24.549334+0000","last_peered":"2024-04-21T10:19:24.549334+0000","last_clean":"2024-04-21T10:19:24.549334+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:19:24.549334+0000","last_undegraded":"2024-04-21T10:19:24.549334+0000","last_fullsized":"2024-04-21T10:19:24.549334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549373+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:19:24.549373+0000","last_peered":"2024-04-21T10:19:24.549373+0000","last_clean":"2024-04-21T10:19:24.549373+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:19:24.549373+0000","last_undegraded":"2024-04-21T10:19:24.549373+0000","last_fullsized":"2024-04-21T10:19:24.549373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.534275+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:19:25.534275+0000","last_peered":"2024-04-21T10:19:25.534275+0000","last_clean":"2024-04-21T10:19:25.534275+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:19:25.534275+0000","last_undegraded":"2024-04-21T10:19:25.534275+0000","last_fullsized":"2024-04-21T10:19:25.534275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518493+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:19:25.518493+0000","last_peered":"2024-04-21T10:19:25.518493+0000","last_clean":"2024-04-21T10:19:25.518493+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:19:25.518493+0000","last_undegraded":"2024-04-21T10:19:25.518493+0000","last_fullsized":"2024-04-21T10:19:25.518493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.520080+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:19:23.520080+0000","last_peered":"2024-04-21T10:19:23.520080+0000","last_clean":"2024-04-21T10:19:23.520080+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:19:23.520080+0000","last_undegraded":"2024-04-21T10:19:23.520080+0000","last_fullsized":"2024-04-21T10:19:23.520080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:38:27.587800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529666+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:19:23.529666+0000","last_peered":"2024-04-21T10:19:23.529666+0000","last_clean":"2024-04-21T10:19:23.529666+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:19:23.529666+0000","last_undegraded":"2024-04-21T10:19:23.529666+0000","last_fullsized":"2024-04-21T10:19:23.529666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:04.080901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.509143+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:19:23.509143+0000","last_peered":"2024-04-21T10:19:23.509143+0000","last_clean":"2024-04-21T10:19:23.509143+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:19:23.509143+0000","last_undegraded":"2024-04-21T10:19:23.509143+0000","last_fullsized":"2024-04-21T10:19:23.509143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:04:06.596148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.510114+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:19:23.510114+0000","last_peered":"2024-04-21T10:19:23.510114+0000","last_clean":"2024-04-21T10:19:23.510114+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:19:23.510114+0000","last_undegraded":"2024-04-21T10:19:23.510114+0000","last_fullsized":"2024-04-21T10:19:23.510114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:46:00.114135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.520176+0000","last_change":"2024-04-21T10:19:23.516740+0000","last_active":"2024-04-21T10:19:23.520176+0000","last_peered":"2024-04-21T10:19:23.520176+0000","last_clean":"2024-04-21T10:19:23.520176+0000","last_became_active":"2024-04-21T10:19:23.516124+0000","last_became_peered":"2024-04-21T10:19:23.516124+0000","last_unstale":"2024-04-21T10:19:23.520176+0000","last_undegraded":"2024-04-21T10:19:23.520176+0000","last_fullsized":"2024-04-21T10:19:23.520176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:04:42.033113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529920+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:19:23.529920+0000","last_peered":"2024-04-21T10:19:23.529920+0000","last_clean":"2024-04-21T10:19:23.529920+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:19:23.529920+0000","last_undegraded":"2024-04-21T10:19:23.529920+0000","last_fullsized":"2024-04-21T10:19:23.529920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:36:00.164015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.534111+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:19:25.534111+0000","last_peered":"2024-04-21T10:19:25.534111+0000","last_clean":"2024-04-21T10:19:25.534111+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:19:25.534111+0000","last_undegraded":"2024-04-21T10:19:25.534111+0000","last_fullsized":"2024-04-21T10:19:25.534111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511753+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:19:24.511753+0000","last_peered":"2024-04-21T10:19:24.511753+0000","last_clean":"2024-04-21T10:19:24.511753+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:19:24.511753+0000","last_undegraded":"2024-04-21T10:19:24.511753+0000","last_fullsized":"2024-04-21T10:19:24.511753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549204+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:19:24.549204+0000","last_peered":"2024-04-21T10:19:24.549204+0000","last_clean":"2024-04-21T10:19:24.549204+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:19:24.549204+0000","last_undegraded":"2024-04-21T10:19:24.549204+0000","last_fullsized":"2024-04-21T10:19:24.549204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549230+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:19:24.549230+0000","last_peered":"2024-04-21T10:19:24.549230+0000","last_clean":"2024-04-21T10:19:24.549230+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:19:24.549230+0000","last_undegraded":"2024-04-21T10:19:24.549230+0000","last_fullsized":"2024-04-21T10:19:24.549230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.516078+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:19:23.516078+0000","last_peered":"2024-04-21T10:19:23.516078+0000","last_clean":"2024-04-21T10:19:23.516078+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:19:23.516078+0000","last_undegraded":"2024-04-21T10:19:23.516078+0000","last_fullsized":"2024-04-21T10:19:23.516078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:08:11.450465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.514413+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:19:23.514413+0000","last_peered":"2024-04-21T10:19:23.514413+0000","last_clean":"2024-04-21T10:19:23.514413+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:19:23.514413+0000","last_undegraded":"2024-04-21T10:19:23.514413+0000","last_fullsized":"2024-04-21T10:19:23.514413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:35.712851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.516080+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:19:25.516080+0000","last_peered":"2024-04-21T10:19:25.516080+0000","last_clean":"2024-04-21T10:19:25.516080+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:19:25.516080+0000","last_undegraded":"2024-04-21T10:19:25.516080+0000","last_fullsized":"2024-04-21T10:19:25.516080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.524791+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:19:23.524791+0000","last_peered":"2024-04-21T10:19:23.524791+0000","last_clean":"2024-04-21T10:19:23.524791+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:19:23.524791+0000","last_undegraded":"2024-04-21T10:19:23.524791+0000","last_fullsized":"2024-04-21T10:19:23.524791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:46.921899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.984687+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:19:25.984687+0000","last_peered":"2024-04-21T10:19:25.984687+0000","last_clean":"2024-04-21T10:19:25.984687+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:19:25.984687+0000","last_undegraded":"2024-04-21T10:19:25.984687+0000","last_fullsized":"2024-04-21T10:19:25.984687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521969+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:19:23.521969+0000","last_peered":"2024-04-21T10:19:23.521969+0000","last_clean":"2024-04-21T10:19:23.521969+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:19:23.521969+0000","last_undegraded":"2024-04-21T10:19:23.521969+0000","last_fullsized":"2024-04-21T10:19:23.521969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:41:08.475374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.531059+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:19:23.531059+0000","last_peered":"2024-04-21T10:19:23.531059+0000","last_clean":"2024-04-21T10:19:23.531059+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:19:23.531059+0000","last_undegraded":"2024-04-21T10:19:23.531059+0000","last_fullsized":"2024-04-21T10:19:23.531059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549518+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:19:24.549518+0000","last_peered":"2024-04-21T10:19:24.549518+0000","last_clean":"2024-04-21T10:19:24.549518+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:19:24.549518+0000","last_undegraded":"2024-04-21T10:19:24.549518+0000","last_fullsized":"2024-04-21T10:19:24.549518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518910+0000","last_change":"2024-04-21T10:19:22.498942+0000","last_active":"2024-04-21T10:19:25.518910+0000","last_peered":"2024-04-21T10:19:25.518910+0000","last_clean":"2024-04-21T10:19:25.518910+0000","last_became_active":"2024-04-21T10:19:22.498566+0000","last_became_peered":"2024-04-21T10:19:22.498566+0000","last_unstale":"2024-04-21T10:19:25.518910+0000","last_undegraded":"2024-04-21T10:19:25.518910+0000","last_fullsized":"2024-04-21T10:19:25.518910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:38:20.461678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.518061+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:19:23.518061+0000","last_peered":"2024-04-21T10:19:23.518061+0000","last_clean":"2024-04-21T10:19:23.518061+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:19:23.518061+0000","last_undegraded":"2024-04-21T10:19:23.518061+0000","last_fullsized":"2024-04-21T10:19:23.518061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:46:38.864878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518736+0000","last_change":"2024-04-21T10:19:22.499002+0000","last_active":"2024-04-21T10:19:25.518736+0000","last_peered":"2024-04-21T10:19:25.518736+0000","last_clean":"2024-04-21T10:19:25.518736+0000","last_became_active":"2024-04-21T10:19:22.498627+0000","last_became_peered":"2024-04-21T10:19:22.498627+0000","last_unstale":"2024-04-21T10:19:25.518736+0000","last_undegraded":"2024-04-21T10:19:25.518736+0000","last_fullsized":"2024-04-21T10:19:25.518736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:42:35.249277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529496+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:19:23.529496+0000","last_peered":"2024-04-21T10:19:23.529496+0000","last_clean":"2024-04-21T10:19:23.529496+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:19:23.529496+0000","last_undegraded":"2024-04-21T10:19:23.529496+0000","last_fullsized":"2024-04-21T10:19:23.529496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:29.779272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.532847+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:19:23.532847+0000","last_peered":"2024-04-21T10:19:23.532847+0000","last_clean":"2024-04-21T10:19:23.532847+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:19:23.532847+0000","last_undegraded":"2024-04-21T10:19:23.532847+0000","last_fullsized":"2024-04-21T10:19:23.532847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518456+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:19:25.518456+0000","last_peered":"2024-04-21T10:19:25.518456+0000","last_clean":"2024-04-21T10:19:25.518456+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:19:25.518456+0000","last_undegraded":"2024-04-21T10:19:25.518456+0000","last_fullsized":"2024-04-21T10:19:25.518456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.534344+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:19:23.534344+0000","last_peered":"2024-04-21T10:19:23.534344+0000","last_clean":"2024-04-21T10:19:23.534344+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:19:23.534344+0000","last_undegraded":"2024-04-21T10:19:23.534344+0000","last_fullsized":"2024-04-21T10:19:23.534344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529558+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:19:23.529558+0000","last_peered":"2024-04-21T10:19:23.529558+0000","last_clean":"2024-04-21T10:19:23.529558+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:19:23.529558+0000","last_undegraded":"2024-04-21T10:19:23.529558+0000","last_fullsized":"2024-04-21T10:19:23.529558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:15:35.415045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511510+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:19:24.511510+0000","last_peered":"2024-04-21T10:19:24.511510+0000","last_clean":"2024-04-21T10:19:24.511510+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:19:24.511510+0000","last_undegraded":"2024-04-21T10:19:24.511510+0000","last_fullsized":"2024-04-21T10:19:24.511510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.509503+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:19:23.509503+0000","last_peered":"2024-04-21T10:19:23.509503+0000","last_clean":"2024-04-21T10:19:23.509503+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:19:23.509503+0000","last_undegraded":"2024-04-21T10:19:23.509503+0000","last_fullsized":"2024-04-21T10:19:23.509503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:13:29.672555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.497748+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:19:23.497748+0000","last_peered":"2024-04-21T10:19:23.497748+0000","last_clean":"2024-04-21T10:19:23.497748+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:19:23.497748+0000","last_undegraded":"2024-04-21T10:19:23.497748+0000","last_fullsized":"2024-04-21T10:19:23.497748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.516009+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:19:25.516009+0000","last_peered":"2024-04-21T10:19:25.516009+0000","last_clean":"2024-04-21T10:19:25.516009+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:19:25.516009+0000","last_undegraded":"2024-04-21T10:19:25.516009+0000","last_fullsized":"2024-04-21T10:19:25.516009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.507144+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:19:23.507144+0000","last_peered":"2024-04-21T10:19:23.507144+0000","last_clean":"2024-04-21T10:19:23.507144+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:19:23.507144+0000","last_undegraded":"2024-04-21T10:19:23.507144+0000","last_fullsized":"2024-04-21T10:19:23.507144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521877+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:19:23.521877+0000","last_peered":"2024-04-21T10:19:23.521877+0000","last_clean":"2024-04-21T10:19:23.521877+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:19:23.521877+0000","last_undegraded":"2024-04-21T10:19:23.521877+0000","last_fullsized":"2024-04-21T10:19:23.521877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:32:49.384749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.512681+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:19:23.512681+0000","last_peered":"2024-04-21T10:19:23.512681+0000","last_clean":"2024-04-21T10:19:23.512681+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:19:23.512681+0000","last_undegraded":"2024-04-21T10:19:23.512681+0000","last_fullsized":"2024-04-21T10:19:23.512681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549443+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:19:24.549443+0000","last_peered":"2024-04-21T10:19:24.549443+0000","last_clean":"2024-04-21T10:19:24.549443+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:19:24.549443+0000","last_undegraded":"2024-04-21T10:19:24.549443+0000","last_fullsized":"2024-04-21T10:19:24.549443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.533442+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:19:23.533442+0000","last_peered":"2024-04-21T10:19:23.533442+0000","last_clean":"2024-04-21T10:19:23.533442+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:19:23.533442+0000","last_undegraded":"2024-04-21T10:19:23.533442+0000","last_fullsized":"2024-04-21T10:19:23.533442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.512003+0000","last_change":"2024-04-21T10:19:23.511406+0000","last_active":"2024-04-21T10:19:23.512003+0000","last_peered":"2024-04-21T10:19:23.512003+0000","last_clean":"2024-04-21T10:19:23.512003+0000","last_became_active":"2024-04-21T10:19:23.511040+0000","last_became_peered":"2024-04-21T10:19:23.511040+0000","last_unstale":"2024-04-21T10:19:23.512003+0000","last_undegraded":"2024-04-21T10:19:23.512003+0000","last_fullsized":"2024-04-21T10:19:23.512003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:21.453646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'6","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.534907+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:19:23.534907+0000","last_peered":"2024-04-21T10:19:23.534907+0000","last_clean":"2024-04-21T10:19:23.534907+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:19:23.534907+0000","last_undegraded":"2024-04-21T10:19:23.534907+0000","last_fullsized":"2024-04-21T10:19:23.534907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518765+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:19:25.518765+0000","last_peered":"2024-04-21T10:19:25.518765+0000","last_clean":"2024-04-21T10:19:25.518765+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:19:25.518765+0000","last_undegraded":"2024-04-21T10:19:25.518765+0000","last_fullsized":"2024-04-21T10:19:25.518765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.532100+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:19:23.532100+0000","last_peered":"2024-04-21T10:19:23.532100+0000","last_clean":"2024-04-21T10:19:23.532100+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:19:23.532100+0000","last_undegraded":"2024-04-21T10:19:23.532100+0000","last_fullsized":"2024-04-21T10:19:23.532100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511853+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:19:24.511853+0000","last_peered":"2024-04-21T10:19:24.511853+0000","last_clean":"2024-04-21T10:19:24.511853+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:19:24.511853+0000","last_undegraded":"2024-04-21T10:19:24.511853+0000","last_fullsized":"2024-04-21T10:19:24.511853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.497713+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:19:23.497713+0000","last_peered":"2024-04-21T10:19:23.497713+0000","last_clean":"2024-04-21T10:19:23.497713+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:19:23.497713+0000","last_undegraded":"2024-04-21T10:19:23.497713+0000","last_fullsized":"2024-04-21T10:19:23.497713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529035+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:19:23.529035+0000","last_peered":"2024-04-21T10:19:23.529035+0000","last_clean":"2024-04-21T10:19:23.529035+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:19:23.529035+0000","last_undegraded":"2024-04-21T10:19:23.529035+0000","last_fullsized":"2024-04-21T10:19:23.529035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:36:05.269587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:26.989434+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:19:26.989434+0000","last_peered":"2024-04-21T10:19:26.989434+0000","last_clean":"2024-04-21T10:19:26.989434+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:19:26.989434+0000","last_undegraded":"2024-04-21T10:19:26.989434+0000","last_fullsized":"2024-04-21T10:19:26.989434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529631+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:19:23.529631+0000","last_peered":"2024-04-21T10:19:23.529631+0000","last_clean":"2024-04-21T10:19:23.529631+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:19:23.529631+0000","last_undegraded":"2024-04-21T10:19:23.529631+0000","last_fullsized":"2024-04-21T10:19:23.529631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:48:23.338670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'10","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.529375+0000","last_change":"2024-04-21T10:19:22.500911+0000","last_active":"2024-04-21T10:19:25.529375+0000","last_peered":"2024-04-21T10:19:25.529375+0000","last_clean":"2024-04-21T10:19:25.529375+0000","last_became_active":"2024-04-21T10:19:22.499854+0000","last_became_peered":"2024-04-21T10:19:22.499854+0000","last_unstale":"2024-04-21T10:19:25.529375+0000","last_undegraded":"2024-04-21T10:19:25.529375+0000","last_fullsized":"2024-04-21T10:19:25.529375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:18:58.701765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529504+0000","last_change":"2024-04-21T10:19:23.527048+0000","last_active":"2024-04-21T10:19:23.529504+0000","last_peered":"2024-04-21T10:19:23.529504+0000","last_clean":"2024-04-21T10:19:23.529504+0000","last_became_active":"2024-04-21T10:19:23.526673+0000","last_became_peered":"2024-04-21T10:19:23.526673+0000","last_unstale":"2024-04-21T10:19:23.529504+0000","last_undegraded":"2024-04-21T10:19:23.529504+0000","last_fullsized":"2024-04-21T10:19:23.529504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:02:50.390812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518850+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:19:25.518850+0000","last_peered":"2024-04-21T10:19:25.518850+0000","last_clean":"2024-04-21T10:19:25.518850+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:19:25.518850+0000","last_undegraded":"2024-04-21T10:19:25.518850+0000","last_fullsized":"2024-04-21T10:19:25.518850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.522046+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:19:23.522046+0000","last_peered":"2024-04-21T10:19:23.522046+0000","last_clean":"2024-04-21T10:19:23.522046+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:19:23.522046+0000","last_undegraded":"2024-04-21T10:19:23.522046+0000","last_fullsized":"2024-04-21T10:19:23.522046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:38:19.314156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.515805+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:19:25.515805+0000","last_peered":"2024-04-21T10:19:25.515805+0000","last_clean":"2024-04-21T10:19:25.515805+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:19:25.515805+0000","last_undegraded":"2024-04-21T10:19:25.515805+0000","last_fullsized":"2024-04-21T10:19:25.515805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.522359+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:19:23.522359+0000","last_peered":"2024-04-21T10:19:23.522359+0000","last_clean":"2024-04-21T10:19:23.522359+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:19:23.522359+0000","last_undegraded":"2024-04-21T10:19:23.522359+0000","last_fullsized":"2024-04-21T10:19:23.522359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:04:30.264594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.515153+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:19:23.515153+0000","last_peered":"2024-04-21T10:19:23.515153+0000","last_clean":"2024-04-21T10:19:23.515153+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:19:23.515153+0000","last_undegraded":"2024-04-21T10:19:23.515153+0000","last_fullsized":"2024-04-21T10:19:23.515153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.520116+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:19:23.520116+0000","last_peered":"2024-04-21T10:19:23.520116+0000","last_clean":"2024-04-21T10:19:23.520116+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:19:23.520116+0000","last_undegraded":"2024-04-21T10:19:23.520116+0000","last_fullsized":"2024-04-21T10:19:23.520116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:26:20.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521223+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:19:23.521223+0000","last_peered":"2024-04-21T10:19:23.521223+0000","last_clean":"2024-04-21T10:19:23.521223+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:19:23.521223+0000","last_undegraded":"2024-04-21T10:19:23.521223+0000","last_fullsized":"2024-04-21T10:19:23.521223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:35:07.479141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511399+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:19:24.511399+0000","last_peered":"2024-04-21T10:19:24.511399+0000","last_clean":"2024-04-21T10:19:24.511399+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:19:24.511399+0000","last_undegraded":"2024-04-21T10:19:24.511399+0000","last_fullsized":"2024-04-21T10:19:24.511399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.508512+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:19:23.508512+0000","last_peered":"2024-04-21T10:19:23.508512+0000","last_clean":"2024-04-21T10:19:23.508512+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:19:23.508512+0000","last_undegraded":"2024-04-21T10:19:23.508512+0000","last_fullsized":"2024-04-21T10:19:23.508512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:46:07.412566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.983261+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:19:25.983261+0000","last_peered":"2024-04-21T10:19:25.983261+0000","last_clean":"2024-04-21T10:19:25.983261+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:19:25.983261+0000","last_undegraded":"2024-04-21T10:19:25.983261+0000","last_fullsized":"2024-04-21T10:19:25.983261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":347,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.513447+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:19:23.513447+0000","last_peered":"2024-04-21T10:19:23.513447+0000","last_clean":"2024-04-21T10:19:23.513447+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:19:23.513447+0000","last_undegraded":"2024-04-21T10:19:23.513447+0000","last_fullsized":"2024-04-21T10:19:23.513447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511469+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:19:24.511469+0000","last_peered":"2024-04-21T10:19:24.511469+0000","last_clean":"2024-04-21T10:19:24.511469+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:19:24.511469+0000","last_undegraded":"2024-04-21T10:19:24.511469+0000","last_fullsized":"2024-04-21T10:19:24.511469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.513797+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:19:23.513797+0000","last_peered":"2024-04-21T10:19:23.513797+0000","last_clean":"2024-04-21T10:19:23.513797+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:19:23.513797+0000","last_undegraded":"2024-04-21T10:19:23.513797+0000","last_fullsized":"2024-04-21T10:19:23.513797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.529637+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:19:25.529637+0000","last_peered":"2024-04-21T10:19:25.529637+0000","last_clean":"2024-04-21T10:19:25.529637+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:19:25.529637+0000","last_undegraded":"2024-04-21T10:19:25.529637+0000","last_fullsized":"2024-04-21T10:19:25.529637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511782+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:19:24.511782+0000","last_peered":"2024-04-21T10:19:24.511782+0000","last_clean":"2024-04-21T10:19:24.511782+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:19:24.511782+0000","last_undegraded":"2024-04-21T10:19:24.511782+0000","last_fullsized":"2024-04-21T10:19:24.511782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.984017+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:19:25.984017+0000","last_peered":"2024-04-21T10:19:25.984017+0000","last_clean":"2024-04-21T10:19:25.984017+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:19:25.984017+0000","last_undegraded":"2024-04-21T10:19:25.984017+0000","last_fullsized":"2024-04-21T10:19:25.984017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521934+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:19:23.521934+0000","last_peered":"2024-04-21T10:19:23.521934+0000","last_clean":"2024-04-21T10:19:23.521934+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:19:23.521934+0000","last_undegraded":"2024-04-21T10:19:23.521934+0000","last_fullsized":"2024-04-21T10:19:23.521934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:05:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.536544+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:19:25.536544+0000","last_peered":"2024-04-21T10:19:25.536544+0000","last_clean":"2024-04-21T10:19:25.536544+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:19:25.536544+0000","last_undegraded":"2024-04-21T10:19:25.536544+0000","last_fullsized":"2024-04-21T10:19:25.536544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549414+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:19:24.549414+0000","last_peered":"2024-04-21T10:19:24.549414+0000","last_clean":"2024-04-21T10:19:24.549414+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:19:24.549414+0000","last_undegraded":"2024-04-21T10:19:24.549414+0000","last_fullsized":"2024-04-21T10:19:24.549414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.498115+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:19:23.498115+0000","last_peered":"2024-04-21T10:19:23.498115+0000","last_clean":"2024-04-21T10:19:23.498115+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:19:23.498115+0000","last_undegraded":"2024-04-21T10:19:23.498115+0000","last_fullsized":"2024-04-21T10:19:23.498115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.518343+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:19:25.518343+0000","last_peered":"2024-04-21T10:19:25.518343+0000","last_clean":"2024-04-21T10:19:25.518343+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:19:25.518343+0000","last_undegraded":"2024-04-21T10:19:25.518343+0000","last_fullsized":"2024-04-21T10:19:25.518343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.500171+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:19:23.500171+0000","last_peered":"2024-04-21T10:19:23.500171+0000","last_clean":"2024-04-21T10:19:23.500171+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:19:23.500171+0000","last_undegraded":"2024-04-21T10:19:23.500171+0000","last_fullsized":"2024-04-21T10:19:23.500171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.517501+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:19:23.517501+0000","last_peered":"2024-04-21T10:19:23.517501+0000","last_clean":"2024-04-21T10:19:23.517501+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:19:23.517501+0000","last_undegraded":"2024-04-21T10:19:23.517501+0000","last_fullsized":"2024-04-21T10:19:23.517501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:41:30.517074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.503697+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:19:23.503697+0000","last_peered":"2024-04-21T10:19:23.503697+0000","last_clean":"2024-04-21T10:19:23.503697+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:19:23.503697+0000","last_undegraded":"2024-04-21T10:19:23.503697+0000","last_fullsized":"2024-04-21T10:19:23.503697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.515489+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:19:23.515489+0000","last_peered":"2024-04-21T10:19:23.515489+0000","last_clean":"2024-04-21T10:19:23.515489+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:19:23.515489+0000","last_undegraded":"2024-04-21T10:19:23.515489+0000","last_fullsized":"2024-04-21T10:19:23.515489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:57:48.972501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:25.529958+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:19:25.529958+0000","last_peered":"2024-04-21T10:19:25.529958+0000","last_clean":"2024-04-21T10:19:25.529958+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:19:25.529958+0000","last_undegraded":"2024-04-21T10:19:25.529958+0000","last_fullsized":"2024-04-21T10:19:25.529958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521822+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:19:23.521822+0000","last_peered":"2024-04-21T10:19:23.521822+0000","last_clean":"2024-04-21T10:19:23.521822+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:19:23.521822+0000","last_undegraded":"2024-04-21T10:19:23.521822+0000","last_fullsized":"2024-04-21T10:19:23.521822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:32:18.504454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.504802+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:19:23.504802+0000","last_peered":"2024-04-21T10:19:23.504802+0000","last_clean":"2024-04-21T10:19:23.504802+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:19:23.504802+0000","last_undegraded":"2024-04-21T10:19:23.504802+0000","last_fullsized":"2024-04-21T10:19:23.504802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529609+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:19:23.529609+0000","last_peered":"2024-04-21T10:19:23.529609+0000","last_clean":"2024-04-21T10:19:23.529609+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:19:23.529609+0000","last_undegraded":"2024-04-21T10:19:23.529609+0000","last_fullsized":"2024-04-21T10:19:23.529609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:17:51.567521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.533649+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:19:23.533649+0000","last_peered":"2024-04-21T10:19:23.533649+0000","last_clean":"2024-04-21T10:19:23.533649+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:19:23.533649+0000","last_undegraded":"2024-04-21T10:19:23.533649+0000","last_fullsized":"2024-04-21T10:19:23.533649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.530288+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:19:23.530288+0000","last_peered":"2024-04-21T10:19:23.530288+0000","last_clean":"2024-04-21T10:19:23.530288+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:19:23.530288+0000","last_undegraded":"2024-04-21T10:19:23.530288+0000","last_fullsized":"2024-04-21T10:19:23.530288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:50:15.178268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511873+0000","last_change":"2024-04-21T10:19:22.499969+0000","last_active":"2024-04-21T10:19:24.511873+0000","last_peered":"2024-04-21T10:19:24.511873+0000","last_clean":"2024-04-21T10:19:24.511873+0000","last_became_active":"2024-04-21T10:19:22.498895+0000","last_became_peered":"2024-04-21T10:19:22.498895+0000","last_unstale":"2024-04-21T10:19:24.511873+0000","last_undegraded":"2024-04-21T10:19:24.511873+0000","last_fullsized":"2024-04-21T10:19:24.511873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:06:11.124328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.529142+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:19:23.529142+0000","last_peered":"2024-04-21T10:19:23.529142+0000","last_clean":"2024-04-21T10:19:23.529142+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:19:23.529142+0000","last_undegraded":"2024-04-21T10:19:23.529142+0000","last_fullsized":"2024-04-21T10:19:23.529142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:35.903757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.527640+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:19:23.527640+0000","last_peered":"2024-04-21T10:19:23.527640+0000","last_clean":"2024-04-21T10:19:23.527640+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:19:23.527640+0000","last_undegraded":"2024-04-21T10:19:23.527640+0000","last_fullsized":"2024-04-21T10:19:23.527640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:15:09.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.522795+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:19:23.522795+0000","last_peered":"2024-04-21T10:19:23.522795+0000","last_clean":"2024-04-21T10:19:23.522795+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:19:23.522795+0000","last_undegraded":"2024-04-21T10:19:23.522795+0000","last_fullsized":"2024-04-21T10:19:23.522795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:08:04.571137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.518560+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:19:23.518560+0000","last_peered":"2024-04-21T10:19:23.518560+0000","last_clean":"2024-04-21T10:19:23.518560+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:19:23.518560+0000","last_undegraded":"2024-04-21T10:19:23.518560+0000","last_fullsized":"2024-04-21T10:19:23.518560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:51.610695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.549453+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:19:24.549453+0000","last_peered":"2024-04-21T10:19:24.549453+0000","last_clean":"2024-04-21T10:19:24.549453+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:19:24.549453+0000","last_undegraded":"2024-04-21T10:19:24.549453+0000","last_fullsized":"2024-04-21T10:19:24.549453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511883+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:19:24.511883+0000","last_peered":"2024-04-21T10:19:24.511883+0000","last_clean":"2024-04-21T10:19:24.511883+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:19:24.511883+0000","last_undegraded":"2024-04-21T10:19:24.511883+0000","last_fullsized":"2024-04-21T10:19:24.511883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.511103+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:19:23.511103+0000","last_peered":"2024-04-21T10:19:23.511103+0000","last_clean":"2024-04-21T10:19:23.511103+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:19:23.511103+0000","last_undegraded":"2024-04-21T10:19:23.511103+0000","last_fullsized":"2024-04-21T10:19:23.511103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:51.140777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.514183+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:19:23.514183+0000","last_peered":"2024-04-21T10:19:23.514183+0000","last_clean":"2024-04-21T10:19:23.514183+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:19:23.514183+0000","last_undegraded":"2024-04-21T10:19:23.514183+0000","last_fullsized":"2024-04-21T10:19:23.514183+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:18:12.306361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521186+0000","last_change":"2024-04-21T10:19:23.516771+0000","last_active":"2024-04-21T10:19:23.521186+0000","last_peered":"2024-04-21T10:19:23.521186+0000","last_clean":"2024-04-21T10:19:23.521186+0000","last_became_active":"2024-04-21T10:19:23.516290+0000","last_became_peered":"2024-04-21T10:19:23.516290+0000","last_unstale":"2024-04-21T10:19:23.521186+0000","last_undegraded":"2024-04-21T10:19:23.521186+0000","last_fullsized":"2024-04-21T10:19:23.521186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:58.055233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.514555+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:19:23.514555+0000","last_peered":"2024-04-21T10:19:23.514555+0000","last_clean":"2024-04-21T10:19:23.514555+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:19:23.514555+0000","last_undegraded":"2024-04-21T10:19:23.514555+0000","last_fullsized":"2024-04-21T10:19:23.514555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:02:54.458777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521295+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:19:23.521295+0000","last_peered":"2024-04-21T10:19:23.521295+0000","last_clean":"2024-04-21T10:19:23.521295+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:19:23.521295+0000","last_undegraded":"2024-04-21T10:19:23.521295+0000","last_fullsized":"2024-04-21T10:19:23.521295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:51:00.302540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.515474+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:19:23.515474+0000","last_peered":"2024-04-21T10:19:23.515474+0000","last_clean":"2024-04-21T10:19:23.515474+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:19:23.515474+0000","last_undegraded":"2024-04-21T10:19:23.515474+0000","last_fullsized":"2024-04-21T10:19:23.515474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:33:31.508607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T10:19:24.511839+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:19:24.511839+0000","last_peered":"2024-04-21T10:19:24.511839+0000","last_clean":"2024-04-21T10:19:24.511839+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:19:24.511839+0000","last_undegraded":"2024-04-21T10:19:24.511839+0000","last_fullsized":"2024-04-21T10:19:24.511839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-21T10:19:23.521690+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:19:23.521690+0000","last_peered":"2024-04-21T10:19:23.521690+0000","last_clean":"2024-04-21T10:19:23.521690+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:19:23.521690+0000","last_undegraded":"2024-04-21T10:19:23.521690+0000","last_fullsized":"2024-04-21T10:19:23.521690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:40:10.425729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249634,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3445,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":9889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":429951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645331,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1011242,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":933888,"data_stored":439339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":439147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":954368,"data_stored":1020901,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":429951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":431563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":431597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":429951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":439556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1020501,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:19:30.024 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-21T10:19:30.025 INFO:tasks.cephadm:Setting up client nodes... 2024-04-21T10:19:30.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-21T10:19:30.295 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:30.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:30 smithi077 ceph-mon[27902]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-21T10:19:30.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:30 smithi077 ceph-mon[27902]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:19:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:30 smithi170 ceph-mon[31212]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-21T10:19:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:30 smithi170 ceph-mon[31212]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:19:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:30 smithi191 ceph-mon[31636]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-21T10:19:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:30 smithi191 ceph-mon[31636]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:19:31.782 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:31 smithi077 ceph-mon[27902]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:19:31.782 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:31 smithi077 ceph-mon[27902]: pgmap v293: 97 pgs: 97 active+clean; 618 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 KiB/s wr, 22 op/s 2024-04-21T10:19:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:31 smithi170 ceph-mon[31212]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:19:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:31 smithi170 ceph-mon[31212]: pgmap v293: 97 pgs: 97 active+clean; 618 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 KiB/s wr, 22 op/s 2024-04-21T10:19:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:31 smithi191 ceph-mon[31636]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:19:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:31 smithi191 ceph-mon[31636]: pgmap v293: 97 pgs: 97 active+clean; 618 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 KiB/s wr, 22 op/s 2024-04-21T10:19:32.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 -- 172.21.15.77:0/1072002997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 msgr2=0x7fc6b8104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:32.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/1072002997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8104150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00099c0 tx=0x7fc6a0009cd0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 -- 172.21.15.77:0/1072002997 shutdown_connections 2024-04-21T10:19:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/1072002997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 0x7fc6b8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/1072002997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 0x7fc6b810af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/1072002997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8104150 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 -- 172.21.15.77:0/1072002997 >> 172.21.15.77:0/1072002997 conn(0x7fc6b80fe090 msgr2=0x7fc6b81004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 -- 172.21.15.77:0/1072002997 shutdown_connections 2024-04-21T10:19:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 -- 172.21.15.77:0/1072002997 wait complete. 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.023+0000 7fc6bcd35700 1 Processor -- start 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 -- start start 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 0x7fc6b8198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 0x7fc6b81a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810e680 con 0x7fc6b8103cf0 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810e500 con 0x7fc6b8102af0 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810e800 con 0x7fc6b8104690 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44416/0 (socket says 172.21.15.77:44416) 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 -- 172.21.15.77:0/3024933238 learned_addr learned my addr 172.21.15.77:0/3024933238 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6b6d9d700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 0x7fc6b81a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6b659c700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 0x7fc6b8198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 -- 172.21.15.77:0/3024933238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 msgr2=0x7fc6b81a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 0x7fc6b81a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 -- 172.21.15.77:0/3024933238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 msgr2=0x7fc6b8198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 0x7fc6b8198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 -- 172.21.15.77:0/3024933238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b81a0870 con 0x7fc6b8103cf0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6b6d9d700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 0x7fc6b81a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6b659c700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 0x7fc6b8198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6affff700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8199160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000b580 tx=0x7fc6a0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0027070 con 0x7fc6b8103cf0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6a0022470 con 0x7fc6b8103cf0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b81a0b00 con 0x7fc6b8103cf0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.024+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000f6e0 con 0x7fc6b8103cf0 2024-04-21T10:19:32.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.025+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81a0fe0 con 0x7fc6b8103cf0 2024-04-21T10:19:32.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.025+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b8050f80 con 0x7fc6b8103cf0 2024-04-21T10:19:32.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.027+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc6a002a070 con 0x7fc6b8103cf0 2024-04-21T10:19:32.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.027+0000 7fc6af7fe700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6a40a3d80 0x7fc6a40a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:32.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.027+0000 7fc6b659c700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6a40a3d80 0x7fc6a40a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:32.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.027+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc6a00d14c0 con 0x7fc6b8103cf0 2024-04-21T10:19:32.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.028+0000 7fc6b659c700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6a40a3d80 0x7fc6a40a6240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc6b819a100 tx=0x7fc6a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:32.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.031+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6a0013070 con 0x7fc6b8103cf0 2024-04-21T10:19:32.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.314+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc6b802e0f0 con 0x7fc6b8103cf0 2024-04-21T10:19:32.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.316+0000 7fc6af7fe700 1 -- 172.21.15.77:0/3024933238 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc6b802e0f0 con 0x7fc6b8103cf0 2024-04-21T10:19:32.316 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-04-21T10:19:32.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA06CRmNdPOEhAAuoDYjp/LAcwEDl5uRmEgNw== 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6a40a3d80 msgr2=0x7fc6a40a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6a40a3d80 0x7fc6a40a6240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc6b819a100 tx=0x7fc6a8008040 comp rx=0 tx=0).stop 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 msgr2=0x7fc6b8199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8199160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000b580 tx=0x7fc6a0003960 comp rx=0 tx=0).stop 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 shutdown_connections 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc6a40a3d80 0x7fc6a40a6240 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6b8102af0 0x7fc6b8198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b8104690 0x7fc6b81a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 --2- 172.21.15.77:0/3024933238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b8103cf0 0x7fc6b8199160 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 >> 172.21.15.77:0/3024933238 conn(0x7fc6b80fe090 msgr2=0x7fc6b8106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 shutdown_connections 2024-04-21T10:19:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:32.318+0000 7fc6bcd35700 1 -- 172.21.15.77:0/3024933238 wait complete. 2024-04-21T10:19:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:32 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3024933238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T10:19:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:32 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3024933238' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-21T10:19:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:32 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3024933238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T10:19:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:32 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3024933238' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-21T10:19:32.948 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:19:32.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-21T10:19:32.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-21T10:19:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:32 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3024933238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T10:19:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:32 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3024933238' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-21T10:19:32.983 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-21T10:19:32.984 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-21T10:19:32.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-21T10:19:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:33 smithi077 ceph-mon[27902]: pgmap v294: 97 pgs: 97 active+clean; 618 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.0 KiB/s wr, 20 op/s 2024-04-21T10:19:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:33 smithi170 ceph-mon[31212]: pgmap v294: 97 pgs: 97 active+clean; 618 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.0 KiB/s wr, 20 op/s 2024-04-21T10:19:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:33 smithi191 ceph-mon[31636]: pgmap v294: 97 pgs: 97 active+clean; 618 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.0 KiB/s wr, 20 op/s 2024-04-21T10:19:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 -- 172.21.15.77:0/793766332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 msgr2=0x7f4f34105290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 --2- 172.21.15.77:0/793766332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f34105290 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f240099c0 tx=0x7f4f24009cd0 comp rx=0 tx=0).stop 2024-04-21T10:19:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 -- 172.21.15.77:0/793766332 shutdown_connections 2024-04-21T10:19:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 --2- 172.21.15.77:0/793766332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34109f90 0x7f4f34111b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 --2- 172.21.15.77:0/793766332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f34105290 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 --2- 172.21.15.77:0/793766332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34105860 0x7f4f341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:34.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 -- 172.21.15.77:0/793766332 >> 172.21.15.77:0/793766332 conn(0x7f4f34100740 msgr2=0x7f4f34102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:34.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 -- 172.21.15.77:0/793766332 shutdown_connections 2024-04-21T10:19:34.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 -- 172.21.15.77:0/793766332 wait complete. 2024-04-21T10:19:34.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.964+0000 7f4f39b60700 1 Processor -- start 2024-04-21T10:19:34.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 -- start start 2024-04-21T10:19:34.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f3419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34105860 0x7f4f3419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34109f90 0x7f4f3419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34114ea0 con 0x7f4f34104eb0 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34114d20 con 0x7f4f34109f90 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34115020 con 0x7f4f34105860 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f3419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f3419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44434/0 (socket says 172.21.15.77:44434) 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 -- 172.21.15.77:0/3279677986 learned_addr learned my addr 172.21.15.77:0/3279677986 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f33fff700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34109f90 0x7f4f3419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f32ffd700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34105860 0x7f4f3419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 -- 172.21.15.77:0/3279677986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34105860 msgr2=0x7f4f3419b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34105860 0x7f4f3419b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 -- 172.21.15.77:0/3279677986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34109f90 msgr2=0x7f4f3419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34109f90 0x7f4f3419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 -- 172.21.15.77:0/3279677986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f341a03c0 con 0x7f4f34104eb0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f32ffd700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34105860 0x7f4f3419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f33fff700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34109f90 0x7f4f3419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f337fe700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f3419b3b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400b580 tx=0x7f4f240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24027070 con 0x7f4f34104eb0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f24004020 con 0x7f4f34104eb0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f341a0650 con 0x7f4f34104eb0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.965+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24022e30 con 0x7f4f34104eb0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.966+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f341a7f30 con 0x7f4f34104eb0 2024-04-21T10:19:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.966+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f34106390 con 0x7f4f34104eb0 2024-04-21T10:19:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.967+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4f24022590 con 0x7f4f34104eb0 2024-04-21T10:19:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.968+0000 7f4f30ff9700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f1c0a3cd0 0x7f4f1c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.968+0000 7f4f32ffd700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f1c0a3cd0 0x7f4f1c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.968+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f4f240d1080 con 0x7f4f34104eb0 2024-04-21T10:19:34.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.968+0000 7f4f32ffd700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f1c0a3cd0 0x7f4f1c0a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f28005fd0 tx=0x7f4f28005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:34.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:34.973+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4f2405dff0 con 0x7f4f34104eb0 2024-04-21T10:19:35.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.234+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4f3402df80 con 0x7f4f34104eb0 2024-04-21T10:19:35.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.242+0000 7f4f30ff9700 1 -- 172.21.15.77:0/3279677986 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264998 (secure 0 0 0) 0x7f4f24013070 con 0x7f4f34104eb0 2024-04-21T10:19:35.246 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f1c0a3cd0 msgr2=0x7f4f1c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f1c0a3cd0 0x7f4f1c0a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f28005fd0 tx=0x7f4f28005ee0 comp rx=0 tx=0).stop 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 msgr2=0x7f4f3419b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f3419b3b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400b580 tx=0x7f4f240047b0 comp rx=0 tx=0).stop 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 shutdown_connections 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4f1c0a3cd0 0x7f4f1c0a6190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f34109f90 0x7f4f3419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f34104eb0 0x7f4f3419b3b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:35.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 --2- 172.21.15.77:0/3279677986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f34105860 0x7f4f3419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:35.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 >> 172.21.15.77:0/3279677986 conn(0x7f4f34100740 msgr2=0x7f4f34101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:35.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 shutdown_connections 2024-04-21T10:19:35.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:35.245+0000 7f4f39b60700 1 -- 172.21.15.77:0/3279677986 wait complete. 2024-04-21T10:19:35.913 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3235809387},{"type":"v1","addr":"172.21.15.77:6801","nonce":3235809387}]},"active_addr":"172.21.15.77:6801/3235809387","active_change":"2024-04-21T10:12:14.592341+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.77:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1164251312}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3467069555}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3052232463}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2521386496}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2137054681}]}]} 2024-04-21T10:19:35.920 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-21T10:19:35.920 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-21T10:19:35.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-21T10:19:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:35 smithi170 ceph-mon[31212]: pgmap v295: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 KiB/s wr, 20 op/s 2024-04-21T10:19:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:35 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3279677986' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-21T10:19:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:35 smithi077 ceph-mon[27902]: pgmap v295: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 KiB/s wr, 20 op/s 2024-04-21T10:19:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:35 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3279677986' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-21T10:19:36.166 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:35 smithi191 ceph-mon[31636]: pgmap v295: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 KiB/s wr, 20 op/s 2024-04-21T10:19:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:35 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3279677986' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-21T10:19:37.956 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:37 smithi077 ceph-mon[27902]: pgmap v296: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.1 KiB/s wr, 17 op/s 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 -- 172.21.15.77:0/3068336601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8102a90 msgr2=0x7f72e8102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 --2- 172.21.15.77:0/3068336601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8102a90 0x7f72e8102f10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009990 tx=0x7f72dc009ca0 comp rx=0 tx=0).stop 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 -- 172.21.15.77:0/3068336601 shutdown_connections 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 --2- 172.21.15.77:0/3068336601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8108a80 0x7f72e8108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 --2- 172.21.15.77:0/3068336601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8103450 0x7f72e810f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 --2- 172.21.15.77:0/3068336601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8102a90 0x7f72e8102f10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 -- 172.21.15.77:0/3068336601 >> 172.21.15.77:0/3068336601 conn(0x7f72e8079bf0 msgr2=0x7f72e807a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 -- 172.21.15.77:0/3068336601 shutdown_connections 2024-04-21T10:19:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 -- 172.21.15.77:0/3068336601 wait complete. 2024-04-21T10:19:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 Processor -- start 2024-04-21T10:19:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.967+0000 7f72ed427700 1 -- start start 2024-04-21T10:19:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8102a90 0x7f72e819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 0x7f72e819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8108a80 0x7f72e819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8112cb0 con 0x7f72e8103450 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8112b30 con 0x7f72e8102a90 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8112e30 con 0x7f72e8108a80 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 0x7f72e819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 0x7f72e819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44446/0 (socket says 172.21.15.77:44446) 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 -- 172.21.15.77:0/1529396756 learned_addr learned my addr 172.21.15.77:0/1529396756 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e6ffd700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8102a90 0x7f72e819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 -- 172.21.15.77:0/1529396756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8108a80 msgr2=0x7f72e819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e77fe700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8108a80 0x7f72e819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8108a80 0x7f72e819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 -- 172.21.15.77:0/1529396756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8102a90 msgr2=0x7f72e819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8102a90 0x7f72e819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 -- 172.21.15.77:0/1529396756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e81a0390 con 0x7f72e8103450 2024-04-21T10:19:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e77fe700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8108a80 0x7f72e819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e6ffd700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8102a90 0x7f72e819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72e67fc700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 0x7f72e819b8c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72dc000c00 tx=0x7f72dc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc027070 con 0x7f72e8103450 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e81a0620 con 0x7f72e8103450 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72dc003fa0 con 0x7f72e8103450 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc022db0 con 0x7f72e8103450 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.968+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e81a7f00 con 0x7f72e8103450 2024-04-21T10:19:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.969+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e81041b0 con 0x7f72e8103450 2024-04-21T10:19:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.970+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f72dc02a070 con 0x7f72e8103450 2024-04-21T10:19:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.971+0000 7f72cffff700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f72d00a3cd0 0x7f72d00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.971+0000 7f72e6ffd700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f72d00a3cd0 0x7f72d00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.971+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f72dc0d1110 con 0x7f72e8103450 2024-04-21T10:19:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.971+0000 7f72e6ffd700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f72d00a3cd0 0x7f72d00a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72d8005950 tx=0x7f72d80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:37.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:37.975+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f72dc013070 con 0x7f72e8103450 2024-04-21T10:19:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:37 smithi170 ceph-mon[31212]: pgmap v296: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.1 KiB/s wr, 17 op/s 2024-04-21T10:19:38.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.172+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72e81a80d0 con 0x7f72e8103450 2024-04-21T10:19:38.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.173+0000 7f72cffff700 1 -- 172.21.15.77:0/1529396756 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22229 (secure 0 0 0) 0x7f72dc09dbd0 con 0x7f72e8103450 2024-04-21T10:19:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:38.173 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":85,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:19:24.501547+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:19:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f72d00a3cd0 msgr2=0x7f72d00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f72d00a3cd0 0x7f72d00a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72d8005950 tx=0x7f72d80058e0 comp rx=0 tx=0).stop 2024-04-21T10:19:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 msgr2=0x7f72e819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 0x7f72e819b8c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72dc000c00 tx=0x7f72dc0047b0 comp rx=0 tx=0).stop 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 shutdown_connections 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f72d00a3cd0 0x7f72d00a6190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e8102a90 0x7f72e819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e8108a80 0x7f72e819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 --2- 172.21.15.77:0/1529396756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72e8103450 0x7f72e819b8c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 >> 172.21.15.77:0/1529396756 conn(0x7f72e8079bf0 msgr2=0x7f72e810df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 shutdown_connections 2024-04-21T10:19:38.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:38.176+0000 7f72ed427700 1 -- 172.21.15.77:0/1529396756 wait complete. 2024-04-21T10:19:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:37 smithi191 ceph-mon[31636]: pgmap v296: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.1 KiB/s wr, 17 op/s 2024-04-21T10:19:38.804 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-21T10:19:38.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-21T10:19:39.041 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:38 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1529396756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:38 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1529396756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:38 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1529396756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:39 smithi191 ceph-mon[31636]: pgmap v297: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2024-04-21T10:19:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:39 smithi170 ceph-mon[31212]: pgmap v297: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2024-04-21T10:19:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:39 smithi077 ceph-mon[27902]: pgmap v297: 97 pgs: 97 active+clean; 630 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 -- 172.21.15.77:0/908207449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360102330 msgr2=0x7fe36010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 --2- 172.21.15.77:0/908207449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360102330 0x7fe36010e7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe35800b0a0 tx=0x7fe35800b3b0 comp rx=0 tx=0).stop 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 -- 172.21.15.77:0/908207449 shutdown_connections 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 --2- 172.21.15.77:0/908207449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360102330 0x7fe36010e7f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 --2- 172.21.15.77:0/908207449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360107920 0x7fe360107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 --2- 172.21.15.77:0/908207449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe360101970 0x7fe360101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 -- 172.21.15.77:0/908207449 >> 172.21.15.77:0/908207449 conn(0x7fe3600788f0 msgr2=0x7fe360078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 -- 172.21.15.77:0/908207449 shutdown_connections 2024-04-21T10:19:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.819+0000 7fe366b9e700 1 -- 172.21.15.77:0/908207449 wait complete. 2024-04-21T10:19:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 Processor -- start 2024-04-21T10:19:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 -- start start 2024-04-21T10:19:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 0x7fe36010f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360102330 0x7fe36010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe360107920 0x7fe36010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112c60 con 0x7fe360101970 2024-04-21T10:19:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112ae0 con 0x7fe360107920 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe366b9e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112de0 con 0x7fe360102330 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe36493a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 0x7fe36010f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe36493a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 0x7fe36010f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49312/0 (socket says 172.21.15.77:49312) 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.820+0000 7fe36493a700 1 -- 172.21.15.77:0/641464145 learned_addr learned my addr 172.21.15.77:0/641464145 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe35ffff700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360102330 0x7fe36010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe36493a700 1 -- 172.21.15.77:0/641464145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360102330 msgr2=0x7fe36010f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe36493a700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360102330 0x7fe36010f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:40.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe36493a700 1 -- 172.21.15.77:0/641464145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe360107920 msgr2=0x7fe36010fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe36493a700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe360107920 0x7fe36010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe36493a700 1 -- 172.21.15.77:0/641464145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3601a7600 con 0x7fe360101970 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe35ffff700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360102330 0x7fe36010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe36493a700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 0x7fe36010f280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe35400d980 tx=0x7fe35400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354017070 con 0x7fe360101970 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe354004830 con 0x7fe360101970 2024-04-21T10:19:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe360198e70 con 0x7fe360101970 2024-04-21T10:19:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354005440 con 0x7fe360101970 2024-04-21T10:19:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.821+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe360199360 con 0x7fe360101970 2024-04-21T10:19:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.823+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe360069730 con 0x7fe360101970 2024-04-21T10:19:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.823+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe3540055e0 con 0x7fe360101970 2024-04-21T10:19:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.824+0000 7fe35dffb700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500a3cd0 0x7fe3500a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.824+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fe3540d02f0 con 0x7fe360101970 2024-04-21T10:19:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.824+0000 7fe35ffff700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500a3cd0 0x7fe3500a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.825+0000 7fe35ffff700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500a3cd0 0x7fe3500a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe34c005fd0 tx=0x7fe34c005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:40.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:40.829+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe354020020 con 0x7fe360101970 2024-04-21T10:19:41.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.028+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe36002df80 con 0x7fe360101970 2024-04-21T10:19:41.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.030+0000 7fe35dffb700 1 -- 172.21.15.77:0/641464145 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22229 (secure 0 0 0) 0x7fe35409cd20 con 0x7fe360101970 2024-04-21T10:19:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:19:41.029 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":85,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:19:24.501547+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:19:41.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500a3cd0 msgr2=0x7fe3500a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500a3cd0 0x7fe3500a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe34c005fd0 tx=0x7fe34c005e20 comp rx=0 tx=0).stop 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 msgr2=0x7fe36010f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 0x7fe36010f280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe35400d980 tx=0x7fe35400dd40 comp rx=0 tx=0).stop 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 shutdown_connections 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe3500a3cd0 0x7fe3500a6190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe360107920 0x7fe36010fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe360101970 0x7fe36010f280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 --2- 172.21.15.77:0/641464145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe360102330 0x7fe36010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 >> 172.21.15.77:0/641464145 conn(0x7fe3600788f0 msgr2=0x7fe3600ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 shutdown_connections 2024-04-21T10:19:41.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:41.032+0000 7fe366b9e700 1 -- 172.21.15.77:0/641464145 wait complete. 2024-04-21T10:19:41.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-21T10:19:41.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-21T10:19:41.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-21T10:19:41.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-21T10:19:41.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-21T10:19:41.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-21T10:19:41.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-21T10:19:41.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-21T10:19:41.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-21T10:19:41.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-21T10:19:41.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-21T10:19:41.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-21T10:19:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:41 smithi170 ceph-mon[31212]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 14 op/s 2024-04-21T10:19:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:41 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/641464145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:41 smithi077 ceph-mon[27902]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 14 op/s 2024-04-21T10:19:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:41 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/641464145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:41 smithi191 ceph-mon[31636]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 14 op/s 2024-04-21T10:19:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:41 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/641464145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:19:42.656 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.658 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.658 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.661 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.662 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.669 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.669 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.669 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.673 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:42.673 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:19:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:43 smithi170 ceph-mon[31212]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-04-21T10:19:44.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:43 smithi077 ceph-mon[27902]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-04-21T10:19:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:43 smithi191 ceph-mon[31636]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-04-21T10:19:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:45 smithi077 ceph-mon[27902]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-04-21T10:19:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:45 smithi170 ceph-mon[31212]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-04-21T10:19:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:45 smithi191 ceph-mon[31636]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-04-21T10:19:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:47 smithi170 ceph-mon[31212]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-04-21T10:19:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:47 smithi077 ceph-mon[27902]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-04-21T10:19:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:47 smithi191 ceph-mon[31636]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-04-21T10:19:50.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:49 smithi077 ceph-mon[27902]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-04-21T10:19:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:49 smithi170 ceph-mon[31212]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-04-21T10:19:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:49 smithi191 ceph-mon[31636]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-04-21T10:19:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:51 smithi170 ceph-mon[31212]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-04-21T10:19:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:51 smithi077 ceph-mon[27902]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-04-21T10:19:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:51 smithi191 ceph-mon[31636]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-04-21T10:19:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:53 smithi170 ceph-mon[31212]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-21T10:19:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:53 smithi077 ceph-mon[27902]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-21T10:19:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:53 smithi191 ceph-mon[31636]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-21T10:19:54.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 -- 172.21.15.77:0/677873099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06b1e0 msgr2=0x7f8d8c06b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:54.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 --2- 172.21.15.77:0/677873099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06b1e0 0x7f8d8c06b640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009990 tx=0x7f8d80009ca0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 -- 172.21.15.77:0/677873099 shutdown_connections 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 --2- 172.21.15.77:0/677873099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d8c108a30 0x7f8d8c108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 --2- 172.21.15.77:0/677873099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d8c06bb80 0x7f8d8c10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 --2- 172.21.15.77:0/677873099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06b1e0 0x7f8d8c06b640 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 -- 172.21.15.77:0/677873099 >> 172.21.15.77:0/677873099 conn(0x7f8d8c0788f0 msgr2=0x7f8d8c078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 -- 172.21.15.77:0/677873099 shutdown_connections 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.825+0000 7f8d90839700 1 -- 172.21.15.77:0/677873099 wait complete. 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 Processor -- start 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 -- start start 2024-04-21T10:19:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d8c06b1e0 0x7f8d8c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06bb80 0x7f8d8c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d8c108a30 0x7f8d8c19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c112cb0 con 0x7f8d8c06bb80 2024-04-21T10:19:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c112b30 con 0x7f8d8c06b1e0 2024-04-21T10:19:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d90839700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c112e30 con 0x7f8d8c108a30 2024-04-21T10:19:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06bb80 0x7f8d8c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06bb80 0x7f8d8c1997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57486/0 (socket says 172.21.15.77:57486) 2024-04-21T10:19:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 -- 172.21.15.77:0/739339545 learned_addr learned my addr 172.21.15.77:0/739339545 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d8ad9d700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d8c108a30 0x7f8d8c19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 -- 172.21.15.77:0/739339545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d8c108a30 msgr2=0x7f8d8c19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d8c108a30 0x7f8d8c19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 -- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d8c06b1e0 msgr2=0x7f8d8c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d8a59c700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d8c06b1e0 0x7f8d8c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d8c06b1e0 0x7f8d8c199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.826+0000 7f8d89d9b700 1 -- 172.21.15.77:0/739339545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c19e280 con 0x7f8d8c06bb80 2024-04-21T10:19:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.827+0000 7f8d89d9b700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06bb80 0x7f8d8c1997b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d80000c00 tx=0x7f8d800047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.827+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80027070 con 0x7f8d8c06bb80 2024-04-21T10:19:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.827+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c19e510 con 0x7f8d8c06bb80 2024-04-21T10:19:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.827+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d800041d0 con 0x7f8d8c06bb80 2024-04-21T10:19:54.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.827+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000f460 con 0x7f8d8c06bb80 2024-04-21T10:19:54.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.827+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1a5df0 con 0x7f8d8c06bb80 2024-04-21T10:19:54.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.828+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d8c0631d0 con 0x7f8d8c06bb80 2024-04-21T10:19:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.829+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8d8002a070 con 0x7f8d8c06bb80 2024-04-21T10:19:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.829+0000 7f8d7b7fe700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8d740a3cd0 0x7f8d740a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d8a59c700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8d740a3cd0 0x7f8d740a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f8d800d1ab0 con 0x7f8d8c06bb80 2024-04-21T10:19:54.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d7b7fe700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] conn(0x7f8d740ad4b0 0x7f8d740af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:54.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 --> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d80019e80 con 0x7f8d740ad4b0 2024-04-21T10:19:54.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f8d800d1f90 con 0x7f8d8c06bb80 2024-04-21T10:19:54.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d8a59c700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8d740a3cd0 0x7f8d740a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006fd0 tx=0x7f8d7c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:54.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d8ad9d700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] conn(0x7f8d740ad4b0 0x7f8d740af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:54.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.830+0000 7f8d8ad9d700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] conn(0x7f8d740ad4b0 0x7f8d740af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:54.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.831+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== osd.1 v2:172.21.15.170:6800/1692456293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d80019e80 con 0x7f8d740ad4b0 2024-04-21T10:19:54.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.847+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 --> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d8c0635d0 con 0x7f8d740ad4b0 2024-04-21T10:19:54.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.848+0000 7f8d7b7fe700 1 -- 172.21.15.77:0/739339545 <== osd.1 v2:172.21.15.170:6800/1692456293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d8c0635d0 con 0x7f8d740ad4b0 2024-04-21T10:19:54.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.848+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] conn(0x7f8d740ad4b0 msgr2=0x7f8d740af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:54.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.848+0000 7f8d90839700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] conn(0x7f8d740ad4b0 0x7f8d740af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8d740a3cd0 msgr2=0x7f8d740a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8d740a3cd0 0x7f8d740a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006fd0 tx=0x7f8d7c008040 comp rx=0 tx=0).stop 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06bb80 msgr2=0x7f8d8c1997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 --2- 172.21.15.77:0/739339545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8c06bb80 0x7f8d8c1997b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d80000c00 tx=0x7f8d800047b0 comp rx=0 tx=0).stop 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d8ad9d700 1 -- 172.21.15.77:0/739339545 reap_dead start 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 shutdown_connections 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 >> 172.21.15.77:0/739339545 conn(0x7f8d8c0788f0 msgr2=0x7f8d8c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 shutdown_connections 2024-04-21T10:19:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:54.849+0000 7f8d90839700 1 -- 172.21.15.77:0/739339545 wait complete. 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 -- 172.21.15.77:0/1546077034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 msgr2=0x7f8fac10e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 --2- 172.21.15.77:0/1546077034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac10e7f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400b0a0 tx=0x7f8fa400b3b0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 -- 172.21.15.77:0/1546077034 shutdown_connections 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 --2- 172.21.15.77:0/1546077034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fac107920 0x7f8fac107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 --2- 172.21.15.77:0/1546077034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac10e7f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 --2- 172.21.15.77:0/1546077034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fac101970 0x7f8fac101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 -- 172.21.15.77:0/1546077034 >> 172.21.15.77:0/1546077034 conn(0x7f8fac0788f0 msgr2=0x7f8fac078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 -- 172.21.15.77:0/1546077034 shutdown_connections 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.021+0000 7f8fb3597700 1 -- 172.21.15.77:0/1546077034 wait complete. 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 Processor -- start 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 -- start start 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fac101970 0x7f8fac1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fac107920 0x7f8fac19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac111b60 con 0x7f8fac102330 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1119e0 con 0x7f8fac107920 2024-04-21T10:19:55.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb3597700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac111ce0 con 0x7f8fac101970 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb0b32700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb0b32700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57504/0 (socket says 172.21.15.77:57504) 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb0b32700 1 -- 172.21.15.77:0/315884925 learned_addr learned my addr 172.21.15.77:0/315884925 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb1333700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fac101970 0x7f8fac1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.022+0000 7f8fb1b34700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fac107920 0x7f8fac19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb0b32700 1 -- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fac101970 msgr2=0x7f8fac1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb0b32700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fac101970 0x7f8fac1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb0b32700 1 -- 172.21.15.77:0/315884925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fac107920 msgr2=0x7f8fac19d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:55.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb0b32700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fac107920 0x7f8fac19d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb0b32700 1 -- 172.21.15.77:0/315884925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac19e0b0 con 0x7f8fac102330 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb0b32700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac199630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b530 tx=0x7f8f9c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c015020 con 0x7f8fac102330 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f9c011ce0 con 0x7f8fac102330 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fac19e3a0 con 0x7f8fac102330 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c010d20 con 0x7f8fac102330 2024-04-21T10:19:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.023+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fac1a5c20 con 0x7f8fac102330 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.024+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fac0631d0 con 0x7f8fac102330 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.025+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8f9c018020 con 0x7f8fac102330 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.025+0000 7f8fa27fc700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8f980a3cd0 0x7f8f980a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fb1333700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8f980a3cd0 0x7f8f980a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f8f9c0d0240 con 0x7f8fac102330 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fa27fc700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] conn(0x7f8f980ad4b0 0x7f8f980af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 --> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f980aff80 con 0x7f8f980ad4b0 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f8f9c0d0720 con 0x7f8fac102330 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fb1333700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8f980a3cd0 0x7f8f980a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8005ea0 tx=0x7f8fa8005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.026+0000 7f8fb1b34700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] conn(0x7f8f980ad4b0 0x7f8f980af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:55.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.027+0000 7f8fb1b34700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] conn(0x7f8f980ad4b0 0x7f8f980af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:55.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.027+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== osd.8 v2:172.21.15.191:6816/609468755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f980aff80 con 0x7f8f980ad4b0 2024-04-21T10:19:55.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.043+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 --> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8fac0635d0 con 0x7f8f980ad4b0 2024-04-21T10:19:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fa27fc700 1 -- 172.21.15.77:0/315884925 <== osd.8 v2:172.21.15.191:6816/609468755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8fac0635d0 con 0x7f8f980ad4b0 2024-04-21T10:19:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] conn(0x7f8f980ad4b0 msgr2=0x7f8f980af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] conn(0x7f8f980ad4b0 0x7f8f980af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8f980a3cd0 msgr2=0x7f8f980a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8f980a3cd0 0x7f8f980a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8005ea0 tx=0x7f8fa8005e30 comp rx=0 tx=0).stop 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 msgr2=0x7f8fac199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 --2- 172.21.15.77:0/315884925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fac102330 0x7f8fac199630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b530 tx=0x7f8f9c00b8f0 comp rx=0 tx=0).stop 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb1b34700 1 -- 172.21.15.77:0/315884925 reap_dead start 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 shutdown_connections 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 >> 172.21.15.77:0/315884925 conn(0x7f8fac0788f0 msgr2=0x7f8fac06b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 shutdown_connections 2024-04-21T10:19:55.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.044+0000 7f8fb3597700 1 -- 172.21.15.77:0/315884925 wait complete. 2024-04-21T10:19:55.980 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:55 smithi077 ceph-mon[27902]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-21T10:19:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:55 smithi170 ceph-mon[31212]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-21T10:19:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:55 smithi191 ceph-mon[31636]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-21T10:19:56.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.549+0000 7f029910d700 1 -- 172.21.15.77:0/2314586334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294101940 msgr2=0x7f0294101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:56.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.549+0000 7f029910d700 1 --2- 172.21.15.77:0/2314586334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294101940 0x7f0294101dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f027c009990 tx=0x7f027c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 -- 172.21.15.77:0/2314586334 shutdown_connections 2024-04-21T10:19:56.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 --2- 172.21.15.77:0/2314586334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0294107990 0x7f0294107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 --2- 172.21.15.77:0/2314586334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0294102300 0x7f029410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 --2- 172.21.15.77:0/2314586334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294101940 0x7f0294101dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 -- 172.21.15.77:0/2314586334 >> 172.21.15.77:0/2314586334 conn(0x7f02940788f0 msgr2=0x7f0294078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 -- 172.21.15.77:0/2314586334 shutdown_connections 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 -- 172.21.15.77:0/2314586334 wait complete. 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.550+0000 7f029910d700 1 Processor -- start 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 -- start start 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0294101940 0x7f0294198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294102300 0x7f02941985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0294107990 0x7f029419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0294111b50 con 0x7f0294102300 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f02941119d0 con 0x7f0294107990 2024-04-21T10:19:56.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029910d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0294111cd0 con 0x7f0294101940 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294102300 0x7f02941985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294102300 0x7f02941985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57552/0 (socket says 172.21.15.77:57552) 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 -- 172.21.15.77:0/2970989566 learned_addr learned my addr 172.21.15.77:0/2970989566 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029359e700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0294107990 0x7f029419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 -- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0294101940 msgr2=0x7f0294198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f0292d9d700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0294101940 0x7f0294198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0294101940 0x7f0294198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 -- 172.21.15.77:0/2970989566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0294107990 msgr2=0x7f029419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0294107990 0x7f029419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 -- 172.21.15.77:0/2970989566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029419d070 con 0x7f0294102300 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f029359e700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0294107990 0x7f029419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f028a59c700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294102300 0x7f02941985a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.551+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c02a070 con 0x7f0294102300 2024-04-21T10:19:56.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.552+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029419d300 con 0x7f0294102300 2024-04-21T10:19:56.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.552+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f027c01ad70 con 0x7f0294102300 2024-04-21T10:19:56.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.552+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029406a720 con 0x7f0294102300 2024-04-21T10:19:56.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.552+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c00f460 con 0x7f0294102300 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.552+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f029406ad10 con 0x7f0294102300 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f027c02d070 con 0x7f0294102300 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0290d99700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f02800a3cd0 0x7f02800a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0292d9d700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f02800a3cd0 0x7f02800a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f027c0d3ec0 con 0x7f0294102300 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0290d99700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] conn(0x7f02800ad4b0 0x7f02800af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:56.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 --> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f027c00b0b0 con 0x7f02800ad4b0 2024-04-21T10:19:56.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.554+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f027c0d43a0 con 0x7f0294102300 2024-04-21T10:19:56.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.555+0000 7f0292d9d700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f02800a3cd0 0x7f02800a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f02840060b0 tx=0x7f0284008640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:56.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.555+0000 7f029359e700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] conn(0x7f02800ad4b0 0x7f02800af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:56.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.555+0000 7f029359e700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] conn(0x7f02800ad4b0 0x7f02800af8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:56.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.556+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== osd.11 v2:172.21.15.191:6824/1429777061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f027c00b0b0 con 0x7f02800ad4b0 2024-04-21T10:19:56.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.575+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 --> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f029406b110 con 0x7f02800ad4b0 2024-04-21T10:19:56.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f0290d99700 1 -- 172.21.15.77:0/2970989566 <== osd.11 v2:172.21.15.191:6824/1429777061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f029406b110 con 0x7f02800ad4b0 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] conn(0x7f02800ad4b0 msgr2=0x7f02800af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029910d700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] conn(0x7f02800ad4b0 0x7f02800af8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f02800a3cd0 msgr2=0x7f02800a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029910d700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f02800a3cd0 0x7f02800a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f02840060b0 tx=0x7f0284008640 comp rx=0 tx=0).stop 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294102300 msgr2=0x7f02941985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029910d700 1 --2- 172.21.15.77:0/2970989566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0294102300 0x7f02941985a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c0047b0 comp rx=0 tx=0).stop 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.576+0000 7f029359e700 1 -- 172.21.15.77:0/2970989566 reap_dead start 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.577+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 shutdown_connections 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.577+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 >> 172.21.15.77:0/2970989566 conn(0x7f02940788f0 msgr2=0x7f02940ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.577+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 shutdown_connections 2024-04-21T10:19:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.577+0000 7f029910d700 1 -- 172.21.15.77:0/2970989566 wait complete. 2024-04-21T10:19:58.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:57 smithi191 ceph-mon[31636]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-04-21T10:19:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:57 smithi170 ceph-mon[31212]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-04-21T10:19:58.082 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:57 smithi077 ceph-mon[27902]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-04-21T10:19:58.773 INFO:teuthology.orchestra.run.smithi077.stdout:253403070500 2024-04-21T10:19:58.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-21T10:19:58.889 INFO:teuthology.orchestra.run.smithi077.stdout:55834574919 2024-04-21T10:19:58.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 -- 172.21.15.77:0/1317072956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4406a750 msgr2=0x7f8c4406abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 --2- 172.21.15.77:0/1317072956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4406a750 0x7f8c4406abb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009990 tx=0x7f8c2c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 -- 172.21.15.77:0/1317072956 shutdown_connections 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 --2- 172.21.15.77:0/1317072956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4406b0f0 0x7f8c4410f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 --2- 172.21.15.77:0/1317072956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c44108a30 0x7f8c44108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 --2- 172.21.15.77:0/1317072956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4406a750 0x7f8c4406abb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 -- 172.21.15.77:0/1317072956 >> 172.21.15.77:0/1317072956 conn(0x7f8c440788f0 msgr2=0x7f8c44078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 -- 172.21.15.77:0/1317072956 shutdown_connections 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 -- 172.21.15.77:0/1317072956 wait complete. 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 Processor -- start 2024-04-21T10:19:59.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.981+0000 7f8c49749700 1 -- start start 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c4406a750 0x7f8c44101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4406b0f0 0x7f8c44101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c44108a30 0x7f8c44102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44112c30 con 0x7f8c44108a30 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44112ab0 con 0x7f8c4406b0f0 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44112db0 con 0x7f8c4406a750 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c44108a30 0x7f8c44102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c44108a30 0x7f8c44102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57526/0 (socket says 172.21.15.77:57526) 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 -- 172.21.15.77:0/3161733572 learned_addr learned my addr 172.21.15.77:0/3161733572 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c3a7fc700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4406b0f0 0x7f8c44101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c42ffd700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c4406a750 0x7f8c44101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:59.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 -- 172.21.15.77:0/3161733572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c4406a750 msgr2=0x7f8c44101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c4406a750 0x7f8c44101a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 -- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4406b0f0 msgr2=0x7f8c44101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4406b0f0 0x7f8c44101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 -- 172.21.15.77:0/3161733572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c441a7700 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c3a7fc700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4406b0f0 0x7f8c44101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c437fe700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c44108a30 0x7f8c44102490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00ada0 tx=0x7f8c3c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c017020 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c441a79f0 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c3c00ce30 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.982+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0054a0 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.983+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c441a7ee0 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.983+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c44063110 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.984+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8c3c00c980 con 0x7f8c44108a30 2024-04-21T10:19:59.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c40ff9700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8c300a3cd0 0x7f8c300a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c42ffd700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8c300a3cd0 0x7f8c300a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f8c3c0d05d0 con 0x7f8c44108a30 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c40ff9700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] conn(0x7f8c300ad4b0 0x7f8c300af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 --> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c3c019e50 con 0x7f8c300ad4b0 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f8c3c0d0ab0 con 0x7f8c44108a30 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.985+0000 7f8c42ffd700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8c300a3cd0 0x7f8c300a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c34006fd0 tx=0x7f8c34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.986+0000 7f8c3a7fc700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] conn(0x7f8c300ad4b0 0x7f8c300af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:19:59.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.986+0000 7f8c3a7fc700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] conn(0x7f8c300ad4b0 0x7f8c300af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:55.987+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== osd.10 v2:172.21.15.170:6824/1368923221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c3c019e50 con 0x7f8c300ad4b0 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.004+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 --> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c44063590 con 0x7f8c300ad4b0 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c40ff9700 1 -- 172.21.15.77:0/3161733572 <== osd.10 v2:172.21.15.170:6824/1368923221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c44063590 con 0x7f8c300ad4b0 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] conn(0x7f8c300ad4b0 msgr2=0x7f8c300af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] conn(0x7f8c300ad4b0 0x7f8c300af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8c300a3cd0 msgr2=0x7f8c300a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8c300a3cd0 0x7f8c300a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c34006fd0 tx=0x7f8c34008040 comp rx=0 tx=0).stop 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c44108a30 msgr2=0x7f8c44102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 --2- 172.21.15.77:0/3161733572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c44108a30 0x7f8c44102490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00ada0 tx=0x7f8c3c00c330 comp rx=0 tx=0).stop 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c437fe700 1 -- 172.21.15.77:0/3161733572 reap_dead start 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 shutdown_connections 2024-04-21T10:19:59.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.005+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 >> 172.21.15.77:0/3161733572 conn(0x7f8c440788f0 msgr2=0x7f8c440ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:19:59.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.006+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 shutdown_connections 2024-04-21T10:19:59.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:56.006+0000 7f8c49749700 1 -- 172.21.15.77:0/3161733572 wait complete. 2024-04-21T10:19:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:19:59 smithi077 ceph-mon[27902]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T10:20:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:19:59 smithi170 ceph-mon[31212]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T10:20:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:19:59 smithi191 ceph-mon[31636]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T10:20:00.549 INFO:teuthology.orchestra.run.smithi077.stdout:309237645338 2024-04-21T10:20:00.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 -- 172.21.15.77:0/803434557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 msgr2=0x7f5190102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 --2- 172.21.15.77:0/803434557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190102f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5180009990 tx=0x7f5180009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 -- 172.21.15.77:0/803434557 shutdown_connections 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 --2- 172.21.15.77:0/803434557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5190108a50 0x7f5190108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 --2- 172.21.15.77:0/803434557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5190103450 0x7f519010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 --2- 172.21.15.77:0/803434557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190102f10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 -- 172.21.15.77:0/803434557 >> 172.21.15.77:0/803434557 conn(0x7f5190079ba0 msgr2=0x7f5190079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 -- 172.21.15.77:0/803434557 shutdown_connections 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.889+0000 7f5197feb700 1 -- 172.21.15.77:0/803434557 wait complete. 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 Processor -- start 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 -- start start 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5190103450 0x7f5190075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5190108a50 0x7f51900757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5190112c80 con 0x7f5190102a90 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5190112b00 con 0x7f5190108a50 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5197feb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5190112e00 con 0x7f5190103450 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57576/0 (socket says 172.21.15.77:57576) 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 -- 172.21.15.77:0/1655660203 learned_addr learned my addr 172.21.15.77:0/1655660203 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195586700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5190103450 0x7f5190075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 -- 172.21.15.77:0/1655660203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5190103450 msgr2=0x7f5190075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5190103450 0x7f5190075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 -- 172.21.15.77:0/1655660203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5190108a50 msgr2=0x7f51900757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5190108a50 0x7f51900757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 -- 172.21.15.77:0/1655660203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51901a7700 con 0x7f5190102a90 2024-04-21T10:20:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195586700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5190103450 0x7f5190075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.890+0000 7f5195d87700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190074d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c920 tx=0x7f518c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.891+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c007b00 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.891+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51901a79f0 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.891+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f518c004ce0 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.891+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c005650 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.891+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51901a7f30 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.891+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5190063110 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f518c007ca0 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5186ffd700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f517c0a3cd0 0x7f517c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5195586700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f517c0a3cd0 0x7f517c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f518c0d04d0 con 0x7f5190102a90 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5186ffd700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] conn(0x7f517c0ad4b0 0x7f517c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 --> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f518c012ec0 con 0x7f517c0ad4b0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f518c0d09b0 con 0x7f5190102a90 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.893+0000 7f5196588700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] conn(0x7f517c0ad4b0 0x7f517c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.894+0000 7f5195586700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f517c0a3cd0 0x7f517c0a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5180006010 tx=0x7f518000b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.894+0000 7f5196588700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] conn(0x7f517c0ad4b0 0x7f517c0af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.894+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== osd.6 v2:172.21.15.77:6818/170633927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f518c012ec0 con 0x7f517c0ad4b0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.910+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 --> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5190063510 con 0x7f517c0ad4b0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5186ffd700 1 -- 172.21.15.77:0/1655660203 <== osd.6 v2:172.21.15.77:6818/170633927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5190063510 con 0x7f517c0ad4b0 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] conn(0x7f517c0ad4b0 msgr2=0x7f517c0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] conn(0x7f517c0ad4b0 0x7f517c0af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f517c0a3cd0 msgr2=0x7f517c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f517c0a3cd0 0x7f517c0a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5180006010 tx=0x7f518000b540 comp rx=0 tx=0).stop 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 msgr2=0x7f5190074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 --2- 172.21.15.77:0/1655660203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5190102a90 0x7f5190074d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c920 tx=0x7f518c00cce0 comp rx=0 tx=0).stop 2024-04-21T10:20:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5196588700 1 -- 172.21.15.77:0/1655660203 reap_dead start 2024-04-21T10:20:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 shutdown_connections 2024-04-21T10:20:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 >> 172.21.15.77:0/1655660203 conn(0x7f5190079ba0 msgr2=0x7f51901017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 shutdown_connections 2024-04-21T10:20:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:19:57.911+0000 7f5197feb700 1 -- 172.21.15.77:0/1655660203 wait complete. 2024-04-21T10:20:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:00 smithi170 ceph-mon[31212]: overall HEALTH_OK 2024-04-21T10:20:01.090 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:00 smithi077 ceph-mon[27902]: overall HEALTH_OK 2024-04-21T10:20:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:00 smithi191 ceph-mon[31636]: overall HEALTH_OK 2024-04-21T10:20:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.627+0000 7f6b7fe00700 1 -- 172.21.15.77:0/1667965609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78108a80 msgr2=0x7f6b78108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.627+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/1667965609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78108a80 0x7f6b78108e60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009990 tx=0x7f6b74009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 -- 172.21.15.77:0/1667965609 shutdown_connections 2024-04-21T10:20:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/1667965609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b781034b0 0x7f6b7810f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/1667965609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78108a80 0x7f6b78108e60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/1667965609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b78102af0 0x7f6b78102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 -- 172.21.15.77:0/1667965609 >> 172.21.15.77:0/1667965609 conn(0x7f6b78079b20 msgr2=0x7f6b78079f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 -- 172.21.15.77:0/1667965609 shutdown_connections 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 -- 172.21.15.77:0/1667965609 wait complete. 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 Processor -- start 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.628+0000 7f6b7fe00700 1 -- start start 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78102af0 0x7f6b78074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b781034b0 0x7f6b78075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b78108a80 0x7f6b780757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78112d10 con 0x7f6b78102af0 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78112b90 con 0x7f6b78108a80 2024-04-21T10:20:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78112e90 con 0x7f6b781034b0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78102af0 0x7f6b78074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78102af0 0x7f6b78074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47162/0 (socket says 172.21.15.77:47162) 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 -- 172.21.15.77:0/877962174 learned_addr learned my addr 172.21.15.77:0/877962174 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7d39b700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b781034b0 0x7f6b78075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7e39d700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b78108a80 0x7f6b780757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 -- 172.21.15.77:0/877962174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b781034b0 msgr2=0x7f6b78075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b781034b0 0x7f6b78075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 -- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b78108a80 msgr2=0x7f6b780757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b78108a80 0x7f6b780757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 -- 172.21.15.77:0/877962174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b781a77b0 con 0x7f6b78102af0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7d39b700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b781034b0 0x7f6b78075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7db9c700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78102af0 0x7f6b78074d40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6b740057f0 tx=0x7f6b74003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74027070 con 0x7f6b78102af0 2024-04-21T10:20:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b740041c0 con 0x7f6b78102af0 2024-04-21T10:20:01.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b781a7a40 con 0x7f6b78102af0 2024-04-21T10:20:01.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.629+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400f460 con 0x7f6b78102af0 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.630+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b781a7f20 con 0x7f6b78102af0 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.630+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b78063110 con 0x7f6b78102af0 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6b7402a070 con 0x7f6b78102af0 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b6effd700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6b640a3cd0 0x7f6b640a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b7d39b700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6b640a3cd0 0x7f6b640a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f6b740d1e60 con 0x7f6b78102af0 2024-04-21T10:20:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b6effd700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] conn(0x7f6b640ad4b0 0x7f6b640af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 --> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b74027e70 con 0x7f6b640ad4b0 2024-04-21T10:20:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.632+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f6b740d2340 con 0x7f6b78102af0 2024-04-21T10:20:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.633+0000 7f6b7d39b700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6b640a3cd0 0x7f6b640a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b7807a460 tx=0x7f6b68008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.633+0000 7f6b7e39d700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] conn(0x7f6b640ad4b0 0x7f6b640af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.633+0000 7f6b7e39d700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] conn(0x7f6b640ad4b0 0x7f6b640af8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.634+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== osd.7 v2:172.21.15.170:6816/3139153153 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b74027e70 con 0x7f6b640ad4b0 2024-04-21T10:20:01.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.652+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 --> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b78063590 con 0x7f6b640ad4b0 2024-04-21T10:20:01.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b6effd700 1 -- 172.21.15.77:0/877962174 <== osd.7 v2:172.21.15.170:6816/3139153153 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6b78063590 con 0x7f6b640ad4b0 2024-04-21T10:20:01.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] conn(0x7f6b640ad4b0 msgr2=0x7f6b640af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:01.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] conn(0x7f6b640ad4b0 0x7f6b640af8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:01.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6b640a3cd0 msgr2=0x7f6b640a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:01.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6b640a3cd0 0x7f6b640a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b7807a460 tx=0x7f6b68008040 comp rx=0 tx=0).stop 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78102af0 msgr2=0x7f6b78074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 --2- 172.21.15.77:0/877962174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b78102af0 0x7f6b78074d40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6b740057f0 tx=0x7f6b74003730 comp rx=0 tx=0).stop 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7e39d700 1 -- 172.21.15.77:0/877962174 reap_dead start 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 shutdown_connections 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 >> 172.21.15.77:0/877962174 conn(0x7f6b78079b20 msgr2=0x7f6b781069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 shutdown_connections 2024-04-21T10:20:01.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:01.653+0000 7f6b7fe00700 1 -- 172.21.15.77:0/877962174 wait complete. 2024-04-21T10:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:01 smithi170 ceph-mon[31212]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-04-21T10:20:02.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:01 smithi077 ceph-mon[27902]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-04-21T10:20:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 -- 172.21.15.77:0/342015695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018103450 msgr2=0x7f501810f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 --2- 172.21.15.77:0/342015695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018103450 0x7f501810f8b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f501000b0a0 tx=0x7f501000b3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 -- 172.21.15.77:0/342015695 shutdown_connections 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 --2- 172.21.15.77:0/342015695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018103450 0x7f501810f8b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 --2- 172.21.15.77:0/342015695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5018108a50 0x7f5018108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 --2- 172.21.15.77:0/342015695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5018102a90 0x7f5018102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 -- 172.21.15.77:0/342015695 >> 172.21.15.77:0/342015695 conn(0x7f5018079ba0 msgr2=0x7f5018079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 -- 172.21.15.77:0/342015695 shutdown_connections 2024-04-21T10:20:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 -- 172.21.15.77:0/342015695 wait complete. 2024-04-21T10:20:02.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 Processor -- start 2024-04-21T10:20:02.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.114+0000 7f501e2a1700 1 -- start start 2024-04-21T10:20:02.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5018102a90 0x7f50181990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5018103450 0x7f50181995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018108a50 0x7f501819d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5018112c00 con 0x7f5018108a50 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5018112a80 con 0x7f5018103450 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5018112d80 con 0x7f5018102a90 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018108a50 0x7f501819d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018108a50 0x7f501819d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47168/0 (socket says 172.21.15.77:47168) 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 -- 172.21.15.77:0/272721747 learned_addr learned my addr 172.21.15.77:0/272721747 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f50177fe700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5018103450 0x7f50181995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f5017fff700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5018102a90 0x7f50181990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 -- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5018102a90 msgr2=0x7f50181990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5018102a90 0x7f50181990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 -- 172.21.15.77:0/272721747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5018103450 msgr2=0x7f50181995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5018103450 0x7f50181995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 -- 172.21.15.77:0/272721747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501819e0c0 con 0x7f5018108a50 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f5017fff700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5018102a90 0x7f50181990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f50177fe700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5018103450 0x7f50181995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501c83e700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018108a50 0x7f501819d980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f501000b830 tx=0x7f5010004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010021070 con 0x7f5018108a50 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501819e350 con 0x7f5018108a50 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5010003c00 con 0x7f5018108a50 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010004810 con 0x7f5018108a50 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.115+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50181a5c30 con 0x7f5018108a50 2024-04-21T10:20:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.116+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5018063190 con 0x7f5018108a50 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.117+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5010003db0 con 0x7f5018108a50 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f50157fa700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50000a3cd0 0x7f50000a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f5017fff700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50000a3cd0 0x7f50000a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f501000f020 con 0x7f5018108a50 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f50157fa700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] conn(0x7f50000ad380 0x7f50000af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 --> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50100040a0 con 0x7f50000ad380 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f50100d2170 con 0x7f5018108a50 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.118+0000 7f5017fff700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50000a3cd0 0x7f50000a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5008009b50 tx=0x7f5008009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.119+0000 7f50177fe700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] conn(0x7f50000ad380 0x7f50000af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.119+0000 7f50177fe700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] conn(0x7f50000ad380 0x7f50000af7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.120+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== osd.5 v2:172.21.15.191:6808/2690785499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50100040a0 con 0x7f50000ad380 2024-04-21T10:20:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.136+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 --> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5018063590 con 0x7f50000ad380 2024-04-21T10:20:02.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f50157fa700 1 -- 172.21.15.77:0/272721747 <== osd.5 v2:172.21.15.191:6808/2690785499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5018063590 con 0x7f50000ad380 2024-04-21T10:20:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] conn(0x7f50000ad380 msgr2=0x7f50000af7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] conn(0x7f50000ad380 0x7f50000af7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50000a3cd0 msgr2=0x7f50000a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50000a3cd0 0x7f50000a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5008009b50 tx=0x7f5008009550 comp rx=0 tx=0).stop 2024-04-21T10:20:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018108a50 msgr2=0x7f501819d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 --2- 172.21.15.77:0/272721747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5018108a50 0x7f501819d980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f501000b830 tx=0x7f5010004d90 comp rx=0 tx=0).stop 2024-04-21T10:20:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501c83e700 1 -- 172.21.15.77:0/272721747 reap_dead start 2024-04-21T10:20:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 shutdown_connections 2024-04-21T10:20:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 >> 172.21.15.77:0/272721747 conn(0x7f5018079ba0 msgr2=0x7f5018101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 shutdown_connections 2024-04-21T10:20:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.137+0000 7f501e2a1700 1 -- 172.21.15.77:0/272721747 wait complete. 2024-04-21T10:20:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:01 smithi191 ceph-mon[31636]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-04-21T10:20:02.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 -- 172.21.15.77:0/2044647867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24102300 msgr2=0x7f3a2410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2044647867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24102300 0x7f3a2410e7f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b0a0 tx=0x7f3a1c00b3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 -- 172.21.15.77:0/2044647867 shutdown_connections 2024-04-21T10:20:02.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2044647867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24102300 0x7f3a2410e7f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2044647867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a24107990 0x7f3a24107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2044647867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a24101940 0x7f3a24101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 -- 172.21.15.77:0/2044647867 >> 172.21.15.77:0/2044647867 conn(0x7f3a240788f0 msgr2=0x7f3a24078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 -- 172.21.15.77:0/2044647867 shutdown_connections 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.338+0000 7f3a291ad700 1 -- 172.21.15.77:0/2044647867 wait complete. 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 Processor -- start 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 -- start start 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24101940 0x7f3a241990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a24102300 0x7f3a24199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a24107990 0x7f3a2419d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24111b60 con 0x7f3a24101940 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241119e0 con 0x7f3a24102300 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.339+0000 7f3a291ad700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24111ce0 con 0x7f3a24107990 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24101940 0x7f3a241990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24101940 0x7f3a241990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47184/0 (socket says 172.21.15.77:47184) 2024-04-21T10:20:02.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 -- 172.21.15.77:0/2113065264 learned_addr learned my addr 172.21.15.77:0/2113065264 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a2259c700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a24102300 0x7f3a24199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a2359e700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a24107990 0x7f3a2419d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 -- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a24107990 msgr2=0x7f3a2419d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a24107990 0x7f3a2419d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 -- 172.21.15.77:0/2113065264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a24102300 msgr2=0x7f3a24199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a24102300 0x7f3a24199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 -- 172.21.15.77:0/2113065264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2419e0d0 con 0x7f3a24101940 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a2359e700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a24107990 0x7f3a2419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a22d9d700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24101940 0x7f3a241990c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b530 tx=0x7f3a1400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14015020 con 0x7f3a24101940 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2419e3c0 con 0x7f3a24101940 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a14011ce0 con 0x7f3a24101940 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14010e40 con 0x7f3a24101940 2024-04-21T10:20:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.340+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241a5c40 con 0x7f3a24101940 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.341+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a24063190 con 0x7f3a24101940 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.342+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3a14018020 con 0x7f3a24101940 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a0bfff700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3a0c0a3cd0 0x7f3a0c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a2259c700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3a0c0a3cd0 0x7f3a0c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f3a140d0240 con 0x7f3a24101940 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a0bfff700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] conn(0x7f3a0c0ad4b0 0x7f3a0c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 --> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a0c0aff80 con 0x7f3a0c0ad4b0 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3a140d0720 con 0x7f3a24101940 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a2259c700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3a0c0a3cd0 0x7f3a0c0a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a24078f40 tx=0x7f3a1800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.343+0000 7f3a2359e700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] conn(0x7f3a0c0ad4b0 0x7f3a0c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.344+0000 7f3a2359e700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] conn(0x7f3a0c0ad4b0 0x7f3a0c0af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.345+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== osd.2 v2:172.21.15.191:6800/1645526465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a0c0aff80 con 0x7f3a0c0ad4b0 2024-04-21T10:20:02.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.361+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 --> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a240635c0 con 0x7f3a0c0ad4b0 2024-04-21T10:20:02.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.361+0000 7f3a0bfff700 1 -- 172.21.15.77:0/2113065264 <== osd.2 v2:172.21.15.191:6800/1645526465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a240635c0 con 0x7f3a0c0ad4b0 2024-04-21T10:20:02.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] conn(0x7f3a0c0ad4b0 msgr2=0x7f3a0c0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] conn(0x7f3a0c0ad4b0 0x7f3a0c0af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3a0c0a3cd0 msgr2=0x7f3a0c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3a0c0a3cd0 0x7f3a0c0a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a24078f40 tx=0x7f3a1800a380 comp rx=0 tx=0).stop 2024-04-21T10:20:02.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24101940 msgr2=0x7f3a241990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 --2- 172.21.15.77:0/2113065264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a24101940 0x7f3a241990c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b530 tx=0x7f3a1400b840 comp rx=0 tx=0).stop 2024-04-21T10:20:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a2359e700 1 -- 172.21.15.77:0/2113065264 reap_dead start 2024-04-21T10:20:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 shutdown_connections 2024-04-21T10:20:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 >> 172.21.15.77:0/2113065264 conn(0x7f3a240788f0 msgr2=0x7f3a2406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 shutdown_connections 2024-04-21T10:20:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.362+0000 7f3a291ad700 1 -- 172.21.15.77:0/2113065264 wait complete. 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 -- 172.21.15.77:0/3390973384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 msgr2=0x7fa46810f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/3390973384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa46810f8b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa460009990 tx=0x7fa460009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 -- 172.21.15.77:0/3390973384 shutdown_connections 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/3390973384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa468108a50 0x7fa468108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/3390973384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa46810f8b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/3390973384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa468102a90 0x7fa468102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 -- 172.21.15.77:0/3390973384 >> 172.21.15.77:0/3390973384 conn(0x7fa468079ba0 msgr2=0x7fa468079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 -- 172.21.15.77:0/3390973384 shutdown_connections 2024-04-21T10:20:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 -- 172.21.15.77:0/3390973384 wait complete. 2024-04-21T10:20:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.844+0000 7fa46e0b2700 1 Processor -- start 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 -- start start 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa468102a90 0x7fa468074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa468075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa468108a50 0x7fa4680757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa468112ce0 con 0x7fa468103450 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa468112b60 con 0x7fa468108a50 2024-04-21T10:20:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa46e0b2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa468112e60 con 0x7fa468102a90 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa468075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa468075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47206/0 (socket says 172.21.15.77:47206) 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 -- 172.21.15.77:0/702784552 learned_addr learned my addr 172.21.15.77:0/702784552 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 -- 172.21.15.77:0/702784552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa468102a90 msgr2=0x7fa468074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa4677fe700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa468102a90 0x7fa468074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa468102a90 0x7fa468074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 -- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa468108a50 msgr2=0x7fa4680757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa467fff700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa468108a50 0x7fa4680757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa468108a50 0x7fa4680757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 -- 172.21.15.77:0/702784552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4681a7780 con 0x7fa468103450 2024-04-21T10:20:02.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa4677fe700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa468102a90 0x7fa468074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa466ffd700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa468075280 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00b530 tx=0x7fa45c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.845+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c015020 con 0x7fa468103450 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.846+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4681a7a70 con 0x7fa468103450 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.846+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa45c011ce0 con 0x7fa468103450 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.846+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c010d20 con 0x7fa468103450 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.846+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4681a7fb0 con 0x7fa468103450 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.846+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4680630d0 con 0x7fa468103450 2024-04-21T10:20:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.848+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa45c018020 con 0x7fa468103450 2024-04-21T10:20:02.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.848+0000 7fa464ff9700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4500a3cd0 0x7fa4500a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.848+0000 7fa4677fe700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4500a3cd0 0x7fa4500a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.848+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fa45c0d01e0 con 0x7fa468103450 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.848+0000 7fa464ff9700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] conn(0x7fa4500ad4b0 0x7fa4500af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.849+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 --> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa45c01deb0 con 0x7fa4500ad4b0 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.849+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa45c0d06c0 con 0x7fa468103450 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.849+0000 7fa4677fe700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4500a3cd0 0x7fa4500a6190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa458007eb0 tx=0x7fa4580073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.849+0000 7fa467fff700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] conn(0x7fa4500ad4b0 0x7fa4500af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.849+0000 7fa467fff700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] conn(0x7fa4500ad4b0 0x7fa4500af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:02.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.850+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== osd.4 v2:172.21.15.170:6808/3749271051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa45c01deb0 con 0x7fa4500ad4b0 2024-04-21T10:20:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.866+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 --> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa468063550 con 0x7fa4500ad4b0 2024-04-21T10:20:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.866+0000 7fa464ff9700 1 -- 172.21.15.77:0/702784552 <== osd.4 v2:172.21.15.170:6808/3749271051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa468063550 con 0x7fa4500ad4b0 2024-04-21T10:20:02.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] conn(0x7fa4500ad4b0 msgr2=0x7fa4500af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] conn(0x7fa4500ad4b0 0x7fa4500af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4500a3cd0 msgr2=0x7fa4500a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4500a3cd0 0x7fa4500a6190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa458007eb0 tx=0x7fa4580073c0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 msgr2=0x7fa468075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:02.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 --2- 172.21.15.77:0/702784552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa468103450 0x7fa468075280 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00b530 tx=0x7fa45c00b8f0 comp rx=0 tx=0).stop 2024-04-21T10:20:02.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa467fff700 1 -- 172.21.15.77:0/702784552 reap_dead start 2024-04-21T10:20:02.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 shutdown_connections 2024-04-21T10:20:02.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 >> 172.21.15.77:0/702784552 conn(0x7fa468079ba0 msgr2=0x7fa468101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:02.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 shutdown_connections 2024-04-21T10:20:02.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:02.867+0000 7fa46e0b2700 1 -- 172.21.15.77:0/702784552 wait complete. 2024-04-21T10:20:03.777 INFO:teuthology.orchestra.run.smithi077.stdout:219043332138 2024-04-21T10:20:03.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-21T10:20:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 -- 172.21.15.77:0/2080557711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 msgr2=0x7fc978101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 --2- 172.21.15.77:0/2080557711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978101dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009990 tx=0x7fc96c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 -- 172.21.15.77:0/2080557711 shutdown_connections 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 --2- 172.21.15.77:0/2080557711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc978107990 0x7fc978107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 --2- 172.21.15.77:0/2080557711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc978102300 0x7fc97810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 --2- 172.21.15.77:0/2080557711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978101dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 -- 172.21.15.77:0/2080557711 >> 172.21.15.77:0/2080557711 conn(0x7fc9780788f0 msgr2=0x7fc978078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 -- 172.21.15.77:0/2080557711 shutdown_connections 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:03.999+0000 7fc97d44e700 1 -- 172.21.15.77:0/2080557711 wait complete. 2024-04-21T10:20:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 Processor -- start 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 -- start start 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc978102300 0x7fc978199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc978107990 0x7fc97819da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111af0 con 0x7fc978101940 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111970 con 0x7fc978102300 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc97d44e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111c70 con 0x7fc978107990 2024-04-21T10:20:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc976ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc976ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47220/0 (socket says 172.21.15.77:47220) 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc976ffd700 1 -- 172.21.15.77:0/1933856019 learned_addr learned my addr 172.21.15.77:0/1933856019 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc9767fc700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc978102300 0x7fc978199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.000+0000 7fc9777fe700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc978107990 0x7fc97819da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc976ffd700 1 -- 172.21.15.77:0/1933856019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc978107990 msgr2=0x7fc97819da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc976ffd700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc978107990 0x7fc97819da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc976ffd700 1 -- 172.21.15.77:0/1933856019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc978102300 msgr2=0x7fc978199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc976ffd700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc978102300 0x7fc978199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc976ffd700 1 -- 172.21.15.77:0/1933856019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97819e150 con 0x7fc978101940 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc9777fe700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc978107990 0x7fc97819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc976ffd700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978199140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc96800e9a0 tx=0x7fc96800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:04.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:03 smithi077 ceph-mon[27902]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T10:20:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96800cbd0 con 0x7fc978101940 2024-04-21T10:20:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97819e440 con 0x7fc978101940 2024-04-21T10:20:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96800cd70 con 0x7fc978101940 2024-04-21T10:20:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9781a5cc0 con 0x7fc978101940 2024-04-21T10:20:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.001+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968018680 con 0x7fc978101940 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.002+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc978063150 con 0x7fc978101940 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.003+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc968010430 con 0x7fc978101940 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc95ffff700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc9600a3cd0 0x7fc9600a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc9767fc700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc9600a3cd0 0x7fc9600a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc9680d1120 con 0x7fc978101940 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc95ffff700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] conn(0x7fc9600ad4b0 0x7fc9600af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 --> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9600aff80 con 0x7fc9600ad4b0 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc9680d1600 con 0x7fc978101940 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc9777fe700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] conn(0x7fc9600ad4b0 0x7fc9600af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc9767fc700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc9600a3cd0 0x7fc9600a6190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0098e0 tx=0x7fc96c005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.004+0000 7fc9777fe700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] conn(0x7fc9600ad4b0 0x7fc9600af8d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.005+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== osd.9 v2:172.21.15.77:6826/2816502344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9600aff80 con 0x7fc9600ad4b0 2024-04-21T10:20:04.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.021+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 --> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc978063580 con 0x7fc9600ad4b0 2024-04-21T10:20:04.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc95ffff700 1 -- 172.21.15.77:0/1933856019 <== osd.9 v2:172.21.15.77:6826/2816502344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc978063580 con 0x7fc9600ad4b0 2024-04-21T10:20:04.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] conn(0x7fc9600ad4b0 msgr2=0x7fc9600af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] conn(0x7fc9600ad4b0 0x7fc9600af8d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc9600a3cd0 msgr2=0x7fc9600a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc9600a3cd0 0x7fc9600a6190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0098e0 tx=0x7fc96c005960 comp rx=0 tx=0).stop 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 msgr2=0x7fc978199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 --2- 172.21.15.77:0/1933856019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc978101940 0x7fc978199140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc96800e9a0 tx=0x7fc96800ecb0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc9777fe700 1 -- 172.21.15.77:0/1933856019 reap_dead start 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 shutdown_connections 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 >> 172.21.15.77:0/1933856019 conn(0x7fc9780788f0 msgr2=0x7fc97806ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 shutdown_connections 2024-04-21T10:20:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.022+0000 7fc97d44e700 1 -- 172.21.15.77:0/1933856019 wait complete. 2024-04-21T10:20:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:03 smithi170 ceph-mon[31212]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T10:20:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:03 smithi191 ceph-mon[31636]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 -- 172.21.15.77:0/1991233762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8102300 msgr2=0x7fccc810e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 --2- 172.21.15.77:0/1991233762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8102300 0x7fccc810e7f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fccc000b0a0 tx=0x7fccc000b3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 -- 172.21.15.77:0/1991233762 shutdown_connections 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 --2- 172.21.15.77:0/1991233762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8102300 0x7fccc810e7f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 --2- 172.21.15.77:0/1991233762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc8107990 0x7fccc8107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 --2- 172.21.15.77:0/1991233762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccc8101940 0x7fccc8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 -- 172.21.15.77:0/1991233762 >> 172.21.15.77:0/1991233762 conn(0x7fccc80788f0 msgr2=0x7fccc8078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 -- 172.21.15.77:0/1991233762 shutdown_connections 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.233+0000 7fcccf110700 1 -- 172.21.15.77:0/1991233762 wait complete. 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 Processor -- start 2024-04-21T10:20:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 -- start start 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc8101940 0x7fccc819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccc8102300 0x7fccc819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8107990 0x7fccc81a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8111bd0 con 0x7fccc8107990 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8111a50 con 0x7fccc8102300 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccf110700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8111d50 con 0x7fccc8101940 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8107990 0x7fccc81a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8107990 0x7fccc81a50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47234/0 (socket says 172.21.15.77:47234) 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 -- 172.21.15.77:0/1649280713 learned_addr learned my addr 172.21.15.77:0/1649280713 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccceac700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc8101940 0x7fccc819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fccc7fff700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccc8102300 0x7fccc819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 -- 172.21.15.77:0/1649280713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc8101940 msgr2=0x7fccc819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc8101940 0x7fccc819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 -- 172.21.15.77:0/1649280713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccc8102300 msgr2=0x7fccc819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccc8102300 0x7fccc819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fcccd6ad700 1 -- 172.21.15.77:0/1649280713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc8197e40 con 0x7fccc8107990 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.234+0000 7fccc7fff700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccc8102300 0x7fccc819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.235+0000 7fcccd6ad700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8107990 0x7fccc81a50d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fccc00062a0 tx=0x7fccc0004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.235+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0021070 con 0x7fccc8107990 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.235+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc81980d0 con 0x7fccc8107990 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.235+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc0007c80 con 0x7fccc8107990 2024-04-21T10:20:04.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.235+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc001d450 con 0x7fccc8107990 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.235+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc8198660 con 0x7fccc8107990 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.236+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccc8063150 con 0x7fccc8107990 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.237+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fccc0004000 con 0x7fccc8107990 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.238+0000 7fccc5ffb700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccb80a3d50 0x7fccb80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.238+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fccc000f020 con 0x7fccc8107990 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.238+0000 7fcccceac700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccb80a3d50 0x7fccb80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.238+0000 7fccc5ffb700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] conn(0x7fccb80ad530 0x7fccb80af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.238+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 --> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccc002ee50 con 0x7fccb80ad530 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.238+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fccc00d20f0 con 0x7fccc8107990 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.239+0000 7fccc7fff700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] conn(0x7fccb80ad530 0x7fccb80af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.239+0000 7fcccceac700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccb80a3d50 0x7fccb80a6210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009a10 tx=0x7fccbc009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.239+0000 7fccc7fff700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] conn(0x7fccb80ad530 0x7fccb80af950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:04.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.240+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== osd.3 v2:172.21.15.77:6810/2907599341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccc002ee50 con 0x7fccb80ad530 2024-04-21T10:20:04.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.257+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 --> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccc8063550 con 0x7fccb80ad530 2024-04-21T10:20:04.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.257+0000 7fccc5ffb700 1 -- 172.21.15.77:0/1649280713 <== osd.3 v2:172.21.15.77:6810/2907599341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fccc8063550 con 0x7fccb80ad530 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] conn(0x7fccb80ad530 msgr2=0x7fccb80af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] conn(0x7fccb80ad530 0x7fccb80af950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccb80a3d50 msgr2=0x7fccb80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fccb80a3d50 0x7fccb80a6210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009a10 tx=0x7fccbc009190 comp rx=0 tx=0).stop 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8107990 msgr2=0x7fccc81a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 --2- 172.21.15.77:0/1649280713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccc8107990 0x7fccc81a50d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fccc00062a0 tx=0x7fccc0004e20 comp rx=0 tx=0).stop 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccd6ad700 1 -- 172.21.15.77:0/1649280713 reap_dead start 2024-04-21T10:20:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 shutdown_connections 2024-04-21T10:20:04.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 >> 172.21.15.77:0/1649280713 conn(0x7fccc80788f0 msgr2=0x7fccc80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:04.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 shutdown_connections 2024-04-21T10:20:04.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:04.258+0000 7fcccf110700 1 -- 172.21.15.77:0/1649280713 wait complete. 2024-04-21T10:20:05.192 INFO:teuthology.orchestra.run.smithi077.stdout:287762808864 2024-04-21T10:20:05.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-21T10:20:05.970 INFO:teuthology.orchestra.run.smithi077.stdout:343597383701 2024-04-21T10:20:05.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-21T10:20:06.052 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:05 smithi077 ceph-mon[27902]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:05 smithi170 ceph-mon[31212]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:06.086 INFO:teuthology.orchestra.run.smithi077.stdout:197568495662 2024-04-21T10:20:06.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-21T10:20:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:05 smithi191 ceph-mon[31636]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:06.935 INFO:teuthology.orchestra.run.smithi077.stdout:77309411395 2024-04-21T10:20:06.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-21T10:20:07.530 INFO:teuthology.orchestra.run.smithi077.stdout:163208757301 2024-04-21T10:20:07.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-21T10:20:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:07 smithi170 ceph-mon[31212]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:20:08.070 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:07 smithi077 ceph-mon[27902]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:20:08.071 INFO:teuthology.orchestra.run.smithi077.stdout:141733920825 2024-04-21T10:20:08.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-21T10:20:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:07 smithi191 ceph-mon[31636]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:20:08.566 INFO:teuthology.orchestra.run.smithi077.stdout:107374182464 2024-04-21T10:20:08.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-21T10:20:08.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.823+0000 7f61d7195700 1 -- 172.21.15.77:0/1295656087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 msgr2=0x7f61d0115650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:08.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.823+0000 7f61d7195700 1 --2- 172.21.15.77:0/1295656087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 0x7f61d0115650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009990 tx=0x7f61bc009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.824+0000 7f61d7195700 1 -- 172.21.15.77:0/1295656087 shutdown_connections 2024-04-21T10:20:08.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.824+0000 7f61d7195700 1 --2- 172.21.15.77:0/1295656087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0109a40 0x7f61d0109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.824+0000 7f61d7195700 1 --2- 172.21.15.77:0/1295656087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61d0115b90 0x7f61d0117f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.824+0000 7f61d7195700 1 --2- 172.21.15.77:0/1295656087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 0x7f61d0115650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.824+0000 7f61d7195700 1 -- 172.21.15.77:0/1295656087 >> 172.21.15.77:0/1295656087 conn(0x7f61d006dbb0 msgr2=0x7f61d006dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:08.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.829+0000 7f61d7195700 1 -- 172.21.15.77:0/1295656087 shutdown_connections 2024-04-21T10:20:08.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.831+0000 7f61d7195700 1 -- 172.21.15.77:0/1295656087 wait complete. 2024-04-21T10:20:08.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.833+0000 7f61d7195700 1 Processor -- start 2024-04-21T10:20:08.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.833+0000 7f61d7195700 1 -- start start 2024-04-21T10:20:08.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.833+0000 7f61d7195700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61d0109a40 0x7f61d01a8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:08.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d7195700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 0x7f61d01a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:08.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d7195700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0115b90 0x7f61d01ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:08.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d7195700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61d0121bd0 con 0x7f61d010a360 2024-04-21T10:20:08.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d7195700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61d0121a50 con 0x7f61d0115b90 2024-04-21T10:20:08.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d7195700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f61d0121d50 con 0x7f61d0109a40 2024-04-21T10:20:08.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d5732700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0115b90 0x7f61d01ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:08.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d5732700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0115b90 0x7f61d01ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:53956/0 (socket says 172.21.15.77:53956) 2024-04-21T10:20:08.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.834+0000 7f61d5732700 1 -- 172.21.15.77:0/3302741965 learned_addr learned my addr 172.21.15.77:0/3302741965 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:08.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.835+0000 7f61d4f31700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61d0109a40 0x7f61d01a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:08.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.835+0000 7f61cffff700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 0x7f61d01a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.835+0000 7f61d5732700 1 -- 172.21.15.77:0/3302741965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61d0109a40 msgr2=0x7f61d01a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.835+0000 7f61d5732700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61d0109a40 0x7f61d01a8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.835+0000 7f61d5732700 1 -- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 msgr2=0x7f61d01a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.835+0000 7f61d5732700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 0x7f61d01a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.836+0000 7f61d5732700 1 -- 172.21.15.77:0/3302741965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d01ad070 con 0x7f61d0115b90 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.836+0000 7f61d4f31700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61d0109a40 0x7f61d01a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:08.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.836+0000 7f61d5732700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0115b90 0x7f61d01ac930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61c800b780 tx=0x7f61c800bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:08.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.839+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c800f840 con 0x7f61d0115b90 2024-04-21T10:20:08.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.839+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61c8017400 con 0x7f61d0115b90 2024-04-21T10:20:08.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.839+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d01ad360 con 0x7f61d0115b90 2024-04-21T10:20:08.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.840+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d01b4be0 con 0x7f61d0115b90 2024-04-21T10:20:08.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.840+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c800d5f0 con 0x7f61d0115b90 2024-04-21T10:20:08.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.842+0000 7f61cffff700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d010a360 0x7f61d01a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:08.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.844+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61b4001030 con 0x7f61d0115b90 2024-04-21T10:20:08.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.844+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f61c80175b0 con 0x7f61d0115b90 2024-04-21T10:20:08.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.845+0000 7f61cdffb700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f61c00a3ef0 0x7f61c00a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:08.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.846+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f61c80d0100 con 0x7f61d0115b90 2024-04-21T10:20:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.846+0000 7f61cdffb700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] conn(0x7f61c00ad6d0 0x7f61c00afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.846+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 --> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61c8014e70 con 0x7f61c00ad6d0 2024-04-21T10:20:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.846+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f61c80d7050 con 0x7f61d0115b90 2024-04-21T10:20:08.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.847+0000 7f61d4f31700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f61c00a3ef0 0x7f61c00a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:08.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.848+0000 7f61cffff700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] conn(0x7f61c00ad6d0 0x7f61c00afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:08.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.848+0000 7f61d4f31700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f61c00a3ef0 0x7f61c00a63b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009be0 tx=0x7f61c4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:08.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.848+0000 7f61cffff700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] conn(0x7f61c00ad6d0 0x7f61c00afaf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:08.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.850+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== osd.0 v2:172.21.15.77:6802/2965386112 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61c8014e70 con 0x7f61c00ad6d0 2024-04-21T10:20:08.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.876+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 --> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61b4002e60 con 0x7f61c00ad6d0 2024-04-21T10:20:08.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.876+0000 7f61cdffb700 1 -- 172.21.15.77:0/3302741965 <== osd.0 v2:172.21.15.77:6802/2965386112 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f61b4002e60 con 0x7f61c00ad6d0 2024-04-21T10:20:08.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] conn(0x7f61c00ad6d0 msgr2=0x7f61c00afaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:08.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] conn(0x7f61c00ad6d0 0x7f61c00afaf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f61c00a3ef0 msgr2=0x7f61c00a63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f61c00a3ef0 0x7f61c00a63b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009be0 tx=0x7f61c4009260 comp rx=0 tx=0).stop 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0115b90 msgr2=0x7f61d01ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 --2- 172.21.15.77:0/3302741965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61d0115b90 0x7f61d01ac930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61c800b780 tx=0x7f61c800bb40 comp rx=0 tx=0).stop 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d5732700 1 -- 172.21.15.77:0/3302741965 reap_dead start 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 shutdown_connections 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 >> 172.21.15.77:0/3302741965 conn(0x7f61d006dbb0 msgr2=0x7f61d0071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 shutdown_connections 2024-04-21T10:20:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:08.877+0000 7f61d7195700 1 -- 172.21.15.77:0/3302741965 wait complete. 2024-04-21T10:20:09.582 INFO:teuthology.orchestra.run.smithi077.stdout:34359738447 2024-04-21T10:20:09.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-21T10:20:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.600 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.600 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.602 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:09 smithi170 ceph-mon[31212]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T10:20:10.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:09 smithi077 ceph-mon[27902]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T10:20:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:09 smithi191 ceph-mon[31636]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T10:20:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:11 smithi077 ceph-mon[27902]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T10:20:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:11 smithi191 ceph-mon[31636]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T10:20:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:11 smithi170 ceph-mon[31212]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T10:20:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:13 smithi077 ceph-mon[27902]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 -- 172.21.15.77:0/209141094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988107990 msgr2=0x7f2988107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 --2- 172.21.15.77:0/209141094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988107990 0x7f2988107d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f297c009990 tx=0x7f297c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 -- 172.21.15.77:0/209141094 shutdown_connections 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 --2- 172.21.15.77:0/209141094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2988102300 0x7f298810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 --2- 172.21.15.77:0/209141094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988107990 0x7f2988107d70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 --2- 172.21.15.77:0/209141094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988101940 0x7f2988101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 -- 172.21.15.77:0/209141094 >> 172.21.15.77:0/209141094 conn(0x7f29880788f0 msgr2=0x7f2988078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 -- 172.21.15.77:0/209141094 shutdown_connections 2024-04-21T10:20:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 -- 172.21.15.77:0/209141094 wait complete. 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.020+0000 7f298df7e700 1 Processor -- start 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 -- start start 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 0x7f2988199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988102300 0x7f298819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2988107990 0x7f29881a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2988111b60 con 0x7f2988101940 2024-04-21T10:20:14.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f29881119e0 con 0x7f2988102300 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f298df7e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2988111ce0 con 0x7f2988107990 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f29877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 0x7f2988199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f29877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 0x7f2988199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36386/0 (socket says 172.21.15.77:36386) 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f29877fe700 1 -- 172.21.15.77:0/343680083 learned_addr learned my addr 172.21.15.77:0/343680083 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f2987fff700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2988107990 0x7f29881a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.021+0000 7f2986ffd700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988102300 0x7f298819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f29877fe700 1 -- 172.21.15.77:0/343680083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2988107990 msgr2=0x7f29881a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f29877fe700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2988107990 0x7f29881a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f29877fe700 1 -- 172.21.15.77:0/343680083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988102300 msgr2=0x7f298819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f29877fe700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988102300 0x7f298819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f29877fe700 1 -- 172.21.15.77:0/343680083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29881a5580 con 0x7f2988101940 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f2986ffd700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988102300 0x7f298819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:14.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f29877fe700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 0x7f2988199fc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f297c000c00 tx=0x7f297c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:14.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c027070 con 0x7f2988101940 2024-04-21T10:20:14.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f297c0040e0 con 0x7f2988101940 2024-04-21T10:20:14.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29881a5750 con 0x7f2988101940 2024-04-21T10:20:14.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c00f460 con 0x7f2988101940 2024-04-21T10:20:14.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.022+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29881a5c00 con 0x7f2988101940 2024-04-21T10:20:14.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.023+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2988109eb0 con 0x7f2988101940 2024-04-21T10:20:14.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.024+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f297c02a070 con 0x7f2988101940 2024-04-21T10:20:14.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.025+0000 7f2984ff9700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f29700a3d50 0x7f29700a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:14.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.025+0000 7f2986ffd700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f29700a3d50 0x7f29700a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:14.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.025+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f297c0d1420 con 0x7f2988101940 2024-04-21T10:20:14.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.026+0000 7f2986ffd700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f29700a3d50 0x7f29700a6210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2988078fd0 tx=0x7f2978005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:14.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.032+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f297c05eff0 con 0x7f2988101940 2024-04-21T10:20:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:13 smithi191 ceph-mon[31636]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:14.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.239+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2988109890 con 0x7f2988101940 2024-04-21T10:20:14.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.239+0000 7f2984ff9700 1 -- 172.21.15.77:0/343680083 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f297c013070 con 0x7f2988101940 2024-04-21T10:20:14.240 INFO:teuthology.orchestra.run.smithi077.stdout:77309411397 2024-04-21T10:20:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f29700a3d50 msgr2=0x7f29700a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f29700a3d50 0x7f29700a6210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2988078fd0 tx=0x7f2978005f50 comp rx=0 tx=0).stop 2024-04-21T10:20:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 msgr2=0x7f2988199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 0x7f2988199fc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f297c000c00 tx=0x7f297c0047b0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 shutdown_connections 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f29700a3d50 0x7f29700a6210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2988107990 0x7f29881a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2988101940 0x7f2988199fc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 --2- 172.21.15.77:0/343680083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2988102300 0x7f298819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.242+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 >> 172.21.15.77:0/343680083 conn(0x7f29880788f0 msgr2=0x7f29881007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.243+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 shutdown_connections 2024-04-21T10:20:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:14.243+0000 7f298df7e700 1 -- 172.21.15.77:0/343680083 wait complete. 2024-04-21T10:20:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:13 smithi170 ceph-mon[31212]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/343680083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-21T10:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-21T10:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-21T10:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-21T10:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-04-21T10:20:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-21T10:20:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-04-21T10:20:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-21T10:20:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:14 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-21T10:20:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/343680083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-21T10:20:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-21T10:20:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-21T10:20:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-21T10:20:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-04-21T10:20:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-21T10:20:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-04-21T10:20:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-21T10:20:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:14 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-21T10:20:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/343680083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-21T10:20:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:14 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-21T10:20:15.840 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411397 for osd.2 2024-04-21T10:20:15.841 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T10:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-21T10:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-21T10:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-21T10:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-04-21T10:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-21T10:20:16.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-04-21T10:20:16.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-21T10:20:16.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-21T10:20:16.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:15 smithi077 ceph-mon[27902]: osdmap e86: 12 total, 12 up, 12 in 2024-04-21T10:20:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T10:20:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-21T10:20:16.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:15 smithi191 ceph-mon[31636]: osdmap e86: 12 total, 12 up, 12 in 2024-04-21T10:20:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T10:20:16.334 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-21T10:20:16.334 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-21T10:20:16.334 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-21T10:20:16.334 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-04-21T10:20:16.334 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-21T10:20:16.334 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-04-21T10:20:16.335 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-21T10:20:16.335 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-21T10:20:16.335 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:15 smithi170 ceph-mon[31212]: osdmap e86: 12 total, 12 up, 12 in 2024-04-21T10:20:17.013 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:16 smithi077 ceph-mon[27902]: osdmap e87: 12 total, 12 up, 12 in 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 -- 172.21.15.77:0/4181474465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504107b20 msgr2=0x7f0504107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 --2- 172.21.15.77:0/4181474465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504107b20 0x7f0504107f00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009990 tx=0x7f04f4009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 -- 172.21.15.77:0/4181474465 shutdown_connections 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 --2- 172.21.15.77:0/4181474465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0504101dc0 0x7f050410f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 --2- 172.21.15.77:0/4181474465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504107b20 0x7f0504107f00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 --2- 172.21.15.77:0/4181474465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0504101400 0x7f0504101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 -- 172.21.15.77:0/4181474465 >> 172.21.15.77:0/4181474465 conn(0x7f0504076c60 msgr2=0x7f0504077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 -- 172.21.15.77:0/4181474465 shutdown_connections 2024-04-21T10:20:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.126+0000 7f05093dc700 1 -- 172.21.15.77:0/4181474465 wait complete. 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 Processor -- start 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 -- start start 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 0x7f0504199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0504101dc0 0x7f0504199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0504107b20 0x7f050419d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112cb0 con 0x7f0504101400 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112b30 con 0x7f0504101dc0 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05093dc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112e30 con 0x7f0504107b20 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f0502ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 0x7f0504199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f0502ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 0x7f0504199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36410/0 (socket says 172.21.15.77:36410) 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f0502ffd700 1 -- 172.21.15.77:0/1925239128 learned_addr learned my addr 172.21.15.77:0/1925239128 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.127+0000 7f05037fe700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0504107b20 0x7f050419d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f05027fc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0504101dc0 0x7f0504199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f0502ffd700 1 -- 172.21.15.77:0/1925239128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0504107b20 msgr2=0x7f050419d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f0502ffd700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0504107b20 0x7f050419d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f0502ffd700 1 -- 172.21.15.77:0/1925239128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0504101dc0 msgr2=0x7f0504199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f0502ffd700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0504101dc0 0x7f0504199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f0502ffd700 1 -- 172.21.15.77:0/1925239128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050419e110 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f0502ffd700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 0x7f0504199100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f04f4000c00 tx=0x7f04f4003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4027070 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050419e3a0 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05041a5c80 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f4004160 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.128+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4022d80 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.129+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f0005330 con 0x7f0504101400 2024-04-21T10:20:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.130+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f04f402a070 con 0x7f0504101400 2024-04-21T10:20:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.131+0000 7f04ebfff700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f04ec0a3cd0 0x7f04ec0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.131+0000 7f05027fc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f04ec0a3cd0 0x7f04ec0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.131+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f04f40d1ac0 con 0x7f0504101400 2024-04-21T10:20:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.131+0000 7f05027fc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f04ec0a3cd0 0x7f04ec0a6190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005ea0 tx=0x7f04f8005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.134+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f04f4031020 con 0x7f0504101400 2024-04-21T10:20:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:16 smithi191 ceph-mon[31636]: osdmap e87: 12 total, 12 up, 12 in 2024-04-21T10:20:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:16 smithi170 ceph-mon[31212]: osdmap e87: 12 total, 12 up, 12 in 2024-04-21T10:20:17.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.337+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f04f00058f0 con 0x7f0504101400 2024-04-21T10:20:17.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.337+0000 7f04ebfff700 1 -- 172.21.15.77:0/1925239128 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f04f4013070 con 0x7f0504101400 2024-04-21T10:20:17.337 INFO:teuthology.orchestra.run.smithi077.stdout:287762808866 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f04ec0a3cd0 msgr2=0x7f04ec0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f04ec0a3cd0 0x7f04ec0a6190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005ea0 tx=0x7f04f8005e30 comp rx=0 tx=0).stop 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 msgr2=0x7f0504199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 0x7f0504199100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f04f4000c00 tx=0x7f04f4003680 comp rx=0 tx=0).stop 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 shutdown_connections 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f04ec0a3cd0 0x7f04ec0a6190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0504107b20 0x7f050419d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0504101400 0x7f0504199100 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 --2- 172.21.15.77:0/1925239128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0504101dc0 0x7f0504199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 >> 172.21.15.77:0/1925239128 conn(0x7f0504076c60 msgr2=0x7f05040ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:17.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 shutdown_connections 2024-04-21T10:20:17.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:17.339+0000 7f05093dc700 1 -- 172.21.15.77:0/1925239128 wait complete. 2024-04-21T10:20:18.024 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:17 smithi077 ceph-mon[27902]: pgmap v318: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T10:20:18.025 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:17 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1925239128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-21T10:20:18.052 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808864 got 287762808866 for osd.9 2024-04-21T10:20:18.052 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:17 smithi191 ceph-mon[31636]: pgmap v318: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T10:20:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:17 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1925239128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-21T10:20:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:17 smithi170 ceph-mon[31212]: pgmap v318: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T10:20:18.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:17 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1925239128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-21T10:20:19.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/664116112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 msgr2=0x7fc5f010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:19.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/664116112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f010e7f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800b0a0 tx=0x7fc5e800b3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:19.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/664116112 shutdown_connections 2024-04-21T10:20:19.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/664116112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f010e7f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:19.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/664116112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0107990 0x7fc5f0107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:19.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/664116112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5f0101940 0x7fc5f0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:19.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/664116112 >> 172.21.15.77:0/664116112 conn(0x7fc5f00788f0 msgr2=0x7fc5f0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:19.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/664116112 shutdown_connections 2024-04-21T10:20:19.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/664116112 wait complete. 2024-04-21T10:20:19.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.893+0000 7fc5f5a2d700 1 Processor -- start 2024-04-21T10:20:19.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 -- start start 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0101940 0x7fc5f01034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f0103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5f0107990 0x7fc5f0103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f0111b60 con 0x7fc5f0102300 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f01119e0 con 0x7fc5f0107990 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5f5a2d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f0111ce0 con 0x7fc5f0101940 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f0103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f0103a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36456/0 (socket says 172.21.15.77:36456) 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 -- 172.21.15.77:0/2205610564 learned_addr learned my addr 172.21.15.77:0/2205610564 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5eeffd700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0101940 0x7fc5f01034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ef7fe700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5f0107990 0x7fc5f0103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 -- 172.21.15.77:0/2205610564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0101940 msgr2=0x7fc5f01034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:19.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0101940 0x7fc5f01034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 -- 172.21.15.77:0/2205610564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5f0107990 msgr2=0x7fc5f0103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5f0107990 0x7fc5f0103f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5ee7fc700 1 -- 172.21.15.77:0/2205610564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f01a7670 con 0x7fc5f0102300 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.894+0000 7fc5eeffd700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0101940 0x7fc5f01034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.895+0000 7fc5ee7fc700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f0103a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400c920 tx=0x7fc5e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.895+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4007b00 con 0x7fc5f0102300 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.895+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5e4004ce0 con 0x7fc5f0102300 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.895+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4005650 con 0x7fc5f0102300 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.895+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f01a7960 con 0x7fc5f0102300 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.895+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f01a7e50 con 0x7fc5f0102300 2024-04-21T10:20:19.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.896+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f0069730 con 0x7fc5f0102300 2024-04-21T10:20:19.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.897+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc5e4004750 con 0x7fc5f0102300 2024-04-21T10:20:19.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.898+0000 7fc5f4a2b700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc5d80a3d50 0x7fc5d80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:19.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.898+0000 7fc5eeffd700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc5d80a3d50 0x7fc5d80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:19.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.898+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc5e40d0640 con 0x7fc5f0102300 2024-04-21T10:20:19.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.898+0000 7fc5eeffd700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc5d80a3d50 0x7fc5d80a6210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00099d0 tx=0x7fc5e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:19.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.901+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc5e4014030 con 0x7fc5f0102300 2024-04-21T10:20:20.002 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:19 smithi077 ceph-mon[27902]: pgmap v319: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-21T10:20:20.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 -- 172.21.15.77:0/113136376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c1079c0 msgr2=0x7fb00c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 --2- 172.21.15.77:0/113136376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c1079c0 0x7fb00c107da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb000009990 tx=0x7fb000009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 -- 172.21.15.77:0/113136376 shutdown_connections 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 --2- 172.21.15.77:0/113136376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb00c102600 0x7fb00c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 --2- 172.21.15.77:0/113136376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c1079c0 0x7fb00c107da0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 --2- 172.21.15.77:0/113136376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb00c101c40 0x7fb00c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 -- 172.21.15.77:0/113136376 >> 172.21.15.77:0/113136376 conn(0x7fb00c078740 msgr2=0x7fb00c078b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 -- 172.21.15.77:0/113136376 shutdown_connections 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.782+0000 7fb0130b5700 1 -- 172.21.15.77:0/113136376 wait complete. 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 Processor -- start 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 -- start start 2024-04-21T10:20:20.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb00c101c40 0x7fb00c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 0x7fb00c199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb00c1079c0 0x7fb00c19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c111c00 con 0x7fb00c102600 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c111a80 con 0x7fb00c101c40 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb0130b5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c111d80 con 0x7fb00c1079c0 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 0x7fb00c199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 0x7fb00c199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36426/0 (socket says 172.21.15.77:36426) 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 -- 172.21.15.77:0/3926691596 learned_addr learned my addr 172.21.15.77:0/3926691596 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb011652700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb00c1079c0 0x7fb00c19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:20.025 INFO:teuthology.orchestra.run.smithi077.stdout:219043332141 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 -- 172.21.15.77:0/3926691596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb00c1079c0 msgr2=0x7fb00c19da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb00c1079c0 0x7fb00c19da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 -- 172.21.15.77:0/3926691596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb00c101c40 msgr2=0x7fb00c1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb010e51700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb00c101c40 0x7fb00c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb00c101c40 0x7fb00c1991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.783+0000 7fb00bfff700 1 -- 172.21.15.77:0/3926691596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c19e1d0 con 0x7fb00c102600 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.784+0000 7fb00bfff700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 0x7fb00c199700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faff800b530 tx=0x7faff800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.784+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8015020 con 0x7fb00c102600 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.784+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c19e4c0 con 0x7fb00c102600 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.784+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff8011ce0 con 0x7fb00c102600 2024-04-21T10:20:20.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.784+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8010d20 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.784+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c1a5d40 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.785+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00c069730 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.786+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7faff8018020 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.786+0000 7fb009ffb700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7faffc0a3cd0 0x7faffc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.786+0000 7fb010e51700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7faffc0a3cd0 0x7faffc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.786+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7faff80cfcb0 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.787+0000 7fb010e51700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7faffc0a3cd0 0x7faffc0a6190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b5c0 tx=0x7fb000005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:19.791+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faff801f020 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.002+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb00c1a5f70 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.002+0000 7fb009ffb700 1 -- 172.21.15.77:0/3926691596 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faff809c650 con 0x7fb00c102600 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7faffc0a3cd0 msgr2=0x7faffc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7faffc0a3cd0 0x7faffc0a6190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b5c0 tx=0x7fb000005fd0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 msgr2=0x7fb00c199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 0x7fb00c199700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faff800b530 tx=0x7faff800b8f0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 shutdown_connections 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7faffc0a3cd0 0x7faffc0a6190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb00c101c40 0x7fb00c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb00c1079c0 0x7fb00c19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 --2- 172.21.15.77:0/3926691596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb00c102600 0x7fb00c199700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 >> 172.21.15.77:0/3926691596 conn(0x7fb00c078740 msgr2=0x7fb00c105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 shutdown_connections 2024-04-21T10:20:20.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.004+0000 7fb0130b5700 1 -- 172.21.15.77:0/3926691596 wait complete. 2024-04-21T10:20:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.108+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc5f002e020 con 0x7fc5f0102300 2024-04-21T10:20:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.109+0000 7fc5f4a2b700 1 -- 172.21.15.77:0/2205610564 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc5e409cf50 con 0x7fc5f0102300 2024-04-21T10:20:20.109 INFO:teuthology.orchestra.run.smithi077.stdout:343597383705 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc5d80a3d50 msgr2=0x7fc5d80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc5d80a3d50 0x7fc5d80a6210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00099d0 tx=0x7fc5e0008040 comp rx=0 tx=0).stop 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 msgr2=0x7fc5f0103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f0103a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400c920 tx=0x7fc5e400cce0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 shutdown_connections 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc5d80a3d50 0x7fc5d80a6210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5f0107990 0x7fc5f0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5f0101940 0x7fc5f01034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 --2- 172.21.15.77:0/2205610564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5f0102300 0x7fc5f0103a30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 >> 172.21.15.77:0/2205610564 conn(0x7fc5f00788f0 msgr2=0x7fc5f006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 shutdown_connections 2024-04-21T10:20:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:20.111+0000 7fc5f5a2d700 1 -- 172.21.15.77:0/2205610564 wait complete. 2024-04-21T10:20:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:19 smithi191 ceph-mon[31636]: pgmap v319: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-21T10:20:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:19 smithi170 ceph-mon[31212]: pgmap v319: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-21T10:20:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3926691596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-21T10:20:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2205610564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-21T10:20:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:20 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:20:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3926691596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-21T10:20:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2205610564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-21T10:20:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:20 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:20:21.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3926691596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-21T10:20:21.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2205610564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-21T10:20:21.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:20 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:20:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:21 smithi077 ceph-mon[27902]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:21 smithi191 ceph-mon[31636]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:22.236 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332138 got 219043332141 for osd.7 2024-04-21T10:20:22.236 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:21 smithi170 ceph-mon[31212]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:22.635 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:22.635 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:23 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:23 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:23 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:23 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:23 smithi077 ceph-mon[27902]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:23 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:23 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:23 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:23 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:23 smithi191 ceph-mon[31636]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:23 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:23 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:23 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:23 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:23 smithi170 ceph-mon[31212]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:23.722 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383701 got 343597383705 for osd.11 2024-04-21T10:20:23.723 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:24.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/3715497223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48102a90 msgr2=0x7fdd48102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:24.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/3715497223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48102a90 0x7fdd48102f10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009990 tx=0x7fdd38009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/3715497223 shutdown_connections 2024-04-21T10:20:24.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/3715497223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 0x7fdd4810f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/3715497223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd48108a50 0x7fdd48108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/3715497223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48102a90 0x7fdd48102f10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/3715497223 >> 172.21.15.77:0/3715497223 conn(0x7fdd48079ba0 msgr2=0x7fdd48079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/3715497223 shutdown_connections 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.378+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/3715497223 wait complete. 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 Processor -- start 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 -- start start 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd48102a90 0x7fdd481992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 0x7fdd481997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 0x7fdd4819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48112ce0 con 0x7fdd48108a50 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48112b60 con 0x7fdd48103450 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4fd1e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48112e60 con 0x7fdd48102a90 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4e2bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 0x7fdd4819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:24.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4e2bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 0x7fdd4819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39244/0 (socket says 172.21.15.77:39244) 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4e2bb700 1 -- 172.21.15.77:0/2073580990 learned_addr learned my addr 172.21.15.77:0/2073580990 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4daba700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd48102a90 0x7fdd481992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.379+0000 7fdd4d2b9700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 0x7fdd481997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4e2bb700 1 -- 172.21.15.77:0/2073580990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd48102a90 msgr2=0x7fdd481992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4e2bb700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd48102a90 0x7fdd481992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4e2bb700 1 -- 172.21.15.77:0/2073580990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 msgr2=0x7fdd481997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4e2bb700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 0x7fdd481997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4e2bb700 1 -- 172.21.15.77:0/2073580990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4819e2c0 con 0x7fdd48108a50 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4d2b9700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 0x7fdd481997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4e2bb700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 0x7fdd4819db80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000b970 tx=0x7fdd4000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40019070 con 0x7fdd48108a50 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd40014440 con 0x7fdd48108a50 2024-04-21T10:20:24.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4819e5b0 con 0x7fdd48108a50 2024-04-21T10:20:24.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000ce60 con 0x7fdd48108a50 2024-04-21T10:20:24.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.380+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd481a5e30 con 0x7fdd48108a50 2024-04-21T10:20:24.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.381+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd48069730 con 0x7fdd48108a50 2024-04-21T10:20:24.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.382+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdd4001c070 con 0x7fdd48108a50 2024-04-21T10:20:24.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.382+0000 7fdd3effd700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fdd340a3cd0 0x7fdd340a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:24.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.383+0000 7fdd4daba700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fdd340a3cd0 0x7fdd340a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:24.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.383+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fdd400cf840 con 0x7fdd48108a50 2024-04-21T10:20:24.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.383+0000 7fdd4daba700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fdd340a3cd0 0x7fdd340a6190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd44006fd0 tx=0x7fdd44008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:24.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.387+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdd4009c1e0 con 0x7fdd48108a50 2024-04-21T10:20:24.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.594+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdd4802df80 con 0x7fdd48108a50 2024-04-21T10:20:24.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.594+0000 7fdd3effd700 1 -- 172.21.15.77:0/2073580990 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdd4009bae0 con 0x7fdd48108a50 2024-04-21T10:20:24.594 INFO:teuthology.orchestra.run.smithi077.stdout:197568495667 2024-04-21T10:20:24.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.596+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fdd340a3cd0 msgr2=0x7fdd340a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:24.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.596+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fdd340a3cd0 0x7fdd340a6190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd44006fd0 tx=0x7fdd44008040 comp rx=0 tx=0).stop 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.596+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 msgr2=0x7fdd4819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.596+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 0x7fdd4819db80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000b970 tx=0x7fdd4000bd30 comp rx=0 tx=0).stop 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 shutdown_connections 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fdd340a3cd0 0x7fdd340a6190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd48108a50 0x7fdd4819db80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd48102a90 0x7fdd481992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 --2- 172.21.15.77:0/2073580990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd48103450 0x7fdd481997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 >> 172.21.15.77:0/2073580990 conn(0x7fdd48079ba0 msgr2=0x7fdd481018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 shutdown_connections 2024-04-21T10:20:24.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.597+0000 7fdd4fd1e700 1 -- 172.21.15.77:0/2073580990 wait complete. 2024-04-21T10:20:24.845 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:24 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2073580990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-21T10:20:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:24 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2073580990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-21T10:20:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:24 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2073580990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 -- 172.21.15.77:0/507691379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 msgr2=0x7feee8102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 --2- 172.21.15.77:0/507691379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8102f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feed8009990 tx=0x7feed8009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 -- 172.21.15.77:0/507691379 shutdown_connections 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 --2- 172.21.15.77:0/507691379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8103490 0x7feee810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 --2- 172.21.15.77:0/507691379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8108aa0 0x7feee8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 --2- 172.21.15.77:0/507691379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8102f50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 -- 172.21.15.77:0/507691379 >> 172.21.15.77:0/507691379 conn(0x7feee8079c30 msgr2=0x7feee807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:25.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 -- 172.21.15.77:0/507691379 shutdown_connections 2024-04-21T10:20:25.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.394+0000 7feeecdeb700 1 -- 172.21.15.77:0/507691379 wait complete. 2024-04-21T10:20:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 Processor -- start 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 -- start start 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8103490 0x7feee8199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8108aa0 0x7feee819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feee8112ce0 con 0x7feee8102ad0 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feee8112b60 con 0x7feee8108aa0 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feeecdeb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feee8112e60 con 0x7feee8103490 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39280/0 (socket says 172.21.15.77:39280) 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee659c700 1 -- 172.21.15.77:0/3636285074 learned_addr learned my addr 172.21.15.77:0/3636285074 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee5d9b700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8103490 0x7feee8199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee6d9d700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8108aa0 0x7feee819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee659c700 1 -- 172.21.15.77:0/3636285074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8103490 msgr2=0x7feee8199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee659c700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8103490 0x7feee8199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.395+0000 7feee659c700 1 -- 172.21.15.77:0/3636285074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8108aa0 msgr2=0x7feee819da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feee659c700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8108aa0 0x7feee819da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feee659c700 1 -- 172.21.15.77:0/3636285074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee819e160 con 0x7feee8102ad0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feee6d9d700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8108aa0 0x7feee819da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feee659c700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8199150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feedc00d950 tx=0x7feedc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc016070 con 0x7feee8102ad0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee819e450 con 0x7feee8102ad0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feedc009df0 con 0x7feee8102ad0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc00f3c0 con 0x7feee8102ad0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.396+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee81a5cd0 con 0x7feee8102ad0 2024-04-21T10:20:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.397+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee8069730 con 0x7feee8102ad0 2024-04-21T10:20:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.398+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7feedc019070 con 0x7feee8102ad0 2024-04-21T10:20:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.399+0000 7feed77fe700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feed00a3cd0 0x7feed00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.399+0000 7feee5d9b700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feed00a3cd0 0x7feed00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.399+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7feedc0d0110 con 0x7feee8102ad0 2024-04-21T10:20:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.399+0000 7feee5d9b700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feed00a3cd0 0x7feed00a6190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feed800b5c0 tx=0x7feed8005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:25.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.402+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feedc09c9a0 con 0x7feee8102ad0 2024-04-21T10:20:25.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.609+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7feee802df80 con 0x7feee8102ad0 2024-04-21T10:20:25.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.610+0000 7feed77fe700 1 -- 172.21.15.77:0/3636285074 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feedc09c2a0 con 0x7feee8102ad0 2024-04-21T10:20:25.610 INFO:teuthology.orchestra.run.smithi077.stdout:253403070506 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feed00a3cd0 msgr2=0x7feed00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feed00a3cd0 0x7feed00a6190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feed800b5c0 tx=0x7feed8005960 comp rx=0 tx=0).stop 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 msgr2=0x7feee8199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8199150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feedc00d950 tx=0x7feedc00dc60 comp rx=0 tx=0).stop 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 shutdown_connections 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feed00a3cd0 0x7feed00a6190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8108aa0 0x7feee819da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feee8102ad0 0x7feee8199150 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 --2- 172.21.15.77:0/3636285074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8103490 0x7feee8199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:25.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 >> 172.21.15.77:0/3636285074 conn(0x7feee8079c30 msgr2=0x7feee8100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:25.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 shutdown_connections 2024-04-21T10:20:25.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:25.612+0000 7feeecdeb700 1 -- 172.21.15.77:0/3636285074 wait complete. 2024-04-21T10:20:25.731 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:25 smithi077 ceph-mon[27902]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:25.732 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:25 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3926029838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-21T10:20:25.732 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:25 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3636285074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-21T10:20:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:25 smithi191 ceph-mon[31636]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:25 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3926029838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-21T10:20:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:25 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3636285074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-21T10:20:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:25 smithi170 ceph-mon[31212]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-04-21T10:20:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:25 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3926029838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-21T10:20:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:25 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3636285074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.606+0000 7fddd0c3d700 1 -- 172.21.15.77:0/2908466556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 msgr2=0x7fddcc108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.606+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/2908466556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc108e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009990 tx=0x7fddbc009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 -- 172.21.15.77:0/2908466556 shutdown_connections 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/2908466556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddcc103450 0x7fddcc10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/2908466556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc108e30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/2908466556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddcc102a90 0x7fddcc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 -- 172.21.15.77:0/2908466556 >> 172.21.15.77:0/2908466556 conn(0x7fddcc079ba0 msgr2=0x7fddcc079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 -- 172.21.15.77:0/2908466556 shutdown_connections 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.607+0000 7fddd0c3d700 1 -- 172.21.15.77:0/2908466556 wait complete. 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 Processor -- start 2024-04-21T10:20:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 -- start start 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddcc102a90 0x7fddcc19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddcc103450 0x7fddcc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc112c00 con 0x7fddcc108a50 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc112a80 con 0x7fddcc102a90 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddd0c3d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc112d80 con 0x7fddcc103450 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddcad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddcad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39254/0 (socket says 172.21.15.77:39254) 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddcad9d700 1 -- 172.21.15.77:0/3926029838 learned_addr learned my addr 172.21.15.77:0/3926029838 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddc9d9b700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddcc103450 0x7fddcc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stdout:309237645343 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.608+0000 7fddca59c700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddcc102a90 0x7fddcc19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddcad9d700 1 -- 172.21.15.77:0/3926029838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddcc103450 msgr2=0x7fddcc19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddcad9d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddcc103450 0x7fddcc19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddcad9d700 1 -- 172.21.15.77:0/3926029838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddcc102a90 msgr2=0x7fddcc19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddcad9d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddcc102a90 0x7fddcc19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddcad9d700 1 -- 172.21.15.77:0/3926029838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc1a0380 con 0x7fddcc108a50 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddcad9d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc19fc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddc4007ee0 tx=0x7fddc400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4004bb0 con 0x7fddcc108a50 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc4004d50 con 0x7fddcc108a50 2024-04-21T10:20:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc1a0670 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4005920 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.609+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc1a7ef0 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.610+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddcc069730 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.612+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fddc401a020 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.613+0000 7fddbb7fe700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fddb40a3d50 0x7fddb40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.613+0000 7fddca59c700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fddb40a3d50 0x7fddb40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.613+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fddc40d0170 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.613+0000 7fddca59c700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fddb40a3d50 0x7fddb40a6210 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00b2e0 tx=0x7fddbc005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.617+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fddc4010070 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.830+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fddcc1a8180 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.831+0000 7fddbb7fe700 1 -- 172.21.15.77:0/3926029838 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fddc409ca00 con 0x7fddcc108a50 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fddb40a3d50 msgr2=0x7fddb40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fddb40a3d50 0x7fddb40a6210 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00b2e0 tx=0x7fddbc005960 comp rx=0 tx=0).stop 2024-04-21T10:20:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 msgr2=0x7fddcc19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc19fc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddc4007ee0 tx=0x7fddc400d3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 shutdown_connections 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fddb40a3d50 0x7fddb40a6210 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddcc102a90 0x7fddcc19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc108a50 0x7fddcc19fc40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 --2- 172.21.15.77:0/3926029838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddcc103450 0x7fddcc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 >> 172.21.15.77:0/3926029838 conn(0x7fddcc079ba0 msgr2=0x7fddcc101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 shutdown_connections 2024-04-21T10:20:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:24.833+0000 7fddd0c3d700 1 -- 172.21.15.77:0/3926029838 wait complete. 2024-04-21T10:20:27.109 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495662 got 197568495667 for osd.6 2024-04-21T10:20:27.109 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:27 smithi170 ceph-mon[31212]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-04-21T10:20:28.096 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:27 smithi077 ceph-mon[27902]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-04-21T10:20:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:27 smithi191 ceph-mon[31636]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-04-21T10:20:28.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645338 got 309237645343 for osd.10 2024-04-21T10:20:28.541 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:29.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 -- 172.21.15.77:0/286594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 msgr2=0x7f06e410f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:29.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 --2- 172.21.15.77:0/286594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e410f920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b0d0 tx=0x7f06dc00b3e0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 -- 172.21.15.77:0/286594478 shutdown_connections 2024-04-21T10:20:29.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 --2- 172.21.15.77:0/286594478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e4107a60 0x7f06e4107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 --2- 172.21.15.77:0/286594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e410f920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 --2- 172.21.15.77:0/286594478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06e4100f90 0x7f06e4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 -- 172.21.15.77:0/286594478 >> 172.21.15.77:0/286594478 conn(0x7f06e4077f40 msgr2=0x7f06e40ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 -- 172.21.15.77:0/286594478 shutdown_connections 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 -- 172.21.15.77:0/286594478 wait complete. 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.228+0000 7f06eb3af700 1 Processor -- start 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 -- start start 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e4100f90 0x7f06e4199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e41996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06e4107a60 0x7f06e419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4112d70 con 0x7f06e4101950 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4112bf0 con 0x7f06e4100f90 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4112ef0 con 0x7f06e4107a60 2024-04-21T10:20:29.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e41996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e41996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39286/0 (socket says 172.21.15.77:39286) 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 -- 172.21.15.77:0/189106268 learned_addr learned my addr 172.21.15.77:0/189106268 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e914b700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e4100f90 0x7f06e4199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 -- 172.21.15.77:0/189106268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06e4107a60 msgr2=0x7f06e419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06e4107a60 0x7f06e419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 -- 172.21.15.77:0/189106268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e4100f90 msgr2=0x7f06e4199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e4100f90 0x7f06e4199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 -- 172.21.15.77:0/189106268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e419e190 con 0x7f06e4101950 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06e894a700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e41996c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06d400b530 tx=0x7f06d400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4015020 con 0x7f06e4101950 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06d4011ce0 con 0x7f06e4101950 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4010e40 con 0x7f06e4101950 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.229+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e419e480 con 0x7f06e4101950 2024-04-21T10:20:29.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.230+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41a5d00 con 0x7f06e4101950 2024-04-21T10:20:29.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.230+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e4069730 con 0x7f06e4101950 2024-04-21T10:20:29.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.232+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f06d4018020 con 0x7f06e4101950 2024-04-21T10:20:29.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.232+0000 7f06da7fc700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06d00a3cd0 0x7f06d00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:29.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.232+0000 7f06e914b700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06d00a3cd0 0x7f06d00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:29.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.232+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f06d40d0290 con 0x7f06e4101950 2024-04-21T10:20:29.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.233+0000 7f06e914b700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06d00a3cd0 0x7f06d00a6190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f06e0005950 tx=0x7f06e000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:29.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.236+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f06d401f020 con 0x7f06e4101950 2024-04-21T10:20:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.445+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f06e402df80 con 0x7f06e4101950 2024-04-21T10:20:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.445+0000 7f06da7fc700 1 -- 172.21.15.77:0/189106268 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f06d409cc30 con 0x7f06e4101950 2024-04-21T10:20:29.444 INFO:teuthology.orchestra.run.smithi077.stdout:107374182468 2024-04-21T10:20:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06d00a3cd0 msgr2=0x7f06d00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06d00a3cd0 0x7f06d00a6190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f06e0005950 tx=0x7f06e000b410 comp rx=0 tx=0).stop 2024-04-21T10:20:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 msgr2=0x7f06e41996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e41996c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06d400b530 tx=0x7f06d400b840 comp rx=0 tx=0).stop 2024-04-21T10:20:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 shutdown_connections 2024-04-21T10:20:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f06d00a3cd0 0x7f06d00a6190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e4100f90 0x7f06e4199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06e4107a60 0x7f06e419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 --2- 172.21.15.77:0/189106268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4101950 0x7f06e41996c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 >> 172.21.15.77:0/189106268 conn(0x7f06e4077f40 msgr2=0x7f06e4105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 shutdown_connections 2024-04-21T10:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:29.447+0000 7f06eb3af700 1 -- 172.21.15.77:0/189106268 wait complete. 2024-04-21T10:20:30.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:29 smithi191 ceph-mon[31636]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-21T10:20:30.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:29 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/189106268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-21T10:20:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:29 smithi170 ceph-mon[31212]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-21T10:20:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:29 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/189106268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-21T10:20:30.081 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:29 smithi077 ceph-mon[27902]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-21T10:20:30.081 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:29 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/189106268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-21T10:20:31.956 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:31 smithi077 ceph-mon[27902]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 -- 172.21.15.77:0/3148573896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c1034b0 msgr2=0x7f635c10f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 --2- 172.21.15.77:0/3148573896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c1034b0 0x7f635c10f8e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f634c009990 tx=0x7f634c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 -- 172.21.15.77:0/3148573896 shutdown_connections 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 --2- 172.21.15.77:0/3148573896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c108a80 0x7f635c108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 --2- 172.21.15.77:0/3148573896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c1034b0 0x7f635c10f8e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 --2- 172.21.15.77:0/3148573896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635c102af0 0x7f635c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.957+0000 7f6360dee700 1 -- 172.21.15.77:0/3148573896 >> 172.21.15.77:0/3148573896 conn(0x7f635c079b20 msgr2=0x7f635c079f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.958+0000 7f6360dee700 1 -- 172.21.15.77:0/3148573896 shutdown_connections 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.958+0000 7f6360dee700 1 -- 172.21.15.77:0/3148573896 wait complete. 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.958+0000 7f6360dee700 1 Processor -- start 2024-04-21T10:20:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.958+0000 7f6360dee700 1 -- start start 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 0x7f635c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c1034b0 0x7f635c199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635c108a80 0x7f635c19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f635c112cb0 con 0x7f635c102af0 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f635c112b30 con 0x7f635c1034b0 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f635c112e30 con 0x7f635c108a80 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 0x7f635c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 0x7f635c1991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43796/0 (socket says 172.21.15.77:43796) 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 -- 172.21.15.77:0/4026821910 learned_addr learned my addr 172.21.15.77:0/4026821910 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635ad9d700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635c108a80 0x7f635c19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6359d9b700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c1034b0 0x7f635c199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 -- 172.21.15.77:0/4026821910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635c108a80 msgr2=0x7f635c19da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635c108a80 0x7f635c19da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 -- 172.21.15.77:0/4026821910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c1034b0 msgr2=0x7f635c199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c1034b0 0x7f635c199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 -- 172.21.15.77:0/4026821910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c19e1d0 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f635a59c700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 0x7f635c1991c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f635400ba50 tx=0x7f635400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354019070 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6354014440 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c19e4c0 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635400ce60 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.959+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c1a5d40 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.960+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c069730 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.961+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f635401c070 con 0x7f635c102af0 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.962+0000 7f63537fe700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f63480a3cd0 0x7f63480a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.962+0000 7f6359d9b700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f63480a3cd0 0x7f63480a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.963+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f63540cfd80 con 0x7f635c102af0 2024-04-21T10:20:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.963+0000 7f6359d9b700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f63480a3cd0 0x7f63480a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6344005950 tx=0x7f63440058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:31.967+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f635409c6c0 con 0x7f635c102af0 2024-04-21T10:20:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:31 smithi170 ceph-mon[31212]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-21T10:20:32.176 INFO:teuthology.orchestra.run.smithi077.stdout:55834574927 2024-04-21T10:20:32.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.176+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f635c19a520 con 0x7f635c102af0 2024-04-21T10:20:32.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.176+0000 7f63537fe700 1 -- 172.21.15.77:0/4026821910 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f635409bfc0 con 0x7f635c102af0 2024-04-21T10:20:32.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.178+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f63480a3cd0 msgr2=0x7f63480a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.178+0000 7f6360dee700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f63480a3cd0 0x7f63480a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6344005950 tx=0x7f63440058e0 comp rx=0 tx=0).stop 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.178+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 msgr2=0x7f635c1991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.178+0000 7f6360dee700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 0x7f635c1991c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f635400ba50 tx=0x7f635400bd60 comp rx=0 tx=0).stop 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 shutdown_connections 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f63480a3cd0 0x7f63480a6190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635c108a80 0x7f635c19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f635c102af0 0x7f635c1991c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 --2- 172.21.15.77:0/4026821910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c1034b0 0x7f635c199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 >> 172.21.15.77:0/4026821910 conn(0x7f635c079b20 msgr2=0x7f635c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 shutdown_connections 2024-04-21T10:20:32.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.179+0000 7f6360dee700 1 -- 172.21.15.77:0/4026821910 wait complete. 2024-04-21T10:20:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:31 smithi191 ceph-mon[31636]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-21T10:20:32.721 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182464 got 107374182468 for osd.3 2024-04-21T10:20:32.721 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:33.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:32 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4026821910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-21T10:20:33.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:32 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/363319361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-21T10:20:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:32 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4026821910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-21T10:20:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:32 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/363319361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-21T10:20:33.168 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070500 got 253403070506 for osd.8 2024-04-21T10:20:33.168 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:32 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4026821910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-21T10:20:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:32 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/363319361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-21T10:20:33.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574927 for osd.1 2024-04-21T10:20:33.648 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:33 smithi077 ceph-mon[27902]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:33 smithi170 ceph-mon[31212]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:33 smithi191 ceph-mon[31636]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 -- 172.21.15.77:0/4109730611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 msgr2=0x7fde58108e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 --2- 172.21.15.77:0/4109730611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde58108e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fde5000b0a0 tx=0x7fde5000b3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 -- 172.21.15.77:0/4109730611 shutdown_connections 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 --2- 172.21.15.77:0/4109730611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde5806bb30 0x7fde5810f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 --2- 172.21.15.77:0/4109730611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde58108e10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 --2- 172.21.15.77:0/4109730611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806b190 0x7fde5806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 -- 172.21.15.77:0/4109730611 >> 172.21.15.77:0/4109730611 conn(0x7fde58078910 msgr2=0x7fde58078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 -- 172.21.15.77:0/4109730611 shutdown_connections 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.473+0000 7fde5ce49700 1 -- 172.21.15.77:0/4109730611 wait complete. 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 Processor -- start 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 -- start start 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde5806b190 0x7fde58199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806bb30 0x7fde58199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde5819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde58112cb0 con 0x7fde58108a30 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde58112b30 con 0x7fde5806bb30 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5ce49700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde58112e30 con 0x7fde5806b190 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde5819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde5659c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde5806b190 0x7fde58199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde5819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43838/0 (socket says 172.21.15.77:43838) 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 -- 172.21.15.77:0/794054875 learned_addr learned my addr 172.21.15.77:0/794054875 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde55d9b700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806bb30 0x7fde58199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 -- 172.21.15.77:0/794054875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde5806b190 msgr2=0x7fde58199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde5806b190 0x7fde58199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 -- 172.21.15.77:0/794054875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806bb30 msgr2=0x7fde58199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806bb30 0x7fde58199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde56d9d700 1 -- 172.21.15.77:0/794054875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5819e320 con 0x7fde58108a30 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.474+0000 7fde55d9b700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806bb30 0x7fde58199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.475+0000 7fde56d9d700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde5819dbe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fde4800b550 tx=0x7fde4800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.475+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48015020 con 0x7fde58108a30 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.475+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde48011ce0 con 0x7fde58108a30 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.475+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5819e610 con 0x7fde58108a30 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.475+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48010dd0 con 0x7fde58108a30 2024-04-21T10:20:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.475+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde581a5e90 con 0x7fde58108a30 2024-04-21T10:20:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.476+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde58069730 con 0x7fde58108a30 2024-04-21T10:20:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.477+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fde48018020 con 0x7fde58108a30 2024-04-21T10:20:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.477+0000 7fde4f7fe700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde440a3cd0 0x7fde440a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.477+0000 7fde5659c700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde440a3cd0 0x7fde440a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.477+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fde480cfb50 con 0x7fde58108a30 2024-04-21T10:20:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.478+0000 7fde5659c700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde440a3cd0 0x7fde440a6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fde50009fd0 tx=0x7fde5000b7b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:34.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.482+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde4801f020 con 0x7fde58108a30 2024-04-21T10:20:34.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 -- 172.21.15.77:0/2022338072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101940 msgr2=0x7fb708101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 --2- 172.21.15.77:0/2022338072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101940 0x7fb708101dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009990 tx=0x7fb6f4009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 -- 172.21.15.77:0/2022338072 shutdown_connections 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 --2- 172.21.15.77:0/2022338072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708107990 0x7fb708107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 --2- 172.21.15.77:0/2022338072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb708102300 0x7fb70810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 --2- 172.21.15.77:0/2022338072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101940 0x7fb708101dc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 -- 172.21.15.77:0/2022338072 >> 172.21.15.77:0/2022338072 conn(0x7fb7080788f0 msgr2=0x7fb708078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 -- 172.21.15.77:0/2022338072 shutdown_connections 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 -- 172.21.15.77:0/2022338072 wait complete. 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 Processor -- start 2024-04-21T10:20:34.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.296+0000 7fb70f08c700 1 -- start start 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708101940 0x7fb708199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb708102300 0x7fb70819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 0x7fb7081a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb708111b50 con 0x7fb708107990 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081119d0 con 0x7fb708101940 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb708111cd0 con 0x7fb708102300 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 0x7fb7081a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 0x7fb7081a4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43812/0 (socket says 172.21.15.77:43812) 2024-04-21T10:20:34.628 INFO:teuthology.orchestra.run.smithi077.stdout:141733920831 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 -- 172.21.15.77:0/363319361 learned_addr learned my addr 172.21.15.77:0/363319361 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70ce28700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708101940 0x7fb708199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 -- 172.21.15.77:0/363319361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb708102300 msgr2=0x7fb70819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb708102300 0x7fb70819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 -- 172.21.15.77:0/363319361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708101940 msgr2=0x7fb708199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708101940 0x7fb708199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 -- 172.21.15.77:0/363319361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7081a54d0 con 0x7fb708107990 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70ce28700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708101940 0x7fb708199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:34.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70d629700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 0x7fb7081a4f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb70000b970 tx=0x7fb70000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700019070 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb700014440 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7081a5700 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.297+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70000ce60 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.298+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7081a5bf0 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.298+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb708069730 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.299+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb70001c070 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.300+0000 7fb705ffb700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb6f80a3cd0 0x7fb6f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.300+0000 7fb70ce28700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb6f80a3cd0 0x7fb6f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.300+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fb7000cf8c0 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.301+0000 7fb70ce28700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb6f80a3cd0 0x7fb6f80a6190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc005fd0 tx=0x7fb6fc005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.305+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb70009c260 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.506+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb70802e140 con 0x7fb708107990 2024-04-21T10:20:34.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.507+0000 7fb705ffb700 1 -- 172.21.15.77:0/363319361 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb70009bb60 con 0x7fb708107990 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb6f80a3cd0 msgr2=0x7fb6f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb6f80a3cd0 0x7fb6f80a6190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc005fd0 tx=0x7fb6fc005e30 comp rx=0 tx=0).stop 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 msgr2=0x7fb7081a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 0x7fb7081a4f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb70000b970 tx=0x7fb70000bd30 comp rx=0 tx=0).stop 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 shutdown_connections 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb6f80a3cd0 0x7fb6f80a6190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708101940 0x7fb708199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708107990 0x7fb7081a4f90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 --2- 172.21.15.77:0/363319361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb708102300 0x7fb70819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 >> 172.21.15.77:0/363319361 conn(0x7fb7080788f0 msgr2=0x7fb7080ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 shutdown_connections 2024-04-21T10:20:34.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:32.509+0000 7fb70f08c700 1 -- 172.21.15.77:0/363319361 wait complete. 2024-04-21T10:20:34.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.695+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fde5819a670 con 0x7fde58108a30 2024-04-21T10:20:34.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.695+0000 7fde4f7fe700 1 -- 172.21.15.77:0/794054875 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fde4809c4f0 con 0x7fde58108a30 2024-04-21T10:20:34.695 INFO:teuthology.orchestra.run.smithi077.stdout:163208757307 2024-04-21T10:20:34.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde440a3cd0 msgr2=0x7fde440a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde440a3cd0 0x7fde440a6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fde50009fd0 tx=0x7fde5000b7b0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 msgr2=0x7fde5819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:34.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde5819dbe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fde4800b550 tx=0x7fde4800b860 comp rx=0 tx=0).stop 2024-04-21T10:20:34.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 shutdown_connections 2024-04-21T10:20:34.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde440a3cd0 0x7fde440a6190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde58108a30 0x7fde5819dbe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde5806b190 0x7fde58199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 --2- 172.21.15.77:0/794054875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5806bb30 0x7fde58199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:34.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 >> 172.21.15.77:0/794054875 conn(0x7fde58078910 msgr2=0x7fde580ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:34.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 shutdown_connections 2024-04-21T10:20:34.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:34.697+0000 7fde5ce49700 1 -- 172.21.15.77:0/794054875 wait complete. 2024-04-21T10:20:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:34 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/794054875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-21T10:20:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:34 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/794054875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-21T10:20:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:34 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/794054875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-21T10:20:35.285 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920825 got 141733920831 for osd.4 2024-04-21T10:20:35.285 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:35.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:35 smithi077 ceph-mon[27902]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:36.005 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757301 got 163208757307 for osd.5 2024-04-21T10:20:36.005 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:35 smithi170 ceph-mon[31212]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:35 smithi191 ceph-mon[31636]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 -- 172.21.15.77:0/4020925089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80108a50 msgr2=0x7efd80108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 --2- 172.21.15.77:0/4020925089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80108a50 0x7efd80108e30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd74009990 tx=0x7efd74009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 -- 172.21.15.77:0/4020925089 shutdown_connections 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 --2- 172.21.15.77:0/4020925089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd80103450 0x7efd8010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 --2- 172.21.15.77:0/4020925089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80108a50 0x7efd80108e30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 --2- 172.21.15.77:0/4020925089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd80102a90 0x7efd80102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 -- 172.21.15.77:0/4020925089 >> 172.21.15.77:0/4020925089 conn(0x7efd80079ba0 msgr2=0x7efd80079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 -- 172.21.15.77:0/4020925089 shutdown_connections 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 -- 172.21.15.77:0/4020925089 wait complete. 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.493+0000 7efd85255700 1 Processor -- start 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 -- start start 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd80102a90 0x7efd80199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 0x7efd80199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd80108a50 0x7efd8019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112be0 con 0x7efd80103450 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112a60 con 0x7efd80102a90 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd85255700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112d60 con 0x7efd80108a50 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd7e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 0x7efd80199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd7e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 0x7efd80199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43864/0 (socket says 172.21.15.77:43864) 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd7e59c700 1 -- 172.21.15.77:0/277286726 learned_addr learned my addr 172.21.15.77:0/277286726 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd7ed9d700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd80102a90 0x7efd80199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.494+0000 7efd7f59e700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd80108a50 0x7efd8019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd7e59c700 1 -- 172.21.15.77:0/277286726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd80108a50 msgr2=0x7efd8019d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd7e59c700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd80108a50 0x7efd8019d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd7e59c700 1 -- 172.21.15.77:0/277286726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd80102a90 msgr2=0x7efd80199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd7e59c700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd80102a90 0x7efd80199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd7e59c700 1 -- 172.21.15.77:0/277286726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8019e120 con 0x7efd80103450 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd7e59c700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 0x7efd80199650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c920 tx=0x7efd7000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70004a30 con 0x7efd80103450 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8019e410 con 0x7efd80103450 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd700054d0 con 0x7efd80103450 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70007bd0 con 0x7efd80103450 2024-04-21T10:20:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.495+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd801a5c90 con 0x7efd80103450 2024-04-21T10:20:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.496+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd80069730 con 0x7efd80103450 2024-04-21T10:20:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.497+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efd70004bd0 con 0x7efd80103450 2024-04-21T10:20:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.498+0000 7efd67fff700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efd680a3cd0 0x7efd680a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.498+0000 7efd7ed9d700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efd680a3cd0 0x7efd680a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.498+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7efd700d0490 con 0x7efd80103450 2024-04-21T10:20:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.498+0000 7efd7ed9d700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efd680a3cd0 0x7efd680a6190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efd740098e0 tx=0x7efd74005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.502+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efd70014030 con 0x7efd80103450 2024-04-21T10:20:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.736+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efd8019a470 con 0x7efd80103450 2024-04-21T10:20:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.736+0000 7efd67fff700 1 -- 172.21.15.77:0/277286726 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd7009cd20 con 0x7efd80103450 2024-04-21T10:20:36.737 INFO:teuthology.orchestra.run.smithi077.stdout:34359738452 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efd680a3cd0 msgr2=0x7efd680a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efd680a3cd0 0x7efd680a6190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efd740098e0 tx=0x7efd74005960 comp rx=0 tx=0).stop 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 msgr2=0x7efd80199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 0x7efd80199650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c920 tx=0x7efd7000cc30 comp rx=0 tx=0).stop 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 shutdown_connections 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efd680a3cd0 0x7efd680a6190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd80102a90 0x7efd80199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd80108a50 0x7efd8019d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 --2- 172.21.15.77:0/277286726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd80103450 0x7efd80199650 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.739+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 >> 172.21.15.77:0/277286726 conn(0x7efd80079ba0 msgr2=0x7efd80101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.740+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 shutdown_connections 2024-04-21T10:20:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:36.740+0000 7efd85255700 1 -- 172.21.15.77:0/277286726 wait complete. 2024-04-21T10:20:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:36 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/277286726' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-21T10:20:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:36 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:36 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/277286726' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-21T10:20:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:36 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:36 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/277286726' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-21T10:20:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:36 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:37.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738452 for osd.0 2024-04-21T10:20:37.502 DEBUG:teuthology.parallel:result is None 2024-04-21T10:20:37.502 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-21T10:20:37.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-21T10:20:37.751 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:38.027 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:37 smithi077 ceph-mon[27902]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:20:38.027 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:20:38.027 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:20:38.027 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:37 smithi077 ceph-mon[27902]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:37 smithi170 ceph-mon[31212]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:20:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:37 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:20:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:37 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:20:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:37 smithi170 ceph-mon[31212]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:37 smithi191 ceph-mon[31636]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:20:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:37 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:20:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:37 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:20:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:37 smithi191 ceph-mon[31636]: from='mgr.14150 172.21.15.77:0/1303251296' entity='mgr.x' 2024-04-21T10:20:39.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 -- 172.21.15.77:0/2598853906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 msgr2=0x7efccc06abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:39.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 --2- 172.21.15.77:0/2598853906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc06abb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009990 tx=0x7efcb8009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 -- 172.21.15.77:0/2598853906 shutdown_connections 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 --2- 172.21.15.77:0/2598853906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efccc108a30 0x7efccc108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 --2- 172.21.15.77:0/2598853906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efccc06b0f0 0x7efccc10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 --2- 172.21.15.77:0/2598853906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc06abb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 -- 172.21.15.77:0/2598853906 >> 172.21.15.77:0/2598853906 conn(0x7efccc0788f0 msgr2=0x7efccc078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 -- 172.21.15.77:0/2598853906 shutdown_connections 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.492+0000 7efcd2f89700 1 -- 172.21.15.77:0/2598853906 wait complete. 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 Processor -- start 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 -- start start 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efccc06b0f0 0x7efccc199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efccc108a30 0x7efccc19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efccc112bd0 con 0x7efccc06a750 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efccc112a50 con 0x7efccc108a30 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.493+0000 7efcd2f89700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efccc112d50 con 0x7efccc06b0f0 2024-04-21T10:20:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43880/0 (socket says 172.21.15.77:43880) 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 -- 172.21.15.77:0/1485443090 learned_addr learned my addr 172.21.15.77:0/1485443090 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efccbfff700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efccc06b0f0 0x7efccc199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd1526700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efccc108a30 0x7efccc19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 -- 172.21.15.77:0/1485443090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efccc06b0f0 msgr2=0x7efccc199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efccc06b0f0 0x7efccc199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 -- 172.21.15.77:0/1485443090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efccc108a30 msgr2=0x7efccc19d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efccc108a30 0x7efccc19d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 -- 172.21.15.77:0/1485443090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc19e110 con 0x7efccc06a750 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd0d25700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc199100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c920 tx=0x7efcc000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0007b00 con 0x7efccc06a750 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcc0004ce0 con 0x7efccc06a750 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc19e400 con 0x7efccc06a750 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.494+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0005550 con 0x7efccc06a750 2024-04-21T10:20:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.495+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc1a5c80 con 0x7efccc06a750 2024-04-21T10:20:39.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.495+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc069730 con 0x7efccc06a750 2024-04-21T10:20:39.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.496+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efcc0007ca0 con 0x7efccc06a750 2024-04-21T10:20:39.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.497+0000 7efcc9ffb700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efcbc0a3d50 0x7efcbc0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:39.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.497+0000 7efccbfff700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efcbc0a3d50 0x7efcbc0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:39.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.497+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7efcc00d0350 con 0x7efccc06a750 2024-04-21T10:20:39.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.497+0000 7efccbfff700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efcbc0a3d50 0x7efcbc0a6210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b5c0 tx=0x7efcb8005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:39.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.501+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efcc0014030 con 0x7efccc06a750 2024-04-21T10:20:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.696+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efccc19a460 con 0x7efcbc0a3d50 2024-04-21T10:20:39.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.704+0000 7efcc9ffb700 1 -- 172.21.15.77:0/1485443090 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258861 (secure 0 0 0) 0x7efccc19a460 con 0x7efcbc0a3d50 2024-04-21T10:20:39.707 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efcbc0a3d50 msgr2=0x7efcbc0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efcbc0a3d50 0x7efcbc0a6210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b5c0 tx=0x7efcb8005960 comp rx=0 tx=0).stop 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 msgr2=0x7efccc199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc199100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c920 tx=0x7efcc000cc30 comp rx=0 tx=0).stop 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 shutdown_connections 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efcbc0a3d50 0x7efcbc0a6210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efccc108a30 0x7efccc19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efccc06a750 0x7efccc199100 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 --2- 172.21.15.77:0/1485443090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efccc06b0f0 0x7efccc199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 >> 172.21.15.77:0/1485443090 conn(0x7efccc0788f0 msgr2=0x7efccc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 shutdown_connections 2024-04-21T10:20:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:39.708+0000 7efcd2f89700 1 -- 172.21.15.77:0/1485443090 wait complete. 2024-04-21T10:20:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:20:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:39 smithi170 ceph-mon[31212]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T10:20:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:39 smithi077 ceph-mon[27902]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T10:20:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:39 smithi191 ceph-mon[31636]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T10:20:40.505 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-21T10:20:38.691703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653874,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":574,"num_read_kb":402,"num_write":339,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360784,"kb_used_data":11568,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581040,"statfs":{"total":1151940427776,"available":1151570984960,"internally_reserved":0,"allocated":11845632,"data_stored":7429098,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19137,"internal_metadata":357414207},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003122"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822331+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:20:15.822331+0000","last_peered":"2024-04-21T10:20:15.822331+0000","last_clean":"2024-04-21T10:20:15.822331+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:20:15.822331+0000","last_undegraded":"2024-04-21T10:20:15.822331+0000","last_fullsized":"2024-04-21T10:20:15.822331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:06:40.220736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819966+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:20:15.819966+0000","last_peered":"2024-04-21T10:20:15.819966+0000","last_clean":"2024-04-21T10:20:15.819966+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:20:15.819966+0000","last_undegraded":"2024-04-21T10:20:15.819966+0000","last_fullsized":"2024-04-21T10:20:15.819966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820331+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:20:15.820331+0000","last_peered":"2024-04-21T10:20:15.820331+0000","last_clean":"2024-04-21T10:20:15.820331+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:20:15.820331+0000","last_undegraded":"2024-04-21T10:20:15.820331+0000","last_fullsized":"2024-04-21T10:20:15.820331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821083+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:20:15.821083+0000","last_peered":"2024-04-21T10:20:15.821083+0000","last_clean":"2024-04-21T10:20:15.821083+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:20:15.821083+0000","last_undegraded":"2024-04-21T10:20:15.821083+0000","last_fullsized":"2024-04-21T10:20:15.821083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821055+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:20:15.821055+0000","last_peered":"2024-04-21T10:20:15.821055+0000","last_clean":"2024-04-21T10:20:15.821055+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:20:15.821055+0000","last_undegraded":"2024-04-21T10:20:15.821055+0000","last_fullsized":"2024-04-21T10:20:15.821055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825168+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:20:15.825168+0000","last_peered":"2024-04-21T10:20:15.825168+0000","last_clean":"2024-04-21T10:20:15.825168+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:20:15.825168+0000","last_undegraded":"2024-04-21T10:20:15.825168+0000","last_fullsized":"2024-04-21T10:20:15.825168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:57.136408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826151+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:20:15.826151+0000","last_peered":"2024-04-21T10:20:15.826151+0000","last_clean":"2024-04-21T10:20:15.826151+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:20:15.826151+0000","last_undegraded":"2024-04-21T10:20:15.826151+0000","last_fullsized":"2024-04-21T10:20:15.826151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:17.305626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825192+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:20:15.825192+0000","last_peered":"2024-04-21T10:20:15.825192+0000","last_clean":"2024-04-21T10:20:15.825192+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:20:15.825192+0000","last_undegraded":"2024-04-21T10:20:15.825192+0000","last_fullsized":"2024-04-21T10:20:15.825192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:52.203999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823872+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:20:15.823872+0000","last_peered":"2024-04-21T10:20:15.823872+0000","last_clean":"2024-04-21T10:20:15.823872+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:20:15.823872+0000","last_undegraded":"2024-04-21T10:20:15.823872+0000","last_fullsized":"2024-04-21T10:20:15.823872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:26:01.902847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.830905+0000","last_change":"2024-04-21T10:20:15.830905+0000","last_active":"2024-04-21T10:20:15.830905+0000","last_peered":"2024-04-21T10:20:15.830905+0000","last_clean":"2024-04-21T10:20:15.830905+0000","last_became_active":"2024-04-21T10:20:15.830536+0000","last_became_peered":"2024-04-21T10:20:15.830536+0000","last_unstale":"2024-04-21T10:20:15.830905+0000","last_undegraded":"2024-04-21T10:20:15.830905+0000","last_fullsized":"2024-04-21T10:20:15.830905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:02:48.213874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827144+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:20:15.827144+0000","last_peered":"2024-04-21T10:20:15.827144+0000","last_clean":"2024-04-21T10:20:15.827144+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:20:15.827144+0000","last_undegraded":"2024-04-21T10:20:15.827144+0000","last_fullsized":"2024-04-21T10:20:15.827144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:52:25.586003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820946+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:20:15.820946+0000","last_peered":"2024-04-21T10:20:15.820946+0000","last_clean":"2024-04-21T10:20:15.820946+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:20:15.820946+0000","last_undegraded":"2024-04-21T10:20:15.820946+0000","last_fullsized":"2024-04-21T10:20:15.820946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823536+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:20:15.823536+0000","last_peered":"2024-04-21T10:20:15.823536+0000","last_clean":"2024-04-21T10:20:15.823536+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:20:15.823536+0000","last_undegraded":"2024-04-21T10:20:15.823536+0000","last_fullsized":"2024-04-21T10:20:15.823536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819951+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:20:15.819951+0000","last_peered":"2024-04-21T10:20:15.819951+0000","last_clean":"2024-04-21T10:20:15.819951+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:20:15.819951+0000","last_undegraded":"2024-04-21T10:20:15.819951+0000","last_fullsized":"2024-04-21T10:20:15.819951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819817+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:20:15.819817+0000","last_peered":"2024-04-21T10:20:15.819817+0000","last_clean":"2024-04-21T10:20:15.819817+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:20:15.819817+0000","last_undegraded":"2024-04-21T10:20:15.819817+0000","last_fullsized":"2024-04-21T10:20:15.819817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822794+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:20:15.822794+0000","last_peered":"2024-04-21T10:20:15.822794+0000","last_clean":"2024-04-21T10:20:15.822794+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:20:15.822794+0000","last_undegraded":"2024-04-21T10:20:15.822794+0000","last_fullsized":"2024-04-21T10:20:15.822794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:04:32.551997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822602+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:20:15.822602+0000","last_peered":"2024-04-21T10:20:15.822602+0000","last_clean":"2024-04-21T10:20:15.822602+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:20:15.822602+0000","last_undegraded":"2024-04-21T10:20:15.822602+0000","last_fullsized":"2024-04-21T10:20:15.822602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:10:09.025923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822318+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:20:15.822318+0000","last_peered":"2024-04-21T10:20:15.822318+0000","last_clean":"2024-04-21T10:20:15.822318+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:20:15.822318+0000","last_undegraded":"2024-04-21T10:20:15.822318+0000","last_fullsized":"2024-04-21T10:20:15.822318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827176+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:20:15.827176+0000","last_peered":"2024-04-21T10:20:15.827176+0000","last_clean":"2024-04-21T10:20:15.827176+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:20:15.827176+0000","last_undegraded":"2024-04-21T10:20:15.827176+0000","last_fullsized":"2024-04-21T10:20:15.827176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:37:23.490245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822727+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:20:15.822727+0000","last_peered":"2024-04-21T10:20:15.822727+0000","last_clean":"2024-04-21T10:20:15.822727+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:20:15.822727+0000","last_undegraded":"2024-04-21T10:20:15.822727+0000","last_fullsized":"2024-04-21T10:20:15.822727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826260+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:20:15.826260+0000","last_peered":"2024-04-21T10:20:15.826260+0000","last_clean":"2024-04-21T10:20:15.826260+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:20:15.826260+0000","last_undegraded":"2024-04-21T10:20:15.826260+0000","last_fullsized":"2024-04-21T10:20:15.826260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:26.283821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827152+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:20:15.827152+0000","last_peered":"2024-04-21T10:20:15.827152+0000","last_clean":"2024-04-21T10:20:15.827152+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:20:15.827152+0000","last_undegraded":"2024-04-21T10:20:15.827152+0000","last_fullsized":"2024-04-21T10:20:15.827152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820231+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:20:15.820231+0000","last_peered":"2024-04-21T10:20:15.820231+0000","last_clean":"2024-04-21T10:20:15.820231+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:20:15.820231+0000","last_undegraded":"2024-04-21T10:20:15.820231+0000","last_fullsized":"2024-04-21T10:20:15.820231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.833712+0000","last_change":"2024-04-21T10:20:15.833712+0000","last_active":"2024-04-21T10:20:15.833712+0000","last_peered":"2024-04-21T10:20:15.833712+0000","last_clean":"2024-04-21T10:20:15.833712+0000","last_became_active":"2024-04-21T10:20:15.827691+0000","last_became_peered":"2024-04-21T10:20:15.827691+0000","last_unstale":"2024-04-21T10:20:15.833712+0000","last_undegraded":"2024-04-21T10:20:15.833712+0000","last_fullsized":"2024-04-21T10:20:15.833712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:32:14.844485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825760+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:20:15.825760+0000","last_peered":"2024-04-21T10:20:15.825760+0000","last_clean":"2024-04-21T10:20:15.825760+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:20:15.825760+0000","last_undegraded":"2024-04-21T10:20:15.825760+0000","last_fullsized":"2024-04-21T10:20:15.825760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:55:54.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.836375+0000","last_change":"2024-04-21T10:20:15.835895+0000","last_active":"2024-04-21T10:20:15.836375+0000","last_peered":"2024-04-21T10:20:15.836375+0000","last_clean":"2024-04-21T10:20:15.836375+0000","last_became_active":"2024-04-21T10:20:15.828529+0000","last_became_peered":"2024-04-21T10:20:15.828529+0000","last_unstale":"2024-04-21T10:20:15.836375+0000","last_undegraded":"2024-04-21T10:20:15.836375+0000","last_fullsized":"2024-04-21T10:20:15.836375+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:09.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825767+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:20:15.825767+0000","last_peered":"2024-04-21T10:20:15.825767+0000","last_clean":"2024-04-21T10:20:15.825767+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:20:15.825767+0000","last_undegraded":"2024-04-21T10:20:15.825767+0000","last_fullsized":"2024-04-21T10:20:15.825767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:12:42.198001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:33.085380+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:20:33.085380+0000","last_peered":"2024-04-21T10:20:33.085380+0000","last_clean":"2024-04-21T10:20:33.085380+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:20:33.085380+0000","last_undegraded":"2024-04-21T10:20:33.085380+0000","last_fullsized":"2024-04-21T10:20:33.085380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822209+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:20:15.822209+0000","last_peered":"2024-04-21T10:20:15.822209+0000","last_clean":"2024-04-21T10:20:15.822209+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:20:15.822209+0000","last_undegraded":"2024-04-21T10:20:15.822209+0000","last_fullsized":"2024-04-21T10:20:15.822209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825018+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:20:15.825018+0000","last_peered":"2024-04-21T10:20:15.825018+0000","last_clean":"2024-04-21T10:20:15.825018+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:20:15.825018+0000","last_undegraded":"2024-04-21T10:20:15.825018+0000","last_fullsized":"2024-04-21T10:20:15.825018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825467+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:20:15.825467+0000","last_peered":"2024-04-21T10:20:15.825467+0000","last_clean":"2024-04-21T10:20:15.825467+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:20:15.825467+0000","last_undegraded":"2024-04-21T10:20:15.825467+0000","last_fullsized":"2024-04-21T10:20:15.825467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:48:22.623681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823249+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:20:15.823249+0000","last_peered":"2024-04-21T10:20:15.823249+0000","last_clean":"2024-04-21T10:20:15.823249+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:20:15.823249+0000","last_undegraded":"2024-04-21T10:20:15.823249+0000","last_fullsized":"2024-04-21T10:20:15.823249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825302+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:20:15.825302+0000","last_peered":"2024-04-21T10:20:15.825302+0000","last_clean":"2024-04-21T10:20:15.825302+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:20:15.825302+0000","last_undegraded":"2024-04-21T10:20:15.825302+0000","last_fullsized":"2024-04-21T10:20:15.825302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:54.824898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824938+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:20:15.824938+0000","last_peered":"2024-04-21T10:20:15.824938+0000","last_clean":"2024-04-21T10:20:15.824938+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:20:15.824938+0000","last_undegraded":"2024-04-21T10:20:15.824938+0000","last_fullsized":"2024-04-21T10:20:15.824938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822541+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:20:15.822541+0000","last_peered":"2024-04-21T10:20:15.822541+0000","last_clean":"2024-04-21T10:20:15.822541+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:20:15.822541+0000","last_undegraded":"2024-04-21T10:20:15.822541+0000","last_fullsized":"2024-04-21T10:20:15.822541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:32.082880+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:20:32.082880+0000","last_peered":"2024-04-21T10:20:32.082880+0000","last_clean":"2024-04-21T10:20:32.082880+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:20:32.082880+0000","last_undegraded":"2024-04-21T10:20:32.082880+0000","last_fullsized":"2024-04-21T10:20:32.082880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823989+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:20:15.823989+0000","last_peered":"2024-04-21T10:20:15.823989+0000","last_clean":"2024-04-21T10:20:15.823989+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:20:15.823989+0000","last_undegraded":"2024-04-21T10:20:15.823989+0000","last_fullsized":"2024-04-21T10:20:15.823989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:43.283515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826799+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:20:15.826799+0000","last_peered":"2024-04-21T10:20:15.826799+0000","last_clean":"2024-04-21T10:20:15.826799+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:20:15.826799+0000","last_undegraded":"2024-04-21T10:20:15.826799+0000","last_fullsized":"2024-04-21T10:20:15.826799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820166+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:20:15.820166+0000","last_peered":"2024-04-21T10:20:15.820166+0000","last_clean":"2024-04-21T10:20:15.820166+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:20:15.820166+0000","last_undegraded":"2024-04-21T10:20:15.820166+0000","last_fullsized":"2024-04-21T10:20:15.820166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825878+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:20:15.825878+0000","last_peered":"2024-04-21T10:20:15.825878+0000","last_clean":"2024-04-21T10:20:15.825878+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:20:15.825878+0000","last_undegraded":"2024-04-21T10:20:15.825878+0000","last_fullsized":"2024-04-21T10:20:15.825878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.828140+0000","last_change":"2024-04-21T10:20:15.828140+0000","last_active":"2024-04-21T10:20:15.828140+0000","last_peered":"2024-04-21T10:20:15.828140+0000","last_clean":"2024-04-21T10:20:15.828140+0000","last_became_active":"2024-04-21T10:20:15.827748+0000","last_became_peered":"2024-04-21T10:20:15.827748+0000","last_unstale":"2024-04-21T10:20:15.828140+0000","last_undegraded":"2024-04-21T10:20:15.828140+0000","last_fullsized":"2024-04-21T10:20:15.828140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:57.570062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'28","reported_seq":190,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:33.084487+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:20:33.084487+0000","last_peered":"2024-04-21T10:20:33.084487+0000","last_clean":"2024-04-21T10:20:33.084487+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:20:33.084487+0000","last_undegraded":"2024-04-21T10:20:33.084487+0000","last_fullsized":"2024-04-21T10:20:33.084487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58880,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821411+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:20:15.821411+0000","last_peered":"2024-04-21T10:20:15.821411+0000","last_clean":"2024-04-21T10:20:15.821411+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:20:15.821411+0000","last_undegraded":"2024-04-21T10:20:15.821411+0000","last_fullsized":"2024-04-21T10:20:15.821411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827037+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:20:15.827037+0000","last_peered":"2024-04-21T10:20:15.827037+0000","last_clean":"2024-04-21T10:20:15.827037+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:20:15.827037+0000","last_undegraded":"2024-04-21T10:20:15.827037+0000","last_fullsized":"2024-04-21T10:20:15.827037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823298+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:20:15.823298+0000","last_peered":"2024-04-21T10:20:15.823298+0000","last_clean":"2024-04-21T10:20:15.823298+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:20:15.823298+0000","last_undegraded":"2024-04-21T10:20:15.823298+0000","last_fullsized":"2024-04-21T10:20:15.823298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825293+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:20:15.825293+0000","last_peered":"2024-04-21T10:20:15.825293+0000","last_clean":"2024-04-21T10:20:15.825293+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:20:15.825293+0000","last_undegraded":"2024-04-21T10:20:15.825293+0000","last_fullsized":"2024-04-21T10:20:15.825293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826687+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:20:15.826687+0000","last_peered":"2024-04-21T10:20:15.826687+0000","last_clean":"2024-04-21T10:20:15.826687+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:20:15.826687+0000","last_undegraded":"2024-04-21T10:20:15.826687+0000","last_fullsized":"2024-04-21T10:20:15.826687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:52:23.121128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:36.107901+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:20:36.107901+0000","last_peered":"2024-04-21T10:20:36.107901+0000","last_clean":"2024-04-21T10:20:36.107901+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:20:36.107901+0000","last_undegraded":"2024-04-21T10:20:36.107901+0000","last_fullsized":"2024-04-21T10:20:36.107901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825732+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:20:15.825732+0000","last_peered":"2024-04-21T10:20:15.825732+0000","last_clean":"2024-04-21T10:20:15.825732+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:20:15.825732+0000","last_undegraded":"2024-04-21T10:20:15.825732+0000","last_fullsized":"2024-04-21T10:20:15.825732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:19:57.323697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.847516+0000","last_change":"2024-04-21T10:20:15.847040+0000","last_active":"2024-04-21T10:20:15.847516+0000","last_peered":"2024-04-21T10:20:15.847516+0000","last_clean":"2024-04-21T10:20:15.847516+0000","last_became_active":"2024-04-21T10:20:15.828688+0000","last_became_peered":"2024-04-21T10:20:15.828688+0000","last_unstale":"2024-04-21T10:20:15.847516+0000","last_undegraded":"2024-04-21T10:20:15.847516+0000","last_fullsized":"2024-04-21T10:20:15.847516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:42:55.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825079+0000","last_change":"2024-04-21T10:20:15.824670+0000","last_active":"2024-04-21T10:20:15.825079+0000","last_peered":"2024-04-21T10:20:15.825079+0000","last_clean":"2024-04-21T10:20:15.825079+0000","last_became_active":"2024-04-21T10:20:15.824428+0000","last_became_peered":"2024-04-21T10:20:15.824428+0000","last_unstale":"2024-04-21T10:20:15.825079+0000","last_undegraded":"2024-04-21T10:20:15.825079+0000","last_fullsized":"2024-04-21T10:20:15.825079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:23:50.732573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821840+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:20:15.821840+0000","last_peered":"2024-04-21T10:20:15.821840+0000","last_clean":"2024-04-21T10:20:15.821840+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:20:15.821840+0000","last_undegraded":"2024-04-21T10:20:15.821840+0000","last_fullsized":"2024-04-21T10:20:15.821840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822062+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:20:15.822062+0000","last_peered":"2024-04-21T10:20:15.822062+0000","last_clean":"2024-04-21T10:20:15.822062+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:20:15.822062+0000","last_undegraded":"2024-04-21T10:20:15.822062+0000","last_fullsized":"2024-04-21T10:20:15.822062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:44:18.798775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822198+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:20:15.822198+0000","last_peered":"2024-04-21T10:20:15.822198+0000","last_clean":"2024-04-21T10:20:15.822198+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:20:15.822198+0000","last_undegraded":"2024-04-21T10:20:15.822198+0000","last_fullsized":"2024-04-21T10:20:15.822198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824687+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:20:15.824687+0000","last_peered":"2024-04-21T10:20:15.824687+0000","last_clean":"2024-04-21T10:20:15.824687+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:20:15.824687+0000","last_undegraded":"2024-04-21T10:20:15.824687+0000","last_fullsized":"2024-04-21T10:20:15.824687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:39:16.369964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826430+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:20:15.826430+0000","last_peered":"2024-04-21T10:20:15.826430+0000","last_clean":"2024-04-21T10:20:15.826430+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:20:15.826430+0000","last_undegraded":"2024-04-21T10:20:15.826430+0000","last_fullsized":"2024-04-21T10:20:15.826430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824069+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:20:15.824069+0000","last_peered":"2024-04-21T10:20:15.824069+0000","last_clean":"2024-04-21T10:20:15.824069+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:20:15.824069+0000","last_undegraded":"2024-04-21T10:20:15.824069+0000","last_fullsized":"2024-04-21T10:20:15.824069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:05:27.020650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825018+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:20:15.825018+0000","last_peered":"2024-04-21T10:20:15.825018+0000","last_clean":"2024-04-21T10:20:15.825018+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:20:15.825018+0000","last_undegraded":"2024-04-21T10:20:15.825018+0000","last_fullsized":"2024-04-21T10:20:15.825018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:05:15.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":91,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:33.102242+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:20:33.102242+0000","last_peered":"2024-04-21T10:20:33.102242+0000","last_clean":"2024-04-21T10:20:33.102242+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:20:33.102242+0000","last_undegraded":"2024-04-21T10:20:33.102242+0000","last_fullsized":"2024-04-21T10:20:33.102242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825712+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:20:15.825712+0000","last_peered":"2024-04-21T10:20:15.825712+0000","last_clean":"2024-04-21T10:20:15.825712+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:20:15.825712+0000","last_undegraded":"2024-04-21T10:20:15.825712+0000","last_fullsized":"2024-04-21T10:20:15.825712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:41:15.466810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820859+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:20:15.820859+0000","last_peered":"2024-04-21T10:20:15.820859+0000","last_clean":"2024-04-21T10:20:15.820859+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:20:15.820859+0000","last_undegraded":"2024-04-21T10:20:15.820859+0000","last_fullsized":"2024-04-21T10:20:15.820859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":353,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825847+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:20:15.825847+0000","last_peered":"2024-04-21T10:20:15.825847+0000","last_clean":"2024-04-21T10:20:15.825847+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:20:15.825847+0000","last_undegraded":"2024-04-21T10:20:15.825847+0000","last_fullsized":"2024-04-21T10:20:15.825847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823079+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:20:15.823079+0000","last_peered":"2024-04-21T10:20:15.823079+0000","last_clean":"2024-04-21T10:20:15.823079+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:20:15.823079+0000","last_undegraded":"2024-04-21T10:20:15.823079+0000","last_fullsized":"2024-04-21T10:20:15.823079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826016+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:20:15.826016+0000","last_peered":"2024-04-21T10:20:15.826016+0000","last_clean":"2024-04-21T10:20:15.826016+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:20:15.826016+0000","last_undegraded":"2024-04-21T10:20:15.826016+0000","last_fullsized":"2024-04-21T10:20:15.826016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821554+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:20:15.821554+0000","last_peered":"2024-04-21T10:20:15.821554+0000","last_clean":"2024-04-21T10:20:15.821554+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:20:15.821554+0000","last_undegraded":"2024-04-21T10:20:15.821554+0000","last_fullsized":"2024-04-21T10:20:15.821554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823222+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:20:15.823222+0000","last_peered":"2024-04-21T10:20:15.823222+0000","last_clean":"2024-04-21T10:20:15.823222+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:20:15.823222+0000","last_undegraded":"2024-04-21T10:20:15.823222+0000","last_fullsized":"2024-04-21T10:20:15.823222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822421+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:20:15.822421+0000","last_peered":"2024-04-21T10:20:15.822421+0000","last_clean":"2024-04-21T10:20:15.822421+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:20:15.822421+0000","last_undegraded":"2024-04-21T10:20:15.822421+0000","last_fullsized":"2024-04-21T10:20:15.822421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827008+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:20:15.827008+0000","last_peered":"2024-04-21T10:20:15.827008+0000","last_clean":"2024-04-21T10:20:15.827008+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:20:15.827008+0000","last_undegraded":"2024-04-21T10:20:15.827008+0000","last_fullsized":"2024-04-21T10:20:15.827008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:17.595175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821108+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:20:15.821108+0000","last_peered":"2024-04-21T10:20:15.821108+0000","last_clean":"2024-04-21T10:20:15.821108+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:20:15.821108+0000","last_undegraded":"2024-04-21T10:20:15.821108+0000","last_fullsized":"2024-04-21T10:20:15.821108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819960+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:20:15.819960+0000","last_peered":"2024-04-21T10:20:15.819960+0000","last_clean":"2024-04-21T10:20:15.819960+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:20:15.819960+0000","last_undegraded":"2024-04-21T10:20:15.819960+0000","last_fullsized":"2024-04-21T10:20:15.819960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822946+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:20:15.822946+0000","last_peered":"2024-04-21T10:20:15.822946+0000","last_clean":"2024-04-21T10:20:15.822946+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:20:15.822946+0000","last_undegraded":"2024-04-21T10:20:15.822946+0000","last_fullsized":"2024-04-21T10:20:15.822946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820972+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:20:15.820972+0000","last_peered":"2024-04-21T10:20:15.820972+0000","last_clean":"2024-04-21T10:20:15.820972+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:20:15.820972+0000","last_undegraded":"2024-04-21T10:20:15.820972+0000","last_fullsized":"2024-04-21T10:20:15.820972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825986+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:20:15.825986+0000","last_peered":"2024-04-21T10:20:15.825986+0000","last_clean":"2024-04-21T10:20:15.825986+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:20:15.825986+0000","last_undegraded":"2024-04-21T10:20:15.825986+0000","last_fullsized":"2024-04-21T10:20:15.825986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822561+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:20:15.822561+0000","last_peered":"2024-04-21T10:20:15.822561+0000","last_clean":"2024-04-21T10:20:15.822561+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:20:15.822561+0000","last_undegraded":"2024-04-21T10:20:15.822561+0000","last_fullsized":"2024-04-21T10:20:15.822561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:16:31.547608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826844+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:20:15.826844+0000","last_peered":"2024-04-21T10:20:15.826844+0000","last_clean":"2024-04-21T10:20:15.826844+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:20:15.826844+0000","last_undegraded":"2024-04-21T10:20:15.826844+0000","last_fullsized":"2024-04-21T10:20:15.826844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826592+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:20:15.826592+0000","last_peered":"2024-04-21T10:20:15.826592+0000","last_clean":"2024-04-21T10:20:15.826592+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:20:15.826592+0000","last_undegraded":"2024-04-21T10:20:15.826592+0000","last_fullsized":"2024-04-21T10:20:15.826592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:34:48.679940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821134+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:20:15.821134+0000","last_peered":"2024-04-21T10:20:15.821134+0000","last_clean":"2024-04-21T10:20:15.821134+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:20:15.821134+0000","last_undegraded":"2024-04-21T10:20:15.821134+0000","last_fullsized":"2024-04-21T10:20:15.821134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826515+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:20:15.826515+0000","last_peered":"2024-04-21T10:20:15.826515+0000","last_clean":"2024-04-21T10:20:15.826515+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:20:15.826515+0000","last_undegraded":"2024-04-21T10:20:15.826515+0000","last_fullsized":"2024-04-21T10:20:15.826515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:52:13.768086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827489+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:20:15.827489+0000","last_peered":"2024-04-21T10:20:15.827489+0000","last_clean":"2024-04-21T10:20:15.827489+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:20:15.827489+0000","last_undegraded":"2024-04-21T10:20:15.827489+0000","last_fullsized":"2024-04-21T10:20:15.827489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826935+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:20:15.826935+0000","last_peered":"2024-04-21T10:20:15.826935+0000","last_clean":"2024-04-21T10:20:15.826935+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:20:15.826935+0000","last_undegraded":"2024-04-21T10:20:15.826935+0000","last_fullsized":"2024-04-21T10:20:15.826935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:20:52.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825643+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:20:15.825643+0000","last_peered":"2024-04-21T10:20:15.825643+0000","last_clean":"2024-04-21T10:20:15.825643+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:20:15.825643+0000","last_undegraded":"2024-04-21T10:20:15.825643+0000","last_fullsized":"2024-04-21T10:20:15.825643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826680+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:20:15.826680+0000","last_peered":"2024-04-21T10:20:15.826680+0000","last_clean":"2024-04-21T10:20:15.826680+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:20:15.826680+0000","last_undegraded":"2024-04-21T10:20:15.826680+0000","last_fullsized":"2024-04-21T10:20:15.826680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:34:13.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.830810+0000","last_change":"2024-04-21T10:20:15.830810+0000","last_active":"2024-04-21T10:20:15.830810+0000","last_peered":"2024-04-21T10:20:15.830810+0000","last_clean":"2024-04-21T10:20:15.830810+0000","last_became_active":"2024-04-21T10:20:15.826657+0000","last_became_peered":"2024-04-21T10:20:15.826657+0000","last_unstale":"2024-04-21T10:20:15.830810+0000","last_undegraded":"2024-04-21T10:20:15.830810+0000","last_fullsized":"2024-04-21T10:20:15.830810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:12:19.425100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827025+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:20:15.827025+0000","last_peered":"2024-04-21T10:20:15.827025+0000","last_clean":"2024-04-21T10:20:15.827025+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:20:15.827025+0000","last_undegraded":"2024-04-21T10:20:15.827025+0000","last_fullsized":"2024-04-21T10:20:15.827025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:10:06.613615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822689+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:20:15.822689+0000","last_peered":"2024-04-21T10:20:15.822689+0000","last_clean":"2024-04-21T10:20:15.822689+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:20:15.822689+0000","last_undegraded":"2024-04-21T10:20:15.822689+0000","last_fullsized":"2024-04-21T10:20:15.822689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:54:10.827986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826535+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:20:15.826535+0000","last_peered":"2024-04-21T10:20:15.826535+0000","last_clean":"2024-04-21T10:20:15.826535+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:20:15.826535+0000","last_undegraded":"2024-04-21T10:20:15.826535+0000","last_fullsized":"2024-04-21T10:20:15.826535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:30:54.398105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826749+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:20:15.826749+0000","last_peered":"2024-04-21T10:20:15.826749+0000","last_clean":"2024-04-21T10:20:15.826749+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:20:15.826749+0000","last_undegraded":"2024-04-21T10:20:15.826749+0000","last_fullsized":"2024-04-21T10:20:15.826749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:15.894562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820292+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:20:15.820292+0000","last_peered":"2024-04-21T10:20:15.820292+0000","last_clean":"2024-04-21T10:20:15.820292+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:20:15.820292+0000","last_undegraded":"2024-04-21T10:20:15.820292+0000","last_fullsized":"2024-04-21T10:20:15.820292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823257+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:20:15.823257+0000","last_peered":"2024-04-21T10:20:15.823257+0000","last_clean":"2024-04-21T10:20:15.823257+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:20:15.823257+0000","last_undegraded":"2024-04-21T10:20:15.823257+0000","last_fullsized":"2024-04-21T10:20:15.823257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821936+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:20:15.821936+0000","last_peered":"2024-04-21T10:20:15.821936+0000","last_clean":"2024-04-21T10:20:15.821936+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:20:15.821936+0000","last_undegraded":"2024-04-21T10:20:15.821936+0000","last_fullsized":"2024-04-21T10:20:15.821936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:55:02.979989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827995+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:20:15.827995+0000","last_peered":"2024-04-21T10:20:15.827995+0000","last_clean":"2024-04-21T10:20:15.827995+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:20:15.827995+0000","last_undegraded":"2024-04-21T10:20:15.827995+0000","last_fullsized":"2024-04-21T10:20:15.827995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:14:13.509778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.831009+0000","last_change":"2024-04-21T10:20:15.830207+0000","last_active":"2024-04-21T10:20:15.831009+0000","last_peered":"2024-04-21T10:20:15.831009+0000","last_clean":"2024-04-21T10:20:15.831009+0000","last_became_active":"2024-04-21T10:20:15.829809+0000","last_became_peered":"2024-04-21T10:20:15.829809+0000","last_unstale":"2024-04-21T10:20:15.831009+0000","last_undegraded":"2024-04-21T10:20:15.831009+0000","last_fullsized":"2024-04-21T10:20:15.831009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:21:03.485624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824892+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:20:15.824892+0000","last_peered":"2024-04-21T10:20:15.824892+0000","last_clean":"2024-04-21T10:20:15.824892+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:20:15.824892+0000","last_undegraded":"2024-04-21T10:20:15.824892+0000","last_fullsized":"2024-04-21T10:20:15.824892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:44:20.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825887+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:20:15.825887+0000","last_peered":"2024-04-21T10:20:15.825887+0000","last_clean":"2024-04-21T10:20:15.825887+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:20:15.825887+0000","last_undegraded":"2024-04-21T10:20:15.825887+0000","last_fullsized":"2024-04-21T10:20:15.825887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:48:22.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823974+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:20:15.823974+0000","last_peered":"2024-04-21T10:20:15.823974+0000","last_clean":"2024-04-21T10:20:15.823974+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:20:15.823974+0000","last_undegraded":"2024-04-21T10:20:15.823974+0000","last_fullsized":"2024-04-21T10:20:15.823974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:18:46.271474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823626+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:20:15.823626+0000","last_peered":"2024-04-21T10:20:15.823626+0000","last_clean":"2024-04-21T10:20:15.823626+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:20:15.823626+0000","last_undegraded":"2024-04-21T10:20:15.823626+0000","last_fullsized":"2024-04-21T10:20:15.823626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822557+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:20:15.822557+0000","last_peered":"2024-04-21T10:20:15.822557+0000","last_clean":"2024-04-21T10:20:15.822557+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:20:15.822557+0000","last_undegraded":"2024-04-21T10:20:15.822557+0000","last_fullsized":"2024-04-21T10:20:15.822557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:32:45.653309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249634,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63272,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":438,"num_read_kb":283,"num_write":156,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383709,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":456317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":1106957,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":958464,"data_stored":456441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070509,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":456249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":1048682,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":455830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":514503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":457101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":516244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":456141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920833,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":456658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757308,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":1047975,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:20:40.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-21T10:20:40.748 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:40 smithi170 ceph-mon[31212]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:20:41.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:40 smithi077 ceph-mon[27902]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:20:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:40 smithi191 ceph-mon[31636]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:20:41.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:41 smithi077 ceph-mon[27902]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:20:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:41 smithi170 ceph-mon[31212]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:20:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:41 smithi191 ceph-mon[31636]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:20:42.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 -- 172.21.15.77:0/26414868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 msgr2=0x7fb89410f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:42.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/26414868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89410f810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00b0a0 tx=0x7fb88c00b3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 -- 172.21.15.77:0/26414868 shutdown_connections 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/26414868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb894107b00 0x7fb894107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/26414868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89410f810 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/26414868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8941013e0 0x7fb894101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 -- 172.21.15.77:0/26414868 >> 172.21.15.77:0/26414868 conn(0x7fb894076c60 msgr2=0x7fb894077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 -- 172.21.15.77:0/26414868 shutdown_connections 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.450+0000 7fb89b6c0700 1 -- 172.21.15.77:0/26414868 wait complete. 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 Processor -- start 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 -- start start 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8941013e0 0x7fb89419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb894107b00 0x7fb89419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb894112c90 con 0x7fb894101da0 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb894112b10 con 0x7fb8941013e0 2024-04-21T10:20:42.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89b6c0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb894112e10 con 0x7fb894107b00 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49154/0 (socket says 172.21.15.77:49154) 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 -- 172.21.15.77:0/193861842 learned_addr learned my addr 172.21.15.77:0/193861842 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89945c700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8941013e0 0x7fb89419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb899c5d700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb894107b00 0x7fb89419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 -- 172.21.15.77:0/193861842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb894107b00 msgr2=0x7fb89419fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb894107b00 0x7fb89419fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 -- 172.21.15.77:0/193861842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8941013e0 msgr2=0x7fb89419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8941013e0 0x7fb89419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb898c5b700 1 -- 172.21.15.77:0/193861842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8941a0260 con 0x7fb894101da0 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb89945c700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8941013e0 0x7fb89419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.451+0000 7fb899c5d700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb894107b00 0x7fb89419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:42.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.452+0000 7fb898c5b700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89419b790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb88400b530 tx=0x7fb88400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.452+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884015020 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.452+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb884011ce0 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.452+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8941a0550 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.452+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884010d20 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.452+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8941a7dd0 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.453+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb894069730 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.454+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb884018020 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.454+0000 7fb88a7fc700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb8800a3cd0 0x7fb8800a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.455+0000 7fb89945c700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb8800a3cd0 0x7fb8800a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.455+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fb8840cfcb0 con 0x7fb894101da0 2024-04-21T10:20:42.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.455+0000 7fb89945c700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb8800a3cd0 0x7fb8800a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb890005fd0 tx=0x7fb890005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:42.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.459+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb88401f020 con 0x7fb894101da0 2024-04-21T10:20:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.657+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb894100420 con 0x7fb8800a3cd0 2024-04-21T10:20:42.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.665+0000 7fb88a7fc700 1 -- 172.21.15.77:0/193861842 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258862 (secure 0 0 0) 0x7fb894100420 con 0x7fb8800a3cd0 2024-04-21T10:20:42.668 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.668+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb8800a3cd0 msgr2=0x7fb8800a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.668+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb8800a3cd0 0x7fb8800a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb890005fd0 tx=0x7fb890005e40 comp rx=0 tx=0).stop 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 msgr2=0x7fb89419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89419b790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb88400b530 tx=0x7fb88400b8f0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 shutdown_connections 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fb8800a3cd0 0x7fb8800a6190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8941013e0 0x7fb89419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb894107b00 0x7fb89419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 --2- 172.21.15.77:0/193861842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb894101da0 0x7fb89419b790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:42.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 >> 172.21.15.77:0/193861842 conn(0x7fb894076c60 msgr2=0x7fb8940ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:42.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 shutdown_connections 2024-04-21T10:20:42.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:42.669+0000 7fb89b6c0700 1 -- 172.21.15.77:0/193861842 wait complete. 2024-04-21T10:20:42.671 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:20:43.379 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-04-21T10:20:40.692242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653874,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":599,"num_read_kb":417,"num_write":339,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360784,"kb_used_data":11568,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581040,"statfs":{"total":1151940427776,"available":1151570984960,"internally_reserved":0,"allocated":11845632,"data_stored":7429098,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19137,"internal_metadata":357414207},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003075"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822331+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:20:15.822331+0000","last_peered":"2024-04-21T10:20:15.822331+0000","last_clean":"2024-04-21T10:20:15.822331+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:20:15.822331+0000","last_undegraded":"2024-04-21T10:20:15.822331+0000","last_fullsized":"2024-04-21T10:20:15.822331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:06:40.220736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819966+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:20:15.819966+0000","last_peered":"2024-04-21T10:20:15.819966+0000","last_clean":"2024-04-21T10:20:15.819966+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:20:15.819966+0000","last_undegraded":"2024-04-21T10:20:15.819966+0000","last_fullsized":"2024-04-21T10:20:15.819966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820331+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:20:15.820331+0000","last_peered":"2024-04-21T10:20:15.820331+0000","last_clean":"2024-04-21T10:20:15.820331+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:20:15.820331+0000","last_undegraded":"2024-04-21T10:20:15.820331+0000","last_fullsized":"2024-04-21T10:20:15.820331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821083+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:20:15.821083+0000","last_peered":"2024-04-21T10:20:15.821083+0000","last_clean":"2024-04-21T10:20:15.821083+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:20:15.821083+0000","last_undegraded":"2024-04-21T10:20:15.821083+0000","last_fullsized":"2024-04-21T10:20:15.821083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821055+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:20:15.821055+0000","last_peered":"2024-04-21T10:20:15.821055+0000","last_clean":"2024-04-21T10:20:15.821055+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:20:15.821055+0000","last_undegraded":"2024-04-21T10:20:15.821055+0000","last_fullsized":"2024-04-21T10:20:15.821055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825168+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:20:15.825168+0000","last_peered":"2024-04-21T10:20:15.825168+0000","last_clean":"2024-04-21T10:20:15.825168+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:20:15.825168+0000","last_undegraded":"2024-04-21T10:20:15.825168+0000","last_fullsized":"2024-04-21T10:20:15.825168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:57.136408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826151+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:20:15.826151+0000","last_peered":"2024-04-21T10:20:15.826151+0000","last_clean":"2024-04-21T10:20:15.826151+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:20:15.826151+0000","last_undegraded":"2024-04-21T10:20:15.826151+0000","last_fullsized":"2024-04-21T10:20:15.826151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:17.305626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825192+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:20:15.825192+0000","last_peered":"2024-04-21T10:20:15.825192+0000","last_clean":"2024-04-21T10:20:15.825192+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:20:15.825192+0000","last_undegraded":"2024-04-21T10:20:15.825192+0000","last_fullsized":"2024-04-21T10:20:15.825192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:52.203999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823872+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:20:15.823872+0000","last_peered":"2024-04-21T10:20:15.823872+0000","last_clean":"2024-04-21T10:20:15.823872+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:20:15.823872+0000","last_undegraded":"2024-04-21T10:20:15.823872+0000","last_fullsized":"2024-04-21T10:20:15.823872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:26:01.902847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.830905+0000","last_change":"2024-04-21T10:20:15.830905+0000","last_active":"2024-04-21T10:20:15.830905+0000","last_peered":"2024-04-21T10:20:15.830905+0000","last_clean":"2024-04-21T10:20:15.830905+0000","last_became_active":"2024-04-21T10:20:15.830536+0000","last_became_peered":"2024-04-21T10:20:15.830536+0000","last_unstale":"2024-04-21T10:20:15.830905+0000","last_undegraded":"2024-04-21T10:20:15.830905+0000","last_fullsized":"2024-04-21T10:20:15.830905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:02:48.213874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827144+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:20:15.827144+0000","last_peered":"2024-04-21T10:20:15.827144+0000","last_clean":"2024-04-21T10:20:15.827144+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:20:15.827144+0000","last_undegraded":"2024-04-21T10:20:15.827144+0000","last_fullsized":"2024-04-21T10:20:15.827144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:52:25.586003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820946+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:20:15.820946+0000","last_peered":"2024-04-21T10:20:15.820946+0000","last_clean":"2024-04-21T10:20:15.820946+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:20:15.820946+0000","last_undegraded":"2024-04-21T10:20:15.820946+0000","last_fullsized":"2024-04-21T10:20:15.820946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823536+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:20:15.823536+0000","last_peered":"2024-04-21T10:20:15.823536+0000","last_clean":"2024-04-21T10:20:15.823536+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:20:15.823536+0000","last_undegraded":"2024-04-21T10:20:15.823536+0000","last_fullsized":"2024-04-21T10:20:15.823536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819951+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:20:15.819951+0000","last_peered":"2024-04-21T10:20:15.819951+0000","last_clean":"2024-04-21T10:20:15.819951+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:20:15.819951+0000","last_undegraded":"2024-04-21T10:20:15.819951+0000","last_fullsized":"2024-04-21T10:20:15.819951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819817+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:20:15.819817+0000","last_peered":"2024-04-21T10:20:15.819817+0000","last_clean":"2024-04-21T10:20:15.819817+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:20:15.819817+0000","last_undegraded":"2024-04-21T10:20:15.819817+0000","last_fullsized":"2024-04-21T10:20:15.819817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822794+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:20:15.822794+0000","last_peered":"2024-04-21T10:20:15.822794+0000","last_clean":"2024-04-21T10:20:15.822794+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:20:15.822794+0000","last_undegraded":"2024-04-21T10:20:15.822794+0000","last_fullsized":"2024-04-21T10:20:15.822794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:04:32.551997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822602+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:20:15.822602+0000","last_peered":"2024-04-21T10:20:15.822602+0000","last_clean":"2024-04-21T10:20:15.822602+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:20:15.822602+0000","last_undegraded":"2024-04-21T10:20:15.822602+0000","last_fullsized":"2024-04-21T10:20:15.822602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:10:09.025923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822318+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:20:15.822318+0000","last_peered":"2024-04-21T10:20:15.822318+0000","last_clean":"2024-04-21T10:20:15.822318+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:20:15.822318+0000","last_undegraded":"2024-04-21T10:20:15.822318+0000","last_fullsized":"2024-04-21T10:20:15.822318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827176+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:20:15.827176+0000","last_peered":"2024-04-21T10:20:15.827176+0000","last_clean":"2024-04-21T10:20:15.827176+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:20:15.827176+0000","last_undegraded":"2024-04-21T10:20:15.827176+0000","last_fullsized":"2024-04-21T10:20:15.827176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:37:23.490245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822727+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:20:15.822727+0000","last_peered":"2024-04-21T10:20:15.822727+0000","last_clean":"2024-04-21T10:20:15.822727+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:20:15.822727+0000","last_undegraded":"2024-04-21T10:20:15.822727+0000","last_fullsized":"2024-04-21T10:20:15.822727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826260+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:20:15.826260+0000","last_peered":"2024-04-21T10:20:15.826260+0000","last_clean":"2024-04-21T10:20:15.826260+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:20:15.826260+0000","last_undegraded":"2024-04-21T10:20:15.826260+0000","last_fullsized":"2024-04-21T10:20:15.826260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:26.283821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827152+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:20:15.827152+0000","last_peered":"2024-04-21T10:20:15.827152+0000","last_clean":"2024-04-21T10:20:15.827152+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:20:15.827152+0000","last_undegraded":"2024-04-21T10:20:15.827152+0000","last_fullsized":"2024-04-21T10:20:15.827152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820231+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:20:15.820231+0000","last_peered":"2024-04-21T10:20:15.820231+0000","last_clean":"2024-04-21T10:20:15.820231+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:20:15.820231+0000","last_undegraded":"2024-04-21T10:20:15.820231+0000","last_fullsized":"2024-04-21T10:20:15.820231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.833712+0000","last_change":"2024-04-21T10:20:15.833712+0000","last_active":"2024-04-21T10:20:15.833712+0000","last_peered":"2024-04-21T10:20:15.833712+0000","last_clean":"2024-04-21T10:20:15.833712+0000","last_became_active":"2024-04-21T10:20:15.827691+0000","last_became_peered":"2024-04-21T10:20:15.827691+0000","last_unstale":"2024-04-21T10:20:15.833712+0000","last_undegraded":"2024-04-21T10:20:15.833712+0000","last_fullsized":"2024-04-21T10:20:15.833712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:32:14.844485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825760+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:20:15.825760+0000","last_peered":"2024-04-21T10:20:15.825760+0000","last_clean":"2024-04-21T10:20:15.825760+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:20:15.825760+0000","last_undegraded":"2024-04-21T10:20:15.825760+0000","last_fullsized":"2024-04-21T10:20:15.825760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:55:54.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.836375+0000","last_change":"2024-04-21T10:20:15.835895+0000","last_active":"2024-04-21T10:20:15.836375+0000","last_peered":"2024-04-21T10:20:15.836375+0000","last_clean":"2024-04-21T10:20:15.836375+0000","last_became_active":"2024-04-21T10:20:15.828529+0000","last_became_peered":"2024-04-21T10:20:15.828529+0000","last_unstale":"2024-04-21T10:20:15.836375+0000","last_undegraded":"2024-04-21T10:20:15.836375+0000","last_fullsized":"2024-04-21T10:20:15.836375+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:09.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825767+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:20:15.825767+0000","last_peered":"2024-04-21T10:20:15.825767+0000","last_clean":"2024-04-21T10:20:15.825767+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:20:15.825767+0000","last_undegraded":"2024-04-21T10:20:15.825767+0000","last_fullsized":"2024-04-21T10:20:15.825767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:12:42.198001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":102,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:38.093078+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:20:38.093078+0000","last_peered":"2024-04-21T10:20:38.093078+0000","last_clean":"2024-04-21T10:20:38.093078+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:20:38.093078+0000","last_undegraded":"2024-04-21T10:20:38.093078+0000","last_fullsized":"2024-04-21T10:20:38.093078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822209+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:20:15.822209+0000","last_peered":"2024-04-21T10:20:15.822209+0000","last_clean":"2024-04-21T10:20:15.822209+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:20:15.822209+0000","last_undegraded":"2024-04-21T10:20:15.822209+0000","last_fullsized":"2024-04-21T10:20:15.822209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825018+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:20:15.825018+0000","last_peered":"2024-04-21T10:20:15.825018+0000","last_clean":"2024-04-21T10:20:15.825018+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:20:15.825018+0000","last_undegraded":"2024-04-21T10:20:15.825018+0000","last_fullsized":"2024-04-21T10:20:15.825018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825467+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:20:15.825467+0000","last_peered":"2024-04-21T10:20:15.825467+0000","last_clean":"2024-04-21T10:20:15.825467+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:20:15.825467+0000","last_undegraded":"2024-04-21T10:20:15.825467+0000","last_fullsized":"2024-04-21T10:20:15.825467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:48:22.623681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823249+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:20:15.823249+0000","last_peered":"2024-04-21T10:20:15.823249+0000","last_clean":"2024-04-21T10:20:15.823249+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:20:15.823249+0000","last_undegraded":"2024-04-21T10:20:15.823249+0000","last_fullsized":"2024-04-21T10:20:15.823249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825302+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:20:15.825302+0000","last_peered":"2024-04-21T10:20:15.825302+0000","last_clean":"2024-04-21T10:20:15.825302+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:20:15.825302+0000","last_undegraded":"2024-04-21T10:20:15.825302+0000","last_fullsized":"2024-04-21T10:20:15.825302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:54.824898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824938+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:20:15.824938+0000","last_peered":"2024-04-21T10:20:15.824938+0000","last_clean":"2024-04-21T10:20:15.824938+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:20:15.824938+0000","last_undegraded":"2024-04-21T10:20:15.824938+0000","last_fullsized":"2024-04-21T10:20:15.824938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822541+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:20:15.822541+0000","last_peered":"2024-04-21T10:20:15.822541+0000","last_clean":"2024-04-21T10:20:15.822541+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:20:15.822541+0000","last_undegraded":"2024-04-21T10:20:15.822541+0000","last_fullsized":"2024-04-21T10:20:15.822541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:37.090901+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:20:37.090901+0000","last_peered":"2024-04-21T10:20:37.090901+0000","last_clean":"2024-04-21T10:20:37.090901+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:20:37.090901+0000","last_undegraded":"2024-04-21T10:20:37.090901+0000","last_fullsized":"2024-04-21T10:20:37.090901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823989+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:20:15.823989+0000","last_peered":"2024-04-21T10:20:15.823989+0000","last_clean":"2024-04-21T10:20:15.823989+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:20:15.823989+0000","last_undegraded":"2024-04-21T10:20:15.823989+0000","last_fullsized":"2024-04-21T10:20:15.823989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:43.283515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826799+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:20:15.826799+0000","last_peered":"2024-04-21T10:20:15.826799+0000","last_clean":"2024-04-21T10:20:15.826799+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:20:15.826799+0000","last_undegraded":"2024-04-21T10:20:15.826799+0000","last_fullsized":"2024-04-21T10:20:15.826799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820166+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:20:15.820166+0000","last_peered":"2024-04-21T10:20:15.820166+0000","last_clean":"2024-04-21T10:20:15.820166+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:20:15.820166+0000","last_undegraded":"2024-04-21T10:20:15.820166+0000","last_fullsized":"2024-04-21T10:20:15.820166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825878+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:20:15.825878+0000","last_peered":"2024-04-21T10:20:15.825878+0000","last_clean":"2024-04-21T10:20:15.825878+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:20:15.825878+0000","last_undegraded":"2024-04-21T10:20:15.825878+0000","last_fullsized":"2024-04-21T10:20:15.825878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.828140+0000","last_change":"2024-04-21T10:20:15.828140+0000","last_active":"2024-04-21T10:20:15.828140+0000","last_peered":"2024-04-21T10:20:15.828140+0000","last_clean":"2024-04-21T10:20:15.828140+0000","last_became_active":"2024-04-21T10:20:15.827748+0000","last_became_peered":"2024-04-21T10:20:15.827748+0000","last_unstale":"2024-04-21T10:20:15.828140+0000","last_undegraded":"2024-04-21T10:20:15.828140+0000","last_fullsized":"2024-04-21T10:20:15.828140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:57.570062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'28","reported_seq":200,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:38.092366+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:20:38.092366+0000","last_peered":"2024-04-21T10:20:38.092366+0000","last_clean":"2024-04-21T10:20:38.092366+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:20:38.092366+0000","last_undegraded":"2024-04-21T10:20:38.092366+0000","last_fullsized":"2024-04-21T10:20:38.092366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58880,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":133,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821411+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:20:15.821411+0000","last_peered":"2024-04-21T10:20:15.821411+0000","last_clean":"2024-04-21T10:20:15.821411+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:20:15.821411+0000","last_undegraded":"2024-04-21T10:20:15.821411+0000","last_fullsized":"2024-04-21T10:20:15.821411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827037+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:20:15.827037+0000","last_peered":"2024-04-21T10:20:15.827037+0000","last_clean":"2024-04-21T10:20:15.827037+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:20:15.827037+0000","last_undegraded":"2024-04-21T10:20:15.827037+0000","last_fullsized":"2024-04-21T10:20:15.827037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823298+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:20:15.823298+0000","last_peered":"2024-04-21T10:20:15.823298+0000","last_clean":"2024-04-21T10:20:15.823298+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:20:15.823298+0000","last_undegraded":"2024-04-21T10:20:15.823298+0000","last_fullsized":"2024-04-21T10:20:15.823298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825293+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:20:15.825293+0000","last_peered":"2024-04-21T10:20:15.825293+0000","last_clean":"2024-04-21T10:20:15.825293+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:20:15.825293+0000","last_undegraded":"2024-04-21T10:20:15.825293+0000","last_fullsized":"2024-04-21T10:20:15.825293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826687+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:20:15.826687+0000","last_peered":"2024-04-21T10:20:15.826687+0000","last_clean":"2024-04-21T10:20:15.826687+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:20:15.826687+0000","last_undegraded":"2024-04-21T10:20:15.826687+0000","last_fullsized":"2024-04-21T10:20:15.826687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:52:23.121128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:36.107901+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:20:36.107901+0000","last_peered":"2024-04-21T10:20:36.107901+0000","last_clean":"2024-04-21T10:20:36.107901+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:20:36.107901+0000","last_undegraded":"2024-04-21T10:20:36.107901+0000","last_fullsized":"2024-04-21T10:20:36.107901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825732+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:20:15.825732+0000","last_peered":"2024-04-21T10:20:15.825732+0000","last_clean":"2024-04-21T10:20:15.825732+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:20:15.825732+0000","last_undegraded":"2024-04-21T10:20:15.825732+0000","last_fullsized":"2024-04-21T10:20:15.825732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:19:57.323697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.847516+0000","last_change":"2024-04-21T10:20:15.847040+0000","last_active":"2024-04-21T10:20:15.847516+0000","last_peered":"2024-04-21T10:20:15.847516+0000","last_clean":"2024-04-21T10:20:15.847516+0000","last_became_active":"2024-04-21T10:20:15.828688+0000","last_became_peered":"2024-04-21T10:20:15.828688+0000","last_unstale":"2024-04-21T10:20:15.847516+0000","last_undegraded":"2024-04-21T10:20:15.847516+0000","last_fullsized":"2024-04-21T10:20:15.847516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:42:55.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825079+0000","last_change":"2024-04-21T10:20:15.824670+0000","last_active":"2024-04-21T10:20:15.825079+0000","last_peered":"2024-04-21T10:20:15.825079+0000","last_clean":"2024-04-21T10:20:15.825079+0000","last_became_active":"2024-04-21T10:20:15.824428+0000","last_became_peered":"2024-04-21T10:20:15.824428+0000","last_unstale":"2024-04-21T10:20:15.825079+0000","last_undegraded":"2024-04-21T10:20:15.825079+0000","last_fullsized":"2024-04-21T10:20:15.825079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:23:50.732573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821840+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:20:15.821840+0000","last_peered":"2024-04-21T10:20:15.821840+0000","last_clean":"2024-04-21T10:20:15.821840+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:20:15.821840+0000","last_undegraded":"2024-04-21T10:20:15.821840+0000","last_fullsized":"2024-04-21T10:20:15.821840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822062+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:20:15.822062+0000","last_peered":"2024-04-21T10:20:15.822062+0000","last_clean":"2024-04-21T10:20:15.822062+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:20:15.822062+0000","last_undegraded":"2024-04-21T10:20:15.822062+0000","last_fullsized":"2024-04-21T10:20:15.822062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:44:18.798775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822198+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:20:15.822198+0000","last_peered":"2024-04-21T10:20:15.822198+0000","last_clean":"2024-04-21T10:20:15.822198+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:20:15.822198+0000","last_undegraded":"2024-04-21T10:20:15.822198+0000","last_fullsized":"2024-04-21T10:20:15.822198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824687+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:20:15.824687+0000","last_peered":"2024-04-21T10:20:15.824687+0000","last_clean":"2024-04-21T10:20:15.824687+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:20:15.824687+0000","last_undegraded":"2024-04-21T10:20:15.824687+0000","last_fullsized":"2024-04-21T10:20:15.824687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:39:16.369964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826430+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:20:15.826430+0000","last_peered":"2024-04-21T10:20:15.826430+0000","last_clean":"2024-04-21T10:20:15.826430+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:20:15.826430+0000","last_undegraded":"2024-04-21T10:20:15.826430+0000","last_fullsized":"2024-04-21T10:20:15.826430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824069+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:20:15.824069+0000","last_peered":"2024-04-21T10:20:15.824069+0000","last_clean":"2024-04-21T10:20:15.824069+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:20:15.824069+0000","last_undegraded":"2024-04-21T10:20:15.824069+0000","last_fullsized":"2024-04-21T10:20:15.824069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:05:27.020650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825018+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:20:15.825018+0000","last_peered":"2024-04-21T10:20:15.825018+0000","last_clean":"2024-04-21T10:20:15.825018+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:20:15.825018+0000","last_undegraded":"2024-04-21T10:20:15.825018+0000","last_fullsized":"2024-04-21T10:20:15.825018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:05:15.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:38.110377+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:20:38.110377+0000","last_peered":"2024-04-21T10:20:38.110377+0000","last_clean":"2024-04-21T10:20:38.110377+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:20:38.110377+0000","last_undegraded":"2024-04-21T10:20:38.110377+0000","last_fullsized":"2024-04-21T10:20:38.110377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825712+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:20:15.825712+0000","last_peered":"2024-04-21T10:20:15.825712+0000","last_clean":"2024-04-21T10:20:15.825712+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:20:15.825712+0000","last_undegraded":"2024-04-21T10:20:15.825712+0000","last_fullsized":"2024-04-21T10:20:15.825712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:41:15.466810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820859+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:20:15.820859+0000","last_peered":"2024-04-21T10:20:15.820859+0000","last_clean":"2024-04-21T10:20:15.820859+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:20:15.820859+0000","last_undegraded":"2024-04-21T10:20:15.820859+0000","last_fullsized":"2024-04-21T10:20:15.820859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":353,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825847+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:20:15.825847+0000","last_peered":"2024-04-21T10:20:15.825847+0000","last_clean":"2024-04-21T10:20:15.825847+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:20:15.825847+0000","last_undegraded":"2024-04-21T10:20:15.825847+0000","last_fullsized":"2024-04-21T10:20:15.825847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823079+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:20:15.823079+0000","last_peered":"2024-04-21T10:20:15.823079+0000","last_clean":"2024-04-21T10:20:15.823079+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:20:15.823079+0000","last_undegraded":"2024-04-21T10:20:15.823079+0000","last_fullsized":"2024-04-21T10:20:15.823079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826016+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:20:15.826016+0000","last_peered":"2024-04-21T10:20:15.826016+0000","last_clean":"2024-04-21T10:20:15.826016+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:20:15.826016+0000","last_undegraded":"2024-04-21T10:20:15.826016+0000","last_fullsized":"2024-04-21T10:20:15.826016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821554+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:20:15.821554+0000","last_peered":"2024-04-21T10:20:15.821554+0000","last_clean":"2024-04-21T10:20:15.821554+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:20:15.821554+0000","last_undegraded":"2024-04-21T10:20:15.821554+0000","last_fullsized":"2024-04-21T10:20:15.821554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823222+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:20:15.823222+0000","last_peered":"2024-04-21T10:20:15.823222+0000","last_clean":"2024-04-21T10:20:15.823222+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:20:15.823222+0000","last_undegraded":"2024-04-21T10:20:15.823222+0000","last_fullsized":"2024-04-21T10:20:15.823222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822421+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:20:15.822421+0000","last_peered":"2024-04-21T10:20:15.822421+0000","last_clean":"2024-04-21T10:20:15.822421+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:20:15.822421+0000","last_undegraded":"2024-04-21T10:20:15.822421+0000","last_fullsized":"2024-04-21T10:20:15.822421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827008+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:20:15.827008+0000","last_peered":"2024-04-21T10:20:15.827008+0000","last_clean":"2024-04-21T10:20:15.827008+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:20:15.827008+0000","last_undegraded":"2024-04-21T10:20:15.827008+0000","last_fullsized":"2024-04-21T10:20:15.827008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:17.595175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821108+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:20:15.821108+0000","last_peered":"2024-04-21T10:20:15.821108+0000","last_clean":"2024-04-21T10:20:15.821108+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:20:15.821108+0000","last_undegraded":"2024-04-21T10:20:15.821108+0000","last_fullsized":"2024-04-21T10:20:15.821108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.819960+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:20:15.819960+0000","last_peered":"2024-04-21T10:20:15.819960+0000","last_clean":"2024-04-21T10:20:15.819960+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:20:15.819960+0000","last_undegraded":"2024-04-21T10:20:15.819960+0000","last_fullsized":"2024-04-21T10:20:15.819960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822946+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:20:15.822946+0000","last_peered":"2024-04-21T10:20:15.822946+0000","last_clean":"2024-04-21T10:20:15.822946+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:20:15.822946+0000","last_undegraded":"2024-04-21T10:20:15.822946+0000","last_fullsized":"2024-04-21T10:20:15.822946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820972+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:20:15.820972+0000","last_peered":"2024-04-21T10:20:15.820972+0000","last_clean":"2024-04-21T10:20:15.820972+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:20:15.820972+0000","last_undegraded":"2024-04-21T10:20:15.820972+0000","last_fullsized":"2024-04-21T10:20:15.820972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825986+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:20:15.825986+0000","last_peered":"2024-04-21T10:20:15.825986+0000","last_clean":"2024-04-21T10:20:15.825986+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:20:15.825986+0000","last_undegraded":"2024-04-21T10:20:15.825986+0000","last_fullsized":"2024-04-21T10:20:15.825986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822561+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:20:15.822561+0000","last_peered":"2024-04-21T10:20:15.822561+0000","last_clean":"2024-04-21T10:20:15.822561+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:20:15.822561+0000","last_undegraded":"2024-04-21T10:20:15.822561+0000","last_fullsized":"2024-04-21T10:20:15.822561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:16:31.547608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826844+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:20:15.826844+0000","last_peered":"2024-04-21T10:20:15.826844+0000","last_clean":"2024-04-21T10:20:15.826844+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:20:15.826844+0000","last_undegraded":"2024-04-21T10:20:15.826844+0000","last_fullsized":"2024-04-21T10:20:15.826844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826592+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:20:15.826592+0000","last_peered":"2024-04-21T10:20:15.826592+0000","last_clean":"2024-04-21T10:20:15.826592+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:20:15.826592+0000","last_undegraded":"2024-04-21T10:20:15.826592+0000","last_fullsized":"2024-04-21T10:20:15.826592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:34:48.679940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821134+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:20:15.821134+0000","last_peered":"2024-04-21T10:20:15.821134+0000","last_clean":"2024-04-21T10:20:15.821134+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:20:15.821134+0000","last_undegraded":"2024-04-21T10:20:15.821134+0000","last_fullsized":"2024-04-21T10:20:15.821134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826515+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:20:15.826515+0000","last_peered":"2024-04-21T10:20:15.826515+0000","last_clean":"2024-04-21T10:20:15.826515+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:20:15.826515+0000","last_undegraded":"2024-04-21T10:20:15.826515+0000","last_fullsized":"2024-04-21T10:20:15.826515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:52:13.768086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827489+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:20:15.827489+0000","last_peered":"2024-04-21T10:20:15.827489+0000","last_clean":"2024-04-21T10:20:15.827489+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:20:15.827489+0000","last_undegraded":"2024-04-21T10:20:15.827489+0000","last_fullsized":"2024-04-21T10:20:15.827489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826935+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:20:15.826935+0000","last_peered":"2024-04-21T10:20:15.826935+0000","last_clean":"2024-04-21T10:20:15.826935+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:20:15.826935+0000","last_undegraded":"2024-04-21T10:20:15.826935+0000","last_fullsized":"2024-04-21T10:20:15.826935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:20:52.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825643+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:20:15.825643+0000","last_peered":"2024-04-21T10:20:15.825643+0000","last_clean":"2024-04-21T10:20:15.825643+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:20:15.825643+0000","last_undegraded":"2024-04-21T10:20:15.825643+0000","last_fullsized":"2024-04-21T10:20:15.825643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826680+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:20:15.826680+0000","last_peered":"2024-04-21T10:20:15.826680+0000","last_clean":"2024-04-21T10:20:15.826680+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:20:15.826680+0000","last_undegraded":"2024-04-21T10:20:15.826680+0000","last_fullsized":"2024-04-21T10:20:15.826680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:34:13.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.830810+0000","last_change":"2024-04-21T10:20:15.830810+0000","last_active":"2024-04-21T10:20:15.830810+0000","last_peered":"2024-04-21T10:20:15.830810+0000","last_clean":"2024-04-21T10:20:15.830810+0000","last_became_active":"2024-04-21T10:20:15.826657+0000","last_became_peered":"2024-04-21T10:20:15.826657+0000","last_unstale":"2024-04-21T10:20:15.830810+0000","last_undegraded":"2024-04-21T10:20:15.830810+0000","last_fullsized":"2024-04-21T10:20:15.830810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:12:19.425100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827025+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:20:15.827025+0000","last_peered":"2024-04-21T10:20:15.827025+0000","last_clean":"2024-04-21T10:20:15.827025+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:20:15.827025+0000","last_undegraded":"2024-04-21T10:20:15.827025+0000","last_fullsized":"2024-04-21T10:20:15.827025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:10:06.613615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822689+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:20:15.822689+0000","last_peered":"2024-04-21T10:20:15.822689+0000","last_clean":"2024-04-21T10:20:15.822689+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:20:15.822689+0000","last_undegraded":"2024-04-21T10:20:15.822689+0000","last_fullsized":"2024-04-21T10:20:15.822689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:54:10.827986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826535+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:20:15.826535+0000","last_peered":"2024-04-21T10:20:15.826535+0000","last_clean":"2024-04-21T10:20:15.826535+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:20:15.826535+0000","last_undegraded":"2024-04-21T10:20:15.826535+0000","last_fullsized":"2024-04-21T10:20:15.826535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:30:54.398105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.826749+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:20:15.826749+0000","last_peered":"2024-04-21T10:20:15.826749+0000","last_clean":"2024-04-21T10:20:15.826749+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:20:15.826749+0000","last_undegraded":"2024-04-21T10:20:15.826749+0000","last_fullsized":"2024-04-21T10:20:15.826749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:15.894562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.820292+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:20:15.820292+0000","last_peered":"2024-04-21T10:20:15.820292+0000","last_clean":"2024-04-21T10:20:15.820292+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:20:15.820292+0000","last_undegraded":"2024-04-21T10:20:15.820292+0000","last_fullsized":"2024-04-21T10:20:15.820292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823257+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:20:15.823257+0000","last_peered":"2024-04-21T10:20:15.823257+0000","last_clean":"2024-04-21T10:20:15.823257+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:20:15.823257+0000","last_undegraded":"2024-04-21T10:20:15.823257+0000","last_fullsized":"2024-04-21T10:20:15.823257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.821936+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:20:15.821936+0000","last_peered":"2024-04-21T10:20:15.821936+0000","last_clean":"2024-04-21T10:20:15.821936+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:20:15.821936+0000","last_undegraded":"2024-04-21T10:20:15.821936+0000","last_fullsized":"2024-04-21T10:20:15.821936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:55:02.979989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.827995+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:20:15.827995+0000","last_peered":"2024-04-21T10:20:15.827995+0000","last_clean":"2024-04-21T10:20:15.827995+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:20:15.827995+0000","last_undegraded":"2024-04-21T10:20:15.827995+0000","last_fullsized":"2024-04-21T10:20:15.827995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:14:13.509778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.831009+0000","last_change":"2024-04-21T10:20:15.830207+0000","last_active":"2024-04-21T10:20:15.831009+0000","last_peered":"2024-04-21T10:20:15.831009+0000","last_clean":"2024-04-21T10:20:15.831009+0000","last_became_active":"2024-04-21T10:20:15.829809+0000","last_became_peered":"2024-04-21T10:20:15.829809+0000","last_unstale":"2024-04-21T10:20:15.831009+0000","last_undegraded":"2024-04-21T10:20:15.831009+0000","last_fullsized":"2024-04-21T10:20:15.831009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:21:03.485624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.824892+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:20:15.824892+0000","last_peered":"2024-04-21T10:20:15.824892+0000","last_clean":"2024-04-21T10:20:15.824892+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:20:15.824892+0000","last_undegraded":"2024-04-21T10:20:15.824892+0000","last_fullsized":"2024-04-21T10:20:15.824892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:44:20.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.825887+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:20:15.825887+0000","last_peered":"2024-04-21T10:20:15.825887+0000","last_clean":"2024-04-21T10:20:15.825887+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:20:15.825887+0000","last_undegraded":"2024-04-21T10:20:15.825887+0000","last_fullsized":"2024-04-21T10:20:15.825887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:48:22.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823974+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:20:15.823974+0000","last_peered":"2024-04-21T10:20:15.823974+0000","last_clean":"2024-04-21T10:20:15.823974+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:20:15.823974+0000","last_undegraded":"2024-04-21T10:20:15.823974+0000","last_fullsized":"2024-04-21T10:20:15.823974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:18:46.271474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.823626+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:20:15.823626+0000","last_peered":"2024-04-21T10:20:15.823626+0000","last_clean":"2024-04-21T10:20:15.823626+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:20:15.823626+0000","last_undegraded":"2024-04-21T10:20:15.823626+0000","last_fullsized":"2024-04-21T10:20:15.823626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T10:20:15.822557+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:20:15.822557+0000","last_peered":"2024-04-21T10:20:15.822557+0000","last_clean":"2024-04-21T10:20:15.822557+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:20:15.822557+0000","last_undegraded":"2024-04-21T10:20:15.822557+0000","last_fullsized":"2024-04-21T10:20:15.822557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:32:45.653309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249634,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63272,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":463,"num_read_kb":298,"num_write":156,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383710,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":456317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645347,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":1106957,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":958464,"data_stored":456441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070510,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":456249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":1048682,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":455830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":514503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":457101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":516244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":456141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920833,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":456658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":1047975,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34492,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:20:43.383 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-21T10:20:43.383 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-21T10:20:43.383 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-21T10:20:43.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph health --format=json 2024-04-21T10:20:43.625 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:43 smithi170 ceph-mon[31212]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:20:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:43 smithi170 ceph-mon[31212]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:44.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:43 smithi077 ceph-mon[27902]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:20:44.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:43 smithi077 ceph-mon[27902]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:43 smithi191 ceph-mon[31636]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:20:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:43 smithi191 ceph-mon[31636]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 -- 172.21.15.77:0/2496922809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414107920 msgr2=0x7f9414107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 --2- 172.21.15.77:0/2496922809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414107920 0x7f9414107d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9404009990 tx=0x7f9404009ca0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 -- 172.21.15.77:0/2496922809 shutdown_connections 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 --2- 172.21.15.77:0/2496922809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 0x7f941410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 --2- 172.21.15.77:0/2496922809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414107920 0x7f9414107d00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 --2- 172.21.15.77:0/2496922809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414101970 0x7f9414101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 -- 172.21.15.77:0/2496922809 >> 172.21.15.77:0/2496922809 conn(0x7f9414078910 msgr2=0x7f9414078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 -- 172.21.15.77:0/2496922809 shutdown_connections 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.413+0000 7f9419492700 1 -- 172.21.15.77:0/2496922809 wait complete. 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 Processor -- start 2024-04-21T10:20:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 -- start start 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 0x7f94141981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 0x7f94141986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414107920 0x7f941419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9414111bc0 con 0x7f9414101970 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9414111a40 con 0x7f9414107920 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9419492700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9414111d40 con 0x7f9414102330 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 0x7f94141981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 0x7f94141981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49178/0 (socket says 172.21.15.77:49178) 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 -- 172.21.15.77:0/647112322 learned_addr learned my addr 172.21.15.77:0/647112322 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f940a7fc700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 0x7f94141986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f94137fe700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414107920 0x7f941419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 -- 172.21.15.77:0/647112322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 msgr2=0x7f94141986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 0x7f94141986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 -- 172.21.15.77:0/647112322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414107920 msgr2=0x7f941419ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414107920 0x7f941419ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f9412ffd700 1 -- 172.21.15.77:0/647112322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941419d1c0 con 0x7f9414101970 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f940a7fc700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 0x7f94141986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.414+0000 7f94137fe700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414107920 0x7f941419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.415+0000 7f9412ffd700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 0x7f94141981b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9404000c00 tx=0x7f94040047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.415+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9404027070 con 0x7f9414101970 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.415+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94040041d0 con 0x7f9414101970 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.415+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940400f460 con 0x7f9414101970 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.415+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941419d450 con 0x7f9414101970 2024-04-21T10:20:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.415+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94141a4d30 con 0x7f9414101970 2024-04-21T10:20:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.416+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9414103060 con 0x7f9414101970 2024-04-21T10:20:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.417+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f940402a070 con 0x7f9414101970 2024-04-21T10:20:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.417+0000 7f9410ff9700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f94000a3d90 0x7f94000a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.418+0000 7f940a7fc700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f94000a3d90 0x7f94000a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.418+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f94040d1300 con 0x7f9414101970 2024-04-21T10:20:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.418+0000 7f940a7fc700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f94000a3d90 0x7f94000a6250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9414079030 tx=0x7f93fc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.425+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f940405eff0 con 0x7f9414101970 2024-04-21T10:20:45.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.671+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f941402df80 con 0x7f9414101970 2024-04-21T10:20:45.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.671+0000 7f9410ff9700 1 -- 172.21.15.77:0/647112322 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9404013070 con 0x7f9414101970 2024-04-21T10:20:45.671 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:45.671 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f94000a3d90 msgr2=0x7f94000a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f94000a3d90 0x7f94000a6250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9414079030 tx=0x7f93fc008040 comp rx=0 tx=0).stop 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 msgr2=0x7f94141981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 0x7f94141981b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9404000c00 tx=0x7f94040047b0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 shutdown_connections 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f94000a3d90 0x7f94000a6250 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9414107920 0x7f941419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9414101970 0x7f94141981b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 --2- 172.21.15.77:0/647112322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9414102330 0x7f94141986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:45.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 >> 172.21.15.77:0/647112322 conn(0x7f9414078910 msgr2=0x7f94140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:45.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 shutdown_connections 2024-04-21T10:20:45.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:45.673+0000 7f9419492700 1 -- 172.21.15.77:0/647112322 wait complete. 2024-04-21T10:20:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:45 smithi077 ceph-mon[27902]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:45 smithi077 ceph-mon[27902]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-21T10:20:46.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:45 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/647112322' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-21T10:20:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:45 smithi170 ceph-mon[31212]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:45 smithi170 ceph-mon[31212]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-21T10:20:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:45 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/647112322' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-21T10:20:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:45 smithi191 ceph-mon[31636]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:20:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:45 smithi191 ceph-mon[31636]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-21T10:20:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:45 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/647112322' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-21T10:20:46.365 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-21T10:20:46.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 -- 172.21.15.77:0/1376182203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4105340 msgr2=0x7f8cc4107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 --2- 172.21.15.77:0/1376182203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4105340 0x7f8cc4107730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009900 tx=0x7f8cc002bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 -- 172.21.15.77:0/1376182203 shutdown_connections 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 --2- 172.21.15.77:0/1376182203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4105340 0x7f8cc4107730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 --2- 172.21.15.77:0/1376182203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4107c70 0x7f8cc410a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 --2- 172.21.15.77:0/1376182203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc4102a10 0x7f8cc4104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 -- 172.21.15.77:0/1376182203 >> 172.21.15.77:0/1376182203 conn(0x7f8cc40fc420 msgr2=0x7f8cc40fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 -- 172.21.15.77:0/1376182203 shutdown_connections 2024-04-21T10:20:46.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.468+0000 7f8ccc406640 1 -- 172.21.15.77:0/1376182203 wait complete. 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 Processor -- start 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 -- start start 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4102a10 0x7f8cc4198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc4105340 0x7f8cc41986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 0x7f8cc419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc410dac0 con 0x7f8cc4107c70 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc410d940 con 0x7f8cc4102a10 2024-04-21T10:20:46.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8ccc406640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc410dc40 con 0x7f8cc4105340 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 0x7f8cc419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 0x7f8cc419f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49200/0 (socket says 172.21.15.77:49200) 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 -- 172.21.15.77:0/828230711 learned_addr learned my addr 172.21.15.77:0/828230711 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cc99a1640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc4105340 0x7f8cc41986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca1a2640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4102a10 0x7f8cc4198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 -- 172.21.15.77:0/828230711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc4105340 msgr2=0x7f8cc41986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc4105340 0x7f8cc41986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 -- 172.21.15.77:0/828230711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4102a10 msgr2=0x7f8cc4198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4102a10 0x7f8cc4198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 -- 172.21.15.77:0/828230711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc419fd80 con 0x7f8cc4107c70 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca1a2640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4102a10 0x7f8cc4198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:46.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cca9a3640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 0x7f8cc419f710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00ccb0 tx=0x7f8cbc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:46.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.469+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc004b90 con 0x7f8cc4107c70 2024-04-21T10:20:46.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.470+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cbc004d30 con 0x7f8cc4107c70 2024-04-21T10:20:46.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.470+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc005320 con 0x7f8cc4107c70 2024-04-21T10:20:46.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.470+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc41a0070 con 0x7f8cc4107c70 2024-04-21T10:20:46.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.470+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc41a0590 con 0x7f8cc4107c70 2024-04-21T10:20:46.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.471+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc40fdf10 con 0x7f8cc4107c70 2024-04-21T10:20:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.472+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8cbc00f450 con 0x7f8cc4107c70 2024-04-21T10:20:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.472+0000 7f8cbb7fe640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8cb00a3bb0 0x7f8cb00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.472+0000 7f8cca1a2640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8cb00a3bb0 0x7f8cb00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.472+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f8cbc0d0490 con 0x7f8cc4107c70 2024-04-21T10:20:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.473+0000 7f8cca1a2640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8cb00a3bb0 0x7f8cb00a6070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40058c0 tx=0x7f8cb4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:46.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.477+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8cbc014070 con 0x7f8cc4107c70 2024-04-21T10:20:46.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.656+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cc4062b50 con 0x7f8cc4107c70 2024-04-21T10:20:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.657+0000 7f8cbb7fe640 1 -- 172.21.15.77:0/828230711 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22664 (secure 0 0 0) 0x7f8cbc09ce80 con 0x7f8cc4107c70 2024-04-21T10:20:46.657 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:46.658 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:20:15.816743+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:20:46.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8cb00a3bb0 msgr2=0x7f8cb00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8cb00a3bb0 0x7f8cb00a6070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40058c0 tx=0x7f8cb4005850 comp rx=0 tx=0).stop 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 msgr2=0x7f8cc419f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 0x7f8cc419f710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00ccb0 tx=0x7f8cbc00a620 comp rx=0 tx=0).stop 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 shutdown_connections 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f8cb00a3bb0 0x7f8cb00a6070 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cc4107c70 0x7f8cc419f710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc4105340 0x7f8cc41986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 --2- 172.21.15.77:0/828230711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc4102a10 0x7f8cc4198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 >> 172.21.15.77:0/828230711 conn(0x7f8cc40fc420 msgr2=0x7f8cc4103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.659+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 shutdown_connections 2024-04-21T10:20:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.660+0000 7f8ccc406640 1 -- 172.21.15.77:0/828230711 wait complete. 2024-04-21T10:20:46.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:20:46.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:20:46.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 -- 172.21.15.77:0/2155225573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 msgr2=0x7f263c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 --2- 172.21.15.77:0/2155225573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c1012a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f262c009900 tx=0x7f262c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:46.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 -- 172.21.15.77:0/2155225573 shutdown_connections 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 --2- 172.21.15.77:0/2155225573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263c102990 0x7f263c1092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 --2- 172.21.15.77:0/2155225573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f263c101fd0 0x7f263c102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 --2- 172.21.15.77:0/2155225573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c1012a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 -- 172.21.15.77:0/2155225573 >> 172.21.15.77:0/2155225573 conn(0x7f263c0fc3f0 msgr2=0x7f263c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 -- 172.21.15.77:0/2155225573 shutdown_connections 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 -- 172.21.15.77:0/2155225573 wait complete. 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 Processor -- start 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.773+0000 7f2642552640 1 -- start start 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c10b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f263c101fd0 0x7f263c109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263c102990 0x7f263c10a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10db20 con 0x7f263c100e80 2024-04-21T10:20:46.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10d9a0 con 0x7f263c102990 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10dca0 con 0x7f263c101fd0 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c10b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c10b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49216/0 (socket says 172.21.15.77:49216) 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 -- 172.21.15.77:0/4200495569 learned_addr learned my addr 172.21.15.77:0/4200495569 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263b7fe640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f263c101fd0 0x7f263c109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2640aef640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263c102990 0x7f263c10a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 -- 172.21.15.77:0/4200495569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f263c101fd0 msgr2=0x7f263c109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f263c101fd0 0x7f263c109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 -- 172.21.15.77:0/4200495569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263c102990 msgr2=0x7f263c10a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263c102990 0x7f263c10a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 -- 172.21.15.77:0/4200495569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c10ac30 con 0x7f263c100e80 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f263bfff640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c10b820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f262c006010 tx=0x7f262c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c043020 con 0x7f263c100e80 2024-04-21T10:20:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f262c004aa0 con 0x7f263c100e80 2024-04-21T10:20:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c003c70 con 0x7f263c100e80 2024-04-21T10:20:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c1a2360 con 0x7f263c100e80 2024-04-21T10:20:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.774+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a28b0 con 0x7f263c100e80 2024-04-21T10:20:46.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.775+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c108280 con 0x7f263c100e80 2024-04-21T10:20:46.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.776+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f262c046020 con 0x7f263c100e80 2024-04-21T10:20:46.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.777+0000 7f26397fa640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f26240a3bb0 0x7f26240a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:46.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.777+0000 7f263b7fe640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f26240a3bb0 0x7f26240a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:46.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.777+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f262c0f2870 con 0x7f263c100e80 2024-04-21T10:20:46.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.777+0000 7f263b7fe640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f26240a3bb0 0x7f26240a6070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2630005fd0 tx=0x7f2630005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.781+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f262c04d020 con 0x7f263c100e80 2024-04-21T10:20:46.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.959+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f263c062b50 con 0x7f263c100e80 2024-04-21T10:20:46.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.960+0000 7f26397fa640 1 -- 172.21.15.77:0/4200495569 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f262c0bf260 con 0x7f263c100e80 2024-04-21T10:20:46.960 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f26240a3bb0 msgr2=0x7f26240a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f26240a3bb0 0x7f26240a6070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2630005fd0 tx=0x7f2630005850 comp rx=0 tx=0).stop 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 msgr2=0x7f263c10b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c10b820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f262c006010 tx=0x7f262c0042f0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 shutdown_connections 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f26240a3bb0 0x7f26240a6070 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263c102990 0x7f263c10a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f263c101fd0 0x7f263c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 --2- 172.21.15.77:0/4200495569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c100e80 0x7f263c10b820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 >> 172.21.15.77:0/4200495569 conn(0x7f263c0fc3f0 msgr2=0x7f263c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 shutdown_connections 2024-04-21T10:20:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:46.962+0000 7f2642552640 1 -- 172.21.15.77:0/4200495569 wait complete. 2024-04-21T10:20:46.971 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:46 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/828230711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:46.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:20:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:46 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/828230711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:47.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/1980136887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 msgr2=0x7f4d38102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/1980136887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d38102020 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009ca0 tx=0x7f4d3002c180 comp rx=0 tx=0).stop 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/1980136887 shutdown_connections 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/1980136887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d38102020 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/1980136887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d38101200 0x7f4d38101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/1980136887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 0x7f4d38100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/1980136887 >> 172.21.15.77:0/1980136887 conn(0x7f4d380fc420 msgr2=0x7f4d380fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/1980136887 shutdown_connections 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.073+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/1980136887 wait complete. 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 Processor -- start 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 -- start start 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 0x7f4d3819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d38101200 0x7f4d3819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d381a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3810fd30 con 0x7f4d38101ba0 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3810fbb0 con 0x7f4d381008a0 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3e7ce640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3810feb0 con 0x7f4d38101200 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3cd6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d381a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3cd6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d381a19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49230/0 (socket says 172.21.15.77:49230) 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.074+0000 7f4d3cd6b640 1 -- 172.21.15.77:0/2486410845 learned_addr learned my addr 172.21.15.77:0/2486410845 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d37fff640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 0x7f4d3819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3cd6b640 1 -- 172.21.15.77:0/2486410845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d38101200 msgr2=0x7f4d3819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3cd6b640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d38101200 0x7f4d3819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3cd6b640 1 -- 172.21.15.77:0/2486410845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 msgr2=0x7f4d3819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3cd6b640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 0x7f4d3819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3cd6b640 1 -- 172.21.15.77:0/2486410845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d381a2020 con 0x7f4d38101ba0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d37fff640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 0x7f4d3819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3cd6b640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d381a19b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005cc0 tx=0x7f4d30003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30039040 con 0x7f4d38101ba0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d381a22b0 con 0x7f4d38101ba0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d30044070 con 0x7f4d38101ba0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30032970 con 0x7f4d38101ba0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.075+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d381a2820 con 0x7f4d38101ba0 2024-04-21T10:20:47.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.076+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3810b7f0 con 0x7f4d38101ba0 2024-04-21T10:20:47.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.077+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f4d30032b30 con 0x7f4d38101ba0 2024-04-21T10:20:47.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.077+0000 7f4d357fa640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4d200a3bb0 0x7f4d200a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.078+0000 7f4d37fff640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4d200a3bb0 0x7f4d200a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.078+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f4d300f2b00 con 0x7f4d38101ba0 2024-04-21T10:20:47.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.078+0000 7f4d37fff640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4d200a3bb0 0x7f4d200a6070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0058c0 tx=0x7f4d2c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:47.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.082+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4d300bf4f0 con 0x7f4d38101ba0 2024-04-21T10:20:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:46 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/828230711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:47.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.259+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4d38062b50 con 0x7f4d38101ba0 2024-04-21T10:20:47.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.259+0000 7f4d357fa640 1 -- 172.21.15.77:0/2486410845 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f4d300bedf0 con 0x7f4d38101ba0 2024-04-21T10:20:47.259 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:20:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4d200a3bb0 msgr2=0x7f4d200a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4d200a3bb0 0x7f4d200a6070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0058c0 tx=0x7f4d2c005850 comp rx=0 tx=0).stop 2024-04-21T10:20:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 msgr2=0x7f4d381a19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d381a19b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005cc0 tx=0x7f4d30003c20 comp rx=0 tx=0).stop 2024-04-21T10:20:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 shutdown_connections 2024-04-21T10:20:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f4d200a3bb0 0x7f4d200a6070 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38101ba0 0x7f4d381a19b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d38101200 0x7f4d3819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 --2- 172.21.15.77:0/2486410845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d381008a0 0x7f4d3819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 >> 172.21.15.77:0/2486410845 conn(0x7f4d380fc420 msgr2=0x7f4d380fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:47.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 shutdown_connections 2024-04-21T10:20:47.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.261+0000 7f4d3e7ce640 1 -- 172.21.15.77:0/2486410845 wait complete. 2024-04-21T10:20:47.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:20:47.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 -- 172.21.15.77:0/371553602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54100800 msgr2=0x7feb54102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 --2- 172.21.15.77:0/371553602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54100800 0x7feb54102c30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb50009900 tx=0x7feb5002bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:47.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 -- 172.21.15.77:0/371553602 shutdown_connections 2024-04-21T10:20:47.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 --2- 172.21.15.77:0/371553602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb54105b20 0x7feb54105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 --2- 172.21.15.77:0/371553602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb54103170 0x7feb541055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 --2- 172.21.15.77:0/371553602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54100800 0x7feb54102c30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 -- 172.21.15.77:0/371553602 >> 172.21.15.77:0/371553602 conn(0x7feb540fc400 msgr2=0x7feb540fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 -- 172.21.15.77:0/371553602 shutdown_connections 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.373+0000 7feb5bd11640 1 -- 172.21.15.77:0/371553602 wait complete. 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 Processor -- start 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 -- start start 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb54100800 0x7feb5419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 0x7feb5419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb54105b20 0x7feb541a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feb54114100 con 0x7feb54103170 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feb54113f80 con 0x7feb54105b20 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb5bd11640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feb54114280 con 0x7feb54100800 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 0x7feb5419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 0x7feb5419ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49254/0 (socket says 172.21.15.77:49254) 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 -- 172.21.15.77:0/706663763 learned_addr learned my addr 172.21.15.77:0/706663763 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb59aad640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb54100800 0x7feb5419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 -- 172.21.15.77:0/706663763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb54100800 msgr2=0x7feb5419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb54100800 0x7feb5419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 -- 172.21.15.77:0/706663763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb54105b20 msgr2=0x7feb541a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb54105b20 0x7feb541a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.374+0000 7feb592ac640 1 -- 172.21.15.77:0/706663763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb541a63b0 con 0x7feb54103170 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.375+0000 7feb592ac640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 0x7feb5419ecd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb4400c920 tx=0x7feb4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.375+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44007c70 con 0x7feb54103170 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.375+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb44007e10 con 0x7feb54103170 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.375+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb541a66a0 con 0x7feb54103170 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.375+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44018820 con 0x7feb54103170 2024-04-21T10:20:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.375+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb541a6c70 con 0x7feb54103170 2024-04-21T10:20:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.376+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb540fdef0 con 0x7feb54103170 2024-04-21T10:20:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.377+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7feb4400f450 con 0x7feb54103170 2024-04-21T10:20:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.377+0000 7feb4affd640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feb400a3bb0 0x7feb400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.378+0000 7feb59aad640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feb400a3bb0 0x7feb400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.378+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7feb440d05b0 con 0x7feb54103170 2024-04-21T10:20:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.378+0000 7feb59aad640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feb400a3bb0 0x7feb400a6070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb50000c00 tx=0x7feb5002c800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.382+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb44014030 con 0x7feb54103170 2024-04-21T10:20:47.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.560+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feb54062bf0 con 0x7feb54103170 2024-04-21T10:20:47.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.560+0000 7feb4affd640 1 -- 172.21.15.77:0/706663763 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7feb4409cfa0 con 0x7feb54103170 2024-04-21T10:20:47.560 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feb400a3bb0 msgr2=0x7feb400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feb400a3bb0 0x7feb400a6070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb50000c00 tx=0x7feb5002c800 comp rx=0 tx=0).stop 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 msgr2=0x7feb5419ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 0x7feb5419ecd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb4400c920 tx=0x7feb4400cde0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 shutdown_connections 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7feb400a3bb0 0x7feb400a6070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54103170 0x7feb5419ecd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb54105b20 0x7feb541a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 --2- 172.21.15.77:0/706663763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb54100800 0x7feb5419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 >> 172.21.15.77:0/706663763 conn(0x7feb540fc400 msgr2=0x7feb54103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:47.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 shutdown_connections 2024-04-21T10:20:47.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.562+0000 7feb5bd11640 1 -- 172.21.15.77:0/706663763 wait complete. 2024-04-21T10:20:47.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 -- 172.21.15.77:0/921155927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 msgr2=0x7f79001039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 --2- 172.21.15.77:0/921155927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f79001039a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009900 tx=0x7f78fc02bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 -- 172.21.15.77:0/921155927 shutdown_connections 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 --2- 172.21.15.77:0/921155927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 0x7f790010a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 --2- 172.21.15.77:0/921155927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79000ffff0 0x7f7900100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 --2- 172.21.15.77:0/921155927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f79001039a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 -- 172.21.15.77:0/921155927 >> 172.21.15.77:0/921155927 conn(0x7f79000fbb90 msgr2=0x7f79000fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 -- 172.21.15.77:0/921155927 shutdown_connections 2024-04-21T10:20:47.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.671+0000 7f7908631640 1 -- 172.21.15.77:0/921155927 wait complete. 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 Processor -- start 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 -- start start 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79000ffff0 0x7f7900102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 0x7f79001012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f7900101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f790010db10 con 0x7f7900103580 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f790010d990 con 0x7f79001009b0 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f790010dc90 con 0x7f79000ffff0 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f7900101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f7900101800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49270/0 (socket says 172.21.15.77:49270) 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 -- 172.21.15.77:0/932491081 learned_addr learned my addr 172.21.15.77:0/932491081 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:47.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f79063cd640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79000ffff0 0x7f7900102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7905bcc640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 0x7f79001012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 -- 172.21.15.77:0/932491081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79000ffff0 msgr2=0x7f7900102c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79000ffff0 0x7f7900102c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 -- 172.21.15.77:0/932491081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 msgr2=0x7f79001012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 0x7f79001012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 -- 172.21.15.77:0/932491081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7900102090 con 0x7f7900103580 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7905bcc640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 0x7f79001012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7906bce640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f7900101800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f78f800cce0 tx=0x7f78f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f800f450 con 0x7f7900103580 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f800faa0 con 0x7f7900103580 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.672+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79001a2290 con 0x7f7900103580 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.673+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8018b70 con 0x7f7900103580 2024-04-21T10:20:47.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.673+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79001a2790 con 0x7f7900103580 2024-04-21T10:20:47.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.674+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79001094c0 con 0x7f7900103580 2024-04-21T10:20:47.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.675+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f78f8018d10 con 0x7f7900103580 2024-04-21T10:20:47.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.675+0000 7f78f77fe640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78ec0a3bb0 0x7f78ec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:47.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.675+0000 7f79063cd640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78ec0a3bb0 0x7f78ec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:47.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.676+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f78f80d0890 con 0x7f7900103580 2024-04-21T10:20:47.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.676+0000 7f79063cd640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78ec0a3bb0 0x7f78ec0a6070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78fc005ab0 tx=0x7f78fc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:47.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.680+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f78f8014030 con 0x7f7900103580 2024-04-21T10:20:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:47 smithi077 ceph-mon[27902]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T10:20:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:47 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4200495569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:20:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:47 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2486410845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:20:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:47 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/706663763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:20:47.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.897+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7900062b50 con 0x7f7900103580 2024-04-21T10:20:47.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.898+0000 7f78f77fe640 1 -- 172.21.15.77:0/932491081 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f78f809d280 con 0x7f7900103580 2024-04-21T10:20:47.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:47.898 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:19:26.977992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:20:47.899 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:20:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78ec0a3bb0 msgr2=0x7f78ec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78ec0a3bb0 0x7f78ec0a6070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78fc005ab0 tx=0x7f78fc005fd0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 msgr2=0x7f7900101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f7900101800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f78f800cce0 tx=0x7f78f800a620 comp rx=0 tx=0).stop 2024-04-21T10:20:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 shutdown_connections 2024-04-21T10:20:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78ec0a3bb0 0x7f78ec0a6070 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7900103580 0x7f7900101800 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79001009b0 0x7f79001012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 --2- 172.21.15.77:0/932491081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79000ffff0 0x7f7900102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:47.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 >> 172.21.15.77:0/932491081 conn(0x7f79000fbb90 msgr2=0x7f7900106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:47.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 shutdown_connections 2024-04-21T10:20:47.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:47.900+0000 7f7908631640 1 -- 172.21.15.77:0/932491081 wait complete. 2024-04-21T10:20:47.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:20:48.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 -- 172.21.15.77:0/2847607010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8102990 msgr2=0x7f89b81092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/2847607010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8102990 0x7f89b81092b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009ca0 tx=0x7f89b002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 -- 172.21.15.77:0/2847607010 shutdown_connections 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/2847607010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8102990 0x7f89b81092b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/2847607010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89b8101fd0 0x7f89b8102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/2847607010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89b8100e80 0x7f89b81012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 -- 172.21.15.77:0/2847607010 >> 172.21.15.77:0/2847607010 conn(0x7f89b80fc410 msgr2=0x7f89b80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 -- 172.21.15.77:0/2847607010 shutdown_connections 2024-04-21T10:20:48.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.009+0000 7f89bcfb2640 1 -- 172.21.15.77:0/2847607010 wait complete. 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 Processor -- start 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 -- start start 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89b8100e80 0x7f89b8104e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 0x7f89b8103440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89b8102990 0x7f89b8103980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89b810c9c0 con 0x7f89b8101fd0 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89b810c840 con 0x7f89b8100e80 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89bcfb2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f89b810cb40 con 0x7f89b8102990 2024-04-21T10:20:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 0x7f89b8103440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 0x7f89b8103440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49292/0 (socket says 172.21.15.77:49292) 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 -- 172.21.15.77:0/3789609764 learned_addr learned my addr 172.21.15.77:0/3789609764 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b6d9d640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89b8102990 0x7f89b8103980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 -- 172.21.15.77:0/3789609764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89b8102990 msgr2=0x7f89b8103980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89b8102990 0x7f89b8103980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b659c640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89b8100e80 0x7f89b8104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 -- 172.21.15.77:0/3789609764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89b8100e80 msgr2=0x7f89b8104e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89b8100e80 0x7f89b8104e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 -- 172.21.15.77:0/3789609764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b8104210 con 0x7f89b8101fd0 2024-04-21T10:20:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.010+0000 7f89b5d9b640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 0x7f89b8103440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00c970 tx=0x7f89ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.011+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac007c10 con 0x7f89b8101fd0 2024-04-21T10:20:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.011+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ac007db0 con 0x7f89b8101fd0 2024-04-21T10:20:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.011+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b81a2170 con 0x7f89b8101fd0 2024-04-21T10:20:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.011+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00f870 con 0x7f89b8101fd0 2024-04-21T10:20:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.011+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b81a26c0 con 0x7f89b8101fd0 2024-04-21T10:20:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.012+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b81a29e0 con 0x7f89b8101fd0 2024-04-21T10:20:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.013+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f89ac00fa10 con 0x7f89b8101fd0 2024-04-21T10:20:48.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.013+0000 7f89a77fe640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f89a00a3bb0 0x7f89a00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.013+0000 7f89b659c640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f89a00a3bb0 0x7f89a00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.013+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f89ac0d0870 con 0x7f89b8101fd0 2024-04-21T10:20:48.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.014+0000 7f89b659c640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f89a00a3bb0 0x7f89a00a6070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89a80058c0 tx=0x7f89a8005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.018+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f89ac09d2f0 con 0x7f89b8101fd0 2024-04-21T10:20:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:47 smithi170 ceph-mon[31212]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T10:20:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:47 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4200495569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:20:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:47 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2486410845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:20:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:47 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/706663763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:20:48.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.197+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89b81a2bb0 con 0x7f89b8101fd0 2024-04-21T10:20:48.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.198+0000 7f89a77fe640 1 -- 172.21.15.77:0/3789609764 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22664 (secure 0 0 0) 0x7f89ac09cbf0 con 0x7f89b8101fd0 2024-04-21T10:20:48.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:48.199 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:20:15.816743+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:20:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.200+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f89a00a3bb0 msgr2=0x7f89a00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.200+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f89a00a3bb0 0x7f89a00a6070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89a80058c0 tx=0x7f89a8005c60 comp rx=0 tx=0).stop 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.200+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 msgr2=0x7f89b8103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.200+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 0x7f89b8103440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00c970 tx=0x7f89ac00ce30 comp rx=0 tx=0).stop 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 shutdown_connections 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f89a00a3bb0 0x7f89a00a6070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b8101fd0 0x7f89b8103440 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89b8102990 0x7f89b8103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 --2- 172.21.15.77:0/3789609764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89b8100e80 0x7f89b8104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 >> 172.21.15.77:0/3789609764 conn(0x7f89b80fc410 msgr2=0x7f89b806a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 shutdown_connections 2024-04-21T10:20:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.201+0000 7f89bcfb2640 1 -- 172.21.15.77:0/3789609764 wait complete. 2024-04-21T10:20:48.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:20:48.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:47 smithi191 ceph-mon[31636]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T10:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:47 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4200495569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:47 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2486410845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:47 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/706663763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:20:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 -- 172.21.15.77:0/54508553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103190 msgr2=0x7fa49c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/54508553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103190 0x7fa49c103610 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009900 tx=0x7fa48c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 -- 172.21.15.77:0/54508553 shutdown_connections 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/54508553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103190 0x7fa49c103610 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/54508553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa49c103b50 0x7fa49c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/54508553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c101fa0 0x7fa49c1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 -- 172.21.15.77:0/54508553 >> 172.21.15.77:0/54508553 conn(0x7fa49c0fd530 msgr2=0x7fa49c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 -- 172.21.15.77:0/54508553 shutdown_connections 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.312+0000 7fa4a37b6640 1 -- 172.21.15.77:0/54508553 wait complete. 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 Processor -- start 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 -- start start 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa49c101fa0 0x7fa49c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c103190 0x7fa49c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 0x7fa49c19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10dae0 con 0x7fa49c103b50 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10d960 con 0x7fa49c103190 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a37b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10dc60 con 0x7fa49c101fa0 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 0x7fa49c19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 0x7fa49c19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49316/0 (socket says 172.21.15.77:49316) 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 -- 172.21.15.77:0/468834590 learned_addr learned my addr 172.21.15.77:0/468834590 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 -- 172.21.15.77:0/468834590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa49c101fa0 msgr2=0x7fa49c1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1552640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa49c101fa0 0x7fa49c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa49c101fa0 0x7fa49c1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a0d51640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c103190 0x7fa49c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 -- 172.21.15.77:0/468834590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c103190 msgr2=0x7fa49c198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c103190 0x7fa49c198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.313+0000 7fa4a1d53640 1 -- 172.21.15.77:0/468834590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c19fde0 con 0x7fa49c103b50 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.314+0000 7fa4a1d53640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 0x7fa49c19f770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa49800eaa0 tx=0x7fa49800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.314+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49800cdb0 con 0x7fa49c103b50 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.314+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c1a00d0 con 0x7fa49c103b50 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.314+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa498005020 con 0x7fa49c103b50 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.314+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4980116d0 con 0x7fa49c103b50 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.314+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c1a0620 con 0x7fa49c103b50 2024-04-21T10:20:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.315+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c109390 con 0x7fa49c103b50 2024-04-21T10:20:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.316+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fa4980054a0 con 0x7fa49c103b50 2024-04-21T10:20:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.316+0000 7fa4927fc640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4880a3bb0 0x7fa4880a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.316+0000 7fa4a1552640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4880a3bb0 0x7fa4880a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.316+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fa4980d0620 con 0x7fa49c103b50 2024-04-21T10:20:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.317+0000 7fa4a1552640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4880a3bb0 0x7fa4880a6070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa494005fd0 tx=0x7fa494005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.321+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa498016030 con 0x7fa49c103b50 2024-04-21T10:20:48.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.498+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa49c062b50 con 0x7fa49c103b50 2024-04-21T10:20:48.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.499+0000 7fa4927fc640 1 -- 172.21.15.77:0/468834590 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fa49809d010 con 0x7fa49c103b50 2024-04-21T10:20:48.499 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:20:48.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4880a3bb0 msgr2=0x7fa4880a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4880a3bb0 0x7fa4880a6070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa494005fd0 tx=0x7fa494005850 comp rx=0 tx=0).stop 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 msgr2=0x7fa49c19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 0x7fa49c19f770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa49800eaa0 tx=0x7fa49800ef60 comp rx=0 tx=0).stop 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 shutdown_connections 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fa4880a3bb0 0x7fa4880a6070 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa49c103b50 0x7fa49c19f770 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c103190 0x7fa49c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 --2- 172.21.15.77:0/468834590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa49c101fa0 0x7fa49c1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 >> 172.21.15.77:0/468834590 conn(0x7fa49c0fd530 msgr2=0x7fa49c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 shutdown_connections 2024-04-21T10:20:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.501+0000 7fa4a37b6640 1 -- 172.21.15.77:0/468834590 wait complete. 2024-04-21T10:20:48.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 -- 172.21.15.77:0/884969484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138101fe0 msgr2=0x7f1138102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 --2- 172.21.15.77:0/884969484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138101fe0 0x7f1138102460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1128009900 tx=0x7f112802bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 -- 172.21.15.77:0/884969484 shutdown_connections 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 --2- 172.21.15.77:0/884969484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138101fe0 0x7f1138102460 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 --2- 172.21.15.77:0/884969484 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11381029a0 0x7f11381092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 --2- 172.21.15.77:0/884969484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1138100e90 0x7f11381012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 -- 172.21.15.77:0/884969484 >> 172.21.15.77:0/884969484 conn(0x7f11380fc400 msgr2=0x7f11380fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 -- 172.21.15.77:0/884969484 shutdown_connections 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.612+0000 7f113f97e640 1 -- 172.21.15.77:0/884969484 wait complete. 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 Processor -- start 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 -- start start 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 0x7f11381971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1138101fe0 0x7f1138197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11381029a0 0x7f113819e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f113810ca40 con 0x7f1138100e90 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f113810c8c0 con 0x7f1138101fe0 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113f97e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f113810cbc0 con 0x7f11381029a0 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 0x7f11381971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 0x7f11381971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49330/0 (socket says 172.21.15.77:49330) 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 -- 172.21.15.77:0/2722414659 learned_addr learned my addr 172.21.15.77:0/2722414659 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113cf19640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1138101fe0 0x7f1138197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 -- 172.21.15.77:0/2722414659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11381029a0 msgr2=0x7f113819e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11381029a0 0x7f113819e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 -- 172.21.15.77:0/2722414659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1138101fe0 msgr2=0x7f1138197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1138101fe0 0x7f1138197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.613+0000 7f113d71a640 1 -- 172.21.15.77:0/2722414659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113819ede0 con 0x7f1138100e90 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.614+0000 7f113d71a640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 0x7f11381971c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f113400df40 tx=0x7f113400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.614+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113400ea60 con 0x7f1138100e90 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.614+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113400ec00 con 0x7f1138100e90 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.614+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11380690e0 con 0x7f1138100e90 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.614+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134016670 con 0x7f1138100e90 2024-04-21T10:20:48.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.614+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11380696b0 con 0x7f1138100e90 2024-04-21T10:20:48.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.615+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1138068d70 con 0x7f1138100e90 2024-04-21T10:20:48.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.616+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f1134009580 con 0x7f1138100e90 2024-04-21T10:20:48.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.616+0000 7f112e7fc640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f11240a3c30 0x7f11240a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.616+0000 7f113cf19640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f11240a3c30 0x7f11240a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.616+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f11340d1d50 con 0x7f1138100e90 2024-04-21T10:20:48.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.617+0000 7f113cf19640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f11240a3c30 0x7f11240a60f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f112802c840 tx=0x7f1128000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.620+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f113409e7d0 con 0x7f1138100e90 2024-04-21T10:20:48.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.798+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1138107ee0 con 0x7f1138100e90 2024-04-21T10:20:48.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.798+0000 7f112e7fc640 1 -- 172.21.15.77:0/2722414659 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f113409e0d0 con 0x7f1138100e90 2024-04-21T10:20:48.798 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f11240a3c30 msgr2=0x7f11240a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f11240a3c30 0x7f11240a60f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f112802c840 tx=0x7f1128000bc0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 msgr2=0x7f11381971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 0x7f11381971c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f113400df40 tx=0x7f113400df70 comp rx=0 tx=0).stop 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 shutdown_connections 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f11240a3c30 0x7f11240a60f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11381029a0 0x7f113819e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1138101fe0 0x7f1138197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 --2- 172.21.15.77:0/2722414659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1138100e90 0x7f11381971c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 >> 172.21.15.77:0/2722414659 conn(0x7f11380fc400 msgr2=0x7f1138105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 shutdown_connections 2024-04-21T10:20:48.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.800+0000 7f113f97e640 1 -- 172.21.15.77:0/2722414659 wait complete. 2024-04-21T10:20:48.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:20:48.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 -- 172.21.15.77:0/270521435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103b50 msgr2=0x7efc5010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 --2- 172.21.15.77:0/270521435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103b50 0x7efc5010a3e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc48009ca0 tx=0x7efc4802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 -- 172.21.15.77:0/270521435 shutdown_connections 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 --2- 172.21.15.77:0/270521435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103b50 0x7efc5010a3e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 --2- 172.21.15.77:0/270521435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50103190 0x7efc50103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 --2- 172.21.15.77:0/270521435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc50101fa0 0x7efc501023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 -- 172.21.15.77:0/270521435 >> 172.21.15.77:0/270521435 conn(0x7efc500fd530 msgr2=0x7efc500ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 -- 172.21.15.77:0/270521435 shutdown_connections 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.912+0000 7efc56767640 1 -- 172.21.15.77:0/270521435 wait complete. 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 Processor -- start 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 -- start start 2024-04-21T10:20:48.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50101fa0 0x7efc50198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 0x7efc501986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc50103b50 0x7efc5019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc5010dae0 con 0x7efc50103190 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efc5010d960 con 0x7efc50101fa0 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc56767640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efc5010dc60 con 0x7efc50103b50 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 0x7efc501986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 0x7efc501986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49346/0 (socket says 172.21.15.77:49346) 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 -- 172.21.15.77:0/1979742668 learned_addr learned my addr 172.21.15.77:0/1979742668 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc54d04640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc50103b50 0x7efc5019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 -- 172.21.15.77:0/1979742668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc50103b50 msgr2=0x7efc5019f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc50103b50 0x7efc5019f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 -- 172.21.15.77:0/1979742668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50101fa0 msgr2=0x7efc50198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4ffff640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50101fa0 0x7efc50198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.913+0000 7efc4f7fe640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50101fa0 0x7efc50198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc4f7fe640 1 -- 172.21.15.77:0/1979742668 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5019fd80 con 0x7efc50103190 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc4ffff640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50101fa0 0x7efc50198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc4f7fe640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 0x7efc501986a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c890 tx=0x7efc4400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44004220 con 0x7efc50103190 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc440043c0 con 0x7efc50103190 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc501a0070 con 0x7efc50103190 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44004a00 con 0x7efc50103190 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.914+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501a05c0 con 0x7efc50103190 2024-04-21T10:20:48.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.915+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc50109340 con 0x7efc50103190 2024-04-21T10:20:48.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.916+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7efc440079b0 con 0x7efc50103190 2024-04-21T10:20:48.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.917+0000 7efc4d7fa640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efc380a3bb0 0x7efc380a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:48.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.917+0000 7efc4ffff640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efc380a3bb0 0x7efc380a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:48.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.917+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7efc440d01e0 con 0x7efc50103190 2024-04-21T10:20:48.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.917+0000 7efc4ffff640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efc380a3bb0 0x7efc380a6070 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efc400058c0 tx=0x7efc40005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:48.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:48.921+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efc44014030 con 0x7efc50103190 2024-04-21T10:20:49.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.098+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efc50062b80 con 0x7efc50103190 2024-04-21T10:20:49.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.098+0000 7efc4d7fa640 1 -- 172.21.15.77:0/1979742668 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7efc4409cbd0 con 0x7efc50103190 2024-04-21T10:20:49.098 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:20:49.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.100+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efc380a3bb0 msgr2=0x7efc380a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.100+0000 7efc56767640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efc380a3bb0 0x7efc380a6070 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efc400058c0 tx=0x7efc40005d50 comp rx=0 tx=0).stop 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.100+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 msgr2=0x7efc501986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.100+0000 7efc56767640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 0x7efc501986a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c890 tx=0x7efc4400cd50 comp rx=0 tx=0).stop 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 shutdown_connections 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7efc380a3bb0 0x7efc380a6070 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc50103190 0x7efc501986a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc50103b50 0x7efc5019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 --2- 172.21.15.77:0/1979742668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc50101fa0 0x7efc50198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 >> 172.21.15.77:0/1979742668 conn(0x7efc500fd530 msgr2=0x7efc50106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 shutdown_connections 2024-04-21T10:20:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.101+0000 7efc56767640 1 -- 172.21.15.77:0/1979742668 wait complete. 2024-04-21T10:20:49.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:48 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/932491081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:49.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:48 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3789609764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:49.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:48 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/468834590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:20:49.112 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 -- 172.21.15.77:0/1201402178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c102a10 msgr2=0x7f7e2c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 --2- 172.21.15.77:0/1201402178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c102a10 0x7f7e2c109330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009ca0 tx=0x7f7e2402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 -- 172.21.15.77:0/1201402178 shutdown_connections 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 --2- 172.21.15.77:0/1201402178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c102a10 0x7f7e2c109330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 --2- 172.21.15.77:0/1201402178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e2c102050 0x7f7e2c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 --2- 172.21.15.77:0/1201402178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c100e70 0x7f7e2c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 -- 172.21.15.77:0/1201402178 >> 172.21.15.77:0/1201402178 conn(0x7f7e2c0fc470 msgr2=0x7f7e2c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 -- 172.21.15.77:0/1201402178 shutdown_connections 2024-04-21T10:20:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.210+0000 7f7e30d96640 1 -- 172.21.15.77:0/1201402178 wait complete. 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 Processor -- start 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 -- start start 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 0x7f7e2c198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c102050 0x7f7e2c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e2c102a10 0x7f7e2c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c10ca10 con 0x7f7e2c100e70 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c10c890 con 0x7f7e2c102050 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e30d96640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c10cb90 con 0x7f7e2c102a10 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 0x7f7e2c198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 0x7f7e2c198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49362/0 (socket says 172.21.15.77:49362) 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 -- 172.21.15.77:0/2180722510 learned_addr learned my addr 172.21.15.77:0/2180722510 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e23fff640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c102050 0x7f7e2c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2ad9d640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e2c102a10 0x7f7e2c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 -- 172.21.15.77:0/2180722510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e2c102a10 msgr2=0x7f7e2c19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e2c102a10 0x7f7e2c19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 -- 172.21.15.77:0/2180722510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c102050 msgr2=0x7f7e2c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c102050 0x7f7e2c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 -- 172.21.15.77:0/2180722510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c19fd30 con 0x7f7e2c100e70 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e23fff640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c102050 0x7f7e2c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.211+0000 7f7e2a59c640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 0x7f7e2c198110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00d770 tx=0x7f7e1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.212+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c017070 con 0x7f7e2c100e70 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.212+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e1c009c30 con 0x7f7e2c100e70 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.212+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c19ffc0 con 0x7f7e2c100e70 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.212+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c003cc0 con 0x7f7e2c100e70 2024-04-21T10:20:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.212+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c1a0480 con 0x7f7e2c100e70 2024-04-21T10:20:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.213+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c1a06e0 con 0x7f7e2c100e70 2024-04-21T10:20:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.214+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f7e1c003e60 con 0x7f7e2c100e70 2024-04-21T10:20:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.214+0000 7f7e237fe640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7e180a3bb0 0x7f7e180a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.214+0000 7f7e23fff640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7e180a3bb0 0x7f7e180a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.214+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f7e1c0d0240 con 0x7f7e2c100e70 2024-04-21T10:20:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.215+0000 7f7e23fff640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7e180a3bb0 0x7f7e180a6070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e14005fd0 tx=0x7f7e14005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.218+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7e1c009de0 con 0x7f7e2c100e70 2024-04-21T10:20:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:48 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/932491081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:48 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3789609764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:48 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/468834590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:20:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:48 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/932491081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:48 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3789609764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:48 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/468834590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:20:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.432+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e2c1a09d0 con 0x7f7e2c100e70 2024-04-21T10:20:49.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.433+0000 7f7e237fe640 1 -- 172.21.15.77:0/2180722510 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f7e1c09cc30 con 0x7f7e2c100e70 2024-04-21T10:20:49.433 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:49.433 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:19:26.977992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:20:49.433 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:20:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7e180a3bb0 msgr2=0x7f7e180a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7e180a3bb0 0x7f7e180a6070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e14005fd0 tx=0x7f7e14005ea0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 msgr2=0x7f7e2c198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 0x7f7e2c198110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00d770 tx=0x7f7e1c00dc30 comp rx=0 tx=0).stop 2024-04-21T10:20:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 shutdown_connections 2024-04-21T10:20:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f7e180a3bb0 0x7f7e180a6070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e2c102a10 0x7f7e2c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e2c102050 0x7f7e2c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 --2- 172.21.15.77:0/2180722510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c100e70 0x7f7e2c198110 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 >> 172.21.15.77:0/2180722510 conn(0x7f7e2c0fc470 msgr2=0x7f7e2c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 shutdown_connections 2024-04-21T10:20:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.435+0000 7f7e30d96640 1 -- 172.21.15.77:0/2180722510 wait complete. 2024-04-21T10:20:49.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:20:49.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 -- 172.21.15.77:0/4258879377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a0102a80 msgr2=0x7f78a0104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 --2- 172.21.15.77:0/4258879377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a0102a80 0x7f78a0104e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7890009900 tx=0x7f789002bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 -- 172.21.15.77:0/4258879377 shutdown_connections 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 --2- 172.21.15.77:0/4258879377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a0107ce0 0x7f78a010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 --2- 172.21.15.77:0/4258879377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a01053b0 0x7f78a01077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 --2- 172.21.15.77:0/4258879377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a0102a80 0x7f78a0104e70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 -- 172.21.15.77:0/4258879377 >> 172.21.15.77:0/4258879377 conn(0x7f78a00fc450 msgr2=0x7f78a00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 -- 172.21.15.77:0/4258879377 shutdown_connections 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.545+0000 7f78a5d10640 1 -- 172.21.15.77:0/4258879377 wait complete. 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 Processor -- start 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 -- start start 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0102a80 0x7f78a0198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 0x7f78a0198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a0107ce0 0x7f78a019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010dae0 con 0x7f78a01053b0 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010d960 con 0x7f78a0102a80 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f78a5d10640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010dc60 con 0x7f78a0107ce0 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f789effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 0x7f78a0198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f789effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 0x7f78a0198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49368/0 (socket says 172.21.15.77:49368) 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f789effd640 1 -- 172.21.15.77:0/3775667598 learned_addr learned my addr 172.21.15.77:0/3775667598 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.546+0000 7f789ffff640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a0107ce0 0x7f78a019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789f7fe640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0102a80 0x7f78a0198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789effd640 1 -- 172.21.15.77:0/3775667598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a0107ce0 msgr2=0x7f78a019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789effd640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a0107ce0 0x7f78a019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789effd640 1 -- 172.21.15.77:0/3775667598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0102a80 msgr2=0x7f78a0198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789effd640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0102a80 0x7f78a0198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789effd640 1 -- 172.21.15.77:0/3775667598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a019fd40 con 0x7f78a01053b0 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789f7fe640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0102a80 0x7f78a0198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789effd640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 0x7f78a0198660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f789400c970 tx=0x7f789400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:49.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894014070 con 0x7f78a01053b0 2024-04-21T10:20:49.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7894004440 con 0x7f78a01053b0 2024-04-21T10:20:49.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a019ffd0 con 0x7f78a01053b0 2024-04-21T10:20:49.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894003e50 con 0x7f78a01053b0 2024-04-21T10:20:49.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.547+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a01a04f0 con 0x7f78a01053b0 2024-04-21T10:20:49.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.548+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a00fdf40 con 0x7f78a01053b0 2024-04-21T10:20:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.549+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f7894017070 con 0x7f78a01053b0 2024-04-21T10:20:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.549+0000 7f789cff9640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78880a3d50 0x7f78880a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.550+0000 7f789f7fe640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78880a3d50 0x7f78880a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.550+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f78940cffe0 con 0x7f78a01053b0 2024-04-21T10:20:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.550+0000 7f789f7fe640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78880a3d50 0x7f78880a6210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f78900096c0 tx=0x7f7890000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.554+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f789401e030 con 0x7f78a01053b0 2024-04-21T10:20:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.735+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78a0062bf0 con 0x7f78a01053b0 2024-04-21T10:20:49.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.737+0000 7f789cff9640 1 -- 172.21.15.77:0/3775667598 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22664 (secure 0 0 0) 0x7f789400de20 con 0x7f78a01053b0 2024-04-21T10:20:49.737 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:49.737 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:20:15.816743+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78880a3d50 msgr2=0x7f78880a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78880a3d50 0x7f78880a6210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f78900096c0 tx=0x7f7890000bc0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 msgr2=0x7f78a0198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 0x7f78a0198660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f789400c970 tx=0x7f789400ce30 comp rx=0 tx=0).stop 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 shutdown_connections 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f78880a3d50 0x7f78880a6210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a01053b0 0x7f78a0198660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a0107ce0 0x7f78a019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 --2- 172.21.15.77:0/3775667598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0102a80 0x7f78a0198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 >> 172.21.15.77:0/3775667598 conn(0x7f78a00fc450 msgr2=0x7f78a01033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:49.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 shutdown_connections 2024-04-21T10:20:49.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.739+0000 7f78a5d10640 1 -- 172.21.15.77:0/3775667598 wait complete. 2024-04-21T10:20:49.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:20:49.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 -- 172.21.15.77:0/2645628402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 msgr2=0x7f9e4c103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 --2- 172.21.15.77:0/2645628402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c103600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009900 tx=0x7f9e3802bc30 comp rx=0 tx=0).stop 2024-04-21T10:20:49.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 -- 172.21.15.77:0/2645628402 shutdown_connections 2024-04-21T10:20:49.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 --2- 172.21.15.77:0/2645628402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c103600 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 --2- 172.21.15.77:0/2645628402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 0x7f9e4c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 --2- 172.21.15.77:0/2645628402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4c101f90 0x7f9e4c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 -- 172.21.15.77:0/2645628402 >> 172.21.15.77:0/2645628402 conn(0x7f9e4c0fd500 msgr2=0x7f9e4c0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 -- 172.21.15.77:0/2645628402 shutdown_connections 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 -- 172.21.15.77:0/2645628402 wait complete. 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 Processor -- start 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.850+0000 7f9e531fb640 1 -- start start 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4c101f90 0x7f9e4c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 0x7f9e4c19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c10dc00 con 0x7f9e4c103180 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c10da80 con 0x7f9e4c103b40 2024-04-21T10:20:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c10dd80 con 0x7f9e4c101f90 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49390/0 (socket says 172.21.15.77:49390) 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 -- 172.21.15.77:0/1171425859 learned_addr learned my addr 172.21.15.77:0/1171425859 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e51798640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 0x7f9e4c19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 -- 172.21.15.77:0/1171425859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4c101f90 msgr2=0x7f9e4c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4c101f90 0x7f9e4c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 -- 172.21.15.77:0/1171425859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 msgr2=0x7f9e4c19f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 0x7f9e4c19f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 -- 172.21.15.77:0/1171425859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c19ff50 con 0x7f9e4c103180 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e51798640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 0x7f9e4c19f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e4bfff640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c198870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9e38000c00 tx=0x7f9e380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38043020 con 0x7f9e4c103180 2024-04-21T10:20:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e380054c0 con 0x7f9e4c103180 2024-04-21T10:20:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4c1a01e0 con 0x7f9e4c103180 2024-04-21T10:20:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.851+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38003d80 con 0x7f9e4c103180 2024-04-21T10:20:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.852+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4c1a07b0 con 0x7f9e4c103180 2024-04-21T10:20:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.852+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4c1092d0 con 0x7f9e4c103180 2024-04-21T10:20:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.854+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f9e38046020 con 0x7f9e4c103180 2024-04-21T10:20:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.854+0000 7f9e49ffb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.854+0000 7f9e50f97640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.854+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f9e380f2cd0 con 0x7f9e4c103180 2024-04-21T10:20:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.855+0000 7f9e50f97640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c102fe0 tx=0x7f9e40006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:49.858+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9e3804d020 con 0x7f9e4c103180 2024-04-21T10:20:50.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.074+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e4c02d5c0 con 0x7f9e4c103180 2024-04-21T10:20:50.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.075+0000 7f9e49ffb640 1 -- 172.21.15.77:0/1171425859 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f9e380bf7e0 con 0x7f9e4c103180 2024-04-21T10:20:50.074 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:20:50.075 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:19:26.977992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:20:50.075 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:20:50.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 msgr2=0x7f9e3c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c102fe0 tx=0x7f9e40006c90 comp rx=0 tx=0).stop 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 msgr2=0x7f9e4c198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c198870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9e38000c00 tx=0x7f9e380042f0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 shutdown_connections 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4c103180 0x7f9e4c198870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e4c103b40 0x7f9e4c19f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 --2- 172.21.15.77:0/1171425859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4c101f90 0x7f9e4c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 >> 172.21.15.77:0/1171425859 conn(0x7f9e4c0fd500 msgr2=0x7f9e4c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 shutdown_connections 2024-04-21T10:20:50.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.077+0000 7f9e531fb640 1 -- 172.21.15.77:0/1171425859 wait complete. 2024-04-21T10:20:50.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:49 smithi077 ceph-mon[27902]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T10:20:50.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:49 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2722414659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:20:50.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:49 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1979742668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:20:50.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:49 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2180722510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:50.087 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:49 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3775667598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:50.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-21T10:19:22.828859+0000', 'modified': '2024-04-21T10:19:26.977992+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24505, 'mds_1': 24491, 'mds_2': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2131093525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2131093525}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2131093525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.170:6837/3141822041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6836', 'nonce': 3141822041}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 3141822041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6835/2650789974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2650789974}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 2650789974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6837/2009641600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 2009641600}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2009641600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.170:6839/4122605825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 4122605825}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 4122605825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.191:6839/2863843162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2863843162}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2863843162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24505, 'qdb_cluster': [24461, 24505, 24491]} 2024-04-21T10:20:50.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-21T10:20:50.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-21T10:20:50.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 -- 172.21.15.77:0/242841453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 msgr2=0x7f1c481092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/242841453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c481092c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009ca0 tx=0x7f1c4002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 -- 172.21.15.77:0/242841453 shutdown_connections 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/242841453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c481092c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/242841453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c48101fe0 0x7f1c48102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/242841453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c48100e90 0x7f1c481012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.190+0000 7f1c4e46d640 1 -- 172.21.15.77:0/242841453 >> 172.21.15.77:0/242841453 conn(0x7f1c480fc400 msgr2=0x7f1c480fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 -- 172.21.15.77:0/242841453 shutdown_connections 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 -- 172.21.15.77:0/242841453 wait complete. 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 Processor -- start 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 -- start start 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c48100e90 0x7f1c481981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c48101fe0 0x7f1c48198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c4819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4810c9f0 con 0x7f1c481029a0 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4810c870 con 0x7f1c48101fe0 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4e46d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4810cb70 con 0x7f1c48100e90 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4ca0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c4819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4ca0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c4819f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49406/0 (socket says 172.21.15.77:49406) 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.191+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1675728307 learned_addr learned my addr 172.21.15.77:0/1675728307 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c47fff640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c48100e90 0x7f1c481981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c477fe640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c48101fe0 0x7f1c48198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1675728307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c48100e90 msgr2=0x7f1c481981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c48100e90 0x7f1c481981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1675728307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c48101fe0 msgr2=0x7f1c48198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c48101fe0 0x7f1c48198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1675728307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4819fe10 con 0x7f1c481029a0 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c4819f7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1c4002c700 tx=0x7f1c400093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c457fa640 1 -- 172.21.15.77:0/1675728307 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40041020 con 0x7f1c481029a0 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c457fa640 1 -- 172.21.15.77:0/1675728307 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c40034d60 con 0x7f1c481029a0 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c481a00a0 con 0x7f1c481029a0 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c457fa640 1 -- 172.21.15.77:0/1675728307 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40039040 con 0x7f1c481029a0 2024-04-21T10:20:50.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.192+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c481a0590 con 0x7f1c481029a0 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.194+0000 7f1c457fa640 1 -- 172.21.15.77:0/1675728307 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f1c40044020 con 0x7f1c481029a0 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 Processor -- start 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 -- start start 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c457fa640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1c300a3bb0 0x7f1c300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 0x55b2701cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cd830 0x55b2701cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701d4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b270131b10 con 0x55b2701cce40 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b2700cf240 con 0x55b2701ce2d0 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c51064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b27012dad0 con 0x55b2701cd830 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c477fe640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1c300a3bb0 0x7f1c300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 0x55b2701cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c457fa640 1 -- 172.21.15.77:0/1675728307 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f1c400f22f0 con 0x7f1c481029a0 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 0x55b2701cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49410/0 (socket says 172.21.15.77:49410) 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 -- 172.21.15.77:0/3944911994 learned_addr learned my addr 172.21.15.77:0/3944911994 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c477fe640 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cd830 0x55b2701cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701d4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 -- 172.21.15.77:0/3944911994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cd830 msgr2=0x55b2701cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cd830 0x55b2701cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 -- 172.21.15.77:0/3944911994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 msgr2=0x55b2701d4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701d4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 -- 172.21.15.77:0/3944911994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26fe442d0 con 0x55b2701cce40 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c477fe640 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cd830 0x55b2701cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c477fe640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1c300a3bb0 0x7f1c300a6070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c48199700 tx=0x7f1c3c009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.195+0000 7f1c47fff640 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 0x55b2701cd260 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800b760 tx=0x7f1c3800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9081d82a391913 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c2e7fc640 1 -- 172.21.15.77:0/3944911994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38003dd0 con 0x55b2701cce40 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c2e7fc640 1 -- 172.21.15.77:0/3944911994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c38015070 con 0x55b2701cce40 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c2e7fc640 1 -- 172.21.15.77:0/3944911994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38004d50 con 0x55b2701cce40 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 -- 172.21.15.77:0/3944911994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 msgr2=0x55b2701cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 0x55b2701cd260 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800b760 tx=0x7f1c3800bc20 comp rx=0 tx=0).stop 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 -- 172.21.15.77:0/3944911994 shutdown_connections 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701d4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cd830 0x55b2701cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 --2- 172.21.15.77:0/3944911994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cce40 0x55b2701cd260 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 -- 172.21.15.77:0/3944911994 >> 172.21.15.77:0/3944911994 conn(0x55b2701c8f40 msgr2=0x55b2701c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 -- 172.21.15.77:0/3944911994 shutdown_connections 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.196+0000 7f1c51064740 1 -- 172.21.15.77:0/3944911994 wait complete. 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 -- start start 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 Processor -- start 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701de400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b2701d54b0 con 0x55b2701cd830 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b2700ba190 con 0x55b2701ce2d0 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b2701d5630 con 0x55b2701cce40 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c51064740 10 client.0 _ll_register_callbacks cb 0x55b2700b58b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49422/0 (socket says 172.21.15.77:49422) 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 -- 172.21.15.77:0/504658015 learned_addr learned my addr 172.21.15.77:0/504658015 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c47fff640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 -- 172.21.15.77:0/504658015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 msgr2=0x55b2701d6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701d6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 -- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 msgr2=0x55b2701de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701de400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c477fe640 1 -- 172.21.15.77:0/504658015 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b26ff0e6b0 con 0x55b2701cd830 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.197+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c477fe640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d73c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c010640 tx=0x7f1c3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528d867ac8bb2bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c277fe640 1 -- 172.21.15.77:0/504658015 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c01f920 con 0x55b2701cd830 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c38015070 con 0x55b2701cd830 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c277fe640 1 -- 172.21.15.77:0/504658015 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f1c3c01fac0 con 0x55b2701cd830 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c277fe640 1 -- 172.21.15.77:0/504658015 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1c3c01fcc0 con 0x55b2701cd830 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 10 client.15087 fetch_fsmap learned FSMap version 21 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b2701e1750 con 0x55b2701cd830 2024-04-21T10:20:50.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c277fe640 1 -- 172.21.15.77:0/504658015 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c38015070 con 0x55b2701cd830 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c277fe640 1 -- 172.21.15.77:0/504658015 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1c3c01c040 con 0x55b2701cd830 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 10 client.15087 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 20 client.15087 populate_metadata read hostname 'smithi077' 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b2701e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 4 client.15087 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.198+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 --> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b27013f530 con 0x55b2701e3e60 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.199+0000 7f1c47fff640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b2701e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.199+0000 7f1c277fe640 10 client.15087 ms_handle_connect on v2:172.21.15.170:6836/3141822041 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.199+0000 7f1c47fff640 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b2701e52d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5a7e7784dfe07cc server_cookie=f2dc10af502a6c7b in_seq=0 out_seq=0 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c277fe640 1 -- 172.21.15.77:0/504658015 <== mds.2 v2:172.21.15.170:6836/3141822041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b27013f530 con 0x55b2701e3e60 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c277fe640 10 client.15087 handle_command_reply: tid=0 2024-04-21T10:20:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 client.15087 shutdown 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 msgr2=0x55b2701d73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d73c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c010640 tx=0x7f1c3c004730 comp rx=0 tx=0).stop 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 shutdown_connections 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b2701e52d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d73c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c277fe640 0 client.15087 ms_handle_reset on v2:172.21.15.170:6836/3141822041 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701ce2d0 0x55b2701de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 --2- 172.21.15.77:0/504658015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701d6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 >> 172.21.15.77:0/504658015 conn(0x55b2701c8f40 msgr2=0x55b2701c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 shutdown_connections 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 1 -- 172.21.15.77:0/504658015 wait complete. 2024-04-21T10:20:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.200+0000 7f1c51064740 20 client.15087 trim_cache size 0 max 16384 2024-04-21T10:20:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 Processor -- start 2024-04-21T10:20:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 -- start start 2024-04-21T10:20:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cd830 0x55b2701de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 0x55b2701c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b2701e3610 con 0x55b2701ce2d0 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b2701e3ce0 con 0x55b2701cd830 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c51064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b2701e43b0 con 0x55b2701cce40 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c4ca0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 0x55b2701c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c4ca0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 0x55b2701c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49436/0 (socket says 172.21.15.77:49436) 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1001431088 learned_addr learned my addr 172.21.15.77:0/1001431088 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.218+0000 7f1c47fff640 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1001431088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 msgr2=0x55b2701c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1001431088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cd830 msgr2=0x55b2701de3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cd830 0x55b2701de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c4ca0a640 1 -- 172.21.15.77:0/1001431088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2701d12f0 con 0x55b2701ce2d0 2024-04-21T10:20:50.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c47fff640 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 0x55b2701c7890 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c40033000 tx=0x7f1c4002c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fde63dd436501ef server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c2dffb640 1 -- 172.21.15.77:0/1001431088 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c400a2310 con 0x55b2701ce2d0 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c2dffb640 1 -- 172.21.15.77:0/1001431088 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c400bece0 con 0x55b2701ce2d0 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c2dffb640 1 -- 172.21.15.77:0/1001431088 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c400453b0 con 0x55b2701ce2d0 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 -- 172.21.15.77:0/1001431088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 msgr2=0x55b2701c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 0x55b2701c7890 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c40033000 tx=0x7f1c4002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 -- 172.21.15.77:0/1001431088 shutdown_connections 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701ce2d0 0x55b2701c7890 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cd830 0x55b2701de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 --2- 172.21.15.77:0/1001431088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701cce40 0x55b2701c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 -- 172.21.15.77:0/1001431088 >> 172.21.15.77:0/1001431088 conn(0x55b2701c8f40 msgr2=0x55b2701d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 -- 172.21.15.77:0/1001431088 shutdown_connections 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.219+0000 7f1c51064740 1 -- 172.21.15.77:0/1001431088 wait complete. 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 -- start start 2024-04-21T10:20:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 Processor -- start 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cce40 0x55b2701d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701ce2d0 0x55b2701dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b2701e5150 con 0x55b2701cd830 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b2701e4a80 con 0x55b2701cce40 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b2701e5820 con 0x55b2701ce2d0 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c51064740 10 client.0 _ll_register_callbacks cb 0x7f1c3c009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49444/0 (socket says 172.21.15.77:49444) 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c477fe640 1 -- 172.21.15.77:0/1459549481 learned_addr learned my addr 172.21.15.77:0/1459549481 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c4ca0a640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701ce2d0 0x55b2701dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.220+0000 7f1c47fff640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cce40 0x55b2701d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c477fe640 1 -- 172.21.15.77:0/1459549481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701ce2d0 msgr2=0x55b2701dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c477fe640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701ce2d0 0x55b2701dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c477fe640 1 -- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cce40 msgr2=0x55b2701d9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c477fe640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cce40 0x55b2701d9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c477fe640 1 -- 172.21.15.77:0/1459549481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2701dd3c0 con 0x55b2701cd830 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c477fe640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d9f80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009bc0 tx=0x7f1c3c01de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf00cd67df8eda5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c277fe640 1 -- 172.21.15.77:0/1459549481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c01fe60 con 0x55b2701cd830 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c277fe640 1 -- 172.21.15.77:0/1459549481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f1c3c004020 con 0x55b2701cd830 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c400bece0 con 0x55b2701cd830 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c277fe640 1 -- 172.21.15.77:0/1459549481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1c3c010430 con 0x55b2701cd830 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 10 client.15093 fetch_fsmap learned FSMap version 21 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b2701de760 con 0x55b2701cd830 2024-04-21T10:20:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c277fe640 1 -- 172.21.15.77:0/1459549481 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c400bece0 con 0x55b2701cd830 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c277fe640 1 -- 172.21.15.77:0/1459549481 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1c3c01c030 con 0x55b2701cd830 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 10 client.15093 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 10 client.15093 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 20 client.15093 populate_metadata read hostname 'smithi077' 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b27024d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 4 client.15093 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.221+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 --> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] -- command(tid 0: {"prefix": "status"}) -- 0x55b2701393a0 con 0x55b2701e3e60 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c47fff640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b27024d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c47fff640 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b27024d4f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71aa2b75ef6faef2 server_cookie=80a8508551dda4f5 in_seq=0 out_seq=0 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c277fe640 10 client.15093 ms_handle_connect on v2:172.21.15.170:6836/3141822041 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c277fe640 1 -- 172.21.15.77:0/1459549481 <== mds.2 v2:172.21.15.170:6836/3141822041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b2701393a0 con 0x55b2701e3e60 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c277fe640 10 client.15093 handle_command_reply: tid=0 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 client.15093 shutdown 2024-04-21T10:20:50.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 msgr2=0x55b2701d9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d9f80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009bc0 tx=0x7f1c3c01de50 comp rx=0 tx=0).stop 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 shutdown_connections 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x55b2701e3e60 0x55b27024d4f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2701cd830 0x55b2701d9f80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2701ce2d0 0x55b2701dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c277fe640 0 client.15093 ms_handle_reset on v2:172.21.15.170:6836/3141822041 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 --2- 172.21.15.77:0/1459549481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2701cce40 0x55b2701d9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 >> 172.21.15.77:0/1459549481 conn(0x55b2701c8f40 msgr2=0x55b2701c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 shutdown_connections 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.222+0000 7f1c51064740 1 -- 172.21.15.77:0/1459549481 wait complete. 2024-04-21T10:20:50.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c51064740 20 client.15093 trim_cache size 0 max 16384 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 2, 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24461, 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 84.249292844999999, 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 87, 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 104.87670858200001 2024-04-21T10:20:50.230 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:20:50.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1c300a3bb0 msgr2=0x7f1c300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1c300a3bb0 0x7f1c300a6070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c48199700 tx=0x7f1c3c009840 comp rx=0 tx=0).stop 2024-04-21T10:20:50.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 msgr2=0x7f1c4819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c4819f7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1c4002c700 tx=0x7f1c400093f0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 shutdown_connections 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1c300a3bb0 0x7f1c300a6070 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481029a0 0x7f1c4819f7a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c48101fe0 0x7f1c48198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 --2- 172.21.15.77:0/1675728307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c48100e90 0x7f1c481981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 >> 172.21.15.77:0/1675728307 conn(0x7f1c480fc400 msgr2=0x7f1c480fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 shutdown_connections 2024-04-21T10:20:50.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.223+0000 7f1c4e46d640 1 -- 172.21.15.77:0/1675728307 wait complete. 2024-04-21T10:20:50.232 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:49 smithi191 ceph-mon[31636]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T10:20:50.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:49 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2722414659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:20:50.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:49 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1979742668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:20:50.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:49 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2180722510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:50.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:49 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3775667598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:50.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-21T10:20:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:49 smithi170 ceph-mon[31212]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T10:20:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:49 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2722414659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:20:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:49 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1979742668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:20:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:49 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2180722510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:49 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3775667598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.332+0000 7f589f7ef640 1 -- 172.21.15.77:0/349751907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 msgr2=0x7f5898109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.332+0000 7f589f7ef640 1 --2- 172.21.15.77:0/349751907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f5898109320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5890009ca0 tx=0x7f589002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- 172.21.15.77:0/349751907 shutdown_connections 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 --2- 172.21.15.77:0/349751907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f5898109320 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 --2- 172.21.15.77:0/349751907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898102040 0x7f58981024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 --2- 172.21.15.77:0/349751907 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898100e60 0x7f5898101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- 172.21.15.77:0/349751907 >> 172.21.15.77:0/349751907 conn(0x7f58980fc440 msgr2=0x7f58980fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- 172.21.15.77:0/349751907 shutdown_connections 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- 172.21.15.77:0/349751907 wait complete. 2024-04-21T10:20:50.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 Processor -- start 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- start start 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898100e60 0x7f5898198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898102040 0x7f5898198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f589819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f589810ca70 con 0x7f5898102a00 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f589810c8f0 con 0x7f5898100e60 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589f7ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f589810cbf0 con 0x7f5898102040 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589dd8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f589819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589dd8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f589819f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49458/0 (socket says 172.21.15.77:49458) 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.333+0000 7f589dd8c640 1 -- 172.21.15.77:0/1714954222 learned_addr learned my addr 172.21.15.77:0/1714954222 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589cd8a640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898102040 0x7f5898198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589dd8c640 1 -- 172.21.15.77:0/1714954222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898102040 msgr2=0x7f5898198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589dd8c640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898102040 0x7f5898198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589d58b640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898100e60 0x7f5898198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589dd8c640 1 -- 172.21.15.77:0/1714954222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898100e60 msgr2=0x7f5898198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589dd8c640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898100e60 0x7f5898198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589dd8c640 1 -- 172.21.15.77:0/1714954222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589819fe60 con 0x7f5898102a00 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589cd8a640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898102040 0x7f5898198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589dd8c640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f589819f7f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f589002c700 tx=0x7f5890035d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f588e7fc640 1 -- 172.21.15.77:0/1714954222 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890039040 con 0x7f5898102a00 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f588e7fc640 1 -- 172.21.15.77:0/1714954222 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5890044070 con 0x7f5898102a00 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58981a00f0 con 0x7f5898102a00 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f588e7fc640 1 -- 172.21.15.77:0/1714954222 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890004440 con 0x7f5898102a00 2024-04-21T10:20:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.334+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58981a0630 con 0x7f5898102a00 2024-04-21T10:20:50.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.336+0000 7f588e7fc640 1 -- 172.21.15.77:0/1714954222 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f58900045e0 con 0x7f5898102a00 2024-04-21T10:20:50.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 Processor -- start 2024-04-21T10:20:50.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 -- start start 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb249260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f588e7fc640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f58840a3c30 0x7f58840a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb249830 0x560edb249cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb250eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560edb1adb10 con 0x560edb24a2d0 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560edb14b240 con 0x560edb248e40 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f58a23dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560edb1a9ad0 con 0x560edb249830 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb250eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589d58b640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f58840a3c30 0x7f58840a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb250eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49474/0 (socket says 172.21.15.77:49474) 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 -- 172.21.15.77:0/927256392 learned_addr learned my addr 172.21.15.77:0/927256392 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f588e7fc640 1 -- 172.21.15.77:0/1714954222 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f58900f2b00 con 0x7f5898102a00 2024-04-21T10:20:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589cd8a640 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb249260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589cd8a640 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb249830 0x560edb249cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 -- 172.21.15.77:0/927256392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb249830 msgr2=0x560edb249cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb249830 0x560edb249cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 -- 172.21.15.77:0/927256392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 msgr2=0x560edb249260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb249260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 -- 172.21.15.77:0/927256392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560edaec02d0 con 0x560edb24a2d0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589d58b640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f58840a3c30 0x7f58840a60f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5898101bb0 tx=0x7f5888008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.337+0000 7f589dd8c640 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb250eb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5890032380 tx=0x7f5890035f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd74e3f39477b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58837fe640 1 -- 172.21.15.77:0/927256392 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58900be750 con 0x560edb24a2d0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58837fe640 1 -- 172.21.15.77:0/927256392 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58900098d0 con 0x560edb24a2d0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58837fe640 1 -- 172.21.15.77:0/927256392 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58900d8570 con 0x560edb24a2d0 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 -- 172.21.15.77:0/927256392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 msgr2=0x560edb250eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb250eb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5890032380 tx=0x7f5890035f50 comp rx=0 tx=0).stop 2024-04-21T10:20:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 -- 172.21.15.77:0/927256392 shutdown_connections 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb250eb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb249830 0x560edb249cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 --2- 172.21.15.77:0/927256392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb249260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 -- 172.21.15.77:0/927256392 >> 172.21.15.77:0/927256392 conn(0x560edb244f40 msgr2=0x560edb243490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 -- 172.21.15.77:0/927256392 shutdown_connections 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.338+0000 7f58a23dc740 1 -- 172.21.15.77:0/927256392 wait complete. 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 -- start start 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 Processor -- start 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb252ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 0x560edb253020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb25a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560edb24aad0 con 0x560edb249830 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560edb136190 con 0x560edb248e40 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560edb2513f0 con 0x560edb24a2d0 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f58a23dc740 10 client.0 _ll_register_callbacks cb 0x560edb1318b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 0x560edb253020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 0x560edb253020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49484/0 (socket says 172.21.15.77:49484) 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 -- 172.21.15.77:0/2841879770 learned_addr learned my addr 172.21.15.77:0/2841879770 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589dd8c640 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb25a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 -- 172.21.15.77:0/2841879770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 msgr2=0x560edb25a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb25a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 -- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 msgr2=0x560edb252ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb252ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.339+0000 7f589cd8a640 1 -- 172.21.15.77:0/2841879770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560edaf8a6b0 con 0x560edb249830 2024-04-21T10:20:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f589cd8a640 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 0x560edb253020 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5894012a70 tx=0x7f5894012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d7c28466ea7854 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f5880ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f5880ff9640 1 -- 172.21.15.77:0/2841879770 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894010ce0 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f5880ff9640 1 -- 172.21.15.77:0/2841879770 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f589401d480 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560edb1bb530 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f5880ff9640 1 -- 172.21.15.77:0/2841879770 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f589401d680 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 10 client.15105 fetch_fsmap learned FSMap version 21 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560edb25d4a0 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f5880ff9640 1 -- 172.21.15.77:0/2841879770 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560edb1bb530 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f5880ff9640 1 -- 172.21.15.77:0/2841879770 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f589400e440 con 0x560edb249830 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 10 client.15105 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 20 client.15105 populate_metadata read hostname 'smithi077' 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb25fbf0 0x560edb261060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 4 client.15105 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 --> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560edb1b53a0 con 0x560edb25fbf0 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.340+0000 7f589d58b640 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb25fbf0 0x560edb261060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.341+0000 7f5880ff9640 10 client.15105 ms_handle_connect on v2:172.21.15.170:6838/4122605825 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.341+0000 7f589d58b640 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb25fbf0 0x560edb261060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51508730b6763f86 server_cookie=d03acf1448fabf82 in_seq=0 out_seq=0 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f5880ff9640 1 -- 172.21.15.77:0/2841879770 <== mds.1 v2:172.21.15.170:6838/4122605825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560edb1b53a0 con 0x560edb25fbf0 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f5880ff9640 10 client.15105 handle_command_reply: tid=0 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 client.15105 shutdown 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 msgr2=0x560edb253020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 0x560edb253020 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5894012a70 tx=0x7f5894012f30 comp rx=0 tx=0).stop 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 shutdown_connections 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb25fbf0 0x560edb261060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb249830 0x560edb253020 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb25a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f5880ff9640 0 client.15105 ms_handle_reset on v2:172.21.15.170:6838/4122605825 2024-04-21T10:20:50.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2841879770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb248e40 0x560edb252ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 >> 172.21.15.77:0/2841879770 conn(0x560edb244f40 msgr2=0x560edb242a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 shutdown_connections 2024-04-21T10:20:50.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 1 -- 172.21.15.77:0/2841879770 wait complete. 2024-04-21T10:20:50.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.342+0000 7f58a23dc740 20 client.15105 trim_cache size 0 max 16384 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 Processor -- start 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 -- start start 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 0x560edb24d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb25a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb24dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560edb25f3a0 con 0x560edb248e40 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560edb25fa70 con 0x560edb249830 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f58a23dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560edb260140 con 0x560edb24a2d0 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 0x560edb24d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 0x560edb24d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49496/0 (socket says 172.21.15.77:49496) 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 -- 172.21.15.77:0/1442942402 learned_addr learned my addr 172.21.15.77:0/1442942402 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 -- 172.21.15.77:0/1442942402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 msgr2=0x560edb24dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb24dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 -- 172.21.15.77:0/1442942402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 msgr2=0x560edb25a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb25a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 -- 172.21.15.77:0/1442942402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560edb253ad0 con 0x560edb248e40 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f589d58b640 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 0x560edb24d6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x560edb2600a0 tx=0x7f58880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0798c6c761648c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f5882ffd640 1 -- 172.21.15.77:0/1442942402 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880159d0 con 0x560edb248e40 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f5882ffd640 1 -- 172.21.15.77:0/1442942402 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58880220f0 con 0x560edb248e40 2024-04-21T10:20:50.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.360+0000 7f5882ffd640 1 -- 172.21.15.77:0/1442942402 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888013680 con 0x560edb248e40 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 -- 172.21.15.77:0/1442942402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 msgr2=0x560edb24d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 0x560edb24d6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x560edb2600a0 tx=0x7f58880046c0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 -- 172.21.15.77:0/1442942402 shutdown_connections 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb24a2d0 0x560edb24dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb25a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 --2- 172.21.15.77:0/1442942402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb248e40 0x560edb24d6f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 -- 172.21.15.77:0/1442942402 >> 172.21.15.77:0/1442942402 conn(0x560edb244f40 msgr2=0x560edb25e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 -- 172.21.15.77:0/1442942402 shutdown_connections 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 -- 172.21.15.77:0/1442942402 wait complete. 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 -- start start 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.361+0000 7f58a23dc740 1 Processor -- start 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb248e40 0x560edb2551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb255700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb258720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560edb260ee0 con 0x560edb24a2d0 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560edb260810 con 0x560edb249830 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560edb2615b0 con 0x560edb248e40 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 10 client.0 _ll_register_callbacks cb 0x7f5894012680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb258720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb258720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49508/0 (socket says 172.21.15.77:49508) 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 -- 172.21.15.77:0/2181911977 learned_addr learned my addr 172.21.15.77:0/2181911977 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589cd8a640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb255700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 -- 172.21.15.77:0/2181911977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb248e40 msgr2=0x560edb2551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb248e40 0x560edb2551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 -- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 msgr2=0x560edb255700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb255700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 -- 172.21.15.77:0/2181911977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560edb258d10 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589cd8a640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb255700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f589dd8c640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb258720 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f58900beaf0 tx=0x7f58900bef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f47038be1580c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f5880ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f5880ff9640 1 -- 172.21.15.77:0/2181911977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58900d8750 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f5880ff9640 1 -- 172.21.15.77:0/2181911977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f58900990e0 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58880220f0 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f5880ff9640 1 -- 172.21.15.77:0/2181911977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f58900c7a60 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 10 client.15111 fetch_fsmap learned FSMap version 21 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.362+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560edb25a010 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f5880ff9640 1 -- 172.21.15.77:0/2181911977 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58880220f0 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f5880ff9640 1 -- 172.21.15.77:0/2181911977 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f589003c030 con 0x560edb24a2d0 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f58a23dc740 10 client.15111 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f58a23dc740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f58a23dc740 20 client.15111 populate_metadata read hostname 'smithi077' 2024-04-21T10:20:50.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb2c9f00 0x560edb2c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f58a23dc740 4 client.15111 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 --> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] -- command(tid 0: {"prefix": "status"}) -- 0x560edb131960 con 0x560edb2c9f00 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f589d58b640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb2c9f00 0x560edb2c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f589d58b640 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb2c9f00 0x560edb2c8c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9411bf6fe21a09cd server_cookie=fd90172e8787552b in_seq=0 out_seq=0 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.363+0000 7f5880ff9640 10 client.15111 ms_handle_connect on v2:172.21.15.170:6838/4122605825 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f5880ff9640 1 -- 172.21.15.77:0/2181911977 <== mds.1 v2:172.21.15.170:6838/4122605825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560edb131960 con 0x560edb2c9f00 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f5880ff9640 10 client.15111 handle_command_reply: tid=0 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 client.15111 shutdown 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 msgr2=0x560edb258720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb258720 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f58900beaf0 tx=0x7f58900bef30 comp rx=0 tx=0).stop 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 shutdown_connections 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x560edb2c9f00 0x560edb2c8c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560edb24a2d0 0x560edb258720 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560edb249830 0x560edb255700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f5880ff9640 0 client.15111 ms_handle_reset on v2:172.21.15.170:6838/4122605825 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 --2- 172.21.15.77:0/2181911977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560edb248e40 0x560edb2551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 >> 172.21.15.77:0/2181911977 conn(0x560edb244f40 msgr2=0x560edb24d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 shutdown_connections 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 1 -- 172.21.15.77:0/2181911977 wait complete. 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f58a23dc740 20 client.15111 trim_cache size 0 max 16384 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24491, 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:20:50.371 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 84.842130187999999, 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 87, 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 94.003850549000006 2024-04-21T10:20:50.372 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f58840a3c30 msgr2=0x7f58840a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f58840a3c30 0x7f58840a60f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5898101bb0 tx=0x7f5888008040 comp rx=0 tx=0).stop 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 msgr2=0x7f589819f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f589819f7f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f589002c700 tx=0x7f5890035d60 comp rx=0 tx=0).stop 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 shutdown_connections 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f58840a3c30 0x7f58840a60f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102a00 0x7f589819f7f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5898102040 0x7f5898198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 --2- 172.21.15.77:0/1714954222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898100e60 0x7f5898198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.364+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 >> 172.21.15.77:0/1714954222 conn(0x7f58980fc440 msgr2=0x7f589806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.365+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 shutdown_connections 2024-04-21T10:20:50.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.365+0000 7f589f7ef640 1 -- 172.21.15.77:0/1714954222 wait complete. 2024-04-21T10:20:50.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-21T10:20:50.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2455426093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f8107d10 msgr2=0x7f20f810a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2455426093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f8107d10 0x7f20f810a100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ca0 tx=0x7f20f002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2455426093 shutdown_connections 2024-04-21T10:20:50.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2455426093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f8107d10 0x7f20f810a100 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2455426093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f81053e0 0x7f20f81077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2455426093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8102ab0 0x7f20f8104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2455426093 >> 172.21.15.77:0/2455426093 conn(0x7f20f80fc400 msgr2=0x7f20f80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2455426093 shutdown_connections 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.473+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2455426093 wait complete. 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 Processor -- start 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 -- start start 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f8102ab0 0x7f20f81981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 0x7f20f8198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8107d10 0x7f20f819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f20f810daf0 con 0x7f20f81053e0 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f20f810d970 con 0x7f20f8107d10 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fe7ce640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f20f810dc70 con 0x7f20f8102ab0 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 0x7f20f8198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 0x7f20f8198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49526/0 (socket says 172.21.15.77:49526) 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20f77fe640 1 -- 172.21.15.77:0/2228382506 learned_addr learned my addr 172.21.15.77:0/2228382506 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8107d10 0x7f20f819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.474+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f8102ab0 0x7f20f81981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f77fe640 1 -- 172.21.15.77:0/2228382506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f8102ab0 msgr2=0x7f20f81981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f8102ab0 0x7f20f81981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f77fe640 1 -- 172.21.15.77:0/2228382506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8107d10 msgr2=0x7f20f819f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8107d10 0x7f20f819f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f77fe640 1 -- 172.21.15.77:0/2228382506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f819fdf0 con 0x7f20f81053e0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 0x7f20f8198710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00c970 tx=0x7f20ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f57fa640 1 -- 172.21.15.77:0/2228382506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec007bb0 con 0x7f20f81053e0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f57fa640 1 -- 172.21.15.77:0/2228382506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20ec007d50 con 0x7f20f81053e0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f81a00e0 con 0x7f20f81053e0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20f57fa640 1 -- 172.21.15.77:0/2228382506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec018730 con 0x7f20f81053e0 2024-04-21T10:20:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.475+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a05e0 con 0x7f20f81053e0 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.477+0000 7f20f57fa640 1 -- 172.21.15.77:0/2228382506 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f20ec00f990 con 0x7f20f81053e0 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.477+0000 7f21013c0740 1 Processor -- start 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.477+0000 7f21013c0740 1 -- start start 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f21013c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7de40 0x55615ed7e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f21013c0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed7ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f21013c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed85eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f21013c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55615ece2b10 con 0x55615ed7f2d0 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f21013c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55615ec80240 con 0x55615ed7de40 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f21013c0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55615ecdead0 con 0x55615ed7e830 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed85eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed85eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49530/0 (socket says 172.21.15.77:49530) 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 -- 172.21.15.77:0/2893403621 learned_addr learned my addr 172.21.15.77:0/2893403621 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7de40 0x55615ed7e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed7ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 -- 172.21.15.77:0/2893403621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 msgr2=0x55615ed7ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed7ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 -- 172.21.15.77:0/2893403621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7de40 msgr2=0x55615ed7e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7de40 0x55615ed7e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f57fa640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20e00a3bb0 0x7f20e00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 -- 172.21.15.77:0/2893403621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615e9f52d0 con 0x55615ed7f2d0 2024-04-21T10:20:50.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20e00a3bb0 0x7f20e00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed85eb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20ec098ae0 tx=0x7f20ec0989e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12c4c1181f465 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20f57fa640 1 -- 172.21.15.77:0/2228382506 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f20ec0d0390 con 0x7f20f81053e0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20de7fc640 1 -- 172.21.15.77:0/2893403621 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec09c450 con 0x55615ed7f2d0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.478+0000 7f20de7fc640 1 -- 172.21.15.77:0/2893403621 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20ec09cd80 con 0x55615ed7f2d0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f20de7fc640 1 -- 172.21.15.77:0/2893403621 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0870d0 con 0x55615ed7f2d0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20e00a3bb0 0x7f20e00a6070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004610 tx=0x7f20e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 -- 172.21.15.77:0/2893403621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 msgr2=0x55615ed85eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed85eb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20ec098ae0 tx=0x7f20ec0989e0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 -- 172.21.15.77:0/2893403621 shutdown_connections 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed85eb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed7ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 --2- 172.21.15.77:0/2893403621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7de40 0x55615ed7e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 -- 172.21.15.77:0/2893403621 >> 172.21.15.77:0/2893403621 conn(0x55615ed79f40 msgr2=0x55615ed78490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 -- 172.21.15.77:0/2893403621 shutdown_connections 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 -- 172.21.15.77:0/2893403621 wait complete. 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.479+0000 7f21013c0740 1 -- start start 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 Processor -- start 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 0x55615ed8c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed938c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55615ed8a800 con 0x55615ed7de40 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55615ec6b190 con 0x55615ed7f2d0 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55615ed8a980 con 0x55615ed7e830 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f21013c0740 10 client.0 _ll_register_callbacks cb 0x55615ec668b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 0x55615ed8c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 0x55615ed8c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49534/0 (socket says 172.21.15.77:49534) 2024-04-21T10:20:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 -- 172.21.15.77:0/2188639842 learned_addr learned my addr 172.21.15.77:0/2188639842 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 -- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 msgr2=0x55615ed8c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed8c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 -- 172.21.15.77:0/2188639842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 msgr2=0x55615ed938c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed938c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 -- 172.21.15.77:0/2188639842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55615eabf6b0 con 0x55615ed7de40 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed938c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.480+0000 7f20f7fff640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 0x55615ed8c340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f20e8003d80 tx=0x7f20e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eeb60ff42adde42 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20d77fe640 1 -- 172.21.15.77:0/2188639842 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e801b660 con 0x55615ed7de40 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20d77fe640 1 -- 172.21.15.77:0/2188639842 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f20e801b800 con 0x55615ed7de40 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ec09cd80 con 0x55615ed7de40 2024-04-21T10:20:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20d77fe640 1 -- 172.21.15.77:0/2188639842 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f20e801ba00 con 0x55615ed7de40 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 10 client.15123 fetch_fsmap learned FSMap version 21 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55615ed96d00 con 0x55615ed7de40 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20d77fe640 1 -- 172.21.15.77:0/2188639842 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20ec09cd80 con 0x55615ed7de40 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20d77fe640 1 -- 172.21.15.77:0/2188639842 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f20e802f070 con 0x55615ed7de40 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 10 client.15123 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 10 client.15123 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 20 client.15123 populate_metadata read hostname 'smithi077' 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ed99400 0x55615ed9a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 4 client.15123 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55615ecf0530 con 0x55615ed99400 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.481+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ed99400 0x55615ed9a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.482+0000 7f20d77fe640 10 client.15123 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.482+0000 7f20f77fe640 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ed99400 0x55615ed9a870 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e990ccb69ca98d5 server_cookie=d2a4da07bf3c86df in_seq=0 out_seq=0 2024-04-21T10:20:50.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.482+0000 7f20d77fe640 1 -- 172.21.15.77:0/2188639842 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55615ecf0530 con 0x55615ed99400 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.482+0000 7f20d77fe640 10 client.15123 handle_command_reply: tid=0 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 client.15123 shutdown 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 msgr2=0x55615ed8c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 0x55615ed8c340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f20e8003d80 tx=0x7f20e80046c0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 shutdown_connections 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ed99400 0x55615ed9a870 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed938c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f20d77fe640 0 client.15123 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7e830 0x55615ed8c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 --2- 172.21.15.77:0/2188639842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7de40 0x55615ed8c340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 >> 172.21.15.77:0/2188639842 conn(0x55615ed79f40 msgr2=0x55615ed77a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 shutdown_connections 2024-04-21T10:20:50.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 1 -- 172.21.15.77:0/2188639842 wait complete. 2024-04-21T10:20:50.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.483+0000 7f21013c0740 20 client.15123 trim_cache size 0 max 16384 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 Processor -- start 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 -- start start 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed82980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7e830 0x55615ed82ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed93850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55615ed98bb0 con 0x55615ed7f2d0 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55615ed99280 con 0x55615ed7e830 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f21013c0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55615ed99950 con 0x55615ed7de40 2024-04-21T10:20:50.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed93850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed93850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49538/0 (socket says 172.21.15.77:49538) 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 -- 172.21.15.77:0/1967165351 learned_addr learned my addr 172.21.15.77:0/1967165351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20f7fff640 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed82980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20f77fe640 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7e830 0x55615ed82ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 -- 172.21.15.77:0/1967165351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 msgr2=0x55615ed82980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed82980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 -- 172.21.15.77:0/1967165351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7e830 msgr2=0x55615ed82ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7e830 0x55615ed82ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 -- 172.21.15.77:0/1967165351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615ed72d80 con 0x55615ed7f2d0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed93850 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f20f0037040 tx=0x7f20f0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf9088e6f5f1cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.502+0000 7f20ddffb640 1 -- 172.21.15.77:0/1967165351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0039040 con 0x55615ed7f2d0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f20ddffb640 1 -- 172.21.15.77:0/1967165351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20f0032e80 con 0x55615ed7f2d0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f20ddffb640 1 -- 172.21.15.77:0/1967165351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f00043c0 con 0x55615ed7f2d0 2024-04-21T10:20:50.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 -- 172.21.15.77:0/1967165351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 msgr2=0x55615ed93850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed93850 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f20f0037040 tx=0x7f20f0009a20 comp rx=0 tx=0).stop 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 -- 172.21.15.77:0/1967165351 shutdown_connections 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7f2d0 0x55615ed93850 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7e830 0x55615ed82ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 --2- 172.21.15.77:0/1967165351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed82980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 -- 172.21.15.77:0/1967165351 >> 172.21.15.77:0/1967165351 conn(0x55615ed79f40 msgr2=0x55615ed981c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 -- 172.21.15.77:0/1967165351 shutdown_connections 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.503+0000 7f21013c0740 1 -- 172.21.15.77:0/1967165351 wait complete. 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 -- start start 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 Processor -- start 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 0x55615ed917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed91de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55615ed9a6f0 con 0x55615ed7e830 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55615ed9a020 con 0x55615ed7f2d0 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55615ed9adc0 con 0x55615ed7de40 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f21013c0740 10 client.0 _ll_register_callbacks cb 0x7f20e8005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 0x55615ed917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 0x55615ed917d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49544/0 (socket says 172.21.15.77:49544) 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 -- 172.21.15.77:0/734546757 learned_addr learned my addr 172.21.15.77:0/734546757 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed91de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f7fff640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 -- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 msgr2=0x55615ed820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed820d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 -- 172.21.15.77:0/734546757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 msgr2=0x55615ed91de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed91de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f77fe640 1 -- 172.21.15.77:0/734546757 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55615ed92610 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20fcd6b640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed91de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.504+0000 7f20f7fff640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20f77fe640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 0x55615ed917d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cdef0 tx=0x7f20ec007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0b2746ee547a15 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20d77fe640 1 -- 172.21.15.77:0/734546757 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec09bfe0 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20d77fe640 1 -- 172.21.15.77:0/734546757 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f20ec09a980 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f0032e80 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20d77fe640 1 -- 172.21.15.77:0/734546757 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f20ec09c1c0 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 10 client.15129 fetch_fsmap learned FSMap version 21 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55615ed93910 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20d77fe640 1 -- 172.21.15.77:0/734546757 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20f0032e80 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f20d77fe640 1 -- 172.21.15.77:0/734546757 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f20ec020030 con 0x55615ed7e830 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 10 client.15129 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:20:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 10 client.15129 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 20 client.15129 populate_metadata read hostname 'smithi077' 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ee03630 0x55615ee02340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 4 client.15129 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.505+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "status"}) -- 0x55615ecea3a0 con 0x55615ee03630 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f20f7fff640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ee03630 0x55615ee02340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f20f7fff640 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ee03630 0x55615ee02340 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bcc59ea7b1651a2 server_cookie=6eb278aed35a2961 in_seq=0 out_seq=0 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f20d77fe640 10 client.15129 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f20d77fe640 1 -- 172.21.15.77:0/734546757 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55615ecea3a0 con 0x55615ee03630 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f20d77fe640 10 client.15129 handle_command_reply: tid=0 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 client.15129 shutdown 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 msgr2=0x55615ed917d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 0x55615ed917d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cdef0 tx=0x7f20ec007f00 comp rx=0 tx=0).stop 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 shutdown_connections 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55615ee03630 0x55615ee02340 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55615ed7e830 0x55615ed917d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f20d77fe640 0 client.15129 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55615ed7f2d0 0x55615ed91de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 --2- 172.21.15.77:0/734546757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55615ed7de40 0x55615ed820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 >> 172.21.15.77:0/734546757 conn(0x55615ed79f40 msgr2=0x55615ed78400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 shutdown_connections 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.506+0000 7f21013c0740 1 -- 172.21.15.77:0/734546757 wait complete. 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f21013c0740 20 client.15129 trim_cache size 0 max 16384 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:20:50.513 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24505, 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 87.002565657999995, 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 87, 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 102.384812145 2024-04-21T10:20:50.514 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20e00a3bb0 msgr2=0x7f20e00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20e00a3bb0 0x7f20e00a6070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004610 tx=0x7f20e800b390 comp rx=0 tx=0).stop 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 msgr2=0x7f20f8198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 0x7f20f8198710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00c970 tx=0x7f20ec00ce30 comp rx=0 tx=0).stop 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 shutdown_connections 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f20e00a3bb0 0x7f20e00a6070 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20f81053e0 0x7f20f8198710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8107d10 0x7f20f819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 --2- 172.21.15.77:0/2228382506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f8102ab0 0x7f20f81981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 >> 172.21.15.77:0/2228382506 conn(0x7f20f80fc400 msgr2=0x7f20f81034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 shutdown_connections 2024-04-21T10:20:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:50.507+0000 7f20fe7ce640 1 -- 172.21.15.77:0/2228382506 wait complete. 2024-04-21T10:20:50.517 INFO:tasks.cephadm:Setup complete, yielding 2024-04-21T10:20:50.518 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-21T10:20:50.527 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:20:50.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-21T10:20:50.764 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:50 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1171425859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:50 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1171425859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:50 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1171425859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:20:52.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:51 smithi077 ceph-mon[27902]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-21T10:20:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:51 smithi191 ceph-mon[31636]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-21T10:20:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:51 smithi170 ceph-mon[31212]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 -- 172.21.15.77:0/914294820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff298103540 msgr2=0x7ff298109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 --2- 172.21.15.77:0/914294820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff298103540 0x7ff298109df0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff2900099c0 tx=0x7ff290009cd0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 -- 172.21.15.77:0/914294820 shutdown_connections 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 --2- 172.21.15.77:0/914294820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2981019a0 0x7ff298101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 --2- 172.21.15.77:0/914294820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff298103540 0x7ff298109df0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 --2- 172.21.15.77:0/914294820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff298102ba0 0x7ff298103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 -- 172.21.15.77:0/914294820 >> 172.21.15.77:0/914294820 conn(0x7ff2980fcf40 msgr2=0x7ff2980ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 -- 172.21.15.77:0/914294820 shutdown_connections 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.565+0000 7ff29f8be700 1 -- 172.21.15.77:0/914294820 wait complete. 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 Processor -- start 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 -- start start 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 0x7ff29806b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff298102ba0 0x7ff29819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff298103540 0x7ff2981a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810d490 con 0x7ff2981019a0 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810d310 con 0x7ff298102ba0 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29f8be700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810d610 con 0x7ff298103540 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 0x7ff29806b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 0x7ff29806b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49374/0 (socket says 172.21.15.77:49374) 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 -- 172.21.15.77:0/3202535256 learned_addr learned my addr 172.21.15.77:0/3202535256 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29de5b700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff298103540 0x7ff2981a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29ce59700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff298102ba0 0x7ff29819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 -- 172.21.15.77:0/3202535256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff298103540 msgr2=0x7ff2981a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff298103540 0x7ff2981a22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 -- 172.21.15.77:0/3202535256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff298102ba0 msgr2=0x7ff29819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff298102ba0 0x7ff29819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29d65a700 1 -- 172.21.15.77:0/3202535256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2981a2ab0 con 0x7ff2981019a0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.566+0000 7ff29ce59700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff298102ba0 0x7ff29819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.567+0000 7ff29d65a700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 0x7ff29806b280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff288007ee0 tx=0x7ff28800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.567+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28801a070 con 0x7ff2981019a0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.567+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2880158b0 con 0x7ff2981019a0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.567+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2981a2da0 con 0x7ff2981019a0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.567+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880147c0 con 0x7ff2981019a0 2024-04-21T10:20:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.567+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2981a3250 con 0x7ff2981019a0 2024-04-21T10:20:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.568+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff298069730 con 0x7ff2981019a0 2024-04-21T10:20:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.569+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7ff288015a60 con 0x7ff2981019a0 2024-04-21T10:20:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.570+0000 7ff2967fc700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2800a3c40 0x7ff2800a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.570+0000 7ff29ce59700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2800a3c40 0x7ff2800a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.570+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff2880cff10 con 0x7ff2981019a0 2024-04-21T10:20:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.570+0000 7ff29ce59700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2800a3c40 0x7ff2800a6100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff29806b800 tx=0x7ff28c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.574+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff288050ff0 con 0x7ff2981019a0 2024-04-21T10:20:52.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.791+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff298062e80 con 0x7ff2800a3c40 2024-04-21T10:20:52.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.792+0000 7ff2967fc700 1 -- 172.21.15.77:0/3202535256 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff298062e80 con 0x7ff2800a3c40 2024-04-21T10:20:52.792 INFO:teuthology.orchestra.run.smithi077.stdout:Backend: cephadm 2024-04-21T10:20:52.792 INFO:teuthology.orchestra.run.smithi077.stdout:Available: Yes 2024-04-21T10:20:52.792 INFO:teuthology.orchestra.run.smithi077.stdout:Paused: No 2024-04-21T10:20:52.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2800a3c40 msgr2=0x7ff2800a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:52.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2800a3c40 0x7ff2800a6100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff29806b800 tx=0x7ff28c008040 comp rx=0 tx=0).stop 2024-04-21T10:20:52.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 msgr2=0x7ff29806b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:52.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 0x7ff29806b280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff288007ee0 tx=0x7ff28800d3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 shutdown_connections 2024-04-21T10:20:52.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff2800a3c40 0x7ff2800a6100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff298103540 0x7ff2981a22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2981019a0 0x7ff29806b280 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 --2- 172.21.15.77:0/3202535256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff298102ba0 0x7ff29819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 >> 172.21.15.77:0/3202535256 conn(0x7ff2980fcf40 msgr2=0x7ff298105f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 shutdown_connections 2024-04-21T10:20:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:52.794+0000 7ff29f8be700 1 -- 172.21.15.77:0/3202535256 wait complete. 2024-04-21T10:20:53.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-21T10:20:53.810 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:54.086 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:53 smithi077 ceph-mon[27902]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-21T10:20:54.086 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:53 smithi077 ceph-mon[27902]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:20:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:53 smithi191 ceph-mon[31636]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-21T10:20:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:53 smithi191 ceph-mon[31636]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:20:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:53 smithi170 ceph-mon[31212]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-21T10:20:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:53 smithi170 ceph-mon[31212]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:20:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 -- 172.21.15.77:0/938781635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38102ad0 msgr2=0x7f3f38102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/938781635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38102ad0 0x7f3f38102ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3f280099c0 tx=0x7f3f28009cd0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 -- 172.21.15.77:0/938781635 shutdown_connections 2024-04-21T10:20:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/938781635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38104670 0x7f3f3810af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/938781635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38102ad0 0x7f3f38102ef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/938781635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f38103cd0 0x7f3f38104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 -- 172.21.15.77:0/938781635 >> 172.21.15.77:0/938781635 conn(0x7f3f380fe090 msgr2=0x7f3f381004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 -- 172.21.15.77:0/938781635 shutdown_connections 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 -- 172.21.15.77:0/938781635 wait complete. 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 Processor -- start 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.674+0000 7f3f3f51e700 1 -- start start 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38102ad0 0x7f3f38198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 0x7f3f38199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f38104670 0x7f3f381a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3810e5c0 con 0x7f3f38103cd0 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3810e440 con 0x7f3f38102ad0 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3810e740 con 0x7f3f38104670 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 0x7f3f38199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 0x7f3f38199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49394/0 (socket says 172.21.15.77:49394) 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 -- 172.21.15.77:0/539712361 learned_addr learned my addr 172.21.15.77:0/539712361 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3d2ba700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38102ad0 0x7f3f38198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3dabb700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f38104670 0x7f3f381a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 -- 172.21.15.77:0/539712361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f38104670 msgr2=0x7f3f381a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f38104670 0x7f3f381a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 -- 172.21.15.77:0/539712361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38102ad0 msgr2=0x7f3f38198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38102ad0 0x7f3f38198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 -- 172.21.15.77:0/539712361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f381a0830 con 0x7f3f38103cd0 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3d2ba700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38102ad0 0x7f3f38198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3cab9700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 0x7f3f38199110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400b560 tx=0x7f3f3400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34015020 con 0x7f3f38103cd0 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f34011ce0 con 0x7f3f38103cd0 2024-04-21T10:20:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34010da0 con 0x7f3f38103cd0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f381a0b20 con 0x7f3f38103cd0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.675+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f381a1010 con 0x7f3f38103cd0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.676+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38069730 con 0x7f3f38103cd0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.678+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f3f34018020 con 0x7f3f38103cd0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.678+0000 7f3f2e7fc700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3f240a3c40 0x7f3f240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.678+0000 7f3f3d2ba700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3f240a3c40 0x7f3f240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.678+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f3f340d0210 con 0x7f3f38103cd0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.679+0000 7f3f3d2ba700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3f240a3c40 0x7f3f240a6100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b580 tx=0x7f3f28005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.682+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3f3401f020 con 0x7f3f38103cd0 2024-04-21T10:20:55.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.893+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3f38062e80 con 0x7f3f240a3c40 2024-04-21T10:20:55.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.907+0000 7f3f2e7fc700 1 -- 172.21.15.77:0/539712361 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f3f38062e80 con 0x7f3f240a3c40 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.a smithi077 running (102s) 19s ago 102s 15.3M - 19.0.0-3154-ga630765c b45a994450e2 f09409db8a65 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.b smithi170 running (99s) 33s ago 99s 19.0M - 19.0.0-3154-ga630765c b45a994450e2 82a9fc62c242 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.c smithi191 running (113s) 33s ago 113s 20.2M - 19.0.0-3154-ga630765c b45a994450e2 949befae87e9 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.d smithi077 running (2m) 19s ago 2m 15.4M - 19.0.0-3154-ga630765c b45a994450e2 124a63c41e9d 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.e smithi170 running (119s) 33s ago 119s 16.2M - 19.0.0-3154-ga630765c b45a994450e2 aabf9088ef71 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.f smithi191 running (116s) 33s ago 116s 19.1M - 19.0.0-3154-ga630765c b45a994450e2 2111e919df16 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.g smithi077 running (105s) 19s ago 104s 13.9M - 19.0.0-3154-ga630765c b45a994450e2 19a67faa77ed 2024-04-21T10:20:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:mds.h smithi170 running (110s) 33s ago 110s 18.8M - 19.0.0-3154-ga630765c b45a994450e2 c53718f14098 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mds.i smithi191 running (108s) 33s ago 107s 25.3M - 19.0.0-3154-ga630765c b45a994450e2 011dfd7e1185 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mds.j smithi077 running (2m) 19s ago 2m 13.7M - 19.0.0-3154-ga630765c b45a994450e2 afa8a0f6bfbf 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mds.k smithi170 running (2m) 33s ago 2m 13.2M - 19.0.0-3154-ga630765c b45a994450e2 8e79c792727f 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mds.l smithi191 running (2m) 33s ago 2m 19.3M - 19.0.0-3154-ga630765c b45a994450e2 552dc808c958 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.x smithi077 *:9283,8765 running (9m) 19s ago 9m 514M - 19.0.0-3154-ga630765c b45a994450e2 f60ebce81d7f 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.y smithi170 *:8443,8765 running (7m) 33s ago 7m 454M - 19.0.0-3154-ga630765c b45a994450e2 28ecb3bb4045 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.z smithi191 *:8443,8765 running (7m) 33s ago 7m 452M - 19.0.0-3154-ga630765c b45a994450e2 87918d745da1 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mon.a smithi077 running (9m) 19s ago 9m 49.6M 2048M 19.0.0-3154-ga630765c b45a994450e2 d3416ecaa582 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mon.b smithi170 running (7m) 33s ago 7m 39.0M 2048M 19.0.0-3154-ga630765c b45a994450e2 7a6efca93f45 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:mon.c smithi191 running (7m) 33s ago 7m 40.7M 2048M 19.0.0-3154-ga630765c b45a994450e2 48bef46c5215 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 19s ago 7m 54.9M 4272M 19.0.0-3154-ga630765c b45a994450e2 02008180abb2 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi170 running (6m) 33s ago 6m 48.4M 4272M 19.0.0-3154-ga630765c b45a994450e2 e4dc833b0ea3 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi191 running (6m) 33s ago 6m 46.6M 4272M 19.0.0-3154-ga630765c b45a994450e2 1eaf92196e15 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi077 running (6m) 19s ago 5m 57.2M 4272M 19.0.0-3154-ga630765c b45a994450e2 40a1857d1b32 2024-04-21T10:20:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi170 running (5m) 33s ago 5m 45.3M 4272M 19.0.0-3154-ga630765c b45a994450e2 5a73b6277a3b 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi191 running (5m) 33s ago 5m 43.6M 4272M 19.0.0-3154-ga630765c b45a994450e2 5ee21b240695 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6 smithi077 running (4m) 19s ago 4m 42.4M 4272M 19.0.0-3154-ga630765c b45a994450e2 3e48117f9484 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7 smithi170 running (4m) 33s ago 4m 53.2M 4272M 19.0.0-3154-ga630765c b45a994450e2 0adfdf88361d 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.8 smithi191 running (3m) 33s ago 3m 42.1M 4272M 19.0.0-3154-ga630765c b45a994450e2 c5b572cb0aed 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.9 smithi077 running (3m) 19s ago 3m 54.0M 4272M 19.0.0-3154-ga630765c b45a994450e2 d10fa08eda95 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.10 smithi170 running (3m) 33s ago 3m 42.0M 4272M 19.0.0-3154-ga630765c b45a994450e2 e3c52cd790b6 2024-04-21T10:20:55.909 INFO:teuthology.orchestra.run.smithi077.stdout:osd.11 smithi191 running (2m) 33s ago 2m 54.3M 4272M 19.0.0-3154-ga630765c b45a994450e2 f297066d6c4e 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3f240a3c40 msgr2=0x7f3f240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3f240a3c40 0x7f3f240a6100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b580 tx=0x7f3f28005fb0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 msgr2=0x7f3f38199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 0x7f3f38199110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400b560 tx=0x7f3f3400b920 comp rx=0 tx=0).stop 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 shutdown_connections 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3f240a3c40 0x7f3f240a6100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f38102ad0 0x7f3f38198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f38104670 0x7f3f381a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 --2- 172.21.15.77:0/539712361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f38103cd0 0x7f3f38199110 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 >> 172.21.15.77:0/539712361 conn(0x7f3f380fe090 msgr2=0x7f3f38106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 shutdown_connections 2024-04-21T10:20:55.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:55.909+0000 7f3f3f51e700 1 -- 172.21.15.77:0/539712361 wait complete. 2024-04-21T10:20:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:55 smithi077 ceph-mon[27902]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-21T10:20:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:55 smithi191 ceph-mon[31636]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-21T10:20:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:55 smithi170 ceph-mon[31212]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-21T10:20:56.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-21T10:20:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:20:57.093 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:56 smithi077 ceph-mon[27902]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:20:57.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:56 smithi170 ceph-mon[31212]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:20:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:56 smithi191 ceph-mon[31636]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:20:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:57 smithi077 ceph-mon[27902]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-21T10:20:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:57 smithi191 ceph-mon[31636]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-21T10:20:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:57 smithi170 ceph-mon[31212]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 -- 172.21.15.77:0/3914801966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c102ba0 msgr2=0x7f6a9c103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3914801966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c103000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6a900099c0 tx=0x7f6a90009cd0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 -- 172.21.15.77:0/3914801966 shutdown_connections 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3914801966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c103540 0x7f6a9c109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3914801966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c1019a0 0x7f6a9c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3914801966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c103000 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 -- 172.21.15.77:0/3914801966 >> 172.21.15.77:0/3914801966 conn(0x7f6a9c0fcf40 msgr2=0x7f6a9c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 -- 172.21.15.77:0/3914801966 shutdown_connections 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 -- 172.21.15.77:0/3914801966 wait complete. 2024-04-21T10:20:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 Processor -- start 2024-04-21T10:20:58.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.712+0000 7f6aa184d700 1 -- start start 2024-04-21T10:20:58.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c1019a0 0x7f6a9c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:58.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:58.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 0x7f6a9c1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c10d460 con 0x7f6a9c103540 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c10d2e0 con 0x7f6a9c1019a0 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c10d5e0 con 0x7f6a9c102ba0 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 0x7f6a9c1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 0x7f6a9c1a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49408/0 (socket says 172.21.15.77:49408) 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 -- 172.21.15.77:0/3349950495 learned_addr learned my addr 172.21.15.77:0/3349950495 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9affd700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c1019a0 0x7f6a9c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9a7fc700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 -- 172.21.15.77:0/3349950495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c102ba0 msgr2=0x7f6a9c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 -- 172.21.15.77:0/3349950495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c1019a0 msgr2=0x7f6a9c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c1019a0 0x7f6a9c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 -- 172.21.15.77:0/3349950495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c1a08e0 con 0x7f6a9c103540 2024-04-21T10:20:58.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9affd700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c1019a0 0x7f6a9c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9a7fc700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6a9b7fe700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 0x7f6a9c1a0210 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6a94007ee0 tx=0x7f6a9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400dbd0 con 0x7f6a9c103540 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c1a0bd0 con 0x7f6a9c103540 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a9400dd70 con 0x7f6a9c103540 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.713+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a94005990 con 0x7f6a9c103540 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.714+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c1a10c0 con 0x7f6a9c103540 2024-04-21T10:20:58.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.714+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9c069760 con 0x7f6a9c103540 2024-04-21T10:20:58.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.716+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f6a9401a020 con 0x7f6a9c103540 2024-04-21T10:20:58.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.716+0000 7f6aa084b700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6a840a3c40 0x7f6a840a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:20:58.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.716+0000 7f6a9affd700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6a840a3c40 0x7f6a840a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:20:58.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.716+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f6a940d0260 con 0x7f6a9c103540 2024-04-21T10:20:58.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.717+0000 7f6a9affd700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6a840a3c40 0x7f6a840a6100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005fd0 tx=0x7f6a8c005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:20:58.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.720+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6a9c069760 con 0x7f6a9c103540 2024-04-21T10:20:58.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.926+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f6a9c06ae30 con 0x7f6a840a3c40 2024-04-21T10:20:58.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.932+0000 7f6aa084b700 1 -- 172.21.15.77:0/3349950495 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f6a9c06ae30 con 0x7f6a840a3c40 2024-04-21T10:20:58.932 INFO:teuthology.orchestra.run.smithi077.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-21T10:20:58.932 INFO:teuthology.orchestra.run.smithi077.stdout:mds.all 12/12 36s ago 2m smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-04-21T10:20:58.932 INFO:teuthology.orchestra.run.smithi077.stdout:mgr 3/3 36s ago 7m smithi077=x;smithi170=y;smithi191=z;count:3 2024-04-21T10:20:58.932 INFO:teuthology.orchestra.run.smithi077.stdout:mon 3/3 36s ago 8m smithi077:172.21.15.77=a;smithi170:172.21.15.170=b;smithi191:172.21.15.191=c;count:3 2024-04-21T10:20:58.932 INFO:teuthology.orchestra.run.smithi077.stdout:osd 12 36s ago - 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6a840a3c40 msgr2=0x7f6a840a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6a840a3c40 0x7f6a840a6100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005fd0 tx=0x7f6a8c005de0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 msgr2=0x7f6a9c1a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 0x7f6a9c1a0210 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6a94007ee0 tx=0x7f6a9400d3b0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 shutdown_connections 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f6a840a3c40 0x7f6a840a6100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9c1019a0 0x7f6a9c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9c103540 0x7f6a9c1a0210 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 --2- 172.21.15.77:0/3349950495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a9c102ba0 0x7f6a9c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 >> 172.21.15.77:0/3349950495 conn(0x7f6a9c0fcf40 msgr2=0x7f6a9c06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:20:58.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 shutdown_connections 2024-04-21T10:20:58.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:20:58.934+0000 7f6aa184d700 1 -- 172.21.15.77:0/3349950495 wait complete. 2024-04-21T10:20:59.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-21T10:21:00.000 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:21:00.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:20:59 smithi077 ceph-mon[27902]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-04-21T10:21:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:20:59 smithi191 ceph-mon[31636]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-04-21T10:21:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:20:59 smithi170 ceph-mon[31212]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-04-21T10:21:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:00 smithi077 ceph-mon[27902]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:00 smithi191 ceph-mon[31636]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:00 smithi170 ceph-mon[31212]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:01.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 -- 172.21.15.77:0/954657987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 msgr2=0x7f0e00109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 --2- 172.21.15.77:0/954657987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e00109df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0df800b0d0 tx=0x7f0df800b3e0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 -- 172.21.15.77:0/954657987 shutdown_connections 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 --2- 172.21.15.77:0/954657987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e001019a0 0x7f0e00101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 --2- 172.21.15.77:0/954657987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e00109df0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 --2- 172.21.15.77:0/954657987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e00102ba0 0x7f0e00103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.739+0000 7f0e07baa700 1 -- 172.21.15.77:0/954657987 >> 172.21.15.77:0/954657987 conn(0x7f0e000fcf40 msgr2=0x7f0e000ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 -- 172.21.15.77:0/954657987 shutdown_connections 2024-04-21T10:21:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 -- 172.21.15.77:0/954657987 wait complete. 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 Processor -- start 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 -- start start 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e001019a0 0x7f0e0006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e00102ba0 0x7f0e0019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e001a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010d530 con 0x7f0e00103540 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010d3b0 con 0x7f0e00102ba0 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e07baa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010d6b0 con 0x7f0e001019a0 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e06147700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e001a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e06147700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e001a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41066/0 (socket says 172.21.15.77:41066) 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e06147700 1 -- 172.21.15.77:0/686260425 learned_addr learned my addr 172.21.15.77:0/686260425 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.740+0000 7f0e05946700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e001019a0 0x7f0e0006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e06147700 1 -- 172.21.15.77:0/686260425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e001019a0 msgr2=0x7f0e0006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e06147700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e001019a0 0x7f0e0006b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e06147700 1 -- 172.21.15.77:0/686260425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e00102ba0 msgr2=0x7f0e0019da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e05145700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e00102ba0 0x7f0e0019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e06147700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e00102ba0 0x7f0e0019da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e06147700 1 -- 172.21.15.77:0/686260425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e001a0990 con 0x7f0e00103540 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e05145700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e00102ba0 0x7f0e0019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e06147700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e001a00c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0df800d010 tx=0x7f0df8007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8021070 con 0x7f0e00103540 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df8007e50 con 0x7f0e00103540 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e001a0c20 con 0x7f0e00103540 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df801bd30 con 0x7f0e00103540 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.741+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e001a1150 con 0x7f0e00103540 2024-04-21T10:21:01.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.742+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e00069730 con 0x7f0e00103540 2024-04-21T10:21:01.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.743+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f0df8024070 con 0x7f0e00103540 2024-04-21T10:21:01.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.744+0000 7f0df6ffd700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0dec0a3c40 0x7f0dec0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:01.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.744+0000 7f0e05946700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0dec0a3c40 0x7f0dec0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:01.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.744+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f0df800f020 con 0x7f0e00103540 2024-04-21T10:21:01.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.744+0000 7f0e05946700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0dec0a3c40 0x7f0dec0a6100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc006fd0 tx=0x7f0dfc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:01.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.747+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0df802b020 con 0x7f0e00103540 2024-04-21T10:21:01.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.952+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f0e00062e80 con 0x7f0dec0a3c40 2024-04-21T10:21:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.953+0000 7f0df6ffd700 1 -- 172.21.15.77:0/686260425 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f0e00062e80 con 0x7f0dec0a3c40 2024-04-21T10:21:01.953 INFO:teuthology.orchestra.run.smithi077.stdout:HOST ADDR LABELS STATUS 2024-04-21T10:21:01.953 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 172.21.15.77 2024-04-21T10:21:01.953 INFO:teuthology.orchestra.run.smithi077.stdout:smithi170 172.21.15.170 2024-04-21T10:21:01.953 INFO:teuthology.orchestra.run.smithi077.stdout:smithi191 172.21.15.191 2024-04-21T10:21:01.953 INFO:teuthology.orchestra.run.smithi077.stdout:3 hosts in cluster 2024-04-21T10:21:01.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0dec0a3c40 msgr2=0x7f0dec0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:01.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0dec0a3c40 0x7f0dec0a6100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc006fd0 tx=0x7f0dfc008040 comp rx=0 tx=0).stop 2024-04-21T10:21:01.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 msgr2=0x7f0e001a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:01.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e001a00c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0df800d010 tx=0x7f0df8007b40 comp rx=0 tx=0).stop 2024-04-21T10:21:01.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 shutdown_connections 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f0dec0a3c40 0x7f0dec0a6100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e00103540 0x7f0e001a00c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e001019a0 0x7f0e0006b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 --2- 172.21.15.77:0/686260425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e00102ba0 0x7f0e0019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 >> 172.21.15.77:0/686260425 conn(0x7f0e000fcf40 msgr2=0x7f0e00106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 shutdown_connections 2024-04-21T10:21:01.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:01.955+0000 7f0e07baa700 1 -- 172.21.15.77:0/686260425 wait complete. 2024-04-21T10:21:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:01 smithi077 ceph-mon[27902]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-21T10:21:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:01 smithi191 ceph-mon[31636]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-21T10:21:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:01 smithi170 ceph-mon[31212]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-21T10:21:02.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-21T10:21:02.969 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:21:04.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:03 smithi077 ceph-mon[27902]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:04.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:03 smithi077 ceph-mon[27902]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:21:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:03 smithi191 ceph-mon[31636]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:03 smithi191 ceph-mon[31636]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:21:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:03 smithi170 ceph-mon[31212]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:03 smithi170 ceph-mon[31212]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 -- 172.21.15.77:0/3244185372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac8102ba0 msgr2=0x7f1ac8103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 --2- 172.21.15.77:0/3244185372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac8102ba0 0x7f1ac8103000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0099c0 tx=0x7f1abc009cd0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 -- 172.21.15.77:0/3244185372 shutdown_connections 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 --2- 172.21.15.77:0/3244185372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8103540 0x7f1ac8109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 --2- 172.21.15.77:0/3244185372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac81019a0 0x7f1ac8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 --2- 172.21.15.77:0/3244185372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac8102ba0 0x7f1ac8103000 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 -- 172.21.15.77:0/3244185372 >> 172.21.15.77:0/3244185372 conn(0x7f1ac80fcf40 msgr2=0x7f1ac80ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 -- 172.21.15.77:0/3244185372 shutdown_connections 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.699+0000 7f1acd160700 1 -- 172.21.15.77:0/3244185372 wait complete. 2024-04-21T10:21:04.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 Processor -- start 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 -- start start 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 0x7f1ac806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8102ba0 0x7f1ac819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac8103540 0x7f1ac81a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac810d4b0 con 0x7f1ac81019a0 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac810d330 con 0x7f1ac8102ba0 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1acd160700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac810d630 con 0x7f1ac8103540 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.700+0000 7f1ac6d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 0x7f1ac806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 0x7f1ac806b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41072/0 (socket says 172.21.15.77:41072) 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 -- 172.21.15.77:0/1630505059 learned_addr learned my addr 172.21.15.77:0/1630505059 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac659c700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8102ba0 0x7f1ac819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac759e700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac8103540 0x7f1ac81a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 -- 172.21.15.77:0/1630505059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac8103540 msgr2=0x7f1ac81a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:04.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac8103540 0x7f1ac81a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 -- 172.21.15.77:0/1630505059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8102ba0 msgr2=0x7f1ac819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8102ba0 0x7f1ac819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 -- 172.21.15.77:0/1630505059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac81a2af0 con 0x7f1ac81019a0 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1ac6d9d700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 0x7f1ac806b2a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800d980 tx=0x7f1ab800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8017070 con 0x7f1ac81019a0 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac81a2de0 con 0x7f1ac81019a0 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab8009de0 con 0x7f1ac81019a0 2024-04-21T10:21:04.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab800f3c0 con 0x7f1ac81019a0 2024-04-21T10:21:04.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.701+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac81a3240 con 0x7f1ac81019a0 2024-04-21T10:21:04.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.702+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac8069730 con 0x7f1ac81019a0 2024-04-21T10:21:04.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.703+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f1ab8009930 con 0x7f1ac81019a0 2024-04-21T10:21:04.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.704+0000 7f1aaffff700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1ab00a3c40 0x7f1ab00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:04.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.704+0000 7f1ac659c700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1ab00a3c40 0x7f1ab00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:04.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.704+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f1ab80cff90 con 0x7f1ac81019a0 2024-04-21T10:21:04.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.704+0000 7f1ac659c700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1ab00a3c40 0x7f1ab00a6100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009990 tx=0x7f1abc00b870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:04.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.709+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1ab809c980 con 0x7f1ac81019a0 2024-04-21T10:21:04.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.916+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1ac8062e80 con 0x7f1ab00a3c40 2024-04-21T10:21:04.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.918+0000 7f1aaffff700 1 -- 172.21.15.77:0/1630505059 <== mgr.14150 v2:172.21.15.77:6800/3235809387 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1ac8062e80 con 0x7f1ab00a3c40 2024-04-21T10:21:04.918 INFO:teuthology.orchestra.run.smithi077.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-21T10:21:04.918 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-21T10:21:04.918 INFO:teuthology.orchestra.run.smithi077.stdout:smithi170 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002R480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-21T10:21:04.918 INFO:teuthology.orchestra.run.smithi077.stdout:smithi191 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303008M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1ab00a3c40 msgr2=0x7f1ab00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1ab00a3c40 0x7f1ab00a6100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009990 tx=0x7f1abc00b870 comp rx=0 tx=0).stop 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 msgr2=0x7f1ac806b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 0x7f1ac806b2a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800d980 tx=0x7f1ab800dc90 comp rx=0 tx=0).stop 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 shutdown_connections 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f1ab00a3c40 0x7f1ab00a6100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac8103540 0x7f1ac81a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ac81019a0 0x7f1ac806b2a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 --2- 172.21.15.77:0/1630505059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8102ba0 0x7f1ac819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:04.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 >> 172.21.15.77:0/1630505059 conn(0x7f1ac80fcf40 msgr2=0x7f1ac8105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:04.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 shutdown_connections 2024-04-21T10:21:04.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:04.920+0000 7f1acd160700 1 -- 172.21.15.77:0/1630505059 wait complete. 2024-04-21T10:21:05.686 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-21T10:21:05.695 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:21:05.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-21T10:21:05.933 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:21:06.054 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:05 smithi077 ceph-mon[27902]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:05 smithi191 ceph-mon[31636]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:21:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:05 smithi170 ceph-mon[31212]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:21:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:06 smithi077 ceph-mon[27902]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:06 smithi191 ceph-mon[31636]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:06 smithi170 ceph-mon[31212]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/1693599129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 msgr2=0x7fc8a0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/1693599129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a0106d60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009990 tx=0x7fc89c009ca0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/1693599129 shutdown_connections 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/1693599129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0100d90 0x7fc8a01011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/1693599129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a0106d60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/1693599129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8a0101b00 0x7fc8a0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/1693599129 >> 172.21.15.77:0/1693599129 conn(0x7fc8a00fc6f0 msgr2=0x7fc8a00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/1693599129 shutdown_connections 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/1693599129 wait complete. 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 Processor -- start 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 -- start start 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.732+0000 7fc8a7d9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8a0100d90 0x7fc8a019f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0101b00 0x7fc8a019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a01a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a0114be0 con 0x7fc8a01024c0 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a0114a60 con 0x7fc8a0101b00 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a0114d60 con 0x7fc8a0100d90 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a01a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a01a6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41090/0 (socket says 172.21.15.77:41090) 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 -- 172.21.15.77:0/2242794522 learned_addr learned my addr 172.21.15.77:0/2242794522 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a5336700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0101b00 0x7fc8a019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 -- 172.21.15.77:0/2242794522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8a0100d90 msgr2=0x7fc8a019f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a5b37700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8a0100d90 0x7fc8a019f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8a0100d90 0x7fc8a019f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 -- 172.21.15.77:0/2242794522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0101b00 msgr2=0x7fc8a019f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0101b00 0x7fc8a019f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 -- 172.21.15.77:0/2242794522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a01a6dd0 con 0x7fc8a01024c0 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a5336700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0101b00 0x7fc8a019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a6338700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a01a6730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc89c003790 tx=0x7fc89c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:07.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c027070 con 0x7fc8a01024c0 2024-04-21T10:21:07.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a01a7060 con 0x7fc8a01024c0 2024-04-21T10:21:07.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc89c022470 con 0x7fc8a01024c0 2024-04-21T10:21:07.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00f6c0 con 0x7fc8a01024c0 2024-04-21T10:21:07.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.733+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a01a74e0 con 0x7fc8a01024c0 2024-04-21T10:21:07.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.734+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a0069730 con 0x7fc8a01024c0 2024-04-21T10:21:07.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.736+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fc89c02a070 con 0x7fc8a01024c0 2024-04-21T10:21:07.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.736+0000 7fc896ffd700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc88c0a3c40 0x7fc88c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:07.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.736+0000 7fc8a5b37700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc88c0a3c40 0x7fc88c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:07.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.736+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc89c0d1570 con 0x7fc8a01024c0 2024-04-21T10:21:07.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.737+0000 7fc8a5b37700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc88c0a3c40 0x7fc88c0a6100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8980060b0 tx=0x7fc898008640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:07.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.740+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc89c013070 con 0x7fc8a01024c0 2024-04-21T10:21:07.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.986+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc8a002e050 con 0x7fc8a01024c0 2024-04-21T10:21:07.986 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:07 smithi077 ceph-mon[27902]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:21:07.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.986+0000 7fc896ffd700 1 -- 172.21.15.77:0/2242794522 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3058 (secure 0 0 0) 0x7fc89c09dff0 con 0x7fc8a01024c0 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:e21 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 21 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-21T10:21:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-21T10:19:22.828859+0000 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-21T10:19:26.977992+0000 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 300 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T10:21:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 3 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:in 0,1,2 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24505,1=24491,2=24461} 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 0 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 24505 members: 24461,24505,24491 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.i{0:24505} state up:active seq 5 addr [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c{0:24487} state up:standby-replay seq 1 addr [v2:172.21.15.191:6836/2009641600,v1:172.21.15.191:6837/2009641600] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b{1:24491} state up:active seq 4 addr [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.f{1:24469} state up:standby-replay seq 1 addr [v2:172.21.15.191:6834/2650789974,v1:172.21.15.191:6835/2650789974] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.h{2:24461} state up:active seq 7 addr [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.l{2:24430} state up:standby-replay seq 1 addr [v2:172.21.15.191:6832/2131093525,v1:172.21.15.191:6833/2131093525] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.j{-1:14574} state up:standby seq 1 addr [v2:172.21.15.77:6834/3612886708,v1:172.21.15.77:6835/3612886708] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d{-1:14586} state up:standby seq 1 addr [v2:172.21.15.77:6836/1731345826,v1:172.21.15.77:6837/1731345826] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.g{-1:14652} state up:standby seq 1 addr [v2:172.21.15.77:6838/3489435011,v1:172.21.15.77:6839/3489435011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a{-1:14664} state up:standby seq 1 addr [v2:172.21.15.77:6840/3790434755,v1:172.21.15.77:6841/3790434755] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.990 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.k{-1:24407} state up:standby seq 1 addr [v2:172.21.15.170:6832/1764258640,v1:172.21.15.170:6833/1764258640] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.991 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.e{-1:24428} state up:standby seq 1 addr [v2:172.21.15.170:6834/2565539323,v1:172.21.15.170:6835/2565539323] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T10:21:07.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc88c0a3c40 msgr2=0x7fc88c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:07.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc88c0a3c40 0x7fc88c0a6100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8980060b0 tx=0x7fc898008640 comp rx=0 tx=0).stop 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 msgr2=0x7fc8a01a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a01a6730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc89c003790 tx=0x7fc89c009f90 comp rx=0 tx=0).stop 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 shutdown_connections 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc88c0a3c40 0x7fc88c0a6100 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a01024c0 0x7fc8a01a6730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8a0100d90 0x7fc8a019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 --2- 172.21.15.77:0/2242794522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8a0101b00 0x7fc8a019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.988+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 >> 172.21.15.77:0/2242794522 conn(0x7fc8a00fc6f0 msgr2=0x7fc8a0102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.989+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 shutdown_connections 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:07.989+0000 7fc8a7d9b700 1 -- 172.21.15.77:0/2242794522 wait complete. 2024-04-21T10:21:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:21:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:07 smithi191 ceph-mon[31636]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:21:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:07 smithi170 ceph-mon[31212]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:21:08.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-21T10:21:09.001 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:21:09.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:08 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2242794522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-21T10:21:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:08 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2242794522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-21T10:21:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:08 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2242794522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-21T10:21:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:09 smithi077 ceph-mon[27902]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T10:21:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:09 smithi191 ceph-mon[31636]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T10:21:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:09 smithi170 ceph-mon[31212]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.735+0000 7f9052658700 1 -- 172.21.15.77:0/4257553715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c102870 msgr2=0x7f904c109120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.735+0000 7f9052658700 1 --2- 172.21.15.77:0/4257553715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c102870 0x7f904c109120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f904400b9e0 tx=0x7f904400bcf0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 -- 172.21.15.77:0/4257553715 shutdown_connections 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 --2- 172.21.15.77:0/4257553715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c100cd0 0x7f904c1010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 --2- 172.21.15.77:0/4257553715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c102870 0x7f904c109120 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 --2- 172.21.15.77:0/4257553715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f904c101ed0 0x7f904c102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 -- 172.21.15.77:0/4257553715 >> 172.21.15.77:0/4257553715 conn(0x7f904c0fc290 msgr2=0x7f904c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 -- 172.21.15.77:0/4257553715 shutdown_connections 2024-04-21T10:21:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 -- 172.21.15.77:0/4257553715 wait complete. 2024-04-21T10:21:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 Processor -- start 2024-04-21T10:21:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 -- start start 2024-04-21T10:21:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.736+0000 7f9052658700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 0x7f904c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f904c101ed0 0x7f904c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c102870 0x7f904c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10c400 con 0x7f904c100cd0 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10c280 con 0x7f904c102870 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10c580 con 0x7f904c101ed0 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 0x7f904c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 0x7f904c198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47444/0 (socket says 172.21.15.77:47444) 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 -- 172.21.15.77:0/2459077924 learned_addr learned my addr 172.21.15.77:0/2459077924 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904b7fe700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f904c101ed0 0x7f904c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9050bf5700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c102870 0x7f904c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 -- 172.21.15.77:0/2459077924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f904c101ed0 msgr2=0x7f904c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f904c101ed0 0x7f904c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 -- 172.21.15.77:0/2459077924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c102870 msgr2=0x7f904c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c102870 0x7f904c1a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 -- 172.21.15.77:0/2459077924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c1a08c0 con 0x7f904c100cd0 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9050bf5700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c102870 0x7f904c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f904bfff700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 0x7f904c198c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f903c00b500 tx=0x7f903c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c015020 con 0x7f904c100cd0 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f903c011ce0 con 0x7f904c100cd0 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c1a0bb0 con 0x7f904c100cd0 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c010d20 con 0x7f904c100cd0 2024-04-21T10:21:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.737+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c1a10f0 con 0x7f904c100cd0 2024-04-21T10:21:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.739+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c069730 con 0x7f904c100cd0 2024-04-21T10:21:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.740+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f903c018020 con 0x7f904c100cd0 2024-04-21T10:21:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.740+0000 7f90497fa700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90340a3c40 0x7f90340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.740+0000 7f904b7fe700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90340a3c40 0x7f90340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.740+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f903c0cfb40 con 0x7f904c100cd0 2024-04-21T10:21:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.741+0000 7f904b7fe700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90340a3c40 0x7f90340a6100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f904000bd70 tx=0x7f904000b4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:10.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.745+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f903c01f020 con 0x7f904c100cd0 2024-04-21T10:21:10.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.949+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f904c063650 con 0x7f904c100cd0 2024-04-21T10:21:10.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.950+0000 7f90497fa700 1 -- 172.21.15.77:0/2459077924 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5287 (secure 0 0 0) 0x7f903c09c530 con 0x7f904c100cd0 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 87 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-21T10:11:13.991495+0000 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-21T10:20:15.816743+0000 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:crush_version 26 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:full_ratio 0.95 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:backfillfull_ratio 0.9 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:nearfull_ratio 0.85 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:require_min_compat_client luminous 2024-04-21T10:21:10.950 INFO:teuthology.orchestra.run.smithi077.stdout:min_compat_client luminous 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:require_osd_release squid 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:stretch_mode_enabled false 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:max_osd 12 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6802/2965386112,v1:172.21.15.77:6803/2965386112] [v2:172.21.15.77:6804/2965386112,v1:172.21.15.77:6805/2965386112] exists,up e82e5ffc-2406-48be-b12a-30c6972b3df6 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6800/1692456293,v1:172.21.15.170:6801/1692456293] [v2:172.21.15.170:6802/1692456293,v1:172.21.15.170:6803/1692456293] exists,up 692cfb0a-b71d-41b3-bc8f-f99352c085e3 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/1645526465,v1:172.21.15.191:6801/1645526465] [v2:172.21.15.191:6802/1645526465,v1:172.21.15.191:6803/1645526465] exists,up c585bc66-98a9-4126-8208-11fb8b8d16ad 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6810/2907599341,v1:172.21.15.77:6811/2907599341] [v2:172.21.15.77:6812/2907599341,v1:172.21.15.77:6813/2907599341] exists,up 81c05614-2d27-42d3-8f3a-27ac4d5aa6cb 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6808/3749271051,v1:172.21.15.170:6809/3749271051] [v2:172.21.15.170:6810/3749271051,v1:172.21.15.170:6811/3749271051] exists,up cab5e375-2471-41e0-84bb-afee83e3a6a8 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6808/2690785499,v1:172.21.15.191:6809/2690785499] [v2:172.21.15.191:6810/2690785499,v1:172.21.15.191:6811/2690785499] exists,up a658a938-5f51-414f-a216-bbc79584570d 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6 up in weight 1 up_from 46 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6818/170633927,v1:172.21.15.77:6819/170633927] [v2:172.21.15.77:6820/170633927,v1:172.21.15.77:6821/170633927] exists,up 0d435ee1-0bb9-4cf2-b897-3a5297c8ed62 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7 up in weight 1 up_from 51 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6816/3139153153,v1:172.21.15.170:6817/3139153153] [v2:172.21.15.170:6818/3139153153,v1:172.21.15.170:6819/3139153153] exists,up 3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70 2024-04-21T10:21:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:osd.8 up in weight 1 up_from 59 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/609468755,v1:172.21.15.191:6817/609468755] [v2:172.21.15.191:6818/609468755,v1:172.21.15.191:6819/609468755] exists,up e52a3152-3a86-4b87-b14d-dae9955549a4 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6826/2816502344,v1:172.21.15.77:6827/2816502344] [v2:172.21.15.77:6828/2816502344,v1:172.21.15.77:6829/2816502344] exists,up e43bf362-1689-4a04-8dc2-eba9baedc9bd 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6824/1368923221,v1:172.21.15.170:6825/1368923221] [v2:172.21.15.170:6826/1368923221,v1:172.21.15.170:6827/1368923221] exists,up 97e854a6-998b-40c5-82c6-fa7ceb23400e 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6824/1429777061,v1:172.21.15.191:6825/1429777061] [v2:172.21.15.191:6826/1429777061,v1:172.21.15.191:6827/1429777061] exists,up 0a84fddf-e9d1-45a2-a805-b1a92bd9a379 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 2.e [2,4] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 2.10 [8,11] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 2.1c [8,11] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 2.1d [2,1] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.11 [5,9] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.14 [4,6] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.27 [3,9] 2024-04-21T10:21:10.952 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.36 [4,9] 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/577902576 expires 2024-04-22T10:12:14.592198+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6801/1650379483 expires 2024-04-22T10:12:14.592198+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/815934319 expires 2024-04-22T10:12:14.592198+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6801/1648486673 expires 2024-04-22T10:11:47.548747+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6800/1648486673 expires 2024-04-22T10:11:47.548747+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/850001197 expires 2024-04-22T10:12:14.592198+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/159829319 expires 2024-04-22T10:11:47.548747+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6800/1650379483 expires 2024-04-22T10:12:14.592198+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/3733818915 expires 2024-04-22T10:11:47.548747+0000 2024-04-21T10:21:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/2397197543 expires 2024-04-22T10:11:47.548747+0000 2024-04-21T10:21:10.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90340a3c40 msgr2=0x7f90340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:10.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90340a3c40 0x7f90340a6100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f904000bd70 tx=0x7f904000b4c0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 msgr2=0x7f904c198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:10.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 0x7f904c198c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f903c00b500 tx=0x7f903c00b810 comp rx=0 tx=0).stop 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 shutdown_connections 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f90340a3c40 0x7f90340a6100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f904c102870 0x7f904c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f904c100cd0 0x7f904c198c70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 --2- 172.21.15.77:0/2459077924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f904c101ed0 0x7f904c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 >> 172.21.15.77:0/2459077924 conn(0x7f904c0fc290 msgr2=0x7f904c105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 shutdown_connections 2024-04-21T10:21:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:10.952+0000 7f9052658700 1 -- 172.21.15.77:0/2459077924 wait complete. 2024-04-21T10:21:11.769 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-21T10:21:11.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:11.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 -- 172.21.15.77:0/953998287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 msgr2=0x7fcd54103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 --2- 172.21.15.77:0/953998287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54103610 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009900 tx=0x7fcd4802bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 -- 172.21.15.77:0/953998287 shutdown_connections 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 --2- 172.21.15.77:0/953998287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54103610 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 --2- 172.21.15.77:0/953998287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54103b50 0x7fcd5410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 --2- 172.21.15.77:0/953998287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101fa0 0x7fcd541023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 -- 172.21.15.77:0/953998287 >> 172.21.15.77:0/953998287 conn(0x7fcd540fd530 msgr2=0x7fcd540ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:11.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 -- 172.21.15.77:0/953998287 shutdown_connections 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.887+0000 7fcd592ba640 1 -- 172.21.15.77:0/953998287 wait complete. 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 Processor -- start 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 -- start start 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101fa0 0x7fcd54075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54103b50 0x7fcd54074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5410dae0 con 0x7fcd54103190 2024-04-21T10:21:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5410d960 con 0x7fcd54103b50 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd592ba640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5410dc60 con 0x7fcd54101fa0 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47454/0 (socket says 172.21.15.77:47454) 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 -- 172.21.15.77:0/1049073358 learned_addr learned my addr 172.21.15.77:0/1049073358 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd52ffd640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101fa0 0x7fcd54075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 -- 172.21.15.77:0/1049073358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101fa0 msgr2=0x7fcd54075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:11.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101fa0 0x7fcd54075d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 -- 172.21.15.77:0/1049073358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54103b50 msgr2=0x7fcd54074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54103b50 0x7fcd54074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 -- 172.21.15.77:0/1049073358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd54075110 con 0x7fcd54103190 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.888+0000 7fcd527fc640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54074340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcd48006010 tx=0x7fcd480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.889+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48043020 con 0x7fcd54103190 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.889+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd541a22c0 con 0x7fcd54103190 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.889+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd48004aa0 con 0x7fcd54103190 2024-04-21T10:21:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.889+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48003c70 con 0x7fcd54103190 2024-04-21T10:21:11.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.889+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd541a2860 con 0x7fcd54103190 2024-04-21T10:21:11.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.890+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd541092e0 con 0x7fcd54103190 2024-04-21T10:21:11.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.891+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fcd48046020 con 0x7fcd54103190 2024-04-21T10:21:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.891+0000 7fcd3bfff640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd3c0a3bb0 0x7fcd3c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.891+0000 7fcd52ffd640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd3c0a3bb0 0x7fcd3c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.891+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcd480f2780 con 0x7fcd54103190 2024-04-21T10:21:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.892+0000 7fcd52ffd640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd3c0a3bb0 0x7fcd3c0a6070 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c005fd0 tx=0x7fcd4c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:11.896+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcd4804d020 con 0x7fcd54103190 2024-04-21T10:21:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.077+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd54062b50 con 0x7fcd54103190 2024-04-21T10:21:12.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.078+0000 7fcd3bfff640 1 -- 172.21.15.77:0/1049073358 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22664 (secure 0 0 0) 0x7fcd480bf170 con 0x7fcd54103190 2024-04-21T10:21:12.079 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:12.079 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:20:15.816743+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd3c0a3bb0 msgr2=0x7fcd3c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd3c0a3bb0 0x7fcd3c0a6070 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c005fd0 tx=0x7fcd4c00b390 comp rx=0 tx=0).stop 2024-04-21T10:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 msgr2=0x7fcd54074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54074340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcd48006010 tx=0x7fcd480042f0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 shutdown_connections 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd3c0a3bb0 0x7fcd3c0a6070 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd54103190 0x7fcd54074340 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54103b50 0x7fcd54074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 --2- 172.21.15.77:0/1049073358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101fa0 0x7fcd54075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 >> 172.21.15.77:0/1049073358 conn(0x7fcd540fd530 msgr2=0x7fcd541064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 shutdown_connections 2024-04-21T10:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.080+0000 7fcd592ba640 1 -- 172.21.15.77:0/1049073358 wait complete. 2024-04-21T10:21:12.091 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:11 smithi077 ceph-mon[27902]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:21:12.091 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:11 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2459077924' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-21T10:21:12.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:21:12.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 -- 172.21.15.77:0/2750429815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0102040 msgr2=0x7fe1f01024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- 172.21.15.77:0/2750429815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0102040 0x7fe1f01024c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009900 tx=0x7fe1e002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 -- 172.21.15.77:0/2750429815 shutdown_connections 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- 172.21.15.77:0/2750429815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0102040 0x7fe1f01024c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- 172.21.15.77:0/2750429815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 0x7fe1f0109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- 172.21.15.77:0/2750429815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0100e60 0x7fe1f0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 -- 172.21.15.77:0/2750429815 >> 172.21.15.77:0/2750429815 conn(0x7fe1f00fc440 msgr2=0x7fe1f00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 -- 172.21.15.77:0/2750429815 shutdown_connections 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 -- 172.21.15.77:0/2750429815 wait complete. 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 Processor -- start 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 -- start start 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 0x7fe1f0198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0102040 0x7fe1f0198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.195+0000 7fe1f7932640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 0x7fe1f019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f7932640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010db30 con 0x7fe1f0100e60 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f7932640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010d9b0 con 0x7fe1f0102a00 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f7932640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010dcb0 con 0x7fe1f0102040 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 0x7fe1f0198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 0x7fe1f0198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47472/0 (socket says 172.21.15.77:47472) 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 -- 172.21.15.77:0/534000551 learned_addr learned my addr 172.21.15.77:0/534000551 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:12.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f5ecf640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 0x7fe1f019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f4ecd640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0102040 0x7fe1f0198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 -- 172.21.15.77:0/534000551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0102040 msgr2=0x7fe1f0198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0102040 0x7fe1f0198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 -- 172.21.15.77:0/534000551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 msgr2=0x7fe1f019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 0x7fe1f019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 -- 172.21.15.77:0/534000551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f019fe30 con 0x7fe1f0100e60 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f4ecd640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0102040 0x7fe1f0198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f5ecf640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 0x7fe1f019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f56ce640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 0x7fe1f0198210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c970 tx=0x7fe1ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec004220 con 0x7fe1f0100e60 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1ec0043c0 con 0x7fe1f0100e60 2024-04-21T10:21:12.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f01a0120 con 0x7fe1f0100e60 2024-04-21T10:21:12.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec004a00 con 0x7fe1f0100e60 2024-04-21T10:21:12.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.196+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01a0670 con 0x7fe1f0100e60 2024-04-21T10:21:12.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.197+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f0108250 con 0x7fe1f0100e60 2024-04-21T10:21:12.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.198+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fe1ec0079b0 con 0x7fe1f0100e60 2024-04-21T10:21:12.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.199+0000 7fe1e67fc640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe1dc0a3c30 0x7fe1dc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.199+0000 7fe1f4ecd640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe1dc0a3c30 0x7fe1dc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.199+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe1ec0d05c0 con 0x7fe1f0100e60 2024-04-21T10:21:12.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.199+0000 7fe1f4ecd640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe1dc0a3c30 0x7fe1dc0a60f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00096c0 tx=0x7fe1e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:12.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.203+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe1ec014030 con 0x7fe1f0100e60 2024-04-21T10:21:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:11 smithi191 ceph-mon[31636]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:21:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:11 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2459077924' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-21T10:21:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:11 smithi170 ceph-mon[31212]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:21:12.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:11 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2459077924' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-21T10:21:12.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.379+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1f002d770 con 0x7fe1f0100e60 2024-04-21T10:21:12.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.379+0000 7fe1e67fc640 1 -- 172.21.15.77:0/534000551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fe1ec09d030 con 0x7fe1f0100e60 2024-04-21T10:21:12.379 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:21:12.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.381+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe1dc0a3c30 msgr2=0x7fe1dc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.381+0000 7fe1f7932640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe1dc0a3c30 0x7fe1dc0a60f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00096c0 tx=0x7fe1e0000bc0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.381+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 msgr2=0x7fe1f0198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 0x7fe1f0198210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c970 tx=0x7fe1ec00ce30 comp rx=0 tx=0).stop 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 shutdown_connections 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe1dc0a3c30 0x7fe1dc0a60f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0102a00 0x7fe1f019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1f0102040 0x7fe1f0198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 --2- 172.21.15.77:0/534000551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f0100e60 0x7fe1f0198210 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 >> 172.21.15.77:0/534000551 conn(0x7fe1f00fc440 msgr2=0x7fe1f0105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 shutdown_connections 2024-04-21T10:21:12.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.382+0000 7fe1f7932640 1 -- 172.21.15.77:0/534000551 wait complete. 2024-04-21T10:21:12.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:21:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 -- 172.21.15.77:0/3995259793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 msgr2=0x7fcd88104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 --2- 172.21.15.77:0/3995259793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88104e00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009900 tx=0x7fcd7802bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 -- 172.21.15.77:0/3995259793 shutdown_connections 2024-04-21T10:21:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 --2- 172.21.15.77:0/3995259793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd88107c70 0x7fcd8810a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 --2- 172.21.15.77:0/3995259793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88105340 0x7fcd88107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 --2- 172.21.15.77:0/3995259793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88104e00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 -- 172.21.15.77:0/3995259793 >> 172.21.15.77:0/3995259793 conn(0x7fcd880fc400 msgr2=0x7fcd880fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 -- 172.21.15.77:0/3995259793 shutdown_connections 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.495+0000 7fcd8d966640 1 -- 172.21.15.77:0/3995259793 wait complete. 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 Processor -- start 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 -- start start 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd88105340 0x7fcd88198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88107c70 0x7fcd8819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8810dae0 con 0x7fcd88102a10 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8810d960 con 0x7fcd88107c70 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd8d966640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8810dc60 con 0x7fcd88105340 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47488/0 (socket says 172.21.15.77:47488) 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 -- 172.21.15.77:0/2261174878 learned_addr learned my addr 172.21.15.77:0/2261174878 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd867fc640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd88105340 0x7fcd88198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd877fe640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88107c70 0x7fcd8819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 -- 172.21.15.77:0/2261174878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd88105340 msgr2=0x7fcd88198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd88105340 0x7fcd88198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 -- 172.21.15.77:0/2261174878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88107c70 msgr2=0x7fcd8819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88107c70 0x7fcd8819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd86ffd640 1 -- 172.21.15.77:0/2261174878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8819fe60 con 0x7fcd88102a10 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.496+0000 7fcd877fe640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88107c70 0x7fcd8819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.497+0000 7fcd86ffd640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88198240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006010 tx=0x7fcd780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.497+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78043020 con 0x7fcd88102a10 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.497+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd78004aa0 con 0x7fcd88102a10 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.497+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881a00f0 con 0x7fcd88102a10 2024-04-21T10:21:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.497+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78003c70 con 0x7fcd88102a10 2024-04-21T10:21:12.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.497+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881a0690 con 0x7fcd88102a10 2024-04-21T10:21:12.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.498+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd880fdef0 con 0x7fcd88102a10 2024-04-21T10:21:12.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.499+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fcd78046020 con 0x7fcd88102a10 2024-04-21T10:21:12.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.499+0000 7fcd8c964640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd700a3c30 0x7fcd700a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.500+0000 7fcd867fc640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd700a3c30 0x7fcd700a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.500+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcd780f27f0 con 0x7fcd88102a10 2024-04-21T10:21:12.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.500+0000 7fcd867fc640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd700a3c30 0x7fcd700a60f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd88199750 tx=0x7fcd7c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.504+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcd7804d020 con 0x7fcd88102a10 2024-04-21T10:21:12.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.681+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcd88062b50 con 0x7fcd88102a10 2024-04-21T10:21:12.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.681+0000 7fcd8c964640 1 -- 172.21.15.77:0/2261174878 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fcd780bf1e0 con 0x7fcd88102a10 2024-04-21T10:21:12.681 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:21:12.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd700a3c30 msgr2=0x7fcd700a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd700a3c30 0x7fcd700a60f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd88199750 tx=0x7fcd7c00a4c0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 msgr2=0x7fcd88198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88198240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006010 tx=0x7fcd780042f0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 shutdown_connections 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd700a3c30 0x7fcd700a60f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd88107c70 0x7fcd8819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd88105340 0x7fcd88198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 --2- 172.21.15.77:0/2261174878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88102a10 0x7fcd88198240 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.683+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 >> 172.21.15.77:0/2261174878 conn(0x7fcd880fc400 msgr2=0x7fcd881048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.684+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 shutdown_connections 2024-04-21T10:21:12.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.684+0000 7fcd8d966640 1 -- 172.21.15.77:0/2261174878 wait complete. 2024-04-21T10:21:12.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 -- 172.21.15.77:0/3230805743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1009f0 msgr2=0x7ff3ec10a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 --2- 172.21.15.77:0/3230805743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1009f0 0x7ff3ec10a5a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009ca0 tx=0x7ff3e402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 -- 172.21.15.77:0/3230805743 shutdown_connections 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 --2- 172.21.15.77:0/3230805743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1009f0 0x7ff3ec10a5a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 --2- 172.21.15.77:0/3230805743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3ec100030 0x7ff3ec1004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 --2- 172.21.15.77:0/3230805743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 -- 172.21.15.77:0/3230805743 >> 172.21.15.77:0/3230805743 conn(0x7ff3ec0fbb90 msgr2=0x7ff3ec0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 -- 172.21.15.77:0/3230805743 shutdown_connections 2024-04-21T10:21:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.796+0000 7ff3f3081640 1 -- 172.21.15.77:0/3230805743 wait complete. 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 Processor -- start 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 -- start start 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3ec100030 0x7ff3ec198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec1009f0 0x7ff3ec198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec10db40 con 0x7ff3ec1035c0 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec10d9c0 con 0x7ff3ec100030 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f3081640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec10dcc0 con 0x7ff3ec1009f0 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47518/0 (socket says 172.21.15.77:47518) 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 -- 172.21.15.77:0/2410040917 learned_addr learned my addr 172.21.15.77:0/2410040917 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 -- 172.21.15.77:0/2410040917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec1009f0 msgr2=0x7ff3ec198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec1009f0 0x7ff3ec198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 -- 172.21.15.77:0/2410040917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3ec100030 msgr2=0x7ff3ec198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3ec100030 0x7ff3ec198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.797+0000 7ff3f161e640 1 -- 172.21.15.77:0/2410040917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec19fe30 con 0x7ff3ec1035c0 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.798+0000 7ff3f161e640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec19f7c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff3e402c700 tx=0x7ff3e4035d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.798+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4039040 con 0x7ff3ec1035c0 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.798+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ec1a00c0 con 0x7ff3ec1035c0 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.798+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e4044070 con 0x7ff3ec1035c0 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.798+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4004440 con 0x7ff3ec1035c0 2024-04-21T10:21:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.798+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec1a0600 con 0x7ff3ec1035c0 2024-04-21T10:21:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.799+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ec1094d0 con 0x7ff3ec1035c0 2024-04-21T10:21:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.800+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7ff3e40045e0 con 0x7ff3ec1035c0 2024-04-21T10:21:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.801+0000 7ff3e9ffb640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff3dc0a3bb0 0x7ff3dc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.801+0000 7ff3f0e1d640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff3dc0a3bb0 0x7ff3dc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.801+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff3e40f3640 con 0x7ff3ec1035c0 2024-04-21T10:21:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.801+0000 7ff3f0e1d640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff3dc0a3bb0 0x7ff3dc0a6070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec06a2b0 tx=0x7ff3e0006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.804+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3e40c0030 con 0x7ff3ec1035c0 2024-04-21T10:21:12.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.984+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3ec02d5c0 con 0x7ff3ec1035c0 2024-04-21T10:21:12.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.984+0000 7ff3e9ffb640 1 -- 172.21.15.77:0/2410040917 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7ff3e40bf930 con 0x7ff3ec1035c0 2024-04-21T10:21:12.984 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff3dc0a3bb0 msgr2=0x7ff3dc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff3dc0a3bb0 0x7ff3dc0a6070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec06a2b0 tx=0x7ff3e0006c90 comp rx=0 tx=0).stop 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 msgr2=0x7ff3ec19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec19f7c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff3e402c700 tx=0x7ff3e4035d60 comp rx=0 tx=0).stop 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 shutdown_connections 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff3dc0a3bb0 0x7ff3dc0a6070 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3ec1035c0 0x7ff3ec19f7c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec1009f0 0x7ff3ec198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 --2- 172.21.15.77:0/2410040917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3ec100030 0x7ff3ec198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 >> 172.21.15.77:0/2410040917 conn(0x7ff3ec0fbb90 msgr2=0x7ff3ec1066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.986+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 shutdown_connections 2024-04-21T10:21:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:12.987+0000 7ff3f3081640 1 -- 172.21.15.77:0/2410040917 wait complete. 2024-04-21T10:21:12.996 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:12 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1049073358' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:12.997 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:12 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/534000551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:12.997 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:12 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2261174878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:12.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 -- 172.21.15.77:0/2605247379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 msgr2=0x7f3e68104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/2605247379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e68104e30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009900 tx=0x7f3e6402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 -- 172.21.15.77:0/2605247379 shutdown_connections 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/2605247379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e68107ca0 0x7f3e6810a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/2605247379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 0x7f3e68107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/2605247379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e68104e30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 -- 172.21.15.77:0/2605247379 >> 172.21.15.77:0/2605247379 conn(0x7f3e680fc470 msgr2=0x7f3e680fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 -- 172.21.15.77:0/2605247379 shutdown_connections 2024-04-21T10:21:13.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 -- 172.21.15.77:0/2605247379 wait complete. 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.096+0000 7f3e6fd32640 1 Processor -- start 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 -- start start 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e681981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 0x7f3e681986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e68107ca0 0x7f3e6819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810db00 con 0x7f3e68102a40 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810d980 con 0x7f3e68105370 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810dc80 con 0x7f3e68107ca0 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e681981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e681981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47532/0 (socket says 172.21.15.77:47532) 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 -- 172.21.15.77:0/3545511868 learned_addr learned my addr 172.21.15.77:0/3545511868 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:13.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6d2cd640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 0x7f3e681986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 -- 172.21.15.77:0/3545511868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e68107ca0 msgr2=0x7f3e6819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e68107ca0 0x7f3e6819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 -- 172.21.15.77:0/3545511868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 msgr2=0x7f3e681986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 0x7f3e681986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 -- 172.21.15.77:0/3545511868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6819fdc0 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6d2cd640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 0x7f3e681986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6dace640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e681981a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006010 tx=0x7f3e640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64043020 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e64004aa0 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e681a0050 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64003c70 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.097+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e681a05a0 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.098+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e680fdf60 con 0x7f3e68102a40 2024-04-21T10:21:13.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.099+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f3e64046020 con 0x7f3e68102a40 2024-04-21T10:21:13.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.100+0000 7f3e5effd640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3e540a3bb0 0x7f3e540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.100+0000 7f3e6d2cd640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3e540a3bb0 0x7f3e540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.100+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f3e640f2f00 con 0x7f3e68102a40 2024-04-21T10:21:13.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.101+0000 7f3e6d2cd640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3e540a3bb0 0x7f3e540a6070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e681996b0 tx=0x7f3e58005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:13.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.104+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3e6404d020 con 0x7f3e68102a40 2024-04-21T10:21:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:12 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1049073358' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:12 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/534000551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:12 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2261174878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:12 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1049073358' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:12 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/534000551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:12 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2261174878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:13.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.320+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e6802d5c0 con 0x7f3e68102a40 2024-04-21T10:21:13.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.321+0000 7f3e5effd640 1 -- 172.21.15.77:0/3545511868 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f3e640bf8f0 con 0x7f3e68102a40 2024-04-21T10:21:13.321 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:13.321 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:19:26.977992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:21:13.321 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3e540a3bb0 msgr2=0x7f3e540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3e540a3bb0 0x7f3e540a6070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e681996b0 tx=0x7f3e58005ec0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 msgr2=0x7f3e681981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e681981a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006010 tx=0x7f3e640042f0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 shutdown_connections 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3e540a3bb0 0x7f3e540a6070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3e68107ca0 0x7f3e6819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e68105370 0x7f3e681986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 --2- 172.21.15.77:0/3545511868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68102a40 0x7f3e681981a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 >> 172.21.15.77:0/3545511868 conn(0x7f3e680fc470 msgr2=0x7f3e68103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 shutdown_connections 2024-04-21T10:21:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.323+0000 7f3e6fd32640 1 -- 172.21.15.77:0/3545511868 wait complete. 2024-04-21T10:21:13.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- 172.21.15.77:0/3551641445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 msgr2=0x7f8360109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- 172.21.15.77:0/3551641445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f8360109330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f835c009900 tx=0x7f835c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- 172.21.15.77:0/3551641445 shutdown_connections 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- 172.21.15.77:0/3551641445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f8360109330 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- 172.21.15.77:0/3551641445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 0x7f83601024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- 172.21.15.77:0/3551641445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 0x7f8360101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- 172.21.15.77:0/3551641445 >> 172.21.15.77:0/3551641445 conn(0x7f83600fc470 msgr2=0x7f83600fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:13.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- 172.21.15.77:0/3551641445 shutdown_connections 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- 172.21.15.77:0/3551641445 wait complete. 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 Processor -- start 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- start start 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 0x7f83601980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 0x7f83601985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f836019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f836010ca00 con 0x7f8360102a10 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f836010c880 con 0x7f8360100e70 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f83676c0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f836010cb80 con 0x7f8360102050 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.433+0000 7f8365c5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f836019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f836019f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47560/0 (socket says 172.21.15.77:47560) 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 -- 172.21.15.77:0/2321904697 learned_addr learned my addr 172.21.15.77:0/2321904697 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f836545c640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 0x7f83601980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8364c5b640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 0x7f83601985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 -- 172.21.15.77:0/2321904697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 msgr2=0x7f83601985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 0x7f83601985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 -- 172.21.15.77:0/2321904697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 msgr2=0x7f83601980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 0x7f83601980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 -- 172.21.15.77:0/2321904697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836019fcd0 con 0x7f8360102a10 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8364c5b640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 0x7f83601985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f836545c640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 0x7f83601980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f8365c5d640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f836019f660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f835c009230 tx=0x7f835c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c043020 con 0x7f8360102a10 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836019ff60 con 0x7f8360102a10 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f835c0054c0 con 0x7f8360102a10 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c003db0 con 0x7f8360102a10 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.434+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601a0420 con 0x7f8360102a10 2024-04-21T10:21:13.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.435+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83601a0620 con 0x7f8360102a10 2024-04-21T10:21:13.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.436+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f835c046020 con 0x7f8360102a10 2024-04-21T10:21:13.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.437+0000 7f83567fc640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f834c0a3bb0 0x7f834c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.437+0000 7f836545c640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f834c0a3bb0 0x7f834c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.437+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f835c0f2d80 con 0x7f8360102a10 2024-04-21T10:21:13.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.437+0000 7f836545c640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f834c0a3bb0 0x7f834c0a6070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8360101bc0 tx=0x7f8358007870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:13.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.440+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f835c04d020 con 0x7f8360102a10 2024-04-21T10:21:13.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.619+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83601a09b0 con 0x7f8360102a10 2024-04-21T10:21:13.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.620+0000 7f83567fc640 1 -- 172.21.15.77:0/2321904697 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22664 (secure 0 0 0) 0x7f835c0bf890 con 0x7f8360102a10 2024-04-21T10:21:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:13.620 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:20:15.816743+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:13.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f834c0a3bb0 msgr2=0x7f834c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f834c0a3bb0 0x7f834c0a6070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8360101bc0 tx=0x7f8358007870 comp rx=0 tx=0).stop 2024-04-21T10:21:13.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 msgr2=0x7f836019f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f836019f660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f835c009230 tx=0x7f835c0042f0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 shutdown_connections 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f834c0a3bb0 0x7f834c0a6070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8360102a10 0x7f836019f660 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360102050 0x7f83601985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 --2- 172.21.15.77:0/2321904697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8360100e70 0x7f83601980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 >> 172.21.15.77:0/2321904697 conn(0x7f83600fc470 msgr2=0x7f83600fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 shutdown_connections 2024-04-21T10:21:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.622+0000 7f83676c0640 1 -- 172.21.15.77:0/2321904697 wait complete. 2024-04-21T10:21:13.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:21:13.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:21:13.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- 172.21.15.77:0/2872629294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 msgr2=0x7fec5010a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- 172.21.15.77:0/2872629294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5010a0c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fec48009ca0 tx=0x7fec4802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- 172.21.15.77:0/2872629294 shutdown_connections 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- 172.21.15.77:0/2872629294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5010a0c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- 172.21.15.77:0/2872629294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec50105340 0x7fec50107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- 172.21.15.77:0/2872629294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec50102a10 0x7fec50104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- 172.21.15.77:0/2872629294 >> 172.21.15.77:0/2872629294 conn(0x7fec500fc400 msgr2=0x7fec500fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- 172.21.15.77:0/2872629294 shutdown_connections 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- 172.21.15.77:0/2872629294 wait complete. 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 Processor -- start 2024-04-21T10:21:13.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- start start 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec50102a10 0x7fec50198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec50105340 0x7fec501986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5019f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec5010dad0 con 0x7fec50107c70 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fec5010d950 con 0x7fec50102a10 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.736+0000 7fec5780f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fec5010dc50 con 0x7fec50105340 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5019f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5019f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47590/0 (socket says 172.21.15.77:47590) 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 -- 172.21.15.77:0/1601974886 learned_addr learned my addr 172.21.15.77:0/1601974886 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec555ab640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec50102a10 0x7fec50198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec54daa640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec50105340 0x7fec501986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 -- 172.21.15.77:0/1601974886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec50105340 msgr2=0x7fec501986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec50105340 0x7fec501986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 -- 172.21.15.77:0/1601974886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec50102a10 msgr2=0x7fec50198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec50102a10 0x7fec50198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 -- 172.21.15.77:0/1601974886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5019fd90 con 0x7fec50107c70 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec55dac640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5019f720 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fec4802c700 tx=0x7fec48035d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48039040 con 0x7fec50107c70 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec48044070 con 0x7fec50107c70 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec501a0020 con 0x7fec50107c70 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480043c0 con 0x7fec50107c70 2024-04-21T10:21:13.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.737+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501a0510 con 0x7fec50107c70 2024-04-21T10:21:13.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.738+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec500fdef0 con 0x7fec50107c70 2024-04-21T10:21:13.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.739+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fec48004560 con 0x7fec50107c70 2024-04-21T10:21:13.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.740+0000 7fec467fc640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fec3c0a3bb0 0x7fec3c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:13.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.740+0000 7fec555ab640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fec3c0a3bb0 0x7fec3c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:13.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.740+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fec480f2ae0 con 0x7fec50107c70 2024-04-21T10:21:13.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.740+0000 7fec555ab640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fec3c0a3bb0 0x7fec3c0a6070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00abe0 tx=0x7fec4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:13.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.744+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fec480bf4d0 con 0x7fec50107c70 2024-04-21T10:21:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:13 smithi077 ceph-mon[27902]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:21:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:13 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2410040917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:13 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3545511868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:13 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2321904697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:13.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.924+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec50062b50 con 0x7fec50107c70 2024-04-21T10:21:13.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.924+0000 7fec467fc640 1 -- 172.21.15.77:0/1601974886 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fec480bedd0 con 0x7fec50107c70 2024-04-21T10:21:13.925 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:21:13.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fec3c0a3bb0 msgr2=0x7fec3c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fec3c0a3bb0 0x7fec3c0a6070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00abe0 tx=0x7fec4c00a2d0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 msgr2=0x7fec5019f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:13.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5019f720 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fec4802c700 tx=0x7fec48035d60 comp rx=0 tx=0).stop 2024-04-21T10:21:13.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 shutdown_connections 2024-04-21T10:21:13.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fec3c0a3bb0 0x7fec3c0a6070 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec50107c70 0x7fec5019f720 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec50105340 0x7fec501986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 --2- 172.21.15.77:0/1601974886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec50102a10 0x7fec50198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:13.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 >> 172.21.15.77:0/1601974886 conn(0x7fec500fc400 msgr2=0x7fec50103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:13.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 shutdown_connections 2024-04-21T10:21:13.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:13.926+0000 7fec5780f640 1 -- 172.21.15.77:0/1601974886 wait complete. 2024-04-21T10:21:13.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 -- 172.21.15.77:0/600567257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 msgr2=0x7f9e541012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 --2- 172.21.15.77:0/600567257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e541012b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009900 tx=0x7f9e4402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 -- 172.21.15.77:0/600567257 shutdown_connections 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 --2- 172.21.15.77:0/600567257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e541029a0 0x7f9e541092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 --2- 172.21.15.77:0/600567257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54101fe0 0x7f9e54102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 --2- 172.21.15.77:0/600567257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e541012b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 -- 172.21.15.77:0/600567257 >> 172.21.15.77:0/600567257 conn(0x7f9e540fc400 msgr2=0x7f9e540fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 -- 172.21.15.77:0/600567257 shutdown_connections 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.038+0000 7f9e58a43640 1 -- 172.21.15.77:0/600567257 wait complete. 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 Processor -- start 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 -- start start 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e54197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e54101fe0 0x7f9e54197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e541029a0 0x7f9e5419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5410c9c0 con 0x7f9e54100e90 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5410c840 con 0x7f9e541029a0 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e58a43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5410cb40 con 0x7f9e54101fe0 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e54197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e54197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47606/0 (socket says 172.21.15.77:47606) 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 -- 172.21.15.77:0/363395264 learned_addr learned my addr 172.21.15.77:0/363395264 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e51d9b640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e54101fe0 0x7f9e54197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 -- 172.21.15.77:0/363395264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e54101fe0 msgr2=0x7f9e54197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e54101fe0 0x7f9e54197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 -- 172.21.15.77:0/363395264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e541029a0 msgr2=0x7f9e5419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e541029a0 0x7f9e5419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.039+0000 7f9e5259c640 1 -- 172.21.15.77:0/363395264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5419ed40 con 0x7f9e54100e90 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.040+0000 7f9e5259c640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e54197120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e44036040 tx=0x7f9e440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.040+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44043020 con 0x7f9e54100e90 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.040+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5419efd0 con 0x7f9e54100e90 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.040+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e440054c0 con 0x7f9e54100e90 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.040+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44003db0 con 0x7f9e54100e90 2024-04-21T10:21:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.040+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5419f490 con 0x7f9e54100e90 2024-04-21T10:21:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.041+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e54108310 con 0x7f9e54100e90 2024-04-21T10:21:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.042+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f9e44046020 con 0x7f9e54100e90 2024-04-21T10:21:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.042+0000 7f9e437fe640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.042+0000 7f9e51d9b640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.042+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f9e440f2960 con 0x7f9e54100e90 2024-04-21T10:21:14.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.043+0000 7f9e51d9b640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e48005db0 tx=0x7f9e48005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.047+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9e4404d020 con 0x7f9e54100e90 2024-04-21T10:21:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:13 smithi191 ceph-mon[31636]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:21:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:13 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2410040917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:13 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3545511868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:13 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2321904697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:14.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.224+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e54062b80 con 0x7f9e54100e90 2024-04-21T10:21:14.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.225+0000 7f9e437fe640 1 -- 172.21.15.77:0/363395264 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f9e440bf350 con 0x7f9e54100e90 2024-04-21T10:21:14.225 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:21:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 msgr2=0x7f9e3c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e48005db0 tx=0x7f9e48005d40 comp rx=0 tx=0).stop 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 msgr2=0x7f9e54197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e54197120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e44036040 tx=0x7f9e440042f0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 shutdown_connections 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f9e3c0a3bb0 0x7f9e3c0a6070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e541029a0 0x7f9e5419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e54101fe0 0x7f9e54197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 --2- 172.21.15.77:0/363395264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e54100e90 0x7f9e54197120 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 >> 172.21.15.77:0/363395264 conn(0x7f9e540fc400 msgr2=0x7f9e541054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 shutdown_connections 2024-04-21T10:21:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.227+0000 7f9e58a43640 1 -- 172.21.15.77:0/363395264 wait complete. 2024-04-21T10:21:14.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:21:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:13 smithi170 ceph-mon[31212]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:21:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:13 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2410040917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:13 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3545511868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:13 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2321904697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:14.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 -- 172.21.15.77:0/1788715283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 msgr2=0x7fd7c81023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 --2- 172.21.15.77:0/1788715283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c81023c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009900 tx=0x7fd7b802bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:14.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 -- 172.21.15.77:0/1788715283 shutdown_connections 2024-04-21T10:21:14.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 --2- 172.21.15.77:0/1788715283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c8103b50 0x7fd7c810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 --2- 172.21.15.77:0/1788715283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7c8103190 0x7fd7c8103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 --2- 172.21.15.77:0/1788715283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c81023c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 -- 172.21.15.77:0/1788715283 >> 172.21.15.77:0/1788715283 conn(0x7fd7c80fd530 msgr2=0x7fd7c80ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 -- 172.21.15.77:0/1788715283 shutdown_connections 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 -- 172.21.15.77:0/1788715283 wait complete. 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.339+0000 7fd7ce704640 1 Processor -- start 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 -- start start 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c8103190 0x7fd7c81987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7c8103b50 0x7fd7c819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c810dae0 con 0x7fd7c8101fa0 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c810d960 con 0x7fd7c8103190 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c810dc60 con 0x7fd7c8103b50 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c8198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47622/0 (socket says 172.21.15.77:47622) 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 -- 172.21.15.77:0/938789208 learned_addr learned my addr 172.21.15.77:0/938789208 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ccca1640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7c8103b50 0x7fd7c819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 -- 172.21.15.77:0/938789208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7c8103b50 msgr2=0x7fd7c819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7c8103b50 0x7fd7c819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 -- 172.21.15.77:0/938789208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c8103190 msgr2=0x7fd7c81987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c8103190 0x7fd7c81987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 -- 172.21.15.77:0/938789208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c819fe80 con 0x7fd7c8101fa0 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c7fff640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c8198260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8000c00 tx=0x7fd7b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8043020 con 0x7fd7c8101fa0 2024-04-21T10:21:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c81a0110 con 0x7fd7c8101fa0 2024-04-21T10:21:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b8004aa0 con 0x7fd7c8101fa0 2024-04-21T10:21:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8003d00 con 0x7fd7c8101fa0 2024-04-21T10:21:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.340+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c81a06b0 con 0x7fd7c8101fa0 2024-04-21T10:21:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.342+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c8109430 con 0x7fd7c8101fa0 2024-04-21T10:21:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.342+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd7b8046020 con 0x7fd7c8101fa0 2024-04-21T10:21:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.343+0000 7fd7c57fa640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7b00a3bb0 0x7fd7b00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.343+0000 7fd7c77fe640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7b00a3bb0 0x7fd7b00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.343+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd7b80f2810 con 0x7fd7c8101fa0 2024-04-21T10:21:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.343+0000 7fd7c77fe640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7b00a3bb0 0x7fd7b00a6070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc005fd0 tx=0x7fd7bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.347+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd7b804d020 con 0x7fd7c8101fa0 2024-04-21T10:21:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.527+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7c8062b50 con 0x7fd7c8101fa0 2024-04-21T10:21:14.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.528+0000 7fd7c57fa640 1 -- 172.21.15.77:0/938789208 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7fd7b80bf200 con 0x7fd7c8101fa0 2024-04-21T10:21:14.528 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:21:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7b00a3bb0 msgr2=0x7fd7b00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7b00a3bb0 0x7fd7b00a6070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc005fd0 tx=0x7fd7bc005850 comp rx=0 tx=0).stop 2024-04-21T10:21:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 msgr2=0x7fd7c8198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c8198260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8000c00 tx=0x7fd7b8004270 comp rx=0 tx=0).stop 2024-04-21T10:21:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 shutdown_connections 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd7b00a3bb0 0x7fd7b00a6070 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7c8103b50 0x7fd7c819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c8103190 0x7fd7c81987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 --2- 172.21.15.77:0/938789208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c8101fa0 0x7fd7c8198260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 >> 172.21.15.77:0/938789208 conn(0x7fd7c80fd530 msgr2=0x7fd7c8106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 shutdown_connections 2024-04-21T10:21:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.530+0000 7fd7ce704640 1 -- 172.21.15.77:0/938789208 wait complete. 2024-04-21T10:21:14.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:21:14.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/1909225577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 msgr2=0x7fd5e410a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/1909225577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e410a0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009ca0 tx=0x7fd5dc02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/1909225577 shutdown_connections 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/1909225577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e410a0a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/1909225577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 0x7fd5e4107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/1909225577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41029f0 0x7fd5e4104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/1909225577 >> 172.21.15.77:0/1909225577 conn(0x7fd5e40fc3e0 msgr2=0x7fd5e40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/1909225577 shutdown_connections 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.639+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/1909225577 wait complete. 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 Processor -- start 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 -- start start 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41029f0 0x7fd5e4198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 0x7fd5e41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410dac0 con 0x7fd5e4107c50 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410d940 con 0x7fd5e4105320 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5eaaeb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410dc40 con 0x7fd5e41029f0 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47642/0 (socket says 172.21.15.77:47642) 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 -- 172.21.15.77:0/3069213762 learned_addr learned my addr 172.21.15.77:0/3069213762 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e8887640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41029f0 0x7fd5e4198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e3fff640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 0x7fd5e41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 -- 172.21.15.77:0/3069213762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41029f0 msgr2=0x7fd5e4198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41029f0 0x7fd5e4198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 -- 172.21.15.77:0/3069213762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 msgr2=0x7fd5e41986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 0x7fd5e41986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e9088640 1 -- 172.21.15.77:0/3069213762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e419fdb0 con 0x7fd5e4107c50 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.640+0000 7fd5e3fff640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 0x7fd5e41986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.641+0000 7fd5e9088640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e419f740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc02c700 tx=0x7fd5dc034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.641+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc039040 con 0x7fd5e4107c50 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.641+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5dc044070 con 0x7fd5e4107c50 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.641+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e41a0040 con 0x7fd5e4107c50 2024-04-21T10:21:14.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.641+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0042a0 con 0x7fd5e4107c50 2024-04-21T10:21:14.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.641+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e41a0530 con 0x7fd5e4107c50 2024-04-21T10:21:14.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.642+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e40fded0 con 0x7fd5e4107c50 2024-04-21T10:21:14.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.643+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd5dc003970 con 0x7fd5e4107c50 2024-04-21T10:21:14.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.644+0000 7fd5e1ffb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd5d40a3bb0 0x7fd5d40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.644+0000 7fd5e8887640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd5d40a3bb0 0x7fd5d40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.644+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd5dc0f2880 con 0x7fd5e4107c50 2024-04-21T10:21:14.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.644+0000 7fd5e8887640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd5d40a3bb0 0x7fd5d40a6070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8005fd0 tx=0x7fd5d8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.648+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5dc0bf270 con 0x7fd5e4107c50 2024-04-21T10:21:14.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.881+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5e4062b50 con 0x7fd5e4107c50 2024-04-21T10:21:14.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.881+0000 7fd5e1ffb640 1 -- 172.21.15.77:0/3069213762 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7fd5dc0beb70 con 0x7fd5e4107c50 2024-04-21T10:21:14.882 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:14.882 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:19:26.977992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:21:14.882 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd5d40a3bb0 msgr2=0x7fd5d40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd5d40a3bb0 0x7fd5d40a6070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8005fd0 tx=0x7fd5d8005850 comp rx=0 tx=0).stop 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 msgr2=0x7fd5e419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e419f740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc02c700 tx=0x7fd5dc034760 comp rx=0 tx=0).stop 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 shutdown_connections 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fd5d40a3bb0 0x7fd5d40a6070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5e4107c50 0x7fd5e419f740 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5e4105320 0x7fd5e41986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 --2- 172.21.15.77:0/3069213762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41029f0 0x7fd5e4198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 >> 172.21.15.77:0/3069213762 conn(0x7fd5e40fc3e0 msgr2=0x7fd5e4103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 shutdown_connections 2024-04-21T10:21:14.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.884+0000 7fd5eaaeb640 1 -- 172.21.15.77:0/3069213762 wait complete. 2024-04-21T10:21:14.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- 172.21.15.77:0/3433852631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 msgr2=0x7f51001023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3433852631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f51001023b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009900 tx=0x7f50f002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- 172.21.15.77:0/3433852631 shutdown_connections 2024-04-21T10:21:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3433852631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5100103b40 0x7f510010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3433852631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 0x7f5100103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3433852631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f51001023b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- 172.21.15.77:0/3433852631 >> 172.21.15.77:0/3433852631 conn(0x7f51000fd500 msgr2=0x7f51000ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- 172.21.15.77:0/3433852631 shutdown_connections 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- 172.21.15.77:0/3433852631 wait complete. 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 Processor -- start 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- start start 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f5100075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 0x7f5100074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5100103b40 0x7f5100074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f510010dad0 con 0x7f5100101f90 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f510010d950 con 0x7f5100103180 2024-04-21T10:21:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f5105ea5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f510010dc50 con 0x7f5100103b40 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f50ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f5100075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f50ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f5100075d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47652/0 (socket says 172.21.15.77:47652) 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.994+0000 7f50ff7fe640 1 -- 172.21.15.77:0/3424369393 learned_addr learned my addr 172.21.15.77:0/3424369393 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50f7fff640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 0x7f5100074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50fffff640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5100103b40 0x7f5100074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50ff7fe640 1 -- 172.21.15.77:0/3424369393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5100103b40 msgr2=0x7f5100074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50ff7fe640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5100103b40 0x7f5100074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50ff7fe640 1 -- 172.21.15.77:0/3424369393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 msgr2=0x7f5100074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50ff7fe640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 0x7f5100074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50ff7fe640 1 -- 172.21.15.77:0/3424369393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100075110 con 0x7f5100101f90 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50f7fff640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 0x7f5100074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50ff7fe640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f5100075d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000c00 tx=0x7f50f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0043020 con 0x7f5100101f90 2024-04-21T10:21:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f0004aa0 con 0x7f5100101f90 2024-04-21T10:21:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0003d00 con 0x7f5100101f90 2024-04-21T10:21:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51001a22b0 con 0x7f5100101f90 2024-04-21T10:21:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.995+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51001a2800 con 0x7f5100101f90 2024-04-21T10:21:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.996+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51001092d0 con 0x7f5100101f90 2024-04-21T10:21:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.997+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f50f0046020 con 0x7f5100101f90 2024-04-21T10:21:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.998+0000 7f50fd7fa640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50ec0a3bb0 0x7f50ec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.998+0000 7f50f7fff640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50ec0a3bb0 0x7f50ec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.998+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f50f00f2ee0 con 0x7f5100101f90 2024-04-21T10:21:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:14.998+0000 7f50f7fff640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50ec0a3bb0 0x7f50ec0a6070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f50e80058c0 tx=0x7f50e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.001+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f50f004d020 con 0x7f5100101f90 2024-04-21T10:21:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1601974886' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/363395264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/938789208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.183+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5100062b50 con 0x7f5100101f90 2024-04-21T10:21:15.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.185+0000 7f50fd7fa640 1 -- 172.21.15.77:0/3424369393 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22664 (secure 0 0 0) 0x7f50f00bf8d0 con 0x7f5100101f90 2024-04-21T10:21:15.185 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:15.185 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:20:15.816743+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50ec0a3bb0 msgr2=0x7f50ec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50ec0a3bb0 0x7f50ec0a6070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f50e80058c0 tx=0x7f50e8005850 comp rx=0 tx=0).stop 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 msgr2=0x7f5100075d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f5100075d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000c00 tx=0x7f50f0004270 comp rx=0 tx=0).stop 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 shutdown_connections 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f50ec0a3bb0 0x7f50ec0a6070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5100103b40 0x7f5100074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5100103180 0x7f5100074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 --2- 172.21.15.77:0/3424369393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5100101f90 0x7f5100075d00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 >> 172.21.15.77:0/3424369393 conn(0x7f51000fd500 msgr2=0x7f51001064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 shutdown_connections 2024-04-21T10:21:15.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.187+0000 7f5105ea5640 1 -- 172.21.15.77:0/3424369393 wait complete. 2024-04-21T10:21:15.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-21T10:19:22.828859+0000', 'modified': '2024-04-21T10:19:26.977992+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24505, 'mds_1': 24491, 'mds_2': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2131093525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2131093525}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2131093525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.170:6837/3141822041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6836', 'nonce': 3141822041}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 3141822041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6835/2650789974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2650789974}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 2650789974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6837/2009641600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 2009641600}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2009641600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.170:6839/4122605825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 4122605825}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 4122605825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.191:6839/2863843162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2863843162}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2863843162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24505, 'qdb_cluster': [24461, 24505, 24491]} 2024-04-21T10:21:15.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-21T10:21:15.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-21T10:21:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1601974886' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/363395264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/938789208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.298+0000 7fcda5f15640 1 -- 172.21.15.77:0/552855664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda01029a0 msgr2=0x7fcda01092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.298+0000 7fcda5f15640 1 --2- 172.21.15.77:0/552855664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda01029a0 0x7fcda01092c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009ca0 tx=0x7fcd9802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- 172.21.15.77:0/552855664 shutdown_connections 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 --2- 172.21.15.77:0/552855664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda01029a0 0x7fcda01092c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 --2- 172.21.15.77:0/552855664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0101fe0 0x7fcda0102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 --2- 172.21.15.77:0/552855664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcda0100e90 0x7fcda01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- 172.21.15.77:0/552855664 >> 172.21.15.77:0/552855664 conn(0x7fcda00fc400 msgr2=0x7fcda00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- 172.21.15.77:0/552855664 shutdown_connections 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- 172.21.15.77:0/552855664 wait complete. 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 Processor -- start 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- start start 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0100e90 0x7fcda0104e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 0x7fcda0103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcda01029a0 0x7fcda0103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcda010ca40 con 0x7fcda0101fe0 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcda010c8c0 con 0x7fcda0100e90 2024-04-21T10:21:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcda5f15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcda010cbc0 con 0x7fcda01029a0 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcd97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 0x7fcda0103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcd97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 0x7fcda0103450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47668/0 (socket says 172.21.15.77:47668) 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.299+0000 7fcd97fff640 1 -- 172.21.15.77:0/2011141739 learned_addr learned my addr 172.21.15.77:0/2011141739 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd97fff640 1 -- 172.21.15.77:0/2011141739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcda01029a0 msgr2=0x7fcda0103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0100e90 0x7fcda0104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcda01029a0 0x7fcda0103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd97fff640 1 -- 172.21.15.77:0/2011141739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0100e90 msgr2=0x7fcda0104e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0100e90 0x7fcda0104e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd97fff640 1 -- 172.21.15.77:0/2011141739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda0104220 con 0x7fcda0101fe0 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0100e90 0x7fcda0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 0x7fcda0103450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800d770 tx=0x7fcd8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd9d7fa640 1 -- 172.21.15.77:0/2011141739 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88017070 con 0x7fcda0101fe0 2024-04-21T10:21:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd9d7fa640 1 -- 172.21.15.77:0/2011141739 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd88009c30 con 0x7fcda0101fe0 2024-04-21T10:21:15.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda01a2330 con 0x7fcda0101fe0 2024-04-21T10:21:15.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcd9d7fa640 1 -- 172.21.15.77:0/2011141739 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88003cc0 con 0x7fcda0101fe0 2024-04-21T10:21:15.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.300+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda01a2880 con 0x7fcda0101fe0 2024-04-21T10:21:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.302+0000 7fcd9d7fa640 1 -- 172.21.15.77:0/2011141739 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fcd88003e60 con 0x7fcda0101fe0 2024-04-21T10:21:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.302+0000 7fcda8be3740 1 Processor -- start 2024-04-21T10:21:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 -- start start 2024-04-21T10:21:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc45260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 0x56127bc45cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56127bba9b10 con 0x56127bc45830 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56127bb47240 con 0x56127bc44e40 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcda8be3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56127bba5ad0 con 0x56127bc462d0 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 0x56127bc45cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 0x56127bc45cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47678/0 (socket says 172.21.15.77:47678) 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2041665299 learned_addr learned my addr 172.21.15.77:0/2041665299 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9d7fa640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd8c0a3bb0 0x7fcd8c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc45260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2041665299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 msgr2=0x56127bc4ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc4ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2041665299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 msgr2=0x56127bc45260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc45260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2041665299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127b8bc2d0 con 0x56127bc45830 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc45260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd8c0a3bb0 0x7fcd8c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 0x56127bc45cb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000aa10 tx=0x7fcd9000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88eb33766f54dbbe server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd9d7fa640 1 -- 172.21.15.77:0/2011141739 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcd880cfe90 con 0x7fcda0101fe0 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd95ffb640 1 -- 172.21.15.77:0/2041665299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90015070 con 0x56127bc45830 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd95ffb640 1 -- 172.21.15.77:0/2041665299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9000cc60 con 0x56127bc45830 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.303+0000 7fcd95ffb640 1 -- 172.21.15.77:0/2041665299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90018580 con 0x56127bc45830 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 -- 172.21.15.77:0/2041665299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 msgr2=0x56127bc45cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd8c0a3bb0 0x7fcd8c0a6070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcd98005e30 tx=0x7fcd98005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 0x56127bc45cb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000aa10 tx=0x7fcd9000aed0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 -- 172.21.15.77:0/2041665299 shutdown_connections 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc45830 0x56127bc45cb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc4ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2041665299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc45260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 -- 172.21.15.77:0/2041665299 >> 172.21.15.77:0/2041665299 conn(0x56127bc40f40 msgr2=0x56127bc3f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 -- 172.21.15.77:0/2041665299 shutdown_connections 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 -- 172.21.15.77:0/2041665299 wait complete. 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.304+0000 7fcda8be3740 1 -- start start 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 Processor -- start 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc56430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56127bc4d4b0 con 0x56127bc462d0 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56127bb32190 con 0x56127bc44e40 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56127bc4d630 con 0x56127bc45830 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcda8be3740 10 client.0 _ll_register_callbacks cb 0x56127bb2d8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc56430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc56430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47692/0 (socket says 172.21.15.77:47692) 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 -- 172.21.15.77:0/3192963181 learned_addr learned my addr 172.21.15.77:0/3192963181 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd97fff640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 -- 172.21.15.77:0/3192963181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 msgr2=0x56127bc4f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 -- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 msgr2=0x56127bc4eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9ffff640 1 -- 172.21.15.77:0/3192963181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127b9866b0 con 0x56127bc462d0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.305+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc56430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcd98036000 tx=0x7fcd98032340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c242c177504f2926 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd7effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd7effd640 1 -- 172.21.15.77:0/3192963181 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98045050 con 0x56127bc462d0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd7effd640 1 -- 172.21.15.77:0/3192963181 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcd98004240 con 0x56127bc462d0 2024-04-21T10:21:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd9000cc60 con 0x56127bc462d0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd7effd640 1 -- 172.21.15.77:0/3192963181 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcd98039040 con 0x56127bc462d0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 10 client.15249 fetch_fsmap learned FSMap version 21 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56127bc59780 con 0x56127bc462d0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd7effd640 1 -- 172.21.15.77:0/3192963181 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9000cc60 con 0x56127bc462d0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcd7effd640 1 -- 172.21.15.77:0/3192963181 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcd9803fb50 con 0x56127bc462d0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 10 client.15249 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 20 client.15249 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bc5be90 0x56127bc5d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 4 client.15249 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.306+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 --> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56127bbb7530 con 0x56127bc5be90 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.307+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bc5be90 0x56127bc5d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.307+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bc5be90 0x56127bc5d300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c99f7a27639ee539 server_cookie=c792547491876460 in_seq=0 out_seq=0 2024-04-21T10:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.307+0000 7fcd7effd640 10 client.15249 ms_handle_connect on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcd7effd640 1 -- 172.21.15.77:0/3192963181 <== mds.2 v2:172.21.15.170:6836/3141822041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56127bbb7530 con 0x56127bc5be90 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcd7effd640 10 client.15249 handle_command_reply: tid=0 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 client.15249 shutdown 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 msgr2=0x56127bc56430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc56430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcd98036000 tx=0x7fcd98032340 comp rx=0 tx=0).stop 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 shutdown_connections 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bc5be90 0x56127bc5d300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc56430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcd7effd640 0 client.15249 ms_handle_reset on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:15.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 --2- 172.21.15.77:0/3192963181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 >> 172.21.15.77:0/3192963181 conn(0x56127bc40f40 msgr2=0x56127bc3ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 shutdown_connections 2024-04-21T10:21:15.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 1 -- 172.21.15.77:0/3192963181 wait complete. 2024-04-21T10:21:15.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.308+0000 7fcda8be3740 20 client.15249 trim_cache size 0 max 16384 2024-04-21T10:21:15.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1601974886' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/363395264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/938789208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:15.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 Processor -- start 2024-04-21T10:21:15.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 -- start start 2024-04-21T10:21:15.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56127bc5b640 con 0x56127bc462d0 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56127bc5bd10 con 0x56127bc44e40 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcda8be3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56127bc5c3e0 con 0x56127bc45830 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47702/0 (socket says 172.21.15.77:47702) 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 -- 172.21.15.77:0/1198099780 learned_addr learned my addr 172.21.15.77:0/1198099780 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 -- 172.21.15.77:0/1198099780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 msgr2=0x56127bc4d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 -- 172.21.15.77:0/1198099780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 msgr2=0x56127bc4ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.326+0000 7fcd9ffff640 1 -- 172.21.15.77:0/1198099780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127bc4cb30 con 0x56127bc462d0 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc563f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcd9802c630 tx=0x7fcd9802cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d5c999fff9815f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcd957fa640 1 -- 172.21.15.77:0/1198099780 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98045070 con 0x56127bc462d0 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcd957fa640 1 -- 172.21.15.77:0/1198099780 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9804f070 con 0x56127bc462d0 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcd957fa640 1 -- 172.21.15.77:0/1198099780 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9804ad40 con 0x56127bc462d0 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 -- 172.21.15.77:0/1198099780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 msgr2=0x56127bc563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc563f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcd9802c630 tx=0x7fcd9802cd40 comp rx=0 tx=0).stop 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 -- 172.21.15.77:0/1198099780 shutdown_connections 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc462d0 0x56127bc563f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc45830 0x56127bc4d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 --2- 172.21.15.77:0/1198099780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc44e40 0x56127bc4ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 -- 172.21.15.77:0/1198099780 >> 172.21.15.77:0/1198099780 conn(0x56127bc40f40 msgr2=0x56127bc3a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 -- 172.21.15.77:0/1198099780 shutdown_connections 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.327+0000 7fcda8be3740 1 -- 172.21.15.77:0/1198099780 wait complete. 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 -- start start 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 Processor -- start 2024-04-21T10:21:15.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 0x56127bc523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc45830 0x56127bc54920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc54e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56127bc5d180 con 0x56127bc44e40 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56127bc5cab0 con 0x56127bc45830 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56127bc5d850 con 0x56127bc462d0 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcda8be3740 10 client.0 _ll_register_callbacks cb 0x7fcd98037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 0x56127bc523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 0x56127bc523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47712/0 (socket says 172.21.15.77:47712) 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2194475882 learned_addr learned my addr 172.21.15.77:0/2194475882 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2194475882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 msgr2=0x56127bc54e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc54e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc54e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc45830 0x56127bc54920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc45830 msgr2=0x56127bc54920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc45830 0x56127bc54920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9f7fe640 1 -- 172.21.15.77:0/2194475882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127bc55500 con 0x56127bc44e40 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd9ffff640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc54e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.328+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc45830 0x56127bc54920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd9f7fe640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 0x56127bc523d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000a930 tx=0x7fcd9000a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3535ca4be8ddb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd7effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd7effd640 1 -- 172.21.15.77:0/2194475882 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9002a060 con 0x56127bc44e40 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd7effd640 1 -- 172.21.15.77:0/2194475882 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcd90011d00 con 0x56127bc44e40 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd9804f070 con 0x56127bc44e40 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd7effd640 1 -- 172.21.15.77:0/2194475882 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcd90015040 con 0x56127bc44e40 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 10 client.15255 fetch_fsmap learned FSMap version 21 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56127bcc1e40 con 0x56127bc44e40 2024-04-21T10:21:15.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd7effd640 1 -- 172.21.15.77:0/2194475882 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9804f070 con 0x56127bc44e40 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd7effd640 1 -- 172.21.15.77:0/2194475882 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcd90011480 con 0x56127bc44e40 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 10 client.15255 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 10 client.15255 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 20 client.15255 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bcc6630 0x56127bcc5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 4 client.15255 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 --> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] -- command(tid 0: {"prefix": "status"}) -- 0x56127bbb13a0 con 0x56127bcc6630 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.329+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bcc6630 0x56127bcc5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcd7effd640 10 client.15255 ms_handle_connect on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcd97fff640 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bcc6630 0x56127bcc5340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b9e1f9765e21376 server_cookie=4571dd0b5707d402 in_seq=0 out_seq=0 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcd7effd640 1 -- 172.21.15.77:0/2194475882 <== mds.2 v2:172.21.15.170:6836/3141822041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56127bbb13a0 con 0x56127bcc6630 2024-04-21T10:21:15.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcd7effd640 10 client.15255 handle_command_reply: tid=0 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 client.15255 shutdown 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 msgr2=0x56127bc523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 0x56127bc523d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000a930 tx=0x7fcd9000a520 comp rx=0 tx=0).stop 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 shutdown_connections 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x56127bcc6630 0x56127bcc5340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56127bc462d0 0x56127bc54e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56127bc45830 0x56127bc54920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcd7effd640 0 client.15255 ms_handle_reset on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 --2- 172.21.15.77:0/2194475882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56127bc44e40 0x56127bc523d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 >> 172.21.15.77:0/2194475882 conn(0x56127bc40f40 msgr2=0x56127bc49880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 shutdown_connections 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 1 -- 172.21.15.77:0/2194475882 wait complete. 2024-04-21T10:21:15.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.330+0000 7fcda8be3740 20 client.15255 trim_cache size 0 max 16384 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 2, 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24461, 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 109.357191148, 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-04-21T10:21:15.338 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 87, 2024-04-21T10:21:15.339 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T10:21:15.339 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 129.98460652899999 2024-04-21T10:21:15.339 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:15.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd8c0a3bb0 msgr2=0x7fcd8c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd8c0a3bb0 0x7fcd8c0a6070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcd98005e30 tx=0x7fcd98005da0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 msgr2=0x7fcda0103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 0x7fcda0103450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800d770 tx=0x7fcd8800dc30 comp rx=0 tx=0).stop 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 shutdown_connections 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fcd8c0a3bb0 0x7fcd8c0a6070 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcda0101fe0 0x7fcda0103450 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcda01029a0 0x7fcda0103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 --2- 172.21.15.77:0/2011141739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda0100e90 0x7fcda0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 >> 172.21.15.77:0/2011141739 conn(0x7fcda00fc400 msgr2=0x7fcda00fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 shutdown_connections 2024-04-21T10:21:15.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.331+0000 7fcda5f15640 1 -- 172.21.15.77:0/2011141739 wait complete. 2024-04-21T10:21:15.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-21T10:21:15.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 -- 172.21.15.77:0/3804418978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0103190 msgr2=0x7fadd0103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 --2- 172.21.15.77:0/3804418978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0103190 0x7fadd0103610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009900 tx=0x7fadc402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 -- 172.21.15.77:0/3804418978 shutdown_connections 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 --2- 172.21.15.77:0/3804418978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0103190 0x7fadd0103610 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 --2- 172.21.15.77:0/3804418978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd0103b50 0x7fadd010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 --2- 172.21.15.77:0/3804418978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadd0101fa0 0x7fadd01023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.440+0000 7fadd7c81640 1 -- 172.21.15.77:0/3804418978 >> 172.21.15.77:0/3804418978 conn(0x7fadd00fd530 msgr2=0x7fadd00ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 -- 172.21.15.77:0/3804418978 shutdown_connections 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 -- 172.21.15.77:0/3804418978 wait complete. 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 Processor -- start 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 -- start start 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 0x7fadd01981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd0103190 0x7fadd0198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadd0103b50 0x7fadd019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010dae0 con 0x7fadd0101fa0 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010d960 con 0x7fadd0103b50 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd7c81640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010dc60 con 0x7fadd0103190 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 0x7fadd01981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 0x7fadd01981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47734/0 (socket says 172.21.15.77:47734) 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 -- 172.21.15.77:0/880050019 learned_addr learned my addr 172.21.15.77:0/880050019 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 -- 172.21.15.77:0/880050019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd0103190 msgr2=0x7fadd0198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd0103190 0x7fadd0198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 -- 172.21.15.77:0/880050019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadd0103b50 msgr2=0x7fadd019f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.441+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadd0103b50 0x7fadd019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadd5a1d640 1 -- 172.21.15.77:0/880050019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd019fde0 con 0x7fadd0101fa0 2024-04-21T10:21:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 0x7fadd01981c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fadc000ebc0 tx=0x7fadc000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadceffd640 1 -- 172.21.15.77:0/880050019 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003b70 con 0x7fadd0101fa0 2024-04-21T10:21:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadceffd640 1 -- 172.21.15.77:0/880050019 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc0003d10 con 0x7fadd0101fa0 2024-04-21T10:21:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd01a00d0 con 0x7fadd0101fa0 2024-04-21T10:21:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadceffd640 1 -- 172.21.15.77:0/880050019 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0019800 con 0x7fadd0101fa0 2024-04-21T10:21:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.442+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd01a0670 con 0x7fadd0101fa0 2024-04-21T10:21:15.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.444+0000 7fadceffd640 1 -- 172.21.15.77:0/880050019 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fadc00199a0 con 0x7fadd0101fa0 2024-04-21T10:21:15.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.444+0000 7fadda878740 1 Processor -- start 2024-04-21T10:21:15.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 -- start start 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e341f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e341fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 0x55d6e3426eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3383b10 con 0x55d6e34202d0 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3321240 con 0x55d6e341f830 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadda878740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d6e337fad0 con 0x55d6e341ee40 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 0x55d6e3426eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 0x55d6e3426eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47746/0 (socket says 172.21.15.77:47746) 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 -- 172.21.15.77:0/3428551047 learned_addr learned my addr 172.21.15.77:0/3428551047 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e341fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd621e640 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e341f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadceffd640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fadb80a3c30 0x7fadb80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd621e640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fadb80a3c30 0x7fadb80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 -- 172.21.15.77:0/3428551047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 msgr2=0x55d6e341f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e341f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 -- 172.21.15.77:0/3428551047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 msgr2=0x55d6e341fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e341fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 -- 172.21.15.77:0/3428551047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e30962d0 con 0x55d6e34202d0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadceffd640 1 -- 172.21.15.77:0/880050019 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fadc00d0dd0 con 0x7fadd0101fa0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.445+0000 7fadd521c640 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 0x55d6e3426eb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005ab0 tx=0x7fadc4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61511d74a3ae4b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadd621e640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fadb80a3c30 0x7fadb80a60f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55d6e341a200 tx=0x7fadc80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadb7fff640 1 -- 172.21.15.77:0/3428551047 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4041020 con 0x55d6e34202d0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadb7fff640 1 -- 172.21.15.77:0/3428551047 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc402cae0 con 0x55d6e34202d0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadb7fff640 1 -- 172.21.15.77:0/3428551047 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4004920 con 0x55d6e34202d0 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 -- 172.21.15.77:0/3428551047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 msgr2=0x55d6e3426eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 0x55d6e3426eb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005ab0 tx=0x7fadc4005bd0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 -- 172.21.15.77:0/3428551047 shutdown_connections 2024-04-21T10:21:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e34202d0 0x55d6e3426eb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e341fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 --2- 172.21.15.77:0/3428551047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e341f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.446+0000 7fadda878740 1 -- 172.21.15.77:0/3428551047 >> 172.21.15.77:0/3428551047 conn(0x55d6e341af40 msgr2=0x55d6e3419490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 -- 172.21.15.77:0/3428551047 shutdown_connections 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 -- 172.21.15.77:0/3428551047 wait complete. 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 -- start start 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 Processor -- start 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3428e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3429340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3427450 con 0x55d6e341f830 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d6e330c190 con 0x55d6e34202d0 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d6e34275d0 con 0x55d6e341ee40 2024-04-21T10:21:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadda878740 10 client.0 _ll_register_callbacks cb 0x55d6e33078b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadd521c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3429340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadd521c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3429340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47748/0 (socket says 172.21.15.77:47748) 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadd521c640 1 -- 172.21.15.77:0/4288356445 learned_addr learned my addr 172.21.15.77:0/4288356445 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.447+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3428e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd621e640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd521c640 1 -- 172.21.15.77:0/4288356445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 msgr2=0x55d6e3428e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd521c640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3428e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd521c640 1 -- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 msgr2=0x55d6e3430380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd521c640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd521c640 1 -- 172.21.15.77:0/4288356445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e31606b0 con 0x55d6e341f830 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd621e640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadd521c640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3429340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fadc402c840 tx=0x7fadc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7529f1d8d4e3b427 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadb57fa640 1 -- 172.21.15.77:0/4288356445 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4041030 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadb57fa640 1 -- 172.21.15.77:0/4288356445 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fadc40046c0 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc402cae0 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadb57fa640 1 -- 172.21.15.77:0/4288356445 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fadc4056050 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadda878740 10 client.15267 fetch_fsmap learned FSMap version 21 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d6e34336f0 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadb57fa640 1 -- 172.21.15.77:0/4288356445 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc402cae0 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadb57fa640 1 -- 172.21.15.77:0/4288356445 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fadc4003860 con 0x55d6e341f830 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadda878740 10 client.15267 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadda878740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.448+0000 7fadda878740 20 client.15267 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.449+0000 7fadda878740 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e3435940 0x55d6e3436db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.449+0000 7fadda878740 4 client.15267 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.449+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 --> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e3391530 con 0x55d6e3435940 2024-04-21T10:21:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.449+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e3435940 0x55d6e3436db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.449+0000 7fadb57fa640 10 client.15267 ms_handle_connect on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.449+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e3435940 0x55d6e3436db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ffaa7ceda539bf2f server_cookie=947e86e0ab9a4241 in_seq=0 out_seq=0 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadb57fa640 1 -- 172.21.15.77:0/4288356445 <== mds.1 v2:172.21.15.170:6838/4122605825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d6e3391530 con 0x55d6e3435940 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadb57fa640 10 client.15267 handle_command_reply: tid=0 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 client.15267 shutdown 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 msgr2=0x55d6e3429340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3429340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fadc402c840 tx=0x7fadc4004270 comp rx=0 tx=0).stop 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 shutdown_connections 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e3435940 0x55d6e3436db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3429340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadb57fa640 0 client.15267 ms_handle_reset on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 --2- 172.21.15.77:0/4288356445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3428e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 >> 172.21.15.77:0/4288356445 conn(0x55d6e341af40 msgr2=0x55d6e3418a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 shutdown_connections 2024-04-21T10:21:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 1 -- 172.21.15.77:0/4288356445 wait complete. 2024-04-21T10:21:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.450+0000 7fadda878740 20 client.15267 trim_cache size 0 max 16384 2024-04-21T10:21:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 Processor -- start 2024-04-21T10:21:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 -- start start 2024-04-21T10:21:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3419400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3419940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d6e34350f0 con 0x55d6e341f830 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d6e34357c0 con 0x55d6e34202d0 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadda878740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3435e90 con 0x55d6e341ee40 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadd521c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3419940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadd521c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3419940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47758/0 (socket says 172.21.15.77:47758) 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.468+0000 7fadd521c640 1 -- 172.21.15.77:0/476069492 learned_addr learned my addr 172.21.15.77:0/476069492 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3419400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd621e640 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd521c640 1 -- 172.21.15.77:0/476069492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 msgr2=0x55d6e3419400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd521c640 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3419400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd521c640 1 -- 172.21.15.77:0/476069492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 msgr2=0x55d6e3430340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd521c640 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd521c640 1 -- 172.21.15.77:0/476069492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e3429f80 con 0x55d6e341f830 2024-04-21T10:21:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadd521c640 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3419940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fadc4003c80 tx=0x7fadc4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4786519b6897796a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadb77fe640 1 -- 172.21.15.77:0/476069492 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4041030 con 0x55d6e341f830 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadb77fe640 1 -- 172.21.15.77:0/476069492 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc404a070 con 0x55d6e341f830 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadb77fe640 1 -- 172.21.15.77:0/476069492 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc40046c0 con 0x55d6e341f830 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadda878740 1 -- 172.21.15.77:0/476069492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 msgr2=0x55d6e3419940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.469+0000 7fadda878740 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3419940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fadc4003c80 tx=0x7fadc4005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- 172.21.15.77:0/476069492 shutdown_connections 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341f830 0x55d6e3419940 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e34202d0 0x55d6e3430340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 --2- 172.21.15.77:0/476069492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e341ee40 0x55d6e3419400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- 172.21.15.77:0/476069492 >> 172.21.15.77:0/476069492 conn(0x55d6e341af40 msgr2=0x55d6e3423810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- 172.21.15.77:0/476069492 shutdown_connections 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- 172.21.15.77:0/476069492 wait complete. 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- start start 2024-04-21T10:21:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 Processor -- start 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 0x55d6e342c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e342e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e34202d0 0x55d6e342ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3436c30 con 0x55d6e341ee40 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3436560 con 0x55d6e341f830 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d6e3437300 con 0x55d6e34202d0 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadda878740 10 client.0 _ll_register_callbacks cb 0x7fadc0099130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadd5a1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 0x55d6e342c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadd5a1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 0x55d6e342c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47762/0 (socket says 172.21.15.77:47762) 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadd5a1d640 1 -- 172.21.15.77:0/2960682353 learned_addr learned my addr 172.21.15.77:0/2960682353 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.470+0000 7fadd621e640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e34202d0 0x55d6e342ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd521c640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e342e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd5a1d640 1 -- 172.21.15.77:0/2960682353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e34202d0 msgr2=0x55d6e342ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e34202d0 0x55d6e342ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd5a1d640 1 -- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 msgr2=0x55d6e342e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e342e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd5a1d640 1 -- 172.21.15.77:0/2960682353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e342f250 con 0x55d6e341ee40 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd621e640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e34202d0 0x55d6e342ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd521c640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e342e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadd5a1d640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 0x55d6e342c280 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fadc009cff0 tx=0x7fadc009cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7348f58a28be5663 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadb57fa640 1 -- 172.21.15.77:0/2960682353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc009d760 con 0x55d6e341ee40 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadb57fa640 1 -- 172.21.15.77:0/2960682353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fadc00ce990 con 0x55d6e341ee40 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc404a070 con 0x55d6e341ee40 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadb57fa640 1 -- 172.21.15.77:0/2960682353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fadc009d060 con 0x55d6e341ee40 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 10 client.15273 fetch_fsmap learned FSMap version 21 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d6e3430620 con 0x55d6e341ee40 2024-04-21T10:21:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadb57fa640 1 -- 172.21.15.77:0/2960682353 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc404a070 con 0x55d6e341ee40 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadb57fa640 1 -- 172.21.15.77:0/2960682353 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fadc00996d0 con 0x55d6e341ee40 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 10 client.15273 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 20 client.15273 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e34a00e0 0x55d6e349edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 4 client.15273 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.471+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 --> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] -- command(tid 0: {"prefix": "status"}) -- 0x55d6e338b3a0 con 0x55d6e34a00e0 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadd521c640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e34a00e0 0x55d6e349edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadb57fa640 10 client.15273 ms_handle_connect on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadd521c640 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e34a00e0 0x55d6e349edf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd52e050a2c119ce server_cookie=3f1181d8b08257b8 in_seq=0 out_seq=0 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadb57fa640 1 -- 172.21.15.77:0/2960682353 <== mds.1 v2:172.21.15.170:6838/4122605825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55d6e338b3a0 con 0x55d6e34a00e0 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadb57fa640 10 client.15273 handle_command_reply: tid=0 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 client.15273 shutdown 2024-04-21T10:21:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 msgr2=0x55d6e342c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 0x55d6e342c280 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fadc009cff0 tx=0x7fadc009cef0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 shutdown_connections 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55d6e34a00e0 0x55d6e349edf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d6e34202d0 0x55d6e342ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadb57fa640 0 client.15273 ms_handle_reset on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d6e341f830 0x55d6e342e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 --2- 172.21.15.77:0/2960682353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d6e341ee40 0x55d6e342c280 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 >> 172.21.15.77:0/2960682353 conn(0x55d6e341af40 msgr2=0x55d6e3426e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 shutdown_connections 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 1 -- 172.21.15.77:0/2960682353 wait complete. 2024-04-21T10:21:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.472+0000 7fadda878740 20 client.15273 trim_cache size 0 max 16384 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24491, 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 109.950657959, 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 87, 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T10:21:15.480 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 119.112378072 2024-04-21T10:21:15.481 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:15.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fadb80a3c30 msgr2=0x7fadb80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fadb80a3c30 0x7fadb80a60f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55d6e341a200 tx=0x7fadc80046c0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 msgr2=0x7fadd01981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 0x7fadd01981c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fadc000ebc0 tx=0x7fadc000c6a0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 shutdown_connections 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fadb80a3c30 0x7fadb80a60f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadd0103b50 0x7fadd019f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd0103190 0x7fadd0198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 --2- 172.21.15.77:0/880050019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadd0101fa0 0x7fadd01981c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 >> 172.21.15.77:0/880050019 conn(0x7fadd00fd530 msgr2=0x7fadd0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 shutdown_connections 2024-04-21T10:21:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.473+0000 7fadd7c81640 1 -- 172.21.15.77:0/880050019 wait complete. 2024-04-21T10:21:15.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 -- 172.21.15.77:0/1486598598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103190 msgr2=0x7f3280103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 --2- 172.21.15.77:0/1486598598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103190 0x7f3280103610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f326c009900 tx=0x7f326c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 -- 172.21.15.77:0/1486598598 shutdown_connections 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 --2- 172.21.15.77:0/1486598598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103190 0x7f3280103610 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 --2- 172.21.15.77:0/1486598598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3280103b50 0x7f328010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 --2- 172.21.15.77:0/1486598598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 0x7f32801023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 -- 172.21.15.77:0/1486598598 >> 172.21.15.77:0/1486598598 conn(0x7f32800fd530 msgr2=0x7f32800ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 -- 172.21.15.77:0/1486598598 shutdown_connections 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.585+0000 7f3286c11640 1 -- 172.21.15.77:0/1486598598 wait complete. 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 Processor -- start 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 -- start start 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 0x7f32801981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3280103190 0x7f3280198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 0x7f328019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f328010dae0 con 0x7f3280103b50 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f328010d960 con 0x7f3280103190 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f328010dc60 con 0x7f3280101fa0 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 0x7f328019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 0x7f328019f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47774/0 (socket says 172.21.15.77:47774) 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 -- 172.21.15.77:0/2229088391 learned_addr learned my addr 172.21.15.77:0/2229088391 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32849ad640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 0x7f32801981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f327ffff640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3280103190 0x7f3280198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 -- 172.21.15.77:0/2229088391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 msgr2=0x7f32801981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 0x7f32801981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 -- 172.21.15.77:0/2229088391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3280103190 msgr2=0x7f3280198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3280103190 0x7f3280198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 -- 172.21.15.77:0/2229088391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328019fdf0 con 0x7f3280103b50 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32849ad640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 0x7f32801981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f32851ae640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 0x7f328019f780 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f327800eaa0 tx=0x7f327800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f327dffb640 1 -- 172.21.15.77:0/2229088391 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327800cdb0 con 0x7f3280103b50 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f327dffb640 1 -- 172.21.15.77:0/2229088391 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3278005020 con 0x7f3280103b50 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f327dffb640 1 -- 172.21.15.77:0/2229088391 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32780116d0 con 0x7f3280103b50 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.586+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32801a00e0 con 0x7f3280103b50 2024-04-21T10:21:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.587+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801a0630 con 0x7f3280103b50 2024-04-21T10:21:15.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f327dffb640 1 -- 172.21.15.77:0/2229088391 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f32780051d0 con 0x7f3280103b50 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 Processor -- start 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 -- start start 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f327dffb640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f32700a3c30 0x7f32700a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b2830 0x5635e87b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 0x5635e87b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635e8716b10 con 0x5635e87b32d0 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5635e86b4240 con 0x5635e87b1e40 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.589+0000 7f3289801740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5635e8712ad0 con 0x5635e87b2830 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 0x5635e87b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32849ad640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f32700a3c30 0x7f32700a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 0x5635e87b9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47782/0 (socket says 172.21.15.77:47782) 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 -- 172.21.15.77:0/1657042376 learned_addr learned my addr 172.21.15.77:0/1657042376 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f327ffff640 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f327dffb640 1 -- 172.21.15.77:0/2229088391 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f32780d0630 con 0x7f3280103b50 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f327ffff640 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b2830 0x5635e87b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 -- 172.21.15.77:0/1657042376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b2830 msgr2=0x5635e87b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b2830 0x5635e87b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 -- 172.21.15.77:0/1657042376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 msgr2=0x5635e87b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 -- 172.21.15.77:0/1657042376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e84292d0 con 0x5635e87b32d0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32849ad640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f32700a3c30 0x7f32700a60f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f32740058c0 tx=0x7f3274005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f32851ae640 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 0x5635e87b9eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3278014e90 tx=0x7f3278005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eeeb4a9f775954c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f326affd640 1 -- 172.21.15.77:0/1657042376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327801f070 con 0x5635e87b32d0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f326affd640 1 -- 172.21.15.77:0/1657042376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3278067480 con 0x5635e87b32d0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.590+0000 7f326affd640 1 -- 172.21.15.77:0/1657042376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327809c920 con 0x5635e87b32d0 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 -- 172.21.15.77:0/1657042376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 msgr2=0x5635e87b9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 0x5635e87b9eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3278014e90 tx=0x7f3278005890 comp rx=0 tx=0).stop 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 -- 172.21.15.77:0/1657042376 shutdown_connections 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b32d0 0x5635e87b9eb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b2830 0x5635e87b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 --2- 172.21.15.77:0/1657042376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 -- 172.21.15.77:0/1657042376 >> 172.21.15.77:0/1657042376 conn(0x5635e87adf40 msgr2=0x5635e87ac490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 -- 172.21.15.77:0/1657042376 shutdown_connections 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 -- 172.21.15.77:0/1657042376 wait complete. 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 -- start start 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.591+0000 7f3289801740 1 Processor -- start 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87bc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635e87ba3f0 con 0x5635e87b2830 2024-04-21T10:21:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5635e869f190 con 0x5635e87b1e40 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5635e87ba570 con 0x5635e87b32d0 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 10 client.0 _ll_register_callbacks cb 0x5635e869a8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87bc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47788/0 (socket says 172.21.15.77:47788) 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 -- 172.21.15.77:0/1926492021 learned_addr learned my addr 172.21.15.77:0/1926492021 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f32849ad640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f32851ae640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 -- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 msgr2=0x5635e87c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 -- 172.21.15.77:0/1926492021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 msgr2=0x5635e87bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87bbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 -- 172.21.15.77:0/1926492021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e84f36b0 con 0x5635e87b2830 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f32849ad640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f327ffff640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87bc390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f326c009230 tx=0x7f326c02ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58d6b35f8c0fabd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f325ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f325ffff640 1 -- 172.21.15.77:0/1926492021 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c046020 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f325ffff640 1 -- 172.21.15.77:0/1926492021 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f326c004250 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3278067480 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f325ffff640 1 -- 172.21.15.77:0/1926492021 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f326c004450 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 10 client.15285 fetch_fsmap learned FSMap version 21 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.592+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5635e87c6740 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f325ffff640 1 -- 172.21.15.77:0/1926492021 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3278067480 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f325ffff640 1 -- 172.21.15.77:0/1926492021 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f326c0035f0 con 0x5635e87b2830 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f3289801740 10 client.15285 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f3289801740 10 client.15285 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f3289801740 20 client.15285 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f3289801740 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e87c8e20 0x5635e87ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f3289801740 4 client.15285 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635e8724530 con 0x5635e87c8e20 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f32849ad640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e87c8e20 0x5635e87ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f325ffff640 10 client.15285 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.593+0000 7f32849ad640 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e87c8e20 0x5635e87ca290 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4393610f734648e5 server_cookie=e8e6c397e8cf12f9 in_seq=0 out_seq=0 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f325ffff640 1 -- 172.21.15.77:0/1926492021 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5635e8724530 con 0x5635e87c8e20 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f325ffff640 10 client.15285 handle_command_reply: tid=0 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 client.15285 shutdown 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 msgr2=0x5635e87bc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87bc390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f326c009230 tx=0x7f326c02ccb0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 shutdown_connections 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e87c8e20 0x5635e87ca290 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87bc390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f325ffff640 0 client.15285 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 --2- 172.21.15.77:0/1926492021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 >> 172.21.15.77:0/1926492021 conn(0x5635e87adf40 msgr2=0x5635e87aba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 shutdown_connections 2024-04-21T10:21:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.594+0000 7f3289801740 1 -- 172.21.15.77:0/1926492021 wait complete. 2024-04-21T10:21:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.595+0000 7f3289801740 20 client.15285 trim_cache size 0 max 16384 2024-04-21T10:21:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.612+0000 7f3289801740 1 Processor -- start 2024-04-21T10:21:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.612+0000 7f3289801740 1 -- start start 2024-04-21T10:21:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f3289801740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87ba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f3289801740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f3289801740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f3289801740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635e87c85d0 con 0x5635e87b2830 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f3289801740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5635e87c8ca0 con 0x5635e87b1e40 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f3289801740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5635e87c9370 con 0x5635e87b32d0 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47790/0 (socket says 172.21.15.77:47790) 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 -- 172.21.15.77:0/4127908487 learned_addr learned my addr 172.21.15.77:0/4127908487 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 -- 172.21.15.77:0/4127908487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 msgr2=0x5635e87c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 -- 172.21.15.77:0/4127908487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 msgr2=0x5635e87ba940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f32849ad640 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87ba940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 -- 172.21.15.77:0/4127908487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e87add40 con 0x5635e87b2830 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f32849ad640 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87ba940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f327ffff640 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c3320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f326c003c00 tx=0x7f326c02cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266f87d6aec0b23a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f326a7fc640 1 -- 172.21.15.77:0/4127908487 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c05a070 con 0x5635e87b2830 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f326a7fc640 1 -- 172.21.15.77:0/4127908487 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f326c0035f0 con 0x5635e87b2830 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.613+0000 7f326a7fc640 1 -- 172.21.15.77:0/4127908487 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c046070 con 0x5635e87b2830 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 -- 172.21.15.77:0/4127908487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 msgr2=0x5635e87c3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c3320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f326c003c00 tx=0x7f326c02cdd0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 -- 172.21.15.77:0/4127908487 shutdown_connections 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c3320 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b32d0 0x5635e87c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 --2- 172.21.15.77:0/4127908487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b1e40 0x5635e87ba940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 -- 172.21.15.77:0/4127908487 >> 172.21.15.77:0/4127908487 conn(0x5635e87adf40 msgr2=0x5635e87b9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 -- 172.21.15.77:0/4127908487 shutdown_connections 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 -- 172.21.15.77:0/4127908487 wait complete. 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 -- start start 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.614+0000 7f3289801740 1 Processor -- start 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b1e40 0x5635e87abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b32d0 0x5635e882cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635e87ca110 con 0x5635e87b2830 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5635e87c9a40 con 0x5635e87b32d0 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5635e87ca7e0 con 0x5635e87b1e40 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 10 client.0 _ll_register_callbacks cb 0x7f326c005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47802/0 (socket says 172.21.15.77:47802) 2024-04-21T10:21:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 -- 172.21.15.77:0/2098450788 learned_addr learned my addr 172.21.15.77:0/2098450788 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f32851ae640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b32d0 0x5635e882cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f32849ad640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b1e40 0x5635e87abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 -- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b1e40 msgr2=0x5635e87abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b1e40 0x5635e87abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 -- 172.21.15.77:0/2098450788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b32d0 msgr2=0x5635e882cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b32d0 0x5635e882cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 -- 172.21.15.77:0/2098450788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e882d550 con 0x5635e87b2830 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f32851ae640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b32d0 0x5635e882cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f327ffff640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c1270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f326c009230 tx=0x7f326c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16376cc148accce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f325ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f325ffff640 1 -- 172.21.15.77:0/2098450788 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c05a070 con 0x5635e87b2830 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f325ffff640 1 -- 172.21.15.77:0/2098450788 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f326c034440 con 0x5635e87b2830 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f326c0035f0 con 0x5635e87b2830 2024-04-21T10:21:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f325ffff640 1 -- 172.21.15.77:0/2098450788 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f326c046040 con 0x5635e87b2830 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 10 client.15291 fetch_fsmap learned FSMap version 21 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.615+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5635e882e7c0 con 0x5635e87b2830 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f325ffff640 1 -- 172.21.15.77:0/2098450788 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f326c0035f0 con 0x5635e87b2830 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f325ffff640 1 -- 172.21.15.77:0/2098450788 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f326c054030 con 0x5635e87b2830 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f3289801740 10 client.15291 fetch_fsmap finished waiting for FSMap version 21 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f3289801740 10 client.15291 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f3289801740 20 client.15291 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f3289801740 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e8832e70 0x5635e8831b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f3289801740 4 client.15291 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "status"}) -- 0x5635e871e3a0 con 0x5635e8832e70 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f32849ad640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e8832e70 0x5635e8831b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f32849ad640 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e8832e70 0x5635e8831b80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33b70a971d550cfe server_cookie=c9b69a52bfc4747 in_seq=0 out_seq=0 2024-04-21T10:21:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.616+0000 7f325ffff640 10 client.15291 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f325ffff640 1 -- 172.21.15.77:0/2098450788 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5635e871e3a0 con 0x5635e8832e70 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f325ffff640 10 client.15291 handle_command_reply: tid=0 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 client.15291 shutdown 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 msgr2=0x5635e87c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c1270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f326c009230 tx=0x7f326c003b60 comp rx=0 tx=0).stop 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 shutdown_connections 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5635e8832e70 0x5635e8831b80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635e87b2830 0x5635e87c1270 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f325ffff640 0 client.15291 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635e87b32d0 0x5635e882cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 --2- 172.21.15.77:0/2098450788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5635e87b1e40 0x5635e87abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 >> 172.21.15.77:0/2098450788 conn(0x5635e87adf40 msgr2=0x5635e87b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 shutdown_connections 2024-04-21T10:21:15.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 1 -- 172.21.15.77:0/2098450788 wait complete. 2024-04-21T10:21:15.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3289801740 20 client.15291 trim_cache size 0 max 16384 2024-04-21T10:21:15.627 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:15.627 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:21:15.627 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-04-21T10:21:15.627 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24505, 2024-04-21T10:21:15.627 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:21:15.627 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 112.112975319, 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 87, 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 127.495218432 2024-04-21T10:21:15.628 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f32700a3c30 msgr2=0x7f32700a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f32700a3c30 0x7f32700a60f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f32740058c0 tx=0x7f3274005850 comp rx=0 tx=0).stop 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 msgr2=0x7f328019f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 0x7f328019f780 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f327800eaa0 tx=0x7f327800ef60 comp rx=0 tx=0).stop 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 shutdown_connections 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f32700a3c30 0x7f32700a60f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3280103b50 0x7f328019f780 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3280103190 0x7f3280198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 --2- 172.21.15.77:0/2229088391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3280101fa0 0x7f32801981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.617+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 >> 172.21.15.77:0/2229088391 conn(0x7f32800fd530 msgr2=0x7f3280106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.618+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 shutdown_connections 2024-04-21T10:21:15.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.618+0000 7f3286c11640 1 -- 172.21.15.77:0/2229088391 wait complete. 2024-04-21T10:21:15.631 INFO:teuthology.run_tasks:Running task sequential... 2024-04-21T10:21:15.641 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-21T10:21:15.642 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-21T10:21:15.642 INFO:teuthology.task.print:Enabling mgr modules 2024-04-21T10:21:15.642 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-21T10:21:15.643 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T10:21:15.643 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:21:15.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-21T10:21:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.741+0000 7fde21ec1640 1 -- 172.21.15.77:0/1895107822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c102a90 msgr2=0x7fde1c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.741+0000 7fde21ec1640 1 --2- 172.21.15.77:0/1895107822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c102a90 0x7fde1c104e80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fde10009900 tx=0x7fde1002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.741+0000 7fde21ec1640 1 -- 172.21.15.77:0/1895107822 shutdown_connections 2024-04-21T10:21:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.741+0000 7fde21ec1640 1 --2- 172.21.15.77:0/1895107822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde1c107cf0 0x7fde1c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 --2- 172.21.15.77:0/1895107822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde1c1053c0 0x7fde1c1077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 --2- 172.21.15.77:0/1895107822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c102a90 0x7fde1c104e80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- 172.21.15.77:0/1895107822 >> 172.21.15.77:0/1895107822 conn(0x7fde1c0fc420 msgr2=0x7fde1c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- 172.21.15.77:0/1895107822 shutdown_connections 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- 172.21.15.77:0/1895107822 wait complete. 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 Processor -- start 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- start start 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde1c102a90 0x7fde1c1981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde1c1053c0 0x7fde1c1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 0x7fde1c19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c10daf0 con 0x7fde1c107cf0 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c10d970 con 0x7fde1c102a90 2024-04-21T10:21:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde21ec1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c10dc70 con 0x7fde1c1053c0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.742+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 0x7fde1c19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 0x7fde1c19f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47824/0 (socket says 172.21.15.77:47824) 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 -- 172.21.15.77:0/2286411492 learned_addr learned my addr 172.21.15.77:0/2286411492 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1b7fe640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde1c102a90 0x7fde1c1981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1affd640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde1c1053c0 0x7fde1c1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 -- 172.21.15.77:0/2286411492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde1c1053c0 msgr2=0x7fde1c1986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde1c1053c0 0x7fde1c1986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 -- 172.21.15.77:0/2286411492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde1c102a90 msgr2=0x7fde1c1981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde1c102a90 0x7fde1c1981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 -- 172.21.15.77:0/2286411492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c19fdc0 con 0x7fde1c107cf0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde1bfff640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 0x7fde1c19f750 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fde1400cad0 tx=0x7fde1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400ae20 con 0x7fde1c107cf0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde14005020 con 0x7fde1c107cf0 2024-04-21T10:21:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1c1a00b0 con 0x7fde1c107cf0 2024-04-21T10:21:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400f6b0 con 0x7fde1c107cf0 2024-04-21T10:21:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.743+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1c1a0600 con 0x7fde1c107cf0 2024-04-21T10:21:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.744+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1c0fdf10 con 0x7fde1c107cf0 2024-04-21T10:21:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.745+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fde140051d0 con 0x7fde1c107cf0 2024-04-21T10:21:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.746+0000 7fde18ff9640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde040a3c50 0x7fde040a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.746+0000 7fde1b7fe640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde040a3c50 0x7fde040a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.746+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fde140d0740 con 0x7fde1c107cf0 2024-04-21T10:21:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.746+0000 7fde1b7fe640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde040a3c50 0x7fde040a6110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fde10009230 tx=0x7fde10005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.749+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde14014030 con 0x7fde1c107cf0 2024-04-21T10:21:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:15.977+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fde1c02d5c0 con 0x7fde1c107cf0 2024-04-21T10:21:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:15 smithi077 ceph-mon[27902]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:21:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:15 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3069213762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:15 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3424369393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:15 smithi191 ceph-mon[31636]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:21:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:15 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3069213762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:15 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3424369393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:16.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:15 smithi170 ceph-mon[31212]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T10:21:16.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:15 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3069213762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:16.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:15 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3424369393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:16.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.887+0000 7fde18ff9640 1 -- 172.21.15.77:0/2286411492 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fde1409d130 con 0x7fde1c107cf0 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.889+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde040a3c50 msgr2=0x7fde040a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde040a3c50 0x7fde040a6110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fde10009230 tx=0x7fde10005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 msgr2=0x7fde1c19f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 0x7fde1c19f750 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fde1400cad0 tx=0x7fde1400cf90 comp rx=0 tx=0).stop 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 shutdown_connections 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fde040a3c50 0x7fde040a6110 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c107cf0 0x7fde1c19f750 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde1c1053c0 0x7fde1c1986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 --2- 172.21.15.77:0/2286411492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde1c102a90 0x7fde1c1981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:16.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 >> 172.21.15.77:0/2286411492 conn(0x7fde1c0fc420 msgr2=0x7fde1c1033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 shutdown_connections 2024-04-21T10:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:16.890+0000 7fde21ec1640 1 -- 172.21.15.77:0/2286411492 wait complete. 2024-04-21T10:21:16.910 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-21T10:21:17.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 -- 172.21.15.77:0/2169948914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 msgr2=0x7f676810a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 --2- 172.21.15.77:0/2169948914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676810a0e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6760009900 tx=0x7f676002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:17.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 -- 172.21.15.77:0/2169948914 shutdown_connections 2024-04-21T10:21:17.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 --2- 172.21.15.77:0/2169948914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676810a0e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 --2- 172.21.15.77:0/2169948914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6768105360 0x7f6768107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 --2- 172.21.15.77:0/2169948914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768102a30 0x7f6768104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 -- 172.21.15.77:0/2169948914 >> 172.21.15.77:0/2169948914 conn(0x7f67680fc420 msgr2=0x7f67680fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 -- 172.21.15.77:0/2169948914 shutdown_connections 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.030+0000 7f676e08c640 1 -- 172.21.15.77:0/2169948914 wait complete. 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 Processor -- start 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 -- start start 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6768102a30 0x7f6768198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768105360 0x7f67681986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f676810daf0 con 0x7f6768107c90 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f676810d970 con 0x7f6768102a30 2024-04-21T10:21:17.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f676e08c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f676810dc70 con 0x7f6768105360 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f6767fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f6767fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676819f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47848/0 (socket says 172.21.15.77:47848) 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f6767fff640 1 -- 172.21.15.77:0/2095198041 learned_addr learned my addr 172.21.15.77:0/2095198041 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f67677fe640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6768102a30 0x7f6768198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.031+0000 7f6766ffd640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768105360 0x7f67681986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6767fff640 1 -- 172.21.15.77:0/2095198041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768105360 msgr2=0x7f67681986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6767fff640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768105360 0x7f67681986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6767fff640 1 -- 172.21.15.77:0/2095198041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6768102a30 msgr2=0x7f6768198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6767fff640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6768102a30 0x7f6768198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6767fff640 1 -- 172.21.15.77:0/2095198041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676819fd60 con 0x7f6768107c90 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6766ffd640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768105360 0x7f67681986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6767fff640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676819f6f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6760009230 tx=0x7f6760005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760043020 con 0x7f6768107c90 2024-04-21T10:21:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676819fff0 con 0x7f6768107c90 2024-04-21T10:21:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67600043d0 con 0x7f6768107c90 2024-04-21T10:21:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760003af0 con 0x7f6768107c90 2024-04-21T10:21:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.032+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681a0500 con 0x7f6768107c90 2024-04-21T10:21:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.033+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67680fdf10 con 0x7f6768107c90 2024-04-21T10:21:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.035+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f6760046020 con 0x7f6768107c90 2024-04-21T10:21:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.035+0000 7f6764ff9640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f67500a3ca0 0x7f67500a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.035+0000 7f67677fe640 1 -- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f67500a3ca0 msgr2=0x7f67500a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.035+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f67600f2980 con 0x7f6768107c90 2024-04-21T10:21:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.035+0000 7f67677fe640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f67500a3ca0 0x7f67500a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:21:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.039+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f676004d020 con 0x7f6768107c90 2024-04-21T10:21:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:16 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2286411492' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-21T10:21:17.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:16 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: ignoring --setuser ceph since I am not root 2024-04-21T10:21:17.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:16 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: ignoring --setgroup ceph since I am not root 2024-04-21T10:21:17.136 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:17.088+0000 7f0720892200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:21:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:16 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2286411492' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-21T10:21:17.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:16 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: ignoring --setuser ceph since I am not root 2024-04-21T10:21:17.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:16 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: ignoring --setgroup ceph since I am not root 2024-04-21T10:21:17.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:16 smithi191 ceph-mgr[33487]: -- 172.21.15.191:0/3372564617 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556bfff1a5a0 con 0x556bffeee800 2024-04-21T10:21:17.218 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:17.069+0000 7f613585f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:21:17.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.224+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f676802d5c0 con 0x7f6768107c90 2024-04-21T10:21:17.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.228+0000 7f6764ff9640 1 -- 172.21.15.77:0/2095198041 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f67600a9020 con 0x7f6768107c90 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f67500a3ca0 msgr2=0x7f67500a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f67500a3ca0 0x7f67500a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 msgr2=0x7f676819f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676819f6f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6760009230 tx=0x7f6760005e40 comp rx=0 tx=0).stop 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 shutdown_connections 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f67500a3ca0 0x7f67500a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6768107c90 0x7f676819f6f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6768105360 0x7f67681986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 --2- 172.21.15.77:0/2095198041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6768102a30 0x7f6768198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 >> 172.21.15.77:0/2095198041 conn(0x7f67680fc420 msgr2=0x7f6768103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 shutdown_connections 2024-04-21T10:21:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.231+0000 7f676e08c640 1 -- 172.21.15.77:0/2095198041 wait complete. 2024-04-21T10:21:17.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-21T10:21:17.246 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:16 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2286411492' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-21T10:21:17.246 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:16 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: ignoring --setuser ceph since I am not root 2024-04-21T10:21:17.246 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:16 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: ignoring --setgroup ceph since I am not root 2024-04-21T10:21:17.246 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:16 smithi170 ceph-mgr[32597]: -- 172.21.15.170:0/2603964024 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561920565a0 con 0x55619202b000 2024-04-21T10:21:17.246 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:17.064+0000 7f0e2e401200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T10:21:17.246 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:17.246+0000 7f0e2e401200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- 172.21.15.77:0/3102452795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004105360 msgr2=0x7f4004107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- 172.21.15.77:0/3102452795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004105360 0x7f4004107750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009900 tx=0x7f3fec02bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- 172.21.15.77:0/3102452795 shutdown_connections 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- 172.21.15.77:0/3102452795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004105360 0x7f4004107750 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- 172.21.15.77:0/3102452795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004107c90 0x7f400410a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- 172.21.15.77:0/3102452795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4004102a30 0x7f4004104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- 172.21.15.77:0/3102452795 >> 172.21.15.77:0/3102452795 conn(0x7f40040fc420 msgr2=0x7f40040fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- 172.21.15.77:0/3102452795 shutdown_connections 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- 172.21.15.77:0/3102452795 wait complete. 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 Processor -- start 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- start start 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004102a30 0x7f4004198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4004105360 0x7f4004198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 0x7f400419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f400410daf0 con 0x7f4004107c90 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f400410d970 con 0x7f4004105360 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.343+0000 7f400ab32640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f400410dc70 con 0x7f4004102a30 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 0x7f400419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 0x7f400419f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47870/0 (socket says 172.21.15.77:47870) 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40088ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004102a30 0x7f4004198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 -- 172.21.15.77:0/391662072 learned_addr learned my addr 172.21.15.77:0/391662072 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f4003fff640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4004105360 0x7f4004198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 -- 172.21.15.77:0/391662072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004102a30 msgr2=0x7f4004198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004102a30 0x7f4004198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 -- 172.21.15.77:0/391662072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4004105360 msgr2=0x7f4004198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4004105360 0x7f4004198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 -- 172.21.15.77:0/391662072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400419fd60 con 0x7f4004107c90 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40088ce640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004102a30 0x7f4004198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f40090cf640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 0x7f400419f6f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400e970 tx=0x7f3ff400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff400ccc0 con 0x7f4004107c90 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ff400ce60 con 0x7f4004107c90 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400419fff0 con 0x7f4004107c90 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4010430 con 0x7f4004107c90 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.344+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40041a0560 con 0x7f4004107c90 2024-04-21T10:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.346+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40040fdf10 con 0x7f4004107c90 2024-04-21T10:21:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.346+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f3ff4004f90 con 0x7f4004107c90 2024-04-21T10:21:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.347+0000 7f4001ffb640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3ff00a3d20 0x7f3ff00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.347+0000 7f40088ce640 1 -- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3ff00a3d20 msgr2=0x7f3ff00a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.347+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f3ff40d06f0 con 0x7f4004107c90 2024-04-21T10:21:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.347+0000 7f40088ce640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3ff00a3d20 0x7f3ff00a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:21:17.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.351+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ff409d0e0 con 0x7f4004107c90 2024-04-21T10:21:17.519 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:17.279+0000 7f0720892200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:21:17.520 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:17.387+0000 7f0720892200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:21:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.537+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f4004062b50 con 0x7f4004107c90 2024-04-21T10:21:17.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.541+0000 7f4001ffb640 1 -- 172.21.15.77:0/391662072 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f3ff409c9e0 con 0x7f4004107c90 2024-04-21T10:21:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3ff00a3d20 msgr2=0x7f3ff00a61e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:21:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3ff00a3d20 0x7f3ff00a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 msgr2=0x7f400419f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 0x7f400419f6f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400e970 tx=0x7f3ff400ed70 comp rx=0 tx=0).stop 2024-04-21T10:21:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 shutdown_connections 2024-04-21T10:21:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7f3ff00a3d20 0x7f3ff00a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4004107c90 0x7f400419f6f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4004105360 0x7f4004198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 --2- 172.21.15.77:0/391662072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4004102a30 0x7f4004198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 >> 172.21.15.77:0/391662072 conn(0x7f40040fc420 msgr2=0x7f4004103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 shutdown_connections 2024-04-21T10:21:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:17.543+0000 7f400ab32640 1 -- 172.21.15.77:0/391662072 wait complete. 2024-04-21T10:21:17.554 INFO:teuthology.run_tasks:Running task kclient... 2024-04-21T10:21:17.582 INFO:tasks.kclient:Mounting kernel clients... 2024-04-21T10:21:17.582 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-21T10:21:17.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:17.583 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-21T10:21:17.583 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:17.347+0000 7f0e2e401200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:21:17.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:17.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-04-21T10:21:17.662 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:17.252+0000 7f613585f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:21:17.662 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:17.355+0000 7f613585f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T10:21:17.662 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:17.662+0000 7f613585f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:21:17.665 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-04-21T10:21:17.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T10:21:17.667 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-04-21T10:21:17.668 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-21T10:21:17.668 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-04-21T10:21:17.668 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-04-21T10:21:17.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a630765c1f93c6e61d9b40c4b76437611d5ef29e shell --fsid 41617fb2-ffc7-11ee-bc93-c7b262605968 -- ceph fs ls 2024-04-21T10:21:17.827 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:17.739+0000 7f0720892200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:21:17.827 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:17.827+0000 7f0720892200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:21:17.951 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/mon.a/config 2024-04-21T10:21:17.968 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:17.748+0000 7f613585f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:21:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2286411492' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-21T10:21:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-mon[31636]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-21T10:21:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2095198041' entity='client.admin' 2024-04-21T10:21:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:17 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/391662072' entity='client.admin' 2024-04-21T10:21:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2286411492' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-21T10:21:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-mon[31212]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-21T10:21:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2095198041' entity='client.admin' 2024-04-21T10:21:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/391662072' entity='client.admin' 2024-04-21T10:21:18.057 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:17.653+0000 7f0e2e401200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T10:21:18.057 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:17 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:17.736+0000 7f0e2e401200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T10:21:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2286411492' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-21T10:21:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-mon[27902]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-21T10:21:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2095198041' entity='client.admin' 2024-04-21T10:21:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:17 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/391662072' entity='client.admin' 2024-04-21T10:21:19.219 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:18 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:18.920+0000 7f613585f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:21:19.219 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:19 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:19.091+0000 7f613585f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:21:19.238 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:18 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:18.903+0000 7f0e2e401200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:21:19.239 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:19 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:19.070+0000 7f0e2e401200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:21:19.239 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:19 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:19.238+0000 7f0e2e401200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:21:19.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:19 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:19.051+0000 7f0720892200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T10:21:19.385 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:19 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:19.225+0000 7f0720892200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T10:21:19.549 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:19 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:19.261+0000 7f613585f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:21:19.696 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:19 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:19.400+0000 7f0720892200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.799+0000 7ff12fd69700 1 -- 172.21.15.77:0/2115088729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff128106cc0 msgr2=0x7ff12810e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.799+0000 7ff12fd69700 1 --2- 172.21.15.77:0/2115088729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff128106cc0 0x7ff12810e8d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff12000b0d0 tx=0x7ff12000b3e0 comp rx=0 tx=0).stop 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- 172.21.15.77:0/2115088729 shutdown_connections 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 --2- 172.21.15.77:0/2115088729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff128106cc0 0x7ff12810e8d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 --2- 172.21.15.77:0/2115088729 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1281023a0 0x7ff128102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 --2- 172.21.15.77:0/2115088729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff128102d50 0x7ff1281065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- 172.21.15.77:0/2115088729 >> 172.21.15.77:0/2115088729 conn(0x7ff128077fb0 msgr2=0x7ff1280ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- 172.21.15.77:0/2115088729 shutdown_connections 2024-04-21T10:21:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- 172.21.15.77:0/2115088729 wait complete. 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 Processor -- start 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- start start 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 0x7ff128197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff128102d50 0x7ff1281982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff128106cc0 0x7ff128198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111bc0 con 0x7ff1281023a0 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.800+0000 7ff12fd69700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111a40 con 0x7ff128106cc0 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12fd69700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111d40 con 0x7ff128102d50 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 0x7ff128197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 0x7ff128197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47884/0 (socket says 172.21.15.77:47884) 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 -- 172.21.15.77:0/4220689653 learned_addr learned my addr 172.21.15.77:0/4220689653 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12d304700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff128102d50 0x7ff1281982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12e306700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff128106cc0 0x7ff128198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 -- 172.21.15.77:0/4220689653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff128102d50 msgr2=0x7ff1281982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff128102d50 0x7ff1281982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 -- 172.21.15.77:0/4220689653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff128106cc0 msgr2=0x7ff128198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff128106cc0 0x7ff128198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 -- 172.21.15.77:0/4220689653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1281a75c0 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12db05700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 0x7ff128197db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d950 tx=0x7ff11800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118016070 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1281a78b0 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff11800fd40 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11800e3b0 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.801+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a7e40 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.802+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff128103150 con 0x7ff1281023a0 2024-04-21T10:21:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.803+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7ff118019070 con 0x7ff1281023a0 2024-04-21T10:21:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.804+0000 7ff11effd700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 0x7ff1140a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.804+0000 7ff12d304700 1 -- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 msgr2=0x7ff1140a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.804+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff1180d0210 con 0x7ff1281023a0 2024-04-21T10:21:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.804+0000 7ff12d304700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 0x7ff1140a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:21:19.808 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:19 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:19.524+0000 7f0e2e401200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:21:19.808 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:19 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:19.616+0000 7f0e2e401200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:21:19.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:19.808+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff11809cc00 con 0x7ff1281023a0 2024-04-21T10:21:19.847 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:19 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:19.550+0000 7f613585f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:21:19.847 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:19 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:19.643+0000 7f613585f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:21:19.847 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:19 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:19.847+0000 7f613585f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:21:20.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.005+0000 7ff12d304700 1 -- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 msgr2=0x7ff1140a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:20.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.005+0000 7ff12d304700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 0x7ff1140a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:21:20.004 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:19 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:19.699+0000 7f0720892200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T10:21:20.004 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:19 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:19.798+0000 7f0720892200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T10:21:20.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.063+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff12802df80 con 0x7ff1281023a0 2024-04-21T10:21:20.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.063+0000 7ff11effd700 1 -- 172.21.15.77:0/4220689653 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7ff11809c500 con 0x7ff1281023a0 2024-04-21T10:21:20.062 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-21T10:21:20.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 msgr2=0x7ff1140a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:21:20.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 0x7ff1140a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:20.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 msgr2=0x7ff128197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:20.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 0x7ff128197db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d950 tx=0x7ff11800dc60 comp rx=0 tx=0).stop 2024-04-21T10:21:20.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 shutdown_connections 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7ff1140a3c90 0x7ff1140a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff128106cc0 0x7ff128198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281023a0 0x7ff128197db0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 --2- 172.21.15.77:0/4220689653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff128102d50 0x7ff1281982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 >> 172.21.15.77:0/4220689653 conn(0x7ff128077fb0 msgr2=0x7ff128105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 shutdown_connections 2024-04-21T10:21:20.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20.065+0000 7ff12fd69700 1 -- 172.21.15.77:0/4220689653 wait complete. 2024-04-21T10:21:20.114 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:19 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:19.817+0000 7f0e2e401200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:21:20.114 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:20 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:20.010+0000 7f0e2e401200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:21:20.114 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:20 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:20.042+0000 7f613585f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:21:20.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4220689653' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-21T10:21:20.358 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:20 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:20.009+0000 7f0720892200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T10:21:20.358 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:20 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:20.216+0000 7f0720892200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T10:21:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4220689653' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-21T10:21:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4220689653' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-21T10:21:20.873 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-21T10:21:20.873 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-21T10:21:20.874 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-04-21T10:21:20.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:20.874 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-21T10:21:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42041sec preferred_lft 42041sec 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::bd99:3607:3039:b3f4/64 scope link noprefixroute 2024-04-21T10:21:20.892 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-21T10:21:20.893 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-21T10:21:20.893 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-21T10:21:20.968 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:20 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:20.639+0000 7f613585f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:21:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T10:21:21.018 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:20 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:20.604+0000 7f0e2e401200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:21:21.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:21.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:21.084 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-21T10:21:21.098 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:20 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:20.844+0000 7f0720892200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T10:21:21.108 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-04-21T10:21:21.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:21.110 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-04-21T10:21:21.177 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-04-21T10:21:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-21T10:21:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-21T10:21:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-21T10:21:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-21T10:21:21.178 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T10:21:21.179 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-21T10:21:21.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-21T10:21:21.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-21T10:21:21.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-21T10:21:21.179 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-21T10:21:21.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T10:21:21.306 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:21 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:21.018+0000 7f0e2e401200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:21:21.307 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:21 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:21.112+0000 7f0e2e401200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:21:21.350 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:21 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:21.305+0000 7f0720892200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:21:21.354 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:21 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:21.059+0000 7f613585f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T10:21:21.354 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:21 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:21.154+0000 7f613585f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:21:21.354 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:21 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:21.355+0000 7f613585f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:21:21.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:21.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:21.451 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-21T10:21:21.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:21.468 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-04-21T10:21:21.523 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T10:21:21.523 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-21T10:21:21.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--tmp-cephfs 2024-04-21T10:21:21.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-04-21T10:21:21.523 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-21T10:21:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T10:21:21.619 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:21 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:21.413+0000 7f0720892200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T10:21:21.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:21.640 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-04-21T10:21:21.640 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-04-21T10:21:21.641 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-21T10:21:21.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T10:21:21.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:21.761 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T10:21:21.761 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-21T10:21:21.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-04-21T10:21:21.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-04-21T10:21:21.762 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-21T10:21:21.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:21 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:21.312+0000 7f0e2e401200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:21:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T10:21:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:21.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T10:21:21.840 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /tmp/cephfs 2024-04-21T10:21:21.855 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/tmp/cephfs' 2024-04-21T10:21:21.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T10:21:21.855 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /tmp/cephfs 2024-04-21T10:21:21.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:21 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:21.635+0000 7f0720892200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T10:21:21.899 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-21T10:21:21.899 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-21T10:21:21.899 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/0d601c45-51df-451f-bb5e-994bae49327f 2024-04-21T10:21:21.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:21.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/0d601c45-51df-451f-bb5e-994bae49327f /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context=system_u:object_r:postgresql_db_t:s0 2024-04-21T10:21:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-04-21T10:21:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-04-21T10:21:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-21T10:21:22.109 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-04-21T10:21:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-04-21T10:21:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-21T10:21:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.170:3300,172.21.15.191:3300" 2024-04-21T10:21:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:3300,172.21.15.170:3300,172.21.15.191:3300:/volumes/qa/sv_1/0d601c45-51df-451f-bb5e-994bae49327f 2024-04-21T10:21:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=41617fb2-ffc7-11ee-bc93-c7b262605968" will pass to kernel 2024-04-21T10:21:22.112 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-21T10:21:22.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T10:21:22.112 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /tmp/cephfs 2024-04-21T10:21:22.136 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-21T10:21:22.159 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:21 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:21.831+0000 7f0e2e401200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:21:22.159 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:21 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:21.921+0000 7f0e2e401200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:21:22.207 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:21 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:21.875+0000 7f613585f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:21:22.208 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:21 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:21.966+0000 7f613585f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:21:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-21T10:21:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:client24824 2024-04-21T10:21:22.234 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-21T10:21:22.234 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T10:21:22.251 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-21T10:21:22.301 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:22.203+0000 7f0720892200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T10:21:22.301 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:22.302+0000 7f0720892200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T10:21:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-21T10:21:22.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:client24824 2024-04-21T10:21:22.348 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-21T10:21:22.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-21T10:21:22.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:22.446 INFO:teuthology.orchestra.run.smithi077.stdout:client24824 2024-04-21T10:21:22.447 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968.client24824/status') 2024-04-21T10:21:22.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:22 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:22.208+0000 7f613585f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:21:22.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:22 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:22.341+0000 7f613585f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:21:22.468 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:22 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:22.434+0000 7f613585f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:21:22.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T10:21:22.497 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:22 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:22.160+0000 7f0e2e401200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:21:22.497 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:22 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:22.291+0000 7f0e2e401200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:21:22.497 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:22 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:22.385+0000 7f0e2e401200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:21:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.24824 (3)172.21.15.77:0/2611891737 2024-04-21T10:21:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2024-04-21T10:21:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2024-04-21T10:21:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2024-04-21T10:21:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:71 bytes copied, 2.6994e-05 s, 2.6 MB/s 2024-04-21T10:21:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T10:21:22.513 INFO:teuthology.run_tasks:Running task exec... 2024-04-21T10:21:22.522 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T10:21:22.522 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:21:22.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-21T10:21:22.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/3294192160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8102a00 msgr2=0x7fc3e8109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:22.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/3294192160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8102a00 0x7fc3e8109320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009ca0 tx=0x7fc3e002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/3294192160 shutdown_connections 2024-04-21T10:21:22.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/3294192160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8102a00 0x7fc3e8109320 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/3294192160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e8102040 0x7fc3e81024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/3294192160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e8100e60 0x7fc3e8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/3294192160 >> 172.21.15.77:0/3294192160 conn(0x7fc3e80fc420 msgr2=0x7fc3e80fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/3294192160 shutdown_connections 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.625+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/3294192160 wait complete. 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 Processor -- start 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 -- start start 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 0x7fc3e8198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e8102040 0x7fc3e8198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e8102a00 0x7fc3e819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e810ca00 con 0x7fc3e8100e60 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e810c880 con 0x7fc3e8102a00 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ef9e6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e810cb80 con 0x7fc3e8102040 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ed782640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 0x7fc3e8198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ed782640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 0x7fc3e8198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33728/0 (socket says 172.21.15.77:33728) 2024-04-21T10:21:22.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ed782640 1 -- 172.21.15.77:0/2496098596 learned_addr learned my addr 172.21.15.77:0/2496098596 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3ecf81640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e8102040 0x7fc3e8198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.626+0000 7fc3edf83640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e8102a00 0x7fc3e819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ed782640 1 -- 172.21.15.77:0/2496098596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e8102040 msgr2=0x7fc3e8198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ed782640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e8102040 0x7fc3e8198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ed782640 1 -- 172.21.15.77:0/2496098596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e8102a00 msgr2=0x7fc3e819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ed782640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e8102a00 0x7fc3e819f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ed782640 1 -- 172.21.15.77:0/2496098596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e819fd30 con 0x7fc3e8100e60 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ed782640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 0x7fc3e8198110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800d950 tx=0x7fc3d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8017020 con 0x7fc3e8100e60 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3d8009c30 con 0x7fc3e8100e60 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e819ffc0 con 0x7fc3e8100e60 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800f6b0 con 0x7fc3e8100e60 2024-04-21T10:21:22.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.627+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e81a0480 con 0x7fc3e8100e60 2024-04-21T10:21:22.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.628+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e81a0740 con 0x7fc3e8100e60 2024-04-21T10:21:22.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.630+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fc3d801a020 con 0x7fc3e8100e60 2024-04-21T10:21:22.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.630+0000 7fc3de7fc640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 0x7fc3d40a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:22.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.630+0000 7fc3ecf81640 1 -- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 msgr2=0x7fc3d40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:22.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.630+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc3d80d0010 con 0x7fc3e8100e60 2024-04-21T10:21:22.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.630+0000 7fc3ecf81640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 0x7fc3d40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:21:22.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.635+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc3d8009de0 con 0x7fc3e8100e60 2024-04-21T10:21:22.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.831+0000 7fc3ecf81640 1 -- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 msgr2=0x7fc3d40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:22.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.831+0000 7fc3ecf81640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 0x7fc3d40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:21:22.853 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:22 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:22.550+0000 7f613585f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:21:22.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.859+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fc3e81a0f40 con 0x7fc3e8100e60 2024-04-21T10:21:22.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:22.562+0000 7f0720892200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T10:21:22.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:22.704+0000 7f0720892200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T10:21:22.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:22.803+0000 7f0720892200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T10:21:22.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.911+0000 7fc3de7fc640 1 -- 172.21.15.77:0/2496098596 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7fc3d809ca00 con 0x7fc3e8100e60 2024-04-21T10:21:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.913+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 msgr2=0x7fc3d40a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:21:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.913+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 0x7fc3d40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.913+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 msgr2=0x7fc3e8198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.913+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 0x7fc3e8198110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800d950 tx=0x7fc3d800de10 comp rx=0 tx=0).stop 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 shutdown_connections 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fc3d40a3ca0 0x7fc3d40a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e8102a00 0x7fc3e819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e8102040 0x7fc3e8198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 --2- 172.21.15.77:0/2496098596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e8100e60 0x7fc3e8198110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 >> 172.21.15.77:0/2496098596 conn(0x7fc3e80fc420 msgr2=0x7fc3e80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 shutdown_connections 2024-04-21T10:21:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:22.914+0000 7fc3ef9e6640 1 -- 172.21.15.77:0/2496098596 wait complete. 2024-04-21T10:21:22.924 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-21T10:21:22.936 INFO:teuthology.run_tasks:Running task exec... 2024-04-21T10:21:22.945 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T10:21:22.945 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:21:22.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 -- 172.21.15.77:0/565061634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394102a00 msgr2=0x7fe394109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 --2- 172.21.15.77:0/565061634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394102a00 0x7fe394109320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009ca0 tx=0x7fe38c02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 -- 172.21.15.77:0/565061634 shutdown_connections 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 --2- 172.21.15.77:0/565061634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394102a00 0x7fe394109320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 --2- 172.21.15.77:0/565061634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe394102040 0x7fe3941024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 --2- 172.21.15.77:0/565061634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe394100e60 0x7fe394101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 -- 172.21.15.77:0/565061634 >> 172.21.15.77:0/565061634 conn(0x7fe3940fc420 msgr2=0x7fe3940fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 -- 172.21.15.77:0/565061634 shutdown_connections 2024-04-21T10:21:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 -- 172.21.15.77:0/565061634 wait complete. 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.051+0000 7fe399e11640 1 Processor -- start 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 -- start start 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394100e60 0x7fe394198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe394102040 0x7fe394198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe394102a00 0x7fe39419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe39410ca00 con 0x7fe394100e60 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe39410c880 con 0x7fe394102040 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe399e11640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe39410cb80 con 0x7fe394102a00 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe3937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394100e60 0x7fe394198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe3937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394100e60 0x7fe394198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33754/0 (socket says 172.21.15.77:33754) 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe3937fe640 1 -- 172.21.15.77:0/1041508124 learned_addr learned my addr 172.21.15.77:0/1041508124 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe394102040 0x7fe394198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe393fff640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe394102a00 0x7fe39419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe394102a00 msgr2=0x7fe39419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe394102a00 0x7fe39419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394100e60 msgr2=0x7fe394198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394100e60 0x7fe394198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 -- 172.21.15.77:0/1041508124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39419fd10 con 0x7fe394102040 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe3937fe640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe394100e60 0x7fe394198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.052+0000 7fe392ffd640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe394102040 0x7fe394198680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe38400e9f0 tx=0x7fe38400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.053+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38400ccc0 con 0x7fe394102040 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.053+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe384005020 con 0x7fe394102040 2024-04-21T10:21:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.053+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39419ffa0 con 0x7fe394102040 2024-04-21T10:21:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.053+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384004a00 con 0x7fe394102040 2024-04-21T10:21:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.053+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3941a0470 con 0x7fe394102040 2024-04-21T10:21:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.054+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3941a0700 con 0x7fe394102040 2024-04-21T10:21:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.055+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fe384004ba0 con 0x7fe394102040 2024-04-21T10:21:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.055+0000 7fe390ff9640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 0x7fe37c0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.055+0000 7fe3937fe640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 msgr2=0x7fe37c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.055+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe3840d04d0 con 0x7fe394102040 2024-04-21T10:21:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.055+0000 7fe3937fe640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 0x7fe37c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T10:21:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:22 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2496098596' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-21T10:21:23.057 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:22 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:22.498+0000 7f0e2e401200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:21:23.058 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:22 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:22.802+0000 7f0e2e401200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:21:23.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.059+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe384042e20 con 0x7fe394102040 2024-04-21T10:21:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:22 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2496098596' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-21T10:21:23.219 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:22 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:22.854+0000 7f613585f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:21:23.242 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2496098596' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-21T10:21:23.243 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:22 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:22.926+0000 7f0720892200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T10:21:23.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.256+0000 7fe3937fe640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 msgr2=0x7fe37c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:23.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.256+0000 7fe3937fe640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 0x7fe37c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T10:21:23.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.268+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 --> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe3941a08d0 con 0x7fe37c0a3ca0 2024-04-21T10:21:23.635 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:23.243+0000 7f0720892200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T10:21:23.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.656+0000 7fe3937fe640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 msgr2=0x7fe37c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3235809387 2024-04-21T10:21:23.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.656+0000 7fe3937fe640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 0x7fe37c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T10:21:23.718 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:23.456+0000 7f613585f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:21:23.718 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-z[33483]: 2024-04-21T10:21:23.674+0000 7f613585f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:21:23.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:23.400+0000 7f0e2e401200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:21:23.806 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-y[32593]: 2024-04-21T10:21:23.615+0000 7f0e2e401200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:21:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:23.931+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 20) ==== 138663+0+0 (secure 0 0 0) 0x7fe384098e30 con 0x7fe394102040 2024-04-21T10:21:24.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:24.093+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 8 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7fe3840ce030 con 0x7fe394102040 2024-04-21T10:21:24.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:24.093+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 msgr2=0x7fe37c0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:21:24.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:24.093+0000 7fe390ff9640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3235809387,v1:172.21.15.77:6801/3235809387] conn(0x7fe37c0a3ca0 0x7fe37c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:24.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:23.854+0000 7f0720892200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T10:21:24.135 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.079+0000 7f0720892200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T10:21:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2496098596' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-21T10:21:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: Standby manager daemon y restarted 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: Standby manager daemon y started 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: Standby manager daemon z restarted 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: Standby manager daemon z started 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T10:21:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:23 smithi077 ceph-mon[27902]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:21:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2496098596' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: Standby manager daemon y restarted 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: Standby manager daemon y started 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: Standby manager daemon z restarted 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: Standby manager daemon z started 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T10:21:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:23 smithi191 ceph-mon[31636]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:21:24.236 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2496098596' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-21T10:21:24.236 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: Standby manager daemon y restarted 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: Standby manager daemon y started 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.170:0/1729075027' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: Standby manager daemon z restarted 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: Standby manager daemon z started 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T10:21:24.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:23 smithi170 ceph-mon[31212]: from='mgr.? 172.21.15.191:0/2066241513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T10:21:24.635 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f0682a0b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f0682a0b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f0682a0b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f0682a0b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f0682a0b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f067fa05700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f067fa05700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f067fa05700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f067fa05700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:24.636 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:21:24.326+0000 7f067fa05700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:21:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.100+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mon.2 v2:172.21.15.170:3300/0 9 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fe38404bed0 con 0x7fe394102040 2024-04-21T10:21:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.101+0000 7fe390ff9640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe37c035660 0x7fe37c035a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.101+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe3840d0320 con 0x7fe37c035660 2024-04-21T10:21:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.104+0000 7fe3937fe640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe37c035660 0x7fe37c035a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.106+0000 7fe3937fe640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe37c035660 0x7fe37c035a40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3880058c0 tx=0x7fe388005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:25.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.165+0000 7fe390ff9640 1 -- 172.21.15.77:0/1041508124 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe3840d0320 con 0x7fe37c035660 2024-04-21T10:21:25.165 INFO:teuthology.orchestra.run.smithi077.stdout:Schedule set for path / 2024-04-21T10:21:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe37c035660 msgr2=0x7fe37c035a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe37c035660 0x7fe37c035a40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3880058c0 tx=0x7fe388005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe394102040 msgr2=0x7fe394198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 --2- 172.21.15.77:0/1041508124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe394102040 0x7fe394198680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe38400e9f0 tx=0x7fe38400eeb0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe393fff640 1 -- 172.21.15.77:0/1041508124 reap_dead start 2024-04-21T10:21:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 shutdown_connections 2024-04-21T10:21:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 >> 172.21.15.77:0/1041508124 conn(0x7fe3940fc420 msgr2=0x7fe3940fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 shutdown_connections 2024-04-21T10:21:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.167+0000 7fe399e11640 1 -- 172.21.15.77:0/1041508124 wait complete. 2024-04-21T10:21:25.177 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: Active manager daemon x restarted 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: Activating manager daemon x 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: osdmap e88: 12 total, 12 up, 12 in 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: mgrmap e21: x(active, starting, since 0.0145947s), standbys: y, z 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T10:21:25.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:21:25.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: Manager daemon x is now available 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:21:25.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T10:21:25.181 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T10:21:25.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: Active manager daemon x restarted 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: Activating manager daemon x 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: osdmap e88: 12 total, 12 up, 12 in 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: mgrmap e21: x(active, starting, since 0.0145947s), standbys: y, z 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T10:21:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T10:21:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:21:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: Manager daemon x is now available 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T10:21:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T10:21:25.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/1545873724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 msgr2=0x7f6aac100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/1545873724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac100e90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009ca0 tx=0x7f6aa402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/1545873724 shutdown_connections 2024-04-21T10:21:25.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/1545873724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac100e90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/1545873724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aac100060 0x7f6aac1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/1545873724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac1024e0 0x7f6aac102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/1545873724 >> 172.21.15.77:0/1545873724 conn(0x7f6aac0fbbc0 msgr2=0x7f6aac0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/1545873724 shutdown_connections 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.284+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/1545873724 wait complete. 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 Processor -- start 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 -- start start 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac100060 0x7f6aac19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aac1024e0 0x7f6aac1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10fce0 con 0x7f6aac100a20 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10fb60 con 0x7f6aac1024e0 2024-04-21T10:21:25.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10fe60 con 0x7f6aac100060 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33910/0 (socket says 172.21.15.77:33910) 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 -- 172.21.15.77:0/3736197737 learned_addr learned my addr 172.21.15.77:0/3736197737 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab1160640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aac1024e0 0x7f6aac1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab095f640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac100060 0x7f6aac19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 -- 172.21.15.77:0/3736197737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac100060 msgr2=0x7f6aac19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac100060 0x7f6aac19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 -- 172.21.15.77:0/3736197737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aac1024e0 msgr2=0x7f6aac1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aac1024e0 0x7f6aac1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 -- 172.21.15.77:0/3736197737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac1a1f20 con 0x7f6aac100a20 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab095f640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac100060 0x7f6aac19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aabfff640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac19a840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800e9f0 tx=0x7f6a9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800cd80 con 0x7f6aac100a20 2024-04-21T10:21:25.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a980108e0 con 0x7f6aac100a20 2024-04-21T10:21:25.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.285+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aac1a2210 con 0x7f6aac100a20 2024-04-21T10:21:25.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.286+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a98018980 con 0x7f6aac100a20 2024-04-21T10:21:25.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.286+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aac1a2760 con 0x7f6aac100a20 2024-04-21T10:21:25.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.287+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aac10be80 con 0x7f6aac100a20 2024-04-21T10:21:25.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.288+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f6a98010430 con 0x7f6aac100a20 2024-04-21T10:21:25.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.288+0000 7f6aa9ffb640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f6a9c0a3a60 0x7f6a9c0a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.288+0000 7f6ab095f640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f6a9c0a3a60 0x7f6a9c0a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.289+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f6a980d0970 con 0x7f6aac100a20 2024-04-21T10:21:25.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.289+0000 7f6ab095f640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f6a9c0a3a60 0x7f6a9c0a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0005d00 tx=0x7f6aa0005c70 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:25.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.292+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6a9809d550 con 0x7f6aac100a20 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: Active manager daemon x restarted 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: Activating manager daemon x 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: osdmap e88: 12 total, 12 up, 12 in 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: mgrmap e21: x(active, starting, since 0.0145947s), standbys: y, z 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T10:21:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T10:21:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T10:21:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: Manager daemon x is now available 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T10:21:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T10:21:25.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.501+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f6aac062390 con 0x7f6a9c0a3a60 2024-04-21T10:21:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.554+0000 7f6aa9ffb640 1 -- 172.21.15.77:0/3736197737 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f6aac062390 con 0x7f6a9c0a3a60 2024-04-21T10:21:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:Retention added to path / 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.556+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f6a9c0a3a60 msgr2=0x7f6a9c0a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.556+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f6a9c0a3a60 0x7f6a9c0a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0005d00 tx=0x7f6aa0005c70 comp rx=0 tx=0).stop 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.556+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 msgr2=0x7f6aac19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.556+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac19a840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800e9f0 tx=0x7f6a9800eeb0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 shutdown_connections 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f6a9c0a3a60 0x7f6a9c0a5f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aac100a20 0x7f6aac19a840 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aac1024e0 0x7f6aac1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 --2- 172.21.15.77:0/3736197737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6aac100060 0x7f6aac19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 >> 172.21.15.77:0/3736197737 conn(0x7f6aac0fbbc0 msgr2=0x7f6aac0fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 shutdown_connections 2024-04-21T10:21:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.557+0000 7f6ab2bc3640 1 -- 172.21.15.77:0/3736197737 wait complete. 2024-04-21T10:21:25.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 -- 172.21.15.77:0/924020000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f14101ff0 msgr2=0x7f7f14102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 --2- 172.21.15.77:0/924020000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f14101ff0 0x7f7f14102470 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009900 tx=0x7f7f0802bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 -- 172.21.15.77:0/924020000 shutdown_connections 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 --2- 172.21.15.77:0/924020000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f14101ff0 0x7f7f14102470 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 --2- 172.21.15.77:0/924020000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f141029b0 0x7f7f141092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 --2- 172.21.15.77:0/924020000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f14100ea0 0x7f7f141012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 -- 172.21.15.77:0/924020000 >> 172.21.15.77:0/924020000 conn(0x7f7f140fc410 msgr2=0x7f7f140fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 -- 172.21.15.77:0/924020000 shutdown_connections 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 -- 172.21.15.77:0/924020000 wait complete. 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.672+0000 7f7f18b52640 1 Processor -- start 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 -- start start 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f14100ea0 0x7f7f14104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f14101ff0 0x7f7f14103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 0x7f7f14103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410c9e0 con 0x7f7f141029b0 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410c860 con 0x7f7f14100ea0 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410cb60 con 0x7f7f14101ff0 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 0x7f7f14103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 0x7f7f14103a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33916/0 (socket says 172.21.15.77:33916) 2024-04-21T10:21:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f11d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f14101ff0 0x7f7f14103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 -- 172.21.15.77:0/547288957 learned_addr learned my addr 172.21.15.77:0/547288957 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f1259c640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f14100ea0 0x7f7f14104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 -- 172.21.15.77:0/547288957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f14101ff0 msgr2=0x7f7f14103530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f14101ff0 0x7f7f14103530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 -- 172.21.15.77:0/547288957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f14100ea0 msgr2=0x7f7f14104ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f14100ea0 0x7f7f14104ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 -- 172.21.15.77:0/547288957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f14104300 con 0x7f7f141029b0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f1259c640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f14100ea0 0x7f7f14104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f12d9d640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 0x7f7f14103a70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00eaa0 tx=0x7f7f0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00cdb0 con 0x7f7f141029b0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f0c005020 con 0x7f7f141029b0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0116d0 con 0x7f7f141029b0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.673+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f141a2250 con 0x7f7f141029b0 2024-04-21T10:21:25.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.674+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f141a2720 con 0x7f7f141029b0 2024-04-21T10:21:25.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.675+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1404fce0 con 0x7f7f141029b0 2024-04-21T10:21:25.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.676+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f7f0c0051d0 con 0x7f7f141029b0 2024-04-21T10:21:25.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.676+0000 7f7f037fe640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7efc0a3a60 0x7f7efc0a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:25.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.677+0000 7f7f1259c640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7efc0a3a60 0x7f7efc0a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:25.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.677+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f7f0c0d0330 con 0x7f7f141029b0 2024-04-21T10:21:25.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.677+0000 7f7f1259c640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7efc0a3a60 0x7f7efc0a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f040058c0 tx=0x7f7f04005850 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.681+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7f0c016030 con 0x7f7f141029b0 2024-04-21T10:21:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.891+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7f1406ae90 con 0x7f7efc0a3a60 2024-04-21T10:21:25.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.899+0000 7f7f037fe640 1 -- 172.21.15.77:0/547288957 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f7f1406ae90 con 0x7f7efc0a3a60 2024-04-21T10:21:25.899 INFO:teuthology.orchestra.run.smithi077.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-21T00:00:00", "created": "2024-04-21T10:21:25", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7efc0a3a60 msgr2=0x7f7efc0a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7efc0a3a60 0x7f7efc0a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f040058c0 tx=0x7f7f04005850 comp rx=0 tx=0).stop 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 msgr2=0x7f7f14103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 0x7f7f14103a70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00eaa0 tx=0x7f7f0c00ef60 comp rx=0 tx=0).stop 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 shutdown_connections 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7efc0a3a60 0x7f7efc0a5f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f141029b0 0x7f7f14103a70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f14101ff0 0x7f7f14103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 --2- 172.21.15.77:0/547288957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f14100ea0 0x7f7f14104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 >> 172.21.15.77:0/547288957 conn(0x7f7f140fc410 msgr2=0x7f7f1406a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 shutdown_connections 2024-04-21T10:21:25.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:25.902+0000 7f7f18b52640 1 -- 172.21.15.77:0/547288957 wait complete. 2024-04-21T10:21:25.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-21T10:21:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 -- 172.21.15.77:0/555575308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c1053e0 msgr2=0x7fe00c1077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 --2- 172.21.15.77:0/555575308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c1053e0 0x7fe00c1077d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe000009900 tx=0x7fe00002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 -- 172.21.15.77:0/555575308 shutdown_connections 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 --2- 172.21.15.77:0/555575308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c1053e0 0x7fe00c1077d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 --2- 172.21.15.77:0/555575308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe00c107d10 0x7fe00c10a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 --2- 172.21.15.77:0/555575308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe00c102ab0 0x7fe00c104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 -- 172.21.15.77:0/555575308 >> 172.21.15.77:0/555575308 conn(0x7fe00c0fc440 msgr2=0x7fe00c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 -- 172.21.15.77:0/555575308 shutdown_connections 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.029+0000 7fe0123f4640 1 -- 172.21.15.77:0/555575308 wait complete. 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 Processor -- start 2024-04-21T10:21:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 -- start start 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 0x7fe00c198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe00c1053e0 0x7fe00c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe00c107d10 0x7fe00c19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c10db10 con 0x7fe00c102ab0 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c10d990 con 0x7fe00c107d10 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe0123f4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c10dc90 con 0x7fe00c1053e0 2024-04-21T10:21:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 0x7fe00c198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 0x7fe00c198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33944/0 (socket says 172.21.15.77:33944) 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe00bfff640 1 -- 172.21.15.77:0/1481554694 learned_addr learned my addr 172.21.15.77:0/1481554694 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe010991640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe00c107d10 0x7fe00c19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.030+0000 7fe00b7fe640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe00c1053e0 0x7fe00c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe00bfff640 1 -- 172.21.15.77:0/1481554694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe00c1053e0 msgr2=0x7fe00c198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe00bfff640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe00c1053e0 0x7fe00c198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe00bfff640 1 -- 172.21.15.77:0/1481554694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe00c107d10 msgr2=0x7fe00c19f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe00bfff640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe00c107d10 0x7fe00c19f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe00bfff640 1 -- 172.21.15.77:0/1481554694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c19fd60 con 0x7fe00c102ab0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe00bfff640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 0x7fe00c198140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9f0 tx=0x7fdffc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00cd80 con 0x7fe00c102ab0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c19fff0 con 0x7fe00c102ab0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdffc0108e0 con 0x7fe00c102ab0 2024-04-21T10:21:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc018980 con 0x7fe00c102ab0 2024-04-21T10:21:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.031+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c1a04b0 con 0x7fe00c102ab0 2024-04-21T10:21:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.032+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c0fdf30 con 0x7fe00c102ab0 2024-04-21T10:21:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.033+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fdffc010430 con 0x7fe00c102ab0 2024-04-21T10:21:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.033+0000 7fe0097fa640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdff40a3a60 0x7fdff40a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.034+0000 7fe00b7fe640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdff40a3a60 0x7fdff40a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.034+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdffc0d03a0 con 0x7fe00c102ab0 2024-04-21T10:21:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.034+0000 7fe00b7fe640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdff40a3a60 0x7fdff40a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe000005ab0 tx=0x7fe000005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.038+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdffc09c930 con 0x7fe00c102ab0 2024-04-21T10:21:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:25 smithi191 ceph-mon[31636]: [21/Apr/2024:10:21:24] ENGINE Bus STARTING 2024-04-21T10:21:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:25 smithi191 ceph-mon[31636]: [21/Apr/2024:10:21:24] ENGINE Serving on https://172.21.15.77:7150 2024-04-21T10:21:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:25 smithi191 ceph-mon[31636]: [21/Apr/2024:10:21:24] ENGINE Serving on http://172.21.15.77:8765 2024-04-21T10:21:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:25 smithi191 ceph-mon[31636]: [21/Apr/2024:10:21:24] ENGINE Bus STARTED 2024-04-21T10:21:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:25 smithi191 ceph-mon[31636]: mgrmap e22: x(active, since 1.01954s), standbys: y, z 2024-04-21T10:21:26.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.273+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fe00c062390 con 0x7fdff40a3a60 2024-04-21T10:21:26.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.280+0000 7fe0097fa640 1 -- 172.21.15.77:0/1481554694 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fe00c062390 con 0x7fdff40a3a60 2024-04-21T10:21:26.279 INFO:teuthology.orchestra.run.smithi077.stdout:/ 1m 6m3h 2024-04-21T10:21:26.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdff40a3a60 msgr2=0x7fdff40a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdff40a3a60 0x7fdff40a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe000005ab0 tx=0x7fe000005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 msgr2=0x7fe00c198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 0x7fe00c198140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9f0 tx=0x7fdffc00eeb0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 shutdown_connections 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdff40a3a60 0x7fdff40a5f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe00c107d10 0x7fe00c19f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe00c1053e0 0x7fe00c198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 --2- 172.21.15.77:0/1481554694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe00c102ab0 0x7fe00c198140 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 >> 172.21.15.77:0/1481554694 conn(0x7fe00c0fc440 msgr2=0x7fe00c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 shutdown_connections 2024-04-21T10:21:26.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.282+0000 7fe0123f4640 1 -- 172.21.15.77:0/1481554694 wait complete. 2024-04-21T10:21:26.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:25 smithi077 ceph-mon[27902]: [21/Apr/2024:10:21:24] ENGINE Bus STARTING 2024-04-21T10:21:26.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:25 smithi077 ceph-mon[27902]: [21/Apr/2024:10:21:24] ENGINE Serving on https://172.21.15.77:7150 2024-04-21T10:21:26.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:25 smithi077 ceph-mon[27902]: [21/Apr/2024:10:21:24] ENGINE Serving on http://172.21.15.77:8765 2024-04-21T10:21:26.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:25 smithi077 ceph-mon[27902]: [21/Apr/2024:10:21:24] ENGINE Bus STARTED 2024-04-21T10:21:26.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:25 smithi077 ceph-mon[27902]: mgrmap e22: x(active, since 1.01954s), standbys: y, z 2024-04-21T10:21:26.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-21T10:21:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:25 smithi170 ceph-mon[31212]: [21/Apr/2024:10:21:24] ENGINE Bus STARTING 2024-04-21T10:21:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:25 smithi170 ceph-mon[31212]: [21/Apr/2024:10:21:24] ENGINE Serving on https://172.21.15.77:7150 2024-04-21T10:21:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:25 smithi170 ceph-mon[31212]: [21/Apr/2024:10:21:24] ENGINE Serving on http://172.21.15.77:8765 2024-04-21T10:21:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:25 smithi170 ceph-mon[31212]: [21/Apr/2024:10:21:24] ENGINE Bus STARTED 2024-04-21T10:21:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:25 smithi170 ceph-mon[31212]: mgrmap e22: x(active, since 1.01954s), standbys: y, z 2024-04-21T10:21:26.319 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-21T10:21:26.329 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-21T10:21:26.342 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:21:26.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-21T10:21:26.362 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-21T10:21:26.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:26.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- 172.21.15.77:0/2505189250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644101fc0 msgr2=0x7f3644102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- 172.21.15.77:0/2505189250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644101fc0 0x7f3644102440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3630009900 tx=0x7f363002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:26.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- 172.21.15.77:0/2505189250 shutdown_connections 2024-04-21T10:21:26.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- 172.21.15.77:0/2505189250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644101fc0 0x7f3644102440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- 172.21.15.77:0/2505189250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3644102980 0x7f36441092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- 172.21.15.77:0/2505189250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644100e70 0x7f3644101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- 172.21.15.77:0/2505189250 >> 172.21.15.77:0/2505189250 conn(0x7f36440fc3e0 msgr2=0x7f36440fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- 172.21.15.77:0/2505189250 shutdown_connections 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- 172.21.15.77:0/2505189250 wait complete. 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 Processor -- start 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- start start 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 0x7f3644069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644101fc0 0x7f364419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3644102980 0x7f364419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f364410c9c0 con 0x7f3644100e70 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f364410c840 con 0x7f3644102980 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.477+0000 7f364ae2c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f364410cb40 con 0x7f3644101fc0 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 0x7f3644069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 0x7f3644069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33980/0 (socket says 172.21.15.77:33980) 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 -- 172.21.15.77:0/1034215296 learned_addr learned my addr 172.21.15.77:0/1034215296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f36493c9640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3644102980 0x7f364419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3643fff640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644101fc0 0x7f364419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 -- 172.21.15.77:0/1034215296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644101fc0 msgr2=0x7f364419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644101fc0 0x7f364419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 -- 172.21.15.77:0/1034215296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3644102980 msgr2=0x7f364419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3644102980 0x7f364419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 -- 172.21.15.77:0/1034215296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364419fe70 con 0x7f3644100e70 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3648bc8640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 0x7f3644069c50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f363800e9f0 tx=0x7f363800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363800cd80 con 0x7f3644100e70 2024-04-21T10:21:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441a0100 con 0x7f3644100e70 2024-04-21T10:21:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36380054d0 con 0x7f3644100e70 2024-04-21T10:21:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638010690 con 0x7f3644100e70 2024-04-21T10:21:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.478+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a0620 con 0x7f3644100e70 2024-04-21T10:21:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.479+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3644108200 con 0x7f3644100e70 2024-04-21T10:21:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.480+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f3638004e90 con 0x7f3644100e70 2024-04-21T10:21:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.481+0000 7f3641ffb640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36340a39b0 0x7f36340a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.481+0000 7f3643fff640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36340a39b0 0x7f36340a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.481+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f36380d04e0 con 0x7f3644100e70 2024-04-21T10:21:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.482+0000 7f3643fff640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36340a39b0 0x7f36340a5e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3630005ab0 tx=0x7f3630005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.485+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f363809d0c0 con 0x7f3644100e70 2024-04-21T10:21:26.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.672+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3644062b50 con 0x7f3644100e70 2024-04-21T10:21:26.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.674+0000 7f3641ffb640 1 -- 172.21.15.77:0/1034215296 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23042 (secure 0 0 0) 0x7f363809c9c0 con 0x7f3644100e70 2024-04-21T10:21:26.674 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:26.674 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":88,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:21:24.082200+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1164251312":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6800/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/3052232463":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/2521386496":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3467069555":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36340a39b0 msgr2=0x7f36340a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36340a39b0 0x7f36340a5e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3630005ab0 tx=0x7f3630005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 msgr2=0x7f3644069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 0x7f3644069c50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f363800e9f0 tx=0x7f363800edf0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 shutdown_connections 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36340a39b0 0x7f36340a5e70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3644102980 0x7f364419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644101fc0 0x7f364419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 --2- 172.21.15.77:0/1034215296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3644100e70 0x7f3644069c50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 >> 172.21.15.77:0/1034215296 conn(0x7f36440fc3e0 msgr2=0x7f36441053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:26.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 shutdown_connections 2024-04-21T10:21:26.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.676+0000 7f364ae2c640 1 -- 172.21.15.77:0/1034215296 wait complete. 2024-04-21T10:21:26.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:21:26.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3781346392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 msgr2=0x7ff9bc10a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3781346392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc10a0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009ca0 tx=0x7ff9b402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3781346392 shutdown_connections 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3781346392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc10a0c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3781346392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc105340 0x7ff9bc107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3781346392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9bc102a10 0x7ff9bc104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3781346392 >> 172.21.15.77:0/3781346392 conn(0x7ff9bc0fc400 msgr2=0x7ff9bc0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:26.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3781346392 shutdown_connections 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3781346392 wait complete. 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.810+0000 7ff9c0c43640 1 Processor -- start 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 -- start start 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc102a10 0x7ff9bc1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9bc105340 0x7ff9bc198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc10dad0 con 0x7ff9bc107c70 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc10d950 con 0x7ff9bc105340 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9c0c43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc10dc50 con 0x7ff9bc102a10 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc19f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33996/0 (socket says 172.21.15.77:33996) 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 -- 172.21.15.77:0/3942275597 learned_addr learned my addr 172.21.15.77:0/3942275597 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9b9d9b640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9bc105340 0x7ff9bc198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9ba59c640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc102a10 0x7ff9bc1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 -- 172.21.15.77:0/3942275597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc102a10 msgr2=0x7ff9bc1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc102a10 0x7ff9bc1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 -- 172.21.15.77:0/3942275597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9bc105340 msgr2=0x7ff9bc198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9bc105340 0x7ff9bc198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 -- 172.21.15.77:0/3942275597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc19fdf0 con 0x7ff9bc107c70 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.811+0000 7ff9bad9d640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc19f780 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff9b402c700 tx=0x7ff9b40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.812+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4041020 con 0x7ff9bc107c70 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.812+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc1a0080 con 0x7ff9bc107c70 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.812+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9b4034d60 con 0x7ff9bc107c70 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.812+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4039040 con 0x7ff9bc107c70 2024-04-21T10:21:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.812+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9bc1a05c0 con 0x7ff9bc107c70 2024-04-21T10:21:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.813+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9bc0fdef0 con 0x7ff9bc107c70 2024-04-21T10:21:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.814+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7ff9b4044020 con 0x7ff9bc107c70 2024-04-21T10:21:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.815+0000 7ff9ab7fe640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff9a40a39b0 0x7ff9a40a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.815+0000 7ff9ba59c640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff9a40a39b0 0x7ff9a40a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.815+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff9b40f1ff0 con 0x7ff9bc107c70 2024-04-21T10:21:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.815+0000 7ff9ba59c640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff9a40a39b0 0x7ff9a40a5e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009bd0 tx=0x7ff9ac005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:26.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.819+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff9b404b020 con 0x7ff9bc107c70 2024-04-21T10:21:26.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:26.944+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7ff9b40bab40 con 0x7ff9bc107c70 2024-04-21T10:21:27.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.025+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9bc062b50 con 0x7ff9bc107c70 2024-04-21T10:21:27.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.025+0000 7ff9ab7fe640 1 -- 172.21.15.77:0/3942275597 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7ff9b4079ad0 con 0x7ff9bc107c70 2024-04-21T10:21:27.025 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff9a40a39b0 msgr2=0x7ff9a40a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff9a40a39b0 0x7ff9a40a5e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009bd0 tx=0x7ff9ac005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 msgr2=0x7ff9bc19f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc19f780 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff9b402c700 tx=0x7ff9b40093f0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 shutdown_connections 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff9a40a39b0 0x7ff9a40a5e70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9bc107c70 0x7ff9bc19f780 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9bc105340 0x7ff9bc198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 --2- 172.21.15.77:0/3942275597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc102a10 0x7ff9bc1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 >> 172.21.15.77:0/3942275597 conn(0x7ff9bc0fc400 msgr2=0x7ff9bc1033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:27.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 shutdown_connections 2024-04-21T10:21:27.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.028+0000 7ff9c0c43640 1 -- 172.21.15.77:0/3942275597 wait complete. 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='client.24836 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:26 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1034215296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:27.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:21:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 -- 172.21.15.77:0/94495402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88100e90 msgr2=0x7f4e881012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/94495402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88100e90 0x7f4e881012b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009900 tx=0x7f4e8402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 -- 172.21.15.77:0/94495402 shutdown_connections 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/94495402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e881029a0 0x7f4e881092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/94495402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e88101fe0 0x7f4e88102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/94495402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88100e90 0x7f4e881012b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 -- 172.21.15.77:0/94495402 >> 172.21.15.77:0/94495402 conn(0x7f4e880fc400 msgr2=0x7f4e880fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 -- 172.21.15.77:0/94495402 shutdown_connections 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.144+0000 7f4e8fd11640 1 -- 172.21.15.77:0/94495402 wait complete. 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 Processor -- start 2024-04-21T10:21:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 -- start start 2024-04-21T10:21:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e88100e90 0x7f4e88198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 0x7f4e88198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e881029a0 0x7f4e8819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8810daf0 con 0x7f4e88101fe0 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8810d970 con 0x7f4e881029a0 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8fd11640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8810dc70 con 0x7f4e88100e90 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 0x7f4e88198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 0x7f4e88198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34010/0 (socket says 172.21.15.77:34010) 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 -- 172.21.15.77:0/205481287 learned_addr learned my addr 172.21.15.77:0/205481287 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8daad640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e88100e90 0x7f4e88198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8e2ae640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e881029a0 0x7f4e8819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 -- 172.21.15.77:0/205481287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e88100e90 msgr2=0x7f4e88198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e88100e90 0x7f4e88198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 -- 172.21.15.77:0/205481287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e881029a0 msgr2=0x7f4e8819f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e881029a0 0x7f4e8819f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.145+0000 7f4e8d2ac640 1 -- 172.21.15.77:0/205481287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8819fe30 con 0x7f4e88101fe0 2024-04-21T10:21:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.146+0000 7f4e8d2ac640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 0x7f4e88198750 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800e9c0 tx=0x7f4e7800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.146+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800cd80 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.146+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e881a0120 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.146+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e780035f0 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.146+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78010690 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.146+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e881a06c0 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.147+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e881082c0 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.148+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7f4e780037a0 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.148+0000 7f4e7effd640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4e740a3d20 0x7f4e740a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.148+0000 7f4e8daad640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4e740a3d20 0x7f4e740a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.148+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f4e780d0b40 con 0x7f4e88101fe0 2024-04-21T10:21:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.149+0000 7f4e8daad640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4e740a3d20 0x7f4e740a61e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009230 tx=0x7f4e84005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.153+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e7809d210 con 0x7f4e88101fe0 2024-04-21T10:21:27.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='client.24836 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:27.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:26 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1034215296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='client.24836 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:26 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1034215296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:27.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.338+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4e8802d7c0 con 0x7f4e88101fe0 2024-04-21T10:21:27.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.339+0000 7f4e7effd640 1 -- 172.21.15.77:0/205481287 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f4e7809cb10 con 0x7f4e88101fe0 2024-04-21T10:21:27.338 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.340+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4e740a3d20 msgr2=0x7f4e740a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.340+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4e740a3d20 0x7f4e740a61e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009230 tx=0x7f4e84005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.340+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 msgr2=0x7f4e88198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.340+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 0x7f4e88198750 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800e9c0 tx=0x7f4e7800ee80 comp rx=0 tx=0).stop 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 shutdown_connections 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4e740a3d20 0x7f4e740a61e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e88101fe0 0x7f4e88198750 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e881029a0 0x7f4e8819f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 --2- 172.21.15.77:0/205481287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e88100e90 0x7f4e88198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 >> 172.21.15.77:0/205481287 conn(0x7f4e880fc400 msgr2=0x7f4e88105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 shutdown_connections 2024-04-21T10:21:27.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.341+0000 7f4e8fd11640 1 -- 172.21.15.77:0/205481287 wait complete. 2024-04-21T10:21:27.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 -- 172.21.15.77:0/2889473975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 msgr2=0x7f72881024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 --2- 172.21.15.77:0/2889473975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f72881024c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f727c009900 tx=0x7f727c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 -- 172.21.15.77:0/2889473975 shutdown_connections 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 --2- 172.21.15.77:0/2889473975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f72881024c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 --2- 172.21.15.77:0/2889473975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7288102a00 0x7f7288109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 --2- 172.21.15.77:0/2889473975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7288100e60 0x7f7288101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 -- 172.21.15.77:0/2889473975 >> 172.21.15.77:0/2889473975 conn(0x7f72880fc440 msgr2=0x7f72880fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 -- 172.21.15.77:0/2889473975 shutdown_connections 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 -- 172.21.15.77:0/2889473975 wait complete. 2024-04-21T10:21:27.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.464+0000 7f728cc99640 1 Processor -- start 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 -- start start 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7288100e60 0x7f728819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f728819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7288102a00 0x7f72881a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f728810ca10 con 0x7f7288102040 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f728810c890 con 0x7f7288102a00 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728cc99640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f728810cb90 con 0x7f7288100e60 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f728819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f728819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34040/0 (socket says 172.21.15.77:34040) 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 -- 172.21.15.77:0/3885218425 learned_addr learned my addr 172.21.15.77:0/3885218425 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f728659c640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7288100e60 0x7f728819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7286d9d640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7288102a00 0x7f72881a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 -- 172.21.15.77:0/3885218425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7288100e60 msgr2=0x7f728819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7288100e60 0x7f728819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 -- 172.21.15.77:0/3885218425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7288102a00 msgr2=0x7f72881a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7288102a00 0x7f72881a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 -- 172.21.15.77:0/3885218425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72881a2090 con 0x7f7288102040 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f7285d9b640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f728819a9b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f727c006010 tx=0x7f727c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.465+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c043020 con 0x7f7288102040 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.466+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72881a2320 con 0x7f7288102040 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.466+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f727c004350 con 0x7f7288102040 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.466+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c003af0 con 0x7f7288102040 2024-04-21T10:21:27.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.466+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72881a28c0 con 0x7f7288102040 2024-04-21T10:21:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.467+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72881a2ac0 con 0x7f7288102040 2024-04-21T10:21:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.468+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7f727c046020 con 0x7f7288102040 2024-04-21T10:21:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.468+0000 7f72777fe640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f72700a3d20 0x7f72700a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.468+0000 7f728659c640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f72700a3d20 0x7f72700a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.469+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f727c0f2890 con 0x7f7288102040 2024-04-21T10:21:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.469+0000 7f728659c640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f72700a3d20 0x7f72700a61e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7288101bb0 tx=0x7f7278005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:27.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.473+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f727c04d020 con 0x7f7288102040 2024-04-21T10:21:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.686+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f72881a2db0 con 0x7f7288102040 2024-04-21T10:21:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.686+0000 7f72777fe640 1 -- 172.21.15.77:0/3885218425 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f727c0bf070 con 0x7f7288102040 2024-04-21T10:21:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:21:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.688+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f72700a3d20 msgr2=0x7f72700a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.688+0000 7f728cc99640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f72700a3d20 0x7f72700a61e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7288101bb0 tx=0x7f7278005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.688+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 msgr2=0x7f728819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.688+0000 7f728cc99640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f728819a9b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f727c006010 tx=0x7f727c005dd0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.688+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 shutdown_connections 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f72700a3d20 0x7f72700a61e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7288102040 0x7f728819a9b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7288102a00 0x7f72881a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 --2- 172.21.15.77:0/3885218425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7288100e60 0x7f728819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 >> 172.21.15.77:0/3885218425 conn(0x7f72880fc440 msgr2=0x7f728806a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 shutdown_connections 2024-04-21T10:21:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.689+0000 7f728cc99640 1 -- 172.21.15.77:0/3885218425 wait complete. 2024-04-21T10:21:27.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 -- 172.21.15.77:0/3288906974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0101f80 msgr2=0x7f36f01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 --2- 172.21.15.77:0/3288906974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0101f80 0x7f36f01023a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009900 tx=0x7f36e002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 -- 172.21.15.77:0/3288906974 shutdown_connections 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 --2- 172.21.15.77:0/3288906974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36f0103b30 0x7f36f010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 --2- 172.21.15.77:0/3288906974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0103170 0x7f36f01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 --2- 172.21.15.77:0/3288906974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0101f80 0x7f36f01023a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 -- 172.21.15.77:0/3288906974 >> 172.21.15.77:0/3288906974 conn(0x7f36f00fd530 msgr2=0x7f36f00ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 -- 172.21.15.77:0/3288906974 shutdown_connections 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.803+0000 7f36f863a640 1 -- 172.21.15.77:0/3288906974 wait complete. 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 Processor -- start 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 -- start start 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0101f80 0x7f36f0198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 0x7f36f01986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36f0103b30 0x7f36f019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f36f010dac0 con 0x7f36f0103170 2024-04-21T10:21:27.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f36f010d940 con 0x7f36f0101f80 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f863a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f36f010dc40 con 0x7f36f0103b30 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 0x7f36f01986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 0x7f36f01986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34066/0 (socket says 172.21.15.77:34066) 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 -- 172.21.15.77:0/911997516 learned_addr learned my addr 172.21.15.77:0/911997516 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f63d6640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0101f80 0x7f36f0198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f6bd7640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36f0103b30 0x7f36f019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 -- 172.21.15.77:0/911997516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36f0103b30 msgr2=0x7f36f019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36f0103b30 0x7f36f019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 -- 172.21.15.77:0/911997516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0101f80 msgr2=0x7f36f0198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0101f80 0x7f36f0198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:27.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 -- 172.21.15.77:0/911997516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f019fda0 con 0x7f36f0103170 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f63d6640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0101f80 0x7f36f0198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.804+0000 7f36f5bd5640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 0x7f36f01986c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9f0 tx=0x7f36ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.805+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00cd80 con 0x7f36f0103170 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.805+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f01a0090 con 0x7f36f0103170 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.805+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36ec0108e0 con 0x7f36f0103170 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.805+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec018980 con 0x7f36f0103170 2024-04-21T10:21:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.805+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f01a0630 con 0x7f36f0103170 2024-04-21T10:21:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.806+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f0109340 con 0x7f36f0103170 2024-04-21T10:21:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.807+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7f36ec010430 con 0x7f36f0103170 2024-04-21T10:21:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.807+0000 7f36e77fe640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36dc0a3d20 0x7f36dc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.808+0000 7f36f63d6640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36dc0a3d20 0x7f36dc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.808+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f36ec0d1050 con 0x7f36f0103170 2024-04-21T10:21:27.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.808+0000 7f36f63d6640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36dc0a3d20 0x7f36dc0a61e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005ab0 tx=0x7f36e0005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:27.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:27.811+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f36ec09d720 con 0x7f36f0103170 2024-04-21T10:21:28.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.004+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36f002d7c0 con 0x7f36f0103170 2024-04-21T10:21:28.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.006+0000 7f36e77fe640 1 -- 172.21.15.77:0/911997516 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23042 (secure 0 0 0) 0x7f36ec09d020 con 0x7f36f0103170 2024-04-21T10:21:28.006 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":88,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:21:24.082200+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1164251312":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6800/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/3052232463":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/2521386496":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3467069555":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36dc0a3d20 msgr2=0x7f36dc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36dc0a3d20 0x7f36dc0a61e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005ab0 tx=0x7f36e0005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 msgr2=0x7f36f01986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 0x7f36f01986c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9f0 tx=0x7f36ec00eeb0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 shutdown_connections 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f36dc0a3d20 0x7f36dc0a61e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f0103170 0x7f36f01986c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36f0103b30 0x7f36f019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 --2- 172.21.15.77:0/911997516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f0101f80 0x7f36f0198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 >> 172.21.15.77:0/911997516 conn(0x7f36f00fd530 msgr2=0x7f36f0106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 shutdown_connections 2024-04-21T10:21:28.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.008+0000 7f36f863a640 1 -- 172.21.15.77:0/911997516 wait complete. 2024-04-21T10:21:28.018 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3942275597' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/205481287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.019 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:21:28.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:27 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3885218425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.022 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:21:28.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 -- 172.21.15.77:0/2585744052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 msgr2=0x7fd8fc1024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 --2- 172.21.15.77:0/2585744052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1024c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009900 tx=0x7fd8e402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 -- 172.21.15.77:0/2585744052 shutdown_connections 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 --2- 172.21.15.77:0/2585744052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1024c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 --2- 172.21.15.77:0/2585744052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8fc102a00 0x7fd8fc109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 --2- 172.21.15.77:0/2585744052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8fc100e60 0x7fd8fc101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 -- 172.21.15.77:0/2585744052 >> 172.21.15.77:0/2585744052 conn(0x7fd8fc0fc440 msgr2=0x7fd8fc0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 -- 172.21.15.77:0/2585744052 shutdown_connections 2024-04-21T10:21:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.127+0000 7fd901855640 1 -- 172.21.15.77:0/2585744052 wait complete. 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 Processor -- start 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 -- start start 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8fc100e60 0x7fd8fc198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8fc102a00 0x7fd8fc19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc10db20 con 0x7fd8fc102040 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc10d9a0 con 0x7fd8fc100e60 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd901855640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc10dca0 con 0x7fd8fc102a00 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34078/0 (socket says 172.21.15.77:34078) 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 -- 172.21.15.77:0/30365649 learned_addr learned my addr 172.21.15.77:0/30365649 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8fb7fe640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8fc102a00 0x7fd8fc19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8faffd640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8fc100e60 0x7fd8fc198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 -- 172.21.15.77:0/30365649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8fc102a00 msgr2=0x7fd8fc19f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8fc102a00 0x7fd8fc19f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 -- 172.21.15.77:0/30365649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8fc100e60 msgr2=0x7fd8fc198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8fc100e60 0x7fd8fc198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 -- 172.21.15.77:0/30365649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc19fe50 con 0x7fd8fc102040 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.128+0000 7fd8f3fff640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1987c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd8e402c240 tx=0x7fd8e4005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.129+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4043020 con 0x7fd8fc102040 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.129+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e40043d0 con 0x7fd8fc102040 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.129+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4003b80 con 0x7fd8fc102040 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.129+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc1a00e0 con 0x7fd8fc102040 2024-04-21T10:21:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.129+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc1a05e0 con 0x7fd8fc102040 2024-04-21T10:21:28.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.130+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc108320 con 0x7fd8fc102040 2024-04-21T10:21:28.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.131+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7fd8e4046020 con 0x7fd8fc102040 2024-04-21T10:21:28.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.131+0000 7fd900853640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd8e80a3d20 0x7fd8e80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.131+0000 7fd8faffd640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd8e80a3d20 0x7fd8e80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.131+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd8e40f2820 con 0x7fd8fc102040 2024-04-21T10:21:28.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.132+0000 7fd8faffd640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd8e80a3d20 0x7fd8e80a61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc101bb0 tx=0x7fd8ec005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:28.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.136+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd8e404d020 con 0x7fd8fc102040 2024-04-21T10:21:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3942275597' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/205481287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:21:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:27 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3885218425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3942275597' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/205481287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:21:28.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:21:28.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:21:28.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:27 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3885218425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.332+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd8fc02d7c0 con 0x7fd8fc102040 2024-04-21T10:21:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.333+0000 7fd900853640 1 -- 172.21.15.77:0/30365649 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fd8e40bf000 con 0x7fd8fc102040 2024-04-21T10:21:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd8e80a3d20 msgr2=0x7fd8e80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd8e80a3d20 0x7fd8e80a61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc101bb0 tx=0x7fd8ec005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 msgr2=0x7fd8fc1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1987c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd8e402c240 tx=0x7fd8e4005e50 comp rx=0 tx=0).stop 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 shutdown_connections 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd8e80a3d20 0x7fd8e80a61e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8fc102040 0x7fd8fc1987c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8fc102a00 0x7fd8fc19f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 --2- 172.21.15.77:0/30365649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8fc100e60 0x7fd8fc198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 >> 172.21.15.77:0/30365649 conn(0x7fd8fc0fc440 msgr2=0x7fd8fc1054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 shutdown_connections 2024-04-21T10:21:28.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.335+0000 7fd901855640 1 -- 172.21.15.77:0/30365649 wait complete. 2024-04-21T10:21:28.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 -- 172.21.15.77:0/2287380914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101072b0 msgr2=0x7f591010eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2287380914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101072b0 0x7f591010eec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5908009ca0 tx=0x7f590802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 -- 172.21.15.77:0/2287380914 shutdown_connections 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2287380914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101072b0 0x7f591010eec0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2287380914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59101014a0 0x7f5910106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2287380914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5910100af0 0x7f5910100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 -- 172.21.15.77:0/2287380914 >> 172.21.15.77:0/2287380914 conn(0x7f59100760e0 msgr2=0x7f59100764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 -- 172.21.15.77:0/2287380914 shutdown_connections 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.451+0000 7f5917d3d640 1 -- 172.21.15.77:0/2287380914 wait complete. 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 Processor -- start 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 -- start start 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5910100af0 0x7f591019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59101072b0 0x7f591019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 0x7f5910198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5910112250 con 0x7f59101985d0 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59101120d0 con 0x7f5910100af0 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5917d3d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f59101123d0 con 0x7f59101072b0 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 0x7f5910198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 0x7f5910198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34096/0 (socket says 172.21.15.77:34096) 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 -- 172.21.15.77:0/2516120181 learned_addr learned my addr 172.21.15.77:0/2516120181 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59152d8640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59101072b0 0x7f591019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f5915ad9640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5910100af0 0x7f591019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 -- 172.21.15.77:0/2516120181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59101072b0 msgr2=0x7f591019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59101072b0 0x7f591019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 -- 172.21.15.77:0/2516120181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5910100af0 msgr2=0x7f591019e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5910100af0 0x7f591019e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.452+0000 7f59162da640 1 -- 172.21.15.77:0/2516120181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59101990f0 con 0x7f59101985d0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.453+0000 7f59162da640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 0x7f5910198a80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5908005e30 tx=0x7f59080346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.453+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908041020 con 0x7f59101985d0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.453+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5908032970 con 0x7f59101985d0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.453+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5910199380 con 0x7f59101985d0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.453+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908039040 con 0x7f59101985d0 2024-04-21T10:21:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.453+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59101a5570 con 0x7f59101985d0 2024-04-21T10:21:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.454+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59100691c0 con 0x7f59101985d0 2024-04-21T10:21:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.455+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7f5908044020 con 0x7f59101985d0 2024-04-21T10:21:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.455+0000 7f5906ffd640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f58fc0a3d20 0x7f58fc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.456+0000 7f5915ad9640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f58fc0a3d20 0x7f58fc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.456+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f59080f2290 con 0x7f59101985d0 2024-04-21T10:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.456+0000 7f5915ad9640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f58fc0a3d20 0x7f58fc0a61e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f590c009bd0 tx=0x7f590c005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.460+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f590804b020 con 0x7f59101985d0 2024-04-21T10:21:28.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.650+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f591010a580 con 0x7f59101985d0 2024-04-21T10:21:28.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.650+0000 7f5906ffd640 1 -- 172.21.15.77:0/2516120181 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f59080bea70 con 0x7f59101985d0 2024-04-21T10:21:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:21:28.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f58fc0a3d20 msgr2=0x7f58fc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f58fc0a3d20 0x7f58fc0a61e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f590c009bd0 tx=0x7f590c005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 msgr2=0x7f5910198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 0x7f5910198a80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5908005e30 tx=0x7f59080346d0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 shutdown_connections 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f58fc0a3d20 0x7f58fc0a61e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59101985d0 0x7f5910198a80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59101072b0 0x7f591019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 --2- 172.21.15.77:0/2516120181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5910100af0 0x7f591019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 >> 172.21.15.77:0/2516120181 conn(0x7f59100760e0 msgr2=0x7f59100fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 shutdown_connections 2024-04-21T10:21:28.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.652+0000 7f5917d3d640 1 -- 172.21.15.77:0/2516120181 wait complete. 2024-04-21T10:21:28.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:21:28.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 -- 172.21.15.77:0/413691382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f883006a360 msgr2=0x7f883006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 --2- 172.21.15.77:0/413691382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f883006a360 0x7f883006a7a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8820009930 tx=0x7f882002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 -- 172.21.15.77:0/413691382 shutdown_connections 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 --2- 172.21.15.77:0/413691382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f883006a360 0x7f883006a7a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 --2- 172.21.15.77:0/413691382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883006ace0 0x7f883010ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 --2- 172.21.15.77:0/413691382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8830107fd0 0x7f88301083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.767+0000 7f8837293640 1 -- 172.21.15.77:0/413691382 >> 172.21.15.77:0/413691382 conn(0x7f8830077ef0 msgr2=0x7f8830078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 -- 172.21.15.77:0/413691382 shutdown_connections 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 -- 172.21.15.77:0/413691382 wait complete. 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 Processor -- start 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 -- start start 2024-04-21T10:21:28.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f883006a360 0x7f883019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883006ace0 0x7f883019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 0x7f8830198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88301121a0 con 0x7f8830107fd0 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8830112020 con 0x7f883006ace0 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8837293640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8830112320 con 0x7f883006a360 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8835830640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 0x7f8830198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8835830640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 0x7f8830198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34118/0 (socket says 172.21.15.77:34118) 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f8835830640 1 -- 172.21.15.77:0/445370849 learned_addr learned my addr 172.21.15.77:0/445370849 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.768+0000 7f883502f640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f883006a360 0x7f883019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f883482e640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883006ace0 0x7f883019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8835830640 1 -- 172.21.15.77:0/445370849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f883006a360 msgr2=0x7f883019e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8835830640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f883006a360 0x7f883019e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8835830640 1 -- 172.21.15.77:0/445370849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883006ace0 msgr2=0x7f883019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8835830640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883006ace0 0x7f883019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8835830640 1 -- 172.21.15.77:0/445370849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8830198da0 con 0x7f8830107fd0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8835830640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 0x7f8830198620 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f882800eb10 tx=0x7f882800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828004b20 con 0x7f8830107fd0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8828004cc0 con 0x7f8830107fd0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8830199090 con 0x7f8830107fd0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828010670 con 0x7f8830107fd0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.769+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88301a52e0 con 0x7f8830107fd0 2024-04-21T10:21:28.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.770+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88300684e0 con 0x7f8830107fd0 2024-04-21T10:21:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.771+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7f8828005020 con 0x7f8830107fd0 2024-04-21T10:21:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.772+0000 7f88267fc640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f881c0a3d20 0x7f881c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.772+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f88280d0d80 con 0x7f8830107fd0 2024-04-21T10:21:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.772+0000 7f883502f640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f881c0a3d20 0x7f881c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.772+0000 7f883502f640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f881c0a3d20 0x7f881c0a61e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f882c009b50 tx=0x7f882c005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.776+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f882809d450 con 0x7f8830107fd0 2024-04-21T10:21:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.954+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f88280ce780 con 0x7f8830107fd0 2024-04-21T10:21:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.959+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8830109ec0 con 0x7f8830107fd0 2024-04-21T10:21:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.960+0000 7f88267fc640 1 -- 172.21.15.77:0/445370849 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f8828056bc0 con 0x7f8830107fd0 2024-04-21T10:21:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.961+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f881c0a3d20 msgr2=0x7f881c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.961+0000 7f8837293640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f881c0a3d20 0x7f881c0a61e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f882c009b50 tx=0x7f882c005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.961+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 msgr2=0x7f8830198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.961+0000 7f8837293640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 0x7f8830198620 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f882800eb10 tx=0x7f882800c2d0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.961+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 shutdown_connections 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f881c0a3d20 0x7f881c0a61e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8830107fd0 0x7f8830198620 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883006ace0 0x7f883019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 --2- 172.21.15.77:0/445370849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f883006a360 0x7f883019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 >> 172.21.15.77:0/445370849 conn(0x7f8830077ef0 msgr2=0x7f88300ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 shutdown_connections 2024-04-21T10:21:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:28.962+0000 7f8837293640 1 -- 172.21.15.77:0/445370849 wait complete. 2024-04-21T10:21:28.972 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-21T10:21:28.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T10:21:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 -- 172.21.15.77:0/3394204533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b8105f20 msgr2=0x7f74b810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3394204533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b8105f20 0x7f74b810daf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009ca0 tx=0x7f74b002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 -- 172.21.15.77:0/3394204533 shutdown_connections 2024-04-21T10:21:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3394204533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b8105f20 0x7f74b810daf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3394204533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8101800 0x7f74b8105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3394204533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74b8100e50 0x7f74b8101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 -- 172.21.15.77:0/3394204533 >> 172.21.15.77:0/3394204533 conn(0x7f74b80fc6f0 msgr2=0x7f74b80feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 -- 172.21.15.77:0/3394204533 shutdown_connections 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.070+0000 7f74bc99f640 1 -- 172.21.15.77:0/3394204533 wait complete. 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 Processor -- start 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 -- start start 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74b8100e50 0x7f74b8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8105f20 0x7f74b81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 0x7f74b819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8110e80 con 0x7f74b819cd40 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8110d00 con 0x7f74b8105f20 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74bc99f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8111000 con 0x7f74b8100e50 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 0x7f74b819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 0x7f74b819d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34132/0 (socket says 172.21.15.77:34132) 2024-04-21T10:21:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 -- 172.21.15.77:0/3095917113 learned_addr learned my addr 172.21.15.77:0/3095917113 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b77fe640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74b8100e50 0x7f74b8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b6ffd640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8105f20 0x7f74b81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 -- 172.21.15.77:0/3095917113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74b8100e50 msgr2=0x7f74b8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74b8100e50 0x7f74b8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 -- 172.21.15.77:0/3095917113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8105f20 msgr2=0x7f74b81989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8105f20 0x7f74b81989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b7fff640 1 -- 172.21.15.77:0/3095917113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b819d830 con 0x7f74b819cd40 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.071+0000 7f74b6ffd640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8105f20 0x7f74b81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.072+0000 7f74b7fff640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 0x7f74b819d1f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74b0005e30 tx=0x7f74b0034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.072+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0039040 con 0x7f74b819cd40 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.072+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b819dac0 con 0x7f74b819cd40 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.072+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74b0044070 con 0x7f74b819cd40 2024-04-21T10:21:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.072+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0003e60 con 0x7f74b819cd40 2024-04-21T10:21:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.072+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81a5280 con 0x7f74b819cd40 2024-04-21T10:21:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.073+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b80690e0 con 0x7f74b819cd40 2024-04-21T10:21:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.074+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f74b00324c0 con 0x7f74b819cd40 2024-04-21T10:21:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.075+0000 7f74b4ff9640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f74a00a3db0 0x7f74a00a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.075+0000 7f74b77fe640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f74a00a3db0 0x7f74a00a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.075+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f74b00f2b00 con 0x7f74b819cd40 2024-04-21T10:21:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.075+0000 7f74b77fe640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f74a00a3db0 0x7f74a00a6270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74a80058c0 tx=0x7f74a800a250 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.080+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f74b00bf170 con 0x7f74b819cd40 2024-04-21T10:21:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:21:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:21:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:21:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/911997516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/30365649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2516120181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:21:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.253+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74b8101870 con 0x7f74a00a3db0 2024-04-21T10:21:29.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.261+0000 7f74b4ff9640 1 -- 172.21.15.77:0/3095917113 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258000 (secure 0 0 0) 0x7f74b8101870 con 0x7f74a00a3db0 2024-04-21T10:21:29.265 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:29.267 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:21:29.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f74a00a3db0 msgr2=0x7f74a00a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f74a00a3db0 0x7f74a00a6270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74a80058c0 tx=0x7f74a800a250 comp rx=0 tx=0).stop 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 msgr2=0x7f74b819d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 0x7f74b819d1f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74b0005e30 tx=0x7f74b0034760 comp rx=0 tx=0).stop 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 shutdown_connections 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f74a00a3db0 0x7f74a00a6270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b819cd40 0x7f74b819d1f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b8105f20 0x7f74b81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 --2- 172.21.15.77:0/3095917113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74b8100e50 0x7f74b8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 >> 172.21.15.77:0/3095917113 conn(0x7f74b80fc6f0 msgr2=0x7f74b806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 shutdown_connections 2024-04-21T10:21:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.264+0000 7f74bc99f640 1 -- 172.21.15.77:0/3095917113 wait complete. 2024-04-21T10:21:29.274 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/911997516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/30365649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2516120181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:21:29.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.277 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-21T10:21:28.103670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186075,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":971,"num_read_kb":643,"num_write":467,"num_write_kb":4374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365228,"kb_used_data":11856,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576596,"statfs":{"total":1151940427776,"available":1151566434304,"internally_reserved":0,"allocated":12140544,"data_stored":9132434,"data_compressed":219048,"data_compressed_allocated":282624,"data_compressed_original":3416064,"omap_allocated":19137,"internal_metadata":361674047},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.992891"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090548+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:21:24.090548+0000","last_peered":"2024-04-21T10:21:24.090548+0000","last_clean":"2024-04-21T10:21:24.090548+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:21:24.090548+0000","last_undegraded":"2024-04-21T10:21:24.090548+0000","last_fullsized":"2024-04-21T10:21:24.090548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:06:40.220736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100392+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:21:24.100392+0000","last_peered":"2024-04-21T10:21:24.100392+0000","last_clean":"2024-04-21T10:21:24.100392+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:21:24.100392+0000","last_undegraded":"2024-04-21T10:21:24.100392+0000","last_fullsized":"2024-04-21T10:21:24.100392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100211+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:21:24.100211+0000","last_peered":"2024-04-21T10:21:24.100211+0000","last_clean":"2024-04-21T10:21:24.100211+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:21:24.100211+0000","last_undegraded":"2024-04-21T10:21:24.100211+0000","last_fullsized":"2024-04-21T10:21:24.100211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099216+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:21:24.099216+0000","last_peered":"2024-04-21T10:21:24.099216+0000","last_clean":"2024-04-21T10:21:24.099216+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:21:24.099216+0000","last_undegraded":"2024-04-21T10:21:24.099216+0000","last_fullsized":"2024-04-21T10:21:24.099216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098192+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:21:24.098192+0000","last_peered":"2024-04-21T10:21:24.098192+0000","last_clean":"2024-04-21T10:21:24.098192+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:21:24.098192+0000","last_undegraded":"2024-04-21T10:21:24.098192+0000","last_fullsized":"2024-04-21T10:21:24.098192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099585+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:21:24.099585+0000","last_peered":"2024-04-21T10:21:24.099585+0000","last_clean":"2024-04-21T10:21:24.099585+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:21:24.099585+0000","last_undegraded":"2024-04-21T10:21:24.099585+0000","last_fullsized":"2024-04-21T10:21:24.099585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:57.136408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088030+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:21:24.088030+0000","last_peered":"2024-04-21T10:21:24.088030+0000","last_clean":"2024-04-21T10:21:24.088030+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:21:24.088030+0000","last_undegraded":"2024-04-21T10:21:24.088030+0000","last_fullsized":"2024-04-21T10:21:24.088030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:17.305626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098594+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:21:24.098594+0000","last_peered":"2024-04-21T10:21:24.098594+0000","last_clean":"2024-04-21T10:21:24.098594+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:21:24.098594+0000","last_undegraded":"2024-04-21T10:21:24.098594+0000","last_fullsized":"2024-04-21T10:21:24.098594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:52.203999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099373+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:21:24.099373+0000","last_peered":"2024-04-21T10:21:24.099373+0000","last_clean":"2024-04-21T10:21:24.099373+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:21:24.099373+0000","last_undegraded":"2024-04-21T10:21:24.099373+0000","last_fullsized":"2024-04-21T10:21:24.099373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:26:01.902847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099831+0000","last_change":"2024-04-21T10:20:15.830905+0000","last_active":"2024-04-21T10:21:24.099831+0000","last_peered":"2024-04-21T10:21:24.099831+0000","last_clean":"2024-04-21T10:21:24.099831+0000","last_became_active":"2024-04-21T10:20:15.830536+0000","last_became_peered":"2024-04-21T10:20:15.830536+0000","last_unstale":"2024-04-21T10:21:24.099831+0000","last_undegraded":"2024-04-21T10:21:24.099831+0000","last_fullsized":"2024-04-21T10:21:24.099831+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:02:48.213874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088389+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:21:24.088389+0000","last_peered":"2024-04-21T10:21:24.088389+0000","last_clean":"2024-04-21T10:21:24.088389+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:21:24.088389+0000","last_undegraded":"2024-04-21T10:21:24.088389+0000","last_fullsized":"2024-04-21T10:21:24.088389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:52:25.586003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099003+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:21:24.099003+0000","last_peered":"2024-04-21T10:21:24.099003+0000","last_clean":"2024-04-21T10:21:24.099003+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:21:24.099003+0000","last_undegraded":"2024-04-21T10:21:24.099003+0000","last_fullsized":"2024-04-21T10:21:24.099003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099226+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:21:24.099226+0000","last_peered":"2024-04-21T10:21:24.099226+0000","last_clean":"2024-04-21T10:21:24.099226+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:21:24.099226+0000","last_undegraded":"2024-04-21T10:21:24.099226+0000","last_fullsized":"2024-04-21T10:21:24.099226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099423+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:21:24.099423+0000","last_peered":"2024-04-21T10:21:24.099423+0000","last_clean":"2024-04-21T10:21:24.099423+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:21:24.099423+0000","last_undegraded":"2024-04-21T10:21:24.099423+0000","last_fullsized":"2024-04-21T10:21:24.099423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098662+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:21:24.098662+0000","last_peered":"2024-04-21T10:21:24.098662+0000","last_clean":"2024-04-21T10:21:24.098662+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:21:24.098662+0000","last_undegraded":"2024-04-21T10:21:24.098662+0000","last_fullsized":"2024-04-21T10:21:24.098662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098508+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:21:24.098508+0000","last_peered":"2024-04-21T10:21:24.098508+0000","last_clean":"2024-04-21T10:21:24.098508+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:21:24.098508+0000","last_undegraded":"2024-04-21T10:21:24.098508+0000","last_fullsized":"2024-04-21T10:21:24.098508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:04:32.551997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090693+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:21:24.090693+0000","last_peered":"2024-04-21T10:21:24.090693+0000","last_clean":"2024-04-21T10:21:24.090693+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:21:24.090693+0000","last_undegraded":"2024-04-21T10:21:24.090693+0000","last_fullsized":"2024-04-21T10:21:24.090693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:10:09.025923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089286+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:21:24.089286+0000","last_peered":"2024-04-21T10:21:24.089286+0000","last_clean":"2024-04-21T10:21:24.089286+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:21:24.089286+0000","last_undegraded":"2024-04-21T10:21:24.089286+0000","last_fullsized":"2024-04-21T10:21:24.089286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098568+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:21:24.098568+0000","last_peered":"2024-04-21T10:21:24.098568+0000","last_clean":"2024-04-21T10:21:24.098568+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:21:24.098568+0000","last_undegraded":"2024-04-21T10:21:24.098568+0000","last_fullsized":"2024-04-21T10:21:24.098568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:37:23.490245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089417+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:21:24.089417+0000","last_peered":"2024-04-21T10:21:24.089417+0000","last_clean":"2024-04-21T10:21:24.089417+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:21:24.089417+0000","last_undegraded":"2024-04-21T10:21:24.089417+0000","last_fullsized":"2024-04-21T10:21:24.089417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100322+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:21:24.100322+0000","last_peered":"2024-04-21T10:21:24.100322+0000","last_clean":"2024-04-21T10:21:24.100322+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:21:24.100322+0000","last_undegraded":"2024-04-21T10:21:24.100322+0000","last_fullsized":"2024-04-21T10:21:24.100322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:26.283821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100467+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:21:24.100467+0000","last_peered":"2024-04-21T10:21:24.100467+0000","last_clean":"2024-04-21T10:21:24.100467+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:21:24.100467+0000","last_undegraded":"2024-04-21T10:21:24.100467+0000","last_fullsized":"2024-04-21T10:21:24.100467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100603+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:21:24.100603+0000","last_peered":"2024-04-21T10:21:24.100603+0000","last_clean":"2024-04-21T10:21:24.100603+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:21:24.100603+0000","last_undegraded":"2024-04-21T10:21:24.100603+0000","last_fullsized":"2024-04-21T10:21:24.100603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098657+0000","last_change":"2024-04-21T10:20:15.833712+0000","last_active":"2024-04-21T10:21:24.098657+0000","last_peered":"2024-04-21T10:21:24.098657+0000","last_clean":"2024-04-21T10:21:24.098657+0000","last_became_active":"2024-04-21T10:20:15.827691+0000","last_became_peered":"2024-04-21T10:20:15.827691+0000","last_unstale":"2024-04-21T10:21:24.098657+0000","last_undegraded":"2024-04-21T10:21:24.098657+0000","last_fullsized":"2024-04-21T10:21:24.098657+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:32:14.844485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098746+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:21:24.098746+0000","last_peered":"2024-04-21T10:21:24.098746+0000","last_clean":"2024-04-21T10:21:24.098746+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:21:24.098746+0000","last_undegraded":"2024-04-21T10:21:24.098746+0000","last_fullsized":"2024-04-21T10:21:24.098746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:55:54.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090231+0000","last_change":"2024-04-21T10:20:15.835895+0000","last_active":"2024-04-21T10:21:24.090231+0000","last_peered":"2024-04-21T10:21:24.090231+0000","last_clean":"2024-04-21T10:21:24.090231+0000","last_became_active":"2024-04-21T10:20:15.828529+0000","last_became_peered":"2024-04-21T10:20:15.828529+0000","last_unstale":"2024-04-21T10:21:24.090231+0000","last_undegraded":"2024-04-21T10:21:24.090231+0000","last_fullsized":"2024-04-21T10:21:24.090231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:09.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099361+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:21:24.099361+0000","last_peered":"2024-04-21T10:21:24.099361+0000","last_clean":"2024-04-21T10:21:24.099361+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:21:24.099361+0000","last_undegraded":"2024-04-21T10:21:24.099361+0000","last_fullsized":"2024-04-21T10:21:24.099361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:12:42.198001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099189+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:21:24.099189+0000","last_peered":"2024-04-21T10:21:24.099189+0000","last_clean":"2024-04-21T10:21:24.099189+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:21:24.099189+0000","last_undegraded":"2024-04-21T10:21:24.099189+0000","last_fullsized":"2024-04-21T10:21:24.099189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098381+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:21:24.098381+0000","last_peered":"2024-04-21T10:21:24.098381+0000","last_clean":"2024-04-21T10:21:24.098381+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:21:24.098381+0000","last_undegraded":"2024-04-21T10:21:24.098381+0000","last_fullsized":"2024-04-21T10:21:24.098381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099447+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:21:24.099447+0000","last_peered":"2024-04-21T10:21:24.099447+0000","last_clean":"2024-04-21T10:21:24.099447+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:21:24.099447+0000","last_undegraded":"2024-04-21T10:21:24.099447+0000","last_fullsized":"2024-04-21T10:21:24.099447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099161+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:21:24.099161+0000","last_peered":"2024-04-21T10:21:24.099161+0000","last_clean":"2024-04-21T10:21:24.099161+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:21:24.099161+0000","last_undegraded":"2024-04-21T10:21:24.099161+0000","last_fullsized":"2024-04-21T10:21:24.099161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:48:22.623681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098911+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:21:24.098911+0000","last_peered":"2024-04-21T10:21:24.098911+0000","last_clean":"2024-04-21T10:21:24.098911+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:21:24.098911+0000","last_undegraded":"2024-04-21T10:21:24.098911+0000","last_fullsized":"2024-04-21T10:21:24.098911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098842+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:21:24.098842+0000","last_peered":"2024-04-21T10:21:24.098842+0000","last_clean":"2024-04-21T10:21:24.098842+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:21:24.098842+0000","last_undegraded":"2024-04-21T10:21:24.098842+0000","last_fullsized":"2024-04-21T10:21:24.098842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:54.824898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098785+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:21:24.098785+0000","last_peered":"2024-04-21T10:21:24.098785+0000","last_clean":"2024-04-21T10:21:24.098785+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:21:24.098785+0000","last_undegraded":"2024-04-21T10:21:24.098785+0000","last_fullsized":"2024-04-21T10:21:24.098785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089231+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:21:24.089231+0000","last_peered":"2024-04-21T10:21:24.089231+0000","last_clean":"2024-04-21T10:21:24.089231+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:21:24.089231+0000","last_undegraded":"2024-04-21T10:21:24.089231+0000","last_fullsized":"2024-04-21T10:21:24.089231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099820+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:21:24.099820+0000","last_peered":"2024-04-21T10:21:24.099820+0000","last_clean":"2024-04-21T10:21:24.099820+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:21:24.099820+0000","last_undegraded":"2024-04-21T10:21:24.099820+0000","last_fullsized":"2024-04-21T10:21:24.099820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098949+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:21:24.098949+0000","last_peered":"2024-04-21T10:21:24.098949+0000","last_clean":"2024-04-21T10:21:24.098949+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:21:24.098949+0000","last_undegraded":"2024-04-21T10:21:24.098949+0000","last_fullsized":"2024-04-21T10:21:24.098949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:43.283515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088302+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:21:24.088302+0000","last_peered":"2024-04-21T10:21:24.088302+0000","last_clean":"2024-04-21T10:21:24.088302+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:21:24.088302+0000","last_undegraded":"2024-04-21T10:21:24.088302+0000","last_fullsized":"2024-04-21T10:21:24.088302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100585+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:21:24.100585+0000","last_peered":"2024-04-21T10:21:24.100585+0000","last_clean":"2024-04-21T10:21:24.100585+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:21:24.100585+0000","last_undegraded":"2024-04-21T10:21:24.100585+0000","last_fullsized":"2024-04-21T10:21:24.100585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099409+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:21:24.099409+0000","last_peered":"2024-04-21T10:21:24.099409+0000","last_clean":"2024-04-21T10:21:24.099409+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:21:24.099409+0000","last_undegraded":"2024-04-21T10:21:24.099409+0000","last_fullsized":"2024-04-21T10:21:24.099409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098965+0000","last_change":"2024-04-21T10:20:15.828140+0000","last_active":"2024-04-21T10:21:24.098965+0000","last_peered":"2024-04-21T10:21:24.098965+0000","last_clean":"2024-04-21T10:21:24.098965+0000","last_became_active":"2024-04-21T10:20:15.827748+0000","last_became_peered":"2024-04-21T10:20:15.827748+0000","last_unstale":"2024-04-21T10:21:24.098965+0000","last_undegraded":"2024-04-21T10:21:24.098965+0000","last_fullsized":"2024-04-21T10:21:24.098965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:57.570062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'35","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.171636+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:21:24.171636+0000","last_peered":"2024-04-21T10:21:24.171636+0000","last_clean":"2024-04-21T10:21:24.171636+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:21:24.171636+0000","last_undegraded":"2024-04-21T10:21:24.171636+0000","last_fullsized":"2024-04-21T10:21:24.171636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65201,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":187,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098447+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:21:24.098447+0000","last_peered":"2024-04-21T10:21:24.098447+0000","last_clean":"2024-04-21T10:21:24.098447+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:21:24.098447+0000","last_undegraded":"2024-04-21T10:21:24.098447+0000","last_fullsized":"2024-04-21T10:21:24.098447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099233+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:21:24.099233+0000","last_peered":"2024-04-21T10:21:24.099233+0000","last_clean":"2024-04-21T10:21:24.099233+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:21:24.099233+0000","last_undegraded":"2024-04-21T10:21:24.099233+0000","last_fullsized":"2024-04-21T10:21:24.099233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098950+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:21:24.098950+0000","last_peered":"2024-04-21T10:21:24.098950+0000","last_clean":"2024-04-21T10:21:24.098950+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:21:24.098950+0000","last_undegraded":"2024-04-21T10:21:24.098950+0000","last_fullsized":"2024-04-21T10:21:24.098950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099037+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:21:24.099037+0000","last_peered":"2024-04-21T10:21:24.099037+0000","last_clean":"2024-04-21T10:21:24.099037+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:21:24.099037+0000","last_undegraded":"2024-04-21T10:21:24.099037+0000","last_fullsized":"2024-04-21T10:21:24.099037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088290+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:21:24.088290+0000","last_peered":"2024-04-21T10:21:24.088290+0000","last_clean":"2024-04-21T10:21:24.088290+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:21:24.088290+0000","last_undegraded":"2024-04-21T10:21:24.088290+0000","last_fullsized":"2024-04-21T10:21:24.088290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:52:23.121128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.332244+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:21:24.332244+0000","last_peered":"2024-04-21T10:21:24.332244+0000","last_clean":"2024-04-21T10:21:24.332244+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:21:24.332244+0000","last_undegraded":"2024-04-21T10:21:24.332244+0000","last_fullsized":"2024-04-21T10:21:24.332244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.087998+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:21:24.087998+0000","last_peered":"2024-04-21T10:21:24.087998+0000","last_clean":"2024-04-21T10:21:24.087998+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:21:24.087998+0000","last_undegraded":"2024-04-21T10:21:24.087998+0000","last_fullsized":"2024-04-21T10:21:24.087998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:19:57.323697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090149+0000","last_change":"2024-04-21T10:20:15.847040+0000","last_active":"2024-04-21T10:21:24.090149+0000","last_peered":"2024-04-21T10:21:24.090149+0000","last_clean":"2024-04-21T10:21:24.090149+0000","last_became_active":"2024-04-21T10:20:15.828688+0000","last_became_peered":"2024-04-21T10:20:15.828688+0000","last_unstale":"2024-04-21T10:21:24.090149+0000","last_undegraded":"2024-04-21T10:21:24.090149+0000","last_fullsized":"2024-04-21T10:21:24.090149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:42:55.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089153+0000","last_change":"2024-04-21T10:20:15.824670+0000","last_active":"2024-04-21T10:21:24.089153+0000","last_peered":"2024-04-21T10:21:24.089153+0000","last_clean":"2024-04-21T10:21:24.089153+0000","last_became_active":"2024-04-21T10:20:15.824428+0000","last_became_peered":"2024-04-21T10:20:15.824428+0000","last_unstale":"2024-04-21T10:21:24.089153+0000","last_undegraded":"2024-04-21T10:21:24.089153+0000","last_fullsized":"2024-04-21T10:21:24.089153+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:23:50.732573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"88'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098837+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:21:24.098837+0000","last_peered":"2024-04-21T10:21:24.098837+0000","last_clean":"2024-04-21T10:21:24.098837+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:21:24.098837+0000","last_undegraded":"2024-04-21T10:21:24.098837+0000","last_fullsized":"2024-04-21T10:21:24.098837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090505+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:21:24.090505+0000","last_peered":"2024-04-21T10:21:24.090505+0000","last_clean":"2024-04-21T10:21:24.090505+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:21:24.090505+0000","last_undegraded":"2024-04-21T10:21:24.090505+0000","last_fullsized":"2024-04-21T10:21:24.090505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:44:18.798775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089228+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:21:24.089228+0000","last_peered":"2024-04-21T10:21:24.089228+0000","last_clean":"2024-04-21T10:21:24.089228+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:21:24.089228+0000","last_undegraded":"2024-04-21T10:21:24.089228+0000","last_fullsized":"2024-04-21T10:21:24.089228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099742+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:21:24.099742+0000","last_peered":"2024-04-21T10:21:24.099742+0000","last_clean":"2024-04-21T10:21:24.099742+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:21:24.099742+0000","last_undegraded":"2024-04-21T10:21:24.099742+0000","last_fullsized":"2024-04-21T10:21:24.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:39:16.369964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088236+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:21:24.088236+0000","last_peered":"2024-04-21T10:21:24.088236+0000","last_clean":"2024-04-21T10:21:24.088236+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:21:24.088236+0000","last_undegraded":"2024-04-21T10:21:24.088236+0000","last_fullsized":"2024-04-21T10:21:24.088236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099447+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:21:24.099447+0000","last_peered":"2024-04-21T10:21:24.099447+0000","last_clean":"2024-04-21T10:21:24.099447+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:21:24.099447+0000","last_undegraded":"2024-04-21T10:21:24.099447+0000","last_fullsized":"2024-04-21T10:21:24.099447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:05:27.020650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099022+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:21:24.099022+0000","last_peered":"2024-04-21T10:21:24.099022+0000","last_clean":"2024-04-21T10:21:24.099022+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:21:24.099022+0000","last_undegraded":"2024-04-21T10:21:24.099022+0000","last_fullsized":"2024-04-21T10:21:24.099022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:05:15.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.184732+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:21:24.184732+0000","last_peered":"2024-04-21T10:21:24.184732+0000","last_clean":"2024-04-21T10:21:24.184732+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:21:24.184732+0000","last_undegraded":"2024-04-21T10:21:24.184732+0000","last_fullsized":"2024-04-21T10:21:24.184732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099583+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:21:24.099583+0000","last_peered":"2024-04-21T10:21:24.099583+0000","last_clean":"2024-04-21T10:21:24.099583+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:21:24.099583+0000","last_undegraded":"2024-04-21T10:21:24.099583+0000","last_fullsized":"2024-04-21T10:21:24.099583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:41:15.466810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098845+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:21:24.098845+0000","last_peered":"2024-04-21T10:21:24.098845+0000","last_clean":"2024-04-21T10:21:24.098845+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:21:24.098845+0000","last_undegraded":"2024-04-21T10:21:24.098845+0000","last_fullsized":"2024-04-21T10:21:24.098845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088048+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:21:24.088048+0000","last_peered":"2024-04-21T10:21:24.088048+0000","last_clean":"2024-04-21T10:21:24.088048+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:21:24.088048+0000","last_undegraded":"2024-04-21T10:21:24.088048+0000","last_fullsized":"2024-04-21T10:21:24.088048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098694+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:21:24.098694+0000","last_peered":"2024-04-21T10:21:24.098694+0000","last_clean":"2024-04-21T10:21:24.098694+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:21:24.098694+0000","last_undegraded":"2024-04-21T10:21:24.098694+0000","last_fullsized":"2024-04-21T10:21:24.098694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088285+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:21:24.088285+0000","last_peered":"2024-04-21T10:21:24.088285+0000","last_clean":"2024-04-21T10:21:24.088285+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:21:24.088285+0000","last_undegraded":"2024-04-21T10:21:24.088285+0000","last_fullsized":"2024-04-21T10:21:24.088285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098548+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:21:24.098548+0000","last_peered":"2024-04-21T10:21:24.098548+0000","last_clean":"2024-04-21T10:21:24.098548+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:21:24.098548+0000","last_undegraded":"2024-04-21T10:21:24.098548+0000","last_fullsized":"2024-04-21T10:21:24.098548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099455+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:21:24.099455+0000","last_peered":"2024-04-21T10:21:24.099455+0000","last_clean":"2024-04-21T10:21:24.099455+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:21:24.099455+0000","last_undegraded":"2024-04-21T10:21:24.099455+0000","last_fullsized":"2024-04-21T10:21:24.099455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'43","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.288740+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:21:24.288740+0000","last_peered":"2024-04-21T10:21:24.288740+0000","last_clean":"2024-04-21T10:21:24.288740+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:21:24.288740+0000","last_undegraded":"2024-04-21T10:21:24.288740+0000","last_fullsized":"2024-04-21T10:21:24.288740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":77,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100103+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:21:24.100103+0000","last_peered":"2024-04-21T10:21:24.100103+0000","last_clean":"2024-04-21T10:21:24.100103+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:21:24.100103+0000","last_undegraded":"2024-04-21T10:21:24.100103+0000","last_fullsized":"2024-04-21T10:21:24.100103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:17.595175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098760+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:21:24.098760+0000","last_peered":"2024-04-21T10:21:24.098760+0000","last_clean":"2024-04-21T10:21:24.098760+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:21:24.098760+0000","last_undegraded":"2024-04-21T10:21:24.098760+0000","last_fullsized":"2024-04-21T10:21:24.098760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100528+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:21:24.100528+0000","last_peered":"2024-04-21T10:21:24.100528+0000","last_clean":"2024-04-21T10:21:24.100528+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:21:24.100528+0000","last_undegraded":"2024-04-21T10:21:24.100528+0000","last_fullsized":"2024-04-21T10:21:24.100528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098532+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:21:24.098532+0000","last_peered":"2024-04-21T10:21:24.098532+0000","last_clean":"2024-04-21T10:21:24.098532+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:21:24.098532+0000","last_undegraded":"2024-04-21T10:21:24.098532+0000","last_fullsized":"2024-04-21T10:21:24.098532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098184+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:21:24.098184+0000","last_peered":"2024-04-21T10:21:24.098184+0000","last_clean":"2024-04-21T10:21:24.098184+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:21:24.098184+0000","last_undegraded":"2024-04-21T10:21:24.098184+0000","last_fullsized":"2024-04-21T10:21:24.098184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099138+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:21:24.099138+0000","last_peered":"2024-04-21T10:21:24.099138+0000","last_clean":"2024-04-21T10:21:24.099138+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:21:24.099138+0000","last_undegraded":"2024-04-21T10:21:24.099138+0000","last_fullsized":"2024-04-21T10:21:24.099138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090229+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:21:24.090229+0000","last_peered":"2024-04-21T10:21:24.090229+0000","last_clean":"2024-04-21T10:21:24.090229+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:21:24.090229+0000","last_undegraded":"2024-04-21T10:21:24.090229+0000","last_fullsized":"2024-04-21T10:21:24.090229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:16:31.547608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099004+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:21:24.099004+0000","last_peered":"2024-04-21T10:21:24.099004+0000","last_clean":"2024-04-21T10:21:24.099004+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:21:24.099004+0000","last_undegraded":"2024-04-21T10:21:24.099004+0000","last_fullsized":"2024-04-21T10:21:24.099004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099812+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:21:24.099812+0000","last_peered":"2024-04-21T10:21:24.099812+0000","last_clean":"2024-04-21T10:21:24.099812+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:21:24.099812+0000","last_undegraded":"2024-04-21T10:21:24.099812+0000","last_fullsized":"2024-04-21T10:21:24.099812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:34:48.679940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098352+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:21:24.098352+0000","last_peered":"2024-04-21T10:21:24.098352+0000","last_clean":"2024-04-21T10:21:24.098352+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:21:24.098352+0000","last_undegraded":"2024-04-21T10:21:24.098352+0000","last_fullsized":"2024-04-21T10:21:24.098352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088357+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:21:24.088357+0000","last_peered":"2024-04-21T10:21:24.088357+0000","last_clean":"2024-04-21T10:21:24.088357+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:21:24.088357+0000","last_undegraded":"2024-04-21T10:21:24.088357+0000","last_fullsized":"2024-04-21T10:21:24.088357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:52:13.768086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099580+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:21:24.099580+0000","last_peered":"2024-04-21T10:21:24.099580+0000","last_clean":"2024-04-21T10:21:24.099580+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:21:24.099580+0000","last_undegraded":"2024-04-21T10:21:24.099580+0000","last_fullsized":"2024-04-21T10:21:24.099580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088416+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:21:24.088416+0000","last_peered":"2024-04-21T10:21:24.088416+0000","last_clean":"2024-04-21T10:21:24.088416+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:21:24.088416+0000","last_undegraded":"2024-04-21T10:21:24.088416+0000","last_fullsized":"2024-04-21T10:21:24.088416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:20:52.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.286743+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:21:24.286743+0000","last_peered":"2024-04-21T10:21:24.286743+0000","last_clean":"2024-04-21T10:21:24.286743+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:21:24.286743+0000","last_undegraded":"2024-04-21T10:21:24.286743+0000","last_fullsized":"2024-04-21T10:21:24.286743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088170+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:21:24.088170+0000","last_peered":"2024-04-21T10:21:24.088170+0000","last_clean":"2024-04-21T10:21:24.088170+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:21:24.088170+0000","last_undegraded":"2024-04-21T10:21:24.088170+0000","last_fullsized":"2024-04-21T10:21:24.088170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:34:13.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099326+0000","last_change":"2024-04-21T10:20:15.830810+0000","last_active":"2024-04-21T10:21:24.099326+0000","last_peered":"2024-04-21T10:21:24.099326+0000","last_clean":"2024-04-21T10:21:24.099326+0000","last_became_active":"2024-04-21T10:20:15.826657+0000","last_became_peered":"2024-04-21T10:20:15.826657+0000","last_unstale":"2024-04-21T10:21:24.099326+0000","last_undegraded":"2024-04-21T10:21:24.099326+0000","last_fullsized":"2024-04-21T10:21:24.099326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:12:19.425100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088577+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:21:24.088577+0000","last_peered":"2024-04-21T10:21:24.088577+0000","last_clean":"2024-04-21T10:21:24.088577+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:21:24.088577+0000","last_undegraded":"2024-04-21T10:21:24.088577+0000","last_fullsized":"2024-04-21T10:21:24.088577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:10:06.613615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090319+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:21:24.090319+0000","last_peered":"2024-04-21T10:21:24.090319+0000","last_clean":"2024-04-21T10:21:24.090319+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:21:24.090319+0000","last_undegraded":"2024-04-21T10:21:24.090319+0000","last_fullsized":"2024-04-21T10:21:24.090319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:54:10.827986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098626+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:21:24.098626+0000","last_peered":"2024-04-21T10:21:24.098626+0000","last_clean":"2024-04-21T10:21:24.098626+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:21:24.098626+0000","last_undegraded":"2024-04-21T10:21:24.098626+0000","last_fullsized":"2024-04-21T10:21:24.098626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:30:54.398105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098859+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:21:24.098859+0000","last_peered":"2024-04-21T10:21:24.098859+0000","last_clean":"2024-04-21T10:21:24.098859+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:21:24.098859+0000","last_undegraded":"2024-04-21T10:21:24.098859+0000","last_fullsized":"2024-04-21T10:21:24.098859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:15.894562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100072+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:21:24.100072+0000","last_peered":"2024-04-21T10:21:24.100072+0000","last_clean":"2024-04-21T10:21:24.100072+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:21:24.100072+0000","last_undegraded":"2024-04-21T10:21:24.100072+0000","last_fullsized":"2024-04-21T10:21:24.100072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099614+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:21:24.099614+0000","last_peered":"2024-04-21T10:21:24.099614+0000","last_clean":"2024-04-21T10:21:24.099614+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:21:24.099614+0000","last_undegraded":"2024-04-21T10:21:24.099614+0000","last_fullsized":"2024-04-21T10:21:24.099614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090386+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:21:24.090386+0000","last_peered":"2024-04-21T10:21:24.090386+0000","last_clean":"2024-04-21T10:21:24.090386+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:21:24.090386+0000","last_undegraded":"2024-04-21T10:21:24.090386+0000","last_fullsized":"2024-04-21T10:21:24.090386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:55:02.979989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099006+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:21:24.099006+0000","last_peered":"2024-04-21T10:21:24.099006+0000","last_clean":"2024-04-21T10:21:24.099006+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:21:24.099006+0000","last_undegraded":"2024-04-21T10:21:24.099006+0000","last_fullsized":"2024-04-21T10:21:24.099006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:14:13.509778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089253+0000","last_change":"2024-04-21T10:20:15.830207+0000","last_active":"2024-04-21T10:21:24.089253+0000","last_peered":"2024-04-21T10:21:24.089253+0000","last_clean":"2024-04-21T10:21:24.089253+0000","last_became_active":"2024-04-21T10:20:15.829809+0000","last_became_peered":"2024-04-21T10:20:15.829809+0000","last_unstale":"2024-04-21T10:21:24.089253+0000","last_undegraded":"2024-04-21T10:21:24.089253+0000","last_fullsized":"2024-04-21T10:21:24.089253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:21:03.485624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099538+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:21:24.099538+0000","last_peered":"2024-04-21T10:21:24.099538+0000","last_clean":"2024-04-21T10:21:24.099538+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:21:24.099538+0000","last_undegraded":"2024-04-21T10:21:24.099538+0000","last_fullsized":"2024-04-21T10:21:24.099538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:44:20.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099081+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:21:24.099081+0000","last_peered":"2024-04-21T10:21:24.099081+0000","last_clean":"2024-04-21T10:21:24.099081+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:21:24.099081+0000","last_undegraded":"2024-04-21T10:21:24.099081+0000","last_fullsized":"2024-04-21T10:21:24.099081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:48:22.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098831+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:21:24.098831+0000","last_peered":"2024-04-21T10:21:24.098831+0000","last_clean":"2024-04-21T10:21:24.098831+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:21:24.098831+0000","last_undegraded":"2024-04-21T10:21:24.098831+0000","last_fullsized":"2024-04-21T10:21:24.098831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:18:46.271474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099406+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:21:24.099406+0000","last_peered":"2024-04-21T10:21:24.099406+0000","last_clean":"2024-04-21T10:21:24.099406+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:21:24.099406+0000","last_undegraded":"2024-04-21T10:21:24.099406+0000","last_fullsized":"2024-04-21T10:21:24.099406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090255+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:21:24.090255+0000","last_peered":"2024-04-21T10:21:24.090255+0000","last_clean":"2024-04-21T10:21:24.090255+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:21:24.090255+0000","last_undegraded":"2024-04-21T10:21:24.090255+0000","last_fullsized":"2024-04-21T10:21:24.090255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:32:45.653309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595473,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":835,"num_read_kb":524,"num_write":284,"num_write_kb":1434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1786419,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":465244,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1130496,"data_stored":1254728,"data_compressed":45182,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":858584,"data_compressed":22042,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":858392,"data_compressed":22042,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1019904,"data_stored":1058673,"data_compressed":39026,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":464757,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":529360,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":466028,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":531633,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":989884,"data_compressed":28198,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":466508,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":1188643,"data_compressed":45182,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133608,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":393842,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":199693,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:21:29.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Updating smithi170:/etc/ceph/ceph.conf 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Updating smithi191:/etc/ceph/ceph.conf 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/911997516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/30365649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2516120181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:21:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:21:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:21:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 -- 172.21.15.77:0/2228065655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24105e30 msgr2=0x7f3f24106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/2228065655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24105e30 0x7f3f24106210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009930 tx=0x7f3f1402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 -- 172.21.15.77:0/2228065655 shutdown_connections 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/2228065655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f24101b60 0x7f3f2410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/2228065655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f241011a0 0x7f3f24101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/2228065655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24105e30 0x7f3f24106210 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 -- 172.21.15.77:0/2228065655 >> 172.21.15.77:0/2228065655 conn(0x7f3f24077e30 msgr2=0x7f3f24078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 -- 172.21.15.77:0/2228065655 shutdown_connections 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.415+0000 7f3f28cd2640 1 -- 172.21.15.77:0/2228065655 wait complete. 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 Processor -- start 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 -- start start 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f241011a0 0x7f3f24199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 0x7f3f24199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f24105e30 0x7f3f241a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241110e0 con 0x7f3f24101b60 2024-04-21T10:21:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24110f60 con 0x7f3f241011a0 2024-04-21T10:21:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f28cd2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24111260 con 0x7f3f24105e30 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 0x7f3f24199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 0x7f3f24199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34160/0 (socket says 172.21.15.77:34160) 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f1bfff640 1 -- 172.21.15.77:0/1254840865 learned_addr learned my addr 172.21.15.77:0/1254840865 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f2259c640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f241011a0 0x7f3f24199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.416+0000 7f3f22d9d640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f24105e30 0x7f3f241a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1bfff640 1 -- 172.21.15.77:0/1254840865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f24105e30 msgr2=0x7f3f241a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1bfff640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f24105e30 0x7f3f241a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1bfff640 1 -- 172.21.15.77:0/1254840865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f241011a0 msgr2=0x7f3f24199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1bfff640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f241011a0 0x7f3f24199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1bfff640 1 -- 172.21.15.77:0/1254840865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f241a4b40 con 0x7f3f24101b60 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f22d9d640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f24105e30 0x7f3f241a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1bfff640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 0x7f3f24199ac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00d770 tx=0x7f3f0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c017070 con 0x7f3f24101b60 2024-04-21T10:21:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f241a4d10 con 0x7f3f24101b60 2024-04-21T10:21:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f0c0054d0 con 0x7f3f24101b60 2024-04-21T10:21:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c004c30 con 0x7f3f24101b60 2024-04-21T10:21:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.417+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f241a5200 con 0x7f3f24101b60 2024-04-21T10:21:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.418+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f24102570 con 0x7f3f24101b60 2024-04-21T10:21:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.419+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f3f0c004e10 con 0x7f3f24101b60 2024-04-21T10:21:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.420+0000 7f3f1b7fe640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3f100a3db0 0x7f3f100a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.420+0000 7f3f2259c640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3f100a3db0 0x7f3f100a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.420+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3f0c0d0440 con 0x7f3f24101b60 2024-04-21T10:21:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.420+0000 7f3f2259c640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3f100a3db0 0x7f3f100a6270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f14005ab0 tx=0x7f3f14005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:29.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.424+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3f0c09c9a0 con 0x7f3f24101b60 2024-04-21T10:21:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.597+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f24062390 con 0x7f3f100a3db0 2024-04-21T10:21:29.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.605+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1254840865 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258000 (secure 0 0 0) 0x7f3f24062390 con 0x7f3f100a3db0 2024-04-21T10:21:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:29.608 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.607+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3f100a3db0 msgr2=0x7f3f100a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.607+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3f100a3db0 0x7f3f100a6270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f14005ab0 tx=0x7f3f14005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.607+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 msgr2=0x7f3f24199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.607+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 0x7f3f24199ac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00d770 tx=0x7f3f0c00dc30 comp rx=0 tx=0).stop 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 shutdown_connections 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3f100a3db0 0x7f3f100a6270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f24101b60 0x7f3f24199ac0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f24105e30 0x7f3f241a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 --2- 172.21.15.77:0/1254840865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f241011a0 0x7f3f24199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 >> 172.21.15.77:0/1254840865 conn(0x7f3f24077e30 msgr2=0x7f3f240fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:29.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 shutdown_connections 2024-04-21T10:21:29.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.608+0000 7f3f28cd2640 1 -- 172.21.15.77:0/1254840865 wait complete. 2024-04-21T10:21:29.618 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-21T10:21:28.103670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186075,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":971,"num_read_kb":643,"num_write":467,"num_write_kb":4374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365228,"kb_used_data":11856,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576596,"statfs":{"total":1151940427776,"available":1151566434304,"internally_reserved":0,"allocated":12140544,"data_stored":9132434,"data_compressed":219048,"data_compressed_allocated":282624,"data_compressed_original":3416064,"omap_allocated":19137,"internal_metadata":361674047},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.992891"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090548+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:21:24.090548+0000","last_peered":"2024-04-21T10:21:24.090548+0000","last_clean":"2024-04-21T10:21:24.090548+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:21:24.090548+0000","last_undegraded":"2024-04-21T10:21:24.090548+0000","last_fullsized":"2024-04-21T10:21:24.090548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:06:40.220736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100392+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:21:24.100392+0000","last_peered":"2024-04-21T10:21:24.100392+0000","last_clean":"2024-04-21T10:21:24.100392+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:21:24.100392+0000","last_undegraded":"2024-04-21T10:21:24.100392+0000","last_fullsized":"2024-04-21T10:21:24.100392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100211+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:21:24.100211+0000","last_peered":"2024-04-21T10:21:24.100211+0000","last_clean":"2024-04-21T10:21:24.100211+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:21:24.100211+0000","last_undegraded":"2024-04-21T10:21:24.100211+0000","last_fullsized":"2024-04-21T10:21:24.100211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099216+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:21:24.099216+0000","last_peered":"2024-04-21T10:21:24.099216+0000","last_clean":"2024-04-21T10:21:24.099216+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:21:24.099216+0000","last_undegraded":"2024-04-21T10:21:24.099216+0000","last_fullsized":"2024-04-21T10:21:24.099216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098192+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:21:24.098192+0000","last_peered":"2024-04-21T10:21:24.098192+0000","last_clean":"2024-04-21T10:21:24.098192+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:21:24.098192+0000","last_undegraded":"2024-04-21T10:21:24.098192+0000","last_fullsized":"2024-04-21T10:21:24.098192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099585+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:21:24.099585+0000","last_peered":"2024-04-21T10:21:24.099585+0000","last_clean":"2024-04-21T10:21:24.099585+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:21:24.099585+0000","last_undegraded":"2024-04-21T10:21:24.099585+0000","last_fullsized":"2024-04-21T10:21:24.099585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:57.136408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088030+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:21:24.088030+0000","last_peered":"2024-04-21T10:21:24.088030+0000","last_clean":"2024-04-21T10:21:24.088030+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:21:24.088030+0000","last_undegraded":"2024-04-21T10:21:24.088030+0000","last_fullsized":"2024-04-21T10:21:24.088030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:17.305626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098594+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:21:24.098594+0000","last_peered":"2024-04-21T10:21:24.098594+0000","last_clean":"2024-04-21T10:21:24.098594+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:21:24.098594+0000","last_undegraded":"2024-04-21T10:21:24.098594+0000","last_fullsized":"2024-04-21T10:21:24.098594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:52.203999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099373+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:21:24.099373+0000","last_peered":"2024-04-21T10:21:24.099373+0000","last_clean":"2024-04-21T10:21:24.099373+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:21:24.099373+0000","last_undegraded":"2024-04-21T10:21:24.099373+0000","last_fullsized":"2024-04-21T10:21:24.099373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:26:01.902847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099831+0000","last_change":"2024-04-21T10:20:15.830905+0000","last_active":"2024-04-21T10:21:24.099831+0000","last_peered":"2024-04-21T10:21:24.099831+0000","last_clean":"2024-04-21T10:21:24.099831+0000","last_became_active":"2024-04-21T10:20:15.830536+0000","last_became_peered":"2024-04-21T10:20:15.830536+0000","last_unstale":"2024-04-21T10:21:24.099831+0000","last_undegraded":"2024-04-21T10:21:24.099831+0000","last_fullsized":"2024-04-21T10:21:24.099831+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:02:48.213874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088389+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:21:24.088389+0000","last_peered":"2024-04-21T10:21:24.088389+0000","last_clean":"2024-04-21T10:21:24.088389+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:21:24.088389+0000","last_undegraded":"2024-04-21T10:21:24.088389+0000","last_fullsized":"2024-04-21T10:21:24.088389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:52:25.586003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099003+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:21:24.099003+0000","last_peered":"2024-04-21T10:21:24.099003+0000","last_clean":"2024-04-21T10:21:24.099003+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:21:24.099003+0000","last_undegraded":"2024-04-21T10:21:24.099003+0000","last_fullsized":"2024-04-21T10:21:24.099003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099226+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:21:24.099226+0000","last_peered":"2024-04-21T10:21:24.099226+0000","last_clean":"2024-04-21T10:21:24.099226+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:21:24.099226+0000","last_undegraded":"2024-04-21T10:21:24.099226+0000","last_fullsized":"2024-04-21T10:21:24.099226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099423+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:21:24.099423+0000","last_peered":"2024-04-21T10:21:24.099423+0000","last_clean":"2024-04-21T10:21:24.099423+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:21:24.099423+0000","last_undegraded":"2024-04-21T10:21:24.099423+0000","last_fullsized":"2024-04-21T10:21:24.099423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098662+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:21:24.098662+0000","last_peered":"2024-04-21T10:21:24.098662+0000","last_clean":"2024-04-21T10:21:24.098662+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:21:24.098662+0000","last_undegraded":"2024-04-21T10:21:24.098662+0000","last_fullsized":"2024-04-21T10:21:24.098662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098508+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:21:24.098508+0000","last_peered":"2024-04-21T10:21:24.098508+0000","last_clean":"2024-04-21T10:21:24.098508+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:21:24.098508+0000","last_undegraded":"2024-04-21T10:21:24.098508+0000","last_fullsized":"2024-04-21T10:21:24.098508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:04:32.551997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090693+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:21:24.090693+0000","last_peered":"2024-04-21T10:21:24.090693+0000","last_clean":"2024-04-21T10:21:24.090693+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:21:24.090693+0000","last_undegraded":"2024-04-21T10:21:24.090693+0000","last_fullsized":"2024-04-21T10:21:24.090693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:10:09.025923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089286+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:21:24.089286+0000","last_peered":"2024-04-21T10:21:24.089286+0000","last_clean":"2024-04-21T10:21:24.089286+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:21:24.089286+0000","last_undegraded":"2024-04-21T10:21:24.089286+0000","last_fullsized":"2024-04-21T10:21:24.089286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098568+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:21:24.098568+0000","last_peered":"2024-04-21T10:21:24.098568+0000","last_clean":"2024-04-21T10:21:24.098568+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:21:24.098568+0000","last_undegraded":"2024-04-21T10:21:24.098568+0000","last_fullsized":"2024-04-21T10:21:24.098568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:37:23.490245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089417+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:21:24.089417+0000","last_peered":"2024-04-21T10:21:24.089417+0000","last_clean":"2024-04-21T10:21:24.089417+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:21:24.089417+0000","last_undegraded":"2024-04-21T10:21:24.089417+0000","last_fullsized":"2024-04-21T10:21:24.089417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100322+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:21:24.100322+0000","last_peered":"2024-04-21T10:21:24.100322+0000","last_clean":"2024-04-21T10:21:24.100322+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:21:24.100322+0000","last_undegraded":"2024-04-21T10:21:24.100322+0000","last_fullsized":"2024-04-21T10:21:24.100322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:26.283821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100467+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:21:24.100467+0000","last_peered":"2024-04-21T10:21:24.100467+0000","last_clean":"2024-04-21T10:21:24.100467+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:21:24.100467+0000","last_undegraded":"2024-04-21T10:21:24.100467+0000","last_fullsized":"2024-04-21T10:21:24.100467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100603+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:21:24.100603+0000","last_peered":"2024-04-21T10:21:24.100603+0000","last_clean":"2024-04-21T10:21:24.100603+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:21:24.100603+0000","last_undegraded":"2024-04-21T10:21:24.100603+0000","last_fullsized":"2024-04-21T10:21:24.100603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098657+0000","last_change":"2024-04-21T10:20:15.833712+0000","last_active":"2024-04-21T10:21:24.098657+0000","last_peered":"2024-04-21T10:21:24.098657+0000","last_clean":"2024-04-21T10:21:24.098657+0000","last_became_active":"2024-04-21T10:20:15.827691+0000","last_became_peered":"2024-04-21T10:20:15.827691+0000","last_unstale":"2024-04-21T10:21:24.098657+0000","last_undegraded":"2024-04-21T10:21:24.098657+0000","last_fullsized":"2024-04-21T10:21:24.098657+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:32:14.844485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098746+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:21:24.098746+0000","last_peered":"2024-04-21T10:21:24.098746+0000","last_clean":"2024-04-21T10:21:24.098746+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:21:24.098746+0000","last_undegraded":"2024-04-21T10:21:24.098746+0000","last_fullsized":"2024-04-21T10:21:24.098746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:55:54.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090231+0000","last_change":"2024-04-21T10:20:15.835895+0000","last_active":"2024-04-21T10:21:24.090231+0000","last_peered":"2024-04-21T10:21:24.090231+0000","last_clean":"2024-04-21T10:21:24.090231+0000","last_became_active":"2024-04-21T10:20:15.828529+0000","last_became_peered":"2024-04-21T10:20:15.828529+0000","last_unstale":"2024-04-21T10:21:24.090231+0000","last_undegraded":"2024-04-21T10:21:24.090231+0000","last_fullsized":"2024-04-21T10:21:24.090231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:09.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099361+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:21:24.099361+0000","last_peered":"2024-04-21T10:21:24.099361+0000","last_clean":"2024-04-21T10:21:24.099361+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:21:24.099361+0000","last_undegraded":"2024-04-21T10:21:24.099361+0000","last_fullsized":"2024-04-21T10:21:24.099361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:12:42.198001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099189+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:21:24.099189+0000","last_peered":"2024-04-21T10:21:24.099189+0000","last_clean":"2024-04-21T10:21:24.099189+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:21:24.099189+0000","last_undegraded":"2024-04-21T10:21:24.099189+0000","last_fullsized":"2024-04-21T10:21:24.099189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098381+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:21:24.098381+0000","last_peered":"2024-04-21T10:21:24.098381+0000","last_clean":"2024-04-21T10:21:24.098381+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:21:24.098381+0000","last_undegraded":"2024-04-21T10:21:24.098381+0000","last_fullsized":"2024-04-21T10:21:24.098381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099447+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:21:24.099447+0000","last_peered":"2024-04-21T10:21:24.099447+0000","last_clean":"2024-04-21T10:21:24.099447+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:21:24.099447+0000","last_undegraded":"2024-04-21T10:21:24.099447+0000","last_fullsized":"2024-04-21T10:21:24.099447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099161+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:21:24.099161+0000","last_peered":"2024-04-21T10:21:24.099161+0000","last_clean":"2024-04-21T10:21:24.099161+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:21:24.099161+0000","last_undegraded":"2024-04-21T10:21:24.099161+0000","last_fullsized":"2024-04-21T10:21:24.099161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:48:22.623681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098911+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:21:24.098911+0000","last_peered":"2024-04-21T10:21:24.098911+0000","last_clean":"2024-04-21T10:21:24.098911+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:21:24.098911+0000","last_undegraded":"2024-04-21T10:21:24.098911+0000","last_fullsized":"2024-04-21T10:21:24.098911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098842+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:21:24.098842+0000","last_peered":"2024-04-21T10:21:24.098842+0000","last_clean":"2024-04-21T10:21:24.098842+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:21:24.098842+0000","last_undegraded":"2024-04-21T10:21:24.098842+0000","last_fullsized":"2024-04-21T10:21:24.098842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:54.824898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098785+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:21:24.098785+0000","last_peered":"2024-04-21T10:21:24.098785+0000","last_clean":"2024-04-21T10:21:24.098785+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:21:24.098785+0000","last_undegraded":"2024-04-21T10:21:24.098785+0000","last_fullsized":"2024-04-21T10:21:24.098785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089231+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:21:24.089231+0000","last_peered":"2024-04-21T10:21:24.089231+0000","last_clean":"2024-04-21T10:21:24.089231+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:21:24.089231+0000","last_undegraded":"2024-04-21T10:21:24.089231+0000","last_fullsized":"2024-04-21T10:21:24.089231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099820+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:21:24.099820+0000","last_peered":"2024-04-21T10:21:24.099820+0000","last_clean":"2024-04-21T10:21:24.099820+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:21:24.099820+0000","last_undegraded":"2024-04-21T10:21:24.099820+0000","last_fullsized":"2024-04-21T10:21:24.099820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098949+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:21:24.098949+0000","last_peered":"2024-04-21T10:21:24.098949+0000","last_clean":"2024-04-21T10:21:24.098949+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:21:24.098949+0000","last_undegraded":"2024-04-21T10:21:24.098949+0000","last_fullsized":"2024-04-21T10:21:24.098949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:43.283515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088302+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:21:24.088302+0000","last_peered":"2024-04-21T10:21:24.088302+0000","last_clean":"2024-04-21T10:21:24.088302+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:21:24.088302+0000","last_undegraded":"2024-04-21T10:21:24.088302+0000","last_fullsized":"2024-04-21T10:21:24.088302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100585+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:21:24.100585+0000","last_peered":"2024-04-21T10:21:24.100585+0000","last_clean":"2024-04-21T10:21:24.100585+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:21:24.100585+0000","last_undegraded":"2024-04-21T10:21:24.100585+0000","last_fullsized":"2024-04-21T10:21:24.100585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099409+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:21:24.099409+0000","last_peered":"2024-04-21T10:21:24.099409+0000","last_clean":"2024-04-21T10:21:24.099409+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:21:24.099409+0000","last_undegraded":"2024-04-21T10:21:24.099409+0000","last_fullsized":"2024-04-21T10:21:24.099409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098965+0000","last_change":"2024-04-21T10:20:15.828140+0000","last_active":"2024-04-21T10:21:24.098965+0000","last_peered":"2024-04-21T10:21:24.098965+0000","last_clean":"2024-04-21T10:21:24.098965+0000","last_became_active":"2024-04-21T10:20:15.827748+0000","last_became_peered":"2024-04-21T10:20:15.827748+0000","last_unstale":"2024-04-21T10:21:24.098965+0000","last_undegraded":"2024-04-21T10:21:24.098965+0000","last_fullsized":"2024-04-21T10:21:24.098965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:57.570062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'35","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.171636+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:21:24.171636+0000","last_peered":"2024-04-21T10:21:24.171636+0000","last_clean":"2024-04-21T10:21:24.171636+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:21:24.171636+0000","last_undegraded":"2024-04-21T10:21:24.171636+0000","last_fullsized":"2024-04-21T10:21:24.171636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65201,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":187,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098447+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:21:24.098447+0000","last_peered":"2024-04-21T10:21:24.098447+0000","last_clean":"2024-04-21T10:21:24.098447+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:21:24.098447+0000","last_undegraded":"2024-04-21T10:21:24.098447+0000","last_fullsized":"2024-04-21T10:21:24.098447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099233+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:21:24.099233+0000","last_peered":"2024-04-21T10:21:24.099233+0000","last_clean":"2024-04-21T10:21:24.099233+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:21:24.099233+0000","last_undegraded":"2024-04-21T10:21:24.099233+0000","last_fullsized":"2024-04-21T10:21:24.099233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098950+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:21:24.098950+0000","last_peered":"2024-04-21T10:21:24.098950+0000","last_clean":"2024-04-21T10:21:24.098950+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:21:24.098950+0000","last_undegraded":"2024-04-21T10:21:24.098950+0000","last_fullsized":"2024-04-21T10:21:24.098950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099037+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:21:24.099037+0000","last_peered":"2024-04-21T10:21:24.099037+0000","last_clean":"2024-04-21T10:21:24.099037+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:21:24.099037+0000","last_undegraded":"2024-04-21T10:21:24.099037+0000","last_fullsized":"2024-04-21T10:21:24.099037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088290+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:21:24.088290+0000","last_peered":"2024-04-21T10:21:24.088290+0000","last_clean":"2024-04-21T10:21:24.088290+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:21:24.088290+0000","last_undegraded":"2024-04-21T10:21:24.088290+0000","last_fullsized":"2024-04-21T10:21:24.088290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:52:23.121128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.332244+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:21:24.332244+0000","last_peered":"2024-04-21T10:21:24.332244+0000","last_clean":"2024-04-21T10:21:24.332244+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:21:24.332244+0000","last_undegraded":"2024-04-21T10:21:24.332244+0000","last_fullsized":"2024-04-21T10:21:24.332244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.087998+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:21:24.087998+0000","last_peered":"2024-04-21T10:21:24.087998+0000","last_clean":"2024-04-21T10:21:24.087998+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:21:24.087998+0000","last_undegraded":"2024-04-21T10:21:24.087998+0000","last_fullsized":"2024-04-21T10:21:24.087998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:19:57.323697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090149+0000","last_change":"2024-04-21T10:20:15.847040+0000","last_active":"2024-04-21T10:21:24.090149+0000","last_peered":"2024-04-21T10:21:24.090149+0000","last_clean":"2024-04-21T10:21:24.090149+0000","last_became_active":"2024-04-21T10:20:15.828688+0000","last_became_peered":"2024-04-21T10:20:15.828688+0000","last_unstale":"2024-04-21T10:21:24.090149+0000","last_undegraded":"2024-04-21T10:21:24.090149+0000","last_fullsized":"2024-04-21T10:21:24.090149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:42:55.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089153+0000","last_change":"2024-04-21T10:20:15.824670+0000","last_active":"2024-04-21T10:21:24.089153+0000","last_peered":"2024-04-21T10:21:24.089153+0000","last_clean":"2024-04-21T10:21:24.089153+0000","last_became_active":"2024-04-21T10:20:15.824428+0000","last_became_peered":"2024-04-21T10:20:15.824428+0000","last_unstale":"2024-04-21T10:21:24.089153+0000","last_undegraded":"2024-04-21T10:21:24.089153+0000","last_fullsized":"2024-04-21T10:21:24.089153+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:23:50.732573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"88'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098837+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:21:24.098837+0000","last_peered":"2024-04-21T10:21:24.098837+0000","last_clean":"2024-04-21T10:21:24.098837+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:21:24.098837+0000","last_undegraded":"2024-04-21T10:21:24.098837+0000","last_fullsized":"2024-04-21T10:21:24.098837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090505+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:21:24.090505+0000","last_peered":"2024-04-21T10:21:24.090505+0000","last_clean":"2024-04-21T10:21:24.090505+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:21:24.090505+0000","last_undegraded":"2024-04-21T10:21:24.090505+0000","last_fullsized":"2024-04-21T10:21:24.090505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:44:18.798775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089228+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:21:24.089228+0000","last_peered":"2024-04-21T10:21:24.089228+0000","last_clean":"2024-04-21T10:21:24.089228+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:21:24.089228+0000","last_undegraded":"2024-04-21T10:21:24.089228+0000","last_fullsized":"2024-04-21T10:21:24.089228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099742+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:21:24.099742+0000","last_peered":"2024-04-21T10:21:24.099742+0000","last_clean":"2024-04-21T10:21:24.099742+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:21:24.099742+0000","last_undegraded":"2024-04-21T10:21:24.099742+0000","last_fullsized":"2024-04-21T10:21:24.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:39:16.369964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088236+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:21:24.088236+0000","last_peered":"2024-04-21T10:21:24.088236+0000","last_clean":"2024-04-21T10:21:24.088236+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:21:24.088236+0000","last_undegraded":"2024-04-21T10:21:24.088236+0000","last_fullsized":"2024-04-21T10:21:24.088236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099447+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:21:24.099447+0000","last_peered":"2024-04-21T10:21:24.099447+0000","last_clean":"2024-04-21T10:21:24.099447+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:21:24.099447+0000","last_undegraded":"2024-04-21T10:21:24.099447+0000","last_fullsized":"2024-04-21T10:21:24.099447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:05:27.020650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099022+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:21:24.099022+0000","last_peered":"2024-04-21T10:21:24.099022+0000","last_clean":"2024-04-21T10:21:24.099022+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:21:24.099022+0000","last_undegraded":"2024-04-21T10:21:24.099022+0000","last_fullsized":"2024-04-21T10:21:24.099022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:05:15.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.184732+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:21:24.184732+0000","last_peered":"2024-04-21T10:21:24.184732+0000","last_clean":"2024-04-21T10:21:24.184732+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:21:24.184732+0000","last_undegraded":"2024-04-21T10:21:24.184732+0000","last_fullsized":"2024-04-21T10:21:24.184732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099583+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:21:24.099583+0000","last_peered":"2024-04-21T10:21:24.099583+0000","last_clean":"2024-04-21T10:21:24.099583+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:21:24.099583+0000","last_undegraded":"2024-04-21T10:21:24.099583+0000","last_fullsized":"2024-04-21T10:21:24.099583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:41:15.466810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098845+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:21:24.098845+0000","last_peered":"2024-04-21T10:21:24.098845+0000","last_clean":"2024-04-21T10:21:24.098845+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:21:24.098845+0000","last_undegraded":"2024-04-21T10:21:24.098845+0000","last_fullsized":"2024-04-21T10:21:24.098845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088048+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:21:24.088048+0000","last_peered":"2024-04-21T10:21:24.088048+0000","last_clean":"2024-04-21T10:21:24.088048+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:21:24.088048+0000","last_undegraded":"2024-04-21T10:21:24.088048+0000","last_fullsized":"2024-04-21T10:21:24.088048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098694+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:21:24.098694+0000","last_peered":"2024-04-21T10:21:24.098694+0000","last_clean":"2024-04-21T10:21:24.098694+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:21:24.098694+0000","last_undegraded":"2024-04-21T10:21:24.098694+0000","last_fullsized":"2024-04-21T10:21:24.098694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088285+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:21:24.088285+0000","last_peered":"2024-04-21T10:21:24.088285+0000","last_clean":"2024-04-21T10:21:24.088285+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:21:24.088285+0000","last_undegraded":"2024-04-21T10:21:24.088285+0000","last_fullsized":"2024-04-21T10:21:24.088285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098548+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:21:24.098548+0000","last_peered":"2024-04-21T10:21:24.098548+0000","last_clean":"2024-04-21T10:21:24.098548+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:21:24.098548+0000","last_undegraded":"2024-04-21T10:21:24.098548+0000","last_fullsized":"2024-04-21T10:21:24.098548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099455+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:21:24.099455+0000","last_peered":"2024-04-21T10:21:24.099455+0000","last_clean":"2024-04-21T10:21:24.099455+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:21:24.099455+0000","last_undegraded":"2024-04-21T10:21:24.099455+0000","last_fullsized":"2024-04-21T10:21:24.099455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'43","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.288740+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:21:24.288740+0000","last_peered":"2024-04-21T10:21:24.288740+0000","last_clean":"2024-04-21T10:21:24.288740+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:21:24.288740+0000","last_undegraded":"2024-04-21T10:21:24.288740+0000","last_fullsized":"2024-04-21T10:21:24.288740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":77,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100103+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:21:24.100103+0000","last_peered":"2024-04-21T10:21:24.100103+0000","last_clean":"2024-04-21T10:21:24.100103+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:21:24.100103+0000","last_undegraded":"2024-04-21T10:21:24.100103+0000","last_fullsized":"2024-04-21T10:21:24.100103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:17.595175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098760+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:21:24.098760+0000","last_peered":"2024-04-21T10:21:24.098760+0000","last_clean":"2024-04-21T10:21:24.098760+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:21:24.098760+0000","last_undegraded":"2024-04-21T10:21:24.098760+0000","last_fullsized":"2024-04-21T10:21:24.098760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100528+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:21:24.100528+0000","last_peered":"2024-04-21T10:21:24.100528+0000","last_clean":"2024-04-21T10:21:24.100528+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:21:24.100528+0000","last_undegraded":"2024-04-21T10:21:24.100528+0000","last_fullsized":"2024-04-21T10:21:24.100528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098532+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:21:24.098532+0000","last_peered":"2024-04-21T10:21:24.098532+0000","last_clean":"2024-04-21T10:21:24.098532+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:21:24.098532+0000","last_undegraded":"2024-04-21T10:21:24.098532+0000","last_fullsized":"2024-04-21T10:21:24.098532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098184+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:21:24.098184+0000","last_peered":"2024-04-21T10:21:24.098184+0000","last_clean":"2024-04-21T10:21:24.098184+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:21:24.098184+0000","last_undegraded":"2024-04-21T10:21:24.098184+0000","last_fullsized":"2024-04-21T10:21:24.098184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099138+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:21:24.099138+0000","last_peered":"2024-04-21T10:21:24.099138+0000","last_clean":"2024-04-21T10:21:24.099138+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:21:24.099138+0000","last_undegraded":"2024-04-21T10:21:24.099138+0000","last_fullsized":"2024-04-21T10:21:24.099138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090229+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:21:24.090229+0000","last_peered":"2024-04-21T10:21:24.090229+0000","last_clean":"2024-04-21T10:21:24.090229+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:21:24.090229+0000","last_undegraded":"2024-04-21T10:21:24.090229+0000","last_fullsized":"2024-04-21T10:21:24.090229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:16:31.547608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099004+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:21:24.099004+0000","last_peered":"2024-04-21T10:21:24.099004+0000","last_clean":"2024-04-21T10:21:24.099004+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:21:24.099004+0000","last_undegraded":"2024-04-21T10:21:24.099004+0000","last_fullsized":"2024-04-21T10:21:24.099004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099812+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:21:24.099812+0000","last_peered":"2024-04-21T10:21:24.099812+0000","last_clean":"2024-04-21T10:21:24.099812+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:21:24.099812+0000","last_undegraded":"2024-04-21T10:21:24.099812+0000","last_fullsized":"2024-04-21T10:21:24.099812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:34:48.679940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098352+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:21:24.098352+0000","last_peered":"2024-04-21T10:21:24.098352+0000","last_clean":"2024-04-21T10:21:24.098352+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:21:24.098352+0000","last_undegraded":"2024-04-21T10:21:24.098352+0000","last_fullsized":"2024-04-21T10:21:24.098352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088357+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:21:24.088357+0000","last_peered":"2024-04-21T10:21:24.088357+0000","last_clean":"2024-04-21T10:21:24.088357+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:21:24.088357+0000","last_undegraded":"2024-04-21T10:21:24.088357+0000","last_fullsized":"2024-04-21T10:21:24.088357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:52:13.768086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099580+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:21:24.099580+0000","last_peered":"2024-04-21T10:21:24.099580+0000","last_clean":"2024-04-21T10:21:24.099580+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:21:24.099580+0000","last_undegraded":"2024-04-21T10:21:24.099580+0000","last_fullsized":"2024-04-21T10:21:24.099580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088416+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:21:24.088416+0000","last_peered":"2024-04-21T10:21:24.088416+0000","last_clean":"2024-04-21T10:21:24.088416+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:21:24.088416+0000","last_undegraded":"2024-04-21T10:21:24.088416+0000","last_fullsized":"2024-04-21T10:21:24.088416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:20:52.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.286743+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:21:24.286743+0000","last_peered":"2024-04-21T10:21:24.286743+0000","last_clean":"2024-04-21T10:21:24.286743+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:21:24.286743+0000","last_undegraded":"2024-04-21T10:21:24.286743+0000","last_fullsized":"2024-04-21T10:21:24.286743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088170+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:21:24.088170+0000","last_peered":"2024-04-21T10:21:24.088170+0000","last_clean":"2024-04-21T10:21:24.088170+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:21:24.088170+0000","last_undegraded":"2024-04-21T10:21:24.088170+0000","last_fullsized":"2024-04-21T10:21:24.088170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:34:13.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099326+0000","last_change":"2024-04-21T10:20:15.830810+0000","last_active":"2024-04-21T10:21:24.099326+0000","last_peered":"2024-04-21T10:21:24.099326+0000","last_clean":"2024-04-21T10:21:24.099326+0000","last_became_active":"2024-04-21T10:20:15.826657+0000","last_became_peered":"2024-04-21T10:20:15.826657+0000","last_unstale":"2024-04-21T10:21:24.099326+0000","last_undegraded":"2024-04-21T10:21:24.099326+0000","last_fullsized":"2024-04-21T10:21:24.099326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:12:19.425100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088577+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:21:24.088577+0000","last_peered":"2024-04-21T10:21:24.088577+0000","last_clean":"2024-04-21T10:21:24.088577+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:21:24.088577+0000","last_undegraded":"2024-04-21T10:21:24.088577+0000","last_fullsized":"2024-04-21T10:21:24.088577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:10:06.613615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090319+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:21:24.090319+0000","last_peered":"2024-04-21T10:21:24.090319+0000","last_clean":"2024-04-21T10:21:24.090319+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:21:24.090319+0000","last_undegraded":"2024-04-21T10:21:24.090319+0000","last_fullsized":"2024-04-21T10:21:24.090319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:54:10.827986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098626+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:21:24.098626+0000","last_peered":"2024-04-21T10:21:24.098626+0000","last_clean":"2024-04-21T10:21:24.098626+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:21:24.098626+0000","last_undegraded":"2024-04-21T10:21:24.098626+0000","last_fullsized":"2024-04-21T10:21:24.098626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:30:54.398105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098859+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:21:24.098859+0000","last_peered":"2024-04-21T10:21:24.098859+0000","last_clean":"2024-04-21T10:21:24.098859+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:21:24.098859+0000","last_undegraded":"2024-04-21T10:21:24.098859+0000","last_fullsized":"2024-04-21T10:21:24.098859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:15.894562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100072+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:21:24.100072+0000","last_peered":"2024-04-21T10:21:24.100072+0000","last_clean":"2024-04-21T10:21:24.100072+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:21:24.100072+0000","last_undegraded":"2024-04-21T10:21:24.100072+0000","last_fullsized":"2024-04-21T10:21:24.100072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099614+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:21:24.099614+0000","last_peered":"2024-04-21T10:21:24.099614+0000","last_clean":"2024-04-21T10:21:24.099614+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:21:24.099614+0000","last_undegraded":"2024-04-21T10:21:24.099614+0000","last_fullsized":"2024-04-21T10:21:24.099614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090386+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:21:24.090386+0000","last_peered":"2024-04-21T10:21:24.090386+0000","last_clean":"2024-04-21T10:21:24.090386+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:21:24.090386+0000","last_undegraded":"2024-04-21T10:21:24.090386+0000","last_fullsized":"2024-04-21T10:21:24.090386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:55:02.979989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099006+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:21:24.099006+0000","last_peered":"2024-04-21T10:21:24.099006+0000","last_clean":"2024-04-21T10:21:24.099006+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:21:24.099006+0000","last_undegraded":"2024-04-21T10:21:24.099006+0000","last_fullsized":"2024-04-21T10:21:24.099006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:14:13.509778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089253+0000","last_change":"2024-04-21T10:20:15.830207+0000","last_active":"2024-04-21T10:21:24.089253+0000","last_peered":"2024-04-21T10:21:24.089253+0000","last_clean":"2024-04-21T10:21:24.089253+0000","last_became_active":"2024-04-21T10:20:15.829809+0000","last_became_peered":"2024-04-21T10:20:15.829809+0000","last_unstale":"2024-04-21T10:21:24.089253+0000","last_undegraded":"2024-04-21T10:21:24.089253+0000","last_fullsized":"2024-04-21T10:21:24.089253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:21:03.485624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099538+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:21:24.099538+0000","last_peered":"2024-04-21T10:21:24.099538+0000","last_clean":"2024-04-21T10:21:24.099538+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:21:24.099538+0000","last_undegraded":"2024-04-21T10:21:24.099538+0000","last_fullsized":"2024-04-21T10:21:24.099538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:44:20.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099081+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:21:24.099081+0000","last_peered":"2024-04-21T10:21:24.099081+0000","last_clean":"2024-04-21T10:21:24.099081+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:21:24.099081+0000","last_undegraded":"2024-04-21T10:21:24.099081+0000","last_fullsized":"2024-04-21T10:21:24.099081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:48:22.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098831+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:21:24.098831+0000","last_peered":"2024-04-21T10:21:24.098831+0000","last_clean":"2024-04-21T10:21:24.098831+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:21:24.098831+0000","last_undegraded":"2024-04-21T10:21:24.098831+0000","last_fullsized":"2024-04-21T10:21:24.098831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:18:46.271474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099406+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:21:24.099406+0000","last_peered":"2024-04-21T10:21:24.099406+0000","last_clean":"2024-04-21T10:21:24.099406+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:21:24.099406+0000","last_undegraded":"2024-04-21T10:21:24.099406+0000","last_fullsized":"2024-04-21T10:21:24.099406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090255+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:21:24.090255+0000","last_peered":"2024-04-21T10:21:24.090255+0000","last_clean":"2024-04-21T10:21:24.090255+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:21:24.090255+0000","last_undegraded":"2024-04-21T10:21:24.090255+0000","last_fullsized":"2024-04-21T10:21:24.090255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:32:45.653309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595473,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":835,"num_read_kb":524,"num_write":284,"num_write_kb":1434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1786419,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":465244,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1130496,"data_stored":1254728,"data_compressed":45182,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":858584,"data_compressed":22042,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":858392,"data_compressed":22042,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1019904,"data_stored":1058673,"data_compressed":39026,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":464757,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":529360,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":466028,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":531633,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":989884,"data_compressed":28198,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":466508,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":1188643,"data_compressed":45182,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133608,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":393842,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":199693,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:21:29.623 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-21T10:21:29.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T10:21:29.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 -- 172.21.15.77:0/284137993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f601021f0 msgr2=0x7f7f60105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 --2- 172.21.15.77:0/284137993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f601021f0 0x7f7f60105a70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009900 tx=0x7f7f5402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:29.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 -- 172.21.15.77:0/284137993 shutdown_connections 2024-04-21T10:21:29.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 --2- 172.21.15.77:0/284137993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f601021f0 0x7f7f60105a70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 --2- 172.21.15.77:0/284137993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60106150 0x7f7f6010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 --2- 172.21.15.77:0/284137993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f60101840 0x7f7f60101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 -- 172.21.15.77:0/284137993 >> 172.21.15.77:0/284137993 conn(0x7f7f60077450 msgr2=0x7f7f600fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 -- 172.21.15.77:0/284137993 shutdown_connections 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.758+0000 7f7f661d5640 1 -- 172.21.15.77:0/284137993 wait complete. 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 Processor -- start 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 -- start start 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 0x7f7f601994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f60106150 0x7f7f60199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60199f70 0x7f7f601a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f60111070 con 0x7f7f60101840 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f60110ef0 con 0x7f7f60199f70 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f661d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601111f0 con 0x7f7f60106150 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 0x7f7f601994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 0x7f7f601994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34170/0 (socket says 172.21.15.77:34170) 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f5f7fe640 1 -- 172.21.15.77:0/2512857786 learned_addr learned my addr 172.21.15.77:0/2512857786 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f5ffff640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60199f70 0x7f7f601a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.759+0000 7f7f5effd640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f60106150 0x7f7f60199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5f7fe640 1 -- 172.21.15.77:0/2512857786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f60106150 msgr2=0x7f7f60199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5f7fe640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f60106150 0x7f7f60199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5f7fe640 1 -- 172.21.15.77:0/2512857786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60199f70 msgr2=0x7f7f601a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5f7fe640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60199f70 0x7f7f601a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5f7fe640 1 -- 172.21.15.77:0/2512857786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f601a4cf0 con 0x7f7f60101840 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5ffff640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60199f70 0x7f7f601a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5f7fe640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 0x7f7f601994f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000cce0 tx=0x7f7f5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000f650 con 0x7f7f60101840 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f5000fca0 con 0x7f7f60101840 2024-04-21T10:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f601a4fe0 con 0x7f7f60101840 2024-04-21T10:21:29.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50018b40 con 0x7f7f60101840 2024-04-21T10:21:29.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.760+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f601a5450 con 0x7f7f60101840 2024-04-21T10:21:29.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.761+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f60100a60 con 0x7f7f60101840 2024-04-21T10:21:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.762+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f7f5000f7f0 con 0x7f7f60101840 2024-04-21T10:21:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.763+0000 7f7f5cff9640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7f480a3db0 0x7f7f480a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.763+0000 7f7f5effd640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7f480a3db0 0x7f7f480a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.763+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f7f500d0eb0 con 0x7f7f60101840 2024-04-21T10:21:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.763+0000 7f7f5effd640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7f480a3db0 0x7f7f480a6270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f54006010 tx=0x7f7f54004120 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.767+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7f50014030 con 0x7f7f60101840 2024-04-21T10:21:29.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.944+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 --> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f6002d630 con 0x7f7f480a3db0 2024-04-21T10:21:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.951+0000 7f7f5cff9640 1 -- 172.21.15.77:0/2512857786 <== mgr.15315 v2:172.21.15.77:6800/3868346371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258000 (secure 0 0 0) 0x7f7f6002d630 con 0x7f7f480a3db0 2024-04-21T10:21:29.954 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.954+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7f480a3db0 msgr2=0x7f7f480a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.954+0000 7f7f661d5640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7f480a3db0 0x7f7f480a6270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f54006010 tx=0x7f7f54004120 comp rx=0 tx=0).stop 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.954+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 msgr2=0x7f7f601994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.954+0000 7f7f661d5640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 0x7f7f601994f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000cce0 tx=0x7f7f5000a620 comp rx=0 tx=0).stop 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 shutdown_connections 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7f480a3db0 0x7f7f480a6270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60199f70 0x7f7f601a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f60106150 0x7f7f60199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 --2- 172.21.15.77:0/2512857786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f60101840 0x7f7f601994f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 >> 172.21.15.77:0/2512857786 conn(0x7f7f60077450 msgr2=0x7f7f60104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 shutdown_connections 2024-04-21T10:21:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:29.955+0000 7f7f661d5640 1 -- 172.21.15.77:0/2512857786 wait complete. 2024-04-21T10:21:29.965 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-21T10:21:28.103670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186075,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":971,"num_read_kb":643,"num_write":467,"num_write_kb":4374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365228,"kb_used_data":11856,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576596,"statfs":{"total":1151940427776,"available":1151566434304,"internally_reserved":0,"allocated":12140544,"data_stored":9132434,"data_compressed":219048,"data_compressed_allocated":282624,"data_compressed_original":3416064,"omap_allocated":19137,"internal_metadata":361674047},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.992891"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090548+0000","last_change":"2024-04-21T10:19:23.513368+0000","last_active":"2024-04-21T10:21:24.090548+0000","last_peered":"2024-04-21T10:21:24.090548+0000","last_clean":"2024-04-21T10:21:24.090548+0000","last_became_active":"2024-04-21T10:19:23.512538+0000","last_became_peered":"2024-04-21T10:19:23.512538+0000","last_unstale":"2024-04-21T10:21:24.090548+0000","last_undegraded":"2024-04-21T10:21:24.090548+0000","last_fullsized":"2024-04-21T10:21:24.090548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:06:40.220736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100392+0000","last_change":"2024-04-21T10:19:23.515054+0000","last_active":"2024-04-21T10:21:24.100392+0000","last_peered":"2024-04-21T10:21:24.100392+0000","last_clean":"2024-04-21T10:21:24.100392+0000","last_became_active":"2024-04-21T10:19:23.514721+0000","last_became_peered":"2024-04-21T10:19:23.514721+0000","last_unstale":"2024-04-21T10:21:24.100392+0000","last_undegraded":"2024-04-21T10:21:24.100392+0000","last_fullsized":"2024-04-21T10:21:24.100392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:38:17.488883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100211+0000","last_change":"2024-04-21T10:19:23.512992+0000","last_active":"2024-04-21T10:21:24.100211+0000","last_peered":"2024-04-21T10:21:24.100211+0000","last_clean":"2024-04-21T10:21:24.100211+0000","last_became_active":"2024-04-21T10:19:23.512650+0000","last_became_peered":"2024-04-21T10:19:23.512650+0000","last_unstale":"2024-04-21T10:21:24.100211+0000","last_undegraded":"2024-04-21T10:21:24.100211+0000","last_fullsized":"2024-04-21T10:21:24.100211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:29:17.337732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099216+0000","last_change":"2024-04-21T10:19:23.521377+0000","last_active":"2024-04-21T10:21:24.099216+0000","last_peered":"2024-04-21T10:21:24.099216+0000","last_clean":"2024-04-21T10:21:24.099216+0000","last_became_active":"2024-04-21T10:19:23.520960+0000","last_became_peered":"2024-04-21T10:19:23.520960+0000","last_unstale":"2024-04-21T10:21:24.099216+0000","last_undegraded":"2024-04-21T10:21:24.099216+0000","last_fullsized":"2024-04-21T10:21:24.099216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:19:04.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098192+0000","last_change":"2024-04-21T10:19:23.511021+0000","last_active":"2024-04-21T10:21:24.098192+0000","last_peered":"2024-04-21T10:21:24.098192+0000","last_clean":"2024-04-21T10:21:24.098192+0000","last_became_active":"2024-04-21T10:19:23.510684+0000","last_became_peered":"2024-04-21T10:19:23.510684+0000","last_unstale":"2024-04-21T10:21:24.098192+0000","last_undegraded":"2024-04-21T10:21:24.098192+0000","last_fullsized":"2024-04-21T10:21:24.098192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:36:48.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099585+0000","last_change":"2024-04-21T10:19:23.518947+0000","last_active":"2024-04-21T10:21:24.099585+0000","last_peered":"2024-04-21T10:21:24.099585+0000","last_clean":"2024-04-21T10:21:24.099585+0000","last_became_active":"2024-04-21T10:19:23.518610+0000","last_became_peered":"2024-04-21T10:19:23.518610+0000","last_unstale":"2024-04-21T10:21:24.099585+0000","last_undegraded":"2024-04-21T10:21:24.099585+0000","last_fullsized":"2024-04-21T10:21:24.099585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:57.136408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088030+0000","last_change":"2024-04-21T10:19:23.526670+0000","last_active":"2024-04-21T10:21:24.088030+0000","last_peered":"2024-04-21T10:21:24.088030+0000","last_clean":"2024-04-21T10:21:24.088030+0000","last_became_active":"2024-04-21T10:19:23.525999+0000","last_became_peered":"2024-04-21T10:19:23.525999+0000","last_unstale":"2024-04-21T10:21:24.088030+0000","last_undegraded":"2024-04-21T10:21:24.088030+0000","last_fullsized":"2024-04-21T10:21:24.088030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:17.305626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098594+0000","last_change":"2024-04-21T10:19:23.507901+0000","last_active":"2024-04-21T10:21:24.098594+0000","last_peered":"2024-04-21T10:21:24.098594+0000","last_clean":"2024-04-21T10:21:24.098594+0000","last_became_active":"2024-04-21T10:19:23.507098+0000","last_became_peered":"2024-04-21T10:19:23.507098+0000","last_unstale":"2024-04-21T10:21:24.098594+0000","last_undegraded":"2024-04-21T10:21:24.098594+0000","last_fullsized":"2024-04-21T10:21:24.098594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:52.203999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099373+0000","last_change":"2024-04-21T10:19:23.508796+0000","last_active":"2024-04-21T10:21:24.099373+0000","last_peered":"2024-04-21T10:21:24.099373+0000","last_clean":"2024-04-21T10:21:24.099373+0000","last_became_active":"2024-04-21T10:19:23.508434+0000","last_became_peered":"2024-04-21T10:19:23.508434+0000","last_unstale":"2024-04-21T10:21:24.099373+0000","last_undegraded":"2024-04-21T10:21:24.099373+0000","last_fullsized":"2024-04-21T10:21:24.099373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:26:01.902847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099831+0000","last_change":"2024-04-21T10:20:15.830905+0000","last_active":"2024-04-21T10:21:24.099831+0000","last_peered":"2024-04-21T10:21:24.099831+0000","last_clean":"2024-04-21T10:21:24.099831+0000","last_became_active":"2024-04-21T10:20:15.830536+0000","last_became_peered":"2024-04-21T10:20:15.830536+0000","last_unstale":"2024-04-21T10:21:24.099831+0000","last_undegraded":"2024-04-21T10:21:24.099831+0000","last_fullsized":"2024-04-21T10:21:24.099831+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:02:48.213874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088389+0000","last_change":"2024-04-21T10:19:23.529378+0000","last_active":"2024-04-21T10:21:24.088389+0000","last_peered":"2024-04-21T10:21:24.088389+0000","last_clean":"2024-04-21T10:21:24.088389+0000","last_became_active":"2024-04-21T10:19:23.528837+0000","last_became_peered":"2024-04-21T10:19:23.528837+0000","last_unstale":"2024-04-21T10:21:24.088389+0000","last_undegraded":"2024-04-21T10:21:24.088389+0000","last_fullsized":"2024-04-21T10:21:24.088389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:52:25.586003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099003+0000","last_change":"2024-04-21T10:19:23.517768+0000","last_active":"2024-04-21T10:21:24.099003+0000","last_peered":"2024-04-21T10:21:24.099003+0000","last_clean":"2024-04-21T10:21:24.099003+0000","last_became_active":"2024-04-21T10:19:23.517443+0000","last_became_peered":"2024-04-21T10:19:23.517443+0000","last_unstale":"2024-04-21T10:21:24.099003+0000","last_undegraded":"2024-04-21T10:21:24.099003+0000","last_fullsized":"2024-04-21T10:21:24.099003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:54:25.734515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099226+0000","last_change":"2024-04-21T10:19:23.518671+0000","last_active":"2024-04-21T10:21:24.099226+0000","last_peered":"2024-04-21T10:21:24.099226+0000","last_clean":"2024-04-21T10:21:24.099226+0000","last_became_active":"2024-04-21T10:19:23.517588+0000","last_became_peered":"2024-04-21T10:19:23.517588+0000","last_unstale":"2024-04-21T10:21:24.099226+0000","last_undegraded":"2024-04-21T10:21:24.099226+0000","last_fullsized":"2024-04-21T10:21:24.099226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:09:09.942233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099423+0000","last_change":"2024-04-21T10:19:23.514317+0000","last_active":"2024-04-21T10:21:24.099423+0000","last_peered":"2024-04-21T10:21:24.099423+0000","last_clean":"2024-04-21T10:21:24.099423+0000","last_became_active":"2024-04-21T10:19:23.514015+0000","last_became_peered":"2024-04-21T10:19:23.514015+0000","last_unstale":"2024-04-21T10:21:24.099423+0000","last_undegraded":"2024-04-21T10:21:24.099423+0000","last_fullsized":"2024-04-21T10:21:24.099423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:04.221210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098662+0000","last_change":"2024-04-21T10:19:23.519856+0000","last_active":"2024-04-21T10:21:24.098662+0000","last_peered":"2024-04-21T10:21:24.098662+0000","last_clean":"2024-04-21T10:21:24.098662+0000","last_became_active":"2024-04-21T10:19:23.519420+0000","last_became_peered":"2024-04-21T10:19:23.519420+0000","last_unstale":"2024-04-21T10:21:24.098662+0000","last_undegraded":"2024-04-21T10:21:24.098662+0000","last_fullsized":"2024-04-21T10:21:24.098662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:11:09.596880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098508+0000","last_change":"2024-04-21T10:19:23.514399+0000","last_active":"2024-04-21T10:21:24.098508+0000","last_peered":"2024-04-21T10:21:24.098508+0000","last_clean":"2024-04-21T10:21:24.098508+0000","last_became_active":"2024-04-21T10:19:23.513941+0000","last_became_peered":"2024-04-21T10:19:23.513941+0000","last_unstale":"2024-04-21T10:21:24.098508+0000","last_undegraded":"2024-04-21T10:21:24.098508+0000","last_fullsized":"2024-04-21T10:21:24.098508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:04:32.551997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090693+0000","last_change":"2024-04-21T10:19:23.513713+0000","last_active":"2024-04-21T10:21:24.090693+0000","last_peered":"2024-04-21T10:21:24.090693+0000","last_clean":"2024-04-21T10:21:24.090693+0000","last_became_active":"2024-04-21T10:19:23.512965+0000","last_became_peered":"2024-04-21T10:19:23.512965+0000","last_unstale":"2024-04-21T10:21:24.090693+0000","last_undegraded":"2024-04-21T10:21:24.090693+0000","last_fullsized":"2024-04-21T10:21:24.090693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:10:09.025923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089286+0000","last_change":"2024-04-21T10:19:23.513808+0000","last_active":"2024-04-21T10:21:24.089286+0000","last_peered":"2024-04-21T10:21:24.089286+0000","last_clean":"2024-04-21T10:21:24.089286+0000","last_became_active":"2024-04-21T10:19:23.513513+0000","last_became_peered":"2024-04-21T10:19:23.513513+0000","last_unstale":"2024-04-21T10:21:24.089286+0000","last_undegraded":"2024-04-21T10:21:24.089286+0000","last_fullsized":"2024-04-21T10:21:24.089286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:38:40.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098568+0000","last_change":"2024-04-21T10:19:23.523917+0000","last_active":"2024-04-21T10:21:24.098568+0000","last_peered":"2024-04-21T10:21:24.098568+0000","last_clean":"2024-04-21T10:21:24.098568+0000","last_became_active":"2024-04-21T10:19:23.523587+0000","last_became_peered":"2024-04-21T10:19:23.523587+0000","last_unstale":"2024-04-21T10:21:24.098568+0000","last_undegraded":"2024-04-21T10:21:24.098568+0000","last_fullsized":"2024-04-21T10:21:24.098568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:37:23.490245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089417+0000","last_change":"2024-04-21T10:19:22.497681+0000","last_active":"2024-04-21T10:21:24.089417+0000","last_peered":"2024-04-21T10:21:24.089417+0000","last_clean":"2024-04-21T10:21:24.089417+0000","last_became_active":"2024-04-21T10:19:22.497408+0000","last_became_peered":"2024-04-21T10:19:22.497408+0000","last_unstale":"2024-04-21T10:21:24.089417+0000","last_undegraded":"2024-04-21T10:21:24.089417+0000","last_fullsized":"2024-04-21T10:21:24.089417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:33:10.119662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100322+0000","last_change":"2024-04-21T10:19:23.520880+0000","last_active":"2024-04-21T10:21:24.100322+0000","last_peered":"2024-04-21T10:21:24.100322+0000","last_clean":"2024-04-21T10:21:24.100322+0000","last_became_active":"2024-04-21T10:19:23.520522+0000","last_became_peered":"2024-04-21T10:19:23.520522+0000","last_unstale":"2024-04-21T10:21:24.100322+0000","last_undegraded":"2024-04-21T10:21:24.100322+0000","last_fullsized":"2024-04-21T10:21:24.100322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:26.283821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100467+0000","last_change":"2024-04-21T10:19:22.502006+0000","last_active":"2024-04-21T10:21:24.100467+0000","last_peered":"2024-04-21T10:21:24.100467+0000","last_clean":"2024-04-21T10:21:24.100467+0000","last_became_active":"2024-04-21T10:19:22.501681+0000","last_became_peered":"2024-04-21T10:19:22.501681+0000","last_unstale":"2024-04-21T10:21:24.100467+0000","last_undegraded":"2024-04-21T10:21:24.100467+0000","last_fullsized":"2024-04-21T10:21:24.100467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:12:10.238897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100603+0000","last_change":"2024-04-21T10:19:23.513236+0000","last_active":"2024-04-21T10:21:24.100603+0000","last_peered":"2024-04-21T10:21:24.100603+0000","last_clean":"2024-04-21T10:21:24.100603+0000","last_became_active":"2024-04-21T10:19:23.512870+0000","last_became_peered":"2024-04-21T10:19:23.512870+0000","last_unstale":"2024-04-21T10:21:24.100603+0000","last_undegraded":"2024-04-21T10:21:24.100603+0000","last_fullsized":"2024-04-21T10:21:24.100603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:55.923109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098657+0000","last_change":"2024-04-21T10:20:15.833712+0000","last_active":"2024-04-21T10:21:24.098657+0000","last_peered":"2024-04-21T10:21:24.098657+0000","last_clean":"2024-04-21T10:21:24.098657+0000","last_became_active":"2024-04-21T10:20:15.827691+0000","last_became_peered":"2024-04-21T10:20:15.827691+0000","last_unstale":"2024-04-21T10:21:24.098657+0000","last_undegraded":"2024-04-21T10:21:24.098657+0000","last_fullsized":"2024-04-21T10:21:24.098657+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:32:14.844485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098746+0000","last_change":"2024-04-21T10:19:23.514893+0000","last_active":"2024-04-21T10:21:24.098746+0000","last_peered":"2024-04-21T10:21:24.098746+0000","last_clean":"2024-04-21T10:21:24.098746+0000","last_became_active":"2024-04-21T10:19:23.514544+0000","last_became_peered":"2024-04-21T10:19:23.514544+0000","last_unstale":"2024-04-21T10:21:24.098746+0000","last_undegraded":"2024-04-21T10:21:24.098746+0000","last_fullsized":"2024-04-21T10:21:24.098746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:55:54.917389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090231+0000","last_change":"2024-04-21T10:20:15.835895+0000","last_active":"2024-04-21T10:21:24.090231+0000","last_peered":"2024-04-21T10:21:24.090231+0000","last_clean":"2024-04-21T10:21:24.090231+0000","last_became_active":"2024-04-21T10:20:15.828529+0000","last_became_peered":"2024-04-21T10:20:15.828529+0000","last_unstale":"2024-04-21T10:21:24.090231+0000","last_undegraded":"2024-04-21T10:21:24.090231+0000","last_fullsized":"2024-04-21T10:21:24.090231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:09.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099361+0000","last_change":"2024-04-21T10:19:23.525375+0000","last_active":"2024-04-21T10:21:24.099361+0000","last_peered":"2024-04-21T10:21:24.099361+0000","last_clean":"2024-04-21T10:21:24.099361+0000","last_became_active":"2024-04-21T10:19:23.525077+0000","last_became_peered":"2024-04-21T10:19:23.525077+0000","last_unstale":"2024-04-21T10:21:24.099361+0000","last_undegraded":"2024-04-21T10:21:24.099361+0000","last_fullsized":"2024-04-21T10:21:24.099361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:12:42.198001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099189+0000","last_change":"2024-04-21T10:19:22.501758+0000","last_active":"2024-04-21T10:21:24.099189+0000","last_peered":"2024-04-21T10:21:24.099189+0000","last_clean":"2024-04-21T10:21:24.099189+0000","last_became_active":"2024-04-21T10:19:22.500852+0000","last_became_peered":"2024-04-21T10:19:22.500852+0000","last_unstale":"2024-04-21T10:21:24.099189+0000","last_undegraded":"2024-04-21T10:21:24.099189+0000","last_fullsized":"2024-04-21T10:21:24.099189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:37:50.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098381+0000","last_change":"2024-04-21T10:19:23.509262+0000","last_active":"2024-04-21T10:21:24.098381+0000","last_peered":"2024-04-21T10:21:24.098381+0000","last_clean":"2024-04-21T10:21:24.098381+0000","last_became_active":"2024-04-21T10:19:23.508914+0000","last_became_peered":"2024-04-21T10:19:23.508914+0000","last_unstale":"2024-04-21T10:21:24.098381+0000","last_undegraded":"2024-04-21T10:21:24.098381+0000","last_fullsized":"2024-04-21T10:21:24.098381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:56.769349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099447+0000","last_change":"2024-04-21T10:19:22.503978+0000","last_active":"2024-04-21T10:21:24.099447+0000","last_peered":"2024-04-21T10:21:24.099447+0000","last_clean":"2024-04-21T10:21:24.099447+0000","last_became_active":"2024-04-21T10:19:22.503624+0000","last_became_peered":"2024-04-21T10:19:22.503624+0000","last_unstale":"2024-04-21T10:21:24.099447+0000","last_undegraded":"2024-04-21T10:21:24.099447+0000","last_fullsized":"2024-04-21T10:21:24.099447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:06.276530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099161+0000","last_change":"2024-04-21T10:19:23.527160+0000","last_active":"2024-04-21T10:21:24.099161+0000","last_peered":"2024-04-21T10:21:24.099161+0000","last_clean":"2024-04-21T10:21:24.099161+0000","last_became_active":"2024-04-21T10:19:23.526770+0000","last_became_peered":"2024-04-21T10:19:23.526770+0000","last_unstale":"2024-04-21T10:21:24.099161+0000","last_undegraded":"2024-04-21T10:21:24.099161+0000","last_fullsized":"2024-04-21T10:21:24.099161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:48:22.623681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098911+0000","last_change":"2024-04-21T10:19:22.498069+0000","last_active":"2024-04-21T10:21:24.098911+0000","last_peered":"2024-04-21T10:21:24.098911+0000","last_clean":"2024-04-21T10:21:24.098911+0000","last_became_active":"2024-04-21T10:19:22.497325+0000","last_became_peered":"2024-04-21T10:19:22.497325+0000","last_unstale":"2024-04-21T10:21:24.098911+0000","last_undegraded":"2024-04-21T10:21:24.098911+0000","last_fullsized":"2024-04-21T10:21:24.098911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:30:27.959481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098842+0000","last_change":"2024-04-21T10:19:23.508768+0000","last_active":"2024-04-21T10:21:24.098842+0000","last_peered":"2024-04-21T10:21:24.098842+0000","last_clean":"2024-04-21T10:21:24.098842+0000","last_became_active":"2024-04-21T10:19:23.508182+0000","last_became_peered":"2024-04-21T10:19:23.508182+0000","last_unstale":"2024-04-21T10:21:24.098842+0000","last_undegraded":"2024-04-21T10:21:24.098842+0000","last_fullsized":"2024-04-21T10:21:24.098842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:47:54.824898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098785+0000","last_change":"2024-04-21T10:19:22.501365+0000","last_active":"2024-04-21T10:21:24.098785+0000","last_peered":"2024-04-21T10:21:24.098785+0000","last_clean":"2024-04-21T10:21:24.098785+0000","last_became_active":"2024-04-21T10:19:22.501039+0000","last_became_peered":"2024-04-21T10:19:22.501039+0000","last_unstale":"2024-04-21T10:21:24.098785+0000","last_undegraded":"2024-04-21T10:21:24.098785+0000","last_fullsized":"2024-04-21T10:21:24.098785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:18:19.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089231+0000","last_change":"2024-04-21T10:19:23.513015+0000","last_active":"2024-04-21T10:21:24.089231+0000","last_peered":"2024-04-21T10:21:24.089231+0000","last_clean":"2024-04-21T10:21:24.089231+0000","last_became_active":"2024-04-21T10:19:23.512678+0000","last_became_peered":"2024-04-21T10:19:23.512678+0000","last_unstale":"2024-04-21T10:21:24.089231+0000","last_undegraded":"2024-04-21T10:21:24.089231+0000","last_fullsized":"2024-04-21T10:21:24.089231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:17:51.677436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099820+0000","last_change":"2024-04-21T10:19:22.496409+0000","last_active":"2024-04-21T10:21:24.099820+0000","last_peered":"2024-04-21T10:21:24.099820+0000","last_clean":"2024-04-21T10:21:24.099820+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:21:24.099820+0000","last_undegraded":"2024-04-21T10:21:24.099820+0000","last_fullsized":"2024-04-21T10:21:24.099820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:56:55.314142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098949+0000","last_change":"2024-04-21T10:19:23.518234+0000","last_active":"2024-04-21T10:21:24.098949+0000","last_peered":"2024-04-21T10:21:24.098949+0000","last_clean":"2024-04-21T10:21:24.098949+0000","last_became_active":"2024-04-21T10:19:23.516284+0000","last_became_peered":"2024-04-21T10:19:23.516284+0000","last_unstale":"2024-04-21T10:21:24.098949+0000","last_undegraded":"2024-04-21T10:21:24.098949+0000","last_fullsized":"2024-04-21T10:21:24.098949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:43.283515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088302+0000","last_change":"2024-04-21T10:19:22.503047+0000","last_active":"2024-04-21T10:21:24.088302+0000","last_peered":"2024-04-21T10:21:24.088302+0000","last_clean":"2024-04-21T10:21:24.088302+0000","last_became_active":"2024-04-21T10:19:22.502655+0000","last_became_peered":"2024-04-21T10:19:22.502655+0000","last_unstale":"2024-04-21T10:21:24.088302+0000","last_undegraded":"2024-04-21T10:21:24.088302+0000","last_fullsized":"2024-04-21T10:21:24.088302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:48:42.369248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100585+0000","last_change":"2024-04-21T10:19:23.533514+0000","last_active":"2024-04-21T10:21:24.100585+0000","last_peered":"2024-04-21T10:21:24.100585+0000","last_clean":"2024-04-21T10:21:24.100585+0000","last_became_active":"2024-04-21T10:19:23.533260+0000","last_became_peered":"2024-04-21T10:19:23.533260+0000","last_unstale":"2024-04-21T10:21:24.100585+0000","last_undegraded":"2024-04-21T10:21:24.100585+0000","last_fullsized":"2024-04-21T10:21:24.100585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:28:06.323224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099409+0000","last_change":"2024-04-21T10:19:22.496919+0000","last_active":"2024-04-21T10:21:24.099409+0000","last_peered":"2024-04-21T10:21:24.099409+0000","last_clean":"2024-04-21T10:21:24.099409+0000","last_became_active":"2024-04-21T10:19:22.496570+0000","last_became_peered":"2024-04-21T10:19:22.496570+0000","last_unstale":"2024-04-21T10:21:24.099409+0000","last_undegraded":"2024-04-21T10:21:24.099409+0000","last_fullsized":"2024-04-21T10:21:24.099409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:46:52.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098965+0000","last_change":"2024-04-21T10:20:15.828140+0000","last_active":"2024-04-21T10:21:24.098965+0000","last_peered":"2024-04-21T10:21:24.098965+0000","last_clean":"2024-04-21T10:21:24.098965+0000","last_became_active":"2024-04-21T10:20:15.827748+0000","last_became_peered":"2024-04-21T10:20:15.827748+0000","last_unstale":"2024-04-21T10:21:24.098965+0000","last_undegraded":"2024-04-21T10:21:24.098965+0000","last_fullsized":"2024-04-21T10:21:24.098965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:05:57.570062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'35","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.171636+0000","last_change":"2024-04-21T10:19:22.501151+0000","last_active":"2024-04-21T10:21:24.171636+0000","last_peered":"2024-04-21T10:21:24.171636+0000","last_clean":"2024-04-21T10:21:24.171636+0000","last_became_active":"2024-04-21T10:19:22.500717+0000","last_became_peered":"2024-04-21T10:19:22.500717+0000","last_unstale":"2024-04-21T10:21:24.171636+0000","last_undegraded":"2024-04-21T10:21:24.171636+0000","last_fullsized":"2024-04-21T10:21:24.171636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:39:57.060800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65201,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":187,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098447+0000","last_change":"2024-04-21T10:19:23.518892+0000","last_active":"2024-04-21T10:21:24.098447+0000","last_peered":"2024-04-21T10:21:24.098447+0000","last_clean":"2024-04-21T10:21:24.098447+0000","last_became_active":"2024-04-21T10:19:23.518563+0000","last_became_peered":"2024-04-21T10:19:23.518563+0000","last_unstale":"2024-04-21T10:21:24.098447+0000","last_undegraded":"2024-04-21T10:21:24.098447+0000","last_fullsized":"2024-04-21T10:21:24.098447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:00:08.736225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099233+0000","last_change":"2024-04-21T10:19:22.498976+0000","last_active":"2024-04-21T10:21:24.099233+0000","last_peered":"2024-04-21T10:21:24.099233+0000","last_clean":"2024-04-21T10:21:24.099233+0000","last_became_active":"2024-04-21T10:19:22.498638+0000","last_became_peered":"2024-04-21T10:19:22.498638+0000","last_unstale":"2024-04-21T10:21:24.099233+0000","last_undegraded":"2024-04-21T10:21:24.099233+0000","last_fullsized":"2024-04-21T10:21:24.099233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:19:53.642863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098950+0000","last_change":"2024-04-21T10:19:23.514347+0000","last_active":"2024-04-21T10:21:24.098950+0000","last_peered":"2024-04-21T10:21:24.098950+0000","last_clean":"2024-04-21T10:21:24.098950+0000","last_became_active":"2024-04-21T10:19:23.514050+0000","last_became_peered":"2024-04-21T10:19:23.514050+0000","last_unstale":"2024-04-21T10:21:24.098950+0000","last_undegraded":"2024-04-21T10:21:24.098950+0000","last_fullsized":"2024-04-21T10:21:24.098950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:43.191434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099037+0000","last_change":"2024-04-21T10:19:22.501657+0000","last_active":"2024-04-21T10:21:24.099037+0000","last_peered":"2024-04-21T10:21:24.099037+0000","last_clean":"2024-04-21T10:21:24.099037+0000","last_became_active":"2024-04-21T10:19:22.501322+0000","last_became_peered":"2024-04-21T10:19:22.501322+0000","last_unstale":"2024-04-21T10:21:24.099037+0000","last_undegraded":"2024-04-21T10:21:24.099037+0000","last_fullsized":"2024-04-21T10:21:24.099037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:56:40.583849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088290+0000","last_change":"2024-04-21T10:19:23.523782+0000","last_active":"2024-04-21T10:21:24.088290+0000","last_peered":"2024-04-21T10:21:24.088290+0000","last_clean":"2024-04-21T10:21:24.088290+0000","last_became_active":"2024-04-21T10:19:23.523467+0000","last_became_peered":"2024-04-21T10:19:23.523467+0000","last_unstale":"2024-04-21T10:21:24.088290+0000","last_undegraded":"2024-04-21T10:21:24.088290+0000","last_fullsized":"2024-04-21T10:21:24.088290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:52:23.121128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.332244+0000","last_change":"2024-04-21T10:19:22.495725+0000","last_active":"2024-04-21T10:21:24.332244+0000","last_peered":"2024-04-21T10:21:24.332244+0000","last_clean":"2024-04-21T10:21:24.332244+0000","last_became_active":"2024-04-21T10:19:22.495364+0000","last_became_peered":"2024-04-21T10:19:22.495364+0000","last_unstale":"2024-04-21T10:21:24.332244+0000","last_undegraded":"2024-04-21T10:21:24.332244+0000","last_fullsized":"2024-04-21T10:21:24.332244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:32:33.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.087998+0000","last_change":"2024-04-21T10:19:23.526298+0000","last_active":"2024-04-21T10:21:24.087998+0000","last_peered":"2024-04-21T10:21:24.087998+0000","last_clean":"2024-04-21T10:21:24.087998+0000","last_became_active":"2024-04-21T10:19:23.525918+0000","last_became_peered":"2024-04-21T10:19:23.525918+0000","last_unstale":"2024-04-21T10:21:24.087998+0000","last_undegraded":"2024-04-21T10:21:24.087998+0000","last_fullsized":"2024-04-21T10:21:24.087998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:19:57.323697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090149+0000","last_change":"2024-04-21T10:20:15.847040+0000","last_active":"2024-04-21T10:21:24.090149+0000","last_peered":"2024-04-21T10:21:24.090149+0000","last_clean":"2024-04-21T10:21:24.090149+0000","last_became_active":"2024-04-21T10:20:15.828688+0000","last_became_peered":"2024-04-21T10:20:15.828688+0000","last_unstale":"2024-04-21T10:21:24.090149+0000","last_undegraded":"2024-04-21T10:21:24.090149+0000","last_fullsized":"2024-04-21T10:21:24.090149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:42:55.986550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089153+0000","last_change":"2024-04-21T10:20:15.824670+0000","last_active":"2024-04-21T10:21:24.089153+0000","last_peered":"2024-04-21T10:21:24.089153+0000","last_clean":"2024-04-21T10:21:24.089153+0000","last_became_active":"2024-04-21T10:20:15.824428+0000","last_became_peered":"2024-04-21T10:20:15.824428+0000","last_unstale":"2024-04-21T10:21:24.089153+0000","last_undegraded":"2024-04-21T10:21:24.089153+0000","last_fullsized":"2024-04-21T10:21:24.089153+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:23:50.732573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"88'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098837+0000","last_change":"2024-04-21T10:19:22.504359+0000","last_active":"2024-04-21T10:21:24.098837+0000","last_peered":"2024-04-21T10:21:24.098837+0000","last_clean":"2024-04-21T10:21:24.098837+0000","last_became_active":"2024-04-21T10:19:22.502124+0000","last_became_peered":"2024-04-21T10:19:22.502124+0000","last_unstale":"2024-04-21T10:21:24.098837+0000","last_undegraded":"2024-04-21T10:21:24.098837+0000","last_fullsized":"2024-04-21T10:21:24.098837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:46.382232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090505+0000","last_change":"2024-04-21T10:19:23.521126+0000","last_active":"2024-04-21T10:21:24.090505+0000","last_peered":"2024-04-21T10:21:24.090505+0000","last_clean":"2024-04-21T10:21:24.090505+0000","last_became_active":"2024-04-21T10:19:23.520782+0000","last_became_peered":"2024-04-21T10:19:23.520782+0000","last_unstale":"2024-04-21T10:21:24.090505+0000","last_undegraded":"2024-04-21T10:21:24.090505+0000","last_fullsized":"2024-04-21T10:21:24.090505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:44:18.798775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089228+0000","last_change":"2024-04-21T10:19:22.496332+0000","last_active":"2024-04-21T10:21:24.089228+0000","last_peered":"2024-04-21T10:21:24.089228+0000","last_clean":"2024-04-21T10:21:24.089228+0000","last_became_active":"2024-04-21T10:19:22.495997+0000","last_became_peered":"2024-04-21T10:19:22.495997+0000","last_unstale":"2024-04-21T10:21:24.089228+0000","last_undegraded":"2024-04-21T10:21:24.089228+0000","last_fullsized":"2024-04-21T10:21:24.089228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:25:54.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099742+0000","last_change":"2024-04-21T10:19:23.521988+0000","last_active":"2024-04-21T10:21:24.099742+0000","last_peered":"2024-04-21T10:21:24.099742+0000","last_clean":"2024-04-21T10:21:24.099742+0000","last_became_active":"2024-04-21T10:19:23.521655+0000","last_became_peered":"2024-04-21T10:19:23.521655+0000","last_unstale":"2024-04-21T10:21:24.099742+0000","last_undegraded":"2024-04-21T10:21:24.099742+0000","last_fullsized":"2024-04-21T10:21:24.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:39:16.369964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088236+0000","last_change":"2024-04-21T10:19:22.503049+0000","last_active":"2024-04-21T10:21:24.088236+0000","last_peered":"2024-04-21T10:21:24.088236+0000","last_clean":"2024-04-21T10:21:24.088236+0000","last_became_active":"2024-04-21T10:19:22.502676+0000","last_became_peered":"2024-04-21T10:19:22.502676+0000","last_unstale":"2024-04-21T10:21:24.088236+0000","last_undegraded":"2024-04-21T10:21:24.088236+0000","last_fullsized":"2024-04-21T10:21:24.088236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:24.603024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099447+0000","last_change":"2024-04-21T10:19:23.518103+0000","last_active":"2024-04-21T10:21:24.099447+0000","last_peered":"2024-04-21T10:21:24.099447+0000","last_clean":"2024-04-21T10:21:24.099447+0000","last_became_active":"2024-04-21T10:19:23.517774+0000","last_became_peered":"2024-04-21T10:19:23.517774+0000","last_unstale":"2024-04-21T10:21:24.099447+0000","last_undegraded":"2024-04-21T10:21:24.099447+0000","last_fullsized":"2024-04-21T10:21:24.099447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:05:27.020650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099022+0000","last_change":"2024-04-21T10:19:23.520722+0000","last_active":"2024-04-21T10:21:24.099022+0000","last_peered":"2024-04-21T10:21:24.099022+0000","last_clean":"2024-04-21T10:21:24.099022+0000","last_became_active":"2024-04-21T10:19:23.520406+0000","last_became_peered":"2024-04-21T10:19:23.520406+0000","last_unstale":"2024-04-21T10:21:24.099022+0000","last_undegraded":"2024-04-21T10:21:24.099022+0000","last_fullsized":"2024-04-21T10:21:24.099022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:05:15.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.184732+0000","last_change":"2024-04-21T10:19:22.499674+0000","last_active":"2024-04-21T10:21:24.184732+0000","last_peered":"2024-04-21T10:21:24.184732+0000","last_clean":"2024-04-21T10:21:24.184732+0000","last_became_active":"2024-04-21T10:19:22.499378+0000","last_became_peered":"2024-04-21T10:19:22.499378+0000","last_unstale":"2024-04-21T10:21:24.184732+0000","last_undegraded":"2024-04-21T10:21:24.184732+0000","last_fullsized":"2024-04-21T10:21:24.184732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:55:39.145287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099583+0000","last_change":"2024-04-21T10:19:23.507449+0000","last_active":"2024-04-21T10:21:24.099583+0000","last_peered":"2024-04-21T10:21:24.099583+0000","last_clean":"2024-04-21T10:21:24.099583+0000","last_became_active":"2024-04-21T10:19:23.507131+0000","last_became_peered":"2024-04-21T10:19:23.507131+0000","last_unstale":"2024-04-21T10:21:24.099583+0000","last_undegraded":"2024-04-21T10:21:24.099583+0000","last_fullsized":"2024-04-21T10:21:24.099583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:41:15.466810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098845+0000","last_change":"2024-04-21T10:19:22.491707+0000","last_active":"2024-04-21T10:21:24.098845+0000","last_peered":"2024-04-21T10:21:24.098845+0000","last_clean":"2024-04-21T10:21:24.098845+0000","last_became_active":"2024-04-21T10:19:22.491334+0000","last_became_peered":"2024-04-21T10:19:22.491334+0000","last_unstale":"2024-04-21T10:21:24.098845+0000","last_undegraded":"2024-04-21T10:21:24.098845+0000","last_fullsized":"2024-04-21T10:21:24.098845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:49:48.367915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088048+0000","last_change":"2024-04-21T10:18:06.709741+0000","last_active":"2024-04-21T10:21:24.088048+0000","last_peered":"2024-04-21T10:21:24.088048+0000","last_clean":"2024-04-21T10:21:24.088048+0000","last_became_active":"2024-04-21T10:18:06.709287+0000","last_became_peered":"2024-04-21T10:18:06.709287+0000","last_unstale":"2024-04-21T10:21:24.088048+0000","last_undegraded":"2024-04-21T10:21:24.088048+0000","last_fullsized":"2024-04-21T10:21:24.088048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:14:38.995260+0000","last_clean_scrub_stamp":"2024-04-21T10:14:38.995260+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:23:50.374900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098694+0000","last_change":"2024-04-21T10:19:23.518275+0000","last_active":"2024-04-21T10:21:24.098694+0000","last_peered":"2024-04-21T10:21:24.098694+0000","last_clean":"2024-04-21T10:21:24.098694+0000","last_became_active":"2024-04-21T10:19:23.517952+0000","last_became_peered":"2024-04-21T10:19:23.517952+0000","last_unstale":"2024-04-21T10:21:24.098694+0000","last_undegraded":"2024-04-21T10:21:24.098694+0000","last_fullsized":"2024-04-21T10:21:24.098694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:43:43.911703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088285+0000","last_change":"2024-04-21T10:19:22.503215+0000","last_active":"2024-04-21T10:21:24.088285+0000","last_peered":"2024-04-21T10:21:24.088285+0000","last_clean":"2024-04-21T10:21:24.088285+0000","last_became_active":"2024-04-21T10:19:22.502849+0000","last_became_peered":"2024-04-21T10:19:22.502849+0000","last_unstale":"2024-04-21T10:21:24.088285+0000","last_undegraded":"2024-04-21T10:21:24.088285+0000","last_fullsized":"2024-04-21T10:21:24.088285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:26:52.880711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098548+0000","last_change":"2024-04-21T10:19:22.504688+0000","last_active":"2024-04-21T10:21:24.098548+0000","last_peered":"2024-04-21T10:21:24.098548+0000","last_clean":"2024-04-21T10:21:24.098548+0000","last_became_active":"2024-04-21T10:19:22.504362+0000","last_became_peered":"2024-04-21T10:19:22.504362+0000","last_unstale":"2024-04-21T10:21:24.098548+0000","last_undegraded":"2024-04-21T10:21:24.098548+0000","last_fullsized":"2024-04-21T10:21:24.098548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:36:13.408649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099455+0000","last_change":"2024-04-21T10:19:23.517890+0000","last_active":"2024-04-21T10:21:24.099455+0000","last_peered":"2024-04-21T10:21:24.099455+0000","last_clean":"2024-04-21T10:21:24.099455+0000","last_became_active":"2024-04-21T10:19:23.517570+0000","last_became_peered":"2024-04-21T10:19:23.517570+0000","last_unstale":"2024-04-21T10:21:24.099455+0000","last_undegraded":"2024-04-21T10:21:24.099455+0000","last_fullsized":"2024-04-21T10:21:24.099455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:33:20.884740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'43","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.288740+0000","last_change":"2024-04-21T10:19:22.498951+0000","last_active":"2024-04-21T10:21:24.288740+0000","last_peered":"2024-04-21T10:21:24.288740+0000","last_clean":"2024-04-21T10:21:24.288740+0000","last_became_active":"2024-04-21T10:19:22.498622+0000","last_became_peered":"2024-04-21T10:19:22.498622+0000","last_unstale":"2024-04-21T10:21:24.288740+0000","last_undegraded":"2024-04-21T10:21:24.288740+0000","last_fullsized":"2024-04-21T10:21:24.288740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:43:27.597456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":77,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100103+0000","last_change":"2024-04-21T10:19:23.519402+0000","last_active":"2024-04-21T10:21:24.100103+0000","last_peered":"2024-04-21T10:21:24.100103+0000","last_clean":"2024-04-21T10:21:24.100103+0000","last_became_active":"2024-04-21T10:19:23.517145+0000","last_became_peered":"2024-04-21T10:19:23.517145+0000","last_unstale":"2024-04-21T10:21:24.100103+0000","last_undegraded":"2024-04-21T10:21:24.100103+0000","last_fullsized":"2024-04-21T10:21:24.100103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:17.595175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098760+0000","last_change":"2024-04-21T10:19:22.507161+0000","last_active":"2024-04-21T10:21:24.098760+0000","last_peered":"2024-04-21T10:21:24.098760+0000","last_clean":"2024-04-21T10:21:24.098760+0000","last_became_active":"2024-04-21T10:19:22.506775+0000","last_became_peered":"2024-04-21T10:19:22.506775+0000","last_unstale":"2024-04-21T10:21:24.098760+0000","last_undegraded":"2024-04-21T10:21:24.098760+0000","last_fullsized":"2024-04-21T10:21:24.098760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:35:39.262577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100528+0000","last_change":"2024-04-21T10:19:23.525739+0000","last_active":"2024-04-21T10:21:24.100528+0000","last_peered":"2024-04-21T10:21:24.100528+0000","last_clean":"2024-04-21T10:21:24.100528+0000","last_became_active":"2024-04-21T10:19:23.525410+0000","last_became_peered":"2024-04-21T10:19:23.525410+0000","last_unstale":"2024-04-21T10:21:24.100528+0000","last_undegraded":"2024-04-21T10:21:24.100528+0000","last_fullsized":"2024-04-21T10:21:24.100528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:41:48.875374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098532+0000","last_change":"2024-04-21T10:19:22.496341+0000","last_active":"2024-04-21T10:21:24.098532+0000","last_peered":"2024-04-21T10:21:24.098532+0000","last_clean":"2024-04-21T10:21:24.098532+0000","last_became_active":"2024-04-21T10:19:22.496023+0000","last_became_peered":"2024-04-21T10:19:22.496023+0000","last_unstale":"2024-04-21T10:21:24.098532+0000","last_undegraded":"2024-04-21T10:21:24.098532+0000","last_fullsized":"2024-04-21T10:21:24.098532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:15:07.690438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098184+0000","last_change":"2024-04-21T10:19:23.515031+0000","last_active":"2024-04-21T10:21:24.098184+0000","last_peered":"2024-04-21T10:21:24.098184+0000","last_clean":"2024-04-21T10:21:24.098184+0000","last_became_active":"2024-04-21T10:19:23.514664+0000","last_became_peered":"2024-04-21T10:19:23.514664+0000","last_unstale":"2024-04-21T10:21:24.098184+0000","last_undegraded":"2024-04-21T10:21:24.098184+0000","last_fullsized":"2024-04-21T10:21:24.098184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:59:28.846282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099138+0000","last_change":"2024-04-21T10:19:22.498438+0000","last_active":"2024-04-21T10:21:24.099138+0000","last_peered":"2024-04-21T10:21:24.099138+0000","last_clean":"2024-04-21T10:21:24.099138+0000","last_became_active":"2024-04-21T10:19:22.498103+0000","last_became_peered":"2024-04-21T10:19:22.498103+0000","last_unstale":"2024-04-21T10:21:24.099138+0000","last_undegraded":"2024-04-21T10:21:24.099138+0000","last_fullsized":"2024-04-21T10:21:24.099138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:15:50.830134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090229+0000","last_change":"2024-04-21T10:19:23.514040+0000","last_active":"2024-04-21T10:21:24.090229+0000","last_peered":"2024-04-21T10:21:24.090229+0000","last_clean":"2024-04-21T10:21:24.090229+0000","last_became_active":"2024-04-21T10:19:23.513581+0000","last_became_peered":"2024-04-21T10:19:23.513581+0000","last_unstale":"2024-04-21T10:21:24.090229+0000","last_undegraded":"2024-04-21T10:21:24.090229+0000","last_fullsized":"2024-04-21T10:21:24.090229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:16:31.547608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099004+0000","last_change":"2024-04-21T10:19:22.504176+0000","last_active":"2024-04-21T10:21:24.099004+0000","last_peered":"2024-04-21T10:21:24.099004+0000","last_clean":"2024-04-21T10:21:24.099004+0000","last_became_active":"2024-04-21T10:19:22.503831+0000","last_became_peered":"2024-04-21T10:19:22.503831+0000","last_unstale":"2024-04-21T10:21:24.099004+0000","last_undegraded":"2024-04-21T10:21:24.099004+0000","last_fullsized":"2024-04-21T10:21:24.099004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:06:37.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099812+0000","last_change":"2024-04-21T10:19:23.513899+0000","last_active":"2024-04-21T10:21:24.099812+0000","last_peered":"2024-04-21T10:21:24.099812+0000","last_clean":"2024-04-21T10:21:24.099812+0000","last_became_active":"2024-04-21T10:19:23.513559+0000","last_became_peered":"2024-04-21T10:19:23.513559+0000","last_unstale":"2024-04-21T10:21:24.099812+0000","last_undegraded":"2024-04-21T10:21:24.099812+0000","last_fullsized":"2024-04-21T10:21:24.099812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:34:48.679940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098352+0000","last_change":"2024-04-21T10:19:22.506151+0000","last_active":"2024-04-21T10:21:24.098352+0000","last_peered":"2024-04-21T10:21:24.098352+0000","last_clean":"2024-04-21T10:21:24.098352+0000","last_became_active":"2024-04-21T10:19:22.504644+0000","last_became_peered":"2024-04-21T10:19:22.504644+0000","last_unstale":"2024-04-21T10:21:24.098352+0000","last_undegraded":"2024-04-21T10:21:24.098352+0000","last_fullsized":"2024-04-21T10:21:24.098352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:00:32.109874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088357+0000","last_change":"2024-04-21T10:19:23.519715+0000","last_active":"2024-04-21T10:21:24.088357+0000","last_peered":"2024-04-21T10:21:24.088357+0000","last_clean":"2024-04-21T10:21:24.088357+0000","last_became_active":"2024-04-21T10:19:23.519368+0000","last_became_peered":"2024-04-21T10:19:23.519368+0000","last_unstale":"2024-04-21T10:21:24.088357+0000","last_undegraded":"2024-04-21T10:21:24.088357+0000","last_fullsized":"2024-04-21T10:21:24.088357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:52:13.768086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099580+0000","last_change":"2024-04-21T10:19:22.508923+0000","last_active":"2024-04-21T10:21:24.099580+0000","last_peered":"2024-04-21T10:21:24.099580+0000","last_clean":"2024-04-21T10:21:24.099580+0000","last_became_active":"2024-04-21T10:19:22.508539+0000","last_became_peered":"2024-04-21T10:19:22.508539+0000","last_unstale":"2024-04-21T10:21:24.099580+0000","last_undegraded":"2024-04-21T10:21:24.099580+0000","last_fullsized":"2024-04-21T10:21:24.099580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:38:41.296920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088416+0000","last_change":"2024-04-21T10:19:23.528381+0000","last_active":"2024-04-21T10:21:24.088416+0000","last_peered":"2024-04-21T10:21:24.088416+0000","last_clean":"2024-04-21T10:21:24.088416+0000","last_became_active":"2024-04-21T10:19:23.528013+0000","last_became_peered":"2024-04-21T10:19:23.528013+0000","last_unstale":"2024-04-21T10:21:24.088416+0000","last_undegraded":"2024-04-21T10:21:24.088416+0000","last_fullsized":"2024-04-21T10:21:24.088416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:20:52.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.286743+0000","last_change":"2024-04-21T10:19:22.507085+0000","last_active":"2024-04-21T10:21:24.286743+0000","last_peered":"2024-04-21T10:21:24.286743+0000","last_clean":"2024-04-21T10:21:24.286743+0000","last_became_active":"2024-04-21T10:19:22.504856+0000","last_became_peered":"2024-04-21T10:19:22.504856+0000","last_unstale":"2024-04-21T10:21:24.286743+0000","last_undegraded":"2024-04-21T10:21:24.286743+0000","last_fullsized":"2024-04-21T10:21:24.286743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:24:39.233047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088170+0000","last_change":"2024-04-21T10:19:23.527589+0000","last_active":"2024-04-21T10:21:24.088170+0000","last_peered":"2024-04-21T10:21:24.088170+0000","last_clean":"2024-04-21T10:21:24.088170+0000","last_became_active":"2024-04-21T10:19:23.526836+0000","last_became_peered":"2024-04-21T10:19:23.526836+0000","last_unstale":"2024-04-21T10:21:24.088170+0000","last_undegraded":"2024-04-21T10:21:24.088170+0000","last_fullsized":"2024-04-21T10:21:24.088170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:34:13.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099326+0000","last_change":"2024-04-21T10:20:15.830810+0000","last_active":"2024-04-21T10:21:24.099326+0000","last_peered":"2024-04-21T10:21:24.099326+0000","last_clean":"2024-04-21T10:21:24.099326+0000","last_became_active":"2024-04-21T10:20:15.826657+0000","last_became_peered":"2024-04-21T10:20:15.826657+0000","last_unstale":"2024-04-21T10:21:24.099326+0000","last_undegraded":"2024-04-21T10:21:24.099326+0000","last_fullsized":"2024-04-21T10:21:24.099326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:21.469812+0000","last_clean_scrub_stamp":"2024-04-21T10:19:21.469812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:12:19.425100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.088577+0000","last_change":"2024-04-21T10:19:23.524698+0000","last_active":"2024-04-21T10:21:24.088577+0000","last_peered":"2024-04-21T10:21:24.088577+0000","last_clean":"2024-04-21T10:21:24.088577+0000","last_became_active":"2024-04-21T10:19:23.524335+0000","last_became_peered":"2024-04-21T10:19:23.524335+0000","last_unstale":"2024-04-21T10:21:24.088577+0000","last_undegraded":"2024-04-21T10:21:24.088577+0000","last_fullsized":"2024-04-21T10:21:24.088577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:10:06.613615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090319+0000","last_change":"2024-04-21T10:19:23.525865+0000","last_active":"2024-04-21T10:21:24.090319+0000","last_peered":"2024-04-21T10:21:24.090319+0000","last_clean":"2024-04-21T10:21:24.090319+0000","last_became_active":"2024-04-21T10:19:23.525550+0000","last_became_peered":"2024-04-21T10:19:23.525550+0000","last_unstale":"2024-04-21T10:21:24.090319+0000","last_undegraded":"2024-04-21T10:21:24.090319+0000","last_fullsized":"2024-04-21T10:21:24.090319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:54:10.827986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098626+0000","last_change":"2024-04-21T10:19:23.521514+0000","last_active":"2024-04-21T10:21:24.098626+0000","last_peered":"2024-04-21T10:21:24.098626+0000","last_clean":"2024-04-21T10:21:24.098626+0000","last_became_active":"2024-04-21T10:19:23.521180+0000","last_became_peered":"2024-04-21T10:19:23.521180+0000","last_unstale":"2024-04-21T10:21:24.098626+0000","last_undegraded":"2024-04-21T10:21:24.098626+0000","last_fullsized":"2024-04-21T10:21:24.098626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:30:54.398105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098859+0000","last_change":"2024-04-21T10:19:23.515001+0000","last_active":"2024-04-21T10:21:24.098859+0000","last_peered":"2024-04-21T10:21:24.098859+0000","last_clean":"2024-04-21T10:21:24.098859+0000","last_became_active":"2024-04-21T10:19:23.514662+0000","last_became_peered":"2024-04-21T10:19:23.514662+0000","last_unstale":"2024-04-21T10:21:24.098859+0000","last_undegraded":"2024-04-21T10:21:24.098859+0000","last_fullsized":"2024-04-21T10:21:24.098859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:15.894562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.100072+0000","last_change":"2024-04-21T10:19:23.524210+0000","last_active":"2024-04-21T10:21:24.100072+0000","last_peered":"2024-04-21T10:21:24.100072+0000","last_clean":"2024-04-21T10:21:24.100072+0000","last_became_active":"2024-04-21T10:19:23.523830+0000","last_became_peered":"2024-04-21T10:19:23.523830+0000","last_unstale":"2024-04-21T10:21:24.100072+0000","last_undegraded":"2024-04-21T10:21:24.100072+0000","last_fullsized":"2024-04-21T10:21:24.100072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:29:38.394124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099614+0000","last_change":"2024-04-21T10:19:23.520154+0000","last_active":"2024-04-21T10:21:24.099614+0000","last_peered":"2024-04-21T10:21:24.099614+0000","last_clean":"2024-04-21T10:21:24.099614+0000","last_became_active":"2024-04-21T10:19:23.519836+0000","last_became_peered":"2024-04-21T10:19:23.519836+0000","last_unstale":"2024-04-21T10:21:24.099614+0000","last_undegraded":"2024-04-21T10:21:24.099614+0000","last_fullsized":"2024-04-21T10:21:24.099614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:20:49.449443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090386+0000","last_change":"2024-04-21T10:19:23.508561+0000","last_active":"2024-04-21T10:21:24.090386+0000","last_peered":"2024-04-21T10:21:24.090386+0000","last_clean":"2024-04-21T10:21:24.090386+0000","last_became_active":"2024-04-21T10:19:23.508214+0000","last_became_peered":"2024-04-21T10:19:23.508214+0000","last_unstale":"2024-04-21T10:21:24.090386+0000","last_undegraded":"2024-04-21T10:21:24.090386+0000","last_fullsized":"2024-04-21T10:21:24.090386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:55:02.979989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099006+0000","last_change":"2024-04-21T10:19:23.513148+0000","last_active":"2024-04-21T10:21:24.099006+0000","last_peered":"2024-04-21T10:21:24.099006+0000","last_clean":"2024-04-21T10:21:24.099006+0000","last_became_active":"2024-04-21T10:19:23.512808+0000","last_became_peered":"2024-04-21T10:19:23.512808+0000","last_unstale":"2024-04-21T10:21:24.099006+0000","last_undegraded":"2024-04-21T10:21:24.099006+0000","last_fullsized":"2024-04-21T10:21:24.099006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:14:13.509778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.089253+0000","last_change":"2024-04-21T10:20:15.830207+0000","last_active":"2024-04-21T10:21:24.089253+0000","last_peered":"2024-04-21T10:21:24.089253+0000","last_clean":"2024-04-21T10:21:24.089253+0000","last_became_active":"2024-04-21T10:20:15.829809+0000","last_became_peered":"2024-04-21T10:20:15.829809+0000","last_unstale":"2024-04-21T10:21:24.089253+0000","last_undegraded":"2024-04-21T10:21:24.089253+0000","last_fullsized":"2024-04-21T10:21:24.089253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:21:03.485624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099538+0000","last_change":"2024-04-21T10:19:23.510020+0000","last_active":"2024-04-21T10:21:24.099538+0000","last_peered":"2024-04-21T10:21:24.099538+0000","last_clean":"2024-04-21T10:21:24.099538+0000","last_became_active":"2024-04-21T10:19:23.509651+0000","last_became_peered":"2024-04-21T10:19:23.509651+0000","last_unstale":"2024-04-21T10:21:24.099538+0000","last_undegraded":"2024-04-21T10:21:24.099538+0000","last_fullsized":"2024-04-21T10:21:24.099538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T21:44:20.214408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099081+0000","last_change":"2024-04-21T10:19:23.520049+0000","last_active":"2024-04-21T10:21:24.099081+0000","last_peered":"2024-04-21T10:21:24.099081+0000","last_clean":"2024-04-21T10:21:24.099081+0000","last_became_active":"2024-04-21T10:19:23.519763+0000","last_became_peered":"2024-04-21T10:19:23.519763+0000","last_unstale":"2024-04-21T10:21:24.099081+0000","last_undegraded":"2024-04-21T10:21:24.099081+0000","last_fullsized":"2024-04-21T10:21:24.099081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:48:22.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.098831+0000","last_change":"2024-04-21T10:19:23.514179+0000","last_active":"2024-04-21T10:21:24.098831+0000","last_peered":"2024-04-21T10:21:24.098831+0000","last_clean":"2024-04-21T10:21:24.098831+0000","last_became_active":"2024-04-21T10:19:23.512982+0000","last_became_peered":"2024-04-21T10:19:23.512982+0000","last_unstale":"2024-04-21T10:21:24.098831+0000","last_undegraded":"2024-04-21T10:21:24.098831+0000","last_fullsized":"2024-04-21T10:21:24.098831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:18:46.271474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.099406+0000","last_change":"2024-04-21T10:19:23.517695+0000","last_active":"2024-04-21T10:21:24.099406+0000","last_peered":"2024-04-21T10:21:24.099406+0000","last_clean":"2024-04-21T10:21:24.099406+0000","last_became_active":"2024-04-21T10:19:23.517309+0000","last_became_peered":"2024-04-21T10:19:23.517309+0000","last_unstale":"2024-04-21T10:21:24.099406+0000","last_undegraded":"2024-04-21T10:21:24.099406+0000","last_fullsized":"2024-04-21T10:21:24.099406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:23:30.951945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T10:21:24.090255+0000","last_change":"2024-04-21T10:19:23.520150+0000","last_active":"2024-04-21T10:21:24.090255+0000","last_peered":"2024-04-21T10:21:24.090255+0000","last_clean":"2024-04-21T10:21:24.090255+0000","last_became_active":"2024-04-21T10:19:23.519831+0000","last_became_peered":"2024-04-21T10:19:23.519831+0000","last_unstale":"2024-04-21T10:21:24.090255+0000","last_undegraded":"2024-04-21T10:21:24.090255+0000","last_fullsized":"2024-04-21T10:21:24.090255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T10:19:22.479067+0000","last_clean_scrub_stamp":"2024-04-21T10:19:22.479067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:32:45.653309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108390,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595473,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":835,"num_read_kb":524,"num_write":284,"num_write_kb":1434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1786419,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":465244,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1130496,"data_stored":1254728,"data_compressed":45182,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":858584,"data_compressed":22042,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":858392,"data_compressed":22042,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1019904,"data_stored":1058673,"data_compressed":39026,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":464757,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":529360,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":466028,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":531633,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":989884,"data_compressed":28198,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":466508,"data_compressed":2896,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":1188643,"data_compressed":45182,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36130,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133608,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":393842,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":199693,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T10:21:29.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:21:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 -- 172.21.15.77:0/3765489478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc106150 msgr2=0x7f9acc10dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3765489478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc106150 0x7f9acc10dd20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009ca0 tx=0x7f9ac402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 -- 172.21.15.77:0/3765489478 shutdown_connections 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3765489478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc106150 0x7f9acc10dd20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3765489478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc1021f0 0x7f9acc105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3765489478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9acc101840 0x7f9acc101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 -- 172.21.15.77:0/3765489478 >> 172.21.15.77:0/3765489478 conn(0x7f9acc077450 msgr2=0x7f9acc0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 -- 172.21.15.77:0/3765489478 shutdown_connections 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.104+0000 7f9ad0843640 1 -- 172.21.15.77:0/3765489478 wait complete. 2024-04-21T10:21:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 Processor -- start 2024-04-21T10:21:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 -- start start 2024-04-21T10:21:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc101840 0x7f9acc1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9acc106150 0x7f9acc1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 0x7f9acc19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc10ffb0 con 0x7f9acc19a780 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc10fe30 con 0x7f9acc101840 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9ad0843640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc110130 con 0x7f9acc106150 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.105+0000 7f9acad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 0x7f9acc19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 0x7f9acc19ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34186/0 (socket says 172.21.15.77:34186) 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 -- 172.21.15.77:0/3366357141 learned_addr learned my addr 172.21.15.77:0/3366357141 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9ac1d9b640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9acc106150 0x7f9acc1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9aca59c640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc101840 0x7f9acc1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 -- 172.21.15.77:0/3366357141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9acc106150 msgr2=0x7f9acc1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9acc106150 0x7f9acc1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 -- 172.21.15.77:0/3366357141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc101840 msgr2=0x7f9acc1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc101840 0x7f9acc1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 -- 172.21.15.77:0/3366357141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc19b380 con 0x7f9acc19a780 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9aca59c640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc101840 0x7f9acc1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9acad9d640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 0x7f9acc19ac00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4005e30 tx=0x7f9ac40346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4041020 con 0x7f9acc19a780 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ac4032970 con 0x7f9acc19a780 2024-04-21T10:21:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc19b610 con 0x7f9acc19a780 2024-04-21T10:21:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4039040 con 0x7f9acc19a780 2024-04-21T10:21:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.106+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1a7700 con 0x7f9acc19a780 2024-04-21T10:21:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.107+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9acc069230 con 0x7f9acc19a780 2024-04-21T10:21:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.109+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f9ac4044020 con 0x7f9acc19a780 2024-04-21T10:21:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.109+0000 7f9ac3fff640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ab80a3db0 0x7f9ab80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.109+0000 7f9aca59c640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ab80a3db0 0x7f9ab80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.109+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9ac40f2570 con 0x7f9acc19a780 2024-04-21T10:21:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.110+0000 7f9aca59c640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ab80a3db0 0x7f9ab80a6270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009b50 tx=0x7f9abc005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.114+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9ac404b020 con 0x7f9acc19a780 2024-04-21T10:21:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-21T10:21:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:29 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/445370849' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-21T10:21:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:29 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/445370849' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:30.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.330+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9acc02d660 con 0x7f9acc19a780 2024-04-21T10:21:30.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.330+0000 7f9ac3fff640 1 -- 172.21.15.77:0/3366357141 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f9ac40bebe0 con 0x7f9acc19a780 2024-04-21T10:21:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:22.860473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:21:30.331 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2024-04-21T10:21:30.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ab80a3db0 msgr2=0x7f9ab80a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ab80a3db0 0x7f9ab80a6270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009b50 tx=0x7f9abc005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 msgr2=0x7f9acc19ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 0x7f9acc19ac00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4005e30 tx=0x7f9ac40346d0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 shutdown_connections 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ab80a3db0 0x7f9ab80a6270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9acc19a780 0x7f9acc19ac00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9acc106150 0x7f9acc1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 --2- 172.21.15.77:0/3366357141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9acc101840 0x7f9acc1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 >> 172.21.15.77:0/3366357141 conn(0x7f9acc077450 msgr2=0x7f9acc1042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 shutdown_connections 2024-04-21T10:21:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.333+0000 7f9ad0843640 1 -- 172.21.15.77:0/3366357141 wait complete. 2024-04-21T10:21:30.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.342 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-04-21T10:21:30.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T10:21:30.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: Updating smithi077:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: Updating smithi191:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: Updating smithi170:/var/lib/ceph/41617fb2-ffc7-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T10:21:30.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-21T10:21:30.343 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:29 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/445370849' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:30.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:30.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 -- 172.21.15.77:0/4204338835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 msgr2=0x7f0da8102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 --2- 172.21.15.77:0/4204338835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8102580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009900 tx=0x7f0d9802bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:30.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 -- 172.21.15.77:0/4204338835 shutdown_connections 2024-04-21T10:21:30.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 --2- 172.21.15.77:0/4204338835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da8107270 0x7f0da810ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 --2- 172.21.15.77:0/4204338835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0da8102b50 0x7f0da8106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 --2- 172.21.15.77:0/4204338835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8102580 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 -- 172.21.15.77:0/4204338835 >> 172.21.15.77:0/4204338835 conn(0x7f0da80793a0 msgr2=0x7f0da80797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 -- 172.21.15.77:0/4204338835 shutdown_connections 2024-04-21T10:21:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.442+0000 7f0dace88640 1 -- 172.21.15.77:0/4204338835 wait complete. 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 Processor -- start 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 -- start start 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0da8107270 0x7f0da8198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da819cfd0 0x7f0da819d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81121b0 con 0x7f0da81021a0 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0da8112030 con 0x7f0da8107270 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0dace88640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0da8112330 con 0x7f0da819cfd0 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34190/0 (socket says 172.21.15.77:34190) 2024-04-21T10:21:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 -- 172.21.15.77:0/874473266 learned_addr learned my addr 172.21.15.77:0/874473266 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da5d9b640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0da8107270 0x7f0da8198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da6d9d640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da819cfd0 0x7f0da819d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 -- 172.21.15.77:0/874473266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da819cfd0 msgr2=0x7f0da819d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da819cfd0 0x7f0da819d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 -- 172.21.15.77:0/874473266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0da8107270 msgr2=0x7f0da8198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0da8107270 0x7f0da8198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da659c640 1 -- 172.21.15.77:0/874473266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da819dac0 con 0x7f0da81021a0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.443+0000 7f0da6d9d640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da819cfd0 0x7f0da819d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.444+0000 7f0da659c640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8198710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005940 tx=0x7f0d9802c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.444+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98043020 con 0x7f0da81021a0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.444+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da819dd50 con 0x7f0da81021a0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.444+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d9802cc60 con 0x7f0da81021a0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.444+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98003c30 con 0x7f0da81021a0 2024-04-21T10:21:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.444+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da81a5570 con 0x7f0da81021a0 2024-04-21T10:21:30.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.445+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da8069230 con 0x7f0da81021a0 2024-04-21T10:21:30.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.446+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f0d98046020 con 0x7f0da81021a0 2024-04-21T10:21:30.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.446+0000 7f0d977fe640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d900a3db0 0x7f0d900a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.447+0000 7f0da5d9b640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d900a3db0 0x7f0d900a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.447+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d980f2d10 con 0x7f0da81021a0 2024-04-21T10:21:30.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.447+0000 7f0da5d9b640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d900a3db0 0x7f0d900a6270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0da81018c0 tx=0x7f0d9c00a4c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.451+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0d9804d020 con 0x7f0da81021a0 2024-04-21T10:21:30.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.632+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0da8199a60 con 0x7f0da81021a0 2024-04-21T10:21:30.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.634+0000 7f0d977fe640 1 -- 172.21.15.77:0/874473266 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23042 (secure 0 0 0) 0x7f0d980bf380 con 0x7f0da81021a0 2024-04-21T10:21:30.634 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:30.634 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":88,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:21:24.082200+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1164251312":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6800/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/3052232463":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/2521386496":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3467069555":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d900a3db0 msgr2=0x7f0d900a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d900a3db0 0x7f0d900a6270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0da81018c0 tx=0x7f0d9c00a4c0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 msgr2=0x7f0da8198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8198710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005940 tx=0x7f0d9802c860 comp rx=0 tx=0).stop 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 shutdown_connections 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d900a3db0 0x7f0d900a6270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0da819cfd0 0x7f0da819d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0da8107270 0x7f0da8198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 --2- 172.21.15.77:0/874473266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0da81021a0 0x7f0da8198710 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 >> 172.21.15.77:0/874473266 conn(0x7f0da80793a0 msgr2=0x7f0da80fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:30.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 shutdown_connections 2024-04-21T10:21:30.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.636+0000 7f0dace88640 1 -- 172.21.15.77:0/874473266 wait complete. 2024-04-21T10:21:30.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T10:14:38.682196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T10:19:20.522696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T10:19:21.796864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T10:21:30.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 -- 172.21.15.77:0/2576564037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102b40 msgr2=0x7f56b4106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/2576564037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102b40 0x7f56b4106b80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009900 tx=0x7f56a802bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 -- 172.21.15.77:0/2576564037 shutdown_connections 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/2576564037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102b40 0x7f56b4106b80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/2576564037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b4107260 0x7f56b410ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/2576564037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4102190 0x7f56b4102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 -- 172.21.15.77:0/2576564037 >> 172.21.15.77:0/2576564037 conn(0x7f56b40793a0 msgr2=0x7f56b40797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 -- 172.21.15.77:0/2576564037 shutdown_connections 2024-04-21T10:21:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 -- 172.21.15.77:0/2576564037 wait complete. 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.748+0000 7f56b9fb2640 1 Processor -- start 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 -- start start 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 0x7f56b4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4107260 0x7f56b4074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b4074cd0 0x7f56b41a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41121a0 con 0x7f56b4102190 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4112020 con 0x7f56b4074cd0 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b9fb2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4112320 con 0x7f56b4107260 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 0x7f56b4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 0x7f56b4074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33770/0 (socket says 172.21.15.77:33770) 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 -- 172.21.15.77:0/1765897006 learned_addr learned my addr 172.21.15.77:0/1765897006 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b2ffd640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4107260 0x7f56b4074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 -- 172.21.15.77:0/1765897006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4107260 msgr2=0x7f56b4074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4107260 0x7f56b4074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 -- 172.21.15.77:0/1765897006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b4074cd0 msgr2=0x7f56b41a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b4074cd0 0x7f56b41a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 -- 172.21.15.77:0/1765897006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b41a7050 con 0x7f56b4102190 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b2ffd640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4107260 0x7f56b4074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.749+0000 7f56b37fe640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 0x7f56b4074250 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f56a400e9f0 tx=0x7f56a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.750+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a400cd80 con 0x7f56b4102190 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.750+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a40054d0 con 0x7f56b4102190 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.750+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b41a7340 con 0x7f56b4102190 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.750+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4010690 con 0x7f56b4102190 2024-04-21T10:21:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.750+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b41a7810 con 0x7f56b4102190 2024-04-21T10:21:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.751+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b40691c0 con 0x7f56b4102190 2024-04-21T10:21:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.752+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f56a4004e50 con 0x7f56b4102190 2024-04-21T10:21:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.752+0000 7f56b0ff9640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f569c0a3de0 0x7f569c0a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.752+0000 7f56b2ffd640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f569c0a3de0 0x7f569c0a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.753+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f56a40d0e60 con 0x7f56b4102190 2024-04-21T10:21:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.753+0000 7f56b2ffd640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f569c0a3de0 0x7f569c0a62a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56a8006010 tx=0x7f56a8005a20 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.757+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f56a409d3c0 con 0x7f56b4102190 2024-04-21T10:21:30.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.937+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f56b4102b40 con 0x7f56b4102190 2024-04-21T10:21:30.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.938+0000 7f56b0ff9640 1 -- 172.21.15.77:0/1765897006 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f56a409ccc0 con 0x7f56b4102190 2024-04-21T10:21:30.938 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-21T10:21:30.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.939+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f569c0a3de0 msgr2=0x7f569c0a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.939+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f569c0a3de0 0x7f569c0a62a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56a8006010 tx=0x7f56a8005a20 comp rx=0 tx=0).stop 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.939+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 msgr2=0x7f56b4074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.939+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 0x7f56b4074250 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f56a400e9f0 tx=0x7f56a400edf0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 shutdown_connections 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f569c0a3de0 0x7f569c0a62a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b4074cd0 0x7f56b41a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b4107260 0x7f56b4074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 --2- 172.21.15.77:0/1765897006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b4102190 0x7f56b4074250 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 >> 172.21.15.77:0/1765897006 conn(0x7f56b40793a0 msgr2=0x7f56b4100040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 shutdown_connections 2024-04-21T10:21:30.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:30.940+0000 7f56b9fb2640 1 -- 172.21.15.77:0/1765897006 wait complete. 2024-04-21T10:21:30.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.052+0000 7f18f1a62640 1 -- 172.21.15.77:0/3764585660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec10c900 msgr2=0x7f18ec10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.052+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3764585660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec10c900 0x7f18ec10cd80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009930 tx=0x7f18e002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.052+0000 7f18f1a62640 1 -- 172.21.15.77:0/3764585660 shutdown_connections 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.052+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3764585660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec10c900 0x7f18ec10cd80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.052+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3764585660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 0x7f18ec1197d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3764585660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18ec112910 0x7f18ec112cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- 172.21.15.77:0/3764585660 >> 172.21.15.77:0/3764585660 conn(0x7f18ec06cfa0 msgr2=0x7f18ec10af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- 172.21.15.77:0/3764585660 shutdown_connections 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- 172.21.15.77:0/3764585660 wait complete. 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 Processor -- start 2024-04-21T10:21:31.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- start start 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18ec10c900 0x7f18ec1a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 0x7f18ec1a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 0x7f18ec1a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec11cc20 con 0x7f18ec112910 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec11caa0 con 0x7f18ec10c900 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.053+0000 7f18f1a62640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec11cda0 con 0x7f18ec10d2c0 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 0x7f18ec1a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 0x7f18ec1a7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33786/0 (socket says 172.21.15.77:33786) 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 -- 172.21.15.77:0/3146958314 learned_addr learned my addr 172.21.15.77:0/3146958314 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18ec10c900 0x7f18ec1a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18eaffd640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 0x7f18ec1a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 -- 172.21.15.77:0/3146958314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 msgr2=0x7f18ec1a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 0x7f18ec1a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 -- 172.21.15.77:0/3146958314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18ec10c900 msgr2=0x7f18ec1a31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18ec10c900 0x7f18ec1a31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 -- 172.21.15.77:0/3146958314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec1a81d0 con 0x7f18ec112910 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18eaffd640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 0x7f18ec1a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18ebfff640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 0x7f18ec1a7aa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f18e400b970 tx=0x7f18e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4019070 con 0x7f18ec112910 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18e4014440 con 0x7f18ec112910 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec1a84c0 con 0x7f18ec112910 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e40075d0 con 0x7f18ec112910 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.054+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec1afd50 con 0x7f18ec112910 2024-04-21T10:21:31.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.055+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ec068d70 con 0x7f18ec112910 2024-04-21T10:21:31.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.056+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f18e401c070 con 0x7f18ec112910 2024-04-21T10:21:31.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.057+0000 7f18e8ff9640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f18d40a3e30 0x7f18d40a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.057+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f18d40a3e30 0x7f18d40a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.057+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f18e40cfe40 con 0x7f18ec112910 2024-04-21T10:21:31.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.057+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f18d40a3e30 0x7f18d40a62f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0058c0 tx=0x7f18dc00a4c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:31.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.062+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18e409c4b0 con 0x7f18ec112910 2024-04-21T10:21:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:30 smithi191 ceph-mon[31636]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:30 smithi191 ceph-mon[31636]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:30 smithi191 ceph-mon[31636]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:30 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3366357141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:30 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/874473266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:30 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1765897006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:31.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.240+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f18ec02d5c0 con 0x7f18ec112910 2024-04-21T10:21:31.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.240+0000 7f18e8ff9640 1 -- 172.21.15.77:0/3146958314 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f18e409bdb0 con 0x7f18ec112910 2024-04-21T10:21:31.240 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f18d40a3e30 msgr2=0x7f18d40a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f18d40a3e30 0x7f18d40a62f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0058c0 tx=0x7f18dc00a4c0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 msgr2=0x7f18ec1a7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 0x7f18ec1a7aa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f18e400b970 tx=0x7f18e400be30 comp rx=0 tx=0).stop 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 shutdown_connections 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f18d40a3e30 0x7f18d40a62f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec112910 0x7f18ec1a7aa0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18ec10d2c0 0x7f18ec1a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 --2- 172.21.15.77:0/3146958314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18ec10c900 0x7f18ec1a31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 >> 172.21.15.77:0/3146958314 conn(0x7f18ec06cfa0 msgr2=0x7f18ec10f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 shutdown_connections 2024-04-21T10:21:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.242+0000 7f18f1a62640 1 -- 172.21.15.77:0/3146958314 wait complete. 2024-04-21T10:21:31.252 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:30 smithi077 ceph-mon[27902]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.252 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:30 smithi077 ceph-mon[27902]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.252 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:30 smithi077 ceph-mon[27902]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:30 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3366357141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:31.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:30 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/874473266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:31.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:30 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1765897006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:31.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T10:21:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:30 smithi170 ceph-mon[31212]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:30 smithi170 ceph-mon[31212]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:30 smithi170 ceph-mon[31212]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T10:21:31.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:30 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3366357141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:31.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:30 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/874473266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:31.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:30 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1765897006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T10:21:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 -- 172.21.15.77:0/1472754408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7100106160 msgr2=0x7f710010dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1472754408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7100106160 0x7f710010dd30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009ca0 tx=0x7f70f802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 -- 172.21.15.77:0/1472754408 shutdown_connections 2024-04-21T10:21:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1472754408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7100106160 0x7f710010dd30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1472754408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7100101a40 0x7f7100105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1472754408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7100101090 0x7f7100101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 -- 172.21.15.77:0/1472754408 >> 172.21.15.77:0/1472754408 conn(0x7f7100077f50 msgr2=0x7f7100078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 -- 172.21.15.77:0/1472754408 shutdown_connections 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.357+0000 7f7106a9a640 1 -- 172.21.15.77:0/1472754408 wait complete. 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 Processor -- start 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 -- start start 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7100101090 0x7f71001986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7100106160 0x7f7100198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 0x7f710019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71001121e0 con 0x7f710019cf80 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7100112060 con 0x7f7100101090 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7106a9a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7100112360 con 0x7f7100106160 2024-04-21T10:21:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7105037640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 0x7f710019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7105037640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 0x7f710019d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33804/0 (socket says 172.21.15.77:33804) 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f70fffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7100106160 0x7f7100198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.358+0000 7f7105037640 1 -- 172.21.15.77:0/1022878935 learned_addr learned my addr 172.21.15.77:0/1022878935 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7104836640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7100101090 0x7f71001986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7105037640 1 -- 172.21.15.77:0/1022878935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7100106160 msgr2=0x7f7100198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7105037640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7100106160 0x7f7100198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7105037640 1 -- 172.21.15.77:0/1022878935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7100101090 msgr2=0x7f71001986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7105037640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7100101090 0x7f71001986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7105037640 1 -- 172.21.15.77:0/1022878935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710019da70 con 0x7f710019cf80 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7105037640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 0x7f710019d430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005e30 tx=0x7f70f8034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8039040 con 0x7f710019cf80 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70f8044070 con 0x7f710019cf80 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710019dd00 con 0x7f710019cf80 2024-04-21T10:21:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8003e60 con 0x7f710019cf80 2024-04-21T10:21:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.359+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71001a54c0 con 0x7f710019cf80 2024-04-21T10:21:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.360+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7100068d70 con 0x7f710019cf80 2024-04-21T10:21:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.361+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f70f80324c0 con 0x7f710019cf80 2024-04-21T10:21:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.362+0000 7f70fdffb640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f70f00a3db0 0x7f70f00a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.362+0000 7f7104836640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f70f00a3db0 0x7f70f00a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.362+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f70f80f35e0 con 0x7f710019cf80 2024-04-21T10:21:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.363+0000 7f7104836640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f70f00a3db0 0x7f70f00a6270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005fd0 tx=0x7f70f4005850 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:31.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.366+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70f80bfc30 con 0x7f710019cf80 2024-04-21T10:21:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.549+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7100101a40 con 0x7f710019cf80 2024-04-21T10:21:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.550+0000 7f70fdffb640 1 -- 172.21.15.77:0/1022878935 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f70f80bf530 con 0x7f710019cf80 2024-04-21T10:21:31.550 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-21T10:21:31.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f70f00a3db0 msgr2=0x7f70f00a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f70f00a3db0 0x7f70f00a6270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005fd0 tx=0x7f70f4005850 comp rx=0 tx=0).stop 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 msgr2=0x7f710019d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 0x7f710019d430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005e30 tx=0x7f70f8034760 comp rx=0 tx=0).stop 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 shutdown_connections 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f70f00a3db0 0x7f70f00a6270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f710019cf80 0x7f710019d430 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7100106160 0x7f7100198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 --2- 172.21.15.77:0/1022878935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7100101090 0x7f71001986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 >> 172.21.15.77:0/1022878935 conn(0x7f7100077f50 msgr2=0x7f71000fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 shutdown_connections 2024-04-21T10:21:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.552+0000 7f7106a9a640 1 -- 172.21.15.77:0/1022878935 wait complete. 2024-04-21T10:21:31.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 -- 172.21.15.77:0/1543828952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc06b2a0 msgr2=0x7fa7fc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 --2- 172.21.15.77:0/1543828952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc06b2a0 0x7fa7fc106bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009900 tx=0x7fa7f002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 -- 172.21.15.77:0/1543828952 shutdown_connections 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 --2- 172.21.15.77:0/1543828952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc06b2a0 0x7fa7fc106bc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 --2- 172.21.15.77:0/1543828952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7fc1072f0 0x7fa7fc10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 --2- 172.21.15.77:0/1543828952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7fc06a8f0 0x7fa7fc06acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 -- 172.21.15.77:0/1543828952 >> 172.21.15.77:0/1543828952 conn(0x7fa7fc077e30 msgr2=0x7fa7fc078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 -- 172.21.15.77:0/1543828952 shutdown_connections 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 -- 172.21.15.77:0/1543828952 wait complete. 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.662+0000 7fa801984640 1 Processor -- start 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 -- start start 2024-04-21T10:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7fc06a8f0 0x7fa7fc198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7fc1072f0 0x7fa7fc198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 0x7fa7fc19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1121c0 con 0x7fa7fc19d020 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc112040 con 0x7fa7fc1072f0 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa801984640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc112340 con 0x7fa7fc06a8f0 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 0x7fa7fc19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 0x7fa7fc19d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33820/0 (socket says 172.21.15.77:33820) 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 -- 172.21.15.77:0/1862107344 learned_addr learned my addr 172.21.15.77:0/1862107344 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7faffd640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7fc06a8f0 0x7fa7fc198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fa7fc640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7fc1072f0 0x7fa7fc198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 -- 172.21.15.77:0/1862107344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7fc06a8f0 msgr2=0x7fa7fc198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7fc06a8f0 0x7fa7fc198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 -- 172.21.15.77:0/1862107344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7fc1072f0 msgr2=0x7fa7fc198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7fc1072f0 0x7fa7fc198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 -- 172.21.15.77:0/1862107344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc19db10 con 0x7fa7fc19d020 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa7fb7fe640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 0x7fa7fc19d4d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400eb10 tx=0x7fa7f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.663+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4004b20 con 0x7fa7fc19d020 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.664+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7f4004cc0 con 0x7fa7fc19d020 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.664+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc19de00 con 0x7fa7fc19d020 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.664+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4010670 con 0x7fa7fc19d020 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.664+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc1a55c0 con 0x7fa7fc19d020 2024-04-21T10:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.664+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc069230 con 0x7fa7fc19d020 2024-04-21T10:21:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.665+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7fa7f4005020 con 0x7fa7fc19d020 2024-04-21T10:21:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.666+0000 7fa800982640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7e40a3db0 0x7fa7e40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.666+0000 7fa7faffd640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7e40a3db0 0x7fa7e40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.666+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa7f40d0e50 con 0x7fa7fc19d020 2024-04-21T10:21:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.667+0000 7fa7faffd640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7e40a3db0 0x7fa7e40a6270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0058c0 tx=0x7fa7ec00a2d0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.671+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa7f409d3b0 con 0x7fa7fc19d020 2024-04-21T10:21:31.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.884+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7fc06b2a0 con 0x7fa7fc19d020 2024-04-21T10:21:31.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.885+0000 7fa800982640 1 -- 172.21.15.77:0/1862107344 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7fa7f409ccb0 con 0x7fa7fc19d020 2024-04-21T10:21:31.885 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:31.885 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:22.860473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:21:31.885 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7e40a3db0 msgr2=0x7fa7e40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7e40a3db0 0x7fa7e40a6270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0058c0 tx=0x7fa7ec00a2d0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 msgr2=0x7fa7fc19d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 0x7fa7fc19d4d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400eb10 tx=0x7fa7f400c2d0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 shutdown_connections 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7e40a3db0 0x7fa7e40a6270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7fc19d020 0x7fa7fc19d4d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7fc1072f0 0x7fa7fc198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 --2- 172.21.15.77:0/1862107344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7fc06a8f0 0x7fa7fc198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 >> 172.21.15.77:0/1862107344 conn(0x7fa7fc077e30 msgr2=0x7fa7fc0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:31.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 shutdown_connections 2024-04-21T10:21:31.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.887+0000 7fa801984640 1 -- 172.21.15.77:0/1862107344 wait complete. 2024-04-21T10:21:31.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T10:21:31.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 -- 172.21.15.77:0/3817328464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c0106180 msgr2=0x7f12c010dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 --2- 172.21.15.77:0/3817328464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c0106180 0x7f12c010dd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009900 tx=0x7f12b002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 -- 172.21.15.77:0/3817328464 shutdown_connections 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 --2- 172.21.15.77:0/3817328464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c0106180 0x7f12c010dd50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 --2- 172.21.15.77:0/3817328464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0101a60 0x7f12c0105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 --2- 172.21.15.77:0/3817328464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c01010b0 0x7f12c0101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 -- 172.21.15.77:0/3817328464 >> 172.21.15.77:0/3817328464 conn(0x7f12c00771d0 msgr2=0x7f12c00775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 -- 172.21.15.77:0/3817328464 shutdown_connections 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.997+0000 7f12c56a0640 1 -- 172.21.15.77:0/3817328464 wait complete. 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 Processor -- start 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 -- start start 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c01010b0 0x7f12c0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0106180 0x7f12c0198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 0x7f12c019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12c0112200 con 0x7f12c019cfb0 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f12c0112080 con 0x7f12c0106180 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12c56a0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f12c0112380 con 0x7f12c01010b0 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 0x7f12c019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 0x7f12c019d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33824/0 (socket says 172.21.15.77:33824) 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12bf7fe640 1 -- 172.21.15.77:0/4027189281 learned_addr learned my addr 172.21.15.77:0/4027189281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.998+0000 7f12beffd640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c01010b0 0x7f12c0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12be7fc640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0106180 0x7f12c0198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12bf7fe640 1 -- 172.21.15.77:0/4027189281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c01010b0 msgr2=0x7f12c0198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12bf7fe640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c01010b0 0x7f12c0198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12bf7fe640 1 -- 172.21.15.77:0/4027189281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0106180 msgr2=0x7f12c0198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12bf7fe640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0106180 0x7f12c0198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12bf7fe640 1 -- 172.21.15.77:0/4027189281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c019daa0 con 0x7f12c019cfb0 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12be7fc640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0106180 0x7f12c0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12bf7fe640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 0x7f12c019d460 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009230 tx=0x7f12b002c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0043020 con 0x7f12c019cfb0 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c019dd30 con 0x7f12c019cfb0 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12b002caf0 con 0x7f12c019cfb0 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0003990 con 0x7f12c019cfb0 2024-04-21T10:21:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:31.999+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c01a5580 con 0x7f12c019cfb0 2024-04-21T10:21:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.000+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c0069230 con 0x7f12c019cfb0 2024-04-21T10:21:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.001+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f12b0046020 con 0x7f12c019cfb0 2024-04-21T10:21:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.002+0000 7f12a7fff640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f12a80a3db0 0x7f12a80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.002+0000 7f12beffd640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f12a80a3db0 0x7f12a80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.002+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f12b00f2bb0 con 0x7f12c019cfb0 2024-04-21T10:21:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.002+0000 7f12beffd640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f12a80a3db0 0x7f12a80a6270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12b8005fd0 tx=0x7f12b8009500 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.006+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f12b004d020 con 0x7f12c019cfb0 2024-04-21T10:21:32.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.188+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12c0109410 con 0x7f12c019cfb0 2024-04-21T10:21:32.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.189+0000 7f12a7fff640 1 -- 172.21.15.77:0/4027189281 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23042 (secure 0 0 0) 0x7f12b00bf340 con 0x7f12c019cfb0 2024-04-21T10:21:32.189 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:32.190 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":88,"fsid":"41617fb2-ffc7-11ee-bc93-c7b262605968","created":"2024-04-21T10:11:13.991495+0000","modified":"2024-04-21T10:21:24.082200+0000","last_up_change":"2024-04-21T10:18:29.151160+0000","last_in_change":"2024-04-21T10:18:08.474468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T10:14:38.682196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T10:19:20.522696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T10:19:21.796864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e82e5ffc-2406-48be-b12a-30c6972b3df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6803","nonce":2965386112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6805","nonce":2965386112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6809","nonce":2965386112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2965386112},{"type":"v1","addr":"172.21.15.77:6807","nonce":2965386112}]},"public_addr":"172.21.15.77:6803/2965386112","cluster_addr":"172.21.15.77:6805/2965386112","heartbeat_back_addr":"172.21.15.77:6809/2965386112","heartbeat_front_addr":"172.21.15.77:6807/2965386112","state":["exists","up"]},{"osd":1,"uuid":"692cfb0a-b71d-41b3-bc8f-f99352c085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6801","nonce":1692456293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6803","nonce":1692456293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6807","nonce":1692456293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1692456293},{"type":"v1","addr":"172.21.15.170:6805","nonce":1692456293}]},"public_addr":"172.21.15.170:6801/1692456293","cluster_addr":"172.21.15.170:6803/1692456293","heartbeat_back_addr":"172.21.15.170:6807/1692456293","heartbeat_front_addr":"172.21.15.170:6805/1692456293","state":["exists","up"]},{"osd":2,"uuid":"c585bc66-98a9-4126-8208-11fb8b8d16ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6801","nonce":1645526465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6803","nonce":1645526465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6807","nonce":1645526465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1645526465},{"type":"v1","addr":"172.21.15.191:6805","nonce":1645526465}]},"public_addr":"172.21.15.191:6801/1645526465","cluster_addr":"172.21.15.191:6803/1645526465","heartbeat_back_addr":"172.21.15.191:6807/1645526465","heartbeat_front_addr":"172.21.15.191:6805/1645526465","state":["exists","up"]},{"osd":3,"uuid":"81c05614-2d27-42d3-8f3a-27ac4d5aa6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6811","nonce":2907599341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6813","nonce":2907599341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6817","nonce":2907599341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2907599341},{"type":"v1","addr":"172.21.15.77:6815","nonce":2907599341}]},"public_addr":"172.21.15.77:6811/2907599341","cluster_addr":"172.21.15.77:6813/2907599341","heartbeat_back_addr":"172.21.15.77:6817/2907599341","heartbeat_front_addr":"172.21.15.77:6815/2907599341","state":["exists","up"]},{"osd":4,"uuid":"cab5e375-2471-41e0-84bb-afee83e3a6a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6809","nonce":3749271051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6811","nonce":3749271051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6815","nonce":3749271051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3749271051},{"type":"v1","addr":"172.21.15.170:6813","nonce":3749271051}]},"public_addr":"172.21.15.170:6809/3749271051","cluster_addr":"172.21.15.170:6811/3749271051","heartbeat_back_addr":"172.21.15.170:6815/3749271051","heartbeat_front_addr":"172.21.15.170:6813/3749271051","state":["exists","up"]},{"osd":5,"uuid":"a658a938-5f51-414f-a216-bbc79584570d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6809","nonce":2690785499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6811","nonce":2690785499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6815","nonce":2690785499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2690785499},{"type":"v1","addr":"172.21.15.191:6813","nonce":2690785499}]},"public_addr":"172.21.15.191:6809/2690785499","cluster_addr":"172.21.15.191:6811/2690785499","heartbeat_back_addr":"172.21.15.191:6815/2690785499","heartbeat_front_addr":"172.21.15.191:6813/2690785499","state":["exists","up"]},{"osd":6,"uuid":"0d435ee1-0bb9-4cf2-b897-3a5297c8ed62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6819","nonce":170633927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6821","nonce":170633927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6825","nonce":170633927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":170633927},{"type":"v1","addr":"172.21.15.77:6823","nonce":170633927}]},"public_addr":"172.21.15.77:6819/170633927","cluster_addr":"172.21.15.77:6821/170633927","heartbeat_back_addr":"172.21.15.77:6825/170633927","heartbeat_front_addr":"172.21.15.77:6823/170633927","state":["exists","up"]},{"osd":7,"uuid":"3b00b7ce-1cb7-4a10-901f-ea7c6a82cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6817","nonce":3139153153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6819","nonce":3139153153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6823","nonce":3139153153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3139153153},{"type":"v1","addr":"172.21.15.170:6821","nonce":3139153153}]},"public_addr":"172.21.15.170:6817/3139153153","cluster_addr":"172.21.15.170:6819/3139153153","heartbeat_back_addr":"172.21.15.170:6823/3139153153","heartbeat_front_addr":"172.21.15.170:6821/3139153153","state":["exists","up"]},{"osd":8,"uuid":"e52a3152-3a86-4b87-b14d-dae9955549a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6817","nonce":609468755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6819","nonce":609468755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6823","nonce":609468755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":609468755},{"type":"v1","addr":"172.21.15.191:6821","nonce":609468755}]},"public_addr":"172.21.15.191:6817/609468755","cluster_addr":"172.21.15.191:6819/609468755","heartbeat_back_addr":"172.21.15.191:6823/609468755","heartbeat_front_addr":"172.21.15.191:6821/609468755","state":["exists","up"]},{"osd":9,"uuid":"e43bf362-1689-4a04-8dc2-eba9baedc9bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6827","nonce":2816502344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6829","nonce":2816502344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6833","nonce":2816502344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2816502344},{"type":"v1","addr":"172.21.15.77:6831","nonce":2816502344}]},"public_addr":"172.21.15.77:6827/2816502344","cluster_addr":"172.21.15.77:6829/2816502344","heartbeat_back_addr":"172.21.15.77:6833/2816502344","heartbeat_front_addr":"172.21.15.77:6831/2816502344","state":["exists","up"]},{"osd":10,"uuid":"97e854a6-998b-40c5-82c6-fa7ceb23400e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6825","nonce":1368923221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6827","nonce":1368923221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6831","nonce":1368923221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1368923221},{"type":"v1","addr":"172.21.15.170:6829","nonce":1368923221}]},"public_addr":"172.21.15.170:6825/1368923221","cluster_addr":"172.21.15.170:6827/1368923221","heartbeat_back_addr":"172.21.15.170:6831/1368923221","heartbeat_front_addr":"172.21.15.170:6829/1368923221","state":["exists","up"]},{"osd":11,"uuid":"0a84fddf-e9d1-45a2-a805-b1a92bd9a379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6825","nonce":1429777061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6827","nonce":1429777061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6831","nonce":1429777061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1429777061},{"type":"v1","addr":"172.21.15.191:6829","nonce":1429777061}]},"public_addr":"172.21.15.191:6825/1429777061","cluster_addr":"172.21.15.191:6827/1429777061","heartbeat_back_addr":"172.21.15.191:6831/1429777061","heartbeat_front_addr":"172.21.15.191:6829/1429777061","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:13:48.357226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:12.154865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:14:36.433875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:01.118258+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:25.965469+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:15:51.644680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:16.985498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:16:42.932397+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:08.286239+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:17:34.750541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:00.652264+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T10:18:26.850403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1164251312":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6800/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/3052232463":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/2521386496":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/3235809387":"2024-04-22T10:21:24.082147+0000","172.21.15.77:0/577902576":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3467069555":"2024-04-22T10:21:24.082147+0000","172.21.15.77:6801/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/815934319":"2024-04-22T10:12:14.592198+0000","172.21.15.77:6801/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1648486673":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/850001197":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/159829319":"2024-04-22T10:11:47.548747+0000","172.21.15.77:6800/1650379483":"2024-04-22T10:12:14.592198+0000","172.21.15.77:0/3733818915":"2024-04-22T10:11:47.548747+0000","172.21.15.77:0/2397197543":"2024-04-22T10:11:47.548747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T10:21:32.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f12a80a3db0 msgr2=0x7f12a80a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f12a80a3db0 0x7f12a80a6270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12b8005fd0 tx=0x7f12b8009500 comp rx=0 tx=0).stop 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 msgr2=0x7f12c019d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 0x7f12c019d460 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009230 tx=0x7f12b002c710 comp rx=0 tx=0).stop 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 shutdown_connections 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f12a80a3db0 0x7f12a80a6270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c019cfb0 0x7f12c019d460 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0106180 0x7f12c0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 --2- 172.21.15.77:0/4027189281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c01010b0 0x7f12c0198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.191+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 >> 172.21.15.77:0/4027189281 conn(0x7f12c00771d0 msgr2=0x7f12c00fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.192+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 shutdown_connections 2024-04-21T10:21:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.192+0000 7f12c56a0640 1 -- 172.21.15.77:0/4027189281 wait complete. 2024-04-21T10:21:32.202 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:31 smithi077 ceph-mon[27902]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 90 KiB/s wr, 94 op/s 2024-04-21T10:21:32.202 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:31 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3146958314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:32.202 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:31 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1022878935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:32.202 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:31 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1862107344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:32.204 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 821880 2024-04-21T10:21:32.204 DEBUG:tasks.quiescer:Yielding 2024-04-21T10:21:32.204 INFO:teuthology.run_tasks:Running task exec... 2024-04-21T10:21:32.214 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T10:21:32.214 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi077.front.sepia.ceph.com 2024-04-21T10:21:32.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-04-21T10:21:32.215 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:21:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:31 smithi191 ceph-mon[31636]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 90 KiB/s wr, 94 op/s 2024-04-21T10:21:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:31 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3146958314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:31 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1022878935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:31 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1862107344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:32.246 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:32.262 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem Size Used Avail Use% Mounted on 2024-04-21T10:21:32.262 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:3300,172.21.15.170:3300,172.21.15.191:3300:/volumes/qa/sv_1/0d601c45-51df-451f-bb5e-994bae49327f 340G 0 340G 0% /tmp/cephfs 2024-04-21T10:21:32.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-04-21T10:21:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:31 smithi170 ceph-mon[31212]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 90 KiB/s wr, 94 op/s 2024-04-21T10:21:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:31 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3146958314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T10:21:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:31 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1022878935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T10:21:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:31 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1862107344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:32.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 -- 172.21.15.77:0/3022072485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100690e0 msgr2=0x7f3110069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 --2- 172.21.15.77:0/3022072485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100690e0 0x7f3110069560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009900 tx=0x7f30fc02bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 -- 172.21.15.77:0/3022072485 shutdown_connections 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 --2- 172.21.15.77:0/3022072485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100690e0 0x7f3110069560 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 --2- 172.21.15.77:0/3022072485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3110069aa0 0x7f311010ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 --2- 172.21.15.77:0/3022072485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3110106f50 0x7f3110107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 -- 172.21.15.77:0/3022072485 >> 172.21.15.77:0/3022072485 conn(0x7f3110077e30 msgr2=0x7f3110078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 -- 172.21.15.77:0/3022072485 shutdown_connections 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 -- 172.21.15.77:0/3022072485 wait complete. 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 Processor -- start 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.316+0000 7f3117081640 1 -- start start 2024-04-21T10:21:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31100690e0 0x7f3110198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3110069aa0 0x7f3110198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 0x7f311019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3110112170 con 0x7f3110106f50 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3110111ff0 con 0x7f3110069aa0 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31101122f0 con 0x7f31100690e0 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 0x7f311019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 0x7f311019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33844/0 (socket says 172.21.15.77:33844) 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 -- 172.21.15.77:0/2462509225 learned_addr learned my addr 172.21.15.77:0/2462509225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3114e1d640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31100690e0 0x7f3110198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f310ffff640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3110069aa0 0x7f3110198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 -- 172.21.15.77:0/2462509225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31100690e0 msgr2=0x7f3110198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31100690e0 0x7f3110198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 -- 172.21.15.77:0/2462509225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3110069aa0 msgr2=0x7f3110198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3110069aa0 0x7f3110198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 -- 172.21.15.77:0/2462509225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311019d640 con 0x7f3110106f50 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f311561e640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 0x7f311019cf10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f310800eb10 tx=0x7f310800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108004b20 con 0x7f3110106f50 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311019d930 con 0x7f3110106f50 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3108004cc0 con 0x7f3110106f50 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.317+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108010690 con 0x7f3110106f50 2024-04-21T10:21:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.318+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31101a51c0 con 0x7f3110106f50 2024-04-21T10:21:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.319+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3110068de0 con 0x7f3110106f50 2024-04-21T10:21:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.320+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f3108005020 con 0x7f3110106f50 2024-04-21T10:21:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.320+0000 7f310dffb640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f31000a3db0 0x7f31000a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.320+0000 7f3114e1d640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f31000a3db0 0x7f31000a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.320+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f31080d0eb0 con 0x7f3110106f50 2024-04-21T10:21:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.321+0000 7f3114e1d640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f31000a3db0 0x7f31000a6270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3104009bd0 tx=0x7f3104005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.325+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f310809d410 con 0x7f3110106f50 2024-04-21T10:21:32.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-04-21T10:21:32.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-04-21T10:21:32.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.551+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f311002d5c0 con 0x7f3110106f50 2024-04-21T10:21:32.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.552+0000 7f310dffb640 1 -- 172.21.15.77:0/2462509225 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f310809cd10 con 0x7f3110106f50 2024-04-21T10:21:32.552 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:32.552 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:22.860473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:21:32.552 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2024-04-21T10:21:32.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f31000a3db0 msgr2=0x7f31000a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f31000a3db0 0x7f31000a6270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3104009bd0 tx=0x7f3104005f90 comp rx=0 tx=0).stop 2024-04-21T10:21:32.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 msgr2=0x7f311019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 0x7f311019cf10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f310800eb10 tx=0x7f310800c2d0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 shutdown_connections 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f31000a3db0 0x7f31000a6270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3110106f50 0x7f311019cf10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3110069aa0 0x7f3110198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 --2- 172.21.15.77:0/2462509225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31100690e0 0x7f3110198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 >> 172.21.15.77:0/2462509225 conn(0x7f3110077e30 msgr2=0x7f31100fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 shutdown_connections 2024-04-21T10:21:32.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.554+0000 7f3117081640 1 -- 172.21.15.77:0/2462509225 wait complete. 2024-04-21T10:21:32.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-21T10:19:22.828859+0000', 'modified': '2024-04-21T10:21:22.860473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24505, 'mds_1': 24491, 'mds_2': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2131093525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2131093525}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2131093525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.170:6837/3141822041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6836', 'nonce': 3141822041}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 3141822041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6835/2650789974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2650789974}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 2650789974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6837/2009641600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 2009641600}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2009641600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.170:6839/4122605825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 4122605825}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 4122605825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.191:6839/2863843162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2863843162}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2863843162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24505, 'qdb_cluster': [24461, 24491, 24505]} 2024-04-21T10:21:32.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-21T10:21:32.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1457417990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38106160 msgr2=0x7f0d3810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1457417990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38106160 0x7f0d3810dd30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009ca0 tx=0x7f0d3002c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1457417990 shutdown_connections 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1457417990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38106160 0x7f0d3810dd30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1457417990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d38101a40 0x7f0d38105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1457417990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d38101090 0x7f0d38101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1457417990 >> 172.21.15.77:0/1457417990 conn(0x7f0d38077f50 msgr2=0x7f0d38078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1457417990 shutdown_connections 2024-04-21T10:21:32.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.666+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1457417990 wait complete. 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 Processor -- start 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 -- start start 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 0x7f0d38199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d38106160 0x7f0d38199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d3819a010 0x7f0d381a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d381110d0 con 0x7f0d38101090 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38110f50 con 0x7f0d3819a010 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3c8ba640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38111250 con 0x7f0d38106160 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 0x7f0d38199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 0x7f0d38199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33862/0 (socket says 172.21.15.77:33862) 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.667+0000 7f0d3659c640 1 -- 172.21.15.77:0/1186684741 learned_addr learned my addr 172.21.15.77:0/1186684741 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d38106160 0x7f0d38199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d3819a010 0x7f0d381a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3659c640 1 -- 172.21.15.77:0/1186684741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d38106160 msgr2=0x7f0d38199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d38106160 0x7f0d38199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3659c640 1 -- 172.21.15.77:0/1186684741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d3819a010 msgr2=0x7f0d381a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d3819a010 0x7f0d381a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3659c640 1 -- 172.21.15.77:0/1186684741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d381a4db0 con 0x7f0d38101090 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d3819a010 0x7f0d381a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:32.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 0x7f0d38199590 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800e9f0 tx=0x7f0d2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d277fe640 1 -- 172.21.15.77:0/1186684741 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800cd80 con 0x7f0d38101090 2024-04-21T10:21:32.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d381a50a0 con 0x7f0d38101090 2024-04-21T10:21:32.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d277fe640 1 -- 172.21.15.77:0/1186684741 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d280054d0 con 0x7f0d38101090 2024-04-21T10:21:32.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d277fe640 1 -- 172.21.15.77:0/1186684741 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28010690 con 0x7f0d38101090 2024-04-21T10:21:32.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.668+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d381a55f0 con 0x7f0d38101090 2024-04-21T10:21:32.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.670+0000 7f0d277fe640 1 -- 172.21.15.77:0/1186684741 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f0d28004e70 con 0x7f0d38101090 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 Processor -- start 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 -- start start 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf90b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf90bee0 0x562baf918b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 0x562baf91b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562baf86fb10 con 0x562baf9190f0 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562baf80d240 con 0x562baf90bee0 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d3f584740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562baf86bad0 con 0x562baf90b530 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d277fe640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d200a3de0 0x7f0d200a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 0x562baf91b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 0x562baf91b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33870/0 (socket says 172.21.15.77:33870) 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d35d9b640 1 -- 172.21.15.77:0/1698044577 learned_addr learned my addr 172.21.15.77:0/1698044577 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf90b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d200a3de0 0x7f0d200a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.671+0000 7f0d277fe640 1 -- 172.21.15.77:0/1186684741 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d280d0ea0 con 0x7f0d38101090 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf90bee0 0x562baf918b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d35d9b640 1 -- 172.21.15.77:0/1698044577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 msgr2=0x562baf90b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf90b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d35d9b640 1 -- 172.21.15.77:0/1698044577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf90bee0 msgr2=0x562baf918b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf90bee0 0x562baf918b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d35d9b640 1 -- 172.21.15.77:0/1698044577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562baf5822d0 con 0x562baf9190f0 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf90bee0 0x562baf918b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:32.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 0x562baf91b500 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00dbd0 tx=0x7f0d2c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea581e2ad502cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d200a3de0 0x7f0d200a62a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d30033000 tx=0x7f0d300095c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d24ff9640 1 -- 172.21.15.77:0/1698044577 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c004030 con 0x562baf9190f0 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d24ff9640 1 -- 172.21.15.77:0/1698044577 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d2c0041d0 con 0x562baf9190f0 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.672+0000 7f0d24ff9640 1 -- 172.21.15.77:0/1698044577 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c011440 con 0x562baf9190f0 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- 172.21.15.77:0/1698044577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 msgr2=0x562baf91b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 0x562baf91b500 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00dbd0 tx=0x7f0d2c00f730 comp rx=0 tx=0).stop 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- 172.21.15.77:0/1698044577 shutdown_connections 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf9190f0 0x562baf91b500 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf90bee0 0x562baf918b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1698044577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf90b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- 172.21.15.77:0/1698044577 >> 172.21.15.77:0/1698044577 conn(0x562baf905a60 msgr2=0x562baf905e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- 172.21.15.77:0/1698044577 shutdown_connections 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- 172.21.15.77:0/1698044577 wait complete. 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- start start 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 Processor -- start 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 0x562baf9160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90bee0 0x562baf916610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf916b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562baf91c020 con 0x562baf90b530 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562baf7f8190 con 0x562baf9190f0 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562baf91c1a0 con 0x562baf90bee0 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.673+0000 7f0d3f584740 10 client.0 _ll_register_callbacks cb 0x562baf7f38b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 0x562baf9160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 0x562baf9160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33872/0 (socket says 172.21.15.77:33872) 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 -- 172.21.15.77:0/1943829201 learned_addr learned my addr 172.21.15.77:0/1943829201 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90bee0 0x562baf916610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf916b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 -- 172.21.15.77:0/1943829201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90bee0 msgr2=0x562baf916610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90bee0 0x562baf916610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 -- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 msgr2=0x562baf916b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf916b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 -- 172.21.15.77:0/1943829201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562baf64c6b0 con 0x562baf90b530 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3659c640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 0x562baf9160d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0d2809ca00 tx=0x7f0d28005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaf0741875270b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d1dffb640 1 -- 172.21.15.77:0/1943829201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d280b5020 con 0x562baf90b530 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d1dffb640 1 -- 172.21.15.77:0/1943829201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d28005160 con 0x562baf90b530 2024-04-21T10:21:32.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2c0041d0 con 0x562baf90b530 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d1dffb640 1 -- 172.21.15.77:0/1943829201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0d280a10b0 con 0x562baf90b530 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3f584740 10 client.15531 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562baf9282c0 con 0x562baf90b530 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.674+0000 7f0d1dffb640 1 -- 172.21.15.77:0/1943829201 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d2c0041d0 con 0x562baf90b530 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d1dffb640 1 -- 172.21.15.77:0/1943829201 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f0d2809cf60 con 0x562baf90b530 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d3f584740 10 client.15531 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d3f584740 10 client.15531 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d3f584740 20 client.15531 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf92a900 0x562baf92bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d3f584740 4 client.15531 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 --> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562baf87d530 con 0x562baf92a900 2024-04-21T10:21:32.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf92a900 0x562baf92bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d1dffb640 10 client.15531 ms_handle_connect on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.675+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf92a900 0x562baf92bd70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1829e2c66b5e5c2 server_cookie=86940bfd28f043b8 in_seq=0 out_seq=0 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d1dffb640 1 -- 172.21.15.77:0/1943829201 <== mds.2 v2:172.21.15.170:6836/3141822041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562baf87d530 con 0x562baf92a900 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d1dffb640 10 client.15531 handle_command_reply: tid=0 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 client.15531 shutdown 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 msgr2=0x562baf9160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 0x562baf9160d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0d2809ca00 tx=0x7f0d28005740 comp rx=0 tx=0).stop 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 shutdown_connections 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf92a900 0x562baf92bd70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf916b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d1dffb640 0 client.15531 ms_handle_reset on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90bee0 0x562baf916610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 --2- 172.21.15.77:0/1943829201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90b530 0x562baf9160d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 >> 172.21.15.77:0/1943829201 conn(0x562baf905a60 msgr2=0x562baf907bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.676+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 shutdown_connections 2024-04-21T10:21:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.677+0000 7f0d3f584740 1 -- 172.21.15.77:0/1943829201 wait complete. 2024-04-21T10:21:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.677+0000 7f0d3f584740 20 client.15531 trim_cache size 0 max 16384 2024-04-21T10:21:32.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.694+0000 7f0d3f584740 1 Processor -- start 2024-04-21T10:21:32.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.694+0000 7f0d3f584740 1 -- start start 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf918800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf9149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf914ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3f584740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562baf92a0b0 con 0x562baf90bee0 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3f584740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562baf92a780 con 0x562baf9190f0 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3f584740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562baf92ae50 con 0x562baf90b530 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf9149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf9149a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33874/0 (socket says 172.21.15.77:33874) 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2057533467 learned_addr learned my addr 172.21.15.77:0/2057533467 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d3659c640 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf918800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf914ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2057533467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 msgr2=0x562baf918800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf918800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2057533467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 msgr2=0x562baf914ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf914ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2057533467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562baf911c70 con 0x562baf90bee0 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf914ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:32.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf9149a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00d700 tx=0x7f0d2c00d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ca887ab0652c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d1ffff640 1 -- 172.21.15.77:0/2057533467 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c02e070 con 0x562baf90bee0 2024-04-21T10:21:32.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d1ffff640 1 -- 172.21.15.77:0/2057533467 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d2c005040 con 0x562baf90bee0 2024-04-21T10:21:32.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.695+0000 7f0d1ffff640 1 -- 172.21.15.77:0/2057533467 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c003f50 con 0x562baf90bee0 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 -- 172.21.15.77:0/2057533467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 msgr2=0x562baf9149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf9149a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00d700 tx=0x7f0d2c00d4c0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 -- 172.21.15.77:0/2057533467 shutdown_connections 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf9149a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf914ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2057533467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf918800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.696+0000 7f0d3f584740 1 -- 172.21.15.77:0/2057533467 >> 172.21.15.77:0/2057533467 conn(0x562baf905a60 msgr2=0x562baf900800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 -- 172.21.15.77:0/2057533467 shutdown_connections 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 -- 172.21.15.77:0/2057533467 wait complete. 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 -- start start 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 Processor -- start 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf9345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf92d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf92dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562baf92bbf0 con 0x562baf90bee0 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562baf92b520 con 0x562baf9190f0 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562baf92c2c0 con 0x562baf90b530 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d3f584740 10 client.0 _ll_register_callbacks cb 0x7f0d280ce3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf92d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf92d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33888/0 (socket says 172.21.15.77:33888) 2024-04-21T10:21:32.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.697+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2131984838 learned_addr learned my addr 172.21.15.77:0/2131984838 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf92dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2131984838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 msgr2=0x562baf9345a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d3659c640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf9345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf9345a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 msgr2=0x562baf92dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf92dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d35d9b640 1 -- 172.21.15.77:0/2131984838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562baf9320b0 con 0x562baf90bee0 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d36d9d640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf92dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d35d9b640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf92d8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00f770 tx=0x7f0d2c00d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3ed347da48b387 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d1dffb640 1 -- 172.21.15.77:0/2131984838 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c02e040 con 0x562baf90bee0 2024-04-21T10:21:32.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d1dffb640 1 -- 172.21.15.77:0/2131984838 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d2c0037f0 con 0x562baf90bee0 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2c005040 con 0x562baf90bee0 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d1dffb640 1 -- 172.21.15.77:0/2131984838 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0d2c0051f0 con 0x562baf90bee0 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d3f584740 10 client.15537 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562baf9909a0 con 0x562baf90bee0 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.698+0000 7f0d1dffb640 1 -- 172.21.15.77:0/2131984838 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d2c005040 con 0x562baf90bee0 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d1dffb640 1 -- 172.21.15.77:0/2131984838 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f0d2c004c70 con 0x562baf90bee0 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3f584740 10 client.15537 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3f584740 10 client.15537 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-21T10:21:32.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3f584740 20 client.15537 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf994ef0 0x562baf993c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3f584740 4 client.15537 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 --> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] -- command(tid 0: {"prefix": "status"}) -- 0x562baf8773a0 con 0x562baf994ef0 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3659c640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf994ef0 0x562baf993c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d1dffb640 10 client.15537 ms_handle_connect on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d3659c640 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf994ef0 0x562baf993c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb7ddbb7b9d3cac3 server_cookie=b59a28cc61733815 in_seq=0 out_seq=0 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d1dffb640 1 -- 172.21.15.77:0/2131984838 <== mds.2 v2:172.21.15.170:6836/3141822041 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562baf8773a0 con 0x562baf994ef0 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.699+0000 7f0d1dffb640 10 client.15537 handle_command_reply: tid=0 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 client.15537 shutdown 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 msgr2=0x562baf92d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf92d8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00f770 tx=0x7f0d2c00d910 comp rx=0 tx=0).stop 2024-04-21T10:21:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 shutdown_connections 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:6836/3141822041,v1:172.21.15.170:6837/3141822041] conn(0x562baf994ef0 0x562baf993c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562baf90bee0 0x562baf92d8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d1dffb640 0 client.15537 ms_handle_reset on v2:172.21.15.170:6836/3141822041 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562baf9190f0 0x562baf92dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 --2- 172.21.15.77:0/2131984838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562baf90b530 0x562baf9345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 >> 172.21.15.77:0/2131984838 conn(0x562baf905a60 msgr2=0x562baf914960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 shutdown_connections 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 1 -- 172.21.15.77:0/2131984838 wait complete. 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3f584740 20 client.15537 trim_cache size 0 max 16384 2024-04-21T10:21:32.708 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 2, 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24461, 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 126.726600761, 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 22, 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 88, 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 87, 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 147.35401608500001 2024-04-21T10:21:32.709 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:32.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d200a3de0 msgr2=0x7f0d200a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d200a3de0 0x7f0d200a62a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d30033000 tx=0x7f0d300095c0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 msgr2=0x7f0d38199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 0x7f0d38199590 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800e9f0 tx=0x7f0d2800edf0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 shutdown_connections 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.700+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0d200a3de0 0x7f0d200a62a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.701+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d3819a010 0x7f0d381a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.701+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d38106160 0x7f0d38199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.701+0000 7f0d3c8ba640 1 --2- 172.21.15.77:0/1186684741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d38101090 0x7f0d38199590 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.701+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 >> 172.21.15.77:0/1186684741 conn(0x7f0d38077f50 msgr2=0x7f0d380fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.701+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 shutdown_connections 2024-04-21T10:21:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.701+0000 7f0d3c8ba640 1 -- 172.21.15.77:0/1186684741 wait complete. 2024-04-21T10:21:32.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-21T10:21:32.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 -- 172.21.15.77:0/1364659226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 msgr2=0x7f19b010dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 --2- 172.21.15.77:0/1364659226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b010dd30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009ca0 tx=0x7f19a802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 -- 172.21.15.77:0/1364659226 shutdown_connections 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 --2- 172.21.15.77:0/1364659226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b010dd30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 --2- 172.21.15.77:0/1364659226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101a40 0x7f19b0105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 --2- 172.21.15.77:0/1364659226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b0101090 0x7f19b0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 -- 172.21.15.77:0/1364659226 >> 172.21.15.77:0/1364659226 conn(0x7f19b0077f50 msgr2=0x7f19b0078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 -- 172.21.15.77:0/1364659226 shutdown_connections 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.815+0000 7f19b711e640 1 -- 172.21.15.77:0/1364659226 wait complete. 2024-04-21T10:21:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 Processor -- start 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 -- start start 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101090 0x7f19b0197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b019bed0 0x7f19b019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01110d0 con 0x7f19b0106160 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0110f50 con 0x7f19b019bed0 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19b711e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0111250 con 0x7f19b0101090 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b0197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33906/0 (socket says 172.21.15.77:33906) 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.816+0000 7f19affff640 1 -- 172.21.15.77:0/2846028891 learned_addr learned my addr 172.21.15.77:0/2846028891 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101090 0x7f19b0197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b019bed0 0x7f19b019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19affff640 1 -- 172.21.15.77:0/2846028891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101090 msgr2=0x7f19b0197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19affff640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101090 0x7f19b0197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19affff640 1 -- 172.21.15.77:0/2846028891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b019bed0 msgr2=0x7f19b019c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19affff640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b019bed0 0x7f19b019c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19affff640 1 -- 172.21.15.77:0/2846028891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b019c9c0 con 0x7f19b0106160 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b019bed0 0x7f19b019c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101090 0x7f19b0197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19affff640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b0197b50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f199c00eb00 tx=0x7f199c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19adffb640 1 -- 172.21.15.77:0/2846028891 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c00bc30 con 0x7f19b0106160 2024-04-21T10:21:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19adffb640 1 -- 172.21.15.77:0/2846028891 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f199c00bdd0 con 0x7f19b0106160 2024-04-21T10:21:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b019ccb0 con 0x7f19b0106160 2024-04-21T10:21:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19adffb640 1 -- 172.21.15.77:0/2846028891 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c017410 con 0x7f19b0106160 2024-04-21T10:21:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.817+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b0069400 con 0x7f19b0106160 2024-04-21T10:21:32.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19adffb640 1 -- 172.21.15.77:0/2846028891 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f199c004f20 con 0x7f19b0106160 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 Processor -- start 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 -- start start 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9abc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9abcce0 0x55e3e9abf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9a17b10 con 0x55e3e9ab4160 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e3e99b5240 con 0x55e3e9ab37b0 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b9de0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9a13ad0 con 0x55e3e9abcce0 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b4eba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9abc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b4eba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9abc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33918/0 (socket says 172.21.15.77:33918) 2024-04-21T10:21:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19b4eba640 1 -- 172.21.15.77:0/1838084961 learned_addr learned my addr 172.21.15.77:0/1838084961 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19adffb640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f19a00a3e30 0x7f19a00a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.820+0000 7f19affff640 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9abcce0 0x55e3e9abf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b56bb640 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b4eba640 1 -- 172.21.15.77:0/1838084961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9abcce0 msgr2=0x55e3e9abf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b4eba640 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9abcce0 0x55e3e9abf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f19a00a3e30 0x7f19a00a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b4eba640 1 -- 172.21.15.77:0/1838084961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab37b0 msgr2=0x55e3e9ab3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b4eba640 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b4eba640 1 -- 172.21.15.77:0/1838084961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e972a2d0 con 0x55e3e9ab4160 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19affff640 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9abcce0 0x55e3e9abf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19adffb640 1 -- 172.21.15.77:0/2846028891 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f199c0d22e0 con 0x7f19b0106160 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b4eba640 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9abc710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d50 tx=0x7f19a40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725cf7f9a1c6182c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f199affd640 1 -- 172.21.15.77:0/1838084961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4012650 con 0x55e3e9ab4160 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f19a00a3e30 0x7f19a00a62f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006010 tx=0x7f19a80095c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f199affd640 1 -- 172.21.15.77:0/1838084961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19a4009e40 con 0x55e3e9ab4160 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.821+0000 7f199affd640 1 -- 172.21.15.77:0/1838084961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a400fb90 con 0x55e3e9ab4160 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 -- 172.21.15.77:0/1838084961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 msgr2=0x55e3e9abc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9abc710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d50 tx=0x7f19a40117b0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 -- 172.21.15.77:0/1838084961 shutdown_connections 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9abc710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9abcce0 0x55e3e9abf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 --2- 172.21.15.77:0/1838084961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 -- 172.21.15.77:0/1838084961 >> 172.21.15.77:0/1838084961 conn(0x55e3e9aada60 msgr2=0x55e3e9aade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 -- 172.21.15.77:0/1838084961 shutdown_connections 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 -- 172.21.15.77:0/1838084961 wait complete. 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 -- start start 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.822+0000 7f19b9de0740 1 Processor -- start 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9aba210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9aba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9abfc50 con 0x55e3e9abcce0 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e3e99a0190 con 0x55e3e9ab4160 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9abfdd0 con 0x55e3e9ab37b0 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b9de0740 10 client.0 _ll_register_callbacks cb 0x55e3e999b8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b56bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9aba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b56bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9aba750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33926/0 (socket says 172.21.15.77:33926) 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b56bb640 1 -- 172.21.15.77:0/859473373 learned_addr learned my addr 172.21.15.77:0/859473373 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19affff640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9aba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 -- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 msgr2=0x55e3e9aba210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9aba210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 -- 172.21.15.77:0/859473373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 msgr2=0x55e3e9aba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9aba750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 -- 172.21.15.77:0/859473373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e97f46b0 con 0x55e3e9ab37b0 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b56bb640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9aba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f19b4eba640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab9cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55e3e9ab4560 tx=0x7f19a4009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc0caec37958343 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.823+0000 7f198ffff640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f198ffff640 1 -- 172.21.15.77:0/859473373 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4028020 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e3e9a25530 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f198ffff640 1 -- 172.21.15.77:0/859473373 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f19a400fb70 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f198ffff640 1 -- 172.21.15.77:0/859473373 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f19a4033050 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 10 client.25087 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55e3e9acbf40 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f198ffff640 1 -- 172.21.15.77:0/859473373 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e3e9a25530 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f198ffff640 1 -- 172.21.15.77:0/859473373 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f19a4012450 con 0x55e3e9ab37b0 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 10 client.25087 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 10 client.25087 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 20 client.25087 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9ace200 0x55e3e9acf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 4 client.25087 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.824+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 --> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3e9a1f3a0 con 0x55e3e9ace200 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.825+0000 7f19affff640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9ace200 0x55e3e9acf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.825+0000 7f19affff640 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9ace200 0x55e3e9acf670 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d437057f7fbb3f86 server_cookie=89ea9bb26b7fb21c in_seq=0 out_seq=0 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.825+0000 7f198ffff640 10 client.25087 ms_handle_connect on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f198ffff640 1 -- 172.21.15.77:0/859473373 <== mds.1 v2:172.21.15.170:6838/4122605825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e3e9a1f3a0 con 0x55e3e9ace200 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f198ffff640 10 client.25087 handle_command_reply: tid=0 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 client.25087 shutdown 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 msgr2=0x55e3e9ab9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab9cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55e3e9ab4560 tx=0x7f19a4009530 comp rx=0 tx=0).stop 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 shutdown_connections 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9ace200 0x55e3e9acf670 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9aba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f198ffff640 0 client.25087 ms_handle_reset on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9aba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 --2- 172.21.15.77:0/859473373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ab9cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 >> 172.21.15.77:0/859473373 conn(0x55e3e9aada60 msgr2=0x55e3e9aafbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 shutdown_connections 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 1 -- 172.21.15.77:0/859473373 wait complete. 2024-04-21T10:21:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.826+0000 7f19b9de0740 20 client.25087 trim_cache size 0 max 16384 2024-04-21T10:21:32.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 Processor -- start 2024-04-21T10:21:32.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 -- start start 2024-04-21T10:21:32.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9abc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9abcce0 0x55e3e9aa8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9acd9b0 con 0x55e3e9ab4160 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9ace080 con 0x55e3e9abcce0 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b9de0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9ace750 con 0x55e3e9ab37b0 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33930/0 (socket says 172.21.15.77:33930) 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 -- 172.21.15.77:0/2937035552 learned_addr learned my addr 172.21.15.77:0/2937035552 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9abc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9abcce0 0x55e3e9aa8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 -- 172.21.15.77:0/2937035552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 msgr2=0x55e3e9abc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9abc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 -- 172.21.15.77:0/2937035552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9abcce0 msgr2=0x55e3e9aa8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9abcce0 0x55e3e9aa8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19affff640 1 -- 172.21.15.77:0/2937035552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e9ab3b90 con 0x55e3e9ab4160 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.844+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9abc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f19affff640 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab4590 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f199c09dde0 tx=0x7f199c0a2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406054abe72d84b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f199a7fc640 1 -- 172.21.15.77:0/2937035552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c0a6d50 con 0x55e3e9ab4160 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f199a7fc640 1 -- 172.21.15.77:0/2937035552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f199c09e0e0 con 0x55e3e9ab4160 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f199a7fc640 1 -- 172.21.15.77:0/2937035552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c005210 con 0x55e3e9ab4160 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f19b9de0740 1 -- 172.21.15.77:0/2937035552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 msgr2=0x55e3e9ab4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab4590 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f199c09dde0 tx=0x7f199c0a2040 comp rx=0 tx=0).stop 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f19b9de0740 1 -- 172.21.15.77:0/2937035552 shutdown_connections 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab4590 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.845+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9abcce0 0x55e3e9aa8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2937035552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9abc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- 172.21.15.77:0/2937035552 >> 172.21.15.77:0/2937035552 conn(0x55e3e9aada60 msgr2=0x55e3e9aade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- 172.21.15.77:0/2937035552 shutdown_connections 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- 172.21.15.77:0/2937035552 wait complete. 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- start start 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 Processor -- start 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ad7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9ab6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9acf4f0 con 0x55e3e9abcce0 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9acee20 con 0x55e3e9ab4160 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9acfbc0 con 0x55e3e9ab37b0 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b9de0740 10 client.0 _ll_register_callbacks cb 0x7f19a4009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b56bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9ab6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.846+0000 7f19b56bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9ab6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33946/0 (socket says 172.21.15.77:33946) 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 -- 172.21.15.77:0/2638950149 learned_addr learned my addr 172.21.15.77:0/2638950149 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ad7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19affff640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 -- 172.21.15.77:0/2638950149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 msgr2=0x55e3e9ad7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ad7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 -- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 msgr2=0x55e3e9ab69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 -- 172.21.15.77:0/2638950149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e9ab7710 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b56bb640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9ab6ee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19a8003bf0 tx=0x7f19a802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cba6f87b4f9419f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f198ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f198ffff640 1 -- 172.21.15.77:0/2638950149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8039040 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f198ffff640 1 -- 172.21.15.77:0/2638950149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f19a8004250 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f199c09e0e0 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f198ffff640 1 -- 172.21.15.77:0/2638950149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f19a8003e10 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b9de0740 10 client.15555 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.847+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55e3e9b341b0 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f198ffff640 1 -- 172.21.15.77:0/2638950149 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f199c09e0e0 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f198ffff640 1 -- 172.21.15.77:0/2638950149 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f19a804fbc0 con 0x55e3e9abcce0 2024-04-21T10:21:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b9de0740 10 client.15555 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b9de0740 10 client.15555 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b9de0740 20 client.15555 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9b38de0 0x55e3e9b37af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b9de0740 4 client.15555 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 --> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] -- command(tid 0: {"prefix": "status"}) -- 0x55e3e999b960 con 0x55e3e9b38de0 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.848+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9b38de0 0x55e3e9b37af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f198ffff640 10 client.15555 ms_handle_connect on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b4eba640 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9b38de0 0x55e3e9b37af0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=671f47035062c1e3 server_cookie=7fcc21b3664263b8 in_seq=0 out_seq=0 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f198ffff640 1 -- 172.21.15.77:0/2638950149 <== mds.1 v2:172.21.15.170:6838/4122605825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e3e999b960 con 0x55e3e9b38de0 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f198ffff640 10 client.15555 handle_command_reply: tid=0 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 client.15555 shutdown 2024-04-21T10:21:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 msgr2=0x55e3e9ab6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9ab6ee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19a8003bf0 tx=0x7f19a802e070 comp rx=0 tx=0).stop 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 shutdown_connections 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] conn(0x55e3e9b38de0 0x55e3e9b37af0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3e9abcce0 0x55e3e9ab6ee0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e3e9ab4160 0x55e3e9ab69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f198ffff640 0 client.15555 ms_handle_reset on v2:172.21.15.170:6838/4122605825 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 --2- 172.21.15.77:0/2638950149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e3e9ab37b0 0x55e3e9ad7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 >> 172.21.15.77:0/2638950149 conn(0x55e3e9aada60 msgr2=0x55e3e9aa8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 shutdown_connections 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 1 -- 172.21.15.77:0/2638950149 wait complete. 2024-04-21T10:21:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.849+0000 7f19b9de0740 20 client.15555 trim_cache size 0 max 16384 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24491, 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 127.32729876400001, 2024-04-21T10:21:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 22, 2024-04-21T10:21:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 88, 2024-04-21T10:21:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 87, 2024-04-21T10:21:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 136.489016935 2024-04-21T10:21:32.859 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f19a00a3e30 msgr2=0x7f19a00a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f19a00a3e30 0x7f19a00a62f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006010 tx=0x7f19a80095c0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 msgr2=0x7f19b0197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b0197b50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f199c00eb00 tx=0x7f199c009ee0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 shutdown_connections 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f19a00a3e30 0x7f19a00a62f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b0106160 0x7f19b0197b50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b019bed0 0x7f19b019c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 --2- 172.21.15.77:0/2846028891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19b0101090 0x7f19b0197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 >> 172.21.15.77:0/2846028891 conn(0x7f19b0077f50 msgr2=0x7f19b00fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 shutdown_connections 2024-04-21T10:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.850+0000 7f19b711e640 1 -- 172.21.15.77:0/2846028891 wait complete. 2024-04-21T10:21:32.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-21T10:21:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 -- 172.21.15.77:0/1142423741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 msgr2=0x7f33e8101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 --2- 172.21.15.77:0/1142423741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8101470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009900 tx=0x7f33e002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 -- 172.21.15.77:0/1142423741 shutdown_connections 2024-04-21T10:21:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 --2- 172.21.15.77:0/1142423741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e8106160 0x7f33e810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 --2- 172.21.15.77:0/1142423741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33e8101a40 0x7f33e8105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 --2- 172.21.15.77:0/1142423741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8101470 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 -- 172.21.15.77:0/1142423741 >> 172.21.15.77:0/1142423741 conn(0x7f33e8077f50 msgr2=0x7f33e8078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 -- 172.21.15.77:0/1142423741 shutdown_connections 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.964+0000 7f33ecd59640 1 -- 172.21.15.77:0/1142423741 wait complete. 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 Processor -- start 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 -- start start 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33e8106160 0x7f33e8198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e819d000 0x7f33e819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81110a0 con 0x7f33e8101090 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8110f20 con 0x7f33e819d000 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33ecd59640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8111220 con 0x7f33e8106160 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33950/0 (socket says 172.21.15.77:33950) 2024-04-21T10:21:32.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 -- 172.21.15.77:0/217136997 learned_addr learned my addr 172.21.15.77:0/217136997 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33e8106160 0x7f33e8198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e819d000 0x7f33e819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 -- 172.21.15.77:0/217136997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33e8106160 msgr2=0x7f33e8198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33e8106160 0x7f33e8198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 -- 172.21.15.77:0/217136997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e819d000 msgr2=0x7f33e819d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e819d000 0x7f33e819d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 -- 172.21.15.77:0/217136997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e819daf0 con 0x7f33e8101090 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e819d000 0x7f33e819d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.965+0000 7f33e659c640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8198740 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33e0005940 tx=0x7f33e002c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.966+0000 7f33d77fe640 1 -- 172.21.15.77:0/217136997 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0043020 con 0x7f33e8101090 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.966+0000 7f33d77fe640 1 -- 172.21.15.77:0/217136997 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e002cbe0 con 0x7f33e8101090 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.966+0000 7f33d77fe640 1 -- 172.21.15.77:0/217136997 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0003bf0 con 0x7f33e8101090 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.966+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e819dd80 con 0x7f33e8101090 2024-04-21T10:21:32.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.966+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e81a55a0 con 0x7f33e8101090 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33d77fe640 1 -- 172.21.15.77:0/217136997 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f33e0046020 con 0x7f33e8101090 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 Processor -- start 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 -- start start 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d810b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d819710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d81c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560c6d774b10 con 0x560c6d811160 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c6d712240 con 0x560c6d819ce0 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33efa2f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560c6d770ad0 con 0x560c6d8107b0 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.968+0000 7f33d77fe640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f33d00a3db0 0x7f33d00a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d819710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e6d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d810b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d819710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33954/0 (socket says 172.21.15.77:33954) 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e6d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d810b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:40154/0 (socket says 172.21.15.77:40154) 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 -- 172.21.15.77:0/3986422269 learned_addr learned my addr 172.21.15.77:0/3986422269 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d81c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f33d00a3db0 0x7f33d00a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33d77fe640 1 -- 172.21.15.77:0/217136997 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f33e00f2b80 con 0x7f33e8101090 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 -- 172.21.15.77:0/3986422269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 msgr2=0x560c6d810b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d810b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 -- 172.21.15.77:0/3986422269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 msgr2=0x560c6d81c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d81c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 -- 172.21.15.77:0/3986422269 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6d4872d0 con 0x560c6d811160 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d810b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e659c640 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d819710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33e0092460 tx=0x7f33e0092490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e343dfa1ed12046f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f33d00a3db0 0x7f33d00a6270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33d8014b40 tx=0x7f33d8004730 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33d4ff9640 1 -- 172.21.15.77:0/3986422269 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e00bf1f0 con 0x560c6d811160 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33d4ff9640 1 -- 172.21.15.77:0/3986422269 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e00beaf0 con 0x560c6d811160 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.969+0000 7f33d4ff9640 1 -- 172.21.15.77:0/3986422269 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e00054d0 con 0x560c6d811160 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 -- 172.21.15.77:0/3986422269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 msgr2=0x560c6d819710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d819710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33e0092460 tx=0x7f33e0092490 comp rx=0 tx=0).stop 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 -- 172.21.15.77:0/3986422269 shutdown_connections 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d819710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d81c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3986422269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d810b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 -- 172.21.15.77:0/3986422269 >> 172.21.15.77:0/3986422269 conn(0x560c6d80aa60 msgr2=0x560c6d80ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 -- 172.21.15.77:0/3986422269 shutdown_connections 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.970+0000 7f33efa2f740 1 -- 172.21.15.77:0/3986422269 wait complete. 2024-04-21T10:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 -- start start 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 Processor -- start 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 0x560c6d816c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d811160 0x560c6d817160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d8176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560c6d81ca10 con 0x560c6d8107b0 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c6d6fd190 con 0x560c6d819ce0 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560c6d81cb90 con 0x560c6d811160 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33efa2f740 10 client.0 _ll_register_callbacks cb 0x560c6d6f88b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 0x560c6d816c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 0x560c6d816c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33962/0 (socket says 172.21.15.77:33962) 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 -- 172.21.15.77:0/3664432708 learned_addr learned my addr 172.21.15.77:0/3664432708 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d811160 0x560c6d817160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d8176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 -- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d811160 msgr2=0x560c6d817160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d811160 0x560c6d817160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 -- 172.21.15.77:0/3664432708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 msgr2=0x560c6d8176a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d8176a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 -- 172.21.15.77:0/3664432708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6d5516b0 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33e659c640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 0x560c6d816c20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f33e00f0900 tx=0x7f33e002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d27f503bfeef340 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.971+0000 7f33cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33cdffb640 1 -- 172.21.15.77:0/3664432708 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e00c7760 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33cdffb640 1 -- 172.21.15.77:0/3664432708 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f33e00f04f0 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e00beaf0 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33cdffb640 1 -- 172.21.15.77:0/3664432708 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f33e0003d90 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 10 client.15567 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560c6d81ca10 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33cdffb640 1 -- 172.21.15.77:0/3664432708 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e00beaf0 con 0x560c6d8107b0 2024-04-21T10:21:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33cdffb640 1 -- 172.21.15.77:0/3664432708 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f33e0090030 con 0x560c6d8107b0 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 10 client.15567 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 10 client.15567 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 20 client.15567 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d82c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 4 client.15567 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c6d782530 con 0x560c6d82b000 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.972+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d82c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.973+0000 7f33cdffb640 10 client.15567 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.973+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d82c470 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b972a40b45392df server_cookie=898fb66ecde7a016 in_seq=0 out_seq=0 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.973+0000 7f33cdffb640 1 -- 172.21.15.77:0/3664432708 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560c6d782530 con 0x560c6d82b000 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.973+0000 7f33cdffb640 10 client.15567 handle_command_reply: tid=0 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 client.15567 shutdown 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 msgr2=0x560c6d816c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 0x560c6d816c20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f33e00f0900 tx=0x7f33e002bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 shutdown_connections 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d82c470 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d8176a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33cdffb640 0 client.15567 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d811160 0x560c6d817160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 --2- 172.21.15.77:0/3664432708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d8107b0 0x560c6d816c20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 >> 172.21.15.77:0/3664432708 conn(0x560c6d80aa60 msgr2=0x560c6d80cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 shutdown_connections 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 1 -- 172.21.15.77:0/3664432708 wait complete. 2024-04-21T10:21:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:32.974+0000 7f33efa2f740 20 client.15567 trim_cache size 0 max 16384 2024-04-21T10:21:33.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 Processor -- start 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 -- start start 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d819350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d8174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d813ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560c6d82a7b0 con 0x560c6d811160 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c6d82ae80 con 0x560c6d819ce0 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.005+0000 7f33efa2f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560c6d82b550 con 0x560c6d8107b0 2024-04-21T10:21:33.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d8174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d8174c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33964/0 (socket says 172.21.15.77:33964) 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 -- 172.21.15.77:0/538022524 learned_addr learned my addr 172.21.15.77:0/538022524 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e659c640 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d819350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d813ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 -- 172.21.15.77:0/538022524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 msgr2=0x560c6d819350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d819350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 -- 172.21.15.77:0/538022524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 msgr2=0x560c6d813ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d813ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 -- 172.21.15.77:0/538022524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6d810b90 con 0x560c6d811160 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e659c640 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d819350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d8174c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f33e806b6e0 tx=0x7f33dc0075b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943f7807d4c72dec server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:33.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33cffff640 1 -- 172.21.15.77:0/538022524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc004d20 con 0x560c6d811160 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33cffff640 1 -- 172.21.15.77:0/538022524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33dc023030 con 0x560c6d811160 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.006+0000 7f33cffff640 1 -- 172.21.15.77:0/538022524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc005760 con 0x560c6d811160 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 -- 172.21.15.77:0/538022524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 msgr2=0x560c6d8174c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d8174c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f33e806b6e0 tx=0x7f33dc0075b0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 -- 172.21.15.77:0/538022524 shutdown_connections 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d8174c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d819ce0 0x560c6d813ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 --2- 172.21.15.77:0/538022524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d8107b0 0x560c6d819350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 -- 172.21.15.77:0/538022524 >> 172.21.15.77:0/538022524 conn(0x560c6d80aa60 msgr2=0x560c6d805800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 -- 172.21.15.77:0/538022524 shutdown_connections 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 -- 172.21.15.77:0/538022524 wait complete. 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 -- start start 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.007+0000 7f33efa2f740 1 Processor -- start 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d8107b0 0x560c6d8345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d834b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d819ce0 0x560c6d82db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560c6d82c2f0 con 0x560c6d811160 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c6d82bc20 con 0x560c6d8107b0 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560c6d82c9c0 con 0x560c6d819ce0 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 10 client.0 _ll_register_callbacks cb 0x7f33dc007910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d834b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d834b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33970/0 (socket says 172.21.15.77:33970) 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 -- 172.21.15.77:0/2830944355 learned_addr learned my addr 172.21.15.77:0/2830944355 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e659c640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d8107b0 0x560c6d8345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e6d9d640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d819ce0 0x560c6d82db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 -- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d819ce0 msgr2=0x560c6d82db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d819ce0 0x560c6d82db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 -- 172.21.15.77:0/2830944355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d8107b0 msgr2=0x560c6d8345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d8107b0 0x560c6d8345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 -- 172.21.15.77:0/2830944355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6d82e350 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33e5d9b640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d834b20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f33dc01f0b0 tx=0x7f33dc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61eeca9780ef417 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33cdffb640 1 -- 172.21.15.77:0/2830944355 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc004c50 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33dc023030 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.008+0000 7f33cdffb640 1 -- 172.21.15.77:0/2830944355 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f33dc004df0 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33cdffb640 1 -- 172.21.15.77:0/2830944355 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f33dc0054e0 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 10 client.15573 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560c6d832ca0 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33cdffb640 1 -- 172.21.15.77:0/2830944355 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33dc023030 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33cdffb640 1 -- 172.21.15.77:0/2830944355 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f33dc028470 con 0x560c6d811160 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 10 client.15573 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:33.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 10 client.15573 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 20 client.15573 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d894210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 4 client.15573 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "status"}) -- 0x560c6d77c3a0 con 0x560c6d82b000 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33e659c640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d894210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33e659c640 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d894210 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e91311e1a1ad50e5 server_cookie=3cd56cafcc503c93 in_seq=0 out_seq=0 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.009+0000 7f33cdffb640 10 client.15573 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33cdffb640 1 -- 172.21.15.77:0/2830944355 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560c6d77c3a0 con 0x560c6d82b000 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33cdffb640 10 client.15573 handle_command_reply: tid=0 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 client.15573 shutdown 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 msgr2=0x560c6d834b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d834b20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f33dc01f0b0 tx=0x7f33dc007e00 comp rx=0 tx=0).stop 2024-04-21T10:21:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 shutdown_connections 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560c6d82b000 0x560c6d894210 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c6d811160 0x560c6d834b20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560c6d819ce0 0x560c6d82db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33cdffb640 0 client.15573 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 --2- 172.21.15.77:0/2830944355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c6d8107b0 0x560c6d8345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 >> 172.21.15.77:0/2830944355 conn(0x560c6d80aa60 msgr2=0x560c6d817540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 shutdown_connections 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 1 -- 172.21.15.77:0/2830944355 wait complete. 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33efa2f740 20 client.15573 trim_cache size 0 max 16384 2024-04-21T10:21:33.019 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "41617fb2-ffc7-11ee-bc93-c7b262605968", 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24505, 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 129.506066127, 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 22, 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 88, 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 87, 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 144.88830958200001 2024-04-21T10:21:33.020 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f33d00a3db0 msgr2=0x7f33d00a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f33d00a3db0 0x7f33d00a6270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33d8014b40 tx=0x7f33d8004730 comp rx=0 tx=0).stop 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 msgr2=0x7f33e8198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8198740 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33e0005940 tx=0x7f33e002c7e0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 shutdown_connections 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f33d00a3db0 0x7f33d00a6270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33e819d000 0x7f33e819d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33e8106160 0x7f33e8198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.010+0000 7f33ecd59640 1 --2- 172.21.15.77:0/217136997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8101090 0x7f33e8198740 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:33.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.011+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 >> 172.21.15.77:0/217136997 conn(0x7f33e8077f50 msgr2=0x7f33e8104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:33.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.011+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 shutdown_connections 2024-04-21T10:21:33.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:33.011+0000 7f33ecd59640 1 -- 172.21.15.77:0/217136997 wait complete. 2024-04-21T10:21:33.023 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-21T10:21:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:32 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4027189281' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:32 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2462509225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:32 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4027189281' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:32 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2462509225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:32 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4027189281' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T10:21:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:32 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2462509225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:33.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-04-21T10:21:34.020 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-04-21T10:21:34.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-04-21T10:21:34.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-04-21T10:21:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:33 smithi077 ceph-mon[27902]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 131 KiB/s wr, 76 op/s 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/: 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 . 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 .. 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 data 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data: 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:34.166 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 .. 2024-04-21T10:21:34.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-04-21T10:21:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:33 smithi191 ceph-mon[31636]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 131 KiB/s wr, 76 op/s 2024-04-21T10:21:34.248 INFO:teuthology.orchestra.run.smithi077.stdout:[Service] 2024-04-21T10:21:34.248 INFO:teuthology.orchestra.run.smithi077.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-04-21T10:21:34.248 INFO:teuthology.orchestra.run.smithi077.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-04-21T10:21:34.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-04-21T10:21:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:33 smithi170 ceph-mon[31212]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 131 KiB/s wr, 76 op/s 2024-04-21T10:21:34.365 INFO:teuthology.orchestra.run.smithi077.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-04-21T10:21:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:35 smithi191 ceph-mon[31636]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-21T10:21:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:35 smithi170 ceph-mon[31212]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-21T10:21:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:35 smithi077 ceph-mon[27902]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-21T10:21:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:37 smithi170 ceph-mon[31212]: pgmap v9: 97 pgs: 97 active+clean; 2.0 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 156 KiB/s wr, 55 op/s 2024-04-21T10:21:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:37 smithi077 ceph-mon[27902]: pgmap v9: 97 pgs: 97 active+clean; 2.0 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 156 KiB/s wr, 55 op/s 2024-04-21T10:21:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:37 smithi191 ceph-mon[31636]: pgmap v9: 97 pgs: 97 active+clean; 2.0 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 156 KiB/s wr, 55 op/s 2024-04-21T10:21:38.826 INFO:teuthology.orchestra.run.smithi077.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-04-21T10:21:38.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-04-21T10:21:38.866 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/: 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 . 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 .. 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 data 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data: 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:total 35 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 . 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 .. 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 base 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Apr 21 10:21 global 2024-04-21T10:21:38.867 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 log 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_commit_ts 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_dynshmem 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Apr 21 10:21 pg_hba.conf 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Apr 21 10:21 pg_ident.conf 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 pg_logical 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 pg_multixact 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_notify 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_replslot 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_serial 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_snapshots 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_stat 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_stat_tmp 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 pg_subtrans 2024-04-21T10:21:38.868 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_tblspc 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 pg_twophase 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 PG_VERSION 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 pg_wal 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 pg_xact 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Apr 21 10:21 postgresql.auto.conf 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 Apr 21 10:21 postgresql.conf 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/base: 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.869 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 . 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 21 10:21 1 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 21 10:21 13493 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 21 10:21 13494 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/base/1: 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:total 7777 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 21 10:21 . 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 .. 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 112 2024-04-21T10:21:38.870 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 113 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 21 10:21 1247 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1247_fsm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1247_vm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 21 10:21 1249 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1249_fsm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1249_vm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 21 10:21 1255 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1255_fsm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1255_vm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 21 10:21 1259 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1259_fsm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1259_vm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 21 10:21 13344 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13344_fsm 2024-04-21T10:21:38.871 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13344_vm 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13346 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13348 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13349 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13349_fsm 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13349_vm 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13351 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13353 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13354 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13354_fsm 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13354_vm 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13356 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13358 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13359 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13359_fsm 2024-04-21T10:21:38.872 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13359_vm 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13361 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13363 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 1417 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 1418 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 174 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 175 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2187 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2224 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2328 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2336 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2337 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2579 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2600 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2600_fsm 2024-04-21T10:21:38.873 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2600_vm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2601 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2601_fsm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2601_vm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2602 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2602_fsm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2602_vm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2603 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2603_fsm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2603_vm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2604 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2605 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2605_fsm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2605_vm 2024-04-21T10:21:38.874 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2606 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2606_fsm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2606_vm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2607 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2607_fsm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2607_vm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 21 10:21 2608 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2608_fsm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2608_vm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 21 10:21 2609 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2609_fsm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2609_vm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2610 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2610_fsm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2610_vm 2024-04-21T10:21:38.875 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2611 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2612 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2612_fsm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2612_vm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2613 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2615 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2615_fsm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2615_vm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2616 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2616_fsm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2616_vm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 21 10:21 2617 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2617_fsm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2617_vm 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 21 10:21 2618 2024-04-21T10:21:38.876 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2618_fsm 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2618_vm 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 21 10:21 2619 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2619_fsm 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2619_vm 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2620 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2650 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2651 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2652 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2653 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2654 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2655 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2656 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2657 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 21 10:21 2658 2024-04-21T10:21:38.877 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 21 10:21 2659 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2660 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2661 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2662 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2663 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2664 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2665 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2666 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2667 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2668 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2669 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2670 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 21 10:21 2673 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 21 10:21 2674 2024-04-21T10:21:38.878 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 21 10:21 2675 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2678 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2679 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2680 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2681 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2682 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2683 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2684 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2685 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2686 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2687 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2688 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2689 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 21 10:21 2690 2024-04-21T10:21:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 21 10:21 2691 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2692 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2693 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2696 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2699 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2701 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2702 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2703 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2704 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2753 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2753_fsm 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2753_vm 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2754 2024-04-21T10:21:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2755 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2756 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2757 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2830 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2831 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2832 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2833 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2834 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2835 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2836 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2837 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 21 10:21 2838 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2838_fsm 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2838_vm 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2839 2024-04-21T10:21:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2840 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2840_fsm 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2840_vm 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2841 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2995 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2996 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3079 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3079_fsm 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3079_vm 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3080 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3081 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 3085 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3118 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3119 2024-04-21T10:21:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 21 10:21 3164 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3256 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3257 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3258 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3350 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3351 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3379 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3380 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3381 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3394 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3394_fsm 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3394_vm 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3395 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3429 2024-04-21T10:21:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3430 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3431 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3433 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3439 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3440 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 3455 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 21 10:21 3456 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3456_fsm 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3456_vm 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3466 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3467 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3468 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3501 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3502 2024-04-21T10:21:38.884 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3503 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3534 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3541 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3541_fsm 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3541_vm 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3542 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3574 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3575 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3576 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3596 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3597 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3598 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3599 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3600 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3600_fsm 2024-04-21T10:21:38.885 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3600_vm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3601 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3601_fsm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3601_vm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3602 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3602_fsm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3602_vm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3603 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3603_fsm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3603_vm 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3604 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3605 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3606 2024-04-21T10:21:38.886 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3607 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3608 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 3609 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3712 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3764 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3764_fsm 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3764_vm 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3766 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3767 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3997 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4143 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4144 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4145 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4146 2024-04-21T10:21:38.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4147 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4148 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4149 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4150 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4151 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4152 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4153 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4154 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4155 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4156 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4157 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4158 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4159 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4160 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4161 2024-04-21T10:21:38.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4162 2024-04-21T10:21:38.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4163 2024-04-21T10:21:38.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4164 2024-04-21T10:21:38.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4165 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4166 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4167 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4168 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4169 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4170 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4171 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4172 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4173 2024-04-21T10:21:38.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4174 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 5002 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 548 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 549 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6102 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6104 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6106 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6110 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6111 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6112 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6113 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6117 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 826 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 827 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 828 2024-04-21T10:21:38.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 21 10:21 pg_filenode.map 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 PG_VERSION 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:total 7777 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 21 10:21 . 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 .. 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 112 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 113 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 21 10:21 1247 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1247_fsm 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1247_vm 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 21 10:21 1249 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1249_fsm 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1249_vm 2024-04-21T10:21:38.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 21 10:21 1255 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1255_fsm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1255_vm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 21 10:21 1259 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1259_fsm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1259_vm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 21 10:21 13344 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13344_fsm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13344_vm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13346 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13348 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13349 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13349_fsm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13349_vm 2024-04-21T10:21:38.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13351 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13353 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13354 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13354_fsm 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13354_vm 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13356 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13358 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13359 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13359_fsm 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13359_vm 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13361 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13363 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 1417 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 1418 2024-04-21T10:21:38.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 174 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 175 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2187 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2224 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2328 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2336 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2337 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2579 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2600 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2600_fsm 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2600_vm 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2601 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2601_fsm 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2601_vm 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2602 2024-04-21T10:21:38.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2602_fsm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2602_vm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2603 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2603_fsm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2603_vm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2604 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2605 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2605_fsm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2605_vm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2606 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2606_fsm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2606_vm 2024-04-21T10:21:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2607 2024-04-21T10:21:38.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2607_fsm 2024-04-21T10:21:38.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2607_vm 2024-04-21T10:21:38.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 21 10:21 2608 2024-04-21T10:21:38.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2608_fsm 2024-04-21T10:21:38.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2608_vm 2024-04-21T10:21:38.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 21 10:21 2609 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2609_fsm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2609_vm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2610 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2610_fsm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2610_vm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2611 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2612 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2612_fsm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2612_vm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2613 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2615 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2615_fsm 2024-04-21T10:21:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2615_vm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2616 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2616_fsm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2616_vm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 21 10:21 2617 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2617_fsm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2617_vm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 21 10:21 2618 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2618_fsm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2618_vm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 21 10:21 2619 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2619_fsm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2619_vm 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2620 2024-04-21T10:21:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2650 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2651 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2652 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2653 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2654 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2655 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2656 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2657 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 21 10:21 2658 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 21 10:21 2659 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2660 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2661 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2662 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2663 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2664 2024-04-21T10:21:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2665 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2666 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2667 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2668 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2669 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2670 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 21 10:21 2673 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 21 10:21 2674 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 21 10:21 2675 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2678 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2679 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2680 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2681 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2682 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2683 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2684 2024-04-21T10:21:38.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2685 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2686 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2687 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2688 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2689 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 21 10:21 2690 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 21 10:21 2691 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2692 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2693 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2696 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2699 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2701 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2702 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2703 2024-04-21T10:21:38.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2704 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2753 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2753_fsm 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2753_vm 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2754 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2755 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2756 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2757 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2830 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2831 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2832 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2833 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2834 2024-04-21T10:21:38.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2835 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2836 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2837 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 21 10:21 2838 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2838_fsm 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2838_vm 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2839 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2840 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2840_fsm 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2840_vm 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2841 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2995 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2996 2024-04-21T10:21:38.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3079 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3079_fsm 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3079_vm 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3080 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3081 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 3085 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3118 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3119 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 21 10:21 3164 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3256 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3257 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3258 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3350 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3351 2024-04-21T10:21:38.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3379 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3380 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3381 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3394 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3394_fsm 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3394_vm 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3395 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3429 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3430 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3431 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3433 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3439 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3440 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 3455 2024-04-21T10:21:38.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 21 10:21 3456 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3456_fsm 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3456_vm 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3466 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3467 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3468 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3501 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3502 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3503 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3534 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3541 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3541_fsm 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3541_vm 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3542 2024-04-21T10:21:38.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3574 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3575 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3576 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3596 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3597 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3598 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3599 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3600 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3600_fsm 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3600_vm 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3601 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3601_fsm 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3601_vm 2024-04-21T10:21:38.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3602 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3602_fsm 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3602_vm 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3603 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3603_fsm 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3603_vm 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3604 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3605 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3606 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3607 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3608 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 3609 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3712 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3764 2024-04-21T10:21:38.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3764_fsm 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3764_vm 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3766 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3767 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3997 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4143 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4144 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4145 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4146 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4147 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4148 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4149 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4150 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4151 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4152 2024-04-21T10:21:38.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4153 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4154 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4155 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4156 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4157 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4158 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4159 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4160 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4161 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4162 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4163 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4164 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4165 2024-04-21T10:21:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4166 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4167 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4168 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4169 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4170 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4171 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4172 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4173 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4174 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 5002 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 548 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 549 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6102 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6104 2024-04-21T10:21:38.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6106 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6110 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6111 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6112 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6113 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6117 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 826 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 827 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 828 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 21 10:21 pg_filenode.map 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 PG_VERSION 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-04-21T10:21:38.915 INFO:teuthology.orchestra.run.smithi077.stdout:total 7777 2024-04-21T10:21:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 21 10:21 . 2024-04-21T10:21:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 .. 2024-04-21T10:21:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 112 2024-04-21T10:21:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 113 2024-04-21T10:21:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 21 10:21 1247 2024-04-21T10:21:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1247_fsm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1247_vm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 21 10:21 1249 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1249_fsm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1249_vm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 21 10:21 1255 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1255_fsm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1255_vm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 21 10:21 1259 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1259_fsm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1259_vm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 21 10:21 13344 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13344_fsm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13344_vm 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13346 2024-04-21T10:21:38.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13348 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13349 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13349_fsm 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13349_vm 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13351 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13353 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13354 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13354_fsm 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13354_vm 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13356 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13358 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13359 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 13359_fsm 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13359_vm 2024-04-21T10:21:38.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 13361 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 13363 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 1417 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 1418 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 174 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 175 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2187 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2224 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2328 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2336 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2337 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2579 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2600 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2600_fsm 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2600_vm 2024-04-21T10:21:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2601 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2601_fsm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2601_vm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2602 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2602_fsm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2602_vm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2603 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2603_fsm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2603_vm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2604 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2605 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2605_fsm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2605_vm 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2606 2024-04-21T10:21:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2606_fsm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2606_vm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2607 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2607_fsm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2607_vm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 21 10:21 2608 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2608_fsm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2608_vm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 21 10:21 2609 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2609_fsm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2609_vm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2610 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2610_fsm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2610_vm 2024-04-21T10:21:38.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2611 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2612 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2612_fsm 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2612_vm 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2613 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2615 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2615_fsm 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2615_vm 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2616 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2616_fsm 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2616_vm 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 21 10:21 2617 2024-04-21T10:21:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2617_fsm 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2617_vm 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 21 10:21 2618 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2618_fsm 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2618_vm 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 21 10:21 2619 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2619_fsm 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2619_vm 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2620 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2650 2024-04-21T10:21:38.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2651 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2652 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2653 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2654 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2655 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2656 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2657 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 21 10:21 2658 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 21 10:21 2659 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2660 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2661 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2662 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2663 2024-04-21T10:21:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2664 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2665 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2666 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2667 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2668 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2669 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2670 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 21 10:21 2673 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 21 10:21 2674 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 21 10:21 2675 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2678 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2679 2024-04-21T10:21:38.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2680 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2681 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2682 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2683 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2684 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2685 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2686 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2687 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2688 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 21 10:21 2689 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 21 10:21 2690 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 21 10:21 2691 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2692 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2693 2024-04-21T10:21:38.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2696 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2699 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2701 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2702 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2703 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 2704 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2753 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2753_fsm 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2753_vm 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2754 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2755 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2756 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 2757 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2830 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2831 2024-04-21T10:21:38.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2832 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2833 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2834 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2835 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2836 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2837 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 21 10:21 2838 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2838_fsm 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2838_vm 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2839 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2840 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2840_fsm 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2840_vm 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2841 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2995 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2996 2024-04-21T10:21:38.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3079 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3079_fsm 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3079_vm 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3080 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3081 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 3085 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3118 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3119 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 21 10:21 3164 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3256 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3257 2024-04-21T10:21:38.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3258 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3350 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3351 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3379 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3380 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3381 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3394 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3394_fsm 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3394_vm 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3395 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3429 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3430 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3431 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3433 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3439 2024-04-21T10:21:38.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3440 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 21 10:21 3455 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 21 10:21 3456 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3456_fsm 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3456_vm 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3466 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3467 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3468 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3501 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3502 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3503 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3534 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3541 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3541_fsm 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3541_vm 2024-04-21T10:21:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3542 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3574 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3575 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3576 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3596 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3597 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3598 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3599 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3600 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3600_fsm 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3600_vm 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3601 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3601_fsm 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3601_vm 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3602 2024-04-21T10:21:38.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3602_fsm 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3602_vm 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3603 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3603_fsm 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3603_vm 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3604 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3605 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3606 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3607 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3608 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 21 10:21 3609 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3712 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3764 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 3764_fsm 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3764_vm 2024-04-21T10:21:38.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3766 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 3767 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3997 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4143 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4144 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4145 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4146 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4147 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4148 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4149 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4150 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4151 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4152 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4153 2024-04-21T10:21:38.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4154 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4155 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4156 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4157 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4158 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4159 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4160 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4161 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4162 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4163 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4164 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4165 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4166 2024-04-21T10:21:38.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4167 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4168 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4169 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4170 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4171 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4172 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4173 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4174 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 5002 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 548 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 549 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6102 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6104 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6106 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6110 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6111 2024-04-21T10:21:38.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6112 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6113 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6117 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 826 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 827 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 828 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 21 10:21 pg_filenode.map 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 PG_VERSION 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/global: 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:total 537 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Apr 21 10:21 . 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1213 2024-04-21T10:21:38.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1213_fsm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1213_vm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1214 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1214_fsm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1214_vm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 1232 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 1233 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1260 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1260_fsm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1260_vm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1261 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1261_fsm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1261_vm 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1262 2024-04-21T10:21:38.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 1262_fsm 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 1262_vm 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2396 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 21 10:21 2396_fsm 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2396_vm 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2397 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2671 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2672 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2676 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2677 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2694 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2695 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2697 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 21 10:21 2698 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2846 2024-04-21T10:21:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2847 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2964 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2965 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 2966 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 2967 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 3592 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 3593 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4060 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4061 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4175 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4176 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4177 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4178 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4181 2024-04-21T10:21:38.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4182 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4183 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4184 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 4185 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 4186 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6000 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6001 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6002 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 6100 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6114 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 6115 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 pg_control 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 21 10:21 pg_filenode.map 2024-04-21T10:21:38.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/log: 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:total 1 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 . 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 mappings 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Apr 21 10:21 replorigin_checkpoint 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 snapshots 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 .. 2024-04-21T10:21:38.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 21 10:21 .. 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 . 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 members 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 offsets 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:total 8 2024-04-21T10:21:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 . 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 .. 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 0000 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:total 8 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 . 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 .. 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 0000 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:total 8 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 . 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 0000 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:total 16384 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 . 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Apr 21 10:21 000000010000000000000001 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 archive_status 2024-04-21T10:21:38.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:total 0 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 21 10:21 . 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 21 10:21 .. 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:total 8 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 21 10:21 . 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 21 10:21 .. 2024-04-21T10:21:38.950 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 21 10:21 0000 2024-04-21T10:21:38.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-04-21T10:21:39.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-04-21T10:21:39.125 INFO:teuthology.orchestra.run.smithi077.stderr:dropping old tables... 2024-04-21T10:21:39.125 INFO:teuthology.orchestra.run.smithi077.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-04-21T10:21:39.125 INFO:teuthology.orchestra.run.smithi077.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-04-21T10:21:39.126 INFO:teuthology.orchestra.run.smithi077.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-04-21T10:21:39.126 INFO:teuthology.orchestra.run.smithi077.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-04-21T10:21:39.126 INFO:teuthology.orchestra.run.smithi077.stderr:creating tables... 2024-04-21T10:21:39.138 INFO:teuthology.orchestra.run.smithi077.stderr:generating data (client-side)... 2024-04-21T10:21:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.76 s) 2024-04-21T10:21:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.21 s, remaining 3.22 s) 2024-04-21T10:21:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:39 smithi077 ceph-mon[27902]: pgmap v10: 97 pgs: 97 active+clean; 2.0 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 142 KiB/s wr, 50 op/s 2024-04-21T10:21:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.30 s, remaining 2.93 s) 2024-04-21T10:21:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:39 smithi191 ceph-mon[31636]: pgmap v10: 97 pgs: 97 active+clean; 2.0 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 142 KiB/s wr, 50 op/s 2024-04-21T10:21:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 -- 172.21.15.77:0/2112384342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87541021d0 msgr2=0x7f87541025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 --2- 172.21.15.77:0/2112384342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87541021d0 0x7f87541025b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8744009900 tx=0x7f874402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 -- 172.21.15.77:0/2112384342 shutdown_connections 2024-04-21T10:21:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 --2- 172.21.15.77:0/2112384342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87541072a0 0x7f875410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 --2- 172.21.15.77:0/2112384342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8754102b80 0x7f8754106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 --2- 172.21.15.77:0/2112384342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87541021d0 0x7f87541025b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.510+0000 7f875a23a640 1 -- 172.21.15.77:0/2112384342 >> 172.21.15.77:0/2112384342 conn(0x7f87540793e0 msgr2=0x7f87540797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 -- 172.21.15.77:0/2112384342 shutdown_connections 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 -- 172.21.15.77:0/2112384342 wait complete. 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 Processor -- start 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 -- start start 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87541021d0 0x7f87541986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87541072a0 0x7f8754198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 0x7f875419d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8754112200 con 0x7f875419cf80 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8754112080 con 0x7f87541021d0 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.511+0000 7f875a23a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8754112380 con 0x7f87541072a0 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 0x7f875419d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 0x7f875419d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33994/0 (socket says 172.21.15.77:33994) 2024-04-21T10:21:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 -- 172.21.15.77:0/2522280519 learned_addr learned my addr 172.21.15.77:0/2522280519 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f87537fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87541021d0 0x7f87541986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8752ffd640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87541072a0 0x7f8754198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 -- 172.21.15.77:0/2522280519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87541072a0 msgr2=0x7f8754198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87541072a0 0x7f8754198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 -- 172.21.15.77:0/2522280519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87541021d0 msgr2=0x7f87541986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87541021d0 0x7f87541986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 -- 172.21.15.77:0/2522280519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875419da70 con 0x7f875419cf80 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8753fff640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 0x7f875419d430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f874c00ea60 tx=0x7f874c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8750ff9640 1 -- 172.21.15.77:0/2522280519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c00ce40 con 0x7f875419cf80 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8750ff9640 1 -- 172.21.15.77:0/2522280519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f874c005020 con 0x7f875419cf80 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875419dd60 con 0x7f875419cf80 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f8750ff9640 1 -- 172.21.15.77:0/2522280519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c010670 con 0x7f875419cf80 2024-04-21T10:21:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.512+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87541a5500 con 0x7f875419cf80 2024-04-21T10:21:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.514+0000 7f8750ff9640 1 -- 172.21.15.77:0/2522280519 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f874c0054b0 con 0x7f875419cf80 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 Processor -- start 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 -- start start 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f407620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f407fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55944f36c8d0 con 0x55944f407b60 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55944f309e80 con 0x55944f4110e0 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f875ce20740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55944f368890 con 0x55944f4088d0 2024-04-21T10:21:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.515+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f407620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f407620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:40220/0 (socket says 172.21.15.77:40220) 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 -- 172.21.15.77:0/2471763327 learned_addr learned my addr 172.21.15.77:0/2471763327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8750ff9640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f873c0a8270 0x7f873c0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f87537fe640 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f407fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 -- 172.21.15.77:0/2471763327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 msgr2=0x55944f4134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 -- 172.21.15.77:0/2471763327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 msgr2=0x55944f407fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f407fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 -- 172.21.15.77:0/2471763327 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944f32b320 con 0x55944f4088d0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8750ff9640 1 -- 172.21.15.77:0/2522280519 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f874c0d0dd0 con 0x7f875419cf80 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8753fff640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f873c0a8270 0x7f873c0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8752ffd640 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f407620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87480058c0 tx=0x7f8748005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778cf23a2eb3b749 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8739ffb640 1 -- 172.21.15.77:0/2471763327 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748004230 con 0x55944f4088d0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8739ffb640 1 -- 172.21.15.77:0/2471763327 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87480043d0 con 0x55944f4088d0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.516+0000 7f8739ffb640 1 -- 172.21.15.77:0/2471763327 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748004cf0 con 0x55944f4088d0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 -- 172.21.15.77:0/2471763327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 msgr2=0x55944f407620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f407620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87480058c0 tx=0x7f8748005850 comp rx=0 tx=0).stop 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f8753fff640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f873c0a8270 0x7f873c0aa730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f874c0ce4f0 tx=0x7f874c00ef90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 -- 172.21.15.77:0/2471763327 shutdown_connections 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f407fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4134d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 --2- 172.21.15.77:0/2471763327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f407620 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 -- 172.21.15.77:0/2471763327 >> 172.21.15.77:0/2471763327 conn(0x55944f3cec90 msgr2=0x55944f402850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 -- 172.21.15.77:0/2471763327 shutdown_connections 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.517+0000 7f875ce20740 1 -- 172.21.15.77:0/2471763327 wait complete. 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 -- start start 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 Processor -- start 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f407b60 0x55944f410a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f40dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f4110e0 0x55944f40e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55944f413e10 con 0x55944f4110e0 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55944f2f4eb0 con 0x55944f4088d0 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55944f413f90 con 0x55944f407b60 2024-04-21T10:21:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f875ce20740 10 client.0 _ll_register_callbacks cb 0x55944f321b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.518+0000 7f87537fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f40dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f40dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:55798/0 (socket says 172.21.15.77:55798) 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 -- 172.21.15.77:0/3814024879 learned_addr learned my addr 172.21.15.77:0/3814024879 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f4110e0 0x55944f40e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f407b60 0x55944f410a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 -- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f407b60 msgr2=0x55944f410a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f407b60 0x55944f410a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 -- 172.21.15.77:0/3814024879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f4110e0 msgr2=0x55944f40e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f4110e0 0x55944f40e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 -- 172.21.15.77:0/3814024879 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944f07f210 con 0x55944f4088d0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f407b60 0x55944f410a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f87537fe640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f40dda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8744005ec0 tx=0x7f874402ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418f3cf63f9acaf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f8732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:21:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f8732ffd640 1 -- 172.21.15.77:0/3814024879 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874402c610 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.519+0000 7f8732ffd640 1 -- 172.21.15.77:0/3814024879 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8744005030 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87480043d0 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f8732ffd640 1 -- 172.21.15.77:0/3814024879 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8744005230 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 10 client.25028 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55944f14b620 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f8732ffd640 1 -- 172.21.15.77:0/3814024879 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87480043d0 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f8732ffd640 1 -- 172.21.15.77:0/3814024879 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f87440035f0 con 0x55944f4088d0 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 10 client.25028 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 10 client.25028 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 20 client.25028 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f421090 0x55944f4234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 4 client.25028 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.520+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55944f380880 con 0x55944f421090 2024-04-21T10:21:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.521+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f421090 0x55944f4234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.521+0000 7f8732ffd640 10 client.25028 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.521+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f421090 0x55944f4234c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2a94525836cf92 server_cookie=766e6ad1bc96186e in_seq=0 out_seq=0 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f8732ffd640 1 -- 172.21.15.77:0/3814024879 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55944f380880 con 0x55944f421090 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f8732ffd640 10 client.25028 handle_command_reply: tid=0 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 client.25028 shutdown 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 msgr2=0x55944f40dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f40dda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8744005ec0 tx=0x7f874402ca10 comp rx=0 tx=0).stop 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 shutdown_connections 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f421090 0x55944f4234c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f4110e0 0x55944f40e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f40dda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 --2- 172.21.15.77:0/3814024879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f407b60 0x55944f410a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f8732ffd640 0 client.25028 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 >> 172.21.15.77:0/3814024879 conn(0x55944f3cec90 msgr2=0x55944f4045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 shutdown_connections 2024-04-21T10:21:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 1 -- 172.21.15.77:0/3814024879 wait complete. 2024-04-21T10:21:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.522+0000 7f875ce20740 20 client.25028 trim_cache size 0 max 16384 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 Processor -- start 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 -- start start 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f41cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f401750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4104d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87541ae160 con 0x55944f407b60 2024-04-21T10:21:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f87541aba30 con 0x55944f4110e0 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f875ce20740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f87541a98a0 con 0x55944f4088d0 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f41cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f41cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34008/0 (socket says 172.21.15.77:34008) 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 -- 172.21.15.77:0/3150320857 learned_addr learned my addr 172.21.15.77:0/3150320857 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f87537fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f401750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 -- 172.21.15.77:0/3150320857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 msgr2=0x55944f401750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f401750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 -- 172.21.15.77:0/3150320857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 msgr2=0x55944f4104d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f8752ffd640 1 -- 172.21.15.77:0/3150320857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944f406e30 con 0x55944f407b60 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.543+0000 7f87537fe640 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f401750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.544+0000 7f8752ffd640 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f41cd10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8748011ca0 tx=0x7f87480048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69796d6da01a5e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.544+0000 7f87397fa640 1 -- 172.21.15.77:0/3150320857 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87480043d0 con 0x55944f407b60 2024-04-21T10:21:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.544+0000 7f87397fa640 1 -- 172.21.15.77:0/3150320857 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8748031030 con 0x55944f407b60 2024-04-21T10:21:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.544+0000 7f87397fa640 1 -- 172.21.15.77:0/3150320857 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874802c680 con 0x55944f407b60 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 -- 172.21.15.77:0/3150320857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 msgr2=0x55944f41cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f41cd10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8748011ca0 tx=0x7f87480048b0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 -- 172.21.15.77:0/3150320857 shutdown_connections 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4110e0 0x55944f4104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4088d0 0x55944f401750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 --2- 172.21.15.77:0/3150320857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f41cd10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 -- 172.21.15.77:0/3150320857 >> 172.21.15.77:0/3150320857 conn(0x55944f3cec90 msgr2=0x55944f401040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 -- 172.21.15.77:0/3150320857 shutdown_connections 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.545+0000 7f875ce20740 1 -- 172.21.15.77:0/3150320857 wait complete. 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.546+0000 7f875ce20740 1 -- start start 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.546+0000 7f875ce20740 1 Processor -- start 2024-04-21T10:21:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f4194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f414820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4110e0 0x55944f414d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87541a9ef0 con 0x55944f407b60 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f87541ab360 con 0x55944f4088d0 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f87541aa5c0 con 0x55944f4110e0 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f875ce20740 10 client.0 _ll_register_callbacks cb 0x7f8748005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f4194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f4194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34012/0 (socket says 172.21.15.77:34012) 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 -- 172.21.15.77:0/679544218 learned_addr learned my addr 172.21.15.77:0/679544218 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 -- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4110e0 msgr2=0x55944f414d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4110e0 0x55944f414d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 -- 172.21.15.77:0/679544218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 msgr2=0x55944f414820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f414820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 -- 172.21.15.77:0/679544218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944f415450 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8752ffd640 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f4194b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8748020e70 tx=0x7f8748009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c71567eb812286 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.547+0000 7f8732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f8732ffd640 1 -- 172.21.15.77:0/679544218 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748003a30 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f8732ffd640 1 -- 172.21.15.77:0/679544218 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f874801f960 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8748031030 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f8732ffd640 1 -- 172.21.15.77:0/679544218 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f874801fb60 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 10 client.15591 fetch_fsmap learned FSMap version 22 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55944f487510 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f8732ffd640 1 -- 172.21.15.77:0/679544218 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8748031030 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f8732ffd640 1 -- 172.21.15.77:0/679544218 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f874802c540 con 0x55944f407b60 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 10 client.15591 fetch_fsmap finished waiting for FSMap version 22 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 20 client.15591 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f487a60 0x55944f489e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 4 client.15591 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:21:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.548+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55944f30c3d0 con 0x55944f487a60 2024-04-21T10:21:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.549+0000 7f87537fe640 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f487a60 0x55944f489e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.549+0000 7f8732ffd640 10 client.15591 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.549+0000 7f87537fe640 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f487a60 0x55944f489e80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfda9d6d93e7a57 server_cookie=fac396031250b939 in_seq=0 out_seq=0 2024-04-21T10:21:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:39 smithi170 ceph-mon[31212]: pgmap v10: 97 pgs: 97 active+clean; 2.0 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 142 KiB/s wr, 50 op/s 2024-04-21T10:21:39.605 INFO:teuthology.orchestra.run.smithi077.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.45 s, remaining 3.14 s) 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.724+0000 7f8732ffd640 1 -- 172.21.15.77:0/679544218 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55944f30c3d0 con 0x55944f487a60 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.724+0000 7f8732ffd640 10 client.15591 handle_command_reply: tid=0 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.724+0000 7f875ce20740 1 client.15591 shutdown 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 msgr2=0x55944f4194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f4194b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8748020e70 tx=0x7f8748009ab0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 shutdown_connections 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55944f487a60 0x55944f489e80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944f4110e0 0x55944f414d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55944f4088d0 0x55944f414820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f8732ffd640 0 client.15591 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 --2- 172.21.15.77:0/679544218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944f407b60 0x55944f4194b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 >> 172.21.15.77:0/679544218 conn(0x55944f3cec90 msgr2=0x55944f4018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 shutdown_connections 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 1 -- 172.21.15.77:0/679544218 wait complete. 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875ce20740 20 client.15591 trim_cache size 0 max 16384 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:21:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:21:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:21:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f873c0a8270 msgr2=0x7f873c0aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f873c0a8270 0x7f873c0aa730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f874c0ce4f0 tx=0x7f874c00ef90 comp rx=0 tx=0).stop 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 msgr2=0x7f875419d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 0x7f875419d430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f874c00ea60 tx=0x7f874c00ef20 comp rx=0 tx=0).stop 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 shutdown_connections 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f873c0a8270 0x7f873c0aa730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875419cf80 0x7f875419d430 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87541072a0 0x7f8754198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 --2- 172.21.15.77:0/2522280519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87541021d0 0x7f87541986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.725+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 >> 172.21.15.77:0/2522280519 conn(0x7f87540793e0 msgr2=0x7f87540ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.726+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 shutdown_connections 2024-04-21T10:21:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:39.726+0000 7f875a23a640 1 -- 172.21.15.77:0/2522280519 wait complete. 2024-04-21T10:21:39.823 INFO:teuthology.orchestra.run.smithi077.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.67 s, remaining 3.59 s) 2024-04-21T10:21:39.907 INFO:teuthology.orchestra.run.smithi077.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.75 s, remaining 3.25 s) 2024-04-21T10:21:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.89 s, remaining 3.18 s) 2024-04-21T10:21:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.06 s, remaining 3.19 s) 2024-04-21T10:21:40.373 INFO:teuthology.orchestra.run.smithi077.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.22 s, remaining 3.11 s) 2024-04-21T10:21:40.452 INFO:teuthology.orchestra.run.smithi077.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.30 s, remaining 2.85 s) 2024-04-21T10:21:40.594 INFO:teuthology.orchestra.run.smithi077.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.44 s, remaining 2.74 s) 2024-04-21T10:21:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.53 s, remaining 2.55 s) 2024-04-21T10:21:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.67 s, remaining 2.44 s) 2024-04-21T10:21:40.993 INFO:teuthology.orchestra.run.smithi077.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.84 s, remaining 2.36 s) 2024-04-21T10:21:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:1500000 of 3200000 tuples (46%) done (elapsed 1.93 s, remaining 2.19 s) 2024-04-21T10:21:41.224 INFO:teuthology.orchestra.run.smithi077.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.07 s, remaining 2.07 s) 2024-04-21T10:21:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.15 s, remaining 1.90 s) 2024-04-21T10:21:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:41 smithi191 ceph-mon[31636]: pgmap v11: 97 pgs: 97 active+clean; 48 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 6.7 MiB/s wr, 225 op/s 2024-04-21T10:21:41.478 INFO:teuthology.orchestra.run.smithi077.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.32 s, remaining 1.81 s) 2024-04-21T10:21:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:41 smithi170 ceph-mon[31212]: pgmap v11: 97 pgs: 97 active+clean; 48 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 6.7 MiB/s wr, 225 op/s 2024-04-21T10:21:41.594 INFO:teuthology.orchestra.run.smithi077.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.44 s, remaining 1.67 s) 2024-04-21T10:21:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:41 smithi077 ceph-mon[27902]: pgmap v11: 97 pgs: 97 active+clean; 48 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 6.7 MiB/s wr, 225 op/s 2024-04-21T10:21:41.686 INFO:teuthology.orchestra.run.smithi077.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.53 s, remaining 1.52 s) 2024-04-21T10:21:41.832 INFO:teuthology.orchestra.run.smithi077.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.68 s, remaining 1.40 s) 2024-04-21T10:21:41.972 INFO:teuthology.orchestra.run.smithi077.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.81 s, remaining 1.28 s) 2024-04-21T10:21:42.060 INFO:teuthology.orchestra.run.smithi077.stderr:2300000 of 3200000 tuples (71%) done (elapsed 2.90 s, remaining 1.14 s) 2024-04-21T10:21:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.05 s, remaining 1.02 s) 2024-04-21T10:21:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.22 s, remaining 0.90 s) 2024-04-21T10:21:42.463 INFO:teuthology.orchestra.run.smithi077.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.31 s, remaining 0.76 s) 2024-04-21T10:21:42.601 INFO:teuthology.orchestra.run.smithi077.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.44 s, remaining 0.64 s) 2024-04-21T10:21:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.54 s, remaining 0.51 s) 2024-04-21T10:21:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.69 s, remaining 0.38 s) 2024-04-21T10:21:42.979 INFO:teuthology.orchestra.run.smithi077.stderr:3000000 of 3200000 tuples (93%) done (elapsed 3.82 s, remaining 0.25 s) 2024-04-21T10:21:43.071 INFO:teuthology.orchestra.run.smithi077.stderr:3100000 of 3200000 tuples (96%) done (elapsed 3.91 s, remaining 0.13 s) 2024-04-21T10:21:43.207 INFO:teuthology.orchestra.run.smithi077.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.05 s, remaining 0.00 s) 2024-04-21T10:21:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:vacuuming... 2024-04-21T10:21:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:43 smithi191 ceph-mon[31636]: pgmap v12: 97 pgs: 97 active+clean; 109 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 15 MiB/s wr, 303 op/s 2024-04-21T10:21:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:43 smithi170 ceph-mon[31212]: pgmap v12: 97 pgs: 97 active+clean; 109 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 15 MiB/s wr, 303 op/s 2024-04-21T10:21:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:43 smithi077 ceph-mon[27902]: pgmap v12: 97 pgs: 97 active+clean; 109 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 15 MiB/s wr, 303 op/s 2024-04-21T10:21:43.838 INFO:teuthology.orchestra.run.smithi077.stderr:creating primary keys... 2024-04-21T10:21:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:44 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:44 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:44 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:45.032 INFO:teuthology.orchestra.run.smithi077.stderr:done in 5.91 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 4.11 s, vacuum 0.59 s, primary keys 1.19 s). 2024-04-21T10:21:45.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-04-21T10:21:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:starting vacuum...end. 2024-04-21T10:21:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:45 smithi077 ceph-mon[27902]: pgmap v13: 97 pgs: 97 active+clean; 109 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 15 MiB/s wr, 298 op/s 2024-04-21T10:21:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:45 smithi191 ceph-mon[31636]: pgmap v13: 97 pgs: 97 active+clean; 109 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 15 MiB/s wr, 298 op/s 2024-04-21T10:21:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:45 smithi170 ceph-mon[31212]: pgmap v13: 97 pgs: 97 active+clean; 109 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 15 MiB/s wr, 298 op/s 2024-04-21T10:21:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:47 smithi077 ceph-mon[27902]: pgmap v14: 97 pgs: 97 active+clean; 498 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 74 MiB/s wr, 336 op/s 2024-04-21T10:21:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:47 smithi191 ceph-mon[31636]: pgmap v14: 97 pgs: 97 active+clean; 498 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 74 MiB/s wr, 336 op/s 2024-04-21T10:21:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:47 smithi170 ceph-mon[31212]: pgmap v14: 97 pgs: 97 active+clean; 498 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 74 MiB/s wr, 336 op/s 2024-04-21T10:21:48.024 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-21T10:21:48.024 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-21T10:21:48.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:21:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.163+0000 7f294254b640 1 -- 172.21.15.77:0/2680100756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c108f50 msgr2=0x7f293c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.163+0000 7f294254b640 1 --2- 172.21.15.77:0/2680100756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c108f50 0x7f293c109330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f293000fb40 tx=0x7f29300341b0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.164+0000 7f294254b640 1 -- 172.21.15.77:0/2680100756 shutdown_connections 2024-04-21T10:21:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.164+0000 7f294254b640 1 --2- 172.21.15.77:0/2680100756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c1150a0 0x7f293c117490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.164+0000 7f294254b640 1 --2- 172.21.15.77:0/2680100756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c109870 0x7f293c114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.164+0000 7f294254b640 1 --2- 172.21.15.77:0/2680100756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c108f50 0x7f293c109330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.164+0000 7f294254b640 1 -- 172.21.15.77:0/2680100756 >> 172.21.15.77:0/2680100756 conn(0x7f293c06e410 msgr2=0x7f293c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.164+0000 7f294254b640 1 -- 172.21.15.77:0/2680100756 shutdown_connections 2024-04-21T10:21:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.165+0000 7f294254b640 1 -- 172.21.15.77:0/2680100756 wait complete. 2024-04-21T10:21:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.165+0000 7f294254b640 1 Processor -- start 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.165+0000 7f294254b640 1 -- start start 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f294254b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c108f50 0x7f293c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f294254b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 0x7f293c19f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f294254b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c1150a0 0x7f293c1a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f294254b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f293c118810 con 0x7f293c1150a0 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f294254b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f293c118690 con 0x7f293c108f50 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f294254b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f293c118990 con 0x7f293c109870 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f293b7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 0x7f293c19f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f293b7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 0x7f293c19f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:47532/0 (socket says 172.21.15.77:47532) 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f293b7fe640 1 -- 172.21.15.77:0/4264293004 learned_addr learned my addr 172.21.15.77:0/4264293004 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f293bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c108f50 0x7f293c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.166+0000 7f2940ae8640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c1150a0 0x7f293c1a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293b7fe640 1 -- 172.21.15.77:0/4264293004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c108f50 msgr2=0x7f293c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293b7fe640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c108f50 0x7f293c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293b7fe640 1 -- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c1150a0 msgr2=0x7f293c1a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293b7fe640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c1150a0 0x7f293c1a3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293b7fe640 1 -- 172.21.15.77:0/4264293004 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c1a3d80 con 0x7f293c109870 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293bfff640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c108f50 0x7f293c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f293b7fe640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 0x7f293c19f2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f293400ba50 tx=0x7f293400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934019070 con 0x7f293c109870 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293c1a4070 con 0x7f293c109870 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293c1ab900 con 0x7f293c109870 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f293400cbe0 con 0x7f293c109870 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.167+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29340075d0 con 0x7f293c109870 2024-04-21T10:21:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.168+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2928005290 con 0x7f293c109870 2024-04-21T10:21:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.169+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f293401c070 con 0x7f293c109870 2024-04-21T10:21:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.170+0000 7f29397fa640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f29240a3e70 0x7f29240a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.171+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f29340cfc30 con 0x7f293c109870 2024-04-21T10:21:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.171+0000 7f293bfff640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f29240a3e70 0x7f29240a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.172+0000 7f293bfff640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f29240a3e70 0x7f29240a6330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2930005ab0 tx=0x7f2930005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.174+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f293409bd30 con 0x7f293c109870 2024-04-21T10:21:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.512+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2928005580 con 0x7f293c109870 2024-04-21T10:21:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.513+0000 7f29397fa640 1 -- 172.21.15.77:0/4264293004 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11887 (secure 0 0 0) 0x7f29340a0030 con 0x7f293c109870 2024-04-21T10:21:48.513 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:21:48.513 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:48.128805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:21:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f29240a3e70 msgr2=0x7f29240a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f29240a3e70 0x7f29240a6330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2930005ab0 tx=0x7f2930005fd0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 msgr2=0x7f293c19f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 0x7f293c19f2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f293400ba50 tx=0x7f293400bf10 comp rx=0 tx=0).stop 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 shutdown_connections 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f29240a3e70 0x7f29240a6330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f293c1150a0 0x7f293c1a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f293c109870 0x7f293c19f2d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 --2- 172.21.15.77:0/4264293004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c108f50 0x7f293c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 >> 172.21.15.77:0/4264293004 conn(0x7f293c06e410 msgr2=0x7f293c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 shutdown_connections 2024-04-21T10:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.516+0000 7f294254b640 1 -- 172.21.15.77:0/4264293004 wait complete. 2024-04-21T10:21:48.530 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 90.0 --await' 2024-04-21T10:21:48.530 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 90.0 --await 2024-04-21T10:21:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 -- 172.21.15.77:0/2215272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101ad0 msgr2=0x7f8e20105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/2215272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101ad0 0x7f8e20105a90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009900 tx=0x7f8e1402bc40 comp rx=0 tx=0).stop 2024-04-21T10:21:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 -- 172.21.15.77:0/2215272567 shutdown_connections 2024-04-21T10:21:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/2215272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101ad0 0x7f8e20105a90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/2215272567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e20106170 0x7f8e2010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/2215272567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20101120 0x7f8e20101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 -- 172.21.15.77:0/2215272567 >> 172.21.15.77:0/2215272567 conn(0x7f8e20076f60 msgr2=0x7f8e20077370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 -- 172.21.15.77:0/2215272567 shutdown_connections 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.688+0000 7f8e25bdb640 1 -- 172.21.15.77:0/2215272567 wait complete. 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 Processor -- start 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 -- start start 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101120 0x7f8e20196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20106170 0x7f8e20196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e2019ae30 0x7f8e2019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2010ffd0 con 0x7f8e20101120 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2010fe50 con 0x7f8e20106170 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e25bdb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20110150 con 0x7f8e2019ae30 2024-04-21T10:21:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.689+0000 7f8e1f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101120 0x7f8e20196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20106170 0x7f8e20196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20106170 0x7f8e20196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:58950/0 (socket says 172.21.15.77:58950) 2024-04-21T10:21:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1effd640 1 -- 172.21.15.77:0/390412777 learned_addr learned my addr 172.21.15.77:0/390412777 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1f7fe640 1 -- 172.21.15.77:0/390412777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e2019ae30 msgr2=0x7f8e2019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e2019ae30 0x7f8e2019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1f7fe640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e2019ae30 0x7f8e2019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1f7fe640 1 -- 172.21.15.77:0/390412777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20106170 msgr2=0x7f8e20196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1f7fe640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20106170 0x7f8e20196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.690+0000 7f8e1f7fe640 1 -- 172.21.15.77:0/390412777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2019b920 con 0x7f8e20101120 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e2019ae30 0x7f8e2019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e1f7fe640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101120 0x7f8e20196570 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000c970 tx=0x7f8e1000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e1cff9640 1 -- 172.21.15.77:0/390412777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10007bb0 con 0x7f8e20101120 2024-04-21T10:21:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2019bc10 con 0x7f8e20101120 2024-04-21T10:21:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e1cff9640 1 -- 172.21.15.77:0/390412777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e10007d50 con 0x7f8e20101120 2024-04-21T10:21:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e1cff9640 1 -- 172.21.15.77:0/390412777 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10004da0 con 0x7f8e20101120 2024-04-21T10:21:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.691+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e201a3420 con 0x7f8e20101120 2024-04-21T10:21:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.693+0000 7f8e1cff9640 1 -- 172.21.15.77:0/390412777 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f8e10004f40 con 0x7f8e20101120 2024-04-21T10:21:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.694+0000 7f8e287ce740 1 Processor -- start 2024-04-21T10:21:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.694+0000 7f8e287ce740 1 -- start start 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030174ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301760190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5603017606d0 0x560301762ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e287ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603016af0b0 con 0x56030174f180 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e287ce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560301660680 con 0x56030174e7d0 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e287ce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56030166cc60 con 0x5603017606d0 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.695+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030174ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030174ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:58964/0 (socket says 172.21.15.77:58964) 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 -- 172.21.15.77:0/2349008123 learned_addr learned my addr 172.21.15.77:0/2349008123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1f7fe640 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301760190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 -- 172.21.15.77:0/2349008123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5603017606d0 msgr2=0x560301762ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5603017606d0 0x560301762ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 -- 172.21.15.77:0/2349008123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 msgr2=0x560301760190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301760190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 -- 172.21.15.77:0/2349008123 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560301491c90 con 0x56030174e7d0 2024-04-21T10:21:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1cff9640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8e080a3da0 0x7f8e080a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1f7fe640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8e080a3da0 0x7f8e080a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030174ebb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009f40 tx=0x7f8e1800f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c5c585d7421266 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e1cff9640 1 -- 172.21.15.77:0/390412777 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8e100d0630 con 0x7f8e20101120 2024-04-21T10:21:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e05ffb640 1 -- 172.21.15.77:0/2349008123 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18003b70 con 0x56030174e7d0 2024-04-21T10:21:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e05ffb640 1 -- 172.21.15.77:0/2349008123 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e18003d10 con 0x56030174e7d0 2024-04-21T10:21:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.696+0000 7f8e05ffb640 1 -- 172.21.15.77:0/2349008123 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e180119e0 con 0x56030174e7d0 2024-04-21T10:21:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 -- 172.21.15.77:0/2349008123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 msgr2=0x56030174ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e1f7fe640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8e080a3da0 0x7f8e080a6260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e100cdd50 tx=0x7f8e100d6480 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030174ebb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009f40 tx=0x7f8e1800f7f0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 -- 172.21.15.77:0/2349008123 shutdown_connections 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301760190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5603017606d0 0x560301762ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2349008123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030174ebb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 -- 172.21.15.77:0/2349008123 >> 172.21.15.77:0/2349008123 conn(0x5603017490f0 msgr2=0x5603017494d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 -- 172.21.15.77:0/2349008123 shutdown_connections 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.697+0000 7f8e287ce740 1 -- 172.21.15.77:0/2349008123 wait complete. 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 -- start start 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 Processor -- start 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174e7d0 0x56030175d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x56030175e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603016b2400 con 0x56030174e7d0 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56030166e840 con 0x5603017606d0 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5603016b7720 con 0x56030174f180 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.698+0000 7f8e287ce740 10 client.0 _ll_register_callbacks cb 0x5603016bfea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:47572/0 (socket says 172.21.15.77:47572) 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 -- 172.21.15.77:0/2757552422 learned_addr learned my addr 172.21.15.77:0/2757552422 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x56030175e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174e7d0 0x56030175d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 -- 172.21.15.77:0/2757552422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 msgr2=0x56030175e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x56030175e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 -- 172.21.15.77:0/2757552422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174e7d0 msgr2=0x56030175d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174e7d0 0x56030175d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 -- 172.21.15.77:0/2757552422 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603014f2420 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x56030175e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8e1effd640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175dd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009340 tx=0x7f8e1402ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b67e085f412c0b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8dfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.699+0000 7f8dfeffd640 1 -- 172.21.15.77:0/2757552422 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14005240 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e18003d10 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8dfeffd640 1 -- 172.21.15.77:0/2757552422 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8e140053e0 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8dfeffd640 1 -- 172.21.15.77:0/2757552422 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8e1404f050 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 10 client.25129 fetch_fsmap learned FSMap version 24 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560301385580 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8dfeffd640 1 -- 172.21.15.77:0/2757552422 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e18003d10 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8dfeffd640 1 -- 172.21.15.77:0/2757552422 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8e140035f0 con 0x56030174f180 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 10 client.25129 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 10 client.25129 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:21:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 20 client.25129 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560301781550 0x560301783940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 4 client.25129 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603016c0b10 con 0x560301781550 2024-04-21T10:21:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.700+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560301781550 0x560301783940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.701+0000 7f8dfeffd640 10 client.25129 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.701+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560301781550 0x560301783940 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a07285aafb99e40 server_cookie=26cc11e724270cde in_seq=0 out_seq=0 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.701+0000 7f8dfeffd640 1 -- 172.21.15.77:0/2757552422 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5603016c0b10 con 0x560301781550 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.701+0000 7f8dfeffd640 10 client.25129 handle_command_reply: tid=0 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 client.25129 shutdown 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 msgr2=0x56030175dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175dd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009340 tx=0x7f8e1402ca00 comp rx=0 tx=0).stop 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 shutdown_connections 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560301781550 0x560301783940 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x56030175e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8dfeffd640 0 client.25129 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175dd60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2757552422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174e7d0 0x56030175d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 >> 172.21.15.77:0/2757552422 conn(0x5603017490f0 msgr2=0x56030174ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 shutdown_connections 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/2757552422 wait complete. 2024-04-21T10:21:48.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.702+0000 7f8e287ce740 20 client.25129 trim_cache size 0 max 16384 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 Processor -- start 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 -- start start 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030176c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603017606d0 0x560301789210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20073d00 con 0x5603017606d0 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20071b50 con 0x56030174e7d0 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e287ce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20073630 con 0x56030174f180 2024-04-21T10:21:48.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603017606d0 0x560301789210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:47578/0 (socket says 172.21.15.77:47578) 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1effd640 1 -- 172.21.15.77:0/2159868150 learned_addr learned my addr 172.21.15.77:0/2159868150 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030176c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1effd640 1 -- 172.21.15.77:0/2159868150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 msgr2=0x56030176c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.725+0000 7f8e1effd640 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030176c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e1effd640 1 -- 172.21.15.77:0/2159868150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603017606d0 msgr2=0x560301789210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e1effd640 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603017606d0 0x560301789210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e1effd640 1 -- 172.21.15.77:0/2159868150 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030175c7d0 con 0x56030174f180 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e1effd640 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175def0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e14003a40 tx=0x7f8e1402cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac093ac873dbb85 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e057fa640 1 -- 172.21.15.77:0/2159868150 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14009520 con 0x56030174f180 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e057fa640 1 -- 172.21.15.77:0/2159868150 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1402c5e0 con 0x56030174f180 2024-04-21T10:21:48.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.726+0000 7f8e057fa640 1 -- 172.21.15.77:0/2159868150 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14034e40 con 0x56030174f180 2024-04-21T10:21:48.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 -- 172.21.15.77:0/2159868150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 msgr2=0x56030175def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:48.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175def0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e14003a40 tx=0x7f8e1402cd80 comp rx=0 tx=0).stop 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 -- 172.21.15.77:0/2159868150 shutdown_connections 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603017606d0 0x560301789210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174f180 0x56030175def0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 --2- 172.21.15.77:0/2159868150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56030174e7d0 0x56030176c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 -- 172.21.15.77:0/2159868150 >> 172.21.15.77:0/2159868150 conn(0x5603017490f0 msgr2=0x56030175d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 -- 172.21.15.77:0/2159868150 shutdown_connections 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.727+0000 7f8e287ce740 1 -- 172.21.15.77:0/2159868150 wait complete. 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.728+0000 7f8e287ce740 1 -- start start 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.728+0000 7f8e287ce740 1 Processor -- start 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.728+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174e7d0 0x5603017685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301768ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e287ce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x560301757970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e287ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20072890 con 0x56030174f180 2024-04-21T10:21:48.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e287ce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200721c0 con 0x5603017606d0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e287ce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20072f60 con 0x56030174e7d0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e287ce740 10 client.0 _ll_register_callbacks cb 0x7f8e14009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174e7d0 0x5603017685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174e7d0 0x5603017685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:47580/0 (socket says 172.21.15.77:47580) 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 -- 172.21.15.77:0/97625738 learned_addr learned my addr 172.21.15.77:0/97625738 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x560301757970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1effd640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301768ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 -- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174e7d0 msgr2=0x5603017685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174e7d0 0x5603017685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 -- 172.21.15.77:0/97625738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 msgr2=0x560301768ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301768ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.729+0000 7f8e1ffff640 1 -- 172.21.15.77:0/97625738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560301765630 con 0x5603017606d0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8e1ffff640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x560301757970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5603017441a0 tx=0x7f8e1800f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd6fc81b75ef9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8dfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:21:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8dfeffd640 1 -- 172.21.15.77:0/97625738 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18024040 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8dfeffd640 1 -- 172.21.15.77:0/97625738 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8e18003d90 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e1402c5e0 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8dfeffd640 1 -- 172.21.15.77:0/97625738 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8e1803d050 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8e287ce740 10 client.25046 fetch_fsmap learned FSMap version 24 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5603017f0de0 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8dfeffd640 1 -- 172.21.15.77:0/97625738 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1402c5e0 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8dfeffd640 1 -- 172.21.15.77:0/97625738 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8e1802a040 con 0x5603017606d0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.730+0000 7f8e287ce740 10 client.25046 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e287ce740 10 client.25046 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e287ce740 20 client.25046 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e287ce740 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5603017f14c0 0x5603017f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e287ce740 4 client.25046 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 90.0, "await": true}] 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 90.0, "await": true}) -- 0x5603016ba980 con 0x5603017f14c0 2024-04-21T10:21:48.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e1effd640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5603017f14c0 0x5603017f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:48.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8dfeffd640 10 client.25046 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:48.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:48.731+0000 7f8e1effd640 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5603017f14c0 0x5603017f38e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=193119dc686daabb server_cookie=f9790bd40e0eb950 in_seq=0 out_seq=0 2024-04-21T10:21:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:49 smithi191 ceph-mon[31636]: pgmap v15: 97 pgs: 97 active+clean; 498 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 74 MiB/s wr, 330 op/s 2024-04-21T10:21:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:49 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:49 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4264293004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:49 smithi170 ceph-mon[31212]: pgmap v15: 97 pgs: 97 active+clean; 498 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 74 MiB/s wr, 330 op/s 2024-04-21T10:21:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:49 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:49 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4264293004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:49 smithi077 ceph-mon[27902]: pgmap v15: 97 pgs: 97 active+clean; 498 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 74 MiB/s wr, 330 op/s 2024-04-21T10:21:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:49 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:21:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:49 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4264293004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:21:49.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8dfeffd640 1 -- 172.21.15.77:0/97625738 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5603016ba980 con 0x5603017f14c0 2024-04-21T10:21:49.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8dfeffd640 10 client.25046 handle_command_reply: tid=0 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 client.25046 shutdown 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 msgr2=0x560301757970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x560301757970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5603017441a0 tx=0x7f8e1800f7f0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 shutdown_connections 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5603017f14c0 0x5603017f38e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56030174f180 0x560301768ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603017606d0 0x560301757970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 --2- 172.21.15.77:0/97625738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56030174e7d0 0x5603017685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8dfeffd640 0 client.25046 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 >> 172.21.15.77:0/97625738 conn(0x5603017490f0 msgr2=0x5603017481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 shutdown_connections 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 1 -- 172.21.15.77:0/97625738 wait complete. 2024-04-21T10:21:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.702+0000 7f8e287ce740 20 client.25046 trim_cache size 0 max 16384 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 24, 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 2, 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "ad6cdd3b": { 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 2, 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:21:49.704 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 90.0, 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:21:49.705 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:21:49.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8e080a3da0 msgr2=0x7f8e080a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:49.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8e080a3da0 0x7f8e080a6260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e100cdd50 tx=0x7f8e100d6480 comp rx=0 tx=0).stop 2024-04-21T10:21:49.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101120 msgr2=0x7f8e20196570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:49.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101120 0x7f8e20196570 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000c970 tx=0x7f8e1000ce30 comp rx=0 tx=0).stop 2024-04-21T10:21:49.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 shutdown_connections 2024-04-21T10:21:49.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8e080a3da0 0x7f8e080a6260 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e2019ae30 0x7f8e2019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e20106170 0x7f8e20196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 --2- 172.21.15.77:0/390412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20101120 0x7f8e20196570 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:49.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 >> 172.21.15.77:0/390412777 conn(0x7f8e20076f60 msgr2=0x7f8e200ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:49.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 shutdown_connections 2024-04-21T10:21:49.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:21:49.703+0000 7f8e25bdb640 1 -- 172.21.15.77:0/390412777 wait complete. 2024-04-21T10:21:49.716 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: ad6cdd3b, quiesce duration: 30.0 2024-04-21T10:21:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5.0 s, 2816.5 tps, lat 25.158 ms stddev 25.313 2024-04-21T10:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:51 smithi191 ceph-mon[31636]: pgmap v16: 97 pgs: 97 active+clean; 773 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 77 MiB/s wr, 462 op/s 2024-04-21T10:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:51 smithi170 ceph-mon[31212]: pgmap v16: 97 pgs: 97 active+clean; 773 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 77 MiB/s wr, 462 op/s 2024-04-21T10:21:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:51 smithi077 ceph-mon[27902]: pgmap v16: 97 pgs: 97 active+clean; 773 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 77 MiB/s wr, 462 op/s 2024-04-21T10:21:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 -- 172.21.15.77:0/3477295430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5240102b80 msgr2=0x7f5240106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 --2- 172.21.15.77:0/3477295430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5240102b80 0x7f5240106bc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5234009900 tx=0x7f523402bc30 comp rx=0 tx=0).stop 2024-04-21T10:21:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 -- 172.21.15.77:0/3477295430 shutdown_connections 2024-04-21T10:21:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 --2- 172.21.15.77:0/3477295430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5240102b80 0x7f5240106bc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 --2- 172.21.15.77:0/3477295430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52401072a0 0x7f524010ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 --2- 172.21.15.77:0/3477295430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52401021d0 0x7f52401025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 -- 172.21.15.77:0/3477295430 >> 172.21.15.77:0/3477295430 conn(0x7f52400793e0 msgr2=0x7f52400797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 -- 172.21.15.77:0/3477295430 shutdown_connections 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.820+0000 7f52465b6640 1 -- 172.21.15.77:0/3477295430 wait complete. 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 Processor -- start 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 -- start start 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52401021d0 0x7f5240198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 0x7f5240198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524019ced0 0x7f524019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5240112210 con 0x7f52401072a0 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5240112090 con 0x7f52401021d0 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f52465b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5240112390 con 0x7f524019ced0 2024-04-21T10:21:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 0x7f5240198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 0x7f5240198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37718/0 (socket says 172.21.15.77:37718) 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f523f7fe640 1 -- 172.21.15.77:0/2529070880 learned_addr learned my addr 172.21.15.77:0/2529070880 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.821+0000 7f523ffff640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52401021d0 0x7f5240198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f5244b53640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524019ced0 0x7f524019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523f7fe640 1 -- 172.21.15.77:0/2529070880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524019ced0 msgr2=0x7f524019d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523f7fe640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524019ced0 0x7f524019d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523f7fe640 1 -- 172.21.15.77:0/2529070880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52401021d0 msgr2=0x7f5240198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523f7fe640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52401021d0 0x7f5240198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523f7fe640 1 -- 172.21.15.77:0/2529070880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524019d9c0 con 0x7f52401072a0 2024-04-21T10:21:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523f7fe640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 0x7f5240198b50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5234000c00 tx=0x7f523402c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523d7fa640 1 -- 172.21.15.77:0/2529070880 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234043020 con 0x7f52401072a0 2024-04-21T10:21:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523d7fa640 1 -- 172.21.15.77:0/2529070880 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f523402cc60 con 0x7f52401072a0 2024-04-21T10:21:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524019dc50 con 0x7f52401072a0 2024-04-21T10:21:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f523d7fa640 1 -- 172.21.15.77:0/2529070880 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234003b50 con 0x7f52401072a0 2024-04-21T10:21:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.822+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52401a5470 con 0x7f52401072a0 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.824+0000 7f523d7fa640 1 -- 172.21.15.77:0/2529070880 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138822+0+0 (secure 0 0 0) 0x7f5234046020 con 0x7f52401072a0 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 Processor -- start 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 -- start start 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523d7fa640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f52280a3e60 0x7f52280a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d90620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d90fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3da08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ede3cf58d0 con 0x55ede3d90b60 2024-04-21T10:21:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f5244b53640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f52280a3e60 0x7f52280a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ede3c92e80 con 0x55ede3d9e4f0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f52491aa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ede3cf1890 con 0x55ede3d918d0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523d7fa640 1 -- 172.21.15.77:0/2529070880 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f52340f2a60 con 0x7f52401072a0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d90fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d90fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37730/0 (socket says 172.21.15.77:37730) 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523f7fe640 1 -- 172.21.15.77:0/2409983373 learned_addr learned my addr 172.21.15.77:0/2409983373 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523ffff640 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d90620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f5244b53640 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3da08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.825+0000 7f523f7fe640 1 -- 172.21.15.77:0/2409983373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 msgr2=0x55ede3d90620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f523f7fe640 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d90620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f523f7fe640 1 -- 172.21.15.77:0/2409983373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 msgr2=0x55ede3da08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f523f7fe640 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3da08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f523f7fe640 1 -- 172.21.15.77:0/2409983373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede3cb4320 con 0x55ede3d90b60 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f5244b53640 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3da08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f5244b53640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f52280a3e60 0x7f52280a6320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52380092f0 tx=0x7f5238010740 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f523f7fe640 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d90fe0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f52340be6d0 tx=0x7f5234003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcae4453b7598b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f52267fc640 1 -- 172.21.15.77:0/2409983373 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523403c350 con 0x55ede3d90b60 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f52267fc640 1 -- 172.21.15.77:0/2409983373 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52340bf0d0 con 0x55ede3d90b60 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.826+0000 7f52267fc640 1 -- 172.21.15.77:0/2409983373 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340bb040 con 0x55ede3d90b60 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- 172.21.15.77:0/2409983373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 msgr2=0x55ede3d90fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d90fe0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f52340be6d0 tx=0x7f5234003680 comp rx=0 tx=0).stop 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- 172.21.15.77:0/2409983373 shutdown_connections 2024-04-21T10:21:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d90fe0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3da08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- 172.21.15.77:0/2409983373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d90620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- 172.21.15.77:0/2409983373 >> 172.21.15.77:0/2409983373 conn(0x55ede3d57c90 msgr2=0x55ede3d8b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- 172.21.15.77:0/2409983373 shutdown_connections 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- 172.21.15.77:0/2409983373 wait complete. 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- start start 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 Processor -- start 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d9def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d9b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.827+0000 7f52491aa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ede3da0fe0 con 0x55ede3d90b60 2024-04-21T10:21:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f52491aa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ede3c7deb0 con 0x55ede3d9e4f0 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f52491aa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ede3da1160 con 0x55ede3d918d0 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f52491aa740 10 client.0 _ll_register_callbacks cb 0x55ede3caab40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d9def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d9def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37738/0 (socket says 172.21.15.77:37738) 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 -- 172.21.15.77:0/1039993516 learned_addr learned my addr 172.21.15.77:0/1039993516 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f5244b53640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523f7fe640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d9b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 -- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 msgr2=0x55ede3d9b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d9b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 -- 172.21.15.77:0/1039993516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 msgr2=0x55ede3d9b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 -- 172.21.15.77:0/1039993516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede3a08210 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f523ffff640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d9def0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5230012840 tx=0x7f5230012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3913e5cc2e58d076 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f521f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f521f7fe640 1 -- 172.21.15.77:0/1039993516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523001f060 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f521f7fe640 1 -- 172.21.15.77:0/1039993516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5230010dc0 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52340bf0d0 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f521f7fe640 1 -- 172.21.15.77:0/1039993516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5230024480 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f52491aa740 10 client.15627 fetch_fsmap learned FSMap version 24 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.828+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ede3ad4620 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f521f7fe640 1 -- 172.21.15.77:0/1039993516 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52340bf0d0 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f521f7fe640 1 -- 172.21.15.77:0/1039993516 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f52300224a0 con 0x55ede3d90b60 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f52491aa740 10 client.15627 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:21:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f52491aa740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f52491aa740 20 client.15627 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f52491aa740 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3dae260 0x55ede3db0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f52491aa740 4 client.15627 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ede3d09880 con 0x55ede3dae260 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.829+0000 7f523f7fe640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3dae260 0x55ede3db0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f523f7fe640 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3dae260 0x55ede3db0650 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f1c81c7b4a85462 server_cookie=d08c722c2708eb20 in_seq=0 out_seq=0 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f521f7fe640 10 client.15627 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f521f7fe640 1 -- 172.21.15.77:0/1039993516 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ede3d09880 con 0x55ede3dae260 2024-04-21T10:21:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f521f7fe640 10 client.15627 handle_command_reply: tid=0 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f52491aa740 1 client.15627 shutdown 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 msgr2=0x55ede3d9def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.830+0000 7f52491aa740 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d9def0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5230012840 tx=0x7f5230012d00 comp rx=0 tx=0).stop 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 shutdown_connections 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3dae260 0x55ede3db0650 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d9b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f521f7fe640 0 client.15627 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 --2- 172.21.15.77:0/1039993516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3d9def0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 >> 172.21.15.77:0/1039993516 conn(0x55ede3d57c90 msgr2=0x55ede3d8d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 shutdown_connections 2024-04-21T10:21:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 1 -- 172.21.15.77:0/1039993516 wait complete. 2024-04-21T10:21:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.831+0000 7f52491aa740 20 client.15627 trim_cache size 0 max 16384 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.845+0000 7f52491aa740 1 Processor -- start 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.845+0000 7f52491aa740 1 -- start start 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f52491aa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d90b60 0x55ede3da9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f52491aa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d918d0 0x55ede3d9d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f52491aa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f52491aa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52401ae030 con 0x55ede3d9e4f0 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f52491aa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f52401ab900 con 0x55ede3d918d0 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f52491aa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52401a9750 con 0x55ede3d90b60 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37748/0 (socket says 172.21.15.77:37748) 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 -- 172.21.15.77:0/486866339 learned_addr learned my addr 172.21.15.77:0/486866339 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 -- 172.21.15.77:0/486866339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d90b60 msgr2=0x55ede3da9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d90b60 0x55ede3da9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 -- 172.21.15.77:0/486866339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d918d0 msgr2=0x55ede3d9d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f523f7fe640 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d918d0 0x55ede3d9d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d918d0 0x55ede3d9d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 -- 172.21.15.77:0/486866339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede3d9bc00 con 0x55ede3d9e4f0 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5244b53640 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9def0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5238012830 tx=0x7f5238009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2420a45f258cc8e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5225ffb640 1 -- 172.21.15.77:0/486866339 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238024030 con 0x55ede3d9e4f0 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5225ffb640 1 -- 172.21.15.77:0/486866339 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5238011e10 con 0x55ede3d9e4f0 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.846+0000 7f5225ffb640 1 -- 172.21.15.77:0/486866339 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238020d50 con 0x55ede3d9e4f0 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 -- 172.21.15.77:0/486866339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 msgr2=0x55ede3d9def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9def0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5238012830 tx=0x7f5238009280 comp rx=0 tx=0).stop 2024-04-21T10:21:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 -- 172.21.15.77:0/486866339 shutdown_connections 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d9e4f0 0x55ede3d9def0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d918d0 0x55ede3d9d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 --2- 172.21.15.77:0/486866339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d90b60 0x55ede3da9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 -- 172.21.15.77:0/486866339 >> 172.21.15.77:0/486866339 conn(0x55ede3d57c90 msgr2=0x55ede3d8b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 -- 172.21.15.77:0/486866339 shutdown_connections 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 -- 172.21.15.77:0/486866339 wait complete. 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.847+0000 7f52491aa740 1 -- start start 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 Processor -- start 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3da64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d97af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d98030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52401a9dc0 con 0x55ede3d90b60 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f52401ab230 con 0x55ede3d9e4f0 2024-04-21T10:21:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52401aa490 con 0x55ede3d918d0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f52491aa740 10 client.0 _ll_register_callbacks cb 0x7f523000a6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3da64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3da64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37750/0 (socket says 172.21.15.77:37750) 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 -- 172.21.15.77:0/915897711 learned_addr learned my addr 172.21.15.77:0/915897711 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f5244b53640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d98030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523f7fe640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d97af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 -- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 msgr2=0x55ede3d97af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d97af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 -- 172.21.15.77:0/915897711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 msgr2=0x55ede3d98030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d98030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 -- 172.21.15.77:0/915897711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede3d986a0 con 0x55ede3d90b60 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f523ffff640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3da64f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5230015040 tx=0x7f5230010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15653bd87ce36dae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.848+0000 7f521f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:21:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f521f7fe640 1 -- 172.21.15.77:0/915897711 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52300107a0 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f521f7fe640 1 -- 172.21.15.77:0/915897711 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5230012030 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5238011e10 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f521f7fe640 1 -- 172.21.15.77:0/915897711 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f523001f020 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 10 client.15633 fetch_fsmap learned FSMap version 24 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ede3e146b0 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f521f7fe640 1 -- 172.21.15.77:0/915897711 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5238011e10 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f521f7fe640 1 -- 172.21.15.77:0/915897711 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f523002c030 con 0x55ede3d90b60 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 10 client.15633 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 20 client.15633 populate_metadata read hostname 'smithi077' 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3e14e10 0x55ede3e17230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 4 client.15633 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ede3c953d0 con 0x55ede3e14e10 2024-04-21T10:21:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.849+0000 7f523f7fe640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3e14e10 0x55ede3e17230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:21:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.850+0000 7f523f7fe640 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3e14e10 0x55ede3e17230 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff8d94755213746 server_cookie=2614f97fbdc0e08 in_seq=0 out_seq=0 2024-04-21T10:21:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.850+0000 7f521f7fe640 10 client.15633 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.903+0000 7f521f7fe640 1 -- 172.21.15.77:0/915897711 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ede3c953d0 con 0x55ede3e14e10 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.903+0000 7f521f7fe640 10 client.15633 handle_command_reply: tid=0 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.903+0000 7f52491aa740 1 client.15633 shutdown 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 msgr2=0x55ede3da64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3da64f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5230015040 tx=0x7f5230010e70 comp rx=0 tx=0).stop 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 shutdown_connections 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ede3e14e10 0x55ede3e17230 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede3d9e4f0 0x55ede3d98030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ede3d918d0 0x55ede3d97af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f521f7fe640 0 client.15633 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 --2- 172.21.15.77:0/915897711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede3d90b60 0x55ede3da64f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 >> 172.21.15.77:0/915897711 conn(0x55ede3d57c90 msgr2=0x55ede3d99b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 shutdown_connections 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 1 -- 172.21.15.77:0/915897711 wait complete. 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52491aa740 20 client.15633 trim_cache size 0 max 16384 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:21:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:21:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f52280a3e60 msgr2=0x7f52280a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52465b6640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f52280a3e60 0x7f52280a6320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52380092f0 tx=0x7f5238010740 comp rx=0 tx=0).stop 2024-04-21T10:21:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 msgr2=0x7f5240198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.904+0000 7f52465b6640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 0x7f5240198b50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5234000c00 tx=0x7f523402c860 comp rx=0 tx=0).stop 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 shutdown_connections 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f52280a3e60 0x7f52280a6320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52401072a0 0x7f5240198b50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524019ced0 0x7f524019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 --2- 172.21.15.77:0/2529070880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52401021d0 0x7f5240198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 >> 172.21.15.77:0/2529070880 conn(0x7f52400793e0 msgr2=0x7f52400ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 shutdown_connections 2024-04-21T10:21:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:21:52.905+0000 7f52465b6640 1 -- 172.21.15.77:0/2529070880 wait complete. 2024-04-21T10:21:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:53 smithi191 ceph-mon[31636]: pgmap v17: 97 pgs: 97 active+clean; 842 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 71 MiB/s wr, 373 op/s 2024-04-21T10:21:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:53 smithi170 ceph-mon[31212]: pgmap v17: 97 pgs: 97 active+clean; 842 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 71 MiB/s wr, 373 op/s 2024-04-21T10:21:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:53 smithi077 ceph-mon[27902]: pgmap v17: 97 pgs: 97 active+clean; 842 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 71 MiB/s wr, 373 op/s 2024-04-21T10:21:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:21:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:55 smithi191 ceph-mon[31636]: pgmap v18: 97 pgs: 97 active+clean; 842 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 62 MiB/s wr, 256 op/s 2024-04-21T10:21:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:55 smithi170 ceph-mon[31212]: pgmap v18: 97 pgs: 97 active+clean; 842 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 62 MiB/s wr, 256 op/s 2024-04-21T10:21:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:55 smithi077 ceph-mon[27902]: pgmap v18: 97 pgs: 97 active+clean; 842 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 62 MiB/s wr, 256 op/s 2024-04-21T10:21:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:57 smithi191 ceph-mon[31636]: pgmap v19: 97 pgs: 97 active+clean; 838 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 62 MiB/s wr, 279 op/s 2024-04-21T10:21:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:57 smithi170 ceph-mon[31212]: pgmap v19: 97 pgs: 97 active+clean; 838 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 62 MiB/s wr, 279 op/s 2024-04-21T10:21:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:57 smithi077 ceph-mon[27902]: pgmap v19: 97 pgs: 97 active+clean; 838 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 62 MiB/s wr, 279 op/s 2024-04-21T10:21:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:21:59 smithi191 ceph-mon[31636]: pgmap v20: 97 pgs: 97 active+clean; 838 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-04-21T10:21:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:21:59 smithi170 ceph-mon[31212]: pgmap v20: 97 pgs: 97 active+clean; 838 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-04-21T10:21:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:21:59 smithi077 ceph-mon[27902]: pgmap v20: 97 pgs: 97 active+clean; 838 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-04-21T10:22:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:00.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:22:00 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:22:00.566+0000 7f0660d48700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:22:00.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:22:00 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:22:00.566+0000 7f0660d48700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:22:00.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:22:00 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:22:00.566+0000 7f0660d48700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:22:00.885 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:22:00 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:22:00.566+0000 7f0660d48700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:22:00.886 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Apr 21 10:22:00 smithi077 ceph-41617fb2-ffc7-11ee-bc93-c7b262605968-mgr-x[28136]: 2024-04-21T10:22:00.566+0000 7f0660d48700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T10:22:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:01 smithi191 ceph-mon[31636]: pgmap v21: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 3.4 MiB/s wr, 242 op/s 2024-04-21T10:22:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:01 smithi170 ceph-mon[31212]: pgmap v21: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 3.4 MiB/s wr, 242 op/s 2024-04-21T10:22:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:01 smithi077 ceph-mon[27902]: pgmap v21: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 3.4 MiB/s wr, 242 op/s 2024-04-21T10:22:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:03 smithi191 ceph-mon[31636]: pgmap v22: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 797 KiB/s wr, 112 op/s 2024-04-21T10:22:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:03 smithi191 ceph-mon[31636]: mgrmap e25: x(active, since 38s), standbys: y, z 2024-04-21T10:22:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:03 smithi170 ceph-mon[31212]: pgmap v22: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 797 KiB/s wr, 112 op/s 2024-04-21T10:22:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:03 smithi170 ceph-mon[31212]: mgrmap e25: x(active, since 38s), standbys: y, z 2024-04-21T10:22:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:03 smithi077 ceph-mon[27902]: pgmap v22: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 797 KiB/s wr, 112 op/s 2024-04-21T10:22:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:03 smithi077 ceph-mon[27902]: mgrmap e25: x(active, since 38s), standbys: y, z 2024-04-21T10:22:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:05 smithi170 ceph-mon[31212]: pgmap v23: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-04-21T10:22:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:05 smithi077 ceph-mon[27902]: pgmap v23: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-04-21T10:22:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:05 smithi191 ceph-mon[31636]: pgmap v23: 97 pgs: 97 active+clean; 838 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-04-21T10:22:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 -- 172.21.15.77:0/2393626908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac1010f0 msgr2=0x7f67ac1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 --2- 172.21.15.77:0/2393626908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac1010f0 0x7f67ac1014d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009900 tx=0x7f67a802bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 -- 172.21.15.77:0/2393626908 shutdown_connections 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 --2- 172.21.15.77:0/2393626908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67ac106170 0x7f67ac10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 --2- 172.21.15.77:0/2393626908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac101aa0 0x7f67ac105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 --2- 172.21.15.77:0/2393626908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac1010f0 0x7f67ac1014d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 -- 172.21.15.77:0/2393626908 >> 172.21.15.77:0/2393626908 conn(0x7f67ac077fd0 msgr2=0x7f67ac0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 -- 172.21.15.77:0/2393626908 shutdown_connections 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.000+0000 7f67b3c43640 1 -- 172.21.15.77:0/2393626908 wait complete. 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 Processor -- start 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 -- start start 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 0x7f67ac1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 0x7f67ac198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67ac19cf20 0x7f67ac19d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac112240 con 0x7f67ac106170 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1120c0 con 0x7f67ac1010f0 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b3c43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1123c0 con 0x7f67ac19cf20 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b11de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 0x7f67ac198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.001+0000 7f67b19df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 0x7f67ac1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b19df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 0x7f67ac1986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:46956/0 (socket says 172.21.15.77:46956) 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b19df640 1 -- 172.21.15.77:0/384579910 learned_addr learned my addr 172.21.15.77:0/384579910 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b21e0640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67ac19cf20 0x7f67ac19d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 0x7f67ac198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41366/0 (socket says 172.21.15.77:41366) 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 -- 172.21.15.77:0/384579910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67ac19cf20 msgr2=0x7f67ac19d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67ac19cf20 0x7f67ac19d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 -- 172.21.15.77:0/384579910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 msgr2=0x7f67ac1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 0x7f67ac1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 -- 172.21.15.77:0/384579910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac19da10 con 0x7f67ac106170 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b19df640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 0x7f67ac1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b11de640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 0x7f67ac198bf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f679c00d6a0 tx=0x7f679c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67a2ffd640 1 -- 172.21.15.77:0/384579910 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c017070 con 0x7f67ac106170 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67a2ffd640 1 -- 172.21.15.77:0/384579910 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f679c009820 con 0x7f67ac106170 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67a2ffd640 1 -- 172.21.15.77:0/384579910 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c004c40 con 0x7f67ac106170 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac19dd00 con 0x7f67ac106170 2024-04-21T10:22:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.002+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac1a5540 con 0x7f67ac106170 2024-04-21T10:22:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.004+0000 7f67a2ffd640 1 -- 172.21.15.77:0/384579910 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7f679c005220 con 0x7f67ac106170 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.005+0000 7f67b6833740 1 Processor -- start 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.005+0000 7f67b6833740 1 -- start start 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.005+0000 7f67a2ffd640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f67980a3f60 0x7f67980a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.005+0000 7f67b6833740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0588620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.005+0000 7f67b6833740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf0588b60 0x564cf0588fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.005+0000 7f67b6833740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf05944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b6833740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564cf04ed8d0 con 0x564cf05920e0 2024-04-21T10:22:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b6833740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564cf048ae80 con 0x564cf05898d0 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b6833740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564cf04e9890 con 0x564cf0588b60 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b21e0640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f67980a3f60 0x7f67980a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0588620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67a2ffd640 1 -- 172.21.15.77:0/384579910 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f679c0d0280 con 0x7f67ac106170 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0588620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:46960/0 (socket says 172.21.15.77:46960) 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b21e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf05944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 -- 172.21.15.77:0/2862041701 learned_addr learned my addr 172.21.15.77:0/2862041701 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b11de640 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf0588b60 0x564cf0588fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 -- 172.21.15.77:0/2862041701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf0588b60 msgr2=0x564cf0588fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf0588b60 0x564cf0588fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 -- 172.21.15.77:0/2862041701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 msgr2=0x564cf05944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf05944d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 -- 172.21.15.77:0/2862041701 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf04ac320 con 0x564cf05898d0 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b21e0640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f67980a3f60 0x7f67980a6420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67a4007fd0 tx=0x7f67a4007d40 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.006+0000 7f67b19df640 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0588620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67a8036040 tx=0x7f67a8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2176beeaf005d4e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f6797fff640 1 -- 172.21.15.77:0/2862041701 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8045070 con 0x564cf05898d0 2024-04-21T10:22:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f6797fff640 1 -- 172.21.15.77:0/2862041701 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a802cc90 con 0x564cf05898d0 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f6797fff640 1 -- 172.21.15.77:0/2862041701 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8003cb0 con 0x564cf05898d0 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 -- 172.21.15.77:0/2862041701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 msgr2=0x564cf0588620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0588620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67a8036040 tx=0x7f67a8004040 comp rx=0 tx=0).stop 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 -- 172.21.15.77:0/2862041701 shutdown_connections 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf05944d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf0588b60 0x564cf0588fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 --2- 172.21.15.77:0/2862041701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0588620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.007+0000 7f67b6833740 1 -- 172.21.15.77:0/2862041701 >> 172.21.15.77:0/2862041701 conn(0x564cf054fc90 msgr2=0x564cf0583850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 -- 172.21.15.77:0/2862041701 shutdown_connections 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 -- 172.21.15.77:0/2862041701 wait complete. 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 -- start start 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 Processor -- start 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf0591a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf058edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05920e0 0x564cf058f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564cf0594db0 con 0x564cf0588b60 2024-04-21T10:22:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564cf0475eb0 con 0x564cf05920e0 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.008+0000 7f67b6833740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564cf0594f30 con 0x564cf05898d0 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b6833740 10 client.0 _ll_register_callbacks cb 0x564cf04a2b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf0591a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf0591a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41380/0 (socket says 172.21.15.77:41380) 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 -- 172.21.15.77:0/1234552655 learned_addr learned my addr 172.21.15.77:0/1234552655 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b21e0640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05920e0 0x564cf058f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b11de640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf058edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 -- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 msgr2=0x564cf058edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf058edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 -- 172.21.15.77:0/1234552655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05920e0 msgr2=0x564cf058f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05920e0 0x564cf058f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 -- 172.21.15.77:0/1234552655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf0200210 con 0x564cf0588b60 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b19df640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf0591a30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a8005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a04b6a72f11852 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67957fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67957fa640 1 -- 172.21.15.77:0/1234552655 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8045040 con 0x564cf0588b60 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67957fa640 1 -- 172.21.15.77:0/1234552655 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f67a8003bf0 con 0x564cf0588b60 2024-04-21T10:22:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a802cc90 con 0x564cf0588b60 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67957fa640 1 -- 172.21.15.77:0/1234552655 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67a805b050 con 0x564cf0588b60 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b6833740 10 client.15651 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.009+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564cf02cc620 con 0x564cf0588b60 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67957fa640 1 -- 172.21.15.77:0/1234552655 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a802cc90 con 0x564cf0588b60 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67957fa640 1 -- 172.21.15.77:0/1234552655 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f67a803f440 con 0x564cf0588b60 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b6833740 10 client.15651 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b6833740 10 client.15651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b6833740 20 client.15651 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b6833740 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf05a1ee0 0x564cf05a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b6833740 4 client.15651 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cf0501880 con 0x564cf05a1ee0 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.010+0000 7f67b11de640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf05a1ee0 0x564cf05a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.011+0000 7f67957fa640 10 client.15651 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.011+0000 7f67b11de640 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf05a1ee0 0x564cf05a42d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b04685568aa09082 server_cookie=7bb013ca5b081f27 in_seq=0 out_seq=0 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.011+0000 7f67957fa640 1 -- 172.21.15.77:0/1234552655 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564cf0501880 con 0x564cf05a1ee0 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.011+0000 7f67957fa640 10 client.15651 handle_command_reply: tid=0 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.011+0000 7f67b6833740 1 client.15651 shutdown 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 msgr2=0x564cf0591a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf0591a30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a8005e20 comp rx=0 tx=0).stop 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 shutdown_connections 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf05a1ee0 0x564cf05a42d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05920e0 0x564cf058f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf058edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 --2- 172.21.15.77:0/1234552655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf0591a30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67957fa640 0 client.15651 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 >> 172.21.15.77:0/1234552655 conn(0x564cf054fc90 msgr2=0x564cf05855a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 shutdown_connections 2024-04-21T10:22:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 1 -- 172.21.15.77:0/1234552655 wait complete. 2024-04-21T10:22:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.012+0000 7f67b6833740 20 client.15651 trim_cache size 0 max 16384 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.026+0000 7f67b6833740 1 Processor -- start 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 -- start start 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf0588b60 0x564cf059dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf05914f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf0591a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1b0210 con 0x564cf05920e0 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1adae0 con 0x564cf0588b60 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b6833740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1ab930 con 0x564cf05898d0 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf0591a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf0591a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41392/0 (socket says 172.21.15.77:41392) 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 -- 172.21.15.77:0/3401118523 learned_addr learned my addr 172.21.15.77:0/3401118523 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b11de640 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf05914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b19df640 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf0588b60 0x564cf059dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 -- 172.21.15.77:0/3401118523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 msgr2=0x564cf05914f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf05914f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 -- 172.21.15.77:0/3401118523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf0588b60 msgr2=0x564cf059dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf0588b60 0x564cf059dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 -- 172.21.15.77:0/3401118523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf0588990 con 0x564cf05920e0 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67b21e0640 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf0591a30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f67a4015010 tx=0x7f67a4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dc1d2aa88dd9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.027+0000 7f67977fe640 1 -- 172.21.15.77:0/3401118523 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4004d20 con 0x564cf05920e0 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67977fe640 1 -- 172.21.15.77:0/3401118523 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a4012e00 con 0x564cf05920e0 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67977fe640 1 -- 172.21.15.77:0/3401118523 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a40057d0 con 0x564cf05920e0 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 -- 172.21.15.77:0/3401118523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 msgr2=0x564cf0591a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf0591a30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f67a4015010 tx=0x7f67a4004ab0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 -- 172.21.15.77:0/3401118523 shutdown_connections 2024-04-21T10:22:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf05920e0 0x564cf0591a30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05898d0 0x564cf05914f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 --2- 172.21.15.77:0/3401118523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf0588b60 0x564cf059dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 -- 172.21.15.77:0/3401118523 >> 172.21.15.77:0/3401118523 conn(0x564cf054fc90 msgr2=0x564cf058d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 -- 172.21.15.77:0/3401118523 shutdown_connections 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 -- 172.21.15.77:0/3401118523 wait complete. 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 -- start start 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.028+0000 7f67b6833740 1 Processor -- start 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf059a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0595760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05920e0 0x564cf0595ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1abfa0 con 0x564cf0588b60 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1ad410 con 0x564cf05898d0 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1ac670 con 0x564cf05920e0 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b6833740 10 client.0 _ll_register_callbacks cb 0x7f67a40146b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf059a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf059a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41406/0 (socket says 172.21.15.77:41406) 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 -- 172.21.15.77:0/2422564625 learned_addr learned my addr 172.21.15.77:0/2422564625 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b21e0640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05920e0 0x564cf0595ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b11de640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0595760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 -- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05920e0 msgr2=0x564cf0595ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05920e0 0x564cf0595ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 -- 172.21.15.77:0/2422564625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 msgr2=0x564cf0595760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0595760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 -- 172.21.15.77:0/2422564625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf0596290 con 0x564cf0588b60 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b21e0640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05920e0 0x564cf0595ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67b19df640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf059a3d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f67a803f8e0 tx=0x7f67a8004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c456b9732220c22 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67957fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.029+0000 7f67957fa640 1 -- 172.21.15.77:0/2422564625 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8045040 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67957fa640 1 -- 172.21.15.77:0/2422564625 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f67a80038c0 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a4012e00 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67957fa640 1 -- 172.21.15.77:0/2422564625 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67a803f650 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 10 client.15657 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564cf0607fe0 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67957fa640 1 -- 172.21.15.77:0/2422564625 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a4012e00 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67957fa640 1 -- 172.21.15.77:0/2422564625 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f67a804a6b0 con 0x564cf0588b60 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 10 client.15657 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 20 client.15657 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf0608780 0x564cf060aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 4 client.15657 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564cf048d3d0 con 0x564cf0608780 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.030+0000 7f67b11de640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf0608780 0x564cf060aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:06.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.031+0000 7f67b11de640 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf0608780 0x564cf060aba0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96432e92d043152b server_cookie=a8f1061c2bced2a in_seq=0 out_seq=0 2024-04-21T10:22:06.036 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.031+0000 7f67957fa640 10 client.15657 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67957fa640 1 -- 172.21.15.77:0/2422564625 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564cf048d3d0 con 0x564cf0608780 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67957fa640 10 client.15657 handle_command_reply: tid=0 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 client.15657 shutdown 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 msgr2=0x564cf059a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf059a3d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f67a803f8e0 tx=0x7f67a8004540 comp rx=0 tx=0).stop 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 shutdown_connections 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cf0608780 0x564cf060aba0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67957fa640 0 client.15657 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cf05920e0 0x564cf0595ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.047+0000 7f67b6833740 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cf05898d0 0x564cf0595760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b6833740 1 --2- 172.21.15.77:0/2422564625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cf0588b60 0x564cf059a3d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 >> 172.21.15.77:0/2422564625 conn(0x564cf054fc90 msgr2=0x564cf0582040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 shutdown_connections 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b6833740 1 -- 172.21.15.77:0/2422564625 wait complete. 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b6833740 20 client.15657 trim_cache size 0 max 16384 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:22:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:22:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f67980a3f60 msgr2=0x7f67980a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f67980a3f60 0x7f67980a6420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67a4007fd0 tx=0x7f67a4007d40 comp rx=0 tx=0).stop 2024-04-21T10:22:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 msgr2=0x7f67ac198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 0x7f67ac198bf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f679c00d6a0 tx=0x7f679c00db60 comp rx=0 tx=0).stop 2024-04-21T10:22:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 shutdown_connections 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f67980a3f60 0x7f67980a6420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67ac106170 0x7f67ac198bf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67ac19cf20 0x7f67ac19d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 --2- 172.21.15.77:0/384579910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67ac1010f0 0x7f67ac1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 >> 172.21.15.77:0/384579910 conn(0x7f67ac077fd0 msgr2=0x7f67ac0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 shutdown_connections 2024-04-21T10:22:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:06.048+0000 7f67b3c43640 1 -- 172.21.15.77:0/384579910 wait complete. 2024-04-21T10:22:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:07 smithi170 ceph-mon[31212]: pgmap v24: 97 pgs: 97 active+clean; 838 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 44 op/s 2024-04-21T10:22:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:07 smithi077 ceph-mon[27902]: pgmap v24: 97 pgs: 97 active+clean; 838 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 44 op/s 2024-04-21T10:22:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:07 smithi191 ceph-mon[31636]: pgmap v24: 97 pgs: 97 active+clean; 838 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 44 op/s 2024-04-21T10:22:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:09 smithi170 ceph-mon[31212]: pgmap v25: 97 pgs: 97 active+clean; 838 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-04-21T10:22:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:09 smithi077 ceph-mon[27902]: pgmap v25: 97 pgs: 97 active+clean; 838 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-04-21T10:22:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:09 smithi191 ceph-mon[31636]: pgmap v25: 97 pgs: 97 active+clean; 838 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-04-21T10:22:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:11 smithi170 ceph-mon[31212]: pgmap v26: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-04-21T10:22:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:11 smithi077 ceph-mon[27902]: pgmap v26: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-04-21T10:22:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:11 smithi191 ceph-mon[31636]: pgmap v26: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-04-21T10:22:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:13 smithi170 ceph-mon[31212]: pgmap v27: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-04-21T10:22:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:13 smithi077 ceph-mon[27902]: pgmap v27: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-04-21T10:22:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:13 smithi191 ceph-mon[31636]: pgmap v27: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-04-21T10:22:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:15 smithi170 ceph-mon[31212]: pgmap v28: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 26 op/s 2024-04-21T10:22:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:15 smithi077 ceph-mon[27902]: pgmap v28: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 26 op/s 2024-04-21T10:22:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:15 smithi191 ceph-mon[31636]: pgmap v28: 97 pgs: 97 active+clean; 838 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 26 op/s 2024-04-21T10:22:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:17 smithi170 ceph-mon[31212]: pgmap v29: 97 pgs: 97 active+clean; 877 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 49 op/s 2024-04-21T10:22:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:17 smithi077 ceph-mon[27902]: pgmap v29: 97 pgs: 97 active+clean; 877 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 49 op/s 2024-04-21T10:22:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:17 smithi191 ceph-mon[31636]: pgmap v29: 97 pgs: 97 active+clean; 877 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 49 op/s 2024-04-21T10:22:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 -- 172.21.15.77:0/1670997511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d4101b60 msgr2=0x7f76d410dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 --2- 172.21.15.77:0/1670997511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d4101b60 0x7f76d410dc70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009ca0 tx=0x7f76cc02c140 comp rx=0 tx=0).stop 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 -- 172.21.15.77:0/1670997511 shutdown_connections 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 --2- 172.21.15.77:0/1670997511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d4101b60 0x7f76d410dc70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 --2- 172.21.15.77:0/1670997511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d41011a0 0x7f76d4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 --2- 172.21.15.77:0/1670997511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4106fb0 0x7f76d4107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 -- 172.21.15.77:0/1670997511 >> 172.21.15.77:0/1670997511 conn(0x7f76d4076c50 msgr2=0x7f76d4077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 -- 172.21.15.77:0/1670997511 shutdown_connections 2024-04-21T10:22:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.139+0000 7f76d8c81640 1 -- 172.21.15.77:0/1670997511 wait complete. 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 Processor -- start 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 -- start start 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 0x7f76d4198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4101b60 0x7f76d4198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d4106fb0 0x7f76d419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4112200 con 0x7f76d41011a0 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4112080 con 0x7f76d4101b60 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d8c81640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4112380 con 0x7f76d4106fb0 2024-04-21T10:22:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 0x7f76d4198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 0x7f76d4198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52324/0 (socket says 172.21.15.77:52324) 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d259c640 1 -- 172.21.15.77:0/852586076 learned_addr learned my addr 172.21.15.77:0/852586076 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76cbfff640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4101b60 0x7f76d4198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.140+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d4106fb0 0x7f76d419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d259c640 1 -- 172.21.15.77:0/852586076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d4106fb0 msgr2=0x7f76d419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d259c640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d4106fb0 0x7f76d419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d259c640 1 -- 172.21.15.77:0/852586076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4101b60 msgr2=0x7f76d4198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d259c640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4101b60 0x7f76d4198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d259c640 1 -- 172.21.15.77:0/852586076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d419d5f0 con 0x7f76d41011a0 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d259c640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 0x7f76d4198600 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76c400b4a0 tx=0x7f76c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76cb7fe640 1 -- 172.21.15.77:0/852586076 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4014070 con 0x7f76d41011a0 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d419d8e0 con 0x7f76d41011a0 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76cb7fe640 1 -- 172.21.15.77:0/852586076 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c4010ac0 con 0x7f76d41011a0 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76cb7fe640 1 -- 172.21.15.77:0/852586076 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4017c30 con 0x7f76d41011a0 2024-04-21T10:22:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.141+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41a51f0 con 0x7f76d41011a0 2024-04-21T10:22:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.143+0000 7f76cb7fe640 1 -- 172.21.15.77:0/852586076 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x7f76d41011a0 2024-04-21T10:22:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 Processor -- start 2024-04-21T10:22:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 -- start start 2024-04-21T10:22:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b06f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56116afd48d0 con 0x56116b0790e0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56116af71e80 con 0x56116b0708d0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76db87c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56116afd0890 con 0x56116b06fb60 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cb7fe640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f76c00a3ee0 0x7f76c00a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b07b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52328/0 (socket says 172.21.15.77:52328) 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 -- 172.21.15.77:0/3419404970 learned_addr learned my addr 172.21.15.77:0/3419404970 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76d259c640 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f76c00a3ee0 0x7f76c00a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cb7fe640 1 -- 172.21.15.77:0/852586076 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f76c40cffc0 con 0x7f76d41011a0 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 -- 172.21.15.77:0/3419404970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 msgr2=0x56116b06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b06ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 -- 172.21.15.77:0/3419404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 msgr2=0x56116b06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.144+0000 7f76cbfff640 1 -- 172.21.15.77:0/3419404970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56116af93320 con 0x56116b0790e0 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.145+0000 7f76cbfff640 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b07b4d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00b740 tx=0x7f76bc00bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdad4a7b013d2e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.145+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f76c00a3ee0 0x7f76c00a63a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76cc004af0 tx=0x7f76cc005c50 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.145+0000 7f76c8ff9640 1 -- 172.21.15.77:0/3419404970 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc003dd0 con 0x56116b0790e0 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.145+0000 7f76c8ff9640 1 -- 172.21.15.77:0/3419404970 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76bc015070 con 0x56116b0790e0 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.145+0000 7f76c8ff9640 1 -- 172.21.15.77:0/3419404970 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc004d30 con 0x56116b0790e0 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- 172.21.15.77:0/3419404970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 msgr2=0x56116b07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b07b4d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00b740 tx=0x7f76bc00bc00 comp rx=0 tx=0).stop 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- 172.21.15.77:0/3419404970 shutdown_connections 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b07b4d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b06ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- 172.21.15.77:0/3419404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- 172.21.15.77:0/3419404970 >> 172.21.15.77:0/3419404970 conn(0x56116b036c90 msgr2=0x56116b06a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- 172.21.15.77:0/3419404970 shutdown_connections 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- 172.21.15.77:0/3419404970 wait complete. 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- start start 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 Processor -- start 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b0789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b075da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b0762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56116b07be10 con 0x56116b0790e0 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56116af5ceb0 con 0x56116b0708d0 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56116b07bf90 con 0x56116b06fb60 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76db87c740 10 client.0 _ll_register_callbacks cb 0x56116af89b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76d2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b0762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76d2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b0762e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52336/0 (socket says 172.21.15.77:52336) 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76d2d9d640 1 -- 172.21.15.77:0/2291653943 learned_addr learned my addr 172.21.15.77:0/2291653943 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76cbfff640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.146+0000 7f76d259c640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b0789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76d2d9d640 1 -- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 msgr2=0x56116b0789a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b0789a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76d2d9d640 1 -- 172.21.15.77:0/2291653943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 msgr2=0x56116b075da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b075da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76d2d9d640 1 -- 172.21.15.77:0/2291653943 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56116ace7210 con 0x56116b0790e0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b0762e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009ca0 tx=0x7f76cc02c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3a51b72caf51c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76b9ffb640 1 -- 172.21.15.77:0/2291653943 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc054060 con 0x56116b0790e0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76b9ffb640 1 -- 172.21.15.77:0/2291653943 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f76cc004310 con 0x56116b0790e0 2024-04-21T10:22:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76bc015070 con 0x56116b0790e0 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76b9ffb640 1 -- 172.21.15.77:0/2291653943 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f76cc039040 con 0x56116b0790e0 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76db87c740 10 client.15669 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56116adb3620 con 0x56116b0790e0 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76b9ffb640 1 -- 172.21.15.77:0/2291653943 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76bc015070 con 0x56116b0790e0 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.147+0000 7f76b9ffb640 1 -- 172.21.15.77:0/2291653943 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f76cc04fbd0 con 0x56116b0790e0 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76db87c740 10 client.15669 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76db87c740 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76db87c740 20 client.15669 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76db87c740 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b089120 0x56116b08b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76db87c740 4 client.15669 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56116afe8880 con 0x56116b089120 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76d259c640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b089120 0x56116b08b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76b9ffb640 10 client.15669 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.148+0000 7f76d259c640 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b089120 0x56116b08b560 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b80277fc74c6a0 server_cookie=d04f2e20bb815d0e in_seq=0 out_seq=0 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76b9ffb640 1 -- 172.21.15.77:0/2291653943 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56116afe8880 con 0x56116b089120 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76b9ffb640 10 client.15669 handle_command_reply: tid=0 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 client.15669 shutdown 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 msgr2=0x56116b0762e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b0762e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009ca0 tx=0x7f76cc02c140 comp rx=0 tx=0).stop 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 shutdown_connections 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b089120 0x56116b08b560 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b0790e0 0x56116b0762e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b075da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 --2- 172.21.15.77:0/2291653943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b06fb60 0x56116b0789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76b9ffb640 0 client.15669 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 >> 172.21.15.77:0/2291653943 conn(0x56116b036c90 msgr2=0x56116b06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 shutdown_connections 2024-04-21T10:22:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 1 -- 172.21.15.77:0/2291653943 wait complete. 2024-04-21T10:22:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.149+0000 7f76db87c740 20 client.15669 trim_cache size 0 max 16384 2024-04-21T10:22:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 Processor -- start 2024-04-21T10:22:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 -- start start 2024-04-21T10:22:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b036c90 0x56116b084d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b075680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b065760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41b0380 con 0x56116b06fb60 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41adc50 con 0x56116b0708d0 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76db87c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41abaa0 con 0x56116b036c90 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52350/0 (socket says 172.21.15.77:52350) 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 -- 172.21.15.77:0/3588007220 learned_addr learned my addr 172.21.15.77:0/3588007220 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76d259c640 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b036c90 0x56116b084d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b065760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 -- 172.21.15.77:0/3588007220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b036c90 msgr2=0x56116b084d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b036c90 0x56116b084d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 -- 172.21.15.77:0/3588007220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 msgr2=0x56116b065760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b065760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 -- 172.21.15.77:0/3588007220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56116b065f30 con 0x56116b06fb60 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b065760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76cbfff640 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b075680 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0039c0 tx=0x7f76bc005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb64b50393c0e11a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.164+0000 7f76bbfff640 1 -- 172.21.15.77:0/3588007220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00be50 con 0x56116b06fb60 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76bbfff640 1 -- 172.21.15.77:0/3588007220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76bc029070 con 0x56116b06fb60 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76bbfff640 1 -- 172.21.15.77:0/3588007220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc024e20 con 0x56116b06fb60 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 -- 172.21.15.77:0/3588007220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 msgr2=0x56116b075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b075680 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0039c0 tx=0x7f76bc005cb0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 -- 172.21.15.77:0/3588007220 shutdown_connections 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b075680 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b0708d0 0x56116b065760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 --2- 172.21.15.77:0/3588007220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b036c90 0x56116b084d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 -- 172.21.15.77:0/3588007220 >> 172.21.15.77:0/3588007220 conn(0x56116b076440 msgr2=0x56116b0774c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 -- 172.21.15.77:0/3588007220 shutdown_connections 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 -- 172.21.15.77:0/3588007220 wait complete. 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 -- start start 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.165+0000 7f76db87c740 1 Processor -- start 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b036c90 0x56116b072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b0708d0 0x56116b073750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41ac110 con 0x56116b06fb60 2024-04-21T10:22:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41ad580 con 0x56116b036c90 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41ac7e0 con 0x56116b0708d0 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 10 client.0 _ll_register_callbacks cb 0x7f76cc0324f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52362/0 (socket says 172.21.15.77:52362) 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 -- 172.21.15.77:0/369636990 learned_addr learned my addr 172.21.15.77:0/369636990 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76d2d9d640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b0708d0 0x56116b073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76d259c640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b036c90 0x56116b072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 -- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b0708d0 msgr2=0x56116b073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b0708d0 0x56116b073750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 -- 172.21.15.77:0/369636990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b036c90 msgr2=0x56116b072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b036c90 0x56116b072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 -- 172.21.15.77:0/369636990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56116b0ee980 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76cbfff640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b073210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00b3f0 tx=0x7f76bc005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5697bbaf2ce86ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76b9ffb640 1 -- 172.21.15.77:0/369636990 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc032070 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76b9ffb640 1 -- 172.21.15.77:0/369636990 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f76bc024b60 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76bc029070 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76b9ffb640 1 -- 172.21.15.77:0/369636990 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f76bc03e050 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 10 client.15675 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.166+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56116b0efbe0 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76b9ffb640 1 -- 172.21.15.77:0/369636990 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76bc029070 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76b9ffb640 1 -- 172.21.15.77:0/369636990 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f76bc037740 con 0x56116b06fb60 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76db87c740 10 client.15675 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76db87c740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76db87c740 20 client.15675 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76db87c740 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b0790e0 0x56116b0f2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76db87c740 4 client.15675 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:22:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56116af743d0 con 0x56116b0790e0 2024-04-21T10:22:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76d259c640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b0790e0 0x56116b0f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76b9ffb640 10 client.15675 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.167+0000 7f76d259c640 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b0790e0 0x56116b0f2100 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ac613b5798fc71 server_cookie=70541ce3031a3e15 in_seq=0 out_seq=0 2024-04-21T10:22:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76b9ffb640 1 -- 172.21.15.77:0/369636990 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56116af743d0 con 0x56116b0790e0 2024-04-21T10:22:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76b9ffb640 10 client.15675 handle_command_reply: tid=0 2024-04-21T10:22:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 client.15675 shutdown 2024-04-21T10:22:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 msgr2=0x56116b073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b073210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00b3f0 tx=0x7f76bc005d20 comp rx=0 tx=0).stop 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 shutdown_connections 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56116b0790e0 0x56116b0f2100 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56116b06fb60 0x56116b073210 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76b9ffb640 0 client.15675 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56116b0708d0 0x56116b073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 --2- 172.21.15.77:0/369636990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56116b036c90 0x56116b072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 >> 172.21.15.77:0/369636990 conn(0x56116b076440 msgr2=0x56116b0698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 shutdown_connections 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 1 -- 172.21.15.77:0/369636990 wait complete. 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.183+0000 7f76db87c740 20 client.15675 trim_cache size 0 max 16384 2024-04-21T10:22:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:22:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:22:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:22:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:22:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f76c00a3ee0 msgr2=0x7f76c00a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f76c00a3ee0 0x7f76c00a63a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76cc004af0 tx=0x7f76cc005c50 comp rx=0 tx=0).stop 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 msgr2=0x7f76d4198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 0x7f76d4198600 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76c400b4a0 tx=0x7f76c400b960 comp rx=0 tx=0).stop 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 shutdown_connections 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f76c00a3ee0 0x7f76c00a63a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d4106fb0 0x7f76d419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4101b60 0x7f76d4198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 --2- 172.21.15.77:0/852586076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d41011a0 0x7f76d4198600 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 >> 172.21.15.77:0/852586076 conn(0x7f76d4076c50 msgr2=0x7f76d40ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 shutdown_connections 2024-04-21T10:22:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:19.184+0000 7f76d8c81640 1 -- 172.21.15.77:0/852586076 wait complete. 2024-04-21T10:22:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:19 smithi170 ceph-mon[31212]: pgmap v30: 97 pgs: 97 active+clean; 877 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 31 op/s 2024-04-21T10:22:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:19 smithi077 ceph-mon[27902]: pgmap v30: 97 pgs: 97 active+clean; 877 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 31 op/s 2024-04-21T10:22:19.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:22:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:19 smithi191 ceph-mon[31636]: pgmap v30: 97 pgs: 97 active+clean; 877 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 31 op/s 2024-04-21T10:22:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 -- 172.21.15.77:0/3895007049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 msgr2=0x7fa740069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 --2- 172.21.15.77:0/3895007049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa740069560 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa734009930 tx=0x7fa73402bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 -- 172.21.15.77:0/3895007049 shutdown_connections 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 --2- 172.21.15.77:0/3895007049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa740069560 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 --2- 172.21.15.77:0/3895007049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 0x7fa74010ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 --2- 172.21.15.77:0/3895007049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa740107fd0 0x7fa7401083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 -- 172.21.15.77:0/3895007049 >> 172.21.15.77:0/3895007049 conn(0x7fa740077e30 msgr2=0x7fa740078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 -- 172.21.15.77:0/3895007049 shutdown_connections 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.817+0000 7fa74574b640 1 -- 172.21.15.77:0/3895007049 wait complete. 2024-04-21T10:22:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 Processor -- start 2024-04-21T10:22:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 -- start start 2024-04-21T10:22:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa7401986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 0x7fa740198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa740107fd0 0x7fa74019cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa740112140 con 0x7fa7400690e0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa740111fc0 con 0x7fa740069aa0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa74574b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa7401122c0 con 0x7fa740107fd0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa73effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa7401986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa73effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa7401986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52378/0 (socket says 172.21.15.77:52378) 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.818+0000 7fa73effd640 1 -- 172.21.15.77:0/1725393134 learned_addr learned my addr 172.21.15.77:0/1725393134 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73f7fe640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa740107fd0 0x7fa74019cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73e7fc640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 0x7fa740198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73effd640 1 -- 172.21.15.77:0/1725393134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa740107fd0 msgr2=0x7fa74019cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73effd640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa740107fd0 0x7fa74019cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73effd640 1 -- 172.21.15.77:0/1725393134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 msgr2=0x7fa740198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73effd640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 0x7fa740198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73effd640 1 -- 172.21.15.77:0/1725393134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74019d6d0 con 0x7fa7400690e0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73e7fc640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 0x7fa740198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa73effd640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa7401986e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa73000d770 tx=0x7fa73000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730017070 con 0x7fa7400690e0 2024-04-21T10:22:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7300054d0 con 0x7fa7400690e0 2024-04-21T10:22:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74019d9c0 con 0x7fa7400690e0 2024-04-21T10:22:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730004c30 con 0x7fa7400690e0 2024-04-21T10:22:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.819+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7401a5250 con 0x7fa7400690e0 2024-04-21T10:22:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.820+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa740068de0 con 0x7fa7400690e0 2024-04-21T10:22:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.821+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7fa730004e10 con 0x7fa7400690e0 2024-04-21T10:22:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.822+0000 7fa727fff640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7280a3e40 0x7fa7280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.822+0000 7fa73e7fc640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7280a3e40 0x7fa7280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.822+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa7300d0600 con 0x7fa7400690e0 2024-04-21T10:22:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.822+0000 7fa73e7fc640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7280a3e40 0x7fa7280a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa734036040 tx=0x7fa734000bc0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:19.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:19.827+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa73009ca80 con 0x7fa7400690e0 2024-04-21T10:22:20.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.047+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa74010a430 con 0x7fa7400690e0 2024-04-21T10:22:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.048+0000 7fa727fff640 1 -- 172.21.15.77:0/1725393134 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11887 (secure 0 0 0) 0x7fa7300b0e20 con 0x7fa7400690e0 2024-04-21T10:22:20.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:22:20.048 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:48.128805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:22:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7280a3e40 msgr2=0x7fa7280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7280a3e40 0x7fa7280a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa734036040 tx=0x7fa734000bc0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 msgr2=0x7fa7401986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa7401986e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa73000d770 tx=0x7fa73000dc30 comp rx=0 tx=0).stop 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 shutdown_connections 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa7280a3e40 0x7fa7280a6300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa740107fd0 0x7fa74019cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa740069aa0 0x7fa740198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 --2- 172.21.15.77:0/1725393134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7400690e0 0x7fa7401986e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 >> 172.21.15.77:0/1725393134 conn(0x7fa740077e30 msgr2=0x7fa740100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 shutdown_connections 2024-04-21T10:22:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.050+0000 7fa74574b640 1 -- 172.21.15.77:0/1725393134 wait complete. 2024-04-21T10:22:20.063 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id ad6cdd3b --release --await' 2024-04-21T10:22:20.063 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id ad6cdd3b --release --await 2024-04-21T10:22:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- 172.21.15.77:0/995113268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0100e80 msgr2=0x7fabf010ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- 172.21.15.77:0/995113268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0100e80 0x7fabf010ede0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009cd0 tx=0x7fabe802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- 172.21.15.77:0/995113268 shutdown_connections 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- 172.21.15.77:0/995113268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0100e80 0x7fabf010ede0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- 172.21.15.77:0/995113268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 0x7fabf0100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- 172.21.15.77:0/995113268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0106f50 0x7fabf0107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- 172.21.15.77:0/995113268 >> 172.21.15.77:0/995113268 conn(0x7fabf0077450 msgr2=0x7fabf00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- 172.21.15.77:0/995113268 shutdown_connections 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- 172.21.15.77:0/995113268 wait complete. 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 Processor -- start 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- start start 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 0x7fabf019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0100e80 0x7fabf019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 0x7fabf0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0112280 con 0x7fabf0106f50 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0112100 con 0x7fabf0100e80 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.170+0000 7fabf8554640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0112400 con 0x7fabf01004c0 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 0x7fabf0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 0x7fabf0198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52392/0 (socket says 172.21.15.77:52392) 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 -- 172.21.15.77:0/1475846435 learned_addr learned my addr 172.21.15.77:0/1475846435 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf5aef640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0100e80 0x7fabf019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf62f0640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 0x7fabf019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 -- 172.21.15.77:0/1475846435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 msgr2=0x7fabf019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 0x7fabf019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 -- 172.21.15.77:0/1475846435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0100e80 msgr2=0x7fabf019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0100e80 0x7fabf019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 -- 172.21.15.77:0/1475846435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf0198d80 con 0x7fabf0106f50 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf62f0640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 0x7fabf019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf5aef640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0100e80 0x7fabf019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:20.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf6af1640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 0x7fabf0198600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fabe8004af0 tx=0x7fabe8034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabe77fe640 1 -- 172.21.15.77:0/1475846435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8041020 con 0x7fabf0106f50 2024-04-21T10:22:20.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabe77fe640 1 -- 172.21.15.77:0/1475846435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe8032960 con 0x7fabf0106f50 2024-04-21T10:22:20.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf0199010 con 0x7fabf0106f50 2024-04-21T10:22:20.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabe77fe640 1 -- 172.21.15.77:0/1475846435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8039040 con 0x7fabf0106f50 2024-04-21T10:22:20.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.171+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf01a52c0 con 0x7fabf0106f50 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.173+0000 7fabe77fe640 1 -- 172.21.15.77:0/1475846435 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7fabe8044020 con 0x7fabf0106f50 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 Processor -- start 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 -- start start 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043e9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043fd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabe77fe640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fabdc0a3e40 0x7fabdc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55860434e500 con 0x5586043e8d80 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5586042f46a0 con 0x5586043e9730 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabfb216740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55860434a4c0 con 0x5586043faf40 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabf6af1640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fabdc0a3e40 0x7fabdc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043e9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52402/0 (socket says 172.21.15.77:52402) 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabf5aef640 1 -- 172.21.15.77:0/2184207782 learned_addr learned my addr 172.21.15.77:0/2184207782 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabe77fe640 1 -- 172.21.15.77:0/1475846435 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fabe80f27a0 con 0x7fabf0106f50 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabf62f0640 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.174+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf5aef640 1 -- 172.21.15.77:0/2184207782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 msgr2=0x5586043fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf5aef640 1 -- 172.21.15.77:0/2184207782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 msgr2=0x5586043e9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043e9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf5aef640 1 -- 172.21.15.77:0/2184207782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586043135e0 con 0x5586043e8d80 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf6af1640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fabdc0a3e40 0x7fabdc0a6300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fabe80eff10 tx=0x7fabe80b3ac0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043e9160 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fabe0015540 tx=0x7fabe00095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1892696a0646e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabe4bfe640 1 -- 172.21.15.77:0/2184207782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00134c0 con 0x5586043e8d80 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabe4bfe640 1 -- 172.21.15.77:0/2184207782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe001b070 con 0x5586043e8d80 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.175+0000 7fabe4bfe640 1 -- 172.21.15.77:0/2184207782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0012810 con 0x5586043e8d80 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- 172.21.15.77:0/2184207782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 msgr2=0x5586043e9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043e9160 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fabe0015540 tx=0x7fabe00095f0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- 172.21.15.77:0/2184207782 shutdown_connections 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043e9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- 172.21.15.77:0/2184207782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043e9160 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- 172.21.15.77:0/2184207782 >> 172.21.15.77:0/2184207782 conn(0x5586043e3a40 msgr2=0x5586043e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- 172.21.15.77:0/2184207782 shutdown_connections 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- 172.21.15.77:0/2184207782 wait complete. 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- start start 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 Processor -- start 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043edce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043eb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043eb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5586043fdd90 con 0x5586043e8d80 2024-04-21T10:22:20.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558604307a60 con 0x5586043e9730 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.176+0000 7fabfb216740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5586043fdf10 con 0x5586043faf40 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabfb216740 10 client.0 _ll_register_callbacks cb 0x558604060110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043edce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52408/0 (socket says 172.21.15.77:52408) 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 -- 172.21.15.77:0/2798076014 learned_addr learned my addr 172.21.15.77:0/2798076014 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 -- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 msgr2=0x5586043eb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043eb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 -- 172.21.15.77:0/2798076014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 msgr2=0x5586043eb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf62f0640 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043eb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 -- 172.21.15.77:0/2798076014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558604060920 con 0x5586043e8d80 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043edce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005e90 tx=0x7fabe00153a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88d7e36807fcddf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2798076014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0005590 con 0x5586043e8d80 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2798076014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fabe0004680 con 0x5586043e8d80 2024-04-21T10:22:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabe001b070 con 0x5586043e8d80 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2798076014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fabe0004880 con 0x5586043e8d80 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabfb216740 10 client.15693 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55860412cd30 con 0x5586043e8d80 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.177+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2798076014 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe001b070 con 0x5586043e8d80 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2798076014 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fabe000c070 con 0x5586043e8d80 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabfb216740 10 client.15693 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabfb216740 10 client.15693 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabfb216740 20 client.15693 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabfb216740 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55860440afb0 0x55860440d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabfb216740 4 client.15693 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558604321a10 con 0x55860440afb0 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabf62f0640 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55860440afb0 0x55860440d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabd9ffb640 10 client.15693 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.178+0000 7fabf62f0640 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55860440afb0 0x55860440d3a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb94cd113e28bf3 server_cookie=87a57622e14a2427 in_seq=0 out_seq=0 2024-04-21T10:22:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2798076014 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558604321a10 con 0x55860440afb0 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabd9ffb640 10 client.15693 handle_command_reply: tid=0 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 client.15693 shutdown 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 msgr2=0x5586043edce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043edce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005e90 tx=0x7fabe00153a0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 shutdown_connections 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55860440afb0 0x55860440d3a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043faf40 0x5586043eb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043e9730 0x5586043eb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabd9ffb640 0 client.15693 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 --2- 172.21.15.77:0/2798076014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043edce0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 >> 172.21.15.77:0/2798076014 conn(0x5586043e3a40 msgr2=0x5586043e5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 shutdown_connections 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 1 -- 172.21.15.77:0/2798076014 wait complete. 2024-04-21T10:22:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.179+0000 7fabfb216740 20 client.15693 trim_cache size 0 max 16384 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 Processor -- start 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 -- start start 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 0x5586043edce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x558604412a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01ae1d0 con 0x5586043e8d80 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01abaa0 con 0x5586043faf40 2024-04-21T10:22:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.196+0000 7fabfb216740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01a98f0 con 0x5586043e9730 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043ed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52420/0 (socket says 172.21.15.77:52420) 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 -- 172.21.15.77:0/3282667303 learned_addr learned my addr 172.21.15.77:0/3282667303 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x558604412a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 -- 172.21.15.77:0/3282667303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 msgr2=0x5586043edce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 0x5586043edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 -- 172.21.15.77:0/3282667303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 msgr2=0x558604412a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x558604412a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 -- 172.21.15.77:0/3282667303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586043fdf20 con 0x5586043e8d80 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabf5aef640 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043ed7a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009e80 tx=0x7fabe0009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d8d5dde81ec128 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabdbfff640 1 -- 172.21.15.77:0/3282667303 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00095f0 con 0x5586043e8d80 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabdbfff640 1 -- 172.21.15.77:0/3282667303 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe001b070 con 0x5586043e8d80 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.197+0000 7fabdbfff640 1 -- 172.21.15.77:0/3282667303 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0004c80 con 0x5586043e8d80 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- 172.21.15.77:0/3282667303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 msgr2=0x5586043ed7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043ed7a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009e80 tx=0x7fabe0009d90 comp rx=0 tx=0).stop 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- 172.21.15.77:0/3282667303 shutdown_connections 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x558604412a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 0x5586043edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- 172.21.15.77:0/3282667303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586043ed7a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- 172.21.15.77:0/3282667303 >> 172.21.15.77:0/3282667303 conn(0x5586043e3a40 msgr2=0x5586043e56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- 172.21.15.77:0/3282667303 shutdown_connections 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- 172.21.15.77:0/3282667303 wait complete. 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- start start 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 Processor -- start 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586044031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 0x558604403710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x5586044001a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01a9f60 con 0x5586043e8d80 2024-04-21T10:22:20.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01ab3d0 con 0x5586043faf40 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01aa630 con 0x5586043e9730 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabfb216740 10 client.0 _ll_register_callbacks cb 0x7fabe0015420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586044031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabf5aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586044031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52424/0 (socket says 172.21.15.77:52424) 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.198+0000 7fabf5aef640 1 -- 172.21.15.77:0/2405169834 learned_addr learned my addr 172.21.15.77:0/2405169834 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabf5aef640 1 -- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 msgr2=0x558604403710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 0x558604403710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabf5aef640 1 -- 172.21.15.77:0/2405169834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 msgr2=0x5586044001a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x5586044001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabf5aef640 1 -- 172.21.15.77:0/2405169834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586044009d0 con 0x5586043e8d80 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabf5aef640 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586044031d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fabe00092e0 tx=0x7fabe0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcddfff5b22ab4a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2405169834 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00123f0 con 0x5586043e8d80 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2405169834 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fabe0009550 con 0x5586043e8d80 2024-04-21T10:22:20.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabe001b070 con 0x5586043e8d80 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2405169834 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fabe0012590 con 0x5586043e8d80 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 10 client.15699 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558604471d80 con 0x5586043e8d80 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2405169834 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe001b070 con 0x5586043e8d80 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2405169834 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fabe000c070 con 0x5586043e8d80 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 10 client.15699 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 10 client.15699 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 20 client.15699 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558604472410 0x558604474830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 4 client.15699 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ad6cdd3b", "release": true, "await": true}] 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.199+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ad6cdd3b", "release": true, "await": true}) -- 0x55860435bf20 con 0x558604472410 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.200+0000 7fabf62f0640 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558604472410 0x558604474830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.200+0000 7fabd9ffb640 10 client.15699 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:20.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.200+0000 7fabf62f0640 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558604472410 0x558604474830 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43df871880bfe2cd server_cookie=824b6c8a425a4f15 in_seq=0 out_seq=0 2024-04-21T10:22:20.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.238+0000 7fabd9ffb640 1 -- 172.21.15.77:0/2405169834 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55860435bf20 con 0x558604472410 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.238+0000 7fabd9ffb640 10 client.15699 handle_command_reply: tid=0 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.238+0000 7fabfb216740 1 client.15699 shutdown 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.238+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 msgr2=0x5586044031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.238+0000 7fabfb216740 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586044031d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fabe00092e0 tx=0x7fabe0004710 comp rx=0 tx=0).stop 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 shutdown_connections 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558604472410 0x558604474830 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586043faf40 0x5586044001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabd9ffb640 0 client.15699 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5586043e9730 0x558604403710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 --2- 172.21.15.77:0/2405169834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586043e8d80 0x5586044031d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 >> 172.21.15.77:0/2405169834 conn(0x5586043e3a40 msgr2=0x5586043e2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 shutdown_connections 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 1 -- 172.21.15.77:0/2405169834 wait complete. 2024-04-21T10:22:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabfb216740 20 client.15699 trim_cache size 0 max 16384 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 24, 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 4, 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "ad6cdd3b": { 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 4, 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:22:20.240 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 90.0, 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:20.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:20.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:22:20.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fabdc0a3e40 msgr2=0x7fabdc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabf8554640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fabdc0a3e40 0x7fabdc0a6300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fabe80eff10 tx=0x7fabe80b3ac0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 msgr2=0x7fabf0198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.239+0000 7fabf8554640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 0x7fabf0198600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fabe8004af0 tx=0x7fabe8034670 comp rx=0 tx=0).stop 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 shutdown_connections 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fabdc0a3e40 0x7fabdc0a6300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabf0106f50 0x7fabf0198600 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0100e80 0x7fabf019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 --2- 172.21.15.77:0/1475846435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabf01004c0 0x7fabf019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 >> 172.21.15.77:0/1475846435 conn(0x7fabf0077450 msgr2=0x7fabf0105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 shutdown_connections 2024-04-21T10:22:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.240+0000 7fabf8554640 1 -- 172.21.15.77:0/1475846435 wait complete. 2024-04-21T10:22:20.257 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: ad6cdd3b, seconds elapsed: 32.2 2024-04-21T10:22:20.257 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-21T10:22:20.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:22:20.326 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1725393134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 -- 172.21.15.77:0/506078205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec102190 msgr2=0x7f92ec102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 --2- 172.21.15.77:0/506078205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec102190 0x7f92ec102570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009900 tx=0x7f92dc02bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 -- 172.21.15.77:0/506078205 shutdown_connections 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 --2- 172.21.15.77:0/506078205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92ec107260 0x7f92ec10ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 --2- 172.21.15.77:0/506078205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92ec102b40 0x7f92ec106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 --2- 172.21.15.77:0/506078205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec102190 0x7f92ec102570 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 -- 172.21.15.77:0/506078205 >> 172.21.15.77:0/506078205 conn(0x7f92ec0fd9f0 msgr2=0x7f92ec0ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 -- 172.21.15.77:0/506078205 shutdown_connections 2024-04-21T10:22:20.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.465+0000 7f92f285c640 1 -- 172.21.15.77:0/506078205 wait complete. 2024-04-21T10:22:20.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 Processor -- start 2024-04-21T10:22:20.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 -- start start 2024-04-21T10:22:20.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92ec102190 0x7f92ec19e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 0x7f92ec19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92ec1986f0 0x7f92ec198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1122a0 con 0x7f92ec107260 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec112120 con 0x7f92ec102190 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92f285c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec112420 con 0x7f92ec1986f0 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 0x7f92ec19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 0x7f92ec19eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52452/0 (socket says 172.21.15.77:52452) 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.466+0000 7f92eb7fe640 1 -- 172.21.15.77:0/3838857203 learned_addr learned my addr 172.21.15.77:0/3838857203 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92eb7fe640 1 -- 172.21.15.77:0/3838857203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92ec1986f0 msgr2=0x7f92ec198b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92eb7fe640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92ec1986f0 0x7f92ec198b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92eb7fe640 1 -- 172.21.15.77:0/3838857203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92ec102190 msgr2=0x7f92ec19e630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92eb7fe640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92ec102190 0x7f92ec19e630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92eb7fe640 1 -- 172.21.15.77:0/3838857203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec1992f0 con 0x7f92ec107260 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92eb7fe640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 0x7f92ec19eb70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f92d400b450 tx=0x7f92d400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d4015020 con 0x7f92ec107260 2024-04-21T10:22:20.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92d4011d40 con 0x7f92ec107260 2024-04-21T10:22:20.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ec1a53d0 con 0x7f92ec107260 2024-04-21T10:22:20.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.467+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d400f340 con 0x7f92ec107260 2024-04-21T10:22:20.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.468+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ec1a5780 con 0x7f92ec107260 2024-04-21T10:22:20.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.469+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92ec103660 con 0x7f92ec107260 2024-04-21T10:22:20.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.471+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7f92d4018020 con 0x7f92ec107260 2024-04-21T10:22:20.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.473+0000 7f92e97fa640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f92d80a3e40 0x7f92d80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.473+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f92d40d0aa0 con 0x7f92ec107260 2024-04-21T10:22:20.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.473+0000 7f92ebfff640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f92d80a3e40 0x7f92d80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.474+0000 7f92ebfff640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f92d80a3e40 0x7f92d80a6300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92dc005770 tx=0x7f92dc005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.481+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f92d401f020 con 0x7f92ec107260 2024-04-21T10:22:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1725393134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1725393134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.790+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92ec068de0 con 0x7f92ec107260 2024-04-21T10:22:20.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.791+0000 7f92e97fa640 1 -- 172.21.15.77:0/3838857203 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11887 (secure 0 0 0) 0x7f92d400d040 con 0x7f92ec107260 2024-04-21T10:22:20.791 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:22:20.791 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:48.128805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:22:20.791 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-04-21T10:22:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f92d80a3e40 msgr2=0x7f92d80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f92d80a3e40 0x7f92d80a6300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92dc005770 tx=0x7f92dc005fd0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 msgr2=0x7f92ec19eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 0x7f92ec19eb70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f92d400b450 tx=0x7f92d400b910 comp rx=0 tx=0).stop 2024-04-21T10:22:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 shutdown_connections 2024-04-21T10:22:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f92d80a3e40 0x7f92d80a6300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec107260 0x7f92ec19eb70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92ec1986f0 0x7f92ec198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 --2- 172.21.15.77:0/3838857203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92ec102190 0x7f92ec19e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 >> 172.21.15.77:0/3838857203 conn(0x7f92ec0fd9f0 msgr2=0x7f92ec0feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 shutdown_connections 2024-04-21T10:22:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.795+0000 7f92f285c640 1 -- 172.21.15.77:0/3838857203 wait complete. 2024-04-21T10:22:20.815 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 90.0 --await' 2024-04-21T10:22:20.816 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 90.0 --await 2024-04-21T10:22:20.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 -- 172.21.15.77:0/1255765264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109180 msgr2=0x7fa46c109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 --2- 172.21.15.77:0/1255765264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109180 0x7fa46c109560 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa464009ca0 tx=0x7fa46402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 -- 172.21.15.77:0/1255765264 shutdown_connections 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 --2- 172.21.15.77:0/1255765264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c1150a0 0x7fa46c117490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 --2- 172.21.15.77:0/1255765264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa46c109aa0 0x7fa46c114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 --2- 172.21.15.77:0/1255765264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109180 0x7fa46c109560 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.956+0000 7fa473ba4640 1 -- 172.21.15.77:0/1255765264 >> 172.21.15.77:0/1255765264 conn(0x7fa46c06d070 msgr2=0x7fa46c06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.957+0000 7fa473ba4640 1 -- 172.21.15.77:0/1255765264 shutdown_connections 2024-04-21T10:22:20.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.957+0000 7fa473ba4640 1 -- 172.21.15.77:0/1255765264 wait complete. 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 Processor -- start 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 -- start start 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c109180 0x7fa46c10a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 0x7fa46c10af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa46c1150a0 0x7fa46c10b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c11a9a0 con 0x7fa46c109aa0 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c11a820 con 0x7fa46c1150a0 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa473ba4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c11ab20 con 0x7fa46c109180 2024-04-21T10:22:20.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 0x7fa46c10af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 0x7fa46c10af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58150/0 (socket says 172.21.15.77:58150) 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa471940640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c109180 0x7fa46c10a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 -- 172.21.15.77:0/2374264499 learned_addr learned my addr 172.21.15.77:0/2374264499 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa472141640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa46c1150a0 0x7fa46c10b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 -- 172.21.15.77:0/2374264499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c109180 msgr2=0x7fa46c10a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c109180 0x7fa46c10a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 -- 172.21.15.77:0/2374264499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa46c1150a0 msgr2=0x7fa46c10b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa46c1150a0 0x7fa46c10b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa47113f640 1 -- 172.21.15.77:0/2374264499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c1b3900 con 0x7fa46c109aa0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.958+0000 7fa471940640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c109180 0x7fa46c10a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.959+0000 7fa47113f640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 0x7fa46c10af00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa46800d950 tx=0x7fa46800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.959+0000 7fa462ffd640 1 -- 172.21.15.77:0/2374264499 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468017030 con 0x7fa46c109aa0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.959+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1b3b30 con 0x7fa46c109aa0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.959+0000 7fa462ffd640 1 -- 172.21.15.77:0/2374264499 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa468004020 con 0x7fa46c109aa0 2024-04-21T10:22:20.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.959+0000 7fa462ffd640 1 -- 172.21.15.77:0/2374264499 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680047a0 con 0x7fa46c109aa0 2024-04-21T10:22:20.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.959+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1b4080 con 0x7fa46c109aa0 2024-04-21T10:22:20.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.961+0000 7fa462ffd640 1 -- 172.21.15.77:0/2374264499 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7fa468009a30 con 0x7fa46c109aa0 2024-04-21T10:22:20.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.962+0000 7fa47679a740 1 Processor -- start 2024-04-21T10:22:20.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.962+0000 7fa47679a740 1 -- start start 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47679a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47679a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47679a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586d62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47679a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ba5862b0b0 con 0x55ba586d3ec0 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47679a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ba585dc680 con 0x55ba586cb2e0 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47679a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ba585e8c60 con 0x55ba586ca9c0 2024-04-21T10:22:20.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:59266/0 (socket says 172.21.15.77:59266) 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 -- 172.21.15.77:0/2605034763 learned_addr learned my addr 172.21.15.77:0/2605034763 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 -- 172.21.15.77:0/2605034763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 msgr2=0x55ba586d3980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d3980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 -- 172.21.15.77:0/2605034763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 msgr2=0x55ba586d62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47113f640 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586d62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586d62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa472141640 1 -- 172.21.15.77:0/2605034763 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5840dc90 con 0x55ba586ca9c0 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.963+0000 7fa47113f640 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586d62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa462ffd640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa4580a3e40 0x7fa4580a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa472141640 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cada0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009ba0 tx=0x7fa45c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64e6d087c76f4d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa457fff640 1 -- 172.21.15.77:0/2605034763 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c004230 con 0x55ba586ca9c0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa471940640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa4580a3e40 0x7fa4580a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa462ffd640 1 -- 172.21.15.77:0/2374264499 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa4680d0430 con 0x7fa46c109aa0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa457fff640 1 -- 172.21.15.77:0/2605034763 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa45c009e10 con 0x55ba586ca9c0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.964+0000 7fa457fff640 1 -- 172.21.15.77:0/2605034763 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c004c70 con 0x55ba586ca9c0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 -- 172.21.15.77:0/2605034763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 msgr2=0x55ba586cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa471940640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa4580a3e40 0x7fa4580a6300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa464004af0 tx=0x7fa464005c50 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cada0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009ba0 tx=0x7fa45c011810 comp rx=0 tx=0).stop 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 -- 172.21.15.77:0/2605034763 shutdown_connections 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586d62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 --2- 172.21.15.77:0/2605034763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cada0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 -- 172.21.15.77:0/2605034763 >> 172.21.15.77:0/2605034763 conn(0x55ba586c50f0 msgr2=0x55ba586c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 -- 172.21.15.77:0/2605034763 shutdown_connections 2024-04-21T10:22:20.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 -- 172.21.15.77:0/2605034763 wait complete. 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 -- start start 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.965+0000 7fa47679a740 1 Processor -- start 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 0x55ba586d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586d3ec0 0x55ba586d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ba5862e400 con 0x55ba586cb2e0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ba585ea840 con 0x55ba586d3ec0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ba58633720 con 0x55ba586ca9c0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47679a740 10 client.0 _ll_register_callbacks cb 0x55ba5863bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47113f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 0x55ba586d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47113f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 0x55ba586d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58166/0 (socket says 172.21.15.77:58166) 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47113f640 1 -- 172.21.15.77:0/293431676 learned_addr learned my addr 172.21.15.77:0/293431676 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa471940640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa472141640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586d3ec0 0x55ba586d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa471940640 1 -- 172.21.15.77:0/293431676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586d3ec0 msgr2=0x55ba586d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa471940640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586d3ec0 0x55ba586d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa471940640 1 -- 172.21.15.77:0/293431676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 msgr2=0x55ba586d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa471940640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 0x55ba586d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa471940640 1 -- 172.21.15.77:0/293431676 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5846e420 con 0x55ba586ca9c0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa47113f640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 0x55ba586d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.966+0000 7fa472141640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586d3ec0 0x55ba586d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.967+0000 7fa471940640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d0eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa464006010 tx=0x7fa46402c0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acbd8a81ecad4df5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.967+0000 7fa4557fa640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.967+0000 7fa4557fa640 1 -- 172.21.15.77:0/293431676 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464044070 con 0x55ba586ca9c0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.967+0000 7fa4557fa640 1 -- 172.21.15.77:0/293431676 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa46404b670 con 0x55ba586ca9c0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.967+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45c009e10 con 0x55ba586ca9c0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa4557fa640 1 -- 172.21.15.77:0/293431676 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa464059050 con 0x55ba586ca9c0 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 10 client.25210 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba58301580 con 0x55ba586ca9c0 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa4557fa640 1 -- 172.21.15.77:0/293431676 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa45c009e10 con 0x55ba586ca9c0 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa4557fa640 1 -- 172.21.15.77:0/293431676 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa464034960 con 0x55ba586ca9c0 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 10 client.25210 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 10 client.25210 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 20 client.25210 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba586e3c10 0x55ba586e6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 4 client.25210 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba5863cb10 con 0x55ba586e3c10 2024-04-21T10:22:20.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.968+0000 7fa47113f640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba586e3c10 0x55ba586e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:20.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.969+0000 7fa47113f640 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba586e3c10 0x55ba586e6060 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1be11c6840d7092 server_cookie=ea781f1cbea85661 in_seq=0 out_seq=0 2024-04-21T10:22:20.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.969+0000 7fa4557fa640 10 client.25210 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:20.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.969+0000 7fa4557fa640 1 -- 172.21.15.77:0/293431676 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ba5863cb10 con 0x55ba586e3c10 2024-04-21T10:22:20.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.969+0000 7fa4557fa640 10 client.25210 handle_command_reply: tid=0 2024-04-21T10:22:20.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.970+0000 7fa47679a740 1 client.25210 shutdown 2024-04-21T10:22:20.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.970+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 msgr2=0x55ba586d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.970+0000 7fa47679a740 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d0eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa464006010 tx=0x7fa46402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 shutdown_connections 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba586e3c10 0x55ba586e6060 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586cb2e0 0x55ba586d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586d3ec0 0x55ba586d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 --2- 172.21.15.77:0/293431676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d0eb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 >> 172.21.15.77:0/293431676 conn(0x55ba586c50f0 msgr2=0x55ba586c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa4557fa640 0 client.25210 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 shutdown_connections 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 1 -- 172.21.15.77:0/293431676 wait complete. 2024-04-21T10:22:20.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:20.971+0000 7fa47679a740 20 client.25210 trim_cache size 0 max 16384 2024-04-21T10:22:21.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.011+0000 7fa47679a740 1 Processor -- start 2024-04-21T10:22:21.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.011+0000 7fa47679a740 1 -- start start 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47679a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47679a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47679a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa471940640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47113f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa471940640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:59278/0 (socket says 172.21.15.77:59278) 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47113f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:58088/0 (socket says 172.21.15.77:58088) 2024-04-21T10:22:21.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa471940640 1 -- 172.21.15.77:0/1138500017 learned_addr learned my addr 172.21.15.77:0/1138500017 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:21.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1bcb40 con 0x55ba586d3ec0 2024-04-21T10:22:21.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1ba990 con 0x55ba586cb2e0 2024-04-21T10:22:21.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1bc470 con 0x55ba586ca9c0 2024-04-21T10:22:21.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.012+0000 7fa472141640 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa471940640 1 -- 172.21.15.77:0/1138500017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 msgr2=0x55ba586d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa471940640 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa471940640 1 -- 172.21.15.77:0/1138500017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 msgr2=0x55ba586c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa471940640 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa471940640 1 -- 172.21.15.77:0/1138500017 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba586cbd60 con 0x55ba586ca9c0 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa47113f640 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa472141640 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa471940640 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d35e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa46402cfd0 tx=0x7fa464009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9010b1962ff0303 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa4577fe640 1 -- 172.21.15.77:0/1138500017 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464061020 con 0x55ba586ca9c0 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa4577fe640 1 -- 172.21.15.77:0/1138500017 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa464050070 con 0x55ba586ca9c0 2024-04-21T10:22:21.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.013+0000 7fa4577fe640 1 -- 172.21.15.77:0/1138500017 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464044040 con 0x55ba586ca9c0 2024-04-21T10:22:21.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.014+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 msgr2=0x55ba586d35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:21.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.014+0000 7fa47679a740 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d35e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa46402cfd0 tx=0x7fa464009b20 comp rx=0 tx=0).stop 2024-04-21T10:22:21.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 shutdown_connections 2024-04-21T10:22:21.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 --2- 172.21.15.77:0/1138500017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586d35e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 >> 172.21.15.77:0/1138500017 conn(0x55ba586c50f0 msgr2=0x55ba586c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:21.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 shutdown_connections 2024-04-21T10:22:21.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 -- 172.21.15.77:0/1138500017 wait complete. 2024-04-21T10:22:21.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 -- start start 2024-04-21T10:22:21.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.015+0000 7fa47679a740 1 Processor -- start 2024-04-21T10:22:21.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa47679a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa47679a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa47679a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa47679a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1bb6d0 con 0x55ba586d3ec0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa471940640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa471940640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:59282/0 (socket says 172.21.15.77:59282) 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa471940640 1 -- 172.21.15.77:0/3930444785 learned_addr learned my addr 172.21.15.77:0/3930444785 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1bb000 con 0x55ba586cb2e0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.016+0000 7fa47113f640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c1bbda0 con 0x55ba586ca9c0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa472141640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa47679a740 10 client.0 _ll_register_callbacks cb 0x7fa45c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa471940640 1 -- 172.21.15.77:0/3930444785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 msgr2=0x55ba586ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa471940640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa471940640 1 -- 172.21.15.77:0/3930444785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 msgr2=0x55ba586ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:21.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa471940640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa471940640 1 -- 172.21.15.77:0/3930444785 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba587492d0 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa472141640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa471940640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cdca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa464000f80 tx=0x7fa464034970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c607caef3b1c51b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa4557fa640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.017+0000 7fa4557fa640 1 -- 172.21.15.77:0/3930444785 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464044040 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa4557fa640 1 -- 172.21.15.77:0/3930444785 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa464034ae0 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa464050070 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa4557fa640 1 -- 172.21.15.77:0/3930444785 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa464039040 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa47679a740 10 client.25216 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba5874a530 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa4557fa640 1 -- 172.21.15.77:0/3930444785 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa464050070 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.018+0000 7fa4557fa640 1 -- 172.21.15.77:0/3930444785 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa464066810 con 0x55ba586ca9c0 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47679a740 10 client.25216 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47679a740 10 client.25216 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47679a740 20 client.25216 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47679a740 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba5874ac10 0x55ba5874d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:21.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47679a740 4 client.25216 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 90.0, "await": true}] 2024-04-21T10:22:21.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 90.0, "await": true}) -- 0x55ba58636980 con 0x55ba5874ac10 2024-04-21T10:22:21.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47113f640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba5874ac10 0x55ba5874d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:21.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa47113f640 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba5874ac10 0x55ba5874d030 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd864db32298720c server_cookie=a950f07a5c76edc7 in_seq=0 out_seq=0 2024-04-21T10:22:21.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.019+0000 7fa4557fa640 10 client.25216 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa4557fa640 1 -- 172.21.15.77:0/3930444785 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55ba58636980 con 0x55ba5874ac10 2024-04-21T10:22:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa4557fa640 10 client.25216 handle_command_reply: tid=0 2024-04-21T10:22:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 client.25216 shutdown 2024-04-21T10:22:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 msgr2=0x55ba586cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cdca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa464000f80 tx=0x7fa464034970 comp rx=0 tx=0).stop 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 shutdown_connections 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55ba5874ac10 0x55ba5874d030 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba586d3ec0 0x55ba586ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba586cb2e0 0x55ba586ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 --2- 172.21.15.77:0/3930444785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba586ca9c0 0x55ba586cdca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa4557fa640 0 client.25216 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 >> 172.21.15.77:0/3930444785 conn(0x55ba586c50f0 msgr2=0x55ba586c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 shutdown_connections 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 1 -- 172.21.15.77:0/3930444785 wait complete. 2024-04-21T10:22:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.145+0000 7fa47679a740 20 client.25216 trim_cache size 0 max 16384 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 24, 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 6, 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "32bf75e6": { 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 6, 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:22:21.147 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 90.0, 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:22:21.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa4580a3e40 msgr2=0x7fa4580a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:21.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa4580a3e40 0x7fa4580a6300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa464004af0 tx=0x7fa464005c50 comp rx=0 tx=0).stop 2024-04-21T10:22:21.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 msgr2=0x7fa46c10af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:21.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 0x7fa46c10af00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa46800d950 tx=0x7fa46800de10 comp rx=0 tx=0).stop 2024-04-21T10:22:21.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 shutdown_connections 2024-04-21T10:22:21.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa4580a3e40 0x7fa4580a6300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa46c109aa0 0x7fa46c10af00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa46c1150a0 0x7fa46c10b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 --2- 172.21.15.77:0/2374264499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46c109180 0x7fa46c10a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 >> 172.21.15.77:0/2374264499 conn(0x7fa46c06d070 msgr2=0x7fa46c070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 shutdown_connections 2024-04-21T10:22:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:21.146+0000 7fa473ba4640 1 -- 172.21.15.77:0/2374264499 wait complete. 2024-04-21T10:22:21.156 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 32bf75e6, quiesce duration: 30.0 2024-04-21T10:22:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:21 smithi170 ceph-mon[31212]: pgmap v31: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 44 op/s 2024-04-21T10:22:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:21 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3838857203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:21 smithi077 ceph-mon[27902]: pgmap v31: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 44 op/s 2024-04-21T10:22:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:21 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3838857203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:21 smithi191 ceph-mon[31636]: pgmap v31: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 44 op/s 2024-04-21T10:22:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:21 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3838857203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:23 smithi170 ceph-mon[31212]: pgmap v32: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 37 op/s 2024-04-21T10:22:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:23 smithi077 ceph-mon[27902]: pgmap v32: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 37 op/s 2024-04-21T10:22:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:23 smithi191 ceph-mon[31636]: pgmap v32: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 37 op/s 2024-04-21T10:22:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40.0 s, 309.2 tps, lat 2088.453 ms stddev 7800.500 2024-04-21T10:22:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:25 smithi170 ceph-mon[31212]: pgmap v33: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 36 op/s 2024-04-21T10:22:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:25 smithi077 ceph-mon[27902]: pgmap v33: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 36 op/s 2024-04-21T10:22:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:25 smithi191 ceph-mon[31636]: pgmap v33: 97 pgs: 97 active+clean; 878 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 36 op/s 2024-04-21T10:22:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:27 smithi170 ceph-mon[31212]: pgmap v34: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 40 MiB/s wr, 104 op/s 2024-04-21T10:22:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:27 smithi077 ceph-mon[27902]: pgmap v34: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 40 MiB/s wr, 104 op/s 2024-04-21T10:22:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:27 smithi191 ceph-mon[31636]: pgmap v34: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 40 MiB/s wr, 104 op/s 2024-04-21T10:22:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:29 smithi170 ceph-mon[31212]: pgmap v35: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 80 op/s 2024-04-21T10:22:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:22:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:29 smithi077 ceph-mon[27902]: pgmap v35: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 80 op/s 2024-04-21T10:22:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:22:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:29 smithi191 ceph-mon[31636]: pgmap v35: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 80 op/s 2024-04-21T10:22:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:22:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 45.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:22:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:22:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:22:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:22:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:22:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:22:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:22:31.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:31 smithi191 ceph-mon[31636]: pgmap v36: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 25 MiB/s wr, 83 op/s 2024-04-21T10:22:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:31 smithi077 ceph-mon[27902]: pgmap v36: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 25 MiB/s wr, 83 op/s 2024-04-21T10:22:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:31 smithi170 ceph-mon[31212]: pgmap v36: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 25 MiB/s wr, 83 op/s 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 -- 172.21.15.77:0/1452634048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 msgr2=0x7faf2c10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 --2- 172.21.15.77:0/1452634048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c10bf80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7faf28009900 tx=0x7faf2802bcd0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 -- 172.21.15.77:0/1452634048 shutdown_connections 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 --2- 172.21.15.77:0/1452634048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c10bf80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 --2- 172.21.15.77:0/1452634048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 0x7faf2c10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 --2- 172.21.15.77:0/1452634048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 0x7faf2c103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 -- 172.21.15.77:0/1452634048 >> 172.21.15.77:0/1452634048 conn(0x7faf2c077fd0 msgr2=0x7faf2c0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 -- 172.21.15.77:0/1452634048 shutdown_connections 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.280+0000 7faf33752640 1 -- 172.21.15.77:0/1452634048 wait complete. 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 Processor -- start 2024-04-21T10:22:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 -- start start 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 0x7faf2c1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 0x7faf2c19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1121d0 con 0x7faf2c103aa0 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c112050 con 0x7faf2c103180 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf33752640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c112350 con 0x7faf2c10c550 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60210/0 (socket says 172.21.15.77:60210) 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.281+0000 7faf30ced640 1 -- 172.21.15.77:0/3299470178 learned_addr learned my addr 172.21.15.77:0/3299470178 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf314ee640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 0x7faf2c1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf31cef640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 0x7faf2c19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf30ced640 1 -- 172.21.15.77:0/3299470178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 msgr2=0x7faf2c19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf30ced640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 0x7faf2c19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf30ced640 1 -- 172.21.15.77:0/3299470178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 msgr2=0x7faf2c1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf30ced640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 0x7faf2c1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf30ced640 1 -- 172.21.15.77:0/3299470178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c19d6a0 con 0x7faf2c103aa0 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf31cef640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 0x7faf2c19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf314ee640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 0x7faf2c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf30ced640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c198bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faf28005940 tx=0x7faf2802d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf227fc640 1 -- 172.21.15.77:0/3299470178 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28043020 con 0x7faf2c103aa0 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf227fc640 1 -- 172.21.15.77:0/3299470178 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf2802dc90 con 0x7faf2c103aa0 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c19d930 con 0x7faf2c103aa0 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf227fc640 1 -- 172.21.15.77:0/3299470178 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28003ab0 con 0x7faf2c103aa0 2024-04-21T10:22:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.282+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1a5220 con 0x7faf2c103aa0 2024-04-21T10:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.284+0000 7faf227fc640 1 -- 172.21.15.77:0/3299470178 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7faf28046020 con 0x7faf2c103aa0 2024-04-21T10:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 Processor -- start 2024-04-21T10:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 -- start start 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45dc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf227fc640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7faf180a3f60 0x7faf180a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5598a45318d0 con 0x5598a45d1ce0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5598a44cee80 con 0x5598a45da4f0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf36425740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5598a452d890 con 0x5598a45d0f70 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf31cef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf31cef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60218/0 (socket says 172.21.15.77:60218) 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.285+0000 7faf31cef640 1 -- 172.21.15.77:0/1196061098 learned_addr learned my addr 172.21.15.77:0/1196061098 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7faf180a3f60 0x7faf180a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf227fc640 1 -- 172.21.15.77:0/3299470178 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7faf280f2b10 con 0x7faf2c103aa0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf314ee640 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf30ced640 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45dc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 -- 172.21.15.77:0/1196061098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 msgr2=0x5598a45d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 -- 172.21.15.77:0/1196061098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 msgr2=0x5598a45dc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45dc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 -- 172.21.15.77:0/1196061098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598a44f0320 con 0x5598a45d1ce0 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf30ced640 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45dc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d0a30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf240092f0 tx=0x7faf24011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa35f5b4d08d3b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf31cef640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7faf180a3f60 0x7faf180a6420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf24011c50 tx=0x7faf24016000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf177fe640 1 -- 172.21.15.77:0/1196061098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24022070 con 0x5598a45d1ce0 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf177fe640 1 -- 172.21.15.77:0/1196061098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf24009bc0 con 0x5598a45d1ce0 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.286+0000 7faf177fe640 1 -- 172.21.15.77:0/1196061098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf240052f0 con 0x5598a45d1ce0 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 -- 172.21.15.77:0/1196061098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 msgr2=0x5598a45d0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d0a30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf240092f0 tx=0x7faf24011750 comp rx=0 tx=0).stop 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 -- 172.21.15.77:0/1196061098 shutdown_connections 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45dc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 --2- 172.21.15.77:0/1196061098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d0a30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 -- 172.21.15.77:0/1196061098 >> 172.21.15.77:0/1196061098 conn(0x5598a4593c90 msgr2=0x5598a45cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 -- 172.21.15.77:0/1196061098 shutdown_connections 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 -- 172.21.15.77:0/1196061098 wait complete. 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 -- start start 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.287+0000 7faf36425740 1 Processor -- start 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45d78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5598a45dd1c0 con 0x5598a45d1ce0 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5598a44b9eb0 con 0x5598a45da4f0 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5598a45dd340 con 0x5598a45d0f70 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf36425740 10 client.0 _ll_register_callbacks cb 0x5598a44e6b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60228/0 (socket says 172.21.15.77:60228) 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 -- 172.21.15.77:0/3218829906 learned_addr learned my addr 172.21.15.77:0/3218829906 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf314ee640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 -- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 msgr2=0x5598a45d9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf31cef640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45d78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 -- 172.21.15.77:0/3218829906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 msgr2=0x5598a45d78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45d78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 -- 172.21.15.77:0/3218829906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598a4244210 con 0x5598a45d1ce0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf30ced640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d72a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faf28005ec0 tx=0x7faf280be8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cfdfcfdba19937 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.288+0000 7faf14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf14ff9640 1 -- 172.21.15.77:0/3218829906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2802de40 con 0x5598a45d1ce0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf14ff9640 1 -- 172.21.15.77:0/3218829906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7faf28005340 con 0x5598a45d1ce0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf24009bc0 con 0x5598a45d1ce0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf14ff9640 1 -- 172.21.15.77:0/3218829906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf280bf160 con 0x5598a45d1ce0 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 10 client.15732 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598a4310620 con 0x5598a45d1ce0 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf14ff9640 1 -- 172.21.15.77:0/3218829906 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf24009bc0 con 0x5598a45d1ce0 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf14ff9640 1 -- 172.21.15.77:0/3218829906 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf280c7240 con 0x5598a45d1ce0 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 10 client.15732 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 20 client.15732 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a45ea540 0x5598a45ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 4 client.15732 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.289+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598a4545880 con 0x5598a45ea540 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.290+0000 7faf314ee640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a45ea540 0x5598a45ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.290+0000 7faf14ff9640 10 client.15732 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.290+0000 7faf314ee640 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a45ea540 0x5598a45ec9a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f8067054fd5fa0e server_cookie=18e03f59f1408b6 in_seq=0 out_seq=0 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf14ff9640 1 -- 172.21.15.77:0/3218829906 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5598a4545880 con 0x5598a45ea540 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf14ff9640 10 client.15732 handle_command_reply: tid=0 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 client.15732 shutdown 2024-04-21T10:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 msgr2=0x5598a45d72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d72a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faf28005ec0 tx=0x7faf280be8f0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 shutdown_connections 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a45ea540 0x5598a45ec9a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d1ce0 0x5598a45d72a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45da4f0 0x5598a45d78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 --2- 172.21.15.77:0/3218829906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45d9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf14ff9640 0 client.15732 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 >> 172.21.15.77:0/3218829906 conn(0x5598a4593c90 msgr2=0x5598a45cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 shutdown_connections 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 1 -- 172.21.15.77:0/3218829906 wait complete. 2024-04-21T10:22:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.291+0000 7faf36425740 20 client.15732 trim_cache size 0 max 16384 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 Processor -- start 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 -- start start 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 0x5598a45d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d2b50 0x5598a45d9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1ae0b0 con 0x5598a45da4f0 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1ab980 con 0x5598a45d2b50 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf36425740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1a97d0 con 0x5598a45d0f70 2024-04-21T10:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 0x5598a45d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 0x5598a45d99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60230/0 (socket says 172.21.15.77:60230) 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 -- 172.21.15.77:0/315410911 learned_addr learned my addr 172.21.15.77:0/315410911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf314ee640 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 -- 172.21.15.77:0/315410911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 msgr2=0x5598a45e60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45e60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 -- 172.21.15.77:0/315410911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d2b50 msgr2=0x5598a45d9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf31cef640 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d2b50 0x5598a45d9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d2b50 0x5598a45d9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 -- 172.21.15.77:0/315410911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598a45ed020 con 0x5598a45da4f0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.306+0000 7faf30ced640 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 0x5598a45d99d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7faf280bb430 tx=0x7faf280be960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a339c359bdabf8fd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf16ffd640 1 -- 172.21.15.77:0/315410911 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2802de40 con 0x5598a45da4f0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf16ffd640 1 -- 172.21.15.77:0/315410911 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf280baae0 con 0x5598a45da4f0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf16ffd640 1 -- 172.21.15.77:0/315410911 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28005340 con 0x5598a45da4f0 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 -- 172.21.15.77:0/315410911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 msgr2=0x5598a45d99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 0x5598a45d99d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7faf280bb430 tx=0x7faf280be960 comp rx=0 tx=0).stop 2024-04-21T10:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 -- 172.21.15.77:0/315410911 shutdown_connections 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45da4f0 0x5598a45d99d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d2b50 0x5598a45d9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 --2- 172.21.15.77:0/315410911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45d0f70 0x5598a45e60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 -- 172.21.15.77:0/315410911 >> 172.21.15.77:0/315410911 conn(0x5598a4593c90 msgr2=0x5598a45d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 -- 172.21.15.77:0/315410911 shutdown_connections 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 -- 172.21.15.77:0/315410911 wait complete. 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.307+0000 7faf36425740 1 -- start start 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 Processor -- start 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d0f70 0x5598a45dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 0x5598a45df180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45da4f0 0x5598a4648ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1a9e40 con 0x5598a45d2b50 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1ab2b0 con 0x5598a45d0f70 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1aa510 con 0x5598a45da4f0 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf36425740 10 client.0 _ll_register_callbacks cb 0x7faf28005770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 0x5598a45df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 0x5598a45df180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60246/0 (socket says 172.21.15.77:60246) 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 -- 172.21.15.77:0/351687411 learned_addr learned my addr 172.21.15.77:0/351687411 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf31cef640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45da4f0 0x5598a4648ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf314ee640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d0f70 0x5598a45dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 -- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45da4f0 msgr2=0x5598a4648ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45da4f0 0x5598a4648ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 -- 172.21.15.77:0/351687411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d0f70 msgr2=0x5598a45dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d0f70 0x5598a45dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf30ced640 1 -- 172.21.15.77:0/351687411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598a45c2f30 con 0x5598a45d2b50 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf31cef640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45da4f0 0x5598a4648ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.308+0000 7faf314ee640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d0f70 0x5598a45dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf30ced640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 0x5598a45df180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7faf28009600 tx=0x7faf2802bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a0819d62b967dd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf14ff9640 1 -- 172.21.15.77:0/351687411 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf280bad00 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf14ff9640 1 -- 172.21.15.77:0/351687411 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7faf280be180 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf280baae0 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf14ff9640 1 -- 172.21.15.77:0/351687411 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf2802de40 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 10 client.15738 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598a45d0240 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf14ff9640 1 -- 172.21.15.77:0/351687411 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf280baae0 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf14ff9640 1 -- 172.21.15.77:0/351687411 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf280a4050 con 0x5598a45d2b50 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 10 client.15738 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 20 client.15738 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a46515e0 0x5598a4653a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 4 client.15738 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.309+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5598a44d13d0 con 0x5598a46515e0 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.310+0000 7faf314ee640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a46515e0 0x5598a4653a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.310+0000 7faf314ee640 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a46515e0 0x5598a4653a00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3626dd768a906299 server_cookie=5211619f1dfbefbd in_seq=0 out_seq=0 2024-04-21T10:22:32.316 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.310+0000 7faf14ff9640 10 client.15738 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf14ff9640 1 -- 172.21.15.77:0/351687411 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598a44d13d0 con 0x5598a46515e0 2024-04-21T10:22:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf14ff9640 10 client.15738 handle_command_reply: tid=0 2024-04-21T10:22:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 client.15738 shutdown 2024-04-21T10:22:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 msgr2=0x5598a45df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 0x5598a45df180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7faf28009600 tx=0x7faf2802bcd0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 shutdown_connections 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5598a46515e0 0x5598a4653a00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598a45d2b50 0x5598a45df180 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5598a45da4f0 0x5598a4648ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 --2- 172.21.15.77:0/351687411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5598a45d0f70 0x5598a45dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf14ff9640 0 client.15738 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 >> 172.21.15.77:0/351687411 conn(0x5598a4593c90 msgr2=0x5598a45cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 shutdown_connections 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 1 -- 172.21.15.77:0/351687411 wait complete. 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.328+0000 7faf36425740 20 client.15738 trim_cache size 0 max 16384 2024-04-21T10:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:22:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:22:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:22:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7faf180a3f60 msgr2=0x7faf180a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7faf180a3f60 0x7faf180a6420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf24011c50 tx=0x7faf24016000 comp rx=0 tx=0).stop 2024-04-21T10:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 msgr2=0x7faf2c198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c198bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faf28005940 tx=0x7faf2802d890 comp rx=0 tx=0).stop 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 shutdown_connections 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7faf180a3f60 0x7faf180a6420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c103aa0 0x7faf2c198bf0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf2c10c550 0x7faf2c19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 --2- 172.21.15.77:0/3299470178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c103180 0x7faf2c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 >> 172.21.15.77:0/3299470178 conn(0x7faf2c077fd0 msgr2=0x7faf2c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 shutdown_connections 2024-04-21T10:22:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:32.329+0000 7faf33752640 1 -- 172.21.15.77:0/3299470178 wait complete. 2024-04-21T10:22:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:33 smithi077 ceph-mon[27902]: pgmap v37: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 70 op/s 2024-04-21T10:22:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:33 smithi191 ceph-mon[31636]: pgmap v37: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 70 op/s 2024-04-21T10:22:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:33 smithi170 ceph-mon[31212]: pgmap v37: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 70 op/s 2024-04-21T10:22:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 50.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:35 smithi077 ceph-mon[27902]: pgmap v38: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 70 op/s 2024-04-21T10:22:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:35 smithi191 ceph-mon[31636]: pgmap v38: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 70 op/s 2024-04-21T10:22:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:35 smithi170 ceph-mon[31212]: pgmap v38: 97 pgs: 97 active+clean; 929 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 70 op/s 2024-04-21T10:22:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:37 smithi077 ceph-mon[27902]: pgmap v39: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 20 MiB/s wr, 187 op/s 2024-04-21T10:22:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:37 smithi191 ceph-mon[31636]: pgmap v39: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 20 MiB/s wr, 187 op/s 2024-04-21T10:22:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:37 smithi170 ceph-mon[31212]: pgmap v39: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 20 MiB/s wr, 187 op/s 2024-04-21T10:22:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:39 smithi077 ceph-mon[27902]: pgmap v40: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 911 KiB/s wr, 119 op/s 2024-04-21T10:22:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:39 smithi191 ceph-mon[31636]: pgmap v40: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 911 KiB/s wr, 119 op/s 2024-04-21T10:22:39.997 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:39 smithi170 ceph-mon[31212]: pgmap v40: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 911 KiB/s wr, 119 op/s 2024-04-21T10:22:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 55.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:41 smithi077 ceph-mon[27902]: pgmap v41: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 912 KiB/s wr, 123 op/s 2024-04-21T10:22:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:41 smithi191 ceph-mon[31636]: pgmap v41: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 912 KiB/s wr, 123 op/s 2024-04-21T10:22:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:41 smithi170 ceph-mon[31212]: pgmap v41: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 912 KiB/s wr, 123 op/s 2024-04-21T10:22:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:43 smithi077 ceph-mon[27902]: pgmap v42: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 909 KiB/s wr, 119 op/s 2024-04-21T10:22:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:43 smithi191 ceph-mon[31636]: pgmap v42: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 909 KiB/s wr, 119 op/s 2024-04-21T10:22:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:43 smithi170 ceph-mon[31212]: pgmap v42: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 909 KiB/s wr, 119 op/s 2024-04-21T10:22:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 60.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 -- 172.21.15.77:0/3093126955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101af0 msgr2=0x7f496010dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 --2- 172.21.15.77:0/3093126955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101af0 0x7f496010dca0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4958009cd0 tx=0x7f495802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 -- 172.21.15.77:0/3093126955 shutdown_connections 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 --2- 172.21.15.77:0/3093126955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101af0 0x7f496010dca0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 --2- 172.21.15.77:0/3093126955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101130 0x7f49601015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 --2- 172.21.15.77:0/3093126955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4960106f90 0x7f4960107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.426+0000 7f4967f15640 1 -- 172.21.15.77:0/3093126955 >> 172.21.15.77:0/3093126955 conn(0x7f4960077c30 msgr2=0x7f4960078040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 -- 172.21.15.77:0/3093126955 shutdown_connections 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 -- 172.21.15.77:0/3093126955 wait complete. 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 Processor -- start 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 -- start start 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 0x7f4960198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101af0 0x7f4960198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4960106f90 0x7f496019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4960111070 con 0x7f4960101130 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4960110ef0 con 0x7f4960106f90 2024-04-21T10:22:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4967f15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49601111f0 con 0x7f4960101af0 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4965cb1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 0x7f4960198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4965cb1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 0x7f4960198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46086/0 (socket says 172.21.15.77:46086) 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.427+0000 7f4965cb1640 1 -- 172.21.15.77:0/4057208883 learned_addr learned my addr 172.21.15.77:0/4057208883 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4965cb1640 1 -- 172.21.15.77:0/4057208883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101af0 msgr2=0x7f4960198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f49654b0640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101af0 0x7f4960198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4965cb1640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101af0 0x7f4960198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f49664b2640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4960106f90 0x7f496019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4965cb1640 1 -- 172.21.15.77:0/4057208883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4960106f90 msgr2=0x7f496019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4965cb1640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4960106f90 0x7f496019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4965cb1640 1 -- 172.21.15.77:0/4057208883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496019d5d0 con 0x7f4960101130 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f49654b0640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101af0 0x7f4960198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4965cb1640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 0x7f4960198630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f495c00d950 tx=0x7f495c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4956ffd640 1 -- 172.21.15.77:0/4057208883 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c017030 con 0x7f4960101130 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496019d8c0 con 0x7f4960101130 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4956ffd640 1 -- 172.21.15.77:0/4057208883 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495c004020 con 0x7f4960101130 2024-04-21T10:22:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4956ffd640 1 -- 172.21.15.77:0/4057208883 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c0047a0 con 0x7f4960101130 2024-04-21T10:22:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.428+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49601a5150 con 0x7f4960101130 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.430+0000 7f4956ffd640 1 -- 172.21.15.77:0/4057208883 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7f495c009a30 con 0x7f4960101130 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 Processor -- start 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 -- start start 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf168d0 0x563b2cf15620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf15fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 0x563b2cf214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563b2ce7a8d0 con 0x563b2cf1f0e0 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563b2ce17e80 con 0x563b2cf15b60 2024-04-21T10:22:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f496abe6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563b2ce76890 con 0x563b2cf168d0 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.431+0000 7f4956ffd640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f494c0a3ee0 0x7f494c0a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 0x563b2cf214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 0x563b2cf214d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46102/0 (socket says 172.21.15.77:46102) 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 -- 172.21.15.77:0/3186061757 learned_addr learned my addr 172.21.15.77:0/3186061757 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49664b2640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f494c0a3ee0 0x7f494c0a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f4965cb1640 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf15fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49664b2640 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf168d0 0x563b2cf15620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f4956ffd640 1 -- 172.21.15.77:0/4057208883 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f495c0d05d0 con 0x7f4960101130 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 -- 172.21.15.77:0/3186061757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf168d0 msgr2=0x563b2cf15620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf168d0 0x563b2cf15620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 -- 172.21.15.77:0/3186061757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 msgr2=0x563b2cf15fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf15fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 -- 172.21.15.77:0/3186061757 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2ce39320 con 0x563b2cf1f0e0 2024-04-21T10:22:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49654b0640 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 0x563b2cf214d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4950009c20 tx=0x7f495000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1f41405d6e35e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f49664b2640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f494c0a3ee0 0x7f494c0a63a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f495802c630 tx=0x7f4958009890 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f494bfff640 1 -- 172.21.15.77:0/3186061757 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950016070 con 0x563b2cf1f0e0 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f494bfff640 1 -- 172.21.15.77:0/3186061757 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4950011920 con 0x563b2cf1f0e0 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.432+0000 7f494bfff640 1 -- 172.21.15.77:0/3186061757 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49500107d0 con 0x563b2cf1f0e0 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 -- 172.21.15.77:0/3186061757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 msgr2=0x563b2cf214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 0x563b2cf214d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4950009c20 tx=0x7f495000e6c0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 -- 172.21.15.77:0/3186061757 shutdown_connections 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf1f0e0 0x563b2cf214d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf15fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 --2- 172.21.15.77:0/3186061757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf168d0 0x563b2cf15620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 -- 172.21.15.77:0/3186061757 >> 172.21.15.77:0/3186061757 conn(0x563b2cedcc90 msgr2=0x563b2cf10850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 -- 172.21.15.77:0/3186061757 shutdown_connections 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.433+0000 7f496abe6740 1 -- 172.21.15.77:0/3186061757 wait complete. 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 -- start start 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 Processor -- start 2024-04-21T10:22:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf1ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf1bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563b2cf21e10 con 0x563b2cf168d0 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563b2ce02eb0 con 0x563b2cf15b60 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563b2cf21f90 con 0x563b2cf1f0e0 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f496abe6740 10 client.0 _ll_register_callbacks cb 0x563b2ce2fb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf1bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf1bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46116/0 (socket says 172.21.15.77:46116) 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 -- 172.21.15.77:0/1879489376 learned_addr learned my addr 172.21.15.77:0/1879489376 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49664b2640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f4965cb1640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf1ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 -- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 msgr2=0x563b2cf1c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 -- 172.21.15.77:0/1879489376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 msgr2=0x563b2cf1ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf1ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.434+0000 7f49654b0640 1 -- 172.21.15.77:0/1879489376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b2cb8d210 con 0x563b2cf168d0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49654b0640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf1bde0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4950000c00 tx=0x7f49500118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdfafec2faff3ab server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49497fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49497fa640 1 -- 172.21.15.77:0/1879489376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950016050 con 0x563b2cf168d0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49497fa640 1 -- 172.21.15.77:0/1879489376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f4950005040 con 0x563b2cf168d0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4950011920 con 0x563b2cf168d0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49497fa640 1 -- 172.21.15.77:0/1879489376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4950009860 con 0x563b2cf168d0 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 10 client.15750 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563b2cc59620 con 0x563b2cf168d0 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49497fa640 1 -- 172.21.15.77:0/1879489376 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4950011920 con 0x563b2cf168d0 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f49497fa640 1 -- 172.21.15.77:0/1879489376 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f495000f040 con 0x563b2cf168d0 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 10 client.15750 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 10 client.15750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 20 client.15750 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf2f000 0x563b2cf313f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 4 client.15750 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.435+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b2ce8e880 con 0x563b2cf2f000 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.436+0000 7f4965cb1640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf2f000 0x563b2cf313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.436+0000 7f49497fa640 10 client.15750 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.436+0000 7f4965cb1640 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf2f000 0x563b2cf313f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfb7db17c06e976 server_cookie=e66dba57421620a5 in_seq=0 out_seq=0 2024-04-21T10:22:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f49497fa640 1 -- 172.21.15.77:0/1879489376 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563b2ce8e880 con 0x563b2cf2f000 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f49497fa640 10 client.15750 handle_command_reply: tid=0 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 client.15750 shutdown 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 msgr2=0x563b2cf1bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf1bde0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4950000c00 tx=0x7f49500118a0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 shutdown_connections 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf2f000 0x563b2cf313f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf1bde0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 --2- 172.21.15.77:0/1879489376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f49497fa640 0 client.15750 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 >> 172.21.15.77:0/1879489376 conn(0x563b2cedcc90 msgr2=0x563b2cf125a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 shutdown_connections 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 1 -- 172.21.15.77:0/1879489376 wait complete. 2024-04-21T10:22:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.437+0000 7f496abe6740 20 client.15750 trim_cache size 0 max 16384 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 Processor -- start 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 -- start start 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 0x563b2cf2ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf168d0 0x563b2cf1e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49601b0300 con 0x563b2cf15b60 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f49601adbd0 con 0x563b2cf168d0 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f496abe6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49601aba20 con 0x563b2cf1f0e0 2024-04-21T10:22:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f4965cb1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 0x563b2cf2ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f4965cb1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 0x563b2cf2ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46128/0 (socket says 172.21.15.77:46128) 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f4965cb1640 1 -- 172.21.15.77:0/3681160752 learned_addr learned my addr 172.21.15.77:0/3681160752 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f49654b0640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf168d0 0x563b2cf1e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.452+0000 7f49664b2640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f4965cb1640 1 -- 172.21.15.77:0/3681160752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 msgr2=0x563b2cf1ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f4965cb1640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f4965cb1640 1 -- 172.21.15.77:0/3681160752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf168d0 msgr2=0x563b2cf1e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f4965cb1640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf168d0 0x563b2cf1e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f4965cb1640 1 -- 172.21.15.77:0/3681160752 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2cf14e30 con 0x563b2cf15b60 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f49654b0640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf168d0 0x563b2cf1e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f49664b2640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f4965cb1640 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 0x563b2cf2ad10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f495c000c00 tx=0x7f495c06dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0197573cec632 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f494b7fe640 1 -- 172.21.15.77:0/3681160752 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c096e60 con 0x563b2cf15b60 2024-04-21T10:22:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f494b7fe640 1 -- 172.21.15.77:0/3681160752 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495c0a4f60 con 0x563b2cf15b60 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f494b7fe640 1 -- 172.21.15.77:0/3681160752 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c09b740 con 0x563b2cf15b60 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 -- 172.21.15.77:0/3681160752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 msgr2=0x563b2cf2ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 0x563b2cf2ad10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f495c000c00 tx=0x7f495c06dd30 comp rx=0 tx=0).stop 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 -- 172.21.15.77:0/3681160752 shutdown_connections 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf168d0 0x563b2cf1e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 --2- 172.21.15.77:0/3681160752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf15b60 0x563b2cf2ad10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.453+0000 7f496abe6740 1 -- 172.21.15.77:0/3681160752 >> 172.21.15.77:0/3681160752 conn(0x563b2cedcc90 msgr2=0x563b2cf10380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 -- 172.21.15.77:0/3681160752 shutdown_connections 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 -- 172.21.15.77:0/3681160752 wait complete. 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 -- start start 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 Processor -- start 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf8d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf8dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49601ac090 con 0x563b2cf168d0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f49601ad500 con 0x563b2cf15b60 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49601ac760 con 0x563b2cf1f0e0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f496abe6740 10 client.0 _ll_register_callbacks cb 0x7f495c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f49654b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf8dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f49654b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf8dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46140/0 (socket says 172.21.15.77:46140) 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f49654b0640 1 -- 172.21.15.77:0/711295935 learned_addr learned my addr 172.21.15.77:0/711295935 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f4965cb1640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf8d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.454+0000 7f49664b2640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49654b0640 1 -- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 msgr2=0x563b2cf225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49654b0640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf225f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49654b0640 1 -- 172.21.15.77:0/711295935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 msgr2=0x563b2cf8d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49654b0640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf8d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49654b0640 1 -- 172.21.15.77:0/711295935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b2cf22ce0 con 0x563b2cf168d0 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49664b2640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49654b0640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf8dc70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4950001eb0 tx=0x7f4950010510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5a19510d018c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49497fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49497fa640 1 -- 172.21.15.77:0/711295935 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49500092a0 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49497fa640 1 -- 172.21.15.77:0/711295935 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f4950004020 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f495c0a4f60 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49497fa640 1 -- 172.21.15.77:0/711295935 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4950004220 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 10 client.15756 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563b2cf94e00 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49497fa640 1 -- 172.21.15.77:0/711295935 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495c0a4f60 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f49497fa640 1 -- 172.21.15.77:0/711295935 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4950011ce0 con 0x563b2cf168d0 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 10 client.15756 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 20 client.15756 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.455+0000 7f496abe6740 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf95520 0x563b2cf97940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.456+0000 7f496abe6740 4 client.15756 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.456+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563b2ce1a3d0 con 0x563b2cf95520 2024-04-21T10:22:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.456+0000 7f4965cb1640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf95520 0x563b2cf97940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.456+0000 7f49497fa640 10 client.15756 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.456+0000 7f4965cb1640 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf95520 0x563b2cf97940 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3fd1b170c449c4 server_cookie=6c690dd4187332ba in_seq=0 out_seq=0 2024-04-21T10:22:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f49497fa640 1 -- 172.21.15.77:0/711295935 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563b2ce1a3d0 con 0x563b2cf95520 2024-04-21T10:22:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f49497fa640 10 client.15756 handle_command_reply: tid=0 2024-04-21T10:22:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 client.15756 shutdown 2024-04-21T10:22:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 msgr2=0x563b2cf8dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf8dc70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4950001eb0 tx=0x7f4950010510 comp rx=0 tx=0).stop 2024-04-21T10:22:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 shutdown_connections 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563b2cf95520 0x563b2cf97940 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563b2cf168d0 0x563b2cf8dc70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563b2cf1f0e0 0x563b2cf225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f49497fa640 0 client.15756 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 --2- 172.21.15.77:0/711295935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b2cf15b60 0x563b2cf8d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 >> 172.21.15.77:0/711295935 conn(0x563b2cedcc90 msgr2=0x563b2cf1a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 shutdown_connections 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 1 -- 172.21.15.77:0/711295935 wait complete. 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.472+0000 7f496abe6740 20 client.15756 trim_cache size 0 max 16384 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:22:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:22:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:22:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:22:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f494c0a3ee0 msgr2=0x7f494c0a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f494c0a3ee0 0x7f494c0a63a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f495802c630 tx=0x7f4958009890 comp rx=0 tx=0).stop 2024-04-21T10:22:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 msgr2=0x7f4960198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 0x7f4960198630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f495c00d950 tx=0x7f495c00de10 comp rx=0 tx=0).stop 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 shutdown_connections 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f494c0a3ee0 0x7f494c0a63a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4960106f90 0x7f496019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4960101af0 0x7f4960198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 --2- 172.21.15.77:0/4057208883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4960101130 0x7f4960198630 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 >> 172.21.15.77:0/4057208883 conn(0x7f4960077c30 msgr2=0x7f4960105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 shutdown_connections 2024-04-21T10:22:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:45.473+0000 7f4967f15640 1 -- 172.21.15.77:0/4057208883 wait complete. 2024-04-21T10:22:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:45 smithi077 ceph-mon[27902]: pgmap v43: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 909 KiB/s wr, 119 op/s 2024-04-21T10:22:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:45 smithi191 ceph-mon[31636]: pgmap v43: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 909 KiB/s wr, 119 op/s 2024-04-21T10:22:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:45 smithi170 ceph-mon[31212]: pgmap v43: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 909 KiB/s wr, 119 op/s 2024-04-21T10:22:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:47 smithi077 ceph-mon[27902]: pgmap v44: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 911 KiB/s wr, 122 op/s 2024-04-21T10:22:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:47 smithi191 ceph-mon[31636]: pgmap v44: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 911 KiB/s wr, 122 op/s 2024-04-21T10:22:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:47 smithi170 ceph-mon[31212]: pgmap v44: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 911 KiB/s wr, 122 op/s 2024-04-21T10:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:49 smithi077 ceph-mon[27902]: pgmap v45: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-21T10:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:49 smithi191 ceph-mon[31636]: pgmap v45: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-21T10:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:49 smithi170 ceph-mon[31212]: pgmap v45: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-21T10:22:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 65.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:22:51.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:22:51.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 -- 172.21.15.77:0/2851853044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c102ed0 msgr2=0x7fb91c06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 --2- 172.21.15.77:0/2851853044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c102ed0 0x7fb91c06a640 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb914009900 tx=0x7fb91402bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:51.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 -- 172.21.15.77:0/2851853044 shutdown_connections 2024-04-21T10:22:51.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 --2- 172.21.15.77:0/2851853044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91c10e830 0x7fb91c110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 --2- 172.21.15.77:0/2851853044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb91c06ab80 0x7fb91c06afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 --2- 172.21.15.77:0/2851853044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c102ed0 0x7fb91c06a640 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 -- 172.21.15.77:0/2851853044 >> 172.21.15.77:0/2851853044 conn(0x7fb91c077e30 msgr2=0x7fb91c078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 -- 172.21.15.77:0/2851853044 shutdown_connections 2024-04-21T10:22:51.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.269+0000 7fb9211f4640 1 -- 172.21.15.77:0/2851853044 wait complete. 2024-04-21T10:22:51.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 Processor -- start 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 -- start start 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91c06ab80 0x7fb91c1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb91c102ed0 0x7fb91c1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 0x7fb91c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c114410 con 0x7fb91c10e830 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c114290 con 0x7fb91c06ab80 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb9211f4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c114590 con 0x7fb91c102ed0 2024-04-21T10:22:51.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb91b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 0x7fb91c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb91b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 0x7fb91c19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37514/0 (socket says 172.21.15.77:37514) 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb91b59e640 1 -- 172.21.15.77:0/4073617285 learned_addr learned my addr 172.21.15.77:0/4073617285 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.270+0000 7fb91a59c640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb91c102ed0 0x7fb91c1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91ad9d640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91c06ab80 0x7fb91c1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91b59e640 1 -- 172.21.15.77:0/4073617285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb91c102ed0 msgr2=0x7fb91c1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91b59e640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb91c102ed0 0x7fb91c1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91b59e640 1 -- 172.21.15.77:0/4073617285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91c06ab80 msgr2=0x7fb91c1a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91b59e640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91c06ab80 0x7fb91c1a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91b59e640 1 -- 172.21.15.77:0/4073617285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c19b030 con 0x7fb91c10e830 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb91b59e640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 0x7fb91c19a770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00ccb0 tx=0x7fb90c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c003970 con 0x7fb91c10e830 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c19b320 con 0x7fb91c10e830 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb90c004030 con 0x7fb91c10e830 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00f6b0 con 0x7fb91c10e830 2024-04-21T10:22:51.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.271+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c1a7630 con 0x7fb91c10e830 2024-04-21T10:22:51.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.272+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91c1014b0 con 0x7fb91c10e830 2024-04-21T10:22:51.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.273+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7fb90c003b10 con 0x7fb91c10e830 2024-04-21T10:22:51.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.274+0000 7fb903fff640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9040a3e40 0x7fb9040a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.274+0000 7fb91ad9d640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9040a3e40 0x7fb9040a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.274+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb90c0d0ba0 con 0x7fb91c10e830 2024-04-21T10:22:51.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.274+0000 7fb91ad9d640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9040a3e40 0x7fb9040a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c00 tx=0x7fb914004040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.279+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb90c014070 con 0x7fb91c10e830 2024-04-21T10:22:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.503+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb91c19b550 con 0x7fb91c10e830 2024-04-21T10:22:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.504+0000 7fb903fff640 1 -- 172.21.15.77:0/4073617285 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11887 (secure 0 0 0) 0x7fb90c09d020 con 0x7fb91c10e830 2024-04-21T10:22:51.504 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:22:51.504 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:21:48.128805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:22:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9040a3e40 msgr2=0x7fb9040a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9040a3e40 0x7fb9040a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c00 tx=0x7fb914004040 comp rx=0 tx=0).stop 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 msgr2=0x7fb91c19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 0x7fb91c19a770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00ccb0 tx=0x7fb90c00a620 comp rx=0 tx=0).stop 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 shutdown_connections 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9040a3e40 0x7fb9040a6300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb91c10e830 0x7fb91c19a770 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb91c102ed0 0x7fb91c1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 --2- 172.21.15.77:0/4073617285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91c06ab80 0x7fb91c1a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 >> 172.21.15.77:0/4073617285 conn(0x7fb91c077e30 msgr2=0x7fb91c10f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 shutdown_connections 2024-04-21T10:22:51.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.506+0000 7fb9211f4640 1 -- 172.21.15.77:0/4073617285 wait complete. 2024-04-21T10:22:51.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:51 smithi077 ceph-mon[27902]: pgmap v46: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-21T10:22:51.517 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id 32bf75e6 --release --await' 2024-04-21T10:22:51.518 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id 32bf75e6 --release --await 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 -- 172.21.15.77:0/3264074221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd424101a50 msgr2=0x7fd424105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 --2- 172.21.15.77:0/3264074221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd424101a50 0x7fd424105a90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd414009900 tx=0x7fd41402bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 -- 172.21.15.77:0/3264074221 shutdown_connections 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 --2- 172.21.15.77:0/3264074221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd424101a50 0x7fd424105a90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 --2- 172.21.15.77:0/3264074221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd424106170 0x7fd42410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 --2- 172.21.15.77:0/3264074221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4241010a0 0x7fd424101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 -- 172.21.15.77:0/3264074221 >> 172.21.15.77:0/3264074221 conn(0x7fd424077eb0 msgr2=0x7fd4240782c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 -- 172.21.15.77:0/3264074221 shutdown_connections 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.624+0000 7fd42c281640 1 -- 172.21.15.77:0/3264074221 wait complete. 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 Processor -- start 2024-04-21T10:22:51.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 -- start start 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4241010a0 0x7fd424198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd424106170 0x7fd424198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 0x7fd42419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd424111110 con 0x7fd42419cfc0 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd424110f90 con 0x7fd424106170 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42c281640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd424111290 con 0x7fd4241010a0 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 0x7fd42419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 0x7fd42419d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37526/0 (socket says 172.21.15.77:37526) 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 -- 172.21.15.77:0/1918938042 learned_addr learned my addr 172.21.15.77:0/1918938042 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a01d640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4241010a0 0x7fd424198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42981c640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd424106170 0x7fd424198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 -- 172.21.15.77:0/1918938042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4241010a0 msgr2=0x7fd424198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4241010a0 0x7fd424198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 -- 172.21.15.77:0/1918938042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd424106170 msgr2=0x7fd424198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd424106170 0x7fd424198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 -- 172.21.15.77:0/1918938042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42419dab0 con 0x7fd42419cfc0 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42981c640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd424106170 0x7fd424198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.625+0000 7fd42a81e640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 0x7fd42419d470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00b970 tx=0x7fd41c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.626+0000 7fd41b7fe640 1 -- 172.21.15.77:0/1918938042 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c019070 con 0x7fd42419cfc0 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.626+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42419dda0 con 0x7fd42419cfc0 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.626+0000 7fd41b7fe640 1 -- 172.21.15.77:0/1918938042 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c014440 con 0x7fd42419cfc0 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.626+0000 7fd41b7fe640 1 -- 172.21.15.77:0/1918938042 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0075d0 con 0x7fd42419cfc0 2024-04-21T10:22:51.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.626+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4241a5590 con 0x7fd42419cfc0 2024-04-21T10:22:51.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.628+0000 7fd41b7fe640 1 -- 172.21.15.77:0/1918938042 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138879+0+0 (secure 0 0 0) 0x7fd41c01c070 con 0x7fd42419cfc0 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.628+0000 7fd42ee71740 1 Processor -- start 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.628+0000 7fd42ee71740 1 -- start start 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd41b7fe640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd4100a3e40 0x7fd4100a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 0x55aa868a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42ee71740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aa8680c500 con 0x55aa868a7310 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42ee71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55aa867b26a0 con 0x55aa868b0810 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42ee71740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aa868084c0 con 0x55aa868a7c30 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42981c640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd4100a3e40 0x7fd4100a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd41b7fe640 1 -- 172.21.15.77:0/1918938042 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd41c0cffb0 con 0x7fd42419cfc0 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 0x55aa868a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 0x55aa868a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37532/0 (socket says 172.21.15.77:37532) 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 -- 172.21.15.77:0/2756553851 learned_addr learned my addr 172.21.15.77:0/2756553851 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42981c640 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a81e640 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 -- 172.21.15.77:0/2756553851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 msgr2=0x55aa868b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 -- 172.21.15.77:0/2756553851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 msgr2=0x55aa868b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 -- 172.21.15.77:0/2756553851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa867d15e0 con 0x55aa868a7310 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42981c640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd4100a3e40 0x7fd4100a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd414036040 tx=0x7fd414004470 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd42a01d640 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 0x55aa868a76f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd42000cc60 tx=0x7fd42000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828713f65a44f88a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd418bfe640 1 -- 172.21.15.77:0/2756553851 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420014070 con 0x55aa868a7310 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd418bfe640 1 -- 172.21.15.77:0/2756553851 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4200047a0 con 0x55aa868a7310 2024-04-21T10:22:51.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.629+0000 7fd418bfe640 1 -- 172.21.15.77:0/2756553851 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420010690 con 0x55aa868a7310 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 -- 172.21.15.77:0/2756553851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 msgr2=0x55aa868a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 0x55aa868a76f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd42000cc60 tx=0x7fd42000e720 comp rx=0 tx=0).stop 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 -- 172.21.15.77:0/2756553851 shutdown_connections 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 --2- 172.21.15.77:0/2756553851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7310 0x55aa868a76f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 -- 172.21.15.77:0/2756553851 >> 172.21.15.77:0/2756553851 conn(0x55aa868a1a40 msgr2=0x55aa868a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 -- 172.21.15.77:0/2756553851 shutdown_connections 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.630+0000 7fd42ee71740 1 -- 172.21.15.77:0/2756553851 wait complete. 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 -- start start 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 Processor -- start 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aa868b3600 con 0x55aa868b0810 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55aa867c5a60 con 0x55aa868a7310 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aa868b3780 con 0x55aa868a7c30 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 10 client.0 _ll_register_callbacks cb 0x55aa8651e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37540/0 (socket says 172.21.15.77:37540) 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 -- 172.21.15.77:0/3148208137 learned_addr learned my addr 172.21.15.77:0/3148208137 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a01d640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42981c640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 -- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 msgr2=0x55aa868ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 -- 172.21.15.77:0/3148208137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 msgr2=0x55aa868b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 -- 172.21.15.77:0/3148208137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa8651e920 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a01d640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42a81e640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868add20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd41c09bdd0 tx=0x7fd41c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96116cafcba9e05a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd40dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd40dffb640 1 -- 172.21.15.77:0/3148208137 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c09e070 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd40dffb640 1 -- 172.21.15.77:0/3148208137 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd41c0145f0 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.631+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4200047a0 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd40dffb640 1 -- 172.21.15.77:0/3148208137 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd41c0b5260 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 10 client.15774 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aa865ead30 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd40dffb640 1 -- 172.21.15.77:0/3148208137 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4200047a0 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd40dffb640 1 -- 172.21.15.77:0/3148208137 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd41c0cd920 con 0x55aa868b0810 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 10 client.15774 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:51.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 10 client.15774 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 20 client.15774 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa868c09e0 0x55aa868c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 4 client.15774 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa867dfa10 con 0x55aa868c09e0 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.632+0000 7fd42a01d640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa868c09e0 0x55aa868c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.633+0000 7fd40dffb640 10 client.15774 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.633+0000 7fd42a01d640 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa868c09e0 0x55aa868c2e10 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe6acd7c321e768 server_cookie=a098b3c59024b983 in_seq=0 out_seq=0 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.633+0000 7fd40dffb640 1 -- 172.21.15.77:0/3148208137 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa867dfa10 con 0x55aa868c09e0 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.633+0000 7fd40dffb640 10 client.15774 handle_command_reply: tid=0 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 client.15774 shutdown 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 msgr2=0x55aa868add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868add20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd41c09bdd0 tx=0x7fd41c004b50 comp rx=0 tx=0).stop 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 shutdown_connections 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa868c09e0 0x55aa868c2e10 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868add20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3148208137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd40dffb640 0 client.15774 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 >> 172.21.15.77:0/3148208137 conn(0x55aa868a1a40 msgr2=0x55aa868a3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 shutdown_connections 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 1 -- 172.21.15.77:0/3148208137 wait complete. 2024-04-21T10:22:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.634+0000 7fd42ee71740 20 client.15774 trim_cache size 0 max 16384 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.651+0000 7fd42ee71740 1 Processor -- start 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.651+0000 7fd42ee71740 1 -- start start 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.651+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.651+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.651+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.651+0000 7fd42ee71740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4241b0420 con 0x55aa868b0810 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42ee71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd4241adcf0 con 0x55aa868a7310 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42ee71740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4241abb40 con 0x55aa868a7c30 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37556/0 (socket says 172.21.15.77:37556) 2024-04-21T10:22:51.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 -- 172.21.15.77:0/3495344125 learned_addr learned my addr 172.21.15.77:0/3495344125 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a01d640 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42981c640 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 -- 172.21.15.77:0/3495344125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 msgr2=0x55aa868b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 -- 172.21.15.77:0/3495344125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 msgr2=0x55aa868afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 -- 172.21.15.77:0/3495344125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa868ac620 con 0x55aa868b0810 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a01d640 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd42a81e640 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868c86e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0cd7d0 tx=0x7fd41c09a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18de5806f77dbf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd40ffff640 1 -- 172.21.15.77:0/3495344125 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c09e070 con 0x55aa868b0810 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd40ffff640 1 -- 172.21.15.77:0/3495344125 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c0145f0 con 0x55aa868b0810 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.652+0000 7fd40ffff640 1 -- 172.21.15.77:0/3495344125 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0a4880 con 0x55aa868b0810 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- 172.21.15.77:0/3495344125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 msgr2=0x55aa868c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868c86e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0cd7d0 tx=0x7fd41c09a350 comp rx=0 tx=0).stop 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- 172.21.15.77:0/3495344125 shutdown_connections 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868b0810 0x55aa868c86e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7c30 0x55aa868b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- 172.21.15.77:0/3495344125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868a7310 0x55aa868afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- 172.21.15.77:0/3495344125 >> 172.21.15.77:0/3495344125 conn(0x55aa868a1a40 msgr2=0x55aa868a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- 172.21.15.77:0/3495344125 shutdown_connections 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- 172.21.15.77:0/3495344125 wait complete. 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- start start 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 Processor -- start 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7310 0x55aa868b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 0x55aa868b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4241ac1b0 con 0x55aa868a7c30 2024-04-21T10:22:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd4241ad620 con 0x55aa868b0810 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4241ac880 con 0x55aa868a7310 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42ee71740 10 client.0 _ll_register_callbacks cb 0x7fd41c09b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42981c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 0x55aa868b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42981c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 0x55aa868b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37558/0 (socket says 172.21.15.77:37558) 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.653+0000 7fd42981c640 1 -- 172.21.15.77:0/948077430 learned_addr learned my addr 172.21.15.77:0/948077430 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42981c640 1 -- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7310 msgr2=0x55aa868b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42981c640 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7310 0x55aa868b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42981c640 1 -- 172.21.15.77:0/948077430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 msgr2=0x55aa868b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:51.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42981c640 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42981c640 1 -- 172.21.15.77:0/948077430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa86926f60 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42981c640 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 0x55aa868b5ee0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd414035000 tx=0x7fd41402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed4cfa7efcac5ae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd40dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd40dffb640 1 -- 172.21.15.77:0/948077430 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140046c0 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd40dffb640 1 -- 172.21.15.77:0/948077430 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd414004860 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd41c0145f0 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd40dffb640 1 -- 172.21.15.77:0/948077430 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd41405d050 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 10 client.15780 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aa86928280 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd40dffb640 1 -- 172.21.15.77:0/948077430 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c0145f0 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd40dffb640 1 -- 172.21.15.77:0/948077430 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd414003c10 con 0x55aa868a7c30 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 10 client.15780 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 10 client.15780 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 20 client.15780 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:51.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa86928ab0 0x55aa8692aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:51.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 4 client.15780 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "32bf75e6", "release": true, "await": true}] 2024-04-21T10:22:51.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.654+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "32bf75e6", "release": true, "await": true}) -- 0x55aa86819f20 con 0x55aa86928ab0 2024-04-21T10:22:51.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.655+0000 7fd42a01d640 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa86928ab0 0x55aa8692aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:51.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.655+0000 7fd40dffb640 10 client.15780 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:51.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.655+0000 7fd42a01d640 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa86928ab0 0x55aa8692aed0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4985685104f2ec6d server_cookie=89f41d37cb88c22 in_seq=0 out_seq=0 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.669+0000 7fd40dffb640 1 -- 172.21.15.77:0/948077430 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55aa86819f20 con 0x55aa86928ab0 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.669+0000 7fd40dffb640 10 client.15780 handle_command_reply: tid=0 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.669+0000 7fd42ee71740 1 client.15780 shutdown 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.669+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 msgr2=0x55aa868b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.669+0000 7fd42ee71740 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 0x55aa868b5ee0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd414035000 tx=0x7fd41402bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 shutdown_connections 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55aa86928ab0 0x55aa8692aed0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa868a7c30 0x55aa868b5ee0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd40dffb640 0 client.15780 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aa868b0810 0x55aa868b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 --2- 172.21.15.77:0/948077430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa868a7310 0x55aa868b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 >> 172.21.15.77:0/948077430 conn(0x55aa868a1a40 msgr2=0x55aa868a0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 shutdown_connections 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 1 -- 172.21.15.77:0/948077430 wait complete. 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42ee71740 20 client.15780 trim_cache size 0 max 16384 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 24, 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 8, 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout: "32bf75e6": { 2024-04-21T10:22:51.671 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 8, 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 90.0, 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:51.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:51.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:51.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:51.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:22:51.673 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:22:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd4100a3e40 msgr2=0x7fd4100a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd4100a3e40 0x7fd4100a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd414036040 tx=0x7fd414004470 comp rx=0 tx=0).stop 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 msgr2=0x7fd42419d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 0x7fd42419d470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00b970 tx=0x7fd41c00be30 comp rx=0 tx=0).stop 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 shutdown_connections 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fd4100a3e40 0x7fd4100a6300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd42419cfc0 0x7fd42419d470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd424106170 0x7fd424198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 --2- 172.21.15.77:0/1918938042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4241010a0 0x7fd424198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 >> 172.21.15.77:0/1918938042 conn(0x7fd424077eb0 msgr2=0x7fd42406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 shutdown_connections 2024-04-21T10:22:51.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:22:51.670+0000 7fd42c281640 1 -- 172.21.15.77:0/1918938042 wait complete. 2024-04-21T10:22:51.687 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 32bf75e6, seconds elapsed: 31.4 2024-04-21T10:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:51 smithi191 ceph-mon[31636]: pgmap v46: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-21T10:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:51 smithi170 ceph-mon[31212]: pgmap v46: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-21T10:22:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:52 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/4073617285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:52 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/4073617285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:52 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/4073617285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:22:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:53 smithi077 ceph-mon[27902]: pgmap v47: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-21T10:22:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:53 smithi191 ceph-mon[31636]: pgmap v47: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-21T10:22:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:53 smithi170 ceph-mon[31212]: pgmap v47: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-21T10:22:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 70.0 s, 2743.7 tps, lat 248.485 ms stddev 2609.173 2024-04-21T10:22:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:55 smithi077 ceph-mon[27902]: pgmap v48: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-21T10:22:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:55 smithi191 ceph-mon[31636]: pgmap v48: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-21T10:22:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:55 smithi170 ceph-mon[31212]: pgmap v48: 97 pgs: 97 active+clean; 940 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-21T10:22:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:57 smithi191 ceph-mon[31636]: pgmap v49: 97 pgs: 97 active+clean; 960 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-04-21T10:22:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:57 smithi191 ceph-mon[31636]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-21T10:22:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:57 smithi170 ceph-mon[31212]: pgmap v49: 97 pgs: 97 active+clean; 960 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-04-21T10:22:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:57 smithi170 ceph-mon[31212]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-21T10:22:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:57 smithi077 ceph-mon[27902]: pgmap v49: 97 pgs: 97 active+clean; 960 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-04-21T10:22:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:57 smithi077 ceph-mon[27902]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 -- 172.21.15.77:0/385337413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9410e620 msgr2=0x7f9e9410ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/385337413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9410e620 0x7f9e9410ea00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009900 tx=0x7f9e8402bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 -- 172.21.15.77:0/385337413 shutdown_connections 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/385337413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108f20 0x7f9e941153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/385337413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e94108560 0x7f9e941089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/385337413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9410e620 0x7f9e9410ea00 secure :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009900 tx=0x7f9e8402bc30 comp rx=0 tx=0).stop 2024-04-21T10:22:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 -- 172.21.15.77:0/385337413 >> 172.21.15.77:0/385337413 conn(0x7f9e940764e0 msgr2=0x7f9e94078900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 -- 172.21.15.77:0/385337413 shutdown_connections 2024-04-21T10:22:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.593+0000 7f9e98b8f640 1 -- 172.21.15.77:0/385337413 wait complete. 2024-04-21T10:22:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 Processor -- start 2024-04-21T10:22:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 -- start start 2024-04-21T10:22:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 0x7f9e94073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e94108f20 0x7f9e9406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e9406ce50 0x7f9e9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94118800 con 0x7f9e94108f20 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94118680 con 0x7f9e9406ce50 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.594+0000 7f9e98b8f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94118980 con 0x7f9e94108560 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 0x7f9e94073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 0x7f9e94073840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:51062/0 (socket says 172.21.15.77:51062) 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e9259c640 1 -- 172.21.15.77:0/3323472246 learned_addr learned my addr 172.21.15.77:0/3323472246 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e94108f20 0x7f9e9406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e9406ce50 0x7f9e9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3323472246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 msgr2=0x7f9e94073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 0x7f9e94073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3323472246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e9406ce50 msgr2=0x7f9e9406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e9406ce50 0x7f9e9406d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3323472246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94071360 con 0x7f9e94108f20 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e9259c640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 0x7f9e94073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e9406ce50 0x7f9e9406d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.595+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e94108f20 0x7f9e9406c910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00e9f0 tx=0x7f9e7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.596+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/3323472246 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00ccc0 con 0x7f9e94108f20 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.596+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/3323472246 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7c0108e0 con 0x7f9e94108f20 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.596+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/3323472246 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c018880 con 0x7f9e94108f20 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.596+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e94071650 con 0x7f9e94108f20 2024-04-21T10:22:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.596+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e94071b20 con 0x7f9e94108f20 2024-04-21T10:22:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 Processor -- start 2024-04-21T10:22:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 -- start start 2024-04-21T10:22:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1de620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1defe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561c8a1438d0 con 0x561c8a1df8d0 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561c8a0e0e80 con 0x561c8a1e80e0 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c8a13f890 con 0x561c8a1deb60 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e92d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e92d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1de620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37586/0 (socket says 172.21.15.77:37586) 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1defe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:51074/0 (socket says 172.21.15.77:51074) 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e92d9d640 1 -- 172.21.15.77:0/3528006788 learned_addr learned my addr 172.21.15.77:0/3528006788 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.600+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/3323472246 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f9e7c010430 con 0x7f9e94108f20 2024-04-21T10:22:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.601+0000 7f9e92d9d640 1 -- 172.21.15.77:0/3528006788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 msgr2=0x561c8a1defe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.601+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1defe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.601+0000 7f9e92d9d640 1 -- 172.21.15.77:0/3528006788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 msgr2=0x561c8a1ea4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T10:22:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.601+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1ea4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.601+0000 7f9e92d9d640 1 -- 172.21.15.77:0/3528006788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8a102320 con 0x561c8a1df8d0 2024-04-21T10:22:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.601+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1de620 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c011790 tx=0x7f9e8c011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecec8d3588e0ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.602+0000 7f9e8b7fe640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9e800a3ff0 0x7f9e800a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.602+0000 7f9e88ff9640 1 -- 172.21.15.77:0/3528006788 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c003c30 con 0x561c8a1df8d0 2024-04-21T10:22:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.602+0000 7f9e88ff9640 1 -- 172.21.15.77:0/3528006788 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c00fe50 con 0x561c8a1df8d0 2024-04-21T10:22:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.602+0000 7f9e9259c640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9e800a3ff0 0x7f9e800a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.602+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/3323472246 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9e7c0d0a30 con 0x7f9e94108f20 2024-04-21T10:22:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.602+0000 7f9e88ff9640 1 -- 172.21.15.77:0/3528006788 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0193e0 con 0x561c8a1df8d0 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3528006788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 msgr2=0x561c8a1de620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1de620 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c011790 tx=0x7f9e8c011c50 comp rx=0 tx=0).stop 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9259c640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9e800a3ff0 0x7f9e800a64b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e84006010 tx=0x7f9e84000bc0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3528006788 shutdown_connections 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3528006788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1de620 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.603+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3528006788 >> 172.21.15.77:0/3528006788 conn(0x561c8a1a5c90 msgr2=0x561c8a1d9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.604+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3528006788 shutdown_connections 2024-04-21T10:22:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.604+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3528006788 wait complete. 2024-04-21T10:22:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.604+0000 7f9e9b77d740 1 -- start start 2024-04-21T10:22:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 Processor -- start 2024-04-21T10:22:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1deb60 0x561c8a1e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1e80e0 0x561c8a1e5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1deb60 0x561c8a1e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561c8a1eae10 con 0x561c8a1e80e0 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561c8a0cbeb0 con 0x561c8a1deb60 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c8a1eaf90 con 0x561c8a1df8d0 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e8bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e9b77d740 10 client.0 _ll_register_callbacks cb 0x561c8a0f8b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e8bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1e4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:51080/0 (socket says 172.21.15.77:51080) 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3047117073 learned_addr learned my addr 172.21.15.77:0/3047117073 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.605+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1e80e0 0x561c8a1e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3047117073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1deb60 msgr2=0x561c8a1e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1deb60 0x561c8a1e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3047117073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1e80e0 msgr2=0x561c8a1e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1e80e0 0x561c8a1e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e8bfff640 1 -- 172.21.15.77:0/3047117073 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c89e56210 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1e4f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00e9c0 tx=0x7f9e7c010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be6e539b80d5c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e79ffb640 1 -- 172.21.15.77:0/3047117073 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0a5610 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e79ffb640 1 -- 172.21.15.77:0/3047117073 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9e7c0ce3d0 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8c00fe50 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e79ffb640 1 -- 172.21.15.77:0/3047117073 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e7c0bbb60 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e9b77d740 10 client.25267 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.606+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561c89f22620 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e79ffb640 1 -- 172.21.15.77:0/3047117073 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c00fe50 con 0x561c8a1df8d0 2024-04-21T10:22:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e79ffb640 1 -- 172.21.15.77:0/3047117073 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e7c0989a0 con 0x561c8a1df8d0 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9b77d740 10 client.25267 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9b77d740 10 client.25267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9b77d740 20 client.25267 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a1f8270 0x561c8a1fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9b77d740 4 client.25267 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c8a157880 con 0x561c8a1f8270 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.607+0000 7f9e9259c640 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a1f8270 0x561c8a1fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.608+0000 7f9e79ffb640 10 client.25267 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.608+0000 7f9e9259c640 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a1f8270 0x561c8a1fa660 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3867cc8bebad81a0 server_cookie=5e6762e2317fb00 in_seq=0 out_seq=0 2024-04-21T10:22:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.608+0000 7f9e79ffb640 1 -- 172.21.15.77:0/3047117073 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561c8a157880 con 0x561c8a1f8270 2024-04-21T10:22:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.608+0000 7f9e79ffb640 10 client.25267 handle_command_reply: tid=0 2024-04-21T10:22:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.608+0000 7f9e9b77d740 1 client.25267 shutdown 2024-04-21T10:22:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 msgr2=0x561c8a1e4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1e4f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00e9c0 tx=0x7f9e7c010860 comp rx=0 tx=0).stop 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 shutdown_connections 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a1f8270 0x561c8a1fa660 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1e80e0 0x561c8a1e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1e4f10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/3047117073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1deb60 0x561c8a1e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 >> 172.21.15.77:0/3047117073 conn(0x561c8a1a5c90 msgr2=0x561c8a1db5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e79ffb640 0 client.25267 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 shutdown_connections 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 1 -- 172.21.15.77:0/3047117073 wait complete. 2024-04-21T10:22:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.609+0000 7f9e9b77d740 20 client.25267 trim_cache size 0 max 16384 2024-04-21T10:22:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 Processor -- start 2024-04-21T10:22:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 -- start start 2024-04-21T10:22:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 0x561c8a1e0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941bf790 con 0x561c8a1deb60 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941bd060 con 0x561c8a1e80e0 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941baeb0 con 0x561c8a1df8d0 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 0x561c8a1e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e8bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e92d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 0x561c8a1e0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37598/0 (socket says 172.21.15.77:37598) 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.627+0000 7f9e9259c640 1 -- 172.21.15.77:0/807607941 learned_addr learned my addr 172.21.15.77:0/807607941 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e9259c640 1 -- 172.21.15.77:0/807607941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 msgr2=0x561c8a1f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e9259c640 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e9259c640 1 -- 172.21.15.77:0/807607941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 msgr2=0x561c8a1e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e9259c640 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e9259c640 1 -- 172.21.15.77:0/807607941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8a1e3460 con 0x561c8a1deb60 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e9259c640 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 0x561c8a1e0790 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9e840096c0 tx=0x7f9e84041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a003b6d227a927a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e7bfff640 1 -- 172.21.15.77:0/807607941 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84045070 con 0x561c8a1deb60 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e7bfff640 1 -- 172.21.15.77:0/807607941 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8405a070 con 0x561c8a1deb60 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.628+0000 7f9e7bfff640 1 -- 172.21.15.77:0/807607941 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840035f0 con 0x561c8a1deb60 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- 172.21.15.77:0/807607941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 msgr2=0x561c8a1e0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 0x561c8a1e0790 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9e840096c0 tx=0x7f9e84041000 comp rx=0 tx=0).stop 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- 172.21.15.77:0/807607941 shutdown_connections 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1df8d0 0x561c8a1f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/807607941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1deb60 0x561c8a1e0790 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- 172.21.15.77:0/807607941 >> 172.21.15.77:0/807607941 conn(0x561c8a1a5c90 msgr2=0x561c8a1e0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- 172.21.15.77:0/807607941 shutdown_connections 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- 172.21.15.77:0/807607941 wait complete. 2024-04-21T10:22:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- start start 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 Processor -- start 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1f0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1e2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941bb520 con 0x561c8a1df8d0 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941bc990 con 0x561c8a1e80e0 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941bbbf0 con 0x561c8a1deb60 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9b77d740 10 client.0 _ll_register_callbacks cb 0x7f9e7c09c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e8bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e8bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1e2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37610/0 (socket says 172.21.15.77:37610) 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e8bfff640 1 -- 172.21.15.77:0/1430491450 learned_addr learned my addr 172.21.15.77:0/1430491450 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e9259c640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.629+0000 7f9e92d9d640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e8bfff640 1 -- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 msgr2=0x561c8a1f0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1f0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e8bfff640 1 -- 172.21.15.77:0/1430491450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 msgr2=0x561c8a1e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e8bfff640 1 -- 172.21.15.77:0/1430491450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c8a1e2c90 con 0x561c8a1df8d0 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e8bfff640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1e2190 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c09c750 tx=0x7f9e7c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcc1d7f101c395b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e79ffb640 1 -- 172.21.15.77:0/1430491450 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0a5610 con 0x561c8a1df8d0 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e79ffb640 1 -- 172.21.15.77:0/1430491450 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9e7c09bea0 con 0x561c8a1df8d0 2024-04-21T10:22:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.630+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8405a070 con 0x561c8a1df8d0 2024-04-21T10:22:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.631+0000 7f9e79ffb640 1 -- 172.21.15.77:0/1430491450 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e7c098cf0 con 0x561c8a1df8d0 2024-04-21T10:22:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.631+0000 7f9e9b77d740 10 client.15798 fetch_fsmap learned FSMap version 24 2024-04-21T10:22:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.631+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561c8a1e96f0 con 0x561c8a1df8d0 2024-04-21T10:22:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.631+0000 7f9e79ffb640 1 -- 172.21.15.77:0/1430491450 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8405a070 con 0x561c8a1df8d0 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e79ffb640 1 -- 172.21.15.77:0/1430491450 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e7c0a20e0 con 0x561c8a1df8d0 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9b77d740 10 client.15798 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9b77d740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9b77d740 20 client.15798 populate_metadata read hostname 'smithi077' 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a25edd0 0x561c8a2611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9b77d740 4 client.15798 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c8a0e33d0 con 0x561c8a25edd0 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9259c640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a25edd0 0x561c8a2611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e79ffb640 10 client.15798 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.632+0000 7f9e9259c640 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a25edd0 0x561c8a2611f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350f8b624ad26bb3 server_cookie=b98e7a8f0be965dc in_seq=0 out_seq=0 2024-04-21T10:22:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.648+0000 7f9e79ffb640 1 -- 172.21.15.77:0/1430491450 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c8a0e33d0 con 0x561c8a25edd0 2024-04-21T10:22:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.648+0000 7f9e79ffb640 10 client.15798 handle_command_reply: tid=0 2024-04-21T10:22:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.648+0000 7f9e9b77d740 1 client.15798 shutdown 2024-04-21T10:22:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 msgr2=0x561c8a1e2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1e2190 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c09c750 tx=0x7f9e7c00cef0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 shutdown_connections 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8a25edd0 0x561c8a2611f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8a1df8d0 0x561c8a1e2190 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8a1e80e0 0x561c8a1e26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 --2- 172.21.15.77:0/1430491450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8a1deb60 0x561c8a1f0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 >> 172.21.15.77:0/1430491450 conn(0x561c8a1a5c90 msgr2=0x561c8a1e3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e79ffb640 0 client.15798 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 shutdown_connections 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 1 -- 172.21.15.77:0/1430491450 wait complete. 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e9b77d740 20 client.15798 trim_cache size 0 max 16384 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:22:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:22:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:22:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:22:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9e800a3ff0 msgr2=0x7f9e800a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.649+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9e800a3ff0 0x7f9e800a64b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e84006010 tx=0x7f9e84000bc0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e94108f20 msgr2=0x7f9e9406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e94108f20 0x7f9e9406c910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00e9f0 tx=0x7f9e7c00eeb0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 shutdown_connections 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9e800a3ff0 0x7f9e800a64b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e94108f20 0x7f9e9406c910 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e9406ce50 0x7f9e9406d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 --2- 172.21.15.77:0/3323472246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e94108560 0x7f9e94073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 >> 172.21.15.77:0/3323472246 conn(0x7f9e940764e0 msgr2=0x7f9e94077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 shutdown_connections 2024-04-21T10:22:58.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:22:58.650+0000 7f9e98b8f640 1 -- 172.21.15.77:0/3323472246 wait complete. 2024-04-21T10:22:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:22:59 smithi191 ceph-mon[31636]: pgmap v50: 97 pgs: 97 active+clean; 960 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.5 MiB/s wr, 248 op/s 2024-04-21T10:22:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:22:59 smithi170 ceph-mon[31212]: pgmap v50: 97 pgs: 97 active+clean; 960 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.5 MiB/s wr, 248 op/s 2024-04-21T10:22:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:22:59 smithi077 ceph-mon[27902]: pgmap v50: 97 pgs: 97 active+clean; 960 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.5 MiB/s wr, 248 op/s 2024-04-21T10:23:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 75.0 s, 3828.4 tps, lat 26.161 ms stddev 27.683 2024-04-21T10:23:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:01 smithi191 ceph-mon[31636]: pgmap v51: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 7.1 MiB/s wr, 582 op/s 2024-04-21T10:23:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:01 smithi170 ceph-mon[31212]: pgmap v51: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 7.1 MiB/s wr, 582 op/s 2024-04-21T10:23:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:01 smithi077 ceph-mon[27902]: pgmap v51: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 7.1 MiB/s wr, 582 op/s 2024-04-21T10:23:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:03 smithi191 ceph-mon[31636]: pgmap v52: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.1 MiB/s wr, 573 op/s 2024-04-21T10:23:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:03 smithi170 ceph-mon[31212]: pgmap v52: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.1 MiB/s wr, 573 op/s 2024-04-21T10:23:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:03 smithi077 ceph-mon[27902]: pgmap v52: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.1 MiB/s wr, 573 op/s 2024-04-21T10:23:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 80.0 s, 3338.6 tps, lat 29.910 ms stddev 52.097 2024-04-21T10:23:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:05 smithi191 ceph-mon[31636]: pgmap v53: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.1 MiB/s wr, 573 op/s 2024-04-21T10:23:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:05 smithi170 ceph-mon[31212]: pgmap v53: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.1 MiB/s wr, 573 op/s 2024-04-21T10:23:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:05 smithi077 ceph-mon[27902]: pgmap v53: 97 pgs: 97 active+clean; 994 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.1 MiB/s wr, 573 op/s 2024-04-21T10:23:07.687 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:07 smithi077 ceph-mon[27902]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 29 MiB/s wr, 2.14k op/s 2024-04-21T10:23:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:07 smithi191 ceph-mon[31636]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 29 MiB/s wr, 2.14k op/s 2024-04-21T10:23:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:07 smithi170 ceph-mon[31212]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 29 MiB/s wr, 2.14k op/s 2024-04-21T10:23:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:09 smithi191 ceph-mon[31636]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 27 MiB/s wr, 1.90k op/s 2024-04-21T10:23:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:09 smithi170 ceph-mon[31212]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 27 MiB/s wr, 1.90k op/s 2024-04-21T10:23:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:09 smithi077 ceph-mon[27902]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 27 MiB/s wr, 1.90k op/s 2024-04-21T10:23:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 85.0 s, 3872.4 tps, lat 25.741 ms stddev 27.233 2024-04-21T10:23:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:11 smithi191 ceph-mon[31636]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 30 MiB/s wr, 2.24k op/s 2024-04-21T10:23:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 -- 172.21.15.77:0/2419830322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4101310 msgr2=0x7f7ac41016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 --2- 172.21.15.77:0/2419830322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4101310 0x7f7ac41016f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009900 tx=0x7f7ac002bc30 comp rx=0 tx=0).stop 2024-04-21T10:23:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 -- 172.21.15.77:0/2419830322 shutdown_connections 2024-04-21T10:23:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 --2- 172.21.15.77:0/2419830322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4106190 0x7f7ac410dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 --2- 172.21.15.77:0/2419830322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac4101cc0 0x7f7ac4105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 --2- 172.21.15.77:0/2419830322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4101310 0x7f7ac41016f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 -- 172.21.15.77:0/2419830322 >> 172.21.15.77:0/2419830322 conn(0x7f7ac4077cc0 msgr2=0x7f7ac40780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 -- 172.21.15.77:0/2419830322 shutdown_connections 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 -- 172.21.15.77:0/2419830322 wait complete. 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 Processor -- start 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 -- start start 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.769+0000 7f7acbb15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4101310 0x7f7ac4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7acbb15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 0x7f7ac4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7acbb15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac419d010 0x7f7ac419d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7acbb15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac4111170 con 0x7f7ac4106190 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7acbb15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac4110ff0 con 0x7f7ac419d010 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7acbb15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41112f0 con 0x7f7ac4101310 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac98b1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4101310 0x7f7ac4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 0x7f7ac4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac98b1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4101310 0x7f7ac4198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:60668/0 (socket says 172.21.15.77:60668) 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 0x7f7ac4198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51498/0 (socket says 172.21.15.77:51498) 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac98b1640 1 -- 172.21.15.77:0/1670830695 learned_addr learned my addr 172.21.15.77:0/1670830695 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac419d010 0x7f7ac419d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 -- 172.21.15.77:0/1670830695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4101310 msgr2=0x7f7ac4198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4101310 0x7f7ac4198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 -- 172.21.15.77:0/1670830695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac419d010 msgr2=0x7f7ac419d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac419d010 0x7f7ac419d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.770+0000 7f7ac90b0640 1 -- 172.21.15.77:0/1670830695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac419db00 con 0x7f7ac4106190 2024-04-21T10:23:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.771+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 0x7f7ac4198c90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e9c0 tx=0x7f7ab400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.771+0000 7f7abaffd640 1 -- 172.21.15.77:0/1670830695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400ccc0 con 0x7f7ac4106190 2024-04-21T10:23:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.771+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac419ddf0 con 0x7f7ac4106190 2024-04-21T10:23:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.771+0000 7f7abaffd640 1 -- 172.21.15.77:0/1670830695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab40108e0 con 0x7f7ac4106190 2024-04-21T10:23:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.771+0000 7f7abaffd640 1 -- 172.21.15.77:0/1670830695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40187a0 con 0x7f7ac4106190 2024-04-21T10:23:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.771+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac41a55e0 con 0x7f7ac4106190 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.773+0000 7f7abaffd640 1 -- 172.21.15.77:0/1670830695 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f7ab4010430 con 0x7f7ac4106190 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 Processor -- start 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 -- start start 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7abaffd640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7ab00a3dc0 0x7f7ab00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9a6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9a6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557b8e90b8d0 con 0x557b8e9a78d0 2024-04-21T10:23:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557b8e8a8e80 con 0x557b8e9b00e0 2024-04-21T10:23:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557b8e907890 con 0x557b8e9a6b60 2024-04-21T10:23:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.774+0000 7f7abaffd640 1 -- 172.21.15.77:0/1670830695 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f7ab40d0b60 con 0x7f7ac4106190 2024-04-21T10:23:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9a6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9a6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:60676/0 (socket says 172.21.15.77:60676) 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 -- 172.21.15.77:0/828701488 learned_addr learned my addr 172.21.15.77:0/828701488 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7ab00a3dc0 0x7f7ab00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 -- 172.21.15.77:0/828701488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 msgr2=0x557b8e9b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 -- 172.21.15.77:0/828701488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 msgr2=0x557b8e9a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.775+0000 7f7ac90b0640 1 -- 172.21.15.77:0/828701488 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8e8ca320 con 0x557b8e9a6b60 2024-04-21T10:23:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.776+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9a6fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4099500 tx=0x7f7ab409d230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b9a567d14ec37f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.776+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7ab00a3dc0 0x7f7ab00a6280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x557b8e9a29e0 tx=0x7f7abc009a60 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.776+0000 7f7aaffff640 1 -- 172.21.15.77:0/828701488 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab409de60 con 0x557b8e9a6b60 2024-04-21T10:23:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.777+0000 7f7aaffff640 1 -- 172.21.15.77:0/828701488 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab40a57a0 con 0x557b8e9a6b60 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.777+0000 7f7aaffff640 1 -- 172.21.15.77:0/828701488 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40991a0 con 0x557b8e9a6b60 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.777+0000 7f7ace7e8740 1 -- 172.21.15.77:0/828701488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 msgr2=0x557b8e9a6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.777+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9a6fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4099500 tx=0x7f7ab409d230 comp rx=0 tx=0).stop 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 -- 172.21.15.77:0/828701488 shutdown_connections 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9a6fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/828701488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 -- 172.21.15.77:0/828701488 >> 172.21.15.77:0/828701488 conn(0x557b8e96dc90 msgr2=0x557b8e9a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 -- 172.21.15.77:0/828701488 shutdown_connections 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 -- 172.21.15.77:0/828701488 wait complete. 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 -- start start 2024-04-21T10:23:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 Processor -- start 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.778+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557b8e9b2e10 con 0x557b8e9a78d0 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557b8e893eb0 con 0x557b8e9b00e0 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557b8e9b2f90 con 0x557b8e9a6b60 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ace7e8740 10 client.0 _ll_register_callbacks cb 0x557b8e8c0b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7aca0b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51524/0 (socket says 172.21.15.77:51524) 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 -- 172.21.15.77:0/44827170 learned_addr learned my addr 172.21.15.77:0/44827170 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 -- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 msgr2=0x557b8e9afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 -- 172.21.15.77:0/44827170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 msgr2=0x557b8e9ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 -- 172.21.15.77:0/44827170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8e61e210 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9aceb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7ab409cac0 tx=0x7f7ab40a1010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0562e6e32af0b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7aad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7aad7fa640 1 -- 172.21.15.77:0/44827170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab409de60 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7aad7fa640 1 -- 172.21.15.77:0/44827170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f7ab40991a0 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab40a57a0 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7aad7fa640 1 -- 172.21.15.77:0/44827170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7ab409bf80 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ace7e8740 10 client.15810 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.779+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b8e6ea620 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7aad7fa640 1 -- 172.21.15.77:0/44827170 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab40a57a0 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7aad7fa640 1 -- 172.21.15.77:0/44827170 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7ab409bae0 con 0x557b8e9a78d0 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ace7e8740 10 client.15810 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ace7e8740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ace7e8740 20 client.15810 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8e9c0030 0x557b8e9c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ace7e8740 4 client.15810 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:23:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b8e91f880 con 0x557b8e9c0030 2024-04-21T10:23:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.780+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8e9c0030 0x557b8e9c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.781+0000 7f7aad7fa640 10 client.15810 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.781+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8e9c0030 0x557b8e9c2420 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10f0aa970cdce7ad server_cookie=f8f8174e6ba7b9b5 in_seq=0 out_seq=0 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7aad7fa640 1 -- 172.21.15.77:0/44827170 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557b8e91f880 con 0x557b8e9c0030 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7aad7fa640 10 client.15810 handle_command_reply: tid=0 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 client.15810 shutdown 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 msgr2=0x557b8e9aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9aceb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7ab409cac0 tx=0x7f7ab40a1010 comp rx=0 tx=0).stop 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 shutdown_connections 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8e9c0030 0x557b8e9c2420 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9a78d0 0x557b8e9aceb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7aad7fa640 0 client.15810 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9b00e0 0x557b8e9ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/44827170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 >> 172.21.15.77:0/44827170 conn(0x557b8e96dc90 msgr2=0x557b8e9a35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 shutdown_connections 2024-04-21T10:23:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 1 -- 172.21.15.77:0/44827170 wait complete. 2024-04-21T10:23:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.782+0000 7f7ace7e8740 20 client.15810 trim_cache size 0 max 16384 2024-04-21T10:23:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 Processor -- start 2024-04-21T10:23:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 -- start start 2024-04-21T10:23:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a6b60 0x557b8e9bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a78d0 0x557b8e9c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41ae170 con 0x557b8e9b00e0 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41aba40 con 0x557b8e9a6b60 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41a98b0 con 0x557b8e9a78d0 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7aca0b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ac98b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a6b60 0x557b8e9bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7aca0b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51534/0 (socket says 172.21.15.77:51534) 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7aca0b2640 1 -- 172.21.15.77:0/1449311610 learned_addr learned my addr 172.21.15.77:0/1449311610 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.802+0000 7f7ac90b0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a78d0 0x557b8e9c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aca0b2640 1 -- 172.21.15.77:0/1449311610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a78d0 msgr2=0x557b8e9c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a78d0 0x557b8e9c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aca0b2640 1 -- 172.21.15.77:0/1449311610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a6b60 msgr2=0x557b8e9bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a6b60 0x557b8e9bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aca0b2640 1 -- 172.21.15.77:0/1449311610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8e99d120 con 0x557b8e9b00e0 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a6b60 0x557b8e9bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9c7f60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7abc014680 tx=0x7f7abc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41248756860def5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aaf7fe640 1 -- 172.21.15.77:0/1449311610 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc004b20 con 0x557b8e9b00e0 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aaf7fe640 1 -- 172.21.15.77:0/1449311610 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7abc004cc0 con 0x557b8e9b00e0 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.803+0000 7f7aaf7fe640 1 -- 172.21.15.77:0/1449311610 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0042f0 con 0x557b8e9b00e0 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- 172.21.15.77:0/1449311610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 msgr2=0x557b8e9c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9c7f60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7abc014680 tx=0x7f7abc004ab0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- 172.21.15.77:0/1449311610 shutdown_connections 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9c7f60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a78d0 0x557b8e9c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/1449311610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a6b60 0x557b8e9bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- 172.21.15.77:0/1449311610 >> 172.21.15.77:0/1449311610 conn(0x557b8e96dc90 msgr2=0x557b8e9a1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- 172.21.15.77:0/1449311610 shutdown_connections 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- 172.21.15.77:0/1449311610 wait complete. 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- start start 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 Processor -- start 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a78d0 0x557b8e9b8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41a9f00 con 0x557b8e9b00e0 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41ab370 con 0x557b8e9a78d0 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac41aa5d0 con 0x557b8e9a6b60 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.804+0000 7f7ace7e8740 10 client.0 _ll_register_callbacks cb 0x7f7ab409c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7aca0b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7aca0b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51544/0 (socket says 172.21.15.77:51544) 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7aca0b2640 1 -- 172.21.15.77:0/2751808812 learned_addr learned my addr 172.21.15.77:0/2751808812 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a78d0 0x557b8e9b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac90b0640 1 -- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 msgr2=0x557b8e9b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac90b0640 1 -- 172.21.15.77:0/2751808812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 msgr2=0x557b8e9aa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9aa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7ac90b0640 1 -- 172.21.15.77:0/2751808812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8e9aaae0 con 0x557b8e9a78d0 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.805+0000 7f7aca0b2640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7ac90b0640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a78d0 0x557b8e9b8790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40ce8e0 tx=0x7f7ab40a2290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bffb5d5f1f876d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:11 smithi170 ceph-mon[31212]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 30 MiB/s wr, 2.24k op/s 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7aad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7aad7fa640 1 -- 172.21.15.77:0/2751808812 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab409de60 con 0x557b8e9a78d0 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7aad7fa640 1 -- 172.21.15.77:0/2751808812 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f7ab40991a0 con 0x557b8e9a78d0 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7abc004cc0 con 0x557b8e9a78d0 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7aad7fa640 1 -- 172.21.15.77:0/2751808812 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7ab4098dd0 con 0x557b8e9a78d0 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7ace7e8740 10 client.25184 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b8e9b1290 con 0x557b8e9a78d0 2024-04-21T10:23:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.806+0000 7f7aad7fa640 1 -- 172.21.15.77:0/2751808812 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7abc004cc0 con 0x557b8e9a78d0 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7aad7fa640 1 -- 172.21.15.77:0/2751808812 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7ab409b9f0 con 0x557b8e9a78d0 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ace7e8740 10 client.25184 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ace7e8740 10 client.25184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ace7e8740 20 client.25184 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8ea263d0 0x557b8ea287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ace7e8740 4 client.25184 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b8e8ab3d0 con 0x557b8ea263d0 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8ea263d0 0x557b8ea287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7aad7fa640 10 client.25184 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.807+0000 7f7ac98b1640 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8ea263d0 0x557b8ea287c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c9ed7e5ce66e28f server_cookie=d26164efa6d12404 in_seq=0 out_seq=0 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.819+0000 7f7aad7fa640 1 -- 172.21.15.77:0/2751808812 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b8e8ab3d0 con 0x557b8ea263d0 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.819+0000 7f7aad7fa640 10 client.25184 handle_command_reply: tid=0 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.819+0000 7f7ace7e8740 1 client.25184 shutdown 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.819+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a78d0 msgr2=0x557b8e9b8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.819+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a78d0 0x557b8e9b8790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40ce8e0 tx=0x7f7ab40a2290 comp rx=0 tx=0).stop 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 shutdown_connections 2024-04-21T10:23:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557b8ea263d0 0x557b8ea287c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b8e9b00e0 0x557b8e9aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7aad7fa640 0 client.25184 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b8e9a78d0 0x557b8e9b8790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 --2- 172.21.15.77:0/2751808812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b8e9a6b60 0x557b8e9b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 >> 172.21.15.77:0/2751808812 conn(0x557b8e96dc90 msgr2=0x557b8e9a7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 shutdown_connections 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 1 -- 172.21.15.77:0/2751808812 wait complete. 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7ace7e8740 20 client.25184 trim_cache size 0 max 16384 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:23:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:23:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:23:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:23:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7ab00a3dc0 msgr2=0x7f7ab00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7ab00a3dc0 0x7f7ab00a6280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x557b8e9a29e0 tx=0x7f7abc009a60 comp rx=0 tx=0).stop 2024-04-21T10:23:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 msgr2=0x7f7ac4198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 0x7f7ac4198c90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e9c0 tx=0x7f7ab400ee80 comp rx=0 tx=0).stop 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 shutdown_connections 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7ab00a3dc0 0x7f7ab00a6280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ac4106190 0x7f7ac4198c90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac419d010 0x7f7ac419d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 --2- 172.21.15.77:0/1670830695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac4101310 0x7f7ac4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.820+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 >> 172.21.15.77:0/1670830695 conn(0x7f7ac4077cc0 msgr2=0x7f7ac406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.821+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 shutdown_connections 2024-04-21T10:23:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:11.821+0000 7f7acbb15640 1 -- 172.21.15.77:0/1670830695 wait complete. 2024-04-21T10:23:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:11 smithi077 ceph-mon[27902]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 30 MiB/s wr, 2.24k op/s 2024-04-21T10:23:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:13 smithi191 ceph-mon[31636]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-04-21T10:23:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:13 smithi170 ceph-mon[31212]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-04-21T10:23:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:13 smithi077 ceph-mon[27902]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-04-21T10:23:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 90.0 s, 3917.4 tps, lat 25.594 ms stddev 26.303 2024-04-21T10:23:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:15 smithi191 ceph-mon[31636]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-04-21T10:23:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:15 smithi170 ceph-mon[31212]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-04-21T10:23:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:15 smithi077 ceph-mon[27902]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-04-21T10:23:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:17 smithi170 ceph-mon[31212]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 MiB/s wr, 2.23k op/s 2024-04-21T10:23:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:17 smithi077 ceph-mon[27902]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 MiB/s wr, 2.23k op/s 2024-04-21T10:23:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:17 smithi191 ceph-mon[31636]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 MiB/s wr, 2.23k op/s 2024-04-21T10:23:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:19 smithi191 ceph-mon[31636]: pgmap v60: 97 pgs: 97 active+clean; 1.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 667 op/s 2024-04-21T10:23:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:19 smithi170 ceph-mon[31212]: pgmap v60: 97 pgs: 97 active+clean; 1.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 667 op/s 2024-04-21T10:23:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:19 smithi077 ceph-mon[27902]: pgmap v60: 97 pgs: 97 active+clean; 1.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 667 op/s 2024-04-21T10:23:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 95.0 s, 4154.6 tps, lat 24.048 ms stddev 24.551 2024-04-21T10:23:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:21 smithi191 ceph-mon[31636]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 997 op/s 2024-04-21T10:23:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:21 smithi170 ceph-mon[31212]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 997 op/s 2024-04-21T10:23:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:21 smithi077 ceph-mon[27902]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 997 op/s 2024-04-21T10:23:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:23 smithi191 ceph-mon[31636]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 659 op/s 2024-04-21T10:23:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:23 smithi170 ceph-mon[31212]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 659 op/s 2024-04-21T10:23:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:23 smithi077 ceph-mon[27902]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 659 op/s 2024-04-21T10:23:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1664792572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 msgr2=0x7f9ec0106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1664792572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec0106a70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009930 tx=0x7f9eb002bc20 comp rx=0 tx=0).stop 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1664792572 shutdown_connections 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1664792572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ec0101270 0x7f9ec010d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1664792572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec01008b0 0x7f9ec0100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1664792572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec0106a70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.946+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1664792572 >> 172.21.15.77:0/1664792572 conn(0x7f9ec0076f50 msgr2=0x7f9ec00fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.947+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1664792572 shutdown_connections 2024-04-21T10:23:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.947+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1664792572 wait complete. 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.947+0000 7f9ec5fb2640 1 Processor -- start 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 -- start start 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ec01008b0 0x7f9ec0198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec0101270 0x7f9ec0198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0110020 con 0x7f9ec0106690 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec010fea0 con 0x7f9ec0101270 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec019cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55424/0 (socket says 172.21.15.77:55424) 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ebffff640 1 -- 172.21.15.77:0/1999498110 learned_addr learned my addr 172.21.15.77:0/1999498110 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01101a0 con 0x7f9ec01008b0 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.948+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ec01008b0 0x7f9ec0198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec0101270 0x7f9ec0198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebffff640 1 -- 172.21.15.77:0/1999498110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ec01008b0 msgr2=0x7f9ec0198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebffff640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ec01008b0 0x7f9ec0198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebffff640 1 -- 172.21.15.77:0/1999498110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec0101270 msgr2=0x7f9ec0198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebffff640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec0101270 0x7f9ec0198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebffff640 1 -- 172.21.15.77:0/1999498110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec019d680 con 0x7f9ec0106690 2024-04-21T10:23:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.949+0000 7f9ebffff640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec019cf50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009fd0 tx=0x7f9eb800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.950+0000 7f9ebcff9640 1 -- 172.21.15.77:0/1999498110 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8017070 con 0x7f9ec0106690 2024-04-21T10:23:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.950+0000 7f9ebcff9640 1 -- 172.21.15.77:0/1999498110 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb8003e20 con 0x7f9ec0106690 2024-04-21T10:23:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.950+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec019d970 con 0x7f9ec0106690 2024-04-21T10:23:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.950+0000 7f9ebcff9640 1 -- 172.21.15.77:0/1999498110 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8010460 con 0x7f9ec0106690 2024-04-21T10:23:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.950+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec01a5200 con 0x7f9ec0106690 2024-04-21T10:23:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.954+0000 7f9ebcff9640 1 -- 172.21.15.77:0/1999498110 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f9eb8003970 con 0x7f9ec0106690 2024-04-21T10:23:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.955+0000 7f9ec8ba1740 1 Processor -- start 2024-04-21T10:23:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.955+0000 7f9ec8ba1740 1 -- start start 2024-04-21T10:23:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe3b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe51f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55890fda28d0 con 0x55890fe4a320 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55890fd3fe80 con 0x55890fe3b760 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55890fd9e890 con 0x55890fe3ada0 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebcff9640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ea80a3ec0 0x7f9ea80a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe3b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55438/0 (socket says 172.21.15.77:55438) 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe3b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:39890/0 (socket says 172.21.15.77:39890) 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebeffd640 1 -- 172.21.15.77:0/3103809327 learned_addr learned my addr 172.21.15.77:0/3103809327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe51f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebffff640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ea80a3ec0 0x7f9ea80a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/3103809327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 msgr2=0x55890fe51f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe51f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/3103809327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 msgr2=0x55890fe4a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/3103809327 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890fd61320 con 0x55890fe3ada0 2024-04-21T10:23:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.956+0000 7f9ebcff9640 1 -- 172.21.15.77:0/1999498110 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9eb80d0580 con 0x7f9ec0106690 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.957+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe3b220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009230 tx=0x7f9eb0009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac87a51748b33bcf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.957+0000 7f9ea5ffb640 1 -- 172.21.15.77:0/3103809327 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0043070 con 0x55890fe3ada0 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.958+0000 7f9ea5ffb640 1 -- 172.21.15.77:0/3103809327 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb002c7d0 con 0x55890fe3ada0 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.958+0000 7f9ea5ffb640 1 -- 172.21.15.77:0/3103809327 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0005550 con 0x55890fe3ada0 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.959+0000 7f9ebffff640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ea80a3ec0 0x7f9ea80a6380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9eb809c480 tx=0x7f9eb80980f0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.959+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/3103809327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 msgr2=0x55890fe3b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.959+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe3b220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009230 tx=0x7f9eb0009610 comp rx=0 tx=0).stop 2024-04-21T10:23:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/3103809327 shutdown_connections 2024-04-21T10:23:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe51f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe3b220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/3103809327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/3103809327 >> 172.21.15.77:0/3103809327 conn(0x55890fe04c90 msgr2=0x55890fe39c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/3103809327 shutdown_connections 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/3103809327 wait complete. 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.960+0000 7f9ec8ba1740 1 -- start start 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 Processor -- start 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe51e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe4f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55890fe52620 con 0x55890fe4a320 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55890fd2aeb0 con 0x55890fe3b760 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55890fe527a0 con 0x55890fe3ada0 2024-04-21T10:23:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ec8ba1740 10 client.0 _ll_register_callbacks cb 0x55890fd57b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe4f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe51e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe4f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:46526/0 (socket says 172.21.15.77:46526) 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe51e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:39904/0 (socket says 172.21.15.77:39904) 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/56161669 learned_addr learned my addr 172.21.15.77:0/56161669 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 msgr2=0x55890fe51e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe51e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/56161669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 msgr2=0x55890fe4f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/56161669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890fab5210 con 0x55890fe3b760 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.961+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe51e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe4f1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005c40 tx=0x7f9eb002ccf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f04433545bd3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9e9effd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9e9effd640 1 -- 172.21.15.77:0/56161669 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb004e070 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9e9effd640 1 -- 172.21.15.77:0/56161669 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9eb0004100 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb002c7d0 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9e9effd640 1 -- 172.21.15.77:0/56161669 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9eb0043040 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 10 client.25196 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55890fb81620 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9e9effd640 1 -- 172.21.15.77:0/56161669 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb002c7d0 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9e9effd640 1 -- 172.21.15.77:0/56161669 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9eb0003680 con 0x55890fe3b760 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 10 client.25196 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 10 client.25196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 20 client.25196 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe61b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 4 client.25196 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.962+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55890fdb6880 con 0x55890fe5f720 2024-04-21T10:23:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.963+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe61b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.963+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe61b10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a5ab92bcb14268 server_cookie=fe2148477d9f51fa in_seq=0 out_seq=0 2024-04-21T10:23:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.963+0000 7f9e9effd640 10 client.25196 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.964+0000 7f9e9effd640 1 -- 172.21.15.77:0/56161669 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55890fdb6880 con 0x55890fe5f720 2024-04-21T10:23:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.964+0000 7f9e9effd640 10 client.25196 handle_command_reply: tid=0 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 client.25196 shutdown 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 msgr2=0x55890fe4f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe4f1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005c40 tx=0x7f9eb002ccf0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 shutdown_connections 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe61b10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9e9effd640 0 client.25196 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe4a320 0x55890fe4f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe3b760 0x55890fe4f1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/56161669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe51e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 >> 172.21.15.77:0/56161669 conn(0x55890fe04c90 msgr2=0x55890fe38b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 shutdown_connections 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/56161669 wait complete. 2024-04-21T10:23:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.965+0000 7f9ec8ba1740 20 client.25196 trim_cache size 0 max 16384 2024-04-21T10:23:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 Processor -- start 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 -- start start 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe5b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 0x55890fe37750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01adf70 con 0x55890fe3b760 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01ab840 con 0x55890fe4a320 2024-04-21T10:23:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01a96b0 con 0x55890fe3ada0 2024-04-21T10:23:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 0x55890fe37750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 0x55890fe37750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55454/0 (socket says 172.21.15.77:55454) 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.985+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/1962616008 learned_addr learned my addr 172.21.15.77:0/1962616008 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe5b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/1962616008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 msgr2=0x55890fe5b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe5b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/1962616008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 msgr2=0x55890fe518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/1962616008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890fe393a0 con 0x55890fe3b760 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 0x55890fe37750 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005dd0 tx=0x7f9eb0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211a33a97a030f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ea57fa640 1 -- 172.21.15.77:0/1962616008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb004e040 con 0x55890fe3b760 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ea57fa640 1 -- 172.21.15.77:0/1962616008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb002c7d0 con 0x55890fe3b760 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.986+0000 7f9ea57fa640 1 -- 172.21.15.77:0/1962616008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0003c40 con 0x55890fe3b760 2024-04-21T10:23:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1962616008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 msgr2=0x55890fe37750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 0x55890fe37750 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005dd0 tx=0x7f9eb0005fd0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1962616008 shutdown_connections 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3b760 0x55890fe37750 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1962616008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3ada0 0x55890fe5b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1962616008 >> 172.21.15.77:0/1962616008 conn(0x55890fe04c90 msgr2=0x55890fe37040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1962616008 shutdown_connections 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1962616008 wait complete. 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.987+0000 7f9ec8ba1740 1 -- start start 2024-04-21T10:23:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 Processor -- start 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3ada0 0x55890fec2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3b760 0x55890fe57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe57f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01a9d00 con 0x55890fe3ada0 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01ab170 con 0x55890fe4a320 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01aa3d0 con 0x55890fe3b760 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ec8ba1740 10 client.0 _ll_register_callbacks cb 0x7f9eb400aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3b760 0x55890fe57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3b760 0x55890fe57a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:39926/0 (socket says 172.21.15.77:39926) 2024-04-21T10:23:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.988+0000 7f9ebf7fe640 1 -- 172.21.15.77:0/1580311912 learned_addr learned my addr 172.21.15.77:0/1580311912 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.989+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3ada0 0x55890fec2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.989+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe57f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.989+0000 7f9ebeffd640 1 -- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3b760 msgr2=0x55890fe57a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.990+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3b760 0x55890fe57a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.990+0000 7f9ebeffd640 1 -- 172.21.15.77:0/1580311912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 msgr2=0x55890fe57f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.990+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe57f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.990+0000 7f9ebeffd640 1 -- 172.21.15.77:0/1580311912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890fe489b0 con 0x55890fe3ada0 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.990+0000 7f9ebeffd640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3ada0 0x55890fec2fd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400a2a0 tx=0x7f9eb400a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0aea5ce71586235 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.992+0000 7f9e9effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.992+0000 7f9e9effd640 1 -- 172.21.15.77:0/1580311912 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb402a040 con 0x55890fe3ada0 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.992+0000 7f9e9effd640 1 -- 172.21.15.77:0/1580311912 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9eb4004bc0 con 0x55890fe3ada0 2024-04-21T10:23:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.992+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb002c7d0 con 0x55890fe3ada0 2024-04-21T10:23:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.993+0000 7f9e9effd640 1 -- 172.21.15.77:0/1580311912 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9eb4004dc0 con 0x55890fe3ada0 2024-04-21T10:23:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.993+0000 7f9ec8ba1740 10 client.15834 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.993+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55890fe3e800 con 0x55890fe3ada0 2024-04-21T10:23:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.994+0000 7f9e9effd640 1 -- 172.21.15.77:0/1580311912 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb002c7d0 con 0x55890fe3ada0 2024-04-21T10:23:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.994+0000 7f9e9effd640 1 -- 172.21.15.77:0/1580311912 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9eb4030040 con 0x55890fe3ada0 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ec8ba1740 10 client.15834 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ec8ba1740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ec8ba1740 20 client.15834 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe40f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ec8ba1740 4 client.15834 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55890fd423d0 con 0x55890fe5f720 2024-04-21T10:23:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.995+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe40f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.997+0000 7f9ebf7fe640 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe40f80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17529fb405d9f03 server_cookie=d5daa63a34476843 in_seq=0 out_seq=0 2024-04-21T10:23:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:24.997+0000 7f9e9effd640 10 client.15834 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.022+0000 7f9e9effd640 1 -- 172.21.15.77:0/1580311912 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55890fd423d0 con 0x55890fe5f720 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.022+0000 7f9e9effd640 10 client.15834 handle_command_reply: tid=0 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.022+0000 7f9ec8ba1740 1 client.15834 shutdown 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.022+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3ada0 msgr2=0x55890fec2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.022+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3ada0 0x55890fec2fd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400a2a0 tx=0x7f9eb400a760 comp rx=0 tx=0).stop 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 shutdown_connections 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55890fe5f720 0x55890fe40f80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55890fe4a320 0x55890fe57f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9e9effd640 0 client.15834 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55890fe3b760 0x55890fe57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 --2- 172.21.15.77:0/1580311912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55890fe3ada0 0x55890fec2fd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 >> 172.21.15.77:0/1580311912 conn(0x55890fe04c90 msgr2=0x55890fe38b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 shutdown_connections 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 1 -- 172.21.15.77:0/1580311912 wait complete. 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec8ba1740 20 client.15834 trim_cache size 0 max 16384 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:23:25.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ea80a3ec0 msgr2=0x7f9ea80a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ea80a3ec0 0x7f9ea80a6380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9eb809c480 tx=0x7f9eb80980f0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 msgr2=0x7f9ec019cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.023+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec019cf50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009fd0 tx=0x7f9eb800b260 comp rx=0 tx=0).stop 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 shutdown_connections 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ea80a3ec0 0x7f9ea80a6380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec0106690 0x7f9ec019cf50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec0101270 0x7f9ec0198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 --2- 172.21.15.77:0/1999498110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ec01008b0 0x7f9ec0198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 >> 172.21.15.77:0/1999498110 conn(0x7f9ec0076f50 msgr2=0x7f9ec00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:25.026 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.024+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 shutdown_connections 2024-04-21T10:23:25.026 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:25.025+0000 7f9ec5fb2640 1 -- 172.21.15.77:0/1999498110 wait complete. 2024-04-21T10:23:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 100.0 s, 3894.4 tps, lat 25.641 ms stddev 25.817 2024-04-21T10:23:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:25 smithi191 ceph-mon[31636]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 659 op/s 2024-04-21T10:23:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:25 smithi170 ceph-mon[31212]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 659 op/s 2024-04-21T10:23:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:25 smithi077 ceph-mon[27902]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 659 op/s 2024-04-21T10:23:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:27 smithi191 ceph-mon[31636]: pgmap v64: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 995 op/s 2024-04-21T10:23:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:27 smithi170 ceph-mon[31212]: pgmap v64: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 995 op/s 2024-04-21T10:23:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:27 smithi077 ceph-mon[27902]: pgmap v64: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 995 op/s 2024-04-21T10:23:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:29 smithi191 ceph-mon[31636]: pgmap v65: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2024-04-21T10:23:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:29 smithi170 ceph-mon[31212]: pgmap v65: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2024-04-21T10:23:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:29 smithi077 ceph-mon[27902]: pgmap v65: 97 pgs: 97 active+clean; 1.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2024-04-21T10:23:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 105.0 s, 3942.5 tps, lat 25.360 ms stddev 25.399 2024-04-21T10:23:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:23:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:23:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:23:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: pgmap v66: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 1.00k op/s 2024-04-21T10:23:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:23:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:23:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: pgmap v66: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 1.00k op/s 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:23:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: pgmap v66: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 1.00k op/s 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:23:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:23:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:33 smithi170 ceph-mon[31212]: pgmap v67: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-04-21T10:23:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:33 smithi077 ceph-mon[27902]: pgmap v67: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-04-21T10:23:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:33 smithi191 ceph-mon[31636]: pgmap v67: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-04-21T10:23:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 110.0 s, 3695.6 tps, lat 27.131 ms stddev 29.095 2024-04-21T10:23:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:35 smithi170 ceph-mon[31212]: pgmap v68: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-04-21T10:23:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:35 smithi077 ceph-mon[27902]: pgmap v68: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-04-21T10:23:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:35 smithi191 ceph-mon[31636]: pgmap v68: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 712 op/s 2024-04-21T10:23:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:37 smithi170 ceph-mon[31212]: pgmap v69: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-04-21T10:23:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:37 smithi077 ceph-mon[27902]: pgmap v69: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 -- 172.21.15.77:0/2201167506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 msgr2=0x7f01fc1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 --2- 172.21.15.77:0/2201167506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc1014d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009900 tx=0x7f01ec02bc30 comp rx=0 tx=0).stop 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 -- 172.21.15.77:0/2201167506 shutdown_connections 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 --2- 172.21.15.77:0/2201167506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc106170 0x7f01fc10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 --2- 172.21.15.77:0/2201167506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc101aa0 0x7f01fc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 --2- 172.21.15.77:0/2201167506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc1014d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.145+0000 7f0202704640 1 -- 172.21.15.77:0/2201167506 >> 172.21.15.77:0/2201167506 conn(0x7f01fc077fd0 msgr2=0x7f01fc0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.147+0000 7f0202704640 1 -- 172.21.15.77:0/2201167506 shutdown_connections 2024-04-21T10:23:38.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.147+0000 7f0202704640 1 -- 172.21.15.77:0/2201167506 wait complete. 2024-04-21T10:23:38.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 Processor -- start 2024-04-21T10:23:38.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 -- start start 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc106170 0x7f01fc197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc19bf10 0x7f01fc19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc1110d0 con 0x7f01fc1010f0 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc110f50 con 0x7f01fc19bf10 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f0202704640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc111250 con 0x7f01fc106170 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.148+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc106170 0x7f01fc197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41402/0 (socket says 172.21.15.77:41402) 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fbfff640 1 -- 172.21.15.77:0/2667792965 learned_addr learned my addr 172.21.15.77:0/2667792965 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f0200ca1640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc19bf10 0x7f01fc19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 -- 172.21.15.77:0/2667792965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc19bf10 msgr2=0x7f01fc19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc19bf10 0x7f01fc19c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 -- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 msgr2=0x7f01fc197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 -- 172.21.15.77:0/2667792965 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc19ca00 con 0x7f01fc106170 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc106170 0x7f01fc197b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01f000e9c0 tx=0x7f01f000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.149+0000 7f01f97fa640 1 -- 172.21.15.77:0/2667792965 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f000ccc0 con 0x7f01fc106170 2024-04-21T10:23:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.150+0000 7f01f97fa640 1 -- 172.21.15.77:0/2667792965 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f0005020 con 0x7f01fc106170 2024-04-21T10:23:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.150+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc19ccf0 con 0x7f01fc106170 2024-04-21T10:23:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.150+0000 7f01f97fa640 1 -- 172.21.15.77:0/2667792965 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004a00 con 0x7f01fc106170 2024-04-21T10:23:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.150+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1a44e0 con 0x7f01fc106170 2024-04-21T10:23:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.154+0000 7f01f97fa640 1 -- 172.21.15.77:0/2667792965 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f01f00051d0 con 0x7f01fc106170 2024-04-21T10:23:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.154+0000 7f02053d5740 1 Processor -- start 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.154+0000 7f02053d5740 1 -- start start 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f02053d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 0x5648e884b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f02053d5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884bb60 0x5648e884bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f02053d5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f02053d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5648e87b08d0 con 0x5648e884c8d0 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f02053d5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5648e874de80 con 0x5648e88550e0 2024-04-21T10:23:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f02053d5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5648e87ac890 con 0x5648e884bb60 2024-04-21T10:23:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f0200ca1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 0x5648e884b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f0200ca1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 0x5648e884b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41418/0 (socket says 172.21.15.77:41418) 2024-04-21T10:23:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f0200ca1640 1 -- 172.21.15.77:0/3624229964 learned_addr learned my addr 172.21.15.77:0/3624229964 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.155+0000 7f01f97fa640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f01e40a3e40 0x7f01e40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f01fbfff640 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884bb60 0x5648e884bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f01f97fa640 1 -- 172.21.15.77:0/2667792965 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f01f00d0780 con 0x7f01fc106170 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f0200ca1640 1 -- 172.21.15.77:0/3624229964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884bb60 msgr2=0x5648e884bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f0200ca1640 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884bb60 0x5648e884bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f0200ca1640 1 -- 172.21.15.77:0/3624229964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 msgr2=0x5648e88574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f0200ca1640 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f0200ca1640 1 -- 172.21.15.77:0/3624229964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e876f320 con 0x5648e884c8d0 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:23:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.156+0000 7f0200ca1640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f01e40a3e40 0x7f01e40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.157+0000 7f0200ca1640 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 0x5648e884b620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009fc0 tx=0x7f01f4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78164e24a071491f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.157+0000 7f01e27fc640 1 -- 172.21.15.77:0/3624229964 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4013020 con 0x5648e884c8d0 2024-04-21T10:23:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.157+0000 7f01e27fc640 1 -- 172.21.15.77:0/3624229964 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f40131c0 con 0x5648e884c8d0 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.157+0000 7f01e27fc640 1 -- 172.21.15.77:0/3624229964 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f401da10 con 0x5648e884c8d0 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 -- 172.21.15.77:0/3624229964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 msgr2=0x5648e884b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f0200ca1640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f01e40a3e40 0x7f01e40a6300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01f401a000 tx=0x7f01f401c000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 0x5648e884b620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009fc0 tx=0x7f01f4010800 comp rx=0 tx=0).stop 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 -- 172.21.15.77:0/3624229964 shutdown_connections 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884bb60 0x5648e884bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 --2- 172.21.15.77:0/3624229964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884c8d0 0x5648e884b620 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 -- 172.21.15.77:0/3624229964 >> 172.21.15.77:0/3624229964 conn(0x5648e8812c90 msgr2=0x5648e8846850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 -- 172.21.15.77:0/3624229964 shutdown_connections 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.158+0000 7f02053d5740 1 -- 172.21.15.77:0/3624229964 wait complete. 2024-04-21T10:23:38.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.159+0000 7f02053d5740 1 -- start start 2024-04-21T10:23:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.159+0000 7f02053d5740 1 Processor -- start 2024-04-21T10:23:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.159+0000 7f02053d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884bb60 0x5648e8850430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f02053d5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8850970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f02053d5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f02053d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5648e8857d90 con 0x5648e884bb60 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f02053d5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5648e8738eb0 con 0x5648e88550e0 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f02053d5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5648e8857f10 con 0x5648e884c8d0 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f02053d5740 10 client.0 _ll_register_callbacks cb 0x5648e8765b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8850970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8850970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:46968/0 (socket says 172.21.15.77:46968) 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 -- 172.21.15.77:0/868759380 learned_addr learned my addr 172.21.15.77:0/868759380 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f0200ca1640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fbfff640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884bb60 0x5648e8850430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 -- 172.21.15.77:0/868759380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 msgr2=0x5648e88650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 -- 172.21.15.77:0/868759380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884bb60 msgr2=0x5648e8850430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884bb60 0x5648e8850430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.160+0000 7f01fb7fe640 1 -- 172.21.15.77:0/868759380 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e84c3210 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8850970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01f009c450 tx=0x7f01f009cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d430e7d65cd1a81 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01db7fe640 1 -- 172.21.15.77:0/868759380 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f001c040 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01db7fe640 1 -- 172.21.15.77:0/868759380 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f01f0098dc0 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f40131c0 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01db7fe640 1 -- 172.21.15.77:0/868759380 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01f00a4f30 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f02053d5740 10 client.25321 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5648e858f620 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01db7fe640 1 -- 172.21.15.77:0/868759380 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f40131c0 con 0x5648e884c8d0 2024-04-21T10:23:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.161+0000 7f01db7fe640 1 -- 172.21.15.77:0/868759380 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01f00984a0 con 0x5648e884c8d0 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f02053d5740 10 client.25321 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f02053d5740 10 client.25321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f02053d5740 20 client.25321 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f02053d5740 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e887a5c0 0x5648e887ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f02053d5740 4 client.25321 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648e87c4880 con 0x5648e887a5c0 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.162+0000 7f01fbfff640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e887a5c0 0x5648e887ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.163+0000 7f01db7fe640 10 client.25321 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.163+0000 7f01fbfff640 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e887a5c0 0x5648e887ca00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=638e169efca79553 server_cookie=f704f1deef36d6fa in_seq=0 out_seq=0 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f01db7fe640 1 -- 172.21.15.77:0/868759380 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5648e87c4880 con 0x5648e887a5c0 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f01db7fe640 10 client.25321 handle_command_reply: tid=0 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 client.25321 shutdown 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 msgr2=0x5648e8850970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8850970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01f009c450 tx=0x7f01f009cf90 comp rx=0 tx=0).stop 2024-04-21T10:23:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 shutdown_connections 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e887a5c0 0x5648e887ca00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e88550e0 0x5648e88650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8850970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f01db7fe640 0 client.25321 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 --2- 172.21.15.77:0/868759380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e884bb60 0x5648e8850430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 >> 172.21.15.77:0/868759380 conn(0x5648e8812c90 msgr2=0x5648e88485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.164+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 shutdown_connections 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.165+0000 7f02053d5740 1 -- 172.21.15.77:0/868759380 wait complete. 2024-04-21T10:23:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.165+0000 7f02053d5740 20 client.25321 trim_cache size 0 max 16384 2024-04-21T10:23:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.195+0000 7f02053d5740 1 Processor -- start 2024-04-21T10:23:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 -- start start 2024-04-21T10:23:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e884e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e88564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8882310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc1a5950 con 0x5648e88550e0 2024-04-21T10:23:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc072bf0 con 0x5648e884bb60 2024-04-21T10:23:38.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e884e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e884e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:44162/0 (socket says 172.21.15.77:44162) 2024-04-21T10:23:38.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f01fbfff640 1 -- 172.21.15.77:0/2030703604 learned_addr learned my addr 172.21.15.77:0/2030703604 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:38.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f01fb7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e88564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.196+0000 7f02053d5740 1 -- 172.21.15.77:0/2030703604 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc070a40 con 0x5648e884c8d0 2024-04-21T10:23:38.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.197+0000 7f01fb7fe640 1 -- 172.21.15.77:0/2030703604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 msgr2=0x5648e884e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.197+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e884e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.197+0000 7f01fb7fe640 1 -- 172.21.15.77:0/2030703604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 msgr2=0x5648e8882310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:23:38.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.197+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8882310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.197+0000 7f01fb7fe640 1 -- 172.21.15.77:0/2030703604 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e88513a0 con 0x5648e884c8d0 2024-04-21T10:23:38.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.199+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e88564d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01f0099120 tx=0x7f01f0087280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9b237c1203751c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.200+0000 7f01e1ffb640 1 -- 172.21.15.77:0/2030703604 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f001c040 con 0x5648e884c8d0 2024-04-21T10:23:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.200+0000 7f01e1ffb640 1 -- 172.21.15.77:0/2030703604 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f00984a0 con 0x5648e884c8d0 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.200+0000 7f01e1ffb640 1 -- 172.21.15.77:0/2030703604 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f009b9a0 con 0x5648e884c8d0 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 -- 172.21.15.77:0/2030703604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 msgr2=0x5648e88564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e88564d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01f0099120 tx=0x7f01f0087280 comp rx=0 tx=0).stop 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 -- 172.21.15.77:0/2030703604 shutdown_connections 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8882310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e88564d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 --2- 172.21.15.77:0/2030703604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e884e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 -- 172.21.15.77:0/2030703604 >> 172.21.15.77:0/2030703604 conn(0x5648e8812c90 msgr2=0x5648e88503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 -- 172.21.15.77:0/2030703604 shutdown_connections 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.203+0000 7f02053d5740 1 -- 172.21.15.77:0/2030703604 wait complete. 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.204+0000 7f02053d5740 1 -- start start 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.204+0000 7f02053d5740 1 Processor -- start 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.205+0000 7f02053d5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e88634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.205+0000 7f02053d5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8863a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.205+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e88634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e88634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:44172/0 (socket says 172.21.15.77:44172) 2024-04-21T10:23:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f01fbfff640 1 -- 172.21.15.77:0/1671479506 learned_addr learned my addr 172.21.15.77:0/1671479506 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8863a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8858570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc0710b0 con 0x5648e88550e0 2024-04-21T10:23:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc072520 con 0x5648e884bb60 2024-04-21T10:23:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.206+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc071780 con 0x5648e884c8d0 2024-04-21T10:23:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f0200ca1640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8858570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01fb7fe640 1 -- 172.21.15.77:0/1671479506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 msgr2=0x5648e88634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e88634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01fb7fe640 1 -- 172.21.15.77:0/1671479506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 msgr2=0x5648e8858570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8858570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01fb7fe640 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e8841f30 con 0x5648e884c8d0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01fb7fe640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8863a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5648e88419b0 tx=0x7f01f00989f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8799f478fb4e20 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f02053d5740 10 client.0 _ll_register_callbacks cb 0x7f01f0098330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f00984a0 con 0x5648e884c8d0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.207+0000 7f01db7fe640 10 client.25327 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f01db7fe640 1 -- 172.21.15.77:0/1671479506 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f00aa060 con 0x5648e884c8d0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f01db7fe640 1 -- 172.21.15.77:0/1671479506 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f01f0004da0 con 0x5648e884c8d0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f01db7fe640 1 -- 172.21.15.77:0/1671479506 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01f001c070 con 0x5648e884c8d0 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 10 client.25327 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5648e886b900 con 0x5648e884c8d0 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f01db7fe640 1 -- 172.21.15.77:0/1671479506 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01f009bba0 con 0x5648e884c8d0 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 10 client.25327 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 10 client.25327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 20 client.25327 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e886bcd0 0x5648e886e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 4 client.25327 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.208+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f01f00984a0 con 0x5648e886bcd0 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.209+0000 7f01fbfff640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e886bcd0 0x5648e886e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.209+0000 7f01fbfff640 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e886bcd0 0x5648e886e0f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b5c4ba56365551f server_cookie=ab43cc053301c21 in_seq=0 out_seq=0 2024-04-21T10:23:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.209+0000 7f01db7fe640 10 client.25327 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:37 smithi191 ceph-mon[31636]: pgmap v69: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.223+0000 7f01db7fe640 1 -- 172.21.15.77:0/1671479506 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f01f00984a0 con 0x5648e886bcd0 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.223+0000 7f01db7fe640 10 client.25327 handle_command_reply: tid=0 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.223+0000 7f02053d5740 1 client.25327 shutdown 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 msgr2=0x5648e8863a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8863a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5648e88419b0 tx=0x7f01f00989f0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 shutdown_connections 2024-04-21T10:23:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5648e886bcd0 0x5648e886e0f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f01db7fe640 0 client.25327 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5648e88550e0 0x5648e8858570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648e884c8d0 0x5648e8863a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 --2- 172.21.15.77:0/1671479506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648e884bb60 0x5648e88634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 >> 172.21.15.77:0/1671479506 conn(0x5648e8812c90 msgr2=0x5648e8853b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 shutdown_connections 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 1 -- 172.21.15.77:0/1671479506 wait complete. 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f02053d5740 20 client.25327 trim_cache size 0 max 16384 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:23:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:23:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f01e40a3e40 msgr2=0x7f01e40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f0202704640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f01e40a3e40 0x7f01e40a6300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01f401a000 tx=0x7f01f401c000 comp rx=0 tx=0).stop 2024-04-21T10:23:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc106170 msgr2=0x7f01fc197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.224+0000 7f0202704640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc106170 0x7f01fc197b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01f000e9c0 tx=0x7f01f000ee80 comp rx=0 tx=0).stop 2024-04-21T10:23:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 shutdown_connections 2024-04-21T10:23:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f01e40a3e40 0x7f01e40a6300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc19bf10 0x7f01fc19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01fc106170 0x7f01fc197b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 --2- 172.21.15.77:0/2667792965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc1010f0 0x7f01fc197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 >> 172.21.15.77:0/2667792965 conn(0x7f01fc077fd0 msgr2=0x7f01fc0ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 shutdown_connections 2024-04-21T10:23:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:38.225+0000 7f0202704640 1 -- 172.21.15.77:0/2667792965 wait complete. 2024-04-21T10:23:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:39 smithi170 ceph-mon[31212]: pgmap v70: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.7 MiB/s wr, 694 op/s 2024-04-21T10:23:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 115.0 s, 3460.2 tps, lat 28.502 ms stddev 30.532 2024-04-21T10:23:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:39 smithi077 ceph-mon[27902]: pgmap v70: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.7 MiB/s wr, 694 op/s 2024-04-21T10:23:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:39 smithi191 ceph-mon[31636]: pgmap v70: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.7 MiB/s wr, 694 op/s 2024-04-21T10:23:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:41 smithi170 ceph-mon[31212]: pgmap v71: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 MiB/s wr, 992 op/s 2024-04-21T10:23:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:41 smithi077 ceph-mon[27902]: pgmap v71: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 MiB/s wr, 992 op/s 2024-04-21T10:23:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:41 smithi191 ceph-mon[31636]: pgmap v71: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 MiB/s wr, 992 op/s 2024-04-21T10:23:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:43 smithi170 ceph-mon[31212]: pgmap v72: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-04-21T10:23:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:43 smithi077 ceph-mon[27902]: pgmap v72: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-04-21T10:23:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:43 smithi191 ceph-mon[31636]: pgmap v72: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-04-21T10:23:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 120.0 s, 3928.8 tps, lat 25.772 ms stddev 27.308 2024-04-21T10:23:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:45 smithi170 ceph-mon[31212]: pgmap v73: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 640 op/s 2024-04-21T10:23:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:45 smithi077 ceph-mon[27902]: pgmap v73: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 640 op/s 2024-04-21T10:23:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:45 smithi191 ceph-mon[31636]: pgmap v73: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 640 op/s 2024-04-21T10:23:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:47 smithi170 ceph-mon[31212]: pgmap v74: 97 pgs: 97 active+clean; 1.4 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 964 op/s 2024-04-21T10:23:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:47 smithi077 ceph-mon[27902]: pgmap v74: 97 pgs: 97 active+clean; 1.4 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 964 op/s 2024-04-21T10:23:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:47 smithi191 ceph-mon[31636]: pgmap v74: 97 pgs: 97 active+clean; 1.4 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 964 op/s 2024-04-21T10:23:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:49 smithi170 ceph-mon[31212]: pgmap v75: 97 pgs: 97 active+clean; 1.4 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.7 MiB/s wr, 644 op/s 2024-04-21T10:23:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 125.0 s, 3731.8 tps, lat 26.746 ms stddev 27.235 2024-04-21T10:23:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:49 smithi077 ceph-mon[27902]: pgmap v75: 97 pgs: 97 active+clean; 1.4 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.7 MiB/s wr, 644 op/s 2024-04-21T10:23:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:49 smithi191 ceph-mon[31636]: pgmap v75: 97 pgs: 97 active+clean; 1.4 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.7 MiB/s wr, 644 op/s 2024-04-21T10:23:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 -- 172.21.15.77:0/2490627536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 msgr2=0x7f0bd4107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2490627536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd4107390 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009900 tx=0x7f0bc402bc80 comp rx=0 tx=0).stop 2024-04-21T10:23:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 -- 172.21.15.77:0/2490627536 shutdown_connections 2024-04-21T10:23:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2490627536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 0x7f0bd410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2490627536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 0x7f0bd4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2490627536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd4107390 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 -- 172.21.15.77:0/2490627536 >> 172.21.15.77:0/2490627536 conn(0x7f0bd4076c50 msgr2=0x7f0bd4077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 -- 172.21.15.77:0/2490627536 shutdown_connections 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 -- 172.21.15.77:0/2490627536 wait complete. 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 Processor -- start 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.348+0000 7f0bdba93640 1 -- start start 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bdba93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 0x7f0bd410c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bdba93640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 0x7f0bd410cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bdba93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd41aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bdba93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd410fa20 con 0x7f0bd4106fb0 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bdba93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd410f8a0 con 0x7f0bd41011a0 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bdba93640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd410fba0 con 0x7f0bd4101b60 2024-04-21T10:23:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bda030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd41aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bda030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd41aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48854/0 (socket says 172.21.15.77:48854) 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bda030640 1 -- 172.21.15.77:0/2638456839 learned_addr learned my addr 172.21.15.77:0/2638456839 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 0x7f0bd410cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd982f640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 0x7f0bd410c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 -- 172.21.15.77:0/2638456839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 msgr2=0x7f0bd410c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 0x7f0bd410c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 -- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 msgr2=0x7f0bd41aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd41aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 -- 172.21.15.77:0/2638456839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd41aaf00 con 0x7f0bd4101b60 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bda030640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd41aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd982f640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 0x7f0bd410c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:23:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.349+0000 7f0bd902e640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 0x7f0bd410cb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000e9f0 tx=0x7f0bd000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.350+0000 7f0bcaffd640 1 -- 172.21.15.77:0/2638456839 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd000ccc0 con 0x7f0bd4101b60 2024-04-21T10:23:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.350+0000 7f0bcaffd640 1 -- 172.21.15.77:0/2638456839 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd00108e0 con 0x7f0bd4101b60 2024-04-21T10:23:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.350+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd41ab1f0 con 0x7f0bd4101b60 2024-04-21T10:23:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.350+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd41ab740 con 0x7f0bd4101b60 2024-04-21T10:23:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.350+0000 7f0bcaffd640 1 -- 172.21.15.77:0/2638456839 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd000ccc0 con 0x7f0bd4101b60 2024-04-21T10:23:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.355+0000 7f0bcaffd640 1 -- 172.21.15.77:0/2638456839 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f0bd0010a90 con 0x7f0bd4101b60 2024-04-21T10:23:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.356+0000 7f0bde763740 1 Processor -- start 2024-04-21T10:23:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.356+0000 7f0bcaffd640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0bc00a4040 0x7f0bc00a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.356+0000 7f0bcaffd640 1 -- 172.21.15.77:0/2638456839 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0bd00d0720 con 0x7f0bd4101b60 2024-04-21T10:23:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 -- start start 2024-04-21T10:23:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c880620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c880fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c88a0e0 0x561c8c88c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561c8c7e58d0 con 0x561c8c8818d0 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561c8c782e80 con 0x561c8c880b60 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bde763740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c8c7e1890 con 0x561c8c88a0e0 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bd902e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c880fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bd902e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c880fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:55576/0 (socket says 172.21.15.77:55576) 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.357+0000 7f0bd902e640 1 -- 172.21.15.77:0/3337594108 learned_addr learned my addr 172.21.15.77:0/3337594108 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.358+0000 7f0bd902e640 1 -- 172.21.15.77:0/3337594108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c88a0e0 msgr2=0x561c8c88c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.358+0000 7f0bd902e640 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c88a0e0 0x561c8c88c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.358+0000 7f0bd902e640 1 -- 172.21.15.77:0/3337594108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 msgr2=0x561c8c880620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.358+0000 7f0bd902e640 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c880620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.358+0000 7f0bd902e640 1 -- 172.21.15.77:0/3337594108 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8c7a4320 con 0x561c8c880b60 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.358+0000 7f0bd902e640 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c880fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00a4e30 tx=0x7f0bd009ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5938acb3caface4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.359+0000 7f0bda030640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0bc00a4040 0x7f0bc00a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.359+0000 7f0bbffff640 1 -- 172.21.15.77:0/3337594108 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00a0aa0 con 0x561c8c880b60 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.359+0000 7f0bbffff640 1 -- 172.21.15.77:0/3337594108 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd00a5360 con 0x561c8c880b60 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.359+0000 7f0bbffff640 1 -- 172.21.15.77:0/3337594108 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00a5130 con 0x561c8c880b60 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.362+0000 7f0bde763740 1 -- 172.21.15.77:0/3337594108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 msgr2=0x561c8c880fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.362+0000 7f0bde763740 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c880fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00a4e30 tx=0x7f0bd009ceb0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.364+0000 7f0bde763740 1 -- 172.21.15.77:0/3337594108 shutdown_connections 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.364+0000 7f0bde763740 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c88a0e0 0x561c8c88c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.364+0000 7f0bde763740 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c880fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.364+0000 7f0bde763740 1 --2- 172.21.15.77:0/3337594108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c880620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.364+0000 7f0bde763740 1 -- 172.21.15.77:0/3337594108 >> 172.21.15.77:0/3337594108 conn(0x561c8c847c90 msgr2=0x561c8c87b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.367+0000 7f0bda030640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0bc00a4040 0x7f0bc00a6500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x561c8c87c9e0 tx=0x7f0bcc009500 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.368+0000 7f0bde763740 1 -- 172.21.15.77:0/3337594108 shutdown_connections 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.369+0000 7f0bde763740 1 -- 172.21.15.77:0/3337594108 wait complete. 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.370+0000 7f0bde763740 1 -- start start 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.370+0000 7f0bde763740 1 Processor -- start 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.370+0000 7f0bde763740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c889b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bde763740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c8818d0 0x561c8c886ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bde763740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c887620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bde763740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561c8c88cdb0 con 0x561c8c88a0e0 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bda030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c887620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bda030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c887620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48876/0 (socket says 172.21.15.77:48876) 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bda030640 1 -- 172.21.15.77:0/663923002 learned_addr learned my addr 172.21.15.77:0/663923002 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561c8c76deb0 con 0x561c8c8818d0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c8c88cf30 con 0x561c8c880b60 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.371+0000 7f0bde763740 10 client.0 _ll_register_callbacks cb 0x561c8c79ab40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bd982f640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c889b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bd902e640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c8818d0 0x561c8c886ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bda030640 1 -- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 msgr2=0x561c8c889b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bda030640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c889b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bda030640 1 -- 172.21.15.77:0/663923002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c8818d0 msgr2=0x561c8c886ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bda030640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c8818d0 0x561c8c886ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bda030640 1 -- 172.21.15.77:0/663923002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c8c4f8210 con 0x561c8c88a0e0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bd902e640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c8818d0 0x561c8c886ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.373+0000 7f0bda030640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c887620 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009950 tx=0x7f0bcc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcbae0a62f1655a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/663923002 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc003970 con 0x561c8c88a0e0 2024-04-21T10:23:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd00a5360 con 0x561c8c88a0e0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/663923002 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0bcc003b10 con 0x561c8c88a0e0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/663923002 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bcc003d10 con 0x561c8c88a0e0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bde763740 10 client.15858 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.374+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561c8c5c4620 con 0x561c8c88a0e0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/663923002 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd00a5360 con 0x561c8c88a0e0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/663923002 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0bcc030630 con 0x561c8c88a0e0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bde763740 10 client.15858 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bde763740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bde763740 20 client.15858 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bde763740 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c89a5c0 0x561c8c89ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bde763740 4 client.15858 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c8c7f9880 con 0x561c8c89a5c0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bd982f640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c89a5c0 0x561c8c89ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.376+0000 7f0bbd7fa640 10 client.15858 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.377+0000 7f0bd982f640 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c89a5c0 0x561c8c89ca00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1915bb095f9b3a server_cookie=f80ddde6cc94f5f in_seq=0 out_seq=0 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.378+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/663923002 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561c8c7f9880 con 0x561c8c89a5c0 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.378+0000 7f0bbd7fa640 10 client.15858 handle_command_reply: tid=0 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.378+0000 7f0bde763740 1 client.15858 shutdown 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 msgr2=0x561c8c887620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c887620 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009950 tx=0x7f0bcc004ab0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 shutdown_connections 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c89a5c0 0x561c8c89ca00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c887620 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c8818d0 0x561c8c886ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 --2- 172.21.15.77:0/663923002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c889b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 >> 172.21.15.77:0/663923002 conn(0x561c8c847c90 msgr2=0x561c8c87d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.379+0000 7f0bbd7fa640 0 client.15858 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.380+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 shutdown_connections 2024-04-21T10:23:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.380+0000 7f0bde763740 1 -- 172.21.15.77:0/663923002 wait complete. 2024-04-21T10:23:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.380+0000 7f0bde763740 20 client.15858 trim_cache size 0 max 16384 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.405+0000 7f0bde763740 1 Processor -- start 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.405+0000 7f0bde763740 1 -- start start 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bde763740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c882790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bde763740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c8818d0 0x561c8c895cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bde763740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c889610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bde763740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41b6ba0 con 0x561c8c88a0e0 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bde763740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41b4470 con 0x561c8c880b60 2024-04-21T10:23:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bde763740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41b22c0 con 0x561c8c8818d0 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c889610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c889610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48886/0 (socket says 172.21.15.77:48886) 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 -- 172.21.15.77:0/2803049767 learned_addr learned my addr 172.21.15.77:0/2803049767 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bd982f640 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c882790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bd902e640 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c8818d0 0x561c8c895cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 -- 172.21.15.77:0/2803049767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c8818d0 msgr2=0x561c8c895cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c8818d0 0x561c8c895cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 -- 172.21.15.77:0/2803049767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 msgr2=0x561c8c882790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c882790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bda030640 1 -- 172.21.15.77:0/2803049767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8c88cf20 con 0x561c8c88a0e0 2024-04-21T10:23:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.406+0000 7f0bd902e640 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c8818d0 0x561c8c895cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.407+0000 7f0bda030640 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c889610 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0099a0 tx=0x7f0bcc00e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f603e19f9997a517 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.407+0000 7f0bbf7fe640 1 -- 172.21.15.77:0/2803049767 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc011c50 con 0x561c8c88a0e0 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.407+0000 7f0bbf7fe640 1 -- 172.21.15.77:0/2803049767 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bcc003970 con 0x561c8c88a0e0 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.407+0000 7f0bbf7fe640 1 -- 172.21.15.77:0/2803049767 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc027ba0 con 0x561c8c88a0e0 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- 172.21.15.77:0/2803049767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 msgr2=0x561c8c889610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c889610 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0099a0 tx=0x7f0bcc00e700 comp rx=0 tx=0).stop 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- 172.21.15.77:0/2803049767 shutdown_connections 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c88a0e0 0x561c8c889610 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c8818d0 0x561c8c895cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- 172.21.15.77:0/2803049767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c880b60 0x561c8c882790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- 172.21.15.77:0/2803049767 >> 172.21.15.77:0/2803049767 conn(0x561c8c847c90 msgr2=0x561c8c882080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- 172.21.15.77:0/2803049767 shutdown_connections 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- 172.21.15.77:0/2803049767 wait complete. 2024-04-21T10:23:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- start start 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 Processor -- start 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c892650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c88b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c88a0e0 0x561c8c88bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41b2930 con 0x561c8c8818d0 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41b3da0 con 0x561c8c88a0e0 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41b3000 con 0x561c8c880b60 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c892650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd902e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c88b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c892650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:44688/0 (socket says 172.21.15.77:44688) 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bde763740 10 client.0 _ll_register_callbacks cb 0x7f0bcc00eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 -- 172.21.15.77:0/4270631980 learned_addr learned my addr 172.21.15.77:0/4270631980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bda030640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c88a0e0 0x561c8c88bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 -- 172.21.15.77:0/4270631980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c88a0e0 msgr2=0x561c8c88bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c88a0e0 0x561c8c88bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 -- 172.21.15.77:0/4270631980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 msgr2=0x561c8c88b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c88b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd982f640 1 -- 172.21.15.77:0/4270631980 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c8c884380 con 0x561c8c880b60 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.409+0000 7f0bd902e640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c88b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bd982f640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c892650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0bc402c210 tx=0x7f0bc4004090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a97f721e363f11b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/4270631980 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc404c070 con 0x561c8c880b60 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/4270631980 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0bc402c9d0 con 0x561c8c880b60 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bcc003970 con 0x561c8c880b60 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/4270631980 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bc4058050 con 0x561c8c880b60 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bde763740 10 client.25342 fetch_fsmap learned FSMap version 24 2024-04-21T10:23:51.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561c8c88aa10 con 0x561c8c880b60 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.410+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/4270631980 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bcc003970 con 0x561c8c880b60 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/4270631980 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0bc4004880 con 0x561c8c880b60 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bde763740 10 client.25342 fetch_fsmap finished waiting for FSMap version 24 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bde763740 10 client.25342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bde763740 20 client.25342 populate_metadata read hostname 'smithi077' 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bde763740 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c900b80 0x561c8c902f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bde763740 4 client.25342 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c8c7853d0 con 0x561c8c900b80 2024-04-21T10:23:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bd902e640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c900b80 0x561c8c902f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:23:51.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bbd7fa640 10 client.25342 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:51.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.411+0000 7f0bd902e640 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c900b80 0x561c8c902f70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c180247681daad3 server_cookie=39fc8faa008643eb in_seq=0 out_seq=0 2024-04-21T10:23:51.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bbd7fa640 1 -- 172.21.15.77:0/4270631980 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c8c7853d0 con 0x561c8c900b80 2024-04-21T10:23:51.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bbd7fa640 10 client.25342 handle_command_reply: tid=0 2024-04-21T10:23:51.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 client.25342 shutdown 2024-04-21T10:23:51.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 msgr2=0x561c8c892650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c892650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0bc402c210 tx=0x7f0bc4004090 comp rx=0 tx=0).stop 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 shutdown_connections 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561c8c900b80 0x561c8c902f70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561c8c8818d0 0x561c8c88b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561c8c88a0e0 0x561c8c88bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 --2- 172.21.15.77:0/4270631980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c8c880b60 0x561c8c892650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 >> 172.21.15.77:0/4270631980 conn(0x561c8c847c90 msgr2=0x561c8c8857d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bbd7fa640 0 client.25342 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 shutdown_connections 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 1 -- 172.21.15.77:0/4270631980 wait complete. 2024-04-21T10:23:51.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.424+0000 7f0bde763740 20 client.25342 trim_cache size 0 max 16384 2024-04-21T10:23:51.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:23:51.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:23:51.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:23:51.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0bc00a4040 msgr2=0x7f0bc00a6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0bc00a4040 0x7f0bc00a6500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x561c8c87c9e0 tx=0x7f0bcc009500 comp rx=0 tx=0).stop 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 msgr2=0x7f0bd410cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 0x7f0bd410cb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000e9f0 tx=0x7f0bd000eeb0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 shutdown_connections 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0bc00a4040 0x7f0bc00a6500 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd4106fb0 0x7f0bd41aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bd4101b60 0x7f0bd410cb90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 --2- 172.21.15.77:0/2638456839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bd41011a0 0x7f0bd410c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:23:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 >> 172.21.15.77:0/2638456839 conn(0x7f0bd4076c50 msgr2=0x7f0bd41061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:23:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 shutdown_connections 2024-04-21T10:23:51.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:23:51.425+0000 7f0bdba93640 1 -- 172.21.15.77:0/2638456839 wait complete. 2024-04-21T10:23:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:51 smithi170 ceph-mon[31212]: pgmap v76: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 943 op/s 2024-04-21T10:23:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:51 smithi077 ceph-mon[27902]: pgmap v76: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 943 op/s 2024-04-21T10:23:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:51 smithi191 ceph-mon[31636]: pgmap v76: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 943 op/s 2024-04-21T10:23:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:53 smithi170 ceph-mon[31212]: pgmap v77: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 666 op/s 2024-04-21T10:23:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:53 smithi077 ceph-mon[27902]: pgmap v77: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 666 op/s 2024-04-21T10:23:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:53 smithi191 ceph-mon[31636]: pgmap v77: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 666 op/s 2024-04-21T10:23:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 130.0 s, 3445.7 tps, lat 29.070 ms stddev 30.168 2024-04-21T10:23:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:55 smithi170 ceph-mon[31212]: pgmap v78: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 643 op/s 2024-04-21T10:23:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:55 smithi077 ceph-mon[27902]: pgmap v78: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 643 op/s 2024-04-21T10:23:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:55 smithi191 ceph-mon[31636]: pgmap v78: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 643 op/s 2024-04-21T10:23:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:57 smithi170 ceph-mon[31212]: pgmap v79: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 11 MiB/s wr, 958 op/s 2024-04-21T10:23:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:57 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:23:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:57 smithi077 ceph-mon[27902]: pgmap v79: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 11 MiB/s wr, 958 op/s 2024-04-21T10:23:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:57 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:23:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:57 smithi191 ceph-mon[31636]: pgmap v79: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 11 MiB/s wr, 958 op/s 2024-04-21T10:23:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:57 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:24:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:23:59 smithi170 ceph-mon[31212]: pgmap v80: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-04-21T10:24:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 135.0 s, 3414.1 tps, lat 29.257 ms stddev 31.332 2024-04-21T10:24:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:23:59 smithi077 ceph-mon[27902]: pgmap v80: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-04-21T10:24:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:23:59 smithi191 ceph-mon[31636]: pgmap v80: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-04-21T10:24:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:01 smithi170 ceph-mon[31212]: pgmap v81: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 13 MiB/s wr, 952 op/s 2024-04-21T10:24:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:01 smithi077 ceph-mon[27902]: pgmap v81: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 13 MiB/s wr, 952 op/s 2024-04-21T10:24:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:01 smithi191 ceph-mon[31636]: pgmap v81: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 13 MiB/s wr, 952 op/s 2024-04-21T10:24:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:02 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:24:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:02 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:24:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:02 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:24:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:03 smithi077 ceph-mon[27902]: pgmap v82: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 9.1 MiB/s wr, 681 op/s 2024-04-21T10:24:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:03 smithi191 ceph-mon[31636]: pgmap v82: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 9.1 MiB/s wr, 681 op/s 2024-04-21T10:24:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:03 smithi170 ceph-mon[31212]: pgmap v82: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 9.1 MiB/s wr, 681 op/s 2024-04-21T10:24:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.544+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/803924713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf941010f0 msgr2=0x7fcf941014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.544+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/803924713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf941010f0 0x7fcf941014d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009900 tx=0x7fcf9002bc30 comp rx=0 tx=0).stop 2024-04-21T10:24:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/803924713 shutdown_connections 2024-04-21T10:24:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/803924713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf94106170 0x7fcf9410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/803924713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf94101aa0 0x7fcf94105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/803924713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf941010f0 0x7fcf941014d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/803924713 >> 172.21.15.77:0/803924713 conn(0x7fcf94077fd0 msgr2=0x7fcf940783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/803924713 shutdown_connections 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/803924713 wait complete. 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 Processor -- start 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.545+0000 7fcf9c7f4640 1 -- start start 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9c7f4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 0x7fcf9410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9c7f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf94106170 0x7fcf9410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9c7f4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf9410a6c0 0x7fcf9410ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9c7f4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9410fd20 con 0x7fcf94106170 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9c7f4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9410fba0 con 0x7fcf941010f0 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9c7f4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9410fea0 con 0x7fcf9410a6c0 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 0x7fcf9410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 0x7fcf9410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:59358/0 (socket says 172.21.15.77:59358) 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 -- 172.21.15.77:0/67236204 learned_addr learned my addr 172.21.15.77:0/67236204 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9ad91640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf9410a6c0 0x7fcf9410ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 -- 172.21.15.77:0/67236204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf9410a6c0 msgr2=0x7fcf9410ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf9410a6c0 0x7fcf9410ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 -- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf94106170 msgr2=0x7fcf9410da10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T10:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf94106170 0x7fcf9410da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.546+0000 7fcf9a590640 1 -- 172.21.15.77:0/67236204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9410b340 con 0x7fcf941010f0 2024-04-21T10:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.547+0000 7fcf9a590640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 0x7fcf9410d4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf90000c00 tx=0x7fcf9002c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.547+0000 7fcf8b7fe640 1 -- 172.21.15.77:0/67236204 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90043020 con 0x7fcf941010f0 2024-04-21T10:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.547+0000 7fcf8b7fe640 1 -- 172.21.15.77:0/67236204 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf9002cbb0 con 0x7fcf941010f0 2024-04-21T10:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.547+0000 7fcf8b7fe640 1 -- 172.21.15.77:0/67236204 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90003ac0 con 0x7fcf941010f0 2024-04-21T10:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.547+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf941151a0 con 0x7fcf941010f0 2024-04-21T10:24:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.548+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941155e0 con 0x7fcf941010f0 2024-04-21T10:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.550+0000 7fcf8b7fe640 1 -- 172.21.15.77:0/67236204 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fcf90046020 con 0x7fcf941010f0 2024-04-21T10:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.551+0000 7fcf8b7fe640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcf800a3f20 0x7fcf800a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.551+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcf800a3f20 0x7fcf800a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.551+0000 7fcf8b7fe640 1 -- 172.21.15.77:0/67236204 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcf900f2810 con 0x7fcf941010f0 2024-04-21T10:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.551+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcf800a3f20 0x7fcf800a63e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf9410be30 tx=0x7fcf84005b80 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.552+0000 7fcf9f3e4740 1 Processor -- start 2024-04-21T10:24:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.552+0000 7fcf9f3e4740 1 -- start start 2024-04-21T10:24:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.552+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde030d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.552+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 0x55dde03194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dde02728d0 con 0x55dde030db60 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 0x55dde03194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 0x55dde03194d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:56800/0 (socket says 172.21.15.77:56800) 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 -- 172.21.15.77:0/2919870047 learned_addr learned my addr 172.21.15.77:0/2919870047 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dde020fe80 con 0x55dde030e8d0 2024-04-21T10:24:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dde026e890 con 0x55dde03170e0 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 -- 172.21.15.77:0/2919870047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 msgr2=0x55dde030d620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde030d620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 -- 172.21.15.77:0/2919870047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 msgr2=0x55dde030dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.553+0000 7fcf9ad91640 1 -- 172.21.15.77:0/2919870047 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dde0231320 con 0x55dde03170e0 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.554+0000 7fcf9ad91640 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 0x55dde03194d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009f40 tx=0x7fcf8c010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8568befcaa04bee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.554+0000 7fcf88ff9640 1 -- 172.21.15.77:0/2919870047 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c003b70 con 0x55dde03170e0 2024-04-21T10:24:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.554+0000 7fcf88ff9640 1 -- 172.21.15.77:0/2919870047 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf8c003d10 con 0x55dde03170e0 2024-04-21T10:24:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.554+0000 7fcf88ff9640 1 -- 172.21.15.77:0/2919870047 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0119c0 con 0x55dde03170e0 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.555+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 msgr2=0x55dde03194d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.555+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 0x55dde03194d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009f40 tx=0x7fcf8c010860 comp rx=0 tx=0).stop 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 shutdown_connections 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde03170e0 0x55dde03194d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2919870047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde030d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 >> 172.21.15.77:0/2919870047 conn(0x55dde02d4c90 msgr2=0x55dde0308850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 shutdown_connections 2024-04-21T10:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.556+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2919870047 wait complete. 2024-04-21T10:24:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 -- start start 2024-04-21T10:24:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 Processor -- start 2024-04-21T10:24:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030db60 0x55dde0316b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde0313f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde0314600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dde0319e10 con 0x55dde03170e0 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dde01faeb0 con 0x55dde030e8d0 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dde0319f90 con 0x55dde030db60 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.557+0000 7fcf99d8f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde0313f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030db60 0x55dde0316b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf99d8f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde0313f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:59364/0 (socket says 172.21.15.77:59364) 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf99d8f640 1 -- 172.21.15.77:0/1210746870 learned_addr learned my addr 172.21.15.77:0/1210746870 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9ad91640 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde0314600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 -- 172.21.15.77:0/1210746870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 msgr2=0x55dde0313f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde0313f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 -- 172.21.15.77:0/1210746870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 msgr2=0x55dde0314600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde0314600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 -- 172.21.15.77:0/1210746870 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddff85210 con 0x55dde030db60 2024-04-21T10:24:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9f3e4740 10 client.0 _ll_register_callbacks cb 0x55dde0227b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9a590640 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030db60 0x55dde0316b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf900f00a0 tx=0x7fcf900be430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e674a8894ffa9120 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.558+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf8c003d10 con 0x55dde030db60 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.559+0000 7fcf7dffb640 1 -- 172.21.15.77:0/1210746870 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900be8f0 con 0x55dde030db60 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.559+0000 7fcf7dffb640 1 -- 172.21.15.77:0/1210746870 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcf90003c60 con 0x55dde030db60 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.559+0000 7fcf7dffb640 1 -- 172.21.15.77:0/1210746870 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcf90003e60 con 0x55dde030db60 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.559+0000 7fcf9f3e4740 10 client.25351 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.559+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55dde0051620 con 0x55dde030db60 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.559+0000 7fcf7dffb640 1 -- 172.21.15.77:0/1210746870 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcf900beb50 con 0x55dde030db60 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf9f3e4740 10 client.25351 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf9f3e4740 10 client.25351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf9f3e4740 20 client.25351 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde0326d10 0x55dde0329160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf9f3e4740 4 client.25351 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:24:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dde0286880 con 0x55dde0326d10 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde0326d10 0x55dde0329160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf7dffb640 10 client.25351 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.560+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde0326d10 0x55dde0329160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be517643b313cc11 server_cookie=96aa4d11b2ace34b in_seq=0 out_seq=0 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.561+0000 7fcf7dffb640 1 -- 172.21.15.77:0/1210746870 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dde0286880 con 0x55dde0326d10 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.561+0000 7fcf7dffb640 10 client.25351 handle_command_reply: tid=0 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.561+0000 7fcf9f3e4740 1 client.25351 shutdown 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030db60 msgr2=0x55dde0316b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030db60 0x55dde0316b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf900f00a0 tx=0x7fcf900be430 comp rx=0 tx=0).stop 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 shutdown_connections 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde0326d10 0x55dde0329160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde0314600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030e8d0 0x55dde0313f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/1210746870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030db60 0x55dde0316b80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 >> 172.21.15.77:0/1210746870 conn(0x55dde02d4c90 msgr2=0x55dde030a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf7dffb640 0 client.25351 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 shutdown_connections 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/1210746870 wait complete. 2024-04-21T10:24:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.562+0000 7fcf9f3e4740 20 client.25351 trim_cache size 0 max 16384 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 Processor -- start 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 -- start start 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0322d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde03170e0 0x55dde0316640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941bf100 con 0x55dde030db60 2024-04-21T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941bc970 con 0x55dde03170e0 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9404fce0 con 0x55dde030e8d0 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55492/0 (socket says 172.21.15.77:55492) 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 -- 172.21.15.77:0/101732084 learned_addr learned my addr 172.21.15.77:0/101732084 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9ad91640 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde03170e0 0x55dde0316640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0322d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 -- 172.21.15.77:0/101732084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 msgr2=0x55dde0322d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0322d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 -- 172.21.15.77:0/101732084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde03170e0 msgr2=0x55dde0316640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde03170e0 0x55dde0316640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 -- 172.21.15.77:0/101732084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dde030ce30 con 0x55dde030db60 2024-04-21T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.584+0000 7fcf9a590640 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030f790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcf9002ce10 tx=0x7fcf900f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e79e4912f32e779 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.585+0000 7fcf7ffff640 1 -- 172.21.15.77:0/101732084 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900bab90 con 0x55dde030db60 2024-04-21T10:24:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.585+0000 7fcf7ffff640 1 -- 172.21.15.77:0/101732084 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf8c003d10 con 0x55dde030db60 2024-04-21T10:24:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.585+0000 7fcf7ffff640 1 -- 172.21.15.77:0/101732084 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900c70d0 con 0x55dde030db60 2024-04-21T10:24:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/101732084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 msgr2=0x55dde030f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030f790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcf9002ce10 tx=0x7fcf900f2000 comp rx=0 tx=0).stop 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/101732084 shutdown_connections 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde03170e0 0x55dde0316640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0322d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/101732084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde030db60 0x55dde030f790 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/101732084 >> 172.21.15.77:0/101732084 conn(0x55dde02d4c90 msgr2=0x55dde030f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/101732084 shutdown_connections 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.586+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/101732084 wait complete. 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.587+0000 7fcf9f3e4740 1 -- start start 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.587+0000 7fcf9f3e4740 1 Processor -- start 2024-04-21T10:24:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 0x55dde0310b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0311090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde03115d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9411c110 con 0x55dde03170e0 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9411d580 con 0x55dde030db60 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 0x55dde0310b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9ad91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde03115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9a590640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 0x55dde0310b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:59386/0 (socket says 172.21.15.77:59386) 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9ad91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde03115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55504/0 (socket says 172.21.15.77:55504) 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9a590640 1 -- 172.21.15.77:0/2760639626 learned_addr learned my addr 172.21.15.77:0/2760639626 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0311090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9411c7e0 con 0x55dde030e8d0 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9f3e4740 10 client.0 _ll_register_callbacks cb 0x7fcf9002cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9a590640 1 -- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 msgr2=0x55dde0311090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.588+0000 7fcf9a590640 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0311090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9a590640 1 -- 172.21.15.77:0/2760639626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 msgr2=0x55dde03115d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9a590640 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde03115d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9a590640 1 -- 172.21.15.77:0/2760639626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dde0303f30 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9a590640 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 0x55dde0310b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf900be880 tx=0x7fcf9004f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4067954ba3448c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf7dffb640 1 -- 172.21.15.77:0/2760639626 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900cb030 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf8c003d10 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf7dffb640 1 -- 172.21.15.77:0/2760639626 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcf90003c60 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf7dffb640 1 -- 172.21.15.77:0/2760639626 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcf900c7560 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 10 client.25244 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dde0303f30 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf7dffb640 1 -- 172.21.15.77:0/2760639626 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf900be8f0 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf7dffb640 1 -- 172.21.15.77:0/2760639626 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcf900ddab0 con 0x55dde030db60 2024-04-21T10:24:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 10 client.25244 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 10 client.25244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 20 client.25244 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde038d5e0 0x55dde038f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 4 client.25244 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.589+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcf8c003d10 con 0x55dde038d5e0 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.590+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde038d5e0 0x55dde038f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.591+0000 7fcf7dffb640 10 client.25244 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.591+0000 7fcf99d8f640 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde038d5e0 0x55dde038f9d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db9bb3ca280b6c7 server_cookie=3e5c35f73646034f in_seq=0 out_seq=0 2024-04-21T10:24:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.628+0000 7fcf7dffb640 1 -- 172.21.15.77:0/2760639626 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fcf8c003d10 con 0x55dde038d5e0 2024-04-21T10:24:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.628+0000 7fcf7dffb640 10 client.25244 handle_command_reply: tid=0 2024-04-21T10:24:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.628+0000 7fcf9f3e4740 1 client.25244 shutdown 2024-04-21T10:24:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.629+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 msgr2=0x55dde0310b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.629+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 0x55dde0310b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf900be880 tx=0x7fcf9004f000 comp rx=0 tx=0).stop 2024-04-21T10:24:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 shutdown_connections 2024-04-21T10:24:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55dde038d5e0 0x55dde038f9d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dde03170e0 0x55dde03115d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dde030e8d0 0x55dde0311090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 --2- 172.21.15.77:0/2760639626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dde030db60 0x55dde0310b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 >> 172.21.15.77:0/2760639626 conn(0x55dde02d4c90 msgr2=0x55dde0309c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf7dffb640 0 client.25244 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 shutdown_connections 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 1 -- 172.21.15.77:0/2760639626 wait complete. 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.630+0000 7fcf9f3e4740 20 client.25244 trim_cache size 0 max 16384 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:24:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:24:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:24:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcf800a3f20 msgr2=0x7fcf800a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcf800a3f20 0x7fcf800a63e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf9410be30 tx=0x7fcf84005b80 comp rx=0 tx=0).stop 2024-04-21T10:24:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 msgr2=0x7fcf9410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 0x7fcf9410d4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf90000c00 tx=0x7fcf9002c6c0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 shutdown_connections 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcf800a3f20 0x7fcf800a63e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf94106170 0x7fcf9410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf9410a6c0 0x7fcf9410ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 --2- 172.21.15.77:0/67236204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf941010f0 0x7fcf9410d4d0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf90000c00 tx=0x7fcf9002c6c0 comp rx=0 tx=0).stop 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.631+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 >> 172.21.15.77:0/67236204 conn(0x7fcf94077fd0 msgr2=0x7fcf940febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.632+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 shutdown_connections 2024-04-21T10:24:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:04.632+0000 7fcf9c7f4640 1 -- 172.21.15.77:0/67236204 wait complete. 2024-04-21T10:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 140.0 s, 2379.2 tps, lat 42.119 ms stddev 115.765 2024-04-21T10:24:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:05 smithi077 ceph-mon[27902]: pgmap v83: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 8.9 MiB/s wr, 661 op/s 2024-04-21T10:24:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:05 smithi191 ceph-mon[31636]: pgmap v83: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 8.9 MiB/s wr, 661 op/s 2024-04-21T10:24:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:05 smithi170 ceph-mon[31212]: pgmap v83: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 8.9 MiB/s wr, 661 op/s 2024-04-21T10:24:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:07 smithi077 ceph-mon[27902]: pgmap v84: 97 pgs: 97 active+clean; 1.8 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 45 MiB/s wr, 1.65k op/s 2024-04-21T10:24:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:07 smithi191 ceph-mon[31636]: pgmap v84: 97 pgs: 97 active+clean; 1.8 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 45 MiB/s wr, 1.65k op/s 2024-04-21T10:24:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:07 smithi170 ceph-mon[31212]: pgmap v84: 97 pgs: 97 active+clean; 1.8 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 45 MiB/s wr, 1.65k op/s 2024-04-21T10:24:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 145.0 s, 3367.4 tps, lat 29.599 ms stddev 30.838 2024-04-21T10:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:09 smithi077 ceph-mon[27902]: pgmap v85: 97 pgs: 97 active+clean; 1.8 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 MiB/s wr, 1.34k op/s 2024-04-21T10:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:09 smithi191 ceph-mon[31636]: pgmap v85: 97 pgs: 97 active+clean; 1.8 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 MiB/s wr, 1.34k op/s 2024-04-21T10:24:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:09 smithi170 ceph-mon[31212]: pgmap v85: 97 pgs: 97 active+clean; 1.8 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 MiB/s wr, 1.34k op/s 2024-04-21T10:24:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:11 smithi077 ceph-mon[27902]: pgmap v86: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 45 MiB/s wr, 1.63k op/s 2024-04-21T10:24:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:11 smithi191 ceph-mon[31636]: pgmap v86: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 45 MiB/s wr, 1.63k op/s 2024-04-21T10:24:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:11 smithi170 ceph-mon[31212]: pgmap v86: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 45 MiB/s wr, 1.63k op/s 2024-04-21T10:24:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:13 smithi077 ceph-mon[27902]: pgmap v87: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 MiB/s wr, 1.33k op/s 2024-04-21T10:24:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:13 smithi191 ceph-mon[31636]: pgmap v87: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 MiB/s wr, 1.33k op/s 2024-04-21T10:24:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:13 smithi170 ceph-mon[31212]: pgmap v87: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 MiB/s wr, 1.33k op/s 2024-04-21T10:24:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 150.0 s, 3577.0 tps, lat 28.059 ms stddev 30.403 2024-04-21T10:24:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:15 smithi077 ceph-mon[27902]: pgmap v88: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 MiB/s wr, 1.30k op/s 2024-04-21T10:24:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:15 smithi191 ceph-mon[31636]: pgmap v88: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 MiB/s wr, 1.30k op/s 2024-04-21T10:24:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:15 smithi170 ceph-mon[31212]: pgmap v88: 97 pgs: 97 active+clean; 1.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 MiB/s wr, 1.30k op/s 2024-04-21T10:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.761+0000 7fb9a45ef640 1 -- 172.21.15.77:0/1226672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c101330 msgr2=0x7fb99c101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.761+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/1226672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c101330 0x7fb99c101710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009ca0 tx=0x7fb98c02c100 comp rx=0 tx=0).stop 2024-04-21T10:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.762+0000 7fb9a45ef640 1 -- 172.21.15.77:0/1226672135 shutdown_connections 2024-04-21T10:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.762+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/1226672135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c101ce0 0x7fb99c105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.762+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/1226672135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1061d0 0x7fb99c10dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.762+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/1226672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c101330 0x7fb99c101710 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009ca0 tx=0x7fb98c02c100 comp rx=0 tx=0).stop 2024-04-21T10:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.762+0000 7fb9a45ef640 1 -- 172.21.15.77:0/1226672135 >> 172.21.15.77:0/1226672135 conn(0x7fb99c077d30 msgr2=0x7fb99c078140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.764+0000 7fb9a45ef640 1 -- 172.21.15.77:0/1226672135 shutdown_connections 2024-04-21T10:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.764+0000 7fb9a45ef640 1 -- 172.21.15.77:0/1226672135 wait complete. 2024-04-21T10:24:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.765+0000 7fb9a45ef640 1 Processor -- start 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.765+0000 7fb9a45ef640 1 -- start start 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a45ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c1061d0 0x7fb99c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a45ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 0x7fb99c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a45ef640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1a4c40 0x7fb99c1a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a45ef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c06af50 con 0x7fb99c1061d0 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a45ef640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c06add0 con 0x7fb99c1a4c40 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a45ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c06b970 con 0x7fb99c19bdb0 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a1b8a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 0x7fb99c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a1b8a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 0x7fb99c1a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:43544/0 (socket says 172.21.15.77:43544) 2024-04-21T10:24:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/2134376271 learned_addr learned my addr 172.21.15.77:0/2134376271 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.766+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1a4c40 0x7fb99c1a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a238b640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c1061d0 0x7fb99c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/2134376271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1a4c40 msgr2=0x7fb99c1a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1a4c40 0x7fb99c1a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c1061d0 msgr2=0x7fb99c19b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c1061d0 0x7fb99c19b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/2134376271 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c06bb70 con 0x7fb99c19bdb0 2024-04-21T10:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1a4c40 0x7fb99c1a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.767+0000 7fb9a238b640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c1061d0 0x7fb99c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.768+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 0x7fb99c1a4700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d740 tx=0x7fb99000dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.768+0000 7fb99b7fe640 1 -- 172.21.15.77:0/2134376271 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990017070 con 0x7fb99c19bdb0 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.768+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c06be60 con 0x7fb99c19bdb0 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.768+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c06c400 con 0x7fb99c19bdb0 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.768+0000 7fb99b7fe640 1 -- 172.21.15.77:0/2134376271 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb99000de50 con 0x7fb99c19bdb0 2024-04-21T10:24:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.768+0000 7fb99b7fe640 1 -- 172.21.15.77:0/2134376271 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99000f620 con 0x7fb99c19bdb0 2024-04-21T10:24:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.771+0000 7fb99b7fe640 1 -- 172.21.15.77:0/2134376271 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fb99001a070 con 0x7fb99c19bdb0 2024-04-21T10:24:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.772+0000 7fb9a71da740 1 Processor -- start 2024-04-21T10:24:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.772+0000 7fb99b7fe640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9840a3e90 0x7fb9840a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.772+0000 7fb99b7fe640 1 -- 172.21.15.77:0/2134376271 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb9900d0110 con 0x7fb99c19bdb0 2024-04-21T10:24:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.772+0000 7fb9a71da740 1 -- start start 2024-04-21T10:24:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.772+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9840a3e90 0x7fb9840a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 0x5593a0a4e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4eb60 0x5593a0a4efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a5a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a71da740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5593a09b38d0 con 0x5593a0a4f8d0 2024-04-21T10:24:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a71da740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5593a0950e80 con 0x5593a0a4eb60 2024-04-21T10:24:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a71da740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5593a09af890 con 0x5593a0a580e0 2024-04-21T10:24:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 0x5593a0a4e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 0x5593a0a4e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42742/0 (socket says 172.21.15.77:42742) 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.773+0000 7fb9a238b640 1 -- 172.21.15.77:0/1731419981 learned_addr learned my addr 172.21.15.77:0/1731419981 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a238b640 1 -- 172.21.15.77:0/1731419981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 msgr2=0x5593a0a5a4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a238b640 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a5a4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a238b640 1 -- 172.21.15.77:0/1731419981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4eb60 msgr2=0x5593a0a4efe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a238b640 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4eb60 0x5593a0a4efe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a238b640 1 -- 172.21.15.77:0/1731419981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a0972320 con 0x5593a0a4f8d0 2024-04-21T10:24:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9840a3e90 0x7fb9840a6350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b960 tx=0x7fb994005bf0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.774+0000 7fb9a238b640 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 0x5593a0a4e620 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009ca0 tx=0x7fb98c032910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715f893aa8d856f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.775+0000 7fb998bfe640 1 -- 172.21.15.77:0/1731419981 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c043020 con 0x5593a0a4f8d0 2024-04-21T10:24:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.775+0000 7fb998bfe640 1 -- 172.21.15.77:0/1731419981 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c003970 con 0x5593a0a4f8d0 2024-04-21T10:24:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.775+0000 7fb998bfe640 1 -- 172.21.15.77:0/1731419981 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c039040 con 0x5593a0a4f8d0 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 -- 172.21.15.77:0/1731419981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 msgr2=0x5593a0a4e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 0x5593a0a4e620 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009ca0 tx=0x7fb98c032910 comp rx=0 tx=0).stop 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 -- 172.21.15.77:0/1731419981 shutdown_connections 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a5a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4eb60 0x5593a0a4efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1731419981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4f8d0 0x5593a0a4e620 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 -- 172.21.15.77:0/1731419981 >> 172.21.15.77:0/1731419981 conn(0x5593a0a15c90 msgr2=0x5593a0a49850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 -- 172.21.15.77:0/1731419981 shutdown_connections 2024-04-21T10:24:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 -- 172.21.15.77:0/1731419981 wait complete. 2024-04-21T10:24:17.777 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 -- start start 2024-04-21T10:24:17.777 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.776+0000 7fb9a71da740 1 Processor -- start 2024-04-21T10:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a57a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a54e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a57a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a57a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42750/0 (socket says 172.21.15.77:42750) 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5593a0a5adb0 con 0x5593a0a4eb60 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5593a093beb0 con 0x5593a0a4f8d0 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5593a0a5af30 con 0x5593a0a580e0 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a2b8c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a71da740 10 client.0 _ll_register_callbacks cb 0x5593a0968b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a2b8c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:43570/0 (socket says 172.21.15.77:43570) 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.777+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/2763306296 learned_addr learned my addr 172.21.15.77:0/2763306296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/2763306296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 msgr2=0x5593a0a54e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a54e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/2763306296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 msgr2=0x5593a0a57a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a57a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/2763306296 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a06c6210 con 0x5593a0a580e0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a553c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb99400f9a0 tx=0x7fb9940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddc5017feaba62f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb981ffb640 1 -- 172.21.15.77:0/2763306296 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99401f070 con 0x5593a0a580e0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb981ffb640 1 -- 172.21.15.77:0/2763306296 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb99400eac0 con 0x5593a0a580e0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.778+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb98c003970 con 0x5593a0a580e0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb981ffb640 1 -- 172.21.15.77:0/2763306296 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb99400fe60 con 0x5593a0a580e0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb9a71da740 10 client.25366 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5593a0792620 con 0x5593a0a580e0 2024-04-21T10:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb981ffb640 1 -- 172.21.15.77:0/2763306296 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c003970 con 0x5593a0a580e0 2024-04-21T10:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb981ffb640 1 -- 172.21.15.77:0/2763306296 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb99402e420 con 0x5593a0a580e0 2024-04-21T10:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb9a71da740 10 client.25366 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb9a71da740 10 client.25366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.779+0000 7fb9a71da740 20 client.25366 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.780+0000 7fb9a71da740 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0a681d0 0x5593a0a6a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.780+0000 7fb9a71da740 4 client.25366 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.780+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593a09c7880 con 0x5593a0a681d0 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.780+0000 7fb9a238b640 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0a681d0 0x5593a0a6a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.781+0000 7fb9a238b640 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0a681d0 0x5593a0a6a650 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27255d7f6fa5f0cf server_cookie=42eda29af2e9270 in_seq=0 out_seq=0 2024-04-21T10:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.781+0000 7fb981ffb640 10 client.25366 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.782+0000 7fb981ffb640 1 -- 172.21.15.77:0/2763306296 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5593a09c7880 con 0x5593a0a681d0 2024-04-21T10:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.782+0000 7fb981ffb640 10 client.25366 handle_command_reply: tid=0 2024-04-21T10:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.782+0000 7fb9a71da740 1 client.25366 shutdown 2024-04-21T10:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 msgr2=0x5593a0a553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a553c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb99400f9a0 tx=0x7fb9940046c0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 shutdown_connections 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0a681d0 0x5593a0a6a650 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a553c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a54e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 --2- 172.21.15.77:0/2763306296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a57a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 >> 172.21.15.77:0/2763306296 conn(0x5593a0a15c90 msgr2=0x5593a0a4b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb981ffb640 0 client.25366 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 shutdown_connections 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 1 -- 172.21.15.77:0/2763306296 wait complete. 2024-04-21T10:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.783+0000 7fb9a71da740 20 client.25366 trim_cache size 0 max 16384 2024-04-21T10:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.806+0000 7fb9a71da740 1 Processor -- start 2024-04-21T10:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.806+0000 7fb9a71da740 1 -- start start 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.806+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a63d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.806+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a57550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.806+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a57a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.806+0000 7fb9a71da740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb988010e10 con 0x5593a0a4eb60 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a71da740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb98800e680 con 0x5593a0a4f8d0 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a57a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a63d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a71da740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb98800c580 con 0x5593a0a580e0 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a57a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:43572/0 (socket says 172.21.15.77:43572) 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/3915735869 learned_addr learned my addr 172.21.15.77:0/3915735869 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a57550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/3915735869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 msgr2=0x5593a0a57550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a57550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/3915735869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 msgr2=0x5593a0a63d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a63d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 -- 172.21.15.77:0/3915735869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a0a66cf0 con 0x5593a0a580e0 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a238b640 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a63d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a57550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a57a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb994005b60 tx=0x7fb99400d7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae16a86feac2cd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.807+0000 7fb983fff640 1 -- 172.21.15.77:0/3915735869 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99401f070 con 0x5593a0a580e0 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.808+0000 7fb983fff640 1 -- 172.21.15.77:0/3915735869 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb99402ec60 con 0x5593a0a580e0 2024-04-21T10:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.808+0000 7fb983fff640 1 -- 172.21.15.77:0/3915735869 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994024a30 con 0x5593a0a580e0 2024-04-21T10:24:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 -- 172.21.15.77:0/3915735869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 msgr2=0x5593a0a57a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a57a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb994005b60 tx=0x7fb99400d7e0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 -- 172.21.15.77:0/3915735869 shutdown_connections 2024-04-21T10:24:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a580e0 0x5593a0a57a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a4f8d0 0x5593a0a57550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 --2- 172.21.15.77:0/3915735869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a63d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.809+0000 7fb9a71da740 1 -- 172.21.15.77:0/3915735869 >> 172.21.15.77:0/3915735869 conn(0x5593a0a15c90 msgr2=0x5593a0a49380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.810+0000 7fb9a71da740 1 -- 172.21.15.77:0/3915735869 shutdown_connections 2024-04-21T10:24:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.810+0000 7fb9a71da740 1 -- 172.21.15.77:0/3915735869 wait complete. 2024-04-21T10:24:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.810+0000 7fb9a71da740 1 -- start start 2024-04-21T10:24:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.810+0000 7fb9a71da740 1 Processor -- start 2024-04-21T10:24:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a60280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a4f8d0 0x5593a0a607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a580e0 0x5593a0a5b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb98800cb40 con 0x5593a0a4eb60 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb98800dfb0 con 0x5593a0a580e0 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb98800d210 con 0x5593a0a4f8d0 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a60280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a238b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a60280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42760/0 (socket says 172.21.15.77:42760) 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a238b640 1 -- 172.21.15.77:0/1320133102 learned_addr learned my addr 172.21.15.77:0/1320133102 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a71da740 10 client.0 _ll_register_callbacks cb 0x7fb994013050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a4f8d0 0x5593a0a607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a2b8c640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a580e0 0x5593a0a5b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/1320133102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a580e0 msgr2=0x5593a0a5b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a580e0 0x5593a0a5b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/1320133102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 msgr2=0x5593a0a60280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a60280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 -- 172.21.15.77:0/1320133102 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a0a5c000 con 0x5593a0a4f8d0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a238b640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a60280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.811+0000 7fb9a1b8a640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a4f8d0 0x5593a0a607c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9900cd890 tx=0x7fb99009ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b8869e4239f9bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb981ffb640 1 -- 172.21.15.77:0/1320133102 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990021040 con 0x5593a0a4f8d0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb981ffb640 1 -- 172.21.15.77:0/1320133102 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb990010460 con 0x5593a0a4f8d0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb99402ec60 con 0x5593a0a4f8d0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb981ffb640 1 -- 172.21.15.77:0/1320133102 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb990010660 con 0x5593a0a4f8d0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb9a71da740 10 client.25372 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.812+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5593a0ace420 con 0x5593a0a4f8d0 2024-04-21T10:24:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb981ffb640 1 -- 172.21.15.77:0/1320133102 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb99402ec60 con 0x5593a0a4f8d0 2024-04-21T10:24:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb981ffb640 1 -- 172.21.15.77:0/1320133102 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb9900a1620 con 0x5593a0a4f8d0 2024-04-21T10:24:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb9a71da740 10 client.25372 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb9a71da740 10 client.25372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb9a71da740 20 client.25372 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0acec00 0x5593a0ad1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:17.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb9a71da740 4 client.25372 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:24:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.813+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593a09533d0 con 0x5593a0acec00 2024-04-21T10:24:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.814+0000 7fb9a238b640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0acec00 0x5593a0ad1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.814+0000 7fb9a238b640 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0acec00 0x5593a0ad1020 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e1f0b47f7e51d5 server_cookie=7d7a49d7d924a964 in_seq=0 out_seq=0 2024-04-21T10:24:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.814+0000 7fb981ffb640 10 client.25372 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.825+0000 7fb981ffb640 1 -- 172.21.15.77:0/1320133102 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593a09533d0 con 0x5593a0acec00 2024-04-21T10:24:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.825+0000 7fb981ffb640 10 client.25372 handle_command_reply: tid=0 2024-04-21T10:24:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.825+0000 7fb9a71da740 1 client.25372 shutdown 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a4f8d0 msgr2=0x5593a0a607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a4f8d0 0x5593a0a607c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9900cd890 tx=0x7fb99009ccb0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 shutdown_connections 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5593a0acec00 0x5593a0ad1020 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593a0a580e0 0x5593a0a5b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593a0a4f8d0 0x5593a0a607c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 --2- 172.21.15.77:0/1320133102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593a0a4eb60 0x5593a0a60280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 >> 172.21.15.77:0/1320133102 conn(0x5593a0a15c90 msgr2=0x5593a0a4aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb981ffb640 0 client.25372 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 shutdown_connections 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 1 -- 172.21.15.77:0/1320133102 wait complete. 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.826+0000 7fb9a71da740 20 client.25372 trim_cache size 0 max 16384 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:24:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:24:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9840a3e90 msgr2=0x7fb9840a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9840a3e90 0x7fb9840a6350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b960 tx=0x7fb994005bf0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 msgr2=0x7fb99c1a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 0x7fb99c1a4700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d740 tx=0x7fb99000dc00 comp rx=0 tx=0).stop 2024-04-21T10:24:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 shutdown_connections 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb9840a3e90 0x7fb9840a6350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb99c1a4c40 0x7fb99c1a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb99c19bdb0 0x7fb99c1a4700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 --2- 172.21.15.77:0/2134376271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99c1061d0 0x7fb99c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 >> 172.21.15.77:0/2134376271 conn(0x7fb99c077d30 msgr2=0x7fb99c102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 shutdown_connections 2024-04-21T10:24:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:17.827+0000 7fb9a45ef640 1 -- 172.21.15.77:0/2134376271 wait complete. 2024-04-21T10:24:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:17 smithi077 ceph-mon[27902]: pgmap v89: 97 pgs: 97 active+clean; 1.9 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 43 MiB/s wr, 1.62k op/s 2024-04-21T10:24:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:17 smithi191 ceph-mon[31636]: pgmap v89: 97 pgs: 97 active+clean; 1.9 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 43 MiB/s wr, 1.62k op/s 2024-04-21T10:24:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:17 smithi170 ceph-mon[31212]: pgmap v89: 97 pgs: 97 active+clean; 1.9 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 43 MiB/s wr, 1.62k op/s 2024-04-21T10:24:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 155.0 s, 3412.2 tps, lat 29.185 ms stddev 31.485 2024-04-21T10:24:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:19 smithi077 ceph-mon[27902]: pgmap v90: 97 pgs: 97 active+clean; 1.9 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 624 op/s 2024-04-21T10:24:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:19 smithi191 ceph-mon[31636]: pgmap v90: 97 pgs: 97 active+clean; 1.9 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 624 op/s 2024-04-21T10:24:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:19 smithi170 ceph-mon[31212]: pgmap v90: 97 pgs: 97 active+clean; 1.9 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 624 op/s 2024-04-21T10:24:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:21 smithi077 ceph-mon[27902]: pgmap v91: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 922 op/s 2024-04-21T10:24:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:21 smithi191 ceph-mon[31636]: pgmap v91: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 922 op/s 2024-04-21T10:24:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:21 smithi170 ceph-mon[31212]: pgmap v91: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 922 op/s 2024-04-21T10:24:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:23 smithi077 ceph-mon[27902]: pgmap v92: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 654 op/s 2024-04-21T10:24:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:23 smithi191 ceph-mon[31636]: pgmap v92: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 654 op/s 2024-04-21T10:24:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:23 smithi170 ceph-mon[31212]: pgmap v92: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 654 op/s 2024-04-21T10:24:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 160.0 s, 3280.0 tps, lat 30.612 ms stddev 34.605 2024-04-21T10:24:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:25 smithi077 ceph-mon[27902]: pgmap v93: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 632 op/s 2024-04-21T10:24:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:25 smithi191 ceph-mon[31636]: pgmap v93: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 632 op/s 2024-04-21T10:24:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:25 smithi170 ceph-mon[31212]: pgmap v93: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 632 op/s 2024-04-21T10:24:28.107 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:27 smithi170 ceph-mon[31212]: pgmap v94: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 938 op/s 2024-04-21T10:24:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:27 smithi077 ceph-mon[27902]: pgmap v94: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 938 op/s 2024-04-21T10:24:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:27 smithi191 ceph-mon[31636]: pgmap v94: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 938 op/s 2024-04-21T10:24:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 165.0 s, 3644.2 tps, lat 27.430 ms stddev 28.689 2024-04-21T10:24:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:29 smithi077 ceph-mon[27902]: pgmap v95: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 626 op/s 2024-04-21T10:24:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:29 smithi191 ceph-mon[31636]: pgmap v95: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 626 op/s 2024-04-21T10:24:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:29 smithi170 ceph-mon[31212]: pgmap v95: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 626 op/s 2024-04-21T10:24:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 -- 172.21.15.77:0/651033126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100101a50 msgr2=0x7f8100105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 --2- 172.21.15.77:0/651033126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100101a50 0x7f8100105a90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009860 tx=0x7f80f402bb70 comp rx=0 tx=0).stop 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 -- 172.21.15.77:0/651033126 shutdown_connections 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 --2- 172.21.15.77:0/651033126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100101a50 0x7f8100105a90 secure :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009860 tx=0x7f80f402bb70 comp rx=0 tx=0).stop 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 --2- 172.21.15.77:0/651033126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8100106170 0x7f810010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 --2- 172.21.15.77:0/651033126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81001010a0 0x7f8100101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.950+0000 7f8106750640 1 -- 172.21.15.77:0/651033126 >> 172.21.15.77:0/651033126 conn(0x7f81000fc920 msgr2=0x7f81000fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.951+0000 7f8106750640 1 -- 172.21.15.77:0/651033126 shutdown_connections 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.951+0000 7f8106750640 1 -- 172.21.15.77:0/651033126 wait complete. 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 Processor -- start 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 -- start start 2024-04-21T10:24:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81001010a0 0x7f8100196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 0x7f8100196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810019afa0 0x7f810019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f810010ff70 con 0x7f8100106170 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f810010fdf0 con 0x7f810019afa0 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8106750640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f81001100f0 con 0x7f81001010a0 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 0x7f8100196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f8104ced640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810019afa0 0x7f810019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 0x7f8100196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49076/0 (socket says 172.21.15.77:49076) 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f80ff7fe640 1 -- 172.21.15.77:0/853061535 learned_addr learned my addr 172.21.15.77:0/853061535 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.952+0000 7f80fffff640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81001010a0 0x7f8100196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80ff7fe640 1 -- 172.21.15.77:0/853061535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81001010a0 msgr2=0x7f8100196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81001010a0 0x7f8100196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80ff7fe640 1 -- 172.21.15.77:0/853061535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810019afa0 msgr2=0x7f810019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810019afa0 0x7f810019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80ff7fe640 1 -- 172.21.15.77:0/853061535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810019ba90 con 0x7f8100106170 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 0x7f8100196c70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80f40057c0 tx=0x7f80f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f80fffff640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81001010a0 0x7f8100196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.953+0000 7f8104ced640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810019afa0 0x7f810019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.954+0000 7f80fd7fa640 1 -- 172.21.15.77:0/853061535 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4039040 con 0x7f8100106170 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.954+0000 7f80fd7fa640 1 -- 172.21.15.77:0/853061535 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f40347b0 con 0x7f8100106170 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.954+0000 7f80fd7fa640 1 -- 172.21.15.77:0/853061535 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f403c390 con 0x7f8100106170 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.954+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810019bd20 con 0x7f8100106170 2024-04-21T10:24:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.954+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81001a3430 con 0x7f8100106170 2024-04-21T10:24:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.956+0000 7f80fd7fa640 1 -- 172.21.15.77:0/853061535 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f80f4044060 con 0x7f8100106170 2024-04-21T10:24:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.957+0000 7f80fd7fa640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f80e80a3f20 0x7f80e80a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.957+0000 7f80fd7fa640 1 -- 172.21.15.77:0/853061535 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f80f40f0f30 con 0x7f8100106170 2024-04-21T10:24:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.957+0000 7f80fffff640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f80e80a3f20 0x7f80e80a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 Processor -- start 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 -- start start 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161ad620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5575161128d0 con 0x5575161b70e0 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5575160afe80 con 0x5575161adb60 2024-04-21T10:24:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f810941b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55751610e890 con 0x5575161ae8d0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f80fffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f80fffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:54588/0 (socket says 172.21.15.77:54588) 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f80fffff640 1 -- 172.21.15.77:0/1777679078 learned_addr learned my addr 172.21.15.77:0/1777679078 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f80fffff640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f80e80a3f20 0x7f80e80a63e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80f0005fd0 tx=0x7f80f0012040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.958+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f8104ced640 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80fffff640 1 -- 172.21.15.77:0/1777679078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 msgr2=0x5575161adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80fffff640 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80fffff640 1 -- 172.21.15.77:0/1777679078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 msgr2=0x5575161b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80fffff640 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80fffff640 1 -- 172.21.15.77:0/1777679078 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575160d1320 con 0x5575161ae8d0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f8104ced640 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80fffff640 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161ad620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80f000b960 tx=0x7f80f001d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47a9d88ca0e9ce38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.959+0000 7f80e67fc640 1 -- 172.21.15.77:0/1777679078 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f001c970 con 0x5575161ae8d0 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f80e67fc640 1 -- 172.21.15.77:0/1777679078 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f00047a0 con 0x5575161ae8d0 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f80e67fc640 1 -- 172.21.15.77:0/1777679078 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00053c0 con 0x5575161ae8d0 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 -- 172.21.15.77:0/1777679078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 msgr2=0x5575161ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161ad620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80f000b960 tx=0x7f80f001d000 comp rx=0 tx=0).stop 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 -- 172.21.15.77:0/1777679078 shutdown_connections 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 --2- 172.21.15.77:0/1777679078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161ad620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.960+0000 7f810941b740 1 -- 172.21.15.77:0/1777679078 >> 172.21.15.77:0/1777679078 conn(0x557516174c90 msgr2=0x5575161a8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.961+0000 7f810941b740 1 -- 172.21.15.77:0/1777679078 shutdown_connections 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.961+0000 7f810941b740 1 -- 172.21.15.77:0/1777679078 wait complete. 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.961+0000 7f810941b740 1 -- start start 2024-04-21T10:24:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.961+0000 7f810941b740 1 Processor -- start 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161ae8d0 0x5575161b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161ae8d0 0x5575161b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161b70e0 0x5575161b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5575161cae20 con 0x5575161ae8d0 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55751609aeb0 con 0x5575161adb60 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5575161cafa0 con 0x5575161b70e0 2024-04-21T10:24:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f80fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f810941b740 10 client.0 _ll_register_callbacks cb 0x5575160c7b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161ae8d0 0x5575161b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49100/0 (socket says 172.21.15.77:49100) 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.962+0000 7f80ff7fe640 1 -- 172.21.15.77:0/1960835320 learned_addr learned my addr 172.21.15.77:0/1960835320 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161b70e0 0x5575161b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 -- 172.21.15.77:0/1960835320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 msgr2=0x5575161b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 -- 172.21.15.77:0/1960835320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161ae8d0 msgr2=0x5575161b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161ae8d0 0x5575161b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 -- 172.21.15.77:0/1960835320 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557515e25210 con 0x5575161b70e0 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f8104ced640 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161b70e0 0x5575161b4370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5575161ae600 tx=0x7f80f8009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed0fce3a9d1d51b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f80df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:24:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f80df7fe640 1 -- 172.21.15.77:0/1960835320 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8009cf0 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f80df7fe640 1 -- 172.21.15.77:0/1960835320 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f80f8009040 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f00047a0 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f80df7fe640 1 -- 172.21.15.77:0/1960835320 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f80f8004b20 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f810941b740 10 client.25384 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.963+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557515ef1620 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f80df7fe640 1 -- 172.21.15.77:0/1960835320 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f00047a0 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f80df7fe640 1 -- 172.21.15.77:0/1960835320 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f80f8016410 con 0x5575161b70e0 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f810941b740 10 client.25384 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f810941b740 10 client.25384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f810941b740 20 client.25384 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f810941b740 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5575161e0980 0x5575161e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f810941b740 4 client.25384 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557516126880 con 0x5575161e0980 2024-04-21T10:24:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.964+0000 7f80fffff640 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5575161e0980 0x5575161e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.965+0000 7f80fffff640 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5575161e0980 0x5575161e2d70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18228625a4a09365 server_cookie=2048ade085fcc8cf in_seq=0 out_seq=0 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.965+0000 7f80df7fe640 10 client.25384 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f80df7fe640 1 -- 172.21.15.77:0/1960835320 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557516126880 con 0x5575161e0980 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f80df7fe640 10 client.25384 handle_command_reply: tid=0 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 client.25384 shutdown 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161b70e0 msgr2=0x5575161b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161b70e0 0x5575161b4370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5575161ae600 tx=0x7f80f8009610 comp rx=0 tx=0).stop 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 shutdown_connections 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5575161e0980 0x5575161e2d70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161ae8d0 0x5575161b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161b70e0 0x5575161b4370 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 --2- 172.21.15.77:0/1960835320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161adb60 0x5575161b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f80df7fe640 0 client.25384 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 >> 172.21.15.77:0/1960835320 conn(0x557516174c90 msgr2=0x5575161aa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 shutdown_connections 2024-04-21T10:24:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 1 -- 172.21.15.77:0/1960835320 wait complete. 2024-04-21T10:24:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.966+0000 7f810941b740 20 client.25384 trim_cache size 0 max 16384 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 Processor -- start 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 -- start start 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161adb60 0x5575161b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161ae8d0 0x5575161b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161e8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81001a5e70 con 0x5575161b70e0 2024-04-21T10:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81001a36e0 con 0x5575161ae8d0 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f810941b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8100072050 con 0x5575161adb60 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f80fffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161adb60 0x5575161b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f80fffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161adb60 0x5575161b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:54608/0 (socket says 172.21.15.77:54608) 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f80fffff640 1 -- 172.21.15.77:0/998790888 learned_addr learned my addr 172.21.15.77:0/998790888 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161ae8d0 0x5575161b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f80ff7fe640 1 -- 172.21.15.77:0/998790888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161adb60 msgr2=0x5575161b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.989+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161adb60 0x5575161b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f8104ced640 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80ff7fe640 1 -- 172.21.15.77:0/998790888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 msgr2=0x5575161e8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161e8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80ff7fe640 1 -- 172.21.15.77:0/998790888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575161a3f30 con 0x5575161ae8d0 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f8104ced640 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161e8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161ae8d0 0x5575161b6a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009830 tx=0x7f80f4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe960d8960511d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80e5ffb640 1 -- 172.21.15.77:0/998790888 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40da020 con 0x5575161ae8d0 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80e5ffb640 1 -- 172.21.15.77:0/998790888 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f40d5070 con 0x5575161ae8d0 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.990+0000 7f80e5ffb640 1 -- 172.21.15.77:0/998790888 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f402cb80 con 0x5575161ae8d0 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.991+0000 7f810941b740 1 -- 172.21.15.77:0/998790888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161ae8d0 msgr2=0x5575161b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.991+0000 7f810941b740 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161ae8d0 0x5575161b6a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009830 tx=0x7f80f4005f90 comp rx=0 tx=0).stop 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 -- 172.21.15.77:0/998790888 shutdown_connections 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161b70e0 0x5575161e8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161ae8d0 0x5575161b6a60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 --2- 172.21.15.77:0/998790888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161adb60 0x5575161b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 -- 172.21.15.77:0/998790888 >> 172.21.15.77:0/998790888 conn(0x557516174c90 msgr2=0x5575161af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 -- 172.21.15.77:0/998790888 shutdown_connections 2024-04-21T10:24:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 -- 172.21.15.77:0/998790888 wait complete. 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.992+0000 7f810941b740 1 -- start start 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.993+0000 7f810941b740 1 Processor -- start 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.993+0000 7f810941b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161adb60 0x5575161d3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f810941b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f810941b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161b70e0 0x557516244ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161adb60 0x5575161d3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161adb60 0x5575161d3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49108/0 (socket says 172.21.15.77:49108) 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:54616/0 (socket says 172.21.15.77:54616) 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80fffff640 1 -- 172.21.15.77:0/331203911 learned_addr learned my addr 172.21.15.77:0/331203911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81000726c0 con 0x5575161adb60 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8100073b30 con 0x5575161b70e0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8100072d90 con 0x5575161ae8d0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f810941b740 10 client.0 _ll_register_callbacks cb 0x7f80f800ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f8104ced640 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161b70e0 0x557516244ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 -- 172.21.15.77:0/331203911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161b70e0 msgr2=0x557516244ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161b70e0 0x557516244ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 -- 172.21.15.77:0/331203911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161adb60 msgr2=0x5575161d3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161adb60 0x5575161d3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.994+0000 7f80ff7fe640 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557516245410 con 0x5575161ae8d0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161d41b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80f40bcae0 tx=0x7f80f40c13c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ded2d70050671e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80df7fe640 1 -- 172.21.15.77:0/331203911 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40da070 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80df7fe640 1 -- 172.21.15.77:0/331203911 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f80f4034b90 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f40d5070 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80df7fe640 1 -- 172.21.15.77:0/331203911 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f80f40bd710 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f810941b740 10 client.25390 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557516246650 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80df7fe640 1 -- 172.21.15.77:0/331203911 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f40d5070 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f80df7fe640 1 -- 172.21.15.77:0/331203911 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f80f403c070 con 0x5575161ae8d0 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f810941b740 10 client.25390 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.995+0000 7f810941b740 10 client.25390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f810941b740 20 client.25390 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f810941b740 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557516246b90 0x557516248fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f810941b740 4 client.25390 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575160b23d0 con 0x557516246b90 2024-04-21T10:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f80fffff640 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557516246b90 0x557516248fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f80fffff640 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557516246b90 0x557516248fb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1656f460f45aefa server_cookie=67063c0c78897309 in_seq=0 out_seq=0 2024-04-21T10:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:30.996+0000 7f80df7fe640 10 client.25390 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.006+0000 7f80df7fe640 1 -- 172.21.15.77:0/331203911 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575160b23d0 con 0x557516246b90 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.006+0000 7f80df7fe640 10 client.25390 handle_command_reply: tid=0 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.006+0000 7f810941b740 1 client.25390 shutdown 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 msgr2=0x5575161d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161d41b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80f40bcae0 tx=0x7f80f40c13c0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 shutdown_connections 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557516246b90 0x557516248fb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575161b70e0 0x557516244ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575161ae8d0 0x5575161d41b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 --2- 172.21.15.77:0/331203911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5575161adb60 0x5575161d3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 >> 172.21.15.77:0/331203911 conn(0x557516174c90 msgr2=0x5575161b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f80df7fe640 0 client.25390 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 shutdown_connections 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 1 -- 172.21.15.77:0/331203911 wait complete. 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.007+0000 7f810941b740 20 client.25390 trim_cache size 0 max 16384 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f80e80a3f20 msgr2=0x7f80e80a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f80e80a3f20 0x7f80e80a63e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80f0005fd0 tx=0x7f80f0012040 comp rx=0 tx=0).stop 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 msgr2=0x7f8100196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 0x7f8100196c70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80f40057c0 tx=0x7f80f40042f0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 shutdown_connections 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f80e80a3f20 0x7f80e80a63e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100106170 0x7f8100196c70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810019afa0 0x7f810019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 --2- 172.21.15.77:0/853061535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81001010a0 0x7f8100196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.008+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 >> 172.21.15.77:0/853061535 conn(0x7f81000fc920 msgr2=0x7f81000fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.009+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 shutdown_connections 2024-04-21T10:24:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:31.009+0000 7f8106750640 1 -- 172.21.15.77:0/853061535 wait complete. 2024-04-21T10:24:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:31 smithi077 ceph-mon[27902]: pgmap v96: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-04-21T10:24:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:24:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:31 smithi191 ceph-mon[31636]: pgmap v96: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-04-21T10:24:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:24:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:31 smithi170 ceph-mon[31212]: pgmap v96: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-04-21T10:24:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:24:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:24:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:24:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:24:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:24:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:24:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:24:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:24:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:24:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:24:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:33 smithi077 ceph-mon[27902]: pgmap v97: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 741 op/s 2024-04-21T10:24:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:33 smithi191 ceph-mon[31636]: pgmap v97: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 741 op/s 2024-04-21T10:24:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:33 smithi170 ceph-mon[31212]: pgmap v97: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 741 op/s 2024-04-21T10:24:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 170.0 s, 3474.4 tps, lat 28.684 ms stddev 31.216 2024-04-21T10:24:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:35 smithi077 ceph-mon[27902]: pgmap v98: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 720 op/s 2024-04-21T10:24:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:35 smithi191 ceph-mon[31636]: pgmap v98: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 720 op/s 2024-04-21T10:24:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:35 smithi170 ceph-mon[31212]: pgmap v98: 97 pgs: 97 active+clean; 1.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 720 op/s 2024-04-21T10:24:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:37 smithi077 ceph-mon[27902]: pgmap v99: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-04-21T10:24:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:37 smithi191 ceph-mon[31636]: pgmap v99: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-04-21T10:24:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:37 smithi170 ceph-mon[31212]: pgmap v99: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-04-21T10:24:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 175.0 s, 3638.0 tps, lat 27.597 ms stddev 27.899 2024-04-21T10:24:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:39 smithi077 ceph-mon[27902]: pgmap v100: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-04-21T10:24:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:39 smithi191 ceph-mon[31636]: pgmap v100: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-04-21T10:24:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:39 smithi170 ceph-mon[31212]: pgmap v100: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-04-21T10:24:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:41 smithi077 ceph-mon[27902]: pgmap v101: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 972 op/s 2024-04-21T10:24:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:41 smithi191 ceph-mon[31636]: pgmap v101: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 972 op/s 2024-04-21T10:24:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:41 smithi170 ceph-mon[31212]: pgmap v101: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 972 op/s 2024-04-21T10:24:43.117 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.4 2024-04-21T10:24:43.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:24:43.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.267+0000 7fcca8001640 1 -- 172.21.15.77:0/1896488196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca01064e0 msgr2=0x7fcca0106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.267+0000 7fcca8001640 1 --2- 172.21.15.77:0/1896488196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca01064e0 0x7fcca0106990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009ca0 tx=0x7fcc9802c100 comp rx=0 tx=0).stop 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.267+0000 7fcca8001640 1 -- 172.21.15.77:0/1896488196 shutdown_connections 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.267+0000 7fcca8001640 1 --2- 172.21.15.77:0/1896488196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca01064e0 0x7fcca0106990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.267+0000 7fcca8001640 1 --2- 172.21.15.77:0/1896488196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca0101980 0x7fcca0105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.268+0000 7fcca8001640 1 --2- 172.21.15.77:0/1896488196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca0100fd0 0x7fcca01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.268+0000 7fcca8001640 1 -- 172.21.15.77:0/1896488196 >> 172.21.15.77:0/1896488196 conn(0x7fcca00771d0 msgr2=0x7fcca00775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.268+0000 7fcca8001640 1 -- 172.21.15.77:0/1896488196 shutdown_connections 2024-04-21T10:24:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.268+0000 7fcca8001640 1 -- 172.21.15.77:0/1896488196 wait complete. 2024-04-21T10:24:43.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.269+0000 7fcca8001640 1 Processor -- start 2024-04-21T10:24:43.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 -- start start 2024-04-21T10:24:43.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 0x7fcca019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca01064e0 0x7fcca019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca01a37b0 0x7fcca01a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0118950 con 0x7fcca01064e0 2024-04-21T10:24:43.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcca01187d0 con 0x7fcca01a37b0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca8001640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0118ad0 con 0x7fcca0100fd0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca5d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 0x7fcca019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca5d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 0x7fcca019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:50662/0 (socket says 172.21.15.77:50662) 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca5d9d640 1 -- 172.21.15.77:0/1764381386 learned_addr learned my addr 172.21.15.77:0/1764381386 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca559c640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca01064e0 0x7fcca019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.270+0000 7fcca659e640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca01a37b0 0x7fcca01a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca5d9d640 1 -- 172.21.15.77:0/1764381386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca01a37b0 msgr2=0x7fcca01a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca5d9d640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca01a37b0 0x7fcca01a3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca5d9d640 1 -- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca01064e0 msgr2=0x7fcca019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca5d9d640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca01064e0 0x7fcca019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca5d9d640 1 -- 172.21.15.77:0/1764381386 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca01a42a0 con 0x7fcca0100fd0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca5d9d640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 0x7fcca019eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00e9f0 tx=0x7fcc9c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00cd80 con 0x7fcca0100fd0 2024-04-21T10:24:43.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc9c0108e0 con 0x7fcca0100fd0 2024-04-21T10:24:43.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca01a4590 con 0x7fcca0100fd0 2024-04-21T10:24:43.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c018980 con 0x7fcca0100fd0 2024-04-21T10:24:43.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.271+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca01abdd0 con 0x7fcca0100fd0 2024-04-21T10:24:43.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.273+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca0068550 con 0x7fcca0100fd0 2024-04-21T10:24:43.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.274+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fcc9c010430 con 0x7fcca0100fd0 2024-04-21T10:24:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.274+0000 7fcc96ffd640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcc8c0a3e20 0x7fcc8c0a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.274+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcc9c0d0b00 con 0x7fcca0100fd0 2024-04-21T10:24:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.274+0000 7fcca559c640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcc8c0a3e20 0x7fcc8c0a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.275+0000 7fcca559c640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcc8c0a3e20 0x7fcc8c0a62e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcca006a080 tx=0x7fcc90005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.280+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcc9c09cb20 con 0x7fcca0100fd0 2024-04-21T10:24:43.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.608+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcca0101980 con 0x7fcca0100fd0 2024-04-21T10:24:43.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.611+0000 7fcc96ffd640 1 -- 172.21.15.77:0/1764381386 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11890 (secure 0 0 0) 0x7fcc9c0a0e20 con 0x7fcca0100fd0 2024-04-21T10:24:43.611 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:24:43.611 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:24:01.369136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:24:43.611 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcc8c0a3e20 msgr2=0x7fcc8c0a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcc8c0a3e20 0x7fcc8c0a62e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcca006a080 tx=0x7fcc90005f90 comp rx=0 tx=0).stop 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 msgr2=0x7fcca019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 0x7fcca019eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00e9f0 tx=0x7fcc9c00eeb0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 shutdown_connections 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fcc8c0a3e20 0x7fcc8c0a62e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca01064e0 0x7fcca019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca01a37b0 0x7fcca01a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 --2- 172.21.15.77:0/1764381386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca0100fd0 0x7fcca019eef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 >> 172.21.15.77:0/1764381386 conn(0x7fcca00771d0 msgr2=0x7fcca0103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:43.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 shutdown_connections 2024-04-21T10:24:43.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.618+0000 7fcca8001640 1 -- 172.21.15.77:0/1764381386 wait complete. 2024-04-21T10:24:43.635 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 83.4 --await' 2024-04-21T10:24:43.635 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 83.4 --await 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 -- 172.21.15.77:0/574801347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 msgr2=0x7f5720112d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 --2- 172.21.15.77:0/574801347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f5720112d40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f571c009930 tx=0x7f571c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 -- 172.21.15.77:0/574801347 shutdown_connections 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 --2- 172.21.15.77:0/574801347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f572010d310 0x7f5720119820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 --2- 172.21.15.77:0/574801347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010c950 0x7f572010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 --2- 172.21.15.77:0/574801347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f5720112d40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 -- 172.21.15.77:0/574801347 >> 172.21.15.77:0/574801347 conn(0x7f572006d020 msgr2=0x7f572010af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:43.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 -- 172.21.15.77:0/574801347 shutdown_connections 2024-04-21T10:24:43.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.781+0000 7f572732b640 1 -- 172.21.15.77:0/574801347 wait complete. 2024-04-21T10:24:43.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 Processor -- start 2024-04-21T10:24:43.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 -- start start 2024-04-21T10:24:43.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f572010c950 0x7f5720116930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010d310 0x7f5720116e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f57201173b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f572011cc20 con 0x7f5720112960 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f572011caa0 con 0x7f572010d310 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.782+0000 7f572732b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f572011cda0 con 0x7f572010c950 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57258c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f57201173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57248c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010d310 0x7f5720116e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57258c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f57201173b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37956/0 (socket says 172.21.15.77:37956) 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57258c8640 1 -- 172.21.15.77:0/3954685741 learned_addr learned my addr 172.21.15.77:0/3954685741 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57250c7640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f572010c950 0x7f5720116930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57248c6640 1 -- 172.21.15.77:0/3954685741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f572010c950 msgr2=0x7f5720116930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57248c6640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f572010c950 0x7f5720116930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57248c6640 1 -- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 msgr2=0x7f57201173b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57248c6640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f57201173b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57248c6640 1 -- 172.21.15.77:0/3954685741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57201b3900 con 0x7f572010d310 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.783+0000 7f57258c8640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f57201173b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.784+0000 7f57248c6640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010d310 0x7f5720116e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f571000d700 tx=0x7f571000dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.784+0000 7f57167fc640 1 -- 172.21.15.77:0/3954685741 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710017070 con 0x7f572010d310 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.784+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57201b3b90 con 0x7f572010d310 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.784+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57201b4130 con 0x7f572010d310 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.784+0000 7f57167fc640 1 -- 172.21.15.77:0/3954685741 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5710010460 con 0x7f572010d310 2024-04-21T10:24:43.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.785+0000 7f57167fc640 1 -- 172.21.15.77:0/3954685741 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571000f620 con 0x7f572010d310 2024-04-21T10:24:43.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.787+0000 7f5729ffc740 1 Processor -- start 2024-04-21T10:24:43.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f57167fc640 1 -- 172.21.15.77:0/3954685741 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f571001a070 con 0x7f572010d310 2024-04-21T10:24:43.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 -- start start 2024-04-21T10:24:43.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1d9c0 0x55c865d1dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d26980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c865c7e0b0 con 0x55c865d1d9c0 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c865c2f680 con 0x55c865d1e2e0 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.788+0000 7f5729ffc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c865c3bc60 con 0x55c865d26ec0 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d292b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:50688/0 (socket says 172.21.15.77:50688) 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 -- 172.21.15.77:0/181549163 learned_addr learned my addr 172.21.15.77:0/181549163 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57258c8640 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1d9c0 0x55c865d1dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57250c7640 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d26980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 -- 172.21.15.77:0/181549163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 msgr2=0x55c865d26980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d26980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 -- 172.21.15.77:0/181549163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1d9c0 msgr2=0x55c865d1dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1d9c0 0x55c865d1dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57248c6640 1 -- 172.21.15.77:0/181549163 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c865a60c90 con 0x55c865d26ec0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.789+0000 7f57258c8640 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1d9c0 0x55c865d1dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f57248c6640 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d292b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57100cd500 tx=0x7f57100d84b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3490d37750d67e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f57167fc640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f570c0a3e20 0x7f570c0a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f570b7fe640 1 -- 172.21.15.77:0/181549163 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100e3070 con 0x55c865d26ec0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f57258c8640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f570c0a3e20 0x7f570c0a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f570b7fe640 1 -- 172.21.15.77:0/181549163 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f571009c510 con 0x55c865d26ec0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f570b7fe640 1 -- 172.21.15.77:0/181549163 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100108c0 con 0x55c865d26ec0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.790+0000 7f57167fc640 1 -- 172.21.15.77:0/3954685741 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f57100cfea0 con 0x7f572010d310 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 -- 172.21.15.77:0/181549163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 msgr2=0x55c865d292b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f57258c8640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f570c0a3e20 0x7f570c0a62e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57180049d0 tx=0x7f5718009500 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d292b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57100cd500 tx=0x7f57100d84b0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 -- 172.21.15.77:0/181549163 shutdown_connections 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d292b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d26980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 --2- 172.21.15.77:0/181549163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1d9c0 0x55c865d1dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 -- 172.21.15.77:0/181549163 >> 172.21.15.77:0/181549163 conn(0x55c865d180f0 msgr2=0x55c865d184d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 -- 172.21.15.77:0/181549163 shutdown_connections 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 -- 172.21.15.77:0/181549163 wait complete. 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 -- start start 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.791+0000 7f5729ffc740 1 Processor -- start 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1d9c0 0x55c865d23f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d24450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d24990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c865c81400 con 0x55c865d26ec0 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57258c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d24990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c865c3d840 con 0x55c865d1e2e0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c865c86720 con 0x55c865d1d9c0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57250c7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1d9c0 0x55c865d23f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57258c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d24990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37966/0 (socket says 172.21.15.77:37966) 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57258c8640 1 -- 172.21.15.77:0/2629334094 learned_addr learned my addr 172.21.15.77:0/2629334094 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f5729ffc740 10 client.0 _ll_register_callbacks cb 0x55c865c8eea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57248c6640 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d24450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57250c7640 1 -- 172.21.15.77:0/2629334094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 msgr2=0x55c865d24450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.792+0000 7f57250c7640 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d24450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.793+0000 7f57250c7640 1 -- 172.21.15.77:0/2629334094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 msgr2=0x55c865d24990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.793+0000 7f57250c7640 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d24990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.793+0000 7f57250c7640 1 -- 172.21.15.77:0/2629334094 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c865ac1420 con 0x55c865d1d9c0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.793+0000 7f57250c7640 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1d9c0 0x55c865d23f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f571c009230 tx=0x7f571c02ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6819595113a254 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.793+0000 7f5708ff9640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5708ff9640 1 -- 172.21.15.77:0/2629334094 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c005230 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5708ff9640 1 -- 172.21.15.77:0/2629334094 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f571c0053d0 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f571009c510 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5708ff9640 1 -- 172.21.15.77:0/2629334094 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f571c0055d0 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5729ffc740 10 client.25408 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c865954580 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5708ff9640 1 -- 172.21.15.77:0/2629334094 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f571c02c5d0 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.794+0000 7f5708ff9640 1 -- 172.21.15.77:0/2629334094 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f571c003960 con 0x55c865d1d9c0 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5729ffc740 10 client.25408 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5729ffc740 10 client.25408 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:24:43.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5729ffc740 20 client.25408 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5729ffc740 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d479e0 0x55c865d49e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5729ffc740 4 client.25408 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f571009c510 con 0x55c865d479e0 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f57248c6640 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d479e0 0x55c865d49e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f5708ff9640 10 client.25408 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.795+0000 7f57248c6640 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d479e0 0x55c865d49e80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b16271892690afbe server_cookie=61347fc8f6923568 in_seq=0 out_seq=0 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5708ff9640 1 -- 172.21.15.77:0/2629334094 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f571009c510 con 0x55c865d479e0 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5708ff9640 10 client.25408 handle_command_reply: tid=0 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 client.25408 shutdown 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1d9c0 msgr2=0x55c865d23f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1d9c0 0x55c865d23f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f571c009230 tx=0x7f571c02ca10 comp rx=0 tx=0).stop 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 shutdown_connections 2024-04-21T10:24:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d479e0 0x55c865d49e80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d24990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5708ff9640 0 client.25408 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1e2e0 0x55c865d24450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 --2- 172.21.15.77:0/2629334094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1d9c0 0x55c865d23f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 >> 172.21.15.77:0/2629334094 conn(0x55c865d180f0 msgr2=0x55c865d19e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 shutdown_connections 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 1 -- 172.21.15.77:0/2629334094 wait complete. 2024-04-21T10:24:43.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.796+0000 7f5729ffc740 20 client.25408 trim_cache size 0 max 16384 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 Processor -- start 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 -- start start 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d26640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1e2e0 0x55c865d43700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d24760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b4450 con 0x55c865d1e2e0 2024-04-21T10:24:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f57201a87d0 con 0x55c865d1d9c0 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.829+0000 7f5729ffc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f57201aa2b0 con 0x55c865d26ec0 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.830+0000 7f57250c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d26640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.830+0000 7f57250c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d26640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:58016/0 (socket says 172.21.15.77:58016) 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.830+0000 7f57250c7640 1 -- 172.21.15.77:0/4173843292 learned_addr learned my addr 172.21.15.77:0/4173843292 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.830+0000 7f57258c8640 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d24760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.831+0000 7f57250c7640 1 -- 172.21.15.77:0/4173843292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 msgr2=0x55c865d24760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.832+0000 7f57250c7640 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d24760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.832+0000 7f57250c7640 1 -- 172.21.15.77:0/4173843292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1e2e0 msgr2=0x55c865d43700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.832+0000 7f57250c7640 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1e2e0 0x55c865d43700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.832+0000 7f57250c7640 1 -- 172.21.15.77:0/4173843292 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c865d1e110 con 0x55c865d1d9c0 2024-04-21T10:24:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.832+0000 7f57250c7640 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d26640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f571c005e10 tx=0x7f571c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b0ab97fae42af6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.833+0000 7f570affd640 1 -- 172.21.15.77:0/4173843292 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c0043e0 con 0x55c865d1d9c0 2024-04-21T10:24:43.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.833+0000 7f570affd640 1 -- 172.21.15.77:0/4173843292 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f571c078030 con 0x55c865d1d9c0 2024-04-21T10:24:43.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.833+0000 7f570affd640 1 -- 172.21.15.77:0/4173843292 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c003a60 con 0x55c865d1d9c0 2024-04-21T10:24:43.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.834+0000 7f5729ffc740 1 -- 172.21.15.77:0/4173843292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 msgr2=0x55c865d26640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:43.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.834+0000 7f5729ffc740 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d26640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f571c005e10 tx=0x7f571c009260 comp rx=0 tx=0).stop 2024-04-21T10:24:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.838+0000 7f5729ffc740 1 -- 172.21.15.77:0/4173843292 shutdown_connections 2024-04-21T10:24:43.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.838+0000 7f5729ffc740 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d1e2e0 0x55c865d43700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.838+0000 7f5729ffc740 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d26ec0 0x55c865d24760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.838+0000 7f5729ffc740 1 --2- 172.21.15.77:0/4173843292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d26640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.838+0000 7f5729ffc740 1 -- 172.21.15.77:0/4173843292 >> 172.21.15.77:0/4173843292 conn(0x55c865d180f0 msgr2=0x55c865d22f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:43.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.847+0000 7f5729ffc740 1 -- 172.21.15.77:0/4173843292 shutdown_connections 2024-04-21T10:24:43.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.848+0000 7f5729ffc740 1 -- 172.21.15.77:0/4173843292 wait complete. 2024-04-21T10:24:43.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.849+0000 7f5729ffc740 1 -- start start 2024-04-21T10:24:43.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.849+0000 7f5729ffc740 1 Processor -- start 2024-04-21T10:24:43.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d21240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1e2e0 0x55c865d21780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57201a9510 con 0x55c865d26ec0 2024-04-21T10:24:43.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f57201a8e40 con 0x55c865d1d9c0 2024-04-21T10:24:43.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f57201a9be0 con 0x55c865d1e2e0 2024-04-21T10:24:43.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f5729ffc740 10 client.0 _ll_register_callbacks cb 0x7f571c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:43.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d21240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d21240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:58024/0 (socket says 172.21.15.77:58024) 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 -- 172.21.15.77:0/3882684889 learned_addr learned my addr 172.21.15.77:0/3882684889 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57258c8640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57248c6640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1e2e0 0x55c865d21780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 -- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1e2e0 msgr2=0x55c865d21780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1e2e0 0x55c865d21780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 -- 172.21.15.77:0/3882684889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 msgr2=0x55c865d308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.850+0000 7f57250c7640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.851+0000 7f57250c7640 1 -- 172.21.15.77:0/3882684889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c865d30e00 con 0x55c865d1d9c0 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.851+0000 7f57248c6640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1e2e0 0x55c865d21780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.851+0000 7f57250c7640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d21240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f571c005a60 tx=0x7f571c005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d59bb1ea6b0fd8e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:43.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.851+0000 7f5708ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:24:43.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.852+0000 7f5708ff9640 1 -- 172.21.15.77:0/3882684889 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c02c5d0 con 0x55c865d1d9c0 2024-04-21T10:24:43.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.852+0000 7f5708ff9640 1 -- 172.21.15.77:0/3882684889 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f571c0043e0 con 0x55c865d1d9c0 2024-04-21T10:24:43.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.852+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f571c078030 con 0x55c865d1d9c0 2024-04-21T10:24:43.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5708ff9640 1 -- 172.21.15.77:0/3882684889 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f571c08a050 con 0x55c865d1d9c0 2024-04-21T10:24:43.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 10 client.25292 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c865d320e0 con 0x55c865d1d9c0 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5708ff9640 1 -- 172.21.15.77:0/3882684889 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f571c078030 con 0x55c865d1d9c0 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5708ff9640 1 -- 172.21.15.77:0/3882684889 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f571c07c4a0 con 0x55c865d1d9c0 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 10 client.25292 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 10 client.25292 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 20 client.25292 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d32870 0x55c865d34c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 4 client.25292 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 83.4, "await": true}] 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 83.4, "await": true}) -- 0x55c865c8fb10 con 0x55c865d32870 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.853+0000 7f57248c6640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d32870 0x55c865d34c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.854+0000 7f57248c6640 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d32870 0x55c865d34c90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92905bf23cca0d7b server_cookie=f9a7a76775242ca3 in_seq=0 out_seq=0 2024-04-21T10:24:43.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:43.854+0000 7f5708ff9640 10 client.25292 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:43 smithi077 ceph-mon[27902]: pgmap v102: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 662 op/s 2024-04-21T10:24:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:43 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1764381386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:24:44.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5708ff9640 1 -- 172.21.15.77:0/3882684889 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c865c8fb10 con 0x55c865d32870 2024-04-21T10:24:44.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5708ff9640 10 client.25292 handle_command_reply: tid=0 2024-04-21T10:24:44.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 client.25292 shutdown 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 msgr2=0x55c865d21240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d21240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f571c005a60 tx=0x7f571c005b50 comp rx=0 tx=0).stop 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 shutdown_connections 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c865d32870 0x55c865d34c90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c865d26ec0 0x55c865d308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c865d1e2e0 0x55c865d21780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5708ff9640 0 client.25292 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 --2- 172.21.15.77:0/3882684889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c865d1d9c0 0x55c865d21240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 >> 172.21.15.77:0/3882684889 conn(0x55c865d180f0 msgr2=0x55c865d171d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 shutdown_connections 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 1 -- 172.21.15.77:0/3882684889 wait complete. 2024-04-21T10:24:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.036+0000 7f5729ffc740 20 client.25292 trim_cache size 0 max 16384 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 26, 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 10, 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "c29a1788": { 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 10, 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:24:44.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 83.4, 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:24:44.038 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:24:44.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f570c0a3e20 msgr2=0x7f570c0a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f570c0a3e20 0x7f570c0a62e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57180049d0 tx=0x7f5718009500 comp rx=0 tx=0).stop 2024-04-21T10:24:44.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010d310 msgr2=0x7f5720116e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010d310 0x7f5720116e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f571000d700 tx=0x7f571000dbc0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 shutdown_connections 2024-04-21T10:24:44.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f570c0a3e20 0x7f570c0a62e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5720112960 0x7f57201173b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572010d310 0x7f5720116e70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 --2- 172.21.15.77:0/3954685741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f572010c950 0x7f5720116930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 >> 172.21.15.77:0/3954685741 conn(0x7f572006d020 msgr2=0x7f572010fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 shutdown_connections 2024-04-21T10:24:44.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:24:44.037+0000 7f572732b640 1 -- 172.21.15.77:0/3954685741 wait complete. 2024-04-21T10:24:44.049 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: c29a1788, quiesce duration: 23.4 2024-04-21T10:24:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 -- 172.21.15.77:0/3588060852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe224103b20 msgr2=0x7fe22410c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 --2- 172.21.15.77:0/3588060852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe224103b20 0x7fe22410c000 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe218009900 tx=0x7fe21802bcd0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 -- 172.21.15.77:0/3588060852 shutdown_connections 2024-04-21T10:24:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 --2- 172.21.15.77:0/3588060852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe224103b20 0x7fe22410c000 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 --2- 172.21.15.77:0/3588060852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe22410c5d0 0x7fe22410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 --2- 172.21.15.77:0/3588060852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe224103200 0x7fe2241035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 -- 172.21.15.77:0/3588060852 >> 172.21.15.77:0/3588060852 conn(0x7fe2240771d0 msgr2=0x7fe2240775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 -- 172.21.15.77:0/3588060852 shutdown_connections 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.105+0000 7fe229c93640 1 -- 172.21.15.77:0/3588060852 wait complete. 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 Processor -- start 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 -- start start 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe224103200 0x7fe224198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe224103b20 0x7fe224198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 0x7fe22419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe224112210 con 0x7fe22410c5d0 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe224112090 con 0x7fe224103200 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe229c93640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe224112390 con 0x7fe224103b20 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe223fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 0x7fe22419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe223fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 0x7fe22419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38000/0 (socket says 172.21.15.77:38000) 2024-04-21T10:24:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe223fff640 1 -- 172.21.15.77:0/3954823446 learned_addr learned my addr 172.21.15.77:0/3954823446 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.106+0000 7fe2237fe640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe224103200 0x7fe224198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe223fff640 1 -- 172.21.15.77:0/3954823446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe224103b20 msgr2=0x7fe224198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe223fff640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe224103b20 0x7fe224198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe223fff640 1 -- 172.21.15.77:0/3954823446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe224103200 msgr2=0x7fe224198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe223fff640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe224103200 0x7fe224198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe223fff640 1 -- 172.21.15.77:0/3954823446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22419d6b0 con 0x7fe22410c5d0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe2237fe640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe224103200 0x7fe224198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe223fff640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 0x7fe22419cf80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00eb40 tx=0x7fe21c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe220ff9640 1 -- 172.21.15.77:0/3954823446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c004b20 con 0x7fe22410c5d0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22419d9a0 con 0x7fe22410c5d0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe220ff9640 1 -- 172.21.15.77:0/3954823446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c004cc0 con 0x7fe22410c5d0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe220ff9640 1 -- 172.21.15.77:0/3954823446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c010720 con 0x7fe22410c5d0 2024-04-21T10:24:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.107+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241a5230 con 0x7fe22410c5d0 2024-04-21T10:24:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe220ff9640 1 -- 172.21.15.77:0/3954823446 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fe21c005560 con 0x7fe22410c5d0 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 Processor -- start 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 -- start start 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588aea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeab60 0x55f588aeafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f588a4f8d0 con 0x55f588af40e0 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f5889ece80 con 0x55f588aeab60 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.109+0000 7fe22c963740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f588a4b890 con 0x55f588aeb8d0 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe220ff9640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe20c0a3dc0 0x7fe20c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38002/0 (socket says 172.21.15.77:38002) 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe2237fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeab60 0x55f588aeafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 -- 172.21.15.77:0/1451270427 learned_addr learned my addr 172.21.15.77:0/1451270427 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe223fff640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe20c0a3dc0 0x7fe20c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588aea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe220ff9640 1 -- 172.21.15.77:0/3954823446 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe21c0d1030 con 0x7fe22410c5d0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 -- 172.21.15.77:0/1451270427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 msgr2=0x55f588aea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588aea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 -- 172.21.15.77:0/1451270427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeab60 msgr2=0x55f588aeafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeab60 0x55f588aeafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 -- 172.21.15.77:0/1451270427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f588a0e320 con 0x55f588af40e0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af64d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe218035000 tx=0x7fe218005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcd766600fb2e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe223fff640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe20c0a3dc0 0x7fe20c0a6280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0999d0 tx=0x7fe21c005900 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe209ffb640 1 -- 172.21.15.77:0/1451270427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218046070 con 0x55f588af40e0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe209ffb640 1 -- 172.21.15.77:0/1451270427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21802edd0 con 0x55f588af40e0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.110+0000 7fe209ffb640 1 -- 172.21.15.77:0/1451270427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21802c880 con 0x55f588af40e0 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 -- 172.21.15.77:0/1451270427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 msgr2=0x55f588af64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af64d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe218035000 tx=0x7fe218005a20 comp rx=0 tx=0).stop 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 -- 172.21.15.77:0/1451270427 shutdown_connections 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af64d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeab60 0x55f588aeafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 --2- 172.21.15.77:0/1451270427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588aea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 -- 172.21.15.77:0/1451270427 >> 172.21.15.77:0/1451270427 conn(0x55f588ab1c90 msgr2=0x55f588ae5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 -- 172.21.15.77:0/1451270427 shutdown_connections 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 -- 172.21.15.77:0/1451270427 wait complete. 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.111+0000 7fe22c963740 1 -- start start 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 Processor -- start 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f588af6db0 con 0x55f588af40e0 2024-04-21T10:24:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f5889d7eb0 con 0x55f588aeb8d0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f588af6f30 con 0x55f588aeab60 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe22c963740 10 client.0 _ll_register_callbacks cb 0x55f588a04b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38012/0 (socket says 172.21.15.77:38012) 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 -- 172.21.15.77:0/2162481550 learned_addr learned my addr 172.21.15.77:0/2162481550 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 -- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 msgr2=0x55f588af3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 -- 172.21.15.77:0/2162481550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 msgr2=0x55f588af0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 -- 172.21.15.77:0/2162481550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f588762210 con 0x55f588af40e0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af14a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe218005910 tx=0x7fe218005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd905783a88acf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.112+0000 7fe202ffd640 1 -- 172.21.15.77:0/2162481550 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218046040 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe202ffd640 1 -- 172.21.15.77:0/2162481550 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe21802c880 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21802edd0 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe202ffd640 1 -- 172.21.15.77:0/2162481550 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe21802ca80 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 10 client.15942 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f58882e620 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe202ffd640 1 -- 172.21.15.77:0/2162481550 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21802edd0 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe202ffd640 1 -- 172.21.15.77:0/2162481550 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe21804c070 con 0x55f588af40e0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 20 client.15942 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b03fd0 0x55f588b063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 4 client.15942 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f588a63880 con 0x55f588b03fd0 2024-04-21T10:24:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.113+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b03fd0 0x55f588b063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe202ffd640 10 client.15942 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b03fd0 0x55f588b063c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e854799d62aa807a server_cookie=cf2923c36f34c5ff in_seq=0 out_seq=0 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe202ffd640 1 -- 172.21.15.77:0/2162481550 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f588a63880 con 0x55f588b03fd0 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe202ffd640 10 client.15942 handle_command_reply: tid=0 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 client.15942 shutdown 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 msgr2=0x55f588af14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af14a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe218005910 tx=0x7fe218005fd0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 shutdown_connections 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b03fd0 0x55f588b063c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588af14a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe202ffd640 0 client.15942 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 --2- 172.21.15.77:0/2162481550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 >> 172.21.15.77:0/2162481550 conn(0x55f588ab1c90 msgr2=0x55f588ae75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 shutdown_connections 2024-04-21T10:24:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.114+0000 7fe22c963740 1 -- 172.21.15.77:0/2162481550 wait complete. 2024-04-21T10:24:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.115+0000 7fe22c963740 20 client.15942 trim_cache size 0 max 16384 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 Processor -- start 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 -- start start 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 0x55f588affce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588af35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588af40e0 0x55f588af3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241b03e0 con 0x55f588aeab60 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241adc50 con 0x55f588af40e0 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe22c963740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241abaa0 con 0x55f588aeb8d0 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 0x55f588affce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 0x55f588affce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38014/0 (socket says 172.21.15.77:38014) 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 -- 172.21.15.77:0/1658956111 learned_addr learned my addr 172.21.15.77:0/1658956111 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 -- 172.21.15.77:0/1658956111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 msgr2=0x55f588af35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588af35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 -- 172.21.15.77:0/1658956111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588af40e0 msgr2=0x55f588af3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588af40e0 0x55f588af3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.129+0000 7fe222ffd640 1 -- 172.21.15.77:0/1658956111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f588ae9e30 con 0x55f588aeab60 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe222ffd640 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 0x55f588affce0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe218004860 tx=0x7fe218004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a522d14c911431 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe2097fa640 1 -- 172.21.15.77:0/1658956111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21805c070 con 0x55f588aeab60 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe2097fa640 1 -- 172.21.15.77:0/1658956111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe218005760 con 0x55f588aeab60 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe2097fa640 1 -- 172.21.15.77:0/1658956111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218046070 con 0x55f588aeab60 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 -- 172.21.15.77:0/1658956111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 msgr2=0x55f588affce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 0x55f588affce0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe218004860 tx=0x7fe218004b20 comp rx=0 tx=0).stop 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 -- 172.21.15.77:0/1658956111 shutdown_connections 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588af40e0 0x55f588af3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeb8d0 0x55f588af35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 --2- 172.21.15.77:0/1658956111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588aeab60 0x55f588affce0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 -- 172.21.15.77:0/1658956111 >> 172.21.15.77:0/1658956111 conn(0x55f588ab1c90 msgr2=0x55f588aec060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 -- 172.21.15.77:0/1658956111 shutdown_connections 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 -- 172.21.15.77:0/1658956111 wait complete. 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.130+0000 7fe22c963740 1 -- start start 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 Processor -- start 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588afb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ac110 con 0x55f588af40e0 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ad580 con 0x55f588aeb8d0 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ac7e0 con 0x55f588aeab60 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe22c963740 10 client.0 _ll_register_callbacks cb 0x7fe218044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588afb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588afb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38030/0 (socket says 172.21.15.77:38030) 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 -- 172.21.15.77:0/2974407329 learned_addr learned my addr 172.21.15.77:0/2974407329 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 -- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 msgr2=0x55f588af4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 -- 172.21.15.77:0/2974407329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 msgr2=0x55f588af4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 -- 172.21.15.77:0/2974407329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f588af5360 con 0x55f588af40e0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe222ffd640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588afb1f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe218004830 tx=0x7fe218005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523e233e120044e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.131+0000 7fe202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe202ffd640 1 -- 172.21.15.77:0/2974407329 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218046070 con 0x55f588af40e0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe202ffd640 1 -- 172.21.15.77:0/2974407329 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe218004c30 con 0x55f588af40e0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe218005760 con 0x55f588af40e0 2024-04-21T10:24:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe202ffd640 1 -- 172.21.15.77:0/2974407329 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe21805c070 con 0x55f588af40e0 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 10 client.15948 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f588afc810 con 0x55f588af40e0 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe202ffd640 1 -- 172.21.15.77:0/2974407329 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe218005760 con 0x55f588af40e0 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe202ffd640 1 -- 172.21.15.77:0/2974407329 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe21804c070 con 0x55f588af40e0 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 10 client.15948 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 20 client.15948 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b6e870 0x55f588b70c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 4 client.15948 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5889ef3d0 con 0x55f588b6e870 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.132+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b6e870 0x55f588b70c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.133+0000 7fe202ffd640 10 client.15948 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.133+0000 7fe2237fe640 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b6e870 0x55f588b70c90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74665ce487218731 server_cookie=9ec5aa568b50308e in_seq=0 out_seq=0 2024-04-21T10:24:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe202ffd640 1 -- 172.21.15.77:0/2974407329 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5889ef3d0 con 0x55f588b6e870 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe202ffd640 10 client.15948 handle_command_reply: tid=0 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 client.15948 shutdown 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 msgr2=0x55f588afb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588afb1f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe218004830 tx=0x7fe218005940 comp rx=0 tx=0).stop 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 shutdown_connections 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55f588b6e870 0x55f588b70c90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f588af40e0 0x55f588afb1f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f588aeb8d0 0x55f588af4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe202ffd640 0 client.15948 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 --2- 172.21.15.77:0/2974407329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f588aeab60 0x55f588af4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 >> 172.21.15.77:0/2974407329 conn(0x55f588ab1c90 msgr2=0x55f588aef6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 shutdown_connections 2024-04-21T10:24:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.141+0000 7fe22c963740 1 -- 172.21.15.77:0/2974407329 wait complete. 2024-04-21T10:24:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe22c963740 20 client.15948 trim_cache size 0 max 16384 2024-04-21T10:24:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:24:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:24:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:24:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe20c0a3dc0 msgr2=0x7fe20c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe20c0a3dc0 0x7fe20c0a6280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0999d0 tx=0x7fe21c005900 comp rx=0 tx=0).stop 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 msgr2=0x7fe22419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 0x7fe22419cf80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00eb40 tx=0x7fe21c00c2d0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 shutdown_connections 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe20c0a3dc0 0x7fe20c0a6280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22410c5d0 0x7fe22419cf80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe224103b20 0x7fe224198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 --2- 172.21.15.77:0/3954823446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe224103200 0x7fe224198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 >> 172.21.15.77:0/3954823446 conn(0x7fe2240771d0 msgr2=0x7fe2240fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 shutdown_connections 2024-04-21T10:24:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:44.142+0000 7fe229c93640 1 -- 172.21.15.77:0/3954823446 wait complete. 2024-04-21T10:24:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:43 smithi191 ceph-mon[31636]: pgmap v102: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 662 op/s 2024-04-21T10:24:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:43 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1764381386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:24:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:43 smithi170 ceph-mon[31212]: pgmap v102: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 662 op/s 2024-04-21T10:24:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:43 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1764381386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:24:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 180.0 s, 2983.5 tps, lat 25.551 ms stddev 26.663 2024-04-21T10:24:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:45 smithi077 ceph-mon[27902]: pgmap v103: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 635 op/s 2024-04-21T10:24:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:45 smithi191 ceph-mon[31636]: pgmap v103: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 635 op/s 2024-04-21T10:24:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:45 smithi170 ceph-mon[31212]: pgmap v103: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 635 op/s 2024-04-21T10:24:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:47 smithi191 ceph-mon[31636]: pgmap v104: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 893 op/s 2024-04-21T10:24:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:47 smithi170 ceph-mon[31212]: pgmap v104: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 893 op/s 2024-04-21T10:24:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:47 smithi077 ceph-mon[27902]: pgmap v104: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 893 op/s 2024-04-21T10:24:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:24:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:49 smithi191 ceph-mon[31636]: pgmap v105: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.0 MiB/s wr, 573 op/s 2024-04-21T10:24:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:49 smithi170 ceph-mon[31212]: pgmap v105: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.0 MiB/s wr, 573 op/s 2024-04-21T10:24:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:49 smithi077 ceph-mon[27902]: pgmap v105: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.0 MiB/s wr, 573 op/s 2024-04-21T10:24:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:51 smithi191 ceph-mon[31636]: pgmap v106: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 576 op/s 2024-04-21T10:24:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:51 smithi170 ceph-mon[31212]: pgmap v106: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 576 op/s 2024-04-21T10:24:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:51 smithi077 ceph-mon[27902]: pgmap v106: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 576 op/s 2024-04-21T10:24:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:53 smithi191 ceph-mon[31636]: pgmap v107: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 337 op/s 2024-04-21T10:24:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:53 smithi170 ceph-mon[31212]: pgmap v107: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 337 op/s 2024-04-21T10:24:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:53 smithi077 ceph-mon[27902]: pgmap v107: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 337 op/s 2024-04-21T10:24:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:24:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:55 smithi191 ceph-mon[31636]: pgmap v108: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.9 MiB/s wr, 260 op/s 2024-04-21T10:24:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:55 smithi170 ceph-mon[31212]: pgmap v108: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.9 MiB/s wr, 260 op/s 2024-04-21T10:24:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:55 smithi077 ceph-mon[27902]: pgmap v108: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.9 MiB/s wr, 260 op/s 2024-04-21T10:24:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 -- 172.21.15.77:0/3563474458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c06b3e0 msgr2=0x7fdf1c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 --2- 172.21.15.77:0/3563474458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c06b3e0 0x7fdf1c106bb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009900 tx=0x7fdf1002bc30 comp rx=0 tx=0).stop 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 -- 172.21.15.77:0/3563474458 shutdown_connections 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 --2- 172.21.15.77:0/3563474458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c06b3e0 0x7fdf1c106bb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 --2- 172.21.15.77:0/3563474458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf1c1072e0 0x7fdf1c10ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 --2- 172.21.15.77:0/3563474458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf1c06aa30 0x7fdf1c06ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 -- 172.21.15.77:0/3563474458 >> 172.21.15.77:0/3563474458 conn(0x7fdf1c077ba0 msgr2=0x7fdf1c077fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 -- 172.21.15.77:0/3563474458 shutdown_connections 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.236+0000 7fdf228c8640 1 -- 172.21.15.77:0/3563474458 wait complete. 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 Processor -- start 2024-04-21T10:24:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 -- start start 2024-04-21T10:24:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf1c06aa30 0x7fdf1c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf1c1072e0 0x7fdf1c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 0x7fdf1c19d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1121b0 con 0x7fdf1c19ced0 2024-04-21T10:24:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c112030 con 0x7fdf1c06aa30 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf228c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c112330 con 0x7fdf1c1072e0 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf20e65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 0x7fdf1c19d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf20e65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 0x7fdf1c19d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57826/0 (socket says 172.21.15.77:57826) 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf20e65640 1 -- 172.21.15.77:0/890793789 learned_addr learned my addr 172.21.15.77:0/890793789 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf1c06aa30 0x7fdf1c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.237+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf1c1072e0 0x7fdf1c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf20e65640 1 -- 172.21.15.77:0/890793789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf1c1072e0 msgr2=0x7fdf1c198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf20e65640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf1c1072e0 0x7fdf1c198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf20e65640 1 -- 172.21.15.77:0/890793789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf1c06aa30 msgr2=0x7fdf1c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf20e65640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf1c06aa30 0x7fdf1c198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf20e65640 1 -- 172.21.15.77:0/890793789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c19d9c0 con 0x7fdf1c19ced0 2024-04-21T10:24:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf20e65640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 0x7fdf1c19d380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400eaa0 tx=0x7fdf1400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf197fa640 1 -- 172.21.15.77:0/890793789 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14004d20 con 0x7fdf1c19ced0 2024-04-21T10:24:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1c19dcb0 con 0x7fdf1c19ced0 2024-04-21T10:24:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf197fa640 1 -- 172.21.15.77:0/890793789 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf14005020 con 0x7fdf1c19ced0 2024-04-21T10:24:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf197fa640 1 -- 172.21.15.77:0/890793789 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf140116b0 con 0x7fdf1c19ced0 2024-04-21T10:24:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.238+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1c1a5470 con 0x7fdf1c19ced0 2024-04-21T10:24:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.240+0000 7fdf197fa640 1 -- 172.21.15.77:0/890793789 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fdf140051d0 con 0x7fdf1c19ced0 2024-04-21T10:24:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 Processor -- start 2024-04-21T10:24:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 -- start start 2024-04-21T10:24:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d48620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 0x555cc8d48fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555cc8cad8d0 con 0x555cc8d48b60 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555cc8c4ae80 con 0x555cc8d520e0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf197fa640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdf040a3dc0 0x7fdf040a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf25597740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555cc8ca9890 con 0x555cc8d498d0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 0x555cc8d48fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 0x555cc8d48fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57834/0 (socket says 172.21.15.77:57834) 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf1bfff640 1 -- 172.21.15.77:0/1393035574 learned_addr learned my addr 172.21.15.77:0/1393035574 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf20e65640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdf040a3dc0 0x7fdf040a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.241+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d48620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf197fa640 1 -- 172.21.15.77:0/890793789 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdf140d0990 con 0x7fdf1c19ced0 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1bfff640 1 -- 172.21.15.77:0/1393035574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 msgr2=0x555cc8d48620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d48620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1bfff640 1 -- 172.21.15.77:0/1393035574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 msgr2=0x555cc8d544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1bfff640 1 -- 172.21.15.77:0/1393035574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc8c6c320 con 0x555cc8d48b60 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 0x555cc8d48fe0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00ad00 tx=0x7fdf0c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7985620862ba62 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf20e65640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdf040a3dc0 0x7fdf040a6280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf140992d0 tx=0x7fdf14087040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf027fc640 1 -- 172.21.15.77:0/1393035574 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c01d070 con 0x555cc8d48b60 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf027fc640 1 -- 172.21.15.77:0/1393035574 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c018af0 con 0x555cc8d48b60 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.242+0000 7fdf027fc640 1 -- 172.21.15.77:0/1393035574 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c010b40 con 0x555cc8d48b60 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 -- 172.21.15.77:0/1393035574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 msgr2=0x555cc8d48fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 0x555cc8d48fe0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00ad00 tx=0x7fdf0c00f790 comp rx=0 tx=0).stop 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 -- 172.21.15.77:0/1393035574 shutdown_connections 2024-04-21T10:24:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d48b60 0x555cc8d48fe0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 --2- 172.21.15.77:0/1393035574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d48620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 -- 172.21.15.77:0/1393035574 >> 172.21.15.77:0/1393035574 conn(0x555cc8d0fc90 msgr2=0x555cc8d43850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 -- 172.21.15.77:0/1393035574 shutdown_connections 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 -- 172.21.15.77:0/1393035574 wait complete. 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 -- start start 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.243+0000 7fdf25597740 1 Processor -- start 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d51ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 0x555cc8d4ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d4f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555cc8d54e10 con 0x555cc8d498d0 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555cc8c35eb0 con 0x555cc8d520e0 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555cc8d54f90 con 0x555cc8d48b60 2024-04-21T10:24:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 10 client.0 _ll_register_callbacks cb 0x555cc8c62b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 0x555cc8d4ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 0x555cc8d4ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57842/0 (socket says 172.21.15.77:57842) 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 -- 172.21.15.77:0/3397212380 learned_addr learned my addr 172.21.15.77:0/3397212380 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d51ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d4f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 -- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 msgr2=0x555cc8d51ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d51ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 -- 172.21.15.77:0/3397212380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 msgr2=0x555cc8d4f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d4f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 -- 172.21.15.77:0/3397212380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc89c0210 con 0x555cc8d498d0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d4f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 0x555cc8d4ee60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c1ec1347dfb139 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdefb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:24:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdefb7fe640 1 -- 172.21.15.77:0/3397212380 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c01d070 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdefb7fe640 1 -- 172.21.15.77:0/3397212380 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdf0c010a80 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.244+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf0c018af0 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdefb7fe640 1 -- 172.21.15.77:0/3397212380 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf0c030050 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 10 client.15960 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555cc8a8c620 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdefb7fe640 1 -- 172.21.15.77:0/3397212380 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c018af0 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdefb7fe640 1 -- 172.21.15.77:0/3397212380 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdf0c0046c0 con 0x555cc8d498d0 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 10 client.15960 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 20 client.15960 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8d62070 0x555cc8d64460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 4 client.15960 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc8cc1880 con 0x555cc8d62070 2024-04-21T10:24:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.245+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8d62070 0x555cc8d64460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.246+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8d62070 0x555cc8d64460 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c924b9036f4da453 server_cookie=92abc976cdc28364 in_seq=0 out_seq=0 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.246+0000 7fdefb7fe640 10 client.15960 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.246+0000 7fdefb7fe640 1 -- 172.21.15.77:0/3397212380 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555cc8cc1880 con 0x555cc8d62070 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.246+0000 7fdefb7fe640 10 client.15960 handle_command_reply: tid=0 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.246+0000 7fdf25597740 1 client.15960 shutdown 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 msgr2=0x555cc8d4ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 0x555cc8d4ee60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c018670 comp rx=0 tx=0).stop 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 shutdown_connections 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8d62070 0x555cc8d64460 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d498d0 0x555cc8d4ee60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d520e0 0x555cc8d4f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdefb7fe640 0 client.15960 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 --2- 172.21.15.77:0/3397212380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d51ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 >> 172.21.15.77:0/3397212380 conn(0x555cc8d0fc90 msgr2=0x555cc8d455a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 shutdown_connections 2024-04-21T10:24:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 1 -- 172.21.15.77:0/3397212380 wait complete. 2024-04-21T10:24:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.247+0000 7fdf25597740 20 client.15960 trim_cache size 0 max 16384 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.261+0000 7fdf25597740 1 Processor -- start 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.261+0000 7fdf25597740 1 -- start start 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf25597740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d48b60 0x555cc8d5dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf25597740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d3ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf25597740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d4de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf25597740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1b02d0 con 0x555cc8d520e0 2024-04-21T10:24:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf25597740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1adb40 con 0x555cc8d48b60 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf25597740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1ab990 con 0x555cc8d498d0 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d4de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d4de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57858/0 (socket says 172.21.15.77:57858) 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/904571062 learned_addr learned my addr 172.21.15.77:0/904571062 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d3ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d48b60 0x555cc8d5dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/904571062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 msgr2=0x555cc8d3ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d3ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/904571062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d48b60 msgr2=0x555cc8d5dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d48b60 0x555cc8d5dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/904571062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc8d4f7e0 con 0x555cc8d520e0 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d3ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:24:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d4de40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c079070 tx=0x7fdf1002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c517faa23e32b37c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf01ffb640 1 -- 172.21.15.77:0/904571062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1002c7e0 con 0x555cc8d520e0 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf01ffb640 1 -- 172.21.15.77:0/904571062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf10005040 con 0x555cc8d520e0 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.262+0000 7fdf01ffb640 1 -- 172.21.15.77:0/904571062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10004b60 con 0x555cc8d520e0 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 -- 172.21.15.77:0/904571062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 msgr2=0x555cc8d4de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d4de40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c079070 tx=0x7fdf1002bc30 comp rx=0 tx=0).stop 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 -- 172.21.15.77:0/904571062 shutdown_connections 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d4de40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d498d0 0x555cc8d3ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 --2- 172.21.15.77:0/904571062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d48b60 0x555cc8d5dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 -- 172.21.15.77:0/904571062 >> 172.21.15.77:0/904571062 conn(0x555cc8d0fc90 msgr2=0x555cc8d4d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 -- 172.21.15.77:0/904571062 shutdown_connections 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 -- 172.21.15.77:0/904571062 wait complete. 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.263+0000 7fdf25597740 1 -- start start 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 Processor -- start 2024-04-21T10:24:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d5a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d498d0 0x555cc8d528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d52e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1ac000 con 0x555cc8d520e0 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1ad470 con 0x555cc8d498d0 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1ac6d0 con 0x555cc8d48b60 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf25597740 10 client.0 _ll_register_callbacks cb 0x7fdf0c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d52e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d52e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57864/0 (socket says 172.21.15.77:57864) 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/2565727906 learned_addr learned my addr 172.21.15.77:0/2565727906 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d5a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d498d0 0x555cc8d528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 msgr2=0x555cc8d5a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d5a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/2565727906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d498d0 msgr2=0x555cc8d528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d498d0 0x555cc8d528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 -- 172.21.15.77:0/2565727906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc8d53450 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdf1b7fe640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d52e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdf10004840 tx=0x7fdf100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffff42f99f23ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.264+0000 7fdefb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdefb7fe640 1 -- 172.21.15.77:0/2565727906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10061060 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdefb7fe640 1 -- 172.21.15.77:0/2565727906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdf100048e0 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf10005040 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdefb7fe640 1 -- 172.21.15.77:0/2565727906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf10004ae0 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 10 client.15966 fetch_fsmap learned FSMap version 26 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555cc8d5a040 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdefb7fe640 1 -- 172.21.15.77:0/2565727906 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf10005040 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdefb7fe640 1 -- 172.21.15.77:0/2565727906 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdf10042440 con 0x555cc8d520e0 2024-04-21T10:24:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 10 client.15966 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 20 client.15966 populate_metadata read hostname 'smithi077' 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8dc87f0 0x555cc8dcac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 4 client.15966 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cc8c4d3d0 con 0x555cc8dc87f0 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.265+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8dc87f0 0x555cc8dcac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.266+0000 7fdefb7fe640 10 client.15966 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.266+0000 7fdf1bfff640 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8dc87f0 0x555cc8dcac10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1dbeb45d2fa4c66 server_cookie=e460e59599819a1c in_seq=0 out_seq=0 2024-04-21T10:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdefb7fe640 1 -- 172.21.15.77:0/2565727906 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cc8c4d3d0 con 0x555cc8dc87f0 2024-04-21T10:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdefb7fe640 10 client.15966 handle_command_reply: tid=0 2024-04-21T10:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 client.15966 shutdown 2024-04-21T10:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 msgr2=0x555cc8d52e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d52e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdf10004840 tx=0x7fdf100046c0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 shutdown_connections 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x555cc8dc87f0 0x555cc8dcac10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555cc8d520e0 0x555cc8d52e10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdefb7fe640 0 client.15966 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555cc8d498d0 0x555cc8d528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 --2- 172.21.15.77:0/2565727906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cc8d48b60 0x555cc8d5a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 >> 172.21.15.77:0/2565727906 conn(0x555cc8d0fc90 msgr2=0x555cc8d42040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 shutdown_connections 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 1 -- 172.21.15.77:0/2565727906 wait complete. 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf25597740 20 client.15966 trim_cache size 0 max 16384 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdf040a3dc0 msgr2=0x7fdf040a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf228c8640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdf040a3dc0 0x7fdf040a6280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf140992d0 tx=0x7fdf14087040 comp rx=0 tx=0).stop 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 msgr2=0x7fdf1c19d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.278+0000 7fdf228c8640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 0x7fdf1c19d380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400eaa0 tx=0x7fdf1400eea0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 shutdown_connections 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdf040a3dc0 0x7fdf040a6280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1c19ced0 0x7fdf1c19d380 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf1c1072e0 0x7fdf1c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 --2- 172.21.15.77:0/890793789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf1c06aa30 0x7fdf1c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 >> 172.21.15.77:0/890793789 conn(0x7fdf1c077ba0 msgr2=0x7fdf1c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 shutdown_connections 2024-04-21T10:24:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:24:57.279+0000 7fdf228c8640 1 -- 172.21.15.77:0/890793789 wait complete. 2024-04-21T10:24:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:57 smithi191 ceph-mon[31636]: pgmap v109: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.9 MiB/s wr, 264 op/s 2024-04-21T10:24:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:57 smithi170 ceph-mon[31212]: pgmap v109: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.9 MiB/s wr, 264 op/s 2024-04-21T10:24:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:57 smithi077 ceph-mon[27902]: pgmap v109: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.9 MiB/s wr, 264 op/s 2024-04-21T10:25:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:25:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:24:59 smithi191 ceph-mon[31636]: pgmap v110: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-21T10:25:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:24:59 smithi170 ceph-mon[31212]: pgmap v110: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-21T10:25:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:24:59 smithi077 ceph-mon[27902]: pgmap v110: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-21T10:25:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:01 smithi191 ceph-mon[31636]: pgmap v111: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-04-21T10:25:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:01 smithi170 ceph-mon[31212]: pgmap v111: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-04-21T10:25:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:01 smithi077 ceph-mon[27902]: pgmap v111: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-04-21T10:25:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:03 smithi191 ceph-mon[31636]: pgmap v112: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-04-21T10:25:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:03 smithi170 ceph-mon[31212]: pgmap v112: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-04-21T10:25:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:03 smithi077 ceph-mon[27902]: pgmap v112: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-04-21T10:25:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:25:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:05 smithi191 ceph-mon[31636]: pgmap v113: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-04-21T10:25:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:05 smithi170 ceph-mon[31212]: pgmap v113: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-04-21T10:25:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:05 smithi077 ceph-mon[27902]: pgmap v113: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-04-21T10:25:07.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:25:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 -- 172.21.15.77:0/41575520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc106f10 msgr2=0x7fccdc1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 --2- 172.21.15.77:0/41575520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc106f10 0x7fccdc1072f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009900 tx=0x7fccd802bc30 comp rx=0 tx=0).stop 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 -- 172.21.15.77:0/41575520 shutdown_connections 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 --2- 172.21.15.77:0/41575520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 0x7fccdc10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 --2- 172.21.15.77:0/41575520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc101130 0x7fccdc101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 --2- 172.21.15.77:0/41575520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc106f10 0x7fccdc1072f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 -- 172.21.15.77:0/41575520 >> 172.21.15.77:0/41575520 conn(0x7fccdc077e30 msgr2=0x7fccdc078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 -- 172.21.15.77:0/41575520 shutdown_connections 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.563+0000 7fcce3b52640 1 -- 172.21.15.77:0/41575520 wait complete. 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 Processor -- start 2024-04-21T10:25:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 -- start start 2024-04-21T10:25:07.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 0x7fccdc197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 0x7fccdc197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc106f10 0x7fccdc19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc1110e0 con 0x7fccdc101130 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc110f60 con 0x7fccdc106f10 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce3b52640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc111260 con 0x7fccdc101ad0 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce18ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 0x7fccdc197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce18ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 0x7fccdc197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32780/0 (socket says 172.21.15.77:32780) 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.564+0000 7fcce18ee640 1 -- 172.21.15.77:0/1347528351 learned_addr learned my addr 172.21.15.77:0/1347528351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce10ed640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 0x7fccdc197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce20ef640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc106f10 0x7fccdc19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce18ee640 1 -- 172.21.15.77:0/1347528351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 msgr2=0x7fccdc197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce18ee640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 0x7fccdc197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce18ee640 1 -- 172.21.15.77:0/1347528351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc106f10 msgr2=0x7fccdc19bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce18ee640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc106f10 0x7fccdc19bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce18ee640 1 -- 172.21.15.77:0/1347528351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc19c600 con 0x7fccdc101130 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce10ed640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 0x7fccdc197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce20ef640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc106f10 0x7fccdc19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce18ee640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 0x7fccdc197660 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005940 tx=0x7fccd802c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8043020 con 0x7fccdc101130 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd802ca70 con 0x7fccdc101130 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc19c890 con 0x7fccdc101130 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd80039f0 con 0x7fccdc101130 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.565+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc1a4180 con 0x7fccdc101130 2024-04-21T10:25:07.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.566+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc069230 con 0x7fccdc101130 2024-04-21T10:25:07.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.567+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fccd8046020 con 0x7fccdc101130 2024-04-21T10:25:07.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.568+0000 7fccd2ffd640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fccc80a3d20 0x7fccc80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.568+0000 7fcce10ed640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fccc80a3d20 0x7fccc80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.568+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fccd80f2870 con 0x7fccdc101130 2024-04-21T10:25:07.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.569+0000 7fcce10ed640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fccc80a3d20 0x7fccc80a61e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ff6c0 tx=0x7fcccc005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.573+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fccd804d020 con 0x7fccdc101130 2024-04-21T10:25:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.793+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccdc109370 con 0x7fccdc101130 2024-04-21T10:25:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.794+0000 7fccd2ffd640 1 -- 172.21.15.77:0/1347528351 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11890 (secure 0 0 0) 0x7fccd802cc20 con 0x7fccdc101130 2024-04-21T10:25:07.793 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:25:07.794 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:24:01.369136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:25:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2024-04-21T10:25:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.795+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fccc80a3d20 msgr2=0x7fccc80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.795+0000 7fcce3b52640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fccc80a3d20 0x7fccc80a61e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ff6c0 tx=0x7fcccc005f90 comp rx=0 tx=0).stop 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.795+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 msgr2=0x7fccdc197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.795+0000 7fcce3b52640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 0x7fccdc197660 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005940 tx=0x7fccd802c5f0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 shutdown_connections 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fccc80a3d20 0x7fccc80a61e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc106f10 0x7fccdc19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccdc101ad0 0x7fccdc197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 --2- 172.21.15.77:0/1347528351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccdc101130 0x7fccdc197660 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 >> 172.21.15.77:0/1347528351 conn(0x7fccdc077e30 msgr2=0x7fccdc0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 shutdown_connections 2024-04-21T10:25:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.796+0000 7fcce3b52640 1 -- 172.21.15.77:0/1347528351 wait complete. 2024-04-21T10:25:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id c29a1788 --release --await' 2024-04-21T10:25:07.807 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id c29a1788 --release --await 2024-04-21T10:25:07.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 -- 172.21.15.77:0/402909133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0107260 msgr2=0x7f9cb010ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 --2- 172.21.15.77:0/402909133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0107260 0x7f9cb010ee30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ca0 tx=0x7f9ca802c120 comp rx=0 tx=0).stop 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 -- 172.21.15.77:0/402909133 shutdown_connections 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 --2- 172.21.15.77:0/402909133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0107260 0x7f9cb010ee30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 --2- 172.21.15.77:0/402909133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cb0102b40 0x7f9cb0106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 --2- 172.21.15.77:0/402909133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cb0102190 0x7f9cb0102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 -- 172.21.15.77:0/402909133 >> 172.21.15.77:0/402909133 conn(0x7f9cb00793a0 msgr2=0x7f9cb00797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 -- 172.21.15.77:0/402909133 shutdown_connections 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.913+0000 7f9cb7214640 1 -- 172.21.15.77:0/402909133 wait complete. 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 Processor -- start 2024-04-21T10:25:07.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 -- start start 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 0x7f9cb019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cb0107260 0x7f9cb019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cb01986c0 0x7f9cb0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01122c0 con 0x7f9cb0102190 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0112140 con 0x7f9cb01986c0 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb7214640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0112440 con 0x7f9cb0107260 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb4fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 0x7f9cb019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb4fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 0x7f9cb019e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32802/0 (socket says 172.21.15.77:32802) 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9cb4fb0640 1 -- 172.21.15.77:0/3672448980 learned_addr learned my addr 172.21.15.77:0/3672448980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.914+0000 7f9caffff640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cb0107260 0x7f9cb019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cb01986c0 0x7f9cb0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb4fb0640 1 -- 172.21.15.77:0/3672448980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cb0107260 msgr2=0x7f9cb019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cb0107260 0x7f9cb019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb4fb0640 1 -- 172.21.15.77:0/3672448980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cb01986c0 msgr2=0x7f9cb0198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cb01986c0 0x7f9cb0198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb4fb0640 1 -- 172.21.15.77:0/3672448980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb01992c0 con 0x7f9cb0102190 2024-04-21T10:25:07.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.915+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 0x7f9cb019e600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400b450 tx=0x7f9ca400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.919+0000 7f9cadffb640 1 -- 172.21.15.77:0/3672448980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4015020 con 0x7f9cb0102190 2024-04-21T10:25:07.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.919+0000 7f9cadffb640 1 -- 172.21.15.77:0/3672448980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca4011ce0 con 0x7f9cb0102190 2024-04-21T10:25:07.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.919+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb01a53a0 con 0x7f9cb0102190 2024-04-21T10:25:07.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.919+0000 7f9cadffb640 1 -- 172.21.15.77:0/3672448980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4010de0 con 0x7f9cb0102190 2024-04-21T10:25:07.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.919+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb01a57a0 con 0x7f9cb0102190 2024-04-21T10:25:07.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.921+0000 7f9cadffb640 1 -- 172.21.15.77:0/3672448980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f9ca4018020 con 0x7f9cb0102190 2024-04-21T10:25:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 Processor -- start 2024-04-21T10:25:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 -- start start 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cadffb640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ca00a3da0 0x7f9ca00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564cda622500 con 0x564cda6c6810 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564cda5c86a0 con 0x564cda6bdc30 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564cda61e4c0 con 0x564cda6bd310 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ca00a3da0 0x7f9ca00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cadffb640 1 -- 172.21.15.77:0/3672448980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9ca40cfed0 con 0x7f9cb0102190 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32804/0 (socket says 172.21.15.77:32804) 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 -- 172.21.15.77:0/3982307845 learned_addr learned my addr 172.21.15.77:0/3982307845 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9caffff640 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 -- 172.21.15.77:0/3982307845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 msgr2=0x564cda6bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6bd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 -- 172.21.15.77:0/3982307845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 msgr2=0x564cda6c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.922+0000 7f9cb57b1640 1 -- 172.21.15.77:0/3982307845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cda5e75e0 con 0x564cda6c6810 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ca00a3da0 0x7f9ca00a6260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8037040 tx=0x7f9ca8009a20 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c8c00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ca0 tx=0x7f9ca8047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46445df64bd959c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9c9affd640 1 -- 172.21.15.77:0/3982307845 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8039040 con 0x564cda6c6810 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9c9affd640 1 -- 172.21.15.77:0/3982307845 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca8004040 con 0x564cda6c6810 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9c9affd640 1 -- 172.21.15.77:0/3982307845 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8005230 con 0x564cda6c6810 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 -- 172.21.15.77:0/3982307845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 msgr2=0x564cda6c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c8c00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ca0 tx=0x7f9ca8047000 comp rx=0 tx=0).stop 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 -- 172.21.15.77:0/3982307845 shutdown_connections 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c8c00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/3982307845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6bd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 -- 172.21.15.77:0/3982307845 >> 172.21.15.77:0/3982307845 conn(0x564cda6b7a40 msgr2=0x564cda6b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.923+0000 7f9cb9e06740 1 -- 172.21.15.77:0/3982307845 shutdown_connections 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 -- 172.21.15.77:0/3982307845 wait complete. 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 -- start start 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 Processor -- start 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564cda6c95a0 con 0x564cda6c6810 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564cda5dba60 con 0x564cda6bd310 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564cda6c9720 con 0x564cda6bdc30 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb9e06740 10 client.0 _ll_register_callbacks cb 0x564cda334110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32820/0 (socket says 172.21.15.77:32820) 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb57b1640 1 -- 172.21.15.77:0/2955127175 learned_addr learned my addr 172.21.15.77:0/2955127175 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.924+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9caffff640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb57b1640 1 -- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 msgr2=0x564cda6c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb57b1640 1 -- 172.21.15.77:0/2955127175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 msgr2=0x564cda6c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb57b1640 1 -- 172.21.15.77:0/2955127175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cda334920 con 0x564cda6c6810 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9caffff640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c3d60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8004780 tx=0x7f9ca80346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b095bce4aaf449df server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9c8ffff640 1 -- 172.21.15.77:0/2955127175 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca805c060 con 0x564cda6c6810 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9c8ffff640 1 -- 172.21.15.77:0/2955127175 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9ca8034af0 con 0x564cda6c6810 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ca8004040 con 0x564cda6c6810 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9c8ffff640 1 -- 172.21.15.77:0/2955127175 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ca8039040 con 0x564cda6c6810 2024-04-21T10:25:07.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 10 client.15984 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564cda400d30 con 0x564cda6c6810 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9c8ffff640 1 -- 172.21.15.77:0/2955127175 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca8004040 con 0x564cda6c6810 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9c8ffff640 1 -- 172.21.15.77:0/2955127175 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9ca803f070 con 0x564cda6c6810 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 10 client.15984 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 10 client.15984 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 20 client.15984 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda6d6860 0x564cda6d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 4 client.15984 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.925+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cda5f5a10 con 0x564cda6d6860 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.926+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda6d6860 0x564cda6d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.926+0000 7f9c8ffff640 10 client.15984 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.926+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda6d6860 0x564cda6d8c50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1be01319b91d99 server_cookie=dec4277f44ed1e59 in_seq=0 out_seq=0 2024-04-21T10:25:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9c8ffff640 1 -- 172.21.15.77:0/2955127175 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564cda5f5a10 con 0x564cda6d6860 2024-04-21T10:25:07.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9c8ffff640 10 client.15984 handle_command_reply: tid=0 2024-04-21T10:25:07.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 client.15984 shutdown 2024-04-21T10:25:07.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 msgr2=0x564cda6c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c3d60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8004780 tx=0x7f9ca80346f0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 shutdown_connections 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda6d6860 0x564cda6d8c50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c3d60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/2955127175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9c8ffff640 0 client.15984 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 >> 172.21.15.77:0/2955127175 conn(0x564cda6b7a40 msgr2=0x564cda6b9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 shutdown_connections 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.927+0000 7f9cb9e06740 1 -- 172.21.15.77:0/2955127175 wait complete. 2024-04-21T10:25:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.928+0000 7f9cb9e06740 20 client.15984 trim_cache size 0 max 16384 2024-04-21T10:25:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 Processor -- start 2024-04-21T10:25:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 -- start start 2024-04-21T10:25:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01b0580 con 0x564cda6c6810 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01addf0 con 0x564cda6bdc30 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01abc40 con 0x564cda6bd310 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32826/0 (socket says 172.21.15.77:32826) 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 -- 172.21.15.77:0/1989337316 learned_addr learned my addr 172.21.15.77:0/1989337316 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9caffff640 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 -- 172.21.15.77:0/1989337316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 msgr2=0x564cda6c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 -- 172.21.15.77:0/1989337316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 msgr2=0x564cda6c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 -- 172.21.15.77:0/1989337316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cda6d3180 con 0x564cda6c6810 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c6290 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9ca802c730 tx=0x7f9ca8032490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717cef553c97abdf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9c9a7fc640 1 -- 172.21.15.77:0/1989337316 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca805c050 con 0x564cda6c6810 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9c9a7fc640 1 -- 172.21.15.77:0/1989337316 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca8061e50 con 0x564cda6c6810 2024-04-21T10:25:07.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.945+0000 7f9c9a7fc640 1 -- 172.21.15.77:0/1989337316 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8004590 con 0x564cda6c6810 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 -- 172.21.15.77:0/1989337316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 msgr2=0x564cda6c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c6290 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9ca802c730 tx=0x7f9ca8032490 comp rx=0 tx=0).stop 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 -- 172.21.15.77:0/1989337316 shutdown_connections 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c6290 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bdc30 0x564cda6c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/1989337316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bd310 0x564cda6c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 -- 172.21.15.77:0/1989337316 >> 172.21.15.77:0/1989337316 conn(0x564cda6b7a40 msgr2=0x564cda6b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 -- 172.21.15.77:0/1989337316 shutdown_connections 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 -- 172.21.15.77:0/1989337316 wait complete. 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 -- start start 2024-04-21T10:25:07.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.946+0000 7f9cb9e06740 1 Processor -- start 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01ac2b0 con 0x564cda6c6810 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01ad720 con 0x564cda6bd310 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01ac980 con 0x564cda6bdc30 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb9e06740 10 client.0 _ll_register_callbacks cb 0x7f9ca400bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32828/0 (socket says 172.21.15.77:32828) 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 -- 172.21.15.77:0/165679870 learned_addr learned my addr 172.21.15.77:0/165679870 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 -- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 msgr2=0x564cda6cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 -- 172.21.15.77:0/165679870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 msgr2=0x564cda6cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 -- 172.21.15.77:0/165679870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cda6ca020 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9cb57b1640 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c99e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8032980 tx=0x7f9ca80346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25554eb9721c247 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.947+0000 7f9c8ffff640 1 -- 172.21.15.77:0/165679870 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca805c070 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9c8ffff640 1 -- 172.21.15.77:0/165679870 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9ca8034cf0 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ca8061e50 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9c8ffff640 1 -- 172.21.15.77:0/165679870 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ca8061cb0 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 10 client.15990 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564cda73d460 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9c8ffff640 1 -- 172.21.15.77:0/165679870 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca8061e50 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9c8ffff640 1 -- 172.21.15.77:0/165679870 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9ca803f040 con 0x564cda6c6810 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 10 client.15990 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 10 client.15990 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:25:07.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 20 client.15990 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:07.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda73da50 0x564cda73fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:07.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 4 client.15990 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c29a1788", "release": true, "await": true}] 2024-04-21T10:25:07.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c29a1788", "release": true, "await": true}) -- 0x564cda62ff20 con 0x564cda73da50 2024-04-21T10:25:07.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.948+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda73da50 0x564cda73fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:07.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.949+0000 7f9c8ffff640 10 client.15990 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:07.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.949+0000 7f9cb4fb0640 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda73da50 0x564cda73fe70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd4445b745a07f4 server_cookie=76dccc335853238e in_seq=0 out_seq=0 2024-04-21T10:25:07.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9c8ffff640 1 -- 172.21.15.77:0/165679870 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564cda62ff20 con 0x564cda73da50 2024-04-21T10:25:07.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9c8ffff640 10 client.15990 handle_command_reply: tid=0 2024-04-21T10:25:07.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 client.15990 shutdown 2024-04-21T10:25:07.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 msgr2=0x564cda6c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c99e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8032980 tx=0x7f9ca80346d0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 shutdown_connections 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x564cda73da50 0x564cda73fe70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cda6c6810 0x564cda6c99e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564cda6bdc30 0x564cda6cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9c8ffff640 0 client.15990 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 --2- 172.21.15.77:0/165679870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564cda6bd310 0x564cda6cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.953+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 >> 172.21.15.77:0/165679870 conn(0x564cda6b7a40 msgr2=0x564cda6b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 shutdown_connections 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb9e06740 1 -- 172.21.15.77:0/165679870 wait complete. 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb9e06740 20 client.15990 trim_cache size 0 max 16384 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:25:07.955 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 26, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 12, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "c29a1788": { 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 12, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 83.4, 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:25:07.956 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:07.957 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ca00a3da0 msgr2=0x7f9ca00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ca00a3da0 0x7f9ca00a6260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8037040 tx=0x7f9ca8009a20 comp rx=0 tx=0).stop 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 msgr2=0x7f9cb019e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 0x7f9cb019e600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400b450 tx=0x7f9ca400b850 comp rx=0 tx=0).stop 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 shutdown_connections 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9ca00a3da0 0x7f9ca00a6260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cb01986c0 0x7f9cb0198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cb0107260 0x7f9cb019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 --2- 172.21.15.77:0/3672448980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb0102190 0x7f9cb019e600 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:07.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 >> 172.21.15.77:0/3672448980 conn(0x7f9cb00793a0 msgr2=0x7f9cb0100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:07.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 shutdown_connections 2024-04-21T10:25:07.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:07.954+0000 7f9cb7214640 1 -- 172.21.15.77:0/3672448980 wait complete. 2024-04-21T10:25:07.964 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: c29a1788, seconds elapsed: 24.8 2024-04-21T10:25:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:07 smithi077 ceph-mon[27902]: pgmap v114: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-04-21T10:25:08.160 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:07 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1347528351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:25:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:07 smithi191 ceph-mon[31636]: pgmap v114: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-04-21T10:25:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:07 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1347528351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:25:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:07 smithi170 ceph-mon[31212]: pgmap v114: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-04-21T10:25:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:07 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1347528351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:25:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 205.0 s, 185.0 tps, lat 2816.233 ms stddev 7427.270 2024-04-21T10:25:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:09 smithi191 ceph-mon[31636]: pgmap v115: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 94 op/s 2024-04-21T10:25:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:09 smithi170 ceph-mon[31212]: pgmap v115: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 94 op/s 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 -- 172.21.15.77:0/2380712174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf0106170 msgr2=0x7f3cf010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 --2- 172.21.15.77:0/2380712174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf0106170 0x7f3cf010dd40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009ca0 tx=0x7f3ce802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 -- 172.21.15.77:0/2380712174 shutdown_connections 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 --2- 172.21.15.77:0/2380712174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf0106170 0x7f3cf010dd40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 --2- 172.21.15.77:0/2380712174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0101aa0 0x7f3cf0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 --2- 172.21.15.77:0/2380712174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf01010f0 0x7f3cf01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 -- 172.21.15.77:0/2380712174 >> 172.21.15.77:0/2380712174 conn(0x7f3cf0077fd0 msgr2=0x7f3cf00783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 -- 172.21.15.77:0/2380712174 shutdown_connections 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 -- 172.21.15.77:0/2380712174 wait complete. 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 Processor -- start 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.373+0000 7f3cf7655640 1 -- start start 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf01010f0 0x7f3cf0198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0106170 0x7f3cf0198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 0x7f3cf019d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01110e0 con 0x7f3cf019cfc0 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0110f60 con 0x7f3cf0106170 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0111260 con 0x7f3cf01010f0 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 0x7f3cf019d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 0x7f3cf019d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32846/0 (socket says 172.21.15.77:32846) 2024-04-21T10:25:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 -- 172.21.15.77:0/1670092381 learned_addr learned my addr 172.21.15.77:0/1670092381 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0106170 0x7f3cf0198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf01010f0 0x7f3cf0198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 -- 172.21.15.77:0/1670092381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf01010f0 msgr2=0x7f3cf0198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf01010f0 0x7f3cf0198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 -- 172.21.15.77:0/1670092381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0106170 msgr2=0x7f3cf0198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0106170 0x7f3cf0198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 -- 172.21.15.77:0/1670092381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf019dab0 con 0x7f3cf019cfc0 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0106170 0x7f3cf0198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf5bf2640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 0x7f3cf019d470 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8005e30 tx=0x7f3ce8034650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3ce67fc640 1 -- 172.21.15.77:0/1670092381 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8041020 con 0x7f3cf019cfc0 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf019dd40 con 0x7f3cf019cfc0 2024-04-21T10:25:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3ce67fc640 1 -- 172.21.15.77:0/1670092381 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce8032970 con 0x7f3cf019cfc0 2024-04-21T10:25:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3ce67fc640 1 -- 172.21.15.77:0/1670092381 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8039040 con 0x7f3cf019cfc0 2024-04-21T10:25:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.374+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf01a5560 con 0x7f3cf019cfc0 2024-04-21T10:25:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.377+0000 7f3ce67fc640 1 -- 172.21.15.77:0/1670092381 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f3ce8044020 con 0x7f3cf019cfc0 2024-04-21T10:25:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.377+0000 7f3cfa248740 1 Processor -- start 2024-04-21T10:25:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 -- start start 2024-04-21T10:25:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba8868620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba8868fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba88744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559ba87cd8d0 con 0x559ba8868b60 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559ba876ae80 con 0x559ba88698d0 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cfa248740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ba87c9890 con 0x559ba88720e0 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3ce67fc640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3cdc0a3dc0 0x7f3cdc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba8868620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf53f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba8868fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba8868620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:42192/0 (socket says 172.21.15.77:42192) 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1536395052 learned_addr learned my addr 172.21.15.77:0/1536395052 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba88744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3ce67fc640 1 -- 172.21.15.77:0/1670092381 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3ce80f22f0 con 0x7f3cf019cfc0 2024-04-21T10:25:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1536395052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 msgr2=0x559ba88744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf5bf2640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3cdc0a3dc0 0x7f3cdc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba88744d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1536395052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 msgr2=0x559ba8868fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba8868fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1536395052 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba878c320 con 0x559ba88698d0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.378+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba8868fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.379+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba8868620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0011b30 tx=0x7f3ce0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd1d7f8f82d0c147 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.379+0000 7f3cf5bf2640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3cdc0a3dc0 0x7f3cdc0a6280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8033000 tx=0x7f3ce80095c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.379+0000 7f3cdb7fe640 1 -- 172.21.15.77:0/1536395052 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0011050 con 0x559ba88698d0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.379+0000 7f3cdb7fe640 1 -- 172.21.15.77:0/1536395052 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce00111f0 con 0x559ba88698d0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.379+0000 7f3cdb7fe640 1 -- 172.21.15.77:0/1536395052 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00035f0 con 0x559ba88698d0 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 -- 172.21.15.77:0/1536395052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 msgr2=0x559ba8868620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba8868620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0011b30 tx=0x7f3ce0004730 comp rx=0 tx=0).stop 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 -- 172.21.15.77:0/1536395052 shutdown_connections 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba8868fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba88744d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1536395052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba8868620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 -- 172.21.15.77:0/1536395052 >> 172.21.15.77:0/1536395052 conn(0x559ba882fc90 msgr2=0x559ba8863850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 -- 172.21.15.77:0/1536395052 shutdown_connections 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 -- 172.21.15.77:0/1536395052 wait complete. 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 -- start start 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.380+0000 7f3cfa248740 1 Processor -- start 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba8868b60 0x559ba8871a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 0x559ba886ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba886f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559ba8874e10 con 0x559ba88698d0 2024-04-21T10:25:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559ba8755eb0 con 0x559ba8868b60 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ba8874f90 con 0x559ba88720e0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 10 client.0 _ll_register_callbacks cb 0x559ba8782b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 0x559ba886ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 0x559ba886ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32856/0 (socket says 172.21.15.77:32856) 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 -- 172.21.15.77:0/2080964814 learned_addr learned my addr 172.21.15.77:0/2080964814 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba8868b60 0x559ba8871a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba886f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 -- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 msgr2=0x559ba886f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba886f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 -- 172.21.15.77:0/2080964814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba8868b60 msgr2=0x559ba8871a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba8868b60 0x559ba8871a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 -- 172.21.15.77:0/2080964814 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba84e0210 con 0x559ba88698d0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 0x559ba886ede0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3cec012740 tx=0x7f3cec012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb45f6d66f8beaca server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/2080964814 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec004050 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/2080964814 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3cec0041f0 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.381+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce00111f0 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/2080964814 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3cec0043f0 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 10 client.16002 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ba85ac620 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/2080964814 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce00111f0 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/2080964814 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3cec003c40 con 0x559ba88698d0 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 10 client.16002 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 10 client.16002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 20 client.16002 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88845a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 4 client.16002 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:25:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ba87e1880 con 0x559ba8882140 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.382+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88845a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.383+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88845a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c4e10ba2120a419 server_cookie=6ec78b1a21de3d64 in_seq=0 out_seq=0 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.383+0000 7f3cd8ff9640 10 client.16002 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/2080964814 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559ba87e1880 con 0x559ba8882140 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cd8ff9640 10 client.16002 handle_command_reply: tid=0 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 client.16002 shutdown 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 msgr2=0x559ba886ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 0x559ba886ede0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3cec012740 tx=0x7f3cec012c00 comp rx=0 tx=0).stop 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 shutdown_connections 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88845a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cd8ff9640 0 client.16002 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88698d0 0x559ba886ede0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88720e0 0x559ba886f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 --2- 172.21.15.77:0/2080964814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba8868b60 0x559ba8871a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 >> 172.21.15.77:0/2080964814 conn(0x559ba882fc90 msgr2=0x559ba88655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 shutdown_connections 2024-04-21T10:25:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 1 -- 172.21.15.77:0/2080964814 wait complete. 2024-04-21T10:25:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.384+0000 7f3cfa248740 20 client.16002 trim_cache size 0 max 16384 2024-04-21T10:25:10.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:09 smithi077 ceph-mon[27902]: pgmap v115: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 94 op/s 2024-04-21T10:25:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.405+0000 7f3cfa248740 1 Processor -- start 2024-04-21T10:25:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.405+0000 7f3cfa248740 1 -- start start 2024-04-21T10:25:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.405+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba8868b60 0x559ba887dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.405+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba887a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.405+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88720e0 0x559ba886dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cfa248740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01b0370 con 0x559ba88720e0 2024-04-21T10:25:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cfa248740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01adbe0 con 0x559ba88698d0 2024-04-21T10:25:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cfa248740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01aba50 con 0x559ba8868b60 2024-04-21T10:25:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88720e0 0x559ba886dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf53f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba887a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba8868b60 0x559ba887dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf53f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba887a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:42208/0 (socket says 172.21.15.77:42208) 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf53f1640 1 -- 172.21.15.77:0/3156285868 learned_addr learned my addr 172.21.15.77:0/3156285868 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/3156285868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 msgr2=0x559ba887a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba887a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/3156285868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88720e0 msgr2=0x559ba886dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88720e0 0x559ba886dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/3156285868 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba8868990 con 0x559ba8868b60 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba8868b60 0x559ba887dd40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00114a0 tx=0x7f3ce0005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c43befcfe50dda41 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.406+0000 7f3cdaffd640 1 -- 172.21.15.77:0/3156285868 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000fad0 con 0x559ba8868b60 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cdaffd640 1 -- 172.21.15.77:0/3156285868 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce001fcd0 con 0x559ba8868b60 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cdaffd640 1 -- 172.21.15.77:0/3156285868 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce002f670 con 0x559ba8868b60 2024-04-21T10:25:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 -- 172.21.15.77:0/3156285868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba8868b60 msgr2=0x559ba887dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba8868b60 0x559ba887dd40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00114a0 tx=0x7f3ce0005850 comp rx=0 tx=0).stop 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 -- 172.21.15.77:0/3156285868 shutdown_connections 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba88720e0 0x559ba886dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88698d0 0x559ba887a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 --2- 172.21.15.77:0/3156285868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba8868b60 0x559ba887dd40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 -- 172.21.15.77:0/3156285868 >> 172.21.15.77:0/3156285868 conn(0x559ba882fc90 msgr2=0x559ba886d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 -- 172.21.15.77:0/3156285868 shutdown_connections 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.407+0000 7f3cfa248740 1 -- 172.21.15.77:0/3156285868 wait complete. 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 -- start start 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 Processor -- start 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba886b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88698d0 0x559ba886b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88720e0 0x559ba886bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01ac0a0 con 0x559ba8868b60 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01ad510 con 0x559ba88720e0 2024-04-21T10:25:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01ac770 con 0x559ba88698d0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.408+0000 7f3cfa248740 10 client.0 _ll_register_callbacks cb 0x7f3cec009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba886b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba886b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32872/0 (socket says 172.21.15.77:32872) 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1971629587 learned_addr learned my addr 172.21.15.77:0/1971629587 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88698d0 0x559ba886b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88720e0 0x559ba886bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88698d0 msgr2=0x559ba886b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88698d0 0x559ba886b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1971629587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88720e0 msgr2=0x559ba886bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88720e0 0x559ba886bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 -- 172.21.15.77:0/1971629587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba886c510 con 0x559ba8868b60 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88698d0 0x559ba886b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cf4bf0640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba886b260 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009d80 tx=0x7f3ce0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bba5f7e02bdc493 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.409+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/1971629587 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000fad0 con 0x559ba8868b60 2024-04-21T10:25:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/1971629587 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3ce000fc70 con 0x559ba8868b60 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce001fcd0 con 0x559ba8868b60 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/1971629587 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3ce0005020 con 0x559ba8868b60 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 10 client.16008 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ba88ecf20 con 0x559ba8868b60 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/1971629587 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce001fcd0 con 0x559ba8868b60 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/1971629587 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3ce001d020 con 0x559ba8868b60 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 10 client.16008 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 10 client.16008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 20 client.16008 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88ef490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 4 client.16008 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559ba876d3d0 con 0x559ba8882140 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.410+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.411+0000 7f3cd8ff9640 10 client.16008 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.411+0000 7f3cf53f1640 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88ef490 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d352581838f71ba server_cookie=adb03059ddaec75e in_seq=0 out_seq=0 2024-04-21T10:25:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cd8ff9640 1 -- 172.21.15.77:0/1971629587 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559ba876d3d0 con 0x559ba8882140 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cd8ff9640 10 client.16008 handle_command_reply: tid=0 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 client.16008 shutdown 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 msgr2=0x559ba886b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba886b260 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009d80 tx=0x7f3ce0009370 comp rx=0 tx=0).stop 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 shutdown_connections 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x559ba8882140 0x559ba88ef490 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559ba88720e0 0x559ba886bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ba88698d0 0x559ba886b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 --2- 172.21.15.77:0/1971629587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559ba8868b60 0x559ba886b260 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cd8ff9640 0 client.16008 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 >> 172.21.15.77:0/1971629587 conn(0x559ba882fc90 msgr2=0x559ba886df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 shutdown_connections 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 1 -- 172.21.15.77:0/1971629587 wait complete. 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.424+0000 7f3cfa248740 20 client.16008 trim_cache size 0 max 16384 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:25:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:25:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:25:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3cdc0a3dc0 msgr2=0x7f3cdc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3cdc0a3dc0 0x7f3cdc0a6280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8033000 tx=0x7f3ce80095c0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 msgr2=0x7f3cf019d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 0x7f3cf019d470 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8005e30 tx=0x7f3ce8034650 comp rx=0 tx=0).stop 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 shutdown_connections 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f3cdc0a3dc0 0x7f3cdc0a6280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf019cfc0 0x7f3cf019d470 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf0106170 0x7f3cf0198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 --2- 172.21.15.77:0/1670092381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf01010f0 0x7f3cf0198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 >> 172.21.15.77:0/1670092381 conn(0x7f3cf0077fd0 msgr2=0x7f3cf0069990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 shutdown_connections 2024-04-21T10:25:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:10.425+0000 7f3cf7655640 1 -- 172.21.15.77:0/1670092381 wait complete. 2024-04-21T10:25:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:11 smithi191 ceph-mon[31636]: pgmap v116: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 204 op/s 2024-04-21T10:25:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:11 smithi170 ceph-mon[31212]: pgmap v116: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 204 op/s 2024-04-21T10:25:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:11 smithi077 ceph-mon[27902]: pgmap v116: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 204 op/s 2024-04-21T10:25:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:13 smithi191 ceph-mon[31636]: pgmap v117: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 888 KiB/s wr, 141 op/s 2024-04-21T10:25:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:13 smithi170 ceph-mon[31212]: pgmap v117: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 888 KiB/s wr, 141 op/s 2024-04-21T10:25:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:13 smithi077 ceph-mon[27902]: pgmap v117: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 888 KiB/s wr, 141 op/s 2024-04-21T10:25:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 210.0 s, 414.6 tps, lat 244.046 ms stddev 144.657 2024-04-21T10:25:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:15 smithi191 ceph-mon[31636]: pgmap v118: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 887 KiB/s wr, 141 op/s 2024-04-21T10:25:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:15 smithi170 ceph-mon[31212]: pgmap v118: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 887 KiB/s wr, 141 op/s 2024-04-21T10:25:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:15 smithi077 ceph-mon[27902]: pgmap v118: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 887 KiB/s wr, 141 op/s 2024-04-21T10:25:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:17 smithi191 ceph-mon[31636]: pgmap v119: 97 pgs: 97 active+clean; 2.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 2.2 MiB/s wr, 425 op/s 2024-04-21T10:25:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:17 smithi170 ceph-mon[31212]: pgmap v119: 97 pgs: 97 active+clean; 2.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 2.2 MiB/s wr, 425 op/s 2024-04-21T10:25:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:17 smithi077 ceph-mon[27902]: pgmap v119: 97 pgs: 97 active+clean; 2.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 2.2 MiB/s wr, 425 op/s 2024-04-21T10:25:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 215.0 s, 3075.8 tps, lat 33.114 ms stddev 68.948 2024-04-21T10:25:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:19 smithi191 ceph-mon[31636]: pgmap v120: 97 pgs: 97 active+clean; 2.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.2 MiB/s wr, 407 op/s 2024-04-21T10:25:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:19 smithi170 ceph-mon[31212]: pgmap v120: 97 pgs: 97 active+clean; 2.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.2 MiB/s wr, 407 op/s 2024-04-21T10:25:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:19 smithi077 ceph-mon[27902]: pgmap v120: 97 pgs: 97 active+clean; 2.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.2 MiB/s wr, 407 op/s 2024-04-21T10:25:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:21 smithi191 ceph-mon[31636]: pgmap v121: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 1.41k op/s 2024-04-21T10:25:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:21 smithi170 ceph-mon[31212]: pgmap v121: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 1.41k op/s 2024-04-21T10:25:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:21 smithi077 ceph-mon[27902]: pgmap v121: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 1.41k op/s 2024-04-21T10:25:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.551+0000 7f65fcc6d640 1 -- 172.21.15.77:0/2578426657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f8104d70 msgr2=0x7f65f8108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.551+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/2578426657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f8104d70 0x7f65f8108db0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009900 tx=0x7f65e802bc30 comp rx=0 tx=0).stop 2024-04-21T10:25:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 -- 172.21.15.77:0/2578426657 shutdown_connections 2024-04-21T10:25:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/2578426657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f8104d70 0x7f65f8108db0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/2578426657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 0x7f65f8111060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/2578426657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65f81043c0 0x7f65f81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 -- 172.21.15.77:0/2578426657 >> 172.21.15.77:0/2578426657 conn(0x7f65f80ffc80 msgr2=0x7f65f81020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 -- 172.21.15.77:0/2578426657 shutdown_connections 2024-04-21T10:25:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.552+0000 7f65fcc6d640 1 -- 172.21.15.77:0/2578426657 wait complete. 2024-04-21T10:25:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 Processor -- start 2024-04-21T10:25:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 -- start start 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f81043c0 0x7f65f8110f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 0x7f65f810e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65f810e5e0 0x7f65f810ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81143b0 con 0x7f65f81043c0 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8114230 con 0x7f65f8109490 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65fcc6d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8114530 con 0x7f65f810e5e0 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.553+0000 7f65f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f81043c0 0x7f65f8110f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 0x7f65f810e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f6d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65f810e5e0 0x7f65f810ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f81043c0 0x7f65f8110f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56440/0 (socket says 172.21.15.77:56440) 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f659c640 1 -- 172.21.15.77:0/730730526 learned_addr learned my addr 172.21.15.77:0/730730526 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 -- 172.21.15.77:0/730730526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65f810e5e0 msgr2=0x7f65f810ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65f810e5e0 0x7f65f810ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 -- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f81043c0 msgr2=0x7f65f8110f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f81043c0 0x7f65f8110f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 -- 172.21.15.77:0/730730526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f81ab320 con 0x7f65f8109490 2024-04-21T10:25:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.554+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 0x7f65f810e0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f65e802c170 tx=0x7f65e80045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.555+0000 7f65ef7fe640 1 -- 172.21.15.77:0/730730526 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8043020 con 0x7f65f8109490 2024-04-21T10:25:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.555+0000 7f65ef7fe640 1 -- 172.21.15.77:0/730730526 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65e802ca70 con 0x7f65f8109490 2024-04-21T10:25:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.555+0000 7f65ef7fe640 1 -- 172.21.15.77:0/730730526 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003ac0 con 0x7f65f8109490 2024-04-21T10:25:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.555+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f81ab5b0 con 0x7f65f8109490 2024-04-21T10:25:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.555+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81ab9f0 con 0x7f65f8109490 2024-04-21T10:25:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.559+0000 7f65ef7fe640 1 -- 172.21.15.77:0/730730526 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f65e8046020 con 0x7f65f8109490 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.559+0000 7f65ff868740 1 Processor -- start 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 -- start start 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ef7fe640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f65e40a3f20 0x7f65e40a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e33620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e33fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b4d6d988d0 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b4d6d35e80 con 0x55b4d6e33b60 2024-04-21T10:25:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ff868740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b4d6d94890 con 0x55b4d6e348d0 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65ef7fe640 1 -- 172.21.15.77:0/730730526 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f65e80f2010 con 0x7f65f8109490 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f65e40a3f20 0x7f65e40a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56452/0 (socket says 172.21.15.77:56452) 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65f6d9d640 1 -- 172.21.15.77:0/944491121 learned_addr learned my addr 172.21.15.77:0/944491121 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.560+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e33fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 -- 172.21.15.77:0/944491121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 msgr2=0x55b4d6e33620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e33620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 -- 172.21.15.77:0/944491121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 msgr2=0x55b4d6e33fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e33fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 -- 172.21.15.77:0/944491121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4d6d57320 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f65e40a3f20 0x7f65e40a63e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009fd0 tx=0x7f65f0009f60 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.561+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3f4d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009dd0 tx=0x7f65f001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd03a4898049249 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.562+0000 7f65ecff9640 1 -- 172.21.15.77:0/944491121 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0024070 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.562+0000 7f65ecff9640 1 -- 172.21.15.77:0/944491121 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f0020c80 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.562+0000 7f65ecff9640 1 -- 172.21.15.77:0/944491121 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00296c0 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 -- 172.21.15.77:0/944491121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 msgr2=0x55b4d6e3f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3f4d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009dd0 tx=0x7f65f001d000 comp rx=0 tx=0).stop 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 -- 172.21.15.77:0/944491121 shutdown_connections 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3f4d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e33fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 --2- 172.21.15.77:0/944491121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e33620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.563+0000 7f65ff868740 1 -- 172.21.15.77:0/944491121 >> 172.21.15.77:0/944491121 conn(0x55b4d6dfac90 msgr2=0x55b4d6e2e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 -- 172.21.15.77:0/944491121 shutdown_connections 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 -- 172.21.15.77:0/944491121 wait complete. 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 -- start start 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 Processor -- start 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e33b60 0x55b4d6e3c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e39d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.564+0000 7f65ff868740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b4d6e3fe50 con 0x55b4d6e33b60 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65ff868740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b4d6d20eb0 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65ff868740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b4d6e3ffd0 con 0x55b4d6e348d0 2024-04-21T10:25:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65ff868740 10 client.0 _ll_register_callbacks cb 0x55b4d6d4db40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e33b60 0x55b4d6e3c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f5d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e39d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e33b60 0x55b4d6e3c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56456/0 (socket says 172.21.15.77:56456) 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f659c640 1 -- 172.21.15.77:0/2657510794 learned_addr learned my addr 172.21.15.77:0/2657510794 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 -- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 msgr2=0x55b4d6e39d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e39d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 -- 172.21.15.77:0/2657510794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e33b60 msgr2=0x55b4d6e3c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e33b60 0x55b4d6e3c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 -- 172.21.15.77:0/2657510794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4d6aab210 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3a270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65f000fc20 tx=0x7f65f001fd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52479647ea99a3cf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.565+0000 7f65ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.566+0000 7f65ddffb640 1 -- 172.21.15.77:0/2657510794 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0037060 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.566+0000 7f65ddffb640 1 -- 172.21.15.77:0/2657510794 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f65f001fe00 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.566+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0020c80 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.566+0000 7f65ddffb640 1 -- 172.21.15.77:0/2657510794 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f65f0024070 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.566+0000 7f65ff868740 10 client.25367 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.566+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b4d6b77620 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ddffb640 1 -- 172.21.15.77:0/2657510794 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f0020c80 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ddffb640 1 -- 172.21.15.77:0/2657510794 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f65f0005160 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ff868740 10 client.25367 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ff868740 10 client.25367 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ff868740 20 client.25367 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ff868740 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6e4f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ff868740 4 client.25367 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4d6dac880 con 0x55b4d6e4cff0 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.567+0000 7f65f659c640 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6e4f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.568+0000 7f65f659c640 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6e4f3e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e111fa1544741c server_cookie=714788625979906a in_seq=0 out_seq=0 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.568+0000 7f65ddffb640 10 client.25367 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.569+0000 7f65ddffb640 1 -- 172.21.15.77:0/2657510794 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b4d6dac880 con 0x55b4d6e4cff0 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.569+0000 7f65ddffb640 10 client.25367 handle_command_reply: tid=0 2024-04-21T10:25:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.569+0000 7f65ff868740 1 client.25367 shutdown 2024-04-21T10:25:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e3d0e0 msgr2=0x55b4d6e3a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3a270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65f000fc20 tx=0x7f65f001fd00 comp rx=0 tx=0).stop 2024-04-21T10:25:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 shutdown_connections 2024-04-21T10:25:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6e4f3e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3a270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e39d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ddffb640 0 client.25367 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 --2- 172.21.15.77:0/2657510794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e33b60 0x55b4d6e3c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.570+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 >> 172.21.15.77:0/2657510794 conn(0x55b4d6dfac90 msgr2=0x55b4d6e305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.571+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 shutdown_connections 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.571+0000 7f65ff868740 1 -- 172.21.15.77:0/2657510794 wait complete. 2024-04-21T10:25:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.571+0000 7f65ff868740 20 client.25367 trim_cache size 0 max 16384 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.596+0000 7f65ff868740 1 Processor -- start 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.596+0000 7f65ff868740 1 -- start start 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.596+0000 7f65ff868740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e33b60 0x55b4d6e39630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.596+0000 7f65ff868740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 0x55b4d6e3c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65ff868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65f5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 0x55b4d6e3c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65f5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 0x55b4d6e3c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:42030/0 (socket says 172.21.15.77:42030) 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65f5d9b640 1 -- 172.21.15.77:0/340749963 learned_addr learned my addr 172.21.15.77:0/340749963 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65f6d9d640 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81b69c0 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81b4230 con 0x55b4d6e348d0 2024-04-21T10:25:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.597+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81b2080 con 0x55b4d6e33b60 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.598+0000 7f65f659c640 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e33b60 0x55b4d6e39630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65f5d9b640 1 -- 172.21.15.77:0/340749963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e33b60 msgr2=0x55b4d6e39630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e33b60 0x55b4d6e39630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65f5d9b640 1 -- 172.21.15.77:0/340749963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 msgr2=0x55b4d6e3c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65f5d9b640 1 -- 172.21.15.77:0/340749963 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4d6e2a120 con 0x55b4d6e348d0 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 0x55b4d6e3c460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65e80ba4f0 tx=0x7f65e80ba460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e52bc791a5f1591 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65dffff640 1 -- 172.21.15.77:0/340749963 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e80be090 con 0x55b4d6e348d0 2024-04-21T10:25:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65dffff640 1 -- 172.21.15.77:0/340749963 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65e80c2440 con 0x55b4d6e348d0 2024-04-21T10:25:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.599+0000 7f65dffff640 1 -- 172.21.15.77:0/340749963 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003c60 con 0x55b4d6e348d0 2024-04-21T10:25:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.600+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 msgr2=0x55b4d6e3c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.601+0000 7f65ff868740 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 0x55b4d6e3c460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65e80ba4f0 tx=0x7f65e80ba460 comp rx=0 tx=0).stop 2024-04-21T10:25:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.601+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 shutdown_connections 2024-04-21T10:25:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.601+0000 7f65ff868740 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e3c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.601+0000 7f65ff868740 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e348d0 0x55b4d6e3c460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.601+0000 7f65ff868740 1 --2- 172.21.15.77:0/340749963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e33b60 0x55b4d6e39630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.601+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 >> 172.21.15.77:0/340749963 conn(0x55b4d6dfac90 msgr2=0x55b4d6e2d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 shutdown_connections 2024-04-21T10:25:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 -- 172.21.15.77:0/340749963 wait complete. 2024-04-21T10:25:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 -- start start 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 Processor -- start 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e36430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.602+0000 7f65ff868740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81b26f0 con 0x55b4d6e3d0e0 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ff868740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81b3b60 con 0x55b4d6e33b60 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ff868740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81b2dc0 con 0x55b4d6e348d0 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ff868740 10 client.0 _ll_register_callbacks cb 0x7f65e8005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e36430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f5d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:42044/0 (socket says 172.21.15.77:42044) 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 -- 172.21.15.77:0/100778656 learned_addr learned my addr 172.21.15.77:0/100778656 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 -- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 msgr2=0x55b4d6e457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 -- 172.21.15.77:0/100778656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 msgr2=0x55b4d6e36430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e36430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 -- 172.21.15.77:0/100778656 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4d6e36c60 con 0x55b4d6e33b60 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65f659c640 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e452b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55b4d6e4faf0 tx=0x7f65e0010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0196c4269c2148c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:25:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ddffb640 1 -- 172.21.15.77:0/100778656 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e001d790 con 0x55b4d6e33b60 2024-04-21T10:25:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ddffb640 1 -- 172.21.15.77:0/100778656 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f65e0004030 con 0x55b4d6e33b60 2024-04-21T10:25:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.603+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65e80c2440 con 0x55b4d6e33b60 2024-04-21T10:25:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.604+0000 7f65ddffb640 1 -- 172.21.15.77:0/100778656 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f65e001d930 con 0x55b4d6e33b60 2024-04-21T10:25:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.605+0000 7f65ff868740 10 client.25373 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.605+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b4d6eb2fb0 con 0x55b4d6e33b60 2024-04-21T10:25:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ddffb640 1 -- 172.21.15.77:0/100778656 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65e80c2440 con 0x55b4d6e33b60 2024-04-21T10:25:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ddffb640 1 -- 172.21.15.77:0/100778656 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f65e0025410 con 0x55b4d6e33b60 2024-04-21T10:25:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ff868740 10 client.25373 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ff868740 10 client.25373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ff868740 20 client.25373 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ff868740 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6eb5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ff868740 4 client.25373 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4d6e3a600 con 0x55b4d6e4cff0 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6eb5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.606+0000 7f65ddffb640 10 client.25373 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.607+0000 7f65f5d9b640 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6eb5770 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a7e9101cccc0889 server_cookie=f5060d20ec7c410 in_seq=0 out_seq=0 2024-04-21T10:25:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ddffb640 1 -- 172.21.15.77:0/100778656 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4d6e3a600 con 0x55b4d6e4cff0 2024-04-21T10:25:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ddffb640 10 client.25373 handle_command_reply: tid=0 2024-04-21T10:25:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 client.25373 shutdown 2024-04-21T10:25:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 msgr2=0x55b4d6e452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e452b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55b4d6e4faf0 tx=0x7f65e0010800 comp rx=0 tx=0).stop 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 shutdown_connections 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b4d6e4cff0 0x55b4d6eb5770 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ddffb640 0 client.25373 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b4d6e3d0e0 0x55b4d6e36430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4d6e348d0 0x55b4d6e457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 --2- 172.21.15.77:0/100778656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4d6e33b60 0x55b4d6e452b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 >> 172.21.15.77:0/100778656 conn(0x55b4d6dfac90 msgr2=0x55b4d6e2d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 shutdown_connections 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 1 -- 172.21.15.77:0/100778656 wait complete. 2024-04-21T10:25:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.619+0000 7f65ff868740 20 client.25373 trim_cache size 0 max 16384 2024-04-21T10:25:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:25:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:25:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:25:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f65e40a3f20 msgr2=0x7f65e40a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f65e40a3f20 0x7f65e40a63e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009fd0 tx=0x7f65f0009f60 comp rx=0 tx=0).stop 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 msgr2=0x7f65f810e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 0x7f65f810e0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f65e802c170 tx=0x7f65e80045e0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 shutdown_connections 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f65e40a3f20 0x7f65e40a63e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65f810e5e0 0x7f65f810ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f8109490 0x7f65f810e0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 --2- 172.21.15.77:0/730730526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65f81043c0 0x7f65f8110f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 >> 172.21.15.77:0/730730526 conn(0x7f65f80ffc80 msgr2=0x7f65f8101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 shutdown_connections 2024-04-21T10:25:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:23.621+0000 7f65fcc6d640 1 -- 172.21.15.77:0/730730526 wait complete. 2024-04-21T10:25:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:23 smithi191 ceph-mon[31636]: pgmap v122: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 31 MiB/s wr, 1.45k op/s 2024-04-21T10:25:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:23 smithi170 ceph-mon[31212]: pgmap v122: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 31 MiB/s wr, 1.45k op/s 2024-04-21T10:25:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:23 smithi077 ceph-mon[27902]: pgmap v122: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 31 MiB/s wr, 1.45k op/s 2024-04-21T10:25:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 220.0 s, 3399.4 tps, lat 29.386 ms stddev 30.137 2024-04-21T10:25:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:25 smithi191 ceph-mon[31636]: pgmap v123: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-21T10:25:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:25 smithi170 ceph-mon[31212]: pgmap v123: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-21T10:25:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:25 smithi077 ceph-mon[27902]: pgmap v123: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-21T10:25:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:27 smithi191 ceph-mon[31636]: pgmap v124: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 35 MiB/s wr, 1.75k op/s 2024-04-21T10:25:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:27 smithi170 ceph-mon[31212]: pgmap v124: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 35 MiB/s wr, 1.75k op/s 2024-04-21T10:25:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:27 smithi077 ceph-mon[27902]: pgmap v124: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 35 MiB/s wr, 1.75k op/s 2024-04-21T10:25:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 225.0 s, 3564.8 tps, lat 28.087 ms stddev 33.253 2024-04-21T10:25:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:29 smithi191 ceph-mon[31636]: pgmap v125: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 1.46k op/s 2024-04-21T10:25:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:29 smithi170 ceph-mon[31212]: pgmap v125: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 1.46k op/s 2024-04-21T10:25:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:29 smithi077 ceph-mon[27902]: pgmap v125: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 1.46k op/s 2024-04-21T10:25:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:31 smithi191 ceph-mon[31636]: pgmap v126: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 MiB/s wr, 1.85k op/s 2024-04-21T10:25:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:31 smithi170 ceph-mon[31212]: pgmap v126: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 MiB/s wr, 1.85k op/s 2024-04-21T10:25:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:31 smithi077 ceph-mon[27902]: pgmap v126: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 MiB/s wr, 1.85k op/s 2024-04-21T10:25:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:25:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:25:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:25:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:33 smithi191 ceph-mon[31636]: pgmap v127: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-04-21T10:25:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:25:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:25:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:25:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:33 smithi170 ceph-mon[31212]: pgmap v127: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-04-21T10:25:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:25:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:25:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:25:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:33 smithi077 ceph-mon[27902]: pgmap v127: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-04-21T10:25:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:25:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:25:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:25:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 230.0 s, 4101.8 tps, lat 24.366 ms stddev 26.195 2024-04-21T10:25:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:35 smithi170 ceph-mon[31212]: pgmap v128: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.0 MiB/s wr, 716 op/s 2024-04-21T10:25:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:35 smithi077 ceph-mon[27902]: pgmap v128: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.0 MiB/s wr, 716 op/s 2024-04-21T10:25:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:35 smithi191 ceph-mon[31636]: pgmap v128: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.0 MiB/s wr, 716 op/s 2024-04-21T10:25:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.743+0000 7fdadf2d5640 1 -- 172.21.15.77:0/4260180989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8102b50 msgr2=0x7fdad8106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.743+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/4260180989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8102b50 0x7fdad8106b90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009900 tx=0x7fdac802bc30 comp rx=0 tx=0).stop 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 -- 172.21.15.77:0/4260180989 shutdown_connections 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/4260180989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8102b50 0x7fdad8106b90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/4260180989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad8107270 0x7fdad810ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/4260180989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad81021a0 0x7fdad8102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 -- 172.21.15.77:0/4260180989 >> 172.21.15.77:0/4260180989 conn(0x7fdad80fda20 msgr2=0x7fdad80ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 -- 172.21.15.77:0/4260180989 shutdown_connections 2024-04-21T10:25:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 -- 172.21.15.77:0/4260180989 wait complete. 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 Processor -- start 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.744+0000 7fdadf2d5640 1 -- start start 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadf2d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad81021a0 0x7fdad8198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadf2d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 0x7fdad8198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadf2d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad819cff0 0x7fdad819d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadf2d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8112220 con 0x7fdad8107270 2024-04-21T10:25:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadf2d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81120a0 con 0x7fdad81021a0 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadf2d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81123a0 con 0x7fdad819cff0 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 0x7fdad8198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 0x7fdad8198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58978/0 (socket says 172.21.15.77:58978) 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 -- 172.21.15.77:0/3201558305 learned_addr learned my addr 172.21.15.77:0/3201558305 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadd872640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad819cff0 0x7fdad819d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadd071640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad81021a0 0x7fdad8198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 -- 172.21.15.77:0/3201558305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad819cff0 msgr2=0x7fdad819d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad819cff0 0x7fdad819d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 -- 172.21.15.77:0/3201558305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad81021a0 msgr2=0x7fdad8198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad81021a0 0x7fdad8198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.745+0000 7fdadc870640 1 -- 172.21.15.77:0/3201558305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad819d9e0 con 0x7fdad8107270 2024-04-21T10:25:36.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.746+0000 7fdadc870640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 0x7fdad8198cc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdac8000c00 tx=0x7fdac80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:36.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.746+0000 7fdace7fc640 1 -- 172.21.15.77:0/3201558305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8043020 con 0x7fdad8107270 2024-04-21T10:25:36.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.746+0000 7fdace7fc640 1 -- 172.21.15.77:0/3201558305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac802cb70 con 0x7fdad8107270 2024-04-21T10:25:36.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.746+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad819dc70 con 0x7fdad8107270 2024-04-21T10:25:36.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.747+0000 7fdace7fc640 1 -- 172.21.15.77:0/3201558305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8003b80 con 0x7fdad8107270 2024-04-21T10:25:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.748+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad81a3470 con 0x7fdad8107270 2024-04-21T10:25:36.748 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.750+0000 7fdace7fc640 1 -- 172.21.15.77:0/3201558305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fdac8046020 con 0x7fdad8107270 2024-04-21T10:25:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.750+0000 7fdace7fc640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdac40a3df0 0x7fdac40a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.751+0000 7fdadd071640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdac40a3df0 0x7fdac40a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.751+0000 7fdace7fc640 1 -- 172.21.15.77:0/3201558305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdac80f5170 con 0x7fdad8107270 2024-04-21T10:25:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdadd071640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdac40a3df0 0x7fdac40a62b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009bd0 tx=0x7fdad4005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 Processor -- start 2024-04-21T10:25:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 -- start start 2024-04-21T10:25:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56035b0298d0 con 0x56035b0c58d0 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56035afc6e80 con 0x56035b0c4b60 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.752+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56035b025890 con 0x56035b0ce0e0 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadd071640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:34204/0 (socket says 172.21.15.77:34204) 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 -- 172.21.15.77:0/2126597023 learned_addr learned my addr 172.21.15.77:0/2126597023 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadd872640 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 -- 172.21.15.77:0/2126597023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 msgr2=0x56035b0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 -- 172.21.15.77:0/2126597023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 msgr2=0x56035b0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 -- 172.21.15.77:0/2126597023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035afe8320 con 0x56035b0c4b60 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.753+0000 7fdadc870640 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0c4fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005ab0 tx=0x7fdac802bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400cd4ba1491f410 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.754+0000 7fdac37fe640 1 -- 172.21.15.77:0/2126597023 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac80f6060 con 0x56035b0c4b60 2024-04-21T10:25:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.754+0000 7fdac37fe640 1 -- 172.21.15.77:0/2126597023 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac8009520 con 0x56035b0c4b60 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.754+0000 7fdac37fe640 1 -- 172.21.15.77:0/2126597023 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac80ba010 con 0x56035b0c4b60 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.754+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2126597023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 msgr2=0x56035b0c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.754+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0c4fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005ab0 tx=0x7fdac802bc30 comp rx=0 tx=0).stop 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2126597023 shutdown_connections 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0c4fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2126597023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2126597023 >> 172.21.15.77:0/2126597023 conn(0x56035b08bc90 msgr2=0x56035b0bf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2126597023 shutdown_connections 2024-04-21T10:25:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.755+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2126597023 wait complete. 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.756+0000 7fdae1f9b740 1 -- start start 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.756+0000 7fdae1f9b740 1 Processor -- start 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.756+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56035b0d0bd0 con 0x56035b0c4b60 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56035afb1eb0 con 0x56035b0c58d0 2024-04-21T10:25:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56035b0d0d50 con 0x56035b0ce0e0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadd071640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadd071640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59000/0 (socket says 172.21.15.77:59000) 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 10 client.0 _ll_register_callbacks cb 0x56035afdeb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadd071640 1 -- 172.21.15.77:0/2548763020 learned_addr learned my addr 172.21.15.77:0/2548763020 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadd872640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 -- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 msgr2=0x56035b0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 -- 172.21.15.77:0/2548763020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 msgr2=0x56035b0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 -- 172.21.15.77:0/2548763020 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035ad3c210 con 0x56035b0c58d0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdadc870640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0cade0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56035b0c6030 tx=0x7fdac80ba220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7cece587589ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdac0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdac0ff9640 1 -- 172.21.15.77:0/2548763020 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac80bd9a0 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac8009520 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.757+0000 7fdac0ff9640 1 -- 172.21.15.77:0/2548763020 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdac80c6390 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdac0ff9640 1 -- 172.21.15.77:0/2548763020 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdac80be0a0 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 10 client.25385 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56035ae08620 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdac0ff9640 1 -- 172.21.15.77:0/2548763020 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac8009520 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdac0ff9640 1 -- 172.21.15.77:0/2548763020 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdac80b96f0 con 0x56035b0c58d0 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 10 client.25385 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 20 client.25385 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b0dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 4 client.25385 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56035b03d880 con 0x56035b0dda90 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.758+0000 7fdadd071640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b0dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.759+0000 7fdadd071640 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b0dfe80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c3f550d1312aa5 server_cookie=ad0695dee29b2e22 in_seq=0 out_seq=0 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.759+0000 7fdac0ff9640 10 client.25385 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdac0ff9640 1 -- 172.21.15.77:0/2548763020 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56035b03d880 con 0x56035b0dda90 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdac0ff9640 10 client.25385 handle_command_reply: tid=0 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 client.25385 shutdown 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 msgr2=0x56035b0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0cade0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56035b0c6030 tx=0x7fdac80ba220 comp rx=0 tx=0).stop 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 shutdown_connections 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b0dfe80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0cade0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdac0ff9640 0 client.25385 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/2548763020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.760+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 >> 172.21.15.77:0/2548763020 conn(0x56035b08bc90 msgr2=0x56035b0c15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.761+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 shutdown_connections 2024-04-21T10:25:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.761+0000 7fdae1f9b740 1 -- 172.21.15.77:0/2548763020 wait complete. 2024-04-21T10:25:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.761+0000 7fdae1f9b740 20 client.25385 trim_cache size 0 max 16384 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.786+0000 7fdae1f9b740 1 Processor -- start 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.786+0000 7fdae1f9b740 1 -- start start 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.786+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.786+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0d9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.786+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b6730 con 0x56035b0c4b60 2024-04-21T10:25:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b3fa0 con 0x56035b0c58d0 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b1e10 con 0x56035b0ce0e0 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd071640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadc870640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0d9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:35660/0 (socket says 172.21.15.77:35660) 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 -- 172.21.15.77:0/1319043242 learned_addr learned my addr 172.21.15.77:0/1319043242 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 -- 172.21.15.77:0/1319043242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 msgr2=0x56035b0d9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0d9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 -- 172.21.15.77:0/1319043242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 msgr2=0x56035b0c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.787+0000 7fdadd872640 1 -- 172.21.15.77:0/1319043242 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035b0baf30 con 0x56035b0ce0e0 2024-04-21T10:25:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.788+0000 7fdadd872640 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cd510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdad0013510 tx=0x7fdad0013910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfeebd21460b7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.788+0000 7fdac2ffd640 1 -- 172.21.15.77:0/1319043242 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0021070 con 0x56035b0ce0e0 2024-04-21T10:25:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.788+0000 7fdac2ffd640 1 -- 172.21.15.77:0/1319043242 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdad0011950 con 0x56035b0ce0e0 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.788+0000 7fdac2ffd640 1 -- 172.21.15.77:0/1319043242 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad001c9f0 con 0x56035b0ce0e0 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1319043242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 msgr2=0x56035b0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cd510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdad0013510 tx=0x7fdad0013910 comp rx=0 tx=0).stop 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1319043242 shutdown_connections 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0cd510 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c58d0 0x56035b0d9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1319043242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c4b60 0x56035b0c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.789+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1319043242 >> 172.21.15.77:0/1319043242 conn(0x56035b08bc90 msgr2=0x56035b0c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.790+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1319043242 shutdown_connections 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.790+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1319043242 wait complete. 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.790+0000 7fdae1f9b740 1 -- start start 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.791+0000 7fdae1f9b740 1 Processor -- start 2024-04-21T10:25:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.791+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.791+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.791+0000 7fdae1f9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.791+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b2460 con 0x56035b0c58d0 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b38d0 con 0x56035b0c4b60 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdae1f9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b2b30 con 0x56035b0ce0e0 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdae1f9b740 10 client.0 _ll_register_callbacks cb 0x7fdac80d5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0d1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:34242/0 (socket says 172.21.15.77:34242) 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 -- 172.21.15.77:0/1275122577 learned_addr learned my addr 172.21.15.77:0/1275122577 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadc870640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd872640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 -- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 msgr2=0x56035b0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 -- 172.21.15.77:0/1275122577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 msgr2=0x56035b0d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 -- 172.21.15.77:0/1275122577 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035b1431b0 con 0x56035b0c4b60 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd872640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadc870640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdadd071640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0d1bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdad4004490 tx=0x7fdad4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bda5b7e29f140d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdac0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.792+0000 7fdac0ff9640 1 -- 172.21.15.77:0/1275122577 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad402a880 con 0x56035b0c4b60 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.793+0000 7fdac0ff9640 1 -- 172.21.15.77:0/1275122577 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdad4005020 con 0x56035b0c4b60 2024-04-21T10:25:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.793+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad0011950 con 0x56035b0c4b60 2024-04-21T10:25:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.793+0000 7fdac0ff9640 1 -- 172.21.15.77:0/1275122577 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdad4005220 con 0x56035b0c4b60 2024-04-21T10:25:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.793+0000 7fdae1f9b740 10 client.25391 fetch_fsmap learned FSMap version 26 2024-04-21T10:25:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.793+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56035b1444e0 con 0x56035b0c4b60 2024-04-21T10:25:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdac0ff9640 1 -- 172.21.15.77:0/1275122577 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdad0011950 con 0x56035b0c4b60 2024-04-21T10:25:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdac0ff9640 1 -- 172.21.15.77:0/1275122577 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdad4032070 con 0x56035b0c4b60 2024-04-21T10:25:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdae1f9b740 10 client.25391 fetch_fsmap finished waiting for FSMap version 26 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdae1f9b740 10 client.25391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdae1f9b740 20 client.25391 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdae1f9b740 4 client.25391 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.794+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56035afc93d0 con 0x56035b0dda90 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.795+0000 7fdadc870640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.795+0000 7fdadc870640 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b146d00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=554e6c3fca147c7 server_cookie=eb1f16745f7dde7d in_seq=0 out_seq=0 2024-04-21T10:25:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.795+0000 7fdac0ff9640 10 client.25391 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdac0ff9640 1 -- 172.21.15.77:0/1275122577 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56035afc93d0 con 0x56035b0dda90 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdac0ff9640 10 client.25391 handle_command_reply: tid=0 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdae1f9b740 1 client.25391 shutdown 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 msgr2=0x56035b0d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0d1bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdad4004490 tx=0x7fdad4004730 comp rx=0 tx=0).stop 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 shutdown_connections 2024-04-21T10:25:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.808+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x56035b0dda90 0x56035b146d00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56035b0c58d0 0x56035b0d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdac0ff9640 0 client.25391 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56035b0ce0e0 0x56035b0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 1 --2- 172.21.15.77:0/1275122577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56035b0c4b60 0x56035b0d1bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 >> 172.21.15.77:0/1275122577 conn(0x56035b08bc90 msgr2=0x56035b0be040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 shutdown_connections 2024-04-21T10:25:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 1 -- 172.21.15.77:0/1275122577 wait complete. 2024-04-21T10:25:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdae1f9b740 20 client.25391 trim_cache size 0 max 16384 2024-04-21T10:25:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:25:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:25:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:25:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:25:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdac40a3df0 msgr2=0x7fdac40a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdac40a3df0 0x7fdac40a62b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009bd0 tx=0x7fdad4005f90 comp rx=0 tx=0).stop 2024-04-21T10:25:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 msgr2=0x7fdad8198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.809+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 0x7fdad8198cc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdac8000c00 tx=0x7fdac80045e0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 shutdown_connections 2024-04-21T10:25:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdac40a3df0 0x7fdac40a62b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdad8107270 0x7fdad8198cc0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad819cff0 0x7fdad819d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 --2- 172.21.15.77:0/3201558305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad81021a0 0x7fdad8198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 >> 172.21.15.77:0/3201558305 conn(0x7fdad80fda20 msgr2=0x7fdad80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 shutdown_connections 2024-04-21T10:25:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:36.810+0000 7fdadf2d5640 1 -- 172.21.15.77:0/3201558305 wait complete. 2024-04-21T10:25:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:37 smithi170 ceph-mon[31212]: pgmap v129: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-04-21T10:25:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:37 smithi077 ceph-mon[27902]: pgmap v129: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-04-21T10:25:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:37 smithi191 ceph-mon[31636]: pgmap v129: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-04-21T10:25:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 235.0 s, 3443.0 tps, lat 29.045 ms stddev 29.552 2024-04-21T10:25:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:39 smithi170 ceph-mon[31212]: pgmap v130: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 738 op/s 2024-04-21T10:25:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:39 smithi077 ceph-mon[27902]: pgmap v130: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 738 op/s 2024-04-21T10:25:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:39 smithi191 ceph-mon[31636]: pgmap v130: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 738 op/s 2024-04-21T10:25:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:41 smithi170 ceph-mon[31212]: pgmap v131: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 989 op/s 2024-04-21T10:25:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:41 smithi077 ceph-mon[27902]: pgmap v131: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 989 op/s 2024-04-21T10:25:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:41 smithi191 ceph-mon[31636]: pgmap v131: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 989 op/s 2024-04-21T10:25:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:43 smithi170 ceph-mon[31212]: pgmap v132: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.0 MiB/s wr, 665 op/s 2024-04-21T10:25:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:43 smithi077 ceph-mon[27902]: pgmap v132: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.0 MiB/s wr, 665 op/s 2024-04-21T10:25:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:43 smithi191 ceph-mon[31636]: pgmap v132: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.0 MiB/s wr, 665 op/s 2024-04-21T10:25:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 240.0 s, 3093.6 tps, lat 32.331 ms stddev 55.999 2024-04-21T10:25:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:45 smithi170 ceph-mon[31212]: pgmap v133: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 647 op/s 2024-04-21T10:25:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:45 smithi077 ceph-mon[27902]: pgmap v133: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 647 op/s 2024-04-21T10:25:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:45 smithi191 ceph-mon[31636]: pgmap v133: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 647 op/s 2024-04-21T10:25:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:47 smithi170 ceph-mon[31212]: pgmap v134: 97 pgs: 97 active+clean; 2.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 1.79k op/s 2024-04-21T10:25:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:47 smithi077 ceph-mon[27902]: pgmap v134: 97 pgs: 97 active+clean; 2.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 1.79k op/s 2024-04-21T10:25:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:47 smithi191 ceph-mon[31636]: pgmap v134: 97 pgs: 97 active+clean; 2.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 1.79k op/s 2024-04-21T10:25:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 -- 172.21.15.77:0/1338305941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c1072b0 msgr2=0x7fa83c10ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 --2- 172.21.15.77:0/1338305941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c1072b0 0x7fa83c10ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa834009ca0 tx=0x7fa83402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 -- 172.21.15.77:0/1338305941 shutdown_connections 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 --2- 172.21.15.77:0/1338305941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c1072b0 0x7fa83c10ee80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 --2- 172.21.15.77:0/1338305941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83c102b90 0x7fa83c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 --2- 172.21.15.77:0/1338305941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1021e0 0x7fa83c1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 -- 172.21.15.77:0/1338305941 >> 172.21.15.77:0/1338305941 conn(0x7fa83c0fda00 msgr2=0x7fa83c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 -- 172.21.15.77:0/1338305941 shutdown_connections 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.941+0000 7fa843715640 1 -- 172.21.15.77:0/1338305941 wait complete. 2024-04-21T10:25:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.942+0000 7fa843715640 1 Processor -- start 2024-04-21T10:25:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.942+0000 7fa843715640 1 -- start start 2024-04-21T10:25:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa843715640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83c1021e0 0x7fa83c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa843715640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1072b0 0x7fa83c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa843715640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c19f010 0x7fa83c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa843715640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1143f0 con 0x7fa83c1072b0 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa843715640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c114270 con 0x7fa83c1021e0 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1072b0 0x7fa83c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1072b0 0x7fa83c19ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48674/0 (socket says 172.21.15.77:48674) 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa8414b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83c1021e0 0x7fa83c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa840cb0640 1 -- 172.21.15.77:0/357250266 learned_addr learned my addr 172.21.15.77:0/357250266 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa841cb2640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c19f010 0x7fa83c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.943+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c114570 con 0x7fa83c19f010 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa841cb2640 1 -- 172.21.15.77:0/357250266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83c1021e0 msgr2=0x7fa83c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa841cb2640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83c1021e0 0x7fa83c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa841cb2640 1 -- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1072b0 msgr2=0x7fa83c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa841cb2640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1072b0 0x7fa83c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa841cb2640 1 -- 172.21.15.77:0/357250266 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c19fb00 con 0x7fa83c19f010 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa841cb2640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c19f010 0x7fa83c19f4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa834009bf0 tx=0x7fa834035ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa8327fc640 1 -- 172.21.15.77:0/357250266 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834039040 con 0x7fa83c19f010 2024-04-21T10:25:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa8327fc640 1 -- 172.21.15.77:0/357250266 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa834032970 con 0x7fa83c19f010 2024-04-21T10:25:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c19fd90 con 0x7fa83c19f010 2024-04-21T10:25:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa8327fc640 1 -- 172.21.15.77:0/357250266 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834004040 con 0x7fa83c19f010 2024-04-21T10:25:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.944+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c1a7550 con 0x7fa83c19f010 2024-04-21T10:25:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8327fc640 1 -- 172.21.15.77:0/357250266 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fa834046030 con 0x7fa83c19f010 2024-04-21T10:25:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 Processor -- start 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 -- start start 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 0x55af08f5c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5cb60 0x55af08f5cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f660e0 0x55af08f684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55af08ec18d0 con 0x55af08f5d8d0 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55af08e5ee80 con 0x55af08f5cb60 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.948+0000 7fa8463e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55af08ebd890 con 0x55af08f660e0 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 0x55af08f5c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 0x55af08f5c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48676/0 (socket says 172.21.15.77:48676) 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 -- 172.21.15.77:0/3682606773 learned_addr learned my addr 172.21.15.77:0/3682606773 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f660e0 0x55af08f684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa8327fc640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa8280a3e40 0x7fa8280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa8414b1640 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5cb60 0x55af08f5cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 -- 172.21.15.77:0/3682606773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f660e0 msgr2=0x55af08f684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f660e0 0x55af08f684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 -- 172.21.15.77:0/3682606773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5cb60 msgr2=0x55af08f5cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5cb60 0x55af08f5cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa840cb0640 1 -- 172.21.15.77:0/3682606773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af08e80320 con 0x55af08f5d8d0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa841cb2640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa8280a3e40 0x7fa8280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.949+0000 7fa8327fc640 1 -- 172.21.15.77:0/357250266 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa8340f2000 con 0x7fa83c19f010 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.950+0000 7fa840cb0640 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 0x55af08f5c620 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa838014900 tx=0x7fa83800a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3b803147cf2f07 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.950+0000 7fa8277fe640 1 -- 172.21.15.77:0/3682606773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838004030 con 0x55af08f5d8d0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.950+0000 7fa841cb2640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa8280a3e40 0x7fa8280a6300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa8340ba5d0 tx=0x7fa834003b50 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.950+0000 7fa8277fe640 1 -- 172.21.15.77:0/3682606773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83800f9f0 con 0x55af08f5d8d0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.950+0000 7fa8277fe640 1 -- 172.21.15.77:0/3682606773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838003850 con 0x55af08f5d8d0 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 -- 172.21.15.77:0/3682606773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 msgr2=0x55af08f5c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 0x55af08f5c620 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa838014900 tx=0x7fa83800a740 comp rx=0 tx=0).stop 2024-04-21T10:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 -- 172.21.15.77:0/3682606773 shutdown_connections 2024-04-21T10:25:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f660e0 0x55af08f684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5cb60 0x55af08f5cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 --2- 172.21.15.77:0/3682606773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f5d8d0 0x55af08f5c620 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.951+0000 7fa8463e3740 1 -- 172.21.15.77:0/3682606773 >> 172.21.15.77:0/3682606773 conn(0x55af08f23c90 msgr2=0x55af08f57850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.953+0000 7fa8463e3740 1 -- 172.21.15.77:0/3682606773 shutdown_connections 2024-04-21T10:25:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.953+0000 7fa8463e3740 1 -- 172.21.15.77:0/3682606773 wait complete. 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.953+0000 7fa8463e3740 1 -- start start 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.953+0000 7fa8463e3740 1 Processor -- start 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f65b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f62e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55af08f68e10 con 0x55af08f660e0 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55af08e49eb0 con 0x55af08f5d8d0 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55af08f68f90 con 0x55af08f5cb60 2024-04-21T10:25:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8463e3740 10 client.0 _ll_register_callbacks cb 0x55af08e76b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48680/0 (socket says 172.21.15.77:48680) 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 -- 172.21.15.77:0/2497550818 learned_addr learned my addr 172.21.15.77:0/2497550818 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa8414b1640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f62e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f65b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 -- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 msgr2=0x55af08f65b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f65b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 -- 172.21.15.77:0/2497550818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 msgr2=0x55af08f62e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f62e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.954+0000 7fa840cb0640 1 -- 172.21.15.77:0/2497550818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af08bd4210 con 0x55af08f660e0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa840cb0640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f634a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa838014160 tx=0x7fa83800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f88b115704ea47 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa824ff9640 1 -- 172.21.15.77:0/2497550818 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380141c0 con 0x55af08f660e0 2024-04-21T10:25:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83800f9f0 con 0x55af08f660e0 2024-04-21T10:25:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa824ff9640 1 -- 172.21.15.77:0/2497550818 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa83800fba0 con 0x55af08f660e0 2024-04-21T10:25:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa824ff9640 1 -- 172.21.15.77:0/2497550818 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa83800fda0 con 0x55af08f660e0 2024-04-21T10:25:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa8463e3740 10 client.16053 fetch_fsmap learned FSMap version 27 2024-04-21T10:25:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.955+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55af08ca0620 con 0x55af08f660e0 2024-04-21T10:25:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa824ff9640 1 -- 172.21.15.77:0/2497550818 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83800f9f0 con 0x55af08f660e0 2024-04-21T10:25:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa824ff9640 1 -- 172.21.15.77:0/2497550818 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7fa8380049f0 con 0x55af08f660e0 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8463e3740 10 client.16053 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8463e3740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8463e3740 20 client.16053 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8463e3740 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08f783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8463e3740 4 client.16053 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af08ed5880 con 0x55af08f76000 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.956+0000 7fa8414b1640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08f783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.957+0000 7fa8414b1640 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08f783f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b522ef353c87a27 server_cookie=f352ba322b35342d in_seq=0 out_seq=0 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.957+0000 7fa824ff9640 10 client.16053 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.957+0000 7fa824ff9640 1 -- 172.21.15.77:0/2497550818 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55af08ed5880 con 0x55af08f76000 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.957+0000 7fa824ff9640 10 client.16053 handle_command_reply: tid=0 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.957+0000 7fa8463e3740 1 client.16053 shutdown 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 msgr2=0x55af08f634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f634a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa838014160 tx=0x7fa83800a6a0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 shutdown_connections 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08f783f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f634a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f62e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa824ff9640 0 client.16053 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 --2- 172.21.15.77:0/2497550818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f65b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 >> 172.21.15.77:0/2497550818 conn(0x55af08f23c90 msgr2=0x55af08f595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 shutdown_connections 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 1 -- 172.21.15.77:0/2497550818 wait complete. 2024-04-21T10:25:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.958+0000 7fa8463e3740 20 client.16053 trim_cache size 0 max 16384 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 Processor -- start 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 -- start start 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f71d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f61e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b2440 con 0x55af08f660e0 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1afcb0 con 0x55af08f5d8d0 2024-04-21T10:25:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.980+0000 7fa8463e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1adb00 con 0x55af08f5cb60 2024-04-21T10:25:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f71d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f71d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:47556/0 (socket says 172.21.15.77:47556) 2024-04-21T10:25:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 -- 172.21.15.77:0/4198082030 learned_addr learned my addr 172.21.15.77:0/4198082030 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa8414b1640 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f61e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 -- 172.21.15.77:0/4198082030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 msgr2=0x55af08f61e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f61e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 -- 172.21.15.77:0/4198082030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 msgr2=0x55af08f655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 -- 172.21.15.77:0/4198082030 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af08f5be30 con 0x55af08f5cb60 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa840cb0640 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f71d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa838014710 tx=0x7fa83800f750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb5ebbae236f5954 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa826ffd640 1 -- 172.21.15.77:0/4198082030 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838014190 con 0x55af08f5cb60 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa826ffd640 1 -- 172.21.15.77:0/4198082030 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83800f9f0 con 0x55af08f5cb60 2024-04-21T10:25:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.981+0000 7fa826ffd640 1 -- 172.21.15.77:0/4198082030 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838012970 con 0x55af08f5cb60 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 -- 172.21.15.77:0/4198082030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 msgr2=0x55af08f71d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f71d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa838014710 tx=0x7fa83800f750 comp rx=0 tx=0).stop 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 -- 172.21.15.77:0/4198082030 shutdown_connections 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f61e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 --2- 172.21.15.77:0/4198082030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f71d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 -- 172.21.15.77:0/4198082030 >> 172.21.15.77:0/4198082030 conn(0x55af08f23c90 msgr2=0x55af08f61760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 -- 172.21.15.77:0/4198082030 shutdown_connections 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.982+0000 7fa8463e3740 1 -- 172.21.15.77:0/4198082030 wait complete. 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 -- start start 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 Processor -- start 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f6e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f69d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1ae170 con 0x55af08f660e0 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1af5e0 con 0x55af08f5d8d0 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1ae840 con 0x55af08f5cb60 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa8463e3740 10 client.0 _ll_register_callbacks cb 0x7fa82c00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f69d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa840cb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f69d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48694/0 (socket says 172.21.15.77:48694) 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.983+0000 7fa840cb0640 1 -- 172.21.15.77:0/1840195613 learned_addr learned my addr 172.21.15.77:0/1840195613 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f6e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa8414b1640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 -- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 msgr2=0x55af08f6e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f6e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 -- 172.21.15.77:0/1840195613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 msgr2=0x55af08f697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 -- 172.21.15.77:0/1840195613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af08f6a310 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa840cb0640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f69d20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa83800a760 tx=0x7fa838000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef806593ef2b853 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa824ff9640 1 -- 172.21.15.77:0/1840195613 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838014370 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa824ff9640 1 -- 172.21.15.77:0/1840195613 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa838003a30 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.984+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83800f9f0 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.985+0000 7fa824ff9640 1 -- 172.21.15.77:0/1840195613 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa838003c30 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.985+0000 7fa8463e3740 10 client.16059 fetch_fsmap learned FSMap version 27 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.985+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55af08fdc040 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.985+0000 7fa824ff9640 1 -- 172.21.15.77:0/1840195613 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83800f9f0 con 0x55af08f660e0 2024-04-21T10:25:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.985+0000 7fa824ff9640 1 -- 172.21.15.77:0/1840195613 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7fa8380054b0 con 0x55af08f660e0 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8463e3740 10 client.16059 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8463e3740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8463e3740 20 client.16059 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8463e3740 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08fde710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8463e3740 4 client.16059 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af08e613d0 con 0x55af08f76000 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.986+0000 7fa8414b1640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08fde710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.987+0000 7fa8414b1640 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08fde710 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292f9ed2c60a4de4 server_cookie=7bc4d78d01353cf5 in_seq=0 out_seq=0 2024-04-21T10:25:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.987+0000 7fa824ff9640 10 client.16059 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.997+0000 7fa824ff9640 1 -- 172.21.15.77:0/1840195613 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af08e613d0 con 0x55af08f76000 2024-04-21T10:25:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.997+0000 7fa824ff9640 10 client.16059 handle_command_reply: tid=0 2024-04-21T10:25:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.997+0000 7fa8463e3740 1 client.16059 shutdown 2024-04-21T10:25:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.997+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 msgr2=0x55af08f69d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.997+0000 7fa8463e3740 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f69d20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa83800a760 tx=0x7fa838000bc0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.998+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 shutdown_connections 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.998+0000 7fa8463e3740 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55af08f76000 0x55af08fde710 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.998+0000 7fa8463e3740 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af08f660e0 0x55af08f69d20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.998+0000 7fa8463e3740 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af08f5d8d0 0x55af08f697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.998+0000 7fa8463e3740 1 --2- 172.21.15.77:0/1840195613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55af08f5cb60 0x55af08f6e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.998+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 >> 172.21.15.77:0/1840195613 conn(0x55af08f23c90 msgr2=0x55af08f56040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.999+0000 7fa824ff9640 0 client.16059 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.999+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 shutdown_connections 2024-04-21T10:25:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:49.999+0000 7fa8463e3740 1 -- 172.21.15.77:0/1840195613 wait complete. 2024-04-21T10:25:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.000+0000 7fa8463e3740 20 client.16059 trim_cache size 0 max 16384 2024-04-21T10:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:25:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa8280a3e40 msgr2=0x7fa8280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa8280a3e40 0x7fa8280a6300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa8340ba5d0 tx=0x7fa834003b50 comp rx=0 tx=0).stop 2024-04-21T10:25:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c19f010 msgr2=0x7fa83c19f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c19f010 0x7fa83c19f4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa834009bf0 tx=0x7fa834035ce0 comp rx=0 tx=0).stop 2024-04-21T10:25:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 shutdown_connections 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fa8280a3e40 0x7fa8280a6300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa83c1072b0 0x7fa83c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa83c19f010 0x7fa83c19f4c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 --2- 172.21.15.77:0/357250266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83c1021e0 0x7fa83c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 >> 172.21.15.77:0/357250266 conn(0x7fa83c0fda00 msgr2=0x7fa83c0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 shutdown_connections 2024-04-21T10:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:25:50.001+0000 7fa843715640 1 -- 172.21.15.77:0/357250266 wait complete. 2024-04-21T10:25:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 245.0 s, 3301.6 tps, lat 30.243 ms stddev 30.835 2024-04-21T10:25:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:49 smithi170 ceph-mon[31212]: pgmap v135: 97 pgs: 97 active+clean; 2.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 1.45k op/s 2024-04-21T10:25:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:49 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:25:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:49 smithi077 ceph-mon[27902]: pgmap v135: 97 pgs: 97 active+clean; 2.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 1.45k op/s 2024-04-21T10:25:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:49 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:25:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:49 smithi191 ceph-mon[31636]: pgmap v135: 97 pgs: 97 active+clean; 2.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 1.45k op/s 2024-04-21T10:25:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:49 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:25:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:51 smithi170 ceph-mon[31212]: pgmap v136: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 42 MiB/s wr, 1.75k op/s 2024-04-21T10:25:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:51 smithi077 ceph-mon[27902]: pgmap v136: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 42 MiB/s wr, 1.75k op/s 2024-04-21T10:25:51.423 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-21T10:25:51.423 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.65 2024-04-21T10:25:51.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:25:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:51 smithi191 ceph-mon[31636]: pgmap v136: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 42 MiB/s wr, 1.75k op/s 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 -- 172.21.15.77:0/607675992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c109b70 msgr2=0x7fdb2c11d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 --2- 172.21.15.77:0/607675992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c109b70 0x7fdb2c11d7a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009900 tx=0x7fdb2402bc30 comp rx=0 tx=0).stop 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 -- 172.21.15.77:0/607675992 shutdown_connections 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 --2- 172.21.15.77:0/607675992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c109b70 0x7fdb2c11d7a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 --2- 172.21.15.77:0/607675992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c110b30 0x7fdb2c109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 --2- 172.21.15.77:0/607675992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb2c1106c0 0x7fdb2c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 -- 172.21.15.77:0/607675992 >> 172.21.15.77:0/607675992 conn(0x7fdb2c06e410 msgr2=0x7fdb2c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 -- 172.21.15.77:0/607675992 shutdown_connections 2024-04-21T10:25:51.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.552+0000 7fdb33132640 1 -- 172.21.15.77:0/607675992 wait complete. 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 Processor -- start 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 -- start start 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c1106c0 0x7fdb2c1a7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 0x7fdb2c1a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb2c1abdc0 0x7fdb2c1ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c120fc0 con 0x7fdb2c110b30 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c120e40 con 0x7fdb2c1abdc0 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb33132640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c121140 con 0x7fdb2c1106c0 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 0x7fdb2c1a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 0x7fdb2c1a7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57136/0 (socket says 172.21.15.77:57136) 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 -- 172.21.15.77:0/369081736 learned_addr learned my addr 172.21.15.77:0/369081736 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb30ece640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c1106c0 0x7fdb2c1a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb316cf640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb2c1abdc0 0x7fdb2c1ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 -- 172.21.15.77:0/369081736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c1106c0 msgr2=0x7fdb2c1a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c1106c0 0x7fdb2c1a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 -- 172.21.15.77:0/369081736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb2c1abdc0 msgr2=0x7fdb2c1ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb2c1abdc0 0x7fdb2c1ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 -- 172.21.15.77:0/369081736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c1ac8b0 con 0x7fdb2c110b30 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb30ece640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c1106c0 0x7fdb2c1a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.553+0000 7fdb2bfff640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 0x7fdb2c1a7a40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00ebc0 tx=0x7fdb1c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.554+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c004d20 con 0x7fdb2c110b30 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.554+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c1acba0 con 0x7fdb2c110b30 2024-04-21T10:25:51.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.554+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb1c0054d0 con 0x7fdb2c110b30 2024-04-21T10:25:51.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.554+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c010720 con 0x7fdb2c110b30 2024-04-21T10:25:51.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.554+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c1b4390 con 0x7fdb2c110b30 2024-04-21T10:25:51.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.555+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c068de0 con 0x7fdb2c110b30 2024-04-21T10:25:51.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.557+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fdb1c005020 con 0x7fdb2c110b30 2024-04-21T10:25:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.557+0000 7fdb29ffb640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdb180a3d20 0x7fdb180a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.557+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdb1c0d1040 con 0x7fdb2c110b30 2024-04-21T10:25:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.557+0000 7fdb30ece640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdb180a3d20 0x7fdb180a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.558+0000 7fdb30ece640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdb180a3d20 0x7fdb180a61e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400bfd0 tx=0x7fdb1400b390 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.563+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdb1c09d710 con 0x7fdb2c110b30 2024-04-21T10:25:51.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.906+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb2c109b70 con 0x7fdb2c110b30 2024-04-21T10:25:51.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.906+0000 7fdb29ffb640 1 -- 172.21.15.77:0/369081736 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11888 (secure 0 0 0) 0x7fdb1c09d010 con 0x7fdb2c110b30 2024-04-21T10:25:51.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:25:51.907 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:25:48.133113+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:25:51.907 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 27 2024-04-21T10:25:51.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.909+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdb180a3d20 msgr2=0x7fdb180a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:51.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.909+0000 7fdb33132640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdb180a3d20 0x7fdb180a61e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400bfd0 tx=0x7fdb1400b390 comp rx=0 tx=0).stop 2024-04-21T10:25:51.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.909+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 msgr2=0x7fdb2c1a7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:51.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.909+0000 7fdb33132640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 0x7fdb2c1a7a40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00ebc0 tx=0x7fdb1c00c6a0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 shutdown_connections 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fdb180a3d20 0x7fdb180a61e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c110b30 0x7fdb2c1a7a40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb2c1abdc0 0x7fdb2c1ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 --2- 172.21.15.77:0/369081736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb2c1106c0 0x7fdb2c1a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 >> 172.21.15.77:0/369081736 conn(0x7fdb2c06e410 msgr2=0x7fdb2c06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 shutdown_connections 2024-04-21T10:25:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:51.910+0000 7fdb33132640 1 -- 172.21.15.77:0/369081736 wait complete. 2024-04-21T10:25:51.924 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 80.65 --await' 2024-04-21T10:25:51.924 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 80.65 --await 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.071+0000 7f17c359e640 1 -- 172.21.15.77:0/324928739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 msgr2=0x7f17bc006f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.071+0000 7f17c359e640 1 --2- 172.21.15.77:0/324928739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc006f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009860 tx=0x7f17b802bc50 comp rx=0 tx=0).stop 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 -- 172.21.15.77:0/324928739 shutdown_connections 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 --2- 172.21.15.77:0/324928739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc006f40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 --2- 172.21.15.77:0/324928739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc098750 0x7f17bc098c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 --2- 172.21.15.77:0/324928739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc09ad60 0x7f17bc006580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 -- 172.21.15.77:0/324928739 >> 172.21.15.77:0/324928739 conn(0x7f17bc00a7c0 msgr2=0x7f17bc00abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 -- 172.21.15.77:0/324928739 shutdown_connections 2024-04-21T10:25:52.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.072+0000 7f17c359e640 1 -- 172.21.15.77:0/324928739 wait complete. 2024-04-21T10:25:52.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 Processor -- start 2024-04-21T10:25:52.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 -- start start 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 0x7f17bc138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc09ad60 0x7f17bc132790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc0ac5f0 con 0x7f17bc006ac0 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 0x7f17bc138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc0ac470 con 0x7f17bc098750 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 0x7f17bc138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:40318/0 (socket says 172.21.15.77:40318) 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c1d9b640 1 -- 172.21.15.77:0/373895042 learned_addr learned my addr 172.21.15.77:0/373895042 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc0ac770 con 0x7f17bc09ad60 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.073+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc09ad60 0x7f17bc132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c259c640 1 -- 172.21.15.77:0/373895042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc09ad60 msgr2=0x7f17bc132790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c259c640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc09ad60 0x7f17bc132790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c259c640 1 -- 172.21.15.77:0/373895042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 msgr2=0x7f17bc138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c259c640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 0x7f17bc138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c259c640 1 -- 172.21.15.77:0/373895042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc132f60 con 0x7f17bc006ac0 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 0x7f17bc138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc09ad60 0x7f17bc132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c259c640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc138620 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009fd0 tx=0x7f17b400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17b37fe640 1 -- 172.21.15.77:0/373895042 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4015020 con 0x7f17bc006ac0 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17b37fe640 1 -- 172.21.15.77:0/373895042 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b4011ce0 con 0x7f17bc006ac0 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc133250 con 0x7f17bc006ac0 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17b37fe640 1 -- 172.21.15.77:0/373895042 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4010de0 con 0x7f17bc006ac0 2024-04-21T10:25:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.074+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc13f470 con 0x7f17bc006ac0 2024-04-21T10:25:52.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.077+0000 7f17b37fe640 1 -- 172.21.15.77:0/373895042 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f17b4018020 con 0x7f17bc006ac0 2024-04-21T10:25:52.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 Processor -- start 2024-04-21T10:25:52.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 -- start start 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb89b90 0x55696cb89f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 0x55696cb92b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb93090 0x55696cb95480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55696caea0b0 con 0x55696cb8a4b0 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55696ca9b680 con 0x55696cb89b90 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17cb40f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55696caa7c60 con 0x55696cb93090 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 0x55696cb92b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 0x55696cb92b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57158/0 (socket says 172.21.15.77:57158) 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17c259c640 1 -- 172.21.15.77:0/430073806 learned_addr learned my addr 172.21.15.77:0/430073806 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:52.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17b37fe640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17ac0a3da0 0x7f17ac0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb93090 0x55696cb95480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.078+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb89b90 0x55696cb89f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17b37fe640 1 -- 172.21.15.77:0/373895042 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f17b40cfef0 con 0x7f17bc006ac0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c259c640 1 -- 172.21.15.77:0/430073806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb93090 msgr2=0x55696cb95480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c259c640 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb93090 0x55696cb95480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c259c640 1 -- 172.21.15.77:0/430073806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb89b90 msgr2=0x55696cb89f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c259c640 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb89b90 0x55696cb89f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c259c640 1 -- 172.21.15.77:0/430073806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696c8ccc90 con 0x55696cb8a4b0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb89b90 0x55696cb89f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17ac0a3da0 0x7f17ac0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17c259c640 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 0x55696cb92b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f17b40cd690 tx=0x7f17b4010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc5ba770994d64d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17b0ff9640 1 -- 172.21.15.77:0/430073806 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b409b8d0 con 0x55696cb8a4b0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17b0ff9640 1 -- 172.21.15.77:0/430073806 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b409c670 con 0x55696cb8a4b0 2024-04-21T10:25:52.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.079+0000 7f17b0ff9640 1 -- 172.21.15.77:0/430073806 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40985e0 con 0x55696cb8a4b0 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 -- 172.21.15.77:0/430073806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 msgr2=0x55696cb92b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17ac0a3da0 0x7f17ac0a6260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17c4067840 tx=0x7f17c407c040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 0x55696cb92b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f17b40cd690 tx=0x7f17b4010660 comp rx=0 tx=0).stop 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 -- 172.21.15.77:0/430073806 shutdown_connections 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb8a4b0 0x55696cb92b50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb93090 0x55696cb95480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 --2- 172.21.15.77:0/430073806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb89b90 0x55696cb89f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 -- 172.21.15.77:0/430073806 >> 172.21.15.77:0/430073806 conn(0x55696cb842c0 msgr2=0x55696cb846a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 -- 172.21.15.77:0/430073806 shutdown_connections 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 -- 172.21.15.77:0/430073806 wait complete. 2024-04-21T10:25:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.080+0000 7f17cb40f740 1 -- start start 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 Processor -- start 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 0x55696cb900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb8a4b0 0x55696cb905e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb93090 0x55696cb90b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 0x55696cb900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 0x55696cb900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57162/0 (socket says 172.21.15.77:57162) 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17c259c640 1 -- 172.21.15.77:0/2811815844 learned_addr learned my addr 172.21.15.77:0/2811815844 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55696caed400 con 0x55696cb89b90 2024-04-21T10:25:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55696caa9840 con 0x55696cb93090 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55696caf2720 con 0x55696cb8a4b0 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb93090 0x55696cb90b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.081+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb8a4b0 0x55696cb905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 10 client.0 _ll_register_callbacks cb 0x55696cafaea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17c259c640 1 -- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb8a4b0 msgr2=0x55696cb905e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17c259c640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb8a4b0 0x55696cb905e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17c259c640 1 -- 172.21.15.77:0/2811815844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb93090 msgr2=0x55696cb90b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17c259c640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb93090 0x55696cb90b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17c259c640 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696c92d420 con 0x55696cb89b90 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17b409c670 con 0x55696cb89b90 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17c259c640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 0x55696cb900a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f17b4098940 tx=0x7f17b4098870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ab90554e753a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17a9ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17a9ffb640 1 -- 172.21.15.77:0/2811815844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40b4070 con 0x55696cb89b90 2024-04-21T10:25:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17a9ffb640 1 -- 172.21.15.77:0/2811815844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f17b4097cc0 con 0x55696cb89b90 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17a9ffb640 1 -- 172.21.15.77:0/2811815844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17b40a4be0 con 0x55696cb89b90 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 10 client.16077 fetch_fsmap learned FSMap version 27 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55696c7c0580 con 0x55696cb89b90 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17a9ffb640 1 -- 172.21.15.77:0/2811815844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f17b40b5260 con 0x55696cb89b90 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 10 client.16077 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 10 client.16077 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 20 client.16077 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.082+0000 7f17cb40f740 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cba4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.083+0000 7f17cb40f740 4 client.16077 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.083+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55696cafbb10 con 0x55696cba2ac0 2024-04-21T10:25:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.085+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cba4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.086+0000 7f17a9ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.086+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cba4eb0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24b56199ed60ad78 server_cookie=6fc8dedb1a1c3736 in_seq=0 out_seq=0 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17a9ffb640 1 -- 172.21.15.77:0/2811815844 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55696cafbb10 con 0x55696cba2ac0 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17a9ffb640 10 client.16077 handle_command_reply: tid=0 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 client.16077 shutdown 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 msgr2=0x55696cb900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 0x55696cb900a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f17b4098940 tx=0x7f17b4098870 comp rx=0 tx=0).stop 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 shutdown_connections 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cba4eb0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17a9ffb640 0 client.16077 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb93090 0x55696cb90b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb8a4b0 0x55696cb905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 --2- 172.21.15.77:0/2811815844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb89b90 0x55696cb900a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 >> 172.21.15.77:0/2811815844 conn(0x55696cb842c0 msgr2=0x55696cb86010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 shutdown_connections 2024-04-21T10:25:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 1 -- 172.21.15.77:0/2811815844 wait complete. 2024-04-21T10:25:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.087+0000 7f17cb40f740 20 client.16077 trim_cache size 0 max 16384 2024-04-21T10:25:52.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 Processor -- start 2024-04-21T10:25:52.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 -- start start 2024-04-21T10:25:52.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb927d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb83180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cb8e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc147f10 con 0x55696cb93090 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc145d60 con 0x55696cb8a4b0 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.108+0000 7f17cb40f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc147840 con 0x55696cb89b90 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cb8e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cb8e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57168/0 (socket says 172.21.15.77:57168) 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 -- 172.21.15.77:0/3155688638 learned_addr learned my addr 172.21.15.77:0/3155688638 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb83180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 -- 172.21.15.77:0/3155688638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 msgr2=0x55696cb927d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb927d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 -- 172.21.15.77:0/3155688638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 msgr2=0x55696cb83180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb83180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 -- 172.21.15.77:0/3155688638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696cb88f10 con 0x55696cb93090 2024-04-21T10:25:52.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cb8e970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f17c4050f50 tx=0x7f17c4077000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eded0f5715875f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17abfff640 1 -- 172.21.15.77:0/3155688638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c40899e0 con 0x55696cb93090 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17abfff640 1 -- 172.21.15.77:0/3155688638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c4089b80 con 0x55696cb93090 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.109+0000 7f17abfff640 1 -- 172.21.15.77:0/3155688638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4086650 con 0x55696cb93090 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 -- 172.21.15.77:0/3155688638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 msgr2=0x55696cb8e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cb8e970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f17c4050f50 tx=0x7f17c4077000 comp rx=0 tx=0).stop 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 -- 172.21.15.77:0/3155688638 shutdown_connections 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cb8e970 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb83180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 --2- 172.21.15.77:0/3155688638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb927d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 -- 172.21.15.77:0/3155688638 >> 172.21.15.77:0/3155688638 conn(0x55696cb842c0 msgr2=0x55696cb85d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 -- 172.21.15.77:0/3155688638 shutdown_connections 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 -- 172.21.15.77:0/3155688638 wait complete. 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.110+0000 7f17cb40f740 1 -- start start 2024-04-21T10:25:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17cb40f740 1 Processor -- start 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb97050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb97590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17cb40f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cc07cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17cb40f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc146aa0 con 0x55696cb93090 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17c1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb97590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17c1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb97590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:40350/0 (socket says 172.21.15.77:40350) 2024-04-21T10:25:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17c1d9b640 1 -- 172.21.15.77:0/1662062841 learned_addr learned my addr 172.21.15.77:0/1662062841 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1463d0 con 0x55696cb8a4b0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.111+0000 7f17c2d9d640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cc07cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc147170 con 0x55696cb89b90 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c259c640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb97050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17cb40f740 10 client.0 _ll_register_callbacks cb 0x7f17c4050bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c1d9b640 1 -- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 msgr2=0x55696cb97050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb97050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c1d9b640 1 -- 172.21.15.77:0/1662062841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 msgr2=0x55696cc07cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cc07cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c1d9b640 1 -- 172.21.15.77:0/1662062841 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696cc08230 con 0x55696cb8a4b0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17c1d9b640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb97590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17b802c230 tx=0x7f17b80044e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccb019674824e71 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.112+0000 7f17a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17a9ffb640 1 -- 172.21.15.77:0/1662062841 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8039040 con 0x55696cb8a4b0 2024-04-21T10:25:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17a9ffb640 1 -- 172.21.15.77:0/1662062841 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f17b8034640 con 0x55696cb8a4b0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17c4089b80 con 0x55696cb8a4b0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17a9ffb640 1 -- 172.21.15.77:0/1662062841 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17b8047e20 con 0x55696cb8a4b0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17cb40f740 10 client.25424 fetch_fsmap learned FSMap version 27 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55696cc09480 con 0x55696cb8a4b0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.113+0000 7f17a9ffb640 1 -- 172.21.15.77:0/1662062841 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c4089b80 con 0x55696cb8a4b0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17a9ffb640 1 -- 172.21.15.77:0/1662062841 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f17b802c9d0 con 0x55696cb8a4b0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17cb40f740 10 client.25424 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17cb40f740 10 client.25424 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17cb40f740 20 client.25424 populate_metadata read hostname 'smithi077' 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17cb40f740 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cc0bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17cb40f740 4 client.25424 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.65, "await": true}] 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.65, "await": true}) -- 0x55696caf5980 con 0x55696cba2ac0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17c259c640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cc0bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:25:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17a9ffb640 10 client.25424 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:52.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.114+0000 7f17c259c640 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cc0bcb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eddc32906f91839 server_cookie=ebcf4b033d51fbe2 in_seq=0 out_seq=0 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17a9ffb640 1 -- 172.21.15.77:0/1662062841 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55696caf5980 con 0x55696cba2ac0 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17a9ffb640 10 client.25424 handle_command_reply: tid=0 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 client.25424 shutdown 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 msgr2=0x55696cb97590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb97590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17b802c230 tx=0x7f17b80044e0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 shutdown_connections 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55696cba2ac0 0x55696cc0bcb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55696cb93090 0x55696cc07cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55696cb8a4b0 0x55696cb97590 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17a9ffb640 0 client.25424 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 --2- 172.21.15.77:0/1662062841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55696cb89b90 0x55696cb97050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 >> 172.21.15.77:0/1662062841 conn(0x55696cb842c0 msgr2=0x55696cb91750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 shutdown_connections 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 1 -- 172.21.15.77:0/1662062841 wait complete. 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.271+0000 7f17cb40f740 20 client.25424 trim_cache size 0 max 16384 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 27, 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 14, 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: "327976fe": { 2024-04-21T10:25:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 14, 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 80.7, 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:25:52.274 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:52.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:52.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:52.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:52.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:25:52.275 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:25:52.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17ac0a3da0 msgr2=0x7f17ac0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17ac0a3da0 0x7f17ac0a6260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17c4067840 tx=0x7f17c407c040 comp rx=0 tx=0).stop 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 msgr2=0x7f17bc138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc138620 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009fd0 tx=0x7f17b400b7b0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 shutdown_connections 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17ac0a3da0 0x7f17ac0a6260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17bc09ad60 0x7f17bc132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17bc098750 0x7f17bc138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 --2- 172.21.15.77:0/373895042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc006ac0 0x7f17bc138620 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 >> 172.21.15.77:0/373895042 conn(0x7f17bc00a7c0 msgr2=0x7f17bc095b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 shutdown_connections 2024-04-21T10:25:52.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:25:52.272+0000 7f17c359e640 1 -- 172.21.15.77:0/373895042 wait complete. 2024-04-21T10:25:52.282 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:52 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/369081736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:25:52.283 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 327976fe, quiesce duration: 20.65 2024-04-21T10:25:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:52 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/369081736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:25:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:52 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/369081736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:25:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:53 smithi170 ceph-mon[31212]: pgmap v137: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 1.52k op/s 2024-04-21T10:25:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:53 smithi077 ceph-mon[27902]: pgmap v137: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 1.52k op/s 2024-04-21T10:25:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:53 smithi191 ceph-mon[31636]: pgmap v137: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 1.52k op/s 2024-04-21T10:25:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 250.0 s, 1386.3 tps, lat 28.320 ms stddev 28.566 2024-04-21T10:25:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:55 smithi170 ceph-mon[31212]: pgmap v138: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 1.45k op/s 2024-04-21T10:25:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:55 smithi077 ceph-mon[27902]: pgmap v138: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 1.45k op/s 2024-04-21T10:25:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:55 smithi191 ceph-mon[31636]: pgmap v138: 97 pgs: 97 active+clean; 2.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 1.45k op/s 2024-04-21T10:25:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:57 smithi170 ceph-mon[31212]: pgmap v139: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 39 MiB/s wr, 1.58k op/s 2024-04-21T10:25:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:57 smithi077 ceph-mon[27902]: pgmap v139: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 39 MiB/s wr, 1.58k op/s 2024-04-21T10:25:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:57 smithi191 ceph-mon[31636]: pgmap v139: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 39 MiB/s wr, 1.58k op/s 2024-04-21T10:25:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:25:59 smithi170 ceph-mon[31212]: pgmap v140: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 445 op/s 2024-04-21T10:25:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:25:59 smithi077 ceph-mon[27902]: pgmap v140: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 445 op/s 2024-04-21T10:25:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:25:59 smithi191 ceph-mon[31636]: pgmap v140: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 445 op/s 2024-04-21T10:26:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:01 smithi170 ceph-mon[31212]: pgmap v141: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 603 op/s 2024-04-21T10:26:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:01 smithi077 ceph-mon[27902]: pgmap v141: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 603 op/s 2024-04-21T10:26:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:01 smithi191 ceph-mon[31636]: pgmap v141: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 603 op/s 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 -- 172.21.15.77:0/1754471791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c102b70 msgr2=0x7efd2c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 --2- 172.21.15.77:0/1754471791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c102b70 0x7efd2c106bb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009900 tx=0x7efd1c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 -- 172.21.15.77:0/1754471791 shutdown_connections 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 --2- 172.21.15.77:0/1754471791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c102b70 0x7efd2c106bb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 --2- 172.21.15.77:0/1754471791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c107290 0x7efd2c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 --2- 172.21.15.77:0/1754471791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd2c1021c0 0x7efd2c1025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 -- 172.21.15.77:0/1754471791 >> 172.21.15.77:0/1754471791 conn(0x7efd2c0fd9e0 msgr2=0x7efd2c0ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 -- 172.21.15.77:0/1754471791 shutdown_connections 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 -- 172.21.15.77:0/1754471791 wait complete. 2024-04-21T10:26:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.100+0000 7efd33a8e640 1 Processor -- start 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 -- start start 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 0x7efd2c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd2c107290 0x7efd2c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c19cfd0 0x7efd2c19d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1121d0 con 0x7efd2c1021c0 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c112050 con 0x7efd2c19cfd0 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd33a8e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c112350 con 0x7efd2c107290 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 0x7efd2c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 0x7efd2c198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49488/0 (socket says 172.21.15.77:49488) 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 -- 172.21.15.77:0/3026752260 learned_addr learned my addr 172.21.15.77:0/3026752260 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd31029640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd2c107290 0x7efd2c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3202b640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c19cfd0 0x7efd2c19d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 -- 172.21.15.77:0/3026752260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd2c107290 msgr2=0x7efd2c198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd2c107290 0x7efd2c198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 -- 172.21.15.77:0/3026752260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c19cfd0 msgr2=0x7efd2c19d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c19cfd0 0x7efd2c19d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 -- 172.21.15.77:0/3026752260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c19dac0 con 0x7efd2c1021c0 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3202b640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c19cfd0 0x7efd2c19d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd3182a640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 0x7efd2c198710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efd2800ea80 tx=0x7efd2800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.101+0000 7efd22ffd640 1 -- 172.21.15.77:0/3026752260 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2800ce40 con 0x7efd2c1021c0 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.102+0000 7efd22ffd640 1 -- 172.21.15.77:0/3026752260 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd28005020 con 0x7efd2c1021c0 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.102+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c19ddb0 con 0x7efd2c1021c0 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.102+0000 7efd22ffd640 1 -- 172.21.15.77:0/3026752260 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd280116d0 con 0x7efd2c1021c0 2024-04-21T10:26:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.102+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1a5520 con 0x7efd2c1021c0 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.104+0000 7efd22ffd640 1 -- 172.21.15.77:0/3026752260 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7efd280054d0 con 0x7efd2c1021c0 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.104+0000 7efd3667d740 1 Processor -- start 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.104+0000 7efd3667d740 1 -- start start 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3667d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d7a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd22ffd640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd180a3dc0 0x7efd180a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3667d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7ab60 0x558a04d7afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3667d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d8a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3667d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558a04cdf8d0 con 0x558a04d884f0 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3667d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a04c7ce80 con 0x558a04d7b8d0 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3667d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558a04cdb890 con 0x558a04d7ab60 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3182a640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd180a3dc0 0x7efd180a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d8a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d8a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49496/0 (socket says 172.21.15.77:49496) 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 -- 172.21.15.77:0/1379302408 learned_addr learned my addr 172.21.15.77:0/1379302408 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d7a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd22ffd640 1 -- 172.21.15.77:0/3026752260 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efd280d0ab0 con 0x7efd2c1021c0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd31029640 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7ab60 0x558a04d7afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 -- 172.21.15.77:0/1379302408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7ab60 msgr2=0x558a04d7afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7ab60 0x558a04d7afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 -- 172.21.15.77:0/1379302408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 msgr2=0x558a04d7a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d7a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3202b640 1 -- 172.21.15.77:0/1379302408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a04c9e320 con 0x558a04d884f0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.105+0000 7efd3182a640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd180a3dc0 0x7efd180a6280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efd280ce830 tx=0x7efd28097040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3202b640 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d8a8e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efd24014990 tx=0x7efd2400c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3125bb4883f9abb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd17fff640 1 -- 172.21.15.77:0/1379302408 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd240142d0 con 0x558a04d884f0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd17fff640 1 -- 172.21.15.77:0/1379302408 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd240054d0 con 0x558a04d884f0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd17fff640 1 -- 172.21.15.77:0/1379302408 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd24004e50 con 0x558a04d884f0 2024-04-21T10:26:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 -- 172.21.15.77:0/1379302408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 msgr2=0x558a04d8a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d8a8e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efd24014990 tx=0x7efd2400c4b0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 -- 172.21.15.77:0/1379302408 shutdown_connections 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d8a8e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7ab60 0x558a04d7afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 --2- 172.21.15.77:0/1379302408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d7a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.106+0000 7efd3667d740 1 -- 172.21.15.77:0/1379302408 >> 172.21.15.77:0/1379302408 conn(0x558a04d41c90 msgr2=0x558a04d75850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 -- 172.21.15.77:0/1379302408 shutdown_connections 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 -- 172.21.15.77:0/1379302408 wait complete. 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 -- start start 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 Processor -- start 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 0x558a04d87f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558a04d8b220 con 0x558a04d7ab60 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a04c67eb0 con 0x558a04d7b8d0 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558a04d8b3a0 con 0x558a04d884f0 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.107+0000 7efd3667d740 10 client.0 _ll_register_callbacks cb 0x558a04c94b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 0x558a04d87f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 0x558a04d87f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49498/0 (socket says 172.21.15.77:49498) 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 -- 172.21.15.77:0/3389493682 learned_addr learned my addr 172.21.15.77:0/3389493682 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd31029640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 -- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 msgr2=0x558a04d858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d858b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 -- 172.21.15.77:0/3389493682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 msgr2=0x558a04d852a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d852a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 -- 172.21.15.77:0/3389493682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a049f2210 con 0x558a04d7ab60 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3202b640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 0x558a04d87f10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd240058c0 tx=0x7efd2400cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8883a560d3da955 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd157fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd157fa640 1 -- 172.21.15.77:0/3389493682 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2402a020 con 0x558a04d7ab60 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd157fa640 1 -- 172.21.15.77:0/3389493682 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efd24004e80 con 0x558a04d7ab60 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd240054d0 con 0x558a04d7ab60 2024-04-21T10:26:03.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd157fa640 1 -- 172.21.15.77:0/3389493682 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd24005080 con 0x558a04d7ab60 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3667d740 10 client.16095 fetch_fsmap learned FSMap version 27 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.108+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558a04abe620 con 0x558a04d7ab60 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd157fa640 1 -- 172.21.15.77:0/3389493682 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd240054d0 con 0x558a04d7ab60 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd157fa640 1 -- 172.21.15.77:0/3389493682 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7efd24020450 con 0x558a04d7ab60 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd3667d740 10 client.16095 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd3667d740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd3667d740 20 client.16095 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd3667d740 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04d98460 0x558a04d9a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd3667d740 4 client.16095 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a04cf3880 con 0x558a04d98460 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd31029640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04d98460 0x558a04d9a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.109+0000 7efd31029640 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04d98460 0x558a04d9a850 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d2ef88d38db949 server_cookie=6e61a94461dab4c5 in_seq=0 out_seq=0 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd157fa640 10 client.16095 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd157fa640 1 -- 172.21.15.77:0/3389493682 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a04cf3880 con 0x558a04d98460 2024-04-21T10:26:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd157fa640 10 client.16095 handle_command_reply: tid=0 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 client.16095 shutdown 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 msgr2=0x558a04d87f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 0x558a04d87f10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd240058c0 tx=0x7efd2400cdd0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 shutdown_connections 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04d98460 0x558a04d9a850 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd157fa640 0 client.16095 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7b8d0 0x558a04d852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 --2- 172.21.15.77:0/3389493682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7ab60 0x558a04d87f10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.110+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 >> 172.21.15.77:0/3389493682 conn(0x558a04d41c90 msgr2=0x558a04d775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.111+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 shutdown_connections 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.111+0000 7efd3667d740 1 -- 172.21.15.77:0/3389493682 wait complete. 2024-04-21T10:26:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.111+0000 7efd3667d740 20 client.16095 trim_cache size 0 max 16384 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.125+0000 7efd3667d740 1 Processor -- start 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.125+0000 7efd3667d740 1 -- start start 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3667d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d879d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3667d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 0x558a04d87f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3667d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d83b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3667d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1ae260 con 0x558a04d7b8d0 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3667d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1abad0 con 0x558a04d7ab60 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3667d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1a9940 con 0x558a04d884f0 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 0x558a04d87f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 0x558a04d87f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49514/0 (socket says 172.21.15.77:49514) 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 -- 172.21.15.77:0/235334735 learned_addr learned my addr 172.21.15.77:0/235334735 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd3202b640 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d879d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 -- 172.21.15.77:0/235334735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 msgr2=0x558a04d83b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d83b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 -- 172.21.15.77:0/235334735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 msgr2=0x558a04d879d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d879d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 -- 172.21.15.77:0/235334735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a04d79e30 con 0x558a04d7b8d0 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd31029640 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 0x558a04d87f10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0096c0 tx=0x7efd1c0042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61445afb18526992 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd177fe640 1 -- 172.21.15.77:0/235334735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c004460 con 0x558a04d7b8d0 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd177fe640 1 -- 172.21.15.77:0/235334735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd1c02cc90 con 0x558a04d7b8d0 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.126+0000 7efd177fe640 1 -- 172.21.15.77:0/235334735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c005400 con 0x558a04d7b8d0 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 -- 172.21.15.77:0/235334735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 msgr2=0x558a04d87f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 0x558a04d87f10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0096c0 tx=0x7efd1c0042b0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 -- 172.21.15.77:0/235334735 shutdown_connections 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d7b8d0 0x558a04d87f10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d884f0 0x558a04d83b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 --2- 172.21.15.77:0/235334735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d879d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 -- 172.21.15.77:0/235334735 >> 172.21.15.77:0/235334735 conn(0x558a04d41c90 msgr2=0x558a04d75380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 -- 172.21.15.77:0/235334735 shutdown_connections 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 -- 172.21.15.77:0/235334735 wait complete. 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 -- start start 2024-04-21T10:26:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.127+0000 7efd3667d740 1 Processor -- start 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d9d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7b8d0 0x558a04d9db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d98bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1a9f90 con 0x558a04d884f0 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1ab400 con 0x558a04d7ab60 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1aa660 con 0x558a04d7b8d0 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3667d740 10 client.0 _ll_register_callbacks cb 0x7efd2400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d98bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d98bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49518/0 (socket says 172.21.15.77:49518) 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 -- 172.21.15.77:0/2081424359 learned_addr learned my addr 172.21.15.77:0/2081424359 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d9d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd31029640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7b8d0 0x558a04d9db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 -- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7b8d0 msgr2=0x558a04d9db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7b8d0 0x558a04d9db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 -- 172.21.15.77:0/2081424359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 msgr2=0x558a04d9d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d9d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 -- 172.21.15.77:0/2081424359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a04d86210 con 0x558a04d884f0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd31029640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7b8d0 0x558a04d9db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd3202b640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d98bd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efd240209c0 tx=0x7efd24016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1e8de6cf77860 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd157fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.128+0000 7efd157fa640 1 -- 172.21.15.77:0/2081424359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2402a040 con 0x558a04d884f0 2024-04-21T10:26:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd157fa640 1 -- 172.21.15.77:0/2081424359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efd24014500 con 0x558a04d884f0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd1c02cc90 con 0x558a04d884f0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd157fa640 1 -- 172.21.15.77:0/2081424359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd240048d0 con 0x558a04d884f0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 10 client.16101 fetch_fsmap learned FSMap version 27 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558a04dfdf00 con 0x558a04d884f0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd157fa640 1 -- 172.21.15.77:0/2081424359 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd1c02cc90 con 0x558a04d884f0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd157fa640 1 -- 172.21.15.77:0/2081424359 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7efd2400fad0 con 0x558a04d884f0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 10 client.16101 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 20 client.16101 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04dfe3d0 0x558a04e007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 4 client.16101 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a04c7f3d0 con 0x558a04dfe3d0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.129+0000 7efd31029640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04dfe3d0 0x558a04e007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.130+0000 7efd157fa640 10 client.16101 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.130+0000 7efd31029640 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04dfe3d0 0x558a04e007c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c8ca32a18290a8 server_cookie=23acd4d240dda298 in_seq=0 out_seq=0 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.146+0000 7efd157fa640 1 -- 172.21.15.77:0/2081424359 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a04c7f3d0 con 0x558a04dfe3d0 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.146+0000 7efd157fa640 10 client.16101 handle_command_reply: tid=0 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.146+0000 7efd3667d740 1 client.16101 shutdown 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.146+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 msgr2=0x558a04d98bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.146+0000 7efd3667d740 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d98bd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efd240209c0 tx=0x7efd24016040 comp rx=0 tx=0).stop 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 shutdown_connections 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558a04dfe3d0 0x558a04e007c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd157fa640 0 client.16101 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a04d884f0 0x558a04d98bd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a04d7b8d0 0x558a04d9db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 --2- 172.21.15.77:0/2081424359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a04d7ab60 0x558a04d9d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 >> 172.21.15.77:0/2081424359 conn(0x558a04d41c90 msgr2=0x558a04d83a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 shutdown_connections 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 1 -- 172.21.15.77:0/2081424359 wait complete. 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd3667d740 20 client.16101 trim_cache size 0 max 16384 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:26:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd180a3dc0 msgr2=0x7efd180a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd180a3dc0 0x7efd180a6280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efd280ce830 tx=0x7efd28097040 comp rx=0 tx=0).stop 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 msgr2=0x7efd2c198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 0x7efd2c198710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efd2800ea80 tx=0x7efd2800ef40 comp rx=0 tx=0).stop 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 shutdown_connections 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd180a3dc0 0x7efd180a6280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd2c19cfd0 0x7efd2c19d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd2c107290 0x7efd2c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 --2- 172.21.15.77:0/3026752260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd2c1021c0 0x7efd2c198710 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 >> 172.21.15.77:0/3026752260 conn(0x7efd2c0fd9e0 msgr2=0x7efd2c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 shutdown_connections 2024-04-21T10:26:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:03.147+0000 7efd33a8e640 1 -- 172.21.15.77:0/3026752260 wait complete. 2024-04-21T10:26:03.520 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:03 smithi191 ceph-mon[31636]: pgmap v142: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.4 MiB/s wr, 308 op/s 2024-04-21T10:26:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:03 smithi170 ceph-mon[31212]: pgmap v142: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.4 MiB/s wr, 308 op/s 2024-04-21T10:26:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:03 smithi077 ceph-mon[27902]: pgmap v142: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.4 MiB/s wr, 308 op/s 2024-04-21T10:26:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:05 smithi170 ceph-mon[31212]: pgmap v143: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-04-21T10:26:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:05 smithi077 ceph-mon[27902]: pgmap v143: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-04-21T10:26:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:05 smithi191 ceph-mon[31636]: pgmap v143: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-04-21T10:26:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:07 smithi170 ceph-mon[31212]: pgmap v144: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 313 op/s 2024-04-21T10:26:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:07 smithi077 ceph-mon[27902]: pgmap v144: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 313 op/s 2024-04-21T10:26:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:07 smithi191 ceph-mon[31636]: pgmap v144: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 313 op/s 2024-04-21T10:26:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:09 smithi170 ceph-mon[31212]: pgmap v145: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.7 MiB/s wr, 183 op/s 2024-04-21T10:26:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:09 smithi077 ceph-mon[27902]: pgmap v145: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.7 MiB/s wr, 183 op/s 2024-04-21T10:26:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:09 smithi191 ceph-mon[31636]: pgmap v145: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.7 MiB/s wr, 183 op/s 2024-04-21T10:26:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:11 smithi170 ceph-mon[31212]: pgmap v146: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 186 op/s 2024-04-21T10:26:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:11 smithi077 ceph-mon[27902]: pgmap v146: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 186 op/s 2024-04-21T10:26:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:11 smithi191 ceph-mon[31636]: pgmap v146: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 186 op/s 2024-04-21T10:26:12.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:26:13.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 -- 172.21.15.77:0/3490335935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc1021a0 msgr2=0x7fc6dc102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3490335935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc1021a0 0x7fc6dc102580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009900 tx=0x7fc6cc02bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 -- 172.21.15.77:0/3490335935 shutdown_connections 2024-04-21T10:26:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3490335935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 0x7fc6dc10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3490335935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6dc102b50 0x7fc6dc106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3490335935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc1021a0 0x7fc6dc102580 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 -- 172.21.15.77:0/3490335935 >> 172.21.15.77:0/3490335935 conn(0x7fc6dc0793a0 msgr2=0x7fc6dc0797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 -- 172.21.15.77:0/3490335935 shutdown_connections 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 -- 172.21.15.77:0/3490335935 wait complete. 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 Processor -- start 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.044+0000 7fc6e283f640 1 -- start start 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6dc1021a0 0x7fc6dc198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 0x7fc6dc198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 0x7fc6dc19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1121e0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc112060 con 0x7fc6dc1021a0 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc112360 con 0x7fc6dc107270 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 0x7fc6dc19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 0x7fc6dc19d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53290/0 (socket says 172.21.15.77:53290) 2024-04-21T10:26:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 -- 172.21.15.77:0/3628678228 learned_addr learned my addr 172.21.15.77:0/3628678228 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6dbfff640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6dc1021a0 0x7fc6dc198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6db7fe640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 0x7fc6dc198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 -- 172.21.15.77:0/3628678228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 msgr2=0x7fc6dc198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 0x7fc6dc198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 -- 172.21.15.77:0/3628678228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6dc1021a0 msgr2=0x7fc6dc198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6dc1021a0 0x7fc6dc198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 -- 172.21.15.77:0/3628678228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc19dad0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6db7fe640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 0x7fc6dc198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e0ddc640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 0x7fc6dc19d490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400eaa0 tx=0x7fc6d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400cdb0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d4005020 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc19ddc0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40116d0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.045+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1a5600 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.046+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc069230 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.047+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fc6d40051d0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.048+0000 7fc6d97fa640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc6c40a3da0 0x7fc6c40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.048+0000 7fc6dbfff640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc6c40a3da0 0x7fc6c40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.048+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc6d40d0cc0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.049+0000 7fc6dbfff640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc6c40a3da0 0x7fc6c40a6260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc006010 tx=0x7fc6cc005e40 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.052+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6d4016030 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.269+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6dc199a70 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.270+0000 7fc6d97fa640 1 -- 172.21.15.77:0/3628678228 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11886 (secure 0 0 0) 0x7fc6d409d3b0 con 0x7fc6dc19cfe0 2024-04-21T10:26:13.270 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:26:13.270 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:26:11.371729+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:26:13.271 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-21T10:26:13.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc6c40a3da0 msgr2=0x7fc6c40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc6c40a3da0 0x7fc6c40a6260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc006010 tx=0x7fc6cc005e40 comp rx=0 tx=0).stop 2024-04-21T10:26:13.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 msgr2=0x7fc6dc19d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 0x7fc6dc19d490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400eaa0 tx=0x7fc6d400ef60 comp rx=0 tx=0).stop 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 shutdown_connections 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc6c40a3da0 0x7fc6c40a6260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6dc19cfe0 0x7fc6dc19d490 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6dc107270 0x7fc6dc198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 --2- 172.21.15.77:0/3628678228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6dc1021a0 0x7fc6dc198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 >> 172.21.15.77:0/3628678228 conn(0x7fc6dc0793a0 msgr2=0x7fc6dc0fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 shutdown_connections 2024-04-21T10:26:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.272+0000 7fc6e283f640 1 -- 172.21.15.77:0/3628678228 wait complete. 2024-04-21T10:26:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id 327976fe --release --await' 2024-04-21T10:26:13.283 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id 327976fe --release --await 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 -- 172.21.15.77:0/3488258707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 msgr2=0x7f2abc10e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 --2- 172.21.15.77:0/3488258707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc10e3c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009900 tx=0x7f2ab002bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 -- 172.21.15.77:0/3488258707 shutdown_connections 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 --2- 172.21.15.77:0/3488258707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc10e3c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 --2- 172.21.15.77:0/3488258707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2abc10e900 0x7f2abc110cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 --2- 172.21.15.77:0/3488258707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2abc100d50 0x7f2abc101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 -- 172.21.15.77:0/3488258707 >> 172.21.15.77:0/3488258707 conn(0x7f2abc077f50 msgr2=0x7f2abc078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 -- 172.21.15.77:0/3488258707 shutdown_connections 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 -- 172.21.15.77:0/3488258707 wait complete. 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 Processor -- start 2024-04-21T10:26:13.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.388+0000 7f2ac1455640 1 -- start start 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2abc100d50 0x7f2abc1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2abc10e900 0x7f2abc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc114430 con 0x7f2abc101670 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1142b0 con 0x7f2abc100d50 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1145b0 con 0x7f2abc10e900 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc1a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53306/0 (socket says 172.21.15.77:53306) 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 -- 172.21.15.77:0/4108410572 learned_addr learned my addr 172.21.15.77:0/4108410572 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2abaffd640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2abc100d50 0x7f2abc1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 -- 172.21.15.77:0/4108410572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2abc10e900 msgr2=0x7f2abc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2abc10e900 0x7f2abc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 -- 172.21.15.77:0/4108410572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2abc100d50 msgr2=0x7f2abc1a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2abc100d50 0x7f2abc1a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 -- 172.21.15.77:0/4108410572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc19afc0 con 0x7f2abc101670 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc1a0bc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0005940 tx=0x7f2ab0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aa3fff640 1 -- 172.21.15.77:0/4108410572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0043020 con 0x7f2abc101670 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2abc19b250 con 0x7f2abc101670 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aa3fff640 1 -- 172.21.15.77:0/4108410572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab0004440 con 0x7f2abc101670 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2aa3fff640 1 -- 172.21.15.77:0/4108410572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0003c20 con 0x7f2abc101670 2024-04-21T10:26:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.389+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2abc1a74d0 con 0x7f2abc101670 2024-04-21T10:26:13.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.391+0000 7f2aa3fff640 1 -- 172.21.15.77:0/4108410572 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f2ab0046020 con 0x7f2abc101670 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.391+0000 7f2ac4048740 1 Processor -- start 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 -- start start 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e605186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e605212d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60523c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e6047d500 con 0x561e60518310 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561e604236a0 con 0x561e60521810 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2ac4048740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561e604794c0 con 0x561e60518c30 2024-04-21T10:26:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2aa3fff640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f2aa40a3d20 0x7f2aa40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e605186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e605186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53310/0 (socket says 172.21.15.77:53310) 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 -- 172.21.15.77:0/2520738747 learned_addr learned my addr 172.21.15.77:0/2520738747 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f2aa40a3d20 0x7f2aa40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2aa3fff640 1 -- 172.21.15.77:0/4108410572 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2ab00f2a90 con 0x7f2abc101670 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60523c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abaffd640 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e605212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 -- 172.21.15.77:0/2520738747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 msgr2=0x561e605212d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e605212d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 -- 172.21.15.77:0/2520738747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 msgr2=0x561e60523c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60523c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 -- 172.21.15.77:0/2520738747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e604425e0 con 0x561e60518310 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60523c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e605186f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4012a10 tx=0x7f2ab4012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaff30430379ff8d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.392+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f2aa40a3d20 0x7f2aa40a61e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40058c0 tx=0x7f2ab4014000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2aa17fa640 1 -- 172.21.15.77:0/2520738747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4020070 con 0x561e60518310 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2aa17fa640 1 -- 172.21.15.77:0/2520738747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab400d830 con 0x561e60518310 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2aa17fa640 1 -- 172.21.15.77:0/2520738747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4004e40 con 0x561e60518310 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 -- 172.21.15.77:0/2520738747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 msgr2=0x561e605186f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e605186f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4012a10 tx=0x7f2ab4012ed0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 -- 172.21.15.77:0/2520738747 shutdown_connections 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60523c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e605212d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 --2- 172.21.15.77:0/2520738747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e605186f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 -- 172.21.15.77:0/2520738747 >> 172.21.15.77:0/2520738747 conn(0x561e60512a40 msgr2=0x561e60512e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 -- 172.21.15.77:0/2520738747 shutdown_connections 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.393+0000 7f2ac4048740 1 -- 172.21.15.77:0/2520738747 wait complete. 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 -- start start 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 Processor -- start 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60518310 0x561e6051e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e6051ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 0x561e6051f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e605245a0 con 0x561e60521810 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561e60436a60 con 0x561e60518310 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561e60524720 con 0x561e60518c30 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2ac4048740 10 client.0 _ll_register_callbacks cb 0x561e6018f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 0x561e6051f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 0x561e6051f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53316/0 (socket says 172.21.15.77:53316) 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 -- 172.21.15.77:0/3031105510 learned_addr learned my addr 172.21.15.77:0/3031105510 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e6051ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abaffd640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60518310 0x561e6051e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 -- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 msgr2=0x561e6051ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e6051ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 -- 172.21.15.77:0/3031105510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60518310 msgr2=0x561e6051e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60518310 0x561e6051e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 -- 172.21.15.77:0/3031105510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6018f920 con 0x561e60521810 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 0x561e6051f0f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400a280 tx=0x7f2ab4004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46e7c51f191d37 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2a9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.394+0000 7f2a9eff5640 1 -- 172.21.15.77:0/3031105510 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4031060 con 0x561e60521810 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2a9eff5640 1 -- 172.21.15.77:0/3031105510 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2ab4005430 con 0x561e60521810 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ab400d830 con 0x561e60521810 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2a9eff5640 1 -- 172.21.15.77:0/3031105510 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ab4020050 con 0x561e60521810 2024-04-21T10:26:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 10 client.16119 fetch_fsmap learned FSMap version 28 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e6025bd30 con 0x561e60521810 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2a9eff5640 1 -- 172.21.15.77:0/3031105510 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab400d830 con 0x561e60521810 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2a9eff5640 1 -- 172.21.15.77:0/3031105510 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f2ab401b030 con 0x561e60521810 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 10 client.16119 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 10 client.16119 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 20 client.16119 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60531960 0x561e60533d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 4 client.16119 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e60450a10 con 0x561e60531960 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.395+0000 7f2abaffd640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60531960 0x561e60533d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2abaffd640 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60531960 0x561e60533d50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c01230ec544e3db9 server_cookie=ba47fbb8aea13abf in_seq=0 out_seq=0 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2a9eff5640 10 client.16119 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2a9eff5640 1 -- 172.21.15.77:0/3031105510 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561e60450a10 con 0x561e60531960 2024-04-21T10:26:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2a9eff5640 10 client.16119 handle_command_reply: tid=0 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2ac4048740 1 client.16119 shutdown 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 msgr2=0x561e6051f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.396+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 0x561e6051f0f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400a280 tx=0x7f2ab4004e30 comp rx=0 tx=0).stop 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 shutdown_connections 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60531960 0x561e60533d50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60521810 0x561e6051f0f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2a9eff5640 0 client.16119 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e6051ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3031105510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60518310 0x561e6051e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 >> 172.21.15.77:0/3031105510 conn(0x561e60512a40 msgr2=0x561e60514790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 shutdown_connections 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 1 -- 172.21.15.77:0/3031105510 wait complete. 2024-04-21T10:26:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.397+0000 7f2ac4048740 20 client.16119 trim_cache size 0 max 16384 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 Processor -- start 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 -- start start 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518310 0x561e6052d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 0x561e60539540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60539a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1b25d0 con 0x561e60518c30 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1afe70 con 0x561e60521810 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2ac4048740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1adcc0 con 0x561e60518310 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 0x561e60539540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 0x561e60539540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53326/0 (socket says 172.21.15.77:53326) 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 -- 172.21.15.77:0/3056785446 learned_addr learned my addr 172.21.15.77:0/3056785446 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 -- 172.21.15.77:0/3056785446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518310 msgr2=0x561e6052d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518310 0x561e6052d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 -- 172.21.15.77:0/3056785446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 msgr2=0x561e60539a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60539a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 -- 172.21.15.77:0/3056785446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e605340c0 con 0x561e60518c30 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 0x561e60539540 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00beb00 tx=0x7f2ab00df040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9670aadd242ebaa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aa0ff9640 1 -- 172.21.15.77:0/3056785446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00bf270 con 0x561e60518c30 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aa0ff9640 1 -- 172.21.15.77:0/3056785446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab00beb70 con 0x561e60518c30 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.414+0000 7f2aa0ff9640 1 -- 172.21.15.77:0/3056785446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00bb1e0 con 0x561e60518c30 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 -- 172.21.15.77:0/3056785446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 msgr2=0x561e60539540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 0x561e60539540 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00beb00 tx=0x7f2ab00df040 comp rx=0 tx=0).stop 2024-04-21T10:26:13.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 -- 172.21.15.77:0/3056785446 shutdown_connections 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518c30 0x561e60539540 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60539a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- 172.21.15.77:0/3056785446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518310 0x561e6052d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 -- 172.21.15.77:0/3056785446 >> 172.21.15.77:0/3056785446 conn(0x561e60512a40 msgr2=0x561e60511270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 -- 172.21.15.77:0/3056785446 shutdown_connections 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 -- 172.21.15.77:0/3056785446 wait complete. 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 -- start start 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 Processor -- start 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e60529b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e60524930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.415+0000 7f2ac4048740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60524e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1ae330 con 0x561e60518310 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1af7a0 con 0x561e60521810 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1aea00 con 0x561e60518c30 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 10 client.0 _ll_register_callbacks cb 0x7f2ab4012810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e60529b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e60529b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53342/0 (socket says 172.21.15.77:53342) 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 -- 172.21.15.77:0/1777653672 learned_addr learned my addr 172.21.15.77:0/1777653672 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60524e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e60524930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 -- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 msgr2=0x561e60524930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e60524930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 -- 172.21.15.77:0/1777653672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 msgr2=0x561e60524e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60524e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 -- 172.21.15.77:0/1777653672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e605253b0 con 0x561e60518310 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e60524930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abb7fe640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60524e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2abaffd640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e60529b70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x561e605344b0 tx=0x7f2aac00ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7797ba1eb61b6ce1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2a9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2a9eff5640 1 -- 172.21.15.77:0/1777653672 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac014b70 con 0x561e60518310 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2a9eff5640 1 -- 172.21.15.77:0/1777653672 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2aac014d10 con 0x561e60518310 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ab00beb70 con 0x561e60518310 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2a9eff5640 1 -- 172.21.15.77:0/1777653672 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2aac029050 con 0x561e60518310 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 10 client.16125 fetch_fsmap learned FSMap version 28 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e60598b00 con 0x561e60518310 2024-04-21T10:26:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.416+0000 7f2a9eff5640 1 -- 172.21.15.77:0/1777653672 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab00beb70 con 0x561e60518310 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2a9eff5640 1 -- 172.21.15.77:0/1777653672 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f2aac018530 con 0x561e60518310 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2ac4048740 10 client.16125 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2ac4048740 10 client.16125 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2ac4048740 20 client.16125 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2ac4048740 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60599290 0x561e6059b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2ac4048740 4 client.16125 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "327976fe", "release": true, "await": true}] 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "327976fe", "release": true, "await": true}) -- 0x561e6048af20 con 0x561e60599290 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60599290 0x561e6059b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2a9eff5640 10 client.16125 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:13.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.417+0000 7f2aba7fc640 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60599290 0x561e6059b6b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14dcfc961d221c69 server_cookie=2503aa79134bdb3e in_seq=0 out_seq=0 2024-04-21T10:26:13.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2a9eff5640 1 -- 172.21.15.77:0/1777653672 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x561e6048af20 con 0x561e60599290 2024-04-21T10:26:13.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2a9eff5640 10 client.16125 handle_command_reply: tid=0 2024-04-21T10:26:13.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 client.16125 shutdown 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 msgr2=0x561e60529b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e60529b70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x561e605344b0 tx=0x7f2aac00ac10 comp rx=0 tx=0).stop 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 shutdown_connections 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x561e60599290 0x561e6059b6b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e60521810 0x561e60524e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e60518c30 0x561e60524930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 --2- 172.21.15.77:0/1777653672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e60518310 0x561e60529b70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2a9eff5640 0 client.16125 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 >> 172.21.15.77:0/1777653672 conn(0x561e60512a40 msgr2=0x561e60511b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 shutdown_connections 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 1 -- 172.21.15.77:0/1777653672 wait complete. 2024-04-21T10:26:13.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.422+0000 7f2ac4048740 20 client.16125 trim_cache size 0 max 16384 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 28, 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 16, 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "327976fe": { 2024-04-21T10:26:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 16, 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 80.7, 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:26:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:13.428 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f2aa40a3d20 msgr2=0x7f2aa40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f2aa40a3d20 0x7f2aa40a61e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40058c0 tx=0x7f2ab4014000 comp rx=0 tx=0).stop 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 msgr2=0x7f2abc1a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc1a0bc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0005940 tx=0x7f2ab0004040 comp rx=0 tx=0).stop 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 shutdown_connections 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f2aa40a3d20 0x7f2aa40a61e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2abc101670 0x7f2abc1a0bc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2abc10e900 0x7f2abc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 --2- 172.21.15.77:0/4108410572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2abc100d50 0x7f2abc1a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 >> 172.21.15.77:0/4108410572 conn(0x7f2abc077f50 msgr2=0x7f2abc110000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 shutdown_connections 2024-04-21T10:26:13.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.423+0000 7f2ac1455640 1 -- 172.21.15.77:0/4108410572 wait complete. 2024-04-21T10:26:13.433 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 327976fe, seconds elapsed: 22.0 2024-04-21T10:26:13.433 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.65 2024-04-21T10:26:13.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:26:13.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 -- 172.21.15.77:0/1405226969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101130 msgr2=0x7fc9981015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/1405226969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101130 0x7fc9981015b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc988009cd0 tx=0x7fc98802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 -- 172.21.15.77:0/1405226969 shutdown_connections 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/1405226969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101130 0x7fc9981015b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/1405226969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc998101af0 0x7fc99810dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/1405226969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc998106f40 0x7fc998107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 -- 172.21.15.77:0/1405226969 >> 172.21.15.77:0/1405226969 conn(0x7fc998077e30 msgr2=0x7fc998078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 -- 172.21.15.77:0/1405226969 shutdown_connections 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.546+0000 7fc99eb4b640 1 -- 172.21.15.77:0/1405226969 wait complete. 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 Processor -- start 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 -- start start 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc998101130 0x7fc9981986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 0x7fc998198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc998106f40 0x7fc99819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981121e0 con 0x7fc998101af0 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc998112060 con 0x7fc998106f40 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99eb4b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc998112360 con 0x7fc998101130 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 0x7fc998198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 0x7fc998198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53366/0 (socket says 172.21.15.77:53366) 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 -- 172.21.15.77:0/289401428 learned_addr learned my addr 172.21.15.77:0/289401428 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99d0e8640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc998106f40 0x7fc99819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc99c8e7640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc998101130 0x7fc9981986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 -- 172.21.15.77:0/289401428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc998101130 msgr2=0x7fc9981986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc998101130 0x7fc9981986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 -- 172.21.15.77:0/289401428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc998106f40 msgr2=0x7fc99819cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc998106f40 0x7fc99819cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.547+0000 7fc997fff640 1 -- 172.21.15.77:0/289401428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99819d6d0 con 0x7fc998101af0 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.548+0000 7fc997fff640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 0x7fc998198c20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc988004af0 tx=0x7fc988032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.548+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988041020 con 0x7fc998101af0 2024-04-21T10:26:13.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.548+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99819d960 con 0x7fc998101af0 2024-04-21T10:26:13.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.548+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc988034ca0 con 0x7fc998101af0 2024-04-21T10:26:13.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.548+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988039040 con 0x7fc998101af0 2024-04-21T10:26:13.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.548+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9981a5250 con 0x7fc998101af0 2024-04-21T10:26:13.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.550+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc998069230 con 0x7fc998101af0 2024-04-21T10:26:13.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.551+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fc988044020 con 0x7fc998101af0 2024-04-21T10:26:13.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.551+0000 7fc995ffb640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc9840a3d20 0x7fc9840a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.551+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc9880f22a0 con 0x7fc998101af0 2024-04-21T10:26:13.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.551+0000 7fc99c8e7640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc9840a3d20 0x7fc9840a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.552+0000 7fc99c8e7640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc9840a3d20 0x7fc9840a61e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc990009b50 tx=0x7fc990005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:13 smithi170 ceph-mon[31212]: pgmap v147: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-04-21T10:26:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:13 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:13.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.557+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc98804b020 con 0x7fc998101af0 2024-04-21T10:26:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:13 smithi077 ceph-mon[27902]: pgmap v147: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-04-21T10:26:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:13 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:13 smithi191 ceph-mon[31636]: pgmap v147: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-04-21T10:26:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:13 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.829+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9981092d0 con 0x7fc998101af0 2024-04-21T10:26:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.830+0000 7fc995ffb640 1 -- 172.21.15.77:0/289401428 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11886 (secure 0 0 0) 0x7fc9880d2e20 con 0x7fc998101af0 2024-04-21T10:26:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:26:13.831 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:26:11.371729+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:26:13.831 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-21T10:26:13.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc9840a3d20 msgr2=0x7fc9840a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc9840a3d20 0x7fc9840a61e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc990009b50 tx=0x7fc990005f90 comp rx=0 tx=0).stop 2024-04-21T10:26:13.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 msgr2=0x7fc998198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 0x7fc998198c20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc988004af0 tx=0x7fc988032da0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 shutdown_connections 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fc9840a3d20 0x7fc9840a61e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc998101af0 0x7fc998198c20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc998106f40 0x7fc99819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 --2- 172.21.15.77:0/289401428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc998101130 0x7fc9981986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 >> 172.21.15.77:0/289401428 conn(0x7fc998077e30 msgr2=0x7fc9980fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 shutdown_connections 2024-04-21T10:26:13.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.832+0000 7fc99eb4b640 1 -- 172.21.15.77:0/289401428 wait complete. 2024-04-21T10:26:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 80.65 --await' 2024-04-21T10:26:13.844 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 80.65 --await 2024-04-21T10:26:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 -- 172.21.15.77:0/175327808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb08101a50 msgr2=0x7fbb08105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/175327808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb08101a50 0x7fbb08105a90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009900 tx=0x7fbafc02bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 -- 172.21.15.77:0/175327808 shutdown_connections 2024-04-21T10:26:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/175327808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb08101a50 0x7fbb08105a90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/175327808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 0x7fbb0810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/175327808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 0x7fbb08101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 -- 172.21.15.77:0/175327808 >> 172.21.15.77:0/175327808 conn(0x7fbb08077f50 msgr2=0x7fbb08078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 -- 172.21.15.77:0/175327808 shutdown_connections 2024-04-21T10:26:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.968+0000 7fbb0cc81640 1 -- 172.21.15.77:0/175327808 wait complete. 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 Processor -- start 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 -- start start 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 0x7fbb08196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 0x7fbb08196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0819adf0 0x7fbb0819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810ffd0 con 0x7fbb0819adf0 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810fe50 con 0x7fbb08106170 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0cc81640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb08110150 con 0x7fbb081010a0 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 0x7fbb08196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb05d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 0x7fbb08196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 0x7fbb08196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:46266/0 (socket says 172.21.15.77:46266) 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb0659c640 1 -- 172.21.15.77:0/638953057 learned_addr learned my addr 172.21.15.77:0/638953057 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.969+0000 7fbb06d9d640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0819adf0 0x7fbb0819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb05d9b640 1 -- 172.21.15.77:0/638953057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 msgr2=0x7fbb08196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 0x7fbb08196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb05d9b640 1 -- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0819adf0 msgr2=0x7fbb0819b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0819adf0 0x7fbb0819b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb05d9b640 1 -- 172.21.15.77:0/638953057 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0819b8e0 con 0x7fbb08106170 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 0x7fbb08196a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbafc036040 tx=0x7fbafc0045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbaf77fe640 1 -- 172.21.15.77:0/638953057 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc043020 con 0x7fbb08106170 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0819bb70 con 0x7fbb08106170 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbaf77fe640 1 -- 172.21.15.77:0/638953057 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc02ca70 con 0x7fbb08106170 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbaf77fe640 1 -- 172.21.15.77:0/638953057 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc003a50 con 0x7fbb08106170 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.970+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb081a3370 con 0x7fbb08106170 2024-04-21T10:26:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.972+0000 7fbaf77fe640 1 -- 172.21.15.77:0/638953057 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fbafc046020 con 0x7fbb08106170 2024-04-21T10:26:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.973+0000 7fbaf77fe640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbaf00a3d20 0x7fbaf00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.973+0000 7fbb0659c640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbaf00a3d20 0x7fbaf00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.973+0000 7fbaf77fe640 1 -- 172.21.15.77:0/638953057 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fbafc0f2660 con 0x7fbb08106170 2024-04-21T10:26:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.973+0000 7fbb0f874740 1 Processor -- start 2024-04-21T10:26:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.973+0000 7fbb0f874740 1 -- start start 2024-04-21T10:26:13.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a14980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0f874740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562eb396c0b0 con 0x562eb3a0b9c0 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0f874740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562eb391d680 con 0x562eb3a14ec0 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0f874740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562eb3929c60 con 0x562eb3a0c2e0 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a14980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a14980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:46282/0 (socket says 172.21.15.77:46282) 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2986927950 learned_addr learned my addr 172.21.15.77:0/2986927950 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0659c640 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb06d9d640 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb0659c640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbaf00a3d20 0x7fbaf00a61e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009d40 tx=0x7fbaf8011810 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2986927950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 msgr2=0x562eb3a172b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a172b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2986927950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 msgr2=0x562eb3a0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a0bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2986927950 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb374ec90 con 0x562eb3a0c2e0 2024-04-21T10:26:13.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.974+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a14980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0baba0 tx=0x7fbafc0be0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4e5fa9d79bcd75e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbaf4ff9640 1 -- 172.21.15.77:0/2986927950 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0be740 con 0x562eb3a0c2e0 2024-04-21T10:26:13.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbaf4ff9640 1 -- 172.21.15.77:0/2986927950 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc0c2af0 con 0x562eb3a0c2e0 2024-04-21T10:26:13.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbaf4ff9640 1 -- 172.21.15.77:0/2986927950 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0be9a0 con 0x562eb3a0c2e0 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 -- 172.21.15.77:0/2986927950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 msgr2=0x562eb3a14980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a14980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0baba0 tx=0x7fbafc0be0a0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 -- 172.21.15.77:0/2986927950 shutdown_connections 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a14980 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2986927950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.975+0000 7fbb0f874740 1 -- 172.21.15.77:0/2986927950 >> 172.21.15.77:0/2986927950 conn(0x562eb3a060f0 msgr2=0x562eb3a064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 -- 172.21.15.77:0/2986927950 shutdown_connections 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 -- 172.21.15.77:0/2986927950 wait complete. 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 -- start start 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 Processor -- start 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a12000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a12540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562eb396f400 con 0x562eb3a14ec0 2024-04-21T10:26:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562eb392b840 con 0x562eb3a0c2e0 2024-04-21T10:26:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562eb3974720 con 0x562eb3a0b9c0 2024-04-21T10:26:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0f874740 10 client.0 _ll_register_callbacks cb 0x562eb397cea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb05d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a12540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb05d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a12540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:43518/0 (socket says 172.21.15.77:43518) 2024-04-21T10:26:13.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb05d9b640 1 -- 172.21.15.77:0/1990584113 learned_addr learned my addr 172.21.15.77:0/1990584113 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:13.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.976+0000 7fbb0659c640 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a12000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb05d9b640 1 -- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 msgr2=0x562eb3a12000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a12000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb05d9b640 1 -- 172.21.15.77:0/1990584113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 msgr2=0x562eb3a12a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a12a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb05d9b640 1 -- 172.21.15.77:0/1990584113 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb37af420 con 0x562eb3a0c2e0 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a12540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0f2980 tx=0x7fbafc005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb6a8cea32eb88b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbaedffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:26:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbaedffb640 1 -- 172.21.15.77:0/1990584113 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0be740 con 0x562eb3a0c2e0 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbaedffb640 1 -- 172.21.15.77:0/1990584113 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fbafc005340 con 0x562eb3a0c2e0 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbafc0c2af0 con 0x562eb3a0c2e0 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbaedffb640 1 -- 172.21.15.77:0/1990584113 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbafc0be9a0 con 0x562eb3a0c2e0 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb0f874740 10 client.25475 fetch_fsmap learned FSMap version 28 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.977+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eb3642580 con 0x562eb3a0c2e0 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbaedffb640 1 -- 172.21.15.77:0/1990584113 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc0c2af0 con 0x562eb3a0c2e0 2024-04-21T10:26:13.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbaedffb640 1 -- 172.21.15.77:0/1990584113 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fbafc0ba5b0 con 0x562eb3a0c2e0 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0f874740 10 client.25475 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0f874740 10 client.25475 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0f874740 20 client.25475 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a24800 0x562eb3a26bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0f874740 4 client.25475 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eb397db10 con 0x562eb3a24800 2024-04-21T10:26:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0659c640 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a24800 0x562eb3a26bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbaedffb640 10 client.25475 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.978+0000 7fbb0659c640 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a24800 0x562eb3a26bf0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f05dd46b7ee0f78 server_cookie=4fd3567cb85a0df7 in_seq=0 out_seq=0 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbaedffb640 1 -- 172.21.15.77:0/1990584113 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562eb397db10 con 0x562eb3a24800 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbaedffb640 10 client.25475 handle_command_reply: tid=0 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 client.25475 shutdown 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 msgr2=0x562eb3a12540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a12540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0f2980 tx=0x7fbafc005770 comp rx=0 tx=0).stop 2024-04-21T10:26:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 shutdown_connections 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a24800 0x562eb3a26bf0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a12540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbaedffb640 0 client.25475 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1990584113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a12000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 >> 172.21.15.77:0/1990584113 conn(0x562eb3a060f0 msgr2=0x562eb3a07e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 shutdown_connections 2024-04-21T10:26:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.979+0000 7fbb0f874740 1 -- 172.21.15.77:0/1990584113 wait complete. 2024-04-21T10:26:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.980+0000 7fbb0f874740 20 client.25475 trim_cache size 0 max 16384 2024-04-21T10:26:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 Processor -- start 2024-04-21T10:26:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 -- start start 2024-04-21T10:26:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a11170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a203b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081aba50 con 0x562eb3a0b9c0 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081a98c0 con 0x562eb3a14ec0 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0f874740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081ab380 con 0x562eb3a0c2e0 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a11170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a11170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53402/0 (socket says 172.21.15.77:53402) 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 -- 172.21.15.77:0/1606362625 learned_addr learned my addr 172.21.15.77:0/1606362625 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb06d9d640 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 -- 172.21.15.77:0/1606362625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 msgr2=0x562eb3a203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 -- 172.21.15.77:0/1606362625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 msgr2=0x562eb3a128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 -- 172.21.15.77:0/1606362625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb3a208f0 con 0x562eb3a0b9c0 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.998+0000 7fbb0659c640 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a11170 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x562eb3a273c0 tx=0x7fbaf801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5880d8a4041becc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbaeffff640 1 -- 172.21.15.77:0/1606362625 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8031070 con 0x562eb3a0b9c0 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbaeffff640 1 -- 172.21.15.77:0/1606362625 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaf8019050 con 0x562eb3a0b9c0 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbaeffff640 1 -- 172.21.15.77:0/1606362625 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8017040 con 0x562eb3a0b9c0 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 -- 172.21.15.77:0/1606362625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 msgr2=0x562eb3a11170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a11170 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x562eb3a273c0 tx=0x7fbaf801c000 comp rx=0 tx=0).stop 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 -- 172.21.15.77:0/1606362625 shutdown_connections 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a14ec0 0x562eb3a128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0c2e0 0x562eb3a203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 --2- 172.21.15.77:0/1606362625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a0b9c0 0x562eb3a11170 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:13.999+0000 7fbb0f874740 1 -- 172.21.15.77:0/1606362625 >> 172.21.15.77:0/1606362625 conn(0x562eb3a060f0 msgr2=0x562eb3a051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 -- 172.21.15.77:0/1606362625 shutdown_connections 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 -- 172.21.15.77:0/1606362625 wait complete. 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 -- start start 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 Processor -- start 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a1cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a180e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081aa5e0 con 0x562eb3a14ec0 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081a9f10 con 0x562eb3a0c2e0 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081aacb0 con 0x562eb3a0b9c0 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0f874740 10 client.0 _ll_register_callbacks cb 0x7fbaf8009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb05d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a180e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53406/0 (socket says 172.21.15.77:53406) 2024-04-21T10:26:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb06d9d640 1 -- 172.21.15.77:0/2773587680 learned_addr learned my addr 172.21.15.77:0/2773587680 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.000+0000 7fbb0659c640 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a1cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 msgr2=0x562eb3a1cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a1cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2773587680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 msgr2=0x562eb3a186f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a186f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb05d9b640 1 -- 172.21.15.77:0/2773587680 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb3a18f20 con 0x562eb3a0c2e0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb05d9b640 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a180e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0be440 tx=0x7fbafc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8175d413379756d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbaedffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbaedffb640 1 -- 172.21.15.77:0/2773587680 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0be740 con 0x562eb3a0c2e0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbaedffb640 1 -- 172.21.15.77:0/2773587680 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fbafc0c6f20 con 0x562eb3a0c2e0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaf8019050 con 0x562eb3a0c2e0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbaedffb640 1 -- 172.21.15.77:0/2773587680 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbafc0c7120 con 0x562eb3a0c2e0 2024-04-21T10:26:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb0f874740 10 client.25481 fetch_fsmap learned FSMap version 28 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eb3a18f20 con 0x562eb3a0c2e0 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbaedffb640 1 -- 172.21.15.77:0/2773587680 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaf8019050 con 0x562eb3a0c2e0 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.001+0000 7fbaedffb640 1 -- 172.21.15.77:0/2773587680 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7fbafc0ba490 con 0x562eb3a0c2e0 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0f874740 10 client.25481 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0f874740 10 client.25481 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0f874740 20 client.25481 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a8b1f0 0x562eb3a8d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0f874740 4 client.25481 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.65, "await": true}] 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.65, "await": true}) -- 0x562eb3977980 con 0x562eb3a8b1f0 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0659c640 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a8b1f0 0x562eb3a8d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbb0659c640 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a8b1f0 0x562eb3a8d610 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c6b8a62dee75a7b server_cookie=28ffdc09c78f2499 in_seq=0 out_seq=0 2024-04-21T10:26:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.002+0000 7fbaedffb640 10 client.25481 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.220+0000 7fbaedffb640 1 -- 172.21.15.77:0/2773587680 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562eb3977980 con 0x562eb3a8b1f0 2024-04-21T10:26:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.220+0000 7fbaedffb640 10 client.25481 handle_command_reply: tid=0 2024-04-21T10:26:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.220+0000 7fbb0f874740 1 client.25481 shutdown 2024-04-21T10:26:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 msgr2=0x562eb3a180e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a180e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0be440 tx=0x7fbafc000bc0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 shutdown_connections 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x562eb3a8b1f0 0x562eb3a8d610 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562eb3a14ec0 0x562eb3a186f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562eb3a0c2e0 0x562eb3a180e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbaedffb640 0 client.25481 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 --2- 172.21.15.77:0/2773587680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb3a0b9c0 0x562eb3a1cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 >> 172.21.15.77:0/2773587680 conn(0x562eb3a060f0 msgr2=0x562eb3a072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 shutdown_connections 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 1 -- 172.21.15.77:0/2773587680 wait complete. 2024-04-21T10:26:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0f874740 20 client.25481 trim_cache size 0 max 16384 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 28, 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 18, 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "964bb5fe": { 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 18, 2024-04-21T10:26:14.223 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 80.7, 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:14.224 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:14.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:14.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:14.225 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:26:14.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbaf00a3d20 msgr2=0x7fbaf00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbaf00a3d20 0x7fbaf00a61e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009d40 tx=0x7fbaf8011810 comp rx=0 tx=0).stop 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 msgr2=0x7fbb08196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 0x7fbb08196a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbafc036040 tx=0x7fbafc0045e0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 shutdown_connections 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbaf00a3d20 0x7fbaf00a61e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0819adf0 0x7fbb0819b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb08106170 0x7fbb08196a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 --2- 172.21.15.77:0/638953057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb081010a0 0x7fbb08196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.221+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 >> 172.21.15.77:0/638953057 conn(0x7fbb08077f50 msgr2=0x7fbb080ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.222+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 shutdown_connections 2024-04-21T10:26:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:14.222+0000 7fbb0cc81640 1 -- 172.21.15.77:0/638953057 wait complete. 2024-04-21T10:26:14.232 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 964bb5fe, quiesce duration: 20.65 2024-04-21T10:26:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3628678228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:14.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:14 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/289401428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3628678228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:14 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/289401428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3628678228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:14 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/289401428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 270.0 s, 115.1 tps, lat 3803.060 ms stddev 8086.072 2024-04-21T10:26:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:15 smithi170 ceph-mon[31212]: pgmap v148: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-04-21T10:26:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:15 smithi077 ceph-mon[27902]: pgmap v148: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-04-21T10:26:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:15 smithi191 ceph-mon[31636]: pgmap v148: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 -- 172.21.15.77:0/964197141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec106170 msgr2=0x7f38ec10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 --2- 172.21.15.77:0/964197141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec106170 0x7f38ec10dd40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009ca0 tx=0x7f38e402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 -- 172.21.15.77:0/964197141 shutdown_connections 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 --2- 172.21.15.77:0/964197141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec106170 0x7f38ec10dd40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 --2- 172.21.15.77:0/964197141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec101aa0 0x7f38ec105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 --2- 172.21.15.77:0/964197141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38ec1010f0 0x7f38ec1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 -- 172.21.15.77:0/964197141 >> 172.21.15.77:0/964197141 conn(0x7f38ec077fd0 msgr2=0x7f38ec0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 -- 172.21.15.77:0/964197141 shutdown_connections 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 -- 172.21.15.77:0/964197141 wait complete. 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.244+0000 7f38f457e640 1 Processor -- start 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 -- start start 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38ec1010f0 0x7f38ec198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec106170 0x7f38ec198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 0x7f38ec19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1121f0 con 0x7f38ec19cf30 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec112070 con 0x7f38ec106170 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f457e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec112370 con 0x7f38ec1010f0 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 0x7f38ec19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 0x7f38ec19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53428/0 (socket says 172.21.15.77:53428) 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1303110844 learned_addr learned my addr 172.21.15.77:0/1303110844 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f231a640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38ec1010f0 0x7f38ec198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec106170 0x7f38ec198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1303110844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38ec1010f0 msgr2=0x7f38ec198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38ec1010f0 0x7f38ec198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1303110844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec106170 msgr2=0x7f38ec198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec106170 0x7f38ec198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1303110844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec19da20 con 0x7f38ec19cf30 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec106170 0x7f38ec198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 0x7f38ec19d3e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f38e4005e30 tx=0x7f38e4034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.245+0000 7f38e37fe640 1 -- 172.21.15.77:0/1303110844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4039040 con 0x7f38ec19cf30 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.246+0000 7f38e37fe640 1 -- 172.21.15.77:0/1303110844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e4044070 con 0x7f38ec19cf30 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.246+0000 7f38e37fe640 1 -- 172.21.15.77:0/1303110844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4004040 con 0x7f38ec19cf30 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.246+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec19dcb0 con 0x7f38ec19cf30 2024-04-21T10:26:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.246+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec1a54d0 con 0x7f38ec19cf30 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.248+0000 7f38e37fe640 1 -- 172.21.15.77:0/1303110844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f38e40324c0 con 0x7f38ec19cf30 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.248+0000 7f38f7168740 1 Processor -- start 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 -- start start 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38e37fe640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f38d80a3e40 0x7f38d80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 0x55c2b129dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b12a70e0 0x55c2b12a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c2b12028d0 con 0x55c2b129db60 2024-04-21T10:26:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c2b119fe80 con 0x55c2b12a70e0 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f7168740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c2b11fe890 con 0x55c2b129e8d0 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f38d80a3e40 0x7f38d80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38e37fe640 1 -- 172.21.15.77:0/1303110844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f38e40f28d0 con 0x7f38ec19cf30 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 0x55c2b129dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 0x55c2b129dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53434/0 (socket says 172.21.15.77:53434) 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 -- 172.21.15.77:0/3044020434 learned_addr learned my addr 172.21.15.77:0/3044020434 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f231a640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b12a70e0 0x55c2b12a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 -- 172.21.15.77:0/3044020434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 msgr2=0x55c2b129d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 -- 172.21.15.77:0/3044020434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b12a70e0 msgr2=0x55c2b12a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b12a70e0 0x55c2b12a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 -- 172.21.15.77:0/3044020434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b11c1320 con 0x55c2b129db60 2024-04-21T10:26:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b12a70e0 0x55c2b12a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f231a640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f38d80a3e40 0x7f38d80a6300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38dc014a00 tx=0x7f38dc00cbc0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.249+0000 7f38f1b19640 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 0x55c2b129dfe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0058c0 tx=0x7f38dc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334d376bd7af0124 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.250+0000 7f38e0bfe640 1 -- 172.21.15.77:0/3044020434 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc00fc30 con 0x55c2b129db60 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.250+0000 7f38e0bfe640 1 -- 172.21.15.77:0/3044020434 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38dc00fdd0 con 0x55c2b129db60 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.250+0000 7f38e0bfe640 1 -- 172.21.15.77:0/3044020434 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc003850 con 0x55c2b129db60 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.250+0000 7f38f7168740 1 -- 172.21.15.77:0/3044020434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 msgr2=0x55c2b129dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.250+0000 7f38f7168740 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 0x55c2b129dfe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0058c0 tx=0x7f38dc01b000 comp rx=0 tx=0).stop 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- 172.21.15.77:0/3044020434 shutdown_connections 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129db60 0x55c2b129dfe0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b12a70e0 0x55c2b12a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 --2- 172.21.15.77:0/3044020434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- 172.21.15.77:0/3044020434 >> 172.21.15.77:0/3044020434 conn(0x55c2b1264c90 msgr2=0x55c2b1298850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- 172.21.15.77:0/3044020434 shutdown_connections 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- 172.21.15.77:0/3044020434 wait complete. 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- start start 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 Processor -- start 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 0x55c2b12a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b12a70e0 0x55c2b12a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c2b12a9db0 con 0x55c2b129e8d0 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c2b118aeb0 con 0x55c2b129db60 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c2b12a9f30 con 0x55c2b12a70e0 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f7168740 10 client.0 _ll_register_callbacks cb 0x55c2b11b7b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f1b19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 0x55c2b12a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f1b19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 0x55c2b12a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53438/0 (socket says 172.21.15.77:53438) 2024-04-21T10:26:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.251+0000 7f38f1b19640 1 -- 172.21.15.77:0/1146796880 learned_addr learned my addr 172.21.15.77:0/1146796880 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f231a640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f1b19640 1 -- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b12a70e0 msgr2=0x55c2b12a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b12a70e0 0x55c2b12a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f1b19640 1 -- 172.21.15.77:0/1146796880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 msgr2=0x55c2b12a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f1b19640 1 -- 172.21.15.77:0/1146796880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b0f15210 con 0x55c2b129e8d0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f231a640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f1b19640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 0x55c2b12a3e40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c310 tx=0x7f38dc00cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e48088a3d3b875 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38d5ffb640 1 -- 172.21.15.77:0/1146796880 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc00fc30 con 0x55c2b129e8d0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38d5ffb640 1 -- 172.21.15.77:0/1146796880 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f38dc003a00 con 0x55c2b129e8d0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38dc00fdd0 con 0x55c2b129e8d0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38d5ffb640 1 -- 172.21.15.77:0/1146796880 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38dc004450 con 0x55c2b129e8d0 2024-04-21T10:26:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f7168740 10 client.16161 fetch_fsmap learned FSMap version 28 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2b0fe1620 con 0x55c2b129e8d0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.252+0000 7f38d5ffb640 1 -- 172.21.15.77:0/1146796880 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38dc00fdd0 con 0x55c2b129e8d0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38d5ffb640 1 -- 172.21.15.77:0/1146796880 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f38dc02e020 con 0x55c2b129e8d0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f7168740 10 client.16161 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f7168740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f7168740 20 client.16161 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f7168740 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b12b70b0 0x55c2b12b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f7168740 4 client.16161 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2b1216880 con 0x55c2b12b70b0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f231a640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b12b70b0 0x55c2b12b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38d5ffb640 10 client.16161 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.253+0000 7f38f231a640 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b12b70b0 0x55c2b12b94a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7029dc7557eb95c3 server_cookie=c334cd127236d5ec in_seq=0 out_seq=0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38d5ffb640 1 -- 172.21.15.77:0/1146796880 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c2b1216880 con 0x55c2b12b70b0 2024-04-21T10:26:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38d5ffb640 10 client.16161 handle_command_reply: tid=0 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 client.16161 shutdown 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 msgr2=0x55c2b12a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 0x55c2b12a3e40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c310 tx=0x7f38dc00cdf0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 shutdown_connections 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b12b70b0 0x55c2b12b94a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b129e8d0 0x55c2b12a3e40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b12a70e0 0x55c2b12a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38d5ffb640 0 client.16161 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 --2- 172.21.15.77:0/1146796880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 >> 172.21.15.77:0/1146796880 conn(0x55c2b1264c90 msgr2=0x55c2b129a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.254+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 shutdown_connections 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.255+0000 7f38f7168740 1 -- 172.21.15.77:0/1146796880 wait complete. 2024-04-21T10:26:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.255+0000 7f38f7168740 20 client.16161 trim_cache size 0 max 16384 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 Processor -- start 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 -- start start 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1b0200 con 0x55c2b12a70e0 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1adaa0 con 0x55c2b129db60 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f7168740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1ab910 con 0x55c2b129e8d0 2024-04-21T10:26:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f2b1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f2b1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12a6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53452/0 (socket says 172.21.15.77:53452) 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.270+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1584505543 learned_addr learned my addr 172.21.15.77:0/1584505543 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f231a640 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1584505543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 msgr2=0x55c2b129f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1584505543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 msgr2=0x55c2b12b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f2b1b640 1 -- 172.21.15.77:0/1584505543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b12a4a50 con 0x55c2b12a70e0 2024-04-21T10:26:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12a6570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f38e40bae10 tx=0x7f38e402c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f754c3dde1e89d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38d7fff640 1 -- 172.21.15.77:0/1584505543 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e40be780 con 0x55c2b12a70e0 2024-04-21T10:26:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38d7fff640 1 -- 172.21.15.77:0/1584505543 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e403e3a0 con 0x55c2b12a70e0 2024-04-21T10:26:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.271+0000 7f38d7fff640 1 -- 172.21.15.77:0/1584505543 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4036cf0 con 0x55c2b12a70e0 2024-04-21T10:26:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- 172.21.15.77:0/1584505543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 msgr2=0x55c2b12a6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12a6570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f38e40bae10 tx=0x7f38e402c910 comp rx=0 tx=0).stop 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- 172.21.15.77:0/1584505543 shutdown_connections 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12a6570 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129e8d0 0x55c2b129f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- 172.21.15.77:0/1584505543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129db60 0x55c2b12b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- 172.21.15.77:0/1584505543 >> 172.21.15.77:0/1584505543 conn(0x55c2b1264c90 msgr2=0x55c2b129eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- 172.21.15.77:0/1584505543 shutdown_connections 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- 172.21.15.77:0/1584505543 wait complete. 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- start start 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 Processor -- start 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129db60 0x55c2b12a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129e8d0 0x55c2b12af210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12af790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1abf60 con 0x55c2b12a70e0 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1ad3d0 con 0x55c2b129e8d0 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1ac630 con 0x55c2b129db60 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f7168740 10 client.0 _ll_register_callbacks cb 0x7f38e800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f2b1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f2b1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12af790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53456/0 (socket says 172.21.15.77:53456) 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.272+0000 7f38f2b1b640 1 -- 172.21.15.77:0/2598621425 learned_addr learned my addr 172.21.15.77:0/2598621425 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f231a640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129db60 0x55c2b12a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f2b1b640 1 -- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129db60 msgr2=0x55c2b12a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129db60 0x55c2b12a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f2b1b640 1 -- 172.21.15.77:0/2598621425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129e8d0 msgr2=0x55c2b12af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f1b19640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129e8d0 0x55c2b12af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129e8d0 0x55c2b12af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f2b1b640 1 -- 172.21.15.77:0/2598621425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b1293f30 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f231a640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129db60 0x55c2b12a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f1b19640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129e8d0 0x55c2b12af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f2b1b640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12af790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009dc0 tx=0x7f38e40be7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de8c990646fe7a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38d5ffb640 1 -- 172.21.15.77:0/2598621425 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e40327b0 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38d5ffb640 1 -- 172.21.15.77:0/2598621425 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f38e40a91b0 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38e403e3a0 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38d5ffb640 1 -- 172.21.15.77:0/2598621425 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38e40be310 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f7168740 10 client.16167 fetch_fsmap learned FSMap version 28 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2b129ce30 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38d5ffb640 1 -- 172.21.15.77:0/2598621425 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e403e3a0 con 0x55c2b12a70e0 2024-04-21T10:26:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.273+0000 7f38d5ffb640 1 -- 172.21.15.77:0/2598621425 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f38e40bfce0 con 0x55c2b12a70e0 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f7168740 10 client.16167 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f7168740 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f7168740 20 client.16167 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f7168740 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b131ded0 0x55c2b13202c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f7168740 4 client.16167 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2b11a23d0 con 0x55c2b131ded0 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f231a640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b131ded0 0x55c2b13202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38f231a640 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b131ded0 0x55c2b13202c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e224da5b3a676968 server_cookie=64d275b25711cb1d in_seq=0 out_seq=0 2024-04-21T10:26:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.274+0000 7f38d5ffb640 10 client.16167 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.287+0000 7f38d5ffb640 1 -- 172.21.15.77:0/2598621425 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2b11a23d0 con 0x55c2b131ded0 2024-04-21T10:26:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.287+0000 7f38d5ffb640 10 client.16167 handle_command_reply: tid=0 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.287+0000 7f38f7168740 1 client.16167 shutdown 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.287+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 msgr2=0x55c2b12af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12af790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009dc0 tx=0x7f38e40be7f0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 shutdown_connections 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c2b131ded0 0x55c2b13202c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c2b12a70e0 0x55c2b12af790 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2b129e8d0 0x55c2b12af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38d5ffb640 0 client.16167 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 --2- 172.21.15.77:0/2598621425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c2b129db60 0x55c2b12a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 >> 172.21.15.77:0/2598621425 conn(0x55c2b1264c90 msgr2=0x55c2b1297040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 shutdown_connections 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 1 -- 172.21.15.77:0/2598621425 wait complete. 2024-04-21T10:26:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f7168740 20 client.16167 trim_cache size 0 max 16384 2024-04-21T10:26:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:26:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:26:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:26:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f38d80a3e40 msgr2=0x7f38d80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f38d80a3e40 0x7f38d80a6300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38dc014a00 tx=0x7f38dc00cbc0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 msgr2=0x7f38ec19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 0x7f38ec19d3e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f38e4005e30 tx=0x7f38e4034760 comp rx=0 tx=0).stop 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 shutdown_connections 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f38d80a3e40 0x7f38d80a6300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38ec19cf30 0x7f38ec19d3e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38ec106170 0x7f38ec198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 --2- 172.21.15.77:0/1303110844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38ec1010f0 0x7f38ec198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 >> 172.21.15.77:0/1303110844 conn(0x7f38ec077fd0 msgr2=0x7f38ec0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.288+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 shutdown_connections 2024-04-21T10:26:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:16.289+0000 7f38f457e640 1 -- 172.21.15.77:0/1303110844 wait complete. 2024-04-21T10:26:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:17 smithi170 ceph-mon[31212]: pgmap v149: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 340 KiB/s wr, 71 op/s 2024-04-21T10:26:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:17 smithi077 ceph-mon[27902]: pgmap v149: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 340 KiB/s wr, 71 op/s 2024-04-21T10:26:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:17 smithi191 ceph-mon[31636]: pgmap v149: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 340 KiB/s wr, 71 op/s 2024-04-21T10:26:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:19 smithi170 ceph-mon[31212]: pgmap v150: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 296 KiB/s wr, 46 op/s 2024-04-21T10:26:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:19 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:19 smithi077 ceph-mon[27902]: pgmap v150: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 296 KiB/s wr, 46 op/s 2024-04-21T10:26:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:19 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:19 smithi191 ceph-mon[31636]: pgmap v150: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 296 KiB/s wr, 46 op/s 2024-04-21T10:26:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:19 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:21 smithi170 ceph-mon[31212]: pgmap v151: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 308 KiB/s wr, 52 op/s 2024-04-21T10:26:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:21 smithi077 ceph-mon[27902]: pgmap v151: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 308 KiB/s wr, 52 op/s 2024-04-21T10:26:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:21 smithi191 ceph-mon[31636]: pgmap v151: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 308 KiB/s wr, 52 op/s 2024-04-21T10:26:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:23 smithi170 ceph-mon[31212]: pgmap v152: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 306 KiB/s wr, 49 op/s 2024-04-21T10:26:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:23 smithi077 ceph-mon[27902]: pgmap v152: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 306 KiB/s wr, 49 op/s 2024-04-21T10:26:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:23 smithi191 ceph-mon[31636]: pgmap v152: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 306 KiB/s wr, 49 op/s 2024-04-21T10:26:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:25 smithi170 ceph-mon[31212]: pgmap v153: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 278 KiB/s wr, 48 op/s 2024-04-21T10:26:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:25 smithi077 ceph-mon[27902]: pgmap v153: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 278 KiB/s wr, 48 op/s 2024-04-21T10:26:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:25 smithi191 ceph-mon[31636]: pgmap v153: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 278 KiB/s wr, 48 op/s 2024-04-21T10:26:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:27 smithi170 ceph-mon[31212]: pgmap v154: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 421 op/s 2024-04-21T10:26:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:27 smithi077 ceph-mon[27902]: pgmap v154: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 421 op/s 2024-04-21T10:26:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:27 smithi191 ceph-mon[31636]: pgmap v154: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 421 op/s 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 -- 172.21.15.77:0/2227398361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 msgr2=0x7f8804103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 --2- 172.21.15.77:0/2227398361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804103600 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8800009ca0 tx=0x7f880002c180 comp rx=0 tx=0).stop 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 -- 172.21.15.77:0/2227398361 shutdown_connections 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 --2- 172.21.15.77:0/2227398361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f880410c560 0x7f880410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 --2- 172.21.15.77:0/2227398361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8804103b40 0x7f880410c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 --2- 172.21.15.77:0/2227398361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804103600 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 -- 172.21.15.77:0/2227398361 >> 172.21.15.77:0/2227398361 conn(0x7f8804077fd0 msgr2=0x7f88040783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 -- 172.21.15.77:0/2227398361 shutdown_connections 2024-04-21T10:26:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.385+0000 7f880bf59640 1 -- 172.21.15.77:0/2227398361 wait complete. 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 Processor -- start 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 -- start start 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8804103b40 0x7f8804198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f880410c560 0x7f880419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88041121b0 con 0x7f8804103220 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8804112030 con 0x7f880410c560 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880bf59640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8804112330 con 0x7f8804103b40 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39900/0 (socket says 172.21.15.77:39900) 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 -- 172.21.15.77:0/3882783351 learned_addr learned my addr 172.21.15.77:0/3882783351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f88094f4640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8804103b40 0x7f8804198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 -- 172.21.15.77:0/3882783351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8804103b40 msgr2=0x7f8804198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8804103b40 0x7f8804198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 -- 172.21.15.77:0/3882783351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f880410c560 msgr2=0x7f880419cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f880410c560 0x7f880419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f880410c560 0x7f880419cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 -- 172.21.15.77:0/3882783351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880419d720 con 0x7f8804103220 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.386+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804198730 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8800005e30 tx=0x7f88000039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.387+0000 7f87faffd640 1 -- 172.21.15.77:0/3882783351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800039040 con 0x7f8804103220 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.387+0000 7f87faffd640 1 -- 172.21.15.77:0/3882783351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8800044070 con 0x7f8804103220 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.387+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880419d9b0 con 0x7f8804103220 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.387+0000 7f87faffd640 1 -- 172.21.15.77:0/3882783351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800032960 con 0x7f8804103220 2024-04-21T10:26:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.387+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88041a52a0 con 0x7f8804103220 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.389+0000 7f87faffd640 1 -- 172.21.15.77:0/3882783351 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f8800004580 con 0x7f8804103220 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.389+0000 7f880ec2e740 1 Processor -- start 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.389+0000 7f880ec2e740 1 -- start start 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a23a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880ec2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f759848d0 con 0x556f75a2d4f0 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880ec2e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556f75921e80 con 0x556f75a23f70 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880ec2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556f75980890 con 0x556f75a24ce0 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39916/0 (socket says 172.21.15.77:39916) 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 -- 172.21.15.77:0/2655245326 learned_addr learned my addr 172.21.15.77:0/2655245326 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f8809cf5640 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880a4f6640 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a23a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f87faffd640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f87f00a3dc0 0x7f87f00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 -- 172.21.15.77:0/2655245326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 msgr2=0x556f75a23a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a23a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 -- 172.21.15.77:0/2655245326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 msgr2=0x556f75a243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a243f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 -- 172.21.15.77:0/2655245326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f75943320 con 0x556f75a2d4f0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880a4f6640 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a23a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f87f00a3dc0 0x7f87f00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f87faffd640 1 -- 172.21.15.77:0/3882783351 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f88000f2d50 con 0x7f8804103220 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.390+0000 7f88094f4640 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2f8e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f87f400bc90 tx=0x7f87f400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dddc23cfc80b31a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f87effff640 1 -- 172.21.15.77:0/2655245326 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4015070 con 0x556f75a2d4f0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f87effff640 1 -- 172.21.15.77:0/2655245326 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f401a910 con 0x556f75a2d4f0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f87effff640 1 -- 172.21.15.77:0/2655245326 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011860 con 0x556f75a2d4f0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 -- 172.21.15.77:0/2655245326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 msgr2=0x556f75a2f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f87f00a3dc0 0x7f87f00a6280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87fc005fd0 tx=0x7f87fc0046c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2f8e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f87f400bc90 tx=0x7f87f400f730 comp rx=0 tx=0).stop 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 -- 172.21.15.77:0/2655245326 shutdown_connections 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2f8e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 --2- 172.21.15.77:0/2655245326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a23a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.391+0000 7f880ec2e740 1 -- 172.21.15.77:0/2655245326 >> 172.21.15.77:0/2655245326 conn(0x556f759e6c90 msgr2=0x556f75a1ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 -- 172.21.15.77:0/2655245326 shutdown_connections 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 -- 172.21.15.77:0/2655245326 wait complete. 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 -- start start 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 Processor -- start 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a2cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a2a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f75a30220 con 0x556f75a2d4f0 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556f7590ceb0 con 0x556f75a23f70 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556f75a303a0 con 0x556f75a24ce0 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.392+0000 7f880ec2e740 10 client.0 _ll_register_callbacks cb 0x556f75939b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39930/0 (socket says 172.21.15.77:39930) 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 -- 172.21.15.77:0/4229256191 learned_addr learned my addr 172.21.15.77:0/4229256191 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f8809cf5640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a2cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f88094f4640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a2a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 -- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 msgr2=0x556f75a2a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a2a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 -- 172.21.15.77:0/4229256191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 msgr2=0x556f75a2cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a2cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 -- 172.21.15.77:0/4229256191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f75697210 con 0x556f75a2d4f0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880a4f6640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2a890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0116c0 tx=0x7f87fc005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5fe534f003b649 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f87ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f87ed7fa640 1 -- 172.21.15.77:0/4229256191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01c940 con 0x556f75a2d4f0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f87ed7fa640 1 -- 172.21.15.77:0/4229256191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f87fc01cae0 con 0x556f75a2d4f0 2024-04-21T10:26:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87f401a910 con 0x556f75a2d4f0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f87ed7fa640 1 -- 172.21.15.77:0/4229256191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f87fc01cce0 con 0x556f75a2d4f0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880ec2e740 10 client.16179 fetch_fsmap learned FSMap version 29 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.393+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556f75763620 con 0x556f75a2d4f0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f87ed7fa640 1 -- 172.21.15.77:0/4229256191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f401a910 con 0x556f75a2d4f0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f87ed7fa640 1 -- 172.21.15.77:0/4229256191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8342+0+0 (secure 0 0 0) 0x7f87fc023070 con 0x556f75a2d4f0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f880ec2e740 10 client.16179 fetch_fsmap finished waiting for FSMap version 29 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f880ec2e740 10 client.16179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f880ec2e740 20 client.16179 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f880ec2e740 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75a3d5a0 0x556f75a3f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f880ec2e740 4 client.16179 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f75998880 con 0x556f75a3d5a0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.394+0000 7f8809cf5640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75a3d5a0 0x556f75a3f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f87ed7fa640 10 client.16179 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f8809cf5640 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75a3d5a0 0x556f75a3f9f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26445ffa0ce156d1 server_cookie=7db1114ef10c3702 in_seq=0 out_seq=0 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f87ed7fa640 1 -- 172.21.15.77:0/4229256191 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556f75998880 con 0x556f75a3d5a0 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f87ed7fa640 10 client.16179 handle_command_reply: tid=0 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 client.16179 shutdown 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 msgr2=0x556f75a2a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2a890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0116c0 tx=0x7f87fc005e20 comp rx=0 tx=0).stop 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 shutdown_connections 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75a3d5a0 0x556f75a3f9f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a2a890 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f87ed7fa640 0 client.16179 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a2a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.395+0000 7f880ec2e740 1 --2- 172.21.15.77:0/4229256191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a2cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.396+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 >> 172.21.15.77:0/4229256191 conn(0x556f759e6c90 msgr2=0x556f75a209b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.396+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 shutdown_connections 2024-04-21T10:26:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.396+0000 7f880ec2e740 1 -- 172.21.15.77:0/4229256191 wait complete. 2024-04-21T10:26:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.396+0000 7f880ec2e740 20 client.16179 trim_cache size 0 max 16384 2024-04-21T10:26:29.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 Processor -- start 2024-04-21T10:26:29.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 -- start start 2024-04-21T10:26:29.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a39120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 0x556f75a2c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a2d4f0 0x556f75a2cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ae120 con 0x556f75a24ce0 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ab9c0 con 0x556f75a23f70 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880ec2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f88041a9810 con 0x556f75a2d4f0 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 0x556f75a2c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 0x556f75a2c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39936/0 (socket says 172.21.15.77:39936) 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 -- 172.21.15.77:0/3391044234 learned_addr learned my addr 172.21.15.77:0/3391044234 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a2d4f0 0x556f75a2cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a39120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 -- 172.21.15.77:0/3391044234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a2d4f0 msgr2=0x556f75a2cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a2d4f0 0x556f75a2cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 -- 172.21.15.77:0/3391044234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 msgr2=0x556f75a39120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a39120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 -- 172.21.15.77:0/3391044234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f75a23240 con 0x556f75a24ce0 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a39120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.411+0000 7f88094f4640 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 0x556f75a2c9b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x556f75a24a10 tx=0x7f87f400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af30152d3ebee6e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f87ef7fe640 1 -- 172.21.15.77:0/3391044234 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4029070 con 0x556f75a24ce0 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f87ef7fe640 1 -- 172.21.15.77:0/3391044234 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f40054f0 con 0x556f75a24ce0 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f87ef7fe640 1 -- 172.21.15.77:0/3391044234 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4015040 con 0x556f75a24ce0 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 -- 172.21.15.77:0/3391044234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 msgr2=0x556f75a2c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 0x556f75a2c9b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x556f75a24a10 tx=0x7f87f400bf10 comp rx=0 tx=0).stop 2024-04-21T10:26:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 -- 172.21.15.77:0/3391044234 shutdown_connections 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a24ce0 0x556f75a2c9b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a2d4f0 0x556f75a2cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3391044234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a39120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 -- 172.21.15.77:0/3391044234 >> 172.21.15.77:0/3391044234 conn(0x556f759e6c90 msgr2=0x556f75a25440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 -- 172.21.15.77:0/3391044234 shutdown_connections 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.412+0000 7f880ec2e740 1 -- 172.21.15.77:0/3391044234 wait complete. 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 -- start start 2024-04-21T10:26:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 Processor -- start 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a35b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a275e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88041a9e80 con 0x556f75a2d4f0 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ab2f0 con 0x556f75a23f70 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f88041aa550 con 0x556f75a24ce0 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880ec2e740 10 client.0 _ll_register_callbacks cb 0x7f87fc009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a27b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39948/0 (socket says 172.21.15.77:39948) 2024-04-21T10:26:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 -- 172.21.15.77:0/3645398828 learned_addr learned my addr 172.21.15.77:0/3645398828 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f88094f4640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a275e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a35b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 -- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 msgr2=0x556f75a275e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a275e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 -- 172.21.15.77:0/3645398828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 msgr2=0x556f75a35b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a35b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.413+0000 7f880a4f6640 1 -- 172.21.15.77:0/3645398828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f75a2e040 con 0x556f75a2d4f0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880a4f6640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a27b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00bc40 tx=0x7f87fc026f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cee3d2cc62c1556 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f87ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f87ed7fa640 1 -- 172.21.15.77:0/3645398828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc03b060 con 0x556f75a2d4f0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f87ed7fa640 1 -- 172.21.15.77:0/3645398828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f87fc01c0b0 con 0x556f75a2d4f0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87f40054f0 con 0x556f75a2d4f0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f87ed7fa640 1 -- 172.21.15.77:0/3645398828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f87fc032040 con 0x556f75a2d4f0 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 10 client.16185 fetch_fsmap learned FSMap version 29 2024-04-21T10:26:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556f75aa3ce0 con 0x556f75a2d4f0 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f87ed7fa640 1 -- 172.21.15.77:0/3645398828 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f40054f0 con 0x556f75a2d4f0 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f87ed7fa640 1 -- 172.21.15.77:0/3645398828 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8342+0+0 (secure 0 0 0) 0x7f87fc035030 con 0x556f75a2d4f0 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 10 client.16185 fetch_fsmap finished waiting for FSMap version 29 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 20 client.16185 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75aa4460 0x556f75aa6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 4 client.16185 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.414+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556f75a2fcf0 con 0x556f75aa4460 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.415+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75aa4460 0x556f75aa6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.415+0000 7f8809cf5640 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75aa4460 0x556f75aa6880 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ec35a7b7bc60d77 server_cookie=52f619f26a6bf34b in_seq=0 out_seq=0 2024-04-21T10:26:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.415+0000 7f87ed7fa640 10 client.16185 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f87ed7fa640 1 -- 172.21.15.77:0/3645398828 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556f75a2fcf0 con 0x556f75aa4460 2024-04-21T10:26:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f87ed7fa640 10 client.16185 handle_command_reply: tid=0 2024-04-21T10:26:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 client.16185 shutdown 2024-04-21T10:26:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 msgr2=0x556f75a27b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a27b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00bc40 tx=0x7f87fc026f30 comp rx=0 tx=0).stop 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 shutdown_connections 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556f75aa4460 0x556f75aa6880 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f75a2d4f0 0x556f75a27b60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f75a24ce0 0x556f75a275e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 --2- 172.21.15.77:0/3645398828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f75a23f70 0x556f75a35b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f87ed7fa640 0 client.16185 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 >> 172.21.15.77:0/3645398828 conn(0x556f759e6c90 msgr2=0x556f75a28ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 shutdown_connections 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 1 -- 172.21.15.77:0/3645398828 wait complete. 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.425+0000 7f880ec2e740 20 client.16185 trim_cache size 0 max 16384 2024-04-21T10:26:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:26:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:26:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:26:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f87f00a3dc0 msgr2=0x7f87f00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f87f00a3dc0 0x7f87f00a6280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87fc005fd0 tx=0x7f87fc0046c0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 msgr2=0x7f8804198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804198730 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8800005e30 tx=0x7f88000039f0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 shutdown_connections 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f87f00a3dc0 0x7f87f00a6280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f880410c560 0x7f880419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8804103b40 0x7f8804198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 --2- 172.21.15.77:0/3882783351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8804103220 0x7f8804198730 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 >> 172.21.15.77:0/3882783351 conn(0x7f8804077fd0 msgr2=0x7f88040fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 shutdown_connections 2024-04-21T10:26:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:29.426+0000 7f880bf59640 1 -- 172.21.15.77:0/3882783351 wait complete. 2024-04-21T10:26:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:29 smithi170 ceph-mon[31212]: pgmap v155: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 378 op/s 2024-04-21T10:26:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:29 smithi077 ceph-mon[27902]: pgmap v155: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 378 op/s 2024-04-21T10:26:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:29 smithi191 ceph-mon[31636]: pgmap v155: 97 pgs: 97 active+clean; 2.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 378 op/s 2024-04-21T10:26:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:31 smithi170 ceph-mon[31212]: pgmap v156: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 978 op/s 2024-04-21T10:26:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:31 smithi077 ceph-mon[27902]: pgmap v156: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 978 op/s 2024-04-21T10:26:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:31 smithi191 ceph-mon[31636]: pgmap v156: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 978 op/s 2024-04-21T10:26:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:33 smithi170 ceph-mon[31212]: pgmap v157: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:33 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:33 smithi077 ceph-mon[27902]: pgmap v157: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:33 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:33 smithi191 ceph-mon[31636]: pgmap v157: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:33 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:26:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:26:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:26:34.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 -- 172.21.15.77:0/3389577014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 msgr2=0x7f9d4c107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/3389577014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c107330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009930 tx=0x7f9d3c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 -- 172.21.15.77:0/3389577014 shutdown_connections 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/3389577014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d4c100e80 0x7f9d4c10ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/3389577014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c1004c0 0x7f9d4c100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/3389577014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c107330 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 -- 172.21.15.77:0/3389577014 >> 172.21.15.77:0/3389577014 conn(0x7f9d4c077450 msgr2=0x7f9d4c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 -- 172.21.15.77:0/3389577014 shutdown_connections 2024-04-21T10:26:34.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 -- 172.21.15.77:0/3389577014 wait complete. 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 Processor -- start 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.983+0000 7f9d52a1f640 1 -- start start 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d4c1004c0 0x7f9d4c19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c100e80 0x7f9d4c19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c112280 con 0x7f9d4c106f50 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c112100 con 0x7f9d4c1004c0 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c112400 con 0x7f9d4c100e80 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47108/0 (socket says 172.21.15.77:47108) 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 -- 172.21.15.77:0/407751614 learned_addr learned my addr 172.21.15.77:0/407751614 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d4bfff640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d4c1004c0 0x7f9d4c19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:34.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d4b7fe640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c100e80 0x7f9d4c19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 -- 172.21.15.77:0/407751614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c100e80 msgr2=0x7f9d4c19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c100e80 0x7f9d4c19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 -- 172.21.15.77:0/407751614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d4c1004c0 msgr2=0x7f9d4c19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d4c1004c0 0x7f9d4c19e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 -- 172.21.15.77:0/407751614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c198de0 con 0x7f9d4c106f50 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d50fbc640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c198660 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400cad0 tx=0x7f9d4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400ae20 con 0x7f9d4c106f50 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c1990d0 con 0x7f9d4c106f50 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d44005020 con 0x7f9d4c106f50 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.984+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400f6b0 con 0x7f9d4c106f50 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.985+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1a5320 con 0x7f9d4c106f50 2024-04-21T10:26:34.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.985+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c069230 con 0x7f9d4c106f50 2024-04-21T10:26:34.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.987+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f9d440051d0 con 0x7f9d4c106f50 2024-04-21T10:26:34.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.987+0000 7f9d497fa640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9d340a3d20 0x7f9d340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:34.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.987+0000 7f9d4bfff640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9d340a3d20 0x7f9d340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:34.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.987+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9d440d0b50 con 0x7f9d4c106f50 2024-04-21T10:26:34.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.988+0000 7f9d4bfff640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9d340a3d20 0x7f9d340a61e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005ab0 tx=0x7f9d3c005fd0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:34.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:34.991+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9d44014030 con 0x7f9d4c106f50 2024-04-21T10:26:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:26:35.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.207+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d4c199b40 con 0x7f9d4c106f50 2024-04-21T10:26:35.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.208+0000 7f9d497fa640 1 -- 172.21.15.77:0/407751614 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11884 (secure 0 0 0) 0x7f9d4c199b40 con 0x7f9d4c106f50 2024-04-21T10:26:35.208 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:26:35.208 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:26:31.372101+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:26:35.209 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 30 2024-04-21T10:26:35.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9d340a3d20 msgr2=0x7f9d340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9d340a3d20 0x7f9d340a61e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005ab0 tx=0x7f9d3c005fd0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 msgr2=0x7f9d4c198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c198660 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400cad0 tx=0x7f9d4400cf90 comp rx=0 tx=0).stop 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 shutdown_connections 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f9d340a3d20 0x7f9d340a61e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c106f50 0x7f9d4c198660 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c100e80 0x7f9d4c19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 --2- 172.21.15.77:0/407751614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d4c1004c0 0x7f9d4c19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 >> 172.21.15.77:0/407751614 conn(0x7f9d4c077450 msgr2=0x7f9d4c105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 shutdown_connections 2024-04-21T10:26:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.210+0000 7f9d52a1f640 1 -- 172.21.15.77:0/407751614 wait complete. 2024-04-21T10:26:35.221 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id 964bb5fe --release --await' 2024-04-21T10:26:35.221 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id 964bb5fe --release --await 2024-04-21T10:26:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 -- 172.21.15.77:0/2950852620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803006a7c0 msgr2=0x7f803006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 --2- 172.21.15.77:0/2950852620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803006a7c0 0x7f803006aba0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8020009900 tx=0x7f802002bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 -- 172.21.15.77:0/2950852620 shutdown_connections 2024-04-21T10:26:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 --2- 172.21.15.77:0/2950852620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8030107280 0x7f803010ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 --2- 172.21.15.77:0/2950852620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803006b170 0x7f8030106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 --2- 172.21.15.77:0/2950852620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803006a7c0 0x7f803006aba0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 -- 172.21.15.77:0/2950852620 >> 172.21.15.77:0/2950852620 conn(0x7f8030076c50 msgr2=0x7f8030077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 -- 172.21.15.77:0/2950852620 shutdown_connections 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.326+0000 7f8038214640 1 -- 172.21.15.77:0/2950852620 wait complete. 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 Processor -- start 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 -- start start 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803006a7c0 0x7f80301986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8030107280 0x7f8030198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 0x7f803019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80301121c0 con 0x7f803019cf80 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8030112040 con 0x7f8030107280 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8038214640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8030112340 con 0x7f803006a7c0 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 0x7f803019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 0x7f803019d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47128/0 (socket says 172.21.15.77:47128) 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 -- 172.21.15.77:0/1064980282 learned_addr learned my addr 172.21.15.77:0/1064980282 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f8035fb0640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803006a7c0 0x7f80301986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80357af640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8030107280 0x7f8030198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 -- 172.21.15.77:0/1064980282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803006a7c0 msgr2=0x7f80301986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803006a7c0 0x7f80301986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 -- 172.21.15.77:0/1064980282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8030107280 msgr2=0x7f8030198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8030107280 0x7f8030198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 -- 172.21.15.77:0/1064980282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803019da70 con 0x7f803019cf80 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.327+0000 7f80367b1640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 0x7f803019d430 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f802800eaa0 tx=0x7f802800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.328+0000 7f8026ffd640 1 -- 172.21.15.77:0/1064980282 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802800cdb0 con 0x7f803019cf80 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.328+0000 7f8026ffd640 1 -- 172.21.15.77:0/1064980282 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8028005020 con 0x7f803019cf80 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.328+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803019dd60 con 0x7f803019cf80 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.328+0000 7f8026ffd640 1 -- 172.21.15.77:0/1064980282 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80280116d0 con 0x7f803019cf80 2024-04-21T10:26:35.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.328+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80301a5500 con 0x7f803019cf80 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.330+0000 7f8026ffd640 1 -- 172.21.15.77:0/1064980282 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f80280051d0 con 0x7f803019cf80 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.330+0000 7f803ae0a740 1 Processor -- start 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.330+0000 7f803ae0a740 1 -- start start 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 0x5587b78516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851c30 0x5587b785a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b785cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f803ae0a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5587b77b6500 con 0x5587b7851310 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f803ae0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5587b775c6a0 con 0x5587b785a810 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f803ae0a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587b77b24c0 con 0x5587b7851c30 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 0x5587b78516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f8026ffd640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f801c0a3d20 0x7f801c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 0x5587b78516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47138/0 (socket says 172.21.15.77:47138) 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 -- 172.21.15.77:0/4027096809 learned_addr learned my addr 172.21.15.77:0/4027096809 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80367b1640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f801c0a3d20 0x7f801c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b785cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f8035fb0640 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851c30 0x5587b785a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f8026ffd640 1 -- 172.21.15.77:0/1064980282 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f80280d0a40 con 0x7f803019cf80 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 -- 172.21.15.77:0/4027096809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851c30 msgr2=0x5587b785a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851c30 0x5587b785a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 -- 172.21.15.77:0/4027096809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 msgr2=0x5587b785cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b785cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 -- 172.21.15.77:0/4027096809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587b777b5e0 con 0x5587b7851310 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80357af640 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 0x5587b78516f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f802c00cfd0 tx=0x7f802c00c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6657a2686d721cee server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f80367b1640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f801c0a3d20 0x7f801c0a61e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80280623c0 tx=0x7f802806c290 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f801bfff640 1 -- 172.21.15.77:0/4027096809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c018030 con 0x5587b7851310 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f801bfff640 1 -- 172.21.15.77:0/4027096809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f802c005020 con 0x5587b7851310 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.331+0000 7f801bfff640 1 -- 172.21.15.77:0/4027096809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c004a00 con 0x5587b7851310 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 -- 172.21.15.77:0/4027096809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 msgr2=0x5587b78516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 0x5587b78516f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f802c00cfd0 tx=0x7f802c00c560 comp rx=0 tx=0).stop 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 -- 172.21.15.77:0/4027096809 shutdown_connections 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b785cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851c30 0x5587b785a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 --2- 172.21.15.77:0/4027096809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851310 0x5587b78516f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 -- 172.21.15.77:0/4027096809 >> 172.21.15.77:0/4027096809 conn(0x5587b784ba40 msgr2=0x5587b784be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 -- 172.21.15.77:0/4027096809 shutdown_connections 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.332+0000 7f803ae0a740 1 -- 172.21.15.77:0/4027096809 wait complete. 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 -- start start 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 Processor -- start 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7857690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b7858110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5587b785d600 con 0x5587b7851c30 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5587b776fa60 con 0x5587b785a810 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587b785d780 con 0x5587b7851310 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f803ae0a740 10 client.0 _ll_register_callbacks cb 0x5587b74c8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47154/0 (socket says 172.21.15.77:47154) 2024-04-21T10:26:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 -- 172.21.15.77:0/1850814098 learned_addr learned my addr 172.21.15.77:0/1850814098 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f80357af640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7857690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f80357af640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b7858110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 -- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 msgr2=0x5587b7857690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7857690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 -- 172.21.15.77:0/1850814098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 msgr2=0x5587b7858110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b7858110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.333+0000 7f8035fb0640 1 -- 172.21.15.77:0/1850814098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587b74c8920 con 0x5587b7851c30 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f8035fb0640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857bd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8020005ec0 tx=0x7f802002c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36046c7160c62804 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f80197fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f80197fa640 1 -- 172.21.15.77:0/1850814098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802002c610 con 0x5587b7851c30 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f80197fa640 1 -- 172.21.15.77:0/1850814098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8020005030 con 0x5587b7851c30 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f802c005020 con 0x5587b7851c30 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f80197fa640 1 -- 172.21.15.77:0/1850814098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8020005230 con 0x5587b7851c30 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 10 client.16203 fetch_fsmap learned FSMap version 30 2024-04-21T10:26:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5587b7594d30 con 0x5587b7851c30 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f80197fa640 1 -- 172.21.15.77:0/1850814098 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f802c005020 con 0x5587b7851c30 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f80197fa640 1 -- 172.21.15.77:0/1850814098 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f8020003680 con 0x5587b7851c30 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 10 client.16203 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 10 client.16203 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 20 client.16203 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b786a960 0x5587b786cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 4 client.16203 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.334+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587b7789a10 con 0x5587b786a960 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.335+0000 7f80357af640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b786a960 0x5587b786cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.335+0000 7f80357af640 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b786a960 0x5587b786cdc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e994c3e8a6b9bd server_cookie=a883659372f8912e in_seq=0 out_seq=0 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.335+0000 7f80197fa640 10 client.16203 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f80197fa640 1 -- 172.21.15.77:0/1850814098 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5587b7789a10 con 0x5587b786a960 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f80197fa640 10 client.16203 handle_command_reply: tid=0 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 client.16203 shutdown 2024-04-21T10:26:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 msgr2=0x5587b7857bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857bd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8020005ec0 tx=0x7f802002c9f0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 shutdown_connections 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b786a960 0x5587b786cdc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857bd0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f80197fa640 0 client.16203 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b785a810 0x5587b7858110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 --2- 172.21.15.77:0/1850814098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7857690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 >> 172.21.15.77:0/1850814098 conn(0x5587b784ba40 msgr2=0x5587b784d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 shutdown_connections 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 1 -- 172.21.15.77:0/1850814098 wait complete. 2024-04-21T10:26:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.336+0000 7f803ae0a740 20 client.16203 trim_cache size 0 max 16384 2024-04-21T10:26:35.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 Processor -- start 2024-04-21T10:26:35.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 -- start start 2024-04-21T10:26:35.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851310 0x5587b78664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b785a810 0x5587b7855f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80301b02b0 con 0x5587b7851c30 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f80301adb80 con 0x5587b7851310 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f803ae0a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80301ab9f0 con 0x5587b785a810 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f8035fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.353+0000 7f8035fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47162/0 (socket says 172.21.15.77:47162) 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 -- 172.21.15.77:0/3383540525 learned_addr learned my addr 172.21.15.77:0/3383540525 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f80357af640 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851310 0x5587b78664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 -- 172.21.15.77:0/3383540525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b785a810 msgr2=0x5587b7855f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b785a810 0x5587b7855f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 -- 172.21.15.77:0/3383540525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851310 msgr2=0x5587b78664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851310 0x5587b78664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 -- 172.21.15.77:0/3383540525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587b7851a60 con 0x5587b7851c30 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f8035fb0640 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857cc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f802002c170 tx=0x7f802002cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945116b15e0fc77d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f801b7fe640 1 -- 172.21.15.77:0/3383540525 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802002c610 con 0x5587b7851c30 2024-04-21T10:26:35.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f801b7fe640 1 -- 172.21.15.77:0/3383540525 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80200035f0 con 0x5587b7851c30 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.354+0000 7f801b7fe640 1 -- 172.21.15.77:0/3383540525 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020052a20 con 0x5587b7851c30 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- 172.21.15.77:0/3383540525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 msgr2=0x5587b7857cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857cc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f802002c170 tx=0x7f802002cd70 comp rx=0 tx=0).stop 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- 172.21.15.77:0/3383540525 shutdown_connections 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b7851c30 0x5587b7857cc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b785a810 0x5587b7855f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- 172.21.15.77:0/3383540525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851310 0x5587b78664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- 172.21.15.77:0/3383540525 >> 172.21.15.77:0/3383540525 conn(0x5587b784ba40 msgr2=0x5587b784d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- 172.21.15.77:0/3383540525 shutdown_connections 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- 172.21.15.77:0/3383540525 wait complete. 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- start start 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 Processor -- start 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7862e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851c30 0x5587b785d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 0x5587b785dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80301ac040 con 0x5587b785a810 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f80301ad4b0 con 0x5587b7851c30 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.355+0000 7f803ae0a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80301ac710 con 0x5587b7851310 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f803ae0a740 10 client.0 _ll_register_callbacks cb 0x7f8020009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 0x5587b785dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 0x5587b785dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47174/0 (socket says 172.21.15.77:47174) 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 -- 172.21.15.77:0/613666893 learned_addr learned my addr 172.21.15.77:0/613666893 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f8035fb0640 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851c30 0x5587b785d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 -- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 msgr2=0x5587b7862e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7862e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 -- 172.21.15.77:0/613666893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851c30 msgr2=0x5587b785d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851c30 0x5587b785d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 -- 172.21.15.77:0/613666893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587b785e7a0 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80357af640 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 0x5587b785dfa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f802c00ce80 tx=0x7f802c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ee4a12bcccefde server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80197fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80197fa640 1 -- 172.21.15.77:0/613666893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c031060 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80197fa640 1 -- 172.21.15.77:0/613666893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f802c012050 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80200035f0 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80197fa640 1 -- 172.21.15.77:0/613666893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f802c018040 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f803ae0a740 10 client.16209 fetch_fsmap learned FSMap version 30 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5587b78d20a0 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.356+0000 7f80197fa640 1 -- 172.21.15.77:0/613666893 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80200035f0 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f80197fa640 1 -- 172.21.15.77:0/613666893 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f802c028020 con 0x5587b785a810 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f803ae0a740 10 client.16209 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f803ae0a740 10 client.16209 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f803ae0a740 20 client.16209 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f803ae0a740 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b78d2690 0x5587b78d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f803ae0a740 4 client.16209 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "964bb5fe", "release": true, "await": true}] 2024-04-21T10:26:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "964bb5fe", "release": true, "await": true}) -- 0x5587b77c3f20 con 0x5587b78d2690 2024-04-21T10:26:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f8035fb0640 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b78d2690 0x5587b78d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f80197fa640 10 client.16209 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.357+0000 7f8035fb0640 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b78d2690 0x5587b78d4ab0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21678dada56f6237 server_cookie=8e43c302cc634557 in_seq=0 out_seq=0 2024-04-21T10:26:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.362+0000 7f80197fa640 1 -- 172.21.15.77:0/613666893 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5587b77c3f20 con 0x5587b78d2690 2024-04-21T10:26:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.362+0000 7f80197fa640 10 client.16209 handle_command_reply: tid=0 2024-04-21T10:26:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.362+0000 7f803ae0a740 1 client.16209 shutdown 2024-04-21T10:26:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 msgr2=0x5587b785dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 0x5587b785dfa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f802c00ce80 tx=0x7f802c005720 comp rx=0 tx=0).stop 2024-04-21T10:26:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 shutdown_connections 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5587b78d2690 0x5587b78d4ab0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587b785a810 0x5587b785dfa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5587b7851c30 0x5587b785d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f80197fa640 0 client.16209 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 --2- 172.21.15.77:0/613666893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587b7851310 0x5587b7862e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 >> 172.21.15.77:0/613666893 conn(0x5587b784ba40 msgr2=0x5587b784cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 shutdown_connections 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 1 -- 172.21.15.77:0/613666893 wait complete. 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f803ae0a740 20 client.16209 trim_cache size 0 max 16384 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:26:35.364 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 30, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 20, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "964bb5fe": { 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 20, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 80.7, 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:26:35.365 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:26:35.366 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:26:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f801c0a3d20 msgr2=0x7f801c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f801c0a3d20 0x7f801c0a61e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80280623c0 tx=0x7f802806c290 comp rx=0 tx=0).stop 2024-04-21T10:26:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 msgr2=0x7f803019d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 0x7f803019d430 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f802800eaa0 tx=0x7f802800ef60 comp rx=0 tx=0).stop 2024-04-21T10:26:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 shutdown_connections 2024-04-21T10:26:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f801c0a3d20 0x7f801c0a61e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f803019cf80 0x7f803019d430 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8030107280 0x7f8030198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 --2- 172.21.15.77:0/1064980282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803006a7c0 0x7f80301986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 >> 172.21.15.77:0/1064980282 conn(0x7f8030076c50 msgr2=0x7f80300ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.363+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 shutdown_connections 2024-04-21T10:26:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:26:35.364+0000 7f8038214640 1 -- 172.21.15.77:0/1064980282 wait complete. 2024-04-21T10:26:35.373 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 964bb5fe, seconds elapsed: 21.9 2024-04-21T10:26:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:35 smithi170 ceph-mon[31212]: pgmap v158: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:26:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:26:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:26:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:35 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/407751614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:35 smithi077 ceph-mon[27902]: pgmap v158: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:26:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:26:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:26:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:35 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/407751614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:35 smithi191 ceph-mon[31636]: pgmap v158: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:26:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:26:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:26:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:35 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/407751614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:26:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:37 smithi077 ceph-mon[27902]: pgmap v159: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:37 smithi191 ceph-mon[31636]: pgmap v159: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:37 smithi170 ceph-mon[31212]: pgmap v159: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-04-21T10:26:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:39 smithi077 ceph-mon[27902]: pgmap v160: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.4 MiB/s wr, 677 op/s 2024-04-21T10:26:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:39 smithi191 ceph-mon[31636]: pgmap v160: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.4 MiB/s wr, 677 op/s 2024-04-21T10:26:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:39 smithi170 ceph-mon[31212]: pgmap v160: 97 pgs: 97 active+clean; 2.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.4 MiB/s wr, 677 op/s 2024-04-21T10:26:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 295.0 s, 3123.3 tps, lat 167.714 ms stddev 1714.142 2024-04-21T10:26:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:41 smithi077 ceph-mon[27902]: pgmap v161: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 914 op/s 2024-04-21T10:26:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:41 smithi191 ceph-mon[31636]: pgmap v161: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 914 op/s 2024-04-21T10:26:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:41 smithi170 ceph-mon[31212]: pgmap v161: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 914 op/s 2024-04-21T10:26:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 -- 172.21.15.77:0/1492612602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c100020 msgr2=0x7f173c1004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 --2- 172.21.15.77:0/1492612602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c100020 0x7f173c1004a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1724009930 tx=0x7f172402bc30 comp rx=0 tx=0).stop 2024-04-21T10:26:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 -- 172.21.15.77:0/1492612602 shutdown_connections 2024-04-21T10:26:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 --2- 172.21.15.77:0/1492612602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c100020 0x7f173c1004a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 --2- 172.21.15.77:0/1492612602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f173c1009e0 0x7f173c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 --2- 172.21.15.77:0/1492612602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c107070 0x7f173c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 -- 172.21.15.77:0/1492612602 >> 172.21.15.77:0/1492612602 conn(0x7f173c076f50 msgr2=0x7f173c0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 -- 172.21.15.77:0/1492612602 shutdown_connections 2024-04-21T10:26:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.549+0000 7f1740946640 1 -- 172.21.15.77:0/1492612602 wait complete. 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.550+0000 7f1740946640 1 Processor -- start 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.550+0000 7f1740946640 1 -- start start 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.550+0000 7f1740946640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c100020 0x7f173c1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.550+0000 7f1740946640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f173c1009e0 0x7f173c198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f1740946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c107070 0x7f173c19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f1740946640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112200 con 0x7f173c107070 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f1740946640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112080 con 0x7f173c100020 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f1740946640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112380 con 0x7f173c1009e0 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c100020 0x7f173c1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c107070 0x7f173c19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c100020 0x7f173c1986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:46678/0 (socket says 172.21.15.77:46678) 2024-04-21T10:26:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173a59c640 1 -- 172.21.15.77:0/1578225147 learned_addr learned my addr 172.21.15.77:0/1578225147 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f1733fff640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f173c1009e0 0x7f173c198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173ad9d640 1 -- 172.21.15.77:0/1578225147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f173c1009e0 msgr2=0x7f173c198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f173c1009e0 0x7f173c198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173ad9d640 1 -- 172.21.15.77:0/1578225147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c100020 msgr2=0x7f173c1986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c100020 0x7f173c1986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.551+0000 7f173ad9d640 1 -- 172.21.15.77:0/1578225147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c19d6d0 con 0x7f173c107070 2024-04-21T10:26:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.552+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c107070 0x7f173c19cfa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1734009fd0 tx=0x7f173400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.553+0000 7f17337fe640 1 -- 172.21.15.77:0/1578225147 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173400ce20 con 0x7f173c107070 2024-04-21T10:26:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.553+0000 7f17337fe640 1 -- 172.21.15.77:0/1578225147 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1734005020 con 0x7f173c107070 2024-04-21T10:26:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.553+0000 7f17337fe640 1 -- 172.21.15.77:0/1578225147 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734010690 con 0x7f173c107070 2024-04-21T10:26:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.553+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c19d9c0 con 0x7f173c107070 2024-04-21T10:26:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.553+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c1a5250 con 0x7f173c107070 2024-04-21T10:26:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.556+0000 7f174360c740 1 Processor -- start 2024-04-21T10:26:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.556+0000 7f17337fe640 1 -- 172.21.15.77:0/1578225147 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f17340054d0 con 0x7f173c107070 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.557+0000 7f174360c740 1 -- start start 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.557+0000 7f174360c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.557+0000 7f17337fe640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17280a3f70 0x7f17280a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f174360c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f174360c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f174360c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558d3a10b8d0 con 0x558d3a1a6ef0 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f174360c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558d3a0a8e80 con 0x558d3a1a7990 2024-04-21T10:26:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f174360c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558d3a107890 con 0x558d3a1a65d0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:44594/0 (socket says 172.21.15.77:44594) 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 -- 172.21.15.77:0/777965863 learned_addr learned my addr 172.21.15.77:0/777965863 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f17337fe640 1 -- 172.21.15.77:0/1578225147 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f17340d0b30 con 0x7f173c107070 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f173ad9d640 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17280a3f70 0x7f17280a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f173a59c640 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 -- 172.21.15.77:0/777965863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 msgr2=0x558d3a1bacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1bacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 -- 172.21.15.77:0/777965863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 msgr2=0x558d3a1a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.558+0000 7f1733fff640 1 -- 172.21.15.77:0/777965863 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d3a0ca320 con 0x558d3a1a65d0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.559+0000 7f1733fff640 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1a69b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f172402c240 tx=0x7f1724004380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63a5193e49cc6d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.559+0000 7f1733fff640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17280a3f70 0x7f17280a6430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1724005c40 tx=0x7f1724048000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.559+0000 7f1730ff9640 1 -- 172.21.15.77:0/777965863 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724050070 con 0x558d3a1a65d0 2024-04-21T10:26:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.559+0000 7f1730ff9640 1 -- 172.21.15.77:0/777965863 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17240055b0 con 0x558d3a1a65d0 2024-04-21T10:26:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.559+0000 7f1730ff9640 1 -- 172.21.15.77:0/777965863 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17240035f0 con 0x558d3a1a65d0 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 -- 172.21.15.77:0/777965863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 msgr2=0x558d3a1a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1a69b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f172402c240 tx=0x7f1724004380 comp rx=0 tx=0).stop 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 -- 172.21.15.77:0/777965863 shutdown_connections 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1bacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 --2- 172.21.15.77:0/777965863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1a69b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.560+0000 7f174360c740 1 -- 172.21.15.77:0/777965863 >> 172.21.15.77:0/777965863 conn(0x558d3a16dc90 msgr2=0x558d3a1a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.561+0000 7f174360c740 1 -- 172.21.15.77:0/777965863 shutdown_connections 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.561+0000 7f174360c740 1 -- 172.21.15.77:0/777965863 wait complete. 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.561+0000 7f174360c740 1 -- start start 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.561+0000 7f174360c740 1 Processor -- start 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558d3a1bb630 con 0x558d3a1a6ef0 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558d3a093eb0 con 0x558d3a1a7990 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558d3a1bb7b0 con 0x558d3a1a65d0 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1babf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:44600/0 (socket says 172.21.15.77:44600) 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 -- 172.21.15.77:0/123784052 learned_addr learned my addr 172.21.15.77:0/123784052 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f1733fff640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f174360c740 10 client.0 _ll_register_callbacks cb 0x558d3a0c0b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 -- 172.21.15.77:0/123784052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 msgr2=0x558d3a1b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173ad9d640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 -- 172.21.15.77:0/123784052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 msgr2=0x558d3a1b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173a59c640 1 -- 172.21.15.77:0/123784052 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d39e1e210 con 0x558d3a1a65d0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f1733fff640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.562+0000 7f173ad9d640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f173a59c640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1babf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f172c012700 tx=0x7f172c012b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47fbbdcc20e59167 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f1721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f1721ffb640 1 -- 172.21.15.77:0/123784052 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c004050 con 0x558d3a1a65d0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f1721ffb640 1 -- 172.21.15.77:0/123784052 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f172c0041f0 con 0x558d3a1a65d0 2024-04-21T10:26:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17240055b0 con 0x558d3a1a65d0 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f1721ffb640 1 -- 172.21.15.77:0/123784052 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f172c0043f0 con 0x558d3a1a65d0 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f174360c740 10 client.25645 fetch_fsmap learned FSMap version 30 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.563+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558d39eea620 con 0x558d3a1a65d0 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f1721ffb640 1 -- 172.21.15.77:0/123784052 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17240055b0 con 0x558d3a1a65d0 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f1721ffb640 1 -- 172.21.15.77:0/123784052 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f172c0038f0 con 0x558d3a1a65d0 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f174360c740 10 client.25645 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f174360c740 10 client.25645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f174360c740 20 client.25645 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f174360c740 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a1d9760 0x558d3a1dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f174360c740 4 client.25645 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d3a11f880 con 0x558d3a1d9760 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f1733fff640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a1d9760 0x558d3a1dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.564+0000 7f1721ffb640 10 client.25645 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.565+0000 7f1733fff640 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a1d9760 0x558d3a1dbbb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7fc76913fbb678 server_cookie=239d25c435c0de7c in_seq=0 out_seq=0 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.565+0000 7f1721ffb640 1 -- 172.21.15.77:0/123784052 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558d3a11f880 con 0x558d3a1d9760 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.565+0000 7f1721ffb640 10 client.25645 handle_command_reply: tid=0 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.565+0000 7f174360c740 1 client.25645 shutdown 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 msgr2=0x558d3a1babf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1babf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f172c012700 tx=0x7f172c012b00 comp rx=0 tx=0).stop 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 shutdown_connections 2024-04-21T10:26:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a1d9760 0x558d3a1dbbb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a7990 0x558d3a1b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 --2- 172.21.15.77:0/123784052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a65d0 0x558d3a1babf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f1721ffb640 0 client.25645 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 >> 172.21.15.77:0/123784052 conn(0x558d3a16dc90 msgr2=0x558d3a1a35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 shutdown_connections 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.566+0000 7f174360c740 1 -- 172.21.15.77:0/123784052 wait complete. 2024-04-21T10:26:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.567+0000 7f174360c740 20 client.25645 trim_cache size 0 max 16384 2024-04-21T10:26:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 Processor -- start 2024-04-21T10:26:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 -- start start 2024-04-21T10:26:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f173c1a5940 con 0x558d3a1a7990 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f173c071f70 con 0x558d3a1a65d0 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.590+0000 7f174360c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f173c06fdc0 con 0x558d3a1a6ef0 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1ba6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37730/0 (socket says 172.21.15.77:37730) 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:46708/0 (socket says 172.21.15.77:46708) 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 -- 172.21.15.77:0/1966219370 learned_addr learned my addr 172.21.15.77:0/1966219370 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f1733fff640 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 -- 172.21.15.77:0/1966219370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 msgr2=0x558d3a1abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 -- 172.21.15.77:0/1966219370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 msgr2=0x558d3a1c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 -- 172.21.15.77:0/1966219370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d3a1c5100 con 0x558d3a1a7990 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173a59c640 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f1733fff640 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1ba6b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f173409ca90 tx=0x7f173409d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bdd8c566d403d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.591+0000 7f1723fff640 1 -- 172.21.15.77:0/1966219370 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340a0eb0 con 0x558d3a1a7990 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f1723fff640 1 -- 172.21.15.77:0/1966219370 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17340a5770 con 0x558d3a1a7990 2024-04-21T10:26:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f1723fff640 1 -- 172.21.15.77:0/1966219370 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173409cd60 con 0x558d3a1a7990 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 -- 172.21.15.77:0/1966219370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 msgr2=0x558d3a1ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1ba6b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f173409ca90 tx=0x7f173409d200 comp rx=0 tx=0).stop 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 -- 172.21.15.77:0/1966219370 shutdown_connections 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1ba6b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 --2- 172.21.15.77:0/1966219370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.592+0000 7f174360c740 1 -- 172.21.15.77:0/1966219370 >> 172.21.15.77:0/1966219370 conn(0x558d3a16dc90 msgr2=0x558d3a1ab680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.593+0000 7f174360c740 1 -- 172.21.15.77:0/1966219370 shutdown_connections 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.593+0000 7f174360c740 1 -- 172.21.15.77:0/1966219370 wait complete. 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.593+0000 7f174360c740 1 -- start start 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.593+0000 7f174360c740 1 Processor -- start 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.593+0000 7f174360c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.593+0000 7f174360c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f174360c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f174360c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f173c070430 con 0x558d3a1a7990 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f174360c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f173c0718a0 con 0x558d3a1a65d0 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f174360c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f173c070b00 con 0x558d3a1a6ef0 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f174360c740 10 client.0 _ll_register_callbacks cb 0x7f172c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:46712/0 (socket says 172.21.15.77:46712) 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 -- 172.21.15.77:0/1953538474 learned_addr learned my addr 172.21.15.77:0/1953538474 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f1733fff640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173ad9d640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 -- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 msgr2=0x558d3a1b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 -- 172.21.15.77:0/1953538474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 msgr2=0x558d3a1b9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1b9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 -- 172.21.15.77:0/1953538474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d3a1ba7f0 con 0x558d3a1a65d0 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f173a59c640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c0e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f172c012420 tx=0x7f172c00f450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7a1607729399fa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.594+0000 7f1721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:26:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.598+0000 7f1721ffb640 1 -- 172.21.15.77:0/1953538474 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c02b040 con 0x558d3a1a65d0 2024-04-21T10:26:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.598+0000 7f1721ffb640 1 -- 172.21.15.77:0/1953538474 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f172c003f00 con 0x558d3a1a65d0 2024-04-21T10:26:42.604 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.605+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17340a5770 con 0x558d3a1a65d0 2024-04-21T10:26:42.605 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.606+0000 7f1721ffb640 1 -- 172.21.15.77:0/1953538474 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f172c004100 con 0x558d3a1a65d0 2024-04-21T10:26:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.612+0000 7f174360c740 10 client.25538 fetch_fsmap learned FSMap version 30 2024-04-21T10:26:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.612+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558d3a23fd10 con 0x558d3a1a65d0 2024-04-21T10:26:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.614+0000 7f1721ffb640 1 -- 172.21.15.77:0/1953538474 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17340a5770 con 0x558d3a1a65d0 2024-04-21T10:26:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.614+0000 7f1721ffb640 1 -- 172.21.15.77:0/1953538474 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) ==== 8338+0+0 (secure 0 0 0) 0x7f172c00f670 con 0x558d3a1a65d0 2024-04-21T10:26:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.617+0000 7f174360c740 10 client.25538 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T10:26:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.617+0000 7f174360c740 10 client.25538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.617+0000 7f174360c740 20 client.25538 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.617+0000 7f174360c740 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a2403e0 0x558d3a242800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.617+0000 7f174360c740 4 client.25538 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:26:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.617+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d3a0ab3d0 con 0x558d3a2403e0 2024-04-21T10:26:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.621+0000 7f1733fff640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a2403e0 0x558d3a242800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.626+0000 7f1733fff640 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a2403e0 0x558d3a242800 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2acbefe0bab3e797 server_cookie=5157143712a9c2 in_seq=0 out_seq=0 2024-04-21T10:26:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.626+0000 7f1721ffb640 10 client.25538 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.657+0000 7f1721ffb640 1 -- 172.21.15.77:0/1953538474 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d3a0ab3d0 con 0x558d3a2403e0 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.657+0000 7f1721ffb640 10 client.25538 handle_command_reply: tid=0 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 client.25538 shutdown 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 msgr2=0x558d3a1c0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c0e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f172c012420 tx=0x7f172c00f450 comp rx=0 tx=0).stop 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 shutdown_connections 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558d3a2403e0 0x558d3a242800 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f1721ffb640 0 client.25538 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d3a1a7990 0x558d3a1b9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d3a1a6ef0 0x558d3a1b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 --2- 172.21.15.77:0/1953538474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d3a1a65d0 0x558d3a1c0e90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 >> 172.21.15.77:0/1953538474 conn(0x558d3a16dc90 msgr2=0x558d3a1a34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 shutdown_connections 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 1 -- 172.21.15.77:0/1953538474 wait complete. 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.658+0000 7f174360c740 20 client.25538 trim_cache size 0 max 16384 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:26:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:26:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17280a3f70 msgr2=0x7f17280a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17280a3f70 0x7f17280a6430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1724005c40 tx=0x7f1724048000 comp rx=0 tx=0).stop 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c107070 msgr2=0x7f173c19cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c107070 0x7f173c19cfa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1734009fd0 tx=0x7f173400ef10 comp rx=0 tx=0).stop 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 shutdown_connections 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f17280a3f70 0x7f17280a6430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f173c107070 0x7f173c19cfa0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f173c1009e0 0x7f173c198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 --2- 172.21.15.77:0/1578225147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f173c100020 0x7f173c1986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 >> 172.21.15.77:0/1578225147 conn(0x7f173c076f50 msgr2=0x7f173c0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 shutdown_connections 2024-04-21T10:26:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:42.659+0000 7f1740946640 1 -- 172.21.15.77:0/1578225147 wait complete. 2024-04-21T10:26:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:43 smithi077 ceph-mon[27902]: pgmap v162: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 395 op/s 2024-04-21T10:26:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:43 smithi191 ceph-mon[31636]: pgmap v162: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 395 op/s 2024-04-21T10:26:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:43 smithi170 ceph-mon[31212]: pgmap v162: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 395 op/s 2024-04-21T10:26:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 300.0 s, 3360.0 tps, lat 29.843 ms stddev 35.726 2024-04-21T10:26:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:45 smithi077 ceph-mon[27902]: pgmap v163: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.6 MiB/s wr, 321 op/s 2024-04-21T10:26:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:45 smithi191 ceph-mon[31636]: pgmap v163: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.6 MiB/s wr, 321 op/s 2024-04-21T10:26:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:45 smithi170 ceph-mon[31212]: pgmap v163: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.6 MiB/s wr, 321 op/s 2024-04-21T10:26:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:47 smithi077 ceph-mon[27902]: pgmap v164: 97 pgs: 97 active+clean; 3.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 29 MiB/s wr, 737 op/s 2024-04-21T10:26:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:47 smithi191 ceph-mon[31636]: pgmap v164: 97 pgs: 97 active+clean; 3.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 29 MiB/s wr, 737 op/s 2024-04-21T10:26:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:47 smithi170 ceph-mon[31212]: pgmap v164: 97 pgs: 97 active+clean; 3.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 29 MiB/s wr, 737 op/s 2024-04-21T10:26:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:49 smithi077 ceph-mon[27902]: pgmap v165: 97 pgs: 97 active+clean; 3.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 29 MiB/s wr, 734 op/s 2024-04-21T10:26:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:49 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:49 smithi191 ceph-mon[31636]: pgmap v165: 97 pgs: 97 active+clean; 3.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 29 MiB/s wr, 734 op/s 2024-04-21T10:26:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:49 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:49 smithi170 ceph-mon[31212]: pgmap v165: 97 pgs: 97 active+clean; 3.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 29 MiB/s wr, 734 op/s 2024-04-21T10:26:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:49 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 305.0 s, 3876.4 tps, lat 25.794 ms stddev 29.389 2024-04-21T10:26:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:51 smithi077 ceph-mon[27902]: pgmap v166: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 45 MiB/s wr, 1.03k op/s 2024-04-21T10:26:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:51 smithi191 ceph-mon[31636]: pgmap v166: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 45 MiB/s wr, 1.03k op/s 2024-04-21T10:26:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:51 smithi170 ceph-mon[31212]: pgmap v166: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 45 MiB/s wr, 1.03k op/s 2024-04-21T10:26:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:53 smithi077 ceph-mon[27902]: pgmap v167: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 44 MiB/s wr, 827 op/s 2024-04-21T10:26:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:53 smithi191 ceph-mon[31636]: pgmap v167: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 44 MiB/s wr, 827 op/s 2024-04-21T10:26:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:53 smithi170 ceph-mon[31212]: pgmap v167: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 44 MiB/s wr, 827 op/s 2024-04-21T10:26:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 310.0 s, 4107.6 tps, lat 24.220 ms stddev 29.599 2024-04-21T10:26:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:55 smithi077 ceph-mon[27902]: pgmap v168: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 MiB/s wr, 746 op/s 2024-04-21T10:26:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:55 smithi191 ceph-mon[31636]: pgmap v168: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 MiB/s wr, 746 op/s 2024-04-21T10:26:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.802+0000 7fae550c1640 1 -- 172.21.15.77:0/2140450970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50110b20 msgr2=0x7fae50109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.802+0000 7fae550c1640 1 --2- 172.21.15.77:0/2140450970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50110b20 0x7fae50109490 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fae4001a940 tx=0x7fae4003cd00 comp rx=0 tx=0).stop 2024-04-21T10:26:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 -- 172.21.15.77:0/2140450970 shutdown_connections 2024-04-21T10:26:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 --2- 172.21.15.77:0/2140450970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50110b20 0x7fae50109490 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 --2- 172.21.15.77:0/2140450970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae5011b730 0x7fae5011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 --2- 172.21.15.77:0/2140450970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae50110740 0x7fae50108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 -- 172.21.15.77:0/2140450970 >> 172.21.15.77:0/2140450970 conn(0x7fae5006d020 msgr2=0x7fae5006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 -- 172.21.15.77:0/2140450970 shutdown_connections 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.804+0000 7fae550c1640 1 -- 172.21.15.77:0/2140450970 wait complete. 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 Processor -- start 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 -- start start 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae50110740 0x7fae5011acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 0x7fae50116d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50117290 0x7fae50117740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae501137a0 con 0x7fae50117290 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fae50113620 con 0x7fae5011b730 2024-04-21T10:26:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.805+0000 7fae550c1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae50113920 con 0x7fae50110740 2024-04-21T10:26:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:55 smithi170 ceph-mon[31212]: pgmap v168: 97 pgs: 97 active+clean; 3.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 MiB/s wr, 746 op/s 2024-04-21T10:26:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 0x7fae50116d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae50110740 0x7fae5011acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 0x7fae50116d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:55998/0 (socket says 172.21.15.77:55998) 2024-04-21T10:26:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 -- 172.21.15.77:0/2782901442 learned_addr learned my addr 172.21.15.77:0/2782901442 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4f59e640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50117290 0x7fae50117740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 -- 172.21.15.77:0/2782901442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae50110740 msgr2=0x7fae5011acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae50110740 0x7fae5011acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 -- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50117290 msgr2=0x7fae50117740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50117290 0x7fae50117740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.806+0000 7fae4e59c640 1 -- 172.21.15.77:0/2782901442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae501ab520 con 0x7fae5011b730 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.807+0000 7fae4e59c640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 0x7fae50116d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae4001a910 tx=0x7fae400045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.808+0000 7fae37fff640 1 -- 172.21.15.77:0/2782901442 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40052020 con 0x7fae5011b730 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.808+0000 7fae37fff640 1 -- 172.21.15.77:0/2782901442 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae40004d60 con 0x7fae5011b730 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.808+0000 7fae37fff640 1 -- 172.21.15.77:0/2782901442 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40003bc0 con 0x7fae5011b730 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.808+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae501ab6f0 con 0x7fae5011b730 2024-04-21T10:26:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.808+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae501abb60 con 0x7fae5011b730 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 Processor -- start 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 -- start start 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfa3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfa3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfaf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556accf088d0 con 0x556accfa3b60 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556accea5e80 con 0x556accfa48d0 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae57d93740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556accf04890 con 0x556accfad0e0 2024-04-21T10:26:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.811+0000 7fae37fff640 1 -- 172.21.15.77:0/2782901442 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fae40055020 con 0x7fae5011b730 2024-04-21T10:26:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.812+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfa3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.812+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfa3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38756/0 (socket says 172.21.15.77:38756) 2024-04-21T10:26:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.812+0000 7fae4ed9d640 1 -- 172.21.15.77:0/2496295367 learned_addr learned my addr 172.21.15.77:0/2496295367 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.812+0000 7fae4f59e640 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfa3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.812+0000 7fae4ed9d640 1 -- 172.21.15.77:0/2496295367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 msgr2=0x556accfaf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.812+0000 7fae37fff640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fae380a3e40 0x7fae380a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae37fff640 1 -- 172.21.15.77:0/2782901442 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fae40103380 con 0x7fae5011b730 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae4e59c640 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfaf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfaf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae4ed9d640 1 -- 172.21.15.77:0/2496295367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 msgr2=0x556accfa3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfa3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae4ed9d640 1 -- 172.21.15.77:0/2496295367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556accec7320 con 0x556accfa3b60 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.813+0000 7fae4f59e640 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfa3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.814+0000 7fae4f59e640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fae380a3e40 0x7fae380a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.814+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfa3fe0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fae48007f90 tx=0x7fae4800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64675ea1eb78b63 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.814+0000 7fae357fa640 1 -- 172.21.15.77:0/2496295367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48004d20 con 0x556accfa3b60 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.814+0000 7fae4f59e640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fae380a3e40 0x7fae380a6300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae5010e1f0 tx=0x7fae440046c0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.814+0000 7fae357fa640 1 -- 172.21.15.77:0/2496295367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae48010bb0 con 0x556accfa3b60 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.814+0000 7fae357fa640 1 -- 172.21.15.77:0/2496295367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae480056b0 con 0x556accfa3b60 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.815+0000 7fae57d93740 1 -- 172.21.15.77:0/2496295367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 msgr2=0x556accfa3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.815+0000 7fae57d93740 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfa3fe0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fae48007f90 tx=0x7fae4800f850 comp rx=0 tx=0).stop 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 -- 172.21.15.77:0/2496295367 shutdown_connections 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfa3fe0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfaf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 --2- 172.21.15.77:0/2496295367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfa3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 -- 172.21.15.77:0/2496295367 >> 172.21.15.77:0/2496295367 conn(0x556accf6ac90 msgr2=0x556accf9e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 -- 172.21.15.77:0/2496295367 shutdown_connections 2024-04-21T10:26:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 -- 172.21.15.77:0/2496295367 wait complete. 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 -- start start 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 Processor -- start 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.816+0000 7fae57d93740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae57d93740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfa9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae57d93740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfad0e0 0x556accfaa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae57d93740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556accfafe10 con 0x556accfa3b60 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae57d93740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556acce90eb0 con 0x556accfad0e0 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae57d93740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556accfaff90 con 0x556accfa48d0 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae57d93740 10 client.0 _ll_register_callbacks cb 0x556accebdb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfa9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfa9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:34802/0 (socket says 172.21.15.77:34802) 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 -- 172.21.15.77:0/4243253403 learned_addr learned my addr 172.21.15.77:0/4243253403 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4f59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfad0e0 0x556accfaa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 -- 172.21.15.77:0/4243253403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfad0e0 msgr2=0x556accfaa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfad0e0 0x556accfaa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 -- 172.21.15.77:0/4243253403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 msgr2=0x556accfac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.817+0000 7fae4e59c640 1 -- 172.21.15.77:0/4243253403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556accc1b210 con 0x556accfa48d0 2024-04-21T10:26:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.818+0000 7fae4e59c640 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfa9de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae400cbe30 tx=0x7fae400cb700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6adc03a579a9b0c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.818+0000 7fae32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:26:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.818+0000 7fae32ff5640 1 -- 172.21.15.77:0/4243253403 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400cedc0 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae32ff5640 1 -- 172.21.15.77:0/4243253403 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fae400cbad0 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae48010bb0 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae32ff5640 1 -- 172.21.15.77:0/4243253403 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae40005020 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 10 client.25657 fetch_fsmap learned FSMap version 31 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556accce7620 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae32ff5640 1 -- 172.21.15.77:0/4243253403 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae48010bb0 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae32ff5640 1 -- 172.21.15.77:0/4243253403 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 31) ==== 8342+0+0 (secure 0 0 0) 0x7fae400e8be0 con 0x556accfa48d0 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 10 client.25657 fetch_fsmap finished waiting for FSMap version 31 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 10 client.25657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 20 client.25657 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfbd0a0 0x556accfbf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 4 client.25657 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.819+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556accf1c880 con 0x556accfbd0a0 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.820+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfbd0a0 0x556accfbf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.820+0000 7fae32ff5640 10 client.25657 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.820+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfbd0a0 0x556accfbf4f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7751f36b6d79865 server_cookie=5b598c653abbea24 in_seq=0 out_seq=0 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.821+0000 7fae32ff5640 1 -- 172.21.15.77:0/4243253403 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556accf1c880 con 0x556accfbd0a0 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.821+0000 7fae32ff5640 10 client.25657 handle_command_reply: tid=0 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.821+0000 7fae57d93740 1 client.25657 shutdown 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 msgr2=0x556accfa9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfa9de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae400cbe30 tx=0x7fae400cb700 comp rx=0 tx=0).stop 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 shutdown_connections 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfbd0a0 0x556accfbf4f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfad0e0 0x556accfaa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfa9de0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 --2- 172.21.15.77:0/4243253403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 >> 172.21.15.77:0/4243253403 conn(0x556accf6ac90 msgr2=0x556accfa05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae32ff5640 0 client.25657 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 shutdown_connections 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 1 -- 172.21.15.77:0/4243253403 wait complete. 2024-04-21T10:26:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.822+0000 7fae57d93740 20 client.25657 trim_cache size 0 max 16384 2024-04-21T10:26:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 Processor -- start 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 -- start start 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 0x556accfb8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfbf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfad0e0 0x556accfc4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae501b69a0 con 0x556accfad0e0 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fae501b4270 con 0x556accfa3b60 2024-04-21T10:26:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae57d93740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae501b20c0 con 0x556accfa48d0 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 0x556accfb8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 0x556accfb8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:56024/0 (socket says 172.21.15.77:56024) 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 -- 172.21.15.77:0/992502957 learned_addr learned my addr 172.21.15.77:0/992502957 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4f59e640 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfad0e0 0x556accfc4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4e59c640 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfbf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 -- 172.21.15.77:0/992502957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 msgr2=0x556accfbf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfbf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 -- 172.21.15.77:0/992502957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfad0e0 msgr2=0x556accfc4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.844+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfad0e0 0x556accfc4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.845+0000 7fae4ed9d640 1 -- 172.21.15.77:0/992502957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556accfa2e30 con 0x556accfa3b60 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.845+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 0x556accfb8d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae48007b90 tx=0x7fae4800f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaea776762e585d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.845+0000 7fae34ff9640 1 -- 172.21.15.77:0/992502957 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48031070 con 0x556accfa3b60 2024-04-21T10:26:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.845+0000 7fae34ff9640 1 -- 172.21.15.77:0/992502957 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae48028070 con 0x556accfa3b60 2024-04-21T10:26:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.845+0000 7fae34ff9640 1 -- 172.21.15.77:0/992502957 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4801d040 con 0x556accfa3b60 2024-04-21T10:26:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 -- 172.21.15.77:0/992502957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 msgr2=0x556accfb8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 0x556accfb8d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae48007b90 tx=0x7fae4800f850 comp rx=0 tx=0).stop 2024-04-21T10:26:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 -- 172.21.15.77:0/992502957 shutdown_connections 2024-04-21T10:26:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfad0e0 0x556accfc4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfa48d0 0x556accfbf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 --2- 172.21.15.77:0/992502957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa3b60 0x556accfb8d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 -- 172.21.15.77:0/992502957 >> 172.21.15.77:0/992502957 conn(0x556accf6ac90 msgr2=0x556accfa3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 -- 172.21.15.77:0/992502957 shutdown_connections 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 -- 172.21.15.77:0/992502957 wait complete. 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 -- start start 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.847+0000 7fae57d93740 1 Processor -- start 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae57d93740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfb5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae57d93740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfb5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae57d93740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfa70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfb5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfb5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38782/0 (socket says 172.21.15.77:38782) 2024-04-21T10:26:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae4ed9d640 1 -- 172.21.15.77:0/1820857596 learned_addr learned my addr 172.21.15.77:0/1820857596 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae4e59c640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfb5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae4f59e640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfa70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.848+0000 7fae57d93740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae501b2730 con 0x556accfa3b60 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fae501b3ba0 con 0x556accfa48d0 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae501b2e00 con 0x556accfad0e0 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae57d93740 10 client.0 _ll_register_callbacks cb 0x7fae4001a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4ed9d640 1 -- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 msgr2=0x556accfa70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfa70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4ed9d640 1 -- 172.21.15.77:0/1820857596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 msgr2=0x556accfb5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfb5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4ed9d640 1 -- 172.21.15.77:0/1820857596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556accfa7790 con 0x556accfa3b60 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4e59c640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfb5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae48028070 con 0x556accfa3b60 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.849+0000 7fae4ed9d640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfb5220 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fae48007f60 tx=0x7fae48007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545e4a9ba3708096 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:26:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae32ff5640 10 client.16245 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae32ff5640 1 -- 172.21.15.77:0/1820857596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48031070 con 0x556accfa3b60 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae32ff5640 1 -- 172.21.15.77:0/1820857596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fae48004c60 con 0x556accfa3b60 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae32ff5640 1 -- 172.21.15.77:0/1820857596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae48010820 con 0x556accfa3b60 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 10 client.16245 fetch_fsmap learned FSMap version 31 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=31}) -- 0x556accfadd10 con 0x556accfa3b60 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae32ff5640 1 -- 172.21.15.77:0/1820857596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== fsmap(e 31) ==== 8342+0+0 (secure 0 0 0) 0x7fae480109c0 con 0x556accfa3b60 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 10 client.16245 fetch_fsmap finished waiting for FSMap version 31 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 20 client.16245 populate_metadata read hostname 'smithi077' 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfae0e0 0x556acd0256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 4 client.16245 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.850+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556accfbf880 con 0x556accfae0e0 2024-04-21T10:26:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.851+0000 7fae4e59c640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfae0e0 0x556acd0256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:26:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.851+0000 7fae4e59c640 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfae0e0 0x556acd0256a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928815da7e878282 server_cookie=cc404c64f1b12632 in_seq=0 out_seq=0 2024-04-21T10:26:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.851+0000 7fae32ff5640 10 client.16245 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae32ff5640 1 -- 172.21.15.77:0/1820857596 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556accfbf880 con 0x556accfae0e0 2024-04-21T10:26:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae32ff5640 10 client.16245 handle_command_reply: tid=0 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 client.16245 shutdown 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 msgr2=0x556accfb5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfb5220 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fae48007f60 tx=0x7fae48007410 comp rx=0 tx=0).stop 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 shutdown_connections 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556accfae0e0 0x556acd0256a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556accfad0e0 0x556accfa70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556accfa48d0 0x556accfb5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 --2- 172.21.15.77:0/1820857596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556accfa3b60 0x556accfb5220 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 >> 172.21.15.77:0/1820857596 conn(0x556accf6ac90 msgr2=0x556accfa5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae32ff5640 0 client.16245 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 shutdown_connections 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.866+0000 7fae57d93740 1 -- 172.21.15.77:0/1820857596 wait complete. 2024-04-21T10:26:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae57d93740 20 client.16245 trim_cache size 0 max 16384 2024-04-21T10:26:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:26:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:26:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:26:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fae380a3e40 msgr2=0x7fae380a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fae380a3e40 0x7fae380a6300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae5010e1f0 tx=0x7fae440046c0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 msgr2=0x7fae50116d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 0x7fae50116d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae4001a910 tx=0x7fae400045e0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 shutdown_connections 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fae380a3e40 0x7fae380a6300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae50117290 0x7fae50117740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae5011b730 0x7fae50116d50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 --2- 172.21.15.77:0/2782901442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae50110740 0x7fae5011acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:26:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 >> 172.21.15.77:0/2782901442 conn(0x7fae5006d020 msgr2=0x7fae5011bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:26:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 shutdown_connections 2024-04-21T10:26:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:26:55.867+0000 7fae550c1640 1 -- 172.21.15.77:0/2782901442 wait complete. 2024-04-21T10:26:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:57 smithi077 ceph-mon[27902]: pgmap v169: 97 pgs: 97 active+clean; 3.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 58 MiB/s wr, 1.10k op/s 2024-04-21T10:26:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:57 smithi191 ceph-mon[31636]: pgmap v169: 97 pgs: 97 active+clean; 3.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 58 MiB/s wr, 1.10k op/s 2024-04-21T10:26:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:57 smithi170 ceph-mon[31212]: pgmap v169: 97 pgs: 97 active+clean; 3.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 58 MiB/s wr, 1.10k op/s 2024-04-21T10:26:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:58 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:58 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:58 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:26:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:26:59 smithi077 ceph-mon[27902]: pgmap v170: 97 pgs: 97 active+clean; 3.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 35 MiB/s wr, 686 op/s 2024-04-21T10:26:59.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:26:59 smithi170 ceph-mon[31212]: pgmap v170: 97 pgs: 97 active+clean; 3.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 35 MiB/s wr, 686 op/s 2024-04-21T10:26:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:26:59 smithi191 ceph-mon[31636]: pgmap v170: 97 pgs: 97 active+clean; 3.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 35 MiB/s wr, 686 op/s 2024-04-21T10:27:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 315.0 s, 3397.7 tps, lat 29.575 ms stddev 62.720 2024-04-21T10:27:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:01 smithi077 ceph-mon[27902]: pgmap v171: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 64 MiB/s wr, 1.96k op/s 2024-04-21T10:27:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:01 smithi191 ceph-mon[31636]: pgmap v171: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 64 MiB/s wr, 1.96k op/s 2024-04-21T10:27:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:01 smithi170 ceph-mon[31212]: pgmap v171: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 64 MiB/s wr, 1.96k op/s 2024-04-21T10:27:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:02 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:02 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:02 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:03 smithi191 ceph-mon[31636]: pgmap v172: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 53 MiB/s wr, 1.81k op/s 2024-04-21T10:27:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:03 smithi170 ceph-mon[31212]: pgmap v172: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 53 MiB/s wr, 1.81k op/s 2024-04-21T10:27:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:03 smithi077 ceph-mon[27902]: pgmap v172: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 53 MiB/s wr, 1.81k op/s 2024-04-21T10:27:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 320.0 s, 3631.5 tps, lat 27.461 ms stddev 37.850 2024-04-21T10:27:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:05 smithi191 ceph-mon[31636]: pgmap v173: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 50 MiB/s wr, 1.78k op/s 2024-04-21T10:27:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:05 smithi170 ceph-mon[31212]: pgmap v173: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 50 MiB/s wr, 1.78k op/s 2024-04-21T10:27:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:05 smithi077 ceph-mon[27902]: pgmap v173: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 50 MiB/s wr, 1.78k op/s 2024-04-21T10:27:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:07 smithi191 ceph-mon[31636]: pgmap v174: 97 pgs: 97 active+clean; 3.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 60 MiB/s wr, 2.59k op/s 2024-04-21T10:27:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:07 smithi170 ceph-mon[31212]: pgmap v174: 97 pgs: 97 active+clean; 3.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 60 MiB/s wr, 2.59k op/s 2024-04-21T10:27:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:07 smithi077 ceph-mon[27902]: pgmap v174: 97 pgs: 97 active+clean; 3.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 60 MiB/s wr, 2.59k op/s 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.990+0000 7f07c688c640 1 -- 172.21.15.77:0/3399607978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0106170 msgr2=0x7f07c010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.990+0000 7f07c688c640 1 --2- 172.21.15.77:0/3399607978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0106170 0x7f07c010dd40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009ca0 tx=0x7f07b802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 -- 172.21.15.77:0/3399607978 shutdown_connections 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 --2- 172.21.15.77:0/3399607978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0106170 0x7f07c010dd40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 --2- 172.21.15.77:0/3399607978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07c0101a50 0x7f07c0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 --2- 172.21.15.77:0/3399607978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c01010a0 0x7f07c0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 -- 172.21.15.77:0/3399607978 >> 172.21.15.77:0/3399607978 conn(0x7f07c00fc920 msgr2=0x7f07c00fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 -- 172.21.15.77:0/3399607978 shutdown_connections 2024-04-21T10:27:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 -- 172.21.15.77:0/3399607978 wait complete. 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.991+0000 7f07c688c640 1 Processor -- start 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.992+0000 7f07c688c640 1 -- start start 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c688c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07c01010a0 0x7f07c01a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c688c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 0x7f07c01a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c688c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 0x7f07c019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c688c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01110e0 con 0x7f07c019a6e0 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c688c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0110f60 con 0x7f07c0106170 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c688c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0111260 con 0x7f07c01010a0 2024-04-21T10:27:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c4e29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 0x7f07c019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 0x7f07c01a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c4e29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 0x7f07c019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55032/0 (socket says 172.21.15.77:55032) 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 0x7f07c01a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:35964/0 (socket says 172.21.15.77:35964) 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c4e29640 1 -- 172.21.15.77:0/3719274170 learned_addr learned my addr 172.21.15.77:0/3719274170 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bffff640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07c01010a0 0x7f07c01a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 -- 172.21.15.77:0/3719274170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07c01010a0 msgr2=0x7f07c01a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07c01010a0 0x7f07c01a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 -- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 msgr2=0x7f07c019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 0x7f07c019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07bf7fe640 1 -- 172.21.15.77:0/3719274170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c019b2e0 con 0x7f07c0106170 2024-04-21T10:27:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.993+0000 7f07c4e29640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 0x7f07c019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.994+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 0x7f07c01a0b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c940 tx=0x7f07b400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.994+0000 7f07bd7fa640 1 -- 172.21.15.77:0/3719274170 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4007bb0 con 0x7f07c0106170 2024-04-21T10:27:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.994+0000 7f07bd7fa640 1 -- 172.21.15.77:0/3719274170 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b4007d50 con 0x7f07c0106170 2024-04-21T10:27:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.995+0000 7f07bd7fa640 1 -- 172.21.15.77:0/3719274170 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4004db0 con 0x7f07c0106170 2024-04-21T10:27:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.995+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c01a73c0 con 0x7f07c0106170 2024-04-21T10:27:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.995+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c01a7770 con 0x7f07c0106170 2024-04-21T10:27:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.997+0000 7f07bd7fa640 1 -- 172.21.15.77:0/3719274170 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f07b4004f50 con 0x7f07c0106170 2024-04-21T10:27:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.998+0000 7f07c9484740 1 Processor -- start 2024-04-21T10:27:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.998+0000 7f07c9484740 1 -- start start 2024-04-21T10:27:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07c9484740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f00e0 0x55a8768eee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07c9484740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a8768ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07c9484740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f88f0 0x55a8768face0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07c9484740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a87684b8d0 con 0x55a8768f00e0 2024-04-21T10:27:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07c9484740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a8767e8e80 con 0x55a8768ef370 2024-04-21T10:27:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07c9484740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a876847890 con 0x55a8768f88f0 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07bd7fa640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f07a80a3f20 0x7f07a80a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07bd7fa640 1 -- 172.21.15.77:0/3719274170 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f07b40d0240 con 0x7f07c0106170 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07bffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a8768ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07bffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a8768ef7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:35972/0 (socket says 172.21.15.77:35972) 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:08.999+0000 7f07bffff640 1 -- 172.21.15.77:0/544967084 learned_addr learned my addr 172.21.15.77:0/544967084 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07c4e29640 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f00e0 0x55a8768eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f88f0 0x55a8768face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07c4e29640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f07a80a3f20 0x7f07a80a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bffff640 1 -- 172.21.15.77:0/544967084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f88f0 msgr2=0x55a8768face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bffff640 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f88f0 0x55a8768face0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bffff640 1 -- 172.21.15.77:0/544967084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f00e0 msgr2=0x55a8768eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bffff640 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f00e0 0x55a8768eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bffff640 1 -- 172.21.15.77:0/544967084 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a87680a320 con 0x55a8768ef370 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f88f0 0x55a8768face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07bffff640 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a8768ef7f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009cf0 tx=0x7f07b0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a2bd2051d2a5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07a67fc640 1 -- 172.21.15.77:0/544967084 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0004230 con 0x55a8768ef370 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07a67fc640 1 -- 172.21.15.77:0/544967084 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b00043d0 con 0x55a8768ef370 2024-04-21T10:27:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.000+0000 7f07a67fc640 1 -- 172.21.15.77:0/544967084 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0019880 con 0x55a8768ef370 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 -- 172.21.15.77:0/544967084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 msgr2=0x55a8768ef7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a8768ef7f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009cf0 tx=0x7f07b0011810 comp rx=0 tx=0).stop 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c4e29640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f07a80a3f20 0x7f07a80a63e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f07b8033000 tx=0x7f07b802c0f0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 -- 172.21.15.77:0/544967084 shutdown_connections 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f88f0 0x55a8768face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a8768ef7f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 --2- 172.21.15.77:0/544967084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f00e0 0x55a8768eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 -- 172.21.15.77:0/544967084 >> 172.21.15.77:0/544967084 conn(0x55a8768adc90 msgr2=0x55a8768ea060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 -- 172.21.15.77:0/544967084 shutdown_connections 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.001+0000 7f07c9484740 1 -- 172.21.15.77:0/544967084 wait complete. 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 -- start start 2024-04-21T10:27:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 Processor -- start 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768ef370 0x55a8768f8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f88f0 0x55a8768f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a8768fb620 con 0x55a8768ef370 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a8767d3eb0 con 0x55a8768f88f0 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a8768fb7a0 con 0x55a8768f00e0 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.002+0000 7f07c9484740 10 client.0 _ll_register_callbacks cb 0x55a876800b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07c4e29640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f88f0 0x55a8768f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07c4e29640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f88f0 0x55a8768f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:35976/0 (socket says 172.21.15.77:35976) 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07c4e29640 1 -- 172.21.15.77:0/1412363480 learned_addr learned my addr 172.21.15.77:0/1412363480 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bffff640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768ef370 0x55a8768f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bf7fe640 1 -- 172.21.15.77:0/1412363480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f88f0 msgr2=0x55a8768f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f88f0 0x55a8768f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bf7fe640 1 -- 172.21.15.77:0/1412363480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768ef370 msgr2=0x55a8768f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768ef370 0x55a8768f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.003+0000 7f07bf7fe640 1 -- 172.21.15.77:0/1412363480 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a87655e210 con 0x55a8768f00e0 2024-04-21T10:27:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f5610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07b40cd9c0 tx=0x7f07b4004800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbbe17bacb1afef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f079f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:27:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f079f7fe640 1 -- 172.21.15.77:0/1412363480 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b401d050 con 0x55a8768f00e0 2024-04-21T10:27:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f079f7fe640 1 -- 172.21.15.77:0/1412363480 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f07b4005240 con 0x55a8768f00e0 2024-04-21T10:27:09.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b00043d0 con 0x55a8768f00e0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f079f7fe640 1 -- 172.21.15.77:0/1412363480 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f07b40a0370 con 0x55a8768f00e0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f07c9484740 10 client.25669 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.004+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a87662a620 con 0x55a8768f00e0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f079f7fe640 1 -- 172.21.15.77:0/1412363480 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b00043d0 con 0x55a8768f00e0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f079f7fe640 1 -- 172.21.15.77:0/1412363480 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f07b409b180 con 0x55a8768f00e0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07c9484740 10 client.25669 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07c9484740 10 client.25669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07c9484740 20 client.25669 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07c9484740 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a876908ce0 0x55a87690b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07c9484740 4 client.25669 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a87685f880 con 0x55a876908ce0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.005+0000 7f07bffff640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a876908ce0 0x55a87690b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.006+0000 7f07bffff640 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a876908ce0 0x55a87690b120 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aab60607fdb6929c server_cookie=e46211d6b37da7e7 in_seq=0 out_seq=0 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.006+0000 7f079f7fe640 10 client.25669 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f079f7fe640 1 -- 172.21.15.77:0/1412363480 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a87685f880 con 0x55a876908ce0 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f079f7fe640 10 client.25669 handle_command_reply: tid=0 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 client.25669 shutdown 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 msgr2=0x55a8768f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f5610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07b40cd9c0 tx=0x7f07b4004800 comp rx=0 tx=0).stop 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 shutdown_connections 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a876908ce0 0x55a87690b120 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f88f0 0x55a8768f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f5610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 --2- 172.21.15.77:0/1412363480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768ef370 0x55a8768f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f079f7fe640 0 client.25669 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 >> 172.21.15.77:0/1412363480 conn(0x55a8768adc90 msgr2=0x55a8768ebdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.007+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 shutdown_connections 2024-04-21T10:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.008+0000 7f07c9484740 1 -- 172.21.15.77:0/1412363480 wait complete. 2024-04-21T10:27:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.008+0000 7f07c9484740 20 client.25669 trim_cache size 0 max 16384 2024-04-21T10:27:09.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.032+0000 7f07c9484740 1 Processor -- start 2024-04-21T10:27:09.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.032+0000 7f07c9484740 1 -- start start 2024-04-21T10:27:09.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.032+0000 7f07c9484740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 0x55a876904520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.032+0000 7f07c9484740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f00e0 0x55a8768dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 0x55a876904520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 0x55a876904520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:36762/0 (socket says 172.21.15.77:36762) 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f00e0 0x55a8768dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f00e0 0x55a8768dc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:35992/0 (socket says 172.21.15.77:35992) 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07c9484740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07c9484740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01ae1a0 con 0x55a8768f88f0 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07c9484740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01aba10 con 0x55a8768f00e0 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07c9484740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01a9860 con 0x55a8768ef370 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 -- 172.21.15.77:0/1826837983 learned_addr learned my addr 172.21.15.77:0/1826837983 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07c4e29640 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 -- 172.21.15.77:0/1826837983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f00e0 msgr2=0x55a8768dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f00e0 0x55a8768dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 -- 172.21.15.77:0/1826837983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 msgr2=0x55a8768f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.033+0000 7f07bffff640 1 -- 172.21.15.77:0/1826837983 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8768dcf30 con 0x55a8768ef370 2024-04-21T10:27:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.034+0000 7f07bffff640 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 0x55a876904520 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009250 tx=0x7f07b0003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3903e7027a57cc01 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.034+0000 7f07a5ffb640 1 -- 172.21.15.77:0/1826837983 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b002cde0 con 0x55a8768ef370 2024-04-21T10:27:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.034+0000 7f07a5ffb640 1 -- 172.21.15.77:0/1826837983 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b0032070 con 0x55a8768ef370 2024-04-21T10:27:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.034+0000 7f07a5ffb640 1 -- 172.21.15.77:0/1826837983 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b00052a0 con 0x55a8768ef370 2024-04-21T10:27:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.035+0000 7f07c9484740 1 -- 172.21.15.77:0/1826837983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 msgr2=0x55a876904520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.035+0000 7f07c9484740 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 0x55a876904520 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009250 tx=0x7f07b0003f10 comp rx=0 tx=0).stop 2024-04-21T10:27:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.036+0000 7f07c9484740 1 -- 172.21.15.77:0/1826837983 shutdown_connections 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.036+0000 7f07c9484740 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.036+0000 7f07c9484740 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768f00e0 0x55a8768dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.037+0000 7f07c9484740 1 --2- 172.21.15.77:0/1826837983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768ef370 0x55a876904520 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.037+0000 7f07c9484740 1 -- 172.21.15.77:0/1826837983 >> 172.21.15.77:0/1826837983 conn(0x55a8768adc90 msgr2=0x55a8768f3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.037+0000 7f07c9484740 1 -- 172.21.15.77:0/1826837983 shutdown_connections 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.037+0000 7f07c9484740 1 -- 172.21.15.77:0/1826837983 wait complete. 2024-04-21T10:27:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.037+0000 7f07c9484740 1 -- start start 2024-04-21T10:27:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.037+0000 7f07c9484740 1 Processor -- start 2024-04-21T10:27:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a876900c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01a9ed0 con 0x55a8768f88f0 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01ab340 con 0x55a8768ef370 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01aa5a0 con 0x55a8768f00e0 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c9484740 10 client.0 _ll_register_callbacks cb 0x7f07b400af00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a876900c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a876900c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:36008/0 (socket says 172.21.15.77:36008) 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 -- 172.21.15.77:0/4171254495 learned_addr learned my addr 172.21.15.77:0/4171254495 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07c4e29640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 -- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 msgr2=0x55a8768f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 -- 172.21.15.77:0/4171254495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 msgr2=0x55a8768f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.038+0000 7f07bffff640 1 -- 172.21.15.77:0/4171254495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8768f3390 con 0x55a8768ef370 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.039+0000 7f07bffff640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a876900c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07b00041b0 tx=0x7f07b00041e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36565de5e7049185 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.039+0000 7f079f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.039+0000 7f079f7fe640 1 -- 172.21.15.77:0/4171254495 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b002cde0 con 0x55a8768ef370 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.039+0000 7f079f7fe640 1 -- 172.21.15.77:0/4171254495 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f07b002b040 con 0x55a8768ef370 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.039+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b0032070 con 0x55a8768ef370 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.039+0000 7f079f7fe640 1 -- 172.21.15.77:0/4171254495 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f07b0005a70 con 0x55a8768ef370 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 10 client.25571 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a8768f9ec0 con 0x55a8768ef370 2024-04-21T10:27:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f079f7fe640 1 -- 172.21.15.77:0/4171254495 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b0004380 con 0x55a8768ef370 2024-04-21T10:27:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f079f7fe640 1 -- 172.21.15.77:0/4171254495 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f07b0003bb0 con 0x55a8768ef370 2024-04-21T10:27:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 10 client.25571 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 10 client.25571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 20 client.25571 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a87696f500 0x55a876971920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:09.042 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 4 client.25571 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:27:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.040+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f07b0032070 con 0x55a87696f500 2024-04-21T10:27:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.041+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a87696f500 0x55a876971920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.041+0000 7f079f7fe640 10 client.25571 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.041+0000 7f07bf7fe640 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a87696f500 0x55a876971920 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75bda9b796adb68f server_cookie=2bf6397db498872b in_seq=0 out_seq=0 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.057+0000 7f079f7fe640 1 -- 172.21.15.77:0/4171254495 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f07b0032070 con 0x55a87696f500 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f079f7fe640 10 client.25571 handle_command_reply: tid=0 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 client.25571 shutdown 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 msgr2=0x55a876900c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a876900c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07b00041b0 tx=0x7f07b00041e0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 shutdown_connections 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55a87696f500 0x55a876971920 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.058 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a8768f88f0 0x55a8768f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f079f7fe640 0 client.25571 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a8768f00e0 0x55a8768f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 --2- 172.21.15.77:0/4171254495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8768ef370 0x55a876900c20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 >> 172.21.15.77:0/4171254495 conn(0x55a8768adc90 msgr2=0x55a8768f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 shutdown_connections 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 1 -- 172.21.15.77:0/4171254495 wait complete. 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.058+0000 7f07c9484740 20 client.25571 trim_cache size 0 max 16384 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:27:09.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:27:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:27:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f07a80a3f20 msgr2=0x7f07a80a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f07a80a3f20 0x7f07a80a63e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f07b8033000 tx=0x7f07b802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 msgr2=0x7f07c01a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 0x7f07c01a0b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c940 tx=0x7f07b400ce00 comp rx=0 tx=0).stop 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 shutdown_connections 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f07a80a3f20 0x7f07a80a63e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c019a6e0 0x7f07c019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c0106170 0x7f07c01a0b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 --2- 172.21.15.77:0/3719274170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07c01010a0 0x7f07c01a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 >> 172.21.15.77:0/3719274170 conn(0x7f07c00fc920 msgr2=0x7f07c006abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 shutdown_connections 2024-04-21T10:27:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:09.059+0000 7f07c688c640 1 -- 172.21.15.77:0/3719274170 wait complete. 2024-04-21T10:27:09.686 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:09 smithi077 ceph-mon[27902]: pgmap v175: 97 pgs: 97 active+clean; 3.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 44 MiB/s wr, 2.24k op/s 2024-04-21T10:27:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:09 smithi191 ceph-mon[31636]: pgmap v175: 97 pgs: 97 active+clean; 3.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 44 MiB/s wr, 2.24k op/s 2024-04-21T10:27:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:09 smithi170 ceph-mon[31212]: pgmap v175: 97 pgs: 97 active+clean; 3.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 44 MiB/s wr, 2.24k op/s 2024-04-21T10:27:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 325.0 s, 3554.4 tps, lat 28.199 ms stddev 32.045 2024-04-21T10:27:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:11 smithi191 ceph-mon[31636]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 49 MiB/s wr, 2.66k op/s 2024-04-21T10:27:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:11 smithi170 ceph-mon[31212]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 49 MiB/s wr, 2.66k op/s 2024-04-21T10:27:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:11 smithi077 ceph-mon[27902]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 49 MiB/s wr, 2.66k op/s 2024-04-21T10:27:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:13 smithi191 ceph-mon[31636]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-04-21T10:27:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:13 smithi170 ceph-mon[31212]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-04-21T10:27:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:13 smithi077 ceph-mon[27902]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-04-21T10:27:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 330.0 s, 967.5 tps, lat 25.817 ms stddev 28.057 2024-04-21T10:27:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:15 smithi191 ceph-mon[31636]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-04-21T10:27:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:15 smithi170 ceph-mon[31212]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-04-21T10:27:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:15 smithi077 ceph-mon[27902]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-04-21T10:27:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:17 smithi077 ceph-mon[27902]: pgmap v179: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 19 MiB/s wr, 1.50k op/s 2024-04-21T10:27:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:17 smithi191 ceph-mon[31636]: pgmap v179: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 19 MiB/s wr, 1.50k op/s 2024-04-21T10:27:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:17 smithi170 ceph-mon[31212]: pgmap v179: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 19 MiB/s wr, 1.50k op/s 2024-04-21T10:27:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:19 smithi170 ceph-mon[31212]: pgmap v180: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 686 op/s 2024-04-21T10:27:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:19 smithi077 ceph-mon[27902]: pgmap v180: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 686 op/s 2024-04-21T10:27:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:19 smithi191 ceph-mon[31636]: pgmap v180: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 686 op/s 2024-04-21T10:27:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 335.0 s, 2441.3 tps, lat 71.458 ms stddev 476.257 2024-04-21T10:27:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:21 smithi170 ceph-mon[31212]: pgmap v181: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 903 op/s 2024-04-21T10:27:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:21 smithi077 ceph-mon[27902]: pgmap v181: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 903 op/s 2024-04-21T10:27:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:21 smithi191 ceph-mon[31636]: pgmap v181: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 903 op/s 2024-04-21T10:27:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 -- 172.21.15.77:0/3627030865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4106190 msgr2=0x7fb2c406a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 --2- 172.21.15.77:0/3627030865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4106190 0x7fb2c406a1b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009900 tx=0x7fb2c002bc30 comp rx=0 tx=0).stop 2024-04-21T10:27:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 -- 172.21.15.77:0/3627030865 shutdown_connections 2024-04-21T10:27:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 --2- 172.21.15.77:0/3627030865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4106190 0x7fb2c406a1b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 --2- 172.21.15.77:0/3627030865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4101ac0 0x7fb2c4105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 --2- 172.21.15.77:0/3627030865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c4101110 0x7fb2c41014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 -- 172.21.15.77:0/3627030865 >> 172.21.15.77:0/3627030865 conn(0x7fb2c4077fa0 msgr2=0x7fb2c40783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 -- 172.21.15.77:0/3627030865 shutdown_connections 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 -- 172.21.15.77:0/3627030865 wait complete. 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 Processor -- start 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.189+0000 7fb2cc281640 1 -- start start 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2cc281640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 0x7fb2c41a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2cc281640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4106190 0x7fb2c41a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2cc281640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 0x7fb2c419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2cc281640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4114500 con 0x7fb2c419a6b0 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2cc281640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4114380 con 0x7fb2c4101110 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2cc281640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4114680 con 0x7fb2c4106190 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 0x7fb2c419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca01d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 0x7fb2c41a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 0x7fb2c419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55540/0 (socket says 172.21.15.77:55540) 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca01d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 0x7fb2c41a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:53934/0 (socket says 172.21.15.77:53934) 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 -- 172.21.15.77:0/54922402 learned_addr learned my addr 172.21.15.77:0/54922402 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2c981c640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4106190 0x7fb2c41a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 -- 172.21.15.77:0/54922402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4106190 msgr2=0x7fb2c41a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4106190 0x7fb2c41a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 -- 172.21.15.77:0/54922402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 msgr2=0x7fb2c41a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 0x7fb2c41a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 -- 172.21.15.77:0/54922402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c419b2b0 con 0x7fb2c419a6b0 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 0x7fb2c41a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2c981c640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4106190 0x7fb2c41a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2ca81e640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 0x7fb2c419ab30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb2c002c170 tx=0x7fb2c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.190+0000 7fb2bb7fe640 1 -- 172.21.15.77:0/54922402 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0043020 con 0x7fb2c419a6b0 2024-04-21T10:27:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.191+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c419b540 con 0x7fb2c419a6b0 2024-04-21T10:27:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.191+0000 7fb2bb7fe640 1 -- 172.21.15.77:0/54922402 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c002cb30 con 0x7fb2c419a6b0 2024-04-21T10:27:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.191+0000 7fb2bb7fe640 1 -- 172.21.15.77:0/54922402 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0003a10 con 0x7fb2c419a6b0 2024-04-21T10:27:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.191+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c41a7730 con 0x7fb2c419a6b0 2024-04-21T10:27:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.194+0000 7fb2bb7fe640 1 -- 172.21.15.77:0/54922402 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fb2c0046020 con 0x7fb2c419a6b0 2024-04-21T10:27:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.194+0000 7fb2cee76740 1 Processor -- start 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 -- start start 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe6269620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe6269fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62754d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556fe61ce8d0 con 0x556fe6269b60 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556fe616be80 con 0x556fe62730e0 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2cee76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556fe61ca890 con 0x556fe626a8d0 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe6269620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe6269620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:60620/0 (socket says 172.21.15.77:60620) 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 -- 172.21.15.77:0/3149231040 learned_addr learned my addr 172.21.15.77:0/3149231040 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2bb7fe640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb2b00a3dc0 0x7fb2b00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2ca01d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe6269fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2ca81e640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb2b00a3dc0 0x7fb2b00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 -- 172.21.15.77:0/3149231040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 msgr2=0x556fe62754d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62754d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 -- 172.21.15.77:0/3149231040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 msgr2=0x556fe6269fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe6269fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2c981c640 1 -- 172.21.15.77:0/3149231040 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe618d320 con 0x556fe626a8d0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.195+0000 7fb2bb7fe640 1 -- 172.21.15.77:0/54922402 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb2c00f2a70 con 0x7fb2c419a6b0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.196+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe6269620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4011b20 tx=0x7fb2b4005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd08921ea755f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.196+0000 7fb2ca81e640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb2b00a3dc0 0x7fb2b00a6280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00f07f0 tx=0x7fb2c002bc30 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.196+0000 7fb2b8bfe640 1 -- 172.21.15.77:0/3149231040 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4011070 con 0x556fe626a8d0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.196+0000 7fb2b8bfe640 1 -- 172.21.15.77:0/3149231040 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b4011210 con 0x556fe626a8d0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.196+0000 7fb2b8bfe640 1 -- 172.21.15.77:0/3149231040 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40035f0 con 0x556fe626a8d0 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 -- 172.21.15.77:0/3149231040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 msgr2=0x556fe6269620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe6269620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4011b20 tx=0x7fb2b4005850 comp rx=0 tx=0).stop 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 -- 172.21.15.77:0/3149231040 shutdown_connections 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe6269fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3149231040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe6269620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 -- 172.21.15.77:0/3149231040 >> 172.21.15.77:0/3149231040 conn(0x556fe6230c90 msgr2=0x556fe6264850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 -- 172.21.15.77:0/3149231040 shutdown_connections 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 -- 172.21.15.77:0/3149231040 wait complete. 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.197+0000 7fb2cee76740 1 -- start start 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.198+0000 7fb2cee76740 1 Processor -- start 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.198+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe626fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe6270340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2cee76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556fe6275e10 con 0x556fe6269b60 2024-04-21T10:27:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2cee76740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556fe6156eb0 con 0x556fe62730e0 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2cee76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556fe6275f90 con 0x556fe626a8d0 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2cee76740 10 client.0 _ll_register_callbacks cb 0x556fe6183b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2c981c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2c981c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55548/0 (socket says 172.21.15.77:55548) 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2c981c640 1 -- 172.21.15.77:0/2961344759 learned_addr learned my addr 172.21.15.77:0/2961344759 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe626fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2c981c640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe6270340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 -- 172.21.15.77:0/2961344759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 msgr2=0x556fe6270340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe6270340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 -- 172.21.15.77:0/2961344759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 msgr2=0x556fe62729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62729e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 -- 172.21.15.77:0/2961344759 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fe5ee1210 con 0x556fe626a8d0 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2c981c640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe6270340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe626fde0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009fd0 tx=0x7fb2bc00fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d86000a02c15be55 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.199+0000 7fb2adffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2adffb640 1 -- 172.21.15.77:0/2961344759 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00fe50 con 0x556fe626a8d0 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2adffb640 1 -- 172.21.15.77:0/2961344759 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb2bc004b20 con 0x556fe626a8d0 2024-04-21T10:27:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b4011210 con 0x556fe626a8d0 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2adffb640 1 -- 172.21.15.77:0/2961344759 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2bc004d20 con 0x556fe626a8d0 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2cee76740 10 client.25687 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556fe5fad620 con 0x556fe626a8d0 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2adffb640 1 -- 172.21.15.77:0/2961344759 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b4011210 con 0x556fe626a8d0 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2adffb640 1 -- 172.21.15.77:0/2961344759 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7fb2bc004030 con 0x556fe626a8d0 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.200+0000 7fb2cee76740 10 client.25687 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.201+0000 7fb2cee76740 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.201+0000 7fb2cee76740 20 client.25687 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.201+0000 7fb2cee76740 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe6283000 0x556fe6285410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.201+0000 7fb2cee76740 4 client.25687 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.201+0000 7fb2c981c640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe6283000 0x556fe6285410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.201+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fe61e2880 con 0x556fe6283000 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.202+0000 7fb2adffb640 10 client.25687 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:22.207 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.202+0000 7fb2c981c640 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe6283000 0x556fe6285410 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513e4f0a5e785e1 server_cookie=dcfcfab6556f4f6c in_seq=0 out_seq=0 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.203+0000 7fb2adffb640 1 -- 172.21.15.77:0/2961344759 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556fe61e2880 con 0x556fe6283000 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.203+0000 7fb2adffb640 10 client.25687 handle_command_reply: tid=0 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.203+0000 7fb2cee76740 1 client.25687 shutdown 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 msgr2=0x556fe626fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe626fde0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009fd0 tx=0x7fb2bc00fc60 comp rx=0 tx=0).stop 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 shutdown_connections 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe6283000 0x556fe6285410 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe6270340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe626fde0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.209 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 --2- 172.21.15.77:0/2961344759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62729e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.210 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.204+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 >> 172.21.15.77:0/2961344759 conn(0x556fe6230c90 msgr2=0x556fe62665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:22.210 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.205+0000 7fb2adffb640 0 client.25687 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:22.210 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.205+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 shutdown_connections 2024-04-21T10:27:22.210 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.205+0000 7fb2cee76740 1 -- 172.21.15.77:0/2961344759 wait complete. 2024-04-21T10:27:22.210 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.205+0000 7fb2cee76740 20 client.25687 trim_cache size 0 max 16384 2024-04-21T10:27:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.232+0000 7fb2cee76740 1 Processor -- start 2024-04-21T10:27:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.235+0000 7fb2cee76740 1 -- start start 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.235+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe627ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.235+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe625f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe628ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2cee76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41ae210 con 0x556fe6269b60 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2cee76740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41aba80 con 0x556fe62730e0 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2cee76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41a98d0 con 0x556fe626a8d0 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2ca01d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe625f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2ca01d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe625f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:60638/0 (socket says 172.21.15.77:60638) 2024-04-21T10:27:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.236+0000 7fb2ca01d640 1 -- 172.21.15.77:0/903421012 learned_addr learned my addr 172.21.15.77:0/903421012 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.237+0000 7fb2ca01d640 1 -- 172.21.15.77:0/903421012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 msgr2=0x556fe628ace0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:27:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.237+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe628ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.237+0000 7fb2ca01d640 1 -- 172.21.15.77:0/903421012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 msgr2=0x556fe627ed70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:27:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.237+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe627ed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.237 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.237+0000 7fb2ca01d640 1 -- 172.21.15.77:0/903421012 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe625ff30 con 0x556fe626a8d0 2024-04-21T10:27:22.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.240+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe625f760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00f470 tx=0x7fb2bc012320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18cf06c59c4f60b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:22.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.240+0000 7fb2affff640 1 -- 172.21.15.77:0/903421012 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc012c00 con 0x556fe626a8d0 2024-04-21T10:27:22.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.241+0000 7fb2affff640 1 -- 172.21.15.77:0/903421012 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2bc016030 con 0x556fe626a8d0 2024-04-21T10:27:22.240 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.241+0000 7fb2affff640 1 -- 172.21.15.77:0/903421012 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc003bd0 con 0x556fe626a8d0 2024-04-21T10:27:22.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.242+0000 7fb2cee76740 1 -- 172.21.15.77:0/903421012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 msgr2=0x556fe625f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.242+0000 7fb2cee76740 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe625f760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00f470 tx=0x7fb2bc012320 comp rx=0 tx=0).stop 2024-04-21T10:27:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.250+0000 7fb2cee76740 1 -- 172.21.15.77:0/903421012 shutdown_connections 2024-04-21T10:27:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.250+0000 7fb2cee76740 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe628ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.250+0000 7fb2cee76740 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe625f760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.250+0000 7fb2cee76740 1 --2- 172.21.15.77:0/903421012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe627ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.250+0000 7fb2cee76740 1 -- 172.21.15.77:0/903421012 >> 172.21.15.77:0/903421012 conn(0x556fe6230c90 msgr2=0x556fe626fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.259+0000 7fb2cee76740 1 -- 172.21.15.77:0/903421012 shutdown_connections 2024-04-21T10:27:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.261+0000 7fb2cee76740 1 -- 172.21.15.77:0/903421012 wait complete. 2024-04-21T10:27:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 -- start start 2024-04-21T10:27:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 Processor -- start 2024-04-21T10:27:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62e1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe62e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41a9f40 con 0x556fe6269b60 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41ab3b0 con 0x556fe62730e0 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41aa610 con 0x556fe626a8d0 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.262+0000 7fb2cee76740 10 client.0 _ll_register_callbacks cb 0x7fb2bc00f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62e1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62e1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55552/0 (socket says 172.21.15.77:55552) 2024-04-21T10:27:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 -- 172.21.15.77:0/3399911185 learned_addr learned my addr 172.21.15.77:0/3399911185 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:22.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 -- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 msgr2=0x556fe62e1a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T10:27:22.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe62e1a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 -- 172.21.15.77:0/3399911185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 msgr2=0x556fe62e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:22.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.263+0000 7fb2c981c640 1 -- 172.21.15.77:0/3399911185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fe627a2f0 con 0x556fe6269b60 2024-04-21T10:27:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.264+0000 7fb2c981c640 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62e1510 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400f850 tx=0x7fb2b40096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2a0fd94049074 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.264+0000 7fb2adffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:27:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.264+0000 7fb2adffb640 1 -- 172.21.15.77:0/3399911185 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4005040 con 0x556fe6269b60 2024-04-21T10:27:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.265+0000 7fb2adffb640 1 -- 172.21.15.77:0/3399911185 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb2b40051e0 con 0x556fe6269b60 2024-04-21T10:27:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.266+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2bc016030 con 0x556fe6269b60 2024-04-21T10:27:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.266+0000 7fb2adffb640 1 -- 172.21.15.77:0/3399911185 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2b40053e0 con 0x556fe6269b60 2024-04-21T10:27:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 10 client.16278 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556fe627b5c0 con 0x556fe6269b60 2024-04-21T10:27:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2adffb640 1 -- 172.21.15.77:0/3399911185 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2bc016030 con 0x556fe6269b60 2024-04-21T10:27:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2adffb640 1 -- 172.21.15.77:0/3399911185 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7fb2b4004900 con 0x556fe6269b60 2024-04-21T10:27:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 10 client.16278 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 20 client.16278 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe62e5530 0x556fe62e7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 4 client.16278 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:27:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.267+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556fe616e3d0 con 0x556fe62e5530 2024-04-21T10:27:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.268+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe62e5530 0x556fe62e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.269+0000 7fb2ca01d640 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe62e5530 0x556fe62e7950 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a52a464460403bd server_cookie=3de9db1490b5d5e1 in_seq=0 out_seq=0 2024-04-21T10:27:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.269+0000 7fb2adffb640 10 client.16278 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.283+0000 7fb2adffb640 1 -- 172.21.15.77:0/3399911185 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556fe616e3d0 con 0x556fe62e5530 2024-04-21T10:27:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2adffb640 10 client.16278 handle_command_reply: tid=0 2024-04-21T10:27:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 client.16278 shutdown 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 msgr2=0x556fe62e1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62e1510 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400f850 tx=0x7fb2b40096c0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 shutdown_connections 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x556fe62e5530 0x556fe62e7950 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556fe62730e0 0x556fe62e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556fe626a8d0 0x556fe62e1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 --2- 172.21.15.77:0/3399911185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556fe6269b60 0x556fe62e1510 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 >> 172.21.15.77:0/3399911185 conn(0x556fe6230c90 msgr2=0x556fe626aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.284+0000 7fb2adffb640 0 client.16278 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.285+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 shutdown_connections 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.285+0000 7fb2cee76740 1 -- 172.21.15.77:0/3399911185 wait complete. 2024-04-21T10:27:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.285+0000 7fb2cee76740 20 client.16278 trim_cache size 0 max 16384 2024-04-21T10:27:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:27:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:27:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:27:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:27:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.287+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb2b00a3dc0 msgr2=0x7fb2b00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.287+0000 7fb2cc281640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb2b00a3dc0 0x7fb2b00a6280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00f07f0 tx=0x7fb2c002bc30 comp rx=0 tx=0).stop 2024-04-21T10:27:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.287+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 msgr2=0x7fb2c419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.287+0000 7fb2cc281640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 0x7fb2c419ab30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb2c002c170 tx=0x7fb2c00045e0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.287+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 shutdown_connections 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.287+0000 7fb2cc281640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fb2b00a3dc0 0x7fb2b00a6280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.288+0000 7fb2cc281640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c419a6b0 0x7fb2c419ab30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.288+0000 7fb2cc281640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c4106190 0x7fb2c41a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.288+0000 7fb2cc281640 1 --2- 172.21.15.77:0/54922402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2c4101110 0x7fb2c41a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.288+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 >> 172.21.15.77:0/54922402 conn(0x7fb2c4077fa0 msgr2=0x7fb2c4104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.288+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 shutdown_connections 2024-04-21T10:27:22.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:22.288+0000 7fb2cc281640 1 -- 172.21.15.77:0/54922402 wait complete. 2024-04-21T10:27:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:23 smithi170 ceph-mon[31212]: pgmap v182: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-04-21T10:27:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:23 smithi077 ceph-mon[27902]: pgmap v182: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-04-21T10:27:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:23 smithi191 ceph-mon[31636]: pgmap v182: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-04-21T10:27:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 340.0 s, 3487.0 tps, lat 28.860 ms stddev 33.222 2024-04-21T10:27:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:25 smithi170 ceph-mon[31212]: pgmap v183: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.0 MiB/s wr, 406 op/s 2024-04-21T10:27:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:25 smithi077 ceph-mon[27902]: pgmap v183: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.0 MiB/s wr, 406 op/s 2024-04-21T10:27:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:25 smithi191 ceph-mon[31636]: pgmap v183: 97 pgs: 97 active+clean; 3.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.0 MiB/s wr, 406 op/s 2024-04-21T10:27:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:27 smithi170 ceph-mon[31212]: pgmap v184: 97 pgs: 97 active+clean; 3.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.1 MiB/s wr, 719 op/s 2024-04-21T10:27:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:27 smithi077 ceph-mon[27902]: pgmap v184: 97 pgs: 97 active+clean; 3.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.1 MiB/s wr, 719 op/s 2024-04-21T10:27:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:27 smithi191 ceph-mon[31636]: pgmap v184: 97 pgs: 97 active+clean; 3.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.1 MiB/s wr, 719 op/s 2024-04-21T10:27:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:29 smithi170 ceph-mon[31212]: pgmap v185: 97 pgs: 97 active+clean; 3.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.2 MiB/s wr, 547 op/s 2024-04-21T10:27:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:29 smithi077 ceph-mon[27902]: pgmap v185: 97 pgs: 97 active+clean; 3.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.2 MiB/s wr, 547 op/s 2024-04-21T10:27:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:29 smithi191 ceph-mon[31636]: pgmap v185: 97 pgs: 97 active+clean; 3.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.2 MiB/s wr, 547 op/s 2024-04-21T10:27:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 345.0 s, 3601.6 tps, lat 27.644 ms stddev 30.396 2024-04-21T10:27:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:31 smithi170 ceph-mon[31212]: pgmap v186: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.5 MiB/s wr, 758 op/s 2024-04-21T10:27:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:31 smithi077 ceph-mon[27902]: pgmap v186: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.5 MiB/s wr, 758 op/s 2024-04-21T10:27:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:31 smithi191 ceph-mon[31636]: pgmap v186: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.5 MiB/s wr, 758 op/s 2024-04-21T10:27:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:33 smithi170 ceph-mon[31212]: pgmap v187: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.0 MiB/s wr, 646 op/s 2024-04-21T10:27:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:33 smithi077 ceph-mon[27902]: pgmap v187: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.0 MiB/s wr, 646 op/s 2024-04-21T10:27:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:33 smithi191 ceph-mon[31636]: pgmap v187: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.0 MiB/s wr, 646 op/s 2024-04-21T10:27:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 350.0 s, 3329.0 tps, lat 30.139 ms stddev 33.023 2024-04-21T10:27:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 -- 172.21.15.77:0/3868237292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180076480 msgr2=0x7fe180076860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 --2- 172.21.15.77:0/3868237292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180076480 0x7fe180076860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe174009930 tx=0x7fe17402bc30 comp rx=0 tx=0).stop 2024-04-21T10:27:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 -- 172.21.15.77:0/3868237292 shutdown_connections 2024-04-21T10:27:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 --2- 172.21.15.77:0/3868237292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180112df0 0x7fe1801151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 --2- 172.21.15.77:0/3868237292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076da0 0x7fe1801128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 --2- 172.21.15.77:0/3868237292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180076480 0x7fe180076860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 -- 172.21.15.77:0/3868237292 >> 172.21.15.77:0/3868237292 conn(0x7fe1800ffc00 msgr2=0x7fe180102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 -- 172.21.15.77:0/3868237292 shutdown_connections 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.425+0000 7fe184bc7640 1 -- 172.21.15.77:0/3868237292 wait complete. 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 Processor -- start 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 -- start start 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076480 0x7fe18019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180076da0 0x7fe18019f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180112df0 0x7fe1801a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076480 0x7fe18019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076480 0x7fe18019eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:57078/0 (socket says 172.21.15.77:57078) 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe17e59c640 1 -- 172.21.15.77:0/3698099974 learned_addr learned my addr 172.21.15.77:0/3698099974 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 -- 172.21.15.77:0/3698099974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe180118860 con 0x7fe180076da0 2024-04-21T10:27:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 -- 172.21.15.77:0/3698099974 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801186e0 con 0x7fe180112df0 2024-04-21T10:27:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe184bc7640 1 -- 172.21.15.77:0/3698099974 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801189e0 con 0x7fe180076480 2024-04-21T10:27:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.426+0000 7fe17ed9d640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180112df0 0x7fe1801a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.427+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180076da0 0x7fe18019f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.427+0000 7fe17dd9b640 1 -- 172.21.15.77:0/3698099974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076480 msgr2=0x7fe18019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.427+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076480 0x7fe18019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.427+0000 7fe17dd9b640 1 -- 172.21.15.77:0/3698099974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180112df0 msgr2=0x7fe1801a3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.427+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180112df0 0x7fe1801a3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.427+0000 7fe17dd9b640 1 -- 172.21.15.77:0/3698099974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1801a3d90 con 0x7fe180076da0 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.428+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180076da0 0x7fe18019f2e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe17000e9f0 tx=0x7fe17000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.428+0000 7fe16f7fe640 1 -- 172.21.15.77:0/3698099974 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17000ccc0 con 0x7fe180076da0 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.428+0000 7fe16f7fe640 1 -- 172.21.15.77:0/3698099974 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe170005020 con 0x7fe180076da0 2024-04-21T10:27:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.428+0000 7fe16f7fe640 1 -- 172.21.15.77:0/3698099974 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170004a00 con 0x7fe180076da0 2024-04-21T10:27:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.431+0000 7fe184bc7640 1 -- 172.21.15.77:0/3698099974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1801a4080 con 0x7fe180076da0 2024-04-21T10:27:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.431+0000 7fe184bc7640 1 -- 172.21.15.77:0/3698099974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1801ab910 con 0x7fe180076da0 2024-04-21T10:27:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.434+0000 7fe1877bc740 1 Processor -- start 2024-04-21T10:27:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.436+0000 7fe16f7fe640 1 -- 172.21.15.77:0/3698099974 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fe170004ba0 con 0x7fe180076da0 2024-04-21T10:27:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.438+0000 7fe16f7fe640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe1680a3ff0 0x7fe1680a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.438+0000 7fe16f7fe640 1 -- 172.21.15.77:0/3698099974 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe1700d0c50 con 0x7fe180076da0 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.438+0000 7fe1877bc740 1 -- start start 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.439+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e1f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.439+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e1f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.439+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.439+0000 7fe1877bc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b2e5d848d0 con 0x55b2e5e20e70 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.439+0000 7fe1877bc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b2e5d21e80 con 0x55b2e5e1fca0 2024-04-21T10:27:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.439+0000 7fe1877bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b2e5d80890 con 0x55b2e5e20a00 2024-04-21T10:27:35.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.441+0000 7fe17ed9d640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe1680a3ff0 0x7fe1680a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.442+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e1f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.442+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e1f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41834/0 (socket says 172.21.15.77:41834) 2024-04-21T10:27:35.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.442+0000 7fe17dd9b640 1 -- 172.21.15.77:0/1039925498 learned_addr learned my addr 172.21.15.77:0/1039925498 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.442+0000 7fe17e59c640 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.447+0000 7fe17e59c640 1 -- 172.21.15.77:0/1039925498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 msgr2=0x55b2e5e2b400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T10:27:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.447+0000 7fe17e59c640 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.447+0000 7fe17e59c640 1 -- 172.21.15.77:0/1039925498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 msgr2=0x55b2e5e1f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.447+0000 7fe17e59c640 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e1f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.447+0000 7fe17e59c640 1 -- 172.21.15.77:0/1039925498 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e5d43320 con 0x55b2e5e20a00 2024-04-21T10:27:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.451+0000 7fe17e59c640 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e1f140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe174005ab0 tx=0x7fe17402c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87d4732cfa92cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.451+0000 7fe184bc7640 1 -- 172.21.15.77:0/1039925498 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174045020 con 0x55b2e5e20a00 2024-04-21T10:27:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.452+0000 7fe184bc7640 1 -- 172.21.15.77:0/1039925498 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17402c7e0 con 0x55b2e5e20a00 2024-04-21T10:27:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.452+0000 7fe184bc7640 1 -- 172.21.15.77:0/1039925498 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1740055e0 con 0x55b2e5e20a00 2024-04-21T10:27:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.452+0000 7fe1877bc740 1 -- 172.21.15.77:0/1039925498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 msgr2=0x55b2e5e1f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.452+0000 7fe1877bc740 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e1f140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe174005ab0 tx=0x7fe17402c700 comp rx=0 tx=0).stop 2024-04-21T10:27:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.454+0000 7fe17ed9d640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe1680a3ff0 0x7fe1680a64b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe18006b310 tx=0x7fe178009500 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.455+0000 7fe1877bc740 1 -- 172.21.15.77:0/1039925498 shutdown_connections 2024-04-21T10:27:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.455+0000 7fe1877bc740 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e1f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.455+0000 7fe1877bc740 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.455+0000 7fe1877bc740 1 --2- 172.21.15.77:0/1039925498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e1f140 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.455+0000 7fe1877bc740 1 -- 172.21.15.77:0/1039925498 >> 172.21.15.77:0/1039925498 conn(0x55b2e5de6c90 msgr2=0x55b2e5e1ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.458+0000 7fe1877bc740 1 -- 172.21.15.77:0/1039925498 shutdown_connections 2024-04-21T10:27:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.458+0000 7fe1877bc740 1 -- 172.21.15.77:0/1039925498 wait complete. 2024-04-21T10:27:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.458+0000 7fe1877bc740 1 -- start start 2024-04-21T10:27:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.458+0000 7fe1877bc740 1 Processor -- start 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e28620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e20e70 0x55b2e5e28b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b2e5e3ce80 con 0x55b2e5e1fca0 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b2e5d0ceb0 con 0x55b2e5e20e70 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b2e5e3d000 con 0x55b2e5e20a00 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe1877bc740 10 client.0 _ll_register_callbacks cb 0x55b2e5d39b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e28620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e28620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:57100/0 (socket says 172.21.15.77:57100) 2024-04-21T10:27:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.459+0000 7fe17dd9b640 1 -- 172.21.15.77:0/43160388 learned_addr learned my addr 172.21.15.77:0/43160388 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:35.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.460+0000 7fe17e59c640 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.462+0000 7fe17e59c640 1 -- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 msgr2=0x55b2e5e28620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.462+0000 7fe17e59c640 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e28620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.462+0000 7fe17e59c640 1 -- 172.21.15.77:0/43160388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e20e70 msgr2=0x55b2e5e28b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.462+0000 7fe17e59c640 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e20e70 0x55b2e5e28b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.462+0000 7fe17e59c640 1 -- 172.21.15.77:0/43160388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e5a97210 con 0x55b2e5e1fca0 2024-04-21T10:27:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.464+0000 7fe17e59c640 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe174005ab0 tx=0x7fe17402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebd2e9011858395 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.464+0000 7fe165ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:27:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.464+0000 7fe165ffb640 1 -- 172.21.15.77:0/43160388 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174045070 con 0x55b2e5e1fca0 2024-04-21T10:27:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.464+0000 7fe165ffb640 1 -- 172.21.15.77:0/43160388 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe1740035f0 con 0x55b2e5e1fca0 2024-04-21T10:27:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.465+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe17402c7e0 con 0x55b2e5e1fca0 2024-04-21T10:27:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.466+0000 7fe165ffb640 1 -- 172.21.15.77:0/43160388 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe174059050 con 0x55b2e5e1fca0 2024-04-21T10:27:35.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.467+0000 7fe1877bc740 10 client.16290 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:35.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.467+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b2e5b63620 con 0x55b2e5e1fca0 2024-04-21T10:27:35.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe165ffb640 1 -- 172.21.15.77:0/43160388 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17402c7e0 con 0x55b2e5e1fca0 2024-04-21T10:27:35.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe165ffb640 1 -- 172.21.15.77:0/43160388 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7fe174004900 con 0x55b2e5e1fca0 2024-04-21T10:27:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe1877bc740 10 client.16290 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe1877bc740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe1877bc740 20 client.16290 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe1877bc740 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5e4a1a0 0x55b2e5e4c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe1877bc740 4 client.16290 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:27:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.469+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2e5d98880 con 0x55b2e5e4a1a0 2024-04-21T10:27:35.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.475+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5e4a1a0 0x55b2e5e4c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.479+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5e4a1a0 0x55b2e5e4c610 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=976f645bc6907d79 server_cookie=65efb9e6236e1f4a in_seq=0 out_seq=0 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.480+0000 7fe165ffb640 10 client.16290 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.480+0000 7fe165ffb640 1 -- 172.21.15.77:0/43160388 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b2e5d98880 con 0x55b2e5e4a1a0 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.480+0000 7fe165ffb640 10 client.16290 handle_command_reply: tid=0 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.480+0000 7fe1877bc740 1 client.16290 shutdown 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.480+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e1fca0 msgr2=0x55b2e5e2b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.480+0000 7fe1877bc740 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe174005ab0 tx=0x7fe17402bc30 comp rx=0 tx=0).stop 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 shutdown_connections 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5e4a1a0 0x55b2e5e4c610 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e20e70 0x55b2e5e28b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e28620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 --2- 172.21.15.77:0/43160388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e2b290 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 >> 172.21.15.77:0/43160388 conn(0x55b2e5de6c90 msgr2=0x55b2e5e1c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe165ffb640 0 client.16290 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 shutdown_connections 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.481+0000 7fe1877bc740 1 -- 172.21.15.77:0/43160388 wait complete. 2024-04-21T10:27:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.482+0000 7fe1877bc740 20 client.16290 trim_cache size 0 max 16384 2024-04-21T10:27:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 Processor -- start 2024-04-21T10:27:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 -- start start 2024-04-21T10:27:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e45d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e2ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e2b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e45d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e45d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:57916/0 (socket says 172.21.15.77:57916) 2024-04-21T10:27:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe17e59c640 1 -- 172.21.15.77:0/793692792 learned_addr learned my addr 172.21.15.77:0/793692792 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801ae220 con 0x55b2e5e20e70 2024-04-21T10:27:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801abae0 con 0x55b2e5e1fca0 2024-04-21T10:27:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.508+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe18010bfb0 con 0x55b2e5e20a00 2024-04-21T10:27:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e2ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17ed9d640 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e2b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17dd9b640 1 -- 172.21.15.77:0/793692792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 msgr2=0x55b2e5e45d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e45d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17dd9b640 1 -- 172.21.15.77:0/793692792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 msgr2=0x55b2e5e2b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e2b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17dd9b640 1 -- 172.21.15.77:0/793692792 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e5e28ec0 con 0x55b2e5e20a00 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.509+0000 7fe17e59c640 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e45d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.510+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e2ad50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe17009cb50 tx=0x7fe17009f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e5379933b90cd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.510+0000 7fe167fff640 1 -- 172.21.15.77:0/793692792 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1700051d0 con 0x55b2e5e20a00 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.510+0000 7fe167fff640 1 -- 172.21.15.77:0/793692792 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17009aec0 con 0x55b2e5e20a00 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.510+0000 7fe167fff640 1 -- 172.21.15.77:0/793692792 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1700ce5f0 con 0x55b2e5e20a00 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 msgr2=0x55b2e5e2ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e2ad50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe17009cb50 tx=0x7fe17009f040 comp rx=0 tx=0).stop 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 shutdown_connections 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20e70 0x55b2e5e2b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20a00 0x55b2e5e2ad50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 --2- 172.21.15.77:0/793692792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5e45d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 >> 172.21.15.77:0/793692792 conn(0x55b2e5de6c90 msgr2=0x55b2e5e19b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 shutdown_connections 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 -- 172.21.15.77:0/793692792 wait complete. 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 -- start start 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.511+0000 7fe1877bc740 1 Processor -- start 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5ea8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20a00 0x55b2e5ea9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20e70 0x55b2e5e3d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe18010c620 con 0x55b2e5e20a00 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe18010da90 con 0x55b2e5e1fca0 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe18010ccf0 con 0x55b2e5e20e70 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5ea8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20a00 0x55b2e5ea9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5ea8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:57932/0 (socket says 172.21.15.77:57932) 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe17e59c640 1 -- 172.21.15.77:0/2147840781 learned_addr learned my addr 172.21.15.77:0/2147840781 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe1877bc740 10 client.0 _ll_register_callbacks cb 0x7fe170098e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.512+0000 7fe17ed9d640 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20e70 0x55b2e5e3d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe17dd9b640 1 -- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20e70 msgr2=0x55b2e5e3d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20e70 0x55b2e5e3d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe17dd9b640 1 -- 172.21.15.77:0/2147840781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 msgr2=0x55b2e5ea8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5ea8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe17dd9b640 1 -- 172.21.15.77:0/2147840781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e5e3dcf0 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe17dd9b640 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20a00 0x55b2e5ea9040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55b2e5e46a20 tx=0x7fe170098f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6d20ba0d4e6b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.513+0000 7fe165ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.514+0000 7fe165ffb640 1 -- 172.21.15.77:0/2147840781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1700a9070 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.514+0000 7fe165ffb640 1 -- 172.21.15.77:0/2147840781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe170099230 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.514+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe17009aec0 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.514+0000 7fe165ffb640 1 -- 172.21.15.77:0/2147840781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe1700b6130 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.514+0000 7fe1877bc740 10 client.16296 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.514+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b2e5eb0220 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe165ffb640 1 -- 172.21.15.77:0/2147840781 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17009aec0 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe165ffb640 1 -- 172.21.15.77:0/2147840781 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7fe1700ac020 con 0x55b2e5e20a00 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe1877bc740 10 client.16296 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe1877bc740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe1877bc740 20 client.16296 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe1877bc740 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5eb0980 0x55b2e5eb2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe1877bc740 4 client.16296 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:27:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2e5d243d0 con 0x55b2e5eb0980 2024-04-21T10:27:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.515+0000 7fe17e59c640 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5eb0980 0x55b2e5eb2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.516+0000 7fe17e59c640 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5eb0980 0x55b2e5eb2da0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2f6abdfd547589 server_cookie=1b565de51903f289 in_seq=0 out_seq=0 2024-04-21T10:27:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.516+0000 7fe165ffb640 10 client.16296 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.536+0000 7fe165ffb640 1 -- 172.21.15.77:0/2147840781 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2e5d243d0 con 0x55b2e5eb0980 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.536+0000 7fe165ffb640 10 client.16296 handle_command_reply: tid=0 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.536+0000 7fe1877bc740 1 client.16296 shutdown 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.536+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20a00 msgr2=0x55b2e5ea9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.536+0000 7fe1877bc740 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20a00 0x55b2e5ea9040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55b2e5e46a20 tx=0x7fe170098f90 comp rx=0 tx=0).stop 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 shutdown_connections 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b2e5eb0980 0x55b2e5eb2da0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b2e5e20a00 0x55b2e5ea9040 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe165ffb640 0 client.16296 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e5e20e70 0x55b2e5e3d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 --2- 172.21.15.77:0/2147840781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e5e1fca0 0x55b2e5ea8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 >> 172.21.15.77:0/2147840781 conn(0x55b2e5de6c90 msgr2=0x55b2e5e27e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 shutdown_connections 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 1 -- 172.21.15.77:0/2147840781 wait complete. 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.537+0000 7fe1877bc740 20 client.16296 trim_cache size 0 max 16384 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:27:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:27:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 -- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe1680a3ff0 msgr2=0x7fe1680a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe1680a3ff0 0x7fe1680a64b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe18006b310 tx=0x7fe178009500 comp rx=0 tx=0).stop 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 -- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180076da0 msgr2=0x7fe18019f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180076da0 0x7fe18019f2e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe17000e9f0 tx=0x7fe17000eeb0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 -- 172.21.15.77:0/3698099974 shutdown_connections 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe1680a3ff0 0x7fe1680a64b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe180076da0 0x7fe18019f2e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe180112df0 0x7fe1801a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 --2- 172.21.15.77:0/3698099974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe180076480 0x7fe18019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 -- 172.21.15.77:0/3698099974 >> 172.21.15.77:0/3698099974 conn(0x7fe1800ffc00 msgr2=0x7fe180101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 -- 172.21.15.77:0/3698099974 shutdown_connections 2024-04-21T10:27:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:35.539+0000 7fe16d7fa640 1 -- 172.21.15.77:0/3698099974 wait complete. 2024-04-21T10:27:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:35 smithi170 ceph-mon[31212]: pgmap v188: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.9 MiB/s wr, 629 op/s 2024-04-21T10:27:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:27:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:35 smithi077 ceph-mon[27902]: pgmap v188: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.9 MiB/s wr, 629 op/s 2024-04-21T10:27:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:27:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:35 smithi191 ceph-mon[31636]: pgmap v188: 97 pgs: 97 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.9 MiB/s wr, 629 op/s 2024-04-21T10:27:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:27:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:27:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:27:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:27:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:27:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:27:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:27:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:27:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:27:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:27:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:37 smithi077 ceph-mon[27902]: pgmap v189: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 931 op/s 2024-04-21T10:27:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:37 smithi191 ceph-mon[31636]: pgmap v189: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 931 op/s 2024-04-21T10:27:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:37 smithi170 ceph-mon[31212]: pgmap v189: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 931 op/s 2024-04-21T10:27:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:39 smithi077 ceph-mon[27902]: pgmap v190: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 618 op/s 2024-04-21T10:27:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:39 smithi191 ceph-mon[31636]: pgmap v190: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 618 op/s 2024-04-21T10:27:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:39 smithi170 ceph-mon[31212]: pgmap v190: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 618 op/s 2024-04-21T10:27:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 355.0 s, 4212.8 tps, lat 23.801 ms stddev 27.163 2024-04-21T10:27:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:41 smithi191 ceph-mon[31636]: pgmap v191: 97 pgs: 97 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 889 op/s 2024-04-21T10:27:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:41 smithi170 ceph-mon[31212]: pgmap v191: 97 pgs: 97 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 889 op/s 2024-04-21T10:27:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:41 smithi077 ceph-mon[27902]: pgmap v191: 97 pgs: 97 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 889 op/s 2024-04-21T10:27:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:43 smithi191 ceph-mon[31636]: pgmap v192: 97 pgs: 97 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-04-21T10:27:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:43 smithi170 ceph-mon[31212]: pgmap v192: 97 pgs: 97 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-04-21T10:27:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:43 smithi077 ceph-mon[27902]: pgmap v192: 97 pgs: 97 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-04-21T10:27:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 360.0 s, 2905.4 tps, lat 34.215 ms stddev 37.182 2024-04-21T10:27:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:45 smithi191 ceph-mon[31636]: pgmap v193: 97 pgs: 97 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.2 MiB/s wr, 739 op/s 2024-04-21T10:27:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:45 smithi170 ceph-mon[31212]: pgmap v193: 97 pgs: 97 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.2 MiB/s wr, 739 op/s 2024-04-21T10:27:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:45 smithi077 ceph-mon[27902]: pgmap v193: 97 pgs: 97 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.2 MiB/s wr, 739 op/s 2024-04-21T10:27:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:47 smithi191 ceph-mon[31636]: pgmap v194: 97 pgs: 97 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-04-21T10:27:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:47 smithi170 ceph-mon[31212]: pgmap v194: 97 pgs: 97 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-04-21T10:27:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:47 smithi077 ceph-mon[27902]: pgmap v194: 97 pgs: 97 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 -- 172.21.15.77:0/246067691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc101a50 msgr2=0x7ffacc105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 --2- 172.21.15.77:0/246067691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc101a50 0x7ffacc105a90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffac800fb10 tx=0x7ffac802fdf0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 -- 172.21.15.77:0/246067691 shutdown_connections 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 --2- 172.21.15.77:0/246067691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc106170 0x7ffacc10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 --2- 172.21.15.77:0/246067691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc101a50 0x7ffacc105a90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 --2- 172.21.15.77:0/246067691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffacc1010a0 0x7ffacc101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 -- 172.21.15.77:0/246067691 >> 172.21.15.77:0/246067691 conn(0x7ffacc0fc920 msgr2=0x7ffacc0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 -- 172.21.15.77:0/246067691 shutdown_connections 2024-04-21T10:27:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.672+0000 7ffad398e640 1 -- 172.21.15.77:0/246067691 wait complete. 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.673+0000 7ffad398e640 1 Processor -- start 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.673+0000 7ffad398e640 1 -- start start 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad398e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc1010a0 0x7ffacc19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad398e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffacc106170 0x7ffacc195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad398e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 0x7ffacc196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad398e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc110070 con 0x7ffacc106170 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad398e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc10fef0 con 0x7ffacc195b70 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad398e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1101f0 con 0x7ffacc1010a0 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad1f2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 0x7ffacc196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad1f2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 0x7ffacc196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:37246/0 (socket says 172.21.15.77:37246) 2024-04-21T10:27:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad1f2b640 1 -- 172.21.15.77:0/395647148 learned_addr learned my addr 172.21.15.77:0/395647148 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.674+0000 7ffad172a640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc1010a0 0x7ffacc19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.675+0000 7ffad1f2b640 1 -- 172.21.15.77:0/395647148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc1010a0 msgr2=0x7ffacc19d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.675+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc1010a0 0x7ffacc19d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.675+0000 7ffad1f2b640 1 -- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffacc106170 msgr2=0x7ffacc195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.675+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffacc106170 0x7ffacc195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.675+0000 7ffad1f2b640 1 -- 172.21.15.77:0/395647148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc1b3d90 con 0x7ffacc195b70 2024-04-21T10:27:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.675+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 0x7ffacc196020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffac400abd0 tx=0x7ffac4007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.676+0000 7ffac27fc640 1 -- 172.21.15.77:0/395647148 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4007ca0 con 0x7ffacc195b70 2024-04-21T10:27:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.676+0000 7ffac27fc640 1 -- 172.21.15.77:0/395647148 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffac4007e40 con 0x7ffacc195b70 2024-04-21T10:27:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.676+0000 7ffac27fc640 1 -- 172.21.15.77:0/395647148 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4014410 con 0x7ffacc195b70 2024-04-21T10:27:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.676+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc1b4080 con 0x7ffacc195b70 2024-04-21T10:27:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.676+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1b4580 con 0x7ffacc195b70 2024-04-21T10:27:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.678+0000 7ffac27fc640 1 -- 172.21.15.77:0/395647148 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7ffac40052b0 con 0x7ffacc195b70 2024-04-21T10:27:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.679+0000 7ffac27fc640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ffab80a3e40 0x7ffab80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.679+0000 7ffac27fc640 1 -- 172.21.15.77:0/395647148 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ffac40d0260 con 0x7ffacc195b70 2024-04-21T10:27:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.681+0000 7ffad6577740 1 Processor -- start 2024-04-21T10:27:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.681+0000 7ffad6577740 1 -- start start 2024-04-21T10:27:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.681+0000 7ffad172a640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ffab80a3e40 0x7ffab80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.681+0000 7ffad6577740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e094620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad6577740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e094fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad6577740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e0a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad6577740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c29dff98d0 con 0x55c29e09e0e0 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad6577740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c29df96e80 con 0x55c29e0958d0 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad6577740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c29dff5890 con 0x55c29e094b60 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e0a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e0a04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58748/0 (socket says 172.21.15.77:58748) 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad0f29640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e094fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 -- 172.21.15.77:0/881045908 learned_addr learned my addr 172.21.15.77:0/881045908 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad172a640 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e094620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 -- 172.21.15.77:0/881045908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 msgr2=0x55c29e094fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e094fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 -- 172.21.15.77:0/881045908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 msgr2=0x55c29e094620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e094620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 -- 172.21.15.77:0/881045908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c29dfb8320 con 0x55c29e09e0e0 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad172a640 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e094620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad0f29640 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e094fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e0a04d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffac40cdfe0 tx=0x7ffac409c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1795266123c15687 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.682+0000 7ffad172a640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ffab80a3e40 0x7ffab80a6300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc009f70 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.683+0000 7ffab77fe640 1 -- 172.21.15.77:0/881045908 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac40b5070 con 0x55c29e09e0e0 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.683+0000 7ffab77fe640 1 -- 172.21.15.77:0/881045908 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffac40cdc60 con 0x55c29e09e0e0 2024-04-21T10:27:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.683+0000 7ffab77fe640 1 -- 172.21.15.77:0/881045908 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac40a03d0 con 0x55c29e09e0e0 2024-04-21T10:27:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 -- 172.21.15.77:0/881045908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 msgr2=0x55c29e0a04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e0a04d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffac40cdfe0 tx=0x7ffac409c370 comp rx=0 tx=0).stop 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 -- 172.21.15.77:0/881045908 shutdown_connections 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e0a04d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e094fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 --2- 172.21.15.77:0/881045908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e094620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 -- 172.21.15.77:0/881045908 >> 172.21.15.77:0/881045908 conn(0x55c29e05bc90 msgr2=0x55c29e08f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 -- 172.21.15.77:0/881045908 shutdown_connections 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 -- 172.21.15.77:0/881045908 wait complete. 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 -- start start 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.684+0000 7ffad6577740 1 Processor -- start 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e09daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e09ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e09e0e0 0x55c29e09b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c29e0a0e10 con 0x55c29e0958d0 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c29df81eb0 con 0x55c29e09e0e0 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c29e0a0f90 con 0x55c29e094b60 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad6577740 10 client.0 _ll_register_callbacks cb 0x55c29dfaeb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e09ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e09ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58750/0 (socket says 172.21.15.77:58750) 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 -- 172.21.15.77:0/1394411972 learned_addr learned my addr 172.21.15.77:0/1394411972 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e09e0e0 0x55c29e09b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad172a640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e09daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 -- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 msgr2=0x55c29e09daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e09daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 -- 172.21.15.77:0/1394411972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e09e0e0 msgr2=0x55c29e09b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e09e0e0 0x55c29e09b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 -- 172.21.15.77:0/1394411972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c29dd0c210 con 0x55c29e0958d0 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffad0f29640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e09ae80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009230 tx=0x7ffac800f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed20a2003e7072b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.685+0000 7ffab4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.686+0000 7ffab4ff9640 1 -- 172.21.15.77:0/1394411972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac800f490 con 0x55c29e0958d0 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.686+0000 7ffab4ff9640 1 -- 172.21.15.77:0/1394411972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ffac800f630 con 0x55c29e0958d0 2024-04-21T10:27:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.686+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffac40cdc60 con 0x55c29e0958d0 2024-04-21T10:27:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.688+0000 7ffab4ff9640 1 -- 172.21.15.77:0/1394411972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ffac8030790 con 0x55c29e0958d0 2024-04-21T10:27:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.688+0000 7ffad6577740 10 client.16302 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.688+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c29ddd8620 con 0x55c29e0958d0 2024-04-21T10:27:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.688+0000 7ffab4ff9640 1 -- 172.21.15.77:0/1394411972 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffac40cdc60 con 0x55c29e0958d0 2024-04-21T10:27:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffab4ff9640 1 -- 172.21.15.77:0/1394411972 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7ffac8048030 con 0x55c29e0958d0 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad6577740 10 client.16302 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad6577740 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad6577740 20 client.16302 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad6577740 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e0adf70 0x55c29e0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad6577740 4 client.16302 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c29e00d880 con 0x55c29e0adf70 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad172a640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e0adf70 0x55c29e0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffad172a640 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e0adf70 0x55c29e0b0380 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=999450b34a2e1ad server_cookie=e75e20c00bfb76f6 in_seq=0 out_seq=0 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.689+0000 7ffab4ff9640 10 client.16302 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffab4ff9640 1 -- 172.21.15.77:0/1394411972 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c29e00d880 con 0x55c29e0adf70 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffab4ff9640 10 client.16302 handle_command_reply: tid=0 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 client.16302 shutdown 2024-04-21T10:27:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 msgr2=0x55c29e09ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e09ae80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009230 tx=0x7ffac800f110 comp rx=0 tx=0).stop 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 shutdown_connections 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e0adf70 0x55c29e0b0380 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e09ae80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffab4ff9640 0 client.16302 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.690+0000 7ffad6577740 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e09e0e0 0x55c29e09b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.691+0000 7ffad6577740 1 --2- 172.21.15.77:0/1394411972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e09daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.691+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 >> 172.21.15.77:0/1394411972 conn(0x55c29e05bc90 msgr2=0x55c29e0915a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.691+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 shutdown_connections 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.691+0000 7ffad6577740 1 -- 172.21.15.77:0/1394411972 wait complete. 2024-04-21T10:27:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.691+0000 7ffad6577740 20 client.16302 trim_cache size 0 max 16384 2024-04-21T10:27:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 Processor -- start 2024-04-21T10:27:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 -- start start 2024-04-21T10:27:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e09d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1bf2e0 con 0x55c29e09e0e0 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1bcb50 con 0x55c29e0958d0 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad6577740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1ba9c0 con 0x55c29e094b60 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad1f2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e09d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad172a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad172a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:55228/0 (socket says 172.21.15.77:55228) 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad1f2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e09d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58758/0 (socket says 172.21.15.77:58758) 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.715+0000 7ffad172a640 1 -- 172.21.15.77:0/1760117180 learned_addr learned my addr 172.21.15.77:0/1760117180 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad0f29640 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad172a640 1 -- 172.21.15.77:0/1760117180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 msgr2=0x55c29e09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad172a640 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad172a640 1 -- 172.21.15.77:0/1760117180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 msgr2=0x55c29e09d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad172a640 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e09d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad172a640 1 -- 172.21.15.77:0/1760117180 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c29e0b0a00 con 0x55c29e094b60 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e09d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffad172a640 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e0a9d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffabc011ba0 tx=0x7ffabc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6504bd5620436cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffab6ffd640 1 -- 172.21.15.77:0/1760117180 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc016d90 con 0x55c29e094b60 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffab6ffd640 1 -- 172.21.15.77:0/1760117180 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc0178e0 con 0x55c29e094b60 2024-04-21T10:27:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.716+0000 7ffab6ffd640 1 -- 172.21.15.77:0/1760117180 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc025750 con 0x55c29e094b60 2024-04-21T10:27:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 -- 172.21.15.77:0/1760117180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 msgr2=0x55c29e0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e0a9d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffabc011ba0 tx=0x7ffabc017000 comp rx=0 tx=0).stop 2024-04-21T10:27:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 -- 172.21.15.77:0/1760117180 shutdown_connections 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e09e0e0 0x55c29e09d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e0958d0 0x55c29e09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 --2- 172.21.15.77:0/1760117180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e094b60 0x55c29e0a9d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 -- 172.21.15.77:0/1760117180 >> 172.21.15.77:0/1760117180 conn(0x55c29e05bc90 msgr2=0x55c29e09a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 -- 172.21.15.77:0/1760117180 shutdown_connections 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 -- 172.21.15.77:0/1760117180 wait complete. 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 -- start start 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.717+0000 7ffad6577740 1 Processor -- start 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e094b60 0x55c29e0a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e098350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e09e0e0 0x55c29e0989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e098350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1bb010 con 0x55c29e0958d0 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e098350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58760/0 (socket says 172.21.15.77:58760) 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1bc480 con 0x55c29e094b60 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 -- 172.21.15.77:0/4072297482 learned_addr learned my addr 172.21.15.77:0/4072297482 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1bb6e0 con 0x55c29e09e0e0 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad6577740 10 client.0 _ll_register_callbacks cb 0x7ffac8005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad1f2b640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e09e0e0 0x55c29e0989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad172a640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e094b60 0x55c29e0a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 -- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e09e0e0 msgr2=0x55c29e0989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e09e0e0 0x55c29e0989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 -- 172.21.15.77:0/4072297482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e094b60 msgr2=0x55c29e0a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e094b60 0x55c29e0a66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 -- 172.21.15.77:0/4072297482 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c29e09eee0 con 0x55c29e0958d0 2024-04-21T10:27:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffad0f29640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e098350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffac800fb10 tx=0x7ffac8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dc2700d1991d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffab4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.718+0000 7ffab4ff9640 1 -- 172.21.15.77:0/4072297482 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8057060 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffab4ff9640 1 -- 172.21.15.77:0/4072297482 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ffac8005870 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffabc0178e0 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffab4ff9640 1 -- 172.21.15.77:0/4072297482 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ffac8030b40 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 10 client.16308 fetch_fsmap learned FSMap version 33 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c29e1148f0 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffab4ff9640 1 -- 172.21.15.77:0/4072297482 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc0178e0 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffab4ff9640 1 -- 172.21.15.77:0/4072297482 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7ffac8048070 con 0x55c29e0958d0 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 10 client.16308 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 20 client.16308 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e1150d0 0x55c29e1174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 4 client.16308 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:27:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.719+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c29df993d0 con 0x55c29e1150d0 2024-04-21T10:27:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.720+0000 7ffad172a640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e1150d0 0x55c29e1174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.720+0000 7ffab4ff9640 10 client.16308 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.720+0000 7ffad172a640 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e1150d0 0x55c29e1174f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d3f936b1cd9861 server_cookie=a74a26514d0d3f33 in_seq=0 out_seq=0 2024-04-21T10:27:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.731+0000 7ffab4ff9640 1 -- 172.21.15.77:0/4072297482 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c29df993d0 con 0x55c29e1150d0 2024-04-21T10:27:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.731+0000 7ffab4ff9640 10 client.16308 handle_command_reply: tid=0 2024-04-21T10:27:48.731 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.731+0000 7ffad6577740 1 client.16308 shutdown 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.731+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 msgr2=0x55c29e098350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.731+0000 7ffad6577740 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e098350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffac800fb10 tx=0x7ffac8005c00 comp rx=0 tx=0).stop 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 shutdown_connections 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55c29e1150d0 0x55c29e1174f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffab4ff9640 0 client.16308 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c29e0958d0 0x55c29e098350 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c29e09e0e0 0x55c29e0989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 --2- 172.21.15.77:0/4072297482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29e094b60 0x55c29e0a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 >> 172.21.15.77:0/4072297482 conn(0x55c29e05bc90 msgr2=0x55c29e090ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 shutdown_connections 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 1 -- 172.21.15.77:0/4072297482 wait complete. 2024-04-21T10:27:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.732+0000 7ffad6577740 20 client.16308 trim_cache size 0 max 16384 2024-04-21T10:27:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:27:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:27:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:27:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:27:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ffab80a3e40 msgr2=0x7ffab80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ffab80a3e40 0x7ffab80a6300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc009f70 comp rx=0 tx=0).stop 2024-04-21T10:27:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 msgr2=0x7ffacc196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 0x7ffacc196020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffac400abd0 tx=0x7ffac4007590 comp rx=0 tx=0).stop 2024-04-21T10:27:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 shutdown_connections 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ffab80a3e40 0x7ffab80a6300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffacc106170 0x7ffacc195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffacc195b70 0x7ffacc196020 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 --2- 172.21.15.77:0/395647148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc1010a0 0x7ffacc19d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.733+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 >> 172.21.15.77:0/395647148 conn(0x7ffacc0fc920 msgr2=0x7ffacc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.734+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 shutdown_connections 2024-04-21T10:27:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:27:48.734+0000 7ffad398e640 1 -- 172.21.15.77:0/395647148 wait complete. 2024-04-21T10:27:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:48 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 180.001563 secs 2024-04-21T10:27:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:48 smithi191 ceph-mon[31636]: slow request 180.001562 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:27:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:48 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 180.001563 secs 2024-04-21T10:27:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:48 smithi170 ceph-mon[31212]: slow request 180.001562 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:27:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:48 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 180.001563 secs 2024-04-21T10:27:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:48 smithi077 ceph-mon[27902]: slow request 180.001562 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:27:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:49 smithi191 ceph-mon[31636]: pgmap v195: 97 pgs: 97 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 734 op/s 2024-04-21T10:27:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:49 smithi170 ceph-mon[31212]: pgmap v195: 97 pgs: 97 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 734 op/s 2024-04-21T10:27:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 365.0 s, 2514.2 tps, lat 39.874 ms stddev 42.913 2024-04-21T10:27:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:49 smithi077 ceph-mon[27902]: pgmap v195: 97 pgs: 97 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 734 op/s 2024-04-21T10:27:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:51 smithi191 ceph-mon[31636]: pgmap v196: 97 pgs: 97 active+clean; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.8 MiB/s wr, 861 op/s 2024-04-21T10:27:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:51 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 183.240022 secs 2024-04-21T10:27:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:51 smithi191 ceph-mon[31636]: slow request 183.240022 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:27:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:51 smithi170 ceph-mon[31212]: pgmap v196: 97 pgs: 97 active+clean; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.8 MiB/s wr, 861 op/s 2024-04-21T10:27:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:51 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 183.240022 secs 2024-04-21T10:27:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:51 smithi170 ceph-mon[31212]: slow request 183.240022 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:27:52.074 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-21T10:27:52.074 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-04-21T10:27:52.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:27:52.101 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:51 smithi077 ceph-mon[27902]: pgmap v196: 97 pgs: 97 active+clean; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.8 MiB/s wr, 861 op/s 2024-04-21T10:27:52.101 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:51 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 183.240022 secs 2024-04-21T10:27:52.101 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:51 smithi077 ceph-mon[27902]: slow request 183.240022 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:27:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 -- 172.21.15.77:0/1721078237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b41061b0 msgr2=0x7f47b410dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1721078237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b41061b0 0x7f47b410dcf0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009ca0 tx=0x7f47ac02c0f0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 -- 172.21.15.77:0/1721078237 shutdown_connections 2024-04-21T10:27:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1721078237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b41061b0 0x7f47b410dcf0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1721078237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b4107770 0x7f47b4105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1721078237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 0x7f47b41071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.213+0000 7f47bbb52640 1 -- 172.21.15.77:0/1721078237 >> 172.21.15.77:0/1721078237 conn(0x7f47b40770b0 msgr2=0x7f47b40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.214+0000 7f47bbb52640 1 -- 172.21.15.77:0/1721078237 shutdown_connections 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.214+0000 7f47bbb52640 1 -- 172.21.15.77:0/1721078237 wait complete. 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.214+0000 7f47bbb52640 1 Processor -- start 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.214+0000 7f47bbb52640 1 -- start start 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47bbb52640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 0x7f47b4198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47bbb52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 0x7f47b4198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47bbb52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b419cef0 0x7f47b419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b90ed640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 0x7f47b4198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 0x7f47b4198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b90ed640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 0x7f47b4198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:48580/0 (socket says 172.21.15.77:48580) 2024-04-21T10:27:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47ba0ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b419cef0 0x7f47b419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 0x7f47b4198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:45216/0 (socket says 172.21.15.77:45216) 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b90ed640 1 -- 172.21.15.77:0/1029903550 learned_addr learned my addr 172.21.15.77:0/1029903550 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4112190 con 0x7f47b419cef0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4112010 con 0x7f47b4106dc0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4112310 con 0x7f47b41061b0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 -- 172.21.15.77:0/1029903550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 msgr2=0x7f47b4198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 0x7f47b4198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 -- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b419cef0 msgr2=0x7f47b419d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b419cef0 0x7f47b419d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.215+0000 7f47b98ee640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b419d9e0 con 0x7f47b41061b0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.216+0000 7f47b98ee640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 0x7f47b4198630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47b000e9f0 tx=0x7f47b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.216+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000cd80 con 0x7f47b41061b0 2024-04-21T10:27:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.216+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b00035f0 con 0x7f47b41061b0 2024-04-21T10:27:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.216+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b419dcd0 con 0x7f47b41061b0 2024-04-21T10:27:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.216+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b410eb50 con 0x7f47b41061b0 2024-04-21T10:27:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.217+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0010690 con 0x7f47b41061b0 2024-04-21T10:27:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.218+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47980052c0 con 0x7f47b41061b0 2024-04-21T10:27:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.219+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f47b00108f0 con 0x7f47b41061b0 2024-04-21T10:27:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.220+0000 7f47aaffd640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f47a00a3e20 0x7f47a00a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.220+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f47b00d0910 con 0x7f47b41061b0 2024-04-21T10:27:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.221+0000 7f47b90ed640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f47a00a3e20 0x7f47a00a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.222+0000 7f47b90ed640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f47a00a3e20 0x7f47a00a62e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f47a4014fd0 tx=0x7f47a4005f90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.224+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f47b009cf80 con 0x7f47b41061b0 2024-04-21T10:27:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.584+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4798005880 con 0x7f47b41061b0 2024-04-21T10:27:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:27:52.585 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:27:51.569779+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":132,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:27:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 34 2024-04-21T10:27:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.584+0000 7f47aaffd640 1 -- 172.21.15.77:0/1029903550 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11890 (secure 0 0 0) 0x7f47b009c880 con 0x7f47b41061b0 2024-04-21T10:27:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.587+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f47a00a3e20 msgr2=0x7f47a00a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f47a00a3e20 0x7f47a00a62e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f47a4014fd0 tx=0x7f47a4005f90 comp rx=0 tx=0).stop 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 msgr2=0x7f47b4198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 0x7f47b4198630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47b000e9f0 tx=0x7f47b000eeb0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 shutdown_connections 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f47a00a3e20 0x7f47a00a62e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47b419cef0 0x7f47b419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b4106dc0 0x7f47b4198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 --2- 172.21.15.77:0/1029903550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47b41061b0 0x7f47b4198630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 >> 172.21.15.77:0/1029903550 conn(0x7f47b40770b0 msgr2=0x7f47b40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 shutdown_connections 2024-04-21T10:27:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.588+0000 7f47bbb52640 1 -- 172.21.15.77:0/1029903550 wait complete. 2024-04-21T10:27:52.603 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 85.7 --await' 2024-04-21T10:27:52.603 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 85.7 --await 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 -- 172.21.15.77:0/533354073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754101a40 msgr2=0x7f3754105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 --2- 172.21.15.77:0/533354073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754101a40 0x7f3754105a80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3748009900 tx=0x7f374802bc30 comp rx=0 tx=0).stop 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 -- 172.21.15.77:0/533354073 shutdown_connections 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 --2- 172.21.15.77:0/533354073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754101a40 0x7f3754105a80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 --2- 172.21.15.77:0/533354073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3754106160 0x7f375410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 --2- 172.21.15.77:0/533354073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f3754101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 -- 172.21.15.77:0/533354073 >> 172.21.15.77:0/533354073 conn(0x7f37540771d0 msgr2=0x7f37540775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:52.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 -- 172.21.15.77:0/533354073 shutdown_connections 2024-04-21T10:27:52.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.818+0000 7f3759b52640 1 -- 172.21.15.77:0/533354073 wait complete. 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 Processor -- start 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 -- start start 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f375410e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754106160 0x7f375410e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375410edc0 0x7f375419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37541121e0 con 0x7f3754106160 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3754112060 con 0x7f375410edc0 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.819+0000 7f3759b52640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3754112360 con 0x7f3754101090 2024-04-21T10:27:52.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f375410e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f375410e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:45236/0 (socket says 172.21.15.77:45236) 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754106160 0x7f375410e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 -- 172.21.15.77:0/4093924833 learned_addr learned my addr 172.21.15.77:0/4093924833 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 -- 172.21.15.77:0/4093924833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375410edc0 msgr2=0x7f375419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375410edc0 0x7f375419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 -- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754106160 msgr2=0x7f375410e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754106160 0x7f375410e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f37537fe640 1 -- 172.21.15.77:0/4093924833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375419abd0 con 0x7f3754101090 2024-04-21T10:27:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.820+0000 7f3752ffd640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754106160 0x7f375410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.821+0000 7f37537fe640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f375410e340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f374400e9f0 tx=0x7f374400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.821+0000 7f3750ff9640 1 -- 172.21.15.77:0/4093924833 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374400cd80 con 0x7f3754101090 2024-04-21T10:27:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.821+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375419aec0 con 0x7f3754101090 2024-04-21T10:27:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.821+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375419b430 con 0x7f3754101090 2024-04-21T10:27:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.821+0000 7f3750ff9640 1 -- 172.21.15.77:0/4093924833 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37440108e0 con 0x7f3754101090 2024-04-21T10:27:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.822+0000 7f3750ff9640 1 -- 172.21.15.77:0/4093924833 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374400cd80 con 0x7f3754101090 2024-04-21T10:27:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.824+0000 7f375c826740 1 Processor -- start 2024-04-21T10:27:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 -- start start 2024-04-21T10:27:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27532da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3750ff9640 1 -- 172.21.15.77:0/4093924833 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f3744018780 con 0x7f3754101090 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d2753b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560d274930b0 con 0x560d275329c0 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560d27444680 con 0x560d275332e0 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f375c826740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560d27450c60 con 0x560d2753bec0 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27532da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27532da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60088/0 (socket says 172.21.15.77:60088) 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 -- 172.21.15.77:0/2561252841 learned_addr learned my addr 172.21.15.77:0/2561252841 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:45246/0 (socket says 172.21.15.77:45246) 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f37537fe640 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d2753b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 -- 172.21.15.77:0/2561252841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 msgr2=0x560d2753e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 -- 172.21.15.77:0/2561252841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 msgr2=0x560d2753b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d2753b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 -- 172.21.15.77:0/2561252841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d27275c90 con 0x560d275329c0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.825+0000 7f3753fff640 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27532da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f374c009e20 tx=0x7f374c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb253c67c6afcd48 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f3750ff9640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f373c0a3f20 0x7f373c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f3739ffb640 1 -- 172.21.15.77:0/2561252841 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c004d20 con 0x560d275329c0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f3739ffb640 1 -- 172.21.15.77:0/2561252841 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f374c00ee70 con 0x560d275329c0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f3739ffb640 1 -- 172.21.15.77:0/2561252841 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c018890 con 0x560d275329c0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f3750ff9640 1 -- 172.21.15.77:0/4093924833 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f37440d06f0 con 0x7f3754101090 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f37537fe640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f373c0a3f20 0x7f373c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 -- 172.21.15.77:0/2561252841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 msgr2=0x560d27532da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27532da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f374c009e20 tx=0x7f374c00e720 comp rx=0 tx=0).stop 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f37537fe640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f373c0a3f20 0x7f373c0a63e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37440cdf20 tx=0x7f3744018420 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 -- 172.21.15.77:0/2561252841 shutdown_connections 2024-04-21T10:27:52.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d2753b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 --2- 172.21.15.77:0/2561252841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27532da0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 -- 172.21.15.77:0/2561252841 >> 172.21.15.77:0/2561252841 conn(0x560d2752d0f0 msgr2=0x560d2752d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:52.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.826+0000 7f375c826740 1 -- 172.21.15.77:0/2561252841 shutdown_connections 2024-04-21T10:27:52.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.827+0000 7f375c826740 1 -- 172.21.15.77:0/2561252841 wait complete. 2024-04-21T10:27:52.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.827+0000 7f375c826740 1 -- start start 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.827+0000 7f375c826740 1 Processor -- start 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27538f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d27539480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d275399c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560d27496400 con 0x560d275329c0 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560d27452840 con 0x560d275332e0 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560d2749b720 con 0x560d2753bec0 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d275399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d275399c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:45258/0 (socket says 172.21.15.77:45258) 2024-04-21T10:27:52.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 -- 172.21.15.77:0/3940827209 learned_addr learned my addr 172.21.15.77:0/3940827209 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d27539480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f375c826740 10 client.0 _ll_register_callbacks cb 0x560d274a3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 -- 172.21.15.77:0/3940827209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 msgr2=0x560d27539480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d27539480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 -- 172.21.15.77:0/3940827209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 msgr2=0x560d27538f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27538f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.828+0000 7f3753fff640 1 -- 172.21.15.77:0/3940827209 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d272d6420 con 0x560d2753bec0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d27539480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3753fff640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d275399c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f374c004f80 tx=0x7f374c0059b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f919ff0a4f1f74b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3732ffd640 1 -- 172.21.15.77:0/3940827209 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c0056e0 con 0x560d2753bec0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f374c00ee70 con 0x560d2753bec0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3732ffd640 1 -- 172.21.15.77:0/3940827209 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f374c010430 con 0x560d2753bec0 2024-04-21T10:27:52.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3732ffd640 1 -- 172.21.15.77:0/3940827209 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f374c010630 con 0x560d2753bec0 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f375c826740 10 client.25744 fetch_fsmap learned FSMap version 34 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560d27169580 con 0x560d2753bec0 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.829+0000 7f3732ffd640 1 -- 172.21.15.77:0/3940827209 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f374c00ee70 con 0x560d2753bec0 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f3732ffd640 1 -- 172.21.15.77:0/3940827209 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f374c0189e0 con 0x560d2753bec0 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f375c826740 10 client.25744 fetch_fsmap finished waiting for FSMap version 34 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f375c826740 10 client.25744 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f375c826740 20 client.25744 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f375c826740 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d2754bf60 0x560d2754e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f375c826740 4 client.25744 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d274a4b10 con 0x560d2754bf60 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d2754bf60 0x560d2754e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f3732ffd640 10 client.25744 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.830+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d2754bf60 0x560d2754e420 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ad7ce95b119dd24 server_cookie=787398bcf894a16e in_seq=0 out_seq=0 2024-04-21T10:27:52.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f3732ffd640 1 -- 172.21.15.77:0/3940827209 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560d274a4b10 con 0x560d2754bf60 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f3732ffd640 10 client.25744 handle_command_reply: tid=0 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 client.25744 shutdown 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 msgr2=0x560d275399c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d275399c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f374c004f80 tx=0x7f374c0059b0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 shutdown_connections 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d2754bf60 0x560d2754e420 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d275399c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275332e0 0x560d27539480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 --2- 172.21.15.77:0/3940827209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275329c0 0x560d27538f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f3732ffd640 0 client.25744 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 >> 172.21.15.77:0/3940827209 conn(0x560d2752d0f0 msgr2=0x560d2752ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 shutdown_connections 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 1 -- 172.21.15.77:0/3940827209 wait complete. 2024-04-21T10:27:52.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.831+0000 7f375c826740 20 client.25744 trim_cache size 0 max 16384 2024-04-21T10:27:52.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.858+0000 7f375c826740 1 Processor -- start 2024-04-21T10:27:52.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.858+0000 7f375c826740 1 -- start start 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f375c826740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 0x560d2753b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f375c826740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d275478a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f375c826740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d2753bec0 0x560d27553cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f375c826740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f374000e860 con 0x560d275332e0 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f375c826740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f374000c6b0 con 0x560d2753bec0 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f375c826740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f374000e190 con 0x560d275329c0 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3753fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 0x560d2753b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d275478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d275478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60110/0 (socket says 172.21.15.77:60110) 2024-04-21T10:27:52.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3753fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 0x560d2753b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:45272/0 (socket says 172.21.15.77:45272) 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 -- 172.21.15.77:0/3516115173 learned_addr learned my addr 172.21.15.77:0/3516115173 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3753fff640 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d2753bec0 0x560d27553cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 -- 172.21.15.77:0/3516115173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 msgr2=0x560d2753b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 0x560d2753b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 -- 172.21.15.77:0/3516115173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d2753bec0 msgr2=0x560d27553cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d2753bec0 0x560d27553cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 -- 172.21.15.77:0/3516115173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2753e2b0 con 0x560d275332e0 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3753fff640 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 0x560d2753b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:27:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.859+0000 7f3752ffd640 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d275478a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f375406a3c0 tx=0x7f3748005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fae95447edba2b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.861+0000 7f37397fa640 1 -- 172.21.15.77:0/3516115173 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374802c7e0 con 0x560d275332e0 2024-04-21T10:27:52.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.861+0000 7f37397fa640 1 -- 172.21.15.77:0/3516115173 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f374804d3c0 con 0x560d275332e0 2024-04-21T10:27:52.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.861+0000 7f37397fa640 1 -- 172.21.15.77:0/3516115173 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748003970 con 0x560d275332e0 2024-04-21T10:27:52.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 -- 172.21.15.77:0/3516115173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 msgr2=0x560d275478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:52.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d275478a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f375406a3c0 tx=0x7f3748005850 comp rx=0 tx=0).stop 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 -- 172.21.15.77:0/3516115173 shutdown_connections 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d275478a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d2753bec0 0x560d27553cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 --2- 172.21.15.77:0/3516115173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d275329c0 0x560d2753b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 -- 172.21.15.77:0/3516115173 >> 172.21.15.77:0/3516115173 conn(0x560d2752d0f0 msgr2=0x560d2752edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 -- 172.21.15.77:0/3516115173 shutdown_connections 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.862+0000 7f375c826740 1 -- 172.21.15.77:0/3516115173 wait complete. 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 -- start start 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 Processor -- start 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275329c0 0x560d27544120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d2753f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f374000d3f0 con 0x560d275332e0 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f374000cd20 con 0x560d275329c0 2024-04-21T10:27:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f374000dac0 con 0x560d2753bec0 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f375c826740 10 client.0 _ll_register_callbacks cb 0x7f3744005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d2753f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d2753f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60120/0 (socket says 172.21.15.77:60120) 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f3752ffd640 1 -- 172.21.15.77:0/2925357443 learned_addr learned my addr 172.21.15.77:0/2925357443 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f3753fff640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275329c0 0x560d27544120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.863+0000 7f3753fff640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3752ffd640 1 -- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 msgr2=0x560d2753fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3752ffd640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3752ffd640 1 -- 172.21.15.77:0/2925357443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275329c0 msgr2=0x560d27544120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3752ffd640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275329c0 0x560d27544120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3752ffd640 1 -- 172.21.15.77:0/2925357443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d27540250 con 0x560d275332e0 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3753fff640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:27:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3752ffd640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d2753f4e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f374802c170 tx=0x7f374804d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee2aadd0af634de server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3732ffd640 1 -- 172.21.15.77:0/2925357443 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374805a030 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3732ffd640 1 -- 172.21.15.77:0/2925357443 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f374804d7a0 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f374804d3c0 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3732ffd640 1 -- 172.21.15.77:0/2925357443 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3748064050 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 10 client.16329 fetch_fsmap learned FSMap version 34 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560d275b2510 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3732ffd640 1 -- 172.21.15.77:0/2925357443 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f374804d3c0 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f3732ffd640 1 -- 172.21.15.77:0/2925357443 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f3748003c40 con 0x560d275332e0 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 10 client.16329 fetch_fsmap finished waiting for FSMap version 34 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 10 client.16329 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 20 client.16329 populate_metadata read hostname 'smithi077' 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d275b2d10 0x560d275b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:27:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 4 client.16329 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.7, "await": true}] 2024-04-21T10:27:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.864+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.7, "await": true}) -- 0x560d2749e980 con 0x560d275b2d10 2024-04-21T10:27:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.865+0000 7f3753fff640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d275b2d10 0x560d275b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:27:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.866+0000 7f3732ffd640 10 client.16329 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:52.866+0000 7f3753fff640 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d275b2d10 0x560d275b5130 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9921d00e917b76c server_cookie=60852ecc8d73d7dd in_seq=0 out_seq=0 2024-04-21T10:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:52 smithi077 ceph-mon[27902]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:52 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:52 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:52 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1029903550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:27:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:52 smithi191 ceph-mon[31636]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:27:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:52 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:27:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:52 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:52 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1029903550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:27:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:52 smithi170 ceph-mon[31212]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:27:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:52 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:27:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:52 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:52 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1029903550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:27:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.145+0000 7f3732ffd640 1 -- 172.21.15.77:0/2925357443 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560d2749e980 con 0x560d275b2d10 2024-04-21T10:27:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.145+0000 7f3732ffd640 10 client.16329 handle_command_reply: tid=0 2024-04-21T10:27:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 client.16329 shutdown 2024-04-21T10:27:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 msgr2=0x560d2753f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d2753f4e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f374802c170 tx=0x7f374804d570 comp rx=0 tx=0).stop 2024-04-21T10:27:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 shutdown_connections 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560d275b2d10 0x560d275b5130 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d275332e0 0x560d2753f4e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d2753bec0 0x560d2753fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3732ffd640 0 client.16329 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 --2- 172.21.15.77:0/2925357443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d275329c0 0x560d27544120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 >> 172.21.15.77:0/2925357443 conn(0x560d2752d0f0 msgr2=0x560d2752b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 shutdown_connections 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 1 -- 172.21.15.77:0/2925357443 wait complete. 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f375c826740 20 client.16329 trim_cache size 0 max 16384 2024-04-21T10:27:53.147 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 34, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 22, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "8296d858": { 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 22, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 85.7, 2024-04-21T10:27:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:27:53.149 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f373c0a3f20 msgr2=0x7f373c0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3759b52640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f373c0a3f20 0x7f373c0a63e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37440cdf20 tx=0x7f3744018420 comp rx=0 tx=0).stop 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 msgr2=0x7f375410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3759b52640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f375410e340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f374400e9f0 tx=0x7f374400eeb0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 shutdown_connections 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.146+0000 7f3759b52640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f373c0a3f20 0x7f373c0a63e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.147+0000 7f3759b52640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3754106160 0x7f375410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.147+0000 7f3759b52640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375410edc0 0x7f375419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.147+0000 7f3759b52640 1 --2- 172.21.15.77:0/4093924833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3754101090 0x7f375410e340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:27:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.147+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 >> 172.21.15.77:0/4093924833 conn(0x7f37540771d0 msgr2=0x7f37540fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:27:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.147+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 shutdown_connections 2024-04-21T10:27:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:27:53.147+0000 7f3759b52640 1 -- 172.21.15.77:0/4093924833 wait complete. 2024-04-21T10:27:53.157 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 8296d858, quiesce duration: 25.7 2024-04-21T10:27:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:53 smithi191 ceph-mon[31636]: pgmap v197: 97 pgs: 97 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.2 MiB/s wr, 750 op/s 2024-04-21T10:27:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:53 smithi170 ceph-mon[31212]: pgmap v197: 97 pgs: 97 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.2 MiB/s wr, 750 op/s 2024-04-21T10:27:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:53 smithi077 ceph-mon[27902]: pgmap v197: 97 pgs: 97 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.2 MiB/s wr, 750 op/s 2024-04-21T10:27:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:54 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:27:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:54 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:54 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:27:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:54 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 370.0 s, 1838.7 tps, lat 30.094 ms stddev 32.270 2024-04-21T10:27:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:54 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:27:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:54 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:55 smithi191 ceph-mon[31636]: pgmap v198: 97 pgs: 97 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 583 op/s 2024-04-21T10:27:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:55 smithi191 ceph-mon[31636]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-04-21T10:27:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:55 smithi170 ceph-mon[31212]: pgmap v198: 97 pgs: 97 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 583 op/s 2024-04-21T10:27:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:55 smithi170 ceph-mon[31212]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-04-21T10:27:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:55 smithi077 ceph-mon[27902]: pgmap v198: 97 pgs: 97 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 583 op/s 2024-04-21T10:27:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:55 smithi077 ceph-mon[27902]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-04-21T10:27:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:56 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:27:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:56 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:56 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:27:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:56 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:56 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:27:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:56 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:57 smithi191 ceph-mon[31636]: pgmap v199: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 7.8 MiB/s wr, 763 op/s 2024-04-21T10:27:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:57 smithi191 ceph-mon[31636]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-04-21T10:27:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:57 smithi170 ceph-mon[31212]: pgmap v199: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 7.8 MiB/s wr, 763 op/s 2024-04-21T10:27:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:57 smithi170 ceph-mon[31212]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-04-21T10:27:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:57 smithi077 ceph-mon[27902]: pgmap v199: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 7.8 MiB/s wr, 763 op/s 2024-04-21T10:27:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:57 smithi077 ceph-mon[27902]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-04-21T10:27:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:58 smithi191 ceph-mon[31636]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-04-21T10:27:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:58 smithi191 ceph-mon[31636]: Cluster is now healthy 2024-04-21T10:27:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:58 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:27:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:58 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:58 smithi170 ceph-mon[31212]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-04-21T10:27:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:58 smithi170 ceph-mon[31212]: Cluster is now healthy 2024-04-21T10:27:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:58 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:27:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:58 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:58 smithi077 ceph-mon[27902]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-04-21T10:27:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:58 smithi077 ceph-mon[27902]: Cluster is now healthy 2024-04-21T10:27:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:58 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:27:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:58 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:27:59.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:27:59 smithi170 ceph-mon[31212]: pgmap v200: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.7 MiB/s wr, 465 op/s 2024-04-21T10:27:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:27:59 smithi191 ceph-mon[31636]: pgmap v200: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.7 MiB/s wr, 465 op/s 2024-04-21T10:28:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:27:59 smithi077 ceph-mon[27902]: pgmap v200: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.7 MiB/s wr, 465 op/s 2024-04-21T10:28:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 -- 172.21.15.77:0/1945443879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac501021b0 msgr2=0x7fac50102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 --2- 172.21.15.77:0/1945443879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac501021b0 0x7fac50102590 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fac40009900 tx=0x7fac4002bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 -- 172.21.15.77:0/1945443879 shutdown_connections 2024-04-21T10:28:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 --2- 172.21.15.77:0/1945443879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 0x7fac5010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 --2- 172.21.15.77:0/1945443879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac50102b60 0x7fac50106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 --2- 172.21.15.77:0/1945443879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac501021b0 0x7fac50102590 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 -- 172.21.15.77:0/1945443879 >> 172.21.15.77:0/1945443879 conn(0x7fac500fda10 msgr2=0x7fac500ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 -- 172.21.15.77:0/1945443879 shutdown_connections 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 -- 172.21.15.77:0/1945443879 wait complete. 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 Processor -- start 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.833+0000 7fac569f4640 1 -- start start 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac501021b0 0x7fac50198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 0x7fac50198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 0x7fac5019d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac501121e0 con 0x7fac5019cff0 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac50112060 con 0x7fac50107280 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac50112360 con 0x7fac501021b0 2024-04-21T10:28:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 0x7fac5019d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 0x7fac5019d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51488/0 (socket says 172.21.15.77:51488) 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 -- 172.21.15.77:0/1010430372 learned_addr learned my addr 172.21.15.77:0/1010430372 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 0x7fac50198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4ffff640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac501021b0 0x7fac50198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 -- 172.21.15.77:0/1010430372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac501021b0 msgr2=0x7fac50198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac501021b0 0x7fac50198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 -- 172.21.15.77:0/1010430372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 msgr2=0x7fac50198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 0x7fac50198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 -- 172.21.15.77:0/1010430372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5019dae0 con 0x7fac5019cff0 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 0x7fac50198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4ffff640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac501021b0 0x7fac50198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac54f91640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 0x7fac5019d4a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fac4800eaa0 tx=0x7fac4800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4d7fa640 1 -- 172.21.15.77:0/1010430372 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4800cdb0 con 0x7fac5019cff0 2024-04-21T10:28:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5019ddd0 con 0x7fac5019cff0 2024-04-21T10:28:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4d7fa640 1 -- 172.21.15.77:0/1010430372 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac48005020 con 0x7fac5019cff0 2024-04-21T10:28:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac4d7fa640 1 -- 172.21.15.77:0/1010430372 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480116d0 con 0x7fac5019cff0 2024-04-21T10:28:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.834+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac501a55c0 con 0x7fac5019cff0 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4d7fa640 1 -- 172.21.15.77:0/1010430372 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fac480051d0 con 0x7fac5019cff0 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 Processor -- start 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 -- start start 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 0x560648997620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4d7fa640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fac380a3dc0 0x7fac380a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x560648997fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489a54f0 0x5606489a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5606488fc8d0 con 0x5606489988d0 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560648899e80 con 0x5606489a54f0 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac595eb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5606488f8890 con 0x560648997b60 2024-04-21T10:28:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 0x560648997620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4ffff640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fac380a3dc0 0x7fac380a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 0x560648997620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51490/0 (socket says 172.21.15.77:51490) 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4f7fe640 1 -- 172.21.15.77:0/501297097 learned_addr learned my addr 172.21.15.77:0/501297097 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac4d7fa640 1 -- 172.21.15.77:0/1010430372 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fac480d0a20 con 0x7fac5019cff0 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.837+0000 7fac54f91640 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489a54f0 0x5606489a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x560648997fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 -- 172.21.15.77:0/501297097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 msgr2=0x560648997fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x560648997fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 -- 172.21.15.77:0/501297097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489a54f0 msgr2=0x5606489a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489a54f0 0x5606489a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 -- 172.21.15.77:0/501297097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606488bb320 con 0x5606489988d0 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac54f91640 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489a54f0 0x5606489a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4ffff640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fac380a3dc0 0x7fac380a6280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac40036040 tx=0x7fac40000bc0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 0x560648997620 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fac44013560 tx=0x7fac4400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628fbc878b078303 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac367fc640 1 -- 172.21.15.77:0/501297097 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44019030 con 0x5606489988d0 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac367fc640 1 -- 172.21.15.77:0/501297097 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac440054d0 con 0x5606489988d0 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.838+0000 7fac367fc640 1 -- 172.21.15.77:0/501297097 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44011720 con 0x5606489988d0 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 -- 172.21.15.77:0/501297097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 msgr2=0x560648997620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 0x560648997620 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fac44013560 tx=0x7fac4400b6f0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 -- 172.21.15.77:0/501297097 shutdown_connections 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489a54f0 0x5606489a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x560648997fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 --2- 172.21.15.77:0/501297097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489988d0 0x560648997620 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 -- 172.21.15.77:0/501297097 >> 172.21.15.77:0/501297097 conn(0x56064895ec90 msgr2=0x560648992850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 -- 172.21.15.77:0/501297097 shutdown_connections 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 -- 172.21.15.77:0/501297097 wait complete. 2024-04-21T10:28:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 -- start start 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.839+0000 7fac595eb740 1 Processor -- start 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5606489a8220 con 0x5606489a54f0 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560648884eb0 con 0x560648997b60 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5606489a83a0 con 0x5606489988d0 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 10 client.0 _ll_register_callbacks cb 0x5606488b1b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51498/0 (socket says 172.21.15.77:51498) 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 -- 172.21.15.77:0/351667313 learned_addr learned my addr 172.21.15.77:0/351667313 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac4ffff640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 -- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 msgr2=0x5606489a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 -- 172.21.15.77:0/351667313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 msgr2=0x5606489a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 -- 172.21.15.77:0/351667313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064860f210 con 0x5606489a54f0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac4ffff640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac54f91640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a2790 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fac4800cfd0 tx=0x7fac48098d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76de217987589bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac2f7fe640 1 -- 172.21.15.77:0/351667313 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4801f040 con 0x5606489a54f0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac2f7fe640 1 -- 172.21.15.77:0/351667313 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fac480054f0 con 0x5606489a54f0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.840+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac440054d0 con 0x5606489a54f0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac2f7fe640 1 -- 172.21.15.77:0/351667313 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fac4809dd20 con 0x5606489a54f0 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 10 client.16341 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5606486db620 con 0x5606489a54f0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac2f7fe640 1 -- 172.21.15.77:0/351667313 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac440054d0 con 0x5606489a54f0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac2f7fe640 1 -- 172.21.15.77:0/351667313 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7fac4800f040 con 0x5606489a54f0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 10 client.16341 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 20 client.16341 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5606489b54e0 0x5606489b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 4 client.16341 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560648910880 con 0x5606489b54e0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.841+0000 7fac4ffff640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5606489b54e0 0x5606489b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.842+0000 7fac4ffff640 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5606489b54e0 0x5606489b78d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e23ff8a622be8c32 server_cookie=eb3f254b5059ec1e in_seq=0 out_seq=0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.842+0000 7fac2f7fe640 10 client.16341 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.842+0000 7fac2f7fe640 1 -- 172.21.15.77:0/351667313 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560648910880 con 0x5606489b54e0 2024-04-21T10:28:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.842+0000 7fac2f7fe640 10 client.16341 handle_command_reply: tid=0 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.842+0000 7fac595eb740 1 client.16341 shutdown 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 msgr2=0x5606489a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a2790 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fac4800cfd0 tx=0x7fac48098d80 comp rx=0 tx=0).stop 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 shutdown_connections 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5606489b54e0 0x5606489b78d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a2790 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac2f7fe640 0 client.16341 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 --2- 172.21.15.77:0/351667313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 >> 172.21.15.77:0/351667313 conn(0x56064895ec90 msgr2=0x5606489945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 shutdown_connections 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 1 -- 172.21.15.77:0/351667313 wait complete. 2024-04-21T10:28:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.843+0000 7fac595eb740 20 client.16341 trim_cache size 0 max 16384 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 Processor -- start 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 -- start start 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x5606489b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489988d0 0x5606489a4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac501ae250 con 0x5606489a54f0 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac501abac0 con 0x5606489988d0 2024-04-21T10:28:01.862 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac595eb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac501a9910 con 0x560648997b60 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51510/0 (socket says 172.21.15.77:51510) 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 -- 172.21.15.77:0/2218711508 learned_addr learned my addr 172.21.15.77:0/2218711508 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489988d0 0x5606489a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 -- 172.21.15.77:0/2218711508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 msgr2=0x5606489b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x5606489b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 -- 172.21.15.77:0/2218711508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489988d0 msgr2=0x5606489a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489988d0 0x5606489a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 -- 172.21.15.77:0/2218711508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56064898df30 con 0x5606489a54f0 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489988d0 0x5606489a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac54f91640 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a4e80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fac480ce250 tx=0x7fac48005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3086341ab51e40 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac35ffb640 1 -- 172.21.15.77:0/2218711508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4801f030 con 0x5606489a54f0 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac35ffb640 1 -- 172.21.15.77:0/2218711508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac480a0da0 con 0x5606489a54f0 2024-04-21T10:28:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.858+0000 7fac35ffb640 1 -- 172.21.15.77:0/2218711508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4809be40 con 0x5606489a54f0 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 -- 172.21.15.77:0/2218711508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 msgr2=0x5606489a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a4e80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fac480ce250 tx=0x7fac48005890 comp rx=0 tx=0).stop 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 -- 172.21.15.77:0/2218711508 shutdown_connections 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x5606489a4e80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606489988d0 0x5606489a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 --2- 172.21.15.77:0/2218711508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560648997b60 0x5606489b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 -- 172.21.15.77:0/2218711508 >> 172.21.15.77:0/2218711508 conn(0x56064895ec90 msgr2=0x56064899d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 -- 172.21.15.77:0/2218711508 shutdown_connections 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 -- 172.21.15.77:0/2218711508 wait complete. 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.859+0000 7fac595eb740 1 -- start start 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 Processor -- start 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x56064899e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac501a9f80 con 0x5606489a54f0 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac501ab3f0 con 0x560648997b60 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac501aa650 con 0x5606489988d0 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac595eb740 10 client.0 _ll_register_callbacks cb 0x7fac4809d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x56064899e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x56064899e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51518/0 (socket says 172.21.15.77:51518) 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 -- 172.21.15.77:0/653081603 learned_addr learned my addr 172.21.15.77:0/653081603 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac4f7fe640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac4ffff640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 -- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 msgr2=0x5606489adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 -- 172.21.15.77:0/653081603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 msgr2=0x5606489ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 -- 172.21.15.77:0/653081603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064899eea0 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac54f91640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x56064899e6a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac480a5130 tx=0x7fac48005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3295d46b4b3b49d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac2f7fe640 1 -- 172.21.15.77:0/653081603 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480b7070 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.860+0000 7fac2f7fe640 1 -- 172.21.15.77:0/653081603 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fac480870b0 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac480a0da0 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac2f7fe640 1 -- 172.21.15.77:0/653081603 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fac48066050 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 10 client.16347 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560648a1b4b0 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac2f7fe640 1 -- 172.21.15.77:0/653081603 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac480a0da0 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac2f7fe640 1 -- 172.21.15.77:0/653081603 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7fac480ba030 con 0x5606489a54f0 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 10 client.16347 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 10 client.16347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 20 client.16347 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560648a1b960 0x560648a1dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 4 client.16347 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:28:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56064889c3d0 con 0x560648a1b960 2024-04-21T10:28:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.861+0000 7fac4ffff640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560648a1b960 0x560648a1dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.862+0000 7fac4ffff640 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560648a1b960 0x560648a1dd80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0da26d660f2122a server_cookie=a3e525282242eade in_seq=0 out_seq=0 2024-04-21T10:28:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.862+0000 7fac2f7fe640 10 client.16347 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.877+0000 7fac2f7fe640 1 -- 172.21.15.77:0/653081603 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56064889c3d0 con 0x560648a1b960 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.877+0000 7fac2f7fe640 10 client.16347 handle_command_reply: tid=0 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.877+0000 7fac595eb740 1 client.16347 shutdown 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 msgr2=0x56064899e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x56064899e6a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac480a5130 tx=0x7fac48005780 comp rx=0 tx=0).stop 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 shutdown_connections 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x560648a1b960 0x560648a1dd80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606489a54f0 0x56064899e6a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606489988d0 0x5606489adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac2f7fe640 0 client.16347 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 --2- 172.21.15.77:0/653081603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560648997b60 0x5606489ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 >> 172.21.15.77:0/653081603 conn(0x56064895ec90 msgr2=0x5606489a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 shutdown_connections 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 1 -- 172.21.15.77:0/653081603 wait complete. 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac595eb740 20 client.16347 trim_cache size 0 max 16384 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:28:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:28:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fac380a3dc0 msgr2=0x7fac380a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac569f4640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fac380a3dc0 0x7fac380a6280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac40036040 tx=0x7fac40000bc0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 msgr2=0x7fac5019d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.878+0000 7fac569f4640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 0x7fac5019d4a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fac4800eaa0 tx=0x7fac4800ef60 comp rx=0 tx=0).stop 2024-04-21T10:28:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 shutdown_connections 2024-04-21T10:28:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fac380a3dc0 0x7fac380a6280 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac5019cff0 0x7fac5019d4a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac50107280 0x7fac50198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 --2- 172.21.15.77:0/1010430372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac501021b0 0x7fac50198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 >> 172.21.15.77:0/1010430372 conn(0x7fac500fda10 msgr2=0x7fac500fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 shutdown_connections 2024-04-21T10:28:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:01.879+0000 7fac569f4640 1 -- 172.21.15.77:0/1010430372 wait complete. 2024-04-21T10:28:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:01 smithi191 ceph-mon[31636]: pgmap v201: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 9.6 MiB/s wr, 672 op/s 2024-04-21T10:28:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:01 smithi170 ceph-mon[31212]: pgmap v201: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 9.6 MiB/s wr, 672 op/s 2024-04-21T10:28:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:01 smithi077 ceph-mon[27902]: pgmap v201: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 9.6 MiB/s wr, 672 op/s 2024-04-21T10:28:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:03 smithi170 ceph-mon[31212]: pgmap v202: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 11 MiB/s wr, 644 op/s 2024-04-21T10:28:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:03 smithi077 ceph-mon[27902]: pgmap v202: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 11 MiB/s wr, 644 op/s 2024-04-21T10:28:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:03 smithi191 ceph-mon[31636]: pgmap v202: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 11 MiB/s wr, 644 op/s 2024-04-21T10:28:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:04 smithi170 ceph-mon[31212]: osdmap e89: 12 total, 12 up, 12 in 2024-04-21T10:28:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:04 smithi077 ceph-mon[27902]: osdmap e89: 12 total, 12 up, 12 in 2024-04-21T10:28:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:04 smithi191 ceph-mon[31636]: osdmap e89: 12 total, 12 up, 12 in 2024-04-21T10:28:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:05 smithi170 ceph-mon[31212]: pgmap v204: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 11 MiB/s wr, 582 op/s 2024-04-21T10:28:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:05 smithi077 ceph-mon[27902]: pgmap v204: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 11 MiB/s wr, 582 op/s 2024-04-21T10:28:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:05 smithi191 ceph-mon[31636]: pgmap v204: 97 pgs: 97 active+clean; 3.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 11 MiB/s wr, 582 op/s 2024-04-21T10:28:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:07 smithi170 ceph-mon[31212]: pgmap v205: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.7 MiB/s wr, 377 op/s 2024-04-21T10:28:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:07 smithi077 ceph-mon[27902]: pgmap v205: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.7 MiB/s wr, 377 op/s 2024-04-21T10:28:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:07 smithi191 ceph-mon[31636]: pgmap v205: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.7 MiB/s wr, 377 op/s 2024-04-21T10:28:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:09 smithi170 ceph-mon[31212]: pgmap v206: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.7 MiB/s wr, 377 op/s 2024-04-21T10:28:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:09 smithi077 ceph-mon[27902]: pgmap v206: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.7 MiB/s wr, 377 op/s 2024-04-21T10:28:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:09 smithi191 ceph-mon[31636]: pgmap v206: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.7 MiB/s wr, 377 op/s 2024-04-21T10:28:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:11 smithi170 ceph-mon[31212]: pgmap v207: 97 pgs: 97 active+clean; 3.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 420 op/s 2024-04-21T10:28:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:11 smithi170 ceph-mon[31212]: osdmap e90: 12 total, 12 up, 12 in 2024-04-21T10:28:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:11 smithi077 ceph-mon[27902]: pgmap v207: 97 pgs: 97 active+clean; 3.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 420 op/s 2024-04-21T10:28:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:11 smithi077 ceph-mon[27902]: osdmap e90: 12 total, 12 up, 12 in 2024-04-21T10:28:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:11 smithi191 ceph-mon[31636]: pgmap v207: 97 pgs: 97 active+clean; 3.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 420 op/s 2024-04-21T10:28:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:11 smithi191 ceph-mon[31636]: osdmap e90: 12 total, 12 up, 12 in 2024-04-21T10:28:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:13 smithi170 ceph-mon[31212]: pgmap v209: 97 pgs: 97 active+clean; 3.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 21 MiB/s wr, 590 op/s 2024-04-21T10:28:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:13 smithi077 ceph-mon[27902]: pgmap v209: 97 pgs: 97 active+clean; 3.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 21 MiB/s wr, 590 op/s 2024-04-21T10:28:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:13 smithi191 ceph-mon[31636]: pgmap v209: 97 pgs: 97 active+clean; 3.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 21 MiB/s wr, 590 op/s 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 -- 172.21.15.77:0/1882892418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 msgr2=0x7f0fa81084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 --2- 172.21.15.77:0/1882892418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa81084c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009900 tx=0x7f0f9802bcd0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 -- 172.21.15.77:0/1882892418 shutdown_connections 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 --2- 172.21.15.77:0/1882892418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa806b120 0x7f0fa810edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 --2- 172.21.15.77:0/1882892418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fa806a780 0x7f0fa806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 --2- 172.21.15.77:0/1882892418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa81084c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 -- 172.21.15.77:0/1882892418 >> 172.21.15.77:0/1882892418 conn(0x7f0fa8076c50 msgr2=0x7f0fa8077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 -- 172.21.15.77:0/1882892418 shutdown_connections 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.974+0000 7f0fac95f640 1 -- 172.21.15.77:0/1882892418 wait complete. 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 Processor -- start 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 -- start start 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa806a780 0x7f0fa81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fa806b120 0x7f0fa8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81121b0 con 0x7f0fa81080e0 2024-04-21T10:28:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.975+0000 7f0fac95f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8112030 con 0x7f0fa806b120 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fac95f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8112330 con 0x7f0fa806a780 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40706/0 (socket says 172.21.15.77:40706) 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/4060184639 learned_addr learned my addr 172.21.15.77:0/4060184639 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa659c640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa806a780 0x7f0fa81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fa806b120 0x7f0fa8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/4060184639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa806a780 msgr2=0x7f0fa81985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa806a780 0x7f0fa81985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/4060184639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fa806b120 msgr2=0x7f0fa8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fa806b120 0x7f0fa8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/4060184639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa819d590 con 0x7f0fa81080e0 2024-04-21T10:28:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa819ce60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000eaa0 tx=0x7f0fa000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0f9f7fe640 1 -- 172.21.15.77:0/4060184639 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000cdb0 con 0x7f0fa81080e0 2024-04-21T10:28:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0f9f7fe640 1 -- 172.21.15.77:0/4060184639 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fa0005020 con 0x7f0fa81080e0 2024-04-21T10:28:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa819d880 con 0x7f0fa81080e0 2024-04-21T10:28:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0f9f7fe640 1 -- 172.21.15.77:0/4060184639 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00116d0 con 0x7f0fa81080e0 2024-04-21T10:28:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.976+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa81a5110 con 0x7f0fa81080e0 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0f9f7fe640 1 -- 172.21.15.77:0/4060184639 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f0fa00051d0 con 0x7f0fa81080e0 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 Processor -- start 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 -- start start 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0f9f7fe640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0f940a3e40 0x7f0f940a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00d80e0 0x557dc00da4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557dc00338d0 con 0x557dc00cf8d0 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557dbffd0e80 con 0x557dc00ceb60 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.979+0000 7f0faf62a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557dc002f890 con 0x557dc00d80e0 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0f940a3e40 0x7f0f940a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9f7fe640 1 -- 172.21.15.77:0/4060184639 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f0fa00d09b0 con 0x7f0fa81080e0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40718/0 (socket says 172.21.15.77:40718) 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 -- 172.21.15.77:0/632830183 learned_addr learned my addr 172.21.15.77:0/632830183 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00d80e0 0x557dc00da4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 -- 172.21.15.77:0/632830183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00d80e0 msgr2=0x557dc00da4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00d80e0 0x557dc00da4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 -- 172.21.15.77:0/632830183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 msgr2=0x557dc00cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 -- 172.21.15.77:0/632830183 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dbfff2320 con 0x557dc00cf8d0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0f940a3e40 0x7f0f940a6300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8107660 tx=0x7f0f9000bbb0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0fa659c640 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00ce620 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009900 tx=0x7f0f98005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acb7ac19ea381b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9cff9640 1 -- 172.21.15.77:0/632830183 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004240 con 0x557dc00cf8d0 2024-04-21T10:28:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9cff9640 1 -- 172.21.15.77:0/632830183 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980043e0 con 0x557dc00cf8d0 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.980+0000 7f0f9cff9640 1 -- 172.21.15.77:0/632830183 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980046c0 con 0x557dc00cf8d0 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 -- 172.21.15.77:0/632830183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 msgr2=0x557dc00ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00ce620 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009900 tx=0x7f0f98005e70 comp rx=0 tx=0).stop 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 -- 172.21.15.77:0/632830183 shutdown_connections 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00d80e0 0x557dc00da4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 --2- 172.21.15.77:0/632830183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00ce620 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 -- 172.21.15.77:0/632830183 >> 172.21.15.77:0/632830183 conn(0x557dc0095c90 msgr2=0x557dc00c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 -- 172.21.15.77:0/632830183 shutdown_connections 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.981+0000 7f0faf62a740 1 -- 172.21.15.77:0/632830183 wait complete. 2024-04-21T10:28:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 -- start start 2024-04-21T10:28:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 Processor -- start 2024-04-21T10:28:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 0x557dc00d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557dc00df1c0 con 0x557dc00d80e0 2024-04-21T10:28:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557dbffbbeb0 con 0x557dc00ceb60 2024-04-21T10:28:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557dc00df340 con 0x557dc00cf8d0 2024-04-21T10:28:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0faf62a740 10 client.0 _ll_register_callbacks cb 0x557dbffe8b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 0x557dc00d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 0x557dc00d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40732/0 (socket says 172.21.15.77:40732) 2024-04-21T10:28:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/1164860050 learned_addr learned my addr 172.21.15.77:0/1164860050 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 msgr2=0x557dc00d4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/1164860050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 msgr2=0x557dc00d79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00d79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 -- 172.21.15.77:0/1164860050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dbfd46210 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00d79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 0x557dc00d52c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0fa009c8e0 tx=0x7f0fa009d190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d0611ba5ee820b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.982+0000 7f0f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0f8dffb640 1 -- 172.21.15.77:0/1164860050 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa001f040 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0f8dffb640 1 -- 172.21.15.77:0/1164860050 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f0fa0087070 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f980043e0 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0f8dffb640 1 -- 172.21.15.77:0/1164860050 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0fa00a55c0 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 10 client.16359 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557dbfe12620 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0f8dffb640 1 -- 172.21.15.77:0/1164860050 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980043e0 con 0x557dc00d80e0 2024-04-21T10:28:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0f8dffb640 1 -- 172.21.15.77:0/1164860050 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7f0fa000f040 con 0x557dc00d80e0 2024-04-21T10:28:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 10 client.16359 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 20 client.16359 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc00ec4b0 0x557dc00ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 4 client.16359 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.983+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dc0047880 con 0x557dc00ec4b0 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.984+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc00ec4b0 0x557dc00ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.984+0000 7f0f8dffb640 10 client.16359 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.984+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc00ec4b0 0x557dc00ee8e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ac80dab1cd31333 server_cookie=b0811d1597372af4 in_seq=0 out_seq=0 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0f8dffb640 1 -- 172.21.15.77:0/1164860050 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557dc0047880 con 0x557dc00ec4b0 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0f8dffb640 10 client.16359 handle_command_reply: tid=0 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 client.16359 shutdown 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 msgr2=0x557dc00d52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 0x557dc00d52c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0fa009c8e0 tx=0x7f0fa009d190 comp rx=0 tx=0).stop 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 shutdown_connections 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc00ec4b0 0x557dc00ee8e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00d80e0 0x557dc00d52c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0f8dffb640 0 client.16359 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:14.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1164860050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00ceb60 0x557dc00d79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:14.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 >> 172.21.15.77:0/1164860050 conn(0x557dc0095c90 msgr2=0x557dc00cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:14.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 shutdown_connections 2024-04-21T10:28:14.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 1 -- 172.21.15.77:0/1164860050 wait complete. 2024-04-21T10:28:14.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.985+0000 7f0faf62a740 20 client.16359 trim_cache size 0 max 16384 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.999+0000 7f0faf62a740 1 Processor -- start 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:14.999+0000 7f0faf62a740 1 -- start start 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 0x557dc00e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0faf62a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81ae190 con 0x557dc00ceb60 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0faf62a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81aba00 con 0x557dc00d80e0 2024-04-21T10:28:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0faf62a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81a9870 con 0x557dc00cf8d0 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 0x557dc00e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 0x557dc00e80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40746/0 (socket says 172.21.15.77:40746) 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 -- 172.21.15.77:0/1844131359 learned_addr learned my addr 172.21.15.77:0/1844131359 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 -- 172.21.15.77:0/1844131359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 msgr2=0x557dc00d74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 -- 172.21.15.77:0/1844131359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 msgr2=0x557dc00d79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 -- 172.21.15.77:0/1844131359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc00cde30 con 0x557dc00ceb60 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0fa659c640 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 0x557dc00e80c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0f9802cbe0 tx=0x7f0f9802cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9b1aa62d7ab0b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0f8ffff640 1 -- 172.21.15.77:0/1844131359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98053080 con 0x557dc00ceb60 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0f8ffff640 1 -- 172.21.15.77:0/1844131359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980536d0 con 0x557dc00ceb60 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.000+0000 7f0f8ffff640 1 -- 172.21.15.77:0/1844131359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98034840 con 0x557dc00ceb60 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 -- 172.21.15.77:0/1844131359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 msgr2=0x557dc00e80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 0x557dc00e80c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0f9802cbe0 tx=0x7f0f9802cc10 comp rx=0 tx=0).stop 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 -- 172.21.15.77:0/1844131359 shutdown_connections 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00d79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00cf8d0 0x557dc00d74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 --2- 172.21.15.77:0/1844131359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00ceb60 0x557dc00e80c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 -- 172.21.15.77:0/1844131359 >> 172.21.15.77:0/1844131359 conn(0x557dc0095c90 msgr2=0x557dc00d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 -- 172.21.15.77:0/1844131359 shutdown_connections 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 -- 172.21.15.77:0/1844131359 wait complete. 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 -- start start 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.001+0000 7f0faf62a740 1 Processor -- start 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00ceb60 0x557dc00e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00e0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81a9ec0 con 0x557dc00cf8d0 2024-04-21T10:28:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81ab330 con 0x557dc00d80e0 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81aa590 con 0x557dc00ceb60 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 10 client.0 _ll_register_callbacks cb 0x7f0fa000cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00e0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40756/0 (socket says 172.21.15.77:40756) 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 -- 172.21.15.77:0/902680852 learned_addr learned my addr 172.21.15.77:0/902680852 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0fa659c640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00ceb60 0x557dc00e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 -- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00ceb60 msgr2=0x557dc00e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00ceb60 0x557dc00e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 -- 172.21.15.77:0/902680852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 msgr2=0x557dc00e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 -- 172.21.15.77:0/902680852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc0151b30 con 0x557dc00cf8d0 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0fa659c640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00ceb60 0x557dc00e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0fa6d9d640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f9ffff640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00e0600 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005fd0 tx=0x7f0f900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0b7a6ffaf912cb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f8dffb640 1 -- 172.21.15.77:0/902680852 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90022b00 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f980536d0 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.002+0000 7f0f8dffb640 1 -- 172.21.15.77:0/902680852 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f0f90022ca0 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0f8dffb640 1 -- 172.21.15.77:0/902680852 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0f9002b440 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 10 client.16365 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557dc0152ec0 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0f8dffb640 1 -- 172.21.15.77:0/902680852 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980536d0 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0f8dffb640 1 -- 172.21.15.77:0/902680852 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7f0f90029070 con 0x557dc00cf8d0 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 10 client.16365 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 20 client.16365 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc01536d0 0x557dc0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 4 client.16365 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:28:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557dbffd33d0 con 0x557dc01536d0 2024-04-21T10:28:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.003+0000 7f0fa659c640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc01536d0 0x557dc0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.004+0000 7f0f8dffb640 10 client.16365 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.004+0000 7f0fa659c640 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc01536d0 0x557dc0155af0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c1ab69a8b2b9fb4 server_cookie=ff97695a5cb19bf8 in_seq=0 out_seq=0 2024-04-21T10:28:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0f8dffb640 1 -- 172.21.15.77:0/902680852 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557dbffd33d0 con 0x557dc01536d0 2024-04-21T10:28:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0f8dffb640 10 client.16365 handle_command_reply: tid=0 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 client.16365 shutdown 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 msgr2=0x557dc00e0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00e0600 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005fd0 tx=0x7f0f900046c0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 shutdown_connections 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x557dc01536d0 0x557dc0155af0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dc00cf8d0 0x557dc00e0600 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0f8dffb640 0 client.16365 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557dc00d80e0 0x557dc00e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 --2- 172.21.15.77:0/902680852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557dc00ceb60 0x557dc00e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 >> 172.21.15.77:0/902680852 conn(0x557dc0095c90 msgr2=0x557dc00c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 shutdown_connections 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 1 -- 172.21.15.77:0/902680852 wait complete. 2024-04-21T10:28:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.015+0000 7f0faf62a740 20 client.16365 trim_cache size 0 max 16384 2024-04-21T10:28:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:28:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:28:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:28:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0f940a3e40 msgr2=0x7f0f940a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0f940a3e40 0x7f0f940a6300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8107660 tx=0x7f0f9000bbb0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 msgr2=0x7f0fa819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa819ce60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000eaa0 tx=0x7f0fa000ef60 comp rx=0 tx=0).stop 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 shutdown_connections 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0f940a3e40 0x7f0f940a6300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa81080e0 0x7f0fa819ce60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fa806b120 0x7f0fa8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 --2- 172.21.15.77:0/4060184639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa806a780 0x7f0fa81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 >> 172.21.15.77:0/4060184639 conn(0x7f0fa8076c50 msgr2=0x7f0fa80ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 shutdown_connections 2024-04-21T10:28:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:15.016+0000 7f0fac95f640 1 -- 172.21.15.77:0/4060184639 wait complete. 2024-04-21T10:28:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:15 smithi170 ceph-mon[31212]: pgmap v210: 97 pgs: 97 active+clean; 3.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 501 op/s 2024-04-21T10:28:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:15 smithi077 ceph-mon[27902]: pgmap v210: 97 pgs: 97 active+clean; 3.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 501 op/s 2024-04-21T10:28:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:15 smithi191 ceph-mon[31636]: pgmap v210: 97 pgs: 97 active+clean; 3.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 501 op/s 2024-04-21T10:28:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:17 smithi170 ceph-mon[31212]: pgmap v211: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 26 MiB/s wr, 704 op/s 2024-04-21T10:28:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:17 smithi077 ceph-mon[27902]: pgmap v211: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 26 MiB/s wr, 704 op/s 2024-04-21T10:28:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:17 smithi191 ceph-mon[31636]: pgmap v211: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 26 MiB/s wr, 704 op/s 2024-04-21T10:28:18.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:28:18.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 -- 172.21.15.77:0/337652710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101130 msgr2=0x7fbd4c101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:18.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 --2- 172.21.15.77:0/337652710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101130 0x7fbd4c101590 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009900 tx=0x7fbd3c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:18.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 -- 172.21.15.77:0/337652710 shutdown_connections 2024-04-21T10:28:18.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 --2- 172.21.15.77:0/337652710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101130 0x7fbd4c101590 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:18.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 --2- 172.21.15.77:0/337652710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:18.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 --2- 172.21.15.77:0/337652710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 -- 172.21.15.77:0/337652710 >> 172.21.15.77:0/337652710 conn(0x7fbd4c077e30 msgr2=0x7fbd4c078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 -- 172.21.15.77:0/337652710 shutdown_connections 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.969+0000 7fbd5161f640 1 -- 172.21.15.77:0/337652710 wait complete. 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 Processor -- start 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 -- start start 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c101130 0x7fbd4c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c111140 con 0x7fbd4c101ad0 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c110fc0 con 0x7fbd4c106f10 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd5161f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1112c0 con 0x7fbd4c101130 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:18.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40768/0 (socket says 172.21.15.77:40768) 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 -- 172.21.15.77:0/2520121231 learned_addr learned my addr 172.21.15.77:0/2520121231 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4affd640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c101130 0x7fbd4c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 -- 172.21.15.77:0/2520121231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c101130 msgr2=0x7fbd4c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c101130 0x7fbd4c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4b7fe640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 -- 172.21.15.77:0/2520121231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c106f10 msgr2=0x7fbd4c1a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4a7fc640 1 -- 172.21.15.77:0/2520121231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c1a4c20 con 0x7fbd4c101ad0 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4affd640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c101130 0x7fbd4c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.970+0000 7fbd4b7fe640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.971+0000 7fbd4a7fc640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c199ba0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c005940 tx=0x7fbd3c02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.971+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c043020 con 0x7fbd4c101ad0 2024-04-21T10:28:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.971+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c1a4df0 con 0x7fbd4c101ad0 2024-04-21T10:28:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.971+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd3c02cc60 con 0x7fbd4c101ad0 2024-04-21T10:28:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.971+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c003c30 con 0x7fbd4c101ad0 2024-04-21T10:28:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.971+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c1a5260 con 0x7fbd4c101ad0 2024-04-21T10:28:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.972+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd4c069230 con 0x7fbd4c101ad0 2024-04-21T10:28:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.973+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fbd3c046020 con 0x7fbd4c101ad0 2024-04-21T10:28:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.974+0000 7fbd33fff640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbd340a3d20 0x7fbd340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.974+0000 7fbd4affd640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbd340a3d20 0x7fbd340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.974+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7fbd3c0f30d0 con 0x7fbd4c101ad0 2024-04-21T10:28:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.974+0000 7fbd4affd640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbd340a3d20 0x7fbd340a61e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd40006fd0 tx=0x7fbd40008040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:18.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:18.977+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd3c04d020 con 0x7fbd4c101ad0 2024-04-21T10:28:19.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.193+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd4c109350 con 0x7fbd4c101ad0 2024-04-21T10:28:19.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.194+0000 7fbd33fff640 1 -- 172.21.15.77:0/2520121231 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11892 (secure 0 0 0) 0x7fbd3c0bf920 con 0x7fbd4c101ad0 2024-04-21T10:28:19.194 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:28:19.194 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:27:57.569549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":132,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":133,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:28:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbd340a3d20 msgr2=0x7fbd340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbd340a3d20 0x7fbd340a61e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd40006fd0 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 msgr2=0x7fbd4c199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c199ba0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c005940 tx=0x7fbd3c02c860 comp rx=0 tx=0).stop 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 shutdown_connections 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fbd340a3d20 0x7fbd340a61e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c199ba0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 --2- 172.21.15.77:0/2520121231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd4c101130 0x7fbd4c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 >> 172.21.15.77:0/2520121231 conn(0x7fbd4c077e30 msgr2=0x7fbd4c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 shutdown_connections 2024-04-21T10:28:19.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.196+0000 7fbd5161f640 1 -- 172.21.15.77:0/2520121231 wait complete. 2024-04-21T10:28:19.207 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id 8296d858 --release --await' 2024-04-21T10:28:19.207 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id 8296d858 --release --await 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 -- 172.21.15.77:0/670807269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac101b40 msgr2=0x7f1dac10dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 --2- 172.21.15.77:0/670807269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac101b40 0x7f1dac10dc80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009cd0 tx=0x7f1da402c0f0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 -- 172.21.15.77:0/670807269 shutdown_connections 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 --2- 172.21.15.77:0/670807269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac101b40 0x7f1dac10dc80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 --2- 172.21.15.77:0/670807269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac1011a0 0x7f1dac101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 --2- 172.21.15.77:0/670807269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dac107030 0x7f1dac107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 -- 172.21.15.77:0/670807269 >> 172.21.15.77:0/670807269 conn(0x7f1dac076c50 msgr2=0x7f1dac077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 -- 172.21.15.77:0/670807269 shutdown_connections 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.313+0000 7f1db1afd640 1 -- 172.21.15.77:0/670807269 wait complete. 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 Processor -- start 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 -- start start 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dac1011a0 0x7f1dac1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac101b40 0x7f1dac198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 0x7f1dac19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1110e0 con 0x7f1dac107030 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac110f60 con 0x7f1dac101b40 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1db1afd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac111260 con 0x7f1dac1011a0 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 0x7f1dac19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 0x7f1dac19cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40786/0 (socket says 172.21.15.77:40786) 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dac1011a0 0x7f1dac1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 -- 172.21.15.77:0/3963156845 learned_addr learned my addr 172.21.15.77:0/3963156845 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1daaffd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac101b40 0x7f1dac198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 -- 172.21.15.77:0/3963156845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dac1011a0 msgr2=0x7f1dac1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dac1011a0 0x7f1dac1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 -- 172.21.15.77:0/3963156845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac101b40 msgr2=0x7f1dac198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac101b40 0x7f1dac198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1dabfff640 1 -- 172.21.15.77:0/3963156845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac19d6c0 con 0x7f1dac107030 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.314+0000 7f1daaffd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac101b40 0x7f1dac198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.315+0000 7f1dabfff640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 0x7f1dac19cf90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1da40098d0 tx=0x7f1da4032420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.315+0000 7f1da8ff9640 1 -- 172.21.15.77:0/3963156845 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4041020 con 0x7f1dac107030 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.315+0000 7f1da8ff9640 1 -- 172.21.15.77:0/3963156845 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1da4032970 con 0x7f1dac107030 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.315+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac19d950 con 0x7f1dac107030 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.315+0000 7f1da8ff9640 1 -- 172.21.15.77:0/3963156845 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4039040 con 0x7f1dac107030 2024-04-21T10:28:19.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.315+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac1a5240 con 0x7f1dac107030 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.317+0000 7f1da8ff9640 1 -- 172.21.15.77:0/3963156845 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f1da4044020 con 0x7f1dac107030 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.317+0000 7f1db47c6740 1 Processor -- start 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.317+0000 7f1db47c6740 1 -- start start 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ecd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680ecd8e0 0x558680eda6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 0x558680edd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1db47c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558680e32500 con 0x558680edac20 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1db47c6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558680dd86a0 con 0x558680ecd8e0 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1da8ff9640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f1d940a3d20 0x7f1d940a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1db47c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558680e2e4c0 con 0x558680eccfc0 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1dabfff640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f1d940a3d20 0x7f1d940a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 0x558680edd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 0x558680edd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40788/0 (socket says 172.21.15.77:40788) 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 -- 172.21.15.77:0/4144087201 learned_addr learned my addr 172.21.15.77:0/4144087201 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680ecd8e0 0x558680eda6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1da8ff9640 1 -- 172.21.15.77:0/3963156845 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f1da40f2480 con 0x7f1dac107030 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ecd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 -- 172.21.15.77:0/4144087201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 msgr2=0x558680ecd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ecd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 -- 172.21.15.77:0/4144087201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680ecd8e0 msgr2=0x558680eda6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680ecd8e0 0x558680eda6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 -- 172.21.15.77:0/4144087201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558680df75e0 con 0x558680edac20 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1daaffd640 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 0x558680edd010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1da00145c0 tx=0x7f1da000d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8214e3734a6fe937 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1dabfff640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f1d940a3d20 0x7f1d940a61e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1da40baf00 tx=0x7f1da4091020 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1d91ffb640 1 -- 172.21.15.77:0/4144087201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0005220 con 0x558680edac20 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1d91ffb640 1 -- 172.21.15.77:0/4144087201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1da0004c50 con 0x558680edac20 2024-04-21T10:28:19.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.318+0000 7f1d91ffb640 1 -- 172.21.15.77:0/4144087201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da000f810 con 0x558680edac20 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 -- 172.21.15.77:0/4144087201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 msgr2=0x558680edd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 0x558680edd010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1da00145c0 tx=0x7f1da000d620 comp rx=0 tx=0).stop 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 -- 172.21.15.77:0/4144087201 shutdown_connections 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680edac20 0x558680edd010 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680ecd8e0 0x558680eda6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 --2- 172.21.15.77:0/4144087201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ecd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 -- 172.21.15.77:0/4144087201 >> 172.21.15.77:0/4144087201 conn(0x558680ec7a40 msgr2=0x558680ec7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 -- 172.21.15.77:0/4144087201 shutdown_connections 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.319+0000 7f1db47c6740 1 -- 172.21.15.77:0/4144087201 wait complete. 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 -- start start 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 Processor -- start 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680eda5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 0x558680ed7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558680edda60 con 0x558680ecd8e0 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558680deba60 con 0x558680edac20 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558680eddbe0 con 0x558680eccfc0 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1db47c6740 10 client.0 _ll_register_callbacks cb 0x558680b44110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40804/0 (socket says 172.21.15.77:40804) 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1dab7fe640 1 -- 172.21.15.77:0/868141479 learned_addr learned my addr 172.21.15.77:0/868141479 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.320+0000 7f1daaffd640 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680eda5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1dab7fe640 1 -- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 msgr2=0x558680eda5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680eda5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1dab7fe640 1 -- 172.21.15.77:0/868141479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 msgr2=0x558680ed7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 0x558680ed7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1dab7fe640 1 -- 172.21.15.77:0/868141479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558680b44920 con 0x558680ecd8e0 2024-04-21T10:28:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed7980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c012840 tx=0x7f1d9c012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3127cab4123b69c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1d8affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1d8affd640 1 -- 172.21.15.77:0/868141479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00f8c0 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1d8affd640 1 -- 172.21.15.77:0/868141479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f1d9c00fa60 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1da0004c50 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1d8affd640 1 -- 172.21.15.77:0/868141479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c00fc60 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 10 client.16383 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558680c10d30 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1d8affd640 1 -- 172.21.15.77:0/868141479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1da0004c50 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1d8affd640 1 -- 172.21.15.77:0/868141479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7f1d9c01c420 con 0x558680ecd8e0 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 10 client.16383 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 10 client.16383 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 20 client.16383 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680eeaec0 0x558680eed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 4 client.16383 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.321+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558680e05a10 con 0x558680eeaec0 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.322+0000 7f1daaffd640 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680eeaec0 0x558680eed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.322+0000 7f1d8affd640 10 client.16383 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.322+0000 7f1daaffd640 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680eeaec0 0x558680eed2e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=114726a6e758f4a6 server_cookie=b6e52501a02f3fba in_seq=0 out_seq=0 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1d8affd640 1 -- 172.21.15.77:0/868141479 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558680e05a10 con 0x558680eeaec0 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1d8affd640 10 client.16383 handle_command_reply: tid=0 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 client.16383 shutdown 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 msgr2=0x558680ed7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed7980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c012840 tx=0x7f1d9c012d00 comp rx=0 tx=0).stop 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 shutdown_connections 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680eeaec0 0x558680eed2e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed7980 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 0x558680ed7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1d8affd640 0 client.16383 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:19.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 --2- 172.21.15.77:0/868141479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680eda5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 >> 172.21.15.77:0/868141479 conn(0x558680ec7a40 msgr2=0x558680ec9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 shutdown_connections 2024-04-21T10:28:19.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 1 -- 172.21.15.77:0/868141479 wait complete. 2024-04-21T10:28:19.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.323+0000 7f1db47c6740 20 client.16383 trim_cache size 0 max 16384 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 Processor -- start 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 -- start start 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ec95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680eda0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 0x558680eda5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1ae190 con 0x558680ecd8e0 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1aba00 con 0x558680edac20 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1db47c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1a9870 con 0x558680eccfc0 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680eda0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680eda0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40820/0 (socket says 172.21.15.77:40820) 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 -- 172.21.15.77:0/418893213 learned_addr learned my addr 172.21.15.77:0/418893213 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 -- 172.21.15.77:0/418893213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 msgr2=0x558680ec95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ec95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 -- 172.21.15.77:0/418893213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 msgr2=0x558680eda5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 0x558680eda5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 -- 172.21.15.77:0/418893213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558680edd3d0 con 0x558680ecd8e0 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.340+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680eda0b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001eb0 tx=0x7f1d9c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b5d59c80e186c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1d917fa640 1 -- 172.21.15.77:0/418893213 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0122e0 con 0x558680ecd8e0 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1d917fa640 1 -- 172.21.15.77:0/418893213 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c01c420 con 0x558680ecd8e0 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1d917fa640 1 -- 172.21.15.77:0/418893213 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c005310 con 0x558680ecd8e0 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 -- 172.21.15.77:0/418893213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 msgr2=0x558680eda0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680eda0b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001eb0 tx=0x7f1d9c00ff90 comp rx=0 tx=0).stop 2024-04-21T10:28:19.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 -- 172.21.15.77:0/418893213 shutdown_connections 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680eda0b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680edac20 0x558680eda5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 --2- 172.21.15.77:0/418893213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680eccfc0 0x558680ec95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 -- 172.21.15.77:0/418893213 >> 172.21.15.77:0/418893213 conn(0x558680ec7a40 msgr2=0x558680ec8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 -- 172.21.15.77:0/418893213 shutdown_connections 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 -- 172.21.15.77:0/418893213 wait complete. 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.341+0000 7f1db47c6740 1 -- start start 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 Processor -- start 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680eccfc0 0x558680ed4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680edac20 0x558680ed52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1a9ec0 con 0x558680ecd8e0 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1ab330 con 0x558680eccfc0 2024-04-21T10:28:19.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1aa590 con 0x558680edac20 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1db47c6740 10 client.0 _ll_register_callbacks cb 0x7f1d9c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40828/0 (socket says 172.21.15.77:40828) 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 -- 172.21.15.77:0/1375561533 learned_addr learned my addr 172.21.15.77:0/1375561533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1daaffd640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680edac20 0x558680ed52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 -- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680edac20 msgr2=0x558680ed52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680edac20 0x558680ed52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 -- 172.21.15.77:0/1375561533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680eccfc0 msgr2=0x558680ed4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680eccfc0 0x558680ed4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 -- 172.21.15.77:0/1375561533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558680ee14c0 con 0x558680ecd8e0 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1daaffd640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680edac20 0x558680ed52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1dab7fe640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed4d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c012840 tx=0x7f1d9c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c998d71cfc4564a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.342+0000 7f1d8affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1d8affd640 1 -- 172.21.15.77:0/1375561533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00f9a0 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1d8affd640 1 -- 172.21.15.77:0/1375561533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f1d9c0050b0 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d9c01c420 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1d8affd640 1 -- 172.21.15.77:0/1375561533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c03b050 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 10 client.16389 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558680f519b0 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1d8affd640 1 -- 172.21.15.77:0/1375561533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c01c420 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1d8affd640 1 -- 172.21.15.77:0/1375561533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7f1d9c003b10 con 0x558680ecd8e0 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 10 client.16389 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 10 client.16389 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 20 client.16389 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680f52040 0x558680f54460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 4 client.16389 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8296d858", "release": true, "await": true}] 2024-04-21T10:28:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8296d858", "release": true, "await": true}) -- 0x558680e3ff20 con 0x558680f52040 2024-04-21T10:28:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.343+0000 7f1daaffd640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680f52040 0x558680f54460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.344+0000 7f1daaffd640 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680f52040 0x558680f54460 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f212f6002d60e671 server_cookie=8e96786a371f6a71 in_seq=0 out_seq=0 2024-04-21T10:28:19.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.344+0000 7f1d8affd640 10 client.16389 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1d8affd640 1 -- 172.21.15.77:0/1375561533 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558680e3ff20 con 0x558680f52040 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1d8affd640 10 client.16389 handle_command_reply: tid=0 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 client.16389 shutdown 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 msgr2=0x558680ed4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed4d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c012840 tx=0x7f1d9c005bf0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 shutdown_connections 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x558680f52040 0x558680f54460 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558680ecd8e0 0x558680ed4d80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558680edac20 0x558680ed52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 --2- 172.21.15.77:0/1375561533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558680eccfc0 0x558680ed4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1d8affd640 0 client.16389 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 >> 172.21.15.77:0/1375561533 conn(0x558680ec7a40 msgr2=0x558680ec9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 shutdown_connections 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 1 -- 172.21.15.77:0/1375561533 wait complete. 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.348+0000 7f1db47c6740 20 client.16389 trim_cache size 0 max 16384 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 37, 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 24, 2024-04-21T10:28:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "8296d858": { 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 24, 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 85.7, 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:28:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:28:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:19.353 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f1d940a3d20 msgr2=0x7f1d940a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f1d940a3d20 0x7f1d940a61e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1da40baf00 tx=0x7f1da4091020 comp rx=0 tx=0).stop 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 msgr2=0x7f1dac19cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 0x7f1dac19cf90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1da40098d0 tx=0x7f1da4032420 comp rx=0 tx=0).stop 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 shutdown_connections 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f1d940a3d20 0x7f1d940a61e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dac107030 0x7f1dac19cf90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dac101b40 0x7f1dac198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 --2- 172.21.15.77:0/3963156845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dac1011a0 0x7f1dac1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 >> 172.21.15.77:0/3963156845 conn(0x7f1dac076c50 msgr2=0x7f1dac100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 shutdown_connections 2024-04-21T10:28:19.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.349+0000 7f1db1afd640 1 -- 172.21.15.77:0/3963156845 wait complete. 2024-04-21T10:28:19.362 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 8296d858, seconds elapsed: 27.3 2024-04-21T10:28:19.362 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-04-21T10:28:19.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:28:19.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.518+0000 7f7c54c26640 1 -- 172.21.15.77:0/2674958623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100360 msgr2=0x7f7c50100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.518+0000 7f7c54c26640 1 --2- 172.21.15.77:0/2674958623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100360 0x7f7c50100740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009900 tx=0x7f7c4402bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 -- 172.21.15.77:0/2674958623 shutdown_connections 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 --2- 172.21.15.77:0/2674958623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100c80 0x7f7c5010e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 --2- 172.21.15.77:0/2674958623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5010e760 0x7f7c50110b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 --2- 172.21.15.77:0/2674958623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100360 0x7f7c50100740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 -- 172.21.15.77:0/2674958623 >> 172.21.15.77:0/2674958623 conn(0x7f7c500770b0 msgr2=0x7f7c500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 -- 172.21.15.77:0/2674958623 shutdown_connections 2024-04-21T10:28:19.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.519+0000 7f7c54c26640 1 -- 172.21.15.77:0/2674958623 wait complete. 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 Processor -- start 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 -- start start 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 0x7f7c5010e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 0x7f7c5010b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5010e760 0x7f7c5010b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c50114350 con 0x7f7c50100360 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c4e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 0x7f7c5010e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c4dd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 0x7f7c5010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c4e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 0x7f7c5010e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40840/0 (socket says 172.21.15.77:40840) 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c4dd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 0x7f7c5010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:41518/0 (socket says 172.21.15.77:41518) 2024-04-21T10:28:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c4e59c640 1 -- 172.21.15.77:0/3509512699 learned_addr learned my addr 172.21.15.77:0/3509512699 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7c501141d0 con 0x7f7c5010e760 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7c501144d0 con 0x7f7c50100c80 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.520+0000 7f7c4ed9d640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5010e760 0x7f7c5010b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.521+0000 7f7c4dd9b640 1 -- 172.21.15.77:0/3509512699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5010e760 msgr2=0x7f7c5010b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.521+0000 7f7c4dd9b640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5010e760 0x7f7c5010b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.521+0000 7f7c4dd9b640 1 -- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 msgr2=0x7f7c5010e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.521+0000 7f7c4dd9b640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 0x7f7c5010e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.521+0000 7f7c4dd9b640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c501ab090 con 0x7f7c50100c80 2024-04-21T10:28:19.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.521+0000 7f7c4e59c640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 0x7f7c5010e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:19.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.522+0000 7f7c4dd9b640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 0x7f7c5010b110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800eb00 tx=0x7f7c4800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.522+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48010430 con 0x7f7c50100c80 2024-04-21T10:28:19.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.522+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c48010a80 con 0x7f7c50100c80 2024-04-21T10:28:19.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.522+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48018b60 con 0x7f7c50100c80 2024-04-21T10:28:19.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.522+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c501ab260 con 0x7f7c50100c80 2024-04-21T10:28:19.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.522+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c501ab710 con 0x7f7c50100c80 2024-04-21T10:28:19.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.524+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c50101420 con 0x7f7c50100c80 2024-04-21T10:28:19.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.525+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f7c4801f020 con 0x7f7c50100c80 2024-04-21T10:28:19.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.526+0000 7f7c3f7fe640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7c380a3da0 0x7f7c380a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:19.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.526+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f7c480d0fc0 con 0x7f7c50100c80 2024-04-21T10:28:19.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.527+0000 7f7c4e59c640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7c380a3da0 0x7f7c380a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:19.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.528+0000 7f7c4e59c640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7c380a3da0 0x7f7c380a6260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005ab0 tx=0x7f7c44005a40 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:19.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.531+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7c48053ff0 con 0x7f7c50100c80 2024-04-21T10:28:19.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.900+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c50105370 con 0x7f7c50100c80 2024-04-21T10:28:19.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.901+0000 7f7c3f7fe640 1 -- 172.21.15.77:0/3509512699 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11892 (secure 0 0 0) 0x7f7c4809d600 con 0x7f7c50100c80 2024-04-21T10:28:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:28:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:27:57.569549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":132,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":133,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:28:19.901 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2024-04-21T10:28:19.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7c380a3da0 msgr2=0x7f7c380a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7c380a3da0 0x7f7c380a6260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005ab0 tx=0x7f7c44005a40 comp rx=0 tx=0).stop 2024-04-21T10:28:19.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 msgr2=0x7f7c5010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:19.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 0x7f7c5010b110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800eb00 tx=0x7f7c4800c2d0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 shutdown_connections 2024-04-21T10:28:19.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f7c380a3da0 0x7f7c380a6260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5010e760 0x7f7c5010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c50100c80 0x7f7c5010b110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 --2- 172.21.15.77:0/3509512699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50100360 0x7f7c5010e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 >> 172.21.15.77:0/3509512699 conn(0x7f7c500770b0 msgr2=0x7f7c500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 shutdown_connections 2024-04-21T10:28:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:19.904+0000 7f7c54c26640 1 -- 172.21.15.77:0/3509512699 wait complete. 2024-04-21T10:28:19.919 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 85.7 --await' 2024-04-21T10:28:19.919 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 85.7 --await 2024-04-21T10:28:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:19 smithi170 ceph-mon[31212]: pgmap v212: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 26 MiB/s wr, 704 op/s 2024-04-21T10:28:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:19 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/2520121231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.100+0000 7ff78cc90640 1 -- 172.21.15.77:0/512632569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788101870 msgr2=0x7ff7881058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.100+0000 7ff78cc90640 1 --2- 172.21.15.77:0/512632569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788101870 0x7ff7881058b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff78001acb0 tx=0x7ff78003d170 comp rx=0 tx=0).stop 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.102+0000 7ff78cc90640 1 -- 172.21.15.77:0/512632569 shutdown_connections 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.102+0000 7ff78cc90640 1 --2- 172.21.15.77:0/512632569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788101870 0x7ff7881058b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.102+0000 7ff78cc90640 1 --2- 172.21.15.77:0/512632569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff788105f90 0x7ff78810db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.102+0000 7ff78cc90640 1 --2- 172.21.15.77:0/512632569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff788100ec0 0x7ff7881012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.102+0000 7ff78cc90640 1 -- 172.21.15.77:0/512632569 >> 172.21.15.77:0/512632569 conn(0x7ff7880fc700 msgr2=0x7ff7880feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.103+0000 7ff78cc90640 1 -- 172.21.15.77:0/512632569 shutdown_connections 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.105+0000 7ff78cc90640 1 -- 172.21.15.77:0/512632569 wait complete. 2024-04-21T10:28:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 Processor -- start 2024-04-21T10:28:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 -- start start 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff788100ec0 0x7ff7880738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 0x7ff78806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff78806ef10 0x7ff78806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806d1f0 con 0x7ff788105f90 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806d070 con 0x7ff788100ec0 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.106+0000 7ff78cc90640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806d370 con 0x7ff78806ef10 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.107+0000 7ff786ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 0x7ff78806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.107+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff788100ec0 0x7ff7880738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.107+0000 7ff786ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 0x7ff78806e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40860/0 (socket says 172.21.15.77:40860) 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.107+0000 7ff786ffd640 1 -- 172.21.15.77:0/3675004410 learned_addr learned my addr 172.21.15.77:0/3675004410 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.108+0000 7ff786ffd640 1 -- 172.21.15.77:0/3675004410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff78806ef10 msgr2=0x7ff78806f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.108+0000 7ff786ffd640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff78806ef10 0x7ff78806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.108+0000 7ff786ffd640 1 -- 172.21.15.77:0/3675004410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff788100ec0 msgr2=0x7ff7880738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.108+0000 7ff786ffd640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff788100ec0 0x7ff7880738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.108+0000 7ff786ffd640 1 -- 172.21.15.77:0/3675004410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78819a400 con 0x7ff788105f90 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.108+0000 7ff786ffd640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 0x7ff78806e9d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7800438e0 tx=0x7ff780043910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.109+0000 7ff784ff9640 1 -- 172.21.15.77:0/3675004410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780003d70 con 0x7ff788105f90 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.109+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78819a690 con 0x7ff788105f90 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.109+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78819ab80 con 0x7ff788105f90 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.112+0000 7ff784ff9640 1 -- 172.21.15.77:0/3675004410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff78006c040 con 0x7ff788105f90 2024-04-21T10:28:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.113+0000 7ff784ff9640 1 -- 172.21.15.77:0/3675004410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800459d0 con 0x7ff788105f90 2024-04-21T10:28:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 Processor -- start 2024-04-21T10:28:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 -- start start 2024-04-21T10:28:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x556689851f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x55668985d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5566897b20b0 con 0x55668985b090 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556689763680 con 0x5566898524b0 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff790bc0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55668976fc60 con 0x556689851b90 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:37852/0 (socket says 172.21.15.77:37852) 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.115+0000 7ff7877fe640 1 -- 172.21.15.77:0/312189810 learned_addr learned my addr 172.21.15.77:0/312189810 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.116+0000 7ff787fff640 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x556689851f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.116+0000 7ff7877fe640 1 -- 172.21.15.77:0/312189810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 msgr2=0x556689851f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.116+0000 7ff7877fe640 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x556689851f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.116+0000 7ff7877fe640 1 -- 172.21.15.77:0/312189810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 msgr2=0x55668985d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:28:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.116+0000 7ff7877fe640 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x55668985d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.116+0000 7ff7877fe640 1 -- 172.21.15.77:0/312189810 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556689594c90 con 0x5566898524b0 2024-04-21T10:28:20.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.117+0000 7ff7877fe640 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985ab50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff778009a40 tx=0x7ff778009f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f126bb2a86fca348 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.117+0000 7ff76dffb640 1 -- 172.21.15.77:0/312189810 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778017070 con 0x5566898524b0 2024-04-21T10:28:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.117+0000 7ff784ff9640 1 -- 172.21.15.77:0/3675004410 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7ff780045b70 con 0x7ff788105f90 2024-04-21T10:28:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.117+0000 7ff76dffb640 1 -- 172.21.15.77:0/312189810 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff778013470 con 0x5566898524b0 2024-04-21T10:28:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.117+0000 7ff76dffb640 1 -- 172.21.15.77:0/312189810 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778012630 con 0x5566898524b0 2024-04-21T10:28:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.118+0000 7ff784ff9640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff7700a3d80 0x7ff7700a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.118+0000 7ff790bc0740 1 -- 172.21.15.77:0/312189810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 msgr2=0x55668985ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.118+0000 7ff790bc0740 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985ab50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff778009a40 tx=0x7ff778009f00 comp rx=0 tx=0).stop 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.119+0000 7ff784ff9640 1 -- 172.21.15.77:0/3675004410 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7ff780125360 con 0x7ff788105f90 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.120+0000 7ff790bc0740 1 -- 172.21.15.77:0/312189810 shutdown_connections 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.120+0000 7ff790bc0740 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x55668985d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.120+0000 7ff790bc0740 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985ab50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.120+0000 7ff790bc0740 1 --2- 172.21.15.77:0/312189810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x556689851f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.120+0000 7ff790bc0740 1 -- 172.21.15.77:0/312189810 >> 172.21.15.77:0/312189810 conn(0x55668984c2c0 msgr2=0x55668984c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.120+0000 7ff787fff640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff7700a3d80 0x7ff7700a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.123+0000 7ff790bc0740 1 -- 172.21.15.77:0/312189810 shutdown_connections 2024-04-21T10:28:20.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.125+0000 7ff787fff640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff7700a3d80 0x7ff7700a6240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00b7d0 tx=0x7ff77c008040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:20.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.125+0000 7ff790bc0740 1 -- 172.21.15.77:0/312189810 wait complete. 2024-04-21T10:28:20.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.125+0000 7ff790bc0740 1 -- start start 2024-04-21T10:28:20.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 Processor -- start 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x5566898580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x556689858620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x556689858b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5566897b5400 con 0x55668985b090 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556689771840 con 0x5566898524b0 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5566897ba720 con 0x556689851b90 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff790bc0740 10 client.0 _ll_register_callbacks cb 0x5566897c2ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.126+0000 7ff787fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x556689858b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x5566898580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff787fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x556689858b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40876/0 (socket says 172.21.15.77:40876) 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff787fff640 1 -- 172.21.15.77:0/4018250570 learned_addr learned my addr 172.21.15.77:0/4018250570 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 -- 172.21.15.77:0/4018250570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 msgr2=0x556689858620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T10:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x556689858620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 -- 172.21.15.77:0/4018250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 msgr2=0x556689858b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x556689858b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 -- 172.21.15.77:0/4018250570 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566895f5420 con 0x556689851b90 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff7877fe640 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x5566898580e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff7780092b0 tx=0x7ff778013620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a7f182fd2231c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.127+0000 7ff76b7f6640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.128+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4018250570 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778017050 con 0x556689851b90 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.128+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4018250570 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7ff77801c450 con 0x556689851b90 2024-04-21T10:28:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 395.0 s, 349.5 tps, lat 1557.800 ms stddev 6151.491 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.128+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff778013470 con 0x556689851b90 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.129+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4018250570 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff77801c650 con 0x556689851b90 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.129+0000 7ff790bc0740 10 client.25798 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.129+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556689488580 con 0x556689851b90 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4018250570 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff778013470 con 0x556689851b90 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4018250570 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7ff778030890 con 0x556689851b90 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff790bc0740 10 client.25798 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff790bc0740 10 client.25798 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff790bc0740 20 client.25798 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55668986add0 0x55668986d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff790bc0740 4 client.25798 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.130+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566897c3b10 con 0x55668986add0 2024-04-21T10:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.131+0000 7ff786ffd640 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55668986add0 0x55668986d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.131+0000 7ff76b7f6640 10 client.25798 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.131+0000 7ff786ffd640 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55668986add0 0x55668986d1c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f06da01598b2098 server_cookie=c8799cca2e660e84 in_seq=0 out_seq=0 2024-04-21T10:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4018250570 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5566897c3b10 con 0x55668986add0 2024-04-21T10:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff76b7f6640 10 client.25798 handle_command_reply: tid=0 2024-04-21T10:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 client.25798 shutdown 2024-04-21T10:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 msgr2=0x5566898580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x5566898580e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff7780092b0 tx=0x7ff778013620 comp rx=0 tx=0).stop 2024-04-21T10:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 shutdown_connections 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55668986add0 0x55668986d1c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x556689858b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x556689858620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4018250570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x5566898580e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 >> 172.21.15.77:0/4018250570 conn(0x55668984c2c0 msgr2=0x55668984e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff76b7f6640 0 client.25798 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 shutdown_connections 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 1 -- 172.21.15.77:0/4018250570 wait complete. 2024-04-21T10:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.132+0000 7ff790bc0740 20 client.25798 trim_cache size 0 max 16384 2024-04-21T10:28:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:19 smithi077 ceph-mon[27902]: pgmap v212: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 26 MiB/s wr, 704 op/s 2024-04-21T10:28:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:19 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/2520121231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.156+0000 7ff790bc0740 1 Processor -- start 2024-04-21T10:28:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.156+0000 7ff790bc0740 1 -- start start 2024-04-21T10:28:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556689851b90 0x55668985a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 0x556689858980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55668985b090 0x556689872850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff790bc0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400ea00 con 0x556689851b90 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff790bc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400c870 con 0x55668985b090 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff790bc0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400e330 con 0x5566898524b0 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff786ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 0x556689858980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff786ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 0x556689858980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:41544/0 (socket says 172.21.15.77:41544) 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff786ffd640 1 -- 172.21.15.77:0/2729765434 learned_addr learned my addr 172.21.15.77:0/2729765434 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff787fff640 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55668985b090 0x556689872850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff7877fe640 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556689851b90 0x55668985a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff786ffd640 1 -- 172.21.15.77:0/2729765434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55668985b090 msgr2=0x556689872850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.157+0000 7ff786ffd640 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55668985b090 0x556689872850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff786ffd640 1 -- 172.21.15.77:0/2729765434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556689851b90 msgr2=0x55668985a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff786ffd640 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556689851b90 0x55668985a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff786ffd640 1 -- 172.21.15.77:0/2729765434 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566898522e0 con 0x5566898524b0 2024-04-21T10:28:20.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff786ffd640 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 0x556689858980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7800ed810 tx=0x7ff780003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3df1de50ae1cac server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff76d7fa640 1 -- 172.21.15.77:0/2729765434 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780045e60 con 0x5566898524b0 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff76d7fa640 1 -- 172.21.15.77:0/2729765434 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff780105e50 con 0x5566898524b0 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.158+0000 7ff76d7fa640 1 -- 172.21.15.77:0/2729765434 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800ef6b0 con 0x5566898524b0 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 -- 172.21.15.77:0/2729765434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 msgr2=0x556689858980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 0x556689858980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7800ed810 tx=0x7ff780003f10 comp rx=0 tx=0).stop 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 -- 172.21.15.77:0/2729765434 shutdown_connections 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55668985b090 0x556689872850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566898524b0 0x556689858980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 --2- 172.21.15.77:0/2729765434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556689851b90 0x55668985a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 -- 172.21.15.77:0/2729765434 >> 172.21.15.77:0/2729765434 conn(0x55668984c2c0 msgr2=0x55668984d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 -- 172.21.15.77:0/2729765434 shutdown_connections 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.159+0000 7ff790bc0740 1 -- 172.21.15.77:0/2729765434 wait complete. 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.160+0000 7ff790bc0740 1 -- start start 2024-04-21T10:28:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.160+0000 7ff790bc0740 1 Processor -- start 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.160+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x55668985f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.160+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.160+0000 7ff790bc0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x5566898d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.160+0000 7ff790bc0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400d590 con 0x55668985b090 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff790bc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400cec0 con 0x5566898524b0 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff790bc0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400dc60 con 0x556689851b90 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff790bc0740 10 client.0 _ll_register_callbacks cb 0x7ff7780098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x55668985f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x55668985f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:41554/0 (socket says 172.21.15.77:41554) 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff7877fe640 1 -- 172.21.15.77:0/4263179086 learned_addr learned my addr 172.21.15.77:0/4263179086 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff787fff640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x5566898d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 -- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 msgr2=0x55668985f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x55668985f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 -- 172.21.15.77:0/4263179086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 msgr2=0x5566898d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x5566898d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 -- 172.21.15.77:0/4263179086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566898d0600 con 0x5566898524b0 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff7877fe640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x55668985f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff786ffd640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985f5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x556689869a90 tx=0x7ff7800ebf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce700abf02091cb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.161+0000 7ff76b7f6640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-21T10:28:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4263179086 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780045e60 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff780105e50 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4263179086 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7ff7800eda20 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4263179086 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff7800f13b0 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff790bc0740 10 client.25676 fetch_fsmap learned FSMap version 37 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5566898d1840 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.162+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4263179086 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff780105e50 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4263179086 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 37) ==== 8350+0+0 (secure 0 0 0) 0x7ff7800f9b90 con 0x5566898524b0 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff790bc0740 10 client.25676 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff790bc0740 10 client.25676 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff790bc0740 20 client.25676 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5566898d1e40 0x5566898d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff790bc0740 4 client.25676 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.7, "await": true}] 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.163+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.7, "await": true}) -- 0x5566897bd980 con 0x5566898d1e40 2024-04-21T10:28:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.164+0000 7ff7877fe640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5566898d1e40 0x5566898d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.164+0000 7ff76b7f6640 10 client.25676 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.164+0000 7ff7877fe640 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5566898d1e40 0x5566898d4260 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a09ac4631f3e1f8c server_cookie=f3e4e1a19fa2a97e in_seq=0 out_seq=0 2024-04-21T10:28:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:19 smithi191 ceph-mon[31636]: pgmap v212: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 26 MiB/s wr, 704 op/s 2024-04-21T10:28:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:19 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/2520121231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.432+0000 7ff76b7f6640 1 -- 172.21.15.77:0/4263179086 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5566897bd980 con 0x5566898d1e40 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.432+0000 7ff76b7f6640 10 client.25676 handle_command_reply: tid=0 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.432+0000 7ff790bc0740 1 client.25676 shutdown 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 msgr2=0x55668985f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985f5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x556689869a90 tx=0x7ff7800ebf20 comp rx=0 tx=0).stop 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 shutdown_connections 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5566898d1e40 0x5566898d4260 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55668985b090 0x5566898d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566898524b0 0x55668985f5c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff76b7f6640 0 client.25676 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 --2- 172.21.15.77:0/4263179086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556689851b90 0x55668985f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 >> 172.21.15.77:0/4263179086 conn(0x55668984c2c0 msgr2=0x55668984dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 shutdown_connections 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 1 -- 172.21.15.77:0/4263179086 wait complete. 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff790bc0740 20 client.25676 trim_cache size 0 max 16384 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:28:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 37, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 26, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "dd8de954": { 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 26, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 85.7, 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:28:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:20.436 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff7700a3d80 msgr2=0x7ff7700a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff7700a3d80 0x7ff7700a6240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00b7d0 tx=0x7ff77c008040 comp rx=0 tx=0).stop 2024-04-21T10:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 msgr2=0x7ff78806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 0x7ff78806e9d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7800438e0 tx=0x7ff780043910 comp rx=0 tx=0).stop 2024-04-21T10:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 shutdown_connections 2024-04-21T10:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7ff7700a3d80 0x7ff7700a6240 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788105f90 0x7ff78806e9d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff78806ef10 0x7ff78806f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 --2- 172.21.15.77:0/3675004410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff788100ec0 0x7ff7880738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:20.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 >> 172.21.15.77:0/3675004410 conn(0x7ff7880fc700 msgr2=0x7ff7880fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:20.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 shutdown_connections 2024-04-21T10:28:20.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:20.433+0000 7ff78cc90640 1 -- 172.21.15.77:0/3675004410 wait complete. 2024-04-21T10:28:20.444 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: dd8de954, quiesce duration: 25.7 2024-04-21T10:28:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:20 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/3509512699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:20 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/3509512699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:20 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/3509512699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:21 smithi170 ceph-mon[31212]: pgmap v213: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 453 op/s 2024-04-21T10:28:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:21 smithi077 ceph-mon[27902]: pgmap v213: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 453 op/s 2024-04-21T10:28:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:21 smithi191 ceph-mon[31636]: pgmap v213: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 453 op/s 2024-04-21T10:28:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:23 smithi170 ceph-mon[31212]: pgmap v214: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 241 op/s 2024-04-21T10:28:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:23 smithi077 ceph-mon[27902]: pgmap v214: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 241 op/s 2024-04-21T10:28:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:23 smithi191 ceph-mon[31636]: pgmap v214: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 241 op/s 2024-04-21T10:28:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:24 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:28:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 400.0 s, 152.5 tps, lat 36.111 ms stddev 41.262 2024-04-21T10:28:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:24 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:28:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:24 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:28:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:25 smithi170 ceph-mon[31212]: pgmap v215: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 224 op/s 2024-04-21T10:28:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:25 smithi077 ceph-mon[27902]: pgmap v215: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 224 op/s 2024-04-21T10:28:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:25 smithi191 ceph-mon[31636]: pgmap v215: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 224 op/s 2024-04-21T10:28:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:27 smithi170 ceph-mon[31212]: pgmap v216: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 239 op/s 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 -- 172.21.15.77:0/3537571245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de806a9f0 msgr2=0x7f8de806add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/3537571245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de806a9f0 0x7f8de806add0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd802bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 -- 172.21.15.77:0/3537571245 shutdown_connections 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/3537571245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8107260 0x7f8de810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/3537571245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806b3a0 0x7f8de8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/3537571245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de806a9f0 0x7f8de806add0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 -- 172.21.15.77:0/3537571245 >> 172.21.15.77:0/3537571245 conn(0x7f8de8076b80 msgr2=0x7f8de8076f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 -- 172.21.15.77:0/3537571245 shutdown_connections 2024-04-21T10:28:28.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.112+0000 7f8ded1d5640 1 -- 172.21.15.77:0/3537571245 wait complete. 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 Processor -- start 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 -- start start 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806a9f0 0x7f8de8101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 0x7f8de81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8101cf0 0x7f8de81a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81121f0 con 0x7f8de8107260 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8112070 con 0x7f8de806a9f0 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8ded1d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8112370 con 0x7f8de8101cf0 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8de659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 0x7f8de81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8de659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 0x7f8de81017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53028/0 (socket says 172.21.15.77:53028) 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.113+0000 7f8de659c640 1 -- 172.21.15.77:0/2216267548 learned_addr learned my addr 172.21.15.77:0/2216267548 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806a9f0 0x7f8de8101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de759e640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8101cf0 0x7f8de81a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de659c640 1 -- 172.21.15.77:0/2216267548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8101cf0 msgr2=0x7f8de81a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de659c640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8101cf0 0x7f8de81a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de659c640 1 -- 172.21.15.77:0/2216267548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806a9f0 msgr2=0x7f8de8101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de659c640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806a9f0 0x7f8de8101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de659c640 1 -- 172.21.15.77:0/2216267548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de81a6f80 con 0x7f8de8107260 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de759e640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8101cf0 0x7f8de81a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806a9f0 0x7f8de8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8de659c640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 0x7f8de81017b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc005fd0 tx=0x7f8ddc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8dcffff640 1 -- 172.21.15.77:0/2216267548 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc017070 con 0x7f8de8107260 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8dcffff640 1 -- 172.21.15.77:0/2216267548 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ddc009c30 con 0x7f8de8107260 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de81a7270 con 0x7f8de8107260 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8dcffff640 1 -- 172.21.15.77:0/2216267548 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc003d30 con 0x7f8de8107260 2024-04-21T10:28:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.114+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de81a7810 con 0x7f8de8107260 2024-04-21T10:28:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.116+0000 7f8dcffff640 1 -- 172.21.15.77:0/2216267548 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f8ddc003ed0 con 0x7f8de8107260 2024-04-21T10:28:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 Processor -- start 2024-04-21T10:28:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 -- start start 2024-04-21T10:28:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8dcffff640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8dd00a3e70 0x7f8dd00a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 0x55b9cc246620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc246fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2500e0 0x55b9cc2524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc1ab8d0 con 0x55b9cc2478d0 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc148e80 con 0x55b9cc246b60 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8defdc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc1a7890 con 0x55b9cc2500e0 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de759e640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8dd00a3e70 0x7f8dd00a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 0x55b9cc246620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 0x55b9cc246620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53034/0 (socket says 172.21.15.77:53034) 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 -- 172.21.15.77:0/356368177 learned_addr learned my addr 172.21.15.77:0/356368177 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8dcffff640 1 -- 172.21.15.77:0/2216267548 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f8ddc0d0490 con 0x7f8de8107260 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de659c640 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc246fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de759e640 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2500e0 0x55b9cc2524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 -- 172.21.15.77:0/356368177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2500e0 msgr2=0x55b9cc2524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2500e0 0x55b9cc2524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 -- 172.21.15.77:0/356368177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 msgr2=0x55b9cc246fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc246fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de6d9d640 1 -- 172.21.15.77:0/356368177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cc16a320 con 0x55b9cc2478d0 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.117+0000 7f8de759e640 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2500e0 0x55b9cc2524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.118+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 0x55b9cc246620 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9309f71d9a57e965 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.118+0000 7f8de759e640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8dd00a3e70 0x7f8dd00a6330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55b9cc2429e0 tx=0x7f8de00097a0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.118+0000 7f8dcd7fa640 1 -- 172.21.15.77:0/356368177 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8044020 con 0x55b9cc2478d0 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.118+0000 7f8dcd7fa640 1 -- 172.21.15.77:0/356368177 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd802cc90 con 0x55b9cc2478d0 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.118+0000 7f8dcd7fa640 1 -- 172.21.15.77:0/356368177 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80048c0 con 0x55b9cc2478d0 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.118+0000 7f8defdc9740 1 -- 172.21.15.77:0/356368177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 msgr2=0x55b9cc246620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 0x55b9cc246620 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd8005e80 comp rx=0 tx=0).stop 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- 172.21.15.77:0/356368177 shutdown_connections 2024-04-21T10:28:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2500e0 0x55b9cc2524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc246fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- 172.21.15.77:0/356368177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc2478d0 0x55b9cc246620 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- 172.21.15.77:0/356368177 >> 172.21.15.77:0/356368177 conn(0x55b9cc20dc90 msgr2=0x55b9cc241850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- 172.21.15.77:0/356368177 shutdown_connections 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- 172.21.15.77:0/356368177 wait complete. 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- start start 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 Processor -- start 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc24f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc2500e0 0x55b9cc24d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc252db0 con 0x55b9cc246b60 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc133eb0 con 0x55b9cc2500e0 2024-04-21T10:28:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc252f30 con 0x55b9cc2478d0 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8defdc9740 10 client.0 _ll_register_callbacks cb 0x55b9cc160b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc24f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc24f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53044/0 (socket says 172.21.15.77:53044) 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.119+0000 7f8de6d9d640 1 -- 172.21.15.77:0/2008596569 learned_addr learned my addr 172.21.15.77:0/2008596569 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de659c640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de6d9d640 1 -- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 msgr2=0x55b9cc24cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de759e640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc2500e0 0x55b9cc24d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de6d9d640 1 -- 172.21.15.77:0/2008596569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc2500e0 msgr2=0x55b9cc24d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc2500e0 0x55b9cc24d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de6d9d640 1 -- 172.21.15.77:0/2008596569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9cbebe210 con 0x55b9cc246b60 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc24f990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8006010 tx=0x7f8dd8004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e333399ae34c7158 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8dcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8dcaff5640 1 -- 172.21.15.77:0/2008596569 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd804d030 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8dcaff5640 1 -- 172.21.15.77:0/2008596569 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f8dd8003800 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd802cc90 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8dcaff5640 1 -- 172.21.15.77:0/2008596569 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8dd8044040 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8defdc9740 10 client.16422 fetch_fsmap learned FSMap version 38 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b9cbf8a620 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8dcaff5640 1 -- 172.21.15.77:0/2008596569 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd802cc90 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.120+0000 7f8dcaff5640 1 -- 172.21.15.77:0/2008596569 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f8dd8004a60 con 0x55b9cc246b60 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8defdc9740 10 client.16422 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8defdc9740 10 client.16422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8defdc9740 20 client.16422 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8defdc9740 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc25fd90 0x55b9cc262180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8defdc9740 4 client.16422 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9cc1bf880 con 0x55b9cc25fd90 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8de659c640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc25fd90 0x55b9cc262180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8dcaff5640 10 client.16422 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.121+0000 7f8de659c640 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc25fd90 0x55b9cc262180 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c4b86bb33c9c38 server_cookie=eb4a1e59f0f89780 in_seq=0 out_seq=0 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8dcaff5640 1 -- 172.21.15.77:0/2008596569 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b9cc1bf880 con 0x55b9cc25fd90 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8dcaff5640 10 client.16422 handle_command_reply: tid=0 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 client.16422 shutdown 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 msgr2=0x55b9cc24f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc24f990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8006010 tx=0x7f8dd8004370 comp rx=0 tx=0).stop 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 shutdown_connections 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc25fd90 0x55b9cc262180 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc2500e0 0x55b9cc24d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8dcaff5640 0 client.16422 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 --2- 172.21.15.77:0/2008596569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc24f990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 >> 172.21.15.77:0/2008596569 conn(0x55b9cc20dc90 msgr2=0x55b9cc2435a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 shutdown_connections 2024-04-21T10:28:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 1 -- 172.21.15.77:0/2008596569 wait complete. 2024-04-21T10:28:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.122+0000 7f8defdc9740 20 client.16422 trim_cache size 0 max 16384 2024-04-21T10:28:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:27 smithi077 ceph-mon[27902]: pgmap v216: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 239 op/s 2024-04-21T10:28:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.137+0000 7f8defdc9740 1 Processor -- start 2024-04-21T10:28:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 -- start start 2024-04-21T10:28:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 0x55b9cc25bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc241380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81b2650 con 0x55b9cc20dc90 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81afec0 con 0x55b9cc246b60 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8defdc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81add30 con 0x55b9cc2478d0 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 0x55b9cc25bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc241380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc241380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:47080/0 (socket says 172.21.15.77:47080) 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 0x55b9cc25bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53046/0 (socket says 172.21.15.77:53046) 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de659c640 1 -- 172.21.15.77:0/885337343 learned_addr learned my addr 172.21.15.77:0/885337343 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de759e640 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 -- 172.21.15.77:0/885337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 msgr2=0x55b9cc24f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 -- 172.21.15.77:0/885337343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 msgr2=0x55b9cc241380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc241380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 -- 172.21.15.77:0/885337343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cc245e30 con 0x55b9cc20dc90 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.138+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 0x55b9cc25bcb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd8005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2036c2d9558a0211 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8dccff9640 1 -- 172.21.15.77:0/885337343 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd804d070 con 0x55b9cc20dc90 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8dccff9640 1 -- 172.21.15.77:0/885337343 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd802c5d0 con 0x55b9cc20dc90 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8dccff9640 1 -- 172.21.15.77:0/885337343 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8003800 con 0x55b9cc20dc90 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 -- 172.21.15.77:0/885337343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 msgr2=0x55b9cc25bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 0x55b9cc25bcb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd8005990 comp rx=0 tx=0).stop 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 -- 172.21.15.77:0/885337343 shutdown_connections 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc24f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc246b60 0x55b9cc241380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 --2- 172.21.15.77:0/885337343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc20dc90 0x55b9cc25bcb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 -- 172.21.15.77:0/885337343 >> 172.21.15.77:0/885337343 conn(0x55b9cc248710 msgr2=0x55b9cc24b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 -- 172.21.15.77:0/885337343 shutdown_connections 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.139+0000 7f8defdc9740 1 -- 172.21.15.77:0/885337343 wait complete. 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 -- start start 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 Processor -- start 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc20dc90 0x55b9cc2583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc249530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc249a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81ae380 con 0x55b9cc246b60 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81af7f0 con 0x55b9cc20dc90 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81aea50 con 0x55b9cc2478d0 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8defdc9740 10 client.0 _ll_register_callbacks cb 0x7f8dd8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc249530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc249530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53056/0 (socket says 172.21.15.77:53056) 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 -- 172.21.15.77:0/3764015762 learned_addr learned my addr 172.21.15.77:0/3764015762 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de759e640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc249a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc20dc90 0x55b9cc2583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 -- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 msgr2=0x55b9cc249a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc249a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 -- 172.21.15.77:0/3764015762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc20dc90 msgr2=0x55b9cc2583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc20dc90 0x55b9cc2583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 -- 172.21.15.77:0/3764015762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9cc24a030 con 0x55b9cc246b60 2024-04-21T10:28:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8de659c640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc249530 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc09c130 tx=0x7f8ddc0d0690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af27afabf070f62 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.140+0000 7f8dcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8dcaff5640 1 -- 172.21.15.77:0/3764015762 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0a50a0 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8dcaff5640 1 -- 172.21.15.77:0/3764015762 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f8ddc09a4d0 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd802c5d0 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8dcaff5640 1 -- 172.21.15.77:0/3764015762 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8ddc09a730 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 10 client.16428 fetch_fsmap learned FSMap version 38 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b9cc2c5ee0 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8dcaff5640 1 -- 172.21.15.77:0/3764015762 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd802c5d0 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8dcaff5640 1 -- 172.21.15.77:0/3764015762 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f8ddc0a4c10 con 0x55b9cc246b60 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 10 client.16428 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 10 client.16428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 20 client.16428 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc2500e0 0x55b9cc2c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 4 client.16428 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:28:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9cc14b3d0 con 0x55b9cc2500e0 2024-04-21T10:28:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.141+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc2500e0 0x55b9cc2c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.142+0000 7f8dcaff5640 10 client.16428 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.142+0000 7f8de6d9d640 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc2500e0 0x55b9cc2c8620 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cdf928f00a04c13 server_cookie=3649a16cdee42b7e in_seq=0 out_seq=0 2024-04-21T10:28:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8dcaff5640 1 -- 172.21.15.77:0/3764015762 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9cc14b3d0 con 0x55b9cc2500e0 2024-04-21T10:28:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8dcaff5640 10 client.16428 handle_command_reply: tid=0 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 client.16428 shutdown 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 msgr2=0x55b9cc249530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc249530 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc09c130 tx=0x7f8ddc0d0690 comp rx=0 tx=0).stop 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 shutdown_connections 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b9cc2500e0 0x55b9cc2c8620 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9cc246b60 0x55b9cc249530 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8dcaff5640 0 client.16428 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9cc2478d0 0x55b9cc249a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 --2- 172.21.15.77:0/3764015762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b9cc20dc90 0x55b9cc2583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 >> 172.21.15.77:0/3764015762 conn(0x55b9cc248710 msgr2=0x55b9cc240040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 shutdown_connections 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 1 -- 172.21.15.77:0/3764015762 wait complete. 2024-04-21T10:28:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.154+0000 7f8defdc9740 20 client.16428 trim_cache size 0 max 16384 2024-04-21T10:28:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:28:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:28:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:28:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:28:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8dd00a3e70 msgr2=0x7f8dd00a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8dd00a3e70 0x7f8dd00a6330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55b9cc2429e0 tx=0x7f8de00097a0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 msgr2=0x7f8de81017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 0x7f8de81017b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc005fd0 tx=0x7f8ddc00dde0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 shutdown_connections 2024-04-21T10:28:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f8dd00a3e70 0x7f8dd00a6330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8de8107260 0x7f8de81017b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8de8101cf0 0x7f8de81a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 --2- 172.21.15.77:0/2216267548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8de806a9f0 0x7f8de8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 >> 172.21.15.77:0/2216267548 conn(0x7f8de8076b80 msgr2=0x7f8de80ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:28.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 shutdown_connections 2024-04-21T10:28:28.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:28.155+0000 7f8ded1d5640 1 -- 172.21.15.77:0/2216267548 wait complete. 2024-04-21T10:28:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:27 smithi191 ceph-mon[31636]: pgmap v216: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 239 op/s 2024-04-21T10:28:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:29 smithi170 ceph-mon[31212]: pgmap v217: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 636 KiB/s wr, 61 op/s 2024-04-21T10:28:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:29 smithi077 ceph-mon[27902]: pgmap v217: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 636 KiB/s wr, 61 op/s 2024-04-21T10:28:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:29 smithi191 ceph-mon[31636]: pgmap v217: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 636 KiB/s wr, 61 op/s 2024-04-21T10:28:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:31 smithi170 ceph-mon[31212]: pgmap v218: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 652 KiB/s wr, 67 op/s 2024-04-21T10:28:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:31 smithi077 ceph-mon[27902]: pgmap v218: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 652 KiB/s wr, 67 op/s 2024-04-21T10:28:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:31 smithi191 ceph-mon[31636]: pgmap v218: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 652 KiB/s wr, 67 op/s 2024-04-21T10:28:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:33 smithi170 ceph-mon[31212]: pgmap v219: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 279 KiB/s wr, 34 op/s 2024-04-21T10:28:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:33 smithi077 ceph-mon[27902]: pgmap v219: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 279 KiB/s wr, 34 op/s 2024-04-21T10:28:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:33 smithi191 ceph-mon[31636]: pgmap v219: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 279 KiB/s wr, 34 op/s 2024-04-21T10:28:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:35 smithi170 ceph-mon[31212]: pgmap v220: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 173 KiB/s wr, 21 op/s 2024-04-21T10:28:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:35 smithi077 ceph-mon[27902]: pgmap v220: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 173 KiB/s wr, 21 op/s 2024-04-21T10:28:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:35 smithi191 ceph-mon[31636]: pgmap v220: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 173 KiB/s wr, 21 op/s 2024-04-21T10:28:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:28:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:28:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:28:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:28:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:28:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:28:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:28:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:28:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:28:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:28:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:28:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:28:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:37 smithi077 ceph-mon[27902]: pgmap v221: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 24 op/s 2024-04-21T10:28:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:37 smithi191 ceph-mon[31636]: pgmap v221: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 24 op/s 2024-04-21T10:28:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:37 smithi170 ceph-mon[31212]: pgmap v221: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 24 op/s 2024-04-21T10:28:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:39 smithi077 ceph-mon[27902]: pgmap v222: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-04-21T10:28:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:39 smithi191 ceph-mon[31636]: pgmap v222: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-04-21T10:28:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:39 smithi170 ceph-mon[31212]: pgmap v222: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 -- 172.21.15.77:0/4288746872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c102b70 msgr2=0x7f0c7c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 --2- 172.21.15.77:0/4288746872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c102b70 0x7f0c7c106bb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009900 tx=0x7f0c6802bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 -- 172.21.15.77:0/4288746872 shutdown_connections 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 --2- 172.21.15.77:0/4288746872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c102b70 0x7f0c7c106bb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 --2- 172.21.15.77:0/4288746872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c7c107290 0x7f0c7c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 --2- 172.21.15.77:0/4288746872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c7c1021c0 0x7f0c7c1025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 -- 172.21.15.77:0/4288746872 >> 172.21.15.77:0/4288746872 conn(0x7f0c7c0fda20 msgr2=0x7f0c7c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 -- 172.21.15.77:0/4288746872 shutdown_connections 2024-04-21T10:28:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.251+0000 7f0c82b67640 1 -- 172.21.15.77:0/4288746872 wait complete. 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 Processor -- start 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 -- start start 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c7c1021c0 0x7f0c7c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c7c107290 0x7f0c7c198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 0x7f0c7c19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1121b0 con 0x7f0c7c19cf50 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c112030 con 0x7f0c7c107290 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c82b67640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c112330 con 0x7f0c7c1021c0 2024-04-21T10:28:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c81104640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 0x7f0c7c19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c81104640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 0x7f0c7c19d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54814/0 (socket says 172.21.15.77:54814) 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c81104640 1 -- 172.21.15.77:0/1543702273 learned_addr learned my addr 172.21.15.77:0/1543702273 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c7c107290 0x7f0c7c198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c80903640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c7c1021c0 0x7f0c7c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.252+0000 7f0c81104640 1 -- 172.21.15.77:0/1543702273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c7c1021c0 msgr2=0x7f0c7c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c81104640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c7c1021c0 0x7f0c7c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c81104640 1 -- 172.21.15.77:0/1543702273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c7c107290 msgr2=0x7f0c7c198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c81104640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c7c107290 0x7f0c7c198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c81104640 1 -- 172.21.15.77:0/1543702273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c19da40 con 0x7f0c7c19cf50 2024-04-21T10:28:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c81104640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 0x7f0c7c19d400 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400eaa0 tx=0x7f0c7400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c79ffb640 1 -- 172.21.15.77:0/1543702273 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400cdb0 con 0x7f0c7c19cf50 2024-04-21T10:28:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c19dd30 con 0x7f0c7c19cf50 2024-04-21T10:28:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c79ffb640 1 -- 172.21.15.77:0/1543702273 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c74005020 con 0x7f0c7c19cf50 2024-04-21T10:28:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c79ffb640 1 -- 172.21.15.77:0/1543702273 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740116d0 con 0x7f0c7c19cf50 2024-04-21T10:28:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.253+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c1a54a0 con 0x7f0c7c19cf50 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.255+0000 7f0c79ffb640 1 -- 172.21.15.77:0/1543702273 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f0c740051d0 con 0x7f0c7c19cf50 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c79ffb640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0c6c0a3dc0 0x7f0c6c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 Processor -- start 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 -- start start 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c79ffb640 1 -- 172.21.15.77:0/1543702273 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f0c740d08f0 con 0x7f0c7c19cf50 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c80903640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0c6c0a3dc0 0x7f0c6c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296f8d0 0x5561d296e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 0x5561d296efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d29780e0 0x5561d297a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5561d28d38d0 con 0x5561d296eb60 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5561d2870e80 con 0x5561d296f8d0 2024-04-21T10:28:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c85839740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5561d28cf890 con 0x5561d29780e0 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 0x5561d296efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 0x5561d296efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54824/0 (socket says 172.21.15.77:54824) 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 -- 172.21.15.77:0/721561685 learned_addr learned my addr 172.21.15.77:0/721561685 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c80903640 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296f8d0 0x5561d296e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c81104640 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d29780e0 0x5561d297a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c80903640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0c6c0a3dc0 0x7f0c6c0a6280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000bc30 tx=0x7f0c7000b390 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 -- 172.21.15.77:0/721561685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d29780e0 msgr2=0x5561d297a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d29780e0 0x5561d297a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 -- 172.21.15.77:0/721561685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296f8d0 msgr2=0x5561d296e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296f8d0 0x5561d296e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.256+0000 7f0c7bfff640 1 -- 172.21.15.77:0/721561685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d2892320 con 0x5561d296eb60 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.257+0000 7f0c81104640 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d29780e0 0x5561d297a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.257+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 0x5561d296efe0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009900 tx=0x7f0c6802c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6d0fb1728fc129 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.257+0000 7f0c66ffd640 1 -- 172.21.15.77:0/721561685 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68045020 con 0x5561d296eb60 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.257+0000 7f0c66ffd640 1 -- 172.21.15.77:0/721561685 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6802c7e0 con 0x5561d296eb60 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.257+0000 7f0c66ffd640 1 -- 172.21.15.77:0/721561685 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680046c0 con 0x5561d296eb60 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 -- 172.21.15.77:0/721561685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 msgr2=0x5561d296efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 0x5561d296efe0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009900 tx=0x7f0c6802c610 comp rx=0 tx=0).stop 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 -- 172.21.15.77:0/721561685 shutdown_connections 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296eb60 0x5561d296efe0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d29780e0 0x5561d297a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- 172.21.15.77:0/721561685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296f8d0 0x5561d296e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 -- 172.21.15.77:0/721561685 >> 172.21.15.77:0/721561685 conn(0x5561d2935c90 msgr2=0x5561d2969850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 -- 172.21.15.77:0/721561685 shutdown_connections 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 -- 172.21.15.77:0/721561685 wait complete. 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 -- start start 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 Processor -- start 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d29779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2974de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.258+0000 7f0c85839740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d2975340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c85839740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5561d297adb0 con 0x5561d296f8d0 2024-04-21T10:28:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c85839740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5561d285beb0 con 0x5561d29780e0 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c85839740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5561d297af30 con 0x5561d296eb60 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c85839740 10 client.0 _ll_register_callbacks cb 0x5561d2888b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2974de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2974de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54832/0 (socket says 172.21.15.77:54832) 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 -- 172.21.15.77:0/1455066585 learned_addr learned my addr 172.21.15.77:0/1455066585 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c81104640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d2975340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c80903640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d29779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 -- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 msgr2=0x5561d29779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d29779e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 -- 172.21.15.77:0/1455066585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 msgr2=0x5561d2975340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d2975340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 -- 172.21.15.77:0/1455066585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d25e6210 con 0x5561d296f8d0 2024-04-21T10:28:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2974de0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0c6802c420 tx=0x7f0c6802cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b77850359b65a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c5bfff640 1 -- 172.21.15.77:0/1455066585 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68045070 con 0x5561d296f8d0 2024-04-21T10:28:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c5bfff640 1 -- 172.21.15.77:0/1455066585 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f0c680035f0 con 0x5561d296f8d0 2024-04-21T10:28:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.259+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c6802c7e0 con 0x5561d296f8d0 2024-04-21T10:28:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c5bfff640 1 -- 172.21.15.77:0/1455066585 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0c6805a050 con 0x5561d296f8d0 2024-04-21T10:28:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 10 client.16440 fetch_fsmap learned FSMap version 38 2024-04-21T10:28:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5561d26b2620 con 0x5561d296f8d0 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c5bfff640 1 -- 172.21.15.77:0/1455066585 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6802c7e0 con 0x5561d296f8d0 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c5bfff640 1 -- 172.21.15.77:0/1455066585 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f0c68041ad0 con 0x5561d296f8d0 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 10 client.16440 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 20 client.16440 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d298a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 4 client.16440 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561d28e7880 con 0x5561d2987ee0 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.260+0000 7f0c80903640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d298a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c5bfff640 10 client.16440 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c80903640 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d298a2d0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cfe1b6d897eae4 server_cookie=8b86dddfd8881d6a in_seq=0 out_seq=0 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c5bfff640 1 -- 172.21.15.77:0/1455066585 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5561d28e7880 con 0x5561d2987ee0 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c5bfff640 10 client.16440 handle_command_reply: tid=0 2024-04-21T10:28:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c85839740 1 client.16440 shutdown 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 msgr2=0x5561d2974de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c85839740 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2974de0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0c6802c420 tx=0x7f0c6802cc40 comp rx=0 tx=0).stop 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 shutdown_connections 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c85839740 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d298a2d0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.261+0000 7f0c85839740 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2974de0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c85839740 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d2975340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c5bfff640 0 client.16440 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c85839740 1 --2- 172.21.15.77:0/1455066585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d29779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 >> 172.21.15.77:0/1455066585 conn(0x5561d2935c90 msgr2=0x5561d296b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 shutdown_connections 2024-04-21T10:28:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c85839740 1 -- 172.21.15.77:0/1455066585 wait complete. 2024-04-21T10:28:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.262+0000 7f0c85839740 20 client.16440 trim_cache size 0 max 16384 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.276+0000 7f0c85839740 1 Processor -- start 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 -- start start 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d2983cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2964760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d298f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1b02e0 con 0x5561d296f8d0 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1adb50 con 0x5561d29780e0 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c85839740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1ab9c0 con 0x5561d296eb60 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2964760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2964760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54842/0 (socket says 172.21.15.77:54842) 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 -- 172.21.15.77:0/993196507 learned_addr learned my addr 172.21.15.77:0/993196507 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c80903640 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d2983cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 -- 172.21.15.77:0/993196507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 msgr2=0x5561d2983cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d2983cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 -- 172.21.15.77:0/993196507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 msgr2=0x5561d298f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d298f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 -- 172.21.15.77:0/993196507 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d2964f30 con 0x5561d296f8d0 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c80903640 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d2983cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2964760 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0c68041ef0 tx=0x7f0c68005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdfac254dc26664 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c667fc640 1 -- 172.21.15.77:0/993196507 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68045040 con 0x5561d296f8d0 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c667fc640 1 -- 172.21.15.77:0/993196507 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6802c7e0 con 0x5561d296f8d0 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.277+0000 7f0c667fc640 1 -- 172.21.15.77:0/993196507 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680416e0 con 0x5561d296f8d0 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 -- 172.21.15.77:0/993196507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 msgr2=0x5561d2964760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2964760 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0c68041ef0 tx=0x7f0c68005fd0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 -- 172.21.15.77:0/993196507 shutdown_connections 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d296f8d0 0x5561d2964760 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d29780e0 0x5561d298f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 --2- 172.21.15.77:0/993196507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296eb60 0x5561d2983cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 -- 172.21.15.77:0/993196507 >> 172.21.15.77:0/993196507 conn(0x5561d2935c90 msgr2=0x5561d29736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 -- 172.21.15.77:0/993196507 shutdown_connections 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 -- 172.21.15.77:0/993196507 wait complete. 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 -- start start 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.278+0000 7f0c85839740 1 Processor -- start 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296eb60 0x5561d29804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296f8d0 0x5561d2972110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 0x5561d2972650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1ac010 con 0x5561d29780e0 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1ad480 con 0x5561d296eb60 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1ac6e0 con 0x5561d296f8d0 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c85839740 10 client.0 _ll_register_callbacks cb 0x7f0c7000b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 0x5561d2972650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 0x5561d2972650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54856/0 (socket says 172.21.15.77:54856) 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 -- 172.21.15.77:0/2354161911 learned_addr learned my addr 172.21.15.77:0/2354161911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296f8d0 0x5561d2972110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c80903640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296eb60 0x5561d29804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 -- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296f8d0 msgr2=0x5561d2972110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296f8d0 0x5561d2972110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 -- 172.21.15.77:0/2354161911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296eb60 msgr2=0x5561d29804b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296eb60 0x5561d29804b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 -- 172.21.15.77:0/2354161911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d2972d40 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c81104640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 0x5561d2972650 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0c740ce0f0 tx=0x7f0c74098d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fed30719a8fcea server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.279+0000 7f0c5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c5bfff640 1 -- 172.21.15.77:0/2354161911 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7401f040 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c5bfff640 1 -- 172.21.15.77:0/2354161911 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f0c7409dbc0 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c6802c7e0 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c5bfff640 1 -- 172.21.15.77:0/2354161911 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0c740a5500 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 10 client.16446 fetch_fsmap learned FSMap version 38 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5561d29ee1a0 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c5bfff640 1 -- 172.21.15.77:0/2354161911 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6802c7e0 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c5bfff640 1 -- 172.21.15.77:0/2354161911 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f0c7400f040 con 0x5561d29780e0 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 10 client.16446 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 20 client.16446 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d29f0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 4 client.16446 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:28:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561d28733d0 con 0x5561d2987ee0 2024-04-21T10:28:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.280+0000 7f0c80903640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d29f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.281+0000 7f0c5bfff640 10 client.16446 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.281+0000 7f0c80903640 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d29f0900 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d3f7ca9515029b server_cookie=f974cd7660ead9c5 in_seq=0 out_seq=0 2024-04-21T10:28:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c5bfff640 1 -- 172.21.15.77:0/2354161911 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561d28733d0 con 0x5561d2987ee0 2024-04-21T10:28:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c5bfff640 10 client.16446 handle_command_reply: tid=0 2024-04-21T10:28:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 client.16446 shutdown 2024-04-21T10:28:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 msgr2=0x5561d2972650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 0x5561d2972650 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0c740ce0f0 tx=0x7f0c74098d00 comp rx=0 tx=0).stop 2024-04-21T10:28:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 shutdown_connections 2024-04-21T10:28:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5561d2987ee0 0x5561d29f0900 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561d29780e0 0x5561d2972650 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5561d296f8d0 0x5561d2972110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c5bfff640 0 client.16446 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 --2- 172.21.15.77:0/2354161911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5561d296eb60 0x5561d29804b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 >> 172.21.15.77:0/2354161911 conn(0x5561d2935c90 msgr2=0x5561d2974bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 shutdown_connections 2024-04-21T10:28:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 1 -- 172.21.15.77:0/2354161911 wait complete. 2024-04-21T10:28:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.290+0000 7f0c85839740 20 client.16446 trim_cache size 0 max 16384 2024-04-21T10:28:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-04-21T10:28:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-04-21T10:28:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-04-21T10:28:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-04-21T10:28:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0c6c0a3dc0 msgr2=0x7f0c6c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0c6c0a3dc0 0x7f0c6c0a6280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000bc30 tx=0x7f0c7000b390 comp rx=0 tx=0).stop 2024-04-21T10:28:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 msgr2=0x7f0c7c19d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 0x7f0c7c19d400 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400eaa0 tx=0x7f0c7400ef60 comp rx=0 tx=0).stop 2024-04-21T10:28:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 shutdown_connections 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f0c6c0a3dc0 0x7f0c6c0a6280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c7c19cf50 0x7f0c7c19d400 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c7c107290 0x7f0c7c198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 --2- 172.21.15.77:0/1543702273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c7c1021c0 0x7f0c7c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 >> 172.21.15.77:0/1543702273 conn(0x7f0c7c0fda20 msgr2=0x7f0c7c0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 shutdown_connections 2024-04-21T10:28:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:41.291+0000 7f0c82b67640 1 -- 172.21.15.77:0/1543702273 wait complete. 2024-04-21T10:28:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:41 smithi077 ceph-mon[27902]: pgmap v223: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2024-04-21T10:28:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:41 smithi191 ceph-mon[31636]: pgmap v223: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2024-04-21T10:28:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:41 smithi170 ceph-mon[31212]: pgmap v223: 97 pgs: 97 active+clean; 3.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2024-04-21T10:28:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:43 smithi077 ceph-mon[27902]: pgmap v224: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 MiB/s wr, 223 op/s 2024-04-21T10:28:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:43 smithi191 ceph-mon[31636]: pgmap v224: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 MiB/s wr, 223 op/s 2024-04-21T10:28:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:43 smithi170 ceph-mon[31212]: pgmap v224: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 MiB/s wr, 223 op/s 2024-04-21T10:28:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:45 smithi077 ceph-mon[27902]: pgmap v225: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 MiB/s wr, 222 op/s 2024-04-21T10:28:46.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:28:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:45 smithi191 ceph-mon[31636]: pgmap v225: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 MiB/s wr, 222 op/s 2024-04-21T10:28:46.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 -- 172.21.15.77:0/1422795918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0107260 msgr2=0x7f29b010ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 --2- 172.21.15.77:0/1422795918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0107260 0x7f29b010ee30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009ca0 tx=0x7f29a802c0f0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 -- 172.21.15.77:0/1422795918 shutdown_connections 2024-04-21T10:28:46.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 --2- 172.21.15.77:0/1422795918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0107260 0x7f29b010ee30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 --2- 172.21.15.77:0/1422795918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0102b40 0x7f29b0106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 --2- 172.21.15.77:0/1422795918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29b0102190 0x7f29b0102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 -- 172.21.15.77:0/1422795918 >> 172.21.15.77:0/1422795918 conn(0x7f29b00793e0 msgr2=0x7f29b00797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 -- 172.21.15.77:0/1422795918 shutdown_connections 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.257+0000 7f29b5888640 1 -- 172.21.15.77:0/1422795918 wait complete. 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 Processor -- start 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 -- start start 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 0x7f29b0074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29b0107260 0x7f29b0074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0074cd0 0x7f29b01a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01121b0 con 0x7f29b0102190 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112030 con 0x7f29b0107260 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29b5888640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112330 con 0x7f29b0074cd0 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 0x7f29b0074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 0x7f29b0074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54874/0 (socket says 172.21.15.77:54874) 2024-04-21T10:28:46.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.258+0000 7f29aeffd640 1 -- 172.21.15.77:0/1656466051 learned_addr learned my addr 172.21.15.77:0/1656466051 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29af7fe640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0074cd0 0x7f29b01a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29a7fff640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29b0107260 0x7f29b0074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29aeffd640 1 -- 172.21.15.77:0/1656466051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0074cd0 msgr2=0x7f29b01a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29aeffd640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0074cd0 0x7f29b01a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29aeffd640 1 -- 172.21.15.77:0/1656466051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29b0107260 msgr2=0x7f29b0074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29aeffd640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29b0107260 0x7f29b0074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29aeffd640 1 -- 172.21.15.77:0/1656466051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01a6fc0 con 0x7f29b0102190 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29af7fe640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0074cd0 0x7f29b01a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29aeffd640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 0x7f29b0074250 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f29a000d950 tx=0x7f29a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0017070 con 0x7f29b0102190 2024-04-21T10:28:46.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01a72b0 con 0x7f29b0102190 2024-04-21T10:28:46.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a0009c30 con 0x7f29b0102190 2024-04-21T10:28:46.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a000f620 con 0x7f29b0102190 2024-04-21T10:28:46.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.259+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a7800 con 0x7f29b0102190 2024-04-21T10:28:46.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.260+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b0069230 con 0x7f29b0102190 2024-04-21T10:28:46.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.261+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f29a0010460 con 0x7f29b0102190 2024-04-21T10:28:46.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.262+0000 7f29b4886640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f299c0a3d50 0x7f299c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.262+0000 7f29a7fff640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f299c0a3d50 0x7f299c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.262+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7f29a00d04c0 con 0x7f29b0102190 2024-04-21T10:28:46.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.262+0000 7f29a7fff640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f299c0a3d50 0x7f299c0a6210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2998005d80 tx=0x7f2998005c90 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.266+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f29a009cb60 con 0x7f29b0102190 2024-04-21T10:28:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:45 smithi170 ceph-mon[31212]: pgmap v225: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 MiB/s wr, 222 op/s 2024-04-21T10:28:46.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.484+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29b0075780 con 0x7f29b0102190 2024-04-21T10:28:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.484+0000 7f29b4886640 1 -- 172.21.15.77:0/1656466051 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11894 (secure 0 0 0) 0x7f29a009c460 con 0x7f29b0102190 2024-04-21T10:28:46.484 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:28:46.484 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:28:23.136065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":132,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":133,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24491,24505]},"id":1}]} 2024-04-21T10:28:46.485 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 38 2024-04-21T10:28:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f299c0a3d50 msgr2=0x7f299c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f299c0a3d50 0x7f299c0a6210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2998005d80 tx=0x7f2998005c90 comp rx=0 tx=0).stop 2024-04-21T10:28:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 msgr2=0x7f29b0074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 0x7f29b0074250 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f29a000d950 tx=0x7f29a000de10 comp rx=0 tx=0).stop 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 shutdown_connections 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f299c0a3d50 0x7f299c0a6210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29b0074cd0 0x7f29b01a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29b0107260 0x7f29b0074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 --2- 172.21.15.77:0/1656466051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0102190 0x7f29b0074250 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.486+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 >> 172.21.15.77:0/1656466051 conn(0x7f29b00793e0 msgr2=0x7f29b00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.487+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 shutdown_connections 2024-04-21T10:28:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.487+0000 7f29b5888640 1 -- 172.21.15.77:0/1656466051 wait complete. 2024-04-21T10:28:46.498 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db --set-id dd8de954 --release --await' 2024-04-21T10:28:46.498 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db --set-id dd8de954 --release --await 2024-04-21T10:28:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 -- 172.21.15.77:0/3552612795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044101a50 msgr2=0x7fe044105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 --2- 172.21.15.77:0/3552612795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044101a50 0x7fe044105a90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe034009900 tx=0x7fe03402bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 -- 172.21.15.77:0/3552612795 shutdown_connections 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 --2- 172.21.15.77:0/3552612795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044101a50 0x7fe044105a90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 --2- 172.21.15.77:0/3552612795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe044106170 0x7fe04410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 --2- 172.21.15.77:0/3552612795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 0x7fe044101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 -- 172.21.15.77:0/3552612795 >> 172.21.15.77:0/3552612795 conn(0x7fe044077eb0 msgr2=0x7fe0440782c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 -- 172.21.15.77:0/3552612795 shutdown_connections 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.603+0000 7fe04ad32640 1 -- 172.21.15.77:0/3552612795 wait complete. 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 Processor -- start 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 -- start start 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 0x7fe04419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 0x7fe04419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0441985a0 0x7fe044198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441110b0 con 0x7fe044106170 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe044110f30 con 0x7fe0441985a0 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe04ad32640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe044111230 con 0x7fe0441010a0 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 0x7fe04419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 0x7fe04419e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54890/0 (socket says 172.21.15.77:54890) 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 -- 172.21.15.77:0/1144412642 learned_addr learned my addr 172.21.15.77:0/1144412642 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe048ace640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 0x7fe04419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe0492cf640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0441985a0 0x7fe044198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 -- 172.21.15.77:0/1144412642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 msgr2=0x7fe04419e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 0x7fe04419e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 -- 172.21.15.77:0/1144412642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0441985a0 msgr2=0x7fe044198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0441985a0 0x7fe044198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 -- 172.21.15.77:0/1144412642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0441990c0 con 0x7fe044106170 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe048ace640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 0x7fe04419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe0492cf640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0441985a0 0x7fe044198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.604+0000 7fe043fff640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 0x7fe04419e930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe034036040 tx=0x7fe03402c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.605+0000 7fe041ffb640 1 -- 172.21.15.77:0/1144412642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034043020 con 0x7fe044106170 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.605+0000 7fe041ffb640 1 -- 172.21.15.77:0/1144412642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe03402cbe0 con 0x7fe044106170 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.605+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe044199350 con 0x7fe044106170 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.605+0000 7fe041ffb640 1 -- 172.21.15.77:0/1144412642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034003bf0 con 0x7fe044106170 2024-04-21T10:28:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.605+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0441a55a0 con 0x7fe044106170 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe041ffb640 1 -- 172.21.15.77:0/1144412642 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fe034046020 con 0x7fe044106170 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 Processor -- start 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 -- start start 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a18b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a1942d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 0x55b57a196c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b57a0f0500 con 0x55b57a194810 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b57a0966a0 con 0x55b57a18bc30 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe04da01740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b57a0ec4c0 con 0x55b57a18b310 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe041ffb640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe0300a3d20 0x7fe0300a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 0x55b57a196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe0492cf640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe0300a3d20 0x7fe0300a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.607+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 0x55b57a196c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54906/0 (socket says 172.21.15.77:54906) 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 -- 172.21.15.77:0/743766083 learned_addr learned my addr 172.21.15.77:0/743766083 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe048ace640 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a1942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe0492cf640 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a18b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe041ffb640 1 -- 172.21.15.77:0/1144412642 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7fe0340f29f0 con 0x7fe044106170 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 -- 172.21.15.77:0/743766083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 msgr2=0x55b57a18b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a18b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 -- 172.21.15.77:0/743766083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 msgr2=0x55b57a1942d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a1942d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 -- 172.21.15.77:0/743766083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b57a0b55e0 con 0x55b57a194810 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe0492cf640 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a18b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe0492cf640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe0300a3d20 0x7fe0300a61e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe02c005fd0 tx=0x7fe02c0123f0 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe043fff640 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 0x55b57a196c00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe034005ec0 tx=0x7fe03402cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ebcc2c75a483f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe03affd640 1 -- 172.21.15.77:0/743766083 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340bf1a0 con 0x55b57a194810 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe03affd640 1 -- 172.21.15.77:0/743766083 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0340beaa0 con 0x55b57a194810 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.608+0000 7fe03affd640 1 -- 172.21.15.77:0/743766083 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340bce80 con 0x55b57a194810 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 -- 172.21.15.77:0/743766083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 msgr2=0x55b57a196c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 0x55b57a196c00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe034005ec0 tx=0x7fe03402cd90 comp rx=0 tx=0).stop 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 -- 172.21.15.77:0/743766083 shutdown_connections 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a194810 0x55b57a196c00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a1942d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 --2- 172.21.15.77:0/743766083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a18b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 -- 172.21.15.77:0/743766083 >> 172.21.15.77:0/743766083 conn(0x55b57a185a40 msgr2=0x55b57a185e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 -- 172.21.15.77:0/743766083 shutdown_connections 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 -- 172.21.15.77:0/743766083 wait complete. 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 -- start start 2024-04-21T10:28:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.609+0000 7fe04da01740 1 Processor -- start 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a1916d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 0x55b57a191c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a194810 0x55b57a192150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b57a1973c0 con 0x55b57a18bc30 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b57a0a9a60 con 0x55b57a194810 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b57a197540 con 0x55b57a18b310 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 10 client.0 _ll_register_callbacks cb 0x55b579e02110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 0x55b57a191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 0x55b57a191c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54912/0 (socket says 172.21.15.77:54912) 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 -- 172.21.15.77:0/3159580417 learned_addr learned my addr 172.21.15.77:0/3159580417 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe0492cf640 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a194810 0x55b57a192150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 -- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 msgr2=0x55b57a1916d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a1916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 -- 172.21.15.77:0/3159580417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a194810 msgr2=0x55b57a192150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a194810 0x55b57a192150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 -- 172.21.15.77:0/3159580417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b579e02920 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe043fff640 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 0x55b57a191c10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0340be7a0 tx=0x7fe0340c7a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc2cdcfc9a14e4e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe023fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe023fff640 1 -- 172.21.15.77:0/3159580417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340c2e50 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0340beaa0 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe023fff640 1 -- 172.21.15.77:0/3159580417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7fe0340f03c0 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe023fff640 1 -- 172.21.15.77:0/3159580417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe0340d8020 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.610+0000 7fe04da01740 10 client.16464 fetch_fsmap learned FSMap version 38 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b579eced30 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe023fff640 1 -- 172.21.15.77:0/3159580417 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0340beaa0 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe023fff640 1 -- 172.21.15.77:0/3159580417 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fe0340c7c40 con 0x55b57a18bc30 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 10 client.16464 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T10:28:46.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 10 client.16464 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 20 client.16464 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a1a45f0 0x55b57a1a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 4 client.16464 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b57a0c3a10 con 0x55b57a1a45f0 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.611+0000 7fe048ace640 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a1a45f0 0x55b57a1a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe023fff640 10 client.16464 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe048ace640 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a1a45f0 0x55b57a1a6a30 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0f96afea9f686d server_cookie=fbb0772d0e024e50 in_seq=0 out_seq=0 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe023fff640 1 -- 172.21.15.77:0/3159580417 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b57a0c3a10 con 0x55b57a1a45f0 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe023fff640 10 client.16464 handle_command_reply: tid=0 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe04da01740 1 client.16464 shutdown 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 msgr2=0x55b57a191c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.612+0000 7fe04da01740 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 0x55b57a191c10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0340be7a0 tx=0x7fe0340c7a20 comp rx=0 tx=0).stop 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 shutdown_connections 2024-04-21T10:28:46.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a1a45f0 0x55b57a1a6a30 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18bc30 0x55b57a191c10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a194810 0x55b57a192150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe023fff640 0 client.16464 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 --2- 172.21.15.77:0/3159580417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a1916d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 >> 172.21.15.77:0/3159580417 conn(0x55b57a185a40 msgr2=0x55b57a187790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 shutdown_connections 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 1 -- 172.21.15.77:0/3159580417 wait complete. 2024-04-21T10:28:46.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.613+0000 7fe04da01740 20 client.16464 trim_cache size 0 max 16384 2024-04-21T10:28:46.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 Processor -- start 2024-04-21T10:28:46.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 -- start start 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a185a40 0x55b57a1a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 0x55b57a191da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18bc30 0x55b57a1ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441b04c0 con 0x55b57a18b310 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441add30 con 0x55b57a185a40 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe04da01740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441abba0 con 0x55b57a18bc30 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 0x55b57a191da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 0x55b57a191da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54926/0 (socket says 172.21.15.77:54926) 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 -- 172.21.15.77:0/2026279376 learned_addr learned my addr 172.21.15.77:0/2026279376 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 -- 172.21.15.77:0/2026279376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18bc30 msgr2=0x55b57a1ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18bc30 0x55b57a1ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 -- 172.21.15.77:0/2026279376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a185a40 msgr2=0x55b57a1a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a185a40 0x55b57a1a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 -- 172.21.15.77:0/2026279376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b57a17fc50 con 0x55b57a18b310 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.630+0000 7fe043fff640 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 0x55b57a191da0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe0340bea30 tx=0x7fe0340c8050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3b2c7b26df7261 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe03a7fc640 1 -- 172.21.15.77:0/2026279376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340be870 con 0x55b57a18b310 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe03a7fc640 1 -- 172.21.15.77:0/2026279376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0340bf1a0 con 0x55b57a18b310 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe03a7fc640 1 -- 172.21.15.77:0/2026279376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340c7bf0 con 0x55b57a18b310 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 -- 172.21.15.77:0/2026279376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 msgr2=0x55b57a191da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 0x55b57a191da0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe0340bea30 tx=0x7fe0340c8050 comp rx=0 tx=0).stop 2024-04-21T10:28:46.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 -- 172.21.15.77:0/2026279376 shutdown_connections 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a18b310 0x55b57a191da0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18bc30 0x55b57a1ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 --2- 172.21.15.77:0/2026279376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a185a40 0x55b57a1a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 -- 172.21.15.77:0/2026279376 >> 172.21.15.77:0/2026279376 conn(0x55b57a190310 msgr2=0x55b57a191690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 -- 172.21.15.77:0/2026279376 shutdown_connections 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 -- 172.21.15.77:0/2026279376 wait complete. 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.631+0000 7fe04da01740 1 -- start start 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 Processor -- start 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 0x55b57a1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a199710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a199c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441ac1f0 con 0x55b57a185a40 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441ad660 con 0x55b57a18bc30 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe0441ac8c0 con 0x55b57a18b310 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe04da01740 10 client.0 _ll_register_callbacks cb 0x7fe03c009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 0x55b57a1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 0x55b57a1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54930/0 (socket says 172.21.15.77:54930) 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 -- 172.21.15.77:0/1058311973 learned_addr learned my addr 172.21.15.77:0/1058311973 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe043fff640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe0492cf640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 -- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 msgr2=0x55b57a199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 -- 172.21.15.77:0/1058311973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 msgr2=0x55b57a199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 -- 172.21.15.77:0/1058311973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b57a20ad30 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe048ace640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 0x55b57a1991d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009670 tx=0x7fe03c0139b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4ae596a1262584 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.632+0000 7fe023fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe023fff640 1 -- 172.21.15.77:0/1058311973 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c01f070 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe023fff640 1 -- 172.21.15.77:0/1058311973 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7fe03c01b2c0 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0340bf1a0 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe023fff640 1 -- 172.21.15.77:0/1058311973 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe03c02b050 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 10 client.16470 fetch_fsmap learned FSMap version 38 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b57a20c090 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe023fff640 1 -- 172.21.15.77:0/1058311973 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0340bf1a0 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe023fff640 1 -- 172.21.15.77:0/1058311973 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fe03c00f040 con 0x55b57a185a40 2024-04-21T10:28:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 10 client.16470 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 10 client.16470 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 20 client.16470 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a194810 0x55b57a20e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 4 client.16470 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dd8de954", "release": true, "await": true}] 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dd8de954", "release": true, "await": true}) -- 0x55b57a0fdf20 con 0x55b57a194810 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.633+0000 7fe043fff640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a194810 0x55b57a20e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.634+0000 7fe043fff640 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a194810 0x55b57a20e860 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b2d3862ff1c40d server_cookie=4bf1fb5dc794d606 in_seq=0 out_seq=0 2024-04-21T10:28:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.634+0000 7fe023fff640 10 client.16470 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:46.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe023fff640 1 -- 172.21.15.77:0/1058311973 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b57a0fdf20 con 0x55b57a194810 2024-04-21T10:28:46.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe023fff640 10 client.16470 handle_command_reply: tid=0 2024-04-21T10:28:46.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 client.16470 shutdown 2024-04-21T10:28:46.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 msgr2=0x55b57a1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 0x55b57a1991d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009670 tx=0x7fe03c0139b0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 shutdown_connections 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55b57a194810 0x55b57a20e860 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b57a18bc30 0x55b57a199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b57a18b310 0x55b57a199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe023fff640 0 client.16470 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 --2- 172.21.15.77:0/1058311973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b57a185a40 0x55b57a1991d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.638+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 >> 172.21.15.77:0/1058311973 conn(0x55b57a190310 msgr2=0x55b57a184b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 shutdown_connections 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04da01740 1 -- 172.21.15.77:0/1058311973 wait complete. 2024-04-21T10:28:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04da01740 20 client.16470 trim_cache size 0 max 16384 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 38, 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24505, 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 28, 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout: "dd8de954": { 2024-04-21T10:28:46.643 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 28, 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 30.0, 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 85.7, 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-04-21T10:28:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-21T10:28:46.645 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-21T10:28:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe0300a3d20 msgr2=0x7fe0300a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe0300a3d20 0x7fe0300a61e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe02c005fd0 tx=0x7fe02c0123f0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 msgr2=0x7fe04419e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 0x7fe04419e930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe034036040 tx=0x7fe03402c7e0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 shutdown_connections 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7fe0300a3d20 0x7fe0300a61e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe044106170 0x7fe04419e930 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0441985a0 0x7fe044198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.639+0000 7fe04ad32640 1 --2- 172.21.15.77:0/1144412642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0441010a0 0x7fe04419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.640+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 >> 172.21.15.77:0/1144412642 conn(0x7fe044077eb0 msgr2=0x7fe044104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.640+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 shutdown_connections 2024-04-21T10:28:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:28:46.640+0000 7fe04ad32640 1 -- 172.21.15.77:0/1144412642 wait complete. 2024-04-21T10:28:46.651 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: dd8de954, seconds elapsed: 27.3 2024-04-21T10:28:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:46 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/1656466051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:46 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/1656466051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:46 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/1656466051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:28:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:47 smithi077 ceph-mon[27902]: pgmap v226: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-04-21T10:28:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:47 smithi191 ceph-mon[31636]: pgmap v226: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-04-21T10:28:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:47 smithi170 ceph-mon[31212]: pgmap v226: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-04-21T10:28:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 425.0 s, 257.9 tps, lat 1983.690 ms stddev 6912.960 2024-04-21T10:28:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:49 smithi077 ceph-mon[27902]: pgmap v227: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.5 MiB/s wr, 224 op/s 2024-04-21T10:28:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:49 smithi191 ceph-mon[31636]: pgmap v227: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.5 MiB/s wr, 224 op/s 2024-04-21T10:28:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:49 smithi170 ceph-mon[31212]: pgmap v227: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.5 MiB/s wr, 224 op/s 2024-04-21T10:28:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:51 smithi077 ceph-mon[27902]: pgmap v228: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.4 MiB/s wr, 337 op/s 2024-04-21T10:28:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 243.241291 secs 2024-04-21T10:28:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:51 smithi191 ceph-mon[31636]: pgmap v228: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.4 MiB/s wr, 337 op/s 2024-04-21T10:28:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 243.241291 secs 2024-04-21T10:28:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:51 smithi170 ceph-mon[31212]: pgmap v228: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.4 MiB/s wr, 337 op/s 2024-04-21T10:28:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 243.241291 secs 2024-04-21T10:28:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:53 smithi077 ceph-mon[27902]: pgmap v229: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 315 op/s 2024-04-21T10:28:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:53 smithi191 ceph-mon[31636]: pgmap v229: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 315 op/s 2024-04-21T10:28:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:53 smithi170 ceph-mon[31212]: pgmap v229: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 315 op/s 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 -- 172.21.15.77:0/4049351300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78106f70 msgr2=0x7efd78107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 --2- 172.21.15.77:0/4049351300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78106f70 0x7efd78107350 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009930 tx=0x7efd6c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 -- 172.21.15.77:0/4049351300 shutdown_connections 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 --2- 172.21.15.77:0/4049351300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd78101af0 0x7efd7810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 --2- 172.21.15.77:0/4049351300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd78101130 0x7efd781015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 --2- 172.21.15.77:0/4049351300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78106f70 0x7efd78107350 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 -- 172.21.15.77:0/4049351300 >> 172.21.15.77:0/4049351300 conn(0x7efd78077ba0 msgr2=0x7efd78077fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 -- 172.21.15.77:0/4049351300 shutdown_connections 2024-04-21T10:28:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.387+0000 7efd7f76d640 1 -- 172.21.15.77:0/4049351300 wait complete. 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 Processor -- start 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 -- start start 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78101130 0x7efd78198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd78101af0 0x7efd78198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd78106f70 0x7efd7819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd78112210 con 0x7efd78101130 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd78112090 con 0x7efd78101af0 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7f76d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd78112390 con 0x7efd78106f70 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78101130 0x7efd78198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78101130 0x7efd78198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59304/0 (socket says 172.21.15.77:59304) 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 -- 172.21.15.77:0/823123653 learned_addr learned my addr 172.21.15.77:0/823123653 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd78106f70 0x7efd7819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7cd08640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd78101af0 0x7efd78198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd78106f70 msgr2=0x7efd7819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd78106f70 0x7efd7819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd78101af0 msgr2=0x7efd78198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd78101af0 0x7efd78198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7819d660 con 0x7efd78101130 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7cd08640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd78101af0 0x7efd78198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.388+0000 7efd7d509640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78101130 0x7efd78198670 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efd6c005940 tx=0x7efd6c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.389+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c043020 con 0x7efd78101130 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.389+0000 7efd7f76d640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7819d8f0 con 0x7efd78101130 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.389+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6c004440 con 0x7efd78101130 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.389+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c003b50 con 0x7efd78101130 2024-04-21T10:28:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.389+0000 7efd7f76d640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd781a51e0 con 0x7efd78101130 2024-04-21T10:28:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.391+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7efd6c046020 con 0x7efd78101130 2024-04-21T10:28:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.391+0000 7efd82434740 1 Processor -- start 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.391+0000 7efd82434740 1 -- start start 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd82434740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726990620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd82434740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726990fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd82434740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x56372699c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd82434740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5637268f58d0 con 0x56372699a0e0 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd82434740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563726892e80 con 0x5637269918d0 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd82434740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5637268f1890 con 0x563726990b60 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7efd6c0f22a0 con 0x7efd78101130 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7d509640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726990620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726990fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7d509640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726990620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:60218/0 (socket says 172.21.15.77:60218) 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7dd0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x56372699c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7d509640 1 -- 172.21.15.77:0/2353236555 learned_addr learned my addr 172.21.15.77:0/2353236555 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726990fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.77:54976/0 (socket says 172.21.15.77:54976) 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 -- 172.21.15.77:0/2353236555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 msgr2=0x563726990620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726990620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 -- 172.21.15.77:0/2353236555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 msgr2=0x56372699c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x56372699c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7cd08640 1 -- 172.21.15.77:0/2353236555 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637268b4320 con 0x563726990b60 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x56372699c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.392+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a6280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd700098b0 tx=0x7efd70009e20 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd7cd08640 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726990fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd74009c00 tx=0x7efd740113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95283692318f2264 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd637fe640 1 -- 172.21.15.77:0/2353236555 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74011db0 con 0x563726990b60 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd637fe640 1 -- 172.21.15.77:0/2353236555 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd740054d0 con 0x563726990b60 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd637fe640 1 -- 172.21.15.77:0/2353236555 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74012450 con 0x563726990b60 2024-04-21T10:28:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 -- 172.21.15.77:0/2353236555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 msgr2=0x563726990fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726990fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd74009c00 tx=0x7efd740113e0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 -- 172.21.15.77:0/2353236555 shutdown_connections 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x56372699c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726990fe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 --2- 172.21.15.77:0/2353236555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726990620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.393+0000 7efd82434740 1 -- 172.21.15.77:0/2353236555 >> 172.21.15.77:0/2353236555 conn(0x563726957c90 msgr2=0x56372698b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 -- 172.21.15.77:0/2353236555 shutdown_connections 2024-04-21T10:28:54.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 -- 172.21.15.77:0/2353236555 wait complete. 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 -- start start 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 Processor -- start 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726999a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726996d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x5637269972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56372699ce10 con 0x56372699a0e0 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56372687deb0 con 0x5637269918d0 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56372699cf90 con 0x563726990b60 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.394+0000 7efd82434740 10 client.0 _ll_register_callbacks cb 0x5637268aab40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x5637269972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x5637269972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59322/0 (socket says 172.21.15.77:59322) 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/1639454560 learned_addr learned my addr 172.21.15.77:0/1639454560 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7d509640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726999a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7cd08640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726996d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 msgr2=0x563726999a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726999a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/1639454560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 msgr2=0x563726996d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726996d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/1639454560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563726608210 con 0x56372699a0e0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x5637269972d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efd70010e50 tx=0x7efd70009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7482ad690c849b1b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd60ff9640 1 -- 172.21.15.77:0/1639454560 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd700045b0 con 0x56372699a0e0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd60ff9640 1 -- 172.21.15.77:0/1639454560 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7efd70004750 con 0x56372699a0e0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd740054d0 con 0x56372699a0e0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd60ff9640 1 -- 172.21.15.77:0/1639454560 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efd70029480 con 0x56372699a0e0 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd82434740 10 client.16482 fetch_fsmap learned FSMap version 39 2024-04-21T10:28:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.395+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5637266d4620 con 0x56372699a0e0 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd60ff9640 1 -- 172.21.15.77:0/1639454560 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd740054d0 con 0x56372699a0e0 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd60ff9640 1 -- 172.21.15.77:0/1639454560 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7efd7001f070 con 0x56372699a0e0 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd82434740 10 client.16482 fetch_fsmap finished waiting for FSMap version 39 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd82434740 10 client.16482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd82434740 20 client.16482 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd82434740 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5637269aa0e0 0x5637269ac550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd82434740 4 client.16482 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563726909880 con 0x5637269aa0e0 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd7d509640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5637269aa0e0 0x5637269ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd7d509640 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5637269aa0e0 0x5637269ac550 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dad4dd362ec6bca server_cookie=6f507809dab18b51 in_seq=0 out_seq=0 2024-04-21T10:28:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.396+0000 7efd60ff9640 10 client.16482 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd60ff9640 1 -- 172.21.15.77:0/1639454560 <== mds.0 v2:172.21.15.191:6838/2863843162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563726909880 con 0x5637269aa0e0 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd60ff9640 10 client.16482 handle_command_reply: tid=0 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 client.16482 shutdown 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 msgr2=0x5637269972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x5637269972d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efd70010e50 tx=0x7efd70009600 comp rx=0 tx=0).stop 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 shutdown_connections 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x5637269aa0e0 0x5637269ac550 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x5637269972d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637269918d0 0x563726996d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 --2- 172.21.15.77:0/1639454560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563726990b60 0x563726999a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 >> 172.21.15.77:0/1639454560 conn(0x563726957c90 msgr2=0x56372698d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd60ff9640 0 client.16482 ms_handle_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.397+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 shutdown_connections 2024-04-21T10:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.398+0000 7efd82434740 1 -- 172.21.15.77:0/1639454560 wait complete. 2024-04-21T10:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.398+0000 7efd82434740 20 client.16482 trim_cache size 0 max 16384 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.412+0000 7efd82434740 1 Processor -- start 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.412+0000 7efd82434740 1 -- start start 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd82434740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd82434740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637269918d0 0x5637269994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd82434740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x563726999a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd82434740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd781b03c0 con 0x56372699a0e0 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd82434740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd781adc30 con 0x563726990b60 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd82434740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd781abaa0 con 0x5637269918d0 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x563726999a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x563726999a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59334/0 (socket says 172.21.15.77:59334) 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 -- 172.21.15.77:0/2694855387 learned_addr learned my addr 172.21.15.77:0/2694855387 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7cd08640 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637269918d0 0x5637269994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 -- 172.21.15.77:0/2694855387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637269918d0 msgr2=0x5637269994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637269918d0 0x5637269994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 -- 172.21.15.77:0/2694855387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 msgr2=0x5637269a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 -- 172.21.15.77:0/2694855387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637269ac8c0 con 0x56372699a0e0 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7cd08640 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637269918d0 0x5637269994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x563726999a00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efd70003f90 tx=0x7efd70005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ccda2d08dddd30 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd62ffd640 1 -- 172.21.15.77:0/2694855387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70012920 con 0x56372699a0e0 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd62ffd640 1 -- 172.21.15.77:0/2694855387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd70037020 con 0x56372699a0e0 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.413+0000 7efd62ffd640 1 -- 172.21.15.77:0/2694855387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70004660 con 0x56372699a0e0 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 -- 172.21.15.77:0/2694855387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 msgr2=0x563726999a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x563726999a00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efd70003f90 tx=0x7efd70005f70 comp rx=0 tx=0).stop 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 -- 172.21.15.77:0/2694855387 shutdown_connections 2024-04-21T10:28:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56372699a0e0 0x563726999a00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637269918d0 0x5637269994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 --2- 172.21.15.77:0/2694855387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 -- 172.21.15.77:0/2694855387 >> 172.21.15.77:0/2694855387 conn(0x563726957c90 msgr2=0x56372698b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 -- 172.21.15.77:0/2694855387 shutdown_connections 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 -- 172.21.15.77:0/2694855387 wait complete. 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 -- start start 2024-04-21T10:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.414+0000 7efd82434740 1 Processor -- start 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637269918d0 0x5637269a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56372699a0e0 0x56372699d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd781ac0f0 con 0x5637269918d0 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd781ad560 con 0x563726990b60 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd781ac7c0 con 0x56372699a0e0 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd82434740 10 client.0 _ll_register_callbacks cb 0x7efd70010b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637269918d0 0x5637269a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637269918d0 0x5637269a2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59338/0 (socket says 172.21.15.77:59338) 2024-04-21T10:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 -- 172.21.15.77:0/826097124 learned_addr learned my addr 172.21.15.77:0/826097124 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56372699a0e0 0x56372699d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56372699a0e0 msgr2=0x56372699d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56372699a0e0 0x56372699d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 msgr2=0x5637269a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56372699dfe0 con 0x5637269918d0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563726990b60 0x5637269a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd7cd08640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637269918d0 0x5637269a2760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efd740118e0 tx=0x7efd740098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5403959e1e9a768 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.415+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74004c90 con 0x5637269918d0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8513+0+0 (secure 0 0 0) 0x7efd74004e30 con 0x5637269918d0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd70037020 con 0x5637269918d0 2024-04-21T10:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efd74005030 con 0x5637269918d0 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 10 client.16488 fetch_fsmap learned FSMap version 39 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563726a102f0 con 0x5637269918d0 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd70037020 con 0x5637269918d0 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7efd74012a20 con 0x5637269918d0 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 10 client.16488 fetch_fsmap finished waiting for FSMap version 39 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 10 client.16488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 20 client.16488 populate_metadata read hostname 'smithi077' 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 4 client.16488 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd82434740 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5637268953d0 con 0x563726a107e0 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.416+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.417+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:28:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:28:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9cc4eec819a74d server_cookie=d46061fd3604761d in_seq=0 out_seq=0 2024-04-21T10:28:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:28:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:54 smithi077 ceph-mon[27902]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:28:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:54 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:28:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:54 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:28:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:54 smithi191 ceph-mon[31636]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:28:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:54 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:28:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:54 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:28:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:54 smithi170 ceph-mon[31212]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:28:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:54 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.170:6838/4122605825,v1:172.21.15.170:6839/4122605825] up:active 2024-04-21T10:28:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:54 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:28:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:55 smithi077 ceph-mon[27902]: pgmap v230: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.8 MiB/s wr, 207 op/s 2024-04-21T10:28:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:55 smithi191 ceph-mon[31636]: pgmap v230: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.8 MiB/s wr, 207 op/s 2024-04-21T10:28:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:55 smithi170 ceph-mon[31212]: pgmap v230: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.8 MiB/s wr, 207 op/s 2024-04-21T10:28:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 248.241418 secs 2024-04-21T10:28:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 248.241418 secs 2024-04-21T10:28:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 248.241418 secs 2024-04-21T10:28:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:57 smithi077 ceph-mon[27902]: pgmap v231: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-04-21T10:28:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:57 smithi191 ceph-mon[31636]: pgmap v231: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-04-21T10:28:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:57 smithi170 ceph-mon[31212]: pgmap v231: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-04-21T10:29:00.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:28:59 smithi170 ceph-mon[31212]: pgmap v232: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-04-21T10:29:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:28:59 smithi077 ceph-mon[27902]: pgmap v232: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-04-21T10:29:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:28:59 smithi191 ceph-mon[31636]: pgmap v232: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-04-21T10:29:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:01 smithi077 ceph-mon[27902]: pgmap v233: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.4 MiB/s wr, 293 op/s 2024-04-21T10:29:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 253.241564 secs 2024-04-21T10:29:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:01 smithi191 ceph-mon[31636]: pgmap v233: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.4 MiB/s wr, 293 op/s 2024-04-21T10:29:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 253.241564 secs 2024-04-21T10:29:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:01 smithi170 ceph-mon[31212]: pgmap v233: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.4 MiB/s wr, 293 op/s 2024-04-21T10:29:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 253.241564 secs 2024-04-21T10:29:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:03 smithi077 ceph-mon[27902]: pgmap v234: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.7 MiB/s wr, 197 op/s 2024-04-21T10:29:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:03 smithi191 ceph-mon[31636]: pgmap v234: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.7 MiB/s wr, 197 op/s 2024-04-21T10:29:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:03 smithi170 ceph-mon[31212]: pgmap v234: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.7 MiB/s wr, 197 op/s 2024-04-21T10:29:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:04 smithi077 ceph-mon[27902]: osdmap e91: 12 total, 12 up, 12 in 2024-04-21T10:29:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:04 smithi191 ceph-mon[31636]: osdmap e91: 12 total, 12 up, 12 in 2024-04-21T10:29:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:04 smithi170 ceph-mon[31212]: osdmap e91: 12 total, 12 up, 12 in 2024-04-21T10:29:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:05 smithi077 ceph-mon[27902]: pgmap v236: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 961 KiB/s wr, 129 op/s 2024-04-21T10:29:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:05 smithi191 ceph-mon[31636]: pgmap v236: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 961 KiB/s wr, 129 op/s 2024-04-21T10:29:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:05 smithi170 ceph-mon[31212]: pgmap v236: 97 pgs: 97 active+clean; 3.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 961 KiB/s wr, 129 op/s 2024-04-21T10:29:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 258.241691 secs 2024-04-21T10:29:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 258.241691 secs 2024-04-21T10:29:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 258.241691 secs 2024-04-21T10:29:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:07 smithi191 ceph-mon[31636]: pgmap v237: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 837 KiB/s wr, 118 op/s 2024-04-21T10:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:07 smithi170 ceph-mon[31212]: pgmap v237: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 837 KiB/s wr, 118 op/s 2024-04-21T10:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:07 smithi077 ceph-mon[27902]: pgmap v237: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 837 KiB/s wr, 118 op/s 2024-04-21T10:29:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:10.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:09 smithi077 ceph-mon[27902]: pgmap v238: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 837 KiB/s wr, 118 op/s 2024-04-21T10:29:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:09 smithi191 ceph-mon[31636]: pgmap v238: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 837 KiB/s wr, 118 op/s 2024-04-21T10:29:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:09 smithi170 ceph-mon[31212]: pgmap v238: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 837 KiB/s wr, 118 op/s 2024-04-21T10:29:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:11 smithi191 ceph-mon[31636]: pgmap v239: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 800 KiB/s wr, 111 op/s 2024-04-21T10:29:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:11 smithi191 ceph-mon[31636]: osdmap e92: 12 total, 12 up, 12 in 2024-04-21T10:29:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 263.241820 secs 2024-04-21T10:29:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:11 smithi170 ceph-mon[31212]: pgmap v239: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 800 KiB/s wr, 111 op/s 2024-04-21T10:29:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:11 smithi170 ceph-mon[31212]: osdmap e92: 12 total, 12 up, 12 in 2024-04-21T10:29:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 263.241820 secs 2024-04-21T10:29:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:11 smithi077 ceph-mon[27902]: pgmap v239: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 800 KiB/s wr, 111 op/s 2024-04-21T10:29:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:11 smithi077 ceph-mon[27902]: osdmap e92: 12 total, 12 up, 12 in 2024-04-21T10:29:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 263.241820 secs 2024-04-21T10:29:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:13 smithi191 ceph-mon[31636]: pgmap v241: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 966 KiB/s wr, 133 op/s 2024-04-21T10:29:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:13 smithi170 ceph-mon[31212]: pgmap v241: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 966 KiB/s wr, 133 op/s 2024-04-21T10:29:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:13 smithi077 ceph-mon[27902]: pgmap v241: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 966 KiB/s wr, 133 op/s 2024-04-21T10:29:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:15 smithi191 ceph-mon[31636]: pgmap v242: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 807 KiB/s wr, 111 op/s 2024-04-21T10:29:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:15 smithi170 ceph-mon[31212]: pgmap v242: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 807 KiB/s wr, 111 op/s 2024-04-21T10:29:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:15 smithi077 ceph-mon[27902]: pgmap v242: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 807 KiB/s wr, 111 op/s 2024-04-21T10:29:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 268.241930 secs 2024-04-21T10:29:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 268.241930 secs 2024-04-21T10:29:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 268.241930 secs 2024-04-21T10:29:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:17 smithi191 ceph-mon[31636]: pgmap v243: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 462 KiB/s wr, 63 op/s 2024-04-21T10:29:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:17 smithi170 ceph-mon[31212]: pgmap v243: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 462 KiB/s wr, 63 op/s 2024-04-21T10:29:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:17 smithi077 ceph-mon[27902]: pgmap v243: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 462 KiB/s wr, 63 op/s 2024-04-21T10:29:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:19 smithi191 ceph-mon[31636]: pgmap v244: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 462 KiB/s wr, 63 op/s 2024-04-21T10:29:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:19 smithi170 ceph-mon[31212]: pgmap v244: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 462 KiB/s wr, 63 op/s 2024-04-21T10:29:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:19 smithi077 ceph-mon[27902]: pgmap v244: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 462 KiB/s wr, 63 op/s 2024-04-21T10:29:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:21 smithi191 ceph-mon[31636]: pgmap v245: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 227 KiB/s wr, 33 op/s 2024-04-21T10:29:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 273.242017 secs 2024-04-21T10:29:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:21 smithi170 ceph-mon[31212]: pgmap v245: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 227 KiB/s wr, 33 op/s 2024-04-21T10:29:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 273.242017 secs 2024-04-21T10:29:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:21 smithi077 ceph-mon[27902]: pgmap v245: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 227 KiB/s wr, 33 op/s 2024-04-21T10:29:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 273.242017 secs 2024-04-21T10:29:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:23 smithi191 ceph-mon[31636]: pgmap v246: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-04-21T10:29:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:23 smithi170 ceph-mon[31212]: pgmap v246: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-04-21T10:29:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:23 smithi077 ceph-mon[27902]: pgmap v246: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-04-21T10:29:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:25 smithi191 ceph-mon[31636]: pgmap v247: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:25 smithi170 ceph-mon[31212]: pgmap v247: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:25 smithi077 ceph-mon[27902]: pgmap v247: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 278.242128 secs 2024-04-21T10:29:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 278.242128 secs 2024-04-21T10:29:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 278.242128 secs 2024-04-21T10:29:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:27 smithi191 ceph-mon[31636]: pgmap v248: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 83 KiB/s wr, 18 op/s 2024-04-21T10:29:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:27 smithi170 ceph-mon[31212]: pgmap v248: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 83 KiB/s wr, 18 op/s 2024-04-21T10:29:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:27 smithi077 ceph-mon[27902]: pgmap v248: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 83 KiB/s wr, 18 op/s 2024-04-21T10:29:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:29 smithi191 ceph-mon[31636]: pgmap v249: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-04-21T10:29:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:29 smithi170 ceph-mon[31212]: pgmap v249: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-04-21T10:29:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:29 smithi077 ceph-mon[27902]: pgmap v249: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-04-21T10:29:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:31 smithi191 ceph-mon[31636]: pgmap v250: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-04-21T10:29:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 283.242193 secs 2024-04-21T10:29:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:31 smithi170 ceph-mon[31212]: pgmap v250: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-04-21T10:29:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 283.242193 secs 2024-04-21T10:29:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:31 smithi077 ceph-mon[27902]: pgmap v250: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-04-21T10:29:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 283.242193 secs 2024-04-21T10:29:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:33 smithi191 ceph-mon[31636]: pgmap v251: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:33 smithi170 ceph-mon[31212]: pgmap v251: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:33 smithi077 ceph-mon[27902]: pgmap v251: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:35 smithi191 ceph-mon[31636]: pgmap v252: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:35 smithi170 ceph-mon[31212]: pgmap v252: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:35 smithi077 ceph-mon[27902]: pgmap v252: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-04-21T10:29:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 288.242311 secs 2024-04-21T10:29:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:29:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 288.242311 secs 2024-04-21T10:29:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:29:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 288.242311 secs 2024-04-21T10:29:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:29:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:37 smithi191 ceph-mon[31636]: pgmap v253: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-04-21T10:29:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:29:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:29:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:29:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:37 smithi170 ceph-mon[31212]: pgmap v253: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-04-21T10:29:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:29:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:29:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:29:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:37 smithi077 ceph-mon[27902]: pgmap v253: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-04-21T10:29:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:29:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:29:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:29:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:39 smithi191 ceph-mon[31636]: pgmap v254: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-04-21T10:29:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:39 smithi170 ceph-mon[31212]: pgmap v254: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-04-21T10:29:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:39 smithi077 ceph-mon[27902]: pgmap v254: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-04-21T10:29:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:41 smithi170 ceph-mon[31212]: pgmap v255: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-04-21T10:29:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 293.242457 secs 2024-04-21T10:29:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:41 smithi077 ceph-mon[27902]: pgmap v255: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-04-21T10:29:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 293.242457 secs 2024-04-21T10:29:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:41 smithi191 ceph-mon[31636]: pgmap v255: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-04-21T10:29:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 293.242457 secs 2024-04-21T10:29:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:43 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:29:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:43 smithi077 ceph-mon[27902]: pgmap v256: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-04-21T10:29:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:43 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:29:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:43 smithi191 ceph-mon[31636]: pgmap v256: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-04-21T10:29:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:43 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:29:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:43 smithi170 ceph-mon[31212]: pgmap v256: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-04-21T10:29:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:45 smithi170 ceph-mon[31212]: pgmap v257: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-04-21T10:29:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:45 smithi077 ceph-mon[27902]: pgmap v257: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-04-21T10:29:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:45 smithi191 ceph-mon[31636]: pgmap v257: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-04-21T10:29:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:47 smithi170 ceph-mon[31212]: pgmap v258: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-04-21T10:29:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 298.242612 secs 2024-04-21T10:29:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:47 smithi077 ceph-mon[27902]: pgmap v258: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-04-21T10:29:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 298.242612 secs 2024-04-21T10:29:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:47 smithi191 ceph-mon[31636]: pgmap v258: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-04-21T10:29:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 298.242612 secs 2024-04-21T10:29:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:48 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:29:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:48 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:29:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:48 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:29:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:49 smithi077 ceph-mon[27902]: pgmap v259: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-04-21T10:29:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:49 smithi191 ceph-mon[31636]: pgmap v259: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-04-21T10:29:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:49 smithi170 ceph-mon[31212]: pgmap v259: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-04-21T10:29:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:51 smithi077 ceph-mon[27902]: pgmap v260: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-04-21T10:29:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:51 smithi191 ceph-mon[31636]: pgmap v260: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-04-21T10:29:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:51 smithi170 ceph-mon[31212]: pgmap v260: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-04-21T10:29:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 303.242754 secs 2024-04-21T10:29:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 303.242754 secs 2024-04-21T10:29:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 303.242754 secs 2024-04-21T10:29:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:53 smithi077 ceph-mon[27902]: pgmap v261: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:53 smithi191 ceph-mon[31636]: pgmap v261: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:53 smithi170 ceph-mon[31212]: pgmap v261: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:29:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:55 smithi077 ceph-mon[27902]: pgmap v262: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:55 smithi191 ceph-mon[31636]: pgmap v262: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:55 smithi170 ceph-mon[31212]: pgmap v262: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:57 smithi077 ceph-mon[27902]: pgmap v263: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:29:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 308.242884 secs 2024-04-21T10:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:57 smithi191 ceph-mon[31636]: pgmap v263: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 308.242884 secs 2024-04-21T10:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:57 smithi170 ceph-mon[31212]: pgmap v263: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 308.242884 secs 2024-04-21T10:29:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:29:59 smithi077 ceph-mon[27902]: pgmap v264: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:29:59 smithi191 ceph-mon[31636]: pgmap v264: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:29:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:29:59 smithi170 ceph-mon[31212]: pgmap v264: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:00 smithi077 ceph-mon[27902]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2024-04-21T10:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:00 smithi077 ceph-mon[27902]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-21T10:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:00 smithi077 ceph-mon[27902]: mds.b(mds.1): 1 slow requests are blocked > 180 secs 2024-04-21T10:30:00.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:00 smithi170 ceph-mon[31212]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2024-04-21T10:30:00.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:00 smithi170 ceph-mon[31212]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-21T10:30:00.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:00 smithi170 ceph-mon[31212]: mds.b(mds.1): 1 slow requests are blocked > 180 secs 2024-04-21T10:30:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:00 smithi191 ceph-mon[31636]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2024-04-21T10:30:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:00 smithi191 ceph-mon[31636]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-21T10:30:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:00 smithi191 ceph-mon[31636]: mds.b(mds.1): 1 slow requests are blocked > 180 secs 2024-04-21T10:30:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:01 smithi077 ceph-mon[27902]: pgmap v265: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-21T10:30:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:01 smithi191 ceph-mon[31636]: pgmap v265: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-21T10:30:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:01 smithi170 ceph-mon[31212]: pgmap v265: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-21T10:30:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 313.243007 secs 2024-04-21T10:30:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 313.243007 secs 2024-04-21T10:30:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 313.243007 secs 2024-04-21T10:30:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:03 smithi077 ceph-mon[27902]: pgmap v266: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-21T10:30:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:03 smithi191 ceph-mon[31636]: pgmap v266: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-21T10:30:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:03 smithi170 ceph-mon[31212]: pgmap v266: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-21T10:30:04.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:04 smithi191 ceph-mon[31636]: osdmap e93: 12 total, 12 up, 12 in 2024-04-21T10:30:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:04 smithi077 ceph-mon[27902]: osdmap e93: 12 total, 12 up, 12 in 2024-04-21T10:30:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:04 smithi170 ceph-mon[31212]: osdmap e93: 12 total, 12 up, 12 in 2024-04-21T10:30:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:05 smithi077 ceph-mon[27902]: pgmap v268: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-21T10:30:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:05 smithi191 ceph-mon[31636]: pgmap v268: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-21T10:30:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:05 smithi170 ceph-mon[31212]: pgmap v268: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-21T10:30:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:07 smithi077 ceph-mon[27902]: pgmap v269: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T10:30:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 318.243075 secs 2024-04-21T10:30:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:07 smithi191 ceph-mon[31636]: pgmap v269: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T10:30:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 318.243075 secs 2024-04-21T10:30:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:07 smithi170 ceph-mon[31212]: pgmap v269: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T10:30:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 318.243075 secs 2024-04-21T10:30:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:09 smithi077 ceph-mon[27902]: pgmap v270: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T10:30:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:09 smithi191 ceph-mon[31636]: pgmap v270: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T10:30:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:09 smithi170 ceph-mon[31212]: pgmap v270: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T10:30:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:11 smithi077 ceph-mon[27902]: pgmap v271: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:30:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:11 smithi077 ceph-mon[27902]: osdmap e94: 12 total, 12 up, 12 in 2024-04-21T10:30:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:11 smithi191 ceph-mon[31636]: pgmap v271: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:30:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:11 smithi191 ceph-mon[31636]: osdmap e94: 12 total, 12 up, 12 in 2024-04-21T10:30:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:11 smithi170 ceph-mon[31212]: pgmap v271: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:30:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:11 smithi170 ceph-mon[31212]: osdmap e94: 12 total, 12 up, 12 in 2024-04-21T10:30:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 323.243147 secs 2024-04-21T10:30:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 323.243147 secs 2024-04-21T10:30:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 323.243147 secs 2024-04-21T10:30:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:13 smithi077 ceph-mon[27902]: pgmap v273: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:30:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:13 smithi191 ceph-mon[31636]: pgmap v273: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:30:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:13 smithi170 ceph-mon[31212]: pgmap v273: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:30:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:15 smithi077 ceph-mon[27902]: pgmap v274: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:30:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:15 smithi191 ceph-mon[31636]: pgmap v274: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:30:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:15 smithi170 ceph-mon[31212]: pgmap v274: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:30:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:17 smithi077 ceph-mon[27902]: pgmap v275: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:30:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 328.243271 secs 2024-04-21T10:30:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:17 smithi191 ceph-mon[31636]: pgmap v275: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:30:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 328.243271 secs 2024-04-21T10:30:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:17 smithi170 ceph-mon[31212]: pgmap v275: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:30:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 328.243271 secs 2024-04-21T10:30:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:19 smithi191 ceph-mon[31636]: pgmap v276: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:30:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:19 smithi170 ceph-mon[31212]: pgmap v276: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:30:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:19 smithi077 ceph-mon[27902]: pgmap v276: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:30:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:21 smithi191 ceph-mon[31636]: pgmap v277: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-04-21T10:30:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:21 smithi170 ceph-mon[31212]: pgmap v277: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-04-21T10:30:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:21 smithi077 ceph-mon[27902]: pgmap v277: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-04-21T10:30:22.109 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.0 2024-04-21T10:30:22.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T10:30:22.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/2228206299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a64102b40 msgr2=0x7f4a64106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/2228206299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a64102b40 0x7f4a64106b80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009900 tx=0x7f4a5402bc30 comp rx=0 tx=0).stop 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/2228206299 shutdown_connections 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/2228206299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a64102b40 0x7f4a64106b80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/2228206299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64107260 0x7f4a6410ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/2228206299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a64102190 0x7f4a64102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.222+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/2228206299 >> 172.21.15.77:0/2228206299 conn(0x7f4a640793e0 msgr2=0x7f4a640797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/2228206299 shutdown_connections 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/2228206299 wait complete. 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 Processor -- start 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 -- start start 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64102190 0x7f4a64198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a64107260 0x7f4a64198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 0x7f4a6419d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a64112180 con 0x7f4a6419cfe0 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a64112000 con 0x7f4a64102190 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6b8c1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4a64112300 con 0x7f4a64107260 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a69e5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 0x7f4a6419d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a69e5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 0x7f4a6419d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34416/0 (socket says 172.21.15.77:34416) 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a69e5e640 1 -- 172.21.15.77:0/442556829 learned_addr learned my addr 172.21.15.77:0/442556829 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.223+0000 7f4a6965d640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64102190 0x7f4a64198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a68e5c640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a64107260 0x7f4a64198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a69e5e640 1 -- 172.21.15.77:0/442556829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a64107260 msgr2=0x7f4a64198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a69e5e640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a64107260 0x7f4a64198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a69e5e640 1 -- 172.21.15.77:0/442556829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64102190 msgr2=0x7f4a64198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a69e5e640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64102190 0x7f4a64198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a69e5e640 1 -- 172.21.15.77:0/442556829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6419dad0 con 0x7f4a6419cfe0 2024-04-21T10:30:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a69e5e640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 0x7f4a6419d490 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00eaa0 tx=0x7f4a5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:30:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00cdb0 con 0x7f4a6419cfe0 2024-04-21T10:30:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a5c005020 con 0x7f4a6419cfe0 2024-04-21T10:30:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6419ddc0 con 0x7f4a6419cfe0 2024-04-21T10:30:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0116d0 con 0x7f4a6419cfe0 2024-04-21T10:30:22.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.224+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a641a5580 con 0x7f4a6419cfe0 2024-04-21T10:30:22.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.225+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a64069230 con 0x7f4a6419cfe0 2024-04-21T10:30:22.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.226+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f4a5c0051d0 con 0x7f4a6419cfe0 2024-04-21T10:30:22.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.227+0000 7f4a5a7fc640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4a500a3da0 0x7f4a500a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.227+0000 7f4a6965d640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4a500a3da0 0x7f4a500a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.227+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8513+0+0 (secure 0 0 0) 0x7f4a5c0d0900 con 0x7f4a6419cfe0 2024-04-21T10:30:22.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.227+0000 7f4a6965d640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4a500a3da0 0x7f4a500a6260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000bbe0 tx=0x7f4a6000b390 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:30:22.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.232+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4a5c016030 con 0x7f4a6419cfe0 2024-04-21T10:30:22.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.449+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a64102b40 con 0x7f4a6419cfe0 2024-04-21T10:30:22.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.450+0000 7f4a5a7fc640 1 -- 172.21.15.77:0/442556829 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11891 (secure 0 0 0) 0x7f4a5c09cfa0 con 0x7f4a6419cfe0 2024-04-21T10:30:22.449 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-21T10:30:22.450 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3612886708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3612886708},{"type":"v1","addr":"172.21.15.77:6835","nonce":3612886708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1731345826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1731345826},{"type":"v1","addr":"172.21.15.77:6837","nonce":1731345826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3489435011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":3489435011},{"type":"v1","addr":"172.21.15.77:6839","nonce":3489435011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/3790434755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":3790434755},{"type":"v1","addr":"172.21.15.77:6841","nonce":3790434755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1764258640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1764258640},{"type":"v1","addr":"172.21.15.170:6833","nonce":1764258640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2565539323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2565539323},{"type":"v1","addr":"172.21.15.170:6835","nonce":2565539323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T10:19:22.828859+0000","modified":"2024-04-21T10:29:46.375832+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24505,"mds_1":24491,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2131093525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2131093525},{"type":"v1","addr":"172.21.15.191:6833","nonce":2131093525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.170:6837/3141822041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3141822041},{"type":"v1","addr":"172.21.15.170:6837","nonce":3141822041}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/2650789974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2650789974},{"type":"v1","addr":"172.21.15.191:6835","nonce":2650789974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6837/2009641600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2009641600},{"type":"v1","addr":"172.21.15.191:6837","nonce":2009641600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":146,"addr":"172.21.15.170:6839/4122605825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":4122605825},{"type":"v1","addr":"172.21.15.170:6839","nonce":4122605825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":133,"addr":"172.21.15.191:6839/2863843162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2863843162},{"type":"v1","addr":"172.21.15.191:6839","nonce":2863843162}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24505,"qdb_cluster":[24461,24505,24491]},"id":1}]} 2024-04-21T10:30:22.450 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 41 2024-04-21T10:30:22.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.451+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4a500a3da0 msgr2=0x7f4a500a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.451+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4a500a3da0 0x7f4a500a6260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000bbe0 tx=0x7f4a6000b390 comp rx=0 tx=0).stop 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.451+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 msgr2=0x7f4a6419d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.451+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 0x7f4a6419d490 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00eaa0 tx=0x7f4a5c00ef60 comp rx=0 tx=0).stop 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 shutdown_connections 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f4a500a3da0 0x7f4a500a6260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a6419cfe0 0x7f4a6419d490 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a64107260 0x7f4a64198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 --2- 172.21.15.77:0/442556829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64102190 0x7f4a64198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 >> 172.21.15.77:0/442556829 conn(0x7f4a640793e0 msgr2=0x7f4a640fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 shutdown_connections 2024-04-21T10:30:22.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.452+0000 7f4a6b8c1640 1 -- 172.21.15.77:0/442556829 wait complete. 2024-04-21T10:30:22.462 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24505 quiesce db / --timeout 30 --expiration 78.0 --await' 2024-04-21T10:30:22.462 DEBUG:teuthology.orchestra.run.smithi077:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24505 quiesce db / --timeout 30 --expiration 78.0 --await 2024-04-21T10:30:22.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 -- 172.21.15.77:0/2561276323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c101a40 msgr2=0x7f613c105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 --2- 172.21.15.77:0/2561276323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c101a40 0x7f613c105a80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f612c009900 tx=0x7f612c02bc30 comp rx=0 tx=0).stop 2024-04-21T10:30:22.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 -- 172.21.15.77:0/2561276323 shutdown_connections 2024-04-21T10:30:22.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 --2- 172.21.15.77:0/2561276323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c101a40 0x7f613c105a80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 --2- 172.21.15.77:0/2561276323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c106160 0x7f613c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 --2- 172.21.15.77:0/2561276323 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f613c101090 0x7f613c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 -- 172.21.15.77:0/2561276323 >> 172.21.15.77:0/2561276323 conn(0x7f613c0771d0 msgr2=0x7f613c0775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 -- 172.21.15.77:0/2561276323 shutdown_connections 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 -- 172.21.15.77:0/2561276323 wait complete. 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 Processor -- start 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.570+0000 7f61435ef640 1 -- start start 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c101090 0x7f613c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c106160 0x7f613c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f613c19cfe0 0x7f613c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1121a0 con 0x7f613c106160 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f613c112020 con 0x7f613c101090 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f613c112320 con 0x7f613c19cfe0 2024-04-21T10:30:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c106160 0x7f613c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c106160 0x7f613c198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34442/0 (socket says 172.21.15.77:34442) 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 -- 172.21.15.77:0/2011859663 learned_addr learned my addr 172.21.15.77:0/2011859663 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f614138b640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c101090 0x7f613c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 -- 172.21.15.77:0/2011859663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f613c19cfe0 msgr2=0x7f613c19d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f613c19cfe0 0x7f613c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 -- 172.21.15.77:0/2011859663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c101090 msgr2=0x7f613c198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c101090 0x7f613c198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 -- 172.21.15.77:0/2011859663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c19dad0 con 0x7f613c106160 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f6140b8a640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f613c106160 0x7f613c198c60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f612c036040 tx=0x7f612c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61327fc640 1 -- 172.21.15.77:0/2011859663 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c043020 con 0x7f613c106160 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 -- 172.21.15.77:0/2011859663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c19dd60 con 0x7f613c106160 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61327fc640 1 -- 172.21.15.77:0/2011859663 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f612c02cb70 con 0x7f613c106160 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61327fc640 1 -- 172.21.15.77:0/2011859663 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c003bf0 con 0x7f613c106160 2024-04-21T10:30:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.571+0000 7f61435ef640 1 -- 172.21.15.77:0/2011859663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c1a55b0 con 0x7f613c106160 2024-04-21T10:30:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.574+0000 7f61461db740 1 Processor -- start 2024-04-21T10:30:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.574+0000 7f61327fc640 1 -- 172.21.15.77:0/2011859663 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f612c046020 con 0x7f613c106160 2024-04-21T10:30:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.574+0000 7f61461db740 1 -- start start 2024-04-21T10:30:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.574+0000 7f61461db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb8969c0 0x55d9fb896da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.574+0000 7f61461db740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61461db740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 0x55d9fb8a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61461db740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d9fb7f70b0 con 0x55d9fb89fec0 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61461db740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d9fb7a8680 con 0x55d9fb8972e0 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61461db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d9fb7b4c60 con 0x55d9fb8969c0 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 0x55d9fb8a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f614138b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 0x55d9fb8a22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34446/0 (socket says 172.21.15.77:34446) 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f614138b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.77:47746/0 (socket says 172.21.15.77:47746) 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 -- 172.21.15.77:0/678140571 learned_addr learned my addr 172.21.15.77:0/678140571 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6141b8c640 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb8969c0 0x55d9fb896da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61327fc640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f61280a3d20 0x7f61280a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 -- 172.21.15.77:0/678140571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb8969c0 msgr2=0x55d9fb896da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb8969c0 0x55d9fb896da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 -- 172.21.15.77:0/678140571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 msgr2=0x55d9fb89f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 -- 172.21.15.77:0/678140571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9fb5d9c90 con 0x55d9fb89fec0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f614138b640 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6141b8c640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f61280a3d20 0x7f61280a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61327fc640 1 -- 172.21.15.77:0/2011859663 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8513+0+0 (secure 0 0 0) 0x7f612c0f28f0 con 0x7f613c106160 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6140b8a640 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 0x55d9fb8a22b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f612c0f0030 tx=0x7f612c088f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558f17f1749edeab server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f6141b8c640 1 --2- 172.21.15.77:0/2011859663 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7f61280a3d20 0x7f61280a61e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6134009270 tx=0x7f6134004a40 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.575+0000 7f61277fe640 1 -- 172.21.15.77:0/678140571 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0be480 con 0x55d9fb89fec0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61277fe640 1 -- 172.21.15.77:0/678140571 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f612c0abeb0 con 0x55d9fb89fec0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61277fe640 1 -- 172.21.15.77:0/678140571 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0abcb0 con 0x55d9fb89fec0 2024-04-21T10:30:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 -- 172.21.15.77:0/678140571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 msgr2=0x55d9fb8a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 0x55d9fb8a22b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f612c0f0030 tx=0x7f612c088f40 comp rx=0 tx=0).stop 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 -- 172.21.15.77:0/678140571 shutdown_connections 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb89fec0 0x55d9fb8a22b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 --2- 172.21.15.77:0/678140571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb8969c0 0x55d9fb896da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 -- 172.21.15.77:0/678140571 >> 172.21.15.77:0/678140571 conn(0x55d9fb8910f0 msgr2=0x55d9fb8914d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 -- 172.21.15.77:0/678140571 shutdown_connections 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.576+0000 7f61461db740 1 -- 172.21.15.77:0/678140571 wait complete. 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 -- start start 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 Processor -- start 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb8969c0 0x55d9fb89ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb89fec0 0x55d9fb89d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d9fb7fa400 con 0x55d9fb8969c0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d9fb7b6840 con 0x55d9fb8972e0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d9fb7ff720 con 0x55d9fb89fec0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f61461db740 10 client.0 _ll_register_callbacks cb 0x55d9fb807ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb8969c0 0x55d9fb89ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb8969c0 0x55d9fb89ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34448/0 (socket says 172.21.15.77:34448) 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 -- 172.21.15.77:0/140669413 learned_addr learned my addr 172.21.15.77:0/140669413 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f6140b8a640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f6141b8c640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb89fec0 0x55d9fb89d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 -- 172.21.15.77:0/140669413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb89fec0 msgr2=0x55d9fb89d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d9fb89fec0 0x55d9fb89d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 -- 172.21.15.77:0/140669413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 msgr2=0x55d9fb89d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f614138b640 1 -- 172.21.15.77:0/140669413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9fb63a420 con 0x55d9fb8969c0 2024-04-21T10:30:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.577+0000 7f6140b8a640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d9fb8972e0 0x55d9fb89d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f614138b640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9fb8969c0 0x55d9fb89ce90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6138011470 tx=0x7f6138011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e74205a3a2217bd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f6124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f6124ff9640 1 -- 172.21.15.77:0/140669413 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138004020 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f6124ff9640 1 -- 172.21.15.77:0/140669413 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8513+0+0 (secure 0 0 0) 0x7f61380041c0 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 1 -- 172.21.15.77:0/140669413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9fb808b10 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f6124ff9640 1 -- 172.21.15.77:0/140669413 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f61380043c0 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 10 client.16506 fetch_fsmap learned FSMap version 41 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 1 -- 172.21.15.77:0/140669413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d9fb4cd580 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f6124ff9640 1 -- 172.21.15.77:0/140669413 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d9fb808b10 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f6124ff9640 1 -- 172.21.15.77:0/140669413 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 41) ==== 8346+0+0 (secure 0 0 0) 0x7f6138003ab0 con 0x55d9fb8969c0 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 10 client.16506 fetch_fsmap finished waiting for FSMap version 41 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 10 client.16506 resolve_mds: validated gid 24505 aka daemon mds.i 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 20 client.16506 populate_metadata read hostname 'smithi077' 2024-04-21T10:30:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55d9fb8af940 0x55d9fb8b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:30:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 4 client.16506 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T10:30:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.578+0000 7f61461db740 1 -- 172.21.15.77:0/140669413 --> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9fb802980 con 0x55d9fb8af940 2024-04-21T10:30:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.579+0000 7f6140b8a640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55d9fb8af940 0x55d9fb8b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:30:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.579+0000 7f6140b8a640 1 --2- 172.21.15.77:0/140669413 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x55d9fb8af940 0x55d9fb8b1dd0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df9fa503559fd95 server_cookie=5e6ef9ca95e87d25 in_seq=0 out_seq=0 2024-04-21T10:30:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-21T10:30:22.579+0000 7f6124ff9640 10 client.16506 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:30:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 333.243409 secs 2024-04-21T10:30:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 333.243409 secs 2024-04-21T10:30:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 333.243409 secs 2024-04-21T10:30:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:23 smithi191 ceph-mon[31636]: pgmap v278: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T10:30:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:23 smithi191 ceph-mon[31636]: from='client.? 172.21.15.77:0/442556829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:30:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:23 smithi170 ceph-mon[31212]: pgmap v278: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T10:30:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:23 smithi170 ceph-mon[31212]: from='client.? 172.21.15.77:0/442556829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:30:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:23 smithi077 ceph-mon[27902]: pgmap v278: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T10:30:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:23 smithi077 ceph-mon[27902]: from='client.? 172.21.15.77:0/442556829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T10:30:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:25 smithi191 ceph-mon[31636]: pgmap v279: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 5 op/s 2024-04-21T10:30:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:25 smithi170 ceph-mon[31212]: pgmap v279: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 5 op/s 2024-04-21T10:30:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:25 smithi077 ceph-mon[27902]: pgmap v279: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 5 op/s 2024-04-21T10:30:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:27 smithi191 ceph-mon[31636]: pgmap v280: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 KiB/s wr, 8 op/s 2024-04-21T10:30:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 338.243529 secs 2024-04-21T10:30:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:27 smithi170 ceph-mon[31212]: pgmap v280: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 KiB/s wr, 8 op/s 2024-04-21T10:30:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 338.243529 secs 2024-04-21T10:30:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:27 smithi077 ceph-mon[27902]: pgmap v280: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 KiB/s wr, 8 op/s 2024-04-21T10:30:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 338.243529 secs 2024-04-21T10:30:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:29 smithi191 ceph-mon[31636]: pgmap v281: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 5 op/s 2024-04-21T10:30:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:29 smithi170 ceph-mon[31212]: pgmap v281: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 5 op/s 2024-04-21T10:30:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:29 smithi077 ceph-mon[27902]: pgmap v281: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 5 op/s 2024-04-21T10:30:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:31 smithi191 ceph-mon[31636]: pgmap v282: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-04-21T10:30:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:31 smithi170 ceph-mon[31212]: pgmap v282: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-04-21T10:30:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:31 smithi077 ceph-mon[27902]: pgmap v282: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-04-21T10:30:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 343.243649 secs 2024-04-21T10:30:32.832 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 343.243649 secs 2024-04-21T10:30:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 343.243649 secs 2024-04-21T10:30:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:33 smithi191 ceph-mon[31636]: pgmap v283: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:33 smithi170 ceph-mon[31212]: pgmap v283: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:33 smithi077 ceph-mon[27902]: pgmap v283: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:35 smithi191 ceph-mon[31636]: pgmap v284: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:35 smithi170 ceph-mon[31212]: pgmap v284: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:35 smithi077 ceph-mon[27902]: pgmap v284: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:37 smithi191 ceph-mon[31636]: pgmap v285: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:30:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 348.243800 secs 2024-04-21T10:30:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:30:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:37 smithi170 ceph-mon[31212]: pgmap v285: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:30:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 348.243800 secs 2024-04-21T10:30:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:30:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:37 smithi077 ceph-mon[27902]: pgmap v285: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:30:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 348.243800 secs 2024-04-21T10:30:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:30:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:30:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:30:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:30:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:30:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:30:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:30:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:30:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:30:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:30:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:40 smithi170 ceph-mon[31212]: pgmap v286: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:40 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:30:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:40 smithi077 ceph-mon[27902]: pgmap v286: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:40 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:30:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:40 smithi191 ceph-mon[31636]: pgmap v286: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:40 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:30:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:42 smithi170 ceph-mon[31212]: pgmap v287: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 353.243852 secs 2024-04-21T10:30:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:42 smithi077 ceph-mon[27902]: pgmap v287: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 353.243852 secs 2024-04-21T10:30:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:42 smithi191 ceph-mon[31636]: pgmap v287: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 353.243852 secs 2024-04-21T10:30:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:43 smithi077 ceph-mon[27902]: pgmap v288: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-21T10:30:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:43 smithi191 ceph-mon[31636]: pgmap v288: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-21T10:30:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:43 smithi170 ceph-mon[31212]: pgmap v288: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-21T10:30:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:45 smithi077 ceph-mon[27902]: pgmap v289: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-21T10:30:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:45 smithi191 ceph-mon[31636]: pgmap v289: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-21T10:30:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:45 smithi170 ceph-mon[31212]: pgmap v289: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-21T10:30:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:47 smithi077 ceph-mon[27902]: pgmap v290: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 358.243930 secs 2024-04-21T10:30:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:47 smithi191 ceph-mon[31636]: pgmap v290: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 358.243930 secs 2024-04-21T10:30:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:47 smithi170 ceph-mon[31212]: pgmap v290: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 358.243930 secs 2024-04-21T10:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:49 smithi077 ceph-mon[27902]: pgmap v291: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-04-21T10:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:49 smithi191 ceph-mon[31636]: pgmap v291: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-04-21T10:30:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:49 smithi170 ceph-mon[31212]: pgmap v291: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-04-21T10:30:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:51 smithi077 ceph-mon[27902]: pgmap v292: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:51 smithi191 ceph-mon[31636]: pgmap v292: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:51 smithi170 ceph-mon[31212]: pgmap v292: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-21T10:30:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 363.244013 secs 2024-04-21T10:30:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:52 smithi077 ceph-mon[27902]: slow request 363.244013 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:30:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 363.244013 secs 2024-04-21T10:30:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:52 smithi191 ceph-mon[31636]: slow request 363.244013 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:30:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 363.244013 secs 2024-04-21T10:30:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:52 smithi170 ceph-mon[31212]: slow request 363.244013 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:30:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:53 smithi077 ceph-mon[27902]: pgmap v293: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:53 smithi191 ceph-mon[31636]: pgmap v293: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:53 smithi170 ceph-mon[31212]: pgmap v293: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:54 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:30:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:54 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:30:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:54 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:30:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:30:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:55 smithi077 ceph-mon[27902]: pgmap v294: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:55 smithi191 ceph-mon[31636]: pgmap v294: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:55 smithi170 ceph-mon[31212]: pgmap v294: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-21T10:30:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:57 smithi077 ceph-mon[27902]: pgmap v295: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:30:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 368.244096 secs 2024-04-21T10:30:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:57 smithi191 ceph-mon[31636]: pgmap v295: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:30:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 368.244096 secs 2024-04-21T10:30:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:57 smithi170 ceph-mon[31212]: pgmap v295: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-21T10:30:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 368.244096 secs 2024-04-21T10:30:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:30:59 smithi077 ceph-mon[27902]: pgmap v296: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:30:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:30:59 smithi191 ceph-mon[31636]: pgmap v296: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:30:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:30:59 smithi170 ceph-mon[31212]: pgmap v296: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:01.608 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:01 smithi170 ceph-mon[31212]: pgmap v297: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:01 smithi077 ceph-mon[27902]: pgmap v297: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:01 smithi191 ceph-mon[31636]: pgmap v297: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 373.244214 secs 2024-04-21T10:31:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 373.244214 secs 2024-04-21T10:31:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 373.244214 secs 2024-04-21T10:31:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:03 smithi077 ceph-mon[27902]: pgmap v298: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:03 smithi191 ceph-mon[31636]: pgmap v298: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:03 smithi170 ceph-mon[31212]: pgmap v298: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:04 smithi077 ceph-mon[27902]: osdmap e95: 12 total, 12 up, 12 in 2024-04-21T10:31:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:04 smithi191 ceph-mon[31636]: osdmap e95: 12 total, 12 up, 12 in 2024-04-21T10:31:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:04 smithi170 ceph-mon[31212]: osdmap e95: 12 total, 12 up, 12 in 2024-04-21T10:31:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:05 smithi077 ceph-mon[27902]: pgmap v300: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:31:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:05 smithi191 ceph-mon[31636]: pgmap v300: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:31:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:05 smithi170 ceph-mon[31212]: pgmap v300: 97 pgs: 97 active+clean; 3.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:31:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:07 smithi077 ceph-mon[27902]: pgmap v301: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 378.244284 secs 2024-04-21T10:31:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:07 smithi191 ceph-mon[31636]: pgmap v301: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 378.244284 secs 2024-04-21T10:31:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:07 smithi170 ceph-mon[31212]: pgmap v301: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 378.244284 secs 2024-04-21T10:31:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:09 smithi077 ceph-mon[27902]: pgmap v302: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:09 smithi191 ceph-mon[31636]: pgmap v302: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:09 smithi170 ceph-mon[31212]: pgmap v302: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:11 smithi077 ceph-mon[27902]: pgmap v303: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:11 smithi077 ceph-mon[27902]: osdmap e96: 12 total, 12 up, 12 in 2024-04-21T10:31:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:11 smithi191 ceph-mon[31636]: pgmap v303: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:11 smithi191 ceph-mon[31636]: osdmap e96: 12 total, 12 up, 12 in 2024-04-21T10:31:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:11 smithi170 ceph-mon[31212]: pgmap v303: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:11 smithi170 ceph-mon[31212]: osdmap e96: 12 total, 12 up, 12 in 2024-04-21T10:31:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 383.244433 secs 2024-04-21T10:31:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 383.244433 secs 2024-04-21T10:31:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 383.244433 secs 2024-04-21T10:31:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:13 smithi191 ceph-mon[31636]: pgmap v305: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:31:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:13 smithi170 ceph-mon[31212]: pgmap v305: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:31:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:13 smithi077 ceph-mon[27902]: pgmap v305: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:31:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:15 smithi191 ceph-mon[31636]: pgmap v306: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:15 smithi170 ceph-mon[31212]: pgmap v306: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:15 smithi077 ceph-mon[27902]: pgmap v306: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:17 smithi077 ceph-mon[27902]: pgmap v307: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 388.244543 secs 2024-04-21T10:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:17 smithi191 ceph-mon[31636]: pgmap v307: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 388.244543 secs 2024-04-21T10:31:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:17 smithi170 ceph-mon[31212]: pgmap v307: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:31:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 388.244543 secs 2024-04-21T10:31:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:19 smithi077 ceph-mon[27902]: pgmap v308: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:31:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:19 smithi191 ceph-mon[31636]: pgmap v308: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:31:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:19 smithi170 ceph-mon[31212]: pgmap v308: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:31:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:21 smithi077 ceph-mon[27902]: pgmap v309: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:31:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:21 smithi191 ceph-mon[31636]: pgmap v309: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:31:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:21 smithi170 ceph-mon[31212]: pgmap v309: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:31:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 393.244659 secs 2024-04-21T10:31:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 393.244659 secs 2024-04-21T10:31:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 393.244659 secs 2024-04-21T10:31:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:23 smithi077 ceph-mon[27902]: pgmap v310: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:31:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:23 smithi191 ceph-mon[31636]: pgmap v310: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:31:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:23 smithi170 ceph-mon[31212]: pgmap v310: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:31:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:25 smithi077 ceph-mon[27902]: pgmap v311: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:25 smithi191 ceph-mon[31636]: pgmap v311: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:25 smithi170 ceph-mon[31212]: pgmap v311: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:27 smithi077 ceph-mon[27902]: pgmap v312: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 398.244792 secs 2024-04-21T10:31:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:27 smithi191 ceph-mon[31636]: pgmap v312: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 398.244792 secs 2024-04-21T10:31:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:27 smithi170 ceph-mon[31212]: pgmap v312: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 398.244792 secs 2024-04-21T10:31:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:29 smithi077 ceph-mon[27902]: pgmap v313: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:29 smithi191 ceph-mon[31636]: pgmap v313: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:29 smithi170 ceph-mon[31212]: pgmap v313: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:31.609 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:31 smithi170 ceph-mon[31212]: pgmap v314: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:31 smithi077 ceph-mon[27902]: pgmap v314: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:31 smithi191 ceph-mon[31636]: pgmap v314: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 403.244915 secs 2024-04-21T10:31:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 403.244915 secs 2024-04-21T10:31:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 403.244915 secs 2024-04-21T10:31:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:33 smithi077 ceph-mon[27902]: pgmap v315: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:33 smithi191 ceph-mon[31636]: pgmap v315: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:33 smithi170 ceph-mon[31212]: pgmap v315: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:35 smithi077 ceph-mon[27902]: pgmap v316: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:35 smithi191 ceph-mon[31636]: pgmap v316: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:35 smithi170 ceph-mon[31212]: pgmap v316: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:37 smithi077 ceph-mon[27902]: pgmap v317: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 408.244992 secs 2024-04-21T10:31:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:37 smithi191 ceph-mon[31636]: pgmap v317: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 408.244992 secs 2024-04-21T10:31:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:37 smithi170 ceph-mon[31212]: pgmap v317: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 408.244992 secs 2024-04-21T10:31:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:31:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:31:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:31:39.446 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:39 smithi170 ceph-mon[31212]: pgmap v318: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:39 smithi077 ceph-mon[27902]: pgmap v318: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:39 smithi191 ceph-mon[31636]: pgmap v318: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:31:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:31:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:31:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:31:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:31:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:31:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: pgmap v319: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:31:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:31:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:31:42.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:31:42.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:31:42.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:31:42.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 413.245112 secs 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: pgmap v319: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:31:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 413.245112 secs 2024-04-21T10:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: pgmap v319: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:31:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:31:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:31:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 413.245112 secs 2024-04-21T10:31:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:43 smithi077 ceph-mon[27902]: pgmap v320: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:43 smithi191 ceph-mon[31636]: pgmap v320: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:43 smithi170 ceph-mon[31212]: pgmap v320: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:45 smithi077 ceph-mon[27902]: pgmap v321: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:45 smithi191 ceph-mon[31636]: pgmap v321: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:45 smithi170 ceph-mon[31212]: pgmap v321: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 418.245227 secs 2024-04-21T10:31:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 418.245227 secs 2024-04-21T10:31:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 418.245227 secs 2024-04-21T10:31:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:47 smithi077 ceph-mon[27902]: pgmap v322: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:47 smithi191 ceph-mon[31636]: pgmap v322: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:47 smithi170 ceph-mon[31212]: pgmap v322: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:49 smithi077 ceph-mon[27902]: pgmap v323: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:49 smithi191 ceph-mon[31636]: pgmap v323: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:49 smithi170 ceph-mon[31212]: pgmap v323: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:51 smithi077 ceph-mon[27902]: pgmap v324: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 423.245346 secs 2024-04-21T10:31:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:51 smithi191 ceph-mon[31636]: pgmap v324: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 423.245346 secs 2024-04-21T10:31:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:51 smithi170 ceph-mon[31212]: pgmap v324: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 423.245346 secs 2024-04-21T10:31:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:53 smithi077 ceph-mon[27902]: pgmap v325: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:53 smithi191 ceph-mon[31636]: pgmap v325: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:53 smithi170 ceph-mon[31212]: pgmap v325: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:31:54.411+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500034f0 con 0x7efd78101130 2024-04-21T10:31:54.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:31:54.411+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500034f0 con 0x7efd78101130 2024-04-21T10:31:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:31:54.437+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd480034c0 con 0x5637269918d0 2024-04-21T10:31:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:31:54.437+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd480034c0 con 0x5637269918d0 2024-04-21T10:31:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:31:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:55 smithi077 ceph-mon[27902]: pgmap v326: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:55 smithi191 ceph-mon[31636]: pgmap v326: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:55 smithi170 ceph-mon[31212]: pgmap v326: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:31:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 428.245472 secs 2024-04-21T10:31:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 428.245472 secs 2024-04-21T10:31:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 428.245472 secs 2024-04-21T10:31:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:57 smithi077 ceph-mon[27902]: pgmap v327: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:57 smithi191 ceph-mon[31636]: pgmap v327: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:31:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:57 smithi170 ceph-mon[31212]: pgmap v327: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:31:59 smithi077 ceph-mon[27902]: pgmap v328: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:31:59 smithi191 ceph-mon[31636]: pgmap v328: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:31:59 smithi170 ceph-mon[31212]: pgmap v328: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:02.124 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:01 smithi170 ceph-mon[31212]: pgmap v329: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:02.124 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 433.245606 secs 2024-04-21T10:32:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:01 smithi077 ceph-mon[27902]: pgmap v329: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 433.245606 secs 2024-04-21T10:32:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:01 smithi191 ceph-mon[31636]: pgmap v329: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 433.245606 secs 2024-04-21T10:32:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:03 smithi077 ceph-mon[27902]: pgmap v330: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:03 smithi191 ceph-mon[31636]: pgmap v330: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:03 smithi170 ceph-mon[31212]: pgmap v330: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:04 smithi077 ceph-mon[27902]: osdmap e97: 12 total, 12 up, 12 in 2024-04-21T10:32:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:04 smithi191 ceph-mon[31636]: osdmap e97: 12 total, 12 up, 12 in 2024-04-21T10:32:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:04 smithi170 ceph-mon[31212]: osdmap e97: 12 total, 12 up, 12 in 2024-04-21T10:32:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:05 smithi077 ceph-mon[27902]: pgmap v332: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:32:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:05 smithi191 ceph-mon[31636]: pgmap v332: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:32:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:05 smithi170 ceph-mon[31212]: pgmap v332: 97 pgs: 97 active+clean; 2.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:32:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 438.245708 secs 2024-04-21T10:32:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 438.245708 secs 2024-04-21T10:32:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 438.245708 secs 2024-04-21T10:32:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:07 smithi191 ceph-mon[31636]: pgmap v333: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:32:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:07 smithi170 ceph-mon[31212]: pgmap v333: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:32:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:07 smithi077 ceph-mon[27902]: pgmap v333: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:32:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:09 smithi191 ceph-mon[31636]: pgmap v334: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:32:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:09 smithi170 ceph-mon[31212]: pgmap v334: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:32:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:09 smithi077 ceph-mon[27902]: pgmap v334: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:32:12.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:11 smithi077 ceph-mon[27902]: pgmap v335: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:32:12.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:11 smithi077 ceph-mon[27902]: osdmap e98: 12 total, 12 up, 12 in 2024-04-21T10:32:12.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 443.245858 secs 2024-04-21T10:32:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:11 smithi191 ceph-mon[31636]: pgmap v335: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:32:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:11 smithi191 ceph-mon[31636]: osdmap e98: 12 total, 12 up, 12 in 2024-04-21T10:32:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 443.245858 secs 2024-04-21T10:32:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:11 smithi170 ceph-mon[31212]: pgmap v335: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:32:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:11 smithi170 ceph-mon[31212]: osdmap e98: 12 total, 12 up, 12 in 2024-04-21T10:32:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 443.245858 secs 2024-04-21T10:32:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:13 smithi191 ceph-mon[31636]: pgmap v337: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:32:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:13 smithi170 ceph-mon[31212]: pgmap v337: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:32:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:13 smithi077 ceph-mon[27902]: pgmap v337: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:32:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:15 smithi191 ceph-mon[31636]: pgmap v338: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:32:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:15 smithi170 ceph-mon[31212]: pgmap v338: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:32:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:15 smithi077 ceph-mon[27902]: pgmap v338: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:32:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 448.245980 secs 2024-04-21T10:32:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 448.245980 secs 2024-04-21T10:32:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 448.245980 secs 2024-04-21T10:32:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:17 smithi191 ceph-mon[31636]: pgmap v339: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:32:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:17 smithi170 ceph-mon[31212]: pgmap v339: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:32:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:17 smithi077 ceph-mon[27902]: pgmap v339: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:32:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:19 smithi191 ceph-mon[31636]: pgmap v340: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:32:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:19 smithi170 ceph-mon[31212]: pgmap v340: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:32:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:19 smithi077 ceph-mon[27902]: pgmap v340: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:32:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:21 smithi191 ceph-mon[31636]: pgmap v341: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:32:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 453.246102 secs 2024-04-21T10:32:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:21 smithi170 ceph-mon[31212]: pgmap v341: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:32:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 453.246102 secs 2024-04-21T10:32:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:21 smithi077 ceph-mon[27902]: pgmap v341: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:32:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 453.246102 secs 2024-04-21T10:32:22.492 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-21T10:32:22.493 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't parse response with error Expecting value: line 1 column 1 (char 0); stdout: 2024-04-21T10:32:22.493 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_b8ddeda347de6c45510a6df67440a1d298c37030/qa/tasks/quiescer.py", line 185, in do_quiesce response = json.loads(stdout) File "/usr/lib/python3.8/json/__init__.py", line 357, in loads return _default_decoder.decode(s) File "/usr/lib/python3.8/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.8/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_b8ddeda347de6c45510a6df67440a1d298c37030/qa/tasks/quiescer.py", line 240, in _run self.do_quiesce(d) File "/home/teuthworker/src/github.com_ceph_ceph_b8ddeda347de6c45510a6df67440a1d298c37030/qa/tasks/quiescer.py", line 189, in do_quiesce raise RuntimeError(f"Error parsing quiesce response: {e}") RuntimeError: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-04-21T10:32:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:23 smithi191 ceph-mon[31636]: pgmap v342: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:32:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:23 smithi170 ceph-mon[31212]: pgmap v342: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:32:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:23 smithi077 ceph-mon[27902]: pgmap v342: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:32:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:25 smithi191 ceph-mon[31636]: pgmap v343: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:25 smithi170 ceph-mon[31212]: pgmap v343: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:25 smithi077 ceph-mon[27902]: pgmap v343: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 458.246234 secs 2024-04-21T10:32:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 458.246234 secs 2024-04-21T10:32:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 458.246234 secs 2024-04-21T10:32:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:27 smithi191 ceph-mon[31636]: pgmap v344: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:27 smithi170 ceph-mon[31212]: pgmap v344: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:27 smithi077 ceph-mon[27902]: pgmap v344: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:29 smithi191 ceph-mon[31636]: pgmap v345: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:29 smithi170 ceph-mon[31212]: pgmap v345: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:29 smithi077 ceph-mon[27902]: pgmap v345: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:31 smithi191 ceph-mon[31636]: pgmap v346: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 463.246315 secs 2024-04-21T10:32:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:31 smithi170 ceph-mon[31212]: pgmap v346: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 463.246315 secs 2024-04-21T10:32:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:31 smithi077 ceph-mon[27902]: pgmap v346: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 463.246315 secs 2024-04-21T10:32:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:33 smithi191 ceph-mon[31636]: pgmap v347: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:33 smithi170 ceph-mon[31212]: pgmap v347: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:33 smithi077 ceph-mon[27902]: pgmap v347: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:35 smithi191 ceph-mon[31636]: pgmap v348: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:35 smithi170 ceph-mon[31212]: pgmap v348: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:35 smithi077 ceph-mon[27902]: pgmap v348: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 468.246456 secs 2024-04-21T10:32:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 468.246456 secs 2024-04-21T10:32:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 468.246456 secs 2024-04-21T10:32:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:37 smithi191 ceph-mon[31636]: pgmap v349: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:37 smithi170 ceph-mon[31212]: pgmap v349: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:37 smithi077 ceph-mon[27902]: pgmap v349: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:39 smithi191 ceph-mon[31636]: pgmap v350: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:39 smithi170 ceph-mon[31212]: pgmap v350: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:39 smithi077 ceph-mon[27902]: pgmap v350: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:32:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:32:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: pgmap v351: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 473.246607 secs 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:32:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: pgmap v351: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:42.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 473.246607 secs 2024-04-21T10:32:42.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:32:42.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:32:42.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: pgmap v351: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 473.246607 secs 2024-04-21T10:32:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:32:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:32:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:32:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:43 smithi170 ceph-mon[31212]: pgmap v352: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:43 smithi077 ceph-mon[27902]: pgmap v352: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:43 smithi191 ceph-mon[31636]: pgmap v352: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:45 smithi170 ceph-mon[31212]: pgmap v353: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:45 smithi077 ceph-mon[27902]: pgmap v353: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:45 smithi191 ceph-mon[31636]: pgmap v353: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:32:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 478.246732 secs 2024-04-21T10:32:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 478.246732 secs 2024-04-21T10:32:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 478.246732 secs 2024-04-21T10:32:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:47 smithi170 ceph-mon[31212]: pgmap v354: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:47 smithi077 ceph-mon[27902]: pgmap v354: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:47 smithi191 ceph-mon[31636]: pgmap v354: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:49 smithi170 ceph-mon[31212]: pgmap v355: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:49 smithi077 ceph-mon[27902]: pgmap v355: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:49 smithi191 ceph-mon[31636]: pgmap v355: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:51 smithi170 ceph-mon[31212]: pgmap v356: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 483.246833 secs 2024-04-21T10:32:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:51 smithi077 ceph-mon[27902]: pgmap v356: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 483.246833 secs 2024-04-21T10:32:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:51 smithi191 ceph-mon[31636]: pgmap v356: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 483.246833 secs 2024-04-21T10:32:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:53 smithi170 ceph-mon[31212]: pgmap v357: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:53 smithi077 ceph-mon[27902]: pgmap v357: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:53 smithi191 ceph-mon[31636]: pgmap v357: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:32:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:55 smithi170 ceph-mon[31212]: pgmap v358: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:55 smithi077 ceph-mon[27902]: pgmap v358: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:55 smithi191 ceph-mon[31636]: pgmap v358: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:32:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 488.246958 secs 2024-04-21T10:32:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 488.246958 secs 2024-04-21T10:32:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 488.246958 secs 2024-04-21T10:32:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:32:58 smithi170 ceph-mon[31212]: pgmap v359: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:32:58 smithi077 ceph-mon[27902]: pgmap v359: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:32:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:32:58 smithi191 ceph-mon[31636]: pgmap v359: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:00 smithi170 ceph-mon[31212]: pgmap v360: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:00 smithi077 ceph-mon[27902]: pgmap v360: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:00 smithi191 ceph-mon[31636]: pgmap v360: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:02 smithi170 ceph-mon[31212]: pgmap v361: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:02.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 493.247069 secs 2024-04-21T10:33:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:02 smithi077 ceph-mon[27902]: pgmap v361: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 493.247069 secs 2024-04-21T10:33:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:02 smithi191 ceph-mon[31636]: pgmap v361: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 493.247069 secs 2024-04-21T10:33:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:04 smithi170 ceph-mon[31212]: pgmap v362: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:04 smithi077 ceph-mon[27902]: pgmap v362: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:04 smithi191 ceph-mon[31636]: pgmap v362: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:05 smithi170 ceph-mon[31212]: osdmap e99: 12 total, 12 up, 12 in 2024-04-21T10:33:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:05 smithi077 ceph-mon[27902]: osdmap e99: 12 total, 12 up, 12 in 2024-04-21T10:33:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:05 smithi191 ceph-mon[31636]: osdmap e99: 12 total, 12 up, 12 in 2024-04-21T10:33:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:06 smithi170 ceph-mon[31212]: pgmap v364: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:33:06.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:06 smithi191 ceph-mon[31636]: pgmap v364: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:33:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:06 smithi077 ceph-mon[27902]: pgmap v364: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:33:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 498.247188 secs 2024-04-21T10:33:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 498.247188 secs 2024-04-21T10:33:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 498.247188 secs 2024-04-21T10:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:08 smithi170 ceph-mon[31212]: pgmap v365: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:33:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:08 smithi077 ceph-mon[27902]: pgmap v365: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:33:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:08 smithi191 ceph-mon[31636]: pgmap v365: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:33:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:10 smithi170 ceph-mon[31212]: pgmap v366: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:33:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:10 smithi077 ceph-mon[27902]: pgmap v366: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:33:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:10 smithi191 ceph-mon[31636]: pgmap v366: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:33:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:12 smithi170 ceph-mon[31212]: pgmap v367: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:33:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:12 smithi170 ceph-mon[31212]: osdmap e100: 12 total, 12 up, 12 in 2024-04-21T10:33:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 503.247258 secs 2024-04-21T10:33:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:12 smithi077 ceph-mon[27902]: pgmap v367: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:33:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:12 smithi077 ceph-mon[27902]: osdmap e100: 12 total, 12 up, 12 in 2024-04-21T10:33:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 503.247258 secs 2024-04-21T10:33:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:12 smithi191 ceph-mon[31636]: pgmap v367: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:33:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:12 smithi191 ceph-mon[31636]: osdmap e100: 12 total, 12 up, 12 in 2024-04-21T10:33:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 503.247258 secs 2024-04-21T10:33:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:14 smithi170 ceph-mon[31212]: pgmap v369: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T10:33:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:14 smithi077 ceph-mon[27902]: pgmap v369: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T10:33:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:14 smithi191 ceph-mon[31636]: pgmap v369: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T10:33:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:16 smithi170 ceph-mon[31212]: pgmap v370: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:33:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:16 smithi077 ceph-mon[27902]: pgmap v370: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:33:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:16 smithi191 ceph-mon[31636]: pgmap v370: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T10:33:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:17 smithi191 ceph-mon[31636]: pgmap v371: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:33:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 508.247379 secs 2024-04-21T10:33:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:17 smithi170 ceph-mon[31212]: pgmap v371: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:33:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 508.247379 secs 2024-04-21T10:33:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:17 smithi077 ceph-mon[27902]: pgmap v371: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:33:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 508.247379 secs 2024-04-21T10:33:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:19 smithi077 ceph-mon[27902]: pgmap v372: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:33:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:19 smithi191 ceph-mon[31636]: pgmap v372: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:33:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:19 smithi170 ceph-mon[31212]: pgmap v372: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:33:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:21 smithi077 ceph-mon[27902]: pgmap v373: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:33:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:21 smithi191 ceph-mon[31636]: pgmap v373: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:33:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:21 smithi170 ceph-mon[31212]: pgmap v373: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:33:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 513.247501 secs 2024-04-21T10:33:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 513.247501 secs 2024-04-21T10:33:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 513.247501 secs 2024-04-21T10:33:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:23 smithi077 ceph-mon[27902]: pgmap v374: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:33:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:23 smithi191 ceph-mon[31636]: pgmap v374: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:33:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:23 smithi170 ceph-mon[31212]: pgmap v374: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:33:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:25 smithi077 ceph-mon[27902]: pgmap v375: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:25 smithi191 ceph-mon[31636]: pgmap v375: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:25 smithi170 ceph-mon[31212]: pgmap v375: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:27 smithi077 ceph-mon[27902]: pgmap v376: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 518.247652 secs 2024-04-21T10:33:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:27 smithi191 ceph-mon[31636]: pgmap v376: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 518.247652 secs 2024-04-21T10:33:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:27 smithi170 ceph-mon[31212]: pgmap v376: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 518.247652 secs 2024-04-21T10:33:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:29 smithi077 ceph-mon[27902]: pgmap v377: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:29 smithi191 ceph-mon[31636]: pgmap v377: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:29 smithi170 ceph-mon[31212]: pgmap v377: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:31 smithi077 ceph-mon[27902]: pgmap v378: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:31 smithi191 ceph-mon[31636]: pgmap v378: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:31 smithi170 ceph-mon[31212]: pgmap v378: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:32.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 523.247744 secs 2024-04-21T10:33:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 523.247744 secs 2024-04-21T10:33:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 523.247744 secs 2024-04-21T10:33:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:33 smithi191 ceph-mon[31636]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:33 smithi170 ceph-mon[31212]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:33 smithi077 ceph-mon[27902]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:35 smithi191 ceph-mon[31636]: pgmap v380: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:35 smithi170 ceph-mon[31212]: pgmap v380: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:35 smithi077 ceph-mon[27902]: pgmap v380: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:37 smithi191 ceph-mon[31636]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 528.247880 secs 2024-04-21T10:33:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:37 smithi170 ceph-mon[31212]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 528.247880 secs 2024-04-21T10:33:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:37 smithi077 ceph-mon[27902]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 528.247880 secs 2024-04-21T10:33:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:39 smithi191 ceph-mon[31636]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:39 smithi170 ceph-mon[31212]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:39 smithi077 ceph-mon[27902]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:41 smithi191 ceph-mon[31636]: pgmap v383: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:41 smithi170 ceph-mon[31212]: pgmap v383: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:41 smithi077 ceph-mon[27902]: pgmap v383: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 533.248002 secs 2024-04-21T10:33:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:33:42.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 533.248002 secs 2024-04-21T10:33:42.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:33:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 533.248002 secs 2024-04-21T10:33:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:33:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:33:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:33:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:33:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:33:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:45 smithi191 ceph-mon[31636]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:45 smithi170 ceph-mon[31212]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:45 smithi077 ceph-mon[27902]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 538.248047 secs 2024-04-21T10:33:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 538.248047 secs 2024-04-21T10:33:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 538.248047 secs 2024-04-21T10:33:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:47 smithi191 ceph-mon[31636]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:47 smithi170 ceph-mon[31212]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:47 smithi077 ceph-mon[27902]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:49 smithi191 ceph-mon[31636]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:49 smithi170 ceph-mon[31212]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:49 smithi077 ceph-mon[27902]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:51 smithi191 ceph-mon[31636]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 543.248167 secs 2024-04-21T10:33:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:51 smithi170 ceph-mon[31212]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 543.248167 secs 2024-04-21T10:33:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:51 smithi077 ceph-mon[27902]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 543.248167 secs 2024-04-21T10:33:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:53 smithi191 ceph-mon[31636]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:53 smithi170 ceph-mon[31212]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:53 smithi077 ceph-mon[27902]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:33:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:55 smithi191 ceph-mon[31636]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:55 smithi170 ceph-mon[31212]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:55 smithi077 ceph-mon[27902]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:33:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 548.248292 secs 2024-04-21T10:33:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 548.248292 secs 2024-04-21T10:33:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 548.248292 secs 2024-04-21T10:33:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:57 smithi191 ceph-mon[31636]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:57 smithi170 ceph-mon[31212]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:57 smithi077 ceph-mon[27902]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:33:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:33:59 smithi191 ceph-mon[31636]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:33:59 smithi170 ceph-mon[31212]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:33:59 smithi077 ceph-mon[27902]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:01 smithi191 ceph-mon[31636]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 553.248440 secs 2024-04-21T10:34:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:01 smithi170 ceph-mon[31212]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 553.248440 secs 2024-04-21T10:34:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:01 smithi077 ceph-mon[27902]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 553.248440 secs 2024-04-21T10:34:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:03 smithi191 ceph-mon[31636]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:03 smithi170 ceph-mon[31212]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:03 smithi077 ceph-mon[27902]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:04 smithi191 ceph-mon[31636]: osdmap e101: 12 total, 12 up, 12 in 2024-04-21T10:34:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:04 smithi170 ceph-mon[31212]: osdmap e101: 12 total, 12 up, 12 in 2024-04-21T10:34:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:04 smithi077 ceph-mon[27902]: osdmap e101: 12 total, 12 up, 12 in 2024-04-21T10:34:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:05 smithi191 ceph-mon[31636]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:34:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:05 smithi170 ceph-mon[31212]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:34:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:05 smithi077 ceph-mon[27902]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:34:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 558.248560 secs 2024-04-21T10:34:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 558.248560 secs 2024-04-21T10:34:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 558.248560 secs 2024-04-21T10:34:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:07 smithi191 ceph-mon[31636]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:34:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:07 smithi170 ceph-mon[31212]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:34:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:07 smithi077 ceph-mon[27902]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:34:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:09 smithi191 ceph-mon[31636]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:34:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:09 smithi170 ceph-mon[31212]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:34:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:09 smithi077 ceph-mon[27902]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:34:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:11 smithi191 ceph-mon[31636]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:34:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:11 smithi191 ceph-mon[31636]: osdmap e102: 12 total, 12 up, 12 in 2024-04-21T10:34:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 563.248694 secs 2024-04-21T10:34:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:11 smithi170 ceph-mon[31212]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:34:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:11 smithi170 ceph-mon[31212]: osdmap e102: 12 total, 12 up, 12 in 2024-04-21T10:34:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 563.248694 secs 2024-04-21T10:34:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:11 smithi077 ceph-mon[27902]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:34:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:11 smithi077 ceph-mon[27902]: osdmap e102: 12 total, 12 up, 12 in 2024-04-21T10:34:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 563.248694 secs 2024-04-21T10:34:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:13 smithi191 ceph-mon[31636]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:34:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:13 smithi170 ceph-mon[31212]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:34:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:13 smithi077 ceph-mon[27902]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:34:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:15 smithi191 ceph-mon[31636]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:34:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:15 smithi170 ceph-mon[31212]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:34:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:15 smithi077 ceph-mon[27902]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:34:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 568.248788 secs 2024-04-21T10:34:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 568.248788 secs 2024-04-21T10:34:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 568.248788 secs 2024-04-21T10:34:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:17 smithi170 ceph-mon[31212]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:34:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:17 smithi077 ceph-mon[27902]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:34:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:17 smithi191 ceph-mon[31636]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:34:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:19 smithi170 ceph-mon[31212]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:34:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:19 smithi077 ceph-mon[27902]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:34:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:19 smithi191 ceph-mon[31636]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:34:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:21 smithi170 ceph-mon[31212]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:34:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 573.248885 secs 2024-04-21T10:34:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:21 smithi077 ceph-mon[27902]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:34:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 573.248885 secs 2024-04-21T10:34:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:21 smithi191 ceph-mon[31636]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:34:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 573.248885 secs 2024-04-21T10:34:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:23 smithi170 ceph-mon[31212]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:34:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:23 smithi077 ceph-mon[27902]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:34:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:23 smithi191 ceph-mon[31636]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:34:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:25 smithi170 ceph-mon[31212]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:25 smithi077 ceph-mon[27902]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:25 smithi191 ceph-mon[31636]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 578.249015 secs 2024-04-21T10:34:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 578.249015 secs 2024-04-21T10:34:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 578.249015 secs 2024-04-21T10:34:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:27 smithi170 ceph-mon[31212]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:27 smithi077 ceph-mon[27902]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:27 smithi191 ceph-mon[31636]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:29 smithi170 ceph-mon[31212]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:29 smithi077 ceph-mon[27902]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:29 smithi191 ceph-mon[31636]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:31 smithi170 ceph-mon[31212]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 583.249115 secs 2024-04-21T10:34:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:31 smithi077 ceph-mon[27902]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 583.249115 secs 2024-04-21T10:34:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:31 smithi191 ceph-mon[31636]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 583.249115 secs 2024-04-21T10:34:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:33 smithi170 ceph-mon[31212]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:33 smithi077 ceph-mon[27902]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:33 smithi191 ceph-mon[31636]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:35 smithi170 ceph-mon[31212]: pgmap v412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:35 smithi077 ceph-mon[27902]: pgmap v412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:35 smithi191 ceph-mon[31636]: pgmap v412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 588.249216 secs 2024-04-21T10:34:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 588.249216 secs 2024-04-21T10:34:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 588.249216 secs 2024-04-21T10:34:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:37 smithi170 ceph-mon[31212]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:37 smithi077 ceph-mon[27902]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:37 smithi191 ceph-mon[31636]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:39 smithi170 ceph-mon[31212]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:39 smithi077 ceph-mon[27902]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:39 smithi191 ceph-mon[31636]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:34:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:41 smithi170 ceph-mon[31212]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 593.249280 secs 2024-04-21T10:34:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:41 smithi077 ceph-mon[27902]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 593.249280 secs 2024-04-21T10:34:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:41 smithi191 ceph-mon[31636]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 593.249280 secs 2024-04-21T10:34:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 595.010837 secs 2024-04-21T10:34:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: slow request 183.275038 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: slow request 341.302720 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: slow request 356.464646 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: slow request 356.453489 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: slow request 356.405306 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 595.010837 secs 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: slow request 183.275038 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: slow request 341.302720 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: slow request 356.464646 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: slow request 356.453489 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: slow request 356.405306 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:34:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 595.010837 secs 2024-04-21T10:34:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: slow request 183.275038 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: slow request 341.302720 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: slow request 356.464646 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:44.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: slow request 356.453489 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:44.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: slow request 356.405306 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:44.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:44 smithi170 ceph-mon[31212]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:44 smithi170 ceph-mon[31212]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:44 smithi170 ceph-mon[31212]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:34:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:34:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:34:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:44 smithi077 ceph-mon[27902]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:34:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:44 smithi077 ceph-mon[27902]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:34:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:44 smithi077 ceph-mon[27902]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:34:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:34:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:34:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:34:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:44 smithi191 ceph-mon[31636]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-21T10:34:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:44 smithi191 ceph-mon[31636]: mds.? [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] up:active 2024-04-21T10:34:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:44 smithi191 ceph-mon[31636]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-21T10:34:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:34:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:34:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:34:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:46 smithi077 ceph-mon[27902]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:46 smithi191 ceph-mon[31636]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:46 smithi170 ceph-mon[31212]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 598.249419 secs 2024-04-21T10:34:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 598.249419 secs 2024-04-21T10:34:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 598.249419 secs 2024-04-21T10:34:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:48 smithi077 ceph-mon[27902]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:48 smithi191 ceph-mon[31636]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:48 smithi170 ceph-mon[31212]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 600.010954 secs 2024-04-21T10:34:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:49 smithi077 ceph-mon[27902]: slow request 361.464762 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:49 smithi077 ceph-mon[27902]: slow request 361.453605 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:49 smithi077 ceph-mon[27902]: slow request 361.405422 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:49 smithi077 ceph-mon[27902]: slow request 361.374373 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:49 smithi077 ceph-mon[27902]: slow request 361.330811 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 600.010954 secs 2024-04-21T10:34:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:49 smithi191 ceph-mon[31636]: slow request 361.464762 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:49 smithi191 ceph-mon[31636]: slow request 361.453605 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:49 smithi191 ceph-mon[31636]: slow request 361.405422 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:49 smithi191 ceph-mon[31636]: slow request 361.374373 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:49 smithi191 ceph-mon[31636]: slow request 361.330811 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 600.010954 secs 2024-04-21T10:34:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:49 smithi170 ceph-mon[31212]: slow request 361.464762 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:34:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:49 smithi170 ceph-mon[31212]: slow request 361.453605 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:49 smithi170 ceph-mon[31212]: slow request 361.405422 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:49 smithi170 ceph-mon[31212]: slow request 361.374373 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:49 smithi170 ceph-mon[31212]: slow request 361.330811 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:50 smithi077 ceph-mon[27902]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:50 smithi191 ceph-mon[31636]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:50 smithi170 ceph-mon[31212]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:51 smithi077 ceph-mon[27902]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:51 smithi191 ceph-mon[31636]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:51 smithi170 ceph-mon[31212]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 603.249564 secs 2024-04-21T10:34:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 603.249564 secs 2024-04-21T10:34:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 603.249564 secs 2024-04-21T10:34:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:53 smithi077 ceph-mon[27902]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:53 smithi191 ceph-mon[31636]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:53 smithi170 ceph-mon[31212]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 605.011036 secs 2024-04-21T10:34:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:54 smithi077 ceph-mon[27902]: slow request 366.374455 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:54 smithi077 ceph-mon[27902]: slow request 366.330893 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:54 smithi077 ceph-mon[27902]: slow request 366.203583 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:54 smithi077 ceph-mon[27902]: slow request 366.193838 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:54 smithi077 ceph-mon[27902]: slow request 366.174845 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:34:54.436+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50005850 con 0x7efd78101130 2024-04-21T10:34:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:34:54.436+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50005850 con 0x7efd78101130 2024-04-21T10:34:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:34:54.460+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48005850 con 0x5637269918d0 2024-04-21T10:34:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:34:54.460+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48005850 con 0x5637269918d0 2024-04-21T10:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 605.011036 secs 2024-04-21T10:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:54 smithi191 ceph-mon[31636]: slow request 366.374455 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:54 smithi191 ceph-mon[31636]: slow request 366.330893 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:54 smithi191 ceph-mon[31636]: slow request 366.203583 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:54 smithi191 ceph-mon[31636]: slow request 366.193838 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:54 smithi191 ceph-mon[31636]: slow request 366.174845 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 605.011036 secs 2024-04-21T10:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:54 smithi170 ceph-mon[31212]: slow request 366.374455 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:54 smithi170 ceph-mon[31212]: slow request 366.330893 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:54 smithi170 ceph-mon[31212]: slow request 366.203583 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:54 smithi170 ceph-mon[31212]: slow request 366.193838 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:54 smithi170 ceph-mon[31212]: slow request 366.174845 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:34:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:55 smithi077 ceph-mon[27902]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:55 smithi191 ceph-mon[31636]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:55 smithi170 ceph-mon[31212]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:57 smithi077 ceph-mon[27902]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 608.249652 secs 2024-04-21T10:34:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:57 smithi191 ceph-mon[31636]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 608.249652 secs 2024-04-21T10:34:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:57 smithi170 ceph-mon[31212]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:34:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 608.249652 secs 2024-04-21T10:34:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:58 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 610.011157 secs 2024-04-21T10:34:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:58 smithi191 ceph-mon[31636]: slow request 371.203703 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:58 smithi191 ceph-mon[31636]: slow request 371.193958 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:58 smithi191 ceph-mon[31636]: slow request 371.174966 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:58 smithi191 ceph-mon[31636]: slow request 371.172950 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:58 smithi191 ceph-mon[31636]: slow request 371.164963 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:58 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 610.011157 secs 2024-04-21T10:34:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:58 smithi170 ceph-mon[31212]: slow request 371.203703 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:58 smithi170 ceph-mon[31212]: slow request 371.193958 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:58 smithi170 ceph-mon[31212]: slow request 371.174966 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:58 smithi170 ceph-mon[31212]: slow request 371.172950 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:58 smithi170 ceph-mon[31212]: slow request 371.164963 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:58 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 610.011157 secs 2024-04-21T10:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:58 smithi077 ceph-mon[27902]: slow request 371.203703 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:58 smithi077 ceph-mon[27902]: slow request 371.193958 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:58 smithi077 ceph-mon[27902]: slow request 371.174966 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:58 smithi077 ceph-mon[27902]: slow request 371.172950 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:58 smithi077 ceph-mon[27902]: slow request 371.164963 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:34:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:34:59 smithi191 ceph-mon[31636]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:34:59 smithi170 ceph-mon[31212]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:34:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:34:59 smithi077 ceph-mon[27902]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:01 smithi191 ceph-mon[31636]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:01 smithi170 ceph-mon[31212]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:01 smithi077 ceph-mon[27902]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 613.249782 secs 2024-04-21T10:35:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 613.249782 secs 2024-04-21T10:35:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 613.249782 secs 2024-04-21T10:35:03.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:03.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 615.011263 secs 2024-04-21T10:35:03.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: slow request 361.303146 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:03.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: slow request 376.173057 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: slow request 376.165070 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: slow request 376.158218 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:03 smithi170 ceph-mon[31212]: slow request 376.149211 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 615.011263 secs 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: slow request 361.303146 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: slow request 376.173057 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: slow request 376.165070 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: slow request 376.158218 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:03 smithi191 ceph-mon[31636]: slow request 376.149211 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 615.011263 secs 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: slow request 361.303146 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: slow request 376.173057 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: slow request 376.165070 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: slow request 376.158218 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:03 smithi077 ceph-mon[27902]: slow request 376.149211 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:04 smithi191 ceph-mon[31636]: osdmap e103: 12 total, 12 up, 12 in 2024-04-21T10:35:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:04 smithi170 ceph-mon[31212]: osdmap e103: 12 total, 12 up, 12 in 2024-04-21T10:35:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:04 smithi077 ceph-mon[27902]: osdmap e103: 12 total, 12 up, 12 in 2024-04-21T10:35:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:05 smithi191 ceph-mon[31636]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:35:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:05 smithi170 ceph-mon[31212]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:35:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:05 smithi077 ceph-mon[27902]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:35:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:07 smithi191 ceph-mon[31636]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:35:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 618.249865 secs 2024-04-21T10:35:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:07 smithi170 ceph-mon[31212]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:35:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 618.249865 secs 2024-04-21T10:35:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:07 smithi077 ceph-mon[27902]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:35:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 618.249865 secs 2024-04-21T10:35:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:08 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 620.011378 secs 2024-04-21T10:35:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:08 smithi191 ceph-mon[31636]: slow request 381.158332 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:08 smithi191 ceph-mon[31636]: slow request 381.149326 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:08 smithi191 ceph-mon[31636]: slow request 620.011377 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:35:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:08 smithi191 ceph-mon[31636]: slow request 381.144217 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:08 smithi191 ceph-mon[31636]: slow request 381.128708 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:08 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 620.011378 secs 2024-04-21T10:35:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:08 smithi170 ceph-mon[31212]: slow request 381.158332 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:08 smithi170 ceph-mon[31212]: slow request 381.149326 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:08 smithi170 ceph-mon[31212]: slow request 620.011377 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:35:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:08 smithi170 ceph-mon[31212]: slow request 381.144217 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:08 smithi170 ceph-mon[31212]: slow request 381.128708 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:08 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 620.011378 secs 2024-04-21T10:35:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:08 smithi077 ceph-mon[27902]: slow request 381.158332 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:08 smithi077 ceph-mon[27902]: slow request 381.149326 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:08 smithi077 ceph-mon[27902]: slow request 620.011377 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:35:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:08 smithi077 ceph-mon[27902]: slow request 381.144217 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:08 smithi077 ceph-mon[27902]: slow request 381.128708 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:09 smithi191 ceph-mon[31636]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:35:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:09 smithi170 ceph-mon[31212]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:35:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:09 smithi077 ceph-mon[27902]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:35:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:11 smithi191 ceph-mon[31636]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:35:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:11 smithi191 ceph-mon[31636]: osdmap e104: 12 total, 12 up, 12 in 2024-04-21T10:35:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:11 smithi170 ceph-mon[31212]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:35:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:11 smithi170 ceph-mon[31212]: osdmap e104: 12 total, 12 up, 12 in 2024-04-21T10:35:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:11 smithi077 ceph-mon[27902]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:35:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:11 smithi077 ceph-mon[27902]: osdmap e104: 12 total, 12 up, 12 in 2024-04-21T10:35:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 623.249985 secs 2024-04-21T10:35:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 623.249985 secs 2024-04-21T10:35:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 623.249985 secs 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 625.011497 secs 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: slow request 386.144336 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: slow request 386.128827 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: slow request 386.120139 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: slow request 381.221576 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:13 smithi191 ceph-mon[31636]: slow request 381.206704 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:13.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:35:13.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 625.011497 secs 2024-04-21T10:35:13.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: slow request 386.144336 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: slow request 386.128827 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: slow request 386.120139 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: slow request 381.221576 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:13.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:13 smithi077 ceph-mon[27902]: slow request 381.206704 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:35:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 625.011497 secs 2024-04-21T10:35:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: slow request 386.144336 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: slow request 386.128827 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: slow request 386.120139 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: slow request 381.221576 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:13 smithi170 ceph-mon[31212]: slow request 381.206704 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:15 smithi191 ceph-mon[31636]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:35:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:15 smithi170 ceph-mon[31212]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:35:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:15 smithi077 ceph-mon[27902]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:35:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:17 smithi191 ceph-mon[31636]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:35:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 628.250082 secs 2024-04-21T10:35:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:17 smithi170 ceph-mon[31212]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:35:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 628.250082 secs 2024-04-21T10:35:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:17 smithi077 ceph-mon[27902]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:35:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 628.250082 secs 2024-04-21T10:35:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:18 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 630.011632 secs 2024-04-21T10:35:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:18 smithi170 ceph-mon[31212]: slow request 391.120275 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:18 smithi170 ceph-mon[31212]: slow request 386.221711 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:18 smithi170 ceph-mon[31212]: slow request 386.206840 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:18 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 630.011632 secs 2024-04-21T10:35:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:18 smithi077 ceph-mon[27902]: slow request 391.120275 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:18 smithi077 ceph-mon[27902]: slow request 386.221711 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:18 smithi077 ceph-mon[27902]: slow request 386.206840 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:18 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 630.011632 secs 2024-04-21T10:35:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:18 smithi191 ceph-mon[31636]: slow request 391.120275 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:35:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:18 smithi191 ceph-mon[31636]: slow request 386.221711 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:18 smithi191 ceph-mon[31636]: slow request 386.206840 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:35:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:19 smithi170 ceph-mon[31212]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:35:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:19 smithi077 ceph-mon[27902]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:35:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:19 smithi191 ceph-mon[31636]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:35:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:21 smithi191 ceph-mon[31636]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:35:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:21 smithi170 ceph-mon[31212]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:35:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:21 smithi077 ceph-mon[27902]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 633.250163 secs 2024-04-21T10:35:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 633.250163 secs 2024-04-21T10:35:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 633.250163 secs 2024-04-21T10:35:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:23 smithi191 ceph-mon[31636]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:35:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 635.011773 secs 2024-04-21T10:35:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:23 smithi170 ceph-mon[31212]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:35:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 635.011773 secs 2024-04-21T10:35:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:23 smithi077 ceph-mon[27902]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:35:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 635.011773 secs 2024-04-21T10:35:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:25 smithi191 ceph-mon[31636]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:25 smithi170 ceph-mon[31212]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:25 smithi077 ceph-mon[27902]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:27 smithi191 ceph-mon[31636]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 638.250281 secs 2024-04-21T10:35:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:27 smithi170 ceph-mon[31212]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 638.250281 secs 2024-04-21T10:35:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:27 smithi077 ceph-mon[27902]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 638.250281 secs 2024-04-21T10:35:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 640.011906 secs 2024-04-21T10:35:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 640.011906 secs 2024-04-21T10:35:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 640.011906 secs 2024-04-21T10:35:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:29 smithi191 ceph-mon[31636]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:29 smithi170 ceph-mon[31212]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:29 smithi077 ceph-mon[27902]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:31 smithi191 ceph-mon[31636]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:31 smithi170 ceph-mon[31212]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:31 smithi077 ceph-mon[27902]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 643.250437 secs 2024-04-21T10:35:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 643.250437 secs 2024-04-21T10:35:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 643.250437 secs 2024-04-21T10:35:33.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:33 smithi170 ceph-mon[31212]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:33.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 645.012057 secs 2024-04-21T10:35:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:33 smithi191 ceph-mon[31636]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 645.012057 secs 2024-04-21T10:35:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:33 smithi077 ceph-mon[27902]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 645.012057 secs 2024-04-21T10:35:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:35 smithi191 ceph-mon[31636]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:35 smithi170 ceph-mon[31212]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:35 smithi077 ceph-mon[27902]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:37 smithi191 ceph-mon[31636]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 648.250535 secs 2024-04-21T10:35:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:37 smithi170 ceph-mon[31212]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 648.250535 secs 2024-04-21T10:35:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:37 smithi077 ceph-mon[27902]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 648.250535 secs 2024-04-21T10:35:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 650.012178 secs 2024-04-21T10:35:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 650.012178 secs 2024-04-21T10:35:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 650.012178 secs 2024-04-21T10:35:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:39 smithi191 ceph-mon[31636]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:39 smithi170 ceph-mon[31212]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:39 smithi077 ceph-mon[27902]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:41 smithi191 ceph-mon[31636]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:41 smithi170 ceph-mon[31212]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:41 smithi077 ceph-mon[27902]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 653.250649 secs 2024-04-21T10:35:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 653.250649 secs 2024-04-21T10:35:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 653.250649 secs 2024-04-21T10:35:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:43 smithi191 ceph-mon[31636]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 655.012271 secs 2024-04-21T10:35:43.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:43 smithi077 ceph-mon[27902]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:43.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 655.012271 secs 2024-04-21T10:35:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:43 smithi170 ceph-mon[31212]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 655.012271 secs 2024-04-21T10:35:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:35:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:35:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:35:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:45 smithi191 ceph-mon[31636]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:35:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:35:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:35:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:45 smithi170 ceph-mon[31212]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:35:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:35:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:35:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:45 smithi077 ceph-mon[27902]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:35:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:35:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:35:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:47 smithi191 ceph-mon[31636]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 658.250784 secs 2024-04-21T10:35:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:47 smithi170 ceph-mon[31212]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 658.250784 secs 2024-04-21T10:35:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:47 smithi077 ceph-mon[27902]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 658.250784 secs 2024-04-21T10:35:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 660.012393 secs 2024-04-21T10:35:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 660.012393 secs 2024-04-21T10:35:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 660.012393 secs 2024-04-21T10:35:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:49 smithi191 ceph-mon[31636]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:49 smithi170 ceph-mon[31212]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:49 smithi077 ceph-mon[27902]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:51 smithi191 ceph-mon[31636]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:51 smithi170 ceph-mon[31212]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:51 smithi077 ceph-mon[27902]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 663.250881 secs 2024-04-21T10:35:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 663.250881 secs 2024-04-21T10:35:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 663.250881 secs 2024-04-21T10:35:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:53 smithi170 ceph-mon[31212]: pgmap v453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 665.012505 secs 2024-04-21T10:35:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:53 smithi077 ceph-mon[27902]: pgmap v453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 665.012505 secs 2024-04-21T10:35:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:53 smithi191 ceph-mon[31636]: pgmap v453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 665.012505 secs 2024-04-21T10:35:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:35:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:55 smithi170 ceph-mon[31212]: pgmap v454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:55 smithi077 ceph-mon[27902]: pgmap v454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:55 smithi191 ceph-mon[31636]: pgmap v454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:57 smithi170 ceph-mon[31212]: pgmap v455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 668.250999 secs 2024-04-21T10:35:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:57 smithi077 ceph-mon[27902]: pgmap v455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 668.250999 secs 2024-04-21T10:35:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:57 smithi191 ceph-mon[31636]: pgmap v455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:35:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 668.250999 secs 2024-04-21T10:35:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 670.012636 secs 2024-04-21T10:35:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 670.012636 secs 2024-04-21T10:35:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 670.012636 secs 2024-04-21T10:35:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:35:59 smithi170 ceph-mon[31212]: pgmap v456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:35:59 smithi077 ceph-mon[27902]: pgmap v456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:35:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:35:59 smithi191 ceph-mon[31636]: pgmap v456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:01 smithi170 ceph-mon[31212]: pgmap v457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:01 smithi077 ceph-mon[27902]: pgmap v457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:01 smithi191 ceph-mon[31636]: pgmap v457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 673.251119 secs 2024-04-21T10:36:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 673.251119 secs 2024-04-21T10:36:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 673.251119 secs 2024-04-21T10:36:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:03 smithi170 ceph-mon[31212]: pgmap v458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 675.012757 secs 2024-04-21T10:36:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:03 smithi077 ceph-mon[27902]: pgmap v458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 675.012757 secs 2024-04-21T10:36:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:03 smithi191 ceph-mon[31636]: pgmap v458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 675.012757 secs 2024-04-21T10:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:04 smithi170 ceph-mon[31212]: osdmap e105: 12 total, 12 up, 12 in 2024-04-21T10:36:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:04 smithi077 ceph-mon[27902]: osdmap e105: 12 total, 12 up, 12 in 2024-04-21T10:36:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:04 smithi191 ceph-mon[31636]: osdmap e105: 12 total, 12 up, 12 in 2024-04-21T10:36:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:05 smithi170 ceph-mon[31212]: pgmap v460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:36:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:05 smithi077 ceph-mon[27902]: pgmap v460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:36:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:05 smithi191 ceph-mon[31636]: pgmap v460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:36:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 678.251228 secs 2024-04-21T10:36:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 678.251228 secs 2024-04-21T10:36:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 678.251228 secs 2024-04-21T10:36:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:07 smithi170 ceph-mon[31212]: pgmap v461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:36:07.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:07 smithi191 ceph-mon[31636]: pgmap v461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:36:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:07 smithi077 ceph-mon[27902]: pgmap v461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:36:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 680.012907 secs 2024-04-21T10:36:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 680.012907 secs 2024-04-21T10:36:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 680.012907 secs 2024-04-21T10:36:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:09 smithi170 ceph-mon[31212]: pgmap v462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:36:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:09 smithi077 ceph-mon[27902]: pgmap v462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:36:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:09 smithi191 ceph-mon[31636]: pgmap v462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:36:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:11 smithi170 ceph-mon[31212]: pgmap v463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:36:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:11 smithi170 ceph-mon[31212]: osdmap e106: 12 total, 12 up, 12 in 2024-04-21T10:36:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 683.251352 secs 2024-04-21T10:36:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:11 smithi077 ceph-mon[27902]: pgmap v463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:36:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:11 smithi077 ceph-mon[27902]: osdmap e106: 12 total, 12 up, 12 in 2024-04-21T10:36:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 683.251352 secs 2024-04-21T10:36:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:11 smithi191 ceph-mon[31636]: pgmap v463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:36:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:11 smithi191 ceph-mon[31636]: osdmap e106: 12 total, 12 up, 12 in 2024-04-21T10:36:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 683.251352 secs 2024-04-21T10:36:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:13 smithi170 ceph-mon[31212]: pgmap v465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:36:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 685.013025 secs 2024-04-21T10:36:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:13 smithi077 ceph-mon[27902]: pgmap v465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:36:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 685.013025 secs 2024-04-21T10:36:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:13 smithi191 ceph-mon[31636]: pgmap v465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:36:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 685.013025 secs 2024-04-21T10:36:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:15 smithi170 ceph-mon[31212]: pgmap v466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:36:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:15 smithi077 ceph-mon[27902]: pgmap v466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:36:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:15 smithi191 ceph-mon[31636]: pgmap v466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:36:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 688.251470 secs 2024-04-21T10:36:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 688.251470 secs 2024-04-21T10:36:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 688.251470 secs 2024-04-21T10:36:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:17 smithi170 ceph-mon[31212]: pgmap v467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:36:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:17 smithi077 ceph-mon[27902]: pgmap v467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:36:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:17 smithi191 ceph-mon[31636]: pgmap v467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:36:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 690.013140 secs 2024-04-21T10:36:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 690.013140 secs 2024-04-21T10:36:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 690.013140 secs 2024-04-21T10:36:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:19 smithi170 ceph-mon[31212]: pgmap v468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:36:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:19 smithi077 ceph-mon[27902]: pgmap v468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:36:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:19 smithi191 ceph-mon[31636]: pgmap v468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:36:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:21 smithi170 ceph-mon[31212]: pgmap v469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:36:21.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 693.251547 secs 2024-04-21T10:36:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:21 smithi077 ceph-mon[27902]: pgmap v469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:36:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 693.251547 secs 2024-04-21T10:36:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:21 smithi191 ceph-mon[31636]: pgmap v469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:36:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 693.251547 secs 2024-04-21T10:36:23.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:23 smithi077 ceph-mon[27902]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:36:23.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 695.013250 secs 2024-04-21T10:36:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:23 smithi191 ceph-mon[31636]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:36:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 695.013250 secs 2024-04-21T10:36:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:23 smithi170 ceph-mon[31212]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:36:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 695.013250 secs 2024-04-21T10:36:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:25 smithi077 ceph-mon[27902]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:25 smithi191 ceph-mon[31636]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:25 smithi170 ceph-mon[31212]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 698.251681 secs 2024-04-21T10:36:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 698.251681 secs 2024-04-21T10:36:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 698.251681 secs 2024-04-21T10:36:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:27 smithi077 ceph-mon[27902]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:27 smithi191 ceph-mon[31636]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:27 smithi170 ceph-mon[31212]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 700.013363 secs 2024-04-21T10:36:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 700.013363 secs 2024-04-21T10:36:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 700.013363 secs 2024-04-21T10:36:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:29 smithi077 ceph-mon[27902]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:29 smithi191 ceph-mon[31636]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:29 smithi170 ceph-mon[31212]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:31 smithi077 ceph-mon[27902]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 703.251829 secs 2024-04-21T10:36:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:31 smithi191 ceph-mon[31636]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 703.251829 secs 2024-04-21T10:36:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:31 smithi170 ceph-mon[31212]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 703.251829 secs 2024-04-21T10:36:33.858 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:33 smithi170 ceph-mon[31212]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:33.859 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 705.013471 secs 2024-04-21T10:36:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:33 smithi077 ceph-mon[27902]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 705.013471 secs 2024-04-21T10:36:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:33 smithi191 ceph-mon[31636]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 705.013471 secs 2024-04-21T10:36:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:35 smithi077 ceph-mon[27902]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:35 smithi191 ceph-mon[31636]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:35 smithi170 ceph-mon[31212]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 708.251952 secs 2024-04-21T10:36:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 708.251952 secs 2024-04-21T10:36:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 708.251952 secs 2024-04-21T10:36:37.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:37 smithi191 ceph-mon[31636]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:37 smithi077 ceph-mon[27902]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:37 smithi170 ceph-mon[31212]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 710.013610 secs 2024-04-21T10:36:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 710.013610 secs 2024-04-21T10:36:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 710.013610 secs 2024-04-21T10:36:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:39 smithi077 ceph-mon[27902]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:39 smithi191 ceph-mon[31636]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:39 smithi170 ceph-mon[31212]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:41 smithi077 ceph-mon[27902]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 713.252048 secs 2024-04-21T10:36:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:41 smithi191 ceph-mon[31636]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 713.252048 secs 2024-04-21T10:36:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:41 smithi170 ceph-mon[31212]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 713.252048 secs 2024-04-21T10:36:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:43 smithi077 ceph-mon[27902]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 715.013748 secs 2024-04-21T10:36:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:43 smithi191 ceph-mon[31636]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 715.013748 secs 2024-04-21T10:36:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:43 smithi170 ceph-mon[31212]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 715.013748 secs 2024-04-21T10:36:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:45 smithi077 ceph-mon[27902]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:36:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:45 smithi191 ceph-mon[31636]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:36:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:45 smithi170 ceph-mon[31212]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:36:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:36:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:36:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:36:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 718.252119 secs 2024-04-21T10:36:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:36:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:36:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:36:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 718.252119 secs 2024-04-21T10:36:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:36:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:36:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:36:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 718.252119 secs 2024-04-21T10:36:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:47 smithi191 ceph-mon[31636]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:47 smithi170 ceph-mon[31212]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:47 smithi077 ceph-mon[27902]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:48 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 720.013913 secs 2024-04-21T10:36:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:48 smithi191 ceph-mon[31636]: slow request 720.013912 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:36:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:48 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 720.013913 secs 2024-04-21T10:36:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:48 smithi170 ceph-mon[31212]: slow request 720.013912 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:36:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:48 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 720.013913 secs 2024-04-21T10:36:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:48 smithi077 ceph-mon[27902]: slow request 720.013912 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:36:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:49 smithi191 ceph-mon[31636]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:49 smithi170 ceph-mon[31212]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:49 smithi077 ceph-mon[27902]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:51 smithi191 ceph-mon[31636]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:51 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 723.252231 secs 2024-04-21T10:36:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:51 smithi191 ceph-mon[31636]: slow request 723.252230 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:36:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:51 smithi170 ceph-mon[31212]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:51 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 723.252231 secs 2024-04-21T10:36:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:51 smithi170 ceph-mon[31212]: slow request 723.252230 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:36:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:51 smithi077 ceph-mon[27902]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:51 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 723.252231 secs 2024-04-21T10:36:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:51 smithi077 ceph-mon[27902]: slow request 723.252230 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:36:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:53 smithi191 ceph-mon[31636]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 725.014034 secs 2024-04-21T10:36:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:53 smithi170 ceph-mon[31212]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 725.014034 secs 2024-04-21T10:36:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:53 smithi077 ceph-mon[27902]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 725.014034 secs 2024-04-21T10:36:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:36:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:55 smithi191 ceph-mon[31636]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:55 smithi170 ceph-mon[31212]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:55 smithi077 ceph-mon[27902]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:36:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 728.252337 secs 2024-04-21T10:36:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 728.252337 secs 2024-04-21T10:36:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 728.252337 secs 2024-04-21T10:36:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:57 smithi191 ceph-mon[31636]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:57 smithi170 ceph-mon[31212]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:57 smithi077 ceph-mon[27902]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:36:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 730.014158 secs 2024-04-21T10:36:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 730.014158 secs 2024-04-21T10:36:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 730.014158 secs 2024-04-21T10:36:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:36:59 smithi191 ceph-mon[31636]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:36:59 smithi170 ceph-mon[31212]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:36:59 smithi077 ceph-mon[27902]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:01 smithi191 ceph-mon[31636]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 733.252473 secs 2024-04-21T10:37:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:01 smithi170 ceph-mon[31212]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 733.252473 secs 2024-04-21T10:37:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:01 smithi077 ceph-mon[27902]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 733.252473 secs 2024-04-21T10:37:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:03 smithi191 ceph-mon[31636]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 735.014270 secs 2024-04-21T10:37:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:03 smithi170 ceph-mon[31212]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 735.014270 secs 2024-04-21T10:37:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:03 smithi077 ceph-mon[27902]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 735.014270 secs 2024-04-21T10:37:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:04 smithi191 ceph-mon[31636]: osdmap e107: 12 total, 12 up, 12 in 2024-04-21T10:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:04 smithi170 ceph-mon[31212]: osdmap e107: 12 total, 12 up, 12 in 2024-04-21T10:37:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:04 smithi077 ceph-mon[27902]: osdmap e107: 12 total, 12 up, 12 in 2024-04-21T10:37:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:05 smithi191 ceph-mon[31636]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:37:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:05 smithi170 ceph-mon[31212]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:37:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:05 smithi077 ceph-mon[27902]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:37:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 738.252589 secs 2024-04-21T10:37:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 738.252589 secs 2024-04-21T10:37:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 738.252589 secs 2024-04-21T10:37:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:07 smithi191 ceph-mon[31636]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:37:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:07 smithi170 ceph-mon[31212]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:37:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:07 smithi077 ceph-mon[27902]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:37:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 740.014409 secs 2024-04-21T10:37:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 740.014409 secs 2024-04-21T10:37:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 740.014409 secs 2024-04-21T10:37:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:09.455+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50005b90 con 0x7efd78101130 2024-04-21T10:37:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:09.455+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50005b90 con 0x7efd78101130 2024-04-21T10:37:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:09.476+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48005b50 con 0x5637269918d0 2024-04-21T10:37:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:09.476+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48005b50 con 0x5637269918d0 2024-04-21T10:37:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:09 smithi191 ceph-mon[31636]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:37:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:09 smithi170 ceph-mon[31212]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:37:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:09 smithi077 ceph-mon[27902]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:37:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:11 smithi191 ceph-mon[31636]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:37:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:11 smithi191 ceph-mon[31636]: osdmap e108: 12 total, 12 up, 12 in 2024-04-21T10:37:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 743.252730 secs 2024-04-21T10:37:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:11 smithi170 ceph-mon[31212]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:37:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:11 smithi170 ceph-mon[31212]: osdmap e108: 12 total, 12 up, 12 in 2024-04-21T10:37:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 743.252730 secs 2024-04-21T10:37:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:11 smithi077 ceph-mon[27902]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:37:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:11 smithi077 ceph-mon[27902]: osdmap e108: 12 total, 12 up, 12 in 2024-04-21T10:37:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 743.252730 secs 2024-04-21T10:37:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:13 smithi191 ceph-mon[31636]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:37:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 745.014542 secs 2024-04-21T10:37:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:13 smithi170 ceph-mon[31212]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:37:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 745.014542 secs 2024-04-21T10:37:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:13 smithi077 ceph-mon[27902]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:37:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 745.014542 secs 2024-04-21T10:37:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:15 smithi170 ceph-mon[31212]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:37:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:15 smithi077 ceph-mon[27902]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:37:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:15 smithi191 ceph-mon[31636]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:37:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 748.252855 secs 2024-04-21T10:37:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 748.252855 secs 2024-04-21T10:37:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 748.252855 secs 2024-04-21T10:37:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:17 smithi170 ceph-mon[31212]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:37:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:17 smithi077 ceph-mon[27902]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:37:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:17 smithi191 ceph-mon[31636]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:37:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 750.014681 secs 2024-04-21T10:37:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 750.014681 secs 2024-04-21T10:37:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 750.014681 secs 2024-04-21T10:37:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:19 smithi170 ceph-mon[31212]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:37:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:19 smithi077 ceph-mon[27902]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:37:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:19 smithi191 ceph-mon[31636]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:37:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:21 smithi170 ceph-mon[31212]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:37:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 753.252980 secs 2024-04-21T10:37:22.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:21 smithi077 ceph-mon[27902]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:37:22.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 753.252980 secs 2024-04-21T10:37:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:21 smithi191 ceph-mon[31636]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:37:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 753.252980 secs 2024-04-21T10:37:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:23 smithi170 ceph-mon[31212]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:37:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 755.014820 secs 2024-04-21T10:37:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:23 smithi077 ceph-mon[27902]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:37:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 755.014820 secs 2024-04-21T10:37:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:23 smithi191 ceph-mon[31636]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:37:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 755.014820 secs 2024-04-21T10:37:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:25 smithi170 ceph-mon[31212]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:25 smithi077 ceph-mon[27902]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:25 smithi191 ceph-mon[31636]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 758.253097 secs 2024-04-21T10:37:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 758.253097 secs 2024-04-21T10:37:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 758.253097 secs 2024-04-21T10:37:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:27 smithi170 ceph-mon[31212]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:27 smithi077 ceph-mon[27902]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:27 smithi191 ceph-mon[31636]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 760.014932 secs 2024-04-21T10:37:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 760.014932 secs 2024-04-21T10:37:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 760.014932 secs 2024-04-21T10:37:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:29 smithi170 ceph-mon[31212]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:29 smithi077 ceph-mon[27902]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:29 smithi191 ceph-mon[31636]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:31 smithi170 ceph-mon[31212]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 763.253210 secs 2024-04-21T10:37:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:31 smithi077 ceph-mon[27902]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 763.253210 secs 2024-04-21T10:37:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:31 smithi191 ceph-mon[31636]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 763.253210 secs 2024-04-21T10:37:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:33 smithi170 ceph-mon[31212]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 765.014999 secs 2024-04-21T10:37:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:33 smithi077 ceph-mon[27902]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 765.014999 secs 2024-04-21T10:37:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:33 smithi191 ceph-mon[31636]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 765.014999 secs 2024-04-21T10:37:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:35 smithi170 ceph-mon[31212]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:35 smithi077 ceph-mon[27902]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:35 smithi191 ceph-mon[31636]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 768.253319 secs 2024-04-21T10:37:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 768.253319 secs 2024-04-21T10:37:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 768.253319 secs 2024-04-21T10:37:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:37 smithi170 ceph-mon[31212]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:37 smithi077 ceph-mon[27902]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:37 smithi191 ceph-mon[31636]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 770.015155 secs 2024-04-21T10:37:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 770.015155 secs 2024-04-21T10:37:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 770.015155 secs 2024-04-21T10:37:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:39 smithi170 ceph-mon[31212]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:39 smithi077 ceph-mon[27902]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:39 smithi191 ceph-mon[31636]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:41 smithi170 ceph-mon[31212]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 773.253453 secs 2024-04-21T10:37:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:41 smithi077 ceph-mon[27902]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 773.253453 secs 2024-04-21T10:37:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:41 smithi191 ceph-mon[31636]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 773.253453 secs 2024-04-21T10:37:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:43 smithi170 ceph-mon[31212]: pgmap v512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:43 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 775.015292 secs 2024-04-21T10:37:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:43 smithi170 ceph-mon[31212]: slow request 363.279493 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:37:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:43 smithi077 ceph-mon[27902]: pgmap v512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:43 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 775.015292 secs 2024-04-21T10:37:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:43 smithi077 ceph-mon[27902]: slow request 363.279493 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:37:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:43 smithi191 ceph-mon[31636]: pgmap v512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:43 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 775.015292 secs 2024-04-21T10:37:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:43 smithi191 ceph-mon[31636]: slow request 363.279493 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:37:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:45 smithi170 ceph-mon[31212]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:37:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:45 smithi077 ceph-mon[27902]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:37:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:45 smithi191 ceph-mon[31636]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:37:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 778.253569 secs 2024-04-21T10:37:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:37:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:37:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:37:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 778.253569 secs 2024-04-21T10:37:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:37:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:37:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:37:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 778.253569 secs 2024-04-21T10:37:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:37:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:37:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:37:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:47 smithi170 ceph-mon[31212]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:47 smithi077 ceph-mon[27902]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:47 smithi191 ceph-mon[31636]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 780.015429 secs 2024-04-21T10:37:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 780.015429 secs 2024-04-21T10:37:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 780.015429 secs 2024-04-21T10:37:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:49 smithi170 ceph-mon[31212]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:49 smithi077 ceph-mon[27902]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:49 smithi191 ceph-mon[31636]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:51 smithi170 ceph-mon[31212]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 783.253693 secs 2024-04-21T10:37:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:51 smithi077 ceph-mon[27902]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 783.253693 secs 2024-04-21T10:37:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:51 smithi191 ceph-mon[31636]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 783.253693 secs 2024-04-21T10:37:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:53 smithi077 ceph-mon[27902]: pgmap v517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 785.015548 secs 2024-04-21T10:37:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:53 smithi191 ceph-mon[31636]: pgmap v517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 785.015548 secs 2024-04-21T10:37:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:53 smithi170 ceph-mon[31212]: pgmap v517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 785.015548 secs 2024-04-21T10:37:54.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:54.461+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50005ec0 con 0x7efd78101130 2024-04-21T10:37:54.461 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:54.461+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50005ec0 con 0x7efd78101130 2024-04-21T10:37:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:54.481+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48005e50 con 0x5637269918d0 2024-04-21T10:37:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:37:54.481+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48005e50 con 0x5637269918d0 2024-04-21T10:37:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:37:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:55 smithi077 ceph-mon[27902]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:55 smithi191 ceph-mon[31636]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:55 smithi170 ceph-mon[31212]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:37:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 788.253839 secs 2024-04-21T10:37:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 788.253839 secs 2024-04-21T10:37:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 788.253839 secs 2024-04-21T10:37:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:57 smithi077 ceph-mon[27902]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:57 smithi191 ceph-mon[31636]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:57 smithi170 ceph-mon[31212]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:37:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 790.015684 secs 2024-04-21T10:37:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 790.015684 secs 2024-04-21T10:37:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 790.015684 secs 2024-04-21T10:38:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:37:59 smithi077 ceph-mon[27902]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:37:59 smithi191 ceph-mon[31636]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:37:59 smithi170 ceph-mon[31212]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:01 smithi077 ceph-mon[27902]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 793.253972 secs 2024-04-21T10:38:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:01 smithi191 ceph-mon[31636]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 793.253972 secs 2024-04-21T10:38:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:01 smithi170 ceph-mon[31212]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 793.253972 secs 2024-04-21T10:38:04.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:03 smithi170 ceph-mon[31212]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:04.109 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 795.015799 secs 2024-04-21T10:38:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:03 smithi077 ceph-mon[27902]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 795.015799 secs 2024-04-21T10:38:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:03 smithi191 ceph-mon[31636]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 795.015799 secs 2024-04-21T10:38:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:04 smithi077 ceph-mon[27902]: osdmap e109: 12 total, 12 up, 12 in 2024-04-21T10:38:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:04 smithi191 ceph-mon[31636]: osdmap e109: 12 total, 12 up, 12 in 2024-04-21T10:38:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:04 smithi170 ceph-mon[31212]: osdmap e109: 12 total, 12 up, 12 in 2024-04-21T10:38:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:05 smithi077 ceph-mon[27902]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:38:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:05 smithi191 ceph-mon[31636]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:38:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:05 smithi170 ceph-mon[31212]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:38:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 798.254090 secs 2024-04-21T10:38:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 798.254090 secs 2024-04-21T10:38:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 798.254090 secs 2024-04-21T10:38:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:07 smithi077 ceph-mon[27902]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:38:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:07 smithi191 ceph-mon[31636]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:38:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:07 smithi170 ceph-mon[31212]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:38:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 800.015936 secs 2024-04-21T10:38:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 800.015936 secs 2024-04-21T10:38:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 800.015936 secs 2024-04-21T10:38:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:09 smithi077 ceph-mon[27902]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:38:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:09 smithi191 ceph-mon[31636]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:38:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:09 smithi170 ceph-mon[31212]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:38:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:11 smithi077 ceph-mon[27902]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:38:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:11 smithi077 ceph-mon[27902]: osdmap e110: 12 total, 12 up, 12 in 2024-04-21T10:38:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 803.254172 secs 2024-04-21T10:38:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:11 smithi191 ceph-mon[31636]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:38:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:11 smithi191 ceph-mon[31636]: osdmap e110: 12 total, 12 up, 12 in 2024-04-21T10:38:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 803.254172 secs 2024-04-21T10:38:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:11 smithi170 ceph-mon[31212]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:38:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:11 smithi170 ceph-mon[31212]: osdmap e110: 12 total, 12 up, 12 in 2024-04-21T10:38:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 803.254172 secs 2024-04-21T10:38:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:13 smithi077 ceph-mon[27902]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T10:38:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 805.016049 secs 2024-04-21T10:38:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:13 smithi191 ceph-mon[31636]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T10:38:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 805.016049 secs 2024-04-21T10:38:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:13 smithi170 ceph-mon[31212]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T10:38:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 805.016049 secs 2024-04-21T10:38:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:15 smithi077 ceph-mon[27902]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:38:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:15 smithi191 ceph-mon[31636]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:38:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:15 smithi170 ceph-mon[31212]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:38:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 808.254292 secs 2024-04-21T10:38:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 808.254292 secs 2024-04-21T10:38:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 808.254292 secs 2024-04-21T10:38:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:17 smithi077 ceph-mon[27902]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:38:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:17 smithi191 ceph-mon[31636]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:38:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:17 smithi170 ceph-mon[31212]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:38:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 810.016158 secs 2024-04-21T10:38:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 810.016158 secs 2024-04-21T10:38:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 810.016158 secs 2024-04-21T10:38:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:19 smithi077 ceph-mon[27902]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:38:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:19 smithi191 ceph-mon[31636]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:38:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:19 smithi170 ceph-mon[31212]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:38:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:21 smithi191 ceph-mon[31636]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:38:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 813.254434 secs 2024-04-21T10:38:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:21 smithi170 ceph-mon[31212]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:38:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 813.254434 secs 2024-04-21T10:38:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:21 smithi077 ceph-mon[27902]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:38:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 813.254434 secs 2024-04-21T10:38:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:23 smithi191 ceph-mon[31636]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:38:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 815.016299 secs 2024-04-21T10:38:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:23 smithi170 ceph-mon[31212]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:38:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 815.016299 secs 2024-04-21T10:38:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:23 smithi077 ceph-mon[27902]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:38:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 815.016299 secs 2024-04-21T10:38:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:25 smithi191 ceph-mon[31636]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:25 smithi170 ceph-mon[31212]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:25 smithi077 ceph-mon[27902]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 818.254582 secs 2024-04-21T10:38:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 818.254582 secs 2024-04-21T10:38:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 818.254582 secs 2024-04-21T10:38:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:27 smithi191 ceph-mon[31636]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:27 smithi170 ceph-mon[31212]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:27 smithi077 ceph-mon[27902]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 820.016442 secs 2024-04-21T10:38:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 820.016442 secs 2024-04-21T10:38:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 820.016442 secs 2024-04-21T10:38:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:29 smithi191 ceph-mon[31636]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:29 smithi170 ceph-mon[31212]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:29 smithi077 ceph-mon[27902]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:31 smithi191 ceph-mon[31636]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 823.254713 secs 2024-04-21T10:38:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:31 smithi170 ceph-mon[31212]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 823.254713 secs 2024-04-21T10:38:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:31 smithi077 ceph-mon[27902]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 823.254713 secs 2024-04-21T10:38:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:33 smithi191 ceph-mon[31636]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 825.016582 secs 2024-04-21T10:38:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:33 smithi170 ceph-mon[31212]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 825.016582 secs 2024-04-21T10:38:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:33 smithi077 ceph-mon[27902]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 825.016582 secs 2024-04-21T10:38:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:35 smithi191 ceph-mon[31636]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:35 smithi170 ceph-mon[31212]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:35 smithi077 ceph-mon[27902]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 828.254831 secs 2024-04-21T10:38:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 828.254831 secs 2024-04-21T10:38:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 828.254831 secs 2024-04-21T10:38:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:37 smithi191 ceph-mon[31636]: pgmap v541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:37 smithi170 ceph-mon[31212]: pgmap v541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:37 smithi077 ceph-mon[27902]: pgmap v541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 830.016728 secs 2024-04-21T10:38:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 830.016728 secs 2024-04-21T10:38:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 830.016728 secs 2024-04-21T10:38:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:39 smithi191 ceph-mon[31636]: pgmap v542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:39 smithi170 ceph-mon[31212]: pgmap v542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:39 smithi077 ceph-mon[27902]: pgmap v542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:41 smithi191 ceph-mon[31636]: pgmap v543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 833.254979 secs 2024-04-21T10:38:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:41 smithi170 ceph-mon[31212]: pgmap v543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 833.254979 secs 2024-04-21T10:38:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:41 smithi077 ceph-mon[27902]: pgmap v543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 833.254979 secs 2024-04-21T10:38:44.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:43 smithi077 ceph-mon[27902]: pgmap v544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:44.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 835.016883 secs 2024-04-21T10:38:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:43 smithi191 ceph-mon[31636]: pgmap v544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 835.016883 secs 2024-04-21T10:38:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:43 smithi170 ceph-mon[31212]: pgmap v544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 835.016883 secs 2024-04-21T10:38:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:45 smithi191 ceph-mon[31636]: pgmap v545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:45 smithi170 ceph-mon[31212]: pgmap v545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:45 smithi077 ceph-mon[27902]: pgmap v545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 838.255092 secs 2024-04-21T10:38:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:38:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 838.255092 secs 2024-04-21T10:38:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:38:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 838.255092 secs 2024-04-21T10:38:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:38:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:47 smithi191 ceph-mon[31636]: pgmap v546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:38:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:38:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:38:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:47 smithi170 ceph-mon[31212]: pgmap v546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:38:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:38:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:38:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:47 smithi077 ceph-mon[27902]: pgmap v546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:38:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:38:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:38:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 840.017018 secs 2024-04-21T10:38:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 840.017018 secs 2024-04-21T10:38:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 840.017018 secs 2024-04-21T10:38:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:49 smithi191 ceph-mon[31636]: pgmap v547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:49 smithi170 ceph-mon[31212]: pgmap v547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:49 smithi077 ceph-mon[27902]: pgmap v547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:51 smithi191 ceph-mon[31636]: pgmap v548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 843.255216 secs 2024-04-21T10:38:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:51 smithi170 ceph-mon[31212]: pgmap v548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 843.255216 secs 2024-04-21T10:38:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:51 smithi077 ceph-mon[27902]: pgmap v548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 843.255216 secs 2024-04-21T10:38:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:53 smithi191 ceph-mon[31636]: pgmap v549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 845.017166 secs 2024-04-21T10:38:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:53 smithi170 ceph-mon[31212]: pgmap v549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 845.017166 secs 2024-04-21T10:38:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:53 smithi077 ceph-mon[27902]: pgmap v549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 845.017166 secs 2024-04-21T10:38:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:38:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:55 smithi170 ceph-mon[31212]: pgmap v550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:55 smithi077 ceph-mon[27902]: pgmap v550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:55 smithi191 ceph-mon[31636]: pgmap v550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:38:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 848.255341 secs 2024-04-21T10:38:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 848.255341 secs 2024-04-21T10:38:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 848.255341 secs 2024-04-21T10:38:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:57 smithi170 ceph-mon[31212]: pgmap v551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:57 smithi077 ceph-mon[27902]: pgmap v551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:57 smithi191 ceph-mon[31636]: pgmap v551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:38:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 850.017301 secs 2024-04-21T10:38:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 850.017301 secs 2024-04-21T10:38:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 850.017301 secs 2024-04-21T10:39:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:38:59 smithi170 ceph-mon[31212]: pgmap v552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:38:59 smithi077 ceph-mon[27902]: pgmap v552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:38:59 smithi191 ceph-mon[31636]: pgmap v552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:01 smithi170 ceph-mon[31212]: pgmap v553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 853.255461 secs 2024-04-21T10:39:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:01 smithi077 ceph-mon[27902]: pgmap v553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 853.255461 secs 2024-04-21T10:39:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:01 smithi191 ceph-mon[31636]: pgmap v553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 853.255461 secs 2024-04-21T10:39:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:03 smithi170 ceph-mon[31212]: pgmap v554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 855.017414 secs 2024-04-21T10:39:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:03 smithi077 ceph-mon[27902]: pgmap v554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 855.017414 secs 2024-04-21T10:39:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:03 smithi191 ceph-mon[31636]: pgmap v554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 855.017414 secs 2024-04-21T10:39:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:05 smithi170 ceph-mon[31212]: osdmap e111: 12 total, 12 up, 12 in 2024-04-21T10:39:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:05 smithi077 ceph-mon[27902]: osdmap e111: 12 total, 12 up, 12 in 2024-04-21T10:39:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:05 smithi191 ceph-mon[31636]: osdmap e111: 12 total, 12 up, 12 in 2024-04-21T10:39:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:06 smithi170 ceph-mon[31212]: pgmap v556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:39:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:06 smithi077 ceph-mon[27902]: pgmap v556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:39:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:06 smithi191 ceph-mon[31636]: pgmap v556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:39:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 858.255581 secs 2024-04-21T10:39:07.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 858.255581 secs 2024-04-21T10:39:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 858.255581 secs 2024-04-21T10:39:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:08 smithi170 ceph-mon[31212]: pgmap v557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:39:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:08 smithi077 ceph-mon[27902]: pgmap v557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:39:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:08 smithi191 ceph-mon[31636]: pgmap v557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:39:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 860.017525 secs 2024-04-21T10:39:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 860.017525 secs 2024-04-21T10:39:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 860.017525 secs 2024-04-21T10:39:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:10 smithi170 ceph-mon[31212]: pgmap v558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:39:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:10 smithi077 ceph-mon[27902]: pgmap v558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:39:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:10 smithi191 ceph-mon[31636]: pgmap v558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:39:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:12 smithi170 ceph-mon[31212]: pgmap v559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:39:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:12 smithi170 ceph-mon[31212]: osdmap e112: 12 total, 12 up, 12 in 2024-04-21T10:39:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 863.255699 secs 2024-04-21T10:39:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:12 smithi077 ceph-mon[27902]: pgmap v559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:39:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:12 smithi077 ceph-mon[27902]: osdmap e112: 12 total, 12 up, 12 in 2024-04-21T10:39:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 863.255699 secs 2024-04-21T10:39:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:12 smithi191 ceph-mon[31636]: pgmap v559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:39:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:12 smithi191 ceph-mon[31636]: osdmap e112: 12 total, 12 up, 12 in 2024-04-21T10:39:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 863.255699 secs 2024-04-21T10:39:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:14 smithi170 ceph-mon[31212]: pgmap v561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:39:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 865.017638 secs 2024-04-21T10:39:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:14 smithi077 ceph-mon[27902]: pgmap v561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:39:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 865.017638 secs 2024-04-21T10:39:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:14 smithi191 ceph-mon[31636]: pgmap v561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:39:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 865.017638 secs 2024-04-21T10:39:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:16 smithi170 ceph-mon[31212]: pgmap v562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:39:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:16 smithi077 ceph-mon[27902]: pgmap v562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:39:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:16 smithi191 ceph-mon[31636]: pgmap v562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:39:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 868.255838 secs 2024-04-21T10:39:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:17 smithi170 ceph-mon[31212]: pgmap v563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:39:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 868.255838 secs 2024-04-21T10:39:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:17 smithi077 ceph-mon[27902]: pgmap v563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:39:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 868.255838 secs 2024-04-21T10:39:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:17 smithi191 ceph-mon[31636]: pgmap v563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:39:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 870.017753 secs 2024-04-21T10:39:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 870.017753 secs 2024-04-21T10:39:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 870.017753 secs 2024-04-21T10:39:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:19 smithi077 ceph-mon[27902]: pgmap v564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:39:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:19 smithi191 ceph-mon[31636]: pgmap v564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:39:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:19 smithi170 ceph-mon[31212]: pgmap v564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:39:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:21 smithi191 ceph-mon[31636]: pgmap v565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:39:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:21 smithi170 ceph-mon[31212]: pgmap v565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:39:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:21 smithi077 ceph-mon[27902]: pgmap v565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T10:39:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 873.255976 secs 2024-04-21T10:39:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 873.255976 secs 2024-04-21T10:39:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 873.255976 secs 2024-04-21T10:39:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:23 smithi191 ceph-mon[31636]: pgmap v566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T10:39:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 875.017899 secs 2024-04-21T10:39:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:23 smithi170 ceph-mon[31212]: pgmap v566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T10:39:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 875.017899 secs 2024-04-21T10:39:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:23 smithi077 ceph-mon[27902]: pgmap v566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T10:39:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 875.017899 secs 2024-04-21T10:39:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:25 smithi191 ceph-mon[31636]: pgmap v567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:39:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:25 smithi170 ceph-mon[31212]: pgmap v567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:39:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:25 smithi077 ceph-mon[27902]: pgmap v567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:39:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 878.256067 secs 2024-04-21T10:39:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:27 smithi170 ceph-mon[31212]: pgmap v568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 878.256067 secs 2024-04-21T10:39:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:27 smithi077 ceph-mon[27902]: pgmap v568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 878.256067 secs 2024-04-21T10:39:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:27 smithi191 ceph-mon[31636]: pgmap v568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 880.017964 secs 2024-04-21T10:39:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 880.017964 secs 2024-04-21T10:39:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 880.017964 secs 2024-04-21T10:39:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:29 smithi170 ceph-mon[31212]: pgmap v569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:29 smithi077 ceph-mon[27902]: pgmap v569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:29 smithi191 ceph-mon[31636]: pgmap v569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:31 smithi170 ceph-mon[31212]: pgmap v570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:31 smithi077 ceph-mon[27902]: pgmap v570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:31 smithi191 ceph-mon[31636]: pgmap v570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 883.256186 secs 2024-04-21T10:39:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 883.256186 secs 2024-04-21T10:39:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 883.256186 secs 2024-04-21T10:39:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:33 smithi170 ceph-mon[31212]: pgmap v571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 885.018079 secs 2024-04-21T10:39:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:33 smithi077 ceph-mon[27902]: pgmap v571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 885.018079 secs 2024-04-21T10:39:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:33 smithi191 ceph-mon[31636]: pgmap v571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 885.018079 secs 2024-04-21T10:39:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:35 smithi170 ceph-mon[31212]: pgmap v572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:35 smithi077 ceph-mon[27902]: pgmap v572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:35.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:35 smithi191 ceph-mon[31636]: pgmap v572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:37.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 888.256304 secs 2024-04-21T10:39:37.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:37 smithi191 ceph-mon[31636]: pgmap v573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 888.256304 secs 2024-04-21T10:39:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:37 smithi170 ceph-mon[31212]: pgmap v573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 888.256304 secs 2024-04-21T10:39:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:37 smithi077 ceph-mon[27902]: pgmap v573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 890.018172 secs 2024-04-21T10:39:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 890.018172 secs 2024-04-21T10:39:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 890.018172 secs 2024-04-21T10:39:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:39 smithi170 ceph-mon[31212]: pgmap v574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:39 smithi077 ceph-mon[27902]: pgmap v574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:39 smithi191 ceph-mon[31636]: pgmap v574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:41 smithi170 ceph-mon[31212]: pgmap v575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:41 smithi077 ceph-mon[27902]: pgmap v575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:41 smithi191 ceph-mon[31636]: pgmap v575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 893.256425 secs 2024-04-21T10:39:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 893.256425 secs 2024-04-21T10:39:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 893.256425 secs 2024-04-21T10:39:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:43 smithi170 ceph-mon[31212]: pgmap v576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 895.018288 secs 2024-04-21T10:39:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:43 smithi077 ceph-mon[27902]: pgmap v576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 895.018288 secs 2024-04-21T10:39:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:43 smithi191 ceph-mon[31636]: pgmap v576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 895.018288 secs 2024-04-21T10:39:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:45 smithi170 ceph-mon[31212]: pgmap v577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:45 smithi077 ceph-mon[27902]: pgmap v577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:45 smithi191 ceph-mon[31636]: pgmap v577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 898.256523 secs 2024-04-21T10:39:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:47 smithi170 ceph-mon[31212]: pgmap v578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:39:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 898.256523 secs 2024-04-21T10:39:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:47 smithi077 ceph-mon[27902]: pgmap v578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:39:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 898.256523 secs 2024-04-21T10:39:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:47 smithi191 ceph-mon[31636]: pgmap v578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:39:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:39:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:39:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:39:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 900.018427 secs 2024-04-21T10:39:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:39:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:39:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:39:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 900.018427 secs 2024-04-21T10:39:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:39:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:39:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:39:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 900.018427 secs 2024-04-21T10:39:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:49 smithi170 ceph-mon[31212]: pgmap v579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:49 smithi077 ceph-mon[27902]: pgmap v579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:49 smithi191 ceph-mon[31636]: pgmap v579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:51 smithi170 ceph-mon[31212]: pgmap v580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 903.256646 secs 2024-04-21T10:39:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:51 smithi077 ceph-mon[27902]: pgmap v580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 903.256646 secs 2024-04-21T10:39:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:51 smithi191 ceph-mon[31636]: pgmap v580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 903.256646 secs 2024-04-21T10:39:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:53 smithi170 ceph-mon[31212]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 905.018567 secs 2024-04-21T10:39:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:53 smithi077 ceph-mon[27902]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 905.018567 secs 2024-04-21T10:39:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:53 smithi191 ceph-mon[31636]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 905.018567 secs 2024-04-21T10:39:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:39:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:55 smithi170 ceph-mon[31212]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:55 smithi077 ceph-mon[27902]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:55 smithi191 ceph-mon[31636]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:39:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 908.256795 secs 2024-04-21T10:39:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 908.256795 secs 2024-04-21T10:39:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 908.256795 secs 2024-04-21T10:39:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:57 smithi170 ceph-mon[31212]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:57 smithi077 ceph-mon[27902]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:57 smithi191 ceph-mon[31636]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:39:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 910.018702 secs 2024-04-21T10:39:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 910.018702 secs 2024-04-21T10:39:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 910.018702 secs 2024-04-21T10:40:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:39:59 smithi170 ceph-mon[31212]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:39:59 smithi077 ceph-mon[27902]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:39:59 smithi191 ceph-mon[31636]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:01 smithi170 ceph-mon[31212]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2024-04-21T10:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:01 smithi170 ceph-mon[31212]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-21T10:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:01 smithi170 ceph-mon[31212]: mds.b(mds.1): 1 slow requests are blocked > 180 secs 2024-04-21T10:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:01 smithi170 ceph-mon[31212]: mds.i(mds.0): 20 slow requests are blocked > 180 secs 2024-04-21T10:40:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:01 smithi077 ceph-mon[27902]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2024-04-21T10:40:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:01 smithi077 ceph-mon[27902]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-21T10:40:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:01 smithi077 ceph-mon[27902]: mds.b(mds.1): 1 slow requests are blocked > 180 secs 2024-04-21T10:40:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:01 smithi077 ceph-mon[27902]: mds.i(mds.0): 20 slow requests are blocked > 180 secs 2024-04-21T10:40:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:01 smithi191 ceph-mon[31636]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2024-04-21T10:40:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:01 smithi191 ceph-mon[31636]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-21T10:40:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:01 smithi191 ceph-mon[31636]: mds.b(mds.1): 1 slow requests are blocked > 180 secs 2024-04-21T10:40:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:01 smithi191 ceph-mon[31636]: mds.i(mds.0): 20 slow requests are blocked > 180 secs 2024-04-21T10:40:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:02 smithi170 ceph-mon[31212]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 913.256913 secs 2024-04-21T10:40:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:02 smithi077 ceph-mon[27902]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 913.256913 secs 2024-04-21T10:40:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:02 smithi191 ceph-mon[31636]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 913.256913 secs 2024-04-21T10:40:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:04 smithi170 ceph-mon[31212]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 915.018816 secs 2024-04-21T10:40:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:04 smithi077 ceph-mon[27902]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 915.018816 secs 2024-04-21T10:40:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:04 smithi191 ceph-mon[31636]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 915.018816 secs 2024-04-21T10:40:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:05 smithi170 ceph-mon[31212]: osdmap e113: 12 total, 12 up, 12 in 2024-04-21T10:40:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:05 smithi077 ceph-mon[27902]: osdmap e113: 12 total, 12 up, 12 in 2024-04-21T10:40:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:05 smithi191 ceph-mon[31636]: osdmap e113: 12 total, 12 up, 12 in 2024-04-21T10:40:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:06 smithi170 ceph-mon[31212]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:40:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:06 smithi077 ceph-mon[27902]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:40:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:06 smithi191 ceph-mon[31636]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:40:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 918.257036 secs 2024-04-21T10:40:07.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 918.257036 secs 2024-04-21T10:40:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 918.257036 secs 2024-04-21T10:40:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:08 smithi170 ceph-mon[31212]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:40:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:08 smithi077 ceph-mon[27902]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:40:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:08 smithi191 ceph-mon[31636]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:40:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 920.018952 secs 2024-04-21T10:40:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 920.018952 secs 2024-04-21T10:40:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 920.018952 secs 2024-04-21T10:40:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:10 smithi170 ceph-mon[31212]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:40:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:10 smithi077 ceph-mon[27902]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:40:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:10 smithi191 ceph-mon[31636]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:40:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:12 smithi170 ceph-mon[31212]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:40:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:12 smithi170 ceph-mon[31212]: osdmap e114: 12 total, 12 up, 12 in 2024-04-21T10:40:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 923.257140 secs 2024-04-21T10:40:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:12 smithi077 ceph-mon[27902]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:40:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:12 smithi077 ceph-mon[27902]: osdmap e114: 12 total, 12 up, 12 in 2024-04-21T10:40:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 923.257140 secs 2024-04-21T10:40:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:12 smithi191 ceph-mon[31636]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:40:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:12 smithi191 ceph-mon[31636]: osdmap e114: 12 total, 12 up, 12 in 2024-04-21T10:40:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 923.257140 secs 2024-04-21T10:40:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:14 smithi170 ceph-mon[31212]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:40:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 925.019097 secs 2024-04-21T10:40:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:14 smithi077 ceph-mon[27902]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:40:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 925.019097 secs 2024-04-21T10:40:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:14 smithi191 ceph-mon[31636]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T10:40:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 925.019097 secs 2024-04-21T10:40:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:16 smithi077 ceph-mon[27902]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:40:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:16 smithi191 ceph-mon[31636]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:40:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:16 smithi170 ceph-mon[31212]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:40:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 928.257238 secs 2024-04-21T10:40:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 928.257238 secs 2024-04-21T10:40:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 928.257238 secs 2024-04-21T10:40:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:18 smithi077 ceph-mon[27902]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:40:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:18 smithi191 ceph-mon[31636]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:40:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:18 smithi170 ceph-mon[31212]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:40:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 930.019192 secs 2024-04-21T10:40:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 930.019192 secs 2024-04-21T10:40:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 930.019192 secs 2024-04-21T10:40:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:20 smithi077 ceph-mon[27902]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:40:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:20 smithi191 ceph-mon[31636]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:40:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:20 smithi170 ceph-mon[31212]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:40:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:22 smithi077 ceph-mon[27902]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:40:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 933.257338 secs 2024-04-21T10:40:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:22 smithi191 ceph-mon[31636]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:40:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 933.257338 secs 2024-04-21T10:40:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:22 smithi170 ceph-mon[31212]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:40:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 933.257338 secs 2024-04-21T10:40:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:24 smithi077 ceph-mon[27902]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:40:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 935.019309 secs 2024-04-21T10:40:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:24 smithi191 ceph-mon[31636]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:40:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 935.019309 secs 2024-04-21T10:40:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:24 smithi170 ceph-mon[31212]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:40:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 935.019309 secs 2024-04-21T10:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:26 smithi077 ceph-mon[27902]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:26 smithi191 ceph-mon[31636]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:26 smithi170 ceph-mon[31212]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 938.257462 secs 2024-04-21T10:40:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 938.257462 secs 2024-04-21T10:40:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 938.257462 secs 2024-04-21T10:40:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:28 smithi077 ceph-mon[27902]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:28 smithi191 ceph-mon[31636]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:28 smithi170 ceph-mon[31212]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 940.019449 secs 2024-04-21T10:40:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 940.019449 secs 2024-04-21T10:40:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 940.019449 secs 2024-04-21T10:40:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:30 smithi077 ceph-mon[27902]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:30 smithi191 ceph-mon[31636]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:30 smithi170 ceph-mon[31212]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:32 smithi077 ceph-mon[27902]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 943.257619 secs 2024-04-21T10:40:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:32 smithi191 ceph-mon[31636]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 943.257619 secs 2024-04-21T10:40:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:32 smithi170 ceph-mon[31212]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 943.257619 secs 2024-04-21T10:40:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:34 smithi077 ceph-mon[27902]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 945.019591 secs 2024-04-21T10:40:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:34 smithi191 ceph-mon[31636]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 945.019591 secs 2024-04-21T10:40:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:34 smithi170 ceph-mon[31212]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 945.019591 secs 2024-04-21T10:40:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:36 smithi077 ceph-mon[27902]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:36 smithi191 ceph-mon[31636]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:36 smithi170 ceph-mon[31212]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 948.257785 secs 2024-04-21T10:40:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 948.257785 secs 2024-04-21T10:40:37.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 948.257785 secs 2024-04-21T10:40:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:38 smithi077 ceph-mon[27902]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:38 smithi191 ceph-mon[31636]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:38 smithi170 ceph-mon[31212]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 950.019702 secs 2024-04-21T10:40:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 950.019702 secs 2024-04-21T10:40:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 950.019702 secs 2024-04-21T10:40:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:40 smithi077 ceph-mon[27902]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:40 smithi191 ceph-mon[31636]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:40 smithi170 ceph-mon[31212]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:42 smithi191 ceph-mon[31636]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 953.257899 secs 2024-04-21T10:40:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:42 smithi170 ceph-mon[31212]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 953.257899 secs 2024-04-21T10:40:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:42 smithi077 ceph-mon[27902]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 953.257899 secs 2024-04-21T10:40:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:44 smithi191 ceph-mon[31636]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 955.019777 secs 2024-04-21T10:40:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:44 smithi170 ceph-mon[31212]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 955.019777 secs 2024-04-21T10:40:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:44 smithi077 ceph-mon[27902]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 955.019777 secs 2024-04-21T10:40:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:46.437 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:46 smithi077 ceph-mon[27902]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:46 smithi191 ceph-mon[31636]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:46 smithi170 ceph-mon[31212]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 958.258017 secs 2024-04-21T10:40:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 958.258017 secs 2024-04-21T10:40:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 958.258017 secs 2024-04-21T10:40:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:48 smithi191 ceph-mon[31636]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:40:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:48 smithi170 ceph-mon[31212]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:40:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:48 smithi077 ceph-mon[27902]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 960.019895 secs 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: slow request 721.473704 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: slow request 721.462547 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: slow request 721.414364 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: slow request 721.383314 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: slow request 721.339753 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:40:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:40:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 960.019895 secs 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: slow request 721.473704 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: slow request 721.462547 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: slow request 721.414364 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: slow request 721.383314 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: slow request 721.339753 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:40:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:40:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 960.019895 secs 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: slow request 721.473704 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: slow request 721.462547 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: slow request 721.414364 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: slow request 721.383314 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: slow request 721.339753 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:40:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:40:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:40:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:51 smithi170 ceph-mon[31212]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:51 smithi077 ceph-mon[27902]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:51 smithi191 ceph-mon[31636]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 963.258103 secs 2024-04-21T10:40:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 963.258103 secs 2024-04-21T10:40:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 963.258103 secs 2024-04-21T10:40:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 965.020033 secs 2024-04-21T10:40:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: slow request 726.212580 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: slow request 726.202835 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: slow request 726.183842 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: slow request 726.181826 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:53 smithi170 ceph-mon[31212]: slow request 726.173840 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 965.020033 secs 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: slow request 726.212580 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: slow request 726.202835 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: slow request 726.183842 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: slow request 726.181826 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:53 smithi077 ceph-mon[27902]: slow request 726.173840 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 965.020033 secs 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: slow request 726.212580 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: slow request 726.202835 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: slow request 726.183842 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: slow request 726.181826 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:53 smithi191 ceph-mon[31636]: slow request 726.173840 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:40:54.487+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006140 con 0x7efd78101130 2024-04-21T10:40:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:40:54.488+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006140 con 0x7efd78101130 2024-04-21T10:40:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:40:54.504+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006020 con 0x5637269918d0 2024-04-21T10:40:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:40:54.504+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006020 con 0x5637269918d0 2024-04-21T10:40:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:40:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:55 smithi170 ceph-mon[31212]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:55 smithi077 ceph-mon[27902]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:55 smithi191 ceph-mon[31636]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 968.258222 secs 2024-04-21T10:40:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:57 smithi170 ceph-mon[31212]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 968.258222 secs 2024-04-21T10:40:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:57 smithi077 ceph-mon[27902]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 968.258222 secs 2024-04-21T10:40:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:57 smithi191 ceph-mon[31636]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:40:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:58 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 970.020186 secs 2024-04-21T10:40:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:58 smithi170 ceph-mon[31212]: slow request 731.167141 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:58 smithi170 ceph-mon[31212]: slow request 731.158134 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:58 smithi170 ceph-mon[31212]: slow request 731.153025 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:58 smithi170 ceph-mon[31212]: slow request 731.137516 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:58 smithi170 ceph-mon[31212]: slow request 731.128829 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:58 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 970.020186 secs 2024-04-21T10:40:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:58 smithi077 ceph-mon[27902]: slow request 731.167141 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:58 smithi077 ceph-mon[27902]: slow request 731.158134 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:58 smithi077 ceph-mon[27902]: slow request 731.153025 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:58 smithi077 ceph-mon[27902]: slow request 731.137516 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:58 smithi077 ceph-mon[27902]: slow request 731.128829 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:58 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 970.020186 secs 2024-04-21T10:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:58 smithi191 ceph-mon[31636]: slow request 731.167141 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:58 smithi191 ceph-mon[31636]: slow request 731.158134 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:58 smithi191 ceph-mon[31636]: slow request 731.153025 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:58 smithi191 ceph-mon[31636]: slow request 731.137516 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:58 smithi191 ceph-mon[31636]: slow request 731.128829 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:40:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:40:59 smithi170 ceph-mon[31212]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:40:59 smithi077 ceph-mon[27902]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:40:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:40:59 smithi191 ceph-mon[31636]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:01 smithi170 ceph-mon[31212]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T10:41:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:01 smithi077 ceph-mon[27902]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T10:41:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:01 smithi191 ceph-mon[31636]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T10:41:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 973.258343 secs 2024-04-21T10:41:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 973.258343 secs 2024-04-21T10:41:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 973.258343 secs 2024-04-21T10:41:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:03 smithi170 ceph-mon[31212]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T10:41:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:03 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 975.020308 secs 2024-04-21T10:41:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:03 smithi170 ceph-mon[31212]: slow request 721.312190 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:03 smithi170 ceph-mon[31212]: slow request 731.230386 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:03 smithi170 ceph-mon[31212]: slow request 731.215515 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:03 smithi077 ceph-mon[27902]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T10:41:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:03 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 975.020308 secs 2024-04-21T10:41:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:03 smithi077 ceph-mon[27902]: slow request 721.312190 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:03 smithi077 ceph-mon[27902]: slow request 731.230386 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:03 smithi077 ceph-mon[27902]: slow request 731.215515 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:03 smithi191 ceph-mon[31636]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T10:41:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:03 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 975.020308 secs 2024-04-21T10:41:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:03 smithi191 ceph-mon[31636]: slow request 721.312190 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:03 smithi191 ceph-mon[31636]: slow request 731.230386 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:03 smithi191 ceph-mon[31636]: slow request 731.215515 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:41:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:04 smithi170 ceph-mon[31212]: osdmap e115: 12 total, 12 up, 12 in 2024-04-21T10:41:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:04 smithi077 ceph-mon[27902]: osdmap e115: 12 total, 12 up, 12 in 2024-04-21T10:41:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:04 smithi191 ceph-mon[31636]: osdmap e115: 12 total, 12 up, 12 in 2024-04-21T10:41:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:05 smithi170 ceph-mon[31212]: pgmap v620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:41:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:05 smithi077 ceph-mon[27902]: pgmap v620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:41:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:05 smithi191 ceph-mon[31636]: pgmap v620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:41:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 978.258461 secs 2024-04-21T10:41:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:07 smithi170 ceph-mon[31212]: pgmap v621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:41:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 978.258461 secs 2024-04-21T10:41:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:07 smithi077 ceph-mon[27902]: pgmap v621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:41:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 978.258461 secs 2024-04-21T10:41:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:07 smithi191 ceph-mon[31636]: pgmap v621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:41:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 980.020377 secs 2024-04-21T10:41:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 980.020377 secs 2024-04-21T10:41:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 980.020377 secs 2024-04-21T10:41:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:09 smithi170 ceph-mon[31212]: pgmap v622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:41:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:09 smithi077 ceph-mon[27902]: pgmap v622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:41:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:09 smithi191 ceph-mon[31636]: pgmap v622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:41:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:11 smithi170 ceph-mon[31212]: pgmap v623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T10:41:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:11 smithi170 ceph-mon[31212]: osdmap e116: 12 total, 12 up, 12 in 2024-04-21T10:41:11.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:11 smithi077 ceph-mon[27902]: pgmap v623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T10:41:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:11 smithi077 ceph-mon[27902]: osdmap e116: 12 total, 12 up, 12 in 2024-04-21T10:41:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:11 smithi191 ceph-mon[31636]: pgmap v623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T10:41:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:11 smithi191 ceph-mon[31636]: osdmap e116: 12 total, 12 up, 12 in 2024-04-21T10:41:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 983.258579 secs 2024-04-21T10:41:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 983.258579 secs 2024-04-21T10:41:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 983.258579 secs 2024-04-21T10:41:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:13 smithi170 ceph-mon[31212]: pgmap v625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T10:41:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 985.020453 secs 2024-04-21T10:41:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:13 smithi077 ceph-mon[27902]: pgmap v625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T10:41:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 985.020453 secs 2024-04-21T10:41:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:13 smithi191 ceph-mon[31636]: pgmap v625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T10:41:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 985.020453 secs 2024-04-21T10:41:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:15 smithi170 ceph-mon[31212]: pgmap v626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T10:41:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:15 smithi077 ceph-mon[27902]: pgmap v626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T10:41:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:15 smithi191 ceph-mon[31636]: pgmap v626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T10:41:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 988.258689 secs 2024-04-21T10:41:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:17 smithi077 ceph-mon[27902]: pgmap v627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:41:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 988.258689 secs 2024-04-21T10:41:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:17 smithi191 ceph-mon[31636]: pgmap v627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:41:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 988.258689 secs 2024-04-21T10:41:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:17 smithi170 ceph-mon[31212]: pgmap v627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:41:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 990.020584 secs 2024-04-21T10:41:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 990.020584 secs 2024-04-21T10:41:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 990.020584 secs 2024-04-21T10:41:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:19 smithi077 ceph-mon[27902]: pgmap v628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:41:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:19 smithi191 ceph-mon[31636]: pgmap v628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:41:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:19 smithi170 ceph-mon[31212]: pgmap v628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:41:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:21 smithi077 ceph-mon[27902]: pgmap v629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:41:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 993.258784 secs 2024-04-21T10:41:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:21 smithi191 ceph-mon[31636]: pgmap v629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:41:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 993.258784 secs 2024-04-21T10:41:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:21 smithi170 ceph-mon[31212]: pgmap v629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:41:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 993.258784 secs 2024-04-21T10:41:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:23 smithi077 ceph-mon[27902]: pgmap v630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:41:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 995.020721 secs 2024-04-21T10:41:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:23 smithi191 ceph-mon[31636]: pgmap v630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:41:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 995.020721 secs 2024-04-21T10:41:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:23 smithi170 ceph-mon[31212]: pgmap v630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:41:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 995.020721 secs 2024-04-21T10:41:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:25 smithi077 ceph-mon[27902]: pgmap v631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:25 smithi191 ceph-mon[31636]: pgmap v631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:25 smithi170 ceph-mon[31212]: pgmap v631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 998.258903 secs 2024-04-21T10:41:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 998.258903 secs 2024-04-21T10:41:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 998.258903 secs 2024-04-21T10:41:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:27 smithi077 ceph-mon[27902]: pgmap v632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:27 smithi191 ceph-mon[31636]: pgmap v632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:27 smithi170 ceph-mon[31212]: pgmap v632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1000.020850 secs 2024-04-21T10:41:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1000.020850 secs 2024-04-21T10:41:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1000.020850 secs 2024-04-21T10:41:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:29 smithi077 ceph-mon[27902]: pgmap v633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:29 smithi191 ceph-mon[31636]: pgmap v633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:29 smithi170 ceph-mon[31212]: pgmap v633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:31 smithi077 ceph-mon[27902]: pgmap v634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1003.259014 secs 2024-04-21T10:41:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:31 smithi191 ceph-mon[31636]: pgmap v634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1003.259014 secs 2024-04-21T10:41:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:31 smithi170 ceph-mon[31212]: pgmap v634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1003.259014 secs 2024-04-21T10:41:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:33 smithi077 ceph-mon[27902]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1005.020989 secs 2024-04-21T10:41:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:33 smithi191 ceph-mon[31636]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1005.020989 secs 2024-04-21T10:41:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:33 smithi170 ceph-mon[31212]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1005.020989 secs 2024-04-21T10:41:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:35 smithi077 ceph-mon[27902]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:35 smithi191 ceph-mon[31636]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:35 smithi170 ceph-mon[31212]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1008.259131 secs 2024-04-21T10:41:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1008.259131 secs 2024-04-21T10:41:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1008.259131 secs 2024-04-21T10:41:37.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:37 smithi191 ceph-mon[31636]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:37 smithi077 ceph-mon[27902]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:37.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:37 smithi170 ceph-mon[31212]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1010.021119 secs 2024-04-21T10:41:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1010.021119 secs 2024-04-21T10:41:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1010.021119 secs 2024-04-21T10:41:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:39 smithi077 ceph-mon[27902]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:39 smithi191 ceph-mon[31636]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:39 smithi170 ceph-mon[31212]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:41 smithi077 ceph-mon[27902]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1013.259245 secs 2024-04-21T10:41:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:41 smithi191 ceph-mon[31636]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1013.259245 secs 2024-04-21T10:41:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:41 smithi170 ceph-mon[31212]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1013.259245 secs 2024-04-21T10:41:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:43 smithi077 ceph-mon[27902]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1015.021204 secs 2024-04-21T10:41:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:43 smithi191 ceph-mon[31636]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1015.021204 secs 2024-04-21T10:41:44.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:43 smithi170 ceph-mon[31212]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:44.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1015.021204 secs 2024-04-21T10:41:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:45 smithi077 ceph-mon[27902]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:45 smithi191 ceph-mon[31636]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:45 smithi170 ceph-mon[31212]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1018.259357 secs 2024-04-21T10:41:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1018.259357 secs 2024-04-21T10:41:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1018.259357 secs 2024-04-21T10:41:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:47 smithi077 ceph-mon[27902]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:47 smithi191 ceph-mon[31636]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:47 smithi170 ceph-mon[31212]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1020.021338 secs 2024-04-21T10:41:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1020.021338 secs 2024-04-21T10:41:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1020.021338 secs 2024-04-21T10:41:49.923 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:49 smithi077 ceph-mon[27902]: pgmap v643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:49.923 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:41:49.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:49 smithi191 ceph-mon[31636]: pgmap v643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:49.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:41:49.946 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:49 smithi170 ceph-mon[31212]: pgmap v643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:41:49.946 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:41:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: pgmap v644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:41:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:41:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1023.259485 secs 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: pgmap v644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1023.259485 secs 2024-04-21T10:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: pgmap v644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:41:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:41:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:41:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:41:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1023.259485 secs 2024-04-21T10:41:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:41:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:41:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:41:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:41:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:41:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:41:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:53 smithi077 ceph-mon[27902]: pgmap v645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1025.021472 secs 2024-04-21T10:41:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:53 smithi191 ceph-mon[31636]: pgmap v645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1025.021472 secs 2024-04-21T10:41:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:53 smithi170 ceph-mon[31212]: pgmap v645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1025.021472 secs 2024-04-21T10:41:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:41:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:55 smithi077 ceph-mon[27902]: pgmap v646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:55 smithi191 ceph-mon[31636]: pgmap v646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:55 smithi170 ceph-mon[31212]: pgmap v646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1028.259597 secs 2024-04-21T10:41:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1028.259597 secs 2024-04-21T10:41:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1028.259597 secs 2024-04-21T10:41:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:57 smithi077 ceph-mon[27902]: pgmap v647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:57 smithi191 ceph-mon[31636]: pgmap v647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:57 smithi170 ceph-mon[31212]: pgmap v647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:41:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1030.021605 secs 2024-04-21T10:41:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1030.021605 secs 2024-04-21T10:41:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1030.021605 secs 2024-04-21T10:41:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:41:59 smithi077 ceph-mon[27902]: pgmap v648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:41:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:41:59 smithi191 ceph-mon[31636]: pgmap v648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:42:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:41:59 smithi170 ceph-mon[31212]: pgmap v648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:42:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:01 smithi077 ceph-mon[27902]: pgmap v649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T10:42:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1033.259713 secs 2024-04-21T10:42:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:01 smithi191 ceph-mon[31636]: pgmap v649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T10:42:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1033.259713 secs 2024-04-21T10:42:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:01 smithi170 ceph-mon[31212]: pgmap v649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T10:42:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1033.259713 secs 2024-04-21T10:42:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:03 smithi077 ceph-mon[27902]: pgmap v650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T10:42:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1035.021720 secs 2024-04-21T10:42:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:03 smithi191 ceph-mon[31636]: pgmap v650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T10:42:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1035.021720 secs 2024-04-21T10:42:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:03 smithi170 ceph-mon[31212]: pgmap v650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T10:42:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1035.021720 secs 2024-04-21T10:42:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:04 smithi077 ceph-mon[27902]: osdmap e117: 12 total, 12 up, 12 in 2024-04-21T10:42:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:04 smithi191 ceph-mon[31636]: osdmap e117: 12 total, 12 up, 12 in 2024-04-21T10:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:04 smithi170 ceph-mon[31212]: osdmap e117: 12 total, 12 up, 12 in 2024-04-21T10:42:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:05 smithi077 ceph-mon[27902]: pgmap v652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-04-21T10:42:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:05 smithi191 ceph-mon[31636]: pgmap v652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-04-21T10:42:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:05 smithi170 ceph-mon[31212]: pgmap v652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-04-21T10:42:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1038.259783 secs 2024-04-21T10:42:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1038.259783 secs 2024-04-21T10:42:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1038.259783 secs 2024-04-21T10:42:07.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:07 smithi170 ceph-mon[31212]: pgmap v653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:42:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:07 smithi191 ceph-mon[31636]: pgmap v653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:42:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:07 smithi077 ceph-mon[27902]: pgmap v653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:42:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1040.021829 secs 2024-04-21T10:42:08.974 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1040.021829 secs 2024-04-21T10:42:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1040.021829 secs 2024-04-21T10:42:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:09 smithi191 ceph-mon[31636]: pgmap v654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:42:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:09 smithi170 ceph-mon[31212]: pgmap v654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:42:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:09 smithi077 ceph-mon[27902]: pgmap v654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:42:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:11 smithi191 ceph-mon[31636]: pgmap v655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T10:42:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:11 smithi191 ceph-mon[31636]: osdmap e118: 12 total, 12 up, 12 in 2024-04-21T10:42:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1043.259897 secs 2024-04-21T10:42:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:11 smithi170 ceph-mon[31212]: pgmap v655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T10:42:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:11 smithi170 ceph-mon[31212]: osdmap e118: 12 total, 12 up, 12 in 2024-04-21T10:42:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1043.259897 secs 2024-04-21T10:42:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:11 smithi077 ceph-mon[27902]: pgmap v655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T10:42:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:11 smithi077 ceph-mon[27902]: osdmap e118: 12 total, 12 up, 12 in 2024-04-21T10:42:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1043.259897 secs 2024-04-21T10:42:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:13 smithi191 ceph-mon[31636]: pgmap v657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-21T10:42:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1045.021876 secs 2024-04-21T10:42:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:13 smithi170 ceph-mon[31212]: pgmap v657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-21T10:42:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1045.021876 secs 2024-04-21T10:42:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:13 smithi077 ceph-mon[27902]: pgmap v657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-21T10:42:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1045.021876 secs 2024-04-21T10:42:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:15 smithi191 ceph-mon[31636]: pgmap v658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T10:42:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:15 smithi170 ceph-mon[31212]: pgmap v658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T10:42:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:15 smithi077 ceph-mon[27902]: pgmap v658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T10:42:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1048.260039 secs 2024-04-21T10:42:17.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1048.260039 secs 2024-04-21T10:42:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1048.260039 secs 2024-04-21T10:42:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:17 smithi191 ceph-mon[31636]: pgmap v659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:42:18.052 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:17 smithi077 ceph-mon[27902]: pgmap v659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:42:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:17 smithi170 ceph-mon[31212]: pgmap v659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:42:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1050.021955 secs 2024-04-21T10:42:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1050.021955 secs 2024-04-21T10:42:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1050.021955 secs 2024-04-21T10:42:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:19 smithi191 ceph-mon[31636]: pgmap v660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:42:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:19 smithi170 ceph-mon[31212]: pgmap v660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:42:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:19 smithi077 ceph-mon[27902]: pgmap v660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:42:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:21 smithi191 ceph-mon[31636]: pgmap v661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:42:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1053.260151 secs 2024-04-21T10:42:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:21 smithi170 ceph-mon[31212]: pgmap v661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:42:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1053.260151 secs 2024-04-21T10:42:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:21 smithi077 ceph-mon[27902]: pgmap v661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:42:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1053.260151 secs 2024-04-21T10:42:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:23 smithi191 ceph-mon[31636]: pgmap v662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:42:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1055.022034 secs 2024-04-21T10:42:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:23 smithi170 ceph-mon[31212]: pgmap v662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:42:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1055.022034 secs 2024-04-21T10:42:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:23 smithi077 ceph-mon[27902]: pgmap v662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:42:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1055.022034 secs 2024-04-21T10:42:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:25 smithi191 ceph-mon[31636]: pgmap v663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:25 smithi170 ceph-mon[31212]: pgmap v663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:25 smithi077 ceph-mon[27902]: pgmap v663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1058.260271 secs 2024-04-21T10:42:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1058.260271 secs 2024-04-21T10:42:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1058.260271 secs 2024-04-21T10:42:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:27 smithi191 ceph-mon[31636]: pgmap v664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:27 smithi170 ceph-mon[31212]: pgmap v664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:27 smithi077 ceph-mon[27902]: pgmap v664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1060.022110 secs 2024-04-21T10:42:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1060.022110 secs 2024-04-21T10:42:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1060.022110 secs 2024-04-21T10:42:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:29 smithi191 ceph-mon[31636]: pgmap v665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:29 smithi170 ceph-mon[31212]: pgmap v665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:29 smithi077 ceph-mon[27902]: pgmap v665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:31 smithi191 ceph-mon[31636]: pgmap v666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1063.260405 secs 2024-04-21T10:42:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:31 smithi170 ceph-mon[31212]: pgmap v666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1063.260405 secs 2024-04-21T10:42:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:31 smithi077 ceph-mon[27902]: pgmap v666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1063.260405 secs 2024-04-21T10:42:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:33 smithi191 ceph-mon[31636]: pgmap v667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1065.022210 secs 2024-04-21T10:42:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:33 smithi170 ceph-mon[31212]: pgmap v667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1065.022210 secs 2024-04-21T10:42:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:33 smithi077 ceph-mon[27902]: pgmap v667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1065.022210 secs 2024-04-21T10:42:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:35 smithi191 ceph-mon[31636]: pgmap v668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:35 smithi170 ceph-mon[31212]: pgmap v668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:35 smithi077 ceph-mon[27902]: pgmap v668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1068.260522 secs 2024-04-21T10:42:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1068.260522 secs 2024-04-21T10:42:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1068.260522 secs 2024-04-21T10:42:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:37 smithi191 ceph-mon[31636]: pgmap v669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:37 smithi170 ceph-mon[31212]: pgmap v669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:37 smithi077 ceph-mon[27902]: pgmap v669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1070.022339 secs 2024-04-21T10:42:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1070.022339 secs 2024-04-21T10:42:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1070.022339 secs 2024-04-21T10:42:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:39 smithi170 ceph-mon[31212]: pgmap v670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:39 smithi077 ceph-mon[27902]: pgmap v670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:39 smithi191 ceph-mon[31636]: pgmap v670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:41 smithi170 ceph-mon[31212]: pgmap v671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1073.260645 secs 2024-04-21T10:42:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:41 smithi077 ceph-mon[27902]: pgmap v671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1073.260645 secs 2024-04-21T10:42:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:41 smithi191 ceph-mon[31636]: pgmap v671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1073.260645 secs 2024-04-21T10:42:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:43 smithi170 ceph-mon[31212]: pgmap v672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1075.022477 secs 2024-04-21T10:42:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:43 smithi077 ceph-mon[27902]: pgmap v672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1075.022477 secs 2024-04-21T10:42:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:43 smithi191 ceph-mon[31636]: pgmap v672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1075.022477 secs 2024-04-21T10:42:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:45 smithi170 ceph-mon[31212]: pgmap v673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:45 smithi077 ceph-mon[27902]: pgmap v673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:45 smithi191 ceph-mon[31636]: pgmap v673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:47.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1078.260770 secs 2024-04-21T10:42:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1078.260770 secs 2024-04-21T10:42:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1078.260770 secs 2024-04-21T10:42:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:47 smithi170 ceph-mon[31212]: pgmap v674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:47 smithi077 ceph-mon[27902]: pgmap v674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:47 smithi191 ceph-mon[31636]: pgmap v674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1080.022618 secs 2024-04-21T10:42:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1080.022618 secs 2024-04-21T10:42:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1080.022618 secs 2024-04-21T10:42:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:49 smithi170 ceph-mon[31212]: pgmap v675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:49 smithi077 ceph-mon[27902]: pgmap v675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:49 smithi191 ceph-mon[31636]: pgmap v675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:51 smithi170 ceph-mon[31212]: pgmap v676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:42:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1083.260823 secs 2024-04-21T10:42:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:51 smithi077 ceph-mon[27902]: pgmap v676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:42:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1083.260823 secs 2024-04-21T10:42:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:51 smithi191 ceph-mon[31636]: pgmap v676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:42:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1083.260823 secs 2024-04-21T10:42:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:42:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:53 smithi077 ceph-mon[27902]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1085.022731 secs 2024-04-21T10:42:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:53 smithi191 ceph-mon[31636]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1085.022731 secs 2024-04-21T10:42:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:53 smithi170 ceph-mon[31212]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1085.022731 secs 2024-04-21T10:42:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:42:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:55 smithi077 ceph-mon[27902]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:55 smithi191 ceph-mon[31636]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:55 smithi170 ceph-mon[31212]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:42:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1088.260890 secs 2024-04-21T10:42:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1088.260890 secs 2024-04-21T10:42:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1088.260890 secs 2024-04-21T10:42:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:57 smithi191 ceph-mon[31636]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:57 smithi170 ceph-mon[31212]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:57 smithi077 ceph-mon[27902]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:42:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1090.022807 secs 2024-04-21T10:42:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1090.022807 secs 2024-04-21T10:42:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1090.022807 secs 2024-04-21T10:43:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:42:59 smithi191 ceph-mon[31636]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:42:59 smithi170 ceph-mon[31212]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:42:59 smithi077 ceph-mon[27902]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:01 smithi191 ceph-mon[31636]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T10:43:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1093.260998 secs 2024-04-21T10:43:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:01 smithi170 ceph-mon[31212]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T10:43:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1093.260998 secs 2024-04-21T10:43:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:01 smithi077 ceph-mon[27902]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T10:43:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1093.260998 secs 2024-04-21T10:43:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:03 smithi191 ceph-mon[31636]: pgmap v682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T10:43:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1095.022897 secs 2024-04-21T10:43:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:03 smithi170 ceph-mon[31212]: pgmap v682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T10:43:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1095.022897 secs 2024-04-21T10:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:03 smithi077 ceph-mon[27902]: pgmap v682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T10:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1095.022897 secs 2024-04-21T10:43:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:04 smithi191 ceph-mon[31636]: osdmap e119: 12 total, 12 up, 12 in 2024-04-21T10:43:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:04 smithi170 ceph-mon[31212]: osdmap e119: 12 total, 12 up, 12 in 2024-04-21T10:43:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:04 smithi077 ceph-mon[27902]: osdmap e119: 12 total, 12 up, 12 in 2024-04-21T10:43:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:05 smithi191 ceph-mon[31636]: pgmap v684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-04-21T10:43:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:05 smithi170 ceph-mon[31212]: pgmap v684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-04-21T10:43:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:05 smithi077 ceph-mon[27902]: pgmap v684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-04-21T10:43:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1098.261138 secs 2024-04-21T10:43:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1098.261138 secs 2024-04-21T10:43:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1098.261138 secs 2024-04-21T10:43:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:07 smithi191 ceph-mon[31636]: pgmap v685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:43:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:07 smithi170 ceph-mon[31212]: pgmap v685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:43:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:07 smithi077 ceph-mon[27902]: pgmap v685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:43:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1100.022990 secs 2024-04-21T10:43:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1100.022990 secs 2024-04-21T10:43:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1100.022990 secs 2024-04-21T10:43:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:09 smithi191 ceph-mon[31636]: pgmap v686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:43:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:09 smithi170 ceph-mon[31212]: pgmap v686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:43:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:09 smithi077 ceph-mon[27902]: pgmap v686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:43:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:11 smithi191 ceph-mon[31636]: pgmap v687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T10:43:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:11 smithi191 ceph-mon[31636]: osdmap e120: 12 total, 12 up, 12 in 2024-04-21T10:43:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1103.261241 secs 2024-04-21T10:43:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:11 smithi170 ceph-mon[31212]: pgmap v687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T10:43:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:11 smithi170 ceph-mon[31212]: osdmap e120: 12 total, 12 up, 12 in 2024-04-21T10:43:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1103.261241 secs 2024-04-21T10:43:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:11 smithi077 ceph-mon[27902]: pgmap v687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T10:43:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:11 smithi077 ceph-mon[27902]: osdmap e120: 12 total, 12 up, 12 in 2024-04-21T10:43:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1103.261241 secs 2024-04-21T10:43:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:13 smithi191 ceph-mon[31636]: pgmap v689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T10:43:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1105.023100 secs 2024-04-21T10:43:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:13 smithi170 ceph-mon[31212]: pgmap v689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T10:43:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1105.023100 secs 2024-04-21T10:43:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:13 smithi077 ceph-mon[27902]: pgmap v689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T10:43:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1105.023100 secs 2024-04-21T10:43:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:15 smithi191 ceph-mon[31636]: pgmap v690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T10:43:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:15 smithi170 ceph-mon[31212]: pgmap v690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T10:43:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:15 smithi077 ceph-mon[27902]: pgmap v690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T10:43:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1108.261357 secs 2024-04-21T10:43:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:17 smithi170 ceph-mon[31212]: pgmap v691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:43:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1108.261357 secs 2024-04-21T10:43:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:17 smithi077 ceph-mon[27902]: pgmap v691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:43:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1108.261357 secs 2024-04-21T10:43:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:17 smithi191 ceph-mon[31636]: pgmap v691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:43:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1110.023207 secs 2024-04-21T10:43:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1110.023207 secs 2024-04-21T10:43:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1110.023207 secs 2024-04-21T10:43:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:19 smithi077 ceph-mon[27902]: pgmap v692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:43:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:19 smithi191 ceph-mon[31636]: pgmap v692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:43:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:19 smithi170 ceph-mon[31212]: pgmap v692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:43:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:21 smithi170 ceph-mon[31212]: pgmap v693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:43:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:21 smithi077 ceph-mon[27902]: pgmap v693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:43:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:21 smithi191 ceph-mon[31636]: pgmap v693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:43:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1113.261460 secs 2024-04-21T10:43:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1113.261460 secs 2024-04-21T10:43:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1113.261460 secs 2024-04-21T10:43:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:23 smithi170 ceph-mon[31212]: pgmap v694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:43:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1115.023316 secs 2024-04-21T10:43:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:23 smithi077 ceph-mon[27902]: pgmap v694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:43:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1115.023316 secs 2024-04-21T10:43:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:23 smithi191 ceph-mon[31636]: pgmap v694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:43:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1115.023316 secs 2024-04-21T10:43:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:25 smithi170 ceph-mon[31212]: pgmap v695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:25 smithi077 ceph-mon[27902]: pgmap v695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:25 smithi191 ceph-mon[31636]: pgmap v695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1118.261579 secs 2024-04-21T10:43:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:27 smithi170 ceph-mon[31212]: pgmap v696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1118.261579 secs 2024-04-21T10:43:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:27 smithi077 ceph-mon[27902]: pgmap v696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1118.261579 secs 2024-04-21T10:43:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:27 smithi191 ceph-mon[31636]: pgmap v696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1120.023424 secs 2024-04-21T10:43:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1120.023424 secs 2024-04-21T10:43:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1120.023424 secs 2024-04-21T10:43:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:29 smithi170 ceph-mon[31212]: pgmap v697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:29 smithi077 ceph-mon[27902]: pgmap v697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:29 smithi191 ceph-mon[31636]: pgmap v697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:31 smithi170 ceph-mon[31212]: pgmap v698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:31 smithi077 ceph-mon[27902]: pgmap v698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:31 smithi191 ceph-mon[31636]: pgmap v698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1123.261689 secs 2024-04-21T10:43:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1123.261689 secs 2024-04-21T10:43:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1123.261689 secs 2024-04-21T10:43:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:33 smithi077 ceph-mon[27902]: pgmap v699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:33.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1125.023536 secs 2024-04-21T10:43:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:33 smithi191 ceph-mon[31636]: pgmap v699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1125.023536 secs 2024-04-21T10:43:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:33 smithi170 ceph-mon[31212]: pgmap v699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1125.023536 secs 2024-04-21T10:43:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:35 smithi077 ceph-mon[27902]: pgmap v700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:35 smithi191 ceph-mon[31636]: pgmap v700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:35 smithi170 ceph-mon[31212]: pgmap v700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:37.858 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1128.261752 secs 2024-04-21T10:43:37.859 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:37 smithi170 ceph-mon[31212]: pgmap v701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1128.261752 secs 2024-04-21T10:43:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:37 smithi077 ceph-mon[27902]: pgmap v701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1128.261752 secs 2024-04-21T10:43:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:37 smithi191 ceph-mon[31636]: pgmap v701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1130.023642 secs 2024-04-21T10:43:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1130.023642 secs 2024-04-21T10:43:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1130.023642 secs 2024-04-21T10:43:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:39 smithi077 ceph-mon[27902]: pgmap v702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:39 smithi191 ceph-mon[31636]: pgmap v702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:39 smithi170 ceph-mon[31212]: pgmap v702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:41 smithi077 ceph-mon[27902]: pgmap v703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:41 smithi191 ceph-mon[31636]: pgmap v703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:41 smithi170 ceph-mon[31212]: pgmap v703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1133.261868 secs 2024-04-21T10:43:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1133.261868 secs 2024-04-21T10:43:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1133.261868 secs 2024-04-21T10:43:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:43 smithi077 ceph-mon[27902]: pgmap v704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:43 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 1135.023751 secs 2024-04-21T10:43:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:43 smithi077 ceph-mon[27902]: slow request 723.287952 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:43:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:43 smithi191 ceph-mon[31636]: pgmap v704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:43 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 1135.023751 secs 2024-04-21T10:43:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:43 smithi191 ceph-mon[31636]: slow request 723.287952 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:43:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:43 smithi170 ceph-mon[31212]: pgmap v704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:43 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 1135.023751 secs 2024-04-21T10:43:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:43 smithi170 ceph-mon[31212]: slow request 723.287952 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:43:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:45 smithi077 ceph-mon[27902]: pgmap v705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:45 smithi191 ceph-mon[31636]: pgmap v705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:45 smithi170 ceph-mon[31212]: pgmap v705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:43:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1138.261985 secs 2024-04-21T10:43:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1138.261985 secs 2024-04-21T10:43:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1138.261985 secs 2024-04-21T10:43:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:47 smithi077 ceph-mon[27902]: pgmap v706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:47 smithi191 ceph-mon[31636]: pgmap v706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:47 smithi170 ceph-mon[31212]: pgmap v706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1140.023877 secs 2024-04-21T10:43:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1140.023877 secs 2024-04-21T10:43:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1140.023877 secs 2024-04-21T10:43:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:49 smithi077 ceph-mon[27902]: pgmap v707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:49 smithi191 ceph-mon[31636]: pgmap v707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:49 smithi170 ceph-mon[31212]: pgmap v707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:51 smithi077 ceph-mon[27902]: pgmap v708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1143.262100 secs 2024-04-21T10:43:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:51 smithi191 ceph-mon[31636]: pgmap v708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1143.262100 secs 2024-04-21T10:43:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:51 smithi170 ceph-mon[31212]: pgmap v708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1143.262100 secs 2024-04-21T10:43:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: pgmap v709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:43:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1145.023938 secs 2024-04-21T10:43:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: pgmap v709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1145.023938 secs 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: pgmap v709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1145.023938 secs 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a6280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd700098b0 tx=0x7efd70009e20 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a6280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd700098b0 tx=0x7efd70009e20 comp rx=0 tx=0).stop 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a6280 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a6280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a6280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:43:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.395+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd70012010 tx=0x7efd70012040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:43:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000311) for more than 900000000 us, fault. 2024-04-21T10:43:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T10:43:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=132 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:43:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=SESSION_RECONNECTING pgs=132 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-04-21T10:43:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=SESSION_RECONNECTING pgs=132 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-04-21T10:43:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd60ff9640 0 client.16488 ms_handle_remote_reset on v2:172.21.15.191:6838/2863843162 2024-04-21T10:43:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T10:43:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.417+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:43:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.510+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006400 con 0x7efd78101130 2024-04-21T10:43:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.510+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006400 con 0x7efd78101130 2024-04-21T10:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.524+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006290 con 0x5637269918d0 2024-04-21T10:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:43:54.524+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006290 con 0x5637269918d0 2024-04-21T10:43:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:43:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:43:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:43:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:43:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:43:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:43:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:43:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:43:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:55 smithi077 ceph-mon[27902]: pgmap v710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:55 smithi191 ceph-mon[31636]: pgmap v710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:55 smithi170 ceph-mon[31212]: pgmap v710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:43:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1148.262218 secs 2024-04-21T10:43:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1148.262218 secs 2024-04-21T10:43:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1148.262218 secs 2024-04-21T10:43:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:57 smithi191 ceph-mon[31636]: pgmap v711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:57 smithi170 ceph-mon[31212]: pgmap v711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:57 smithi077 ceph-mon[27902]: pgmap v711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:43:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1150.024052 secs 2024-04-21T10:43:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1150.024052 secs 2024-04-21T10:43:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1150.024052 secs 2024-04-21T10:44:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:43:59 smithi191 ceph-mon[31636]: pgmap v712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:43:59 smithi170 ceph-mon[31212]: pgmap v712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:43:59 smithi077 ceph-mon[27902]: pgmap v712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:01 smithi191 ceph-mon[31636]: pgmap v713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1153.262340 secs 2024-04-21T10:44:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:01 smithi170 ceph-mon[31212]: pgmap v713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1153.262340 secs 2024-04-21T10:44:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:01 smithi077 ceph-mon[27902]: pgmap v713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1153.262340 secs 2024-04-21T10:44:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:03 smithi191 ceph-mon[31636]: pgmap v714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1155.024115 secs 2024-04-21T10:44:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:03 smithi170 ceph-mon[31212]: pgmap v714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1155.024115 secs 2024-04-21T10:44:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:03 smithi077 ceph-mon[27902]: pgmap v714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1155.024115 secs 2024-04-21T10:44:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:04 smithi191 ceph-mon[31636]: osdmap e121: 12 total, 12 up, 12 in 2024-04-21T10:44:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:04 smithi170 ceph-mon[31212]: osdmap e121: 12 total, 12 up, 12 in 2024-04-21T10:44:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:04 smithi077 ceph-mon[27902]: osdmap e121: 12 total, 12 up, 12 in 2024-04-21T10:44:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:05 smithi191 ceph-mon[31636]: pgmap v716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:44:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:05 smithi170 ceph-mon[31212]: pgmap v716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:44:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:05 smithi077 ceph-mon[27902]: pgmap v716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:44:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1158.262455 secs 2024-04-21T10:44:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1158.262455 secs 2024-04-21T10:44:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1158.262455 secs 2024-04-21T10:44:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:07 smithi191 ceph-mon[31636]: pgmap v717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:07 smithi170 ceph-mon[31212]: pgmap v717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:07 smithi077 ceph-mon[27902]: pgmap v717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1160.024231 secs 2024-04-21T10:44:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1160.024231 secs 2024-04-21T10:44:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1160.024231 secs 2024-04-21T10:44:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:09 smithi191 ceph-mon[31636]: pgmap v718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:09 smithi170 ceph-mon[31212]: pgmap v718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:09 smithi077 ceph-mon[27902]: pgmap v718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:11 smithi191 ceph-mon[31636]: pgmap v719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:11 smithi191 ceph-mon[31636]: osdmap e122: 12 total, 12 up, 12 in 2024-04-21T10:44:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1163.262577 secs 2024-04-21T10:44:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:11 smithi170 ceph-mon[31212]: pgmap v719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:11 smithi170 ceph-mon[31212]: osdmap e122: 12 total, 12 up, 12 in 2024-04-21T10:44:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1163.262577 secs 2024-04-21T10:44:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:11 smithi077 ceph-mon[27902]: pgmap v719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:11 smithi077 ceph-mon[27902]: osdmap e122: 12 total, 12 up, 12 in 2024-04-21T10:44:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1163.262577 secs 2024-04-21T10:44:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:13 smithi191 ceph-mon[31636]: pgmap v721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:44:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1165.024363 secs 2024-04-21T10:44:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:13 smithi170 ceph-mon[31212]: pgmap v721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:44:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1165.024363 secs 2024-04-21T10:44:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:13 smithi077 ceph-mon[27902]: pgmap v721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:44:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1165.024363 secs 2024-04-21T10:44:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:15 smithi191 ceph-mon[31636]: pgmap v722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:15 smithi170 ceph-mon[31212]: pgmap v722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:15 smithi077 ceph-mon[27902]: pgmap v722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:44:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1168.262717 secs 2024-04-21T10:44:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:17 smithi077 ceph-mon[27902]: pgmap v723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:44:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1168.262717 secs 2024-04-21T10:44:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:17 smithi191 ceph-mon[31636]: pgmap v723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:44:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1168.262717 secs 2024-04-21T10:44:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:17 smithi170 ceph-mon[31212]: pgmap v723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:44:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1170.024502 secs 2024-04-21T10:44:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1170.024502 secs 2024-04-21T10:44:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1170.024502 secs 2024-04-21T10:44:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:19 smithi191 ceph-mon[31636]: pgmap v724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:44:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:19 smithi170 ceph-mon[31212]: pgmap v724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:44:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:19 smithi077 ceph-mon[27902]: pgmap v724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:44:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:21 smithi170 ceph-mon[31212]: pgmap v725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:44:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:21 smithi077 ceph-mon[27902]: pgmap v725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:44:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:21 smithi191 ceph-mon[31636]: pgmap v725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:44:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1173.262835 secs 2024-04-21T10:44:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1173.262835 secs 2024-04-21T10:44:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1173.262835 secs 2024-04-21T10:44:23.551 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:23 smithi191 ceph-mon[31636]: pgmap v726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:44:23.551 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1175.024636 secs 2024-04-21T10:44:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:23 smithi170 ceph-mon[31212]: pgmap v726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:44:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1175.024636 secs 2024-04-21T10:44:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:23 smithi077 ceph-mon[27902]: pgmap v726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:44:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1175.024636 secs 2024-04-21T10:44:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:25 smithi170 ceph-mon[31212]: pgmap v727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:25 smithi077 ceph-mon[27902]: pgmap v727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:25 smithi191 ceph-mon[31636]: pgmap v727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1178.262949 secs 2024-04-21T10:44:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:27 smithi170 ceph-mon[31212]: pgmap v728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1178.262949 secs 2024-04-21T10:44:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:27 smithi077 ceph-mon[27902]: pgmap v728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1178.262949 secs 2024-04-21T10:44:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:27 smithi191 ceph-mon[31636]: pgmap v728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1180.024763 secs 2024-04-21T10:44:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1180.024763 secs 2024-04-21T10:44:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1180.024763 secs 2024-04-21T10:44:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:29 smithi077 ceph-mon[27902]: pgmap v729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:29 smithi191 ceph-mon[31636]: pgmap v729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:29 smithi170 ceph-mon[31212]: pgmap v729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:31 smithi077 ceph-mon[27902]: pgmap v730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:31 smithi191 ceph-mon[31636]: pgmap v730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:31 smithi170 ceph-mon[31212]: pgmap v730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1183.263028 secs 2024-04-21T10:44:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1183.263028 secs 2024-04-21T10:44:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1183.263028 secs 2024-04-21T10:44:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:33 smithi077 ceph-mon[27902]: pgmap v731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1185.024905 secs 2024-04-21T10:44:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:33 smithi191 ceph-mon[31636]: pgmap v731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1185.024905 secs 2024-04-21T10:44:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:33 smithi170 ceph-mon[31212]: pgmap v731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1185.024905 secs 2024-04-21T10:44:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:35 smithi077 ceph-mon[27902]: pgmap v732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:35 smithi191 ceph-mon[31636]: pgmap v732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:35 smithi170 ceph-mon[31212]: pgmap v732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:37.858 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1188.263110 secs 2024-04-21T10:44:37.858 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:37 smithi170 ceph-mon[31212]: pgmap v733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1188.263110 secs 2024-04-21T10:44:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:37 smithi077 ceph-mon[27902]: pgmap v733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1188.263110 secs 2024-04-21T10:44:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:37 smithi191 ceph-mon[31636]: pgmap v733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1190.025036 secs 2024-04-21T10:44:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1190.025036 secs 2024-04-21T10:44:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1190.025036 secs 2024-04-21T10:44:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:39 smithi077 ceph-mon[27902]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:39 smithi191 ceph-mon[31636]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:39 smithi170 ceph-mon[31212]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:41 smithi077 ceph-mon[27902]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1193.263228 secs 2024-04-21T10:44:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:41 smithi191 ceph-mon[31636]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1193.263228 secs 2024-04-21T10:44:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:41 smithi170 ceph-mon[31212]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1193.263228 secs 2024-04-21T10:44:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:43 smithi077 ceph-mon[27902]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1195.025167 secs 2024-04-21T10:44:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:43 smithi191 ceph-mon[31636]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1195.025167 secs 2024-04-21T10:44:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:43 smithi170 ceph-mon[31212]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1195.025167 secs 2024-04-21T10:44:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:45 smithi077 ceph-mon[27902]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:45 smithi191 ceph-mon[31636]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:45 smithi170 ceph-mon[31212]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1198.263343 secs 2024-04-21T10:44:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1198.263343 secs 2024-04-21T10:44:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1198.263343 secs 2024-04-21T10:44:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:47 smithi077 ceph-mon[27902]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:47 smithi191 ceph-mon[31636]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:47 smithi170 ceph-mon[31212]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1200.025295 secs 2024-04-21T10:44:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1200.025295 secs 2024-04-21T10:44:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1200.025295 secs 2024-04-21T10:44:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:49 smithi077 ceph-mon[27902]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:49 smithi191 ceph-mon[31636]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:49 smithi170 ceph-mon[31212]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:51 smithi077 ceph-mon[27902]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1203.263476 secs 2024-04-21T10:44:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:51 smithi191 ceph-mon[31636]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1203.263476 secs 2024-04-21T10:44:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:51 smithi170 ceph-mon[31212]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1203.263476 secs 2024-04-21T10:44:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:53 smithi077 ceph-mon[27902]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1205.025431 secs 2024-04-21T10:44:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:53 smithi191 ceph-mon[31636]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1205.025431 secs 2024-04-21T10:44:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:53 smithi170 ceph-mon[31212]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1205.025431 secs 2024-04-21T10:44:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:44:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:44:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:44:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:44:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:55 smithi077 ceph-mon[27902]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:44:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:44:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:44:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:55 smithi191 ceph-mon[31636]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:44:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:44:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:44:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:55 smithi170 ceph-mon[31212]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:44:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:44:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:44:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:44:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1208.263613 secs 2024-04-21T10:44:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1208.263613 secs 2024-04-21T10:44:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1208.263613 secs 2024-04-21T10:44:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:57 smithi191 ceph-mon[31636]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:57 smithi170 ceph-mon[31212]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:57 smithi077 ceph-mon[27902]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:44:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1210.025574 secs 2024-04-21T10:44:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1210.025574 secs 2024-04-21T10:44:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1210.025574 secs 2024-04-21T10:44:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:44:59 smithi191 ceph-mon[31636]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:44:59 smithi170 ceph-mon[31212]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:44:59 smithi077 ceph-mon[27902]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:01 smithi191 ceph-mon[31636]: pgmap v745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1213.263707 secs 2024-04-21T10:45:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:01 smithi170 ceph-mon[31212]: pgmap v745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1213.263707 secs 2024-04-21T10:45:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:01 smithi077 ceph-mon[27902]: pgmap v745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1213.263707 secs 2024-04-21T10:45:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:03 smithi191 ceph-mon[31636]: pgmap v746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1215.025702 secs 2024-04-21T10:45:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:03 smithi170 ceph-mon[31212]: pgmap v746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1215.025702 secs 2024-04-21T10:45:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:03 smithi077 ceph-mon[27902]: pgmap v746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1215.025702 secs 2024-04-21T10:45:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:04 smithi191 ceph-mon[31636]: osdmap e123: 12 total, 12 up, 12 in 2024-04-21T10:45:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:04 smithi170 ceph-mon[31212]: osdmap e123: 12 total, 12 up, 12 in 2024-04-21T10:45:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:04 smithi077 ceph-mon[27902]: osdmap e123: 12 total, 12 up, 12 in 2024-04-21T10:45:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:05 smithi191 ceph-mon[31636]: pgmap v748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:45:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:05 smithi170 ceph-mon[31212]: pgmap v748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:45:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:05 smithi077 ceph-mon[27902]: pgmap v748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:45:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1218.263820 secs 2024-04-21T10:45:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1218.263820 secs 2024-04-21T10:45:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1218.263820 secs 2024-04-21T10:45:07.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:07 smithi170 ceph-mon[31212]: pgmap v749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:45:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:07 smithi191 ceph-mon[31636]: pgmap v749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:45:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:07 smithi077 ceph-mon[27902]: pgmap v749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:45:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1220.025848 secs 2024-04-21T10:45:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1220.025848 secs 2024-04-21T10:45:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1220.025848 secs 2024-04-21T10:45:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:09 smithi191 ceph-mon[31636]: pgmap v750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:45:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:09 smithi170 ceph-mon[31212]: pgmap v750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:45:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:09 smithi077 ceph-mon[27902]: pgmap v750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:45:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:11 smithi191 ceph-mon[31636]: pgmap v751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:45:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:11 smithi191 ceph-mon[31636]: osdmap e124: 12 total, 12 up, 12 in 2024-04-21T10:45:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1223.263958 secs 2024-04-21T10:45:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:11 smithi170 ceph-mon[31212]: pgmap v751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:45:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:11 smithi170 ceph-mon[31212]: osdmap e124: 12 total, 12 up, 12 in 2024-04-21T10:45:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1223.263958 secs 2024-04-21T10:45:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:11 smithi077 ceph-mon[27902]: pgmap v751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:45:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:11 smithi077 ceph-mon[27902]: osdmap e124: 12 total, 12 up, 12 in 2024-04-21T10:45:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1223.263958 secs 2024-04-21T10:45:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:13 smithi191 ceph-mon[31636]: pgmap v753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:45:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1225.025959 secs 2024-04-21T10:45:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:13 smithi170 ceph-mon[31212]: pgmap v753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:45:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1225.025959 secs 2024-04-21T10:45:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:13 smithi077 ceph-mon[27902]: pgmap v753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:45:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1225.025959 secs 2024-04-21T10:45:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:15 smithi191 ceph-mon[31636]: pgmap v754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:45:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:15 smithi170 ceph-mon[31212]: pgmap v754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:45:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:15 smithi077 ceph-mon[27902]: pgmap v754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:45:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1228.264093 secs 2024-04-21T10:45:17.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1228.264093 secs 2024-04-21T10:45:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1228.264093 secs 2024-04-21T10:45:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:17 smithi191 ceph-mon[31636]: pgmap v755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:45:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:17 smithi170 ceph-mon[31212]: pgmap v755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:45:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:17 smithi077 ceph-mon[27902]: pgmap v755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:45:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1230.026057 secs 2024-04-21T10:45:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1230.026057 secs 2024-04-21T10:45:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1230.026057 secs 2024-04-21T10:45:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:19 smithi191 ceph-mon[31636]: pgmap v756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:45:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:19 smithi170 ceph-mon[31212]: pgmap v756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:45:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:19 smithi077 ceph-mon[27902]: pgmap v756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:45:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:21 smithi170 ceph-mon[31212]: pgmap v757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:45:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1233.264215 secs 2024-04-21T10:45:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:21 smithi077 ceph-mon[27902]: pgmap v757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:45:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1233.264215 secs 2024-04-21T10:45:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:21 smithi191 ceph-mon[31636]: pgmap v757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:45:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1233.264215 secs 2024-04-21T10:45:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:23 smithi170 ceph-mon[31212]: pgmap v758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:45:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1235.026132 secs 2024-04-21T10:45:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:23 smithi077 ceph-mon[27902]: pgmap v758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:45:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1235.026132 secs 2024-04-21T10:45:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:23 smithi191 ceph-mon[31636]: pgmap v758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:45:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1235.026132 secs 2024-04-21T10:45:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:45:24.523+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T10:45:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:45:24.523+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T10:45:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:45:24.536+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T10:45:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:45:24.536+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T10:45:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:25 smithi170 ceph-mon[31212]: pgmap v759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:25 smithi077 ceph-mon[27902]: pgmap v759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:25 smithi191 ceph-mon[31636]: pgmap v759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1238.264335 secs 2024-04-21T10:45:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1238.264335 secs 2024-04-21T10:45:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1238.264335 secs 2024-04-21T10:45:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:27 smithi170 ceph-mon[31212]: pgmap v760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:27 smithi077 ceph-mon[27902]: pgmap v760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:27 smithi191 ceph-mon[31636]: pgmap v760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1240.026287 secs 2024-04-21T10:45:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1240.026287 secs 2024-04-21T10:45:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1240.026287 secs 2024-04-21T10:45:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:29 smithi170 ceph-mon[31212]: pgmap v761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:29 smithi077 ceph-mon[27902]: pgmap v761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:29 smithi191 ceph-mon[31636]: pgmap v761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:31 smithi170 ceph-mon[31212]: pgmap v762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1243.264412 secs 2024-04-21T10:45:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:31 smithi077 ceph-mon[27902]: pgmap v762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1243.264412 secs 2024-04-21T10:45:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:31 smithi191 ceph-mon[31636]: pgmap v762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1243.264412 secs 2024-04-21T10:45:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:33 smithi170 ceph-mon[31212]: pgmap v763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1245.026408 secs 2024-04-21T10:45:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:33 smithi077 ceph-mon[27902]: pgmap v763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1245.026408 secs 2024-04-21T10:45:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:33 smithi191 ceph-mon[31636]: pgmap v763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1245.026408 secs 2024-04-21T10:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:35 smithi170 ceph-mon[31212]: pgmap v764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:35 smithi077 ceph-mon[27902]: pgmap v764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:35 smithi191 ceph-mon[31636]: pgmap v764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1248.264526 secs 2024-04-21T10:45:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1248.264526 secs 2024-04-21T10:45:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1248.264526 secs 2024-04-21T10:45:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:37 smithi170 ceph-mon[31212]: pgmap v765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:37 smithi077 ceph-mon[27902]: pgmap v765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:37 smithi191 ceph-mon[31636]: pgmap v765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1250.026551 secs 2024-04-21T10:45:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1250.026551 secs 2024-04-21T10:45:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1250.026551 secs 2024-04-21T10:45:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:39 smithi170 ceph-mon[31212]: pgmap v766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:39 smithi077 ceph-mon[27902]: pgmap v766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:39 smithi191 ceph-mon[31636]: pgmap v766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:41 smithi170 ceph-mon[31212]: pgmap v767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1253.264643 secs 2024-04-21T10:45:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:41 smithi077 ceph-mon[27902]: pgmap v767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1253.264643 secs 2024-04-21T10:45:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:41 smithi191 ceph-mon[31636]: pgmap v767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1253.264643 secs 2024-04-21T10:45:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:43 smithi170 ceph-mon[31212]: pgmap v768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1255.026676 secs 2024-04-21T10:45:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:43 smithi077 ceph-mon[27902]: pgmap v768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1255.026676 secs 2024-04-21T10:45:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:43 smithi191 ceph-mon[31636]: pgmap v768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1255.026676 secs 2024-04-21T10:45:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:45 smithi170 ceph-mon[31212]: pgmap v769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:45 smithi077 ceph-mon[27902]: pgmap v769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:45 smithi191 ceph-mon[31636]: pgmap v769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:47.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1258.264780 secs 2024-04-21T10:45:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1258.264780 secs 2024-04-21T10:45:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1258.264780 secs 2024-04-21T10:45:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:47 smithi170 ceph-mon[31212]: pgmap v770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:47 smithi077 ceph-mon[27902]: pgmap v770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:47 smithi191 ceph-mon[31636]: pgmap v770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1260.026809 secs 2024-04-21T10:45:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1260.026809 secs 2024-04-21T10:45:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1260.026809 secs 2024-04-21T10:45:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:49 smithi170 ceph-mon[31212]: pgmap v771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:49 smithi077 ceph-mon[27902]: pgmap v771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:49 smithi191 ceph-mon[31636]: pgmap v771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:51 smithi170 ceph-mon[31212]: pgmap v772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1263.264896 secs 2024-04-21T10:45:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:51 smithi077 ceph-mon[27902]: pgmap v772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1263.264896 secs 2024-04-21T10:45:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:51 smithi191 ceph-mon[31636]: pgmap v772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1263.264896 secs 2024-04-21T10:45:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:53 smithi170 ceph-mon[31212]: pgmap v773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1265.026941 secs 2024-04-21T10:45:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:53 smithi077 ceph-mon[27902]: pgmap v773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1265.026941 secs 2024-04-21T10:45:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:53 smithi191 ceph-mon[31636]: pgmap v773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1265.026941 secs 2024-04-21T10:45:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:45:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:45:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:45:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:45:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:55 smithi170 ceph-mon[31212]: pgmap v774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:45:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:45:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:45:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:55 smithi077 ceph-mon[27902]: pgmap v774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:45:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:45:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:45:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:55 smithi191 ceph-mon[31636]: pgmap v774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:45:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:45:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:45:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:45:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1268.264958 secs 2024-04-21T10:45:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1268.264958 secs 2024-04-21T10:45:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1268.264958 secs 2024-04-21T10:45:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:57 smithi077 ceph-mon[27902]: pgmap v775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:57 smithi191 ceph-mon[31636]: pgmap v775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:57 smithi170 ceph-mon[31212]: pgmap v775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:45:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1270.027066 secs 2024-04-21T10:45:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1270.027066 secs 2024-04-21T10:45:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1270.027066 secs 2024-04-21T10:46:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:45:59 smithi077 ceph-mon[27902]: pgmap v776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:45:59 smithi191 ceph-mon[31636]: pgmap v776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:45:59 smithi170 ceph-mon[31212]: pgmap v776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:01 smithi077 ceph-mon[27902]: pgmap v777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1273.265042 secs 2024-04-21T10:46:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:01 smithi191 ceph-mon[31636]: pgmap v777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1273.265042 secs 2024-04-21T10:46:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:01 smithi170 ceph-mon[31212]: pgmap v777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1273.265042 secs 2024-04-21T10:46:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:03 smithi077 ceph-mon[27902]: pgmap v778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1275.027140 secs 2024-04-21T10:46:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:03 smithi191 ceph-mon[31636]: pgmap v778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1275.027140 secs 2024-04-21T10:46:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:03 smithi170 ceph-mon[31212]: pgmap v778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1275.027140 secs 2024-04-21T10:46:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:04 smithi077 ceph-mon[27902]: osdmap e125: 12 total, 12 up, 12 in 2024-04-21T10:46:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:04 smithi191 ceph-mon[31636]: osdmap e125: 12 total, 12 up, 12 in 2024-04-21T10:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:04 smithi170 ceph-mon[31212]: osdmap e125: 12 total, 12 up, 12 in 2024-04-21T10:46:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:05 smithi077 ceph-mon[27902]: pgmap v780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:46:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:05 smithi191 ceph-mon[31636]: pgmap v780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:46:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:05 smithi170 ceph-mon[31212]: pgmap v780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:46:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1278.265156 secs 2024-04-21T10:46:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1278.265156 secs 2024-04-21T10:46:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1278.265156 secs 2024-04-21T10:46:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:07 smithi077 ceph-mon[27902]: pgmap v781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:46:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:07 smithi191 ceph-mon[31636]: pgmap v781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:46:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:07 smithi170 ceph-mon[31212]: pgmap v781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:46:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1280.027289 secs 2024-04-21T10:46:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1280.027289 secs 2024-04-21T10:46:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1280.027289 secs 2024-04-21T10:46:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:09 smithi077 ceph-mon[27902]: pgmap v782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:46:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:09 smithi191 ceph-mon[31636]: pgmap v782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:46:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:09 smithi170 ceph-mon[31212]: pgmap v782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:46:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:11 smithi077 ceph-mon[27902]: pgmap v783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:46:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:11 smithi077 ceph-mon[27902]: osdmap e126: 12 total, 12 up, 12 in 2024-04-21T10:46:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1283.265274 secs 2024-04-21T10:46:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:11 smithi191 ceph-mon[31636]: pgmap v783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:46:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:11 smithi191 ceph-mon[31636]: osdmap e126: 12 total, 12 up, 12 in 2024-04-21T10:46:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1283.265274 secs 2024-04-21T10:46:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:11 smithi170 ceph-mon[31212]: pgmap v783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:46:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:11 smithi170 ceph-mon[31212]: osdmap e126: 12 total, 12 up, 12 in 2024-04-21T10:46:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1283.265274 secs 2024-04-21T10:46:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:13 smithi077 ceph-mon[27902]: pgmap v785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T10:46:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1285.027429 secs 2024-04-21T10:46:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:13 smithi191 ceph-mon[31636]: pgmap v785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T10:46:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1285.027429 secs 2024-04-21T10:46:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:13 smithi170 ceph-mon[31212]: pgmap v785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T10:46:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1285.027429 secs 2024-04-21T10:46:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:15 smithi077 ceph-mon[27902]: pgmap v786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:46:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:15 smithi191 ceph-mon[31636]: pgmap v786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:46:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:15 smithi170 ceph-mon[31212]: pgmap v786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:46:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1288.265377 secs 2024-04-21T10:46:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1288.265377 secs 2024-04-21T10:46:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1288.265377 secs 2024-04-21T10:46:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:17 smithi077 ceph-mon[27902]: pgmap v787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:46:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:17 smithi191 ceph-mon[31636]: pgmap v787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:46:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:17 smithi170 ceph-mon[31212]: pgmap v787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:46:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1290.027559 secs 2024-04-21T10:46:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1290.027559 secs 2024-04-21T10:46:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1290.027559 secs 2024-04-21T10:46:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:19 smithi077 ceph-mon[27902]: pgmap v788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:46:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:19 smithi191 ceph-mon[31636]: pgmap v788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:46:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:19 smithi170 ceph-mon[31212]: pgmap v788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:46:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:21 smithi191 ceph-mon[31636]: pgmap v789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:46:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1293.265500 secs 2024-04-21T10:46:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:21 smithi170 ceph-mon[31212]: pgmap v789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:46:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1293.265500 secs 2024-04-21T10:46:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:21 smithi077 ceph-mon[27902]: pgmap v789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:46:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1293.265500 secs 2024-04-21T10:46:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:23 smithi191 ceph-mon[31636]: pgmap v790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:46:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1295.027670 secs 2024-04-21T10:46:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:23 smithi170 ceph-mon[31212]: pgmap v790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:46:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1295.027670 secs 2024-04-21T10:46:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:23 smithi077 ceph-mon[27902]: pgmap v790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:46:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1295.027670 secs 2024-04-21T10:46:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:25 smithi191 ceph-mon[31636]: pgmap v791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:25 smithi170 ceph-mon[31212]: pgmap v791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:25 smithi077 ceph-mon[27902]: pgmap v791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1298.265627 secs 2024-04-21T10:46:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1298.265627 secs 2024-04-21T10:46:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1298.265627 secs 2024-04-21T10:46:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:27 smithi191 ceph-mon[31636]: pgmap v792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:27 smithi170 ceph-mon[31212]: pgmap v792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:27 smithi077 ceph-mon[27902]: pgmap v792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1300.027736 secs 2024-04-21T10:46:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1300.027736 secs 2024-04-21T10:46:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1300.027736 secs 2024-04-21T10:46:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:29 smithi191 ceph-mon[31636]: pgmap v793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:29 smithi170 ceph-mon[31212]: pgmap v793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:29 smithi077 ceph-mon[27902]: pgmap v793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:31 smithi191 ceph-mon[31636]: pgmap v794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1303.265748 secs 2024-04-21T10:46:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:31 smithi170 ceph-mon[31212]: pgmap v794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1303.265748 secs 2024-04-21T10:46:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:31 smithi077 ceph-mon[27902]: pgmap v794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1303.265748 secs 2024-04-21T10:46:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:33 smithi191 ceph-mon[31636]: pgmap v795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1305.027872 secs 2024-04-21T10:46:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:33 smithi170 ceph-mon[31212]: pgmap v795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1305.027872 secs 2024-04-21T10:46:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:33 smithi077 ceph-mon[27902]: pgmap v795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1305.027872 secs 2024-04-21T10:46:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:35 smithi191 ceph-mon[31636]: pgmap v796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:35 smithi170 ceph-mon[31212]: pgmap v796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:35 smithi077 ceph-mon[27902]: pgmap v796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:37.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1308.265853 secs 2024-04-21T10:46:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1308.265853 secs 2024-04-21T10:46:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1308.265853 secs 2024-04-21T10:46:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:37 smithi191 ceph-mon[31636]: pgmap v797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:37 smithi170 ceph-mon[31212]: pgmap v797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:37 smithi077 ceph-mon[27902]: pgmap v797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1310.027985 secs 2024-04-21T10:46:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1310.027985 secs 2024-04-21T10:46:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1310.027985 secs 2024-04-21T10:46:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:39 smithi191 ceph-mon[31636]: pgmap v798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:39 smithi170 ceph-mon[31212]: pgmap v798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:39 smithi077 ceph-mon[27902]: pgmap v798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:41 smithi191 ceph-mon[31636]: pgmap v799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1313.265974 secs 2024-04-21T10:46:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:41 smithi170 ceph-mon[31212]: pgmap v799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1313.265974 secs 2024-04-21T10:46:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:41 smithi077 ceph-mon[27902]: pgmap v799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1313.265974 secs 2024-04-21T10:46:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:43 smithi191 ceph-mon[31636]: pgmap v800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1315.028063 secs 2024-04-21T10:46:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:43 smithi170 ceph-mon[31212]: pgmap v800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1315.028063 secs 2024-04-21T10:46:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:43 smithi077 ceph-mon[27902]: pgmap v800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1315.028063 secs 2024-04-21T10:46:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:45 smithi191 ceph-mon[31636]: pgmap v801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:45 smithi170 ceph-mon[31212]: pgmap v801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:45 smithi077 ceph-mon[27902]: pgmap v801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1318.266093 secs 2024-04-21T10:46:47.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1318.266093 secs 2024-04-21T10:46:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1318.266093 secs 2024-04-21T10:46:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:47 smithi191 ceph-mon[31636]: pgmap v802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:47 smithi170 ceph-mon[31212]: pgmap v802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:47 smithi077 ceph-mon[27902]: pgmap v802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1320.028126 secs 2024-04-21T10:46:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1320.028126 secs 2024-04-21T10:46:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1320.028126 secs 2024-04-21T10:46:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:49 smithi170 ceph-mon[31212]: pgmap v803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:49 smithi077 ceph-mon[27902]: pgmap v803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:49 smithi191 ceph-mon[31636]: pgmap v803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:51 smithi170 ceph-mon[31212]: pgmap v804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1323.266165 secs 2024-04-21T10:46:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:51 smithi077 ceph-mon[27902]: pgmap v804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1323.266165 secs 2024-04-21T10:46:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:51 smithi191 ceph-mon[31636]: pgmap v804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1323.266165 secs 2024-04-21T10:46:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:53 smithi170 ceph-mon[31212]: pgmap v805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1325.028238 secs 2024-04-21T10:46:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:53 smithi077 ceph-mon[27902]: pgmap v805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1325.028238 secs 2024-04-21T10:46:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:53 smithi191 ceph-mon[31636]: pgmap v805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1325.028238 secs 2024-04-21T10:46:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:46:54.535+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:46:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:46:54.536+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:46:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:46:54.546+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:46:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:46:54.546+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:46:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:46:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:55 smithi170 ceph-mon[31212]: pgmap v806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:46:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:55 smithi077 ceph-mon[27902]: pgmap v806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:46:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:55 smithi191 ceph-mon[31636]: pgmap v806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:46:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:46:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:46:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:46:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:46:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1328.266240 secs 2024-04-21T10:46:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:46:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:46:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:46:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1328.266240 secs 2024-04-21T10:46:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:46:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:46:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:46:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1328.266240 secs 2024-04-21T10:46:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:57 smithi170 ceph-mon[31212]: pgmap v807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:57 smithi077 ceph-mon[27902]: pgmap v807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:57 smithi191 ceph-mon[31636]: pgmap v807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:46:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1330.028356 secs 2024-04-21T10:46:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1330.028356 secs 2024-04-21T10:46:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1330.028356 secs 2024-04-21T10:47:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:46:59 smithi170 ceph-mon[31212]: pgmap v808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:46:59 smithi077 ceph-mon[27902]: pgmap v808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:46:59 smithi191 ceph-mon[31636]: pgmap v808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:01 smithi170 ceph-mon[31212]: pgmap v809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1333.266379 secs 2024-04-21T10:47:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:01 smithi077 ceph-mon[27902]: pgmap v809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1333.266379 secs 2024-04-21T10:47:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:01 smithi191 ceph-mon[31636]: pgmap v809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1333.266379 secs 2024-04-21T10:47:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:03 smithi170 ceph-mon[31212]: pgmap v810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1335.028501 secs 2024-04-21T10:47:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:03 smithi077 ceph-mon[27902]: pgmap v810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1335.028501 secs 2024-04-21T10:47:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:03 smithi191 ceph-mon[31636]: pgmap v810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1335.028501 secs 2024-04-21T10:47:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:05 smithi170 ceph-mon[31212]: osdmap e127: 12 total, 12 up, 12 in 2024-04-21T10:47:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:05 smithi077 ceph-mon[27902]: osdmap e127: 12 total, 12 up, 12 in 2024-04-21T10:47:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:05 smithi191 ceph-mon[31636]: osdmap e127: 12 total, 12 up, 12 in 2024-04-21T10:47:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:06 smithi170 ceph-mon[31212]: pgmap v812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:47:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:06 smithi077 ceph-mon[27902]: pgmap v812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:47:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:06 smithi191 ceph-mon[31636]: pgmap v812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:47:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1338.266491 secs 2024-04-21T10:47:07.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1338.266491 secs 2024-04-21T10:47:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1338.266491 secs 2024-04-21T10:47:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:08 smithi170 ceph-mon[31212]: pgmap v813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:47:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:08 smithi077 ceph-mon[27902]: pgmap v813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:47:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:08 smithi191 ceph-mon[31636]: pgmap v813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:47:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1340.028615 secs 2024-04-21T10:47:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1340.028615 secs 2024-04-21T10:47:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1340.028615 secs 2024-04-21T10:47:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:10 smithi170 ceph-mon[31212]: pgmap v814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:47:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:10 smithi077 ceph-mon[27902]: pgmap v814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:47:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:10 smithi191 ceph-mon[31636]: pgmap v814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:47:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:12 smithi170 ceph-mon[31212]: pgmap v815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:47:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:12 smithi170 ceph-mon[31212]: osdmap e128: 12 total, 12 up, 12 in 2024-04-21T10:47:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1343.266602 secs 2024-04-21T10:47:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:12 smithi077 ceph-mon[27902]: pgmap v815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:47:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:12 smithi077 ceph-mon[27902]: osdmap e128: 12 total, 12 up, 12 in 2024-04-21T10:47:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1343.266602 secs 2024-04-21T10:47:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:12 smithi191 ceph-mon[31636]: pgmap v815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:47:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:12 smithi191 ceph-mon[31636]: osdmap e128: 12 total, 12 up, 12 in 2024-04-21T10:47:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1343.266602 secs 2024-04-21T10:47:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:14 smithi170 ceph-mon[31212]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T10:47:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1345.028695 secs 2024-04-21T10:47:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:14 smithi077 ceph-mon[27902]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T10:47:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1345.028695 secs 2024-04-21T10:47:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:14 smithi191 ceph-mon[31636]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T10:47:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1345.028695 secs 2024-04-21T10:47:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:16 smithi170 ceph-mon[31212]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:47:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:16 smithi077 ceph-mon[27902]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:47:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:16 smithi191 ceph-mon[31636]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:47:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1348.266721 secs 2024-04-21T10:47:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:17 smithi077 ceph-mon[27902]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:47:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1348.266721 secs 2024-04-21T10:47:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:17 smithi191 ceph-mon[31636]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:47:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1348.266721 secs 2024-04-21T10:47:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:17 smithi170 ceph-mon[31212]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:47:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1350.028815 secs 2024-04-21T10:47:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1350.028815 secs 2024-04-21T10:47:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1350.028815 secs 2024-04-21T10:47:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:19 smithi191 ceph-mon[31636]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:47:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:19 smithi170 ceph-mon[31212]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:47:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:19 smithi077 ceph-mon[27902]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:47:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:21 smithi077 ceph-mon[27902]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:47:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:21 smithi191 ceph-mon[31636]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:47:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:21 smithi170 ceph-mon[31212]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:47:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1353.266865 secs 2024-04-21T10:47:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1353.266865 secs 2024-04-21T10:47:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1353.266865 secs 2024-04-21T10:47:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:23 smithi077 ceph-mon[27902]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:47:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1355.028912 secs 2024-04-21T10:47:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:23 smithi191 ceph-mon[31636]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:47:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1355.028912 secs 2024-04-21T10:47:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:23 smithi170 ceph-mon[31212]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:47:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1355.028912 secs 2024-04-21T10:47:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:25 smithi077 ceph-mon[27902]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:25 smithi191 ceph-mon[31636]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:25 smithi170 ceph-mon[31212]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1358.266942 secs 2024-04-21T10:47:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:27 smithi077 ceph-mon[27902]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1358.266942 secs 2024-04-21T10:47:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:27 smithi191 ceph-mon[31636]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1358.266942 secs 2024-04-21T10:47:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:27 smithi170 ceph-mon[31212]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1360.028987 secs 2024-04-21T10:47:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1360.028987 secs 2024-04-21T10:47:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1360.028987 secs 2024-04-21T10:47:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:29 smithi077 ceph-mon[27902]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:29 smithi191 ceph-mon[31636]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:29 smithi170 ceph-mon[31212]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:31 smithi077 ceph-mon[27902]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1363.267007 secs 2024-04-21T10:47:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:31 smithi191 ceph-mon[31636]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1363.267007 secs 2024-04-21T10:47:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:31 smithi170 ceph-mon[31212]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1363.267007 secs 2024-04-21T10:47:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:33 smithi077 ceph-mon[27902]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1365.029124 secs 2024-04-21T10:47:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:33 smithi191 ceph-mon[31636]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1365.029124 secs 2024-04-21T10:47:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:33 smithi170 ceph-mon[31212]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1365.029124 secs 2024-04-21T10:47:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:35 smithi077 ceph-mon[27902]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:35 smithi191 ceph-mon[31636]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:35 smithi170 ceph-mon[31212]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1368.267127 secs 2024-04-21T10:47:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1368.267127 secs 2024-04-21T10:47:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1368.267127 secs 2024-04-21T10:47:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:37 smithi077 ceph-mon[27902]: pgmap v829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:37.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:37 smithi170 ceph-mon[31212]: pgmap v829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:37 smithi191 ceph-mon[31636]: pgmap v829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1370.029188 secs 2024-04-21T10:47:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1370.029188 secs 2024-04-21T10:47:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1370.029188 secs 2024-04-21T10:47:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:39 smithi191 ceph-mon[31636]: pgmap v830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:39 smithi170 ceph-mon[31212]: pgmap v830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:39 smithi077 ceph-mon[27902]: pgmap v830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:41 smithi191 ceph-mon[31636]: pgmap v831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1373.267246 secs 2024-04-21T10:47:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:41 smithi170 ceph-mon[31212]: pgmap v831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1373.267246 secs 2024-04-21T10:47:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:41 smithi077 ceph-mon[27902]: pgmap v831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1373.267246 secs 2024-04-21T10:47:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:43 smithi191 ceph-mon[31636]: pgmap v832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1375.029279 secs 2024-04-21T10:47:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:43 smithi170 ceph-mon[31212]: pgmap v832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1375.029279 secs 2024-04-21T10:47:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:43 smithi077 ceph-mon[27902]: pgmap v832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1375.029279 secs 2024-04-21T10:47:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:45 smithi191 ceph-mon[31636]: pgmap v833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:45 smithi170 ceph-mon[31212]: pgmap v833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:45 smithi077 ceph-mon[27902]: pgmap v833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1378.267370 secs 2024-04-21T10:47:47.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1378.267370 secs 2024-04-21T10:47:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1378.267370 secs 2024-04-21T10:47:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:47 smithi191 ceph-mon[31636]: pgmap v834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:47 smithi170 ceph-mon[31212]: pgmap v834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:47 smithi077 ceph-mon[27902]: pgmap v834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1380.029394 secs 2024-04-21T10:47:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1380.029394 secs 2024-04-21T10:47:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1380.029394 secs 2024-04-21T10:47:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:49 smithi191 ceph-mon[31636]: pgmap v835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:49 smithi170 ceph-mon[31212]: pgmap v835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:49 smithi077 ceph-mon[27902]: pgmap v835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:51 smithi191 ceph-mon[31636]: pgmap v836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1383.267466 secs 2024-04-21T10:47:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:51 smithi170 ceph-mon[31212]: pgmap v836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1383.267466 secs 2024-04-21T10:47:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:51 smithi077 ceph-mon[27902]: pgmap v836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1383.267466 secs 2024-04-21T10:47:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:53 smithi191 ceph-mon[31636]: pgmap v837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1385.029499 secs 2024-04-21T10:47:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:53 smithi170 ceph-mon[31212]: pgmap v837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1385.029499 secs 2024-04-21T10:47:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:53 smithi077 ceph-mon[27902]: pgmap v837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1385.029499 secs 2024-04-21T10:47:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:47:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:55 smithi191 ceph-mon[31636]: pgmap v838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:55 smithi170 ceph-mon[31212]: pgmap v838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:55 smithi077 ceph-mon[27902]: pgmap v838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:47:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1388.267579 secs 2024-04-21T10:47:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:47:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1388.267579 secs 2024-04-21T10:47:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:47:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1388.267579 secs 2024-04-21T10:47:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:57 smithi077 ceph-mon[27902]: pgmap v839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:57 smithi191 ceph-mon[31636]: pgmap v839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:57 smithi170 ceph-mon[31212]: pgmap v839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:47:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1390.029622 secs 2024-04-21T10:47:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1390.029622 secs 2024-04-21T10:47:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1390.029622 secs 2024-04-21T10:47:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:47:59 smithi077 ceph-mon[27902]: pgmap v840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:47:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:47:59 smithi191 ceph-mon[31636]: pgmap v840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:47:59 smithi170 ceph-mon[31212]: pgmap v840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: pgmap v841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1393.267699 secs 2024-04-21T10:48:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: pgmap v841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:48:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:48:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1393.267699 secs 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: pgmap v841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:48:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1393.267699 secs 2024-04-21T10:48:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:03 smithi077 ceph-mon[27902]: pgmap v842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1395.029733 secs 2024-04-21T10:48:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:03 smithi191 ceph-mon[31636]: pgmap v842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1395.029733 secs 2024-04-21T10:48:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:03 smithi170 ceph-mon[31212]: pgmap v842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1395.029733 secs 2024-04-21T10:48:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:04 smithi191 ceph-mon[31636]: osdmap e129: 12 total, 12 up, 12 in 2024-04-21T10:48:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:04 smithi170 ceph-mon[31212]: osdmap e129: 12 total, 12 up, 12 in 2024-04-21T10:48:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:04 smithi077 ceph-mon[27902]: osdmap e129: 12 total, 12 up, 12 in 2024-04-21T10:48:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:05 smithi191 ceph-mon[31636]: pgmap v844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:48:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:05 smithi170 ceph-mon[31212]: pgmap v844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:48:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:05 smithi077 ceph-mon[27902]: pgmap v844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:48:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1398.267836 secs 2024-04-21T10:48:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1398.267836 secs 2024-04-21T10:48:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1398.267836 secs 2024-04-21T10:48:07.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:07 smithi170 ceph-mon[31212]: pgmap v845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:48:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:07 smithi191 ceph-mon[31636]: pgmap v845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:48:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:07 smithi077 ceph-mon[27902]: pgmap v845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:48:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1400.029850 secs 2024-04-21T10:48:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1400.029850 secs 2024-04-21T10:48:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1400.029850 secs 2024-04-21T10:48:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:09 smithi191 ceph-mon[31636]: pgmap v846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:48:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:09 smithi170 ceph-mon[31212]: pgmap v846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:48:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:09 smithi077 ceph-mon[27902]: pgmap v846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:48:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:11 smithi191 ceph-mon[31636]: pgmap v847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:48:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:11 smithi191 ceph-mon[31636]: osdmap e130: 12 total, 12 up, 12 in 2024-04-21T10:48:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1403.267951 secs 2024-04-21T10:48:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:11 smithi170 ceph-mon[31212]: pgmap v847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:48:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:11 smithi170 ceph-mon[31212]: osdmap e130: 12 total, 12 up, 12 in 2024-04-21T10:48:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1403.267951 secs 2024-04-21T10:48:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:11 smithi077 ceph-mon[27902]: pgmap v847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:48:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:11 smithi077 ceph-mon[27902]: osdmap e130: 12 total, 12 up, 12 in 2024-04-21T10:48:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1403.267951 secs 2024-04-21T10:48:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:13 smithi191 ceph-mon[31636]: pgmap v849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:48:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1405.029966 secs 2024-04-21T10:48:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:13 smithi170 ceph-mon[31212]: pgmap v849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:48:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1405.029966 secs 2024-04-21T10:48:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:13 smithi077 ceph-mon[27902]: pgmap v849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:48:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1405.029966 secs 2024-04-21T10:48:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:15 smithi191 ceph-mon[31636]: pgmap v850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:48:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:15 smithi170 ceph-mon[31212]: pgmap v850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:48:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:15 smithi077 ceph-mon[27902]: pgmap v850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:48:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1408.268087 secs 2024-04-21T10:48:17.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1408.268087 secs 2024-04-21T10:48:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1408.268087 secs 2024-04-21T10:48:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:17 smithi191 ceph-mon[31636]: pgmap v851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:48:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:17 smithi170 ceph-mon[31212]: pgmap v851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:48:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:17 smithi077 ceph-mon[27902]: pgmap v851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:48:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1410.030083 secs 2024-04-21T10:48:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1410.030083 secs 2024-04-21T10:48:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1410.030083 secs 2024-04-21T10:48:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:19 smithi191 ceph-mon[31636]: pgmap v852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:48:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:19 smithi170 ceph-mon[31212]: pgmap v852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:48:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:19 smithi077 ceph-mon[27902]: pgmap v852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:48:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:21 smithi191 ceph-mon[31636]: pgmap v853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:48:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1413.268197 secs 2024-04-21T10:48:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:21 smithi170 ceph-mon[31212]: pgmap v853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:48:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1413.268197 secs 2024-04-21T10:48:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:21 smithi077 ceph-mon[27902]: pgmap v853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:48:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1413.268197 secs 2024-04-21T10:48:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:23 smithi191 ceph-mon[31636]: pgmap v854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:48:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1415.030156 secs 2024-04-21T10:48:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:23 smithi170 ceph-mon[31212]: pgmap v854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:48:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1415.030156 secs 2024-04-21T10:48:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:23 smithi077 ceph-mon[27902]: pgmap v854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:48:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1415.030156 secs 2024-04-21T10:48:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:25 smithi191 ceph-mon[31636]: pgmap v855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:25 smithi170 ceph-mon[31212]: pgmap v855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:25 smithi077 ceph-mon[27902]: pgmap v855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1418.268341 secs 2024-04-21T10:48:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1418.268341 secs 2024-04-21T10:48:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1418.268341 secs 2024-04-21T10:48:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:27 smithi191 ceph-mon[31636]: pgmap v856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:27 smithi170 ceph-mon[31212]: pgmap v856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:27 smithi077 ceph-mon[27902]: pgmap v856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1420.030280 secs 2024-04-21T10:48:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1420.030280 secs 2024-04-21T10:48:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1420.030280 secs 2024-04-21T10:48:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:29 smithi191 ceph-mon[31636]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:29 smithi170 ceph-mon[31212]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:29 smithi077 ceph-mon[27902]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:31 smithi191 ceph-mon[31636]: pgmap v858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1423.268479 secs 2024-04-21T10:48:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:31 smithi170 ceph-mon[31212]: pgmap v858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1423.268479 secs 2024-04-21T10:48:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:31 smithi077 ceph-mon[27902]: pgmap v858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1423.268479 secs 2024-04-21T10:48:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:33 smithi191 ceph-mon[31636]: pgmap v859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1425.030397 secs 2024-04-21T10:48:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:33 smithi170 ceph-mon[31212]: pgmap v859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1425.030397 secs 2024-04-21T10:48:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:33 smithi077 ceph-mon[27902]: pgmap v859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1425.030397 secs 2024-04-21T10:48:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:35 smithi170 ceph-mon[31212]: pgmap v860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:35 smithi077 ceph-mon[27902]: pgmap v860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:35 smithi191 ceph-mon[31636]: pgmap v860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1428.268597 secs 2024-04-21T10:48:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1428.268597 secs 2024-04-21T10:48:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1428.268597 secs 2024-04-21T10:48:37.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:37 smithi170 ceph-mon[31212]: pgmap v861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:37 smithi077 ceph-mon[27902]: pgmap v861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:37 smithi191 ceph-mon[31636]: pgmap v861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1430.030542 secs 2024-04-21T10:48:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1430.030542 secs 2024-04-21T10:48:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1430.030542 secs 2024-04-21T10:48:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:39 smithi170 ceph-mon[31212]: pgmap v862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:39 smithi077 ceph-mon[27902]: pgmap v862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:39 smithi191 ceph-mon[31636]: pgmap v862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:41 smithi170 ceph-mon[31212]: pgmap v863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1433.268733 secs 2024-04-21T10:48:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:41 smithi077 ceph-mon[27902]: pgmap v863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1433.268733 secs 2024-04-21T10:48:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:41 smithi191 ceph-mon[31636]: pgmap v863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1433.268733 secs 2024-04-21T10:48:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:43 smithi170 ceph-mon[31212]: pgmap v864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1435.030658 secs 2024-04-21T10:48:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:43 smithi077 ceph-mon[27902]: pgmap v864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1435.030658 secs 2024-04-21T10:48:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:43 smithi191 ceph-mon[31636]: pgmap v864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1435.030658 secs 2024-04-21T10:48:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:45 smithi170 ceph-mon[31212]: pgmap v865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:45 smithi077 ceph-mon[27902]: pgmap v865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:45 smithi191 ceph-mon[31636]: pgmap v865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:47.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1438.268863 secs 2024-04-21T10:48:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1438.268863 secs 2024-04-21T10:48:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1438.268863 secs 2024-04-21T10:48:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:47 smithi170 ceph-mon[31212]: pgmap v866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:47 smithi077 ceph-mon[27902]: pgmap v866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:47 smithi191 ceph-mon[31636]: pgmap v866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:48 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 1440.030780 secs 2024-04-21T10:48:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:48 smithi170 ceph-mon[31212]: slow request 1440.030780 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:48:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:48 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 1440.030780 secs 2024-04-21T10:48:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:48 smithi077 ceph-mon[27902]: slow request 1440.030780 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:48:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:48 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 1440.030780 secs 2024-04-21T10:48:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:48 smithi191 ceph-mon[31636]: slow request 1440.030780 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T10:48:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:49 smithi170 ceph-mon[31212]: pgmap v867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:49 smithi077 ceph-mon[27902]: pgmap v867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:49 smithi191 ceph-mon[31636]: pgmap v867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:51 smithi170 ceph-mon[31212]: pgmap v868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:51 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 1443.268991 secs 2024-04-21T10:48:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:51 smithi170 ceph-mon[31212]: slow request 1443.268991 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:48:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:51 smithi077 ceph-mon[27902]: pgmap v868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:51 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 1443.268991 secs 2024-04-21T10:48:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:51 smithi077 ceph-mon[27902]: slow request 1443.268991 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:48:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:51 smithi191 ceph-mon[31636]: pgmap v868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:51 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 1443.268991 secs 2024-04-21T10:48:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:51 smithi191 ceph-mon[31636]: slow request 1443.268991 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T10:48:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:53 smithi170 ceph-mon[31212]: pgmap v869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1445.030897 secs 2024-04-21T10:48:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:53 smithi077 ceph-mon[27902]: pgmap v869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1445.030897 secs 2024-04-21T10:48:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:53 smithi191 ceph-mon[31636]: pgmap v869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1445.030897 secs 2024-04-21T10:48:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:48:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:55 smithi170 ceph-mon[31212]: pgmap v870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:55 smithi077 ceph-mon[27902]: pgmap v870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:55 smithi191 ceph-mon[31636]: pgmap v870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:48:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1448.269122 secs 2024-04-21T10:48:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1448.269122 secs 2024-04-21T10:48:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1448.269122 secs 2024-04-21T10:48:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:57 smithi170 ceph-mon[31212]: pgmap v871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:57 smithi077 ceph-mon[27902]: pgmap v871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:57 smithi191 ceph-mon[31636]: pgmap v871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:48:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1450.031014 secs 2024-04-21T10:48:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1450.031014 secs 2024-04-21T10:48:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1450.031014 secs 2024-04-21T10:49:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:48:59 smithi170 ceph-mon[31212]: pgmap v872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:48:59 smithi077 ceph-mon[27902]: pgmap v872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:48:59 smithi191 ceph-mon[31636]: pgmap v872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:01 smithi170 ceph-mon[31212]: pgmap v873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:49:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1453.269202 secs 2024-04-21T10:49:02.117 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:01 smithi191 ceph-mon[31636]: pgmap v873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:02.117 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:49:02.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1453.269202 secs 2024-04-21T10:49:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:01 smithi077 ceph-mon[27902]: pgmap v873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:49:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1453.269202 secs 2024-04-21T10:49:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:03 smithi170 ceph-mon[31212]: pgmap v874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1455.031087 secs 2024-04-21T10:49:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:03 smithi077 ceph-mon[27902]: pgmap v874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1455.031087 secs 2024-04-21T10:49:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:03 smithi191 ceph-mon[31636]: pgmap v874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1455.031087 secs 2024-04-21T10:49:04.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:04 smithi191 ceph-mon[31636]: osdmap e131: 12 total, 12 up, 12 in 2024-04-21T10:49:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:04 smithi170 ceph-mon[31212]: osdmap e131: 12 total, 12 up, 12 in 2024-04-21T10:49:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:04 smithi077 ceph-mon[27902]: osdmap e131: 12 total, 12 up, 12 in 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: pgmap v876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:49:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: pgmap v876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:49:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: pgmap v876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:49:07.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1458.269321 secs 2024-04-21T10:49:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1458.269321 secs 2024-04-21T10:49:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1458.269321 secs 2024-04-21T10:49:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:08 smithi191 ceph-mon[31636]: pgmap v877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:49:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:08 smithi170 ceph-mon[31212]: pgmap v877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:49:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:08 smithi077 ceph-mon[27902]: pgmap v877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:49:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1460.031179 secs 2024-04-21T10:49:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1460.031179 secs 2024-04-21T10:49:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1460.031179 secs 2024-04-21T10:49:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:10 smithi191 ceph-mon[31636]: pgmap v878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:49:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:10 smithi170 ceph-mon[31212]: pgmap v878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:49:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:10 smithi077 ceph-mon[27902]: pgmap v878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:49:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:12 smithi191 ceph-mon[31636]: pgmap v879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:49:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:12 smithi191 ceph-mon[31636]: osdmap e132: 12 total, 12 up, 12 in 2024-04-21T10:49:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1463.269398 secs 2024-04-21T10:49:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:12 smithi170 ceph-mon[31212]: pgmap v879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:49:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:12 smithi170 ceph-mon[31212]: osdmap e132: 12 total, 12 up, 12 in 2024-04-21T10:49:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1463.269398 secs 2024-04-21T10:49:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:12 smithi077 ceph-mon[27902]: pgmap v879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:49:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:12 smithi077 ceph-mon[27902]: osdmap e132: 12 total, 12 up, 12 in 2024-04-21T10:49:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1463.269398 secs 2024-04-21T10:49:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:14 smithi191 ceph-mon[31636]: pgmap v881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:49:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1465.031258 secs 2024-04-21T10:49:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:14 smithi170 ceph-mon[31212]: pgmap v881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:49:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1465.031258 secs 2024-04-21T10:49:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:14 smithi077 ceph-mon[27902]: pgmap v881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:49:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1465.031258 secs 2024-04-21T10:49:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:16 smithi191 ceph-mon[31636]: pgmap v882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:49:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:16 smithi170 ceph-mon[31212]: pgmap v882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:49:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:16 smithi077 ceph-mon[27902]: pgmap v882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:49:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1468.269520 secs 2024-04-21T10:49:17.511 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1468.269520 secs 2024-04-21T10:49:17.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1468.269520 secs 2024-04-21T10:49:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:18 smithi191 ceph-mon[31636]: pgmap v883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:49:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:18 smithi170 ceph-mon[31212]: pgmap v883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:49:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:18 smithi077 ceph-mon[27902]: pgmap v883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:49:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1470.031378 secs 2024-04-21T10:49:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1470.031378 secs 2024-04-21T10:49:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1470.031378 secs 2024-04-21T10:49:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:20 smithi170 ceph-mon[31212]: pgmap v884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:49:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:20 smithi077 ceph-mon[27902]: pgmap v884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:49:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:20 smithi191 ceph-mon[31636]: pgmap v884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:49:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:22 smithi170 ceph-mon[31212]: pgmap v885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:49:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1473.269642 secs 2024-04-21T10:49:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:22 smithi077 ceph-mon[27902]: pgmap v885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:49:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1473.269642 secs 2024-04-21T10:49:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:22 smithi191 ceph-mon[31636]: pgmap v885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:49:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1473.269642 secs 2024-04-21T10:49:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:24 smithi170 ceph-mon[31212]: pgmap v886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:49:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1475.031457 secs 2024-04-21T10:49:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:24 smithi077 ceph-mon[27902]: pgmap v886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:49:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1475.031457 secs 2024-04-21T10:49:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:24 smithi191 ceph-mon[31636]: pgmap v886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:49:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1475.031457 secs 2024-04-21T10:49:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:25 smithi170 ceph-mon[31212]: pgmap v887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:25 smithi077 ceph-mon[27902]: pgmap v887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:25 smithi191 ceph-mon[31636]: pgmap v887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1478.269705 secs 2024-04-21T10:49:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:27 smithi077 ceph-mon[27902]: pgmap v888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1478.269705 secs 2024-04-21T10:49:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:27 smithi191 ceph-mon[31636]: pgmap v888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1478.269705 secs 2024-04-21T10:49:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:27 smithi170 ceph-mon[31212]: pgmap v888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1480.031592 secs 2024-04-21T10:49:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1480.031592 secs 2024-04-21T10:49:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1480.031592 secs 2024-04-21T10:49:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:29 smithi191 ceph-mon[31636]: pgmap v889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:29 smithi170 ceph-mon[31212]: pgmap v889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:29 smithi077 ceph-mon[27902]: pgmap v889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:31 smithi191 ceph-mon[31636]: pgmap v890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1483.269828 secs 2024-04-21T10:49:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:31 smithi170 ceph-mon[31212]: pgmap v890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1483.269828 secs 2024-04-21T10:49:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:31 smithi077 ceph-mon[27902]: pgmap v890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1483.269828 secs 2024-04-21T10:49:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:33 smithi191 ceph-mon[31636]: pgmap v891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1485.031734 secs 2024-04-21T10:49:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:33 smithi170 ceph-mon[31212]: pgmap v891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1485.031734 secs 2024-04-21T10:49:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:33 smithi077 ceph-mon[27902]: pgmap v891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1485.031734 secs 2024-04-21T10:49:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:35 smithi191 ceph-mon[31636]: pgmap v892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:35 smithi170 ceph-mon[31212]: pgmap v892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:36.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:35 smithi077 ceph-mon[27902]: pgmap v892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:49:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1488.269952 secs 2024-04-21T10:49:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1488.269952 secs 2024-04-21T10:49:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1488.269952 secs 2024-04-21T10:49:37.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:37 smithi170 ceph-mon[31212]: pgmap v893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:37 smithi191 ceph-mon[31636]: pgmap v893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:37 smithi077 ceph-mon[27902]: pgmap v893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1490.031813 secs 2024-04-21T10:49:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1490.031813 secs 2024-04-21T10:49:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1490.031813 secs 2024-04-21T10:49:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:39 smithi191 ceph-mon[31636]: pgmap v894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:39 smithi170 ceph-mon[31212]: pgmap v894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:39 smithi077 ceph-mon[27902]: pgmap v894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:41 smithi191 ceph-mon[31636]: pgmap v895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1493.270028 secs 2024-04-21T10:49:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:41 smithi170 ceph-mon[31212]: pgmap v895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1493.270028 secs 2024-04-21T10:49:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:41 smithi077 ceph-mon[27902]: pgmap v895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1493.270028 secs 2024-04-21T10:49:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:43 smithi191 ceph-mon[31636]: pgmap v896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1495.031876 secs 2024-04-21T10:49:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:43 smithi170 ceph-mon[31212]: pgmap v896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1495.031876 secs 2024-04-21T10:49:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:43 smithi077 ceph-mon[27902]: pgmap v896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1495.031876 secs 2024-04-21T10:49:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:45 smithi191 ceph-mon[31636]: pgmap v897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:45 smithi170 ceph-mon[31212]: pgmap v897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:45 smithi077 ceph-mon[27902]: pgmap v897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1498.270142 secs 2024-04-21T10:49:47.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1498.270142 secs 2024-04-21T10:49:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1498.270142 secs 2024-04-21T10:49:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:47 smithi191 ceph-mon[31636]: pgmap v898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:47 smithi170 ceph-mon[31212]: pgmap v898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:47 smithi077 ceph-mon[27902]: pgmap v898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1500.032009 secs 2024-04-21T10:49:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1500.032009 secs 2024-04-21T10:49:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1500.032009 secs 2024-04-21T10:49:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:49 smithi191 ceph-mon[31636]: pgmap v899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:49 smithi170 ceph-mon[31212]: pgmap v899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:49 smithi077 ceph-mon[27902]: pgmap v899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:51 smithi191 ceph-mon[31636]: pgmap v900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1503.270232 secs 2024-04-21T10:49:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:51 smithi170 ceph-mon[31212]: pgmap v900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1503.270232 secs 2024-04-21T10:49:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:51 smithi077 ceph-mon[27902]: pgmap v900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1503.270232 secs 2024-04-21T10:49:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:53 smithi191 ceph-mon[31636]: pgmap v901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1505.032130 secs 2024-04-21T10:49:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:53 smithi170 ceph-mon[31212]: pgmap v901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1505.032130 secs 2024-04-21T10:49:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:53 smithi077 ceph-mon[27902]: pgmap v901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1505.032130 secs 2024-04-21T10:49:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:49:54.561+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:49:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:49:54.561+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:49:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:49:54.568+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:49:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:49:54.568+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:49:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:49:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:55 smithi191 ceph-mon[31636]: pgmap v902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:55 smithi170 ceph-mon[31212]: pgmap v902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:55 smithi077 ceph-mon[27902]: pgmap v902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:49:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1508.270310 secs 2024-04-21T10:49:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1508.270310 secs 2024-04-21T10:49:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1508.270310 secs 2024-04-21T10:49:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:57 smithi191 ceph-mon[31636]: pgmap v903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:57 smithi170 ceph-mon[31212]: pgmap v903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:57 smithi077 ceph-mon[27902]: pgmap v903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:49:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1510.032245 secs 2024-04-21T10:49:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1510.032245 secs 2024-04-21T10:49:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1510.032245 secs 2024-04-21T10:49:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:49:59 smithi191 ceph-mon[31636]: pgmap v904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:49:59 smithi170 ceph-mon[31212]: pgmap v904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:49:59 smithi077 ceph-mon[27902]: pgmap v904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T10:50:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T10:50:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T10:50:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:01 smithi170 ceph-mon[31212]: pgmap v905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1513.270434 secs 2024-04-21T10:50:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:01 smithi077 ceph-mon[27902]: pgmap v905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1513.270434 secs 2024-04-21T10:50:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:01 smithi191 ceph-mon[31636]: pgmap v905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1513.270434 secs 2024-04-21T10:50:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:03 smithi170 ceph-mon[31212]: pgmap v906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1515.032324 secs 2024-04-21T10:50:04.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:03 smithi077 ceph-mon[27902]: pgmap v906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:04.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1515.032324 secs 2024-04-21T10:50:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:03 smithi191 ceph-mon[31636]: pgmap v906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1515.032324 secs 2024-04-21T10:50:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:04 smithi170 ceph-mon[31212]: osdmap e133: 12 total, 12 up, 12 in 2024-04-21T10:50:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:04 smithi077 ceph-mon[27902]: osdmap e133: 12 total, 12 up, 12 in 2024-04-21T10:50:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:04 smithi191 ceph-mon[31636]: osdmap e133: 12 total, 12 up, 12 in 2024-04-21T10:50:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:05 smithi170 ceph-mon[31212]: pgmap v908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:50:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:50:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:05 smithi077 ceph-mon[27902]: pgmap v908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:50:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:50:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:05 smithi191 ceph-mon[31636]: pgmap v908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:50:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:50:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:50:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:50:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:50:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1518.270546 secs 2024-04-21T10:50:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:50:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:50:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:50:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1518.270546 secs 2024-04-21T10:50:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:50:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:50:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:50:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1518.270546 secs 2024-04-21T10:50:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:07 smithi170 ceph-mon[31212]: pgmap v909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:50:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:07 smithi077 ceph-mon[27902]: pgmap v909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:50:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:07 smithi191 ceph-mon[31636]: pgmap v909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:50:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1520.032452 secs 2024-04-21T10:50:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1520.032452 secs 2024-04-21T10:50:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1520.032452 secs 2024-04-21T10:50:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:09 smithi170 ceph-mon[31212]: pgmap v910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:50:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:09 smithi077 ceph-mon[27902]: pgmap v910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:50:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:09 smithi191 ceph-mon[31636]: pgmap v910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:50:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:11 smithi170 ceph-mon[31212]: pgmap v911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:50:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:11 smithi170 ceph-mon[31212]: osdmap e134: 12 total, 12 up, 12 in 2024-04-21T10:50:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1523.270696 secs 2024-04-21T10:50:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:11 smithi077 ceph-mon[27902]: pgmap v911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:50:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:11 smithi077 ceph-mon[27902]: osdmap e134: 12 total, 12 up, 12 in 2024-04-21T10:50:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1523.270696 secs 2024-04-21T10:50:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:11 smithi191 ceph-mon[31636]: pgmap v911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:50:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:11 smithi191 ceph-mon[31636]: osdmap e134: 12 total, 12 up, 12 in 2024-04-21T10:50:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1523.270696 secs 2024-04-21T10:50:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:13 smithi170 ceph-mon[31212]: pgmap v913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:50:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1525.032571 secs 2024-04-21T10:50:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:13 smithi077 ceph-mon[27902]: pgmap v913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:50:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1525.032571 secs 2024-04-21T10:50:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:13 smithi191 ceph-mon[31636]: pgmap v913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:50:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1525.032571 secs 2024-04-21T10:50:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:15 smithi170 ceph-mon[31212]: pgmap v914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:50:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:15 smithi077 ceph-mon[27902]: pgmap v914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:50:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:15 smithi191 ceph-mon[31636]: pgmap v914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:50:17.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1528.270787 secs 2024-04-21T10:50:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1528.270787 secs 2024-04-21T10:50:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1528.270787 secs 2024-04-21T10:50:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:17 smithi170 ceph-mon[31212]: pgmap v915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:50:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:17 smithi077 ceph-mon[27902]: pgmap v915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:50:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:17 smithi191 ceph-mon[31636]: pgmap v915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:50:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1530.032686 secs 2024-04-21T10:50:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1530.032686 secs 2024-04-21T10:50:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1530.032686 secs 2024-04-21T10:50:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:19 smithi170 ceph-mon[31212]: pgmap v916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:50:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:19 smithi077 ceph-mon[27902]: pgmap v916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:50:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:19 smithi191 ceph-mon[31636]: pgmap v916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:50:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:21 smithi170 ceph-mon[31212]: pgmap v917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:50:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1533.270924 secs 2024-04-21T10:50:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:21 smithi077 ceph-mon[27902]: pgmap v917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:50:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1533.270924 secs 2024-04-21T10:50:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:21 smithi191 ceph-mon[31636]: pgmap v917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:50:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1533.270924 secs 2024-04-21T10:50:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:23 smithi170 ceph-mon[31212]: pgmap v918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:50:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1535.032821 secs 2024-04-21T10:50:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:23 smithi077 ceph-mon[27902]: pgmap v918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:50:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1535.032821 secs 2024-04-21T10:50:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:23 smithi191 ceph-mon[31636]: pgmap v918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:50:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1535.032821 secs 2024-04-21T10:50:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:25 smithi170 ceph-mon[31212]: pgmap v919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:25 smithi077 ceph-mon[27902]: pgmap v919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:26.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:25 smithi191 ceph-mon[31636]: pgmap v919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1538.271050 secs 2024-04-21T10:50:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1538.271050 secs 2024-04-21T10:50:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1538.271050 secs 2024-04-21T10:50:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:27 smithi170 ceph-mon[31212]: pgmap v920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:27 smithi077 ceph-mon[27902]: pgmap v920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:27 smithi191 ceph-mon[31636]: pgmap v920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1540.032963 secs 2024-04-21T10:50:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1540.032963 secs 2024-04-21T10:50:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1540.032963 secs 2024-04-21T10:50:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:29 smithi077 ceph-mon[27902]: pgmap v921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:29 smithi191 ceph-mon[31636]: pgmap v921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:29 smithi170 ceph-mon[31212]: pgmap v921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:31 smithi077 ceph-mon[27902]: pgmap v922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1543.271135 secs 2024-04-21T10:50:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:31 smithi191 ceph-mon[31636]: pgmap v922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1543.271135 secs 2024-04-21T10:50:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:31 smithi170 ceph-mon[31212]: pgmap v922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1543.271135 secs 2024-04-21T10:50:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:33 smithi077 ceph-mon[27902]: pgmap v923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1545.033027 secs 2024-04-21T10:50:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:33 smithi191 ceph-mon[31636]: pgmap v923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1545.033027 secs 2024-04-21T10:50:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:33 smithi170 ceph-mon[31212]: pgmap v923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1545.033027 secs 2024-04-21T10:50:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:35 smithi077 ceph-mon[27902]: pgmap v924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:35 smithi191 ceph-mon[31636]: pgmap v924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:35 smithi170 ceph-mon[31212]: pgmap v924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1548.271206 secs 2024-04-21T10:50:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1548.271206 secs 2024-04-21T10:50:37.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1548.271206 secs 2024-04-21T10:50:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:37 smithi077 ceph-mon[27902]: pgmap v925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:37 smithi191 ceph-mon[31636]: pgmap v925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:37 smithi170 ceph-mon[31212]: pgmap v925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1550.033091 secs 2024-04-21T10:50:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1550.033091 secs 2024-04-21T10:50:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1550.033091 secs 2024-04-21T10:50:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:39 smithi077 ceph-mon[27902]: pgmap v926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:39 smithi191 ceph-mon[31636]: pgmap v926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:39 smithi170 ceph-mon[31212]: pgmap v926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:41 smithi077 ceph-mon[27902]: pgmap v927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1553.271348 secs 2024-04-21T10:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:41 smithi191 ceph-mon[31636]: pgmap v927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1553.271348 secs 2024-04-21T10:50:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:41 smithi170 ceph-mon[31212]: pgmap v927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1553.271348 secs 2024-04-21T10:50:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:43 smithi170 ceph-mon[31212]: pgmap v928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1555.033213 secs 2024-04-21T10:50:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:43 smithi077 ceph-mon[27902]: pgmap v928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1555.033213 secs 2024-04-21T10:50:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:43 smithi191 ceph-mon[31636]: pgmap v928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1555.033213 secs 2024-04-21T10:50:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:45 smithi077 ceph-mon[27902]: pgmap v929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:45 smithi191 ceph-mon[31636]: pgmap v929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:45 smithi170 ceph-mon[31212]: pgmap v929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1558.271470 secs 2024-04-21T10:50:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1558.271470 secs 2024-04-21T10:50:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1558.271470 secs 2024-04-21T10:50:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:47 smithi077 ceph-mon[27902]: pgmap v930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:47 smithi191 ceph-mon[31636]: pgmap v930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:47 smithi170 ceph-mon[31212]: pgmap v930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1560.033332 secs 2024-04-21T10:50:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1560.033332 secs 2024-04-21T10:50:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1560.033332 secs 2024-04-21T10:50:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:49 smithi077 ceph-mon[27902]: pgmap v931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:49 smithi191 ceph-mon[31636]: pgmap v931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:49 smithi170 ceph-mon[31212]: pgmap v931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:51 smithi077 ceph-mon[27902]: pgmap v932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1563.271593 secs 2024-04-21T10:50:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:51 smithi191 ceph-mon[31636]: pgmap v932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1563.271593 secs 2024-04-21T10:50:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:51 smithi170 ceph-mon[31212]: pgmap v932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1563.271593 secs 2024-04-21T10:50:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:53 smithi077 ceph-mon[27902]: pgmap v933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1565.033450 secs 2024-04-21T10:50:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:53 smithi191 ceph-mon[31636]: pgmap v933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1565.033450 secs 2024-04-21T10:50:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:53 smithi170 ceph-mon[31212]: pgmap v933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1565.033450 secs 2024-04-21T10:50:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:50:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:55 smithi077 ceph-mon[27902]: pgmap v934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:55 smithi191 ceph-mon[31636]: pgmap v934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:55 smithi170 ceph-mon[31212]: pgmap v934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:50:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1568.271720 secs 2024-04-21T10:50:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1568.271720 secs 2024-04-21T10:50:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1568.271720 secs 2024-04-21T10:50:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:57 smithi077 ceph-mon[27902]: pgmap v935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:57 smithi191 ceph-mon[31636]: pgmap v935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:57 smithi170 ceph-mon[31212]: pgmap v935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:50:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1570.033565 secs 2024-04-21T10:50:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1570.033565 secs 2024-04-21T10:50:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1570.033565 secs 2024-04-21T10:51:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:50:59 smithi191 ceph-mon[31636]: pgmap v936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:50:59 smithi170 ceph-mon[31212]: pgmap v936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:50:59 smithi077 ceph-mon[27902]: pgmap v936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:01 smithi191 ceph-mon[31636]: pgmap v937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1573.271837 secs 2024-04-21T10:51:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:01 smithi170 ceph-mon[31212]: pgmap v937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1573.271837 secs 2024-04-21T10:51:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:01 smithi077 ceph-mon[27902]: pgmap v937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1573.271837 secs 2024-04-21T10:51:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:03 smithi191 ceph-mon[31636]: pgmap v938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1575.033715 secs 2024-04-21T10:51:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:03 smithi170 ceph-mon[31212]: pgmap v938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1575.033715 secs 2024-04-21T10:51:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:03 smithi077 ceph-mon[27902]: pgmap v938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1575.033715 secs 2024-04-21T10:51:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:04 smithi191 ceph-mon[31636]: osdmap e135: 12 total, 12 up, 12 in 2024-04-21T10:51:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:04 smithi170 ceph-mon[31212]: osdmap e135: 12 total, 12 up, 12 in 2024-04-21T10:51:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:04 smithi077 ceph-mon[27902]: osdmap e135: 12 total, 12 up, 12 in 2024-04-21T10:51:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:05 smithi191 ceph-mon[31636]: pgmap v940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:51:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:05 smithi170 ceph-mon[31212]: pgmap v940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:51:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:05 smithi077 ceph-mon[27902]: pgmap v940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:51:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:51:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1578.271907 secs 2024-04-21T10:51:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:51:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1578.271907 secs 2024-04-21T10:51:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:51:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1578.271907 secs 2024-04-21T10:51:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:07 smithi191 ceph-mon[31636]: pgmap v941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:51:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:51:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:51:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:51:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:07 smithi170 ceph-mon[31212]: pgmap v941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:51:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:51:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:51:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:51:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:07 smithi077 ceph-mon[27902]: pgmap v941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:51:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:51:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:51:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:51:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1580.033809 secs 2024-04-21T10:51:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1580.033809 secs 2024-04-21T10:51:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1580.033809 secs 2024-04-21T10:51:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:09 smithi191 ceph-mon[31636]: pgmap v942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:51:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:09 smithi170 ceph-mon[31212]: pgmap v942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:51:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:09 smithi077 ceph-mon[27902]: pgmap v942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:51:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:11 smithi191 ceph-mon[31636]: pgmap v943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:51:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:11 smithi191 ceph-mon[31636]: osdmap e136: 12 total, 12 up, 12 in 2024-04-21T10:51:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1583.272056 secs 2024-04-21T10:51:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:11 smithi170 ceph-mon[31212]: pgmap v943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:51:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:11 smithi170 ceph-mon[31212]: osdmap e136: 12 total, 12 up, 12 in 2024-04-21T10:51:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1583.272056 secs 2024-04-21T10:51:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:11 smithi077 ceph-mon[27902]: pgmap v943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:11 smithi077 ceph-mon[27902]: osdmap e136: 12 total, 12 up, 12 in 2024-04-21T10:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1583.272056 secs 2024-04-21T10:51:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:13 smithi191 ceph-mon[31636]: pgmap v945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T10:51:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1585.033936 secs 2024-04-21T10:51:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:13 smithi170 ceph-mon[31212]: pgmap v945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T10:51:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1585.033936 secs 2024-04-21T10:51:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:13 smithi077 ceph-mon[27902]: pgmap v945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T10:51:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1585.033936 secs 2024-04-21T10:51:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:15 smithi191 ceph-mon[31636]: pgmap v946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:51:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:15 smithi170 ceph-mon[31212]: pgmap v946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:51:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:15 smithi077 ceph-mon[27902]: pgmap v946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:51:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1588.272181 secs 2024-04-21T10:51:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:17 smithi191 ceph-mon[31636]: pgmap v947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:51:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1588.272181 secs 2024-04-21T10:51:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:17 smithi170 ceph-mon[31212]: pgmap v947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:51:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1588.272181 secs 2024-04-21T10:51:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:17 smithi077 ceph-mon[27902]: pgmap v947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:51:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1590.034009 secs 2024-04-21T10:51:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1590.034009 secs 2024-04-21T10:51:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1590.034009 secs 2024-04-21T10:51:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:19 smithi191 ceph-mon[31636]: pgmap v948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:51:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:19 smithi170 ceph-mon[31212]: pgmap v948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:51:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:19 smithi077 ceph-mon[27902]: pgmap v948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:51:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:21 smithi191 ceph-mon[31636]: pgmap v949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:51:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1593.272317 secs 2024-04-21T10:51:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:21 smithi170 ceph-mon[31212]: pgmap v949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:51:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1593.272317 secs 2024-04-21T10:51:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:21 smithi077 ceph-mon[27902]: pgmap v949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:51:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1593.272317 secs 2024-04-21T10:51:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:23 smithi191 ceph-mon[31636]: pgmap v950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:51:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1595.034091 secs 2024-04-21T10:51:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:23 smithi170 ceph-mon[31212]: pgmap v950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:51:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1595.034091 secs 2024-04-21T10:51:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:23 smithi077 ceph-mon[27902]: pgmap v950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:51:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1595.034091 secs 2024-04-21T10:51:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:25 smithi191 ceph-mon[31636]: pgmap v951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:25 smithi170 ceph-mon[31212]: pgmap v951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:25 smithi077 ceph-mon[27902]: pgmap v951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1598.272453 secs 2024-04-21T10:51:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1598.272453 secs 2024-04-21T10:51:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1598.272453 secs 2024-04-21T10:51:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:27 smithi191 ceph-mon[31636]: pgmap v952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:27 smithi170 ceph-mon[31212]: pgmap v952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:27 smithi077 ceph-mon[27902]: pgmap v952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1600.034152 secs 2024-04-21T10:51:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1600.034152 secs 2024-04-21T10:51:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1600.034152 secs 2024-04-21T10:51:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:29 smithi191 ceph-mon[31636]: pgmap v953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:29 smithi170 ceph-mon[31212]: pgmap v953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:29 smithi077 ceph-mon[27902]: pgmap v953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:31 smithi191 ceph-mon[31636]: pgmap v954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1603.272581 secs 2024-04-21T10:51:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:31 smithi170 ceph-mon[31212]: pgmap v954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1603.272581 secs 2024-04-21T10:51:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:31 smithi077 ceph-mon[27902]: pgmap v954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1603.272581 secs 2024-04-21T10:51:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:33 smithi191 ceph-mon[31636]: pgmap v955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1605.034231 secs 2024-04-21T10:51:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:33 smithi170 ceph-mon[31212]: pgmap v955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1605.034231 secs 2024-04-21T10:51:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:33 smithi077 ceph-mon[27902]: pgmap v955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1605.034231 secs 2024-04-21T10:51:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:35 smithi191 ceph-mon[31636]: pgmap v956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:35 smithi170 ceph-mon[31212]: pgmap v956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:35 smithi077 ceph-mon[27902]: pgmap v956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T10:51:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1608.272713 secs 2024-04-21T10:51:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1608.272713 secs 2024-04-21T10:51:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1608.272713 secs 2024-04-21T10:51:37.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:37 smithi170 ceph-mon[31212]: pgmap v957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:37 smithi191 ceph-mon[31636]: pgmap v957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:37 smithi077 ceph-mon[27902]: pgmap v957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T10:51:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1610.034362 secs 2024-04-21T10:51:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1610.034362 secs 2024-04-21T10:51:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1610.034362 secs 2024-04-21T10:51:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:39 smithi191 ceph-mon[31636]: pgmap v958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:39 smithi170 ceph-mon[31212]: pgmap v958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:39 smithi077 ceph-mon[27902]: pgmap v958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:41 smithi191 ceph-mon[31636]: pgmap v959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:41.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1613.272832 secs 2024-04-21T10:51:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:41 smithi170 ceph-mon[31212]: pgmap v959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1613.272832 secs 2024-04-21T10:51:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:41 smithi077 ceph-mon[27902]: pgmap v959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1613.272832 secs 2024-04-21T10:51:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:43 smithi170 ceph-mon[31212]: pgmap v960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1615.034496 secs 2024-04-21T10:51:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:43 smithi077 ceph-mon[27902]: pgmap v960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1615.034496 secs 2024-04-21T10:51:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:43 smithi191 ceph-mon[31636]: pgmap v960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1615.034496 secs 2024-04-21T10:51:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:45 smithi170 ceph-mon[31212]: pgmap v961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:45 smithi077 ceph-mon[27902]: pgmap v961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:45 smithi191 ceph-mon[31636]: pgmap v961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:47.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1618.272899 secs 2024-04-21T10:51:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1618.272899 secs 2024-04-21T10:51:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1618.272899 secs 2024-04-21T10:51:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:47 smithi170 ceph-mon[31212]: pgmap v962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:47 smithi077 ceph-mon[27902]: pgmap v962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:47 smithi191 ceph-mon[31636]: pgmap v962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1620.034612 secs 2024-04-21T10:51:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1620.034612 secs 2024-04-21T10:51:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1620.034612 secs 2024-04-21T10:51:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:49 smithi170 ceph-mon[31212]: pgmap v963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:49 smithi077 ceph-mon[27902]: pgmap v963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:49 smithi191 ceph-mon[31636]: pgmap v963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:51 smithi170 ceph-mon[31212]: pgmap v964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1623.273012 secs 2024-04-21T10:51:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:51 smithi077 ceph-mon[27902]: pgmap v964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1623.273012 secs 2024-04-21T10:51:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:51 smithi191 ceph-mon[31636]: pgmap v964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1623.273012 secs 2024-04-21T10:51:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:53 smithi170 ceph-mon[31212]: pgmap v965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1625.034701 secs 2024-04-21T10:51:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:53 smithi077 ceph-mon[27902]: pgmap v965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1625.034701 secs 2024-04-21T10:51:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:53 smithi191 ceph-mon[31636]: pgmap v965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1625.034701 secs 2024-04-21T10:51:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:51:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:55 smithi170 ceph-mon[31212]: pgmap v966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:55 smithi077 ceph-mon[27902]: pgmap v966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:55 smithi191 ceph-mon[31636]: pgmap v966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:51:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1628.273135 secs 2024-04-21T10:51:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1628.273135 secs 2024-04-21T10:51:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1628.273135 secs 2024-04-21T10:51:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:57 smithi170 ceph-mon[31212]: pgmap v967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:57 smithi077 ceph-mon[27902]: pgmap v967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:57 smithi191 ceph-mon[31636]: pgmap v967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:51:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1630.034811 secs 2024-04-21T10:51:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1630.034811 secs 2024-04-21T10:51:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1630.034811 secs 2024-04-21T10:52:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:51:59 smithi170 ceph-mon[31212]: pgmap v968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:51:59 smithi077 ceph-mon[27902]: pgmap v968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:51:59 smithi191 ceph-mon[31636]: pgmap v968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:01 smithi170 ceph-mon[31212]: pgmap v969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1633.273251 secs 2024-04-21T10:52:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:01 smithi077 ceph-mon[27902]: pgmap v969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1633.273251 secs 2024-04-21T10:52:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:01 smithi191 ceph-mon[31636]: pgmap v969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1633.273251 secs 2024-04-21T10:52:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:03 smithi170 ceph-mon[31212]: pgmap v970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1635.034926 secs 2024-04-21T10:52:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:03 smithi077 ceph-mon[27902]: pgmap v970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1635.034926 secs 2024-04-21T10:52:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:03 smithi191 ceph-mon[31636]: pgmap v970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1635.034926 secs 2024-04-21T10:52:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:04 smithi170 ceph-mon[31212]: osdmap e137: 12 total, 12 up, 12 in 2024-04-21T10:52:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:04 smithi077 ceph-mon[27902]: osdmap e137: 12 total, 12 up, 12 in 2024-04-21T10:52:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:04 smithi191 ceph-mon[31636]: osdmap e137: 12 total, 12 up, 12 in 2024-04-21T10:52:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:05 smithi170 ceph-mon[31212]: pgmap v972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:52:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:05 smithi077 ceph-mon[27902]: pgmap v972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:52:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:05 smithi191 ceph-mon[31636]: pgmap v972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:52:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1638.273369 secs 2024-04-21T10:52:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1638.273369 secs 2024-04-21T10:52:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1638.273369 secs 2024-04-21T10:52:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:07 smithi170 ceph-mon[31212]: pgmap v973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:52:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:52:08.131 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:07 smithi191 ceph-mon[31636]: pgmap v973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:52:08.131 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:52:08.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:07 smithi077 ceph-mon[27902]: pgmap v973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:52:08.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:52:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1640.035004 secs 2024-04-21T10:52:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1640.035004 secs 2024-04-21T10:52:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1640.035004 secs 2024-04-21T10:52:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: pgmap v974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: pgmap v974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: pgmap v974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:52:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:52:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:52:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:52:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:52:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:52:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:12 smithi170 ceph-mon[31212]: pgmap v975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:52:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1643.273441 secs 2024-04-21T10:52:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:12 smithi170 ceph-mon[31212]: osdmap e138: 12 total, 12 up, 12 in 2024-04-21T10:52:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:12 smithi077 ceph-mon[27902]: pgmap v975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:52:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1643.273441 secs 2024-04-21T10:52:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:12 smithi077 ceph-mon[27902]: osdmap e138: 12 total, 12 up, 12 in 2024-04-21T10:52:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:12 smithi191 ceph-mon[31636]: pgmap v975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:52:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1643.273441 secs 2024-04-21T10:52:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:12 smithi191 ceph-mon[31636]: osdmap e138: 12 total, 12 up, 12 in 2024-04-21T10:52:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:14 smithi170 ceph-mon[31212]: pgmap v977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:52:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1645.035122 secs 2024-04-21T10:52:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:14 smithi077 ceph-mon[27902]: pgmap v977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:52:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1645.035122 secs 2024-04-21T10:52:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:14 smithi191 ceph-mon[31636]: pgmap v977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:52:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1645.035122 secs 2024-04-21T10:52:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:16 smithi170 ceph-mon[31212]: pgmap v978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:52:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:16 smithi077 ceph-mon[27902]: pgmap v978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:52:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:16 smithi191 ceph-mon[31636]: pgmap v978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:52:17.303 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1648.273545 secs 2024-04-21T10:52:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1648.273545 secs 2024-04-21T10:52:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1648.273545 secs 2024-04-21T10:52:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:18 smithi170 ceph-mon[31212]: pgmap v979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:52:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:18 smithi077 ceph-mon[27902]: pgmap v979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:52:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:18 smithi191 ceph-mon[31636]: pgmap v979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:52:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1650.035235 secs 2024-04-21T10:52:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1650.035235 secs 2024-04-21T10:52:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1650.035235 secs 2024-04-21T10:52:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:20 smithi170 ceph-mon[31212]: pgmap v980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:52:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:20 smithi077 ceph-mon[27902]: pgmap v980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:52:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:20 smithi191 ceph-mon[31636]: pgmap v980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:52:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:22 smithi170 ceph-mon[31212]: pgmap v981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:52:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1653.273667 secs 2024-04-21T10:52:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:22 smithi077 ceph-mon[27902]: pgmap v981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:52:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1653.273667 secs 2024-04-21T10:52:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:22 smithi191 ceph-mon[31636]: pgmap v981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:52:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1653.273667 secs 2024-04-21T10:52:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:24 smithi170 ceph-mon[31212]: pgmap v982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:52:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1655.035352 secs 2024-04-21T10:52:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:24 smithi077 ceph-mon[27902]: pgmap v982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:52:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1655.035352 secs 2024-04-21T10:52:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:24 smithi191 ceph-mon[31636]: pgmap v982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:52:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1655.035352 secs 2024-04-21T10:52:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:26 smithi077 ceph-mon[27902]: pgmap v983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:26 smithi191 ceph-mon[31636]: pgmap v983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:26 smithi170 ceph-mon[31212]: pgmap v983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1658.273816 secs 2024-04-21T10:52:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1658.273816 secs 2024-04-21T10:52:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1658.273816 secs 2024-04-21T10:52:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:28 smithi077 ceph-mon[27902]: pgmap v984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:28 smithi191 ceph-mon[31636]: pgmap v984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:28 smithi170 ceph-mon[31212]: pgmap v984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1660.035457 secs 2024-04-21T10:52:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1660.035457 secs 2024-04-21T10:52:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1660.035457 secs 2024-04-21T10:52:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:30 smithi077 ceph-mon[27902]: pgmap v985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:30 smithi191 ceph-mon[31636]: pgmap v985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:30 smithi170 ceph-mon[31212]: pgmap v985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:32 smithi077 ceph-mon[27902]: pgmap v986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1663.273931 secs 2024-04-21T10:52:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:32 smithi191 ceph-mon[31636]: pgmap v986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1663.273931 secs 2024-04-21T10:52:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:32 smithi170 ceph-mon[31212]: pgmap v986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1663.273931 secs 2024-04-21T10:52:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:34 smithi077 ceph-mon[27902]: pgmap v987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1665.035591 secs 2024-04-21T10:52:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:34 smithi191 ceph-mon[31636]: pgmap v987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1665.035591 secs 2024-04-21T10:52:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:34 smithi170 ceph-mon[31212]: pgmap v987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1665.035591 secs 2024-04-21T10:52:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:36 smithi077 ceph-mon[27902]: pgmap v988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:36 smithi191 ceph-mon[31636]: pgmap v988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:36 smithi170 ceph-mon[31212]: pgmap v988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1668.274043 secs 2024-04-21T10:52:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1668.274043 secs 2024-04-21T10:52:37.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1668.274043 secs 2024-04-21T10:52:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:38 smithi077 ceph-mon[27902]: pgmap v989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:38 smithi191 ceph-mon[31636]: pgmap v989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:38 smithi170 ceph-mon[31212]: pgmap v989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1670.035725 secs 2024-04-21T10:52:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1670.035725 secs 2024-04-21T10:52:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1670.035725 secs 2024-04-21T10:52:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:40 smithi077 ceph-mon[27902]: pgmap v990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:40 smithi191 ceph-mon[31636]: pgmap v990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:40 smithi170 ceph-mon[31212]: pgmap v990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:42 smithi077 ceph-mon[27902]: pgmap v991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1673.274162 secs 2024-04-21T10:52:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:42 smithi191 ceph-mon[31636]: pgmap v991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1673.274162 secs 2024-04-21T10:52:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:42 smithi170 ceph-mon[31212]: pgmap v991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1673.274162 secs 2024-04-21T10:52:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:44 smithi077 ceph-mon[27902]: pgmap v992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1675.035846 secs 2024-04-21T10:52:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:44 smithi191 ceph-mon[31636]: pgmap v992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1675.035846 secs 2024-04-21T10:52:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:44 smithi170 ceph-mon[31212]: pgmap v992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1675.035846 secs 2024-04-21T10:52:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:46 smithi077 ceph-mon[27902]: pgmap v993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:46 smithi191 ceph-mon[31636]: pgmap v993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:46 smithi170 ceph-mon[31212]: pgmap v993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1678.274284 secs 2024-04-21T10:52:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1678.274284 secs 2024-04-21T10:52:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1678.274284 secs 2024-04-21T10:52:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:48 smithi077 ceph-mon[27902]: pgmap v994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:48 smithi191 ceph-mon[31636]: pgmap v994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:48 smithi170 ceph-mon[31212]: pgmap v994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 1680.035968 secs 2024-04-21T10:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:49 smithi077 ceph-mon[27902]: slow request 1441.489777 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:49 smithi077 ceph-mon[27902]: slow request 1441.478620 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:49 smithi077 ceph-mon[27902]: slow request 1441.430437 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:49 smithi077 ceph-mon[27902]: slow request 1441.399387 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:49 smithi077 ceph-mon[27902]: slow request 1441.355826 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 1680.035968 secs 2024-04-21T10:52:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:49 smithi191 ceph-mon[31636]: slow request 1441.489777 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:52:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:49 smithi191 ceph-mon[31636]: slow request 1441.478620 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:49 smithi191 ceph-mon[31636]: slow request 1441.430437 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:49 smithi191 ceph-mon[31636]: slow request 1441.399387 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:49 smithi191 ceph-mon[31636]: slow request 1441.355826 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 1680.035968 secs 2024-04-21T10:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:49 smithi170 ceph-mon[31212]: slow request 1441.489777 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:49 smithi170 ceph-mon[31212]: slow request 1441.478620 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:49 smithi170 ceph-mon[31212]: slow request 1441.430437 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:49 smithi170 ceph-mon[31212]: slow request 1441.399387 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:49 smithi170 ceph-mon[31212]: slow request 1441.355826 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:50 smithi077 ceph-mon[27902]: pgmap v995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:50 smithi191 ceph-mon[31636]: pgmap v995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:50 smithi170 ceph-mon[31212]: pgmap v995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:52 smithi077 ceph-mon[27902]: pgmap v996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1683.274426 secs 2024-04-21T10:52:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:52 smithi191 ceph-mon[31636]: pgmap v996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1683.274426 secs 2024-04-21T10:52:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:52 smithi170 ceph-mon[31212]: pgmap v996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1683.274426 secs 2024-04-21T10:52:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: pgmap v997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 1685.036075 secs 2024-04-21T10:52:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: slow request 1446.228622 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: slow request 1446.218877 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: slow request 1446.199884 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: slow request 1446.197868 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:54 smithi077 ceph-mon[27902]: slow request 1446.189882 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: pgmap v997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 1685.036075 secs 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: slow request 1446.228622 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: slow request 1446.218877 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: slow request 1446.199884 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: slow request 1446.197868 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:54 smithi191 ceph-mon[31636]: slow request 1446.189882 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: pgmap v997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 1685.036075 secs 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: slow request 1446.228622 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: slow request 1446.218877 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: slow request 1446.199884 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: slow request 1446.197868 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:54 smithi170 ceph-mon[31212]: slow request 1446.189882 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:52:54.584+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:52:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:52:54.585+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:52:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:52:54.589+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:52:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:52:54.589+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:52:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:52:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:56 smithi077 ceph-mon[27902]: pgmap v998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:56 smithi191 ceph-mon[31636]: pgmap v998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:56 smithi170 ceph-mon[31212]: pgmap v998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:52:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1688.274561 secs 2024-04-21T10:52:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1688.274561 secs 2024-04-21T10:52:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1688.274561 secs 2024-04-21T10:52:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:58 smithi191 ceph-mon[31636]: pgmap v999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:58 smithi170 ceph-mon[31212]: pgmap v999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:58 smithi077 ceph-mon[27902]: pgmap v999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:52:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 1690.036154 secs 2024-04-21T10:52:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:59 smithi191 ceph-mon[31636]: slow request 1451.183109 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:59 smithi191 ceph-mon[31636]: slow request 1451.174103 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:59 smithi191 ceph-mon[31636]: slow request 1451.168994 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:59 smithi191 ceph-mon[31636]: slow request 1451.153484 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:52:59 smithi191 ceph-mon[31636]: slow request 1451.144797 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 1690.036154 secs 2024-04-21T10:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:59 smithi170 ceph-mon[31212]: slow request 1451.183109 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:59 smithi170 ceph-mon[31212]: slow request 1451.174103 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:59 smithi170 ceph-mon[31212]: slow request 1451.168994 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:59 smithi170 ceph-mon[31212]: slow request 1451.153484 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:52:59 smithi170 ceph-mon[31212]: slow request 1451.144797 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 1690.036154 secs 2024-04-21T10:52:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:59 smithi077 ceph-mon[27902]: slow request 1451.183109 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:59 smithi077 ceph-mon[27902]: slow request 1451.174103 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:59 smithi077 ceph-mon[27902]: slow request 1451.168994 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:59 smithi077 ceph-mon[27902]: slow request 1451.153484 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:52:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:52:59 smithi077 ceph-mon[27902]: slow request 1451.144797 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T10:53:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:00 smithi191 ceph-mon[31636]: pgmap v1000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:00 smithi170 ceph-mon[31212]: pgmap v1000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:00 smithi077 ceph-mon[27902]: pgmap v1000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:02 smithi191 ceph-mon[31636]: pgmap v1001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T10:53:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1693.274697 secs 2024-04-21T10:53:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:02 smithi170 ceph-mon[31212]: pgmap v1001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T10:53:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1693.274697 secs 2024-04-21T10:53:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:02 smithi077 ceph-mon[27902]: pgmap v1001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T10:53:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1693.274697 secs 2024-04-21T10:53:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:04 smithi191 ceph-mon[31636]: pgmap v1002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T10:53:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 1695.036293 secs 2024-04-21T10:53:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:04 smithi191 ceph-mon[31636]: slow request 1441.328175 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:04 smithi191 ceph-mon[31636]: slow request 1451.246371 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:04 smithi191 ceph-mon[31636]: slow request 1451.231500 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:04 smithi170 ceph-mon[31212]: pgmap v1002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T10:53:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 1695.036293 secs 2024-04-21T10:53:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:04 smithi170 ceph-mon[31212]: slow request 1441.328175 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:04 smithi170 ceph-mon[31212]: slow request 1451.246371 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:04 smithi170 ceph-mon[31212]: slow request 1451.231500 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:04 smithi077 ceph-mon[27902]: pgmap v1002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T10:53:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 1695.036293 secs 2024-04-21T10:53:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:04 smithi077 ceph-mon[27902]: slow request 1441.328175 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:04 smithi077 ceph-mon[27902]: slow request 1451.246371 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:04 smithi077 ceph-mon[27902]: slow request 1451.231500 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:53:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:05 smithi191 ceph-mon[31636]: osdmap e139: 12 total, 12 up, 12 in 2024-04-21T10:53:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:05 smithi170 ceph-mon[31212]: osdmap e139: 12 total, 12 up, 12 in 2024-04-21T10:53:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:05 smithi077 ceph-mon[27902]: osdmap e139: 12 total, 12 up, 12 in 2024-04-21T10:53:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:06 smithi191 ceph-mon[31636]: pgmap v1004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T10:53:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:06 smithi170 ceph-mon[31212]: pgmap v1004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T10:53:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:06 smithi077 ceph-mon[27902]: pgmap v1004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T10:53:07.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1698.274815 secs 2024-04-21T10:53:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1698.274815 secs 2024-04-21T10:53:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1698.274815 secs 2024-04-21T10:53:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:08 smithi191 ceph-mon[31636]: pgmap v1005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:53:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:08 smithi170 ceph-mon[31212]: pgmap v1005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:53:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:08 smithi077 ceph-mon[27902]: pgmap v1005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:53:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1700.036426 secs 2024-04-21T10:53:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1700.036426 secs 2024-04-21T10:53:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1700.036426 secs 2024-04-21T10:53:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:10 smithi191 ceph-mon[31636]: pgmap v1006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:53:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:53:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:10 smithi170 ceph-mon[31212]: pgmap v1006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:53:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:53:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:10 smithi077 ceph-mon[27902]: pgmap v1006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:53:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: pgmap v1007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:11 smithi191 ceph-mon[31636]: osdmap e140: 12 total, 12 up, 12 in 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: pgmap v1007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:11 smithi170 ceph-mon[31212]: osdmap e140: 12 total, 12 up, 12 in 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: pgmap v1007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:53:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:11 smithi077 ceph-mon[27902]: osdmap e140: 12 total, 12 up, 12 in 2024-04-21T10:53:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1703.274892 secs 2024-04-21T10:53:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1703.274892 secs 2024-04-21T10:53:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1703.274892 secs 2024-04-21T10:53:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:13 smithi191 ceph-mon[31636]: pgmap v1009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T10:53:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1705.036559 secs 2024-04-21T10:53:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:13 smithi170 ceph-mon[31212]: pgmap v1009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T10:53:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1705.036559 secs 2024-04-21T10:53:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:13 smithi077 ceph-mon[27902]: pgmap v1009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T10:53:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1705.036559 secs 2024-04-21T10:53:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:15 smithi191 ceph-mon[31636]: pgmap v1010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T10:53:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:15 smithi170 ceph-mon[31212]: pgmap v1010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T10:53:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:15 smithi077 ceph-mon[27902]: pgmap v1010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T10:53:17.937 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1708.275010 secs 2024-04-21T10:53:17.937 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:17 smithi077 ceph-mon[27902]: pgmap v1011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:53:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1708.275010 secs 2024-04-21T10:53:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:17 smithi191 ceph-mon[31636]: pgmap v1011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:53:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1708.275010 secs 2024-04-21T10:53:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:17 smithi170 ceph-mon[31212]: pgmap v1011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:53:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1710.036673 secs 2024-04-21T10:53:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1710.036673 secs 2024-04-21T10:53:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1710.036673 secs 2024-04-21T10:53:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:19 smithi191 ceph-mon[31636]: pgmap v1012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:53:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:19 smithi170 ceph-mon[31212]: pgmap v1012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:53:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:19 smithi077 ceph-mon[27902]: pgmap v1012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:53:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:21 smithi191 ceph-mon[31636]: pgmap v1013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:53:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1713.275145 secs 2024-04-21T10:53:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:21 smithi170 ceph-mon[31212]: pgmap v1013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:53:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1713.275145 secs 2024-04-21T10:53:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:21 smithi077 ceph-mon[27902]: pgmap v1013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:53:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1713.275145 secs 2024-04-21T10:53:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:23 smithi191 ceph-mon[31636]: pgmap v1014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:53:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1715.036775 secs 2024-04-21T10:53:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:23 smithi170 ceph-mon[31212]: pgmap v1014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:53:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1715.036775 secs 2024-04-21T10:53:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:23 smithi077 ceph-mon[27902]: pgmap v1014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:53:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1715.036775 secs 2024-04-21T10:53:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:25 smithi191 ceph-mon[31636]: pgmap v1015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:25 smithi170 ceph-mon[31212]: pgmap v1015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:25 smithi077 ceph-mon[27902]: pgmap v1015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1718.275279 secs 2024-04-21T10:53:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1718.275279 secs 2024-04-21T10:53:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1718.275279 secs 2024-04-21T10:53:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:27 smithi191 ceph-mon[31636]: pgmap v1016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:27 smithi170 ceph-mon[31212]: pgmap v1016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:27 smithi077 ceph-mon[27902]: pgmap v1016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1720.036892 secs 2024-04-21T10:53:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1720.036892 secs 2024-04-21T10:53:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1720.036892 secs 2024-04-21T10:53:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:29 smithi191 ceph-mon[31636]: pgmap v1017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:29 smithi170 ceph-mon[31212]: pgmap v1017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:29 smithi077 ceph-mon[27902]: pgmap v1017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:31 smithi191 ceph-mon[31636]: pgmap v1018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1723.275414 secs 2024-04-21T10:53:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:31 smithi170 ceph-mon[31212]: pgmap v1018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1723.275414 secs 2024-04-21T10:53:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:31 smithi077 ceph-mon[27902]: pgmap v1018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1723.275414 secs 2024-04-21T10:53:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:33 smithi191 ceph-mon[31636]: pgmap v1019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1725.037002 secs 2024-04-21T10:53:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:33 smithi170 ceph-mon[31212]: pgmap v1019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1725.037002 secs 2024-04-21T10:53:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:33 smithi077 ceph-mon[27902]: pgmap v1019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1725.037002 secs 2024-04-21T10:53:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:35 smithi191 ceph-mon[31636]: pgmap v1020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:35 smithi170 ceph-mon[31212]: pgmap v1020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:35 smithi077 ceph-mon[27902]: pgmap v1020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1728.275508 secs 2024-04-21T10:53:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1728.275508 secs 2024-04-21T10:53:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1728.275508 secs 2024-04-21T10:53:37.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:37 smithi170 ceph-mon[31212]: pgmap v1021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:37 smithi191 ceph-mon[31636]: pgmap v1021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:37 smithi077 ceph-mon[27902]: pgmap v1021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1730.037115 secs 2024-04-21T10:53:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1730.037115 secs 2024-04-21T10:53:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1730.037115 secs 2024-04-21T10:53:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:53:39.590+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:53:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:53:39.590+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:53:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:53:39.594+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:53:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:53:39.595+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:53:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:39 smithi191 ceph-mon[31636]: pgmap v1022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:39 smithi170 ceph-mon[31212]: pgmap v1022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:39 smithi077 ceph-mon[27902]: pgmap v1022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:41 smithi170 ceph-mon[31212]: pgmap v1023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1733.275629 secs 2024-04-21T10:53:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:41 smithi077 ceph-mon[27902]: pgmap v1023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1733.275629 secs 2024-04-21T10:53:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:41 smithi191 ceph-mon[31636]: pgmap v1023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1733.275629 secs 2024-04-21T10:53:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:43 smithi170 ceph-mon[31212]: pgmap v1024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1735.037216 secs 2024-04-21T10:53:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:43 smithi077 ceph-mon[27902]: pgmap v1024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1735.037216 secs 2024-04-21T10:53:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:43 smithi191 ceph-mon[31636]: pgmap v1024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1735.037216 secs 2024-04-21T10:53:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:45 smithi170 ceph-mon[31212]: pgmap v1025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:45 smithi077 ceph-mon[27902]: pgmap v1025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:45 smithi191 ceph-mon[31636]: pgmap v1025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:47.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1738.275736 secs 2024-04-21T10:53:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1738.275736 secs 2024-04-21T10:53:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1738.275736 secs 2024-04-21T10:53:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:47 smithi170 ceph-mon[31212]: pgmap v1026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:47 smithi077 ceph-mon[27902]: pgmap v1026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:47 smithi191 ceph-mon[31636]: pgmap v1026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1740.037331 secs 2024-04-21T10:53:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1740.037331 secs 2024-04-21T10:53:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1740.037331 secs 2024-04-21T10:53:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:49 smithi170 ceph-mon[31212]: pgmap v1027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:49 smithi077 ceph-mon[27902]: pgmap v1027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:49 smithi191 ceph-mon[31636]: pgmap v1027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:51 smithi170 ceph-mon[31212]: pgmap v1028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1743.275852 secs 2024-04-21T10:53:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:51 smithi077 ceph-mon[27902]: pgmap v1028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1743.275852 secs 2024-04-21T10:53:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:51 smithi191 ceph-mon[31636]: pgmap v1028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1743.275852 secs 2024-04-21T10:53:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:53 smithi170 ceph-mon[31212]: pgmap v1029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1745.037455 secs 2024-04-21T10:53:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:53 smithi077 ceph-mon[27902]: pgmap v1029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1745.037455 secs 2024-04-21T10:53:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:53 smithi191 ceph-mon[31636]: pgmap v1029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1745.037455 secs 2024-04-21T10:53:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:53:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:55 smithi170 ceph-mon[31212]: pgmap v1030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:55 smithi077 ceph-mon[27902]: pgmap v1030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:55 smithi191 ceph-mon[31636]: pgmap v1030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:53:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1748.275998 secs 2024-04-21T10:53:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1748.275998 secs 2024-04-21T10:53:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1748.275998 secs 2024-04-21T10:53:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:57 smithi170 ceph-mon[31212]: pgmap v1031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:57 smithi077 ceph-mon[27902]: pgmap v1031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:57 smithi191 ceph-mon[31636]: pgmap v1031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:53:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1750.037562 secs 2024-04-21T10:53:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1750.037562 secs 2024-04-21T10:53:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1750.037562 secs 2024-04-21T10:54:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:53:59 smithi170 ceph-mon[31212]: pgmap v1032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:53:59 smithi077 ceph-mon[27902]: pgmap v1032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:53:59 smithi191 ceph-mon[31636]: pgmap v1032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:01 smithi170 ceph-mon[31212]: pgmap v1033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T10:54:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1753.276191 secs 2024-04-21T10:54:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:01 smithi077 ceph-mon[27902]: pgmap v1033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T10:54:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1753.276191 secs 2024-04-21T10:54:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:01 smithi191 ceph-mon[31636]: pgmap v1033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T10:54:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1753.276191 secs 2024-04-21T10:54:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:03 smithi170 ceph-mon[31212]: pgmap v1034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T10:54:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1755.037699 secs 2024-04-21T10:54:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:03 smithi077 ceph-mon[27902]: pgmap v1034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T10:54:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1755.037699 secs 2024-04-21T10:54:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:03 smithi191 ceph-mon[31636]: pgmap v1034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T10:54:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1755.037699 secs 2024-04-21T10:54:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:04 smithi170 ceph-mon[31212]: osdmap e141: 12 total, 12 up, 12 in 2024-04-21T10:54:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:04 smithi077 ceph-mon[27902]: osdmap e141: 12 total, 12 up, 12 in 2024-04-21T10:54:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:04 smithi191 ceph-mon[31636]: osdmap e141: 12 total, 12 up, 12 in 2024-04-21T10:54:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:05 smithi170 ceph-mon[31212]: pgmap v1036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T10:54:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:05 smithi077 ceph-mon[27902]: pgmap v1036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T10:54:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:05 smithi191 ceph-mon[31636]: pgmap v1036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T10:54:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1758.276346 secs 2024-04-21T10:54:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1758.276346 secs 2024-04-21T10:54:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1758.276346 secs 2024-04-21T10:54:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:07 smithi170 ceph-mon[31212]: pgmap v1037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:54:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:07 smithi077 ceph-mon[27902]: pgmap v1037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:54:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:07 smithi191 ceph-mon[31636]: pgmap v1037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:54:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1760.037816 secs 2024-04-21T10:54:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1760.037816 secs 2024-04-21T10:54:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1760.037816 secs 2024-04-21T10:54:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:09 smithi170 ceph-mon[31212]: pgmap v1038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:54:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:09 smithi077 ceph-mon[27902]: pgmap v1038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:54:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:09 smithi191 ceph-mon[31636]: pgmap v1038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:54:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:11 smithi170 ceph-mon[31212]: pgmap v1039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T10:54:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1763.276484 secs 2024-04-21T10:54:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:11 smithi170 ceph-mon[31212]: osdmap e142: 12 total, 12 up, 12 in 2024-04-21T10:54:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:54:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:11 smithi077 ceph-mon[27902]: pgmap v1039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T10:54:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1763.276484 secs 2024-04-21T10:54:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:11 smithi077 ceph-mon[27902]: osdmap e142: 12 total, 12 up, 12 in 2024-04-21T10:54:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:54:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:11 smithi191 ceph-mon[31636]: pgmap v1039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T10:54:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1763.276484 secs 2024-04-21T10:54:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:11 smithi191 ceph-mon[31636]: osdmap e142: 12 total, 12 up, 12 in 2024-04-21T10:54:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:54:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:54:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:54:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:14 smithi170 ceph-mon[31212]: pgmap v1041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 25 op/s 2024-04-21T10:54:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1765.037929 secs 2024-04-21T10:54:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:14 smithi077 ceph-mon[27902]: pgmap v1041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 25 op/s 2024-04-21T10:54:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1765.037929 secs 2024-04-21T10:54:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:14 smithi191 ceph-mon[31636]: pgmap v1041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 25 op/s 2024-04-21T10:54:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1765.037929 secs 2024-04-21T10:54:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:16 smithi170 ceph-mon[31212]: pgmap v1042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T10:54:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:16 smithi077 ceph-mon[27902]: pgmap v1042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T10:54:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:16 smithi191 ceph-mon[31636]: pgmap v1042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T10:54:17.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1768.276598 secs 2024-04-21T10:54:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1768.276598 secs 2024-04-21T10:54:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1768.276598 secs 2024-04-21T10:54:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:18 smithi170 ceph-mon[31212]: pgmap v1043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:54:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:18 smithi077 ceph-mon[27902]: pgmap v1043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:54:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:18 smithi191 ceph-mon[31636]: pgmap v1043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:54:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1770.038046 secs 2024-04-21T10:54:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1770.038046 secs 2024-04-21T10:54:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1770.038046 secs 2024-04-21T10:54:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:20 smithi170 ceph-mon[31212]: pgmap v1044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:54:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:20 smithi077 ceph-mon[27902]: pgmap v1044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:54:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:20 smithi191 ceph-mon[31636]: pgmap v1044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:54:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:22 smithi170 ceph-mon[31212]: pgmap v1045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:54:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1773.276724 secs 2024-04-21T10:54:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:22 smithi077 ceph-mon[27902]: pgmap v1045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:54:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1773.276724 secs 2024-04-21T10:54:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:22 smithi191 ceph-mon[31636]: pgmap v1045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:54:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1773.276724 secs 2024-04-21T10:54:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:24 smithi170 ceph-mon[31212]: pgmap v1046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:54:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1775.038110 secs 2024-04-21T10:54:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:24 smithi077 ceph-mon[27902]: pgmap v1046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:54:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1775.038110 secs 2024-04-21T10:54:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:24 smithi191 ceph-mon[31636]: pgmap v1046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:54:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1775.038110 secs 2024-04-21T10:54:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:26 smithi170 ceph-mon[31212]: pgmap v1047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:26 smithi077 ceph-mon[27902]: pgmap v1047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:26 smithi191 ceph-mon[31636]: pgmap v1047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1778.276857 secs 2024-04-21T10:54:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1778.276857 secs 2024-04-21T10:54:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1778.276857 secs 2024-04-21T10:54:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:28 smithi170 ceph-mon[31212]: pgmap v1048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:28 smithi077 ceph-mon[27902]: pgmap v1048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:28 smithi191 ceph-mon[31636]: pgmap v1048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1780.038228 secs 2024-04-21T10:54:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1780.038228 secs 2024-04-21T10:54:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1780.038228 secs 2024-04-21T10:54:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:30 smithi077 ceph-mon[27902]: pgmap v1049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:30 smithi191 ceph-mon[31636]: pgmap v1049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:30 smithi170 ceph-mon[31212]: pgmap v1049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:32 smithi077 ceph-mon[27902]: pgmap v1050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1783.276926 secs 2024-04-21T10:54:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:32 smithi191 ceph-mon[31636]: pgmap v1050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1783.276926 secs 2024-04-21T10:54:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:32 smithi170 ceph-mon[31212]: pgmap v1050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1783.276926 secs 2024-04-21T10:54:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:34 smithi077 ceph-mon[27902]: pgmap v1051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1785.038340 secs 2024-04-21T10:54:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:34 smithi191 ceph-mon[31636]: pgmap v1051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1785.038340 secs 2024-04-21T10:54:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:34 smithi170 ceph-mon[31212]: pgmap v1051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1785.038340 secs 2024-04-21T10:54:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:36 smithi077 ceph-mon[27902]: pgmap v1052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:36 smithi191 ceph-mon[31636]: pgmap v1052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:36 smithi170 ceph-mon[31212]: pgmap v1052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1788.277051 secs 2024-04-21T10:54:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1788.277051 secs 2024-04-21T10:54:37.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1788.277051 secs 2024-04-21T10:54:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:38 smithi077 ceph-mon[27902]: pgmap v1053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:38 smithi191 ceph-mon[31636]: pgmap v1053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:38 smithi170 ceph-mon[31212]: pgmap v1053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1790.038454 secs 2024-04-21T10:54:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1790.038454 secs 2024-04-21T10:54:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1790.038454 secs 2024-04-21T10:54:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:40 smithi077 ceph-mon[27902]: pgmap v1054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:40 smithi191 ceph-mon[31636]: pgmap v1054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:40 smithi170 ceph-mon[31212]: pgmap v1054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:42 smithi077 ceph-mon[27902]: pgmap v1055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1793.277184 secs 2024-04-21T10:54:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:42 smithi191 ceph-mon[31636]: pgmap v1055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1793.277184 secs 2024-04-21T10:54:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:42 smithi170 ceph-mon[31212]: pgmap v1055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1793.277184 secs 2024-04-21T10:54:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:44 smithi077 ceph-mon[27902]: pgmap v1056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1795.038572 secs 2024-04-21T10:54:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:44 smithi191 ceph-mon[31636]: pgmap v1056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1795.038572 secs 2024-04-21T10:54:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:44 smithi170 ceph-mon[31212]: pgmap v1056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1795.038572 secs 2024-04-21T10:54:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:46 smithi077 ceph-mon[27902]: pgmap v1057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:46 smithi191 ceph-mon[31636]: pgmap v1057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:46 smithi170 ceph-mon[31212]: pgmap v1057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1798.277260 secs 2024-04-21T10:54:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1798.277260 secs 2024-04-21T10:54:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1798.277260 secs 2024-04-21T10:54:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:48 smithi077 ceph-mon[27902]: pgmap v1058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:48 smithi191 ceph-mon[31636]: pgmap v1058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:48 smithi170 ceph-mon[31212]: pgmap v1058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1800.038692 secs 2024-04-21T10:54:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1800.038692 secs 2024-04-21T10:54:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1800.038692 secs 2024-04-21T10:54:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:50 smithi077 ceph-mon[27902]: pgmap v1059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:50 smithi191 ceph-mon[31636]: pgmap v1059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:50 smithi170 ceph-mon[31212]: pgmap v1059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:52 smithi077 ceph-mon[27902]: pgmap v1060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1803.277377 secs 2024-04-21T10:54:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:52 smithi191 ceph-mon[31636]: pgmap v1060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1803.277377 secs 2024-04-21T10:54:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:52 smithi170 ceph-mon[31212]: pgmap v1060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1803.277377 secs 2024-04-21T10:54:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:54 smithi077 ceph-mon[27902]: pgmap v1061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1805.038810 secs 2024-04-21T10:54:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:54 smithi191 ceph-mon[31636]: pgmap v1061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1805.038810 secs 2024-04-21T10:54:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:54 smithi170 ceph-mon[31212]: pgmap v1061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1805.038810 secs 2024-04-21T10:54:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:54:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:56 smithi077 ceph-mon[27902]: pgmap v1062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:56 smithi191 ceph-mon[31636]: pgmap v1062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:56 smithi170 ceph-mon[31212]: pgmap v1062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:54:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1808.277498 secs 2024-04-21T10:54:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1808.277498 secs 2024-04-21T10:54:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1808.277498 secs 2024-04-21T10:54:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:58 smithi077 ceph-mon[27902]: pgmap v1063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:58 smithi191 ceph-mon[31636]: pgmap v1063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:58 smithi170 ceph-mon[31212]: pgmap v1063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:54:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:54:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1810.038906 secs 2024-04-21T10:54:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:54:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1810.038906 secs 2024-04-21T10:54:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:54:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1810.038906 secs 2024-04-21T10:55:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 1995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:00 smithi077 ceph-mon[27902]: pgmap v1064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:00 smithi191 ceph-mon[31636]: pgmap v1064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:00 smithi170 ceph-mon[31212]: pgmap v1064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:02 smithi077 ceph-mon[27902]: pgmap v1065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T10:55:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1813.277643 secs 2024-04-21T10:55:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:02 smithi191 ceph-mon[31636]: pgmap v1065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T10:55:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1813.277643 secs 2024-04-21T10:55:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:02 smithi170 ceph-mon[31212]: pgmap v1065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T10:55:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1813.277643 secs 2024-04-21T10:55:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:04 smithi191 ceph-mon[31636]: pgmap v1066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T10:55:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1815.039053 secs 2024-04-21T10:55:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:04 smithi170 ceph-mon[31212]: pgmap v1066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T10:55:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1815.039053 secs 2024-04-21T10:55:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:04 smithi077 ceph-mon[27902]: pgmap v1066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T10:55:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1815.039053 secs 2024-04-21T10:55:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:05 smithi191 ceph-mon[31636]: osdmap e143: 12 total, 12 up, 12 in 2024-04-21T10:55:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:05 smithi170 ceph-mon[31212]: osdmap e143: 12 total, 12 up, 12 in 2024-04-21T10:55:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:05 smithi077 ceph-mon[27902]: osdmap e143: 12 total, 12 up, 12 in 2024-04-21T10:55:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:06 smithi191 ceph-mon[31636]: pgmap v1068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T10:55:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:06 smithi170 ceph-mon[31212]: pgmap v1068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T10:55:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:06 smithi077 ceph-mon[27902]: pgmap v1068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T10:55:07.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1818.277800 secs 2024-04-21T10:55:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1818.277800 secs 2024-04-21T10:55:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1818.277800 secs 2024-04-21T10:55:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:08 smithi191 ceph-mon[31636]: pgmap v1069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:55:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:08 smithi170 ceph-mon[31212]: pgmap v1069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:55:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:08 smithi077 ceph-mon[27902]: pgmap v1069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:55:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1820.039177 secs 2024-04-21T10:55:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1820.039177 secs 2024-04-21T10:55:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1820.039177 secs 2024-04-21T10:55:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:10 smithi191 ceph-mon[31636]: pgmap v1070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:55:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:10 smithi170 ceph-mon[31212]: pgmap v1070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:55:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:10 smithi077 ceph-mon[27902]: pgmap v1070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:55:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:12 smithi191 ceph-mon[31636]: pgmap v1071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:55:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1823.277881 secs 2024-04-21T10:55:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:12 smithi191 ceph-mon[31636]: osdmap e144: 12 total, 12 up, 12 in 2024-04-21T10:55:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:12 smithi170 ceph-mon[31212]: pgmap v1071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:55:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1823.277881 secs 2024-04-21T10:55:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:12 smithi170 ceph-mon[31212]: osdmap e144: 12 total, 12 up, 12 in 2024-04-21T10:55:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:12 smithi077 ceph-mon[27902]: pgmap v1071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:55:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1823.277881 secs 2024-04-21T10:55:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:12 smithi077 ceph-mon[27902]: osdmap e144: 12 total, 12 up, 12 in 2024-04-21T10:55:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:55:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:55:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:55:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:14 smithi191 ceph-mon[31636]: pgmap v1073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 30 op/s 2024-04-21T10:55:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1825.039253 secs 2024-04-21T10:55:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:55:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:55:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:55:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:14 smithi170 ceph-mon[31212]: pgmap v1073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 30 op/s 2024-04-21T10:55:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1825.039253 secs 2024-04-21T10:55:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:55:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:55:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:55:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:14 smithi077 ceph-mon[27902]: pgmap v1073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 30 op/s 2024-04-21T10:55:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1825.039253 secs 2024-04-21T10:55:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:55:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:55:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:55:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:16 smithi191 ceph-mon[31636]: pgmap v1074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:55:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:16 smithi170 ceph-mon[31212]: pgmap v1074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:55:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:16 smithi077 ceph-mon[27902]: pgmap v1074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T10:55:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1828.277962 secs 2024-04-21T10:55:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:17 smithi191 ceph-mon[31636]: pgmap v1075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:55:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1828.277962 secs 2024-04-21T10:55:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:17 smithi170 ceph-mon[31212]: pgmap v1075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:55:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1828.277962 secs 2024-04-21T10:55:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:17 smithi077 ceph-mon[27902]: pgmap v1075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:55:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1830.039392 secs 2024-04-21T10:55:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1830.039392 secs 2024-04-21T10:55:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1830.039392 secs 2024-04-21T10:55:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:19 smithi191 ceph-mon[31636]: pgmap v1076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:55:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:19 smithi170 ceph-mon[31212]: pgmap v1076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:55:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:19 smithi077 ceph-mon[27902]: pgmap v1076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:55:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:21 smithi170 ceph-mon[31212]: pgmap v1077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:55:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1833.278081 secs 2024-04-21T10:55:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:21 smithi077 ceph-mon[27902]: pgmap v1077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:55:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1833.278081 secs 2024-04-21T10:55:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:21 smithi191 ceph-mon[31636]: pgmap v1077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:55:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1833.278081 secs 2024-04-21T10:55:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:23 smithi170 ceph-mon[31212]: pgmap v1078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:55:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1835.039458 secs 2024-04-21T10:55:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:23 smithi077 ceph-mon[27902]: pgmap v1078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:55:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1835.039458 secs 2024-04-21T10:55:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:23 smithi191 ceph-mon[31636]: pgmap v1078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:55:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1835.039458 secs 2024-04-21T10:55:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:25 smithi170 ceph-mon[31212]: pgmap v1079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:25 smithi077 ceph-mon[27902]: pgmap v1079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:25 smithi191 ceph-mon[31636]: pgmap v1079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1838.278198 secs 2024-04-21T10:55:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1838.278198 secs 2024-04-21T10:55:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1838.278198 secs 2024-04-21T10:55:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:27 smithi170 ceph-mon[31212]: pgmap v1080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:27 smithi077 ceph-mon[27902]: pgmap v1080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:27 smithi191 ceph-mon[31636]: pgmap v1080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1840.039567 secs 2024-04-21T10:55:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1840.039567 secs 2024-04-21T10:55:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1840.039567 secs 2024-04-21T10:55:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:29 smithi170 ceph-mon[31212]: pgmap v1081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:29 smithi077 ceph-mon[27902]: pgmap v1081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:29 smithi191 ceph-mon[31636]: pgmap v1081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:31 smithi170 ceph-mon[31212]: pgmap v1082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1843.278340 secs 2024-04-21T10:55:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:31 smithi077 ceph-mon[27902]: pgmap v1082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1843.278340 secs 2024-04-21T10:55:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:31 smithi191 ceph-mon[31636]: pgmap v1082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1843.278340 secs 2024-04-21T10:55:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:33 smithi170 ceph-mon[31212]: pgmap v1083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1845.039678 secs 2024-04-21T10:55:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:33 smithi077 ceph-mon[27902]: pgmap v1083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1845.039678 secs 2024-04-21T10:55:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:33 smithi191 ceph-mon[31636]: pgmap v1083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1845.039678 secs 2024-04-21T10:55:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:35 smithi170 ceph-mon[31212]: pgmap v1084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:35 smithi077 ceph-mon[27902]: pgmap v1084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:35 smithi191 ceph-mon[31636]: pgmap v1084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1848.278465 secs 2024-04-21T10:55:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1848.278465 secs 2024-04-21T10:55:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1848.278465 secs 2024-04-21T10:55:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:37 smithi170 ceph-mon[31212]: pgmap v1085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:37 smithi077 ceph-mon[27902]: pgmap v1085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:37 smithi191 ceph-mon[31636]: pgmap v1085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1850.039797 secs 2024-04-21T10:55:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1850.039797 secs 2024-04-21T10:55:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1850.039797 secs 2024-04-21T10:55:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:39 smithi170 ceph-mon[31212]: pgmap v1086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:39 smithi077 ceph-mon[27902]: pgmap v1086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:39 smithi191 ceph-mon[31636]: pgmap v1086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:41 smithi170 ceph-mon[31212]: pgmap v1087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1853.278528 secs 2024-04-21T10:55:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:41 smithi077 ceph-mon[27902]: pgmap v1087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1853.278528 secs 2024-04-21T10:55:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:41 smithi191 ceph-mon[31636]: pgmap v1087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1853.278528 secs 2024-04-21T10:55:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:43 smithi170 ceph-mon[31212]: pgmap v1088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:43 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 1855.039913 secs 2024-04-21T10:55:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:43 smithi170 ceph-mon[31212]: slow request 1443.304114 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:55:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:43 smithi077 ceph-mon[27902]: pgmap v1088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:43 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 1855.039913 secs 2024-04-21T10:55:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:43 smithi077 ceph-mon[27902]: slow request 1443.304114 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:55:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:43 smithi191 ceph-mon[31636]: pgmap v1088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:43 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 1855.039913 secs 2024-04-21T10:55:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:43 smithi191 ceph-mon[31636]: slow request 1443.304114 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T10:55:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:45 smithi170 ceph-mon[31212]: pgmap v1089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:45 smithi077 ceph-mon[27902]: pgmap v1089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:45 smithi191 ceph-mon[31636]: pgmap v1089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1858.278665 secs 2024-04-21T10:55:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1858.278665 secs 2024-04-21T10:55:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1858.278665 secs 2024-04-21T10:55:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:47 smithi170 ceph-mon[31212]: pgmap v1090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:47 smithi077 ceph-mon[27902]: pgmap v1090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:47 smithi191 ceph-mon[31636]: pgmap v1090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1860.040032 secs 2024-04-21T10:55:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1860.040032 secs 2024-04-21T10:55:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1860.040032 secs 2024-04-21T10:55:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:49 smithi077 ceph-mon[27902]: pgmap v1091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:49 smithi191 ceph-mon[31636]: pgmap v1091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:49 smithi170 ceph-mon[31212]: pgmap v1091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:51 smithi077 ceph-mon[27902]: pgmap v1092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1863.278813 secs 2024-04-21T10:55:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:51 smithi191 ceph-mon[31636]: pgmap v1092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1863.278813 secs 2024-04-21T10:55:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:51 smithi170 ceph-mon[31212]: pgmap v1092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1863.278813 secs 2024-04-21T10:55:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:53 smithi077 ceph-mon[27902]: pgmap v1093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1865.040148 secs 2024-04-21T10:55:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:53 smithi191 ceph-mon[31636]: pgmap v1093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1865.040148 secs 2024-04-21T10:55:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:53 smithi170 ceph-mon[31212]: pgmap v1093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1865.040148 secs 2024-04-21T10:55:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:55:54.609+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:55:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:55:54.609+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:55:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:55:54.611+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:55:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:55:54.612+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:55:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:55:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:55 smithi077 ceph-mon[27902]: pgmap v1094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:55 smithi191 ceph-mon[31636]: pgmap v1094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:55 smithi170 ceph-mon[31212]: pgmap v1094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:55:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1868.278922 secs 2024-04-21T10:55:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1868.278922 secs 2024-04-21T10:55:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1868.278922 secs 2024-04-21T10:55:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:57 smithi077 ceph-mon[27902]: pgmap v1095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:57 smithi191 ceph-mon[31636]: pgmap v1095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:57 smithi170 ceph-mon[31212]: pgmap v1095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:55:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1870.040259 secs 2024-04-21T10:55:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1870.040259 secs 2024-04-21T10:55:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1870.040259 secs 2024-04-21T10:56:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:55:59 smithi077 ceph-mon[27902]: pgmap v1096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:55:59 smithi191 ceph-mon[31636]: pgmap v1096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:55:59 smithi170 ceph-mon[31212]: pgmap v1096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:01 smithi077 ceph-mon[27902]: pgmap v1097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1873.279002 secs 2024-04-21T10:56:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:01 smithi191 ceph-mon[31636]: pgmap v1097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1873.279002 secs 2024-04-21T10:56:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:01 smithi170 ceph-mon[31212]: pgmap v1097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1873.279002 secs 2024-04-21T10:56:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:03 smithi077 ceph-mon[27902]: pgmap v1098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1875.040384 secs 2024-04-21T10:56:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:03 smithi191 ceph-mon[31636]: pgmap v1098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1875.040384 secs 2024-04-21T10:56:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:03 smithi170 ceph-mon[31212]: pgmap v1098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1875.040384 secs 2024-04-21T10:56:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:04 smithi077 ceph-mon[27902]: osdmap e145: 12 total, 12 up, 12 in 2024-04-21T10:56:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:04 smithi191 ceph-mon[31636]: osdmap e145: 12 total, 12 up, 12 in 2024-04-21T10:56:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:04 smithi170 ceph-mon[31212]: osdmap e145: 12 total, 12 up, 12 in 2024-04-21T10:56:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:05 smithi077 ceph-mon[27902]: pgmap v1100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:56:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:05 smithi191 ceph-mon[31636]: pgmap v1100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:56:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:05 smithi170 ceph-mon[31212]: pgmap v1100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:56:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1878.279086 secs 2024-04-21T10:56:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1878.279086 secs 2024-04-21T10:56:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1878.279086 secs 2024-04-21T10:56:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:07 smithi077 ceph-mon[27902]: pgmap v1101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:56:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:07 smithi191 ceph-mon[31636]: pgmap v1101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:56:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:07 smithi170 ceph-mon[31212]: pgmap v1101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:56:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1880.040475 secs 2024-04-21T10:56:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1880.040475 secs 2024-04-21T10:56:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1880.040475 secs 2024-04-21T10:56:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:09 smithi077 ceph-mon[27902]: pgmap v1102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:56:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:09 smithi191 ceph-mon[31636]: pgmap v1102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:56:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:09 smithi170 ceph-mon[31212]: pgmap v1102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:56:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:11 smithi077 ceph-mon[27902]: pgmap v1103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:56:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1883.279208 secs 2024-04-21T10:56:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:11 smithi077 ceph-mon[27902]: osdmap e146: 12 total, 12 up, 12 in 2024-04-21T10:56:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:11 smithi191 ceph-mon[31636]: pgmap v1103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:56:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1883.279208 secs 2024-04-21T10:56:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:11 smithi191 ceph-mon[31636]: osdmap e146: 12 total, 12 up, 12 in 2024-04-21T10:56:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:11 smithi170 ceph-mon[31212]: pgmap v1103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:56:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1883.279208 secs 2024-04-21T10:56:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:11 smithi170 ceph-mon[31212]: osdmap e146: 12 total, 12 up, 12 in 2024-04-21T10:56:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:13 smithi077 ceph-mon[27902]: pgmap v1105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:56:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1885.040594 secs 2024-04-21T10:56:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:56:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:13 smithi191 ceph-mon[31636]: pgmap v1105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:56:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1885.040594 secs 2024-04-21T10:56:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:56:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:13 smithi170 ceph-mon[31212]: pgmap v1105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:56:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1885.040594 secs 2024-04-21T10:56:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:56:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:56:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:56:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:56:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:56:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:56:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:56:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:56:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:56:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:56:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:16 smithi170 ceph-mon[31212]: pgmap v1106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:56:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:16 smithi077 ceph-mon[27902]: pgmap v1106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:56:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:16 smithi191 ceph-mon[31636]: pgmap v1106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:56:17.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1888.279329 secs 2024-04-21T10:56:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1888.279329 secs 2024-04-21T10:56:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1888.279329 secs 2024-04-21T10:56:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:18 smithi170 ceph-mon[31212]: pgmap v1107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:56:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:18 smithi077 ceph-mon[27902]: pgmap v1107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:56:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:18 smithi191 ceph-mon[31636]: pgmap v1107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:56:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1890.040731 secs 2024-04-21T10:56:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1890.040731 secs 2024-04-21T10:56:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1890.040731 secs 2024-04-21T10:56:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:20 smithi170 ceph-mon[31212]: pgmap v1108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:56:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:20 smithi077 ceph-mon[27902]: pgmap v1108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:56:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:20 smithi191 ceph-mon[31636]: pgmap v1108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:56:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:22 smithi170 ceph-mon[31212]: pgmap v1109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:56:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1893.279459 secs 2024-04-21T10:56:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:22 smithi077 ceph-mon[27902]: pgmap v1109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:56:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1893.279459 secs 2024-04-21T10:56:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:22 smithi191 ceph-mon[31636]: pgmap v1109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:56:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1893.279459 secs 2024-04-21T10:56:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:24 smithi170 ceph-mon[31212]: pgmap v1110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:56:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1895.040887 secs 2024-04-21T10:56:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:24 smithi077 ceph-mon[27902]: pgmap v1110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:56:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1895.040887 secs 2024-04-21T10:56:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:24 smithi191 ceph-mon[31636]: pgmap v1110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:56:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1895.040887 secs 2024-04-21T10:56:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:26 smithi170 ceph-mon[31212]: pgmap v1111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:26 smithi077 ceph-mon[27902]: pgmap v1111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:26 smithi191 ceph-mon[31636]: pgmap v1111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1898.279600 secs 2024-04-21T10:56:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1898.279600 secs 2024-04-21T10:56:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1898.279600 secs 2024-04-21T10:56:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:28 smithi170 ceph-mon[31212]: pgmap v1112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:28 smithi077 ceph-mon[27902]: pgmap v1112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:28 smithi191 ceph-mon[31636]: pgmap v1112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1900.041002 secs 2024-04-21T10:56:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1900.041002 secs 2024-04-21T10:56:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1900.041002 secs 2024-04-21T10:56:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:30 smithi170 ceph-mon[31212]: pgmap v1113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:30 smithi077 ceph-mon[27902]: pgmap v1113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:30 smithi191 ceph-mon[31636]: pgmap v1113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:32 smithi170 ceph-mon[31212]: pgmap v1114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1903.279747 secs 2024-04-21T10:56:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:32 smithi077 ceph-mon[27902]: pgmap v1114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1903.279747 secs 2024-04-21T10:56:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:32 smithi191 ceph-mon[31636]: pgmap v1114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1903.279747 secs 2024-04-21T10:56:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:34 smithi170 ceph-mon[31212]: pgmap v1115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1905.041119 secs 2024-04-21T10:56:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:34 smithi077 ceph-mon[27902]: pgmap v1115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1905.041119 secs 2024-04-21T10:56:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:34 smithi191 ceph-mon[31636]: pgmap v1115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1905.041119 secs 2024-04-21T10:56:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:36 smithi170 ceph-mon[31212]: pgmap v1116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:36 smithi077 ceph-mon[27902]: pgmap v1116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:36 smithi191 ceph-mon[31636]: pgmap v1116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1908.279865 secs 2024-04-21T10:56:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1908.279865 secs 2024-04-21T10:56:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1908.279865 secs 2024-04-21T10:56:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:38 smithi170 ceph-mon[31212]: pgmap v1117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:38 smithi077 ceph-mon[27902]: pgmap v1117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:38 smithi191 ceph-mon[31636]: pgmap v1117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1910.041228 secs 2024-04-21T10:56:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1910.041228 secs 2024-04-21T10:56:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1910.041228 secs 2024-04-21T10:56:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:40 smithi170 ceph-mon[31212]: pgmap v1118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:40 smithi077 ceph-mon[27902]: pgmap v1118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:40 smithi191 ceph-mon[31636]: pgmap v1118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:42 smithi170 ceph-mon[31212]: pgmap v1119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1913.279987 secs 2024-04-21T10:56:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:42 smithi077 ceph-mon[27902]: pgmap v1119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1913.279987 secs 2024-04-21T10:56:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:42 smithi191 ceph-mon[31636]: pgmap v1119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1913.279987 secs 2024-04-21T10:56:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:44 smithi170 ceph-mon[31212]: pgmap v1120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1915.041357 secs 2024-04-21T10:56:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:44 smithi077 ceph-mon[27902]: pgmap v1120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1915.041357 secs 2024-04-21T10:56:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:44 smithi191 ceph-mon[31636]: pgmap v1120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1915.041357 secs 2024-04-21T10:56:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:46 smithi170 ceph-mon[31212]: pgmap v1121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:46 smithi077 ceph-mon[27902]: pgmap v1121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:46 smithi191 ceph-mon[31636]: pgmap v1121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1918.280052 secs 2024-04-21T10:56:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:47 smithi077 ceph-mon[27902]: pgmap v1122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1918.280052 secs 2024-04-21T10:56:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:47 smithi191 ceph-mon[31636]: pgmap v1122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1918.280052 secs 2024-04-21T10:56:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:47 smithi170 ceph-mon[31212]: pgmap v1122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1920.041493 secs 2024-04-21T10:56:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1920.041493 secs 2024-04-21T10:56:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1920.041493 secs 2024-04-21T10:56:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:49 smithi170 ceph-mon[31212]: pgmap v1123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:49 smithi077 ceph-mon[27902]: pgmap v1123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:49 smithi191 ceph-mon[31636]: pgmap v1123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:51 smithi170 ceph-mon[31212]: pgmap v1124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1923.280131 secs 2024-04-21T10:56:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:51 smithi077 ceph-mon[27902]: pgmap v1124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1923.280131 secs 2024-04-21T10:56:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:51 smithi191 ceph-mon[31636]: pgmap v1124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1923.280131 secs 2024-04-21T10:56:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:53 smithi170 ceph-mon[31212]: pgmap v1125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1925.041643 secs 2024-04-21T10:56:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:53 smithi077 ceph-mon[27902]: pgmap v1125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1925.041643 secs 2024-04-21T10:56:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:53 smithi191 ceph-mon[31636]: pgmap v1125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1925.041643 secs 2024-04-21T10:56:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:56:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:55 smithi170 ceph-mon[31212]: pgmap v1126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:55 smithi077 ceph-mon[27902]: pgmap v1126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:55 smithi191 ceph-mon[31636]: pgmap v1126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:56:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1928.280264 secs 2024-04-21T10:56:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1928.280264 secs 2024-04-21T10:56:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1928.280264 secs 2024-04-21T10:56:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:57 smithi170 ceph-mon[31212]: pgmap v1127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:57 smithi077 ceph-mon[27902]: pgmap v1127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:57 smithi191 ceph-mon[31636]: pgmap v1127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:56:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1930.041786 secs 2024-04-21T10:56:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1930.041786 secs 2024-04-21T10:56:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1930.041786 secs 2024-04-21T10:57:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:56:59 smithi170 ceph-mon[31212]: pgmap v1128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:56:59 smithi077 ceph-mon[27902]: pgmap v1128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:56:59 smithi191 ceph-mon[31636]: pgmap v1128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:01 smithi170 ceph-mon[31212]: pgmap v1129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1933.280343 secs 2024-04-21T10:57:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:01 smithi077 ceph-mon[27902]: pgmap v1129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1933.280343 secs 2024-04-21T10:57:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:01 smithi191 ceph-mon[31636]: pgmap v1129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:02.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1933.280343 secs 2024-04-21T10:57:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:03 smithi170 ceph-mon[31212]: pgmap v1130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1935.041928 secs 2024-04-21T10:57:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:03 smithi077 ceph-mon[27902]: pgmap v1130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1935.041928 secs 2024-04-21T10:57:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:03 smithi191 ceph-mon[31636]: pgmap v1130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1935.041928 secs 2024-04-21T10:57:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:04 smithi170 ceph-mon[31212]: osdmap e147: 12 total, 12 up, 12 in 2024-04-21T10:57:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:04 smithi077 ceph-mon[27902]: osdmap e147: 12 total, 12 up, 12 in 2024-04-21T10:57:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:04 smithi191 ceph-mon[31636]: osdmap e147: 12 total, 12 up, 12 in 2024-04-21T10:57:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:05 smithi077 ceph-mon[27902]: pgmap v1132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:57:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:05 smithi191 ceph-mon[31636]: pgmap v1132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:57:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:05 smithi170 ceph-mon[31212]: pgmap v1132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:57:07.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1938.280449 secs 2024-04-21T10:57:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1938.280449 secs 2024-04-21T10:57:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1938.280449 secs 2024-04-21T10:57:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:07 smithi077 ceph-mon[27902]: pgmap v1133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:07 smithi191 ceph-mon[31636]: pgmap v1133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:07 smithi170 ceph-mon[31212]: pgmap v1133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1940.041997 secs 2024-04-21T10:57:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1940.041997 secs 2024-04-21T10:57:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1940.041997 secs 2024-04-21T10:57:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:09 smithi077 ceph-mon[27902]: pgmap v1134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:09 smithi191 ceph-mon[31636]: pgmap v1134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:09 smithi170 ceph-mon[31212]: pgmap v1134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:11 smithi077 ceph-mon[27902]: pgmap v1135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1943.280592 secs 2024-04-21T10:57:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:11 smithi077 ceph-mon[27902]: osdmap e148: 12 total, 12 up, 12 in 2024-04-21T10:57:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:11 smithi191 ceph-mon[31636]: pgmap v1135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1943.280592 secs 2024-04-21T10:57:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:11 smithi191 ceph-mon[31636]: osdmap e148: 12 total, 12 up, 12 in 2024-04-21T10:57:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:11 smithi170 ceph-mon[31212]: pgmap v1135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1943.280592 secs 2024-04-21T10:57:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:11 smithi170 ceph-mon[31212]: osdmap e148: 12 total, 12 up, 12 in 2024-04-21T10:57:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:13 smithi077 ceph-mon[27902]: pgmap v1137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:57:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1945.042114 secs 2024-04-21T10:57:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:13 smithi191 ceph-mon[31636]: pgmap v1137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:57:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1945.042114 secs 2024-04-21T10:57:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:13 smithi170 ceph-mon[31212]: pgmap v1137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T10:57:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1945.042114 secs 2024-04-21T10:57:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:57:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:57:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:57:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:15 smithi077 ceph-mon[27902]: pgmap v1138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:57:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:57:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:57:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:15 smithi191 ceph-mon[31636]: pgmap v1138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:57:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:57:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:57:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:15 smithi170 ceph-mon[31212]: pgmap v1138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:57:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:57:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:57:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:57:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1948.280732 secs 2024-04-21T10:57:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1948.280732 secs 2024-04-21T10:57:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1948.280732 secs 2024-04-21T10:57:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:17 smithi077 ceph-mon[27902]: pgmap v1139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:57:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:17 smithi191 ceph-mon[31636]: pgmap v1139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:57:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:17 smithi170 ceph-mon[31212]: pgmap v1139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:57:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1950.042229 secs 2024-04-21T10:57:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1950.042229 secs 2024-04-21T10:57:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1950.042229 secs 2024-04-21T10:57:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:19 smithi077 ceph-mon[27902]: pgmap v1140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:57:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:19 smithi191 ceph-mon[31636]: pgmap v1140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:57:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:19 smithi170 ceph-mon[31212]: pgmap v1140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:57:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:21 smithi077 ceph-mon[27902]: pgmap v1141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:57:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1953.280849 secs 2024-04-21T10:57:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:21 smithi191 ceph-mon[31636]: pgmap v1141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:57:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1953.280849 secs 2024-04-21T10:57:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:21 smithi170 ceph-mon[31212]: pgmap v1141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:57:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1953.280849 secs 2024-04-21T10:57:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:23 smithi077 ceph-mon[27902]: pgmap v1142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:57:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1955.042344 secs 2024-04-21T10:57:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:23 smithi191 ceph-mon[31636]: pgmap v1142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:57:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1955.042344 secs 2024-04-21T10:57:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:23 smithi170 ceph-mon[31212]: pgmap v1142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:57:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1955.042344 secs 2024-04-21T10:57:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:25 smithi077 ceph-mon[27902]: pgmap v1143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:25 smithi191 ceph-mon[31636]: pgmap v1143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:25 smithi170 ceph-mon[31212]: pgmap v1143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1958.280913 secs 2024-04-21T10:57:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1958.280913 secs 2024-04-21T10:57:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1958.280913 secs 2024-04-21T10:57:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:27 smithi077 ceph-mon[27902]: pgmap v1144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:27 smithi191 ceph-mon[31636]: pgmap v1144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:27 smithi170 ceph-mon[31212]: pgmap v1144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1960.042409 secs 2024-04-21T10:57:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1960.042409 secs 2024-04-21T10:57:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1960.042409 secs 2024-04-21T10:57:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:29 smithi077 ceph-mon[27902]: pgmap v1145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:29 smithi191 ceph-mon[31636]: pgmap v1145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:29 smithi170 ceph-mon[31212]: pgmap v1145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:31 smithi077 ceph-mon[27902]: pgmap v1146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1963.280998 secs 2024-04-21T10:57:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:31 smithi191 ceph-mon[31636]: pgmap v1146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1963.280998 secs 2024-04-21T10:57:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:31 smithi170 ceph-mon[31212]: pgmap v1146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1963.280998 secs 2024-04-21T10:57:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:33 smithi077 ceph-mon[27902]: pgmap v1147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1965.042498 secs 2024-04-21T10:57:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:33 smithi191 ceph-mon[31636]: pgmap v1147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1965.042498 secs 2024-04-21T10:57:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:33 smithi170 ceph-mon[31212]: pgmap v1147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1965.042498 secs 2024-04-21T10:57:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:35 smithi191 ceph-mon[31636]: pgmap v1148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:35 smithi170 ceph-mon[31212]: pgmap v1148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:35 smithi077 ceph-mon[27902]: pgmap v1148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:37.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1968.281111 secs 2024-04-21T10:57:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1968.281111 secs 2024-04-21T10:57:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1968.281111 secs 2024-04-21T10:57:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:37 smithi191 ceph-mon[31636]: pgmap v1149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:37 smithi170 ceph-mon[31212]: pgmap v1149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:37 smithi077 ceph-mon[27902]: pgmap v1149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1970.042613 secs 2024-04-21T10:57:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1970.042613 secs 2024-04-21T10:57:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1970.042613 secs 2024-04-21T10:57:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:39 smithi191 ceph-mon[31636]: pgmap v1150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:39 smithi170 ceph-mon[31212]: pgmap v1150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:39 smithi077 ceph-mon[27902]: pgmap v1150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:41 smithi191 ceph-mon[31636]: pgmap v1151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1973.281227 secs 2024-04-21T10:57:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:41 smithi170 ceph-mon[31212]: pgmap v1151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1973.281227 secs 2024-04-21T10:57:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:41 smithi077 ceph-mon[27902]: pgmap v1151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1973.281227 secs 2024-04-21T10:57:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:43 smithi191 ceph-mon[31636]: pgmap v1152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1975.042742 secs 2024-04-21T10:57:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:43 smithi170 ceph-mon[31212]: pgmap v1152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1975.042742 secs 2024-04-21T10:57:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:43 smithi077 ceph-mon[27902]: pgmap v1152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1975.042742 secs 2024-04-21T10:57:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:45 smithi191 ceph-mon[31636]: pgmap v1153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:45 smithi170 ceph-mon[31212]: pgmap v1153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:45 smithi077 ceph-mon[27902]: pgmap v1153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1978.281364 secs 2024-04-21T10:57:47.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1978.281364 secs 2024-04-21T10:57:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1978.281364 secs 2024-04-21T10:57:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:47 smithi191 ceph-mon[31636]: pgmap v1154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:47 smithi170 ceph-mon[31212]: pgmap v1154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:47 smithi077 ceph-mon[27902]: pgmap v1154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1980.042880 secs 2024-04-21T10:57:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1980.042880 secs 2024-04-21T10:57:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1980.042880 secs 2024-04-21T10:57:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:49 smithi191 ceph-mon[31636]: pgmap v1155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:49 smithi170 ceph-mon[31212]: pgmap v1155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:49 smithi077 ceph-mon[27902]: pgmap v1155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:51 smithi191 ceph-mon[31636]: pgmap v1156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1983.281479 secs 2024-04-21T10:57:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:51 smithi170 ceph-mon[31212]: pgmap v1156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1983.281479 secs 2024-04-21T10:57:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:51 smithi077 ceph-mon[27902]: pgmap v1156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1983.281479 secs 2024-04-21T10:57:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:53 smithi191 ceph-mon[31636]: pgmap v1157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1985.042976 secs 2024-04-21T10:57:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:53 smithi170 ceph-mon[31212]: pgmap v1157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1985.042976 secs 2024-04-21T10:57:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:53 smithi077 ceph-mon[27902]: pgmap v1157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1985.042976 secs 2024-04-21T10:57:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:57:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:55 smithi191 ceph-mon[31636]: pgmap v1158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:55 smithi170 ceph-mon[31212]: pgmap v1158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:55 smithi077 ceph-mon[27902]: pgmap v1158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:57:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1988.281597 secs 2024-04-21T10:57:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1988.281597 secs 2024-04-21T10:57:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1988.281597 secs 2024-04-21T10:57:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:57 smithi191 ceph-mon[31636]: pgmap v1159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:57 smithi170 ceph-mon[31212]: pgmap v1159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:57 smithi077 ceph-mon[27902]: pgmap v1159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:57:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1990.043094 secs 2024-04-21T10:57:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1990.043094 secs 2024-04-21T10:57:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1990.043094 secs 2024-04-21T10:58:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:57:59 smithi191 ceph-mon[31636]: pgmap v1160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:57:59 smithi170 ceph-mon[31212]: pgmap v1160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:57:59 smithi077 ceph-mon[27902]: pgmap v1160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:01 smithi191 ceph-mon[31636]: pgmap v1161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1993.281736 secs 2024-04-21T10:58:02.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:01 smithi170 ceph-mon[31212]: pgmap v1161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:02.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1993.281736 secs 2024-04-21T10:58:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:01 smithi077 ceph-mon[27902]: pgmap v1161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1993.281736 secs 2024-04-21T10:58:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:03 smithi191 ceph-mon[31636]: pgmap v1162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 1995.043212 secs 2024-04-21T10:58:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:03 smithi170 ceph-mon[31212]: pgmap v1162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 1995.043212 secs 2024-04-21T10:58:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:03 smithi077 ceph-mon[27902]: pgmap v1162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 1995.043212 secs 2024-04-21T10:58:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:04 smithi170 ceph-mon[31212]: osdmap e149: 12 total, 12 up, 12 in 2024-04-21T10:58:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:04 smithi077 ceph-mon[27902]: osdmap e149: 12 total, 12 up, 12 in 2024-04-21T10:58:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:04 smithi191 ceph-mon[31636]: osdmap e149: 12 total, 12 up, 12 in 2024-04-21T10:58:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:05 smithi170 ceph-mon[31212]: pgmap v1164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:58:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:05 smithi077 ceph-mon[27902]: pgmap v1164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:58:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:05 smithi191 ceph-mon[31636]: pgmap v1164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:58:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 1998.281854 secs 2024-04-21T10:58:07.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 1998.281854 secs 2024-04-21T10:58:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 1998.281854 secs 2024-04-21T10:58:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:07 smithi170 ceph-mon[31212]: pgmap v1165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:58:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:07 smithi077 ceph-mon[27902]: pgmap v1165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:58:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:07 smithi191 ceph-mon[31636]: pgmap v1165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:58:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2000.043328 secs 2024-04-21T10:58:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2000.043328 secs 2024-04-21T10:58:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2000.043328 secs 2024-04-21T10:58:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:09 smithi170 ceph-mon[31212]: pgmap v1166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:58:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:09 smithi077 ceph-mon[27902]: pgmap v1166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:58:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:09 smithi191 ceph-mon[31636]: pgmap v1166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:58:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:11 smithi170 ceph-mon[31212]: pgmap v1167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:58:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2003.281978 secs 2024-04-21T10:58:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:11 smithi170 ceph-mon[31212]: osdmap e150: 12 total, 12 up, 12 in 2024-04-21T10:58:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:11 smithi077 ceph-mon[27902]: pgmap v1167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:58:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2003.281978 secs 2024-04-21T10:58:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:11 smithi077 ceph-mon[27902]: osdmap e150: 12 total, 12 up, 12 in 2024-04-21T10:58:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:11 smithi191 ceph-mon[31636]: pgmap v1167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:58:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2003.281978 secs 2024-04-21T10:58:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:11 smithi191 ceph-mon[31636]: osdmap e150: 12 total, 12 up, 12 in 2024-04-21T10:58:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:13 smithi170 ceph-mon[31212]: pgmap v1169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:58:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2005.043417 secs 2024-04-21T10:58:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:13 smithi077 ceph-mon[27902]: pgmap v1169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:58:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2005.043417 secs 2024-04-21T10:58:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:13 smithi191 ceph-mon[31636]: pgmap v1169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T10:58:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2005.043417 secs 2024-04-21T10:58:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:15 smithi170 ceph-mon[31212]: pgmap v1170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:58:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:58:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:58:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:58:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:58:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:15 smithi077 ceph-mon[27902]: pgmap v1170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:58:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:58:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:58:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:58:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:58:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:16 smithi191 ceph-mon[31636]: pgmap v1170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T10:58:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:58:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:58:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:58:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:58:17.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2008.282049 secs 2024-04-21T10:58:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2008.282049 secs 2024-04-21T10:58:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2008.282049 secs 2024-04-21T10:58:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:18 smithi170 ceph-mon[31212]: pgmap v1171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:58:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:18 smithi077 ceph-mon[27902]: pgmap v1171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:58:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:18 smithi191 ceph-mon[31636]: pgmap v1171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:58:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2010.043489 secs 2024-04-21T10:58:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2010.043489 secs 2024-04-21T10:58:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2010.043489 secs 2024-04-21T10:58:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:20 smithi170 ceph-mon[31212]: pgmap v1172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:58:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:20 smithi077 ceph-mon[27902]: pgmap v1172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:58:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:20 smithi191 ceph-mon[31636]: pgmap v1172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:58:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:22 smithi170 ceph-mon[31212]: pgmap v1173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:58:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2013.282169 secs 2024-04-21T10:58:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:22 smithi077 ceph-mon[27902]: pgmap v1173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:58:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2013.282169 secs 2024-04-21T10:58:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:22 smithi191 ceph-mon[31636]: pgmap v1173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:58:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2013.282169 secs 2024-04-21T10:58:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:24 smithi170 ceph-mon[31212]: pgmap v1174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:58:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2015.043610 secs 2024-04-21T10:58:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:24 smithi077 ceph-mon[27902]: pgmap v1174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:58:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2015.043610 secs 2024-04-21T10:58:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:24 smithi191 ceph-mon[31636]: pgmap v1174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:58:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2015.043610 secs 2024-04-21T10:58:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:26 smithi170 ceph-mon[31212]: pgmap v1175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:26 smithi077 ceph-mon[27902]: pgmap v1175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:26 smithi191 ceph-mon[31636]: pgmap v1175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2018.282303 secs 2024-04-21T10:58:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2018.282303 secs 2024-04-21T10:58:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2018.282303 secs 2024-04-21T10:58:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:28 smithi170 ceph-mon[31212]: pgmap v1176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:28 smithi077 ceph-mon[27902]: pgmap v1176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:28 smithi191 ceph-mon[31636]: pgmap v1176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2020.043726 secs 2024-04-21T10:58:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2020.043726 secs 2024-04-21T10:58:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2020.043726 secs 2024-04-21T10:58:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:30 smithi170 ceph-mon[31212]: pgmap v1177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:30 smithi077 ceph-mon[27902]: pgmap v1177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:30 smithi191 ceph-mon[31636]: pgmap v1177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:32 smithi170 ceph-mon[31212]: pgmap v1178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2023.282443 secs 2024-04-21T10:58:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:32 smithi077 ceph-mon[27902]: pgmap v1178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2023.282443 secs 2024-04-21T10:58:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:32 smithi191 ceph-mon[31636]: pgmap v1178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2023.282443 secs 2024-04-21T10:58:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:34 smithi170 ceph-mon[31212]: pgmap v1179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2025.043827 secs 2024-04-21T10:58:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:34 smithi077 ceph-mon[27902]: pgmap v1179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2025.043827 secs 2024-04-21T10:58:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:34 smithi191 ceph-mon[31636]: pgmap v1179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2025.043827 secs 2024-04-21T10:58:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:36 smithi170 ceph-mon[31212]: pgmap v1180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:36 smithi077 ceph-mon[27902]: pgmap v1180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:36 smithi191 ceph-mon[31636]: pgmap v1180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2028.282567 secs 2024-04-21T10:58:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2028.282567 secs 2024-04-21T10:58:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2028.282567 secs 2024-04-21T10:58:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:38 smithi170 ceph-mon[31212]: pgmap v1181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:38 smithi077 ceph-mon[27902]: pgmap v1181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:38 smithi191 ceph-mon[31636]: pgmap v1181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2030.043978 secs 2024-04-21T10:58:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2030.043978 secs 2024-04-21T10:58:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2030.043978 secs 2024-04-21T10:58:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:40 smithi077 ceph-mon[27902]: pgmap v1182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:40 smithi191 ceph-mon[31636]: pgmap v1182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:40 smithi170 ceph-mon[31212]: pgmap v1182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:42 smithi077 ceph-mon[27902]: pgmap v1183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2033.282680 secs 2024-04-21T10:58:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:42 smithi191 ceph-mon[31636]: pgmap v1183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2033.282680 secs 2024-04-21T10:58:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:42 smithi170 ceph-mon[31212]: pgmap v1183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2033.282680 secs 2024-04-21T10:58:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:44 smithi077 ceph-mon[27902]: pgmap v1184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2035.044097 secs 2024-04-21T10:58:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:44 smithi191 ceph-mon[31636]: pgmap v1184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2035.044097 secs 2024-04-21T10:58:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:44 smithi170 ceph-mon[31212]: pgmap v1184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2035.044097 secs 2024-04-21T10:58:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:46 smithi077 ceph-mon[27902]: pgmap v1185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:46 smithi191 ceph-mon[31636]: pgmap v1185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:46 smithi170 ceph-mon[31212]: pgmap v1185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T10:58:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2038.282834 secs 2024-04-21T10:58:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2038.282834 secs 2024-04-21T10:58:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2038.282834 secs 2024-04-21T10:58:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:48 smithi077 ceph-mon[27902]: pgmap v1186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:48 smithi191 ceph-mon[31636]: pgmap v1186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:48 smithi170 ceph-mon[31212]: pgmap v1186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2040.044185 secs 2024-04-21T10:58:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2040.044185 secs 2024-04-21T10:58:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2040.044185 secs 2024-04-21T10:58:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:50 smithi077 ceph-mon[27902]: pgmap v1187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:50 smithi191 ceph-mon[31636]: pgmap v1187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:50 smithi170 ceph-mon[31212]: pgmap v1187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:52 smithi077 ceph-mon[27902]: pgmap v1188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2043.282952 secs 2024-04-21T10:58:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:52 smithi191 ceph-mon[31636]: pgmap v1188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2043.282952 secs 2024-04-21T10:58:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:52 smithi170 ceph-mon[31212]: pgmap v1188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2043.282952 secs 2024-04-21T10:58:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:54 smithi077 ceph-mon[27902]: pgmap v1189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2045.044307 secs 2024-04-21T10:58:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T10:58:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T10:58:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd70012010 tx=0x7efd70012040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T10:58:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd70012010 tx=0x7efd70012040 comp rx=0 tx=0).stop 2024-04-21T10:58:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T10:58:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T10:58:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T10:58:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T10:58:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:58:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.398+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640b0770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd70017000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T10:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.417+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T10:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.417+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T10:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T10:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T10:58:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.417+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T10:58:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.418+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T10:58:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.418+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T10:58:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:54 smithi191 ceph-mon[31636]: pgmap v1189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2045.044307 secs 2024-04-21T10:58:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:54 smithi170 ceph-mon[31212]: pgmap v1189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2045.044307 secs 2024-04-21T10:58:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.631+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:58:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.631+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:58:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.632+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T10:58:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T10:58:54.632+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T10:58:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:58:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:56 smithi077 ceph-mon[27902]: pgmap v1190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:56 smithi191 ceph-mon[31636]: pgmap v1190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:56 smithi170 ceph-mon[31212]: pgmap v1190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:58:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2048.283074 secs 2024-04-21T10:58:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2048.283074 secs 2024-04-21T10:58:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2048.283074 secs 2024-04-21T10:58:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:58 smithi077 ceph-mon[27902]: pgmap v1191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:58 smithi191 ceph-mon[31636]: pgmap v1191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:58 smithi170 ceph-mon[31212]: pgmap v1191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:58:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:58:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2050.044440 secs 2024-04-21T10:58:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:58:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2050.044440 secs 2024-04-21T10:58:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:58:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2050.044440 secs 2024-04-21T10:59:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:00 smithi077 ceph-mon[27902]: pgmap v1192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:00 smithi191 ceph-mon[31636]: pgmap v1192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:00 smithi170 ceph-mon[31212]: pgmap v1192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:02 smithi077 ceph-mon[27902]: pgmap v1193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2053.283197 secs 2024-04-21T10:59:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:02 smithi191 ceph-mon[31636]: pgmap v1193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2053.283197 secs 2024-04-21T10:59:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:02 smithi170 ceph-mon[31212]: pgmap v1193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2053.283197 secs 2024-04-21T10:59:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:04 smithi077 ceph-mon[27902]: pgmap v1194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2055.044552 secs 2024-04-21T10:59:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:04 smithi191 ceph-mon[31636]: pgmap v1194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2055.044552 secs 2024-04-21T10:59:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:04 smithi170 ceph-mon[31212]: pgmap v1194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2055.044552 secs 2024-04-21T10:59:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:05 smithi077 ceph-mon[27902]: osdmap e151: 12 total, 12 up, 12 in 2024-04-21T10:59:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:05 smithi191 ceph-mon[31636]: osdmap e151: 12 total, 12 up, 12 in 2024-04-21T10:59:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:05 smithi170 ceph-mon[31212]: osdmap e151: 12 total, 12 up, 12 in 2024-04-21T10:59:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:06 smithi077 ceph-mon[27902]: pgmap v1196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:59:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:06 smithi191 ceph-mon[31636]: pgmap v1196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:59:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:06 smithi170 ceph-mon[31212]: pgmap v1196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:59:07.456 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2058.283319 secs 2024-04-21T10:59:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2058.283319 secs 2024-04-21T10:59:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2058.283319 secs 2024-04-21T10:59:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:08 smithi191 ceph-mon[31636]: pgmap v1197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:08 smithi170 ceph-mon[31212]: pgmap v1197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:08 smithi077 ceph-mon[27902]: pgmap v1197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2060.044682 secs 2024-04-21T10:59:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2060.044682 secs 2024-04-21T10:59:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2060.044682 secs 2024-04-21T10:59:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:10 smithi191 ceph-mon[31636]: pgmap v1198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:10 smithi170 ceph-mon[31212]: pgmap v1198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:10 smithi077 ceph-mon[27902]: pgmap v1198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:12 smithi191 ceph-mon[31636]: pgmap v1199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2063.283455 secs 2024-04-21T10:59:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:12 smithi191 ceph-mon[31636]: osdmap e152: 12 total, 12 up, 12 in 2024-04-21T10:59:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:12 smithi170 ceph-mon[31212]: pgmap v1199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2063.283455 secs 2024-04-21T10:59:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:12 smithi170 ceph-mon[31212]: osdmap e152: 12 total, 12 up, 12 in 2024-04-21T10:59:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:12 smithi077 ceph-mon[27902]: pgmap v1199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2063.283455 secs 2024-04-21T10:59:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:12 smithi077 ceph-mon[27902]: osdmap e152: 12 total, 12 up, 12 in 2024-04-21T10:59:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:14 smithi191 ceph-mon[31636]: pgmap v1201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:59:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2065.044835 secs 2024-04-21T10:59:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:14 smithi170 ceph-mon[31212]: pgmap v1201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:59:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2065.044835 secs 2024-04-21T10:59:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:14 smithi077 ceph-mon[27902]: pgmap v1201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T10:59:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2065.044835 secs 2024-04-21T10:59:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:16 smithi191 ceph-mon[31636]: pgmap v1202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:59:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:16 smithi170 ceph-mon[31212]: pgmap v1202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:59:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:16 smithi077 ceph-mon[27902]: pgmap v1202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T10:59:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T10:59:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2068.283544 secs 2024-04-21T10:59:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:59:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:59:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:59:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:17 smithi170 ceph-mon[31212]: pgmap v1203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:59:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2068.283544 secs 2024-04-21T10:59:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:59:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:59:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:59:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:17 smithi077 ceph-mon[27902]: pgmap v1203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:59:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2068.283544 secs 2024-04-21T10:59:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T10:59:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T10:59:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T10:59:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:17 smithi191 ceph-mon[31636]: pgmap v1203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:59:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2070.044973 secs 2024-04-21T10:59:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2070.044973 secs 2024-04-21T10:59:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2070.044973 secs 2024-04-21T10:59:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:19 smithi077 ceph-mon[27902]: pgmap v1204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:59:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:19 smithi191 ceph-mon[31636]: pgmap v1204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:59:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:19 smithi170 ceph-mon[31212]: pgmap v1204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T10:59:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:21 smithi170 ceph-mon[31212]: pgmap v1205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:59:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2073.283697 secs 2024-04-21T10:59:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:21 smithi077 ceph-mon[27902]: pgmap v1205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:59:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2073.283697 secs 2024-04-21T10:59:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:21 smithi191 ceph-mon[31636]: pgmap v1205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T10:59:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2073.283697 secs 2024-04-21T10:59:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:23 smithi077 ceph-mon[27902]: pgmap v1206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:59:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2075.045028 secs 2024-04-21T10:59:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:23 smithi191 ceph-mon[31636]: pgmap v1206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:59:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2075.045028 secs 2024-04-21T10:59:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:23 smithi170 ceph-mon[31212]: pgmap v1206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T10:59:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2075.045028 secs 2024-04-21T10:59:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:25 smithi077 ceph-mon[27902]: pgmap v1207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:25 smithi191 ceph-mon[31636]: pgmap v1207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:25 smithi170 ceph-mon[31212]: pgmap v1207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2078.283821 secs 2024-04-21T10:59:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2078.283821 secs 2024-04-21T10:59:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2078.283821 secs 2024-04-21T10:59:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:27 smithi077 ceph-mon[27902]: pgmap v1208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:27 smithi191 ceph-mon[31636]: pgmap v1208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:27 smithi170 ceph-mon[31212]: pgmap v1208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2080.045107 secs 2024-04-21T10:59:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2080.045107 secs 2024-04-21T10:59:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2080.045107 secs 2024-04-21T10:59:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:29 smithi077 ceph-mon[27902]: pgmap v1209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:29 smithi191 ceph-mon[31636]: pgmap v1209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:29 smithi170 ceph-mon[31212]: pgmap v1209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:31 smithi077 ceph-mon[27902]: pgmap v1210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2083.283900 secs 2024-04-21T10:59:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:31 smithi191 ceph-mon[31636]: pgmap v1210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2083.283900 secs 2024-04-21T10:59:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:31 smithi170 ceph-mon[31212]: pgmap v1210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2083.283900 secs 2024-04-21T10:59:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:33 smithi077 ceph-mon[27902]: pgmap v1211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2085.045218 secs 2024-04-21T10:59:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:33 smithi191 ceph-mon[31636]: pgmap v1211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2085.045218 secs 2024-04-21T10:59:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:33 smithi170 ceph-mon[31212]: pgmap v1211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2085.045218 secs 2024-04-21T10:59:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:35 smithi077 ceph-mon[27902]: pgmap v1212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:35 smithi191 ceph-mon[31636]: pgmap v1212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:35 smithi170 ceph-mon[31212]: pgmap v1212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:37.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2088.283964 secs 2024-04-21T10:59:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2088.283964 secs 2024-04-21T10:59:37.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2088.283964 secs 2024-04-21T10:59:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:37 smithi077 ceph-mon[27902]: pgmap v1213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:37 smithi191 ceph-mon[31636]: pgmap v1213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:37 smithi170 ceph-mon[31212]: pgmap v1213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2090.045300 secs 2024-04-21T10:59:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2090.045300 secs 2024-04-21T10:59:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2090.045300 secs 2024-04-21T10:59:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:39 smithi077 ceph-mon[27902]: pgmap v1214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:39 smithi191 ceph-mon[31636]: pgmap v1214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:39 smithi170 ceph-mon[31212]: pgmap v1214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:41 smithi077 ceph-mon[27902]: pgmap v1215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2093.284076 secs 2024-04-21T10:59:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:41 smithi191 ceph-mon[31636]: pgmap v1215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2093.284076 secs 2024-04-21T10:59:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:41 smithi170 ceph-mon[31212]: pgmap v1215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2093.284076 secs 2024-04-21T10:59:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:43 smithi077 ceph-mon[27902]: pgmap v1216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2095.045437 secs 2024-04-21T10:59:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:43 smithi191 ceph-mon[31636]: pgmap v1216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2095.045437 secs 2024-04-21T10:59:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:43 smithi170 ceph-mon[31212]: pgmap v1216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2095.045437 secs 2024-04-21T10:59:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:45 smithi077 ceph-mon[27902]: pgmap v1217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:45 smithi191 ceph-mon[31636]: pgmap v1217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:45 smithi170 ceph-mon[31212]: pgmap v1217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2098.284218 secs 2024-04-21T10:59:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2098.284218 secs 2024-04-21T10:59:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2098.284218 secs 2024-04-21T10:59:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:47 smithi077 ceph-mon[27902]: pgmap v1218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:47 smithi191 ceph-mon[31636]: pgmap v1218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:47 smithi170 ceph-mon[31212]: pgmap v1218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2100.045580 secs 2024-04-21T10:59:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2100.045580 secs 2024-04-21T10:59:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2100.045580 secs 2024-04-21T10:59:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:49 smithi077 ceph-mon[27902]: pgmap v1219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:49 smithi191 ceph-mon[31636]: pgmap v1219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:49 smithi170 ceph-mon[31212]: pgmap v1219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:51 smithi077 ceph-mon[27902]: pgmap v1220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2103.284341 secs 2024-04-21T10:59:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:51 smithi191 ceph-mon[31636]: pgmap v1220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2103.284341 secs 2024-04-21T10:59:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:51 smithi170 ceph-mon[31212]: pgmap v1220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2103.284341 secs 2024-04-21T10:59:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:53 smithi077 ceph-mon[27902]: pgmap v1221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2105.045728 secs 2024-04-21T10:59:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:53 smithi191 ceph-mon[31636]: pgmap v1221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2105.045728 secs 2024-04-21T10:59:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:53 smithi170 ceph-mon[31212]: pgmap v1221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2105.045728 secs 2024-04-21T10:59:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T10:59:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:55 smithi077 ceph-mon[27902]: pgmap v1222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:55 smithi191 ceph-mon[31636]: pgmap v1222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:55 smithi170 ceph-mon[31212]: pgmap v1222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T10:59:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2108.284489 secs 2024-04-21T10:59:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2108.284489 secs 2024-04-21T10:59:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2108.284489 secs 2024-04-21T10:59:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:57 smithi191 ceph-mon[31636]: pgmap v1223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:57 smithi170 ceph-mon[31212]: pgmap v1223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:57 smithi077 ceph-mon[27902]: pgmap v1223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T10:59:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2110.045844 secs 2024-04-21T10:59:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2110.045844 secs 2024-04-21T10:59:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2110.045844 secs 2024-04-21T11:00:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 10:59:59 smithi191 ceph-mon[31636]: pgmap v1224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 10:59:59 smithi170 ceph-mon[31212]: pgmap v1224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 10:59:59 smithi077 ceph-mon[27902]: pgmap v1224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:00:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:00:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:00:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:01 smithi191 ceph-mon[31636]: pgmap v1225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2113.284628 secs 2024-04-21T11:00:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:01 smithi170 ceph-mon[31212]: pgmap v1225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2113.284628 secs 2024-04-21T11:00:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:01 smithi077 ceph-mon[27902]: pgmap v1225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2113.284628 secs 2024-04-21T11:00:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:03 smithi191 ceph-mon[31636]: pgmap v1226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2115.045892 secs 2024-04-21T11:00:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:03 smithi170 ceph-mon[31212]: pgmap v1226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2115.045892 secs 2024-04-21T11:00:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:03 smithi077 ceph-mon[27902]: pgmap v1226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2115.045892 secs 2024-04-21T11:00:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:04 smithi191 ceph-mon[31636]: osdmap e153: 12 total, 12 up, 12 in 2024-04-21T11:00:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:04 smithi170 ceph-mon[31212]: osdmap e153: 12 total, 12 up, 12 in 2024-04-21T11:00:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:04 smithi077 ceph-mon[27902]: osdmap e153: 12 total, 12 up, 12 in 2024-04-21T11:00:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:05 smithi191 ceph-mon[31636]: pgmap v1228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:00:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:05 smithi170 ceph-mon[31212]: pgmap v1228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:00:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:05 smithi077 ceph-mon[27902]: pgmap v1228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:00:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2118.284784 secs 2024-04-21T11:00:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2118.284784 secs 2024-04-21T11:00:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2118.284784 secs 2024-04-21T11:00:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:07 smithi191 ceph-mon[31636]: pgmap v1229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:00:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:07 smithi170 ceph-mon[31212]: pgmap v1229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:00:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:07 smithi077 ceph-mon[27902]: pgmap v1229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:00:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2120.046001 secs 2024-04-21T11:00:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2120.046001 secs 2024-04-21T11:00:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2120.046001 secs 2024-04-21T11:00:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:09 smithi191 ceph-mon[31636]: pgmap v1230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:00:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:09 smithi170 ceph-mon[31212]: pgmap v1230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:00:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:09 smithi077 ceph-mon[27902]: pgmap v1230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:00:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:11 smithi191 ceph-mon[31636]: pgmap v1231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:00:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2123.284894 secs 2024-04-21T11:00:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:11 smithi191 ceph-mon[31636]: osdmap e154: 12 total, 12 up, 12 in 2024-04-21T11:00:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:11 smithi170 ceph-mon[31212]: pgmap v1231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:00:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2123.284894 secs 2024-04-21T11:00:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:11 smithi170 ceph-mon[31212]: osdmap e154: 12 total, 12 up, 12 in 2024-04-21T11:00:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:11 smithi077 ceph-mon[27902]: pgmap v1231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:00:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2123.284894 secs 2024-04-21T11:00:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:11 smithi077 ceph-mon[27902]: osdmap e154: 12 total, 12 up, 12 in 2024-04-21T11:00:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:13 smithi191 ceph-mon[31636]: pgmap v1233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:00:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2125.046119 secs 2024-04-21T11:00:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:13 smithi170 ceph-mon[31212]: pgmap v1233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:00:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2125.046119 secs 2024-04-21T11:00:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:13 smithi077 ceph-mon[27902]: pgmap v1233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:00:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2125.046119 secs 2024-04-21T11:00:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:15 smithi191 ceph-mon[31636]: pgmap v1234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:00:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:15 smithi170 ceph-mon[31212]: pgmap v1234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:00:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:15 smithi077 ceph-mon[27902]: pgmap v1234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:00:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2128.284971 secs 2024-04-21T11:00:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:00:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2128.284971 secs 2024-04-21T11:00:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:00:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2128.284971 secs 2024-04-21T11:00:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:00:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:17 smithi191 ceph-mon[31636]: pgmap v1235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:00:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:00:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:00:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:00:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:17 smithi170 ceph-mon[31212]: pgmap v1235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:00:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:00:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:00:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:00:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:17 smithi077 ceph-mon[27902]: pgmap v1235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:00:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:00:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:00:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:00:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2130.046234 secs 2024-04-21T11:00:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2130.046234 secs 2024-04-21T11:00:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2130.046234 secs 2024-04-21T11:00:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:19 smithi191 ceph-mon[31636]: pgmap v1236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:00:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:19 smithi170 ceph-mon[31212]: pgmap v1236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:00:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:19 smithi077 ceph-mon[27902]: pgmap v1236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:00:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:21 smithi191 ceph-mon[31636]: pgmap v1237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:00:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2133.285082 secs 2024-04-21T11:00:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:21 smithi170 ceph-mon[31212]: pgmap v1237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:00:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2133.285082 secs 2024-04-21T11:00:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:21 smithi077 ceph-mon[27902]: pgmap v1237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:00:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2133.285082 secs 2024-04-21T11:00:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:23 smithi191 ceph-mon[31636]: pgmap v1238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:00:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2135.046308 secs 2024-04-21T11:00:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:23 smithi170 ceph-mon[31212]: pgmap v1238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:00:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2135.046308 secs 2024-04-21T11:00:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:23 smithi077 ceph-mon[27902]: pgmap v1238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:00:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2135.046308 secs 2024-04-21T11:00:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:25 smithi191 ceph-mon[31636]: pgmap v1239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:25 smithi170 ceph-mon[31212]: pgmap v1239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:25 smithi077 ceph-mon[27902]: pgmap v1239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2138.285191 secs 2024-04-21T11:00:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2138.285191 secs 2024-04-21T11:00:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2138.285191 secs 2024-04-21T11:00:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:27 smithi170 ceph-mon[31212]: pgmap v1240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:27 smithi077 ceph-mon[27902]: pgmap v1240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:27 smithi191 ceph-mon[31636]: pgmap v1240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2140.046418 secs 2024-04-21T11:00:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2140.046418 secs 2024-04-21T11:00:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2140.046418 secs 2024-04-21T11:00:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:29 smithi170 ceph-mon[31212]: pgmap v1241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:29 smithi077 ceph-mon[27902]: pgmap v1241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:29 smithi191 ceph-mon[31636]: pgmap v1241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:31 smithi170 ceph-mon[31212]: pgmap v1242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2143.285332 secs 2024-04-21T11:00:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:31 smithi077 ceph-mon[27902]: pgmap v1242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2143.285332 secs 2024-04-21T11:00:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:31 smithi191 ceph-mon[31636]: pgmap v1242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2143.285332 secs 2024-04-21T11:00:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:33 smithi170 ceph-mon[31212]: pgmap v1243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2145.046511 secs 2024-04-21T11:00:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:33 smithi077 ceph-mon[27902]: pgmap v1243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2145.046511 secs 2024-04-21T11:00:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:33 smithi191 ceph-mon[31636]: pgmap v1243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2145.046511 secs 2024-04-21T11:00:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:35 smithi170 ceph-mon[31212]: pgmap v1244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:35 smithi077 ceph-mon[27902]: pgmap v1244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:35 smithi191 ceph-mon[31636]: pgmap v1244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2148.285429 secs 2024-04-21T11:00:37.368 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2148.285429 secs 2024-04-21T11:00:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2148.285429 secs 2024-04-21T11:00:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:38 smithi170 ceph-mon[31212]: pgmap v1245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:38 smithi077 ceph-mon[27902]: pgmap v1245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:38.388 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:38 smithi191 ceph-mon[31636]: pgmap v1245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2150.046607 secs 2024-04-21T11:00:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2150.046607 secs 2024-04-21T11:00:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2150.046607 secs 2024-04-21T11:00:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:40 smithi170 ceph-mon[31212]: pgmap v1246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:40 smithi077 ceph-mon[27902]: pgmap v1246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:40 smithi191 ceph-mon[31636]: pgmap v1246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:42 smithi170 ceph-mon[31212]: pgmap v1247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2153.285554 secs 2024-04-21T11:00:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:42 smithi077 ceph-mon[27902]: pgmap v1247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2153.285554 secs 2024-04-21T11:00:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:42 smithi191 ceph-mon[31636]: pgmap v1247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2153.285554 secs 2024-04-21T11:00:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:44 smithi170 ceph-mon[31212]: pgmap v1248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2155.046733 secs 2024-04-21T11:00:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:44 smithi077 ceph-mon[27902]: pgmap v1248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2155.046733 secs 2024-04-21T11:00:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:44 smithi191 ceph-mon[31636]: pgmap v1248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2155.046733 secs 2024-04-21T11:00:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:46 smithi170 ceph-mon[31212]: pgmap v1249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:46 smithi077 ceph-mon[27902]: pgmap v1249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:46 smithi191 ceph-mon[31636]: pgmap v1249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:47.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2158.285667 secs 2024-04-21T11:00:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2158.285667 secs 2024-04-21T11:00:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2158.285667 secs 2024-04-21T11:00:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:48 smithi170 ceph-mon[31212]: pgmap v1250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:48 smithi077 ceph-mon[27902]: pgmap v1250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:48 smithi191 ceph-mon[31636]: pgmap v1250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2160.046848 secs 2024-04-21T11:00:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2160.046848 secs 2024-04-21T11:00:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2160.046848 secs 2024-04-21T11:00:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:50 smithi170 ceph-mon[31212]: pgmap v1251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:50 smithi077 ceph-mon[27902]: pgmap v1251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:50 smithi191 ceph-mon[31636]: pgmap v1251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:52 smithi170 ceph-mon[31212]: pgmap v1252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2163.285795 secs 2024-04-21T11:00:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:52 smithi077 ceph-mon[27902]: pgmap v1252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2163.285795 secs 2024-04-21T11:00:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:52 smithi191 ceph-mon[31636]: pgmap v1252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2163.285795 secs 2024-04-21T11:00:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:54 smithi170 ceph-mon[31212]: pgmap v1253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2165.046999 secs 2024-04-21T11:00:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:54 smithi077 ceph-mon[27902]: pgmap v1253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2165.046999 secs 2024-04-21T11:00:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:54 smithi191 ceph-mon[31636]: pgmap v1253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2165.046999 secs 2024-04-21T11:00:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:00:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:56 smithi170 ceph-mon[31212]: pgmap v1254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:56 smithi077 ceph-mon[27902]: pgmap v1254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:56 smithi191 ceph-mon[31636]: pgmap v1254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:00:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2168.285856 secs 2024-04-21T11:00:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2168.285856 secs 2024-04-21T11:00:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2168.285856 secs 2024-04-21T11:00:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:58 smithi170 ceph-mon[31212]: pgmap v1255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:58 smithi077 ceph-mon[27902]: pgmap v1255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:58 smithi191 ceph-mon[31636]: pgmap v1255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:00:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:00:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2170.047064 secs 2024-04-21T11:00:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:00:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2170.047064 secs 2024-04-21T11:00:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:00:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2170.047064 secs 2024-04-21T11:01:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:00 smithi077 ceph-mon[27902]: pgmap v1256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:00 smithi191 ceph-mon[31636]: pgmap v1256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:00 smithi170 ceph-mon[31212]: pgmap v1256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:02 smithi077 ceph-mon[27902]: pgmap v1257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2173.285938 secs 2024-04-21T11:01:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:02 smithi191 ceph-mon[31636]: pgmap v1257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2173.285938 secs 2024-04-21T11:01:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:02 smithi170 ceph-mon[31212]: pgmap v1257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2173.285938 secs 2024-04-21T11:01:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:04 smithi077 ceph-mon[27902]: pgmap v1258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2175.047158 secs 2024-04-21T11:01:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:04 smithi191 ceph-mon[31636]: pgmap v1258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2175.047158 secs 2024-04-21T11:01:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:04 smithi170 ceph-mon[31212]: pgmap v1258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2175.047158 secs 2024-04-21T11:01:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:05 smithi077 ceph-mon[27902]: osdmap e155: 12 total, 12 up, 12 in 2024-04-21T11:01:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:05 smithi191 ceph-mon[31636]: osdmap e155: 12 total, 12 up, 12 in 2024-04-21T11:01:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:05 smithi170 ceph-mon[31212]: osdmap e155: 12 total, 12 up, 12 in 2024-04-21T11:01:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:06 smithi077 ceph-mon[27902]: pgmap v1260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:01:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:06 smithi191 ceph-mon[31636]: pgmap v1260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:01:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:06 smithi170 ceph-mon[31212]: pgmap v1260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:01:07.368 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2178.286045 secs 2024-04-21T11:01:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2178.286045 secs 2024-04-21T11:01:07.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2178.286045 secs 2024-04-21T11:01:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:08 smithi077 ceph-mon[27902]: pgmap v1261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:01:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:08 smithi191 ceph-mon[31636]: pgmap v1261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:01:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:08 smithi170 ceph-mon[31212]: pgmap v1261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:01:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2180.047242 secs 2024-04-21T11:01:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2180.047242 secs 2024-04-21T11:01:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2180.047242 secs 2024-04-21T11:01:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:10 smithi077 ceph-mon[27902]: pgmap v1262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:01:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:10 smithi191 ceph-mon[31636]: pgmap v1262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:01:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:10 smithi170 ceph-mon[31212]: pgmap v1262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:01:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:12 smithi077 ceph-mon[27902]: pgmap v1263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:01:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2183.286155 secs 2024-04-21T11:01:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:12 smithi077 ceph-mon[27902]: osdmap e156: 12 total, 12 up, 12 in 2024-04-21T11:01:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:12 smithi191 ceph-mon[31636]: pgmap v1263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:01:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2183.286155 secs 2024-04-21T11:01:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:12 smithi191 ceph-mon[31636]: osdmap e156: 12 total, 12 up, 12 in 2024-04-21T11:01:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:12 smithi170 ceph-mon[31212]: pgmap v1263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:01:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2183.286155 secs 2024-04-21T11:01:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:12 smithi170 ceph-mon[31212]: osdmap e156: 12 total, 12 up, 12 in 2024-04-21T11:01:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:14 smithi077 ceph-mon[27902]: pgmap v1265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T11:01:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2185.047385 secs 2024-04-21T11:01:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:14 smithi191 ceph-mon[31636]: pgmap v1265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T11:01:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2185.047385 secs 2024-04-21T11:01:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:14 smithi170 ceph-mon[31212]: pgmap v1265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T11:01:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2185.047385 secs 2024-04-21T11:01:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:16 smithi077 ceph-mon[27902]: pgmap v1266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:01:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:16 smithi191 ceph-mon[31636]: pgmap v1266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:01:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:16 smithi170 ceph-mon[31212]: pgmap v1266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:01:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2188.286217 secs 2024-04-21T11:01:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2188.286217 secs 2024-04-21T11:01:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2188.286217 secs 2024-04-21T11:01:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:18 smithi077 ceph-mon[27902]: pgmap v1267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:01:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:01:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:18 smithi191 ceph-mon[31636]: pgmap v1267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:01:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:01:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:18 smithi170 ceph-mon[31212]: pgmap v1267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:01:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:01:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:01:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:01:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:01:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2190.047477 secs 2024-04-21T11:01:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:01:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:01:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:01:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2190.047477 secs 2024-04-21T11:01:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:01:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:01:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:01:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2190.047477 secs 2024-04-21T11:01:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:20 smithi191 ceph-mon[31636]: pgmap v1268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:01:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:20 smithi170 ceph-mon[31212]: pgmap v1268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:01:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:20 smithi077 ceph-mon[27902]: pgmap v1268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:01:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:22 smithi191 ceph-mon[31636]: pgmap v1269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:01:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2193.286355 secs 2024-04-21T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:22 smithi170 ceph-mon[31212]: pgmap v1269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2193.286355 secs 2024-04-21T11:01:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:22 smithi077 ceph-mon[27902]: pgmap v1269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:01:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2193.286355 secs 2024-04-21T11:01:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:24 smithi191 ceph-mon[31636]: pgmap v1270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:01:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2195.047594 secs 2024-04-21T11:01:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:24 smithi170 ceph-mon[31212]: pgmap v1270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:01:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2195.047594 secs 2024-04-21T11:01:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:24 smithi077 ceph-mon[27902]: pgmap v1270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:01:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2195.047594 secs 2024-04-21T11:01:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:26 smithi191 ceph-mon[31636]: pgmap v1271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:26 smithi170 ceph-mon[31212]: pgmap v1271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:26 smithi077 ceph-mon[27902]: pgmap v1271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2198.286492 secs 2024-04-21T11:01:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2198.286492 secs 2024-04-21T11:01:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2198.286492 secs 2024-04-21T11:01:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:28 smithi191 ceph-mon[31636]: pgmap v1272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:28 smithi170 ceph-mon[31212]: pgmap v1272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:28 smithi077 ceph-mon[27902]: pgmap v1272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2200.047729 secs 2024-04-21T11:01:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2200.047729 secs 2024-04-21T11:01:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2200.047729 secs 2024-04-21T11:01:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:30 smithi191 ceph-mon[31636]: pgmap v1273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:30 smithi170 ceph-mon[31212]: pgmap v1273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:30 smithi077 ceph-mon[27902]: pgmap v1273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:32 smithi191 ceph-mon[31636]: pgmap v1274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2203.286646 secs 2024-04-21T11:01:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:32 smithi170 ceph-mon[31212]: pgmap v1274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2203.286646 secs 2024-04-21T11:01:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:32 smithi077 ceph-mon[27902]: pgmap v1274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2203.286646 secs 2024-04-21T11:01:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:34 smithi191 ceph-mon[31636]: pgmap v1275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2205.047814 secs 2024-04-21T11:01:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:34 smithi170 ceph-mon[31212]: pgmap v1275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2205.047814 secs 2024-04-21T11:01:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:34 smithi077 ceph-mon[27902]: pgmap v1275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2205.047814 secs 2024-04-21T11:01:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:36 smithi191 ceph-mon[31636]: pgmap v1276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:36 smithi170 ceph-mon[31212]: pgmap v1276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:36 smithi077 ceph-mon[27902]: pgmap v1276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:37.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2208.286778 secs 2024-04-21T11:01:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2208.286778 secs 2024-04-21T11:01:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2208.286778 secs 2024-04-21T11:01:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:38 smithi191 ceph-mon[31636]: pgmap v1277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:38 smithi170 ceph-mon[31212]: pgmap v1277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:38 smithi077 ceph-mon[27902]: pgmap v1277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2210.047930 secs 2024-04-21T11:01:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2210.047930 secs 2024-04-21T11:01:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2210.047930 secs 2024-04-21T11:01:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:40 smithi191 ceph-mon[31636]: pgmap v1278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:40 smithi170 ceph-mon[31212]: pgmap v1278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:40 smithi077 ceph-mon[27902]: pgmap v1278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:42 smithi191 ceph-mon[31636]: pgmap v1279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2213.286876 secs 2024-04-21T11:01:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:42 smithi170 ceph-mon[31212]: pgmap v1279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2213.286876 secs 2024-04-21T11:01:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:42 smithi077 ceph-mon[27902]: pgmap v1279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2213.286876 secs 2024-04-21T11:01:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:44 smithi191 ceph-mon[31636]: pgmap v1280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2215.048050 secs 2024-04-21T11:01:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:44 smithi170 ceph-mon[31212]: pgmap v1280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2215.048050 secs 2024-04-21T11:01:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:44 smithi077 ceph-mon[27902]: pgmap v1280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2215.048050 secs 2024-04-21T11:01:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:46 smithi191 ceph-mon[31636]: pgmap v1281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:46 smithi170 ceph-mon[31212]: pgmap v1281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:46 smithi077 ceph-mon[27902]: pgmap v1281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2218.286987 secs 2024-04-21T11:01:47.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2218.286987 secs 2024-04-21T11:01:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2218.286987 secs 2024-04-21T11:01:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:48 smithi191 ceph-mon[31636]: pgmap v1282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:48 smithi170 ceph-mon[31212]: pgmap v1282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:48 smithi077 ceph-mon[27902]: pgmap v1282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2220.048119 secs 2024-04-21T11:01:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2220.048119 secs 2024-04-21T11:01:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2220.048119 secs 2024-04-21T11:01:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:50 smithi170 ceph-mon[31212]: pgmap v1283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:50 smithi077 ceph-mon[27902]: pgmap v1283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:50 smithi191 ceph-mon[31636]: pgmap v1283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:52 smithi170 ceph-mon[31212]: pgmap v1284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2223.287115 secs 2024-04-21T11:01:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:52 smithi077 ceph-mon[27902]: pgmap v1284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2223.287115 secs 2024-04-21T11:01:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:52 smithi191 ceph-mon[31636]: pgmap v1284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2223.287115 secs 2024-04-21T11:01:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:54 smithi170 ceph-mon[31212]: pgmap v1285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2225.048250 secs 2024-04-21T11:01:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:54 smithi077 ceph-mon[27902]: pgmap v1285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2225.048250 secs 2024-04-21T11:01:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.655+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:01:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.655+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:01:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.656+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:01:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.656+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:01:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.656+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:01:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.656+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:01:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.656+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:01:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:01:54.656+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:01:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:54 smithi191 ceph-mon[31636]: pgmap v1285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2225.048250 secs 2024-04-21T11:01:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:01:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:56 smithi170 ceph-mon[31212]: pgmap v1286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:56 smithi077 ceph-mon[27902]: pgmap v1286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:56 smithi191 ceph-mon[31636]: pgmap v1286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:01:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2228.287233 secs 2024-04-21T11:01:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2228.287233 secs 2024-04-21T11:01:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2228.287233 secs 2024-04-21T11:01:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:58 smithi170 ceph-mon[31212]: pgmap v1287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:58 smithi077 ceph-mon[27902]: pgmap v1287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:58 smithi191 ceph-mon[31636]: pgmap v1287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:01:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:01:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2230.048387 secs 2024-04-21T11:01:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:01:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2230.048387 secs 2024-04-21T11:01:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:01:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2230.048387 secs 2024-04-21T11:02:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:00 smithi170 ceph-mon[31212]: pgmap v1288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:00 smithi077 ceph-mon[27902]: pgmap v1288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:00 smithi191 ceph-mon[31636]: pgmap v1288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:02 smithi170 ceph-mon[31212]: pgmap v1289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2233.287364 secs 2024-04-21T11:02:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:02 smithi077 ceph-mon[27902]: pgmap v1289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2233.287364 secs 2024-04-21T11:02:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:02 smithi191 ceph-mon[31636]: pgmap v1289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2233.287364 secs 2024-04-21T11:02:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:04 smithi170 ceph-mon[31212]: pgmap v1290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2235.048510 secs 2024-04-21T11:02:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:04 smithi170 ceph-mon[31212]: osdmap e157: 12 total, 12 up, 12 in 2024-04-21T11:02:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:04 smithi077 ceph-mon[27902]: pgmap v1290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2235.048510 secs 2024-04-21T11:02:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:04 smithi077 ceph-mon[27902]: osdmap e157: 12 total, 12 up, 12 in 2024-04-21T11:02:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:04 smithi191 ceph-mon[31636]: pgmap v1290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2235.048510 secs 2024-04-21T11:02:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:04 smithi191 ceph-mon[31636]: osdmap e157: 12 total, 12 up, 12 in 2024-04-21T11:02:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:06 smithi170 ceph-mon[31212]: pgmap v1292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:02:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:06 smithi077 ceph-mon[27902]: pgmap v1292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:02:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:06 smithi191 ceph-mon[31636]: pgmap v1292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:02:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2238.287496 secs 2024-04-21T11:02:07.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2238.287496 secs 2024-04-21T11:02:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2238.287496 secs 2024-04-21T11:02:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:08 smithi170 ceph-mon[31212]: pgmap v1293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:02:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:08 smithi077 ceph-mon[27902]: pgmap v1293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:02:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:08 smithi191 ceph-mon[31636]: pgmap v1293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:02:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2240.048633 secs 2024-04-21T11:02:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2240.048633 secs 2024-04-21T11:02:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2240.048633 secs 2024-04-21T11:02:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:10 smithi170 ceph-mon[31212]: pgmap v1294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:02:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:10 smithi077 ceph-mon[27902]: pgmap v1294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:02:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:10 smithi191 ceph-mon[31636]: pgmap v1294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:02:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:12 smithi170 ceph-mon[31212]: pgmap v1295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:02:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2243.287634 secs 2024-04-21T11:02:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:12 smithi170 ceph-mon[31212]: osdmap e158: 12 total, 12 up, 12 in 2024-04-21T11:02:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:12 smithi077 ceph-mon[27902]: pgmap v1295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:02:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2243.287634 secs 2024-04-21T11:02:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:12 smithi077 ceph-mon[27902]: osdmap e158: 12 total, 12 up, 12 in 2024-04-21T11:02:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:12 smithi191 ceph-mon[31636]: pgmap v1295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:02:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2243.287634 secs 2024-04-21T11:02:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:12 smithi191 ceph-mon[31636]: osdmap e158: 12 total, 12 up, 12 in 2024-04-21T11:02:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:14 smithi170 ceph-mon[31212]: pgmap v1297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:02:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2245.048766 secs 2024-04-21T11:02:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:14 smithi077 ceph-mon[27902]: pgmap v1297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:02:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2245.048766 secs 2024-04-21T11:02:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:14 smithi191 ceph-mon[31636]: pgmap v1297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:02:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2245.048766 secs 2024-04-21T11:02:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:16 smithi170 ceph-mon[31212]: pgmap v1298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:02:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:16 smithi077 ceph-mon[27902]: pgmap v1298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:02:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:16 smithi191 ceph-mon[31636]: pgmap v1298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:02:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2248.287732 secs 2024-04-21T11:02:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2248.287732 secs 2024-04-21T11:02:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2248.287732 secs 2024-04-21T11:02:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:18 smithi170 ceph-mon[31212]: pgmap v1299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:02:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:02:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:18 smithi077 ceph-mon[27902]: pgmap v1299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:02:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:02:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:18 smithi191 ceph-mon[31636]: pgmap v1299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:02:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:02:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2250.048923 secs 2024-04-21T11:02:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2250.048923 secs 2024-04-21T11:02:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2250.048923 secs 2024-04-21T11:02:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: pgmap v1300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: pgmap v1300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: pgmap v1300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:02:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:02:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:02:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:02:21.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:02:21.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:02:21.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: pgmap v1301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:02:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2253.287851 secs 2024-04-21T11:02:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: pgmap v1301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:02:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2253.287851 secs 2024-04-21T11:02:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: pgmap v1301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:02:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2253.287851 secs 2024-04-21T11:02:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:24 smithi077 ceph-mon[27902]: pgmap v1302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:02:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2255.049018 secs 2024-04-21T11:02:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:24 smithi191 ceph-mon[31636]: pgmap v1302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:02:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2255.049018 secs 2024-04-21T11:02:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:24 smithi170 ceph-mon[31212]: pgmap v1302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:02:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2255.049018 secs 2024-04-21T11:02:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:26 smithi077 ceph-mon[27902]: pgmap v1303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:26 smithi191 ceph-mon[31636]: pgmap v1303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:26 smithi170 ceph-mon[31212]: pgmap v1303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2258.287915 secs 2024-04-21T11:02:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2258.287915 secs 2024-04-21T11:02:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2258.287915 secs 2024-04-21T11:02:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:28 smithi077 ceph-mon[27902]: pgmap v1304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:28 smithi191 ceph-mon[31636]: pgmap v1304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:28 smithi170 ceph-mon[31212]: pgmap v1304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2260.049097 secs 2024-04-21T11:02:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2260.049097 secs 2024-04-21T11:02:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2260.049097 secs 2024-04-21T11:02:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:30 smithi077 ceph-mon[27902]: pgmap v1305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:30 smithi191 ceph-mon[31636]: pgmap v1305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:30 smithi170 ceph-mon[31212]: pgmap v1305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:32 smithi077 ceph-mon[27902]: pgmap v1306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2263.288023 secs 2024-04-21T11:02:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:32 smithi191 ceph-mon[31636]: pgmap v1306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2263.288023 secs 2024-04-21T11:02:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:32 smithi170 ceph-mon[31212]: pgmap v1306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2263.288023 secs 2024-04-21T11:02:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:34 smithi077 ceph-mon[27902]: pgmap v1307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2265.049207 secs 2024-04-21T11:02:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:34 smithi191 ceph-mon[31636]: pgmap v1307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2265.049207 secs 2024-04-21T11:02:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:34 smithi170 ceph-mon[31212]: pgmap v1307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2265.049207 secs 2024-04-21T11:02:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:36 smithi077 ceph-mon[27902]: pgmap v1308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:36 smithi191 ceph-mon[31636]: pgmap v1308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:36 smithi170 ceph-mon[31212]: pgmap v1308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2268.288140 secs 2024-04-21T11:02:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2268.288140 secs 2024-04-21T11:02:37.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2268.288140 secs 2024-04-21T11:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:38 smithi077 ceph-mon[27902]: pgmap v1309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:38.635 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:38 smithi191 ceph-mon[31636]: pgmap v1309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:38.720 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:38 smithi170 ceph-mon[31212]: pgmap v1309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2270.049344 secs 2024-04-21T11:02:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2270.049344 secs 2024-04-21T11:02:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2270.049344 secs 2024-04-21T11:02:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:40 smithi077 ceph-mon[27902]: pgmap v1310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:40 smithi191 ceph-mon[31636]: pgmap v1310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:40 smithi170 ceph-mon[31212]: pgmap v1310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:42 smithi077 ceph-mon[27902]: pgmap v1311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2273.288283 secs 2024-04-21T11:02:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:42 smithi191 ceph-mon[31636]: pgmap v1311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2273.288283 secs 2024-04-21T11:02:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:42 smithi170 ceph-mon[31212]: pgmap v1311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2273.288283 secs 2024-04-21T11:02:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:44 smithi077 ceph-mon[27902]: pgmap v1312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2275.049409 secs 2024-04-21T11:02:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:44 smithi191 ceph-mon[31636]: pgmap v1312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2275.049409 secs 2024-04-21T11:02:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:44 smithi170 ceph-mon[31212]: pgmap v1312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2275.049409 secs 2024-04-21T11:02:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:46 smithi077 ceph-mon[27902]: pgmap v1313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:46 smithi191 ceph-mon[31636]: pgmap v1313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:46 smithi170 ceph-mon[31212]: pgmap v1313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2278.288350 secs 2024-04-21T11:02:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2278.288350 secs 2024-04-21T11:02:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2278.288350 secs 2024-04-21T11:02:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:48 smithi077 ceph-mon[27902]: pgmap v1314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:48 smithi191 ceph-mon[31636]: pgmap v1314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:48 smithi170 ceph-mon[31212]: pgmap v1314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2280.049524 secs 2024-04-21T11:02:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2280.049524 secs 2024-04-21T11:02:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2280.049524 secs 2024-04-21T11:02:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:50 smithi077 ceph-mon[27902]: pgmap v1315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:50 smithi191 ceph-mon[31636]: pgmap v1315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:50 smithi170 ceph-mon[31212]: pgmap v1315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:51 smithi077 ceph-mon[27902]: pgmap v1316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:51 smithi191 ceph-mon[31636]: pgmap v1316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:51 smithi170 ceph-mon[31212]: pgmap v1316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2283.288459 secs 2024-04-21T11:02:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2283.288459 secs 2024-04-21T11:02:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2283.288459 secs 2024-04-21T11:02:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:53 smithi077 ceph-mon[27902]: pgmap v1317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:53 smithi191 ceph-mon[31636]: pgmap v1317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:53 smithi170 ceph-mon[31212]: pgmap v1317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2285.049639 secs 2024-04-21T11:02:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2285.049639 secs 2024-04-21T11:02:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2285.049639 secs 2024-04-21T11:02:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:02:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:55 smithi191 ceph-mon[31636]: pgmap v1318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:55 smithi170 ceph-mon[31212]: pgmap v1318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:55 smithi077 ceph-mon[27902]: pgmap v1318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:02:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2288.288565 secs 2024-04-21T11:02:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2288.288565 secs 2024-04-21T11:02:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2288.288565 secs 2024-04-21T11:02:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:57 smithi077 ceph-mon[27902]: pgmap v1319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:57 smithi191 ceph-mon[31636]: pgmap v1319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:57 smithi170 ceph-mon[31212]: pgmap v1319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:02:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2290.049734 secs 2024-04-21T11:02:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2290.049734 secs 2024-04-21T11:02:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2290.049734 secs 2024-04-21T11:03:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:02:59 smithi077 ceph-mon[27902]: pgmap v1320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:02:59 smithi191 ceph-mon[31636]: pgmap v1320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:02:59 smithi170 ceph-mon[31212]: pgmap v1320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:01 smithi077 ceph-mon[27902]: pgmap v1321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2293.288703 secs 2024-04-21T11:03:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:01 smithi191 ceph-mon[31636]: pgmap v1321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2293.288703 secs 2024-04-21T11:03:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:01 smithi170 ceph-mon[31212]: pgmap v1321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2293.288703 secs 2024-04-21T11:03:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:03 smithi077 ceph-mon[27902]: pgmap v1322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2295.049914 secs 2024-04-21T11:03:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:03 smithi191 ceph-mon[31636]: pgmap v1322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2295.049914 secs 2024-04-21T11:03:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:03 smithi170 ceph-mon[31212]: pgmap v1322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2295.049914 secs 2024-04-21T11:03:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:04 smithi191 ceph-mon[31636]: osdmap e159: 12 total, 12 up, 12 in 2024-04-21T11:03:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:04 smithi170 ceph-mon[31212]: osdmap e159: 12 total, 12 up, 12 in 2024-04-21T11:03:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:04 smithi077 ceph-mon[27902]: osdmap e159: 12 total, 12 up, 12 in 2024-04-21T11:03:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:05 smithi191 ceph-mon[31636]: pgmap v1324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:03:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:05 smithi170 ceph-mon[31212]: pgmap v1324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:03:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:05 smithi077 ceph-mon[27902]: pgmap v1324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:03:07.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2298.288836 secs 2024-04-21T11:03:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2298.288836 secs 2024-04-21T11:03:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2298.288836 secs 2024-04-21T11:03:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:07 smithi191 ceph-mon[31636]: pgmap v1325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:03:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:07 smithi170 ceph-mon[31212]: pgmap v1325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:03:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:07 smithi077 ceph-mon[27902]: pgmap v1325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:03:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2300.050019 secs 2024-04-21T11:03:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2300.050019 secs 2024-04-21T11:03:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2300.050019 secs 2024-04-21T11:03:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:09 smithi191 ceph-mon[31636]: pgmap v1326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:03:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:09 smithi170 ceph-mon[31212]: pgmap v1326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:03:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:09 smithi077 ceph-mon[27902]: pgmap v1326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:03:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:11 smithi191 ceph-mon[31636]: pgmap v1327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:03:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2303.288902 secs 2024-04-21T11:03:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:11 smithi191 ceph-mon[31636]: osdmap e160: 12 total, 12 up, 12 in 2024-04-21T11:03:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:11 smithi170 ceph-mon[31212]: pgmap v1327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:03:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2303.288902 secs 2024-04-21T11:03:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:11 smithi170 ceph-mon[31212]: osdmap e160: 12 total, 12 up, 12 in 2024-04-21T11:03:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:11 smithi077 ceph-mon[27902]: pgmap v1327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:03:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2303.288902 secs 2024-04-21T11:03:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:11 smithi077 ceph-mon[27902]: osdmap e160: 12 total, 12 up, 12 in 2024-04-21T11:03:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:13 smithi191 ceph-mon[31636]: pgmap v1329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:03:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2305.050131 secs 2024-04-21T11:03:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:13 smithi170 ceph-mon[31212]: pgmap v1329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:03:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2305.050131 secs 2024-04-21T11:03:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:13 smithi077 ceph-mon[27902]: pgmap v1329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:03:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2305.050131 secs 2024-04-21T11:03:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:15 smithi191 ceph-mon[31636]: pgmap v1330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:03:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:15 smithi170 ceph-mon[31212]: pgmap v1330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:03:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:15 smithi077 ceph-mon[27902]: pgmap v1330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:03:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2308.288966 secs 2024-04-21T11:03:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:17 smithi077 ceph-mon[27902]: pgmap v1331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:03:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2308.288966 secs 2024-04-21T11:03:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:17 smithi191 ceph-mon[31636]: pgmap v1331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:03:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2308.288966 secs 2024-04-21T11:03:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:17 smithi170 ceph-mon[31212]: pgmap v1331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:03:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2310.050213 secs 2024-04-21T11:03:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2310.050213 secs 2024-04-21T11:03:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2310.050213 secs 2024-04-21T11:03:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:19 smithi077 ceph-mon[27902]: pgmap v1332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:03:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:19 smithi191 ceph-mon[31636]: pgmap v1332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:03:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:19 smithi170 ceph-mon[31212]: pgmap v1332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:03:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:03:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:03:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:03:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:21 smithi191 ceph-mon[31636]: pgmap v1333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:03:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2313.289036 secs 2024-04-21T11:03:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:21 smithi170 ceph-mon[31212]: pgmap v1333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:03:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2313.289036 secs 2024-04-21T11:03:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:21 smithi077 ceph-mon[27902]: pgmap v1333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:03:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2313.289036 secs 2024-04-21T11:03:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:03:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:03:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:03:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:03:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:03:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:03:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:03:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:24 smithi077 ceph-mon[27902]: pgmap v1334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:03:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2315.050333 secs 2024-04-21T11:03:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:24 smithi191 ceph-mon[31636]: pgmap v1334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:03:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2315.050333 secs 2024-04-21T11:03:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:24 smithi170 ceph-mon[31212]: pgmap v1334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:03:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2315.050333 secs 2024-04-21T11:03:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:26 smithi077 ceph-mon[27902]: pgmap v1335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:26 smithi191 ceph-mon[31636]: pgmap v1335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:26 smithi170 ceph-mon[31212]: pgmap v1335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2318.289097 secs 2024-04-21T11:03:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2318.289097 secs 2024-04-21T11:03:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2318.289097 secs 2024-04-21T11:03:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:28 smithi077 ceph-mon[27902]: pgmap v1336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:28 smithi191 ceph-mon[31636]: pgmap v1336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:28 smithi170 ceph-mon[31212]: pgmap v1336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2320.050464 secs 2024-04-21T11:03:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2320.050464 secs 2024-04-21T11:03:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2320.050464 secs 2024-04-21T11:03:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:30 smithi077 ceph-mon[27902]: pgmap v1337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:30 smithi191 ceph-mon[31636]: pgmap v1337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:30 smithi170 ceph-mon[31212]: pgmap v1337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:32 smithi077 ceph-mon[27902]: pgmap v1338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2323.289222 secs 2024-04-21T11:03:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:32 smithi191 ceph-mon[31636]: pgmap v1338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2323.289222 secs 2024-04-21T11:03:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:32 smithi170 ceph-mon[31212]: pgmap v1338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2323.289222 secs 2024-04-21T11:03:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:34 smithi077 ceph-mon[27902]: pgmap v1339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2325.050589 secs 2024-04-21T11:03:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:34 smithi191 ceph-mon[31636]: pgmap v1339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2325.050589 secs 2024-04-21T11:03:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:34 smithi170 ceph-mon[31212]: pgmap v1339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2325.050589 secs 2024-04-21T11:03:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:36 smithi077 ceph-mon[27902]: pgmap v1340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:36.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:36 smithi191 ceph-mon[31636]: pgmap v1340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:36 smithi170 ceph-mon[31212]: pgmap v1340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2328.289307 secs 2024-04-21T11:03:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2328.289307 secs 2024-04-21T11:03:37.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2328.289307 secs 2024-04-21T11:03:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:38 smithi077 ceph-mon[27902]: pgmap v1341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:38 smithi191 ceph-mon[31636]: pgmap v1341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:38 smithi170 ceph-mon[31212]: pgmap v1341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2330.050707 secs 2024-04-21T11:03:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2330.050707 secs 2024-04-21T11:03:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2330.050707 secs 2024-04-21T11:03:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:40 smithi077 ceph-mon[27902]: pgmap v1342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:40 smithi191 ceph-mon[31636]: pgmap v1342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:40 smithi170 ceph-mon[31212]: pgmap v1342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:42 smithi077 ceph-mon[27902]: pgmap v1343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2333.289429 secs 2024-04-21T11:03:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:42 smithi191 ceph-mon[31636]: pgmap v1343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2333.289429 secs 2024-04-21T11:03:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:42 smithi170 ceph-mon[31212]: pgmap v1343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2333.289429 secs 2024-04-21T11:03:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:44 smithi077 ceph-mon[27902]: pgmap v1344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2335.050820 secs 2024-04-21T11:03:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:44 smithi191 ceph-mon[31636]: pgmap v1344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2335.050820 secs 2024-04-21T11:03:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:44 smithi170 ceph-mon[31212]: pgmap v1344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2335.050820 secs 2024-04-21T11:03:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:46 smithi077 ceph-mon[27902]: pgmap v1345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:46 smithi191 ceph-mon[31636]: pgmap v1345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:46 smithi170 ceph-mon[31212]: pgmap v1345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2338.289581 secs 2024-04-21T11:03:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2338.289581 secs 2024-04-21T11:03:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2338.289581 secs 2024-04-21T11:03:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:48 smithi191 ceph-mon[31636]: pgmap v1346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:48 smithi170 ceph-mon[31212]: pgmap v1346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:48 smithi077 ceph-mon[27902]: pgmap v1346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2340.050944 secs 2024-04-21T11:03:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2340.050944 secs 2024-04-21T11:03:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2340.050944 secs 2024-04-21T11:03:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:50 smithi191 ceph-mon[31636]: pgmap v1347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:50 smithi170 ceph-mon[31212]: pgmap v1347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:50 smithi077 ceph-mon[27902]: pgmap v1347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:52 smithi191 ceph-mon[31636]: pgmap v1348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2343.289725 secs 2024-04-21T11:03:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:52 smithi170 ceph-mon[31212]: pgmap v1348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2343.289725 secs 2024-04-21T11:03:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:52 smithi077 ceph-mon[27902]: pgmap v1348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2343.289725 secs 2024-04-21T11:03:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:54 smithi191 ceph-mon[31636]: pgmap v1349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2345.051044 secs 2024-04-21T11:03:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:54 smithi170 ceph-mon[31212]: pgmap v1349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2345.051044 secs 2024-04-21T11:03:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:54 smithi077 ceph-mon[27902]: pgmap v1349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2345.051044 secs 2024-04-21T11:03:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:03:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:56 smithi191 ceph-mon[31636]: pgmap v1350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:56 smithi170 ceph-mon[31212]: pgmap v1350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:56 smithi077 ceph-mon[27902]: pgmap v1350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:03:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2348.289842 secs 2024-04-21T11:03:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2348.289842 secs 2024-04-21T11:03:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2348.289842 secs 2024-04-21T11:03:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:58 smithi191 ceph-mon[31636]: pgmap v1351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:58 smithi170 ceph-mon[31212]: pgmap v1351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:58 smithi077 ceph-mon[27902]: pgmap v1351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:03:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:03:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2350.051144 secs 2024-04-21T11:03:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:03:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2350.051144 secs 2024-04-21T11:03:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:03:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2350.051144 secs 2024-04-21T11:04:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:00 smithi191 ceph-mon[31636]: pgmap v1352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:00 smithi170 ceph-mon[31212]: pgmap v1352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:00 smithi077 ceph-mon[27902]: pgmap v1352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:02 smithi191 ceph-mon[31636]: pgmap v1353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2353.289965 secs 2024-04-21T11:04:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:02 smithi170 ceph-mon[31212]: pgmap v1353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2353.289965 secs 2024-04-21T11:04:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:02 smithi077 ceph-mon[27902]: pgmap v1353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2353.289965 secs 2024-04-21T11:04:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:04 smithi191 ceph-mon[31636]: pgmap v1354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2355.051269 secs 2024-04-21T11:04:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:04 smithi170 ceph-mon[31212]: pgmap v1354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2355.051269 secs 2024-04-21T11:04:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:04 smithi077 ceph-mon[27902]: pgmap v1354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2355.051269 secs 2024-04-21T11:04:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:05 smithi191 ceph-mon[31636]: osdmap e161: 12 total, 12 up, 12 in 2024-04-21T11:04:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:05 smithi170 ceph-mon[31212]: osdmap e161: 12 total, 12 up, 12 in 2024-04-21T11:04:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:05 smithi077 ceph-mon[27902]: osdmap e161: 12 total, 12 up, 12 in 2024-04-21T11:04:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:06 smithi191 ceph-mon[31636]: pgmap v1356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:04:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:06 smithi170 ceph-mon[31212]: pgmap v1356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:04:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:06 smithi077 ceph-mon[27902]: pgmap v1356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:04:07.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2358.290066 secs 2024-04-21T11:04:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2358.290066 secs 2024-04-21T11:04:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2358.290066 secs 2024-04-21T11:04:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:08 smithi191 ceph-mon[31636]: pgmap v1357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:04:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:08 smithi170 ceph-mon[31212]: pgmap v1357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:04:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:08 smithi077 ceph-mon[27902]: pgmap v1357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:04:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2360.051386 secs 2024-04-21T11:04:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2360.051386 secs 2024-04-21T11:04:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2360.051386 secs 2024-04-21T11:04:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:10 smithi191 ceph-mon[31636]: pgmap v1358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:04:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:10 smithi170 ceph-mon[31212]: pgmap v1358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:04:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:10 smithi077 ceph-mon[27902]: pgmap v1358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:04:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:12 smithi191 ceph-mon[31636]: pgmap v1359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:04:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2363.290185 secs 2024-04-21T11:04:12.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:12 smithi191 ceph-mon[31636]: osdmap e162: 12 total, 12 up, 12 in 2024-04-21T11:04:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:12 smithi170 ceph-mon[31212]: pgmap v1359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:04:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2363.290185 secs 2024-04-21T11:04:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:12 smithi170 ceph-mon[31212]: osdmap e162: 12 total, 12 up, 12 in 2024-04-21T11:04:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:12 smithi077 ceph-mon[27902]: pgmap v1359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:04:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2363.290185 secs 2024-04-21T11:04:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:12 smithi077 ceph-mon[27902]: osdmap e162: 12 total, 12 up, 12 in 2024-04-21T11:04:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:14 smithi191 ceph-mon[31636]: pgmap v1361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T11:04:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2365.051536 secs 2024-04-21T11:04:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:14 smithi170 ceph-mon[31212]: pgmap v1361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T11:04:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2365.051536 secs 2024-04-21T11:04:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:14 smithi077 ceph-mon[27902]: pgmap v1361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T11:04:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2365.051536 secs 2024-04-21T11:04:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:16 smithi191 ceph-mon[31636]: pgmap v1362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:04:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:16 smithi170 ceph-mon[31212]: pgmap v1362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:04:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:16 smithi077 ceph-mon[27902]: pgmap v1362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:04:17.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2368.290264 secs 2024-04-21T11:04:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2368.290264 secs 2024-04-21T11:04:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2368.290264 secs 2024-04-21T11:04:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:18 smithi170 ceph-mon[31212]: pgmap v1363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:04:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:18 smithi077 ceph-mon[27902]: pgmap v1363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:04:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:18 smithi191 ceph-mon[31636]: pgmap v1363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:04:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2370.051653 secs 2024-04-21T11:04:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2370.051653 secs 2024-04-21T11:04:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2370.051653 secs 2024-04-21T11:04:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:20 smithi170 ceph-mon[31212]: pgmap v1364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:04:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:20 smithi077 ceph-mon[27902]: pgmap v1364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:04:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:20 smithi191 ceph-mon[31636]: pgmap v1364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:04:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:22 smithi170 ceph-mon[31212]: pgmap v1365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:04:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2373.290382 secs 2024-04-21T11:04:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:22 smithi077 ceph-mon[27902]: pgmap v1365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:04:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2373.290382 secs 2024-04-21T11:04:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:22 smithi191 ceph-mon[31636]: pgmap v1365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:04:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2373.290382 secs 2024-04-21T11:04:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:04:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:04:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:04:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:24 smithi170 ceph-mon[31212]: pgmap v1366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:04:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2375.051742 secs 2024-04-21T11:04:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:04:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:04:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:24 smithi077 ceph-mon[27902]: pgmap v1366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:04:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2375.051742 secs 2024-04-21T11:04:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:04:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:04:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:24 smithi191 ceph-mon[31636]: pgmap v1366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:04:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2375.051742 secs 2024-04-21T11:04:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:04:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:04:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:04:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:26 smithi170 ceph-mon[31212]: pgmap v1367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:26 smithi077 ceph-mon[27902]: pgmap v1367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:26 smithi191 ceph-mon[31636]: pgmap v1367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2378.290506 secs 2024-04-21T11:04:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2378.290506 secs 2024-04-21T11:04:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2378.290506 secs 2024-04-21T11:04:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:28 smithi170 ceph-mon[31212]: pgmap v1368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:28 smithi077 ceph-mon[27902]: pgmap v1368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:28 smithi191 ceph-mon[31636]: pgmap v1368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2380.051835 secs 2024-04-21T11:04:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2380.051835 secs 2024-04-21T11:04:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2380.051835 secs 2024-04-21T11:04:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:30 smithi170 ceph-mon[31212]: pgmap v1369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:30 smithi077 ceph-mon[27902]: pgmap v1369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:30 smithi191 ceph-mon[31636]: pgmap v1369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:32 smithi170 ceph-mon[31212]: pgmap v1370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2383.290625 secs 2024-04-21T11:04:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:32 smithi077 ceph-mon[27902]: pgmap v1370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2383.290625 secs 2024-04-21T11:04:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:32 smithi191 ceph-mon[31636]: pgmap v1370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2383.290625 secs 2024-04-21T11:04:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:34 smithi170 ceph-mon[31212]: pgmap v1371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2385.051953 secs 2024-04-21T11:04:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:34 smithi077 ceph-mon[27902]: pgmap v1371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2385.051953 secs 2024-04-21T11:04:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:34 smithi191 ceph-mon[31636]: pgmap v1371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2385.051953 secs 2024-04-21T11:04:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:36 smithi170 ceph-mon[31212]: pgmap v1372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:36 smithi077 ceph-mon[27902]: pgmap v1372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:36 smithi191 ceph-mon[31636]: pgmap v1372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2388.290792 secs 2024-04-21T11:04:37.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2388.290792 secs 2024-04-21T11:04:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2388.290792 secs 2024-04-21T11:04:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:38 smithi170 ceph-mon[31212]: pgmap v1373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:38 smithi077 ceph-mon[27902]: pgmap v1373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:38 smithi191 ceph-mon[31636]: pgmap v1373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2390.052031 secs 2024-04-21T11:04:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2390.052031 secs 2024-04-21T11:04:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2390.052031 secs 2024-04-21T11:04:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:40 smithi170 ceph-mon[31212]: pgmap v1374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:40 smithi077 ceph-mon[27902]: pgmap v1374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:40 smithi191 ceph-mon[31636]: pgmap v1374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:42 smithi170 ceph-mon[31212]: pgmap v1375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2393.290909 secs 2024-04-21T11:04:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:42 smithi077 ceph-mon[27902]: pgmap v1375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2393.290909 secs 2024-04-21T11:04:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:42 smithi191 ceph-mon[31636]: pgmap v1375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2393.290909 secs 2024-04-21T11:04:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:44 smithi170 ceph-mon[31212]: pgmap v1376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2395.052148 secs 2024-04-21T11:04:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:44 smithi077 ceph-mon[27902]: pgmap v1376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2395.052148 secs 2024-04-21T11:04:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:44 smithi191 ceph-mon[31636]: pgmap v1376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2395.052148 secs 2024-04-21T11:04:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:46 smithi170 ceph-mon[31212]: pgmap v1377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:46 smithi077 ceph-mon[27902]: pgmap v1377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:46 smithi191 ceph-mon[31636]: pgmap v1377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2398.291027 secs 2024-04-21T11:04:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2398.291027 secs 2024-04-21T11:04:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2398.291027 secs 2024-04-21T11:04:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:48 smithi170 ceph-mon[31212]: pgmap v1378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:48 smithi077 ceph-mon[27902]: pgmap v1378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:48 smithi191 ceph-mon[31636]: pgmap v1378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2400.052270 secs 2024-04-21T11:04:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2400.052270 secs 2024-04-21T11:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2400.052270 secs 2024-04-21T11:04:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:50 smithi077 ceph-mon[27902]: pgmap v1379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:50 smithi191 ceph-mon[31636]: pgmap v1379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:50 smithi170 ceph-mon[31212]: pgmap v1379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:52 smithi077 ceph-mon[27902]: pgmap v1380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2403.291094 secs 2024-04-21T11:04:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:52 smithi191 ceph-mon[31636]: pgmap v1380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2403.291094 secs 2024-04-21T11:04:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:52 smithi170 ceph-mon[31212]: pgmap v1380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2403.291094 secs 2024-04-21T11:04:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:54 smithi077 ceph-mon[27902]: pgmap v1381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2405.052394 secs 2024-04-21T11:04:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:04:54.680+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:04:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:04:54.680+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:04:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:04:54.681+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:04:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:04:54.681+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:04:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:54 smithi191 ceph-mon[31636]: pgmap v1381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2405.052394 secs 2024-04-21T11:04:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:54 smithi170 ceph-mon[31212]: pgmap v1381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2405.052394 secs 2024-04-21T11:04:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:04:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:56 smithi077 ceph-mon[27902]: pgmap v1382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:56 smithi191 ceph-mon[31636]: pgmap v1382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:56 smithi170 ceph-mon[31212]: pgmap v1382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:04:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2408.291218 secs 2024-04-21T11:04:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2408.291218 secs 2024-04-21T11:04:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2408.291218 secs 2024-04-21T11:04:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:58 smithi077 ceph-mon[27902]: pgmap v1383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:58 smithi191 ceph-mon[31636]: pgmap v1383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:58 smithi170 ceph-mon[31212]: pgmap v1383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:04:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:04:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2410.052520 secs 2024-04-21T11:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:04:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2410.052520 secs 2024-04-21T11:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:04:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2410.052520 secs 2024-04-21T11:05:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:00 smithi077 ceph-mon[27902]: pgmap v1384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:00 smithi191 ceph-mon[31636]: pgmap v1384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:00 smithi170 ceph-mon[31212]: pgmap v1384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:02 smithi077 ceph-mon[27902]: pgmap v1385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2413.291340 secs 2024-04-21T11:05:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:02 smithi191 ceph-mon[31636]: pgmap v1385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2413.291340 secs 2024-04-21T11:05:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:02 smithi170 ceph-mon[31212]: pgmap v1385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2413.291340 secs 2024-04-21T11:05:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:04 smithi077 ceph-mon[27902]: pgmap v1386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2415.052652 secs 2024-04-21T11:05:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:04 smithi191 ceph-mon[31636]: pgmap v1386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2415.052652 secs 2024-04-21T11:05:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:04 smithi170 ceph-mon[31212]: pgmap v1386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2415.052652 secs 2024-04-21T11:05:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:06 smithi077 ceph-mon[27902]: pgmap v1387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:06 smithi191 ceph-mon[31636]: pgmap v1387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:06 smithi170 ceph-mon[31212]: pgmap v1387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:07.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2418.291431 secs 2024-04-21T11:05:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2418.291431 secs 2024-04-21T11:05:07.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2418.291431 secs 2024-04-21T11:05:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:08 smithi077 ceph-mon[27902]: pgmap v1388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:08 smithi191 ceph-mon[31636]: pgmap v1388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:08 smithi170 ceph-mon[31212]: pgmap v1388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2420.052785 secs 2024-04-21T11:05:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2420.052785 secs 2024-04-21T11:05:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2420.052785 secs 2024-04-21T11:05:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:10 smithi077 ceph-mon[27902]: pgmap v1389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:10 smithi191 ceph-mon[31636]: pgmap v1389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:10 smithi170 ceph-mon[31212]: pgmap v1389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:12 smithi077 ceph-mon[27902]: pgmap v1390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2423.291550 secs 2024-04-21T11:05:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:12 smithi191 ceph-mon[31636]: pgmap v1390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2423.291550 secs 2024-04-21T11:05:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:12 smithi170 ceph-mon[31212]: pgmap v1390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2423.291550 secs 2024-04-21T11:05:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:14 smithi077 ceph-mon[27902]: pgmap v1391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2425.052916 secs 2024-04-21T11:05:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:14 smithi191 ceph-mon[31636]: pgmap v1391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2425.052916 secs 2024-04-21T11:05:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:14 smithi170 ceph-mon[31212]: pgmap v1391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2425.052916 secs 2024-04-21T11:05:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:16 smithi077 ceph-mon[27902]: pgmap v1392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:16 smithi191 ceph-mon[31636]: pgmap v1392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:17.161 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:16 smithi170 ceph-mon[31212]: pgmap v1392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T11:05:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2428.291668 secs 2024-04-21T11:05:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2428.291668 secs 2024-04-21T11:05:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2428.291668 secs 2024-04-21T11:05:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:18 smithi077 ceph-mon[27902]: pgmap v1393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:18 smithi191 ceph-mon[31636]: pgmap v1393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:18 smithi170 ceph-mon[31212]: pgmap v1393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T11:05:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2430.053013 secs 2024-04-21T11:05:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2430.053013 secs 2024-04-21T11:05:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2430.053013 secs 2024-04-21T11:05:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:20 smithi077 ceph-mon[27902]: pgmap v1394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:20 smithi191 ceph-mon[31636]: pgmap v1394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:20 smithi170 ceph-mon[31212]: pgmap v1394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:22 smithi191 ceph-mon[31636]: pgmap v1395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2433.291815 secs 2024-04-21T11:05:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:22 smithi170 ceph-mon[31212]: pgmap v1395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2433.291815 secs 2024-04-21T11:05:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:22 smithi077 ceph-mon[27902]: pgmap v1395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2433.291815 secs 2024-04-21T11:05:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:24 smithi191 ceph-mon[31636]: pgmap v1396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2435.053129 secs 2024-04-21T11:05:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:05:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:05:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:05:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:05:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:24 smithi170 ceph-mon[31212]: pgmap v1396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2435.053129 secs 2024-04-21T11:05:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:05:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:05:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:05:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:05:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:24 smithi077 ceph-mon[27902]: pgmap v1396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2435.053129 secs 2024-04-21T11:05:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:05:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:05:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:05:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:05:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:25 smithi191 ceph-mon[31636]: pgmap v1397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:25 smithi170 ceph-mon[31212]: pgmap v1397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:25 smithi077 ceph-mon[27902]: pgmap v1397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2438.291930 secs 2024-04-21T11:05:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2438.291930 secs 2024-04-21T11:05:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2438.291930 secs 2024-04-21T11:05:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:27 smithi077 ceph-mon[27902]: pgmap v1398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:27 smithi191 ceph-mon[31636]: pgmap v1398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:27 smithi170 ceph-mon[31212]: pgmap v1398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2440.053286 secs 2024-04-21T11:05:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2440.053286 secs 2024-04-21T11:05:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2440.053286 secs 2024-04-21T11:05:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:29 smithi077 ceph-mon[27902]: pgmap v1399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:29 smithi191 ceph-mon[31636]: pgmap v1399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:29 smithi170 ceph-mon[31212]: pgmap v1399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:31 smithi191 ceph-mon[31636]: pgmap v1400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2443.292085 secs 2024-04-21T11:05:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:31 smithi170 ceph-mon[31212]: pgmap v1400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2443.292085 secs 2024-04-21T11:05:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:31 smithi077 ceph-mon[27902]: pgmap v1400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2443.292085 secs 2024-04-21T11:05:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:33 smithi191 ceph-mon[31636]: pgmap v1401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2445.053406 secs 2024-04-21T11:05:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:33 smithi170 ceph-mon[31212]: pgmap v1401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2445.053406 secs 2024-04-21T11:05:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:33 smithi077 ceph-mon[27902]: pgmap v1401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2445.053406 secs 2024-04-21T11:05:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:35 smithi191 ceph-mon[31636]: pgmap v1402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:35 smithi170 ceph-mon[31212]: pgmap v1402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:35 smithi077 ceph-mon[27902]: pgmap v1402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:37.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2448.292231 secs 2024-04-21T11:05:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2448.292231 secs 2024-04-21T11:05:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2448.292231 secs 2024-04-21T11:05:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:37 smithi191 ceph-mon[31636]: pgmap v1403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:37 smithi170 ceph-mon[31212]: pgmap v1403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:37 smithi077 ceph-mon[27902]: pgmap v1403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2450.053518 secs 2024-04-21T11:05:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2450.053518 secs 2024-04-21T11:05:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2450.053518 secs 2024-04-21T11:05:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:39 smithi191 ceph-mon[31636]: pgmap v1404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:39 smithi170 ceph-mon[31212]: pgmap v1404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:39 smithi077 ceph-mon[27902]: pgmap v1404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:41 smithi191 ceph-mon[31636]: pgmap v1405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2453.292386 secs 2024-04-21T11:05:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:41 smithi170 ceph-mon[31212]: pgmap v1405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2453.292386 secs 2024-04-21T11:05:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:41 smithi077 ceph-mon[27902]: pgmap v1405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2453.292386 secs 2024-04-21T11:05:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:43 smithi191 ceph-mon[31636]: pgmap v1406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2455.053636 secs 2024-04-21T11:05:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:43 smithi170 ceph-mon[31212]: pgmap v1406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2455.053636 secs 2024-04-21T11:05:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:43 smithi077 ceph-mon[27902]: pgmap v1406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2455.053636 secs 2024-04-21T11:05:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:45 smithi191 ceph-mon[31636]: pgmap v1407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:45 smithi170 ceph-mon[31212]: pgmap v1407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:45 smithi077 ceph-mon[27902]: pgmap v1407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2458.292526 secs 2024-04-21T11:05:47.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2458.292526 secs 2024-04-21T11:05:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2458.292526 secs 2024-04-21T11:05:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:47 smithi191 ceph-mon[31636]: pgmap v1408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:48.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:47 smithi170 ceph-mon[31212]: pgmap v1408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:47 smithi077 ceph-mon[27902]: pgmap v1408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2460.053768 secs 2024-04-21T11:05:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2460.053768 secs 2024-04-21T11:05:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2460.053768 secs 2024-04-21T11:05:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:49 smithi191 ceph-mon[31636]: pgmap v1409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:49 smithi170 ceph-mon[31212]: pgmap v1409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:49 smithi077 ceph-mon[27902]: pgmap v1409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:51 smithi191 ceph-mon[31636]: pgmap v1410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2463.292656 secs 2024-04-21T11:05:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:51 smithi170 ceph-mon[31212]: pgmap v1410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2463.292656 secs 2024-04-21T11:05:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:51 smithi077 ceph-mon[27902]: pgmap v1410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2463.292656 secs 2024-04-21T11:05:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:53 smithi191 ceph-mon[31636]: pgmap v1411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2465.053874 secs 2024-04-21T11:05:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:53 smithi170 ceph-mon[31212]: pgmap v1411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2465.053874 secs 2024-04-21T11:05:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:53 smithi077 ceph-mon[27902]: pgmap v1411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2465.053874 secs 2024-04-21T11:05:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:05:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:55 smithi191 ceph-mon[31636]: pgmap v1412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:55 smithi170 ceph-mon[31212]: pgmap v1412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:55 smithi077 ceph-mon[27902]: pgmap v1412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:05:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2468.292801 secs 2024-04-21T11:05:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2468.292801 secs 2024-04-21T11:05:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2468.292801 secs 2024-04-21T11:05:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:57 smithi170 ceph-mon[31212]: pgmap v1413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:57 smithi077 ceph-mon[27902]: pgmap v1413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:57 smithi191 ceph-mon[31636]: pgmap v1413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:05:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2470.053991 secs 2024-04-21T11:05:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2470.053991 secs 2024-04-21T11:05:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2470.053991 secs 2024-04-21T11:06:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:05:59 smithi170 ceph-mon[31212]: pgmap v1414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:05:59 smithi077 ceph-mon[27902]: pgmap v1414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:05:59 smithi191 ceph-mon[31636]: pgmap v1414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:01 smithi170 ceph-mon[31212]: pgmap v1415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T11:06:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2473.292959 secs 2024-04-21T11:06:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:01 smithi077 ceph-mon[27902]: pgmap v1415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T11:06:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2473.292959 secs 2024-04-21T11:06:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:01 smithi191 ceph-mon[31636]: pgmap v1415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T11:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2473.292959 secs 2024-04-21T11:06:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:03 smithi170 ceph-mon[31212]: pgmap v1416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T11:06:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2475.054111 secs 2024-04-21T11:06:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:03 smithi077 ceph-mon[27902]: pgmap v1416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T11:06:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2475.054111 secs 2024-04-21T11:06:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:03 smithi191 ceph-mon[31636]: pgmap v1416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T11:06:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2475.054111 secs 2024-04-21T11:06:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:05 smithi170 ceph-mon[31212]: osdmap e163: 12 total, 12 up, 12 in 2024-04-21T11:06:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:05 smithi077 ceph-mon[27902]: osdmap e163: 12 total, 12 up, 12 in 2024-04-21T11:06:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:05 smithi191 ceph-mon[31636]: osdmap e163: 12 total, 12 up, 12 in 2024-04-21T11:06:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:06 smithi170 ceph-mon[31212]: pgmap v1418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:06 smithi077 ceph-mon[27902]: pgmap v1418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:06 smithi191 ceph-mon[31636]: pgmap v1418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2478.293025 secs 2024-04-21T11:06:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:07 smithi077 ceph-mon[27902]: pgmap v1419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2478.293025 secs 2024-04-21T11:06:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:07 smithi191 ceph-mon[31636]: pgmap v1419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2478.293025 secs 2024-04-21T11:06:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:07 smithi170 ceph-mon[31212]: pgmap v1419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2480.054220 secs 2024-04-21T11:06:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2480.054220 secs 2024-04-21T11:06:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2480.054220 secs 2024-04-21T11:06:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:09 smithi077 ceph-mon[27902]: pgmap v1420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:09 smithi191 ceph-mon[31636]: pgmap v1420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:09 smithi170 ceph-mon[31212]: pgmap v1420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:06:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:11 smithi191 ceph-mon[31636]: pgmap v1421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T11:06:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2483.293169 secs 2024-04-21T11:06:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:11 smithi191 ceph-mon[31636]: osdmap e164: 12 total, 12 up, 12 in 2024-04-21T11:06:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:11 smithi170 ceph-mon[31212]: pgmap v1421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T11:06:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2483.293169 secs 2024-04-21T11:06:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:11 smithi170 ceph-mon[31212]: osdmap e164: 12 total, 12 up, 12 in 2024-04-21T11:06:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:11 smithi077 ceph-mon[27902]: pgmap v1421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T11:06:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2483.293169 secs 2024-04-21T11:06:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:11 smithi077 ceph-mon[27902]: osdmap e164: 12 total, 12 up, 12 in 2024-04-21T11:06:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:13 smithi191 ceph-mon[31636]: pgmap v1423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 346 B/s wr, 7 op/s 2024-04-21T11:06:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2485.054333 secs 2024-04-21T11:06:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:13 smithi170 ceph-mon[31212]: pgmap v1423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 346 B/s wr, 7 op/s 2024-04-21T11:06:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2485.054333 secs 2024-04-21T11:06:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:13 smithi077 ceph-mon[27902]: pgmap v1423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 346 B/s wr, 7 op/s 2024-04-21T11:06:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2485.054333 secs 2024-04-21T11:06:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:15 smithi191 ceph-mon[31636]: pgmap v1424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T11:06:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:15 smithi170 ceph-mon[31212]: pgmap v1424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T11:06:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:15 smithi077 ceph-mon[27902]: pgmap v1424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T11:06:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2488.293276 secs 2024-04-21T11:06:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:17 smithi077 ceph-mon[27902]: pgmap v1425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:06:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2488.293276 secs 2024-04-21T11:06:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:17 smithi191 ceph-mon[31636]: pgmap v1425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:06:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2488.293276 secs 2024-04-21T11:06:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:17 smithi170 ceph-mon[31212]: pgmap v1425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:06:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2490.054449 secs 2024-04-21T11:06:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2490.054449 secs 2024-04-21T11:06:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2490.054449 secs 2024-04-21T11:06:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:19 smithi077 ceph-mon[27902]: pgmap v1426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:06:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:19 smithi191 ceph-mon[31636]: pgmap v1426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:06:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:19 smithi170 ceph-mon[31212]: pgmap v1426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:06:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:21 smithi191 ceph-mon[31636]: pgmap v1427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:06:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2493.293427 secs 2024-04-21T11:06:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:21 smithi170 ceph-mon[31212]: pgmap v1427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:06:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2493.293427 secs 2024-04-21T11:06:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:21 smithi077 ceph-mon[27902]: pgmap v1427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:06:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2493.293427 secs 2024-04-21T11:06:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:23 smithi191 ceph-mon[31636]: pgmap v1428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:06:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2495.054597 secs 2024-04-21T11:06:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:23 smithi170 ceph-mon[31212]: pgmap v1428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:06:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2495.054597 secs 2024-04-21T11:06:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:23 smithi077 ceph-mon[27902]: pgmap v1428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:06:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2495.054597 secs 2024-04-21T11:06:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:06:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:06:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:06:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:25 smithi191 ceph-mon[31636]: pgmap v1429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:06:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:06:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:06:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:25 smithi170 ceph-mon[31212]: pgmap v1429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:06:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:06:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:06:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:25 smithi077 ceph-mon[27902]: pgmap v1429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:06:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:06:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:06:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2498.293554 secs 2024-04-21T11:06:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2498.293554 secs 2024-04-21T11:06:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2498.293554 secs 2024-04-21T11:06:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:27 smithi191 ceph-mon[31636]: pgmap v1430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:27 smithi170 ceph-mon[31212]: pgmap v1430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:27 smithi077 ceph-mon[27902]: pgmap v1430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2500.054695 secs 2024-04-21T11:06:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2500.054695 secs 2024-04-21T11:06:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2500.054695 secs 2024-04-21T11:06:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:29 smithi191 ceph-mon[31636]: pgmap v1431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:29 smithi170 ceph-mon[31212]: pgmap v1431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:29 smithi077 ceph-mon[27902]: pgmap v1431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:31 smithi191 ceph-mon[31636]: pgmap v1432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2503.293691 secs 2024-04-21T11:06:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:31 smithi170 ceph-mon[31212]: pgmap v1432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2503.293691 secs 2024-04-21T11:06:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:31 smithi077 ceph-mon[27902]: pgmap v1432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2503.293691 secs 2024-04-21T11:06:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:33 smithi191 ceph-mon[31636]: pgmap v1433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2505.054759 secs 2024-04-21T11:06:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:33 smithi170 ceph-mon[31212]: pgmap v1433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2505.054759 secs 2024-04-21T11:06:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:33 smithi077 ceph-mon[27902]: pgmap v1433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2505.054759 secs 2024-04-21T11:06:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:35 smithi191 ceph-mon[31636]: pgmap v1434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:35 smithi170 ceph-mon[31212]: pgmap v1434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:35 smithi077 ceph-mon[27902]: pgmap v1434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2508.293807 secs 2024-04-21T11:06:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2508.293807 secs 2024-04-21T11:06:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2508.293807 secs 2024-04-21T11:06:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:37 smithi170 ceph-mon[31212]: pgmap v1435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:37 smithi077 ceph-mon[27902]: pgmap v1435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:37 smithi191 ceph-mon[31636]: pgmap v1435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2510.054836 secs 2024-04-21T11:06:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2510.054836 secs 2024-04-21T11:06:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2510.054836 secs 2024-04-21T11:06:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:39 smithi170 ceph-mon[31212]: pgmap v1436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:39 smithi077 ceph-mon[27902]: pgmap v1436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:39 smithi191 ceph-mon[31636]: pgmap v1436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:41 smithi170 ceph-mon[31212]: pgmap v1437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2513.293922 secs 2024-04-21T11:06:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:41 smithi077 ceph-mon[27902]: pgmap v1437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2513.293922 secs 2024-04-21T11:06:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:41 smithi191 ceph-mon[31636]: pgmap v1437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2513.293922 secs 2024-04-21T11:06:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:43 smithi170 ceph-mon[31212]: pgmap v1438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2515.054890 secs 2024-04-21T11:06:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:43 smithi077 ceph-mon[27902]: pgmap v1438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2515.054890 secs 2024-04-21T11:06:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:43 smithi191 ceph-mon[31636]: pgmap v1438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2515.054890 secs 2024-04-21T11:06:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:45 smithi170 ceph-mon[31212]: pgmap v1439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:45 smithi077 ceph-mon[27902]: pgmap v1439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:45 smithi191 ceph-mon[31636]: pgmap v1439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:47.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2518.293988 secs 2024-04-21T11:06:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2518.293988 secs 2024-04-21T11:06:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2518.293988 secs 2024-04-21T11:06:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:47 smithi170 ceph-mon[31212]: pgmap v1440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:47 smithi077 ceph-mon[27902]: pgmap v1440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:47 smithi191 ceph-mon[31636]: pgmap v1440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2520.055013 secs 2024-04-21T11:06:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2520.055013 secs 2024-04-21T11:06:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2520.055013 secs 2024-04-21T11:06:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:50 smithi170 ceph-mon[31212]: pgmap v1441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:50 smithi077 ceph-mon[27902]: pgmap v1441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:50 smithi191 ceph-mon[31636]: pgmap v1441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:52 smithi170 ceph-mon[31212]: pgmap v1442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2523.294088 secs 2024-04-21T11:06:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:52 smithi077 ceph-mon[27902]: pgmap v1442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2523.294088 secs 2024-04-21T11:06:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:52 smithi191 ceph-mon[31636]: pgmap v1442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2523.294088 secs 2024-04-21T11:06:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:54 smithi170 ceph-mon[31212]: pgmap v1443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2525.055146 secs 2024-04-21T11:06:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:54 smithi077 ceph-mon[27902]: pgmap v1443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2525.055146 secs 2024-04-21T11:06:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:54 smithi191 ceph-mon[31636]: pgmap v1443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2525.055146 secs 2024-04-21T11:06:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:06:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:56 smithi170 ceph-mon[31212]: pgmap v1444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:56 smithi077 ceph-mon[27902]: pgmap v1444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:56 smithi191 ceph-mon[31636]: pgmap v1444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:06:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2528.294170 secs 2024-04-21T11:06:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2528.294170 secs 2024-04-21T11:06:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2528.294170 secs 2024-04-21T11:06:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:58 smithi170 ceph-mon[31212]: pgmap v1445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:58 smithi077 ceph-mon[27902]: pgmap v1445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:58 smithi191 ceph-mon[31636]: pgmap v1445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:06:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:06:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2530.055267 secs 2024-04-21T11:06:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:06:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2530.055267 secs 2024-04-21T11:06:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:06:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2530.055267 secs 2024-04-21T11:07:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:00 smithi170 ceph-mon[31212]: pgmap v1446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:00 smithi077 ceph-mon[27902]: pgmap v1446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:00 smithi191 ceph-mon[31636]: pgmap v1446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:02 smithi170 ceph-mon[31212]: pgmap v1447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:07:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2533.294248 secs 2024-04-21T11:07:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:02 smithi077 ceph-mon[27902]: pgmap v1447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:07:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2533.294248 secs 2024-04-21T11:07:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:02 smithi191 ceph-mon[31636]: pgmap v1447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:07:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2533.294248 secs 2024-04-21T11:07:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:04 smithi170 ceph-mon[31212]: pgmap v1448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:07:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2535.055361 secs 2024-04-21T11:07:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:04 smithi077 ceph-mon[27902]: pgmap v1448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:07:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2535.055361 secs 2024-04-21T11:07:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:04 smithi191 ceph-mon[31636]: pgmap v1448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:07:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2535.055361 secs 2024-04-21T11:07:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:05 smithi170 ceph-mon[31212]: osdmap e165: 12 total, 12 up, 12 in 2024-04-21T11:07:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:05 smithi077 ceph-mon[27902]: osdmap e165: 12 total, 12 up, 12 in 2024-04-21T11:07:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:05 smithi191 ceph-mon[31636]: osdmap e165: 12 total, 12 up, 12 in 2024-04-21T11:07:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:06 smithi170 ceph-mon[31212]: pgmap v1450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:06 smithi077 ceph-mon[27902]: pgmap v1450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:06 smithi191 ceph-mon[31636]: pgmap v1450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:07.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2538.294339 secs 2024-04-21T11:07:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2538.294339 secs 2024-04-21T11:07:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2538.294339 secs 2024-04-21T11:07:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:08 smithi077 ceph-mon[27902]: pgmap v1451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:08.456 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:08 smithi170 ceph-mon[31212]: pgmap v1451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:08 smithi191 ceph-mon[31636]: pgmap v1451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2540.055475 secs 2024-04-21T11:07:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2540.055475 secs 2024-04-21T11:07:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2540.055475 secs 2024-04-21T11:07:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:10 smithi077 ceph-mon[27902]: pgmap v1452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:10 smithi191 ceph-mon[31636]: pgmap v1452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:10 smithi170 ceph-mon[31212]: pgmap v1452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:12 smithi077 ceph-mon[27902]: pgmap v1453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2543.294459 secs 2024-04-21T11:07:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:12 smithi077 ceph-mon[27902]: osdmap e166: 12 total, 12 up, 12 in 2024-04-21T11:07:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:12 smithi191 ceph-mon[31636]: pgmap v1453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2543.294459 secs 2024-04-21T11:07:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:12 smithi191 ceph-mon[31636]: osdmap e166: 12 total, 12 up, 12 in 2024-04-21T11:07:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:12 smithi170 ceph-mon[31212]: pgmap v1453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2543.294459 secs 2024-04-21T11:07:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:12 smithi170 ceph-mon[31212]: osdmap e166: 12 total, 12 up, 12 in 2024-04-21T11:07:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:14 smithi077 ceph-mon[27902]: pgmap v1455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:07:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2545.055591 secs 2024-04-21T11:07:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:14 smithi191 ceph-mon[31636]: pgmap v1455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:07:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2545.055591 secs 2024-04-21T11:07:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:14 smithi170 ceph-mon[31212]: pgmap v1455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:07:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2545.055591 secs 2024-04-21T11:07:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:16 smithi077 ceph-mon[27902]: pgmap v1456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:16 smithi191 ceph-mon[31636]: pgmap v1456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:16 smithi170 ceph-mon[31212]: pgmap v1456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:07:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2548.294566 secs 2024-04-21T11:07:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:17 smithi077 ceph-mon[27902]: pgmap v1457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2548.294566 secs 2024-04-21T11:07:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:17 smithi191 ceph-mon[31636]: pgmap v1457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2548.294566 secs 2024-04-21T11:07:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:17 smithi170 ceph-mon[31212]: pgmap v1457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2550.055679 secs 2024-04-21T11:07:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2550.055679 secs 2024-04-21T11:07:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2550.055679 secs 2024-04-21T11:07:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:19 smithi077 ceph-mon[27902]: pgmap v1458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:19 smithi191 ceph-mon[31636]: pgmap v1458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:19 smithi170 ceph-mon[31212]: pgmap v1458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:07:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:21 smithi191 ceph-mon[31636]: pgmap v1459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:07:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2553.294687 secs 2024-04-21T11:07:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:21 smithi170 ceph-mon[31212]: pgmap v1459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:07:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2553.294687 secs 2024-04-21T11:07:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:21 smithi077 ceph-mon[27902]: pgmap v1459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:07:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2553.294687 secs 2024-04-21T11:07:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:23 smithi191 ceph-mon[31636]: pgmap v1460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:07:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2555.055801 secs 2024-04-21T11:07:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:23 smithi170 ceph-mon[31212]: pgmap v1460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:07:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2555.055801 secs 2024-04-21T11:07:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:23 smithi077 ceph-mon[27902]: pgmap v1460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:07:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2555.055801 secs 2024-04-21T11:07:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:25 smithi191 ceph-mon[31636]: pgmap v1461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:07:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:07:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:07:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:07:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:25 smithi170 ceph-mon[31212]: pgmap v1461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:07:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:07:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:07:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:07:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:25 smithi077 ceph-mon[27902]: pgmap v1461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:07:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:07:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:07:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:07:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2558.294828 secs 2024-04-21T11:07:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2558.294828 secs 2024-04-21T11:07:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2558.294828 secs 2024-04-21T11:07:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:27 smithi191 ceph-mon[31636]: pgmap v1462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:27 smithi170 ceph-mon[31212]: pgmap v1462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:27 smithi077 ceph-mon[27902]: pgmap v1462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2560.055920 secs 2024-04-21T11:07:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2560.055920 secs 2024-04-21T11:07:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2560.055920 secs 2024-04-21T11:07:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:29 smithi170 ceph-mon[31212]: pgmap v1463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:29 smithi077 ceph-mon[27902]: pgmap v1463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:29 smithi191 ceph-mon[31636]: pgmap v1463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:31 smithi170 ceph-mon[31212]: pgmap v1464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2563.294910 secs 2024-04-21T11:07:32.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:31 smithi077 ceph-mon[27902]: pgmap v1464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2563.294910 secs 2024-04-21T11:07:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:31 smithi191 ceph-mon[31636]: pgmap v1464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2563.294910 secs 2024-04-21T11:07:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:33 smithi170 ceph-mon[31212]: pgmap v1465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2565.056000 secs 2024-04-21T11:07:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:33 smithi077 ceph-mon[27902]: pgmap v1465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2565.056000 secs 2024-04-21T11:07:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:33 smithi191 ceph-mon[31636]: pgmap v1465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2565.056000 secs 2024-04-21T11:07:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:35 smithi170 ceph-mon[31212]: pgmap v1466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:35 smithi077 ceph-mon[27902]: pgmap v1466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:35 smithi191 ceph-mon[31636]: pgmap v1466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2568.295027 secs 2024-04-21T11:07:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2568.295027 secs 2024-04-21T11:07:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2568.295027 secs 2024-04-21T11:07:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:37 smithi170 ceph-mon[31212]: pgmap v1467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:37 smithi077 ceph-mon[27902]: pgmap v1467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:37 smithi191 ceph-mon[31636]: pgmap v1467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2570.056092 secs 2024-04-21T11:07:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2570.056092 secs 2024-04-21T11:07:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2570.056092 secs 2024-04-21T11:07:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:39 smithi170 ceph-mon[31212]: pgmap v1468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:39 smithi077 ceph-mon[27902]: pgmap v1468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:39 smithi191 ceph-mon[31636]: pgmap v1468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:41 smithi170 ceph-mon[31212]: pgmap v1469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2573.295146 secs 2024-04-21T11:07:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:41 smithi077 ceph-mon[27902]: pgmap v1469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2573.295146 secs 2024-04-21T11:07:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:42 smithi191 ceph-mon[31636]: pgmap v1469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2573.295146 secs 2024-04-21T11:07:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:44 smithi170 ceph-mon[31212]: pgmap v1470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2575.056208 secs 2024-04-21T11:07:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:44 smithi077 ceph-mon[27902]: pgmap v1470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2575.056208 secs 2024-04-21T11:07:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:44 smithi191 ceph-mon[31636]: pgmap v1470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2575.056208 secs 2024-04-21T11:07:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:46 smithi170 ceph-mon[31212]: pgmap v1471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:46 smithi077 ceph-mon[27902]: pgmap v1471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:46 smithi191 ceph-mon[31636]: pgmap v1471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:07:47.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2578.295283 secs 2024-04-21T11:07:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2578.295283 secs 2024-04-21T11:07:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2578.295283 secs 2024-04-21T11:07:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:48 smithi170 ceph-mon[31212]: pgmap v1472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:48 smithi077 ceph-mon[27902]: pgmap v1472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:48 smithi191 ceph-mon[31636]: pgmap v1472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2580.056303 secs 2024-04-21T11:07:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2580.056303 secs 2024-04-21T11:07:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2580.056303 secs 2024-04-21T11:07:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:50 smithi170 ceph-mon[31212]: pgmap v1473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:50 smithi077 ceph-mon[27902]: pgmap v1473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:50 smithi191 ceph-mon[31636]: pgmap v1473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:52 smithi170 ceph-mon[31212]: pgmap v1474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2583.295403 secs 2024-04-21T11:07:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:52 smithi077 ceph-mon[27902]: pgmap v1474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2583.295403 secs 2024-04-21T11:07:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:52 smithi191 ceph-mon[31636]: pgmap v1474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2583.295403 secs 2024-04-21T11:07:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:54 smithi170 ceph-mon[31212]: pgmap v1475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2585.056418 secs 2024-04-21T11:07:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:54 smithi077 ceph-mon[27902]: pgmap v1475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2585.056418 secs 2024-04-21T11:07:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:54 smithi191 ceph-mon[31636]: pgmap v1475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2585.056418 secs 2024-04-21T11:07:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:07:54.705+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:07:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:07:54.705+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:07:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:07:54.705+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:07:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:07:54.705+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:07:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:07:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:56 smithi170 ceph-mon[31212]: pgmap v1476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:56 smithi077 ceph-mon[27902]: pgmap v1476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:56 smithi191 ceph-mon[31636]: pgmap v1476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:07:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2588.295544 secs 2024-04-21T11:07:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2588.295544 secs 2024-04-21T11:07:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2588.295544 secs 2024-04-21T11:07:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:58 smithi170 ceph-mon[31212]: pgmap v1477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:58 smithi077 ceph-mon[27902]: pgmap v1477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:58 smithi191 ceph-mon[31636]: pgmap v1477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:07:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2590.056554 secs 2024-04-21T11:07:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2590.056554 secs 2024-04-21T11:07:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2590.056554 secs 2024-04-21T11:08:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:00 smithi170 ceph-mon[31212]: pgmap v1478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:00 smithi077 ceph-mon[27902]: pgmap v1478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:00 smithi191 ceph-mon[31636]: pgmap v1478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:02 smithi170 ceph-mon[31212]: pgmap v1479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2593.295680 secs 2024-04-21T11:08:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:02 smithi077 ceph-mon[27902]: pgmap v1479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2593.295680 secs 2024-04-21T11:08:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:02 smithi191 ceph-mon[31636]: pgmap v1479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2593.295680 secs 2024-04-21T11:08:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:04 smithi170 ceph-mon[31212]: pgmap v1480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2595.056664 secs 2024-04-21T11:08:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:04 smithi077 ceph-mon[27902]: pgmap v1480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2595.056664 secs 2024-04-21T11:08:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:04 smithi191 ceph-mon[31636]: pgmap v1480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2595.056664 secs 2024-04-21T11:08:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:05 smithi077 ceph-mon[27902]: osdmap e167: 12 total, 12 up, 12 in 2024-04-21T11:08:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:05 smithi191 ceph-mon[31636]: osdmap e167: 12 total, 12 up, 12 in 2024-04-21T11:08:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:05 smithi170 ceph-mon[31212]: osdmap e167: 12 total, 12 up, 12 in 2024-04-21T11:08:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:06 smithi077 ceph-mon[27902]: pgmap v1482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:08:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:06 smithi191 ceph-mon[31636]: pgmap v1482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:08:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:06 smithi170 ceph-mon[31212]: pgmap v1482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:08:07.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2598.295794 secs 2024-04-21T11:08:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2598.295794 secs 2024-04-21T11:08:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2598.295794 secs 2024-04-21T11:08:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:08 smithi077 ceph-mon[27902]: pgmap v1483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:08:08.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:08 smithi170 ceph-mon[31212]: pgmap v1483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:08:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:08 smithi191 ceph-mon[31636]: pgmap v1483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:08:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2600.056785 secs 2024-04-21T11:08:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2600.056785 secs 2024-04-21T11:08:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2600.056785 secs 2024-04-21T11:08:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:10 smithi077 ceph-mon[27902]: pgmap v1484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:08:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:10 smithi191 ceph-mon[31636]: pgmap v1484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:08:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:10 smithi170 ceph-mon[31212]: pgmap v1484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:08:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:12 smithi077 ceph-mon[27902]: pgmap v1485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:08:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2603.295844 secs 2024-04-21T11:08:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:12 smithi077 ceph-mon[27902]: osdmap e168: 12 total, 12 up, 12 in 2024-04-21T11:08:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:12 smithi191 ceph-mon[31636]: pgmap v1485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:08:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2603.295844 secs 2024-04-21T11:08:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:12 smithi191 ceph-mon[31636]: osdmap e168: 12 total, 12 up, 12 in 2024-04-21T11:08:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:12 smithi170 ceph-mon[31212]: pgmap v1485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:08:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2603.295844 secs 2024-04-21T11:08:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:12 smithi170 ceph-mon[31212]: osdmap e168: 12 total, 12 up, 12 in 2024-04-21T11:08:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:14 smithi077 ceph-mon[27902]: pgmap v1487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:08:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2605.056907 secs 2024-04-21T11:08:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:14 smithi191 ceph-mon[31636]: pgmap v1487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:08:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2605.056907 secs 2024-04-21T11:08:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:14 smithi170 ceph-mon[31212]: pgmap v1487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:08:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2605.056907 secs 2024-04-21T11:08:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:16 smithi077 ceph-mon[27902]: pgmap v1488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:08:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:16 smithi191 ceph-mon[31636]: pgmap v1488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:08:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:16 smithi170 ceph-mon[31212]: pgmap v1488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:08:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2608.295906 secs 2024-04-21T11:08:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2608.295906 secs 2024-04-21T11:08:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2608.295906 secs 2024-04-21T11:08:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:18 smithi077 ceph-mon[27902]: pgmap v1489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:08:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:18 smithi191 ceph-mon[31636]: pgmap v1489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:08:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:18 smithi170 ceph-mon[31212]: pgmap v1489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:08:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2610.057030 secs 2024-04-21T11:08:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2610.057030 secs 2024-04-21T11:08:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2610.057030 secs 2024-04-21T11:08:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:20 smithi077 ceph-mon[27902]: pgmap v1490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:08:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:20 smithi191 ceph-mon[31636]: pgmap v1490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:08:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:20 smithi170 ceph-mon[31212]: pgmap v1490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:08:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:22 smithi077 ceph-mon[27902]: pgmap v1491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T11:08:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2613.296031 secs 2024-04-21T11:08:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:22 smithi191 ceph-mon[31636]: pgmap v1491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T11:08:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2613.296031 secs 2024-04-21T11:08:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:22 smithi170 ceph-mon[31212]: pgmap v1491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T11:08:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2613.296031 secs 2024-04-21T11:08:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:24 smithi077 ceph-mon[27902]: pgmap v1492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:08:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2615.057115 secs 2024-04-21T11:08:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:24 smithi191 ceph-mon[31636]: pgmap v1492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:08:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2615.057115 secs 2024-04-21T11:08:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:24 smithi170 ceph-mon[31212]: pgmap v1492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:08:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2615.057115 secs 2024-04-21T11:08:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:26 smithi077 ceph-mon[27902]: pgmap v1493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:08:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:26 smithi191 ceph-mon[31636]: pgmap v1493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:08:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:26 smithi170 ceph-mon[31212]: pgmap v1493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:08:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2618.296169 secs 2024-04-21T11:08:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:08:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:08:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:08:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2618.296169 secs 2024-04-21T11:08:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:08:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:08:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:08:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2618.296169 secs 2024-04-21T11:08:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:08:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:08:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:08:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:28 smithi077 ceph-mon[27902]: pgmap v1494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:08:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:28 smithi191 ceph-mon[31636]: pgmap v1494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:08:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:28 smithi170 ceph-mon[31212]: pgmap v1494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:08:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2620.057214 secs 2024-04-21T11:08:29.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2620.057214 secs 2024-04-21T11:08:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2620.057214 secs 2024-04-21T11:08:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:30 smithi077 ceph-mon[27902]: pgmap v1495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:08:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:30 smithi191 ceph-mon[31636]: pgmap v1495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:08:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:30 smithi170 ceph-mon[31212]: pgmap v1495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:08:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:32 smithi077 ceph-mon[27902]: pgmap v1496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:08:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2623.296311 secs 2024-04-21T11:08:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:32 smithi191 ceph-mon[31636]: pgmap v1496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:08:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2623.296311 secs 2024-04-21T11:08:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:32 smithi170 ceph-mon[31212]: pgmap v1496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:08:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2623.296311 secs 2024-04-21T11:08:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:34 smithi077 ceph-mon[27902]: pgmap v1497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2625.057359 secs 2024-04-21T11:08:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:34 smithi191 ceph-mon[31636]: pgmap v1497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2625.057359 secs 2024-04-21T11:08:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:34 smithi170 ceph-mon[31212]: pgmap v1497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2625.057359 secs 2024-04-21T11:08:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:36 smithi077 ceph-mon[27902]: pgmap v1498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:36 smithi191 ceph-mon[31636]: pgmap v1498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:36 smithi170 ceph-mon[31212]: pgmap v1498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:08:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2628.296384 secs 2024-04-21T11:08:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2628.296384 secs 2024-04-21T11:08:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2628.296384 secs 2024-04-21T11:08:38.456 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:38 smithi170 ceph-mon[31212]: pgmap v1499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:38 smithi191 ceph-mon[31636]: pgmap v1499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:38 smithi077 ceph-mon[27902]: pgmap v1499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2630.057484 secs 2024-04-21T11:08:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2630.057484 secs 2024-04-21T11:08:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2630.057484 secs 2024-04-21T11:08:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:40 smithi191 ceph-mon[31636]: pgmap v1500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:40 smithi170 ceph-mon[31212]: pgmap v1500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:40 smithi077 ceph-mon[27902]: pgmap v1500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:42 smithi191 ceph-mon[31636]: pgmap v1501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2633.296500 secs 2024-04-21T11:08:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:42 smithi170 ceph-mon[31212]: pgmap v1501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2633.296500 secs 2024-04-21T11:08:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:42 smithi077 ceph-mon[27902]: pgmap v1501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2633.296500 secs 2024-04-21T11:08:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:44 smithi191 ceph-mon[31636]: pgmap v1502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2635.057627 secs 2024-04-21T11:08:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:44 smithi170 ceph-mon[31212]: pgmap v1502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2635.057627 secs 2024-04-21T11:08:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:44 smithi077 ceph-mon[27902]: pgmap v1502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2635.057627 secs 2024-04-21T11:08:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:46 smithi191 ceph-mon[31636]: pgmap v1503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:46 smithi170 ceph-mon[31212]: pgmap v1503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:46 smithi077 ceph-mon[27902]: pgmap v1503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2638.296600 secs 2024-04-21T11:08:47.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2638.296600 secs 2024-04-21T11:08:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2638.296600 secs 2024-04-21T11:08:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:48 smithi191 ceph-mon[31636]: pgmap v1504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:48 smithi170 ceph-mon[31212]: pgmap v1504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:48 smithi077 ceph-mon[27902]: pgmap v1504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2640.057776 secs 2024-04-21T11:08:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2640.057776 secs 2024-04-21T11:08:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2640.057776 secs 2024-04-21T11:08:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:50 smithi191 ceph-mon[31636]: pgmap v1505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:50 smithi170 ceph-mon[31212]: pgmap v1505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:50 smithi077 ceph-mon[27902]: pgmap v1505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:52 smithi191 ceph-mon[31636]: pgmap v1506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2643.296746 secs 2024-04-21T11:08:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:52 smithi170 ceph-mon[31212]: pgmap v1506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2643.296746 secs 2024-04-21T11:08:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:52 smithi077 ceph-mon[27902]: pgmap v1506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2643.296746 secs 2024-04-21T11:08:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:54 smithi191 ceph-mon[31636]: pgmap v1507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2645.057873 secs 2024-04-21T11:08:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:54 smithi170 ceph-mon[31212]: pgmap v1507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2645.057873 secs 2024-04-21T11:08:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:54 smithi077 ceph-mon[27902]: pgmap v1507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2645.057873 secs 2024-04-21T11:08:55.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:08:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:56 smithi191 ceph-mon[31636]: pgmap v1508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:56 smithi170 ceph-mon[31212]: pgmap v1508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:56 smithi077 ceph-mon[27902]: pgmap v1508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:08:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2648.296865 secs 2024-04-21T11:08:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2648.296865 secs 2024-04-21T11:08:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2648.296865 secs 2024-04-21T11:08:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:58 smithi191 ceph-mon[31636]: pgmap v1509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:58 smithi170 ceph-mon[31212]: pgmap v1509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:58 smithi077 ceph-mon[27902]: pgmap v1509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:08:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2650.057957 secs 2024-04-21T11:08:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2650.057957 secs 2024-04-21T11:08:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2650.057957 secs 2024-04-21T11:09:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:00 smithi191 ceph-mon[31636]: pgmap v1510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:00 smithi170 ceph-mon[31212]: pgmap v1510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:00 smithi077 ceph-mon[27902]: pgmap v1510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:02 smithi191 ceph-mon[31636]: pgmap v1511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2653.296986 secs 2024-04-21T11:09:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:02 smithi170 ceph-mon[31212]: pgmap v1511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2653.296986 secs 2024-04-21T11:09:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:02 smithi077 ceph-mon[27902]: pgmap v1511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2653.296986 secs 2024-04-21T11:09:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:04 smithi191 ceph-mon[31636]: pgmap v1512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2655.058052 secs 2024-04-21T11:09:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:04 smithi191 ceph-mon[31636]: osdmap e169: 12 total, 12 up, 12 in 2024-04-21T11:09:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:04 smithi170 ceph-mon[31212]: pgmap v1512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2655.058052 secs 2024-04-21T11:09:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:04 smithi170 ceph-mon[31212]: osdmap e169: 12 total, 12 up, 12 in 2024-04-21T11:09:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:04 smithi077 ceph-mon[27902]: pgmap v1512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2655.058052 secs 2024-04-21T11:09:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:04 smithi077 ceph-mon[27902]: osdmap e169: 12 total, 12 up, 12 in 2024-04-21T11:09:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:06 smithi170 ceph-mon[31212]: pgmap v1514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:09:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:06 smithi077 ceph-mon[27902]: pgmap v1514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:09:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:06 smithi191 ceph-mon[31636]: pgmap v1514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:09:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2658.297104 secs 2024-04-21T11:09:07.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2658.297104 secs 2024-04-21T11:09:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2658.297104 secs 2024-04-21T11:09:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:08 smithi170 ceph-mon[31212]: pgmap v1515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:08 smithi077 ceph-mon[27902]: pgmap v1515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:08 smithi191 ceph-mon[31636]: pgmap v1515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2660.058143 secs 2024-04-21T11:09:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2660.058143 secs 2024-04-21T11:09:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2660.058143 secs 2024-04-21T11:09:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:10 smithi170 ceph-mon[31212]: pgmap v1516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:10 smithi077 ceph-mon[27902]: pgmap v1516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:10 smithi191 ceph-mon[31636]: pgmap v1516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:12 smithi170 ceph-mon[31212]: pgmap v1517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2663.297226 secs 2024-04-21T11:09:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:12 smithi170 ceph-mon[31212]: osdmap e170: 12 total, 12 up, 12 in 2024-04-21T11:09:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:12 smithi077 ceph-mon[27902]: pgmap v1517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2663.297226 secs 2024-04-21T11:09:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:12 smithi077 ceph-mon[27902]: osdmap e170: 12 total, 12 up, 12 in 2024-04-21T11:09:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:12 smithi191 ceph-mon[31636]: pgmap v1517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2663.297226 secs 2024-04-21T11:09:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:12 smithi191 ceph-mon[31636]: osdmap e170: 12 total, 12 up, 12 in 2024-04-21T11:09:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:14 smithi170 ceph-mon[31212]: pgmap v1519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:09:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2665.058266 secs 2024-04-21T11:09:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:14 smithi077 ceph-mon[27902]: pgmap v1519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:09:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2665.058266 secs 2024-04-21T11:09:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:14 smithi191 ceph-mon[31636]: pgmap v1519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:09:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2665.058266 secs 2024-04-21T11:09:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:16 smithi170 ceph-mon[31212]: pgmap v1520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:16 smithi077 ceph-mon[27902]: pgmap v1520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:16 smithi191 ceph-mon[31636]: pgmap v1520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:09:17.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2668.297361 secs 2024-04-21T11:09:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2668.297361 secs 2024-04-21T11:09:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2668.297361 secs 2024-04-21T11:09:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:18 smithi170 ceph-mon[31212]: pgmap v1521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:09:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:18 smithi077 ceph-mon[27902]: pgmap v1521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:09:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:18 smithi191 ceph-mon[31636]: pgmap v1521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:09:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2670.058388 secs 2024-04-21T11:09:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2670.058388 secs 2024-04-21T11:09:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2670.058388 secs 2024-04-21T11:09:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:20 smithi170 ceph-mon[31212]: pgmap v1522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:09:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:20 smithi077 ceph-mon[27902]: pgmap v1522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:09:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:20 smithi191 ceph-mon[31636]: pgmap v1522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:09:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:22 smithi170 ceph-mon[31212]: pgmap v1523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:09:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2673.297511 secs 2024-04-21T11:09:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:22 smithi077 ceph-mon[27902]: pgmap v1523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:09:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2673.297511 secs 2024-04-21T11:09:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:22 smithi191 ceph-mon[31636]: pgmap v1523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:09:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2673.297511 secs 2024-04-21T11:09:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:24 smithi170 ceph-mon[31212]: pgmap v1524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:09:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2675.058515 secs 2024-04-21T11:09:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:24 smithi077 ceph-mon[27902]: pgmap v1524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:09:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2675.058515 secs 2024-04-21T11:09:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:24 smithi191 ceph-mon[31636]: pgmap v1524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:09:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2675.058515 secs 2024-04-21T11:09:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:26 smithi170 ceph-mon[31212]: pgmap v1525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:26 smithi077 ceph-mon[27902]: pgmap v1525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:26 smithi191 ceph-mon[31636]: pgmap v1525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:27.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2678.297595 secs 2024-04-21T11:09:27.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:09:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2678.297595 secs 2024-04-21T11:09:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:09:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2678.297595 secs 2024-04-21T11:09:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:09:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:28 smithi170 ceph-mon[31212]: pgmap v1526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:09:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:09:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:09:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:28 smithi077 ceph-mon[27902]: pgmap v1526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:09:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:09:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:09:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:28 smithi191 ceph-mon[31636]: pgmap v1526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:09:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:09:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:09:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2680.058652 secs 2024-04-21T11:09:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2680.058652 secs 2024-04-21T11:09:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2680.058652 secs 2024-04-21T11:09:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:30 smithi170 ceph-mon[31212]: pgmap v1527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:30 smithi077 ceph-mon[27902]: pgmap v1527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:30 smithi191 ceph-mon[31636]: pgmap v1527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:32 smithi170 ceph-mon[31212]: pgmap v1528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2683.297730 secs 2024-04-21T11:09:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:32 smithi077 ceph-mon[27902]: pgmap v1528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2683.297730 secs 2024-04-21T11:09:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:32 smithi191 ceph-mon[31636]: pgmap v1528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2683.297730 secs 2024-04-21T11:09:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:34 smithi170 ceph-mon[31212]: pgmap v1529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2685.058778 secs 2024-04-21T11:09:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:34 smithi077 ceph-mon[27902]: pgmap v1529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2685.058778 secs 2024-04-21T11:09:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:34 smithi191 ceph-mon[31636]: pgmap v1529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2685.058778 secs 2024-04-21T11:09:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:36 smithi170 ceph-mon[31212]: pgmap v1530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:36 smithi077 ceph-mon[27902]: pgmap v1530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:36 smithi191 ceph-mon[31636]: pgmap v1530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2688.297856 secs 2024-04-21T11:09:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2688.297856 secs 2024-04-21T11:09:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2688.297856 secs 2024-04-21T11:09:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:38 smithi170 ceph-mon[31212]: pgmap v1531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:38 smithi077 ceph-mon[27902]: pgmap v1531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:38 smithi191 ceph-mon[31636]: pgmap v1531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2690.058895 secs 2024-04-21T11:09:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2690.058895 secs 2024-04-21T11:09:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2690.058895 secs 2024-04-21T11:09:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:40 smithi077 ceph-mon[27902]: pgmap v1532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:40 smithi191 ceph-mon[31636]: pgmap v1532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:40 smithi170 ceph-mon[31212]: pgmap v1532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:42 smithi077 ceph-mon[27902]: pgmap v1533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2693.297994 secs 2024-04-21T11:09:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:42 smithi191 ceph-mon[31636]: pgmap v1533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2693.297994 secs 2024-04-21T11:09:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:42 smithi170 ceph-mon[31212]: pgmap v1533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2693.297994 secs 2024-04-21T11:09:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:44 smithi077 ceph-mon[27902]: pgmap v1534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2695.058962 secs 2024-04-21T11:09:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:44 smithi191 ceph-mon[31636]: pgmap v1534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2695.058962 secs 2024-04-21T11:09:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:44 smithi170 ceph-mon[31212]: pgmap v1534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2695.058962 secs 2024-04-21T11:09:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:46 smithi077 ceph-mon[27902]: pgmap v1535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:46 smithi191 ceph-mon[31636]: pgmap v1535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:46 smithi170 ceph-mon[31212]: pgmap v1535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2698.298116 secs 2024-04-21T11:09:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2698.298116 secs 2024-04-21T11:09:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2698.298116 secs 2024-04-21T11:09:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:48 smithi077 ceph-mon[27902]: pgmap v1536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:48 smithi191 ceph-mon[31636]: pgmap v1536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:48 smithi170 ceph-mon[31212]: pgmap v1536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2700.059072 secs 2024-04-21T11:09:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2700.059072 secs 2024-04-21T11:09:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2700.059072 secs 2024-04-21T11:09:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:50 smithi077 ceph-mon[27902]: pgmap v1537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:50 smithi191 ceph-mon[31636]: pgmap v1537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:50 smithi170 ceph-mon[31212]: pgmap v1537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:52 smithi077 ceph-mon[27902]: pgmap v1538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2703.298182 secs 2024-04-21T11:09:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:52 smithi191 ceph-mon[31636]: pgmap v1538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2703.298182 secs 2024-04-21T11:09:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:52 smithi170 ceph-mon[31212]: pgmap v1538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2703.298182 secs 2024-04-21T11:09:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:54 smithi077 ceph-mon[27902]: pgmap v1539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2705.059208 secs 2024-04-21T11:09:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:54 smithi191 ceph-mon[31636]: pgmap v1539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2705.059208 secs 2024-04-21T11:09:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:54 smithi170 ceph-mon[31212]: pgmap v1539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2705.059208 secs 2024-04-21T11:09:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:09:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:56 smithi077 ceph-mon[27902]: pgmap v1540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:56 smithi191 ceph-mon[31636]: pgmap v1540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:56 smithi170 ceph-mon[31212]: pgmap v1540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:09:57.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2708.298266 secs 2024-04-21T11:09:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2708.298266 secs 2024-04-21T11:09:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2708.298266 secs 2024-04-21T11:09:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:58 smithi077 ceph-mon[27902]: pgmap v1541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:58 smithi191 ceph-mon[31636]: pgmap v1541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:58 smithi170 ceph-mon[31212]: pgmap v1541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:09:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2710.059343 secs 2024-04-21T11:09:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2710.059343 secs 2024-04-21T11:09:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2710.059343 secs 2024-04-21T11:10:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:00 smithi077 ceph-mon[27902]: pgmap v1542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:10:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:00 smithi191 ceph-mon[31636]: pgmap v1542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:10:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:00 smithi170 ceph-mon[31212]: pgmap v1542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:10:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:02 smithi077 ceph-mon[27902]: pgmap v1543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:03.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2713.298411 secs 2024-04-21T11:10:03.378 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:02 smithi170 ceph-mon[31212]: pgmap v1543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:03.378 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2713.298411 secs 2024-04-21T11:10:03.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:02 smithi191 ceph-mon[31636]: pgmap v1543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:03.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2713.298411 secs 2024-04-21T11:10:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:04 smithi077 ceph-mon[27902]: pgmap v1544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2715.059457 secs 2024-04-21T11:10:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:04 smithi077 ceph-mon[27902]: osdmap e171: 12 total, 12 up, 12 in 2024-04-21T11:10:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:04 smithi191 ceph-mon[31636]: pgmap v1544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2715.059457 secs 2024-04-21T11:10:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:04 smithi191 ceph-mon[31636]: osdmap e171: 12 total, 12 up, 12 in 2024-04-21T11:10:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:04 smithi170 ceph-mon[31212]: pgmap v1544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2715.059457 secs 2024-04-21T11:10:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:04 smithi170 ceph-mon[31212]: osdmap e171: 12 total, 12 up, 12 in 2024-04-21T11:10:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:06 smithi077 ceph-mon[27902]: pgmap v1546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:10:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:06 smithi191 ceph-mon[31636]: pgmap v1546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:10:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:06 smithi170 ceph-mon[31212]: pgmap v1546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:10:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2718.298529 secs 2024-04-21T11:10:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2718.298529 secs 2024-04-21T11:10:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2718.298529 secs 2024-04-21T11:10:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:08 smithi170 ceph-mon[31212]: pgmap v1547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:10:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:08 smithi191 ceph-mon[31636]: pgmap v1547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:10:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:08 smithi077 ceph-mon[27902]: pgmap v1547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:10:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2720.059555 secs 2024-04-21T11:10:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:09.724+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:10:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:09.724+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:10:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:09.724+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:10:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:09.724+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:10:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2720.059555 secs 2024-04-21T11:10:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2720.059555 secs 2024-04-21T11:10:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:10 smithi191 ceph-mon[31636]: pgmap v1548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:10:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:10 smithi170 ceph-mon[31212]: pgmap v1548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:10:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:10 smithi077 ceph-mon[27902]: pgmap v1548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:10:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:12 smithi191 ceph-mon[31636]: pgmap v1549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:10:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2723.298626 secs 2024-04-21T11:10:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:12 smithi191 ceph-mon[31636]: osdmap e172: 12 total, 12 up, 12 in 2024-04-21T11:10:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:12 smithi170 ceph-mon[31212]: pgmap v1549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:10:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2723.298626 secs 2024-04-21T11:10:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:12 smithi170 ceph-mon[31212]: osdmap e172: 12 total, 12 up, 12 in 2024-04-21T11:10:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:12 smithi077 ceph-mon[27902]: pgmap v1549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:10:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2723.298626 secs 2024-04-21T11:10:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:12 smithi077 ceph-mon[27902]: osdmap e172: 12 total, 12 up, 12 in 2024-04-21T11:10:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:14 smithi191 ceph-mon[31636]: pgmap v1551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:10:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2725.059653 secs 2024-04-21T11:10:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:14 smithi170 ceph-mon[31212]: pgmap v1551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:10:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2725.059653 secs 2024-04-21T11:10:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:14 smithi077 ceph-mon[27902]: pgmap v1551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:10:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2725.059653 secs 2024-04-21T11:10:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:16 smithi191 ceph-mon[31636]: pgmap v1552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:10:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:16 smithi170 ceph-mon[31212]: pgmap v1552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:10:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:16 smithi077 ceph-mon[27902]: pgmap v1552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:10:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2728.298776 secs 2024-04-21T11:10:17.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2728.298776 secs 2024-04-21T11:10:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2728.298776 secs 2024-04-21T11:10:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:18 smithi191 ceph-mon[31636]: pgmap v1553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:10:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:18 smithi170 ceph-mon[31212]: pgmap v1553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:10:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:18 smithi077 ceph-mon[27902]: pgmap v1553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:10:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2730.059794 secs 2024-04-21T11:10:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2730.059794 secs 2024-04-21T11:10:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2730.059794 secs 2024-04-21T11:10:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:20 smithi191 ceph-mon[31636]: pgmap v1554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:10:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:20 smithi170 ceph-mon[31212]: pgmap v1554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:10:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:20 smithi077 ceph-mon[27902]: pgmap v1554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:10:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:22 smithi191 ceph-mon[31636]: pgmap v1555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:10:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2733.298916 secs 2024-04-21T11:10:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:22 smithi170 ceph-mon[31212]: pgmap v1555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:10:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2733.298916 secs 2024-04-21T11:10:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:22 smithi077 ceph-mon[27902]: pgmap v1555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:10:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2733.298916 secs 2024-04-21T11:10:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:23 smithi170 ceph-mon[31212]: pgmap v1556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:10:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:23 smithi077 ceph-mon[27902]: pgmap v1556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:10:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:23 smithi191 ceph-mon[31636]: pgmap v1556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:10:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2735.059921 secs 2024-04-21T11:10:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2735.059921 secs 2024-04-21T11:10:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2735.059921 secs 2024-04-21T11:10:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:25 smithi170 ceph-mon[31212]: pgmap v1557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:25 smithi077 ceph-mon[27902]: pgmap v1557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:25 smithi191 ceph-mon[31636]: pgmap v1557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2738.299038 secs 2024-04-21T11:10:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2738.299038 secs 2024-04-21T11:10:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2738.299038 secs 2024-04-21T11:10:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:27 smithi077 ceph-mon[27902]: pgmap v1558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:10:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:27 smithi191 ceph-mon[31636]: pgmap v1558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:10:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:27 smithi170 ceph-mon[31212]: pgmap v1558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:10:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:10:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:10:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:10:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2740.059985 secs 2024-04-21T11:10:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:10:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:10:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:10:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2740.059985 secs 2024-04-21T11:10:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:10:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:10:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:10:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2740.059985 secs 2024-04-21T11:10:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:29 smithi077 ceph-mon[27902]: pgmap v1559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:29 smithi191 ceph-mon[31636]: pgmap v1559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:29 smithi170 ceph-mon[31212]: pgmap v1559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:32 smithi170 ceph-mon[31212]: pgmap v1560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2743.299165 secs 2024-04-21T11:10:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:32 smithi077 ceph-mon[27902]: pgmap v1560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2743.299165 secs 2024-04-21T11:10:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:32 smithi191 ceph-mon[31636]: pgmap v1560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2743.299165 secs 2024-04-21T11:10:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:34 smithi170 ceph-mon[31212]: pgmap v1561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2745.060063 secs 2024-04-21T11:10:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:34 smithi077 ceph-mon[27902]: pgmap v1561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2745.060063 secs 2024-04-21T11:10:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:34 smithi191 ceph-mon[31636]: pgmap v1561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2745.060063 secs 2024-04-21T11:10:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:36 smithi170 ceph-mon[31212]: pgmap v1562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:36 smithi077 ceph-mon[27902]: pgmap v1562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:36 smithi191 ceph-mon[31636]: pgmap v1562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2748.299295 secs 2024-04-21T11:10:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2748.299295 secs 2024-04-21T11:10:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2748.299295 secs 2024-04-21T11:10:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:38 smithi170 ceph-mon[31212]: pgmap v1563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:38 smithi077 ceph-mon[27902]: pgmap v1563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:38 smithi191 ceph-mon[31636]: pgmap v1563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2750.060169 secs 2024-04-21T11:10:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2750.060169 secs 2024-04-21T11:10:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2750.060169 secs 2024-04-21T11:10:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:40 smithi170 ceph-mon[31212]: pgmap v1564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:40 smithi077 ceph-mon[27902]: pgmap v1564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:40 smithi191 ceph-mon[31636]: pgmap v1564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:42 smithi170 ceph-mon[31212]: pgmap v1565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2753.299398 secs 2024-04-21T11:10:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:42 smithi077 ceph-mon[27902]: pgmap v1565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2753.299398 secs 2024-04-21T11:10:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:42 smithi191 ceph-mon[31636]: pgmap v1565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2753.299398 secs 2024-04-21T11:10:44.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:44 smithi170 ceph-mon[31212]: pgmap v1566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:44.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2755.060283 secs 2024-04-21T11:10:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:44 smithi077 ceph-mon[27902]: pgmap v1566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2755.060283 secs 2024-04-21T11:10:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:44 smithi191 ceph-mon[31636]: pgmap v1566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2755.060283 secs 2024-04-21T11:10:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:46 smithi170 ceph-mon[31212]: pgmap v1567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:46 smithi077 ceph-mon[27902]: pgmap v1567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:46 smithi191 ceph-mon[31636]: pgmap v1567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2758.299474 secs 2024-04-21T11:10:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2758.299474 secs 2024-04-21T11:10:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2758.299474 secs 2024-04-21T11:10:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:48 smithi170 ceph-mon[31212]: pgmap v1568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:48 smithi077 ceph-mon[27902]: pgmap v1568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:48 smithi191 ceph-mon[31636]: pgmap v1568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2760.060398 secs 2024-04-21T11:10:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2760.060398 secs 2024-04-21T11:10:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2760.060398 secs 2024-04-21T11:10:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:50 smithi170 ceph-mon[31212]: pgmap v1569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:50 smithi077 ceph-mon[27902]: pgmap v1569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:50 smithi191 ceph-mon[31636]: pgmap v1569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:52 smithi170 ceph-mon[31212]: pgmap v1570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2763.299593 secs 2024-04-21T11:10:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:52 smithi077 ceph-mon[27902]: pgmap v1570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2763.299593 secs 2024-04-21T11:10:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:52 smithi191 ceph-mon[31636]: pgmap v1570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2763.299593 secs 2024-04-21T11:10:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:54 smithi077 ceph-mon[27902]: pgmap v1571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2765.060521 secs 2024-04-21T11:10:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:54 smithi191 ceph-mon[31636]: pgmap v1571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2765.060521 secs 2024-04-21T11:10:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:54 smithi170 ceph-mon[31212]: pgmap v1571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2765.060521 secs 2024-04-21T11:10:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:54.730+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:10:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:54.730+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:10:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:54.731+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:10:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:10:54.731+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:10:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:10:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:56 smithi077 ceph-mon[27902]: pgmap v1572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:56 smithi191 ceph-mon[31636]: pgmap v1572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:56 smithi170 ceph-mon[31212]: pgmap v1572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:10:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2768.299705 secs 2024-04-21T11:10:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2768.299705 secs 2024-04-21T11:10:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2768.299705 secs 2024-04-21T11:10:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:58 smithi077 ceph-mon[27902]: pgmap v1573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:58 smithi191 ceph-mon[31636]: pgmap v1573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:58 smithi170 ceph-mon[31212]: pgmap v1573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:10:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2770.060581 secs 2024-04-21T11:10:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2770.060581 secs 2024-04-21T11:10:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2770.060581 secs 2024-04-21T11:11:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:00 smithi077 ceph-mon[27902]: pgmap v1574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:00 smithi191 ceph-mon[31636]: pgmap v1574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:00 smithi170 ceph-mon[31212]: pgmap v1574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:02 smithi077 ceph-mon[27902]: pgmap v1575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2773.299831 secs 2024-04-21T11:11:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:02 smithi191 ceph-mon[31636]: pgmap v1575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2773.299831 secs 2024-04-21T11:11:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:02 smithi170 ceph-mon[31212]: pgmap v1575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2773.299831 secs 2024-04-21T11:11:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:04 smithi077 ceph-mon[27902]: pgmap v1576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2775.060705 secs 2024-04-21T11:11:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:04 smithi191 ceph-mon[31636]: pgmap v1576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2775.060705 secs 2024-04-21T11:11:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:04 smithi170 ceph-mon[31212]: pgmap v1576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2775.060705 secs 2024-04-21T11:11:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:05 smithi077 ceph-mon[27902]: osdmap e173: 12 total, 12 up, 12 in 2024-04-21T11:11:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:05 smithi191 ceph-mon[31636]: osdmap e173: 12 total, 12 up, 12 in 2024-04-21T11:11:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:05 smithi170 ceph-mon[31212]: osdmap e173: 12 total, 12 up, 12 in 2024-04-21T11:11:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:06 smithi077 ceph-mon[27902]: pgmap v1578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:11:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:06 smithi191 ceph-mon[31636]: pgmap v1578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:11:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:06 smithi170 ceph-mon[31212]: pgmap v1578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:11:07.368 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2778.299981 secs 2024-04-21T11:11:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2778.299981 secs 2024-04-21T11:11:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2778.299981 secs 2024-04-21T11:11:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:08 smithi077 ceph-mon[27902]: pgmap v1579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:11:08.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:08 smithi170 ceph-mon[31212]: pgmap v1579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:11:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:08 smithi191 ceph-mon[31636]: pgmap v1579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:11:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2780.060818 secs 2024-04-21T11:11:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2780.060818 secs 2024-04-21T11:11:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2780.060818 secs 2024-04-21T11:11:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:10 smithi077 ceph-mon[27902]: pgmap v1580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:11:10.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:10 smithi191 ceph-mon[31636]: pgmap v1580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:11:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:10 smithi170 ceph-mon[31212]: pgmap v1580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:11:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:12 smithi077 ceph-mon[27902]: pgmap v1581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:11:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2783.300105 secs 2024-04-21T11:11:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:12 smithi077 ceph-mon[27902]: osdmap e174: 12 total, 12 up, 12 in 2024-04-21T11:11:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:12 smithi191 ceph-mon[31636]: pgmap v1581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:11:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2783.300105 secs 2024-04-21T11:11:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:12 smithi191 ceph-mon[31636]: osdmap e174: 12 total, 12 up, 12 in 2024-04-21T11:11:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:12 smithi170 ceph-mon[31212]: pgmap v1581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:11:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2783.300105 secs 2024-04-21T11:11:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:12 smithi170 ceph-mon[31212]: osdmap e174: 12 total, 12 up, 12 in 2024-04-21T11:11:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:14 smithi077 ceph-mon[27902]: pgmap v1583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:11:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2785.060935 secs 2024-04-21T11:11:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:14 smithi191 ceph-mon[31636]: pgmap v1583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:11:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2785.060935 secs 2024-04-21T11:11:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:14 smithi170 ceph-mon[31212]: pgmap v1583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:11:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2785.060935 secs 2024-04-21T11:11:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:16 smithi077 ceph-mon[27902]: pgmap v1584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:11:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:16 smithi191 ceph-mon[31636]: pgmap v1584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:11:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:16 smithi170 ceph-mon[31212]: pgmap v1584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:11:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2788.300253 secs 2024-04-21T11:11:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:17 smithi191 ceph-mon[31636]: pgmap v1585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:11:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2788.300253 secs 2024-04-21T11:11:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:17 smithi170 ceph-mon[31212]: pgmap v1585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:11:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2788.300253 secs 2024-04-21T11:11:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:17 smithi077 ceph-mon[27902]: pgmap v1585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:11:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2790.061048 secs 2024-04-21T11:11:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2790.061048 secs 2024-04-21T11:11:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2790.061048 secs 2024-04-21T11:11:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:19 smithi191 ceph-mon[31636]: pgmap v1586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:11:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:19 smithi170 ceph-mon[31212]: pgmap v1586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:11:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:19 smithi077 ceph-mon[27902]: pgmap v1586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:11:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:22 smithi170 ceph-mon[31212]: pgmap v1587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:11:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2793.300391 secs 2024-04-21T11:11:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:22 smithi077 ceph-mon[27902]: pgmap v1587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:11:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2793.300391 secs 2024-04-21T11:11:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:22 smithi191 ceph-mon[31636]: pgmap v1587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:11:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2793.300391 secs 2024-04-21T11:11:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:24 smithi170 ceph-mon[31212]: pgmap v1588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:11:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2795.061164 secs 2024-04-21T11:11:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:24 smithi077 ceph-mon[27902]: pgmap v1588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:11:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2795.061164 secs 2024-04-21T11:11:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:24 smithi191 ceph-mon[31636]: pgmap v1588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:11:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2795.061164 secs 2024-04-21T11:11:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:26 smithi170 ceph-mon[31212]: pgmap v1589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:26 smithi077 ceph-mon[27902]: pgmap v1589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:26 smithi191 ceph-mon[31636]: pgmap v1589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2798.300507 secs 2024-04-21T11:11:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2798.300507 secs 2024-04-21T11:11:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2798.300507 secs 2024-04-21T11:11:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:28 smithi170 ceph-mon[31212]: pgmap v1590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:28 smithi077 ceph-mon[27902]: pgmap v1590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:28 smithi191 ceph-mon[31636]: pgmap v1590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:11:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2800.061228 secs 2024-04-21T11:11:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:11:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:11:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:11:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:11:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2800.061228 secs 2024-04-21T11:11:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:11:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:11:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:11:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:11:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2800.061228 secs 2024-04-21T11:11:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:11:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:11:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:11:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:30 smithi170 ceph-mon[31212]: pgmap v1591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:30 smithi077 ceph-mon[27902]: pgmap v1591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:30 smithi191 ceph-mon[31636]: pgmap v1591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:32 smithi170 ceph-mon[31212]: pgmap v1592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2803.300581 secs 2024-04-21T11:11:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:32 smithi077 ceph-mon[27902]: pgmap v1592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2803.300581 secs 2024-04-21T11:11:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:32 smithi191 ceph-mon[31636]: pgmap v1592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2803.300581 secs 2024-04-21T11:11:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:34 smithi170 ceph-mon[31212]: pgmap v1593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2805.061344 secs 2024-04-21T11:11:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:34 smithi077 ceph-mon[27902]: pgmap v1593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2805.061344 secs 2024-04-21T11:11:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:34 smithi191 ceph-mon[31636]: pgmap v1593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2805.061344 secs 2024-04-21T11:11:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:36 smithi170 ceph-mon[31212]: pgmap v1594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:36 smithi077 ceph-mon[27902]: pgmap v1594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:36 smithi191 ceph-mon[31636]: pgmap v1594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2808.300694 secs 2024-04-21T11:11:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2808.300694 secs 2024-04-21T11:11:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2808.300694 secs 2024-04-21T11:11:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:38 smithi170 ceph-mon[31212]: pgmap v1595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:38 smithi077 ceph-mon[27902]: pgmap v1595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:38 smithi191 ceph-mon[31636]: pgmap v1595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2810.061442 secs 2024-04-21T11:11:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2810.061442 secs 2024-04-21T11:11:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2810.061442 secs 2024-04-21T11:11:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 2995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:40 smithi077 ceph-mon[27902]: pgmap v1596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:40 smithi191 ceph-mon[31636]: pgmap v1596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:40 smithi170 ceph-mon[31212]: pgmap v1596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:42 smithi077 ceph-mon[27902]: pgmap v1597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2813.300806 secs 2024-04-21T11:11:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:42 smithi191 ceph-mon[31636]: pgmap v1597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2813.300806 secs 2024-04-21T11:11:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:42 smithi170 ceph-mon[31212]: pgmap v1597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2813.300806 secs 2024-04-21T11:11:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:44 smithi077 ceph-mon[27902]: pgmap v1598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2815.061560 secs 2024-04-21T11:11:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:44 smithi191 ceph-mon[31636]: pgmap v1598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2815.061560 secs 2024-04-21T11:11:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:44 smithi170 ceph-mon[31212]: pgmap v1598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2815.061560 secs 2024-04-21T11:11:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:46 smithi077 ceph-mon[27902]: pgmap v1599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:46 smithi191 ceph-mon[31636]: pgmap v1599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:46 smithi170 ceph-mon[31212]: pgmap v1599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2818.300922 secs 2024-04-21T11:11:47.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2818.300922 secs 2024-04-21T11:11:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2818.300922 secs 2024-04-21T11:11:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:48 smithi077 ceph-mon[27902]: pgmap v1600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:48 smithi191 ceph-mon[31636]: pgmap v1600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:48 smithi170 ceph-mon[31212]: pgmap v1600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2820.061651 secs 2024-04-21T11:11:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2820.061651 secs 2024-04-21T11:11:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2820.061651 secs 2024-04-21T11:11:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:50 smithi077 ceph-mon[27902]: pgmap v1601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:50 smithi191 ceph-mon[31636]: pgmap v1601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:50 smithi170 ceph-mon[31212]: pgmap v1601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:52 smithi077 ceph-mon[27902]: pgmap v1602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2823.301038 secs 2024-04-21T11:11:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:52 smithi191 ceph-mon[31636]: pgmap v1602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2823.301038 secs 2024-04-21T11:11:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:52 smithi170 ceph-mon[31212]: pgmap v1602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2823.301038 secs 2024-04-21T11:11:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:54 smithi077 ceph-mon[27902]: pgmap v1603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2825.061787 secs 2024-04-21T11:11:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:54 smithi191 ceph-mon[31636]: pgmap v1603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2825.061787 secs 2024-04-21T11:11:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:54 smithi170 ceph-mon[31212]: pgmap v1603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2825.061787 secs 2024-04-21T11:11:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:11:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:56 smithi077 ceph-mon[27902]: pgmap v1604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:56 smithi191 ceph-mon[31636]: pgmap v1604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:56 smithi170 ceph-mon[31212]: pgmap v1604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:11:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2828.301161 secs 2024-04-21T11:11:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2828.301161 secs 2024-04-21T11:11:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2828.301161 secs 2024-04-21T11:11:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:58 smithi077 ceph-mon[27902]: pgmap v1605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:58 smithi191 ceph-mon[31636]: pgmap v1605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:58 smithi170 ceph-mon[31212]: pgmap v1605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:11:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2830.061893 secs 2024-04-21T11:11:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2830.061893 secs 2024-04-21T11:11:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2830.061893 secs 2024-04-21T11:12:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:00 smithi077 ceph-mon[27902]: pgmap v1606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:00 smithi191 ceph-mon[31636]: pgmap v1606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:00 smithi170 ceph-mon[31212]: pgmap v1606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:02 smithi077 ceph-mon[27902]: pgmap v1607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2833.301273 secs 2024-04-21T11:12:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:02 smithi191 ceph-mon[31636]: pgmap v1607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2833.301273 secs 2024-04-21T11:12:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:02 smithi170 ceph-mon[31212]: pgmap v1607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2833.301273 secs 2024-04-21T11:12:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:04 smithi077 ceph-mon[27902]: pgmap v1608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2835.061942 secs 2024-04-21T11:12:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:04 smithi191 ceph-mon[31636]: pgmap v1608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2835.061942 secs 2024-04-21T11:12:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:04 smithi170 ceph-mon[31212]: pgmap v1608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2835.061942 secs 2024-04-21T11:12:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:05 smithi191 ceph-mon[31636]: osdmap e175: 12 total, 12 up, 12 in 2024-04-21T11:12:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:05 smithi170 ceph-mon[31212]: osdmap e175: 12 total, 12 up, 12 in 2024-04-21T11:12:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:05 smithi077 ceph-mon[27902]: osdmap e175: 12 total, 12 up, 12 in 2024-04-21T11:12:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:06 smithi191 ceph-mon[31636]: pgmap v1610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:12:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:06 smithi170 ceph-mon[31212]: pgmap v1610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:12:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:06 smithi077 ceph-mon[27902]: pgmap v1610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:12:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2838.301391 secs 2024-04-21T11:12:07.581 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2838.301391 secs 2024-04-21T11:12:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2838.301391 secs 2024-04-21T11:12:08.456 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:08 smithi170 ceph-mon[31212]: pgmap v1611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:12:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:08 smithi191 ceph-mon[31636]: pgmap v1611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:12:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:08 smithi077 ceph-mon[27902]: pgmap v1611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:12:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2840.062017 secs 2024-04-21T11:12:09.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2840.062017 secs 2024-04-21T11:12:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2840.062017 secs 2024-04-21T11:12:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:10 smithi191 ceph-mon[31636]: pgmap v1612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:12:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:10 smithi170 ceph-mon[31212]: pgmap v1612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:12:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:10 smithi077 ceph-mon[27902]: pgmap v1612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:12:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:12 smithi191 ceph-mon[31636]: pgmap v1613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:12:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2843.301513 secs 2024-04-21T11:12:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:12 smithi191 ceph-mon[31636]: osdmap e176: 12 total, 12 up, 12 in 2024-04-21T11:12:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:12 smithi170 ceph-mon[31212]: pgmap v1613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:12:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2843.301513 secs 2024-04-21T11:12:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:12 smithi170 ceph-mon[31212]: osdmap e176: 12 total, 12 up, 12 in 2024-04-21T11:12:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:12 smithi077 ceph-mon[27902]: pgmap v1613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:12:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2843.301513 secs 2024-04-21T11:12:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:12 smithi077 ceph-mon[27902]: osdmap e176: 12 total, 12 up, 12 in 2024-04-21T11:12:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:14 smithi191 ceph-mon[31636]: pgmap v1615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:12:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2845.062128 secs 2024-04-21T11:12:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:14 smithi170 ceph-mon[31212]: pgmap v1615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:12:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2845.062128 secs 2024-04-21T11:12:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:14 smithi077 ceph-mon[27902]: pgmap v1615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:12:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2845.062128 secs 2024-04-21T11:12:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:16 smithi191 ceph-mon[31636]: pgmap v1616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:12:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:16 smithi170 ceph-mon[31212]: pgmap v1616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:12:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:16 smithi077 ceph-mon[27902]: pgmap v1616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:12:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2848.301625 secs 2024-04-21T11:12:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2848.301625 secs 2024-04-21T11:12:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2848.301625 secs 2024-04-21T11:12:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:18 smithi191 ceph-mon[31636]: pgmap v1617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:12:18.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:18 smithi077 ceph-mon[27902]: pgmap v1617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:12:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:18 smithi170 ceph-mon[31212]: pgmap v1617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:12:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2850.062202 secs 2024-04-21T11:12:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2850.062202 secs 2024-04-21T11:12:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2850.062202 secs 2024-04-21T11:12:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:20 smithi191 ceph-mon[31636]: pgmap v1618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:12:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:20 smithi170 ceph-mon[31212]: pgmap v1618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:12:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:20 smithi077 ceph-mon[27902]: pgmap v1618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:12:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:22 smithi191 ceph-mon[31636]: pgmap v1619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:12:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2853.301757 secs 2024-04-21T11:12:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:22 smithi170 ceph-mon[31212]: pgmap v1619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:12:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2853.301757 secs 2024-04-21T11:12:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:22 smithi077 ceph-mon[27902]: pgmap v1619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:12:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2853.301757 secs 2024-04-21T11:12:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:24 smithi191 ceph-mon[31636]: pgmap v1620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:12:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2855.062267 secs 2024-04-21T11:12:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:24 smithi170 ceph-mon[31212]: pgmap v1620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:12:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2855.062267 secs 2024-04-21T11:12:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:24 smithi077 ceph-mon[27902]: pgmap v1620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:12:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2855.062267 secs 2024-04-21T11:12:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:26 smithi191 ceph-mon[31636]: pgmap v1621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:26 smithi170 ceph-mon[31212]: pgmap v1621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:26 smithi077 ceph-mon[27902]: pgmap v1621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2858.301873 secs 2024-04-21T11:12:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2858.301873 secs 2024-04-21T11:12:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2858.301873 secs 2024-04-21T11:12:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:28 smithi191 ceph-mon[31636]: pgmap v1622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:28 smithi170 ceph-mon[31212]: pgmap v1622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:28 smithi077 ceph-mon[27902]: pgmap v1622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2860.062384 secs 2024-04-21T11:12:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:12:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2860.062384 secs 2024-04-21T11:12:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:12:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2860.062384 secs 2024-04-21T11:12:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:12:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:30 smithi191 ceph-mon[31636]: pgmap v1623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:30 smithi170 ceph-mon[31212]: pgmap v1623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:30 smithi077 ceph-mon[27902]: pgmap v1623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: pgmap v1624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:12:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:12:31.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:12:31.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:12:31.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: pgmap v1624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:12:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:12:32.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:12:32.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: pgmap v1624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:12:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:12:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2863.301987 secs 2024-04-21T11:12:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2863.301987 secs 2024-04-21T11:12:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2863.301987 secs 2024-04-21T11:12:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:33 smithi191 ceph-mon[31636]: pgmap v1625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2865.062501 secs 2024-04-21T11:12:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:33 smithi170 ceph-mon[31212]: pgmap v1625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2865.062501 secs 2024-04-21T11:12:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:33 smithi077 ceph-mon[27902]: pgmap v1625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2865.062501 secs 2024-04-21T11:12:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:36 smithi170 ceph-mon[31212]: pgmap v1626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:36 smithi077 ceph-mon[27902]: pgmap v1626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:36 smithi191 ceph-mon[31636]: pgmap v1626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2868.302067 secs 2024-04-21T11:12:37.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2868.302067 secs 2024-04-21T11:12:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2868.302067 secs 2024-04-21T11:12:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:38 smithi170 ceph-mon[31212]: pgmap v1627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:38 smithi077 ceph-mon[27902]: pgmap v1627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:38 smithi191 ceph-mon[31636]: pgmap v1627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2870.062585 secs 2024-04-21T11:12:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2870.062585 secs 2024-04-21T11:12:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2870.062585 secs 2024-04-21T11:12:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:40 smithi077 ceph-mon[27902]: pgmap v1628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:40 smithi191 ceph-mon[31636]: pgmap v1628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:40 smithi170 ceph-mon[31212]: pgmap v1628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:42 smithi077 ceph-mon[27902]: pgmap v1629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2873.302149 secs 2024-04-21T11:12:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:42 smithi191 ceph-mon[31636]: pgmap v1629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2873.302149 secs 2024-04-21T11:12:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:42 smithi170 ceph-mon[31212]: pgmap v1629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2873.302149 secs 2024-04-21T11:12:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:44 smithi077 ceph-mon[27902]: pgmap v1630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2875.062721 secs 2024-04-21T11:12:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:44 smithi191 ceph-mon[31636]: pgmap v1630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2875.062721 secs 2024-04-21T11:12:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:44 smithi170 ceph-mon[31212]: pgmap v1630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2875.062721 secs 2024-04-21T11:12:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:46 smithi077 ceph-mon[27902]: pgmap v1631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:46 smithi191 ceph-mon[31636]: pgmap v1631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:46 smithi170 ceph-mon[31212]: pgmap v1631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2878.302281 secs 2024-04-21T11:12:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2878.302281 secs 2024-04-21T11:12:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2878.302281 secs 2024-04-21T11:12:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:48 smithi077 ceph-mon[27902]: pgmap v1632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:48 smithi191 ceph-mon[31636]: pgmap v1632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:48 smithi170 ceph-mon[31212]: pgmap v1632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 2880.062837 secs 2024-04-21T11:12:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:49 smithi170 ceph-mon[31212]: slow request 2880.062836 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T11:12:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 2880.062837 secs 2024-04-21T11:12:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:49 smithi077 ceph-mon[27902]: slow request 2880.062836 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T11:12:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 2880.062837 secs 2024-04-21T11:12:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:49 smithi191 ceph-mon[31636]: slow request 2880.062836 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T11:12:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:50 smithi077 ceph-mon[27902]: pgmap v1633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:50 smithi191 ceph-mon[31636]: pgmap v1633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:50 smithi170 ceph-mon[31212]: pgmap v1633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:52 smithi077 ceph-mon[27902]: pgmap v1634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:52 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 2883.302418 secs 2024-04-21T11:12:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:52 smithi077 ceph-mon[27902]: slow request 2883.302417 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T11:12:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:52 smithi191 ceph-mon[31636]: pgmap v1634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:52 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 2883.302418 secs 2024-04-21T11:12:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:52 smithi191 ceph-mon[31636]: slow request 2883.302417 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T11:12:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:52 smithi170 ceph-mon[31212]: pgmap v1634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:52 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 2883.302418 secs 2024-04-21T11:12:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:52 smithi170 ceph-mon[31212]: slow request 2883.302417 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T11:12:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:54 smithi077 ceph-mon[27902]: pgmap v1635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2885.062953 secs 2024-04-21T11:12:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:54 smithi191 ceph-mon[31636]: pgmap v1635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2885.062953 secs 2024-04-21T11:12:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:54 smithi170 ceph-mon[31212]: pgmap v1635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2885.062953 secs 2024-04-21T11:12:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:12:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:56 smithi077 ceph-mon[27902]: pgmap v1636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:56 smithi191 ceph-mon[31636]: pgmap v1636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:56 smithi170 ceph-mon[31212]: pgmap v1636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:12:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2888.302534 secs 2024-04-21T11:12:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2888.302534 secs 2024-04-21T11:12:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2888.302534 secs 2024-04-21T11:12:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:58 smithi077 ceph-mon[27902]: pgmap v1637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:58 smithi191 ceph-mon[31636]: pgmap v1637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:58 smithi170 ceph-mon[31212]: pgmap v1637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:12:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:12:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2890.063066 secs 2024-04-21T11:12:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:12:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2890.063066 secs 2024-04-21T11:12:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:12:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2890.063066 secs 2024-04-21T11:13:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:00 smithi077 ceph-mon[27902]: pgmap v1638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:00 smithi191 ceph-mon[31636]: pgmap v1638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:00 smithi170 ceph-mon[31212]: pgmap v1638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:02 smithi077 ceph-mon[27902]: pgmap v1639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2893.302689 secs 2024-04-21T11:13:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:02 smithi191 ceph-mon[31636]: pgmap v1639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2893.302689 secs 2024-04-21T11:13:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:02 smithi170 ceph-mon[31212]: pgmap v1639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2893.302689 secs 2024-04-21T11:13:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:04 smithi077 ceph-mon[27902]: pgmap v1640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2895.063175 secs 2024-04-21T11:13:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:04 smithi191 ceph-mon[31636]: pgmap v1640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2895.063175 secs 2024-04-21T11:13:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:04 smithi170 ceph-mon[31212]: pgmap v1640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2895.063175 secs 2024-04-21T11:13:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:05 smithi077 ceph-mon[27902]: osdmap e177: 12 total, 12 up, 12 in 2024-04-21T11:13:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:05 smithi191 ceph-mon[31636]: osdmap e177: 12 total, 12 up, 12 in 2024-04-21T11:13:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:05 smithi170 ceph-mon[31212]: osdmap e177: 12 total, 12 up, 12 in 2024-04-21T11:13:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:06 smithi077 ceph-mon[27902]: pgmap v1642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:13:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:06 smithi191 ceph-mon[31636]: pgmap v1642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:13:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:06 smithi170 ceph-mon[31212]: pgmap v1642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:13:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2898.302806 secs 2024-04-21T11:13:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2898.302806 secs 2024-04-21T11:13:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2898.302806 secs 2024-04-21T11:13:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:08 smithi077 ceph-mon[27902]: pgmap v1643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:13:08.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:08 smithi170 ceph-mon[31212]: pgmap v1643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:13:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:08 smithi191 ceph-mon[31636]: pgmap v1643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:13:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2900.063290 secs 2024-04-21T11:13:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2900.063290 secs 2024-04-21T11:13:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2900.063290 secs 2024-04-21T11:13:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:10 smithi191 ceph-mon[31636]: pgmap v1644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:13:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:10 smithi170 ceph-mon[31212]: pgmap v1644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:13:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:10 smithi077 ceph-mon[27902]: pgmap v1644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:13:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:12 smithi191 ceph-mon[31636]: pgmap v1645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:13:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2903.302926 secs 2024-04-21T11:13:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:12 smithi191 ceph-mon[31636]: osdmap e178: 12 total, 12 up, 12 in 2024-04-21T11:13:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:12 smithi170 ceph-mon[31212]: pgmap v1645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:13:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2903.302926 secs 2024-04-21T11:13:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:12 smithi170 ceph-mon[31212]: osdmap e178: 12 total, 12 up, 12 in 2024-04-21T11:13:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:12 smithi077 ceph-mon[27902]: pgmap v1645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:13:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2903.302926 secs 2024-04-21T11:13:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:12 smithi077 ceph-mon[27902]: osdmap e178: 12 total, 12 up, 12 in 2024-04-21T11:13:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:14 smithi191 ceph-mon[31636]: pgmap v1647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:13:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2905.063408 secs 2024-04-21T11:13:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:14 smithi170 ceph-mon[31212]: pgmap v1647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:13:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2905.063408 secs 2024-04-21T11:13:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:14 smithi077 ceph-mon[27902]: pgmap v1647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:13:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2905.063408 secs 2024-04-21T11:13:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:16 smithi191 ceph-mon[31636]: pgmap v1648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:13:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:16 smithi170 ceph-mon[31212]: pgmap v1648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:13:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:16 smithi077 ceph-mon[27902]: pgmap v1648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:13:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2908.303042 secs 2024-04-21T11:13:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2908.303042 secs 2024-04-21T11:13:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2908.303042 secs 2024-04-21T11:13:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:18 smithi191 ceph-mon[31636]: pgmap v1649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:13:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:18 smithi077 ceph-mon[27902]: pgmap v1649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:13:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:18 smithi170 ceph-mon[31212]: pgmap v1649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:13:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2910.063531 secs 2024-04-21T11:13:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2910.063531 secs 2024-04-21T11:13:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2910.063531 secs 2024-04-21T11:13:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:20 smithi191 ceph-mon[31636]: pgmap v1650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:13:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:20 smithi170 ceph-mon[31212]: pgmap v1650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:13:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:20 smithi077 ceph-mon[27902]: pgmap v1650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:13:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:22 smithi191 ceph-mon[31636]: pgmap v1651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:13:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2913.303132 secs 2024-04-21T11:13:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:22 smithi170 ceph-mon[31212]: pgmap v1651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:13:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2913.303132 secs 2024-04-21T11:13:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:22 smithi077 ceph-mon[27902]: pgmap v1651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:13:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2913.303132 secs 2024-04-21T11:13:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:24 smithi191 ceph-mon[31636]: pgmap v1652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:13:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2915.063607 secs 2024-04-21T11:13:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:24 smithi170 ceph-mon[31212]: pgmap v1652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:13:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2915.063607 secs 2024-04-21T11:13:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:24 smithi077 ceph-mon[27902]: pgmap v1652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:13:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2915.063607 secs 2024-04-21T11:13:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:26 smithi191 ceph-mon[31636]: pgmap v1653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:26 smithi170 ceph-mon[31212]: pgmap v1653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:26 smithi077 ceph-mon[27902]: pgmap v1653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2918.303250 secs 2024-04-21T11:13:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2918.303250 secs 2024-04-21T11:13:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2918.303250 secs 2024-04-21T11:13:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:28 smithi191 ceph-mon[31636]: pgmap v1654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:28 smithi170 ceph-mon[31212]: pgmap v1654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:28 smithi077 ceph-mon[27902]: pgmap v1654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2920.063742 secs 2024-04-21T11:13:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2920.063742 secs 2024-04-21T11:13:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2920.063742 secs 2024-04-21T11:13:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:30 smithi191 ceph-mon[31636]: pgmap v1655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:30 smithi170 ceph-mon[31212]: pgmap v1655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:30 smithi077 ceph-mon[27902]: pgmap v1655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:32 smithi191 ceph-mon[31636]: pgmap v1656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:13:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2923.303346 secs 2024-04-21T11:13:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:32 smithi170 ceph-mon[31212]: pgmap v1656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:13:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2923.303346 secs 2024-04-21T11:13:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:32 smithi077 ceph-mon[27902]: pgmap v1656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:13:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2923.303346 secs 2024-04-21T11:13:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:13:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:13:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:13:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:13:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:13:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:13:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:34 smithi191 ceph-mon[31636]: pgmap v1657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2925.063838 secs 2024-04-21T11:13:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:34 smithi170 ceph-mon[31212]: pgmap v1657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2925.063838 secs 2024-04-21T11:13:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:34 smithi077 ceph-mon[27902]: pgmap v1657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2925.063838 secs 2024-04-21T11:13:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:36 smithi191 ceph-mon[31636]: pgmap v1658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:36 smithi170 ceph-mon[31212]: pgmap v1658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:36 smithi077 ceph-mon[27902]: pgmap v1658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2928.303501 secs 2024-04-21T11:13:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2928.303501 secs 2024-04-21T11:13:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2928.303501 secs 2024-04-21T11:13:38.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:38 smithi170 ceph-mon[31212]: pgmap v1659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:38 smithi191 ceph-mon[31636]: pgmap v1659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:38 smithi077 ceph-mon[27902]: pgmap v1659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2930.063936 secs 2024-04-21T11:13:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2930.063936 secs 2024-04-21T11:13:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2930.063936 secs 2024-04-21T11:13:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:40 smithi191 ceph-mon[31636]: pgmap v1660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:40 smithi170 ceph-mon[31212]: pgmap v1660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:40 smithi077 ceph-mon[27902]: pgmap v1660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:42 smithi191 ceph-mon[31636]: pgmap v1661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2933.303628 secs 2024-04-21T11:13:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:42 smithi170 ceph-mon[31212]: pgmap v1661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2933.303628 secs 2024-04-21T11:13:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:42 smithi077 ceph-mon[27902]: pgmap v1661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2933.303628 secs 2024-04-21T11:13:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:44 smithi170 ceph-mon[31212]: pgmap v1662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2935.064058 secs 2024-04-21T11:13:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:44 smithi077 ceph-mon[27902]: pgmap v1662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2935.064058 secs 2024-04-21T11:13:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:44 smithi191 ceph-mon[31636]: pgmap v1662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2935.064058 secs 2024-04-21T11:13:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:46 smithi170 ceph-mon[31212]: pgmap v1663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:46 smithi077 ceph-mon[27902]: pgmap v1663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:46 smithi191 ceph-mon[31636]: pgmap v1663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2938.303757 secs 2024-04-21T11:13:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2938.303757 secs 2024-04-21T11:13:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2938.303757 secs 2024-04-21T11:13:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:48 smithi077 ceph-mon[27902]: pgmap v1664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:48 smithi170 ceph-mon[31212]: pgmap v1664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:48 smithi191 ceph-mon[31636]: pgmap v1664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2940.064172 secs 2024-04-21T11:13:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2940.064172 secs 2024-04-21T11:13:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2940.064172 secs 2024-04-21T11:13:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:50 smithi170 ceph-mon[31212]: pgmap v1665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:50 smithi077 ceph-mon[27902]: pgmap v1665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:50 smithi191 ceph-mon[31636]: pgmap v1665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:52 smithi170 ceph-mon[31212]: pgmap v1666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2943.303855 secs 2024-04-21T11:13:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:52 smithi077 ceph-mon[27902]: pgmap v1666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2943.303855 secs 2024-04-21T11:13:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:52 smithi191 ceph-mon[31636]: pgmap v1666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2943.303855 secs 2024-04-21T11:13:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.401+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T11:13:54.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.401+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.401+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640b0770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd70017000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.401+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640b0770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd70017000 comp rx=0 tx=0).stop 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.401+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640b0770 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.402+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640b0770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.402+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640b0770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.402+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.402+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:13:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.402+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7002a000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T11:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.419+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000809) for more than 900000000 us, fault. 2024-04-21T11:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T11:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:13:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T11:13:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.419+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T11:13:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:54 smithi170 ceph-mon[31212]: pgmap v1667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2945.064295 secs 2024-04-21T11:13:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:54 smithi077 ceph-mon[27902]: pgmap v1667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2945.064295 secs 2024-04-21T11:13:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:54 smithi191 ceph-mon[31636]: pgmap v1667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2945.064295 secs 2024-04-21T11:13:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.755+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:13:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.755+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:13:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.755+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:13:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:13:54.755+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:13:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:13:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:56 smithi170 ceph-mon[31212]: pgmap v1668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:56 smithi077 ceph-mon[27902]: pgmap v1668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:56 smithi191 ceph-mon[31636]: pgmap v1668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:13:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2948.303970 secs 2024-04-21T11:13:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2948.303970 secs 2024-04-21T11:13:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2948.303970 secs 2024-04-21T11:13:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:58 smithi170 ceph-mon[31212]: pgmap v1669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:58 smithi077 ceph-mon[27902]: pgmap v1669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:58 smithi191 ceph-mon[31636]: pgmap v1669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:13:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2950.064415 secs 2024-04-21T11:13:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2950.064415 secs 2024-04-21T11:13:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2950.064415 secs 2024-04-21T11:14:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:00 smithi170 ceph-mon[31212]: pgmap v1670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:00 smithi077 ceph-mon[27902]: pgmap v1670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:00 smithi191 ceph-mon[31636]: pgmap v1670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:02 smithi170 ceph-mon[31212]: pgmap v1671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2953.304061 secs 2024-04-21T11:14:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:02 smithi077 ceph-mon[27902]: pgmap v1671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2953.304061 secs 2024-04-21T11:14:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:02 smithi191 ceph-mon[31636]: pgmap v1671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2953.304061 secs 2024-04-21T11:14:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:04 smithi170 ceph-mon[31212]: pgmap v1672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2955.064537 secs 2024-04-21T11:14:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:04 smithi170 ceph-mon[31212]: osdmap e179: 12 total, 12 up, 12 in 2024-04-21T11:14:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:04 smithi077 ceph-mon[27902]: pgmap v1672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2955.064537 secs 2024-04-21T11:14:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:04 smithi077 ceph-mon[27902]: osdmap e179: 12 total, 12 up, 12 in 2024-04-21T11:14:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:04 smithi191 ceph-mon[31636]: pgmap v1672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2955.064537 secs 2024-04-21T11:14:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:04 smithi191 ceph-mon[31636]: osdmap e179: 12 total, 12 up, 12 in 2024-04-21T11:14:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:06.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:06 smithi170 ceph-mon[31212]: pgmap v1674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:14:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:06 smithi077 ceph-mon[27902]: pgmap v1674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:14:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:06 smithi191 ceph-mon[31636]: pgmap v1674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:14:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2958.304182 secs 2024-04-21T11:14:07.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2958.304182 secs 2024-04-21T11:14:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2958.304182 secs 2024-04-21T11:14:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:08 smithi170 ceph-mon[31212]: pgmap v1675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:14:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:08 smithi077 ceph-mon[27902]: pgmap v1675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:14:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:08 smithi191 ceph-mon[31636]: pgmap v1675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:14:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2960.064663 secs 2024-04-21T11:14:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2960.064663 secs 2024-04-21T11:14:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2960.064663 secs 2024-04-21T11:14:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:10 smithi170 ceph-mon[31212]: pgmap v1676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:14:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:10 smithi077 ceph-mon[27902]: pgmap v1676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:14:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:10 smithi191 ceph-mon[31636]: pgmap v1676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:14:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:12 smithi170 ceph-mon[31212]: pgmap v1677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:14:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2963.304314 secs 2024-04-21T11:14:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:12 smithi170 ceph-mon[31212]: osdmap e180: 12 total, 12 up, 12 in 2024-04-21T11:14:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:12 smithi077 ceph-mon[27902]: pgmap v1677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:14:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2963.304314 secs 2024-04-21T11:14:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:12 smithi077 ceph-mon[27902]: osdmap e180: 12 total, 12 up, 12 in 2024-04-21T11:14:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:12 smithi191 ceph-mon[31636]: pgmap v1677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:14:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2963.304314 secs 2024-04-21T11:14:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:12 smithi191 ceph-mon[31636]: osdmap e180: 12 total, 12 up, 12 in 2024-04-21T11:14:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:14 smithi170 ceph-mon[31212]: pgmap v1679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:14:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2965.064784 secs 2024-04-21T11:14:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:14 smithi077 ceph-mon[27902]: pgmap v1679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:14:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2965.064784 secs 2024-04-21T11:14:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:14 smithi191 ceph-mon[31636]: pgmap v1679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:14:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2965.064784 secs 2024-04-21T11:14:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:16 smithi170 ceph-mon[31212]: pgmap v1680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:14:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:16 smithi077 ceph-mon[27902]: pgmap v1680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:14:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:16 smithi191 ceph-mon[31636]: pgmap v1680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:14:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2968.304460 secs 2024-04-21T11:14:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2968.304460 secs 2024-04-21T11:14:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2968.304460 secs 2024-04-21T11:14:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:18 smithi077 ceph-mon[27902]: pgmap v1681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:14:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:18 smithi191 ceph-mon[31636]: pgmap v1681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:14:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:18 smithi170 ceph-mon[31212]: pgmap v1681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:14:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2970.064882 secs 2024-04-21T11:14:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2970.064882 secs 2024-04-21T11:14:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2970.064882 secs 2024-04-21T11:14:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:20 smithi077 ceph-mon[27902]: pgmap v1682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:14:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:20 smithi191 ceph-mon[31636]: pgmap v1682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:14:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:20 smithi170 ceph-mon[31212]: pgmap v1682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:14:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:22 smithi077 ceph-mon[27902]: pgmap v1683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:14:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2973.304544 secs 2024-04-21T11:14:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:22 smithi191 ceph-mon[31636]: pgmap v1683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:14:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2973.304544 secs 2024-04-21T11:14:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:22 smithi170 ceph-mon[31212]: pgmap v1683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:14:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2973.304544 secs 2024-04-21T11:14:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:24 smithi077 ceph-mon[27902]: pgmap v1684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:14:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2975.064993 secs 2024-04-21T11:14:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:24 smithi191 ceph-mon[31636]: pgmap v1684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:14:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2975.064993 secs 2024-04-21T11:14:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:24 smithi170 ceph-mon[31212]: pgmap v1684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:14:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2975.064993 secs 2024-04-21T11:14:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:26 smithi077 ceph-mon[27902]: pgmap v1685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:26 smithi191 ceph-mon[31636]: pgmap v1685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:26 smithi170 ceph-mon[31212]: pgmap v1685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2978.304655 secs 2024-04-21T11:14:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2978.304655 secs 2024-04-21T11:14:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2978.304655 secs 2024-04-21T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:28 smithi077 ceph-mon[27902]: pgmap v1686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:28 smithi191 ceph-mon[31636]: pgmap v1686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:28 smithi170 ceph-mon[31212]: pgmap v1686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2980.065102 secs 2024-04-21T11:14:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2980.065102 secs 2024-04-21T11:14:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2980.065102 secs 2024-04-21T11:14:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:30 smithi077 ceph-mon[27902]: pgmap v1687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:30 smithi191 ceph-mon[31636]: pgmap v1687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:30 smithi170 ceph-mon[31212]: pgmap v1687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:32 smithi077 ceph-mon[27902]: pgmap v1688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2983.304769 secs 2024-04-21T11:14:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:32 smithi191 ceph-mon[31636]: pgmap v1688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2983.304769 secs 2024-04-21T11:14:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:32 smithi170 ceph-mon[31212]: pgmap v1688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2983.304769 secs 2024-04-21T11:14:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:14:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:14:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:14:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:34 smithi077 ceph-mon[27902]: pgmap v1689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2985.065167 secs 2024-04-21T11:14:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:14:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:14:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:34 smithi191 ceph-mon[31636]: pgmap v1689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2985.065167 secs 2024-04-21T11:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:34 smithi170 ceph-mon[31212]: pgmap v1689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2985.065167 secs 2024-04-21T11:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:14:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:36 smithi077 ceph-mon[27902]: pgmap v1690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:36 smithi191 ceph-mon[31636]: pgmap v1690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:36 smithi170 ceph-mon[31212]: pgmap v1690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2988.304901 secs 2024-04-21T11:14:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2988.304901 secs 2024-04-21T11:14:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2988.304901 secs 2024-04-21T11:14:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:38 smithi077 ceph-mon[27902]: pgmap v1691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:38 smithi170 ceph-mon[31212]: pgmap v1691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:38 smithi191 ceph-mon[31636]: pgmap v1691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2990.065240 secs 2024-04-21T11:14:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2990.065240 secs 2024-04-21T11:14:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2990.065240 secs 2024-04-21T11:14:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:40 smithi077 ceph-mon[27902]: pgmap v1692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:40 smithi191 ceph-mon[31636]: pgmap v1692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:40 smithi170 ceph-mon[31212]: pgmap v1692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:42 smithi077 ceph-mon[27902]: pgmap v1693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2993.305033 secs 2024-04-21T11:14:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:42 smithi191 ceph-mon[31636]: pgmap v1693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2993.305033 secs 2024-04-21T11:14:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:42 smithi170 ceph-mon[31212]: pgmap v1693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2993.305033 secs 2024-04-21T11:14:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:44 smithi077 ceph-mon[27902]: pgmap v1694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 2995.065346 secs 2024-04-21T11:14:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:44 smithi191 ceph-mon[31636]: pgmap v1694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 2995.065346 secs 2024-04-21T11:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:44 smithi170 ceph-mon[31212]: pgmap v1694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 2995.065346 secs 2024-04-21T11:14:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:46 smithi077 ceph-mon[27902]: pgmap v1695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:46 smithi191 ceph-mon[31636]: pgmap v1695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:46 smithi170 ceph-mon[31212]: pgmap v1695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 2998.305170 secs 2024-04-21T11:14:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 2998.305170 secs 2024-04-21T11:14:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 2998.305170 secs 2024-04-21T11:14:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:48 smithi191 ceph-mon[31636]: pgmap v1696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:48.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:48 smithi077 ceph-mon[27902]: pgmap v1696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:48 smithi170 ceph-mon[31212]: pgmap v1696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3000.065475 secs 2024-04-21T11:14:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3000.065475 secs 2024-04-21T11:14:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3000.065475 secs 2024-04-21T11:14:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:50 smithi191 ceph-mon[31636]: pgmap v1697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:50 smithi170 ceph-mon[31212]: pgmap v1697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:50 smithi077 ceph-mon[27902]: pgmap v1697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:52 smithi191 ceph-mon[31636]: pgmap v1698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3003.305300 secs 2024-04-21T11:14:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:52 smithi170 ceph-mon[31212]: pgmap v1698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3003.305300 secs 2024-04-21T11:14:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:52 smithi077 ceph-mon[27902]: pgmap v1698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3003.305300 secs 2024-04-21T11:14:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:54 smithi191 ceph-mon[31636]: pgmap v1699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3005.065547 secs 2024-04-21T11:14:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:54 smithi170 ceph-mon[31212]: pgmap v1699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3005.065547 secs 2024-04-21T11:14:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:54 smithi077 ceph-mon[27902]: pgmap v1699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3005.065547 secs 2024-04-21T11:14:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:14:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:56 smithi191 ceph-mon[31636]: pgmap v1700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:56 smithi170 ceph-mon[31212]: pgmap v1700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:56 smithi077 ceph-mon[27902]: pgmap v1700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:14:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3008.305438 secs 2024-04-21T11:14:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3008.305438 secs 2024-04-21T11:14:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3008.305438 secs 2024-04-21T11:14:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:58 smithi191 ceph-mon[31636]: pgmap v1701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:58 smithi170 ceph-mon[31212]: pgmap v1701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:58 smithi077 ceph-mon[27902]: pgmap v1701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:14:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3010.065697 secs 2024-04-21T11:14:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3010.065697 secs 2024-04-21T11:14:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3010.065697 secs 2024-04-21T11:15:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:00 smithi191 ceph-mon[31636]: pgmap v1702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:00 smithi170 ceph-mon[31212]: pgmap v1702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:00 smithi077 ceph-mon[27902]: pgmap v1702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:02 smithi191 ceph-mon[31636]: pgmap v1703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3013.305544 secs 2024-04-21T11:15:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:02 smithi170 ceph-mon[31212]: pgmap v1703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3013.305544 secs 2024-04-21T11:15:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:02 smithi077 ceph-mon[27902]: pgmap v1703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3013.305544 secs 2024-04-21T11:15:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:04 smithi191 ceph-mon[31636]: pgmap v1704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3015.065799 secs 2024-04-21T11:15:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:04 smithi191 ceph-mon[31636]: osdmap e181: 12 total, 12 up, 12 in 2024-04-21T11:15:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:04 smithi170 ceph-mon[31212]: pgmap v1704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3015.065799 secs 2024-04-21T11:15:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:04 smithi170 ceph-mon[31212]: osdmap e181: 12 total, 12 up, 12 in 2024-04-21T11:15:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:04 smithi077 ceph-mon[27902]: pgmap v1704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3015.065799 secs 2024-04-21T11:15:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:04 smithi077 ceph-mon[27902]: osdmap e181: 12 total, 12 up, 12 in 2024-04-21T11:15:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:06 smithi191 ceph-mon[31636]: pgmap v1706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:15:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:06 smithi170 ceph-mon[31212]: pgmap v1706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:15:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:06 smithi077 ceph-mon[27902]: pgmap v1706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:15:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3018.305640 secs 2024-04-21T11:15:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3018.305640 secs 2024-04-21T11:15:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3018.305640 secs 2024-04-21T11:15:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:08 smithi170 ceph-mon[31212]: pgmap v1707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:15:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:08 smithi191 ceph-mon[31636]: pgmap v1707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:15:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:08 smithi077 ceph-mon[27902]: pgmap v1707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:15:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3020.065946 secs 2024-04-21T11:15:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3020.065946 secs 2024-04-21T11:15:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3020.065946 secs 2024-04-21T11:15:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:10 smithi191 ceph-mon[31636]: pgmap v1708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:15:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:10 smithi170 ceph-mon[31212]: pgmap v1708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:10 smithi077 ceph-mon[27902]: pgmap v1708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:15:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:12 smithi191 ceph-mon[31636]: pgmap v1709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:15:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3023.305811 secs 2024-04-21T11:15:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:12 smithi191 ceph-mon[31636]: osdmap e182: 12 total, 12 up, 12 in 2024-04-21T11:15:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:12 smithi170 ceph-mon[31212]: pgmap v1709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:15:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3023.305811 secs 2024-04-21T11:15:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:12 smithi170 ceph-mon[31212]: osdmap e182: 12 total, 12 up, 12 in 2024-04-21T11:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:12 smithi077 ceph-mon[27902]: pgmap v1709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3023.305811 secs 2024-04-21T11:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:12 smithi077 ceph-mon[27902]: osdmap e182: 12 total, 12 up, 12 in 2024-04-21T11:15:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:14 smithi191 ceph-mon[31636]: pgmap v1711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:15:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3025.066026 secs 2024-04-21T11:15:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:14 smithi170 ceph-mon[31212]: pgmap v1711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:15:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3025.066026 secs 2024-04-21T11:15:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:14 smithi077 ceph-mon[27902]: pgmap v1711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T11:15:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3025.066026 secs 2024-04-21T11:15:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:16 smithi191 ceph-mon[31636]: pgmap v1712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:15:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:16 smithi170 ceph-mon[31212]: pgmap v1712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:15:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:16 smithi077 ceph-mon[27902]: pgmap v1712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:15:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3028.305939 secs 2024-04-21T11:15:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:17 smithi170 ceph-mon[31212]: pgmap v1713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:15:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3028.305939 secs 2024-04-21T11:15:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:17 smithi077 ceph-mon[27902]: pgmap v1713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:15:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3028.305939 secs 2024-04-21T11:15:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:17 smithi191 ceph-mon[31636]: pgmap v1713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:15:19.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3030.066155 secs 2024-04-21T11:15:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3030.066155 secs 2024-04-21T11:15:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3030.066155 secs 2024-04-21T11:15:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:19 smithi170 ceph-mon[31212]: pgmap v1714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:15:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:19 smithi077 ceph-mon[27902]: pgmap v1714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:15:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:19 smithi191 ceph-mon[31636]: pgmap v1714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:15:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:22 smithi077 ceph-mon[27902]: pgmap v1715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:15:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3033.306066 secs 2024-04-21T11:15:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:22 smithi191 ceph-mon[31636]: pgmap v1715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:15:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3033.306066 secs 2024-04-21T11:15:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:22 smithi170 ceph-mon[31212]: pgmap v1715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:15:22.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3033.306066 secs 2024-04-21T11:15:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:24 smithi077 ceph-mon[27902]: pgmap v1716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:15:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3035.066294 secs 2024-04-21T11:15:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:24 smithi191 ceph-mon[31636]: pgmap v1716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:15:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3035.066294 secs 2024-04-21T11:15:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:24 smithi170 ceph-mon[31212]: pgmap v1716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:15:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3035.066294 secs 2024-04-21T11:15:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:26 smithi077 ceph-mon[27902]: pgmap v1717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:26 smithi191 ceph-mon[31636]: pgmap v1717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:26 smithi170 ceph-mon[31212]: pgmap v1717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3038.306146 secs 2024-04-21T11:15:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3038.306146 secs 2024-04-21T11:15:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3038.306146 secs 2024-04-21T11:15:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:28 smithi077 ceph-mon[27902]: pgmap v1718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:28 smithi191 ceph-mon[31636]: pgmap v1718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:28 smithi170 ceph-mon[31212]: pgmap v1718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3040.066359 secs 2024-04-21T11:15:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3040.066359 secs 2024-04-21T11:15:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3040.066359 secs 2024-04-21T11:15:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:30 smithi077 ceph-mon[27902]: pgmap v1719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:30 smithi191 ceph-mon[31636]: pgmap v1719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:30 smithi170 ceph-mon[31212]: pgmap v1719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:32 smithi077 ceph-mon[27902]: pgmap v1720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3043.306285 secs 2024-04-21T11:15:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:32 smithi191 ceph-mon[31636]: pgmap v1720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3043.306285 secs 2024-04-21T11:15:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:32 smithi170 ceph-mon[31212]: pgmap v1720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3043.306285 secs 2024-04-21T11:15:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:34 smithi077 ceph-mon[27902]: pgmap v1721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3045.066498 secs 2024-04-21T11:15:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:15:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:34 smithi191 ceph-mon[31636]: pgmap v1721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3045.066498 secs 2024-04-21T11:15:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:15:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:34 smithi170 ceph-mon[31212]: pgmap v1721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3045.066498 secs 2024-04-21T11:15:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:15:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:15:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:15:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:15:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:15:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:15:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:15:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:15:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:15:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:15:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:36 smithi077 ceph-mon[27902]: pgmap v1722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:36 smithi191 ceph-mon[31636]: pgmap v1722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:36 smithi170 ceph-mon[31212]: pgmap v1722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3048.306363 secs 2024-04-21T11:15:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3048.306363 secs 2024-04-21T11:15:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3048.306363 secs 2024-04-21T11:15:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:38 smithi077 ceph-mon[27902]: pgmap v1723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:38.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:38 smithi170 ceph-mon[31212]: pgmap v1723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:38 smithi191 ceph-mon[31636]: pgmap v1723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3050.066623 secs 2024-04-21T11:15:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3050.066623 secs 2024-04-21T11:15:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3050.066623 secs 2024-04-21T11:15:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:40 smithi191 ceph-mon[31636]: pgmap v1724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:40 smithi170 ceph-mon[31212]: pgmap v1724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:40 smithi077 ceph-mon[27902]: pgmap v1724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:42 smithi191 ceph-mon[31636]: pgmap v1725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3053.306461 secs 2024-04-21T11:15:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:42 smithi170 ceph-mon[31212]: pgmap v1725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3053.306461 secs 2024-04-21T11:15:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:42 smithi077 ceph-mon[27902]: pgmap v1725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3053.306461 secs 2024-04-21T11:15:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:44 smithi191 ceph-mon[31636]: pgmap v1726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3055.066744 secs 2024-04-21T11:15:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:44 smithi170 ceph-mon[31212]: pgmap v1726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3055.066744 secs 2024-04-21T11:15:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:44 smithi077 ceph-mon[27902]: pgmap v1726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3055.066744 secs 2024-04-21T11:15:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:46 smithi191 ceph-mon[31636]: pgmap v1727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:46 smithi170 ceph-mon[31212]: pgmap v1727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:46 smithi077 ceph-mon[27902]: pgmap v1727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3058.306595 secs 2024-04-21T11:15:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3058.306595 secs 2024-04-21T11:15:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3058.306595 secs 2024-04-21T11:15:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:48 smithi191 ceph-mon[31636]: pgmap v1728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:48 smithi170 ceph-mon[31212]: pgmap v1728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:48 smithi077 ceph-mon[27902]: pgmap v1728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3060.066906 secs 2024-04-21T11:15:49.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3060.066906 secs 2024-04-21T11:15:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3060.066906 secs 2024-04-21T11:15:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:50 smithi191 ceph-mon[31636]: pgmap v1729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:50.708 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:50 smithi077 ceph-mon[27902]: pgmap v1729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:50.709 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:50 smithi170 ceph-mon[31212]: pgmap v1729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:52 smithi191 ceph-mon[31636]: pgmap v1730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3063.306695 secs 2024-04-21T11:15:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:52 smithi170 ceph-mon[31212]: pgmap v1730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3063.306695 secs 2024-04-21T11:15:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:52 smithi077 ceph-mon[27902]: pgmap v1730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3063.306695 secs 2024-04-21T11:15:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:54 smithi191 ceph-mon[31636]: pgmap v1731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3065.066974 secs 2024-04-21T11:15:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:54 smithi170 ceph-mon[31212]: pgmap v1731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3065.066974 secs 2024-04-21T11:15:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:54 smithi077 ceph-mon[27902]: pgmap v1731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3065.066974 secs 2024-04-21T11:15:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:15:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:56 smithi191 ceph-mon[31636]: pgmap v1732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:56 smithi170 ceph-mon[31212]: pgmap v1732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:56 smithi077 ceph-mon[27902]: pgmap v1732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:15:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3068.306811 secs 2024-04-21T11:15:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3068.306811 secs 2024-04-21T11:15:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3068.306811 secs 2024-04-21T11:15:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:58 smithi191 ceph-mon[31636]: pgmap v1733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:58 smithi170 ceph-mon[31212]: pgmap v1733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:58 smithi077 ceph-mon[27902]: pgmap v1733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:15:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3070.067067 secs 2024-04-21T11:15:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3070.067067 secs 2024-04-21T11:15:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3070.067067 secs 2024-04-21T11:16:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:00 smithi191 ceph-mon[31636]: pgmap v1734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:00 smithi170 ceph-mon[31212]: pgmap v1734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:00 smithi077 ceph-mon[27902]: pgmap v1734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:02 smithi191 ceph-mon[31636]: pgmap v1735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3073.306937 secs 2024-04-21T11:16:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:02 smithi170 ceph-mon[31212]: pgmap v1735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3073.306937 secs 2024-04-21T11:16:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:02 smithi077 ceph-mon[27902]: pgmap v1735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3073.306937 secs 2024-04-21T11:16:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:04 smithi191 ceph-mon[31636]: pgmap v1736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3075.067131 secs 2024-04-21T11:16:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:04 smithi170 ceph-mon[31212]: pgmap v1736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3075.067131 secs 2024-04-21T11:16:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:04 smithi077 ceph-mon[27902]: pgmap v1736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3075.067131 secs 2024-04-21T11:16:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:05 smithi191 ceph-mon[31636]: osdmap e183: 12 total, 12 up, 12 in 2024-04-21T11:16:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:05 smithi170 ceph-mon[31212]: osdmap e183: 12 total, 12 up, 12 in 2024-04-21T11:16:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:05 smithi077 ceph-mon[27902]: osdmap e183: 12 total, 12 up, 12 in 2024-04-21T11:16:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:06 smithi191 ceph-mon[31636]: pgmap v1738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:16:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:06 smithi170 ceph-mon[31212]: pgmap v1738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:16:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:06 smithi077 ceph-mon[27902]: pgmap v1738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:16:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3078.307050 secs 2024-04-21T11:16:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3078.307050 secs 2024-04-21T11:16:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3078.307050 secs 2024-04-21T11:16:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:08 smithi170 ceph-mon[31212]: pgmap v1739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:16:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:08 smithi077 ceph-mon[27902]: pgmap v1739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:16:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:08 smithi191 ceph-mon[31636]: pgmap v1739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:16:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3080.067260 secs 2024-04-21T11:16:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3080.067260 secs 2024-04-21T11:16:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3080.067260 secs 2024-04-21T11:16:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:10 smithi170 ceph-mon[31212]: pgmap v1740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:16:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:10 smithi077 ceph-mon[27902]: pgmap v1740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:16:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:10 smithi191 ceph-mon[31636]: pgmap v1740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:16:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:12 smithi170 ceph-mon[31212]: pgmap v1741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:16:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3083.307176 secs 2024-04-21T11:16:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:12 smithi170 ceph-mon[31212]: osdmap e184: 12 total, 12 up, 12 in 2024-04-21T11:16:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:12 smithi077 ceph-mon[27902]: pgmap v1741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:16:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3083.307176 secs 2024-04-21T11:16:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:12 smithi077 ceph-mon[27902]: osdmap e184: 12 total, 12 up, 12 in 2024-04-21T11:16:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:12 smithi191 ceph-mon[31636]: pgmap v1741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3083.307176 secs 2024-04-21T11:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:12 smithi191 ceph-mon[31636]: osdmap e184: 12 total, 12 up, 12 in 2024-04-21T11:16:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:14 smithi170 ceph-mon[31212]: pgmap v1743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:16:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3085.067382 secs 2024-04-21T11:16:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:14 smithi077 ceph-mon[27902]: pgmap v1743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:16:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3085.067382 secs 2024-04-21T11:16:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:14 smithi191 ceph-mon[31636]: pgmap v1743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T11:16:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3085.067382 secs 2024-04-21T11:16:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:16 smithi170 ceph-mon[31212]: pgmap v1744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:16:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:16 smithi077 ceph-mon[27902]: pgmap v1744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:16:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:16 smithi191 ceph-mon[31636]: pgmap v1744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:16:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3088.307246 secs 2024-04-21T11:16:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3088.307246 secs 2024-04-21T11:16:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3088.307246 secs 2024-04-21T11:16:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:18 smithi170 ceph-mon[31212]: pgmap v1745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:16:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:18 smithi077 ceph-mon[27902]: pgmap v1745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:16:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:18 smithi191 ceph-mon[31636]: pgmap v1745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:16:19.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3090.067528 secs 2024-04-21T11:16:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3090.067528 secs 2024-04-21T11:16:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3090.067528 secs 2024-04-21T11:16:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:20 smithi170 ceph-mon[31212]: pgmap v1746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:16:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:20 smithi077 ceph-mon[27902]: pgmap v1746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:16:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:20 smithi191 ceph-mon[31636]: pgmap v1746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:16:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:22 smithi170 ceph-mon[31212]: pgmap v1747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:16:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3093.307367 secs 2024-04-21T11:16:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:22 smithi077 ceph-mon[27902]: pgmap v1747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:16:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3093.307367 secs 2024-04-21T11:16:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:22 smithi191 ceph-mon[31636]: pgmap v1747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:16:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3093.307367 secs 2024-04-21T11:16:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:24 smithi170 ceph-mon[31212]: pgmap v1748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:16:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3095.067647 secs 2024-04-21T11:16:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:24 smithi077 ceph-mon[27902]: pgmap v1748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:16:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3095.067647 secs 2024-04-21T11:16:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:24 smithi191 ceph-mon[31636]: pgmap v1748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T11:16:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3095.067647 secs 2024-04-21T11:16:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:26 smithi170 ceph-mon[31212]: pgmap v1749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:26 smithi077 ceph-mon[27902]: pgmap v1749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:26 smithi191 ceph-mon[31636]: pgmap v1749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3098.307504 secs 2024-04-21T11:16:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3098.307504 secs 2024-04-21T11:16:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3098.307504 secs 2024-04-21T11:16:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:28 smithi170 ceph-mon[31212]: pgmap v1750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:28 smithi077 ceph-mon[27902]: pgmap v1750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:28 smithi191 ceph-mon[31636]: pgmap v1750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3100.067756 secs 2024-04-21T11:16:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3100.067756 secs 2024-04-21T11:16:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3100.067756 secs 2024-04-21T11:16:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:30 smithi170 ceph-mon[31212]: pgmap v1751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:30 smithi077 ceph-mon[27902]: pgmap v1751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:30 smithi191 ceph-mon[31636]: pgmap v1751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:32 smithi170 ceph-mon[31212]: pgmap v1752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3103.307621 secs 2024-04-21T11:16:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:32 smithi077 ceph-mon[27902]: pgmap v1752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3103.307621 secs 2024-04-21T11:16:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:32 smithi191 ceph-mon[31636]: pgmap v1752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3103.307621 secs 2024-04-21T11:16:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:34 smithi170 ceph-mon[31212]: pgmap v1753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3105.067902 secs 2024-04-21T11:16:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:34 smithi077 ceph-mon[27902]: pgmap v1753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3105.067902 secs 2024-04-21T11:16:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:34 smithi191 ceph-mon[31636]: pgmap v1753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3105.067902 secs 2024-04-21T11:16:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:16:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:16:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:16:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:36 smithi170 ceph-mon[31212]: pgmap v1754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:16:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:16:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:16:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:36 smithi077 ceph-mon[27902]: pgmap v1754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:16:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:16:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:16:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:36 smithi191 ceph-mon[31636]: pgmap v1754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:16:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:16:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:16:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3108.307727 secs 2024-04-21T11:16:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3108.307727 secs 2024-04-21T11:16:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3108.307727 secs 2024-04-21T11:16:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:38 smithi170 ceph-mon[31212]: pgmap v1755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:38 smithi077 ceph-mon[27902]: pgmap v1755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:38 smithi191 ceph-mon[31636]: pgmap v1755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3110.068001 secs 2024-04-21T11:16:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3110.068001 secs 2024-04-21T11:16:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3110.068001 secs 2024-04-21T11:16:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:40 smithi077 ceph-mon[27902]: pgmap v1756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:40 smithi191 ceph-mon[31636]: pgmap v1756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:40 smithi170 ceph-mon[31212]: pgmap v1756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:42 smithi077 ceph-mon[27902]: pgmap v1757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3113.307825 secs 2024-04-21T11:16:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:42 smithi191 ceph-mon[31636]: pgmap v1757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3113.307825 secs 2024-04-21T11:16:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:42 smithi170 ceph-mon[31212]: pgmap v1757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3113.307825 secs 2024-04-21T11:16:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:44 smithi077 ceph-mon[27902]: pgmap v1758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3115.068124 secs 2024-04-21T11:16:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:44 smithi191 ceph-mon[31636]: pgmap v1758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3115.068124 secs 2024-04-21T11:16:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:44 smithi170 ceph-mon[31212]: pgmap v1758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3115.068124 secs 2024-04-21T11:16:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:46 smithi077 ceph-mon[27902]: pgmap v1759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:46 smithi191 ceph-mon[31636]: pgmap v1759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:46 smithi170 ceph-mon[31212]: pgmap v1759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3118.307948 secs 2024-04-21T11:16:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3118.307948 secs 2024-04-21T11:16:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3118.307948 secs 2024-04-21T11:16:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:48 smithi077 ceph-mon[27902]: pgmap v1760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:48 smithi191 ceph-mon[31636]: pgmap v1760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:48 smithi170 ceph-mon[31212]: pgmap v1760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 3120.068268 secs 2024-04-21T11:16:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:49 smithi077 ceph-mon[27902]: slow request 2881.522077 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:16:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:49 smithi077 ceph-mon[27902]: slow request 2881.510920 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:49 smithi077 ceph-mon[27902]: slow request 2881.462737 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:49 smithi077 ceph-mon[27902]: slow request 2881.431687 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:49 smithi077 ceph-mon[27902]: slow request 2881.388126 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 3120.068268 secs 2024-04-21T11:16:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:49 smithi191 ceph-mon[31636]: slow request 2881.522077 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:16:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:49 smithi191 ceph-mon[31636]: slow request 2881.510920 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:49 smithi191 ceph-mon[31636]: slow request 2881.462737 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:49 smithi191 ceph-mon[31636]: slow request 2881.431687 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:49 smithi191 ceph-mon[31636]: slow request 2881.388126 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 3120.068268 secs 2024-04-21T11:16:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:49 smithi170 ceph-mon[31212]: slow request 2881.522077 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:16:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:49 smithi170 ceph-mon[31212]: slow request 2881.510920 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:49 smithi170 ceph-mon[31212]: slow request 2881.462737 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:49 smithi170 ceph-mon[31212]: slow request 2881.431687 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:49 smithi170 ceph-mon[31212]: slow request 2881.388126 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:50 smithi077 ceph-mon[27902]: pgmap v1761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:50 smithi191 ceph-mon[31636]: pgmap v1761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:50 smithi170 ceph-mon[31212]: pgmap v1761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:52 smithi077 ceph-mon[27902]: pgmap v1762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:52.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3123.308065 secs 2024-04-21T11:16:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:52 smithi191 ceph-mon[31636]: pgmap v1762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3123.308065 secs 2024-04-21T11:16:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:52 smithi170 ceph-mon[31212]: pgmap v1762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3123.308065 secs 2024-04-21T11:16:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: pgmap v1763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 3125.068386 secs 2024-04-21T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: slow request 2886.260933 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: slow request 2886.251188 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: slow request 2886.232196 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: slow request 2886.230179 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:54 smithi077 ceph-mon[27902]: slow request 2886.222193 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: pgmap v1763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 3125.068386 secs 2024-04-21T11:16:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: slow request 2886.260933 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: slow request 2886.251188 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: slow request 2886.232196 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: slow request 2886.230179 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:54 smithi191 ceph-mon[31636]: slow request 2886.222193 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:16:54.780+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:16:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:16:54.780+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:16:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:16:54.780+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:16:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:16:54.780+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: pgmap v1763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 3125.068386 secs 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: slow request 2886.260933 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: slow request 2886.251188 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: slow request 2886.232196 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: slow request 2886.230179 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:54 smithi170 ceph-mon[31212]: slow request 2886.222193 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:16:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:56 smithi077 ceph-mon[27902]: pgmap v1764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:56 smithi191 ceph-mon[31636]: pgmap v1764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:56 smithi170 ceph-mon[31212]: pgmap v1764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:16:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3128.308183 secs 2024-04-21T11:16:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3128.308183 secs 2024-04-21T11:16:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3128.308183 secs 2024-04-21T11:16:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:58 smithi077 ceph-mon[27902]: pgmap v1765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:58 smithi191 ceph-mon[31636]: pgmap v1765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:58 smithi170 ceph-mon[31212]: pgmap v1765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 3130.068540 secs 2024-04-21T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:59 smithi077 ceph-mon[27902]: slow request 2891.215495 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:59 smithi077 ceph-mon[27902]: slow request 2891.206488 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:59 smithi077 ceph-mon[27902]: slow request 2891.201379 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:59 smithi077 ceph-mon[27902]: slow request 2891.185870 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:16:59 smithi077 ceph-mon[27902]: slow request 2891.177183 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 3130.068540 secs 2024-04-21T11:16:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:59 smithi191 ceph-mon[31636]: slow request 2891.215495 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:59 smithi191 ceph-mon[31636]: slow request 2891.206488 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:59 smithi191 ceph-mon[31636]: slow request 2891.201379 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:59 smithi191 ceph-mon[31636]: slow request 2891.185870 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:16:59 smithi191 ceph-mon[31636]: slow request 2891.177183 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 3130.068540 secs 2024-04-21T11:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:59 smithi170 ceph-mon[31212]: slow request 2891.215495 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:59 smithi170 ceph-mon[31212]: slow request 2891.206488 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:59 smithi170 ceph-mon[31212]: slow request 2891.201379 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:59 smithi170 ceph-mon[31212]: slow request 2891.185870 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:16:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:16:59 smithi170 ceph-mon[31212]: slow request 2891.177183 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T11:17:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:00 smithi077 ceph-mon[27902]: pgmap v1766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:00 smithi191 ceph-mon[31636]: pgmap v1766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:00 smithi170 ceph-mon[31212]: pgmap v1766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:02 smithi077 ceph-mon[27902]: pgmap v1767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3133.308308 secs 2024-04-21T11:17:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:02 smithi191 ceph-mon[31636]: pgmap v1767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3133.308308 secs 2024-04-21T11:17:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:02 smithi170 ceph-mon[31212]: pgmap v1767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3133.308308 secs 2024-04-21T11:17:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:04 smithi077 ceph-mon[27902]: pgmap v1768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 3135.068664 secs 2024-04-21T11:17:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:04 smithi077 ceph-mon[27902]: slow request 2881.360547 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:04 smithi077 ceph-mon[27902]: slow request 2891.278742 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:04 smithi077 ceph-mon[27902]: slow request 2891.263871 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:04 smithi077 ceph-mon[27902]: osdmap e185: 12 total, 12 up, 12 in 2024-04-21T11:17:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:04 smithi191 ceph-mon[31636]: pgmap v1768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 3135.068664 secs 2024-04-21T11:17:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:04 smithi191 ceph-mon[31636]: slow request 2881.360547 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:04 smithi191 ceph-mon[31636]: slow request 2891.278742 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:04 smithi191 ceph-mon[31636]: slow request 2891.263871 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:04 smithi191 ceph-mon[31636]: osdmap e185: 12 total, 12 up, 12 in 2024-04-21T11:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:04 smithi170 ceph-mon[31212]: pgmap v1768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 3135.068664 secs 2024-04-21T11:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:04 smithi170 ceph-mon[31212]: slow request 2881.360547 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:04 smithi170 ceph-mon[31212]: slow request 2891.278742 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:04 smithi170 ceph-mon[31212]: slow request 2891.263871 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:17:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:04 smithi170 ceph-mon[31212]: osdmap e185: 12 total, 12 up, 12 in 2024-04-21T11:17:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:06 smithi077 ceph-mon[27902]: pgmap v1770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:17:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:06 smithi191 ceph-mon[31636]: pgmap v1770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:17:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:06 smithi170 ceph-mon[31212]: pgmap v1770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:17:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3138.308420 secs 2024-04-21T11:17:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3138.308420 secs 2024-04-21T11:17:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3138.308420 secs 2024-04-21T11:17:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:08 smithi077 ceph-mon[27902]: pgmap v1771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:17:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:08 smithi170 ceph-mon[31212]: pgmap v1771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:17:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:08 smithi191 ceph-mon[31636]: pgmap v1771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:17:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3140.068787 secs 2024-04-21T11:17:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3140.068787 secs 2024-04-21T11:17:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3140.068787 secs 2024-04-21T11:17:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:10 smithi191 ceph-mon[31636]: pgmap v1772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:17:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:10 smithi170 ceph-mon[31212]: pgmap v1772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:17:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:10 smithi077 ceph-mon[27902]: pgmap v1772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:17:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:12 smithi191 ceph-mon[31636]: pgmap v1773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:17:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3143.308557 secs 2024-04-21T11:17:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:12 smithi191 ceph-mon[31636]: osdmap e186: 12 total, 12 up, 12 in 2024-04-21T11:17:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:12 smithi170 ceph-mon[31212]: pgmap v1773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:17:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3143.308557 secs 2024-04-21T11:17:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:12 smithi170 ceph-mon[31212]: osdmap e186: 12 total, 12 up, 12 in 2024-04-21T11:17:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:12 smithi077 ceph-mon[27902]: pgmap v1773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:17:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3143.308557 secs 2024-04-21T11:17:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:12 smithi077 ceph-mon[27902]: osdmap e186: 12 total, 12 up, 12 in 2024-04-21T11:17:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:14 smithi191 ceph-mon[31636]: pgmap v1775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:17:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3145.068907 secs 2024-04-21T11:17:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:14 smithi170 ceph-mon[31212]: pgmap v1775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:17:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3145.068907 secs 2024-04-21T11:17:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:14 smithi077 ceph-mon[27902]: pgmap v1775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:17:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3145.068907 secs 2024-04-21T11:17:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:16 smithi191 ceph-mon[31636]: pgmap v1776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:17:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:16 smithi170 ceph-mon[31212]: pgmap v1776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:17:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:16 smithi077 ceph-mon[27902]: pgmap v1776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:17:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3148.308704 secs 2024-04-21T11:17:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:17 smithi170 ceph-mon[31212]: pgmap v1777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:17:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3148.308704 secs 2024-04-21T11:17:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:17 smithi077 ceph-mon[27902]: pgmap v1777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:17:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3148.308704 secs 2024-04-21T11:17:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:17 smithi191 ceph-mon[31636]: pgmap v1777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:17:19.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3150.068974 secs 2024-04-21T11:17:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3150.068974 secs 2024-04-21T11:17:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3150.068974 secs 2024-04-21T11:17:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:19 smithi170 ceph-mon[31212]: pgmap v1778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:17:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:19 smithi077 ceph-mon[27902]: pgmap v1778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:17:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:19 smithi191 ceph-mon[31636]: pgmap v1778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:17:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:22 smithi077 ceph-mon[27902]: pgmap v1779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:17:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3153.308860 secs 2024-04-21T11:17:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:22 smithi191 ceph-mon[31636]: pgmap v1779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:17:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3153.308860 secs 2024-04-21T11:17:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:22 smithi170 ceph-mon[31212]: pgmap v1779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:17:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3153.308860 secs 2024-04-21T11:17:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:24 smithi077 ceph-mon[27902]: pgmap v1780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:17:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3155.069101 secs 2024-04-21T11:17:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:24 smithi191 ceph-mon[31636]: pgmap v1780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:17:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3155.069101 secs 2024-04-21T11:17:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:24 smithi170 ceph-mon[31212]: pgmap v1780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:17:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3155.069101 secs 2024-04-21T11:17:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:26 smithi077 ceph-mon[27902]: pgmap v1781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:26 smithi191 ceph-mon[31636]: pgmap v1781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:26 smithi170 ceph-mon[31212]: pgmap v1781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3158.308925 secs 2024-04-21T11:17:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3158.308925 secs 2024-04-21T11:17:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3158.308925 secs 2024-04-21T11:17:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:28 smithi191 ceph-mon[31636]: pgmap v1782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:28 smithi170 ceph-mon[31212]: pgmap v1782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:28 smithi077 ceph-mon[27902]: pgmap v1782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3160.069225 secs 2024-04-21T11:17:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3160.069225 secs 2024-04-21T11:17:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3160.069225 secs 2024-04-21T11:17:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:30 smithi191 ceph-mon[31636]: pgmap v1783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:30 smithi170 ceph-mon[31212]: pgmap v1783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:30 smithi077 ceph-mon[27902]: pgmap v1783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:32 smithi191 ceph-mon[31636]: pgmap v1784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3163.309016 secs 2024-04-21T11:17:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:32 smithi170 ceph-mon[31212]: pgmap v1784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3163.309016 secs 2024-04-21T11:17:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:32 smithi077 ceph-mon[27902]: pgmap v1784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3163.309016 secs 2024-04-21T11:17:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:34 smithi191 ceph-mon[31636]: pgmap v1785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3165.069357 secs 2024-04-21T11:17:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:34 smithi170 ceph-mon[31212]: pgmap v1785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3165.069357 secs 2024-04-21T11:17:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:34 smithi077 ceph-mon[27902]: pgmap v1785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3165.069357 secs 2024-04-21T11:17:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:36 smithi191 ceph-mon[31636]: pgmap v1786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:17:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:36 smithi170 ceph-mon[31212]: pgmap v1786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:17:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:36 smithi077 ceph-mon[27902]: pgmap v1786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:17:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:17:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:17:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:17:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3168.309122 secs 2024-04-21T11:17:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:17:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:17:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:17:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3168.309122 secs 2024-04-21T11:17:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:17:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:17:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:17:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3168.309122 secs 2024-04-21T11:17:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:38 smithi170 ceph-mon[31212]: pgmap v1787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:38 smithi077 ceph-mon[27902]: pgmap v1787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:38 smithi191 ceph-mon[31636]: pgmap v1787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3170.069417 secs 2024-04-21T11:17:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3170.069417 secs 2024-04-21T11:17:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3170.069417 secs 2024-04-21T11:17:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:40 smithi170 ceph-mon[31212]: pgmap v1788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:40 smithi077 ceph-mon[27902]: pgmap v1788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:40 smithi191 ceph-mon[31636]: pgmap v1788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:42 smithi170 ceph-mon[31212]: pgmap v1789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3173.309227 secs 2024-04-21T11:17:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:42 smithi077 ceph-mon[27902]: pgmap v1789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3173.309227 secs 2024-04-21T11:17:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:42 smithi191 ceph-mon[31636]: pgmap v1789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3173.309227 secs 2024-04-21T11:17:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:44 smithi170 ceph-mon[31212]: pgmap v1790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3175.069537 secs 2024-04-21T11:17:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:44 smithi077 ceph-mon[27902]: pgmap v1790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3175.069537 secs 2024-04-21T11:17:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:44 smithi191 ceph-mon[31636]: pgmap v1790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3175.069537 secs 2024-04-21T11:17:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:46 smithi170 ceph-mon[31212]: pgmap v1791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:46 smithi077 ceph-mon[27902]: pgmap v1791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:46 smithi191 ceph-mon[31636]: pgmap v1791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3178.309354 secs 2024-04-21T11:17:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3178.309354 secs 2024-04-21T11:17:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3178.309354 secs 2024-04-21T11:17:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:48 smithi170 ceph-mon[31212]: pgmap v1792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:48 smithi077 ceph-mon[27902]: pgmap v1792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:48 smithi191 ceph-mon[31636]: pgmap v1792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3180.069678 secs 2024-04-21T11:17:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3180.069678 secs 2024-04-21T11:17:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3180.069678 secs 2024-04-21T11:17:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:50 smithi077 ceph-mon[27902]: pgmap v1793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:50 smithi191 ceph-mon[31636]: pgmap v1793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:50 smithi170 ceph-mon[31212]: pgmap v1793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:52 smithi077 ceph-mon[27902]: pgmap v1794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3183.309462 secs 2024-04-21T11:17:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:52 smithi191 ceph-mon[31636]: pgmap v1794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3183.309462 secs 2024-04-21T11:17:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:52 smithi170 ceph-mon[31212]: pgmap v1794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3183.309462 secs 2024-04-21T11:17:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:54 smithi077 ceph-mon[27902]: pgmap v1795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3185.069796 secs 2024-04-21T11:17:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:54 smithi191 ceph-mon[31636]: pgmap v1795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3185.069796 secs 2024-04-21T11:17:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:54 smithi170 ceph-mon[31212]: pgmap v1795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3185.069796 secs 2024-04-21T11:17:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:17:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:56 smithi077 ceph-mon[27902]: pgmap v1796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:56 smithi191 ceph-mon[31636]: pgmap v1796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:56 smithi170 ceph-mon[31212]: pgmap v1796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:17:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3188.309587 secs 2024-04-21T11:17:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3188.309587 secs 2024-04-21T11:17:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3188.309587 secs 2024-04-21T11:17:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:58 smithi077 ceph-mon[27902]: pgmap v1797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:58 smithi191 ceph-mon[31636]: pgmap v1797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:58 smithi170 ceph-mon[31212]: pgmap v1797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:17:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3190.069865 secs 2024-04-21T11:17:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3190.069865 secs 2024-04-21T11:17:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3190.069865 secs 2024-04-21T11:18:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:00 smithi077 ceph-mon[27902]: pgmap v1798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:00 smithi191 ceph-mon[31636]: pgmap v1798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:00 smithi170 ceph-mon[31212]: pgmap v1798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:02 smithi077 ceph-mon[27902]: pgmap v1799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 23 op/s 2024-04-21T11:18:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3193.309743 secs 2024-04-21T11:18:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:02 smithi191 ceph-mon[31636]: pgmap v1799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 23 op/s 2024-04-21T11:18:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3193.309743 secs 2024-04-21T11:18:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:02 smithi170 ceph-mon[31212]: pgmap v1799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 23 op/s 2024-04-21T11:18:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3193.309743 secs 2024-04-21T11:18:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:04 smithi077 ceph-mon[27902]: pgmap v1800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T11:18:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3195.069938 secs 2024-04-21T11:18:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:04 smithi077 ceph-mon[27902]: osdmap e187: 12 total, 12 up, 12 in 2024-04-21T11:18:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:04 smithi191 ceph-mon[31636]: pgmap v1800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T11:18:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3195.069938 secs 2024-04-21T11:18:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:04 smithi191 ceph-mon[31636]: osdmap e187: 12 total, 12 up, 12 in 2024-04-21T11:18:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:04 smithi170 ceph-mon[31212]: pgmap v1800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T11:18:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3195.069938 secs 2024-04-21T11:18:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:04 smithi170 ceph-mon[31212]: osdmap e187: 12 total, 12 up, 12 in 2024-04-21T11:18:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:06 smithi077 ceph-mon[27902]: pgmap v1802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T11:18:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:06 smithi191 ceph-mon[31636]: pgmap v1802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T11:18:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:06 smithi170 ceph-mon[31212]: pgmap v1802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T11:18:07.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3198.309859 secs 2024-04-21T11:18:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3198.309859 secs 2024-04-21T11:18:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3198.309859 secs 2024-04-21T11:18:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:08 smithi077 ceph-mon[27902]: pgmap v1803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:18:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:08 smithi170 ceph-mon[31212]: pgmap v1803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:18:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:08 smithi191 ceph-mon[31636]: pgmap v1803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:18:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3200.070053 secs 2024-04-21T11:18:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3200.070053 secs 2024-04-21T11:18:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3200.070053 secs 2024-04-21T11:18:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:10 smithi077 ceph-mon[27902]: pgmap v1804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:18:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:10 smithi191 ceph-mon[31636]: pgmap v1804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:18:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:10 smithi170 ceph-mon[31212]: pgmap v1804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:18:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:12 smithi077 ceph-mon[27902]: pgmap v1805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3203.309931 secs 2024-04-21T11:18:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:12 smithi077 ceph-mon[27902]: osdmap e188: 12 total, 12 up, 12 in 2024-04-21T11:18:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:12 smithi191 ceph-mon[31636]: pgmap v1805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3203.309931 secs 2024-04-21T11:18:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:12 smithi191 ceph-mon[31636]: osdmap e188: 12 total, 12 up, 12 in 2024-04-21T11:18:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:12 smithi170 ceph-mon[31212]: pgmap v1805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3203.309931 secs 2024-04-21T11:18:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:12 smithi170 ceph-mon[31212]: osdmap e188: 12 total, 12 up, 12 in 2024-04-21T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:14 smithi077 ceph-mon[27902]: pgmap v1807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3205.070161 secs 2024-04-21T11:18:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:14 smithi191 ceph-mon[31636]: pgmap v1807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3205.070161 secs 2024-04-21T11:18:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:14 smithi170 ceph-mon[31212]: pgmap v1807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3205.070161 secs 2024-04-21T11:18:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:16 smithi077 ceph-mon[27902]: pgmap v1808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:16 smithi191 ceph-mon[31636]: pgmap v1808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:16 smithi170 ceph-mon[31212]: pgmap v1808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T11:18:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3208.310016 secs 2024-04-21T11:18:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3208.310016 secs 2024-04-21T11:18:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3208.310016 secs 2024-04-21T11:18:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:18 smithi077 ceph-mon[27902]: pgmap v1809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:18:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:18 smithi191 ceph-mon[31636]: pgmap v1809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:18:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:18 smithi170 ceph-mon[31212]: pgmap v1809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:18:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3210.070276 secs 2024-04-21T11:18:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3210.070276 secs 2024-04-21T11:18:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3210.070276 secs 2024-04-21T11:18:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:20 smithi191 ceph-mon[31636]: pgmap v1810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:18:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:20 smithi170 ceph-mon[31212]: pgmap v1810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:18:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:20 smithi077 ceph-mon[27902]: pgmap v1810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:18:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:22 smithi191 ceph-mon[31636]: pgmap v1811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:18:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3213.310135 secs 2024-04-21T11:18:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:22 smithi170 ceph-mon[31212]: pgmap v1811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:18:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3213.310135 secs 2024-04-21T11:18:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:22 smithi077 ceph-mon[27902]: pgmap v1811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:18:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3213.310135 secs 2024-04-21T11:18:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:24 smithi191 ceph-mon[31636]: pgmap v1812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:18:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3215.070352 secs 2024-04-21T11:18:24.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:18:24.791+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:18:24.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:18:24.791+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:18:24.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:18:24.792+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:18:24.791 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:18:24.792+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:18:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:24 smithi170 ceph-mon[31212]: pgmap v1812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:18:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3215.070352 secs 2024-04-21T11:18:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:24 smithi077 ceph-mon[27902]: pgmap v1812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:18:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3215.070352 secs 2024-04-21T11:18:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:26 smithi191 ceph-mon[31636]: pgmap v1813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:26 smithi170 ceph-mon[31212]: pgmap v1813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:26 smithi077 ceph-mon[27902]: pgmap v1813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3218.310258 secs 2024-04-21T11:18:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3218.310258 secs 2024-04-21T11:18:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3218.310258 secs 2024-04-21T11:18:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:28 smithi191 ceph-mon[31636]: pgmap v1814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:28 smithi170 ceph-mon[31212]: pgmap v1814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:28 smithi077 ceph-mon[27902]: pgmap v1814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3220.070486 secs 2024-04-21T11:18:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3220.070486 secs 2024-04-21T11:18:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3220.070486 secs 2024-04-21T11:18:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:30 smithi191 ceph-mon[31636]: pgmap v1815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:30 smithi170 ceph-mon[31212]: pgmap v1815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:30 smithi077 ceph-mon[27902]: pgmap v1815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:32 smithi191 ceph-mon[31636]: pgmap v1816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3223.310404 secs 2024-04-21T11:18:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:32 smithi170 ceph-mon[31212]: pgmap v1816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3223.310404 secs 2024-04-21T11:18:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:32 smithi077 ceph-mon[27902]: pgmap v1816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3223.310404 secs 2024-04-21T11:18:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:34 smithi191 ceph-mon[31636]: pgmap v1817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3225.070599 secs 2024-04-21T11:18:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:34 smithi170 ceph-mon[31212]: pgmap v1817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3225.070599 secs 2024-04-21T11:18:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:34 smithi077 ceph-mon[27902]: pgmap v1817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3225.070599 secs 2024-04-21T11:18:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:36 smithi191 ceph-mon[31636]: pgmap v1818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:18:36.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:36 smithi170 ceph-mon[31212]: pgmap v1818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:18:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:36 smithi077 ceph-mon[27902]: pgmap v1818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:18:37.706 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3228.310472 secs 2024-04-21T11:18:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3228.310472 secs 2024-04-21T11:18:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3228.310472 secs 2024-04-21T11:18:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:38 smithi170 ceph-mon[31212]: pgmap v1819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:38.709 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:38 smithi077 ceph-mon[27902]: pgmap v1819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:38 smithi191 ceph-mon[31636]: pgmap v1819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:39.511 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3230.070711 secs 2024-04-21T11:18:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3230.070711 secs 2024-04-21T11:18:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3230.070711 secs 2024-04-21T11:18:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:40 smithi077 ceph-mon[27902]: pgmap v1820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:40 smithi191 ceph-mon[31636]: pgmap v1820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:40 smithi170 ceph-mon[31212]: pgmap v1820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:18:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:41 smithi170 ceph-mon[31212]: pgmap v1821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:41 smithi077 ceph-mon[27902]: pgmap v1821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:18:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:18:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:18:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:41 smithi191 ceph-mon[31636]: pgmap v1821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3233.310609 secs 2024-04-21T11:18:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3233.310609 secs 2024-04-21T11:18:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3233.310609 secs 2024-04-21T11:18:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:43 smithi170 ceph-mon[31212]: pgmap v1822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3235.070871 secs 2024-04-21T11:18:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:43 smithi077 ceph-mon[27902]: pgmap v1822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3235.070871 secs 2024-04-21T11:18:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:43 smithi191 ceph-mon[31636]: pgmap v1822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3235.070871 secs 2024-04-21T11:18:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:46 smithi191 ceph-mon[31636]: pgmap v1823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:46 smithi170 ceph-mon[31212]: pgmap v1823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:46 smithi077 ceph-mon[27902]: pgmap v1823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3238.310727 secs 2024-04-21T11:18:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3238.310727 secs 2024-04-21T11:18:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3238.310727 secs 2024-04-21T11:18:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:48 smithi191 ceph-mon[31636]: pgmap v1824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:48 smithi170 ceph-mon[31212]: pgmap v1824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:48 smithi077 ceph-mon[27902]: pgmap v1824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3240.070945 secs 2024-04-21T11:18:49.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3240.070945 secs 2024-04-21T11:18:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3240.070945 secs 2024-04-21T11:18:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:50 smithi077 ceph-mon[27902]: pgmap v1825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:50 smithi191 ceph-mon[31636]: pgmap v1825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:50 smithi170 ceph-mon[31212]: pgmap v1825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:18:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:52 smithi191 ceph-mon[31636]: pgmap v1826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3243.310871 secs 2024-04-21T11:18:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:52 smithi170 ceph-mon[31212]: pgmap v1826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3243.310871 secs 2024-04-21T11:18:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:52 smithi077 ceph-mon[27902]: pgmap v1826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:18:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3243.310871 secs 2024-04-21T11:18:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:54 smithi191 ceph-mon[31636]: pgmap v1827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3245.071041 secs 2024-04-21T11:18:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:54 smithi170 ceph-mon[31212]: pgmap v1827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3245.071041 secs 2024-04-21T11:18:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:54 smithi077 ceph-mon[27902]: pgmap v1827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3245.071041 secs 2024-04-21T11:18:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:18:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:56 smithi191 ceph-mon[31636]: pgmap v1828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:56 smithi170 ceph-mon[31212]: pgmap v1828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:56 smithi077 ceph-mon[27902]: pgmap v1828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:18:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3248.310996 secs 2024-04-21T11:18:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3248.310996 secs 2024-04-21T11:18:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3248.310996 secs 2024-04-21T11:18:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:58 smithi191 ceph-mon[31636]: pgmap v1829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:18:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:58 smithi170 ceph-mon[31212]: pgmap v1829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:18:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:58 smithi077 ceph-mon[27902]: pgmap v1829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:18:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3250.071152 secs 2024-04-21T11:18:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3250.071152 secs 2024-04-21T11:18:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3250.071152 secs 2024-04-21T11:19:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:00 smithi191 ceph-mon[31636]: pgmap v1830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:19:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:00 smithi170 ceph-mon[31212]: pgmap v1830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:19:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:00 smithi077 ceph-mon[27902]: pgmap v1830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:19:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:02 smithi191 ceph-mon[31636]: pgmap v1831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T11:19:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3253.311075 secs 2024-04-21T11:19:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:02 smithi170 ceph-mon[31212]: pgmap v1831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T11:19:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3253.311075 secs 2024-04-21T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:02 smithi077 ceph-mon[27902]: pgmap v1831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3253.311075 secs 2024-04-21T11:19:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:04 smithi191 ceph-mon[31636]: pgmap v1832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T11:19:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3255.071277 secs 2024-04-21T11:19:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:04 smithi170 ceph-mon[31212]: pgmap v1832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T11:19:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3255.071277 secs 2024-04-21T11:19:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:04 smithi077 ceph-mon[27902]: pgmap v1832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T11:19:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3255.071277 secs 2024-04-21T11:19:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:05 smithi191 ceph-mon[31636]: osdmap e189: 12 total, 12 up, 12 in 2024-04-21T11:19:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:05 smithi170 ceph-mon[31212]: osdmap e189: 12 total, 12 up, 12 in 2024-04-21T11:19:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:05 smithi077 ceph-mon[27902]: osdmap e189: 12 total, 12 up, 12 in 2024-04-21T11:19:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:06 smithi191 ceph-mon[31636]: pgmap v1834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T11:19:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:06 smithi170 ceph-mon[31212]: pgmap v1834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T11:19:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:06 smithi077 ceph-mon[27902]: pgmap v1834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T11:19:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3258.311154 secs 2024-04-21T11:19:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3258.311154 secs 2024-04-21T11:19:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3258.311154 secs 2024-04-21T11:19:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:08 smithi170 ceph-mon[31212]: pgmap v1835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:19:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:08 smithi077 ceph-mon[27902]: pgmap v1835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:19:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:08 smithi191 ceph-mon[31636]: pgmap v1835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:19:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3260.071398 secs 2024-04-21T11:19:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3260.071398 secs 2024-04-21T11:19:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3260.071398 secs 2024-04-21T11:19:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:10 smithi170 ceph-mon[31212]: pgmap v1836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:19:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:10 smithi077 ceph-mon[27902]: pgmap v1836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:19:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:10 smithi191 ceph-mon[31636]: pgmap v1836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:19:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:12 smithi170 ceph-mon[31212]: pgmap v1837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T11:19:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3263.311219 secs 2024-04-21T11:19:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:12 smithi170 ceph-mon[31212]: osdmap e190: 12 total, 12 up, 12 in 2024-04-21T11:19:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:12 smithi077 ceph-mon[27902]: pgmap v1837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T11:19:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3263.311219 secs 2024-04-21T11:19:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:12 smithi077 ceph-mon[27902]: osdmap e190: 12 total, 12 up, 12 in 2024-04-21T11:19:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:12 smithi191 ceph-mon[31636]: pgmap v1837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T11:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3263.311219 secs 2024-04-21T11:19:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:12 smithi191 ceph-mon[31636]: osdmap e190: 12 total, 12 up, 12 in 2024-04-21T11:19:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:14 smithi170 ceph-mon[31212]: pgmap v1839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-21T11:19:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3265.071470 secs 2024-04-21T11:19:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:14 smithi077 ceph-mon[27902]: pgmap v1839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-21T11:19:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3265.071470 secs 2024-04-21T11:19:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:14 smithi191 ceph-mon[31636]: pgmap v1839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-21T11:19:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3265.071470 secs 2024-04-21T11:19:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:16 smithi170 ceph-mon[31212]: pgmap v1840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T11:19:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:16 smithi077 ceph-mon[27902]: pgmap v1840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T11:19:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:16 smithi191 ceph-mon[31636]: pgmap v1840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T11:19:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3268.311359 secs 2024-04-21T11:19:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:17 smithi170 ceph-mon[31212]: pgmap v1841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:19:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3268.311359 secs 2024-04-21T11:19:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:17 smithi077 ceph-mon[27902]: pgmap v1841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:19:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3268.311359 secs 2024-04-21T11:19:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:17 smithi191 ceph-mon[31636]: pgmap v1841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:19:19.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3270.071586 secs 2024-04-21T11:19:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3270.071586 secs 2024-04-21T11:19:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3270.071586 secs 2024-04-21T11:19:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:19 smithi170 ceph-mon[31212]: pgmap v1842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:19:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:19 smithi077 ceph-mon[27902]: pgmap v1842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:19:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:19 smithi191 ceph-mon[31636]: pgmap v1842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:19:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:22 smithi191 ceph-mon[31636]: pgmap v1843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:19:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3273.311434 secs 2024-04-21T11:19:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:22 smithi170 ceph-mon[31212]: pgmap v1843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:19:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3273.311434 secs 2024-04-21T11:19:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:22 smithi077 ceph-mon[27902]: pgmap v1843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:19:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3273.311434 secs 2024-04-21T11:19:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:24 smithi191 ceph-mon[31636]: pgmap v1844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:19:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3275.071700 secs 2024-04-21T11:19:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:24 smithi170 ceph-mon[31212]: pgmap v1844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:19:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3275.071700 secs 2024-04-21T11:19:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:24 smithi077 ceph-mon[27902]: pgmap v1844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:19:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3275.071700 secs 2024-04-21T11:19:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:26 smithi191 ceph-mon[31636]: pgmap v1845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:26 smithi170 ceph-mon[31212]: pgmap v1845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:26 smithi077 ceph-mon[27902]: pgmap v1845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3278.311565 secs 2024-04-21T11:19:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3278.311565 secs 2024-04-21T11:19:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3278.311565 secs 2024-04-21T11:19:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:28 smithi191 ceph-mon[31636]: pgmap v1846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:28 smithi170 ceph-mon[31212]: pgmap v1846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:28 smithi077 ceph-mon[27902]: pgmap v1846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3280.071763 secs 2024-04-21T11:19:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3280.071763 secs 2024-04-21T11:19:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3280.071763 secs 2024-04-21T11:19:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:30 smithi191 ceph-mon[31636]: pgmap v1847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:30 smithi170 ceph-mon[31212]: pgmap v1847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:30 smithi077 ceph-mon[27902]: pgmap v1847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:32 smithi191 ceph-mon[31636]: pgmap v1848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3283.311685 secs 2024-04-21T11:19:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:32 smithi170 ceph-mon[31212]: pgmap v1848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3283.311685 secs 2024-04-21T11:19:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:32 smithi077 ceph-mon[27902]: pgmap v1848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3283.311685 secs 2024-04-21T11:19:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:34 smithi191 ceph-mon[31636]: pgmap v1849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3285.071889 secs 2024-04-21T11:19:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:34 smithi170 ceph-mon[31212]: pgmap v1849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3285.071889 secs 2024-04-21T11:19:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:34 smithi077 ceph-mon[27902]: pgmap v1849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3285.071889 secs 2024-04-21T11:19:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:36 smithi191 ceph-mon[31636]: pgmap v1850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:36 smithi170 ceph-mon[31212]: pgmap v1850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:36 smithi077 ceph-mon[27902]: pgmap v1850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3288.311822 secs 2024-04-21T11:19:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3288.311822 secs 2024-04-21T11:19:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3288.311822 secs 2024-04-21T11:19:38.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:38 smithi170 ceph-mon[31212]: pgmap v1851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:38 smithi191 ceph-mon[31636]: pgmap v1851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:38 smithi077 ceph-mon[27902]: pgmap v1851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3290.071980 secs 2024-04-21T11:19:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3290.071980 secs 2024-04-21T11:19:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3290.071980 secs 2024-04-21T11:19:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:40 smithi191 ceph-mon[31636]: pgmap v1852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:40 smithi170 ceph-mon[31212]: pgmap v1852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:40 smithi077 ceph-mon[27902]: pgmap v1852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:19:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:19:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:19:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:42 smithi191 ceph-mon[31636]: pgmap v1853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3293.311888 secs 2024-04-21T11:19:42.476 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:42 smithi170 ceph-mon[31212]: pgmap v1853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:42.476 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3293.311888 secs 2024-04-21T11:19:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:42 smithi077 ceph-mon[27902]: pgmap v1853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3293.311888 secs 2024-04-21T11:19:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:44 smithi191 ceph-mon[31636]: pgmap v1854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 3295.072094 secs 2024-04-21T11:19:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:44 smithi191 ceph-mon[31636]: slow request 2883.336295 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:19:44.473 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:44 smithi170 ceph-mon[31212]: pgmap v1854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:44.473 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 3295.072094 secs 2024-04-21T11:19:44.473 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:44 smithi170 ceph-mon[31212]: slow request 2883.336295 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:19:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:44 smithi077 ceph-mon[27902]: pgmap v1854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 3295.072094 secs 2024-04-21T11:19:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:44 smithi077 ceph-mon[27902]: slow request 2883.336295 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T11:19:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: pgmap v1855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:19:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:19:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: pgmap v1855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:19:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: pgmap v1855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:19:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:19:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3298.312003 secs 2024-04-21T11:19:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3298.312003 secs 2024-04-21T11:19:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3298.312003 secs 2024-04-21T11:19:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:48 smithi170 ceph-mon[31212]: pgmap v1856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:48 smithi077 ceph-mon[27902]: pgmap v1856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:48 smithi191 ceph-mon[31636]: pgmap v1856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:49.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3300.072208 secs 2024-04-21T11:19:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3300.072208 secs 2024-04-21T11:19:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3300.072208 secs 2024-04-21T11:19:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:50 smithi170 ceph-mon[31212]: pgmap v1857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:50 smithi077 ceph-mon[27902]: pgmap v1857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:50 smithi191 ceph-mon[31636]: pgmap v1857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:52 smithi170 ceph-mon[31212]: pgmap v1858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3303.312083 secs 2024-04-21T11:19:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:52 smithi077 ceph-mon[27902]: pgmap v1858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3303.312083 secs 2024-04-21T11:19:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:52 smithi191 ceph-mon[31636]: pgmap v1858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3303.312083 secs 2024-04-21T11:19:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:54 smithi170 ceph-mon[31212]: pgmap v1859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3305.072346 secs 2024-04-21T11:19:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:54 smithi077 ceph-mon[27902]: pgmap v1859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3305.072346 secs 2024-04-21T11:19:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:54 smithi191 ceph-mon[31636]: pgmap v1859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3305.072346 secs 2024-04-21T11:19:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:19:54.804+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:19:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:19:54.804+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:19:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:19:54.805+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:19:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:19:54.805+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:19:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:19:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:56 smithi170 ceph-mon[31212]: pgmap v1860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:56 smithi077 ceph-mon[27902]: pgmap v1860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:56 smithi191 ceph-mon[31636]: pgmap v1860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:19:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3308.312177 secs 2024-04-21T11:19:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3308.312177 secs 2024-04-21T11:19:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3308.312177 secs 2024-04-21T11:19:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:58 smithi170 ceph-mon[31212]: pgmap v1861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:58 smithi077 ceph-mon[27902]: pgmap v1861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:58 smithi191 ceph-mon[31636]: pgmap v1861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:19:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3310.072480 secs 2024-04-21T11:19:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3310.072480 secs 2024-04-21T11:19:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3310.072480 secs 2024-04-21T11:20:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:00 smithi170 ceph-mon[31212]: pgmap v1862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:20:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:00 smithi077 ceph-mon[27902]: pgmap v1862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:20:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:00 smithi191 ceph-mon[31636]: pgmap v1862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:20:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:02 smithi170 ceph-mon[31212]: pgmap v1863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:20:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3313.312259 secs 2024-04-21T11:20:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:02 smithi077 ceph-mon[27902]: pgmap v1863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:20:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3313.312259 secs 2024-04-21T11:20:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:02 smithi191 ceph-mon[31636]: pgmap v1863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:20:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3313.312259 secs 2024-04-21T11:20:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:04 smithi170 ceph-mon[31212]: pgmap v1864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:20:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3315.072600 secs 2024-04-21T11:20:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:04 smithi170 ceph-mon[31212]: osdmap e191: 12 total, 12 up, 12 in 2024-04-21T11:20:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:04 smithi077 ceph-mon[27902]: pgmap v1864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:20:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3315.072600 secs 2024-04-21T11:20:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:04 smithi077 ceph-mon[27902]: osdmap e191: 12 total, 12 up, 12 in 2024-04-21T11:20:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:04 smithi191 ceph-mon[31636]: pgmap v1864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:20:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3315.072600 secs 2024-04-21T11:20:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:04 smithi191 ceph-mon[31636]: osdmap e191: 12 total, 12 up, 12 in 2024-04-21T11:20:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:06 smithi170 ceph-mon[31212]: pgmap v1866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:06 smithi077 ceph-mon[27902]: pgmap v1866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:06 smithi191 ceph-mon[31636]: pgmap v1866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3318.312386 secs 2024-04-21T11:20:07.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3318.312386 secs 2024-04-21T11:20:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3318.312386 secs 2024-04-21T11:20:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:08 smithi170 ceph-mon[31212]: pgmap v1867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:20:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:08 smithi077 ceph-mon[27902]: pgmap v1867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:20:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:08 smithi191 ceph-mon[31636]: pgmap v1867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:20:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3320.072724 secs 2024-04-21T11:20:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3320.072724 secs 2024-04-21T11:20:09.730 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3320.072724 secs 2024-04-21T11:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:10 smithi077 ceph-mon[27902]: pgmap v1868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:20:10.657 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:10 smithi170 ceph-mon[31212]: pgmap v1868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:20:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:10 smithi191 ceph-mon[31636]: pgmap v1868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:20:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:12 smithi077 ceph-mon[27902]: pgmap v1869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:20:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3323.312526 secs 2024-04-21T11:20:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:12 smithi077 ceph-mon[27902]: osdmap e192: 12 total, 12 up, 12 in 2024-04-21T11:20:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:12 smithi191 ceph-mon[31636]: pgmap v1869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:20:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3323.312526 secs 2024-04-21T11:20:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:12 smithi191 ceph-mon[31636]: osdmap e192: 12 total, 12 up, 12 in 2024-04-21T11:20:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:12 smithi170 ceph-mon[31212]: pgmap v1869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:20:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3323.312526 secs 2024-04-21T11:20:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:12 smithi170 ceph-mon[31212]: osdmap e192: 12 total, 12 up, 12 in 2024-04-21T11:20:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:14 smithi077 ceph-mon[27902]: pgmap v1871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:20:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3325.072841 secs 2024-04-21T11:20:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:14 smithi191 ceph-mon[31636]: pgmap v1871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:20:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3325.072841 secs 2024-04-21T11:20:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:14 smithi170 ceph-mon[31212]: pgmap v1871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:20:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3325.072841 secs 2024-04-21T11:20:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:16 smithi077 ceph-mon[27902]: pgmap v1872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:20:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:16 smithi191 ceph-mon[31636]: pgmap v1872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:20:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:16 smithi170 ceph-mon[31212]: pgmap v1872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:20:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3328.312681 secs 2024-04-21T11:20:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3328.312681 secs 2024-04-21T11:20:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3328.312681 secs 2024-04-21T11:20:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:18 smithi077 ceph-mon[27902]: pgmap v1873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:18 smithi191 ceph-mon[31636]: pgmap v1873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:18 smithi170 ceph-mon[31212]: pgmap v1873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3330.072983 secs 2024-04-21T11:20:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3330.072983 secs 2024-04-21T11:20:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3330.072983 secs 2024-04-21T11:20:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:20 smithi170 ceph-mon[31212]: pgmap v1874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:20 smithi077 ceph-mon[27902]: pgmap v1874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:20 smithi191 ceph-mon[31636]: pgmap v1874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:20:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:22 smithi077 ceph-mon[27902]: pgmap v1875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:20:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3333.312750 secs 2024-04-21T11:20:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:22 smithi191 ceph-mon[31636]: pgmap v1875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:20:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3333.312750 secs 2024-04-21T11:20:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:22 smithi170 ceph-mon[31212]: pgmap v1875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:20:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3333.312750 secs 2024-04-21T11:20:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:24 smithi077 ceph-mon[27902]: pgmap v1876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:20:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3335.073117 secs 2024-04-21T11:20:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:24 smithi191 ceph-mon[31636]: pgmap v1876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:20:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3335.073117 secs 2024-04-21T11:20:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:24 smithi170 ceph-mon[31212]: pgmap v1876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:20:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3335.073117 secs 2024-04-21T11:20:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:26 smithi077 ceph-mon[27902]: pgmap v1877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:26 smithi191 ceph-mon[31636]: pgmap v1877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:26 smithi170 ceph-mon[31212]: pgmap v1877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3338.312846 secs 2024-04-21T11:20:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3338.312846 secs 2024-04-21T11:20:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3338.312846 secs 2024-04-21T11:20:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:28 smithi077 ceph-mon[27902]: pgmap v1878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:28 smithi191 ceph-mon[31636]: pgmap v1878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:28 smithi170 ceph-mon[31212]: pgmap v1878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3340.073233 secs 2024-04-21T11:20:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3340.073233 secs 2024-04-21T11:20:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3340.073233 secs 2024-04-21T11:20:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:30 smithi077 ceph-mon[27902]: pgmap v1879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:30 smithi191 ceph-mon[31636]: pgmap v1879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:30 smithi170 ceph-mon[31212]: pgmap v1879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:32 smithi077 ceph-mon[27902]: pgmap v1880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3343.312969 secs 2024-04-21T11:20:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:32 smithi191 ceph-mon[31636]: pgmap v1880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3343.312969 secs 2024-04-21T11:20:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:32 smithi170 ceph-mon[31212]: pgmap v1880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3343.312969 secs 2024-04-21T11:20:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:34 smithi077 ceph-mon[27902]: pgmap v1881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3345.073313 secs 2024-04-21T11:20:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:34 smithi191 ceph-mon[31636]: pgmap v1881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3345.073313 secs 2024-04-21T11:20:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:34 smithi170 ceph-mon[31212]: pgmap v1881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3345.073313 secs 2024-04-21T11:20:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:36 smithi077 ceph-mon[27902]: pgmap v1882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:36 smithi191 ceph-mon[31636]: pgmap v1882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:36 smithi170 ceph-mon[31212]: pgmap v1882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3348.313083 secs 2024-04-21T11:20:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3348.313083 secs 2024-04-21T11:20:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3348.313083 secs 2024-04-21T11:20:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:38 smithi077 ceph-mon[27902]: pgmap v1883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:38 smithi170 ceph-mon[31212]: pgmap v1883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:38 smithi191 ceph-mon[31636]: pgmap v1883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3350.073426 secs 2024-04-21T11:20:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3350.073426 secs 2024-04-21T11:20:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3350.073426 secs 2024-04-21T11:20:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:40 smithi191 ceph-mon[31636]: pgmap v1884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:40 smithi170 ceph-mon[31212]: pgmap v1884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:41.235 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:40 smithi077 ceph-mon[27902]: pgmap v1884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:42 smithi191 ceph-mon[31636]: pgmap v1885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3353.313203 secs 2024-04-21T11:20:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:42 smithi170 ceph-mon[31212]: pgmap v1885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3353.313203 secs 2024-04-21T11:20:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:42 smithi077 ceph-mon[27902]: pgmap v1885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3353.313203 secs 2024-04-21T11:20:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:44 smithi191 ceph-mon[31636]: pgmap v1886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3355.073544 secs 2024-04-21T11:20:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:44 smithi170 ceph-mon[31212]: pgmap v1886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3355.073544 secs 2024-04-21T11:20:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:44 smithi077 ceph-mon[27902]: pgmap v1886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3355.073544 secs 2024-04-21T11:20:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:46 smithi191 ceph-mon[31636]: pgmap v1887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:20:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:20:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:20:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:20:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:46 smithi170 ceph-mon[31212]: pgmap v1887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:20:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:20:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:20:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:20:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:46 smithi077 ceph-mon[27902]: pgmap v1887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:20:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:20:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:20:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:20:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3358.313322 secs 2024-04-21T11:20:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3358.313322 secs 2024-04-21T11:20:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3358.313322 secs 2024-04-21T11:20:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:48 smithi191 ceph-mon[31636]: pgmap v1888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:48 smithi170 ceph-mon[31212]: pgmap v1888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:48 smithi077 ceph-mon[27902]: pgmap v1888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3360.073661 secs 2024-04-21T11:20:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3360.073661 secs 2024-04-21T11:20:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3360.073661 secs 2024-04-21T11:20:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:50 smithi191 ceph-mon[31636]: pgmap v1889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:50 smithi170 ceph-mon[31212]: pgmap v1889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:50 smithi077 ceph-mon[27902]: pgmap v1889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:52 smithi191 ceph-mon[31636]: pgmap v1890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3363.313460 secs 2024-04-21T11:20:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:52 smithi170 ceph-mon[31212]: pgmap v1890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3363.313460 secs 2024-04-21T11:20:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:52 smithi077 ceph-mon[27902]: pgmap v1890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3363.313460 secs 2024-04-21T11:20:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:54 smithi191 ceph-mon[31636]: pgmap v1891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3365.073782 secs 2024-04-21T11:20:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:54 smithi170 ceph-mon[31212]: pgmap v1891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3365.073782 secs 2024-04-21T11:20:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:54 smithi077 ceph-mon[27902]: pgmap v1891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3365.073782 secs 2024-04-21T11:20:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:20:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:56 smithi191 ceph-mon[31636]: pgmap v1892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:56 smithi170 ceph-mon[31212]: pgmap v1892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:56 smithi077 ceph-mon[27902]: pgmap v1892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:20:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3368.313576 secs 2024-04-21T11:20:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3368.313576 secs 2024-04-21T11:20:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3368.313576 secs 2024-04-21T11:20:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:58 smithi191 ceph-mon[31636]: pgmap v1893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:58 smithi170 ceph-mon[31212]: pgmap v1893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:58 smithi077 ceph-mon[27902]: pgmap v1893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:20:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3370.073842 secs 2024-04-21T11:20:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3370.073842 secs 2024-04-21T11:20:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3370.073842 secs 2024-04-21T11:21:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:00 smithi191 ceph-mon[31636]: pgmap v1894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:00 smithi170 ceph-mon[31212]: pgmap v1894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:00 smithi077 ceph-mon[27902]: pgmap v1894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:02 smithi191 ceph-mon[31636]: pgmap v1895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3373.313669 secs 2024-04-21T11:21:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:02 smithi170 ceph-mon[31212]: pgmap v1895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3373.313669 secs 2024-04-21T11:21:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:02 smithi077 ceph-mon[27902]: pgmap v1895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3373.313669 secs 2024-04-21T11:21:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:04 smithi191 ceph-mon[31636]: pgmap v1896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3375.073963 secs 2024-04-21T11:21:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:04 smithi191 ceph-mon[31636]: osdmap e193: 12 total, 12 up, 12 in 2024-04-21T11:21:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:04 smithi170 ceph-mon[31212]: pgmap v1896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3375.073963 secs 2024-04-21T11:21:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:04 smithi170 ceph-mon[31212]: osdmap e193: 12 total, 12 up, 12 in 2024-04-21T11:21:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:04 smithi077 ceph-mon[27902]: pgmap v1896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3375.073963 secs 2024-04-21T11:21:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:04 smithi077 ceph-mon[27902]: osdmap e193: 12 total, 12 up, 12 in 2024-04-21T11:21:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:06 smithi191 ceph-mon[31636]: pgmap v1898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:21:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:06 smithi170 ceph-mon[31212]: pgmap v1898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:21:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:06 smithi077 ceph-mon[27902]: pgmap v1898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:21:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3378.313789 secs 2024-04-21T11:21:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3378.313789 secs 2024-04-21T11:21:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3378.313789 secs 2024-04-21T11:21:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:08 smithi191 ceph-mon[31636]: pgmap v1899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:21:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:08 smithi170 ceph-mon[31212]: pgmap v1899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:21:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:08 smithi077 ceph-mon[27902]: pgmap v1899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:21:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3380.074027 secs 2024-04-21T11:21:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3380.074027 secs 2024-04-21T11:21:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3380.074027 secs 2024-04-21T11:21:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:10 smithi170 ceph-mon[31212]: pgmap v1900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:21:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:10 smithi077 ceph-mon[27902]: pgmap v1900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:21:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:10 smithi191 ceph-mon[31636]: pgmap v1900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:21:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:12 smithi170 ceph-mon[31212]: pgmap v1901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:21:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3383.313852 secs 2024-04-21T11:21:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:12 smithi170 ceph-mon[31212]: osdmap e194: 12 total, 12 up, 12 in 2024-04-21T11:21:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:12 smithi077 ceph-mon[27902]: pgmap v1901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:21:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3383.313852 secs 2024-04-21T11:21:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:12 smithi077 ceph-mon[27902]: osdmap e194: 12 total, 12 up, 12 in 2024-04-21T11:21:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:12 smithi191 ceph-mon[31636]: pgmap v1901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:21:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3383.313852 secs 2024-04-21T11:21:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:12 smithi191 ceph-mon[31636]: osdmap e194: 12 total, 12 up, 12 in 2024-04-21T11:21:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:14 smithi170 ceph-mon[31212]: pgmap v1903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:21:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3385.074165 secs 2024-04-21T11:21:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:14 smithi077 ceph-mon[27902]: pgmap v1903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:21:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3385.074165 secs 2024-04-21T11:21:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:14 smithi191 ceph-mon[31636]: pgmap v1903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:21:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3385.074165 secs 2024-04-21T11:21:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:16 smithi170 ceph-mon[31212]: pgmap v1904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:21:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:16 smithi077 ceph-mon[27902]: pgmap v1904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:21:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:16 smithi191 ceph-mon[31636]: pgmap v1904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:21:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3388.313972 secs 2024-04-21T11:21:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3388.313972 secs 2024-04-21T11:21:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3388.313972 secs 2024-04-21T11:21:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:18 smithi170 ceph-mon[31212]: pgmap v1905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:21:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:18 smithi077 ceph-mon[27902]: pgmap v1905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:21:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:18 smithi191 ceph-mon[31636]: pgmap v1905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:21:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3390.074260 secs 2024-04-21T11:21:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3390.074260 secs 2024-04-21T11:21:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3390.074260 secs 2024-04-21T11:21:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:20 smithi170 ceph-mon[31212]: pgmap v1906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:21:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:20 smithi077 ceph-mon[27902]: pgmap v1906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:21:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:20 smithi191 ceph-mon[31636]: pgmap v1906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:21:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:22 smithi170 ceph-mon[31212]: pgmap v1907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:21:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3393.314047 secs 2024-04-21T11:21:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:22 smithi077 ceph-mon[27902]: pgmap v1907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:21:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3393.314047 secs 2024-04-21T11:21:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:22 smithi191 ceph-mon[31636]: pgmap v1907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:21:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3393.314047 secs 2024-04-21T11:21:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:24 smithi170 ceph-mon[31212]: pgmap v1908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:21:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3395.074379 secs 2024-04-21T11:21:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:24 smithi077 ceph-mon[27902]: pgmap v1908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:21:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3395.074379 secs 2024-04-21T11:21:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:24 smithi191 ceph-mon[31636]: pgmap v1908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:21:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3395.074379 secs 2024-04-21T11:21:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:26 smithi170 ceph-mon[31212]: pgmap v1909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:26 smithi077 ceph-mon[27902]: pgmap v1909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:26 smithi191 ceph-mon[31636]: pgmap v1909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3398.314163 secs 2024-04-21T11:21:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3398.314163 secs 2024-04-21T11:21:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3398.314163 secs 2024-04-21T11:21:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:28 smithi170 ceph-mon[31212]: pgmap v1910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:28 smithi077 ceph-mon[27902]: pgmap v1910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:28 smithi191 ceph-mon[31636]: pgmap v1910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3400.074515 secs 2024-04-21T11:21:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3400.074515 secs 2024-04-21T11:21:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3400.074515 secs 2024-04-21T11:21:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:30 smithi170 ceph-mon[31212]: pgmap v1911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:30 smithi077 ceph-mon[27902]: pgmap v1911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:30 smithi191 ceph-mon[31636]: pgmap v1911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:32 smithi170 ceph-mon[31212]: pgmap v1912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3403.314273 secs 2024-04-21T11:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:32 smithi077 ceph-mon[27902]: pgmap v1912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3403.314273 secs 2024-04-21T11:21:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:32 smithi191 ceph-mon[31636]: pgmap v1912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3403.314273 secs 2024-04-21T11:21:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:34 smithi170 ceph-mon[31212]: pgmap v1913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3405.074578 secs 2024-04-21T11:21:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:34 smithi077 ceph-mon[27902]: pgmap v1913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3405.074578 secs 2024-04-21T11:21:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:34 smithi191 ceph-mon[31636]: pgmap v1913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3405.074578 secs 2024-04-21T11:21:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:36 smithi170 ceph-mon[31212]: pgmap v1914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:36 smithi077 ceph-mon[27902]: pgmap v1914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:36 smithi191 ceph-mon[31636]: pgmap v1914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3408.314387 secs 2024-04-21T11:21:37.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3408.314387 secs 2024-04-21T11:21:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3408.314387 secs 2024-04-21T11:21:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:38 smithi170 ceph-mon[31212]: pgmap v1915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:38 smithi077 ceph-mon[27902]: pgmap v1915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:38 smithi191 ceph-mon[31636]: pgmap v1915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3410.074689 secs 2024-04-21T11:21:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3410.074689 secs 2024-04-21T11:21:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3410.074689 secs 2024-04-21T11:21:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:40 smithi170 ceph-mon[31212]: pgmap v1916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:40 smithi077 ceph-mon[27902]: pgmap v1916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:40 smithi191 ceph-mon[31636]: pgmap v1916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:42 smithi170 ceph-mon[31212]: pgmap v1917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3413.314508 secs 2024-04-21T11:21:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:42 smithi077 ceph-mon[27902]: pgmap v1917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3413.314508 secs 2024-04-21T11:21:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:42 smithi191 ceph-mon[31636]: pgmap v1917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:43.379 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3413.314508 secs 2024-04-21T11:21:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:43 smithi077 ceph-mon[27902]: pgmap v1918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:43 smithi191 ceph-mon[31636]: pgmap v1918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:43 smithi170 ceph-mon[31212]: pgmap v1918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3415.074810 secs 2024-04-21T11:21:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3415.074810 secs 2024-04-21T11:21:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3415.074810 secs 2024-04-21T11:21:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:45 smithi077 ceph-mon[27902]: pgmap v1919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:45 smithi191 ceph-mon[31636]: pgmap v1919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:45 smithi170 ceph-mon[31212]: pgmap v1919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:21:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:21:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3418.314584 secs 2024-04-21T11:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:47 smithi077 ceph-mon[27902]: pgmap v1920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3418.314584 secs 2024-04-21T11:21:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:21:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:21:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:21:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:47 smithi191 ceph-mon[31636]: pgmap v1920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3418.314584 secs 2024-04-21T11:21:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:21:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:21:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:21:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:47 smithi170 ceph-mon[31212]: pgmap v1920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3420.074923 secs 2024-04-21T11:21:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3420.074923 secs 2024-04-21T11:21:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3420.074923 secs 2024-04-21T11:21:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:50 smithi077 ceph-mon[27902]: pgmap v1921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:50 smithi191 ceph-mon[31636]: pgmap v1921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:50 smithi170 ceph-mon[31212]: pgmap v1921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:52 smithi191 ceph-mon[31636]: pgmap v1922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3423.314693 secs 2024-04-21T11:21:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:52 smithi170 ceph-mon[31212]: pgmap v1922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3423.314693 secs 2024-04-21T11:21:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:52 smithi077 ceph-mon[27902]: pgmap v1922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:21:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3423.314693 secs 2024-04-21T11:21:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:54 smithi191 ceph-mon[31636]: pgmap v1923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3425.075013 secs 2024-04-21T11:21:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:54 smithi170 ceph-mon[31212]: pgmap v1923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3425.075013 secs 2024-04-21T11:21:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:54 smithi077 ceph-mon[27902]: pgmap v1923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:21:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3425.075013 secs 2024-04-21T11:21:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:21:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:56 smithi191 ceph-mon[31636]: pgmap v1924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:56 smithi170 ceph-mon[31212]: pgmap v1924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:56 smithi077 ceph-mon[27902]: pgmap v1924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:21:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3428.314811 secs 2024-04-21T11:21:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3428.314811 secs 2024-04-21T11:21:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3428.314811 secs 2024-04-21T11:21:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:58 smithi170 ceph-mon[31212]: pgmap v1925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:58 smithi077 ceph-mon[27902]: pgmap v1925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:58 smithi191 ceph-mon[31636]: pgmap v1925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:21:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3430.075124 secs 2024-04-21T11:21:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3430.075124 secs 2024-04-21T11:21:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3430.075124 secs 2024-04-21T11:22:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:00 smithi170 ceph-mon[31212]: pgmap v1926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:00 smithi077 ceph-mon[27902]: pgmap v1926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:00 smithi191 ceph-mon[31636]: pgmap v1926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:02 smithi170 ceph-mon[31212]: pgmap v1927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3433.314924 secs 2024-04-21T11:22:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:02 smithi077 ceph-mon[27902]: pgmap v1927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3433.314924 secs 2024-04-21T11:22:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:02 smithi191 ceph-mon[31636]: pgmap v1927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3433.314924 secs 2024-04-21T11:22:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:04 smithi170 ceph-mon[31212]: pgmap v1928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3435.075239 secs 2024-04-21T11:22:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:04 smithi170 ceph-mon[31212]: osdmap e195: 12 total, 12 up, 12 in 2024-04-21T11:22:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:04 smithi077 ceph-mon[27902]: pgmap v1928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3435.075239 secs 2024-04-21T11:22:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:04 smithi077 ceph-mon[27902]: osdmap e195: 12 total, 12 up, 12 in 2024-04-21T11:22:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:04 smithi191 ceph-mon[31636]: pgmap v1928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3435.075239 secs 2024-04-21T11:22:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:04 smithi191 ceph-mon[31636]: osdmap e195: 12 total, 12 up, 12 in 2024-04-21T11:22:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:06 smithi170 ceph-mon[31212]: pgmap v1930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 24 op/s 2024-04-21T11:22:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:06 smithi077 ceph-mon[27902]: pgmap v1930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 24 op/s 2024-04-21T11:22:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:06 smithi191 ceph-mon[31636]: pgmap v1930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 24 op/s 2024-04-21T11:22:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3438.315021 secs 2024-04-21T11:22:07.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3438.315021 secs 2024-04-21T11:22:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3438.315021 secs 2024-04-21T11:22:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:08 smithi170 ceph-mon[31212]: pgmap v1931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:08 smithi077 ceph-mon[27902]: pgmap v1931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:08 smithi191 ceph-mon[31636]: pgmap v1931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3440.075318 secs 2024-04-21T11:22:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3440.075318 secs 2024-04-21T11:22:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3440.075318 secs 2024-04-21T11:22:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:10 smithi170 ceph-mon[31212]: pgmap v1932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:10 smithi077 ceph-mon[27902]: pgmap v1932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:10 smithi191 ceph-mon[31636]: pgmap v1932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:12 smithi170 ceph-mon[31212]: pgmap v1933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3443.315136 secs 2024-04-21T11:22:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:12 smithi170 ceph-mon[31212]: osdmap e196: 12 total, 12 up, 12 in 2024-04-21T11:22:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:12 smithi077 ceph-mon[27902]: pgmap v1933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3443.315136 secs 2024-04-21T11:22:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:12 smithi077 ceph-mon[27902]: osdmap e196: 12 total, 12 up, 12 in 2024-04-21T11:22:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:12 smithi191 ceph-mon[31636]: pgmap v1933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:22:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3443.315136 secs 2024-04-21T11:22:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:12 smithi191 ceph-mon[31636]: osdmap e196: 12 total, 12 up, 12 in 2024-04-21T11:22:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:14 smithi170 ceph-mon[31212]: pgmap v1935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:22:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3445.075435 secs 2024-04-21T11:22:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:14 smithi077 ceph-mon[27902]: pgmap v1935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:22:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3445.075435 secs 2024-04-21T11:22:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:14 smithi191 ceph-mon[31636]: pgmap v1935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:22:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3445.075435 secs 2024-04-21T11:22:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:16 smithi170 ceph-mon[31212]: pgmap v1936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:22:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:16 smithi077 ceph-mon[27902]: pgmap v1936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:22:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:16 smithi191 ceph-mon[31636]: pgmap v1936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:22:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3448.315246 secs 2024-04-21T11:22:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3448.315246 secs 2024-04-21T11:22:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3448.315246 secs 2024-04-21T11:22:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:18 smithi170 ceph-mon[31212]: pgmap v1937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:22:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:18 smithi077 ceph-mon[27902]: pgmap v1937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:22:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:18 smithi191 ceph-mon[31636]: pgmap v1937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:22:19.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3450.075572 secs 2024-04-21T11:22:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3450.075572 secs 2024-04-21T11:22:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3450.075572 secs 2024-04-21T11:22:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:20 smithi170 ceph-mon[31212]: pgmap v1938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:22:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:20 smithi077 ceph-mon[27902]: pgmap v1938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:22:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:20 smithi191 ceph-mon[31636]: pgmap v1938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:22:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:22 smithi170 ceph-mon[31212]: pgmap v1939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:22:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3453.315364 secs 2024-04-21T11:22:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:22 smithi077 ceph-mon[27902]: pgmap v1939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:22:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3453.315364 secs 2024-04-21T11:22:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:22 smithi191 ceph-mon[31636]: pgmap v1939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:22:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3453.315364 secs 2024-04-21T11:22:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:24 smithi170 ceph-mon[31212]: pgmap v1940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:22:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3455.075697 secs 2024-04-21T11:22:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:24 smithi077 ceph-mon[27902]: pgmap v1940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:22:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3455.075697 secs 2024-04-21T11:22:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:24 smithi191 ceph-mon[31636]: pgmap v1940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:22:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3455.075697 secs 2024-04-21T11:22:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:26 smithi170 ceph-mon[31212]: pgmap v1941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:26 smithi077 ceph-mon[27902]: pgmap v1941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:26 smithi191 ceph-mon[31636]: pgmap v1941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3458.315486 secs 2024-04-21T11:22:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3458.315486 secs 2024-04-21T11:22:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3458.315486 secs 2024-04-21T11:22:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:28 smithi170 ceph-mon[31212]: pgmap v1942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:28 smithi077 ceph-mon[27902]: pgmap v1942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:28 smithi191 ceph-mon[31636]: pgmap v1942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3460.075810 secs 2024-04-21T11:22:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3460.075810 secs 2024-04-21T11:22:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3460.075810 secs 2024-04-21T11:22:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:30 smithi170 ceph-mon[31212]: pgmap v1943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:30 smithi077 ceph-mon[27902]: pgmap v1943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:30 smithi191 ceph-mon[31636]: pgmap v1943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:32 smithi170 ceph-mon[31212]: pgmap v1944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3463.315600 secs 2024-04-21T11:22:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:32 smithi077 ceph-mon[27902]: pgmap v1944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3463.315600 secs 2024-04-21T11:22:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:32 smithi191 ceph-mon[31636]: pgmap v1944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3463.315600 secs 2024-04-21T11:22:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:34 smithi077 ceph-mon[27902]: pgmap v1945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3465.075924 secs 2024-04-21T11:22:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:34 smithi191 ceph-mon[31636]: pgmap v1945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3465.075924 secs 2024-04-21T11:22:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:34 smithi170 ceph-mon[31212]: pgmap v1945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3465.075924 secs 2024-04-21T11:22:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:36 smithi077 ceph-mon[27902]: pgmap v1946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:36 smithi191 ceph-mon[31636]: pgmap v1946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:36 smithi170 ceph-mon[31212]: pgmap v1946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3468.315732 secs 2024-04-21T11:22:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3468.315732 secs 2024-04-21T11:22:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3468.315732 secs 2024-04-21T11:22:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:38 smithi077 ceph-mon[27902]: pgmap v1947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:38 smithi170 ceph-mon[31212]: pgmap v1947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:38 smithi191 ceph-mon[31636]: pgmap v1947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3470.076041 secs 2024-04-21T11:22:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3470.076041 secs 2024-04-21T11:22:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3470.076041 secs 2024-04-21T11:22:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:40 smithi077 ceph-mon[27902]: pgmap v1948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:40 smithi191 ceph-mon[31636]: pgmap v1948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:40 smithi170 ceph-mon[31212]: pgmap v1948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:42 smithi077 ceph-mon[27902]: pgmap v1949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3473.315834 secs 2024-04-21T11:22:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:42 smithi191 ceph-mon[31636]: pgmap v1949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3473.315834 secs 2024-04-21T11:22:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:42 smithi170 ceph-mon[31212]: pgmap v1949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3473.315834 secs 2024-04-21T11:22:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:44 smithi077 ceph-mon[27902]: pgmap v1950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3475.076154 secs 2024-04-21T11:22:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:44 smithi191 ceph-mon[31636]: pgmap v1950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3475.076154 secs 2024-04-21T11:22:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:44 smithi170 ceph-mon[31212]: pgmap v1950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3475.076154 secs 2024-04-21T11:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:46 smithi077 ceph-mon[27902]: pgmap v1951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:46 smithi191 ceph-mon[31636]: pgmap v1951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:46 smithi170 ceph-mon[31212]: pgmap v1951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3478.315949 secs 2024-04-21T11:22:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:22:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3478.315949 secs 2024-04-21T11:22:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:22:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3478.315949 secs 2024-04-21T11:22:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:22:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:48 smithi077 ceph-mon[27902]: pgmap v1952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:48 smithi191 ceph-mon[31636]: pgmap v1952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:48 smithi170 ceph-mon[31212]: pgmap v1952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3480.076271 secs 2024-04-21T11:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3480.076271 secs 2024-04-21T11:22:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3480.076271 secs 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: pgmap v1953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:22:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:22:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: pgmap v1953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:22:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: pgmap v1953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:22:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:22:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:22:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:22:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:22:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:52 smithi077 ceph-mon[27902]: pgmap v1954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3483.316030 secs 2024-04-21T11:22:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:52 smithi191 ceph-mon[31636]: pgmap v1954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3483.316030 secs 2024-04-21T11:22:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:52 smithi170 ceph-mon[31212]: pgmap v1954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:22:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3483.316030 secs 2024-04-21T11:22:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:54 smithi077 ceph-mon[27902]: pgmap v1955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3485.076354 secs 2024-04-21T11:22:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:54 smithi191 ceph-mon[31636]: pgmap v1955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3485.076354 secs 2024-04-21T11:22:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:54 smithi170 ceph-mon[31212]: pgmap v1955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:22:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3485.076354 secs 2024-04-21T11:22:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:22:54.828+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:22:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:22:54.828+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:22:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:22:54.828+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:22:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:22:54.828+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:22:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:22:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:56 smithi077 ceph-mon[27902]: pgmap v1956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:56 smithi191 ceph-mon[31636]: pgmap v1956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:56 smithi170 ceph-mon[31212]: pgmap v1956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:22:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3488.316112 secs 2024-04-21T11:22:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3488.316112 secs 2024-04-21T11:22:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3488.316112 secs 2024-04-21T11:22:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:58 smithi077 ceph-mon[27902]: pgmap v1957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:58 smithi191 ceph-mon[31636]: pgmap v1957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:58 smithi170 ceph-mon[31212]: pgmap v1957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:22:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3490.076470 secs 2024-04-21T11:22:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3490.076470 secs 2024-04-21T11:22:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3490.076470 secs 2024-04-21T11:23:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:00 smithi077 ceph-mon[27902]: pgmap v1958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:00 smithi191 ceph-mon[31636]: pgmap v1958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:00 smithi170 ceph-mon[31212]: pgmap v1958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:02 smithi077 ceph-mon[27902]: pgmap v1959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3493.316231 secs 2024-04-21T11:23:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:02 smithi191 ceph-mon[31636]: pgmap v1959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3493.316231 secs 2024-04-21T11:23:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:02 smithi170 ceph-mon[31212]: pgmap v1959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3493.316231 secs 2024-04-21T11:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:04 smithi191 ceph-mon[31636]: pgmap v1960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3495.076579 secs 2024-04-21T11:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:04 smithi191 ceph-mon[31636]: osdmap e197: 12 total, 12 up, 12 in 2024-04-21T11:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:04 smithi170 ceph-mon[31212]: pgmap v1960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3495.076579 secs 2024-04-21T11:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:04 smithi170 ceph-mon[31212]: osdmap e197: 12 total, 12 up, 12 in 2024-04-21T11:23:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:04 smithi077 ceph-mon[27902]: pgmap v1960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3495.076579 secs 2024-04-21T11:23:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:04 smithi077 ceph-mon[27902]: osdmap e197: 12 total, 12 up, 12 in 2024-04-21T11:23:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:06 smithi191 ceph-mon[31636]: pgmap v1962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:23:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:06 smithi170 ceph-mon[31212]: pgmap v1962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:23:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:06 smithi077 ceph-mon[27902]: pgmap v1962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:23:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3498.316365 secs 2024-04-21T11:23:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3498.316365 secs 2024-04-21T11:23:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3498.316365 secs 2024-04-21T11:23:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:08 smithi170 ceph-mon[31212]: pgmap v1963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:23:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:08 smithi191 ceph-mon[31636]: pgmap v1963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:23:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:08 smithi077 ceph-mon[27902]: pgmap v1963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:23:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3500.076692 secs 2024-04-21T11:23:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3500.076692 secs 2024-04-21T11:23:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3500.076692 secs 2024-04-21T11:23:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:10 smithi191 ceph-mon[31636]: pgmap v1964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:23:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:10 smithi170 ceph-mon[31212]: pgmap v1964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:23:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:10 smithi077 ceph-mon[27902]: pgmap v1964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:23:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:12 smithi191 ceph-mon[31636]: pgmap v1965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:23:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3503.316485 secs 2024-04-21T11:23:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:12 smithi191 ceph-mon[31636]: osdmap e198: 12 total, 12 up, 12 in 2024-04-21T11:23:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:12 smithi170 ceph-mon[31212]: pgmap v1965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:23:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3503.316485 secs 2024-04-21T11:23:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:12 smithi170 ceph-mon[31212]: osdmap e198: 12 total, 12 up, 12 in 2024-04-21T11:23:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:12 smithi077 ceph-mon[27902]: pgmap v1965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:23:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3503.316485 secs 2024-04-21T11:23:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:12 smithi077 ceph-mon[27902]: osdmap e198: 12 total, 12 up, 12 in 2024-04-21T11:23:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:14 smithi191 ceph-mon[31636]: pgmap v1967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:23:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3505.076818 secs 2024-04-21T11:23:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:14 smithi170 ceph-mon[31212]: pgmap v1967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:23:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3505.076818 secs 2024-04-21T11:23:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:14 smithi077 ceph-mon[27902]: pgmap v1967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:23:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3505.076818 secs 2024-04-21T11:23:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:16 smithi191 ceph-mon[31636]: pgmap v1968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:23:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:16 smithi170 ceph-mon[31212]: pgmap v1968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:23:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:16 smithi077 ceph-mon[27902]: pgmap v1968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:23:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3508.316605 secs 2024-04-21T11:23:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:17 smithi077 ceph-mon[27902]: pgmap v1969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:23:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3508.316605 secs 2024-04-21T11:23:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:17 smithi191 ceph-mon[31636]: pgmap v1969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:23:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3508.316605 secs 2024-04-21T11:23:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:17 smithi170 ceph-mon[31212]: pgmap v1969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:23:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3510.076944 secs 2024-04-21T11:23:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3510.076944 secs 2024-04-21T11:23:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3510.076944 secs 2024-04-21T11:23:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:19 smithi077 ceph-mon[27902]: pgmap v1970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:23:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:19 smithi191 ceph-mon[31636]: pgmap v1970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:23:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:19 smithi170 ceph-mon[31212]: pgmap v1970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:23:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:22 smithi170 ceph-mon[31212]: pgmap v1971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:23:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3513.316700 secs 2024-04-21T11:23:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:22 smithi077 ceph-mon[27902]: pgmap v1971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:23:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3513.316700 secs 2024-04-21T11:23:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:22 smithi191 ceph-mon[31636]: pgmap v1971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:23:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3513.316700 secs 2024-04-21T11:23:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:24 smithi170 ceph-mon[31212]: pgmap v1972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:23:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3515.077008 secs 2024-04-21T11:23:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:24 smithi077 ceph-mon[27902]: pgmap v1972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:23:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3515.077008 secs 2024-04-21T11:23:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:24 smithi191 ceph-mon[31636]: pgmap v1972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:23:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3515.077008 secs 2024-04-21T11:23:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:26 smithi170 ceph-mon[31212]: pgmap v1973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:26 smithi077 ceph-mon[27902]: pgmap v1973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:26 smithi191 ceph-mon[31636]: pgmap v1973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3518.316831 secs 2024-04-21T11:23:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3518.316831 secs 2024-04-21T11:23:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3518.316831 secs 2024-04-21T11:23:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:28 smithi170 ceph-mon[31212]: pgmap v1974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:28 smithi077 ceph-mon[27902]: pgmap v1974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:28 smithi191 ceph-mon[31636]: pgmap v1974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3520.077081 secs 2024-04-21T11:23:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3520.077081 secs 2024-04-21T11:23:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3520.077081 secs 2024-04-21T11:23:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:30 smithi170 ceph-mon[31212]: pgmap v1975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:30 smithi077 ceph-mon[27902]: pgmap v1975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:30 smithi191 ceph-mon[31636]: pgmap v1975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:32 smithi170 ceph-mon[31212]: pgmap v1976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3523.316949 secs 2024-04-21T11:23:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:32 smithi077 ceph-mon[27902]: pgmap v1976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3523.316949 secs 2024-04-21T11:23:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:32 smithi191 ceph-mon[31636]: pgmap v1976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3523.316949 secs 2024-04-21T11:23:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:34 smithi170 ceph-mon[31212]: pgmap v1977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3525.077200 secs 2024-04-21T11:23:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:34 smithi077 ceph-mon[27902]: pgmap v1977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3525.077200 secs 2024-04-21T11:23:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:34 smithi191 ceph-mon[31636]: pgmap v1977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3525.077200 secs 2024-04-21T11:23:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:36 smithi170 ceph-mon[31212]: pgmap v1978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:36 smithi077 ceph-mon[27902]: pgmap v1978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:36 smithi191 ceph-mon[31636]: pgmap v1978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3528.317034 secs 2024-04-21T11:23:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3528.317034 secs 2024-04-21T11:23:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3528.317034 secs 2024-04-21T11:23:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:38 smithi170 ceph-mon[31212]: pgmap v1979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:38.632 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:38 smithi191 ceph-mon[31636]: pgmap v1979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:38 smithi077 ceph-mon[27902]: pgmap v1979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3530.077265 secs 2024-04-21T11:23:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3530.077265 secs 2024-04-21T11:23:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3530.077265 secs 2024-04-21T11:23:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:40 smithi170 ceph-mon[31212]: pgmap v1980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:40 smithi077 ceph-mon[27902]: pgmap v1980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:40 smithi191 ceph-mon[31636]: pgmap v1980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:42 smithi170 ceph-mon[31212]: pgmap v1981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3533.317159 secs 2024-04-21T11:23:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:42 smithi077 ceph-mon[27902]: pgmap v1981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3533.317159 secs 2024-04-21T11:23:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:42 smithi191 ceph-mon[31636]: pgmap v1981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3533.317159 secs 2024-04-21T11:23:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:44 smithi170 ceph-mon[31212]: pgmap v1982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3535.077330 secs 2024-04-21T11:23:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:44 smithi077 ceph-mon[27902]: pgmap v1982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3535.077330 secs 2024-04-21T11:23:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:44 smithi191 ceph-mon[31636]: pgmap v1982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3535.077330 secs 2024-04-21T11:23:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:46 smithi170 ceph-mon[31212]: pgmap v1983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:46 smithi077 ceph-mon[27902]: pgmap v1983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:46 smithi191 ceph-mon[31636]: pgmap v1983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:48.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3538.317240 secs 2024-04-21T11:23:48.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:47 smithi077 ceph-mon[27902]: pgmap v1984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3538.317240 secs 2024-04-21T11:23:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:47 smithi191 ceph-mon[31636]: pgmap v1984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3538.317240 secs 2024-04-21T11:23:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:47 smithi170 ceph-mon[31212]: pgmap v1984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3540.077468 secs 2024-04-21T11:23:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3540.077468 secs 2024-04-21T11:23:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3540.077468 secs 2024-04-21T11:23:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:49 smithi077 ceph-mon[27902]: pgmap v1985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:49 smithi191 ceph-mon[31636]: pgmap v1985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:49 smithi170 ceph-mon[31212]: pgmap v1985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:23:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:23:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:23:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:51 smithi077 ceph-mon[27902]: pgmap v1986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:23:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:23:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:51 smithi191 ceph-mon[31636]: pgmap v1986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:23:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:23:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:51 smithi170 ceph-mon[31212]: pgmap v1986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:23:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:23:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:23:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:23:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3543.317306 secs 2024-04-21T11:23:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3543.317306 secs 2024-04-21T11:23:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3543.317306 secs 2024-04-21T11:23:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:53 smithi077 ceph-mon[27902]: pgmap v1987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3545.077604 secs 2024-04-21T11:23:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:53 smithi191 ceph-mon[31636]: pgmap v1987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3545.077604 secs 2024-04-21T11:23:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:53 smithi170 ceph-mon[31212]: pgmap v1987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:23:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3545.077604 secs 2024-04-21T11:23:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:23:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:56 smithi170 ceph-mon[31212]: pgmap v1988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:56 smithi077 ceph-mon[27902]: pgmap v1988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:56 smithi191 ceph-mon[31636]: pgmap v1988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:23:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3548.317428 secs 2024-04-21T11:23:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3548.317428 secs 2024-04-21T11:23:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3548.317428 secs 2024-04-21T11:23:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:58 smithi170 ceph-mon[31212]: pgmap v1989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:58 smithi077 ceph-mon[27902]: pgmap v1989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:58 smithi191 ceph-mon[31636]: pgmap v1989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:23:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3550.077729 secs 2024-04-21T11:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3550.077729 secs 2024-04-21T11:23:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3550.077729 secs 2024-04-21T11:24:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:00 smithi170 ceph-mon[31212]: pgmap v1990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:00 smithi077 ceph-mon[27902]: pgmap v1990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:00 smithi191 ceph-mon[31636]: pgmap v1990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:02 smithi170 ceph-mon[31212]: pgmap v1991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3553.317529 secs 2024-04-21T11:24:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:02 smithi077 ceph-mon[27902]: pgmap v1991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3553.317529 secs 2024-04-21T11:24:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:02 smithi191 ceph-mon[31636]: pgmap v1991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3553.317529 secs 2024-04-21T11:24:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:04 smithi170 ceph-mon[31212]: pgmap v1992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3555.077888 secs 2024-04-21T11:24:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:04 smithi170 ceph-mon[31212]: osdmap e199: 12 total, 12 up, 12 in 2024-04-21T11:24:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:04 smithi077 ceph-mon[27902]: pgmap v1992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3555.077888 secs 2024-04-21T11:24:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:04 smithi077 ceph-mon[27902]: osdmap e199: 12 total, 12 up, 12 in 2024-04-21T11:24:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:04 smithi191 ceph-mon[31636]: pgmap v1992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3555.077888 secs 2024-04-21T11:24:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:04 smithi191 ceph-mon[31636]: osdmap e199: 12 total, 12 up, 12 in 2024-04-21T11:24:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:06 smithi170 ceph-mon[31212]: pgmap v1994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:24:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:06 smithi077 ceph-mon[27902]: pgmap v1994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:24:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:06 smithi191 ceph-mon[31636]: pgmap v1994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:24:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3558.317650 secs 2024-04-21T11:24:07.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3558.317650 secs 2024-04-21T11:24:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3558.317650 secs 2024-04-21T11:24:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:08 smithi170 ceph-mon[31212]: pgmap v1995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:24:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:08 smithi077 ceph-mon[27902]: pgmap v1995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:24:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:08 smithi191 ceph-mon[31636]: pgmap v1995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:24:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3560.077930 secs 2024-04-21T11:24:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3560.077930 secs 2024-04-21T11:24:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3560.077930 secs 2024-04-21T11:24:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:10 smithi170 ceph-mon[31212]: pgmap v1996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:24:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:10 smithi077 ceph-mon[27902]: pgmap v1996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:24:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:10 smithi191 ceph-mon[31636]: pgmap v1996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:24:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:12 smithi170 ceph-mon[31212]: pgmap v1997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:24:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3563.317793 secs 2024-04-21T11:24:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:12 smithi170 ceph-mon[31212]: osdmap e200: 12 total, 12 up, 12 in 2024-04-21T11:24:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:12 smithi077 ceph-mon[27902]: pgmap v1997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:24:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3563.317793 secs 2024-04-21T11:24:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:12 smithi077 ceph-mon[27902]: osdmap e200: 12 total, 12 up, 12 in 2024-04-21T11:24:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:12 smithi191 ceph-mon[31636]: pgmap v1997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:24:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3563.317793 secs 2024-04-21T11:24:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:12 smithi191 ceph-mon[31636]: osdmap e200: 12 total, 12 up, 12 in 2024-04-21T11:24:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:14 smithi170 ceph-mon[31212]: pgmap v1999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:24:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3565.078047 secs 2024-04-21T11:24:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:14 smithi077 ceph-mon[27902]: pgmap v1999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:24:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3565.078047 secs 2024-04-21T11:24:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:14 smithi191 ceph-mon[31636]: pgmap v1999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:24:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3565.078047 secs 2024-04-21T11:24:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:16 smithi170 ceph-mon[31212]: pgmap v2000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:24:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:16 smithi077 ceph-mon[27902]: pgmap v2000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:24:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:16 smithi191 ceph-mon[31636]: pgmap v2000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:24:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3568.317917 secs 2024-04-21T11:24:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3568.317917 secs 2024-04-21T11:24:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3568.317917 secs 2024-04-21T11:24:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:18 smithi170 ceph-mon[31212]: pgmap v2001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:24:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:18 smithi077 ceph-mon[27902]: pgmap v2001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:24:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:18 smithi191 ceph-mon[31636]: pgmap v2001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:24:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3570.078125 secs 2024-04-21T11:24:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3570.078125 secs 2024-04-21T11:24:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3570.078125 secs 2024-04-21T11:24:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:20 smithi077 ceph-mon[27902]: pgmap v2002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:24:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:20 smithi191 ceph-mon[31636]: pgmap v2002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:24:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:20 smithi170 ceph-mon[31212]: pgmap v2002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:24:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:22 smithi077 ceph-mon[27902]: pgmap v2003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:24:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3573.318042 secs 2024-04-21T11:24:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:22 smithi191 ceph-mon[31636]: pgmap v2003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:24:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3573.318042 secs 2024-04-21T11:24:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:22 smithi170 ceph-mon[31212]: pgmap v2003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:24:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3573.318042 secs 2024-04-21T11:24:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:24 smithi077 ceph-mon[27902]: pgmap v2004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:24:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3575.078204 secs 2024-04-21T11:24:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:24 smithi191 ceph-mon[31636]: pgmap v2004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:24:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3575.078204 secs 2024-04-21T11:24:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:24 smithi170 ceph-mon[31212]: pgmap v2004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:24:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3575.078204 secs 2024-04-21T11:24:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:26 smithi077 ceph-mon[27902]: pgmap v2005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:26 smithi191 ceph-mon[31636]: pgmap v2005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:26 smithi170 ceph-mon[31212]: pgmap v2005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3578.318122 secs 2024-04-21T11:24:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3578.318122 secs 2024-04-21T11:24:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3578.318122 secs 2024-04-21T11:24:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:28 smithi077 ceph-mon[27902]: pgmap v2006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:28 smithi191 ceph-mon[31636]: pgmap v2006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:28 smithi170 ceph-mon[31212]: pgmap v2006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3580.078298 secs 2024-04-21T11:24:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3580.078298 secs 2024-04-21T11:24:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3580.078298 secs 2024-04-21T11:24:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:30 smithi077 ceph-mon[27902]: pgmap v2007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:30 smithi191 ceph-mon[31636]: pgmap v2007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:30 smithi170 ceph-mon[31212]: pgmap v2007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:32 smithi077 ceph-mon[27902]: pgmap v2008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3583.318199 secs 2024-04-21T11:24:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:32 smithi191 ceph-mon[31636]: pgmap v2008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3583.318199 secs 2024-04-21T11:24:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:32 smithi170 ceph-mon[31212]: pgmap v2008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3583.318199 secs 2024-04-21T11:24:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:34 smithi077 ceph-mon[27902]: pgmap v2009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3585.078395 secs 2024-04-21T11:24:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:34 smithi191 ceph-mon[31636]: pgmap v2009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3585.078395 secs 2024-04-21T11:24:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:34 smithi170 ceph-mon[31212]: pgmap v2009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3585.078395 secs 2024-04-21T11:24:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:36 smithi077 ceph-mon[27902]: pgmap v2010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:36 smithi191 ceph-mon[31636]: pgmap v2010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:36 smithi170 ceph-mon[31212]: pgmap v2010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3588.318274 secs 2024-04-21T11:24:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3588.318274 secs 2024-04-21T11:24:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3588.318274 secs 2024-04-21T11:24:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:38 smithi077 ceph-mon[27902]: pgmap v2011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:38 smithi170 ceph-mon[31212]: pgmap v2011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:38 smithi191 ceph-mon[31636]: pgmap v2011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3590.078511 secs 2024-04-21T11:24:39.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3590.078511 secs 2024-04-21T11:24:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3590.078511 secs 2024-04-21T11:24:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:40 smithi077 ceph-mon[27902]: pgmap v2012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:40 smithi191 ceph-mon[31636]: pgmap v2012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:40 smithi170 ceph-mon[31212]: pgmap v2012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:42 smithi077 ceph-mon[27902]: pgmap v2013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3593.318390 secs 2024-04-21T11:24:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:42 smithi191 ceph-mon[31636]: pgmap v2013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3593.318390 secs 2024-04-21T11:24:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:42 smithi170 ceph-mon[31212]: pgmap v2013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3593.318390 secs 2024-04-21T11:24:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:44 smithi077 ceph-mon[27902]: pgmap v2014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3595.078643 secs 2024-04-21T11:24:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:44 smithi191 ceph-mon[31636]: pgmap v2014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3595.078643 secs 2024-04-21T11:24:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:44 smithi170 ceph-mon[31212]: pgmap v2014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3595.078643 secs 2024-04-21T11:24:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:46 smithi077 ceph-mon[27902]: pgmap v2015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:46 smithi191 ceph-mon[31636]: pgmap v2015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:46 smithi170 ceph-mon[31212]: pgmap v2015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3598.318509 secs 2024-04-21T11:24:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3598.318509 secs 2024-04-21T11:24:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3598.318509 secs 2024-04-21T11:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:48 smithi077 ceph-mon[27902]: pgmap v2016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:48 smithi191 ceph-mon[31636]: pgmap v2016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:48 smithi170 ceph-mon[31212]: pgmap v2016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3600.078762 secs 2024-04-21T11:24:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3600.078762 secs 2024-04-21T11:24:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3600.078762 secs 2024-04-21T11:24:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:50 smithi191 ceph-mon[31636]: pgmap v2017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:50 smithi170 ceph-mon[31212]: pgmap v2017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:50 smithi077 ceph-mon[27902]: pgmap v2017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: pgmap v2018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3603.318624 secs 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: pgmap v2018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3603.318624 secs 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: pgmap v2018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3603.318624 secs 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:24:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:24:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:24:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:24:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:24:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:24:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:24:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:54 smithi191 ceph-mon[31636]: pgmap v2019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3605.078890 secs 2024-04-21T11:24:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:54 smithi170 ceph-mon[31212]: pgmap v2019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3605.078890 secs 2024-04-21T11:24:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:54 smithi077 ceph-mon[27902]: pgmap v2019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:24:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3605.078890 secs 2024-04-21T11:24:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:24:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:56 smithi191 ceph-mon[31636]: pgmap v2020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:56 smithi170 ceph-mon[31212]: pgmap v2020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:56 smithi077 ceph-mon[27902]: pgmap v2020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:24:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3608.318758 secs 2024-04-21T11:24:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3608.318758 secs 2024-04-21T11:24:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3608.318758 secs 2024-04-21T11:24:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:58 smithi191 ceph-mon[31636]: pgmap v2021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:58 smithi170 ceph-mon[31212]: pgmap v2021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:58 smithi077 ceph-mon[27902]: pgmap v2021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:24:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3610.078990 secs 2024-04-21T11:24:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3610.078990 secs 2024-04-21T11:24:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3610.078990 secs 2024-04-21T11:25:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:00 smithi191 ceph-mon[31636]: pgmap v2022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:00 smithi170 ceph-mon[31212]: pgmap v2022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:00 smithi077 ceph-mon[27902]: pgmap v2022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:02 smithi191 ceph-mon[31636]: pgmap v2023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3613.318854 secs 2024-04-21T11:25:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:02 smithi170 ceph-mon[31212]: pgmap v2023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3613.318854 secs 2024-04-21T11:25:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:02 smithi077 ceph-mon[27902]: pgmap v2023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3613.318854 secs 2024-04-21T11:25:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:04 smithi191 ceph-mon[31636]: pgmap v2024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3615.079101 secs 2024-04-21T11:25:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:04 smithi191 ceph-mon[31636]: osdmap e201: 12 total, 12 up, 12 in 2024-04-21T11:25:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:04 smithi170 ceph-mon[31212]: pgmap v2024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3615.079101 secs 2024-04-21T11:25:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:04 smithi170 ceph-mon[31212]: osdmap e201: 12 total, 12 up, 12 in 2024-04-21T11:25:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:04 smithi077 ceph-mon[27902]: pgmap v2024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3615.079101 secs 2024-04-21T11:25:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:04 smithi077 ceph-mon[27902]: osdmap e201: 12 total, 12 up, 12 in 2024-04-21T11:25:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:06 smithi191 ceph-mon[31636]: pgmap v2026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:25:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:06 smithi170 ceph-mon[31212]: pgmap v2026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:25:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:06 smithi077 ceph-mon[27902]: pgmap v2026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:25:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3618.318971 secs 2024-04-21T11:25:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3618.318971 secs 2024-04-21T11:25:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3618.318971 secs 2024-04-21T11:25:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:08 smithi170 ceph-mon[31212]: pgmap v2027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:25:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:08 smithi191 ceph-mon[31636]: pgmap v2027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:25:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:08 smithi077 ceph-mon[27902]: pgmap v2027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:25:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3620.079216 secs 2024-04-21T11:25:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3620.079216 secs 2024-04-21T11:25:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3620.079216 secs 2024-04-21T11:25:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:10 smithi191 ceph-mon[31636]: pgmap v2028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:25:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:10 smithi170 ceph-mon[31212]: pgmap v2028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:25:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:10 smithi077 ceph-mon[27902]: pgmap v2028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:25:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:12 smithi191 ceph-mon[31636]: pgmap v2029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:25:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3623.319036 secs 2024-04-21T11:25:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:12 smithi191 ceph-mon[31636]: osdmap e202: 12 total, 12 up, 12 in 2024-04-21T11:25:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:12 smithi170 ceph-mon[31212]: pgmap v2029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:25:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3623.319036 secs 2024-04-21T11:25:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:12 smithi170 ceph-mon[31212]: osdmap e202: 12 total, 12 up, 12 in 2024-04-21T11:25:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:12 smithi077 ceph-mon[27902]: pgmap v2029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:25:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3623.319036 secs 2024-04-21T11:25:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:12 smithi077 ceph-mon[27902]: osdmap e202: 12 total, 12 up, 12 in 2024-04-21T11:25:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3625.079339 secs 2024-04-21T11:25:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:14 smithi191 ceph-mon[31636]: pgmap v2031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:25:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3625.079339 secs 2024-04-21T11:25:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:14 smithi170 ceph-mon[31212]: pgmap v2031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:25:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3625.079339 secs 2024-04-21T11:25:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:14 smithi077 ceph-mon[27902]: pgmap v2031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:25:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:16 smithi191 ceph-mon[31636]: pgmap v2032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:25:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:16 smithi170 ceph-mon[31212]: pgmap v2032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:25:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:16 smithi077 ceph-mon[27902]: pgmap v2032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:25:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3628.319152 secs 2024-04-21T11:25:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3628.319152 secs 2024-04-21T11:25:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3628.319152 secs 2024-04-21T11:25:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:18 smithi191 ceph-mon[31636]: pgmap v2033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:25:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:18 smithi170 ceph-mon[31212]: pgmap v2033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:25:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:18 smithi077 ceph-mon[27902]: pgmap v2033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:25:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3630.079499 secs 2024-04-21T11:25:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3630.079499 secs 2024-04-21T11:25:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3630.079499 secs 2024-04-21T11:25:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:20 smithi191 ceph-mon[31636]: pgmap v2034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:25:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:20 smithi170 ceph-mon[31212]: pgmap v2034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:25:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:20 smithi077 ceph-mon[27902]: pgmap v2034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:25:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:22 smithi170 ceph-mon[31212]: pgmap v2035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:25:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3633.319268 secs 2024-04-21T11:25:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:22 smithi077 ceph-mon[27902]: pgmap v2035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:25:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3633.319268 secs 2024-04-21T11:25:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:22 smithi191 ceph-mon[31636]: pgmap v2035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:25:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3633.319268 secs 2024-04-21T11:25:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3635.079643 secs 2024-04-21T11:25:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:24 smithi170 ceph-mon[31212]: pgmap v2036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:25:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3635.079643 secs 2024-04-21T11:25:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:24 smithi077 ceph-mon[27902]: pgmap v2036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:25:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3635.079643 secs 2024-04-21T11:25:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:24 smithi191 ceph-mon[31636]: pgmap v2036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:25:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:26 smithi170 ceph-mon[31212]: pgmap v2037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:26 smithi077 ceph-mon[27902]: pgmap v2037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:26 smithi191 ceph-mon[31636]: pgmap v2037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3638.319345 secs 2024-04-21T11:25:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3638.319345 secs 2024-04-21T11:25:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3638.319345 secs 2024-04-21T11:25:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:28 smithi170 ceph-mon[31212]: pgmap v2038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:28 smithi077 ceph-mon[27902]: pgmap v2038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:28 smithi191 ceph-mon[31636]: pgmap v2038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3640.079760 secs 2024-04-21T11:25:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3640.079760 secs 2024-04-21T11:25:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3640.079760 secs 2024-04-21T11:25:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:30 smithi170 ceph-mon[31212]: pgmap v2039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:30 smithi077 ceph-mon[27902]: pgmap v2039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:30 smithi191 ceph-mon[31636]: pgmap v2039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:32 smithi170 ceph-mon[31212]: pgmap v2040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3643.319481 secs 2024-04-21T11:25:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:32 smithi077 ceph-mon[27902]: pgmap v2040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3643.319481 secs 2024-04-21T11:25:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:32 smithi191 ceph-mon[31636]: pgmap v2040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3643.319481 secs 2024-04-21T11:25:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3645.079879 secs 2024-04-21T11:25:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:34 smithi170 ceph-mon[31212]: pgmap v2041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3645.079879 secs 2024-04-21T11:25:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:34 smithi077 ceph-mon[27902]: pgmap v2041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3645.079879 secs 2024-04-21T11:25:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:34 smithi191 ceph-mon[31636]: pgmap v2041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:36 smithi170 ceph-mon[31212]: pgmap v2042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:36 smithi077 ceph-mon[27902]: pgmap v2042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:36 smithi191 ceph-mon[31636]: pgmap v2042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3648.319594 secs 2024-04-21T11:25:37.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3648.319594 secs 2024-04-21T11:25:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3648.319594 secs 2024-04-21T11:25:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:38 smithi170 ceph-mon[31212]: pgmap v2043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:38 smithi077 ceph-mon[27902]: pgmap v2043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:38 smithi191 ceph-mon[31636]: pgmap v2043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3650.079953 secs 2024-04-21T11:25:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3650.079953 secs 2024-04-21T11:25:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3650.079953 secs 2024-04-21T11:25:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:40 smithi170 ceph-mon[31212]: pgmap v2044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:40 smithi077 ceph-mon[27902]: pgmap v2044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:40 smithi191 ceph-mon[31636]: pgmap v2044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:42 smithi170 ceph-mon[31212]: pgmap v2045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3653.319702 secs 2024-04-21T11:25:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:42 smithi077 ceph-mon[27902]: pgmap v2045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3653.319702 secs 2024-04-21T11:25:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:42 smithi191 ceph-mon[31636]: pgmap v2045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3653.319702 secs 2024-04-21T11:25:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3655.080071 secs 2024-04-21T11:25:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:44 smithi170 ceph-mon[31212]: pgmap v2046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3655.080071 secs 2024-04-21T11:25:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:44 smithi077 ceph-mon[27902]: pgmap v2046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3655.080071 secs 2024-04-21T11:25:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:44 smithi191 ceph-mon[31636]: pgmap v2046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:46 smithi170 ceph-mon[31212]: pgmap v2047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:46 smithi077 ceph-mon[27902]: pgmap v2047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:46 smithi191 ceph-mon[31636]: pgmap v2047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3658.319825 secs 2024-04-21T11:25:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3658.319825 secs 2024-04-21T11:25:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3658.319825 secs 2024-04-21T11:25:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:48 smithi170 ceph-mon[31212]: pgmap v2048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:48 smithi077 ceph-mon[27902]: pgmap v2048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:48 smithi191 ceph-mon[31636]: pgmap v2048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3660.080150 secs 2024-04-21T11:25:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3660.080150 secs 2024-04-21T11:25:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3660.080150 secs 2024-04-21T11:25:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:50 smithi170 ceph-mon[31212]: pgmap v2049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:50 smithi077 ceph-mon[27902]: pgmap v2049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:50 smithi191 ceph-mon[31636]: pgmap v2049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:52 smithi170 ceph-mon[31212]: pgmap v2050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3663.319964 secs 2024-04-21T11:25:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:52 smithi077 ceph-mon[27902]: pgmap v2050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3663.319964 secs 2024-04-21T11:25:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:52 smithi191 ceph-mon[31636]: pgmap v2050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:25:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3663.319964 secs 2024-04-21T11:25:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:25:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:25:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:25:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:25:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:25:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:25:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:25:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:25:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:25:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:25:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:25:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:25:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3665.080214 secs 2024-04-21T11:25:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:54 smithi170 ceph-mon[31212]: pgmap v2051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:25:54.852+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:25:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:25:54.852+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:25:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:25:54.852+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:25:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:25:54.852+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:25:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3665.080214 secs 2024-04-21T11:25:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:54 smithi077 ceph-mon[27902]: pgmap v2051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3665.080214 secs 2024-04-21T11:25:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:54 smithi191 ceph-mon[31636]: pgmap v2051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:25:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:25:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:56 smithi170 ceph-mon[31212]: pgmap v2052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:56 smithi077 ceph-mon[27902]: pgmap v2052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:56 smithi191 ceph-mon[31636]: pgmap v2052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:25:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3668.320027 secs 2024-04-21T11:25:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3668.320027 secs 2024-04-21T11:25:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3668.320027 secs 2024-04-21T11:25:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:58 smithi077 ceph-mon[27902]: pgmap v2053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:58 smithi191 ceph-mon[31636]: pgmap v2053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:58 smithi170 ceph-mon[31212]: pgmap v2053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:25:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3670.080294 secs 2024-04-21T11:25:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3670.080294 secs 2024-04-21T11:26:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3670.080294 secs 2024-04-21T11:26:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:00 smithi077 ceph-mon[27902]: pgmap v2054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:00 smithi191 ceph-mon[31636]: pgmap v2054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:00 smithi170 ceph-mon[31212]: pgmap v2054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:02 smithi077 ceph-mon[27902]: pgmap v2055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3673.320149 secs 2024-04-21T11:26:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:02 smithi191 ceph-mon[31636]: pgmap v2055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3673.320149 secs 2024-04-21T11:26:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:02 smithi170 ceph-mon[31212]: pgmap v2055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3673.320149 secs 2024-04-21T11:26:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3675.080413 secs 2024-04-21T11:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:04 smithi077 ceph-mon[27902]: pgmap v2056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:04 smithi077 ceph-mon[27902]: osdmap e203: 12 total, 12 up, 12 in 2024-04-21T11:26:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3675.080413 secs 2024-04-21T11:26:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:04 smithi191 ceph-mon[31636]: pgmap v2056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:04 smithi191 ceph-mon[31636]: osdmap e203: 12 total, 12 up, 12 in 2024-04-21T11:26:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3675.080413 secs 2024-04-21T11:26:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:04 smithi170 ceph-mon[31212]: pgmap v2056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:04 smithi170 ceph-mon[31212]: osdmap e203: 12 total, 12 up, 12 in 2024-04-21T11:26:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:06 smithi077 ceph-mon[27902]: pgmap v2058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:26:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:06 smithi191 ceph-mon[31636]: pgmap v2058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:26:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:06 smithi170 ceph-mon[31212]: pgmap v2058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:26:07.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3678.320288 secs 2024-04-21T11:26:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3678.320288 secs 2024-04-21T11:26:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3678.320288 secs 2024-04-21T11:26:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:08 smithi077 ceph-mon[27902]: pgmap v2059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:26:08.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:08 smithi170 ceph-mon[31212]: pgmap v2059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:26:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:08 smithi191 ceph-mon[31636]: pgmap v2059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:26:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3680.080544 secs 2024-04-21T11:26:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3680.080544 secs 2024-04-21T11:26:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3680.080544 secs 2024-04-21T11:26:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:10 smithi077 ceph-mon[27902]: pgmap v2060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:26:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:10 smithi191 ceph-mon[31636]: pgmap v2060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:26:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:10 smithi170 ceph-mon[31212]: pgmap v2060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:26:11.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:11 smithi077 ceph-mon[27902]: pgmap v2061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:26:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:11 smithi191 ceph-mon[31636]: pgmap v2061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:26:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:11 smithi170 ceph-mon[31212]: pgmap v2061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:26:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3683.320427 secs 2024-04-21T11:26:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:12 smithi077 ceph-mon[27902]: osdmap e204: 12 total, 12 up, 12 in 2024-04-21T11:26:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3683.320427 secs 2024-04-21T11:26:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:12 smithi191 ceph-mon[31636]: osdmap e204: 12 total, 12 up, 12 in 2024-04-21T11:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3683.320427 secs 2024-04-21T11:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:12 smithi170 ceph-mon[31212]: osdmap e204: 12 total, 12 up, 12 in 2024-04-21T11:26:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3685.080664 secs 2024-04-21T11:26:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:13 smithi077 ceph-mon[27902]: pgmap v2063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:26:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3685.080664 secs 2024-04-21T11:26:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:13 smithi191 ceph-mon[31636]: pgmap v2063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:26:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3685.080664 secs 2024-04-21T11:26:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:13 smithi170 ceph-mon[31212]: pgmap v2063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T11:26:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:16 smithi170 ceph-mon[31212]: pgmap v2064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T11:26:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:16 smithi077 ceph-mon[27902]: pgmap v2064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T11:26:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:16 smithi191 ceph-mon[31636]: pgmap v2064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T11:26:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3688.320552 secs 2024-04-21T11:26:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3688.320552 secs 2024-04-21T11:26:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3688.320552 secs 2024-04-21T11:26:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:18 smithi170 ceph-mon[31212]: pgmap v2065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:26:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:18 smithi077 ceph-mon[27902]: pgmap v2065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:26:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:18 smithi191 ceph-mon[31636]: pgmap v2065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:26:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3690.080809 secs 2024-04-21T11:26:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3690.080809 secs 2024-04-21T11:26:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3690.080809 secs 2024-04-21T11:26:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:20 smithi170 ceph-mon[31212]: pgmap v2066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:26:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:20 smithi077 ceph-mon[27902]: pgmap v2066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:26:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:20 smithi191 ceph-mon[31636]: pgmap v2066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:26:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:22 smithi170 ceph-mon[31212]: pgmap v2067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:26:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3693.320690 secs 2024-04-21T11:26:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:22 smithi077 ceph-mon[27902]: pgmap v2067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:26:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3693.320690 secs 2024-04-21T11:26:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:22 smithi191 ceph-mon[31636]: pgmap v2067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T11:26:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3693.320690 secs 2024-04-21T11:26:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3695.080926 secs 2024-04-21T11:26:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:24 smithi170 ceph-mon[31212]: pgmap v2068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:26:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3695.080926 secs 2024-04-21T11:26:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:24 smithi077 ceph-mon[27902]: pgmap v2068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:26:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3695.080926 secs 2024-04-21T11:26:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:24 smithi191 ceph-mon[31636]: pgmap v2068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:26:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:26 smithi077 ceph-mon[27902]: pgmap v2069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:26 smithi191 ceph-mon[31636]: pgmap v2069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:26 smithi170 ceph-mon[31212]: pgmap v2069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3698.320803 secs 2024-04-21T11:26:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3698.320803 secs 2024-04-21T11:26:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3698.320803 secs 2024-04-21T11:26:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:28 smithi077 ceph-mon[27902]: pgmap v2070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:28 smithi191 ceph-mon[31636]: pgmap v2070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:28 smithi170 ceph-mon[31212]: pgmap v2070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3700.081041 secs 2024-04-21T11:26:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3700.081041 secs 2024-04-21T11:26:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3700.081041 secs 2024-04-21T11:26:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:30 smithi077 ceph-mon[27902]: pgmap v2071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:30 smithi191 ceph-mon[31636]: pgmap v2071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:30 smithi170 ceph-mon[31212]: pgmap v2071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:32 smithi077 ceph-mon[27902]: pgmap v2072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3703.320914 secs 2024-04-21T11:26:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:32 smithi191 ceph-mon[31636]: pgmap v2072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3703.320914 secs 2024-04-21T11:26:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:32 smithi170 ceph-mon[31212]: pgmap v2072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3703.320914 secs 2024-04-21T11:26:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3705.081162 secs 2024-04-21T11:26:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:34 smithi077 ceph-mon[27902]: pgmap v2073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3705.081162 secs 2024-04-21T11:26:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:34 smithi191 ceph-mon[31636]: pgmap v2073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3705.081162 secs 2024-04-21T11:26:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:34 smithi170 ceph-mon[31212]: pgmap v2073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:36 smithi077 ceph-mon[27902]: pgmap v2074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:36 smithi191 ceph-mon[31636]: pgmap v2074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:36 smithi170 ceph-mon[31212]: pgmap v2074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3708.320984 secs 2024-04-21T11:26:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3708.320984 secs 2024-04-21T11:26:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3708.320984 secs 2024-04-21T11:26:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:38 smithi077 ceph-mon[27902]: pgmap v2075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:38 smithi170 ceph-mon[31212]: pgmap v2075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:38 smithi191 ceph-mon[31636]: pgmap v2075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3710.081282 secs 2024-04-21T11:26:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3710.081282 secs 2024-04-21T11:26:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3710.081282 secs 2024-04-21T11:26:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:26:39.859+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:26:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:26:39.859+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:26:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:26:39.859+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:26:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:26:39.859+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:26:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:40 smithi077 ceph-mon[27902]: pgmap v2076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:40 smithi191 ceph-mon[31636]: pgmap v2076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:40 smithi170 ceph-mon[31212]: pgmap v2076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:42 smithi077 ceph-mon[27902]: pgmap v2077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3713.321073 secs 2024-04-21T11:26:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:42 smithi191 ceph-mon[31636]: pgmap v2077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3713.321073 secs 2024-04-21T11:26:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:42 smithi170 ceph-mon[31212]: pgmap v2077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3713.321073 secs 2024-04-21T11:26:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3715.081362 secs 2024-04-21T11:26:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:44 smithi077 ceph-mon[27902]: pgmap v2078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3715.081362 secs 2024-04-21T11:26:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:44 smithi191 ceph-mon[31636]: pgmap v2078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3715.081362 secs 2024-04-21T11:26:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:44 smithi170 ceph-mon[31212]: pgmap v2078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:46 smithi077 ceph-mon[27902]: pgmap v2079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:46 smithi191 ceph-mon[31636]: pgmap v2079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:46 smithi170 ceph-mon[31212]: pgmap v2079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3718.321195 secs 2024-04-21T11:26:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3718.321195 secs 2024-04-21T11:26:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3718.321195 secs 2024-04-21T11:26:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:48 smithi077 ceph-mon[27902]: pgmap v2080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:48 smithi191 ceph-mon[31636]: pgmap v2080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:48 smithi170 ceph-mon[31212]: pgmap v2080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:26:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3720.081443 secs 2024-04-21T11:26:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3720.081443 secs 2024-04-21T11:26:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3720.081443 secs 2024-04-21T11:26:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:50 smithi077 ceph-mon[27902]: pgmap v2081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:50 smithi191 ceph-mon[31636]: pgmap v2081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:50 smithi170 ceph-mon[31212]: pgmap v2081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:52 smithi077 ceph-mon[27902]: pgmap v2082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3723.321319 secs 2024-04-21T11:26:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:52 smithi191 ceph-mon[31636]: pgmap v2082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3723.321319 secs 2024-04-21T11:26:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:52 smithi170 ceph-mon[31212]: pgmap v2082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:26:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3723.321319 secs 2024-04-21T11:26:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3725.081561 secs 2024-04-21T11:26:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:54 smithi191 ceph-mon[31636]: pgmap v2083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:26:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:26:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:26:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:26:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3725.081561 secs 2024-04-21T11:26:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:54 smithi170 ceph-mon[31212]: pgmap v2083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:26:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:26:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:26:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:26:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3725.081561 secs 2024-04-21T11:26:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:54 smithi077 ceph-mon[27902]: pgmap v2083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:26:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:26:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:26:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:26:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:26:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:26:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:56 smithi191 ceph-mon[31636]: pgmap v2084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:26:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:56 smithi170 ceph-mon[31212]: pgmap v2084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:26:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:56 smithi077 ceph-mon[27902]: pgmap v2084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:26:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3728.321441 secs 2024-04-21T11:26:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3728.321441 secs 2024-04-21T11:26:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3728.321441 secs 2024-04-21T11:26:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:58 smithi191 ceph-mon[31636]: pgmap v2085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T11:26:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:58 smithi170 ceph-mon[31212]: pgmap v2085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T11:26:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:58 smithi077 ceph-mon[27902]: pgmap v2085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T11:26:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3730.081679 secs 2024-04-21T11:26:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3730.081679 secs 2024-04-21T11:26:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3730.081679 secs 2024-04-21T11:27:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:00 smithi191 ceph-mon[31636]: pgmap v2086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:27:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:00 smithi170 ceph-mon[31212]: pgmap v2086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:27:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:00 smithi077 ceph-mon[27902]: pgmap v2086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:27:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:02 smithi191 ceph-mon[31636]: pgmap v2087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3733.321596 secs 2024-04-21T11:27:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:02 smithi170 ceph-mon[31212]: pgmap v2087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3733.321596 secs 2024-04-21T11:27:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:02 smithi077 ceph-mon[27902]: pgmap v2087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3733.321596 secs 2024-04-21T11:27:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3735.081788 secs 2024-04-21T11:27:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:04 smithi191 ceph-mon[31636]: pgmap v2088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:27:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:04 smithi191 ceph-mon[31636]: osdmap e205: 12 total, 12 up, 12 in 2024-04-21T11:27:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3735.081788 secs 2024-04-21T11:27:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:04 smithi170 ceph-mon[31212]: pgmap v2088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:27:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:04 smithi170 ceph-mon[31212]: osdmap e205: 12 total, 12 up, 12 in 2024-04-21T11:27:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3735.081788 secs 2024-04-21T11:27:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:04 smithi077 ceph-mon[27902]: pgmap v2088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:27:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:04 smithi077 ceph-mon[27902]: osdmap e205: 12 total, 12 up, 12 in 2024-04-21T11:27:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:06 smithi191 ceph-mon[31636]: pgmap v2090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:27:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:06 smithi170 ceph-mon[31212]: pgmap v2090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:27:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:06 smithi077 ceph-mon[27902]: pgmap v2090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T11:27:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3738.321696 secs 2024-04-21T11:27:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3738.321696 secs 2024-04-21T11:27:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3738.321696 secs 2024-04-21T11:27:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:08 smithi170 ceph-mon[31212]: pgmap v2091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:08 smithi191 ceph-mon[31636]: pgmap v2091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:08 smithi077 ceph-mon[27902]: pgmap v2091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3740.081921 secs 2024-04-21T11:27:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3740.081921 secs 2024-04-21T11:27:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3740.081921 secs 2024-04-21T11:27:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:10 smithi191 ceph-mon[31636]: pgmap v2092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:10 smithi170 ceph-mon[31212]: pgmap v2092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:10 smithi077 ceph-mon[27902]: pgmap v2092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:12 smithi191 ceph-mon[31636]: pgmap v2093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3743.321819 secs 2024-04-21T11:27:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:12 smithi191 ceph-mon[31636]: osdmap e206: 12 total, 12 up, 12 in 2024-04-21T11:27:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:12 smithi170 ceph-mon[31212]: pgmap v2093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3743.321819 secs 2024-04-21T11:27:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:12 smithi170 ceph-mon[31212]: osdmap e206: 12 total, 12 up, 12 in 2024-04-21T11:27:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:12 smithi077 ceph-mon[27902]: pgmap v2093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:27:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3743.321819 secs 2024-04-21T11:27:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:12 smithi077 ceph-mon[27902]: osdmap e206: 12 total, 12 up, 12 in 2024-04-21T11:27:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3745.082001 secs 2024-04-21T11:27:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:14 smithi191 ceph-mon[31636]: pgmap v2095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:27:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3745.082001 secs 2024-04-21T11:27:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:14 smithi170 ceph-mon[31212]: pgmap v2095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:27:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3745.082001 secs 2024-04-21T11:27:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:14 smithi077 ceph-mon[27902]: pgmap v2095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:27:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:16 smithi191 ceph-mon[31636]: pgmap v2096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:27:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:16 smithi170 ceph-mon[31212]: pgmap v2096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:27:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:16 smithi077 ceph-mon[27902]: pgmap v2096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T11:27:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3748.321903 secs 2024-04-21T11:27:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:17 smithi191 ceph-mon[31636]: pgmap v2097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:27:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3748.321903 secs 2024-04-21T11:27:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:17 smithi170 ceph-mon[31212]: pgmap v2097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:27:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3748.321903 secs 2024-04-21T11:27:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:17 smithi077 ceph-mon[27902]: pgmap v2097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:27:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3750.082068 secs 2024-04-21T11:27:19.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3750.082068 secs 2024-04-21T11:27:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3750.082068 secs 2024-04-21T11:27:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:19 smithi191 ceph-mon[31636]: pgmap v2098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:27:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:19 smithi170 ceph-mon[31212]: pgmap v2098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:27:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:19 smithi077 ceph-mon[27902]: pgmap v2098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:27:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:22 smithi170 ceph-mon[31212]: pgmap v2099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T11:27:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3753.321999 secs 2024-04-21T11:27:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:22 smithi077 ceph-mon[27902]: pgmap v2099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T11:27:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3753.321999 secs 2024-04-21T11:27:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:22 smithi191 ceph-mon[31636]: pgmap v2099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T11:27:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3753.321999 secs 2024-04-21T11:27:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3755.082193 secs 2024-04-21T11:27:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:24 smithi077 ceph-mon[27902]: pgmap v2100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:27:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3755.082193 secs 2024-04-21T11:27:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:24 smithi191 ceph-mon[31636]: pgmap v2100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:27:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3755.082193 secs 2024-04-21T11:27:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:24 smithi170 ceph-mon[31212]: pgmap v2100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:27:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:26 smithi077 ceph-mon[27902]: pgmap v2101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:27:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:26 smithi191 ceph-mon[31636]: pgmap v2101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:27:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:26 smithi170 ceph-mon[31212]: pgmap v2101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T11:27:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3758.322080 secs 2024-04-21T11:27:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3758.322080 secs 2024-04-21T11:27:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3758.322080 secs 2024-04-21T11:27:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:28 smithi077 ceph-mon[27902]: pgmap v2102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:28 smithi191 ceph-mon[31636]: pgmap v2102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:28 smithi170 ceph-mon[31212]: pgmap v2102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3760.082324 secs 2024-04-21T11:27:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3760.082324 secs 2024-04-21T11:27:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3760.082324 secs 2024-04-21T11:27:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:30 smithi077 ceph-mon[27902]: pgmap v2103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:30 smithi191 ceph-mon[31636]: pgmap v2103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:30 smithi170 ceph-mon[31212]: pgmap v2103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:32 smithi077 ceph-mon[27902]: pgmap v2104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3763.322206 secs 2024-04-21T11:27:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:32 smithi191 ceph-mon[31636]: pgmap v2104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3763.322206 secs 2024-04-21T11:27:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:32 smithi170 ceph-mon[31212]: pgmap v2104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3763.322206 secs 2024-04-21T11:27:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3765.082473 secs 2024-04-21T11:27:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:34 smithi077 ceph-mon[27902]: pgmap v2105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3765.082473 secs 2024-04-21T11:27:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:34 smithi191 ceph-mon[31636]: pgmap v2105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3765.082473 secs 2024-04-21T11:27:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:34 smithi170 ceph-mon[31212]: pgmap v2105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:36 smithi077 ceph-mon[27902]: pgmap v2106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:36 smithi191 ceph-mon[31636]: pgmap v2106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:36 smithi170 ceph-mon[31212]: pgmap v2106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:37.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3768.322280 secs 2024-04-21T11:27:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3768.322280 secs 2024-04-21T11:27:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3768.322280 secs 2024-04-21T11:27:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:38 smithi077 ceph-mon[27902]: pgmap v2107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:38 smithi170 ceph-mon[31212]: pgmap v2107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:38 smithi191 ceph-mon[31636]: pgmap v2107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3770.082531 secs 2024-04-21T11:27:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3770.082531 secs 2024-04-21T11:27:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3770.082531 secs 2024-04-21T11:27:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:40 smithi077 ceph-mon[27902]: pgmap v2108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:40 smithi191 ceph-mon[31636]: pgmap v2108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:40 smithi170 ceph-mon[31212]: pgmap v2108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:42 smithi077 ceph-mon[27902]: pgmap v2109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3773.322402 secs 2024-04-21T11:27:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:42 smithi191 ceph-mon[31636]: pgmap v2109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3773.322402 secs 2024-04-21T11:27:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:42 smithi170 ceph-mon[31212]: pgmap v2109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3773.322402 secs 2024-04-21T11:27:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3775.082664 secs 2024-04-21T11:27:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:44 smithi077 ceph-mon[27902]: pgmap v2110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3775.082664 secs 2024-04-21T11:27:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:44 smithi191 ceph-mon[31636]: pgmap v2110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3775.082664 secs 2024-04-21T11:27:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:44 smithi170 ceph-mon[31212]: pgmap v2110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:46 smithi077 ceph-mon[27902]: pgmap v2111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:46 smithi191 ceph-mon[31636]: pgmap v2111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:46 smithi170 ceph-mon[31212]: pgmap v2111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3778.322521 secs 2024-04-21T11:27:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3778.322521 secs 2024-04-21T11:27:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3778.322521 secs 2024-04-21T11:27:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:48 smithi077 ceph-mon[27902]: pgmap v2112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:48 smithi191 ceph-mon[31636]: pgmap v2112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:48 smithi170 ceph-mon[31212]: pgmap v2112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T11:27:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3780.082793 secs 2024-04-21T11:27:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3780.082793 secs 2024-04-21T11:27:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3780.082793 secs 2024-04-21T11:27:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:50 smithi191 ceph-mon[31636]: pgmap v2113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:50 smithi170 ceph-mon[31212]: pgmap v2113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:50 smithi077 ceph-mon[27902]: pgmap v2113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:52 smithi191 ceph-mon[31636]: pgmap v2114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3783.322642 secs 2024-04-21T11:27:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:52 smithi170 ceph-mon[31212]: pgmap v2114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3783.322642 secs 2024-04-21T11:27:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:52 smithi077 ceph-mon[27902]: pgmap v2114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3783.322642 secs 2024-04-21T11:27:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3785.082875 secs 2024-04-21T11:27:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:54 smithi191 ceph-mon[31636]: pgmap v2115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:27:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3785.082875 secs 2024-04-21T11:27:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:54 smithi170 ceph-mon[31212]: pgmap v2115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:27:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3785.082875 secs 2024-04-21T11:27:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:54 smithi077 ceph-mon[27902]: pgmap v2115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:27:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:27:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:27:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:27:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:27:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:27:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:27:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:27:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:27:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:27:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:27:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:56 smithi191 ceph-mon[31636]: pgmap v2116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:56 smithi170 ceph-mon[31212]: pgmap v2116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:56 smithi077 ceph-mon[27902]: pgmap v2116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:27:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3788.322787 secs 2024-04-21T11:27:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3788.322787 secs 2024-04-21T11:27:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3788.322787 secs 2024-04-21T11:27:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:58 smithi191 ceph-mon[31636]: pgmap v2117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:58 smithi170 ceph-mon[31212]: pgmap v2117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:58 smithi077 ceph-mon[27902]: pgmap v2117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:27:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3790.082990 secs 2024-04-21T11:27:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3790.082990 secs 2024-04-21T11:27:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3790.082990 secs 2024-04-21T11:28:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:00 smithi191 ceph-mon[31636]: pgmap v2118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:00 smithi170 ceph-mon[31212]: pgmap v2118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:00 smithi077 ceph-mon[27902]: pgmap v2118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:02 smithi191 ceph-mon[31636]: pgmap v2119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3793.322888 secs 2024-04-21T11:28:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:02 smithi170 ceph-mon[31212]: pgmap v2119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3793.322888 secs 2024-04-21T11:28:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:02 smithi077 ceph-mon[27902]: pgmap v2119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3793.322888 secs 2024-04-21T11:28:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3795.083105 secs 2024-04-21T11:28:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:04 smithi191 ceph-mon[31636]: pgmap v2120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:04 smithi191 ceph-mon[31636]: osdmap e207: 12 total, 12 up, 12 in 2024-04-21T11:28:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3795.083105 secs 2024-04-21T11:28:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:04 smithi170 ceph-mon[31212]: pgmap v2120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:04 smithi170 ceph-mon[31212]: osdmap e207: 12 total, 12 up, 12 in 2024-04-21T11:28:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3795.083105 secs 2024-04-21T11:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:04 smithi077 ceph-mon[27902]: pgmap v2120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:04 smithi077 ceph-mon[27902]: osdmap e207: 12 total, 12 up, 12 in 2024-04-21T11:28:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:06 smithi191 ceph-mon[31636]: pgmap v2122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:28:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:06 smithi170 ceph-mon[31212]: pgmap v2122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:28:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:06 smithi077 ceph-mon[27902]: pgmap v2122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:28:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3798.323010 secs 2024-04-21T11:28:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:07 smithi191 ceph-mon[31636]: osdmap e208: 12 total, 12 up, 12 in 2024-04-21T11:28:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:07 smithi191 ceph-mon[31636]: pgmap v2124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3798.323010 secs 2024-04-21T11:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:07 smithi170 ceph-mon[31212]: osdmap e208: 12 total, 12 up, 12 in 2024-04-21T11:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:07 smithi170 ceph-mon[31212]: pgmap v2124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:28:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3798.323010 secs 2024-04-21T11:28:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:07 smithi077 ceph-mon[27902]: osdmap e208: 12 total, 12 up, 12 in 2024-04-21T11:28:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:07 smithi077 ceph-mon[27902]: pgmap v2124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:28:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3800.083222 secs 2024-04-21T11:28:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3800.083222 secs 2024-04-21T11:28:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3800.083222 secs 2024-04-21T11:28:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:09 smithi191 ceph-mon[31636]: pgmap v2125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:28:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:09 smithi170 ceph-mon[31212]: pgmap v2125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:28:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:09 smithi077 ceph-mon[27902]: pgmap v2125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:28:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:12 smithi077 ceph-mon[27902]: pgmap v2126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:28:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3803.323137 secs 2024-04-21T11:28:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:12 smithi191 ceph-mon[31636]: pgmap v2126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:28:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3803.323137 secs 2024-04-21T11:28:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:12 smithi170 ceph-mon[31212]: pgmap v2126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:28:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3803.323137 secs 2024-04-21T11:28:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3805.083336 secs 2024-04-21T11:28:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:14 smithi077 ceph-mon[27902]: pgmap v2127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:28:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3805.083336 secs 2024-04-21T11:28:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:14 smithi191 ceph-mon[31636]: pgmap v2127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:28:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3805.083336 secs 2024-04-21T11:28:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:14 smithi170 ceph-mon[31212]: pgmap v2127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:28:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:16 smithi077 ceph-mon[27902]: pgmap v2128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:28:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:16 smithi191 ceph-mon[31636]: pgmap v2128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:28:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:16 smithi170 ceph-mon[31212]: pgmap v2128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:28:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3808.323197 secs 2024-04-21T11:28:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:17 smithi191 ceph-mon[31636]: pgmap v2129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:28:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3808.323197 secs 2024-04-21T11:28:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:17 smithi170 ceph-mon[31212]: pgmap v2129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:28:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3808.323197 secs 2024-04-21T11:28:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:17 smithi077 ceph-mon[27902]: pgmap v2129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:28:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3810.083487 secs 2024-04-21T11:28:19.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3810.083487 secs 2024-04-21T11:28:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3810.083487 secs 2024-04-21T11:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 3995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:19 smithi191 ceph-mon[31636]: pgmap v2130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:28:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:19 smithi170 ceph-mon[31212]: pgmap v2130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:28:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:19 smithi077 ceph-mon[27902]: pgmap v2130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:28:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:22 smithi077 ceph-mon[27902]: pgmap v2131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:28:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3813.323277 secs 2024-04-21T11:28:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:22 smithi191 ceph-mon[31636]: pgmap v2131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:28:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3813.323277 secs 2024-04-21T11:28:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:22 smithi170 ceph-mon[31212]: pgmap v2131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:28:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3813.323277 secs 2024-04-21T11:28:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3815.083621 secs 2024-04-21T11:28:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:24 smithi077 ceph-mon[27902]: pgmap v2132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3815.083621 secs 2024-04-21T11:28:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:24 smithi191 ceph-mon[31636]: pgmap v2132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3815.083621 secs 2024-04-21T11:28:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:24 smithi170 ceph-mon[31212]: pgmap v2132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:26 smithi077 ceph-mon[27902]: pgmap v2133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:26 smithi191 ceph-mon[31636]: pgmap v2133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:26 smithi170 ceph-mon[31212]: pgmap v2133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3818.323398 secs 2024-04-21T11:28:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3818.323398 secs 2024-04-21T11:28:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3818.323398 secs 2024-04-21T11:28:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:28 smithi077 ceph-mon[27902]: pgmap v2134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:28 smithi191 ceph-mon[31636]: pgmap v2134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:28 smithi170 ceph-mon[31212]: pgmap v2134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3820.083734 secs 2024-04-21T11:28:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3820.083734 secs 2024-04-21T11:28:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3820.083734 secs 2024-04-21T11:28:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:30 smithi077 ceph-mon[27902]: pgmap v2135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:30 smithi191 ceph-mon[31636]: pgmap v2135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:30 smithi170 ceph-mon[31212]: pgmap v2135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:32 smithi077 ceph-mon[27902]: pgmap v2136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3823.323482 secs 2024-04-21T11:28:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:32 smithi191 ceph-mon[31636]: pgmap v2136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3823.323482 secs 2024-04-21T11:28:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:32 smithi170 ceph-mon[31212]: pgmap v2136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3823.323482 secs 2024-04-21T11:28:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3825.083872 secs 2024-04-21T11:28:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:34 smithi077 ceph-mon[27902]: pgmap v2137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3825.083872 secs 2024-04-21T11:28:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:34 smithi191 ceph-mon[31636]: pgmap v2137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3825.083872 secs 2024-04-21T11:28:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:34 smithi170 ceph-mon[31212]: pgmap v2137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:36 smithi077 ceph-mon[27902]: pgmap v2138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:36 smithi191 ceph-mon[31636]: pgmap v2138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:36 smithi170 ceph-mon[31212]: pgmap v2138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3828.323604 secs 2024-04-21T11:28:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3828.323604 secs 2024-04-21T11:28:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3828.323604 secs 2024-04-21T11:28:38.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:38 smithi191 ceph-mon[31636]: pgmap v2139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:38 smithi077 ceph-mon[27902]: pgmap v2139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:38 smithi170 ceph-mon[31212]: pgmap v2139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3830.083901 secs 2024-04-21T11:28:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3830.083901 secs 2024-04-21T11:28:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3830.083901 secs 2024-04-21T11:28:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:40 smithi077 ceph-mon[27902]: pgmap v2140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:40 smithi191 ceph-mon[31636]: pgmap v2140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:40 smithi170 ceph-mon[31212]: pgmap v2140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:42 smithi077 ceph-mon[27902]: pgmap v2141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3833.323722 secs 2024-04-21T11:28:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:42 smithi191 ceph-mon[31636]: pgmap v2141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3833.323722 secs 2024-04-21T11:28:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:42 smithi170 ceph-mon[31212]: pgmap v2141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3833.323722 secs 2024-04-21T11:28:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3835.083964 secs 2024-04-21T11:28:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:44 smithi077 ceph-mon[27902]: pgmap v2142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3835.083964 secs 2024-04-21T11:28:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:44 smithi191 ceph-mon[31636]: pgmap v2142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3835.083964 secs 2024-04-21T11:28:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:44 smithi170 ceph-mon[31212]: pgmap v2142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:46 smithi077 ceph-mon[27902]: pgmap v2143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:46 smithi191 ceph-mon[31636]: pgmap v2143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:46 smithi170 ceph-mon[31212]: pgmap v2143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3838.323840 secs 2024-04-21T11:28:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3838.323840 secs 2024-04-21T11:28:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3838.323840 secs 2024-04-21T11:28:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:48 smithi077 ceph-mon[27902]: pgmap v2144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:48 smithi191 ceph-mon[31636]: pgmap v2144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:48 smithi170 ceph-mon[31212]: pgmap v2144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3840.084076 secs 2024-04-21T11:28:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3840.084076 secs 2024-04-21T11:28:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3840.084076 secs 2024-04-21T11:28:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:50 smithi191 ceph-mon[31636]: pgmap v2145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:50 smithi170 ceph-mon[31212]: pgmap v2145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:50 smithi077 ceph-mon[27902]: pgmap v2145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:52 smithi191 ceph-mon[31636]: pgmap v2146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3843.323940 secs 2024-04-21T11:28:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:52 smithi170 ceph-mon[31212]: pgmap v2146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3843.323940 secs 2024-04-21T11:28:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:52 smithi077 ceph-mon[27902]: pgmap v2146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3843.323940 secs 2024-04-21T11:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T11:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T11:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7002a000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7002a000 comp rx=0 tx=0).stop 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.405+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd7003c000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T11:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.419+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000184) for more than 900000000 us, fault. 2024-04-21T11:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T11:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.420+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T11:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.420+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T11:28:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3845.084193 secs 2024-04-21T11:28:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:54 smithi191 ceph-mon[31636]: pgmap v2147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3845.084193 secs 2024-04-21T11:28:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:54 smithi170 ceph-mon[31212]: pgmap v2147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.877+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:28:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.877+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:28:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.877+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:28:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:28:54.877+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:28:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3845.084193 secs 2024-04-21T11:28:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:54 smithi077 ceph-mon[27902]: pgmap v2147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:28:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:28:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:28:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:28:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:56 smithi191 ceph-mon[31636]: pgmap v2148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:28:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:28:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:28:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:56 smithi170 ceph-mon[31212]: pgmap v2148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:28:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:28:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:28:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:56 smithi077 ceph-mon[27902]: pgmap v2148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:28:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:28:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:28:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:28:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3848.324051 secs 2024-04-21T11:28:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3848.324051 secs 2024-04-21T11:28:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3848.324051 secs 2024-04-21T11:28:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:58 smithi191 ceph-mon[31636]: pgmap v2149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:58 smithi170 ceph-mon[31212]: pgmap v2149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:58 smithi077 ceph-mon[27902]: pgmap v2149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:28:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3850.084313 secs 2024-04-21T11:28:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3850.084313 secs 2024-04-21T11:28:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3850.084313 secs 2024-04-21T11:29:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:00 smithi191 ceph-mon[31636]: pgmap v2150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:00 smithi170 ceph-mon[31212]: pgmap v2150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:00 smithi077 ceph-mon[27902]: pgmap v2150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:02 smithi191 ceph-mon[31636]: pgmap v2151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T11:29:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3853.324135 secs 2024-04-21T11:29:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:02 smithi170 ceph-mon[31212]: pgmap v2151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T11:29:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3853.324135 secs 2024-04-21T11:29:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:02 smithi077 ceph-mon[27902]: pgmap v2151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T11:29:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3853.324135 secs 2024-04-21T11:29:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3855.084444 secs 2024-04-21T11:29:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:04 smithi191 ceph-mon[31636]: pgmap v2152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T11:29:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:04 smithi191 ceph-mon[31636]: osdmap e209: 12 total, 12 up, 12 in 2024-04-21T11:29:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3855.084444 secs 2024-04-21T11:29:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:04 smithi170 ceph-mon[31212]: pgmap v2152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T11:29:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:04 smithi170 ceph-mon[31212]: osdmap e209: 12 total, 12 up, 12 in 2024-04-21T11:29:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3855.084444 secs 2024-04-21T11:29:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:04 smithi077 ceph-mon[27902]: pgmap v2152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T11:29:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:04 smithi077 ceph-mon[27902]: osdmap e209: 12 total, 12 up, 12 in 2024-04-21T11:29:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:06 smithi191 ceph-mon[31636]: pgmap v2154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:29:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:06 smithi170 ceph-mon[31212]: pgmap v2154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:29:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:06 smithi077 ceph-mon[27902]: pgmap v2154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:29:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3858.324260 secs 2024-04-21T11:29:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:07 smithi191 ceph-mon[31636]: osdmap e210: 12 total, 12 up, 12 in 2024-04-21T11:29:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:07 smithi191 ceph-mon[31636]: pgmap v2156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3858.324260 secs 2024-04-21T11:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:07 smithi170 ceph-mon[31212]: osdmap e210: 12 total, 12 up, 12 in 2024-04-21T11:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:07 smithi170 ceph-mon[31212]: pgmap v2156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:29:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3858.324260 secs 2024-04-21T11:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:07 smithi077 ceph-mon[27902]: osdmap e210: 12 total, 12 up, 12 in 2024-04-21T11:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:07 smithi077 ceph-mon[27902]: pgmap v2156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:29:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3860.084537 secs 2024-04-21T11:29:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3860.084537 secs 2024-04-21T11:29:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3860.084537 secs 2024-04-21T11:29:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:09 smithi191 ceph-mon[31636]: pgmap v2157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T11:29:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:09 smithi170 ceph-mon[31212]: pgmap v2157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T11:29:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:09 smithi077 ceph-mon[27902]: pgmap v2157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T11:29:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:12 smithi077 ceph-mon[27902]: pgmap v2158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T11:29:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3863.324404 secs 2024-04-21T11:29:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:12 smithi191 ceph-mon[31636]: pgmap v2158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T11:29:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3863.324404 secs 2024-04-21T11:29:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:12 smithi170 ceph-mon[31212]: pgmap v2158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T11:29:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3863.324404 secs 2024-04-21T11:29:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3865.084641 secs 2024-04-21T11:29:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:14 smithi077 ceph-mon[27902]: pgmap v2159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 311 B/s wr, 6 op/s 2024-04-21T11:29:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3865.084641 secs 2024-04-21T11:29:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:14 smithi191 ceph-mon[31636]: pgmap v2159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 311 B/s wr, 6 op/s 2024-04-21T11:29:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3865.084641 secs 2024-04-21T11:29:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:14 smithi170 ceph-mon[31212]: pgmap v2159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 311 B/s wr, 6 op/s 2024-04-21T11:29:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:16 smithi077 ceph-mon[27902]: pgmap v2160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:29:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:16 smithi191 ceph-mon[31636]: pgmap v2160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:29:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:16 smithi170 ceph-mon[31212]: pgmap v2160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:29:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3868.324547 secs 2024-04-21T11:29:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3868.324547 secs 2024-04-21T11:29:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3868.324547 secs 2024-04-21T11:29:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:18 smithi077 ceph-mon[27902]: pgmap v2161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:29:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:18 smithi191 ceph-mon[31636]: pgmap v2161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:29:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:18 smithi170 ceph-mon[31212]: pgmap v2161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:29:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3870.084753 secs 2024-04-21T11:29:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3870.084753 secs 2024-04-21T11:29:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3870.084753 secs 2024-04-21T11:29:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:20 smithi077 ceph-mon[27902]: pgmap v2162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:29:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:20 smithi191 ceph-mon[31636]: pgmap v2162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:29:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:20 smithi170 ceph-mon[31212]: pgmap v2162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:29:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:22 smithi077 ceph-mon[27902]: pgmap v2163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:29:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3873.324664 secs 2024-04-21T11:29:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:22 smithi191 ceph-mon[31636]: pgmap v2163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:29:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3873.324664 secs 2024-04-21T11:29:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:22 smithi170 ceph-mon[31212]: pgmap v2163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:29:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3873.324664 secs 2024-04-21T11:29:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3875.084899 secs 2024-04-21T11:29:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:24 smithi077 ceph-mon[27902]: pgmap v2164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3875.084899 secs 2024-04-21T11:29:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:24 smithi191 ceph-mon[31636]: pgmap v2164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3875.084899 secs 2024-04-21T11:29:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:24 smithi170 ceph-mon[31212]: pgmap v2164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:26 smithi077 ceph-mon[27902]: pgmap v2165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:26 smithi191 ceph-mon[31636]: pgmap v2165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:26 smithi170 ceph-mon[31212]: pgmap v2165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3878.324828 secs 2024-04-21T11:29:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3878.324828 secs 2024-04-21T11:29:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3878.324828 secs 2024-04-21T11:29:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:28 smithi077 ceph-mon[27902]: pgmap v2166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:28 smithi191 ceph-mon[31636]: pgmap v2166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:28 smithi170 ceph-mon[31212]: pgmap v2166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3880.085027 secs 2024-04-21T11:29:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3880.085027 secs 2024-04-21T11:29:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3880.085027 secs 2024-04-21T11:29:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:30 smithi191 ceph-mon[31636]: pgmap v2167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:30 smithi170 ceph-mon[31212]: pgmap v2167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:30 smithi077 ceph-mon[27902]: pgmap v2167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:32 smithi191 ceph-mon[31636]: pgmap v2168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3883.324966 secs 2024-04-21T11:29:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:32 smithi170 ceph-mon[31212]: pgmap v2168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3883.324966 secs 2024-04-21T11:29:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:32 smithi077 ceph-mon[27902]: pgmap v2168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3883.324966 secs 2024-04-21T11:29:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3885.085143 secs 2024-04-21T11:29:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:34 smithi191 ceph-mon[31636]: pgmap v2169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3885.085143 secs 2024-04-21T11:29:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:34 smithi170 ceph-mon[31212]: pgmap v2169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3885.085143 secs 2024-04-21T11:29:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:34 smithi077 ceph-mon[27902]: pgmap v2169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:36 smithi191 ceph-mon[31636]: pgmap v2170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:36 smithi170 ceph-mon[31212]: pgmap v2170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:36 smithi077 ceph-mon[27902]: pgmap v2170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3888.325081 secs 2024-04-21T11:29:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3888.325081 secs 2024-04-21T11:29:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3888.325081 secs 2024-04-21T11:29:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:38 smithi170 ceph-mon[31212]: pgmap v2171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:38 smithi191 ceph-mon[31636]: pgmap v2171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:38 smithi077 ceph-mon[27902]: pgmap v2171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3890.085227 secs 2024-04-21T11:29:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3890.085227 secs 2024-04-21T11:29:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3890.085227 secs 2024-04-21T11:29:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:40 smithi191 ceph-mon[31636]: pgmap v2172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:40 smithi170 ceph-mon[31212]: pgmap v2172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:40 smithi077 ceph-mon[27902]: pgmap v2172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:42 smithi191 ceph-mon[31636]: pgmap v2173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3893.325182 secs 2024-04-21T11:29:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:42 smithi170 ceph-mon[31212]: pgmap v2173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3893.325182 secs 2024-04-21T11:29:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:42 smithi077 ceph-mon[27902]: pgmap v2173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3893.325182 secs 2024-04-21T11:29:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3895.085304 secs 2024-04-21T11:29:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:44 smithi191 ceph-mon[31636]: pgmap v2174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3895.085304 secs 2024-04-21T11:29:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:44 smithi170 ceph-mon[31212]: pgmap v2174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3895.085304 secs 2024-04-21T11:29:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:44 smithi077 ceph-mon[27902]: pgmap v2174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:46 smithi191 ceph-mon[31636]: pgmap v2175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:46 smithi170 ceph-mon[31212]: pgmap v2175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:46 smithi077 ceph-mon[27902]: pgmap v2175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3898.325295 secs 2024-04-21T11:29:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3898.325295 secs 2024-04-21T11:29:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3898.325295 secs 2024-04-21T11:29:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:48 smithi191 ceph-mon[31636]: pgmap v2176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:48 smithi170 ceph-mon[31212]: pgmap v2176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:48 smithi077 ceph-mon[27902]: pgmap v2176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3900.085420 secs 2024-04-21T11:29:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3900.085420 secs 2024-04-21T11:29:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3900.085420 secs 2024-04-21T11:29:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:50 smithi191 ceph-mon[31636]: pgmap v2177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:50 smithi170 ceph-mon[31212]: pgmap v2177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:50 smithi077 ceph-mon[27902]: pgmap v2177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:52 smithi191 ceph-mon[31636]: pgmap v2178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3903.325439 secs 2024-04-21T11:29:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:52 smithi170 ceph-mon[31212]: pgmap v2178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3903.325439 secs 2024-04-21T11:29:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:52 smithi077 ceph-mon[27902]: pgmap v2178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3903.325439 secs 2024-04-21T11:29:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3905.085536 secs 2024-04-21T11:29:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:54 smithi191 ceph-mon[31636]: pgmap v2179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3905.085536 secs 2024-04-21T11:29:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:54 smithi170 ceph-mon[31212]: pgmap v2179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3905.085536 secs 2024-04-21T11:29:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:54 smithi077 ceph-mon[27902]: pgmap v2179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:29:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:56 smithi191 ceph-mon[31636]: pgmap v2180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:29:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:56 smithi170 ceph-mon[31212]: pgmap v2180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:29:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:56 smithi077 ceph-mon[27902]: pgmap v2180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:29:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3908.325508 secs 2024-04-21T11:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3908.325508 secs 2024-04-21T11:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:29:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3908.325508 secs 2024-04-21T11:29:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:29:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:29:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:29:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:58 smithi077 ceph-mon[27902]: pgmap v2181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:58 smithi191 ceph-mon[31636]: pgmap v2181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:58 smithi170 ceph-mon[31212]: pgmap v2181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:29:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3910.085656 secs 2024-04-21T11:29:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3910.085656 secs 2024-04-21T11:30:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3910.085656 secs 2024-04-21T11:30:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:00 smithi077 ceph-mon[27902]: pgmap v2182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:30:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:00 smithi191 ceph-mon[31636]: pgmap v2182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:30:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:00 smithi170 ceph-mon[31212]: pgmap v2182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:30:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:01 smithi191 ceph-mon[31636]: pgmap v2183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T11:30:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:01 smithi170 ceph-mon[31212]: pgmap v2183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T11:30:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:01 smithi077 ceph-mon[27902]: pgmap v2183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T11:30:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3913.325626 secs 2024-04-21T11:30:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3913.325626 secs 2024-04-21T11:30:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3913.325626 secs 2024-04-21T11:30:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:03 smithi191 ceph-mon[31636]: pgmap v2184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-04-21T11:30:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:03 smithi170 ceph-mon[31212]: pgmap v2184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-04-21T11:30:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:03 smithi077 ceph-mon[27902]: pgmap v2184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-04-21T11:30:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3915.085752 secs 2024-04-21T11:30:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:04 smithi191 ceph-mon[31636]: osdmap e211: 12 total, 12 up, 12 in 2024-04-21T11:30:05.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3915.085752 secs 2024-04-21T11:30:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:04 smithi170 ceph-mon[31212]: osdmap e211: 12 total, 12 up, 12 in 2024-04-21T11:30:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3915.085752 secs 2024-04-21T11:30:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:04 smithi077 ceph-mon[27902]: osdmap e211: 12 total, 12 up, 12 in 2024-04-21T11:30:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:05 smithi191 ceph-mon[31636]: pgmap v2186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:30:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:05 smithi170 ceph-mon[31212]: pgmap v2186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:30:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:05 smithi077 ceph-mon[27902]: pgmap v2186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:30:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3918.325697 secs 2024-04-21T11:30:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:07 smithi191 ceph-mon[31636]: osdmap e212: 12 total, 12 up, 12 in 2024-04-21T11:30:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:07 smithi191 ceph-mon[31636]: pgmap v2188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:30:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3918.325697 secs 2024-04-21T11:30:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:07 smithi170 ceph-mon[31212]: osdmap e212: 12 total, 12 up, 12 in 2024-04-21T11:30:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:07 smithi170 ceph-mon[31212]: pgmap v2188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:30:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3918.325697 secs 2024-04-21T11:30:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:07 smithi077 ceph-mon[27902]: osdmap e212: 12 total, 12 up, 12 in 2024-04-21T11:30:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:07 smithi077 ceph-mon[27902]: pgmap v2188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:30:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3920.085898 secs 2024-04-21T11:30:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3920.085898 secs 2024-04-21T11:30:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3920.085898 secs 2024-04-21T11:30:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:09 smithi191 ceph-mon[31636]: pgmap v2189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-21T11:30:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:09 smithi170 ceph-mon[31212]: pgmap v2189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-21T11:30:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:09 smithi077 ceph-mon[27902]: pgmap v2189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-21T11:30:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:12 smithi077 ceph-mon[27902]: pgmap v2190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T11:30:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3923.325755 secs 2024-04-21T11:30:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:12 smithi191 ceph-mon[31636]: pgmap v2190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T11:30:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3923.325755 secs 2024-04-21T11:30:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:12 smithi170 ceph-mon[31212]: pgmap v2190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T11:30:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3923.325755 secs 2024-04-21T11:30:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3925.085955 secs 2024-04-21T11:30:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:14 smithi077 ceph-mon[27902]: pgmap v2191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-04-21T11:30:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3925.085955 secs 2024-04-21T11:30:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:14 smithi191 ceph-mon[31636]: pgmap v2191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-04-21T11:30:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3925.085955 secs 2024-04-21T11:30:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:14 smithi170 ceph-mon[31212]: pgmap v2191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-04-21T11:30:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:16 smithi077 ceph-mon[27902]: pgmap v2192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:30:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:16 smithi191 ceph-mon[31636]: pgmap v2192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:30:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:16 smithi170 ceph-mon[31212]: pgmap v2192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:30:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3928.325867 secs 2024-04-21T11:30:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3928.325867 secs 2024-04-21T11:30:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3928.325867 secs 2024-04-21T11:30:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:18 smithi077 ceph-mon[27902]: pgmap v2193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:30:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:18 smithi191 ceph-mon[31636]: pgmap v2193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:30:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:18 smithi170 ceph-mon[31212]: pgmap v2193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:30:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3930.086040 secs 2024-04-21T11:30:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3930.086040 secs 2024-04-21T11:30:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3930.086040 secs 2024-04-21T11:30:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:20 smithi077 ceph-mon[27902]: pgmap v2194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:30:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:20 smithi191 ceph-mon[31636]: pgmap v2194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:30:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:20 smithi170 ceph-mon[31212]: pgmap v2194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:30:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:22 smithi077 ceph-mon[27902]: pgmap v2195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:30:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3933.325988 secs 2024-04-21T11:30:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:22 smithi191 ceph-mon[31636]: pgmap v2195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:30:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3933.325988 secs 2024-04-21T11:30:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:22 smithi170 ceph-mon[31212]: pgmap v2195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:30:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3933.325988 secs 2024-04-21T11:30:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3935.086166 secs 2024-04-21T11:30:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:24 smithi077 ceph-mon[27902]: pgmap v2196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3935.086166 secs 2024-04-21T11:30:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:24 smithi191 ceph-mon[31636]: pgmap v2196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3935.086166 secs 2024-04-21T11:30:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:24 smithi170 ceph-mon[31212]: pgmap v2196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:26 smithi191 ceph-mon[31636]: pgmap v2197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:26 smithi170 ceph-mon[31212]: pgmap v2197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:26 smithi077 ceph-mon[27902]: pgmap v2197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3938.326089 secs 2024-04-21T11:30:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3938.326089 secs 2024-04-21T11:30:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3938.326089 secs 2024-04-21T11:30:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:28 smithi191 ceph-mon[31636]: pgmap v2198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:28 smithi170 ceph-mon[31212]: pgmap v2198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:28 smithi077 ceph-mon[27902]: pgmap v2198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3940.086281 secs 2024-04-21T11:30:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3940.086281 secs 2024-04-21T11:30:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3940.086281 secs 2024-04-21T11:30:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:30 smithi191 ceph-mon[31636]: pgmap v2199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:30 smithi170 ceph-mon[31212]: pgmap v2199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:30 smithi077 ceph-mon[27902]: pgmap v2199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:32 smithi191 ceph-mon[31636]: pgmap v2200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3943.326169 secs 2024-04-21T11:30:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:32 smithi170 ceph-mon[31212]: pgmap v2200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3943.326169 secs 2024-04-21T11:30:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:32 smithi077 ceph-mon[27902]: pgmap v2200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3943.326169 secs 2024-04-21T11:30:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3945.086360 secs 2024-04-21T11:30:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:34 smithi191 ceph-mon[31636]: pgmap v2201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3945.086360 secs 2024-04-21T11:30:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:34 smithi170 ceph-mon[31212]: pgmap v2201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3945.086360 secs 2024-04-21T11:30:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:34 smithi077 ceph-mon[27902]: pgmap v2201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:36 smithi191 ceph-mon[31636]: pgmap v2202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:36 smithi170 ceph-mon[31212]: pgmap v2202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:36 smithi077 ceph-mon[27902]: pgmap v2202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3948.326246 secs 2024-04-21T11:30:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3948.326246 secs 2024-04-21T11:30:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3948.326246 secs 2024-04-21T11:30:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:38 smithi170 ceph-mon[31212]: pgmap v2203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:38 smithi191 ceph-mon[31636]: pgmap v2203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:38 smithi077 ceph-mon[27902]: pgmap v2203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3950.086499 secs 2024-04-21T11:30:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3950.086499 secs 2024-04-21T11:30:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3950.086499 secs 2024-04-21T11:30:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:40 smithi191 ceph-mon[31636]: pgmap v2204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:40 smithi170 ceph-mon[31212]: pgmap v2204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:40 smithi077 ceph-mon[27902]: pgmap v2204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:42 smithi191 ceph-mon[31636]: pgmap v2205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3953.326325 secs 2024-04-21T11:30:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:42 smithi170 ceph-mon[31212]: pgmap v2205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3953.326325 secs 2024-04-21T11:30:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:42 smithi077 ceph-mon[27902]: pgmap v2205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3953.326325 secs 2024-04-21T11:30:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3955.086600 secs 2024-04-21T11:30:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:44 smithi191 ceph-mon[31636]: pgmap v2206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3955.086600 secs 2024-04-21T11:30:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:44 smithi170 ceph-mon[31212]: pgmap v2206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3955.086600 secs 2024-04-21T11:30:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:44 smithi077 ceph-mon[27902]: pgmap v2206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:46 smithi191 ceph-mon[31636]: pgmap v2207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:46 smithi170 ceph-mon[31212]: pgmap v2207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:46 smithi077 ceph-mon[27902]: pgmap v2207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3958.326458 secs 2024-04-21T11:30:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3958.326458 secs 2024-04-21T11:30:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3958.326458 secs 2024-04-21T11:30:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:48 smithi191 ceph-mon[31636]: pgmap v2208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:48 smithi170 ceph-mon[31212]: pgmap v2208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:48 smithi077 ceph-mon[27902]: pgmap v2208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3960.086703 secs 2024-04-21T11:30:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3960.086703 secs 2024-04-21T11:30:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3960.086703 secs 2024-04-21T11:30:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:50 smithi191 ceph-mon[31636]: pgmap v2209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:50 smithi170 ceph-mon[31212]: pgmap v2209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:50 smithi077 ceph-mon[27902]: pgmap v2209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:52 smithi191 ceph-mon[31636]: pgmap v2210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3963.326572 secs 2024-04-21T11:30:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:52 smithi170 ceph-mon[31212]: pgmap v2210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3963.326572 secs 2024-04-21T11:30:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:52 smithi077 ceph-mon[27902]: pgmap v2210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3963.326572 secs 2024-04-21T11:30:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3965.086818 secs 2024-04-21T11:30:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:54 smithi191 ceph-mon[31636]: pgmap v2211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3965.086818 secs 2024-04-21T11:30:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:54 smithi170 ceph-mon[31212]: pgmap v2211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3965.086818 secs 2024-04-21T11:30:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:54 smithi077 ceph-mon[27902]: pgmap v2211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:30:56.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:56 smithi170 ceph-mon[31212]: pgmap v2212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:56 smithi077 ceph-mon[27902]: pgmap v2212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:56 smithi191 ceph-mon[31636]: pgmap v2212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:30:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3968.326723 secs 2024-04-21T11:30:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:30:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:30:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:30:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:30:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3968.326723 secs 2024-04-21T11:30:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:30:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:30:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:30:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:30:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3968.326723 secs 2024-04-21T11:30:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:30:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:30:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:30:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:30:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:58 smithi170 ceph-mon[31212]: pgmap v2213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:58 smithi077 ceph-mon[27902]: pgmap v2213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:58 smithi191 ceph-mon[31636]: pgmap v2213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:30:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3970.086943 secs 2024-04-21T11:30:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3970.086943 secs 2024-04-21T11:30:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3970.086943 secs 2024-04-21T11:31:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:00 smithi170 ceph-mon[31212]: pgmap v2214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:00 smithi077 ceph-mon[27902]: pgmap v2214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:00 smithi191 ceph-mon[31636]: pgmap v2214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:02 smithi170 ceph-mon[31212]: pgmap v2215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T11:31:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3973.326817 secs 2024-04-21T11:31:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:02 smithi077 ceph-mon[27902]: pgmap v2215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T11:31:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3973.326817 secs 2024-04-21T11:31:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:02 smithi191 ceph-mon[31636]: pgmap v2215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T11:31:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3973.326817 secs 2024-04-21T11:31:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3975.087086 secs 2024-04-21T11:31:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:04 smithi170 ceph-mon[31212]: pgmap v2216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T11:31:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:04 smithi170 ceph-mon[31212]: osdmap e213: 12 total, 12 up, 12 in 2024-04-21T11:31:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3975.087086 secs 2024-04-21T11:31:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:04 smithi077 ceph-mon[27902]: pgmap v2216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T11:31:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:04 smithi077 ceph-mon[27902]: osdmap e213: 12 total, 12 up, 12 in 2024-04-21T11:31:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3975.087086 secs 2024-04-21T11:31:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:04 smithi191 ceph-mon[31636]: pgmap v2216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T11:31:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:04 smithi191 ceph-mon[31636]: osdmap e213: 12 total, 12 up, 12 in 2024-04-21T11:31:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:06 smithi170 ceph-mon[31212]: pgmap v2218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:31:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:06 smithi077 ceph-mon[27902]: pgmap v2218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:31:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:06 smithi191 ceph-mon[31636]: pgmap v2218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:31:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3978.326966 secs 2024-04-21T11:31:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:07 smithi191 ceph-mon[31636]: osdmap e214: 12 total, 12 up, 12 in 2024-04-21T11:31:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:07 smithi191 ceph-mon[31636]: pgmap v2220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3978.326966 secs 2024-04-21T11:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:07 smithi170 ceph-mon[31212]: osdmap e214: 12 total, 12 up, 12 in 2024-04-21T11:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:07 smithi170 ceph-mon[31212]: pgmap v2220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:31:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3978.326966 secs 2024-04-21T11:31:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:07 smithi077 ceph-mon[27902]: osdmap e214: 12 total, 12 up, 12 in 2024-04-21T11:31:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:07 smithi077 ceph-mon[27902]: pgmap v2220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:31:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3980.087157 secs 2024-04-21T11:31:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3980.087157 secs 2024-04-21T11:31:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3980.087157 secs 2024-04-21T11:31:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:09 smithi191 ceph-mon[31636]: pgmap v2221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 42 KiB/s wr, 26 op/s 2024-04-21T11:31:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:09 smithi170 ceph-mon[31212]: pgmap v2221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 42 KiB/s wr, 26 op/s 2024-04-21T11:31:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:09 smithi077 ceph-mon[27902]: pgmap v2221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 42 KiB/s wr, 26 op/s 2024-04-21T11:31:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:12 smithi077 ceph-mon[27902]: pgmap v2222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 KiB/s wr, 30 op/s 2024-04-21T11:31:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3983.327082 secs 2024-04-21T11:31:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:12 smithi191 ceph-mon[31636]: pgmap v2222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 KiB/s wr, 30 op/s 2024-04-21T11:31:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3983.327082 secs 2024-04-21T11:31:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:12 smithi170 ceph-mon[31212]: pgmap v2222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 KiB/s wr, 30 op/s 2024-04-21T11:31:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3983.327082 secs 2024-04-21T11:31:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3985.087273 secs 2024-04-21T11:31:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:14 smithi077 ceph-mon[27902]: pgmap v2223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 25 op/s 2024-04-21T11:31:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3985.087273 secs 2024-04-21T11:31:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:14 smithi191 ceph-mon[31636]: pgmap v2223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 25 op/s 2024-04-21T11:31:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3985.087273 secs 2024-04-21T11:31:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:14 smithi170 ceph-mon[31212]: pgmap v2223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 25 op/s 2024-04-21T11:31:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:16 smithi077 ceph-mon[27902]: pgmap v2224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:31:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:16 smithi191 ceph-mon[31636]: pgmap v2224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:31:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:16 smithi170 ceph-mon[31212]: pgmap v2224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:31:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3988.327206 secs 2024-04-21T11:31:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:17 smithi191 ceph-mon[31636]: pgmap v2225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:31:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3988.327206 secs 2024-04-21T11:31:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:17 smithi170 ceph-mon[31212]: pgmap v2225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:31:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3988.327206 secs 2024-04-21T11:31:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:17 smithi077 ceph-mon[27902]: pgmap v2225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:31:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3990.087333 secs 2024-04-21T11:31:19.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3990.087333 secs 2024-04-21T11:31:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3990.087333 secs 2024-04-21T11:31:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:19 smithi191 ceph-mon[31636]: pgmap v2226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:31:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:19 smithi170 ceph-mon[31212]: pgmap v2226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:31:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:19 smithi077 ceph-mon[27902]: pgmap v2226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:31:22.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:22 smithi077 ceph-mon[27902]: pgmap v2227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:31:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3993.327321 secs 2024-04-21T11:31:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:22 smithi191 ceph-mon[31636]: pgmap v2227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:31:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3993.327321 secs 2024-04-21T11:31:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:22 smithi170 ceph-mon[31212]: pgmap v2227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:31:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3993.327321 secs 2024-04-21T11:31:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 3995.087448 secs 2024-04-21T11:31:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:24 smithi077 ceph-mon[27902]: pgmap v2228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 3995.087448 secs 2024-04-21T11:31:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:24 smithi191 ceph-mon[31636]: pgmap v2228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 3995.087448 secs 2024-04-21T11:31:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:24 smithi170 ceph-mon[31212]: pgmap v2228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:26 smithi077 ceph-mon[27902]: pgmap v2229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:26 smithi191 ceph-mon[31636]: pgmap v2229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:26 smithi170 ceph-mon[31212]: pgmap v2229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 3998.327462 secs 2024-04-21T11:31:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 3998.327462 secs 2024-04-21T11:31:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 3998.327462 secs 2024-04-21T11:31:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:28 smithi077 ceph-mon[27902]: pgmap v2230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:28 smithi191 ceph-mon[31636]: pgmap v2230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:28 smithi170 ceph-mon[31212]: pgmap v2230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4000.087562 secs 2024-04-21T11:31:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4000.087562 secs 2024-04-21T11:31:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4000.087562 secs 2024-04-21T11:31:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:30 smithi191 ceph-mon[31636]: pgmap v2231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:30 smithi170 ceph-mon[31212]: pgmap v2231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:30 smithi077 ceph-mon[27902]: pgmap v2231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:32 smithi191 ceph-mon[31636]: pgmap v2232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4003.327590 secs 2024-04-21T11:31:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:32 smithi170 ceph-mon[31212]: pgmap v2232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4003.327590 secs 2024-04-21T11:31:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:32 smithi077 ceph-mon[27902]: pgmap v2232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4003.327590 secs 2024-04-21T11:31:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4005.087679 secs 2024-04-21T11:31:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:34 smithi191 ceph-mon[31636]: pgmap v2233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4005.087679 secs 2024-04-21T11:31:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:34 smithi170 ceph-mon[31212]: pgmap v2233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4005.087679 secs 2024-04-21T11:31:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:34 smithi077 ceph-mon[27902]: pgmap v2233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:36 smithi191 ceph-mon[31636]: pgmap v2234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:36 smithi170 ceph-mon[31212]: pgmap v2234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:36 smithi077 ceph-mon[27902]: pgmap v2234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4008.327709 secs 2024-04-21T11:31:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4008.327709 secs 2024-04-21T11:31:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4008.327709 secs 2024-04-21T11:31:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:38 smithi170 ceph-mon[31212]: pgmap v2235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:38 smithi191 ceph-mon[31636]: pgmap v2235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:38 smithi077 ceph-mon[27902]: pgmap v2235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4010.087790 secs 2024-04-21T11:31:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4010.087790 secs 2024-04-21T11:31:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4010.087790 secs 2024-04-21T11:31:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:40 smithi191 ceph-mon[31636]: pgmap v2236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:40 smithi170 ceph-mon[31212]: pgmap v2236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:40 smithi077 ceph-mon[27902]: pgmap v2236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:42 smithi191 ceph-mon[31636]: pgmap v2237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4013.327829 secs 2024-04-21T11:31:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:42 smithi170 ceph-mon[31212]: pgmap v2237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4013.327829 secs 2024-04-21T11:31:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:42 smithi077 ceph-mon[27902]: pgmap v2237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4013.327829 secs 2024-04-21T11:31:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4015.087928 secs 2024-04-21T11:31:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:44 smithi191 ceph-mon[31636]: pgmap v2238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4015.087928 secs 2024-04-21T11:31:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:44 smithi170 ceph-mon[31212]: pgmap v2238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4015.087928 secs 2024-04-21T11:31:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:44 smithi077 ceph-mon[27902]: pgmap v2238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:46 smithi191 ceph-mon[31636]: pgmap v2239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:46 smithi170 ceph-mon[31212]: pgmap v2239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:46 smithi077 ceph-mon[27902]: pgmap v2239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4018.327912 secs 2024-04-21T11:31:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4018.327912 secs 2024-04-21T11:31:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4018.327912 secs 2024-04-21T11:31:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:48 smithi191 ceph-mon[31636]: pgmap v2240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:48 smithi170 ceph-mon[31212]: pgmap v2240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:48 smithi077 ceph-mon[27902]: pgmap v2240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4020.088049 secs 2024-04-21T11:31:49.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4020.088049 secs 2024-04-21T11:31:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4020.088049 secs 2024-04-21T11:31:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:50 smithi191 ceph-mon[31636]: pgmap v2241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:50 smithi170 ceph-mon[31212]: pgmap v2241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:50 smithi077 ceph-mon[27902]: pgmap v2241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:52 smithi191 ceph-mon[31636]: pgmap v2242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4023.327995 secs 2024-04-21T11:31:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:52 smithi170 ceph-mon[31212]: pgmap v2242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4023.327995 secs 2024-04-21T11:31:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:52 smithi077 ceph-mon[27902]: pgmap v2242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4023.327995 secs 2024-04-21T11:31:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4025.088176 secs 2024-04-21T11:31:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:54 smithi191 ceph-mon[31636]: pgmap v2243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4025.088176 secs 2024-04-21T11:31:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:54 smithi170 ceph-mon[31212]: pgmap v2243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4025.088176 secs 2024-04-21T11:31:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:54 smithi077 ceph-mon[27902]: pgmap v2243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:31:54.900+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:31:54.900 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:31:54.900+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:31:54.900 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:31:54.901+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:31:54.900 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:31:54.901+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:31:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:31:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:56 smithi191 ceph-mon[31636]: pgmap v2244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:56 smithi170 ceph-mon[31212]: pgmap v2244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:56 smithi077 ceph-mon[27902]: pgmap v2244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:31:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4028.328055 secs 2024-04-21T11:31:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4028.328055 secs 2024-04-21T11:31:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4028.328055 secs 2024-04-21T11:31:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:58 smithi191 ceph-mon[31636]: pgmap v2245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:31:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:31:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:31:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:31:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:58 smithi170 ceph-mon[31212]: pgmap v2245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:31:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:31:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:31:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:31:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:58 smithi077 ceph-mon[27902]: pgmap v2245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:31:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:31:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:31:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:31:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:31:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4030.088270 secs 2024-04-21T11:31:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4030.088270 secs 2024-04-21T11:31:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4030.088270 secs 2024-04-21T11:32:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:00 smithi170 ceph-mon[31212]: pgmap v2246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:00 smithi077 ceph-mon[27902]: pgmap v2246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:00 smithi191 ceph-mon[31636]: pgmap v2246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:02 smithi170 ceph-mon[31212]: pgmap v2247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-04-21T11:32:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4033.328174 secs 2024-04-21T11:32:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:02 smithi077 ceph-mon[27902]: pgmap v2247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-04-21T11:32:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4033.328174 secs 2024-04-21T11:32:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:02 smithi191 ceph-mon[31636]: pgmap v2247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-04-21T11:32:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4033.328174 secs 2024-04-21T11:32:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4035.088343 secs 2024-04-21T11:32:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:04 smithi170 ceph-mon[31212]: pgmap v2248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-04-21T11:32:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:04 smithi170 ceph-mon[31212]: osdmap e215: 12 total, 12 up, 12 in 2024-04-21T11:32:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4035.088343 secs 2024-04-21T11:32:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:04 smithi077 ceph-mon[27902]: pgmap v2248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-04-21T11:32:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:04 smithi077 ceph-mon[27902]: osdmap e215: 12 total, 12 up, 12 in 2024-04-21T11:32:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4035.088343 secs 2024-04-21T11:32:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:04 smithi191 ceph-mon[31636]: pgmap v2248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-04-21T11:32:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:04 smithi191 ceph-mon[31636]: osdmap e215: 12 total, 12 up, 12 in 2024-04-21T11:32:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:06 smithi170 ceph-mon[31212]: pgmap v2250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:32:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:06 smithi077 ceph-mon[27902]: pgmap v2250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:32:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:06 smithi191 ceph-mon[31636]: pgmap v2250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:32:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4038.328280 secs 2024-04-21T11:32:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:07 smithi191 ceph-mon[31636]: osdmap e216: 12 total, 12 up, 12 in 2024-04-21T11:32:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:07 smithi191 ceph-mon[31636]: pgmap v2252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:32:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4038.328280 secs 2024-04-21T11:32:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:07 smithi170 ceph-mon[31212]: osdmap e216: 12 total, 12 up, 12 in 2024-04-21T11:32:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:07 smithi170 ceph-mon[31212]: pgmap v2252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:32:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4038.328280 secs 2024-04-21T11:32:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:07 smithi077 ceph-mon[27902]: osdmap e216: 12 total, 12 up, 12 in 2024-04-21T11:32:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:07 smithi077 ceph-mon[27902]: pgmap v2252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:32:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4040.088426 secs 2024-04-21T11:32:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4040.088426 secs 2024-04-21T11:32:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4040.088426 secs 2024-04-21T11:32:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:09 smithi170 ceph-mon[31212]: pgmap v2253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T11:32:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:09 smithi077 ceph-mon[27902]: pgmap v2253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T11:32:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:09 smithi191 ceph-mon[31636]: pgmap v2253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T11:32:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:12 smithi077 ceph-mon[27902]: pgmap v2254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 33 op/s 2024-04-21T11:32:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4043.328418 secs 2024-04-21T11:32:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:12 smithi191 ceph-mon[31636]: pgmap v2254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 33 op/s 2024-04-21T11:32:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4043.328418 secs 2024-04-21T11:32:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:12 smithi170 ceph-mon[31212]: pgmap v2254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 33 op/s 2024-04-21T11:32:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4043.328418 secs 2024-04-21T11:32:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4045.088547 secs 2024-04-21T11:32:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:14 smithi191 ceph-mon[31636]: pgmap v2255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T11:32:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4045.088547 secs 2024-04-21T11:32:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:14 smithi170 ceph-mon[31212]: pgmap v2255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T11:32:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4045.088547 secs 2024-04-21T11:32:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:14 smithi077 ceph-mon[27902]: pgmap v2255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T11:32:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:16 smithi191 ceph-mon[31636]: pgmap v2256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:32:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:16 smithi170 ceph-mon[31212]: pgmap v2256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:32:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:16 smithi077 ceph-mon[27902]: pgmap v2256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:32:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4048.328527 secs 2024-04-21T11:32:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4048.328527 secs 2024-04-21T11:32:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4048.328527 secs 2024-04-21T11:32:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:18 smithi191 ceph-mon[31636]: pgmap v2257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:32:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:18 smithi170 ceph-mon[31212]: pgmap v2257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:32:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:18 smithi077 ceph-mon[27902]: pgmap v2257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:32:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4050.088670 secs 2024-04-21T11:32:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4050.088670 secs 2024-04-21T11:32:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4050.088670 secs 2024-04-21T11:32:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:20 smithi191 ceph-mon[31636]: pgmap v2258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:32:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:20 smithi170 ceph-mon[31212]: pgmap v2258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:32:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:20 smithi077 ceph-mon[27902]: pgmap v2258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:32:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:22 smithi191 ceph-mon[31636]: pgmap v2259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:32:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4053.328638 secs 2024-04-21T11:32:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:22 smithi170 ceph-mon[31212]: pgmap v2259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:32:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4053.328638 secs 2024-04-21T11:32:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:22 smithi077 ceph-mon[27902]: pgmap v2259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:32:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4053.328638 secs 2024-04-21T11:32:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4055.088791 secs 2024-04-21T11:32:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:24 smithi191 ceph-mon[31636]: pgmap v2260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4055.088791 secs 2024-04-21T11:32:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:24 smithi170 ceph-mon[31212]: pgmap v2260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4055.088791 secs 2024-04-21T11:32:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:24 smithi077 ceph-mon[27902]: pgmap v2260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:26 smithi191 ceph-mon[31636]: pgmap v2261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:26 smithi170 ceph-mon[31212]: pgmap v2261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:26 smithi077 ceph-mon[27902]: pgmap v2261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4058.328780 secs 2024-04-21T11:32:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4058.328780 secs 2024-04-21T11:32:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4058.328780 secs 2024-04-21T11:32:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:28 smithi191 ceph-mon[31636]: pgmap v2262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:28 smithi170 ceph-mon[31212]: pgmap v2262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:28 smithi077 ceph-mon[27902]: pgmap v2262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4060.088905 secs 2024-04-21T11:32:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4060.088905 secs 2024-04-21T11:32:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4060.088905 secs 2024-04-21T11:32:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:30 smithi191 ceph-mon[31636]: pgmap v2263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:30 smithi170 ceph-mon[31212]: pgmap v2263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:30 smithi077 ceph-mon[27902]: pgmap v2263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:32 smithi191 ceph-mon[31636]: pgmap v2264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4063.328846 secs 2024-04-21T11:32:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:32 smithi170 ceph-mon[31212]: pgmap v2264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4063.328846 secs 2024-04-21T11:32:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:32 smithi077 ceph-mon[27902]: pgmap v2264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4063.328846 secs 2024-04-21T11:32:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4065.088971 secs 2024-04-21T11:32:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:34 smithi191 ceph-mon[31636]: pgmap v2265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4065.088971 secs 2024-04-21T11:32:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:34 smithi170 ceph-mon[31212]: pgmap v2265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4065.088971 secs 2024-04-21T11:32:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:34 smithi077 ceph-mon[27902]: pgmap v2265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:36 smithi191 ceph-mon[31636]: pgmap v2266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:36 smithi170 ceph-mon[31212]: pgmap v2266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:36 smithi077 ceph-mon[27902]: pgmap v2266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4068.328984 secs 2024-04-21T11:32:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4068.328984 secs 2024-04-21T11:32:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4068.328984 secs 2024-04-21T11:32:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:38 smithi170 ceph-mon[31212]: pgmap v2267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:38 smithi191 ceph-mon[31636]: pgmap v2267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:38 smithi077 ceph-mon[27902]: pgmap v2267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4070.089047 secs 2024-04-21T11:32:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4070.089047 secs 2024-04-21T11:32:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4070.089047 secs 2024-04-21T11:32:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:40 smithi191 ceph-mon[31636]: pgmap v2268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:40 smithi170 ceph-mon[31212]: pgmap v2268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:40 smithi077 ceph-mon[27902]: pgmap v2268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:42 smithi191 ceph-mon[31636]: pgmap v2269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4073.329056 secs 2024-04-21T11:32:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:42 smithi170 ceph-mon[31212]: pgmap v2269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4073.329056 secs 2024-04-21T11:32:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:42 smithi077 ceph-mon[27902]: pgmap v2269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4073.329056 secs 2024-04-21T11:32:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4075.089162 secs 2024-04-21T11:32:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:44 smithi191 ceph-mon[31636]: pgmap v2270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4075.089162 secs 2024-04-21T11:32:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:44 smithi170 ceph-mon[31212]: pgmap v2270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4075.089162 secs 2024-04-21T11:32:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:44 smithi077 ceph-mon[27902]: pgmap v2270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:46 smithi191 ceph-mon[31636]: pgmap v2271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:46 smithi170 ceph-mon[31212]: pgmap v2271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:46 smithi077 ceph-mon[27902]: pgmap v2271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4078.329178 secs 2024-04-21T11:32:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4078.329178 secs 2024-04-21T11:32:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4078.329178 secs 2024-04-21T11:32:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:48 smithi170 ceph-mon[31212]: pgmap v2272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:48 smithi077 ceph-mon[27902]: pgmap v2272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:48 smithi191 ceph-mon[31636]: pgmap v2272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4080.089273 secs 2024-04-21T11:32:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4080.089273 secs 2024-04-21T11:32:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4080.089273 secs 2024-04-21T11:32:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:50 smithi170 ceph-mon[31212]: pgmap v2273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:50 smithi077 ceph-mon[27902]: pgmap v2273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:50 smithi191 ceph-mon[31636]: pgmap v2273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:52 smithi170 ceph-mon[31212]: pgmap v2274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4083.329319 secs 2024-04-21T11:32:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:52 smithi077 ceph-mon[27902]: pgmap v2274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4083.329319 secs 2024-04-21T11:32:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:52 smithi191 ceph-mon[31636]: pgmap v2274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4083.329319 secs 2024-04-21T11:32:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4085.089429 secs 2024-04-21T11:32:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:54 smithi170 ceph-mon[31212]: pgmap v2275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4085.089429 secs 2024-04-21T11:32:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:54 smithi077 ceph-mon[27902]: pgmap v2275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4085.089429 secs 2024-04-21T11:32:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:54 smithi191 ceph-mon[31636]: pgmap v2275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:32:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:56 smithi170 ceph-mon[31212]: pgmap v2276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:56 smithi077 ceph-mon[27902]: pgmap v2276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:56 smithi191 ceph-mon[31636]: pgmap v2276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:32:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4088.329432 secs 2024-04-21T11:32:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4088.329432 secs 2024-04-21T11:32:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4088.329432 secs 2024-04-21T11:32:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:58 smithi170 ceph-mon[31212]: pgmap v2277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:32:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:58 smithi077 ceph-mon[27902]: pgmap v2277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:32:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:58 smithi191 ceph-mon[31636]: pgmap v2277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:32:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:32:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4090.089563 secs 2024-04-21T11:32:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4090.089563 secs 2024-04-21T11:32:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4090.089563 secs 2024-04-21T11:33:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: pgmap v2278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: pgmap v2278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: pgmap v2278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:33:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:33:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:33:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:02 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:02 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:02 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:02 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:02 smithi170 ceph-mon[31212]: pgmap v2279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4093.329546 secs 2024-04-21T11:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:02 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:02 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:02 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:02 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:02 smithi077 ceph-mon[27902]: pgmap v2279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4093.329546 secs 2024-04-21T11:33:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:02 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:02 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:02 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:02 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:02 smithi191 ceph-mon[31636]: pgmap v2279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4093.329546 secs 2024-04-21T11:33:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4095.089679 secs 2024-04-21T11:33:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:04 smithi170 ceph-mon[31212]: pgmap v2280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:04 smithi170 ceph-mon[31212]: osdmap e217: 12 total, 12 up, 12 in 2024-04-21T11:33:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4095.089679 secs 2024-04-21T11:33:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:04 smithi077 ceph-mon[27902]: pgmap v2280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:04 smithi077 ceph-mon[27902]: osdmap e217: 12 total, 12 up, 12 in 2024-04-21T11:33:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4095.089679 secs 2024-04-21T11:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:04 smithi191 ceph-mon[31636]: pgmap v2280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:04 smithi191 ceph-mon[31636]: osdmap e217: 12 total, 12 up, 12 in 2024-04-21T11:33:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:06 smithi170 ceph-mon[31212]: pgmap v2282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:33:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:06 smithi077 ceph-mon[27902]: pgmap v2282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:33:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:06 smithi191 ceph-mon[31636]: pgmap v2282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4098.329661 secs 2024-04-21T11:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:07 smithi170 ceph-mon[31212]: osdmap e218: 12 total, 12 up, 12 in 2024-04-21T11:33:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:07 smithi170 ceph-mon[31212]: pgmap v2284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:33:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4098.329661 secs 2024-04-21T11:33:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:07 smithi077 ceph-mon[27902]: osdmap e218: 12 total, 12 up, 12 in 2024-04-21T11:33:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:07 smithi077 ceph-mon[27902]: pgmap v2284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:33:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4098.329661 secs 2024-04-21T11:33:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:07 smithi191 ceph-mon[31636]: osdmap e218: 12 total, 12 up, 12 in 2024-04-21T11:33:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:07 smithi191 ceph-mon[31636]: pgmap v2284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:33:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4100.089794 secs 2024-04-21T11:33:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4100.089794 secs 2024-04-21T11:33:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4100.089794 secs 2024-04-21T11:33:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:09 smithi170 ceph-mon[31212]: pgmap v2285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:33:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:09 smithi077 ceph-mon[27902]: pgmap v2285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:33:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:09 smithi191 ceph-mon[31636]: pgmap v2285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:33:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:12 smithi191 ceph-mon[31636]: pgmap v2286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:33:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4103.329798 secs 2024-04-21T11:33:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:12 smithi170 ceph-mon[31212]: pgmap v2286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:33:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4103.329798 secs 2024-04-21T11:33:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:12 smithi077 ceph-mon[27902]: pgmap v2286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:33:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4103.329798 secs 2024-04-21T11:33:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4105.089920 secs 2024-04-21T11:33:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:14 smithi191 ceph-mon[31636]: pgmap v2287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:33:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4105.089920 secs 2024-04-21T11:33:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:14 smithi170 ceph-mon[31212]: pgmap v2287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:33:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4105.089920 secs 2024-04-21T11:33:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:14 smithi077 ceph-mon[27902]: pgmap v2287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:33:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:16 smithi191 ceph-mon[31636]: pgmap v2288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:33:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:16 smithi170 ceph-mon[31212]: pgmap v2288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:33:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:16 smithi077 ceph-mon[27902]: pgmap v2288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:33:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4108.329909 secs 2024-04-21T11:33:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4108.329909 secs 2024-04-21T11:33:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4108.329909 secs 2024-04-21T11:33:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:18 smithi191 ceph-mon[31636]: pgmap v2289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:33:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:18 smithi170 ceph-mon[31212]: pgmap v2289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:33:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:18 smithi077 ceph-mon[27902]: pgmap v2289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:33:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4110.090033 secs 2024-04-21T11:33:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4110.090033 secs 2024-04-21T11:33:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4110.090033 secs 2024-04-21T11:33:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:20 smithi191 ceph-mon[31636]: pgmap v2290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:33:20.801 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:20 smithi077 ceph-mon[27902]: pgmap v2290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:33:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:20 smithi170 ceph-mon[31212]: pgmap v2290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:33:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:22 smithi191 ceph-mon[31636]: pgmap v2291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:33:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4113.330027 secs 2024-04-21T11:33:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:22 smithi170 ceph-mon[31212]: pgmap v2291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:33:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4113.330027 secs 2024-04-21T11:33:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:22 smithi077 ceph-mon[27902]: pgmap v2291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:33:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4113.330027 secs 2024-04-21T11:33:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4115.090098 secs 2024-04-21T11:33:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:24 smithi191 ceph-mon[31636]: pgmap v2292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4115.090098 secs 2024-04-21T11:33:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:24 smithi170 ceph-mon[31212]: pgmap v2292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4115.090098 secs 2024-04-21T11:33:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:24 smithi077 ceph-mon[27902]: pgmap v2292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:26 smithi191 ceph-mon[31636]: pgmap v2293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:26 smithi170 ceph-mon[31212]: pgmap v2293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:26 smithi077 ceph-mon[27902]: pgmap v2293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4118.330157 secs 2024-04-21T11:33:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4118.330157 secs 2024-04-21T11:33:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4118.330157 secs 2024-04-21T11:33:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:28 smithi191 ceph-mon[31636]: pgmap v2294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:28 smithi170 ceph-mon[31212]: pgmap v2294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:28 smithi077 ceph-mon[27902]: pgmap v2294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4120.090175 secs 2024-04-21T11:33:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4120.090175 secs 2024-04-21T11:33:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4120.090175 secs 2024-04-21T11:33:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:30 smithi191 ceph-mon[31636]: pgmap v2295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:30 smithi170 ceph-mon[31212]: pgmap v2295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:30 smithi077 ceph-mon[27902]: pgmap v2295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:32 smithi191 ceph-mon[31636]: pgmap v2296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4123.330235 secs 2024-04-21T11:33:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:32 smithi170 ceph-mon[31212]: pgmap v2296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4123.330235 secs 2024-04-21T11:33:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:32 smithi077 ceph-mon[27902]: pgmap v2296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4123.330235 secs 2024-04-21T11:33:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4125.090239 secs 2024-04-21T11:33:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:34 smithi191 ceph-mon[31636]: pgmap v2297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4125.090239 secs 2024-04-21T11:33:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:34 smithi170 ceph-mon[31212]: pgmap v2297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4125.090239 secs 2024-04-21T11:33:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:34 smithi077 ceph-mon[27902]: pgmap v2297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:36 smithi191 ceph-mon[31636]: pgmap v2298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:36 smithi170 ceph-mon[31212]: pgmap v2298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:36 smithi077 ceph-mon[27902]: pgmap v2298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4128.330298 secs 2024-04-21T11:33:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4128.330298 secs 2024-04-21T11:33:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4128.330298 secs 2024-04-21T11:33:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:38 smithi191 ceph-mon[31636]: pgmap v2299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:38.718 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:38 smithi170 ceph-mon[31212]: pgmap v2299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:38 smithi077 ceph-mon[27902]: pgmap v2299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4130.090354 secs 2024-04-21T11:33:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4130.090354 secs 2024-04-21T11:33:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4130.090354 secs 2024-04-21T11:33:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:40 smithi170 ceph-mon[31212]: pgmap v2300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:40 smithi077 ceph-mon[27902]: pgmap v2300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:40 smithi191 ceph-mon[31636]: pgmap v2300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:42 smithi170 ceph-mon[31212]: pgmap v2301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4133.330377 secs 2024-04-21T11:33:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:42 smithi077 ceph-mon[27902]: pgmap v2301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4133.330377 secs 2024-04-21T11:33:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:42 smithi191 ceph-mon[31636]: pgmap v2301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4133.330377 secs 2024-04-21T11:33:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4135.090486 secs 2024-04-21T11:33:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:44 smithi170 ceph-mon[31212]: pgmap v2302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4135.090486 secs 2024-04-21T11:33:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:44 smithi077 ceph-mon[27902]: pgmap v2302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4135.090486 secs 2024-04-21T11:33:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:44 smithi191 ceph-mon[31636]: pgmap v2302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:46 smithi170 ceph-mon[31212]: pgmap v2303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:46 smithi077 ceph-mon[27902]: pgmap v2303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:46 smithi191 ceph-mon[31636]: pgmap v2303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4138.330492 secs 2024-04-21T11:33:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4138.330492 secs 2024-04-21T11:33:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4138.330492 secs 2024-04-21T11:33:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:48 smithi170 ceph-mon[31212]: pgmap v2304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:48 smithi077 ceph-mon[27902]: pgmap v2304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:48 smithi191 ceph-mon[31636]: pgmap v2304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4140.090629 secs 2024-04-21T11:33:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4140.090629 secs 2024-04-21T11:33:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4140.090629 secs 2024-04-21T11:33:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:50 smithi170 ceph-mon[31212]: pgmap v2305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:50 smithi077 ceph-mon[27902]: pgmap v2305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:50 smithi191 ceph-mon[31636]: pgmap v2305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:52 smithi170 ceph-mon[31212]: pgmap v2306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4143.330603 secs 2024-04-21T11:33:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:52 smithi077 ceph-mon[27902]: pgmap v2306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4143.330603 secs 2024-04-21T11:33:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:52 smithi191 ceph-mon[31636]: pgmap v2306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4143.330603 secs 2024-04-21T11:33:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4145.090742 secs 2024-04-21T11:33:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:54 smithi170 ceph-mon[31212]: pgmap v2307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4145.090742 secs 2024-04-21T11:33:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:54 smithi077 ceph-mon[27902]: pgmap v2307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4145.090742 secs 2024-04-21T11:33:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:54 smithi191 ceph-mon[31636]: pgmap v2307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:33:56.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:56 smithi170 ceph-mon[31212]: pgmap v2308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:56 smithi077 ceph-mon[27902]: pgmap v2308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:56 smithi191 ceph-mon[31636]: pgmap v2308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:33:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4148.330719 secs 2024-04-21T11:33:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4148.330719 secs 2024-04-21T11:33:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4148.330719 secs 2024-04-21T11:33:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:58 smithi170 ceph-mon[31212]: pgmap v2309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:58 smithi077 ceph-mon[27902]: pgmap v2309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:58 smithi191 ceph-mon[31636]: pgmap v2309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:33:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:33:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4150.090873 secs 2024-04-21T11:33:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:33:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4150.090873 secs 2024-04-21T11:33:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:33:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4150.090873 secs 2024-04-21T11:34:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:00 smithi170 ceph-mon[31212]: pgmap v2310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:00 smithi077 ceph-mon[27902]: pgmap v2310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:00 smithi191 ceph-mon[31636]: pgmap v2310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:34:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:34:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:34:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:02 smithi170 ceph-mon[31212]: pgmap v2311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4153.330842 secs 2024-04-21T11:34:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:34:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:34:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:02 smithi077 ceph-mon[27902]: pgmap v2311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4153.330842 secs 2024-04-21T11:34:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:34:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:34:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:02 smithi191 ceph-mon[31636]: pgmap v2311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4153.330842 secs 2024-04-21T11:34:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:34:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:34:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:34:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4155.090981 secs 2024-04-21T11:34:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:04 smithi170 ceph-mon[31212]: pgmap v2312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:04 smithi170 ceph-mon[31212]: osdmap e219: 12 total, 12 up, 12 in 2024-04-21T11:34:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4155.090981 secs 2024-04-21T11:34:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:04 smithi077 ceph-mon[27902]: pgmap v2312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:04 smithi077 ceph-mon[27902]: osdmap e219: 12 total, 12 up, 12 in 2024-04-21T11:34:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4155.090981 secs 2024-04-21T11:34:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:04 smithi191 ceph-mon[31636]: pgmap v2312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:04 smithi191 ceph-mon[31636]: osdmap e219: 12 total, 12 up, 12 in 2024-04-21T11:34:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:06 smithi170 ceph-mon[31212]: pgmap v2314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:34:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:06 smithi077 ceph-mon[27902]: pgmap v2314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:34:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:06 smithi191 ceph-mon[31636]: pgmap v2314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:34:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4158.330937 secs 2024-04-21T11:34:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:07 smithi170 ceph-mon[31212]: osdmap e220: 12 total, 12 up, 12 in 2024-04-21T11:34:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:07 smithi170 ceph-mon[31212]: pgmap v2316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:34:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4158.330937 secs 2024-04-21T11:34:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:07 smithi077 ceph-mon[27902]: osdmap e220: 12 total, 12 up, 12 in 2024-04-21T11:34:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:07 smithi077 ceph-mon[27902]: pgmap v2316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:34:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4158.330937 secs 2024-04-21T11:34:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:07 smithi191 ceph-mon[31636]: osdmap e220: 12 total, 12 up, 12 in 2024-04-21T11:34:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:07 smithi191 ceph-mon[31636]: pgmap v2316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:34:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4160.091078 secs 2024-04-21T11:34:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4160.091078 secs 2024-04-21T11:34:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4160.091078 secs 2024-04-21T11:34:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:09 smithi170 ceph-mon[31212]: pgmap v2317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:34:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:09 smithi077 ceph-mon[27902]: pgmap v2317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:34:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:09 smithi191 ceph-mon[31636]: pgmap v2317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:34:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:12 smithi191 ceph-mon[31636]: pgmap v2318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:34:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4163.331024 secs 2024-04-21T11:34:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:12 smithi170 ceph-mon[31212]: pgmap v2318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:34:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4163.331024 secs 2024-04-21T11:34:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:12 smithi077 ceph-mon[27902]: pgmap v2318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:34:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4163.331024 secs 2024-04-21T11:34:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4165.091213 secs 2024-04-21T11:34:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:14 smithi191 ceph-mon[31636]: pgmap v2319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:34:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4165.091213 secs 2024-04-21T11:34:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:14 smithi170 ceph-mon[31212]: pgmap v2319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:34:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4165.091213 secs 2024-04-21T11:34:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:14 smithi077 ceph-mon[27902]: pgmap v2319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:34:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:16 smithi191 ceph-mon[31636]: pgmap v2320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:34:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:16 smithi170 ceph-mon[31212]: pgmap v2320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:34:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:16 smithi077 ceph-mon[27902]: pgmap v2320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:34:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4168.331123 secs 2024-04-21T11:34:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4168.331123 secs 2024-04-21T11:34:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4168.331123 secs 2024-04-21T11:34:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:18 smithi191 ceph-mon[31636]: pgmap v2321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:34:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:18 smithi170 ceph-mon[31212]: pgmap v2321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:34:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:18 smithi077 ceph-mon[27902]: pgmap v2321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:34:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4170.091327 secs 2024-04-21T11:34:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4170.091327 secs 2024-04-21T11:34:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4170.091327 secs 2024-04-21T11:34:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:20 smithi191 ceph-mon[31636]: pgmap v2322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:34:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:20 smithi170 ceph-mon[31212]: pgmap v2322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:34:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:20 smithi077 ceph-mon[27902]: pgmap v2322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:34:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:22 smithi191 ceph-mon[31636]: pgmap v2323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:34:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4173.331246 secs 2024-04-21T11:34:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:22 smithi170 ceph-mon[31212]: pgmap v2323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:34:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4173.331246 secs 2024-04-21T11:34:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:22 smithi077 ceph-mon[27902]: pgmap v2323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:34:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4173.331246 secs 2024-04-21T11:34:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4175.091448 secs 2024-04-21T11:34:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:24 smithi191 ceph-mon[31636]: pgmap v2324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4175.091448 secs 2024-04-21T11:34:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:24 smithi170 ceph-mon[31212]: pgmap v2324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4175.091448 secs 2024-04-21T11:34:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:24 smithi077 ceph-mon[27902]: pgmap v2324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:26 smithi191 ceph-mon[31636]: pgmap v2325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:26 smithi170 ceph-mon[31212]: pgmap v2325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:26 smithi077 ceph-mon[27902]: pgmap v2325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4178.331324 secs 2024-04-21T11:34:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4178.331324 secs 2024-04-21T11:34:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4178.331324 secs 2024-04-21T11:34:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:28 smithi191 ceph-mon[31636]: pgmap v2326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:28 smithi170 ceph-mon[31212]: pgmap v2326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:28 smithi077 ceph-mon[27902]: pgmap v2326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4180.091559 secs 2024-04-21T11:34:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4180.091559 secs 2024-04-21T11:34:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4180.091559 secs 2024-04-21T11:34:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:30 smithi170 ceph-mon[31212]: pgmap v2327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:30 smithi077 ceph-mon[27902]: pgmap v2327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:30 smithi191 ceph-mon[31636]: pgmap v2327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:32 smithi170 ceph-mon[31212]: pgmap v2328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4183.331439 secs 2024-04-21T11:34:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:32 smithi077 ceph-mon[27902]: pgmap v2328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4183.331439 secs 2024-04-21T11:34:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:32 smithi191 ceph-mon[31636]: pgmap v2328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4183.331439 secs 2024-04-21T11:34:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4185.091670 secs 2024-04-21T11:34:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:34 smithi170 ceph-mon[31212]: pgmap v2329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4185.091670 secs 2024-04-21T11:34:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:34 smithi077 ceph-mon[27902]: pgmap v2329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4185.091670 secs 2024-04-21T11:34:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:34 smithi191 ceph-mon[31636]: pgmap v2329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:36 smithi170 ceph-mon[31212]: pgmap v2330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:36 smithi077 ceph-mon[27902]: pgmap v2330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:36 smithi191 ceph-mon[31636]: pgmap v2330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4188.331558 secs 2024-04-21T11:34:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4188.331558 secs 2024-04-21T11:34:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4188.331558 secs 2024-04-21T11:34:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:38 smithi170 ceph-mon[31212]: pgmap v2331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:38.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:38 smithi191 ceph-mon[31636]: pgmap v2331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:38 smithi077 ceph-mon[27902]: pgmap v2331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4190.091812 secs 2024-04-21T11:34:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4190.091812 secs 2024-04-21T11:34:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4190.091812 secs 2024-04-21T11:34:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:40 smithi170 ceph-mon[31212]: pgmap v2332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:40 smithi077 ceph-mon[27902]: pgmap v2332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:40 smithi191 ceph-mon[31636]: pgmap v2332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:42 smithi170 ceph-mon[31212]: pgmap v2333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4193.331674 secs 2024-04-21T11:34:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:42 smithi077 ceph-mon[27902]: pgmap v2333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4193.331674 secs 2024-04-21T11:34:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:42 smithi191 ceph-mon[31636]: pgmap v2333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4193.331674 secs 2024-04-21T11:34:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4195.091922 secs 2024-04-21T11:34:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:44 smithi170 ceph-mon[31212]: pgmap v2334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4195.091922 secs 2024-04-21T11:34:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:44 smithi077 ceph-mon[27902]: pgmap v2334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4195.091922 secs 2024-04-21T11:34:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:44 smithi191 ceph-mon[31636]: pgmap v2334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:46 smithi170 ceph-mon[31212]: pgmap v2335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:46 smithi077 ceph-mon[27902]: pgmap v2335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:46 smithi191 ceph-mon[31636]: pgmap v2335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4198.331825 secs 2024-04-21T11:34:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4198.331825 secs 2024-04-21T11:34:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4198.331825 secs 2024-04-21T11:34:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:48 smithi170 ceph-mon[31212]: pgmap v2336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:48 smithi077 ceph-mon[27902]: pgmap v2336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:48 smithi191 ceph-mon[31636]: pgmap v2336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4200.092036 secs 2024-04-21T11:34:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4200.092036 secs 2024-04-21T11:34:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4200.092036 secs 2024-04-21T11:34:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:50 smithi170 ceph-mon[31212]: pgmap v2337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:50 smithi077 ceph-mon[27902]: pgmap v2337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:50 smithi191 ceph-mon[31636]: pgmap v2337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:52 smithi170 ceph-mon[31212]: pgmap v2338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4203.331918 secs 2024-04-21T11:34:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:52 smithi077 ceph-mon[27902]: pgmap v2338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4203.331918 secs 2024-04-21T11:34:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:52 smithi191 ceph-mon[31636]: pgmap v2338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4203.331918 secs 2024-04-21T11:34:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4205.092149 secs 2024-04-21T11:34:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:54 smithi170 ceph-mon[31212]: pgmap v2339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4205.092149 secs 2024-04-21T11:34:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:54 smithi077 ceph-mon[27902]: pgmap v2339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:34:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:34:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T11:34:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T11:34:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:34:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:34:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:34:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:34:54.926+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:34:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4205.092149 secs 2024-04-21T11:34:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:54 smithi191 ceph-mon[31636]: pgmap v2339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:34:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:56 smithi170 ceph-mon[31212]: pgmap v2340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:56 smithi077 ceph-mon[27902]: pgmap v2340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:56 smithi191 ceph-mon[31636]: pgmap v2340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:34:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4208.332033 secs 2024-04-21T11:34:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4208.332033 secs 2024-04-21T11:34:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4208.332033 secs 2024-04-21T11:34:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:58 smithi170 ceph-mon[31212]: pgmap v2341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:58 smithi077 ceph-mon[27902]: pgmap v2341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:58 smithi191 ceph-mon[31636]: pgmap v2341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:34:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4210.092272 secs 2024-04-21T11:34:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4210.092272 secs 2024-04-21T11:34:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4210.092272 secs 2024-04-21T11:35:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:00 smithi170 ceph-mon[31212]: pgmap v2342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:00 smithi077 ceph-mon[27902]: pgmap v2342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:00 smithi191 ceph-mon[31636]: pgmap v2342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:02 smithi170 ceph-mon[31212]: pgmap v2343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4213.332150 secs 2024-04-21T11:35:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:35:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:02 smithi077 ceph-mon[27902]: pgmap v2343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4213.332150 secs 2024-04-21T11:35:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:35:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:02 smithi191 ceph-mon[31636]: pgmap v2343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4213.332150 secs 2024-04-21T11:35:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:35:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:35:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:35:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:35:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:35:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4215.092418 secs 2024-04-21T11:35:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:04 smithi191 ceph-mon[31636]: pgmap v2344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:04 smithi191 ceph-mon[31636]: osdmap e221: 12 total, 12 up, 12 in 2024-04-21T11:35:05.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4215.092418 secs 2024-04-21T11:35:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:04 smithi170 ceph-mon[31212]: pgmap v2344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:04 smithi170 ceph-mon[31212]: osdmap e221: 12 total, 12 up, 12 in 2024-04-21T11:35:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4215.092418 secs 2024-04-21T11:35:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:04 smithi077 ceph-mon[27902]: pgmap v2344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:04 smithi077 ceph-mon[27902]: osdmap e221: 12 total, 12 up, 12 in 2024-04-21T11:35:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:06 smithi191 ceph-mon[31636]: pgmap v2346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:35:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:06 smithi170 ceph-mon[31212]: pgmap v2346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:35:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:06 smithi077 ceph-mon[27902]: pgmap v2346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:35:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4218.332294 secs 2024-04-21T11:35:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:08 smithi170 ceph-mon[31212]: osdmap e222: 12 total, 12 up, 12 in 2024-04-21T11:35:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:08 smithi170 ceph-mon[31212]: pgmap v2348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:35:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4218.332294 secs 2024-04-21T11:35:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:08 smithi077 ceph-mon[27902]: osdmap e222: 12 total, 12 up, 12 in 2024-04-21T11:35:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:08 smithi077 ceph-mon[27902]: pgmap v2348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:35:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4218.332294 secs 2024-04-21T11:35:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:08 smithi191 ceph-mon[31636]: osdmap e222: 12 total, 12 up, 12 in 2024-04-21T11:35:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:08 smithi191 ceph-mon[31636]: pgmap v2348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:35:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4220.092552 secs 2024-04-21T11:35:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4220.092552 secs 2024-04-21T11:35:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4220.092552 secs 2024-04-21T11:35:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:10 smithi170 ceph-mon[31212]: pgmap v2349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:35:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:10 smithi077 ceph-mon[27902]: pgmap v2349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:35:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:10 smithi191 ceph-mon[31636]: pgmap v2349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:35:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:12 smithi191 ceph-mon[31636]: pgmap v2350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:35:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4223.332414 secs 2024-04-21T11:35:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:12 smithi170 ceph-mon[31212]: pgmap v2350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:35:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4223.332414 secs 2024-04-21T11:35:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:12 smithi077 ceph-mon[27902]: pgmap v2350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:35:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4223.332414 secs 2024-04-21T11:35:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4225.092665 secs 2024-04-21T11:35:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:14 smithi191 ceph-mon[31636]: pgmap v2351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:35:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4225.092665 secs 2024-04-21T11:35:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:14 smithi170 ceph-mon[31212]: pgmap v2351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:35:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4225.092665 secs 2024-04-21T11:35:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:14 smithi077 ceph-mon[27902]: pgmap v2351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:35:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:16 smithi191 ceph-mon[31636]: pgmap v2352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:35:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:16 smithi170 ceph-mon[31212]: pgmap v2352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:35:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:16 smithi077 ceph-mon[27902]: pgmap v2352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:35:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4228.332538 secs 2024-04-21T11:35:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:18 smithi170 ceph-mon[31212]: pgmap v2353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:35:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4228.332538 secs 2024-04-21T11:35:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:18 smithi077 ceph-mon[27902]: pgmap v2353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:35:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4228.332538 secs 2024-04-21T11:35:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:18 smithi191 ceph-mon[31636]: pgmap v2353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:35:19.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4230.092808 secs 2024-04-21T11:35:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4230.092808 secs 2024-04-21T11:35:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4230.092808 secs 2024-04-21T11:35:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:20 smithi170 ceph-mon[31212]: pgmap v2354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:35:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:20 smithi077 ceph-mon[27902]: pgmap v2354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:35:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:20 smithi191 ceph-mon[31636]: pgmap v2354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:35:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:22 smithi191 ceph-mon[31636]: pgmap v2355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4233.332670 secs 2024-04-21T11:35:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:22 smithi170 ceph-mon[31212]: pgmap v2355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:35:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4233.332670 secs 2024-04-21T11:35:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:22 smithi077 ceph-mon[27902]: pgmap v2355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:35:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4233.332670 secs 2024-04-21T11:35:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4235.092930 secs 2024-04-21T11:35:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:24 smithi191 ceph-mon[31636]: pgmap v2356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4235.092930 secs 2024-04-21T11:35:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:24 smithi170 ceph-mon[31212]: pgmap v2356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4235.092930 secs 2024-04-21T11:35:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:24 smithi077 ceph-mon[27902]: pgmap v2356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:26 smithi191 ceph-mon[31636]: pgmap v2357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:26 smithi170 ceph-mon[31212]: pgmap v2357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:26 smithi077 ceph-mon[27902]: pgmap v2357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4238.332793 secs 2024-04-21T11:35:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4238.332793 secs 2024-04-21T11:35:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4238.332793 secs 2024-04-21T11:35:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:28 smithi191 ceph-mon[31636]: pgmap v2358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:28 smithi170 ceph-mon[31212]: pgmap v2358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:28 smithi077 ceph-mon[27902]: pgmap v2358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4240.093017 secs 2024-04-21T11:35:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4240.093017 secs 2024-04-21T11:35:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4240.093017 secs 2024-04-21T11:35:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:30 smithi191 ceph-mon[31636]: pgmap v2359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:30 smithi170 ceph-mon[31212]: pgmap v2359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:30 smithi077 ceph-mon[27902]: pgmap v2359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:32 smithi191 ceph-mon[31636]: pgmap v2360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4243.332861 secs 2024-04-21T11:35:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:32 smithi170 ceph-mon[31212]: pgmap v2360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4243.332861 secs 2024-04-21T11:35:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:32 smithi077 ceph-mon[27902]: pgmap v2360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4243.332861 secs 2024-04-21T11:35:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4245.093097 secs 2024-04-21T11:35:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:34 smithi191 ceph-mon[31636]: pgmap v2361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4245.093097 secs 2024-04-21T11:35:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:34 smithi170 ceph-mon[31212]: pgmap v2361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4245.093097 secs 2024-04-21T11:35:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:34 smithi077 ceph-mon[27902]: pgmap v2361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:36 smithi170 ceph-mon[31212]: pgmap v2362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:36 smithi077 ceph-mon[27902]: pgmap v2362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:36 smithi191 ceph-mon[31636]: pgmap v2362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4248.332954 secs 2024-04-21T11:35:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4248.332954 secs 2024-04-21T11:35:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4248.332954 secs 2024-04-21T11:35:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:38 smithi170 ceph-mon[31212]: pgmap v2363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:38.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:38 smithi191 ceph-mon[31636]: pgmap v2363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:38 smithi077 ceph-mon[27902]: pgmap v2363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4250.093210 secs 2024-04-21T11:35:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4250.093210 secs 2024-04-21T11:35:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4250.093210 secs 2024-04-21T11:35:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:40 smithi170 ceph-mon[31212]: pgmap v2364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:40 smithi077 ceph-mon[27902]: pgmap v2364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:40 smithi191 ceph-mon[31636]: pgmap v2364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:42 smithi170 ceph-mon[31212]: pgmap v2365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4253.333074 secs 2024-04-21T11:35:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:42 smithi077 ceph-mon[27902]: pgmap v2365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4253.333074 secs 2024-04-21T11:35:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:42 smithi191 ceph-mon[31636]: pgmap v2365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4253.333074 secs 2024-04-21T11:35:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4255.093329 secs 2024-04-21T11:35:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:44 smithi170 ceph-mon[31212]: pgmap v2366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4255.093329 secs 2024-04-21T11:35:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:44 smithi077 ceph-mon[27902]: pgmap v2366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4255.093329 secs 2024-04-21T11:35:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:44 smithi191 ceph-mon[31636]: pgmap v2366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:46 smithi170 ceph-mon[31212]: pgmap v2367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:46 smithi077 ceph-mon[27902]: pgmap v2367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:46 smithi191 ceph-mon[31636]: pgmap v2367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4258.333170 secs 2024-04-21T11:35:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:48 smithi170 ceph-mon[31212]: pgmap v2368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4258.333170 secs 2024-04-21T11:35:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:48 smithi077 ceph-mon[27902]: pgmap v2368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4258.333170 secs 2024-04-21T11:35:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:48 smithi191 ceph-mon[31636]: pgmap v2368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:49.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4260.093445 secs 2024-04-21T11:35:49.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4260.093445 secs 2024-04-21T11:35:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4260.093445 secs 2024-04-21T11:35:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:50 smithi170 ceph-mon[31212]: pgmap v2369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:50 smithi077 ceph-mon[27902]: pgmap v2369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:50 smithi191 ceph-mon[31636]: pgmap v2369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:52 smithi191 ceph-mon[31636]: pgmap v2370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4263.333298 secs 2024-04-21T11:35:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:52 smithi170 ceph-mon[31212]: pgmap v2370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4263.333298 secs 2024-04-21T11:35:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:52 smithi077 ceph-mon[27902]: pgmap v2370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4263.333298 secs 2024-04-21T11:35:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4265.093557 secs 2024-04-21T11:35:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:54 smithi191 ceph-mon[31636]: pgmap v2371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4265.093557 secs 2024-04-21T11:35:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:54 smithi170 ceph-mon[31212]: pgmap v2371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4265.093557 secs 2024-04-21T11:35:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:54 smithi077 ceph-mon[27902]: pgmap v2371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:35:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:56 smithi191 ceph-mon[31636]: pgmap v2372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:56.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:56 smithi170 ceph-mon[31212]: pgmap v2372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:56 smithi077 ceph-mon[27902]: pgmap v2372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:35:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4268.333438 secs 2024-04-21T11:35:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4268.333438 secs 2024-04-21T11:35:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4268.333438 secs 2024-04-21T11:35:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:58 smithi191 ceph-mon[31636]: pgmap v2373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:58 smithi170 ceph-mon[31212]: pgmap v2373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:58 smithi077 ceph-mon[27902]: pgmap v2373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:35:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4270.093674 secs 2024-04-21T11:35:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4270.093674 secs 2024-04-21T11:35:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4270.093674 secs 2024-04-21T11:36:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:00 smithi170 ceph-mon[31212]: pgmap v2374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:00 smithi077 ceph-mon[27902]: pgmap v2374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:00 smithi191 ceph-mon[31636]: pgmap v2374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:02.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:02 smithi170 ceph-mon[31212]: pgmap v2375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4273.333599 secs 2024-04-21T11:36:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:02 smithi077 ceph-mon[27902]: pgmap v2375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4273.333599 secs 2024-04-21T11:36:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:02 smithi191 ceph-mon[31636]: pgmap v2375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4273.333599 secs 2024-04-21T11:36:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:36:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:36:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4275.093787 secs 2024-04-21T11:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:04 smithi170 ceph-mon[31212]: pgmap v2376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:04 smithi170 ceph-mon[31212]: osdmap e223: 12 total, 12 up, 12 in 2024-04-21T11:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:36:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:36:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4275.093787 secs 2024-04-21T11:36:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:04 smithi077 ceph-mon[27902]: pgmap v2376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:04 smithi077 ceph-mon[27902]: osdmap e223: 12 total, 12 up, 12 in 2024-04-21T11:36:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:36:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:36:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:36:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4275.093787 secs 2024-04-21T11:36:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:04 smithi191 ceph-mon[31636]: pgmap v2376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:04 smithi191 ceph-mon[31636]: osdmap e223: 12 total, 12 up, 12 in 2024-04-21T11:36:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:36:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:36:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:36:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:06.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:06 smithi170 ceph-mon[31212]: pgmap v2378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:36:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:06 smithi077 ceph-mon[27902]: pgmap v2378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:36:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:06 smithi191 ceph-mon[31636]: pgmap v2378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:36:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4278.333692 secs 2024-04-21T11:36:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:08 smithi170 ceph-mon[31212]: osdmap e224: 12 total, 12 up, 12 in 2024-04-21T11:36:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:08 smithi170 ceph-mon[31212]: pgmap v2380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:36:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4278.333692 secs 2024-04-21T11:36:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:08 smithi077 ceph-mon[27902]: osdmap e224: 12 total, 12 up, 12 in 2024-04-21T11:36:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:08 smithi077 ceph-mon[27902]: pgmap v2380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:36:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4278.333692 secs 2024-04-21T11:36:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:08 smithi191 ceph-mon[31636]: osdmap e224: 12 total, 12 up, 12 in 2024-04-21T11:36:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:08 smithi191 ceph-mon[31636]: pgmap v2380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4280.093930 secs 2024-04-21T11:36:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4280.093930 secs 2024-04-21T11:36:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4280.093930 secs 2024-04-21T11:36:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:10 smithi170 ceph-mon[31212]: pgmap v2381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:36:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:10 smithi077 ceph-mon[27902]: pgmap v2381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:36:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:10 smithi191 ceph-mon[31636]: pgmap v2381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:36:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:12 smithi191 ceph-mon[31636]: pgmap v2382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:36:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4283.333786 secs 2024-04-21T11:36:12.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:12 smithi170 ceph-mon[31212]: pgmap v2382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:36:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4283.333786 secs 2024-04-21T11:36:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:12 smithi077 ceph-mon[27902]: pgmap v2382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:36:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4283.333786 secs 2024-04-21T11:36:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4285.094053 secs 2024-04-21T11:36:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:14 smithi191 ceph-mon[31636]: pgmap v2383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:36:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4285.094053 secs 2024-04-21T11:36:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:14 smithi170 ceph-mon[31212]: pgmap v2383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:36:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4285.094053 secs 2024-04-21T11:36:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:14 smithi077 ceph-mon[27902]: pgmap v2383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:36:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:16 smithi191 ceph-mon[31636]: pgmap v2384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:36:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:16 smithi170 ceph-mon[31212]: pgmap v2384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:36:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:16 smithi077 ceph-mon[27902]: pgmap v2384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:36:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4288.333854 secs 2024-04-21T11:36:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4288.333854 secs 2024-04-21T11:36:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4288.333854 secs 2024-04-21T11:36:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:18 smithi191 ceph-mon[31636]: pgmap v2385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:36:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:18 smithi170 ceph-mon[31212]: pgmap v2385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:36:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:18 smithi077 ceph-mon[27902]: pgmap v2385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:36:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4290.094165 secs 2024-04-21T11:36:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4290.094165 secs 2024-04-21T11:36:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4290.094165 secs 2024-04-21T11:36:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:20 smithi170 ceph-mon[31212]: pgmap v2386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:36:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:20 smithi077 ceph-mon[27902]: pgmap v2386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:36:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:20 smithi191 ceph-mon[31636]: pgmap v2386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:36:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:22 smithi170 ceph-mon[31212]: pgmap v2387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:36:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4293.333938 secs 2024-04-21T11:36:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:22 smithi077 ceph-mon[27902]: pgmap v2387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:36:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4293.333938 secs 2024-04-21T11:36:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:22 smithi191 ceph-mon[31636]: pgmap v2387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:36:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4293.333938 secs 2024-04-21T11:36:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4295.094288 secs 2024-04-21T11:36:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:24 smithi170 ceph-mon[31212]: pgmap v2388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4295.094288 secs 2024-04-21T11:36:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:24 smithi077 ceph-mon[27902]: pgmap v2388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4295.094288 secs 2024-04-21T11:36:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:24 smithi191 ceph-mon[31636]: pgmap v2388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:26.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:26 smithi170 ceph-mon[31212]: pgmap v2389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:26 smithi077 ceph-mon[27902]: pgmap v2389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:26 smithi191 ceph-mon[31636]: pgmap v2389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4298.334003 secs 2024-04-21T11:36:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4298.334003 secs 2024-04-21T11:36:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4298.334003 secs 2024-04-21T11:36:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:28 smithi170 ceph-mon[31212]: pgmap v2390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:28 smithi077 ceph-mon[27902]: pgmap v2390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:28 smithi191 ceph-mon[31636]: pgmap v2390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4300.094418 secs 2024-04-21T11:36:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4300.094418 secs 2024-04-21T11:36:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4300.094418 secs 2024-04-21T11:36:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:30 smithi170 ceph-mon[31212]: pgmap v2391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:30 smithi077 ceph-mon[27902]: pgmap v2391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:30 smithi191 ceph-mon[31636]: pgmap v2391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:32 smithi170 ceph-mon[31212]: pgmap v2392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4303.334124 secs 2024-04-21T11:36:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:32 smithi077 ceph-mon[27902]: pgmap v2392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4303.334124 secs 2024-04-21T11:36:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:32 smithi191 ceph-mon[31636]: pgmap v2392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4303.334124 secs 2024-04-21T11:36:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4305.094535 secs 2024-04-21T11:36:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:34 smithi170 ceph-mon[31212]: pgmap v2393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4305.094535 secs 2024-04-21T11:36:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:34 smithi077 ceph-mon[27902]: pgmap v2393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4305.094535 secs 2024-04-21T11:36:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:34 smithi191 ceph-mon[31636]: pgmap v2393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:36 smithi170 ceph-mon[31212]: pgmap v2394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:36 smithi077 ceph-mon[27902]: pgmap v2394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:36 smithi191 ceph-mon[31636]: pgmap v2394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4308.334275 secs 2024-04-21T11:36:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4308.334275 secs 2024-04-21T11:36:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4308.334275 secs 2024-04-21T11:36:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:38 smithi170 ceph-mon[31212]: pgmap v2395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:38.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:38 smithi191 ceph-mon[31636]: pgmap v2395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:38 smithi077 ceph-mon[27902]: pgmap v2395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4310.094653 secs 2024-04-21T11:36:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4310.094653 secs 2024-04-21T11:36:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4310.094653 secs 2024-04-21T11:36:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:40 smithi170 ceph-mon[31212]: pgmap v2396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:40 smithi077 ceph-mon[27902]: pgmap v2396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:40 smithi191 ceph-mon[31636]: pgmap v2396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:42 smithi170 ceph-mon[31212]: pgmap v2397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4313.334346 secs 2024-04-21T11:36:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:42 smithi077 ceph-mon[27902]: pgmap v2397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4313.334346 secs 2024-04-21T11:36:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:42 smithi191 ceph-mon[31636]: pgmap v2397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4313.334346 secs 2024-04-21T11:36:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4315.094772 secs 2024-04-21T11:36:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:44 smithi170 ceph-mon[31212]: pgmap v2398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4315.094772 secs 2024-04-21T11:36:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:44 smithi077 ceph-mon[27902]: pgmap v2398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4315.094772 secs 2024-04-21T11:36:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:44 smithi191 ceph-mon[31636]: pgmap v2398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:36:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:46.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:46 smithi170 ceph-mon[31212]: pgmap v2399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:46 smithi077 ceph-mon[27902]: pgmap v2399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:46 smithi191 ceph-mon[31636]: pgmap v2399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4318.334462 secs 2024-04-21T11:36:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4318.334462 secs 2024-04-21T11:36:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4318.334462 secs 2024-04-21T11:36:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:48 smithi170 ceph-mon[31212]: pgmap v2400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:48 smithi077 ceph-mon[27902]: pgmap v2400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:48 smithi191 ceph-mon[31636]: pgmap v2400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4320.094904 secs 2024-04-21T11:36:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4320.094904 secs 2024-04-21T11:36:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4320.094904 secs 2024-04-21T11:36:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:50 smithi170 ceph-mon[31212]: pgmap v2401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:50 smithi077 ceph-mon[27902]: pgmap v2401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:50 smithi191 ceph-mon[31636]: pgmap v2401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:52 smithi170 ceph-mon[31212]: pgmap v2402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4323.334597 secs 2024-04-21T11:36:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:52 smithi077 ceph-mon[27902]: pgmap v2402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4323.334597 secs 2024-04-21T11:36:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:52 smithi191 ceph-mon[31636]: pgmap v2402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4323.334597 secs 2024-04-21T11:36:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4325.094981 secs 2024-04-21T11:36:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:54 smithi170 ceph-mon[31212]: pgmap v2403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4325.094981 secs 2024-04-21T11:36:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:54 smithi077 ceph-mon[27902]: pgmap v2403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4325.094981 secs 2024-04-21T11:36:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:54 smithi191 ceph-mon[31636]: pgmap v2403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:36:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:56 smithi077 ceph-mon[27902]: pgmap v2404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:56 smithi191 ceph-mon[31636]: pgmap v2404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:56 smithi170 ceph-mon[31212]: pgmap v2404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:36:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4328.334710 secs 2024-04-21T11:36:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4328.334710 secs 2024-04-21T11:36:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4328.334710 secs 2024-04-21T11:36:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:58 smithi077 ceph-mon[27902]: pgmap v2405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:58 smithi191 ceph-mon[31636]: pgmap v2405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:58 smithi170 ceph-mon[31212]: pgmap v2405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:36:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:36:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4330.095099 secs 2024-04-21T11:36:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:36:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4330.095099 secs 2024-04-21T11:37:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:36:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4330.095099 secs 2024-04-21T11:37:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:00 smithi077 ceph-mon[27902]: pgmap v2406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:00 smithi191 ceph-mon[31636]: pgmap v2406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:00 smithi170 ceph-mon[31212]: pgmap v2406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:02 smithi077 ceph-mon[27902]: pgmap v2407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4333.334822 secs 2024-04-21T11:37:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:02 smithi191 ceph-mon[31636]: pgmap v2407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4333.334822 secs 2024-04-21T11:37:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:02 smithi170 ceph-mon[31212]: pgmap v2407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4333.334822 secs 2024-04-21T11:37:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4335.095202 secs 2024-04-21T11:37:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:04 smithi077 ceph-mon[27902]: pgmap v2408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:04 smithi077 ceph-mon[27902]: osdmap e225: 12 total, 12 up, 12 in 2024-04-21T11:37:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:37:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4335.095202 secs 2024-04-21T11:37:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:04 smithi191 ceph-mon[31636]: pgmap v2408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:04 smithi191 ceph-mon[31636]: osdmap e225: 12 total, 12 up, 12 in 2024-04-21T11:37:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4335.095202 secs 2024-04-21T11:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:04 smithi170 ceph-mon[31212]: pgmap v2408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:04 smithi170 ceph-mon[31212]: osdmap e225: 12 total, 12 up, 12 in 2024-04-21T11:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:37:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:37:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:37:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:37:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:37:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:37:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:37:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:37:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:37:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:37:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:06 smithi077 ceph-mon[27902]: pgmap v2410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:37:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:06 smithi191 ceph-mon[31636]: pgmap v2410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:37:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:06 smithi170 ceph-mon[31212]: pgmap v2410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:37:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4338.334955 secs 2024-04-21T11:37:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:08 smithi170 ceph-mon[31212]: osdmap e226: 12 total, 12 up, 12 in 2024-04-21T11:37:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:08 smithi170 ceph-mon[31212]: pgmap v2412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:37:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4338.334955 secs 2024-04-21T11:37:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:08 smithi077 ceph-mon[27902]: osdmap e226: 12 total, 12 up, 12 in 2024-04-21T11:37:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:08 smithi077 ceph-mon[27902]: pgmap v2412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:37:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4338.334955 secs 2024-04-21T11:37:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:08 smithi191 ceph-mon[31636]: osdmap e226: 12 total, 12 up, 12 in 2024-04-21T11:37:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:08 smithi191 ceph-mon[31636]: pgmap v2412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:37:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4340.095334 secs 2024-04-21T11:37:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4340.095334 secs 2024-04-21T11:37:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4340.095334 secs 2024-04-21T11:37:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:10 smithi170 ceph-mon[31212]: pgmap v2413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:37:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:10 smithi077 ceph-mon[27902]: pgmap v2413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:37:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:10 smithi191 ceph-mon[31636]: pgmap v2413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:37:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:12 smithi170 ceph-mon[31212]: pgmap v2414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:37:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4343.335075 secs 2024-04-21T11:37:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:12 smithi077 ceph-mon[27902]: pgmap v2414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:37:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4343.335075 secs 2024-04-21T11:37:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:12 smithi191 ceph-mon[31636]: pgmap v2414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:37:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4343.335075 secs 2024-04-21T11:37:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4345.095452 secs 2024-04-21T11:37:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:14 smithi170 ceph-mon[31212]: pgmap v2415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:37:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4345.095452 secs 2024-04-21T11:37:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:14 smithi077 ceph-mon[27902]: pgmap v2415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:37:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4345.095452 secs 2024-04-21T11:37:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:14 smithi191 ceph-mon[31636]: pgmap v2415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:37:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:16 smithi170 ceph-mon[31212]: pgmap v2416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:37:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:16 smithi077 ceph-mon[27902]: pgmap v2416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:37:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:16 smithi191 ceph-mon[31636]: pgmap v2416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:37:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4348.335197 secs 2024-04-21T11:37:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4348.335197 secs 2024-04-21T11:37:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4348.335197 secs 2024-04-21T11:37:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:18 smithi170 ceph-mon[31212]: pgmap v2417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:37:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:18 smithi077 ceph-mon[27902]: pgmap v2417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:37:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:18 smithi191 ceph-mon[31636]: pgmap v2417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:37:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4350.095569 secs 2024-04-21T11:37:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4350.095569 secs 2024-04-21T11:37:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4350.095569 secs 2024-04-21T11:37:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:20 smithi170 ceph-mon[31212]: pgmap v2418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:37:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:20 smithi077 ceph-mon[27902]: pgmap v2418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:37:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:20 smithi191 ceph-mon[31636]: pgmap v2418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:37:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:22 smithi170 ceph-mon[31212]: pgmap v2419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:37:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4353.335284 secs 2024-04-21T11:37:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:22 smithi077 ceph-mon[27902]: pgmap v2419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:37:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4353.335284 secs 2024-04-21T11:37:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:22 smithi191 ceph-mon[31636]: pgmap v2419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:37:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4353.335284 secs 2024-04-21T11:37:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4355.095685 secs 2024-04-21T11:37:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:24 smithi170 ceph-mon[31212]: pgmap v2420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4355.095685 secs 2024-04-21T11:37:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:24 smithi077 ceph-mon[27902]: pgmap v2420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4355.095685 secs 2024-04-21T11:37:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:24 smithi191 ceph-mon[31636]: pgmap v2420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:26 smithi170 ceph-mon[31212]: pgmap v2421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:26 smithi077 ceph-mon[27902]: pgmap v2421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:26 smithi191 ceph-mon[31636]: pgmap v2421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4358.335388 secs 2024-04-21T11:37:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4358.335388 secs 2024-04-21T11:37:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4358.335388 secs 2024-04-21T11:37:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:28 smithi170 ceph-mon[31212]: pgmap v2422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:28 smithi077 ceph-mon[27902]: pgmap v2422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:28 smithi191 ceph-mon[31636]: pgmap v2422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4360.095816 secs 2024-04-21T11:37:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4360.095816 secs 2024-04-21T11:37:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4360.095816 secs 2024-04-21T11:37:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:30 smithi170 ceph-mon[31212]: pgmap v2423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:30 smithi077 ceph-mon[27902]: pgmap v2423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:30 smithi191 ceph-mon[31636]: pgmap v2423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:32 smithi170 ceph-mon[31212]: pgmap v2424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4363.335525 secs 2024-04-21T11:37:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:32 smithi077 ceph-mon[27902]: pgmap v2424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4363.335525 secs 2024-04-21T11:37:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:32 smithi191 ceph-mon[31636]: pgmap v2424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4363.335525 secs 2024-04-21T11:37:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4365.095941 secs 2024-04-21T11:37:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:34 smithi170 ceph-mon[31212]: pgmap v2425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4365.095941 secs 2024-04-21T11:37:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:34 smithi077 ceph-mon[27902]: pgmap v2425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4365.095941 secs 2024-04-21T11:37:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:34 smithi191 ceph-mon[31636]: pgmap v2425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:36 smithi170 ceph-mon[31212]: pgmap v2426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:36 smithi077 ceph-mon[27902]: pgmap v2426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:36 smithi191 ceph-mon[31636]: pgmap v2426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4368.335644 secs 2024-04-21T11:37:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4368.335644 secs 2024-04-21T11:37:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4368.335644 secs 2024-04-21T11:37:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:38 smithi170 ceph-mon[31212]: pgmap v2427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:38.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:38 smithi191 ceph-mon[31636]: pgmap v2427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:38 smithi077 ceph-mon[27902]: pgmap v2427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4370.096003 secs 2024-04-21T11:37:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4370.096003 secs 2024-04-21T11:37:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4370.096003 secs 2024-04-21T11:37:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:40 smithi170 ceph-mon[31212]: pgmap v2428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:40 smithi077 ceph-mon[27902]: pgmap v2428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:40 smithi191 ceph-mon[31636]: pgmap v2428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:42 smithi170 ceph-mon[31212]: pgmap v2429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4373.335737 secs 2024-04-21T11:37:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:42 smithi077 ceph-mon[27902]: pgmap v2429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4373.335737 secs 2024-04-21T11:37:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:42 smithi191 ceph-mon[31636]: pgmap v2429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4373.335737 secs 2024-04-21T11:37:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4375.096102 secs 2024-04-21T11:37:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:44 smithi170 ceph-mon[31212]: pgmap v2430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4375.096102 secs 2024-04-21T11:37:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:44 smithi077 ceph-mon[27902]: pgmap v2430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4375.096102 secs 2024-04-21T11:37:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:44 smithi191 ceph-mon[31636]: pgmap v2430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T11:37:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:46 smithi077 ceph-mon[27902]: pgmap v2431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:46 smithi191 ceph-mon[31636]: pgmap v2431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:46 smithi170 ceph-mon[31212]: pgmap v2431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:37:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4378.335856 secs 2024-04-21T11:37:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4378.335856 secs 2024-04-21T11:37:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4378.335856 secs 2024-04-21T11:37:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:48 smithi077 ceph-mon[27902]: pgmap v2432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:48 smithi191 ceph-mon[31636]: pgmap v2432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:48 smithi170 ceph-mon[31212]: pgmap v2432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4380.096211 secs 2024-04-21T11:37:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4380.096211 secs 2024-04-21T11:37:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4380.096211 secs 2024-04-21T11:37:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:50 smithi077 ceph-mon[27902]: pgmap v2433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:50 smithi191 ceph-mon[31636]: pgmap v2433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:50 smithi170 ceph-mon[31212]: pgmap v2433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:52 smithi077 ceph-mon[27902]: pgmap v2434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4383.335963 secs 2024-04-21T11:37:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:52 smithi191 ceph-mon[31636]: pgmap v2434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4383.335963 secs 2024-04-21T11:37:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:52 smithi170 ceph-mon[31212]: pgmap v2434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4383.335963 secs 2024-04-21T11:37:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4385.096332 secs 2024-04-21T11:37:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:54 smithi077 ceph-mon[27902]: pgmap v2435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:37:54.950+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:37:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:37:54.950+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:37:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:37:54.950+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:37:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:37:54.950+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:37:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4385.096332 secs 2024-04-21T11:37:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:54 smithi191 ceph-mon[31636]: pgmap v2435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4385.096332 secs 2024-04-21T11:37:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:54 smithi170 ceph-mon[31212]: pgmap v2435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:37:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:56 smithi077 ceph-mon[27902]: pgmap v2436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:56 smithi191 ceph-mon[31636]: pgmap v2436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:56 smithi170 ceph-mon[31212]: pgmap v2436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:37:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4388.336059 secs 2024-04-21T11:37:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4388.336059 secs 2024-04-21T11:37:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4388.336059 secs 2024-04-21T11:37:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:58 smithi077 ceph-mon[27902]: pgmap v2437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:58 smithi191 ceph-mon[31636]: pgmap v2437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:58 smithi170 ceph-mon[31212]: pgmap v2437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:37:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4390.096439 secs 2024-04-21T11:37:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4390.096439 secs 2024-04-21T11:38:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4390.096439 secs 2024-04-21T11:38:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:00 smithi077 ceph-mon[27902]: pgmap v2438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:00 smithi191 ceph-mon[31636]: pgmap v2438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:00 smithi170 ceph-mon[31212]: pgmap v2438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:02 smithi077 ceph-mon[27902]: pgmap v2439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4393.336175 secs 2024-04-21T11:38:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:02 smithi191 ceph-mon[31636]: pgmap v2439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4393.336175 secs 2024-04-21T11:38:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:02 smithi170 ceph-mon[31212]: pgmap v2439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4393.336175 secs 2024-04-21T11:38:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4395.096517 secs 2024-04-21T11:38:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:04 smithi077 ceph-mon[27902]: pgmap v2440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:04 smithi077 ceph-mon[27902]: osdmap e227: 12 total, 12 up, 12 in 2024-04-21T11:38:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4395.096517 secs 2024-04-21T11:38:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:04 smithi191 ceph-mon[31636]: pgmap v2440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:04 smithi191 ceph-mon[31636]: osdmap e227: 12 total, 12 up, 12 in 2024-04-21T11:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4395.096517 secs 2024-04-21T11:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:04 smithi170 ceph-mon[31212]: pgmap v2440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:04 smithi170 ceph-mon[31212]: osdmap e227: 12 total, 12 up, 12 in 2024-04-21T11:38:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:38:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:38:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:38:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:06 smithi077 ceph-mon[27902]: pgmap v2442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:38:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:38:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:38:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:38:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:06 smithi191 ceph-mon[31636]: pgmap v2442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:38:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:38:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:38:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:38:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:06 smithi170 ceph-mon[31212]: pgmap v2442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:38:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:38:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:38:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:38:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4398.336237 secs 2024-04-21T11:38:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:08 smithi170 ceph-mon[31212]: osdmap e228: 12 total, 12 up, 12 in 2024-04-21T11:38:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:08 smithi170 ceph-mon[31212]: pgmap v2444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:38:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4398.336237 secs 2024-04-21T11:38:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:08 smithi077 ceph-mon[27902]: osdmap e228: 12 total, 12 up, 12 in 2024-04-21T11:38:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:08 smithi077 ceph-mon[27902]: pgmap v2444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:38:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4398.336237 secs 2024-04-21T11:38:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:08 smithi191 ceph-mon[31636]: osdmap e228: 12 total, 12 up, 12 in 2024-04-21T11:38:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:08 smithi191 ceph-mon[31636]: pgmap v2444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:38:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4400.096635 secs 2024-04-21T11:38:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4400.096635 secs 2024-04-21T11:38:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4400.096635 secs 2024-04-21T11:38:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:10 smithi170 ceph-mon[31212]: pgmap v2445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:38:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:10 smithi077 ceph-mon[27902]: pgmap v2445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:38:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:10 smithi191 ceph-mon[31636]: pgmap v2445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:38:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:12 smithi170 ceph-mon[31212]: pgmap v2446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:38:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4403.336372 secs 2024-04-21T11:38:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:12 smithi077 ceph-mon[27902]: pgmap v2446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:38:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4403.336372 secs 2024-04-21T11:38:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:12 smithi191 ceph-mon[31636]: pgmap v2446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:38:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4403.336372 secs 2024-04-21T11:38:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4405.096776 secs 2024-04-21T11:38:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:14 smithi170 ceph-mon[31212]: pgmap v2447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:38:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4405.096776 secs 2024-04-21T11:38:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:14 smithi077 ceph-mon[27902]: pgmap v2447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:38:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4405.096776 secs 2024-04-21T11:38:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:14 smithi191 ceph-mon[31636]: pgmap v2447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:38:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:16 smithi170 ceph-mon[31212]: pgmap v2448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:38:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:16 smithi077 ceph-mon[27902]: pgmap v2448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:38:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:16 smithi191 ceph-mon[31636]: pgmap v2448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:38:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4408.336443 secs 2024-04-21T11:38:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4408.336443 secs 2024-04-21T11:38:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4408.336443 secs 2024-04-21T11:38:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:18 smithi170 ceph-mon[31212]: pgmap v2449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:38:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:18 smithi077 ceph-mon[27902]: pgmap v2449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:38:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:18 smithi191 ceph-mon[31636]: pgmap v2449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:38:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4410.096889 secs 2024-04-21T11:38:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4410.096889 secs 2024-04-21T11:38:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4410.096889 secs 2024-04-21T11:38:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:20 smithi170 ceph-mon[31212]: pgmap v2450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:38:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:20 smithi077 ceph-mon[27902]: pgmap v2450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:38:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:20 smithi191 ceph-mon[31636]: pgmap v2450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:38:22.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:22 smithi170 ceph-mon[31212]: pgmap v2451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:38:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4413.336578 secs 2024-04-21T11:38:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:22 smithi077 ceph-mon[27902]: pgmap v2451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:38:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4413.336578 secs 2024-04-21T11:38:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:22 smithi191 ceph-mon[31636]: pgmap v2451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:38:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4413.336578 secs 2024-04-21T11:38:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4415.097006 secs 2024-04-21T11:38:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:24 smithi170 ceph-mon[31212]: pgmap v2452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4415.097006 secs 2024-04-21T11:38:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:24 smithi077 ceph-mon[27902]: pgmap v2452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4415.097006 secs 2024-04-21T11:38:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:24 smithi191 ceph-mon[31636]: pgmap v2452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:26 smithi170 ceph-mon[31212]: pgmap v2453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:26 smithi077 ceph-mon[27902]: pgmap v2453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:26 smithi191 ceph-mon[31636]: pgmap v2453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4418.336709 secs 2024-04-21T11:38:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4418.336709 secs 2024-04-21T11:38:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4418.336709 secs 2024-04-21T11:38:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:28 smithi170 ceph-mon[31212]: pgmap v2454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:28 smithi077 ceph-mon[27902]: pgmap v2454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:28 smithi191 ceph-mon[31636]: pgmap v2454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4420.097119 secs 2024-04-21T11:38:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4420.097119 secs 2024-04-21T11:38:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4420.097119 secs 2024-04-21T11:38:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:30 smithi170 ceph-mon[31212]: pgmap v2455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:30 smithi077 ceph-mon[27902]: pgmap v2455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:30 smithi191 ceph-mon[31636]: pgmap v2455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:32 smithi170 ceph-mon[31212]: pgmap v2456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4423.336842 secs 2024-04-21T11:38:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:32 smithi077 ceph-mon[27902]: pgmap v2456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4423.336842 secs 2024-04-21T11:38:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:32 smithi191 ceph-mon[31636]: pgmap v2456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4423.336842 secs 2024-04-21T11:38:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4425.097199 secs 2024-04-21T11:38:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:34 smithi170 ceph-mon[31212]: pgmap v2457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4425.097199 secs 2024-04-21T11:38:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:34 smithi077 ceph-mon[27902]: pgmap v2457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4425.097199 secs 2024-04-21T11:38:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:34 smithi191 ceph-mon[31636]: pgmap v2457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:36 smithi170 ceph-mon[31212]: pgmap v2458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:36 smithi077 ceph-mon[27902]: pgmap v2458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:36 smithi191 ceph-mon[31636]: pgmap v2458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4428.336957 secs 2024-04-21T11:38:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4428.336957 secs 2024-04-21T11:38:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4428.336957 secs 2024-04-21T11:38:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:38 smithi170 ceph-mon[31212]: pgmap v2459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:38.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:38 smithi191 ceph-mon[31636]: pgmap v2459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:38 smithi077 ceph-mon[27902]: pgmap v2459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4430.097312 secs 2024-04-21T11:38:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4430.097312 secs 2024-04-21T11:38:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4430.097312 secs 2024-04-21T11:38:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:40 smithi077 ceph-mon[27902]: pgmap v2460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:40 smithi191 ceph-mon[31636]: pgmap v2460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:40 smithi170 ceph-mon[31212]: pgmap v2460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:42 smithi077 ceph-mon[27902]: pgmap v2461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4433.337049 secs 2024-04-21T11:38:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:42 smithi191 ceph-mon[31636]: pgmap v2461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4433.337049 secs 2024-04-21T11:38:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:42 smithi170 ceph-mon[31212]: pgmap v2461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4433.337049 secs 2024-04-21T11:38:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4435.097427 secs 2024-04-21T11:38:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:44 smithi077 ceph-mon[27902]: pgmap v2462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4435.097427 secs 2024-04-21T11:38:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:44 smithi191 ceph-mon[31636]: pgmap v2462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4435.097427 secs 2024-04-21T11:38:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:44 smithi170 ceph-mon[31212]: pgmap v2462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:46 smithi077 ceph-mon[27902]: pgmap v2463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:46 smithi191 ceph-mon[31636]: pgmap v2463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:46 smithi170 ceph-mon[31212]: pgmap v2463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4438.337128 secs 2024-04-21T11:38:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4438.337128 secs 2024-04-21T11:38:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4438.337128 secs 2024-04-21T11:38:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:48 smithi077 ceph-mon[27902]: pgmap v2464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:48 smithi191 ceph-mon[31636]: pgmap v2464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:48 smithi170 ceph-mon[31212]: pgmap v2464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4440.097559 secs 2024-04-21T11:38:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4440.097559 secs 2024-04-21T11:38:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4440.097559 secs 2024-04-21T11:38:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:50 smithi077 ceph-mon[27902]: pgmap v2465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:50 smithi191 ceph-mon[31636]: pgmap v2465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:50 smithi170 ceph-mon[31212]: pgmap v2465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:52 smithi077 ceph-mon[27902]: pgmap v2466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4443.337266 secs 2024-04-21T11:38:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:52 smithi191 ceph-mon[31636]: pgmap v2466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4443.337266 secs 2024-04-21T11:38:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:52 smithi170 ceph-mon[31212]: pgmap v2466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4443.337266 secs 2024-04-21T11:38:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4445.097691 secs 2024-04-21T11:38:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:54 smithi077 ceph-mon[27902]: pgmap v2467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4445.097691 secs 2024-04-21T11:38:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:54 smithi191 ceph-mon[31636]: pgmap v2467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4445.097691 secs 2024-04-21T11:38:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:54 smithi170 ceph-mon[31212]: pgmap v2467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:38:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:56 smithi077 ceph-mon[27902]: pgmap v2468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:56 smithi191 ceph-mon[31636]: pgmap v2468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:56 smithi170 ceph-mon[31212]: pgmap v2468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:38:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4448.337401 secs 2024-04-21T11:38:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4448.337401 secs 2024-04-21T11:38:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4448.337401 secs 2024-04-21T11:38:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:58 smithi077 ceph-mon[27902]: pgmap v2469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:58 smithi191 ceph-mon[31636]: pgmap v2469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:58 smithi170 ceph-mon[31212]: pgmap v2469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:38:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4450.097810 secs 2024-04-21T11:38:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4450.097810 secs 2024-04-21T11:39:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4450.097810 secs 2024-04-21T11:39:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:00 smithi077 ceph-mon[27902]: pgmap v2470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:00 smithi191 ceph-mon[31636]: pgmap v2470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:01.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:00 smithi170 ceph-mon[31212]: pgmap v2470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:02 smithi077 ceph-mon[27902]: pgmap v2471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4453.337517 secs 2024-04-21T11:39:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:02 smithi191 ceph-mon[31636]: pgmap v2471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4453.337517 secs 2024-04-21T11:39:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:02 smithi170 ceph-mon[31212]: pgmap v2471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4453.337517 secs 2024-04-21T11:39:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4455.097950 secs 2024-04-21T11:39:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:04 smithi077 ceph-mon[27902]: pgmap v2472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:04 smithi077 ceph-mon[27902]: osdmap e229: 12 total, 12 up, 12 in 2024-04-21T11:39:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4455.097950 secs 2024-04-21T11:39:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:04 smithi191 ceph-mon[31636]: pgmap v2472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:04 smithi191 ceph-mon[31636]: osdmap e229: 12 total, 12 up, 12 in 2024-04-21T11:39:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4455.097950 secs 2024-04-21T11:39:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:04 smithi170 ceph-mon[31212]: pgmap v2472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:04 smithi170 ceph-mon[31212]: osdmap e229: 12 total, 12 up, 12 in 2024-04-21T11:39:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:06 smithi077 ceph-mon[27902]: pgmap v2474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:39:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:39:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:39:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:39:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:39:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:06 smithi191 ceph-mon[31636]: pgmap v2474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:39:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:39:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:39:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:39:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:39:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:06 smithi170 ceph-mon[31212]: pgmap v2474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:39:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:39:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:39:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:39:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:39:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4458.337642 secs 2024-04-21T11:39:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:08 smithi077 ceph-mon[27902]: osdmap e230: 12 total, 12 up, 12 in 2024-04-21T11:39:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:08 smithi077 ceph-mon[27902]: pgmap v2476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:39:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4458.337642 secs 2024-04-21T11:39:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:08 smithi191 ceph-mon[31636]: osdmap e230: 12 total, 12 up, 12 in 2024-04-21T11:39:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:08 smithi191 ceph-mon[31636]: pgmap v2476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:39:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4458.337642 secs 2024-04-21T11:39:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:08 smithi170 ceph-mon[31212]: osdmap e230: 12 total, 12 up, 12 in 2024-04-21T11:39:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:08 smithi170 ceph-mon[31212]: pgmap v2476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:39:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4460.098068 secs 2024-04-21T11:39:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4460.098068 secs 2024-04-21T11:39:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4460.098068 secs 2024-04-21T11:39:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:10 smithi077 ceph-mon[27902]: pgmap v2477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:39:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:10 smithi191 ceph-mon[31636]: pgmap v2477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:39:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:10 smithi170 ceph-mon[31212]: pgmap v2477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:39:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:12 smithi170 ceph-mon[31212]: pgmap v2478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:39:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4463.337782 secs 2024-04-21T11:39:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:12 smithi077 ceph-mon[27902]: pgmap v2478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:39:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4463.337782 secs 2024-04-21T11:39:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:12 smithi191 ceph-mon[31636]: pgmap v2478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:39:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4463.337782 secs 2024-04-21T11:39:14.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4465.098164 secs 2024-04-21T11:39:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:14 smithi170 ceph-mon[31212]: pgmap v2479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:39:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4465.098164 secs 2024-04-21T11:39:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:14 smithi077 ceph-mon[27902]: pgmap v2479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:39:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4465.098164 secs 2024-04-21T11:39:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:14 smithi191 ceph-mon[31636]: pgmap v2479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:39:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:16 smithi170 ceph-mon[31212]: pgmap v2480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:39:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:16 smithi077 ceph-mon[27902]: pgmap v2480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:39:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:16 smithi191 ceph-mon[31636]: pgmap v2480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:39:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4468.337897 secs 2024-04-21T11:39:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:18 smithi077 ceph-mon[27902]: pgmap v2481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:39:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4468.337897 secs 2024-04-21T11:39:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:18 smithi191 ceph-mon[31636]: pgmap v2481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:39:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4468.337897 secs 2024-04-21T11:39:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:18 smithi170 ceph-mon[31212]: pgmap v2481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:39:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4470.098242 secs 2024-04-21T11:39:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4470.098242 secs 2024-04-21T11:39:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4470.098242 secs 2024-04-21T11:39:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:20 smithi077 ceph-mon[27902]: pgmap v2482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:39:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:20 smithi191 ceph-mon[31636]: pgmap v2482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:39:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:20 smithi170 ceph-mon[31212]: pgmap v2482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:39:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:22 smithi170 ceph-mon[31212]: pgmap v2483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:39:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4473.338013 secs 2024-04-21T11:39:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:22 smithi077 ceph-mon[27902]: pgmap v2483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:39:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4473.338013 secs 2024-04-21T11:39:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:22 smithi191 ceph-mon[31636]: pgmap v2483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:39:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4473.338013 secs 2024-04-21T11:39:24.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4475.098359 secs 2024-04-21T11:39:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:24 smithi170 ceph-mon[31212]: pgmap v2484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4475.098359 secs 2024-04-21T11:39:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:24 smithi077 ceph-mon[27902]: pgmap v2484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4475.098359 secs 2024-04-21T11:39:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:24 smithi191 ceph-mon[31636]: pgmap v2484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:26 smithi170 ceph-mon[31212]: pgmap v2485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:26 smithi077 ceph-mon[27902]: pgmap v2485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:26 smithi191 ceph-mon[31636]: pgmap v2485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4478.338114 secs 2024-04-21T11:39:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4478.338114 secs 2024-04-21T11:39:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4478.338114 secs 2024-04-21T11:39:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:28 smithi170 ceph-mon[31212]: pgmap v2486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:28 smithi077 ceph-mon[27902]: pgmap v2486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:28 smithi191 ceph-mon[31636]: pgmap v2486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4480.098489 secs 2024-04-21T11:39:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4480.098489 secs 2024-04-21T11:39:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4480.098489 secs 2024-04-21T11:39:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:30 smithi170 ceph-mon[31212]: pgmap v2487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:30 smithi077 ceph-mon[27902]: pgmap v2487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:30 smithi191 ceph-mon[31636]: pgmap v2487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:32 smithi170 ceph-mon[31212]: pgmap v2488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4483.338228 secs 2024-04-21T11:39:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:32 smithi077 ceph-mon[27902]: pgmap v2488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4483.338228 secs 2024-04-21T11:39:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:32 smithi191 ceph-mon[31636]: pgmap v2488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4483.338228 secs 2024-04-21T11:39:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4485.098623 secs 2024-04-21T11:39:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:34 smithi170 ceph-mon[31212]: pgmap v2489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4485.098623 secs 2024-04-21T11:39:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:34 smithi077 ceph-mon[27902]: pgmap v2489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4485.098623 secs 2024-04-21T11:39:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:34 smithi191 ceph-mon[31636]: pgmap v2489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:36 smithi170 ceph-mon[31212]: pgmap v2490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:36 smithi077 ceph-mon[27902]: pgmap v2490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:36 smithi191 ceph-mon[31636]: pgmap v2490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4488.338321 secs 2024-04-21T11:39:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4488.338321 secs 2024-04-21T11:39:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4488.338321 secs 2024-04-21T11:39:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:38 smithi170 ceph-mon[31212]: pgmap v2491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:38.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:38 smithi191 ceph-mon[31636]: pgmap v2491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:38 smithi077 ceph-mon[27902]: pgmap v2491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4490.098753 secs 2024-04-21T11:39:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4490.098753 secs 2024-04-21T11:39:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4490.098753 secs 2024-04-21T11:39:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:40 smithi170 ceph-mon[31212]: pgmap v2492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:40 smithi077 ceph-mon[27902]: pgmap v2492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:40 smithi191 ceph-mon[31636]: pgmap v2492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:42 smithi077 ceph-mon[27902]: pgmap v2493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4493.338436 secs 2024-04-21T11:39:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:42 smithi191 ceph-mon[31636]: pgmap v2493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4493.338436 secs 2024-04-21T11:39:43.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:42 smithi170 ceph-mon[31212]: pgmap v2493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4493.338436 secs 2024-04-21T11:39:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4495.098886 secs 2024-04-21T11:39:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:44 smithi077 ceph-mon[27902]: pgmap v2494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4495.098886 secs 2024-04-21T11:39:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:44 smithi191 ceph-mon[31636]: pgmap v2494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:45.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4495.098886 secs 2024-04-21T11:39:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:44 smithi170 ceph-mon[31212]: pgmap v2494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:46 smithi077 ceph-mon[27902]: pgmap v2495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:46 smithi191 ceph-mon[31636]: pgmap v2495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:46 smithi170 ceph-mon[31212]: pgmap v2495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4498.338555 secs 2024-04-21T11:39:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4498.338555 secs 2024-04-21T11:39:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4498.338555 secs 2024-04-21T11:39:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:48 smithi077 ceph-mon[27902]: pgmap v2496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:48 smithi191 ceph-mon[31636]: pgmap v2496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:48 smithi170 ceph-mon[31212]: pgmap v2496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4500.098986 secs 2024-04-21T11:39:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4500.098986 secs 2024-04-21T11:39:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4500.098986 secs 2024-04-21T11:39:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:50 smithi077 ceph-mon[27902]: pgmap v2497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:50 smithi191 ceph-mon[31636]: pgmap v2497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:50 smithi170 ceph-mon[31212]: pgmap v2497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:52 smithi077 ceph-mon[27902]: pgmap v2498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4503.338671 secs 2024-04-21T11:39:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:52 smithi191 ceph-mon[31636]: pgmap v2498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4503.338671 secs 2024-04-21T11:39:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:52 smithi170 ceph-mon[31212]: pgmap v2498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4503.338671 secs 2024-04-21T11:39:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4505.099066 secs 2024-04-21T11:39:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:54 smithi077 ceph-mon[27902]: pgmap v2499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4505.099066 secs 2024-04-21T11:39:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:54 smithi191 ceph-mon[31636]: pgmap v2499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4505.099066 secs 2024-04-21T11:39:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:54 smithi170 ceph-mon[31212]: pgmap v2499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:39:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:56 smithi077 ceph-mon[27902]: pgmap v2500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:56 smithi191 ceph-mon[31636]: pgmap v2500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:56 smithi170 ceph-mon[31212]: pgmap v2500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:39:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4508.338769 secs 2024-04-21T11:39:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4508.338769 secs 2024-04-21T11:39:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4508.338769 secs 2024-04-21T11:39:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:58 smithi077 ceph-mon[27902]: pgmap v2501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:58 smithi191 ceph-mon[31636]: pgmap v2501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:58 smithi170 ceph-mon[31212]: pgmap v2501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:39:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4510.099179 secs 2024-04-21T11:39:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4510.099179 secs 2024-04-21T11:40:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4510.099179 secs 2024-04-21T11:40:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:00 smithi077 ceph-mon[27902]: pgmap v2502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:40:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:00 smithi191 ceph-mon[31636]: pgmap v2502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:40:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:00 smithi170 ceph-mon[31212]: pgmap v2502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:40:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:02 smithi077 ceph-mon[27902]: pgmap v2503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4513.338861 secs 2024-04-21T11:40:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:02 smithi191 ceph-mon[31636]: pgmap v2503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4513.338861 secs 2024-04-21T11:40:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:02 smithi170 ceph-mon[31212]: pgmap v2503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4513.338861 secs 2024-04-21T11:40:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4515.099302 secs 2024-04-21T11:40:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:04 smithi077 ceph-mon[27902]: pgmap v2504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:04 smithi077 ceph-mon[27902]: osdmap e231: 12 total, 12 up, 12 in 2024-04-21T11:40:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4515.099302 secs 2024-04-21T11:40:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:04 smithi191 ceph-mon[31636]: pgmap v2504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:04 smithi191 ceph-mon[31636]: osdmap e231: 12 total, 12 up, 12 in 2024-04-21T11:40:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4515.099302 secs 2024-04-21T11:40:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:04 smithi170 ceph-mon[31212]: pgmap v2504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:04 smithi170 ceph-mon[31212]: osdmap e231: 12 total, 12 up, 12 in 2024-04-21T11:40:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:06 smithi077 ceph-mon[27902]: pgmap v2506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:40:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:40:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:06 smithi191 ceph-mon[31636]: pgmap v2506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:40:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:40:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:06 smithi170 ceph-mon[31212]: pgmap v2506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:40:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:40:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4518.338974 secs 2024-04-21T11:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:08 smithi077 ceph-mon[27902]: osdmap e232: 12 total, 12 up, 12 in 2024-04-21T11:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:08 smithi077 ceph-mon[27902]: pgmap v2508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4518.338974 secs 2024-04-21T11:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:08 smithi191 ceph-mon[31636]: osdmap e232: 12 total, 12 up, 12 in 2024-04-21T11:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:40:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:08 smithi191 ceph-mon[31636]: pgmap v2508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:40:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4518.338974 secs 2024-04-21T11:40:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:08 smithi170 ceph-mon[31212]: osdmap e232: 12 total, 12 up, 12 in 2024-04-21T11:40:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:40:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:40:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:40:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:08 smithi170 ceph-mon[31212]: pgmap v2508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:40:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4520.099393 secs 2024-04-21T11:40:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4520.099393 secs 2024-04-21T11:40:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4520.099393 secs 2024-04-21T11:40:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:10 smithi191 ceph-mon[31636]: pgmap v2509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:40:10.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:10 smithi170 ceph-mon[31212]: pgmap v2509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:40:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:10 smithi077 ceph-mon[27902]: pgmap v2509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:40:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4523.339096 secs 2024-04-21T11:40:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:12 smithi170 ceph-mon[31212]: pgmap v2510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:40:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4523.339096 secs 2024-04-21T11:40:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:12 smithi077 ceph-mon[27902]: pgmap v2510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:40:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4523.339096 secs 2024-04-21T11:40:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:12 smithi191 ceph-mon[31636]: pgmap v2510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:40:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4525.099495 secs 2024-04-21T11:40:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:14 smithi170 ceph-mon[31212]: pgmap v2511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:40:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4525.099495 secs 2024-04-21T11:40:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:14 smithi077 ceph-mon[27902]: pgmap v2511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:40:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4525.099495 secs 2024-04-21T11:40:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:14 smithi191 ceph-mon[31636]: pgmap v2511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:40:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:16 smithi170 ceph-mon[31212]: pgmap v2512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:40:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:16 smithi077 ceph-mon[27902]: pgmap v2512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:40:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:16 smithi191 ceph-mon[31636]: pgmap v2512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:40:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4528.339240 secs 2024-04-21T11:40:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4528.339240 secs 2024-04-21T11:40:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4528.339240 secs 2024-04-21T11:40:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:18 smithi170 ceph-mon[31212]: pgmap v2513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:40:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:18 smithi077 ceph-mon[27902]: pgmap v2513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:40:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:18 smithi191 ceph-mon[31636]: pgmap v2513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:40:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4530.099555 secs 2024-04-21T11:40:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4530.099555 secs 2024-04-21T11:40:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4530.099555 secs 2024-04-21T11:40:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:20 smithi170 ceph-mon[31212]: pgmap v2514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:40:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:20 smithi077 ceph-mon[27902]: pgmap v2514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:40:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:20 smithi191 ceph-mon[31636]: pgmap v2514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:40:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4533.339364 secs 2024-04-21T11:40:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:22 smithi170 ceph-mon[31212]: pgmap v2515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:40:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4533.339364 secs 2024-04-21T11:40:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:22 smithi077 ceph-mon[27902]: pgmap v2515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:40:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4533.339364 secs 2024-04-21T11:40:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:22 smithi191 ceph-mon[31636]: pgmap v2515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:40:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4535.099674 secs 2024-04-21T11:40:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:24 smithi170 ceph-mon[31212]: pgmap v2516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4535.099674 secs 2024-04-21T11:40:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:24 smithi077 ceph-mon[27902]: pgmap v2516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4535.099674 secs 2024-04-21T11:40:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:24 smithi191 ceph-mon[31636]: pgmap v2516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:26 smithi170 ceph-mon[31212]: pgmap v2517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:26 smithi077 ceph-mon[27902]: pgmap v2517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:26 smithi191 ceph-mon[31636]: pgmap v2517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4538.339498 secs 2024-04-21T11:40:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4538.339498 secs 2024-04-21T11:40:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4538.339498 secs 2024-04-21T11:40:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:28 smithi077 ceph-mon[27902]: pgmap v2518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:28 smithi191 ceph-mon[31636]: pgmap v2518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:28 smithi170 ceph-mon[31212]: pgmap v2518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4540.099806 secs 2024-04-21T11:40:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4540.099806 secs 2024-04-21T11:40:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4540.099806 secs 2024-04-21T11:40:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:30 smithi077 ceph-mon[27902]: pgmap v2519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:30 smithi191 ceph-mon[31636]: pgmap v2519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:30 smithi170 ceph-mon[31212]: pgmap v2519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4543.339607 secs 2024-04-21T11:40:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:32 smithi077 ceph-mon[27902]: pgmap v2520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4543.339607 secs 2024-04-21T11:40:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:32 smithi191 ceph-mon[31636]: pgmap v2520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4543.339607 secs 2024-04-21T11:40:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:32 smithi170 ceph-mon[31212]: pgmap v2520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4545.099902 secs 2024-04-21T11:40:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:34 smithi077 ceph-mon[27902]: pgmap v2521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4545.099902 secs 2024-04-21T11:40:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:34 smithi191 ceph-mon[31636]: pgmap v2521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4545.099902 secs 2024-04-21T11:40:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:34 smithi170 ceph-mon[31212]: pgmap v2521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:36 smithi077 ceph-mon[27902]: pgmap v2522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:36 smithi191 ceph-mon[31636]: pgmap v2522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:36 smithi170 ceph-mon[31212]: pgmap v2522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4548.339718 secs 2024-04-21T11:40:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4548.339718 secs 2024-04-21T11:40:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4548.339718 secs 2024-04-21T11:40:38.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:38 smithi191 ceph-mon[31636]: pgmap v2523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:38.928 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:38 smithi077 ceph-mon[27902]: pgmap v2523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:38 smithi170 ceph-mon[31212]: pgmap v2523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4550.100019 secs 2024-04-21T11:40:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4550.100019 secs 2024-04-21T11:40:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4550.100019 secs 2024-04-21T11:40:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:40 smithi077 ceph-mon[27902]: pgmap v2524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:40 smithi191 ceph-mon[31636]: pgmap v2524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:40 smithi170 ceph-mon[31212]: pgmap v2524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4553.339851 secs 2024-04-21T11:40:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:42 smithi077 ceph-mon[27902]: pgmap v2525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4553.339851 secs 2024-04-21T11:40:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:42 smithi191 ceph-mon[31636]: pgmap v2525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:43.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4553.339851 secs 2024-04-21T11:40:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:42 smithi170 ceph-mon[31212]: pgmap v2525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4555.100101 secs 2024-04-21T11:40:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:44 smithi077 ceph-mon[27902]: pgmap v2526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4555.100101 secs 2024-04-21T11:40:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:44 smithi191 ceph-mon[31636]: pgmap v2526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4555.100101 secs 2024-04-21T11:40:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:44 smithi170 ceph-mon[31212]: pgmap v2526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:46 smithi077 ceph-mon[27902]: pgmap v2527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:46 smithi191 ceph-mon[31636]: pgmap v2527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:46 smithi170 ceph-mon[31212]: pgmap v2527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4558.339967 secs 2024-04-21T11:40:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4558.339967 secs 2024-04-21T11:40:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4558.339967 secs 2024-04-21T11:40:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:48 smithi077 ceph-mon[27902]: pgmap v2528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:48 smithi191 ceph-mon[31636]: pgmap v2528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:48 smithi170 ceph-mon[31212]: pgmap v2528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4560.100218 secs 2024-04-21T11:40:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4560.100218 secs 2024-04-21T11:40:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4560.100218 secs 2024-04-21T11:40:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:50 smithi077 ceph-mon[27902]: pgmap v2529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:50 smithi191 ceph-mon[31636]: pgmap v2529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:50 smithi170 ceph-mon[31212]: pgmap v2529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4563.340086 secs 2024-04-21T11:40:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:52 smithi077 ceph-mon[27902]: pgmap v2530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4563.340086 secs 2024-04-21T11:40:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:52 smithi191 ceph-mon[31636]: pgmap v2530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4563.340086 secs 2024-04-21T11:40:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:52 smithi170 ceph-mon[31212]: pgmap v2530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4565.100290 secs 2024-04-21T11:40:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:54 smithi077 ceph-mon[27902]: pgmap v2531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4565.100290 secs 2024-04-21T11:40:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:54 smithi191 ceph-mon[31636]: pgmap v2531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:40:54.975+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:40:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:40:54.975+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:40:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:40:54.976+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:40:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:40:54.976+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:40:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4565.100290 secs 2024-04-21T11:40:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:54 smithi170 ceph-mon[31212]: pgmap v2531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:40:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:56 smithi077 ceph-mon[27902]: pgmap v2532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:56 smithi191 ceph-mon[31636]: pgmap v2532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:56 smithi170 ceph-mon[31212]: pgmap v2532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:40:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4568.340200 secs 2024-04-21T11:40:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4568.340200 secs 2024-04-21T11:40:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4568.340200 secs 2024-04-21T11:40:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:58 smithi191 ceph-mon[31636]: pgmap v2533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:58 smithi170 ceph-mon[31212]: pgmap v2533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:58 smithi077 ceph-mon[27902]: pgmap v2533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:40:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4570.100397 secs 2024-04-21T11:41:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4570.100397 secs 2024-04-21T11:41:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4570.100397 secs 2024-04-21T11:41:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:00 smithi191 ceph-mon[31636]: pgmap v2534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:00 smithi170 ceph-mon[31212]: pgmap v2534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:00 smithi077 ceph-mon[27902]: pgmap v2534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4573.340339 secs 2024-04-21T11:41:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:02 smithi191 ceph-mon[31636]: pgmap v2535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T11:41:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4573.340339 secs 2024-04-21T11:41:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:02 smithi170 ceph-mon[31212]: pgmap v2535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T11:41:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4573.340339 secs 2024-04-21T11:41:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:02 smithi077 ceph-mon[27902]: pgmap v2535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T11:41:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4575.100536 secs 2024-04-21T11:41:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:04 smithi191 ceph-mon[31636]: pgmap v2536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T11:41:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:04 smithi191 ceph-mon[31636]: osdmap e233: 12 total, 12 up, 12 in 2024-04-21T11:41:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4575.100536 secs 2024-04-21T11:41:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:04 smithi170 ceph-mon[31212]: pgmap v2536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T11:41:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:04 smithi170 ceph-mon[31212]: osdmap e233: 12 total, 12 up, 12 in 2024-04-21T11:41:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4575.100536 secs 2024-04-21T11:41:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:04 smithi077 ceph-mon[27902]: pgmap v2536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T11:41:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:04 smithi077 ceph-mon[27902]: osdmap e233: 12 total, 12 up, 12 in 2024-04-21T11:41:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:06 smithi191 ceph-mon[31636]: pgmap v2538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:41:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:06 smithi170 ceph-mon[31212]: pgmap v2538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:41:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:06 smithi077 ceph-mon[27902]: pgmap v2538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:41:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4578.340476 secs 2024-04-21T11:41:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: osdmap e234: 12 total, 12 up, 12 in 2024-04-21T11:41:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:41:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: pgmap v2540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:41:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:41:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:41:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:41:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4578.340476 secs 2024-04-21T11:41:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: osdmap e234: 12 total, 12 up, 12 in 2024-04-21T11:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: pgmap v2540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4578.340476 secs 2024-04-21T11:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: osdmap e234: 12 total, 12 up, 12 in 2024-04-21T11:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: pgmap v2540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:41:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:41:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:41:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:41:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4580.100596 secs 2024-04-21T11:41:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4580.100596 secs 2024-04-21T11:41:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4580.100596 secs 2024-04-21T11:41:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:10 smithi077 ceph-mon[27902]: pgmap v2541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T11:41:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:10 smithi191 ceph-mon[31636]: pgmap v2541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T11:41:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:10 smithi170 ceph-mon[31212]: pgmap v2541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T11:41:12.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4583.340588 secs 2024-04-21T11:41:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:12 smithi170 ceph-mon[31212]: pgmap v2542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T11:41:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4583.340588 secs 2024-04-21T11:41:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:12 smithi077 ceph-mon[27902]: pgmap v2542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T11:41:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4583.340588 secs 2024-04-21T11:41:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:12 smithi191 ceph-mon[31636]: pgmap v2542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T11:41:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4585.100717 secs 2024-04-21T11:41:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:14 smithi170 ceph-mon[31212]: pgmap v2543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T11:41:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4585.100717 secs 2024-04-21T11:41:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:14 smithi077 ceph-mon[27902]: pgmap v2543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T11:41:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4585.100717 secs 2024-04-21T11:41:14.986 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:14 smithi191 ceph-mon[31636]: pgmap v2543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T11:41:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:16 smithi170 ceph-mon[31212]: pgmap v2544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:41:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:16 smithi077 ceph-mon[27902]: pgmap v2544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:41:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:16 smithi191 ceph-mon[31636]: pgmap v2544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:41:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4588.340700 secs 2024-04-21T11:41:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4588.340700 secs 2024-04-21T11:41:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4588.340700 secs 2024-04-21T11:41:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:18 smithi077 ceph-mon[27902]: pgmap v2545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:41:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:18 smithi191 ceph-mon[31636]: pgmap v2545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:41:19.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:18 smithi170 ceph-mon[31212]: pgmap v2545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:41:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4590.100843 secs 2024-04-21T11:41:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4590.100843 secs 2024-04-21T11:41:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4590.100843 secs 2024-04-21T11:41:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:20 smithi077 ceph-mon[27902]: pgmap v2546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:41:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:20 smithi191 ceph-mon[31636]: pgmap v2546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:41:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:20 smithi170 ceph-mon[31212]: pgmap v2546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:41:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4593.340821 secs 2024-04-21T11:41:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:22 smithi077 ceph-mon[27902]: pgmap v2547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:41:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4593.340821 secs 2024-04-21T11:41:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:22 smithi191 ceph-mon[31636]: pgmap v2547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:41:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4593.340821 secs 2024-04-21T11:41:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:22 smithi170 ceph-mon[31212]: pgmap v2547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:41:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4595.100972 secs 2024-04-21T11:41:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:24 smithi077 ceph-mon[27902]: pgmap v2548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4595.100972 secs 2024-04-21T11:41:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:24 smithi191 ceph-mon[31636]: pgmap v2548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4595.100972 secs 2024-04-21T11:41:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:24 smithi170 ceph-mon[31212]: pgmap v2548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:26 smithi077 ceph-mon[27902]: pgmap v2549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:26 smithi191 ceph-mon[31636]: pgmap v2549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:26 smithi170 ceph-mon[31212]: pgmap v2549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4598.340936 secs 2024-04-21T11:41:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4598.340936 secs 2024-04-21T11:41:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4598.340936 secs 2024-04-21T11:41:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:28 smithi077 ceph-mon[27902]: pgmap v2550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:28 smithi191 ceph-mon[31636]: pgmap v2550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:28 smithi170 ceph-mon[31212]: pgmap v2550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4600.101113 secs 2024-04-21T11:41:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4600.101113 secs 2024-04-21T11:41:30.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4600.101113 secs 2024-04-21T11:41:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:30 smithi077 ceph-mon[27902]: pgmap v2551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:30 smithi191 ceph-mon[31636]: pgmap v2551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:30 smithi170 ceph-mon[31212]: pgmap v2551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4603.341047 secs 2024-04-21T11:41:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:32 smithi077 ceph-mon[27902]: pgmap v2552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4603.341047 secs 2024-04-21T11:41:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:32 smithi191 ceph-mon[31636]: pgmap v2552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4603.341047 secs 2024-04-21T11:41:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:32 smithi170 ceph-mon[31212]: pgmap v2552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4605.101187 secs 2024-04-21T11:41:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:34 smithi077 ceph-mon[27902]: pgmap v2553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4605.101187 secs 2024-04-21T11:41:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:34 smithi191 ceph-mon[31636]: pgmap v2553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4605.101187 secs 2024-04-21T11:41:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:34 smithi170 ceph-mon[31212]: pgmap v2553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:36 smithi077 ceph-mon[27902]: pgmap v2554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:36 smithi191 ceph-mon[31636]: pgmap v2554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:36 smithi170 ceph-mon[31212]: pgmap v2554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4608.341140 secs 2024-04-21T11:41:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4608.341140 secs 2024-04-21T11:41:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4608.341140 secs 2024-04-21T11:41:38.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:38 smithi191 ceph-mon[31636]: pgmap v2555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:38 smithi077 ceph-mon[27902]: pgmap v2555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:38 smithi170 ceph-mon[31212]: pgmap v2555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4610.101255 secs 2024-04-21T11:41:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4610.101255 secs 2024-04-21T11:41:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4610.101255 secs 2024-04-21T11:41:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:40 smithi077 ceph-mon[27902]: pgmap v2556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:40 smithi191 ceph-mon[31636]: pgmap v2556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:40 smithi170 ceph-mon[31212]: pgmap v2556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4613.341259 secs 2024-04-21T11:41:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:42 smithi077 ceph-mon[27902]: pgmap v2557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4613.341259 secs 2024-04-21T11:41:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:42 smithi191 ceph-mon[31636]: pgmap v2557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4613.341259 secs 2024-04-21T11:41:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:42 smithi170 ceph-mon[31212]: pgmap v2557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4615.101315 secs 2024-04-21T11:41:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:44 smithi077 ceph-mon[27902]: pgmap v2558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4615.101315 secs 2024-04-21T11:41:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:44 smithi191 ceph-mon[31636]: pgmap v2558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4615.101315 secs 2024-04-21T11:41:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:44 smithi170 ceph-mon[31212]: pgmap v2558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:46 smithi077 ceph-mon[27902]: pgmap v2559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:46 smithi191 ceph-mon[31636]: pgmap v2559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:46 smithi170 ceph-mon[31212]: pgmap v2559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4618.341393 secs 2024-04-21T11:41:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4618.341393 secs 2024-04-21T11:41:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4618.341393 secs 2024-04-21T11:41:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:48 smithi077 ceph-mon[27902]: pgmap v2560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:48 smithi191 ceph-mon[31636]: pgmap v2560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:48 smithi170 ceph-mon[31212]: pgmap v2560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4620.101433 secs 2024-04-21T11:41:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4620.101433 secs 2024-04-21T11:41:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4620.101433 secs 2024-04-21T11:41:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:50 smithi077 ceph-mon[27902]: pgmap v2561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:50 smithi191 ceph-mon[31636]: pgmap v2561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:50 smithi170 ceph-mon[31212]: pgmap v2561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4623.341527 secs 2024-04-21T11:41:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:52 smithi191 ceph-mon[31636]: pgmap v2562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4623.341527 secs 2024-04-21T11:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:52 smithi170 ceph-mon[31212]: pgmap v2562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4623.341527 secs 2024-04-21T11:41:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:52 smithi077 ceph-mon[27902]: pgmap v2562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4625.101550 secs 2024-04-21T11:41:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:54 smithi191 ceph-mon[31636]: pgmap v2563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4625.101550 secs 2024-04-21T11:41:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:54 smithi170 ceph-mon[31212]: pgmap v2563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:41:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4625.101550 secs 2024-04-21T11:41:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:54 smithi077 ceph-mon[27902]: pgmap v2563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:56 smithi191 ceph-mon[31636]: pgmap v2564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:56 smithi170 ceph-mon[31212]: pgmap v2564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:56 smithi077 ceph-mon[27902]: pgmap v2564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:41:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4628.341630 secs 2024-04-21T11:41:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4628.341630 secs 2024-04-21T11:41:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4628.341630 secs 2024-04-21T11:41:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:58 smithi191 ceph-mon[31636]: pgmap v2565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:58 smithi170 ceph-mon[31212]: pgmap v2565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:58 smithi077 ceph-mon[27902]: pgmap v2565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:41:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:41:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4630.101665 secs 2024-04-21T11:42:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:41:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4630.101665 secs 2024-04-21T11:42:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:41:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4630.101665 secs 2024-04-21T11:42:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:00 smithi191 ceph-mon[31636]: pgmap v2566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:00 smithi170 ceph-mon[31212]: pgmap v2566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:00 smithi077 ceph-mon[27902]: pgmap v2566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4633.341746 secs 2024-04-21T11:42:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:02 smithi191 ceph-mon[31636]: pgmap v2567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-04-21T11:42:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4633.341746 secs 2024-04-21T11:42:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:02 smithi170 ceph-mon[31212]: pgmap v2567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-04-21T11:42:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4633.341746 secs 2024-04-21T11:42:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:02 smithi077 ceph-mon[27902]: pgmap v2567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-04-21T11:42:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4635.101785 secs 2024-04-21T11:42:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:04 smithi191 ceph-mon[31636]: pgmap v2568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-04-21T11:42:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:04 smithi191 ceph-mon[31636]: osdmap e235: 12 total, 12 up, 12 in 2024-04-21T11:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4635.101785 secs 2024-04-21T11:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:04 smithi170 ceph-mon[31212]: pgmap v2568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-04-21T11:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:04 smithi170 ceph-mon[31212]: osdmap e235: 12 total, 12 up, 12 in 2024-04-21T11:42:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4635.101785 secs 2024-04-21T11:42:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:04 smithi077 ceph-mon[27902]: pgmap v2568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-04-21T11:42:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:04 smithi077 ceph-mon[27902]: osdmap e235: 12 total, 12 up, 12 in 2024-04-21T11:42:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:06 smithi191 ceph-mon[31636]: pgmap v2570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:42:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:06 smithi170 ceph-mon[31212]: pgmap v2570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:42:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:06 smithi077 ceph-mon[27902]: pgmap v2570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:42:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4638.341859 secs 2024-04-21T11:42:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:08 smithi077 ceph-mon[27902]: osdmap e236: 12 total, 12 up, 12 in 2024-04-21T11:42:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:08 smithi077 ceph-mon[27902]: pgmap v2572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:42:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:42:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4638.341859 secs 2024-04-21T11:42:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:08 smithi191 ceph-mon[31636]: osdmap e236: 12 total, 12 up, 12 in 2024-04-21T11:42:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:08 smithi191 ceph-mon[31636]: pgmap v2572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:42:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:42:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4638.341859 secs 2024-04-21T11:42:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:08 smithi170 ceph-mon[31212]: osdmap e236: 12 total, 12 up, 12 in 2024-04-21T11:42:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:08 smithi170 ceph-mon[31212]: pgmap v2572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:42:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:42:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4640.101896 secs 2024-04-21T11:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:42:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4640.101896 secs 2024-04-21T11:42:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:42:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:42:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:42:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4640.101896 secs 2024-04-21T11:42:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:42:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:42:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:42:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:10 smithi077 ceph-mon[27902]: pgmap v2573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-04-21T11:42:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:10 smithi191 ceph-mon[31636]: pgmap v2573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-04-21T11:42:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:10 smithi170 ceph-mon[31212]: pgmap v2573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-04-21T11:42:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4643.341923 secs 2024-04-21T11:42:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:12 smithi077 ceph-mon[27902]: pgmap v2574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-04-21T11:42:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4643.341923 secs 2024-04-21T11:42:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:12 smithi191 ceph-mon[31636]: pgmap v2574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-04-21T11:42:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4643.341923 secs 2024-04-21T11:42:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:12 smithi170 ceph-mon[31212]: pgmap v2574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-04-21T11:42:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4645.101992 secs 2024-04-21T11:42:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:14 smithi077 ceph-mon[27902]: pgmap v2575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-04-21T11:42:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4645.101992 secs 2024-04-21T11:42:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:14 smithi191 ceph-mon[31636]: pgmap v2575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-04-21T11:42:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4645.101992 secs 2024-04-21T11:42:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:14 smithi170 ceph-mon[31212]: pgmap v2575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-04-21T11:42:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:16 smithi077 ceph-mon[27902]: pgmap v2576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:42:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:16 smithi191 ceph-mon[31636]: pgmap v2576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:42:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:16 smithi170 ceph-mon[31212]: pgmap v2576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:42:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4648.342036 secs 2024-04-21T11:42:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4648.342036 secs 2024-04-21T11:42:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4648.342036 secs 2024-04-21T11:42:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:18 smithi077 ceph-mon[27902]: pgmap v2577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:42:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:18 smithi191 ceph-mon[31636]: pgmap v2577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:42:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:18 smithi170 ceph-mon[31212]: pgmap v2577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:42:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4650.102118 secs 2024-04-21T11:42:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4650.102118 secs 2024-04-21T11:42:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4650.102118 secs 2024-04-21T11:42:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:20 smithi077 ceph-mon[27902]: pgmap v2578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:42:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:20 smithi191 ceph-mon[31636]: pgmap v2578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:42:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:20 smithi170 ceph-mon[31212]: pgmap v2578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:42:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4653.342170 secs 2024-04-21T11:42:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:22 smithi077 ceph-mon[27902]: pgmap v2579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:42:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4653.342170 secs 2024-04-21T11:42:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:22 smithi191 ceph-mon[31636]: pgmap v2579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:42:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4653.342170 secs 2024-04-21T11:42:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:22 smithi170 ceph-mon[31212]: pgmap v2579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:42:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4655.102241 secs 2024-04-21T11:42:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:24 smithi077 ceph-mon[27902]: pgmap v2580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4655.102241 secs 2024-04-21T11:42:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:24 smithi191 ceph-mon[31636]: pgmap v2580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4655.102241 secs 2024-04-21T11:42:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:24 smithi170 ceph-mon[31212]: pgmap v2580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:26 smithi077 ceph-mon[27902]: pgmap v2581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:26 smithi191 ceph-mon[31636]: pgmap v2581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:26 smithi170 ceph-mon[31212]: pgmap v2581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4658.342308 secs 2024-04-21T11:42:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4658.342308 secs 2024-04-21T11:42:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4658.342308 secs 2024-04-21T11:42:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:28 smithi077 ceph-mon[27902]: pgmap v2582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:28 smithi191 ceph-mon[31636]: pgmap v2582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:28 smithi170 ceph-mon[31212]: pgmap v2582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4660.102317 secs 2024-04-21T11:42:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4660.102317 secs 2024-04-21T11:42:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4660.102317 secs 2024-04-21T11:42:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:30 smithi077 ceph-mon[27902]: pgmap v2583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:30 smithi191 ceph-mon[31636]: pgmap v2583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:30 smithi170 ceph-mon[31212]: pgmap v2583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4663.342457 secs 2024-04-21T11:42:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:32 smithi077 ceph-mon[27902]: pgmap v2584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4663.342457 secs 2024-04-21T11:42:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:32 smithi191 ceph-mon[31636]: pgmap v2584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4663.342457 secs 2024-04-21T11:42:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:32 smithi170 ceph-mon[31212]: pgmap v2584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4665.102458 secs 2024-04-21T11:42:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:34 smithi077 ceph-mon[27902]: pgmap v2585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4665.102458 secs 2024-04-21T11:42:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:34 smithi191 ceph-mon[31636]: pgmap v2585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4665.102458 secs 2024-04-21T11:42:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:34 smithi170 ceph-mon[31212]: pgmap v2585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:36 smithi077 ceph-mon[27902]: pgmap v2586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:36 smithi191 ceph-mon[31636]: pgmap v2586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:36 smithi170 ceph-mon[31212]: pgmap v2586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4668.342521 secs 2024-04-21T11:42:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4668.342521 secs 2024-04-21T11:42:38.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4668.342521 secs 2024-04-21T11:42:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:38 smithi077 ceph-mon[27902]: pgmap v2587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:38 smithi170 ceph-mon[31212]: pgmap v2587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:38 smithi191 ceph-mon[31636]: pgmap v2587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4670.102598 secs 2024-04-21T11:42:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4670.102598 secs 2024-04-21T11:42:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4670.102598 secs 2024-04-21T11:42:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:40 smithi077 ceph-mon[27902]: pgmap v2588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:40 smithi191 ceph-mon[31636]: pgmap v2588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:40 smithi170 ceph-mon[31212]: pgmap v2588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4673.342636 secs 2024-04-21T11:42:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:42 smithi191 ceph-mon[31636]: pgmap v2589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4673.342636 secs 2024-04-21T11:42:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:42 smithi170 ceph-mon[31212]: pgmap v2589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4673.342636 secs 2024-04-21T11:42:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:42 smithi077 ceph-mon[27902]: pgmap v2589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4675.102666 secs 2024-04-21T11:42:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:44 smithi191 ceph-mon[31636]: pgmap v2590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4675.102666 secs 2024-04-21T11:42:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:44 smithi170 ceph-mon[31212]: pgmap v2590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4675.102666 secs 2024-04-21T11:42:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:44 smithi077 ceph-mon[27902]: pgmap v2590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:46 smithi191 ceph-mon[31636]: pgmap v2591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:46 smithi170 ceph-mon[31212]: pgmap v2591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:46 smithi077 ceph-mon[27902]: pgmap v2591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4678.342809 secs 2024-04-21T11:42:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4678.342809 secs 2024-04-21T11:42:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4678.342809 secs 2024-04-21T11:42:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:48 smithi191 ceph-mon[31636]: pgmap v2592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:49.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:48 smithi077 ceph-mon[27902]: pgmap v2592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:48 smithi170 ceph-mon[31212]: pgmap v2592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4680.102788 secs 2024-04-21T11:42:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4680.102788 secs 2024-04-21T11:42:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4680.102788 secs 2024-04-21T11:42:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:50 smithi191 ceph-mon[31636]: pgmap v2593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:50 smithi170 ceph-mon[31212]: pgmap v2593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:50 smithi077 ceph-mon[27902]: pgmap v2593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4683.342905 secs 2024-04-21T11:42:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:52 smithi191 ceph-mon[31636]: pgmap v2594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4683.342905 secs 2024-04-21T11:42:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:52 smithi170 ceph-mon[31212]: pgmap v2594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4683.342905 secs 2024-04-21T11:42:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:52 smithi077 ceph-mon[27902]: pgmap v2594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4685.102906 secs 2024-04-21T11:42:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:54 smithi191 ceph-mon[31636]: pgmap v2595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:55.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4685.102906 secs 2024-04-21T11:42:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:54 smithi170 ceph-mon[31212]: pgmap v2595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:42:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4685.102906 secs 2024-04-21T11:42:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:54 smithi077 ceph-mon[27902]: pgmap v2595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:56 smithi191 ceph-mon[31636]: pgmap v2596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:56 smithi170 ceph-mon[31212]: pgmap v2596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:56 smithi077 ceph-mon[27902]: pgmap v2596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:42:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4688.343027 secs 2024-04-21T11:42:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4688.343027 secs 2024-04-21T11:42:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4688.343027 secs 2024-04-21T11:42:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:58 smithi191 ceph-mon[31636]: pgmap v2597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:58 smithi170 ceph-mon[31212]: pgmap v2597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:58 smithi077 ceph-mon[27902]: pgmap v2597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:42:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:42:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4690.102981 secs 2024-04-21T11:43:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:42:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4690.102981 secs 2024-04-21T11:43:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:42:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4690.102981 secs 2024-04-21T11:43:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:00 smithi191 ceph-mon[31636]: pgmap v2598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:00 smithi170 ceph-mon[31212]: pgmap v2598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:00 smithi077 ceph-mon[27902]: pgmap v2598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4693.343135 secs 2024-04-21T11:43:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:02 smithi191 ceph-mon[31636]: pgmap v2599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T11:43:03.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4693.343135 secs 2024-04-21T11:43:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:02 smithi170 ceph-mon[31212]: pgmap v2599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T11:43:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4693.343135 secs 2024-04-21T11:43:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:02 smithi077 ceph-mon[27902]: pgmap v2599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T11:43:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4695.103100 secs 2024-04-21T11:43:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:04 smithi191 ceph-mon[31636]: pgmap v2600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:43:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:04 smithi191 ceph-mon[31636]: osdmap e237: 12 total, 12 up, 12 in 2024-04-21T11:43:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4695.103100 secs 2024-04-21T11:43:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:04 smithi170 ceph-mon[31212]: pgmap v2600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:43:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:04 smithi170 ceph-mon[31212]: osdmap e237: 12 total, 12 up, 12 in 2024-04-21T11:43:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4695.103100 secs 2024-04-21T11:43:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:04 smithi077 ceph-mon[27902]: pgmap v2600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:43:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:04 smithi077 ceph-mon[27902]: osdmap e237: 12 total, 12 up, 12 in 2024-04-21T11:43:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:06 smithi191 ceph-mon[31636]: pgmap v2602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:43:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:06 smithi170 ceph-mon[31212]: pgmap v2602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:43:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:06 smithi077 ceph-mon[27902]: pgmap v2602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:43:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4698.343249 secs 2024-04-21T11:43:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:08 smithi077 ceph-mon[27902]: osdmap e238: 12 total, 12 up, 12 in 2024-04-21T11:43:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:08 smithi077 ceph-mon[27902]: pgmap v2604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:43:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4698.343249 secs 2024-04-21T11:43:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:08 smithi191 ceph-mon[31636]: osdmap e238: 12 total, 12 up, 12 in 2024-04-21T11:43:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:08 smithi191 ceph-mon[31636]: pgmap v2604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4698.343249 secs 2024-04-21T11:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:08 smithi170 ceph-mon[31212]: osdmap e238: 12 total, 12 up, 12 in 2024-04-21T11:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:08 smithi170 ceph-mon[31212]: pgmap v2604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:43:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4700.103172 secs 2024-04-21T11:43:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:43:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4700.103172 secs 2024-04-21T11:43:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:43:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4700.103172 secs 2024-04-21T11:43:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:43:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:09.994+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:43:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:09.994+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:43:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:09.994+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:43:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:09.994+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:43:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:10 smithi077 ceph-mon[27902]: pgmap v2605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-04-21T11:43:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:10 smithi191 ceph-mon[31636]: pgmap v2605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-04-21T11:43:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:10 smithi170 ceph-mon[31212]: pgmap v2605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:43:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:43:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:43:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4703.343330 secs 2024-04-21T11:43:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:12 smithi170 ceph-mon[31212]: pgmap v2606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T11:43:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:43:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:43:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:43:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:43:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:43:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:43:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4703.343330 secs 2024-04-21T11:43:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:12 smithi077 ceph-mon[27902]: pgmap v2606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T11:43:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4703.343330 secs 2024-04-21T11:43:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:12 smithi191 ceph-mon[31636]: pgmap v2606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T11:43:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4705.103286 secs 2024-04-21T11:43:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:14 smithi077 ceph-mon[27902]: pgmap v2607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-21T11:43:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4705.103286 secs 2024-04-21T11:43:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:14 smithi191 ceph-mon[31636]: pgmap v2607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-21T11:43:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4705.103286 secs 2024-04-21T11:43:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:14 smithi170 ceph-mon[31212]: pgmap v2607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-21T11:43:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:16 smithi077 ceph-mon[27902]: pgmap v2608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:43:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:16 smithi191 ceph-mon[31636]: pgmap v2608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:43:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:16 smithi170 ceph-mon[31212]: pgmap v2608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:43:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4708.343429 secs 2024-04-21T11:43:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:18 smithi077 ceph-mon[27902]: pgmap v2609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:43:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4708.343429 secs 2024-04-21T11:43:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:18 smithi191 ceph-mon[31636]: pgmap v2609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:43:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4708.343429 secs 2024-04-21T11:43:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:18 smithi170 ceph-mon[31212]: pgmap v2609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:43:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4710.103365 secs 2024-04-21T11:43:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4710.103365 secs 2024-04-21T11:43:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4710.103365 secs 2024-04-21T11:43:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:20 smithi077 ceph-mon[27902]: pgmap v2610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:43:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:20 smithi191 ceph-mon[31636]: pgmap v2610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:43:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:20 smithi170 ceph-mon[31212]: pgmap v2610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:43:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4713.343549 secs 2024-04-21T11:43:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:22 smithi077 ceph-mon[27902]: pgmap v2611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:43:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4713.343549 secs 2024-04-21T11:43:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:22 smithi191 ceph-mon[31636]: pgmap v2611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:43:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4713.343549 secs 2024-04-21T11:43:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:22 smithi170 ceph-mon[31212]: pgmap v2611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:43:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4715.103500 secs 2024-04-21T11:43:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:24 smithi077 ceph-mon[27902]: pgmap v2612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4715.103500 secs 2024-04-21T11:43:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:24 smithi191 ceph-mon[31636]: pgmap v2612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4715.103500 secs 2024-04-21T11:43:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:24 smithi170 ceph-mon[31212]: pgmap v2612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:26 smithi077 ceph-mon[27902]: pgmap v2613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:26 smithi191 ceph-mon[31636]: pgmap v2613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:26 smithi170 ceph-mon[31212]: pgmap v2613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4718.343665 secs 2024-04-21T11:43:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4718.343665 secs 2024-04-21T11:43:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4718.343665 secs 2024-04-21T11:43:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:28 smithi077 ceph-mon[27902]: pgmap v2614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:28 smithi191 ceph-mon[31636]: pgmap v2614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:28 smithi170 ceph-mon[31212]: pgmap v2614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4720.103655 secs 2024-04-21T11:43:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4720.103655 secs 2024-04-21T11:43:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4720.103655 secs 2024-04-21T11:43:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:30 smithi077 ceph-mon[27902]: pgmap v2615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:30 smithi191 ceph-mon[31636]: pgmap v2615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:30 smithi170 ceph-mon[31212]: pgmap v2615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4723.343827 secs 2024-04-21T11:43:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:32 smithi077 ceph-mon[27902]: pgmap v2616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4723.343827 secs 2024-04-21T11:43:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:32 smithi191 ceph-mon[31636]: pgmap v2616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4723.343827 secs 2024-04-21T11:43:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:32 smithi170 ceph-mon[31212]: pgmap v2616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4725.103752 secs 2024-04-21T11:43:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:34 smithi077 ceph-mon[27902]: pgmap v2617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4725.103752 secs 2024-04-21T11:43:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:34 smithi191 ceph-mon[31636]: pgmap v2617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4725.103752 secs 2024-04-21T11:43:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:34 smithi170 ceph-mon[31212]: pgmap v2617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:36 smithi077 ceph-mon[27902]: pgmap v2618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:36 smithi191 ceph-mon[31636]: pgmap v2618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:36 smithi170 ceph-mon[31212]: pgmap v2618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4728.343908 secs 2024-04-21T11:43:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4728.343908 secs 2024-04-21T11:43:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4728.343908 secs 2024-04-21T11:43:38.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:38 smithi191 ceph-mon[31636]: pgmap v2619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:38 smithi077 ceph-mon[27902]: pgmap v2619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:38 smithi170 ceph-mon[31212]: pgmap v2619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4730.103885 secs 2024-04-21T11:43:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4730.103885 secs 2024-04-21T11:43:39.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4730.103885 secs 2024-04-21T11:43:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:40 smithi077 ceph-mon[27902]: pgmap v2620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:40 smithi191 ceph-mon[31636]: pgmap v2620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:40 smithi170 ceph-mon[31212]: pgmap v2620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4733.344000 secs 2024-04-21T11:43:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:42 smithi077 ceph-mon[27902]: pgmap v2621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4733.344000 secs 2024-04-21T11:43:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:42 smithi191 ceph-mon[31636]: pgmap v2621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4733.344000 secs 2024-04-21T11:43:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:42 smithi170 ceph-mon[31212]: pgmap v2621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4735.103998 secs 2024-04-21T11:43:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:44 smithi077 ceph-mon[27902]: pgmap v2622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4735.103998 secs 2024-04-21T11:43:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:44 smithi191 ceph-mon[31636]: pgmap v2622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4735.103998 secs 2024-04-21T11:43:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:44 smithi170 ceph-mon[31212]: pgmap v2622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:46 smithi077 ceph-mon[27902]: pgmap v2623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:46 smithi191 ceph-mon[31636]: pgmap v2623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:46 smithi170 ceph-mon[31212]: pgmap v2623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4738.344122 secs 2024-04-21T11:43:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4738.344122 secs 2024-04-21T11:43:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4738.344122 secs 2024-04-21T11:43:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:48 smithi191 ceph-mon[31636]: pgmap v2624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:48 smithi077 ceph-mon[27902]: pgmap v2624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:48 smithi170 ceph-mon[31212]: pgmap v2624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4740.104125 secs 2024-04-21T11:43:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4740.104125 secs 2024-04-21T11:43:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4740.104125 secs 2024-04-21T11:43:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:50 smithi191 ceph-mon[31636]: pgmap v2625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:50 smithi170 ceph-mon[31212]: pgmap v2625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:50 smithi077 ceph-mon[27902]: pgmap v2625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4743.344232 secs 2024-04-21T11:43:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:52 smithi191 ceph-mon[31636]: pgmap v2626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4743.344232 secs 2024-04-21T11:43:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:52 smithi170 ceph-mon[31212]: pgmap v2626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4743.344232 secs 2024-04-21T11:43:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:52 smithi077 ceph-mon[27902]: pgmap v2626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd7003c000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd7003c000 comp rx=0 tx=0).stop 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4760 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T11:43:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:43:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.409+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T11:43:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.419+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000081) for more than 900000000 us, fault. 2024-04-21T11:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T11:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T11:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.419+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T11:43:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4745.104230 secs 2024-04-21T11:43:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:54 smithi191 ceph-mon[31636]: pgmap v2627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.999+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:43:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.999+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:43:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:54.999+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:43:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:43:55.000+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:43:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4745.104230 secs 2024-04-21T11:43:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:54 smithi170 ceph-mon[31212]: pgmap v2627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:43:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4745.104230 secs 2024-04-21T11:43:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:54 smithi077 ceph-mon[27902]: pgmap v2627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:56 smithi191 ceph-mon[31636]: pgmap v2628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:56 smithi170 ceph-mon[31212]: pgmap v2628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:56 smithi077 ceph-mon[27902]: pgmap v2628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:43:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4748.344367 secs 2024-04-21T11:43:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4748.344367 secs 2024-04-21T11:43:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4748.344367 secs 2024-04-21T11:43:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:58 smithi191 ceph-mon[31636]: pgmap v2629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:58 smithi170 ceph-mon[31212]: pgmap v2629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:58 smithi077 ceph-mon[27902]: pgmap v2629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:43:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4750.104360 secs 2024-04-21T11:44:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4750.104360 secs 2024-04-21T11:44:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4750.104360 secs 2024-04-21T11:44:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:00 smithi191 ceph-mon[31636]: pgmap v2630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:00 smithi170 ceph-mon[31212]: pgmap v2630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:00 smithi077 ceph-mon[27902]: pgmap v2630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4753.344486 secs 2024-04-21T11:44:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:02 smithi191 ceph-mon[31636]: pgmap v2631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:03.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4753.344486 secs 2024-04-21T11:44:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:02 smithi170 ceph-mon[31212]: pgmap v2631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4753.344486 secs 2024-04-21T11:44:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:02 smithi077 ceph-mon[27902]: pgmap v2631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4755.104473 secs 2024-04-21T11:44:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:04 smithi191 ceph-mon[31636]: pgmap v2632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:04 smithi191 ceph-mon[31636]: osdmap e239: 12 total, 12 up, 12 in 2024-04-21T11:44:05.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4755.104473 secs 2024-04-21T11:44:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:04 smithi170 ceph-mon[31212]: pgmap v2632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:04 smithi170 ceph-mon[31212]: osdmap e239: 12 total, 12 up, 12 in 2024-04-21T11:44:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4755.104473 secs 2024-04-21T11:44:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:04 smithi077 ceph-mon[27902]: pgmap v2632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:04 smithi077 ceph-mon[27902]: osdmap e239: 12 total, 12 up, 12 in 2024-04-21T11:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:06 smithi191 ceph-mon[31636]: pgmap v2634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:44:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:06 smithi170 ceph-mon[31212]: pgmap v2634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:44:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:06 smithi077 ceph-mon[27902]: pgmap v2634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:44:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4758.344623 secs 2024-04-21T11:44:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:08 smithi077 ceph-mon[27902]: osdmap e240: 12 total, 12 up, 12 in 2024-04-21T11:44:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:08 smithi077 ceph-mon[27902]: pgmap v2636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:44:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4758.344623 secs 2024-04-21T11:44:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:08 smithi191 ceph-mon[31636]: osdmap e240: 12 total, 12 up, 12 in 2024-04-21T11:44:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:08 smithi191 ceph-mon[31636]: pgmap v2636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4758.344623 secs 2024-04-21T11:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:08 smithi170 ceph-mon[31212]: osdmap e240: 12 total, 12 up, 12 in 2024-04-21T11:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:08 smithi170 ceph-mon[31212]: pgmap v2636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:44:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4760.104590 secs 2024-04-21T11:44:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4760.104590 secs 2024-04-21T11:44:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4760.104590 secs 2024-04-21T11:44:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:10 smithi191 ceph-mon[31636]: pgmap v2637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:44:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:10 smithi170 ceph-mon[31212]: pgmap v2637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:44:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:10 smithi077 ceph-mon[27902]: pgmap v2637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:44:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:44:11.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:44:11.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:44:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4763.344716 secs 2024-04-21T11:44:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:12 smithi077 ceph-mon[27902]: pgmap v2638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:44:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4763.344716 secs 2024-04-21T11:44:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:12 smithi191 ceph-mon[31636]: pgmap v2638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:44:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4763.344716 secs 2024-04-21T11:44:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:12 smithi170 ceph-mon[31212]: pgmap v2638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:44:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:44:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:44:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:44:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:44:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:44:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:44:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:44:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4765.104704 secs 2024-04-21T11:44:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:14 smithi191 ceph-mon[31636]: pgmap v2639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:44:14.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4765.104704 secs 2024-04-21T11:44:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:14 smithi170 ceph-mon[31212]: pgmap v2639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:44:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4765.104704 secs 2024-04-21T11:44:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:14 smithi077 ceph-mon[27902]: pgmap v2639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:44:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:16 smithi077 ceph-mon[27902]: pgmap v2640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:44:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:16 smithi191 ceph-mon[31636]: pgmap v2640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:44:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:16 smithi170 ceph-mon[31212]: pgmap v2640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:44:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4768.344832 secs 2024-04-21T11:44:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4768.344832 secs 2024-04-21T11:44:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4768.344832 secs 2024-04-21T11:44:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:18 smithi077 ceph-mon[27902]: pgmap v2641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:44:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:18 smithi191 ceph-mon[31636]: pgmap v2641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:44:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:18 smithi170 ceph-mon[31212]: pgmap v2641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:44:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4770.104829 secs 2024-04-21T11:44:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4770.104829 secs 2024-04-21T11:44:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4770.104829 secs 2024-04-21T11:44:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:20 smithi077 ceph-mon[27902]: pgmap v2642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:44:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:20 smithi191 ceph-mon[31636]: pgmap v2642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:44:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:20 smithi170 ceph-mon[31212]: pgmap v2642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:44:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4773.344954 secs 2024-04-21T11:44:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:22 smithi077 ceph-mon[27902]: pgmap v2643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:44:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4773.344954 secs 2024-04-21T11:44:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:22 smithi191 ceph-mon[31636]: pgmap v2643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:44:23.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4773.344954 secs 2024-04-21T11:44:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:22 smithi170 ceph-mon[31212]: pgmap v2643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:44:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4775.104935 secs 2024-04-21T11:44:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:24 smithi077 ceph-mon[27902]: pgmap v2644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4775.104935 secs 2024-04-21T11:44:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:24 smithi191 ceph-mon[31636]: pgmap v2644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4775.104935 secs 2024-04-21T11:44:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:24 smithi170 ceph-mon[31212]: pgmap v2644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:26 smithi077 ceph-mon[27902]: pgmap v2645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:26 smithi191 ceph-mon[31636]: pgmap v2645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:26 smithi170 ceph-mon[31212]: pgmap v2645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4778.345069 secs 2024-04-21T11:44:28.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4778.345069 secs 2024-04-21T11:44:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4778.345069 secs 2024-04-21T11:44:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:28 smithi191 ceph-mon[31636]: pgmap v2646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:28 smithi170 ceph-mon[31212]: pgmap v2646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:28 smithi077 ceph-mon[27902]: pgmap v2646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4780.105070 secs 2024-04-21T11:44:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4780.105070 secs 2024-04-21T11:44:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4780.105070 secs 2024-04-21T11:44:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:30 smithi191 ceph-mon[31636]: pgmap v2647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:30 smithi170 ceph-mon[31212]: pgmap v2647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:30 smithi077 ceph-mon[27902]: pgmap v2647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4783.345222 secs 2024-04-21T11:44:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:32 smithi191 ceph-mon[31636]: pgmap v2648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4783.345222 secs 2024-04-21T11:44:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:32 smithi170 ceph-mon[31212]: pgmap v2648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4783.345222 secs 2024-04-21T11:44:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:32 smithi077 ceph-mon[27902]: pgmap v2648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4785.105149 secs 2024-04-21T11:44:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:34 smithi191 ceph-mon[31636]: pgmap v2649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4785.105149 secs 2024-04-21T11:44:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:34 smithi170 ceph-mon[31212]: pgmap v2649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4785.105149 secs 2024-04-21T11:44:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:34 smithi077 ceph-mon[27902]: pgmap v2649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:36 smithi191 ceph-mon[31636]: pgmap v2650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:36 smithi170 ceph-mon[31212]: pgmap v2650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:36 smithi077 ceph-mon[27902]: pgmap v2650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4788.345340 secs 2024-04-21T11:44:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4788.345340 secs 2024-04-21T11:44:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4788.345340 secs 2024-04-21T11:44:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:38 smithi170 ceph-mon[31212]: pgmap v2651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:38 smithi191 ceph-mon[31636]: pgmap v2651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:38 smithi077 ceph-mon[27902]: pgmap v2651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4790.105266 secs 2024-04-21T11:44:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4790.105266 secs 2024-04-21T11:44:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4790.105266 secs 2024-04-21T11:44:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:40 smithi191 ceph-mon[31636]: pgmap v2652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:40 smithi170 ceph-mon[31212]: pgmap v2652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:40 smithi077 ceph-mon[27902]: pgmap v2652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4793.345458 secs 2024-04-21T11:44:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:42 smithi191 ceph-mon[31636]: pgmap v2653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4793.345458 secs 2024-04-21T11:44:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:42 smithi170 ceph-mon[31212]: pgmap v2653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4793.345458 secs 2024-04-21T11:44:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:42 smithi077 ceph-mon[27902]: pgmap v2653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4795.105405 secs 2024-04-21T11:44:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:44 smithi191 ceph-mon[31636]: pgmap v2654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4795.105405 secs 2024-04-21T11:44:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:44 smithi170 ceph-mon[31212]: pgmap v2654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4795.105405 secs 2024-04-21T11:44:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:44 smithi077 ceph-mon[27902]: pgmap v2654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:46 smithi191 ceph-mon[31636]: pgmap v2655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:46 smithi170 ceph-mon[31212]: pgmap v2655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:46 smithi077 ceph-mon[27902]: pgmap v2655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4798.345565 secs 2024-04-21T11:44:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4798.345565 secs 2024-04-21T11:44:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4798.345565 secs 2024-04-21T11:44:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:48 smithi191 ceph-mon[31636]: pgmap v2656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:48 smithi077 ceph-mon[27902]: pgmap v2656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:48 smithi170 ceph-mon[31212]: pgmap v2656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4800.105538 secs 2024-04-21T11:44:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4800.105538 secs 2024-04-21T11:44:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4800.105538 secs 2024-04-21T11:44:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:50 smithi191 ceph-mon[31636]: pgmap v2657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:50 smithi170 ceph-mon[31212]: pgmap v2657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:50 smithi077 ceph-mon[27902]: pgmap v2657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4803.345683 secs 2024-04-21T11:44:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:52 smithi191 ceph-mon[31636]: pgmap v2658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:53.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4803.345683 secs 2024-04-21T11:44:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:52 smithi170 ceph-mon[31212]: pgmap v2658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4803.345683 secs 2024-04-21T11:44:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:52 smithi077 ceph-mon[27902]: pgmap v2658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4805.105672 secs 2024-04-21T11:44:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:54 smithi191 ceph-mon[31636]: pgmap v2659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4805.105672 secs 2024-04-21T11:44:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:54 smithi170 ceph-mon[31212]: pgmap v2659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:44:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4805.105672 secs 2024-04-21T11:44:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:54 smithi077 ceph-mon[27902]: pgmap v2659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:56 smithi191 ceph-mon[31636]: pgmap v2660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:56 smithi170 ceph-mon[31212]: pgmap v2660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:56 smithi077 ceph-mon[27902]: pgmap v2660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:44:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4808.345799 secs 2024-04-21T11:44:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4808.345799 secs 2024-04-21T11:44:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4808.345799 secs 2024-04-21T11:44:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:58 smithi170 ceph-mon[31212]: pgmap v2661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:58 smithi077 ceph-mon[27902]: pgmap v2661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:44:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:58 smithi191 ceph-mon[31636]: pgmap v2661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4810.105787 secs 2024-04-21T11:45:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 4995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4810.105787 secs 2024-04-21T11:45:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4810.105787 secs 2024-04-21T11:45:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:00 smithi170 ceph-mon[31212]: pgmap v2662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:00 smithi077 ceph-mon[27902]: pgmap v2662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:00 smithi191 ceph-mon[31636]: pgmap v2662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:03.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4813.345915 secs 2024-04-21T11:45:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:02 smithi170 ceph-mon[31212]: pgmap v2663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4813.345915 secs 2024-04-21T11:45:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:02 smithi077 ceph-mon[27902]: pgmap v2663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4813.345915 secs 2024-04-21T11:45:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:02 smithi191 ceph-mon[31636]: pgmap v2663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4815.105927 secs 2024-04-21T11:45:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:04 smithi170 ceph-mon[31212]: pgmap v2664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:04 smithi170 ceph-mon[31212]: osdmap e241: 12 total, 12 up, 12 in 2024-04-21T11:45:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4815.105927 secs 2024-04-21T11:45:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:04 smithi077 ceph-mon[27902]: pgmap v2664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:04 smithi077 ceph-mon[27902]: osdmap e241: 12 total, 12 up, 12 in 2024-04-21T11:45:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4815.105927 secs 2024-04-21T11:45:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:04 smithi191 ceph-mon[31636]: pgmap v2664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:04 smithi191 ceph-mon[31636]: osdmap e241: 12 total, 12 up, 12 in 2024-04-21T11:45:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:06 smithi170 ceph-mon[31212]: pgmap v2666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:45:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:06 smithi077 ceph-mon[27902]: pgmap v2666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:45:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:06 smithi191 ceph-mon[31636]: pgmap v2666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:45:08.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4818.346028 secs 2024-04-21T11:45:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:07 smithi170 ceph-mon[31212]: osdmap e242: 12 total, 12 up, 12 in 2024-04-21T11:45:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4818.346028 secs 2024-04-21T11:45:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:07 smithi191 ceph-mon[31636]: osdmap e242: 12 total, 12 up, 12 in 2024-04-21T11:45:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4818.346028 secs 2024-04-21T11:45:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:07 smithi077 ceph-mon[27902]: osdmap e242: 12 total, 12 up, 12 in 2024-04-21T11:45:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:08 smithi170 ceph-mon[31212]: pgmap v2668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:45:09.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:08 smithi077 ceph-mon[27902]: pgmap v2668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:45:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:08 smithi191 ceph-mon[31636]: pgmap v2668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:45:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4820.106046 secs 2024-04-21T11:45:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4820.106046 secs 2024-04-21T11:45:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4820.106046 secs 2024-04-21T11:45:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:10 smithi170 ceph-mon[31212]: pgmap v2669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:45:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:10 smithi077 ceph-mon[27902]: pgmap v2669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:45:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:10 smithi191 ceph-mon[31636]: pgmap v2669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:45:13.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4823.346149 secs 2024-04-21T11:45:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:12 smithi170 ceph-mon[31212]: pgmap v2670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:45:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:45:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4823.346149 secs 2024-04-21T11:45:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:12 smithi077 ceph-mon[27902]: pgmap v2670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:45:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:45:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4823.346149 secs 2024-04-21T11:45:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:12 smithi191 ceph-mon[31636]: pgmap v2670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:45:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:45:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4825.106116 secs 2024-04-21T11:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: pgmap v2671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:45:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:45:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4825.106116 secs 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: pgmap v2671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4825.106116 secs 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: pgmap v2671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:45:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:16 smithi077 ceph-mon[27902]: pgmap v2672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:45:16.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:16 smithi191 ceph-mon[31636]: pgmap v2672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:45:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:16 smithi170 ceph-mon[31212]: pgmap v2672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:45:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4828.346212 secs 2024-04-21T11:45:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4828.346212 secs 2024-04-21T11:45:18.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4828.346212 secs 2024-04-21T11:45:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:18 smithi077 ceph-mon[27902]: pgmap v2673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:45:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:18 smithi191 ceph-mon[31636]: pgmap v2673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:45:19.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:18 smithi170 ceph-mon[31212]: pgmap v2673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:45:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4830.106229 secs 2024-04-21T11:45:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4830.106229 secs 2024-04-21T11:45:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4830.106229 secs 2024-04-21T11:45:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:20 smithi077 ceph-mon[27902]: pgmap v2674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:45:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:20 smithi191 ceph-mon[31636]: pgmap v2674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:45:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:20 smithi170 ceph-mon[31212]: pgmap v2674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:45:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4833.346313 secs 2024-04-21T11:45:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:22 smithi077 ceph-mon[27902]: pgmap v2675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:45:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4833.346313 secs 2024-04-21T11:45:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:22 smithi191 ceph-mon[31636]: pgmap v2675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:45:23.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4833.346313 secs 2024-04-21T11:45:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:22 smithi170 ceph-mon[31212]: pgmap v2675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:45:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4835.106321 secs 2024-04-21T11:45:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:24 smithi077 ceph-mon[27902]: pgmap v2676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4835.106321 secs 2024-04-21T11:45:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:24 smithi191 ceph-mon[31636]: pgmap v2676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4835.106321 secs 2024-04-21T11:45:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:24 smithi170 ceph-mon[31212]: pgmap v2676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:26 smithi191 ceph-mon[31636]: pgmap v2677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:26 smithi170 ceph-mon[31212]: pgmap v2677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:26 smithi077 ceph-mon[27902]: pgmap v2677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4838.346451 secs 2024-04-21T11:45:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4838.346451 secs 2024-04-21T11:45:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4838.346451 secs 2024-04-21T11:45:28.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:28 smithi191 ceph-mon[31636]: pgmap v2678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:28 smithi170 ceph-mon[31212]: pgmap v2678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:28 smithi077 ceph-mon[27902]: pgmap v2678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4840.106439 secs 2024-04-21T11:45:30.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4840.106439 secs 2024-04-21T11:45:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4840.106439 secs 2024-04-21T11:45:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:30 smithi191 ceph-mon[31636]: pgmap v2679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:30 smithi170 ceph-mon[31212]: pgmap v2679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:30 smithi077 ceph-mon[27902]: pgmap v2679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4843.346569 secs 2024-04-21T11:45:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:32 smithi191 ceph-mon[31636]: pgmap v2680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4843.346569 secs 2024-04-21T11:45:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:32 smithi170 ceph-mon[31212]: pgmap v2680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4843.346569 secs 2024-04-21T11:45:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:32 smithi077 ceph-mon[27902]: pgmap v2680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4845.106561 secs 2024-04-21T11:45:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:34 smithi191 ceph-mon[31636]: pgmap v2681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4845.106561 secs 2024-04-21T11:45:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:34 smithi170 ceph-mon[31212]: pgmap v2681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4845.106561 secs 2024-04-21T11:45:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:34 smithi077 ceph-mon[27902]: pgmap v2681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:36 smithi191 ceph-mon[31636]: pgmap v2682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:36 smithi170 ceph-mon[31212]: pgmap v2682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:36 smithi077 ceph-mon[27902]: pgmap v2682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4848.346704 secs 2024-04-21T11:45:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4848.346704 secs 2024-04-21T11:45:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4848.346704 secs 2024-04-21T11:45:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:38 smithi170 ceph-mon[31212]: pgmap v2683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:38 smithi191 ceph-mon[31636]: pgmap v2683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:38 smithi077 ceph-mon[27902]: pgmap v2683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4850.106678 secs 2024-04-21T11:45:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4850.106678 secs 2024-04-21T11:45:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4850.106678 secs 2024-04-21T11:45:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:40 smithi191 ceph-mon[31636]: pgmap v2684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:40 smithi170 ceph-mon[31212]: pgmap v2684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:40 smithi077 ceph-mon[27902]: pgmap v2684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4853.346822 secs 2024-04-21T11:45:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:42 smithi191 ceph-mon[31636]: pgmap v2685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:43.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4853.346822 secs 2024-04-21T11:45:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:42 smithi170 ceph-mon[31212]: pgmap v2685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4853.346822 secs 2024-04-21T11:45:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:42 smithi077 ceph-mon[27902]: pgmap v2685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4855.106803 secs 2024-04-21T11:45:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:44 smithi191 ceph-mon[31636]: pgmap v2686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:45.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4855.106803 secs 2024-04-21T11:45:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:44 smithi170 ceph-mon[31212]: pgmap v2686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4855.106803 secs 2024-04-21T11:45:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:44 smithi077 ceph-mon[27902]: pgmap v2686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:46 smithi191 ceph-mon[31636]: pgmap v2687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:46 smithi170 ceph-mon[31212]: pgmap v2687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:46 smithi077 ceph-mon[27902]: pgmap v2687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4858.346931 secs 2024-04-21T11:45:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4858.346931 secs 2024-04-21T11:45:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4858.346931 secs 2024-04-21T11:45:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:48 smithi191 ceph-mon[31636]: pgmap v2688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:48 smithi077 ceph-mon[27902]: pgmap v2688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:48 smithi170 ceph-mon[31212]: pgmap v2688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4860.106925 secs 2024-04-21T11:45:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4860.106925 secs 2024-04-21T11:45:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4860.106925 secs 2024-04-21T11:45:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:50 smithi191 ceph-mon[31636]: pgmap v2689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:50 smithi170 ceph-mon[31212]: pgmap v2689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:50 smithi077 ceph-mon[27902]: pgmap v2689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4863.347029 secs 2024-04-21T11:45:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:52 smithi191 ceph-mon[31636]: pgmap v2690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:53.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4863.347029 secs 2024-04-21T11:45:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:52 smithi170 ceph-mon[31212]: pgmap v2690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4863.347029 secs 2024-04-21T11:45:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:52 smithi077 ceph-mon[27902]: pgmap v2690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4865.107033 secs 2024-04-21T11:45:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:54 smithi191 ceph-mon[31636]: pgmap v2691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:55.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4865.107033 secs 2024-04-21T11:45:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:54 smithi170 ceph-mon[31212]: pgmap v2691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:45:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4865.107033 secs 2024-04-21T11:45:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:54 smithi077 ceph-mon[27902]: pgmap v2691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:56 smithi191 ceph-mon[31636]: pgmap v2692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:56 smithi170 ceph-mon[31212]: pgmap v2692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:56 smithi077 ceph-mon[27902]: pgmap v2692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:45:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4868.347095 secs 2024-04-21T11:45:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4868.347095 secs 2024-04-21T11:45:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4868.347095 secs 2024-04-21T11:45:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:58 smithi191 ceph-mon[31636]: pgmap v2693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:58 smithi170 ceph-mon[31212]: pgmap v2693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:45:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:58 smithi077 ceph-mon[27902]: pgmap v2693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4870.107160 secs 2024-04-21T11:46:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4870.107160 secs 2024-04-21T11:46:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4870.107160 secs 2024-04-21T11:46:01.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:00 smithi170 ceph-mon[31212]: pgmap v2694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:00 smithi077 ceph-mon[27902]: pgmap v2694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:00 smithi191 ceph-mon[31636]: pgmap v2694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:03.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4873.347180 secs 2024-04-21T11:46:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:02 smithi170 ceph-mon[31212]: pgmap v2695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4873.347180 secs 2024-04-21T11:46:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:02 smithi077 ceph-mon[27902]: pgmap v2695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4873.347180 secs 2024-04-21T11:46:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:02 smithi191 ceph-mon[31636]: pgmap v2695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4875.107273 secs 2024-04-21T11:46:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:04 smithi170 ceph-mon[31212]: pgmap v2696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:04 smithi170 ceph-mon[31212]: osdmap e243: 12 total, 12 up, 12 in 2024-04-21T11:46:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4875.107273 secs 2024-04-21T11:46:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:04 smithi077 ceph-mon[27902]: pgmap v2696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:04 smithi077 ceph-mon[27902]: osdmap e243: 12 total, 12 up, 12 in 2024-04-21T11:46:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4875.107273 secs 2024-04-21T11:46:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:04 smithi191 ceph-mon[31636]: pgmap v2696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:04 smithi191 ceph-mon[31636]: osdmap e243: 12 total, 12 up, 12 in 2024-04-21T11:46:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:06 smithi170 ceph-mon[31212]: pgmap v2698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:46:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:06 smithi077 ceph-mon[27902]: pgmap v2698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:46:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:06 smithi191 ceph-mon[31636]: pgmap v2698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:46:08.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4878.347311 secs 2024-04-21T11:46:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:07 smithi170 ceph-mon[31212]: osdmap e244: 12 total, 12 up, 12 in 2024-04-21T11:46:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4878.347311 secs 2024-04-21T11:46:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:07 smithi191 ceph-mon[31636]: osdmap e244: 12 total, 12 up, 12 in 2024-04-21T11:46:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4878.347311 secs 2024-04-21T11:46:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:07 smithi077 ceph-mon[27902]: osdmap e244: 12 total, 12 up, 12 in 2024-04-21T11:46:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:08 smithi170 ceph-mon[31212]: pgmap v2700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:46:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:08 smithi077 ceph-mon[27902]: pgmap v2700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:46:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:08 smithi191 ceph-mon[31636]: pgmap v2700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:46:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4880.107389 secs 2024-04-21T11:46:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4880.107389 secs 2024-04-21T11:46:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4880.107389 secs 2024-04-21T11:46:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:10 smithi170 ceph-mon[31212]: pgmap v2701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:46:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:10 smithi077 ceph-mon[27902]: pgmap v2701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:46:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:10 smithi191 ceph-mon[31636]: pgmap v2701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:46:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4883.347440 secs 2024-04-21T11:46:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:12 smithi170 ceph-mon[31212]: pgmap v2702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:46:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4883.347440 secs 2024-04-21T11:46:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:12 smithi077 ceph-mon[27902]: pgmap v2702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:46:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4883.347440 secs 2024-04-21T11:46:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:12 smithi191 ceph-mon[31636]: pgmap v2702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:46:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4885.107507 secs 2024-04-21T11:46:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:14 smithi170 ceph-mon[31212]: pgmap v2703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:46:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:46:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:46:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:46:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:46:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4885.107507 secs 2024-04-21T11:46:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:14 smithi077 ceph-mon[27902]: pgmap v2703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:46:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:46:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:46:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:46:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:46:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4885.107507 secs 2024-04-21T11:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:14 smithi191 ceph-mon[31636]: pgmap v2703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:46:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:16 smithi170 ceph-mon[31212]: pgmap v2704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:46:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:16 smithi077 ceph-mon[27902]: pgmap v2704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:46:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:16 smithi191 ceph-mon[31636]: pgmap v2704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T11:46:18.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4888.347558 secs 2024-04-21T11:46:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4888.347558 secs 2024-04-21T11:46:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4888.347558 secs 2024-04-21T11:46:19.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:18 smithi077 ceph-mon[27902]: pgmap v2705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:46:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:18 smithi170 ceph-mon[31212]: pgmap v2705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:46:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:18 smithi191 ceph-mon[31636]: pgmap v2705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:46:20.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4890.107622 secs 2024-04-21T11:46:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4890.107622 secs 2024-04-21T11:46:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4890.107622 secs 2024-04-21T11:46:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:20 smithi170 ceph-mon[31212]: pgmap v2706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T11:46:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:20 smithi077 ceph-mon[27902]: pgmap v2706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T11:46:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:20 smithi191 ceph-mon[31636]: pgmap v2706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T11:46:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4893.347676 secs 2024-04-21T11:46:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:22 smithi170 ceph-mon[31212]: pgmap v2707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:46:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4893.347676 secs 2024-04-21T11:46:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:22 smithi077 ceph-mon[27902]: pgmap v2707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:46:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4893.347676 secs 2024-04-21T11:46:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:22 smithi191 ceph-mon[31636]: pgmap v2707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:46:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4895.107783 secs 2024-04-21T11:46:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:24 smithi170 ceph-mon[31212]: pgmap v2708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4895.107783 secs 2024-04-21T11:46:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:24 smithi077 ceph-mon[27902]: pgmap v2708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4895.107783 secs 2024-04-21T11:46:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:24 smithi191 ceph-mon[31636]: pgmap v2708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:26 smithi170 ceph-mon[31212]: pgmap v2709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:26 smithi077 ceph-mon[27902]: pgmap v2709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:26 smithi191 ceph-mon[31636]: pgmap v2709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4898.347797 secs 2024-04-21T11:46:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4898.347797 secs 2024-04-21T11:46:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4898.347797 secs 2024-04-21T11:46:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:28 smithi170 ceph-mon[31212]: pgmap v2710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:28 smithi077 ceph-mon[27902]: pgmap v2710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:28 smithi191 ceph-mon[31636]: pgmap v2710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:30.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4900.107895 secs 2024-04-21T11:46:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:29 smithi170 ceph-mon[31212]: pgmap v2711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4900.107895 secs 2024-04-21T11:46:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:29 smithi077 ceph-mon[27902]: pgmap v2711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4900.107895 secs 2024-04-21T11:46:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:29 smithi191 ceph-mon[31636]: pgmap v2711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4903.347904 secs 2024-04-21T11:46:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:32 smithi191 ceph-mon[31636]: pgmap v2712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4903.347904 secs 2024-04-21T11:46:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:32 smithi170 ceph-mon[31212]: pgmap v2712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4903.347904 secs 2024-04-21T11:46:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:32 smithi077 ceph-mon[27902]: pgmap v2712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4905.107976 secs 2024-04-21T11:46:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:34 smithi191 ceph-mon[31636]: pgmap v2713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4905.107976 secs 2024-04-21T11:46:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:34 smithi170 ceph-mon[31212]: pgmap v2713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4905.107976 secs 2024-04-21T11:46:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:34 smithi077 ceph-mon[27902]: pgmap v2713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:36 smithi191 ceph-mon[31636]: pgmap v2714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:36 smithi170 ceph-mon[31212]: pgmap v2714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:36 smithi077 ceph-mon[27902]: pgmap v2714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4908.348040 secs 2024-04-21T11:46:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4908.348040 secs 2024-04-21T11:46:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4908.348040 secs 2024-04-21T11:46:38.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:38 smithi170 ceph-mon[31212]: pgmap v2715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:38 smithi191 ceph-mon[31636]: pgmap v2715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:38 smithi077 ceph-mon[27902]: pgmap v2715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4910.108094 secs 2024-04-21T11:46:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4910.108094 secs 2024-04-21T11:46:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4910.108094 secs 2024-04-21T11:46:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:40 smithi191 ceph-mon[31636]: pgmap v2716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:40 smithi170 ceph-mon[31212]: pgmap v2716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:40 smithi077 ceph-mon[27902]: pgmap v2716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4913.348106 secs 2024-04-21T11:46:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:42 smithi191 ceph-mon[31636]: pgmap v2717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4913.348106 secs 2024-04-21T11:46:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:42 smithi170 ceph-mon[31212]: pgmap v2717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4913.348106 secs 2024-04-21T11:46:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:42 smithi077 ceph-mon[27902]: pgmap v2717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4915.108216 secs 2024-04-21T11:46:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:44 smithi191 ceph-mon[31636]: pgmap v2718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4915.108216 secs 2024-04-21T11:46:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:44 smithi170 ceph-mon[31212]: pgmap v2718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4915.108216 secs 2024-04-21T11:46:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:44 smithi077 ceph-mon[27902]: pgmap v2718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:46 smithi191 ceph-mon[31636]: pgmap v2719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:46 smithi170 ceph-mon[31212]: pgmap v2719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:46 smithi077 ceph-mon[27902]: pgmap v2719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4918.348184 secs 2024-04-21T11:46:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4918.348184 secs 2024-04-21T11:46:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4918.348184 secs 2024-04-21T11:46:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:48 smithi191 ceph-mon[31636]: pgmap v2720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:48 smithi077 ceph-mon[27902]: pgmap v2720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:48 smithi170 ceph-mon[31212]: pgmap v2720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4920.108278 secs 2024-04-21T11:46:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4920.108278 secs 2024-04-21T11:46:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4920.108278 secs 2024-04-21T11:46:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:50 smithi191 ceph-mon[31636]: pgmap v2721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:50 smithi170 ceph-mon[31212]: pgmap v2721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:50 smithi077 ceph-mon[27902]: pgmap v2721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4923.348271 secs 2024-04-21T11:46:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:52 smithi191 ceph-mon[31636]: pgmap v2722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4923.348271 secs 2024-04-21T11:46:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:52 smithi170 ceph-mon[31212]: pgmap v2722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4923.348271 secs 2024-04-21T11:46:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:52 smithi077 ceph-mon[27902]: pgmap v2722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4925.108406 secs 2024-04-21T11:46:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:54 smithi191 ceph-mon[31636]: pgmap v2723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:46:55.024+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:46:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:46:55.024+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:46:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:46:55.024+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:46:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:46:55.024+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:46:55.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4925.108406 secs 2024-04-21T11:46:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:54 smithi170 ceph-mon[31212]: pgmap v2723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:46:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4925.108406 secs 2024-04-21T11:46:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:54 smithi077 ceph-mon[27902]: pgmap v2723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:56 smithi191 ceph-mon[31636]: pgmap v2724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:56 smithi170 ceph-mon[31212]: pgmap v2724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:56 smithi077 ceph-mon[27902]: pgmap v2724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:46:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4928.348402 secs 2024-04-21T11:46:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4928.348402 secs 2024-04-21T11:46:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4928.348402 secs 2024-04-21T11:46:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:58 smithi191 ceph-mon[31636]: pgmap v2725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:58 smithi170 ceph-mon[31212]: pgmap v2725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:58 smithi077 ceph-mon[27902]: pgmap v2725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:46:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4930.108522 secs 2024-04-21T11:47:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4930.108522 secs 2024-04-21T11:47:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4930.108522 secs 2024-04-21T11:47:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:00 smithi191 ceph-mon[31636]: pgmap v2726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:01.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:00 smithi170 ceph-mon[31212]: pgmap v2726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:00 smithi077 ceph-mon[27902]: pgmap v2726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4933.348515 secs 2024-04-21T11:47:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:02 smithi191 ceph-mon[31636]: pgmap v2727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4933.348515 secs 2024-04-21T11:47:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:02 smithi170 ceph-mon[31212]: pgmap v2727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4933.348515 secs 2024-04-21T11:47:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:02 smithi077 ceph-mon[27902]: pgmap v2727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4935.108641 secs 2024-04-21T11:47:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:04 smithi170 ceph-mon[31212]: pgmap v2728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:04 smithi170 ceph-mon[31212]: osdmap e245: 12 total, 12 up, 12 in 2024-04-21T11:47:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4935.108641 secs 2024-04-21T11:47:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:04 smithi077 ceph-mon[27902]: pgmap v2728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:04 smithi077 ceph-mon[27902]: osdmap e245: 12 total, 12 up, 12 in 2024-04-21T11:47:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4935.108641 secs 2024-04-21T11:47:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:04 smithi191 ceph-mon[31636]: pgmap v2728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:04 smithi191 ceph-mon[31636]: osdmap e245: 12 total, 12 up, 12 in 2024-04-21T11:47:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:06 smithi170 ceph-mon[31212]: pgmap v2730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:47:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:06 smithi077 ceph-mon[27902]: pgmap v2730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:47:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:06 smithi191 ceph-mon[31636]: pgmap v2730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:47:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4938.348633 secs 2024-04-21T11:47:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:07 smithi170 ceph-mon[31212]: osdmap e246: 12 total, 12 up, 12 in 2024-04-21T11:47:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4938.348633 secs 2024-04-21T11:47:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:07 smithi191 ceph-mon[31636]: osdmap e246: 12 total, 12 up, 12 in 2024-04-21T11:47:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4938.348633 secs 2024-04-21T11:47:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:07 smithi077 ceph-mon[27902]: osdmap e246: 12 total, 12 up, 12 in 2024-04-21T11:47:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:08 smithi170 ceph-mon[31212]: pgmap v2732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:47:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:08 smithi077 ceph-mon[27902]: pgmap v2732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:47:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:08 smithi191 ceph-mon[31636]: pgmap v2732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:47:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4940.108706 secs 2024-04-21T11:47:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4940.108706 secs 2024-04-21T11:47:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4940.108706 secs 2024-04-21T11:47:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:10 smithi170 ceph-mon[31212]: pgmap v2733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:47:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:10 smithi077 ceph-mon[27902]: pgmap v2733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:47:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:10 smithi191 ceph-mon[31636]: pgmap v2733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:47:13.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4943.348731 secs 2024-04-21T11:47:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:12 smithi170 ceph-mon[31212]: pgmap v2734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:47:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4943.348731 secs 2024-04-21T11:47:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:12 smithi077 ceph-mon[27902]: pgmap v2734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:47:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4943.348731 secs 2024-04-21T11:47:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:12 smithi191 ceph-mon[31636]: pgmap v2734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:47:15.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4945.108821 secs 2024-04-21T11:47:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:14 smithi170 ceph-mon[31212]: pgmap v2735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:47:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4945.108821 secs 2024-04-21T11:47:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:14 smithi077 ceph-mon[27902]: pgmap v2735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:47:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4945.108821 secs 2024-04-21T11:47:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:14 smithi191 ceph-mon[31636]: pgmap v2735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:47:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:47:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:47:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:47:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:47:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:47:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:47:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:47:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:47:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:47:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:47:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:47:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:47:17.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:16 smithi170 ceph-mon[31212]: pgmap v2736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:47:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:16 smithi077 ceph-mon[27902]: pgmap v2736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:47:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:16 smithi191 ceph-mon[31636]: pgmap v2736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:47:18.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4948.348780 secs 2024-04-21T11:47:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4948.348780 secs 2024-04-21T11:47:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4948.348780 secs 2024-04-21T11:47:19.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:18 smithi077 ceph-mon[27902]: pgmap v2737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:47:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:18 smithi170 ceph-mon[31212]: pgmap v2737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:47:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:18 smithi191 ceph-mon[31636]: pgmap v2737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:47:20.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4950.108961 secs 2024-04-21T11:47:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4950.108961 secs 2024-04-21T11:47:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4950.108961 secs 2024-04-21T11:47:21.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:20 smithi170 ceph-mon[31212]: pgmap v2738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:47:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:20 smithi077 ceph-mon[27902]: pgmap v2738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:47:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:20 smithi191 ceph-mon[31636]: pgmap v2738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:47:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4953.348874 secs 2024-04-21T11:47:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:22 smithi170 ceph-mon[31212]: pgmap v2739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:47:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4953.348874 secs 2024-04-21T11:47:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:22 smithi077 ceph-mon[27902]: pgmap v2739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:47:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4953.348874 secs 2024-04-21T11:47:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:22 smithi191 ceph-mon[31636]: pgmap v2739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:47:25.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4955.109043 secs 2024-04-21T11:47:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:24 smithi170 ceph-mon[31212]: pgmap v2740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4955.109043 secs 2024-04-21T11:47:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:24 smithi077 ceph-mon[27902]: pgmap v2740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4955.109043 secs 2024-04-21T11:47:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:24 smithi191 ceph-mon[31636]: pgmap v2740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:27.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:26 smithi170 ceph-mon[31212]: pgmap v2741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:26 smithi077 ceph-mon[27902]: pgmap v2741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:26 smithi191 ceph-mon[31636]: pgmap v2741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:28.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4958.348936 secs 2024-04-21T11:47:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4958.348936 secs 2024-04-21T11:47:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4958.348936 secs 2024-04-21T11:47:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:28 smithi170 ceph-mon[31212]: pgmap v2742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:28 smithi077 ceph-mon[27902]: pgmap v2742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:28 smithi191 ceph-mon[31636]: pgmap v2742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4960.109165 secs 2024-04-21T11:47:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4960.109165 secs 2024-04-21T11:47:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4960.109165 secs 2024-04-21T11:47:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:30 smithi170 ceph-mon[31212]: pgmap v2743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:30 smithi077 ceph-mon[27902]: pgmap v2743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:30 smithi191 ceph-mon[31636]: pgmap v2743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4963.349043 secs 2024-04-21T11:47:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:32 smithi170 ceph-mon[31212]: pgmap v2744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4963.349043 secs 2024-04-21T11:47:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:32 smithi077 ceph-mon[27902]: pgmap v2744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4963.349043 secs 2024-04-21T11:47:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:32 smithi191 ceph-mon[31636]: pgmap v2744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4965.109245 secs 2024-04-21T11:47:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:34 smithi170 ceph-mon[31212]: pgmap v2745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4965.109245 secs 2024-04-21T11:47:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:34 smithi077 ceph-mon[27902]: pgmap v2745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4965.109245 secs 2024-04-21T11:47:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:34 smithi191 ceph-mon[31636]: pgmap v2745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:36 smithi170 ceph-mon[31212]: pgmap v2746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:47:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:36 smithi077 ceph-mon[27902]: pgmap v2746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:47:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:36 smithi191 ceph-mon[31636]: pgmap v2746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T11:47:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4968.349157 secs 2024-04-21T11:47:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4968.349157 secs 2024-04-21T11:47:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4968.349157 secs 2024-04-21T11:47:39.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:38 smithi170 ceph-mon[31212]: pgmap v2747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:38 smithi077 ceph-mon[27902]: pgmap v2747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:38 smithi191 ceph-mon[31636]: pgmap v2747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4970.109361 secs 2024-04-21T11:47:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:39 smithi077 ceph-mon[27902]: pgmap v2748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4970.109361 secs 2024-04-21T11:47:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:39 smithi191 ceph-mon[31636]: pgmap v2748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4970.109361 secs 2024-04-21T11:47:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:39 smithi170 ceph-mon[31212]: pgmap v2748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4973.349292 secs 2024-04-21T11:47:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:42 smithi191 ceph-mon[31636]: pgmap v2749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4973.349292 secs 2024-04-21T11:47:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:42 smithi170 ceph-mon[31212]: pgmap v2749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4973.349292 secs 2024-04-21T11:47:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:42 smithi077 ceph-mon[27902]: pgmap v2749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4975.109497 secs 2024-04-21T11:47:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:44 smithi191 ceph-mon[31636]: pgmap v2750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:45.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4975.109497 secs 2024-04-21T11:47:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:44 smithi170 ceph-mon[31212]: pgmap v2750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4975.109497 secs 2024-04-21T11:47:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:44 smithi077 ceph-mon[27902]: pgmap v2750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:47:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:46 smithi191 ceph-mon[31636]: pgmap v2751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:46 smithi170 ceph-mon[31212]: pgmap v2751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:46 smithi077 ceph-mon[27902]: pgmap v2751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4978.349355 secs 2024-04-21T11:47:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4978.349355 secs 2024-04-21T11:47:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4978.349355 secs 2024-04-21T11:47:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:48 smithi191 ceph-mon[31636]: pgmap v2752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:48 smithi077 ceph-mon[27902]: pgmap v2752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:48 smithi170 ceph-mon[31212]: pgmap v2752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4980.109630 secs 2024-04-21T11:47:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4980.109630 secs 2024-04-21T11:47:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4980.109630 secs 2024-04-21T11:47:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:50 smithi191 ceph-mon[31636]: pgmap v2753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:50 smithi170 ceph-mon[31212]: pgmap v2753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:50 smithi077 ceph-mon[27902]: pgmap v2753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4983.349445 secs 2024-04-21T11:47:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:52 smithi191 ceph-mon[31636]: pgmap v2754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:53.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4983.349445 secs 2024-04-21T11:47:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:52 smithi170 ceph-mon[31212]: pgmap v2754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4983.349445 secs 2024-04-21T11:47:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:52 smithi077 ceph-mon[27902]: pgmap v2754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4985.109735 secs 2024-04-21T11:47:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:54 smithi191 ceph-mon[31636]: pgmap v2755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:55.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4985.109735 secs 2024-04-21T11:47:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:54 smithi170 ceph-mon[31212]: pgmap v2755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:47:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4985.109735 secs 2024-04-21T11:47:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:54 smithi077 ceph-mon[27902]: pgmap v2755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:56 smithi191 ceph-mon[31636]: pgmap v2756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:56 smithi170 ceph-mon[31212]: pgmap v2756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:56 smithi077 ceph-mon[27902]: pgmap v2756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:47:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4988.349562 secs 2024-04-21T11:47:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4988.349562 secs 2024-04-21T11:47:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4988.349562 secs 2024-04-21T11:47:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:58 smithi191 ceph-mon[31636]: pgmap v2757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:58 smithi170 ceph-mon[31212]: pgmap v2757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:58 smithi077 ceph-mon[27902]: pgmap v2757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:47:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:47:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4990.109822 secs 2024-04-21T11:48:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:47:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4990.109822 secs 2024-04-21T11:48:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:47:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4990.109822 secs 2024-04-21T11:48:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:00 smithi191 ceph-mon[31636]: pgmap v2758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:00 smithi170 ceph-mon[31212]: pgmap v2758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:00 smithi077 ceph-mon[27902]: pgmap v2758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4993.349681 secs 2024-04-21T11:48:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:02 smithi191 ceph-mon[31636]: pgmap v2759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:03.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4993.349681 secs 2024-04-21T11:48:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:02 smithi170 ceph-mon[31212]: pgmap v2759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4993.349681 secs 2024-04-21T11:48:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:02 smithi077 ceph-mon[27902]: pgmap v2759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 4995.109932 secs 2024-04-21T11:48:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:04 smithi191 ceph-mon[31636]: pgmap v2760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:04 smithi191 ceph-mon[31636]: osdmap e247: 12 total, 12 up, 12 in 2024-04-21T11:48:05.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 4995.109932 secs 2024-04-21T11:48:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:04 smithi170 ceph-mon[31212]: pgmap v2760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:04 smithi170 ceph-mon[31212]: osdmap e247: 12 total, 12 up, 12 in 2024-04-21T11:48:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 4995.109932 secs 2024-04-21T11:48:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:04 smithi077 ceph-mon[27902]: pgmap v2760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:04 smithi077 ceph-mon[27902]: osdmap e247: 12 total, 12 up, 12 in 2024-04-21T11:48:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:06 smithi191 ceph-mon[31636]: pgmap v2762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:48:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:06 smithi170 ceph-mon[31212]: pgmap v2762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:48:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:06 smithi077 ceph-mon[27902]: pgmap v2762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:48:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 4998.349754 secs 2024-04-21T11:48:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:07 smithi191 ceph-mon[31636]: osdmap e248: 12 total, 12 up, 12 in 2024-04-21T11:48:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 4998.349754 secs 2024-04-21T11:48:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:07 smithi170 ceph-mon[31212]: osdmap e248: 12 total, 12 up, 12 in 2024-04-21T11:48:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 4998.349754 secs 2024-04-21T11:48:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:07 smithi077 ceph-mon[27902]: osdmap e248: 12 total, 12 up, 12 in 2024-04-21T11:48:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:08 smithi191 ceph-mon[31636]: pgmap v2764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:48:09.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:08 smithi170 ceph-mon[31212]: pgmap v2764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:48:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:08 smithi077 ceph-mon[27902]: pgmap v2764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:48:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5000.110051 secs 2024-04-21T11:48:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5000.110051 secs 2024-04-21T11:48:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5000.110051 secs 2024-04-21T11:48:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:10 smithi170 ceph-mon[31212]: pgmap v2765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:48:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:10 smithi077 ceph-mon[27902]: pgmap v2765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:48:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:10 smithi191 ceph-mon[31636]: pgmap v2765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:48:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5003.349861 secs 2024-04-21T11:48:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:12 smithi170 ceph-mon[31212]: pgmap v2766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:48:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5003.349861 secs 2024-04-21T11:48:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:12 smithi077 ceph-mon[27902]: pgmap v2766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:48:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5003.349861 secs 2024-04-21T11:48:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:12 smithi191 ceph-mon[31636]: pgmap v2766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:48:15.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5005.110168 secs 2024-04-21T11:48:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:14 smithi170 ceph-mon[31212]: pgmap v2767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:48:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5005.110168 secs 2024-04-21T11:48:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:14 smithi077 ceph-mon[27902]: pgmap v2767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:48:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5005.110168 secs 2024-04-21T11:48:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:14 smithi191 ceph-mon[31636]: pgmap v2767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:48:16.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:48:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:48:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:48:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:16 smithi170 ceph-mon[31212]: pgmap v2768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:48:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:48:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:48:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:48:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:16 smithi077 ceph-mon[27902]: pgmap v2768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:48:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:48:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:48:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:48:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:16 smithi191 ceph-mon[31636]: pgmap v2768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:48:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:48:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:48:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:48:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5008.349952 secs 2024-04-21T11:48:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5008.349952 secs 2024-04-21T11:48:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5008.349952 secs 2024-04-21T11:48:19.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:18 smithi077 ceph-mon[27902]: pgmap v2769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:48:19.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:18 smithi170 ceph-mon[31212]: pgmap v2769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:48:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:18 smithi191 ceph-mon[31636]: pgmap v2769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:48:20.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5010.110284 secs 2024-04-21T11:48:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5010.110284 secs 2024-04-21T11:48:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5010.110284 secs 2024-04-21T11:48:21.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:20 smithi170 ceph-mon[31212]: pgmap v2770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:48:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:20 smithi077 ceph-mon[27902]: pgmap v2770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:48:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:20 smithi191 ceph-mon[31636]: pgmap v2770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:48:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5013.350071 secs 2024-04-21T11:48:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:22 smithi170 ceph-mon[31212]: pgmap v2771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:48:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5013.350071 secs 2024-04-21T11:48:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:22 smithi077 ceph-mon[27902]: pgmap v2771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:48:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5013.350071 secs 2024-04-21T11:48:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:22 smithi191 ceph-mon[31636]: pgmap v2771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:48:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5015.110410 secs 2024-04-21T11:48:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:24 smithi170 ceph-mon[31212]: pgmap v2772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5015.110410 secs 2024-04-21T11:48:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:24 smithi077 ceph-mon[27902]: pgmap v2772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5015.110410 secs 2024-04-21T11:48:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:24 smithi191 ceph-mon[31636]: pgmap v2772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:27.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:26 smithi170 ceph-mon[31212]: pgmap v2773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:26 smithi077 ceph-mon[27902]: pgmap v2773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:26 smithi191 ceph-mon[31636]: pgmap v2773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:28.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5018.350207 secs 2024-04-21T11:48:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5018.350207 secs 2024-04-21T11:48:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5018.350207 secs 2024-04-21T11:48:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:28 smithi170 ceph-mon[31212]: pgmap v2774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:28 smithi077 ceph-mon[27902]: pgmap v2774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:28 smithi191 ceph-mon[31636]: pgmap v2774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:30.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5020.110532 secs 2024-04-21T11:48:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5020.110532 secs 2024-04-21T11:48:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5020.110532 secs 2024-04-21T11:48:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:30 smithi170 ceph-mon[31212]: pgmap v2775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:30 smithi077 ceph-mon[27902]: pgmap v2775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:30 smithi191 ceph-mon[31636]: pgmap v2775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5023.350330 secs 2024-04-21T11:48:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:32 smithi170 ceph-mon[31212]: pgmap v2776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5023.350330 secs 2024-04-21T11:48:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:32 smithi077 ceph-mon[27902]: pgmap v2776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5023.350330 secs 2024-04-21T11:48:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:32 smithi191 ceph-mon[31636]: pgmap v2776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5025.110666 secs 2024-04-21T11:48:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:34 smithi170 ceph-mon[31212]: pgmap v2777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5025.110666 secs 2024-04-21T11:48:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:34 smithi077 ceph-mon[27902]: pgmap v2777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5025.110666 secs 2024-04-21T11:48:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:34 smithi191 ceph-mon[31636]: pgmap v2777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:36 smithi170 ceph-mon[31212]: pgmap v2778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:36 smithi077 ceph-mon[27902]: pgmap v2778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:36 smithi191 ceph-mon[31636]: pgmap v2778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5028.350402 secs 2024-04-21T11:48:38.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5028.350402 secs 2024-04-21T11:48:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5028.350402 secs 2024-04-21T11:48:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:38 smithi170 ceph-mon[31212]: pgmap v2779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:38 smithi077 ceph-mon[27902]: pgmap v2779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:38 smithi191 ceph-mon[31636]: pgmap v2779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5030.110783 secs 2024-04-21T11:48:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5030.110783 secs 2024-04-21T11:48:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5030.110783 secs 2024-04-21T11:48:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:40 smithi170 ceph-mon[31212]: pgmap v2780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:40 smithi077 ceph-mon[27902]: pgmap v2780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:40 smithi191 ceph-mon[31636]: pgmap v2780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5033.350536 secs 2024-04-21T11:48:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:42 smithi077 ceph-mon[27902]: pgmap v2781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5033.350536 secs 2024-04-21T11:48:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:42 smithi191 ceph-mon[31636]: pgmap v2781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5033.350536 secs 2024-04-21T11:48:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:42 smithi170 ceph-mon[31212]: pgmap v2781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:43 smithi077 ceph-mon[27902]: pgmap v2782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:43 smithi191 ceph-mon[31636]: pgmap v2782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:43 smithi170 ceph-mon[31212]: pgmap v2782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5035.110899 secs 2024-04-21T11:48:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5035.110899 secs 2024-04-21T11:48:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5035.110899 secs 2024-04-21T11:48:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:45 smithi077 ceph-mon[27902]: pgmap v2783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:45 smithi191 ceph-mon[31636]: pgmap v2783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:46.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:45 smithi170 ceph-mon[31212]: pgmap v2783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5038.350607 secs 2024-04-21T11:48:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5038.350607 secs 2024-04-21T11:48:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5038.350607 secs 2024-04-21T11:48:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:48 smithi170 ceph-mon[31212]: pgmap v2784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:48 smithi077 ceph-mon[27902]: pgmap v2784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:48 smithi191 ceph-mon[31636]: pgmap v2784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:49.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5040.111018 secs 2024-04-21T11:48:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5040.111018 secs 2024-04-21T11:48:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5040.111018 secs 2024-04-21T11:48:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:50 smithi170 ceph-mon[31212]: pgmap v2785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:50 smithi077 ceph-mon[27902]: pgmap v2785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:50 smithi191 ceph-mon[31636]: pgmap v2785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5043.350728 secs 2024-04-21T11:48:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:52 smithi191 ceph-mon[31636]: pgmap v2786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5043.350728 secs 2024-04-21T11:48:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:52 smithi170 ceph-mon[31212]: pgmap v2786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5043.350728 secs 2024-04-21T11:48:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:52 smithi077 ceph-mon[27902]: pgmap v2786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5045.111133 secs 2024-04-21T11:48:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:54 smithi191 ceph-mon[31636]: pgmap v2787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5045.111133 secs 2024-04-21T11:48:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:54 smithi170 ceph-mon[31212]: pgmap v2787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:48:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5045.111133 secs 2024-04-21T11:48:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:54 smithi077 ceph-mon[27902]: pgmap v2787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:56 smithi191 ceph-mon[31636]: pgmap v2788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:56 smithi170 ceph-mon[31212]: pgmap v2788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:56 smithi077 ceph-mon[27902]: pgmap v2788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:48:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5048.350824 secs 2024-04-21T11:48:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5048.350824 secs 2024-04-21T11:48:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5048.350824 secs 2024-04-21T11:48:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:58 smithi191 ceph-mon[31636]: pgmap v2789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:58 smithi170 ceph-mon[31212]: pgmap v2789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:58 smithi077 ceph-mon[27902]: pgmap v2789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:48:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:48:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5050.111248 secs 2024-04-21T11:49:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:48:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5050.111248 secs 2024-04-21T11:49:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:48:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5050.111248 secs 2024-04-21T11:49:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:00 smithi191 ceph-mon[31636]: pgmap v2790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:00 smithi170 ceph-mon[31212]: pgmap v2790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:00 smithi077 ceph-mon[27902]: pgmap v2790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5053.350950 secs 2024-04-21T11:49:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:02 smithi191 ceph-mon[31636]: pgmap v2791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:03.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5053.350950 secs 2024-04-21T11:49:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:02 smithi170 ceph-mon[31212]: pgmap v2791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5053.350950 secs 2024-04-21T11:49:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:02 smithi077 ceph-mon[27902]: pgmap v2791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5055.111362 secs 2024-04-21T11:49:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:04 smithi191 ceph-mon[31636]: pgmap v2792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:04 smithi191 ceph-mon[31636]: osdmap e249: 12 total, 12 up, 12 in 2024-04-21T11:49:05.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5055.111362 secs 2024-04-21T11:49:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:04 smithi170 ceph-mon[31212]: pgmap v2792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:04 smithi170 ceph-mon[31212]: osdmap e249: 12 total, 12 up, 12 in 2024-04-21T11:49:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5055.111362 secs 2024-04-21T11:49:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:04 smithi077 ceph-mon[27902]: pgmap v2792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:04 smithi077 ceph-mon[27902]: osdmap e249: 12 total, 12 up, 12 in 2024-04-21T11:49:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:06 smithi191 ceph-mon[31636]: pgmap v2794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:49:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:06 smithi170 ceph-mon[31212]: pgmap v2794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:49:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:06 smithi077 ceph-mon[27902]: pgmap v2794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:49:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5058.351028 secs 2024-04-21T11:49:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:07 smithi191 ceph-mon[31636]: osdmap e250: 12 total, 12 up, 12 in 2024-04-21T11:49:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5058.351028 secs 2024-04-21T11:49:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:07 smithi170 ceph-mon[31212]: osdmap e250: 12 total, 12 up, 12 in 2024-04-21T11:49:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5058.351028 secs 2024-04-21T11:49:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:07 smithi077 ceph-mon[27902]: osdmap e250: 12 total, 12 up, 12 in 2024-04-21T11:49:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:08 smithi191 ceph-mon[31636]: pgmap v2796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:49:09.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:08 smithi170 ceph-mon[31212]: pgmap v2796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:49:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:08 smithi077 ceph-mon[27902]: pgmap v2796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:49:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5060.111505 secs 2024-04-21T11:49:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5060.111505 secs 2024-04-21T11:49:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5060.111505 secs 2024-04-21T11:49:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:10 smithi170 ceph-mon[31212]: pgmap v2797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:49:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:10 smithi077 ceph-mon[27902]: pgmap v2797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:49:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:10 smithi191 ceph-mon[31636]: pgmap v2797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:49:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5063.351145 secs 2024-04-21T11:49:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:12 smithi170 ceph-mon[31212]: pgmap v2798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:49:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5063.351145 secs 2024-04-21T11:49:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:12 smithi077 ceph-mon[27902]: pgmap v2798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:49:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5063.351145 secs 2024-04-21T11:49:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:12 smithi191 ceph-mon[31636]: pgmap v2798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:49:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5065.111622 secs 2024-04-21T11:49:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:14 smithi170 ceph-mon[31212]: pgmap v2799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:49:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5065.111622 secs 2024-04-21T11:49:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:14 smithi077 ceph-mon[27902]: pgmap v2799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:49:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5065.111622 secs 2024-04-21T11:49:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:14 smithi191 ceph-mon[31636]: pgmap v2799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:49:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:16 smithi170 ceph-mon[31212]: pgmap v2800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:49:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:49:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:16 smithi077 ceph-mon[27902]: pgmap v2800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:49:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:49:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:16 smithi191 ceph-mon[31636]: pgmap v2800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:49:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:49:17.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5068.351235 secs 2024-04-21T11:49:18.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5068.351235 secs 2024-04-21T11:49:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5068.351235 secs 2024-04-21T11:49:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:18 smithi077 ceph-mon[27902]: pgmap v2801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:49:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:18 smithi170 ceph-mon[31212]: pgmap v2801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:49:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:18 smithi191 ceph-mon[31636]: pgmap v2801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:49:20.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5070.111772 secs 2024-04-21T11:49:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5070.111772 secs 2024-04-21T11:49:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5070.111772 secs 2024-04-21T11:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:20 smithi170 ceph-mon[31212]: pgmap v2802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:20 smithi077 ceph-mon[27902]: pgmap v2802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:49:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:49:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:49:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:20 smithi191 ceph-mon[31636]: pgmap v2802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:49:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:49:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:49:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:49:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5073.351388 secs 2024-04-21T11:49:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:22 smithi170 ceph-mon[31212]: pgmap v2803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:49:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5073.351388 secs 2024-04-21T11:49:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:22 smithi077 ceph-mon[27902]: pgmap v2803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:49:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5073.351388 secs 2024-04-21T11:49:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:22 smithi191 ceph-mon[31636]: pgmap v2803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:49:25.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5075.111932 secs 2024-04-21T11:49:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:24 smithi170 ceph-mon[31212]: pgmap v2804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5075.111932 secs 2024-04-21T11:49:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:24 smithi077 ceph-mon[27902]: pgmap v2804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5075.111932 secs 2024-04-21T11:49:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:24 smithi191 ceph-mon[31636]: pgmap v2804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:26 smithi170 ceph-mon[31212]: pgmap v2805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:26 smithi077 ceph-mon[27902]: pgmap v2805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:26 smithi191 ceph-mon[31636]: pgmap v2805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5078.351484 secs 2024-04-21T11:49:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5078.351484 secs 2024-04-21T11:49:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5078.351484 secs 2024-04-21T11:49:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:28 smithi170 ceph-mon[31212]: pgmap v2806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:28 smithi077 ceph-mon[27902]: pgmap v2806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:28 smithi191 ceph-mon[31636]: pgmap v2806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5080.112042 secs 2024-04-21T11:49:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5080.112042 secs 2024-04-21T11:49:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5080.112042 secs 2024-04-21T11:49:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:30 smithi077 ceph-mon[27902]: pgmap v2807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:30 smithi170 ceph-mon[31212]: pgmap v2807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:30 smithi191 ceph-mon[31636]: pgmap v2807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5083.351555 secs 2024-04-21T11:49:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:32 smithi170 ceph-mon[31212]: pgmap v2808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5083.351555 secs 2024-04-21T11:49:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:32 smithi077 ceph-mon[27902]: pgmap v2808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5083.351555 secs 2024-04-21T11:49:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:32 smithi191 ceph-mon[31636]: pgmap v2808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:35.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5085.112158 secs 2024-04-21T11:49:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:34 smithi170 ceph-mon[31212]: pgmap v2809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5085.112158 secs 2024-04-21T11:49:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:34 smithi077 ceph-mon[27902]: pgmap v2809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5085.112158 secs 2024-04-21T11:49:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:34 smithi191 ceph-mon[31636]: pgmap v2809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:36 smithi170 ceph-mon[31212]: pgmap v2810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:36 smithi077 ceph-mon[27902]: pgmap v2810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:36 smithi191 ceph-mon[31636]: pgmap v2810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5088.351689 secs 2024-04-21T11:49:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5088.351689 secs 2024-04-21T11:49:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5088.351689 secs 2024-04-21T11:49:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:38 smithi170 ceph-mon[31212]: pgmap v2811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:38 smithi077 ceph-mon[27902]: pgmap v2811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:38 smithi191 ceph-mon[31636]: pgmap v2811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5090.112278 secs 2024-04-21T11:49:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5090.112278 secs 2024-04-21T11:49:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5090.112278 secs 2024-04-21T11:49:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:40 smithi077 ceph-mon[27902]: pgmap v2812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:40 smithi191 ceph-mon[31636]: pgmap v2812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:40 smithi170 ceph-mon[31212]: pgmap v2812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5093.351814 secs 2024-04-21T11:49:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:42 smithi077 ceph-mon[27902]: pgmap v2813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5093.351814 secs 2024-04-21T11:49:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:42 smithi191 ceph-mon[31636]: pgmap v2813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5093.351814 secs 2024-04-21T11:49:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:42 smithi170 ceph-mon[31212]: pgmap v2813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5095.112413 secs 2024-04-21T11:49:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:44 smithi077 ceph-mon[27902]: pgmap v2814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5095.112413 secs 2024-04-21T11:49:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:44 smithi191 ceph-mon[31636]: pgmap v2814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5095.112413 secs 2024-04-21T11:49:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:44 smithi170 ceph-mon[31212]: pgmap v2814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:46 smithi077 ceph-mon[27902]: pgmap v2815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:46 smithi191 ceph-mon[31636]: pgmap v2815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:46 smithi170 ceph-mon[31212]: pgmap v2815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5098.351888 secs 2024-04-21T11:49:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5098.351888 secs 2024-04-21T11:49:48.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5098.351888 secs 2024-04-21T11:49:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:48 smithi077 ceph-mon[27902]: pgmap v2816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:48 smithi191 ceph-mon[31636]: pgmap v2816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:48 smithi170 ceph-mon[31212]: pgmap v2816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5100.112547 secs 2024-04-21T11:49:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:49 smithi077 ceph-mon[27902]: pgmap v2817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5100.112547 secs 2024-04-21T11:49:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:49 smithi191 ceph-mon[31636]: pgmap v2817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5100.112547 secs 2024-04-21T11:49:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:49 smithi170 ceph-mon[31212]: pgmap v2817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5103.351972 secs 2024-04-21T11:49:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:52 smithi191 ceph-mon[31636]: pgmap v2818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5103.351972 secs 2024-04-21T11:49:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:52 smithi170 ceph-mon[31212]: pgmap v2818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5103.351972 secs 2024-04-21T11:49:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:52 smithi077 ceph-mon[27902]: pgmap v2818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5105.112670 secs 2024-04-21T11:49:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:54 smithi191 ceph-mon[31636]: pgmap v2819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:49:55.048+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:49:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:49:55.048+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:49:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:49:55.048+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:49:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:49:55.048+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:49:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5105.112670 secs 2024-04-21T11:49:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:54 smithi170 ceph-mon[31212]: pgmap v2819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:49:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5105.112670 secs 2024-04-21T11:49:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:54 smithi077 ceph-mon[27902]: pgmap v2819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:56 smithi191 ceph-mon[31636]: pgmap v2820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:56 smithi170 ceph-mon[31212]: pgmap v2820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:56 smithi077 ceph-mon[27902]: pgmap v2820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:49:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5108.352106 secs 2024-04-21T11:49:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5108.352106 secs 2024-04-21T11:49:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5108.352106 secs 2024-04-21T11:49:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:58 smithi191 ceph-mon[31636]: pgmap v2821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:58 smithi170 ceph-mon[31212]: pgmap v2821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:58 smithi077 ceph-mon[27902]: pgmap v2821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:49:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:49:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5110.112784 secs 2024-04-21T11:50:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:49:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5110.112784 secs 2024-04-21T11:50:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:49:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5110.112784 secs 2024-04-21T11:50:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:00 smithi191 ceph-mon[31636]: pgmap v2822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:50:01.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:00 smithi170 ceph-mon[31212]: pgmap v2822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:50:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:00 smithi077 ceph-mon[27902]: pgmap v2822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T11:50:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5113.352170 secs 2024-04-21T11:50:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:02 smithi191 ceph-mon[31636]: pgmap v2823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5113.352170 secs 2024-04-21T11:50:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:02 smithi170 ceph-mon[31212]: pgmap v2823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5113.352170 secs 2024-04-21T11:50:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:02 smithi077 ceph-mon[27902]: pgmap v2823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5115.112900 secs 2024-04-21T11:50:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:04 smithi170 ceph-mon[31212]: pgmap v2824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:04 smithi170 ceph-mon[31212]: osdmap e251: 12 total, 12 up, 12 in 2024-04-21T11:50:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5115.112900 secs 2024-04-21T11:50:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:04 smithi077 ceph-mon[27902]: pgmap v2824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:04 smithi077 ceph-mon[27902]: osdmap e251: 12 total, 12 up, 12 in 2024-04-21T11:50:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5115.112900 secs 2024-04-21T11:50:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:04 smithi191 ceph-mon[31636]: pgmap v2824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:04 smithi191 ceph-mon[31636]: osdmap e251: 12 total, 12 up, 12 in 2024-04-21T11:50:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:06 smithi170 ceph-mon[31212]: pgmap v2826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:50:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:06 smithi077 ceph-mon[27902]: pgmap v2826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:50:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:06 smithi191 ceph-mon[31636]: pgmap v2826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:50:08.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5118.352290 secs 2024-04-21T11:50:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:07 smithi170 ceph-mon[31212]: osdmap e252: 12 total, 12 up, 12 in 2024-04-21T11:50:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5118.352290 secs 2024-04-21T11:50:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:07 smithi191 ceph-mon[31636]: osdmap e252: 12 total, 12 up, 12 in 2024-04-21T11:50:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5118.352290 secs 2024-04-21T11:50:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:07 smithi077 ceph-mon[27902]: osdmap e252: 12 total, 12 up, 12 in 2024-04-21T11:50:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:08 smithi170 ceph-mon[31212]: pgmap v2828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:50:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:08 smithi077 ceph-mon[27902]: pgmap v2828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:50:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:08 smithi191 ceph-mon[31636]: pgmap v2828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:50:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5120.113035 secs 2024-04-21T11:50:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5120.113035 secs 2024-04-21T11:50:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5120.113035 secs 2024-04-21T11:50:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:10 smithi170 ceph-mon[31212]: pgmap v2829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:50:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:10 smithi077 ceph-mon[27902]: pgmap v2829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:50:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:10 smithi191 ceph-mon[31636]: pgmap v2829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:50:13.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5123.352404 secs 2024-04-21T11:50:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:12 smithi170 ceph-mon[31212]: pgmap v2830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:50:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5123.352404 secs 2024-04-21T11:50:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:12 smithi077 ceph-mon[27902]: pgmap v2830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:50:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5123.352404 secs 2024-04-21T11:50:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:12 smithi191 ceph-mon[31636]: pgmap v2830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:50:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5125.113152 secs 2024-04-21T11:50:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:14 smithi170 ceph-mon[31212]: pgmap v2831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:50:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5125.113152 secs 2024-04-21T11:50:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:14 smithi077 ceph-mon[27902]: pgmap v2831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:50:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5125.113152 secs 2024-04-21T11:50:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:14 smithi191 ceph-mon[31636]: pgmap v2831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:50:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:16 smithi170 ceph-mon[31212]: pgmap v2832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:50:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:16 smithi077 ceph-mon[27902]: pgmap v2832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:50:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:16 smithi191 ceph-mon[31636]: pgmap v2832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:50:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5128.352524 secs 2024-04-21T11:50:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5128.352524 secs 2024-04-21T11:50:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5128.352524 secs 2024-04-21T11:50:19.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:18 smithi077 ceph-mon[27902]: pgmap v2833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:50:19.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:18 smithi170 ceph-mon[31212]: pgmap v2833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:50:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:18 smithi191 ceph-mon[31636]: pgmap v2833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:50:20.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5130.113266 secs 2024-04-21T11:50:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5130.113266 secs 2024-04-21T11:50:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5130.113266 secs 2024-04-21T11:50:21.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:20 smithi170 ceph-mon[31212]: pgmap v2834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:50:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:20 smithi077 ceph-mon[27902]: pgmap v2834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:50:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:20 smithi191 ceph-mon[31636]: pgmap v2834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:50:22.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:50:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:50:22.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:50:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5133.352614 secs 2024-04-21T11:50:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:22 smithi170 ceph-mon[31212]: pgmap v2835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:50:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5133.352614 secs 2024-04-21T11:50:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:22 smithi077 ceph-mon[27902]: pgmap v2835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:50:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5133.352614 secs 2024-04-21T11:50:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:22 smithi191 ceph-mon[31636]: pgmap v2835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:50:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5135.113374 secs 2024-04-21T11:50:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:24 smithi191 ceph-mon[31636]: pgmap v2836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5135.113374 secs 2024-04-21T11:50:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:24 smithi170 ceph-mon[31212]: pgmap v2836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5135.113374 secs 2024-04-21T11:50:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:24 smithi077 ceph-mon[27902]: pgmap v2836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:26 smithi170 ceph-mon[31212]: pgmap v2837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:26 smithi077 ceph-mon[27902]: pgmap v2837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:50:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:50:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:50:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:26 smithi191 ceph-mon[31636]: pgmap v2837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5138.352723 secs 2024-04-21T11:50:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5138.352723 secs 2024-04-21T11:50:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5138.352723 secs 2024-04-21T11:50:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:28 smithi191 ceph-mon[31636]: pgmap v2838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:28 smithi170 ceph-mon[31212]: pgmap v2838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:28 smithi077 ceph-mon[27902]: pgmap v2838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5140.113484 secs 2024-04-21T11:50:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5140.113484 secs 2024-04-21T11:50:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5140.113484 secs 2024-04-21T11:50:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:30 smithi170 ceph-mon[31212]: pgmap v2839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:30 smithi077 ceph-mon[27902]: pgmap v2839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:30 smithi191 ceph-mon[31636]: pgmap v2839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5143.352842 secs 2024-04-21T11:50:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:32 smithi191 ceph-mon[31636]: pgmap v2840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5143.352842 secs 2024-04-21T11:50:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:32 smithi170 ceph-mon[31212]: pgmap v2840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5143.352842 secs 2024-04-21T11:50:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:32 smithi077 ceph-mon[27902]: pgmap v2840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5145.113597 secs 2024-04-21T11:50:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:34 smithi191 ceph-mon[31636]: pgmap v2841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5145.113597 secs 2024-04-21T11:50:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:34 smithi170 ceph-mon[31212]: pgmap v2841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5145.113597 secs 2024-04-21T11:50:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:34 smithi077 ceph-mon[27902]: pgmap v2841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:36.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:36 smithi191 ceph-mon[31636]: pgmap v2842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:36 smithi170 ceph-mon[31212]: pgmap v2842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:36 smithi077 ceph-mon[27902]: pgmap v2842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5148.352909 secs 2024-04-21T11:50:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5148.352909 secs 2024-04-21T11:50:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5148.352909 secs 2024-04-21T11:50:39.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:38 smithi170 ceph-mon[31212]: pgmap v2843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:38 smithi077 ceph-mon[27902]: pgmap v2843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:38 smithi191 ceph-mon[31636]: pgmap v2843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5150.113712 secs 2024-04-21T11:50:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5150.113712 secs 2024-04-21T11:50:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5150.113712 secs 2024-04-21T11:50:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:40 smithi170 ceph-mon[31212]: pgmap v2844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:40 smithi077 ceph-mon[27902]: pgmap v2844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:40 smithi191 ceph-mon[31636]: pgmap v2844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:43.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5153.352981 secs 2024-04-21T11:50:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:42 smithi170 ceph-mon[31212]: pgmap v2845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5153.352981 secs 2024-04-21T11:50:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:42 smithi077 ceph-mon[27902]: pgmap v2845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5153.352981 secs 2024-04-21T11:50:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:42 smithi191 ceph-mon[31636]: pgmap v2845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5155.113827 secs 2024-04-21T11:50:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:44 smithi170 ceph-mon[31212]: pgmap v2846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5155.113827 secs 2024-04-21T11:50:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:44 smithi077 ceph-mon[27902]: pgmap v2846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5155.113827 secs 2024-04-21T11:50:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:44 smithi191 ceph-mon[31636]: pgmap v2846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:46 smithi170 ceph-mon[31212]: pgmap v2847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:46 smithi077 ceph-mon[27902]: pgmap v2847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:46 smithi191 ceph-mon[31636]: pgmap v2847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5158.353094 secs 2024-04-21T11:50:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5158.353094 secs 2024-04-21T11:50:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5158.353094 secs 2024-04-21T11:50:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:48 smithi077 ceph-mon[27902]: pgmap v2848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:48 smithi170 ceph-mon[31212]: pgmap v2848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:48 smithi191 ceph-mon[31636]: pgmap v2848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5160.113937 secs 2024-04-21T11:50:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5160.113937 secs 2024-04-21T11:50:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5160.113937 secs 2024-04-21T11:50:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:50 smithi170 ceph-mon[31212]: pgmap v2849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:50 smithi077 ceph-mon[27902]: pgmap v2849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:50 smithi191 ceph-mon[31636]: pgmap v2849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:53.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5163.353213 secs 2024-04-21T11:50:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:52 smithi170 ceph-mon[31212]: pgmap v2850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5163.353213 secs 2024-04-21T11:50:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:52 smithi077 ceph-mon[27902]: pgmap v2850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5163.353213 secs 2024-04-21T11:50:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:52 smithi191 ceph-mon[31636]: pgmap v2850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5165.114053 secs 2024-04-21T11:50:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:54 smithi170 ceph-mon[31212]: pgmap v2851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:50:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5165.114053 secs 2024-04-21T11:50:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:54 smithi077 ceph-mon[27902]: pgmap v2851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5165.114053 secs 2024-04-21T11:50:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:54 smithi191 ceph-mon[31636]: pgmap v2851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:56 smithi170 ceph-mon[31212]: pgmap v2852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:56 smithi077 ceph-mon[27902]: pgmap v2852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:56 smithi191 ceph-mon[31636]: pgmap v2852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:50:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5168.353337 secs 2024-04-21T11:50:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5168.353337 secs 2024-04-21T11:50:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5168.353337 secs 2024-04-21T11:50:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:58 smithi170 ceph-mon[31212]: pgmap v2853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:58 smithi077 ceph-mon[27902]: pgmap v2853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:50:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:58 smithi191 ceph-mon[31636]: pgmap v2853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:50:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5170.114181 secs 2024-04-21T11:51:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:50:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5170.114181 secs 2024-04-21T11:51:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:50:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5170.114181 secs 2024-04-21T11:51:01.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:00 smithi170 ceph-mon[31212]: pgmap v2854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:00 smithi077 ceph-mon[27902]: pgmap v2854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:00 smithi191 ceph-mon[31636]: pgmap v2854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5173.353453 secs 2024-04-21T11:51:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:02 smithi170 ceph-mon[31212]: pgmap v2855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5173.353453 secs 2024-04-21T11:51:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:02 smithi077 ceph-mon[27902]: pgmap v2855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5173.353453 secs 2024-04-21T11:51:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:02 smithi191 ceph-mon[31636]: pgmap v2855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5175.114298 secs 2024-04-21T11:51:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:04 smithi170 ceph-mon[31212]: pgmap v2856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:04 smithi170 ceph-mon[31212]: osdmap e253: 12 total, 12 up, 12 in 2024-04-21T11:51:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5175.114298 secs 2024-04-21T11:51:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:04 smithi077 ceph-mon[27902]: pgmap v2856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:04 smithi077 ceph-mon[27902]: osdmap e253: 12 total, 12 up, 12 in 2024-04-21T11:51:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5175.114298 secs 2024-04-21T11:51:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:04 smithi191 ceph-mon[31636]: pgmap v2856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:04 smithi191 ceph-mon[31636]: osdmap e253: 12 total, 12 up, 12 in 2024-04-21T11:51:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:06 smithi170 ceph-mon[31212]: pgmap v2858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:51:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:06 smithi077 ceph-mon[27902]: pgmap v2858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:51:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:06 smithi191 ceph-mon[31636]: pgmap v2858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:51:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5178.353546 secs 2024-04-21T11:51:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:07 smithi170 ceph-mon[31212]: osdmap e254: 12 total, 12 up, 12 in 2024-04-21T11:51:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5178.353546 secs 2024-04-21T11:51:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:07 smithi191 ceph-mon[31636]: osdmap e254: 12 total, 12 up, 12 in 2024-04-21T11:51:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5178.353546 secs 2024-04-21T11:51:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:07 smithi077 ceph-mon[27902]: osdmap e254: 12 total, 12 up, 12 in 2024-04-21T11:51:09.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:08 smithi170 ceph-mon[31212]: pgmap v2860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:51:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:08 smithi077 ceph-mon[27902]: pgmap v2860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:51:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:08 smithi191 ceph-mon[31636]: pgmap v2860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:51:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5180.114451 secs 2024-04-21T11:51:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5180.114451 secs 2024-04-21T11:51:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5180.114451 secs 2024-04-21T11:51:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:10 smithi077 ceph-mon[27902]: pgmap v2861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:51:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:10 smithi191 ceph-mon[31636]: pgmap v2861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:51:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:10 smithi170 ceph-mon[31212]: pgmap v2861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:51:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5183.353666 secs 2024-04-21T11:51:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:12 smithi077 ceph-mon[27902]: pgmap v2862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:51:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5183.353666 secs 2024-04-21T11:51:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:12 smithi191 ceph-mon[31636]: pgmap v2862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:51:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5183.353666 secs 2024-04-21T11:51:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:12 smithi170 ceph-mon[31212]: pgmap v2862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:51:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5185.114570 secs 2024-04-21T11:51:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:14 smithi077 ceph-mon[27902]: pgmap v2863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:51:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5185.114570 secs 2024-04-21T11:51:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:14 smithi191 ceph-mon[31636]: pgmap v2863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:51:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5185.114570 secs 2024-04-21T11:51:15.331 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:14 smithi170 ceph-mon[31212]: pgmap v2863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:51:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:16 smithi077 ceph-mon[27902]: pgmap v2864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:51:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:16 smithi191 ceph-mon[31636]: pgmap v2864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:51:17.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:16 smithi170 ceph-mon[31212]: pgmap v2864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:51:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5188.353751 secs 2024-04-21T11:51:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5188.353751 secs 2024-04-21T11:51:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5188.353751 secs 2024-04-21T11:51:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:18 smithi077 ceph-mon[27902]: pgmap v2865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:51:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:18 smithi191 ceph-mon[31636]: pgmap v2865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:51:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:18 smithi170 ceph-mon[31212]: pgmap v2865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 98 B/s wr, 5 op/s 2024-04-21T11:51:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5190.114691 secs 2024-04-21T11:51:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5190.114691 secs 2024-04-21T11:51:20.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5190.114691 secs 2024-04-21T11:51:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:20 smithi077 ceph-mon[27902]: pgmap v2866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:51:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:20 smithi191 ceph-mon[31636]: pgmap v2866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:51:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:20 smithi170 ceph-mon[31212]: pgmap v2866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:51:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5193.353868 secs 2024-04-21T11:51:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:22 smithi077 ceph-mon[27902]: pgmap v2867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:51:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5193.353868 secs 2024-04-21T11:51:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:22 smithi191 ceph-mon[31636]: pgmap v2867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:51:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5193.353868 secs 2024-04-21T11:51:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:22 smithi170 ceph-mon[31212]: pgmap v2867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:51:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:51:25.061+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:51:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:51:25.061+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:51:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:51:25.061+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:51:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:51:25.061+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:51:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5195.114827 secs 2024-04-21T11:51:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:24 smithi077 ceph-mon[27902]: pgmap v2868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5195.114827 secs 2024-04-21T11:51:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:24 smithi191 ceph-mon[31636]: pgmap v2868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5195.114827 secs 2024-04-21T11:51:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:24 smithi170 ceph-mon[31212]: pgmap v2868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:51:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:25 smithi077 ceph-mon[27902]: pgmap v2869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:51:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:25 smithi191 ceph-mon[31636]: pgmap v2869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:51:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:25 smithi170 ceph-mon[31212]: pgmap v2869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:51:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:51:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:51:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:51:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:51:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:51:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:51:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:51:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:51:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5198.353961 secs 2024-04-21T11:51:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:27 smithi077 ceph-mon[27902]: pgmap v2870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5198.353961 secs 2024-04-21T11:51:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:27 smithi191 ceph-mon[31636]: pgmap v2870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5198.353961 secs 2024-04-21T11:51:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:27 smithi170 ceph-mon[31212]: pgmap v2870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5200.114943 secs 2024-04-21T11:51:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5200.114943 secs 2024-04-21T11:51:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5200.114943 secs 2024-04-21T11:51:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:29 smithi170 ceph-mon[31212]: pgmap v2871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:29 smithi077 ceph-mon[27902]: pgmap v2871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:29 smithi191 ceph-mon[31636]: pgmap v2871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5203.354100 secs 2024-04-21T11:51:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:32 smithi170 ceph-mon[31212]: pgmap v2872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5203.354100 secs 2024-04-21T11:51:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:32 smithi077 ceph-mon[27902]: pgmap v2872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5203.354100 secs 2024-04-21T11:51:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:32 smithi191 ceph-mon[31636]: pgmap v2872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5205.115059 secs 2024-04-21T11:51:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:34 smithi170 ceph-mon[31212]: pgmap v2873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5205.115059 secs 2024-04-21T11:51:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:34 smithi077 ceph-mon[27902]: pgmap v2873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5205.115059 secs 2024-04-21T11:51:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:34 smithi191 ceph-mon[31636]: pgmap v2873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:36 smithi170 ceph-mon[31212]: pgmap v2874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:36 smithi077 ceph-mon[27902]: pgmap v2874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:36 smithi191 ceph-mon[31636]: pgmap v2874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5208.354176 secs 2024-04-21T11:51:38.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5208.354176 secs 2024-04-21T11:51:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5208.354176 secs 2024-04-21T11:51:39.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:38 smithi170 ceph-mon[31212]: pgmap v2875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:38 smithi077 ceph-mon[27902]: pgmap v2875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:38 smithi191 ceph-mon[31636]: pgmap v2875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5210.115171 secs 2024-04-21T11:51:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5210.115171 secs 2024-04-21T11:51:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5210.115171 secs 2024-04-21T11:51:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:40 smithi170 ceph-mon[31212]: pgmap v2876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:40 smithi077 ceph-mon[27902]: pgmap v2876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:40 smithi191 ceph-mon[31636]: pgmap v2876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5213.354314 secs 2024-04-21T11:51:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:42 smithi170 ceph-mon[31212]: pgmap v2877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5213.354314 secs 2024-04-21T11:51:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:42 smithi077 ceph-mon[27902]: pgmap v2877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5213.354314 secs 2024-04-21T11:51:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:42 smithi191 ceph-mon[31636]: pgmap v2877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5215.115300 secs 2024-04-21T11:51:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:44 smithi170 ceph-mon[31212]: pgmap v2878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5215.115300 secs 2024-04-21T11:51:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:44 smithi077 ceph-mon[27902]: pgmap v2878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5215.115300 secs 2024-04-21T11:51:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:44 smithi191 ceph-mon[31636]: pgmap v2878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:46 smithi170 ceph-mon[31212]: pgmap v2879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:46 smithi077 ceph-mon[27902]: pgmap v2879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:46 smithi191 ceph-mon[31636]: pgmap v2879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5218.354448 secs 2024-04-21T11:51:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5218.354448 secs 2024-04-21T11:51:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5218.354448 secs 2024-04-21T11:51:49.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:48 smithi077 ceph-mon[27902]: pgmap v2880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:48 smithi170 ceph-mon[31212]: pgmap v2880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:48 smithi191 ceph-mon[31636]: pgmap v2880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5220.115422 secs 2024-04-21T11:51:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5220.115422 secs 2024-04-21T11:51:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5220.115422 secs 2024-04-21T11:51:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:50 smithi170 ceph-mon[31212]: pgmap v2881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:50 smithi077 ceph-mon[27902]: pgmap v2881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:50 smithi191 ceph-mon[31636]: pgmap v2881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:53.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5223.354579 secs 2024-04-21T11:51:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:52 smithi170 ceph-mon[31212]: pgmap v2882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5223.354579 secs 2024-04-21T11:51:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:52 smithi077 ceph-mon[27902]: pgmap v2882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5223.354579 secs 2024-04-21T11:51:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:52 smithi191 ceph-mon[31636]: pgmap v2882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5225.115560 secs 2024-04-21T11:51:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:54 smithi170 ceph-mon[31212]: pgmap v2883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:51:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5225.115560 secs 2024-04-21T11:51:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:54 smithi077 ceph-mon[27902]: pgmap v2883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5225.115560 secs 2024-04-21T11:51:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:54 smithi191 ceph-mon[31636]: pgmap v2883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:56 smithi170 ceph-mon[31212]: pgmap v2884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:56 smithi077 ceph-mon[27902]: pgmap v2884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:56 smithi191 ceph-mon[31636]: pgmap v2884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:51:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5228.354692 secs 2024-04-21T11:51:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5228.354692 secs 2024-04-21T11:51:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5228.354692 secs 2024-04-21T11:51:59.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:58 smithi170 ceph-mon[31212]: pgmap v2885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:58 smithi077 ceph-mon[27902]: pgmap v2885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:51:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:58 smithi191 ceph-mon[31636]: pgmap v2885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:51:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5230.115662 secs 2024-04-21T11:52:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:51:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5230.115662 secs 2024-04-21T11:52:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:51:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5230.115662 secs 2024-04-21T11:52:01.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:00 smithi170 ceph-mon[31212]: pgmap v2886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:00 smithi077 ceph-mon[27902]: pgmap v2886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:00 smithi191 ceph-mon[31636]: pgmap v2886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5233.354844 secs 2024-04-21T11:52:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:02 smithi170 ceph-mon[31212]: pgmap v2887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T11:52:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5233.354844 secs 2024-04-21T11:52:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:02 smithi077 ceph-mon[27902]: pgmap v2887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T11:52:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5233.354844 secs 2024-04-21T11:52:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:02 smithi191 ceph-mon[31636]: pgmap v2887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T11:52:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5235.115782 secs 2024-04-21T11:52:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:04 smithi170 ceph-mon[31212]: pgmap v2888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T11:52:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:04 smithi170 ceph-mon[31212]: osdmap e255: 12 total, 12 up, 12 in 2024-04-21T11:52:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5235.115782 secs 2024-04-21T11:52:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:04 smithi077 ceph-mon[27902]: pgmap v2888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T11:52:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:04 smithi077 ceph-mon[27902]: osdmap e255: 12 total, 12 up, 12 in 2024-04-21T11:52:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5235.115782 secs 2024-04-21T11:52:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:04 smithi191 ceph-mon[31636]: pgmap v2888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T11:52:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:04 smithi191 ceph-mon[31636]: osdmap e255: 12 total, 12 up, 12 in 2024-04-21T11:52:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:06 smithi170 ceph-mon[31212]: pgmap v2890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:52:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:06 smithi077 ceph-mon[27902]: pgmap v2890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:52:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:06 smithi191 ceph-mon[31636]: pgmap v2890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:52:08.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5238.354963 secs 2024-04-21T11:52:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:07 smithi170 ceph-mon[31212]: osdmap e256: 12 total, 12 up, 12 in 2024-04-21T11:52:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5238.354963 secs 2024-04-21T11:52:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:07 smithi191 ceph-mon[31636]: osdmap e256: 12 total, 12 up, 12 in 2024-04-21T11:52:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5238.354963 secs 2024-04-21T11:52:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:07 smithi077 ceph-mon[27902]: osdmap e256: 12 total, 12 up, 12 in 2024-04-21T11:52:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:08 smithi170 ceph-mon[31212]: pgmap v2892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:52:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:08 smithi077 ceph-mon[27902]: pgmap v2892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:52:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:08 smithi191 ceph-mon[31636]: pgmap v2892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:52:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5240.115903 secs 2024-04-21T11:52:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5240.115903 secs 2024-04-21T11:52:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5240.115903 secs 2024-04-21T11:52:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:10 smithi077 ceph-mon[27902]: pgmap v2893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-04-21T11:52:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:10 smithi191 ceph-mon[31636]: pgmap v2893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-04-21T11:52:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:10 smithi170 ceph-mon[31212]: pgmap v2893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-04-21T11:52:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5243.355028 secs 2024-04-21T11:52:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:12 smithi077 ceph-mon[27902]: pgmap v2894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T11:52:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5243.355028 secs 2024-04-21T11:52:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:12 smithi191 ceph-mon[31636]: pgmap v2894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T11:52:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5243.355028 secs 2024-04-21T11:52:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:12 smithi170 ceph-mon[31212]: pgmap v2894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T11:52:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5245.115979 secs 2024-04-21T11:52:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:14 smithi077 ceph-mon[27902]: pgmap v2895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-04-21T11:52:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5245.115979 secs 2024-04-21T11:52:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:14 smithi191 ceph-mon[31636]: pgmap v2895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-04-21T11:52:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5245.115979 secs 2024-04-21T11:52:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:14 smithi170 ceph-mon[31212]: pgmap v2895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-04-21T11:52:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:16 smithi077 ceph-mon[27902]: pgmap v2896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:52:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:16 smithi191 ceph-mon[31636]: pgmap v2896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:52:17.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:16 smithi170 ceph-mon[31212]: pgmap v2896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:52:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5248.355138 secs 2024-04-21T11:52:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5248.355138 secs 2024-04-21T11:52:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5248.355138 secs 2024-04-21T11:52:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:18 smithi077 ceph-mon[27902]: pgmap v2897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:52:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:18 smithi191 ceph-mon[31636]: pgmap v2897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:52:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:18 smithi170 ceph-mon[31212]: pgmap v2897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:52:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5250.116094 secs 2024-04-21T11:52:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5250.116094 secs 2024-04-21T11:52:20.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5250.116094 secs 2024-04-21T11:52:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:20 smithi077 ceph-mon[27902]: pgmap v2898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:52:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:20 smithi191 ceph-mon[31636]: pgmap v2898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:52:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:20 smithi170 ceph-mon[31212]: pgmap v2898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:52:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5253.355260 secs 2024-04-21T11:52:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:22 smithi077 ceph-mon[27902]: pgmap v2899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:52:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5253.355260 secs 2024-04-21T11:52:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:22 smithi191 ceph-mon[31636]: pgmap v2899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:52:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5253.355260 secs 2024-04-21T11:52:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:22 smithi170 ceph-mon[31212]: pgmap v2899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:52:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:23 smithi191 ceph-mon[31636]: pgmap v2900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:23 smithi170 ceph-mon[31212]: pgmap v2900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:23 smithi077 ceph-mon[27902]: pgmap v2900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5255.116210 secs 2024-04-21T11:52:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5255.116210 secs 2024-04-21T11:52:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5255.116210 secs 2024-04-21T11:52:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:25 smithi191 ceph-mon[31636]: pgmap v2901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:25 smithi170 ceph-mon[31212]: pgmap v2901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:25 smithi077 ceph-mon[27902]: pgmap v2901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:52:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:52:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:52:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5258.355356 secs 2024-04-21T11:52:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:52:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:52:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:52:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:27 smithi191 ceph-mon[31636]: pgmap v2902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5258.355356 secs 2024-04-21T11:52:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:52:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:52:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:52:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:27 smithi170 ceph-mon[31212]: pgmap v2902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5258.355356 secs 2024-04-21T11:52:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:52:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:52:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:52:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:27 smithi077 ceph-mon[27902]: pgmap v2902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5260.116278 secs 2024-04-21T11:52:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5260.116278 secs 2024-04-21T11:52:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5260.116278 secs 2024-04-21T11:52:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:30 smithi170 ceph-mon[31212]: pgmap v2903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:30 smithi077 ceph-mon[27902]: pgmap v2903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:30 smithi191 ceph-mon[31636]: pgmap v2903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5263.355473 secs 2024-04-21T11:52:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:32 smithi170 ceph-mon[31212]: pgmap v2904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5263.355473 secs 2024-04-21T11:52:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:32 smithi077 ceph-mon[27902]: pgmap v2904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5263.355473 secs 2024-04-21T11:52:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:32 smithi191 ceph-mon[31636]: pgmap v2904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:35.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5265.116398 secs 2024-04-21T11:52:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:34 smithi170 ceph-mon[31212]: pgmap v2905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5265.116398 secs 2024-04-21T11:52:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:34 smithi077 ceph-mon[27902]: pgmap v2905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5265.116398 secs 2024-04-21T11:52:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:34 smithi191 ceph-mon[31636]: pgmap v2905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:36 smithi170 ceph-mon[31212]: pgmap v2906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:36 smithi077 ceph-mon[27902]: pgmap v2906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:36 smithi191 ceph-mon[31636]: pgmap v2906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5268.355588 secs 2024-04-21T11:52:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5268.355588 secs 2024-04-21T11:52:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5268.355588 secs 2024-04-21T11:52:39.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:38 smithi170 ceph-mon[31212]: pgmap v2907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:38 smithi077 ceph-mon[27902]: pgmap v2907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:38 smithi191 ceph-mon[31636]: pgmap v2907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5270.116519 secs 2024-04-21T11:52:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5270.116519 secs 2024-04-21T11:52:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5270.116519 secs 2024-04-21T11:52:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:40 smithi170 ceph-mon[31212]: pgmap v2908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:40 smithi077 ceph-mon[27902]: pgmap v2908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:40 smithi191 ceph-mon[31636]: pgmap v2908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:43.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5273.355702 secs 2024-04-21T11:52:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:42 smithi170 ceph-mon[31212]: pgmap v2909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5273.355702 secs 2024-04-21T11:52:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:42 smithi077 ceph-mon[27902]: pgmap v2909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5273.355702 secs 2024-04-21T11:52:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:42 smithi191 ceph-mon[31636]: pgmap v2909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:45.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5275.116634 secs 2024-04-21T11:52:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:44 smithi170 ceph-mon[31212]: pgmap v2910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5275.116634 secs 2024-04-21T11:52:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:44 smithi077 ceph-mon[27902]: pgmap v2910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5275.116634 secs 2024-04-21T11:52:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:44 smithi191 ceph-mon[31636]: pgmap v2910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:46 smithi170 ceph-mon[31212]: pgmap v2911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:46 smithi077 ceph-mon[27902]: pgmap v2911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:46 smithi191 ceph-mon[31636]: pgmap v2911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5278.355809 secs 2024-04-21T11:52:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5278.355809 secs 2024-04-21T11:52:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5278.355809 secs 2024-04-21T11:52:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:48 smithi077 ceph-mon[27902]: pgmap v2912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:48 smithi170 ceph-mon[31212]: pgmap v2912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:48 smithi191 ceph-mon[31636]: pgmap v2912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5280.116770 secs 2024-04-21T11:52:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5280.116770 secs 2024-04-21T11:52:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5280.116770 secs 2024-04-21T11:52:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:50 smithi170 ceph-mon[31212]: pgmap v2913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:50 smithi077 ceph-mon[27902]: pgmap v2913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:50 smithi191 ceph-mon[31636]: pgmap v2913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5283.355923 secs 2024-04-21T11:52:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:52 smithi170 ceph-mon[31212]: pgmap v2914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5283.355923 secs 2024-04-21T11:52:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:52 smithi077 ceph-mon[27902]: pgmap v2914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5283.355923 secs 2024-04-21T11:52:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:52 smithi191 ceph-mon[31636]: pgmap v2914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5285.116889 secs 2024-04-21T11:52:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:54 smithi170 ceph-mon[31212]: pgmap v2915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:52:55.074+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:52:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:52:55.074+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:52:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:52:55.074+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:52:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:52:55.074+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:52:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:52:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5285.116889 secs 2024-04-21T11:52:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:54 smithi077 ceph-mon[27902]: pgmap v2915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5285.116889 secs 2024-04-21T11:52:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:54 smithi191 ceph-mon[31636]: pgmap v2915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:56 smithi170 ceph-mon[31212]: pgmap v2916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:56 smithi077 ceph-mon[27902]: pgmap v2916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:56 smithi191 ceph-mon[31636]: pgmap v2916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:52:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5288.356053 secs 2024-04-21T11:52:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5288.356053 secs 2024-04-21T11:52:58.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5288.356053 secs 2024-04-21T11:52:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:58 smithi077 ceph-mon[27902]: pgmap v2917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:58 smithi191 ceph-mon[31636]: pgmap v2917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:52:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:58 smithi170 ceph-mon[31212]: pgmap v2917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5290.117002 secs 2024-04-21T11:53:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5290.117002 secs 2024-04-21T11:53:00.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5290.117002 secs 2024-04-21T11:53:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:00 smithi077 ceph-mon[27902]: pgmap v2918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:00 smithi191 ceph-mon[31636]: pgmap v2918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:01.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:00 smithi170 ceph-mon[31212]: pgmap v2918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5293.356169 secs 2024-04-21T11:53:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:02 smithi077 ceph-mon[27902]: pgmap v2919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T11:53:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5293.356169 secs 2024-04-21T11:53:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:02 smithi191 ceph-mon[31636]: pgmap v2919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T11:53:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5293.356169 secs 2024-04-21T11:53:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:02 smithi170 ceph-mon[31212]: pgmap v2919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T11:53:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5295.117157 secs 2024-04-21T11:53:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:04 smithi077 ceph-mon[27902]: pgmap v2920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T11:53:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:04 smithi077 ceph-mon[27902]: osdmap e257: 12 total, 12 up, 12 in 2024-04-21T11:53:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5295.117157 secs 2024-04-21T11:53:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:04 smithi191 ceph-mon[31636]: pgmap v2920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T11:53:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:04 smithi191 ceph-mon[31636]: osdmap e257: 12 total, 12 up, 12 in 2024-04-21T11:53:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5295.117157 secs 2024-04-21T11:53:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:04 smithi170 ceph-mon[31212]: pgmap v2920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T11:53:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:04 smithi170 ceph-mon[31212]: osdmap e257: 12 total, 12 up, 12 in 2024-04-21T11:53:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:06 smithi077 ceph-mon[27902]: pgmap v2922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:53:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:06 smithi191 ceph-mon[31636]: pgmap v2922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:53:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:06 smithi170 ceph-mon[31212]: pgmap v2922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:53:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5298.356239 secs 2024-04-21T11:53:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:07 smithi191 ceph-mon[31636]: osdmap e258: 12 total, 12 up, 12 in 2024-04-21T11:53:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5298.356239 secs 2024-04-21T11:53:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:07 smithi077 ceph-mon[27902]: osdmap e258: 12 total, 12 up, 12 in 2024-04-21T11:53:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5298.356239 secs 2024-04-21T11:53:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:07 smithi170 ceph-mon[31212]: osdmap e258: 12 total, 12 up, 12 in 2024-04-21T11:53:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:08 smithi077 ceph-mon[27902]: pgmap v2924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:53:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:08 smithi191 ceph-mon[31636]: pgmap v2924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:53:09.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:08 smithi170 ceph-mon[31212]: pgmap v2924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:53:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5300.117260 secs 2024-04-21T11:53:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5300.117260 secs 2024-04-21T11:53:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5300.117260 secs 2024-04-21T11:53:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:10 smithi077 ceph-mon[27902]: pgmap v2925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-21T11:53:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:10 smithi191 ceph-mon[31636]: pgmap v2925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-21T11:53:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:10 smithi170 ceph-mon[31212]: pgmap v2925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-21T11:53:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5303.356356 secs 2024-04-21T11:53:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:12 smithi077 ceph-mon[27902]: pgmap v2926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 31 op/s 2024-04-21T11:53:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5303.356356 secs 2024-04-21T11:53:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:12 smithi191 ceph-mon[31636]: pgmap v2926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 31 op/s 2024-04-21T11:53:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5303.356356 secs 2024-04-21T11:53:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:12 smithi170 ceph-mon[31212]: pgmap v2926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 31 op/s 2024-04-21T11:53:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5305.117359 secs 2024-04-21T11:53:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:14 smithi077 ceph-mon[27902]: pgmap v2927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 25 op/s 2024-04-21T11:53:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5305.117359 secs 2024-04-21T11:53:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:14 smithi191 ceph-mon[31636]: pgmap v2927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 25 op/s 2024-04-21T11:53:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5305.117359 secs 2024-04-21T11:53:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:14 smithi170 ceph-mon[31212]: pgmap v2927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 25 op/s 2024-04-21T11:53:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:16 smithi077 ceph-mon[27902]: pgmap v2928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:53:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:16 smithi191 ceph-mon[31636]: pgmap v2928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:53:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:16 smithi170 ceph-mon[31212]: pgmap v2928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:53:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5308.356471 secs 2024-04-21T11:53:18.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:17 smithi077 ceph-mon[27902]: pgmap v2929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:53:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5308.356471 secs 2024-04-21T11:53:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:17 smithi191 ceph-mon[31636]: pgmap v2929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:53:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5308.356471 secs 2024-04-21T11:53:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:17 smithi170 ceph-mon[31212]: pgmap v2929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:53:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5310.117475 secs 2024-04-21T11:53:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5310.117475 secs 2024-04-21T11:53:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5310.117475 secs 2024-04-21T11:53:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:20 smithi170 ceph-mon[31212]: pgmap v2930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:53:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:20 smithi077 ceph-mon[27902]: pgmap v2930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:53:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:20 smithi191 ceph-mon[31636]: pgmap v2930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:53:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5313.356561 secs 2024-04-21T11:53:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:22 smithi170 ceph-mon[31212]: pgmap v2931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:53:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5313.356561 secs 2024-04-21T11:53:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:22 smithi077 ceph-mon[27902]: pgmap v2931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:53:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5313.356561 secs 2024-04-21T11:53:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:22 smithi191 ceph-mon[31636]: pgmap v2931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:53:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5315.117571 secs 2024-04-21T11:53:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:24 smithi170 ceph-mon[31212]: pgmap v2932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5315.117571 secs 2024-04-21T11:53:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:24 smithi077 ceph-mon[27902]: pgmap v2932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5315.117571 secs 2024-04-21T11:53:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:24 smithi191 ceph-mon[31636]: pgmap v2932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:26 smithi170 ceph-mon[31212]: pgmap v2933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:26 smithi077 ceph-mon[27902]: pgmap v2933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:26 smithi191 ceph-mon[31636]: pgmap v2933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:28.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5318.356681 secs 2024-04-21T11:53:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:53:28.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5318.356681 secs 2024-04-21T11:53:28.105 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:53:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5318.356681 secs 2024-04-21T11:53:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:53:29.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:28 smithi170 ceph-mon[31212]: pgmap v2934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:28 smithi077 ceph-mon[27902]: pgmap v2934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:28 smithi191 ceph-mon[31636]: pgmap v2934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5320.117690 secs 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:29 smithi077 ceph-mon[27902]: pgmap v2935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5320.117690 secs 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:29 smithi191 ceph-mon[31636]: pgmap v2935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5320.117690 secs 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:29 smithi170 ceph-mon[31212]: pgmap v2935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:53:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:53:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:53:31.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T11:53:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:53:31.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:53:31.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:53:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:32 smithi170 ceph-mon[31212]: pgmap v2936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:32 smithi077 ceph-mon[27902]: pgmap v2936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:32 smithi191 ceph-mon[31636]: pgmap v2936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5323.356798 secs 2024-04-21T11:53:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5323.356798 secs 2024-04-21T11:53:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5323.356798 secs 2024-04-21T11:53:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5325.117819 secs 2024-04-21T11:53:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:34 smithi077 ceph-mon[27902]: pgmap v2937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5325.117819 secs 2024-04-21T11:53:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:34 smithi191 ceph-mon[31636]: pgmap v2937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5325.117819 secs 2024-04-21T11:53:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:34 smithi170 ceph-mon[31212]: pgmap v2937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:36 smithi170 ceph-mon[31212]: pgmap v2938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:36 smithi077 ceph-mon[27902]: pgmap v2938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:36 smithi191 ceph-mon[31636]: pgmap v2938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5328.356869 secs 2024-04-21T11:53:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5328.356869 secs 2024-04-21T11:53:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5328.356869 secs 2024-04-21T11:53:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:38 smithi170 ceph-mon[31212]: pgmap v2939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:39.134 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:38 smithi191 ceph-mon[31636]: pgmap v2939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:38 smithi077 ceph-mon[27902]: pgmap v2939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5330.117922 secs 2024-04-21T11:53:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5330.117922 secs 2024-04-21T11:53:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5330.117922 secs 2024-04-21T11:53:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:40 smithi170 ceph-mon[31212]: pgmap v2940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:40 smithi077 ceph-mon[27902]: pgmap v2940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:40 smithi191 ceph-mon[31636]: pgmap v2940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5333.356981 secs 2024-04-21T11:53:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:42 smithi170 ceph-mon[31212]: pgmap v2941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5333.356981 secs 2024-04-21T11:53:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:42 smithi077 ceph-mon[27902]: pgmap v2941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5333.356981 secs 2024-04-21T11:53:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:42 smithi191 ceph-mon[31636]: pgmap v2941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5335.118038 secs 2024-04-21T11:53:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:44 smithi170 ceph-mon[31212]: pgmap v2942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5335.118038 secs 2024-04-21T11:53:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:44 smithi077 ceph-mon[27902]: pgmap v2942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5335.118038 secs 2024-04-21T11:53:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:44 smithi191 ceph-mon[31636]: pgmap v2942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:46 smithi170 ceph-mon[31212]: pgmap v2943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:46 smithi077 ceph-mon[27902]: pgmap v2943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:46 smithi191 ceph-mon[31636]: pgmap v2943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5338.357058 secs 2024-04-21T11:53:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5338.357058 secs 2024-04-21T11:53:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5338.357058 secs 2024-04-21T11:53:49.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:48 smithi077 ceph-mon[27902]: pgmap v2944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:48 smithi170 ceph-mon[31212]: pgmap v2944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:48 smithi191 ceph-mon[31636]: pgmap v2944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5340.118150 secs 2024-04-21T11:53:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5340.118150 secs 2024-04-21T11:53:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5340.118150 secs 2024-04-21T11:53:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:50 smithi170 ceph-mon[31212]: pgmap v2945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:50 smithi077 ceph-mon[27902]: pgmap v2945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:50 smithi191 ceph-mon[31636]: pgmap v2945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5343.357179 secs 2024-04-21T11:53:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:52 smithi170 ceph-mon[31212]: pgmap v2946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5343.357179 secs 2024-04-21T11:53:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:52 smithi077 ceph-mon[27902]: pgmap v2946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5343.357179 secs 2024-04-21T11:53:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:52 smithi191 ceph-mon[31636]: pgmap v2946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5345.118269 secs 2024-04-21T11:53:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:54 smithi170 ceph-mon[31212]: pgmap v2947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:53:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5345.118269 secs 2024-04-21T11:53:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:54 smithi077 ceph-mon[27902]: pgmap v2947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5345.118269 secs 2024-04-21T11:53:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:54 smithi191 ceph-mon[31636]: pgmap v2947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:56 smithi077 ceph-mon[27902]: pgmap v2948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:56 smithi191 ceph-mon[31636]: pgmap v2948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:57.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:56 smithi170 ceph-mon[31212]: pgmap v2948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:53:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5348.357316 secs 2024-04-21T11:53:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5348.357316 secs 2024-04-21T11:53:58.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5348.357316 secs 2024-04-21T11:53:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:58 smithi077 ceph-mon[27902]: pgmap v2949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:58 smithi191 ceph-mon[31636]: pgmap v2949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:53:59.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:58 smithi170 ceph-mon[31212]: pgmap v2949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:53:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5350.118393 secs 2024-04-21T11:54:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:53:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5350.118393 secs 2024-04-21T11:54:00.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:53:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5350.118393 secs 2024-04-21T11:54:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:00 smithi077 ceph-mon[27902]: pgmap v2950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:00 smithi191 ceph-mon[31636]: pgmap v2950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:00 smithi170 ceph-mon[31212]: pgmap v2950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5353.357431 secs 2024-04-21T11:54:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:02 smithi077 ceph-mon[27902]: pgmap v2951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T11:54:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5353.357431 secs 2024-04-21T11:54:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:02 smithi191 ceph-mon[31636]: pgmap v2951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T11:54:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5353.357431 secs 2024-04-21T11:54:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:02 smithi170 ceph-mon[31212]: pgmap v2951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T11:54:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5355.118512 secs 2024-04-21T11:54:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:04 smithi077 ceph-mon[27902]: pgmap v2952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:54:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:04 smithi077 ceph-mon[27902]: osdmap e259: 12 total, 12 up, 12 in 2024-04-21T11:54:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5355.118512 secs 2024-04-21T11:54:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:04 smithi191 ceph-mon[31636]: pgmap v2952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:54:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:04 smithi191 ceph-mon[31636]: osdmap e259: 12 total, 12 up, 12 in 2024-04-21T11:54:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5355.118512 secs 2024-04-21T11:54:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:04 smithi170 ceph-mon[31212]: pgmap v2952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T11:54:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:04 smithi170 ceph-mon[31212]: osdmap e259: 12 total, 12 up, 12 in 2024-04-21T11:54:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:06 smithi077 ceph-mon[27902]: pgmap v2954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:54:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:06 smithi191 ceph-mon[31636]: pgmap v2954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:54:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:06 smithi170 ceph-mon[31212]: pgmap v2954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:54:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5358.357526 secs 2024-04-21T11:54:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:07 smithi191 ceph-mon[31636]: osdmap e260: 12 total, 12 up, 12 in 2024-04-21T11:54:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5358.357526 secs 2024-04-21T11:54:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:07 smithi077 ceph-mon[27902]: osdmap e260: 12 total, 12 up, 12 in 2024-04-21T11:54:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5358.357526 secs 2024-04-21T11:54:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:07 smithi170 ceph-mon[31212]: osdmap e260: 12 total, 12 up, 12 in 2024-04-21T11:54:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:08 smithi077 ceph-mon[27902]: pgmap v2956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:54:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:08 smithi191 ceph-mon[31636]: pgmap v2956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:54:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:08 smithi170 ceph-mon[31212]: pgmap v2956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:54:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5360.118582 secs 2024-04-21T11:54:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5360.118582 secs 2024-04-21T11:54:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5360.118582 secs 2024-04-21T11:54:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:10 smithi077 ceph-mon[27902]: pgmap v2957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:54:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:10 smithi191 ceph-mon[31636]: pgmap v2957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:54:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:10 smithi170 ceph-mon[31212]: pgmap v2957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:54:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5363.357603 secs 2024-04-21T11:54:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:12 smithi077 ceph-mon[27902]: pgmap v2958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:54:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5363.357603 secs 2024-04-21T11:54:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:12 smithi191 ceph-mon[31636]: pgmap v2958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5363.357603 secs 2024-04-21T11:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:12 smithi170 ceph-mon[31212]: pgmap v2958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:54:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:13 smithi191 ceph-mon[31636]: pgmap v2959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:54:14.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:13 smithi170 ceph-mon[31212]: pgmap v2959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:54:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:13 smithi077 ceph-mon[27902]: pgmap v2959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:54:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5365.118695 secs 2024-04-21T11:54:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5365.118695 secs 2024-04-21T11:54:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5365.118695 secs 2024-04-21T11:54:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:15 smithi191 ceph-mon[31636]: pgmap v2960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:54:16.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:15 smithi170 ceph-mon[31212]: pgmap v2960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:54:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:15 smithi077 ceph-mon[27902]: pgmap v2960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:54:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5368.357718 secs 2024-04-21T11:54:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5368.357718 secs 2024-04-21T11:54:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5368.357718 secs 2024-04-21T11:54:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:18 smithi170 ceph-mon[31212]: pgmap v2961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:54:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:18 smithi077 ceph-mon[27902]: pgmap v2961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:54:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:18 smithi191 ceph-mon[31636]: pgmap v2961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:54:19.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5370.118820 secs 2024-04-21T11:54:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5370.118820 secs 2024-04-21T11:54:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5370.118820 secs 2024-04-21T11:54:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:20 smithi170 ceph-mon[31212]: pgmap v2962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:54:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:20 smithi077 ceph-mon[27902]: pgmap v2962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:54:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:20 smithi191 ceph-mon[31636]: pgmap v2962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:54:23.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5373.357784 secs 2024-04-21T11:54:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:22 smithi170 ceph-mon[31212]: pgmap v2963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:54:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5373.357784 secs 2024-04-21T11:54:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:22 smithi077 ceph-mon[27902]: pgmap v2963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:54:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5373.357784 secs 2024-04-21T11:54:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:22 smithi191 ceph-mon[31636]: pgmap v2963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:54:25.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5375.118945 secs 2024-04-21T11:54:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:24 smithi170 ceph-mon[31212]: pgmap v2964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5375.118945 secs 2024-04-21T11:54:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:24 smithi077 ceph-mon[27902]: pgmap v2964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5375.118945 secs 2024-04-21T11:54:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:24 smithi191 ceph-mon[31636]: pgmap v2964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:27.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:26 smithi170 ceph-mon[31212]: pgmap v2965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:26 smithi077 ceph-mon[27902]: pgmap v2965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:26 smithi191 ceph-mon[31636]: pgmap v2965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:28.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5378.357890 secs 2024-04-21T11:54:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5378.357890 secs 2024-04-21T11:54:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5378.357890 secs 2024-04-21T11:54:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:28 smithi170 ceph-mon[31212]: pgmap v2966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:28 smithi077 ceph-mon[27902]: pgmap v2966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:28 smithi191 ceph-mon[31636]: pgmap v2966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:30.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5380.119054 secs 2024-04-21T11:54:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5380.119054 secs 2024-04-21T11:54:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5380.119054 secs 2024-04-21T11:54:31.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:30 smithi170 ceph-mon[31212]: pgmap v2967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:54:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:30 smithi077 ceph-mon[27902]: pgmap v2967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:54:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:30 smithi191 ceph-mon[31636]: pgmap v2967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:54:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:54:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:54:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:54:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:54:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:54:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:54:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:54:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5383.358006 secs 2024-04-21T11:54:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:32 smithi170 ceph-mon[31212]: pgmap v2968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5383.358006 secs 2024-04-21T11:54:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:32 smithi077 ceph-mon[27902]: pgmap v2968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5383.358006 secs 2024-04-21T11:54:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:32 smithi191 ceph-mon[31636]: pgmap v2968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:35.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5385.119181 secs 2024-04-21T11:54:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:34 smithi170 ceph-mon[31212]: pgmap v2969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5385.119181 secs 2024-04-21T11:54:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:34 smithi077 ceph-mon[27902]: pgmap v2969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5385.119181 secs 2024-04-21T11:54:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:34 smithi191 ceph-mon[31636]: pgmap v2969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:37.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:36 smithi170 ceph-mon[31212]: pgmap v2970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:36 smithi077 ceph-mon[27902]: pgmap v2970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:36 smithi191 ceph-mon[31636]: pgmap v2970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5388.358124 secs 2024-04-21T11:54:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5388.358124 secs 2024-04-21T11:54:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5388.358124 secs 2024-04-21T11:54:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:38 smithi077 ceph-mon[27902]: pgmap v2971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:38 smithi191 ceph-mon[31636]: pgmap v2971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:38 smithi170 ceph-mon[31212]: pgmap v2971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5390.119298 secs 2024-04-21T11:54:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5390.119298 secs 2024-04-21T11:54:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5390.119298 secs 2024-04-21T11:54:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:40 smithi077 ceph-mon[27902]: pgmap v2972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:40 smithi191 ceph-mon[31636]: pgmap v2972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:40 smithi170 ceph-mon[31212]: pgmap v2972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5393.358258 secs 2024-04-21T11:54:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:42 smithi077 ceph-mon[27902]: pgmap v2973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5393.358258 secs 2024-04-21T11:54:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:42 smithi191 ceph-mon[31636]: pgmap v2973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5393.358258 secs 2024-04-21T11:54:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:42 smithi170 ceph-mon[31212]: pgmap v2973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5395.119439 secs 2024-04-21T11:54:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:44 smithi077 ceph-mon[27902]: pgmap v2974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5395.119439 secs 2024-04-21T11:54:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:44 smithi191 ceph-mon[31636]: pgmap v2974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5395.119439 secs 2024-04-21T11:54:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:44 smithi170 ceph-mon[31212]: pgmap v2974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:46 smithi077 ceph-mon[27902]: pgmap v2975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:46 smithi191 ceph-mon[31636]: pgmap v2975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:46 smithi170 ceph-mon[31212]: pgmap v2975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5398.358367 secs 2024-04-21T11:54:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5398.358367 secs 2024-04-21T11:54:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5398.358367 secs 2024-04-21T11:54:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:48 smithi077 ceph-mon[27902]: pgmap v2976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:48 smithi191 ceph-mon[31636]: pgmap v2976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:48 smithi170 ceph-mon[31212]: pgmap v2976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5400.119555 secs 2024-04-21T11:54:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5400.119555 secs 2024-04-21T11:54:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5400.119555 secs 2024-04-21T11:54:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:50 smithi077 ceph-mon[27902]: pgmap v2977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:50 smithi191 ceph-mon[31636]: pgmap v2977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:50 smithi170 ceph-mon[31212]: pgmap v2977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5403.358502 secs 2024-04-21T11:54:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:52 smithi077 ceph-mon[27902]: pgmap v2978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5403.358502 secs 2024-04-21T11:54:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:52 smithi191 ceph-mon[31636]: pgmap v2978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5403.358502 secs 2024-04-21T11:54:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:52 smithi170 ceph-mon[31212]: pgmap v2978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:54:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5405.119676 secs 2024-04-21T11:54:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:54 smithi077 ceph-mon[27902]: pgmap v2979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5405.119676 secs 2024-04-21T11:54:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:54 smithi191 ceph-mon[31636]: pgmap v2979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5405.119676 secs 2024-04-21T11:54:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:54 smithi170 ceph-mon[31212]: pgmap v2979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:56 smithi077 ceph-mon[27902]: pgmap v2980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:56 smithi191 ceph-mon[31636]: pgmap v2980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:57.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:56 smithi170 ceph-mon[31212]: pgmap v2980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:54:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5408.358615 secs 2024-04-21T11:54:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5408.358615 secs 2024-04-21T11:54:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5408.358615 secs 2024-04-21T11:54:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:58 smithi077 ceph-mon[27902]: pgmap v2981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:58 smithi191 ceph-mon[31636]: pgmap v2981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:54:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:58 smithi170 ceph-mon[31212]: pgmap v2981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:54:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5410.119815 secs 2024-04-21T11:55:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:54:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5410.119815 secs 2024-04-21T11:55:00.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:54:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5410.119815 secs 2024-04-21T11:55:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:00 smithi077 ceph-mon[27902]: pgmap v2982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:00 smithi191 ceph-mon[31636]: pgmap v2982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:01.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:00 smithi170 ceph-mon[31212]: pgmap v2982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:01 smithi191 ceph-mon[31636]: pgmap v2983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:02.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:01 smithi170 ceph-mon[31212]: pgmap v2983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:01 smithi077 ceph-mon[27902]: pgmap v2983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5413.358729 secs 2024-04-21T11:55:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5413.358729 secs 2024-04-21T11:55:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5413.358729 secs 2024-04-21T11:55:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:03 smithi191 ceph-mon[31636]: pgmap v2984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:03 smithi170 ceph-mon[31212]: pgmap v2984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:03 smithi077 ceph-mon[27902]: pgmap v2984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5415.119932 secs 2024-04-21T11:55:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:04 smithi191 ceph-mon[31636]: osdmap e261: 12 total, 12 up, 12 in 2024-04-21T11:55:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5415.119932 secs 2024-04-21T11:55:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:04 smithi170 ceph-mon[31212]: osdmap e261: 12 total, 12 up, 12 in 2024-04-21T11:55:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5415.119932 secs 2024-04-21T11:55:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:04 smithi077 ceph-mon[27902]: osdmap e261: 12 total, 12 up, 12 in 2024-04-21T11:55:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:05 smithi191 ceph-mon[31636]: pgmap v2986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:55:06.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:05 smithi170 ceph-mon[31212]: pgmap v2986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:55:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:05 smithi077 ceph-mon[27902]: pgmap v2986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:55:07.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5418.358850 secs 2024-04-21T11:55:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5418.358850 secs 2024-04-21T11:55:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5418.358850 secs 2024-04-21T11:55:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:08 smithi170 ceph-mon[31212]: osdmap e262: 12 total, 12 up, 12 in 2024-04-21T11:55:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:08 smithi170 ceph-mon[31212]: pgmap v2988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:55:08.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:08 smithi191 ceph-mon[31636]: osdmap e262: 12 total, 12 up, 12 in 2024-04-21T11:55:08.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:08 smithi191 ceph-mon[31636]: pgmap v2988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:55:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:08 smithi077 ceph-mon[27902]: osdmap e262: 12 total, 12 up, 12 in 2024-04-21T11:55:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:08 smithi077 ceph-mon[27902]: pgmap v2988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:55:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5420.120025 secs 2024-04-21T11:55:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5420.120025 secs 2024-04-21T11:55:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5420.120025 secs 2024-04-21T11:55:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:10.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:10 smithi170 ceph-mon[31212]: pgmap v2989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:55:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:10 smithi077 ceph-mon[27902]: pgmap v2989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:55:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:10 smithi191 ceph-mon[31636]: pgmap v2989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:55:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5423.358940 secs 2024-04-21T11:55:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:12 smithi170 ceph-mon[31212]: pgmap v2990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:55:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5423.358940 secs 2024-04-21T11:55:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:12 smithi077 ceph-mon[27902]: pgmap v2990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:55:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5423.358940 secs 2024-04-21T11:55:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:12 smithi191 ceph-mon[31636]: pgmap v2990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:55:15.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5425.120090 secs 2024-04-21T11:55:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:14 smithi170 ceph-mon[31212]: pgmap v2991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:55:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5425.120090 secs 2024-04-21T11:55:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:14 smithi077 ceph-mon[27902]: pgmap v2991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:55:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5425.120090 secs 2024-04-21T11:55:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:14 smithi191 ceph-mon[31636]: pgmap v2991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:55:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:16 smithi170 ceph-mon[31212]: pgmap v2992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:55:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:16 smithi077 ceph-mon[27902]: pgmap v2992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:55:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:16 smithi191 ceph-mon[31636]: pgmap v2992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:55:18.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5428.359056 secs 2024-04-21T11:55:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5428.359056 secs 2024-04-21T11:55:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5428.359056 secs 2024-04-21T11:55:19.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:18 smithi170 ceph-mon[31212]: pgmap v2993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:55:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:18 smithi077 ceph-mon[27902]: pgmap v2993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:55:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:18 smithi191 ceph-mon[31636]: pgmap v2993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:55:20.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5430.120205 secs 2024-04-21T11:55:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5430.120205 secs 2024-04-21T11:55:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5430.120205 secs 2024-04-21T11:55:21.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:20 smithi170 ceph-mon[31212]: pgmap v2994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:55:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:20 smithi077 ceph-mon[27902]: pgmap v2994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:55:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:20 smithi191 ceph-mon[31636]: pgmap v2994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:55:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5433.359164 secs 2024-04-21T11:55:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:22 smithi077 ceph-mon[27902]: pgmap v2995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:55:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5433.359164 secs 2024-04-21T11:55:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:22 smithi191 ceph-mon[31636]: pgmap v2995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:55:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5433.359164 secs 2024-04-21T11:55:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:22 smithi170 ceph-mon[31212]: pgmap v2995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:55:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5435.120321 secs 2024-04-21T11:55:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:24 smithi077 ceph-mon[27902]: pgmap v2996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5435.120321 secs 2024-04-21T11:55:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:24 smithi191 ceph-mon[31636]: pgmap v2996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5435.120321 secs 2024-04-21T11:55:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:24 smithi170 ceph-mon[31212]: pgmap v2996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:26 smithi077 ceph-mon[27902]: pgmap v2997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:26 smithi191 ceph-mon[31636]: pgmap v2997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:26 smithi170 ceph-mon[31212]: pgmap v2997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5438.359276 secs 2024-04-21T11:55:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5438.359276 secs 2024-04-21T11:55:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5438.359276 secs 2024-04-21T11:55:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:28 smithi077 ceph-mon[27902]: pgmap v2998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:28 smithi191 ceph-mon[31636]: pgmap v2998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:29.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:28 smithi170 ceph-mon[31212]: pgmap v2998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5440.120437 secs 2024-04-21T11:55:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5440.120437 secs 2024-04-21T11:55:30.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5440.120437 secs 2024-04-21T11:55:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:30 smithi077 ceph-mon[27902]: pgmap v2999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:30 smithi191 ceph-mon[31636]: pgmap v2999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:31.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:30 smithi170 ceph-mon[31212]: pgmap v2999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:55:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:55:32.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:55:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5443.359418 secs 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: pgmap v3000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:55:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5443.359418 secs 2024-04-21T11:55:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: pgmap v3000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:55:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:55:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5443.359418 secs 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: pgmap v3000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:55:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5445.120562 secs 2024-04-21T11:55:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:34 smithi077 ceph-mon[27902]: pgmap v3001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5445.120562 secs 2024-04-21T11:55:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:34 smithi191 ceph-mon[31636]: pgmap v3001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5445.120562 secs 2024-04-21T11:55:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:34 smithi170 ceph-mon[31212]: pgmap v3001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:36 smithi077 ceph-mon[27902]: pgmap v3002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:36 smithi191 ceph-mon[31636]: pgmap v3002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:36 smithi170 ceph-mon[31212]: pgmap v3002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5448.359544 secs 2024-04-21T11:55:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5448.359544 secs 2024-04-21T11:55:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5448.359544 secs 2024-04-21T11:55:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:38 smithi077 ceph-mon[27902]: pgmap v3003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:38 smithi191 ceph-mon[31636]: pgmap v3003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:39.223 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:38 smithi170 ceph-mon[31212]: pgmap v3003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5450.120674 secs 2024-04-21T11:55:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5450.120674 secs 2024-04-21T11:55:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5450.120674 secs 2024-04-21T11:55:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:40 smithi077 ceph-mon[27902]: pgmap v3004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:40 smithi191 ceph-mon[31636]: pgmap v3004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:40 smithi170 ceph-mon[31212]: pgmap v3004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5453.359688 secs 2024-04-21T11:55:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:42 smithi077 ceph-mon[27902]: pgmap v3005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5453.359688 secs 2024-04-21T11:55:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:42 smithi191 ceph-mon[31636]: pgmap v3005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5453.359688 secs 2024-04-21T11:55:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:42 smithi170 ceph-mon[31212]: pgmap v3005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5455.120790 secs 2024-04-21T11:55:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:44 smithi077 ceph-mon[27902]: pgmap v3006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5455.120790 secs 2024-04-21T11:55:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:44 smithi191 ceph-mon[31636]: pgmap v3006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5455.120790 secs 2024-04-21T11:55:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:44 smithi170 ceph-mon[31212]: pgmap v3006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:46 smithi077 ceph-mon[27902]: pgmap v3007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:46 smithi191 ceph-mon[31636]: pgmap v3007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:46 smithi170 ceph-mon[31212]: pgmap v3007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5458.359802 secs 2024-04-21T11:55:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5458.359802 secs 2024-04-21T11:55:48.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5458.359802 secs 2024-04-21T11:55:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:48 smithi077 ceph-mon[27902]: pgmap v3008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:48 smithi191 ceph-mon[31636]: pgmap v3008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:48 smithi170 ceph-mon[31212]: pgmap v3008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5460.120910 secs 2024-04-21T11:55:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:49 smithi191 ceph-mon[31636]: pgmap v3009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:50.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5460.120910 secs 2024-04-21T11:55:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:49 smithi170 ceph-mon[31212]: pgmap v3009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5460.120910 secs 2024-04-21T11:55:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:49 smithi077 ceph-mon[27902]: pgmap v3009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5463.359920 secs 2024-04-21T11:55:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:52 smithi170 ceph-mon[31212]: pgmap v3010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5463.359920 secs 2024-04-21T11:55:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:52 smithi077 ceph-mon[27902]: pgmap v3010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5463.359920 secs 2024-04-21T11:55:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:52 smithi191 ceph-mon[31636]: pgmap v3010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5465.121025 secs 2024-04-21T11:55:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:54 smithi170 ceph-mon[31212]: pgmap v3011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:55:55.099+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:55:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:55:55.099+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:55:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:55:55.099+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:55:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:55:55.099+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:55:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:55:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5465.121025 secs 2024-04-21T11:55:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:54 smithi077 ceph-mon[27902]: pgmap v3011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5465.121025 secs 2024-04-21T11:55:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:54 smithi191 ceph-mon[31636]: pgmap v3011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:55:57.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:56 smithi170 ceph-mon[31212]: pgmap v3012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:56 smithi077 ceph-mon[27902]: pgmap v3012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:56 smithi191 ceph-mon[31636]: pgmap v3012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:55:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5468.360040 secs 2024-04-21T11:55:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5468.360040 secs 2024-04-21T11:55:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5468.360040 secs 2024-04-21T11:55:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:58 smithi077 ceph-mon[27902]: pgmap v3013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:58 smithi191 ceph-mon[31636]: pgmap v3013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:55:59.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:58 smithi170 ceph-mon[31212]: pgmap v3013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:55:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5470.121137 secs 2024-04-21T11:56:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:55:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5470.121137 secs 2024-04-21T11:56:00.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:55:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5470.121137 secs 2024-04-21T11:56:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:00 smithi077 ceph-mon[27902]: pgmap v3014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:00 smithi191 ceph-mon[31636]: pgmap v3014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:01.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:00 smithi170 ceph-mon[31212]: pgmap v3014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5473.360120 secs 2024-04-21T11:56:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:02 smithi077 ceph-mon[27902]: pgmap v3015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5473.360120 secs 2024-04-21T11:56:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:02 smithi191 ceph-mon[31636]: pgmap v3015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5473.360120 secs 2024-04-21T11:56:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:02 smithi170 ceph-mon[31212]: pgmap v3015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5475.121255 secs 2024-04-21T11:56:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:04 smithi077 ceph-mon[27902]: pgmap v3016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:04 smithi077 ceph-mon[27902]: osdmap e263: 12 total, 12 up, 12 in 2024-04-21T11:56:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5475.121255 secs 2024-04-21T11:56:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:04 smithi191 ceph-mon[31636]: pgmap v3016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:04 smithi191 ceph-mon[31636]: osdmap e263: 12 total, 12 up, 12 in 2024-04-21T11:56:05.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5475.121255 secs 2024-04-21T11:56:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:04 smithi170 ceph-mon[31212]: pgmap v3016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T11:56:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:04 smithi170 ceph-mon[31212]: osdmap e263: 12 total, 12 up, 12 in 2024-04-21T11:56:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:06 smithi077 ceph-mon[27902]: pgmap v3018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:56:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:06 smithi191 ceph-mon[31636]: pgmap v3018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:56:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:06 smithi170 ceph-mon[31212]: pgmap v3018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T11:56:08.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5478.360252 secs 2024-04-21T11:56:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:07 smithi191 ceph-mon[31636]: osdmap e264: 12 total, 12 up, 12 in 2024-04-21T11:56:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5478.360252 secs 2024-04-21T11:56:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:07 smithi077 ceph-mon[27902]: osdmap e264: 12 total, 12 up, 12 in 2024-04-21T11:56:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5478.360252 secs 2024-04-21T11:56:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:07 smithi170 ceph-mon[31212]: osdmap e264: 12 total, 12 up, 12 in 2024-04-21T11:56:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:08 smithi077 ceph-mon[27902]: pgmap v3020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:56:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:08 smithi191 ceph-mon[31636]: pgmap v3020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:56:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:08 smithi170 ceph-mon[31212]: pgmap v3020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:56:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5480.121369 secs 2024-04-21T11:56:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5480.121369 secs 2024-04-21T11:56:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5480.121369 secs 2024-04-21T11:56:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:10 smithi077 ceph-mon[27902]: pgmap v3021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:56:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:10 smithi191 ceph-mon[31636]: pgmap v3021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:56:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:10 smithi170 ceph-mon[31212]: pgmap v3021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T11:56:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5483.360326 secs 2024-04-21T11:56:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:12 smithi077 ceph-mon[27902]: pgmap v3022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:56:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5483.360326 secs 2024-04-21T11:56:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:12 smithi191 ceph-mon[31636]: pgmap v3022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:56:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5483.360326 secs 2024-04-21T11:56:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:12 smithi170 ceph-mon[31212]: pgmap v3022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T11:56:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5485.121479 secs 2024-04-21T11:56:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:14 smithi077 ceph-mon[27902]: pgmap v3023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:56:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5485.121479 secs 2024-04-21T11:56:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:14 smithi191 ceph-mon[31636]: pgmap v3023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:56:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5485.121479 secs 2024-04-21T11:56:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:14 smithi170 ceph-mon[31212]: pgmap v3023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:56:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:16 smithi077 ceph-mon[27902]: pgmap v3024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:56:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:16 smithi191 ceph-mon[31636]: pgmap v3024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:56:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:16 smithi170 ceph-mon[31212]: pgmap v3024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:56:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5488.360440 secs 2024-04-21T11:56:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5488.360440 secs 2024-04-21T11:56:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5488.360440 secs 2024-04-21T11:56:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:18 smithi077 ceph-mon[27902]: pgmap v3025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:56:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:18 smithi191 ceph-mon[31636]: pgmap v3025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:56:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:18 smithi170 ceph-mon[31212]: pgmap v3025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:56:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5490.121595 secs 2024-04-21T11:56:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5490.121595 secs 2024-04-21T11:56:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5490.121595 secs 2024-04-21T11:56:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:20 smithi077 ceph-mon[27902]: pgmap v3026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:56:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:20 smithi191 ceph-mon[31636]: pgmap v3026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:56:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:20 smithi170 ceph-mon[31212]: pgmap v3026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:56:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5493.360501 secs 2024-04-21T11:56:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:22 smithi077 ceph-mon[27902]: pgmap v3027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:56:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5493.360501 secs 2024-04-21T11:56:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:22 smithi191 ceph-mon[31636]: pgmap v3027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:56:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5493.360501 secs 2024-04-21T11:56:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:22 smithi170 ceph-mon[31212]: pgmap v3027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:56:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5495.121717 secs 2024-04-21T11:56:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:24 smithi077 ceph-mon[27902]: pgmap v3028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5495.121717 secs 2024-04-21T11:56:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:24 smithi191 ceph-mon[31636]: pgmap v3028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5495.121717 secs 2024-04-21T11:56:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:24 smithi170 ceph-mon[31212]: pgmap v3028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:26 smithi077 ceph-mon[27902]: pgmap v3029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:26 smithi191 ceph-mon[31636]: pgmap v3029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:26 smithi170 ceph-mon[31212]: pgmap v3029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5498.360560 secs 2024-04-21T11:56:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5498.360560 secs 2024-04-21T11:56:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5498.360560 secs 2024-04-21T11:56:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:28 smithi191 ceph-mon[31636]: pgmap v3030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:28 smithi170 ceph-mon[31212]: pgmap v3030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:28 smithi077 ceph-mon[27902]: pgmap v3030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5500.121826 secs 2024-04-21T11:56:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:29 smithi191 ceph-mon[31636]: pgmap v3031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5500.121826 secs 2024-04-21T11:56:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:29 smithi170 ceph-mon[31212]: pgmap v3031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5500.121826 secs 2024-04-21T11:56:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:29 smithi077 ceph-mon[27902]: pgmap v3031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5503.360676 secs 2024-04-21T11:56:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:32 smithi077 ceph-mon[27902]: pgmap v3032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5503.360676 secs 2024-04-21T11:56:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:32 smithi191 ceph-mon[31636]: pgmap v3032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5503.360676 secs 2024-04-21T11:56:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:32 smithi170 ceph-mon[31212]: pgmap v3032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:56:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:56:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:56:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:56:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:56:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:56:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:56:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:56:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:56:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:56:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:56:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:56:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5505.121894 secs 2024-04-21T11:56:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:34 smithi077 ceph-mon[27902]: pgmap v3033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5505.121894 secs 2024-04-21T11:56:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:34 smithi191 ceph-mon[31636]: pgmap v3033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5505.121894 secs 2024-04-21T11:56:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:34 smithi170 ceph-mon[31212]: pgmap v3033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:36 smithi077 ceph-mon[27902]: pgmap v3034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:36 smithi191 ceph-mon[31636]: pgmap v3034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:36 smithi170 ceph-mon[31212]: pgmap v3034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:38.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5508.360797 secs 2024-04-21T11:56:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5508.360797 secs 2024-04-21T11:56:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5508.360797 secs 2024-04-21T11:56:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:38 smithi077 ceph-mon[27902]: pgmap v3035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:38 smithi191 ceph-mon[31636]: pgmap v3035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:39.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:38 smithi170 ceph-mon[31212]: pgmap v3035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5510.121957 secs 2024-04-21T11:56:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5510.121957 secs 2024-04-21T11:56:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5510.121957 secs 2024-04-21T11:56:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:40 smithi077 ceph-mon[27902]: pgmap v3036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:40 smithi191 ceph-mon[31636]: pgmap v3036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:40 smithi170 ceph-mon[31212]: pgmap v3036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5513.360887 secs 2024-04-21T11:56:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:42 smithi077 ceph-mon[27902]: pgmap v3037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5513.360887 secs 2024-04-21T11:56:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:42 smithi191 ceph-mon[31636]: pgmap v3037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5513.360887 secs 2024-04-21T11:56:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:42 smithi170 ceph-mon[31212]: pgmap v3037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5515.122048 secs 2024-04-21T11:56:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:44 smithi077 ceph-mon[27902]: pgmap v3038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5515.122048 secs 2024-04-21T11:56:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:44 smithi191 ceph-mon[31636]: pgmap v3038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5515.122048 secs 2024-04-21T11:56:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:44 smithi170 ceph-mon[31212]: pgmap v3038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:46 smithi077 ceph-mon[27902]: pgmap v3039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:46 smithi191 ceph-mon[31636]: pgmap v3039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:46 smithi170 ceph-mon[31212]: pgmap v3039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5518.361016 secs 2024-04-21T11:56:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5518.361016 secs 2024-04-21T11:56:48.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5518.361016 secs 2024-04-21T11:56:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:48 smithi077 ceph-mon[27902]: pgmap v3040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:48 smithi191 ceph-mon[31636]: pgmap v3040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:49.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:48 smithi170 ceph-mon[31212]: pgmap v3040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5520.122173 secs 2024-04-21T11:56:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5520.122173 secs 2024-04-21T11:56:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5520.122173 secs 2024-04-21T11:56:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:50 smithi077 ceph-mon[27902]: pgmap v3041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:50 smithi191 ceph-mon[31636]: pgmap v3041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:50 smithi170 ceph-mon[31212]: pgmap v3041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5523.361080 secs 2024-04-21T11:56:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:52 smithi077 ceph-mon[27902]: pgmap v3042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5523.361080 secs 2024-04-21T11:56:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:52 smithi191 ceph-mon[31636]: pgmap v3042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5523.361080 secs 2024-04-21T11:56:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:52 smithi170 ceph-mon[31212]: pgmap v3042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:56:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5525.122286 secs 2024-04-21T11:56:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:54 smithi077 ceph-mon[27902]: pgmap v3043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5525.122286 secs 2024-04-21T11:56:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:54 smithi191 ceph-mon[31636]: pgmap v3043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5525.122286 secs 2024-04-21T11:56:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:54 smithi170 ceph-mon[31212]: pgmap v3043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:56 smithi077 ceph-mon[27902]: pgmap v3044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:56 smithi191 ceph-mon[31636]: pgmap v3044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:57.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:56 smithi170 ceph-mon[31212]: pgmap v3044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:56:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5528.361193 secs 2024-04-21T11:56:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5528.361193 secs 2024-04-21T11:56:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5528.361193 secs 2024-04-21T11:56:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:58 smithi077 ceph-mon[27902]: pgmap v3045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:58 smithi191 ceph-mon[31636]: pgmap v3045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:56:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:58 smithi170 ceph-mon[31212]: pgmap v3045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:56:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5530.122420 secs 2024-04-21T11:57:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:56:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5530.122420 secs 2024-04-21T11:57:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:56:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5530.122420 secs 2024-04-21T11:57:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:00 smithi077 ceph-mon[27902]: pgmap v3046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:00 smithi191 ceph-mon[31636]: pgmap v3046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:01.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:00 smithi170 ceph-mon[31212]: pgmap v3046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5533.361271 secs 2024-04-21T11:57:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:02 smithi077 ceph-mon[27902]: pgmap v3047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5533.361271 secs 2024-04-21T11:57:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:02 smithi191 ceph-mon[31636]: pgmap v3047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5533.361271 secs 2024-04-21T11:57:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:02 smithi170 ceph-mon[31212]: pgmap v3047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5535.122538 secs 2024-04-21T11:57:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:04 smithi191 ceph-mon[31636]: pgmap v3048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:04 smithi191 ceph-mon[31636]: osdmap e265: 12 total, 12 up, 12 in 2024-04-21T11:57:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5535.122538 secs 2024-04-21T11:57:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:04 smithi170 ceph-mon[31212]: pgmap v3048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:04 smithi170 ceph-mon[31212]: osdmap e265: 12 total, 12 up, 12 in 2024-04-21T11:57:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5535.122538 secs 2024-04-21T11:57:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:04 smithi077 ceph-mon[27902]: pgmap v3048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:04 smithi077 ceph-mon[27902]: osdmap e265: 12 total, 12 up, 12 in 2024-04-21T11:57:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:05 smithi191 ceph-mon[31636]: pgmap v3050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:57:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:05 smithi170 ceph-mon[31212]: pgmap v3050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:57:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:05 smithi077 ceph-mon[27902]: pgmap v3050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:57:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5538.361388 secs 2024-04-21T11:57:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5538.361388 secs 2024-04-21T11:57:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5538.361388 secs 2024-04-21T11:57:08.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:08 smithi191 ceph-mon[31636]: osdmap e266: 12 total, 12 up, 12 in 2024-04-21T11:57:08.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:08 smithi191 ceph-mon[31636]: pgmap v3052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:57:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:08 smithi077 ceph-mon[27902]: osdmap e266: 12 total, 12 up, 12 in 2024-04-21T11:57:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:08 smithi077 ceph-mon[27902]: pgmap v3052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:57:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:08 smithi170 ceph-mon[31212]: osdmap e266: 12 total, 12 up, 12 in 2024-04-21T11:57:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:08 smithi170 ceph-mon[31212]: pgmap v3052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:57:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5540.122604 secs 2024-04-21T11:57:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5540.122604 secs 2024-04-21T11:57:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5540.122604 secs 2024-04-21T11:57:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:10 smithi077 ceph-mon[27902]: pgmap v3053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:57:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:10 smithi191 ceph-mon[31636]: pgmap v3053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:57:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:10 smithi170 ceph-mon[31212]: pgmap v3053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:57:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5543.361453 secs 2024-04-21T11:57:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:12 smithi077 ceph-mon[27902]: pgmap v3054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:57:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5543.361453 secs 2024-04-21T11:57:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:12 smithi191 ceph-mon[31636]: pgmap v3054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:57:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5543.361453 secs 2024-04-21T11:57:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:12 smithi170 ceph-mon[31212]: pgmap v3054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:57:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5545.122755 secs 2024-04-21T11:57:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:14 smithi077 ceph-mon[27902]: pgmap v3055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:57:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5545.122755 secs 2024-04-21T11:57:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:14 smithi191 ceph-mon[31636]: pgmap v3055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:57:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5545.122755 secs 2024-04-21T11:57:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:14 smithi170 ceph-mon[31212]: pgmap v3055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:57:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:16 smithi077 ceph-mon[27902]: pgmap v3056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:57:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:16 smithi191 ceph-mon[31636]: pgmap v3056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:57:17.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:16 smithi170 ceph-mon[31212]: pgmap v3056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:57:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5548.361597 secs 2024-04-21T11:57:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5548.361597 secs 2024-04-21T11:57:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5548.361597 secs 2024-04-21T11:57:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:18 smithi077 ceph-mon[27902]: pgmap v3057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:57:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:18 smithi191 ceph-mon[31636]: pgmap v3057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:57:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:18 smithi170 ceph-mon[31212]: pgmap v3057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:57:20.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5550.122882 secs 2024-04-21T11:57:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5550.122882 secs 2024-04-21T11:57:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5550.122882 secs 2024-04-21T11:57:21.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:20 smithi077 ceph-mon[27902]: pgmap v3058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:57:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:20 smithi191 ceph-mon[31636]: pgmap v3058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:57:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:20 smithi170 ceph-mon[31212]: pgmap v3058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:57:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5553.361733 secs 2024-04-21T11:57:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:22 smithi077 ceph-mon[27902]: pgmap v3059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:57:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5553.361733 secs 2024-04-21T11:57:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:22 smithi191 ceph-mon[31636]: pgmap v3059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:57:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5553.361733 secs 2024-04-21T11:57:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:22 smithi170 ceph-mon[31212]: pgmap v3059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:57:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5555.122980 secs 2024-04-21T11:57:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:24 smithi077 ceph-mon[27902]: pgmap v3060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5555.122980 secs 2024-04-21T11:57:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:24 smithi191 ceph-mon[31636]: pgmap v3060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5555.122980 secs 2024-04-21T11:57:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:24 smithi170 ceph-mon[31212]: pgmap v3060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:26 smithi077 ceph-mon[27902]: pgmap v3061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:26 smithi191 ceph-mon[31636]: pgmap v3061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:26 smithi170 ceph-mon[31212]: pgmap v3061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5558.361829 secs 2024-04-21T11:57:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5558.361829 secs 2024-04-21T11:57:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5558.361829 secs 2024-04-21T11:57:29.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:28 smithi077 ceph-mon[27902]: pgmap v3062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:28 smithi191 ceph-mon[31636]: pgmap v3062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:29.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:28 smithi170 ceph-mon[31212]: pgmap v3062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5560.123045 secs 2024-04-21T11:57:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5560.123045 secs 2024-04-21T11:57:30.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5560.123045 secs 2024-04-21T11:57:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:30 smithi077 ceph-mon[27902]: pgmap v3063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:30 smithi191 ceph-mon[31636]: pgmap v3063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:31.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:30 smithi170 ceph-mon[31212]: pgmap v3063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5563.361906 secs 2024-04-21T11:57:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:32 smithi077 ceph-mon[27902]: pgmap v3064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5563.361906 secs 2024-04-21T11:57:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:32 smithi191 ceph-mon[31636]: pgmap v3064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5563.361906 secs 2024-04-21T11:57:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:32 smithi170 ceph-mon[31212]: pgmap v3064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:57:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:57:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:57:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5565.123146 secs 2024-04-21T11:57:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:34 smithi077 ceph-mon[27902]: pgmap v3065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:57:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:57:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:57:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5565.123146 secs 2024-04-21T11:57:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:34 smithi191 ceph-mon[31636]: pgmap v3065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:57:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:57:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:57:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5565.123146 secs 2024-04-21T11:57:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:34 smithi170 ceph-mon[31212]: pgmap v3065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:57:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:57:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:57:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:36 smithi077 ceph-mon[27902]: pgmap v3066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:36 smithi191 ceph-mon[31636]: pgmap v3066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:36 smithi170 ceph-mon[31212]: pgmap v3066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5568.362021 secs 2024-04-21T11:57:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5568.362021 secs 2024-04-21T11:57:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5568.362021 secs 2024-04-21T11:57:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:38 smithi077 ceph-mon[27902]: pgmap v3067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:38 smithi191 ceph-mon[31636]: pgmap v3067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:39.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:38 smithi170 ceph-mon[31212]: pgmap v3067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5570.123224 secs 2024-04-21T11:57:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5570.123224 secs 2024-04-21T11:57:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5570.123224 secs 2024-04-21T11:57:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:40 smithi191 ceph-mon[31636]: pgmap v3068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:40 smithi170 ceph-mon[31212]: pgmap v3068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:40 smithi077 ceph-mon[27902]: pgmap v3068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5573.362149 secs 2024-04-21T11:57:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:42 smithi191 ceph-mon[31636]: pgmap v3069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5573.362149 secs 2024-04-21T11:57:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:42 smithi170 ceph-mon[31212]: pgmap v3069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5573.362149 secs 2024-04-21T11:57:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:42 smithi077 ceph-mon[27902]: pgmap v3069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:43 smithi191 ceph-mon[31636]: pgmap v3070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:43 smithi170 ceph-mon[31212]: pgmap v3070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:43 smithi077 ceph-mon[27902]: pgmap v3070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5575.123311 secs 2024-04-21T11:57:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5575.123311 secs 2024-04-21T11:57:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5575.123311 secs 2024-04-21T11:57:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:45 smithi191 ceph-mon[31636]: pgmap v3071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:45 smithi170 ceph-mon[31212]: pgmap v3071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:45 smithi077 ceph-mon[27902]: pgmap v3071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5578.362213 secs 2024-04-21T11:57:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5578.362213 secs 2024-04-21T11:57:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5578.362213 secs 2024-04-21T11:57:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:48 smithi170 ceph-mon[31212]: pgmap v3072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:48 smithi077 ceph-mon[27902]: pgmap v3072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:48 smithi191 ceph-mon[31636]: pgmap v3072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5580.123421 secs 2024-04-21T11:57:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5580.123421 secs 2024-04-21T11:57:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5580.123421 secs 2024-04-21T11:57:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:50 smithi170 ceph-mon[31212]: pgmap v3073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:50 smithi077 ceph-mon[27902]: pgmap v3073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:50 smithi191 ceph-mon[31636]: pgmap v3073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5583.362326 secs 2024-04-21T11:57:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:52 smithi077 ceph-mon[27902]: pgmap v3074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5583.362326 secs 2024-04-21T11:57:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:52 smithi191 ceph-mon[31636]: pgmap v3074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5583.362326 secs 2024-04-21T11:57:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:52 smithi170 ceph-mon[31212]: pgmap v3074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:57:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5585.123610 secs 2024-04-21T11:57:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:54 smithi077 ceph-mon[27902]: pgmap v3075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5585.123610 secs 2024-04-21T11:57:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:54 smithi191 ceph-mon[31636]: pgmap v3075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5585.123610 secs 2024-04-21T11:57:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:54 smithi170 ceph-mon[31212]: pgmap v3075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:56 smithi077 ceph-mon[27902]: pgmap v3076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:56 smithi191 ceph-mon[31636]: pgmap v3076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:57.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:56 smithi170 ceph-mon[31212]: pgmap v3076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:57:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5588.362458 secs 2024-04-21T11:57:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5588.362458 secs 2024-04-21T11:57:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5588.362458 secs 2024-04-21T11:57:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:58 smithi077 ceph-mon[27902]: pgmap v3077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:58 smithi191 ceph-mon[31636]: pgmap v3077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:57:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:58 smithi170 ceph-mon[31212]: pgmap v3077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:57:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5590.123745 secs 2024-04-21T11:58:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:57:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5590.123745 secs 2024-04-21T11:58:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:57:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5590.123745 secs 2024-04-21T11:58:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:00 smithi077 ceph-mon[27902]: pgmap v3078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:00 smithi191 ceph-mon[31636]: pgmap v3078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:00 smithi170 ceph-mon[31212]: pgmap v3078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5593.362599 secs 2024-04-21T11:58:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:02 smithi077 ceph-mon[27902]: pgmap v3079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5593.362599 secs 2024-04-21T11:58:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:02 smithi191 ceph-mon[31636]: pgmap v3079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5593.362599 secs 2024-04-21T11:58:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:02 smithi170 ceph-mon[31212]: pgmap v3079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5595.123880 secs 2024-04-21T11:58:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:04 smithi077 ceph-mon[27902]: pgmap v3080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:04 smithi077 ceph-mon[27902]: osdmap e267: 12 total, 12 up, 12 in 2024-04-21T11:58:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5595.123880 secs 2024-04-21T11:58:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:04 smithi191 ceph-mon[31636]: pgmap v3080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:04 smithi191 ceph-mon[31636]: osdmap e267: 12 total, 12 up, 12 in 2024-04-21T11:58:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5595.123880 secs 2024-04-21T11:58:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:04 smithi170 ceph-mon[31212]: pgmap v3080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:04 smithi170 ceph-mon[31212]: osdmap e267: 12 total, 12 up, 12 in 2024-04-21T11:58:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:06 smithi077 ceph-mon[27902]: pgmap v3082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:58:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:06 smithi191 ceph-mon[31636]: pgmap v3082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:58:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:06 smithi170 ceph-mon[31212]: pgmap v3082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:58:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5598.362732 secs 2024-04-21T11:58:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:07 smithi191 ceph-mon[31636]: osdmap e268: 12 total, 12 up, 12 in 2024-04-21T11:58:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5598.362732 secs 2024-04-21T11:58:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:07 smithi077 ceph-mon[27902]: osdmap e268: 12 total, 12 up, 12 in 2024-04-21T11:58:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5598.362732 secs 2024-04-21T11:58:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:07 smithi170 ceph-mon[31212]: osdmap e268: 12 total, 12 up, 12 in 2024-04-21T11:58:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:08 smithi077 ceph-mon[27902]: pgmap v3084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:58:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:08 smithi191 ceph-mon[31636]: pgmap v3084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:58:09.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:08 smithi170 ceph-mon[31212]: pgmap v3084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:58:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5600.123991 secs 2024-04-21T11:58:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5600.123991 secs 2024-04-21T11:58:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5600.123991 secs 2024-04-21T11:58:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:10 smithi077 ceph-mon[27902]: pgmap v3085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:58:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:10 smithi191 ceph-mon[31636]: pgmap v3085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:58:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:10 smithi170 ceph-mon[31212]: pgmap v3085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:58:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5603.362855 secs 2024-04-21T11:58:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:12 smithi077 ceph-mon[27902]: pgmap v3086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:58:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5603.362855 secs 2024-04-21T11:58:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:12 smithi191 ceph-mon[31636]: pgmap v3086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:58:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5603.362855 secs 2024-04-21T11:58:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:12 smithi170 ceph-mon[31212]: pgmap v3086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:58:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5605.124103 secs 2024-04-21T11:58:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:14 smithi077 ceph-mon[27902]: pgmap v3087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:58:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5605.124103 secs 2024-04-21T11:58:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:14 smithi191 ceph-mon[31636]: pgmap v3087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:58:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5605.124103 secs 2024-04-21T11:58:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:14 smithi170 ceph-mon[31212]: pgmap v3087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:58:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:16 smithi191 ceph-mon[31636]: pgmap v3088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:58:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:16 smithi170 ceph-mon[31212]: pgmap v3088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:58:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:16 smithi077 ceph-mon[27902]: pgmap v3088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:58:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5608.363004 secs 2024-04-21T11:58:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5608.363004 secs 2024-04-21T11:58:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5608.363004 secs 2024-04-21T11:58:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:18 smithi191 ceph-mon[31636]: pgmap v3089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:58:19.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:18 smithi077 ceph-mon[27902]: pgmap v3089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:58:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:18 smithi170 ceph-mon[31212]: pgmap v3089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:58:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5610.124212 secs 2024-04-21T11:58:20.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5610.124212 secs 2024-04-21T11:58:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5610.124212 secs 2024-04-21T11:58:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:20 smithi191 ceph-mon[31636]: pgmap v3090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:58:21.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:20 smithi170 ceph-mon[31212]: pgmap v3090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:58:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:20 smithi077 ceph-mon[27902]: pgmap v3090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:58:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:21 smithi191 ceph-mon[31636]: pgmap v3091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:58:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:21 smithi170 ceph-mon[31212]: pgmap v3091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:58:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:21 smithi077 ceph-mon[27902]: pgmap v3091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:58:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5613.363114 secs 2024-04-21T11:58:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5613.363114 secs 2024-04-21T11:58:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5613.363114 secs 2024-04-21T11:58:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:23 smithi191 ceph-mon[31636]: pgmap v3092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:23 smithi170 ceph-mon[31212]: pgmap v3092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:23 smithi077 ceph-mon[27902]: pgmap v3092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5615.124288 secs 2024-04-21T11:58:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5615.124288 secs 2024-04-21T11:58:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5615.124288 secs 2024-04-21T11:58:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:25 smithi191 ceph-mon[31636]: pgmap v3093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:25 smithi170 ceph-mon[31212]: pgmap v3093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:25 smithi077 ceph-mon[27902]: pgmap v3093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5618.363230 secs 2024-04-21T11:58:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5618.363230 secs 2024-04-21T11:58:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5618.363230 secs 2024-04-21T11:58:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:28 smithi170 ceph-mon[31212]: pgmap v3094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:28 smithi077 ceph-mon[27902]: pgmap v3094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:28 smithi191 ceph-mon[31636]: pgmap v3094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5620.124405 secs 2024-04-21T11:58:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5620.124405 secs 2024-04-21T11:58:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5620.124405 secs 2024-04-21T11:58:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:30 smithi077 ceph-mon[27902]: pgmap v3095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:30 smithi191 ceph-mon[31636]: pgmap v3095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:30 smithi170 ceph-mon[31212]: pgmap v3095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5623.363294 secs 2024-04-21T11:58:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:32 smithi077 ceph-mon[27902]: pgmap v3096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5623.363294 secs 2024-04-21T11:58:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:32 smithi191 ceph-mon[31636]: pgmap v3096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5623.363294 secs 2024-04-21T11:58:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:32 smithi170 ceph-mon[31212]: pgmap v3096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5625.124528 secs 2024-04-21T11:58:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:34 smithi077 ceph-mon[27902]: pgmap v3097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:58:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5625.124528 secs 2024-04-21T11:58:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:34 smithi191 ceph-mon[31636]: pgmap v3097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:58:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5625.124528 secs 2024-04-21T11:58:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:34 smithi170 ceph-mon[31212]: pgmap v3097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:58:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:58:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:58:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:58:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:58:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:58:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:58:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:58:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:58:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:58:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:36 smithi077 ceph-mon[27902]: pgmap v3098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:36 smithi191 ceph-mon[31636]: pgmap v3098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:36 smithi170 ceph-mon[31212]: pgmap v3098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:38.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5628.363428 secs 2024-04-21T11:58:38.161 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5628.363428 secs 2024-04-21T11:58:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5628.363428 secs 2024-04-21T11:58:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:38 smithi077 ceph-mon[27902]: pgmap v3099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:38 smithi191 ceph-mon[31636]: pgmap v3099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:38 smithi170 ceph-mon[31212]: pgmap v3099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5630.124649 secs 2024-04-21T11:58:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5630.124649 secs 2024-04-21T11:58:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5630.124649 secs 2024-04-21T11:58:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:40 smithi077 ceph-mon[27902]: pgmap v3100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:40 smithi191 ceph-mon[31636]: pgmap v3100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:40 smithi170 ceph-mon[31212]: pgmap v3100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5633.363545 secs 2024-04-21T11:58:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:42 smithi077 ceph-mon[27902]: pgmap v3101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5633.363545 secs 2024-04-21T11:58:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:42 smithi191 ceph-mon[31636]: pgmap v3101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5633.363545 secs 2024-04-21T11:58:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:42 smithi170 ceph-mon[31212]: pgmap v3101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5635.124741 secs 2024-04-21T11:58:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:44 smithi077 ceph-mon[27902]: pgmap v3102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5635.124741 secs 2024-04-21T11:58:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:44 smithi191 ceph-mon[31636]: pgmap v3102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5635.124741 secs 2024-04-21T11:58:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:44 smithi170 ceph-mon[31212]: pgmap v3102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:46 smithi077 ceph-mon[27902]: pgmap v3103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:46 smithi191 ceph-mon[31636]: pgmap v3103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:46 smithi170 ceph-mon[31212]: pgmap v3103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5638.363640 secs 2024-04-21T11:58:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5638.363640 secs 2024-04-21T11:58:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5638.363640 secs 2024-04-21T11:58:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:48 smithi191 ceph-mon[31636]: pgmap v3104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:48 smithi170 ceph-mon[31212]: pgmap v3104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:48 smithi077 ceph-mon[27902]: pgmap v3104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5640.124870 secs 2024-04-21T11:58:50.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5640.124870 secs 2024-04-21T11:58:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5640.124870 secs 2024-04-21T11:58:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:50 smithi191 ceph-mon[31636]: pgmap v3105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:51.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:50 smithi170 ceph-mon[31212]: pgmap v3105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:50 smithi077 ceph-mon[27902]: pgmap v3105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5643.363753 secs 2024-04-21T11:58:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:52 smithi191 ceph-mon[31636]: pgmap v3106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5643.363753 secs 2024-04-21T11:58:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:52 smithi170 ceph-mon[31212]: pgmap v3106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5643.363753 secs 2024-04-21T11:58:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:52 smithi077 ceph-mon[27902]: pgmap v3106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T11:58:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T11:58:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:58:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.410+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd700204f0 tx=0x7efd70046000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T11:58:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.419+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000113) for more than 900000000 us, fault. 2024-04-21T11:58:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T11:58:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T11:58:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.420+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T11:58:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:54.420+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T11:58:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:55.124+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:58:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:55.124+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:58:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:55.124+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:58:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:58:55.124+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:58:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:58:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5645.124949 secs 2024-04-21T11:58:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:54 smithi191 ceph-mon[31636]: pgmap v3107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5645.124949 secs 2024-04-21T11:58:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:54 smithi170 ceph-mon[31212]: pgmap v3107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5645.124949 secs 2024-04-21T11:58:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:54 smithi077 ceph-mon[27902]: pgmap v3107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:56 smithi191 ceph-mon[31636]: pgmap v3108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:57.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:56 smithi170 ceph-mon[31212]: pgmap v3108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:56 smithi077 ceph-mon[27902]: pgmap v3108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:58:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5648.363858 secs 2024-04-21T11:58:58.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5648.363858 secs 2024-04-21T11:58:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5648.363858 secs 2024-04-21T11:58:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:58 smithi191 ceph-mon[31636]: pgmap v3109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:58 smithi170 ceph-mon[31212]: pgmap v3109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:58:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:58 smithi077 ceph-mon[27902]: pgmap v3109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5650.125064 secs 2024-04-21T11:59:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:58:59 smithi191 ceph-mon[31636]: pgmap v3110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5650.125064 secs 2024-04-21T11:59:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:58:59 smithi170 ceph-mon[31212]: pgmap v3110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5650.125064 secs 2024-04-21T11:59:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:58:59 smithi077 ceph-mon[27902]: pgmap v3110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5653.364002 secs 2024-04-21T11:59:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:02 smithi077 ceph-mon[27902]: pgmap v3111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5653.364002 secs 2024-04-21T11:59:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:02 smithi191 ceph-mon[31636]: pgmap v3111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5653.364002 secs 2024-04-21T11:59:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:02 smithi170 ceph-mon[31212]: pgmap v3111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5655.125148 secs 2024-04-21T11:59:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:04 smithi077 ceph-mon[27902]: pgmap v3112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:04 smithi077 ceph-mon[27902]: osdmap e269: 12 total, 12 up, 12 in 2024-04-21T11:59:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5655.125148 secs 2024-04-21T11:59:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:04 smithi191 ceph-mon[31636]: pgmap v3112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:04 smithi191 ceph-mon[31636]: osdmap e269: 12 total, 12 up, 12 in 2024-04-21T11:59:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5655.125148 secs 2024-04-21T11:59:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:04 smithi170 ceph-mon[31212]: pgmap v3112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:04 smithi170 ceph-mon[31212]: osdmap e269: 12 total, 12 up, 12 in 2024-04-21T11:59:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:06 smithi077 ceph-mon[27902]: pgmap v3114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:59:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:06 smithi191 ceph-mon[31636]: pgmap v3114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:59:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:06 smithi170 ceph-mon[31212]: pgmap v3114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T11:59:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5658.364138 secs 2024-04-21T11:59:08.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:07 smithi191 ceph-mon[31636]: osdmap e270: 12 total, 12 up, 12 in 2024-04-21T11:59:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5658.364138 secs 2024-04-21T11:59:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:07 smithi077 ceph-mon[27902]: osdmap e270: 12 total, 12 up, 12 in 2024-04-21T11:59:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5658.364138 secs 2024-04-21T11:59:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:07 smithi170 ceph-mon[31212]: osdmap e270: 12 total, 12 up, 12 in 2024-04-21T11:59:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:08 smithi077 ceph-mon[27902]: pgmap v3116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:59:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:08 smithi191 ceph-mon[31636]: pgmap v3116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:59:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:08 smithi170 ceph-mon[31212]: pgmap v3116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:59:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5660.125263 secs 2024-04-21T11:59:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5660.125263 secs 2024-04-21T11:59:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5660.125263 secs 2024-04-21T11:59:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:10 smithi077 ceph-mon[27902]: pgmap v3117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:59:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:10 smithi191 ceph-mon[31636]: pgmap v3117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:59:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:10 smithi170 ceph-mon[31212]: pgmap v3117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T11:59:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5663.364257 secs 2024-04-21T11:59:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:12 smithi077 ceph-mon[27902]: pgmap v3118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:59:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5663.364257 secs 2024-04-21T11:59:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:12 smithi191 ceph-mon[31636]: pgmap v3118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:59:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5663.364257 secs 2024-04-21T11:59:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:12 smithi170 ceph-mon[31212]: pgmap v3118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T11:59:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5665.125381 secs 2024-04-21T11:59:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:14 smithi077 ceph-mon[27902]: pgmap v3119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:59:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5665.125381 secs 2024-04-21T11:59:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:14 smithi191 ceph-mon[31636]: pgmap v3119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:59:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5665.125381 secs 2024-04-21T11:59:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:14 smithi170 ceph-mon[31212]: pgmap v3119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T11:59:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:16 smithi191 ceph-mon[31636]: pgmap v3120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:59:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:16 smithi170 ceph-mon[31212]: pgmap v3120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:59:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:16 smithi077 ceph-mon[27902]: pgmap v3120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T11:59:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5668.364397 secs 2024-04-21T11:59:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5668.364397 secs 2024-04-21T11:59:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5668.364397 secs 2024-04-21T11:59:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:18 smithi191 ceph-mon[31636]: pgmap v3121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:59:19.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:18 smithi077 ceph-mon[27902]: pgmap v3121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:59:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:18 smithi170 ceph-mon[31212]: pgmap v3121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T11:59:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5670.125491 secs 2024-04-21T11:59:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5670.125491 secs 2024-04-21T11:59:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5670.125491 secs 2024-04-21T11:59:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:20 smithi191 ceph-mon[31636]: pgmap v3122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:59:21.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:20 smithi170 ceph-mon[31212]: pgmap v3122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:59:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:20 smithi077 ceph-mon[27902]: pgmap v3122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T11:59:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5673.364535 secs 2024-04-21T11:59:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:22 smithi191 ceph-mon[31636]: pgmap v3123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:59:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5673.364535 secs 2024-04-21T11:59:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:22 smithi170 ceph-mon[31212]: pgmap v3123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:59:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5673.364535 secs 2024-04-21T11:59:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:22 smithi077 ceph-mon[27902]: pgmap v3123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T11:59:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5675.125611 secs 2024-04-21T11:59:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:24 smithi191 ceph-mon[31636]: pgmap v3124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5675.125611 secs 2024-04-21T11:59:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:24 smithi170 ceph-mon[31212]: pgmap v3124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5675.125611 secs 2024-04-21T11:59:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:24 smithi077 ceph-mon[27902]: pgmap v3124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:26 smithi191 ceph-mon[31636]: pgmap v3125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:26 smithi170 ceph-mon[31212]: pgmap v3125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:26 smithi077 ceph-mon[27902]: pgmap v3125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5678.364648 secs 2024-04-21T11:59:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5678.364648 secs 2024-04-21T11:59:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5678.364648 secs 2024-04-21T11:59:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:28 smithi191 ceph-mon[31636]: pgmap v3126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:29.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:28 smithi170 ceph-mon[31212]: pgmap v3126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:28 smithi077 ceph-mon[27902]: pgmap v3126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5680.125740 secs 2024-04-21T11:59:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:29 smithi191 ceph-mon[31636]: pgmap v3127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5680.125740 secs 2024-04-21T11:59:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:29 smithi170 ceph-mon[31212]: pgmap v3127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5680.125740 secs 2024-04-21T11:59:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:29 smithi077 ceph-mon[27902]: pgmap v3127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5683.364774 secs 2024-04-21T11:59:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:32 smithi077 ceph-mon[27902]: pgmap v3128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5683.364774 secs 2024-04-21T11:59:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:32 smithi191 ceph-mon[31636]: pgmap v3128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5683.364774 secs 2024-04-21T11:59:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:32 smithi170 ceph-mon[31212]: pgmap v3128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5685.125889 secs 2024-04-21T11:59:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:34 smithi077 ceph-mon[27902]: pgmap v3129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5685.125889 secs 2024-04-21T11:59:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:34 smithi191 ceph-mon[31636]: pgmap v3129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5685.125889 secs 2024-04-21T11:59:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:34 smithi170 ceph-mon[31212]: pgmap v3129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:59:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:59:36.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T11:59:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:36 smithi077 ceph-mon[27902]: pgmap v3130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:59:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:59:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:59:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:36 smithi191 ceph-mon[31636]: pgmap v3130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:59:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:59:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:59:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:36 smithi170 ceph-mon[31212]: pgmap v3130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T11:59:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T11:59:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T11:59:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5688.364872 secs 2024-04-21T11:59:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5688.364872 secs 2024-04-21T11:59:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5688.364872 secs 2024-04-21T11:59:39.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:38 smithi077 ceph-mon[27902]: pgmap v3131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:38 smithi191 ceph-mon[31636]: pgmap v3131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:39.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:38 smithi170 ceph-mon[31212]: pgmap v3131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:59:40.130+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:59:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:59:40.130+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:59:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:59:40.130+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T11:59:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T11:59:40.130+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T11:59:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5690.126005 secs 2024-04-21T11:59:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5690.126005 secs 2024-04-21T11:59:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5690.126005 secs 2024-04-21T11:59:41.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:40 smithi077 ceph-mon[27902]: pgmap v3132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:40 smithi191 ceph-mon[31636]: pgmap v3132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:40 smithi170 ceph-mon[31212]: pgmap v3132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5693.364995 secs 2024-04-21T11:59:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:42 smithi077 ceph-mon[27902]: pgmap v3133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5693.364995 secs 2024-04-21T11:59:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:42 smithi191 ceph-mon[31636]: pgmap v3133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5693.364995 secs 2024-04-21T11:59:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:42 smithi170 ceph-mon[31212]: pgmap v3133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5695.126134 secs 2024-04-21T11:59:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:44 smithi191 ceph-mon[31636]: pgmap v3134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5695.126134 secs 2024-04-21T11:59:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:44 smithi170 ceph-mon[31212]: pgmap v3134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5695.126134 secs 2024-04-21T11:59:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:44 smithi077 ceph-mon[27902]: pgmap v3134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:46 smithi191 ceph-mon[31636]: pgmap v3135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:46 smithi170 ceph-mon[31212]: pgmap v3135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:46 smithi077 ceph-mon[27902]: pgmap v3135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5698.365053 secs 2024-04-21T11:59:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5698.365053 secs 2024-04-21T11:59:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5698.365053 secs 2024-04-21T11:59:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:48 smithi191 ceph-mon[31636]: pgmap v3136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:49.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:48 smithi077 ceph-mon[27902]: pgmap v3136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:48 smithi170 ceph-mon[31212]: pgmap v3136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5700.126247 secs 2024-04-21T11:59:50.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5700.126247 secs 2024-04-21T11:59:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5700.126247 secs 2024-04-21T11:59:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:50 smithi191 ceph-mon[31636]: pgmap v3137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:51.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:50 smithi170 ceph-mon[31212]: pgmap v3137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:50 smithi077 ceph-mon[27902]: pgmap v3137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5703.365171 secs 2024-04-21T11:59:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:52 smithi191 ceph-mon[31636]: pgmap v3138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5703.365171 secs 2024-04-21T11:59:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:52 smithi170 ceph-mon[31212]: pgmap v3138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5703.365171 secs 2024-04-21T11:59:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:52 smithi077 ceph-mon[27902]: pgmap v3138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T11:59:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5705.126369 secs 2024-04-21T11:59:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:54 smithi191 ceph-mon[31636]: pgmap v3139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5705.126369 secs 2024-04-21T11:59:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:54 smithi170 ceph-mon[31212]: pgmap v3139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5705.126369 secs 2024-04-21T11:59:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:54 smithi077 ceph-mon[27902]: pgmap v3139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:55 smithi191 ceph-mon[31636]: pgmap v3140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:56.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:55 smithi170 ceph-mon[31212]: pgmap v3140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:55 smithi077 ceph-mon[27902]: pgmap v3140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T11:59:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5708.365285 secs 2024-04-21T11:59:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5708.365285 secs 2024-04-21T11:59:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5708.365285 secs 2024-04-21T11:59:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:58 smithi077 ceph-mon[27902]: pgmap v3141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:58 smithi191 ceph-mon[31636]: pgmap v3141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:58 smithi170 ceph-mon[31212]: pgmap v3141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T11:59:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 11:59:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5710.126484 secs 2024-04-21T11:59:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 11:59:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5710.126484 secs 2024-04-21T11:59:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 11:59:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5710.126484 secs 2024-04-21T12:00:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:00 smithi077 ceph-mon[27902]: pgmap v3142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:00:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:00 smithi191 ceph-mon[31636]: pgmap v3142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:00:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:00 smithi170 ceph-mon[31212]: pgmap v3142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:00:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5713.365400 secs 2024-04-21T12:00:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:02 smithi077 ceph-mon[27902]: pgmap v3143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5713.365400 secs 2024-04-21T12:00:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:02 smithi191 ceph-mon[31636]: pgmap v3143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5713.365400 secs 2024-04-21T12:00:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:02 smithi170 ceph-mon[31212]: pgmap v3143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5715.126598 secs 2024-04-21T12:00:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:04 smithi077 ceph-mon[27902]: pgmap v3144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:04 smithi077 ceph-mon[27902]: osdmap e271: 12 total, 12 up, 12 in 2024-04-21T12:00:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5715.126598 secs 2024-04-21T12:00:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:04 smithi191 ceph-mon[31636]: pgmap v3144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:04 smithi191 ceph-mon[31636]: osdmap e271: 12 total, 12 up, 12 in 2024-04-21T12:00:05.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5715.126598 secs 2024-04-21T12:00:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:04 smithi170 ceph-mon[31212]: pgmap v3144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:04 smithi170 ceph-mon[31212]: osdmap e271: 12 total, 12 up, 12 in 2024-04-21T12:00:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:06 smithi077 ceph-mon[27902]: pgmap v3146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:00:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:06 smithi191 ceph-mon[31636]: pgmap v3146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:00:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:06 smithi170 ceph-mon[31212]: pgmap v3146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:00:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5718.365517 secs 2024-04-21T12:00:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:07 smithi077 ceph-mon[27902]: osdmap e272: 12 total, 12 up, 12 in 2024-04-21T12:00:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5718.365517 secs 2024-04-21T12:00:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:07 smithi170 ceph-mon[31212]: osdmap e272: 12 total, 12 up, 12 in 2024-04-21T12:00:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5718.365517 secs 2024-04-21T12:00:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:07 smithi191 ceph-mon[31636]: osdmap e272: 12 total, 12 up, 12 in 2024-04-21T12:00:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:08 smithi191 ceph-mon[31636]: pgmap v3148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:00:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:08 smithi170 ceph-mon[31212]: pgmap v3148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:00:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:08 smithi077 ceph-mon[27902]: pgmap v3148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:00:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5720.126730 secs 2024-04-21T12:00:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5720.126730 secs 2024-04-21T12:00:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5720.126730 secs 2024-04-21T12:00:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:10 smithi191 ceph-mon[31636]: pgmap v3149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:00:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:10 smithi170 ceph-mon[31212]: pgmap v3149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:00:11.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:10 smithi077 ceph-mon[27902]: pgmap v3149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:00:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5723.365638 secs 2024-04-21T12:00:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:12 smithi191 ceph-mon[31636]: pgmap v3150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:00:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5723.365638 secs 2024-04-21T12:00:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:12 smithi170 ceph-mon[31212]: pgmap v3150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:00:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5723.365638 secs 2024-04-21T12:00:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:12 smithi077 ceph-mon[27902]: pgmap v3150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:00:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5725.126881 secs 2024-04-21T12:00:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:14 smithi191 ceph-mon[31636]: pgmap v3151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:00:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5725.126881 secs 2024-04-21T12:00:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:14 smithi170 ceph-mon[31212]: pgmap v3151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:00:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5725.126881 secs 2024-04-21T12:00:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:14 smithi077 ceph-mon[27902]: pgmap v3151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:00:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:16 smithi191 ceph-mon[31636]: pgmap v3152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:00:17.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:16 smithi170 ceph-mon[31212]: pgmap v3152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:00:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:16 smithi077 ceph-mon[27902]: pgmap v3152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:00:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5728.365748 secs 2024-04-21T12:00:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5728.365748 secs 2024-04-21T12:00:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5728.365748 secs 2024-04-21T12:00:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:18 smithi191 ceph-mon[31636]: pgmap v3153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:00:19.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:18 smithi077 ceph-mon[27902]: pgmap v3153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:00:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:18 smithi170 ceph-mon[31212]: pgmap v3153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:00:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5730.126997 secs 2024-04-21T12:00:20.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5730.126997 secs 2024-04-21T12:00:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5730.126997 secs 2024-04-21T12:00:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:20 smithi191 ceph-mon[31636]: pgmap v3154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:00:21.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:20 smithi170 ceph-mon[31212]: pgmap v3154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:00:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:20 smithi077 ceph-mon[27902]: pgmap v3154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:00:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:21 smithi191 ceph-mon[31636]: pgmap v3155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:00:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:21 smithi170 ceph-mon[31212]: pgmap v3155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:00:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:21 smithi077 ceph-mon[27902]: pgmap v3155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:00:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5733.365861 secs 2024-04-21T12:00:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5733.365861 secs 2024-04-21T12:00:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5733.365861 secs 2024-04-21T12:00:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:23 smithi191 ceph-mon[31636]: pgmap v3156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:23 smithi170 ceph-mon[31212]: pgmap v3156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:23 smithi077 ceph-mon[27902]: pgmap v3156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5735.127061 secs 2024-04-21T12:00:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5735.127061 secs 2024-04-21T12:00:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5735.127061 secs 2024-04-21T12:00:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:25 smithi191 ceph-mon[31636]: pgmap v3157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:25 smithi170 ceph-mon[31212]: pgmap v3157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:25 smithi077 ceph-mon[27902]: pgmap v3157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5738.365982 secs 2024-04-21T12:00:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5738.365982 secs 2024-04-21T12:00:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5738.365982 secs 2024-04-21T12:00:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:28 smithi077 ceph-mon[27902]: pgmap v3158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:28 smithi191 ceph-mon[31636]: pgmap v3158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:28 smithi170 ceph-mon[31212]: pgmap v3158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5740.127170 secs 2024-04-21T12:00:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5740.127170 secs 2024-04-21T12:00:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5740.127170 secs 2024-04-21T12:00:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:30 smithi077 ceph-mon[27902]: pgmap v3159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:30 smithi191 ceph-mon[31636]: pgmap v3159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:30 smithi170 ceph-mon[31212]: pgmap v3159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5743.366117 secs 2024-04-21T12:00:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:32 smithi077 ceph-mon[27902]: pgmap v3160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5743.366117 secs 2024-04-21T12:00:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:32 smithi191 ceph-mon[31636]: pgmap v3160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5743.366117 secs 2024-04-21T12:00:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:32 smithi170 ceph-mon[31212]: pgmap v3160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5745.127262 secs 2024-04-21T12:00:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:34 smithi077 ceph-mon[27902]: pgmap v3161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5745.127262 secs 2024-04-21T12:00:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:34 smithi191 ceph-mon[31636]: pgmap v3161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5745.127262 secs 2024-04-21T12:00:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:34 smithi170 ceph-mon[31212]: pgmap v3161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:36 smithi191 ceph-mon[31636]: pgmap v3162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:00:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:00:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:00:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:00:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:36 smithi170 ceph-mon[31212]: pgmap v3162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:00:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:00:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:00:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:00:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:36 smithi077 ceph-mon[27902]: pgmap v3162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:00:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:00:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:00:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:00:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5748.366180 secs 2024-04-21T12:00:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5748.366180 secs 2024-04-21T12:00:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5748.366180 secs 2024-04-21T12:00:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:38 smithi191 ceph-mon[31636]: pgmap v3163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:39.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:38 smithi170 ceph-mon[31212]: pgmap v3163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:38 smithi077 ceph-mon[27902]: pgmap v3163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5750.127382 secs 2024-04-21T12:00:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5750.127382 secs 2024-04-21T12:00:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5750.127382 secs 2024-04-21T12:00:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:40 smithi191 ceph-mon[31636]: pgmap v3164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:40 smithi170 ceph-mon[31212]: pgmap v3164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:40 smithi077 ceph-mon[27902]: pgmap v3164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5753.366331 secs 2024-04-21T12:00:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:42 smithi191 ceph-mon[31636]: pgmap v3165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5753.366331 secs 2024-04-21T12:00:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:42 smithi170 ceph-mon[31212]: pgmap v3165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5753.366331 secs 2024-04-21T12:00:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:42 smithi077 ceph-mon[27902]: pgmap v3165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5755.127516 secs 2024-04-21T12:00:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:44 smithi191 ceph-mon[31636]: pgmap v3166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5755.127516 secs 2024-04-21T12:00:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:44 smithi170 ceph-mon[31212]: pgmap v3166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5755.127516 secs 2024-04-21T12:00:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:44 smithi077 ceph-mon[27902]: pgmap v3166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:46 smithi191 ceph-mon[31636]: pgmap v3167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:46 smithi170 ceph-mon[31212]: pgmap v3167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:46 smithi077 ceph-mon[27902]: pgmap v3167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5758.366467 secs 2024-04-21T12:00:48.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5758.366467 secs 2024-04-21T12:00:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5758.366467 secs 2024-04-21T12:00:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:48 smithi191 ceph-mon[31636]: pgmap v3168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:49.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:48 smithi077 ceph-mon[27902]: pgmap v3168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:49.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:48 smithi170 ceph-mon[31212]: pgmap v3168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 5760.127648 secs 2024-04-21T12:00:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:49 smithi191 ceph-mon[31636]: slow request 5760.127647 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T12:00:50.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 5760.127648 secs 2024-04-21T12:00:50.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:49 smithi170 ceph-mon[31212]: slow request 5760.127647 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T12:00:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 5760.127648 secs 2024-04-21T12:00:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:49 smithi077 ceph-mon[27902]: slow request 5760.127647 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T12:00:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:50 smithi191 ceph-mon[31636]: pgmap v3169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:50 smithi170 ceph-mon[31212]: pgmap v3169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:50 smithi077 ceph-mon[27902]: pgmap v3169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:51 smithi191 ceph-mon[31636]: pgmap v3170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:52.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:51 smithi170 ceph-mon[31212]: pgmap v3170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:51 smithi077 ceph-mon[27902]: pgmap v3170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 5763.366612 secs 2024-04-21T12:00:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:52 smithi191 ceph-mon[31636]: slow request 5763.366611 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T12:00:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 5763.366612 secs 2024-04-21T12:00:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:52 smithi170 ceph-mon[31212]: slow request 5763.366611 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T12:00:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 5763.366612 secs 2024-04-21T12:00:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:52 smithi077 ceph-mon[27902]: slow request 5763.366611 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T12:00:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:53 smithi191 ceph-mon[31636]: pgmap v3171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:54.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:53 smithi170 ceph-mon[31212]: pgmap v3171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:53 smithi077 ceph-mon[27902]: pgmap v3171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:00:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5765.127781 secs 2024-04-21T12:00:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5765.127781 secs 2024-04-21T12:00:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5765.127781 secs 2024-04-21T12:00:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:55 smithi191 ceph-mon[31636]: pgmap v3172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:56.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:55 smithi170 ceph-mon[31212]: pgmap v3172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:55 smithi077 ceph-mon[27902]: pgmap v3172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:00:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5768.366729 secs 2024-04-21T12:00:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5768.366729 secs 2024-04-21T12:00:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5768.366729 secs 2024-04-21T12:00:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:58 smithi077 ceph-mon[27902]: pgmap v3173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:58 smithi191 ceph-mon[31636]: pgmap v3173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:58 smithi170 ceph-mon[31212]: pgmap v3173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:00:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:00:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5770.127873 secs 2024-04-21T12:00:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:00:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5770.127873 secs 2024-04-21T12:00:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:00:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5770.127873 secs 2024-04-21T12:01:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:00 smithi077 ceph-mon[27902]: pgmap v3174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:00 smithi191 ceph-mon[31636]: pgmap v3174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:00 smithi170 ceph-mon[31212]: pgmap v3174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5773.366852 secs 2024-04-21T12:01:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:02 smithi191 ceph-mon[31636]: pgmap v3175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5773.366852 secs 2024-04-21T12:01:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:02 smithi170 ceph-mon[31212]: pgmap v3175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5773.366852 secs 2024-04-21T12:01:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:02 smithi077 ceph-mon[27902]: pgmap v3175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5775.127966 secs 2024-04-21T12:01:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:04 smithi191 ceph-mon[31636]: pgmap v3176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:04 smithi191 ceph-mon[31636]: osdmap e273: 12 total, 12 up, 12 in 2024-04-21T12:01:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5775.127966 secs 2024-04-21T12:01:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:04 smithi170 ceph-mon[31212]: pgmap v3176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:04 smithi170 ceph-mon[31212]: osdmap e273: 12 total, 12 up, 12 in 2024-04-21T12:01:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5775.127966 secs 2024-04-21T12:01:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:04 smithi077 ceph-mon[27902]: pgmap v3176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:04 smithi077 ceph-mon[27902]: osdmap e273: 12 total, 12 up, 12 in 2024-04-21T12:01:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:06 smithi191 ceph-mon[31636]: pgmap v3178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:01:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:06 smithi170 ceph-mon[31212]: pgmap v3178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:01:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:06 smithi077 ceph-mon[27902]: pgmap v3178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:01:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5778.366967 secs 2024-04-21T12:01:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:07 smithi170 ceph-mon[31212]: osdmap e274: 12 total, 12 up, 12 in 2024-04-21T12:01:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5778.366967 secs 2024-04-21T12:01:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:07 smithi191 ceph-mon[31636]: osdmap e274: 12 total, 12 up, 12 in 2024-04-21T12:01:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5778.366967 secs 2024-04-21T12:01:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:07 smithi077 ceph-mon[27902]: osdmap e274: 12 total, 12 up, 12 in 2024-04-21T12:01:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:08 smithi191 ceph-mon[31636]: pgmap v3180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:01:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:08 smithi170 ceph-mon[31212]: pgmap v3180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:01:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:08 smithi077 ceph-mon[27902]: pgmap v3180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:01:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5780.128047 secs 2024-04-21T12:01:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5780.128047 secs 2024-04-21T12:01:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5780.128047 secs 2024-04-21T12:01:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:10 smithi191 ceph-mon[31636]: pgmap v3181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:01:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:10 smithi170 ceph-mon[31212]: pgmap v3181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:01:11.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:10 smithi077 ceph-mon[27902]: pgmap v3181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:01:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5783.367081 secs 2024-04-21T12:01:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:12 smithi191 ceph-mon[31636]: pgmap v3182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:01:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5783.367081 secs 2024-04-21T12:01:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:12 smithi170 ceph-mon[31212]: pgmap v3182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:01:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5783.367081 secs 2024-04-21T12:01:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:12 smithi077 ceph-mon[27902]: pgmap v3182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:01:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5785.128187 secs 2024-04-21T12:01:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:14 smithi191 ceph-mon[31636]: pgmap v3183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:01:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5785.128187 secs 2024-04-21T12:01:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:14 smithi170 ceph-mon[31212]: pgmap v3183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:01:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5785.128187 secs 2024-04-21T12:01:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:14 smithi077 ceph-mon[27902]: pgmap v3183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:01:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:16 smithi191 ceph-mon[31636]: pgmap v3184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:01:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:16 smithi170 ceph-mon[31212]: pgmap v3184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:01:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:16 smithi077 ceph-mon[27902]: pgmap v3184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:01:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5788.367189 secs 2024-04-21T12:01:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5788.367189 secs 2024-04-21T12:01:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5788.367189 secs 2024-04-21T12:01:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:18 smithi191 ceph-mon[31636]: pgmap v3185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:01:19.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:18 smithi077 ceph-mon[27902]: pgmap v3185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:01:19.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:18 smithi170 ceph-mon[31212]: pgmap v3185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:01:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5790.128284 secs 2024-04-21T12:01:20.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5790.128284 secs 2024-04-21T12:01:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5790.128284 secs 2024-04-21T12:01:21.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:20 smithi191 ceph-mon[31636]: pgmap v3186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:01:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:20 smithi170 ceph-mon[31212]: pgmap v3186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:01:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:20 smithi077 ceph-mon[27902]: pgmap v3186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:01:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:21 smithi191 ceph-mon[31636]: pgmap v3187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:01:22.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:21 smithi170 ceph-mon[31212]: pgmap v3187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:01:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:21 smithi077 ceph-mon[27902]: pgmap v3187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:01:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5793.367306 secs 2024-04-21T12:01:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5793.367306 secs 2024-04-21T12:01:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5793.367306 secs 2024-04-21T12:01:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:23 smithi191 ceph-mon[31636]: pgmap v3188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:23 smithi170 ceph-mon[31212]: pgmap v3188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:23 smithi077 ceph-mon[27902]: pgmap v3188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5795.128420 secs 2024-04-21T12:01:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5795.128420 secs 2024-04-21T12:01:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5795.128420 secs 2024-04-21T12:01:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:25 smithi191 ceph-mon[31636]: pgmap v3189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:25 smithi170 ceph-mon[31212]: pgmap v3189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:25 smithi077 ceph-mon[27902]: pgmap v3189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5798.367407 secs 2024-04-21T12:01:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5798.367407 secs 2024-04-21T12:01:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5798.367407 secs 2024-04-21T12:01:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:28 smithi077 ceph-mon[27902]: pgmap v3190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:28 smithi191 ceph-mon[31636]: pgmap v3190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:28 smithi170 ceph-mon[31212]: pgmap v3190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5800.128553 secs 2024-04-21T12:01:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5800.128553 secs 2024-04-21T12:01:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5800.128553 secs 2024-04-21T12:01:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:30 smithi077 ceph-mon[27902]: pgmap v3191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:30 smithi191 ceph-mon[31636]: pgmap v3191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:30 smithi170 ceph-mon[31212]: pgmap v3191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5803.367530 secs 2024-04-21T12:01:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:32 smithi191 ceph-mon[31636]: pgmap v3192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5803.367530 secs 2024-04-21T12:01:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:32 smithi170 ceph-mon[31212]: pgmap v3192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5803.367530 secs 2024-04-21T12:01:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:32 smithi077 ceph-mon[27902]: pgmap v3192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5805.128675 secs 2024-04-21T12:01:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:34 smithi191 ceph-mon[31636]: pgmap v3193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5805.128675 secs 2024-04-21T12:01:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:34 smithi170 ceph-mon[31212]: pgmap v3193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5805.128675 secs 2024-04-21T12:01:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:34 smithi077 ceph-mon[27902]: pgmap v3193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:36 smithi191 ceph-mon[31636]: pgmap v3194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:01:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:36 smithi170 ceph-mon[31212]: pgmap v3194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:01:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:36 smithi077 ceph-mon[27902]: pgmap v3194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:01:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5808.367660 secs 2024-04-21T12:01:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:01:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:01:38.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:01:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5808.367660 secs 2024-04-21T12:01:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:01:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:01:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:01:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5808.367660 secs 2024-04-21T12:01:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:01:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:01:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:01:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:38 smithi191 ceph-mon[31636]: pgmap v3195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:39.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:38 smithi170 ceph-mon[31212]: pgmap v3195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:38 smithi077 ceph-mon[27902]: pgmap v3195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 5995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5810.128763 secs 2024-04-21T12:01:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5810.128763 secs 2024-04-21T12:01:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5810.128763 secs 2024-04-21T12:01:41.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:40 smithi191 ceph-mon[31636]: pgmap v3196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:40 smithi170 ceph-mon[31212]: pgmap v3196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:40 smithi077 ceph-mon[27902]: pgmap v3196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5813.367792 secs 2024-04-21T12:01:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:42 smithi191 ceph-mon[31636]: pgmap v3197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5813.367792 secs 2024-04-21T12:01:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:42 smithi170 ceph-mon[31212]: pgmap v3197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5813.367792 secs 2024-04-21T12:01:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:42 smithi077 ceph-mon[27902]: pgmap v3197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5815.128924 secs 2024-04-21T12:01:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:44 smithi191 ceph-mon[31636]: pgmap v3198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5815.128924 secs 2024-04-21T12:01:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:44 smithi170 ceph-mon[31212]: pgmap v3198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5815.128924 secs 2024-04-21T12:01:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:44 smithi077 ceph-mon[27902]: pgmap v3198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:46 smithi191 ceph-mon[31636]: pgmap v3199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:46 smithi170 ceph-mon[31212]: pgmap v3199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:46 smithi077 ceph-mon[27902]: pgmap v3199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5818.367900 secs 2024-04-21T12:01:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5818.367900 secs 2024-04-21T12:01:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5818.367900 secs 2024-04-21T12:01:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:48 smithi191 ceph-mon[31636]: pgmap v3200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:49.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:48 smithi077 ceph-mon[27902]: pgmap v3200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:49.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:48 smithi170 ceph-mon[31212]: pgmap v3200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5820.129076 secs 2024-04-21T12:01:50.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5820.129076 secs 2024-04-21T12:01:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5820.129076 secs 2024-04-21T12:01:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:50 smithi191 ceph-mon[31636]: pgmap v3201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:51.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:50 smithi170 ceph-mon[31212]: pgmap v3201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:50 smithi077 ceph-mon[27902]: pgmap v3201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:51 smithi191 ceph-mon[31636]: pgmap v3202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:52.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:51 smithi170 ceph-mon[31212]: pgmap v3202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:51 smithi077 ceph-mon[27902]: pgmap v3202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5823.368036 secs 2024-04-21T12:01:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5823.368036 secs 2024-04-21T12:01:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5823.368036 secs 2024-04-21T12:01:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:53 smithi191 ceph-mon[31636]: pgmap v3203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:54.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:53 smithi170 ceph-mon[31212]: pgmap v3203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:53 smithi077 ceph-mon[27902]: pgmap v3203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:01:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:01:55.150+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:01:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:01:55.150+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:01:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:01:55.150+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:01:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:01:55.150+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:01:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5825.129197 secs 2024-04-21T12:01:55.229 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5825.129197 secs 2024-04-21T12:01:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5825.129197 secs 2024-04-21T12:01:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:55 smithi191 ceph-mon[31636]: pgmap v3204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:56.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:55 smithi170 ceph-mon[31212]: pgmap v3204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:55 smithi077 ceph-mon[27902]: pgmap v3204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:01:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5828.368173 secs 2024-04-21T12:01:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5828.368173 secs 2024-04-21T12:01:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5828.368173 secs 2024-04-21T12:01:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:58 smithi077 ceph-mon[27902]: pgmap v3205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:58 smithi191 ceph-mon[31636]: pgmap v3205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:58 smithi170 ceph-mon[31212]: pgmap v3205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:01:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:01:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5830.129287 secs 2024-04-21T12:01:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:01:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5830.129287 secs 2024-04-21T12:01:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:01:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5830.129287 secs 2024-04-21T12:02:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:00 smithi077 ceph-mon[27902]: pgmap v3206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:00 smithi191 ceph-mon[31636]: pgmap v3206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:00 smithi170 ceph-mon[31212]: pgmap v3206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5833.368287 secs 2024-04-21T12:02:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:02 smithi191 ceph-mon[31636]: pgmap v3207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5833.368287 secs 2024-04-21T12:02:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:02 smithi170 ceph-mon[31212]: pgmap v3207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5833.368287 secs 2024-04-21T12:02:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:02 smithi077 ceph-mon[27902]: pgmap v3207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5835.129406 secs 2024-04-21T12:02:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:04 smithi191 ceph-mon[31636]: pgmap v3208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:04 smithi191 ceph-mon[31636]: osdmap e275: 12 total, 12 up, 12 in 2024-04-21T12:02:05.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5835.129406 secs 2024-04-21T12:02:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:04 smithi170 ceph-mon[31212]: pgmap v3208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:04 smithi170 ceph-mon[31212]: osdmap e275: 12 total, 12 up, 12 in 2024-04-21T12:02:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5835.129406 secs 2024-04-21T12:02:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:04 smithi077 ceph-mon[27902]: pgmap v3208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:04 smithi077 ceph-mon[27902]: osdmap e275: 12 total, 12 up, 12 in 2024-04-21T12:02:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:06 smithi191 ceph-mon[31636]: pgmap v3210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:02:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:06 smithi170 ceph-mon[31212]: pgmap v3210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:02:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:06 smithi077 ceph-mon[27902]: pgmap v3210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:02:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5838.368401 secs 2024-04-21T12:02:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:07 smithi170 ceph-mon[31212]: osdmap e276: 12 total, 12 up, 12 in 2024-04-21T12:02:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5838.368401 secs 2024-04-21T12:02:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:07 smithi191 ceph-mon[31636]: osdmap e276: 12 total, 12 up, 12 in 2024-04-21T12:02:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5838.368401 secs 2024-04-21T12:02:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:07 smithi077 ceph-mon[27902]: osdmap e276: 12 total, 12 up, 12 in 2024-04-21T12:02:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:08 smithi191 ceph-mon[31636]: pgmap v3212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:02:09.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:08 smithi170 ceph-mon[31212]: pgmap v3212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:02:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:08 smithi077 ceph-mon[27902]: pgmap v3212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:02:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5840.129519 secs 2024-04-21T12:02:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5840.129519 secs 2024-04-21T12:02:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5840.129519 secs 2024-04-21T12:02:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:10 smithi191 ceph-mon[31636]: pgmap v3213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:02:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:10 smithi170 ceph-mon[31212]: pgmap v3213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:02:11.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:10 smithi077 ceph-mon[27902]: pgmap v3213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:02:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5843.368519 secs 2024-04-21T12:02:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:12 smithi191 ceph-mon[31636]: pgmap v3214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:02:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5843.368519 secs 2024-04-21T12:02:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:12 smithi170 ceph-mon[31212]: pgmap v3214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:02:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5843.368519 secs 2024-04-21T12:02:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:12 smithi077 ceph-mon[27902]: pgmap v3214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:02:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:13 smithi170 ceph-mon[31212]: pgmap v3215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:02:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:13 smithi077 ceph-mon[27902]: pgmap v3215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:02:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:13 smithi191 ceph-mon[31636]: pgmap v3215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:02:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5845.129639 secs 2024-04-21T12:02:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5845.129639 secs 2024-04-21T12:02:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5845.129639 secs 2024-04-21T12:02:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:15 smithi170 ceph-mon[31212]: pgmap v3216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:02:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:15 smithi077 ceph-mon[27902]: pgmap v3216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:02:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:15 smithi191 ceph-mon[31636]: pgmap v3216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:02:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5848.368657 secs 2024-04-21T12:02:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5848.368657 secs 2024-04-21T12:02:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5848.368657 secs 2024-04-21T12:02:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:18 smithi077 ceph-mon[27902]: pgmap v3217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:02:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:18 smithi191 ceph-mon[31636]: pgmap v3217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:02:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:18 smithi170 ceph-mon[31212]: pgmap v3217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:02:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5850.129737 secs 2024-04-21T12:02:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5850.129737 secs 2024-04-21T12:02:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5850.129737 secs 2024-04-21T12:02:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:20 smithi077 ceph-mon[27902]: pgmap v3218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:02:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:20 smithi191 ceph-mon[31636]: pgmap v3218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:02:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:20 smithi170 ceph-mon[31212]: pgmap v3218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:02:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5853.368819 secs 2024-04-21T12:02:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:22 smithi191 ceph-mon[31636]: pgmap v3219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:02:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5853.368819 secs 2024-04-21T12:02:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:22 smithi170 ceph-mon[31212]: pgmap v3219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:02:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5853.368819 secs 2024-04-21T12:02:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:22 smithi077 ceph-mon[27902]: pgmap v3219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:02:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5855.129887 secs 2024-04-21T12:02:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:24 smithi191 ceph-mon[31636]: pgmap v3220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5855.129887 secs 2024-04-21T12:02:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:24 smithi170 ceph-mon[31212]: pgmap v3220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5855.129887 secs 2024-04-21T12:02:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:24 smithi077 ceph-mon[27902]: pgmap v3220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:26 smithi191 ceph-mon[31636]: pgmap v3221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:26 smithi170 ceph-mon[31212]: pgmap v3221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:26 smithi077 ceph-mon[27902]: pgmap v3221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5858.368927 secs 2024-04-21T12:02:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5858.368927 secs 2024-04-21T12:02:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5858.368927 secs 2024-04-21T12:02:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:28 smithi191 ceph-mon[31636]: pgmap v3222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:28 smithi170 ceph-mon[31212]: pgmap v3222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:28 smithi077 ceph-mon[27902]: pgmap v3222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5860.130001 secs 2024-04-21T12:02:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5860.130001 secs 2024-04-21T12:02:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5860.130001 secs 2024-04-21T12:02:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:30 smithi191 ceph-mon[31636]: pgmap v3223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:31.237 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:30 smithi077 ceph-mon[27902]: pgmap v3223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:31.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:30 smithi170 ceph-mon[31212]: pgmap v3223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5863.369043 secs 2024-04-21T12:02:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:32 smithi191 ceph-mon[31636]: pgmap v3224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5863.369043 secs 2024-04-21T12:02:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:32 smithi170 ceph-mon[31212]: pgmap v3224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5863.369043 secs 2024-04-21T12:02:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:32 smithi077 ceph-mon[27902]: pgmap v3224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:33 smithi170 ceph-mon[31212]: pgmap v3225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:33 smithi077 ceph-mon[27902]: pgmap v3225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:33 smithi191 ceph-mon[31636]: pgmap v3225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5865.130075 secs 2024-04-21T12:02:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5865.130075 secs 2024-04-21T12:02:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5865.130075 secs 2024-04-21T12:02:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:35 smithi170 ceph-mon[31212]: pgmap v3226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:35 smithi077 ceph-mon[27902]: pgmap v3226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:35 smithi191 ceph-mon[31636]: pgmap v3226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5868.369130 secs 2024-04-21T12:02:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5868.369130 secs 2024-04-21T12:02:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5868.369130 secs 2024-04-21T12:02:38.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:02:38.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:38 smithi191 ceph-mon[31636]: pgmap v3227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:38.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:02:38.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:02:38.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:38 smithi077 ceph-mon[27902]: pgmap v3227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:02:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:02:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:38 smithi170 ceph-mon[31212]: pgmap v3227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:02:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:02:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:02:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5870.130169 secs 2024-04-21T12:02:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5870.130169 secs 2024-04-21T12:02:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5870.130169 secs 2024-04-21T12:02:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:40 smithi077 ceph-mon[27902]: pgmap v3228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:40 smithi191 ceph-mon[31636]: pgmap v3228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:40 smithi170 ceph-mon[31212]: pgmap v3228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5873.369246 secs 2024-04-21T12:02:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:42 smithi191 ceph-mon[31636]: pgmap v3229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5873.369246 secs 2024-04-21T12:02:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:42 smithi170 ceph-mon[31212]: pgmap v3229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5873.369246 secs 2024-04-21T12:02:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:42 smithi077 ceph-mon[27902]: pgmap v3229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5875.130290 secs 2024-04-21T12:02:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:44 smithi191 ceph-mon[31636]: pgmap v3230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5875.130290 secs 2024-04-21T12:02:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:44 smithi170 ceph-mon[31212]: pgmap v3230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5875.130290 secs 2024-04-21T12:02:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:44 smithi077 ceph-mon[27902]: pgmap v3230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:46 smithi191 ceph-mon[31636]: pgmap v3231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:46 smithi170 ceph-mon[31212]: pgmap v3231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:46 smithi077 ceph-mon[27902]: pgmap v3231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5878.369373 secs 2024-04-21T12:02:48.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5878.369373 secs 2024-04-21T12:02:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5878.369373 secs 2024-04-21T12:02:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:48 smithi191 ceph-mon[31636]: pgmap v3232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:49.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:48 smithi077 ceph-mon[27902]: pgmap v3232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:49.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:48 smithi170 ceph-mon[31212]: pgmap v3232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5880.130405 secs 2024-04-21T12:02:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5880.130405 secs 2024-04-21T12:02:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5880.130405 secs 2024-04-21T12:02:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:50 smithi191 ceph-mon[31636]: pgmap v3233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:51.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:50 smithi170 ceph-mon[31212]: pgmap v3233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:50 smithi077 ceph-mon[27902]: pgmap v3233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:51 smithi191 ceph-mon[31636]: pgmap v3234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:52.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:51 smithi170 ceph-mon[31212]: pgmap v3234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:51 smithi077 ceph-mon[27902]: pgmap v3234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5883.369457 secs 2024-04-21T12:02:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5883.369457 secs 2024-04-21T12:02:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5883.369457 secs 2024-04-21T12:02:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:53 smithi191 ceph-mon[31636]: pgmap v3235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:54.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:53 smithi170 ceph-mon[31212]: pgmap v3235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:53 smithi077 ceph-mon[27902]: pgmap v3235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:02:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5885.130520 secs 2024-04-21T12:02:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5885.130520 secs 2024-04-21T12:02:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5885.130520 secs 2024-04-21T12:02:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:55 smithi191 ceph-mon[31636]: pgmap v3236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:55 smithi170 ceph-mon[31212]: pgmap v3236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:55 smithi077 ceph-mon[27902]: pgmap v3236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:02:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5888.369575 secs 2024-04-21T12:02:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5888.369575 secs 2024-04-21T12:02:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5888.369575 secs 2024-04-21T12:02:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:58 smithi077 ceph-mon[27902]: pgmap v3237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:58 smithi191 ceph-mon[31636]: pgmap v3237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:58 smithi170 ceph-mon[31212]: pgmap v3237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:02:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:02:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5890.130624 secs 2024-04-21T12:02:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:02:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5890.130624 secs 2024-04-21T12:02:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:02:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5890.130624 secs 2024-04-21T12:03:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:00 smithi077 ceph-mon[27902]: pgmap v3238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:00 smithi191 ceph-mon[31636]: pgmap v3238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:00 smithi170 ceph-mon[31212]: pgmap v3238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5893.369668 secs 2024-04-21T12:03:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:02 smithi191 ceph-mon[31636]: pgmap v3239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:03:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5893.369668 secs 2024-04-21T12:03:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:02 smithi170 ceph-mon[31212]: pgmap v3239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:03:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5893.369668 secs 2024-04-21T12:03:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:02 smithi077 ceph-mon[27902]: pgmap v3239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:03:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5895.130736 secs 2024-04-21T12:03:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:04 smithi191 ceph-mon[31636]: pgmap v3240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:03:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:04 smithi191 ceph-mon[31636]: osdmap e277: 12 total, 12 up, 12 in 2024-04-21T12:03:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5895.130736 secs 2024-04-21T12:03:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:04 smithi170 ceph-mon[31212]: pgmap v3240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:03:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:04 smithi170 ceph-mon[31212]: osdmap e277: 12 total, 12 up, 12 in 2024-04-21T12:03:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5895.130736 secs 2024-04-21T12:03:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:04 smithi077 ceph-mon[27902]: pgmap v3240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:03:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:04 smithi077 ceph-mon[27902]: osdmap e277: 12 total, 12 up, 12 in 2024-04-21T12:03:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:06 smithi191 ceph-mon[31636]: pgmap v3242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:03:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:06 smithi170 ceph-mon[31212]: pgmap v3242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:03:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:06 smithi077 ceph-mon[27902]: pgmap v3242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:03:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5898.369767 secs 2024-04-21T12:03:08.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:07 smithi170 ceph-mon[31212]: osdmap e278: 12 total, 12 up, 12 in 2024-04-21T12:03:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5898.369767 secs 2024-04-21T12:03:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:07 smithi191 ceph-mon[31636]: osdmap e278: 12 total, 12 up, 12 in 2024-04-21T12:03:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5898.369767 secs 2024-04-21T12:03:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:07 smithi077 ceph-mon[27902]: osdmap e278: 12 total, 12 up, 12 in 2024-04-21T12:03:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:08 smithi191 ceph-mon[31636]: pgmap v3244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:03:09.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:08 smithi170 ceph-mon[31212]: pgmap v3244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:03:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:08 smithi077 ceph-mon[27902]: pgmap v3244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:03:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5900.130893 secs 2024-04-21T12:03:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5900.130893 secs 2024-04-21T12:03:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5900.130893 secs 2024-04-21T12:03:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:10 smithi191 ceph-mon[31636]: pgmap v3245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:03:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:10 smithi170 ceph-mon[31212]: pgmap v3245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:03:11.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:10 smithi077 ceph-mon[27902]: pgmap v3245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:03:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:11 smithi191 ceph-mon[31636]: pgmap v3246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:03:12.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:11 smithi170 ceph-mon[31212]: pgmap v3246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:03:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:11 smithi077 ceph-mon[27902]: pgmap v3246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:03:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5903.369892 secs 2024-04-21T12:03:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5903.369892 secs 2024-04-21T12:03:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5903.369892 secs 2024-04-21T12:03:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:13 smithi191 ceph-mon[31636]: pgmap v3247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 309 B/s wr, 6 op/s 2024-04-21T12:03:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:13 smithi170 ceph-mon[31212]: pgmap v3247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 309 B/s wr, 6 op/s 2024-04-21T12:03:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:13 smithi077 ceph-mon[27902]: pgmap v3247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 309 B/s wr, 6 op/s 2024-04-21T12:03:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5905.130994 secs 2024-04-21T12:03:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5905.130994 secs 2024-04-21T12:03:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5905.130994 secs 2024-04-21T12:03:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:15 smithi191 ceph-mon[31636]: pgmap v3248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:03:16.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:15 smithi170 ceph-mon[31212]: pgmap v3248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:03:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:15 smithi077 ceph-mon[27902]: pgmap v3248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:03:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5908.370010 secs 2024-04-21T12:03:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5908.370010 secs 2024-04-21T12:03:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5908.370010 secs 2024-04-21T12:03:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:18 smithi191 ceph-mon[31636]: pgmap v3249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:03:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:18 smithi170 ceph-mon[31212]: pgmap v3249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:03:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:18 smithi077 ceph-mon[27902]: pgmap v3249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:03:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5910.131114 secs 2024-04-21T12:03:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5910.131114 secs 2024-04-21T12:03:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5910.131114 secs 2024-04-21T12:03:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:20 smithi191 ceph-mon[31636]: pgmap v3250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:03:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:20 smithi170 ceph-mon[31212]: pgmap v3250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:03:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:20 smithi077 ceph-mon[27902]: pgmap v3250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:03:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5913.370129 secs 2024-04-21T12:03:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:22 smithi191 ceph-mon[31636]: pgmap v3251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:03:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5913.370129 secs 2024-04-21T12:03:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:22 smithi170 ceph-mon[31212]: pgmap v3251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:03:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5913.370129 secs 2024-04-21T12:03:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:22 smithi077 ceph-mon[27902]: pgmap v3251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:03:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5915.131237 secs 2024-04-21T12:03:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:24 smithi191 ceph-mon[31636]: pgmap v3252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5915.131237 secs 2024-04-21T12:03:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:24 smithi170 ceph-mon[31212]: pgmap v3252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5915.131237 secs 2024-04-21T12:03:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:24 smithi077 ceph-mon[27902]: pgmap v3252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:26 smithi191 ceph-mon[31636]: pgmap v3253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:27.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:26 smithi170 ceph-mon[31212]: pgmap v3253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:26 smithi077 ceph-mon[27902]: pgmap v3253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5918.370244 secs 2024-04-21T12:03:28.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5918.370244 secs 2024-04-21T12:03:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5918.370244 secs 2024-04-21T12:03:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:28 smithi191 ceph-mon[31636]: pgmap v3254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:28 smithi170 ceph-mon[31212]: pgmap v3254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:28 smithi077 ceph-mon[27902]: pgmap v3254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5920.131356 secs 2024-04-21T12:03:30.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5920.131356 secs 2024-04-21T12:03:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5920.131356 secs 2024-04-21T12:03:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:30 smithi191 ceph-mon[31636]: pgmap v3255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:31.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:30 smithi170 ceph-mon[31212]: pgmap v3255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:31.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:30 smithi077 ceph-mon[27902]: pgmap v3255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:31 smithi191 ceph-mon[31636]: pgmap v3256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:32.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:31 smithi170 ceph-mon[31212]: pgmap v3256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:31 smithi077 ceph-mon[27902]: pgmap v3256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5923.370356 secs 2024-04-21T12:03:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5923.370356 secs 2024-04-21T12:03:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5923.370356 secs 2024-04-21T12:03:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:33 smithi170 ceph-mon[31212]: pgmap v3257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:33 smithi077 ceph-mon[27902]: pgmap v3257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:33 smithi191 ceph-mon[31636]: pgmap v3257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5925.131483 secs 2024-04-21T12:03:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5925.131483 secs 2024-04-21T12:03:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5925.131483 secs 2024-04-21T12:03:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:35 smithi170 ceph-mon[31212]: pgmap v3258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:35 smithi077 ceph-mon[27902]: pgmap v3258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:35 smithi191 ceph-mon[31636]: pgmap v3258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5928.370469 secs 2024-04-21T12:03:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5928.370469 secs 2024-04-21T12:03:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5928.370469 secs 2024-04-21T12:03:38.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:38 smithi191 ceph-mon[31636]: pgmap v3259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:38 smithi077 ceph-mon[27902]: pgmap v3259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:38 smithi170 ceph-mon[31212]: pgmap v3259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:39.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5930.131625 secs 2024-04-21T12:03:39.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:03:39.524 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5930.131625 secs 2024-04-21T12:03:39.524 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:03:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5930.131625 secs 2024-04-21T12:03:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:03:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: pgmap v3260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: pgmap v3260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: pgmap v3260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:03:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:03:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:03:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:03:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5933.370602 secs 2024-04-21T12:03:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:42 smithi077 ceph-mon[27902]: pgmap v3261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5933.370602 secs 2024-04-21T12:03:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:42 smithi191 ceph-mon[31636]: pgmap v3261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5933.370602 secs 2024-04-21T12:03:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:42 smithi170 ceph-mon[31212]: pgmap v3261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5935.131747 secs 2024-04-21T12:03:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:44 smithi191 ceph-mon[31636]: pgmap v3262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5935.131747 secs 2024-04-21T12:03:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:44 smithi170 ceph-mon[31212]: pgmap v3262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5935.131747 secs 2024-04-21T12:03:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:44 smithi077 ceph-mon[27902]: pgmap v3262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:46 smithi191 ceph-mon[31636]: pgmap v3263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:47.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:46 smithi170 ceph-mon[31212]: pgmap v3263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:46 smithi077 ceph-mon[27902]: pgmap v3263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5938.370722 secs 2024-04-21T12:03:48.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5938.370722 secs 2024-04-21T12:03:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5938.370722 secs 2024-04-21T12:03:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:48 smithi191 ceph-mon[31636]: pgmap v3264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:49.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:48 smithi077 ceph-mon[27902]: pgmap v3264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:49.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:48 smithi170 ceph-mon[31212]: pgmap v3264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5940.131875 secs 2024-04-21T12:03:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:49 smithi191 ceph-mon[31636]: pgmap v3265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5940.131875 secs 2024-04-21T12:03:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:49 smithi170 ceph-mon[31212]: pgmap v3265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5940.131875 secs 2024-04-21T12:03:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:49 smithi077 ceph-mon[27902]: pgmap v3265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5943.370839 secs 2024-04-21T12:03:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:52 smithi191 ceph-mon[31636]: pgmap v3266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5943.370839 secs 2024-04-21T12:03:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:52 smithi170 ceph-mon[31212]: pgmap v3266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5943.370839 secs 2024-04-21T12:03:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:52 smithi077 ceph-mon[27902]: pgmap v3266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:03:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5945.131986 secs 2024-04-21T12:03:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:54 smithi191 ceph-mon[31636]: pgmap v3267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5945.131986 secs 2024-04-21T12:03:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:54 smithi170 ceph-mon[31212]: pgmap v3267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5945.131986 secs 2024-04-21T12:03:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:54 smithi077 ceph-mon[27902]: pgmap v3267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:56 smithi191 ceph-mon[31636]: pgmap v3268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:57.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:56 smithi170 ceph-mon[31212]: pgmap v3268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:56 smithi077 ceph-mon[27902]: pgmap v3268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:03:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5948.370949 secs 2024-04-21T12:03:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5948.370949 secs 2024-04-21T12:03:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5948.370949 secs 2024-04-21T12:03:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:58 smithi191 ceph-mon[31636]: pgmap v3269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:59.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:58 smithi170 ceph-mon[31212]: pgmap v3269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:03:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:58 smithi077 ceph-mon[27902]: pgmap v3269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5950.132102 secs 2024-04-21T12:04:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:03:59 smithi191 ceph-mon[31636]: pgmap v3270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:00.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5950.132102 secs 2024-04-21T12:04:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:03:59 smithi170 ceph-mon[31212]: pgmap v3270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5950.132102 secs 2024-04-21T12:04:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:03:59 smithi077 ceph-mon[27902]: pgmap v3270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5953.371068 secs 2024-04-21T12:04:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:02 smithi191 ceph-mon[31636]: pgmap v3271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T12:04:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5953.371068 secs 2024-04-21T12:04:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:02 smithi170 ceph-mon[31212]: pgmap v3271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T12:04:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5953.371068 secs 2024-04-21T12:04:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:02 smithi077 ceph-mon[27902]: pgmap v3271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T12:04:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5955.132232 secs 2024-04-21T12:04:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:04 smithi191 ceph-mon[31636]: pgmap v3272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T12:04:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:04 smithi191 ceph-mon[31636]: osdmap e279: 12 total, 12 up, 12 in 2024-04-21T12:04:05.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5955.132232 secs 2024-04-21T12:04:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:04 smithi170 ceph-mon[31212]: pgmap v3272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T12:04:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:04 smithi170 ceph-mon[31212]: osdmap e279: 12 total, 12 up, 12 in 2024-04-21T12:04:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5955.132232 secs 2024-04-21T12:04:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:04 smithi077 ceph-mon[27902]: pgmap v3272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T12:04:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:04 smithi077 ceph-mon[27902]: osdmap e279: 12 total, 12 up, 12 in 2024-04-21T12:04:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:05 smithi191 ceph-mon[31636]: pgmap v3274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:04:06.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:05 smithi170 ceph-mon[31212]: pgmap v3274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:04:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:05 smithi077 ceph-mon[27902]: pgmap v3274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:04:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5958.371187 secs 2024-04-21T12:04:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5958.371187 secs 2024-04-21T12:04:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5958.371187 secs 2024-04-21T12:04:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:08 smithi170 ceph-mon[31212]: osdmap e280: 12 total, 12 up, 12 in 2024-04-21T12:04:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:08 smithi170 ceph-mon[31212]: pgmap v3276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:04:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:08 smithi191 ceph-mon[31636]: osdmap e280: 12 total, 12 up, 12 in 2024-04-21T12:04:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:08 smithi191 ceph-mon[31636]: pgmap v3276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:04:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:08 smithi077 ceph-mon[27902]: osdmap e280: 12 total, 12 up, 12 in 2024-04-21T12:04:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:08 smithi077 ceph-mon[27902]: pgmap v3276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:04:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5960.132316 secs 2024-04-21T12:04:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5960.132316 secs 2024-04-21T12:04:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5960.132316 secs 2024-04-21T12:04:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:10 smithi191 ceph-mon[31636]: pgmap v3277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 20 op/s 2024-04-21T12:04:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:10 smithi170 ceph-mon[31212]: pgmap v3277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 20 op/s 2024-04-21T12:04:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:10 smithi077 ceph-mon[27902]: pgmap v3277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 20 op/s 2024-04-21T12:04:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5963.371305 secs 2024-04-21T12:04:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:12 smithi191 ceph-mon[31636]: pgmap v3278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 24 op/s 2024-04-21T12:04:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5963.371305 secs 2024-04-21T12:04:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:12 smithi170 ceph-mon[31212]: pgmap v3278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 24 op/s 2024-04-21T12:04:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5963.371305 secs 2024-04-21T12:04:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:12 smithi077 ceph-mon[27902]: pgmap v3278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 24 op/s 2024-04-21T12:04:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5965.132466 secs 2024-04-21T12:04:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:14 smithi191 ceph-mon[31636]: pgmap v3279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 20 op/s 2024-04-21T12:04:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5965.132466 secs 2024-04-21T12:04:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:14 smithi170 ceph-mon[31212]: pgmap v3279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 20 op/s 2024-04-21T12:04:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5965.132466 secs 2024-04-21T12:04:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:14 smithi077 ceph-mon[27902]: pgmap v3279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 20 op/s 2024-04-21T12:04:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:16 smithi191 ceph-mon[31636]: pgmap v3280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:04:17.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:16 smithi170 ceph-mon[31212]: pgmap v3280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:04:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:16 smithi077 ceph-mon[27902]: pgmap v3280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:04:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5968.371368 secs 2024-04-21T12:04:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:17 smithi191 ceph-mon[31636]: pgmap v3281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:04:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5968.371368 secs 2024-04-21T12:04:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:17 smithi170 ceph-mon[31212]: pgmap v3281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:04:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5968.371368 secs 2024-04-21T12:04:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:17 smithi077 ceph-mon[27902]: pgmap v3281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:04:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5970.132584 secs 2024-04-21T12:04:19.414 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5970.132584 secs 2024-04-21T12:04:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5970.132584 secs 2024-04-21T12:04:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:20 smithi170 ceph-mon[31212]: pgmap v3282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:04:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:20 smithi077 ceph-mon[27902]: pgmap v3282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:04:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:20 smithi191 ceph-mon[31636]: pgmap v3282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:04:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5973.371482 secs 2024-04-21T12:04:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:22 smithi191 ceph-mon[31636]: pgmap v3283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:04:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5973.371482 secs 2024-04-21T12:04:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:22 smithi170 ceph-mon[31212]: pgmap v3283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:04:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5973.371482 secs 2024-04-21T12:04:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:22 smithi077 ceph-mon[27902]: pgmap v3283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:04:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5975.132701 secs 2024-04-21T12:04:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:24 smithi191 ceph-mon[31636]: pgmap v3284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5975.132701 secs 2024-04-21T12:04:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:24 smithi170 ceph-mon[31212]: pgmap v3284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5975.132701 secs 2024-04-21T12:04:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:24 smithi077 ceph-mon[27902]: pgmap v3284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:26 smithi170 ceph-mon[31212]: pgmap v3285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:26 smithi077 ceph-mon[27902]: pgmap v3285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:26 smithi191 ceph-mon[31636]: pgmap v3285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5978.371620 secs 2024-04-21T12:04:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5978.371620 secs 2024-04-21T12:04:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5978.371620 secs 2024-04-21T12:04:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:28 smithi077 ceph-mon[27902]: pgmap v3286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:28 smithi191 ceph-mon[31636]: pgmap v3286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:28 smithi170 ceph-mon[31212]: pgmap v3286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5980.132850 secs 2024-04-21T12:04:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5980.132850 secs 2024-04-21T12:04:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5980.132850 secs 2024-04-21T12:04:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:30 smithi077 ceph-mon[27902]: pgmap v3287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:30 smithi191 ceph-mon[31636]: pgmap v3287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:30 smithi170 ceph-mon[31212]: pgmap v3287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5983.371756 secs 2024-04-21T12:04:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:32 smithi191 ceph-mon[31636]: pgmap v3288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5983.371756 secs 2024-04-21T12:04:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:32 smithi170 ceph-mon[31212]: pgmap v3288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5983.371756 secs 2024-04-21T12:04:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:32 smithi077 ceph-mon[27902]: pgmap v3288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5985.132911 secs 2024-04-21T12:04:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:34 smithi191 ceph-mon[31636]: pgmap v3289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5985.132911 secs 2024-04-21T12:04:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:34 smithi170 ceph-mon[31212]: pgmap v3289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5985.132911 secs 2024-04-21T12:04:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:34 smithi077 ceph-mon[27902]: pgmap v3289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:35 smithi191 ceph-mon[31636]: pgmap v3290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:36.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:35 smithi170 ceph-mon[31212]: pgmap v3290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:35 smithi077 ceph-mon[27902]: pgmap v3290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5988.371848 secs 2024-04-21T12:04:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5988.371848 secs 2024-04-21T12:04:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5988.371848 secs 2024-04-21T12:04:38.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:38 smithi191 ceph-mon[31636]: pgmap v3291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:38 smithi077 ceph-mon[27902]: pgmap v3291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:38 smithi170 ceph-mon[31212]: pgmap v3291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5990.133054 secs 2024-04-21T12:04:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5990.133054 secs 2024-04-21T12:04:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5990.133054 secs 2024-04-21T12:04:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:40 smithi077 ceph-mon[27902]: pgmap v3292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:40 smithi191 ceph-mon[31636]: pgmap v3292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:40 smithi170 ceph-mon[31212]: pgmap v3292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:04:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:04:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:04:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5993.371936 secs 2024-04-21T12:04:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: pgmap v3293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:04:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:04:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5993.371936 secs 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: pgmap v3293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5993.371936 secs 2024-04-21T12:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: pgmap v3293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:04:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:04:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:04:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 5995.133175 secs 2024-04-21T12:04:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:44 smithi191 ceph-mon[31636]: pgmap v3294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 5995.133175 secs 2024-04-21T12:04:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:44 smithi170 ceph-mon[31212]: pgmap v3294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 5995.133175 secs 2024-04-21T12:04:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:44 smithi077 ceph-mon[27902]: pgmap v3294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:45 smithi191 ceph-mon[31636]: pgmap v3295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:46.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:45 smithi170 ceph-mon[31212]: pgmap v3295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:45 smithi077 ceph-mon[27902]: pgmap v3295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 5998.372011 secs 2024-04-21T12:04:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 5998.372011 secs 2024-04-21T12:04:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 5998.372011 secs 2024-04-21T12:04:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:48 smithi077 ceph-mon[27902]: pgmap v3296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:48 smithi191 ceph-mon[31636]: pgmap v3296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:48 smithi170 ceph-mon[31212]: pgmap v3296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 6000.133272 secs 2024-04-21T12:04:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:49 smithi077 ceph-mon[27902]: slow request 5761.587080 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:04:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:49 smithi077 ceph-mon[27902]: slow request 5761.575924 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:49 smithi077 ceph-mon[27902]: slow request 5761.527741 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:49 smithi077 ceph-mon[27902]: slow request 5761.496691 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:49 smithi077 ceph-mon[27902]: slow request 5761.453129 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 6000.133272 secs 2024-04-21T12:04:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:49 smithi191 ceph-mon[31636]: slow request 5761.587080 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:04:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:49 smithi191 ceph-mon[31636]: slow request 5761.575924 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:49 smithi191 ceph-mon[31636]: slow request 5761.527741 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:49 smithi191 ceph-mon[31636]: slow request 5761.496691 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:49 smithi191 ceph-mon[31636]: slow request 5761.453129 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 6000.133272 secs 2024-04-21T12:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:49 smithi170 ceph-mon[31212]: slow request 5761.587080 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:49 smithi170 ceph-mon[31212]: slow request 5761.575924 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:49 smithi170 ceph-mon[31212]: slow request 5761.527741 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:49 smithi170 ceph-mon[31212]: slow request 5761.496691 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:49 smithi170 ceph-mon[31212]: slow request 5761.453129 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:50 smithi077 ceph-mon[27902]: pgmap v3297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:50 smithi191 ceph-mon[31636]: pgmap v3297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:50 smithi170 ceph-mon[31212]: pgmap v3297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6003.372132 secs 2024-04-21T12:04:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:52 smithi191 ceph-mon[31636]: pgmap v3298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6003.372132 secs 2024-04-21T12:04:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:52 smithi170 ceph-mon[31212]: pgmap v3298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6003.372132 secs 2024-04-21T12:04:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:52 smithi077 ceph-mon[27902]: pgmap v3298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:53 smithi191 ceph-mon[31636]: pgmap v3299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:53 smithi170 ceph-mon[31212]: pgmap v3299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:53 smithi077 ceph-mon[27902]: pgmap v3299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:04:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:04:55.173+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:04:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:04:55.173+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:04:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:04:55.173+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:04:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:04:55.173+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:04:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:54 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 6005.133370 secs 2024-04-21T12:04:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:54 smithi191 ceph-mon[31636]: slow request 5766.325917 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:54 smithi191 ceph-mon[31636]: slow request 5766.316172 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:54 smithi191 ceph-mon[31636]: slow request 5766.297180 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:54 smithi191 ceph-mon[31636]: slow request 5766.295164 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:54 smithi191 ceph-mon[31636]: slow request 5766.287177 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:54 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 6005.133370 secs 2024-04-21T12:04:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:54 smithi170 ceph-mon[31212]: slow request 5766.325917 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:54 smithi170 ceph-mon[31212]: slow request 5766.316172 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:54 smithi170 ceph-mon[31212]: slow request 5766.297180 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:54 smithi170 ceph-mon[31212]: slow request 5766.295164 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:54 smithi170 ceph-mon[31212]: slow request 5766.287177 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:54 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 6005.133370 secs 2024-04-21T12:04:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:54 smithi077 ceph-mon[27902]: slow request 5766.325917 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:54 smithi077 ceph-mon[27902]: slow request 5766.316172 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:54 smithi077 ceph-mon[27902]: slow request 5766.297180 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:54 smithi077 ceph-mon[27902]: slow request 5766.295164 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:54 smithi077 ceph-mon[27902]: slow request 5766.287177 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:56.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:55 smithi170 ceph-mon[31212]: pgmap v3300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:55 smithi077 ceph-mon[27902]: pgmap v3300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:55 smithi191 ceph-mon[31636]: pgmap v3300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:04:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6008.372268 secs 2024-04-21T12:04:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6008.372268 secs 2024-04-21T12:04:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6008.372268 secs 2024-04-21T12:04:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:58 smithi077 ceph-mon[27902]: pgmap v3301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:58 smithi191 ceph-mon[31636]: pgmap v3301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:58 smithi170 ceph-mon[31212]: pgmap v3301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:04:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:59 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 6010.133443 secs 2024-04-21T12:04:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:59 smithi077 ceph-mon[27902]: slow request 5771.280397 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:59 smithi077 ceph-mon[27902]: slow request 5771.271390 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:59 smithi077 ceph-mon[27902]: slow request 5771.266281 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:59 smithi077 ceph-mon[27902]: slow request 5771.250772 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:04:59 smithi077 ceph-mon[27902]: slow request 5771.242085 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:59 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 6010.133443 secs 2024-04-21T12:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:59 smithi191 ceph-mon[31636]: slow request 5771.280397 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:59 smithi191 ceph-mon[31636]: slow request 5771.271390 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:59 smithi191 ceph-mon[31636]: slow request 5771.266281 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:59 smithi191 ceph-mon[31636]: slow request 5771.250772 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:04:59 smithi191 ceph-mon[31636]: slow request 5771.242085 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:59 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 6010.133443 secs 2024-04-21T12:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:59 smithi170 ceph-mon[31212]: slow request 5771.280397 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:59 smithi170 ceph-mon[31212]: slow request 5771.271390 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:59 smithi170 ceph-mon[31212]: slow request 5771.266281 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:59 smithi170 ceph-mon[31212]: slow request 5771.250772 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:04:59 smithi170 ceph-mon[31212]: slow request 5771.242085 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T12:05:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:00 smithi077 ceph-mon[27902]: pgmap v3302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:00 smithi191 ceph-mon[31636]: pgmap v3302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:00 smithi170 ceph-mon[31212]: pgmap v3302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:02.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:02 smithi170 ceph-mon[31212]: pgmap v3303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T12:05:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:02 smithi077 ceph-mon[27902]: pgmap v3303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T12:05:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:02 smithi191 ceph-mon[31636]: pgmap v3303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T12:05:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6013.372338 secs 2024-04-21T12:05:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6013.372338 secs 2024-04-21T12:05:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6013.372338 secs 2024-04-21T12:05:04.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:04 smithi170 ceph-mon[31212]: pgmap v3304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T12:05:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:04 smithi077 ceph-mon[27902]: pgmap v3304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T12:05:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:04 smithi191 ceph-mon[31636]: pgmap v3304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T12:05:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:05 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 6015.133571 secs 2024-04-21T12:05:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:05 smithi170 ceph-mon[31212]: slow request 5761.425454 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:05 smithi170 ceph-mon[31212]: slow request 5771.343649 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:05 smithi170 ceph-mon[31212]: slow request 5771.328778 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:05 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 6015.133571 secs 2024-04-21T12:05:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:05 smithi077 ceph-mon[27902]: slow request 5761.425454 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:05 smithi077 ceph-mon[27902]: slow request 5771.343649 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:05 smithi077 ceph-mon[27902]: slow request 5771.328778 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:05 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 6015.133571 secs 2024-04-21T12:05:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:05 smithi191 ceph-mon[31636]: slow request 5761.425454 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:05 smithi191 ceph-mon[31636]: slow request 5771.343649 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:05 smithi191 ceph-mon[31636]: slow request 5771.328778 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:05:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:06 smithi170 ceph-mon[31212]: pgmap v3305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:05:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:06 smithi077 ceph-mon[27902]: pgmap v3305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:05:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:06 smithi191 ceph-mon[31636]: pgmap v3305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:05:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6018.372462 secs 2024-04-21T12:05:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6018.372462 secs 2024-04-21T12:05:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6018.372462 secs 2024-04-21T12:05:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:08 smithi170 ceph-mon[31212]: pgmap v3306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T12:05:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:08 smithi191 ceph-mon[31636]: pgmap v3306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T12:05:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:08 smithi077 ceph-mon[27902]: pgmap v3306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T12:05:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6020.133691 secs 2024-04-21T12:05:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6020.133691 secs 2024-04-21T12:05:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6020.133691 secs 2024-04-21T12:05:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:10 smithi191 ceph-mon[31636]: pgmap v3307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T12:05:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:10 smithi170 ceph-mon[31212]: pgmap v3307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T12:05:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:10 smithi077 ceph-mon[27902]: pgmap v3307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T12:05:12.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:12 smithi170 ceph-mon[31212]: pgmap v3308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:05:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:12 smithi077 ceph-mon[27902]: pgmap v3308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:05:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:12 smithi191 ceph-mon[31636]: pgmap v3308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:05:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6023.372596 secs 2024-04-21T12:05:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6023.372596 secs 2024-04-21T12:05:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6023.372596 secs 2024-04-21T12:05:14.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:14 smithi170 ceph-mon[31212]: pgmap v3309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-04-21T12:05:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:14 smithi077 ceph-mon[27902]: pgmap v3309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-04-21T12:05:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:14 smithi191 ceph-mon[31636]: pgmap v3309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-04-21T12:05:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6025.133833 secs 2024-04-21T12:05:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6025.133833 secs 2024-04-21T12:05:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6025.133833 secs 2024-04-21T12:05:16.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:16 smithi170 ceph-mon[31212]: pgmap v3310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-04-21T12:05:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:16 smithi077 ceph-mon[27902]: pgmap v3310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-04-21T12:05:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:16 smithi191 ceph-mon[31636]: pgmap v3310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-04-21T12:05:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6028.372689 secs 2024-04-21T12:05:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6028.372689 secs 2024-04-21T12:05:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6028.372689 secs 2024-04-21T12:05:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:18 smithi077 ceph-mon[27902]: pgmap v3311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:18 smithi191 ceph-mon[31636]: pgmap v3311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:18 smithi170 ceph-mon[31212]: pgmap v3311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6030.133951 secs 2024-04-21T12:05:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6030.133951 secs 2024-04-21T12:05:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6030.133951 secs 2024-04-21T12:05:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:20 smithi077 ceph-mon[27902]: pgmap v3312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:20 smithi191 ceph-mon[31636]: pgmap v3312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:20 smithi170 ceph-mon[31212]: pgmap v3312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:22.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:22 smithi170 ceph-mon[31212]: pgmap v3313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:22 smithi077 ceph-mon[27902]: pgmap v3313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:22 smithi191 ceph-mon[31636]: pgmap v3313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6033.372792 secs 2024-04-21T12:05:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6033.372792 secs 2024-04-21T12:05:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6033.372792 secs 2024-04-21T12:05:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:24 smithi170 ceph-mon[31212]: pgmap v3314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:24 smithi077 ceph-mon[27902]: pgmap v3314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:24.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:24 smithi191 ceph-mon[31636]: pgmap v3314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6035.134030 secs 2024-04-21T12:05:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6035.134030 secs 2024-04-21T12:05:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6035.134030 secs 2024-04-21T12:05:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:26 smithi170 ceph-mon[31212]: pgmap v3315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:26 smithi077 ceph-mon[27902]: pgmap v3315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:26 smithi191 ceph-mon[31636]: pgmap v3315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6038.372864 secs 2024-04-21T12:05:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6038.372864 secs 2024-04-21T12:05:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6038.372864 secs 2024-04-21T12:05:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:28 smithi077 ceph-mon[27902]: pgmap v3316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:28 smithi191 ceph-mon[31636]: pgmap v3316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:28 smithi170 ceph-mon[31212]: pgmap v3316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6040.134143 secs 2024-04-21T12:05:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6040.134143 secs 2024-04-21T12:05:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6040.134143 secs 2024-04-21T12:05:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:30 smithi077 ceph-mon[27902]: pgmap v3317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:30 smithi191 ceph-mon[31636]: pgmap v3317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:30 smithi170 ceph-mon[31212]: pgmap v3317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:32 smithi170 ceph-mon[31212]: pgmap v3318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:32 smithi077 ceph-mon[27902]: pgmap v3318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:32 smithi191 ceph-mon[31636]: pgmap v3318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6043.372938 secs 2024-04-21T12:05:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6043.372938 secs 2024-04-21T12:05:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6043.372938 secs 2024-04-21T12:05:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:34 smithi170 ceph-mon[31212]: pgmap v3319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:34 smithi077 ceph-mon[27902]: pgmap v3319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:34 smithi191 ceph-mon[31636]: pgmap v3319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6045.134258 secs 2024-04-21T12:05:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6045.134258 secs 2024-04-21T12:05:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6045.134258 secs 2024-04-21T12:05:36.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:36 smithi170 ceph-mon[31212]: pgmap v3320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:36 smithi077 ceph-mon[27902]: pgmap v3320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:36 smithi191 ceph-mon[31636]: pgmap v3320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6048.373060 secs 2024-04-21T12:05:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6048.373060 secs 2024-04-21T12:05:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6048.373060 secs 2024-04-21T12:05:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:38 smithi077 ceph-mon[27902]: pgmap v3321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:38 smithi170 ceph-mon[31212]: pgmap v3321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:38 smithi191 ceph-mon[31636]: pgmap v3321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6050.134370 secs 2024-04-21T12:05:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6050.134370 secs 2024-04-21T12:05:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6050.134370 secs 2024-04-21T12:05:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:40 smithi077 ceph-mon[27902]: pgmap v3322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:40 smithi191 ceph-mon[31636]: pgmap v3322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:40 smithi170 ceph-mon[31212]: pgmap v3322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:42.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:42 smithi170 ceph-mon[31212]: pgmap v3323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:42 smithi077 ceph-mon[27902]: pgmap v3323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:42 smithi191 ceph-mon[31636]: pgmap v3323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6053.373110 secs 2024-04-21T12:05:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:05:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6053.373110 secs 2024-04-21T12:05:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:05:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6053.373110 secs 2024-04-21T12:05:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:05:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:44.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:05:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:05:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:44 smithi170 ceph-mon[31212]: pgmap v3324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:05:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:05:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:44 smithi077 ceph-mon[27902]: pgmap v3324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:05:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:05:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:05:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:44 smithi191 ceph-mon[31636]: pgmap v3324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6055.134436 secs 2024-04-21T12:05:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6055.134436 secs 2024-04-21T12:05:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6055.134436 secs 2024-04-21T12:05:46.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:46 smithi170 ceph-mon[31212]: pgmap v3325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:46 smithi077 ceph-mon[27902]: pgmap v3325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:46 smithi191 ceph-mon[31636]: pgmap v3325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6058.373261 secs 2024-04-21T12:05:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6058.373261 secs 2024-04-21T12:05:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6058.373261 secs 2024-04-21T12:05:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:48 smithi077 ceph-mon[27902]: pgmap v3326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:48 smithi191 ceph-mon[31636]: pgmap v3326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:48 smithi170 ceph-mon[31212]: pgmap v3326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6060.134555 secs 2024-04-21T12:05:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6060.134555 secs 2024-04-21T12:05:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6060.134555 secs 2024-04-21T12:05:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:50 smithi077 ceph-mon[27902]: pgmap v3327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:50 smithi191 ceph-mon[31636]: pgmap v3327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:50 smithi170 ceph-mon[31212]: pgmap v3327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:05:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:52 smithi170 ceph-mon[31212]: pgmap v3328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:52 smithi077 ceph-mon[27902]: pgmap v3328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:52 smithi191 ceph-mon[31636]: pgmap v3328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:05:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6063.373413 secs 2024-04-21T12:05:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6063.373413 secs 2024-04-21T12:05:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6063.373413 secs 2024-04-21T12:05:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:54 smithi170 ceph-mon[31212]: pgmap v3329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:54 smithi077 ceph-mon[27902]: pgmap v3329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:54 smithi191 ceph-mon[31636]: pgmap v3329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:05:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6065.134662 secs 2024-04-21T12:05:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6065.134662 secs 2024-04-21T12:05:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6065.134662 secs 2024-04-21T12:05:56.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:56 smithi170 ceph-mon[31212]: pgmap v3330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:56 smithi077 ceph-mon[27902]: pgmap v3330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:56 smithi191 ceph-mon[31636]: pgmap v3330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:05:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6068.373551 secs 2024-04-21T12:05:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6068.373551 secs 2024-04-21T12:05:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6068.373551 secs 2024-04-21T12:05:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:58 smithi077 ceph-mon[27902]: pgmap v3331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:58 smithi191 ceph-mon[31636]: pgmap v3331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:58 smithi170 ceph-mon[31212]: pgmap v3331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:05:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:05:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6070.134794 secs 2024-04-21T12:05:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:05:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6070.134794 secs 2024-04-21T12:05:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:05:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6070.134794 secs 2024-04-21T12:06:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:00 smithi077 ceph-mon[27902]: pgmap v3332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:00 smithi191 ceph-mon[31636]: pgmap v3332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:00 smithi170 ceph-mon[31212]: pgmap v3332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:02 smithi170 ceph-mon[31212]: pgmap v3333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:02 smithi077 ceph-mon[27902]: pgmap v3333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:02 smithi191 ceph-mon[31636]: pgmap v3333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6073.373695 secs 2024-04-21T12:06:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6073.373695 secs 2024-04-21T12:06:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6073.373695 secs 2024-04-21T12:06:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:04 smithi170 ceph-mon[31212]: pgmap v3334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:04 smithi077 ceph-mon[27902]: pgmap v3334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:04 smithi191 ceph-mon[31636]: pgmap v3334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6075.134911 secs 2024-04-21T12:06:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:05 smithi170 ceph-mon[31212]: osdmap e281: 12 total, 12 up, 12 in 2024-04-21T12:06:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6075.134911 secs 2024-04-21T12:06:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:05 smithi077 ceph-mon[27902]: osdmap e281: 12 total, 12 up, 12 in 2024-04-21T12:06:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6075.134911 secs 2024-04-21T12:06:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:05 smithi191 ceph-mon[31636]: osdmap e281: 12 total, 12 up, 12 in 2024-04-21T12:06:06.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:06 smithi170 ceph-mon[31212]: pgmap v3336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:06:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:06 smithi077 ceph-mon[27902]: pgmap v3336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:06:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:06 smithi191 ceph-mon[31636]: pgmap v3336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:06:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6078.373862 secs 2024-04-21T12:06:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6078.373862 secs 2024-04-21T12:06:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6078.373862 secs 2024-04-21T12:06:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:08 smithi170 ceph-mon[31212]: osdmap e282: 12 total, 12 up, 12 in 2024-04-21T12:06:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:08 smithi170 ceph-mon[31212]: pgmap v3338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:06:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:08 smithi191 ceph-mon[31636]: osdmap e282: 12 total, 12 up, 12 in 2024-04-21T12:06:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:08 smithi191 ceph-mon[31636]: pgmap v3338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:06:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:08 smithi077 ceph-mon[27902]: osdmap e282: 12 total, 12 up, 12 in 2024-04-21T12:06:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:08 smithi077 ceph-mon[27902]: pgmap v3338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:06:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6080.135026 secs 2024-04-21T12:06:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6080.135026 secs 2024-04-21T12:06:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6080.135026 secs 2024-04-21T12:06:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:10 smithi191 ceph-mon[31636]: pgmap v3339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:06:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:10 smithi170 ceph-mon[31212]: pgmap v3339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:06:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:10 smithi077 ceph-mon[27902]: pgmap v3339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:06:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:12 smithi170 ceph-mon[31212]: pgmap v3340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:06:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:12 smithi077 ceph-mon[27902]: pgmap v3340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:06:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:12 smithi191 ceph-mon[31636]: pgmap v3340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:06:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6083.373984 secs 2024-04-21T12:06:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6083.373984 secs 2024-04-21T12:06:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6083.373984 secs 2024-04-21T12:06:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:14 smithi170 ceph-mon[31212]: pgmap v3341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:06:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:14 smithi077 ceph-mon[27902]: pgmap v3341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:06:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:14 smithi191 ceph-mon[31636]: pgmap v3341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:06:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6085.135113 secs 2024-04-21T12:06:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6085.135113 secs 2024-04-21T12:06:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6085.135113 secs 2024-04-21T12:06:16.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:16 smithi170 ceph-mon[31212]: pgmap v3342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:06:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:16 smithi077 ceph-mon[27902]: pgmap v3342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:06:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:16 smithi191 ceph-mon[31636]: pgmap v3342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:06:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6088.374103 secs 2024-04-21T12:06:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6088.374103 secs 2024-04-21T12:06:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6088.374103 secs 2024-04-21T12:06:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:18 smithi077 ceph-mon[27902]: pgmap v3343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:06:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:18 smithi191 ceph-mon[31636]: pgmap v3343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:06:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:18 smithi170 ceph-mon[31212]: pgmap v3343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:06:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6090.135229 secs 2024-04-21T12:06:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6090.135229 secs 2024-04-21T12:06:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6090.135229 secs 2024-04-21T12:06:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:20 smithi077 ceph-mon[27902]: pgmap v3344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:06:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:20 smithi191 ceph-mon[31636]: pgmap v3344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:06:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:20 smithi170 ceph-mon[31212]: pgmap v3344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:06:22.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:22 smithi170 ceph-mon[31212]: pgmap v3345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:06:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:22 smithi077 ceph-mon[27902]: pgmap v3345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:06:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:22 smithi191 ceph-mon[31636]: pgmap v3345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:06:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6093.374216 secs 2024-04-21T12:06:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6093.374216 secs 2024-04-21T12:06:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6093.374216 secs 2024-04-21T12:06:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:24 smithi170 ceph-mon[31212]: pgmap v3346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:24 smithi077 ceph-mon[27902]: pgmap v3346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:24 smithi191 ceph-mon[31636]: pgmap v3346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6095.135370 secs 2024-04-21T12:06:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6095.135370 secs 2024-04-21T12:06:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6095.135370 secs 2024-04-21T12:06:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:26 smithi170 ceph-mon[31212]: pgmap v3347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:26 smithi077 ceph-mon[27902]: pgmap v3347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:26 smithi191 ceph-mon[31636]: pgmap v3347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6098.374351 secs 2024-04-21T12:06:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6098.374351 secs 2024-04-21T12:06:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6098.374351 secs 2024-04-21T12:06:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:28 smithi077 ceph-mon[27902]: pgmap v3348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:28 smithi191 ceph-mon[31636]: pgmap v3348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:28 smithi170 ceph-mon[31212]: pgmap v3348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6100.135480 secs 2024-04-21T12:06:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6100.135480 secs 2024-04-21T12:06:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6100.135480 secs 2024-04-21T12:06:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:30 smithi191 ceph-mon[31636]: pgmap v3349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:30 smithi170 ceph-mon[31212]: pgmap v3349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:30 smithi077 ceph-mon[27902]: pgmap v3349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:32.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:32 smithi170 ceph-mon[31212]: pgmap v3350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:32 smithi077 ceph-mon[27902]: pgmap v3350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:32 smithi191 ceph-mon[31636]: pgmap v3350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6103.374496 secs 2024-04-21T12:06:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6103.374496 secs 2024-04-21T12:06:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6103.374496 secs 2024-04-21T12:06:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:34 smithi170 ceph-mon[31212]: pgmap v3351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:34 smithi077 ceph-mon[27902]: pgmap v3351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:34 smithi191 ceph-mon[31636]: pgmap v3351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:06:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6105.135599 secs 2024-04-21T12:06:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6105.135599 secs 2024-04-21T12:06:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6105.135599 secs 2024-04-21T12:06:36.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:36 smithi170 ceph-mon[31212]: pgmap v3352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:36 smithi077 ceph-mon[27902]: pgmap v3352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:36 smithi191 ceph-mon[31636]: pgmap v3352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6108.374638 secs 2024-04-21T12:06:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6108.374638 secs 2024-04-21T12:06:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6108.374638 secs 2024-04-21T12:06:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:38 smithi077 ceph-mon[27902]: pgmap v3353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:38 smithi170 ceph-mon[31212]: pgmap v3353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:38 smithi191 ceph-mon[31636]: pgmap v3353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6110.135713 secs 2024-04-21T12:06:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6110.135713 secs 2024-04-21T12:06:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6110.135713 secs 2024-04-21T12:06:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:40 smithi191 ceph-mon[31636]: pgmap v3354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:40 smithi170 ceph-mon[31212]: pgmap v3354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:40 smithi077 ceph-mon[27902]: pgmap v3354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:42 smithi170 ceph-mon[31212]: pgmap v3355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:42 smithi077 ceph-mon[27902]: pgmap v3355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:42 smithi191 ceph-mon[31636]: pgmap v3355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6113.374714 secs 2024-04-21T12:06:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6113.374714 secs 2024-04-21T12:06:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6113.374714 secs 2024-04-21T12:06:44.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:06:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:44 smithi170 ceph-mon[31212]: pgmap v3356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:06:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:44 smithi077 ceph-mon[27902]: pgmap v3356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:06:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:44 smithi191 ceph-mon[31636]: pgmap v3356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6115.135832 secs 2024-04-21T12:06:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:06:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:06:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:06:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6115.135832 secs 2024-04-21T12:06:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:06:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:06:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:06:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6115.135832 secs 2024-04-21T12:06:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:06:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:06:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:06:46.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:46 smithi170 ceph-mon[31212]: pgmap v3357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:46 smithi077 ceph-mon[27902]: pgmap v3357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:46 smithi191 ceph-mon[31636]: pgmap v3357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6118.374810 secs 2024-04-21T12:06:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6118.374810 secs 2024-04-21T12:06:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6118.374810 secs 2024-04-21T12:06:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:48 smithi077 ceph-mon[27902]: pgmap v3358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:48 smithi191 ceph-mon[31636]: pgmap v3358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:48 smithi170 ceph-mon[31212]: pgmap v3358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6120.135950 secs 2024-04-21T12:06:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6120.135950 secs 2024-04-21T12:06:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6120.135950 secs 2024-04-21T12:06:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:50 smithi191 ceph-mon[31636]: pgmap v3359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:50 smithi170 ceph-mon[31212]: pgmap v3359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:50 smithi077 ceph-mon[27902]: pgmap v3359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:52.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:52 smithi170 ceph-mon[31212]: pgmap v3360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:52 smithi077 ceph-mon[27902]: pgmap v3360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:52 smithi191 ceph-mon[31636]: pgmap v3360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6123.374929 secs 2024-04-21T12:06:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6123.374929 secs 2024-04-21T12:06:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6123.374929 secs 2024-04-21T12:06:54.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:54 smithi170 ceph-mon[31212]: pgmap v3361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:54 smithi077 ceph-mon[27902]: pgmap v3361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:54 smithi191 ceph-mon[31636]: pgmap v3361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:06:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6125.136056 secs 2024-04-21T12:06:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6125.136056 secs 2024-04-21T12:06:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6125.136056 secs 2024-04-21T12:06:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:56 smithi170 ceph-mon[31212]: pgmap v3362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:56 smithi077 ceph-mon[27902]: pgmap v3362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:56 smithi191 ceph-mon[31636]: pgmap v3362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:06:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6128.375046 secs 2024-04-21T12:06:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6128.375046 secs 2024-04-21T12:06:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6128.375046 secs 2024-04-21T12:06:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:58 smithi077 ceph-mon[27902]: pgmap v3363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:58 smithi191 ceph-mon[31636]: pgmap v3363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:58 smithi170 ceph-mon[31212]: pgmap v3363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:06:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:06:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6130.136171 secs 2024-04-21T12:06:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:06:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6130.136171 secs 2024-04-21T12:06:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:06:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6130.136171 secs 2024-04-21T12:07:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:00 smithi191 ceph-mon[31636]: pgmap v3364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:00 smithi170 ceph-mon[31212]: pgmap v3364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:00 smithi077 ceph-mon[27902]: pgmap v3364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:02.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:02 smithi170 ceph-mon[31212]: pgmap v3365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:02 smithi077 ceph-mon[27902]: pgmap v3365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:02 smithi191 ceph-mon[31636]: pgmap v3365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6133.375142 secs 2024-04-21T12:07:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6133.375142 secs 2024-04-21T12:07:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6133.375142 secs 2024-04-21T12:07:04.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:04 smithi170 ceph-mon[31212]: pgmap v3366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:04 smithi077 ceph-mon[27902]: pgmap v3366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:04 smithi191 ceph-mon[31636]: pgmap v3366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:05.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6135.136289 secs 2024-04-21T12:07:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:05 smithi170 ceph-mon[31212]: osdmap e283: 12 total, 12 up, 12 in 2024-04-21T12:07:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6135.136289 secs 2024-04-21T12:07:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:05 smithi077 ceph-mon[27902]: osdmap e283: 12 total, 12 up, 12 in 2024-04-21T12:07:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6135.136289 secs 2024-04-21T12:07:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:05 smithi191 ceph-mon[31636]: osdmap e283: 12 total, 12 up, 12 in 2024-04-21T12:07:06.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:06 smithi170 ceph-mon[31212]: pgmap v3368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:07:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:06 smithi077 ceph-mon[27902]: pgmap v3368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:07:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:06 smithi191 ceph-mon[31636]: pgmap v3368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:07:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6138.375238 secs 2024-04-21T12:07:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6138.375238 secs 2024-04-21T12:07:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6138.375238 secs 2024-04-21T12:07:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:08 smithi170 ceph-mon[31212]: osdmap e284: 12 total, 12 up, 12 in 2024-04-21T12:07:08.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:08 smithi170 ceph-mon[31212]: pgmap v3370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:07:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:08 smithi191 ceph-mon[31636]: osdmap e284: 12 total, 12 up, 12 in 2024-04-21T12:07:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:08 smithi191 ceph-mon[31636]: pgmap v3370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:07:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:08 smithi077 ceph-mon[27902]: osdmap e284: 12 total, 12 up, 12 in 2024-04-21T12:07:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:08 smithi077 ceph-mon[27902]: pgmap v3370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:07:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6140.136411 secs 2024-04-21T12:07:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6140.136411 secs 2024-04-21T12:07:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6140.136411 secs 2024-04-21T12:07:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:10 smithi191 ceph-mon[31636]: pgmap v3371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:07:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:10 smithi170 ceph-mon[31212]: pgmap v3371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:07:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:10 smithi077 ceph-mon[27902]: pgmap v3371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:07:12.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:12 smithi170 ceph-mon[31212]: pgmap v3372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:07:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:12 smithi077 ceph-mon[27902]: pgmap v3372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:07:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:12 smithi191 ceph-mon[31636]: pgmap v3372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:07:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6143.375390 secs 2024-04-21T12:07:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6143.375390 secs 2024-04-21T12:07:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6143.375390 secs 2024-04-21T12:07:14.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:14 smithi170 ceph-mon[31212]: pgmap v3373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:07:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:14 smithi077 ceph-mon[27902]: pgmap v3373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:07:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:14 smithi191 ceph-mon[31636]: pgmap v3373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:07:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6145.136526 secs 2024-04-21T12:07:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6145.136526 secs 2024-04-21T12:07:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6145.136526 secs 2024-04-21T12:07:16.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:16 smithi170 ceph-mon[31212]: pgmap v3374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:07:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:16 smithi077 ceph-mon[27902]: pgmap v3374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:07:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:16 smithi191 ceph-mon[31636]: pgmap v3374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:07:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6148.375504 secs 2024-04-21T12:07:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6148.375504 secs 2024-04-21T12:07:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6148.375504 secs 2024-04-21T12:07:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:18 smithi191 ceph-mon[31636]: pgmap v3375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:07:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:18 smithi170 ceph-mon[31212]: pgmap v3375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:07:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:18 smithi077 ceph-mon[27902]: pgmap v3375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:07:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6150.136638 secs 2024-04-21T12:07:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6150.136638 secs 2024-04-21T12:07:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6150.136638 secs 2024-04-21T12:07:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:20 smithi191 ceph-mon[31636]: pgmap v3376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:07:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:20 smithi170 ceph-mon[31212]: pgmap v3376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:07:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:20 smithi077 ceph-mon[27902]: pgmap v3376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:07:22.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:22 smithi170 ceph-mon[31212]: pgmap v3377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:07:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:22 smithi077 ceph-mon[27902]: pgmap v3377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:07:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:22 smithi191 ceph-mon[31636]: pgmap v3377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:07:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6153.375584 secs 2024-04-21T12:07:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6153.375584 secs 2024-04-21T12:07:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6153.375584 secs 2024-04-21T12:07:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:24 smithi170 ceph-mon[31212]: pgmap v3378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:24 smithi077 ceph-mon[27902]: pgmap v3378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:24 smithi191 ceph-mon[31636]: pgmap v3378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6155.136772 secs 2024-04-21T12:07:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6155.136772 secs 2024-04-21T12:07:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6155.136772 secs 2024-04-21T12:07:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:26 smithi170 ceph-mon[31212]: pgmap v3379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:26 smithi077 ceph-mon[27902]: pgmap v3379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:26 smithi191 ceph-mon[31636]: pgmap v3379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6158.375701 secs 2024-04-21T12:07:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6158.375701 secs 2024-04-21T12:07:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6158.375701 secs 2024-04-21T12:07:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:28 smithi191 ceph-mon[31636]: pgmap v3380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:28 smithi170 ceph-mon[31212]: pgmap v3380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:28 smithi077 ceph-mon[27902]: pgmap v3380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6160.136885 secs 2024-04-21T12:07:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6160.136885 secs 2024-04-21T12:07:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6160.136885 secs 2024-04-21T12:07:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:30 smithi191 ceph-mon[31636]: pgmap v3381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:30 smithi170 ceph-mon[31212]: pgmap v3381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:30 smithi077 ceph-mon[27902]: pgmap v3381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:32.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:32 smithi170 ceph-mon[31212]: pgmap v3382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:32 smithi077 ceph-mon[27902]: pgmap v3382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:32 smithi191 ceph-mon[31636]: pgmap v3382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6163.375819 secs 2024-04-21T12:07:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6163.375819 secs 2024-04-21T12:07:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6163.375819 secs 2024-04-21T12:07:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:34 smithi170 ceph-mon[31212]: pgmap v3383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:34 smithi077 ceph-mon[27902]: pgmap v3383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:34 smithi191 ceph-mon[31636]: pgmap v3383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6165.137000 secs 2024-04-21T12:07:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6165.137000 secs 2024-04-21T12:07:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6165.137000 secs 2024-04-21T12:07:36.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:36 smithi170 ceph-mon[31212]: pgmap v3384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:36 smithi077 ceph-mon[27902]: pgmap v3384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:36 smithi191 ceph-mon[31636]: pgmap v3384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6168.375933 secs 2024-04-21T12:07:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6168.375933 secs 2024-04-21T12:07:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6168.375933 secs 2024-04-21T12:07:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:38 smithi170 ceph-mon[31212]: pgmap v3385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:38 smithi191 ceph-mon[31636]: pgmap v3385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:38 smithi077 ceph-mon[27902]: pgmap v3385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6170.137079 secs 2024-04-21T12:07:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6170.137079 secs 2024-04-21T12:07:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6170.137079 secs 2024-04-21T12:07:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:40 smithi191 ceph-mon[31636]: pgmap v3386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:40 smithi170 ceph-mon[31212]: pgmap v3386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:40 smithi077 ceph-mon[27902]: pgmap v3386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:42.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:42 smithi170 ceph-mon[31212]: pgmap v3387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:42 smithi077 ceph-mon[27902]: pgmap v3387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:42 smithi191 ceph-mon[31636]: pgmap v3387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:43.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6173.376043 secs 2024-04-21T12:07:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6173.376043 secs 2024-04-21T12:07:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6173.376043 secs 2024-04-21T12:07:44.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:44 smithi170 ceph-mon[31212]: pgmap v3388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:44 smithi077 ceph-mon[27902]: pgmap v3388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:44 smithi191 ceph-mon[31636]: pgmap v3388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:45 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 6175.137196 secs 2024-04-21T12:07:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:45 smithi170 ceph-mon[31212]: slow request 5763.401397 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:07:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:07:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:07:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:07:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:07:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:45 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 6175.137196 secs 2024-04-21T12:07:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:45 smithi077 ceph-mon[27902]: slow request 5763.401397 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:07:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:07:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:07:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:07:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:07:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:45 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 6175.137196 secs 2024-04-21T12:07:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:45 smithi191 ceph-mon[31636]: slow request 5763.401397 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T12:07:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:07:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:07:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:07:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:07:46.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:46 smithi170 ceph-mon[31212]: pgmap v3389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:46 smithi077 ceph-mon[27902]: pgmap v3389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:46 smithi191 ceph-mon[31636]: pgmap v3389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6178.376131 secs 2024-04-21T12:07:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6178.376131 secs 2024-04-21T12:07:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6178.376131 secs 2024-04-21T12:07:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:48 smithi191 ceph-mon[31636]: pgmap v3390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:48 smithi170 ceph-mon[31212]: pgmap v3390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:48 smithi077 ceph-mon[27902]: pgmap v3390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6180.137309 secs 2024-04-21T12:07:49.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6180.137309 secs 2024-04-21T12:07:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6180.137309 secs 2024-04-21T12:07:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:50 smithi191 ceph-mon[31636]: pgmap v3391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:50.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:50 smithi170 ceph-mon[31212]: pgmap v3391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:50 smithi077 ceph-mon[27902]: pgmap v3391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:52.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:52 smithi170 ceph-mon[31212]: pgmap v3392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:52 smithi077 ceph-mon[27902]: pgmap v3392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:52 smithi191 ceph-mon[31636]: pgmap v3392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6183.376243 secs 2024-04-21T12:07:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6183.376243 secs 2024-04-21T12:07:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6183.376243 secs 2024-04-21T12:07:54.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:54 smithi170 ceph-mon[31212]: pgmap v3393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:54 smithi077 ceph-mon[27902]: pgmap v3393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:54 smithi191 ceph-mon[31636]: pgmap v3393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:07:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.197+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:07:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.197+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:07:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.198+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:07:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.198+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:07:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.198+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:07:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.198+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:07:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.198+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:07:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:07:55.198+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:07:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6185.137450 secs 2024-04-21T12:07:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6185.137450 secs 2024-04-21T12:07:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6185.137450 secs 2024-04-21T12:07:56.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:56 smithi170 ceph-mon[31212]: pgmap v3394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:56 smithi077 ceph-mon[27902]: pgmap v3394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:56 smithi191 ceph-mon[31636]: pgmap v3394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:07:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6188.376340 secs 2024-04-21T12:07:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6188.376340 secs 2024-04-21T12:07:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6188.376340 secs 2024-04-21T12:07:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:58 smithi191 ceph-mon[31636]: pgmap v3395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:58 smithi170 ceph-mon[31212]: pgmap v3395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:58 smithi077 ceph-mon[27902]: pgmap v3395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:07:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6190.137577 secs 2024-04-21T12:07:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6190.137577 secs 2024-04-21T12:07:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6190.137577 secs 2024-04-21T12:08:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:00 smithi191 ceph-mon[31636]: pgmap v3396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:00 smithi170 ceph-mon[31212]: pgmap v3396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:00 smithi077 ceph-mon[27902]: pgmap v3396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:02.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:02 smithi170 ceph-mon[31212]: pgmap v3397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:02 smithi077 ceph-mon[27902]: pgmap v3397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:02 smithi191 ceph-mon[31636]: pgmap v3397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6193.376463 secs 2024-04-21T12:08:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6193.376463 secs 2024-04-21T12:08:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6193.376463 secs 2024-04-21T12:08:04.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:04 smithi170 ceph-mon[31212]: pgmap v3398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:04 smithi077 ceph-mon[27902]: pgmap v3398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:04 smithi191 ceph-mon[31636]: pgmap v3398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:05.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6195.137689 secs 2024-04-21T12:08:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:05 smithi170 ceph-mon[31212]: osdmap e285: 12 total, 12 up, 12 in 2024-04-21T12:08:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6195.137689 secs 2024-04-21T12:08:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:05 smithi077 ceph-mon[27902]: osdmap e285: 12 total, 12 up, 12 in 2024-04-21T12:08:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6195.137689 secs 2024-04-21T12:08:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:05 smithi191 ceph-mon[31636]: osdmap e285: 12 total, 12 up, 12 in 2024-04-21T12:08:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:06 smithi170 ceph-mon[31212]: pgmap v3400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:08:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:06 smithi077 ceph-mon[27902]: pgmap v3400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:08:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:06 smithi191 ceph-mon[31636]: pgmap v3400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:08:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6198.376583 secs 2024-04-21T12:08:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6198.376583 secs 2024-04-21T12:08:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6198.376583 secs 2024-04-21T12:08:08.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:08 smithi170 ceph-mon[31212]: osdmap e286: 12 total, 12 up, 12 in 2024-04-21T12:08:08.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:08 smithi170 ceph-mon[31212]: pgmap v3402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:08:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:08 smithi191 ceph-mon[31636]: osdmap e286: 12 total, 12 up, 12 in 2024-04-21T12:08:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:08 smithi191 ceph-mon[31636]: pgmap v3402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:08:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:08 smithi077 ceph-mon[27902]: osdmap e286: 12 total, 12 up, 12 in 2024-04-21T12:08:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:08 smithi077 ceph-mon[27902]: pgmap v3402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:08:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6200.137825 secs 2024-04-21T12:08:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6200.137825 secs 2024-04-21T12:08:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6200.137825 secs 2024-04-21T12:08:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:10 smithi191 ceph-mon[31636]: pgmap v3403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:08:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:10 smithi170 ceph-mon[31212]: pgmap v3403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:08:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:10 smithi077 ceph-mon[27902]: pgmap v3403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:08:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:12 smithi170 ceph-mon[31212]: pgmap v3404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:08:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:12 smithi077 ceph-mon[27902]: pgmap v3404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:08:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:12 smithi191 ceph-mon[31636]: pgmap v3404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:08:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6203.376702 secs 2024-04-21T12:08:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6203.376702 secs 2024-04-21T12:08:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6203.376702 secs 2024-04-21T12:08:14.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:14 smithi170 ceph-mon[31212]: pgmap v3405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:08:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:14 smithi077 ceph-mon[27902]: pgmap v3405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:08:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:14 smithi191 ceph-mon[31636]: pgmap v3405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:08:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6205.137926 secs 2024-04-21T12:08:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6205.137926 secs 2024-04-21T12:08:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6205.137926 secs 2024-04-21T12:08:16.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:16 smithi170 ceph-mon[31212]: pgmap v3406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:08:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:16 smithi077 ceph-mon[27902]: pgmap v3406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:08:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:16 smithi191 ceph-mon[31636]: pgmap v3406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:08:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6208.376850 secs 2024-04-21T12:08:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6208.376850 secs 2024-04-21T12:08:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6208.376850 secs 2024-04-21T12:08:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:18 smithi191 ceph-mon[31636]: pgmap v3407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:08:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:18 smithi170 ceph-mon[31212]: pgmap v3407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:08:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:18 smithi077 ceph-mon[27902]: pgmap v3407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:08:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6210.137986 secs 2024-04-21T12:08:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6210.137986 secs 2024-04-21T12:08:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6210.137986 secs 2024-04-21T12:08:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:20 smithi191 ceph-mon[31636]: pgmap v3408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:08:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:20 smithi170 ceph-mon[31212]: pgmap v3408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:08:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:20 smithi077 ceph-mon[27902]: pgmap v3408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:08:22.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:22 smithi170 ceph-mon[31212]: pgmap v3409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:08:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:22 smithi077 ceph-mon[27902]: pgmap v3409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:08:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:22 smithi191 ceph-mon[31636]: pgmap v3409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:08:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6213.376959 secs 2024-04-21T12:08:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6213.376959 secs 2024-04-21T12:08:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6213.376959 secs 2024-04-21T12:08:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:24 smithi170 ceph-mon[31212]: pgmap v3410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:24 smithi077 ceph-mon[27902]: pgmap v3410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:24 smithi191 ceph-mon[31636]: pgmap v3410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6215.138065 secs 2024-04-21T12:08:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6215.138065 secs 2024-04-21T12:08:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6215.138065 secs 2024-04-21T12:08:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:26 smithi170 ceph-mon[31212]: pgmap v3411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:26 smithi077 ceph-mon[27902]: pgmap v3411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:26 smithi191 ceph-mon[31636]: pgmap v3411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6218.377080 secs 2024-04-21T12:08:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6218.377080 secs 2024-04-21T12:08:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6218.377080 secs 2024-04-21T12:08:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:28 smithi191 ceph-mon[31636]: pgmap v3412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:28 smithi170 ceph-mon[31212]: pgmap v3412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:28 smithi077 ceph-mon[27902]: pgmap v3412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6220.138171 secs 2024-04-21T12:08:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6220.138171 secs 2024-04-21T12:08:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6220.138171 secs 2024-04-21T12:08:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:30 smithi191 ceph-mon[31636]: pgmap v3413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:30 smithi170 ceph-mon[31212]: pgmap v3413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:30 smithi077 ceph-mon[27902]: pgmap v3413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:32.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:32 smithi170 ceph-mon[31212]: pgmap v3414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:32 smithi077 ceph-mon[27902]: pgmap v3414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:32 smithi191 ceph-mon[31636]: pgmap v3414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6223.377161 secs 2024-04-21T12:08:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6223.377161 secs 2024-04-21T12:08:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6223.377161 secs 2024-04-21T12:08:34.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:34 smithi170 ceph-mon[31212]: pgmap v3415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:34 smithi077 ceph-mon[27902]: pgmap v3415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:34 smithi191 ceph-mon[31636]: pgmap v3415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6225.138295 secs 2024-04-21T12:08:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6225.138295 secs 2024-04-21T12:08:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6225.138295 secs 2024-04-21T12:08:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:36 smithi077 ceph-mon[27902]: pgmap v3416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:36 smithi191 ceph-mon[31636]: pgmap v3416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:36.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:36 smithi170 ceph-mon[31212]: pgmap v3416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6228.377301 secs 2024-04-21T12:08:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6228.377301 secs 2024-04-21T12:08:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6228.377301 secs 2024-04-21T12:08:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:38 smithi170 ceph-mon[31212]: pgmap v3417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:38 smithi191 ceph-mon[31636]: pgmap v3417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:38 smithi077 ceph-mon[27902]: pgmap v3417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6230.138409 secs 2024-04-21T12:08:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6230.138409 secs 2024-04-21T12:08:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6230.138409 secs 2024-04-21T12:08:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:40 smithi191 ceph-mon[31636]: pgmap v3418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:40 smithi170 ceph-mon[31212]: pgmap v3418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:40 smithi077 ceph-mon[27902]: pgmap v3418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:42 smithi170 ceph-mon[31212]: pgmap v3419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:42 smithi077 ceph-mon[27902]: pgmap v3419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:42 smithi191 ceph-mon[31636]: pgmap v3419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6233.377425 secs 2024-04-21T12:08:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6233.377425 secs 2024-04-21T12:08:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6233.377425 secs 2024-04-21T12:08:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:44 smithi170 ceph-mon[31212]: pgmap v3420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:44 smithi077 ceph-mon[27902]: pgmap v3420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:44 smithi191 ceph-mon[31636]: pgmap v3420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:45.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6235.138546 secs 2024-04-21T12:08:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:08:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6235.138546 secs 2024-04-21T12:08:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:08:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6235.138546 secs 2024-04-21T12:08:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:08:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:08:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:08:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:08:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:46 smithi077 ceph-mon[27902]: pgmap v3421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:08:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:08:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:08:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:46 smithi191 ceph-mon[31636]: pgmap v3421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:46.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:08:46.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:08:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:08:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:46 smithi170 ceph-mon[31212]: pgmap v3421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6238.377559 secs 2024-04-21T12:08:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6238.377559 secs 2024-04-21T12:08:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6238.377559 secs 2024-04-21T12:08:49.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:48 smithi077 ceph-mon[27902]: pgmap v3422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:48 smithi170 ceph-mon[31212]: pgmap v3422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:48 smithi191 ceph-mon[31636]: pgmap v3422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6240.138675 secs 2024-04-21T12:08:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6240.138675 secs 2024-04-21T12:08:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6240.138675 secs 2024-04-21T12:08:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:50 smithi170 ceph-mon[31212]: pgmap v3423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:50 smithi077 ceph-mon[27902]: pgmap v3423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:50 smithi191 ceph-mon[31636]: pgmap v3423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:52.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:52 smithi170 ceph-mon[31212]: pgmap v3424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:52 smithi077 ceph-mon[27902]: pgmap v3424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:52 smithi191 ceph-mon[31636]: pgmap v3424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:53.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6243.377696 secs 2024-04-21T12:08:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6243.377696 secs 2024-04-21T12:08:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6243.377696 secs 2024-04-21T12:08:54.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:54 smithi170 ceph-mon[31212]: pgmap v3425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:54 smithi077 ceph-mon[27902]: pgmap v3425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:54 smithi191 ceph-mon[31636]: pgmap v3425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:08:55.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6245.138806 secs 2024-04-21T12:08:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6245.138806 secs 2024-04-21T12:08:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6245.138806 secs 2024-04-21T12:08:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:56 smithi077 ceph-mon[27902]: pgmap v3426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:56 smithi191 ceph-mon[31636]: pgmap v3426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:56 smithi170 ceph-mon[31212]: pgmap v3426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:08:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6248.377817 secs 2024-04-21T12:08:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6248.377817 secs 2024-04-21T12:08:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6248.377817 secs 2024-04-21T12:08:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:58 smithi191 ceph-mon[31636]: pgmap v3427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:58 smithi170 ceph-mon[31212]: pgmap v3427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:58 smithi077 ceph-mon[27902]: pgmap v3427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:08:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6250.138943 secs 2024-04-21T12:08:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6250.138943 secs 2024-04-21T12:08:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6250.138943 secs 2024-04-21T12:09:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:00 smithi191 ceph-mon[31636]: pgmap v3428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:00 smithi170 ceph-mon[31212]: pgmap v3428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:00 smithi077 ceph-mon[27902]: pgmap v3428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:02 smithi170 ceph-mon[31212]: pgmap v3429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:02.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:02 smithi077 ceph-mon[27902]: pgmap v3429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:02 smithi191 ceph-mon[31636]: pgmap v3429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6253.377941 secs 2024-04-21T12:09:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6253.377941 secs 2024-04-21T12:09:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6253.377941 secs 2024-04-21T12:09:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:04 smithi170 ceph-mon[31212]: pgmap v3430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:04 smithi077 ceph-mon[27902]: pgmap v3430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:04 smithi191 ceph-mon[31636]: pgmap v3430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6255.139051 secs 2024-04-21T12:09:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:05 smithi170 ceph-mon[31212]: osdmap e287: 12 total, 12 up, 12 in 2024-04-21T12:09:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6255.139051 secs 2024-04-21T12:09:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:05 smithi077 ceph-mon[27902]: osdmap e287: 12 total, 12 up, 12 in 2024-04-21T12:09:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6255.139051 secs 2024-04-21T12:09:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:05 smithi191 ceph-mon[31636]: osdmap e287: 12 total, 12 up, 12 in 2024-04-21T12:09:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:06 smithi077 ceph-mon[27902]: pgmap v3432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:09:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:06 smithi191 ceph-mon[31636]: pgmap v3432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:09:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:06 smithi170 ceph-mon[31212]: pgmap v3432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:09:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6258.378066 secs 2024-04-21T12:09:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6258.378066 secs 2024-04-21T12:09:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6258.378066 secs 2024-04-21T12:09:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:08 smithi191 ceph-mon[31636]: osdmap e288: 12 total, 12 up, 12 in 2024-04-21T12:09:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:08 smithi191 ceph-mon[31636]: pgmap v3434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:09:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:08 smithi170 ceph-mon[31212]: osdmap e288: 12 total, 12 up, 12 in 2024-04-21T12:09:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:08 smithi170 ceph-mon[31212]: pgmap v3434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:09:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:08 smithi077 ceph-mon[27902]: osdmap e288: 12 total, 12 up, 12 in 2024-04-21T12:09:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:08 smithi077 ceph-mon[27902]: pgmap v3434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:09:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6260.139174 secs 2024-04-21T12:09:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6260.139174 secs 2024-04-21T12:09:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6260.139174 secs 2024-04-21T12:09:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:10 smithi170 ceph-mon[31212]: pgmap v3435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:09:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:10 smithi077 ceph-mon[27902]: pgmap v3435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:09:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:10 smithi191 ceph-mon[31636]: pgmap v3435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:09:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:12 smithi170 ceph-mon[31212]: pgmap v3436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:09:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:12 smithi077 ceph-mon[27902]: pgmap v3436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:09:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:12 smithi191 ceph-mon[31636]: pgmap v3436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:09:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6263.378195 secs 2024-04-21T12:09:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6263.378195 secs 2024-04-21T12:09:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6263.378195 secs 2024-04-21T12:09:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:14 smithi170 ceph-mon[31212]: pgmap v3437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:09:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:14 smithi077 ceph-mon[27902]: pgmap v3437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:09:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:14 smithi191 ceph-mon[31636]: pgmap v3437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:09:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6265.139242 secs 2024-04-21T12:09:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6265.139242 secs 2024-04-21T12:09:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6265.139242 secs 2024-04-21T12:09:16.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:16 smithi077 ceph-mon[27902]: pgmap v3438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:09:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:16 smithi191 ceph-mon[31636]: pgmap v3438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:09:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:16 smithi170 ceph-mon[31212]: pgmap v3438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:09:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6268.378323 secs 2024-04-21T12:09:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6268.378323 secs 2024-04-21T12:09:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6268.378323 secs 2024-04-21T12:09:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:18 smithi191 ceph-mon[31636]: pgmap v3439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:09:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:18 smithi170 ceph-mon[31212]: pgmap v3439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:09:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:18 smithi077 ceph-mon[27902]: pgmap v3439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:09:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6270.139360 secs 2024-04-21T12:09:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6270.139360 secs 2024-04-21T12:09:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6270.139360 secs 2024-04-21T12:09:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:20 smithi191 ceph-mon[31636]: pgmap v3440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:09:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:20 smithi170 ceph-mon[31212]: pgmap v3440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:09:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:20 smithi077 ceph-mon[27902]: pgmap v3440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:09:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:22 smithi170 ceph-mon[31212]: pgmap v3441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:09:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:22 smithi077 ceph-mon[27902]: pgmap v3441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:09:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:22 smithi191 ceph-mon[31636]: pgmap v3441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:09:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6273.378458 secs 2024-04-21T12:09:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6273.378458 secs 2024-04-21T12:09:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6273.378458 secs 2024-04-21T12:09:24.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:24 smithi170 ceph-mon[31212]: pgmap v3442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:24 smithi077 ceph-mon[27902]: pgmap v3442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:24 smithi191 ceph-mon[31636]: pgmap v3442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6275.139472 secs 2024-04-21T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6275.139472 secs 2024-04-21T12:09:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6275.139472 secs 2024-04-21T12:09:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:26 smithi077 ceph-mon[27902]: pgmap v3443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:26 smithi191 ceph-mon[31636]: pgmap v3443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:26 smithi170 ceph-mon[31212]: pgmap v3443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6278.378565 secs 2024-04-21T12:09:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6278.378565 secs 2024-04-21T12:09:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6278.378565 secs 2024-04-21T12:09:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:28 smithi191 ceph-mon[31636]: pgmap v3444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:28 smithi170 ceph-mon[31212]: pgmap v3444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:28 smithi077 ceph-mon[27902]: pgmap v3444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6280.139583 secs 2024-04-21T12:09:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6280.139583 secs 2024-04-21T12:09:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6280.139583 secs 2024-04-21T12:09:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:30 smithi191 ceph-mon[31636]: pgmap v3445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:30 smithi170 ceph-mon[31212]: pgmap v3445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:30 smithi077 ceph-mon[27902]: pgmap v3445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:32 smithi170 ceph-mon[31212]: pgmap v3446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:32 smithi077 ceph-mon[27902]: pgmap v3446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:32 smithi191 ceph-mon[31636]: pgmap v3446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6283.378673 secs 2024-04-21T12:09:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6283.378673 secs 2024-04-21T12:09:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6283.378673 secs 2024-04-21T12:09:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:34 smithi077 ceph-mon[27902]: pgmap v3447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:34 smithi191 ceph-mon[31636]: pgmap v3447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:34 smithi170 ceph-mon[31212]: pgmap v3447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6285.139656 secs 2024-04-21T12:09:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6285.139656 secs 2024-04-21T12:09:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6285.139656 secs 2024-04-21T12:09:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:36 smithi077 ceph-mon[27902]: pgmap v3448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:36 smithi191 ceph-mon[31636]: pgmap v3448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:36.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:36 smithi170 ceph-mon[31212]: pgmap v3448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6288.378799 secs 2024-04-21T12:09:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6288.378799 secs 2024-04-21T12:09:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6288.378799 secs 2024-04-21T12:09:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:38 smithi170 ceph-mon[31212]: pgmap v3449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:38 smithi191 ceph-mon[31636]: pgmap v3449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:38 smithi077 ceph-mon[27902]: pgmap v3449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6290.139768 secs 2024-04-21T12:09:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6290.139768 secs 2024-04-21T12:09:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6290.139768 secs 2024-04-21T12:09:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:40 smithi191 ceph-mon[31636]: pgmap v3450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:40 smithi170 ceph-mon[31212]: pgmap v3450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:40 smithi077 ceph-mon[27902]: pgmap v3450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:42 smithi170 ceph-mon[31212]: pgmap v3451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:42 smithi077 ceph-mon[27902]: pgmap v3451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:42 smithi191 ceph-mon[31636]: pgmap v3451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6293.378938 secs 2024-04-21T12:09:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6293.378938 secs 2024-04-21T12:09:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6293.378938 secs 2024-04-21T12:09:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:44 smithi077 ceph-mon[27902]: pgmap v3452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:44 smithi191 ceph-mon[31636]: pgmap v3452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:44 smithi170 ceph-mon[31212]: pgmap v3452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6295.139885 secs 2024-04-21T12:09:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6295.139885 secs 2024-04-21T12:09:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6295.139885 secs 2024-04-21T12:09:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:09:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:46 smithi077 ceph-mon[27902]: pgmap v3453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:09:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:46 smithi191 ceph-mon[31636]: pgmap v3453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:46.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:09:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:46 smithi170 ceph-mon[31212]: pgmap v3453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:09:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:09:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:09:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:09:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:09:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:09:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:09:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:09:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:09:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6298.379062 secs 2024-04-21T12:09:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:48 smithi077 ceph-mon[27902]: pgmap v3454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6298.379062 secs 2024-04-21T12:09:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:48 smithi191 ceph-mon[31636]: pgmap v3454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6298.379062 secs 2024-04-21T12:09:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:48 smithi170 ceph-mon[31212]: pgmap v3454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6300.140000 secs 2024-04-21T12:09:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6300.140000 secs 2024-04-21T12:09:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6300.140000 secs 2024-04-21T12:09:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:50 smithi170 ceph-mon[31212]: pgmap v3455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:50 smithi077 ceph-mon[27902]: pgmap v3455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:50 smithi191 ceph-mon[31636]: pgmap v3455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:52 smithi170 ceph-mon[31212]: pgmap v3456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:52 smithi077 ceph-mon[27902]: pgmap v3456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:52 smithi191 ceph-mon[31636]: pgmap v3456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6303.379193 secs 2024-04-21T12:09:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6303.379193 secs 2024-04-21T12:09:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6303.379193 secs 2024-04-21T12:09:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:54 smithi077 ceph-mon[27902]: pgmap v3457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:54 smithi191 ceph-mon[31636]: pgmap v3457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:54 smithi170 ceph-mon[31212]: pgmap v3457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:09:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6305.140110 secs 2024-04-21T12:09:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6305.140110 secs 2024-04-21T12:09:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6305.140110 secs 2024-04-21T12:09:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:56 smithi077 ceph-mon[27902]: pgmap v3458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:56 smithi191 ceph-mon[31636]: pgmap v3458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:56 smithi170 ceph-mon[31212]: pgmap v3458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:09:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6308.379256 secs 2024-04-21T12:09:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6308.379256 secs 2024-04-21T12:09:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6308.379256 secs 2024-04-21T12:09:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:58 smithi191 ceph-mon[31636]: pgmap v3459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:58 smithi170 ceph-mon[31212]: pgmap v3459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:58 smithi077 ceph-mon[27902]: pgmap v3459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:09:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6310.140244 secs 2024-04-21T12:09:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6310.140244 secs 2024-04-21T12:09:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6310.140244 secs 2024-04-21T12:10:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:00 smithi191 ceph-mon[31636]: pgmap v3460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:10:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:00 smithi170 ceph-mon[31212]: pgmap v3460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:10:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:00 smithi077 ceph-mon[27902]: pgmap v3460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:10:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:02 smithi170 ceph-mon[31212]: pgmap v3461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:02 smithi077 ceph-mon[27902]: pgmap v3461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:02 smithi191 ceph-mon[31636]: pgmap v3461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6313.379369 secs 2024-04-21T12:10:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6313.379369 secs 2024-04-21T12:10:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6313.379369 secs 2024-04-21T12:10:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:04 smithi077 ceph-mon[27902]: pgmap v3462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:04 smithi191 ceph-mon[31636]: pgmap v3462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:04 smithi170 ceph-mon[31212]: pgmap v3462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6315.140369 secs 2024-04-21T12:10:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:05 smithi077 ceph-mon[27902]: osdmap e289: 12 total, 12 up, 12 in 2024-04-21T12:10:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6315.140369 secs 2024-04-21T12:10:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:05 smithi191 ceph-mon[31636]: osdmap e289: 12 total, 12 up, 12 in 2024-04-21T12:10:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6315.140369 secs 2024-04-21T12:10:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:05 smithi170 ceph-mon[31212]: osdmap e289: 12 total, 12 up, 12 in 2024-04-21T12:10:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:06 smithi077 ceph-mon[27902]: pgmap v3464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:10:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:06 smithi191 ceph-mon[31636]: pgmap v3464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:10:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:06 smithi170 ceph-mon[31212]: pgmap v3464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:10:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6318.379492 secs 2024-04-21T12:10:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6318.379492 secs 2024-04-21T12:10:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6318.379492 secs 2024-04-21T12:10:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:08 smithi170 ceph-mon[31212]: osdmap e290: 12 total, 12 up, 12 in 2024-04-21T12:10:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:08 smithi170 ceph-mon[31212]: pgmap v3466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:10:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:08 smithi077 ceph-mon[27902]: osdmap e290: 12 total, 12 up, 12 in 2024-04-21T12:10:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:08 smithi077 ceph-mon[27902]: pgmap v3466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:10:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:08 smithi191 ceph-mon[31636]: osdmap e290: 12 total, 12 up, 12 in 2024-04-21T12:10:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:08 smithi191 ceph-mon[31636]: pgmap v3466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:10:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6320.140494 secs 2024-04-21T12:10:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6320.140494 secs 2024-04-21T12:10:09.893 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6320.140494 secs 2024-04-21T12:10:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:10 smithi170 ceph-mon[31212]: pgmap v3467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:10:10.818 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:10 smithi191 ceph-mon[31636]: pgmap v3467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:10:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:10 smithi077 ceph-mon[27902]: pgmap v3467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:10:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:12 smithi170 ceph-mon[31212]: pgmap v3468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:10:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:12 smithi077 ceph-mon[27902]: pgmap v3468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:10:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:12 smithi191 ceph-mon[31636]: pgmap v3468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:10:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6323.379587 secs 2024-04-21T12:10:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6323.379587 secs 2024-04-21T12:10:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6323.379587 secs 2024-04-21T12:10:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:14 smithi077 ceph-mon[27902]: pgmap v3469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:10:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:14 smithi191 ceph-mon[31636]: pgmap v3469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:10:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:14 smithi170 ceph-mon[31212]: pgmap v3469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:10:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6325.140610 secs 2024-04-21T12:10:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6325.140610 secs 2024-04-21T12:10:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6325.140610 secs 2024-04-21T12:10:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:16 smithi077 ceph-mon[27902]: pgmap v3470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:10:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:16 smithi191 ceph-mon[31636]: pgmap v3470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:10:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:16 smithi170 ceph-mon[31212]: pgmap v3470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:10:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6328.379725 secs 2024-04-21T12:10:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6328.379725 secs 2024-04-21T12:10:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6328.379725 secs 2024-04-21T12:10:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:18 smithi191 ceph-mon[31636]: pgmap v3471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:10:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:18 smithi170 ceph-mon[31212]: pgmap v3471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:10:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:18 smithi077 ceph-mon[27902]: pgmap v3471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:10:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6330.140740 secs 2024-04-21T12:10:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6330.140740 secs 2024-04-21T12:10:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6330.140740 secs 2024-04-21T12:10:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:20 smithi191 ceph-mon[31636]: pgmap v3472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:10:20.805 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:20 smithi077 ceph-mon[27902]: pgmap v3472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:10:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:20 smithi170 ceph-mon[31212]: pgmap v3472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:10:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:22 smithi077 ceph-mon[27902]: pgmap v3473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:10:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:22 smithi191 ceph-mon[31636]: pgmap v3473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:10:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:22 smithi170 ceph-mon[31212]: pgmap v3473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:10:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6333.379863 secs 2024-04-21T12:10:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6333.379863 secs 2024-04-21T12:10:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6333.379863 secs 2024-04-21T12:10:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:24 smithi077 ceph-mon[27902]: pgmap v3474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:24 smithi191 ceph-mon[31636]: pgmap v3474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:24 smithi170 ceph-mon[31212]: pgmap v3474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6335.140881 secs 2024-04-21T12:10:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6335.140881 secs 2024-04-21T12:10:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6335.140881 secs 2024-04-21T12:10:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:26 smithi077 ceph-mon[27902]: pgmap v3475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:26 smithi191 ceph-mon[31636]: pgmap v3475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:26 smithi170 ceph-mon[31212]: pgmap v3475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6338.379965 secs 2024-04-21T12:10:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6338.379965 secs 2024-04-21T12:10:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6338.379965 secs 2024-04-21T12:10:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:28 smithi191 ceph-mon[31636]: pgmap v3476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:28 smithi170 ceph-mon[31212]: pgmap v3476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:28 smithi077 ceph-mon[27902]: pgmap v3476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6340.140987 secs 2024-04-21T12:10:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6340.140987 secs 2024-04-21T12:10:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6340.140987 secs 2024-04-21T12:10:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:30 smithi191 ceph-mon[31636]: pgmap v3477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:30 smithi170 ceph-mon[31212]: pgmap v3477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:30 smithi077 ceph-mon[27902]: pgmap v3477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:32 smithi077 ceph-mon[27902]: pgmap v3478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:32 smithi191 ceph-mon[31636]: pgmap v3478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:32 smithi170 ceph-mon[31212]: pgmap v3478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6343.380079 secs 2024-04-21T12:10:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6343.380079 secs 2024-04-21T12:10:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6343.380079 secs 2024-04-21T12:10:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:34 smithi077 ceph-mon[27902]: pgmap v3479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:34 smithi191 ceph-mon[31636]: pgmap v3479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:34 smithi170 ceph-mon[31212]: pgmap v3479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6345.141107 secs 2024-04-21T12:10:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6345.141107 secs 2024-04-21T12:10:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6345.141107 secs 2024-04-21T12:10:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:36 smithi077 ceph-mon[27902]: pgmap v3480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:36 smithi191 ceph-mon[31636]: pgmap v3480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:36 smithi170 ceph-mon[31212]: pgmap v3480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6348.380218 secs 2024-04-21T12:10:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6348.380218 secs 2024-04-21T12:10:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6348.380218 secs 2024-04-21T12:10:38.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:38 smithi170 ceph-mon[31212]: pgmap v3481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:38 smithi191 ceph-mon[31636]: pgmap v3481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:38 smithi077 ceph-mon[27902]: pgmap v3481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6350.141216 secs 2024-04-21T12:10:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6350.141216 secs 2024-04-21T12:10:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6350.141216 secs 2024-04-21T12:10:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:40 smithi191 ceph-mon[31636]: pgmap v3482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:40 smithi170 ceph-mon[31212]: pgmap v3482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:40 smithi077 ceph-mon[27902]: pgmap v3482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:42 smithi077 ceph-mon[27902]: pgmap v3483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:42 smithi191 ceph-mon[31636]: pgmap v3483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:42 smithi170 ceph-mon[31212]: pgmap v3483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6353.380367 secs 2024-04-21T12:10:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6353.380367 secs 2024-04-21T12:10:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6353.380367 secs 2024-04-21T12:10:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:44 smithi077 ceph-mon[27902]: pgmap v3484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:44 smithi191 ceph-mon[31636]: pgmap v3484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:44 smithi170 ceph-mon[31212]: pgmap v3484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6355.141331 secs 2024-04-21T12:10:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6355.141331 secs 2024-04-21T12:10:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6355.141331 secs 2024-04-21T12:10:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:46 smithi077 ceph-mon[27902]: pgmap v3485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:46 smithi191 ceph-mon[31636]: pgmap v3485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:46.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:46 smithi170 ceph-mon[31212]: pgmap v3485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:10:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:10:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:10:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6358.380484 secs 2024-04-21T12:10:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:10:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:10:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:10:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:48 smithi077 ceph-mon[27902]: pgmap v3486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6358.380484 secs 2024-04-21T12:10:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:10:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:10:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:10:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:48 smithi191 ceph-mon[31636]: pgmap v3486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6358.380484 secs 2024-04-21T12:10:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:10:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:10:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:10:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:48 smithi170 ceph-mon[31212]: pgmap v3486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6360.141489 secs 2024-04-21T12:10:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6360.141489 secs 2024-04-21T12:10:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6360.141489 secs 2024-04-21T12:10:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:50 smithi170 ceph-mon[31212]: pgmap v3487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:50 smithi077 ceph-mon[27902]: pgmap v3487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:50 smithi191 ceph-mon[31636]: pgmap v3487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:52 smithi077 ceph-mon[27902]: pgmap v3488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:52 smithi191 ceph-mon[31636]: pgmap v3488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:52 smithi170 ceph-mon[31212]: pgmap v3488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6363.380579 secs 2024-04-21T12:10:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6363.380579 secs 2024-04-21T12:10:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6363.380579 secs 2024-04-21T12:10:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:54 smithi077 ceph-mon[27902]: pgmap v3489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:54 smithi191 ceph-mon[31636]: pgmap v3489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:54 smithi170 ceph-mon[31212]: pgmap v3489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:10:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:10:55.222+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:10:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:10:55.222+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:10:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:10:55.223+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:10:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:10:55.223+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:10:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6365.141618 secs 2024-04-21T12:10:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6365.141618 secs 2024-04-21T12:10:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6365.141618 secs 2024-04-21T12:10:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:56 smithi077 ceph-mon[27902]: pgmap v3490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:56 smithi191 ceph-mon[31636]: pgmap v3490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:56 smithi170 ceph-mon[31212]: pgmap v3490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:10:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6368.380694 secs 2024-04-21T12:10:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6368.380694 secs 2024-04-21T12:10:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6368.380694 secs 2024-04-21T12:10:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:58 smithi191 ceph-mon[31636]: pgmap v3491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:58 smithi170 ceph-mon[31212]: pgmap v3491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:58 smithi077 ceph-mon[27902]: pgmap v3491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:10:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6370.141741 secs 2024-04-21T12:10:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6370.141741 secs 2024-04-21T12:10:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6370.141741 secs 2024-04-21T12:11:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:00 smithi191 ceph-mon[31636]: pgmap v3492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:00 smithi170 ceph-mon[31212]: pgmap v3492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:00 smithi077 ceph-mon[27902]: pgmap v3492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6373.380792 secs 2024-04-21T12:11:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:03 smithi077 ceph-mon[27902]: pgmap v3493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6373.380792 secs 2024-04-21T12:11:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:03 smithi191 ceph-mon[31636]: pgmap v3493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6373.380792 secs 2024-04-21T12:11:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:03 smithi170 ceph-mon[31212]: pgmap v3493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6375.141873 secs 2024-04-21T12:11:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:05 smithi077 ceph-mon[27902]: pgmap v3494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:05 smithi077 ceph-mon[27902]: osdmap e291: 12 total, 12 up, 12 in 2024-04-21T12:11:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6375.141873 secs 2024-04-21T12:11:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:05 smithi191 ceph-mon[31636]: pgmap v3494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:05 smithi191 ceph-mon[31636]: osdmap e291: 12 total, 12 up, 12 in 2024-04-21T12:11:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6375.141873 secs 2024-04-21T12:11:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:05 smithi170 ceph-mon[31212]: pgmap v3494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:05 smithi170 ceph-mon[31212]: osdmap e291: 12 total, 12 up, 12 in 2024-04-21T12:11:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:07 smithi077 ceph-mon[27902]: pgmap v3496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:11:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:07 smithi191 ceph-mon[31636]: pgmap v3496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:11:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:07 smithi170 ceph-mon[31212]: pgmap v3496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:11:08.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6378.380911 secs 2024-04-21T12:11:08.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:08 smithi191 ceph-mon[31636]: osdmap e292: 12 total, 12 up, 12 in 2024-04-21T12:11:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6378.380911 secs 2024-04-21T12:11:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:08 smithi077 ceph-mon[27902]: osdmap e292: 12 total, 12 up, 12 in 2024-04-21T12:11:08.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6378.380911 secs 2024-04-21T12:11:08.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:08 smithi170 ceph-mon[31212]: osdmap e292: 12 total, 12 up, 12 in 2024-04-21T12:11:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:09 smithi170 ceph-mon[31212]: pgmap v3498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:11:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6380.141954 secs 2024-04-21T12:11:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:09 smithi077 ceph-mon[27902]: pgmap v3498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:11:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6380.141954 secs 2024-04-21T12:11:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:09 smithi191 ceph-mon[31636]: pgmap v3498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:11:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6380.141954 secs 2024-04-21T12:11:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:11 smithi170 ceph-mon[31212]: pgmap v3499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:11:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:11 smithi077 ceph-mon[27902]: pgmap v3499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:11:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:11 smithi191 ceph-mon[31636]: pgmap v3499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:11:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6383.381032 secs 2024-04-21T12:11:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6383.381032 secs 2024-04-21T12:11:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6383.381032 secs 2024-04-21T12:11:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:13 smithi170 ceph-mon[31212]: pgmap v3500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:11:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:13 smithi077 ceph-mon[27902]: pgmap v3500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:11:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:13 smithi191 ceph-mon[31636]: pgmap v3500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:11:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6385.142071 secs 2024-04-21T12:11:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6385.142071 secs 2024-04-21T12:11:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6385.142071 secs 2024-04-21T12:11:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:15.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:15 smithi170 ceph-mon[31212]: pgmap v3501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:11:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:15 smithi077 ceph-mon[27902]: pgmap v3501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:11:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:15 smithi191 ceph-mon[31636]: pgmap v3501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:11:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:17 smithi170 ceph-mon[31212]: pgmap v3502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:11:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6388.381143 secs 2024-04-21T12:11:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:17 smithi077 ceph-mon[27902]: pgmap v3502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:11:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6388.381143 secs 2024-04-21T12:11:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:17 smithi191 ceph-mon[31636]: pgmap v3502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:11:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6388.381143 secs 2024-04-21T12:11:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:19 smithi170 ceph-mon[31212]: pgmap v3503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:11:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6390.142164 secs 2024-04-21T12:11:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:19 smithi077 ceph-mon[27902]: pgmap v3503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:11:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6390.142164 secs 2024-04-21T12:11:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:19 smithi191 ceph-mon[31636]: pgmap v3503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:11:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6390.142164 secs 2024-04-21T12:11:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:21 smithi170 ceph-mon[31212]: pgmap v3504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:11:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:21 smithi077 ceph-mon[27902]: pgmap v3504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:11:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:21 smithi191 ceph-mon[31636]: pgmap v3504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:11:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6393.381305 secs 2024-04-21T12:11:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6393.381305 secs 2024-04-21T12:11:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6393.381305 secs 2024-04-21T12:11:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:23 smithi170 ceph-mon[31212]: pgmap v3505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:11:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:23 smithi077 ceph-mon[27902]: pgmap v3505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:11:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:23 smithi191 ceph-mon[31636]: pgmap v3505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:11:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6395.142301 secs 2024-04-21T12:11:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6395.142301 secs 2024-04-21T12:11:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6395.142301 secs 2024-04-21T12:11:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:25 smithi170 ceph-mon[31212]: pgmap v3506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:25 smithi077 ceph-mon[27902]: pgmap v3506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:25 smithi191 ceph-mon[31636]: pgmap v3506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:27 smithi170 ceph-mon[31212]: pgmap v3507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6398.381376 secs 2024-04-21T12:11:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:27 smithi077 ceph-mon[27902]: pgmap v3507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6398.381376 secs 2024-04-21T12:11:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:27 smithi191 ceph-mon[31636]: pgmap v3507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6398.381376 secs 2024-04-21T12:11:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:29 smithi170 ceph-mon[31212]: pgmap v3508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6400.142412 secs 2024-04-21T12:11:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:29 smithi077 ceph-mon[27902]: pgmap v3508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6400.142412 secs 2024-04-21T12:11:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:29 smithi191 ceph-mon[31636]: pgmap v3508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6400.142412 secs 2024-04-21T12:11:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:31 smithi170 ceph-mon[31212]: pgmap v3509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:31 smithi077 ceph-mon[27902]: pgmap v3509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:31 smithi191 ceph-mon[31636]: pgmap v3509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6403.381491 secs 2024-04-21T12:11:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6403.381491 secs 2024-04-21T12:11:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6403.381491 secs 2024-04-21T12:11:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:33 smithi077 ceph-mon[27902]: pgmap v3510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:33 smithi191 ceph-mon[31636]: pgmap v3510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:33 smithi170 ceph-mon[31212]: pgmap v3510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6405.142508 secs 2024-04-21T12:11:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6405.142508 secs 2024-04-21T12:11:35.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6405.142508 secs 2024-04-21T12:11:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:35 smithi077 ceph-mon[27902]: pgmap v3511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:35 smithi191 ceph-mon[31636]: pgmap v3511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:36.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:35 smithi170 ceph-mon[31212]: pgmap v3511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:37 smithi077 ceph-mon[27902]: pgmap v3512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6408.381596 secs 2024-04-21T12:11:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:37 smithi191 ceph-mon[31636]: pgmap v3512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6408.381596 secs 2024-04-21T12:11:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:37 smithi170 ceph-mon[31212]: pgmap v3512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6408.381596 secs 2024-04-21T12:11:39.858 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:39 smithi170 ceph-mon[31212]: pgmap v3513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:39.858 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6410.142611 secs 2024-04-21T12:11:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:39 smithi077 ceph-mon[27902]: pgmap v3513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6410.142611 secs 2024-04-21T12:11:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:39 smithi191 ceph-mon[31636]: pgmap v3513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6410.142611 secs 2024-04-21T12:11:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:41 smithi077 ceph-mon[27902]: pgmap v3514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:41 smithi191 ceph-mon[31636]: pgmap v3514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:41 smithi170 ceph-mon[31212]: pgmap v3514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6413.381711 secs 2024-04-21T12:11:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6413.381711 secs 2024-04-21T12:11:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6413.381711 secs 2024-04-21T12:11:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:43 smithi077 ceph-mon[27902]: pgmap v3515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:43 smithi191 ceph-mon[31636]: pgmap v3515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:43 smithi170 ceph-mon[31212]: pgmap v3515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6415.142730 secs 2024-04-21T12:11:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6415.142730 secs 2024-04-21T12:11:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6415.142730 secs 2024-04-21T12:11:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:45 smithi077 ceph-mon[27902]: pgmap v3516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:45 smithi191 ceph-mon[31636]: pgmap v3516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:45 smithi170 ceph-mon[31212]: pgmap v3516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:47 smithi077 ceph-mon[27902]: pgmap v3517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6418.381831 secs 2024-04-21T12:11:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:11:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:47 smithi191 ceph-mon[31636]: pgmap v3517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6418.381831 secs 2024-04-21T12:11:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:11:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:47 smithi170 ceph-mon[31212]: pgmap v3517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6418.381831 secs 2024-04-21T12:11:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:11:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:11:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:11:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:11:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:11:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:11:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:11:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:11:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:49 smithi077 ceph-mon[27902]: pgmap v3518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6420.142793 secs 2024-04-21T12:11:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:49 smithi191 ceph-mon[31636]: pgmap v3518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6420.142793 secs 2024-04-21T12:11:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:49 smithi170 ceph-mon[31212]: pgmap v3518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6420.142793 secs 2024-04-21T12:11:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:51 smithi077 ceph-mon[27902]: pgmap v3519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:51 smithi191 ceph-mon[31636]: pgmap v3519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:51 smithi170 ceph-mon[31212]: pgmap v3519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6423.381946 secs 2024-04-21T12:11:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6423.381946 secs 2024-04-21T12:11:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6423.381946 secs 2024-04-21T12:11:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:53 smithi077 ceph-mon[27902]: pgmap v3520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:53 smithi191 ceph-mon[31636]: pgmap v3520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:53 smithi170 ceph-mon[31212]: pgmap v3520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6425.142908 secs 2024-04-21T12:11:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6425.142908 secs 2024-04-21T12:11:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6425.142908 secs 2024-04-21T12:11:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:11:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:55 smithi077 ceph-mon[27902]: pgmap v3521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:55 smithi191 ceph-mon[31636]: pgmap v3521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:55 smithi170 ceph-mon[31212]: pgmap v3521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:57 smithi077 ceph-mon[27902]: pgmap v3522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6428.382018 secs 2024-04-21T12:11:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:57 smithi191 ceph-mon[31636]: pgmap v3522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6428.382018 secs 2024-04-21T12:11:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:57 smithi170 ceph-mon[31212]: pgmap v3522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:11:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6428.382018 secs 2024-04-21T12:11:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:59 smithi077 ceph-mon[27902]: pgmap v3523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6430.142994 secs 2024-04-21T12:11:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:59 smithi191 ceph-mon[31636]: pgmap v3523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:11:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6430.142994 secs 2024-04-21T12:12:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:59 smithi170 ceph-mon[31212]: pgmap v3523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6430.142994 secs 2024-04-21T12:12:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:01 smithi077 ceph-mon[27902]: pgmap v3524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:01 smithi191 ceph-mon[31636]: pgmap v3524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:01 smithi170 ceph-mon[31212]: pgmap v3524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6433.382127 secs 2024-04-21T12:12:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6433.382127 secs 2024-04-21T12:12:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6433.382127 secs 2024-04-21T12:12:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:03 smithi191 ceph-mon[31636]: pgmap v3525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:03 smithi170 ceph-mon[31212]: pgmap v3525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:03 smithi077 ceph-mon[27902]: pgmap v3525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6435.143057 secs 2024-04-21T12:12:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:04 smithi191 ceph-mon[31636]: osdmap e293: 12 total, 12 up, 12 in 2024-04-21T12:12:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6435.143057 secs 2024-04-21T12:12:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:04 smithi170 ceph-mon[31212]: osdmap e293: 12 total, 12 up, 12 in 2024-04-21T12:12:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6435.143057 secs 2024-04-21T12:12:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:04 smithi077 ceph-mon[27902]: osdmap e293: 12 total, 12 up, 12 in 2024-04-21T12:12:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:05 smithi191 ceph-mon[31636]: pgmap v3527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:12:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:05 smithi170 ceph-mon[31212]: pgmap v3527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:12:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:05 smithi077 ceph-mon[27902]: pgmap v3527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:12:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:07 smithi191 ceph-mon[31636]: pgmap v3528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:12:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6438.382223 secs 2024-04-21T12:12:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:07 smithi191 ceph-mon[31636]: osdmap e294: 12 total, 12 up, 12 in 2024-04-21T12:12:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:07 smithi170 ceph-mon[31212]: pgmap v3528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:12:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6438.382223 secs 2024-04-21T12:12:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:07 smithi170 ceph-mon[31212]: osdmap e294: 12 total, 12 up, 12 in 2024-04-21T12:12:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:07 smithi077 ceph-mon[27902]: pgmap v3528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:12:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6438.382223 secs 2024-04-21T12:12:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:07 smithi077 ceph-mon[27902]: osdmap e294: 12 total, 12 up, 12 in 2024-04-21T12:12:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:09 smithi191 ceph-mon[31636]: pgmap v3530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:12:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6440.143158 secs 2024-04-21T12:12:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:09 smithi170 ceph-mon[31212]: pgmap v3530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:12:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6440.143158 secs 2024-04-21T12:12:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:09 smithi077 ceph-mon[27902]: pgmap v3530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:12:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6440.143158 secs 2024-04-21T12:12:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:11 smithi191 ceph-mon[31636]: pgmap v3531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:12:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:11 smithi170 ceph-mon[31212]: pgmap v3531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:12:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:11 smithi077 ceph-mon[27902]: pgmap v3531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:12:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6443.382367 secs 2024-04-21T12:12:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6443.382367 secs 2024-04-21T12:12:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6443.382367 secs 2024-04-21T12:12:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:13 smithi191 ceph-mon[31636]: pgmap v3532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:12:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:13 smithi170 ceph-mon[31212]: pgmap v3532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:12:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:13 smithi077 ceph-mon[27902]: pgmap v3532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:12:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6445.143266 secs 2024-04-21T12:12:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6445.143266 secs 2024-04-21T12:12:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6445.143266 secs 2024-04-21T12:12:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:15 smithi191 ceph-mon[31636]: pgmap v3533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:12:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:15 smithi170 ceph-mon[31212]: pgmap v3533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:12:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:15 smithi077 ceph-mon[27902]: pgmap v3533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:12:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:17 smithi191 ceph-mon[31636]: pgmap v3534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:12:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6448.382460 secs 2024-04-21T12:12:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:17 smithi170 ceph-mon[31212]: pgmap v3534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:12:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6448.382460 secs 2024-04-21T12:12:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:17 smithi077 ceph-mon[27902]: pgmap v3534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:12:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6448.382460 secs 2024-04-21T12:12:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:19 smithi191 ceph-mon[31636]: pgmap v3535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:12:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6450.143370 secs 2024-04-21T12:12:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:19 smithi170 ceph-mon[31212]: pgmap v3535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:12:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6450.143370 secs 2024-04-21T12:12:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:19 smithi077 ceph-mon[27902]: pgmap v3535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:12:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6450.143370 secs 2024-04-21T12:12:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:21 smithi191 ceph-mon[31636]: pgmap v3536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:12:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:21 smithi170 ceph-mon[31212]: pgmap v3536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:12:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:21 smithi077 ceph-mon[27902]: pgmap v3536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:12:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6453.382524 secs 2024-04-21T12:12:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6453.382524 secs 2024-04-21T12:12:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6453.382524 secs 2024-04-21T12:12:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:23 smithi191 ceph-mon[31636]: pgmap v3537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:12:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:23 smithi170 ceph-mon[31212]: pgmap v3537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:12:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:23 smithi077 ceph-mon[27902]: pgmap v3537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:12:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6455.143484 secs 2024-04-21T12:12:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6455.143484 secs 2024-04-21T12:12:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6455.143484 secs 2024-04-21T12:12:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:25 smithi191 ceph-mon[31636]: pgmap v3538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:25 smithi170 ceph-mon[31212]: pgmap v3538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:25 smithi077 ceph-mon[27902]: pgmap v3538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:27 smithi191 ceph-mon[31636]: pgmap v3539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6458.382640 secs 2024-04-21T12:12:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:27 smithi170 ceph-mon[31212]: pgmap v3539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6458.382640 secs 2024-04-21T12:12:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:27 smithi077 ceph-mon[27902]: pgmap v3539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6458.382640 secs 2024-04-21T12:12:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:29 smithi170 ceph-mon[31212]: pgmap v3540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6460.143615 secs 2024-04-21T12:12:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:29 smithi077 ceph-mon[27902]: pgmap v3540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6460.143615 secs 2024-04-21T12:12:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:29 smithi191 ceph-mon[31636]: pgmap v3540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6460.143615 secs 2024-04-21T12:12:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:31 smithi170 ceph-mon[31212]: pgmap v3541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:31 smithi077 ceph-mon[27902]: pgmap v3541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:31 smithi191 ceph-mon[31636]: pgmap v3541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6463.382790 secs 2024-04-21T12:12:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6463.382790 secs 2024-04-21T12:12:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6463.382790 secs 2024-04-21T12:12:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:33 smithi170 ceph-mon[31212]: pgmap v3542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:33 smithi077 ceph-mon[27902]: pgmap v3542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:33 smithi191 ceph-mon[31636]: pgmap v3542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6465.143757 secs 2024-04-21T12:12:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6465.143757 secs 2024-04-21T12:12:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6465.143757 secs 2024-04-21T12:12:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:35 smithi170 ceph-mon[31212]: pgmap v3543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:35 smithi077 ceph-mon[27902]: pgmap v3543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:35 smithi191 ceph-mon[31636]: pgmap v3543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:37 smithi170 ceph-mon[31212]: pgmap v3544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6468.382886 secs 2024-04-21T12:12:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:37 smithi077 ceph-mon[27902]: pgmap v3544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6468.382886 secs 2024-04-21T12:12:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:37 smithi191 ceph-mon[31636]: pgmap v3544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6468.382886 secs 2024-04-21T12:12:40.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:39 smithi191 ceph-mon[31636]: pgmap v3545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:40.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6470.143830 secs 2024-04-21T12:12:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:39 smithi170 ceph-mon[31212]: pgmap v3545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6470.143830 secs 2024-04-21T12:12:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:39 smithi077 ceph-mon[27902]: pgmap v3545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6470.143830 secs 2024-04-21T12:12:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:41 smithi170 ceph-mon[31212]: pgmap v3546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:41 smithi077 ceph-mon[27902]: pgmap v3546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:41 smithi191 ceph-mon[31636]: pgmap v3546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6473.382963 secs 2024-04-21T12:12:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6473.382963 secs 2024-04-21T12:12:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6473.382963 secs 2024-04-21T12:12:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:43 smithi170 ceph-mon[31212]: pgmap v3547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:43 smithi077 ceph-mon[27902]: pgmap v3547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:43 smithi191 ceph-mon[31636]: pgmap v3547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6475.143940 secs 2024-04-21T12:12:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6475.143940 secs 2024-04-21T12:12:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6475.143940 secs 2024-04-21T12:12:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:45 smithi170 ceph-mon[31212]: pgmap v3548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:45 smithi077 ceph-mon[27902]: pgmap v3548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:45 smithi191 ceph-mon[31636]: pgmap v3548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:47 smithi170 ceph-mon[31212]: pgmap v3549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6478.383076 secs 2024-04-21T12:12:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:47 smithi077 ceph-mon[27902]: pgmap v3549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6478.383076 secs 2024-04-21T12:12:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:47 smithi191 ceph-mon[31636]: pgmap v3549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6478.383076 secs 2024-04-21T12:12:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:12:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:12:49.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:12:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:49 smithi170 ceph-mon[31212]: pgmap v3550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6480.144009 secs 2024-04-21T12:12:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:12:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:12:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:12:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:49 smithi077 ceph-mon[27902]: pgmap v3550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6480.144009 secs 2024-04-21T12:12:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:12:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:12:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:12:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:49 smithi191 ceph-mon[31636]: pgmap v3550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6480.144009 secs 2024-04-21T12:12:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:12:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:12:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:12:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:51 smithi170 ceph-mon[31212]: pgmap v3551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:51 smithi077 ceph-mon[27902]: pgmap v3551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:51 smithi191 ceph-mon[31636]: pgmap v3551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6483.383185 secs 2024-04-21T12:12:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6483.383185 secs 2024-04-21T12:12:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6483.383185 secs 2024-04-21T12:12:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:53 smithi170 ceph-mon[31212]: pgmap v3552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:53 smithi077 ceph-mon[27902]: pgmap v3552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:53 smithi191 ceph-mon[31636]: pgmap v3552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6485.144121 secs 2024-04-21T12:12:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:12:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6485.144121 secs 2024-04-21T12:12:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6485.144121 secs 2024-04-21T12:12:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:55 smithi170 ceph-mon[31212]: pgmap v3553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:55 smithi077 ceph-mon[27902]: pgmap v3553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:55 smithi191 ceph-mon[31636]: pgmap v3553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:12:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:57 smithi170 ceph-mon[31212]: pgmap v3554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6488.383305 secs 2024-04-21T12:12:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:57 smithi077 ceph-mon[27902]: pgmap v3554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6488.383305 secs 2024-04-21T12:12:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:57 smithi191 ceph-mon[31636]: pgmap v3554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:12:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6488.383305 secs 2024-04-21T12:13:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:59 smithi170 ceph-mon[31212]: pgmap v3555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:12:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6490.144213 secs 2024-04-21T12:13:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:59 smithi077 ceph-mon[27902]: pgmap v3555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:12:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6490.144213 secs 2024-04-21T12:13:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:59 smithi191 ceph-mon[31636]: pgmap v3555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:12:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6490.144213 secs 2024-04-21T12:13:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:01 smithi170 ceph-mon[31212]: pgmap v3556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:01 smithi077 ceph-mon[27902]: pgmap v3556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:01 smithi191 ceph-mon[31636]: pgmap v3556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6493.383427 secs 2024-04-21T12:13:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6493.383427 secs 2024-04-21T12:13:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6493.383427 secs 2024-04-21T12:13:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:03 smithi170 ceph-mon[31212]: pgmap v3557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:03 smithi077 ceph-mon[27902]: pgmap v3557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:03 smithi191 ceph-mon[31636]: pgmap v3557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6495.144350 secs 2024-04-21T12:13:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:04 smithi077 ceph-mon[27902]: osdmap e295: 12 total, 12 up, 12 in 2024-04-21T12:13:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6495.144350 secs 2024-04-21T12:13:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:04 smithi191 ceph-mon[31636]: osdmap e295: 12 total, 12 up, 12 in 2024-04-21T12:13:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6495.144350 secs 2024-04-21T12:13:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:04 smithi170 ceph-mon[31212]: osdmap e295: 12 total, 12 up, 12 in 2024-04-21T12:13:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:05 smithi077 ceph-mon[27902]: pgmap v3559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:13:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:05 smithi191 ceph-mon[31636]: pgmap v3559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:13:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:05 smithi170 ceph-mon[31212]: pgmap v3559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:13:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:07 smithi077 ceph-mon[27902]: pgmap v3560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:13:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6498.383562 secs 2024-04-21T12:13:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:07 smithi077 ceph-mon[27902]: osdmap e296: 12 total, 12 up, 12 in 2024-04-21T12:13:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:07 smithi191 ceph-mon[31636]: pgmap v3560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:13:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6498.383562 secs 2024-04-21T12:13:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:07 smithi191 ceph-mon[31636]: osdmap e296: 12 total, 12 up, 12 in 2024-04-21T12:13:08.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:07 smithi170 ceph-mon[31212]: pgmap v3560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:13:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6498.383562 secs 2024-04-21T12:13:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:07 smithi170 ceph-mon[31212]: osdmap e296: 12 total, 12 up, 12 in 2024-04-21T12:13:10.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:09 smithi170 ceph-mon[31212]: pgmap v3562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:13:10.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6500.144500 secs 2024-04-21T12:13:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:09 smithi077 ceph-mon[27902]: pgmap v3562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:13:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6500.144500 secs 2024-04-21T12:13:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:09 smithi191 ceph-mon[31636]: pgmap v3562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:13:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6500.144500 secs 2024-04-21T12:13:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:11 smithi077 ceph-mon[27902]: pgmap v3563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:13:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:11 smithi191 ceph-mon[31636]: pgmap v3563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:13:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:11 smithi170 ceph-mon[31212]: pgmap v3563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:13:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6503.383681 secs 2024-04-21T12:13:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6503.383681 secs 2024-04-21T12:13:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6503.383681 secs 2024-04-21T12:13:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:13 smithi077 ceph-mon[27902]: pgmap v3564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:13:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:13 smithi191 ceph-mon[31636]: pgmap v3564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:13:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:13 smithi170 ceph-mon[31212]: pgmap v3564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:13:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6505.144637 secs 2024-04-21T12:13:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6505.144637 secs 2024-04-21T12:13:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6505.144637 secs 2024-04-21T12:13:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:15 smithi077 ceph-mon[27902]: pgmap v3565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:13:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:15 smithi191 ceph-mon[31636]: pgmap v3565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:13:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:15 smithi170 ceph-mon[31212]: pgmap v3565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:13:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:17 smithi077 ceph-mon[27902]: pgmap v3566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:13:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6508.383803 secs 2024-04-21T12:13:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:17 smithi191 ceph-mon[31636]: pgmap v3566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:13:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6508.383803 secs 2024-04-21T12:13:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:17 smithi170 ceph-mon[31212]: pgmap v3566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:13:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6508.383803 secs 2024-04-21T12:13:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:19 smithi077 ceph-mon[27902]: pgmap v3567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:13:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6510.144764 secs 2024-04-21T12:13:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:19 smithi191 ceph-mon[31636]: pgmap v3567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:13:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6510.144764 secs 2024-04-21T12:13:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:19 smithi170 ceph-mon[31212]: pgmap v3567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:13:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6510.144764 secs 2024-04-21T12:13:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:21 smithi077 ceph-mon[27902]: pgmap v3568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:13:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:21 smithi191 ceph-mon[31636]: pgmap v3568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:13:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:21 smithi170 ceph-mon[31212]: pgmap v3568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:13:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6513.383883 secs 2024-04-21T12:13:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6513.383883 secs 2024-04-21T12:13:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6513.383883 secs 2024-04-21T12:13:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:23 smithi077 ceph-mon[27902]: pgmap v3569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:13:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:23 smithi191 ceph-mon[31636]: pgmap v3569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:13:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:23 smithi170 ceph-mon[31212]: pgmap v3569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:13:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6515.144910 secs 2024-04-21T12:13:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6515.144910 secs 2024-04-21T12:13:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6515.144910 secs 2024-04-21T12:13:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:25 smithi077 ceph-mon[27902]: pgmap v3570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:25 smithi191 ceph-mon[31636]: pgmap v3570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:25 smithi170 ceph-mon[31212]: pgmap v3570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:27 smithi077 ceph-mon[27902]: pgmap v3571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6518.383978 secs 2024-04-21T12:13:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:27 smithi191 ceph-mon[31636]: pgmap v3571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6518.383978 secs 2024-04-21T12:13:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:27 smithi170 ceph-mon[31212]: pgmap v3571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6518.383978 secs 2024-04-21T12:13:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:29 smithi077 ceph-mon[27902]: pgmap v3572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6520.145032 secs 2024-04-21T12:13:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:29 smithi191 ceph-mon[31636]: pgmap v3572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6520.145032 secs 2024-04-21T12:13:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:29 smithi170 ceph-mon[31212]: pgmap v3572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6520.145032 secs 2024-04-21T12:13:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:31 smithi077 ceph-mon[27902]: pgmap v3573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:31 smithi191 ceph-mon[31636]: pgmap v3573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:31 smithi170 ceph-mon[31212]: pgmap v3573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6523.384116 secs 2024-04-21T12:13:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6523.384116 secs 2024-04-21T12:13:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6523.384116 secs 2024-04-21T12:13:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:33 smithi077 ceph-mon[27902]: pgmap v3574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:33 smithi191 ceph-mon[31636]: pgmap v3574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:33 smithi170 ceph-mon[31212]: pgmap v3574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6525.145150 secs 2024-04-21T12:13:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6525.145150 secs 2024-04-21T12:13:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6525.145150 secs 2024-04-21T12:13:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:35 smithi191 ceph-mon[31636]: pgmap v3575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:35 smithi170 ceph-mon[31212]: pgmap v3575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:35 smithi077 ceph-mon[27902]: pgmap v3575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:37 smithi191 ceph-mon[31636]: pgmap v3576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6528.384252 secs 2024-04-21T12:13:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:37 smithi170 ceph-mon[31212]: pgmap v3576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6528.384252 secs 2024-04-21T12:13:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:37 smithi077 ceph-mon[27902]: pgmap v3576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6528.384252 secs 2024-04-21T12:13:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:39 smithi191 ceph-mon[31636]: pgmap v3577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6530.145246 secs 2024-04-21T12:13:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:39 smithi170 ceph-mon[31212]: pgmap v3577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6530.145246 secs 2024-04-21T12:13:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:39 smithi077 ceph-mon[27902]: pgmap v3577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6530.145246 secs 2024-04-21T12:13:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:41 smithi191 ceph-mon[31636]: pgmap v3578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:41 smithi170 ceph-mon[31212]: pgmap v3578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:41 smithi077 ceph-mon[27902]: pgmap v3578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6533.384342 secs 2024-04-21T12:13:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6533.384342 secs 2024-04-21T12:13:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6533.384342 secs 2024-04-21T12:13:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:43 smithi191 ceph-mon[31636]: pgmap v3579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:43 smithi170 ceph-mon[31212]: pgmap v3579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:43 smithi077 ceph-mon[27902]: pgmap v3579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6535.145363 secs 2024-04-21T12:13:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6535.145363 secs 2024-04-21T12:13:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6535.145363 secs 2024-04-21T12:13:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:45 smithi191 ceph-mon[31636]: pgmap v3580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:45 smithi170 ceph-mon[31212]: pgmap v3580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:45 smithi077 ceph-mon[27902]: pgmap v3580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:47 smithi191 ceph-mon[31636]: pgmap v3581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6538.384484 secs 2024-04-21T12:13:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:47 smithi170 ceph-mon[31212]: pgmap v3581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6538.384484 secs 2024-04-21T12:13:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:47 smithi077 ceph-mon[27902]: pgmap v3581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6538.384484 secs 2024-04-21T12:13:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:49 smithi077 ceph-mon[27902]: pgmap v3582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6540.145479 secs 2024-04-21T12:13:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:13:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:49 smithi191 ceph-mon[31636]: pgmap v3582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6540.145479 secs 2024-04-21T12:13:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:13:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:49 smithi170 ceph-mon[31212]: pgmap v3582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6540.145479 secs 2024-04-21T12:13:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:13:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: pgmap v3583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:13:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:13:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: pgmap v3583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:13:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: pgmap v3583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:13:52.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:13:52.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:13:52.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:13:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:13:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:13:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:13:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:13:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:13:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:13:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6543.384572 secs 2024-04-21T12:13:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:13:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:13:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:13:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:13:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:13:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:13:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6543.384572 secs 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:13:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6543.384572 secs 2024-04-21T12:13:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:53 smithi077 ceph-mon[27902]: pgmap v3584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:53 smithi191 ceph-mon[31636]: pgmap v3584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:53 smithi170 ceph-mon[31212]: pgmap v3584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd700204f0 tx=0x7efd70046000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd700204f0 tx=0x7efd70046000 comp rx=0 tx=0).stop 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4f20 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a4f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a4f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T12:13:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.412+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:13:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.413+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efd70009b00 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T12:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.419+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T12:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.419+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T12:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T12:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.419+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:13:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.420+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T12:13:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:54.420+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T12:13:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6545.145604 secs 2024-04-21T12:13:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6545.145604 secs 2024-04-21T12:13:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6545.145604 secs 2024-04-21T12:13:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:13:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:55.248+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:13:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:55.248+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:13:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:55.248+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:13:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:13:55.248+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:13:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:55 smithi077 ceph-mon[27902]: pgmap v3585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:55 smithi191 ceph-mon[31636]: pgmap v3585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:55 smithi170 ceph-mon[31212]: pgmap v3585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:57 smithi077 ceph-mon[27902]: pgmap v3586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6548.384689 secs 2024-04-21T12:13:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:57 smithi191 ceph-mon[31636]: pgmap v3586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6548.384689 secs 2024-04-21T12:13:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:57 smithi170 ceph-mon[31212]: pgmap v3586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:13:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6548.384689 secs 2024-04-21T12:13:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:59 smithi077 ceph-mon[27902]: pgmap v3587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6550.145730 secs 2024-04-21T12:13:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:59 smithi191 ceph-mon[31636]: pgmap v3587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:13:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6550.145730 secs 2024-04-21T12:14:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:59 smithi170 ceph-mon[31212]: pgmap v3587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6550.145730 secs 2024-04-21T12:14:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:01 smithi077 ceph-mon[27902]: pgmap v3588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:01 smithi191 ceph-mon[31636]: pgmap v3588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:01 smithi170 ceph-mon[31212]: pgmap v3588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6553.384799 secs 2024-04-21T12:14:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6553.384799 secs 2024-04-21T12:14:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6553.384799 secs 2024-04-21T12:14:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:03 smithi077 ceph-mon[27902]: pgmap v3589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T12:14:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:03 smithi191 ceph-mon[31636]: pgmap v3589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T12:14:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:03 smithi170 ceph-mon[31212]: pgmap v3589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T12:14:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6555.145874 secs 2024-04-21T12:14:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:04 smithi077 ceph-mon[27902]: osdmap e297: 12 total, 12 up, 12 in 2024-04-21T12:14:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6555.145874 secs 2024-04-21T12:14:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:04 smithi191 ceph-mon[31636]: osdmap e297: 12 total, 12 up, 12 in 2024-04-21T12:14:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6555.145874 secs 2024-04-21T12:14:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:04 smithi170 ceph-mon[31212]: osdmap e297: 12 total, 12 up, 12 in 2024-04-21T12:14:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:05 smithi077 ceph-mon[27902]: pgmap v3591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T12:14:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:05 smithi191 ceph-mon[31636]: pgmap v3591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T12:14:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:05 smithi170 ceph-mon[31212]: pgmap v3591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T12:14:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:07 smithi077 ceph-mon[27902]: pgmap v3592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:14:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6558.384918 secs 2024-04-21T12:14:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:07 smithi077 ceph-mon[27902]: osdmap e298: 12 total, 12 up, 12 in 2024-04-21T12:14:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:07 smithi191 ceph-mon[31636]: pgmap v3592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:14:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6558.384918 secs 2024-04-21T12:14:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:07 smithi191 ceph-mon[31636]: osdmap e298: 12 total, 12 up, 12 in 2024-04-21T12:14:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:07 smithi170 ceph-mon[31212]: pgmap v3592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:14:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6558.384918 secs 2024-04-21T12:14:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:07 smithi170 ceph-mon[31212]: osdmap e298: 12 total, 12 up, 12 in 2024-04-21T12:14:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:09 smithi077 ceph-mon[27902]: pgmap v3594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:14:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6560.145973 secs 2024-04-21T12:14:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:09 smithi191 ceph-mon[31636]: pgmap v3594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:14:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6560.145973 secs 2024-04-21T12:14:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:09 smithi170 ceph-mon[31212]: pgmap v3594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:14:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6560.145973 secs 2024-04-21T12:14:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:11.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:11 smithi077 ceph-mon[27902]: pgmap v3595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-04-21T12:14:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:11 smithi191 ceph-mon[31636]: pgmap v3595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-04-21T12:14:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:11 smithi170 ceph-mon[31212]: pgmap v3595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-04-21T12:14:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6563.385011 secs 2024-04-21T12:14:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6563.385011 secs 2024-04-21T12:14:13.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6563.385011 secs 2024-04-21T12:14:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:13 smithi077 ceph-mon[27902]: pgmap v3596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-04-21T12:14:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:13 smithi191 ceph-mon[31636]: pgmap v3596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-04-21T12:14:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:13 smithi170 ceph-mon[31212]: pgmap v3596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-04-21T12:14:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6565.146064 secs 2024-04-21T12:14:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6565.146064 secs 2024-04-21T12:14:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6565.146064 secs 2024-04-21T12:14:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:15 smithi191 ceph-mon[31636]: pgmap v3597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T12:14:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:15 smithi170 ceph-mon[31212]: pgmap v3597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T12:14:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:15 smithi077 ceph-mon[27902]: pgmap v3597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T12:14:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:17 smithi191 ceph-mon[31636]: pgmap v3598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:14:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6568.385118 secs 2024-04-21T12:14:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:17 smithi170 ceph-mon[31212]: pgmap v3598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:14:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6568.385118 secs 2024-04-21T12:14:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:17 smithi077 ceph-mon[27902]: pgmap v3598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:14:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6568.385118 secs 2024-04-21T12:14:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:19 smithi191 ceph-mon[31636]: pgmap v3599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:14:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6570.146177 secs 2024-04-21T12:14:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:19 smithi170 ceph-mon[31212]: pgmap v3599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:14:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6570.146177 secs 2024-04-21T12:14:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:19 smithi077 ceph-mon[27902]: pgmap v3599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:14:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6570.146177 secs 2024-04-21T12:14:21.937 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:21 smithi077 ceph-mon[27902]: pgmap v3600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:14:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:21 smithi191 ceph-mon[31636]: pgmap v3600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:14:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:21 smithi170 ceph-mon[31212]: pgmap v3600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:14:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6573.385246 secs 2024-04-21T12:14:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6573.385246 secs 2024-04-21T12:14:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6573.385246 secs 2024-04-21T12:14:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:23 smithi191 ceph-mon[31636]: pgmap v3601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:14:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:23 smithi170 ceph-mon[31212]: pgmap v3601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:14:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:23 smithi077 ceph-mon[27902]: pgmap v3601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:14:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6575.146326 secs 2024-04-21T12:14:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6575.146326 secs 2024-04-21T12:14:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6575.146326 secs 2024-04-21T12:14:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:25 smithi191 ceph-mon[31636]: pgmap v3602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:25 smithi170 ceph-mon[31212]: pgmap v3602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:25 smithi077 ceph-mon[27902]: pgmap v3602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:27 smithi191 ceph-mon[31636]: pgmap v3603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6578.385360 secs 2024-04-21T12:14:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:27 smithi170 ceph-mon[31212]: pgmap v3603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6578.385360 secs 2024-04-21T12:14:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:27 smithi077 ceph-mon[27902]: pgmap v3603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6578.385360 secs 2024-04-21T12:14:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:29 smithi191 ceph-mon[31636]: pgmap v3604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6580.146387 secs 2024-04-21T12:14:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:29 smithi170 ceph-mon[31212]: pgmap v3604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6580.146387 secs 2024-04-21T12:14:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:29 smithi077 ceph-mon[27902]: pgmap v3604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6580.146387 secs 2024-04-21T12:14:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:31 smithi191 ceph-mon[31636]: pgmap v3605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:31 smithi170 ceph-mon[31212]: pgmap v3605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:31 smithi077 ceph-mon[27902]: pgmap v3605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6583.385478 secs 2024-04-21T12:14:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6583.385478 secs 2024-04-21T12:14:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6583.385478 secs 2024-04-21T12:14:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:33 smithi191 ceph-mon[31636]: pgmap v3606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:33 smithi170 ceph-mon[31212]: pgmap v3606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:33 smithi077 ceph-mon[27902]: pgmap v3606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6585.146512 secs 2024-04-21T12:14:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6585.146512 secs 2024-04-21T12:14:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6585.146512 secs 2024-04-21T12:14:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:35 smithi191 ceph-mon[31636]: pgmap v3607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:35 smithi170 ceph-mon[31212]: pgmap v3607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:35 smithi077 ceph-mon[27902]: pgmap v3607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:37 smithi191 ceph-mon[31636]: pgmap v3608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6588.385591 secs 2024-04-21T12:14:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:37 smithi170 ceph-mon[31212]: pgmap v3608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6588.385591 secs 2024-04-21T12:14:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:37 smithi077 ceph-mon[27902]: pgmap v3608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6588.385591 secs 2024-04-21T12:14:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:39 smithi191 ceph-mon[31636]: pgmap v3609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6590.146638 secs 2024-04-21T12:14:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:39 smithi170 ceph-mon[31212]: pgmap v3609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6590.146638 secs 2024-04-21T12:14:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:39 smithi077 ceph-mon[27902]: pgmap v3609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6590.146638 secs 2024-04-21T12:14:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:41 smithi191 ceph-mon[31636]: pgmap v3610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:41 smithi170 ceph-mon[31212]: pgmap v3610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:41 smithi077 ceph-mon[27902]: pgmap v3610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6593.385708 secs 2024-04-21T12:14:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6593.385708 secs 2024-04-21T12:14:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6593.385708 secs 2024-04-21T12:14:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:43 smithi191 ceph-mon[31636]: pgmap v3611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:43 smithi170 ceph-mon[31212]: pgmap v3611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:43 smithi077 ceph-mon[27902]: pgmap v3611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6595.146757 secs 2024-04-21T12:14:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6595.146757 secs 2024-04-21T12:14:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6595.146757 secs 2024-04-21T12:14:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:45 smithi191 ceph-mon[31636]: pgmap v3612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:45 smithi170 ceph-mon[31212]: pgmap v3612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:45 smithi077 ceph-mon[27902]: pgmap v3612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:14:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:47 smithi170 ceph-mon[31212]: pgmap v3613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6598.385808 secs 2024-04-21T12:14:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:47 smithi077 ceph-mon[27902]: pgmap v3613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6598.385808 secs 2024-04-21T12:14:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:47 smithi191 ceph-mon[31636]: pgmap v3613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6598.385808 secs 2024-04-21T12:14:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:49 smithi170 ceph-mon[31212]: pgmap v3614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6600.146846 secs 2024-04-21T12:14:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:49 smithi077 ceph-mon[27902]: pgmap v3614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6600.146846 secs 2024-04-21T12:14:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:49 smithi191 ceph-mon[31636]: pgmap v3614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6600.146846 secs 2024-04-21T12:14:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:51 smithi170 ceph-mon[31212]: pgmap v3615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:14:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:51 smithi077 ceph-mon[27902]: pgmap v3615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:14:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:51 smithi191 ceph-mon[31636]: pgmap v3615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:14:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6603.385882 secs 2024-04-21T12:14:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: pgmap v3616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:14:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:14:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6603.385882 secs 2024-04-21T12:14:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: pgmap v3616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:14:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:14:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6603.385882 secs 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: pgmap v3616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:14:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:14:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:14:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6605.146971 secs 2024-04-21T12:14:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:55 smithi077 ceph-mon[27902]: pgmap v3617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6605.146971 secs 2024-04-21T12:14:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:55 smithi191 ceph-mon[31636]: pgmap v3617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6605.146971 secs 2024-04-21T12:14:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:55 smithi170 ceph-mon[31212]: pgmap v3617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:57 smithi077 ceph-mon[27902]: pgmap v3618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:57 smithi191 ceph-mon[31636]: pgmap v3618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:57 smithi170 ceph-mon[31212]: pgmap v3618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:14:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6608.385996 secs 2024-04-21T12:14:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6608.385996 secs 2024-04-21T12:14:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6608.385996 secs 2024-04-21T12:14:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:14:59 smithi077 ceph-mon[27902]: pgmap v3619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:14:59 smithi191 ceph-mon[31636]: pgmap v3619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:14:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:14:59 smithi170 ceph-mon[31212]: pgmap v3619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6610.147059 secs 2024-04-21T12:15:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6610.147059 secs 2024-04-21T12:15:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6610.147059 secs 2024-04-21T12:15:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:01 smithi077 ceph-mon[27902]: pgmap v3620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:01 smithi191 ceph-mon[31636]: pgmap v3620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:01 smithi170 ceph-mon[31212]: pgmap v3620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6613.386115 secs 2024-04-21T12:15:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:03 smithi077 ceph-mon[27902]: pgmap v3621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:15:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6613.386115 secs 2024-04-21T12:15:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:03 smithi191 ceph-mon[31636]: pgmap v3621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:15:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6613.386115 secs 2024-04-21T12:15:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:03 smithi170 ceph-mon[31212]: pgmap v3621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:15:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6615.147145 secs 2024-04-21T12:15:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:05 smithi077 ceph-mon[27902]: pgmap v3622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:15:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:05 smithi077 ceph-mon[27902]: osdmap e299: 12 total, 12 up, 12 in 2024-04-21T12:15:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6615.147145 secs 2024-04-21T12:15:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:05 smithi191 ceph-mon[31636]: pgmap v3622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:15:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:05 smithi191 ceph-mon[31636]: osdmap e299: 12 total, 12 up, 12 in 2024-04-21T12:15:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6615.147145 secs 2024-04-21T12:15:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:05 smithi170 ceph-mon[31212]: pgmap v3622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:15:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:05 smithi170 ceph-mon[31212]: osdmap e299: 12 total, 12 up, 12 in 2024-04-21T12:15:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:07 smithi077 ceph-mon[27902]: pgmap v3624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:15:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:07 smithi191 ceph-mon[31636]: pgmap v3624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:15:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:07 smithi170 ceph-mon[31212]: pgmap v3624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:15:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6618.386229 secs 2024-04-21T12:15:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:08 smithi077 ceph-mon[27902]: osdmap e300: 12 total, 12 up, 12 in 2024-04-21T12:15:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6618.386229 secs 2024-04-21T12:15:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:08 smithi191 ceph-mon[31636]: osdmap e300: 12 total, 12 up, 12 in 2024-04-21T12:15:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6618.386229 secs 2024-04-21T12:15:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:08 smithi170 ceph-mon[31212]: osdmap e300: 12 total, 12 up, 12 in 2024-04-21T12:15:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:09 smithi170 ceph-mon[31212]: pgmap v3626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:15:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6620.147268 secs 2024-04-21T12:15:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:09 smithi077 ceph-mon[27902]: pgmap v3626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:15:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6620.147268 secs 2024-04-21T12:15:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:09 smithi191 ceph-mon[31636]: pgmap v3626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:15:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6620.147268 secs 2024-04-21T12:15:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:11.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:11 smithi077 ceph-mon[27902]: pgmap v3627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:15:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:11 smithi191 ceph-mon[31636]: pgmap v3627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:15:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:11 smithi170 ceph-mon[31212]: pgmap v3627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:15:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6623.386343 secs 2024-04-21T12:15:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6623.386343 secs 2024-04-21T12:15:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6623.386343 secs 2024-04-21T12:15:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:13 smithi077 ceph-mon[27902]: pgmap v3628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:15:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:13 smithi191 ceph-mon[31636]: pgmap v3628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:15:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:13 smithi170 ceph-mon[31212]: pgmap v3628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:15:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6625.147413 secs 2024-04-21T12:15:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6625.147413 secs 2024-04-21T12:15:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6625.147413 secs 2024-04-21T12:15:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:15 smithi077 ceph-mon[27902]: pgmap v3629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:15:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:15 smithi191 ceph-mon[31636]: pgmap v3629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:15:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:15 smithi170 ceph-mon[31212]: pgmap v3629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:15:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:17 smithi077 ceph-mon[27902]: pgmap v3630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:15:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6628.386437 secs 2024-04-21T12:15:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:17 smithi191 ceph-mon[31636]: pgmap v3630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:15:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6628.386437 secs 2024-04-21T12:15:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:17 smithi170 ceph-mon[31212]: pgmap v3630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:15:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6628.386437 secs 2024-04-21T12:15:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:19 smithi077 ceph-mon[27902]: pgmap v3631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:15:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6630.147506 secs 2024-04-21T12:15:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:19 smithi191 ceph-mon[31636]: pgmap v3631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:15:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6630.147506 secs 2024-04-21T12:15:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:19 smithi170 ceph-mon[31212]: pgmap v3631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:15:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6630.147506 secs 2024-04-21T12:15:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:21 smithi077 ceph-mon[27902]: pgmap v3632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:15:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:21 smithi191 ceph-mon[31636]: pgmap v3632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:15:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:21 smithi170 ceph-mon[31212]: pgmap v3632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:15:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6633.386550 secs 2024-04-21T12:15:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6633.386550 secs 2024-04-21T12:15:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6633.386550 secs 2024-04-21T12:15:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:23 smithi077 ceph-mon[27902]: pgmap v3633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:15:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:23 smithi191 ceph-mon[31636]: pgmap v3633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:15:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:23 smithi170 ceph-mon[31212]: pgmap v3633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:15:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6635.147646 secs 2024-04-21T12:15:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6635.147646 secs 2024-04-21T12:15:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6635.147646 secs 2024-04-21T12:15:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:25 smithi077 ceph-mon[27902]: pgmap v3634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:25 smithi191 ceph-mon[31636]: pgmap v3634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:25 smithi170 ceph-mon[31212]: pgmap v3634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:27 smithi077 ceph-mon[27902]: pgmap v3635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6638.386663 secs 2024-04-21T12:15:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:27 smithi191 ceph-mon[31636]: pgmap v3635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6638.386663 secs 2024-04-21T12:15:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:27 smithi170 ceph-mon[31212]: pgmap v3635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6638.386663 secs 2024-04-21T12:15:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:29 smithi077 ceph-mon[27902]: pgmap v3636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6640.147785 secs 2024-04-21T12:15:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:29 smithi191 ceph-mon[31636]: pgmap v3636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6640.147785 secs 2024-04-21T12:15:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:29 smithi170 ceph-mon[31212]: pgmap v3636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6640.147785 secs 2024-04-21T12:15:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:31 smithi077 ceph-mon[27902]: pgmap v3637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:31 smithi191 ceph-mon[31636]: pgmap v3637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:31 smithi170 ceph-mon[31212]: pgmap v3637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6643.386780 secs 2024-04-21T12:15:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6643.386780 secs 2024-04-21T12:15:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6643.386780 secs 2024-04-21T12:15:33.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:33 smithi077 ceph-mon[27902]: pgmap v3638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:33 smithi191 ceph-mon[31636]: pgmap v3638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:33 smithi170 ceph-mon[31212]: pgmap v3638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6645.147884 secs 2024-04-21T12:15:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6645.147884 secs 2024-04-21T12:15:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6645.147884 secs 2024-04-21T12:15:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:35 smithi077 ceph-mon[27902]: pgmap v3639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:35 smithi191 ceph-mon[31636]: pgmap v3639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:35 smithi170 ceph-mon[31212]: pgmap v3639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:37 smithi077 ceph-mon[27902]: pgmap v3640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6648.386885 secs 2024-04-21T12:15:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:37 smithi191 ceph-mon[31636]: pgmap v3640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6648.386885 secs 2024-04-21T12:15:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:37 smithi170 ceph-mon[31212]: pgmap v3640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6648.386885 secs 2024-04-21T12:15:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:39 smithi077 ceph-mon[27902]: pgmap v3641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6650.148006 secs 2024-04-21T12:15:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:39 smithi191 ceph-mon[31636]: pgmap v3641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6650.148006 secs 2024-04-21T12:15:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:39 smithi170 ceph-mon[31212]: pgmap v3641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6650.148006 secs 2024-04-21T12:15:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:41 smithi077 ceph-mon[27902]: pgmap v3642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:41 smithi191 ceph-mon[31636]: pgmap v3642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:41 smithi170 ceph-mon[31212]: pgmap v3642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6653.386949 secs 2024-04-21T12:15:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6653.386949 secs 2024-04-21T12:15:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6653.386949 secs 2024-04-21T12:15:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:43 smithi191 ceph-mon[31636]: pgmap v3643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:43 smithi170 ceph-mon[31212]: pgmap v3643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:43 smithi077 ceph-mon[27902]: pgmap v3643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6655.148133 secs 2024-04-21T12:15:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6655.148133 secs 2024-04-21T12:15:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6655.148133 secs 2024-04-21T12:15:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:45 smithi191 ceph-mon[31636]: pgmap v3644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:45 smithi170 ceph-mon[31212]: pgmap v3644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:45 smithi077 ceph-mon[27902]: pgmap v3644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:47 smithi191 ceph-mon[31636]: pgmap v3645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6658.387063 secs 2024-04-21T12:15:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:47 smithi170 ceph-mon[31212]: pgmap v3645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6658.387063 secs 2024-04-21T12:15:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:47 smithi077 ceph-mon[27902]: pgmap v3645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:15:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6658.387063 secs 2024-04-21T12:15:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:49 smithi191 ceph-mon[31636]: pgmap v3646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6660.148261 secs 2024-04-21T12:15:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:49 smithi170 ceph-mon[31212]: pgmap v3646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6660.148261 secs 2024-04-21T12:15:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:49 smithi077 ceph-mon[27902]: pgmap v3646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6660.148261 secs 2024-04-21T12:15:51.937 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:51 smithi077 ceph-mon[27902]: pgmap v3647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:51 smithi191 ceph-mon[31636]: pgmap v3647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:51 smithi170 ceph-mon[31212]: pgmap v3647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:15:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6663.387180 secs 2024-04-21T12:15:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6663.387180 secs 2024-04-21T12:15:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6663.387180 secs 2024-04-21T12:15:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:53 smithi191 ceph-mon[31636]: pgmap v3648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:15:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:15:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:53 smithi170 ceph-mon[31212]: pgmap v3648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:53 smithi077 ceph-mon[27902]: pgmap v3648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:15:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:15:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6665.148323 secs 2024-04-21T12:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6665.148323 secs 2024-04-21T12:15:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:15:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:15:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:15:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6665.148323 secs 2024-04-21T12:15:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:15:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:15:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:15:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:55 smithi191 ceph-mon[31636]: pgmap v3649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:15:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:55 smithi170 ceph-mon[31212]: pgmap v3649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:15:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:55 smithi077 ceph-mon[27902]: pgmap v3649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:15:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:57 smithi191 ceph-mon[31636]: pgmap v3650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:15:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6668.387296 secs 2024-04-21T12:15:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:57 smithi170 ceph-mon[31212]: pgmap v3650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:15:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6668.387296 secs 2024-04-21T12:15:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:57 smithi077 ceph-mon[27902]: pgmap v3650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:15:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6668.387296 secs 2024-04-21T12:15:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:59 smithi191 ceph-mon[31636]: pgmap v3651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:15:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6670.148455 secs 2024-04-21T12:16:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:59 smithi170 ceph-mon[31212]: pgmap v3651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:16:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6670.148455 secs 2024-04-21T12:16:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:59 smithi077 ceph-mon[27902]: pgmap v3651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:16:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6670.148455 secs 2024-04-21T12:16:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:01 smithi191 ceph-mon[31636]: pgmap v3652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:16:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:01 smithi170 ceph-mon[31212]: pgmap v3652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:16:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:01 smithi077 ceph-mon[27902]: pgmap v3652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:16:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6673.387404 secs 2024-04-21T12:16:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6673.387404 secs 2024-04-21T12:16:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6673.387404 secs 2024-04-21T12:16:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:03 smithi191 ceph-mon[31636]: pgmap v3653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:16:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:03 smithi170 ceph-mon[31212]: pgmap v3653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:16:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:03 smithi077 ceph-mon[27902]: pgmap v3653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:16:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6675.148569 secs 2024-04-21T12:16:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:04 smithi191 ceph-mon[31636]: osdmap e301: 12 total, 12 up, 12 in 2024-04-21T12:16:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6675.148569 secs 2024-04-21T12:16:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:04 smithi170 ceph-mon[31212]: osdmap e301: 12 total, 12 up, 12 in 2024-04-21T12:16:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6675.148569 secs 2024-04-21T12:16:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:04 smithi077 ceph-mon[27902]: osdmap e301: 12 total, 12 up, 12 in 2024-04-21T12:16:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:05 smithi191 ceph-mon[31636]: pgmap v3655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:16:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:05 smithi170 ceph-mon[31212]: pgmap v3655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:16:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:05 smithi077 ceph-mon[27902]: pgmap v3655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:16:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:07 smithi191 ceph-mon[31636]: pgmap v3656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:16:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6678.387553 secs 2024-04-21T12:16:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:07 smithi191 ceph-mon[31636]: osdmap e302: 12 total, 12 up, 12 in 2024-04-21T12:16:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:07 smithi170 ceph-mon[31212]: pgmap v3656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:16:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6678.387553 secs 2024-04-21T12:16:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:07 smithi170 ceph-mon[31212]: osdmap e302: 12 total, 12 up, 12 in 2024-04-21T12:16:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:07 smithi077 ceph-mon[27902]: pgmap v3656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:16:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6678.387553 secs 2024-04-21T12:16:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:07 smithi077 ceph-mon[27902]: osdmap e302: 12 total, 12 up, 12 in 2024-04-21T12:16:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:09 smithi191 ceph-mon[31636]: pgmap v3658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:16:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6680.148631 secs 2024-04-21T12:16:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:09 smithi170 ceph-mon[31212]: pgmap v3658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:16:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6680.148631 secs 2024-04-21T12:16:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:09 smithi077 ceph-mon[27902]: pgmap v3658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:16:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6680.148631 secs 2024-04-21T12:16:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:10.266+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:16:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:10.266+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:16:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:10.267+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:16:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:10.267+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:16:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:11 smithi191 ceph-mon[31636]: pgmap v3659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:16:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:11 smithi170 ceph-mon[31212]: pgmap v3659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:16:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:11 smithi077 ceph-mon[27902]: pgmap v3659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:16:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6683.387653 secs 2024-04-21T12:16:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6683.387653 secs 2024-04-21T12:16:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6683.387653 secs 2024-04-21T12:16:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:13 smithi170 ceph-mon[31212]: pgmap v3660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:16:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:13 smithi077 ceph-mon[27902]: pgmap v3660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:16:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:13 smithi191 ceph-mon[31636]: pgmap v3660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:16:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6685.148752 secs 2024-04-21T12:16:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6685.148752 secs 2024-04-21T12:16:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6685.148752 secs 2024-04-21T12:16:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:15 smithi170 ceph-mon[31212]: pgmap v3661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:16:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:15 smithi077 ceph-mon[27902]: pgmap v3661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:16:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:15 smithi191 ceph-mon[31636]: pgmap v3661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:16:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:17 smithi170 ceph-mon[31212]: pgmap v3662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:16:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6688.387786 secs 2024-04-21T12:16:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:17 smithi077 ceph-mon[27902]: pgmap v3662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:16:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6688.387786 secs 2024-04-21T12:16:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:17 smithi191 ceph-mon[31636]: pgmap v3662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:16:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6688.387786 secs 2024-04-21T12:16:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:19 smithi170 ceph-mon[31212]: pgmap v3663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:16:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6690.148897 secs 2024-04-21T12:16:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:19 smithi077 ceph-mon[27902]: pgmap v3663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:16:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6690.148897 secs 2024-04-21T12:16:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:19 smithi191 ceph-mon[31636]: pgmap v3663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:16:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6690.148897 secs 2024-04-21T12:16:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:21 smithi170 ceph-mon[31212]: pgmap v3664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:16:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:21 smithi077 ceph-mon[27902]: pgmap v3664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:16:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:21 smithi191 ceph-mon[31636]: pgmap v3664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:16:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6693.387895 secs 2024-04-21T12:16:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6693.387895 secs 2024-04-21T12:16:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6693.387895 secs 2024-04-21T12:16:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:23 smithi170 ceph-mon[31212]: pgmap v3665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:16:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:23 smithi077 ceph-mon[27902]: pgmap v3665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:16:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:23 smithi191 ceph-mon[31636]: pgmap v3665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:16:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6695.148995 secs 2024-04-21T12:16:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6695.148995 secs 2024-04-21T12:16:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6695.148995 secs 2024-04-21T12:16:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:25 smithi170 ceph-mon[31212]: pgmap v3666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:25 smithi077 ceph-mon[27902]: pgmap v3666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:25 smithi191 ceph-mon[31636]: pgmap v3666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:27 smithi170 ceph-mon[31212]: pgmap v3667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6698.388008 secs 2024-04-21T12:16:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:27 smithi077 ceph-mon[27902]: pgmap v3667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6698.388008 secs 2024-04-21T12:16:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:27 smithi191 ceph-mon[31636]: pgmap v3667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6698.388008 secs 2024-04-21T12:16:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:29 smithi170 ceph-mon[31212]: pgmap v3668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6700.149117 secs 2024-04-21T12:16:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:29 smithi077 ceph-mon[27902]: pgmap v3668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6700.149117 secs 2024-04-21T12:16:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:29 smithi191 ceph-mon[31636]: pgmap v3668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6700.149117 secs 2024-04-21T12:16:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:31 smithi170 ceph-mon[31212]: pgmap v3669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:31 smithi077 ceph-mon[27902]: pgmap v3669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:31 smithi191 ceph-mon[31636]: pgmap v3669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6703.388121 secs 2024-04-21T12:16:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6703.388121 secs 2024-04-21T12:16:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6703.388121 secs 2024-04-21T12:16:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:33 smithi170 ceph-mon[31212]: pgmap v3670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:33 smithi077 ceph-mon[27902]: pgmap v3670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:33 smithi191 ceph-mon[31636]: pgmap v3670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6705.149210 secs 2024-04-21T12:16:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6705.149210 secs 2024-04-21T12:16:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6705.149210 secs 2024-04-21T12:16:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:35 smithi170 ceph-mon[31212]: pgmap v3671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:35 smithi077 ceph-mon[27902]: pgmap v3671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:35 smithi191 ceph-mon[31636]: pgmap v3671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:37 smithi170 ceph-mon[31212]: pgmap v3672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6708.388237 secs 2024-04-21T12:16:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:37 smithi077 ceph-mon[27902]: pgmap v3672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6708.388237 secs 2024-04-21T12:16:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:37 smithi191 ceph-mon[31636]: pgmap v3672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6708.388237 secs 2024-04-21T12:16:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:39 smithi170 ceph-mon[31212]: pgmap v3673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6710.149311 secs 2024-04-21T12:16:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:39 smithi077 ceph-mon[27902]: pgmap v3673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6710.149311 secs 2024-04-21T12:16:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:39 smithi191 ceph-mon[31636]: pgmap v3673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6710.149311 secs 2024-04-21T12:16:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:41 smithi170 ceph-mon[31212]: pgmap v3674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:41 smithi077 ceph-mon[27902]: pgmap v3674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:41 smithi191 ceph-mon[31636]: pgmap v3674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6713.388355 secs 2024-04-21T12:16:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6713.388355 secs 2024-04-21T12:16:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6713.388355 secs 2024-04-21T12:16:44.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:43 smithi170 ceph-mon[31212]: pgmap v3675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:43 smithi077 ceph-mon[27902]: pgmap v3675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:43 smithi191 ceph-mon[31636]: pgmap v3675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6715.149437 secs 2024-04-21T12:16:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6715.149437 secs 2024-04-21T12:16:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6715.149437 secs 2024-04-21T12:16:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:45 smithi077 ceph-mon[27902]: pgmap v3676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:45 smithi191 ceph-mon[31636]: pgmap v3676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:45 smithi170 ceph-mon[31212]: pgmap v3676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:47 smithi077 ceph-mon[27902]: pgmap v3677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6718.388443 secs 2024-04-21T12:16:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:47 smithi191 ceph-mon[31636]: pgmap v3677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6718.388443 secs 2024-04-21T12:16:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:47 smithi170 ceph-mon[31212]: pgmap v3677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6718.388443 secs 2024-04-21T12:16:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:49 smithi077 ceph-mon[27902]: pgmap v3678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6720.149513 secs 2024-04-21T12:16:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:49 smithi191 ceph-mon[31636]: pgmap v3678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6720.149513 secs 2024-04-21T12:16:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:49 smithi170 ceph-mon[31212]: pgmap v3678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6720.149513 secs 2024-04-21T12:16:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:51 smithi077 ceph-mon[27902]: pgmap v3679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:51 smithi191 ceph-mon[31636]: pgmap v3679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:51 smithi170 ceph-mon[31212]: pgmap v3679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6723.388582 secs 2024-04-21T12:16:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6723.388582 secs 2024-04-21T12:16:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6723.388582 secs 2024-04-21T12:16:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:53 smithi077 ceph-mon[27902]: pgmap v3680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:53 smithi191 ceph-mon[31636]: pgmap v3680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:53 smithi170 ceph-mon[31212]: pgmap v3680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:16:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6725.149584 secs 2024-04-21T12:16:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:16:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6725.149584 secs 2024-04-21T12:16:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:16:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:55.274+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:16:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:55.274+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:16:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:55.274+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:16:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:16:55.274+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:16:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6725.149584 secs 2024-04-21T12:16:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:16:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:55 smithi077 ceph-mon[27902]: pgmap v3681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:16:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:16:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:16:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:55 smithi191 ceph-mon[31636]: pgmap v3681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:16:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:16:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:16:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:55 smithi170 ceph-mon[31212]: pgmap v3681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:16:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:16:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:16:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:16:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:57 smithi077 ceph-mon[27902]: pgmap v3682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6728.388679 secs 2024-04-21T12:16:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:57 smithi191 ceph-mon[31636]: pgmap v3682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6728.388679 secs 2024-04-21T12:16:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:57 smithi170 ceph-mon[31212]: pgmap v3682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:16:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6728.388679 secs 2024-04-21T12:17:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:59 smithi077 ceph-mon[27902]: pgmap v3683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6730.149704 secs 2024-04-21T12:17:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:59 smithi191 ceph-mon[31636]: pgmap v3683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6730.149704 secs 2024-04-21T12:17:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:59 smithi170 ceph-mon[31212]: pgmap v3683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6730.149704 secs 2024-04-21T12:17:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:01 smithi077 ceph-mon[27902]: pgmap v3684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:01 smithi191 ceph-mon[31636]: pgmap v3684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:01 smithi170 ceph-mon[31212]: pgmap v3684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6733.388827 secs 2024-04-21T12:17:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6733.388827 secs 2024-04-21T12:17:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6733.388827 secs 2024-04-21T12:17:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:03 smithi077 ceph-mon[27902]: pgmap v3685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:03 smithi191 ceph-mon[31636]: pgmap v3685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:03 smithi170 ceph-mon[31212]: pgmap v3685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6735.149829 secs 2024-04-21T12:17:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:04 smithi077 ceph-mon[27902]: osdmap e303: 12 total, 12 up, 12 in 2024-04-21T12:17:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6735.149829 secs 2024-04-21T12:17:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:04 smithi191 ceph-mon[31636]: osdmap e303: 12 total, 12 up, 12 in 2024-04-21T12:17:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6735.149829 secs 2024-04-21T12:17:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:04 smithi170 ceph-mon[31212]: osdmap e303: 12 total, 12 up, 12 in 2024-04-21T12:17:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:05 smithi077 ceph-mon[27902]: pgmap v3687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:17:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:05 smithi191 ceph-mon[31636]: pgmap v3687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:17:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:05 smithi170 ceph-mon[31212]: pgmap v3687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:17:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:07 smithi077 ceph-mon[27902]: pgmap v3688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:17:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6738.388917 secs 2024-04-21T12:17:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:07 smithi077 ceph-mon[27902]: osdmap e304: 12 total, 12 up, 12 in 2024-04-21T12:17:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:07 smithi191 ceph-mon[31636]: pgmap v3688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:17:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6738.388917 secs 2024-04-21T12:17:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:07 smithi191 ceph-mon[31636]: osdmap e304: 12 total, 12 up, 12 in 2024-04-21T12:17:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:07 smithi170 ceph-mon[31212]: pgmap v3688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:17:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6738.388917 secs 2024-04-21T12:17:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:07 smithi170 ceph-mon[31212]: osdmap e304: 12 total, 12 up, 12 in 2024-04-21T12:17:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:09 smithi077 ceph-mon[27902]: pgmap v3690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:17:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6740.149954 secs 2024-04-21T12:17:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:09 smithi191 ceph-mon[31636]: pgmap v3690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:17:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6740.149954 secs 2024-04-21T12:17:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:09 smithi170 ceph-mon[31212]: pgmap v3690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:17:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6740.149954 secs 2024-04-21T12:17:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:11 smithi077 ceph-mon[27902]: pgmap v3691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:17:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:11 smithi191 ceph-mon[31636]: pgmap v3691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:17:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:11 smithi170 ceph-mon[31212]: pgmap v3691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:17:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6743.389037 secs 2024-04-21T12:17:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6743.389037 secs 2024-04-21T12:17:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6743.389037 secs 2024-04-21T12:17:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:13 smithi077 ceph-mon[27902]: pgmap v3692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:17:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:13 smithi191 ceph-mon[31636]: pgmap v3692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:17:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:13 smithi170 ceph-mon[31212]: pgmap v3692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:17:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6745.150078 secs 2024-04-21T12:17:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6745.150078 secs 2024-04-21T12:17:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6745.150078 secs 2024-04-21T12:17:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:15 smithi077 ceph-mon[27902]: pgmap v3693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:17:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:15 smithi191 ceph-mon[31636]: pgmap v3693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:17:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:15 smithi170 ceph-mon[31212]: pgmap v3693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:17:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:17 smithi191 ceph-mon[31636]: pgmap v3694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:17:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6748.389108 secs 2024-04-21T12:17:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:17 smithi170 ceph-mon[31212]: pgmap v3694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:17:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6748.389108 secs 2024-04-21T12:17:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:17 smithi077 ceph-mon[27902]: pgmap v3694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:17:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6748.389108 secs 2024-04-21T12:17:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:19 smithi191 ceph-mon[31636]: pgmap v3695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:17:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6750.150204 secs 2024-04-21T12:17:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:19 smithi170 ceph-mon[31212]: pgmap v3695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:17:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6750.150204 secs 2024-04-21T12:17:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:19 smithi077 ceph-mon[27902]: pgmap v3695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:17:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6750.150204 secs 2024-04-21T12:17:22.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:21 smithi077 ceph-mon[27902]: pgmap v3696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:17:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:21 smithi191 ceph-mon[31636]: pgmap v3696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:17:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:21 smithi170 ceph-mon[31212]: pgmap v3696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:17:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6753.389220 secs 2024-04-21T12:17:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6753.389220 secs 2024-04-21T12:17:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6753.389220 secs 2024-04-21T12:17:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:23 smithi191 ceph-mon[31636]: pgmap v3697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:17:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:23 smithi170 ceph-mon[31212]: pgmap v3697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:17:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:23 smithi077 ceph-mon[27902]: pgmap v3697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:17:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6755.150267 secs 2024-04-21T12:17:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6755.150267 secs 2024-04-21T12:17:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6755.150267 secs 2024-04-21T12:17:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:25 smithi191 ceph-mon[31636]: pgmap v3698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:25 smithi170 ceph-mon[31212]: pgmap v3698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:25 smithi077 ceph-mon[27902]: pgmap v3698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:27 smithi191 ceph-mon[31636]: pgmap v3699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6758.389352 secs 2024-04-21T12:17:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:27 smithi170 ceph-mon[31212]: pgmap v3699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6758.389352 secs 2024-04-21T12:17:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:27 smithi077 ceph-mon[27902]: pgmap v3699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6758.389352 secs 2024-04-21T12:17:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:29 smithi191 ceph-mon[31636]: pgmap v3700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6760.150331 secs 2024-04-21T12:17:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:29 smithi170 ceph-mon[31212]: pgmap v3700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6760.150331 secs 2024-04-21T12:17:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:29 smithi077 ceph-mon[27902]: pgmap v3700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6760.150331 secs 2024-04-21T12:17:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:31 smithi191 ceph-mon[31636]: pgmap v3701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:31 smithi170 ceph-mon[31212]: pgmap v3701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:31 smithi077 ceph-mon[27902]: pgmap v3701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6763.389473 secs 2024-04-21T12:17:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6763.389473 secs 2024-04-21T12:17:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6763.389473 secs 2024-04-21T12:17:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:33 smithi191 ceph-mon[31636]: pgmap v3702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:33 smithi170 ceph-mon[31212]: pgmap v3702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:33 smithi077 ceph-mon[27902]: pgmap v3702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6765.150475 secs 2024-04-21T12:17:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6765.150475 secs 2024-04-21T12:17:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6765.150475 secs 2024-04-21T12:17:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:35 smithi191 ceph-mon[31636]: pgmap v3703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:35 smithi170 ceph-mon[31212]: pgmap v3703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:35 smithi077 ceph-mon[27902]: pgmap v3703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:37 smithi191 ceph-mon[31636]: pgmap v3704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6768.389598 secs 2024-04-21T12:17:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:37 smithi170 ceph-mon[31212]: pgmap v3704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6768.389598 secs 2024-04-21T12:17:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:37 smithi077 ceph-mon[27902]: pgmap v3704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6768.389598 secs 2024-04-21T12:17:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:39 smithi191 ceph-mon[31636]: pgmap v3705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6770.150535 secs 2024-04-21T12:17:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:39 smithi170 ceph-mon[31212]: pgmap v3705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6770.150535 secs 2024-04-21T12:17:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:39 smithi077 ceph-mon[27902]: pgmap v3705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6770.150535 secs 2024-04-21T12:17:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:41 smithi191 ceph-mon[31636]: pgmap v3706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:41 smithi170 ceph-mon[31212]: pgmap v3706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:41 smithi077 ceph-mon[27902]: pgmap v3706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6773.389681 secs 2024-04-21T12:17:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6773.389681 secs 2024-04-21T12:17:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6773.389681 secs 2024-04-21T12:17:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:43 smithi191 ceph-mon[31636]: pgmap v3707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:43 smithi170 ceph-mon[31212]: pgmap v3707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:43 smithi077 ceph-mon[27902]: pgmap v3707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6775.150650 secs 2024-04-21T12:17:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6775.150650 secs 2024-04-21T12:17:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6775.150650 secs 2024-04-21T12:17:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:45 smithi191 ceph-mon[31636]: pgmap v3708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:45 smithi170 ceph-mon[31212]: pgmap v3708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:45 smithi077 ceph-mon[27902]: pgmap v3708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:47 smithi191 ceph-mon[31636]: pgmap v3709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6778.389803 secs 2024-04-21T12:17:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:47 smithi170 ceph-mon[31212]: pgmap v3709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6778.389803 secs 2024-04-21T12:17:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:47 smithi077 ceph-mon[27902]: pgmap v3709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6778.389803 secs 2024-04-21T12:17:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:49 smithi191 ceph-mon[31636]: pgmap v3710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6780.150728 secs 2024-04-21T12:17:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:49 smithi170 ceph-mon[31212]: pgmap v3710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6780.150728 secs 2024-04-21T12:17:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:49 smithi077 ceph-mon[27902]: pgmap v3710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6780.150728 secs 2024-04-21T12:17:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:51 smithi191 ceph-mon[31636]: pgmap v3711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:51 smithi170 ceph-mon[31212]: pgmap v3711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:51 smithi077 ceph-mon[27902]: pgmap v3711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6783.389920 secs 2024-04-21T12:17:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6783.389920 secs 2024-04-21T12:17:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6783.389920 secs 2024-04-21T12:17:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:53 smithi170 ceph-mon[31212]: pgmap v3712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:53 smithi077 ceph-mon[27902]: pgmap v3712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:53 smithi191 ceph-mon[31636]: pgmap v3712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:17:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6785.150846 secs 2024-04-21T12:17:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6785.150846 secs 2024-04-21T12:17:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6785.150846 secs 2024-04-21T12:17:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:55 smithi170 ceph-mon[31212]: pgmap v3713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:17:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:17:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:17:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:17:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:55 smithi077 ceph-mon[27902]: pgmap v3713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:17:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:17:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:17:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:17:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:55 smithi191 ceph-mon[31636]: pgmap v3713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:17:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:17:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:17:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:17:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:17:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:57 smithi170 ceph-mon[31212]: pgmap v3714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6788.389985 secs 2024-04-21T12:17:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:57 smithi077 ceph-mon[27902]: pgmap v3714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6788.389985 secs 2024-04-21T12:17:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:57 smithi191 ceph-mon[31636]: pgmap v3714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:17:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6788.389985 secs 2024-04-21T12:18:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:59 smithi170 ceph-mon[31212]: pgmap v3715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6790.150931 secs 2024-04-21T12:18:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:59 smithi077 ceph-mon[27902]: pgmap v3715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6790.150931 secs 2024-04-21T12:18:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:59 smithi191 ceph-mon[31636]: pgmap v3715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6790.150931 secs 2024-04-21T12:18:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:01 smithi170 ceph-mon[31212]: pgmap v3716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:01 smithi077 ceph-mon[27902]: pgmap v3716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:01 smithi191 ceph-mon[31636]: pgmap v3716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6793.390122 secs 2024-04-21T12:18:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6793.390122 secs 2024-04-21T12:18:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6793.390122 secs 2024-04-21T12:18:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:04 smithi170 ceph-mon[31212]: pgmap v3717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:04 smithi077 ceph-mon[27902]: pgmap v3717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:04 smithi191 ceph-mon[31636]: pgmap v3717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6795.151054 secs 2024-04-21T12:18:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:05 smithi170 ceph-mon[31212]: osdmap e305: 12 total, 12 up, 12 in 2024-04-21T12:18:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6795.151054 secs 2024-04-21T12:18:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:05 smithi077 ceph-mon[27902]: osdmap e305: 12 total, 12 up, 12 in 2024-04-21T12:18:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6795.151054 secs 2024-04-21T12:18:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:05 smithi191 ceph-mon[31636]: osdmap e305: 12 total, 12 up, 12 in 2024-04-21T12:18:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:06 smithi170 ceph-mon[31212]: pgmap v3719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:18:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:06 smithi077 ceph-mon[27902]: pgmap v3719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:18:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:06 smithi191 ceph-mon[31636]: pgmap v3719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:18:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:08 smithi170 ceph-mon[31212]: pgmap v3720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:18:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6798.390236 secs 2024-04-21T12:18:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:08 smithi170 ceph-mon[31212]: osdmap e306: 12 total, 12 up, 12 in 2024-04-21T12:18:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:08 smithi077 ceph-mon[27902]: pgmap v3720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:18:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6798.390236 secs 2024-04-21T12:18:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:08 smithi077 ceph-mon[27902]: osdmap e306: 12 total, 12 up, 12 in 2024-04-21T12:18:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:08 smithi191 ceph-mon[31636]: pgmap v3720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:18:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6798.390236 secs 2024-04-21T12:18:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:08 smithi191 ceph-mon[31636]: osdmap e306: 12 total, 12 up, 12 in 2024-04-21T12:18:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:10 smithi170 ceph-mon[31212]: pgmap v3722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:18:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6800.151191 secs 2024-04-21T12:18:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:10 smithi077 ceph-mon[27902]: pgmap v3722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:18:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6800.151191 secs 2024-04-21T12:18:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:10 smithi191 ceph-mon[31636]: pgmap v3722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:18:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6800.151191 secs 2024-04-21T12:18:12.270 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:12 smithi191 ceph-mon[31636]: pgmap v3723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:18:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:12 smithi170 ceph-mon[31212]: pgmap v3723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:18:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:12 smithi077 ceph-mon[27902]: pgmap v3723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:18:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6803.390356 secs 2024-04-21T12:18:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6803.390356 secs 2024-04-21T12:18:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6803.390356 secs 2024-04-21T12:18:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:14 smithi170 ceph-mon[31212]: pgmap v3724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T12:18:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:14 smithi077 ceph-mon[27902]: pgmap v3724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T12:18:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:14 smithi191 ceph-mon[31636]: pgmap v3724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T12:18:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6805.151260 secs 2024-04-21T12:18:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6805.151260 secs 2024-04-21T12:18:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6805.151260 secs 2024-04-21T12:18:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:16 smithi170 ceph-mon[31212]: pgmap v3725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:18:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:16 smithi077 ceph-mon[27902]: pgmap v3725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:18:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:16 smithi191 ceph-mon[31636]: pgmap v3725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:18:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:18 smithi170 ceph-mon[31212]: pgmap v3726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:18:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6808.390428 secs 2024-04-21T12:18:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:18 smithi077 ceph-mon[27902]: pgmap v3726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:18:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6808.390428 secs 2024-04-21T12:18:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:18 smithi191 ceph-mon[31636]: pgmap v3726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:18:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6808.390428 secs 2024-04-21T12:18:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 6995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:20 smithi170 ceph-mon[31212]: pgmap v3727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:18:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6810.151378 secs 2024-04-21T12:18:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:20 smithi077 ceph-mon[27902]: pgmap v3727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:18:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6810.151378 secs 2024-04-21T12:18:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:20 smithi191 ceph-mon[31636]: pgmap v3727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:18:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6810.151378 secs 2024-04-21T12:18:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:22 smithi170 ceph-mon[31212]: pgmap v3728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:18:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:22 smithi077 ceph-mon[27902]: pgmap v3728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:18:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:22 smithi191 ceph-mon[31636]: pgmap v3728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:18:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6813.390566 secs 2024-04-21T12:18:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6813.390566 secs 2024-04-21T12:18:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6813.390566 secs 2024-04-21T12:18:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:24 smithi170 ceph-mon[31212]: pgmap v3729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:18:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:24 smithi077 ceph-mon[27902]: pgmap v3729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:18:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:24 smithi191 ceph-mon[31636]: pgmap v3729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:18:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6815.151447 secs 2024-04-21T12:18:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6815.151447 secs 2024-04-21T12:18:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6815.151447 secs 2024-04-21T12:18:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:26 smithi077 ceph-mon[27902]: pgmap v3730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:26 smithi191 ceph-mon[31636]: pgmap v3730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:26 smithi170 ceph-mon[31212]: pgmap v3730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:28 smithi077 ceph-mon[27902]: pgmap v3731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6818.390680 secs 2024-04-21T12:18:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:28 smithi191 ceph-mon[31636]: pgmap v3731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6818.390680 secs 2024-04-21T12:18:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:28 smithi170 ceph-mon[31212]: pgmap v3731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6818.390680 secs 2024-04-21T12:18:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:30 smithi077 ceph-mon[27902]: pgmap v3732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6820.151544 secs 2024-04-21T12:18:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:30 smithi191 ceph-mon[31636]: pgmap v3732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6820.151544 secs 2024-04-21T12:18:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:30 smithi170 ceph-mon[31212]: pgmap v3732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6820.151544 secs 2024-04-21T12:18:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:32 smithi077 ceph-mon[27902]: pgmap v3733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:32 smithi191 ceph-mon[31636]: pgmap v3733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:32 smithi170 ceph-mon[31212]: pgmap v3733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6823.390797 secs 2024-04-21T12:18:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6823.390797 secs 2024-04-21T12:18:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6823.390797 secs 2024-04-21T12:18:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:34 smithi077 ceph-mon[27902]: pgmap v3734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:34 smithi191 ceph-mon[31636]: pgmap v3734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:34 smithi170 ceph-mon[31212]: pgmap v3734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6825.151637 secs 2024-04-21T12:18:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6825.151637 secs 2024-04-21T12:18:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6825.151637 secs 2024-04-21T12:18:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:36 smithi077 ceph-mon[27902]: pgmap v3735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:36 smithi191 ceph-mon[31636]: pgmap v3735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:36 smithi170 ceph-mon[31212]: pgmap v3735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:37 smithi077 ceph-mon[27902]: pgmap v3736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:37 smithi191 ceph-mon[31636]: pgmap v3736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:37 smithi170 ceph-mon[31212]: pgmap v3736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6828.390914 secs 2024-04-21T12:18:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6828.390914 secs 2024-04-21T12:18:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6828.390914 secs 2024-04-21T12:18:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:39 smithi077 ceph-mon[27902]: pgmap v3737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:39 smithi191 ceph-mon[31636]: pgmap v3737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:39 smithi170 ceph-mon[31212]: pgmap v3737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6830.151748 secs 2024-04-21T12:18:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6830.151748 secs 2024-04-21T12:18:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6830.151748 secs 2024-04-21T12:18:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:41 smithi077 ceph-mon[27902]: pgmap v3738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:41 smithi191 ceph-mon[31636]: pgmap v3738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:41 smithi170 ceph-mon[31212]: pgmap v3738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6833.391012 secs 2024-04-21T12:18:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:43 smithi191 ceph-mon[31636]: pgmap v3739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6833.391012 secs 2024-04-21T12:18:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:43 smithi170 ceph-mon[31212]: pgmap v3739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6833.391012 secs 2024-04-21T12:18:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:43 smithi077 ceph-mon[27902]: pgmap v3739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6835.151886 secs 2024-04-21T12:18:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6835.151886 secs 2024-04-21T12:18:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6835.151886 secs 2024-04-21T12:18:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:45 smithi191 ceph-mon[31636]: pgmap v3740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:45 smithi170 ceph-mon[31212]: pgmap v3740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:45 smithi077 ceph-mon[27902]: pgmap v3740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:47 smithi191 ceph-mon[31636]: pgmap v3741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:47 smithi170 ceph-mon[31212]: pgmap v3741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:47 smithi077 ceph-mon[27902]: pgmap v3741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6838.391126 secs 2024-04-21T12:18:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6838.391126 secs 2024-04-21T12:18:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6838.391126 secs 2024-04-21T12:18:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:49 smithi170 ceph-mon[31212]: pgmap v3742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6840.152039 secs 2024-04-21T12:18:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:49 smithi077 ceph-mon[27902]: pgmap v3742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6840.152039 secs 2024-04-21T12:18:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:49 smithi191 ceph-mon[31636]: pgmap v3742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6840.152039 secs 2024-04-21T12:18:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:51 smithi170 ceph-mon[31212]: pgmap v3743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:51 smithi077 ceph-mon[27902]: pgmap v3743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:51 smithi191 ceph-mon[31636]: pgmap v3743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6843.391261 secs 2024-04-21T12:18:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:53 smithi170 ceph-mon[31212]: pgmap v3744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6843.391261 secs 2024-04-21T12:18:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:53 smithi077 ceph-mon[27902]: pgmap v3744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6843.391261 secs 2024-04-21T12:18:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:53 smithi191 ceph-mon[31636]: pgmap v3744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6845.152107 secs 2024-04-21T12:18:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6845.152107 secs 2024-04-21T12:18:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6845.152107 secs 2024-04-21T12:18:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:18:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:55 smithi170 ceph-mon[31212]: pgmap v3745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:55 smithi077 ceph-mon[27902]: pgmap v3745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:55 smithi191 ceph-mon[31636]: pgmap v3745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:18:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:18:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:18:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:57 smithi170 ceph-mon[31212]: pgmap v3746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:18:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:18:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:18:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:57 smithi077 ceph-mon[27902]: pgmap v3746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:18:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:18:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:18:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:57 smithi191 ceph-mon[31636]: pgmap v3746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:18:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:18:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:18:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:18:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6848.391418 secs 2024-04-21T12:18:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6848.391418 secs 2024-04-21T12:18:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6848.391418 secs 2024-04-21T12:18:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:59 smithi170 ceph-mon[31212]: pgmap v3747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6850.152224 secs 2024-04-21T12:18:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:59 smithi077 ceph-mon[27902]: pgmap v3747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6850.152224 secs 2024-04-21T12:18:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:59 smithi191 ceph-mon[31636]: pgmap v3747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:18:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6850.152224 secs 2024-04-21T12:19:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:01 smithi170 ceph-mon[31212]: pgmap v3748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:01 smithi077 ceph-mon[27902]: pgmap v3748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:01 smithi191 ceph-mon[31636]: pgmap v3748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6853.391533 secs 2024-04-21T12:19:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:03 smithi170 ceph-mon[31212]: pgmap v3749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6853.391533 secs 2024-04-21T12:19:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:03 smithi077 ceph-mon[27902]: pgmap v3749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6853.391533 secs 2024-04-21T12:19:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:03 smithi191 ceph-mon[31636]: pgmap v3749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6855.152285 secs 2024-04-21T12:19:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6855.152285 secs 2024-04-21T12:19:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6855.152285 secs 2024-04-21T12:19:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:05 smithi170 ceph-mon[31212]: pgmap v3750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:05 smithi170 ceph-mon[31212]: osdmap e307: 12 total, 12 up, 12 in 2024-04-21T12:19:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:05 smithi077 ceph-mon[27902]: pgmap v3750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:05 smithi077 ceph-mon[27902]: osdmap e307: 12 total, 12 up, 12 in 2024-04-21T12:19:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:05 smithi191 ceph-mon[31636]: pgmap v3750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:05 smithi191 ceph-mon[31636]: osdmap e307: 12 total, 12 up, 12 in 2024-04-21T12:19:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:07 smithi170 ceph-mon[31212]: pgmap v3752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:19:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:07 smithi077 ceph-mon[27902]: pgmap v3752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:19:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:07 smithi191 ceph-mon[31636]: pgmap v3752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:19:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6858.391650 secs 2024-04-21T12:19:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:08 smithi170 ceph-mon[31212]: osdmap e308: 12 total, 12 up, 12 in 2024-04-21T12:19:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6858.391650 secs 2024-04-21T12:19:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:08 smithi077 ceph-mon[27902]: osdmap e308: 12 total, 12 up, 12 in 2024-04-21T12:19:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6858.391650 secs 2024-04-21T12:19:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:08 smithi191 ceph-mon[31636]: osdmap e308: 12 total, 12 up, 12 in 2024-04-21T12:19:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:09 smithi077 ceph-mon[27902]: pgmap v3754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:19:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6860.152422 secs 2024-04-21T12:19:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:09 smithi191 ceph-mon[31636]: pgmap v3754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:19:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6860.152422 secs 2024-04-21T12:19:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:09 smithi170 ceph-mon[31212]: pgmap v3754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:19:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6860.152422 secs 2024-04-21T12:19:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:11.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:11 smithi077 ceph-mon[27902]: pgmap v3755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:19:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:11 smithi191 ceph-mon[31636]: pgmap v3755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:19:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:11 smithi170 ceph-mon[31212]: pgmap v3755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:19:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6863.391773 secs 2024-04-21T12:19:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6863.391773 secs 2024-04-21T12:19:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6863.391773 secs 2024-04-21T12:19:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:13 smithi077 ceph-mon[27902]: pgmap v3756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:19:13.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:13 smithi170 ceph-mon[31212]: pgmap v3756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:19:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:13 smithi191 ceph-mon[31636]: pgmap v3756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:19:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6865.152544 secs 2024-04-21T12:19:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6865.152544 secs 2024-04-21T12:19:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6865.152544 secs 2024-04-21T12:19:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:15 smithi077 ceph-mon[27902]: pgmap v3757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:19:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:15 smithi191 ceph-mon[31636]: pgmap v3757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:19:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:15 smithi170 ceph-mon[31212]: pgmap v3757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T12:19:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:17 smithi077 ceph-mon[27902]: pgmap v3758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:19:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6868.391890 secs 2024-04-21T12:19:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:17 smithi191 ceph-mon[31636]: pgmap v3758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:19:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6868.391890 secs 2024-04-21T12:19:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:17 smithi170 ceph-mon[31212]: pgmap v3758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:19:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6868.391890 secs 2024-04-21T12:19:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:19 smithi191 ceph-mon[31636]: pgmap v3759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:19:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6870.152678 secs 2024-04-21T12:19:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:19 smithi170 ceph-mon[31212]: pgmap v3759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:19:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6870.152678 secs 2024-04-21T12:19:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:19 smithi077 ceph-mon[27902]: pgmap v3759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:19:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6870.152678 secs 2024-04-21T12:19:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:21 smithi191 ceph-mon[31636]: pgmap v3760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:19:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:21 smithi170 ceph-mon[31212]: pgmap v3760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:19:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:21 smithi077 ceph-mon[27902]: pgmap v3760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:19:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6873.392001 secs 2024-04-21T12:19:23.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6873.392001 secs 2024-04-21T12:19:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6873.392001 secs 2024-04-21T12:19:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:23 smithi191 ceph-mon[31636]: pgmap v3761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:19:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:23 smithi170 ceph-mon[31212]: pgmap v3761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:19:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:23 smithi077 ceph-mon[27902]: pgmap v3761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:19:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6875.152805 secs 2024-04-21T12:19:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6875.152805 secs 2024-04-21T12:19:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6875.152805 secs 2024-04-21T12:19:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:25 smithi191 ceph-mon[31636]: pgmap v3762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:25 smithi170 ceph-mon[31212]: pgmap v3762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:25 smithi077 ceph-mon[27902]: pgmap v3762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:27 smithi191 ceph-mon[31636]: pgmap v3763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6878.392137 secs 2024-04-21T12:19:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:27 smithi170 ceph-mon[31212]: pgmap v3763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6878.392137 secs 2024-04-21T12:19:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:27 smithi077 ceph-mon[27902]: pgmap v3763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6878.392137 secs 2024-04-21T12:19:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:29 smithi191 ceph-mon[31636]: pgmap v3764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6880.152947 secs 2024-04-21T12:19:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:29 smithi170 ceph-mon[31212]: pgmap v3764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6880.152947 secs 2024-04-21T12:19:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:29 smithi077 ceph-mon[27902]: pgmap v3764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6880.152947 secs 2024-04-21T12:19:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:31 smithi191 ceph-mon[31636]: pgmap v3765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:31 smithi170 ceph-mon[31212]: pgmap v3765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:31 smithi077 ceph-mon[27902]: pgmap v3765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6883.392217 secs 2024-04-21T12:19:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6883.392217 secs 2024-04-21T12:19:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6883.392217 secs 2024-04-21T12:19:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:33 smithi191 ceph-mon[31636]: pgmap v3766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:33 smithi170 ceph-mon[31212]: pgmap v3766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:33 smithi077 ceph-mon[27902]: pgmap v3766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6885.153072 secs 2024-04-21T12:19:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6885.153072 secs 2024-04-21T12:19:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6885.153072 secs 2024-04-21T12:19:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:35 smithi191 ceph-mon[31636]: pgmap v3767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:35 smithi170 ceph-mon[31212]: pgmap v3767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:35 smithi077 ceph-mon[27902]: pgmap v3767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:37 smithi191 ceph-mon[31636]: pgmap v3768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6888.392278 secs 2024-04-21T12:19:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:37 smithi170 ceph-mon[31212]: pgmap v3768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6888.392278 secs 2024-04-21T12:19:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:37 smithi077 ceph-mon[27902]: pgmap v3768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6888.392278 secs 2024-04-21T12:19:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:39 smithi191 ceph-mon[31636]: pgmap v3769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6890.153189 secs 2024-04-21T12:19:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:39 smithi170 ceph-mon[31212]: pgmap v3769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6890.153189 secs 2024-04-21T12:19:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:39 smithi077 ceph-mon[27902]: pgmap v3769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6890.153189 secs 2024-04-21T12:19:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:41 smithi191 ceph-mon[31636]: pgmap v3770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:41 smithi170 ceph-mon[31212]: pgmap v3770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:41 smithi077 ceph-mon[27902]: pgmap v3770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:42.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6893.392395 secs 2024-04-21T12:19:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6893.392395 secs 2024-04-21T12:19:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6893.392395 secs 2024-04-21T12:19:43.956 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:43 smithi170 ceph-mon[31212]: pgmap v3771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:43 smithi191 ceph-mon[31636]: pgmap v3771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:43 smithi077 ceph-mon[27902]: pgmap v3771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6895.153287 secs 2024-04-21T12:19:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6895.153287 secs 2024-04-21T12:19:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6895.153287 secs 2024-04-21T12:19:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:45 smithi191 ceph-mon[31636]: pgmap v3772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:45 smithi170 ceph-mon[31212]: pgmap v3772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:45 smithi077 ceph-mon[27902]: pgmap v3772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:47 smithi191 ceph-mon[31636]: pgmap v3773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6898.392528 secs 2024-04-21T12:19:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:47 smithi170 ceph-mon[31212]: pgmap v3773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6898.392528 secs 2024-04-21T12:19:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:47 smithi077 ceph-mon[27902]: pgmap v3773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6898.392528 secs 2024-04-21T12:19:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:49 smithi191 ceph-mon[31636]: pgmap v3774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6900.153391 secs 2024-04-21T12:19:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:49 smithi170 ceph-mon[31212]: pgmap v3774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6900.153391 secs 2024-04-21T12:19:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:49 smithi077 ceph-mon[27902]: pgmap v3774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6900.153391 secs 2024-04-21T12:19:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:51 smithi191 ceph-mon[31636]: pgmap v3775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:51 smithi170 ceph-mon[31212]: pgmap v3775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:51 smithi077 ceph-mon[27902]: pgmap v3775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6903.392647 secs 2024-04-21T12:19:53.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6903.392647 secs 2024-04-21T12:19:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6903.392647 secs 2024-04-21T12:19:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:53 smithi170 ceph-mon[31212]: pgmap v3776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:53 smithi077 ceph-mon[27902]: pgmap v3776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:53 smithi191 ceph-mon[31636]: pgmap v3776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6905.153510 secs 2024-04-21T12:19:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:19:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6905.153510 secs 2024-04-21T12:19:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6905.153510 secs 2024-04-21T12:19:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:19:55.298+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:19:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:19:55.298+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:19:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:19:55.298+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:19:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:19:55.298+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:19:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:55 smithi170 ceph-mon[31212]: pgmap v3777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:55 smithi077 ceph-mon[27902]: pgmap v3777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:55 smithi191 ceph-mon[31636]: pgmap v3777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:19:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:19:57.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:19:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:19:57.986 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:57 smithi077 ceph-mon[27902]: pgmap v3778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:57.986 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6908.392816 secs 2024-04-21T12:19:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:57 smithi170 ceph-mon[31212]: pgmap v3778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6908.392816 secs 2024-04-21T12:19:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:57 smithi191 ceph-mon[31636]: pgmap v3778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:19:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6908.392816 secs 2024-04-21T12:20:00.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:59 smithi077 ceph-mon[27902]: pgmap v3779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:00.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6910.153660 secs 2024-04-21T12:20:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:59 smithi170 ceph-mon[31212]: pgmap v3779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6910.153660 secs 2024-04-21T12:20:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:59 smithi191 ceph-mon[31636]: pgmap v3779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6910.153660 secs 2024-04-21T12:20:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:20:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:20:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:01 smithi170 ceph-mon[31212]: pgmap v3780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:20:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:01 smithi077 ceph-mon[27902]: pgmap v3780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:20:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:20:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:01 smithi191 ceph-mon[31636]: pgmap v3780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:20:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:20:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:20:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6913.392949 secs 2024-04-21T12:20:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6913.392949 secs 2024-04-21T12:20:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6913.392949 secs 2024-04-21T12:20:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:03 smithi077 ceph-mon[27902]: pgmap v3781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:03 smithi191 ceph-mon[31636]: pgmap v3781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:03 smithi170 ceph-mon[31212]: pgmap v3781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6915.153789 secs 2024-04-21T12:20:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:04 smithi077 ceph-mon[27902]: osdmap e309: 12 total, 12 up, 12 in 2024-04-21T12:20:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6915.153789 secs 2024-04-21T12:20:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:04 smithi191 ceph-mon[31636]: osdmap e309: 12 total, 12 up, 12 in 2024-04-21T12:20:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6915.153789 secs 2024-04-21T12:20:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:04 smithi170 ceph-mon[31212]: osdmap e309: 12 total, 12 up, 12 in 2024-04-21T12:20:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:05 smithi077 ceph-mon[27902]: pgmap v3783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:20:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:05 smithi191 ceph-mon[31636]: pgmap v3783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:20:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:05 smithi170 ceph-mon[31212]: pgmap v3783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:20:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:07 smithi077 ceph-mon[27902]: pgmap v3784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:20:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6918.393103 secs 2024-04-21T12:20:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:07 smithi077 ceph-mon[27902]: osdmap e310: 12 total, 12 up, 12 in 2024-04-21T12:20:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:07 smithi191 ceph-mon[31636]: pgmap v3784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:20:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6918.393103 secs 2024-04-21T12:20:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:07 smithi191 ceph-mon[31636]: osdmap e310: 12 total, 12 up, 12 in 2024-04-21T12:20:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:07 smithi170 ceph-mon[31212]: pgmap v3784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:20:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6918.393103 secs 2024-04-21T12:20:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:07 smithi170 ceph-mon[31212]: osdmap e310: 12 total, 12 up, 12 in 2024-04-21T12:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:09 smithi077 ceph-mon[27902]: pgmap v3786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:20:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6920.153916 secs 2024-04-21T12:20:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:09 smithi191 ceph-mon[31636]: pgmap v3786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:20:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6920.153916 secs 2024-04-21T12:20:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:09 smithi170 ceph-mon[31212]: pgmap v3786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:20:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6920.153916 secs 2024-04-21T12:20:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:11 smithi077 ceph-mon[27902]: pgmap v3787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:20:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:11 smithi191 ceph-mon[31636]: pgmap v3787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:20:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:11 smithi170 ceph-mon[31212]: pgmap v3787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:20:13.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6923.393225 secs 2024-04-21T12:20:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6923.393225 secs 2024-04-21T12:20:13.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6923.393225 secs 2024-04-21T12:20:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:13 smithi077 ceph-mon[27902]: pgmap v3788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:20:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:13 smithi191 ceph-mon[31636]: pgmap v3788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:20:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:13 smithi170 ceph-mon[31212]: pgmap v3788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:20:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6925.154043 secs 2024-04-21T12:20:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6925.154043 secs 2024-04-21T12:20:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6925.154043 secs 2024-04-21T12:20:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:15 smithi077 ceph-mon[27902]: pgmap v3789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:20:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:15 smithi191 ceph-mon[31636]: pgmap v3789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:20:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:15 smithi170 ceph-mon[31212]: pgmap v3789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:20:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:17 smithi077 ceph-mon[27902]: pgmap v3790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:20:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6928.393367 secs 2024-04-21T12:20:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:17 smithi191 ceph-mon[31636]: pgmap v3790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:20:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6928.393367 secs 2024-04-21T12:20:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:17 smithi170 ceph-mon[31212]: pgmap v3790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:20:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6928.393367 secs 2024-04-21T12:20:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:19 smithi077 ceph-mon[27902]: pgmap v3791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:20:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6930.154158 secs 2024-04-21T12:20:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:19 smithi191 ceph-mon[31636]: pgmap v3791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:20:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6930.154158 secs 2024-04-21T12:20:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:19 smithi170 ceph-mon[31212]: pgmap v3791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:20:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6930.154158 secs 2024-04-21T12:20:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:21 smithi077 ceph-mon[27902]: pgmap v3792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:20:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:21 smithi191 ceph-mon[31636]: pgmap v3792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:20:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:21 smithi170 ceph-mon[31212]: pgmap v3792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:20:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6933.393505 secs 2024-04-21T12:20:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6933.393505 secs 2024-04-21T12:20:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6933.393505 secs 2024-04-21T12:20:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:23 smithi077 ceph-mon[27902]: pgmap v3793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:20:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:23 smithi191 ceph-mon[31636]: pgmap v3793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:20:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:23 smithi170 ceph-mon[31212]: pgmap v3793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:20:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6935.154270 secs 2024-04-21T12:20:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6935.154270 secs 2024-04-21T12:20:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6935.154270 secs 2024-04-21T12:20:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:25 smithi077 ceph-mon[27902]: pgmap v3794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:25 smithi191 ceph-mon[31636]: pgmap v3794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:25 smithi170 ceph-mon[31212]: pgmap v3794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:27 smithi077 ceph-mon[27902]: pgmap v3795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6938.393628 secs 2024-04-21T12:20:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:27 smithi191 ceph-mon[31636]: pgmap v3795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6938.393628 secs 2024-04-21T12:20:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:27 smithi170 ceph-mon[31212]: pgmap v3795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6938.393628 secs 2024-04-21T12:20:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:29 smithi077 ceph-mon[27902]: pgmap v3796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6940.154385 secs 2024-04-21T12:20:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:29 smithi191 ceph-mon[31636]: pgmap v3796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6940.154385 secs 2024-04-21T12:20:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:29 smithi170 ceph-mon[31212]: pgmap v3796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6940.154385 secs 2024-04-21T12:20:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:31 smithi077 ceph-mon[27902]: pgmap v3797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:31 smithi191 ceph-mon[31636]: pgmap v3797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:31 smithi170 ceph-mon[31212]: pgmap v3797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6943.393750 secs 2024-04-21T12:20:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6943.393750 secs 2024-04-21T12:20:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6943.393750 secs 2024-04-21T12:20:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:33 smithi191 ceph-mon[31636]: pgmap v3798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:33 smithi170 ceph-mon[31212]: pgmap v3798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:33 smithi077 ceph-mon[27902]: pgmap v3798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6945.154506 secs 2024-04-21T12:20:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6945.154506 secs 2024-04-21T12:20:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6945.154506 secs 2024-04-21T12:20:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:35 smithi191 ceph-mon[31636]: pgmap v3799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:35 smithi170 ceph-mon[31212]: pgmap v3799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:36.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:35 smithi077 ceph-mon[27902]: pgmap v3799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:37 smithi191 ceph-mon[31636]: pgmap v3800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6948.393871 secs 2024-04-21T12:20:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:37 smithi170 ceph-mon[31212]: pgmap v3800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6948.393871 secs 2024-04-21T12:20:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:37 smithi077 ceph-mon[27902]: pgmap v3800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6948.393871 secs 2024-04-21T12:20:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:39 smithi191 ceph-mon[31636]: pgmap v3801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6950.154657 secs 2024-04-21T12:20:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:39 smithi170 ceph-mon[31212]: pgmap v3801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6950.154657 secs 2024-04-21T12:20:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:39 smithi077 ceph-mon[27902]: pgmap v3801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6950.154657 secs 2024-04-21T12:20:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:41 smithi191 ceph-mon[31636]: pgmap v3802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:41 smithi170 ceph-mon[31212]: pgmap v3802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:41 smithi077 ceph-mon[27902]: pgmap v3802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:43.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6953.393946 secs 2024-04-21T12:20:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6953.393946 secs 2024-04-21T12:20:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6953.393946 secs 2024-04-21T12:20:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:43 smithi191 ceph-mon[31636]: pgmap v3803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:43 smithi170 ceph-mon[31212]: pgmap v3803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:43 smithi077 ceph-mon[27902]: pgmap v3803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6955.154797 secs 2024-04-21T12:20:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6955.154797 secs 2024-04-21T12:20:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6955.154797 secs 2024-04-21T12:20:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:45 smithi191 ceph-mon[31636]: pgmap v3804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:45 smithi170 ceph-mon[31212]: pgmap v3804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:45 smithi077 ceph-mon[27902]: pgmap v3804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:47 smithi191 ceph-mon[31636]: pgmap v3805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6958.394054 secs 2024-04-21T12:20:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:47 smithi170 ceph-mon[31212]: pgmap v3805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6958.394054 secs 2024-04-21T12:20:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:47 smithi077 ceph-mon[27902]: pgmap v3805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6958.394054 secs 2024-04-21T12:20:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:49 smithi191 ceph-mon[31636]: pgmap v3806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6960.154924 secs 2024-04-21T12:20:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:49 smithi170 ceph-mon[31212]: pgmap v3806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6960.154924 secs 2024-04-21T12:20:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:49 smithi077 ceph-mon[27902]: pgmap v3806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6960.154924 secs 2024-04-21T12:20:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:51 smithi191 ceph-mon[31636]: pgmap v3807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:51 smithi170 ceph-mon[31212]: pgmap v3807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:51 smithi077 ceph-mon[27902]: pgmap v3807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6963.394198 secs 2024-04-21T12:20:53.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6963.394198 secs 2024-04-21T12:20:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6963.394198 secs 2024-04-21T12:20:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:53 smithi191 ceph-mon[31636]: pgmap v3808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:53 smithi170 ceph-mon[31212]: pgmap v3808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:53 smithi077 ceph-mon[27902]: pgmap v3808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:20:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6965.155051 secs 2024-04-21T12:20:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6965.155051 secs 2024-04-21T12:20:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6965.155051 secs 2024-04-21T12:20:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:55 smithi191 ceph-mon[31636]: pgmap v3809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:55 smithi170 ceph-mon[31212]: pgmap v3809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:55 smithi077 ceph-mon[27902]: pgmap v3809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:20:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:57 smithi191 ceph-mon[31636]: pgmap v3810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6968.394336 secs 2024-04-21T12:20:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:57 smithi170 ceph-mon[31212]: pgmap v3810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6968.394336 secs 2024-04-21T12:20:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:57 smithi077 ceph-mon[27902]: pgmap v3810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:20:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6968.394336 secs 2024-04-21T12:21:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:59 smithi191 ceph-mon[31636]: pgmap v3811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6970.155112 secs 2024-04-21T12:21:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:59 smithi170 ceph-mon[31212]: pgmap v3811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6970.155112 secs 2024-04-21T12:21:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:59 smithi077 ceph-mon[27902]: pgmap v3811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6970.155112 secs 2024-04-21T12:21:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:01 smithi170 ceph-mon[31212]: pgmap v3812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:21:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:01 smithi191 ceph-mon[31636]: pgmap v3812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:21:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:01 smithi077 ceph-mon[27902]: pgmap v3812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:21:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6973.394401 secs 2024-04-21T12:21:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6973.394401 secs 2024-04-21T12:21:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6973.394401 secs 2024-04-21T12:21:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:03 smithi191 ceph-mon[31636]: pgmap v3813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:03 smithi170 ceph-mon[31212]: pgmap v3813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:03 smithi077 ceph-mon[27902]: pgmap v3813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6975.155235 secs 2024-04-21T12:21:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:04 smithi170 ceph-mon[31212]: osdmap e311: 12 total, 12 up, 12 in 2024-04-21T12:21:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6975.155235 secs 2024-04-21T12:21:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:04 smithi191 ceph-mon[31636]: osdmap e311: 12 total, 12 up, 12 in 2024-04-21T12:21:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6975.155235 secs 2024-04-21T12:21:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:04 smithi077 ceph-mon[27902]: osdmap e311: 12 total, 12 up, 12 in 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: pgmap v3815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:21:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: pgmap v3815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:21:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: pgmap v3815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:21:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:21:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:07 smithi170 ceph-mon[31212]: pgmap v3816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:21:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6978.394541 secs 2024-04-21T12:21:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:07 smithi170 ceph-mon[31212]: osdmap e312: 12 total, 12 up, 12 in 2024-04-21T12:21:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:07 smithi077 ceph-mon[27902]: pgmap v3816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:21:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6978.394541 secs 2024-04-21T12:21:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:07 smithi077 ceph-mon[27902]: osdmap e312: 12 total, 12 up, 12 in 2024-04-21T12:21:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:07 smithi191 ceph-mon[31636]: pgmap v3816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:21:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6978.394541 secs 2024-04-21T12:21:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:07 smithi191 ceph-mon[31636]: osdmap e312: 12 total, 12 up, 12 in 2024-04-21T12:21:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:09 smithi170 ceph-mon[31212]: pgmap v3818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:21:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6980.155356 secs 2024-04-21T12:21:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:09 smithi077 ceph-mon[27902]: pgmap v3818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:21:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6980.155356 secs 2024-04-21T12:21:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:09 smithi191 ceph-mon[31636]: pgmap v3818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:21:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6980.155356 secs 2024-04-21T12:21:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:11 smithi170 ceph-mon[31212]: pgmap v3819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:21:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:11 smithi077 ceph-mon[27902]: pgmap v3819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:21:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:11 smithi191 ceph-mon[31636]: pgmap v3819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:21:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6983.394640 secs 2024-04-21T12:21:13.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6983.394640 secs 2024-04-21T12:21:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6983.394640 secs 2024-04-21T12:21:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:13 smithi170 ceph-mon[31212]: pgmap v3820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T12:21:14.379 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:13 smithi191 ceph-mon[31636]: pgmap v3820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T12:21:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:13 smithi077 ceph-mon[27902]: pgmap v3820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T12:21:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6985.155437 secs 2024-04-21T12:21:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6985.155437 secs 2024-04-21T12:21:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6985.155437 secs 2024-04-21T12:21:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:15 smithi170 ceph-mon[31212]: pgmap v3821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:21:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:15 smithi077 ceph-mon[27902]: pgmap v3821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:21:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:15 smithi191 ceph-mon[31636]: pgmap v3821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:21:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:18 smithi170 ceph-mon[31212]: pgmap v3822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:21:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6988.394804 secs 2024-04-21T12:21:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:17 smithi077 ceph-mon[27902]: pgmap v3822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:21:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6988.394804 secs 2024-04-21T12:21:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:18 smithi191 ceph-mon[31636]: pgmap v3822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:21:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6988.394804 secs 2024-04-21T12:21:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:20 smithi170 ceph-mon[31212]: pgmap v3823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:21:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6990.155560 secs 2024-04-21T12:21:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:20 smithi077 ceph-mon[27902]: pgmap v3823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:21:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6990.155560 secs 2024-04-21T12:21:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:20 smithi191 ceph-mon[31636]: pgmap v3823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:21:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6990.155560 secs 2024-04-21T12:21:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:22 smithi170 ceph-mon[31212]: pgmap v3824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:21:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:22 smithi077 ceph-mon[27902]: pgmap v3824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:21:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:22 smithi191 ceph-mon[31636]: pgmap v3824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:21:23.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6993.394942 secs 2024-04-21T12:21:23.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6993.394942 secs 2024-04-21T12:21:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6993.394942 secs 2024-04-21T12:21:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:24 smithi170 ceph-mon[31212]: pgmap v3825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:21:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:24 smithi077 ceph-mon[27902]: pgmap v3825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:21:24.422 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:24 smithi191 ceph-mon[31636]: pgmap v3825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:21:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 6995.155683 secs 2024-04-21T12:21:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 6995.155683 secs 2024-04-21T12:21:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 6995.155683 secs 2024-04-21T12:21:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:26 smithi170 ceph-mon[31212]: pgmap v3826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:26 smithi077 ceph-mon[27902]: pgmap v3826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:26 smithi191 ceph-mon[31636]: pgmap v3826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:28 smithi170 ceph-mon[31212]: pgmap v3827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 6998.395003 secs 2024-04-21T12:21:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:28 smithi077 ceph-mon[27902]: pgmap v3827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 6998.395003 secs 2024-04-21T12:21:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:28 smithi191 ceph-mon[31636]: pgmap v3827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 6998.395003 secs 2024-04-21T12:21:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:30 smithi170 ceph-mon[31212]: pgmap v3828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7000.155809 secs 2024-04-21T12:21:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:30 smithi077 ceph-mon[27902]: pgmap v3828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7000.155809 secs 2024-04-21T12:21:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:30 smithi191 ceph-mon[31636]: pgmap v3828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7000.155809 secs 2024-04-21T12:21:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:32 smithi170 ceph-mon[31212]: pgmap v3829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:32 smithi077 ceph-mon[27902]: pgmap v3829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:32 smithi191 ceph-mon[31636]: pgmap v3829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7003.395090 secs 2024-04-21T12:21:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7003.395090 secs 2024-04-21T12:21:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7003.395090 secs 2024-04-21T12:21:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:34 smithi170 ceph-mon[31212]: pgmap v3830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:34 smithi077 ceph-mon[27902]: pgmap v3830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:34 smithi191 ceph-mon[31636]: pgmap v3830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7005.155962 secs 2024-04-21T12:21:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7005.155962 secs 2024-04-21T12:21:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7005.155962 secs 2024-04-21T12:21:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:36 smithi170 ceph-mon[31212]: pgmap v3831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:36 smithi077 ceph-mon[27902]: pgmap v3831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:36 smithi191 ceph-mon[31636]: pgmap v3831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:38 smithi170 ceph-mon[31212]: pgmap v3832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7008.395180 secs 2024-04-21T12:21:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:38 smithi077 ceph-mon[27902]: pgmap v3832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7008.395180 secs 2024-04-21T12:21:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:38 smithi191 ceph-mon[31636]: pgmap v3832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7008.395180 secs 2024-04-21T12:21:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:40 smithi170 ceph-mon[31212]: pgmap v3833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7010.156105 secs 2024-04-21T12:21:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:40 smithi077 ceph-mon[27902]: pgmap v3833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7010.156105 secs 2024-04-21T12:21:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:40 smithi191 ceph-mon[31636]: pgmap v3833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7010.156105 secs 2024-04-21T12:21:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:42 smithi077 ceph-mon[27902]: pgmap v3834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:42 smithi191 ceph-mon[31636]: pgmap v3834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:42 smithi170 ceph-mon[31212]: pgmap v3834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:43.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7013.395269 secs 2024-04-21T12:21:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7013.395269 secs 2024-04-21T12:21:43.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7013.395269 secs 2024-04-21T12:21:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:44 smithi077 ceph-mon[27902]: pgmap v3835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:21:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:44 smithi191 ceph-mon[31636]: pgmap v3835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:21:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:44 smithi170 ceph-mon[31212]: pgmap v3835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:21:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7015.156226 secs 2024-04-21T12:21:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7015.156226 secs 2024-04-21T12:21:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7015.156226 secs 2024-04-21T12:21:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:46 smithi077 ceph-mon[27902]: pgmap v3836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:46 smithi191 ceph-mon[31636]: pgmap v3836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:46 smithi170 ceph-mon[31212]: pgmap v3836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:48 smithi077 ceph-mon[27902]: pgmap v3837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7018.395385 secs 2024-04-21T12:21:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:48 smithi191 ceph-mon[31636]: pgmap v3837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7018.395385 secs 2024-04-21T12:21:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:48 smithi170 ceph-mon[31212]: pgmap v3837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7018.395385 secs 2024-04-21T12:21:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:50 smithi077 ceph-mon[27902]: pgmap v3838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7020.156352 secs 2024-04-21T12:21:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:50 smithi191 ceph-mon[31636]: pgmap v3838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7020.156352 secs 2024-04-21T12:21:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:50 smithi170 ceph-mon[31212]: pgmap v3838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7020.156352 secs 2024-04-21T12:21:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:52 smithi077 ceph-mon[27902]: pgmap v3839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:52 smithi191 ceph-mon[31636]: pgmap v3839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:52 smithi170 ceph-mon[31212]: pgmap v3839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:21:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7023.395463 secs 2024-04-21T12:21:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7023.395463 secs 2024-04-21T12:21:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7023.395463 secs 2024-04-21T12:21:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:54 smithi077 ceph-mon[27902]: pgmap v3840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:21:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:54 smithi191 ceph-mon[31636]: pgmap v3840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:21:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:54 smithi170 ceph-mon[31212]: pgmap v3840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:21:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:21:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7025.156474 secs 2024-04-21T12:21:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7025.156474 secs 2024-04-21T12:21:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7025.156474 secs 2024-04-21T12:21:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:56 smithi077 ceph-mon[27902]: pgmap v3841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:56 smithi191 ceph-mon[31636]: pgmap v3841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:56 smithi170 ceph-mon[31212]: pgmap v3841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:21:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:58 smithi077 ceph-mon[27902]: pgmap v3842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:21:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7028.395575 secs 2024-04-21T12:21:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:58 smithi191 ceph-mon[31636]: pgmap v3842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:21:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7028.395575 secs 2024-04-21T12:21:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:58 smithi170 ceph-mon[31212]: pgmap v3842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:21:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:21:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7028.395575 secs 2024-04-21T12:22:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:00 smithi077 ceph-mon[27902]: pgmap v3843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7030.156599 secs 2024-04-21T12:22:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:00 smithi191 ceph-mon[31636]: pgmap v3843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7030.156599 secs 2024-04-21T12:22:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:00 smithi170 ceph-mon[31212]: pgmap v3843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7030.156599 secs 2024-04-21T12:22:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:02 smithi077 ceph-mon[27902]: pgmap v3844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:22:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:02 smithi191 ceph-mon[31636]: pgmap v3844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:22:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:02 smithi170 ceph-mon[31212]: pgmap v3844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T12:22:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7033.395712 secs 2024-04-21T12:22:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7033.395712 secs 2024-04-21T12:22:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7033.395712 secs 2024-04-21T12:22:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:04 smithi077 ceph-mon[27902]: pgmap v3845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:04 smithi191 ceph-mon[31636]: pgmap v3845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:04 smithi170 ceph-mon[31212]: pgmap v3845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7035.156678 secs 2024-04-21T12:22:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:05 smithi077 ceph-mon[27902]: osdmap e313: 12 total, 12 up, 12 in 2024-04-21T12:22:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:05 smithi077 ceph-mon[27902]: pgmap v3847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:22:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7035.156678 secs 2024-04-21T12:22:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:05 smithi191 ceph-mon[31636]: osdmap e313: 12 total, 12 up, 12 in 2024-04-21T12:22:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:05 smithi191 ceph-mon[31636]: pgmap v3847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:22:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7035.156678 secs 2024-04-21T12:22:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:05 smithi170 ceph-mon[31212]: osdmap e313: 12 total, 12 up, 12 in 2024-04-21T12:22:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:05 smithi170 ceph-mon[31212]: pgmap v3847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:22:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:22:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:22:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:22:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:07 smithi191 ceph-mon[31636]: pgmap v3848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:22:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:22:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:22:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:22:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:07 smithi170 ceph-mon[31212]: pgmap v3848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:22:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:22:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:22:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:22:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:07 smithi077 ceph-mon[27902]: pgmap v3848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:22:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:22:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:22:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:22:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7038.395830 secs 2024-04-21T12:22:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:08 smithi191 ceph-mon[31636]: osdmap e314: 12 total, 12 up, 12 in 2024-04-21T12:22:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7038.395830 secs 2024-04-21T12:22:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:08 smithi170 ceph-mon[31212]: osdmap e314: 12 total, 12 up, 12 in 2024-04-21T12:22:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7038.395830 secs 2024-04-21T12:22:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:08 smithi077 ceph-mon[27902]: osdmap e314: 12 total, 12 up, 12 in 2024-04-21T12:22:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:09 smithi191 ceph-mon[31636]: pgmap v3850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T12:22:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:09 smithi170 ceph-mon[31212]: pgmap v3850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T12:22:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:09 smithi077 ceph-mon[27902]: pgmap v3850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T12:22:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7040.156796 secs 2024-04-21T12:22:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7040.156796 secs 2024-04-21T12:22:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7040.156796 secs 2024-04-21T12:22:11.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:11 smithi191 ceph-mon[31636]: pgmap v3851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T12:22:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:11 smithi170 ceph-mon[31212]: pgmap v3851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T12:22:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:11 smithi077 ceph-mon[27902]: pgmap v3851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T12:22:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7043.395942 secs 2024-04-21T12:22:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:13 smithi170 ceph-mon[31212]: pgmap v3852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T12:22:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7043.395942 secs 2024-04-21T12:22:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:13 smithi077 ceph-mon[27902]: pgmap v3852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T12:22:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7043.395942 secs 2024-04-21T12:22:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:13 smithi191 ceph-mon[31636]: pgmap v3852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T12:22:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7045.156948 secs 2024-04-21T12:22:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7045.156948 secs 2024-04-21T12:22:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7045.156948 secs 2024-04-21T12:22:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:15 smithi170 ceph-mon[31212]: pgmap v3853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:22:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:15 smithi077 ceph-mon[27902]: pgmap v3853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:22:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:15 smithi191 ceph-mon[31636]: pgmap v3853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:22:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:17 smithi170 ceph-mon[31212]: pgmap v3854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:22:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:17 smithi077 ceph-mon[27902]: pgmap v3854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:22:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:17 smithi191 ceph-mon[31636]: pgmap v3854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:22:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7048.396051 secs 2024-04-21T12:22:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7048.396051 secs 2024-04-21T12:22:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7048.396051 secs 2024-04-21T12:22:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:19 smithi170 ceph-mon[31212]: pgmap v3855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:22:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7050.157064 secs 2024-04-21T12:22:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:19 smithi077 ceph-mon[27902]: pgmap v3855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:22:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7050.157064 secs 2024-04-21T12:22:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:19 smithi191 ceph-mon[31636]: pgmap v3855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T12:22:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7050.157064 secs 2024-04-21T12:22:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:21 smithi170 ceph-mon[31212]: pgmap v3856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T12:22:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:21 smithi077 ceph-mon[27902]: pgmap v3856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T12:22:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:21 smithi191 ceph-mon[31636]: pgmap v3856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T12:22:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7053.396166 secs 2024-04-21T12:22:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:23 smithi170 ceph-mon[31212]: pgmap v3857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:22:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7053.396166 secs 2024-04-21T12:22:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:23 smithi077 ceph-mon[27902]: pgmap v3857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:22:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7053.396166 secs 2024-04-21T12:22:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:23 smithi191 ceph-mon[31636]: pgmap v3857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:22:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7055.157205 secs 2024-04-21T12:22:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7055.157205 secs 2024-04-21T12:22:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7055.157205 secs 2024-04-21T12:22:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:25 smithi170 ceph-mon[31212]: pgmap v3858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:25 smithi077 ceph-mon[27902]: pgmap v3858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:25 smithi191 ceph-mon[31636]: pgmap v3858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:27 smithi170 ceph-mon[31212]: pgmap v3859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:27 smithi077 ceph-mon[27902]: pgmap v3859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:27 smithi191 ceph-mon[31636]: pgmap v3859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7058.396291 secs 2024-04-21T12:22:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7058.396291 secs 2024-04-21T12:22:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7058.396291 secs 2024-04-21T12:22:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:29 smithi170 ceph-mon[31212]: pgmap v3860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7060.157324 secs 2024-04-21T12:22:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:29 smithi077 ceph-mon[27902]: pgmap v3860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7060.157324 secs 2024-04-21T12:22:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:29 smithi191 ceph-mon[31636]: pgmap v3860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7060.157324 secs 2024-04-21T12:22:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:31 smithi077 ceph-mon[27902]: pgmap v3861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:31 smithi191 ceph-mon[31636]: pgmap v3861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:31 smithi170 ceph-mon[31212]: pgmap v3861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7063.396413 secs 2024-04-21T12:22:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:33 smithi077 ceph-mon[27902]: pgmap v3862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7063.396413 secs 2024-04-21T12:22:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:33 smithi191 ceph-mon[31636]: pgmap v3862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7063.396413 secs 2024-04-21T12:22:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:33 smithi170 ceph-mon[31212]: pgmap v3862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7065.157422 secs 2024-04-21T12:22:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7065.157422 secs 2024-04-21T12:22:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7065.157422 secs 2024-04-21T12:22:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:35 smithi077 ceph-mon[27902]: pgmap v3863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:35 smithi191 ceph-mon[31636]: pgmap v3863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:35 smithi170 ceph-mon[31212]: pgmap v3863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:37 smithi077 ceph-mon[27902]: pgmap v3864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:37 smithi191 ceph-mon[31636]: pgmap v3864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:37 smithi170 ceph-mon[31212]: pgmap v3864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7068.396547 secs 2024-04-21T12:22:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7068.396547 secs 2024-04-21T12:22:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7068.396547 secs 2024-04-21T12:22:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:39 smithi077 ceph-mon[27902]: pgmap v3865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7070.157520 secs 2024-04-21T12:22:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:39 smithi191 ceph-mon[31636]: pgmap v3865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7070.157520 secs 2024-04-21T12:22:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:39 smithi170 ceph-mon[31212]: pgmap v3865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7070.157520 secs 2024-04-21T12:22:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:41 smithi077 ceph-mon[27902]: pgmap v3866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:41 smithi191 ceph-mon[31636]: pgmap v3866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:41 smithi170 ceph-mon[31212]: pgmap v3866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:43.608 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7073.396666 secs 2024-04-21T12:22:43.608 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:43 smithi170 ceph-mon[31212]: pgmap v3867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7073.396666 secs 2024-04-21T12:22:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:43 smithi077 ceph-mon[27902]: pgmap v3867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7073.396666 secs 2024-04-21T12:22:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:43 smithi191 ceph-mon[31636]: pgmap v3867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7075.157656 secs 2024-04-21T12:22:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7075.157656 secs 2024-04-21T12:22:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7075.157656 secs 2024-04-21T12:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:45 smithi077 ceph-mon[27902]: pgmap v3868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:45 smithi191 ceph-mon[31636]: pgmap v3868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:45 smithi170 ceph-mon[31212]: pgmap v3868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:47 smithi077 ceph-mon[27902]: pgmap v3869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:47 smithi191 ceph-mon[31636]: pgmap v3869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:47 smithi170 ceph-mon[31212]: pgmap v3869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7078.396839 secs 2024-04-21T12:22:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7078.396839 secs 2024-04-21T12:22:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7078.396839 secs 2024-04-21T12:22:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:49 smithi077 ceph-mon[27902]: pgmap v3870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7080.157787 secs 2024-04-21T12:22:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:49 smithi191 ceph-mon[31636]: pgmap v3870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7080.157787 secs 2024-04-21T12:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:49 smithi170 ceph-mon[31212]: pgmap v3870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7080.157787 secs 2024-04-21T12:22:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:51 smithi077 ceph-mon[27902]: pgmap v3871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:51 smithi191 ceph-mon[31636]: pgmap v3871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:51 smithi170 ceph-mon[31212]: pgmap v3871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7083.396956 secs 2024-04-21T12:22:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:53 smithi077 ceph-mon[27902]: pgmap v3872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7083.396956 secs 2024-04-21T12:22:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:53 smithi191 ceph-mon[31636]: pgmap v3872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7083.396956 secs 2024-04-21T12:22:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:53 smithi170 ceph-mon[31212]: pgmap v3872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:22:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7085.157928 secs 2024-04-21T12:22:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7085.157928 secs 2024-04-21T12:22:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7085.157928 secs 2024-04-21T12:22:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:22:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:22:55.323+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:22:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:22:55.323+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:22:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:22:55.323+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:22:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:22:55.323+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:22:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:55 smithi077 ceph-mon[27902]: pgmap v3873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:55 smithi191 ceph-mon[31636]: pgmap v3873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:55 smithi170 ceph-mon[31212]: pgmap v3873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:57 smithi077 ceph-mon[27902]: pgmap v3874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:57 smithi191 ceph-mon[31636]: pgmap v3874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:57 smithi170 ceph-mon[31212]: pgmap v3874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:22:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7088.397028 secs 2024-04-21T12:22:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7088.397028 secs 2024-04-21T12:22:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7088.397028 secs 2024-04-21T12:22:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:59 smithi077 ceph-mon[27902]: pgmap v3875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7090.157994 secs 2024-04-21T12:22:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:59 smithi191 ceph-mon[31636]: pgmap v3875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7090.157994 secs 2024-04-21T12:22:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:59 smithi170 ceph-mon[31212]: pgmap v3875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:22:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7090.157994 secs 2024-04-21T12:23:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:01 smithi191 ceph-mon[31636]: pgmap v3876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:01 smithi170 ceph-mon[31212]: pgmap v3876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:01.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:01 smithi077 ceph-mon[27902]: pgmap v3876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7093.397135 secs 2024-04-21T12:23:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:03 smithi191 ceph-mon[31636]: pgmap v3877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7093.397135 secs 2024-04-21T12:23:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:03 smithi170 ceph-mon[31212]: pgmap v3877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7093.397135 secs 2024-04-21T12:23:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:03 smithi077 ceph-mon[27902]: pgmap v3877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7095.158093 secs 2024-04-21T12:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:04 smithi191 ceph-mon[31636]: osdmap e315: 12 total, 12 up, 12 in 2024-04-21T12:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7095.158093 secs 2024-04-21T12:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:04 smithi170 ceph-mon[31212]: osdmap e315: 12 total, 12 up, 12 in 2024-04-21T12:23:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7095.158093 secs 2024-04-21T12:23:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:04 smithi077 ceph-mon[27902]: osdmap e315: 12 total, 12 up, 12 in 2024-04-21T12:23:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:05 smithi191 ceph-mon[31636]: pgmap v3879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:23:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:05 smithi170 ceph-mon[31212]: pgmap v3879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:23:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:05 smithi077 ceph-mon[27902]: pgmap v3879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:23:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:23:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:23:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:23:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:07 smithi191 ceph-mon[31636]: pgmap v3880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:23:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:23:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:23:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:23:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:07 smithi170 ceph-mon[31212]: pgmap v3880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:23:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:23:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:23:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:23:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:07 smithi077 ceph-mon[27902]: pgmap v3880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:23:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:23:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:23:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:23:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7098.397222 secs 2024-04-21T12:23:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:08 smithi191 ceph-mon[31636]: osdmap e316: 12 total, 12 up, 12 in 2024-04-21T12:23:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7098.397222 secs 2024-04-21T12:23:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:08 smithi170 ceph-mon[31212]: osdmap e316: 12 total, 12 up, 12 in 2024-04-21T12:23:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7098.397222 secs 2024-04-21T12:23:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:08 smithi077 ceph-mon[27902]: osdmap e316: 12 total, 12 up, 12 in 2024-04-21T12:23:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:09 smithi191 ceph-mon[31636]: pgmap v3882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:23:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7100.158190 secs 2024-04-21T12:23:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:09 smithi170 ceph-mon[31212]: pgmap v3882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:23:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7100.158190 secs 2024-04-21T12:23:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:09 smithi077 ceph-mon[27902]: pgmap v3882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:23:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7100.158190 secs 2024-04-21T12:23:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:11 smithi191 ceph-mon[31636]: pgmap v3883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:23:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:11 smithi170 ceph-mon[31212]: pgmap v3883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:23:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:11 smithi077 ceph-mon[27902]: pgmap v3883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:23:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7103.397341 secs 2024-04-21T12:23:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7103.397341 secs 2024-04-21T12:23:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7103.397341 secs 2024-04-21T12:23:13.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:13 smithi170 ceph-mon[31212]: pgmap v3884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:23:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:13 smithi191 ceph-mon[31636]: pgmap v3884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:23:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:13 smithi077 ceph-mon[27902]: pgmap v3884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:23:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7105.158304 secs 2024-04-21T12:23:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7105.158304 secs 2024-04-21T12:23:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7105.158304 secs 2024-04-21T12:23:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:15 smithi191 ceph-mon[31636]: pgmap v3885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:23:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:15 smithi170 ceph-mon[31212]: pgmap v3885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:23:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:15 smithi077 ceph-mon[27902]: pgmap v3885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:23:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:17 smithi191 ceph-mon[31636]: pgmap v3886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:23:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7108.397473 secs 2024-04-21T12:23:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:17 smithi170 ceph-mon[31212]: pgmap v3886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:23:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7108.397473 secs 2024-04-21T12:23:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:17 smithi077 ceph-mon[27902]: pgmap v3886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:23:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7108.397473 secs 2024-04-21T12:23:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:19 smithi191 ceph-mon[31636]: pgmap v3887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:23:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7110.158416 secs 2024-04-21T12:23:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:19 smithi170 ceph-mon[31212]: pgmap v3887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:23:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7110.158416 secs 2024-04-21T12:23:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:19 smithi077 ceph-mon[27902]: pgmap v3887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:23:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7110.158416 secs 2024-04-21T12:23:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:21 smithi191 ceph-mon[31636]: pgmap v3888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:23:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:21 smithi170 ceph-mon[31212]: pgmap v3888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:23:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:21 smithi077 ceph-mon[27902]: pgmap v3888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:23:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7113.397599 secs 2024-04-21T12:23:23.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7113.397599 secs 2024-04-21T12:23:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7113.397599 secs 2024-04-21T12:23:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:23 smithi191 ceph-mon[31636]: pgmap v3889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:23 smithi170 ceph-mon[31212]: pgmap v3889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:23 smithi077 ceph-mon[27902]: pgmap v3889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7115.158571 secs 2024-04-21T12:23:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7115.158571 secs 2024-04-21T12:23:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7115.158571 secs 2024-04-21T12:23:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:25 smithi191 ceph-mon[31636]: pgmap v3890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:25 smithi170 ceph-mon[31212]: pgmap v3890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:25 smithi077 ceph-mon[27902]: pgmap v3890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:27 smithi191 ceph-mon[31636]: pgmap v3891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7118.397736 secs 2024-04-21T12:23:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:27 smithi170 ceph-mon[31212]: pgmap v3891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7118.397736 secs 2024-04-21T12:23:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:27 smithi077 ceph-mon[27902]: pgmap v3891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7118.397736 secs 2024-04-21T12:23:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:29 smithi191 ceph-mon[31636]: pgmap v3892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7120.158716 secs 2024-04-21T12:23:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:29 smithi170 ceph-mon[31212]: pgmap v3892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7120.158716 secs 2024-04-21T12:23:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:29 smithi077 ceph-mon[27902]: pgmap v3892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7120.158716 secs 2024-04-21T12:23:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:31 smithi191 ceph-mon[31636]: pgmap v3893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:31 smithi170 ceph-mon[31212]: pgmap v3893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:31 smithi077 ceph-mon[27902]: pgmap v3893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7123.397846 secs 2024-04-21T12:23:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7123.397846 secs 2024-04-21T12:23:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7123.397846 secs 2024-04-21T12:23:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:33 smithi170 ceph-mon[31212]: pgmap v3894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:34.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:33 smithi077 ceph-mon[27902]: pgmap v3894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:33 smithi191 ceph-mon[31636]: pgmap v3894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T12:23:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7125.158834 secs 2024-04-21T12:23:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7125.158834 secs 2024-04-21T12:23:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7125.158834 secs 2024-04-21T12:23:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:35 smithi170 ceph-mon[31212]: pgmap v3895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:35 smithi077 ceph-mon[27902]: pgmap v3895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:35 smithi191 ceph-mon[31636]: pgmap v3895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:37 smithi170 ceph-mon[31212]: pgmap v3896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7128.397962 secs 2024-04-21T12:23:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:37 smithi077 ceph-mon[27902]: pgmap v3896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7128.397962 secs 2024-04-21T12:23:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:37 smithi191 ceph-mon[31636]: pgmap v3896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7128.397962 secs 2024-04-21T12:23:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:39 smithi170 ceph-mon[31212]: pgmap v3897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7130.158979 secs 2024-04-21T12:23:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:39 smithi077 ceph-mon[27902]: pgmap v3897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7130.158979 secs 2024-04-21T12:23:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:39 smithi191 ceph-mon[31636]: pgmap v3897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7130.158979 secs 2024-04-21T12:23:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:41 smithi170 ceph-mon[31212]: pgmap v3898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:41 smithi077 ceph-mon[27902]: pgmap v3898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:41 smithi191 ceph-mon[31636]: pgmap v3898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7133.398078 secs 2024-04-21T12:23:43.118 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7133.398078 secs 2024-04-21T12:23:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7133.398078 secs 2024-04-21T12:23:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:43 smithi170 ceph-mon[31212]: pgmap v3899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:43 smithi077 ceph-mon[27902]: pgmap v3899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:43 smithi191 ceph-mon[31636]: pgmap v3899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7135.159099 secs 2024-04-21T12:23:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7135.159099 secs 2024-04-21T12:23:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7135.159099 secs 2024-04-21T12:23:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:45 smithi170 ceph-mon[31212]: pgmap v3900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:45 smithi077 ceph-mon[27902]: pgmap v3900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:45 smithi191 ceph-mon[31636]: pgmap v3900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:47 smithi170 ceph-mon[31212]: pgmap v3901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7138.398212 secs 2024-04-21T12:23:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:47 smithi077 ceph-mon[27902]: pgmap v3901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7138.398212 secs 2024-04-21T12:23:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:47 smithi191 ceph-mon[31636]: pgmap v3901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7138.398212 secs 2024-04-21T12:23:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:49 smithi170 ceph-mon[31212]: pgmap v3902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7140.159235 secs 2024-04-21T12:23:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:49 smithi077 ceph-mon[27902]: pgmap v3902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7140.159235 secs 2024-04-21T12:23:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:49 smithi191 ceph-mon[31636]: pgmap v3902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7140.159235 secs 2024-04-21T12:23:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:51 smithi170 ceph-mon[31212]: pgmap v3903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:52.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:51 smithi077 ceph-mon[27902]: pgmap v3903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:51 smithi191 ceph-mon[31636]: pgmap v3903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:53.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7143.398336 secs 2024-04-21T12:23:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7143.398336 secs 2024-04-21T12:23:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7143.398336 secs 2024-04-21T12:23:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:53 smithi170 ceph-mon[31212]: pgmap v3904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:53 smithi077 ceph-mon[27902]: pgmap v3904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:53 smithi191 ceph-mon[31636]: pgmap v3904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7145.159349 secs 2024-04-21T12:23:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:23:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7145.159349 secs 2024-04-21T12:23:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7145.159349 secs 2024-04-21T12:23:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:55 smithi170 ceph-mon[31212]: pgmap v3905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:55 smithi077 ceph-mon[27902]: pgmap v3905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:55 smithi191 ceph-mon[31636]: pgmap v3905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:23:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:57 smithi170 ceph-mon[31212]: pgmap v3906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7148.398457 secs 2024-04-21T12:23:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:57 smithi077 ceph-mon[27902]: pgmap v3906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7148.398457 secs 2024-04-21T12:23:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:57 smithi191 ceph-mon[31636]: pgmap v3906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:23:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7148.398457 secs 2024-04-21T12:24:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:59 smithi170 ceph-mon[31212]: pgmap v3907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7150.159462 secs 2024-04-21T12:24:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:59 smithi077 ceph-mon[27902]: pgmap v3907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7150.159462 secs 2024-04-21T12:24:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:59 smithi191 ceph-mon[31636]: pgmap v3907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7150.159462 secs 2024-04-21T12:24:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:01 smithi170 ceph-mon[31212]: pgmap v3908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:24:02.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:01 smithi077 ceph-mon[27902]: pgmap v3908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:24:02.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:01 smithi191 ceph-mon[31636]: pgmap v3908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:24:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7153.398615 secs 2024-04-21T12:24:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7153.398615 secs 2024-04-21T12:24:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7153.398615 secs 2024-04-21T12:24:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:03 smithi170 ceph-mon[31212]: pgmap v3909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:24:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:03 smithi077 ceph-mon[27902]: pgmap v3909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:24:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:03 smithi191 ceph-mon[31636]: pgmap v3909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:24:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7155.159568 secs 2024-04-21T12:24:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:04 smithi077 ceph-mon[27902]: osdmap e317: 12 total, 12 up, 12 in 2024-04-21T12:24:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7155.159568 secs 2024-04-21T12:24:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:04 smithi191 ceph-mon[31636]: osdmap e317: 12 total, 12 up, 12 in 2024-04-21T12:24:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7155.159568 secs 2024-04-21T12:24:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:04 smithi170 ceph-mon[31212]: osdmap e317: 12 total, 12 up, 12 in 2024-04-21T12:24:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:05 smithi077 ceph-mon[27902]: pgmap v3911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:24:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:05 smithi191 ceph-mon[31636]: pgmap v3911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:24:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:05 smithi170 ceph-mon[31212]: pgmap v3911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:24:08.091 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:07 smithi077 ceph-mon[27902]: pgmap v3912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:24:08.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7158.398725 secs 2024-04-21T12:24:08.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:24:08.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:07 smithi077 ceph-mon[27902]: osdmap e318: 12 total, 12 up, 12 in 2024-04-21T12:24:08.129 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:07 smithi170 ceph-mon[31212]: pgmap v3912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:24:08.129 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7158.398725 secs 2024-04-21T12:24:08.130 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:24:08.130 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:07 smithi170 ceph-mon[31212]: osdmap e318: 12 total, 12 up, 12 in 2024-04-21T12:24:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:07 smithi191 ceph-mon[31636]: pgmap v3912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:24:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7158.398725 secs 2024-04-21T12:24:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:24:08.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:07 smithi191 ceph-mon[31636]: osdmap e318: 12 total, 12 up, 12 in 2024-04-21T12:24:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: pgmap v3914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:24:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7160.159673 secs 2024-04-21T12:24:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: pgmap v3914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7160.159673 secs 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: pgmap v3914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7160.159673 secs 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:24:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:24:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:24:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:24:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:24:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:24:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:24:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:24:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:24:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:24:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:24:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:12 smithi170 ceph-mon[31212]: pgmap v3915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:24:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:12 smithi077 ceph-mon[27902]: pgmap v3915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:24:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:12 smithi191 ceph-mon[31636]: pgmap v3915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:24:13.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7163.398863 secs 2024-04-21T12:24:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7163.398863 secs 2024-04-21T12:24:13.487 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7163.398863 secs 2024-04-21T12:24:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:14 smithi077 ceph-mon[27902]: pgmap v3916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 364 B/s wr, 7 op/s 2024-04-21T12:24:14.401 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:14 smithi170 ceph-mon[31212]: pgmap v3916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 364 B/s wr, 7 op/s 2024-04-21T12:24:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:14 smithi191 ceph-mon[31636]: pgmap v3916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 364 B/s wr, 7 op/s 2024-04-21T12:24:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7165.159789 secs 2024-04-21T12:24:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7165.159789 secs 2024-04-21T12:24:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7165.159789 secs 2024-04-21T12:24:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:16 smithi077 ceph-mon[27902]: pgmap v3917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T12:24:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:16 smithi191 ceph-mon[31636]: pgmap v3917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T12:24:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:16 smithi170 ceph-mon[31212]: pgmap v3917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T12:24:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:18 smithi077 ceph-mon[27902]: pgmap v3918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:24:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7168.399010 secs 2024-04-21T12:24:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:18 smithi191 ceph-mon[31636]: pgmap v3918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:24:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7168.399010 secs 2024-04-21T12:24:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:18 smithi170 ceph-mon[31212]: pgmap v3918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:24:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7168.399010 secs 2024-04-21T12:24:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:20 smithi077 ceph-mon[27902]: pgmap v3919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:24:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7170.159906 secs 2024-04-21T12:24:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:20 smithi191 ceph-mon[31636]: pgmap v3919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:24:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7170.159906 secs 2024-04-21T12:24:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:20 smithi170 ceph-mon[31212]: pgmap v3919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:24:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7170.159906 secs 2024-04-21T12:24:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:22 smithi077 ceph-mon[27902]: pgmap v3920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:24:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:22 smithi191 ceph-mon[31636]: pgmap v3920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:24:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:22 smithi170 ceph-mon[31212]: pgmap v3920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:24:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7173.399128 secs 2024-04-21T12:24:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7173.399128 secs 2024-04-21T12:24:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7173.399128 secs 2024-04-21T12:24:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:24 smithi170 ceph-mon[31212]: pgmap v3921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:24:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:24 smithi077 ceph-mon[27902]: pgmap v3921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:24:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:24 smithi191 ceph-mon[31636]: pgmap v3921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:24:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:24:25.336+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:24:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:24:25.336+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:24:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:24:25.336+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:24:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:24:25.336+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:24:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7175.160028 secs 2024-04-21T12:24:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7175.160028 secs 2024-04-21T12:24:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7175.160028 secs 2024-04-21T12:24:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:26 smithi077 ceph-mon[27902]: pgmap v3922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:24:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:26 smithi191 ceph-mon[31636]: pgmap v3922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:24:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:26 smithi170 ceph-mon[31212]: pgmap v3922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:24:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:28 smithi077 ceph-mon[27902]: pgmap v3923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T12:24:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7178.399243 secs 2024-04-21T12:24:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:28 smithi191 ceph-mon[31636]: pgmap v3923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T12:24:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7178.399243 secs 2024-04-21T12:24:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:28 smithi170 ceph-mon[31212]: pgmap v3923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T12:24:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7178.399243 secs 2024-04-21T12:24:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:30 smithi077 ceph-mon[27902]: pgmap v3924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T12:24:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7180.160144 secs 2024-04-21T12:24:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:30 smithi191 ceph-mon[31636]: pgmap v3924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T12:24:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7180.160144 secs 2024-04-21T12:24:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:30 smithi170 ceph-mon[31212]: pgmap v3924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T12:24:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7180.160144 secs 2024-04-21T12:24:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:32 smithi077 ceph-mon[27902]: pgmap v3925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T12:24:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:32 smithi191 ceph-mon[31636]: pgmap v3925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T12:24:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:32 smithi170 ceph-mon[31212]: pgmap v3925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T12:24:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7183.399376 secs 2024-04-21T12:24:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7183.399376 secs 2024-04-21T12:24:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7183.399376 secs 2024-04-21T12:24:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:34 smithi077 ceph-mon[27902]: pgmap v3926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:24:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:34 smithi191 ceph-mon[31636]: pgmap v3926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:24:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:34 smithi170 ceph-mon[31212]: pgmap v3926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:24:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7185.160259 secs 2024-04-21T12:24:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7185.160259 secs 2024-04-21T12:24:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7185.160259 secs 2024-04-21T12:24:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:36 smithi077 ceph-mon[27902]: pgmap v3927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:24:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:36 smithi191 ceph-mon[31636]: pgmap v3927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:24:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:36 smithi170 ceph-mon[31212]: pgmap v3927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:24:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:38 smithi077 ceph-mon[27902]: pgmap v3928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7188.399458 secs 2024-04-21T12:24:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:38 smithi191 ceph-mon[31636]: pgmap v3928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7188.399458 secs 2024-04-21T12:24:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:38 smithi170 ceph-mon[31212]: pgmap v3928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7188.399458 secs 2024-04-21T12:24:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:40 smithi077 ceph-mon[27902]: pgmap v3929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7190.160370 secs 2024-04-21T12:24:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:40 smithi191 ceph-mon[31636]: pgmap v3929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7190.160370 secs 2024-04-21T12:24:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:40 smithi170 ceph-mon[31212]: pgmap v3929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7190.160370 secs 2024-04-21T12:24:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:42 smithi077 ceph-mon[27902]: pgmap v3930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:42 smithi191 ceph-mon[31636]: pgmap v3930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:42 smithi170 ceph-mon[31212]: pgmap v3930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7193.399588 secs 2024-04-21T12:24:43.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7193.399588 secs 2024-04-21T12:24:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7193.399588 secs 2024-04-21T12:24:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:44 smithi077 ceph-mon[27902]: pgmap v3931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:44 smithi191 ceph-mon[31636]: pgmap v3931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:44 smithi170 ceph-mon[31212]: pgmap v3931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7195.160483 secs 2024-04-21T12:24:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7195.160483 secs 2024-04-21T12:24:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7195.160483 secs 2024-04-21T12:24:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:46 smithi191 ceph-mon[31636]: pgmap v3932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:46 smithi170 ceph-mon[31212]: pgmap v3932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:46 smithi077 ceph-mon[27902]: pgmap v3932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:47 smithi191 ceph-mon[31636]: pgmap v3933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:47 smithi170 ceph-mon[31212]: pgmap v3933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:47 smithi077 ceph-mon[27902]: pgmap v3933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7198.399708 secs 2024-04-21T12:24:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7198.399708 secs 2024-04-21T12:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7198.399708 secs 2024-04-21T12:24:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:49 smithi191 ceph-mon[31636]: pgmap v3934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:49 smithi170 ceph-mon[31212]: pgmap v3934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:49 smithi077 ceph-mon[27902]: pgmap v3934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7200.160608 secs 2024-04-21T12:24:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7200.160608 secs 2024-04-21T12:24:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7200.160608 secs 2024-04-21T12:24:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:51 smithi191 ceph-mon[31636]: pgmap v3935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:51 smithi170 ceph-mon[31212]: pgmap v3935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:51 smithi077 ceph-mon[27902]: pgmap v3935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7203.399810 secs 2024-04-21T12:24:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:53 smithi170 ceph-mon[31212]: pgmap v3936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7203.399810 secs 2024-04-21T12:24:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:53 smithi077 ceph-mon[27902]: pgmap v3936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7203.399810 secs 2024-04-21T12:24:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:53 smithi191 ceph-mon[31636]: pgmap v3936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7205.160746 secs 2024-04-21T12:24:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7205.160746 secs 2024-04-21T12:24:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7205.160746 secs 2024-04-21T12:24:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:24:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:55 smithi077 ceph-mon[27902]: pgmap v3937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:55 smithi191 ceph-mon[31636]: pgmap v3937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:55 smithi170 ceph-mon[31212]: pgmap v3937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:57 smithi077 ceph-mon[27902]: pgmap v3938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:57 smithi191 ceph-mon[31636]: pgmap v3938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:57 smithi170 ceph-mon[31212]: pgmap v3938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:24:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7208.399875 secs 2024-04-21T12:24:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7208.399875 secs 2024-04-21T12:24:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7208.399875 secs 2024-04-21T12:24:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:59 smithi077 ceph-mon[27902]: pgmap v3939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7210.160892 secs 2024-04-21T12:24:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:59 smithi191 ceph-mon[31636]: pgmap v3939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7210.160892 secs 2024-04-21T12:24:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:59 smithi170 ceph-mon[31212]: pgmap v3939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:24:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7210.160892 secs 2024-04-21T12:25:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:01 smithi077 ceph-mon[27902]: pgmap v3940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:25:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:01 smithi191 ceph-mon[31636]: pgmap v3940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:25:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:01 smithi170 ceph-mon[31212]: pgmap v3940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T12:25:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7213.399983 secs 2024-04-21T12:25:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:03 smithi077 ceph-mon[27902]: pgmap v3941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T12:25:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7213.399983 secs 2024-04-21T12:25:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:03 smithi191 ceph-mon[31636]: pgmap v3941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T12:25:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7213.399983 secs 2024-04-21T12:25:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:03 smithi170 ceph-mon[31212]: pgmap v3941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T12:25:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7215.161014 secs 2024-04-21T12:25:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:04 smithi077 ceph-mon[27902]: osdmap e319: 12 total, 12 up, 12 in 2024-04-21T12:25:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7215.161014 secs 2024-04-21T12:25:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:04 smithi191 ceph-mon[31636]: osdmap e319: 12 total, 12 up, 12 in 2024-04-21T12:25:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7215.161014 secs 2024-04-21T12:25:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:04 smithi170 ceph-mon[31212]: osdmap e319: 12 total, 12 up, 12 in 2024-04-21T12:25:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:05 smithi077 ceph-mon[27902]: pgmap v3943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-04-21T12:25:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:05 smithi191 ceph-mon[31636]: pgmap v3943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-04-21T12:25:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:05 smithi170 ceph-mon[31212]: pgmap v3943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-04-21T12:25:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:07 smithi077 ceph-mon[27902]: pgmap v3944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:25:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:07 smithi191 ceph-mon[31636]: pgmap v3944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:25:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:07 smithi170 ceph-mon[31212]: pgmap v3944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:25:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7218.400067 secs 2024-04-21T12:25:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:08 smithi077 ceph-mon[27902]: osdmap e320: 12 total, 12 up, 12 in 2024-04-21T12:25:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7218.400067 secs 2024-04-21T12:25:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:08 smithi191 ceph-mon[31636]: osdmap e320: 12 total, 12 up, 12 in 2024-04-21T12:25:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7218.400067 secs 2024-04-21T12:25:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:08 smithi170 ceph-mon[31212]: osdmap e320: 12 total, 12 up, 12 in 2024-04-21T12:25:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:09 smithi191 ceph-mon[31636]: pgmap v3946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-21T12:25:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7220.161143 secs 2024-04-21T12:25:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:09 smithi170 ceph-mon[31212]: pgmap v3946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-21T12:25:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7220.161143 secs 2024-04-21T12:25:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:09 smithi077 ceph-mon[27902]: pgmap v3946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-21T12:25:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7220.161143 secs 2024-04-21T12:25:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:25:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:25:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:25:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:11 smithi191 ceph-mon[31636]: pgmap v3947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-04-21T12:25:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:25:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:25:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:11 smithi170 ceph-mon[31212]: pgmap v3947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-04-21T12:25:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:25:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:25:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:11 smithi077 ceph-mon[27902]: pgmap v3947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-04-21T12:25:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:25:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:25:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:25:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7223.400210 secs 2024-04-21T12:25:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7223.400210 secs 2024-04-21T12:25:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7223.400210 secs 2024-04-21T12:25:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:13 smithi170 ceph-mon[31212]: pgmap v3948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-04-21T12:25:14.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:13 smithi191 ceph-mon[31636]: pgmap v3948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-04-21T12:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:13 smithi077 ceph-mon[27902]: pgmap v3948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-04-21T12:25:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7225.161252 secs 2024-04-21T12:25:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7225.161252 secs 2024-04-21T12:25:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7225.161252 secs 2024-04-21T12:25:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:15 smithi170 ceph-mon[31212]: pgmap v3949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T12:25:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:15 smithi077 ceph-mon[27902]: pgmap v3949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T12:25:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:15 smithi191 ceph-mon[31636]: pgmap v3949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T12:25:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:17 smithi170 ceph-mon[31212]: pgmap v3950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:25:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7228.400349 secs 2024-04-21T12:25:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:17 smithi077 ceph-mon[27902]: pgmap v3950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:25:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7228.400349 secs 2024-04-21T12:25:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:17 smithi191 ceph-mon[31636]: pgmap v3950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:25:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7228.400349 secs 2024-04-21T12:25:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:19 smithi170 ceph-mon[31212]: pgmap v3951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:25:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7230.161361 secs 2024-04-21T12:25:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:19 smithi077 ceph-mon[27902]: pgmap v3951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:25:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7230.161361 secs 2024-04-21T12:25:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:19 smithi191 ceph-mon[31636]: pgmap v3951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:25:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7230.161361 secs 2024-04-21T12:25:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:21 smithi170 ceph-mon[31212]: pgmap v3952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:25:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:21 smithi077 ceph-mon[27902]: pgmap v3952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:25:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:21 smithi191 ceph-mon[31636]: pgmap v3952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:25:23.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7233.400493 secs 2024-04-21T12:25:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7233.400493 secs 2024-04-21T12:25:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7233.400493 secs 2024-04-21T12:25:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:23 smithi170 ceph-mon[31212]: pgmap v3953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:23 smithi077 ceph-mon[27902]: pgmap v3953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:23 smithi191 ceph-mon[31636]: pgmap v3953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7235.161485 secs 2024-04-21T12:25:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7235.161485 secs 2024-04-21T12:25:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7235.161485 secs 2024-04-21T12:25:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:25 smithi170 ceph-mon[31212]: pgmap v3954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:25 smithi077 ceph-mon[27902]: pgmap v3954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:25 smithi191 ceph-mon[31636]: pgmap v3954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:27 smithi170 ceph-mon[31212]: pgmap v3955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7238.400611 secs 2024-04-21T12:25:28.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:27 smithi077 ceph-mon[27902]: pgmap v3955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7238.400611 secs 2024-04-21T12:25:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:27 smithi191 ceph-mon[31636]: pgmap v3955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7238.400611 secs 2024-04-21T12:25:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:29 smithi170 ceph-mon[31212]: pgmap v3956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7240.161611 secs 2024-04-21T12:25:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:29 smithi077 ceph-mon[27902]: pgmap v3956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7240.161611 secs 2024-04-21T12:25:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:29 smithi191 ceph-mon[31636]: pgmap v3956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7240.161611 secs 2024-04-21T12:25:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:31 smithi170 ceph-mon[31212]: pgmap v3957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:31 smithi077 ceph-mon[27902]: pgmap v3957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:31 smithi191 ceph-mon[31636]: pgmap v3957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7243.400749 secs 2024-04-21T12:25:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7243.400749 secs 2024-04-21T12:25:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7243.400749 secs 2024-04-21T12:25:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:33 smithi170 ceph-mon[31212]: pgmap v3958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:33 smithi077 ceph-mon[27902]: pgmap v3958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:33 smithi191 ceph-mon[31636]: pgmap v3958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7245.161753 secs 2024-04-21T12:25:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7245.161753 secs 2024-04-21T12:25:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7245.161753 secs 2024-04-21T12:25:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:35 smithi170 ceph-mon[31212]: pgmap v3959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:35 smithi077 ceph-mon[27902]: pgmap v3959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:35 smithi191 ceph-mon[31636]: pgmap v3959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:37 smithi170 ceph-mon[31212]: pgmap v3960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7248.400873 secs 2024-04-21T12:25:38.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:37 smithi077 ceph-mon[27902]: pgmap v3960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7248.400873 secs 2024-04-21T12:25:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:37 smithi191 ceph-mon[31636]: pgmap v3960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7248.400873 secs 2024-04-21T12:25:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:39 smithi170 ceph-mon[31212]: pgmap v3961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7250.161885 secs 2024-04-21T12:25:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:39 smithi077 ceph-mon[27902]: pgmap v3961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7250.161885 secs 2024-04-21T12:25:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:39 smithi191 ceph-mon[31636]: pgmap v3961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7250.161885 secs 2024-04-21T12:25:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:41 smithi170 ceph-mon[31212]: pgmap v3962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:41 smithi077 ceph-mon[27902]: pgmap v3962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:42.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:41 smithi191 ceph-mon[31636]: pgmap v3962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7253.400975 secs 2024-04-21T12:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7253.400975 secs 2024-04-21T12:25:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7253.400975 secs 2024-04-21T12:25:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:43 smithi170 ceph-mon[31212]: pgmap v3963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:44.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:43 smithi191 ceph-mon[31636]: pgmap v3963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:43 smithi077 ceph-mon[27902]: pgmap v3963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7255.162016 secs 2024-04-21T12:25:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7255.162016 secs 2024-04-21T12:25:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7255.162016 secs 2024-04-21T12:25:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:45 smithi170 ceph-mon[31212]: pgmap v3964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:46.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:45 smithi077 ceph-mon[27902]: pgmap v3964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:45 smithi191 ceph-mon[31636]: pgmap v3964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:47 smithi077 ceph-mon[27902]: pgmap v3965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7258.401098 secs 2024-04-21T12:25:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:47 smithi191 ceph-mon[31636]: pgmap v3965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7258.401098 secs 2024-04-21T12:25:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:47 smithi170 ceph-mon[31212]: pgmap v3965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7258.401098 secs 2024-04-21T12:25:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:49 smithi077 ceph-mon[27902]: pgmap v3966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7260.162147 secs 2024-04-21T12:25:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:49 smithi191 ceph-mon[31636]: pgmap v3966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7260.162147 secs 2024-04-21T12:25:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:49 smithi170 ceph-mon[31212]: pgmap v3966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7260.162147 secs 2024-04-21T12:25:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:51 smithi077 ceph-mon[27902]: pgmap v3967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:51 smithi191 ceph-mon[31636]: pgmap v3967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:51 smithi170 ceph-mon[31212]: pgmap v3967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7263.401173 secs 2024-04-21T12:25:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7263.401173 secs 2024-04-21T12:25:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7263.401173 secs 2024-04-21T12:25:54.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:53 smithi077 ceph-mon[27902]: pgmap v3968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:53 smithi191 ceph-mon[31636]: pgmap v3968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:53 smithi170 ceph-mon[31212]: pgmap v3968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:25:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7265.162274 secs 2024-04-21T12:25:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7265.162274 secs 2024-04-21T12:25:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7265.162274 secs 2024-04-21T12:25:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:25:55.348+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:25:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:25:55.348+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:25:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:25:55.348+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:25:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:25:55.348+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:25:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:55 smithi077 ceph-mon[27902]: pgmap v3969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:55 smithi191 ceph-mon[31636]: pgmap v3969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:55 smithi170 ceph-mon[31212]: pgmap v3969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:25:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:57 smithi077 ceph-mon[27902]: pgmap v3970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7268.401288 secs 2024-04-21T12:25:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:57 smithi191 ceph-mon[31636]: pgmap v3970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7268.401288 secs 2024-04-21T12:25:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:57 smithi170 ceph-mon[31212]: pgmap v3970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:25:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7268.401288 secs 2024-04-21T12:26:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:59 smithi077 ceph-mon[27902]: pgmap v3971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7270.162335 secs 2024-04-21T12:26:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:59 smithi191 ceph-mon[31636]: pgmap v3971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7270.162335 secs 2024-04-21T12:26:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:59 smithi170 ceph-mon[31212]: pgmap v3971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7270.162335 secs 2024-04-21T12:26:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:01 smithi077 ceph-mon[27902]: pgmap v3972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2024-04-21T12:26:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:01 smithi191 ceph-mon[31636]: pgmap v3972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2024-04-21T12:26:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:01 smithi170 ceph-mon[31212]: pgmap v3972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2024-04-21T12:26:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7273.401421 secs 2024-04-21T12:26:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7273.401421 secs 2024-04-21T12:26:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7273.401421 secs 2024-04-21T12:26:04.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:03 smithi077 ceph-mon[27902]: pgmap v3973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-21T12:26:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:03 smithi191 ceph-mon[31636]: pgmap v3973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-21T12:26:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:03 smithi170 ceph-mon[31212]: pgmap v3973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-21T12:26:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7275.162446 secs 2024-04-21T12:26:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:04 smithi077 ceph-mon[27902]: osdmap e321: 12 total, 12 up, 12 in 2024-04-21T12:26:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7275.162446 secs 2024-04-21T12:26:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:04 smithi191 ceph-mon[31636]: osdmap e321: 12 total, 12 up, 12 in 2024-04-21T12:26:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7275.162446 secs 2024-04-21T12:26:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:04 smithi170 ceph-mon[31212]: osdmap e321: 12 total, 12 up, 12 in 2024-04-21T12:26:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:05 smithi077 ceph-mon[27902]: pgmap v3975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-04-21T12:26:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:05 smithi191 ceph-mon[31636]: pgmap v3975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-04-21T12:26:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:05 smithi170 ceph-mon[31212]: pgmap v3975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-04-21T12:26:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:07 smithi077 ceph-mon[27902]: pgmap v3976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:26:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7278.401528 secs 2024-04-21T12:26:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:07 smithi077 ceph-mon[27902]: osdmap e322: 12 total, 12 up, 12 in 2024-04-21T12:26:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:07 smithi191 ceph-mon[31636]: pgmap v3976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:26:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7278.401528 secs 2024-04-21T12:26:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:07 smithi191 ceph-mon[31636]: osdmap e322: 12 total, 12 up, 12 in 2024-04-21T12:26:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:07 smithi170 ceph-mon[31212]: pgmap v3976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:26:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7278.401528 secs 2024-04-21T12:26:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:07 smithi170 ceph-mon[31212]: osdmap e322: 12 total, 12 up, 12 in 2024-04-21T12:26:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:09 smithi077 ceph-mon[27902]: pgmap v3978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-04-21T12:26:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7280.162588 secs 2024-04-21T12:26:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:09 smithi191 ceph-mon[31636]: pgmap v3978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-04-21T12:26:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7280.162588 secs 2024-04-21T12:26:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:09 smithi170 ceph-mon[31212]: pgmap v3978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-04-21T12:26:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7280.162588 secs 2024-04-21T12:26:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:11 smithi077 ceph-mon[27902]: pgmap v3979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 31 op/s 2024-04-21T12:26:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:26:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:11 smithi191 ceph-mon[31636]: pgmap v3979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 31 op/s 2024-04-21T12:26:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:26:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:11 smithi170 ceph-mon[31212]: pgmap v3979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 31 op/s 2024-04-21T12:26:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7283.401611 secs 2024-04-21T12:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:26:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:26:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7283.401611 secs 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7283.401611 secs 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:26:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:26:14.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:14 smithi191 ceph-mon[31636]: pgmap v3980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-04-21T12:26:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:14 smithi077 ceph-mon[27902]: pgmap v3980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-04-21T12:26:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:14 smithi170 ceph-mon[31212]: pgmap v3980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-04-21T12:26:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7285.162744 secs 2024-04-21T12:26:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7285.162744 secs 2024-04-21T12:26:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7285.162744 secs 2024-04-21T12:26:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:16 smithi077 ceph-mon[27902]: pgmap v3981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 25 op/s 2024-04-21T12:26:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:16 smithi191 ceph-mon[31636]: pgmap v3981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 25 op/s 2024-04-21T12:26:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:16 smithi170 ceph-mon[31212]: pgmap v3981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 25 op/s 2024-04-21T12:26:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:18 smithi077 ceph-mon[27902]: pgmap v3982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:26:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7288.401729 secs 2024-04-21T12:26:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:18 smithi191 ceph-mon[31636]: pgmap v3982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:26:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7288.401729 secs 2024-04-21T12:26:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:18 smithi170 ceph-mon[31212]: pgmap v3982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:26:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7288.401729 secs 2024-04-21T12:26:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:20 smithi077 ceph-mon[27902]: pgmap v3983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:26:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7290.162847 secs 2024-04-21T12:26:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:20 smithi191 ceph-mon[31636]: pgmap v3983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:26:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7290.162847 secs 2024-04-21T12:26:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:20 smithi170 ceph-mon[31212]: pgmap v3983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:26:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7290.162847 secs 2024-04-21T12:26:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:22 smithi077 ceph-mon[27902]: pgmap v3984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:26:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:22 smithi191 ceph-mon[31636]: pgmap v3984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:26:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:22 smithi170 ceph-mon[31212]: pgmap v3984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:26:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7293.401854 secs 2024-04-21T12:26:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7293.401854 secs 2024-04-21T12:26:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7293.401854 secs 2024-04-21T12:26:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:24 smithi077 ceph-mon[27902]: pgmap v3985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:24 smithi191 ceph-mon[31636]: pgmap v3985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:24 smithi170 ceph-mon[31212]: pgmap v3985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7295.162968 secs 2024-04-21T12:26:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7295.162968 secs 2024-04-21T12:26:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7295.162968 secs 2024-04-21T12:26:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:26 smithi077 ceph-mon[27902]: pgmap v3986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:26 smithi191 ceph-mon[31636]: pgmap v3986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:26 smithi170 ceph-mon[31212]: pgmap v3986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:28 smithi077 ceph-mon[27902]: pgmap v3987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7298.401964 secs 2024-04-21T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:28 smithi191 ceph-mon[31636]: pgmap v3987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7298.401964 secs 2024-04-21T12:26:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:28 smithi170 ceph-mon[31212]: pgmap v3987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7298.401964 secs 2024-04-21T12:26:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:30 smithi077 ceph-mon[27902]: pgmap v3988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7300.163086 secs 2024-04-21T12:26:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:30 smithi191 ceph-mon[31636]: pgmap v3988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7300.163086 secs 2024-04-21T12:26:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:30 smithi170 ceph-mon[31212]: pgmap v3988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7300.163086 secs 2024-04-21T12:26:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:32 smithi077 ceph-mon[27902]: pgmap v3989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:32 smithi191 ceph-mon[31636]: pgmap v3989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:32 smithi170 ceph-mon[31212]: pgmap v3989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7303.402075 secs 2024-04-21T12:26:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7303.402075 secs 2024-04-21T12:26:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7303.402075 secs 2024-04-21T12:26:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:34 smithi077 ceph-mon[27902]: pgmap v3990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:34 smithi191 ceph-mon[31636]: pgmap v3990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:34 smithi170 ceph-mon[31212]: pgmap v3990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7305.163167 secs 2024-04-21T12:26:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7305.163167 secs 2024-04-21T12:26:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7305.163167 secs 2024-04-21T12:26:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:36 smithi077 ceph-mon[27902]: pgmap v3991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:36 smithi191 ceph-mon[31636]: pgmap v3991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:36 smithi170 ceph-mon[31212]: pgmap v3991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:38 smithi077 ceph-mon[27902]: pgmap v3992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7308.402173 secs 2024-04-21T12:26:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:38 smithi191 ceph-mon[31636]: pgmap v3992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7308.402173 secs 2024-04-21T12:26:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:38 smithi170 ceph-mon[31212]: pgmap v3992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7308.402173 secs 2024-04-21T12:26:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:40 smithi077 ceph-mon[27902]: pgmap v3993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7310.163283 secs 2024-04-21T12:26:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:40 smithi191 ceph-mon[31636]: pgmap v3993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7310.163283 secs 2024-04-21T12:26:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:40 smithi170 ceph-mon[31212]: pgmap v3993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7310.163283 secs 2024-04-21T12:26:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:42 smithi191 ceph-mon[31636]: pgmap v3994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:42 smithi170 ceph-mon[31212]: pgmap v3994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:42 smithi077 ceph-mon[27902]: pgmap v3994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:43.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7313.402291 secs 2024-04-21T12:26:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7313.402291 secs 2024-04-21T12:26:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7313.402291 secs 2024-04-21T12:26:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:44 smithi191 ceph-mon[31636]: pgmap v3995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:44 smithi170 ceph-mon[31212]: pgmap v3995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:44 smithi077 ceph-mon[27902]: pgmap v3995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7315.163392 secs 2024-04-21T12:26:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7315.163392 secs 2024-04-21T12:26:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7315.163392 secs 2024-04-21T12:26:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:46 smithi191 ceph-mon[31636]: pgmap v3996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:46 smithi170 ceph-mon[31212]: pgmap v3996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:46 smithi077 ceph-mon[27902]: pgmap v3996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:48 smithi191 ceph-mon[31636]: pgmap v3997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7318.402433 secs 2024-04-21T12:26:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:48 smithi170 ceph-mon[31212]: pgmap v3997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7318.402433 secs 2024-04-21T12:26:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:48 smithi077 ceph-mon[27902]: pgmap v3997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7318.402433 secs 2024-04-21T12:26:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:50 smithi191 ceph-mon[31636]: pgmap v3998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7320.163509 secs 2024-04-21T12:26:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:50 smithi170 ceph-mon[31212]: pgmap v3998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7320.163509 secs 2024-04-21T12:26:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:50 smithi077 ceph-mon[27902]: pgmap v3998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7320.163509 secs 2024-04-21T12:26:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:52 smithi191 ceph-mon[31636]: pgmap v3999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:52 smithi170 ceph-mon[31212]: pgmap v3999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:52 smithi077 ceph-mon[27902]: pgmap v3999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7323.402497 secs 2024-04-21T12:26:53.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7323.402497 secs 2024-04-21T12:26:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7323.402497 secs 2024-04-21T12:26:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:54 smithi191 ceph-mon[31636]: pgmap v4000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:54 smithi170 ceph-mon[31212]: pgmap v4000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:54 smithi077 ceph-mon[27902]: pgmap v4000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:26:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7325.163646 secs 2024-04-21T12:26:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:55 smithi191 ceph-mon[31636]: pgmap v4001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7325.163646 secs 2024-04-21T12:26:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:55 smithi170 ceph-mon[31212]: pgmap v4001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7325.163646 secs 2024-04-21T12:26:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:55 smithi077 ceph-mon[27902]: pgmap v4001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:57 smithi077 ceph-mon[27902]: pgmap v4002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:57 smithi191 ceph-mon[31636]: pgmap v4002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:57 smithi170 ceph-mon[31212]: pgmap v4002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:26:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7328.402623 secs 2024-04-21T12:26:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7328.402623 secs 2024-04-21T12:26:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7328.402623 secs 2024-04-21T12:26:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:59 smithi077 ceph-mon[27902]: pgmap v4003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7330.163761 secs 2024-04-21T12:26:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:59 smithi191 ceph-mon[31636]: pgmap v4003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7330.163761 secs 2024-04-21T12:26:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:59 smithi170 ceph-mon[31212]: pgmap v4003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:26:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7330.163761 secs 2024-04-21T12:27:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:01 smithi077 ceph-mon[27902]: pgmap v4004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:01 smithi191 ceph-mon[31636]: pgmap v4004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:01 smithi170 ceph-mon[31212]: pgmap v4004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7333.402738 secs 2024-04-21T12:27:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:03 smithi077 ceph-mon[27902]: pgmap v4005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7333.402738 secs 2024-04-21T12:27:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:03 smithi191 ceph-mon[31636]: pgmap v4005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7333.402738 secs 2024-04-21T12:27:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:03 smithi170 ceph-mon[31212]: pgmap v4005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7335.163839 secs 2024-04-21T12:27:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:04 smithi077 ceph-mon[27902]: osdmap e323: 12 total, 12 up, 12 in 2024-04-21T12:27:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7335.163839 secs 2024-04-21T12:27:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:04 smithi191 ceph-mon[31636]: osdmap e323: 12 total, 12 up, 12 in 2024-04-21T12:27:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7335.163839 secs 2024-04-21T12:27:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:04 smithi170 ceph-mon[31212]: osdmap e323: 12 total, 12 up, 12 in 2024-04-21T12:27:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:05 smithi077 ceph-mon[27902]: pgmap v4007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:27:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:05 smithi191 ceph-mon[31636]: pgmap v4007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:27:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:05 smithi170 ceph-mon[31212]: pgmap v4007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:27:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:07 smithi077 ceph-mon[27902]: pgmap v4008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:27:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:07 smithi191 ceph-mon[31636]: pgmap v4008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:27:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:07 smithi170 ceph-mon[31212]: pgmap v4008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:27:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7338.402852 secs 2024-04-21T12:27:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:08 smithi077 ceph-mon[27902]: osdmap e324: 12 total, 12 up, 12 in 2024-04-21T12:27:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7338.402852 secs 2024-04-21T12:27:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:08 smithi191 ceph-mon[31636]: osdmap e324: 12 total, 12 up, 12 in 2024-04-21T12:27:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7338.402852 secs 2024-04-21T12:27:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:08 smithi170 ceph-mon[31212]: osdmap e324: 12 total, 12 up, 12 in 2024-04-21T12:27:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:09 smithi170 ceph-mon[31212]: pgmap v4010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:27:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7340.163975 secs 2024-04-21T12:27:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:09 smithi077 ceph-mon[27902]: pgmap v4010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:27:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7340.163975 secs 2024-04-21T12:27:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:09 smithi191 ceph-mon[31636]: pgmap v4010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:27:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7340.163975 secs 2024-04-21T12:27:12.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:11 smithi170 ceph-mon[31212]: pgmap v4011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:27:12.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:11 smithi077 ceph-mon[27902]: pgmap v4011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:27:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:11 smithi191 ceph-mon[31636]: pgmap v4011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:27:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7343.402949 secs 2024-04-21T12:27:13.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7343.402949 secs 2024-04-21T12:27:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7343.402949 secs 2024-04-21T12:27:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:13 smithi170 ceph-mon[31212]: pgmap v4012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:27:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:27:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:27:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:27:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:27:14.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:13 smithi191 ceph-mon[31636]: pgmap v4012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:27:14.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:27:14.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:27:14.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:27:14.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:27:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:13 smithi077 ceph-mon[27902]: pgmap v4012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:27:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:27:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:27:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:27:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:27:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7345.164039 secs 2024-04-21T12:27:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7345.164039 secs 2024-04-21T12:27:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7345.164039 secs 2024-04-21T12:27:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:15 smithi170 ceph-mon[31212]: pgmap v4013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:27:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:15 smithi077 ceph-mon[27902]: pgmap v4013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:27:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:15 smithi191 ceph-mon[31636]: pgmap v4013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:27:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:17 smithi170 ceph-mon[31212]: pgmap v4014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:27:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7348.403074 secs 2024-04-21T12:27:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:17 smithi077 ceph-mon[27902]: pgmap v4014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:27:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7348.403074 secs 2024-04-21T12:27:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:17 smithi191 ceph-mon[31636]: pgmap v4014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:27:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7348.403074 secs 2024-04-21T12:27:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:19 smithi170 ceph-mon[31212]: pgmap v4015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:27:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7350.164165 secs 2024-04-21T12:27:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:19 smithi077 ceph-mon[27902]: pgmap v4015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:27:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7350.164165 secs 2024-04-21T12:27:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:19 smithi191 ceph-mon[31636]: pgmap v4015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:27:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7350.164165 secs 2024-04-21T12:27:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:21 smithi170 ceph-mon[31212]: pgmap v4016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:27:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:21 smithi077 ceph-mon[27902]: pgmap v4016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:27:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:21 smithi191 ceph-mon[31636]: pgmap v4016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:27:23.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7353.403189 secs 2024-04-21T12:27:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7353.403189 secs 2024-04-21T12:27:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7353.403189 secs 2024-04-21T12:27:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:23 smithi170 ceph-mon[31212]: pgmap v4017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:24.060 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:23 smithi077 ceph-mon[27902]: pgmap v4017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:23 smithi191 ceph-mon[31636]: pgmap v4017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7355.164260 secs 2024-04-21T12:27:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7355.164260 secs 2024-04-21T12:27:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7355.164260 secs 2024-04-21T12:27:26.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:25 smithi170 ceph-mon[31212]: pgmap v4018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:26.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:25 smithi077 ceph-mon[27902]: pgmap v4018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:25 smithi191 ceph-mon[31636]: pgmap v4018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:27 smithi170 ceph-mon[31212]: pgmap v4019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7358.403260 secs 2024-04-21T12:27:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:27 smithi077 ceph-mon[27902]: pgmap v4019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7358.403260 secs 2024-04-21T12:27:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:27 smithi191 ceph-mon[31636]: pgmap v4019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7358.403260 secs 2024-04-21T12:27:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:29 smithi170 ceph-mon[31212]: pgmap v4020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7360.164381 secs 2024-04-21T12:27:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:29 smithi077 ceph-mon[27902]: pgmap v4020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7360.164381 secs 2024-04-21T12:27:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:29 smithi191 ceph-mon[31636]: pgmap v4020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7360.164381 secs 2024-04-21T12:27:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:31 smithi170 ceph-mon[31212]: pgmap v4021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:32.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:31 smithi077 ceph-mon[27902]: pgmap v4021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:31 smithi191 ceph-mon[31636]: pgmap v4021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7363.403377 secs 2024-04-21T12:27:33.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7363.403377 secs 2024-04-21T12:27:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7363.403377 secs 2024-04-21T12:27:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:33 smithi170 ceph-mon[31212]: pgmap v4022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:33 smithi077 ceph-mon[27902]: pgmap v4022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:33 smithi191 ceph-mon[31636]: pgmap v4022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7365.164523 secs 2024-04-21T12:27:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7365.164523 secs 2024-04-21T12:27:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7365.164523 secs 2024-04-21T12:27:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:35 smithi170 ceph-mon[31212]: pgmap v4023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:35 smithi077 ceph-mon[27902]: pgmap v4023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:35 smithi191 ceph-mon[31636]: pgmap v4023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:37 smithi170 ceph-mon[31212]: pgmap v4024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7368.403510 secs 2024-04-21T12:27:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:37 smithi077 ceph-mon[27902]: pgmap v4024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7368.403510 secs 2024-04-21T12:27:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:37 smithi191 ceph-mon[31636]: pgmap v4024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7368.403510 secs 2024-04-21T12:27:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7370.164643 secs 2024-04-21T12:27:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:39 smithi170 ceph-mon[31212]: pgmap v4025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7370.164643 secs 2024-04-21T12:27:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:39 smithi077 ceph-mon[27902]: pgmap v4025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7370.164643 secs 2024-04-21T12:27:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:39 smithi191 ceph-mon[31636]: pgmap v4025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:41 smithi077 ceph-mon[27902]: pgmap v4026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:41 smithi191 ceph-mon[31636]: pgmap v4026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:41 smithi170 ceph-mon[31212]: pgmap v4026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7373.403620 secs 2024-04-21T12:27:43.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7373.403620 secs 2024-04-21T12:27:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7373.403620 secs 2024-04-21T12:27:44.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:43 smithi191 ceph-mon[31636]: pgmap v4027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:43 smithi077 ceph-mon[27902]: pgmap v4027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:43 smithi170 ceph-mon[31212]: pgmap v4027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7375.164761 secs 2024-04-21T12:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7375.164761 secs 2024-04-21T12:27:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7375.164761 secs 2024-04-21T12:27:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:45 smithi077 ceph-mon[27902]: pgmap v4028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:46.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:45 smithi191 ceph-mon[31636]: pgmap v4028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:45 smithi170 ceph-mon[31212]: pgmap v4028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:47 smithi077 ceph-mon[27902]: pgmap v4029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7378.403680 secs 2024-04-21T12:27:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:47 smithi191 ceph-mon[31636]: pgmap v4029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7378.403680 secs 2024-04-21T12:27:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:47 smithi170 ceph-mon[31212]: pgmap v4029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7378.403680 secs 2024-04-21T12:27:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7380.164900 secs 2024-04-21T12:27:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:49 smithi077 ceph-mon[27902]: pgmap v4030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7380.164900 secs 2024-04-21T12:27:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:49 smithi191 ceph-mon[31636]: pgmap v4030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7380.164900 secs 2024-04-21T12:27:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:49 smithi170 ceph-mon[31212]: pgmap v4030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:51 smithi077 ceph-mon[27902]: pgmap v4031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:51 smithi191 ceph-mon[31636]: pgmap v4031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:51 smithi170 ceph-mon[31212]: pgmap v4031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7383.403819 secs 2024-04-21T12:27:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7383.403819 secs 2024-04-21T12:27:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7383.403819 secs 2024-04-21T12:27:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:53 smithi077 ceph-mon[27902]: pgmap v4032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:53 smithi191 ceph-mon[31636]: pgmap v4032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:53 smithi170 ceph-mon[31212]: pgmap v4032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:27:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7385.165024 secs 2024-04-21T12:27:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7385.165024 secs 2024-04-21T12:27:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7385.165024 secs 2024-04-21T12:27:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:55 smithi077 ceph-mon[27902]: pgmap v4033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:55 smithi191 ceph-mon[31636]: pgmap v4033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:55 smithi170 ceph-mon[31212]: pgmap v4033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:27:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:57 smithi077 ceph-mon[27902]: pgmap v4034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7388.403902 secs 2024-04-21T12:27:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:57 smithi191 ceph-mon[31636]: pgmap v4034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7388.403902 secs 2024-04-21T12:27:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:57 smithi170 ceph-mon[31212]: pgmap v4034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:27:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7388.403902 secs 2024-04-21T12:28:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7390.165088 secs 2024-04-21T12:28:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:27:59 smithi077 ceph-mon[27902]: pgmap v4035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7390.165088 secs 2024-04-21T12:28:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:27:59 smithi191 ceph-mon[31636]: pgmap v4035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7390.165088 secs 2024-04-21T12:28:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:27:59 smithi170 ceph-mon[31212]: pgmap v4035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:01 smithi077 ceph-mon[27902]: pgmap v4036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:01 smithi191 ceph-mon[31636]: pgmap v4036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:01 smithi170 ceph-mon[31212]: pgmap v4036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7393.404028 secs 2024-04-21T12:28:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7393.404028 secs 2024-04-21T12:28:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7393.404028 secs 2024-04-21T12:28:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:03 smithi077 ceph-mon[27902]: pgmap v4037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:03 smithi191 ceph-mon[31636]: pgmap v4037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:03 smithi170 ceph-mon[31212]: pgmap v4037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7395.165211 secs 2024-04-21T12:28:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:04 smithi077 ceph-mon[27902]: osdmap e325: 12 total, 12 up, 12 in 2024-04-21T12:28:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7395.165211 secs 2024-04-21T12:28:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:04 smithi191 ceph-mon[31636]: osdmap e325: 12 total, 12 up, 12 in 2024-04-21T12:28:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7395.165211 secs 2024-04-21T12:28:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:04 smithi170 ceph-mon[31212]: osdmap e325: 12 total, 12 up, 12 in 2024-04-21T12:28:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:05 smithi077 ceph-mon[27902]: pgmap v4039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:28:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:05 smithi191 ceph-mon[31636]: pgmap v4039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:28:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:05 smithi170 ceph-mon[31212]: pgmap v4039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:28:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:07 smithi191 ceph-mon[31636]: pgmap v4040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:28:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7398.404146 secs 2024-04-21T12:28:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:07 smithi191 ceph-mon[31636]: osdmap e326: 12 total, 12 up, 12 in 2024-04-21T12:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:07 smithi170 ceph-mon[31212]: pgmap v4040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7398.404146 secs 2024-04-21T12:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:07 smithi170 ceph-mon[31212]: osdmap e326: 12 total, 12 up, 12 in 2024-04-21T12:28:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:07 smithi077 ceph-mon[27902]: pgmap v4040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:28:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7398.404146 secs 2024-04-21T12:28:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:07 smithi077 ceph-mon[27902]: osdmap e326: 12 total, 12 up, 12 in 2024-04-21T12:28:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7400.165352 secs 2024-04-21T12:28:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:09 smithi191 ceph-mon[31636]: pgmap v4042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:28:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7400.165352 secs 2024-04-21T12:28:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:09 smithi170 ceph-mon[31212]: pgmap v4042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:28:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7400.165352 secs 2024-04-21T12:28:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:09 smithi077 ceph-mon[27902]: pgmap v4042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:28:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:11 smithi191 ceph-mon[31636]: pgmap v4043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:28:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:11 smithi170 ceph-mon[31212]: pgmap v4043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:28:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:11 smithi077 ceph-mon[27902]: pgmap v4043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:28:13.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7403.404290 secs 2024-04-21T12:28:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7403.404290 secs 2024-04-21T12:28:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7403.404290 secs 2024-04-21T12:28:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:13 smithi191 ceph-mon[31636]: pgmap v4044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:28:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:28:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:13 smithi170 ceph-mon[31212]: pgmap v4044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:28:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:28:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:13 smithi077 ceph-mon[27902]: pgmap v4044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:28:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:28:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7405.165495 secs 2024-04-21T12:28:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:28:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:28:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:28:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7405.165495 secs 2024-04-21T12:28:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:28:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:28:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:28:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7405.165495 secs 2024-04-21T12:28:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:28:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:28:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:28:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:15 smithi191 ceph-mon[31636]: pgmap v4045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:28:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:15 smithi170 ceph-mon[31212]: pgmap v4045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:28:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:15 smithi077 ceph-mon[27902]: pgmap v4045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:28:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:17 smithi191 ceph-mon[31636]: pgmap v4046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:28:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7408.404428 secs 2024-04-21T12:28:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:17 smithi170 ceph-mon[31212]: pgmap v4046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:28:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7408.404428 secs 2024-04-21T12:28:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:17 smithi077 ceph-mon[27902]: pgmap v4046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:28:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7408.404428 secs 2024-04-21T12:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7410.165629 secs 2024-04-21T12:28:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:19 smithi191 ceph-mon[31636]: pgmap v4047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:28:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7410.165629 secs 2024-04-21T12:28:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:19 smithi170 ceph-mon[31212]: pgmap v4047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:28:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7410.165629 secs 2024-04-21T12:28:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:19 smithi077 ceph-mon[27902]: pgmap v4047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:28:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:21 smithi191 ceph-mon[31636]: pgmap v4048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:28:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:21 smithi170 ceph-mon[31212]: pgmap v4048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:28:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:21 smithi077 ceph-mon[27902]: pgmap v4048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:28:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7413.404560 secs 2024-04-21T12:28:23.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7413.404560 secs 2024-04-21T12:28:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7413.404560 secs 2024-04-21T12:28:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:23 smithi191 ceph-mon[31636]: pgmap v4049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:23 smithi170 ceph-mon[31212]: pgmap v4049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:23 smithi077 ceph-mon[27902]: pgmap v4049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7415.165751 secs 2024-04-21T12:28:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7415.165751 secs 2024-04-21T12:28:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7415.165751 secs 2024-04-21T12:28:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:25 smithi191 ceph-mon[31636]: pgmap v4050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:25 smithi170 ceph-mon[31212]: pgmap v4050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:25 smithi077 ceph-mon[27902]: pgmap v4050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:27 smithi191 ceph-mon[31636]: pgmap v4051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7418.404685 secs 2024-04-21T12:28:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:27 smithi170 ceph-mon[31212]: pgmap v4051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7418.404685 secs 2024-04-21T12:28:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:27 smithi077 ceph-mon[27902]: pgmap v4051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7418.404685 secs 2024-04-21T12:28:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7420.165904 secs 2024-04-21T12:28:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:29 smithi191 ceph-mon[31636]: pgmap v4052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7420.165904 secs 2024-04-21T12:28:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:29 smithi170 ceph-mon[31212]: pgmap v4052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7420.165904 secs 2024-04-21T12:28:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:29 smithi077 ceph-mon[27902]: pgmap v4052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:31 smithi191 ceph-mon[31636]: pgmap v4053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:31 smithi170 ceph-mon[31212]: pgmap v4053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:31 smithi077 ceph-mon[27902]: pgmap v4053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:33.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7423.404826 secs 2024-04-21T12:28:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7423.404826 secs 2024-04-21T12:28:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7423.404826 secs 2024-04-21T12:28:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:33 smithi191 ceph-mon[31636]: pgmap v4054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:33 smithi170 ceph-mon[31212]: pgmap v4054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:33 smithi077 ceph-mon[27902]: pgmap v4054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7425.165991 secs 2024-04-21T12:28:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7425.165991 secs 2024-04-21T12:28:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7425.165991 secs 2024-04-21T12:28:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:35 smithi191 ceph-mon[31636]: pgmap v4055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:35 smithi170 ceph-mon[31212]: pgmap v4055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:35 smithi077 ceph-mon[27902]: pgmap v4055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:37 smithi191 ceph-mon[31636]: pgmap v4056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7428.404953 secs 2024-04-21T12:28:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:37 smithi170 ceph-mon[31212]: pgmap v4056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7428.404953 secs 2024-04-21T12:28:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:37 smithi077 ceph-mon[27902]: pgmap v4056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7428.404953 secs 2024-04-21T12:28:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7430.166105 secs 2024-04-21T12:28:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:39 smithi191 ceph-mon[31636]: pgmap v4057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7430.166105 secs 2024-04-21T12:28:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:39 smithi170 ceph-mon[31212]: pgmap v4057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7430.166105 secs 2024-04-21T12:28:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:39 smithi077 ceph-mon[27902]: pgmap v4057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:41 smithi191 ceph-mon[31636]: pgmap v4058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:41 smithi170 ceph-mon[31212]: pgmap v4058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:41 smithi077 ceph-mon[27902]: pgmap v4058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7433.405068 secs 2024-04-21T12:28:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7433.405068 secs 2024-04-21T12:28:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7433.405068 secs 2024-04-21T12:28:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:43 smithi170 ceph-mon[31212]: pgmap v4059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:44.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:43 smithi191 ceph-mon[31636]: pgmap v4059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:43 smithi077 ceph-mon[27902]: pgmap v4059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7435.166192 secs 2024-04-21T12:28:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7435.166192 secs 2024-04-21T12:28:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7435.166192 secs 2024-04-21T12:28:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:45 smithi170 ceph-mon[31212]: pgmap v4060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:45 smithi077 ceph-mon[27902]: pgmap v4060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:45 smithi191 ceph-mon[31636]: pgmap v4060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:47 smithi170 ceph-mon[31212]: pgmap v4061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7438.405198 secs 2024-04-21T12:28:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:47 smithi077 ceph-mon[27902]: pgmap v4061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7438.405198 secs 2024-04-21T12:28:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:47 smithi191 ceph-mon[31636]: pgmap v4061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7438.405198 secs 2024-04-21T12:28:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7440.166324 secs 2024-04-21T12:28:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:49 smithi170 ceph-mon[31212]: pgmap v4062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7440.166324 secs 2024-04-21T12:28:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:49 smithi077 ceph-mon[27902]: pgmap v4062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7440.166324 secs 2024-04-21T12:28:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:49 smithi191 ceph-mon[31636]: pgmap v4062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:51 smithi170 ceph-mon[31212]: pgmap v4063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:51 smithi077 ceph-mon[27902]: pgmap v4063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:51 smithi191 ceph-mon[31636]: pgmap v4063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:53.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7443.405316 secs 2024-04-21T12:28:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7443.405316 secs 2024-04-21T12:28:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7443.405316 secs 2024-04-21T12:28:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:53 smithi170 ceph-mon[31212]: pgmap v4064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:53 smithi077 ceph-mon[27902]: pgmap v4064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.416+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.416+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.416+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efd70009b00 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.416+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efd70009b00 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.416+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.417+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.417+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.417+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.417+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.417+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a49e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7004c040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T12:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.420+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T12:28:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.420+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T12:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.420+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.420+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T12:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.420+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.421+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T12:28:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:54.421+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T12:28:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:53 smithi191 ceph-mon[31636]: pgmap v4064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:28:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7445.166448 secs 2024-04-21T12:28:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:55.373+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:28:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:55.373+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:28:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:55.373+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:28:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:28:55.373+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:28:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7445.166448 secs 2024-04-21T12:28:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7445.166448 secs 2024-04-21T12:28:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:56 smithi170 ceph-mon[31212]: pgmap v4065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:56 smithi077 ceph-mon[27902]: pgmap v4065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:56 smithi191 ceph-mon[31636]: pgmap v4065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:28:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:58 smithi170 ceph-mon[31212]: pgmap v4066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:28:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7448.405436 secs 2024-04-21T12:28:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:58 smithi077 ceph-mon[27902]: pgmap v4066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:28:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7448.405436 secs 2024-04-21T12:28:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:58 smithi191 ceph-mon[31636]: pgmap v4066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:28:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:28:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7448.405436 secs 2024-04-21T12:29:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7450.166589 secs 2024-04-21T12:29:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:00 smithi170 ceph-mon[31212]: pgmap v4067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7450.166589 secs 2024-04-21T12:29:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:00 smithi077 ceph-mon[27902]: pgmap v4067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7450.166589 secs 2024-04-21T12:29:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:00 smithi191 ceph-mon[31636]: pgmap v4067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:02 smithi170 ceph-mon[31212]: pgmap v4068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:02 smithi077 ceph-mon[27902]: pgmap v4068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:02 smithi191 ceph-mon[31636]: pgmap v4068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7453.405581 secs 2024-04-21T12:29:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7453.405581 secs 2024-04-21T12:29:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7453.405581 secs 2024-04-21T12:29:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:04 smithi170 ceph-mon[31212]: pgmap v4069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:04 smithi077 ceph-mon[27902]: pgmap v4069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:04 smithi191 ceph-mon[31636]: pgmap v4069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7455.166689 secs 2024-04-21T12:29:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:05 smithi170 ceph-mon[31212]: osdmap e327: 12 total, 12 up, 12 in 2024-04-21T12:29:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7455.166689 secs 2024-04-21T12:29:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:05 smithi077 ceph-mon[27902]: osdmap e327: 12 total, 12 up, 12 in 2024-04-21T12:29:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7455.166689 secs 2024-04-21T12:29:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:05 smithi191 ceph-mon[31636]: osdmap e327: 12 total, 12 up, 12 in 2024-04-21T12:29:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:06 smithi170 ceph-mon[31212]: pgmap v4071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:29:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:06 smithi077 ceph-mon[27902]: pgmap v4071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:29:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:06 smithi191 ceph-mon[31636]: pgmap v4071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:08 smithi170 ceph-mon[31212]: pgmap v4072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7458.405706 secs 2024-04-21T12:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:08 smithi170 ceph-mon[31212]: osdmap e328: 12 total, 12 up, 12 in 2024-04-21T12:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:08 smithi077 ceph-mon[27902]: pgmap v4072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7458.405706 secs 2024-04-21T12:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:08 smithi077 ceph-mon[27902]: osdmap e328: 12 total, 12 up, 12 in 2024-04-21T12:29:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:08 smithi191 ceph-mon[31636]: pgmap v4072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:29:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7458.405706 secs 2024-04-21T12:29:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:08 smithi191 ceph-mon[31636]: osdmap e328: 12 total, 12 up, 12 in 2024-04-21T12:29:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7460.166809 secs 2024-04-21T12:29:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:10 smithi170 ceph-mon[31212]: pgmap v4074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:29:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7460.166809 secs 2024-04-21T12:29:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:10 smithi077 ceph-mon[27902]: pgmap v4074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:29:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7460.166809 secs 2024-04-21T12:29:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:10 smithi191 ceph-mon[31636]: pgmap v4074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:29:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:12 smithi170 ceph-mon[31212]: pgmap v4075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:29:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:12 smithi077 ceph-mon[27902]: pgmap v4075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:29:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:12 smithi191 ceph-mon[31636]: pgmap v4075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:29:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7463.405781 secs 2024-04-21T12:29:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7463.405781 secs 2024-04-21T12:29:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7463.405781 secs 2024-04-21T12:29:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:14 smithi170 ceph-mon[31212]: pgmap v4076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:29:14.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:14 smithi191 ceph-mon[31636]: pgmap v4076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:29:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:14 smithi077 ceph-mon[27902]: pgmap v4076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:29:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7465.166936 secs 2024-04-21T12:29:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:29:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:29:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:29:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:29:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7465.166936 secs 2024-04-21T12:29:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:29:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:29:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:29:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:29:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7465.166936 secs 2024-04-21T12:29:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:29:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:29:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:29:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:29:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:16 smithi077 ceph-mon[27902]: pgmap v4077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:29:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:16 smithi191 ceph-mon[31636]: pgmap v4077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:29:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:16 smithi170 ceph-mon[31212]: pgmap v4077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:29:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:18 smithi077 ceph-mon[27902]: pgmap v4078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:29:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7468.405805 secs 2024-04-21T12:29:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:18 smithi191 ceph-mon[31636]: pgmap v4078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:29:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7468.405805 secs 2024-04-21T12:29:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:18 smithi170 ceph-mon[31212]: pgmap v4078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:29:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7468.405805 secs 2024-04-21T12:29:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7470.167011 secs 2024-04-21T12:29:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:20 smithi077 ceph-mon[27902]: pgmap v4079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:29:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7470.167011 secs 2024-04-21T12:29:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:20 smithi191 ceph-mon[31636]: pgmap v4079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:29:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7470.167011 secs 2024-04-21T12:29:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:20 smithi170 ceph-mon[31212]: pgmap v4079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:29:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:22 smithi077 ceph-mon[27902]: pgmap v4080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:29:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:22 smithi191 ceph-mon[31636]: pgmap v4080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:29:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:22 smithi170 ceph-mon[31212]: pgmap v4080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:29:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7473.405925 secs 2024-04-21T12:29:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7473.405925 secs 2024-04-21T12:29:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7473.405925 secs 2024-04-21T12:29:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:24 smithi077 ceph-mon[27902]: pgmap v4081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:24 smithi191 ceph-mon[31636]: pgmap v4081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:24 smithi170 ceph-mon[31212]: pgmap v4081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7475.167137 secs 2024-04-21T12:29:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7475.167137 secs 2024-04-21T12:29:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7475.167137 secs 2024-04-21T12:29:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:26 smithi077 ceph-mon[27902]: pgmap v4082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:26 smithi191 ceph-mon[31636]: pgmap v4082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:26 smithi170 ceph-mon[31212]: pgmap v4082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:28 smithi077 ceph-mon[27902]: pgmap v4083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7478.405992 secs 2024-04-21T12:29:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:28 smithi191 ceph-mon[31636]: pgmap v4083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7478.405992 secs 2024-04-21T12:29:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:28 smithi170 ceph-mon[31212]: pgmap v4083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7478.405992 secs 2024-04-21T12:29:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7480.167266 secs 2024-04-21T12:29:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:30 smithi077 ceph-mon[27902]: pgmap v4084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7480.167266 secs 2024-04-21T12:29:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:30 smithi191 ceph-mon[31636]: pgmap v4084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7480.167266 secs 2024-04-21T12:29:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:30 smithi170 ceph-mon[31212]: pgmap v4084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:32 smithi077 ceph-mon[27902]: pgmap v4085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:32 smithi191 ceph-mon[31636]: pgmap v4085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:32 smithi170 ceph-mon[31212]: pgmap v4085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7483.406059 secs 2024-04-21T12:29:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7483.406059 secs 2024-04-21T12:29:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7483.406059 secs 2024-04-21T12:29:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:34 smithi077 ceph-mon[27902]: pgmap v4086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:34 smithi191 ceph-mon[31636]: pgmap v4086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:34 smithi170 ceph-mon[31212]: pgmap v4086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7485.167391 secs 2024-04-21T12:29:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7485.167391 secs 2024-04-21T12:29:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7485.167391 secs 2024-04-21T12:29:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:36 smithi077 ceph-mon[27902]: pgmap v4087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:36 smithi191 ceph-mon[31636]: pgmap v4087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:36 smithi170 ceph-mon[31212]: pgmap v4087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:38 smithi077 ceph-mon[27902]: pgmap v4088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7488.406181 secs 2024-04-21T12:29:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:38 smithi191 ceph-mon[31636]: pgmap v4088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7488.406181 secs 2024-04-21T12:29:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:38 smithi170 ceph-mon[31212]: pgmap v4088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7488.406181 secs 2024-04-21T12:29:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7490.167529 secs 2024-04-21T12:29:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:40 smithi077 ceph-mon[27902]: pgmap v4089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7490.167529 secs 2024-04-21T12:29:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:40 smithi191 ceph-mon[31636]: pgmap v4089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7490.167529 secs 2024-04-21T12:29:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:40 smithi170 ceph-mon[31212]: pgmap v4089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:42 smithi077 ceph-mon[27902]: pgmap v4090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:42 smithi191 ceph-mon[31636]: pgmap v4090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:42 smithi170 ceph-mon[31212]: pgmap v4090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7493.406300 secs 2024-04-21T12:29:43.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7493.406300 secs 2024-04-21T12:29:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7493.406300 secs 2024-04-21T12:29:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:44 smithi077 ceph-mon[27902]: pgmap v4091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:44 smithi191 ceph-mon[31636]: pgmap v4091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:44 smithi170 ceph-mon[31212]: pgmap v4091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7495.167631 secs 2024-04-21T12:29:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7495.167631 secs 2024-04-21T12:29:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7495.167631 secs 2024-04-21T12:29:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:46 smithi191 ceph-mon[31636]: pgmap v4092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:46 smithi170 ceph-mon[31212]: pgmap v4092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:46 smithi077 ceph-mon[27902]: pgmap v4092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:48 smithi191 ceph-mon[31636]: pgmap v4093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7498.406414 secs 2024-04-21T12:29:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:48 smithi170 ceph-mon[31212]: pgmap v4093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7498.406414 secs 2024-04-21T12:29:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:48 smithi077 ceph-mon[27902]: pgmap v4093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7498.406414 secs 2024-04-21T12:29:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7500.167770 secs 2024-04-21T12:29:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:50 smithi191 ceph-mon[31636]: pgmap v4094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7500.167770 secs 2024-04-21T12:29:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:50 smithi170 ceph-mon[31212]: pgmap v4094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7500.167770 secs 2024-04-21T12:29:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:50 smithi077 ceph-mon[27902]: pgmap v4094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:52 smithi191 ceph-mon[31636]: pgmap v4095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:52 smithi170 ceph-mon[31212]: pgmap v4095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:52 smithi077 ceph-mon[27902]: pgmap v4095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7503.406565 secs 2024-04-21T12:29:53.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7503.406565 secs 2024-04-21T12:29:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7503.406565 secs 2024-04-21T12:29:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:54 smithi191 ceph-mon[31636]: pgmap v4096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:54 smithi170 ceph-mon[31212]: pgmap v4096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:54 smithi077 ceph-mon[27902]: pgmap v4096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:29:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7505.167892 secs 2024-04-21T12:29:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7505.167892 secs 2024-04-21T12:29:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7505.167892 secs 2024-04-21T12:29:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:56 smithi191 ceph-mon[31636]: pgmap v4097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:56 smithi170 ceph-mon[31212]: pgmap v4097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:56 smithi077 ceph-mon[27902]: pgmap v4097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:29:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:58 smithi191 ceph-mon[31636]: pgmap v4098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:29:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7508.406689 secs 2024-04-21T12:29:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:58 smithi170 ceph-mon[31212]: pgmap v4098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:29:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7508.406689 secs 2024-04-21T12:29:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:58 smithi077 ceph-mon[27902]: pgmap v4098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:29:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:29:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7508.406689 secs 2024-04-21T12:30:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7510.168011 secs 2024-04-21T12:30:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:00 smithi191 ceph-mon[31636]: pgmap v4099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:30:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7510.168011 secs 2024-04-21T12:30:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:00 smithi170 ceph-mon[31212]: pgmap v4099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:30:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7510.168011 secs 2024-04-21T12:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:00 smithi077 ceph-mon[27902]: pgmap v4099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:30:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:02 smithi191 ceph-mon[31636]: pgmap v4100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:02 smithi170 ceph-mon[31212]: pgmap v4100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:02 smithi077 ceph-mon[27902]: pgmap v4100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7513.406802 secs 2024-04-21T12:30:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7513.406802 secs 2024-04-21T12:30:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7513.406802 secs 2024-04-21T12:30:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:04 smithi191 ceph-mon[31636]: pgmap v4101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:04 smithi170 ceph-mon[31212]: pgmap v4101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:04 smithi077 ceph-mon[27902]: pgmap v4101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7515.168118 secs 2024-04-21T12:30:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:05 smithi191 ceph-mon[31636]: osdmap e329: 12 total, 12 up, 12 in 2024-04-21T12:30:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7515.168118 secs 2024-04-21T12:30:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:05 smithi170 ceph-mon[31212]: osdmap e329: 12 total, 12 up, 12 in 2024-04-21T12:30:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7515.168118 secs 2024-04-21T12:30:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:05 smithi077 ceph-mon[27902]: osdmap e329: 12 total, 12 up, 12 in 2024-04-21T12:30:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:06 smithi191 ceph-mon[31636]: pgmap v4103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:30:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:06 smithi170 ceph-mon[31212]: pgmap v4103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:30:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:06 smithi077 ceph-mon[27902]: pgmap v4103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:30:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:07 smithi170 ceph-mon[31212]: pgmap v4104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:30:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:07 smithi077 ceph-mon[27902]: pgmap v4104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:30:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:07 smithi191 ceph-mon[31636]: pgmap v4104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:30:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7518.406917 secs 2024-04-21T12:30:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:08 smithi170 ceph-mon[31212]: osdmap e330: 12 total, 12 up, 12 in 2024-04-21T12:30:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7518.406917 secs 2024-04-21T12:30:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:08 smithi077 ceph-mon[27902]: osdmap e330: 12 total, 12 up, 12 in 2024-04-21T12:30:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7518.406917 secs 2024-04-21T12:30:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:08 smithi191 ceph-mon[31636]: osdmap e330: 12 total, 12 up, 12 in 2024-04-21T12:30:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:09 smithi170 ceph-mon[31212]: pgmap v4106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:30:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:09 smithi077 ceph-mon[27902]: pgmap v4106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:30:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:09 smithi191 ceph-mon[31636]: pgmap v4106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:30:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7520.168253 secs 2024-04-21T12:30:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7520.168253 secs 2024-04-21T12:30:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7520.168253 secs 2024-04-21T12:30:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:11 smithi170 ceph-mon[31212]: pgmap v4107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:30:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:11 smithi077 ceph-mon[27902]: pgmap v4107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:30:11.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:11 smithi191 ceph-mon[31636]: pgmap v4107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:30:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7523.406996 secs 2024-04-21T12:30:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:13 smithi191 ceph-mon[31636]: pgmap v4108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T12:30:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7523.406996 secs 2024-04-21T12:30:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:13 smithi170 ceph-mon[31212]: pgmap v4108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T12:30:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7523.406996 secs 2024-04-21T12:30:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:13 smithi077 ceph-mon[27902]: pgmap v4108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T12:30:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7525.168406 secs 2024-04-21T12:30:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7525.168406 secs 2024-04-21T12:30:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7525.168406 secs 2024-04-21T12:30:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:15 smithi191 ceph-mon[31636]: pgmap v4109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:30:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:30:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:15 smithi170 ceph-mon[31212]: pgmap v4109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:30:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:30:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:15 smithi077 ceph-mon[27902]: pgmap v4109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:30:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:30:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:30:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:30:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:30:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:30:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:30:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:30:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:30:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:30:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:30:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:17 smithi077 ceph-mon[27902]: pgmap v4110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:30:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7528.407106 secs 2024-04-21T12:30:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:17 smithi191 ceph-mon[31636]: pgmap v4110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:30:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7528.407106 secs 2024-04-21T12:30:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:17 smithi170 ceph-mon[31212]: pgmap v4110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:30:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7528.407106 secs 2024-04-21T12:30:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7530.168547 secs 2024-04-21T12:30:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:19 smithi077 ceph-mon[27902]: pgmap v4111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:30:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7530.168547 secs 2024-04-21T12:30:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:19 smithi191 ceph-mon[31636]: pgmap v4111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:30:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7530.168547 secs 2024-04-21T12:30:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:19 smithi170 ceph-mon[31212]: pgmap v4111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:30:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:21 smithi077 ceph-mon[27902]: pgmap v4112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:30:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:21 smithi191 ceph-mon[31636]: pgmap v4112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:30:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:21 smithi170 ceph-mon[31212]: pgmap v4112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:30:23.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7533.407243 secs 2024-04-21T12:30:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7533.407243 secs 2024-04-21T12:30:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7533.407243 secs 2024-04-21T12:30:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:23 smithi077 ceph-mon[27902]: pgmap v4113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:23 smithi191 ceph-mon[31636]: pgmap v4113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:23 smithi170 ceph-mon[31212]: pgmap v4113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:25.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7535.168674 secs 2024-04-21T12:30:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7535.168674 secs 2024-04-21T12:30:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7535.168674 secs 2024-04-21T12:30:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:25 smithi077 ceph-mon[27902]: pgmap v4114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:26.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:25 smithi191 ceph-mon[31636]: pgmap v4114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:25 smithi170 ceph-mon[31212]: pgmap v4114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:27 smithi077 ceph-mon[27902]: pgmap v4115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7538.407306 secs 2024-04-21T12:30:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:27 smithi191 ceph-mon[31636]: pgmap v4115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7538.407306 secs 2024-04-21T12:30:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:27 smithi170 ceph-mon[31212]: pgmap v4115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7538.407306 secs 2024-04-21T12:30:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7540.168786 secs 2024-04-21T12:30:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:29 smithi077 ceph-mon[27902]: pgmap v4116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7540.168786 secs 2024-04-21T12:30:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:29 smithi191 ceph-mon[31636]: pgmap v4116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7540.168786 secs 2024-04-21T12:30:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:29 smithi170 ceph-mon[31212]: pgmap v4116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:31 smithi077 ceph-mon[27902]: pgmap v4117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:32.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:31 smithi191 ceph-mon[31636]: pgmap v4117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:31 smithi170 ceph-mon[31212]: pgmap v4117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7543.407444 secs 2024-04-21T12:30:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7543.407444 secs 2024-04-21T12:30:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7543.407444 secs 2024-04-21T12:30:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:33 smithi077 ceph-mon[27902]: pgmap v4118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:34.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:33 smithi191 ceph-mon[31636]: pgmap v4118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:33 smithi170 ceph-mon[31212]: pgmap v4118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7545.168909 secs 2024-04-21T12:30:35.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7545.168909 secs 2024-04-21T12:30:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7545.168909 secs 2024-04-21T12:30:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:35 smithi077 ceph-mon[27902]: pgmap v4119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:35 smithi191 ceph-mon[31636]: pgmap v4119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:35 smithi170 ceph-mon[31212]: pgmap v4119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:37 smithi077 ceph-mon[27902]: pgmap v4120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7548.407602 secs 2024-04-21T12:30:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:37 smithi191 ceph-mon[31636]: pgmap v4120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7548.407602 secs 2024-04-21T12:30:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:37 smithi170 ceph-mon[31212]: pgmap v4120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7548.407602 secs 2024-04-21T12:30:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7550.169024 secs 2024-04-21T12:30:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:39 smithi077 ceph-mon[27902]: pgmap v4121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:40.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7550.169024 secs 2024-04-21T12:30:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:39 smithi191 ceph-mon[31636]: pgmap v4121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7550.169024 secs 2024-04-21T12:30:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:39 smithi170 ceph-mon[31212]: pgmap v4121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:42.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:41 smithi077 ceph-mon[27902]: pgmap v4122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:41 smithi191 ceph-mon[31636]: pgmap v4122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:41 smithi170 ceph-mon[31212]: pgmap v4122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:43.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7553.407737 secs 2024-04-21T12:30:43.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7553.407737 secs 2024-04-21T12:30:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7553.407737 secs 2024-04-21T12:30:44.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:43 smithi191 ceph-mon[31636]: pgmap v4123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:43 smithi170 ceph-mon[31212]: pgmap v4123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:43 smithi077 ceph-mon[27902]: pgmap v4123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:45.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7555.169149 secs 2024-04-21T12:30:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7555.169149 secs 2024-04-21T12:30:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7555.169149 secs 2024-04-21T12:30:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:45 smithi191 ceph-mon[31636]: pgmap v4124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:45 smithi170 ceph-mon[31212]: pgmap v4124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:45 smithi077 ceph-mon[27902]: pgmap v4124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7558.407849 secs 2024-04-21T12:30:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7558.407849 secs 2024-04-21T12:30:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7558.407849 secs 2024-04-21T12:30:48.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:47 smithi191 ceph-mon[31636]: pgmap v4125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:47 smithi170 ceph-mon[31212]: pgmap v4125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:47 smithi077 ceph-mon[27902]: pgmap v4125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7560.169245 secs 2024-04-21T12:30:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:49 smithi191 ceph-mon[31636]: pgmap v4126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7560.169245 secs 2024-04-21T12:30:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:49 smithi170 ceph-mon[31212]: pgmap v4126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7560.169245 secs 2024-04-21T12:30:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:49 smithi077 ceph-mon[27902]: pgmap v4126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:51 smithi191 ceph-mon[31636]: pgmap v4127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7563.407945 secs 2024-04-21T12:30:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:51 smithi170 ceph-mon[31212]: pgmap v4127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7563.407945 secs 2024-04-21T12:30:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:51 smithi077 ceph-mon[27902]: pgmap v4127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7563.407945 secs 2024-04-21T12:30:54.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:53 smithi077 ceph-mon[27902]: pgmap v4128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:53 smithi191 ceph-mon[31636]: pgmap v4128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:53 smithi170 ceph-mon[31212]: pgmap v4128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:30:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7565.169360 secs 2024-04-21T12:30:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7565.169360 secs 2024-04-21T12:30:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7565.169360 secs 2024-04-21T12:30:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:55 smithi191 ceph-mon[31636]: pgmap v4129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:55 smithi170 ceph-mon[31212]: pgmap v4129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:55 smithi077 ceph-mon[27902]: pgmap v4129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:30:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7568.408068 secs 2024-04-21T12:30:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7568.408068 secs 2024-04-21T12:30:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7568.408068 secs 2024-04-21T12:30:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:57 smithi191 ceph-mon[31636]: pgmap v4130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:57 smithi170 ceph-mon[31212]: pgmap v4130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:30:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:57 smithi077 ceph-mon[27902]: pgmap v4130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7570.169473 secs 2024-04-21T12:31:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:30:59 smithi191 ceph-mon[31636]: pgmap v4131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7570.169473 secs 2024-04-21T12:31:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:30:59 smithi170 ceph-mon[31212]: pgmap v4131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7570.169473 secs 2024-04-21T12:31:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:30:59 smithi077 ceph-mon[27902]: pgmap v4131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:01 smithi191 ceph-mon[31636]: pgmap v4132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7573.408193 secs 2024-04-21T12:31:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:01 smithi170 ceph-mon[31212]: pgmap v4132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7573.408193 secs 2024-04-21T12:31:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:01 smithi077 ceph-mon[27902]: pgmap v4132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7573.408193 secs 2024-04-21T12:31:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:03 smithi191 ceph-mon[31636]: pgmap v4133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:03 smithi170 ceph-mon[31212]: pgmap v4133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:03 smithi077 ceph-mon[27902]: pgmap v4133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7575.169585 secs 2024-04-21T12:31:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:04 smithi191 ceph-mon[31636]: osdmap e331: 12 total, 12 up, 12 in 2024-04-21T12:31:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7575.169585 secs 2024-04-21T12:31:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:04 smithi170 ceph-mon[31212]: osdmap e331: 12 total, 12 up, 12 in 2024-04-21T12:31:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7575.169585 secs 2024-04-21T12:31:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:04 smithi077 ceph-mon[27902]: osdmap e331: 12 total, 12 up, 12 in 2024-04-21T12:31:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:05 smithi191 ceph-mon[31636]: pgmap v4135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:31:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:05 smithi170 ceph-mon[31212]: pgmap v4135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:31:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:05 smithi077 ceph-mon[27902]: pgmap v4135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:31:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7578.408333 secs 2024-04-21T12:31:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7578.408333 secs 2024-04-21T12:31:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7578.408333 secs 2024-04-21T12:31:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:07 smithi191 ceph-mon[31636]: pgmap v4136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:31:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:07 smithi191 ceph-mon[31636]: osdmap e332: 12 total, 12 up, 12 in 2024-04-21T12:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:07 smithi170 ceph-mon[31212]: pgmap v4136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:07 smithi170 ceph-mon[31212]: osdmap e332: 12 total, 12 up, 12 in 2024-04-21T12:31:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:07 smithi077 ceph-mon[27902]: pgmap v4136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:31:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:07 smithi077 ceph-mon[27902]: osdmap e332: 12 total, 12 up, 12 in 2024-04-21T12:31:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7580.169715 secs 2024-04-21T12:31:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:09 smithi191 ceph-mon[31636]: pgmap v4138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:31:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7580.169715 secs 2024-04-21T12:31:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:09 smithi170 ceph-mon[31212]: pgmap v4138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:31:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7580.169715 secs 2024-04-21T12:31:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:09 smithi077 ceph-mon[27902]: pgmap v4138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:31:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:11 smithi170 ceph-mon[31212]: pgmap v4139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:31:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7583.408477 secs 2024-04-21T12:31:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:11 smithi077 ceph-mon[27902]: pgmap v4139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:31:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7583.408477 secs 2024-04-21T12:31:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:11 smithi191 ceph-mon[31636]: pgmap v4139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:31:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7583.408477 secs 2024-04-21T12:31:14.270 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:13 smithi191 ceph-mon[31636]: pgmap v4140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:31:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:13 smithi170 ceph-mon[31212]: pgmap v4140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:31:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:13 smithi077 ceph-mon[27902]: pgmap v4140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:31:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7585.169832 secs 2024-04-21T12:31:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7585.169832 secs 2024-04-21T12:31:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7585.169832 secs 2024-04-21T12:31:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:15 smithi170 ceph-mon[31212]: pgmap v4141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:31:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:31:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:15 smithi077 ceph-mon[27902]: pgmap v4141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:31:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:31:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:15 smithi191 ceph-mon[31636]: pgmap v4141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:31:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:31:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7588.408539 secs 2024-04-21T12:31:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:31:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:31:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7588.408539 secs 2024-04-21T12:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7588.408539 secs 2024-04-21T12:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:31:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:17 smithi170 ceph-mon[31212]: pgmap v4142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:31:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:17 smithi077 ceph-mon[27902]: pgmap v4142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:31:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:17 smithi191 ceph-mon[31636]: pgmap v4142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:31:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7590.169895 secs 2024-04-21T12:31:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:19 smithi170 ceph-mon[31212]: pgmap v4143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:31:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7590.169895 secs 2024-04-21T12:31:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:19 smithi077 ceph-mon[27902]: pgmap v4143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:31:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7590.169895 secs 2024-04-21T12:31:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:19 smithi191 ceph-mon[31636]: pgmap v4143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:31:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:21 smithi170 ceph-mon[31212]: pgmap v4144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:31:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7593.408651 secs 2024-04-21T12:31:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:21 smithi077 ceph-mon[27902]: pgmap v4144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:31:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7593.408651 secs 2024-04-21T12:31:22.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:21 smithi191 ceph-mon[31636]: pgmap v4144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:31:22.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7593.408651 secs 2024-04-21T12:31:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:24 smithi170 ceph-mon[31212]: pgmap v4145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:24 smithi077 ceph-mon[27902]: pgmap v4145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:24 smithi191 ceph-mon[31636]: pgmap v4145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7595.169991 secs 2024-04-21T12:31:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7595.169991 secs 2024-04-21T12:31:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7595.169991 secs 2024-04-21T12:31:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:26 smithi170 ceph-mon[31212]: pgmap v4146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:26 smithi077 ceph-mon[27902]: pgmap v4146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:26 smithi191 ceph-mon[31636]: pgmap v4146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7598.408783 secs 2024-04-21T12:31:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7598.408783 secs 2024-04-21T12:31:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7598.408783 secs 2024-04-21T12:31:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:28 smithi170 ceph-mon[31212]: pgmap v4147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:28 smithi077 ceph-mon[27902]: pgmap v4147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:28 smithi191 ceph-mon[31636]: pgmap v4147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7600.170129 secs 2024-04-21T12:31:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:30 smithi170 ceph-mon[31212]: pgmap v4148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7600.170129 secs 2024-04-21T12:31:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:30 smithi077 ceph-mon[27902]: pgmap v4148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7600.170129 secs 2024-04-21T12:31:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:30 smithi191 ceph-mon[31636]: pgmap v4148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:32 smithi170 ceph-mon[31212]: pgmap v4149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7603.408900 secs 2024-04-21T12:31:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:32 smithi077 ceph-mon[27902]: pgmap v4149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7603.408900 secs 2024-04-21T12:31:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:32 smithi191 ceph-mon[31636]: pgmap v4149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7603.408900 secs 2024-04-21T12:31:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:34 smithi170 ceph-mon[31212]: pgmap v4150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:34 smithi077 ceph-mon[27902]: pgmap v4150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:34 smithi191 ceph-mon[31636]: pgmap v4150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7605.170264 secs 2024-04-21T12:31:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7605.170264 secs 2024-04-21T12:31:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7605.170264 secs 2024-04-21T12:31:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:36 smithi170 ceph-mon[31212]: pgmap v4151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:36 smithi077 ceph-mon[27902]: pgmap v4151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:36 smithi191 ceph-mon[31636]: pgmap v4151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7608.409000 secs 2024-04-21T12:31:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7608.409000 secs 2024-04-21T12:31:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7608.409000 secs 2024-04-21T12:31:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:38 smithi170 ceph-mon[31212]: pgmap v4152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:38 smithi077 ceph-mon[27902]: pgmap v4152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:38 smithi191 ceph-mon[31636]: pgmap v4152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7610.170386 secs 2024-04-21T12:31:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:40 smithi170 ceph-mon[31212]: pgmap v4153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7610.170386 secs 2024-04-21T12:31:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:40 smithi077 ceph-mon[27902]: pgmap v4153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7610.170386 secs 2024-04-21T12:31:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:40 smithi191 ceph-mon[31636]: pgmap v4153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:42 smithi170 ceph-mon[31212]: pgmap v4154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7613.409121 secs 2024-04-21T12:31:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:42 smithi077 ceph-mon[27902]: pgmap v4154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7613.409121 secs 2024-04-21T12:31:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:42 smithi191 ceph-mon[31636]: pgmap v4154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7613.409121 secs 2024-04-21T12:31:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:44 smithi077 ceph-mon[27902]: pgmap v4155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:44 smithi191 ceph-mon[31636]: pgmap v4155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:44 smithi170 ceph-mon[31212]: pgmap v4155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7615.170484 secs 2024-04-21T12:31:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7615.170484 secs 2024-04-21T12:31:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7615.170484 secs 2024-04-21T12:31:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:46 smithi077 ceph-mon[27902]: pgmap v4156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:46 smithi191 ceph-mon[31636]: pgmap v4156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:46 smithi170 ceph-mon[31212]: pgmap v4156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7618.409192 secs 2024-04-21T12:31:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7618.409192 secs 2024-04-21T12:31:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7618.409192 secs 2024-04-21T12:31:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:48 smithi077 ceph-mon[27902]: pgmap v4157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:48 smithi191 ceph-mon[31636]: pgmap v4157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:48 smithi170 ceph-mon[31212]: pgmap v4157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7620.170626 secs 2024-04-21T12:31:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:50 smithi077 ceph-mon[27902]: pgmap v4158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7620.170626 secs 2024-04-21T12:31:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:50 smithi191 ceph-mon[31636]: pgmap v4158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7620.170626 secs 2024-04-21T12:31:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:50 smithi170 ceph-mon[31212]: pgmap v4158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:52 smithi077 ceph-mon[27902]: pgmap v4159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7623.409327 secs 2024-04-21T12:31:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:52 smithi191 ceph-mon[31636]: pgmap v4159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7623.409327 secs 2024-04-21T12:31:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:52 smithi170 ceph-mon[31212]: pgmap v4159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7623.409327 secs 2024-04-21T12:31:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:54 smithi077 ceph-mon[27902]: pgmap v4160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:54 smithi191 ceph-mon[31636]: pgmap v4160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:54 smithi170 ceph-mon[31212]: pgmap v4160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:31:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7625.170756 secs 2024-04-21T12:31:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:31:55.398+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:31:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:31:55.398+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:31:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:31:55.399+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:31:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:31:55.399+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:31:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7625.170756 secs 2024-04-21T12:31:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7625.170756 secs 2024-04-21T12:31:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:56 smithi077 ceph-mon[27902]: pgmap v4161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:56 smithi191 ceph-mon[31636]: pgmap v4161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:56 smithi170 ceph-mon[31212]: pgmap v4161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:31:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7628.409474 secs 2024-04-21T12:31:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7628.409474 secs 2024-04-21T12:31:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7628.409474 secs 2024-04-21T12:31:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:31:58 smithi077 ceph-mon[27902]: pgmap v4162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:31:58 smithi191 ceph-mon[31636]: pgmap v4162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:31:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:31:58 smithi170 ceph-mon[31212]: pgmap v4162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7630.170910 secs 2024-04-21T12:32:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:00 smithi077 ceph-mon[27902]: pgmap v4163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7630.170910 secs 2024-04-21T12:32:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:00 smithi191 ceph-mon[31636]: pgmap v4163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7630.170910 secs 2024-04-21T12:32:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:00 smithi170 ceph-mon[31212]: pgmap v4163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:02 smithi077 ceph-mon[27902]: pgmap v4164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7633.409608 secs 2024-04-21T12:32:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:02 smithi191 ceph-mon[31636]: pgmap v4164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7633.409608 secs 2024-04-21T12:32:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:02 smithi170 ceph-mon[31212]: pgmap v4164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7633.409608 secs 2024-04-21T12:32:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:04 smithi077 ceph-mon[27902]: pgmap v4165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:04.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:04 smithi191 ceph-mon[31636]: pgmap v4165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:04 smithi170 ceph-mon[31212]: pgmap v4165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7635.171035 secs 2024-04-21T12:32:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:05 smithi077 ceph-mon[27902]: osdmap e333: 12 total, 12 up, 12 in 2024-04-21T12:32:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7635.171035 secs 2024-04-21T12:32:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:05 smithi191 ceph-mon[31636]: osdmap e333: 12 total, 12 up, 12 in 2024-04-21T12:32:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7635.171035 secs 2024-04-21T12:32:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:05 smithi170 ceph-mon[31212]: osdmap e333: 12 total, 12 up, 12 in 2024-04-21T12:32:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:06 smithi077 ceph-mon[27902]: pgmap v4167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:32:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:06 smithi191 ceph-mon[31636]: pgmap v4167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:32:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:06 smithi170 ceph-mon[31212]: pgmap v4167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:32:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7638.409725 secs 2024-04-21T12:32:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7638.409725 secs 2024-04-21T12:32:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7638.409725 secs 2024-04-21T12:32:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:08 smithi077 ceph-mon[27902]: pgmap v4168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:32:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:08 smithi077 ceph-mon[27902]: osdmap e334: 12 total, 12 up, 12 in 2024-04-21T12:32:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:08 smithi191 ceph-mon[31636]: pgmap v4168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:32:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:08 smithi191 ceph-mon[31636]: osdmap e334: 12 total, 12 up, 12 in 2024-04-21T12:32:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:08 smithi170 ceph-mon[31212]: pgmap v4168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:32:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:08 smithi170 ceph-mon[31212]: osdmap e334: 12 total, 12 up, 12 in 2024-04-21T12:32:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7640.171114 secs 2024-04-21T12:32:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:10 smithi077 ceph-mon[27902]: pgmap v4170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:32:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7640.171114 secs 2024-04-21T12:32:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:10 smithi191 ceph-mon[31636]: pgmap v4170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:32:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7640.171114 secs 2024-04-21T12:32:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:10 smithi170 ceph-mon[31212]: pgmap v4170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:32:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:12 smithi191 ceph-mon[31636]: pgmap v4171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:32:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7643.409834 secs 2024-04-21T12:32:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:12 smithi170 ceph-mon[31212]: pgmap v4171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:32:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7643.409834 secs 2024-04-21T12:32:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:12 smithi077 ceph-mon[27902]: pgmap v4171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:32:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7643.409834 secs 2024-04-21T12:32:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:14 smithi191 ceph-mon[31636]: pgmap v4172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:32:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:14 smithi170 ceph-mon[31212]: pgmap v4172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:32:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:14 smithi077 ceph-mon[27902]: pgmap v4172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T12:32:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7645.171175 secs 2024-04-21T12:32:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7645.171175 secs 2024-04-21T12:32:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7645.171175 secs 2024-04-21T12:32:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:16 smithi191 ceph-mon[31636]: pgmap v4173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:32:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:16 smithi170 ceph-mon[31212]: pgmap v4173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:32:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:16 smithi077 ceph-mon[27902]: pgmap v4173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:32:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7648.409972 secs 2024-04-21T12:32:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:32:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7648.409972 secs 2024-04-21T12:32:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:32:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7648.409972 secs 2024-04-21T12:32:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:32:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:18 smithi191 ceph-mon[31636]: pgmap v4174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:32:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:32:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:32:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:32:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:18 smithi170 ceph-mon[31212]: pgmap v4174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:32:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:32:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:32:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:32:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:18 smithi077 ceph-mon[27902]: pgmap v4174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:32:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:32:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:32:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:32:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7650.171237 secs 2024-04-21T12:32:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:20 smithi191 ceph-mon[31636]: pgmap v4175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:32:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7650.171237 secs 2024-04-21T12:32:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:20 smithi170 ceph-mon[31212]: pgmap v4175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:32:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7650.171237 secs 2024-04-21T12:32:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:20 smithi077 ceph-mon[27902]: pgmap v4175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:32:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:22 smithi191 ceph-mon[31636]: pgmap v4176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:32:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7653.410096 secs 2024-04-21T12:32:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:22 smithi170 ceph-mon[31212]: pgmap v4176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:32:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7653.410096 secs 2024-04-21T12:32:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:22 smithi077 ceph-mon[27902]: pgmap v4176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:32:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7653.410096 secs 2024-04-21T12:32:24.437 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:24 smithi077 ceph-mon[27902]: pgmap v4177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:24.437 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7655.171353 secs 2024-04-21T12:32:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:24 smithi191 ceph-mon[31636]: pgmap v4177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7655.171353 secs 2024-04-21T12:32:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:24 smithi170 ceph-mon[31212]: pgmap v4177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7655.171353 secs 2024-04-21T12:32:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:26 smithi191 ceph-mon[31636]: pgmap v4178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:26 smithi170 ceph-mon[31212]: pgmap v4178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:26 smithi077 ceph-mon[27902]: pgmap v4178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7658.410230 secs 2024-04-21T12:32:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7658.410230 secs 2024-04-21T12:32:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7658.410230 secs 2024-04-21T12:32:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:28 smithi191 ceph-mon[31636]: pgmap v4179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:28 smithi170 ceph-mon[31212]: pgmap v4179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:28 smithi077 ceph-mon[27902]: pgmap v4179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7660.171472 secs 2024-04-21T12:32:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7660.171472 secs 2024-04-21T12:32:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7660.171472 secs 2024-04-21T12:32:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:30 smithi191 ceph-mon[31636]: pgmap v4180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:30 smithi170 ceph-mon[31212]: pgmap v4180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:30 smithi077 ceph-mon[27902]: pgmap v4180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:32 smithi191 ceph-mon[31636]: pgmap v4181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7663.410328 secs 2024-04-21T12:32:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:32 smithi170 ceph-mon[31212]: pgmap v4181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7663.410328 secs 2024-04-21T12:32:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:32 smithi077 ceph-mon[27902]: pgmap v4181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7663.410328 secs 2024-04-21T12:32:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:34 smithi191 ceph-mon[31636]: pgmap v4182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7665.171586 secs 2024-04-21T12:32:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:34 smithi170 ceph-mon[31212]: pgmap v4182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7665.171586 secs 2024-04-21T12:32:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:34 smithi077 ceph-mon[27902]: pgmap v4182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7665.171586 secs 2024-04-21T12:32:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:36 smithi191 ceph-mon[31636]: pgmap v4183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:36 smithi170 ceph-mon[31212]: pgmap v4183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:36 smithi077 ceph-mon[27902]: pgmap v4183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7668.410452 secs 2024-04-21T12:32:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7668.410452 secs 2024-04-21T12:32:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7668.410452 secs 2024-04-21T12:32:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:38 smithi191 ceph-mon[31636]: pgmap v4184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:38 smithi170 ceph-mon[31212]: pgmap v4184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:38 smithi077 ceph-mon[27902]: pgmap v4184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7670.171681 secs 2024-04-21T12:32:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7670.171681 secs 2024-04-21T12:32:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7670.171681 secs 2024-04-21T12:32:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:40.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:32:40.404+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:32:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:32:40.404+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:32:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:32:40.404+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:32:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:32:40.404+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:32:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:40 smithi191 ceph-mon[31636]: pgmap v4185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:40 smithi170 ceph-mon[31212]: pgmap v4185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:40 smithi077 ceph-mon[27902]: pgmap v4185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:42 smithi191 ceph-mon[31636]: pgmap v4186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7673.410570 secs 2024-04-21T12:32:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:42 smithi170 ceph-mon[31212]: pgmap v4186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7673.410570 secs 2024-04-21T12:32:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:42 smithi077 ceph-mon[27902]: pgmap v4186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7673.410570 secs 2024-04-21T12:32:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:44 smithi191 ceph-mon[31636]: pgmap v4187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7675.171816 secs 2024-04-21T12:32:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:44 smithi170 ceph-mon[31212]: pgmap v4187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7675.171816 secs 2024-04-21T12:32:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:44 smithi077 ceph-mon[27902]: pgmap v4187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7675.171816 secs 2024-04-21T12:32:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:46 smithi191 ceph-mon[31636]: pgmap v4188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:46 smithi170 ceph-mon[31212]: pgmap v4188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:46 smithi077 ceph-mon[27902]: pgmap v4188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7678.410681 secs 2024-04-21T12:32:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7678.410681 secs 2024-04-21T12:32:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7678.410681 secs 2024-04-21T12:32:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:48 smithi170 ceph-mon[31212]: pgmap v4189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:48 smithi077 ceph-mon[27902]: pgmap v4189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:48 smithi191 ceph-mon[31636]: pgmap v4189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7680.171941 secs 2024-04-21T12:32:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7680.171941 secs 2024-04-21T12:32:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7680.171941 secs 2024-04-21T12:32:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:50 smithi170 ceph-mon[31212]: pgmap v4190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:50 smithi077 ceph-mon[27902]: pgmap v4190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:50 smithi191 ceph-mon[31636]: pgmap v4190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:51 smithi170 ceph-mon[31212]: pgmap v4191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:51 smithi077 ceph-mon[27902]: pgmap v4191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:51 smithi191 ceph-mon[31636]: pgmap v4191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7683.410798 secs 2024-04-21T12:32:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7683.410798 secs 2024-04-21T12:32:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7683.410798 secs 2024-04-21T12:32:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:53 smithi170 ceph-mon[31212]: pgmap v4192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:53 smithi077 ceph-mon[27902]: pgmap v4192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:53 smithi191 ceph-mon[31636]: pgmap v4192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:54.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7685.172086 secs 2024-04-21T12:32:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7685.172086 secs 2024-04-21T12:32:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7685.172086 secs 2024-04-21T12:32:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:32:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:55 smithi170 ceph-mon[31212]: pgmap v4193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:55 smithi077 ceph-mon[27902]: pgmap v4193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:55 smithi191 ceph-mon[31636]: pgmap v4193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:57 smithi191 ceph-mon[31636]: pgmap v4194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7688.410924 secs 2024-04-21T12:32:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:57 smithi170 ceph-mon[31212]: pgmap v4194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7688.410924 secs 2024-04-21T12:32:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:57 smithi077 ceph-mon[27902]: pgmap v4194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:32:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7688.410924 secs 2024-04-21T12:32:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7690.172167 secs 2024-04-21T12:32:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7690.172167 secs 2024-04-21T12:32:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7690.172167 secs 2024-04-21T12:32:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:32:59 smithi191 ceph-mon[31636]: pgmap v4195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:32:59 smithi170 ceph-mon[31212]: pgmap v4195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:32:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:32:59 smithi077 ceph-mon[27902]: pgmap v4195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:01 smithi191 ceph-mon[31636]: pgmap v4196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:01 smithi170 ceph-mon[31212]: pgmap v4196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:01 smithi077 ceph-mon[27902]: pgmap v4196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7693.411006 secs 2024-04-21T12:33:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7693.411006 secs 2024-04-21T12:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7693.411006 secs 2024-04-21T12:33:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:03 smithi077 ceph-mon[27902]: pgmap v4197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7695.172247 secs 2024-04-21T12:33:04.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:03 smithi191 ceph-mon[31636]: pgmap v4197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7695.172247 secs 2024-04-21T12:33:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:03 smithi170 ceph-mon[31212]: pgmap v4197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7695.172247 secs 2024-04-21T12:33:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:04 smithi077 ceph-mon[27902]: osdmap e335: 12 total, 12 up, 12 in 2024-04-21T12:33:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:04 smithi191 ceph-mon[31636]: osdmap e335: 12 total, 12 up, 12 in 2024-04-21T12:33:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:04 smithi170 ceph-mon[31212]: osdmap e335: 12 total, 12 up, 12 in 2024-04-21T12:33:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:05 smithi077 ceph-mon[27902]: pgmap v4199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:33:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:05 smithi191 ceph-mon[31636]: pgmap v4199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:33:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:05 smithi170 ceph-mon[31212]: pgmap v4199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:33:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7698.411118 secs 2024-04-21T12:33:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7698.411118 secs 2024-04-21T12:33:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7698.411118 secs 2024-04-21T12:33:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:07 smithi077 ceph-mon[27902]: pgmap v4200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:33:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:07 smithi077 ceph-mon[27902]: osdmap e336: 12 total, 12 up, 12 in 2024-04-21T12:33:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:07 smithi191 ceph-mon[31636]: pgmap v4200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:33:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:07 smithi191 ceph-mon[31636]: osdmap e336: 12 total, 12 up, 12 in 2024-04-21T12:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:07 smithi170 ceph-mon[31212]: pgmap v4200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:07 smithi170 ceph-mon[31212]: osdmap e336: 12 total, 12 up, 12 in 2024-04-21T12:33:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7700.172317 secs 2024-04-21T12:33:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7700.172317 secs 2024-04-21T12:33:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7700.172317 secs 2024-04-21T12:33:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:09 smithi077 ceph-mon[27902]: pgmap v4202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:33:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:09 smithi191 ceph-mon[31636]: pgmap v4202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:33:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:09 smithi170 ceph-mon[31212]: pgmap v4202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:33:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:11 smithi077 ceph-mon[27902]: pgmap v4203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:33:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7703.411241 secs 2024-04-21T12:33:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:11 smithi191 ceph-mon[31636]: pgmap v4203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:33:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7703.411241 secs 2024-04-21T12:33:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:11 smithi170 ceph-mon[31212]: pgmap v4203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:33:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7703.411241 secs 2024-04-21T12:33:14.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:13 smithi170 ceph-mon[31212]: pgmap v4204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T12:33:14.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7705.172395 secs 2024-04-21T12:33:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:13 smithi077 ceph-mon[27902]: pgmap v4204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T12:33:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7705.172395 secs 2024-04-21T12:33:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:13 smithi191 ceph-mon[31636]: pgmap v4204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T12:33:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7705.172395 secs 2024-04-21T12:33:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:15 smithi077 ceph-mon[27902]: pgmap v4205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:33:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:15 smithi191 ceph-mon[31636]: pgmap v4205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:33:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:15 smithi170 ceph-mon[31212]: pgmap v4205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:33:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7708.411373 secs 2024-04-21T12:33:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7708.411373 secs 2024-04-21T12:33:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7708.411373 secs 2024-04-21T12:33:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:17 smithi077 ceph-mon[27902]: pgmap v4206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:33:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:33:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:17 smithi191 ceph-mon[31636]: pgmap v4206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:33:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:33:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:17 smithi170 ceph-mon[31212]: pgmap v4206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:33:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:33:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:33:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:33:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:33:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7710.172509 secs 2024-04-21T12:33:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:33:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:33:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:33:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7710.172509 secs 2024-04-21T12:33:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:33:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:33:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:33:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7710.172509 secs 2024-04-21T12:33:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:20 smithi191 ceph-mon[31636]: pgmap v4207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:33:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:20 smithi170 ceph-mon[31212]: pgmap v4207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:33:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:20 smithi077 ceph-mon[27902]: pgmap v4207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:33:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:22 smithi191 ceph-mon[31636]: pgmap v4208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:33:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7713.411515 secs 2024-04-21T12:33:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:22 smithi170 ceph-mon[31212]: pgmap v4208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:33:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7713.411515 secs 2024-04-21T12:33:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:22 smithi077 ceph-mon[27902]: pgmap v4208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:33:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7713.411515 secs 2024-04-21T12:33:24.437 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:24 smithi077 ceph-mon[27902]: pgmap v4209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:24.437 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7715.172630 secs 2024-04-21T12:33:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:24 smithi191 ceph-mon[31636]: pgmap v4209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7715.172630 secs 2024-04-21T12:33:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:24 smithi170 ceph-mon[31212]: pgmap v4209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7715.172630 secs 2024-04-21T12:33:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:26 smithi191 ceph-mon[31636]: pgmap v4210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:26 smithi170 ceph-mon[31212]: pgmap v4210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:26 smithi077 ceph-mon[27902]: pgmap v4210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7718.411619 secs 2024-04-21T12:33:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7718.411619 secs 2024-04-21T12:33:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7718.411619 secs 2024-04-21T12:33:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:28 smithi191 ceph-mon[31636]: pgmap v4211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:28 smithi170 ceph-mon[31212]: pgmap v4211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:28 smithi077 ceph-mon[27902]: pgmap v4211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7720.172730 secs 2024-04-21T12:33:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7720.172730 secs 2024-04-21T12:33:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7720.172730 secs 2024-04-21T12:33:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:30 smithi191 ceph-mon[31636]: pgmap v4212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:30 smithi170 ceph-mon[31212]: pgmap v4212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:30 smithi077 ceph-mon[27902]: pgmap v4212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:32 smithi191 ceph-mon[31636]: pgmap v4213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7723.411750 secs 2024-04-21T12:33:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:32 smithi170 ceph-mon[31212]: pgmap v4213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7723.411750 secs 2024-04-21T12:33:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:32 smithi077 ceph-mon[27902]: pgmap v4213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7723.411750 secs 2024-04-21T12:33:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:34 smithi191 ceph-mon[31636]: pgmap v4214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7725.172884 secs 2024-04-21T12:33:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:34 smithi170 ceph-mon[31212]: pgmap v4214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7725.172884 secs 2024-04-21T12:33:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:34 smithi077 ceph-mon[27902]: pgmap v4214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7725.172884 secs 2024-04-21T12:33:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:36 smithi191 ceph-mon[31636]: pgmap v4215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:36 smithi170 ceph-mon[31212]: pgmap v4215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:36 smithi077 ceph-mon[27902]: pgmap v4215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7728.411779 secs 2024-04-21T12:33:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7728.411779 secs 2024-04-21T12:33:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7728.411779 secs 2024-04-21T12:33:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:38 smithi170 ceph-mon[31212]: pgmap v4216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:38 smithi077 ceph-mon[27902]: pgmap v4216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:38 smithi191 ceph-mon[31636]: pgmap v4216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7730.172999 secs 2024-04-21T12:33:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7730.172999 secs 2024-04-21T12:33:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7730.172999 secs 2024-04-21T12:33:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:40 smithi170 ceph-mon[31212]: pgmap v4217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:40 smithi077 ceph-mon[27902]: pgmap v4217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:40 smithi191 ceph-mon[31636]: pgmap v4217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:41 smithi170 ceph-mon[31212]: pgmap v4218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:41 smithi077 ceph-mon[27902]: pgmap v4218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:41 smithi191 ceph-mon[31636]: pgmap v4218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7733.411897 secs 2024-04-21T12:33:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7733.411897 secs 2024-04-21T12:33:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7733.411897 secs 2024-04-21T12:33:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:43 smithi170 ceph-mon[31212]: pgmap v4219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:43 smithi077 ceph-mon[27902]: pgmap v4219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:43 smithi191 ceph-mon[31636]: pgmap v4219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7735.173064 secs 2024-04-21T12:33:44.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7735.173064 secs 2024-04-21T12:33:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7735.173064 secs 2024-04-21T12:33:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:45 smithi170 ceph-mon[31212]: pgmap v4220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:45 smithi077 ceph-mon[27902]: pgmap v4220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:45 smithi191 ceph-mon[31636]: pgmap v4220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:47 smithi191 ceph-mon[31636]: pgmap v4221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7738.412005 secs 2024-04-21T12:33:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:47 smithi170 ceph-mon[31212]: pgmap v4221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7738.412005 secs 2024-04-21T12:33:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:47 smithi077 ceph-mon[27902]: pgmap v4221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7738.412005 secs 2024-04-21T12:33:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7740.173183 secs 2024-04-21T12:33:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7740.173183 secs 2024-04-21T12:33:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7740.173183 secs 2024-04-21T12:33:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:49 smithi191 ceph-mon[31636]: pgmap v4222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:49 smithi170 ceph-mon[31212]: pgmap v4222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:49 smithi077 ceph-mon[27902]: pgmap v4222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:51 smithi191 ceph-mon[31636]: pgmap v4223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:51 smithi170 ceph-mon[31212]: pgmap v4223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:51 smithi077 ceph-mon[27902]: pgmap v4223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7743.412133 secs 2024-04-21T12:33:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7743.412133 secs 2024-04-21T12:33:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7743.412133 secs 2024-04-21T12:33:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:53 smithi170 ceph-mon[31212]: pgmap v4224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7745.173261 secs 2024-04-21T12:33:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:53 smithi077 ceph-mon[27902]: pgmap v4224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7745.173261 secs 2024-04-21T12:33:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:53 smithi191 ceph-mon[31636]: pgmap v4224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7745.173261 secs 2024-04-21T12:33:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:33:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:55 smithi170 ceph-mon[31212]: pgmap v4225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:55 smithi077 ceph-mon[27902]: pgmap v4225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:55 smithi191 ceph-mon[31636]: pgmap v4225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:57 smithi170 ceph-mon[31212]: pgmap v4226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7748.412258 secs 2024-04-21T12:33:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:57 smithi077 ceph-mon[27902]: pgmap v4226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7748.412258 secs 2024-04-21T12:33:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:57 smithi191 ceph-mon[31636]: pgmap v4226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:33:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7748.412258 secs 2024-04-21T12:33:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7750.173325 secs 2024-04-21T12:33:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7750.173325 secs 2024-04-21T12:33:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7750.173325 secs 2024-04-21T12:33:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:33:59 smithi170 ceph-mon[31212]: pgmap v4227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:33:59 smithi077 ceph-mon[27902]: pgmap v4227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:33:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:33:59 smithi191 ceph-mon[31636]: pgmap v4227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:01 smithi170 ceph-mon[31212]: pgmap v4228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:01 smithi077 ceph-mon[27902]: pgmap v4228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:01 smithi191 ceph-mon[31636]: pgmap v4228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7753.412402 secs 2024-04-21T12:34:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7753.412402 secs 2024-04-21T12:34:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7753.412402 secs 2024-04-21T12:34:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:03 smithi170 ceph-mon[31212]: pgmap v4229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7755.173460 secs 2024-04-21T12:34:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:03 smithi077 ceph-mon[27902]: pgmap v4229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7755.173460 secs 2024-04-21T12:34:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:03 smithi191 ceph-mon[31636]: pgmap v4229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7755.173460 secs 2024-04-21T12:34:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:04 smithi170 ceph-mon[31212]: osdmap e337: 12 total, 12 up, 12 in 2024-04-21T12:34:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:04 smithi077 ceph-mon[27902]: osdmap e337: 12 total, 12 up, 12 in 2024-04-21T12:34:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:04 smithi191 ceph-mon[31636]: osdmap e337: 12 total, 12 up, 12 in 2024-04-21T12:34:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:05 smithi170 ceph-mon[31212]: pgmap v4231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:34:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:05 smithi077 ceph-mon[27902]: pgmap v4231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:34:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:05 smithi191 ceph-mon[31636]: pgmap v4231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:34:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:07 smithi170 ceph-mon[31212]: pgmap v4232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:34:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7758.412545 secs 2024-04-21T12:34:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:07 smithi077 ceph-mon[27902]: pgmap v4232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:34:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7758.412545 secs 2024-04-21T12:34:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:07 smithi191 ceph-mon[31636]: pgmap v4232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:34:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7758.412545 secs 2024-04-21T12:34:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:08 smithi077 ceph-mon[27902]: osdmap e338: 12 total, 12 up, 12 in 2024-04-21T12:34:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7760.173601 secs 2024-04-21T12:34:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:08 smithi191 ceph-mon[31636]: osdmap e338: 12 total, 12 up, 12 in 2024-04-21T12:34:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7760.173601 secs 2024-04-21T12:34:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:08 smithi170 ceph-mon[31212]: osdmap e338: 12 total, 12 up, 12 in 2024-04-21T12:34:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7760.173601 secs 2024-04-21T12:34:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:09 smithi077 ceph-mon[27902]: pgmap v4234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:34:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:09 smithi191 ceph-mon[31636]: pgmap v4234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:34:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:09 smithi170 ceph-mon[31212]: pgmap v4234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:34:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:11 smithi077 ceph-mon[27902]: pgmap v4235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:34:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7763.412669 secs 2024-04-21T12:34:12.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:11 smithi191 ceph-mon[31636]: pgmap v4235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:34:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7763.412669 secs 2024-04-21T12:34:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:11 smithi170 ceph-mon[31212]: pgmap v4235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:34:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7763.412669 secs 2024-04-21T12:34:14.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:13 smithi170 ceph-mon[31212]: pgmap v4236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:34:14.109 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7765.173730 secs 2024-04-21T12:34:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:13 smithi077 ceph-mon[27902]: pgmap v4236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:34:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7765.173730 secs 2024-04-21T12:34:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:13 smithi191 ceph-mon[31636]: pgmap v4236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:34:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7765.173730 secs 2024-04-21T12:34:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:16.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:15 smithi077 ceph-mon[27902]: pgmap v4237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:34:16.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:15 smithi191 ceph-mon[31636]: pgmap v4237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:34:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:15 smithi170 ceph-mon[31212]: pgmap v4237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:34:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7768.412790 secs 2024-04-21T12:34:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7768.412790 secs 2024-04-21T12:34:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7768.412790 secs 2024-04-21T12:34:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:17 smithi077 ceph-mon[27902]: pgmap v4238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T12:34:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:17 smithi191 ceph-mon[31636]: pgmap v4238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T12:34:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:17 smithi170 ceph-mon[31212]: pgmap v4238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T12:34:19.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:34:19.108 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7770.173823 secs 2024-04-21T12:34:19.110 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:34:19.110 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7770.173823 secs 2024-04-21T12:34:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:34:19.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7770.173823 secs 2024-04-21T12:34:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:19 smithi077 ceph-mon[27902]: pgmap v4239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:34:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:19 smithi191 ceph-mon[31636]: pgmap v4239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:34:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:19 smithi170 ceph-mon[31212]: pgmap v4239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:34:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:34:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:34:21.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:34:21.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:34:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:34:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:34:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:34:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: pgmap v4240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:34:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:34:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:34:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:34:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:34:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:34:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:34:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7773.412913 secs 2024-04-21T12:34:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: pgmap v4240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:34:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:34:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:34:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:34:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:34:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:34:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:34:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7773.412913 secs 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: pgmap v4240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:34:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7773.412913 secs 2024-04-21T12:34:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:24 smithi170 ceph-mon[31212]: pgmap v4241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7775.173895 secs 2024-04-21T12:34:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:24 smithi077 ceph-mon[27902]: pgmap v4241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7775.173895 secs 2024-04-21T12:34:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:24 smithi191 ceph-mon[31636]: pgmap v4241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7775.173895 secs 2024-04-21T12:34:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:26 smithi170 ceph-mon[31212]: pgmap v4242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:26 smithi077 ceph-mon[27902]: pgmap v4242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:26 smithi191 ceph-mon[31636]: pgmap v4242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7778.413031 secs 2024-04-21T12:34:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7778.413031 secs 2024-04-21T12:34:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7778.413031 secs 2024-04-21T12:34:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:28 smithi077 ceph-mon[27902]: pgmap v4243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:28 smithi191 ceph-mon[31636]: pgmap v4243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:28 smithi170 ceph-mon[31212]: pgmap v4243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7780.174013 secs 2024-04-21T12:34:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7780.174013 secs 2024-04-21T12:34:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7780.174013 secs 2024-04-21T12:34:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:30 smithi077 ceph-mon[27902]: pgmap v4244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:30 smithi191 ceph-mon[31636]: pgmap v4244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:30 smithi170 ceph-mon[31212]: pgmap v4244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:32 smithi077 ceph-mon[27902]: pgmap v4245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:32.413 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7783.413152 secs 2024-04-21T12:34:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:32 smithi191 ceph-mon[31636]: pgmap v4245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7783.413152 secs 2024-04-21T12:34:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:32 smithi170 ceph-mon[31212]: pgmap v4245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7783.413152 secs 2024-04-21T12:34:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:34 smithi077 ceph-mon[27902]: pgmap v4246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7785.174077 secs 2024-04-21T12:34:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:34 smithi191 ceph-mon[31636]: pgmap v4246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7785.174077 secs 2024-04-21T12:34:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:34 smithi170 ceph-mon[31212]: pgmap v4246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7785.174077 secs 2024-04-21T12:34:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:36 smithi077 ceph-mon[27902]: pgmap v4247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:36 smithi191 ceph-mon[31636]: pgmap v4247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:36 smithi170 ceph-mon[31212]: pgmap v4247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7788.413276 secs 2024-04-21T12:34:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7788.413276 secs 2024-04-21T12:34:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7788.413276 secs 2024-04-21T12:34:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:38 smithi077 ceph-mon[27902]: pgmap v4248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:38 smithi191 ceph-mon[31636]: pgmap v4248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:38 smithi170 ceph-mon[31212]: pgmap v4248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7790.174160 secs 2024-04-21T12:34:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7790.174160 secs 2024-04-21T12:34:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7790.174160 secs 2024-04-21T12:34:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:40 smithi077 ceph-mon[27902]: pgmap v4249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:40 smithi191 ceph-mon[31636]: pgmap v4249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:40 smithi170 ceph-mon[31212]: pgmap v4249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:42 smithi077 ceph-mon[27902]: pgmap v4250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7793.413399 secs 2024-04-21T12:34:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:42 smithi191 ceph-mon[31636]: pgmap v4250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7793.413399 secs 2024-04-21T12:34:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:42 smithi170 ceph-mon[31212]: pgmap v4250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7793.413399 secs 2024-04-21T12:34:44.358 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:44 smithi170 ceph-mon[31212]: pgmap v4251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:44.358 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7795.174273 secs 2024-04-21T12:34:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:44 smithi077 ceph-mon[27902]: pgmap v4251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7795.174273 secs 2024-04-21T12:34:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:44 smithi191 ceph-mon[31636]: pgmap v4251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7795.174273 secs 2024-04-21T12:34:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:46 smithi077 ceph-mon[27902]: pgmap v4252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:46 smithi191 ceph-mon[31636]: pgmap v4252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:46 smithi170 ceph-mon[31212]: pgmap v4252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7798.413460 secs 2024-04-21T12:34:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7798.413460 secs 2024-04-21T12:34:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7798.413460 secs 2024-04-21T12:34:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:48 smithi077 ceph-mon[27902]: pgmap v4253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:48 smithi191 ceph-mon[31636]: pgmap v4253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:48 smithi170 ceph-mon[31212]: pgmap v4253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7800.174349 secs 2024-04-21T12:34:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7800.174349 secs 2024-04-21T12:34:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7800.174349 secs 2024-04-21T12:34:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:50 smithi077 ceph-mon[27902]: pgmap v4254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:50 smithi191 ceph-mon[31636]: pgmap v4254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:50 smithi170 ceph-mon[31212]: pgmap v4254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:34:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:52 smithi191 ceph-mon[31636]: pgmap v4255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7803.413578 secs 2024-04-21T12:34:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:52 smithi170 ceph-mon[31212]: pgmap v4255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7803.413578 secs 2024-04-21T12:34:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:52 smithi077 ceph-mon[27902]: pgmap v4255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:34:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7803.413578 secs 2024-04-21T12:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:54 smithi191 ceph-mon[31636]: pgmap v4256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7805.174483 secs 2024-04-21T12:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:54 smithi170 ceph-mon[31212]: pgmap v4256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7805.174483 secs 2024-04-21T12:34:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:54 smithi077 ceph-mon[27902]: pgmap v4256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7805.174483 secs 2024-04-21T12:34:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:34:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:34:55.422+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:34:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:34:55.422+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:34:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:34:55.423+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:34:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:34:55.423+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:34:56.437 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:56 smithi077 ceph-mon[27902]: pgmap v4257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:56 smithi191 ceph-mon[31636]: pgmap v4257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:56 smithi170 ceph-mon[31212]: pgmap v4257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:34:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7808.413654 secs 2024-04-21T12:34:57.569 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7808.413654 secs 2024-04-21T12:34:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7808.413654 secs 2024-04-21T12:34:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:58 smithi191 ceph-mon[31636]: pgmap v4258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:58 smithi170 ceph-mon[31212]: pgmap v4258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:58 smithi077 ceph-mon[27902]: pgmap v4258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:34:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7810.174545 secs 2024-04-21T12:34:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7810.174545 secs 2024-04-21T12:34:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7810.174545 secs 2024-04-21T12:35:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 7995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:00 smithi191 ceph-mon[31636]: pgmap v4259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:00 smithi170 ceph-mon[31212]: pgmap v4259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:00 smithi077 ceph-mon[27902]: pgmap v4259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:02 smithi191 ceph-mon[31636]: pgmap v4260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:35:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7813.413809 secs 2024-04-21T12:35:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:02 smithi170 ceph-mon[31212]: pgmap v4260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:35:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7813.413809 secs 2024-04-21T12:35:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:02 smithi077 ceph-mon[27902]: pgmap v4260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T12:35:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7813.413809 secs 2024-04-21T12:35:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:04 smithi191 ceph-mon[31636]: pgmap v4261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:35:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7815.174681 secs 2024-04-21T12:35:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:04 smithi170 ceph-mon[31212]: pgmap v4261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:35:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7815.174681 secs 2024-04-21T12:35:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:04 smithi077 ceph-mon[27902]: pgmap v4261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T12:35:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7815.174681 secs 2024-04-21T12:35:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:05 smithi191 ceph-mon[31636]: osdmap e339: 12 total, 12 up, 12 in 2024-04-21T12:35:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:05 smithi170 ceph-mon[31212]: osdmap e339: 12 total, 12 up, 12 in 2024-04-21T12:35:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:05 smithi077 ceph-mon[27902]: osdmap e339: 12 total, 12 up, 12 in 2024-04-21T12:35:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:06 smithi191 ceph-mon[31636]: pgmap v4263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:35:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:06 smithi170 ceph-mon[31212]: pgmap v4263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:35:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:06 smithi077 ceph-mon[27902]: pgmap v4263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:35:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7818.413922 secs 2024-04-21T12:35:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7818.413922 secs 2024-04-21T12:35:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7818.413922 secs 2024-04-21T12:35:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:08 smithi191 ceph-mon[31636]: pgmap v4264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:35:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:08 smithi191 ceph-mon[31636]: osdmap e340: 12 total, 12 up, 12 in 2024-04-21T12:35:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:08 smithi170 ceph-mon[31212]: pgmap v4264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:35:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:08 smithi170 ceph-mon[31212]: osdmap e340: 12 total, 12 up, 12 in 2024-04-21T12:35:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:08 smithi077 ceph-mon[27902]: pgmap v4264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:35:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:08 smithi077 ceph-mon[27902]: osdmap e340: 12 total, 12 up, 12 in 2024-04-21T12:35:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7820.174789 secs 2024-04-21T12:35:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7820.174789 secs 2024-04-21T12:35:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7820.174789 secs 2024-04-21T12:35:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:10 smithi191 ceph-mon[31636]: pgmap v4266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:35:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:10 smithi170 ceph-mon[31212]: pgmap v4266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:35:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:10 smithi077 ceph-mon[27902]: pgmap v4266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T12:35:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:12 smithi191 ceph-mon[31636]: pgmap v4267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:35:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7823.414043 secs 2024-04-21T12:35:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:12 smithi170 ceph-mon[31212]: pgmap v4267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:35:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7823.414043 secs 2024-04-21T12:35:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:12 smithi077 ceph-mon[27902]: pgmap v4267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T12:35:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7823.414043 secs 2024-04-21T12:35:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:14 smithi191 ceph-mon[31636]: pgmap v4268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 372 B/s wr, 7 op/s 2024-04-21T12:35:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7825.174924 secs 2024-04-21T12:35:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:14 smithi170 ceph-mon[31212]: pgmap v4268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 372 B/s wr, 7 op/s 2024-04-21T12:35:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7825.174924 secs 2024-04-21T12:35:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:14 smithi077 ceph-mon[27902]: pgmap v4268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 372 B/s wr, 7 op/s 2024-04-21T12:35:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7825.174924 secs 2024-04-21T12:35:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:16 smithi191 ceph-mon[31636]: pgmap v4269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T12:35:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:16 smithi170 ceph-mon[31212]: pgmap v4269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T12:35:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:16 smithi077 ceph-mon[27902]: pgmap v4269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T12:35:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7828.414166 secs 2024-04-21T12:35:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7828.414166 secs 2024-04-21T12:35:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7828.414166 secs 2024-04-21T12:35:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:18 smithi191 ceph-mon[31636]: pgmap v4270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:35:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:18 smithi170 ceph-mon[31212]: pgmap v4270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:35:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:18 smithi077 ceph-mon[27902]: pgmap v4270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:35:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7830.174988 secs 2024-04-21T12:35:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7830.174988 secs 2024-04-21T12:35:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7830.174988 secs 2024-04-21T12:35:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:20 smithi170 ceph-mon[31212]: pgmap v4271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:35:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:20 smithi077 ceph-mon[27902]: pgmap v4271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:35:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:20 smithi191 ceph-mon[31636]: pgmap v4271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:35:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:35:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:35:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:35:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: pgmap v4272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:35:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7833.414247 secs 2024-04-21T12:35:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:35:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:35:22.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: pgmap v4272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7833.414247 secs 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:35:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: pgmap v4272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7833.414247 secs 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:35:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:35:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:24 smithi170 ceph-mon[31212]: pgmap v4273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7835.175067 secs 2024-04-21T12:35:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:24 smithi077 ceph-mon[27902]: pgmap v4273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7835.175067 secs 2024-04-21T12:35:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:24 smithi191 ceph-mon[31636]: pgmap v4273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7835.175067 secs 2024-04-21T12:35:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:26 smithi170 ceph-mon[31212]: pgmap v4274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:26 smithi077 ceph-mon[27902]: pgmap v4274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:26 smithi191 ceph-mon[31636]: pgmap v4274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7838.414403 secs 2024-04-21T12:35:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7838.414403 secs 2024-04-21T12:35:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7838.414403 secs 2024-04-21T12:35:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:28 smithi170 ceph-mon[31212]: pgmap v4275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:28 smithi077 ceph-mon[27902]: pgmap v4275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:28 smithi191 ceph-mon[31636]: pgmap v4275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7840.175134 secs 2024-04-21T12:35:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7840.175134 secs 2024-04-21T12:35:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7840.175134 secs 2024-04-21T12:35:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:30 smithi170 ceph-mon[31212]: pgmap v4276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:30 smithi077 ceph-mon[27902]: pgmap v4276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:30 smithi191 ceph-mon[31636]: pgmap v4276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:31 smithi170 ceph-mon[31212]: pgmap v4277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:31 smithi077 ceph-mon[27902]: pgmap v4277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:31 smithi191 ceph-mon[31636]: pgmap v4277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7843.414525 secs 2024-04-21T12:35:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7843.414525 secs 2024-04-21T12:35:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7843.414525 secs 2024-04-21T12:35:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:33 smithi170 ceph-mon[31212]: pgmap v4278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:33 smithi077 ceph-mon[27902]: pgmap v4278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:33 smithi191 ceph-mon[31636]: pgmap v4278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7845.175215 secs 2024-04-21T12:35:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7845.175215 secs 2024-04-21T12:35:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7845.175215 secs 2024-04-21T12:35:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:35 smithi170 ceph-mon[31212]: pgmap v4279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:35 smithi077 ceph-mon[27902]: pgmap v4279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:35 smithi191 ceph-mon[31636]: pgmap v4279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:37 smithi170 ceph-mon[31212]: pgmap v4280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7848.414650 secs 2024-04-21T12:35:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:37 smithi077 ceph-mon[27902]: pgmap v4280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7848.414650 secs 2024-04-21T12:35:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:37 smithi191 ceph-mon[31636]: pgmap v4280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7848.414650 secs 2024-04-21T12:35:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7850.175324 secs 2024-04-21T12:35:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7850.175324 secs 2024-04-21T12:35:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7850.175324 secs 2024-04-21T12:35:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:39 smithi170 ceph-mon[31212]: pgmap v4281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:39 smithi077 ceph-mon[27902]: pgmap v4281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:39 smithi191 ceph-mon[31636]: pgmap v4281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:41 smithi170 ceph-mon[31212]: pgmap v4282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:41 smithi077 ceph-mon[27902]: pgmap v4282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:41 smithi191 ceph-mon[31636]: pgmap v4282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7853.414788 secs 2024-04-21T12:35:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7853.414788 secs 2024-04-21T12:35:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7853.414788 secs 2024-04-21T12:35:45.597 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:43 smithi077 ceph-mon[27902]: pgmap v4283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:45.598 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7855.175455 secs 2024-04-21T12:35:45.598 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:43 smithi170 ceph-mon[31212]: pgmap v4283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:45.598 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7855.175455 secs 2024-04-21T12:35:45.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:43 smithi191 ceph-mon[31636]: pgmap v4283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:45.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7855.175455 secs 2024-04-21T12:35:45.598 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:45.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:45 smithi191 ceph-mon[31636]: pgmap v4284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:45 smithi170 ceph-mon[31212]: pgmap v4284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:45 smithi077 ceph-mon[27902]: pgmap v4284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:47 smithi170 ceph-mon[31212]: pgmap v4285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7858.414910 secs 2024-04-21T12:35:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:47 smithi077 ceph-mon[27902]: pgmap v4285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7858.414910 secs 2024-04-21T12:35:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:47 smithi191 ceph-mon[31636]: pgmap v4285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7858.414910 secs 2024-04-21T12:35:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7860.175574 secs 2024-04-21T12:35:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7860.175574 secs 2024-04-21T12:35:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7860.175574 secs 2024-04-21T12:35:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:49 smithi170 ceph-mon[31212]: pgmap v4286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:49 smithi077 ceph-mon[27902]: pgmap v4286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:49 smithi191 ceph-mon[31636]: pgmap v4286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:51 smithi170 ceph-mon[31212]: pgmap v4287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:51 smithi077 ceph-mon[27902]: pgmap v4287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:51 smithi191 ceph-mon[31636]: pgmap v4287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7863.415023 secs 2024-04-21T12:35:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7863.415023 secs 2024-04-21T12:35:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7863.415023 secs 2024-04-21T12:35:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:53 smithi170 ceph-mon[31212]: pgmap v4288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7865.175688 secs 2024-04-21T12:35:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:53 smithi077 ceph-mon[27902]: pgmap v4288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7865.175688 secs 2024-04-21T12:35:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:53 smithi191 ceph-mon[31636]: pgmap v4288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7865.175688 secs 2024-04-21T12:35:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:35:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:55 smithi170 ceph-mon[31212]: pgmap v4289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:55 smithi077 ceph-mon[27902]: pgmap v4289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:55 smithi191 ceph-mon[31636]: pgmap v4289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:57 smithi170 ceph-mon[31212]: pgmap v4290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7868.415091 secs 2024-04-21T12:35:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:57 smithi077 ceph-mon[27902]: pgmap v4290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7868.415091 secs 2024-04-21T12:35:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:57 smithi191 ceph-mon[31636]: pgmap v4290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:35:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7868.415091 secs 2024-04-21T12:35:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7870.175796 secs 2024-04-21T12:35:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7870.175796 secs 2024-04-21T12:35:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7870.175796 secs 2024-04-21T12:35:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:35:59 smithi170 ceph-mon[31212]: pgmap v4291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:35:59 smithi077 ceph-mon[27902]: pgmap v4291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:35:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:35:59 smithi191 ceph-mon[31636]: pgmap v4291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:01 smithi170 ceph-mon[31212]: pgmap v4292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 34 KiB/s wr, 23 op/s 2024-04-21T12:36:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:01 smithi077 ceph-mon[27902]: pgmap v4292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 34 KiB/s wr, 23 op/s 2024-04-21T12:36:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:01 smithi191 ceph-mon[31636]: pgmap v4292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 34 KiB/s wr, 23 op/s 2024-04-21T12:36:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7873.415210 secs 2024-04-21T12:36:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7873.415210 secs 2024-04-21T12:36:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7873.415210 secs 2024-04-21T12:36:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:03 smithi077 ceph-mon[27902]: pgmap v4293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 20 op/s 2024-04-21T12:36:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7875.175903 secs 2024-04-21T12:36:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:03 smithi191 ceph-mon[31636]: pgmap v4293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 20 op/s 2024-04-21T12:36:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7875.175903 secs 2024-04-21T12:36:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:03 smithi170 ceph-mon[31212]: pgmap v4293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 20 op/s 2024-04-21T12:36:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7875.175903 secs 2024-04-21T12:36:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:04 smithi077 ceph-mon[27902]: osdmap e341: 12 total, 12 up, 12 in 2024-04-21T12:36:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:04 smithi191 ceph-mon[31636]: osdmap e341: 12 total, 12 up, 12 in 2024-04-21T12:36:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:04 smithi170 ceph-mon[31212]: osdmap e341: 12 total, 12 up, 12 in 2024-04-21T12:36:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:05 smithi077 ceph-mon[27902]: pgmap v4295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T12:36:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:05 smithi191 ceph-mon[31636]: pgmap v4295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T12:36:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:05 smithi170 ceph-mon[31212]: pgmap v4295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T12:36:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:07 smithi077 ceph-mon[27902]: pgmap v4296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:36:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7878.415323 secs 2024-04-21T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:07 smithi191 ceph-mon[31636]: pgmap v4296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:36:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7878.415323 secs 2024-04-21T12:36:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:07 smithi170 ceph-mon[31212]: pgmap v4296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:36:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7878.415323 secs 2024-04-21T12:36:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:08 smithi077 ceph-mon[27902]: osdmap e342: 12 total, 12 up, 12 in 2024-04-21T12:36:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7880.175964 secs 2024-04-21T12:36:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:08 smithi191 ceph-mon[31636]: osdmap e342: 12 total, 12 up, 12 in 2024-04-21T12:36:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7880.175964 secs 2024-04-21T12:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:08 smithi170 ceph-mon[31212]: osdmap e342: 12 total, 12 up, 12 in 2024-04-21T12:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7880.175964 secs 2024-04-21T12:36:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:09 smithi077 ceph-mon[27902]: pgmap v4298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-04-21T12:36:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:09 smithi191 ceph-mon[31636]: pgmap v4298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-04-21T12:36:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:09 smithi170 ceph-mon[31212]: pgmap v4298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-04-21T12:36:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:11 smithi077 ceph-mon[27902]: pgmap v4299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-04-21T12:36:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7883.415447 secs 2024-04-21T12:36:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:11 smithi191 ceph-mon[31636]: pgmap v4299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-04-21T12:36:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7883.415447 secs 2024-04-21T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:11 smithi170 ceph-mon[31212]: pgmap v4299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-04-21T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7883.415447 secs 2024-04-21T12:36:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:13 smithi077 ceph-mon[27902]: pgmap v4300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-21T12:36:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7885.176029 secs 2024-04-21T12:36:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:13 smithi191 ceph-mon[31636]: pgmap v4300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-21T12:36:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7885.176029 secs 2024-04-21T12:36:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:13 smithi170 ceph-mon[31212]: pgmap v4300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-21T12:36:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7885.176029 secs 2024-04-21T12:36:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:15 smithi077 ceph-mon[27902]: pgmap v4301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T12:36:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:15 smithi191 ceph-mon[31636]: pgmap v4301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T12:36:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:15 smithi170 ceph-mon[31212]: pgmap v4301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T12:36:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7888.415559 secs 2024-04-21T12:36:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7888.415559 secs 2024-04-21T12:36:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7888.415559 secs 2024-04-21T12:36:18.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:17 smithi077 ceph-mon[27902]: pgmap v4302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:36:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:17 smithi191 ceph-mon[31636]: pgmap v4302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:36:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:17 smithi170 ceph-mon[31212]: pgmap v4302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:36:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7890.176144 secs 2024-04-21T12:36:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7890.176144 secs 2024-04-21T12:36:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7890.176144 secs 2024-04-21T12:36:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:19 smithi077 ceph-mon[27902]: pgmap v4303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:36:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:19 smithi191 ceph-mon[31636]: pgmap v4303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:36:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:19 smithi170 ceph-mon[31212]: pgmap v4303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:36:22.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:21 smithi077 ceph-mon[27902]: pgmap v4304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:36:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7893.415673 secs 2024-04-21T12:36:22.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:21 smithi191 ceph-mon[31636]: pgmap v4304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:36:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7893.415673 secs 2024-04-21T12:36:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:21 smithi170 ceph-mon[31212]: pgmap v4304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:36:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7893.415673 secs 2024-04-21T12:36:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:36:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:36:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:36:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:23 smithi077 ceph-mon[27902]: pgmap v4305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:36:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:36:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7895.176267 secs 2024-04-21T12:36:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:23 smithi191 ceph-mon[31636]: pgmap v4305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:36:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:36:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7895.176267 secs 2024-04-21T12:36:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:23 smithi170 ceph-mon[31212]: pgmap v4305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:36:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:36:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:36:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7895.176267 secs 2024-04-21T12:36:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:25 smithi191 ceph-mon[31636]: pgmap v4306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:25 smithi170 ceph-mon[31212]: pgmap v4306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:25 smithi077 ceph-mon[27902]: pgmap v4306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:27.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7898.415799 secs 2024-04-21T12:36:27.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7898.415799 secs 2024-04-21T12:36:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7898.415799 secs 2024-04-21T12:36:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:27 smithi191 ceph-mon[31636]: pgmap v4307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:27 smithi170 ceph-mon[31212]: pgmap v4307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:27 smithi077 ceph-mon[27902]: pgmap v4307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7900.176378 secs 2024-04-21T12:36:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7900.176378 secs 2024-04-21T12:36:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7900.176378 secs 2024-04-21T12:36:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:29 smithi191 ceph-mon[31636]: pgmap v4308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:29 smithi170 ceph-mon[31212]: pgmap v4308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:29 smithi077 ceph-mon[27902]: pgmap v4308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:31 smithi191 ceph-mon[31636]: pgmap v4309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7903.415871 secs 2024-04-21T12:36:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:31 smithi170 ceph-mon[31212]: pgmap v4309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7903.415871 secs 2024-04-21T12:36:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:31 smithi077 ceph-mon[27902]: pgmap v4309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7903.415871 secs 2024-04-21T12:36:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:33 smithi191 ceph-mon[31636]: pgmap v4310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7905.176493 secs 2024-04-21T12:36:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:33 smithi170 ceph-mon[31212]: pgmap v4310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7905.176493 secs 2024-04-21T12:36:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:33 smithi077 ceph-mon[27902]: pgmap v4310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7905.176493 secs 2024-04-21T12:36:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:35 smithi191 ceph-mon[31636]: pgmap v4311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:35 smithi170 ceph-mon[31212]: pgmap v4311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:35 smithi077 ceph-mon[27902]: pgmap v4311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7908.415989 secs 2024-04-21T12:36:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7908.415989 secs 2024-04-21T12:36:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7908.415989 secs 2024-04-21T12:36:38.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:37 smithi191 ceph-mon[31636]: pgmap v4312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:37 smithi170 ceph-mon[31212]: pgmap v4312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:37 smithi077 ceph-mon[27902]: pgmap v4312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7910.176606 secs 2024-04-21T12:36:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7910.176606 secs 2024-04-21T12:36:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7910.176606 secs 2024-04-21T12:36:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:39 smithi191 ceph-mon[31636]: pgmap v4313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:39 smithi170 ceph-mon[31212]: pgmap v4313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:39 smithi077 ceph-mon[27902]: pgmap v4313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:41 smithi191 ceph-mon[31636]: pgmap v4314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7913.416084 secs 2024-04-21T12:36:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:41 smithi170 ceph-mon[31212]: pgmap v4314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7913.416084 secs 2024-04-21T12:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:41 smithi077 ceph-mon[27902]: pgmap v4314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7913.416084 secs 2024-04-21T12:36:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:43 smithi191 ceph-mon[31636]: pgmap v4315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7915.176724 secs 2024-04-21T12:36:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:43 smithi170 ceph-mon[31212]: pgmap v4315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7915.176724 secs 2024-04-21T12:36:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:43 smithi077 ceph-mon[27902]: pgmap v4315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7915.176724 secs 2024-04-21T12:36:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:45 smithi191 ceph-mon[31636]: pgmap v4316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:45 smithi170 ceph-mon[31212]: pgmap v4316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:45 smithi077 ceph-mon[27902]: pgmap v4316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7918.416201 secs 2024-04-21T12:36:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7918.416201 secs 2024-04-21T12:36:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7918.416201 secs 2024-04-21T12:36:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:47 smithi191 ceph-mon[31636]: pgmap v4317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:47 smithi170 ceph-mon[31212]: pgmap v4317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:47 smithi077 ceph-mon[27902]: pgmap v4317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7920.176831 secs 2024-04-21T12:36:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7920.176831 secs 2024-04-21T12:36:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7920.176831 secs 2024-04-21T12:36:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:49 smithi191 ceph-mon[31636]: pgmap v4318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:49 smithi170 ceph-mon[31212]: pgmap v4318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:49 smithi077 ceph-mon[27902]: pgmap v4318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:51 smithi191 ceph-mon[31636]: pgmap v4319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7923.416319 secs 2024-04-21T12:36:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:51 smithi170 ceph-mon[31212]: pgmap v4319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7923.416319 secs 2024-04-21T12:36:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:51 smithi077 ceph-mon[27902]: pgmap v4319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7923.416319 secs 2024-04-21T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:53 smithi191 ceph-mon[31636]: pgmap v4320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7925.176892 secs 2024-04-21T12:36:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:53 smithi170 ceph-mon[31212]: pgmap v4320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7925.176892 secs 2024-04-21T12:36:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:53 smithi077 ceph-mon[27902]: pgmap v4320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7925.176892 secs 2024-04-21T12:36:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:36:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:55 smithi191 ceph-mon[31636]: pgmap v4321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:55 smithi170 ceph-mon[31212]: pgmap v4321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:55 smithi077 ceph-mon[27902]: pgmap v4321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:36:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7928.416459 secs 2024-04-21T12:36:57.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7928.416459 secs 2024-04-21T12:36:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7928.416459 secs 2024-04-21T12:36:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:57 smithi191 ceph-mon[31636]: pgmap v4322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:57 smithi170 ceph-mon[31212]: pgmap v4322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:57 smithi077 ceph-mon[27902]: pgmap v4322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:36:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7930.177010 secs 2024-04-21T12:36:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7930.177010 secs 2024-04-21T12:36:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7930.177010 secs 2024-04-21T12:37:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:36:59 smithi170 ceph-mon[31212]: pgmap v4323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:36:59 smithi077 ceph-mon[27902]: pgmap v4323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:36:59 smithi191 ceph-mon[31636]: pgmap v4323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:01 smithi170 ceph-mon[31212]: pgmap v4324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7933.416554 secs 2024-04-21T12:37:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:01 smithi077 ceph-mon[27902]: pgmap v4324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7933.416554 secs 2024-04-21T12:37:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:01 smithi191 ceph-mon[31636]: pgmap v4324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7933.416554 secs 2024-04-21T12:37:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:03 smithi170 ceph-mon[31212]: pgmap v4325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7935.177074 secs 2024-04-21T12:37:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:03 smithi077 ceph-mon[27902]: pgmap v4325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7935.177074 secs 2024-04-21T12:37:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:03 smithi191 ceph-mon[31636]: pgmap v4325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7935.177074 secs 2024-04-21T12:37:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:04 smithi170 ceph-mon[31212]: osdmap e343: 12 total, 12 up, 12 in 2024-04-21T12:37:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:04 smithi077 ceph-mon[27902]: osdmap e343: 12 total, 12 up, 12 in 2024-04-21T12:37:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:04 smithi191 ceph-mon[31636]: osdmap e343: 12 total, 12 up, 12 in 2024-04-21T12:37:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:05 smithi170 ceph-mon[31212]: pgmap v4327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:37:06.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:05 smithi077 ceph-mon[27902]: pgmap v4327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:37:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:05 smithi191 ceph-mon[31636]: pgmap v4327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:37:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7938.416644 secs 2024-04-21T12:37:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7938.416644 secs 2024-04-21T12:37:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7938.416644 secs 2024-04-21T12:37:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:08 smithi170 ceph-mon[31212]: pgmap v4328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:37:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:08 smithi170 ceph-mon[31212]: osdmap e344: 12 total, 12 up, 12 in 2024-04-21T12:37:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:08 smithi077 ceph-mon[27902]: pgmap v4328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:37:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:08 smithi077 ceph-mon[27902]: osdmap e344: 12 total, 12 up, 12 in 2024-04-21T12:37:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:08 smithi191 ceph-mon[31636]: pgmap v4328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:37:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:08 smithi191 ceph-mon[31636]: osdmap e344: 12 total, 12 up, 12 in 2024-04-21T12:37:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7940.177190 secs 2024-04-21T12:37:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7940.177190 secs 2024-04-21T12:37:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7940.177190 secs 2024-04-21T12:37:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:10 smithi170 ceph-mon[31212]: pgmap v4330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:37:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:10 smithi077 ceph-mon[27902]: pgmap v4330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:37:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:10 smithi191 ceph-mon[31636]: pgmap v4330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:37:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:12 smithi170 ceph-mon[31212]: pgmap v4331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:37:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7943.416776 secs 2024-04-21T12:37:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:12 smithi077 ceph-mon[27902]: pgmap v4331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:37:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7943.416776 secs 2024-04-21T12:37:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:12 smithi191 ceph-mon[31636]: pgmap v4331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:37:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7943.416776 secs 2024-04-21T12:37:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:14 smithi170 ceph-mon[31212]: pgmap v4332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:37:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7945.177307 secs 2024-04-21T12:37:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:14 smithi077 ceph-mon[27902]: pgmap v4332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:37:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7945.177307 secs 2024-04-21T12:37:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:14 smithi191 ceph-mon[31636]: pgmap v4332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:37:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7945.177307 secs 2024-04-21T12:37:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:16.270 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:16 smithi191 ceph-mon[31636]: pgmap v4333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:37:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:16 smithi170 ceph-mon[31212]: pgmap v4333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:37:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:16 smithi077 ceph-mon[27902]: pgmap v4333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:37:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7948.416870 secs 2024-04-21T12:37:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7948.416870 secs 2024-04-21T12:37:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7948.416870 secs 2024-04-21T12:37:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:18 smithi170 ceph-mon[31212]: pgmap v4334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:37:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:18 smithi077 ceph-mon[27902]: pgmap v4334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:37:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:18 smithi191 ceph-mon[31636]: pgmap v4334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:37:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7950.177420 secs 2024-04-21T12:37:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7950.177420 secs 2024-04-21T12:37:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7950.177420 secs 2024-04-21T12:37:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:20 smithi170 ceph-mon[31212]: pgmap v4335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:37:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:20 smithi077 ceph-mon[27902]: pgmap v4335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:37:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:20 smithi191 ceph-mon[31636]: pgmap v4335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:37:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:22 smithi170 ceph-mon[31212]: pgmap v4336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:37:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7953.416935 secs 2024-04-21T12:37:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:22 smithi077 ceph-mon[27902]: pgmap v4336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:37:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7953.416935 secs 2024-04-21T12:37:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:22 smithi191 ceph-mon[31636]: pgmap v4336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:37:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7953.416935 secs 2024-04-21T12:37:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:24 smithi170 ceph-mon[31212]: pgmap v4337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7955.177502 secs 2024-04-21T12:37:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:37:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:24 smithi077 ceph-mon[27902]: pgmap v4337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7955.177502 secs 2024-04-21T12:37:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:37:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:24 smithi191 ceph-mon[31636]: pgmap v4337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7955.177502 secs 2024-04-21T12:37:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:37:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:37:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:37:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:37:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:37:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:37:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:37:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:37:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:37:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:37:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:26 smithi077 ceph-mon[27902]: pgmap v4338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:26 smithi191 ceph-mon[31636]: pgmap v4338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:26 smithi170 ceph-mon[31212]: pgmap v4338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7958.417060 secs 2024-04-21T12:37:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7958.417060 secs 2024-04-21T12:37:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7958.417060 secs 2024-04-21T12:37:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:28 smithi077 ceph-mon[27902]: pgmap v4339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:28 smithi191 ceph-mon[31636]: pgmap v4339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:28 smithi170 ceph-mon[31212]: pgmap v4339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7960.177617 secs 2024-04-21T12:37:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7960.177617 secs 2024-04-21T12:37:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7960.177617 secs 2024-04-21T12:37:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:30 smithi077 ceph-mon[27902]: pgmap v4340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:30 smithi191 ceph-mon[31636]: pgmap v4340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:30 smithi170 ceph-mon[31212]: pgmap v4340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:32 smithi077 ceph-mon[27902]: pgmap v4341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7963.417180 secs 2024-04-21T12:37:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:32 smithi191 ceph-mon[31636]: pgmap v4341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7963.417180 secs 2024-04-21T12:37:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:32 smithi170 ceph-mon[31212]: pgmap v4341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7963.417180 secs 2024-04-21T12:37:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:34 smithi077 ceph-mon[27902]: pgmap v4342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7965.177719 secs 2024-04-21T12:37:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:34 smithi191 ceph-mon[31636]: pgmap v4342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7965.177719 secs 2024-04-21T12:37:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:34 smithi170 ceph-mon[31212]: pgmap v4342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7965.177719 secs 2024-04-21T12:37:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:36 smithi077 ceph-mon[27902]: pgmap v4343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:36 smithi191 ceph-mon[31636]: pgmap v4343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:36 smithi170 ceph-mon[31212]: pgmap v4343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7968.417297 secs 2024-04-21T12:37:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7968.417297 secs 2024-04-21T12:37:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7968.417297 secs 2024-04-21T12:37:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:38 smithi077 ceph-mon[27902]: pgmap v4344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:38 smithi191 ceph-mon[31636]: pgmap v4344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:38 smithi170 ceph-mon[31212]: pgmap v4344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7970.177834 secs 2024-04-21T12:37:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7970.177834 secs 2024-04-21T12:37:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7970.177834 secs 2024-04-21T12:37:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:40 smithi077 ceph-mon[27902]: pgmap v4345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:40 smithi191 ceph-mon[31636]: pgmap v4345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:40 smithi170 ceph-mon[31212]: pgmap v4345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:42 smithi077 ceph-mon[27902]: pgmap v4346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7973.417441 secs 2024-04-21T12:37:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:42 smithi191 ceph-mon[31636]: pgmap v4346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7973.417441 secs 2024-04-21T12:37:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:42 smithi170 ceph-mon[31212]: pgmap v4346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7973.417441 secs 2024-04-21T12:37:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:44 smithi077 ceph-mon[27902]: pgmap v4347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7975.177927 secs 2024-04-21T12:37:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:44 smithi191 ceph-mon[31636]: pgmap v4347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7975.177927 secs 2024-04-21T12:37:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:44 smithi170 ceph-mon[31212]: pgmap v4347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7975.177927 secs 2024-04-21T12:37:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:46 smithi077 ceph-mon[27902]: pgmap v4348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:46 smithi191 ceph-mon[31636]: pgmap v4348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:46 smithi170 ceph-mon[31212]: pgmap v4348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7978.417578 secs 2024-04-21T12:37:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7978.417578 secs 2024-04-21T12:37:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7978.417578 secs 2024-04-21T12:37:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:48 smithi077 ceph-mon[27902]: pgmap v4349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:48 smithi191 ceph-mon[31636]: pgmap v4349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:48 smithi170 ceph-mon[31212]: pgmap v4349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7980.178022 secs 2024-04-21T12:37:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7980.178022 secs 2024-04-21T12:37:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7980.178022 secs 2024-04-21T12:37:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:50 smithi077 ceph-mon[27902]: pgmap v4350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:50 smithi191 ceph-mon[31636]: pgmap v4350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:50 smithi170 ceph-mon[31212]: pgmap v4350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:52 smithi077 ceph-mon[27902]: pgmap v4351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7983.417696 secs 2024-04-21T12:37:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:52 smithi191 ceph-mon[31636]: pgmap v4351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7983.417696 secs 2024-04-21T12:37:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:52 smithi170 ceph-mon[31212]: pgmap v4351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7983.417696 secs 2024-04-21T12:37:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:54 smithi077 ceph-mon[27902]: pgmap v4352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7985.178133 secs 2024-04-21T12:37:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:54 smithi191 ceph-mon[31636]: pgmap v4352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7985.178133 secs 2024-04-21T12:37:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:54 smithi170 ceph-mon[31212]: pgmap v4352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7985.178133 secs 2024-04-21T12:37:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:37:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:37:55.448+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:37:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:37:55.448+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:37:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:37:55.448+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:37:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:37:55.449+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:37:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:56 smithi191 ceph-mon[31636]: pgmap v4353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:56 smithi170 ceph-mon[31212]: pgmap v4353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:56 smithi077 ceph-mon[27902]: pgmap v4353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:37:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7988.417813 secs 2024-04-21T12:37:57.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7988.417813 secs 2024-04-21T12:37:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7988.417813 secs 2024-04-21T12:37:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:58 smithi191 ceph-mon[31636]: pgmap v4354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:58 smithi170 ceph-mon[31212]: pgmap v4354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:58 smithi077 ceph-mon[27902]: pgmap v4354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:37:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7990.178249 secs 2024-04-21T12:37:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7990.178249 secs 2024-04-21T12:37:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7990.178249 secs 2024-04-21T12:38:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:00 smithi191 ceph-mon[31636]: pgmap v4355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:00 smithi170 ceph-mon[31212]: pgmap v4355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:00 smithi077 ceph-mon[27902]: pgmap v4355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:02 smithi191 ceph-mon[31636]: pgmap v4356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7993.417934 secs 2024-04-21T12:38:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:02 smithi170 ceph-mon[31212]: pgmap v4356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7993.417934 secs 2024-04-21T12:38:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:02 smithi077 ceph-mon[27902]: pgmap v4356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7993.417934 secs 2024-04-21T12:38:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:04 smithi191 ceph-mon[31636]: pgmap v4357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 7995.178314 secs 2024-04-21T12:38:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:04 smithi170 ceph-mon[31212]: pgmap v4357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 7995.178314 secs 2024-04-21T12:38:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:04 smithi077 ceph-mon[27902]: pgmap v4357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 7995.178314 secs 2024-04-21T12:38:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:05 smithi191 ceph-mon[31636]: osdmap e345: 12 total, 12 up, 12 in 2024-04-21T12:38:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:05 smithi170 ceph-mon[31212]: osdmap e345: 12 total, 12 up, 12 in 2024-04-21T12:38:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:05 smithi077 ceph-mon[27902]: osdmap e345: 12 total, 12 up, 12 in 2024-04-21T12:38:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:06 smithi191 ceph-mon[31636]: pgmap v4359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:38:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:06 smithi170 ceph-mon[31212]: pgmap v4359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:38:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:06 smithi077 ceph-mon[27902]: pgmap v4359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:38:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 7998.418048 secs 2024-04-21T12:38:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 7998.418048 secs 2024-04-21T12:38:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 7998.418048 secs 2024-04-21T12:38:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:08 smithi191 ceph-mon[31636]: pgmap v4360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:38:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:08 smithi191 ceph-mon[31636]: osdmap e346: 12 total, 12 up, 12 in 2024-04-21T12:38:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:08 smithi170 ceph-mon[31212]: pgmap v4360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:38:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:08 smithi170 ceph-mon[31212]: osdmap e346: 12 total, 12 up, 12 in 2024-04-21T12:38:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:08 smithi077 ceph-mon[27902]: pgmap v4360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:38:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:08 smithi077 ceph-mon[27902]: osdmap e346: 12 total, 12 up, 12 in 2024-04-21T12:38:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8000.178439 secs 2024-04-21T12:38:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8000.178439 secs 2024-04-21T12:38:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8000.178439 secs 2024-04-21T12:38:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:10 smithi191 ceph-mon[31636]: pgmap v4362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:38:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:10 smithi170 ceph-mon[31212]: pgmap v4362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:38:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:10 smithi077 ceph-mon[27902]: pgmap v4362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:38:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:12 smithi191 ceph-mon[31636]: pgmap v4363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:38:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8003.418163 secs 2024-04-21T12:38:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:12 smithi170 ceph-mon[31212]: pgmap v4363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:38:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8003.418163 secs 2024-04-21T12:38:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:12 smithi077 ceph-mon[27902]: pgmap v4363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:38:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8003.418163 secs 2024-04-21T12:38:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:14 smithi191 ceph-mon[31636]: pgmap v4364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:38:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8005.178555 secs 2024-04-21T12:38:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:14 smithi170 ceph-mon[31212]: pgmap v4364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:38:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8005.178555 secs 2024-04-21T12:38:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:14 smithi077 ceph-mon[27902]: pgmap v4364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:38:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8005.178555 secs 2024-04-21T12:38:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:16 smithi191 ceph-mon[31636]: pgmap v4365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:38:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:16 smithi170 ceph-mon[31212]: pgmap v4365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:38:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:16 smithi077 ceph-mon[27902]: pgmap v4365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:38:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8008.418241 secs 2024-04-21T12:38:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8008.418241 secs 2024-04-21T12:38:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8008.418241 secs 2024-04-21T12:38:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:18 smithi191 ceph-mon[31636]: pgmap v4366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:38:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:18 smithi170 ceph-mon[31212]: pgmap v4366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:38:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:18 smithi077 ceph-mon[27902]: pgmap v4366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:38:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8010.178669 secs 2024-04-21T12:38:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8010.178669 secs 2024-04-21T12:38:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8010.178669 secs 2024-04-21T12:38:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:20 smithi191 ceph-mon[31636]: pgmap v4367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:38:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:20 smithi170 ceph-mon[31212]: pgmap v4367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:38:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:20 smithi077 ceph-mon[27902]: pgmap v4367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:38:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:22 smithi191 ceph-mon[31636]: pgmap v4368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:38:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8013.418358 secs 2024-04-21T12:38:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:22 smithi170 ceph-mon[31212]: pgmap v4368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:38:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8013.418358 secs 2024-04-21T12:38:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:22 smithi077 ceph-mon[27902]: pgmap v4368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:38:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8013.418358 secs 2024-04-21T12:38:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:24 smithi170 ceph-mon[31212]: pgmap v4369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8015.178791 secs 2024-04-21T12:38:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:38:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:24 smithi077 ceph-mon[27902]: pgmap v4369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8015.178791 secs 2024-04-21T12:38:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:38:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:24 smithi191 ceph-mon[31636]: pgmap v4369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8015.178791 secs 2024-04-21T12:38:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:38:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:38:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:38:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:38:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:38:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:38:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:38:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:38:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:38:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:38:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:26 smithi170 ceph-mon[31212]: pgmap v4370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:26 smithi077 ceph-mon[27902]: pgmap v4370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:26 smithi191 ceph-mon[31636]: pgmap v4370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8018.418470 secs 2024-04-21T12:38:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8018.418470 secs 2024-04-21T12:38:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8018.418470 secs 2024-04-21T12:38:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:28 smithi170 ceph-mon[31212]: pgmap v4371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:28 smithi077 ceph-mon[27902]: pgmap v4371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:28 smithi191 ceph-mon[31636]: pgmap v4371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8020.178922 secs 2024-04-21T12:38:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8020.178922 secs 2024-04-21T12:38:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8020.178922 secs 2024-04-21T12:38:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:30 smithi170 ceph-mon[31212]: pgmap v4372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:30 smithi077 ceph-mon[27902]: pgmap v4372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:30 smithi191 ceph-mon[31636]: pgmap v4372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:32 smithi170 ceph-mon[31212]: pgmap v4373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8023.418595 secs 2024-04-21T12:38:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:32 smithi077 ceph-mon[27902]: pgmap v4373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8023.418595 secs 2024-04-21T12:38:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:32 smithi191 ceph-mon[31636]: pgmap v4373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8023.418595 secs 2024-04-21T12:38:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:34 smithi170 ceph-mon[31212]: pgmap v4374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8025.179031 secs 2024-04-21T12:38:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:34 smithi077 ceph-mon[27902]: pgmap v4374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8025.179031 secs 2024-04-21T12:38:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:34 smithi191 ceph-mon[31636]: pgmap v4374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8025.179031 secs 2024-04-21T12:38:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:36 smithi170 ceph-mon[31212]: pgmap v4375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:36 smithi077 ceph-mon[27902]: pgmap v4375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:36 smithi191 ceph-mon[31636]: pgmap v4375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8028.418708 secs 2024-04-21T12:38:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8028.418708 secs 2024-04-21T12:38:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8028.418708 secs 2024-04-21T12:38:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:38 smithi170 ceph-mon[31212]: pgmap v4376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:38 smithi077 ceph-mon[27902]: pgmap v4376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:38 smithi191 ceph-mon[31636]: pgmap v4376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8030.179171 secs 2024-04-21T12:38:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8030.179171 secs 2024-04-21T12:38:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8030.179171 secs 2024-04-21T12:38:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:40 smithi170 ceph-mon[31212]: pgmap v4377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:40 smithi077 ceph-mon[27902]: pgmap v4377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:40 smithi191 ceph-mon[31636]: pgmap v4377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:42 smithi170 ceph-mon[31212]: pgmap v4378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8033.418860 secs 2024-04-21T12:38:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:42 smithi077 ceph-mon[27902]: pgmap v4378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8033.418860 secs 2024-04-21T12:38:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:42 smithi191 ceph-mon[31636]: pgmap v4378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8033.418860 secs 2024-04-21T12:38:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:44 smithi170 ceph-mon[31212]: pgmap v4379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8035.179279 secs 2024-04-21T12:38:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:44 smithi077 ceph-mon[27902]: pgmap v4379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8035.179279 secs 2024-04-21T12:38:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:44 smithi191 ceph-mon[31636]: pgmap v4379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8035.179279 secs 2024-04-21T12:38:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:45 smithi077 ceph-mon[27902]: pgmap v4380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:45 smithi191 ceph-mon[31636]: pgmap v4380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:45 smithi170 ceph-mon[31212]: pgmap v4380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:47 smithi170 ceph-mon[31212]: pgmap v4381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8038.418974 secs 2024-04-21T12:38:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:47 smithi077 ceph-mon[27902]: pgmap v4381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:47.908 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8038.418974 secs 2024-04-21T12:38:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:47 smithi191 ceph-mon[31636]: pgmap v4381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8038.418974 secs 2024-04-21T12:38:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8040.179392 secs 2024-04-21T12:38:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8040.179392 secs 2024-04-21T12:38:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8040.179392 secs 2024-04-21T12:38:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:49 smithi170 ceph-mon[31212]: pgmap v4382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:49 smithi077 ceph-mon[27902]: pgmap v4382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:49 smithi191 ceph-mon[31636]: pgmap v4382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:51 smithi170 ceph-mon[31212]: pgmap v4383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:51 smithi077 ceph-mon[27902]: pgmap v4383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:51 smithi191 ceph-mon[31636]: pgmap v4383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8043.419057 secs 2024-04-21T12:38:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8043.419057 secs 2024-04-21T12:38:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8043.419057 secs 2024-04-21T12:38:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:53 smithi077 ceph-mon[27902]: pgmap v4384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8045.179513 secs 2024-04-21T12:38:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:53 smithi191 ceph-mon[31636]: pgmap v4384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8045.179513 secs 2024-04-21T12:38:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:53 smithi170 ceph-mon[31212]: pgmap v4384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8045.179513 secs 2024-04-21T12:38:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:38:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:55 smithi077 ceph-mon[27902]: pgmap v4385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:55 smithi191 ceph-mon[31636]: pgmap v4385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:55 smithi170 ceph-mon[31212]: pgmap v4385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:57 smithi077 ceph-mon[27902]: pgmap v4386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8048.419192 secs 2024-04-21T12:38:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:57 smithi191 ceph-mon[31636]: pgmap v4386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8048.419192 secs 2024-04-21T12:38:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:57 smithi170 ceph-mon[31212]: pgmap v4386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:38:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8048.419192 secs 2024-04-21T12:38:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8050.179626 secs 2024-04-21T12:38:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8050.179626 secs 2024-04-21T12:38:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8050.179626 secs 2024-04-21T12:38:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:38:59 smithi077 ceph-mon[27902]: pgmap v4387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:38:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:38:59 smithi191 ceph-mon[31636]: pgmap v4387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:38:59 smithi170 ceph-mon[31212]: pgmap v4387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:01 smithi077 ceph-mon[27902]: pgmap v4388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:01 smithi191 ceph-mon[31636]: pgmap v4388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:01 smithi170 ceph-mon[31212]: pgmap v4388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8053.419332 secs 2024-04-21T12:39:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8053.419332 secs 2024-04-21T12:39:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8053.419332 secs 2024-04-21T12:39:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:03 smithi077 ceph-mon[27902]: pgmap v4389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8055.179741 secs 2024-04-21T12:39:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:03 smithi191 ceph-mon[31636]: pgmap v4389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8055.179741 secs 2024-04-21T12:39:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:03 smithi170 ceph-mon[31212]: pgmap v4389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8055.179741 secs 2024-04-21T12:39:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:04 smithi077 ceph-mon[27902]: osdmap e347: 12 total, 12 up, 12 in 2024-04-21T12:39:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:04 smithi191 ceph-mon[31636]: osdmap e347: 12 total, 12 up, 12 in 2024-04-21T12:39:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:04 smithi170 ceph-mon[31212]: osdmap e347: 12 total, 12 up, 12 in 2024-04-21T12:39:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:05 smithi077 ceph-mon[27902]: pgmap v4391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:39:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:05 smithi191 ceph-mon[31636]: pgmap v4391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:39:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:05 smithi170 ceph-mon[31212]: pgmap v4391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:39:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:07 smithi077 ceph-mon[27902]: pgmap v4392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:39:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8058.419451 secs 2024-04-21T12:39:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:07 smithi191 ceph-mon[31636]: pgmap v4392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:39:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8058.419451 secs 2024-04-21T12:39:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:07 smithi170 ceph-mon[31212]: pgmap v4392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:39:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8058.419451 secs 2024-04-21T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:08 smithi191 ceph-mon[31636]: osdmap e348: 12 total, 12 up, 12 in 2024-04-21T12:39:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8060.179883 secs 2024-04-21T12:39:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:08 smithi170 ceph-mon[31212]: osdmap e348: 12 total, 12 up, 12 in 2024-04-21T12:39:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8060.179883 secs 2024-04-21T12:39:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:08 smithi077 ceph-mon[27902]: osdmap e348: 12 total, 12 up, 12 in 2024-04-21T12:39:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8060.179883 secs 2024-04-21T12:39:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:09 smithi191 ceph-mon[31636]: pgmap v4394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:39:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:09 smithi170 ceph-mon[31212]: pgmap v4394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:39:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:09 smithi077 ceph-mon[27902]: pgmap v4394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:39:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:11 smithi191 ceph-mon[31636]: pgmap v4395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:39:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8063.419593 secs 2024-04-21T12:39:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:11 smithi170 ceph-mon[31212]: pgmap v4395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:39:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8063.419593 secs 2024-04-21T12:39:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:11 smithi077 ceph-mon[27902]: pgmap v4395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:39:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8063.419593 secs 2024-04-21T12:39:14.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:13 smithi191 ceph-mon[31636]: pgmap v4396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:39:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8065.179992 secs 2024-04-21T12:39:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:13 smithi170 ceph-mon[31212]: pgmap v4396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:39:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8065.179992 secs 2024-04-21T12:39:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:13 smithi077 ceph-mon[27902]: pgmap v4396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:39:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8065.179992 secs 2024-04-21T12:39:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:15 smithi191 ceph-mon[31636]: pgmap v4397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:39:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:15 smithi170 ceph-mon[31212]: pgmap v4397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:39:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:15 smithi077 ceph-mon[27902]: pgmap v4397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:39:17.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8068.419728 secs 2024-04-21T12:39:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8068.419728 secs 2024-04-21T12:39:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8068.419728 secs 2024-04-21T12:39:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:17 smithi191 ceph-mon[31636]: pgmap v4398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:39:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:17 smithi170 ceph-mon[31212]: pgmap v4398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:39:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:17 smithi077 ceph-mon[27902]: pgmap v4398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:39:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8070.180066 secs 2024-04-21T12:39:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8070.180066 secs 2024-04-21T12:39:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8070.180066 secs 2024-04-21T12:39:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:19 smithi191 ceph-mon[31636]: pgmap v4399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:39:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:19 smithi170 ceph-mon[31212]: pgmap v4399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:39:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:19 smithi077 ceph-mon[27902]: pgmap v4399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:39:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:21 smithi191 ceph-mon[31636]: pgmap v4400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:39:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8073.419776 secs 2024-04-21T12:39:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:21 smithi170 ceph-mon[31212]: pgmap v4400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:39:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8073.419776 secs 2024-04-21T12:39:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:21 smithi077 ceph-mon[27902]: pgmap v4400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:39:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8073.419776 secs 2024-04-21T12:39:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:23 smithi191 ceph-mon[31636]: pgmap v4401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8075.180180 secs 2024-04-21T12:39:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:23 smithi170 ceph-mon[31212]: pgmap v4401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8075.180180 secs 2024-04-21T12:39:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:23 smithi077 ceph-mon[27902]: pgmap v4401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8075.180180 secs 2024-04-21T12:39:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:25 smithi191 ceph-mon[31636]: pgmap v4402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:39:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:39:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:39:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:39:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:25 smithi170 ceph-mon[31212]: pgmap v4402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:39:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:39:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:39:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:39:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:25 smithi077 ceph-mon[27902]: pgmap v4402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:39:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:39:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:39:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:39:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8078.419836 secs 2024-04-21T12:39:27.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8078.419836 secs 2024-04-21T12:39:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8078.419836 secs 2024-04-21T12:39:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:27 smithi191 ceph-mon[31636]: pgmap v4403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:27 smithi170 ceph-mon[31212]: pgmap v4403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:27 smithi077 ceph-mon[27902]: pgmap v4403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8080.180299 secs 2024-04-21T12:39:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8080.180299 secs 2024-04-21T12:39:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8080.180299 secs 2024-04-21T12:39:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:29 smithi191 ceph-mon[31636]: pgmap v4404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:29 smithi170 ceph-mon[31212]: pgmap v4404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:29 smithi077 ceph-mon[27902]: pgmap v4404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:31 smithi191 ceph-mon[31636]: pgmap v4405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8083.419950 secs 2024-04-21T12:39:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:31 smithi170 ceph-mon[31212]: pgmap v4405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8083.419950 secs 2024-04-21T12:39:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:31 smithi077 ceph-mon[27902]: pgmap v4405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8083.419950 secs 2024-04-21T12:39:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:33 smithi191 ceph-mon[31636]: pgmap v4406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8085.180418 secs 2024-04-21T12:39:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:33 smithi170 ceph-mon[31212]: pgmap v4406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8085.180418 secs 2024-04-21T12:39:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:33 smithi077 ceph-mon[27902]: pgmap v4406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8085.180418 secs 2024-04-21T12:39:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:35 smithi191 ceph-mon[31636]: pgmap v4407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:35 smithi170 ceph-mon[31212]: pgmap v4407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:35 smithi077 ceph-mon[27902]: pgmap v4407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8088.420068 secs 2024-04-21T12:39:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8088.420068 secs 2024-04-21T12:39:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8088.420068 secs 2024-04-21T12:39:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:37 smithi191 ceph-mon[31636]: pgmap v4408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:37 smithi170 ceph-mon[31212]: pgmap v4408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:37 smithi077 ceph-mon[27902]: pgmap v4408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8090.180535 secs 2024-04-21T12:39:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8090.180535 secs 2024-04-21T12:39:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8090.180535 secs 2024-04-21T12:39:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:39 smithi191 ceph-mon[31636]: pgmap v4409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:39 smithi170 ceph-mon[31212]: pgmap v4409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:39 smithi077 ceph-mon[27902]: pgmap v4409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:41 smithi170 ceph-mon[31212]: pgmap v4410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8093.420135 secs 2024-04-21T12:39:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:41 smithi077 ceph-mon[27902]: pgmap v4410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8093.420135 secs 2024-04-21T12:39:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:41 smithi191 ceph-mon[31636]: pgmap v4410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8093.420135 secs 2024-04-21T12:39:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:43 smithi170 ceph-mon[31212]: pgmap v4411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8095.180649 secs 2024-04-21T12:39:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:43 smithi077 ceph-mon[27902]: pgmap v4411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8095.180649 secs 2024-04-21T12:39:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:43 smithi191 ceph-mon[31636]: pgmap v4411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8095.180649 secs 2024-04-21T12:39:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:45 smithi170 ceph-mon[31212]: pgmap v4412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:45 smithi077 ceph-mon[27902]: pgmap v4412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:45 smithi191 ceph-mon[31636]: pgmap v4412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8098.420257 secs 2024-04-21T12:39:47.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8098.420257 secs 2024-04-21T12:39:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8098.420257 secs 2024-04-21T12:39:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:47 smithi170 ceph-mon[31212]: pgmap v4413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:47 smithi077 ceph-mon[27902]: pgmap v4413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:47 smithi191 ceph-mon[31636]: pgmap v4413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8100.180763 secs 2024-04-21T12:39:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8100.180763 secs 2024-04-21T12:39:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8100.180763 secs 2024-04-21T12:39:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:49 smithi170 ceph-mon[31212]: pgmap v4414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:49 smithi077 ceph-mon[27902]: pgmap v4414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:49 smithi191 ceph-mon[31636]: pgmap v4414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:51 smithi170 ceph-mon[31212]: pgmap v4415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8103.420400 secs 2024-04-21T12:39:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:51 smithi077 ceph-mon[27902]: pgmap v4415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8103.420400 secs 2024-04-21T12:39:52.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:51 smithi191 ceph-mon[31636]: pgmap v4415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8103.420400 secs 2024-04-21T12:39:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:53 smithi170 ceph-mon[31212]: pgmap v4416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8105.180908 secs 2024-04-21T12:39:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:53 smithi077 ceph-mon[27902]: pgmap v4416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8105.180908 secs 2024-04-21T12:39:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:53 smithi191 ceph-mon[31636]: pgmap v4416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8105.180908 secs 2024-04-21T12:39:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:39:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:56 smithi170 ceph-mon[31212]: pgmap v4417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:56 smithi077 ceph-mon[27902]: pgmap v4417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:56 smithi191 ceph-mon[31636]: pgmap v4417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:39:57.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8108.420508 secs 2024-04-21T12:39:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8108.420508 secs 2024-04-21T12:39:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8108.420508 secs 2024-04-21T12:39:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:58 smithi170 ceph-mon[31212]: pgmap v4418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:58 smithi077 ceph-mon[27902]: pgmap v4418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:58 smithi191 ceph-mon[31636]: pgmap v4418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:39:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8110.181030 secs 2024-04-21T12:39:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8110.181030 secs 2024-04-21T12:39:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8110.181030 secs 2024-04-21T12:40:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:00 smithi170 ceph-mon[31212]: pgmap v4419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:40:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:00 smithi077 ceph-mon[27902]: pgmap v4419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:40:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:00 smithi191 ceph-mon[31636]: pgmap v4419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:40:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:02 smithi170 ceph-mon[31212]: pgmap v4420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8113.420622 secs 2024-04-21T12:40:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:02 smithi077 ceph-mon[27902]: pgmap v4420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8113.420622 secs 2024-04-21T12:40:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:02 smithi191 ceph-mon[31636]: pgmap v4420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8113.420622 secs 2024-04-21T12:40:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:04 smithi170 ceph-mon[31212]: pgmap v4421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8115.181145 secs 2024-04-21T12:40:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:04 smithi077 ceph-mon[27902]: pgmap v4421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8115.181145 secs 2024-04-21T12:40:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:04 smithi191 ceph-mon[31636]: pgmap v4421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8115.181145 secs 2024-04-21T12:40:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:05 smithi170 ceph-mon[31212]: osdmap e349: 12 total, 12 up, 12 in 2024-04-21T12:40:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:05 smithi077 ceph-mon[27902]: osdmap e349: 12 total, 12 up, 12 in 2024-04-21T12:40:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:05 smithi191 ceph-mon[31636]: osdmap e349: 12 total, 12 up, 12 in 2024-04-21T12:40:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:06 smithi170 ceph-mon[31212]: pgmap v4423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:40:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:06 smithi077 ceph-mon[27902]: pgmap v4423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:40:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:06 smithi191 ceph-mon[31636]: pgmap v4423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:40:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8118.420752 secs 2024-04-21T12:40:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8118.420752 secs 2024-04-21T12:40:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8118.420752 secs 2024-04-21T12:40:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:08 smithi170 ceph-mon[31212]: pgmap v4424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:40:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:08 smithi170 ceph-mon[31212]: osdmap e350: 12 total, 12 up, 12 in 2024-04-21T12:40:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:08 smithi077 ceph-mon[27902]: pgmap v4424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:08 smithi077 ceph-mon[27902]: osdmap e350: 12 total, 12 up, 12 in 2024-04-21T12:40:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:08 smithi191 ceph-mon[31636]: pgmap v4424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:08 smithi191 ceph-mon[31636]: osdmap e350: 12 total, 12 up, 12 in 2024-04-21T12:40:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8120.181229 secs 2024-04-21T12:40:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8120.181229 secs 2024-04-21T12:40:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8120.181229 secs 2024-04-21T12:40:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:10 smithi170 ceph-mon[31212]: pgmap v4426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:40:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:10 smithi077 ceph-mon[27902]: pgmap v4426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:40:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:10 smithi191 ceph-mon[31636]: pgmap v4426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:40:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:12 smithi170 ceph-mon[31212]: pgmap v4427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:40:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8123.420863 secs 2024-04-21T12:40:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:12 smithi077 ceph-mon[27902]: pgmap v4427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:40:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8123.420863 secs 2024-04-21T12:40:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:12 smithi191 ceph-mon[31636]: pgmap v4427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:40:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8123.420863 secs 2024-04-21T12:40:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:14 smithi077 ceph-mon[27902]: pgmap v4428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:40:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8125.181345 secs 2024-04-21T12:40:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:14 smithi191 ceph-mon[31636]: pgmap v4428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:40:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8125.181345 secs 2024-04-21T12:40:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:14 smithi170 ceph-mon[31212]: pgmap v4428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:40:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8125.181345 secs 2024-04-21T12:40:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:16 smithi077 ceph-mon[27902]: pgmap v4429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:40:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:16 smithi191 ceph-mon[31636]: pgmap v4429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:40:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:16 smithi170 ceph-mon[31212]: pgmap v4429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:40:17.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8128.420981 secs 2024-04-21T12:40:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8128.420981 secs 2024-04-21T12:40:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8128.420981 secs 2024-04-21T12:40:18.321 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:18 smithi170 ceph-mon[31212]: pgmap v4430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:40:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:18 smithi077 ceph-mon[27902]: pgmap v4430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:40:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:18 smithi191 ceph-mon[31636]: pgmap v4430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:40:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8130.181476 secs 2024-04-21T12:40:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8130.181476 secs 2024-04-21T12:40:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8130.181476 secs 2024-04-21T12:40:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:20 smithi077 ceph-mon[27902]: pgmap v4431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:40:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:20 smithi191 ceph-mon[31636]: pgmap v4431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:40:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:20 smithi170 ceph-mon[31212]: pgmap v4431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:40:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:22 smithi077 ceph-mon[27902]: pgmap v4432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:40:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8133.421103 secs 2024-04-21T12:40:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:22 smithi191 ceph-mon[31636]: pgmap v4432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:40:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8133.421103 secs 2024-04-21T12:40:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:22 smithi170 ceph-mon[31212]: pgmap v4432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:40:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8133.421103 secs 2024-04-21T12:40:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:24 smithi077 ceph-mon[27902]: pgmap v4433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8135.181601 secs 2024-04-21T12:40:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:24 smithi191 ceph-mon[31636]: pgmap v4433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8135.181601 secs 2024-04-21T12:40:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:24 smithi170 ceph-mon[31212]: pgmap v4433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8135.181601 secs 2024-04-21T12:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:26 smithi077 ceph-mon[27902]: pgmap v4434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:40:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:26 smithi191 ceph-mon[31636]: pgmap v4434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:40:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:26 smithi170 ceph-mon[31212]: pgmap v4434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:40:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:40:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:40:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:40:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8138.421209 secs 2024-04-21T12:40:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:40:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:40:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:40:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8138.421209 secs 2024-04-21T12:40:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:40:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:40:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:40:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8138.421209 secs 2024-04-21T12:40:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:28 smithi077 ceph-mon[27902]: pgmap v4435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:28 smithi191 ceph-mon[31636]: pgmap v4435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:28 smithi170 ceph-mon[31212]: pgmap v4435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8140.181722 secs 2024-04-21T12:40:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8140.181722 secs 2024-04-21T12:40:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8140.181722 secs 2024-04-21T12:40:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:30 smithi077 ceph-mon[27902]: pgmap v4436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:30 smithi191 ceph-mon[31636]: pgmap v4436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:30 smithi170 ceph-mon[31212]: pgmap v4436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:32 smithi077 ceph-mon[27902]: pgmap v4437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8143.421330 secs 2024-04-21T12:40:32.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:32 smithi191 ceph-mon[31636]: pgmap v4437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8143.421330 secs 2024-04-21T12:40:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:32 smithi170 ceph-mon[31212]: pgmap v4437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8143.421330 secs 2024-04-21T12:40:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:34 smithi077 ceph-mon[27902]: pgmap v4438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8145.181907 secs 2024-04-21T12:40:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:34 smithi191 ceph-mon[31636]: pgmap v4438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8145.181907 secs 2024-04-21T12:40:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:34 smithi170 ceph-mon[31212]: pgmap v4438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8145.181907 secs 2024-04-21T12:40:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:36 smithi077 ceph-mon[27902]: pgmap v4439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:36 smithi191 ceph-mon[31636]: pgmap v4439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:36 smithi170 ceph-mon[31212]: pgmap v4439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8148.421433 secs 2024-04-21T12:40:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8148.421433 secs 2024-04-21T12:40:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8148.421433 secs 2024-04-21T12:40:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:38 smithi077 ceph-mon[27902]: pgmap v4440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:38 smithi191 ceph-mon[31636]: pgmap v4440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:38 smithi170 ceph-mon[31212]: pgmap v4440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8150.182027 secs 2024-04-21T12:40:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8150.182027 secs 2024-04-21T12:40:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8150.182027 secs 2024-04-21T12:40:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:40 smithi077 ceph-mon[27902]: pgmap v4441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:40 smithi191 ceph-mon[31636]: pgmap v4441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:40 smithi170 ceph-mon[31212]: pgmap v4441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:42 smithi077 ceph-mon[27902]: pgmap v4442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8153.421568 secs 2024-04-21T12:40:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:42 smithi191 ceph-mon[31636]: pgmap v4442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8153.421568 secs 2024-04-21T12:40:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:42 smithi170 ceph-mon[31212]: pgmap v4442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8153.421568 secs 2024-04-21T12:40:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:44 smithi077 ceph-mon[27902]: pgmap v4443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8155.182117 secs 2024-04-21T12:40:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:44 smithi191 ceph-mon[31636]: pgmap v4443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8155.182117 secs 2024-04-21T12:40:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:44 smithi170 ceph-mon[31212]: pgmap v4443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8155.182117 secs 2024-04-21T12:40:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:46.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:46 smithi077 ceph-mon[27902]: pgmap v4444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:46 smithi191 ceph-mon[31636]: pgmap v4444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:46 smithi170 ceph-mon[31212]: pgmap v4444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8158.421705 secs 2024-04-21T12:40:47.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8158.421705 secs 2024-04-21T12:40:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8158.421705 secs 2024-04-21T12:40:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:48 smithi191 ceph-mon[31636]: pgmap v4445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:48 smithi170 ceph-mon[31212]: pgmap v4445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:48 smithi077 ceph-mon[27902]: pgmap v4445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8160.182231 secs 2024-04-21T12:40:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8160.182231 secs 2024-04-21T12:40:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8160.182231 secs 2024-04-21T12:40:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:50 smithi191 ceph-mon[31636]: pgmap v4446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:50 smithi170 ceph-mon[31212]: pgmap v4446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:50 smithi077 ceph-mon[27902]: pgmap v4446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:52 smithi191 ceph-mon[31636]: pgmap v4447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8163.421833 secs 2024-04-21T12:40:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:52 smithi170 ceph-mon[31212]: pgmap v4447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8163.421833 secs 2024-04-21T12:40:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:52 smithi077 ceph-mon[27902]: pgmap v4447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8163.421833 secs 2024-04-21T12:40:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:54 smithi191 ceph-mon[31636]: pgmap v4448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8165.182399 secs 2024-04-21T12:40:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:54 smithi170 ceph-mon[31212]: pgmap v4448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8165.182399 secs 2024-04-21T12:40:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:54 smithi077 ceph-mon[27902]: pgmap v4448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8165.182399 secs 2024-04-21T12:40:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:40:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.473+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:40:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.473+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:40:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.474+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T12:40:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.474+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:40:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.474+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T12:40:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.474+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:40:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.474+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:40:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:40:55.474+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:40:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:56 smithi191 ceph-mon[31636]: pgmap v4449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:56 smithi170 ceph-mon[31212]: pgmap v4449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:56 smithi077 ceph-mon[27902]: pgmap v4449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:40:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8168.421983 secs 2024-04-21T12:40:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8168.421983 secs 2024-04-21T12:40:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8168.421983 secs 2024-04-21T12:40:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:58 smithi191 ceph-mon[31636]: pgmap v4450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:58 smithi170 ceph-mon[31212]: pgmap v4450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:58 smithi077 ceph-mon[27902]: pgmap v4450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:40:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8170.182535 secs 2024-04-21T12:40:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8170.182535 secs 2024-04-21T12:40:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8170.182535 secs 2024-04-21T12:41:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:00 smithi191 ceph-mon[31636]: pgmap v4451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:00 smithi170 ceph-mon[31212]: pgmap v4451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:00 smithi077 ceph-mon[27902]: pgmap v4451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:02.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:02 smithi191 ceph-mon[31636]: pgmap v4452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8173.422111 secs 2024-04-21T12:41:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:02 smithi170 ceph-mon[31212]: pgmap v4452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8173.422111 secs 2024-04-21T12:41:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:02 smithi077 ceph-mon[27902]: pgmap v4452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8173.422111 secs 2024-04-21T12:41:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:04 smithi191 ceph-mon[31636]: pgmap v4453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8175.182631 secs 2024-04-21T12:41:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:04 smithi170 ceph-mon[31212]: pgmap v4453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8175.182631 secs 2024-04-21T12:41:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:04 smithi077 ceph-mon[27902]: pgmap v4453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8175.182631 secs 2024-04-21T12:41:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:05 smithi191 ceph-mon[31636]: osdmap e351: 12 total, 12 up, 12 in 2024-04-21T12:41:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:05 smithi170 ceph-mon[31212]: osdmap e351: 12 total, 12 up, 12 in 2024-04-21T12:41:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:05 smithi077 ceph-mon[27902]: osdmap e351: 12 total, 12 up, 12 in 2024-04-21T12:41:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:06 smithi191 ceph-mon[31636]: pgmap v4455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:41:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:06 smithi170 ceph-mon[31212]: pgmap v4455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:41:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:06 smithi077 ceph-mon[27902]: pgmap v4455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:41:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8178.422246 secs 2024-04-21T12:41:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8178.422246 secs 2024-04-21T12:41:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8178.422246 secs 2024-04-21T12:41:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:08 smithi191 ceph-mon[31636]: pgmap v4456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:08 smithi191 ceph-mon[31636]: osdmap e352: 12 total, 12 up, 12 in 2024-04-21T12:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:08 smithi170 ceph-mon[31212]: pgmap v4456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:08 smithi170 ceph-mon[31212]: osdmap e352: 12 total, 12 up, 12 in 2024-04-21T12:41:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:08 smithi077 ceph-mon[27902]: pgmap v4456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:41:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:08 smithi077 ceph-mon[27902]: osdmap e352: 12 total, 12 up, 12 in 2024-04-21T12:41:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8180.182756 secs 2024-04-21T12:41:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8180.182756 secs 2024-04-21T12:41:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8180.182756 secs 2024-04-21T12:41:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:10 smithi191 ceph-mon[31636]: pgmap v4458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:41:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:10 smithi170 ceph-mon[31212]: pgmap v4458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:41:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:10 smithi077 ceph-mon[27902]: pgmap v4458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:41:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:12 smithi191 ceph-mon[31636]: pgmap v4459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:41:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8183.422408 secs 2024-04-21T12:41:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:12 smithi170 ceph-mon[31212]: pgmap v4459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:41:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8183.422408 secs 2024-04-21T12:41:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:12 smithi077 ceph-mon[27902]: pgmap v4459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:41:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8183.422408 secs 2024-04-21T12:41:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:14 smithi191 ceph-mon[31636]: pgmap v4460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:41:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8185.182913 secs 2024-04-21T12:41:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:14 smithi170 ceph-mon[31212]: pgmap v4460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:41:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8185.182913 secs 2024-04-21T12:41:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:14 smithi077 ceph-mon[27902]: pgmap v4460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:41:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8185.182913 secs 2024-04-21T12:41:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:16 smithi170 ceph-mon[31212]: pgmap v4461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:41:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:16 smithi077 ceph-mon[27902]: pgmap v4461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:41:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:16 smithi191 ceph-mon[31636]: pgmap v4461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:41:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8188.422543 secs 2024-04-21T12:41:17.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8188.422543 secs 2024-04-21T12:41:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8188.422543 secs 2024-04-21T12:41:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:18 smithi170 ceph-mon[31212]: pgmap v4462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:41:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:18 smithi077 ceph-mon[27902]: pgmap v4462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:41:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:18 smithi191 ceph-mon[31636]: pgmap v4462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:41:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8190.183031 secs 2024-04-21T12:41:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8190.183031 secs 2024-04-21T12:41:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8190.183031 secs 2024-04-21T12:41:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:20 smithi170 ceph-mon[31212]: pgmap v4463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:41:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:20 smithi077 ceph-mon[27902]: pgmap v4463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:41:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:20 smithi191 ceph-mon[31636]: pgmap v4463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:41:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:22 smithi170 ceph-mon[31212]: pgmap v4464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:41:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8193.422622 secs 2024-04-21T12:41:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:22 smithi077 ceph-mon[27902]: pgmap v4464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:41:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8193.422622 secs 2024-04-21T12:41:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:22 smithi191 ceph-mon[31636]: pgmap v4464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:41:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8193.422622 secs 2024-04-21T12:41:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:24 smithi170 ceph-mon[31212]: pgmap v4465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8195.183174 secs 2024-04-21T12:41:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:24 smithi077 ceph-mon[27902]: pgmap v4465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8195.183174 secs 2024-04-21T12:41:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:24 smithi191 ceph-mon[31636]: pgmap v4465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8195.183174 secs 2024-04-21T12:41:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:26 smithi170 ceph-mon[31212]: pgmap v4466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:26 smithi077 ceph-mon[27902]: pgmap v4466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:26 smithi191 ceph-mon[31636]: pgmap v4466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:41:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8198.422720 secs 2024-04-21T12:41:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:41:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:41:27.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:41:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:41:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8198.422720 secs 2024-04-21T12:41:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:41:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:41:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:41:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:41:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8198.422720 secs 2024-04-21T12:41:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:41:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:41:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:41:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:28 smithi170 ceph-mon[31212]: pgmap v4467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:28 smithi077 ceph-mon[27902]: pgmap v4467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:28 smithi191 ceph-mon[31636]: pgmap v4467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8200.183248 secs 2024-04-21T12:41:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8200.183248 secs 2024-04-21T12:41:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8200.183248 secs 2024-04-21T12:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:30 smithi170 ceph-mon[31212]: pgmap v4468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:30 smithi077 ceph-mon[27902]: pgmap v4468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:30 smithi191 ceph-mon[31636]: pgmap v4468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:32 smithi170 ceph-mon[31212]: pgmap v4469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8203.422838 secs 2024-04-21T12:41:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:32 smithi077 ceph-mon[27902]: pgmap v4469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8203.422838 secs 2024-04-21T12:41:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:32 smithi191 ceph-mon[31636]: pgmap v4469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8203.422838 secs 2024-04-21T12:41:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:34 smithi170 ceph-mon[31212]: pgmap v4470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8205.183342 secs 2024-04-21T12:41:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:34 smithi077 ceph-mon[27902]: pgmap v4470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8205.183342 secs 2024-04-21T12:41:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:34 smithi191 ceph-mon[31636]: pgmap v4470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8205.183342 secs 2024-04-21T12:41:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:36 smithi170 ceph-mon[31212]: pgmap v4471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:36 smithi077 ceph-mon[27902]: pgmap v4471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:36 smithi191 ceph-mon[31636]: pgmap v4471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8208.422954 secs 2024-04-21T12:41:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8208.422954 secs 2024-04-21T12:41:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8208.422954 secs 2024-04-21T12:41:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:38 smithi170 ceph-mon[31212]: pgmap v4472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:38 smithi077 ceph-mon[27902]: pgmap v4472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:38 smithi191 ceph-mon[31636]: pgmap v4472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8210.183461 secs 2024-04-21T12:41:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8210.183461 secs 2024-04-21T12:41:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8210.183461 secs 2024-04-21T12:41:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:40 smithi170 ceph-mon[31212]: pgmap v4473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:40 smithi077 ceph-mon[27902]: pgmap v4473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:40 smithi191 ceph-mon[31636]: pgmap v4473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:42 smithi170 ceph-mon[31212]: pgmap v4474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8213.423073 secs 2024-04-21T12:41:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:42 smithi077 ceph-mon[27902]: pgmap v4474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8213.423073 secs 2024-04-21T12:41:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:42 smithi191 ceph-mon[31636]: pgmap v4474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8213.423073 secs 2024-04-21T12:41:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:44 smithi170 ceph-mon[31212]: pgmap v4475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8215.183608 secs 2024-04-21T12:41:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:44 smithi077 ceph-mon[27902]: pgmap v4475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8215.183608 secs 2024-04-21T12:41:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:44 smithi191 ceph-mon[31636]: pgmap v4475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8215.183608 secs 2024-04-21T12:41:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:46 smithi170 ceph-mon[31212]: pgmap v4476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:46 smithi077 ceph-mon[27902]: pgmap v4476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:46 smithi191 ceph-mon[31636]: pgmap v4476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8218.423194 secs 2024-04-21T12:41:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8218.423194 secs 2024-04-21T12:41:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8218.423194 secs 2024-04-21T12:41:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:48 smithi077 ceph-mon[27902]: pgmap v4477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:48 smithi191 ceph-mon[31636]: pgmap v4477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:48 smithi170 ceph-mon[31212]: pgmap v4477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8220.183669 secs 2024-04-21T12:41:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:49 smithi077 ceph-mon[27902]: pgmap v4478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8220.183669 secs 2024-04-21T12:41:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:49 smithi191 ceph-mon[31636]: pgmap v4478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8220.183669 secs 2024-04-21T12:41:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:49 smithi170 ceph-mon[31212]: pgmap v4478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:51 smithi077 ceph-mon[27902]: pgmap v4479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:51 smithi191 ceph-mon[31636]: pgmap v4479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:51 smithi170 ceph-mon[31212]: pgmap v4479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:52.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8223.423332 secs 2024-04-21T12:41:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8223.423332 secs 2024-04-21T12:41:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8223.423332 secs 2024-04-21T12:41:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:53 smithi077 ceph-mon[27902]: pgmap v4480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8225.183796 secs 2024-04-21T12:41:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:53 smithi191 ceph-mon[31636]: pgmap v4480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8225.183796 secs 2024-04-21T12:41:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:53 smithi170 ceph-mon[31212]: pgmap v4480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8225.183796 secs 2024-04-21T12:41:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:41:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:55 smithi077 ceph-mon[27902]: pgmap v4481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:55 smithi191 ceph-mon[31636]: pgmap v4481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:55 smithi170 ceph-mon[31212]: pgmap v4481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:57 smithi077 ceph-mon[27902]: pgmap v4482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8228.423446 secs 2024-04-21T12:41:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:57 smithi191 ceph-mon[31636]: pgmap v4482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8228.423446 secs 2024-04-21T12:41:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:57 smithi170 ceph-mon[31212]: pgmap v4482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:41:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8228.423446 secs 2024-04-21T12:41:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8230.183912 secs 2024-04-21T12:41:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8230.183912 secs 2024-04-21T12:41:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8230.183912 secs 2024-04-21T12:41:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:41:59 smithi077 ceph-mon[27902]: pgmap v4483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:41:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:41:59 smithi191 ceph-mon[31636]: pgmap v4483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:41:59 smithi170 ceph-mon[31212]: pgmap v4483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:01 smithi077 ceph-mon[27902]: pgmap v4484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:01 smithi191 ceph-mon[31636]: pgmap v4484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:01 smithi170 ceph-mon[31212]: pgmap v4484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8233.423543 secs 2024-04-21T12:42:02.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8233.423543 secs 2024-04-21T12:42:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8233.423543 secs 2024-04-21T12:42:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:03 smithi077 ceph-mon[27902]: pgmap v4485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8235.184021 secs 2024-04-21T12:42:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:03 smithi191 ceph-mon[31636]: pgmap v4485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8235.184021 secs 2024-04-21T12:42:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:03 smithi170 ceph-mon[31212]: pgmap v4485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8235.184021 secs 2024-04-21T12:42:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:04 smithi191 ceph-mon[31636]: osdmap e353: 12 total, 12 up, 12 in 2024-04-21T12:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:04 smithi170 ceph-mon[31212]: osdmap e353: 12 total, 12 up, 12 in 2024-04-21T12:42:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:04 smithi077 ceph-mon[27902]: osdmap e353: 12 total, 12 up, 12 in 2024-04-21T12:42:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:05 smithi191 ceph-mon[31636]: pgmap v4487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:42:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:05 smithi170 ceph-mon[31212]: pgmap v4487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:42:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:05 smithi077 ceph-mon[27902]: pgmap v4487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:42:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8238.423696 secs 2024-04-21T12:42:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8238.423696 secs 2024-04-21T12:42:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8238.423696 secs 2024-04-21T12:42:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:07 smithi191 ceph-mon[31636]: pgmap v4488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:42:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:07 smithi170 ceph-mon[31212]: pgmap v4488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:42:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:07 smithi077 ceph-mon[27902]: pgmap v4488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:42:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:08 smithi191 ceph-mon[31636]: osdmap e354: 12 total, 12 up, 12 in 2024-04-21T12:42:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8240.184137 secs 2024-04-21T12:42:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:08 smithi170 ceph-mon[31212]: osdmap e354: 12 total, 12 up, 12 in 2024-04-21T12:42:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8240.184137 secs 2024-04-21T12:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:08 smithi077 ceph-mon[27902]: osdmap e354: 12 total, 12 up, 12 in 2024-04-21T12:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8240.184137 secs 2024-04-21T12:42:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:09 smithi191 ceph-mon[31636]: pgmap v4490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:42:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:09 smithi170 ceph-mon[31212]: pgmap v4490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:42:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:09 smithi077 ceph-mon[27902]: pgmap v4490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:42:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:11 smithi191 ceph-mon[31636]: pgmap v4491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:42:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8243.423847 secs 2024-04-21T12:42:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:11 smithi170 ceph-mon[31212]: pgmap v4491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:42:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8243.423847 secs 2024-04-21T12:42:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:11 smithi077 ceph-mon[27902]: pgmap v4491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:42:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8243.423847 secs 2024-04-21T12:42:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:13 smithi191 ceph-mon[31636]: pgmap v4492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:42:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8245.184269 secs 2024-04-21T12:42:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:13 smithi170 ceph-mon[31212]: pgmap v4492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:42:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8245.184269 secs 2024-04-21T12:42:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:13 smithi077 ceph-mon[27902]: pgmap v4492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:42:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8245.184269 secs 2024-04-21T12:42:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:15 smithi191 ceph-mon[31636]: pgmap v4493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:42:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:15 smithi170 ceph-mon[31212]: pgmap v4493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:42:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:15 smithi077 ceph-mon[27902]: pgmap v4493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:42:17.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8248.423964 secs 2024-04-21T12:42:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8248.423964 secs 2024-04-21T12:42:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8248.423964 secs 2024-04-21T12:42:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:17 smithi191 ceph-mon[31636]: pgmap v4494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:42:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:17 smithi170 ceph-mon[31212]: pgmap v4494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:42:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:17 smithi077 ceph-mon[27902]: pgmap v4494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:42:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8250.184382 secs 2024-04-21T12:42:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8250.184382 secs 2024-04-21T12:42:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8250.184382 secs 2024-04-21T12:42:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:20.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:19 smithi191 ceph-mon[31636]: pgmap v4495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:42:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:19 smithi170 ceph-mon[31212]: pgmap v4495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:42:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:19 smithi077 ceph-mon[27902]: pgmap v4495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:42:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:21 smithi191 ceph-mon[31636]: pgmap v4496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:42:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8253.424076 secs 2024-04-21T12:42:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:21 smithi170 ceph-mon[31212]: pgmap v4496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:42:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8253.424076 secs 2024-04-21T12:42:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:21 smithi077 ceph-mon[27902]: pgmap v4496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:42:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8253.424076 secs 2024-04-21T12:42:24.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:23 smithi191 ceph-mon[31636]: pgmap v4497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8255.184504 secs 2024-04-21T12:42:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:23 smithi170 ceph-mon[31212]: pgmap v4497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8255.184504 secs 2024-04-21T12:42:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:23 smithi077 ceph-mon[27902]: pgmap v4497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8255.184504 secs 2024-04-21T12:42:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:25 smithi191 ceph-mon[31636]: pgmap v4498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:25 smithi170 ceph-mon[31212]: pgmap v4498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:25 smithi077 ceph-mon[27902]: pgmap v4498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8258.424191 secs 2024-04-21T12:42:27.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8258.424191 secs 2024-04-21T12:42:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8258.424191 secs 2024-04-21T12:42:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:27 smithi170 ceph-mon[31212]: pgmap v4499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:42:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:42:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:42:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:42:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:27 smithi077 ceph-mon[27902]: pgmap v4499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:42:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:42:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:42:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:42:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:27 smithi191 ceph-mon[31636]: pgmap v4499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:42:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:42:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:42:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:42:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8260.184651 secs 2024-04-21T12:42:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8260.184651 secs 2024-04-21T12:42:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8260.184651 secs 2024-04-21T12:42:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:29 smithi170 ceph-mon[31212]: pgmap v4500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:29 smithi077 ceph-mon[27902]: pgmap v4500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:29 smithi191 ceph-mon[31636]: pgmap v4500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:31 smithi170 ceph-mon[31212]: pgmap v4501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8263.424309 secs 2024-04-21T12:42:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:31 smithi077 ceph-mon[27902]: pgmap v4501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8263.424309 secs 2024-04-21T12:42:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:31 smithi191 ceph-mon[31636]: pgmap v4501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8263.424309 secs 2024-04-21T12:42:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:33 smithi170 ceph-mon[31212]: pgmap v4502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8265.184789 secs 2024-04-21T12:42:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:33 smithi077 ceph-mon[27902]: pgmap v4502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8265.184789 secs 2024-04-21T12:42:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:33 smithi191 ceph-mon[31636]: pgmap v4502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8265.184789 secs 2024-04-21T12:42:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:35 smithi170 ceph-mon[31212]: pgmap v4503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:35 smithi077 ceph-mon[27902]: pgmap v4503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:35 smithi191 ceph-mon[31636]: pgmap v4503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8268.424431 secs 2024-04-21T12:42:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8268.424431 secs 2024-04-21T12:42:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8268.424431 secs 2024-04-21T12:42:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:37 smithi170 ceph-mon[31212]: pgmap v4504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:37 smithi077 ceph-mon[27902]: pgmap v4504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:37 smithi191 ceph-mon[31636]: pgmap v4504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8270.184873 secs 2024-04-21T12:42:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8270.184873 secs 2024-04-21T12:42:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8270.184873 secs 2024-04-21T12:42:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:40 smithi170 ceph-mon[31212]: pgmap v4505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:40 smithi077 ceph-mon[27902]: pgmap v4505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:40 smithi191 ceph-mon[31636]: pgmap v4505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:42 smithi170 ceph-mon[31212]: pgmap v4506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8273.424568 secs 2024-04-21T12:42:42.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:42 smithi077 ceph-mon[27902]: pgmap v4506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8273.424568 secs 2024-04-21T12:42:42.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:42 smithi191 ceph-mon[31636]: pgmap v4506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8273.424568 secs 2024-04-21T12:42:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:44 smithi170 ceph-mon[31212]: pgmap v4507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8275.184993 secs 2024-04-21T12:42:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:44 smithi077 ceph-mon[27902]: pgmap v4507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8275.184993 secs 2024-04-21T12:42:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:44 smithi191 ceph-mon[31636]: pgmap v4507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8275.184993 secs 2024-04-21T12:42:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:46 smithi170 ceph-mon[31212]: pgmap v4508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:46 smithi077 ceph-mon[27902]: pgmap v4508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:46 smithi191 ceph-mon[31636]: pgmap v4508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:47.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8278.424695 secs 2024-04-21T12:42:47.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8278.424695 secs 2024-04-21T12:42:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8278.424695 secs 2024-04-21T12:42:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:48 smithi170 ceph-mon[31212]: pgmap v4509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:48 smithi077 ceph-mon[27902]: pgmap v4509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:48 smithi191 ceph-mon[31636]: pgmap v4509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8280.185108 secs 2024-04-21T12:42:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8280.185108 secs 2024-04-21T12:42:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8280.185108 secs 2024-04-21T12:42:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:50 smithi170 ceph-mon[31212]: pgmap v4510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:50 smithi077 ceph-mon[27902]: pgmap v4510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:50 smithi191 ceph-mon[31636]: pgmap v4510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:52 smithi170 ceph-mon[31212]: pgmap v4511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8283.424846 secs 2024-04-21T12:42:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:52 smithi077 ceph-mon[27902]: pgmap v4511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8283.424846 secs 2024-04-21T12:42:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:52 smithi191 ceph-mon[31636]: pgmap v4511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8283.424846 secs 2024-04-21T12:42:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:54 smithi170 ceph-mon[31212]: pgmap v4512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8285.185204 secs 2024-04-21T12:42:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:54 smithi077 ceph-mon[27902]: pgmap v4512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8285.185204 secs 2024-04-21T12:42:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:54 smithi191 ceph-mon[31636]: pgmap v4512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8285.185204 secs 2024-04-21T12:42:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:42:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:56 smithi170 ceph-mon[31212]: pgmap v4513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:56 smithi077 ceph-mon[27902]: pgmap v4513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:56 smithi191 ceph-mon[31636]: pgmap v4513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:42:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8288.424966 secs 2024-04-21T12:42:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8288.424966 secs 2024-04-21T12:42:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8288.424966 secs 2024-04-21T12:42:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:58 smithi170 ceph-mon[31212]: pgmap v4514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:58 smithi077 ceph-mon[27902]: pgmap v4514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:58 smithi191 ceph-mon[31636]: pgmap v4514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:42:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:42:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8290.185279 secs 2024-04-21T12:42:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:42:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8290.185279 secs 2024-04-21T12:42:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:42:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8290.185279 secs 2024-04-21T12:43:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:00 smithi170 ceph-mon[31212]: pgmap v4515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:00 smithi077 ceph-mon[27902]: pgmap v4515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:00 smithi191 ceph-mon[31636]: pgmap v4515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:02 smithi077 ceph-mon[27902]: pgmap v4516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8293.425107 secs 2024-04-21T12:43:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:02 smithi191 ceph-mon[31636]: pgmap v4516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8293.425107 secs 2024-04-21T12:43:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:02 smithi170 ceph-mon[31212]: pgmap v4516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8293.425107 secs 2024-04-21T12:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:04 smithi077 ceph-mon[27902]: pgmap v4517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8295.185411 secs 2024-04-21T12:43:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:04 smithi191 ceph-mon[31636]: pgmap v4517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8295.185411 secs 2024-04-21T12:43:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:04 smithi170 ceph-mon[31212]: pgmap v4517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8295.185411 secs 2024-04-21T12:43:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:05 smithi077 ceph-mon[27902]: osdmap e355: 12 total, 12 up, 12 in 2024-04-21T12:43:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:05 smithi191 ceph-mon[31636]: osdmap e355: 12 total, 12 up, 12 in 2024-04-21T12:43:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:05 smithi170 ceph-mon[31212]: osdmap e355: 12 total, 12 up, 12 in 2024-04-21T12:43:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:06 smithi077 ceph-mon[27902]: pgmap v4519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:43:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:06 smithi191 ceph-mon[31636]: pgmap v4519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:43:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:06 smithi170 ceph-mon[31212]: pgmap v4519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:43:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8298.425234 secs 2024-04-21T12:43:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8298.425234 secs 2024-04-21T12:43:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8298.425234 secs 2024-04-21T12:43:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:08 smithi077 ceph-mon[27902]: pgmap v4520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:43:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:08 smithi077 ceph-mon[27902]: osdmap e356: 12 total, 12 up, 12 in 2024-04-21T12:43:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:08 smithi191 ceph-mon[31636]: pgmap v4520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:43:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:08 smithi191 ceph-mon[31636]: osdmap e356: 12 total, 12 up, 12 in 2024-04-21T12:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:08 smithi170 ceph-mon[31212]: pgmap v4520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:08 smithi170 ceph-mon[31212]: osdmap e356: 12 total, 12 up, 12 in 2024-04-21T12:43:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8300.185526 secs 2024-04-21T12:43:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8300.185526 secs 2024-04-21T12:43:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8300.185526 secs 2024-04-21T12:43:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:10 smithi077 ceph-mon[27902]: pgmap v4522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:43:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:10 smithi191 ceph-mon[31636]: pgmap v4522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:43:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:10 smithi170 ceph-mon[31212]: pgmap v4522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:43:12.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:12 smithi077 ceph-mon[27902]: pgmap v4523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:43:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8303.425314 secs 2024-04-21T12:43:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:12 smithi191 ceph-mon[31636]: pgmap v4523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:43:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8303.425314 secs 2024-04-21T12:43:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:12 smithi170 ceph-mon[31212]: pgmap v4523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:43:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8303.425314 secs 2024-04-21T12:43:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:14 smithi077 ceph-mon[27902]: pgmap v4524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:43:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8305.185644 secs 2024-04-21T12:43:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:14 smithi191 ceph-mon[31636]: pgmap v4524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:43:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8305.185644 secs 2024-04-21T12:43:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:14 smithi170 ceph-mon[31212]: pgmap v4524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:43:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8305.185644 secs 2024-04-21T12:43:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:16 smithi077 ceph-mon[27902]: pgmap v4525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:43:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:16 smithi191 ceph-mon[31636]: pgmap v4525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:43:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:16 smithi170 ceph-mon[31212]: pgmap v4525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:43:17.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8308.425447 secs 2024-04-21T12:43:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8308.425447 secs 2024-04-21T12:43:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8308.425447 secs 2024-04-21T12:43:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:18 smithi077 ceph-mon[27902]: pgmap v4526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:43:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:18 smithi191 ceph-mon[31636]: pgmap v4526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:43:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:18 smithi170 ceph-mon[31212]: pgmap v4526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:43:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8310.185776 secs 2024-04-21T12:43:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8310.185776 secs 2024-04-21T12:43:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8310.185776 secs 2024-04-21T12:43:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:20 smithi077 ceph-mon[27902]: pgmap v4527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:43:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:20 smithi191 ceph-mon[31636]: pgmap v4527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:43:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:20 smithi170 ceph-mon[31212]: pgmap v4527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:43:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:22 smithi077 ceph-mon[27902]: pgmap v4528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:43:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8313.425512 secs 2024-04-21T12:43:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:22 smithi191 ceph-mon[31636]: pgmap v4528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:43:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8313.425512 secs 2024-04-21T12:43:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:22 smithi170 ceph-mon[31212]: pgmap v4528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:43:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8313.425512 secs 2024-04-21T12:43:24.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:24 smithi077 ceph-mon[27902]: pgmap v4529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8315.185891 secs 2024-04-21T12:43:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:24 smithi191 ceph-mon[31636]: pgmap v4529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8315.185891 secs 2024-04-21T12:43:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:24 smithi170 ceph-mon[31212]: pgmap v4529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8315.185891 secs 2024-04-21T12:43:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:26 smithi077 ceph-mon[27902]: pgmap v4530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:26 smithi191 ceph-mon[31636]: pgmap v4530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:26 smithi170 ceph-mon[31212]: pgmap v4530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8318.425638 secs 2024-04-21T12:43:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8318.425638 secs 2024-04-21T12:43:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8318.425638 secs 2024-04-21T12:43:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:28 smithi191 ceph-mon[31636]: pgmap v4531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:43:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:28 smithi170 ceph-mon[31212]: pgmap v4531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:43:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:28 smithi077 ceph-mon[27902]: pgmap v4531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:43:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8320.185982 secs 2024-04-21T12:43:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:43:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:43:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:43:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8320.185982 secs 2024-04-21T12:43:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:43:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:43:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:43:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8320.185982 secs 2024-04-21T12:43:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:43:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:43:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:43:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:30 smithi191 ceph-mon[31636]: pgmap v4532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:30 smithi170 ceph-mon[31212]: pgmap v4532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:30 smithi077 ceph-mon[27902]: pgmap v4532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:32 smithi191 ceph-mon[31636]: pgmap v4533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8323.425755 secs 2024-04-21T12:43:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:32 smithi170 ceph-mon[31212]: pgmap v4533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8323.425755 secs 2024-04-21T12:43:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:32 smithi077 ceph-mon[27902]: pgmap v4533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8323.425755 secs 2024-04-21T12:43:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:34 smithi191 ceph-mon[31636]: pgmap v4534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8325.186049 secs 2024-04-21T12:43:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:34 smithi170 ceph-mon[31212]: pgmap v4534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8325.186049 secs 2024-04-21T12:43:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:34 smithi077 ceph-mon[27902]: pgmap v4534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8325.186049 secs 2024-04-21T12:43:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:36 smithi191 ceph-mon[31636]: pgmap v4535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:36 smithi170 ceph-mon[31212]: pgmap v4535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:36 smithi077 ceph-mon[27902]: pgmap v4535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8328.425922 secs 2024-04-21T12:43:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8328.425922 secs 2024-04-21T12:43:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8328.425922 secs 2024-04-21T12:43:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:38 smithi191 ceph-mon[31636]: pgmap v4536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:38 smithi170 ceph-mon[31212]: pgmap v4536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:38 smithi077 ceph-mon[27902]: pgmap v4536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8330.186169 secs 2024-04-21T12:43:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8330.186169 secs 2024-04-21T12:43:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8330.186169 secs 2024-04-21T12:43:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:40 smithi191 ceph-mon[31636]: pgmap v4537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:40 smithi170 ceph-mon[31212]: pgmap v4537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:40 smithi077 ceph-mon[27902]: pgmap v4537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:42 smithi191 ceph-mon[31636]: pgmap v4538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8333.426043 secs 2024-04-21T12:43:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:42 smithi170 ceph-mon[31212]: pgmap v4538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8333.426043 secs 2024-04-21T12:43:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:42 smithi077 ceph-mon[27902]: pgmap v4538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8333.426043 secs 2024-04-21T12:43:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:44 smithi191 ceph-mon[31636]: pgmap v4539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8335.186284 secs 2024-04-21T12:43:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:44 smithi170 ceph-mon[31212]: pgmap v4539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8335.186284 secs 2024-04-21T12:43:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:44 smithi077 ceph-mon[27902]: pgmap v4539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8335.186284 secs 2024-04-21T12:43:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:46 smithi191 ceph-mon[31636]: pgmap v4540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:46 smithi170 ceph-mon[31212]: pgmap v4540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:46 smithi077 ceph-mon[27902]: pgmap v4540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:43:47.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8338.426106 secs 2024-04-21T12:43:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8338.426106 secs 2024-04-21T12:43:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8338.426106 secs 2024-04-21T12:43:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:48 smithi191 ceph-mon[31636]: pgmap v4541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:48 smithi170 ceph-mon[31212]: pgmap v4541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:48 smithi077 ceph-mon[27902]: pgmap v4541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8340.186399 secs 2024-04-21T12:43:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8340.186399 secs 2024-04-21T12:43:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8340.186399 secs 2024-04-21T12:43:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:50 smithi191 ceph-mon[31636]: pgmap v4542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:50 smithi170 ceph-mon[31212]: pgmap v4542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:50 smithi077 ceph-mon[27902]: pgmap v4542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:52 smithi191 ceph-mon[31636]: pgmap v4543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8343.426251 secs 2024-04-21T12:43:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:52 smithi170 ceph-mon[31212]: pgmap v4543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8343.426251 secs 2024-04-21T12:43:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:52 smithi077 ceph-mon[27902]: pgmap v4543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8343.426251 secs 2024-04-21T12:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T12:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T12:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a49e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7004c040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a49e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7004c040 comp rx=0 tx=0).stop 2024-04-21T12:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a49e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T12:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 msgr2=0x7efd640a49e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T12:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a3dc0 0x7efd640a49e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T12:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T12:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.418+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.419+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd70034000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T12:43:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.421+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T12:43:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.421+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T12:43:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.421+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:43:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.421+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T12:43:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.421+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:43:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.422+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T12:43:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:54.422+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T12:43:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:54 smithi191 ceph-mon[31636]: pgmap v4544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8345.186536 secs 2024-04-21T12:43:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:54 smithi170 ceph-mon[31212]: pgmap v4544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8345.186536 secs 2024-04-21T12:43:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:54 smithi077 ceph-mon[27902]: pgmap v4544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8345.186536 secs 2024-04-21T12:43:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:43:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:55.499+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:43:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:55.499+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:43:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:55.499+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:43:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:43:55.499+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:43:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:56 smithi191 ceph-mon[31636]: pgmap v4545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:56 smithi170 ceph-mon[31212]: pgmap v4545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:56 smithi077 ceph-mon[27902]: pgmap v4545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:43:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8348.426329 secs 2024-04-21T12:43:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8348.426329 secs 2024-04-21T12:43:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8348.426329 secs 2024-04-21T12:43:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:58 smithi170 ceph-mon[31212]: pgmap v4546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:58 smithi077 ceph-mon[27902]: pgmap v4546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:58 smithi191 ceph-mon[31636]: pgmap v4546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:43:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8350.186670 secs 2024-04-21T12:43:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8350.186670 secs 2024-04-21T12:43:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8350.186670 secs 2024-04-21T12:44:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:00 smithi170 ceph-mon[31212]: pgmap v4547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:00 smithi077 ceph-mon[27902]: pgmap v4547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:00 smithi191 ceph-mon[31636]: pgmap v4547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:02 smithi170 ceph-mon[31212]: pgmap v4548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8353.426453 secs 2024-04-21T12:44:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:02 smithi077 ceph-mon[27902]: pgmap v4548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8353.426453 secs 2024-04-21T12:44:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:02 smithi191 ceph-mon[31636]: pgmap v4548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8353.426453 secs 2024-04-21T12:44:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:04 smithi170 ceph-mon[31212]: pgmap v4549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8355.186803 secs 2024-04-21T12:44:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:04 smithi077 ceph-mon[27902]: pgmap v4549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8355.186803 secs 2024-04-21T12:44:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:04 smithi191 ceph-mon[31636]: pgmap v4549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8355.186803 secs 2024-04-21T12:44:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:05 smithi170 ceph-mon[31212]: osdmap e357: 12 total, 12 up, 12 in 2024-04-21T12:44:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:05 smithi077 ceph-mon[27902]: osdmap e357: 12 total, 12 up, 12 in 2024-04-21T12:44:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:05 smithi191 ceph-mon[31636]: osdmap e357: 12 total, 12 up, 12 in 2024-04-21T12:44:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:06 smithi170 ceph-mon[31212]: pgmap v4551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:44:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:06 smithi077 ceph-mon[27902]: pgmap v4551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:44:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:06 smithi191 ceph-mon[31636]: pgmap v4551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:44:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8358.426563 secs 2024-04-21T12:44:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8358.426563 secs 2024-04-21T12:44:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8358.426563 secs 2024-04-21T12:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:08 smithi170 ceph-mon[31212]: pgmap v4552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:08 smithi170 ceph-mon[31212]: osdmap e358: 12 total, 12 up, 12 in 2024-04-21T12:44:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:08 smithi077 ceph-mon[27902]: pgmap v4552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:44:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:08 smithi077 ceph-mon[27902]: osdmap e358: 12 total, 12 up, 12 in 2024-04-21T12:44:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:08 smithi191 ceph-mon[31636]: pgmap v4552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:44:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:08 smithi191 ceph-mon[31636]: osdmap e358: 12 total, 12 up, 12 in 2024-04-21T12:44:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8360.186919 secs 2024-04-21T12:44:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8360.186919 secs 2024-04-21T12:44:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8360.186919 secs 2024-04-21T12:44:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:10 smithi170 ceph-mon[31212]: pgmap v4554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:44:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:10 smithi077 ceph-mon[27902]: pgmap v4554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:44:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:10 smithi191 ceph-mon[31636]: pgmap v4554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:44:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:12 smithi170 ceph-mon[31212]: pgmap v4555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:44:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8363.426685 secs 2024-04-21T12:44:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:12 smithi077 ceph-mon[27902]: pgmap v4555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:44:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8363.426685 secs 2024-04-21T12:44:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:12 smithi191 ceph-mon[31636]: pgmap v4555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:44:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8363.426685 secs 2024-04-21T12:44:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:14 smithi170 ceph-mon[31212]: pgmap v4556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:44:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8365.187044 secs 2024-04-21T12:44:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:14 smithi077 ceph-mon[27902]: pgmap v4556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:44:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8365.187044 secs 2024-04-21T12:44:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:14 smithi191 ceph-mon[31636]: pgmap v4556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:44:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8365.187044 secs 2024-04-21T12:44:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:16 smithi170 ceph-mon[31212]: pgmap v4557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:44:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:16 smithi077 ceph-mon[27902]: pgmap v4557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:44:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:16 smithi191 ceph-mon[31636]: pgmap v4557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:44:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8368.426809 secs 2024-04-21T12:44:17.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8368.426809 secs 2024-04-21T12:44:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8368.426809 secs 2024-04-21T12:44:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:18 smithi170 ceph-mon[31212]: pgmap v4558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:44:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:18 smithi077 ceph-mon[27902]: pgmap v4558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:44:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:18 smithi191 ceph-mon[31636]: pgmap v4558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:44:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8370.187126 secs 2024-04-21T12:44:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8370.187126 secs 2024-04-21T12:44:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8370.187126 secs 2024-04-21T12:44:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:20 smithi170 ceph-mon[31212]: pgmap v4559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:44:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:20 smithi077 ceph-mon[27902]: pgmap v4559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:44:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:20 smithi191 ceph-mon[31636]: pgmap v4559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:44:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:22 smithi170 ceph-mon[31212]: pgmap v4560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:44:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8373.426913 secs 2024-04-21T12:44:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:22 smithi077 ceph-mon[27902]: pgmap v4560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:44:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8373.426913 secs 2024-04-21T12:44:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:22 smithi191 ceph-mon[31636]: pgmap v4560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:44:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8373.426913 secs 2024-04-21T12:44:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:24 smithi170 ceph-mon[31212]: pgmap v4561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8375.187207 secs 2024-04-21T12:44:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:24 smithi077 ceph-mon[27902]: pgmap v4561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8375.187207 secs 2024-04-21T12:44:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:24 smithi191 ceph-mon[31636]: pgmap v4561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8375.187207 secs 2024-04-21T12:44:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:26 smithi170 ceph-mon[31212]: pgmap v4562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:26 smithi077 ceph-mon[27902]: pgmap v4562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:26 smithi191 ceph-mon[31636]: pgmap v4562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8378.426977 secs 2024-04-21T12:44:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8378.426977 secs 2024-04-21T12:44:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8378.426977 secs 2024-04-21T12:44:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:28 smithi077 ceph-mon[27902]: pgmap v4563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:28 smithi191 ceph-mon[31636]: pgmap v4563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:28 smithi170 ceph-mon[31212]: pgmap v4563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8380.187268 secs 2024-04-21T12:44:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:44:29.649 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8380.187268 secs 2024-04-21T12:44:29.650 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:44:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8380.187268 secs 2024-04-21T12:44:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:44:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:30 smithi077 ceph-mon[27902]: pgmap v4564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:30 smithi191 ceph-mon[31636]: pgmap v4564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:30 smithi170 ceph-mon[31212]: pgmap v4564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: pgmap v4565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:44:31.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:44:31.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:44:31.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:44:31.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: pgmap v4565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:44:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: pgmap v4565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:44:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:44:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8383.427129 secs 2024-04-21T12:44:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8383.427129 secs 2024-04-21T12:44:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8383.427129 secs 2024-04-21T12:44:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:33 smithi191 ceph-mon[31636]: pgmap v4566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8385.187362 secs 2024-04-21T12:44:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:33 smithi170 ceph-mon[31212]: pgmap v4566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8385.187362 secs 2024-04-21T12:44:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:33 smithi077 ceph-mon[27902]: pgmap v4566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8385.187362 secs 2024-04-21T12:44:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:35 smithi191 ceph-mon[31636]: pgmap v4567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:35 smithi170 ceph-mon[31212]: pgmap v4567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:35 smithi077 ceph-mon[27902]: pgmap v4567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8388.427275 secs 2024-04-21T12:44:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8388.427275 secs 2024-04-21T12:44:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8388.427275 secs 2024-04-21T12:44:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:37 smithi170 ceph-mon[31212]: pgmap v4568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:37 smithi077 ceph-mon[27902]: pgmap v4568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:37 smithi191 ceph-mon[31636]: pgmap v4568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8390.187495 secs 2024-04-21T12:44:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8390.187495 secs 2024-04-21T12:44:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8390.187495 secs 2024-04-21T12:44:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:39 smithi170 ceph-mon[31212]: pgmap v4569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:39 smithi077 ceph-mon[27902]: pgmap v4569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:39 smithi191 ceph-mon[31636]: pgmap v4569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:41 smithi170 ceph-mon[31212]: pgmap v4570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8393.427425 secs 2024-04-21T12:44:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:41 smithi077 ceph-mon[27902]: pgmap v4570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8393.427425 secs 2024-04-21T12:44:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:41 smithi191 ceph-mon[31636]: pgmap v4570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8393.427425 secs 2024-04-21T12:44:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:43 smithi170 ceph-mon[31212]: pgmap v4571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8395.187625 secs 2024-04-21T12:44:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:43 smithi077 ceph-mon[27902]: pgmap v4571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8395.187625 secs 2024-04-21T12:44:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:43 smithi191 ceph-mon[31636]: pgmap v4571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8395.187625 secs 2024-04-21T12:44:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:45 smithi170 ceph-mon[31212]: pgmap v4572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:45 smithi077 ceph-mon[27902]: pgmap v4572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:45 smithi191 ceph-mon[31636]: pgmap v4572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8398.427562 secs 2024-04-21T12:44:47.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8398.427562 secs 2024-04-21T12:44:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8398.427562 secs 2024-04-21T12:44:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:47 smithi170 ceph-mon[31212]: pgmap v4573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:47 smithi077 ceph-mon[27902]: pgmap v4573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:47 smithi191 ceph-mon[31636]: pgmap v4573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8400.187686 secs 2024-04-21T12:44:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8400.187686 secs 2024-04-21T12:44:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8400.187686 secs 2024-04-21T12:44:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:50 smithi170 ceph-mon[31212]: pgmap v4574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:50 smithi077 ceph-mon[27902]: pgmap v4574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:50 smithi191 ceph-mon[31636]: pgmap v4574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:44:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:52 smithi170 ceph-mon[31212]: pgmap v4575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8403.427702 secs 2024-04-21T12:44:52.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:52 smithi077 ceph-mon[27902]: pgmap v4575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8403.427702 secs 2024-04-21T12:44:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:52 smithi191 ceph-mon[31636]: pgmap v4575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8403.427702 secs 2024-04-21T12:44:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:54 smithi170 ceph-mon[31212]: pgmap v4576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8405.187821 secs 2024-04-21T12:44:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:54 smithi077 ceph-mon[27902]: pgmap v4576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8405.187821 secs 2024-04-21T12:44:54.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:54 smithi191 ceph-mon[31636]: pgmap v4576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8405.187821 secs 2024-04-21T12:44:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:44:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:56 smithi170 ceph-mon[31212]: pgmap v4577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:56 smithi077 ceph-mon[27902]: pgmap v4577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:56 smithi191 ceph-mon[31636]: pgmap v4577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:44:57.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8408.427779 secs 2024-04-21T12:44:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8408.427779 secs 2024-04-21T12:44:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8408.427779 secs 2024-04-21T12:44:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:58 smithi170 ceph-mon[31212]: pgmap v4578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:58 smithi077 ceph-mon[27902]: pgmap v4578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:58 smithi191 ceph-mon[31636]: pgmap v4578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:44:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8410.187915 secs 2024-04-21T12:44:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8410.187915 secs 2024-04-21T12:44:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8410.187915 secs 2024-04-21T12:45:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:00 smithi170 ceph-mon[31212]: pgmap v4579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:00 smithi077 ceph-mon[27902]: pgmap v4579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:00 smithi191 ceph-mon[31636]: pgmap v4579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:02 smithi170 ceph-mon[31212]: pgmap v4580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T12:45:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8413.427914 secs 2024-04-21T12:45:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:02 smithi077 ceph-mon[27902]: pgmap v4580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T12:45:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8413.427914 secs 2024-04-21T12:45:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:02 smithi191 ceph-mon[31636]: pgmap v4580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T12:45:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8413.427914 secs 2024-04-21T12:45:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:04 smithi170 ceph-mon[31212]: pgmap v4581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T12:45:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8415.188031 secs 2024-04-21T12:45:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:04 smithi077 ceph-mon[27902]: pgmap v4581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T12:45:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8415.188031 secs 2024-04-21T12:45:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:04 smithi191 ceph-mon[31636]: pgmap v4581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T12:45:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8415.188031 secs 2024-04-21T12:45:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:05 smithi170 ceph-mon[31212]: osdmap e359: 12 total, 12 up, 12 in 2024-04-21T12:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:05 smithi077 ceph-mon[27902]: osdmap e359: 12 total, 12 up, 12 in 2024-04-21T12:45:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:05 smithi191 ceph-mon[31636]: osdmap e359: 12 total, 12 up, 12 in 2024-04-21T12:45:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:06 smithi170 ceph-mon[31212]: pgmap v4583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T12:45:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:06 smithi077 ceph-mon[27902]: pgmap v4583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T12:45:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:06 smithi191 ceph-mon[31636]: pgmap v4583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T12:45:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8418.428021 secs 2024-04-21T12:45:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8418.428021 secs 2024-04-21T12:45:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8418.428021 secs 2024-04-21T12:45:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:08 smithi170 ceph-mon[31212]: pgmap v4584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:45:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:08 smithi170 ceph-mon[31212]: osdmap e360: 12 total, 12 up, 12 in 2024-04-21T12:45:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:08 smithi077 ceph-mon[27902]: pgmap v4584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:45:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:08 smithi077 ceph-mon[27902]: osdmap e360: 12 total, 12 up, 12 in 2024-04-21T12:45:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:08 smithi191 ceph-mon[31636]: pgmap v4584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:45:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:08 smithi191 ceph-mon[31636]: osdmap e360: 12 total, 12 up, 12 in 2024-04-21T12:45:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8420.188178 secs 2024-04-21T12:45:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8420.188178 secs 2024-04-21T12:45:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8420.188178 secs 2024-04-21T12:45:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:10 smithi077 ceph-mon[27902]: pgmap v4586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-04-21T12:45:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:10 smithi191 ceph-mon[31636]: pgmap v4586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-04-21T12:45:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:10 smithi170 ceph-mon[31212]: pgmap v4586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-04-21T12:45:12.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:12 smithi077 ceph-mon[27902]: pgmap v4587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T12:45:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8423.428144 secs 2024-04-21T12:45:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:12 smithi191 ceph-mon[31636]: pgmap v4587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T12:45:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8423.428144 secs 2024-04-21T12:45:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:12 smithi170 ceph-mon[31212]: pgmap v4587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T12:45:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8423.428144 secs 2024-04-21T12:45:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:14 smithi077 ceph-mon[27902]: pgmap v4588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-04-21T12:45:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8425.188248 secs 2024-04-21T12:45:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:14 smithi191 ceph-mon[31636]: pgmap v4588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-04-21T12:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8425.188248 secs 2024-04-21T12:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:14 smithi170 ceph-mon[31212]: pgmap v4588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-04-21T12:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8425.188248 secs 2024-04-21T12:45:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:16 smithi077 ceph-mon[27902]: pgmap v4589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T12:45:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:16 smithi191 ceph-mon[31636]: pgmap v4589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T12:45:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:16 smithi170 ceph-mon[31212]: pgmap v4589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T12:45:17.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8428.428226 secs 2024-04-21T12:45:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8428.428226 secs 2024-04-21T12:45:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8428.428226 secs 2024-04-21T12:45:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:18 smithi077 ceph-mon[27902]: pgmap v4590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:45:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:18 smithi191 ceph-mon[31636]: pgmap v4590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:45:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:18 smithi170 ceph-mon[31212]: pgmap v4590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:45:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8430.188384 secs 2024-04-21T12:45:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8430.188384 secs 2024-04-21T12:45:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8430.188384 secs 2024-04-21T12:45:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:20 smithi077 ceph-mon[27902]: pgmap v4591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:45:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:20 smithi191 ceph-mon[31636]: pgmap v4591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:45:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:20 smithi170 ceph-mon[31212]: pgmap v4591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:45:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:22 smithi077 ceph-mon[27902]: pgmap v4592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:45:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8433.428359 secs 2024-04-21T12:45:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:22 smithi191 ceph-mon[31636]: pgmap v4592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:45:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8433.428359 secs 2024-04-21T12:45:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:22 smithi170 ceph-mon[31212]: pgmap v4592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:45:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8433.428359 secs 2024-04-21T12:45:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:24 smithi077 ceph-mon[27902]: pgmap v4593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8435.188497 secs 2024-04-21T12:45:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:24 smithi191 ceph-mon[31636]: pgmap v4593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8435.188497 secs 2024-04-21T12:45:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:24 smithi170 ceph-mon[31212]: pgmap v4593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8435.188497 secs 2024-04-21T12:45:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:26 smithi077 ceph-mon[27902]: pgmap v4594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:26 smithi191 ceph-mon[31636]: pgmap v4594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:26 smithi170 ceph-mon[31212]: pgmap v4594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8438.428485 secs 2024-04-21T12:45:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8438.428485 secs 2024-04-21T12:45:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8438.428485 secs 2024-04-21T12:45:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:28 smithi077 ceph-mon[27902]: pgmap v4595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:28 smithi191 ceph-mon[31636]: pgmap v4595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:28 smithi170 ceph-mon[31212]: pgmap v4595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8440.188592 secs 2024-04-21T12:45:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8440.188592 secs 2024-04-21T12:45:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8440.188592 secs 2024-04-21T12:45:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:30 smithi077 ceph-mon[27902]: pgmap v4596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:30 smithi191 ceph-mon[31636]: pgmap v4596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:30 smithi170 ceph-mon[31212]: pgmap v4596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:32 smithi077 ceph-mon[27902]: pgmap v4597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:45:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8443.428570 secs 2024-04-21T12:45:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:32 smithi191 ceph-mon[31636]: pgmap v4597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:45:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8443.428570 secs 2024-04-21T12:45:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:32 smithi170 ceph-mon[31212]: pgmap v4597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:45:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8443.428570 secs 2024-04-21T12:45:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:45:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:45:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:45:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:45:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:45:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:45:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:45:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:34 smithi077 ceph-mon[27902]: pgmap v4598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8445.188715 secs 2024-04-21T12:45:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:34 smithi191 ceph-mon[31636]: pgmap v4598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8445.188715 secs 2024-04-21T12:45:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:34 smithi170 ceph-mon[31212]: pgmap v4598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8445.188715 secs 2024-04-21T12:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:36 smithi077 ceph-mon[27902]: pgmap v4599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:36 smithi191 ceph-mon[31636]: pgmap v4599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:36 smithi170 ceph-mon[31212]: pgmap v4599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8448.428704 secs 2024-04-21T12:45:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8448.428704 secs 2024-04-21T12:45:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8448.428704 secs 2024-04-21T12:45:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:38 smithi077 ceph-mon[27902]: pgmap v4600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:38 smithi191 ceph-mon[31636]: pgmap v4600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:38 smithi170 ceph-mon[31212]: pgmap v4600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8450.188828 secs 2024-04-21T12:45:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8450.188828 secs 2024-04-21T12:45:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8450.188828 secs 2024-04-21T12:45:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:40 smithi191 ceph-mon[31636]: pgmap v4601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:40 smithi170 ceph-mon[31212]: pgmap v4601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:40 smithi077 ceph-mon[27902]: pgmap v4601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:42 smithi191 ceph-mon[31636]: pgmap v4602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8453.428834 secs 2024-04-21T12:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:42 smithi170 ceph-mon[31212]: pgmap v4602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8453.428834 secs 2024-04-21T12:45:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:42 smithi077 ceph-mon[27902]: pgmap v4602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8453.428834 secs 2024-04-21T12:45:44.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:44 smithi191 ceph-mon[31636]: pgmap v4603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8455.188939 secs 2024-04-21T12:45:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:44 smithi170 ceph-mon[31212]: pgmap v4603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8455.188939 secs 2024-04-21T12:45:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:44 smithi077 ceph-mon[27902]: pgmap v4603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8455.188939 secs 2024-04-21T12:45:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:46 smithi191 ceph-mon[31636]: pgmap v4604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:46 smithi170 ceph-mon[31212]: pgmap v4604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:46 smithi077 ceph-mon[27902]: pgmap v4604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:47.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8458.428899 secs 2024-04-21T12:45:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8458.428899 secs 2024-04-21T12:45:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8458.428899 secs 2024-04-21T12:45:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:48 smithi191 ceph-mon[31636]: pgmap v4605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:48 smithi170 ceph-mon[31212]: pgmap v4605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:48 smithi077 ceph-mon[27902]: pgmap v4605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8460.189034 secs 2024-04-21T12:45:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8460.189034 secs 2024-04-21T12:45:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8460.189034 secs 2024-04-21T12:45:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:50 smithi191 ceph-mon[31636]: pgmap v4606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:50 smithi170 ceph-mon[31212]: pgmap v4606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:50 smithi077 ceph-mon[27902]: pgmap v4606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:52 smithi191 ceph-mon[31636]: pgmap v4607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8463.429040 secs 2024-04-21T12:45:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:52 smithi170 ceph-mon[31212]: pgmap v4607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8463.429040 secs 2024-04-21T12:45:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:52 smithi077 ceph-mon[27902]: pgmap v4607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8463.429040 secs 2024-04-21T12:45:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:54 smithi191 ceph-mon[31636]: pgmap v4608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8465.189149 secs 2024-04-21T12:45:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:54 smithi170 ceph-mon[31212]: pgmap v4608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8465.189149 secs 2024-04-21T12:45:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:54 smithi077 ceph-mon[27902]: pgmap v4608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8465.189149 secs 2024-04-21T12:45:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:45:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:56 smithi191 ceph-mon[31636]: pgmap v4609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:56 smithi170 ceph-mon[31212]: pgmap v4609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:56 smithi077 ceph-mon[27902]: pgmap v4609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:45:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8468.429139 secs 2024-04-21T12:45:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8468.429139 secs 2024-04-21T12:45:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8468.429139 secs 2024-04-21T12:45:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:58 smithi191 ceph-mon[31636]: pgmap v4610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:58 smithi170 ceph-mon[31212]: pgmap v4610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:58 smithi077 ceph-mon[27902]: pgmap v4610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:45:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8470.189264 secs 2024-04-21T12:45:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8470.189264 secs 2024-04-21T12:45:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8470.189264 secs 2024-04-21T12:46:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:00 smithi191 ceph-mon[31636]: pgmap v4611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:00 smithi170 ceph-mon[31212]: pgmap v4611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:00 smithi077 ceph-mon[27902]: pgmap v4611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:02 smithi191 ceph-mon[31636]: pgmap v4612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T12:46:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8473.429260 secs 2024-04-21T12:46:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:02 smithi170 ceph-mon[31212]: pgmap v4612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T12:46:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8473.429260 secs 2024-04-21T12:46:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:02 smithi077 ceph-mon[27902]: pgmap v4612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T12:46:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8473.429260 secs 2024-04-21T12:46:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:04 smithi191 ceph-mon[31636]: pgmap v4613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:46:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8475.189397 secs 2024-04-21T12:46:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:04 smithi170 ceph-mon[31212]: pgmap v4613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:46:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8475.189397 secs 2024-04-21T12:46:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:04 smithi077 ceph-mon[27902]: pgmap v4613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:46:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8475.189397 secs 2024-04-21T12:46:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:05 smithi191 ceph-mon[31636]: osdmap e361: 12 total, 12 up, 12 in 2024-04-21T12:46:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:05 smithi170 ceph-mon[31212]: osdmap e361: 12 total, 12 up, 12 in 2024-04-21T12:46:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:05 smithi077 ceph-mon[27902]: osdmap e361: 12 total, 12 up, 12 in 2024-04-21T12:46:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:06 smithi191 ceph-mon[31636]: pgmap v4615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 102 B/s wr, 7 op/s 2024-04-21T12:46:06.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:06 smithi170 ceph-mon[31212]: pgmap v4615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 102 B/s wr, 7 op/s 2024-04-21T12:46:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:06 smithi077 ceph-mon[27902]: pgmap v4615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 102 B/s wr, 7 op/s 2024-04-21T12:46:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8478.429339 secs 2024-04-21T12:46:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8478.429339 secs 2024-04-21T12:46:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8478.429339 secs 2024-04-21T12:46:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:08 smithi170 ceph-mon[31212]: pgmap v4616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:46:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:08 smithi170 ceph-mon[31212]: osdmap e362: 12 total, 12 up, 12 in 2024-04-21T12:46:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:08 smithi077 ceph-mon[27902]: pgmap v4616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:46:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:08 smithi077 ceph-mon[27902]: osdmap e362: 12 total, 12 up, 12 in 2024-04-21T12:46:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:08 smithi191 ceph-mon[31636]: pgmap v4616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:46:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:08 smithi191 ceph-mon[31636]: osdmap e362: 12 total, 12 up, 12 in 2024-04-21T12:46:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8480.189508 secs 2024-04-21T12:46:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8480.189508 secs 2024-04-21T12:46:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8480.189508 secs 2024-04-21T12:46:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:10 smithi170 ceph-mon[31212]: pgmap v4618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-04-21T12:46:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:10 smithi077 ceph-mon[27902]: pgmap v4618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-04-21T12:46:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:10 smithi191 ceph-mon[31636]: pgmap v4618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-04-21T12:46:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:12 smithi170 ceph-mon[31212]: pgmap v4619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T12:46:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8483.429454 secs 2024-04-21T12:46:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:12 smithi077 ceph-mon[27902]: pgmap v4619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T12:46:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8483.429454 secs 2024-04-21T12:46:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:12 smithi191 ceph-mon[31636]: pgmap v4619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T12:46:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8483.429454 secs 2024-04-21T12:46:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:14 smithi170 ceph-mon[31212]: pgmap v4620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:46:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8485.189622 secs 2024-04-21T12:46:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:14 smithi077 ceph-mon[27902]: pgmap v4620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:46:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8485.189622 secs 2024-04-21T12:46:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:14 smithi191 ceph-mon[31636]: pgmap v4620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:46:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8485.189622 secs 2024-04-21T12:46:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:16 smithi170 ceph-mon[31212]: pgmap v4621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:46:16.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:16 smithi077 ceph-mon[27902]: pgmap v4621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:46:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:16 smithi191 ceph-mon[31636]: pgmap v4621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:46:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8488.429593 secs 2024-04-21T12:46:17.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8488.429593 secs 2024-04-21T12:46:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8488.429593 secs 2024-04-21T12:46:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:18 smithi170 ceph-mon[31212]: pgmap v4622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:46:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:18 smithi077 ceph-mon[27902]: pgmap v4622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:46:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:18 smithi191 ceph-mon[31636]: pgmap v4622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:46:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8490.189738 secs 2024-04-21T12:46:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8490.189738 secs 2024-04-21T12:46:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8490.189738 secs 2024-04-21T12:46:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:20 smithi170 ceph-mon[31212]: pgmap v4623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:46:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:20 smithi077 ceph-mon[27902]: pgmap v4623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:46:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:20 smithi191 ceph-mon[31636]: pgmap v4623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:46:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:22 smithi170 ceph-mon[31212]: pgmap v4624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:46:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8493.429692 secs 2024-04-21T12:46:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:22 smithi077 ceph-mon[27902]: pgmap v4624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:46:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8493.429692 secs 2024-04-21T12:46:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:22 smithi191 ceph-mon[31636]: pgmap v4624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:46:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8493.429692 secs 2024-04-21T12:46:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:24 smithi170 ceph-mon[31212]: pgmap v4625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8495.189891 secs 2024-04-21T12:46:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:24 smithi077 ceph-mon[27902]: pgmap v4625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8495.189891 secs 2024-04-21T12:46:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:24 smithi191 ceph-mon[31636]: pgmap v4625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8495.189891 secs 2024-04-21T12:46:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:26 smithi170 ceph-mon[31212]: pgmap v4626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:26 smithi077 ceph-mon[27902]: pgmap v4626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:26 smithi191 ceph-mon[31636]: pgmap v4626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8498.429846 secs 2024-04-21T12:46:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8498.429846 secs 2024-04-21T12:46:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8498.429846 secs 2024-04-21T12:46:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:28 smithi170 ceph-mon[31212]: pgmap v4627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:28 smithi077 ceph-mon[27902]: pgmap v4627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:28 smithi191 ceph-mon[31636]: pgmap v4627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8500.189968 secs 2024-04-21T12:46:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8500.189968 secs 2024-04-21T12:46:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8500.189968 secs 2024-04-21T12:46:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:30 smithi170 ceph-mon[31212]: pgmap v4628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:30 smithi077 ceph-mon[27902]: pgmap v4628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:30 smithi191 ceph-mon[31636]: pgmap v4628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:32 smithi170 ceph-mon[31212]: pgmap v4629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8503.429912 secs 2024-04-21T12:46:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:32 smithi077 ceph-mon[27902]: pgmap v4629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8503.429912 secs 2024-04-21T12:46:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:32 smithi191 ceph-mon[31636]: pgmap v4629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8503.429912 secs 2024-04-21T12:46:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:46:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:46:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:46:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: pgmap v4630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8505.190030 secs 2024-04-21T12:46:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:46:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:46:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: pgmap v4630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8505.190030 secs 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:46:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: pgmap v4630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8505.190030 secs 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:46:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:46:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:36 smithi077 ceph-mon[27902]: pgmap v4631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:36 smithi191 ceph-mon[31636]: pgmap v4631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:36 smithi170 ceph-mon[31212]: pgmap v4631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8508.429996 secs 2024-04-21T12:46:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8508.429996 secs 2024-04-21T12:46:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8508.429996 secs 2024-04-21T12:46:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:38 smithi077 ceph-mon[27902]: pgmap v4632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:38 smithi191 ceph-mon[31636]: pgmap v4632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:38 smithi170 ceph-mon[31212]: pgmap v4632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8510.190133 secs 2024-04-21T12:46:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8510.190133 secs 2024-04-21T12:46:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8510.190133 secs 2024-04-21T12:46:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:40 smithi077 ceph-mon[27902]: pgmap v4633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:40 smithi191 ceph-mon[31636]: pgmap v4633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:40 smithi170 ceph-mon[31212]: pgmap v4633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:42 smithi077 ceph-mon[27902]: pgmap v4634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8513.430105 secs 2024-04-21T12:46:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:42 smithi191 ceph-mon[31636]: pgmap v4634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8513.430105 secs 2024-04-21T12:46:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:42 smithi170 ceph-mon[31212]: pgmap v4634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8513.430105 secs 2024-04-21T12:46:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:44 smithi077 ceph-mon[27902]: pgmap v4635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8515.190196 secs 2024-04-21T12:46:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:44 smithi191 ceph-mon[31636]: pgmap v4635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8515.190196 secs 2024-04-21T12:46:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:44 smithi170 ceph-mon[31212]: pgmap v4635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8515.190196 secs 2024-04-21T12:46:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:46 smithi077 ceph-mon[27902]: pgmap v4636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:46 smithi191 ceph-mon[31636]: pgmap v4636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:46 smithi170 ceph-mon[31212]: pgmap v4636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8518.430227 secs 2024-04-21T12:46:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8518.430227 secs 2024-04-21T12:46:47.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8518.430227 secs 2024-04-21T12:46:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:48 smithi077 ceph-mon[27902]: pgmap v4637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:48 smithi191 ceph-mon[31636]: pgmap v4637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:48 smithi170 ceph-mon[31212]: pgmap v4637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8520.190308 secs 2024-04-21T12:46:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8520.190308 secs 2024-04-21T12:46:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8520.190308 secs 2024-04-21T12:46:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:50 smithi077 ceph-mon[27902]: pgmap v4638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:50 smithi191 ceph-mon[31636]: pgmap v4638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:50 smithi170 ceph-mon[31212]: pgmap v4638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:52 smithi077 ceph-mon[27902]: pgmap v4639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8523.430347 secs 2024-04-21T12:46:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:52 smithi191 ceph-mon[31636]: pgmap v4639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8523.430347 secs 2024-04-21T12:46:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:52 smithi170 ceph-mon[31212]: pgmap v4639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8523.430347 secs 2024-04-21T12:46:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:54 smithi077 ceph-mon[27902]: pgmap v4640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8525.190431 secs 2024-04-21T12:46:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:54 smithi191 ceph-mon[31636]: pgmap v4640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8525.190431 secs 2024-04-21T12:46:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:54 smithi170 ceph-mon[31212]: pgmap v4640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8525.190431 secs 2024-04-21T12:46:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:46:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:46:55.523+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:46:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:46:55.523+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:46:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:46:55.523+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:46:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:46:55.524+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:46:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:55 smithi191 ceph-mon[31636]: pgmap v4641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:55 smithi170 ceph-mon[31212]: pgmap v4641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:55 smithi077 ceph-mon[27902]: pgmap v4641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:46:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8528.430488 secs 2024-04-21T12:46:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:57 smithi191 ceph-mon[31636]: pgmap v4642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8528.430488 secs 2024-04-21T12:46:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:57 smithi170 ceph-mon[31212]: pgmap v4642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8528.430488 secs 2024-04-21T12:46:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:57 smithi077 ceph-mon[27902]: pgmap v4642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:46:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8530.190528 secs 2024-04-21T12:46:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8530.190528 secs 2024-04-21T12:46:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8530.190528 secs 2024-04-21T12:46:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:46:59 smithi191 ceph-mon[31636]: pgmap v4643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:46:59 smithi170 ceph-mon[31212]: pgmap v4643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:46:59 smithi077 ceph-mon[27902]: pgmap v4643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:01 smithi191 ceph-mon[31636]: pgmap v4644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:47:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8533.430605 secs 2024-04-21T12:47:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:01 smithi170 ceph-mon[31212]: pgmap v4644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:47:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8533.430605 secs 2024-04-21T12:47:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:01 smithi077 ceph-mon[27902]: pgmap v4644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:47:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8533.430605 secs 2024-04-21T12:47:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:03 smithi191 ceph-mon[31636]: pgmap v4645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:47:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8535.190649 secs 2024-04-21T12:47:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:03 smithi170 ceph-mon[31212]: pgmap v4645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:47:04.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8535.190649 secs 2024-04-21T12:47:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:03 smithi077 ceph-mon[27902]: pgmap v4645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T12:47:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8535.190649 secs 2024-04-21T12:47:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:04 smithi191 ceph-mon[31636]: osdmap e363: 12 total, 12 up, 12 in 2024-04-21T12:47:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:04 smithi170 ceph-mon[31212]: osdmap e363: 12 total, 12 up, 12 in 2024-04-21T12:47:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:04 smithi077 ceph-mon[27902]: osdmap e363: 12 total, 12 up, 12 in 2024-04-21T12:47:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:05 smithi191 ceph-mon[31636]: pgmap v4647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:47:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:05 smithi170 ceph-mon[31212]: pgmap v4647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:47:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:05 smithi077 ceph-mon[27902]: pgmap v4647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:47:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8538.430720 secs 2024-04-21T12:47:07.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8538.430720 secs 2024-04-21T12:47:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8538.430720 secs 2024-04-21T12:47:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:07 smithi170 ceph-mon[31212]: pgmap v4648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:47:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:07 smithi077 ceph-mon[27902]: pgmap v4648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:47:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:07 smithi191 ceph-mon[31636]: pgmap v4648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:47:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:09 smithi170 ceph-mon[31212]: osdmap e364: 12 total, 12 up, 12 in 2024-04-21T12:47:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8540.190749 secs 2024-04-21T12:47:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:09 smithi077 ceph-mon[27902]: osdmap e364: 12 total, 12 up, 12 in 2024-04-21T12:47:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8540.190749 secs 2024-04-21T12:47:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:09 smithi191 ceph-mon[31636]: osdmap e364: 12 total, 12 up, 12 in 2024-04-21T12:47:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8540.190749 secs 2024-04-21T12:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:10 smithi170 ceph-mon[31212]: pgmap v4650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:47:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:10 smithi077 ceph-mon[27902]: pgmap v4650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:47:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:10 smithi191 ceph-mon[31636]: pgmap v4650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 29 op/s 2024-04-21T12:47:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:12 smithi170 ceph-mon[31212]: pgmap v4651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:47:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8543.430848 secs 2024-04-21T12:47:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:12 smithi077 ceph-mon[27902]: pgmap v4651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:47:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8543.430848 secs 2024-04-21T12:47:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:12 smithi191 ceph-mon[31636]: pgmap v4651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:47:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8543.430848 secs 2024-04-21T12:47:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:14 smithi170 ceph-mon[31212]: pgmap v4652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:47:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8545.190875 secs 2024-04-21T12:47:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:14 smithi077 ceph-mon[27902]: pgmap v4652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:47:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8545.190875 secs 2024-04-21T12:47:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:14 smithi191 ceph-mon[31636]: pgmap v4652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:47:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8545.190875 secs 2024-04-21T12:47:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:16 smithi170 ceph-mon[31212]: pgmap v4653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:47:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:16 smithi077 ceph-mon[27902]: pgmap v4653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:47:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:16 smithi191 ceph-mon[31636]: pgmap v4653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:47:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8548.430927 secs 2024-04-21T12:47:17.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8548.430927 secs 2024-04-21T12:47:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8548.430927 secs 2024-04-21T12:47:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:18 smithi170 ceph-mon[31212]: pgmap v4654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:47:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:18 smithi077 ceph-mon[27902]: pgmap v4654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:47:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:18 smithi191 ceph-mon[31636]: pgmap v4654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:47:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8550.191011 secs 2024-04-21T12:47:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8550.191011 secs 2024-04-21T12:47:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8550.191011 secs 2024-04-21T12:47:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:20 smithi170 ceph-mon[31212]: pgmap v4655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:47:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:20 smithi077 ceph-mon[27902]: pgmap v4655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:47:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:20 smithi191 ceph-mon[31636]: pgmap v4655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:47:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:22 smithi170 ceph-mon[31212]: pgmap v4656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:47:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8553.431018 secs 2024-04-21T12:47:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:22 smithi077 ceph-mon[27902]: pgmap v4656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:47:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8553.431018 secs 2024-04-21T12:47:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:22 smithi191 ceph-mon[31636]: pgmap v4656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:47:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8553.431018 secs 2024-04-21T12:47:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:24 smithi170 ceph-mon[31212]: pgmap v4657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8555.191110 secs 2024-04-21T12:47:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:24 smithi077 ceph-mon[27902]: pgmap v4657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8555.191110 secs 2024-04-21T12:47:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:24 smithi191 ceph-mon[31636]: pgmap v4657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8555.191110 secs 2024-04-21T12:47:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:26 smithi170 ceph-mon[31212]: pgmap v4658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:26 smithi077 ceph-mon[27902]: pgmap v4658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:26 smithi191 ceph-mon[31636]: pgmap v4658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8558.431128 secs 2024-04-21T12:47:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8558.431128 secs 2024-04-21T12:47:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8558.431128 secs 2024-04-21T12:47:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:28 smithi170 ceph-mon[31212]: pgmap v4659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:28 smithi077 ceph-mon[27902]: pgmap v4659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:28 smithi191 ceph-mon[31636]: pgmap v4659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8560.191234 secs 2024-04-21T12:47:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8560.191234 secs 2024-04-21T12:47:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8560.191234 secs 2024-04-21T12:47:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:30 smithi170 ceph-mon[31212]: pgmap v4660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:30 smithi077 ceph-mon[27902]: pgmap v4660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:30 smithi191 ceph-mon[31636]: pgmap v4660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:32 smithi170 ceph-mon[31212]: pgmap v4661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8563.431273 secs 2024-04-21T12:47:32.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:32 smithi077 ceph-mon[27902]: pgmap v4661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8563.431273 secs 2024-04-21T12:47:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:32 smithi191 ceph-mon[31636]: pgmap v4661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8563.431273 secs 2024-04-21T12:47:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:34 smithi077 ceph-mon[27902]: pgmap v4662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8565.191361 secs 2024-04-21T12:47:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:34 smithi191 ceph-mon[31636]: pgmap v4662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8565.191361 secs 2024-04-21T12:47:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:34 smithi170 ceph-mon[31212]: pgmap v4662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8565.191361 secs 2024-04-21T12:47:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:47:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:47:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:47:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:47:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:47:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:47:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:47:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:47:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:47:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:36 smithi077 ceph-mon[27902]: pgmap v4663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:36 smithi191 ceph-mon[31636]: pgmap v4663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:36 smithi170 ceph-mon[31212]: pgmap v4663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8568.431418 secs 2024-04-21T12:47:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8568.431418 secs 2024-04-21T12:47:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8568.431418 secs 2024-04-21T12:47:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:38 smithi077 ceph-mon[27902]: pgmap v4664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:38 smithi191 ceph-mon[31636]: pgmap v4664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:38 smithi170 ceph-mon[31212]: pgmap v4664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8570.191497 secs 2024-04-21T12:47:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8570.191497 secs 2024-04-21T12:47:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8570.191497 secs 2024-04-21T12:47:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:40 smithi077 ceph-mon[27902]: pgmap v4665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:40 smithi191 ceph-mon[31636]: pgmap v4665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:40 smithi170 ceph-mon[31212]: pgmap v4665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:42 smithi077 ceph-mon[27902]: pgmap v4666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8573.431535 secs 2024-04-21T12:47:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:42 smithi191 ceph-mon[31636]: pgmap v4666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8573.431535 secs 2024-04-21T12:47:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:42 smithi170 ceph-mon[31212]: pgmap v4666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8573.431535 secs 2024-04-21T12:47:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:44 smithi077 ceph-mon[27902]: pgmap v4667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8575.191651 secs 2024-04-21T12:47:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:44 smithi191 ceph-mon[31636]: pgmap v4667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8575.191651 secs 2024-04-21T12:47:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:44 smithi170 ceph-mon[31212]: pgmap v4667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8575.191651 secs 2024-04-21T12:47:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:46 smithi077 ceph-mon[27902]: pgmap v4668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:46 smithi191 ceph-mon[31636]: pgmap v4668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:46 smithi170 ceph-mon[31212]: pgmap v4668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:47.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8578.431665 secs 2024-04-21T12:47:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8578.431665 secs 2024-04-21T12:47:47.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8578.431665 secs 2024-04-21T12:47:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:48 smithi077 ceph-mon[27902]: pgmap v4669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:48 smithi191 ceph-mon[31636]: pgmap v4669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:48 smithi170 ceph-mon[31212]: pgmap v4669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8580.191790 secs 2024-04-21T12:47:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8580.191790 secs 2024-04-21T12:47:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8580.191790 secs 2024-04-21T12:47:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:50 smithi077 ceph-mon[27902]: pgmap v4670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:50 smithi191 ceph-mon[31636]: pgmap v4670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:50 smithi170 ceph-mon[31212]: pgmap v4670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:52 smithi077 ceph-mon[27902]: pgmap v4671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8583.431804 secs 2024-04-21T12:47:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:52 smithi191 ceph-mon[31636]: pgmap v4671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8583.431804 secs 2024-04-21T12:47:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:52 smithi170 ceph-mon[31212]: pgmap v4671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8583.431804 secs 2024-04-21T12:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:54 smithi077 ceph-mon[27902]: pgmap v4672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8585.191916 secs 2024-04-21T12:47:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:54 smithi191 ceph-mon[31636]: pgmap v4672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8585.191916 secs 2024-04-21T12:47:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:54 smithi170 ceph-mon[31212]: pgmap v4672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8585.191916 secs 2024-04-21T12:47:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:47:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:56 smithi077 ceph-mon[27902]: pgmap v4673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:56.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:56 smithi191 ceph-mon[31636]: pgmap v4673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:56 smithi170 ceph-mon[31212]: pgmap v4673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:47:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8588.431847 secs 2024-04-21T12:47:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8588.431847 secs 2024-04-21T12:47:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8588.431847 secs 2024-04-21T12:47:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:58 smithi077 ceph-mon[27902]: pgmap v4674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:58 smithi191 ceph-mon[31636]: pgmap v4674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:58 smithi170 ceph-mon[31212]: pgmap v4674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:47:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:47:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8590.191939 secs 2024-04-21T12:47:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:47:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8590.191939 secs 2024-04-21T12:47:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:47:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8590.191939 secs 2024-04-21T12:48:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:00 smithi077 ceph-mon[27902]: pgmap v4675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:00 smithi191 ceph-mon[31636]: pgmap v4675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:00 smithi170 ceph-mon[31212]: pgmap v4675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:02 smithi191 ceph-mon[31636]: pgmap v4676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8593.431981 secs 2024-04-21T12:48:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:02 smithi170 ceph-mon[31212]: pgmap v4676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8593.431981 secs 2024-04-21T12:48:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:02 smithi077 ceph-mon[27902]: pgmap v4676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8593.431981 secs 2024-04-21T12:48:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:04 smithi191 ceph-mon[31636]: pgmap v4677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8595.192090 secs 2024-04-21T12:48:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:04 smithi170 ceph-mon[31212]: pgmap v4677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8595.192090 secs 2024-04-21T12:48:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:04 smithi077 ceph-mon[27902]: pgmap v4677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8595.192090 secs 2024-04-21T12:48:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:05 smithi191 ceph-mon[31636]: osdmap e365: 12 total, 12 up, 12 in 2024-04-21T12:48:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:05 smithi170 ceph-mon[31212]: osdmap e365: 12 total, 12 up, 12 in 2024-04-21T12:48:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:05 smithi077 ceph-mon[27902]: osdmap e365: 12 total, 12 up, 12 in 2024-04-21T12:48:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:06 smithi191 ceph-mon[31636]: pgmap v4679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:48:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:06 smithi170 ceph-mon[31212]: pgmap v4679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:48:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:06 smithi077 ceph-mon[27902]: pgmap v4679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:48:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8598.432062 secs 2024-04-21T12:48:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8598.432062 secs 2024-04-21T12:48:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8598.432062 secs 2024-04-21T12:48:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:08 smithi191 ceph-mon[31636]: pgmap v4680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:48:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:08 smithi191 ceph-mon[31636]: osdmap e366: 12 total, 12 up, 12 in 2024-04-21T12:48:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:08 smithi170 ceph-mon[31212]: pgmap v4680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:48:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:08 smithi170 ceph-mon[31212]: osdmap e366: 12 total, 12 up, 12 in 2024-04-21T12:48:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:08 smithi077 ceph-mon[27902]: pgmap v4680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:48:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:08 smithi077 ceph-mon[27902]: osdmap e366: 12 total, 12 up, 12 in 2024-04-21T12:48:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8600.192199 secs 2024-04-21T12:48:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8600.192199 secs 2024-04-21T12:48:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8600.192199 secs 2024-04-21T12:48:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:10 smithi191 ceph-mon[31636]: pgmap v4682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:48:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:10 smithi170 ceph-mon[31212]: pgmap v4682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:48:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:10 smithi077 ceph-mon[27902]: pgmap v4682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:48:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:12 smithi191 ceph-mon[31636]: pgmap v4683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:48:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8603.432200 secs 2024-04-21T12:48:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:12 smithi170 ceph-mon[31212]: pgmap v4683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:48:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8603.432200 secs 2024-04-21T12:48:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:12 smithi077 ceph-mon[27902]: pgmap v4683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:48:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8603.432200 secs 2024-04-21T12:48:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:14 smithi191 ceph-mon[31636]: pgmap v4684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:48:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8605.192313 secs 2024-04-21T12:48:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:14 smithi170 ceph-mon[31212]: pgmap v4684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:48:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8605.192313 secs 2024-04-21T12:48:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:14 smithi077 ceph-mon[27902]: pgmap v4684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:48:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8605.192313 secs 2024-04-21T12:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:16 smithi191 ceph-mon[31636]: pgmap v4685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:48:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:16 smithi170 ceph-mon[31212]: pgmap v4685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:48:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:16 smithi077 ceph-mon[27902]: pgmap v4685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:48:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8608.432281 secs 2024-04-21T12:48:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8608.432281 secs 2024-04-21T12:48:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8608.432281 secs 2024-04-21T12:48:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:18 smithi191 ceph-mon[31636]: pgmap v4686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:48:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:18 smithi170 ceph-mon[31212]: pgmap v4686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:48:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:18 smithi077 ceph-mon[27902]: pgmap v4686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:48:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8610.192431 secs 2024-04-21T12:48:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8610.192431 secs 2024-04-21T12:48:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8610.192431 secs 2024-04-21T12:48:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:20 smithi191 ceph-mon[31636]: pgmap v4687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:48:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:20 smithi170 ceph-mon[31212]: pgmap v4687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:48:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:20 smithi077 ceph-mon[27902]: pgmap v4687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:48:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:22 smithi191 ceph-mon[31636]: pgmap v4688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:48:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8613.432397 secs 2024-04-21T12:48:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:22 smithi170 ceph-mon[31212]: pgmap v4688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:48:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8613.432397 secs 2024-04-21T12:48:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:22 smithi077 ceph-mon[27902]: pgmap v4688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:48:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8613.432397 secs 2024-04-21T12:48:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:24 smithi191 ceph-mon[31636]: pgmap v4689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8615.192554 secs 2024-04-21T12:48:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:24 smithi170 ceph-mon[31212]: pgmap v4689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8615.192554 secs 2024-04-21T12:48:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:24 smithi077 ceph-mon[27902]: pgmap v4689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8615.192554 secs 2024-04-21T12:48:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:26 smithi191 ceph-mon[31636]: pgmap v4690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:26 smithi170 ceph-mon[31212]: pgmap v4690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:26 smithi077 ceph-mon[27902]: pgmap v4690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8618.432512 secs 2024-04-21T12:48:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8618.432512 secs 2024-04-21T12:48:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8618.432512 secs 2024-04-21T12:48:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:28 smithi191 ceph-mon[31636]: pgmap v4691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:28 smithi170 ceph-mon[31212]: pgmap v4691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:28 smithi077 ceph-mon[27902]: pgmap v4691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8620.192667 secs 2024-04-21T12:48:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8620.192667 secs 2024-04-21T12:48:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8620.192667 secs 2024-04-21T12:48:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:30 smithi170 ceph-mon[31212]: pgmap v4692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:30 smithi077 ceph-mon[27902]: pgmap v4692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:30 smithi191 ceph-mon[31636]: pgmap v4692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:32 smithi170 ceph-mon[31212]: pgmap v4693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8623.432649 secs 2024-04-21T12:48:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:32 smithi077 ceph-mon[27902]: pgmap v4693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8623.432649 secs 2024-04-21T12:48:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:32 smithi191 ceph-mon[31636]: pgmap v4693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8623.432649 secs 2024-04-21T12:48:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:34 smithi170 ceph-mon[31212]: pgmap v4694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8625.192813 secs 2024-04-21T12:48:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:34 smithi077 ceph-mon[27902]: pgmap v4694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8625.192813 secs 2024-04-21T12:48:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:34 smithi191 ceph-mon[31636]: pgmap v4694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8625.192813 secs 2024-04-21T12:48:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:48:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:48:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:48:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:36 smithi170 ceph-mon[31212]: pgmap v4695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:48:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:48:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:48:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:36 smithi077 ceph-mon[27902]: pgmap v4695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:48:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:48:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:48:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:36 smithi191 ceph-mon[31636]: pgmap v4695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:48:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:48:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:48:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8628.432799 secs 2024-04-21T12:48:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8628.432799 secs 2024-04-21T12:48:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8628.432799 secs 2024-04-21T12:48:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:38 smithi170 ceph-mon[31212]: pgmap v4696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:38 smithi077 ceph-mon[27902]: pgmap v4696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:38 smithi191 ceph-mon[31636]: pgmap v4696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8630.192951 secs 2024-04-21T12:48:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8630.192951 secs 2024-04-21T12:48:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8630.192951 secs 2024-04-21T12:48:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:40 smithi170 ceph-mon[31212]: pgmap v4697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:40 smithi077 ceph-mon[27902]: pgmap v4697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:40 smithi191 ceph-mon[31636]: pgmap v4697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:42 smithi170 ceph-mon[31212]: pgmap v4698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8633.432918 secs 2024-04-21T12:48:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:42 smithi077 ceph-mon[27902]: pgmap v4698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8633.432918 secs 2024-04-21T12:48:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:42 smithi191 ceph-mon[31636]: pgmap v4698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8633.432918 secs 2024-04-21T12:48:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:44 smithi170 ceph-mon[31212]: pgmap v4699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8635.193060 secs 2024-04-21T12:48:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:44 smithi077 ceph-mon[27902]: pgmap v4699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8635.193060 secs 2024-04-21T12:48:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:44 smithi191 ceph-mon[31636]: pgmap v4699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8635.193060 secs 2024-04-21T12:48:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:46 smithi170 ceph-mon[31212]: pgmap v4700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:46 smithi077 ceph-mon[27902]: pgmap v4700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:46 smithi191 ceph-mon[31636]: pgmap v4700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8638.432996 secs 2024-04-21T12:48:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8638.432996 secs 2024-04-21T12:48:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8638.432996 secs 2024-04-21T12:48:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:48 smithi170 ceph-mon[31212]: pgmap v4701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:48 smithi077 ceph-mon[27902]: pgmap v4701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:48 smithi191 ceph-mon[31636]: pgmap v4701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8640.193153 secs 2024-04-21T12:48:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8640.193153 secs 2024-04-21T12:48:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8640.193153 secs 2024-04-21T12:48:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:50 smithi170 ceph-mon[31212]: pgmap v4702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:50 smithi077 ceph-mon[27902]: pgmap v4702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:50 smithi191 ceph-mon[31636]: pgmap v4702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:52 smithi170 ceph-mon[31212]: pgmap v4703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:52.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8643.433112 secs 2024-04-21T12:48:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:52 smithi077 ceph-mon[27902]: pgmap v4703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8643.433112 secs 2024-04-21T12:48:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:52 smithi191 ceph-mon[31636]: pgmap v4703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8643.433112 secs 2024-04-21T12:48:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:54 smithi170 ceph-mon[31212]: pgmap v4704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8645.193277 secs 2024-04-21T12:48:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:54 smithi077 ceph-mon[27902]: pgmap v4704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8645.193277 secs 2024-04-21T12:48:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:54 smithi191 ceph-mon[31636]: pgmap v4704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8645.193277 secs 2024-04-21T12:48:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:48:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:56 smithi170 ceph-mon[31212]: pgmap v4705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:56 smithi077 ceph-mon[27902]: pgmap v4705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:56 smithi191 ceph-mon[31636]: pgmap v4705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:48:57.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8648.433179 secs 2024-04-21T12:48:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8648.433179 secs 2024-04-21T12:48:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8648.433179 secs 2024-04-21T12:48:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:58 smithi170 ceph-mon[31212]: pgmap v4706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:58 smithi077 ceph-mon[27902]: pgmap v4706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:58 smithi191 ceph-mon[31636]: pgmap v4706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:48:59.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:48:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8650.193396 secs 2024-04-21T12:48:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:48:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8650.193396 secs 2024-04-21T12:48:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:48:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8650.193396 secs 2024-04-21T12:49:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:00 smithi170 ceph-mon[31212]: pgmap v4707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:00 smithi077 ceph-mon[27902]: pgmap v4707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:00 smithi191 ceph-mon[31636]: pgmap v4707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:02 smithi170 ceph-mon[31212]: pgmap v4708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8653.433296 secs 2024-04-21T12:49:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:02 smithi077 ceph-mon[27902]: pgmap v4708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8653.433296 secs 2024-04-21T12:49:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:02 smithi191 ceph-mon[31636]: pgmap v4708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8653.433296 secs 2024-04-21T12:49:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:04 smithi077 ceph-mon[27902]: pgmap v4709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8655.193488 secs 2024-04-21T12:49:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:04 smithi191 ceph-mon[31636]: pgmap v4709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8655.193488 secs 2024-04-21T12:49:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:04 smithi170 ceph-mon[31212]: pgmap v4709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8655.193488 secs 2024-04-21T12:49:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:05 smithi077 ceph-mon[27902]: osdmap e367: 12 total, 12 up, 12 in 2024-04-21T12:49:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:05 smithi191 ceph-mon[31636]: osdmap e367: 12 total, 12 up, 12 in 2024-04-21T12:49:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:05 smithi170 ceph-mon[31212]: osdmap e367: 12 total, 12 up, 12 in 2024-04-21T12:49:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:06 smithi077 ceph-mon[27902]: pgmap v4711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:49:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:06 smithi191 ceph-mon[31636]: pgmap v4711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:49:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:06 smithi170 ceph-mon[31212]: pgmap v4711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:49:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8658.433436 secs 2024-04-21T12:49:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8658.433436 secs 2024-04-21T12:49:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8658.433436 secs 2024-04-21T12:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:08 smithi077 ceph-mon[27902]: pgmap v4712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:08 smithi077 ceph-mon[27902]: osdmap e368: 12 total, 12 up, 12 in 2024-04-21T12:49:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:08 smithi191 ceph-mon[31636]: pgmap v4712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:49:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:08 smithi191 ceph-mon[31636]: osdmap e368: 12 total, 12 up, 12 in 2024-04-21T12:49:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:08 smithi170 ceph-mon[31212]: pgmap v4712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:49:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:08 smithi170 ceph-mon[31212]: osdmap e368: 12 total, 12 up, 12 in 2024-04-21T12:49:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8660.193620 secs 2024-04-21T12:49:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8660.193620 secs 2024-04-21T12:49:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8660.193620 secs 2024-04-21T12:49:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:10.542+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:49:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:10.542+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:49:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:10.542+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:49:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:10.542+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:49:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:10 smithi077 ceph-mon[27902]: pgmap v4714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:49:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:10 smithi191 ceph-mon[31636]: pgmap v4714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:49:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:10 smithi170 ceph-mon[31212]: pgmap v4714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:49:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:12 smithi077 ceph-mon[27902]: pgmap v4715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:49:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8663.433532 secs 2024-04-21T12:49:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:12 smithi191 ceph-mon[31636]: pgmap v4715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:49:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8663.433532 secs 2024-04-21T12:49:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:12 smithi170 ceph-mon[31212]: pgmap v4715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:49:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8663.433532 secs 2024-04-21T12:49:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:14 smithi077 ceph-mon[27902]: pgmap v4716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:49:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8665.193757 secs 2024-04-21T12:49:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:14 smithi191 ceph-mon[31636]: pgmap v4716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:49:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8665.193757 secs 2024-04-21T12:49:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:14 smithi170 ceph-mon[31212]: pgmap v4716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T12:49:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8665.193757 secs 2024-04-21T12:49:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:16 smithi077 ceph-mon[27902]: pgmap v4717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:49:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:16 smithi191 ceph-mon[31636]: pgmap v4717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:49:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:16 smithi170 ceph-mon[31212]: pgmap v4717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:49:17.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8668.433651 secs 2024-04-21T12:49:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8668.433651 secs 2024-04-21T12:49:17.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8668.433651 secs 2024-04-21T12:49:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:18 smithi077 ceph-mon[27902]: pgmap v4718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:49:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:18 smithi191 ceph-mon[31636]: pgmap v4718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:49:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:18 smithi170 ceph-mon[31212]: pgmap v4718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:49:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8670.193892 secs 2024-04-21T12:49:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8670.193892 secs 2024-04-21T12:49:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8670.193892 secs 2024-04-21T12:49:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:20 smithi077 ceph-mon[27902]: pgmap v4719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:49:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:20 smithi191 ceph-mon[31636]: pgmap v4719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:49:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:20 smithi170 ceph-mon[31212]: pgmap v4719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:49:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:22 smithi077 ceph-mon[27902]: pgmap v4720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:49:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8673.433790 secs 2024-04-21T12:49:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:22 smithi191 ceph-mon[31636]: pgmap v4720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:49:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8673.433790 secs 2024-04-21T12:49:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:22 smithi170 ceph-mon[31212]: pgmap v4720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:49:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8673.433790 secs 2024-04-21T12:49:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:24 smithi077 ceph-mon[27902]: pgmap v4721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8675.193982 secs 2024-04-21T12:49:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:24 smithi191 ceph-mon[31636]: pgmap v4721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8675.193982 secs 2024-04-21T12:49:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:24 smithi170 ceph-mon[31212]: pgmap v4721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8675.193982 secs 2024-04-21T12:49:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:26 smithi077 ceph-mon[27902]: pgmap v4722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:26 smithi191 ceph-mon[31636]: pgmap v4722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:26 smithi170 ceph-mon[31212]: pgmap v4722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8678.433850 secs 2024-04-21T12:49:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8678.433850 secs 2024-04-21T12:49:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8678.433850 secs 2024-04-21T12:49:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:28 smithi077 ceph-mon[27902]: pgmap v4723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:28 smithi191 ceph-mon[31636]: pgmap v4723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:28 smithi170 ceph-mon[31212]: pgmap v4723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8680.194106 secs 2024-04-21T12:49:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:29 smithi191 ceph-mon[31636]: pgmap v4724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8680.194106 secs 2024-04-21T12:49:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:29 smithi170 ceph-mon[31212]: pgmap v4724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8680.194106 secs 2024-04-21T12:49:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:29 smithi077 ceph-mon[27902]: pgmap v4724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:31 smithi170 ceph-mon[31212]: pgmap v4725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8683.433973 secs 2024-04-21T12:49:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:31 smithi077 ceph-mon[27902]: pgmap v4725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8683.433973 secs 2024-04-21T12:49:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:31 smithi191 ceph-mon[31636]: pgmap v4725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8683.433973 secs 2024-04-21T12:49:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:33 smithi170 ceph-mon[31212]: pgmap v4726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8685.194225 secs 2024-04-21T12:49:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:33 smithi077 ceph-mon[27902]: pgmap v4726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8685.194225 secs 2024-04-21T12:49:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:33 smithi191 ceph-mon[31636]: pgmap v4726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8685.194225 secs 2024-04-21T12:49:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:35 smithi170 ceph-mon[31212]: pgmap v4727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:49:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:35 smithi077 ceph-mon[27902]: pgmap v4727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:49:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:35 smithi191 ceph-mon[31636]: pgmap v4727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:49:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:49:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:49:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:49:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8688.434091 secs 2024-04-21T12:49:37.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:49:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:49:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:49:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8688.434091 secs 2024-04-21T12:49:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:49:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:49:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:49:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8688.434091 secs 2024-04-21T12:49:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:38 smithi170 ceph-mon[31212]: pgmap v4728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:38 smithi077 ceph-mon[27902]: pgmap v4728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:38 smithi191 ceph-mon[31636]: pgmap v4728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8690.194389 secs 2024-04-21T12:49:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8690.194389 secs 2024-04-21T12:49:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8690.194389 secs 2024-04-21T12:49:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:40 smithi077 ceph-mon[27902]: pgmap v4729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:40 smithi191 ceph-mon[31636]: pgmap v4729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:40 smithi170 ceph-mon[31212]: pgmap v4729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:42 smithi077 ceph-mon[27902]: pgmap v4730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8693.434186 secs 2024-04-21T12:49:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:42 smithi191 ceph-mon[31636]: pgmap v4730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8693.434186 secs 2024-04-21T12:49:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:42 smithi170 ceph-mon[31212]: pgmap v4730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8693.434186 secs 2024-04-21T12:49:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:44 smithi077 ceph-mon[27902]: pgmap v4731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8695.194516 secs 2024-04-21T12:49:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:44 smithi191 ceph-mon[31636]: pgmap v4731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8695.194516 secs 2024-04-21T12:49:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:44 smithi170 ceph-mon[31212]: pgmap v4731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8695.194516 secs 2024-04-21T12:49:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:46 smithi077 ceph-mon[27902]: pgmap v4732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:46 smithi191 ceph-mon[31636]: pgmap v4732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:46 smithi170 ceph-mon[31212]: pgmap v4732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8698.434329 secs 2024-04-21T12:49:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8698.434329 secs 2024-04-21T12:49:47.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8698.434329 secs 2024-04-21T12:49:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:48 smithi077 ceph-mon[27902]: pgmap v4733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:48 smithi191 ceph-mon[31636]: pgmap v4733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:48 smithi170 ceph-mon[31212]: pgmap v4733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8700.194580 secs 2024-04-21T12:49:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8700.194580 secs 2024-04-21T12:49:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8700.194580 secs 2024-04-21T12:49:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:50 smithi077 ceph-mon[27902]: pgmap v4734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:50 smithi191 ceph-mon[31636]: pgmap v4734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:50 smithi170 ceph-mon[31212]: pgmap v4734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:52 smithi077 ceph-mon[27902]: pgmap v4735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8703.434457 secs 2024-04-21T12:49:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:52 smithi191 ceph-mon[31636]: pgmap v4735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8703.434457 secs 2024-04-21T12:49:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:52 smithi170 ceph-mon[31212]: pgmap v4735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8703.434457 secs 2024-04-21T12:49:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:54 smithi077 ceph-mon[27902]: pgmap v4736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8705.194700 secs 2024-04-21T12:49:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:54 smithi191 ceph-mon[31636]: pgmap v4736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8705.194700 secs 2024-04-21T12:49:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:54 smithi170 ceph-mon[31212]: pgmap v4736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8705.194700 secs 2024-04-21T12:49:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:49:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:55.549+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:49:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:55.549+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:49:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:55.549+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:49:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:49:55.549+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:49:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:56 smithi077 ceph-mon[27902]: pgmap v4737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:56 smithi191 ceph-mon[31636]: pgmap v4737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:56 smithi170 ceph-mon[31212]: pgmap v4737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:49:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8708.434590 secs 2024-04-21T12:49:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8708.434590 secs 2024-04-21T12:49:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8708.434590 secs 2024-04-21T12:49:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:58 smithi077 ceph-mon[27902]: pgmap v4738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:58 smithi191 ceph-mon[31636]: pgmap v4738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:58 smithi170 ceph-mon[31212]: pgmap v4738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:49:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:49:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8710.194755 secs 2024-04-21T12:49:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:49:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8710.194755 secs 2024-04-21T12:49:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:49:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8710.194755 secs 2024-04-21T12:50:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:00 smithi077 ceph-mon[27902]: pgmap v4739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:50:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:00 smithi191 ceph-mon[31636]: pgmap v4739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:50:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:00 smithi170 ceph-mon[31212]: pgmap v4739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T12:50:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:02 smithi077 ceph-mon[27902]: pgmap v4740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8713.434712 secs 2024-04-21T12:50:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:02 smithi191 ceph-mon[31636]: pgmap v4740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8713.434712 secs 2024-04-21T12:50:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:02 smithi170 ceph-mon[31212]: pgmap v4740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8713.434712 secs 2024-04-21T12:50:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:04 smithi077 ceph-mon[27902]: pgmap v4741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8715.194841 secs 2024-04-21T12:50:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:04 smithi077 ceph-mon[27902]: osdmap e369: 12 total, 12 up, 12 in 2024-04-21T12:50:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:04 smithi191 ceph-mon[31636]: pgmap v4741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8715.194841 secs 2024-04-21T12:50:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:04 smithi191 ceph-mon[31636]: osdmap e369: 12 total, 12 up, 12 in 2024-04-21T12:50:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:04 smithi170 ceph-mon[31212]: pgmap v4741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8715.194841 secs 2024-04-21T12:50:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:04 smithi170 ceph-mon[31212]: osdmap e369: 12 total, 12 up, 12 in 2024-04-21T12:50:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:06.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:06 smithi077 ceph-mon[27902]: pgmap v4743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:50:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:06 smithi191 ceph-mon[31636]: pgmap v4743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:50:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:06 smithi170 ceph-mon[31212]: pgmap v4743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:50:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8718.434820 secs 2024-04-21T12:50:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8718.434820 secs 2024-04-21T12:50:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8718.434820 secs 2024-04-21T12:50:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:08 smithi077 ceph-mon[27902]: pgmap v4744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:50:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:08 smithi077 ceph-mon[27902]: osdmap e370: 12 total, 12 up, 12 in 2024-04-21T12:50:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:08 smithi191 ceph-mon[31636]: pgmap v4744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:50:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:08 smithi191 ceph-mon[31636]: osdmap e370: 12 total, 12 up, 12 in 2024-04-21T12:50:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:08 smithi170 ceph-mon[31212]: pgmap v4744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:50:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:08 smithi170 ceph-mon[31212]: osdmap e370: 12 total, 12 up, 12 in 2024-04-21T12:50:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8720.194926 secs 2024-04-21T12:50:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8720.194926 secs 2024-04-21T12:50:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8720.194926 secs 2024-04-21T12:50:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:10 smithi191 ceph-mon[31636]: pgmap v4746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:50:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:10 smithi170 ceph-mon[31212]: pgmap v4746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:50:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:10 smithi077 ceph-mon[27902]: pgmap v4746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:50:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:11 smithi191 ceph-mon[31636]: pgmap v4747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:50:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:11 smithi170 ceph-mon[31212]: pgmap v4747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:50:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:11 smithi077 ceph-mon[27902]: pgmap v4747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:50:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8723.434937 secs 2024-04-21T12:50:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8723.434937 secs 2024-04-21T12:50:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8723.434937 secs 2024-04-21T12:50:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:13 smithi191 ceph-mon[31636]: pgmap v4748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T12:50:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:13 smithi170 ceph-mon[31212]: pgmap v4748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T12:50:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:13 smithi077 ceph-mon[27902]: pgmap v4748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T12:50:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8725.195044 secs 2024-04-21T12:50:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8725.195044 secs 2024-04-21T12:50:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8725.195044 secs 2024-04-21T12:50:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:15 smithi191 ceph-mon[31636]: pgmap v4749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:50:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:15 smithi170 ceph-mon[31212]: pgmap v4749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:50:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:15 smithi077 ceph-mon[27902]: pgmap v4749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:50:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8728.435048 secs 2024-04-21T12:50:17.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8728.435048 secs 2024-04-21T12:50:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8728.435048 secs 2024-04-21T12:50:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:17 smithi170 ceph-mon[31212]: pgmap v4750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:50:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:17 smithi077 ceph-mon[27902]: pgmap v4750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:50:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:17 smithi191 ceph-mon[31636]: pgmap v4750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:50:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8730.195143 secs 2024-04-21T12:50:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8730.195143 secs 2024-04-21T12:50:19.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8730.195143 secs 2024-04-21T12:50:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:20 smithi170 ceph-mon[31212]: pgmap v4751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:50:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:20 smithi077 ceph-mon[27902]: pgmap v4751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:50:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:20 smithi191 ceph-mon[31636]: pgmap v4751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:50:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:22 smithi170 ceph-mon[31212]: pgmap v4752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:50:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8733.435172 secs 2024-04-21T12:50:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:22 smithi077 ceph-mon[27902]: pgmap v4752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:50:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8733.435172 secs 2024-04-21T12:50:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:22 smithi191 ceph-mon[31636]: pgmap v4752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:50:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8733.435172 secs 2024-04-21T12:50:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:24 smithi170 ceph-mon[31212]: pgmap v4753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8735.195260 secs 2024-04-21T12:50:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:24 smithi077 ceph-mon[27902]: pgmap v4753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8735.195260 secs 2024-04-21T12:50:24.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:24 smithi191 ceph-mon[31636]: pgmap v4753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8735.195260 secs 2024-04-21T12:50:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:26 smithi077 ceph-mon[27902]: pgmap v4754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:26 smithi191 ceph-mon[31636]: pgmap v4754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:26 smithi170 ceph-mon[31212]: pgmap v4754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8738.435252 secs 2024-04-21T12:50:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8738.435252 secs 2024-04-21T12:50:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8738.435252 secs 2024-04-21T12:50:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:28 smithi077 ceph-mon[27902]: pgmap v4755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:28 smithi191 ceph-mon[31636]: pgmap v4755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:28 smithi170 ceph-mon[31212]: pgmap v4755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8740.195339 secs 2024-04-21T12:50:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8740.195339 secs 2024-04-21T12:50:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8740.195339 secs 2024-04-21T12:50:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:30 smithi077 ceph-mon[27902]: pgmap v4756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:30 smithi191 ceph-mon[31636]: pgmap v4756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:30 smithi170 ceph-mon[31212]: pgmap v4756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:32 smithi077 ceph-mon[27902]: pgmap v4757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8743.435333 secs 2024-04-21T12:50:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:32 smithi191 ceph-mon[31636]: pgmap v4757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8743.435333 secs 2024-04-21T12:50:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:32 smithi170 ceph-mon[31212]: pgmap v4757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8743.435333 secs 2024-04-21T12:50:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:34 smithi077 ceph-mon[27902]: pgmap v4758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8745.195494 secs 2024-04-21T12:50:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:34 smithi191 ceph-mon[31636]: pgmap v4758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8745.195494 secs 2024-04-21T12:50:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:34 smithi170 ceph-mon[31212]: pgmap v4758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8745.195494 secs 2024-04-21T12:50:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:36 smithi077 ceph-mon[27902]: pgmap v4759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:36 smithi191 ceph-mon[31636]: pgmap v4759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:36 smithi170 ceph-mon[31212]: pgmap v4759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:50:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8748.435410 secs 2024-04-21T12:50:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:50:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8748.435410 secs 2024-04-21T12:50:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:50:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8748.435410 secs 2024-04-21T12:50:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:38 smithi077 ceph-mon[27902]: pgmap v4760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:38 smithi191 ceph-mon[31636]: pgmap v4760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:38 smithi170 ceph-mon[31212]: pgmap v4760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:39.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8750.195630 secs 2024-04-21T12:50:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8750.195630 secs 2024-04-21T12:50:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8750.195630 secs 2024-04-21T12:50:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:40.346 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:40 smithi077 ceph-mon[27902]: pgmap v4761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:40 smithi191 ceph-mon[31636]: pgmap v4761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:40 smithi170 ceph-mon[31212]: pgmap v4761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: pgmap v4762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:50:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:50:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8753.435478 secs 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: pgmap v4762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8753.435478 secs 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: pgmap v4762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:50:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8753.435478 secs 2024-04-21T12:50:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:43 smithi170 ceph-mon[31212]: pgmap v4763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8755.195695 secs 2024-04-21T12:50:44.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:43 smithi077 ceph-mon[27902]: pgmap v4763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8755.195695 secs 2024-04-21T12:50:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:43 smithi191 ceph-mon[31636]: pgmap v4763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8755.195695 secs 2024-04-21T12:50:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:45 smithi170 ceph-mon[31212]: pgmap v4764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:45 smithi077 ceph-mon[27902]: pgmap v4764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:45 smithi191 ceph-mon[31636]: pgmap v4764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8758.435588 secs 2024-04-21T12:50:47.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8758.435588 secs 2024-04-21T12:50:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8758.435588 secs 2024-04-21T12:50:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:47 smithi170 ceph-mon[31212]: pgmap v4765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:47 smithi077 ceph-mon[27902]: pgmap v4765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:47 smithi191 ceph-mon[31636]: pgmap v4765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8760.195808 secs 2024-04-21T12:50:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8760.195808 secs 2024-04-21T12:50:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8760.195808 secs 2024-04-21T12:50:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:49 smithi170 ceph-mon[31212]: pgmap v4766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:49 smithi077 ceph-mon[27902]: pgmap v4766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:49 smithi191 ceph-mon[31636]: pgmap v4766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:51 smithi170 ceph-mon[31212]: pgmap v4767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8763.435716 secs 2024-04-21T12:50:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:51 smithi077 ceph-mon[27902]: pgmap v4767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8763.435716 secs 2024-04-21T12:50:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:51 smithi191 ceph-mon[31636]: pgmap v4767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8763.435716 secs 2024-04-21T12:50:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:53 smithi170 ceph-mon[31212]: pgmap v4768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8765.195938 secs 2024-04-21T12:50:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:53 smithi077 ceph-mon[27902]: pgmap v4768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8765.195938 secs 2024-04-21T12:50:54.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:53 smithi191 ceph-mon[31636]: pgmap v4768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8765.195938 secs 2024-04-21T12:50:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:50:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:55 smithi170 ceph-mon[31212]: pgmap v4769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:55 smithi077 ceph-mon[27902]: pgmap v4769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:55 smithi191 ceph-mon[31636]: pgmap v4769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:50:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8768.435857 secs 2024-04-21T12:50:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8768.435857 secs 2024-04-21T12:50:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8768.435857 secs 2024-04-21T12:50:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:57 smithi170 ceph-mon[31212]: pgmap v4770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:57 smithi077 ceph-mon[27902]: pgmap v4770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:57 smithi191 ceph-mon[31636]: pgmap v4770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:50:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8770.196004 secs 2024-04-21T12:50:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8770.196004 secs 2024-04-21T12:50:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8770.196004 secs 2024-04-21T12:51:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:50:59 smithi170 ceph-mon[31212]: pgmap v4771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:50:59 smithi077 ceph-mon[27902]: pgmap v4771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:50:59 smithi191 ceph-mon[31636]: pgmap v4771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:01 smithi170 ceph-mon[31212]: pgmap v4772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:02.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8773.435980 secs 2024-04-21T12:51:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:01 smithi077 ceph-mon[27902]: pgmap v4772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8773.435980 secs 2024-04-21T12:51:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:01 smithi191 ceph-mon[31636]: pgmap v4772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8773.435980 secs 2024-04-21T12:51:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:03 smithi077 ceph-mon[27902]: pgmap v4773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:04.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8775.196117 secs 2024-04-21T12:51:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:03 smithi191 ceph-mon[31636]: pgmap v4773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8775.196117 secs 2024-04-21T12:51:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:03 smithi170 ceph-mon[31212]: pgmap v4773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8775.196117 secs 2024-04-21T12:51:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:04 smithi077 ceph-mon[27902]: osdmap e371: 12 total, 12 up, 12 in 2024-04-21T12:51:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:04 smithi191 ceph-mon[31636]: osdmap e371: 12 total, 12 up, 12 in 2024-04-21T12:51:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:04 smithi170 ceph-mon[31212]: osdmap e371: 12 total, 12 up, 12 in 2024-04-21T12:51:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:05 smithi077 ceph-mon[27902]: pgmap v4775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:51:06.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:05 smithi191 ceph-mon[31636]: pgmap v4775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:51:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:05 smithi170 ceph-mon[31212]: pgmap v4775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:51:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8778.436095 secs 2024-04-21T12:51:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8778.436095 secs 2024-04-21T12:51:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8778.436095 secs 2024-04-21T12:51:08.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:07 smithi077 ceph-mon[27902]: pgmap v4776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:51:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:07 smithi191 ceph-mon[31636]: pgmap v4776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:51:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:07 smithi170 ceph-mon[31212]: pgmap v4776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:51:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:09 smithi077 ceph-mon[27902]: osdmap e372: 12 total, 12 up, 12 in 2024-04-21T12:51:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8780.196194 secs 2024-04-21T12:51:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:09 smithi191 ceph-mon[31636]: osdmap e372: 12 total, 12 up, 12 in 2024-04-21T12:51:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8780.196194 secs 2024-04-21T12:51:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:09 smithi170 ceph-mon[31212]: osdmap e372: 12 total, 12 up, 12 in 2024-04-21T12:51:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8780.196194 secs 2024-04-21T12:51:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:10 smithi077 ceph-mon[27902]: pgmap v4778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:51:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:10 smithi191 ceph-mon[31636]: pgmap v4778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:51:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:10 smithi170 ceph-mon[31212]: pgmap v4778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:12 smithi077 ceph-mon[27902]: pgmap v4779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8783.436216 secs 2024-04-21T12:51:12.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:12 smithi191 ceph-mon[31636]: pgmap v4779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8783.436216 secs 2024-04-21T12:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:12 smithi170 ceph-mon[31212]: pgmap v4779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8783.436216 secs 2024-04-21T12:51:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:14 smithi077 ceph-mon[27902]: pgmap v4780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:51:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8785.196348 secs 2024-04-21T12:51:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:14 smithi191 ceph-mon[31636]: pgmap v4780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:51:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8785.196348 secs 2024-04-21T12:51:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:14 smithi170 ceph-mon[31212]: pgmap v4780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T12:51:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8785.196348 secs 2024-04-21T12:51:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:16 smithi077 ceph-mon[27902]: pgmap v4781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:51:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:16 smithi191 ceph-mon[31636]: pgmap v4781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:51:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:16 smithi170 ceph-mon[31212]: pgmap v4781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:51:17.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8788.436297 secs 2024-04-21T12:51:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8788.436297 secs 2024-04-21T12:51:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8788.436297 secs 2024-04-21T12:51:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:18 smithi077 ceph-mon[27902]: pgmap v4782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:51:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:18 smithi191 ceph-mon[31636]: pgmap v4782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:51:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:18 smithi170 ceph-mon[31212]: pgmap v4782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:51:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8790.196477 secs 2024-04-21T12:51:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8790.196477 secs 2024-04-21T12:51:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8790.196477 secs 2024-04-21T12:51:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:20 smithi077 ceph-mon[27902]: pgmap v4783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:51:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:20 smithi191 ceph-mon[31636]: pgmap v4783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:51:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:20 smithi170 ceph-mon[31212]: pgmap v4783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:51:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:22 smithi077 ceph-mon[27902]: pgmap v4784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:51:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8793.436389 secs 2024-04-21T12:51:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:22 smithi191 ceph-mon[31636]: pgmap v4784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:51:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8793.436389 secs 2024-04-21T12:51:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:22 smithi170 ceph-mon[31212]: pgmap v4784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:51:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8793.436389 secs 2024-04-21T12:51:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:24 smithi077 ceph-mon[27902]: pgmap v4785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8795.196616 secs 2024-04-21T12:51:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:24 smithi191 ceph-mon[31636]: pgmap v4785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8795.196616 secs 2024-04-21T12:51:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:24 smithi170 ceph-mon[31212]: pgmap v4785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8795.196616 secs 2024-04-21T12:51:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:26 smithi077 ceph-mon[27902]: pgmap v4786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:26 smithi191 ceph-mon[31636]: pgmap v4786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:26 smithi170 ceph-mon[31212]: pgmap v4786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8798.436507 secs 2024-04-21T12:51:27.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8798.436507 secs 2024-04-21T12:51:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8798.436507 secs 2024-04-21T12:51:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:28 smithi077 ceph-mon[27902]: pgmap v4787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:28 smithi191 ceph-mon[31636]: pgmap v4787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:28 smithi170 ceph-mon[31212]: pgmap v4787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8800.196750 secs 2024-04-21T12:51:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8800.196750 secs 2024-04-21T12:51:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8800.196750 secs 2024-04-21T12:51:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:30 smithi077 ceph-mon[27902]: pgmap v4788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:30 smithi191 ceph-mon[31636]: pgmap v4788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:30 smithi170 ceph-mon[31212]: pgmap v4788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:32 smithi077 ceph-mon[27902]: pgmap v4789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:32.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8803.436626 secs 2024-04-21T12:51:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:32 smithi191 ceph-mon[31636]: pgmap v4789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8803.436626 secs 2024-04-21T12:51:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:32 smithi170 ceph-mon[31212]: pgmap v4789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8803.436626 secs 2024-04-21T12:51:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:34 smithi077 ceph-mon[27902]: pgmap v4790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8805.196876 secs 2024-04-21T12:51:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:34 smithi191 ceph-mon[31636]: pgmap v4790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8805.196876 secs 2024-04-21T12:51:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:34 smithi170 ceph-mon[31212]: pgmap v4790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8805.196876 secs 2024-04-21T12:51:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:36 smithi077 ceph-mon[27902]: pgmap v4791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:36.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:36 smithi191 ceph-mon[31636]: pgmap v4791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:36 smithi170 ceph-mon[31212]: pgmap v4791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8808.436695 secs 2024-04-21T12:51:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8808.436695 secs 2024-04-21T12:51:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8808.436695 secs 2024-04-21T12:51:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:38 smithi077 ceph-mon[27902]: pgmap v4792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:38 smithi191 ceph-mon[31636]: pgmap v4792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:38 smithi170 ceph-mon[31212]: pgmap v4792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8810.196994 secs 2024-04-21T12:51:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8810.196994 secs 2024-04-21T12:51:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8810.196994 secs 2024-04-21T12:51:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 8995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:40 smithi077 ceph-mon[27902]: pgmap v4793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:40 smithi191 ceph-mon[31636]: pgmap v4793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:40 smithi170 ceph-mon[31212]: pgmap v4793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:51:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:51:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:51:42.447 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:42 smithi170 ceph-mon[31212]: pgmap v4794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:42.447 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8813.436853 secs 2024-04-21T12:51:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:42 smithi191 ceph-mon[31636]: pgmap v4794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8813.436853 secs 2024-04-21T12:51:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:42 smithi077 ceph-mon[27902]: pgmap v4794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8813.436853 secs 2024-04-21T12:51:44.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:44 smithi191 ceph-mon[31636]: pgmap v4795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:44.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8815.197069 secs 2024-04-21T12:51:44.515 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:44 smithi170 ceph-mon[31212]: pgmap v4795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:44.516 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8815.197069 secs 2024-04-21T12:51:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:44 smithi077 ceph-mon[27902]: pgmap v4795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8815.197069 secs 2024-04-21T12:51:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: pgmap v4796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:51:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: pgmap v4796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:51:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: pgmap v4796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:51:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:51:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8818.436933 secs 2024-04-21T12:51:47.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8818.436933 secs 2024-04-21T12:51:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8818.436933 secs 2024-04-21T12:51:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:48 smithi170 ceph-mon[31212]: pgmap v4797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:48 smithi077 ceph-mon[27902]: pgmap v4797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:48 smithi191 ceph-mon[31636]: pgmap v4797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8820.197193 secs 2024-04-21T12:51:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8820.197193 secs 2024-04-21T12:51:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8820.197193 secs 2024-04-21T12:51:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:50 smithi170 ceph-mon[31212]: pgmap v4798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:50 smithi077 ceph-mon[27902]: pgmap v4798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:50 smithi191 ceph-mon[31636]: pgmap v4798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:52.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:52 smithi170 ceph-mon[31212]: pgmap v4799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:52.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8823.437051 secs 2024-04-21T12:51:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:52 smithi077 ceph-mon[27902]: pgmap v4799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8823.437051 secs 2024-04-21T12:51:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:52 smithi191 ceph-mon[31636]: pgmap v4799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8823.437051 secs 2024-04-21T12:51:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:54 smithi170 ceph-mon[31212]: pgmap v4800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8825.197293 secs 2024-04-21T12:51:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:54 smithi077 ceph-mon[27902]: pgmap v4800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8825.197293 secs 2024-04-21T12:51:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:54 smithi191 ceph-mon[31636]: pgmap v4800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8825.197293 secs 2024-04-21T12:51:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:51:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:56 smithi170 ceph-mon[31212]: pgmap v4801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:56 smithi077 ceph-mon[27902]: pgmap v4801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:56 smithi191 ceph-mon[31636]: pgmap v4801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:51:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8828.437117 secs 2024-04-21T12:51:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8828.437117 secs 2024-04-21T12:51:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8828.437117 secs 2024-04-21T12:51:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:58 smithi170 ceph-mon[31212]: pgmap v4802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:58 smithi077 ceph-mon[27902]: pgmap v4802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:58 smithi191 ceph-mon[31636]: pgmap v4802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:51:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:51:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8830.197435 secs 2024-04-21T12:51:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:51:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8830.197435 secs 2024-04-21T12:51:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:51:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8830.197435 secs 2024-04-21T12:52:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:00 smithi170 ceph-mon[31212]: pgmap v4803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:00 smithi077 ceph-mon[27902]: pgmap v4803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:00 smithi191 ceph-mon[31636]: pgmap v4803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:02 smithi170 ceph-mon[31212]: pgmap v4804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:52:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8833.437202 secs 2024-04-21T12:52:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:02 smithi077 ceph-mon[27902]: pgmap v4804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:52:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8833.437202 secs 2024-04-21T12:52:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:02 smithi191 ceph-mon[31636]: pgmap v4804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T12:52:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8833.437202 secs 2024-04-21T12:52:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:04 smithi170 ceph-mon[31212]: pgmap v4805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:52:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8835.197570 secs 2024-04-21T12:52:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:04 smithi077 ceph-mon[27902]: pgmap v4805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:52:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8835.197570 secs 2024-04-21T12:52:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:04 smithi191 ceph-mon[31636]: pgmap v4805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T12:52:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8835.197570 secs 2024-04-21T12:52:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:05 smithi170 ceph-mon[31212]: osdmap e373: 12 total, 12 up, 12 in 2024-04-21T12:52:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:05 smithi077 ceph-mon[27902]: osdmap e373: 12 total, 12 up, 12 in 2024-04-21T12:52:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:05 smithi191 ceph-mon[31636]: osdmap e373: 12 total, 12 up, 12 in 2024-04-21T12:52:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:06 smithi170 ceph-mon[31212]: pgmap v4807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T12:52:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:06 smithi077 ceph-mon[27902]: pgmap v4807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T12:52:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:06 smithi191 ceph-mon[31636]: pgmap v4807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T12:52:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8838.437280 secs 2024-04-21T12:52:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8838.437280 secs 2024-04-21T12:52:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8838.437280 secs 2024-04-21T12:52:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:08 smithi170 ceph-mon[31212]: pgmap v4808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:52:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:08 smithi170 ceph-mon[31212]: osdmap e374: 12 total, 12 up, 12 in 2024-04-21T12:52:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:08 smithi077 ceph-mon[27902]: pgmap v4808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:52:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:08 smithi077 ceph-mon[27902]: osdmap e374: 12 total, 12 up, 12 in 2024-04-21T12:52:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:08 smithi191 ceph-mon[31636]: pgmap v4808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:52:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:08 smithi191 ceph-mon[31636]: osdmap e374: 12 total, 12 up, 12 in 2024-04-21T12:52:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8840.197731 secs 2024-04-21T12:52:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8840.197731 secs 2024-04-21T12:52:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8840.197731 secs 2024-04-21T12:52:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:10 smithi170 ceph-mon[31212]: pgmap v4810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:52:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:10 smithi077 ceph-mon[27902]: pgmap v4810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:52:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:10 smithi191 ceph-mon[31636]: pgmap v4810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:52:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:12 smithi170 ceph-mon[31212]: pgmap v4811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:52:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8843.437400 secs 2024-04-21T12:52:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:12 smithi077 ceph-mon[27902]: pgmap v4811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:52:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8843.437400 secs 2024-04-21T12:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:12 smithi191 ceph-mon[31636]: pgmap v4811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8843.437400 secs 2024-04-21T12:52:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:14 smithi170 ceph-mon[31212]: pgmap v4812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:52:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8845.197883 secs 2024-04-21T12:52:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:14 smithi077 ceph-mon[27902]: pgmap v4812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:52:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8845.197883 secs 2024-04-21T12:52:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:14 smithi191 ceph-mon[31636]: pgmap v4812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T12:52:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8845.197883 secs 2024-04-21T12:52:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:16 smithi170 ceph-mon[31212]: pgmap v4813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:52:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:16 smithi077 ceph-mon[27902]: pgmap v4813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:52:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:16 smithi191 ceph-mon[31636]: pgmap v4813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:52:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8848.437544 secs 2024-04-21T12:52:17.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8848.437544 secs 2024-04-21T12:52:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8848.437544 secs 2024-04-21T12:52:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:18 smithi077 ceph-mon[27902]: pgmap v4814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:52:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:18 smithi191 ceph-mon[31636]: pgmap v4814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:52:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:18 smithi170 ceph-mon[31212]: pgmap v4814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:52:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8850.197953 secs 2024-04-21T12:52:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8850.197953 secs 2024-04-21T12:52:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8850.197953 secs 2024-04-21T12:52:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:20 smithi077 ceph-mon[27902]: pgmap v4815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:52:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:20 smithi191 ceph-mon[31636]: pgmap v4815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:52:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:20 smithi170 ceph-mon[31212]: pgmap v4815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:52:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:22 smithi077 ceph-mon[27902]: pgmap v4816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:52:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8853.437661 secs 2024-04-21T12:52:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:22 smithi191 ceph-mon[31636]: pgmap v4816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:52:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8853.437661 secs 2024-04-21T12:52:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:22 smithi170 ceph-mon[31212]: pgmap v4816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:52:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8853.437661 secs 2024-04-21T12:52:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:24 smithi077 ceph-mon[27902]: pgmap v4817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8855.198072 secs 2024-04-21T12:52:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:24 smithi191 ceph-mon[31636]: pgmap v4817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8855.198072 secs 2024-04-21T12:52:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:24 smithi170 ceph-mon[31212]: pgmap v4817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8855.198072 secs 2024-04-21T12:52:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:26 smithi077 ceph-mon[27902]: pgmap v4818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:26 smithi191 ceph-mon[31636]: pgmap v4818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:26 smithi170 ceph-mon[31212]: pgmap v4818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8858.437791 secs 2024-04-21T12:52:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8858.437791 secs 2024-04-21T12:52:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8858.437791 secs 2024-04-21T12:52:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:28 smithi077 ceph-mon[27902]: pgmap v4819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:28 smithi191 ceph-mon[31636]: pgmap v4819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:28 smithi170 ceph-mon[31212]: pgmap v4819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8860.198161 secs 2024-04-21T12:52:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8860.198161 secs 2024-04-21T12:52:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8860.198161 secs 2024-04-21T12:52:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:30 smithi077 ceph-mon[27902]: pgmap v4820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:30 smithi191 ceph-mon[31636]: pgmap v4820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:30 smithi170 ceph-mon[31212]: pgmap v4820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:32 smithi077 ceph-mon[27902]: pgmap v4821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8863.437859 secs 2024-04-21T12:52:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:32 smithi191 ceph-mon[31636]: pgmap v4821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:32.731 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8863.437859 secs 2024-04-21T12:52:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:32 smithi170 ceph-mon[31212]: pgmap v4821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8863.437859 secs 2024-04-21T12:52:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:34 smithi077 ceph-mon[27902]: pgmap v4822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8865.198276 secs 2024-04-21T12:52:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:34 smithi191 ceph-mon[31636]: pgmap v4822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8865.198276 secs 2024-04-21T12:52:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:34 smithi170 ceph-mon[31212]: pgmap v4822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8865.198276 secs 2024-04-21T12:52:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:36 smithi077 ceph-mon[27902]: pgmap v4823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:36 smithi191 ceph-mon[31636]: pgmap v4823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:36 smithi170 ceph-mon[31212]: pgmap v4823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8868.437977 secs 2024-04-21T12:52:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8868.437977 secs 2024-04-21T12:52:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8868.437977 secs 2024-04-21T12:52:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:38 smithi077 ceph-mon[27902]: pgmap v4824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:38 smithi191 ceph-mon[31636]: pgmap v4824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:38 smithi170 ceph-mon[31212]: pgmap v4824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8870.198376 secs 2024-04-21T12:52:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8870.198376 secs 2024-04-21T12:52:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8870.198376 secs 2024-04-21T12:52:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:40 smithi077 ceph-mon[27902]: pgmap v4825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:40 smithi191 ceph-mon[31636]: pgmap v4825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:40 smithi170 ceph-mon[31212]: pgmap v4825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:42 smithi077 ceph-mon[27902]: pgmap v4826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8873.438088 secs 2024-04-21T12:52:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:42 smithi191 ceph-mon[31636]: pgmap v4826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8873.438088 secs 2024-04-21T12:52:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:42 smithi170 ceph-mon[31212]: pgmap v4826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8873.438088 secs 2024-04-21T12:52:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:44 smithi077 ceph-mon[27902]: pgmap v4827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8875.198488 secs 2024-04-21T12:52:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:44 smithi191 ceph-mon[31636]: pgmap v4827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8875.198488 secs 2024-04-21T12:52:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:44 smithi170 ceph-mon[31212]: pgmap v4827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8875.198488 secs 2024-04-21T12:52:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:46 smithi077 ceph-mon[27902]: pgmap v4828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:52:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:52:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:52:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:52:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:46 smithi191 ceph-mon[31636]: pgmap v4828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:52:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:52:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:52:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:52:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:46 smithi170 ceph-mon[31212]: pgmap v4828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T12:52:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:52:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:52:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:52:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:52:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8878.438193 secs 2024-04-21T12:52:47.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8878.438193 secs 2024-04-21T12:52:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8878.438193 secs 2024-04-21T12:52:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:48 smithi077 ceph-mon[27902]: pgmap v4829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:48 smithi191 ceph-mon[31636]: pgmap v4829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:48 smithi170 ceph-mon[31212]: pgmap v4829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8880.198625 secs 2024-04-21T12:52:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8880.198625 secs 2024-04-21T12:52:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8880.198625 secs 2024-04-21T12:52:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:50 smithi191 ceph-mon[31636]: pgmap v4830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:50 smithi170 ceph-mon[31212]: pgmap v4830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:50 smithi077 ceph-mon[27902]: pgmap v4830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:52 smithi191 ceph-mon[31636]: pgmap v4831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8883.438307 secs 2024-04-21T12:52:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:52 smithi170 ceph-mon[31212]: pgmap v4831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8883.438307 secs 2024-04-21T12:52:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:52 smithi077 ceph-mon[27902]: pgmap v4831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8883.438307 secs 2024-04-21T12:52:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:54 smithi191 ceph-mon[31636]: pgmap v4832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8885.198747 secs 2024-04-21T12:52:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:54 smithi170 ceph-mon[31212]: pgmap v4832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8885.198747 secs 2024-04-21T12:52:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:54 smithi077 ceph-mon[27902]: pgmap v4832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8885.198747 secs 2024-04-21T12:52:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:52:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:52:55.574+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:52:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:52:55.574+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:52:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:52:55.575+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:52:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:52:55.575+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:52:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:56 smithi191 ceph-mon[31636]: pgmap v4833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:56 smithi170 ceph-mon[31212]: pgmap v4833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:56 smithi077 ceph-mon[27902]: pgmap v4833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:52:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8888.438421 secs 2024-04-21T12:52:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8888.438421 secs 2024-04-21T12:52:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8888.438421 secs 2024-04-21T12:52:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:58 smithi191 ceph-mon[31636]: pgmap v4834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:58 smithi170 ceph-mon[31212]: pgmap v4834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:58 smithi077 ceph-mon[27902]: pgmap v4834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:52:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8890.198883 secs 2024-04-21T12:52:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8890.198883 secs 2024-04-21T12:52:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8890.198883 secs 2024-04-21T12:53:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:00 smithi191 ceph-mon[31636]: pgmap v4835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:00 smithi170 ceph-mon[31212]: pgmap v4835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:00 smithi077 ceph-mon[27902]: pgmap v4835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:01 smithi191 ceph-mon[31636]: pgmap v4836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:01 smithi170 ceph-mon[31212]: pgmap v4836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:01 smithi077 ceph-mon[27902]: pgmap v4836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8893.438547 secs 2024-04-21T12:53:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8893.438547 secs 2024-04-21T12:53:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8893.438547 secs 2024-04-21T12:53:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:03 smithi191 ceph-mon[31636]: pgmap v4837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:03 smithi170 ceph-mon[31212]: pgmap v4837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:03 smithi077 ceph-mon[27902]: pgmap v4837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8895.198989 secs 2024-04-21T12:53:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:04 smithi191 ceph-mon[31636]: osdmap e375: 12 total, 12 up, 12 in 2024-04-21T12:53:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8895.198989 secs 2024-04-21T12:53:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:04 smithi170 ceph-mon[31212]: osdmap e375: 12 total, 12 up, 12 in 2024-04-21T12:53:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8895.198989 secs 2024-04-21T12:53:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:04 smithi077 ceph-mon[27902]: osdmap e375: 12 total, 12 up, 12 in 2024-04-21T12:53:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:05 smithi191 ceph-mon[31636]: pgmap v4839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:53:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:05 smithi170 ceph-mon[31212]: pgmap v4839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:53:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:05 smithi077 ceph-mon[27902]: pgmap v4839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:53:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8898.438607 secs 2024-04-21T12:53:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8898.438607 secs 2024-04-21T12:53:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8898.438607 secs 2024-04-21T12:53:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:07 smithi170 ceph-mon[31212]: pgmap v4840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:53:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:07 smithi077 ceph-mon[27902]: pgmap v4840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:53:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:07 smithi191 ceph-mon[31636]: pgmap v4840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:53:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:09 smithi077 ceph-mon[27902]: osdmap e376: 12 total, 12 up, 12 in 2024-04-21T12:53:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8900.199091 secs 2024-04-21T12:53:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:09 smithi191 ceph-mon[31636]: osdmap e376: 12 total, 12 up, 12 in 2024-04-21T12:53:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8900.199091 secs 2024-04-21T12:53:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:09 smithi170 ceph-mon[31212]: osdmap e376: 12 total, 12 up, 12 in 2024-04-21T12:53:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8900.199091 secs 2024-04-21T12:53:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:10 smithi077 ceph-mon[27902]: pgmap v4842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:53:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:10 smithi191 ceph-mon[31636]: pgmap v4842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:53:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:10 smithi170 ceph-mon[31212]: pgmap v4842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:53:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:12 smithi077 ceph-mon[27902]: pgmap v4843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:53:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8903.438739 secs 2024-04-21T12:53:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:12 smithi191 ceph-mon[31636]: pgmap v4843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:53:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8903.438739 secs 2024-04-21T12:53:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:12 smithi170 ceph-mon[31212]: pgmap v4843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:53:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8903.438739 secs 2024-04-21T12:53:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:14 smithi077 ceph-mon[27902]: pgmap v4844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T12:53:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8905.199211 secs 2024-04-21T12:53:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:14 smithi191 ceph-mon[31636]: pgmap v4844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T12:53:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8905.199211 secs 2024-04-21T12:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:14 smithi170 ceph-mon[31212]: pgmap v4844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T12:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8905.199211 secs 2024-04-21T12:53:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:16 smithi077 ceph-mon[27902]: pgmap v4845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:53:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:16 smithi191 ceph-mon[31636]: pgmap v4845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:53:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:16 smithi170 ceph-mon[31212]: pgmap v4845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:53:17.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8908.438862 secs 2024-04-21T12:53:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8908.438862 secs 2024-04-21T12:53:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8908.438862 secs 2024-04-21T12:53:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:18 smithi077 ceph-mon[27902]: pgmap v4846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:53:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:18 smithi191 ceph-mon[31636]: pgmap v4846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:53:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:18 smithi170 ceph-mon[31212]: pgmap v4846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:53:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8910.199351 secs 2024-04-21T12:53:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8910.199351 secs 2024-04-21T12:53:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8910.199351 secs 2024-04-21T12:53:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:20 smithi077 ceph-mon[27902]: pgmap v4847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:53:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:20 smithi191 ceph-mon[31636]: pgmap v4847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:53:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:20 smithi170 ceph-mon[31212]: pgmap v4847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:53:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:22 smithi077 ceph-mon[27902]: pgmap v4848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:53:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8913.438984 secs 2024-04-21T12:53:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:22 smithi191 ceph-mon[31636]: pgmap v4848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:53:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8913.438984 secs 2024-04-21T12:53:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:22 smithi170 ceph-mon[31212]: pgmap v4848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:53:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8913.438984 secs 2024-04-21T12:53:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:24 smithi077 ceph-mon[27902]: pgmap v4849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8915.199481 secs 2024-04-21T12:53:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:24 smithi191 ceph-mon[31636]: pgmap v4849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8915.199481 secs 2024-04-21T12:53:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:24 smithi170 ceph-mon[31212]: pgmap v4849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:24.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8915.199481 secs 2024-04-21T12:53:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:26 smithi077 ceph-mon[27902]: pgmap v4850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:26 smithi191 ceph-mon[31636]: pgmap v4850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:26 smithi170 ceph-mon[31212]: pgmap v4850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8918.439067 secs 2024-04-21T12:53:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8918.439067 secs 2024-04-21T12:53:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8918.439067 secs 2024-04-21T12:53:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:28 smithi077 ceph-mon[27902]: pgmap v4851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:28 smithi191 ceph-mon[31636]: pgmap v4851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:28 smithi170 ceph-mon[31212]: pgmap v4851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8920.199603 secs 2024-04-21T12:53:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8920.199603 secs 2024-04-21T12:53:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8920.199603 secs 2024-04-21T12:53:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:30 smithi191 ceph-mon[31636]: pgmap v4852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:30 smithi170 ceph-mon[31212]: pgmap v4852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:30 smithi077 ceph-mon[27902]: pgmap v4852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:32 smithi191 ceph-mon[31636]: pgmap v4853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8923.439186 secs 2024-04-21T12:53:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:32 smithi170 ceph-mon[31212]: pgmap v4853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8923.439186 secs 2024-04-21T12:53:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:32 smithi077 ceph-mon[27902]: pgmap v4853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8923.439186 secs 2024-04-21T12:53:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:34 smithi191 ceph-mon[31636]: pgmap v4854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8925.199720 secs 2024-04-21T12:53:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:34 smithi170 ceph-mon[31212]: pgmap v4854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8925.199720 secs 2024-04-21T12:53:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:34 smithi077 ceph-mon[27902]: pgmap v4854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8925.199720 secs 2024-04-21T12:53:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:36 smithi191 ceph-mon[31636]: pgmap v4855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:36 smithi170 ceph-mon[31212]: pgmap v4855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:36 smithi077 ceph-mon[27902]: pgmap v4855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8928.439324 secs 2024-04-21T12:53:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8928.439324 secs 2024-04-21T12:53:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8928.439324 secs 2024-04-21T12:53:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:38 smithi191 ceph-mon[31636]: pgmap v4856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:38 smithi170 ceph-mon[31212]: pgmap v4856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:38 smithi077 ceph-mon[27902]: pgmap v4856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8930.199837 secs 2024-04-21T12:53:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8930.199837 secs 2024-04-21T12:53:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8930.199837 secs 2024-04-21T12:53:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:40 smithi191 ceph-mon[31636]: pgmap v4857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:40 smithi170 ceph-mon[31212]: pgmap v4857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:40 smithi077 ceph-mon[27902]: pgmap v4857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:42 smithi191 ceph-mon[31636]: pgmap v4858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8933.439436 secs 2024-04-21T12:53:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:42 smithi170 ceph-mon[31212]: pgmap v4858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8933.439436 secs 2024-04-21T12:53:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:42 smithi077 ceph-mon[27902]: pgmap v4858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8933.439436 secs 2024-04-21T12:53:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:44 smithi191 ceph-mon[31636]: pgmap v4859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8935.199959 secs 2024-04-21T12:53:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:44 smithi170 ceph-mon[31212]: pgmap v4859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8935.199959 secs 2024-04-21T12:53:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:44 smithi077 ceph-mon[27902]: pgmap v4859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8935.199959 secs 2024-04-21T12:53:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:46.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:46 smithi191 ceph-mon[31636]: pgmap v4860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:46 smithi170 ceph-mon[31212]: pgmap v4860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:46 smithi077 ceph-mon[27902]: pgmap v4860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:47.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:53:47.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8938.439524 secs 2024-04-21T12:53:47.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:53:47.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:53:47.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:53:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:53:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8938.439524 secs 2024-04-21T12:53:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:53:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:53:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:53:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:53:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8938.439524 secs 2024-04-21T12:53:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:53:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:53:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:53:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:48 smithi191 ceph-mon[31636]: pgmap v4861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:48 smithi170 ceph-mon[31212]: pgmap v4861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:48 smithi077 ceph-mon[27902]: pgmap v4861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8940.200047 secs 2024-04-21T12:53:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8940.200047 secs 2024-04-21T12:53:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8940.200047 secs 2024-04-21T12:53:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:50 smithi191 ceph-mon[31636]: pgmap v4862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:50 smithi170 ceph-mon[31212]: pgmap v4862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:50 smithi077 ceph-mon[27902]: pgmap v4862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:52 smithi191 ceph-mon[31636]: pgmap v4863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8943.439638 secs 2024-04-21T12:53:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:52 smithi170 ceph-mon[31212]: pgmap v4863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8943.439638 secs 2024-04-21T12:53:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:52 smithi077 ceph-mon[27902]: pgmap v4863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8943.439638 secs 2024-04-21T12:53:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:54 smithi191 ceph-mon[31636]: pgmap v4864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8945.200162 secs 2024-04-21T12:53:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:54 smithi170 ceph-mon[31212]: pgmap v4864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8945.200162 secs 2024-04-21T12:53:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:54 smithi077 ceph-mon[27902]: pgmap v4864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8945.200162 secs 2024-04-21T12:53:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:53:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:56 smithi191 ceph-mon[31636]: pgmap v4865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:56 smithi170 ceph-mon[31212]: pgmap v4865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:56 smithi077 ceph-mon[27902]: pgmap v4865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:53:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8948.439751 secs 2024-04-21T12:53:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8948.439751 secs 2024-04-21T12:53:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8948.439751 secs 2024-04-21T12:53:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:58 smithi191 ceph-mon[31636]: pgmap v4866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:58 smithi170 ceph-mon[31212]: pgmap v4866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:58 smithi077 ceph-mon[27902]: pgmap v4866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:53:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:53:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8950.200245 secs 2024-04-21T12:53:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:53:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8950.200245 secs 2024-04-21T12:53:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:53:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8950.200245 secs 2024-04-21T12:54:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:00 smithi191 ceph-mon[31636]: pgmap v4867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:00 smithi170 ceph-mon[31212]: pgmap v4867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:00 smithi077 ceph-mon[27902]: pgmap v4867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:02 smithi170 ceph-mon[31212]: pgmap v4868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8953.439865 secs 2024-04-21T12:54:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:02 smithi077 ceph-mon[27902]: pgmap v4868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8953.439865 secs 2024-04-21T12:54:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:02 smithi191 ceph-mon[31636]: pgmap v4868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8953.439865 secs 2024-04-21T12:54:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:04 smithi170 ceph-mon[31212]: pgmap v4869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8955.200362 secs 2024-04-21T12:54:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:04 smithi077 ceph-mon[27902]: pgmap v4869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8955.200362 secs 2024-04-21T12:54:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:04 smithi191 ceph-mon[31636]: pgmap v4869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8955.200362 secs 2024-04-21T12:54:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:05 smithi170 ceph-mon[31212]: osdmap e377: 12 total, 12 up, 12 in 2024-04-21T12:54:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:05 smithi077 ceph-mon[27902]: osdmap e377: 12 total, 12 up, 12 in 2024-04-21T12:54:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:05 smithi191 ceph-mon[31636]: osdmap e377: 12 total, 12 up, 12 in 2024-04-21T12:54:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:06 smithi170 ceph-mon[31212]: pgmap v4871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:54:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:06 smithi077 ceph-mon[27902]: pgmap v4871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:54:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:06 smithi191 ceph-mon[31636]: pgmap v4871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:54:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8958.439949 secs 2024-04-21T12:54:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8958.439949 secs 2024-04-21T12:54:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8958.439949 secs 2024-04-21T12:54:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:08 smithi170 ceph-mon[31212]: pgmap v4872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:54:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:08 smithi170 ceph-mon[31212]: osdmap e378: 12 total, 12 up, 12 in 2024-04-21T12:54:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:08 smithi077 ceph-mon[27902]: pgmap v4872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:54:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:08 smithi077 ceph-mon[27902]: osdmap e378: 12 total, 12 up, 12 in 2024-04-21T12:54:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:08 smithi191 ceph-mon[31636]: pgmap v4872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:54:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:08 smithi191 ceph-mon[31636]: osdmap e378: 12 total, 12 up, 12 in 2024-04-21T12:54:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8960.200476 secs 2024-04-21T12:54:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8960.200476 secs 2024-04-21T12:54:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8960.200476 secs 2024-04-21T12:54:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:10 smithi170 ceph-mon[31212]: pgmap v4874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:54:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:10 smithi077 ceph-mon[27902]: pgmap v4874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:54:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:10 smithi191 ceph-mon[31636]: pgmap v4874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:54:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:12 smithi170 ceph-mon[31212]: pgmap v4875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:54:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8963.440062 secs 2024-04-21T12:54:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:12 smithi077 ceph-mon[27902]: pgmap v4875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:54:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8963.440062 secs 2024-04-21T12:54:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:12 smithi191 ceph-mon[31636]: pgmap v4875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:54:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8963.440062 secs 2024-04-21T12:54:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:14 smithi170 ceph-mon[31212]: pgmap v4876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:54:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8965.200589 secs 2024-04-21T12:54:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:14 smithi077 ceph-mon[27902]: pgmap v4876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:54:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8965.200589 secs 2024-04-21T12:54:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:14 smithi191 ceph-mon[31636]: pgmap v4876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T12:54:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8965.200589 secs 2024-04-21T12:54:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:16 smithi170 ceph-mon[31212]: pgmap v4877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:54:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:16 smithi077 ceph-mon[27902]: pgmap v4877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:54:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:16 smithi191 ceph-mon[31636]: pgmap v4877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:54:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8968.440147 secs 2024-04-21T12:54:17.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8968.440147 secs 2024-04-21T12:54:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8968.440147 secs 2024-04-21T12:54:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:18 smithi170 ceph-mon[31212]: pgmap v4878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:54:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:18 smithi077 ceph-mon[27902]: pgmap v4878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:54:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:18 smithi191 ceph-mon[31636]: pgmap v4878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:54:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8970.200741 secs 2024-04-21T12:54:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8970.200741 secs 2024-04-21T12:54:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8970.200741 secs 2024-04-21T12:54:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:20 smithi170 ceph-mon[31212]: pgmap v4879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:54:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:20 smithi077 ceph-mon[27902]: pgmap v4879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:54:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:20 smithi191 ceph-mon[31636]: pgmap v4879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T12:54:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:22 smithi170 ceph-mon[31212]: pgmap v4880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:54:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8973.440236 secs 2024-04-21T12:54:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:22 smithi077 ceph-mon[27902]: pgmap v4880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:54:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8973.440236 secs 2024-04-21T12:54:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:22 smithi191 ceph-mon[31636]: pgmap v4880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:54:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8973.440236 secs 2024-04-21T12:54:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:24 smithi170 ceph-mon[31212]: pgmap v4881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8975.200883 secs 2024-04-21T12:54:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:24 smithi077 ceph-mon[27902]: pgmap v4881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8975.200883 secs 2024-04-21T12:54:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:24 smithi191 ceph-mon[31636]: pgmap v4881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8975.200883 secs 2024-04-21T12:54:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:26 smithi170 ceph-mon[31212]: pgmap v4882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:26 smithi077 ceph-mon[27902]: pgmap v4882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:26 smithi191 ceph-mon[31636]: pgmap v4882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8978.440355 secs 2024-04-21T12:54:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8978.440355 secs 2024-04-21T12:54:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8978.440355 secs 2024-04-21T12:54:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:28 smithi170 ceph-mon[31212]: pgmap v4883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:28 smithi077 ceph-mon[27902]: pgmap v4883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:28 smithi191 ceph-mon[31636]: pgmap v4883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8980.200949 secs 2024-04-21T12:54:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8980.200949 secs 2024-04-21T12:54:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8980.200949 secs 2024-04-21T12:54:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:30 smithi170 ceph-mon[31212]: pgmap v4884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:30 smithi077 ceph-mon[27902]: pgmap v4884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:30 smithi191 ceph-mon[31636]: pgmap v4884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:32 smithi077 ceph-mon[27902]: pgmap v4885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8983.440500 secs 2024-04-21T12:54:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:32 smithi191 ceph-mon[31636]: pgmap v4885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8983.440500 secs 2024-04-21T12:54:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:32 smithi170 ceph-mon[31212]: pgmap v4885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8983.440500 secs 2024-04-21T12:54:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:34 smithi077 ceph-mon[27902]: pgmap v4886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8985.201032 secs 2024-04-21T12:54:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:34 smithi191 ceph-mon[31636]: pgmap v4886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8985.201032 secs 2024-04-21T12:54:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:34 smithi170 ceph-mon[31212]: pgmap v4886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8985.201032 secs 2024-04-21T12:54:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:36 smithi077 ceph-mon[27902]: pgmap v4887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:36 smithi191 ceph-mon[31636]: pgmap v4887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:36 smithi170 ceph-mon[31212]: pgmap v4887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8988.440643 secs 2024-04-21T12:54:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8988.440643 secs 2024-04-21T12:54:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8988.440643 secs 2024-04-21T12:54:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:38 smithi077 ceph-mon[27902]: pgmap v4888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:38 smithi191 ceph-mon[31636]: pgmap v4888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:38 smithi170 ceph-mon[31212]: pgmap v4888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8990.201152 secs 2024-04-21T12:54:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8990.201152 secs 2024-04-21T12:54:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8990.201152 secs 2024-04-21T12:54:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:40 smithi077 ceph-mon[27902]: pgmap v4889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:40 smithi191 ceph-mon[31636]: pgmap v4889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:40 smithi170 ceph-mon[31212]: pgmap v4889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:42 smithi077 ceph-mon[27902]: pgmap v4890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8993.440782 secs 2024-04-21T12:54:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:42 smithi191 ceph-mon[31636]: pgmap v4890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8993.440782 secs 2024-04-21T12:54:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:42 smithi170 ceph-mon[31212]: pgmap v4890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8993.440782 secs 2024-04-21T12:54:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:44 smithi077 ceph-mon[27902]: pgmap v4891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 8995.201216 secs 2024-04-21T12:54:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:44 smithi191 ceph-mon[31636]: pgmap v4891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 8995.201216 secs 2024-04-21T12:54:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:44 smithi170 ceph-mon[31212]: pgmap v4891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 8995.201216 secs 2024-04-21T12:54:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:46 smithi077 ceph-mon[27902]: pgmap v4892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:46 smithi191 ceph-mon[31636]: pgmap v4892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:46 smithi170 ceph-mon[31212]: pgmap v4892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 8998.440922 secs 2024-04-21T12:54:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:54:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 8998.440922 secs 2024-04-21T12:54:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:54:47.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 8998.440922 secs 2024-04-21T12:54:47.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:54:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:48 smithi077 ceph-mon[27902]: pgmap v4893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:48 smithi191 ceph-mon[31636]: pgmap v4893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:48 smithi170 ceph-mon[31212]: pgmap v4893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9000.201281 secs 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9000.201281 secs 2024-04-21T12:54:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9000.201281 secs 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: pgmap v4894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:54:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:54:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: pgmap v4894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:54:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: pgmap v4894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:54:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:54:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:54:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:54:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:54:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:54:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:54:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:54:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T12:54:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T12:54:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T12:54:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T12:54:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T12:54:51.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T12:54:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:52 smithi077 ceph-mon[27902]: pgmap v4895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9003.440997 secs 2024-04-21T12:54:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:52 smithi191 ceph-mon[31636]: pgmap v4895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9003.440997 secs 2024-04-21T12:54:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:52 smithi170 ceph-mon[31212]: pgmap v4895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9003.440997 secs 2024-04-21T12:54:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:54 smithi077 ceph-mon[27902]: pgmap v4896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9005.201401 secs 2024-04-21T12:54:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:54 smithi191 ceph-mon[31636]: pgmap v4896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9005.201401 secs 2024-04-21T12:54:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:54 smithi170 ceph-mon[31212]: pgmap v4896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9005.201401 secs 2024-04-21T12:54:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:54:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:56 smithi077 ceph-mon[27902]: pgmap v4897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:56 smithi191 ceph-mon[31636]: pgmap v4897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:56 smithi170 ceph-mon[31212]: pgmap v4897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:54:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9008.441075 secs 2024-04-21T12:54:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9008.441075 secs 2024-04-21T12:54:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9008.441075 secs 2024-04-21T12:54:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:58 smithi077 ceph-mon[27902]: pgmap v4898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:58 smithi191 ceph-mon[31636]: pgmap v4898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:58 smithi170 ceph-mon[31212]: pgmap v4898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:54:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:54:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9010.201520 secs 2024-04-21T12:54:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:54:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9010.201520 secs 2024-04-21T12:54:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:54:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9010.201520 secs 2024-04-21T12:55:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:00 smithi077 ceph-mon[27902]: pgmap v4899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:00 smithi191 ceph-mon[31636]: pgmap v4899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:00 smithi170 ceph-mon[31212]: pgmap v4899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:02 smithi077 ceph-mon[27902]: pgmap v4900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T12:55:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9013.441205 secs 2024-04-21T12:55:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:02 smithi191 ceph-mon[31636]: pgmap v4900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T12:55:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9013.441205 secs 2024-04-21T12:55:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:02 smithi170 ceph-mon[31212]: pgmap v4900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T12:55:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9013.441205 secs 2024-04-21T12:55:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:04 smithi191 ceph-mon[31636]: pgmap v4901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T12:55:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9015.201634 secs 2024-04-21T12:55:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:04 smithi191 ceph-mon[31636]: osdmap e379: 12 total, 12 up, 12 in 2024-04-21T12:55:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:04 smithi170 ceph-mon[31212]: pgmap v4901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T12:55:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9015.201634 secs 2024-04-21T12:55:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:04 smithi170 ceph-mon[31212]: osdmap e379: 12 total, 12 up, 12 in 2024-04-21T12:55:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:04 smithi077 ceph-mon[27902]: pgmap v4901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T12:55:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9015.201634 secs 2024-04-21T12:55:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:04 smithi077 ceph-mon[27902]: osdmap e379: 12 total, 12 up, 12 in 2024-04-21T12:55:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:06 smithi191 ceph-mon[31636]: pgmap v4903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T12:55:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:06 smithi170 ceph-mon[31212]: pgmap v4903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T12:55:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:06 smithi077 ceph-mon[27902]: pgmap v4903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T12:55:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9018.441312 secs 2024-04-21T12:55:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9018.441312 secs 2024-04-21T12:55:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9018.441312 secs 2024-04-21T12:55:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:08 smithi191 ceph-mon[31636]: pgmap v4904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:55:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:08 smithi191 ceph-mon[31636]: osdmap e380: 12 total, 12 up, 12 in 2024-04-21T12:55:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:08 smithi170 ceph-mon[31212]: pgmap v4904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:55:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:08 smithi170 ceph-mon[31212]: osdmap e380: 12 total, 12 up, 12 in 2024-04-21T12:55:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:08 smithi077 ceph-mon[27902]: pgmap v4904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:55:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:08 smithi077 ceph-mon[27902]: osdmap e380: 12 total, 12 up, 12 in 2024-04-21T12:55:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9020.201755 secs 2024-04-21T12:55:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9020.201755 secs 2024-04-21T12:55:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9020.201755 secs 2024-04-21T12:55:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:10 smithi191 ceph-mon[31636]: pgmap v4906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T12:55:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:10 smithi170 ceph-mon[31212]: pgmap v4906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T12:55:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:10 smithi077 ceph-mon[27902]: pgmap v4906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T12:55:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:12 smithi191 ceph-mon[31636]: pgmap v4907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T12:55:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9023.441438 secs 2024-04-21T12:55:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:12 smithi170 ceph-mon[31212]: pgmap v4907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T12:55:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9023.441438 secs 2024-04-21T12:55:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:12 smithi077 ceph-mon[27902]: pgmap v4907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T12:55:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9023.441438 secs 2024-04-21T12:55:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:14 smithi191 ceph-mon[31636]: pgmap v4908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T12:55:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9025.201897 secs 2024-04-21T12:55:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:14 smithi170 ceph-mon[31212]: pgmap v4908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T12:55:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9025.201897 secs 2024-04-21T12:55:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:14 smithi077 ceph-mon[27902]: pgmap v4908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T12:55:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9025.201897 secs 2024-04-21T12:55:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:16 smithi191 ceph-mon[31636]: pgmap v4909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T12:55:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:16 smithi170 ceph-mon[31212]: pgmap v4909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T12:55:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:16 smithi077 ceph-mon[27902]: pgmap v4909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T12:55:17.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9028.441542 secs 2024-04-21T12:55:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9028.441542 secs 2024-04-21T12:55:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9028.441542 secs 2024-04-21T12:55:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:18 smithi191 ceph-mon[31636]: pgmap v4910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:55:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:18 smithi170 ceph-mon[31212]: pgmap v4910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:55:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:18 smithi077 ceph-mon[27902]: pgmap v4910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:55:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9030.201961 secs 2024-04-21T12:55:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9030.201961 secs 2024-04-21T12:55:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9030.201961 secs 2024-04-21T12:55:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:20 smithi191 ceph-mon[31636]: pgmap v4911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:55:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:20 smithi170 ceph-mon[31212]: pgmap v4911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:55:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:20 smithi077 ceph-mon[27902]: pgmap v4911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:55:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:21 smithi170 ceph-mon[31212]: pgmap v4912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:55:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:21 smithi077 ceph-mon[27902]: pgmap v4912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:55:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:21 smithi191 ceph-mon[31636]: pgmap v4912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:55:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9033.441673 secs 2024-04-21T12:55:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9033.441673 secs 2024-04-21T12:55:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9033.441673 secs 2024-04-21T12:55:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:23 smithi170 ceph-mon[31212]: pgmap v4913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:23 smithi077 ceph-mon[27902]: pgmap v4913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:23 smithi191 ceph-mon[31636]: pgmap v4913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9035.202112 secs 2024-04-21T12:55:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9035.202112 secs 2024-04-21T12:55:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9035.202112 secs 2024-04-21T12:55:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:25 smithi170 ceph-mon[31212]: pgmap v4914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:25 smithi077 ceph-mon[27902]: pgmap v4914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:25 smithi191 ceph-mon[31636]: pgmap v4914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9038.441784 secs 2024-04-21T12:55:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9038.441784 secs 2024-04-21T12:55:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9038.441784 secs 2024-04-21T12:55:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:27 smithi077 ceph-mon[27902]: pgmap v4915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:28.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:27 smithi191 ceph-mon[31636]: pgmap v4915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:27 smithi170 ceph-mon[31212]: pgmap v4915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9040.202207 secs 2024-04-21T12:55:29.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9040.202207 secs 2024-04-21T12:55:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9040.202207 secs 2024-04-21T12:55:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:29 smithi077 ceph-mon[27902]: pgmap v4916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:30.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:29 smithi191 ceph-mon[31636]: pgmap v4916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:29 smithi170 ceph-mon[31212]: pgmap v4916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:31 smithi077 ceph-mon[27902]: pgmap v4917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9043.441897 secs 2024-04-21T12:55:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:31 smithi191 ceph-mon[31636]: pgmap v4917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9043.441897 secs 2024-04-21T12:55:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:31 smithi170 ceph-mon[31212]: pgmap v4917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9043.441897 secs 2024-04-21T12:55:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:33 smithi077 ceph-mon[27902]: pgmap v4918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9045.202340 secs 2024-04-21T12:55:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:33 smithi191 ceph-mon[31636]: pgmap v4918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9045.202340 secs 2024-04-21T12:55:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:33 smithi170 ceph-mon[31212]: pgmap v4918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9045.202340 secs 2024-04-21T12:55:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:35 smithi077 ceph-mon[27902]: pgmap v4919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:36.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:35 smithi191 ceph-mon[31636]: pgmap v4919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:35 smithi170 ceph-mon[31212]: pgmap v4919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9048.442010 secs 2024-04-21T12:55:37.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9048.442010 secs 2024-04-21T12:55:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9048.442010 secs 2024-04-21T12:55:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:37 smithi077 ceph-mon[27902]: pgmap v4920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:37 smithi191 ceph-mon[31636]: pgmap v4920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:37 smithi170 ceph-mon[31212]: pgmap v4920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9050.202459 secs 2024-04-21T12:55:39.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9050.202459 secs 2024-04-21T12:55:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9050.202459 secs 2024-04-21T12:55:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:39 smithi077 ceph-mon[27902]: pgmap v4921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:39 smithi191 ceph-mon[31636]: pgmap v4921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:39 smithi170 ceph-mon[31212]: pgmap v4921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:41 smithi077 ceph-mon[27902]: pgmap v4922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9053.442093 secs 2024-04-21T12:55:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:41 smithi191 ceph-mon[31636]: pgmap v4922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9053.442093 secs 2024-04-21T12:55:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:41 smithi170 ceph-mon[31212]: pgmap v4922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9053.442093 secs 2024-04-21T12:55:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:43 smithi077 ceph-mon[27902]: pgmap v4923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9055.202594 secs 2024-04-21T12:55:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:43 smithi191 ceph-mon[31636]: pgmap v4923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9055.202594 secs 2024-04-21T12:55:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:43 smithi170 ceph-mon[31212]: pgmap v4923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9055.202594 secs 2024-04-21T12:55:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:45 smithi077 ceph-mon[27902]: pgmap v4924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:45 smithi191 ceph-mon[31636]: pgmap v4924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:45 smithi170 ceph-mon[31212]: pgmap v4924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9058.442175 secs 2024-04-21T12:55:47.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9058.442175 secs 2024-04-21T12:55:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9058.442175 secs 2024-04-21T12:55:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:47 smithi077 ceph-mon[27902]: pgmap v4925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:47 smithi191 ceph-mon[31636]: pgmap v4925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:47 smithi170 ceph-mon[31212]: pgmap v4925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9060.202733 secs 2024-04-21T12:55:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9060.202733 secs 2024-04-21T12:55:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9060.202733 secs 2024-04-21T12:55:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:49 smithi191 ceph-mon[31636]: pgmap v4926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:49 smithi170 ceph-mon[31212]: pgmap v4926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:49 smithi077 ceph-mon[27902]: pgmap v4926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:55:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:55:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:55:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:51 smithi191 ceph-mon[31636]: pgmap v4927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:55:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:55:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9063.442330 secs 2024-04-21T12:55:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:51 smithi170 ceph-mon[31212]: pgmap v4927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:55:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:55:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9063.442330 secs 2024-04-21T12:55:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:51 smithi077 ceph-mon[27902]: pgmap v4927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:55:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:55:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:55:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9063.442330 secs 2024-04-21T12:55:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:53 smithi191 ceph-mon[31636]: pgmap v4928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9065.202891 secs 2024-04-21T12:55:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:53 smithi170 ceph-mon[31212]: pgmap v4928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9065.202891 secs 2024-04-21T12:55:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:53 smithi077 ceph-mon[27902]: pgmap v4928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9065.202891 secs 2024-04-21T12:55:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:55:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:55:55.600+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:55:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:55:55.600+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:55:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:55:55.600+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:55:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:55:55.600+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:55:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:55 smithi191 ceph-mon[31636]: pgmap v4929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:55 smithi170 ceph-mon[31212]: pgmap v4929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:55 smithi077 ceph-mon[27902]: pgmap v4929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:55:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9068.442474 secs 2024-04-21T12:55:57.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9068.442474 secs 2024-04-21T12:55:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9068.442474 secs 2024-04-21T12:55:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:57 smithi191 ceph-mon[31636]: pgmap v4930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:57 smithi170 ceph-mon[31212]: pgmap v4930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:57 smithi077 ceph-mon[27902]: pgmap v4930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:55:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9070.203010 secs 2024-04-21T12:55:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9070.203010 secs 2024-04-21T12:55:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9070.203010 secs 2024-04-21T12:56:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:55:59 smithi191 ceph-mon[31636]: pgmap v4931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:55:59 smithi170 ceph-mon[31212]: pgmap v4931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:55:59 smithi077 ceph-mon[27902]: pgmap v4931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:01 smithi191 ceph-mon[31636]: pgmap v4932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T12:56:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9073.442588 secs 2024-04-21T12:56:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:01 smithi170 ceph-mon[31212]: pgmap v4932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T12:56:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9073.442588 secs 2024-04-21T12:56:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:01 smithi077 ceph-mon[27902]: pgmap v4932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T12:56:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9073.442588 secs 2024-04-21T12:56:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:04 smithi191 ceph-mon[31636]: pgmap v4933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T12:56:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9075.203128 secs 2024-04-21T12:56:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:04 smithi170 ceph-mon[31212]: pgmap v4933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T12:56:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9075.203128 secs 2024-04-21T12:56:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:04 smithi077 ceph-mon[27902]: pgmap v4933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T12:56:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9075.203128 secs 2024-04-21T12:56:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:05 smithi191 ceph-mon[31636]: osdmap e381: 12 total, 12 up, 12 in 2024-04-21T12:56:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:05 smithi170 ceph-mon[31212]: osdmap e381: 12 total, 12 up, 12 in 2024-04-21T12:56:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:05 smithi077 ceph-mon[27902]: osdmap e381: 12 total, 12 up, 12 in 2024-04-21T12:56:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:06 smithi191 ceph-mon[31636]: pgmap v4935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-21T12:56:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:06 smithi170 ceph-mon[31212]: pgmap v4935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-21T12:56:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:06 smithi077 ceph-mon[27902]: pgmap v4935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-21T12:56:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9078.442679 secs 2024-04-21T12:56:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9078.442679 secs 2024-04-21T12:56:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9078.442679 secs 2024-04-21T12:56:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:08 smithi191 ceph-mon[31636]: pgmap v4936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:56:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:08 smithi170 ceph-mon[31212]: pgmap v4936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:56:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:08 smithi077 ceph-mon[27902]: pgmap v4936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:56:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9080.203227 secs 2024-04-21T12:56:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9080.203227 secs 2024-04-21T12:56:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9080.203227 secs 2024-04-21T12:56:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:10 smithi191 ceph-mon[31636]: pgmap v4937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:56:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:10 smithi170 ceph-mon[31212]: pgmap v4937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:56:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:10 smithi077 ceph-mon[27902]: pgmap v4937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:56:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:12 smithi191 ceph-mon[31636]: pgmap v4938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9083.442801 secs 2024-04-21T12:56:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:12 smithi170 ceph-mon[31212]: pgmap v4938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9083.442801 secs 2024-04-21T12:56:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:12 smithi077 ceph-mon[27902]: pgmap v4938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9083.442801 secs 2024-04-21T12:56:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:14 smithi077 ceph-mon[27902]: pgmap v4939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:14 smithi077 ceph-mon[27902]: osdmap e382: 12 total, 12 up, 12 in 2024-04-21T12:56:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9085.203348 secs 2024-04-21T12:56:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:14 smithi191 ceph-mon[31636]: pgmap v4939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:14 smithi191 ceph-mon[31636]: osdmap e382: 12 total, 12 up, 12 in 2024-04-21T12:56:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9085.203348 secs 2024-04-21T12:56:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:14 smithi170 ceph-mon[31212]: pgmap v4939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:14 smithi170 ceph-mon[31212]: osdmap e382: 12 total, 12 up, 12 in 2024-04-21T12:56:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9085.203348 secs 2024-04-21T12:56:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:16 smithi077 ceph-mon[27902]: pgmap v4941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:16 smithi191 ceph-mon[31636]: pgmap v4941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:16 smithi170 ceph-mon[31212]: pgmap v4941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T12:56:17.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9088.442900 secs 2024-04-21T12:56:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9088.442900 secs 2024-04-21T12:56:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9088.442900 secs 2024-04-21T12:56:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:18 smithi191 ceph-mon[31636]: pgmap v4942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:56:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:18 smithi170 ceph-mon[31212]: pgmap v4942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:56:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:18 smithi077 ceph-mon[27902]: pgmap v4942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:56:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9090.203429 secs 2024-04-21T12:56:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9090.203429 secs 2024-04-21T12:56:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9090.203429 secs 2024-04-21T12:56:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:20 smithi191 ceph-mon[31636]: pgmap v4943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:56:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:20 smithi170 ceph-mon[31212]: pgmap v4943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:56:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:20 smithi077 ceph-mon[27902]: pgmap v4943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:56:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:22 smithi191 ceph-mon[31636]: pgmap v4944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:56:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9093.443008 secs 2024-04-21T12:56:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:22 smithi170 ceph-mon[31212]: pgmap v4944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:56:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9093.443008 secs 2024-04-21T12:56:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:22 smithi077 ceph-mon[27902]: pgmap v4944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:56:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9093.443008 secs 2024-04-21T12:56:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:24 smithi191 ceph-mon[31636]: pgmap v4945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:56:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9095.203550 secs 2024-04-21T12:56:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:24 smithi170 ceph-mon[31212]: pgmap v4945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:56:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9095.203550 secs 2024-04-21T12:56:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:24 smithi077 ceph-mon[27902]: pgmap v4945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:56:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9095.203550 secs 2024-04-21T12:56:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:26 smithi191 ceph-mon[31636]: pgmap v4946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T12:56:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:26 smithi170 ceph-mon[31212]: pgmap v4946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T12:56:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:26 smithi077 ceph-mon[27902]: pgmap v4946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T12:56:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9098.443116 secs 2024-04-21T12:56:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9098.443116 secs 2024-04-21T12:56:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9098.443116 secs 2024-04-21T12:56:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:28 smithi191 ceph-mon[31636]: pgmap v4947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:28 smithi170 ceph-mon[31212]: pgmap v4947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:28 smithi077 ceph-mon[27902]: pgmap v4947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9100.203673 secs 2024-04-21T12:56:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9100.203673 secs 2024-04-21T12:56:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9100.203673 secs 2024-04-21T12:56:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:30 smithi191 ceph-mon[31636]: pgmap v4948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:30 smithi170 ceph-mon[31212]: pgmap v4948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:30 smithi077 ceph-mon[27902]: pgmap v4948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:32 smithi191 ceph-mon[31636]: pgmap v4949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9103.443239 secs 2024-04-21T12:56:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:32 smithi170 ceph-mon[31212]: pgmap v4949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9103.443239 secs 2024-04-21T12:56:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:32 smithi077 ceph-mon[27902]: pgmap v4949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9103.443239 secs 2024-04-21T12:56:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:34 smithi191 ceph-mon[31636]: pgmap v4950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9105.203804 secs 2024-04-21T12:56:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:34 smithi170 ceph-mon[31212]: pgmap v4950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9105.203804 secs 2024-04-21T12:56:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:34 smithi077 ceph-mon[27902]: pgmap v4950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9105.203804 secs 2024-04-21T12:56:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:36 smithi191 ceph-mon[31636]: pgmap v4951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:36 smithi170 ceph-mon[31212]: pgmap v4951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:36 smithi077 ceph-mon[27902]: pgmap v4951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9108.443379 secs 2024-04-21T12:56:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9108.443379 secs 2024-04-21T12:56:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9108.443379 secs 2024-04-21T12:56:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:38 smithi191 ceph-mon[31636]: pgmap v4952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:38 smithi170 ceph-mon[31212]: pgmap v4952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:38 smithi077 ceph-mon[27902]: pgmap v4952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9110.203926 secs 2024-04-21T12:56:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9110.203926 secs 2024-04-21T12:56:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9110.203926 secs 2024-04-21T12:56:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:40 smithi191 ceph-mon[31636]: pgmap v4953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:40 smithi170 ceph-mon[31212]: pgmap v4953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:40 smithi077 ceph-mon[27902]: pgmap v4953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:42 smithi191 ceph-mon[31636]: pgmap v4954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9113.443496 secs 2024-04-21T12:56:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:42 smithi170 ceph-mon[31212]: pgmap v4954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9113.443496 secs 2024-04-21T12:56:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:42 smithi077 ceph-mon[27902]: pgmap v4954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9113.443496 secs 2024-04-21T12:56:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:44 smithi191 ceph-mon[31636]: pgmap v4955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9115.204002 secs 2024-04-21T12:56:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:44 smithi170 ceph-mon[31212]: pgmap v4955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9115.204002 secs 2024-04-21T12:56:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:44 smithi077 ceph-mon[27902]: pgmap v4955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9115.204002 secs 2024-04-21T12:56:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:46 smithi191 ceph-mon[31636]: pgmap v4956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:46 smithi170 ceph-mon[31212]: pgmap v4956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:46 smithi077 ceph-mon[27902]: pgmap v4956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9118.443631 secs 2024-04-21T12:56:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9118.443631 secs 2024-04-21T12:56:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9118.443631 secs 2024-04-21T12:56:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:48 smithi191 ceph-mon[31636]: pgmap v4957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:48 smithi170 ceph-mon[31212]: pgmap v4957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:48 smithi077 ceph-mon[27902]: pgmap v4957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9120.204112 secs 2024-04-21T12:56:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9120.204112 secs 2024-04-21T12:56:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9120.204112 secs 2024-04-21T12:56:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:50 smithi170 ceph-mon[31212]: pgmap v4958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:50 smithi077 ceph-mon[27902]: pgmap v4958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:50 smithi191 ceph-mon[31636]: pgmap v4958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: pgmap v4959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:56:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9123.443720 secs 2024-04-21T12:56:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: pgmap v4959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9123.443720 secs 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: pgmap v4959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9123.443720 secs 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:56:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:56:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:56:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:56:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:56:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:56:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:56:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:54 smithi170 ceph-mon[31212]: pgmap v4960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9125.204236 secs 2024-04-21T12:56:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:54 smithi077 ceph-mon[27902]: pgmap v4960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9125.204236 secs 2024-04-21T12:56:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:54 smithi191 ceph-mon[31636]: pgmap v4960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9125.204236 secs 2024-04-21T12:56:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:56:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:56 smithi170 ceph-mon[31212]: pgmap v4961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:56 smithi077 ceph-mon[27902]: pgmap v4961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:56 smithi191 ceph-mon[31636]: pgmap v4961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:56:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9128.443860 secs 2024-04-21T12:56:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9128.443860 secs 2024-04-21T12:56:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9128.443860 secs 2024-04-21T12:56:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:58 smithi170 ceph-mon[31212]: pgmap v4962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:58 smithi077 ceph-mon[27902]: pgmap v4962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:58 smithi191 ceph-mon[31636]: pgmap v4962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:56:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:56:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9130.204365 secs 2024-04-21T12:56:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:56:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9130.204365 secs 2024-04-21T12:56:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:56:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9130.204365 secs 2024-04-21T12:57:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:00 smithi170 ceph-mon[31212]: pgmap v4963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:00 smithi077 ceph-mon[27902]: pgmap v4963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:00 smithi191 ceph-mon[31636]: pgmap v4963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:02 smithi170 ceph-mon[31212]: pgmap v4964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9133.443983 secs 2024-04-21T12:57:02.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:02 smithi077 ceph-mon[27902]: pgmap v4964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9133.443983 secs 2024-04-21T12:57:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:02 smithi191 ceph-mon[31636]: pgmap v4964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9133.443983 secs 2024-04-21T12:57:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:04 smithi170 ceph-mon[31212]: pgmap v4965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9135.204420 secs 2024-04-21T12:57:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:04 smithi077 ceph-mon[27902]: pgmap v4965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9135.204420 secs 2024-04-21T12:57:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:04 smithi191 ceph-mon[31636]: pgmap v4965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9135.204420 secs 2024-04-21T12:57:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:05 smithi170 ceph-mon[31212]: osdmap e383: 12 total, 12 up, 12 in 2024-04-21T12:57:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:05 smithi077 ceph-mon[27902]: osdmap e383: 12 total, 12 up, 12 in 2024-04-21T12:57:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:05 smithi191 ceph-mon[31636]: osdmap e383: 12 total, 12 up, 12 in 2024-04-21T12:57:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:06 smithi170 ceph-mon[31212]: pgmap v4967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:57:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:06 smithi077 ceph-mon[27902]: pgmap v4967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:57:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:06 smithi191 ceph-mon[31636]: pgmap v4967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:57:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9138.444064 secs 2024-04-21T12:57:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9138.444064 secs 2024-04-21T12:57:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9138.444064 secs 2024-04-21T12:57:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:08 smithi170 ceph-mon[31212]: pgmap v4968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:57:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:08 smithi170 ceph-mon[31212]: osdmap e384: 12 total, 12 up, 12 in 2024-04-21T12:57:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:08 smithi077 ceph-mon[27902]: pgmap v4968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:57:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:08 smithi077 ceph-mon[27902]: osdmap e384: 12 total, 12 up, 12 in 2024-04-21T12:57:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:08 smithi191 ceph-mon[31636]: pgmap v4968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:57:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:08 smithi191 ceph-mon[31636]: osdmap e384: 12 total, 12 up, 12 in 2024-04-21T12:57:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9140.204556 secs 2024-04-21T12:57:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9140.204556 secs 2024-04-21T12:57:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9140.204556 secs 2024-04-21T12:57:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:10 smithi170 ceph-mon[31212]: pgmap v4970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:57:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:10 smithi077 ceph-mon[27902]: pgmap v4970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:57:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:10 smithi191 ceph-mon[31636]: pgmap v4970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:57:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:12 smithi170 ceph-mon[31212]: pgmap v4971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:57:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9143.444133 secs 2024-04-21T12:57:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:12 smithi077 ceph-mon[27902]: pgmap v4971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:57:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9143.444133 secs 2024-04-21T12:57:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:12 smithi191 ceph-mon[31636]: pgmap v4971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:57:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9143.444133 secs 2024-04-21T12:57:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:14 smithi170 ceph-mon[31212]: pgmap v4972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T12:57:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9145.204678 secs 2024-04-21T12:57:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:14 smithi077 ceph-mon[27902]: pgmap v4972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T12:57:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9145.204678 secs 2024-04-21T12:57:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:14 smithi191 ceph-mon[31636]: pgmap v4972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T12:57:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9145.204678 secs 2024-04-21T12:57:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:16 smithi170 ceph-mon[31212]: pgmap v4973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:57:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:16 smithi077 ceph-mon[27902]: pgmap v4973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:57:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:16 smithi191 ceph-mon[31636]: pgmap v4973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:57:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9148.444215 secs 2024-04-21T12:57:17.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9148.444215 secs 2024-04-21T12:57:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9148.444215 secs 2024-04-21T12:57:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:18 smithi077 ceph-mon[27902]: pgmap v4974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:57:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:18 smithi191 ceph-mon[31636]: pgmap v4974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:57:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:18 smithi170 ceph-mon[31212]: pgmap v4974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:57:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9150.204798 secs 2024-04-21T12:57:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9150.204798 secs 2024-04-21T12:57:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9150.204798 secs 2024-04-21T12:57:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:20 smithi077 ceph-mon[27902]: pgmap v4975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:57:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:20 smithi191 ceph-mon[31636]: pgmap v4975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:57:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:20 smithi170 ceph-mon[31212]: pgmap v4975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:57:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:22 smithi077 ceph-mon[27902]: pgmap v4976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:57:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9153.444341 secs 2024-04-21T12:57:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:22 smithi191 ceph-mon[31636]: pgmap v4976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:57:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9153.444341 secs 2024-04-21T12:57:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:22 smithi170 ceph-mon[31212]: pgmap v4976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:57:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9153.444341 secs 2024-04-21T12:57:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:24 smithi077 ceph-mon[27902]: pgmap v4977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9155.204900 secs 2024-04-21T12:57:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:24 smithi191 ceph-mon[31636]: pgmap v4977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9155.204900 secs 2024-04-21T12:57:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:24 smithi170 ceph-mon[31212]: pgmap v4977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9155.204900 secs 2024-04-21T12:57:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:57:25.613+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:57:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:57:25.613+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:57:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:57:25.613+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:57:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:57:25.613+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:57:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:26 smithi077 ceph-mon[27902]: pgmap v4978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:26 smithi191 ceph-mon[31636]: pgmap v4978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:26 smithi170 ceph-mon[31212]: pgmap v4978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9158.444483 secs 2024-04-21T12:57:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9158.444483 secs 2024-04-21T12:57:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9158.444483 secs 2024-04-21T12:57:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:28 smithi077 ceph-mon[27902]: pgmap v4979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:28 smithi191 ceph-mon[31636]: pgmap v4979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:28 smithi170 ceph-mon[31212]: pgmap v4979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9160.204964 secs 2024-04-21T12:57:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9160.204964 secs 2024-04-21T12:57:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9160.204964 secs 2024-04-21T12:57:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:30 smithi077 ceph-mon[27902]: pgmap v4980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:30 smithi191 ceph-mon[31636]: pgmap v4980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:30 smithi170 ceph-mon[31212]: pgmap v4980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:32 smithi077 ceph-mon[27902]: pgmap v4981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9163.444625 secs 2024-04-21T12:57:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:32 smithi191 ceph-mon[31636]: pgmap v4981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9163.444625 secs 2024-04-21T12:57:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:32 smithi170 ceph-mon[31212]: pgmap v4981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9163.444625 secs 2024-04-21T12:57:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:34 smithi077 ceph-mon[27902]: pgmap v4982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9165.205092 secs 2024-04-21T12:57:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:34 smithi191 ceph-mon[31636]: pgmap v4982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9165.205092 secs 2024-04-21T12:57:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:34 smithi170 ceph-mon[31212]: pgmap v4982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9165.205092 secs 2024-04-21T12:57:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:36 smithi077 ceph-mon[27902]: pgmap v4983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:36 smithi191 ceph-mon[31636]: pgmap v4983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:36 smithi170 ceph-mon[31212]: pgmap v4983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9168.444766 secs 2024-04-21T12:57:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9168.444766 secs 2024-04-21T12:57:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9168.444766 secs 2024-04-21T12:57:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:38 smithi077 ceph-mon[27902]: pgmap v4984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:38 smithi191 ceph-mon[31636]: pgmap v4984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:38 smithi170 ceph-mon[31212]: pgmap v4984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9170.205216 secs 2024-04-21T12:57:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9170.205216 secs 2024-04-21T12:57:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9170.205216 secs 2024-04-21T12:57:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:40 smithi077 ceph-mon[27902]: pgmap v4985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:40 smithi191 ceph-mon[31636]: pgmap v4985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:40 smithi170 ceph-mon[31212]: pgmap v4985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:42 smithi077 ceph-mon[27902]: pgmap v4986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9173.444886 secs 2024-04-21T12:57:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:42 smithi191 ceph-mon[31636]: pgmap v4986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9173.444886 secs 2024-04-21T12:57:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:42 smithi170 ceph-mon[31212]: pgmap v4986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9173.444886 secs 2024-04-21T12:57:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:44 smithi077 ceph-mon[27902]: pgmap v4987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9175.205370 secs 2024-04-21T12:57:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:44 smithi191 ceph-mon[31636]: pgmap v4987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9175.205370 secs 2024-04-21T12:57:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:44 smithi170 ceph-mon[31212]: pgmap v4987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9175.205370 secs 2024-04-21T12:57:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:46 smithi077 ceph-mon[27902]: pgmap v4988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:46 smithi191 ceph-mon[31636]: pgmap v4988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:46 smithi170 ceph-mon[31212]: pgmap v4988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9178.445003 secs 2024-04-21T12:57:47.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9178.445003 secs 2024-04-21T12:57:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9178.445003 secs 2024-04-21T12:57:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:48 smithi077 ceph-mon[27902]: pgmap v4989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:48 smithi191 ceph-mon[31636]: pgmap v4989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:48 smithi170 ceph-mon[31212]: pgmap v4989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9180.205476 secs 2024-04-21T12:57:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9180.205476 secs 2024-04-21T12:57:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9180.205476 secs 2024-04-21T12:57:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:50 smithi191 ceph-mon[31636]: pgmap v4990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:50 smithi170 ceph-mon[31212]: pgmap v4990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:50 smithi077 ceph-mon[27902]: pgmap v4990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:52 smithi191 ceph-mon[31636]: pgmap v4991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9183.445120 secs 2024-04-21T12:57:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:52 smithi170 ceph-mon[31212]: pgmap v4991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9183.445120 secs 2024-04-21T12:57:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:52 smithi077 ceph-mon[27902]: pgmap v4991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9183.445120 secs 2024-04-21T12:57:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:57:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:57:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:57:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:57:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:57:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:57:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:57:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:57:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:57:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:57:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:57:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:57:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:54 smithi191 ceph-mon[31636]: pgmap v4992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9185.205593 secs 2024-04-21T12:57:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:54 smithi170 ceph-mon[31212]: pgmap v4992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9185.205593 secs 2024-04-21T12:57:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:54 smithi077 ceph-mon[27902]: pgmap v4992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9185.205593 secs 2024-04-21T12:57:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:57:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:56 smithi191 ceph-mon[31636]: pgmap v4993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:56 smithi170 ceph-mon[31212]: pgmap v4993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:56 smithi077 ceph-mon[27902]: pgmap v4993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:57:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9188.445244 secs 2024-04-21T12:57:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9188.445244 secs 2024-04-21T12:57:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9188.445244 secs 2024-04-21T12:57:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:58 smithi191 ceph-mon[31636]: pgmap v4994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:58 smithi170 ceph-mon[31212]: pgmap v4994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:58 smithi077 ceph-mon[27902]: pgmap v4994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:57:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:57:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9190.205665 secs 2024-04-21T12:57:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:57:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9190.205665 secs 2024-04-21T12:57:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:57:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9190.205665 secs 2024-04-21T12:58:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:00 smithi191 ceph-mon[31636]: pgmap v4995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:00 smithi170 ceph-mon[31212]: pgmap v4995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:00 smithi077 ceph-mon[27902]: pgmap v4995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:02 smithi191 ceph-mon[31636]: pgmap v4996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9193.445364 secs 2024-04-21T12:58:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:02 smithi170 ceph-mon[31212]: pgmap v4996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9193.445364 secs 2024-04-21T12:58:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:02 smithi077 ceph-mon[27902]: pgmap v4996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9193.445364 secs 2024-04-21T12:58:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:04 smithi191 ceph-mon[31636]: pgmap v4997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9195.205796 secs 2024-04-21T12:58:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:04 smithi191 ceph-mon[31636]: osdmap e385: 12 total, 12 up, 12 in 2024-04-21T12:58:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:04 smithi170 ceph-mon[31212]: pgmap v4997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9195.205796 secs 2024-04-21T12:58:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:04 smithi170 ceph-mon[31212]: osdmap e385: 12 total, 12 up, 12 in 2024-04-21T12:58:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:04 smithi077 ceph-mon[27902]: pgmap v4997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9195.205796 secs 2024-04-21T12:58:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:04 smithi077 ceph-mon[27902]: osdmap e385: 12 total, 12 up, 12 in 2024-04-21T12:58:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:06 smithi191 ceph-mon[31636]: pgmap v4999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:58:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:06 smithi170 ceph-mon[31212]: pgmap v4999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:58:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:06 smithi077 ceph-mon[27902]: pgmap v4999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:58:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9198.445505 secs 2024-04-21T12:58:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9198.445505 secs 2024-04-21T12:58:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9198.445505 secs 2024-04-21T12:58:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:08 smithi191 ceph-mon[31636]: pgmap v5000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:58:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:08 smithi191 ceph-mon[31636]: osdmap e386: 12 total, 12 up, 12 in 2024-04-21T12:58:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:08 smithi170 ceph-mon[31212]: pgmap v5000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:58:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:08 smithi170 ceph-mon[31212]: osdmap e386: 12 total, 12 up, 12 in 2024-04-21T12:58:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:08 smithi077 ceph-mon[27902]: pgmap v5000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T12:58:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:08 smithi077 ceph-mon[27902]: osdmap e386: 12 total, 12 up, 12 in 2024-04-21T12:58:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9200.205934 secs 2024-04-21T12:58:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9200.205934 secs 2024-04-21T12:58:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9200.205934 secs 2024-04-21T12:58:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:10 smithi191 ceph-mon[31636]: pgmap v5002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:58:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:10 smithi170 ceph-mon[31212]: pgmap v5002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:58:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:10 smithi077 ceph-mon[27902]: pgmap v5002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T12:58:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:12 smithi191 ceph-mon[31636]: pgmap v5003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:58:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9203.445636 secs 2024-04-21T12:58:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:12 smithi170 ceph-mon[31212]: pgmap v5003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:58:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9203.445636 secs 2024-04-21T12:58:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:12 smithi077 ceph-mon[27902]: pgmap v5003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T12:58:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9203.445636 secs 2024-04-21T12:58:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:14 smithi191 ceph-mon[31636]: pgmap v5004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T12:58:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9205.206011 secs 2024-04-21T12:58:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:14 smithi170 ceph-mon[31212]: pgmap v5004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T12:58:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9205.206011 secs 2024-04-21T12:58:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:14 smithi077 ceph-mon[27902]: pgmap v5004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T12:58:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9205.206011 secs 2024-04-21T12:58:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:16 smithi191 ceph-mon[31636]: pgmap v5005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:58:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:16 smithi170 ceph-mon[31212]: pgmap v5005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:58:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:16 smithi077 ceph-mon[27902]: pgmap v5005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:58:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9208.445800 secs 2024-04-21T12:58:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9208.445800 secs 2024-04-21T12:58:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9208.445800 secs 2024-04-21T12:58:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:18 smithi191 ceph-mon[31636]: pgmap v5006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:58:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:18 smithi170 ceph-mon[31212]: pgmap v5006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:58:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:18 smithi077 ceph-mon[27902]: pgmap v5006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:58:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9210.206126 secs 2024-04-21T12:58:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9210.206126 secs 2024-04-21T12:58:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9210.206126 secs 2024-04-21T12:58:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:20 smithi170 ceph-mon[31212]: pgmap v5007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:58:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:20 smithi077 ceph-mon[27902]: pgmap v5007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:58:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:20 smithi191 ceph-mon[31636]: pgmap v5007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:58:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:21 smithi170 ceph-mon[31212]: pgmap v5008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:58:21.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:21 smithi077 ceph-mon[27902]: pgmap v5008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:58:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:21 smithi191 ceph-mon[31636]: pgmap v5008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:58:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9213.445908 secs 2024-04-21T12:58:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9213.445908 secs 2024-04-21T12:58:22.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9213.445908 secs 2024-04-21T12:58:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:23 smithi170 ceph-mon[31212]: pgmap v5009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:23 smithi077 ceph-mon[27902]: pgmap v5009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:23.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:23 smithi191 ceph-mon[31636]: pgmap v5009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9215.206249 secs 2024-04-21T12:58:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9215.206249 secs 2024-04-21T12:58:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9215.206249 secs 2024-04-21T12:58:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:25 smithi170 ceph-mon[31212]: pgmap v5010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:25 smithi077 ceph-mon[27902]: pgmap v5010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:25 smithi191 ceph-mon[31636]: pgmap v5010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9218.445994 secs 2024-04-21T12:58:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9218.445994 secs 2024-04-21T12:58:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9218.445994 secs 2024-04-21T12:58:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:27 smithi191 ceph-mon[31636]: pgmap v5011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:27 smithi170 ceph-mon[31212]: pgmap v5011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:27 smithi077 ceph-mon[27902]: pgmap v5011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9220.206367 secs 2024-04-21T12:58:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9220.206367 secs 2024-04-21T12:58:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9220.206367 secs 2024-04-21T12:58:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:29 smithi191 ceph-mon[31636]: pgmap v5012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:29 smithi170 ceph-mon[31212]: pgmap v5012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:29 smithi077 ceph-mon[27902]: pgmap v5012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:31 smithi191 ceph-mon[31636]: pgmap v5013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9223.446122 secs 2024-04-21T12:58:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:31 smithi170 ceph-mon[31212]: pgmap v5013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9223.446122 secs 2024-04-21T12:58:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:31 smithi077 ceph-mon[27902]: pgmap v5013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9223.446122 secs 2024-04-21T12:58:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:33 smithi191 ceph-mon[31636]: pgmap v5014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9225.206488 secs 2024-04-21T12:58:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:33 smithi170 ceph-mon[31212]: pgmap v5014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9225.206488 secs 2024-04-21T12:58:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:33 smithi077 ceph-mon[27902]: pgmap v5014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9225.206488 secs 2024-04-21T12:58:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:35 smithi191 ceph-mon[31636]: pgmap v5015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:35 smithi170 ceph-mon[31212]: pgmap v5015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:35 smithi077 ceph-mon[27902]: pgmap v5015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9228.446261 secs 2024-04-21T12:58:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9228.446261 secs 2024-04-21T12:58:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9228.446261 secs 2024-04-21T12:58:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:37 smithi191 ceph-mon[31636]: pgmap v5016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:37 smithi170 ceph-mon[31212]: pgmap v5016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:37 smithi077 ceph-mon[27902]: pgmap v5016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9230.206615 secs 2024-04-21T12:58:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9230.206615 secs 2024-04-21T12:58:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9230.206615 secs 2024-04-21T12:58:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:39 smithi191 ceph-mon[31636]: pgmap v5017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:39 smithi170 ceph-mon[31212]: pgmap v5017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:39 smithi077 ceph-mon[27902]: pgmap v5017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:41 smithi191 ceph-mon[31636]: pgmap v5018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9233.446385 secs 2024-04-21T12:58:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:41 smithi170 ceph-mon[31212]: pgmap v5018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9233.446385 secs 2024-04-21T12:58:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:41 smithi077 ceph-mon[27902]: pgmap v5018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9233.446385 secs 2024-04-21T12:58:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:43 smithi191 ceph-mon[31636]: pgmap v5019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9235.206725 secs 2024-04-21T12:58:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:43 smithi170 ceph-mon[31212]: pgmap v5019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9235.206725 secs 2024-04-21T12:58:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:43 smithi077 ceph-mon[27902]: pgmap v5019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9235.206725 secs 2024-04-21T12:58:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:45 smithi191 ceph-mon[31636]: pgmap v5020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:45 smithi170 ceph-mon[31212]: pgmap v5020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:45 smithi077 ceph-mon[27902]: pgmap v5020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:47.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9238.446518 secs 2024-04-21T12:58:47.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9238.446518 secs 2024-04-21T12:58:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9238.446518 secs 2024-04-21T12:58:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:47 smithi191 ceph-mon[31636]: pgmap v5021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:47 smithi170 ceph-mon[31212]: pgmap v5021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:47 smithi077 ceph-mon[27902]: pgmap v5021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9240.206879 secs 2024-04-21T12:58:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9240.206879 secs 2024-04-21T12:58:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9240.206879 secs 2024-04-21T12:58:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:49 smithi191 ceph-mon[31636]: pgmap v5022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:49 smithi170 ceph-mon[31212]: pgmap v5022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:49 smithi077 ceph-mon[27902]: pgmap v5022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:52.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:51 smithi191 ceph-mon[31636]: pgmap v5023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9243.446575 secs 2024-04-21T12:58:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:51 smithi170 ceph-mon[31212]: pgmap v5023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9243.446575 secs 2024-04-21T12:58:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:51 smithi077 ceph-mon[27902]: pgmap v5023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9243.446575 secs 2024-04-21T12:58:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:53 smithi191 ceph-mon[31636]: pgmap v5024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9245.207003 secs 2024-04-21T12:58:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:58:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:53 smithi170 ceph-mon[31212]: pgmap v5024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9245.207003 secs 2024-04-21T12:58:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:58:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:53 smithi077 ceph-mon[27902]: pgmap v5024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9245.207003 secs 2024-04-21T12:58:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd70034000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd70034000 comp rx=0 tx=0).stop 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.422+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a51a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd70054040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.423+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.424+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T12:58:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:54.424+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T12:58:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:58:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:58:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:58:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:58:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:58:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:58:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:58:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:58:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:58:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:58:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:55.625+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:58:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:55.625+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:58:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:55.626+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T12:58:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T12:58:55.626+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T12:58:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:56 smithi077 ceph-mon[27902]: pgmap v5025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:56 smithi191 ceph-mon[31636]: pgmap v5025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:56 smithi170 ceph-mon[31212]: pgmap v5025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:58:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9248.446718 secs 2024-04-21T12:58:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9248.446718 secs 2024-04-21T12:58:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9248.446718 secs 2024-04-21T12:58:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:58 smithi077 ceph-mon[27902]: pgmap v5026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:58 smithi191 ceph-mon[31636]: pgmap v5026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:58 smithi170 ceph-mon[31212]: pgmap v5026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:58:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:58:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9250.207116 secs 2024-04-21T12:58:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:58:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9250.207116 secs 2024-04-21T12:58:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:58:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9250.207116 secs 2024-04-21T12:59:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:00 smithi077 ceph-mon[27902]: pgmap v5027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:00 smithi191 ceph-mon[31636]: pgmap v5027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:00 smithi170 ceph-mon[31212]: pgmap v5027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:02 smithi077 ceph-mon[27902]: pgmap v5028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9253.446844 secs 2024-04-21T12:59:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:02 smithi191 ceph-mon[31636]: pgmap v5028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9253.446844 secs 2024-04-21T12:59:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:02 smithi170 ceph-mon[31212]: pgmap v5028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:02.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9253.446844 secs 2024-04-21T12:59:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:04 smithi191 ceph-mon[31636]: pgmap v5029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9255.207238 secs 2024-04-21T12:59:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:04 smithi170 ceph-mon[31212]: pgmap v5029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9255.207238 secs 2024-04-21T12:59:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:04 smithi077 ceph-mon[27902]: pgmap v5029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9255.207238 secs 2024-04-21T12:59:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:05 smithi191 ceph-mon[31636]: osdmap e387: 12 total, 12 up, 12 in 2024-04-21T12:59:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:05 smithi170 ceph-mon[31212]: osdmap e387: 12 total, 12 up, 12 in 2024-04-21T12:59:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:05 smithi077 ceph-mon[27902]: osdmap e387: 12 total, 12 up, 12 in 2024-04-21T12:59:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:06 smithi191 ceph-mon[31636]: pgmap v5031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:59:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:06 smithi170 ceph-mon[31212]: pgmap v5031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:59:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:06 smithi077 ceph-mon[27902]: pgmap v5031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T12:59:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9258.446942 secs 2024-04-21T12:59:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9258.446942 secs 2024-04-21T12:59:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9258.446942 secs 2024-04-21T12:59:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:08 smithi191 ceph-mon[31636]: pgmap v5032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:59:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:08 smithi170 ceph-mon[31212]: pgmap v5032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:59:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:08 smithi077 ceph-mon[27902]: pgmap v5032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:59:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:09 smithi191 ceph-mon[31636]: osdmap e388: 12 total, 12 up, 12 in 2024-04-21T12:59:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9260.207312 secs 2024-04-21T12:59:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:09 smithi170 ceph-mon[31212]: osdmap e388: 12 total, 12 up, 12 in 2024-04-21T12:59:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9260.207312 secs 2024-04-21T12:59:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:09 smithi077 ceph-mon[27902]: osdmap e388: 12 total, 12 up, 12 in 2024-04-21T12:59:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9260.207312 secs 2024-04-21T12:59:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:10 smithi191 ceph-mon[31636]: pgmap v5034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:59:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:10 smithi170 ceph-mon[31212]: pgmap v5034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:59:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:10 smithi077 ceph-mon[27902]: pgmap v5034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T12:59:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:12 smithi191 ceph-mon[31636]: pgmap v5035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:59:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9263.447071 secs 2024-04-21T12:59:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:12 smithi170 ceph-mon[31212]: pgmap v5035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:59:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9263.447071 secs 2024-04-21T12:59:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:12 smithi077 ceph-mon[27902]: pgmap v5035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T12:59:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9263.447071 secs 2024-04-21T12:59:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:14 smithi191 ceph-mon[31636]: pgmap v5036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T12:59:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9265.207436 secs 2024-04-21T12:59:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:14 smithi170 ceph-mon[31212]: pgmap v5036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T12:59:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9265.207436 secs 2024-04-21T12:59:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:14 smithi077 ceph-mon[27902]: pgmap v5036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T12:59:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9265.207436 secs 2024-04-21T12:59:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:16 smithi191 ceph-mon[31636]: pgmap v5037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:59:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:16 smithi170 ceph-mon[31212]: pgmap v5037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:59:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:16 smithi077 ceph-mon[27902]: pgmap v5037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T12:59:17.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9268.447192 secs 2024-04-21T12:59:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9268.447192 secs 2024-04-21T12:59:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9268.447192 secs 2024-04-21T12:59:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:18 smithi191 ceph-mon[31636]: pgmap v5038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:59:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:18 smithi170 ceph-mon[31212]: pgmap v5038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:59:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:18 smithi077 ceph-mon[27902]: pgmap v5038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T12:59:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9270.207510 secs 2024-04-21T12:59:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9270.207510 secs 2024-04-21T12:59:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9270.207510 secs 2024-04-21T12:59:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:20 smithi191 ceph-mon[31636]: pgmap v5039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:59:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:20 smithi170 ceph-mon[31212]: pgmap v5039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:59:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:20 smithi077 ceph-mon[27902]: pgmap v5039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T12:59:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:22 smithi191 ceph-mon[31636]: pgmap v5040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:59:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9273.447329 secs 2024-04-21T12:59:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:22 smithi170 ceph-mon[31212]: pgmap v5040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:59:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9273.447329 secs 2024-04-21T12:59:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:22 smithi077 ceph-mon[27902]: pgmap v5040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T12:59:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9273.447329 secs 2024-04-21T12:59:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:24 smithi191 ceph-mon[31636]: pgmap v5041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9275.207632 secs 2024-04-21T12:59:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:24 smithi170 ceph-mon[31212]: pgmap v5041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9275.207632 secs 2024-04-21T12:59:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:24 smithi077 ceph-mon[27902]: pgmap v5041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9275.207632 secs 2024-04-21T12:59:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:26 smithi191 ceph-mon[31636]: pgmap v5042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:26 smithi170 ceph-mon[31212]: pgmap v5042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:26 smithi077 ceph-mon[27902]: pgmap v5042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9278.447435 secs 2024-04-21T12:59:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9278.447435 secs 2024-04-21T12:59:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9278.447435 secs 2024-04-21T12:59:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:28 smithi191 ceph-mon[31636]: pgmap v5043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:28 smithi170 ceph-mon[31212]: pgmap v5043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:28 smithi077 ceph-mon[27902]: pgmap v5043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9280.207774 secs 2024-04-21T12:59:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9280.207774 secs 2024-04-21T12:59:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9280.207774 secs 2024-04-21T12:59:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:30 smithi170 ceph-mon[31212]: pgmap v5044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:30 smithi077 ceph-mon[27902]: pgmap v5044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:30 smithi191 ceph-mon[31636]: pgmap v5044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:32 smithi170 ceph-mon[31212]: pgmap v5045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9283.447560 secs 2024-04-21T12:59:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:32 smithi077 ceph-mon[27902]: pgmap v5045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9283.447560 secs 2024-04-21T12:59:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:32 smithi191 ceph-mon[31636]: pgmap v5045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9283.447560 secs 2024-04-21T12:59:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:34 smithi170 ceph-mon[31212]: pgmap v5046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9285.207876 secs 2024-04-21T12:59:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:34 smithi077 ceph-mon[27902]: pgmap v5046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9285.207876 secs 2024-04-21T12:59:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:34 smithi191 ceph-mon[31636]: pgmap v5046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9285.207876 secs 2024-04-21T12:59:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:36 smithi170 ceph-mon[31212]: pgmap v5047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:36 smithi077 ceph-mon[27902]: pgmap v5047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:36 smithi191 ceph-mon[31636]: pgmap v5047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9288.447707 secs 2024-04-21T12:59:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9288.447707 secs 2024-04-21T12:59:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9288.447707 secs 2024-04-21T12:59:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:38 smithi170 ceph-mon[31212]: pgmap v5048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:38 smithi077 ceph-mon[27902]: pgmap v5048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:38 smithi191 ceph-mon[31636]: pgmap v5048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9290.207997 secs 2024-04-21T12:59:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9290.207997 secs 2024-04-21T12:59:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9290.207997 secs 2024-04-21T12:59:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:40 smithi170 ceph-mon[31212]: pgmap v5049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:40 smithi077 ceph-mon[27902]: pgmap v5049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:40 smithi191 ceph-mon[31636]: pgmap v5049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:42 smithi170 ceph-mon[31212]: pgmap v5050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9293.447835 secs 2024-04-21T12:59:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:42 smithi077 ceph-mon[27902]: pgmap v5050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9293.447835 secs 2024-04-21T12:59:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:42 smithi191 ceph-mon[31636]: pgmap v5050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9293.447835 secs 2024-04-21T12:59:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:44 smithi170 ceph-mon[31212]: pgmap v5051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9295.208122 secs 2024-04-21T12:59:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:44 smithi077 ceph-mon[27902]: pgmap v5051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9295.208122 secs 2024-04-21T12:59:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:44 smithi191 ceph-mon[31636]: pgmap v5051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9295.208122 secs 2024-04-21T12:59:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:46 smithi170 ceph-mon[31212]: pgmap v5052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:46 smithi077 ceph-mon[27902]: pgmap v5052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:46 smithi191 ceph-mon[31636]: pgmap v5052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9298.447963 secs 2024-04-21T12:59:47.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9298.447963 secs 2024-04-21T12:59:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9298.447963 secs 2024-04-21T12:59:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:48 smithi170 ceph-mon[31212]: pgmap v5053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:48 smithi077 ceph-mon[27902]: pgmap v5053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:48 smithi191 ceph-mon[31636]: pgmap v5053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9300.208261 secs 2024-04-21T12:59:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9300.208261 secs 2024-04-21T12:59:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9300.208261 secs 2024-04-21T12:59:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:50 smithi170 ceph-mon[31212]: pgmap v5054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:50 smithi077 ceph-mon[27902]: pgmap v5054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:50 smithi191 ceph-mon[31636]: pgmap v5054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:52 smithi170 ceph-mon[31212]: pgmap v5055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9303.448063 secs 2024-04-21T12:59:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:52 smithi077 ceph-mon[27902]: pgmap v5055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9303.448063 secs 2024-04-21T12:59:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:52 smithi191 ceph-mon[31636]: pgmap v5055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9303.448063 secs 2024-04-21T12:59:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:54 smithi170 ceph-mon[31212]: pgmap v5056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9305.208384 secs 2024-04-21T12:59:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:59:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:54 smithi077 ceph-mon[27902]: pgmap v5056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9305.208384 secs 2024-04-21T12:59:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:59:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:54 smithi191 ceph-mon[31636]: pgmap v5056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9305.208384 secs 2024-04-21T12:59:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T12:59:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T12:59:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:59:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:59:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:59:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:59:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:59:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:59:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T12:59:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T12:59:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T12:59:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:56 smithi170 ceph-mon[31212]: pgmap v5057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:56 smithi077 ceph-mon[27902]: pgmap v5057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:56 smithi191 ceph-mon[31636]: pgmap v5057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T12:59:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9308.448210 secs 2024-04-21T12:59:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9308.448210 secs 2024-04-21T12:59:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9308.448210 secs 2024-04-21T12:59:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:58 smithi170 ceph-mon[31212]: pgmap v5058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:58 smithi077 ceph-mon[27902]: pgmap v5058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:58 smithi191 ceph-mon[31636]: pgmap v5058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T12:59:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 12:59:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9310.208506 secs 2024-04-21T12:59:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 12:59:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9310.208506 secs 2024-04-21T12:59:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 12:59:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9310.208506 secs 2024-04-21T13:00:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:00 smithi170 ceph-mon[31212]: pgmap v5059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:00:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:00 smithi077 ceph-mon[27902]: pgmap v5059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:00:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:00 smithi191 ceph-mon[31636]: pgmap v5059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:00:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:02 smithi077 ceph-mon[27902]: pgmap v5060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9313.448325 secs 2024-04-21T13:00:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:02 smithi191 ceph-mon[31636]: pgmap v5060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9313.448325 secs 2024-04-21T13:00:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:02 smithi170 ceph-mon[31212]: pgmap v5060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9313.448325 secs 2024-04-21T13:00:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:04 smithi077 ceph-mon[27902]: pgmap v5061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9315.208612 secs 2024-04-21T13:00:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:04 smithi191 ceph-mon[31636]: pgmap v5061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9315.208612 secs 2024-04-21T13:00:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:04 smithi170 ceph-mon[31212]: pgmap v5061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9315.208612 secs 2024-04-21T13:00:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:05 smithi077 ceph-mon[27902]: osdmap e389: 12 total, 12 up, 12 in 2024-04-21T13:00:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:05 smithi191 ceph-mon[31636]: osdmap e389: 12 total, 12 up, 12 in 2024-04-21T13:00:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:05 smithi170 ceph-mon[31212]: osdmap e389: 12 total, 12 up, 12 in 2024-04-21T13:00:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:06 smithi077 ceph-mon[27902]: pgmap v5063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:00:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:06 smithi191 ceph-mon[31636]: pgmap v5063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:00:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:06 smithi170 ceph-mon[31212]: pgmap v5063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:00:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9318.448445 secs 2024-04-21T13:00:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9318.448445 secs 2024-04-21T13:00:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9318.448445 secs 2024-04-21T13:00:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:08 smithi077 ceph-mon[27902]: pgmap v5064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:00:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:08 smithi077 ceph-mon[27902]: osdmap e390: 12 total, 12 up, 12 in 2024-04-21T13:00:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:08 smithi191 ceph-mon[31636]: pgmap v5064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:00:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:08 smithi191 ceph-mon[31636]: osdmap e390: 12 total, 12 up, 12 in 2024-04-21T13:00:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:08 smithi170 ceph-mon[31212]: pgmap v5064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:00:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:08 smithi170 ceph-mon[31212]: osdmap e390: 12 total, 12 up, 12 in 2024-04-21T13:00:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9320.208693 secs 2024-04-21T13:00:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9320.208693 secs 2024-04-21T13:00:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9320.208693 secs 2024-04-21T13:00:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:10 smithi077 ceph-mon[27902]: pgmap v5066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:00:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:10 smithi191 ceph-mon[31636]: pgmap v5066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:00:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:10 smithi170 ceph-mon[31212]: pgmap v5066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:00:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:12 smithi077 ceph-mon[27902]: pgmap v5067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:00:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9323.448573 secs 2024-04-21T13:00:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:12 smithi191 ceph-mon[31636]: pgmap v5067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:00:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9323.448573 secs 2024-04-21T13:00:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:12 smithi170 ceph-mon[31212]: pgmap v5067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:00:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9323.448573 secs 2024-04-21T13:00:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:14 smithi077 ceph-mon[27902]: pgmap v5068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T13:00:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9325.208828 secs 2024-04-21T13:00:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:14 smithi191 ceph-mon[31636]: pgmap v5068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T13:00:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9325.208828 secs 2024-04-21T13:00:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:14 smithi170 ceph-mon[31212]: pgmap v5068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T13:00:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9325.208828 secs 2024-04-21T13:00:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:16 smithi077 ceph-mon[27902]: pgmap v5069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:00:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:16 smithi191 ceph-mon[31636]: pgmap v5069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:00:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:16 smithi170 ceph-mon[31212]: pgmap v5069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:00:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9328.448716 secs 2024-04-21T13:00:17.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9328.448716 secs 2024-04-21T13:00:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9328.448716 secs 2024-04-21T13:00:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:18 smithi077 ceph-mon[27902]: pgmap v5070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:00:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:18 smithi191 ceph-mon[31636]: pgmap v5070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:00:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:18 smithi170 ceph-mon[31212]: pgmap v5070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:00:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9330.208947 secs 2024-04-21T13:00:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9330.208947 secs 2024-04-21T13:00:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9330.208947 secs 2024-04-21T13:00:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:20 smithi077 ceph-mon[27902]: pgmap v5071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:00:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:20 smithi191 ceph-mon[31636]: pgmap v5071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:00:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:20 smithi170 ceph-mon[31212]: pgmap v5071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:00:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:22 smithi077 ceph-mon[27902]: pgmap v5072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:00:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9333.448867 secs 2024-04-21T13:00:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:22 smithi191 ceph-mon[31636]: pgmap v5072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:00:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9333.448867 secs 2024-04-21T13:00:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:22 smithi170 ceph-mon[31212]: pgmap v5072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:00:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9333.448867 secs 2024-04-21T13:00:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:24 smithi077 ceph-mon[27902]: pgmap v5073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9335.209059 secs 2024-04-21T13:00:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:24 smithi191 ceph-mon[31636]: pgmap v5073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9335.209059 secs 2024-04-21T13:00:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:24 smithi170 ceph-mon[31212]: pgmap v5073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9335.209059 secs 2024-04-21T13:00:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:26 smithi077 ceph-mon[27902]: pgmap v5074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:26 smithi191 ceph-mon[31636]: pgmap v5074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:26 smithi170 ceph-mon[31212]: pgmap v5074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9338.448988 secs 2024-04-21T13:00:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9338.448988 secs 2024-04-21T13:00:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9338.448988 secs 2024-04-21T13:00:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:28 smithi077 ceph-mon[27902]: pgmap v5075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:28 smithi191 ceph-mon[31636]: pgmap v5075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:28 smithi170 ceph-mon[31212]: pgmap v5075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9340.209177 secs 2024-04-21T13:00:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9340.209177 secs 2024-04-21T13:00:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9340.209177 secs 2024-04-21T13:00:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:30 smithi191 ceph-mon[31636]: pgmap v5076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:30 smithi170 ceph-mon[31212]: pgmap v5076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:30 smithi077 ceph-mon[27902]: pgmap v5076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:32 smithi191 ceph-mon[31636]: pgmap v5077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9343.449102 secs 2024-04-21T13:00:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:32 smithi170 ceph-mon[31212]: pgmap v5077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9343.449102 secs 2024-04-21T13:00:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:32 smithi077 ceph-mon[27902]: pgmap v5077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9343.449102 secs 2024-04-21T13:00:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:34 smithi191 ceph-mon[31636]: pgmap v5078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9345.209297 secs 2024-04-21T13:00:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:34 smithi170 ceph-mon[31212]: pgmap v5078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9345.209297 secs 2024-04-21T13:00:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:34 smithi077 ceph-mon[27902]: pgmap v5078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9345.209297 secs 2024-04-21T13:00:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:36 smithi191 ceph-mon[31636]: pgmap v5079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:36 smithi170 ceph-mon[31212]: pgmap v5079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:36 smithi077 ceph-mon[27902]: pgmap v5079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9348.449230 secs 2024-04-21T13:00:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9348.449230 secs 2024-04-21T13:00:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9348.449230 secs 2024-04-21T13:00:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:38 smithi191 ceph-mon[31636]: pgmap v5080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:38 smithi170 ceph-mon[31212]: pgmap v5080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:38 smithi077 ceph-mon[27902]: pgmap v5080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9350.209376 secs 2024-04-21T13:00:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9350.209376 secs 2024-04-21T13:00:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9350.209376 secs 2024-04-21T13:00:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:40 smithi191 ceph-mon[31636]: pgmap v5081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:40 smithi170 ceph-mon[31212]: pgmap v5081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:40 smithi077 ceph-mon[27902]: pgmap v5081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:42 smithi191 ceph-mon[31636]: pgmap v5082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9353.449376 secs 2024-04-21T13:00:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:42 smithi170 ceph-mon[31212]: pgmap v5082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9353.449376 secs 2024-04-21T13:00:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:42 smithi077 ceph-mon[27902]: pgmap v5082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9353.449376 secs 2024-04-21T13:00:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:44 smithi191 ceph-mon[31636]: pgmap v5083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9355.209532 secs 2024-04-21T13:00:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:44 smithi170 ceph-mon[31212]: pgmap v5083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9355.209532 secs 2024-04-21T13:00:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:44 smithi077 ceph-mon[27902]: pgmap v5083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9355.209532 secs 2024-04-21T13:00:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:46 smithi191 ceph-mon[31636]: pgmap v5084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:46 smithi170 ceph-mon[31212]: pgmap v5084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:46 smithi077 ceph-mon[27902]: pgmap v5084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:47.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9358.449515 secs 2024-04-21T13:00:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9358.449515 secs 2024-04-21T13:00:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9358.449515 secs 2024-04-21T13:00:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:48 smithi191 ceph-mon[31636]: pgmap v5085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:48 smithi170 ceph-mon[31212]: pgmap v5085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:48 smithi077 ceph-mon[27902]: pgmap v5085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9360.209669 secs 2024-04-21T13:00:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9360.209669 secs 2024-04-21T13:00:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9360.209669 secs 2024-04-21T13:00:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:50 smithi191 ceph-mon[31636]: pgmap v5086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:50 smithi170 ceph-mon[31212]: pgmap v5086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:50 smithi077 ceph-mon[27902]: pgmap v5086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:52 smithi191 ceph-mon[31636]: pgmap v5087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9363.449643 secs 2024-04-21T13:00:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:52 smithi170 ceph-mon[31212]: pgmap v5087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9363.449643 secs 2024-04-21T13:00:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:52 smithi077 ceph-mon[27902]: pgmap v5087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9363.449643 secs 2024-04-21T13:00:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:54 smithi191 ceph-mon[31636]: pgmap v5088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9365.209786 secs 2024-04-21T13:00:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:54 smithi170 ceph-mon[31212]: pgmap v5088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9365.209786 secs 2024-04-21T13:00:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:54 smithi077 ceph-mon[27902]: pgmap v5088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9365.209786 secs 2024-04-21T13:00:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:00:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:00:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:00:55.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:00:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:56 smithi191 ceph-mon[31636]: pgmap v5089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:00:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:00:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:00:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:56 smithi170 ceph-mon[31212]: pgmap v5089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:00:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:00:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:00:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:56 smithi077 ceph-mon[27902]: pgmap v5089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:00:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:00:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:00:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:00:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9368.449793 secs 2024-04-21T13:00:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9368.449793 secs 2024-04-21T13:00:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9368.449793 secs 2024-04-21T13:00:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:58 smithi191 ceph-mon[31636]: pgmap v5090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:58 smithi170 ceph-mon[31212]: pgmap v5090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:58 smithi077 ceph-mon[27902]: pgmap v5090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:00:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:00:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9370.209902 secs 2024-04-21T13:00:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:00:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9370.209902 secs 2024-04-21T13:00:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:00:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9370.209902 secs 2024-04-21T13:01:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:00 smithi191 ceph-mon[31636]: pgmap v5091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:00 smithi170 ceph-mon[31212]: pgmap v5091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:00 smithi077 ceph-mon[27902]: pgmap v5091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:02 smithi191 ceph-mon[31636]: pgmap v5092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9373.449861 secs 2024-04-21T13:01:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:02 smithi170 ceph-mon[31212]: pgmap v5092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9373.449861 secs 2024-04-21T13:01:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:02 smithi077 ceph-mon[27902]: pgmap v5092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9373.449861 secs 2024-04-21T13:01:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:04 smithi191 ceph-mon[31636]: pgmap v5093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9375.210016 secs 2024-04-21T13:01:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:04 smithi191 ceph-mon[31636]: osdmap e391: 12 total, 12 up, 12 in 2024-04-21T13:01:04.945 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:04 smithi077 ceph-mon[27902]: pgmap v5093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:04.946 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9375.210016 secs 2024-04-21T13:01:04.946 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:04 smithi077 ceph-mon[27902]: osdmap e391: 12 total, 12 up, 12 in 2024-04-21T13:01:04.946 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:04 smithi170 ceph-mon[31212]: pgmap v5093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:04.946 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9375.210016 secs 2024-04-21T13:01:04.946 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:04 smithi170 ceph-mon[31212]: osdmap e391: 12 total, 12 up, 12 in 2024-04-21T13:01:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:06 smithi170 ceph-mon[31212]: pgmap v5095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:01:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:06 smithi077 ceph-mon[27902]: pgmap v5095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:01:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:06 smithi191 ceph-mon[31636]: pgmap v5095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:01:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9378.449987 secs 2024-04-21T13:01:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9378.449987 secs 2024-04-21T13:01:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9378.449987 secs 2024-04-21T13:01:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:08 smithi170 ceph-mon[31212]: pgmap v5096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:01:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:08 smithi170 ceph-mon[31212]: osdmap e392: 12 total, 12 up, 12 in 2024-04-21T13:01:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:08 smithi077 ceph-mon[27902]: pgmap v5096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:01:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:08 smithi077 ceph-mon[27902]: osdmap e392: 12 total, 12 up, 12 in 2024-04-21T13:01:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:08 smithi191 ceph-mon[31636]: pgmap v5096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:01:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:08 smithi191 ceph-mon[31636]: osdmap e392: 12 total, 12 up, 12 in 2024-04-21T13:01:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9380.210165 secs 2024-04-21T13:01:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9380.210165 secs 2024-04-21T13:01:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9380.210165 secs 2024-04-21T13:01:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:10 smithi170 ceph-mon[31212]: pgmap v5098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:01:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:10 smithi077 ceph-mon[27902]: pgmap v5098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:01:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:10 smithi191 ceph-mon[31636]: pgmap v5098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:01:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:12 smithi170 ceph-mon[31212]: pgmap v5099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:01:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9383.450097 secs 2024-04-21T13:01:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:12 smithi077 ceph-mon[27902]: pgmap v5099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:01:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9383.450097 secs 2024-04-21T13:01:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:12 smithi191 ceph-mon[31636]: pgmap v5099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:01:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9383.450097 secs 2024-04-21T13:01:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:14 smithi170 ceph-mon[31212]: pgmap v5100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:01:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9385.210330 secs 2024-04-21T13:01:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:14 smithi077 ceph-mon[27902]: pgmap v5100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:01:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9385.210330 secs 2024-04-21T13:01:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:14 smithi191 ceph-mon[31636]: pgmap v5100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:01:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9385.210330 secs 2024-04-21T13:01:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:15 smithi170 ceph-mon[31212]: pgmap v5101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:01:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:15 smithi077 ceph-mon[27902]: pgmap v5101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:01:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:15 smithi191 ceph-mon[31636]: pgmap v5101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:01:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9388.450239 secs 2024-04-21T13:01:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9388.450239 secs 2024-04-21T13:01:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9388.450239 secs 2024-04-21T13:01:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:17 smithi077 ceph-mon[27902]: pgmap v5102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:01:18.138 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:17 smithi191 ceph-mon[31636]: pgmap v5102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:01:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:17 smithi170 ceph-mon[31212]: pgmap v5102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:01:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9390.210398 secs 2024-04-21T13:01:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9390.210398 secs 2024-04-21T13:01:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9390.210398 secs 2024-04-21T13:01:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:20.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:19 smithi077 ceph-mon[27902]: pgmap v5103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:01:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:19 smithi191 ceph-mon[31636]: pgmap v5103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:01:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:19 smithi170 ceph-mon[31212]: pgmap v5103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:01:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:21 smithi191 ceph-mon[31636]: pgmap v5104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:01:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9393.450322 secs 2024-04-21T13:01:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:21 smithi170 ceph-mon[31212]: pgmap v5104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:01:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9393.450322 secs 2024-04-21T13:01:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:21 smithi077 ceph-mon[27902]: pgmap v5104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:01:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9393.450322 secs 2024-04-21T13:01:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:23 smithi191 ceph-mon[31636]: pgmap v5105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9395.210476 secs 2024-04-21T13:01:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:23 smithi170 ceph-mon[31212]: pgmap v5105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9395.210476 secs 2024-04-21T13:01:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:23 smithi077 ceph-mon[27902]: pgmap v5105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9395.210476 secs 2024-04-21T13:01:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:25 smithi191 ceph-mon[31636]: pgmap v5106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:25 smithi170 ceph-mon[31212]: pgmap v5106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:25 smithi077 ceph-mon[27902]: pgmap v5106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9398.450441 secs 2024-04-21T13:01:27.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9398.450441 secs 2024-04-21T13:01:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9398.450441 secs 2024-04-21T13:01:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:27 smithi191 ceph-mon[31636]: pgmap v5107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:27 smithi170 ceph-mon[31212]: pgmap v5107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:27 smithi077 ceph-mon[27902]: pgmap v5107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9400.210603 secs 2024-04-21T13:01:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9400.210603 secs 2024-04-21T13:01:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9400.210603 secs 2024-04-21T13:01:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:29 smithi191 ceph-mon[31636]: pgmap v5108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:29 smithi170 ceph-mon[31212]: pgmap v5108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:29 smithi077 ceph-mon[27902]: pgmap v5108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:31 smithi191 ceph-mon[31636]: pgmap v5109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:32.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9403.450527 secs 2024-04-21T13:01:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:31 smithi170 ceph-mon[31212]: pgmap v5109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9403.450527 secs 2024-04-21T13:01:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:31 smithi077 ceph-mon[27902]: pgmap v5109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9403.450527 secs 2024-04-21T13:01:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:33 smithi191 ceph-mon[31636]: pgmap v5110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9405.210728 secs 2024-04-21T13:01:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:33 smithi170 ceph-mon[31212]: pgmap v5110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9405.210728 secs 2024-04-21T13:01:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:33 smithi077 ceph-mon[27902]: pgmap v5110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9405.210728 secs 2024-04-21T13:01:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:35 smithi170 ceph-mon[31212]: pgmap v5111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:35 smithi077 ceph-mon[27902]: pgmap v5111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:35 smithi191 ceph-mon[31636]: pgmap v5111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9408.450651 secs 2024-04-21T13:01:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9408.450651 secs 2024-04-21T13:01:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9408.450651 secs 2024-04-21T13:01:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:37 smithi170 ceph-mon[31212]: pgmap v5112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:37 smithi077 ceph-mon[27902]: pgmap v5112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:37 smithi191 ceph-mon[31636]: pgmap v5112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9410.210870 secs 2024-04-21T13:01:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9410.210870 secs 2024-04-21T13:01:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9410.210870 secs 2024-04-21T13:01:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:39 smithi170 ceph-mon[31212]: pgmap v5113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:39 smithi077 ceph-mon[27902]: pgmap v5113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:39 smithi191 ceph-mon[31636]: pgmap v5113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:41 smithi170 ceph-mon[31212]: pgmap v5114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9413.450807 secs 2024-04-21T13:01:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:41 smithi077 ceph-mon[27902]: pgmap v5114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9413.450807 secs 2024-04-21T13:01:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:41 smithi191 ceph-mon[31636]: pgmap v5114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9413.450807 secs 2024-04-21T13:01:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:43 smithi170 ceph-mon[31212]: pgmap v5115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9415.210990 secs 2024-04-21T13:01:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:43 smithi077 ceph-mon[27902]: pgmap v5115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9415.210990 secs 2024-04-21T13:01:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:43 smithi191 ceph-mon[31636]: pgmap v5115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9415.210990 secs 2024-04-21T13:01:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:45 smithi170 ceph-mon[31212]: pgmap v5116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:45 smithi077 ceph-mon[27902]: pgmap v5116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:45 smithi191 ceph-mon[31636]: pgmap v5116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9418.450937 secs 2024-04-21T13:01:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9418.450937 secs 2024-04-21T13:01:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9418.450937 secs 2024-04-21T13:01:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:48 smithi170 ceph-mon[31212]: pgmap v5117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:48.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:48 smithi191 ceph-mon[31636]: pgmap v5117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:48 smithi077 ceph-mon[27902]: pgmap v5117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9420.211118 secs 2024-04-21T13:01:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9420.211118 secs 2024-04-21T13:01:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9420.211118 secs 2024-04-21T13:01:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:50 smithi170 ceph-mon[31212]: pgmap v5118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:50 smithi077 ceph-mon[27902]: pgmap v5118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:50 smithi191 ceph-mon[31636]: pgmap v5118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:52 smithi170 ceph-mon[31212]: pgmap v5119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9423.451059 secs 2024-04-21T13:01:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:52 smithi077 ceph-mon[27902]: pgmap v5119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9423.451059 secs 2024-04-21T13:01:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:52 smithi191 ceph-mon[31636]: pgmap v5119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9423.451059 secs 2024-04-21T13:01:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:54 smithi170 ceph-mon[31212]: pgmap v5120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9425.211194 secs 2024-04-21T13:01:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:54 smithi077 ceph-mon[27902]: pgmap v5120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9425.211194 secs 2024-04-21T13:01:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:54 smithi191 ceph-mon[31636]: pgmap v5120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9425.211194 secs 2024-04-21T13:01:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:01:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:01:55.650+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:01:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:01:55.650+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:01:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:01:55.651+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:01:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:01:55.651+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:01:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:56 smithi170 ceph-mon[31212]: pgmap v5121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:01:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:56 smithi077 ceph-mon[27902]: pgmap v5121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:01:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:56 smithi191 ceph-mon[31636]: pgmap v5121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:01:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:01:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:01:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:01:57.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:01:57.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9428.451191 secs 2024-04-21T13:01:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:01:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:01:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:01:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9428.451191 secs 2024-04-21T13:01:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:01:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:01:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:01:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9428.451191 secs 2024-04-21T13:01:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:58 smithi191 ceph-mon[31636]: pgmap v5122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:58 smithi170 ceph-mon[31212]: pgmap v5122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:58 smithi077 ceph-mon[27902]: pgmap v5122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:01:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:01:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9430.211333 secs 2024-04-21T13:01:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:01:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9430.211333 secs 2024-04-21T13:01:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:01:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9430.211333 secs 2024-04-21T13:02:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:00 smithi170 ceph-mon[31212]: pgmap v5123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:00 smithi077 ceph-mon[27902]: pgmap v5123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:00 smithi191 ceph-mon[31636]: pgmap v5123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:02 smithi170 ceph-mon[31212]: pgmap v5124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9433.451279 secs 2024-04-21T13:02:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:02 smithi077 ceph-mon[27902]: pgmap v5124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9433.451279 secs 2024-04-21T13:02:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:02 smithi191 ceph-mon[31636]: pgmap v5124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9433.451279 secs 2024-04-21T13:02:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:04 smithi170 ceph-mon[31212]: pgmap v5125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9435.211416 secs 2024-04-21T13:02:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:04 smithi170 ceph-mon[31212]: osdmap e393: 12 total, 12 up, 12 in 2024-04-21T13:02:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:04 smithi077 ceph-mon[27902]: pgmap v5125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9435.211416 secs 2024-04-21T13:02:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:04 smithi077 ceph-mon[27902]: osdmap e393: 12 total, 12 up, 12 in 2024-04-21T13:02:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:04 smithi191 ceph-mon[31636]: pgmap v5125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9435.211416 secs 2024-04-21T13:02:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:04 smithi191 ceph-mon[31636]: osdmap e393: 12 total, 12 up, 12 in 2024-04-21T13:02:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:06 smithi170 ceph-mon[31212]: pgmap v5127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:02:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:06 smithi077 ceph-mon[27902]: pgmap v5127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:02:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:06 smithi191 ceph-mon[31636]: pgmap v5127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:02:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9438.451402 secs 2024-04-21T13:02:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9438.451402 secs 2024-04-21T13:02:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9438.451402 secs 2024-04-21T13:02:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:08 smithi170 ceph-mon[31212]: pgmap v5128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:02:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:08 smithi170 ceph-mon[31212]: osdmap e394: 12 total, 12 up, 12 in 2024-04-21T13:02:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:08 smithi077 ceph-mon[27902]: pgmap v5128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:02:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:08 smithi077 ceph-mon[27902]: osdmap e394: 12 total, 12 up, 12 in 2024-04-21T13:02:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:08 smithi191 ceph-mon[31636]: pgmap v5128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:02:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:08 smithi191 ceph-mon[31636]: osdmap e394: 12 total, 12 up, 12 in 2024-04-21T13:02:09.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9440.211534 secs 2024-04-21T13:02:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9440.211534 secs 2024-04-21T13:02:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9440.211534 secs 2024-04-21T13:02:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:10 smithi170 ceph-mon[31212]: pgmap v5130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:02:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:10 smithi077 ceph-mon[27902]: pgmap v5130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:02:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:10 smithi191 ceph-mon[31636]: pgmap v5130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:02:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:11 smithi170 ceph-mon[31212]: pgmap v5131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:02:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:11 smithi077 ceph-mon[27902]: pgmap v5131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:02:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:11 smithi191 ceph-mon[31636]: pgmap v5131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:02:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9443.451521 secs 2024-04-21T13:02:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9443.451521 secs 2024-04-21T13:02:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9443.451521 secs 2024-04-21T13:02:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:13 smithi077 ceph-mon[27902]: pgmap v5132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:02:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:13 smithi191 ceph-mon[31636]: pgmap v5132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:02:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:13 smithi170 ceph-mon[31212]: pgmap v5132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:02:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9445.211671 secs 2024-04-21T13:02:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9445.211671 secs 2024-04-21T13:02:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9445.211671 secs 2024-04-21T13:02:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:15 smithi077 ceph-mon[27902]: pgmap v5133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:02:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:15 smithi191 ceph-mon[31636]: pgmap v5133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:02:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:15 smithi170 ceph-mon[31212]: pgmap v5133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:02:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9448.451644 secs 2024-04-21T13:02:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9448.451644 secs 2024-04-21T13:02:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9448.451644 secs 2024-04-21T13:02:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:17 smithi077 ceph-mon[27902]: pgmap v5134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:02:18.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:17 smithi170 ceph-mon[31212]: pgmap v5134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:02:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:17 smithi191 ceph-mon[31636]: pgmap v5134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:02:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9450.211813 secs 2024-04-21T13:02:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9450.211813 secs 2024-04-21T13:02:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9450.211813 secs 2024-04-21T13:02:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:19 smithi191 ceph-mon[31636]: pgmap v5135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:02:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:19 smithi170 ceph-mon[31212]: pgmap v5135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:02:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:19 smithi077 ceph-mon[27902]: pgmap v5135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:02:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:21 smithi191 ceph-mon[31636]: pgmap v5136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:02:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9453.451787 secs 2024-04-21T13:02:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:21 smithi170 ceph-mon[31212]: pgmap v5136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:02:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9453.451787 secs 2024-04-21T13:02:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:21 smithi077 ceph-mon[27902]: pgmap v5136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:02:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9453.451787 secs 2024-04-21T13:02:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:23 smithi191 ceph-mon[31636]: pgmap v5137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9455.211941 secs 2024-04-21T13:02:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:23 smithi170 ceph-mon[31212]: pgmap v5137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9455.211941 secs 2024-04-21T13:02:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:23 smithi077 ceph-mon[27902]: pgmap v5137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9455.211941 secs 2024-04-21T13:02:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:25 smithi191 ceph-mon[31636]: pgmap v5138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:25 smithi170 ceph-mon[31212]: pgmap v5138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:25 smithi077 ceph-mon[27902]: pgmap v5138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:27.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9458.451928 secs 2024-04-21T13:02:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9458.451928 secs 2024-04-21T13:02:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9458.451928 secs 2024-04-21T13:02:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:27 smithi170 ceph-mon[31212]: pgmap v5139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:27 smithi077 ceph-mon[27902]: pgmap v5139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:27 smithi191 ceph-mon[31636]: pgmap v5139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9460.212053 secs 2024-04-21T13:02:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9460.212053 secs 2024-04-21T13:02:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9460.212053 secs 2024-04-21T13:02:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:29 smithi170 ceph-mon[31212]: pgmap v5140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:29 smithi077 ceph-mon[27902]: pgmap v5140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:29 smithi191 ceph-mon[31636]: pgmap v5140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:31 smithi170 ceph-mon[31212]: pgmap v5141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:32.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9463.452058 secs 2024-04-21T13:02:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:31 smithi077 ceph-mon[27902]: pgmap v5141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9463.452058 secs 2024-04-21T13:02:32.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:31 smithi191 ceph-mon[31636]: pgmap v5141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:32.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9463.452058 secs 2024-04-21T13:02:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:33 smithi170 ceph-mon[31212]: pgmap v5142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9465.212196 secs 2024-04-21T13:02:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:33 smithi077 ceph-mon[27902]: pgmap v5142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9465.212196 secs 2024-04-21T13:02:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:33 smithi191 ceph-mon[31636]: pgmap v5142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9465.212196 secs 2024-04-21T13:02:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:35 smithi170 ceph-mon[31212]: pgmap v5143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:35 smithi077 ceph-mon[27902]: pgmap v5143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:35 smithi191 ceph-mon[31636]: pgmap v5143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9468.452154 secs 2024-04-21T13:02:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9468.452154 secs 2024-04-21T13:02:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9468.452154 secs 2024-04-21T13:02:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:37 smithi170 ceph-mon[31212]: pgmap v5144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:37 smithi077 ceph-mon[27902]: pgmap v5144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:37 smithi191 ceph-mon[31636]: pgmap v5144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9470.212322 secs 2024-04-21T13:02:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9470.212322 secs 2024-04-21T13:02:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9470.212322 secs 2024-04-21T13:02:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:40 smithi170 ceph-mon[31212]: pgmap v5145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:02:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:40 smithi077 ceph-mon[27902]: pgmap v5145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:02:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:40 smithi191 ceph-mon[31636]: pgmap v5145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:02:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:42 smithi170 ceph-mon[31212]: pgmap v5146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T13:02:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9473.452295 secs 2024-04-21T13:02:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:42 smithi077 ceph-mon[27902]: pgmap v5146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T13:02:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9473.452295 secs 2024-04-21T13:02:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:42 smithi191 ceph-mon[31636]: pgmap v5146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T13:02:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9473.452295 secs 2024-04-21T13:02:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:44 smithi170 ceph-mon[31212]: pgmap v5147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T13:02:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9475.212423 secs 2024-04-21T13:02:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:44 smithi077 ceph-mon[27902]: pgmap v5147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T13:02:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9475.212423 secs 2024-04-21T13:02:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:44 smithi191 ceph-mon[31636]: pgmap v5147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T13:02:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9475.212423 secs 2024-04-21T13:02:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:46 smithi170 ceph-mon[31212]: pgmap v5148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T13:02:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:46 smithi077 ceph-mon[27902]: pgmap v5148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T13:02:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:46 smithi191 ceph-mon[31636]: pgmap v5148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-21T13:02:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9478.452418 secs 2024-04-21T13:02:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9478.452418 secs 2024-04-21T13:02:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9478.452418 secs 2024-04-21T13:02:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:48 smithi170 ceph-mon[31212]: pgmap v5149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T13:02:48.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:48 smithi191 ceph-mon[31636]: pgmap v5149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T13:02:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:48 smithi077 ceph-mon[27902]: pgmap v5149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-04-21T13:02:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9480.212548 secs 2024-04-21T13:02:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9480.212548 secs 2024-04-21T13:02:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9480.212548 secs 2024-04-21T13:02:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:50 smithi170 ceph-mon[31212]: pgmap v5150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T13:02:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:50 smithi077 ceph-mon[27902]: pgmap v5150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T13:02:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:50 smithi191 ceph-mon[31636]: pgmap v5150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T13:02:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:52 smithi170 ceph-mon[31212]: pgmap v5151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T13:02:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9483.452536 secs 2024-04-21T13:02:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:52 smithi077 ceph-mon[27902]: pgmap v5151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T13:02:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9483.452536 secs 2024-04-21T13:02:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:52 smithi191 ceph-mon[31636]: pgmap v5151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T13:02:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9483.452536 secs 2024-04-21T13:02:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:54 smithi170 ceph-mon[31212]: pgmap v5152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9485.212679 secs 2024-04-21T13:02:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:54 smithi077 ceph-mon[27902]: pgmap v5152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9485.212679 secs 2024-04-21T13:02:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:54 smithi191 ceph-mon[31636]: pgmap v5152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9485.212679 secs 2024-04-21T13:02:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:02:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:56 smithi170 ceph-mon[31212]: pgmap v5153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:56 smithi077 ceph-mon[27902]: pgmap v5153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:56 smithi191 ceph-mon[31636]: pgmap v5153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:02:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:02:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9488.452609 secs 2024-04-21T13:02:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:02:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9488.452609 secs 2024-04-21T13:02:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:02:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9488.452609 secs 2024-04-21T13:02:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:58 smithi170 ceph-mon[31212]: pgmap v5154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:02:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:02:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:02:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:58 smithi077 ceph-mon[27902]: pgmap v5154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:02:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:02:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:02:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:58 smithi191 ceph-mon[31636]: pgmap v5154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:02:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:02:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:02:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:02:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:02:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9490.212743 secs 2024-04-21T13:02:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:02:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9490.212743 secs 2024-04-21T13:02:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:02:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9490.212743 secs 2024-04-21T13:03:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:00 smithi170 ceph-mon[31212]: pgmap v5155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:00 smithi077 ceph-mon[27902]: pgmap v5155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:00 smithi191 ceph-mon[31636]: pgmap v5155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:02 smithi170 ceph-mon[31212]: pgmap v5156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9493.452757 secs 2024-04-21T13:03:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:02 smithi077 ceph-mon[27902]: pgmap v5156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9493.452757 secs 2024-04-21T13:03:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:02 smithi191 ceph-mon[31636]: pgmap v5156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9493.452757 secs 2024-04-21T13:03:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:04 smithi170 ceph-mon[31212]: pgmap v5157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9495.212877 secs 2024-04-21T13:03:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:04 smithi077 ceph-mon[27902]: pgmap v5157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9495.212877 secs 2024-04-21T13:03:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:04 smithi191 ceph-mon[31636]: pgmap v5157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9495.212877 secs 2024-04-21T13:03:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:05 smithi077 ceph-mon[27902]: osdmap e395: 12 total, 12 up, 12 in 2024-04-21T13:03:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:05 smithi191 ceph-mon[31636]: osdmap e395: 12 total, 12 up, 12 in 2024-04-21T13:03:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:05 smithi170 ceph-mon[31212]: osdmap e395: 12 total, 12 up, 12 in 2024-04-21T13:03:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:06 smithi077 ceph-mon[27902]: pgmap v5159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:03:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:06 smithi191 ceph-mon[31636]: pgmap v5159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:03:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:06 smithi170 ceph-mon[31212]: pgmap v5159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:03:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9498.452880 secs 2024-04-21T13:03:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9498.452880 secs 2024-04-21T13:03:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9498.452880 secs 2024-04-21T13:03:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:08 smithi077 ceph-mon[27902]: pgmap v5160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:03:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:08 smithi191 ceph-mon[31636]: pgmap v5160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:03:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:08 smithi170 ceph-mon[31212]: pgmap v5160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:03:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:09 smithi170 ceph-mon[31212]: osdmap e396: 12 total, 12 up, 12 in 2024-04-21T13:03:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9500.213000 secs 2024-04-21T13:03:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:09 smithi077 ceph-mon[27902]: osdmap e396: 12 total, 12 up, 12 in 2024-04-21T13:03:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9500.213000 secs 2024-04-21T13:03:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:09 smithi191 ceph-mon[31636]: osdmap e396: 12 total, 12 up, 12 in 2024-04-21T13:03:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9500.213000 secs 2024-04-21T13:03:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:10 smithi170 ceph-mon[31212]: pgmap v5162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:03:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:10 smithi077 ceph-mon[27902]: pgmap v5162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:03:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:10 smithi191 ceph-mon[31636]: pgmap v5162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:03:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:12 smithi170 ceph-mon[31212]: pgmap v5163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:03:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9503.452947 secs 2024-04-21T13:03:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:12 smithi077 ceph-mon[27902]: pgmap v5163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:03:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9503.452947 secs 2024-04-21T13:03:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:12 smithi191 ceph-mon[31636]: pgmap v5163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:03:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9503.452947 secs 2024-04-21T13:03:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:14 smithi170 ceph-mon[31212]: pgmap v5164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:03:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9505.213130 secs 2024-04-21T13:03:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:14 smithi077 ceph-mon[27902]: pgmap v5164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:03:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9505.213130 secs 2024-04-21T13:03:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:14 smithi191 ceph-mon[31636]: pgmap v5164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:03:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9505.213130 secs 2024-04-21T13:03:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:16 smithi170 ceph-mon[31212]: pgmap v5165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:03:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:16 smithi077 ceph-mon[27902]: pgmap v5165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:03:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:16 smithi191 ceph-mon[31636]: pgmap v5165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:03:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9508.453015 secs 2024-04-21T13:03:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9508.453015 secs 2024-04-21T13:03:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9508.453015 secs 2024-04-21T13:03:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:18 smithi170 ceph-mon[31212]: pgmap v5166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:03:18.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:18 smithi191 ceph-mon[31636]: pgmap v5166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:03:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:18 smithi077 ceph-mon[27902]: pgmap v5166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:03:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9510.213198 secs 2024-04-21T13:03:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9510.213198 secs 2024-04-21T13:03:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9510.213198 secs 2024-04-21T13:03:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:20 smithi170 ceph-mon[31212]: pgmap v5167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:03:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:20 smithi077 ceph-mon[27902]: pgmap v5167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:03:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:20 smithi191 ceph-mon[31636]: pgmap v5167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:03:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:22 smithi170 ceph-mon[31212]: pgmap v5168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:03:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9513.453110 secs 2024-04-21T13:03:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:22 smithi077 ceph-mon[27902]: pgmap v5168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:03:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9513.453110 secs 2024-04-21T13:03:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:22 smithi191 ceph-mon[31636]: pgmap v5168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:03:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9513.453110 secs 2024-04-21T13:03:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:24 smithi170 ceph-mon[31212]: pgmap v5169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9515.213276 secs 2024-04-21T13:03:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:24 smithi077 ceph-mon[27902]: pgmap v5169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9515.213276 secs 2024-04-21T13:03:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:24 smithi191 ceph-mon[31636]: pgmap v5169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9515.213276 secs 2024-04-21T13:03:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:26 smithi170 ceph-mon[31212]: pgmap v5170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:26 smithi077 ceph-mon[27902]: pgmap v5170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:26 smithi191 ceph-mon[31636]: pgmap v5170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:27.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9518.453234 secs 2024-04-21T13:03:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9518.453234 secs 2024-04-21T13:03:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9518.453234 secs 2024-04-21T13:03:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:28 smithi170 ceph-mon[31212]: pgmap v5171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:28 smithi077 ceph-mon[27902]: pgmap v5171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:28 smithi191 ceph-mon[31636]: pgmap v5171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9520.213398 secs 2024-04-21T13:03:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9520.213398 secs 2024-04-21T13:03:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9520.213398 secs 2024-04-21T13:03:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:30 smithi170 ceph-mon[31212]: pgmap v5172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:30 smithi077 ceph-mon[27902]: pgmap v5172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:30 smithi191 ceph-mon[31636]: pgmap v5172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:32 smithi170 ceph-mon[31212]: pgmap v5173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9523.453334 secs 2024-04-21T13:03:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:32 smithi077 ceph-mon[27902]: pgmap v5173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9523.453334 secs 2024-04-21T13:03:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:32 smithi191 ceph-mon[31636]: pgmap v5173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9523.453334 secs 2024-04-21T13:03:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:34 smithi170 ceph-mon[31212]: pgmap v5174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9525.213472 secs 2024-04-21T13:03:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:34 smithi077 ceph-mon[27902]: pgmap v5174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9525.213472 secs 2024-04-21T13:03:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:34 smithi191 ceph-mon[31636]: pgmap v5174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9525.213472 secs 2024-04-21T13:03:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:36 smithi170 ceph-mon[31212]: pgmap v5175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:36 smithi077 ceph-mon[27902]: pgmap v5175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:36 smithi191 ceph-mon[31636]: pgmap v5175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9528.453454 secs 2024-04-21T13:03:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9528.453454 secs 2024-04-21T13:03:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9528.453454 secs 2024-04-21T13:03:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:38 smithi170 ceph-mon[31212]: pgmap v5176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:38 smithi077 ceph-mon[27902]: pgmap v5176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:38 smithi191 ceph-mon[31636]: pgmap v5176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9530.213566 secs 2024-04-21T13:03:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9530.213566 secs 2024-04-21T13:03:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9530.213566 secs 2024-04-21T13:03:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:40 smithi077 ceph-mon[27902]: pgmap v5177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:40 smithi191 ceph-mon[31636]: pgmap v5177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:40 smithi170 ceph-mon[31212]: pgmap v5177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:42 smithi077 ceph-mon[27902]: pgmap v5178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9533.453581 secs 2024-04-21T13:03:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:42 smithi191 ceph-mon[31636]: pgmap v5178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9533.453581 secs 2024-04-21T13:03:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:42 smithi170 ceph-mon[31212]: pgmap v5178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9533.453581 secs 2024-04-21T13:03:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:44 smithi077 ceph-mon[27902]: pgmap v5179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9535.213701 secs 2024-04-21T13:03:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:44 smithi191 ceph-mon[31636]: pgmap v5179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9535.213701 secs 2024-04-21T13:03:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:44 smithi170 ceph-mon[31212]: pgmap v5179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9535.213701 secs 2024-04-21T13:03:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:46 smithi077 ceph-mon[27902]: pgmap v5180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:46 smithi191 ceph-mon[31636]: pgmap v5180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:46 smithi170 ceph-mon[31212]: pgmap v5180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9538.453749 secs 2024-04-21T13:03:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9538.453749 secs 2024-04-21T13:03:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9538.453749 secs 2024-04-21T13:03:48.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:48 smithi191 ceph-mon[31636]: pgmap v5181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:48 smithi077 ceph-mon[27902]: pgmap v5181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:48.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:48 smithi170 ceph-mon[31212]: pgmap v5181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9540.213852 secs 2024-04-21T13:03:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9540.213852 secs 2024-04-21T13:03:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9540.213852 secs 2024-04-21T13:03:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:50 smithi077 ceph-mon[27902]: pgmap v5182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:50 smithi191 ceph-mon[31636]: pgmap v5182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:50 smithi170 ceph-mon[31212]: pgmap v5182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:52 smithi077 ceph-mon[27902]: pgmap v5183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9543.453868 secs 2024-04-21T13:03:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:52 smithi191 ceph-mon[31636]: pgmap v5183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9543.453868 secs 2024-04-21T13:03:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:52 smithi170 ceph-mon[31212]: pgmap v5183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9543.453868 secs 2024-04-21T13:03:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:54 smithi077 ceph-mon[27902]: pgmap v5184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9545.213893 secs 2024-04-21T13:03:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:54 smithi191 ceph-mon[31636]: pgmap v5184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9545.213893 secs 2024-04-21T13:03:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:54 smithi170 ceph-mon[31212]: pgmap v5184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9545.213893 secs 2024-04-21T13:03:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:03:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:56 smithi077 ceph-mon[27902]: pgmap v5185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:56 smithi191 ceph-mon[31636]: pgmap v5185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:56 smithi170 ceph-mon[31212]: pgmap v5185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:03:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9548.453992 secs 2024-04-21T13:03:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9548.453992 secs 2024-04-21T13:03:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9548.453992 secs 2024-04-21T13:03:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:58 smithi077 ceph-mon[27902]: pgmap v5186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:03:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:03:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:03:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:03:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:58 smithi191 ceph-mon[31636]: pgmap v5186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:03:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:03:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:03:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:03:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:58 smithi170 ceph-mon[31212]: pgmap v5186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:03:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:03:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:03:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:03:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:03:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:03:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9550.213972 secs 2024-04-21T13:03:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:03:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9550.213972 secs 2024-04-21T13:03:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:03:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9550.213972 secs 2024-04-21T13:04:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:00 smithi077 ceph-mon[27902]: pgmap v5187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:00 smithi191 ceph-mon[31636]: pgmap v5187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:00 smithi170 ceph-mon[31212]: pgmap v5187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:02 smithi077 ceph-mon[27902]: pgmap v5188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9553.454119 secs 2024-04-21T13:04:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:02 smithi191 ceph-mon[31636]: pgmap v5188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9553.454119 secs 2024-04-21T13:04:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:02 smithi170 ceph-mon[31212]: pgmap v5188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9553.454119 secs 2024-04-21T13:04:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:04 smithi077 ceph-mon[27902]: pgmap v5189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9555.214093 secs 2024-04-21T13:04:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:04 smithi077 ceph-mon[27902]: osdmap e397: 12 total, 12 up, 12 in 2024-04-21T13:04:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:04 smithi191 ceph-mon[31636]: pgmap v5189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9555.214093 secs 2024-04-21T13:04:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:04 smithi191 ceph-mon[31636]: osdmap e397: 12 total, 12 up, 12 in 2024-04-21T13:04:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:04 smithi170 ceph-mon[31212]: pgmap v5189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9555.214093 secs 2024-04-21T13:04:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:04 smithi170 ceph-mon[31212]: osdmap e397: 12 total, 12 up, 12 in 2024-04-21T13:04:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:06 smithi077 ceph-mon[27902]: pgmap v5191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:04:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:06 smithi191 ceph-mon[31636]: pgmap v5191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:04:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:06 smithi170 ceph-mon[31212]: pgmap v5191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:04:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9558.454247 secs 2024-04-21T13:04:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9558.454247 secs 2024-04-21T13:04:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9558.454247 secs 2024-04-21T13:04:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:08 smithi077 ceph-mon[27902]: pgmap v5192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:04:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:08 smithi077 ceph-mon[27902]: osdmap e398: 12 total, 12 up, 12 in 2024-04-21T13:04:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:08 smithi191 ceph-mon[31636]: pgmap v5192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:04:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:08 smithi191 ceph-mon[31636]: osdmap e398: 12 total, 12 up, 12 in 2024-04-21T13:04:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:08 smithi170 ceph-mon[31212]: pgmap v5192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:04:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:08 smithi170 ceph-mon[31212]: osdmap e398: 12 total, 12 up, 12 in 2024-04-21T13:04:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9560.214413 secs 2024-04-21T13:04:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9560.214413 secs 2024-04-21T13:04:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9560.214413 secs 2024-04-21T13:04:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:10 smithi191 ceph-mon[31636]: pgmap v5194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:04:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:10 smithi170 ceph-mon[31212]: pgmap v5194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:04:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:10 smithi077 ceph-mon[27902]: pgmap v5194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:04:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:12 smithi191 ceph-mon[31636]: pgmap v5195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:04:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9563.454353 secs 2024-04-21T13:04:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:12 smithi170 ceph-mon[31212]: pgmap v5195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:04:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9563.454353 secs 2024-04-21T13:04:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:12 smithi077 ceph-mon[27902]: pgmap v5195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:04:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9563.454353 secs 2024-04-21T13:04:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:14 smithi191 ceph-mon[31636]: pgmap v5196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:04:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9565.214453 secs 2024-04-21T13:04:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:14 smithi170 ceph-mon[31212]: pgmap v5196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:04:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9565.214453 secs 2024-04-21T13:04:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:14 smithi077 ceph-mon[27902]: pgmap v5196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:04:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9565.214453 secs 2024-04-21T13:04:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:16 smithi191 ceph-mon[31636]: pgmap v5197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:04:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:16 smithi170 ceph-mon[31212]: pgmap v5197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:04:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:16 smithi077 ceph-mon[27902]: pgmap v5197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:04:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9568.454499 secs 2024-04-21T13:04:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9568.454499 secs 2024-04-21T13:04:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9568.454499 secs 2024-04-21T13:04:18.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:18 smithi170 ceph-mon[31212]: pgmap v5198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:04:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:18 smithi191 ceph-mon[31636]: pgmap v5198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:04:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:18 smithi077 ceph-mon[27902]: pgmap v5198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:04:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9570.214587 secs 2024-04-21T13:04:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9570.214587 secs 2024-04-21T13:04:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9570.214587 secs 2024-04-21T13:04:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:20 smithi191 ceph-mon[31636]: pgmap v5199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:04:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:20 smithi170 ceph-mon[31212]: pgmap v5199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:04:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:20 smithi077 ceph-mon[27902]: pgmap v5199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:04:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:22 smithi191 ceph-mon[31636]: pgmap v5200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:04:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9573.454614 secs 2024-04-21T13:04:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:22 smithi170 ceph-mon[31212]: pgmap v5200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:04:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9573.454614 secs 2024-04-21T13:04:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:22 smithi077 ceph-mon[27902]: pgmap v5200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:04:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9573.454614 secs 2024-04-21T13:04:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:24 smithi191 ceph-mon[31636]: pgmap v5201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9575.214715 secs 2024-04-21T13:04:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:24 smithi170 ceph-mon[31212]: pgmap v5201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9575.214715 secs 2024-04-21T13:04:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:24 smithi077 ceph-mon[27902]: pgmap v5201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9575.214715 secs 2024-04-21T13:04:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:26 smithi191 ceph-mon[31636]: pgmap v5202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:26 smithi170 ceph-mon[31212]: pgmap v5202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:26 smithi077 ceph-mon[27902]: pgmap v5202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9578.454736 secs 2024-04-21T13:04:27.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9578.454736 secs 2024-04-21T13:04:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9578.454736 secs 2024-04-21T13:04:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:28 smithi191 ceph-mon[31636]: pgmap v5203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:28 smithi170 ceph-mon[31212]: pgmap v5203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:28 smithi077 ceph-mon[27902]: pgmap v5203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9580.214831 secs 2024-04-21T13:04:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9580.214831 secs 2024-04-21T13:04:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9580.214831 secs 2024-04-21T13:04:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:30 smithi191 ceph-mon[31636]: pgmap v5204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:30 smithi170 ceph-mon[31212]: pgmap v5204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:30 smithi077 ceph-mon[27902]: pgmap v5204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:32 smithi191 ceph-mon[31636]: pgmap v5205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9583.454785 secs 2024-04-21T13:04:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:32 smithi170 ceph-mon[31212]: pgmap v5205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9583.454785 secs 2024-04-21T13:04:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:32 smithi077 ceph-mon[27902]: pgmap v5205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9583.454785 secs 2024-04-21T13:04:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:34 smithi191 ceph-mon[31636]: pgmap v5206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9585.214951 secs 2024-04-21T13:04:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:34 smithi170 ceph-mon[31212]: pgmap v5206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9585.214951 secs 2024-04-21T13:04:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:34 smithi077 ceph-mon[27902]: pgmap v5206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9585.214951 secs 2024-04-21T13:04:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:36 smithi191 ceph-mon[31636]: pgmap v5207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:36 smithi170 ceph-mon[31212]: pgmap v5207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:36 smithi077 ceph-mon[27902]: pgmap v5207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9588.454883 secs 2024-04-21T13:04:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9588.454883 secs 2024-04-21T13:04:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9588.454883 secs 2024-04-21T13:04:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:38 smithi191 ceph-mon[31636]: pgmap v5208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:38 smithi170 ceph-mon[31212]: pgmap v5208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:38 smithi077 ceph-mon[27902]: pgmap v5208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9590.215064 secs 2024-04-21T13:04:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9590.215064 secs 2024-04-21T13:04:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9590.215064 secs 2024-04-21T13:04:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:40 smithi191 ceph-mon[31636]: pgmap v5209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:40 smithi170 ceph-mon[31212]: pgmap v5209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:40 smithi077 ceph-mon[27902]: pgmap v5209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:42 smithi191 ceph-mon[31636]: pgmap v5210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9593.454979 secs 2024-04-21T13:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:42 smithi170 ceph-mon[31212]: pgmap v5210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9593.454979 secs 2024-04-21T13:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:42 smithi077 ceph-mon[27902]: pgmap v5210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9593.454979 secs 2024-04-21T13:04:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:44 smithi170 ceph-mon[31212]: pgmap v5211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9595.215187 secs 2024-04-21T13:04:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:44 smithi077 ceph-mon[27902]: pgmap v5211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9595.215187 secs 2024-04-21T13:04:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:44 smithi191 ceph-mon[31636]: pgmap v5211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9595.215187 secs 2024-04-21T13:04:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:46 smithi170 ceph-mon[31212]: pgmap v5212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:46 smithi077 ceph-mon[27902]: pgmap v5212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:46 smithi191 ceph-mon[31636]: pgmap v5212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9598.455051 secs 2024-04-21T13:04:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9598.455051 secs 2024-04-21T13:04:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9598.455051 secs 2024-04-21T13:04:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:48 smithi170 ceph-mon[31212]: pgmap v5213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:48 smithi191 ceph-mon[31636]: pgmap v5213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:48 smithi077 ceph-mon[27902]: pgmap v5213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9600.215244 secs 2024-04-21T13:04:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9600.215244 secs 2024-04-21T13:04:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9600.215244 secs 2024-04-21T13:04:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:50 smithi170 ceph-mon[31212]: pgmap v5214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:50 smithi077 ceph-mon[27902]: pgmap v5214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:50 smithi191 ceph-mon[31636]: pgmap v5214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:52 smithi170 ceph-mon[31212]: pgmap v5215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9603.455174 secs 2024-04-21T13:04:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:52 smithi077 ceph-mon[27902]: pgmap v5215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9603.455174 secs 2024-04-21T13:04:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:52 smithi191 ceph-mon[31636]: pgmap v5215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9603.455174 secs 2024-04-21T13:04:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:54 smithi170 ceph-mon[31212]: pgmap v5216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9605.215369 secs 2024-04-21T13:04:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:54 smithi077 ceph-mon[27902]: pgmap v5216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9605.215369 secs 2024-04-21T13:04:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:54 smithi191 ceph-mon[31636]: pgmap v5216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9605.215369 secs 2024-04-21T13:04:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:04:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:04:55.676+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:04:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:04:55.676+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:04:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:04:55.676+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:04:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:04:55.676+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:04:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:56 smithi170 ceph-mon[31212]: pgmap v5217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:56 smithi077 ceph-mon[27902]: pgmap v5217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:56 smithi191 ceph-mon[31636]: pgmap v5217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:04:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9608.455266 secs 2024-04-21T13:04:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9608.455266 secs 2024-04-21T13:04:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9608.455266 secs 2024-04-21T13:04:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:58 smithi170 ceph-mon[31212]: pgmap v5218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:04:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:58 smithi077 ceph-mon[27902]: pgmap v5218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:04:58.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:58 smithi191 ceph-mon[31636]: pgmap v5218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:04:58.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:04:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9610.215469 secs 2024-04-21T13:04:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:04:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9610.215469 secs 2024-04-21T13:04:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:04:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9610.215469 secs 2024-04-21T13:05:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: pgmap v5219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: pgmap v5219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: pgmap v5219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:05:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:05:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:05:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:05:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:05:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:05:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:05:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:05:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:05:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:05:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:05:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:05:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:05:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:02 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:05:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:02 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:05:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:02 smithi170 ceph-mon[31212]: pgmap v5220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9613.455330 secs 2024-04-21T13:05:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:02 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:05:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:02 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:05:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:02 smithi077 ceph-mon[27902]: pgmap v5220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9613.455330 secs 2024-04-21T13:05:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:02 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:05:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:02 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:05:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:02 smithi191 ceph-mon[31636]: pgmap v5220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9613.455330 secs 2024-04-21T13:05:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:04 smithi170 ceph-mon[31212]: pgmap v5221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:05:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9615.215599 secs 2024-04-21T13:05:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:04 smithi077 ceph-mon[27902]: pgmap v5221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:05:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9615.215599 secs 2024-04-21T13:05:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:04 smithi191 ceph-mon[31636]: pgmap v5221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:05:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9615.215599 secs 2024-04-21T13:05:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:06 smithi170 ceph-mon[31212]: pgmap v5222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:05:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:06 smithi077 ceph-mon[27902]: pgmap v5222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:05:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:06 smithi191 ceph-mon[31636]: pgmap v5222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:05:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9618.455467 secs 2024-04-21T13:05:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9618.455467 secs 2024-04-21T13:05:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9618.455467 secs 2024-04-21T13:05:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:08 smithi170 ceph-mon[31212]: pgmap v5223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:08 smithi077 ceph-mon[27902]: pgmap v5223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:08 smithi191 ceph-mon[31636]: pgmap v5223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9620.215695 secs 2024-04-21T13:05:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:09 smithi170 ceph-mon[31212]: pgmap v5224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T13:05:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9620.215695 secs 2024-04-21T13:05:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:09 smithi077 ceph-mon[27902]: pgmap v5224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T13:05:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9620.215695 secs 2024-04-21T13:05:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:09 smithi191 ceph-mon[31636]: pgmap v5224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T13:05:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:12 smithi170 ceph-mon[31212]: pgmap v5225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:12.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9623.455572 secs 2024-04-21T13:05:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:12 smithi077 ceph-mon[27902]: pgmap v5225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9623.455572 secs 2024-04-21T13:05:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:12 smithi191 ceph-mon[31636]: pgmap v5225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:05:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9623.455572 secs 2024-04-21T13:05:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:14 smithi170 ceph-mon[31212]: pgmap v5226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T13:05:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9625.215816 secs 2024-04-21T13:05:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:14 smithi077 ceph-mon[27902]: pgmap v5226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T13:05:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9625.215816 secs 2024-04-21T13:05:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:14 smithi191 ceph-mon[31636]: pgmap v5226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T13:05:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9625.215816 secs 2024-04-21T13:05:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:16 smithi170 ceph-mon[31212]: pgmap v5227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T13:05:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:16 smithi077 ceph-mon[27902]: pgmap v5227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T13:05:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:16 smithi191 ceph-mon[31636]: pgmap v5227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-21T13:05:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9628.455690 secs 2024-04-21T13:05:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9628.455690 secs 2024-04-21T13:05:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9628.455690 secs 2024-04-21T13:05:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:18 smithi170 ceph-mon[31212]: pgmap v5228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-21T13:05:18.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:18 smithi191 ceph-mon[31636]: pgmap v5228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-21T13:05:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:18 smithi077 ceph-mon[27902]: pgmap v5228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-21T13:05:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9630.215957 secs 2024-04-21T13:05:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9630.215957 secs 2024-04-21T13:05:19.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9630.215957 secs 2024-04-21T13:05:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:20 smithi170 ceph-mon[31212]: pgmap v5229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:20 smithi077 ceph-mon[27902]: pgmap v5229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:20 smithi191 ceph-mon[31636]: pgmap v5229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:22 smithi170 ceph-mon[31212]: pgmap v5230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:22.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9633.455830 secs 2024-04-21T13:05:22.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:22 smithi077 ceph-mon[27902]: pgmap v5230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9633.455830 secs 2024-04-21T13:05:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:22 smithi191 ceph-mon[31636]: pgmap v5230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9633.455830 secs 2024-04-21T13:05:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:24 smithi170 ceph-mon[31212]: pgmap v5231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9635.216039 secs 2024-04-21T13:05:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:24 smithi077 ceph-mon[27902]: pgmap v5231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9635.216039 secs 2024-04-21T13:05:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:24 smithi191 ceph-mon[31636]: pgmap v5231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9635.216039 secs 2024-04-21T13:05:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:26 smithi170 ceph-mon[31212]: pgmap v5232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:26 smithi077 ceph-mon[27902]: pgmap v5232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:26 smithi191 ceph-mon[31636]: pgmap v5232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9638.455904 secs 2024-04-21T13:05:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9638.455904 secs 2024-04-21T13:05:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9638.455904 secs 2024-04-21T13:05:28.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:28 smithi077 ceph-mon[27902]: pgmap v5233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:28 smithi170 ceph-mon[31212]: pgmap v5233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:28 smithi191 ceph-mon[31636]: pgmap v5233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9640.216175 secs 2024-04-21T13:05:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9640.216175 secs 2024-04-21T13:05:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9640.216175 secs 2024-04-21T13:05:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:30 smithi170 ceph-mon[31212]: pgmap v5234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:30 smithi077 ceph-mon[27902]: pgmap v5234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:30 smithi191 ceph-mon[31636]: pgmap v5234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:32 smithi077 ceph-mon[27902]: pgmap v5235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9643.456024 secs 2024-04-21T13:05:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:32 smithi191 ceph-mon[31636]: pgmap v5235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9643.456024 secs 2024-04-21T13:05:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:32 smithi170 ceph-mon[31212]: pgmap v5235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9643.456024 secs 2024-04-21T13:05:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:34 smithi077 ceph-mon[27902]: pgmap v5236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9645.216297 secs 2024-04-21T13:05:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:34 smithi191 ceph-mon[31636]: pgmap v5236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9645.216297 secs 2024-04-21T13:05:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:34 smithi170 ceph-mon[31212]: pgmap v5236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9645.216297 secs 2024-04-21T13:05:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:36 smithi077 ceph-mon[27902]: pgmap v5237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:36 smithi191 ceph-mon[31636]: pgmap v5237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:36 smithi170 ceph-mon[31212]: pgmap v5237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9648.456141 secs 2024-04-21T13:05:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9648.456141 secs 2024-04-21T13:05:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9648.456141 secs 2024-04-21T13:05:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:38 smithi077 ceph-mon[27902]: pgmap v5238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:38 smithi191 ceph-mon[31636]: pgmap v5238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:38 smithi170 ceph-mon[31212]: pgmap v5238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9650.216428 secs 2024-04-21T13:05:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9650.216428 secs 2024-04-21T13:05:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9650.216428 secs 2024-04-21T13:05:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:40 smithi077 ceph-mon[27902]: pgmap v5239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:40 smithi191 ceph-mon[31636]: pgmap v5239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:40 smithi170 ceph-mon[31212]: pgmap v5239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:40.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:05:40.681+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:05:40.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:05:40.681+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:05:40.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:05:40.682+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:05:40.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:05:40.682+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:05:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:42 smithi077 ceph-mon[27902]: pgmap v5240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9653.456258 secs 2024-04-21T13:05:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:42 smithi191 ceph-mon[31636]: pgmap v5240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9653.456258 secs 2024-04-21T13:05:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:42 smithi170 ceph-mon[31212]: pgmap v5240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9653.456258 secs 2024-04-21T13:05:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:44 smithi077 ceph-mon[27902]: pgmap v5241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9655.216490 secs 2024-04-21T13:05:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:44 smithi191 ceph-mon[31636]: pgmap v5241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9655.216490 secs 2024-04-21T13:05:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:44 smithi170 ceph-mon[31212]: pgmap v5241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9655.216490 secs 2024-04-21T13:05:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:46 smithi077 ceph-mon[27902]: pgmap v5242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:46 smithi191 ceph-mon[31636]: pgmap v5242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:46 smithi170 ceph-mon[31212]: pgmap v5242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9658.456360 secs 2024-04-21T13:05:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9658.456360 secs 2024-04-21T13:05:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9658.456360 secs 2024-04-21T13:05:48.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:48 smithi191 ceph-mon[31636]: pgmap v5243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:48 smithi077 ceph-mon[27902]: pgmap v5243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:48.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:48 smithi170 ceph-mon[31212]: pgmap v5243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9660.216630 secs 2024-04-21T13:05:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9660.216630 secs 2024-04-21T13:05:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9660.216630 secs 2024-04-21T13:05:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:50 smithi077 ceph-mon[27902]: pgmap v5244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:50 smithi191 ceph-mon[31636]: pgmap v5244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:50 smithi170 ceph-mon[31212]: pgmap v5244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:52 smithi077 ceph-mon[27902]: pgmap v5245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9663.456472 secs 2024-04-21T13:05:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:52 smithi191 ceph-mon[31636]: pgmap v5245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9663.456472 secs 2024-04-21T13:05:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:52 smithi170 ceph-mon[31212]: pgmap v5245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9663.456472 secs 2024-04-21T13:05:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:54 smithi077 ceph-mon[27902]: pgmap v5246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9665.216764 secs 2024-04-21T13:05:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:54 smithi191 ceph-mon[31636]: pgmap v5246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9665.216764 secs 2024-04-21T13:05:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:54 smithi170 ceph-mon[31212]: pgmap v5246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9665.216764 secs 2024-04-21T13:05:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:05:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:56 smithi077 ceph-mon[27902]: pgmap v5247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:56 smithi191 ceph-mon[31636]: pgmap v5247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:56 smithi170 ceph-mon[31212]: pgmap v5247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:05:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9668.456587 secs 2024-04-21T13:05:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9668.456587 secs 2024-04-21T13:05:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9668.456587 secs 2024-04-21T13:05:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:58 smithi077 ceph-mon[27902]: pgmap v5248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:58 smithi191 ceph-mon[31636]: pgmap v5248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:58 smithi170 ceph-mon[31212]: pgmap v5248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:05:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:05:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9670.216888 secs 2024-04-21T13:05:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:05:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9670.216888 secs 2024-04-21T13:05:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:05:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9670.216888 secs 2024-04-21T13:06:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:00 smithi077 ceph-mon[27902]: pgmap v5249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:00 smithi191 ceph-mon[31636]: pgmap v5249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:00 smithi170 ceph-mon[31212]: pgmap v5249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:06:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:06:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: pgmap v5250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9673.456732 secs 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:06:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: pgmap v5250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-04-21T13:06:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9673.456732 secs 2024-04-21T13:06:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:06:02.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:06:02.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: pgmap v5250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9673.456732 secs 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:06:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:06:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:04 smithi191 ceph-mon[31636]: pgmap v5251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-04-21T13:06:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9675.216982 secs 2024-04-21T13:06:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:04 smithi170 ceph-mon[31212]: pgmap v5251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-04-21T13:06:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9675.216982 secs 2024-04-21T13:06:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:04 smithi077 ceph-mon[27902]: pgmap v5251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-04-21T13:06:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9675.216982 secs 2024-04-21T13:06:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:05 smithi170 ceph-mon[31212]: osdmap e399: 12 total, 12 up, 12 in 2024-04-21T13:06:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:05 smithi077 ceph-mon[27902]: osdmap e399: 12 total, 12 up, 12 in 2024-04-21T13:06:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:05 smithi191 ceph-mon[31636]: osdmap e399: 12 total, 12 up, 12 in 2024-04-21T13:06:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:06 smithi170 ceph-mon[31212]: pgmap v5253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-04-21T13:06:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:06 smithi077 ceph-mon[27902]: pgmap v5253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-04-21T13:06:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:06 smithi191 ceph-mon[31636]: pgmap v5253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-04-21T13:06:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9678.456859 secs 2024-04-21T13:06:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9678.456859 secs 2024-04-21T13:06:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9678.456859 secs 2024-04-21T13:06:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:08 smithi170 ceph-mon[31212]: pgmap v5254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:06:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:08 smithi077 ceph-mon[27902]: pgmap v5254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:06:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:08 smithi191 ceph-mon[31636]: pgmap v5254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:06:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:09 smithi170 ceph-mon[31212]: osdmap e400: 12 total, 12 up, 12 in 2024-04-21T13:06:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9680.217066 secs 2024-04-21T13:06:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:09 smithi077 ceph-mon[27902]: osdmap e400: 12 total, 12 up, 12 in 2024-04-21T13:06:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9680.217066 secs 2024-04-21T13:06:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:09 smithi191 ceph-mon[31636]: osdmap e400: 12 total, 12 up, 12 in 2024-04-21T13:06:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9680.217066 secs 2024-04-21T13:06:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:10 smithi170 ceph-mon[31212]: pgmap v5256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-04-21T13:06:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:10 smithi077 ceph-mon[27902]: pgmap v5256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-04-21T13:06:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:10 smithi191 ceph-mon[31636]: pgmap v5256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-04-21T13:06:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:12 smithi170 ceph-mon[31212]: pgmap v5257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-04-21T13:06:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9683.456981 secs 2024-04-21T13:06:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:12 smithi077 ceph-mon[27902]: pgmap v5257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-04-21T13:06:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9683.456981 secs 2024-04-21T13:06:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:12 smithi191 ceph-mon[31636]: pgmap v5257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-04-21T13:06:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9683.456981 secs 2024-04-21T13:06:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:14 smithi170 ceph-mon[31212]: pgmap v5258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-04-21T13:06:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9685.217186 secs 2024-04-21T13:06:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:14 smithi077 ceph-mon[27902]: pgmap v5258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-04-21T13:06:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9685.217186 secs 2024-04-21T13:06:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:14 smithi191 ceph-mon[31636]: pgmap v5258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-04-21T13:06:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9685.217186 secs 2024-04-21T13:06:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:16 smithi170 ceph-mon[31212]: pgmap v5259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-04-21T13:06:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:16 smithi077 ceph-mon[27902]: pgmap v5259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-04-21T13:06:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:16 smithi191 ceph-mon[31636]: pgmap v5259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-04-21T13:06:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9688.457098 secs 2024-04-21T13:06:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9688.457098 secs 2024-04-21T13:06:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9688.457098 secs 2024-04-21T13:06:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:18 smithi170 ceph-mon[31212]: pgmap v5260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:06:18.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:18 smithi191 ceph-mon[31636]: pgmap v5260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:06:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:18 smithi077 ceph-mon[27902]: pgmap v5260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:06:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9690.217308 secs 2024-04-21T13:06:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9690.217308 secs 2024-04-21T13:06:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9690.217308 secs 2024-04-21T13:06:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:20 smithi170 ceph-mon[31212]: pgmap v5261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:06:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:20 smithi077 ceph-mon[27902]: pgmap v5261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:06:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:20 smithi191 ceph-mon[31636]: pgmap v5261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:06:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:22 smithi170 ceph-mon[31212]: pgmap v5262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:06:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9693.457192 secs 2024-04-21T13:06:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:22 smithi077 ceph-mon[27902]: pgmap v5262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:06:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9693.457192 secs 2024-04-21T13:06:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:22 smithi191 ceph-mon[31636]: pgmap v5262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:06:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9693.457192 secs 2024-04-21T13:06:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:24 smithi170 ceph-mon[31212]: pgmap v5263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9695.217384 secs 2024-04-21T13:06:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:24 smithi077 ceph-mon[27902]: pgmap v5263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9695.217384 secs 2024-04-21T13:06:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:24 smithi191 ceph-mon[31636]: pgmap v5263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9695.217384 secs 2024-04-21T13:06:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:26 smithi170 ceph-mon[31212]: pgmap v5264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:26 smithi077 ceph-mon[27902]: pgmap v5264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:26 smithi191 ceph-mon[31636]: pgmap v5264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9698.457309 secs 2024-04-21T13:06:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9698.457309 secs 2024-04-21T13:06:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9698.457309 secs 2024-04-21T13:06:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:28 smithi077 ceph-mon[27902]: pgmap v5265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:28 smithi191 ceph-mon[31636]: pgmap v5265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:28 smithi170 ceph-mon[31212]: pgmap v5265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9700.217496 secs 2024-04-21T13:06:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9700.217496 secs 2024-04-21T13:06:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9700.217496 secs 2024-04-21T13:06:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:30 smithi077 ceph-mon[27902]: pgmap v5266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:30 smithi191 ceph-mon[31636]: pgmap v5266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:30 smithi170 ceph-mon[31212]: pgmap v5266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:32 smithi077 ceph-mon[27902]: pgmap v5267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9703.457407 secs 2024-04-21T13:06:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:32 smithi191 ceph-mon[31636]: pgmap v5267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9703.457407 secs 2024-04-21T13:06:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:32 smithi170 ceph-mon[31212]: pgmap v5267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9703.457407 secs 2024-04-21T13:06:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:34 smithi077 ceph-mon[27902]: pgmap v5268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9705.217616 secs 2024-04-21T13:06:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:34 smithi191 ceph-mon[31636]: pgmap v5268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9705.217616 secs 2024-04-21T13:06:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:34 smithi170 ceph-mon[31212]: pgmap v5268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9705.217616 secs 2024-04-21T13:06:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:36 smithi077 ceph-mon[27902]: pgmap v5269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:36 smithi191 ceph-mon[31636]: pgmap v5269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:36 smithi170 ceph-mon[31212]: pgmap v5269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9708.457509 secs 2024-04-21T13:06:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9708.457509 secs 2024-04-21T13:06:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9708.457509 secs 2024-04-21T13:06:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:38 smithi077 ceph-mon[27902]: pgmap v5270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:38 smithi191 ceph-mon[31636]: pgmap v5270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:38 smithi170 ceph-mon[31212]: pgmap v5270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9710.217731 secs 2024-04-21T13:06:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9710.217731 secs 2024-04-21T13:06:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9710.217731 secs 2024-04-21T13:06:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:40 smithi077 ceph-mon[27902]: pgmap v5271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:40 smithi191 ceph-mon[31636]: pgmap v5271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:40 smithi170 ceph-mon[31212]: pgmap v5271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:42 smithi077 ceph-mon[27902]: pgmap v5272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9713.457611 secs 2024-04-21T13:06:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:42 smithi191 ceph-mon[31636]: pgmap v5272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9713.457611 secs 2024-04-21T13:06:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:42 smithi170 ceph-mon[31212]: pgmap v5272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9713.457611 secs 2024-04-21T13:06:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:44 smithi077 ceph-mon[27902]: pgmap v5273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9715.217834 secs 2024-04-21T13:06:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:44 smithi191 ceph-mon[31636]: pgmap v5273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9715.217834 secs 2024-04-21T13:06:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:44 smithi170 ceph-mon[31212]: pgmap v5273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9715.217834 secs 2024-04-21T13:06:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:46 smithi077 ceph-mon[27902]: pgmap v5274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:46 smithi191 ceph-mon[31636]: pgmap v5274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:46 smithi170 ceph-mon[31212]: pgmap v5274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9718.457726 secs 2024-04-21T13:06:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9718.457726 secs 2024-04-21T13:06:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9718.457726 secs 2024-04-21T13:06:48.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:48 smithi191 ceph-mon[31636]: pgmap v5275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:48 smithi077 ceph-mon[27902]: pgmap v5275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:48.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:48 smithi170 ceph-mon[31212]: pgmap v5275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9720.217945 secs 2024-04-21T13:06:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9720.217945 secs 2024-04-21T13:06:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9720.217945 secs 2024-04-21T13:06:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:50 smithi077 ceph-mon[27902]: pgmap v5276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:50 smithi191 ceph-mon[31636]: pgmap v5276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:50 smithi170 ceph-mon[31212]: pgmap v5276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:52 smithi077 ceph-mon[27902]: pgmap v5277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9723.457847 secs 2024-04-21T13:06:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:52 smithi191 ceph-mon[31636]: pgmap v5277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9723.457847 secs 2024-04-21T13:06:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:52 smithi170 ceph-mon[31212]: pgmap v5277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9723.457847 secs 2024-04-21T13:06:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:54 smithi077 ceph-mon[27902]: pgmap v5278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9725.218067 secs 2024-04-21T13:06:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:54 smithi191 ceph-mon[31636]: pgmap v5278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9725.218067 secs 2024-04-21T13:06:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:54 smithi170 ceph-mon[31212]: pgmap v5278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9725.218067 secs 2024-04-21T13:06:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:06:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:56 smithi077 ceph-mon[27902]: pgmap v5279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:56 smithi191 ceph-mon[31636]: pgmap v5279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:56 smithi170 ceph-mon[31212]: pgmap v5279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:06:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9728.457932 secs 2024-04-21T13:06:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9728.457932 secs 2024-04-21T13:06:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9728.457932 secs 2024-04-21T13:06:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:58 smithi191 ceph-mon[31636]: pgmap v5280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:58 smithi170 ceph-mon[31212]: pgmap v5280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:58 smithi077 ceph-mon[27902]: pgmap v5280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:06:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:06:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9730.218181 secs 2024-04-21T13:06:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:06:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9730.218181 secs 2024-04-21T13:06:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:06:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9730.218181 secs 2024-04-21T13:07:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:00 smithi191 ceph-mon[31636]: pgmap v5281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:00 smithi170 ceph-mon[31212]: pgmap v5281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:00 smithi077 ceph-mon[27902]: pgmap v5281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:02 smithi191 ceph-mon[31636]: pgmap v5282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9733.458050 secs 2024-04-21T13:07:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:07:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:02 smithi170 ceph-mon[31212]: pgmap v5282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9733.458050 secs 2024-04-21T13:07:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:07:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:02 smithi077 ceph-mon[27902]: pgmap v5282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9733.458050 secs 2024-04-21T13:07:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:07:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:07:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:07:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:07:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:07:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:07:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:04 smithi170 ceph-mon[31212]: pgmap v5283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9735.218291 secs 2024-04-21T13:07:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:04 smithi170 ceph-mon[31212]: osdmap e401: 12 total, 12 up, 12 in 2024-04-21T13:07:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:04 smithi077 ceph-mon[27902]: pgmap v5283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9735.218291 secs 2024-04-21T13:07:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:04 smithi077 ceph-mon[27902]: osdmap e401: 12 total, 12 up, 12 in 2024-04-21T13:07:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:04 smithi191 ceph-mon[31636]: pgmap v5283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9735.218291 secs 2024-04-21T13:07:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:04 smithi191 ceph-mon[31636]: osdmap e401: 12 total, 12 up, 12 in 2024-04-21T13:07:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:06 smithi170 ceph-mon[31212]: pgmap v5285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:07:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:06 smithi077 ceph-mon[27902]: pgmap v5285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:07:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:06 smithi191 ceph-mon[31636]: pgmap v5285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:07:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9738.458157 secs 2024-04-21T13:07:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9738.458157 secs 2024-04-21T13:07:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9738.458157 secs 2024-04-21T13:07:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:08 smithi170 ceph-mon[31212]: pgmap v5286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:07:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:08 smithi170 ceph-mon[31212]: osdmap e402: 12 total, 12 up, 12 in 2024-04-21T13:07:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:08 smithi077 ceph-mon[27902]: pgmap v5286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:07:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:08 smithi077 ceph-mon[27902]: osdmap e402: 12 total, 12 up, 12 in 2024-04-21T13:07:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:08 smithi191 ceph-mon[31636]: pgmap v5286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:07:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:08 smithi191 ceph-mon[31636]: osdmap e402: 12 total, 12 up, 12 in 2024-04-21T13:07:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9740.218424 secs 2024-04-21T13:07:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9740.218424 secs 2024-04-21T13:07:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9740.218424 secs 2024-04-21T13:07:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:10 smithi170 ceph-mon[31212]: pgmap v5288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:07:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:10 smithi077 ceph-mon[27902]: pgmap v5288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:07:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:10 smithi191 ceph-mon[31636]: pgmap v5288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:07:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:12 smithi170 ceph-mon[31212]: pgmap v5289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:07:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9743.458303 secs 2024-04-21T13:07:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:12 smithi077 ceph-mon[27902]: pgmap v5289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:07:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9743.458303 secs 2024-04-21T13:07:12.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:12 smithi191 ceph-mon[31636]: pgmap v5289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:07:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9743.458303 secs 2024-04-21T13:07:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:14 smithi170 ceph-mon[31212]: pgmap v5290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:07:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9745.218556 secs 2024-04-21T13:07:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:14 smithi077 ceph-mon[27902]: pgmap v5290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:07:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9745.218556 secs 2024-04-21T13:07:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:14 smithi191 ceph-mon[31636]: pgmap v5290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:07:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9745.218556 secs 2024-04-21T13:07:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:15 smithi170 ceph-mon[31212]: pgmap v5291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:07:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:15 smithi077 ceph-mon[27902]: pgmap v5291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:07:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:15 smithi191 ceph-mon[31636]: pgmap v5291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:07:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9748.458421 secs 2024-04-21T13:07:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9748.458421 secs 2024-04-21T13:07:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9748.458421 secs 2024-04-21T13:07:18.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:17 smithi170 ceph-mon[31212]: pgmap v5292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:07:18.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:17 smithi191 ceph-mon[31636]: pgmap v5292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:07:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:17 smithi077 ceph-mon[27902]: pgmap v5292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:07:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9750.218671 secs 2024-04-21T13:07:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9750.218671 secs 2024-04-21T13:07:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9750.218671 secs 2024-04-21T13:07:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:20 smithi170 ceph-mon[31212]: pgmap v5293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:07:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:20 smithi077 ceph-mon[27902]: pgmap v5293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:07:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:20 smithi191 ceph-mon[31636]: pgmap v5293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:07:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:22 smithi170 ceph-mon[31212]: pgmap v5294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:07:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9753.458540 secs 2024-04-21T13:07:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:22 smithi077 ceph-mon[27902]: pgmap v5294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:07:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9753.458540 secs 2024-04-21T13:07:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:22 smithi191 ceph-mon[31636]: pgmap v5294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:07:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9753.458540 secs 2024-04-21T13:07:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:24 smithi170 ceph-mon[31212]: pgmap v5295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9755.218816 secs 2024-04-21T13:07:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:24 smithi077 ceph-mon[27902]: pgmap v5295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9755.218816 secs 2024-04-21T13:07:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:24 smithi191 ceph-mon[31636]: pgmap v5295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9755.218816 secs 2024-04-21T13:07:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:26 smithi170 ceph-mon[31212]: pgmap v5296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:26 smithi077 ceph-mon[27902]: pgmap v5296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:26 smithi191 ceph-mon[31636]: pgmap v5296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9758.458660 secs 2024-04-21T13:07:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9758.458660 secs 2024-04-21T13:07:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9758.458660 secs 2024-04-21T13:07:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:28 smithi077 ceph-mon[27902]: pgmap v5297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:28 smithi191 ceph-mon[31636]: pgmap v5297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:28 smithi170 ceph-mon[31212]: pgmap v5297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9760.218936 secs 2024-04-21T13:07:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9760.218936 secs 2024-04-21T13:07:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9760.218936 secs 2024-04-21T13:07:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:30 smithi077 ceph-mon[27902]: pgmap v5298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:30 smithi191 ceph-mon[31636]: pgmap v5298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:30 smithi170 ceph-mon[31212]: pgmap v5298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:32 smithi077 ceph-mon[27902]: pgmap v5299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9763.458775 secs 2024-04-21T13:07:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:32 smithi191 ceph-mon[31636]: pgmap v5299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9763.458775 secs 2024-04-21T13:07:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:32 smithi170 ceph-mon[31212]: pgmap v5299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9763.458775 secs 2024-04-21T13:07:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:34 smithi077 ceph-mon[27902]: pgmap v5300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9765.219054 secs 2024-04-21T13:07:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:34 smithi191 ceph-mon[31636]: pgmap v5300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9765.219054 secs 2024-04-21T13:07:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:34 smithi170 ceph-mon[31212]: pgmap v5300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9765.219054 secs 2024-04-21T13:07:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:36 smithi077 ceph-mon[27902]: pgmap v5301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:36 smithi191 ceph-mon[31636]: pgmap v5301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:36 smithi170 ceph-mon[31212]: pgmap v5301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9768.458888 secs 2024-04-21T13:07:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9768.458888 secs 2024-04-21T13:07:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9768.458888 secs 2024-04-21T13:07:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:38 smithi077 ceph-mon[27902]: pgmap v5302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:38 smithi191 ceph-mon[31636]: pgmap v5302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:38 smithi170 ceph-mon[31212]: pgmap v5302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9770.219128 secs 2024-04-21T13:07:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9770.219128 secs 2024-04-21T13:07:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9770.219128 secs 2024-04-21T13:07:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:40 smithi077 ceph-mon[27902]: pgmap v5303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:40 smithi191 ceph-mon[31636]: pgmap v5303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:40 smithi170 ceph-mon[31212]: pgmap v5303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:42 smithi077 ceph-mon[27902]: pgmap v5304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9773.459003 secs 2024-04-21T13:07:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:42 smithi191 ceph-mon[31636]: pgmap v5304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9773.459003 secs 2024-04-21T13:07:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:42 smithi170 ceph-mon[31212]: pgmap v5304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9773.459003 secs 2024-04-21T13:07:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:44 smithi077 ceph-mon[27902]: pgmap v5305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9775.219240 secs 2024-04-21T13:07:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:44 smithi191 ceph-mon[31636]: pgmap v5305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9775.219240 secs 2024-04-21T13:07:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:44 smithi170 ceph-mon[31212]: pgmap v5305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9775.219240 secs 2024-04-21T13:07:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:46 smithi077 ceph-mon[27902]: pgmap v5306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:46 smithi191 ceph-mon[31636]: pgmap v5306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:46 smithi170 ceph-mon[31212]: pgmap v5306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9778.459079 secs 2024-04-21T13:07:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9778.459079 secs 2024-04-21T13:07:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9778.459079 secs 2024-04-21T13:07:48.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:48 smithi191 ceph-mon[31636]: pgmap v5307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:48 smithi077 ceph-mon[27902]: pgmap v5307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:48.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:48 smithi170 ceph-mon[31212]: pgmap v5307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9780.219360 secs 2024-04-21T13:07:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9780.219360 secs 2024-04-21T13:07:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9780.219360 secs 2024-04-21T13:07:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:50 smithi077 ceph-mon[27902]: pgmap v5308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:50 smithi191 ceph-mon[31636]: pgmap v5308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:50 smithi170 ceph-mon[31212]: pgmap v5308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:52 smithi077 ceph-mon[27902]: pgmap v5309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9783.459196 secs 2024-04-21T13:07:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:52 smithi191 ceph-mon[31636]: pgmap v5309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9783.459196 secs 2024-04-21T13:07:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:52 smithi170 ceph-mon[31212]: pgmap v5309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9783.459196 secs 2024-04-21T13:07:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:54 smithi077 ceph-mon[27902]: pgmap v5310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9785.219467 secs 2024-04-21T13:07:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:54 smithi191 ceph-mon[31636]: pgmap v5310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9785.219467 secs 2024-04-21T13:07:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:54 smithi170 ceph-mon[31212]: pgmap v5310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9785.219467 secs 2024-04-21T13:07:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:07:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:07:55.700+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:07:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:07:55.700+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:07:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:07:55.701+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:07:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:07:55.701+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:07:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:56 smithi191 ceph-mon[31636]: pgmap v5311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:56 smithi170 ceph-mon[31212]: pgmap v5311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:56 smithi077 ceph-mon[27902]: pgmap v5311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:07:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9788.459313 secs 2024-04-21T13:07:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9788.459313 secs 2024-04-21T13:07:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9788.459313 secs 2024-04-21T13:07:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:58 smithi191 ceph-mon[31636]: pgmap v5312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:58 smithi170 ceph-mon[31212]: pgmap v5312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:58 smithi077 ceph-mon[27902]: pgmap v5312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:07:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9790.219577 secs 2024-04-21T13:07:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9790.219577 secs 2024-04-21T13:07:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9790.219577 secs 2024-04-21T13:08:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:00 smithi191 ceph-mon[31636]: pgmap v5313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:00 smithi170 ceph-mon[31212]: pgmap v5313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:00 smithi077 ceph-mon[27902]: pgmap v5313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:02 smithi191 ceph-mon[31636]: pgmap v5314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9793.459433 secs 2024-04-21T13:08:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:02 smithi170 ceph-mon[31212]: pgmap v5314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9793.459433 secs 2024-04-21T13:08:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:02 smithi077 ceph-mon[27902]: pgmap v5314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9793.459433 secs 2024-04-21T13:08:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:08:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:08:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:08:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:04 smithi191 ceph-mon[31636]: pgmap v5315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9795.219673 secs 2024-04-21T13:08:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:04 smithi191 ceph-mon[31636]: osdmap e403: 12 total, 12 up, 12 in 2024-04-21T13:08:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:08:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:08:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:08:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:04 smithi170 ceph-mon[31212]: pgmap v5315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9795.219673 secs 2024-04-21T13:08:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:04 smithi170 ceph-mon[31212]: osdmap e403: 12 total, 12 up, 12 in 2024-04-21T13:08:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:08:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:08:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:08:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:04 smithi077 ceph-mon[27902]: pgmap v5315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9795.219673 secs 2024-04-21T13:08:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:04 smithi077 ceph-mon[27902]: osdmap e403: 12 total, 12 up, 12 in 2024-04-21T13:08:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:08:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:08:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:08:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:06 smithi191 ceph-mon[31636]: pgmap v5317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:08:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:06 smithi170 ceph-mon[31212]: pgmap v5317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:08:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:06 smithi077 ceph-mon[27902]: pgmap v5317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:08:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9798.459548 secs 2024-04-21T13:08:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9798.459548 secs 2024-04-21T13:08:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9798.459548 secs 2024-04-21T13:08:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:08 smithi191 ceph-mon[31636]: pgmap v5318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:08:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:08 smithi191 ceph-mon[31636]: osdmap e404: 12 total, 12 up, 12 in 2024-04-21T13:08:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:08 smithi170 ceph-mon[31212]: pgmap v5318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:08:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:08 smithi170 ceph-mon[31212]: osdmap e404: 12 total, 12 up, 12 in 2024-04-21T13:08:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:08 smithi077 ceph-mon[27902]: pgmap v5318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:08:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:08 smithi077 ceph-mon[27902]: osdmap e404: 12 total, 12 up, 12 in 2024-04-21T13:08:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9800.219812 secs 2024-04-21T13:08:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9800.219812 secs 2024-04-21T13:08:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9800.219812 secs 2024-04-21T13:08:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:10 smithi191 ceph-mon[31636]: pgmap v5320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:08:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:10 smithi170 ceph-mon[31212]: pgmap v5320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:08:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:10 smithi077 ceph-mon[27902]: pgmap v5320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:08:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:12 smithi191 ceph-mon[31636]: pgmap v5321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:08:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9803.459687 secs 2024-04-21T13:08:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:12 smithi170 ceph-mon[31212]: pgmap v5321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:08:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9803.459687 secs 2024-04-21T13:08:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:12 smithi077 ceph-mon[27902]: pgmap v5321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:08:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9803.459687 secs 2024-04-21T13:08:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:14 smithi191 ceph-mon[31636]: pgmap v5322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:08:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9805.219928 secs 2024-04-21T13:08:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:14 smithi170 ceph-mon[31212]: pgmap v5322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:08:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9805.219928 secs 2024-04-21T13:08:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:14 smithi077 ceph-mon[27902]: pgmap v5322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:08:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9805.219928 secs 2024-04-21T13:08:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:16 smithi191 ceph-mon[31636]: pgmap v5323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:08:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:16 smithi170 ceph-mon[31212]: pgmap v5323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:08:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:16 smithi077 ceph-mon[27902]: pgmap v5323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:08:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9808.459749 secs 2024-04-21T13:08:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9808.459749 secs 2024-04-21T13:08:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9808.459749 secs 2024-04-21T13:08:18.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:18 smithi170 ceph-mon[31212]: pgmap v5324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:08:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:18 smithi191 ceph-mon[31636]: pgmap v5324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:08:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:18 smithi077 ceph-mon[27902]: pgmap v5324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:08:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9810.220012 secs 2024-04-21T13:08:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9810.220012 secs 2024-04-21T13:08:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9810.220012 secs 2024-04-21T13:08:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 9995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:20 smithi191 ceph-mon[31636]: pgmap v5325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:08:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:20 smithi170 ceph-mon[31212]: pgmap v5325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:08:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:20 smithi077 ceph-mon[27902]: pgmap v5325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:08:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:22 smithi191 ceph-mon[31636]: pgmap v5326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:08:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9813.459855 secs 2024-04-21T13:08:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:22 smithi170 ceph-mon[31212]: pgmap v5326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:08:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9813.459855 secs 2024-04-21T13:08:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:22 smithi077 ceph-mon[27902]: pgmap v5326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:08:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9813.459855 secs 2024-04-21T13:08:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:24 smithi191 ceph-mon[31636]: pgmap v5327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9815.220128 secs 2024-04-21T13:08:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:24 smithi170 ceph-mon[31212]: pgmap v5327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9815.220128 secs 2024-04-21T13:08:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:24 smithi077 ceph-mon[27902]: pgmap v5327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9815.220128 secs 2024-04-21T13:08:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:26 smithi191 ceph-mon[31636]: pgmap v5328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:26 smithi170 ceph-mon[31212]: pgmap v5328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:26 smithi077 ceph-mon[27902]: pgmap v5328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:27.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9818.459975 secs 2024-04-21T13:08:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9818.459975 secs 2024-04-21T13:08:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9818.459975 secs 2024-04-21T13:08:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:28 smithi170 ceph-mon[31212]: pgmap v5329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:28 smithi077 ceph-mon[27902]: pgmap v5329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:28 smithi191 ceph-mon[31636]: pgmap v5329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9820.220239 secs 2024-04-21T13:08:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9820.220239 secs 2024-04-21T13:08:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9820.220239 secs 2024-04-21T13:08:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:30 smithi170 ceph-mon[31212]: pgmap v5330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:30 smithi077 ceph-mon[27902]: pgmap v5330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:30 smithi191 ceph-mon[31636]: pgmap v5330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:32 smithi170 ceph-mon[31212]: pgmap v5331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9823.460084 secs 2024-04-21T13:08:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:32 smithi077 ceph-mon[27902]: pgmap v5331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9823.460084 secs 2024-04-21T13:08:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:32 smithi191 ceph-mon[31636]: pgmap v5331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9823.460084 secs 2024-04-21T13:08:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:34 smithi170 ceph-mon[31212]: pgmap v5332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9825.220332 secs 2024-04-21T13:08:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:34 smithi077 ceph-mon[27902]: pgmap v5332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9825.220332 secs 2024-04-21T13:08:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:34 smithi191 ceph-mon[31636]: pgmap v5332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9825.220332 secs 2024-04-21T13:08:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:36 smithi170 ceph-mon[31212]: pgmap v5333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:36 smithi077 ceph-mon[27902]: pgmap v5333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:36 smithi191 ceph-mon[31636]: pgmap v5333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9828.460208 secs 2024-04-21T13:08:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9828.460208 secs 2024-04-21T13:08:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9828.460208 secs 2024-04-21T13:08:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:38 smithi170 ceph-mon[31212]: pgmap v5334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:38 smithi077 ceph-mon[27902]: pgmap v5334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:38 smithi191 ceph-mon[31636]: pgmap v5334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9830.220450 secs 2024-04-21T13:08:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9830.220450 secs 2024-04-21T13:08:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9830.220450 secs 2024-04-21T13:08:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:40 smithi170 ceph-mon[31212]: pgmap v5335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:40 smithi077 ceph-mon[27902]: pgmap v5335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:40 smithi191 ceph-mon[31636]: pgmap v5335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:42 smithi170 ceph-mon[31212]: pgmap v5336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9833.460319 secs 2024-04-21T13:08:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:42 smithi077 ceph-mon[27902]: pgmap v5336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9833.460319 secs 2024-04-21T13:08:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:42 smithi191 ceph-mon[31636]: pgmap v5336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9833.460319 secs 2024-04-21T13:08:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:44 smithi170 ceph-mon[31212]: pgmap v5337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9835.220583 secs 2024-04-21T13:08:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:44 smithi077 ceph-mon[27902]: pgmap v5337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9835.220583 secs 2024-04-21T13:08:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:44 smithi191 ceph-mon[31636]: pgmap v5337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9835.220583 secs 2024-04-21T13:08:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:46 smithi170 ceph-mon[31212]: pgmap v5338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:46 smithi077 ceph-mon[27902]: pgmap v5338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:46 smithi191 ceph-mon[31636]: pgmap v5338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9838.460432 secs 2024-04-21T13:08:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9838.460432 secs 2024-04-21T13:08:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9838.460432 secs 2024-04-21T13:08:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:48 smithi170 ceph-mon[31212]: pgmap v5339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:48 smithi191 ceph-mon[31636]: pgmap v5339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:48 smithi077 ceph-mon[27902]: pgmap v5339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9840.220713 secs 2024-04-21T13:08:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9840.220713 secs 2024-04-21T13:08:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9840.220713 secs 2024-04-21T13:08:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:50 smithi170 ceph-mon[31212]: pgmap v5340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:50 smithi077 ceph-mon[27902]: pgmap v5340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:50 smithi191 ceph-mon[31636]: pgmap v5340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:52 smithi170 ceph-mon[31212]: pgmap v5341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9843.460532 secs 2024-04-21T13:08:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:52 smithi077 ceph-mon[27902]: pgmap v5341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9843.460532 secs 2024-04-21T13:08:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:52 smithi191 ceph-mon[31636]: pgmap v5341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9843.460532 secs 2024-04-21T13:08:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:54 smithi170 ceph-mon[31212]: pgmap v5342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9845.220848 secs 2024-04-21T13:08:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:54 smithi077 ceph-mon[27902]: pgmap v5342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9845.220848 secs 2024-04-21T13:08:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:54 smithi191 ceph-mon[31636]: pgmap v5342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9845.220848 secs 2024-04-21T13:08:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:08:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:56 smithi170 ceph-mon[31212]: pgmap v5343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:56 smithi077 ceph-mon[27902]: pgmap v5343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:56.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:56 smithi191 ceph-mon[31636]: pgmap v5343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:08:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9848.460673 secs 2024-04-21T13:08:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9848.460673 secs 2024-04-21T13:08:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9848.460673 secs 2024-04-21T13:08:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:58 smithi170 ceph-mon[31212]: pgmap v5344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:58 smithi077 ceph-mon[27902]: pgmap v5344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:58 smithi191 ceph-mon[31636]: pgmap v5344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:08:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9850.220959 secs 2024-04-21T13:08:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9850.220959 secs 2024-04-21T13:08:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9850.220959 secs 2024-04-21T13:09:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:00 smithi170 ceph-mon[31212]: pgmap v5345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:00 smithi077 ceph-mon[27902]: pgmap v5345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:00 smithi191 ceph-mon[31636]: pgmap v5345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:02 smithi170 ceph-mon[31212]: pgmap v5346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9853.460811 secs 2024-04-21T13:09:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:02 smithi077 ceph-mon[27902]: pgmap v5346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9853.460811 secs 2024-04-21T13:09:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:02 smithi191 ceph-mon[31636]: pgmap v5346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9853.460811 secs 2024-04-21T13:09:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:04 smithi077 ceph-mon[27902]: pgmap v5347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9855.221091 secs 2024-04-21T13:09:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:04 smithi077 ceph-mon[27902]: osdmap e405: 12 total, 12 up, 12 in 2024-04-21T13:09:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:09:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:04 smithi191 ceph-mon[31636]: pgmap v5347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9855.221091 secs 2024-04-21T13:09:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:04 smithi191 ceph-mon[31636]: osdmap e405: 12 total, 12 up, 12 in 2024-04-21T13:09:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:09:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:04 smithi170 ceph-mon[31212]: pgmap v5347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9855.221091 secs 2024-04-21T13:09:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:04 smithi170 ceph-mon[31212]: osdmap e405: 12 total, 12 up, 12 in 2024-04-21T13:09:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:09:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:09:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:09:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:09:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:09:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:09:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:09:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:09:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:09:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:09:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:06 smithi077 ceph-mon[27902]: pgmap v5349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:09:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:06 smithi191 ceph-mon[31636]: pgmap v5349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:09:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:06 smithi170 ceph-mon[31212]: pgmap v5349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:09:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9858.460951 secs 2024-04-21T13:09:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9858.460951 secs 2024-04-21T13:09:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9858.460951 secs 2024-04-21T13:09:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:08 smithi077 ceph-mon[27902]: pgmap v5350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:09:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:08 smithi077 ceph-mon[27902]: osdmap e406: 12 total, 12 up, 12 in 2024-04-21T13:09:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:08 smithi191 ceph-mon[31636]: pgmap v5350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:09:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:08 smithi191 ceph-mon[31636]: osdmap e406: 12 total, 12 up, 12 in 2024-04-21T13:09:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:08 smithi170 ceph-mon[31212]: pgmap v5350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:09:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:08 smithi170 ceph-mon[31212]: osdmap e406: 12 total, 12 up, 12 in 2024-04-21T13:09:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9860.221173 secs 2024-04-21T13:09:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:09 smithi077 ceph-mon[27902]: pgmap v5352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:09:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9860.221173 secs 2024-04-21T13:09:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:09 smithi191 ceph-mon[31636]: pgmap v5352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:09:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9860.221173 secs 2024-04-21T13:09:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:09 smithi170 ceph-mon[31212]: pgmap v5352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:09:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:12 smithi077 ceph-mon[27902]: pgmap v5353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:09:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9863.461064 secs 2024-04-21T13:09:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:12 smithi191 ceph-mon[31636]: pgmap v5353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:09:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9863.461064 secs 2024-04-21T13:09:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:12 smithi170 ceph-mon[31212]: pgmap v5353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:09:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9863.461064 secs 2024-04-21T13:09:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:14 smithi077 ceph-mon[27902]: pgmap v5354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:09:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9865.221254 secs 2024-04-21T13:09:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:14 smithi191 ceph-mon[31636]: pgmap v5354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:09:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9865.221254 secs 2024-04-21T13:09:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:14 smithi170 ceph-mon[31212]: pgmap v5354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T13:09:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9865.221254 secs 2024-04-21T13:09:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:16 smithi077 ceph-mon[27902]: pgmap v5355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:09:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:16 smithi191 ceph-mon[31636]: pgmap v5355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:09:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:16 smithi170 ceph-mon[31212]: pgmap v5355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:09:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9868.461140 secs 2024-04-21T13:09:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9868.461140 secs 2024-04-21T13:09:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9868.461140 secs 2024-04-21T13:09:18.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:18 smithi191 ceph-mon[31636]: pgmap v5356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:09:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:18 smithi077 ceph-mon[27902]: pgmap v5356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:09:18.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:18 smithi170 ceph-mon[31212]: pgmap v5356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:09:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9870.221368 secs 2024-04-21T13:09:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9870.221368 secs 2024-04-21T13:09:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9870.221368 secs 2024-04-21T13:09:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:20 smithi077 ceph-mon[27902]: pgmap v5357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:09:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:20 smithi191 ceph-mon[31636]: pgmap v5357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:09:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:20 smithi170 ceph-mon[31212]: pgmap v5357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:09:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:22 smithi077 ceph-mon[27902]: pgmap v5358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:09:22.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9873.461254 secs 2024-04-21T13:09:22.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:22 smithi191 ceph-mon[31636]: pgmap v5358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:09:22.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9873.461254 secs 2024-04-21T13:09:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:22 smithi170 ceph-mon[31212]: pgmap v5358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:09:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9873.461254 secs 2024-04-21T13:09:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:24 smithi077 ceph-mon[27902]: pgmap v5359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9875.221474 secs 2024-04-21T13:09:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:24 smithi191 ceph-mon[31636]: pgmap v5359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9875.221474 secs 2024-04-21T13:09:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:24 smithi170 ceph-mon[31212]: pgmap v5359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9875.221474 secs 2024-04-21T13:09:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:26 smithi077 ceph-mon[27902]: pgmap v5360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:26 smithi191 ceph-mon[31636]: pgmap v5360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:26 smithi170 ceph-mon[31212]: pgmap v5360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9878.461363 secs 2024-04-21T13:09:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9878.461363 secs 2024-04-21T13:09:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9878.461363 secs 2024-04-21T13:09:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:28 smithi077 ceph-mon[27902]: pgmap v5361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:28 smithi191 ceph-mon[31636]: pgmap v5361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:28 smithi170 ceph-mon[31212]: pgmap v5361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9880.221587 secs 2024-04-21T13:09:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9880.221587 secs 2024-04-21T13:09:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9880.221587 secs 2024-04-21T13:09:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:30 smithi077 ceph-mon[27902]: pgmap v5362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:30 smithi191 ceph-mon[31636]: pgmap v5362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:30 smithi170 ceph-mon[31212]: pgmap v5362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:32 smithi077 ceph-mon[27902]: pgmap v5363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:32.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9883.461498 secs 2024-04-21T13:09:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:32 smithi191 ceph-mon[31636]: pgmap v5363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:32.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9883.461498 secs 2024-04-21T13:09:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:32 smithi170 ceph-mon[31212]: pgmap v5363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:32.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9883.461498 secs 2024-04-21T13:09:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:34 smithi077 ceph-mon[27902]: pgmap v5364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9885.221707 secs 2024-04-21T13:09:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:34 smithi191 ceph-mon[31636]: pgmap v5364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9885.221707 secs 2024-04-21T13:09:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:34 smithi170 ceph-mon[31212]: pgmap v5364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9885.221707 secs 2024-04-21T13:09:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:36 smithi077 ceph-mon[27902]: pgmap v5365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:36 smithi191 ceph-mon[31636]: pgmap v5365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:36 smithi170 ceph-mon[31212]: pgmap v5365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9888.461574 secs 2024-04-21T13:09:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9888.461574 secs 2024-04-21T13:09:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9888.461574 secs 2024-04-21T13:09:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:38 smithi191 ceph-mon[31636]: pgmap v5366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:38 smithi170 ceph-mon[31212]: pgmap v5366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:38 smithi077 ceph-mon[27902]: pgmap v5366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9890.221844 secs 2024-04-21T13:09:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9890.221844 secs 2024-04-21T13:09:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9890.221844 secs 2024-04-21T13:09:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:40 smithi191 ceph-mon[31636]: pgmap v5367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:40 smithi170 ceph-mon[31212]: pgmap v5367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:40 smithi077 ceph-mon[27902]: pgmap v5367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:42 smithi191 ceph-mon[31636]: pgmap v5368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9893.461689 secs 2024-04-21T13:09:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:42 smithi170 ceph-mon[31212]: pgmap v5368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9893.461689 secs 2024-04-21T13:09:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:42 smithi077 ceph-mon[27902]: pgmap v5368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9893.461689 secs 2024-04-21T13:09:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:44 smithi191 ceph-mon[31636]: pgmap v5369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9895.221960 secs 2024-04-21T13:09:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:44 smithi170 ceph-mon[31212]: pgmap v5369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9895.221960 secs 2024-04-21T13:09:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:44 smithi077 ceph-mon[27902]: pgmap v5369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9895.221960 secs 2024-04-21T13:09:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:46 smithi191 ceph-mon[31636]: pgmap v5370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:46 smithi170 ceph-mon[31212]: pgmap v5370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:46 smithi077 ceph-mon[27902]: pgmap v5370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9898.461812 secs 2024-04-21T13:09:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9898.461812 secs 2024-04-21T13:09:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9898.461812 secs 2024-04-21T13:09:48.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:48 smithi170 ceph-mon[31212]: pgmap v5371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:48 smithi191 ceph-mon[31636]: pgmap v5371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:48 smithi077 ceph-mon[27902]: pgmap v5371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9900.222070 secs 2024-04-21T13:09:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9900.222070 secs 2024-04-21T13:09:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9900.222070 secs 2024-04-21T13:09:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:50 smithi191 ceph-mon[31636]: pgmap v5372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:50 smithi170 ceph-mon[31212]: pgmap v5372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:50 smithi077 ceph-mon[27902]: pgmap v5372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:52 smithi191 ceph-mon[31636]: pgmap v5373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9903.461935 secs 2024-04-21T13:09:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:52 smithi170 ceph-mon[31212]: pgmap v5373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9903.461935 secs 2024-04-21T13:09:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:52 smithi077 ceph-mon[27902]: pgmap v5373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9903.461935 secs 2024-04-21T13:09:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:54 smithi191 ceph-mon[31636]: pgmap v5374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9905.222193 secs 2024-04-21T13:09:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:54 smithi170 ceph-mon[31212]: pgmap v5374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9905.222193 secs 2024-04-21T13:09:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:54 smithi077 ceph-mon[27902]: pgmap v5374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9905.222193 secs 2024-04-21T13:09:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:09:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:56 smithi191 ceph-mon[31636]: pgmap v5375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:56 smithi170 ceph-mon[31212]: pgmap v5375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:56 smithi077 ceph-mon[27902]: pgmap v5375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:09:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9908.462054 secs 2024-04-21T13:09:57.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9908.462054 secs 2024-04-21T13:09:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9908.462054 secs 2024-04-21T13:09:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:58 smithi191 ceph-mon[31636]: pgmap v5376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:58 smithi170 ceph-mon[31212]: pgmap v5376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:58 smithi077 ceph-mon[27902]: pgmap v5376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:09:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9910.222307 secs 2024-04-21T13:09:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9910.222307 secs 2024-04-21T13:09:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9910.222307 secs 2024-04-21T13:10:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:00 smithi191 ceph-mon[31636]: pgmap v5377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:10:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:00 smithi170 ceph-mon[31212]: pgmap v5377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:10:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:00 smithi077 ceph-mon[27902]: pgmap v5377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:10:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:02 smithi191 ceph-mon[31636]: pgmap v5378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9913.462171 secs 2024-04-21T13:10:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:02 smithi170 ceph-mon[31212]: pgmap v5378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9913.462171 secs 2024-04-21T13:10:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:02 smithi077 ceph-mon[27902]: pgmap v5378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9913.462171 secs 2024-04-21T13:10:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:04 smithi191 ceph-mon[31636]: pgmap v5379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9915.222424 secs 2024-04-21T13:10:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:04 smithi170 ceph-mon[31212]: pgmap v5379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9915.222424 secs 2024-04-21T13:10:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:04 smithi077 ceph-mon[27902]: pgmap v5379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9915.222424 secs 2024-04-21T13:10:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:05 smithi191 ceph-mon[31636]: osdmap e407: 12 total, 12 up, 12 in 2024-04-21T13:10:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:10:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:05 smithi170 ceph-mon[31212]: osdmap e407: 12 total, 12 up, 12 in 2024-04-21T13:10:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:10:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:05 smithi077 ceph-mon[27902]: osdmap e407: 12 total, 12 up, 12 in 2024-04-21T13:10:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:10:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:06 smithi170 ceph-mon[31212]: pgmap v5381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:10:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:10:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:10:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:10:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:06 smithi077 ceph-mon[27902]: pgmap v5381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:10:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:10:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:10:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:10:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:06 smithi191 ceph-mon[31636]: pgmap v5381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:10:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:10:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:10:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:10:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9918.462284 secs 2024-04-21T13:10:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9918.462284 secs 2024-04-21T13:10:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9918.462284 secs 2024-04-21T13:10:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:08 smithi170 ceph-mon[31212]: pgmap v5382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:10:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:08 smithi077 ceph-mon[27902]: pgmap v5382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:10:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:08 smithi191 ceph-mon[31636]: pgmap v5382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:10:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:09 smithi077 ceph-mon[27902]: osdmap e408: 12 total, 12 up, 12 in 2024-04-21T13:10:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9920.222501 secs 2024-04-21T13:10:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:09 smithi191 ceph-mon[31636]: osdmap e408: 12 total, 12 up, 12 in 2024-04-21T13:10:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9920.222501 secs 2024-04-21T13:10:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:09 smithi170 ceph-mon[31212]: osdmap e408: 12 total, 12 up, 12 in 2024-04-21T13:10:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9920.222501 secs 2024-04-21T13:10:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:10 smithi077 ceph-mon[27902]: pgmap v5384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:10:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:10 smithi191 ceph-mon[31636]: pgmap v5384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:10:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:10 smithi170 ceph-mon[31212]: pgmap v5384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:10:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:12 smithi077 ceph-mon[27902]: pgmap v5385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:10:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9923.462421 secs 2024-04-21T13:10:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:12 smithi191 ceph-mon[31636]: pgmap v5385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:10:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9923.462421 secs 2024-04-21T13:10:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:12 smithi170 ceph-mon[31212]: pgmap v5385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:10:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9923.462421 secs 2024-04-21T13:10:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:14 smithi077 ceph-mon[27902]: pgmap v5386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:10:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9925.222616 secs 2024-04-21T13:10:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:14 smithi191 ceph-mon[31636]: pgmap v5386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:10:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9925.222616 secs 2024-04-21T13:10:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:14 smithi170 ceph-mon[31212]: pgmap v5386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:10:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9925.222616 secs 2024-04-21T13:10:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:16 smithi077 ceph-mon[27902]: pgmap v5387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:10:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:16 smithi191 ceph-mon[31636]: pgmap v5387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:10:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:16 smithi170 ceph-mon[31212]: pgmap v5387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:10:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9928.462536 secs 2024-04-21T13:10:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9928.462536 secs 2024-04-21T13:10:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9928.462536 secs 2024-04-21T13:10:18.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:18 smithi191 ceph-mon[31636]: pgmap v5388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:10:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:18 smithi077 ceph-mon[27902]: pgmap v5388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:10:18.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:18 smithi170 ceph-mon[31212]: pgmap v5388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:10:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9930.222705 secs 2024-04-21T13:10:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9930.222705 secs 2024-04-21T13:10:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9930.222705 secs 2024-04-21T13:10:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:20 smithi077 ceph-mon[27902]: pgmap v5389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:10:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:20 smithi191 ceph-mon[31636]: pgmap v5389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:10:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:20 smithi170 ceph-mon[31212]: pgmap v5389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:10:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:22 smithi077 ceph-mon[27902]: pgmap v5390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:10:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9933.462656 secs 2024-04-21T13:10:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:22 smithi191 ceph-mon[31636]: pgmap v5390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:10:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9933.462656 secs 2024-04-21T13:10:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:22 smithi170 ceph-mon[31212]: pgmap v5390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:10:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9933.462656 secs 2024-04-21T13:10:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:24 smithi077 ceph-mon[27902]: pgmap v5391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9935.222839 secs 2024-04-21T13:10:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:24 smithi191 ceph-mon[31636]: pgmap v5391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9935.222839 secs 2024-04-21T13:10:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:24 smithi170 ceph-mon[31212]: pgmap v5391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9935.222839 secs 2024-04-21T13:10:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:26 smithi077 ceph-mon[27902]: pgmap v5392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:26 smithi191 ceph-mon[31636]: pgmap v5392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:26 smithi170 ceph-mon[31212]: pgmap v5392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9938.462781 secs 2024-04-21T13:10:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9938.462781 secs 2024-04-21T13:10:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9938.462781 secs 2024-04-21T13:10:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:28 smithi077 ceph-mon[27902]: pgmap v5393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:28 smithi191 ceph-mon[31636]: pgmap v5393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:28 smithi170 ceph-mon[31212]: pgmap v5393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9940.222952 secs 2024-04-21T13:10:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9940.222952 secs 2024-04-21T13:10:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9940.222952 secs 2024-04-21T13:10:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:30 smithi077 ceph-mon[27902]: pgmap v5394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:30 smithi191 ceph-mon[31636]: pgmap v5394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:30 smithi170 ceph-mon[31212]: pgmap v5394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:32 smithi077 ceph-mon[27902]: pgmap v5395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9943.462893 secs 2024-04-21T13:10:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:32 smithi191 ceph-mon[31636]: pgmap v5395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9943.462893 secs 2024-04-21T13:10:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:32 smithi170 ceph-mon[31212]: pgmap v5395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9943.462893 secs 2024-04-21T13:10:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:34 smithi077 ceph-mon[27902]: pgmap v5396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9945.223022 secs 2024-04-21T13:10:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:34 smithi191 ceph-mon[31636]: pgmap v5396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9945.223022 secs 2024-04-21T13:10:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:34 smithi170 ceph-mon[31212]: pgmap v5396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9945.223022 secs 2024-04-21T13:10:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:36 smithi191 ceph-mon[31636]: pgmap v5397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:36 smithi170 ceph-mon[31212]: pgmap v5397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:36 smithi077 ceph-mon[27902]: pgmap v5397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9948.463015 secs 2024-04-21T13:10:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9948.463015 secs 2024-04-21T13:10:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9948.463015 secs 2024-04-21T13:10:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:38 smithi191 ceph-mon[31636]: pgmap v5398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:38 smithi170 ceph-mon[31212]: pgmap v5398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:38 smithi077 ceph-mon[27902]: pgmap v5398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9950.223114 secs 2024-04-21T13:10:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9950.223114 secs 2024-04-21T13:10:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9950.223114 secs 2024-04-21T13:10:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:40 smithi191 ceph-mon[31636]: pgmap v5399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:40 smithi170 ceph-mon[31212]: pgmap v5399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:40 smithi077 ceph-mon[27902]: pgmap v5399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:42 smithi191 ceph-mon[31636]: pgmap v5400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9953.463131 secs 2024-04-21T13:10:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:42 smithi170 ceph-mon[31212]: pgmap v5400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9953.463131 secs 2024-04-21T13:10:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:42 smithi077 ceph-mon[27902]: pgmap v5400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9953.463131 secs 2024-04-21T13:10:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:44 smithi191 ceph-mon[31636]: pgmap v5401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9955.223250 secs 2024-04-21T13:10:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:44 smithi170 ceph-mon[31212]: pgmap v5401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9955.223250 secs 2024-04-21T13:10:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:44 smithi077 ceph-mon[27902]: pgmap v5401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9955.223250 secs 2024-04-21T13:10:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:46 smithi191 ceph-mon[31636]: pgmap v5402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:46 smithi170 ceph-mon[31212]: pgmap v5402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:46 smithi077 ceph-mon[27902]: pgmap v5402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9958.463249 secs 2024-04-21T13:10:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9958.463249 secs 2024-04-21T13:10:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9958.463249 secs 2024-04-21T13:10:48.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:48 smithi170 ceph-mon[31212]: pgmap v5403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:48 smithi191 ceph-mon[31636]: pgmap v5403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:48 smithi077 ceph-mon[27902]: pgmap v5403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9960.223363 secs 2024-04-21T13:10:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9960.223363 secs 2024-04-21T13:10:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9960.223363 secs 2024-04-21T13:10:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:50 smithi191 ceph-mon[31636]: pgmap v5404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:50 smithi170 ceph-mon[31212]: pgmap v5404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:50 smithi077 ceph-mon[27902]: pgmap v5404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:52 smithi191 ceph-mon[31636]: pgmap v5405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9963.463370 secs 2024-04-21T13:10:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:52 smithi170 ceph-mon[31212]: pgmap v5405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9963.463370 secs 2024-04-21T13:10:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:52 smithi077 ceph-mon[27902]: pgmap v5405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9963.463370 secs 2024-04-21T13:10:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:54 smithi191 ceph-mon[31636]: pgmap v5406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9965.223457 secs 2024-04-21T13:10:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:54 smithi170 ceph-mon[31212]: pgmap v5406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9965.223457 secs 2024-04-21T13:10:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:54 smithi077 ceph-mon[27902]: pgmap v5406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9965.223457 secs 2024-04-21T13:10:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:10:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:10:55.727+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:10:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:10:55.727+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:10:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:10:55.727+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:10:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:10:55.727+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:10:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:56 smithi191 ceph-mon[31636]: pgmap v5407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:56 smithi170 ceph-mon[31212]: pgmap v5407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:56 smithi077 ceph-mon[27902]: pgmap v5407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:10:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9968.463489 secs 2024-04-21T13:10:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9968.463489 secs 2024-04-21T13:10:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9968.463489 secs 2024-04-21T13:10:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:58 smithi191 ceph-mon[31636]: pgmap v5408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:58 smithi170 ceph-mon[31212]: pgmap v5408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:58 smithi077 ceph-mon[27902]: pgmap v5408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:10:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9970.223550 secs 2024-04-21T13:10:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9970.223550 secs 2024-04-21T13:10:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9970.223550 secs 2024-04-21T13:11:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:00 smithi191 ceph-mon[31636]: pgmap v5409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:00 smithi170 ceph-mon[31212]: pgmap v5409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:00 smithi077 ceph-mon[27902]: pgmap v5409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:02 smithi191 ceph-mon[31636]: pgmap v5410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9973.463604 secs 2024-04-21T13:11:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:02 smithi170 ceph-mon[31212]: pgmap v5410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9973.463604 secs 2024-04-21T13:11:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:02 smithi077 ceph-mon[27902]: pgmap v5410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9973.463604 secs 2024-04-21T13:11:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:04 smithi191 ceph-mon[31636]: pgmap v5411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9975.223666 secs 2024-04-21T13:11:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:04 smithi191 ceph-mon[31636]: osdmap e409: 12 total, 12 up, 12 in 2024-04-21T13:11:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:04 smithi170 ceph-mon[31212]: pgmap v5411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9975.223666 secs 2024-04-21T13:11:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:04 smithi170 ceph-mon[31212]: osdmap e409: 12 total, 12 up, 12 in 2024-04-21T13:11:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:04 smithi077 ceph-mon[27902]: pgmap v5411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9975.223666 secs 2024-04-21T13:11:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:04 smithi077 ceph-mon[27902]: osdmap e409: 12 total, 12 up, 12 in 2024-04-21T13:11:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:06 smithi191 ceph-mon[31636]: pgmap v5413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:11:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:11:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:11:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:11:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:11:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:06 smithi170 ceph-mon[31212]: pgmap v5413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:11:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:11:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:11:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:11:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:11:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:06 smithi077 ceph-mon[27902]: pgmap v5413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:11:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:11:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:11:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:11:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:11:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9978.463713 secs 2024-04-21T13:11:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9978.463713 secs 2024-04-21T13:11:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9978.463713 secs 2024-04-21T13:11:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:08 smithi170 ceph-mon[31212]: pgmap v5414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:11:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:08 smithi170 ceph-mon[31212]: osdmap e410: 12 total, 12 up, 12 in 2024-04-21T13:11:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:08 smithi077 ceph-mon[27902]: pgmap v5414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:11:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:08 smithi077 ceph-mon[27902]: osdmap e410: 12 total, 12 up, 12 in 2024-04-21T13:11:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:08 smithi191 ceph-mon[31636]: pgmap v5414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:11:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:08 smithi191 ceph-mon[31636]: osdmap e410: 12 total, 12 up, 12 in 2024-04-21T13:11:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9980.223812 secs 2024-04-21T13:11:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9980.223812 secs 2024-04-21T13:11:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9980.223812 secs 2024-04-21T13:11:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:10 smithi170 ceph-mon[31212]: pgmap v5416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:11:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:10 smithi077 ceph-mon[27902]: pgmap v5416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:11:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:10 smithi191 ceph-mon[31636]: pgmap v5416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:11:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:12 smithi170 ceph-mon[31212]: pgmap v5417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:11:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9983.463837 secs 2024-04-21T13:11:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:12 smithi077 ceph-mon[27902]: pgmap v5417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:11:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9983.463837 secs 2024-04-21T13:11:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:12 smithi191 ceph-mon[31636]: pgmap v5417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:11:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9983.463837 secs 2024-04-21T13:11:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:14 smithi170 ceph-mon[31212]: pgmap v5418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:11:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9985.223927 secs 2024-04-21T13:11:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:14 smithi077 ceph-mon[27902]: pgmap v5418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:11:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9985.223927 secs 2024-04-21T13:11:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:14 smithi191 ceph-mon[31636]: pgmap v5418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:11:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9985.223927 secs 2024-04-21T13:11:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:16 smithi170 ceph-mon[31212]: pgmap v5419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:11:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:16 smithi077 ceph-mon[27902]: pgmap v5419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:11:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:16 smithi191 ceph-mon[31636]: pgmap v5419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:11:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9988.463955 secs 2024-04-21T13:11:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9988.463955 secs 2024-04-21T13:11:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9988.463955 secs 2024-04-21T13:11:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:18 smithi170 ceph-mon[31212]: pgmap v5420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:11:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:18 smithi191 ceph-mon[31636]: pgmap v5420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:11:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:18 smithi077 ceph-mon[27902]: pgmap v5420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:11:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9990.224006 secs 2024-04-21T13:11:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9990.224006 secs 2024-04-21T13:11:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9990.224006 secs 2024-04-21T13:11:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:20 smithi170 ceph-mon[31212]: pgmap v5421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:11:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:20 smithi077 ceph-mon[27902]: pgmap v5421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:11:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:20 smithi191 ceph-mon[31636]: pgmap v5421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:11:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:22 smithi170 ceph-mon[31212]: pgmap v5422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:11:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9993.464071 secs 2024-04-21T13:11:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:22 smithi077 ceph-mon[27902]: pgmap v5422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:11:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9993.464071 secs 2024-04-21T13:11:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:22 smithi191 ceph-mon[31636]: pgmap v5422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:11:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9993.464071 secs 2024-04-21T13:11:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:24 smithi170 ceph-mon[31212]: pgmap v5423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 9995.224117 secs 2024-04-21T13:11:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:24 smithi077 ceph-mon[27902]: pgmap v5423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 9995.224117 secs 2024-04-21T13:11:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:24 smithi191 ceph-mon[31636]: pgmap v5423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 9995.224117 secs 2024-04-21T13:11:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:26 smithi170 ceph-mon[31212]: pgmap v5424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:26 smithi077 ceph-mon[27902]: pgmap v5424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:26 smithi191 ceph-mon[31636]: pgmap v5424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:27.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 9998.464165 secs 2024-04-21T13:11:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 9998.464165 secs 2024-04-21T13:11:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 9998.464165 secs 2024-04-21T13:11:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:28 smithi170 ceph-mon[31212]: pgmap v5425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:28 smithi077 ceph-mon[27902]: pgmap v5425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:28 smithi191 ceph-mon[31636]: pgmap v5425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10000.224218 secs 2024-04-21T13:11:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10000.224218 secs 2024-04-21T13:11:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10000.224218 secs 2024-04-21T13:11:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:30 smithi170 ceph-mon[31212]: pgmap v5426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:30 smithi077 ceph-mon[27902]: pgmap v5426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:30 smithi191 ceph-mon[31636]: pgmap v5426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:32 smithi170 ceph-mon[31212]: pgmap v5427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10003.464308 secs 2024-04-21T13:11:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:32 smithi077 ceph-mon[27902]: pgmap v5427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10003.464308 secs 2024-04-21T13:11:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:32 smithi191 ceph-mon[31636]: pgmap v5427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10003.464308 secs 2024-04-21T13:11:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:34 smithi170 ceph-mon[31212]: pgmap v5428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10005.224295 secs 2024-04-21T13:11:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:34 smithi077 ceph-mon[27902]: pgmap v5428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10005.224295 secs 2024-04-21T13:11:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:34 smithi191 ceph-mon[31636]: pgmap v5428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10005.224295 secs 2024-04-21T13:11:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:36 smithi170 ceph-mon[31212]: pgmap v5429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:36 smithi077 ceph-mon[27902]: pgmap v5429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:36 smithi191 ceph-mon[31636]: pgmap v5429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10008.464430 secs 2024-04-21T13:11:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10008.464430 secs 2024-04-21T13:11:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10008.464430 secs 2024-04-21T13:11:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:38 smithi170 ceph-mon[31212]: pgmap v5430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:38 smithi077 ceph-mon[27902]: pgmap v5430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:38 smithi191 ceph-mon[31636]: pgmap v5430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10010.224444 secs 2024-04-21T13:11:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10010.224444 secs 2024-04-21T13:11:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10010.224444 secs 2024-04-21T13:11:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:40 smithi170 ceph-mon[31212]: pgmap v5431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:40 smithi077 ceph-mon[27902]: pgmap v5431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:40 smithi191 ceph-mon[31636]: pgmap v5431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:42 smithi170 ceph-mon[31212]: pgmap v5432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10013.464550 secs 2024-04-21T13:11:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:42 smithi077 ceph-mon[27902]: pgmap v5432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10013.464550 secs 2024-04-21T13:11:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:42 smithi191 ceph-mon[31636]: pgmap v5432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10013.464550 secs 2024-04-21T13:11:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:44 smithi077 ceph-mon[27902]: pgmap v5433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10015.224538 secs 2024-04-21T13:11:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:44 smithi191 ceph-mon[31636]: pgmap v5433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10015.224538 secs 2024-04-21T13:11:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:44 smithi170 ceph-mon[31212]: pgmap v5433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10015.224538 secs 2024-04-21T13:11:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:46 smithi077 ceph-mon[27902]: pgmap v5434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:46 smithi191 ceph-mon[31636]: pgmap v5434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:46 smithi170 ceph-mon[31212]: pgmap v5434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10018.464670 secs 2024-04-21T13:11:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10018.464670 secs 2024-04-21T13:11:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10018.464670 secs 2024-04-21T13:11:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:48 smithi191 ceph-mon[31636]: pgmap v5435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:48 smithi077 ceph-mon[27902]: pgmap v5435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:48 smithi170 ceph-mon[31212]: pgmap v5435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10020.224657 secs 2024-04-21T13:11:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10020.224657 secs 2024-04-21T13:11:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10020.224657 secs 2024-04-21T13:11:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:50 smithi077 ceph-mon[27902]: pgmap v5436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:50 smithi191 ceph-mon[31636]: pgmap v5436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:50 smithi170 ceph-mon[31212]: pgmap v5436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:11:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:52 smithi077 ceph-mon[27902]: pgmap v5437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10023.464800 secs 2024-04-21T13:11:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:52 smithi191 ceph-mon[31636]: pgmap v5437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10023.464800 secs 2024-04-21T13:11:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:52 smithi170 ceph-mon[31212]: pgmap v5437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10023.464800 secs 2024-04-21T13:11:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:54 smithi077 ceph-mon[27902]: pgmap v5438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10025.224797 secs 2024-04-21T13:11:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:54 smithi191 ceph-mon[31636]: pgmap v5438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10025.224797 secs 2024-04-21T13:11:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:54 smithi170 ceph-mon[31212]: pgmap v5438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10025.224797 secs 2024-04-21T13:11:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:11:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:56 smithi077 ceph-mon[27902]: pgmap v5439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:56 smithi191 ceph-mon[31636]: pgmap v5439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:56 smithi170 ceph-mon[31212]: pgmap v5439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10028.464868 secs 2024-04-21T13:11:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10028.464868 secs 2024-04-21T13:11:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10028.464868 secs 2024-04-21T13:11:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:58 smithi077 ceph-mon[27902]: pgmap v5440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:58 smithi191 ceph-mon[31636]: pgmap v5440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:58 smithi170 ceph-mon[31212]: pgmap v5440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:11:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10030.224877 secs 2024-04-21T13:11:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:11:59 smithi077 ceph-mon[27902]: pgmap v5441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:11:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10030.224877 secs 2024-04-21T13:11:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:11:59 smithi191 ceph-mon[31636]: pgmap v5441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:12:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10030.224877 secs 2024-04-21T13:12:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:11:59 smithi170 ceph-mon[31212]: pgmap v5441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:12:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:02 smithi077 ceph-mon[27902]: pgmap v5442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10033.464979 secs 2024-04-21T13:12:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:02 smithi191 ceph-mon[31636]: pgmap v5442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10033.464979 secs 2024-04-21T13:12:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:02 smithi170 ceph-mon[31212]: pgmap v5442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10033.464979 secs 2024-04-21T13:12:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:04 smithi191 ceph-mon[31636]: pgmap v5443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10035.224996 secs 2024-04-21T13:12:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:04 smithi170 ceph-mon[31212]: pgmap v5443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10035.224996 secs 2024-04-21T13:12:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:04 smithi077 ceph-mon[27902]: pgmap v5443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10035.224996 secs 2024-04-21T13:12:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:05 smithi191 ceph-mon[31636]: osdmap e411: 12 total, 12 up, 12 in 2024-04-21T13:12:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:05 smithi170 ceph-mon[31212]: osdmap e411: 12 total, 12 up, 12 in 2024-04-21T13:12:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:05 smithi077 ceph-mon[27902]: osdmap e411: 12 total, 12 up, 12 in 2024-04-21T13:12:06.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:06 smithi191 ceph-mon[31636]: pgmap v5445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:12:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:06 smithi170 ceph-mon[31212]: pgmap v5445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:12:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:06 smithi077 ceph-mon[27902]: pgmap v5445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:12:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:12:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10038.465046 secs 2024-04-21T13:12:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:12:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:12:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:12:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:12:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10038.465046 secs 2024-04-21T13:12:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:12:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:12:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:12:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:12:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10038.465046 secs 2024-04-21T13:12:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:12:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:12:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:12:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:08 smithi191 ceph-mon[31636]: pgmap v5446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:12:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:08 smithi170 ceph-mon[31212]: pgmap v5446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:12:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:08 smithi077 ceph-mon[27902]: pgmap v5446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:12:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10040.225059 secs 2024-04-21T13:12:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:09 smithi077 ceph-mon[27902]: osdmap e412: 12 total, 12 up, 12 in 2024-04-21T13:12:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10040.225059 secs 2024-04-21T13:12:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:09 smithi191 ceph-mon[31636]: osdmap e412: 12 total, 12 up, 12 in 2024-04-21T13:12:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10040.225059 secs 2024-04-21T13:12:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:09 smithi170 ceph-mon[31212]: osdmap e412: 12 total, 12 up, 12 in 2024-04-21T13:12:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:10 smithi077 ceph-mon[27902]: pgmap v5448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:12:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:10 smithi191 ceph-mon[31636]: pgmap v5448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:12:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:10 smithi170 ceph-mon[31212]: pgmap v5448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:12:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:12 smithi077 ceph-mon[27902]: pgmap v5449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:12:12.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10043.465145 secs 2024-04-21T13:12:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:12 smithi191 ceph-mon[31636]: pgmap v5449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:12:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10043.465145 secs 2024-04-21T13:12:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:12 smithi170 ceph-mon[31212]: pgmap v5449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:12:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10043.465145 secs 2024-04-21T13:12:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:14 smithi077 ceph-mon[27902]: pgmap v5450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:12:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10045.225209 secs 2024-04-21T13:12:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:14 smithi191 ceph-mon[31636]: pgmap v5450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:12:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10045.225209 secs 2024-04-21T13:12:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:14 smithi170 ceph-mon[31212]: pgmap v5450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:12:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10045.225209 secs 2024-04-21T13:12:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:16.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:16 smithi077 ceph-mon[27902]: pgmap v5451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:12:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:16 smithi191 ceph-mon[31636]: pgmap v5451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:12:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:16 smithi170 ceph-mon[31212]: pgmap v5451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:12:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10048.465258 secs 2024-04-21T13:12:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10048.465258 secs 2024-04-21T13:12:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10048.465258 secs 2024-04-21T13:12:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:18 smithi077 ceph-mon[27902]: pgmap v5452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:12:18.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:18 smithi170 ceph-mon[31212]: pgmap v5452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:12:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:18 smithi191 ceph-mon[31636]: pgmap v5452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:12:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10050.225347 secs 2024-04-21T13:12:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10050.225347 secs 2024-04-21T13:12:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10050.225347 secs 2024-04-21T13:12:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:20 smithi077 ceph-mon[27902]: pgmap v5453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:12:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:20 smithi191 ceph-mon[31636]: pgmap v5453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:12:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:20 smithi170 ceph-mon[31212]: pgmap v5453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:12:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:22 smithi191 ceph-mon[31636]: pgmap v5454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:12:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10053.465400 secs 2024-04-21T13:12:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:22 smithi170 ceph-mon[31212]: pgmap v5454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:12:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10053.465400 secs 2024-04-21T13:12:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:22 smithi077 ceph-mon[27902]: pgmap v5454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:12:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10053.465400 secs 2024-04-21T13:12:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:24 smithi191 ceph-mon[31636]: pgmap v5455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10055.225416 secs 2024-04-21T13:12:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:24 smithi170 ceph-mon[31212]: pgmap v5455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10055.225416 secs 2024-04-21T13:12:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:24 smithi077 ceph-mon[27902]: pgmap v5455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10055.225416 secs 2024-04-21T13:12:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:26 smithi191 ceph-mon[31636]: pgmap v5456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:26 smithi170 ceph-mon[31212]: pgmap v5456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:26 smithi077 ceph-mon[27902]: pgmap v5456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10058.465551 secs 2024-04-21T13:12:27.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10058.465551 secs 2024-04-21T13:12:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10058.465551 secs 2024-04-21T13:12:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:28 smithi191 ceph-mon[31636]: pgmap v5457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:28 smithi170 ceph-mon[31212]: pgmap v5457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:28 smithi077 ceph-mon[27902]: pgmap v5457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10060.225530 secs 2024-04-21T13:12:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10060.225530 secs 2024-04-21T13:12:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10060.225530 secs 2024-04-21T13:12:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:30 smithi191 ceph-mon[31636]: pgmap v5458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:30 smithi170 ceph-mon[31212]: pgmap v5458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:30 smithi077 ceph-mon[27902]: pgmap v5458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:32 smithi191 ceph-mon[31636]: pgmap v5459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10063.465695 secs 2024-04-21T13:12:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:32 smithi170 ceph-mon[31212]: pgmap v5459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10063.465695 secs 2024-04-21T13:12:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:32 smithi077 ceph-mon[27902]: pgmap v5459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10063.465695 secs 2024-04-21T13:12:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:34 smithi191 ceph-mon[31636]: pgmap v5460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10065.225661 secs 2024-04-21T13:12:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:34 smithi170 ceph-mon[31212]: pgmap v5460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10065.225661 secs 2024-04-21T13:12:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:34 smithi077 ceph-mon[27902]: pgmap v5460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10065.225661 secs 2024-04-21T13:12:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:36 smithi191 ceph-mon[31636]: pgmap v5461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:36 smithi170 ceph-mon[31212]: pgmap v5461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:36 smithi077 ceph-mon[27902]: pgmap v5461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10068.465832 secs 2024-04-21T13:12:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10068.465832 secs 2024-04-21T13:12:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10068.465832 secs 2024-04-21T13:12:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:38 smithi191 ceph-mon[31636]: pgmap v5462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:38 smithi170 ceph-mon[31212]: pgmap v5462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:38 smithi077 ceph-mon[27902]: pgmap v5462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10070.225791 secs 2024-04-21T13:12:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10070.225791 secs 2024-04-21T13:12:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10070.225791 secs 2024-04-21T13:12:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:40 smithi191 ceph-mon[31636]: pgmap v5463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:40 smithi170 ceph-mon[31212]: pgmap v5463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:40 smithi077 ceph-mon[27902]: pgmap v5463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:42 smithi191 ceph-mon[31636]: pgmap v5464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10073.465942 secs 2024-04-21T13:12:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:42 smithi170 ceph-mon[31212]: pgmap v5464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10073.465942 secs 2024-04-21T13:12:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:42 smithi077 ceph-mon[27902]: pgmap v5464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10073.465942 secs 2024-04-21T13:12:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:44 smithi191 ceph-mon[31636]: pgmap v5465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10075.225863 secs 2024-04-21T13:12:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:44 smithi170 ceph-mon[31212]: pgmap v5465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10075.225863 secs 2024-04-21T13:12:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:44 smithi077 ceph-mon[27902]: pgmap v5465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10075.225863 secs 2024-04-21T13:12:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:46 smithi191 ceph-mon[31636]: pgmap v5466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:46 smithi170 ceph-mon[31212]: pgmap v5466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:46 smithi077 ceph-mon[27902]: pgmap v5466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10078.466069 secs 2024-04-21T13:12:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10078.466069 secs 2024-04-21T13:12:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10078.466069 secs 2024-04-21T13:12:48.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:48 smithi170 ceph-mon[31212]: pgmap v5467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:48 smithi191 ceph-mon[31636]: pgmap v5467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:48 smithi077 ceph-mon[27902]: pgmap v5467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10080.225946 secs 2024-04-21T13:12:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10080.225946 secs 2024-04-21T13:12:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10080.225946 secs 2024-04-21T13:12:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:50 smithi191 ceph-mon[31636]: pgmap v5468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:50 smithi170 ceph-mon[31212]: pgmap v5468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:50 smithi077 ceph-mon[27902]: pgmap v5468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:52 smithi191 ceph-mon[31636]: pgmap v5469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10083.466199 secs 2024-04-21T13:12:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:52 smithi170 ceph-mon[31212]: pgmap v5469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10083.466199 secs 2024-04-21T13:12:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:52 smithi077 ceph-mon[27902]: pgmap v5469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10083.466199 secs 2024-04-21T13:12:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:54 smithi191 ceph-mon[31636]: pgmap v5470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10085.226010 secs 2024-04-21T13:12:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:54 smithi170 ceph-mon[31212]: pgmap v5470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10085.226010 secs 2024-04-21T13:12:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:54 smithi077 ceph-mon[27902]: pgmap v5470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10085.226010 secs 2024-04-21T13:12:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:12:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:56 smithi170 ceph-mon[31212]: pgmap v5471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:56 smithi077 ceph-mon[27902]: pgmap v5471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:56 smithi191 ceph-mon[31636]: pgmap v5471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:12:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10088.466328 secs 2024-04-21T13:12:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10088.466328 secs 2024-04-21T13:12:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10088.466328 secs 2024-04-21T13:12:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:58 smithi170 ceph-mon[31212]: pgmap v5472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:58 smithi077 ceph-mon[27902]: pgmap v5472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:58 smithi191 ceph-mon[31636]: pgmap v5472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:12:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:12:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10090.226102 secs 2024-04-21T13:12:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:12:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10090.226102 secs 2024-04-21T13:12:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:12:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10090.226102 secs 2024-04-21T13:13:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:00 smithi170 ceph-mon[31212]: pgmap v5473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:00 smithi077 ceph-mon[27902]: pgmap v5473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:00 smithi191 ceph-mon[31636]: pgmap v5473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:02 smithi170 ceph-mon[31212]: pgmap v5474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10093.466460 secs 2024-04-21T13:13:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:02 smithi077 ceph-mon[27902]: pgmap v5474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10093.466460 secs 2024-04-21T13:13:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:02 smithi191 ceph-mon[31636]: pgmap v5474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10093.466460 secs 2024-04-21T13:13:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:04 smithi170 ceph-mon[31212]: pgmap v5475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10095.226470 secs 2024-04-21T13:13:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:04 smithi170 ceph-mon[31212]: osdmap e413: 12 total, 12 up, 12 in 2024-04-21T13:13:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:04 smithi077 ceph-mon[27902]: pgmap v5475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10095.226470 secs 2024-04-21T13:13:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:04 smithi077 ceph-mon[27902]: osdmap e413: 12 total, 12 up, 12 in 2024-04-21T13:13:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:04 smithi191 ceph-mon[31636]: pgmap v5475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10095.226470 secs 2024-04-21T13:13:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:04 smithi191 ceph-mon[31636]: osdmap e413: 12 total, 12 up, 12 in 2024-04-21T13:13:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:06 smithi170 ceph-mon[31212]: pgmap v5477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:13:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:06 smithi077 ceph-mon[27902]: pgmap v5477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:13:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:06 smithi191 ceph-mon[31636]: pgmap v5477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:13:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10098.466588 secs 2024-04-21T13:13:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:13:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10098.466588 secs 2024-04-21T13:13:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:13:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10098.466588 secs 2024-04-21T13:13:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:13:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:08 smithi170 ceph-mon[31212]: pgmap v5478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:13:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:13:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:13:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:13:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:08 smithi170 ceph-mon[31212]: osdmap e414: 12 total, 12 up, 12 in 2024-04-21T13:13:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:08 smithi077 ceph-mon[27902]: pgmap v5478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:13:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:13:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:13:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:13:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:08 smithi077 ceph-mon[27902]: osdmap e414: 12 total, 12 up, 12 in 2024-04-21T13:13:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:08 smithi191 ceph-mon[31636]: pgmap v5478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:13:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:13:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:13:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:13:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:08 smithi191 ceph-mon[31636]: osdmap e414: 12 total, 12 up, 12 in 2024-04-21T13:13:09.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10100.226524 secs 2024-04-21T13:13:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10100.226524 secs 2024-04-21T13:13:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10100.226524 secs 2024-04-21T13:13:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:10 smithi170 ceph-mon[31212]: pgmap v5480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:13:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:10 smithi077 ceph-mon[27902]: pgmap v5480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:13:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:10 smithi191 ceph-mon[31636]: pgmap v5480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:13:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:12 smithi170 ceph-mon[31212]: pgmap v5481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:13:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10103.466716 secs 2024-04-21T13:13:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:12 smithi077 ceph-mon[27902]: pgmap v5481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:13:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10103.466716 secs 2024-04-21T13:13:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:12 smithi191 ceph-mon[31636]: pgmap v5481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:13:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10103.466716 secs 2024-04-21T13:13:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:14 smithi170 ceph-mon[31212]: pgmap v5482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:13:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10105.226604 secs 2024-04-21T13:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:14 smithi077 ceph-mon[27902]: pgmap v5482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10105.226604 secs 2024-04-21T13:13:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:14 smithi191 ceph-mon[31636]: pgmap v5482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:13:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10105.226604 secs 2024-04-21T13:13:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:16 smithi170 ceph-mon[31212]: pgmap v5483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:13:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:16 smithi077 ceph-mon[27902]: pgmap v5483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:13:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:16 smithi191 ceph-mon[31636]: pgmap v5483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:13:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10108.466851 secs 2024-04-21T13:13:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10108.466851 secs 2024-04-21T13:13:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10108.466851 secs 2024-04-21T13:13:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:18 smithi170 ceph-mon[31212]: pgmap v5484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:13:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:18 smithi191 ceph-mon[31636]: pgmap v5484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:13:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:18 smithi077 ceph-mon[27902]: pgmap v5484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:13:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10110.226668 secs 2024-04-21T13:13:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10110.226668 secs 2024-04-21T13:13:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10110.226668 secs 2024-04-21T13:13:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:20 smithi170 ceph-mon[31212]: pgmap v5485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:13:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:20 smithi077 ceph-mon[27902]: pgmap v5485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:13:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:20 smithi191 ceph-mon[31636]: pgmap v5485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:13:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:22 smithi170 ceph-mon[31212]: pgmap v5486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:13:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10113.466992 secs 2024-04-21T13:13:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:22 smithi077 ceph-mon[27902]: pgmap v5486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:13:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10113.466992 secs 2024-04-21T13:13:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:22 smithi191 ceph-mon[31636]: pgmap v5486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:13:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10113.466992 secs 2024-04-21T13:13:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:24 smithi170 ceph-mon[31212]: pgmap v5487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10115.226823 secs 2024-04-21T13:13:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:24 smithi077 ceph-mon[27902]: pgmap v5487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10115.226823 secs 2024-04-21T13:13:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:24 smithi191 ceph-mon[31636]: pgmap v5487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10115.226823 secs 2024-04-21T13:13:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:26 smithi170 ceph-mon[31212]: pgmap v5488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:26 smithi077 ceph-mon[27902]: pgmap v5488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:26 smithi191 ceph-mon[31636]: pgmap v5488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10118.467053 secs 2024-04-21T13:13:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10118.467053 secs 2024-04-21T13:13:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10118.467053 secs 2024-04-21T13:13:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:28 smithi077 ceph-mon[27902]: pgmap v5489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:28 smithi191 ceph-mon[31636]: pgmap v5489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:28 smithi170 ceph-mon[31212]: pgmap v5489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10120.226940 secs 2024-04-21T13:13:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10120.226940 secs 2024-04-21T13:13:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10120.226940 secs 2024-04-21T13:13:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:30 smithi077 ceph-mon[27902]: pgmap v5490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:30 smithi191 ceph-mon[31636]: pgmap v5490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:30 smithi170 ceph-mon[31212]: pgmap v5490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:32 smithi077 ceph-mon[27902]: pgmap v5491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10123.467154 secs 2024-04-21T13:13:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:32 smithi191 ceph-mon[31636]: pgmap v5491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10123.467154 secs 2024-04-21T13:13:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:32 smithi170 ceph-mon[31212]: pgmap v5491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10123.467154 secs 2024-04-21T13:13:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:34 smithi077 ceph-mon[27902]: pgmap v5492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10125.227037 secs 2024-04-21T13:13:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:34 smithi191 ceph-mon[31636]: pgmap v5492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10125.227037 secs 2024-04-21T13:13:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:34 smithi170 ceph-mon[31212]: pgmap v5492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10125.227037 secs 2024-04-21T13:13:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:36 smithi077 ceph-mon[27902]: pgmap v5493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:36 smithi191 ceph-mon[31636]: pgmap v5493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:36 smithi170 ceph-mon[31212]: pgmap v5493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10128.467273 secs 2024-04-21T13:13:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10128.467273 secs 2024-04-21T13:13:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10128.467273 secs 2024-04-21T13:13:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:38 smithi077 ceph-mon[27902]: pgmap v5494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:38 smithi191 ceph-mon[31636]: pgmap v5494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:38 smithi170 ceph-mon[31212]: pgmap v5494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10130.227152 secs 2024-04-21T13:13:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10130.227152 secs 2024-04-21T13:13:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10130.227152 secs 2024-04-21T13:13:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:40 smithi077 ceph-mon[27902]: pgmap v5495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:40 smithi191 ceph-mon[31636]: pgmap v5495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:40 smithi170 ceph-mon[31212]: pgmap v5495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:42 smithi077 ceph-mon[27902]: pgmap v5496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10133.467338 secs 2024-04-21T13:13:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:42 smithi191 ceph-mon[31636]: pgmap v5496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10133.467338 secs 2024-04-21T13:13:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:42 smithi170 ceph-mon[31212]: pgmap v5496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10133.467338 secs 2024-04-21T13:13:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:44 smithi077 ceph-mon[27902]: pgmap v5497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10135.227276 secs 2024-04-21T13:13:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:44 smithi191 ceph-mon[31636]: pgmap v5497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10135.227276 secs 2024-04-21T13:13:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:44 smithi170 ceph-mon[31212]: pgmap v5497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10135.227276 secs 2024-04-21T13:13:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:46 smithi077 ceph-mon[27902]: pgmap v5498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:46 smithi191 ceph-mon[31636]: pgmap v5498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:46 smithi170 ceph-mon[31212]: pgmap v5498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10138.467446 secs 2024-04-21T13:13:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10138.467446 secs 2024-04-21T13:13:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10138.467446 secs 2024-04-21T13:13:48.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:48 smithi191 ceph-mon[31636]: pgmap v5499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:48 smithi077 ceph-mon[27902]: pgmap v5499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:48 smithi170 ceph-mon[31212]: pgmap v5499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10140.227399 secs 2024-04-21T13:13:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:49 smithi077 ceph-mon[27902]: pgmap v5500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10140.227399 secs 2024-04-21T13:13:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:49 smithi191 ceph-mon[31636]: pgmap v5500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10140.227399 secs 2024-04-21T13:13:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:49 smithi170 ceph-mon[31212]: pgmap v5500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:52 smithi191 ceph-mon[31636]: pgmap v5501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10143.467579 secs 2024-04-21T13:13:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:52 smithi170 ceph-mon[31212]: pgmap v5501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10143.467579 secs 2024-04-21T13:13:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:52 smithi077 ceph-mon[27902]: pgmap v5501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10143.467579 secs 2024-04-21T13:13:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T13:13:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T13:13:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:13:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T13:13:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:13:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T13:13:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.425+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a51a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd70054040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a51a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd70054040 comp rx=0 tx=0).stop 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a51a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a51a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a51a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:13:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:54.426+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7005a000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T13:13:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:54 smithi191 ceph-mon[31636]: pgmap v5502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10145.227520 secs 2024-04-21T13:13:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:54 smithi170 ceph-mon[31212]: pgmap v5502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10145.227520 secs 2024-04-21T13:13:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:54 smithi077 ceph-mon[27902]: pgmap v5502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10145.227520 secs 2024-04-21T13:13:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:13:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:13:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:13:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:13:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:13:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:13:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:13:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:13:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:13:55.753+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:13:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:56 smithi191 ceph-mon[31636]: pgmap v5503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:56 smithi170 ceph-mon[31212]: pgmap v5503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:56 smithi077 ceph-mon[27902]: pgmap v5503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:13:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10148.467693 secs 2024-04-21T13:13:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10148.467693 secs 2024-04-21T13:13:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10148.467693 secs 2024-04-21T13:13:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:58 smithi191 ceph-mon[31636]: pgmap v5504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:58 smithi170 ceph-mon[31212]: pgmap v5504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:58 smithi077 ceph-mon[27902]: pgmap v5504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:13:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10150.227672 secs 2024-04-21T13:13:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10150.227672 secs 2024-04-21T13:13:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10150.227672 secs 2024-04-21T13:14:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:00 smithi191 ceph-mon[31636]: pgmap v5505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:00 smithi170 ceph-mon[31212]: pgmap v5505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:00 smithi077 ceph-mon[27902]: pgmap v5505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:02 smithi191 ceph-mon[31636]: pgmap v5506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T13:14:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10153.467809 secs 2024-04-21T13:14:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:02 smithi170 ceph-mon[31212]: pgmap v5506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T13:14:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10153.467809 secs 2024-04-21T13:14:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:02 smithi077 ceph-mon[27902]: pgmap v5506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T13:14:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10153.467809 secs 2024-04-21T13:14:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:04 smithi191 ceph-mon[31636]: pgmap v5507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T13:14:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10155.227813 secs 2024-04-21T13:14:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:04 smithi170 ceph-mon[31212]: pgmap v5507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T13:14:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10155.227813 secs 2024-04-21T13:14:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:04 smithi077 ceph-mon[27902]: pgmap v5507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T13:14:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10155.227813 secs 2024-04-21T13:14:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:05 smithi191 ceph-mon[31636]: osdmap e415: 12 total, 12 up, 12 in 2024-04-21T13:14:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:05 smithi170 ceph-mon[31212]: osdmap e415: 12 total, 12 up, 12 in 2024-04-21T13:14:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:05 smithi077 ceph-mon[27902]: osdmap e415: 12 total, 12 up, 12 in 2024-04-21T13:14:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:06 smithi191 ceph-mon[31636]: pgmap v5509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T13:14:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:06 smithi170 ceph-mon[31212]: pgmap v5509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T13:14:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:06 smithi077 ceph-mon[27902]: pgmap v5509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T13:14:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10158.467923 secs 2024-04-21T13:14:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10158.467923 secs 2024-04-21T13:14:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10158.467923 secs 2024-04-21T13:14:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:08 smithi191 ceph-mon[31636]: pgmap v5510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:14:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:14:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:08 smithi170 ceph-mon[31212]: pgmap v5510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:14:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:14:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:08 smithi077 ceph-mon[27902]: pgmap v5510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:14:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:14:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10160.227923 secs 2024-04-21T13:14:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:09 smithi077 ceph-mon[27902]: osdmap e416: 12 total, 12 up, 12 in 2024-04-21T13:14:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:14:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:14:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:14:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10160.227923 secs 2024-04-21T13:14:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:09 smithi191 ceph-mon[31636]: osdmap e416: 12 total, 12 up, 12 in 2024-04-21T13:14:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:14:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:14:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:14:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10160.227923 secs 2024-04-21T13:14:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:09 smithi170 ceph-mon[31212]: osdmap e416: 12 total, 12 up, 12 in 2024-04-21T13:14:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:14:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:14:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:14:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:10 smithi077 ceph-mon[27902]: pgmap v5512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T13:14:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:10 smithi191 ceph-mon[31636]: pgmap v5512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T13:14:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:10 smithi170 ceph-mon[31212]: pgmap v5512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T13:14:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:12 smithi191 ceph-mon[31636]: pgmap v5513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T13:14:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10163.468036 secs 2024-04-21T13:14:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:12 smithi170 ceph-mon[31212]: pgmap v5513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T13:14:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10163.468036 secs 2024-04-21T13:14:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:12 smithi077 ceph-mon[27902]: pgmap v5513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T13:14:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10163.468036 secs 2024-04-21T13:14:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:14 smithi191 ceph-mon[31636]: pgmap v5514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T13:14:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10165.227986 secs 2024-04-21T13:14:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:14 smithi170 ceph-mon[31212]: pgmap v5514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T13:14:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10165.227986 secs 2024-04-21T13:14:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:14 smithi077 ceph-mon[27902]: pgmap v5514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T13:14:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10165.227986 secs 2024-04-21T13:14:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:16 smithi191 ceph-mon[31636]: pgmap v5515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T13:14:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:16 smithi170 ceph-mon[31212]: pgmap v5515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T13:14:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:16 smithi077 ceph-mon[27902]: pgmap v5515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T13:14:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10168.468107 secs 2024-04-21T13:14:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10168.468107 secs 2024-04-21T13:14:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10168.468107 secs 2024-04-21T13:14:18.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:18 smithi170 ceph-mon[31212]: pgmap v5516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:14:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:18 smithi191 ceph-mon[31636]: pgmap v5516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:14:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:18 smithi077 ceph-mon[27902]: pgmap v5516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:14:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10170.228128 secs 2024-04-21T13:14:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10170.228128 secs 2024-04-21T13:14:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10170.228128 secs 2024-04-21T13:14:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:20 smithi191 ceph-mon[31636]: pgmap v5517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:14:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:20 smithi170 ceph-mon[31212]: pgmap v5517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:14:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:20 smithi077 ceph-mon[27902]: pgmap v5517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:14:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:22 smithi191 ceph-mon[31636]: pgmap v5518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:14:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10173.468224 secs 2024-04-21T13:14:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:22 smithi170 ceph-mon[31212]: pgmap v5518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:14:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10173.468224 secs 2024-04-21T13:14:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:22 smithi077 ceph-mon[27902]: pgmap v5518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:14:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10173.468224 secs 2024-04-21T13:14:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:24 smithi191 ceph-mon[31636]: pgmap v5519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10175.228254 secs 2024-04-21T13:14:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:24 smithi170 ceph-mon[31212]: pgmap v5519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10175.228254 secs 2024-04-21T13:14:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:24 smithi077 ceph-mon[27902]: pgmap v5519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10175.228254 secs 2024-04-21T13:14:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:26 smithi191 ceph-mon[31636]: pgmap v5520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:26 smithi170 ceph-mon[31212]: pgmap v5520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:26 smithi077 ceph-mon[27902]: pgmap v5520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10178.468284 secs 2024-04-21T13:14:27.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10178.468284 secs 2024-04-21T13:14:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10178.468284 secs 2024-04-21T13:14:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:28 smithi191 ceph-mon[31636]: pgmap v5521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:28 smithi170 ceph-mon[31212]: pgmap v5521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:28 smithi077 ceph-mon[27902]: pgmap v5521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10180.228369 secs 2024-04-21T13:14:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10180.228369 secs 2024-04-21T13:14:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10180.228369 secs 2024-04-21T13:14:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:30 smithi191 ceph-mon[31636]: pgmap v5522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:30 smithi170 ceph-mon[31212]: pgmap v5522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:30 smithi077 ceph-mon[27902]: pgmap v5522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:32 smithi191 ceph-mon[31636]: pgmap v5523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10183.468398 secs 2024-04-21T13:14:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:32 smithi170 ceph-mon[31212]: pgmap v5523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10183.468398 secs 2024-04-21T13:14:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:32 smithi077 ceph-mon[27902]: pgmap v5523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10183.468398 secs 2024-04-21T13:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:34 smithi191 ceph-mon[31636]: pgmap v5524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10185.228488 secs 2024-04-21T13:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:34 smithi170 ceph-mon[31212]: pgmap v5524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10185.228488 secs 2024-04-21T13:14:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:34 smithi077 ceph-mon[27902]: pgmap v5524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10185.228488 secs 2024-04-21T13:14:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:36 smithi191 ceph-mon[31636]: pgmap v5525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:36 smithi170 ceph-mon[31212]: pgmap v5525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:36 smithi077 ceph-mon[27902]: pgmap v5525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10188.468517 secs 2024-04-21T13:14:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10188.468517 secs 2024-04-21T13:14:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10188.468517 secs 2024-04-21T13:14:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:38 smithi191 ceph-mon[31636]: pgmap v5526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:38 smithi170 ceph-mon[31212]: pgmap v5526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:38 smithi077 ceph-mon[27902]: pgmap v5526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10190.228605 secs 2024-04-21T13:14:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10190.228605 secs 2024-04-21T13:14:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10190.228605 secs 2024-04-21T13:14:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:40 smithi191 ceph-mon[31636]: pgmap v5527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:40 smithi170 ceph-mon[31212]: pgmap v5527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:40 smithi077 ceph-mon[27902]: pgmap v5527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:42 smithi191 ceph-mon[31636]: pgmap v5528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10193.468630 secs 2024-04-21T13:14:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:42 smithi170 ceph-mon[31212]: pgmap v5528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10193.468630 secs 2024-04-21T13:14:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:42 smithi077 ceph-mon[27902]: pgmap v5528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10193.468630 secs 2024-04-21T13:14:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:44 smithi191 ceph-mon[31636]: pgmap v5529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10195.228714 secs 2024-04-21T13:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:44 smithi170 ceph-mon[31212]: pgmap v5529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10195.228714 secs 2024-04-21T13:14:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:44 smithi077 ceph-mon[27902]: pgmap v5529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10195.228714 secs 2024-04-21T13:14:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:46 smithi191 ceph-mon[31636]: pgmap v5530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:46 smithi170 ceph-mon[31212]: pgmap v5530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:46 smithi077 ceph-mon[27902]: pgmap v5530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10198.468782 secs 2024-04-21T13:14:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10198.468782 secs 2024-04-21T13:14:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10198.468782 secs 2024-04-21T13:14:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:48 smithi170 ceph-mon[31212]: pgmap v5531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:48 smithi191 ceph-mon[31636]: pgmap v5531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:48 smithi077 ceph-mon[27902]: pgmap v5531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10200.228830 secs 2024-04-21T13:14:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10200.228830 secs 2024-04-21T13:14:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10200.228830 secs 2024-04-21T13:14:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:50 smithi170 ceph-mon[31212]: pgmap v5532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:50 smithi077 ceph-mon[27902]: pgmap v5532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:50 smithi191 ceph-mon[31636]: pgmap v5532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:52 smithi170 ceph-mon[31212]: pgmap v5533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10203.468859 secs 2024-04-21T13:14:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:52 smithi077 ceph-mon[27902]: pgmap v5533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10203.468859 secs 2024-04-21T13:14:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:52 smithi191 ceph-mon[31636]: pgmap v5533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10203.468859 secs 2024-04-21T13:14:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:54 smithi170 ceph-mon[31212]: pgmap v5534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10205.228951 secs 2024-04-21T13:14:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:54 smithi077 ceph-mon[27902]: pgmap v5534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10205.228951 secs 2024-04-21T13:14:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:54 smithi191 ceph-mon[31636]: pgmap v5534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10205.228951 secs 2024-04-21T13:14:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:14:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:56 smithi170 ceph-mon[31212]: pgmap v5535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:56 smithi077 ceph-mon[27902]: pgmap v5535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:56 smithi191 ceph-mon[31636]: pgmap v5535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:14:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10208.468982 secs 2024-04-21T13:14:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10208.468982 secs 2024-04-21T13:14:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10208.468982 secs 2024-04-21T13:14:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:58 smithi170 ceph-mon[31212]: pgmap v5536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:58 smithi077 ceph-mon[27902]: pgmap v5536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:58 smithi191 ceph-mon[31636]: pgmap v5536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:14:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10210.229079 secs 2024-04-21T13:14:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10210.229079 secs 2024-04-21T13:14:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10210.229079 secs 2024-04-21T13:15:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:00 smithi170 ceph-mon[31212]: pgmap v5537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:00 smithi077 ceph-mon[27902]: pgmap v5537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:00 smithi191 ceph-mon[31636]: pgmap v5537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:02 smithi170 ceph-mon[31212]: pgmap v5538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-04-21T13:15:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10213.469096 secs 2024-04-21T13:15:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:02 smithi077 ceph-mon[27902]: pgmap v5538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-04-21T13:15:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10213.469096 secs 2024-04-21T13:15:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:02 smithi191 ceph-mon[31636]: pgmap v5538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-04-21T13:15:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10213.469096 secs 2024-04-21T13:15:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:04 smithi170 ceph-mon[31212]: pgmap v5539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-21T13:15:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10215.229160 secs 2024-04-21T13:15:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:04 smithi170 ceph-mon[31212]: osdmap e417: 12 total, 12 up, 12 in 2024-04-21T13:15:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:04 smithi077 ceph-mon[27902]: pgmap v5539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-21T13:15:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10215.229160 secs 2024-04-21T13:15:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:04 smithi077 ceph-mon[27902]: osdmap e417: 12 total, 12 up, 12 in 2024-04-21T13:15:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:04 smithi191 ceph-mon[31636]: pgmap v5539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-21T13:15:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10215.229160 secs 2024-04-21T13:15:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:04 smithi191 ceph-mon[31636]: osdmap e417: 12 total, 12 up, 12 in 2024-04-21T13:15:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:06 smithi170 ceph-mon[31212]: pgmap v5541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T13:15:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:06 smithi077 ceph-mon[27902]: pgmap v5541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T13:15:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:06 smithi191 ceph-mon[31636]: pgmap v5541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T13:15:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10218.469160 secs 2024-04-21T13:15:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10218.469160 secs 2024-04-21T13:15:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10218.469160 secs 2024-04-21T13:15:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:08 smithi170 ceph-mon[31212]: pgmap v5542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:15:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:08 smithi170 ceph-mon[31212]: osdmap e418: 12 total, 12 up, 12 in 2024-04-21T13:15:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:08 smithi077 ceph-mon[27902]: pgmap v5542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:15:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:08 smithi077 ceph-mon[27902]: osdmap e418: 12 total, 12 up, 12 in 2024-04-21T13:15:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:08 smithi191 ceph-mon[31636]: pgmap v5542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:15:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:08 smithi191 ceph-mon[31636]: osdmap e418: 12 total, 12 up, 12 in 2024-04-21T13:15:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10220.229284 secs 2024-04-21T13:15:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:15:09.826 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10220.229284 secs 2024-04-21T13:15:09.827 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:15:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10220.229284 secs 2024-04-21T13:15:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:15:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: pgmap v5544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T13:15:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: pgmap v5544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: pgmap v5544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:15:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:15:11.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:15:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:15:11.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:15:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:15:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: pgmap v5545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-04-21T13:15:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10223.469246 secs 2024-04-21T13:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:15:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:15:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:15:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:15:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: pgmap v5545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-04-21T13:15:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10223.469246 secs 2024-04-21T13:15:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:15:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:15:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:15:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:15:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:15:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:15:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: pgmap v5545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-04-21T13:15:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10223.469246 secs 2024-04-21T13:15:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:14 smithi170 ceph-mon[31212]: pgmap v5546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T13:15:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10225.229363 secs 2024-04-21T13:15:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:14 smithi077 ceph-mon[27902]: pgmap v5546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T13:15:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10225.229363 secs 2024-04-21T13:15:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:14 smithi191 ceph-mon[31636]: pgmap v5546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T13:15:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10225.229363 secs 2024-04-21T13:15:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:16 smithi170 ceph-mon[31212]: pgmap v5547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 KiB/s wr, 21 op/s 2024-04-21T13:15:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:16 smithi077 ceph-mon[27902]: pgmap v5547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 KiB/s wr, 21 op/s 2024-04-21T13:15:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:16 smithi191 ceph-mon[31636]: pgmap v5547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 KiB/s wr, 21 op/s 2024-04-21T13:15:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10228.469367 secs 2024-04-21T13:15:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10228.469367 secs 2024-04-21T13:15:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10228.469367 secs 2024-04-21T13:15:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:18 smithi170 ceph-mon[31212]: pgmap v5548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:15:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:18 smithi191 ceph-mon[31636]: pgmap v5548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:15:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:18 smithi077 ceph-mon[27902]: pgmap v5548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:15:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10230.229483 secs 2024-04-21T13:15:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10230.229483 secs 2024-04-21T13:15:19.977 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10230.229483 secs 2024-04-21T13:15:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:20 smithi077 ceph-mon[27902]: pgmap v5549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:15:20.901 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:20 smithi170 ceph-mon[31212]: pgmap v5549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:15:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:20 smithi191 ceph-mon[31636]: pgmap v5549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:15:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:22 smithi077 ceph-mon[27902]: pgmap v5550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:15:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10233.469459 secs 2024-04-21T13:15:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:22 smithi191 ceph-mon[31636]: pgmap v5550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:15:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10233.469459 secs 2024-04-21T13:15:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:22 smithi170 ceph-mon[31212]: pgmap v5550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:15:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10233.469459 secs 2024-04-21T13:15:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:24 smithi077 ceph-mon[27902]: pgmap v5551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10235.229609 secs 2024-04-21T13:15:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:24 smithi191 ceph-mon[31636]: pgmap v5551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10235.229609 secs 2024-04-21T13:15:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:24 smithi170 ceph-mon[31212]: pgmap v5551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10235.229609 secs 2024-04-21T13:15:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:26 smithi077 ceph-mon[27902]: pgmap v5552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:26 smithi191 ceph-mon[31636]: pgmap v5552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:27.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:26 smithi170 ceph-mon[31212]: pgmap v5552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10238.469553 secs 2024-04-21T13:15:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10238.469553 secs 2024-04-21T13:15:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10238.469553 secs 2024-04-21T13:15:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:28 smithi077 ceph-mon[27902]: pgmap v5553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:28 smithi191 ceph-mon[31636]: pgmap v5553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:28 smithi170 ceph-mon[31212]: pgmap v5553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10240.229746 secs 2024-04-21T13:15:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10240.229746 secs 2024-04-21T13:15:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10240.229746 secs 2024-04-21T13:15:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:30 smithi170 ceph-mon[31212]: pgmap v5554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:30 smithi077 ceph-mon[27902]: pgmap v5554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:30 smithi191 ceph-mon[31636]: pgmap v5554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:32 smithi077 ceph-mon[27902]: pgmap v5555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10243.469674 secs 2024-04-21T13:15:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:32 smithi191 ceph-mon[31636]: pgmap v5555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10243.469674 secs 2024-04-21T13:15:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:32 smithi170 ceph-mon[31212]: pgmap v5555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10243.469674 secs 2024-04-21T13:15:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:34 smithi077 ceph-mon[27902]: pgmap v5556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10245.229883 secs 2024-04-21T13:15:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:34 smithi191 ceph-mon[31636]: pgmap v5556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10245.229883 secs 2024-04-21T13:15:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:34 smithi170 ceph-mon[31212]: pgmap v5556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10245.229883 secs 2024-04-21T13:15:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:36 smithi077 ceph-mon[27902]: pgmap v5557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:36 smithi191 ceph-mon[31636]: pgmap v5557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:36 smithi170 ceph-mon[31212]: pgmap v5557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10248.469740 secs 2024-04-21T13:15:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10248.469740 secs 2024-04-21T13:15:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10248.469740 secs 2024-04-21T13:15:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:38 smithi077 ceph-mon[27902]: pgmap v5558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:38 smithi191 ceph-mon[31636]: pgmap v5558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:38 smithi170 ceph-mon[31212]: pgmap v5558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10250.229963 secs 2024-04-21T13:15:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10250.229963 secs 2024-04-21T13:15:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10250.229963 secs 2024-04-21T13:15:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:40 smithi077 ceph-mon[27902]: pgmap v5559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:40 smithi191 ceph-mon[31636]: pgmap v5559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:40 smithi170 ceph-mon[31212]: pgmap v5559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:42 smithi077 ceph-mon[27902]: pgmap v5560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10253.469860 secs 2024-04-21T13:15:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:42 smithi191 ceph-mon[31636]: pgmap v5560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10253.469860 secs 2024-04-21T13:15:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:42 smithi170 ceph-mon[31212]: pgmap v5560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10253.469860 secs 2024-04-21T13:15:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:44 smithi077 ceph-mon[27902]: pgmap v5561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10255.230079 secs 2024-04-21T13:15:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:44 smithi191 ceph-mon[31636]: pgmap v5561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10255.230079 secs 2024-04-21T13:15:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:44 smithi170 ceph-mon[31212]: pgmap v5561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10255.230079 secs 2024-04-21T13:15:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:46 smithi077 ceph-mon[27902]: pgmap v5562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:46 smithi191 ceph-mon[31636]: pgmap v5562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:46 smithi170 ceph-mon[31212]: pgmap v5562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10258.469921 secs 2024-04-21T13:15:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10258.469921 secs 2024-04-21T13:15:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10258.469921 secs 2024-04-21T13:15:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:48 smithi077 ceph-mon[27902]: pgmap v5563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:48 smithi170 ceph-mon[31212]: pgmap v5563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:48 smithi191 ceph-mon[31636]: pgmap v5563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10260.230185 secs 2024-04-21T13:15:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10260.230185 secs 2024-04-21T13:15:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10260.230185 secs 2024-04-21T13:15:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:50 smithi191 ceph-mon[31636]: pgmap v5564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:50 smithi170 ceph-mon[31212]: pgmap v5564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:50 smithi077 ceph-mon[27902]: pgmap v5564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:51.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:51 smithi191 ceph-mon[31636]: pgmap v5565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:52.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:51 smithi170 ceph-mon[31212]: pgmap v5565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:51 smithi077 ceph-mon[27902]: pgmap v5565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10263.470047 secs 2024-04-21T13:15:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10263.470047 secs 2024-04-21T13:15:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10263.470047 secs 2024-04-21T13:15:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:53 smithi191 ceph-mon[31636]: pgmap v5566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:53 smithi170 ceph-mon[31212]: pgmap v5566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:53 smithi077 ceph-mon[27902]: pgmap v5566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10265.230300 secs 2024-04-21T13:15:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10265.230300 secs 2024-04-21T13:15:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:15:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10265.230300 secs 2024-04-21T13:15:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:55 smithi191 ceph-mon[31636]: pgmap v5567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:55 smithi170 ceph-mon[31212]: pgmap v5567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:55 smithi077 ceph-mon[27902]: pgmap v5567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:15:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10268.470157 secs 2024-04-21T13:15:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10268.470157 secs 2024-04-21T13:15:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10268.470157 secs 2024-04-21T13:15:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:58 smithi170 ceph-mon[31212]: pgmap v5568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:58 smithi077 ceph-mon[27902]: pgmap v5568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:58 smithi191 ceph-mon[31636]: pgmap v5568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:15:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10270.230434 secs 2024-04-21T13:15:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10270.230434 secs 2024-04-21T13:15:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10270.230434 secs 2024-04-21T13:16:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:00 smithi170 ceph-mon[31212]: pgmap v5569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:00 smithi077 ceph-mon[27902]: pgmap v5569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:00 smithi191 ceph-mon[31636]: pgmap v5569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:02 smithi191 ceph-mon[31636]: pgmap v5570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T13:16:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10273.470270 secs 2024-04-21T13:16:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:02 smithi170 ceph-mon[31212]: pgmap v5570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T13:16:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10273.470270 secs 2024-04-21T13:16:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:02 smithi077 ceph-mon[27902]: pgmap v5570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T13:16:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10273.470270 secs 2024-04-21T13:16:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:04 smithi191 ceph-mon[31636]: pgmap v5571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T13:16:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10275.230575 secs 2024-04-21T13:16:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:04 smithi170 ceph-mon[31212]: pgmap v5571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T13:16:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10275.230575 secs 2024-04-21T13:16:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:04 smithi077 ceph-mon[27902]: pgmap v5571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T13:16:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10275.230575 secs 2024-04-21T13:16:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:05 smithi191 ceph-mon[31636]: osdmap e419: 12 total, 12 up, 12 in 2024-04-21T13:16:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:05 smithi170 ceph-mon[31212]: osdmap e419: 12 total, 12 up, 12 in 2024-04-21T13:16:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:05 smithi077 ceph-mon[27902]: osdmap e419: 12 total, 12 up, 12 in 2024-04-21T13:16:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:06 smithi191 ceph-mon[31636]: pgmap v5573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-04-21T13:16:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:06 smithi170 ceph-mon[31212]: pgmap v5573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-04-21T13:16:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:06 smithi077 ceph-mon[27902]: pgmap v5573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-04-21T13:16:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10278.470410 secs 2024-04-21T13:16:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10278.470410 secs 2024-04-21T13:16:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10278.470410 secs 2024-04-21T13:16:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:08 smithi170 ceph-mon[31212]: pgmap v5574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:16:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:08 smithi077 ceph-mon[27902]: pgmap v5574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:16:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:08 smithi191 ceph-mon[31636]: pgmap v5574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:16:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10280.230713 secs 2024-04-21T13:16:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:09 smithi191 ceph-mon[31636]: osdmap e420: 12 total, 12 up, 12 in 2024-04-21T13:16:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10280.230713 secs 2024-04-21T13:16:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:09 smithi170 ceph-mon[31212]: osdmap e420: 12 total, 12 up, 12 in 2024-04-21T13:16:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10280.230713 secs 2024-04-21T13:16:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:09 smithi077 ceph-mon[27902]: osdmap e420: 12 total, 12 up, 12 in 2024-04-21T13:16:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:10 smithi191 ceph-mon[31636]: pgmap v5576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T13:16:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:10 smithi170 ceph-mon[31212]: pgmap v5576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T13:16:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:10 smithi077 ceph-mon[27902]: pgmap v5576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T13:16:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:16:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:16:11.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: pgmap v5577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10283.470497 secs 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:16:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: pgmap v5577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T13:16:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10283.470497 secs 2024-04-21T13:16:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:16:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:16:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: pgmap v5577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10283.470497 secs 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:16:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:16:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:14 smithi191 ceph-mon[31636]: pgmap v5578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T13:16:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10285.230830 secs 2024-04-21T13:16:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:14 smithi170 ceph-mon[31212]: pgmap v5578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T13:16:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10285.230830 secs 2024-04-21T13:16:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:14 smithi077 ceph-mon[27902]: pgmap v5578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T13:16:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10285.230830 secs 2024-04-21T13:16:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:16.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:16 smithi191 ceph-mon[31636]: pgmap v5579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-21T13:16:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:16 smithi170 ceph-mon[31212]: pgmap v5579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-21T13:16:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:16 smithi077 ceph-mon[27902]: pgmap v5579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-21T13:16:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10288.470613 secs 2024-04-21T13:16:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10288.470613 secs 2024-04-21T13:16:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10288.470613 secs 2024-04-21T13:16:18.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:18 smithi170 ceph-mon[31212]: pgmap v5580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:16:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:18 smithi191 ceph-mon[31636]: pgmap v5580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:16:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:18 smithi077 ceph-mon[27902]: pgmap v5580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:16:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10290.230945 secs 2024-04-21T13:16:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10290.230945 secs 2024-04-21T13:16:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10290.230945 secs 2024-04-21T13:16:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:20 smithi191 ceph-mon[31636]: pgmap v5581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:16:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:20 smithi170 ceph-mon[31212]: pgmap v5581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:16:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:20 smithi077 ceph-mon[27902]: pgmap v5581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:16:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:22 smithi191 ceph-mon[31636]: pgmap v5582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:16:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10293.470778 secs 2024-04-21T13:16:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:22 smithi170 ceph-mon[31212]: pgmap v5582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:16:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10293.470778 secs 2024-04-21T13:16:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:22 smithi077 ceph-mon[27902]: pgmap v5582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:16:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10293.470778 secs 2024-04-21T13:16:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:24 smithi191 ceph-mon[31636]: pgmap v5583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10295.231024 secs 2024-04-21T13:16:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:24 smithi170 ceph-mon[31212]: pgmap v5583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10295.231024 secs 2024-04-21T13:16:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:24 smithi077 ceph-mon[27902]: pgmap v5583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10295.231024 secs 2024-04-21T13:16:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:26 smithi191 ceph-mon[31636]: pgmap v5584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:26 smithi170 ceph-mon[31212]: pgmap v5584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:26 smithi077 ceph-mon[27902]: pgmap v5584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10298.470860 secs 2024-04-21T13:16:27.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10298.470860 secs 2024-04-21T13:16:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10298.470860 secs 2024-04-21T13:16:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:28 smithi191 ceph-mon[31636]: pgmap v5585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:28 smithi170 ceph-mon[31212]: pgmap v5585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:28 smithi077 ceph-mon[27902]: pgmap v5585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10300.231133 secs 2024-04-21T13:16:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10300.231133 secs 2024-04-21T13:16:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10300.231133 secs 2024-04-21T13:16:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:30 smithi191 ceph-mon[31636]: pgmap v5586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:30 smithi170 ceph-mon[31212]: pgmap v5586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:30 smithi077 ceph-mon[27902]: pgmap v5586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:32 smithi170 ceph-mon[31212]: pgmap v5587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10303.470983 secs 2024-04-21T13:16:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:32 smithi077 ceph-mon[27902]: pgmap v5587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10303.470983 secs 2024-04-21T13:16:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:32 smithi191 ceph-mon[31636]: pgmap v5587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10303.470983 secs 2024-04-21T13:16:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:34 smithi170 ceph-mon[31212]: pgmap v5588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10305.231267 secs 2024-04-21T13:16:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:34 smithi077 ceph-mon[27902]: pgmap v5588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10305.231267 secs 2024-04-21T13:16:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:34 smithi191 ceph-mon[31636]: pgmap v5588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10305.231267 secs 2024-04-21T13:16:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:36 smithi170 ceph-mon[31212]: pgmap v5589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:36 smithi077 ceph-mon[27902]: pgmap v5589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:36 smithi191 ceph-mon[31636]: pgmap v5589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10308.471060 secs 2024-04-21T13:16:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10308.471060 secs 2024-04-21T13:16:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10308.471060 secs 2024-04-21T13:16:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:38 smithi170 ceph-mon[31212]: pgmap v5590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:38 smithi077 ceph-mon[27902]: pgmap v5590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:38 smithi191 ceph-mon[31636]: pgmap v5590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10310.231381 secs 2024-04-21T13:16:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10310.231381 secs 2024-04-21T13:16:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10310.231381 secs 2024-04-21T13:16:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:40 smithi170 ceph-mon[31212]: pgmap v5591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:40 smithi077 ceph-mon[27902]: pgmap v5591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:40 smithi191 ceph-mon[31636]: pgmap v5591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:42 smithi170 ceph-mon[31212]: pgmap v5592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10313.471136 secs 2024-04-21T13:16:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:42 smithi077 ceph-mon[27902]: pgmap v5592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10313.471136 secs 2024-04-21T13:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:42 smithi191 ceph-mon[31636]: pgmap v5592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10313.471136 secs 2024-04-21T13:16:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:44 smithi170 ceph-mon[31212]: pgmap v5593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10315.231469 secs 2024-04-21T13:16:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:44 smithi077 ceph-mon[27902]: pgmap v5593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10315.231469 secs 2024-04-21T13:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:44 smithi191 ceph-mon[31636]: pgmap v5593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10315.231469 secs 2024-04-21T13:16:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:46 smithi170 ceph-mon[31212]: pgmap v5594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:46 smithi077 ceph-mon[27902]: pgmap v5594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:46 smithi191 ceph-mon[31636]: pgmap v5594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10318.471229 secs 2024-04-21T13:16:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10318.471229 secs 2024-04-21T13:16:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10318.471229 secs 2024-04-21T13:16:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:48 smithi170 ceph-mon[31212]: pgmap v5595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:48 smithi191 ceph-mon[31636]: pgmap v5595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:48 smithi077 ceph-mon[27902]: pgmap v5595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10320.231575 secs 2024-04-21T13:16:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10320.231575 secs 2024-04-21T13:16:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10320.231575 secs 2024-04-21T13:16:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:50 smithi170 ceph-mon[31212]: pgmap v5596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:50 smithi077 ceph-mon[27902]: pgmap v5596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:50 smithi191 ceph-mon[31636]: pgmap v5596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:52 smithi170 ceph-mon[31212]: pgmap v5597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10323.471351 secs 2024-04-21T13:16:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:52 smithi077 ceph-mon[27902]: pgmap v5597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10323.471351 secs 2024-04-21T13:16:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:52 smithi191 ceph-mon[31636]: pgmap v5597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10323.471351 secs 2024-04-21T13:16:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:54 smithi170 ceph-mon[31212]: pgmap v5598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10325.231692 secs 2024-04-21T13:16:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:54 smithi077 ceph-mon[27902]: pgmap v5598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10325.231692 secs 2024-04-21T13:16:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:54 smithi191 ceph-mon[31636]: pgmap v5598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10325.231692 secs 2024-04-21T13:16:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:16:55.778 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:16:55.779+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:16:55.778 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:16:55.779+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:16:55.778 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:16:55.779+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:16:55.778 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:16:55.779+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:16:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:56 smithi170 ceph-mon[31212]: pgmap v5599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:56 smithi077 ceph-mon[27902]: pgmap v5599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:56 smithi191 ceph-mon[31636]: pgmap v5599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:16:57.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10328.471472 secs 2024-04-21T13:16:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10328.471472 secs 2024-04-21T13:16:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10328.471472 secs 2024-04-21T13:16:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:58 smithi170 ceph-mon[31212]: pgmap v5600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:58 smithi077 ceph-mon[27902]: pgmap v5600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:58 smithi191 ceph-mon[31636]: pgmap v5600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10330.231804 secs 2024-04-21T13:16:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10330.231804 secs 2024-04-21T13:16:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10330.231804 secs 2024-04-21T13:17:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:00 smithi170 ceph-mon[31212]: pgmap v5601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:00 smithi077 ceph-mon[27902]: pgmap v5601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:00 smithi191 ceph-mon[31636]: pgmap v5601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:02 smithi170 ceph-mon[31212]: pgmap v5602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10333.471611 secs 2024-04-21T13:17:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:02 smithi077 ceph-mon[27902]: pgmap v5602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10333.471611 secs 2024-04-21T13:17:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:02 smithi191 ceph-mon[31636]: pgmap v5602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10333.471611 secs 2024-04-21T13:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:04 smithi170 ceph-mon[31212]: pgmap v5603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10335.231923 secs 2024-04-21T13:17:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:04 smithi170 ceph-mon[31212]: osdmap e421: 12 total, 12 up, 12 in 2024-04-21T13:17:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:04 smithi077 ceph-mon[27902]: pgmap v5603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10335.231923 secs 2024-04-21T13:17:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:04 smithi077 ceph-mon[27902]: osdmap e421: 12 total, 12 up, 12 in 2024-04-21T13:17:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:04 smithi191 ceph-mon[31636]: pgmap v5603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10335.231923 secs 2024-04-21T13:17:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:04 smithi191 ceph-mon[31636]: osdmap e421: 12 total, 12 up, 12 in 2024-04-21T13:17:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:06 smithi170 ceph-mon[31212]: pgmap v5605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:17:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:06 smithi077 ceph-mon[27902]: pgmap v5605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:17:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:06 smithi191 ceph-mon[31636]: pgmap v5605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:17:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10338.471728 secs 2024-04-21T13:17:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10338.471728 secs 2024-04-21T13:17:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10338.471728 secs 2024-04-21T13:17:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:08 smithi077 ceph-mon[27902]: pgmap v5606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:17:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:08 smithi077 ceph-mon[27902]: osdmap e422: 12 total, 12 up, 12 in 2024-04-21T13:17:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:08 smithi191 ceph-mon[31636]: pgmap v5606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:17:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:08 smithi191 ceph-mon[31636]: osdmap e422: 12 total, 12 up, 12 in 2024-04-21T13:17:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:08 smithi170 ceph-mon[31212]: pgmap v5606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:17:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:08 smithi170 ceph-mon[31212]: osdmap e422: 12 total, 12 up, 12 in 2024-04-21T13:17:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10340.232038 secs 2024-04-21T13:17:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10340.232038 secs 2024-04-21T13:17:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10340.232038 secs 2024-04-21T13:17:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:10 smithi077 ceph-mon[27902]: pgmap v5608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:17:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:10 smithi191 ceph-mon[31636]: pgmap v5608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:17:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:10 smithi170 ceph-mon[31212]: pgmap v5608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:17:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:12 smithi077 ceph-mon[27902]: pgmap v5609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:17:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10343.471848 secs 2024-04-21T13:17:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:12 smithi191 ceph-mon[31636]: pgmap v5609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:17:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10343.471848 secs 2024-04-21T13:17:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:12 smithi170 ceph-mon[31212]: pgmap v5609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:17:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10343.471848 secs 2024-04-21T13:17:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:17:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:17:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:14 smithi077 ceph-mon[27902]: pgmap v5610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:17:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10345.232102 secs 2024-04-21T13:17:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:17:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:17:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:14 smithi191 ceph-mon[31636]: pgmap v5610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10345.232102 secs 2024-04-21T13:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:17:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:14 smithi170 ceph-mon[31212]: pgmap v5610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:17:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10345.232102 secs 2024-04-21T13:17:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:17:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:17:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:17:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:16 smithi077 ceph-mon[27902]: pgmap v5611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:17:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:16 smithi191 ceph-mon[31636]: pgmap v5611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:17:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:16 smithi170 ceph-mon[31212]: pgmap v5611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:17:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10348.471959 secs 2024-04-21T13:17:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10348.471959 secs 2024-04-21T13:17:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10348.471959 secs 2024-04-21T13:17:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:18 smithi191 ceph-mon[31636]: pgmap v5612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:17:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:18 smithi077 ceph-mon[27902]: pgmap v5612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:17:18.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:18 smithi170 ceph-mon[31212]: pgmap v5612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:17:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10350.232200 secs 2024-04-21T13:17:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10350.232200 secs 2024-04-21T13:17:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10350.232200 secs 2024-04-21T13:17:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:20 smithi077 ceph-mon[27902]: pgmap v5613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:17:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:20 smithi191 ceph-mon[31636]: pgmap v5613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:17:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:20 smithi170 ceph-mon[31212]: pgmap v5613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:17:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:22 smithi077 ceph-mon[27902]: pgmap v5614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:17:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10353.472038 secs 2024-04-21T13:17:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:22 smithi191 ceph-mon[31636]: pgmap v5614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:17:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10353.472038 secs 2024-04-21T13:17:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:22 smithi170 ceph-mon[31212]: pgmap v5614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:17:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10353.472038 secs 2024-04-21T13:17:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:24 smithi077 ceph-mon[27902]: pgmap v5615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10355.232321 secs 2024-04-21T13:17:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:24 smithi191 ceph-mon[31636]: pgmap v5615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10355.232321 secs 2024-04-21T13:17:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:24 smithi170 ceph-mon[31212]: pgmap v5615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10355.232321 secs 2024-04-21T13:17:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:26 smithi077 ceph-mon[27902]: pgmap v5616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:26 smithi191 ceph-mon[31636]: pgmap v5616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:26 smithi170 ceph-mon[31212]: pgmap v5616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10358.472102 secs 2024-04-21T13:17:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10358.472102 secs 2024-04-21T13:17:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10358.472102 secs 2024-04-21T13:17:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:28 smithi077 ceph-mon[27902]: pgmap v5617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:28 smithi191 ceph-mon[31636]: pgmap v5617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:28 smithi170 ceph-mon[31212]: pgmap v5617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10360.232432 secs 2024-04-21T13:17:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10360.232432 secs 2024-04-21T13:17:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10360.232432 secs 2024-04-21T13:17:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:30 smithi077 ceph-mon[27902]: pgmap v5618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:30 smithi191 ceph-mon[31636]: pgmap v5618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:30 smithi170 ceph-mon[31212]: pgmap v5618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:32 smithi077 ceph-mon[27902]: pgmap v5619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10363.472229 secs 2024-04-21T13:17:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:32 smithi191 ceph-mon[31636]: pgmap v5619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10363.472229 secs 2024-04-21T13:17:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:32 smithi170 ceph-mon[31212]: pgmap v5619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10363.472229 secs 2024-04-21T13:17:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:34 smithi077 ceph-mon[27902]: pgmap v5620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:34.911 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10365.232543 secs 2024-04-21T13:17:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:34 smithi191 ceph-mon[31636]: pgmap v5620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10365.232543 secs 2024-04-21T13:17:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:34 smithi170 ceph-mon[31212]: pgmap v5620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10365.232543 secs 2024-04-21T13:17:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:36 smithi077 ceph-mon[27902]: pgmap v5621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:36 smithi191 ceph-mon[31636]: pgmap v5621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:36 smithi170 ceph-mon[31212]: pgmap v5621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10368.472378 secs 2024-04-21T13:17:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10368.472378 secs 2024-04-21T13:17:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10368.472378 secs 2024-04-21T13:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:38 smithi077 ceph-mon[27902]: pgmap v5622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:38 smithi191 ceph-mon[31636]: pgmap v5622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:38 smithi170 ceph-mon[31212]: pgmap v5622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10370.232631 secs 2024-04-21T13:17:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10370.232631 secs 2024-04-21T13:17:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10370.232631 secs 2024-04-21T13:17:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:40 smithi191 ceph-mon[31636]: pgmap v5623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:40 smithi170 ceph-mon[31212]: pgmap v5623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:40 smithi077 ceph-mon[27902]: pgmap v5623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:42 smithi191 ceph-mon[31636]: pgmap v5624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10373.472470 secs 2024-04-21T13:17:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:42 smithi170 ceph-mon[31212]: pgmap v5624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10373.472470 secs 2024-04-21T13:17:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:42 smithi077 ceph-mon[27902]: pgmap v5624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10373.472470 secs 2024-04-21T13:17:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:44 smithi191 ceph-mon[31636]: pgmap v5625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10375.232772 secs 2024-04-21T13:17:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:44 smithi170 ceph-mon[31212]: pgmap v5625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10375.232772 secs 2024-04-21T13:17:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:44 smithi077 ceph-mon[27902]: pgmap v5625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10375.232772 secs 2024-04-21T13:17:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:46 smithi191 ceph-mon[31636]: pgmap v5626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:46 smithi170 ceph-mon[31212]: pgmap v5626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:46 smithi077 ceph-mon[27902]: pgmap v5626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10378.472583 secs 2024-04-21T13:17:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10378.472583 secs 2024-04-21T13:17:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10378.472583 secs 2024-04-21T13:17:48.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:48 smithi170 ceph-mon[31212]: pgmap v5627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:48 smithi191 ceph-mon[31636]: pgmap v5627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:48 smithi077 ceph-mon[27902]: pgmap v5627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10380.232887 secs 2024-04-21T13:17:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:49 smithi191 ceph-mon[31636]: pgmap v5628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10380.232887 secs 2024-04-21T13:17:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:49 smithi170 ceph-mon[31212]: pgmap v5628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10380.232887 secs 2024-04-21T13:17:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:49 smithi077 ceph-mon[27902]: pgmap v5628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:52 smithi170 ceph-mon[31212]: pgmap v5629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10383.472719 secs 2024-04-21T13:17:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:52 smithi077 ceph-mon[27902]: pgmap v5629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10383.472719 secs 2024-04-21T13:17:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:52 smithi191 ceph-mon[31636]: pgmap v5629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10383.472719 secs 2024-04-21T13:17:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:54 smithi170 ceph-mon[31212]: pgmap v5630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10385.232994 secs 2024-04-21T13:17:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:54 smithi077 ceph-mon[27902]: pgmap v5630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10385.232994 secs 2024-04-21T13:17:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:54 smithi191 ceph-mon[31636]: pgmap v5630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10385.232994 secs 2024-04-21T13:17:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:17:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:56 smithi170 ceph-mon[31212]: pgmap v5631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:56 smithi077 ceph-mon[27902]: pgmap v5631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:56 smithi191 ceph-mon[31636]: pgmap v5631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:17:57.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10388.472843 secs 2024-04-21T13:17:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10388.472843 secs 2024-04-21T13:17:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10388.472843 secs 2024-04-21T13:17:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:58 smithi170 ceph-mon[31212]: pgmap v5632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:58 smithi077 ceph-mon[27902]: pgmap v5632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:58 smithi191 ceph-mon[31636]: pgmap v5632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:17:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10390.233130 secs 2024-04-21T13:17:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10390.233130 secs 2024-04-21T13:17:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10390.233130 secs 2024-04-21T13:18:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:00 smithi170 ceph-mon[31212]: pgmap v5633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:00 smithi077 ceph-mon[27902]: pgmap v5633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:00 smithi191 ceph-mon[31636]: pgmap v5633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:02.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:02 smithi170 ceph-mon[31212]: pgmap v5634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:02.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10393.472947 secs 2024-04-21T13:18:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:02 smithi077 ceph-mon[27902]: pgmap v5634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10393.472947 secs 2024-04-21T13:18:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:02 smithi191 ceph-mon[31636]: pgmap v5634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10393.472947 secs 2024-04-21T13:18:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:04 smithi170 ceph-mon[31212]: pgmap v5635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10395.233253 secs 2024-04-21T13:18:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:04 smithi077 ceph-mon[27902]: pgmap v5635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10395.233253 secs 2024-04-21T13:18:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:04 smithi191 ceph-mon[31636]: pgmap v5635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10395.233253 secs 2024-04-21T13:18:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:05 smithi170 ceph-mon[31212]: osdmap e423: 12 total, 12 up, 12 in 2024-04-21T13:18:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:05 smithi077 ceph-mon[27902]: osdmap e423: 12 total, 12 up, 12 in 2024-04-21T13:18:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:05 smithi191 ceph-mon[31636]: osdmap e423: 12 total, 12 up, 12 in 2024-04-21T13:18:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:06 smithi170 ceph-mon[31212]: pgmap v5637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:18:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:06 smithi077 ceph-mon[27902]: pgmap v5637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:18:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:06 smithi191 ceph-mon[31636]: pgmap v5637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T13:18:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10398.473005 secs 2024-04-21T13:18:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10398.473005 secs 2024-04-21T13:18:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10398.473005 secs 2024-04-21T13:18:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:08 smithi170 ceph-mon[31212]: pgmap v5638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:18:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:08 smithi077 ceph-mon[27902]: pgmap v5638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:18:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:08 smithi191 ceph-mon[31636]: pgmap v5638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:18:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10400.233376 secs 2024-04-21T13:18:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:09 smithi191 ceph-mon[31636]: osdmap e424: 12 total, 12 up, 12 in 2024-04-21T13:18:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10400.233376 secs 2024-04-21T13:18:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:09 smithi170 ceph-mon[31212]: osdmap e424: 12 total, 12 up, 12 in 2024-04-21T13:18:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10400.233376 secs 2024-04-21T13:18:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:09 smithi077 ceph-mon[27902]: osdmap e424: 12 total, 12 up, 12 in 2024-04-21T13:18:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:10 smithi191 ceph-mon[31636]: pgmap v5640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:18:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:10 smithi170 ceph-mon[31212]: pgmap v5640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:18:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:10 smithi077 ceph-mon[27902]: pgmap v5640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:18:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:12 smithi191 ceph-mon[31636]: pgmap v5641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:18:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10403.473124 secs 2024-04-21T13:18:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:12 smithi170 ceph-mon[31212]: pgmap v5641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:18:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10403.473124 secs 2024-04-21T13:18:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:12 smithi077 ceph-mon[27902]: pgmap v5641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:18:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10403.473124 secs 2024-04-21T13:18:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:14 smithi191 ceph-mon[31636]: pgmap v5642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:18:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10405.233492 secs 2024-04-21T13:18:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:18:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:14 smithi170 ceph-mon[31212]: pgmap v5642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:18:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10405.233492 secs 2024-04-21T13:18:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:18:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:14 smithi077 ceph-mon[27902]: pgmap v5642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:18:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10405.233492 secs 2024-04-21T13:18:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:18:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:18:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:18:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:18:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:18:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:18:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:18:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:18:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:18:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:18:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:16 smithi170 ceph-mon[31212]: pgmap v5643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:18:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:16 smithi077 ceph-mon[27902]: pgmap v5643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:18:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:16 smithi191 ceph-mon[31636]: pgmap v5643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:18:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10408.473196 secs 2024-04-21T13:18:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10408.473196 secs 2024-04-21T13:18:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10408.473196 secs 2024-04-21T13:18:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:18 smithi170 ceph-mon[31212]: pgmap v5644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:18:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:18 smithi191 ceph-mon[31636]: pgmap v5644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:18:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:18 smithi077 ceph-mon[27902]: pgmap v5644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:18:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10410.233632 secs 2024-04-21T13:18:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10410.233632 secs 2024-04-21T13:18:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10410.233632 secs 2024-04-21T13:18:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:20 smithi170 ceph-mon[31212]: pgmap v5645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:18:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:20 smithi077 ceph-mon[27902]: pgmap v5645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:18:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:20 smithi191 ceph-mon[31636]: pgmap v5645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:18:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:22 smithi170 ceph-mon[31212]: pgmap v5646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:18:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10413.473316 secs 2024-04-21T13:18:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:22 smithi077 ceph-mon[27902]: pgmap v5646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:18:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10413.473316 secs 2024-04-21T13:18:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:22 smithi191 ceph-mon[31636]: pgmap v5646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:18:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10413.473316 secs 2024-04-21T13:18:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:24 smithi170 ceph-mon[31212]: pgmap v5647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10415.233772 secs 2024-04-21T13:18:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:24 smithi077 ceph-mon[27902]: pgmap v5647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10415.233772 secs 2024-04-21T13:18:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:24 smithi191 ceph-mon[31636]: pgmap v5647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10415.233772 secs 2024-04-21T13:18:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:26 smithi170 ceph-mon[31212]: pgmap v5648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:18:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:26 smithi077 ceph-mon[27902]: pgmap v5648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:18:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:26 smithi191 ceph-mon[31636]: pgmap v5648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:18:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10418.473431 secs 2024-04-21T13:18:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10418.473431 secs 2024-04-21T13:18:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10418.473431 secs 2024-04-21T13:18:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:28 smithi077 ceph-mon[27902]: pgmap v5649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:28 smithi191 ceph-mon[31636]: pgmap v5649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:28 smithi170 ceph-mon[31212]: pgmap v5649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10420.233837 secs 2024-04-21T13:18:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10420.233837 secs 2024-04-21T13:18:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10420.233837 secs 2024-04-21T13:18:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:30 smithi077 ceph-mon[27902]: pgmap v5650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:30 smithi191 ceph-mon[31636]: pgmap v5650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:30 smithi170 ceph-mon[31212]: pgmap v5650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:32 smithi077 ceph-mon[27902]: pgmap v5651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10423.473514 secs 2024-04-21T13:18:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:32 smithi191 ceph-mon[31636]: pgmap v5651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10423.473514 secs 2024-04-21T13:18:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:32 smithi170 ceph-mon[31212]: pgmap v5651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10423.473514 secs 2024-04-21T13:18:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:34 smithi077 ceph-mon[27902]: pgmap v5652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10425.233960 secs 2024-04-21T13:18:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:34 smithi191 ceph-mon[31636]: pgmap v5652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10425.233960 secs 2024-04-21T13:18:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:34 smithi170 ceph-mon[31212]: pgmap v5652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10425.233960 secs 2024-04-21T13:18:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:36 smithi077 ceph-mon[27902]: pgmap v5653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T13:18:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:36 smithi191 ceph-mon[31636]: pgmap v5653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T13:18:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:36 smithi170 ceph-mon[31212]: pgmap v5653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T13:18:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10428.473630 secs 2024-04-21T13:18:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10428.473630 secs 2024-04-21T13:18:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10428.473630 secs 2024-04-21T13:18:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:38 smithi077 ceph-mon[27902]: pgmap v5654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:38 smithi191 ceph-mon[31636]: pgmap v5654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:38 smithi170 ceph-mon[31212]: pgmap v5654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10430.234038 secs 2024-04-21T13:18:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10430.234038 secs 2024-04-21T13:18:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10430.234038 secs 2024-04-21T13:18:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:40 smithi077 ceph-mon[27902]: pgmap v5655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:40 smithi191 ceph-mon[31636]: pgmap v5655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:40 smithi170 ceph-mon[31212]: pgmap v5655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:42 smithi077 ceph-mon[27902]: pgmap v5656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10433.473745 secs 2024-04-21T13:18:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:42 smithi191 ceph-mon[31636]: pgmap v5656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10433.473745 secs 2024-04-21T13:18:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:42 smithi170 ceph-mon[31212]: pgmap v5656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10433.473745 secs 2024-04-21T13:18:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:44 smithi077 ceph-mon[27902]: pgmap v5657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10435.234103 secs 2024-04-21T13:18:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:44 smithi191 ceph-mon[31636]: pgmap v5657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10435.234103 secs 2024-04-21T13:18:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:44 smithi170 ceph-mon[31212]: pgmap v5657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10435.234103 secs 2024-04-21T13:18:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:46 smithi077 ceph-mon[27902]: pgmap v5658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:18:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:46 smithi191 ceph-mon[31636]: pgmap v5658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:18:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:46 smithi170 ceph-mon[31212]: pgmap v5658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:18:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10438.473779 secs 2024-04-21T13:18:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10438.473779 secs 2024-04-21T13:18:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10438.473779 secs 2024-04-21T13:18:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:48 smithi191 ceph-mon[31636]: pgmap v5659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T13:18:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:48 smithi077 ceph-mon[27902]: pgmap v5659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T13:18:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:48 smithi170 ceph-mon[31212]: pgmap v5659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T13:18:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10440.234227 secs 2024-04-21T13:18:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10440.234227 secs 2024-04-21T13:18:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10440.234227 secs 2024-04-21T13:18:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:50 smithi077 ceph-mon[27902]: pgmap v5660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:50 smithi191 ceph-mon[31636]: pgmap v5660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:50 smithi170 ceph-mon[31212]: pgmap v5660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:52 smithi077 ceph-mon[27902]: pgmap v5661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10443.473900 secs 2024-04-21T13:18:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:52 smithi191 ceph-mon[31636]: pgmap v5661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10443.473900 secs 2024-04-21T13:18:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:52 smithi170 ceph-mon[31212]: pgmap v5661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:18:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10443.473900 secs 2024-04-21T13:18:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:54 smithi077 ceph-mon[27902]: pgmap v5662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10445.234381 secs 2024-04-21T13:18:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:54 smithi191 ceph-mon[31636]: pgmap v5662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10445.234381 secs 2024-04-21T13:18:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:54 smithi170 ceph-mon[31212]: pgmap v5662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:18:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10445.234381 secs 2024-04-21T13:18:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:18:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:56 smithi077 ceph-mon[27902]: pgmap v5663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:18:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:56 smithi191 ceph-mon[31636]: pgmap v5663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:18:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:56 smithi170 ceph-mon[31212]: pgmap v5663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:18:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10448.473996 secs 2024-04-21T13:18:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10448.473996 secs 2024-04-21T13:18:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10448.473996 secs 2024-04-21T13:18:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:58 smithi077 ceph-mon[27902]: pgmap v5664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:18:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:58 smithi191 ceph-mon[31636]: pgmap v5664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:18:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:58 smithi170 ceph-mon[31212]: pgmap v5664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:18:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10450.234512 secs 2024-04-21T13:19:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10450.234512 secs 2024-04-21T13:19:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10450.234512 secs 2024-04-21T13:19:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:00 smithi191 ceph-mon[31636]: pgmap v5665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:00 smithi170 ceph-mon[31212]: pgmap v5665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:00 smithi077 ceph-mon[27902]: pgmap v5665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:02 smithi191 ceph-mon[31636]: pgmap v5666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10453.474125 secs 2024-04-21T13:19:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:02 smithi170 ceph-mon[31212]: pgmap v5666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10453.474125 secs 2024-04-21T13:19:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:02 smithi077 ceph-mon[27902]: pgmap v5666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10453.474125 secs 2024-04-21T13:19:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:04 smithi191 ceph-mon[31636]: pgmap v5667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10455.234650 secs 2024-04-21T13:19:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:04 smithi191 ceph-mon[31636]: osdmap e425: 12 total, 12 up, 12 in 2024-04-21T13:19:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:04 smithi170 ceph-mon[31212]: pgmap v5667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10455.234650 secs 2024-04-21T13:19:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:04 smithi170 ceph-mon[31212]: osdmap e425: 12 total, 12 up, 12 in 2024-04-21T13:19:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:04 smithi077 ceph-mon[27902]: pgmap v5667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10455.234650 secs 2024-04-21T13:19:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:04 smithi077 ceph-mon[27902]: osdmap e425: 12 total, 12 up, 12 in 2024-04-21T13:19:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:06 smithi191 ceph-mon[31636]: pgmap v5669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:19:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:06 smithi170 ceph-mon[31212]: pgmap v5669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:19:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:06 smithi077 ceph-mon[27902]: pgmap v5669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:19:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10458.474242 secs 2024-04-21T13:19:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10458.474242 secs 2024-04-21T13:19:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10458.474242 secs 2024-04-21T13:19:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:08 smithi191 ceph-mon[31636]: pgmap v5670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:19:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:08 smithi191 ceph-mon[31636]: osdmap e426: 12 total, 12 up, 12 in 2024-04-21T13:19:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:08 smithi170 ceph-mon[31212]: pgmap v5670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:19:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:08 smithi170 ceph-mon[31212]: osdmap e426: 12 total, 12 up, 12 in 2024-04-21T13:19:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:08 smithi077 ceph-mon[27902]: pgmap v5670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:19:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:08 smithi077 ceph-mon[27902]: osdmap e426: 12 total, 12 up, 12 in 2024-04-21T13:19:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10460.234770 secs 2024-04-21T13:19:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10460.234770 secs 2024-04-21T13:19:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10460.234770 secs 2024-04-21T13:19:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:10 smithi191 ceph-mon[31636]: pgmap v5672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:19:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:10 smithi170 ceph-mon[31212]: pgmap v5672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:19:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:10 smithi077 ceph-mon[27902]: pgmap v5672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:19:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:11 smithi191 ceph-mon[31636]: pgmap v5673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:19:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:11 smithi170 ceph-mon[31212]: pgmap v5673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:19:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:11 smithi077 ceph-mon[27902]: pgmap v5673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:19:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10463.474360 secs 2024-04-21T13:19:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10463.474360 secs 2024-04-21T13:19:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10463.474360 secs 2024-04-21T13:19:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:13 smithi191 ceph-mon[31636]: pgmap v5674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:19:14.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:13 smithi170 ceph-mon[31212]: pgmap v5674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:19:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:13 smithi077 ceph-mon[27902]: pgmap v5674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T13:19:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10465.234892 secs 2024-04-21T13:19:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:19:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10465.234892 secs 2024-04-21T13:19:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:19:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10465.234892 secs 2024-04-21T13:19:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:19:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:15 smithi191 ceph-mon[31636]: pgmap v5675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:19:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:19:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:19:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:19:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:15 smithi170 ceph-mon[31212]: pgmap v5675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:19:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:19:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:19:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:19:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:15 smithi077 ceph-mon[27902]: pgmap v5675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:19:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:19:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:19:16.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:19:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10468.474453 secs 2024-04-21T13:19:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10468.474453 secs 2024-04-21T13:19:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10468.474453 secs 2024-04-21T13:19:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:18 smithi170 ceph-mon[31212]: pgmap v5676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:19:18.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:18 smithi191 ceph-mon[31636]: pgmap v5676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:19:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:18 smithi077 ceph-mon[27902]: pgmap v5676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:19:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10470.235012 secs 2024-04-21T13:19:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10470.235012 secs 2024-04-21T13:19:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10470.235012 secs 2024-04-21T13:19:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:20 smithi170 ceph-mon[31212]: pgmap v5677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:19:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:20 smithi077 ceph-mon[27902]: pgmap v5677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:19:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:20 smithi191 ceph-mon[31636]: pgmap v5677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:19:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:22 smithi170 ceph-mon[31212]: pgmap v5678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:19:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10473.474570 secs 2024-04-21T13:19:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:22 smithi077 ceph-mon[27902]: pgmap v5678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:19:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10473.474570 secs 2024-04-21T13:19:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:22 smithi191 ceph-mon[31636]: pgmap v5678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:19:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10473.474570 secs 2024-04-21T13:19:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:24 smithi170 ceph-mon[31212]: pgmap v5679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10475.235110 secs 2024-04-21T13:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:24 smithi077 ceph-mon[27902]: pgmap v5679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10475.235110 secs 2024-04-21T13:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:24 smithi191 ceph-mon[31636]: pgmap v5679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10475.235110 secs 2024-04-21T13:19:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:26 smithi170 ceph-mon[31212]: pgmap v5680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:26 smithi077 ceph-mon[27902]: pgmap v5680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:26 smithi191 ceph-mon[31636]: pgmap v5680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:27.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10478.474697 secs 2024-04-21T13:19:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10478.474697 secs 2024-04-21T13:19:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10478.474697 secs 2024-04-21T13:19:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:28 smithi170 ceph-mon[31212]: pgmap v5681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:28 smithi077 ceph-mon[27902]: pgmap v5681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:28 smithi191 ceph-mon[31636]: pgmap v5681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10480.235247 secs 2024-04-21T13:19:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10480.235247 secs 2024-04-21T13:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10480.235247 secs 2024-04-21T13:19:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:30 smithi170 ceph-mon[31212]: pgmap v5682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:30 smithi077 ceph-mon[27902]: pgmap v5682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:30 smithi191 ceph-mon[31636]: pgmap v5682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:32 smithi170 ceph-mon[31212]: pgmap v5683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10483.474790 secs 2024-04-21T13:19:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:32 smithi077 ceph-mon[27902]: pgmap v5683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10483.474790 secs 2024-04-21T13:19:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:32 smithi191 ceph-mon[31636]: pgmap v5683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10483.474790 secs 2024-04-21T13:19:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:34 smithi170 ceph-mon[31212]: pgmap v5684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10485.235345 secs 2024-04-21T13:19:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:34 smithi077 ceph-mon[27902]: pgmap v5684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10485.235345 secs 2024-04-21T13:19:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:34 smithi191 ceph-mon[31636]: pgmap v5684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10485.235345 secs 2024-04-21T13:19:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:36 smithi170 ceph-mon[31212]: pgmap v5685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:36 smithi077 ceph-mon[27902]: pgmap v5685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:36 smithi191 ceph-mon[31636]: pgmap v5685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10488.474862 secs 2024-04-21T13:19:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10488.474862 secs 2024-04-21T13:19:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10488.474862 secs 2024-04-21T13:19:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:38 smithi170 ceph-mon[31212]: pgmap v5686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:38 smithi077 ceph-mon[27902]: pgmap v5686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:38 smithi191 ceph-mon[31636]: pgmap v5686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10490.235474 secs 2024-04-21T13:19:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10490.235474 secs 2024-04-21T13:19:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10490.235474 secs 2024-04-21T13:19:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:40 smithi170 ceph-mon[31212]: pgmap v5687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:40 smithi077 ceph-mon[27902]: pgmap v5687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:40 smithi191 ceph-mon[31636]: pgmap v5687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:42 smithi170 ceph-mon[31212]: pgmap v5688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10493.474979 secs 2024-04-21T13:19:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:42 smithi077 ceph-mon[27902]: pgmap v5688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10493.474979 secs 2024-04-21T13:19:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:42 smithi191 ceph-mon[31636]: pgmap v5688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10493.474979 secs 2024-04-21T13:19:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:44 smithi170 ceph-mon[31212]: pgmap v5689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10495.235589 secs 2024-04-21T13:19:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:44 smithi077 ceph-mon[27902]: pgmap v5689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10495.235589 secs 2024-04-21T13:19:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:44 smithi191 ceph-mon[31636]: pgmap v5689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10495.235589 secs 2024-04-21T13:19:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:46 smithi170 ceph-mon[31212]: pgmap v5690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:46 smithi077 ceph-mon[27902]: pgmap v5690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:46 smithi191 ceph-mon[31636]: pgmap v5690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10498.475096 secs 2024-04-21T13:19:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10498.475096 secs 2024-04-21T13:19:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10498.475096 secs 2024-04-21T13:19:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:48 smithi170 ceph-mon[31212]: pgmap v5691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:48.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:48 smithi191 ceph-mon[31636]: pgmap v5691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:48 smithi077 ceph-mon[27902]: pgmap v5691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10500.235701 secs 2024-04-21T13:19:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10500.235701 secs 2024-04-21T13:19:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10500.235701 secs 2024-04-21T13:19:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:50 smithi170 ceph-mon[31212]: pgmap v5692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:50 smithi077 ceph-mon[27902]: pgmap v5692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:50 smithi191 ceph-mon[31636]: pgmap v5692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:52 smithi170 ceph-mon[31212]: pgmap v5693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10503.475194 secs 2024-04-21T13:19:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:52 smithi077 ceph-mon[27902]: pgmap v5693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10503.475194 secs 2024-04-21T13:19:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:52 smithi191 ceph-mon[31636]: pgmap v5693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:19:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10503.475194 secs 2024-04-21T13:19:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:54 smithi077 ceph-mon[27902]: pgmap v5694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10505.235767 secs 2024-04-21T13:19:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:54 smithi191 ceph-mon[31636]: pgmap v5694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10505.235767 secs 2024-04-21T13:19:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:54 smithi170 ceph-mon[31212]: pgmap v5694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:19:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10505.235767 secs 2024-04-21T13:19:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:19:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:19:55.803+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:19:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:19:55.803+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:19:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:19:55.803+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:19:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:19:55.803+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:19:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:56 smithi077 ceph-mon[27902]: pgmap v5695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:56 smithi191 ceph-mon[31636]: pgmap v5695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:56 smithi170 ceph-mon[31212]: pgmap v5695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:19:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10508.475310 secs 2024-04-21T13:19:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10508.475310 secs 2024-04-21T13:19:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10508.475310 secs 2024-04-21T13:19:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:58 smithi077 ceph-mon[27902]: pgmap v5696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:58 smithi191 ceph-mon[31636]: pgmap v5696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:58 smithi170 ceph-mon[31212]: pgmap v5696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:19:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10510.235874 secs 2024-04-21T13:19:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10510.235874 secs 2024-04-21T13:20:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10510.235874 secs 2024-04-21T13:20:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:00 smithi077 ceph-mon[27902]: pgmap v5697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:20:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:00 smithi191 ceph-mon[31636]: pgmap v5697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:20:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:00 smithi170 ceph-mon[31212]: pgmap v5697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:20:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:02 smithi077 ceph-mon[27902]: pgmap v5698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10513.475453 secs 2024-04-21T13:20:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:02 smithi191 ceph-mon[31636]: pgmap v5698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10513.475453 secs 2024-04-21T13:20:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:02 smithi170 ceph-mon[31212]: pgmap v5698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10513.475453 secs 2024-04-21T13:20:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:04 smithi077 ceph-mon[27902]: pgmap v5699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10515.235973 secs 2024-04-21T13:20:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:04 smithi077 ceph-mon[27902]: osdmap e427: 12 total, 12 up, 12 in 2024-04-21T13:20:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:04 smithi191 ceph-mon[31636]: pgmap v5699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10515.235973 secs 2024-04-21T13:20:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:04 smithi191 ceph-mon[31636]: osdmap e427: 12 total, 12 up, 12 in 2024-04-21T13:20:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:04 smithi170 ceph-mon[31212]: pgmap v5699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10515.235973 secs 2024-04-21T13:20:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:04 smithi170 ceph-mon[31212]: osdmap e427: 12 total, 12 up, 12 in 2024-04-21T13:20:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:06 smithi077 ceph-mon[27902]: pgmap v5701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:20:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:06 smithi191 ceph-mon[31636]: pgmap v5701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:20:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:06 smithi170 ceph-mon[31212]: pgmap v5701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:20:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10518.475570 secs 2024-04-21T13:20:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10518.475570 secs 2024-04-21T13:20:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10518.475570 secs 2024-04-21T13:20:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:08 smithi077 ceph-mon[27902]: pgmap v5702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:20:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:08 smithi077 ceph-mon[27902]: osdmap e428: 12 total, 12 up, 12 in 2024-04-21T13:20:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:08 smithi191 ceph-mon[31636]: pgmap v5702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:20:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:08 smithi191 ceph-mon[31636]: osdmap e428: 12 total, 12 up, 12 in 2024-04-21T13:20:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:08 smithi170 ceph-mon[31212]: pgmap v5702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:20:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:08 smithi170 ceph-mon[31212]: osdmap e428: 12 total, 12 up, 12 in 2024-04-21T13:20:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10520.236064 secs 2024-04-21T13:20:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10520.236064 secs 2024-04-21T13:20:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10520.236064 secs 2024-04-21T13:20:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:10 smithi077 ceph-mon[27902]: pgmap v5704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:20:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:10 smithi191 ceph-mon[31636]: pgmap v5704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:20:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:10 smithi170 ceph-mon[31212]: pgmap v5704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:20:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:12 smithi077 ceph-mon[27902]: pgmap v5705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:20:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10523.475659 secs 2024-04-21T13:20:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:12 smithi191 ceph-mon[31636]: pgmap v5705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:20:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10523.475659 secs 2024-04-21T13:20:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:12 smithi170 ceph-mon[31212]: pgmap v5705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:20:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10523.475659 secs 2024-04-21T13:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:14 smithi077 ceph-mon[27902]: pgmap v5706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:20:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10525.236192 secs 2024-04-21T13:20:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:14 smithi191 ceph-mon[31636]: pgmap v5706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:20:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10525.236192 secs 2024-04-21T13:20:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:14 smithi170 ceph-mon[31212]: pgmap v5706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:20:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10525.236192 secs 2024-04-21T13:20:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:15.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:20:15.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:20:16.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:20:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:16 smithi077 ceph-mon[27902]: pgmap v5707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:20:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:20:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:20:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:20:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:16 smithi191 ceph-mon[31636]: pgmap v5707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:20:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:20:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:20:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:20:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:16 smithi170 ceph-mon[31212]: pgmap v5707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:20:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:20:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:20:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:20:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10528.475799 secs 2024-04-21T13:20:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10528.475799 secs 2024-04-21T13:20:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10528.475799 secs 2024-04-21T13:20:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:18 smithi077 ceph-mon[27902]: pgmap v5708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:20:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:18 smithi170 ceph-mon[31212]: pgmap v5708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:20:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:18 smithi191 ceph-mon[31636]: pgmap v5708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:20:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10530.236274 secs 2024-04-21T13:20:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10530.236274 secs 2024-04-21T13:20:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10530.236274 secs 2024-04-21T13:20:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:20 smithi191 ceph-mon[31636]: pgmap v5709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:20:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:20 smithi170 ceph-mon[31212]: pgmap v5709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:20:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:20 smithi077 ceph-mon[27902]: pgmap v5709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:20:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:22 smithi191 ceph-mon[31636]: pgmap v5710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:20:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10533.475866 secs 2024-04-21T13:20:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:22 smithi170 ceph-mon[31212]: pgmap v5710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:20:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10533.475866 secs 2024-04-21T13:20:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:22 smithi077 ceph-mon[27902]: pgmap v5710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:20:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10533.475866 secs 2024-04-21T13:20:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:24 smithi191 ceph-mon[31636]: pgmap v5711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10535.236397 secs 2024-04-21T13:20:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:24 smithi170 ceph-mon[31212]: pgmap v5711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10535.236397 secs 2024-04-21T13:20:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:24 smithi077 ceph-mon[27902]: pgmap v5711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10535.236397 secs 2024-04-21T13:20:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:26 smithi191 ceph-mon[31636]: pgmap v5712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:26 smithi170 ceph-mon[31212]: pgmap v5712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:26 smithi077 ceph-mon[27902]: pgmap v5712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10538.475975 secs 2024-04-21T13:20:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10538.475975 secs 2024-04-21T13:20:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10538.475975 secs 2024-04-21T13:20:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:28 smithi191 ceph-mon[31636]: pgmap v5713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:28 smithi170 ceph-mon[31212]: pgmap v5713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:28 smithi077 ceph-mon[27902]: pgmap v5713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10540.236518 secs 2024-04-21T13:20:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10540.236518 secs 2024-04-21T13:20:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10540.236518 secs 2024-04-21T13:20:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:30 smithi191 ceph-mon[31636]: pgmap v5714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:30 smithi170 ceph-mon[31212]: pgmap v5714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:30 smithi077 ceph-mon[27902]: pgmap v5714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:32 smithi191 ceph-mon[31636]: pgmap v5715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10543.476083 secs 2024-04-21T13:20:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:32 smithi170 ceph-mon[31212]: pgmap v5715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10543.476083 secs 2024-04-21T13:20:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:32 smithi077 ceph-mon[27902]: pgmap v5715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10543.476083 secs 2024-04-21T13:20:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:34 smithi191 ceph-mon[31636]: pgmap v5716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10545.236623 secs 2024-04-21T13:20:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:34 smithi170 ceph-mon[31212]: pgmap v5716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10545.236623 secs 2024-04-21T13:20:35.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:34 smithi077 ceph-mon[27902]: pgmap v5716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:35.075 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10545.236623 secs 2024-04-21T13:20:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:36 smithi191 ceph-mon[31636]: pgmap v5717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:36 smithi170 ceph-mon[31212]: pgmap v5717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:36 smithi077 ceph-mon[27902]: pgmap v5717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10548.476215 secs 2024-04-21T13:20:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10548.476215 secs 2024-04-21T13:20:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10548.476215 secs 2024-04-21T13:20:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:38 smithi191 ceph-mon[31636]: pgmap v5718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:38 smithi170 ceph-mon[31212]: pgmap v5718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:38 smithi077 ceph-mon[27902]: pgmap v5718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10550.236734 secs 2024-04-21T13:20:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:39 smithi191 ceph-mon[31636]: pgmap v5719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10550.236734 secs 2024-04-21T13:20:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:39 smithi170 ceph-mon[31212]: pgmap v5719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10550.236734 secs 2024-04-21T13:20:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:39 smithi077 ceph-mon[27902]: pgmap v5719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:42 smithi170 ceph-mon[31212]: pgmap v5720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10553.476398 secs 2024-04-21T13:20:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:42 smithi077 ceph-mon[27902]: pgmap v5720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10553.476398 secs 2024-04-21T13:20:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:42 smithi191 ceph-mon[31636]: pgmap v5720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10553.476398 secs 2024-04-21T13:20:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:44 smithi170 ceph-mon[31212]: pgmap v5721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10555.236900 secs 2024-04-21T13:20:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:44 smithi077 ceph-mon[27902]: pgmap v5721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10555.236900 secs 2024-04-21T13:20:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:44 smithi191 ceph-mon[31636]: pgmap v5721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10555.236900 secs 2024-04-21T13:20:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:46.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:46 smithi170 ceph-mon[31212]: pgmap v5722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:46 smithi077 ceph-mon[27902]: pgmap v5722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:46 smithi191 ceph-mon[31636]: pgmap v5722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10558.476551 secs 2024-04-21T13:20:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10558.476551 secs 2024-04-21T13:20:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10558.476551 secs 2024-04-21T13:20:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:48 smithi170 ceph-mon[31212]: pgmap v5723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:48.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:48 smithi191 ceph-mon[31636]: pgmap v5723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:48 smithi077 ceph-mon[27902]: pgmap v5723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10560.237017 secs 2024-04-21T13:20:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10560.237017 secs 2024-04-21T13:20:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10560.237017 secs 2024-04-21T13:20:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:50 smithi170 ceph-mon[31212]: pgmap v5724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:50 smithi077 ceph-mon[27902]: pgmap v5724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:50 smithi191 ceph-mon[31636]: pgmap v5724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:52 smithi077 ceph-mon[27902]: pgmap v5725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10563.476692 secs 2024-04-21T13:20:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:52 smithi191 ceph-mon[31636]: pgmap v5725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10563.476692 secs 2024-04-21T13:20:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:52 smithi170 ceph-mon[31212]: pgmap v5725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:20:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10563.476692 secs 2024-04-21T13:20:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:54 smithi077 ceph-mon[27902]: pgmap v5726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10565.237144 secs 2024-04-21T13:20:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:54 smithi191 ceph-mon[31636]: pgmap v5726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10565.237144 secs 2024-04-21T13:20:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:54 smithi170 ceph-mon[31212]: pgmap v5726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:20:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10565.237144 secs 2024-04-21T13:20:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:20:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:56 smithi077 ceph-mon[27902]: pgmap v5727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:56 smithi191 ceph-mon[31636]: pgmap v5727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:56 smithi170 ceph-mon[31212]: pgmap v5727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T13:20:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10568.476837 secs 2024-04-21T13:20:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10568.476837 secs 2024-04-21T13:20:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10568.476837 secs 2024-04-21T13:20:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:58 smithi077 ceph-mon[27902]: pgmap v5728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:58 smithi191 ceph-mon[31636]: pgmap v5728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:58 smithi170 ceph-mon[31212]: pgmap v5728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:20:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10570.237283 secs 2024-04-21T13:20:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10570.237283 secs 2024-04-21T13:20:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10570.237283 secs 2024-04-21T13:21:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:00 smithi077 ceph-mon[27902]: pgmap v5729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:00 smithi191 ceph-mon[31636]: pgmap v5729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:00 smithi170 ceph-mon[31212]: pgmap v5729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:02 smithi077 ceph-mon[27902]: pgmap v5730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10573.476905 secs 2024-04-21T13:21:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:02 smithi191 ceph-mon[31636]: pgmap v5730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10573.476905 secs 2024-04-21T13:21:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:02 smithi170 ceph-mon[31212]: pgmap v5730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10573.476905 secs 2024-04-21T13:21:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:04 smithi077 ceph-mon[27902]: pgmap v5731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10575.237404 secs 2024-04-21T13:21:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:04 smithi191 ceph-mon[31636]: pgmap v5731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10575.237404 secs 2024-04-21T13:21:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:04 smithi170 ceph-mon[31212]: pgmap v5731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10575.237404 secs 2024-04-21T13:21:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:05 smithi077 ceph-mon[27902]: osdmap e429: 12 total, 12 up, 12 in 2024-04-21T13:21:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:05 smithi191 ceph-mon[31636]: osdmap e429: 12 total, 12 up, 12 in 2024-04-21T13:21:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:05 smithi170 ceph-mon[31212]: osdmap e429: 12 total, 12 up, 12 in 2024-04-21T13:21:06.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:06 smithi077 ceph-mon[27902]: pgmap v5733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:21:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:06 smithi191 ceph-mon[31636]: pgmap v5733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:21:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:06 smithi170 ceph-mon[31212]: pgmap v5733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T13:21:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10578.476969 secs 2024-04-21T13:21:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10578.476969 secs 2024-04-21T13:21:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10578.476969 secs 2024-04-21T13:21:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:08 smithi077 ceph-mon[27902]: pgmap v5734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:21:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:08 smithi191 ceph-mon[31636]: pgmap v5734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:21:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:08 smithi170 ceph-mon[31212]: pgmap v5734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:21:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10580.237488 secs 2024-04-21T13:21:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:09 smithi170 ceph-mon[31212]: osdmap e430: 12 total, 12 up, 12 in 2024-04-21T13:21:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10580.237488 secs 2024-04-21T13:21:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:09 smithi077 ceph-mon[27902]: osdmap e430: 12 total, 12 up, 12 in 2024-04-21T13:21:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10580.237488 secs 2024-04-21T13:21:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:09 smithi191 ceph-mon[31636]: osdmap e430: 12 total, 12 up, 12 in 2024-04-21T13:21:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:10 smithi170 ceph-mon[31212]: pgmap v5736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:21:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:10 smithi077 ceph-mon[27902]: pgmap v5736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:21:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:10 smithi191 ceph-mon[31636]: pgmap v5736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:21:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:12 smithi170 ceph-mon[31212]: pgmap v5737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:21:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10583.477090 secs 2024-04-21T13:21:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:12 smithi077 ceph-mon[27902]: pgmap v5737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:21:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10583.477090 secs 2024-04-21T13:21:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:12 smithi191 ceph-mon[31636]: pgmap v5737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:21:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10583.477090 secs 2024-04-21T13:21:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:14 smithi170 ceph-mon[31212]: pgmap v5738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:21:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10585.237611 secs 2024-04-21T13:21:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:14 smithi077 ceph-mon[27902]: pgmap v5738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:21:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10585.237611 secs 2024-04-21T13:21:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:14 smithi191 ceph-mon[31636]: pgmap v5738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T13:21:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10585.237611 secs 2024-04-21T13:21:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:16 smithi170 ceph-mon[31212]: pgmap v5739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:21:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:21:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:16 smithi077 ceph-mon[27902]: pgmap v5739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:21:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:21:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:16 smithi191 ceph-mon[31636]: pgmap v5739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T13:21:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:21:17.713 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10588.477151 secs 2024-04-21T13:21:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10588.477151 secs 2024-04-21T13:21:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10588.477151 secs 2024-04-21T13:21:18.735 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:18 smithi077 ceph-mon[27902]: pgmap v5740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:21:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:18 smithi170 ceph-mon[31212]: pgmap v5740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:21:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:18 smithi191 ceph-mon[31636]: pgmap v5740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:21:19.788 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10590.237729 secs 2024-04-21T13:21:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10590.237729 secs 2024-04-21T13:21:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10590.237729 secs 2024-04-21T13:21:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:20 smithi170 ceph-mon[31212]: pgmap v5741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:21:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:21:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:21:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:20 smithi077 ceph-mon[27902]: pgmap v5741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:21:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:21:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:21:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:20 smithi191 ceph-mon[31636]: pgmap v5741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:21:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:21:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:21:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:21:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:22 smithi170 ceph-mon[31212]: pgmap v5742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:21:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10593.477251 secs 2024-04-21T13:21:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:22 smithi077 ceph-mon[27902]: pgmap v5742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:21:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10593.477251 secs 2024-04-21T13:21:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:22 smithi191 ceph-mon[31636]: pgmap v5742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:21:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10593.477251 secs 2024-04-21T13:21:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:24 smithi170 ceph-mon[31212]: pgmap v5743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10595.237881 secs 2024-04-21T13:21:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:24 smithi077 ceph-mon[27902]: pgmap v5743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10595.237881 secs 2024-04-21T13:21:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:24 smithi191 ceph-mon[31636]: pgmap v5743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10595.237881 secs 2024-04-21T13:21:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:26 smithi170 ceph-mon[31212]: pgmap v5744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:26 smithi077 ceph-mon[27902]: pgmap v5744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:26 smithi191 ceph-mon[31636]: pgmap v5744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10598.477369 secs 2024-04-21T13:21:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10598.477369 secs 2024-04-21T13:21:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10598.477369 secs 2024-04-21T13:21:28.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:28 smithi077 ceph-mon[27902]: pgmap v5745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:21:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:28 smithi170 ceph-mon[31212]: pgmap v5745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:21:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:28 smithi191 ceph-mon[31636]: pgmap v5745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T13:21:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10600.237960 secs 2024-04-21T13:21:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10600.237960 secs 2024-04-21T13:21:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10600.237960 secs 2024-04-21T13:21:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:30 smithi170 ceph-mon[31212]: pgmap v5746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:30 smithi077 ceph-mon[27902]: pgmap v5746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:30 smithi191 ceph-mon[31636]: pgmap v5746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:32 smithi170 ceph-mon[31212]: pgmap v5747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10603.477491 secs 2024-04-21T13:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:32 smithi077 ceph-mon[27902]: pgmap v5747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10603.477491 secs 2024-04-21T13:21:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:32 smithi191 ceph-mon[31636]: pgmap v5747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10603.477491 secs 2024-04-21T13:21:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:34 smithi170 ceph-mon[31212]: pgmap v5748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10605.238087 secs 2024-04-21T13:21:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:34 smithi077 ceph-mon[27902]: pgmap v5748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10605.238087 secs 2024-04-21T13:21:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:34 smithi191 ceph-mon[31636]: pgmap v5748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10605.238087 secs 2024-04-21T13:21:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:36 smithi170 ceph-mon[31212]: pgmap v5749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:36 smithi077 ceph-mon[27902]: pgmap v5749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:36 smithi191 ceph-mon[31636]: pgmap v5749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10608.477607 secs 2024-04-21T13:21:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10608.477607 secs 2024-04-21T13:21:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10608.477607 secs 2024-04-21T13:21:38.838 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:38 smithi077 ceph-mon[27902]: pgmap v5750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:38 smithi191 ceph-mon[31636]: pgmap v5750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:38 smithi170 ceph-mon[31212]: pgmap v5750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10610.238213 secs 2024-04-21T13:21:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10610.238213 secs 2024-04-21T13:21:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10610.238213 secs 2024-04-21T13:21:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:40 smithi077 ceph-mon[27902]: pgmap v5751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:40 smithi191 ceph-mon[31636]: pgmap v5751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:40 smithi170 ceph-mon[31212]: pgmap v5751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:42 smithi077 ceph-mon[27902]: pgmap v5752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10613.477722 secs 2024-04-21T13:21:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:42 smithi191 ceph-mon[31636]: pgmap v5752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10613.477722 secs 2024-04-21T13:21:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:42 smithi170 ceph-mon[31212]: pgmap v5752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10613.477722 secs 2024-04-21T13:21:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:44 smithi077 ceph-mon[27902]: pgmap v5753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10615.238332 secs 2024-04-21T13:21:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:44 smithi191 ceph-mon[31636]: pgmap v5753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10615.238332 secs 2024-04-21T13:21:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:44 smithi170 ceph-mon[31212]: pgmap v5753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10615.238332 secs 2024-04-21T13:21:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:46 smithi077 ceph-mon[27902]: pgmap v5754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:46 smithi191 ceph-mon[31636]: pgmap v5754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:46 smithi170 ceph-mon[31212]: pgmap v5754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10618.477826 secs 2024-04-21T13:21:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10618.477826 secs 2024-04-21T13:21:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10618.477826 secs 2024-04-21T13:21:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:48 smithi191 ceph-mon[31636]: pgmap v5755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:48 smithi077 ceph-mon[27902]: pgmap v5755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:48.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:48 smithi170 ceph-mon[31212]: pgmap v5755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10620.238465 secs 2024-04-21T13:21:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10620.238465 secs 2024-04-21T13:21:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10620.238465 secs 2024-04-21T13:21:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:50 smithi077 ceph-mon[27902]: pgmap v5756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:50 smithi191 ceph-mon[31636]: pgmap v5756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:50 smithi170 ceph-mon[31212]: pgmap v5756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:21:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:52 smithi077 ceph-mon[27902]: pgmap v5757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10623.477946 secs 2024-04-21T13:21:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:52 smithi191 ceph-mon[31636]: pgmap v5757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10623.477946 secs 2024-04-21T13:21:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:52 smithi170 ceph-mon[31212]: pgmap v5757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10623.477946 secs 2024-04-21T13:21:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:54 smithi077 ceph-mon[27902]: pgmap v5758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10625.238558 secs 2024-04-21T13:21:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:54 smithi191 ceph-mon[31636]: pgmap v5758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10625.238558 secs 2024-04-21T13:21:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:54 smithi170 ceph-mon[31212]: pgmap v5758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10625.238558 secs 2024-04-21T13:21:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:21:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:56 smithi077 ceph-mon[27902]: pgmap v5759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:56 smithi191 ceph-mon[31636]: pgmap v5759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:56 smithi170 ceph-mon[31212]: pgmap v5759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:21:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10628.478019 secs 2024-04-21T13:21:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10628.478019 secs 2024-04-21T13:21:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10628.478019 secs 2024-04-21T13:21:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:58 smithi077 ceph-mon[27902]: pgmap v5760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:58 smithi191 ceph-mon[31636]: pgmap v5760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:58 smithi170 ceph-mon[31212]: pgmap v5760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:21:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10630.238673 secs 2024-04-21T13:21:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10630.238673 secs 2024-04-21T13:22:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10630.238673 secs 2024-04-21T13:22:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:00 smithi077 ceph-mon[27902]: pgmap v5761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:00 smithi191 ceph-mon[31636]: pgmap v5761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:00 smithi170 ceph-mon[31212]: pgmap v5761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:02 smithi077 ceph-mon[27902]: pgmap v5762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10633.478132 secs 2024-04-21T13:22:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:02 smithi191 ceph-mon[31636]: pgmap v5762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10633.478132 secs 2024-04-21T13:22:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:02 smithi170 ceph-mon[31212]: pgmap v5762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10633.478132 secs 2024-04-21T13:22:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:04 smithi077 ceph-mon[27902]: pgmap v5763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10635.238795 secs 2024-04-21T13:22:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:04 smithi077 ceph-mon[27902]: osdmap e431: 12 total, 12 up, 12 in 2024-04-21T13:22:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:04 smithi191 ceph-mon[31636]: pgmap v5763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10635.238795 secs 2024-04-21T13:22:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:04 smithi191 ceph-mon[31636]: osdmap e431: 12 total, 12 up, 12 in 2024-04-21T13:22:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:04 smithi170 ceph-mon[31212]: pgmap v5763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10635.238795 secs 2024-04-21T13:22:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:04 smithi170 ceph-mon[31212]: osdmap e431: 12 total, 12 up, 12 in 2024-04-21T13:22:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:06 smithi077 ceph-mon[27902]: pgmap v5765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:22:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:06 smithi191 ceph-mon[31636]: pgmap v5765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:22:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:06 smithi170 ceph-mon[31212]: pgmap v5765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:22:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10638.478270 secs 2024-04-21T13:22:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10638.478270 secs 2024-04-21T13:22:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10638.478270 secs 2024-04-21T13:22:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:08 smithi191 ceph-mon[31636]: pgmap v5766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:22:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:08 smithi191 ceph-mon[31636]: osdmap e432: 12 total, 12 up, 12 in 2024-04-21T13:22:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:08 smithi170 ceph-mon[31212]: pgmap v5766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:22:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:08 smithi170 ceph-mon[31212]: osdmap e432: 12 total, 12 up, 12 in 2024-04-21T13:22:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:08 smithi077 ceph-mon[27902]: pgmap v5766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:22:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:08 smithi077 ceph-mon[27902]: osdmap e432: 12 total, 12 up, 12 in 2024-04-21T13:22:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10640.238892 secs 2024-04-21T13:22:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10640.238892 secs 2024-04-21T13:22:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10640.238892 secs 2024-04-21T13:22:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:10.822+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:22:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:10.822+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:22:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:10.822+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:22:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:10.822+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:22:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:10 smithi191 ceph-mon[31636]: pgmap v5768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:22:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:10 smithi170 ceph-mon[31212]: pgmap v5768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:22:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:10 smithi077 ceph-mon[27902]: pgmap v5768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:22:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:12 smithi191 ceph-mon[31636]: pgmap v5769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:22:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10643.478420 secs 2024-04-21T13:22:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:12 smithi170 ceph-mon[31212]: pgmap v5769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:22:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10643.478420 secs 2024-04-21T13:22:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:12 smithi077 ceph-mon[27902]: pgmap v5769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:22:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10643.478420 secs 2024-04-21T13:22:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:14 smithi191 ceph-mon[31636]: pgmap v5770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:22:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10645.239024 secs 2024-04-21T13:22:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:14 smithi170 ceph-mon[31212]: pgmap v5770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:22:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10645.239024 secs 2024-04-21T13:22:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:14 smithi077 ceph-mon[27902]: pgmap v5770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:22:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10645.239024 secs 2024-04-21T13:22:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:16 smithi191 ceph-mon[31636]: pgmap v5771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:22:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:16 smithi170 ceph-mon[31212]: pgmap v5771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:22:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:16 smithi077 ceph-mon[27902]: pgmap v5771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:22:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10648.478546 secs 2024-04-21T13:22:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10648.478546 secs 2024-04-21T13:22:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10648.478546 secs 2024-04-21T13:22:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:18 smithi170 ceph-mon[31212]: pgmap v5772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:22:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:18 smithi191 ceph-mon[31636]: pgmap v5772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:22:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:18 smithi077 ceph-mon[27902]: pgmap v5772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:22:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10650.239131 secs 2024-04-21T13:22:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10650.239131 secs 2024-04-21T13:22:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10650.239131 secs 2024-04-21T13:22:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:20 smithi191 ceph-mon[31636]: pgmap v5773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:22:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:20 smithi170 ceph-mon[31212]: pgmap v5773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:22:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:20 smithi077 ceph-mon[27902]: pgmap v5773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:22:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:22:21.988 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:22:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:22:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:22 smithi191 ceph-mon[31636]: pgmap v5774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:22:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10653.478639 secs 2024-04-21T13:22:23.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:22 smithi170 ceph-mon[31212]: pgmap v5774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:22:23.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10653.478639 secs 2024-04-21T13:22:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:22 smithi077 ceph-mon[27902]: pgmap v5774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:22:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10653.478639 secs 2024-04-21T13:22:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:24 smithi170 ceph-mon[31212]: pgmap v5775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10655.239278 secs 2024-04-21T13:22:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:24 smithi191 ceph-mon[31636]: pgmap v5775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10655.239278 secs 2024-04-21T13:22:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:24 smithi077 ceph-mon[27902]: pgmap v5775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10655.239278 secs 2024-04-21T13:22:26.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:26 smithi170 ceph-mon[31212]: pgmap v5776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:22:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:26 smithi077 ceph-mon[27902]: pgmap v5776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:22:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:26 smithi191 ceph-mon[31636]: pgmap v5776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10658.478783 secs 2024-04-21T13:22:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10658.478783 secs 2024-04-21T13:22:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10658.478783 secs 2024-04-21T13:22:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:28 smithi077 ceph-mon[27902]: pgmap v5777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:28 smithi191 ceph-mon[31636]: pgmap v5777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:28 smithi170 ceph-mon[31212]: pgmap v5777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10660.239353 secs 2024-04-21T13:22:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10660.239353 secs 2024-04-21T13:22:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10660.239353 secs 2024-04-21T13:22:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:30 smithi077 ceph-mon[27902]: pgmap v5778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:30 smithi191 ceph-mon[31636]: pgmap v5778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:30 smithi170 ceph-mon[31212]: pgmap v5778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:32 smithi077 ceph-mon[27902]: pgmap v5779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10663.478879 secs 2024-04-21T13:22:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:32 smithi191 ceph-mon[31636]: pgmap v5779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10663.478879 secs 2024-04-21T13:22:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:32 smithi170 ceph-mon[31212]: pgmap v5779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10663.478879 secs 2024-04-21T13:22:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:34 smithi077 ceph-mon[27902]: pgmap v5780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10665.239492 secs 2024-04-21T13:22:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:34 smithi191 ceph-mon[31636]: pgmap v5780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10665.239492 secs 2024-04-21T13:22:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:34 smithi170 ceph-mon[31212]: pgmap v5780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10665.239492 secs 2024-04-21T13:22:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:36 smithi077 ceph-mon[27902]: pgmap v5781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:36 smithi191 ceph-mon[31636]: pgmap v5781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:36 smithi170 ceph-mon[31212]: pgmap v5781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10668.478998 secs 2024-04-21T13:22:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10668.478998 secs 2024-04-21T13:22:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10668.478998 secs 2024-04-21T13:22:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:38 smithi077 ceph-mon[27902]: pgmap v5782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:38 smithi191 ceph-mon[31636]: pgmap v5782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:38 smithi170 ceph-mon[31212]: pgmap v5782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10670.239591 secs 2024-04-21T13:22:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10670.239591 secs 2024-04-21T13:22:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10670.239591 secs 2024-04-21T13:22:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:40 smithi077 ceph-mon[27902]: pgmap v5783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:40 smithi191 ceph-mon[31636]: pgmap v5783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:40 smithi170 ceph-mon[31212]: pgmap v5783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:42 smithi077 ceph-mon[27902]: pgmap v5784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10673.479113 secs 2024-04-21T13:22:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:42 smithi191 ceph-mon[31636]: pgmap v5784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10673.479113 secs 2024-04-21T13:22:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:42 smithi170 ceph-mon[31212]: pgmap v5784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10673.479113 secs 2024-04-21T13:22:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:44 smithi077 ceph-mon[27902]: pgmap v5785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10675.239728 secs 2024-04-21T13:22:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:44 smithi191 ceph-mon[31636]: pgmap v5785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10675.239728 secs 2024-04-21T13:22:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:44 smithi170 ceph-mon[31212]: pgmap v5785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10675.239728 secs 2024-04-21T13:22:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:46 smithi077 ceph-mon[27902]: pgmap v5786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:46 smithi191 ceph-mon[31636]: pgmap v5786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:46 smithi170 ceph-mon[31212]: pgmap v5786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10678.479230 secs 2024-04-21T13:22:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10678.479230 secs 2024-04-21T13:22:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10678.479230 secs 2024-04-21T13:22:48.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:48 smithi191 ceph-mon[31636]: pgmap v5787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:48 smithi077 ceph-mon[27902]: pgmap v5787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:48.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:48 smithi170 ceph-mon[31212]: pgmap v5787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10680.239842 secs 2024-04-21T13:22:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10680.239842 secs 2024-04-21T13:22:49.724 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10680.239842 secs 2024-04-21T13:22:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:50 smithi077 ceph-mon[27902]: pgmap v5788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:50 smithi191 ceph-mon[31636]: pgmap v5788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:50 smithi170 ceph-mon[31212]: pgmap v5788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:52 smithi077 ceph-mon[27902]: pgmap v5789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10683.479367 secs 2024-04-21T13:22:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:52 smithi191 ceph-mon[31636]: pgmap v5789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10683.479367 secs 2024-04-21T13:22:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:52 smithi170 ceph-mon[31212]: pgmap v5789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10683.479367 secs 2024-04-21T13:22:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:54 smithi077 ceph-mon[27902]: pgmap v5790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10685.239907 secs 2024-04-21T13:22:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:54 smithi191 ceph-mon[31636]: pgmap v5790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10685.239907 secs 2024-04-21T13:22:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:54 smithi170 ceph-mon[31212]: pgmap v5790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:22:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10685.239907 secs 2024-04-21T13:22:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:22:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:55.828+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:22:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:55.828+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:22:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:55.828+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:22:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:22:55.828+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:22:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:56 smithi077 ceph-mon[27902]: pgmap v5791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:56 smithi191 ceph-mon[31636]: pgmap v5791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:56 smithi170 ceph-mon[31212]: pgmap v5791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:22:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10688.479503 secs 2024-04-21T13:22:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10688.479503 secs 2024-04-21T13:22:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10688.479503 secs 2024-04-21T13:22:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:58 smithi077 ceph-mon[27902]: pgmap v5792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:58 smithi191 ceph-mon[31636]: pgmap v5792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:58 smithi170 ceph-mon[31212]: pgmap v5792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:22:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10690.240024 secs 2024-04-21T13:22:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10690.240024 secs 2024-04-21T13:22:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10690.240024 secs 2024-04-21T13:23:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:00 smithi191 ceph-mon[31636]: pgmap v5793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:00 smithi170 ceph-mon[31212]: pgmap v5793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:00 smithi077 ceph-mon[27902]: pgmap v5793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:02 smithi191 ceph-mon[31636]: pgmap v5794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:23:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10693.479638 secs 2024-04-21T13:23:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:02 smithi170 ceph-mon[31212]: pgmap v5794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:23:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10693.479638 secs 2024-04-21T13:23:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:02 smithi077 ceph-mon[27902]: pgmap v5794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T13:23:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10693.479638 secs 2024-04-21T13:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:04 smithi191 ceph-mon[31636]: pgmap v5795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10695.240134 secs 2024-04-21T13:23:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:04 smithi191 ceph-mon[31636]: osdmap e433: 12 total, 12 up, 12 in 2024-04-21T13:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:04 smithi170 ceph-mon[31212]: pgmap v5795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:23:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10695.240134 secs 2024-04-21T13:23:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:04 smithi170 ceph-mon[31212]: osdmap e433: 12 total, 12 up, 12 in 2024-04-21T13:23:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:04 smithi077 ceph-mon[27902]: pgmap v5795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:23:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10695.240134 secs 2024-04-21T13:23:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:04 smithi077 ceph-mon[27902]: osdmap e433: 12 total, 12 up, 12 in 2024-04-21T13:23:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:06 smithi191 ceph-mon[31636]: pgmap v5797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:23:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:06 smithi170 ceph-mon[31212]: pgmap v5797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:23:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:06 smithi077 ceph-mon[27902]: pgmap v5797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:23:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10698.479741 secs 2024-04-21T13:23:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10698.479741 secs 2024-04-21T13:23:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10698.479741 secs 2024-04-21T13:23:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:08 smithi191 ceph-mon[31636]: pgmap v5798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:23:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:08 smithi170 ceph-mon[31212]: pgmap v5798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:23:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:08 smithi077 ceph-mon[27902]: pgmap v5798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:23:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10700.240245 secs 2024-04-21T13:23:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:09 smithi170 ceph-mon[31212]: osdmap e434: 12 total, 12 up, 12 in 2024-04-21T13:23:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10700.240245 secs 2024-04-21T13:23:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:09 smithi077 ceph-mon[27902]: osdmap e434: 12 total, 12 up, 12 in 2024-04-21T13:23:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10700.240245 secs 2024-04-21T13:23:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:09 smithi191 ceph-mon[31636]: osdmap e434: 12 total, 12 up, 12 in 2024-04-21T13:23:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:10 smithi170 ceph-mon[31212]: pgmap v5800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-21T13:23:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:10 smithi077 ceph-mon[27902]: pgmap v5800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-21T13:23:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:10 smithi191 ceph-mon[31636]: pgmap v5800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-21T13:23:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:12 smithi170 ceph-mon[31212]: pgmap v5801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T13:23:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10703.479861 secs 2024-04-21T13:23:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:12 smithi077 ceph-mon[27902]: pgmap v5801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T13:23:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10703.479861 secs 2024-04-21T13:23:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:12 smithi191 ceph-mon[31636]: pgmap v5801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T13:23:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10703.479861 secs 2024-04-21T13:23:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:14 smithi170 ceph-mon[31212]: pgmap v5802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T13:23:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10705.240327 secs 2024-04-21T13:23:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:14 smithi077 ceph-mon[27902]: pgmap v5802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T13:23:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10705.240327 secs 2024-04-21T13:23:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:14 smithi191 ceph-mon[31636]: pgmap v5802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T13:23:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10705.240327 secs 2024-04-21T13:23:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:16 smithi170 ceph-mon[31212]: pgmap v5803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:23:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:16 smithi077 ceph-mon[27902]: pgmap v5803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:23:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:16 smithi191 ceph-mon[31636]: pgmap v5803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:23:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10708.479945 secs 2024-04-21T13:23:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10708.479945 secs 2024-04-21T13:23:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10708.479945 secs 2024-04-21T13:23:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:18 smithi170 ceph-mon[31212]: pgmap v5804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:23:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:18 smithi191 ceph-mon[31636]: pgmap v5804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:23:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:18 smithi077 ceph-mon[27902]: pgmap v5804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:23:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10710.240459 secs 2024-04-21T13:23:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10710.240459 secs 2024-04-21T13:23:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10710.240459 secs 2024-04-21T13:23:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:20 smithi170 ceph-mon[31212]: pgmap v5805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:23:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:20 smithi077 ceph-mon[27902]: pgmap v5805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:23:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:20 smithi191 ceph-mon[31636]: pgmap v5805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:23:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:22 smithi170 ceph-mon[31212]: pgmap v5806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:23:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10713.480044 secs 2024-04-21T13:23:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:22 smithi077 ceph-mon[27902]: pgmap v5806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:23:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10713.480044 secs 2024-04-21T13:23:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:22 smithi191 ceph-mon[31636]: pgmap v5806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:23:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10713.480044 secs 2024-04-21T13:23:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:24 smithi170 ceph-mon[31212]: pgmap v5807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10715.240577 secs 2024-04-21T13:23:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:24 smithi077 ceph-mon[27902]: pgmap v5807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10715.240577 secs 2024-04-21T13:23:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:24 smithi191 ceph-mon[31636]: pgmap v5807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10715.240577 secs 2024-04-21T13:23:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:23:25.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:23:25.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:23:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:26 smithi170 ceph-mon[31212]: pgmap v5808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:23:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:23:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:23:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:26 smithi077 ceph-mon[27902]: pgmap v5808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:23:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:23:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:23:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:26 smithi191 ceph-mon[31636]: pgmap v5808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:23:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:23:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:23:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10718.480109 secs 2024-04-21T13:23:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10718.480109 secs 2024-04-21T13:23:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10718.480109 secs 2024-04-21T13:23:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:28 smithi077 ceph-mon[27902]: pgmap v5809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:28 smithi191 ceph-mon[31636]: pgmap v5809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:28 smithi170 ceph-mon[31212]: pgmap v5809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10720.240694 secs 2024-04-21T13:23:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10720.240694 secs 2024-04-21T13:23:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10720.240694 secs 2024-04-21T13:23:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:30 smithi077 ceph-mon[27902]: pgmap v5810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:30 smithi191 ceph-mon[31636]: pgmap v5810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:30 smithi170 ceph-mon[31212]: pgmap v5810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:32 smithi077 ceph-mon[27902]: pgmap v5811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10723.480263 secs 2024-04-21T13:23:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:32 smithi191 ceph-mon[31636]: pgmap v5811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10723.480263 secs 2024-04-21T13:23:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:32 smithi170 ceph-mon[31212]: pgmap v5811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10723.480263 secs 2024-04-21T13:23:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:34 smithi077 ceph-mon[27902]: pgmap v5812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10725.240816 secs 2024-04-21T13:23:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:34 smithi191 ceph-mon[31636]: pgmap v5812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10725.240816 secs 2024-04-21T13:23:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:34 smithi170 ceph-mon[31212]: pgmap v5812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10725.240816 secs 2024-04-21T13:23:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:36 smithi077 ceph-mon[27902]: pgmap v5813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:36 smithi191 ceph-mon[31636]: pgmap v5813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:36 smithi170 ceph-mon[31212]: pgmap v5813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10728.480377 secs 2024-04-21T13:23:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10728.480377 secs 2024-04-21T13:23:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10728.480377 secs 2024-04-21T13:23:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:38 smithi077 ceph-mon[27902]: pgmap v5814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:38 smithi191 ceph-mon[31636]: pgmap v5814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:38 smithi170 ceph-mon[31212]: pgmap v5814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10730.240927 secs 2024-04-21T13:23:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10730.240927 secs 2024-04-21T13:23:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10730.240927 secs 2024-04-21T13:23:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:40 smithi077 ceph-mon[27902]: pgmap v5815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:40 smithi191 ceph-mon[31636]: pgmap v5815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:40 smithi170 ceph-mon[31212]: pgmap v5815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:42 smithi077 ceph-mon[27902]: pgmap v5816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10733.480497 secs 2024-04-21T13:23:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:42 smithi191 ceph-mon[31636]: pgmap v5816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10733.480497 secs 2024-04-21T13:23:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:42 smithi170 ceph-mon[31212]: pgmap v5816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10733.480497 secs 2024-04-21T13:23:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:44 smithi077 ceph-mon[27902]: pgmap v5817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10735.241058 secs 2024-04-21T13:23:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:44 smithi191 ceph-mon[31636]: pgmap v5817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10735.241058 secs 2024-04-21T13:23:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:44 smithi170 ceph-mon[31212]: pgmap v5817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10735.241058 secs 2024-04-21T13:23:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:46 smithi077 ceph-mon[27902]: pgmap v5818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:46 smithi191 ceph-mon[31636]: pgmap v5818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:46 smithi170 ceph-mon[31212]: pgmap v5818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10738.480635 secs 2024-04-21T13:23:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10738.480635 secs 2024-04-21T13:23:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10738.480635 secs 2024-04-21T13:23:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:48 smithi191 ceph-mon[31636]: pgmap v5819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:48 smithi077 ceph-mon[27902]: pgmap v5819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:48 smithi170 ceph-mon[31212]: pgmap v5819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10740.241143 secs 2024-04-21T13:23:49.886 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10740.241143 secs 2024-04-21T13:23:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10740.241143 secs 2024-04-21T13:23:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:50 smithi077 ceph-mon[27902]: pgmap v5820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:50 smithi191 ceph-mon[31636]: pgmap v5820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:50 smithi170 ceph-mon[31212]: pgmap v5820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:52 smithi077 ceph-mon[27902]: pgmap v5821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10743.480791 secs 2024-04-21T13:23:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:52 smithi191 ceph-mon[31636]: pgmap v5821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10743.480791 secs 2024-04-21T13:23:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:52 smithi170 ceph-mon[31212]: pgmap v5821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10743.480791 secs 2024-04-21T13:23:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:54 smithi077 ceph-mon[27902]: pgmap v5822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10745.241222 secs 2024-04-21T13:23:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:54 smithi191 ceph-mon[31636]: pgmap v5822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10745.241222 secs 2024-04-21T13:23:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:54 smithi170 ceph-mon[31212]: pgmap v5822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10745.241222 secs 2024-04-21T13:23:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:23:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:56 smithi077 ceph-mon[27902]: pgmap v5823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:56 smithi191 ceph-mon[31636]: pgmap v5823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:56 smithi170 ceph-mon[31212]: pgmap v5823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:23:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10748.480904 secs 2024-04-21T13:23:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10748.480904 secs 2024-04-21T13:23:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10748.480904 secs 2024-04-21T13:23:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:58 smithi077 ceph-mon[27902]: pgmap v5824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:58 smithi191 ceph-mon[31636]: pgmap v5824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:58 smithi170 ceph-mon[31212]: pgmap v5824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:23:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10750.241339 secs 2024-04-21T13:24:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10750.241339 secs 2024-04-21T13:24:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10750.241339 secs 2024-04-21T13:24:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:00 smithi191 ceph-mon[31636]: pgmap v5825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:00 smithi170 ceph-mon[31212]: pgmap v5825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:00 smithi077 ceph-mon[27902]: pgmap v5825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:02 smithi191 ceph-mon[31636]: pgmap v5826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T13:24:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10753.480978 secs 2024-04-21T13:24:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:02 smithi170 ceph-mon[31212]: pgmap v5826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T13:24:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10753.480978 secs 2024-04-21T13:24:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:02 smithi077 ceph-mon[27902]: pgmap v5826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T13:24:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10753.480978 secs 2024-04-21T13:24:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:04 smithi191 ceph-mon[31636]: pgmap v5827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T13:24:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10755.241454 secs 2024-04-21T13:24:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:04 smithi191 ceph-mon[31636]: osdmap e435: 12 total, 12 up, 12 in 2024-04-21T13:24:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:04 smithi170 ceph-mon[31212]: pgmap v5827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T13:24:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10755.241454 secs 2024-04-21T13:24:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:04 smithi170 ceph-mon[31212]: osdmap e435: 12 total, 12 up, 12 in 2024-04-21T13:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:04 smithi077 ceph-mon[27902]: pgmap v5827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T13:24:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10755.241454 secs 2024-04-21T13:24:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:04 smithi077 ceph-mon[27902]: osdmap e435: 12 total, 12 up, 12 in 2024-04-21T13:24:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:06 smithi191 ceph-mon[31636]: pgmap v5829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:24:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:06 smithi170 ceph-mon[31212]: pgmap v5829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:24:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:06 smithi077 ceph-mon[27902]: pgmap v5829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:24:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10758.481058 secs 2024-04-21T13:24:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10758.481058 secs 2024-04-21T13:24:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10758.481058 secs 2024-04-21T13:24:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:08 smithi191 ceph-mon[31636]: pgmap v5830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:24:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:08 smithi191 ceph-mon[31636]: osdmap e436: 12 total, 12 up, 12 in 2024-04-21T13:24:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:08 smithi170 ceph-mon[31212]: pgmap v5830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:24:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:08 smithi170 ceph-mon[31212]: osdmap e436: 12 total, 12 up, 12 in 2024-04-21T13:24:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:08 smithi077 ceph-mon[27902]: pgmap v5830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:24:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:08 smithi077 ceph-mon[27902]: osdmap e436: 12 total, 12 up, 12 in 2024-04-21T13:24:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10760.241567 secs 2024-04-21T13:24:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10760.241567 secs 2024-04-21T13:24:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10760.241567 secs 2024-04-21T13:24:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:10 smithi191 ceph-mon[31636]: pgmap v5832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-04-21T13:24:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:10 smithi170 ceph-mon[31212]: pgmap v5832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-04-21T13:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:10 smithi077 ceph-mon[27902]: pgmap v5832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-04-21T13:24:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:12 smithi191 ceph-mon[31636]: pgmap v5833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T13:24:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10763.481168 secs 2024-04-21T13:24:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:12 smithi170 ceph-mon[31212]: pgmap v5833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T13:24:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10763.481168 secs 2024-04-21T13:24:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:12 smithi077 ceph-mon[27902]: pgmap v5833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T13:24:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10763.481168 secs 2024-04-21T13:24:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:14 smithi191 ceph-mon[31636]: pgmap v5834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-04-21T13:24:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10765.241688 secs 2024-04-21T13:24:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:14 smithi170 ceph-mon[31212]: pgmap v5834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-04-21T13:24:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10765.241688 secs 2024-04-21T13:24:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:14 smithi077 ceph-mon[27902]: pgmap v5834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-04-21T13:24:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10765.241688 secs 2024-04-21T13:24:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:16 smithi191 ceph-mon[31636]: pgmap v5835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:24:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:16 smithi170 ceph-mon[31212]: pgmap v5835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:24:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:16 smithi077 ceph-mon[27902]: pgmap v5835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:24:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10768.481287 secs 2024-04-21T13:24:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10768.481287 secs 2024-04-21T13:24:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10768.481287 secs 2024-04-21T13:24:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:18 smithi170 ceph-mon[31212]: pgmap v5836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:24:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:18 smithi191 ceph-mon[31636]: pgmap v5836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:24:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:18 smithi077 ceph-mon[27902]: pgmap v5836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:24:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10770.241793 secs 2024-04-21T13:24:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10770.241793 secs 2024-04-21T13:24:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10770.241793 secs 2024-04-21T13:24:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:20 smithi191 ceph-mon[31636]: pgmap v5837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:24:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:20 smithi170 ceph-mon[31212]: pgmap v5837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:24:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:20 smithi077 ceph-mon[27902]: pgmap v5837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:24:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:22 smithi191 ceph-mon[31636]: pgmap v5838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:24:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10773.481405 secs 2024-04-21T13:24:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:22 smithi170 ceph-mon[31212]: pgmap v5838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:24:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10773.481405 secs 2024-04-21T13:24:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:22 smithi077 ceph-mon[27902]: pgmap v5838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:24:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10773.481405 secs 2024-04-21T13:24:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:24 smithi191 ceph-mon[31636]: pgmap v5839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10775.241910 secs 2024-04-21T13:24:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:24 smithi170 ceph-mon[31212]: pgmap v5839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10775.241910 secs 2024-04-21T13:24:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:24 smithi077 ceph-mon[27902]: pgmap v5839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10775.241910 secs 2024-04-21T13:24:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:26 smithi191 ceph-mon[31636]: pgmap v5840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:24:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:24:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:24:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:24:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:26 smithi170 ceph-mon[31212]: pgmap v5840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:24:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:24:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:24:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:24:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:26 smithi077 ceph-mon[27902]: pgmap v5840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:24:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:24:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:24:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:24:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10778.481547 secs 2024-04-21T13:24:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10778.481547 secs 2024-04-21T13:24:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10778.481547 secs 2024-04-21T13:24:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:28 smithi170 ceph-mon[31212]: pgmap v5841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:28 smithi077 ceph-mon[27902]: pgmap v5841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:28 smithi191 ceph-mon[31636]: pgmap v5841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10780.242018 secs 2024-04-21T13:24:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:29 smithi170 ceph-mon[31212]: pgmap v5842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10780.242018 secs 2024-04-21T13:24:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:29 smithi077 ceph-mon[27902]: pgmap v5842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10780.242018 secs 2024-04-21T13:24:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:29 smithi191 ceph-mon[31636]: pgmap v5842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:32 smithi077 ceph-mon[27902]: pgmap v5843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10783.481672 secs 2024-04-21T13:24:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:32 smithi191 ceph-mon[31636]: pgmap v5843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10783.481672 secs 2024-04-21T13:24:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:32 smithi170 ceph-mon[31212]: pgmap v5843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10783.481672 secs 2024-04-21T13:24:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:34 smithi077 ceph-mon[27902]: pgmap v5844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10785.242135 secs 2024-04-21T13:24:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:34 smithi191 ceph-mon[31636]: pgmap v5844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10785.242135 secs 2024-04-21T13:24:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:34 smithi170 ceph-mon[31212]: pgmap v5844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10785.242135 secs 2024-04-21T13:24:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:36 smithi077 ceph-mon[27902]: pgmap v5845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:36 smithi191 ceph-mon[31636]: pgmap v5845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:36 smithi170 ceph-mon[31212]: pgmap v5845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10788.481793 secs 2024-04-21T13:24:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10788.481793 secs 2024-04-21T13:24:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10788.481793 secs 2024-04-21T13:24:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:38 smithi077 ceph-mon[27902]: pgmap v5846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:38 smithi191 ceph-mon[31636]: pgmap v5846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:38 smithi170 ceph-mon[31212]: pgmap v5846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10790.242243 secs 2024-04-21T13:24:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10790.242243 secs 2024-04-21T13:24:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10790.242243 secs 2024-04-21T13:24:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:40 smithi077 ceph-mon[27902]: pgmap v5847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:40 smithi191 ceph-mon[31636]: pgmap v5847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:40 smithi170 ceph-mon[31212]: pgmap v5847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:42 smithi077 ceph-mon[27902]: pgmap v5848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10793.481909 secs 2024-04-21T13:24:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:42 smithi191 ceph-mon[31636]: pgmap v5848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10793.481909 secs 2024-04-21T13:24:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:42 smithi170 ceph-mon[31212]: pgmap v5848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10793.481909 secs 2024-04-21T13:24:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:44 smithi077 ceph-mon[27902]: pgmap v5849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10795.242341 secs 2024-04-21T13:24:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:44 smithi191 ceph-mon[31636]: pgmap v5849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10795.242341 secs 2024-04-21T13:24:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:44 smithi170 ceph-mon[31212]: pgmap v5849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10795.242341 secs 2024-04-21T13:24:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:46 smithi077 ceph-mon[27902]: pgmap v5850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:46 smithi191 ceph-mon[31636]: pgmap v5850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:46 smithi170 ceph-mon[31212]: pgmap v5850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10798.482028 secs 2024-04-21T13:24:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10798.482028 secs 2024-04-21T13:24:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10798.482028 secs 2024-04-21T13:24:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:48 smithi077 ceph-mon[27902]: pgmap v5851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:48.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:48 smithi170 ceph-mon[31212]: pgmap v5851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:48 smithi191 ceph-mon[31636]: pgmap v5851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10800.242468 secs 2024-04-21T13:24:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10800.242468 secs 2024-04-21T13:24:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10800.242468 secs 2024-04-21T13:24:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:50 smithi170 ceph-mon[31212]: pgmap v5852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:50 smithi077 ceph-mon[27902]: pgmap v5852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:50 smithi191 ceph-mon[31636]: pgmap v5852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:52 smithi170 ceph-mon[31212]: pgmap v5853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10803.482139 secs 2024-04-21T13:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:52 smithi077 ceph-mon[27902]: pgmap v5853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10803.482139 secs 2024-04-21T13:24:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:52 smithi191 ceph-mon[31636]: pgmap v5853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10803.482139 secs 2024-04-21T13:24:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:54 smithi170 ceph-mon[31212]: pgmap v5854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10805.242592 secs 2024-04-21T13:24:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:54 smithi077 ceph-mon[27902]: pgmap v5854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10805.242592 secs 2024-04-21T13:24:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:54 smithi191 ceph-mon[31636]: pgmap v5854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10805.242592 secs 2024-04-21T13:24:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:24:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:56 smithi170 ceph-mon[31212]: pgmap v5855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:56 smithi077 ceph-mon[27902]: pgmap v5855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:56 smithi191 ceph-mon[31636]: pgmap v5855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:24:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10808.482257 secs 2024-04-21T13:24:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10808.482257 secs 2024-04-21T13:24:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10808.482257 secs 2024-04-21T13:24:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:58 smithi077 ceph-mon[27902]: pgmap v5856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:58 smithi191 ceph-mon[31636]: pgmap v5856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:58 smithi170 ceph-mon[31212]: pgmap v5856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:24:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10810.242723 secs 2024-04-21T13:24:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10810.242723 secs 2024-04-21T13:25:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10810.242723 secs 2024-04-21T13:25:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 10995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:00 smithi077 ceph-mon[27902]: pgmap v5857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:00 smithi191 ceph-mon[31636]: pgmap v5857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:00 smithi170 ceph-mon[31212]: pgmap v5857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:02 smithi077 ceph-mon[27902]: pgmap v5858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10813.482395 secs 2024-04-21T13:25:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:02 smithi191 ceph-mon[31636]: pgmap v5858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10813.482395 secs 2024-04-21T13:25:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:02 smithi170 ceph-mon[31212]: pgmap v5858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10813.482395 secs 2024-04-21T13:25:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:04 smithi077 ceph-mon[27902]: pgmap v5859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10815.242840 secs 2024-04-21T13:25:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:04 smithi077 ceph-mon[27902]: osdmap e437: 12 total, 12 up, 12 in 2024-04-21T13:25:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:04 smithi191 ceph-mon[31636]: pgmap v5859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10815.242840 secs 2024-04-21T13:25:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:04 smithi191 ceph-mon[31636]: osdmap e437: 12 total, 12 up, 12 in 2024-04-21T13:25:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:04 smithi170 ceph-mon[31212]: pgmap v5859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10815.242840 secs 2024-04-21T13:25:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:04 smithi170 ceph-mon[31212]: osdmap e437: 12 total, 12 up, 12 in 2024-04-21T13:25:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:06 smithi077 ceph-mon[27902]: pgmap v5861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:25:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:06 smithi191 ceph-mon[31636]: pgmap v5861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:25:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:06 smithi170 ceph-mon[31212]: pgmap v5861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:25:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10818.482516 secs 2024-04-21T13:25:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10818.482516 secs 2024-04-21T13:25:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10818.482516 secs 2024-04-21T13:25:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:08 smithi077 ceph-mon[27902]: pgmap v5862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:25:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:08 smithi077 ceph-mon[27902]: osdmap e438: 12 total, 12 up, 12 in 2024-04-21T13:25:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:08 smithi191 ceph-mon[31636]: pgmap v5862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:25:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:08 smithi191 ceph-mon[31636]: osdmap e438: 12 total, 12 up, 12 in 2024-04-21T13:25:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:08 smithi170 ceph-mon[31212]: pgmap v5862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:25:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:08 smithi170 ceph-mon[31212]: osdmap e438: 12 total, 12 up, 12 in 2024-04-21T13:25:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10820.242949 secs 2024-04-21T13:25:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10820.242949 secs 2024-04-21T13:25:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10820.242949 secs 2024-04-21T13:25:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:10 smithi077 ceph-mon[27902]: pgmap v5864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:25:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:10 smithi191 ceph-mon[31636]: pgmap v5864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:25:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:10 smithi170 ceph-mon[31212]: pgmap v5864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:25:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:12 smithi077 ceph-mon[27902]: pgmap v5865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:25:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10823.482631 secs 2024-04-21T13:25:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:12 smithi191 ceph-mon[31636]: pgmap v5865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:25:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10823.482631 secs 2024-04-21T13:25:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:12 smithi170 ceph-mon[31212]: pgmap v5865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:25:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10823.482631 secs 2024-04-21T13:25:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:14 smithi077 ceph-mon[27902]: pgmap v5866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:25:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10825.243023 secs 2024-04-21T13:25:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:14 smithi191 ceph-mon[31636]: pgmap v5866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:25:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10825.243023 secs 2024-04-21T13:25:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:14 smithi170 ceph-mon[31212]: pgmap v5866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:25:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10825.243023 secs 2024-04-21T13:25:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:16 smithi077 ceph-mon[27902]: pgmap v5867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:25:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:16 smithi191 ceph-mon[31636]: pgmap v5867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:25:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:16 smithi170 ceph-mon[31212]: pgmap v5867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:25:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10828.482741 secs 2024-04-21T13:25:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10828.482741 secs 2024-04-21T13:25:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10828.482741 secs 2024-04-21T13:25:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:18 smithi191 ceph-mon[31636]: pgmap v5868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:25:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:18 smithi077 ceph-mon[27902]: pgmap v5868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:25:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:18 smithi170 ceph-mon[31212]: pgmap v5868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:25:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10830.243137 secs 2024-04-21T13:25:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10830.243137 secs 2024-04-21T13:25:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10830.243137 secs 2024-04-21T13:25:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:20 smithi077 ceph-mon[27902]: pgmap v5869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:25:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:20 smithi191 ceph-mon[31636]: pgmap v5869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:25:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:20 smithi170 ceph-mon[31212]: pgmap v5869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:25:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:22 smithi077 ceph-mon[27902]: pgmap v5870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:25:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10833.482860 secs 2024-04-21T13:25:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:22 smithi191 ceph-mon[31636]: pgmap v5870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:25:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10833.482860 secs 2024-04-21T13:25:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:22 smithi170 ceph-mon[31212]: pgmap v5870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:25:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10833.482860 secs 2024-04-21T13:25:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:24 smithi077 ceph-mon[27902]: pgmap v5871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10835.243252 secs 2024-04-21T13:25:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:24 smithi191 ceph-mon[31636]: pgmap v5871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10835.243252 secs 2024-04-21T13:25:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:24 smithi170 ceph-mon[31212]: pgmap v5871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10835.243252 secs 2024-04-21T13:25:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:26 smithi077 ceph-mon[27902]: pgmap v5872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:26 smithi191 ceph-mon[31636]: pgmap v5872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:26 smithi170 ceph-mon[31212]: pgmap v5872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10838.482930 secs 2024-04-21T13:25:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:25:27.912 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10838.482930 secs 2024-04-21T13:25:27.912 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:25:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10838.482930 secs 2024-04-21T13:25:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:25:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:28 smithi077 ceph-mon[27902]: pgmap v5873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:28 smithi191 ceph-mon[31636]: pgmap v5873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:28 smithi170 ceph-mon[31212]: pgmap v5873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10840.243319 secs 2024-04-21T13:25:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10840.243319 secs 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10840.243319 secs 2024-04-21T13:25:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: pgmap v5874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:25:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:25:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:25:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:25:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: pgmap v5874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:25:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: pgmap v5874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:25:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:25:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:25:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:25:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:25:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:25:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:25:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:25:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:32 smithi191 ceph-mon[31636]: pgmap v5875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10843.483048 secs 2024-04-21T13:25:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:32 smithi170 ceph-mon[31212]: pgmap v5875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10843.483048 secs 2024-04-21T13:25:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:32 smithi077 ceph-mon[27902]: pgmap v5875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10843.483048 secs 2024-04-21T13:25:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:34 smithi191 ceph-mon[31636]: pgmap v5876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10845.243436 secs 2024-04-21T13:25:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:34 smithi170 ceph-mon[31212]: pgmap v5876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10845.243436 secs 2024-04-21T13:25:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:34 smithi077 ceph-mon[27902]: pgmap v5876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10845.243436 secs 2024-04-21T13:25:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:36 smithi191 ceph-mon[31636]: pgmap v5877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:36 smithi170 ceph-mon[31212]: pgmap v5877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:36 smithi077 ceph-mon[27902]: pgmap v5877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10848.483162 secs 2024-04-21T13:25:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10848.483162 secs 2024-04-21T13:25:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10848.483162 secs 2024-04-21T13:25:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:38 smithi170 ceph-mon[31212]: pgmap v5878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:38 smithi077 ceph-mon[27902]: pgmap v5878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:38 smithi191 ceph-mon[31636]: pgmap v5878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10850.243505 secs 2024-04-21T13:25:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10850.243505 secs 2024-04-21T13:25:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10850.243505 secs 2024-04-21T13:25:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:40 smithi170 ceph-mon[31212]: pgmap v5879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:40 smithi077 ceph-mon[27902]: pgmap v5879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:40 smithi191 ceph-mon[31636]: pgmap v5879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:42.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:41 smithi170 ceph-mon[31212]: pgmap v5880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:41 smithi077 ceph-mon[27902]: pgmap v5880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:41 smithi191 ceph-mon[31636]: pgmap v5880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10853.483302 secs 2024-04-21T13:25:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10853.483302 secs 2024-04-21T13:25:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10853.483302 secs 2024-04-21T13:25:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:43 smithi170 ceph-mon[31212]: pgmap v5881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:43 smithi077 ceph-mon[27902]: pgmap v5881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:43 smithi191 ceph-mon[31636]: pgmap v5881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10855.243646 secs 2024-04-21T13:25:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10855.243646 secs 2024-04-21T13:25:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10855.243646 secs 2024-04-21T13:25:46.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:45 smithi170 ceph-mon[31212]: pgmap v5882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:45 smithi077 ceph-mon[27902]: pgmap v5882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:45 smithi191 ceph-mon[31636]: pgmap v5882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10858.483412 secs 2024-04-21T13:25:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10858.483412 secs 2024-04-21T13:25:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10858.483412 secs 2024-04-21T13:25:48.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:48 smithi191 ceph-mon[31636]: pgmap v5883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:48 smithi077 ceph-mon[27902]: pgmap v5883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:48.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:48 smithi170 ceph-mon[31212]: pgmap v5883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10860.243758 secs 2024-04-21T13:25:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10860.243758 secs 2024-04-21T13:25:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10860.243758 secs 2024-04-21T13:25:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:50 smithi077 ceph-mon[27902]: pgmap v5884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:50 smithi191 ceph-mon[31636]: pgmap v5884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:50 smithi170 ceph-mon[31212]: pgmap v5884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:52 smithi077 ceph-mon[27902]: pgmap v5885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10863.483530 secs 2024-04-21T13:25:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:52 smithi191 ceph-mon[31636]: pgmap v5885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10863.483530 secs 2024-04-21T13:25:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:52 smithi170 ceph-mon[31212]: pgmap v5885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10863.483530 secs 2024-04-21T13:25:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:54 smithi077 ceph-mon[27902]: pgmap v5886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10865.243824 secs 2024-04-21T13:25:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:54 smithi191 ceph-mon[31636]: pgmap v5886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:54.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10865.243824 secs 2024-04-21T13:25:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:54 smithi170 ceph-mon[31212]: pgmap v5886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10865.243824 secs 2024-04-21T13:25:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:25:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:25:55.854+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:25:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:25:55.854+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:25:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:25:55.854+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:25:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:25:55.854+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:25:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:56 smithi077 ceph-mon[27902]: pgmap v5887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:56.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:56 smithi191 ceph-mon[31636]: pgmap v5887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:56 smithi170 ceph-mon[31212]: pgmap v5887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:25:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10868.483649 secs 2024-04-21T13:25:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10868.483649 secs 2024-04-21T13:25:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10868.483649 secs 2024-04-21T13:25:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:58 smithi077 ceph-mon[27902]: pgmap v5888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:58 smithi191 ceph-mon[31636]: pgmap v5888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:58 smithi170 ceph-mon[31212]: pgmap v5888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:25:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10870.243882 secs 2024-04-21T13:25:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10870.243882 secs 2024-04-21T13:25:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10870.243882 secs 2024-04-21T13:26:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:00 smithi191 ceph-mon[31636]: pgmap v5889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:00 smithi170 ceph-mon[31212]: pgmap v5889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:00 smithi077 ceph-mon[27902]: pgmap v5889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:02 smithi191 ceph-mon[31636]: pgmap v5890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:02.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10873.483790 secs 2024-04-21T13:26:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:02 smithi170 ceph-mon[31212]: pgmap v5890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10873.483790 secs 2024-04-21T13:26:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:02 smithi077 ceph-mon[27902]: pgmap v5890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10873.483790 secs 2024-04-21T13:26:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:04 smithi191 ceph-mon[31636]: pgmap v5891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10875.244005 secs 2024-04-21T13:26:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:04 smithi191 ceph-mon[31636]: osdmap e439: 12 total, 12 up, 12 in 2024-04-21T13:26:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:04 smithi170 ceph-mon[31212]: pgmap v5891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10875.244005 secs 2024-04-21T13:26:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:04 smithi170 ceph-mon[31212]: osdmap e439: 12 total, 12 up, 12 in 2024-04-21T13:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:04 smithi077 ceph-mon[27902]: pgmap v5891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10875.244005 secs 2024-04-21T13:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:04 smithi077 ceph-mon[27902]: osdmap e439: 12 total, 12 up, 12 in 2024-04-21T13:26:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:06 smithi191 ceph-mon[31636]: pgmap v5893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:26:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:06 smithi170 ceph-mon[31212]: pgmap v5893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:26:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:06 smithi077 ceph-mon[27902]: pgmap v5893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:26:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10878.483909 secs 2024-04-21T13:26:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10878.483909 secs 2024-04-21T13:26:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10878.483909 secs 2024-04-21T13:26:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:08 smithi191 ceph-mon[31636]: pgmap v5894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:26:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:08 smithi170 ceph-mon[31212]: pgmap v5894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:26:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:08 smithi077 ceph-mon[27902]: pgmap v5894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:26:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10880.244135 secs 2024-04-21T13:26:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:09 smithi170 ceph-mon[31212]: osdmap e440: 12 total, 12 up, 12 in 2024-04-21T13:26:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10880.244135 secs 2024-04-21T13:26:09.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:09 smithi077 ceph-mon[27902]: osdmap e440: 12 total, 12 up, 12 in 2024-04-21T13:26:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10880.244135 secs 2024-04-21T13:26:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:09 smithi191 ceph-mon[31636]: osdmap e440: 12 total, 12 up, 12 in 2024-04-21T13:26:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:10 smithi077 ceph-mon[27902]: pgmap v5896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:26:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:10 smithi191 ceph-mon[31636]: pgmap v5896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:26:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:10 smithi170 ceph-mon[31212]: pgmap v5896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:26:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:12 smithi077 ceph-mon[27902]: pgmap v5897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:26:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10883.484017 secs 2024-04-21T13:26:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:12 smithi191 ceph-mon[31636]: pgmap v5897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:26:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10883.484017 secs 2024-04-21T13:26:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:12 smithi170 ceph-mon[31212]: pgmap v5897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:26:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10883.484017 secs 2024-04-21T13:26:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:14 smithi077 ceph-mon[27902]: pgmap v5898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:26:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10885.244244 secs 2024-04-21T13:26:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:14 smithi191 ceph-mon[31636]: pgmap v5898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:26:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10885.244244 secs 2024-04-21T13:26:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:14 smithi170 ceph-mon[31212]: pgmap v5898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:26:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10885.244244 secs 2024-04-21T13:26:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:16 smithi077 ceph-mon[27902]: pgmap v5899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:26:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:16 smithi191 ceph-mon[31636]: pgmap v5899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:26:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:16 smithi170 ceph-mon[31212]: pgmap v5899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:26:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10888.484143 secs 2024-04-21T13:26:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10888.484143 secs 2024-04-21T13:26:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10888.484143 secs 2024-04-21T13:26:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:18 smithi191 ceph-mon[31636]: pgmap v5900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:26:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:18 smithi077 ceph-mon[27902]: pgmap v5900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:26:18.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:18 smithi170 ceph-mon[31212]: pgmap v5900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:26:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10890.244361 secs 2024-04-21T13:26:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10890.244361 secs 2024-04-21T13:26:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10890.244361 secs 2024-04-21T13:26:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:20 smithi077 ceph-mon[27902]: pgmap v5901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:26:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:20 smithi191 ceph-mon[31636]: pgmap v5901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:26:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:20 smithi170 ceph-mon[31212]: pgmap v5901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:26:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:22 smithi077 ceph-mon[27902]: pgmap v5902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:26:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10893.484251 secs 2024-04-21T13:26:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:22 smithi191 ceph-mon[31636]: pgmap v5902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:26:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10893.484251 secs 2024-04-21T13:26:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:22 smithi170 ceph-mon[31212]: pgmap v5902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:26:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10893.484251 secs 2024-04-21T13:26:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:24 smithi077 ceph-mon[27902]: pgmap v5903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10895.244476 secs 2024-04-21T13:26:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:24 smithi191 ceph-mon[31636]: pgmap v5903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10895.244476 secs 2024-04-21T13:26:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:24 smithi170 ceph-mon[31212]: pgmap v5903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10895.244476 secs 2024-04-21T13:26:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:26 smithi077 ceph-mon[27902]: pgmap v5904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:26 smithi191 ceph-mon[31636]: pgmap v5904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:26 smithi170 ceph-mon[31212]: pgmap v5904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10898.484366 secs 2024-04-21T13:26:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10898.484366 secs 2024-04-21T13:26:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10898.484366 secs 2024-04-21T13:26:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:28 smithi077 ceph-mon[27902]: pgmap v5905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:28 smithi191 ceph-mon[31636]: pgmap v5905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:28 smithi170 ceph-mon[31212]: pgmap v5905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10900.244612 secs 2024-04-21T13:26:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10900.244612 secs 2024-04-21T13:26:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10900.244612 secs 2024-04-21T13:26:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:30 smithi077 ceph-mon[27902]: pgmap v5906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:26:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:30 smithi191 ceph-mon[31636]: pgmap v5906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:26:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:30 smithi170 ceph-mon[31212]: pgmap v5906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:26:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:26:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:26:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:26:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:26:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:26:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:26:32.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:26:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:32 smithi077 ceph-mon[27902]: pgmap v5907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10903.484434 secs 2024-04-21T13:26:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:32 smithi191 ceph-mon[31636]: pgmap v5907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10903.484434 secs 2024-04-21T13:26:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:32 smithi170 ceph-mon[31212]: pgmap v5907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10903.484434 secs 2024-04-21T13:26:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:34 smithi077 ceph-mon[27902]: pgmap v5908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10905.244745 secs 2024-04-21T13:26:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:34 smithi191 ceph-mon[31636]: pgmap v5908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10905.244745 secs 2024-04-21T13:26:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:34 smithi170 ceph-mon[31212]: pgmap v5908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10905.244745 secs 2024-04-21T13:26:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:36 smithi077 ceph-mon[27902]: pgmap v5909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:36 smithi191 ceph-mon[31636]: pgmap v5909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:36 smithi170 ceph-mon[31212]: pgmap v5909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10908.484573 secs 2024-04-21T13:26:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10908.484573 secs 2024-04-21T13:26:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10908.484573 secs 2024-04-21T13:26:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:38 smithi077 ceph-mon[27902]: pgmap v5910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:38 smithi191 ceph-mon[31636]: pgmap v5910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:38 smithi170 ceph-mon[31212]: pgmap v5910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10910.244878 secs 2024-04-21T13:26:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10910.244878 secs 2024-04-21T13:26:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10910.244878 secs 2024-04-21T13:26:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:40 smithi077 ceph-mon[27902]: pgmap v5911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:40 smithi191 ceph-mon[31636]: pgmap v5911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:40 smithi170 ceph-mon[31212]: pgmap v5911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:42 smithi077 ceph-mon[27902]: pgmap v5912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10913.484629 secs 2024-04-21T13:26:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:42 smithi191 ceph-mon[31636]: pgmap v5912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10913.484629 secs 2024-04-21T13:26:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:42 smithi170 ceph-mon[31212]: pgmap v5912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10913.484629 secs 2024-04-21T13:26:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:44 smithi191 ceph-mon[31636]: pgmap v5913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10915.244990 secs 2024-04-21T13:26:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:44 smithi170 ceph-mon[31212]: pgmap v5913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10915.244990 secs 2024-04-21T13:26:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:44 smithi077 ceph-mon[27902]: pgmap v5913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10915.244990 secs 2024-04-21T13:26:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:46 smithi191 ceph-mon[31636]: pgmap v5914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:46 smithi170 ceph-mon[31212]: pgmap v5914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:46 smithi077 ceph-mon[27902]: pgmap v5914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10918.484782 secs 2024-04-21T13:26:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10918.484782 secs 2024-04-21T13:26:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10918.484782 secs 2024-04-21T13:26:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:48 smithi170 ceph-mon[31212]: pgmap v5915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:48 smithi191 ceph-mon[31636]: pgmap v5915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:48 smithi077 ceph-mon[27902]: pgmap v5915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10920.245103 secs 2024-04-21T13:26:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10920.245103 secs 2024-04-21T13:26:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10920.245103 secs 2024-04-21T13:26:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:50 smithi191 ceph-mon[31636]: pgmap v5916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:50 smithi170 ceph-mon[31212]: pgmap v5916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:50 smithi077 ceph-mon[27902]: pgmap v5916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:52 smithi191 ceph-mon[31636]: pgmap v5917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10923.484898 secs 2024-04-21T13:26:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:52 smithi170 ceph-mon[31212]: pgmap v5917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10923.484898 secs 2024-04-21T13:26:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:52 smithi077 ceph-mon[27902]: pgmap v5917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10923.484898 secs 2024-04-21T13:26:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:54 smithi191 ceph-mon[31636]: pgmap v5918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10925.245219 secs 2024-04-21T13:26:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:54 smithi170 ceph-mon[31212]: pgmap v5918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10925.245219 secs 2024-04-21T13:26:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:26:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:54 smithi077 ceph-mon[27902]: pgmap v5918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10925.245219 secs 2024-04-21T13:26:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:56 smithi191 ceph-mon[31636]: pgmap v5919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:56 smithi170 ceph-mon[31212]: pgmap v5919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:56 smithi077 ceph-mon[27902]: pgmap v5919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:26:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10928.485009 secs 2024-04-21T13:26:58.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10928.485009 secs 2024-04-21T13:26:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10928.485009 secs 2024-04-21T13:26:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:58 smithi191 ceph-mon[31636]: pgmap v5920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:58 smithi170 ceph-mon[31212]: pgmap v5920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:58 smithi077 ceph-mon[27902]: pgmap v5920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:26:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10930.245339 secs 2024-04-21T13:27:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10930.245339 secs 2024-04-21T13:27:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10930.245339 secs 2024-04-21T13:27:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:00 smithi191 ceph-mon[31636]: pgmap v5921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:00 smithi170 ceph-mon[31212]: pgmap v5921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:00 smithi077 ceph-mon[27902]: pgmap v5921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:02 smithi191 ceph-mon[31636]: pgmap v5922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10933.485123 secs 2024-04-21T13:27:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:02 smithi170 ceph-mon[31212]: pgmap v5922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10933.485123 secs 2024-04-21T13:27:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:02 smithi077 ceph-mon[27902]: pgmap v5922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10933.485123 secs 2024-04-21T13:27:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:04 smithi191 ceph-mon[31636]: pgmap v5923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10935.245462 secs 2024-04-21T13:27:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:04 smithi191 ceph-mon[31636]: osdmap e441: 12 total, 12 up, 12 in 2024-04-21T13:27:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:04 smithi170 ceph-mon[31212]: pgmap v5923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10935.245462 secs 2024-04-21T13:27:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:04 smithi170 ceph-mon[31212]: osdmap e441: 12 total, 12 up, 12 in 2024-04-21T13:27:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:04 smithi077 ceph-mon[27902]: pgmap v5923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10935.245462 secs 2024-04-21T13:27:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:04 smithi077 ceph-mon[27902]: osdmap e441: 12 total, 12 up, 12 in 2024-04-21T13:27:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:06 smithi191 ceph-mon[31636]: pgmap v5925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:27:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:06 smithi170 ceph-mon[31212]: pgmap v5925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:27:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:06 smithi077 ceph-mon[27902]: pgmap v5925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:27:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10938.485240 secs 2024-04-21T13:27:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10938.485240 secs 2024-04-21T13:27:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10938.485240 secs 2024-04-21T13:27:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:08 smithi191 ceph-mon[31636]: pgmap v5926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:27:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:08 smithi191 ceph-mon[31636]: osdmap e442: 12 total, 12 up, 12 in 2024-04-21T13:27:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:08 smithi170 ceph-mon[31212]: pgmap v5926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:27:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:08 smithi170 ceph-mon[31212]: osdmap e442: 12 total, 12 up, 12 in 2024-04-21T13:27:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:08 smithi077 ceph-mon[27902]: pgmap v5926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:27:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:08 smithi077 ceph-mon[27902]: osdmap e442: 12 total, 12 up, 12 in 2024-04-21T13:27:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10940.245597 secs 2024-04-21T13:27:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10940.245597 secs 2024-04-21T13:27:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10940.245597 secs 2024-04-21T13:27:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:10 smithi191 ceph-mon[31636]: pgmap v5928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:27:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:10 smithi170 ceph-mon[31212]: pgmap v5928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:27:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:10 smithi077 ceph-mon[27902]: pgmap v5928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:27:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:12 smithi191 ceph-mon[31636]: pgmap v5929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:27:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10943.485371 secs 2024-04-21T13:27:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:12 smithi170 ceph-mon[31212]: pgmap v5929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:27:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10943.485371 secs 2024-04-21T13:27:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:12 smithi077 ceph-mon[27902]: pgmap v5929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:27:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10943.485371 secs 2024-04-21T13:27:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:14 smithi170 ceph-mon[31212]: pgmap v5930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:27:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10945.245734 secs 2024-04-21T13:27:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:14 smithi077 ceph-mon[27902]: pgmap v5930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:27:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10945.245734 secs 2024-04-21T13:27:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:14 smithi191 ceph-mon[31636]: pgmap v5930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:27:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10945.245734 secs 2024-04-21T13:27:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:16 smithi170 ceph-mon[31212]: pgmap v5931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:27:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:16 smithi077 ceph-mon[27902]: pgmap v5931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:27:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:16 smithi191 ceph-mon[31636]: pgmap v5931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:27:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10948.485480 secs 2024-04-21T13:27:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10948.485480 secs 2024-04-21T13:27:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10948.485480 secs 2024-04-21T13:27:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:18 smithi170 ceph-mon[31212]: pgmap v5932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:27:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:18 smithi077 ceph-mon[27902]: pgmap v5932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:27:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:18 smithi191 ceph-mon[31636]: pgmap v5932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:27:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10950.245848 secs 2024-04-21T13:27:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10950.245848 secs 2024-04-21T13:27:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10950.245848 secs 2024-04-21T13:27:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:20 smithi170 ceph-mon[31212]: pgmap v5933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:27:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:20 smithi077 ceph-mon[27902]: pgmap v5933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:27:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:20 smithi191 ceph-mon[31636]: pgmap v5933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T13:27:22.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:21 smithi170 ceph-mon[31212]: pgmap v5934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:27:22.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:21 smithi077 ceph-mon[27902]: pgmap v5934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:27:22.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:21 smithi191 ceph-mon[31636]: pgmap v5934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:27:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10953.485611 secs 2024-04-21T13:27:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10953.485611 secs 2024-04-21T13:27:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10953.485611 secs 2024-04-21T13:27:24.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:23 smithi170 ceph-mon[31212]: pgmap v5935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:24.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10955.245966 secs 2024-04-21T13:27:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:23 smithi077 ceph-mon[27902]: pgmap v5935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:24.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10955.245966 secs 2024-04-21T13:27:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:23 smithi191 ceph-mon[31636]: pgmap v5935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:24.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10955.245966 secs 2024-04-21T13:27:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:26 smithi191 ceph-mon[31636]: pgmap v5936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:26 smithi170 ceph-mon[31212]: pgmap v5936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:26 smithi077 ceph-mon[27902]: pgmap v5936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10958.485729 secs 2024-04-21T13:27:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10958.485729 secs 2024-04-21T13:27:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10958.485729 secs 2024-04-21T13:27:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:28 smithi191 ceph-mon[31636]: pgmap v5937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:28.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:28 smithi077 ceph-mon[27902]: pgmap v5937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:28 smithi170 ceph-mon[31212]: pgmap v5937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10960.246115 secs 2024-04-21T13:27:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10960.246115 secs 2024-04-21T13:27:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10960.246115 secs 2024-04-21T13:27:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:30 smithi191 ceph-mon[31636]: pgmap v5938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:30 smithi170 ceph-mon[31212]: pgmap v5938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:30 smithi077 ceph-mon[27902]: pgmap v5938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:27:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:27:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:27:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:32 smithi191 ceph-mon[31636]: pgmap v5939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10963.485807 secs 2024-04-21T13:27:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:32 smithi170 ceph-mon[31212]: pgmap v5939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10963.485807 secs 2024-04-21T13:27:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:32 smithi077 ceph-mon[27902]: pgmap v5939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10963.485807 secs 2024-04-21T13:27:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:27:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:27:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:27:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:27:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:27:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:27:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:27:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:34 smithi191 ceph-mon[31636]: pgmap v5940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10965.246230 secs 2024-04-21T13:27:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:34 smithi170 ceph-mon[31212]: pgmap v5940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10965.246230 secs 2024-04-21T13:27:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:34 smithi077 ceph-mon[27902]: pgmap v5940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10965.246230 secs 2024-04-21T13:27:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:36 smithi191 ceph-mon[31636]: pgmap v5941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:36 smithi170 ceph-mon[31212]: pgmap v5941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:36 smithi077 ceph-mon[27902]: pgmap v5941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10968.485924 secs 2024-04-21T13:27:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10968.485924 secs 2024-04-21T13:27:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10968.485924 secs 2024-04-21T13:27:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:38 smithi191 ceph-mon[31636]: pgmap v5942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:38 smithi170 ceph-mon[31212]: pgmap v5942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:38 smithi077 ceph-mon[27902]: pgmap v5942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10970.246351 secs 2024-04-21T13:27:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10970.246351 secs 2024-04-21T13:27:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10970.246351 secs 2024-04-21T13:27:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:40 smithi191 ceph-mon[31636]: pgmap v5943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:40 smithi170 ceph-mon[31212]: pgmap v5943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:40 smithi077 ceph-mon[27902]: pgmap v5943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:42 smithi191 ceph-mon[31636]: pgmap v5944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10973.486040 secs 2024-04-21T13:27:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:42 smithi170 ceph-mon[31212]: pgmap v5944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10973.486040 secs 2024-04-21T13:27:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:42 smithi077 ceph-mon[27902]: pgmap v5944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10973.486040 secs 2024-04-21T13:27:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:44 smithi191 ceph-mon[31636]: pgmap v5945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10975.246475 secs 2024-04-21T13:27:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:44 smithi170 ceph-mon[31212]: pgmap v5945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10975.246475 secs 2024-04-21T13:27:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:44 smithi077 ceph-mon[27902]: pgmap v5945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10975.246475 secs 2024-04-21T13:27:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:46 smithi170 ceph-mon[31212]: pgmap v5946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:46 smithi077 ceph-mon[27902]: pgmap v5946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:46 smithi191 ceph-mon[31636]: pgmap v5946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10978.486133 secs 2024-04-21T13:27:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10978.486133 secs 2024-04-21T13:27:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10978.486133 secs 2024-04-21T13:27:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:48 smithi170 ceph-mon[31212]: pgmap v5947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:48 smithi191 ceph-mon[31636]: pgmap v5947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:48 smithi077 ceph-mon[27902]: pgmap v5947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10980.246587 secs 2024-04-21T13:27:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10980.246587 secs 2024-04-21T13:27:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10980.246587 secs 2024-04-21T13:27:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:50 smithi170 ceph-mon[31212]: pgmap v5948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:50 smithi077 ceph-mon[27902]: pgmap v5948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:50 smithi191 ceph-mon[31636]: pgmap v5948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:52 smithi170 ceph-mon[31212]: pgmap v5949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10983.486260 secs 2024-04-21T13:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:52 smithi077 ceph-mon[27902]: pgmap v5949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10983.486260 secs 2024-04-21T13:27:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:52 smithi191 ceph-mon[31636]: pgmap v5949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10983.486260 secs 2024-04-21T13:27:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:54 smithi170 ceph-mon[31212]: pgmap v5950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10985.246704 secs 2024-04-21T13:27:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:54 smithi077 ceph-mon[27902]: pgmap v5950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10985.246704 secs 2024-04-21T13:27:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:54 smithi191 ceph-mon[31636]: pgmap v5950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10985.246704 secs 2024-04-21T13:27:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:27:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:56 smithi170 ceph-mon[31212]: pgmap v5951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:56 smithi077 ceph-mon[27902]: pgmap v5951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:56 smithi191 ceph-mon[31636]: pgmap v5951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:27:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10988.486333 secs 2024-04-21T13:27:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10988.486333 secs 2024-04-21T13:27:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10988.486333 secs 2024-04-21T13:27:58.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:58 smithi077 ceph-mon[27902]: pgmap v5952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:58 smithi170 ceph-mon[31212]: pgmap v5952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:58 smithi191 ceph-mon[31636]: pgmap v5952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:27:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10990.246830 secs 2024-04-21T13:27:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10990.246830 secs 2024-04-21T13:27:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10990.246830 secs 2024-04-21T13:28:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:00.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:00 smithi170 ceph-mon[31212]: pgmap v5953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:00 smithi077 ceph-mon[27902]: pgmap v5953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:00 smithi191 ceph-mon[31636]: pgmap v5953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:02 smithi170 ceph-mon[31212]: pgmap v5954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10993.486430 secs 2024-04-21T13:28:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:02 smithi077 ceph-mon[27902]: pgmap v5954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10993.486430 secs 2024-04-21T13:28:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:02 smithi191 ceph-mon[31636]: pgmap v5954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10993.486430 secs 2024-04-21T13:28:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:04 smithi170 ceph-mon[31212]: pgmap v5955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 10995.246950 secs 2024-04-21T13:28:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:04 smithi170 ceph-mon[31212]: osdmap e443: 12 total, 12 up, 12 in 2024-04-21T13:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:04 smithi077 ceph-mon[27902]: pgmap v5955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 10995.246950 secs 2024-04-21T13:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:04 smithi077 ceph-mon[27902]: osdmap e443: 12 total, 12 up, 12 in 2024-04-21T13:28:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:04 smithi191 ceph-mon[31636]: pgmap v5955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 10995.246950 secs 2024-04-21T13:28:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:04 smithi191 ceph-mon[31636]: osdmap e443: 12 total, 12 up, 12 in 2024-04-21T13:28:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:06 smithi170 ceph-mon[31212]: pgmap v5957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:28:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:06 smithi077 ceph-mon[27902]: pgmap v5957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:28:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:06 smithi191 ceph-mon[31636]: pgmap v5957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:28:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 10998.486545 secs 2024-04-21T13:28:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 10998.486545 secs 2024-04-21T13:28:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 10998.486545 secs 2024-04-21T13:28:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:08 smithi170 ceph-mon[31212]: pgmap v5958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:28:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:08 smithi077 ceph-mon[27902]: pgmap v5958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:28:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:08 smithi191 ceph-mon[31636]: pgmap v5958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:28:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11000.247021 secs 2024-04-21T13:28:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:09 smithi077 ceph-mon[27902]: osdmap e444: 12 total, 12 up, 12 in 2024-04-21T13:28:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11000.247021 secs 2024-04-21T13:28:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:09 smithi191 ceph-mon[31636]: osdmap e444: 12 total, 12 up, 12 in 2024-04-21T13:28:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11000.247021 secs 2024-04-21T13:28:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:09 smithi170 ceph-mon[31212]: osdmap e444: 12 total, 12 up, 12 in 2024-04-21T13:28:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:10 smithi077 ceph-mon[27902]: pgmap v5960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:28:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:10 smithi191 ceph-mon[31636]: pgmap v5960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:28:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:10 smithi170 ceph-mon[31212]: pgmap v5960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:28:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:12 smithi077 ceph-mon[27902]: pgmap v5961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:28:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11003.486668 secs 2024-04-21T13:28:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:12 smithi191 ceph-mon[31636]: pgmap v5961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:28:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11003.486668 secs 2024-04-21T13:28:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:12 smithi170 ceph-mon[31212]: pgmap v5961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:28:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11003.486668 secs 2024-04-21T13:28:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:14 smithi077 ceph-mon[27902]: pgmap v5962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:28:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11005.247100 secs 2024-04-21T13:28:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:14 smithi191 ceph-mon[31636]: pgmap v5962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:28:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11005.247100 secs 2024-04-21T13:28:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:14 smithi170 ceph-mon[31212]: pgmap v5962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:28:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11005.247100 secs 2024-04-21T13:28:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:16 smithi077 ceph-mon[27902]: pgmap v5963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:28:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:16 smithi191 ceph-mon[31636]: pgmap v5963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:28:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:16 smithi170 ceph-mon[31212]: pgmap v5963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:28:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11008.486804 secs 2024-04-21T13:28:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11008.486804 secs 2024-04-21T13:28:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11008.486804 secs 2024-04-21T13:28:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:18 smithi191 ceph-mon[31636]: pgmap v5964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:28:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:18 smithi077 ceph-mon[27902]: pgmap v5964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:28:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:18 smithi170 ceph-mon[31212]: pgmap v5964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:28:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11010.247189 secs 2024-04-21T13:28:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11010.247189 secs 2024-04-21T13:28:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11010.247189 secs 2024-04-21T13:28:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:20 smithi077 ceph-mon[27902]: pgmap v5965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:28:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:20 smithi191 ceph-mon[31636]: pgmap v5965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:28:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:20 smithi170 ceph-mon[31212]: pgmap v5965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:28:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:22 smithi077 ceph-mon[27902]: pgmap v5966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:28:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11013.486872 secs 2024-04-21T13:28:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:22 smithi191 ceph-mon[31636]: pgmap v5966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:28:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11013.486872 secs 2024-04-21T13:28:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:22 smithi170 ceph-mon[31212]: pgmap v5966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:28:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11013.486872 secs 2024-04-21T13:28:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:24 smithi077 ceph-mon[27902]: pgmap v5967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11015.247269 secs 2024-04-21T13:28:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:24 smithi191 ceph-mon[31636]: pgmap v5967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11015.247269 secs 2024-04-21T13:28:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:24 smithi170 ceph-mon[31212]: pgmap v5967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11015.247269 secs 2024-04-21T13:28:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:26 smithi077 ceph-mon[27902]: pgmap v5968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:26 smithi191 ceph-mon[31636]: pgmap v5968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:26 smithi170 ceph-mon[31212]: pgmap v5968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11018.486985 secs 2024-04-21T13:28:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11018.486985 secs 2024-04-21T13:28:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11018.486985 secs 2024-04-21T13:28:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:28 smithi077 ceph-mon[27902]: pgmap v5969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:28 smithi191 ceph-mon[31636]: pgmap v5969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:28 smithi170 ceph-mon[31212]: pgmap v5969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11020.247389 secs 2024-04-21T13:28:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11020.247389 secs 2024-04-21T13:28:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11020.247389 secs 2024-04-21T13:28:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:30 smithi077 ceph-mon[27902]: pgmap v5970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:30 smithi191 ceph-mon[31636]: pgmap v5970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:30 smithi170 ceph-mon[31212]: pgmap v5970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:32 smithi191 ceph-mon[31636]: pgmap v5971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11023.487116 secs 2024-04-21T13:28:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:28:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:32 smithi170 ceph-mon[31212]: pgmap v5971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11023.487116 secs 2024-04-21T13:28:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:28:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:32 smithi077 ceph-mon[27902]: pgmap v5971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11023.487116 secs 2024-04-21T13:28:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:28:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:28:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:28:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:28:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:28:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:28:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:28:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:28:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:28:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:28:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:34 smithi191 ceph-mon[31636]: pgmap v5972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11025.247491 secs 2024-04-21T13:28:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:34 smithi170 ceph-mon[31212]: pgmap v5972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11025.247491 secs 2024-04-21T13:28:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:34 smithi077 ceph-mon[27902]: pgmap v5972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11025.247491 secs 2024-04-21T13:28:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:36 smithi191 ceph-mon[31636]: pgmap v5973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:36 smithi170 ceph-mon[31212]: pgmap v5973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:36 smithi077 ceph-mon[27902]: pgmap v5973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11028.487251 secs 2024-04-21T13:28:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11028.487251 secs 2024-04-21T13:28:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11028.487251 secs 2024-04-21T13:28:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:38 smithi191 ceph-mon[31636]: pgmap v5974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:38 smithi170 ceph-mon[31212]: pgmap v5974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:38 smithi077 ceph-mon[27902]: pgmap v5974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11030.247572 secs 2024-04-21T13:28:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11030.247572 secs 2024-04-21T13:28:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11030.247572 secs 2024-04-21T13:28:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:40 smithi191 ceph-mon[31636]: pgmap v5975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:40 smithi170 ceph-mon[31212]: pgmap v5975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:40 smithi077 ceph-mon[27902]: pgmap v5975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:42 smithi191 ceph-mon[31636]: pgmap v5976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11033.487329 secs 2024-04-21T13:28:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:42 smithi170 ceph-mon[31212]: pgmap v5976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11033.487329 secs 2024-04-21T13:28:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:42 smithi077 ceph-mon[27902]: pgmap v5976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11033.487329 secs 2024-04-21T13:28:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:44 smithi191 ceph-mon[31636]: pgmap v5977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11035.247713 secs 2024-04-21T13:28:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:44 smithi170 ceph-mon[31212]: pgmap v5977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11035.247713 secs 2024-04-21T13:28:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:44 smithi077 ceph-mon[27902]: pgmap v5977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11035.247713 secs 2024-04-21T13:28:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:46 smithi191 ceph-mon[31636]: pgmap v5978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:46 smithi170 ceph-mon[31212]: pgmap v5978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:46 smithi077 ceph-mon[27902]: pgmap v5978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11038.487438 secs 2024-04-21T13:28:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11038.487438 secs 2024-04-21T13:28:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11038.487438 secs 2024-04-21T13:28:48.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:48 smithi170 ceph-mon[31212]: pgmap v5979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:48 smithi191 ceph-mon[31636]: pgmap v5979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:48 smithi077 ceph-mon[27902]: pgmap v5979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11040.247799 secs 2024-04-21T13:28:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11040.247799 secs 2024-04-21T13:28:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11040.247799 secs 2024-04-21T13:28:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:50 smithi191 ceph-mon[31636]: pgmap v5980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:50 smithi170 ceph-mon[31212]: pgmap v5980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:50 smithi077 ceph-mon[27902]: pgmap v5980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:52 smithi191 ceph-mon[31636]: pgmap v5981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11043.487559 secs 2024-04-21T13:28:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:52 smithi170 ceph-mon[31212]: pgmap v5981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11043.487559 secs 2024-04-21T13:28:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:52 smithi077 ceph-mon[27902]: pgmap v5981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11043.487559 secs 2024-04-21T13:28:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.426+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T13:28:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.426+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T13:28:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.426+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:28:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.426+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T13:28:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.427+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:28:54.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.427+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T13:28:54.428 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.427+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7005a000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7005a000 comp rx=0 tx=0).stop 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640ade40 0x7efd640b0230 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:54.429+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a53b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efd700204f0 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T13:28:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:54 smithi191 ceph-mon[31636]: pgmap v5982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11045.247870 secs 2024-04-21T13:28:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:54 smithi170 ceph-mon[31212]: pgmap v5982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11045.247870 secs 2024-04-21T13:28:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:28:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:54 smithi077 ceph-mon[27902]: pgmap v5982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11045.247870 secs 2024-04-21T13:28:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:55.878+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:28:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:55.878+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:28:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:55.879+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:28:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:28:55.879+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:28:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:56 smithi191 ceph-mon[31636]: pgmap v5983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:56 smithi170 ceph-mon[31212]: pgmap v5983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:56 smithi077 ceph-mon[27902]: pgmap v5983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:28:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11048.487707 secs 2024-04-21T13:28:58.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11048.487707 secs 2024-04-21T13:28:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11048.487707 secs 2024-04-21T13:28:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:58 smithi191 ceph-mon[31636]: pgmap v5984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:58 smithi170 ceph-mon[31212]: pgmap v5984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:58 smithi077 ceph-mon[27902]: pgmap v5984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:28:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11050.247958 secs 2024-04-21T13:29:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11050.247958 secs 2024-04-21T13:29:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11050.247958 secs 2024-04-21T13:29:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:00 smithi191 ceph-mon[31636]: pgmap v5985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:00 smithi170 ceph-mon[31212]: pgmap v5985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:00 smithi077 ceph-mon[27902]: pgmap v5985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:02 smithi170 ceph-mon[31212]: pgmap v5986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11053.487823 secs 2024-04-21T13:29:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:02 smithi077 ceph-mon[27902]: pgmap v5986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11053.487823 secs 2024-04-21T13:29:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:02 smithi191 ceph-mon[31636]: pgmap v5986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11053.487823 secs 2024-04-21T13:29:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:04 smithi170 ceph-mon[31212]: pgmap v5987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11055.248071 secs 2024-04-21T13:29:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:04 smithi170 ceph-mon[31212]: osdmap e445: 12 total, 12 up, 12 in 2024-04-21T13:29:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:04 smithi077 ceph-mon[27902]: pgmap v5987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11055.248071 secs 2024-04-21T13:29:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:04 smithi077 ceph-mon[27902]: osdmap e445: 12 total, 12 up, 12 in 2024-04-21T13:29:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:04 smithi191 ceph-mon[31636]: pgmap v5987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11055.248071 secs 2024-04-21T13:29:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:04 smithi191 ceph-mon[31636]: osdmap e445: 12 total, 12 up, 12 in 2024-04-21T13:29:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:06 smithi170 ceph-mon[31212]: pgmap v5989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:29:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:06 smithi077 ceph-mon[27902]: pgmap v5989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:29:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:06 smithi191 ceph-mon[31636]: pgmap v5989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:29:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11058.487934 secs 2024-04-21T13:29:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11058.487934 secs 2024-04-21T13:29:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11058.487934 secs 2024-04-21T13:29:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:08 smithi170 ceph-mon[31212]: pgmap v5990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:29:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:08 smithi170 ceph-mon[31212]: osdmap e446: 12 total, 12 up, 12 in 2024-04-21T13:29:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:08 smithi077 ceph-mon[27902]: pgmap v5990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:29:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:08 smithi077 ceph-mon[27902]: osdmap e446: 12 total, 12 up, 12 in 2024-04-21T13:29:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:08 smithi191 ceph-mon[31636]: pgmap v5990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:29:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:08 smithi191 ceph-mon[31636]: osdmap e446: 12 total, 12 up, 12 in 2024-04-21T13:29:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11060.248200 secs 2024-04-21T13:29:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11060.248200 secs 2024-04-21T13:29:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11060.248200 secs 2024-04-21T13:29:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:10 smithi170 ceph-mon[31212]: pgmap v5992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:29:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:10 smithi077 ceph-mon[27902]: pgmap v5992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:29:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:10 smithi191 ceph-mon[31636]: pgmap v5992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:29:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:12 smithi170 ceph-mon[31212]: pgmap v5993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:29:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11063.488055 secs 2024-04-21T13:29:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:12 smithi077 ceph-mon[27902]: pgmap v5993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:29:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11063.488055 secs 2024-04-21T13:29:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:12 smithi191 ceph-mon[31636]: pgmap v5993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:29:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11063.488055 secs 2024-04-21T13:29:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:14 smithi170 ceph-mon[31212]: pgmap v5994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:29:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11065.248334 secs 2024-04-21T13:29:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:14 smithi077 ceph-mon[27902]: pgmap v5994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:29:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11065.248334 secs 2024-04-21T13:29:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:14 smithi191 ceph-mon[31636]: pgmap v5994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:29:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11065.248334 secs 2024-04-21T13:29:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:16 smithi170 ceph-mon[31212]: pgmap v5995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:29:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:16 smithi077 ceph-mon[27902]: pgmap v5995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:29:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:16 smithi191 ceph-mon[31636]: pgmap v5995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:29:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11068.488167 secs 2024-04-21T13:29:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11068.488167 secs 2024-04-21T13:29:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11068.488167 secs 2024-04-21T13:29:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:18 smithi170 ceph-mon[31212]: pgmap v5996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:29:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:18 smithi077 ceph-mon[27902]: pgmap v5996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:29:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:18 smithi191 ceph-mon[31636]: pgmap v5996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:29:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11070.248406 secs 2024-04-21T13:29:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:19 smithi170 ceph-mon[31212]: pgmap v5997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:29:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11070.248406 secs 2024-04-21T13:29:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:19 smithi077 ceph-mon[27902]: pgmap v5997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:29:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11070.248406 secs 2024-04-21T13:29:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:19 smithi191 ceph-mon[31636]: pgmap v5997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:29:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:22 smithi191 ceph-mon[31636]: pgmap v5998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:29:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11073.488283 secs 2024-04-21T13:29:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:22 smithi170 ceph-mon[31212]: pgmap v5998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:29:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11073.488283 secs 2024-04-21T13:29:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:22 smithi077 ceph-mon[27902]: pgmap v5998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:29:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11073.488283 secs 2024-04-21T13:29:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:24 smithi191 ceph-mon[31636]: pgmap v5999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11075.248537 secs 2024-04-21T13:29:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:24 smithi170 ceph-mon[31212]: pgmap v5999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11075.248537 secs 2024-04-21T13:29:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:24 smithi077 ceph-mon[27902]: pgmap v5999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11075.248537 secs 2024-04-21T13:29:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:26 smithi191 ceph-mon[31636]: pgmap v6000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:26 smithi170 ceph-mon[31212]: pgmap v6000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:26 smithi077 ceph-mon[27902]: pgmap v6000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11078.488397 secs 2024-04-21T13:29:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11078.488397 secs 2024-04-21T13:29:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11078.488397 secs 2024-04-21T13:29:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:28 smithi191 ceph-mon[31636]: pgmap v6001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:28.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:28 smithi077 ceph-mon[27902]: pgmap v6001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:28 smithi170 ceph-mon[31212]: pgmap v6001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11080.248667 secs 2024-04-21T13:29:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11080.248667 secs 2024-04-21T13:29:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11080.248667 secs 2024-04-21T13:29:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:30 smithi191 ceph-mon[31636]: pgmap v6002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:30 smithi170 ceph-mon[31212]: pgmap v6002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:30 smithi077 ceph-mon[27902]: pgmap v6002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:32 smithi191 ceph-mon[31636]: pgmap v6003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11083.488521 secs 2024-04-21T13:29:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:32 smithi170 ceph-mon[31212]: pgmap v6003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11083.488521 secs 2024-04-21T13:29:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:32 smithi077 ceph-mon[27902]: pgmap v6003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11083.488521 secs 2024-04-21T13:29:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:29:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:29:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:29:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:34 smithi191 ceph-mon[31636]: pgmap v6004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11085.248767 secs 2024-04-21T13:29:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:29:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:29:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:29:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:34 smithi170 ceph-mon[31212]: pgmap v6004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11085.248767 secs 2024-04-21T13:29:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:29:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:29:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:29:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:34 smithi077 ceph-mon[27902]: pgmap v6004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11085.248767 secs 2024-04-21T13:29:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:29:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:29:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:29:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:36.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:36 smithi191 ceph-mon[31636]: pgmap v6005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:36 smithi170 ceph-mon[31212]: pgmap v6005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:36 smithi077 ceph-mon[27902]: pgmap v6005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11088.488656 secs 2024-04-21T13:29:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11088.488656 secs 2024-04-21T13:29:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11088.488656 secs 2024-04-21T13:29:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:38 smithi170 ceph-mon[31212]: pgmap v6006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:38 smithi077 ceph-mon[27902]: pgmap v6006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:38 smithi191 ceph-mon[31636]: pgmap v6006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11090.248897 secs 2024-04-21T13:29:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11090.248897 secs 2024-04-21T13:29:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11090.248897 secs 2024-04-21T13:29:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:40 smithi170 ceph-mon[31212]: pgmap v6007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:40 smithi077 ceph-mon[27902]: pgmap v6007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:40 smithi191 ceph-mon[31636]: pgmap v6007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:42 smithi170 ceph-mon[31212]: pgmap v6008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11093.488721 secs 2024-04-21T13:29:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:42 smithi077 ceph-mon[27902]: pgmap v6008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11093.488721 secs 2024-04-21T13:29:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:42 smithi191 ceph-mon[31636]: pgmap v6008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11093.488721 secs 2024-04-21T13:29:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11095.249005 secs 2024-04-21T13:29:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:44 smithi170 ceph-mon[31212]: pgmap v6009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11095.249005 secs 2024-04-21T13:29:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:44 smithi077 ceph-mon[27902]: pgmap v6009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11095.249005 secs 2024-04-21T13:29:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:44 smithi191 ceph-mon[31636]: pgmap v6009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:29:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:46 smithi170 ceph-mon[31212]: pgmap v6010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:46 smithi077 ceph-mon[27902]: pgmap v6010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:46 smithi191 ceph-mon[31636]: pgmap v6010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11098.488838 secs 2024-04-21T13:29:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11098.488838 secs 2024-04-21T13:29:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11098.488838 secs 2024-04-21T13:29:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:48 smithi170 ceph-mon[31212]: pgmap v6011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:48 smithi191 ceph-mon[31636]: pgmap v6011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:48 smithi077 ceph-mon[27902]: pgmap v6011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11100.249124 secs 2024-04-21T13:29:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11100.249124 secs 2024-04-21T13:29:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11100.249124 secs 2024-04-21T13:29:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:50 smithi170 ceph-mon[31212]: pgmap v6012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:50 smithi077 ceph-mon[27902]: pgmap v6012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:50 smithi191 ceph-mon[31636]: pgmap v6012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:52 smithi170 ceph-mon[31212]: pgmap v6013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11103.488990 secs 2024-04-21T13:29:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:52 smithi077 ceph-mon[27902]: pgmap v6013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11103.488990 secs 2024-04-21T13:29:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:52 smithi191 ceph-mon[31636]: pgmap v6013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11103.488990 secs 2024-04-21T13:29:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11105.249242 secs 2024-04-21T13:29:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:54 smithi170 ceph-mon[31212]: pgmap v6014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11105.249242 secs 2024-04-21T13:29:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:54 smithi077 ceph-mon[27902]: pgmap v6014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11105.249242 secs 2024-04-21T13:29:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:54 smithi191 ceph-mon[31636]: pgmap v6014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:29:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:56 smithi170 ceph-mon[31212]: pgmap v6015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:56 smithi077 ceph-mon[27902]: pgmap v6015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:56 smithi191 ceph-mon[31636]: pgmap v6015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:29:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11108.489109 secs 2024-04-21T13:29:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11108.489109 secs 2024-04-21T13:29:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11108.489109 secs 2024-04-21T13:29:58.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:58 smithi077 ceph-mon[27902]: pgmap v6016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:58 smithi170 ceph-mon[31212]: pgmap v6016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:58 smithi191 ceph-mon[31636]: pgmap v6016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:29:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11110.249353 secs 2024-04-21T13:29:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11110.249353 secs 2024-04-21T13:29:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11110.249353 secs 2024-04-21T13:30:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:00 smithi170 ceph-mon[31212]: pgmap v6017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:30:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:00 smithi077 ceph-mon[27902]: pgmap v6017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:30:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:00 smithi191 ceph-mon[31636]: pgmap v6017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:30:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:02 smithi170 ceph-mon[31212]: pgmap v6018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11113.489238 secs 2024-04-21T13:30:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:02 smithi077 ceph-mon[27902]: pgmap v6018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11113.489238 secs 2024-04-21T13:30:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:02 smithi191 ceph-mon[31636]: pgmap v6018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11113.489238 secs 2024-04-21T13:30:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11115.249487 secs 2024-04-21T13:30:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:04 smithi170 ceph-mon[31212]: pgmap v6019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:04 smithi170 ceph-mon[31212]: osdmap e447: 12 total, 12 up, 12 in 2024-04-21T13:30:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11115.249487 secs 2024-04-21T13:30:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:04 smithi077 ceph-mon[27902]: pgmap v6019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:04 smithi077 ceph-mon[27902]: osdmap e447: 12 total, 12 up, 12 in 2024-04-21T13:30:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11115.249487 secs 2024-04-21T13:30:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:04 smithi191 ceph-mon[31636]: pgmap v6019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:04 smithi191 ceph-mon[31636]: osdmap e447: 12 total, 12 up, 12 in 2024-04-21T13:30:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:06 smithi170 ceph-mon[31212]: pgmap v6021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:30:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:06 smithi077 ceph-mon[27902]: pgmap v6021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:30:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:06 smithi191 ceph-mon[31636]: pgmap v6021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:30:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11118.489333 secs 2024-04-21T13:30:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11118.489333 secs 2024-04-21T13:30:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11118.489333 secs 2024-04-21T13:30:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:08 smithi170 ceph-mon[31212]: pgmap v6022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:30:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:08 smithi077 ceph-mon[27902]: pgmap v6022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:30:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:08 smithi191 ceph-mon[31636]: pgmap v6022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:30:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11120.249600 secs 2024-04-21T13:30:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:09 smithi077 ceph-mon[27902]: osdmap e448: 12 total, 12 up, 12 in 2024-04-21T13:30:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11120.249600 secs 2024-04-21T13:30:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:09 smithi191 ceph-mon[31636]: osdmap e448: 12 total, 12 up, 12 in 2024-04-21T13:30:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11120.249600 secs 2024-04-21T13:30:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:09 smithi170 ceph-mon[31212]: osdmap e448: 12 total, 12 up, 12 in 2024-04-21T13:30:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:10 smithi077 ceph-mon[27902]: pgmap v6024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:30:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:10 smithi191 ceph-mon[31636]: pgmap v6024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:30:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:10 smithi170 ceph-mon[31212]: pgmap v6024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:30:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:12 smithi077 ceph-mon[27902]: pgmap v6025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:30:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11123.489459 secs 2024-04-21T13:30:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:12 smithi191 ceph-mon[31636]: pgmap v6025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:30:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11123.489459 secs 2024-04-21T13:30:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:12 smithi170 ceph-mon[31212]: pgmap v6025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:30:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11123.489459 secs 2024-04-21T13:30:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11125.249736 secs 2024-04-21T13:30:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:14 smithi077 ceph-mon[27902]: pgmap v6026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:30:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11125.249736 secs 2024-04-21T13:30:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:14 smithi191 ceph-mon[31636]: pgmap v6026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:30:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11125.249736 secs 2024-04-21T13:30:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:14 smithi170 ceph-mon[31212]: pgmap v6026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:30:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:16 smithi077 ceph-mon[27902]: pgmap v6027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:30:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:16 smithi191 ceph-mon[31636]: pgmap v6027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:30:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:16 smithi170 ceph-mon[31212]: pgmap v6027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:30:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11128.489579 secs 2024-04-21T13:30:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11128.489579 secs 2024-04-21T13:30:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11128.489579 secs 2024-04-21T13:30:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:18 smithi077 ceph-mon[27902]: pgmap v6028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:30:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:18 smithi170 ceph-mon[31212]: pgmap v6028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:30:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:18 smithi191 ceph-mon[31636]: pgmap v6028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:30:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11130.249844 secs 2024-04-21T13:30:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11130.249844 secs 2024-04-21T13:30:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11130.249844 secs 2024-04-21T13:30:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:20 smithi191 ceph-mon[31636]: pgmap v6029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:30:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:20 smithi170 ceph-mon[31212]: pgmap v6029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:30:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:20 smithi077 ceph-mon[27902]: pgmap v6029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:30:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:22 smithi191 ceph-mon[31636]: pgmap v6030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:30:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11133.489698 secs 2024-04-21T13:30:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:22 smithi170 ceph-mon[31212]: pgmap v6030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:30:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11133.489698 secs 2024-04-21T13:30:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:22 smithi077 ceph-mon[27902]: pgmap v6030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:30:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11133.489698 secs 2024-04-21T13:30:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11135.249959 secs 2024-04-21T13:30:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:24 smithi191 ceph-mon[31636]: pgmap v6031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11135.249959 secs 2024-04-21T13:30:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:24 smithi170 ceph-mon[31212]: pgmap v6031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11135.249959 secs 2024-04-21T13:30:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:24 smithi077 ceph-mon[27902]: pgmap v6031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:30:25.890+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:30:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:30:25.890+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:30:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:30:25.890+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:30:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:30:25.890+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:30:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:26 smithi191 ceph-mon[31636]: pgmap v6032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:26 smithi170 ceph-mon[31212]: pgmap v6032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:26 smithi077 ceph-mon[27902]: pgmap v6032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11138.489820 secs 2024-04-21T13:30:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11138.489820 secs 2024-04-21T13:30:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11138.489820 secs 2024-04-21T13:30:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:28 smithi191 ceph-mon[31636]: pgmap v6033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:29.059 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:28 smithi077 ceph-mon[27902]: pgmap v6033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:28 smithi170 ceph-mon[31212]: pgmap v6033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11140.250076 secs 2024-04-21T13:30:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11140.250076 secs 2024-04-21T13:30:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11140.250076 secs 2024-04-21T13:30:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:30 smithi191 ceph-mon[31636]: pgmap v6034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:30 smithi170 ceph-mon[31212]: pgmap v6034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:30 smithi077 ceph-mon[27902]: pgmap v6034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:32 smithi191 ceph-mon[31636]: pgmap v6035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11143.489938 secs 2024-04-21T13:30:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:32 smithi170 ceph-mon[31212]: pgmap v6035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11143.489938 secs 2024-04-21T13:30:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:32 smithi077 ceph-mon[27902]: pgmap v6035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11143.489938 secs 2024-04-21T13:30:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11145.250186 secs 2024-04-21T13:30:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:34 smithi191 ceph-mon[31636]: pgmap v6036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:30:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11145.250186 secs 2024-04-21T13:30:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:34 smithi170 ceph-mon[31212]: pgmap v6036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:30:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11145.250186 secs 2024-04-21T13:30:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:34 smithi077 ceph-mon[27902]: pgmap v6036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:30:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:30:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:30:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:30:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:30:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:30:36.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:30:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:30:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:30:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:30:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:36 smithi170 ceph-mon[31212]: pgmap v6037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:36 smithi077 ceph-mon[27902]: pgmap v6037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:36 smithi191 ceph-mon[31636]: pgmap v6037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11148.490056 secs 2024-04-21T13:30:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11148.490056 secs 2024-04-21T13:30:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11148.490056 secs 2024-04-21T13:30:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:38 smithi170 ceph-mon[31212]: pgmap v6038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:38 smithi077 ceph-mon[27902]: pgmap v6038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:38 smithi191 ceph-mon[31636]: pgmap v6038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11150.250263 secs 2024-04-21T13:30:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:39 smithi170 ceph-mon[31212]: pgmap v6039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11150.250263 secs 2024-04-21T13:30:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:39 smithi077 ceph-mon[27902]: pgmap v6039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11150.250263 secs 2024-04-21T13:30:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:39 smithi191 ceph-mon[31636]: pgmap v6039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:42 smithi191 ceph-mon[31636]: pgmap v6040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11153.490135 secs 2024-04-21T13:30:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:42 smithi170 ceph-mon[31212]: pgmap v6040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11153.490135 secs 2024-04-21T13:30:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:42 smithi077 ceph-mon[27902]: pgmap v6040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11153.490135 secs 2024-04-21T13:30:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11155.250385 secs 2024-04-21T13:30:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:44 smithi191 ceph-mon[31636]: pgmap v6041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11155.250385 secs 2024-04-21T13:30:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:44 smithi170 ceph-mon[31212]: pgmap v6041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11155.250385 secs 2024-04-21T13:30:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:44 smithi077 ceph-mon[27902]: pgmap v6041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:46 smithi191 ceph-mon[31636]: pgmap v6042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:46 smithi170 ceph-mon[31212]: pgmap v6042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:46 smithi077 ceph-mon[27902]: pgmap v6042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11158.490251 secs 2024-04-21T13:30:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11158.490251 secs 2024-04-21T13:30:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11158.490251 secs 2024-04-21T13:30:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:48 smithi191 ceph-mon[31636]: pgmap v6043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:48 smithi170 ceph-mon[31212]: pgmap v6043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:48 smithi077 ceph-mon[27902]: pgmap v6043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:49.728 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11160.250493 secs 2024-04-21T13:30:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11160.250493 secs 2024-04-21T13:30:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11160.250493 secs 2024-04-21T13:30:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:50 smithi170 ceph-mon[31212]: pgmap v6044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:50 smithi077 ceph-mon[27902]: pgmap v6044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:50 smithi191 ceph-mon[31636]: pgmap v6044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:52 smithi170 ceph-mon[31212]: pgmap v6045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11163.490395 secs 2024-04-21T13:30:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:52 smithi077 ceph-mon[27902]: pgmap v6045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11163.490395 secs 2024-04-21T13:30:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:52 smithi191 ceph-mon[31636]: pgmap v6045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11163.490395 secs 2024-04-21T13:30:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11165.250643 secs 2024-04-21T13:30:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:54 smithi170 ceph-mon[31212]: pgmap v6046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11165.250643 secs 2024-04-21T13:30:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:54 smithi077 ceph-mon[27902]: pgmap v6046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11165.250643 secs 2024-04-21T13:30:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:54 smithi191 ceph-mon[31636]: pgmap v6046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:30:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:56 smithi170 ceph-mon[31212]: pgmap v6047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:56 smithi077 ceph-mon[27902]: pgmap v6047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:56 smithi191 ceph-mon[31636]: pgmap v6047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:30:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11168.490514 secs 2024-04-21T13:30:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11168.490514 secs 2024-04-21T13:30:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11168.490514 secs 2024-04-21T13:30:58.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:58 smithi077 ceph-mon[27902]: pgmap v6048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:58 smithi170 ceph-mon[31212]: pgmap v6048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:58 smithi191 ceph-mon[31636]: pgmap v6048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:30:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11170.250780 secs 2024-04-21T13:30:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11170.250780 secs 2024-04-21T13:31:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11170.250780 secs 2024-04-21T13:31:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:00 smithi170 ceph-mon[31212]: pgmap v6049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:00 smithi077 ceph-mon[27902]: pgmap v6049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:00 smithi191 ceph-mon[31636]: pgmap v6049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:02 smithi077 ceph-mon[27902]: pgmap v6050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11173.490635 secs 2024-04-21T13:31:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:02 smithi191 ceph-mon[31636]: pgmap v6050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11173.490635 secs 2024-04-21T13:31:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:02 smithi170 ceph-mon[31212]: pgmap v6050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11173.490635 secs 2024-04-21T13:31:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11175.250932 secs 2024-04-21T13:31:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:04 smithi077 ceph-mon[27902]: pgmap v6051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:04 smithi077 ceph-mon[27902]: osdmap e449: 12 total, 12 up, 12 in 2024-04-21T13:31:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11175.250932 secs 2024-04-21T13:31:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:04 smithi191 ceph-mon[31636]: pgmap v6051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:04 smithi191 ceph-mon[31636]: osdmap e449: 12 total, 12 up, 12 in 2024-04-21T13:31:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11175.250932 secs 2024-04-21T13:31:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:04 smithi170 ceph-mon[31212]: pgmap v6051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:04 smithi170 ceph-mon[31212]: osdmap e449: 12 total, 12 up, 12 in 2024-04-21T13:31:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:06 smithi077 ceph-mon[27902]: pgmap v6053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:31:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:06 smithi191 ceph-mon[31636]: pgmap v6053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:31:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:06 smithi170 ceph-mon[31212]: pgmap v6053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:31:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11178.490755 secs 2024-04-21T13:31:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11178.490755 secs 2024-04-21T13:31:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11178.490755 secs 2024-04-21T13:31:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:08 smithi191 ceph-mon[31636]: pgmap v6054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:31:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:08 smithi191 ceph-mon[31636]: osdmap e450: 12 total, 12 up, 12 in 2024-04-21T13:31:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:08 smithi170 ceph-mon[31212]: pgmap v6054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:31:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:08 smithi170 ceph-mon[31212]: osdmap e450: 12 total, 12 up, 12 in 2024-04-21T13:31:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:08 smithi077 ceph-mon[27902]: pgmap v6054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:31:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:08 smithi077 ceph-mon[27902]: osdmap e450: 12 total, 12 up, 12 in 2024-04-21T13:31:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11180.251024 secs 2024-04-21T13:31:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11180.251024 secs 2024-04-21T13:31:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11180.251024 secs 2024-04-21T13:31:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:10 smithi191 ceph-mon[31636]: pgmap v6056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:31:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:10 smithi170 ceph-mon[31212]: pgmap v6056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:31:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:10 smithi077 ceph-mon[27902]: pgmap v6056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:31:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:12 smithi191 ceph-mon[31636]: pgmap v6057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:31:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11183.490874 secs 2024-04-21T13:31:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:12 smithi170 ceph-mon[31212]: pgmap v6057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:31:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11183.490874 secs 2024-04-21T13:31:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:12 smithi077 ceph-mon[27902]: pgmap v6057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:31:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11183.490874 secs 2024-04-21T13:31:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11185.251090 secs 2024-04-21T13:31:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:14 smithi191 ceph-mon[31636]: pgmap v6058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:31:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11185.251090 secs 2024-04-21T13:31:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:14 smithi170 ceph-mon[31212]: pgmap v6058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:31:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11185.251090 secs 2024-04-21T13:31:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:14 smithi077 ceph-mon[27902]: pgmap v6058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:31:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:16 smithi191 ceph-mon[31636]: pgmap v6059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:31:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:16 smithi170 ceph-mon[31212]: pgmap v6059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:31:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:16 smithi077 ceph-mon[27902]: pgmap v6059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:31:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11188.490984 secs 2024-04-21T13:31:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11188.490984 secs 2024-04-21T13:31:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11188.490984 secs 2024-04-21T13:31:18.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:18 smithi170 ceph-mon[31212]: pgmap v6060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:31:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:18 smithi191 ceph-mon[31636]: pgmap v6060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:31:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:18 smithi077 ceph-mon[27902]: pgmap v6060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:31:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11190.251207 secs 2024-04-21T13:31:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11190.251207 secs 2024-04-21T13:31:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11190.251207 secs 2024-04-21T13:31:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:20 smithi191 ceph-mon[31636]: pgmap v6061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:31:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:20 smithi170 ceph-mon[31212]: pgmap v6061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:31:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:20 smithi077 ceph-mon[27902]: pgmap v6061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:31:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:22 smithi191 ceph-mon[31636]: pgmap v6062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:31:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11193.491101 secs 2024-04-21T13:31:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:22 smithi170 ceph-mon[31212]: pgmap v6062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:31:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11193.491101 secs 2024-04-21T13:31:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:22 smithi077 ceph-mon[27902]: pgmap v6062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:31:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11193.491101 secs 2024-04-21T13:31:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11195.251341 secs 2024-04-21T13:31:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:24 smithi191 ceph-mon[31636]: pgmap v6063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11195.251341 secs 2024-04-21T13:31:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:24 smithi170 ceph-mon[31212]: pgmap v6063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11195.251341 secs 2024-04-21T13:31:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:24 smithi077 ceph-mon[27902]: pgmap v6063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:26 smithi191 ceph-mon[31636]: pgmap v6064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:26 smithi170 ceph-mon[31212]: pgmap v6064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:26 smithi077 ceph-mon[27902]: pgmap v6064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11198.491241 secs 2024-04-21T13:31:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11198.491241 secs 2024-04-21T13:31:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11198.491241 secs 2024-04-21T13:31:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:28 smithi191 ceph-mon[31636]: pgmap v6065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:28 smithi170 ceph-mon[31212]: pgmap v6065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:28 smithi077 ceph-mon[27902]: pgmap v6065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11200.251397 secs 2024-04-21T13:31:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11200.251397 secs 2024-04-21T13:31:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11200.251397 secs 2024-04-21T13:31:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:30 smithi191 ceph-mon[31636]: pgmap v6066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:30 smithi170 ceph-mon[31212]: pgmap v6066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:30 smithi077 ceph-mon[27902]: pgmap v6066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:32 smithi191 ceph-mon[31636]: pgmap v6067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11203.491361 secs 2024-04-21T13:31:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:32 smithi170 ceph-mon[31212]: pgmap v6067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11203.491361 secs 2024-04-21T13:31:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:32 smithi077 ceph-mon[27902]: pgmap v6067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11203.491361 secs 2024-04-21T13:31:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11205.251514 secs 2024-04-21T13:31:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:34 smithi191 ceph-mon[31636]: pgmap v6068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11205.251514 secs 2024-04-21T13:31:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:34 smithi170 ceph-mon[31212]: pgmap v6068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11205.251514 secs 2024-04-21T13:31:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:34 smithi077 ceph-mon[27902]: pgmap v6068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:31:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:31:35.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:31:35.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:31:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:31:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:31:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:31:36.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:31:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:31:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:31:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:31:36.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:31:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:36 smithi191 ceph-mon[31636]: pgmap v6069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:36 smithi170 ceph-mon[31212]: pgmap v6069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:36 smithi077 ceph-mon[27902]: pgmap v6069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11208.491481 secs 2024-04-21T13:31:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11208.491481 secs 2024-04-21T13:31:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11208.491481 secs 2024-04-21T13:31:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:38 smithi191 ceph-mon[31636]: pgmap v6070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:38 smithi170 ceph-mon[31212]: pgmap v6070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:38 smithi077 ceph-mon[27902]: pgmap v6070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11210.251586 secs 2024-04-21T13:31:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11210.251586 secs 2024-04-21T13:31:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11210.251586 secs 2024-04-21T13:31:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:40 smithi170 ceph-mon[31212]: pgmap v6071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:40 smithi077 ceph-mon[27902]: pgmap v6071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:40 smithi191 ceph-mon[31636]: pgmap v6071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:42 smithi170 ceph-mon[31212]: pgmap v6072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11213.491600 secs 2024-04-21T13:31:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:42 smithi077 ceph-mon[27902]: pgmap v6072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11213.491600 secs 2024-04-21T13:31:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:42 smithi191 ceph-mon[31636]: pgmap v6072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11213.491600 secs 2024-04-21T13:31:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11215.251705 secs 2024-04-21T13:31:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:44 smithi170 ceph-mon[31212]: pgmap v6073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11215.251705 secs 2024-04-21T13:31:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:44 smithi077 ceph-mon[27902]: pgmap v6073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11215.251705 secs 2024-04-21T13:31:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:44 smithi191 ceph-mon[31636]: pgmap v6073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:46 smithi170 ceph-mon[31212]: pgmap v6074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:46 smithi077 ceph-mon[27902]: pgmap v6074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:46 smithi191 ceph-mon[31636]: pgmap v6074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11218.491675 secs 2024-04-21T13:31:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11218.491675 secs 2024-04-21T13:31:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11218.491675 secs 2024-04-21T13:31:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:48 smithi170 ceph-mon[31212]: pgmap v6075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:48 smithi077 ceph-mon[27902]: pgmap v6075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:48 smithi191 ceph-mon[31636]: pgmap v6075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11220.251800 secs 2024-04-21T13:31:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11220.251800 secs 2024-04-21T13:31:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11220.251800 secs 2024-04-21T13:31:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:50 smithi170 ceph-mon[31212]: pgmap v6076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:50 smithi077 ceph-mon[27902]: pgmap v6076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:50 smithi191 ceph-mon[31636]: pgmap v6076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:52 smithi170 ceph-mon[31212]: pgmap v6077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11223.491834 secs 2024-04-21T13:31:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:52 smithi077 ceph-mon[27902]: pgmap v6077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11223.491834 secs 2024-04-21T13:31:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:52 smithi191 ceph-mon[31636]: pgmap v6077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11223.491834 secs 2024-04-21T13:31:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11225.251919 secs 2024-04-21T13:31:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:54 smithi170 ceph-mon[31212]: pgmap v6078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:31:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11225.251919 secs 2024-04-21T13:31:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:54 smithi077 ceph-mon[27902]: pgmap v6078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11225.251919 secs 2024-04-21T13:31:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:54 smithi191 ceph-mon[31636]: pgmap v6078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:31:55.903+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:31:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:31:55.903+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:31:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:31:55.903+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:31:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:31:55.903+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:31:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:56 smithi170 ceph-mon[31212]: pgmap v6079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:56 smithi077 ceph-mon[27902]: pgmap v6079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:56 smithi191 ceph-mon[31636]: pgmap v6079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:31:58.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11228.491959 secs 2024-04-21T13:31:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11228.491959 secs 2024-04-21T13:31:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11228.491959 secs 2024-04-21T13:31:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:58 smithi170 ceph-mon[31212]: pgmap v6080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:58 smithi077 ceph-mon[27902]: pgmap v6080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:31:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:58 smithi191 ceph-mon[31636]: pgmap v6080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11230.252035 secs 2024-04-21T13:32:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11230.252035 secs 2024-04-21T13:32:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11230.252035 secs 2024-04-21T13:32:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:00 smithi170 ceph-mon[31212]: pgmap v6081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:00 smithi077 ceph-mon[27902]: pgmap v6081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:00 smithi191 ceph-mon[31636]: pgmap v6081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:02 smithi170 ceph-mon[31212]: pgmap v6082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:32:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11233.492077 secs 2024-04-21T13:32:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:02 smithi077 ceph-mon[27902]: pgmap v6082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:32:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11233.492077 secs 2024-04-21T13:32:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:02 smithi191 ceph-mon[31636]: pgmap v6082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:32:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11233.492077 secs 2024-04-21T13:32:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11235.252153 secs 2024-04-21T13:32:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:04 smithi170 ceph-mon[31212]: pgmap v6083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:32:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:04 smithi170 ceph-mon[31212]: osdmap e451: 12 total, 12 up, 12 in 2024-04-21T13:32:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11235.252153 secs 2024-04-21T13:32:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:04 smithi077 ceph-mon[27902]: pgmap v6083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:32:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:04 smithi077 ceph-mon[27902]: osdmap e451: 12 total, 12 up, 12 in 2024-04-21T13:32:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11235.252153 secs 2024-04-21T13:32:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:04 smithi191 ceph-mon[31636]: pgmap v6083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:32:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:04 smithi191 ceph-mon[31636]: osdmap e451: 12 total, 12 up, 12 in 2024-04-21T13:32:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:06 smithi170 ceph-mon[31212]: pgmap v6085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:32:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:06 smithi077 ceph-mon[27902]: pgmap v6085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:32:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:06 smithi191 ceph-mon[31636]: pgmap v6085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:32:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11238.492219 secs 2024-04-21T13:32:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11238.492219 secs 2024-04-21T13:32:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11238.492219 secs 2024-04-21T13:32:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:08 smithi170 ceph-mon[31212]: pgmap v6086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:32:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:08 smithi170 ceph-mon[31212]: osdmap e452: 12 total, 12 up, 12 in 2024-04-21T13:32:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:08 smithi077 ceph-mon[27902]: pgmap v6086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:32:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:08 smithi077 ceph-mon[27902]: osdmap e452: 12 total, 12 up, 12 in 2024-04-21T13:32:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:08 smithi191 ceph-mon[31636]: pgmap v6086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:32:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:08 smithi191 ceph-mon[31636]: osdmap e452: 12 total, 12 up, 12 in 2024-04-21T13:32:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11240.252267 secs 2024-04-21T13:32:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:09 smithi170 ceph-mon[31212]: pgmap v6088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:32:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11240.252267 secs 2024-04-21T13:32:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:09 smithi077 ceph-mon[27902]: pgmap v6088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:32:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11240.252267 secs 2024-04-21T13:32:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:09 smithi191 ceph-mon[31636]: pgmap v6088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:32:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:12 smithi170 ceph-mon[31212]: pgmap v6089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:32:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11243.492323 secs 2024-04-21T13:32:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:12 smithi077 ceph-mon[27902]: pgmap v6089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:32:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11243.492323 secs 2024-04-21T13:32:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:12 smithi191 ceph-mon[31636]: pgmap v6089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:32:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11243.492323 secs 2024-04-21T13:32:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11245.252381 secs 2024-04-21T13:32:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:14 smithi170 ceph-mon[31212]: pgmap v6090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 318 B/s wr, 6 op/s 2024-04-21T13:32:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11245.252381 secs 2024-04-21T13:32:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:14 smithi077 ceph-mon[27902]: pgmap v6090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 318 B/s wr, 6 op/s 2024-04-21T13:32:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11245.252381 secs 2024-04-21T13:32:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:14 smithi191 ceph-mon[31636]: pgmap v6090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 318 B/s wr, 6 op/s 2024-04-21T13:32:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:16 smithi170 ceph-mon[31212]: pgmap v6091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:32:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:16 smithi077 ceph-mon[27902]: pgmap v6091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:32:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:16 smithi191 ceph-mon[31636]: pgmap v6091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:32:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11248.492443 secs 2024-04-21T13:32:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11248.492443 secs 2024-04-21T13:32:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11248.492443 secs 2024-04-21T13:32:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:18 smithi170 ceph-mon[31212]: pgmap v6092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:32:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:18 smithi191 ceph-mon[31636]: pgmap v6092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:32:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:18 smithi077 ceph-mon[27902]: pgmap v6092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:32:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11250.252493 secs 2024-04-21T13:32:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11250.252493 secs 2024-04-21T13:32:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11250.252493 secs 2024-04-21T13:32:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:20 smithi170 ceph-mon[31212]: pgmap v6093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:32:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:20 smithi077 ceph-mon[27902]: pgmap v6093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:32:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:20 smithi191 ceph-mon[31636]: pgmap v6093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:32:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:22 smithi170 ceph-mon[31212]: pgmap v6094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:32:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11253.492562 secs 2024-04-21T13:32:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:22 smithi077 ceph-mon[27902]: pgmap v6094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:32:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11253.492562 secs 2024-04-21T13:32:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:22 smithi191 ceph-mon[31636]: pgmap v6094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:32:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11253.492562 secs 2024-04-21T13:32:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11255.252608 secs 2024-04-21T13:32:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:24 smithi170 ceph-mon[31212]: pgmap v6095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:32:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11255.252608 secs 2024-04-21T13:32:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:24 smithi077 ceph-mon[27902]: pgmap v6095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:32:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11255.252608 secs 2024-04-21T13:32:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:24 smithi191 ceph-mon[31636]: pgmap v6095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:32:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:26 smithi170 ceph-mon[31212]: pgmap v6096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:26 smithi077 ceph-mon[27902]: pgmap v6096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:26 smithi191 ceph-mon[31636]: pgmap v6096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11258.492675 secs 2024-04-21T13:32:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11258.492675 secs 2024-04-21T13:32:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11258.492675 secs 2024-04-21T13:32:28.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:28 smithi077 ceph-mon[27902]: pgmap v6097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:28 smithi170 ceph-mon[31212]: pgmap v6097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:28 smithi191 ceph-mon[31636]: pgmap v6097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11260.252742 secs 2024-04-21T13:32:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11260.252742 secs 2024-04-21T13:32:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11260.252742 secs 2024-04-21T13:32:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:30 smithi170 ceph-mon[31212]: pgmap v6098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:30 smithi077 ceph-mon[27902]: pgmap v6098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:30 smithi191 ceph-mon[31636]: pgmap v6098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:32 smithi170 ceph-mon[31212]: pgmap v6099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11263.492832 secs 2024-04-21T13:32:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:32 smithi077 ceph-mon[27902]: pgmap v6099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11263.492832 secs 2024-04-21T13:32:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:32 smithi191 ceph-mon[31636]: pgmap v6099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11263.492832 secs 2024-04-21T13:32:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11265.252900 secs 2024-04-21T13:32:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:34 smithi170 ceph-mon[31212]: pgmap v6100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11265.252900 secs 2024-04-21T13:32:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:34 smithi077 ceph-mon[27902]: pgmap v6100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11265.252900 secs 2024-04-21T13:32:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:34 smithi191 ceph-mon[31636]: pgmap v6100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:36 smithi170 ceph-mon[31212]: pgmap v6101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:32:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:32:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:32:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:32:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:36 smithi077 ceph-mon[27902]: pgmap v6101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:32:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:32:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:32:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:32:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:36 smithi191 ceph-mon[31636]: pgmap v6101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:32:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:32:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:32:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:32:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11268.492948 secs 2024-04-21T13:32:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11268.492948 secs 2024-04-21T13:32:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11268.492948 secs 2024-04-21T13:32:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:38 smithi170 ceph-mon[31212]: pgmap v6102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:38 smithi077 ceph-mon[27902]: pgmap v6102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:38 smithi191 ceph-mon[31636]: pgmap v6102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11270.253007 secs 2024-04-21T13:32:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11270.253007 secs 2024-04-21T13:32:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11270.253007 secs 2024-04-21T13:32:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:40 smithi170 ceph-mon[31212]: pgmap v6103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:40 smithi077 ceph-mon[27902]: pgmap v6103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:40 smithi191 ceph-mon[31636]: pgmap v6103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:42 smithi170 ceph-mon[31212]: pgmap v6104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11273.493077 secs 2024-04-21T13:32:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:42 smithi077 ceph-mon[27902]: pgmap v6104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11273.493077 secs 2024-04-21T13:32:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:42 smithi191 ceph-mon[31636]: pgmap v6104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11273.493077 secs 2024-04-21T13:32:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11275.253122 secs 2024-04-21T13:32:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:44 smithi077 ceph-mon[27902]: pgmap v6105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11275.253122 secs 2024-04-21T13:32:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:44 smithi191 ceph-mon[31636]: pgmap v6105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11275.253122 secs 2024-04-21T13:32:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:44 smithi170 ceph-mon[31212]: pgmap v6105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:46 smithi077 ceph-mon[27902]: pgmap v6106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:46.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:46 smithi191 ceph-mon[31636]: pgmap v6106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:46 smithi170 ceph-mon[31212]: pgmap v6106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11278.493193 secs 2024-04-21T13:32:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11278.493193 secs 2024-04-21T13:32:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11278.493193 secs 2024-04-21T13:32:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:48 smithi191 ceph-mon[31636]: pgmap v6107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:48 smithi077 ceph-mon[27902]: pgmap v6107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:48 smithi170 ceph-mon[31212]: pgmap v6107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11280.253230 secs 2024-04-21T13:32:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11280.253230 secs 2024-04-21T13:32:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11280.253230 secs 2024-04-21T13:32:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:50 smithi077 ceph-mon[27902]: pgmap v6108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:50 smithi191 ceph-mon[31636]: pgmap v6108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:50 smithi170 ceph-mon[31212]: pgmap v6108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:52 smithi077 ceph-mon[27902]: pgmap v6109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11283.493327 secs 2024-04-21T13:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:52 smithi191 ceph-mon[31636]: pgmap v6109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11283.493327 secs 2024-04-21T13:32:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:52 smithi170 ceph-mon[31212]: pgmap v6109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11283.493327 secs 2024-04-21T13:32:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11285.253341 secs 2024-04-21T13:32:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:54 smithi077 ceph-mon[27902]: pgmap v6110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11285.253341 secs 2024-04-21T13:32:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:54 smithi191 ceph-mon[31636]: pgmap v6110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11285.253341 secs 2024-04-21T13:32:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:54 smithi170 ceph-mon[31212]: pgmap v6110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:32:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:56 smithi077 ceph-mon[27902]: pgmap v6111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:56 smithi191 ceph-mon[31636]: pgmap v6111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:56 smithi170 ceph-mon[31212]: pgmap v6111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:32:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11288.493468 secs 2024-04-21T13:32:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11288.493468 secs 2024-04-21T13:32:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11288.493468 secs 2024-04-21T13:32:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:58 smithi077 ceph-mon[27902]: pgmap v6112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:58 smithi191 ceph-mon[31636]: pgmap v6112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:58 smithi170 ceph-mon[31212]: pgmap v6112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:32:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11290.253435 secs 2024-04-21T13:32:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11290.253435 secs 2024-04-21T13:33:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11290.253435 secs 2024-04-21T13:33:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:00 smithi077 ceph-mon[27902]: pgmap v6113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:00 smithi191 ceph-mon[31636]: pgmap v6113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:00 smithi170 ceph-mon[31212]: pgmap v6113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:02 smithi077 ceph-mon[27902]: pgmap v6114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T13:33:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11293.493610 secs 2024-04-21T13:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:02 smithi191 ceph-mon[31636]: pgmap v6114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T13:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11293.493610 secs 2024-04-21T13:33:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:02 smithi170 ceph-mon[31212]: pgmap v6114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T13:33:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11293.493610 secs 2024-04-21T13:33:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11295.253507 secs 2024-04-21T13:33:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:04 smithi077 ceph-mon[27902]: pgmap v6115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T13:33:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:04 smithi077 ceph-mon[27902]: osdmap e453: 12 total, 12 up, 12 in 2024-04-21T13:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11295.253507 secs 2024-04-21T13:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:04 smithi191 ceph-mon[31636]: pgmap v6115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T13:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:04 smithi191 ceph-mon[31636]: osdmap e453: 12 total, 12 up, 12 in 2024-04-21T13:33:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11295.253507 secs 2024-04-21T13:33:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:04 smithi170 ceph-mon[31212]: pgmap v6115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T13:33:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:04 smithi170 ceph-mon[31212]: osdmap e453: 12 total, 12 up, 12 in 2024-04-21T13:33:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:06 smithi077 ceph-mon[27902]: pgmap v6117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:33:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:06 smithi191 ceph-mon[31636]: pgmap v6117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:33:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:06 smithi170 ceph-mon[31212]: pgmap v6117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:33:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11298.493741 secs 2024-04-21T13:33:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11298.493741 secs 2024-04-21T13:33:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11298.493741 secs 2024-04-21T13:33:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:08 smithi077 ceph-mon[27902]: pgmap v6118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:33:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:08 smithi191 ceph-mon[31636]: pgmap v6118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:33:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:08 smithi170 ceph-mon[31212]: pgmap v6118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:33:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11300.253635 secs 2024-04-21T13:33:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:09 smithi191 ceph-mon[31636]: osdmap e454: 12 total, 12 up, 12 in 2024-04-21T13:33:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11300.253635 secs 2024-04-21T13:33:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:09 smithi170 ceph-mon[31212]: osdmap e454: 12 total, 12 up, 12 in 2024-04-21T13:33:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11300.253635 secs 2024-04-21T13:33:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:09 smithi077 ceph-mon[27902]: osdmap e454: 12 total, 12 up, 12 in 2024-04-21T13:33:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:10 smithi191 ceph-mon[31636]: pgmap v6120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T13:33:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:10 smithi170 ceph-mon[31212]: pgmap v6120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T13:33:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:10 smithi077 ceph-mon[27902]: pgmap v6120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T13:33:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:12 smithi191 ceph-mon[31636]: pgmap v6121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T13:33:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11303.493845 secs 2024-04-21T13:33:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:12 smithi170 ceph-mon[31212]: pgmap v6121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T13:33:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11303.493845 secs 2024-04-21T13:33:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:12 smithi077 ceph-mon[27902]: pgmap v6121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T13:33:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11303.493845 secs 2024-04-21T13:33:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11305.253748 secs 2024-04-21T13:33:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:14 smithi191 ceph-mon[31636]: pgmap v6122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T13:33:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11305.253748 secs 2024-04-21T13:33:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:14 smithi170 ceph-mon[31212]: pgmap v6122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T13:33:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11305.253748 secs 2024-04-21T13:33:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:14 smithi077 ceph-mon[27902]: pgmap v6122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T13:33:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:16 smithi191 ceph-mon[31636]: pgmap v6123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:33:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:16 smithi170 ceph-mon[31212]: pgmap v6123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:33:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:16 smithi077 ceph-mon[27902]: pgmap v6123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:33:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11308.493909 secs 2024-04-21T13:33:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11308.493909 secs 2024-04-21T13:33:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11308.493909 secs 2024-04-21T13:33:18.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:18 smithi170 ceph-mon[31212]: pgmap v6124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:33:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:18 smithi191 ceph-mon[31636]: pgmap v6124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:33:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:18 smithi077 ceph-mon[27902]: pgmap v6124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:33:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11310.253882 secs 2024-04-21T13:33:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11310.253882 secs 2024-04-21T13:33:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11310.253882 secs 2024-04-21T13:33:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:20 smithi191 ceph-mon[31636]: pgmap v6125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:33:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:20 smithi170 ceph-mon[31212]: pgmap v6125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:33:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:20 smithi077 ceph-mon[27902]: pgmap v6125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:33:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:22 smithi191 ceph-mon[31636]: pgmap v6126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:33:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11313.493994 secs 2024-04-21T13:33:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:22 smithi170 ceph-mon[31212]: pgmap v6126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:33:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11313.493994 secs 2024-04-21T13:33:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:22 smithi077 ceph-mon[27902]: pgmap v6126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:33:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11313.493994 secs 2024-04-21T13:33:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11315.254008 secs 2024-04-21T13:33:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:24 smithi191 ceph-mon[31636]: pgmap v6127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:33:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11315.254008 secs 2024-04-21T13:33:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:24 smithi170 ceph-mon[31212]: pgmap v6127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:33:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11315.254008 secs 2024-04-21T13:33:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:24 smithi077 ceph-mon[27902]: pgmap v6127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:33:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:26 smithi191 ceph-mon[31636]: pgmap v6128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:26 smithi170 ceph-mon[31212]: pgmap v6128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:26 smithi077 ceph-mon[27902]: pgmap v6128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11318.494072 secs 2024-04-21T13:33:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11318.494072 secs 2024-04-21T13:33:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11318.494072 secs 2024-04-21T13:33:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:28 smithi191 ceph-mon[31636]: pgmap v6129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:28 smithi170 ceph-mon[31212]: pgmap v6129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:28 smithi077 ceph-mon[27902]: pgmap v6129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11320.254121 secs 2024-04-21T13:33:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11320.254121 secs 2024-04-21T13:33:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11320.254121 secs 2024-04-21T13:33:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:30 smithi191 ceph-mon[31636]: pgmap v6130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:30 smithi170 ceph-mon[31212]: pgmap v6130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:30 smithi077 ceph-mon[27902]: pgmap v6130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:32 smithi191 ceph-mon[31636]: pgmap v6131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11323.494173 secs 2024-04-21T13:33:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:32 smithi170 ceph-mon[31212]: pgmap v6131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11323.494173 secs 2024-04-21T13:33:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:32 smithi077 ceph-mon[27902]: pgmap v6131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11323.494173 secs 2024-04-21T13:33:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11325.254236 secs 2024-04-21T13:33:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:34 smithi191 ceph-mon[31636]: pgmap v6132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11325.254236 secs 2024-04-21T13:33:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:34 smithi170 ceph-mon[31212]: pgmap v6132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11325.254236 secs 2024-04-21T13:33:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:34 smithi077 ceph-mon[27902]: pgmap v6132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:36 smithi170 ceph-mon[31212]: pgmap v6133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:33:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:36 smithi077 ceph-mon[27902]: pgmap v6133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:33:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:36 smithi191 ceph-mon[31636]: pgmap v6133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:33:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11328.494262 secs 2024-04-21T13:33:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:33:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:33:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:33:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11328.494262 secs 2024-04-21T13:33:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:33:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:33:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:33:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11328.494262 secs 2024-04-21T13:33:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:33:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:33:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:33:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:38 smithi170 ceph-mon[31212]: pgmap v6134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:38 smithi077 ceph-mon[27902]: pgmap v6134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:38 smithi191 ceph-mon[31636]: pgmap v6134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11330.254349 secs 2024-04-21T13:33:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11330.254349 secs 2024-04-21T13:33:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11330.254349 secs 2024-04-21T13:33:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:40 smithi170 ceph-mon[31212]: pgmap v6135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:40 smithi077 ceph-mon[27902]: pgmap v6135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:40 smithi191 ceph-mon[31636]: pgmap v6135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:42 smithi170 ceph-mon[31212]: pgmap v6136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11333.494372 secs 2024-04-21T13:33:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:42 smithi077 ceph-mon[27902]: pgmap v6136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11333.494372 secs 2024-04-21T13:33:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:42 smithi191 ceph-mon[31636]: pgmap v6136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11333.494372 secs 2024-04-21T13:33:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11335.254424 secs 2024-04-21T13:33:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:44 smithi170 ceph-mon[31212]: pgmap v6137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11335.254424 secs 2024-04-21T13:33:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:44 smithi077 ceph-mon[27902]: pgmap v6137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11335.254424 secs 2024-04-21T13:33:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:44 smithi191 ceph-mon[31636]: pgmap v6137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:46 smithi170 ceph-mon[31212]: pgmap v6138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:46 smithi077 ceph-mon[27902]: pgmap v6138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:46 smithi191 ceph-mon[31636]: pgmap v6138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11338.494504 secs 2024-04-21T13:33:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11338.494504 secs 2024-04-21T13:33:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11338.494504 secs 2024-04-21T13:33:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:48 smithi170 ceph-mon[31212]: pgmap v6139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:48 smithi077 ceph-mon[27902]: pgmap v6139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:48 smithi191 ceph-mon[31636]: pgmap v6139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11340.254559 secs 2024-04-21T13:33:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11340.254559 secs 2024-04-21T13:33:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11340.254559 secs 2024-04-21T13:33:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:50 smithi170 ceph-mon[31212]: pgmap v6140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:50 smithi077 ceph-mon[27902]: pgmap v6140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:50 smithi191 ceph-mon[31636]: pgmap v6140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:52 smithi170 ceph-mon[31212]: pgmap v6141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11343.494620 secs 2024-04-21T13:33:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:52 smithi077 ceph-mon[27902]: pgmap v6141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11343.494620 secs 2024-04-21T13:33:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:52 smithi191 ceph-mon[31636]: pgmap v6141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11343.494620 secs 2024-04-21T13:33:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11345.254670 secs 2024-04-21T13:33:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:54 smithi170 ceph-mon[31212]: pgmap v6142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:33:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11345.254670 secs 2024-04-21T13:33:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:54 smithi077 ceph-mon[27902]: pgmap v6142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11345.254670 secs 2024-04-21T13:33:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:54 smithi191 ceph-mon[31636]: pgmap v6142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:56 smithi170 ceph-mon[31212]: pgmap v6143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:56 smithi077 ceph-mon[27902]: pgmap v6143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:56 smithi191 ceph-mon[31636]: pgmap v6143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:33:58.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11348.494723 secs 2024-04-21T13:33:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11348.494723 secs 2024-04-21T13:33:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11348.494723 secs 2024-04-21T13:33:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:58 smithi170 ceph-mon[31212]: pgmap v6144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:58 smithi077 ceph-mon[27902]: pgmap v6144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:33:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:58 smithi191 ceph-mon[31636]: pgmap v6144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:33:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11350.254809 secs 2024-04-21T13:34:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:33:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11350.254809 secs 2024-04-21T13:34:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:33:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11350.254809 secs 2024-04-21T13:34:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:00 smithi170 ceph-mon[31212]: pgmap v6145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:00 smithi077 ceph-mon[27902]: pgmap v6145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:00 smithi191 ceph-mon[31636]: pgmap v6145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:02 smithi170 ceph-mon[31212]: pgmap v6146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11353.494823 secs 2024-04-21T13:34:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:02 smithi077 ceph-mon[27902]: pgmap v6146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11353.494823 secs 2024-04-21T13:34:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:02 smithi191 ceph-mon[31636]: pgmap v6146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11353.494823 secs 2024-04-21T13:34:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11355.254926 secs 2024-04-21T13:34:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:04 smithi170 ceph-mon[31212]: pgmap v6147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:04 smithi170 ceph-mon[31212]: osdmap e455: 12 total, 12 up, 12 in 2024-04-21T13:34:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11355.254926 secs 2024-04-21T13:34:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:04 smithi077 ceph-mon[27902]: pgmap v6147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:04 smithi077 ceph-mon[27902]: osdmap e455: 12 total, 12 up, 12 in 2024-04-21T13:34:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11355.254926 secs 2024-04-21T13:34:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:04 smithi191 ceph-mon[31636]: pgmap v6147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:04 smithi191 ceph-mon[31636]: osdmap e455: 12 total, 12 up, 12 in 2024-04-21T13:34:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:06 smithi170 ceph-mon[31212]: pgmap v6149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:34:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:06 smithi077 ceph-mon[27902]: pgmap v6149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:34:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:06 smithi191 ceph-mon[31636]: pgmap v6149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:34:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11358.494892 secs 2024-04-21T13:34:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11358.494892 secs 2024-04-21T13:34:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11358.494892 secs 2024-04-21T13:34:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:08 smithi170 ceph-mon[31212]: pgmap v6150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:34:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:08 smithi170 ceph-mon[31212]: osdmap e456: 12 total, 12 up, 12 in 2024-04-21T13:34:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:08 smithi077 ceph-mon[27902]: pgmap v6150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:34:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:08 smithi077 ceph-mon[27902]: osdmap e456: 12 total, 12 up, 12 in 2024-04-21T13:34:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:08 smithi191 ceph-mon[31636]: pgmap v6150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:34:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:08 smithi191 ceph-mon[31636]: osdmap e456: 12 total, 12 up, 12 in 2024-04-21T13:34:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11360.255041 secs 2024-04-21T13:34:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11360.255041 secs 2024-04-21T13:34:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11360.255041 secs 2024-04-21T13:34:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:10 smithi077 ceph-mon[27902]: pgmap v6152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:34:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:10 smithi191 ceph-mon[31636]: pgmap v6152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:34:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:10 smithi170 ceph-mon[31212]: pgmap v6152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:34:12.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:11 smithi077 ceph-mon[27902]: pgmap v6153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:34:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:11 smithi191 ceph-mon[31636]: pgmap v6153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:34:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:11 smithi170 ceph-mon[31212]: pgmap v6153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:34:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11363.494952 secs 2024-04-21T13:34:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11363.494952 secs 2024-04-21T13:34:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11363.494952 secs 2024-04-21T13:34:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11365.255104 secs 2024-04-21T13:34:14.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:13 smithi077 ceph-mon[27902]: pgmap v6154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:34:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11365.255104 secs 2024-04-21T13:34:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:13 smithi191 ceph-mon[31636]: pgmap v6154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:34:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11365.255104 secs 2024-04-21T13:34:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:13 smithi170 ceph-mon[31212]: pgmap v6154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:34:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:16 smithi170 ceph-mon[31212]: pgmap v6155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:34:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:16 smithi077 ceph-mon[27902]: pgmap v6155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:34:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:16 smithi191 ceph-mon[31636]: pgmap v6155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:34:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11368.495073 secs 2024-04-21T13:34:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11368.495073 secs 2024-04-21T13:34:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11368.495073 secs 2024-04-21T13:34:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:18 smithi170 ceph-mon[31212]: pgmap v6156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:34:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:18 smithi191 ceph-mon[31636]: pgmap v6156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:34:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:18 smithi077 ceph-mon[27902]: pgmap v6156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:34:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11370.255213 secs 2024-04-21T13:34:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11370.255213 secs 2024-04-21T13:34:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11370.255213 secs 2024-04-21T13:34:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:20 smithi170 ceph-mon[31212]: pgmap v6157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:34:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:20 smithi077 ceph-mon[27902]: pgmap v6157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:34:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:20 smithi191 ceph-mon[31636]: pgmap v6157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:34:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:22 smithi170 ceph-mon[31212]: pgmap v6158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:34:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11373.495148 secs 2024-04-21T13:34:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:22 smithi077 ceph-mon[27902]: pgmap v6158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:34:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11373.495148 secs 2024-04-21T13:34:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:22 smithi191 ceph-mon[31636]: pgmap v6158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:34:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11373.495148 secs 2024-04-21T13:34:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11375.255322 secs 2024-04-21T13:34:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:24 smithi170 ceph-mon[31212]: pgmap v6159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11375.255322 secs 2024-04-21T13:34:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:24 smithi077 ceph-mon[27902]: pgmap v6159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11375.255322 secs 2024-04-21T13:34:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:24 smithi191 ceph-mon[31636]: pgmap v6159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:26 smithi170 ceph-mon[31212]: pgmap v6160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:26 smithi077 ceph-mon[27902]: pgmap v6160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:26 smithi191 ceph-mon[31636]: pgmap v6160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11378.495265 secs 2024-04-21T13:34:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11378.495265 secs 2024-04-21T13:34:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11378.495265 secs 2024-04-21T13:34:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:28 smithi170 ceph-mon[31212]: pgmap v6161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:28 smithi077 ceph-mon[27902]: pgmap v6161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:28 smithi191 ceph-mon[31636]: pgmap v6161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11380.255399 secs 2024-04-21T13:34:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11380.255399 secs 2024-04-21T13:34:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11380.255399 secs 2024-04-21T13:34:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:30 smithi170 ceph-mon[31212]: pgmap v6162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:30 smithi077 ceph-mon[27902]: pgmap v6162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:30 smithi191 ceph-mon[31636]: pgmap v6162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:32 smithi077 ceph-mon[27902]: pgmap v6163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11383.495376 secs 2024-04-21T13:34:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:32 smithi191 ceph-mon[31636]: pgmap v6163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11383.495376 secs 2024-04-21T13:34:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:32 smithi170 ceph-mon[31212]: pgmap v6163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11383.495376 secs 2024-04-21T13:34:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11385.255534 secs 2024-04-21T13:34:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:34 smithi077 ceph-mon[27902]: pgmap v6164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11385.255534 secs 2024-04-21T13:34:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:34 smithi191 ceph-mon[31636]: pgmap v6164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11385.255534 secs 2024-04-21T13:34:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:34 smithi170 ceph-mon[31212]: pgmap v6164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:36 smithi077 ceph-mon[27902]: pgmap v6165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:36 smithi191 ceph-mon[31636]: pgmap v6165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:36 smithi170 ceph-mon[31212]: pgmap v6165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11388.495498 secs 2024-04-21T13:34:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:34:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11388.495498 secs 2024-04-21T13:34:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:34:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11388.495498 secs 2024-04-21T13:34:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:34:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:38 smithi077 ceph-mon[27902]: pgmap v6166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:34:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:34:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:34:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:38 smithi191 ceph-mon[31636]: pgmap v6166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:34:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:34:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:34:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:38 smithi170 ceph-mon[31212]: pgmap v6166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:34:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:34:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:34:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11390.255641 secs 2024-04-21T13:34:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11390.255641 secs 2024-04-21T13:34:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11390.255641 secs 2024-04-21T13:34:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:40 smithi077 ceph-mon[27902]: pgmap v6167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:40 smithi191 ceph-mon[31636]: pgmap v6167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:40 smithi170 ceph-mon[31212]: pgmap v6167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:42 smithi077 ceph-mon[27902]: pgmap v6168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11393.495621 secs 2024-04-21T13:34:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:42 smithi191 ceph-mon[31636]: pgmap v6168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11393.495621 secs 2024-04-21T13:34:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:42 smithi170 ceph-mon[31212]: pgmap v6168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11393.495621 secs 2024-04-21T13:34:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11395.255778 secs 2024-04-21T13:34:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:44 smithi077 ceph-mon[27902]: pgmap v6169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11395.255778 secs 2024-04-21T13:34:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:44 smithi191 ceph-mon[31636]: pgmap v6169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11395.255778 secs 2024-04-21T13:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:44 smithi170 ceph-mon[31212]: pgmap v6169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:46 smithi077 ceph-mon[27902]: pgmap v6170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:46 smithi191 ceph-mon[31636]: pgmap v6170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:46 smithi170 ceph-mon[31212]: pgmap v6170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11398.495736 secs 2024-04-21T13:34:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11398.495736 secs 2024-04-21T13:34:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11398.495736 secs 2024-04-21T13:34:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:48 smithi191 ceph-mon[31636]: pgmap v6171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:48 smithi077 ceph-mon[27902]: pgmap v6171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:48 smithi170 ceph-mon[31212]: pgmap v6171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11400.255890 secs 2024-04-21T13:34:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11400.255890 secs 2024-04-21T13:34:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11400.255890 secs 2024-04-21T13:34:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:50 smithi077 ceph-mon[27902]: pgmap v6172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:50 smithi191 ceph-mon[31636]: pgmap v6172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:50 smithi170 ceph-mon[31212]: pgmap v6172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:52 smithi077 ceph-mon[27902]: pgmap v6173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11403.495862 secs 2024-04-21T13:34:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:52 smithi191 ceph-mon[31636]: pgmap v6173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11403.495862 secs 2024-04-21T13:34:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:52 smithi170 ceph-mon[31212]: pgmap v6173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11403.495862 secs 2024-04-21T13:34:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11405.256005 secs 2024-04-21T13:34:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:54 smithi077 ceph-mon[27902]: pgmap v6174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11405.256005 secs 2024-04-21T13:34:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:54 smithi191 ceph-mon[31636]: pgmap v6174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11405.256005 secs 2024-04-21T13:34:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:54 smithi170 ceph-mon[31212]: pgmap v6174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:34:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:34:55.927+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:34:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:34:55.927+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:34:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:34:55.927+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:34:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:34:55.927+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:34:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:56 smithi077 ceph-mon[27902]: pgmap v6175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:56 smithi191 ceph-mon[31636]: pgmap v6175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:56 smithi170 ceph-mon[31212]: pgmap v6175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:34:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11408.495928 secs 2024-04-21T13:34:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11408.495928 secs 2024-04-21T13:34:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11408.495928 secs 2024-04-21T13:34:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:58 smithi077 ceph-mon[27902]: pgmap v6176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:58 smithi191 ceph-mon[31636]: pgmap v6176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:58 smithi170 ceph-mon[31212]: pgmap v6176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:34:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11410.256117 secs 2024-04-21T13:34:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11410.256117 secs 2024-04-21T13:35:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11410.256117 secs 2024-04-21T13:35:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:00 smithi077 ceph-mon[27902]: pgmap v6177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:00 smithi191 ceph-mon[31636]: pgmap v6177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:00 smithi170 ceph-mon[31212]: pgmap v6177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:02 smithi077 ceph-mon[27902]: pgmap v6178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11413.496039 secs 2024-04-21T13:35:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:02 smithi191 ceph-mon[31636]: pgmap v6178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11413.496039 secs 2024-04-21T13:35:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:02 smithi170 ceph-mon[31212]: pgmap v6178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11413.496039 secs 2024-04-21T13:35:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11415.256228 secs 2024-04-21T13:35:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:04 smithi191 ceph-mon[31636]: pgmap v6179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:04 smithi191 ceph-mon[31636]: osdmap e457: 12 total, 12 up, 12 in 2024-04-21T13:35:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11415.256228 secs 2024-04-21T13:35:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:04 smithi170 ceph-mon[31212]: pgmap v6179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:04 smithi170 ceph-mon[31212]: osdmap e457: 12 total, 12 up, 12 in 2024-04-21T13:35:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11415.256228 secs 2024-04-21T13:35:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:04 smithi077 ceph-mon[27902]: pgmap v6179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:04 smithi077 ceph-mon[27902]: osdmap e457: 12 total, 12 up, 12 in 2024-04-21T13:35:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:06 smithi191 ceph-mon[31636]: pgmap v6181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:35:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:06 smithi170 ceph-mon[31212]: pgmap v6181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:35:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:06 smithi077 ceph-mon[27902]: pgmap v6181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:35:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11418.496151 secs 2024-04-21T13:35:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11418.496151 secs 2024-04-21T13:35:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11418.496151 secs 2024-04-21T13:35:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:08 smithi191 ceph-mon[31636]: pgmap v6182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:35:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:08 smithi170 ceph-mon[31212]: pgmap v6182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:35:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:08 smithi077 ceph-mon[27902]: pgmap v6182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:35:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11420.256342 secs 2024-04-21T13:35:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:09 smithi191 ceph-mon[31636]: osdmap e458: 12 total, 12 up, 12 in 2024-04-21T13:35:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11420.256342 secs 2024-04-21T13:35:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:09 smithi170 ceph-mon[31212]: osdmap e458: 12 total, 12 up, 12 in 2024-04-21T13:35:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11420.256342 secs 2024-04-21T13:35:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:09 smithi077 ceph-mon[27902]: osdmap e458: 12 total, 12 up, 12 in 2024-04-21T13:35:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:10 smithi191 ceph-mon[31636]: pgmap v6184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:35:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:10 smithi170 ceph-mon[31212]: pgmap v6184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:35:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:10 smithi077 ceph-mon[27902]: pgmap v6184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:35:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:12 smithi191 ceph-mon[31636]: pgmap v6185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:35:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11423.496271 secs 2024-04-21T13:35:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:12 smithi170 ceph-mon[31212]: pgmap v6185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:35:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11423.496271 secs 2024-04-21T13:35:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:12 smithi077 ceph-mon[27902]: pgmap v6185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:35:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11423.496271 secs 2024-04-21T13:35:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11425.256461 secs 2024-04-21T13:35:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:14 smithi191 ceph-mon[31636]: pgmap v6186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:35:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11425.256461 secs 2024-04-21T13:35:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:14 smithi170 ceph-mon[31212]: pgmap v6186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:35:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11425.256461 secs 2024-04-21T13:35:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:14 smithi077 ceph-mon[27902]: pgmap v6186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:35:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:16 smithi191 ceph-mon[31636]: pgmap v6187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:35:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:16 smithi170 ceph-mon[31212]: pgmap v6187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:35:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:16 smithi077 ceph-mon[27902]: pgmap v6187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:35:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11428.496360 secs 2024-04-21T13:35:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11428.496360 secs 2024-04-21T13:35:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11428.496360 secs 2024-04-21T13:35:18.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:18 smithi170 ceph-mon[31212]: pgmap v6188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:35:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:18 smithi191 ceph-mon[31636]: pgmap v6188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:35:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:18 smithi077 ceph-mon[27902]: pgmap v6188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:35:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11430.256576 secs 2024-04-21T13:35:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11430.256576 secs 2024-04-21T13:35:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11430.256576 secs 2024-04-21T13:35:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:20 smithi191 ceph-mon[31636]: pgmap v6189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:35:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:20 smithi170 ceph-mon[31212]: pgmap v6189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:35:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:20 smithi077 ceph-mon[27902]: pgmap v6189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:35:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:22 smithi191 ceph-mon[31636]: pgmap v6190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:35:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11433.496475 secs 2024-04-21T13:35:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:22 smithi170 ceph-mon[31212]: pgmap v6190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:35:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11433.496475 secs 2024-04-21T13:35:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:22 smithi077 ceph-mon[27902]: pgmap v6190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:35:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11433.496475 secs 2024-04-21T13:35:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11435.256709 secs 2024-04-21T13:35:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:24 smithi191 ceph-mon[31636]: pgmap v6191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11435.256709 secs 2024-04-21T13:35:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:24 smithi170 ceph-mon[31212]: pgmap v6191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11435.256709 secs 2024-04-21T13:35:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:24 smithi077 ceph-mon[27902]: pgmap v6191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:26 smithi191 ceph-mon[31636]: pgmap v6192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:26 smithi170 ceph-mon[31212]: pgmap v6192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:26 smithi077 ceph-mon[27902]: pgmap v6192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11438.496626 secs 2024-04-21T13:35:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11438.496626 secs 2024-04-21T13:35:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11438.496626 secs 2024-04-21T13:35:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:28 smithi170 ceph-mon[31212]: pgmap v6193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:28 smithi077 ceph-mon[27902]: pgmap v6193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:28 smithi191 ceph-mon[31636]: pgmap v6193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11440.256796 secs 2024-04-21T13:35:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11440.256796 secs 2024-04-21T13:35:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11440.256796 secs 2024-04-21T13:35:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:30 smithi170 ceph-mon[31212]: pgmap v6194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:30 smithi077 ceph-mon[27902]: pgmap v6194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:30 smithi191 ceph-mon[31636]: pgmap v6194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:32 smithi170 ceph-mon[31212]: pgmap v6195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11443.496784 secs 2024-04-21T13:35:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:32 smithi077 ceph-mon[27902]: pgmap v6195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11443.496784 secs 2024-04-21T13:35:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:32 smithi191 ceph-mon[31636]: pgmap v6195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11443.496784 secs 2024-04-21T13:35:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11445.256908 secs 2024-04-21T13:35:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:34 smithi170 ceph-mon[31212]: pgmap v6196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11445.256908 secs 2024-04-21T13:35:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:34 smithi077 ceph-mon[27902]: pgmap v6196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11445.256908 secs 2024-04-21T13:35:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:34 smithi191 ceph-mon[31636]: pgmap v6196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:36 smithi170 ceph-mon[31212]: pgmap v6197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:36 smithi077 ceph-mon[27902]: pgmap v6197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:36 smithi191 ceph-mon[31636]: pgmap v6197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11448.496870 secs 2024-04-21T13:35:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11448.496870 secs 2024-04-21T13:35:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11448.496870 secs 2024-04-21T13:35:39.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:38 smithi077 ceph-mon[27902]: pgmap v6198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:39.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:35:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:38 smithi170 ceph-mon[31212]: pgmap v6198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:35:39.099 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:38 smithi191 ceph-mon[31636]: pgmap v6198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:39.099 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:35:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11450.256978 secs 2024-04-21T13:35:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11450.256978 secs 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11450.256978 secs 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: pgmap v6199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:35:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:35:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: pgmap v6199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: pgmap v6199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:35:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:35:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:35:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:35:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:35:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:35:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:35:42.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:35:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:35:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:35:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:35:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:35:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:35:42.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:35:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:35:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:35:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:35:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:35:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:35:42.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:35:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:42 smithi170 ceph-mon[31212]: pgmap v6200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11453.496974 secs 2024-04-21T13:35:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:42 smithi077 ceph-mon[27902]: pgmap v6200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11453.496974 secs 2024-04-21T13:35:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:42 smithi191 ceph-mon[31636]: pgmap v6200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11453.496974 secs 2024-04-21T13:35:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11455.257094 secs 2024-04-21T13:35:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:44 smithi170 ceph-mon[31212]: pgmap v6201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11455.257094 secs 2024-04-21T13:35:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:44 smithi077 ceph-mon[27902]: pgmap v6201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11455.257094 secs 2024-04-21T13:35:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:44 smithi191 ceph-mon[31636]: pgmap v6201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:46 smithi170 ceph-mon[31212]: pgmap v6202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:46 smithi077 ceph-mon[27902]: pgmap v6202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:46 smithi191 ceph-mon[31636]: pgmap v6202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11458.497090 secs 2024-04-21T13:35:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11458.497090 secs 2024-04-21T13:35:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11458.497090 secs 2024-04-21T13:35:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:48 smithi170 ceph-mon[31212]: pgmap v6203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:48 smithi077 ceph-mon[27902]: pgmap v6203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:48 smithi191 ceph-mon[31636]: pgmap v6203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11460.257216 secs 2024-04-21T13:35:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11460.257216 secs 2024-04-21T13:35:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11460.257216 secs 2024-04-21T13:35:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:50 smithi170 ceph-mon[31212]: pgmap v6204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:50 smithi077 ceph-mon[27902]: pgmap v6204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:50 smithi191 ceph-mon[31636]: pgmap v6204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:52 smithi170 ceph-mon[31212]: pgmap v6205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11463.497215 secs 2024-04-21T13:35:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:52 smithi077 ceph-mon[27902]: pgmap v6205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11463.497215 secs 2024-04-21T13:35:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:52 smithi191 ceph-mon[31636]: pgmap v6205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11463.497215 secs 2024-04-21T13:35:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11465.257353 secs 2024-04-21T13:35:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:54 smithi170 ceph-mon[31212]: pgmap v6206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11465.257353 secs 2024-04-21T13:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:54 smithi077 ceph-mon[27902]: pgmap v6206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11465.257353 secs 2024-04-21T13:35:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:54 smithi191 ceph-mon[31636]: pgmap v6206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:57.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:56 smithi170 ceph-mon[31212]: pgmap v6207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:56 smithi077 ceph-mon[27902]: pgmap v6207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:56 smithi191 ceph-mon[31636]: pgmap v6207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:35:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11468.497323 secs 2024-04-21T13:35:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11468.497323 secs 2024-04-21T13:35:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11468.497323 secs 2024-04-21T13:35:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:58 smithi077 ceph-mon[27902]: pgmap v6208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:58 smithi191 ceph-mon[31636]: pgmap v6208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:35:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:58 smithi170 ceph-mon[31212]: pgmap v6208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11470.257486 secs 2024-04-21T13:36:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11470.257486 secs 2024-04-21T13:36:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11470.257486 secs 2024-04-21T13:36:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:00 smithi077 ceph-mon[27902]: pgmap v6209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:00 smithi191 ceph-mon[31636]: pgmap v6209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:00 smithi170 ceph-mon[31212]: pgmap v6209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:02 smithi077 ceph-mon[27902]: pgmap v6210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11473.497424 secs 2024-04-21T13:36:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:02 smithi191 ceph-mon[31636]: pgmap v6210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11473.497424 secs 2024-04-21T13:36:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:02 smithi170 ceph-mon[31212]: pgmap v6210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11473.497424 secs 2024-04-21T13:36:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11475.257634 secs 2024-04-21T13:36:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:04 smithi077 ceph-mon[27902]: pgmap v6211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:04 smithi077 ceph-mon[27902]: osdmap e459: 12 total, 12 up, 12 in 2024-04-21T13:36:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11475.257634 secs 2024-04-21T13:36:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:04 smithi191 ceph-mon[31636]: pgmap v6211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:04 smithi191 ceph-mon[31636]: osdmap e459: 12 total, 12 up, 12 in 2024-04-21T13:36:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11475.257634 secs 2024-04-21T13:36:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:04 smithi170 ceph-mon[31212]: pgmap v6211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:04 smithi170 ceph-mon[31212]: osdmap e459: 12 total, 12 up, 12 in 2024-04-21T13:36:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:06 smithi077 ceph-mon[27902]: pgmap v6213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:36:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:06 smithi191 ceph-mon[31636]: pgmap v6213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:36:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:06 smithi170 ceph-mon[31212]: pgmap v6213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:36:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11478.497574 secs 2024-04-21T13:36:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11478.497574 secs 2024-04-21T13:36:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11478.497574 secs 2024-04-21T13:36:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:08 smithi077 ceph-mon[27902]: pgmap v6214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:36:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:08 smithi077 ceph-mon[27902]: osdmap e460: 12 total, 12 up, 12 in 2024-04-21T13:36:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:08 smithi191 ceph-mon[31636]: pgmap v6214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:36:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:08 smithi191 ceph-mon[31636]: osdmap e460: 12 total, 12 up, 12 in 2024-04-21T13:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:08 smithi170 ceph-mon[31212]: pgmap v6214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:08 smithi170 ceph-mon[31212]: osdmap e460: 12 total, 12 up, 12 in 2024-04-21T13:36:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11480.257759 secs 2024-04-21T13:36:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:09 smithi077 ceph-mon[27902]: pgmap v6216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:36:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11480.257759 secs 2024-04-21T13:36:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:09 smithi191 ceph-mon[31636]: pgmap v6216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:36:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11480.257759 secs 2024-04-21T13:36:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:09 smithi170 ceph-mon[31212]: pgmap v6216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:36:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:12 smithi170 ceph-mon[31212]: pgmap v6217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:36:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11483.497713 secs 2024-04-21T13:36:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:12 smithi077 ceph-mon[27902]: pgmap v6217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:36:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11483.497713 secs 2024-04-21T13:36:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:12 smithi191 ceph-mon[31636]: pgmap v6217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:36:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11483.497713 secs 2024-04-21T13:36:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11485.257910 secs 2024-04-21T13:36:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:14 smithi170 ceph-mon[31212]: pgmap v6218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:36:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11485.257910 secs 2024-04-21T13:36:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:14 smithi077 ceph-mon[27902]: pgmap v6218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:36:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11485.257910 secs 2024-04-21T13:36:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:14 smithi191 ceph-mon[31636]: pgmap v6218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:36:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:16 smithi170 ceph-mon[31212]: pgmap v6219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:36:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:16 smithi077 ceph-mon[27902]: pgmap v6219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:36:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:16 smithi191 ceph-mon[31636]: pgmap v6219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:36:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11488.497809 secs 2024-04-21T13:36:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11488.497809 secs 2024-04-21T13:36:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11488.497809 secs 2024-04-21T13:36:18.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:18 smithi191 ceph-mon[31636]: pgmap v6220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:36:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:18 smithi077 ceph-mon[27902]: pgmap v6220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:36:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:18 smithi170 ceph-mon[31212]: pgmap v6220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:36:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11490.258017 secs 2024-04-21T13:36:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11490.258017 secs 2024-04-21T13:36:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11490.258017 secs 2024-04-21T13:36:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:20 smithi077 ceph-mon[27902]: pgmap v6221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:36:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:20 smithi191 ceph-mon[31636]: pgmap v6221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:36:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:20 smithi170 ceph-mon[31212]: pgmap v6221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:36:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:22 smithi077 ceph-mon[27902]: pgmap v6222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:36:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11493.497908 secs 2024-04-21T13:36:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:22 smithi191 ceph-mon[31636]: pgmap v6222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:36:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11493.497908 secs 2024-04-21T13:36:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:22 smithi170 ceph-mon[31212]: pgmap v6222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:36:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11493.497908 secs 2024-04-21T13:36:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11495.258136 secs 2024-04-21T13:36:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:24 smithi077 ceph-mon[27902]: pgmap v6223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11495.258136 secs 2024-04-21T13:36:24.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:24 smithi191 ceph-mon[31636]: pgmap v6223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11495.258136 secs 2024-04-21T13:36:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:24 smithi170 ceph-mon[31212]: pgmap v6223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:26 smithi077 ceph-mon[27902]: pgmap v6224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:26 smithi191 ceph-mon[31636]: pgmap v6224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:26 smithi170 ceph-mon[31212]: pgmap v6224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11498.498028 secs 2024-04-21T13:36:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11498.498028 secs 2024-04-21T13:36:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11498.498028 secs 2024-04-21T13:36:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:28 smithi077 ceph-mon[27902]: pgmap v6225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:28 smithi191 ceph-mon[31636]: pgmap v6225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:28 smithi170 ceph-mon[31212]: pgmap v6225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11500.258211 secs 2024-04-21T13:36:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11500.258211 secs 2024-04-21T13:36:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11500.258211 secs 2024-04-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:30 smithi077 ceph-mon[27902]: pgmap v6226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:30 smithi191 ceph-mon[31636]: pgmap v6226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:30 smithi170 ceph-mon[31212]: pgmap v6226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:32 smithi077 ceph-mon[27902]: pgmap v6227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11503.498108 secs 2024-04-21T13:36:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:32 smithi191 ceph-mon[31636]: pgmap v6227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11503.498108 secs 2024-04-21T13:36:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:32 smithi170 ceph-mon[31212]: pgmap v6227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11503.498108 secs 2024-04-21T13:36:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11505.258317 secs 2024-04-21T13:36:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:34 smithi077 ceph-mon[27902]: pgmap v6228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11505.258317 secs 2024-04-21T13:36:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:34 smithi191 ceph-mon[31636]: pgmap v6228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11505.258317 secs 2024-04-21T13:36:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:34 smithi170 ceph-mon[31212]: pgmap v6228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:36 smithi077 ceph-mon[27902]: pgmap v6229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:36 smithi191 ceph-mon[31636]: pgmap v6229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:36 smithi170 ceph-mon[31212]: pgmap v6229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11508.498223 secs 2024-04-21T13:36:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11508.498223 secs 2024-04-21T13:36:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11508.498223 secs 2024-04-21T13:36:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:38 smithi077 ceph-mon[27902]: pgmap v6230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:38 smithi191 ceph-mon[31636]: pgmap v6230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:38 smithi170 ceph-mon[31212]: pgmap v6230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11510.258451 secs 2024-04-21T13:36:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11510.258451 secs 2024-04-21T13:36:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11510.258451 secs 2024-04-21T13:36:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:40 smithi077 ceph-mon[27902]: pgmap v6231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:36:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:40 smithi191 ceph-mon[31636]: pgmap v6231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:36:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:40 smithi170 ceph-mon[31212]: pgmap v6231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:36:42.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:42 smithi170 ceph-mon[31212]: pgmap v6232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:36:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:36:42.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:42 smithi077 ceph-mon[27902]: pgmap v6232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:36:42.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:42 smithi191 ceph-mon[31636]: pgmap v6232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:36:42.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:36:42.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:36:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11513.498338 secs 2024-04-21T13:36:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11513.498338 secs 2024-04-21T13:36:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11513.498338 secs 2024-04-21T13:36:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11515.258572 secs 2024-04-21T13:36:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:44 smithi170 ceph-mon[31212]: pgmap v6233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11515.258572 secs 2024-04-21T13:36:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:44 smithi077 ceph-mon[27902]: pgmap v6233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11515.258572 secs 2024-04-21T13:36:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:44 smithi191 ceph-mon[31636]: pgmap v6233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:46 smithi077 ceph-mon[27902]: pgmap v6234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:46 smithi191 ceph-mon[31636]: pgmap v6234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:46 smithi170 ceph-mon[31212]: pgmap v6234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11518.498454 secs 2024-04-21T13:36:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11518.498454 secs 2024-04-21T13:36:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11518.498454 secs 2024-04-21T13:36:48.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:48 smithi191 ceph-mon[31636]: pgmap v6235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:48 smithi077 ceph-mon[27902]: pgmap v6235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:48.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:48 smithi170 ceph-mon[31212]: pgmap v6235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:49 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 11520.258714 secs 2024-04-21T13:36:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:49 smithi077 ceph-mon[27902]: slow request 11520.258714 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T13:36:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:49 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 11520.258714 secs 2024-04-21T13:36:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:49 smithi191 ceph-mon[31636]: slow request 11520.258714 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T13:36:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:49 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 11520.258714 secs 2024-04-21T13:36:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:49 smithi170 ceph-mon[31212]: slow request 11520.258714 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T13:36:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:50 smithi077 ceph-mon[27902]: pgmap v6236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:50 smithi191 ceph-mon[31636]: pgmap v6236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:50 smithi170 ceph-mon[31212]: pgmap v6236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:52 smithi077 ceph-mon[27902]: pgmap v6237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 11523.498572 secs 2024-04-21T13:36:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:52 smithi077 ceph-mon[27902]: slow request 11523.498571 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T13:36:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:52 smithi191 ceph-mon[31636]: pgmap v6237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 11523.498572 secs 2024-04-21T13:36:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:52 smithi191 ceph-mon[31636]: slow request 11523.498571 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T13:36:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:52 smithi170 ceph-mon[31212]: pgmap v6237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 11523.498572 secs 2024-04-21T13:36:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:52 smithi170 ceph-mon[31212]: slow request 11523.498571 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T13:36:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11525.258832 secs 2024-04-21T13:36:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:54 smithi191 ceph-mon[31636]: pgmap v6238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11525.258832 secs 2024-04-21T13:36:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:54 smithi170 ceph-mon[31212]: pgmap v6238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:36:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11525.258832 secs 2024-04-21T13:36:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:54 smithi077 ceph-mon[27902]: pgmap v6238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:56 smithi191 ceph-mon[31636]: pgmap v6239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:56 smithi170 ceph-mon[31212]: pgmap v6239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:56 smithi077 ceph-mon[27902]: pgmap v6239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:36:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11528.498690 secs 2024-04-21T13:36:58.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11528.498690 secs 2024-04-21T13:36:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11528.498690 secs 2024-04-21T13:36:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:58 smithi191 ceph-mon[31636]: pgmap v6240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:59.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:58 smithi077 ceph-mon[27902]: pgmap v6240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:58 smithi170 ceph-mon[31212]: pgmap v6240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:36:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:36:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11530.258931 secs 2024-04-21T13:37:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:36:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11530.258931 secs 2024-04-21T13:37:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:36:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11530.258931 secs 2024-04-21T13:37:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:00 smithi191 ceph-mon[31636]: pgmap v6241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:00 smithi170 ceph-mon[31212]: pgmap v6241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:00 smithi077 ceph-mon[27902]: pgmap v6241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:02 smithi170 ceph-mon[31212]: pgmap v6242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11533.498812 secs 2024-04-21T13:37:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:02 smithi077 ceph-mon[27902]: pgmap v6242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11533.498812 secs 2024-04-21T13:37:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:02 smithi191 ceph-mon[31636]: pgmap v6242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11533.498812 secs 2024-04-21T13:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11535.259044 secs 2024-04-21T13:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:04 smithi170 ceph-mon[31212]: pgmap v6243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:04 smithi170 ceph-mon[31212]: osdmap e461: 12 total, 12 up, 12 in 2024-04-21T13:37:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11535.259044 secs 2024-04-21T13:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:04 smithi077 ceph-mon[27902]: pgmap v6243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:04 smithi077 ceph-mon[27902]: osdmap e461: 12 total, 12 up, 12 in 2024-04-21T13:37:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11535.259044 secs 2024-04-21T13:37:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:04 smithi191 ceph-mon[31636]: pgmap v6243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:04 smithi191 ceph-mon[31636]: osdmap e461: 12 total, 12 up, 12 in 2024-04-21T13:37:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:06 smithi170 ceph-mon[31212]: pgmap v6245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:37:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:06 smithi077 ceph-mon[27902]: pgmap v6245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:37:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:06 smithi191 ceph-mon[31636]: pgmap v6245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:37:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11538.498923 secs 2024-04-21T13:37:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11538.498923 secs 2024-04-21T13:37:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11538.498923 secs 2024-04-21T13:37:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:08 smithi170 ceph-mon[31212]: pgmap v6246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:37:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:08 smithi170 ceph-mon[31212]: osdmap e462: 12 total, 12 up, 12 in 2024-04-21T13:37:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:08 smithi077 ceph-mon[27902]: pgmap v6246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:37:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:08 smithi077 ceph-mon[27902]: osdmap e462: 12 total, 12 up, 12 in 2024-04-21T13:37:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:08 smithi191 ceph-mon[31636]: pgmap v6246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:37:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:08 smithi191 ceph-mon[31636]: osdmap e462: 12 total, 12 up, 12 in 2024-04-21T13:37:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11540.259149 secs 2024-04-21T13:37:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11540.259149 secs 2024-04-21T13:37:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11540.259149 secs 2024-04-21T13:37:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:10 smithi170 ceph-mon[31212]: pgmap v6248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:37:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:10 smithi077 ceph-mon[27902]: pgmap v6248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:37:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:10 smithi191 ceph-mon[31636]: pgmap v6248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:37:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:12 smithi170 ceph-mon[31212]: pgmap v6249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:37:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11543.499039 secs 2024-04-21T13:37:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:12 smithi077 ceph-mon[27902]: pgmap v6249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:37:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11543.499039 secs 2024-04-21T13:37:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:12 smithi191 ceph-mon[31636]: pgmap v6249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:37:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11543.499039 secs 2024-04-21T13:37:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11545.259265 secs 2024-04-21T13:37:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:14 smithi170 ceph-mon[31212]: pgmap v6250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:37:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11545.259265 secs 2024-04-21T13:37:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:14 smithi077 ceph-mon[27902]: pgmap v6250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:37:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11545.259265 secs 2024-04-21T13:37:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:14 smithi191 ceph-mon[31636]: pgmap v6250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:37:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:16 smithi170 ceph-mon[31212]: pgmap v6251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:37:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:16 smithi077 ceph-mon[27902]: pgmap v6251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:37:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:16 smithi191 ceph-mon[31636]: pgmap v6251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:37:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11548.499153 secs 2024-04-21T13:37:18.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11548.499153 secs 2024-04-21T13:37:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11548.499153 secs 2024-04-21T13:37:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:18 smithi170 ceph-mon[31212]: pgmap v6252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:37:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:18 smithi077 ceph-mon[27902]: pgmap v6252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:37:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:18 smithi191 ceph-mon[31636]: pgmap v6252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:37:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11550.259385 secs 2024-04-21T13:37:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11550.259385 secs 2024-04-21T13:37:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11550.259385 secs 2024-04-21T13:37:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:20 smithi170 ceph-mon[31212]: pgmap v6253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:37:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:20 smithi077 ceph-mon[27902]: pgmap v6253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:37:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:20 smithi191 ceph-mon[31636]: pgmap v6253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:37:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:22 smithi170 ceph-mon[31212]: pgmap v6254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:37:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11553.499269 secs 2024-04-21T13:37:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:22 smithi077 ceph-mon[27902]: pgmap v6254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:37:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11553.499269 secs 2024-04-21T13:37:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:22 smithi191 ceph-mon[31636]: pgmap v6254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:37:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11553.499269 secs 2024-04-21T13:37:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11555.259498 secs 2024-04-21T13:37:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:24 smithi170 ceph-mon[31212]: pgmap v6255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11555.259498 secs 2024-04-21T13:37:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:24 smithi077 ceph-mon[27902]: pgmap v6255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11555.259498 secs 2024-04-21T13:37:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:24 smithi191 ceph-mon[31636]: pgmap v6255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:26 smithi170 ceph-mon[31212]: pgmap v6256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:26 smithi077 ceph-mon[27902]: pgmap v6256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:26 smithi191 ceph-mon[31636]: pgmap v6256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11558.499381 secs 2024-04-21T13:37:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11558.499381 secs 2024-04-21T13:37:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11558.499381 secs 2024-04-21T13:37:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:28 smithi170 ceph-mon[31212]: pgmap v6257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:28 smithi077 ceph-mon[27902]: pgmap v6257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:28 smithi191 ceph-mon[31636]: pgmap v6257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11560.259644 secs 2024-04-21T13:37:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11560.259644 secs 2024-04-21T13:37:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11560.259644 secs 2024-04-21T13:37:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:30 smithi170 ceph-mon[31212]: pgmap v6258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:30 smithi077 ceph-mon[27902]: pgmap v6258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:30 smithi191 ceph-mon[31636]: pgmap v6258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:32 smithi170 ceph-mon[31212]: pgmap v6259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11563.499500 secs 2024-04-21T13:37:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:32 smithi077 ceph-mon[27902]: pgmap v6259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11563.499500 secs 2024-04-21T13:37:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:32 smithi191 ceph-mon[31636]: pgmap v6259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11563.499500 secs 2024-04-21T13:37:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11565.259779 secs 2024-04-21T13:37:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:34 smithi170 ceph-mon[31212]: pgmap v6260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11565.259779 secs 2024-04-21T13:37:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:34 smithi077 ceph-mon[27902]: pgmap v6260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11565.259779 secs 2024-04-21T13:37:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:34 smithi191 ceph-mon[31636]: pgmap v6260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:36 smithi170 ceph-mon[31212]: pgmap v6261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:36 smithi077 ceph-mon[27902]: pgmap v6261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:36 smithi191 ceph-mon[31636]: pgmap v6261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11568.499631 secs 2024-04-21T13:37:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11568.499631 secs 2024-04-21T13:37:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11568.499631 secs 2024-04-21T13:37:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:38 smithi077 ceph-mon[27902]: pgmap v6262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:38 smithi191 ceph-mon[31636]: pgmap v6262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:38 smithi170 ceph-mon[31212]: pgmap v6262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11570.259898 secs 2024-04-21T13:37:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11570.259898 secs 2024-04-21T13:37:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11570.259898 secs 2024-04-21T13:37:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:40 smithi077 ceph-mon[27902]: pgmap v6263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:40 smithi191 ceph-mon[31636]: pgmap v6263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:40 smithi170 ceph-mon[31212]: pgmap v6263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: pgmap v6264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11573.499748 secs 2024-04-21T13:37:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:37:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: pgmap v6264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11573.499748 secs 2024-04-21T13:37:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:37:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: pgmap v6264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11573.499748 secs 2024-04-21T13:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:37:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:37:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:37:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:37:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:37:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:37:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:37:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11575.259958 secs 2024-04-21T13:37:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:44 smithi077 ceph-mon[27902]: pgmap v6265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11575.259958 secs 2024-04-21T13:37:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:44 smithi191 ceph-mon[31636]: pgmap v6265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11575.259958 secs 2024-04-21T13:37:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:44 smithi170 ceph-mon[31212]: pgmap v6265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:46 smithi077 ceph-mon[27902]: pgmap v6266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:46 smithi191 ceph-mon[31636]: pgmap v6266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:46 smithi170 ceph-mon[31212]: pgmap v6266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11578.499862 secs 2024-04-21T13:37:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11578.499862 secs 2024-04-21T13:37:48.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11578.499862 secs 2024-04-21T13:37:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:48 smithi077 ceph-mon[27902]: pgmap v6267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:48 smithi191 ceph-mon[31636]: pgmap v6267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:48 smithi170 ceph-mon[31212]: pgmap v6267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11580.260106 secs 2024-04-21T13:37:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11580.260106 secs 2024-04-21T13:37:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11580.260106 secs 2024-04-21T13:37:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:50 smithi077 ceph-mon[27902]: pgmap v6268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:50 smithi191 ceph-mon[31636]: pgmap v6268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:50 smithi170 ceph-mon[31212]: pgmap v6268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:52 smithi077 ceph-mon[27902]: pgmap v6269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11583.499945 secs 2024-04-21T13:37:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:52 smithi191 ceph-mon[31636]: pgmap v6269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11583.499945 secs 2024-04-21T13:37:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:52 smithi170 ceph-mon[31212]: pgmap v6269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11583.499945 secs 2024-04-21T13:37:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:53 smithi077 ceph-mon[27902]: pgmap v6270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:53 smithi191 ceph-mon[31636]: pgmap v6270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:53 smithi170 ceph-mon[31212]: pgmap v6270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:37:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11585.260221 secs 2024-04-21T13:37:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11585.260221 secs 2024-04-21T13:37:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11585.260221 secs 2024-04-21T13:37:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:37:55.952+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:37:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:37:55.952+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:37:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:37:55.953+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:37:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:37:55.953+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:37:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:55 smithi077 ceph-mon[27902]: pgmap v6271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:55 smithi191 ceph-mon[31636]: pgmap v6271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:55 smithi170 ceph-mon[31212]: pgmap v6271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:37:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11588.500058 secs 2024-04-21T13:37:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11588.500058 secs 2024-04-21T13:37:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11588.500058 secs 2024-04-21T13:37:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:58 smithi191 ceph-mon[31636]: pgmap v6272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:58.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:58 smithi077 ceph-mon[27902]: pgmap v6272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:58 smithi170 ceph-mon[31212]: pgmap v6272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:37:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11590.260334 secs 2024-04-21T13:37:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11590.260334 secs 2024-04-21T13:37:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11590.260334 secs 2024-04-21T13:38:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:00 smithi191 ceph-mon[31636]: pgmap v6273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:00 smithi170 ceph-mon[31212]: pgmap v6273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:00 smithi077 ceph-mon[27902]: pgmap v6273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:02 smithi077 ceph-mon[27902]: pgmap v6274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11593.500126 secs 2024-04-21T13:38:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:02 smithi191 ceph-mon[31636]: pgmap v6274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11593.500126 secs 2024-04-21T13:38:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:02 smithi170 ceph-mon[31212]: pgmap v6274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11593.500126 secs 2024-04-21T13:38:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11595.260449 secs 2024-04-21T13:38:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:04 smithi077 ceph-mon[27902]: pgmap v6275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:04 smithi077 ceph-mon[27902]: osdmap e463: 12 total, 12 up, 12 in 2024-04-21T13:38:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11595.260449 secs 2024-04-21T13:38:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:04 smithi191 ceph-mon[31636]: pgmap v6275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:04 smithi191 ceph-mon[31636]: osdmap e463: 12 total, 12 up, 12 in 2024-04-21T13:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11595.260449 secs 2024-04-21T13:38:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:04 smithi170 ceph-mon[31212]: pgmap v6275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:04 smithi170 ceph-mon[31212]: osdmap e463: 12 total, 12 up, 12 in 2024-04-21T13:38:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:06 smithi077 ceph-mon[27902]: pgmap v6277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:38:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:06 smithi191 ceph-mon[31636]: pgmap v6277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:38:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:06 smithi170 ceph-mon[31212]: pgmap v6277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:38:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11598.500246 secs 2024-04-21T13:38:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11598.500246 secs 2024-04-21T13:38:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11598.500246 secs 2024-04-21T13:38:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:08 smithi077 ceph-mon[27902]: pgmap v6278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:38:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:08 smithi191 ceph-mon[31636]: pgmap v6278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:38:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:08 smithi170 ceph-mon[31212]: pgmap v6278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:38:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11600.260522 secs 2024-04-21T13:38:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:09 smithi170 ceph-mon[31212]: osdmap e464: 12 total, 12 up, 12 in 2024-04-21T13:38:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11600.260522 secs 2024-04-21T13:38:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:09 smithi077 ceph-mon[27902]: osdmap e464: 12 total, 12 up, 12 in 2024-04-21T13:38:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11600.260522 secs 2024-04-21T13:38:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:09 smithi191 ceph-mon[31636]: osdmap e464: 12 total, 12 up, 12 in 2024-04-21T13:38:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:10 smithi170 ceph-mon[31212]: pgmap v6280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:38:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:10 smithi077 ceph-mon[27902]: pgmap v6280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:38:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:10 smithi191 ceph-mon[31636]: pgmap v6280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:38:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:12 smithi170 ceph-mon[31212]: pgmap v6281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:38:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11603.500317 secs 2024-04-21T13:38:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:12 smithi077 ceph-mon[27902]: pgmap v6281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:38:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11603.500317 secs 2024-04-21T13:38:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:12 smithi191 ceph-mon[31636]: pgmap v6281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:38:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11603.500317 secs 2024-04-21T13:38:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11605.260633 secs 2024-04-21T13:38:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:14 smithi170 ceph-mon[31212]: pgmap v6282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:38:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11605.260633 secs 2024-04-21T13:38:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:14 smithi077 ceph-mon[27902]: pgmap v6282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:38:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11605.260633 secs 2024-04-21T13:38:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:14 smithi191 ceph-mon[31636]: pgmap v6282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:38:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:16 smithi170 ceph-mon[31212]: pgmap v6283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:38:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:16 smithi077 ceph-mon[27902]: pgmap v6283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:38:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:16 smithi191 ceph-mon[31636]: pgmap v6283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:38:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11608.500428 secs 2024-04-21T13:38:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11608.500428 secs 2024-04-21T13:38:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11608.500428 secs 2024-04-21T13:38:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:18 smithi170 ceph-mon[31212]: pgmap v6284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:38:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:18 smithi077 ceph-mon[27902]: pgmap v6284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:38:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:18 smithi191 ceph-mon[31636]: pgmap v6284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:38:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11610.260730 secs 2024-04-21T13:38:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11610.260730 secs 2024-04-21T13:38:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11610.260730 secs 2024-04-21T13:38:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:20 smithi170 ceph-mon[31212]: pgmap v6285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:38:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:20 smithi077 ceph-mon[27902]: pgmap v6285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:38:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:20 smithi191 ceph-mon[31636]: pgmap v6285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:38:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:22 smithi170 ceph-mon[31212]: pgmap v6286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:38:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11613.500558 secs 2024-04-21T13:38:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:22 smithi077 ceph-mon[27902]: pgmap v6286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:38:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11613.500558 secs 2024-04-21T13:38:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:22 smithi191 ceph-mon[31636]: pgmap v6286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:38:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11613.500558 secs 2024-04-21T13:38:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11615.260840 secs 2024-04-21T13:38:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:24 smithi170 ceph-mon[31212]: pgmap v6287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11615.260840 secs 2024-04-21T13:38:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:24 smithi077 ceph-mon[27902]: pgmap v6287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11615.260840 secs 2024-04-21T13:38:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:24 smithi191 ceph-mon[31636]: pgmap v6287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:26 smithi170 ceph-mon[31212]: pgmap v6288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:26 smithi077 ceph-mon[27902]: pgmap v6288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:26 smithi191 ceph-mon[31636]: pgmap v6288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11618.500695 secs 2024-04-21T13:38:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11618.500695 secs 2024-04-21T13:38:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11618.500695 secs 2024-04-21T13:38:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:28 smithi170 ceph-mon[31212]: pgmap v6289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:28 smithi077 ceph-mon[27902]: pgmap v6289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:28 smithi191 ceph-mon[31636]: pgmap v6289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11620.260870 secs 2024-04-21T13:38:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11620.260870 secs 2024-04-21T13:38:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11620.260870 secs 2024-04-21T13:38:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:30 smithi170 ceph-mon[31212]: pgmap v6290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:30 smithi077 ceph-mon[27902]: pgmap v6290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:30 smithi191 ceph-mon[31636]: pgmap v6290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:32 smithi170 ceph-mon[31212]: pgmap v6291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11623.500839 secs 2024-04-21T13:38:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:32 smithi077 ceph-mon[27902]: pgmap v6291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11623.500839 secs 2024-04-21T13:38:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:32 smithi191 ceph-mon[31636]: pgmap v6291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11623.500839 secs 2024-04-21T13:38:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11625.260964 secs 2024-04-21T13:38:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:34 smithi170 ceph-mon[31212]: pgmap v6292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11625.260964 secs 2024-04-21T13:38:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:34 smithi077 ceph-mon[27902]: pgmap v6292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11625.260964 secs 2024-04-21T13:38:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:34 smithi191 ceph-mon[31636]: pgmap v6292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:36 smithi170 ceph-mon[31212]: pgmap v6293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:36 smithi077 ceph-mon[27902]: pgmap v6293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:36 smithi191 ceph-mon[31636]: pgmap v6293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11628.500948 secs 2024-04-21T13:38:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11628.500948 secs 2024-04-21T13:38:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11628.500948 secs 2024-04-21T13:38:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:38 smithi170 ceph-mon[31212]: pgmap v6294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:38 smithi077 ceph-mon[27902]: pgmap v6294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:38 smithi191 ceph-mon[31636]: pgmap v6294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11630.261079 secs 2024-04-21T13:38:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11630.261079 secs 2024-04-21T13:38:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11630.261079 secs 2024-04-21T13:38:40.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:38:40.960+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:38:40.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:38:40.960+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:38:40.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:38:40.960+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:38:40.959 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:38:40.960+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:38:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:40 smithi170 ceph-mon[31212]: pgmap v6295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:40 smithi077 ceph-mon[27902]: pgmap v6295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:40 smithi191 ceph-mon[31636]: pgmap v6295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:42 smithi170 ceph-mon[31212]: pgmap v6296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11633.501041 secs 2024-04-21T13:38:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:42 smithi077 ceph-mon[27902]: pgmap v6296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11633.501041 secs 2024-04-21T13:38:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:42 smithi191 ceph-mon[31636]: pgmap v6296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11633.501041 secs 2024-04-21T13:38:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:38:44.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:38:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:38:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:38:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:38:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:38:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:38:44.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:38:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:38:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:38:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:38:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:38:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11635.261168 secs 2024-04-21T13:38:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:44 smithi170 ceph-mon[31212]: pgmap v6297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11635.261168 secs 2024-04-21T13:38:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:44 smithi077 ceph-mon[27902]: pgmap v6297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11635.261168 secs 2024-04-21T13:38:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:44 smithi191 ceph-mon[31636]: pgmap v6297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:46 smithi170 ceph-mon[31212]: pgmap v6298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:46 smithi077 ceph-mon[27902]: pgmap v6298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:46 smithi191 ceph-mon[31636]: pgmap v6298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11638.501133 secs 2024-04-21T13:38:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11638.501133 secs 2024-04-21T13:38:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11638.501133 secs 2024-04-21T13:38:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:48 smithi077 ceph-mon[27902]: pgmap v6299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:49.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:48 smithi170 ceph-mon[31212]: pgmap v6299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:48 smithi191 ceph-mon[31636]: pgmap v6299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11640.261282 secs 2024-04-21T13:38:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11640.261282 secs 2024-04-21T13:38:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11640.261282 secs 2024-04-21T13:38:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:50 smithi077 ceph-mon[27902]: pgmap v6300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:50 smithi191 ceph-mon[31636]: pgmap v6300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:50 smithi170 ceph-mon[31212]: pgmap v6300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:38:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:52 smithi077 ceph-mon[27902]: pgmap v6301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11643.501255 secs 2024-04-21T13:38:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:52 smithi191 ceph-mon[31636]: pgmap v6301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11643.501255 secs 2024-04-21T13:38:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:52 smithi170 ceph-mon[31212]: pgmap v6301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11643.501255 secs 2024-04-21T13:38:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:38:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11645.261379 secs 2024-04-21T13:38:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:54 smithi077 ceph-mon[27902]: pgmap v6302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11645.261379 secs 2024-04-21T13:38:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:54 smithi191 ceph-mon[31636]: pgmap v6302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11645.261379 secs 2024-04-21T13:38:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:54 smithi170 ceph-mon[31212]: pgmap v6302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:56 smithi077 ceph-mon[27902]: pgmap v6303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:56 smithi191 ceph-mon[31636]: pgmap v6303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:56 smithi170 ceph-mon[31212]: pgmap v6303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:38:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11648.501376 secs 2024-04-21T13:38:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11648.501376 secs 2024-04-21T13:38:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11648.501376 secs 2024-04-21T13:38:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:58 smithi077 ceph-mon[27902]: pgmap v6304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:58 smithi191 ceph-mon[31636]: pgmap v6304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:38:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:58 smithi170 ceph-mon[31212]: pgmap v6304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11650.261496 secs 2024-04-21T13:39:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11650.261496 secs 2024-04-21T13:39:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11650.261496 secs 2024-04-21T13:39:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:00 smithi077 ceph-mon[27902]: pgmap v6305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:00 smithi191 ceph-mon[31636]: pgmap v6305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:00 smithi170 ceph-mon[31212]: pgmap v6305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:02 smithi077 ceph-mon[27902]: pgmap v6306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11653.501532 secs 2024-04-21T13:39:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:02 smithi191 ceph-mon[31636]: pgmap v6306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11653.501532 secs 2024-04-21T13:39:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:02 smithi170 ceph-mon[31212]: pgmap v6306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11653.501532 secs 2024-04-21T13:39:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11655.261606 secs 2024-04-21T13:39:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:04 smithi077 ceph-mon[27902]: pgmap v6307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:04 smithi077 ceph-mon[27902]: osdmap e465: 12 total, 12 up, 12 in 2024-04-21T13:39:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11655.261606 secs 2024-04-21T13:39:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:04 smithi191 ceph-mon[31636]: pgmap v6307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:04 smithi191 ceph-mon[31636]: osdmap e465: 12 total, 12 up, 12 in 2024-04-21T13:39:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11655.261606 secs 2024-04-21T13:39:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:04 smithi170 ceph-mon[31212]: pgmap v6307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:04 smithi170 ceph-mon[31212]: osdmap e465: 12 total, 12 up, 12 in 2024-04-21T13:39:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:06 smithi077 ceph-mon[27902]: pgmap v6309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:39:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:06 smithi191 ceph-mon[31636]: pgmap v6309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:39:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:06 smithi170 ceph-mon[31212]: pgmap v6309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:39:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11658.501642 secs 2024-04-21T13:39:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:07 smithi077 ceph-mon[27902]: pgmap v6310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:39:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11658.501642 secs 2024-04-21T13:39:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:07 smithi191 ceph-mon[31636]: pgmap v6310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:39:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11658.501642 secs 2024-04-21T13:39:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:07 smithi170 ceph-mon[31212]: pgmap v6310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:39:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11660.261724 secs 2024-04-21T13:39:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:09 smithi170 ceph-mon[31212]: osdmap e466: 12 total, 12 up, 12 in 2024-04-21T13:39:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11660.261724 secs 2024-04-21T13:39:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:09 smithi077 ceph-mon[27902]: osdmap e466: 12 total, 12 up, 12 in 2024-04-21T13:39:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11660.261724 secs 2024-04-21T13:39:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:09 smithi191 ceph-mon[31636]: osdmap e466: 12 total, 12 up, 12 in 2024-04-21T13:39:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:10 smithi170 ceph-mon[31212]: pgmap v6312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:39:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:10 smithi077 ceph-mon[27902]: pgmap v6312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:39:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:10 smithi191 ceph-mon[31636]: pgmap v6312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:39:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:12 smithi170 ceph-mon[31212]: pgmap v6313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:39:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11663.501800 secs 2024-04-21T13:39:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:12 smithi077 ceph-mon[27902]: pgmap v6313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:39:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11663.501800 secs 2024-04-21T13:39:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:12 smithi191 ceph-mon[31636]: pgmap v6313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:39:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11663.501800 secs 2024-04-21T13:39:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11665.261849 secs 2024-04-21T13:39:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:14 smithi170 ceph-mon[31212]: pgmap v6314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:39:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11665.261849 secs 2024-04-21T13:39:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:14 smithi077 ceph-mon[27902]: pgmap v6314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:39:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11665.261849 secs 2024-04-21T13:39:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:14 smithi191 ceph-mon[31636]: pgmap v6314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:39:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:16 smithi170 ceph-mon[31212]: pgmap v6315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:39:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:16 smithi077 ceph-mon[27902]: pgmap v6315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:39:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:16 smithi191 ceph-mon[31636]: pgmap v6315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:39:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11668.501921 secs 2024-04-21T13:39:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11668.501921 secs 2024-04-21T13:39:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11668.501921 secs 2024-04-21T13:39:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:18 smithi170 ceph-mon[31212]: pgmap v6316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:39:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:18 smithi077 ceph-mon[27902]: pgmap v6316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:39:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:18 smithi191 ceph-mon[31636]: pgmap v6316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:39:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11670.262000 secs 2024-04-21T13:39:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11670.262000 secs 2024-04-21T13:39:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11670.262000 secs 2024-04-21T13:39:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:20 smithi170 ceph-mon[31212]: pgmap v6317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:39:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:20 smithi077 ceph-mon[27902]: pgmap v6317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:39:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:20 smithi191 ceph-mon[31636]: pgmap v6317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:39:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:22 smithi170 ceph-mon[31212]: pgmap v6318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:39:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11673.502042 secs 2024-04-21T13:39:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:22 smithi077 ceph-mon[27902]: pgmap v6318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:39:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11673.502042 secs 2024-04-21T13:39:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:22 smithi191 ceph-mon[31636]: pgmap v6318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:39:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11673.502042 secs 2024-04-21T13:39:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11675.262141 secs 2024-04-21T13:39:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:24 smithi170 ceph-mon[31212]: pgmap v6319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11675.262141 secs 2024-04-21T13:39:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:24 smithi077 ceph-mon[27902]: pgmap v6319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11675.262141 secs 2024-04-21T13:39:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:24 smithi191 ceph-mon[31636]: pgmap v6319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:26 smithi170 ceph-mon[31212]: pgmap v6320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:26 smithi077 ceph-mon[27902]: pgmap v6320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:26 smithi191 ceph-mon[31636]: pgmap v6320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11678.502171 secs 2024-04-21T13:39:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11678.502171 secs 2024-04-21T13:39:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11678.502171 secs 2024-04-21T13:39:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:28 smithi170 ceph-mon[31212]: pgmap v6321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:28 smithi077 ceph-mon[27902]: pgmap v6321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:28 smithi191 ceph-mon[31636]: pgmap v6321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11680.262262 secs 2024-04-21T13:39:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11680.262262 secs 2024-04-21T13:39:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11680.262262 secs 2024-04-21T13:39:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:30 smithi170 ceph-mon[31212]: pgmap v6322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:30 smithi077 ceph-mon[27902]: pgmap v6322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:30 smithi191 ceph-mon[31636]: pgmap v6322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:32 smithi170 ceph-mon[31212]: pgmap v6323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11683.502285 secs 2024-04-21T13:39:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:32 smithi077 ceph-mon[27902]: pgmap v6323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11683.502285 secs 2024-04-21T13:39:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:32 smithi191 ceph-mon[31636]: pgmap v6323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11683.502285 secs 2024-04-21T13:39:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11685.262390 secs 2024-04-21T13:39:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:34 smithi170 ceph-mon[31212]: pgmap v6324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11685.262390 secs 2024-04-21T13:39:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:34 smithi077 ceph-mon[27902]: pgmap v6324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11685.262390 secs 2024-04-21T13:39:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:34 smithi191 ceph-mon[31636]: pgmap v6324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:36 smithi170 ceph-mon[31212]: pgmap v6325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:36 smithi077 ceph-mon[27902]: pgmap v6325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:36 smithi191 ceph-mon[31636]: pgmap v6325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11688.502405 secs 2024-04-21T13:39:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11688.502405 secs 2024-04-21T13:39:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11688.502405 secs 2024-04-21T13:39:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:38 smithi170 ceph-mon[31212]: pgmap v6326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:38 smithi077 ceph-mon[27902]: pgmap v6326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:38 smithi191 ceph-mon[31636]: pgmap v6326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11690.262529 secs 2024-04-21T13:39:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11690.262529 secs 2024-04-21T13:39:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11690.262529 secs 2024-04-21T13:39:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:40 smithi077 ceph-mon[27902]: pgmap v6327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:40 smithi191 ceph-mon[31636]: pgmap v6327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:40 smithi170 ceph-mon[31212]: pgmap v6327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:42 smithi077 ceph-mon[27902]: pgmap v6328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11693.502544 secs 2024-04-21T13:39:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:42 smithi191 ceph-mon[31636]: pgmap v6328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11693.502544 secs 2024-04-21T13:39:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:42 smithi170 ceph-mon[31212]: pgmap v6328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11693.502544 secs 2024-04-21T13:39:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11695.262667 secs 2024-04-21T13:39:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:44 smithi077 ceph-mon[27902]: pgmap v6329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:39:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:39:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:39:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11695.262667 secs 2024-04-21T13:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:44 smithi191 ceph-mon[31636]: pgmap v6329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:39:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:39:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11695.262667 secs 2024-04-21T13:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:44 smithi170 ceph-mon[31212]: pgmap v6329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:39:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:46 smithi077 ceph-mon[27902]: pgmap v6330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:46 smithi191 ceph-mon[31636]: pgmap v6330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:46 smithi170 ceph-mon[31212]: pgmap v6330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11698.502681 secs 2024-04-21T13:39:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11698.502681 secs 2024-04-21T13:39:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11698.502681 secs 2024-04-21T13:39:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:48 smithi077 ceph-mon[27902]: pgmap v6331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:48 smithi170 ceph-mon[31212]: pgmap v6331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:48 smithi191 ceph-mon[31636]: pgmap v6331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11700.262789 secs 2024-04-21T13:39:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11700.262789 secs 2024-04-21T13:39:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11700.262789 secs 2024-04-21T13:39:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:50 smithi077 ceph-mon[27902]: pgmap v6332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:50 smithi191 ceph-mon[31636]: pgmap v6332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:50 smithi170 ceph-mon[31212]: pgmap v6332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:52 smithi077 ceph-mon[27902]: pgmap v6333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11703.502800 secs 2024-04-21T13:39:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:52 smithi191 ceph-mon[31636]: pgmap v6333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11703.502800 secs 2024-04-21T13:39:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:52 smithi170 ceph-mon[31212]: pgmap v6333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11703.502800 secs 2024-04-21T13:39:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:39:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11705.262924 secs 2024-04-21T13:39:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:54 smithi077 ceph-mon[27902]: pgmap v6334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11705.262924 secs 2024-04-21T13:39:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:54 smithi191 ceph-mon[31636]: pgmap v6334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11705.262924 secs 2024-04-21T13:39:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:54 smithi170 ceph-mon[31212]: pgmap v6334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:56 smithi077 ceph-mon[27902]: pgmap v6335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:56 smithi191 ceph-mon[31636]: pgmap v6335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:56 smithi170 ceph-mon[31212]: pgmap v6335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:39:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11708.502929 secs 2024-04-21T13:39:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11708.502929 secs 2024-04-21T13:39:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11708.502929 secs 2024-04-21T13:39:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:58 smithi077 ceph-mon[27902]: pgmap v6336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:58 smithi191 ceph-mon[31636]: pgmap v6336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:39:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:58 smithi170 ceph-mon[31212]: pgmap v6336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11710.263036 secs 2024-04-21T13:40:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11710.263036 secs 2024-04-21T13:40:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11710.263036 secs 2024-04-21T13:40:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:00 smithi077 ceph-mon[27902]: pgmap v6337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:40:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:00 smithi191 ceph-mon[31636]: pgmap v6337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:00 smithi170 ceph-mon[31212]: pgmap v6337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:40:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:02 smithi077 ceph-mon[27902]: pgmap v6338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11713.503066 secs 2024-04-21T13:40:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:02 smithi191 ceph-mon[31636]: pgmap v6338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11713.503066 secs 2024-04-21T13:40:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:02 smithi170 ceph-mon[31212]: pgmap v6338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11713.503066 secs 2024-04-21T13:40:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11715.263154 secs 2024-04-21T13:40:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:04 smithi077 ceph-mon[27902]: pgmap v6339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:04 smithi077 ceph-mon[27902]: osdmap e467: 12 total, 12 up, 12 in 2024-04-21T13:40:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11715.263154 secs 2024-04-21T13:40:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:04 smithi191 ceph-mon[31636]: pgmap v6339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:04 smithi191 ceph-mon[31636]: osdmap e467: 12 total, 12 up, 12 in 2024-04-21T13:40:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11715.263154 secs 2024-04-21T13:40:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:04 smithi170 ceph-mon[31212]: pgmap v6339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:04 smithi170 ceph-mon[31212]: osdmap e467: 12 total, 12 up, 12 in 2024-04-21T13:40:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:06 smithi077 ceph-mon[27902]: pgmap v6341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:40:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:06 smithi191 ceph-mon[31636]: pgmap v6341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:40:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:06 smithi170 ceph-mon[31212]: pgmap v6341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:40:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11718.503135 secs 2024-04-21T13:40:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:07 smithi077 ceph-mon[27902]: pgmap v6342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:40:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11718.503135 secs 2024-04-21T13:40:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:07 smithi191 ceph-mon[31636]: pgmap v6342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:40:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11718.503135 secs 2024-04-21T13:40:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:07 smithi170 ceph-mon[31212]: pgmap v6342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:40:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11720.263215 secs 2024-04-21T13:40:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:09 smithi170 ceph-mon[31212]: osdmap e468: 12 total, 12 up, 12 in 2024-04-21T13:40:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11720.263215 secs 2024-04-21T13:40:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:09 smithi077 ceph-mon[27902]: osdmap e468: 12 total, 12 up, 12 in 2024-04-21T13:40:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11720.263215 secs 2024-04-21T13:40:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:09 smithi191 ceph-mon[31636]: osdmap e468: 12 total, 12 up, 12 in 2024-04-21T13:40:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:10 smithi170 ceph-mon[31212]: pgmap v6344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:40:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:10 smithi077 ceph-mon[27902]: pgmap v6344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:40:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:10 smithi191 ceph-mon[31636]: pgmap v6344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:40:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:12 smithi170 ceph-mon[31212]: pgmap v6345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:40:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11723.503254 secs 2024-04-21T13:40:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:12 smithi077 ceph-mon[27902]: pgmap v6345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:40:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11723.503254 secs 2024-04-21T13:40:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:12 smithi191 ceph-mon[31636]: pgmap v6345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:40:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11723.503254 secs 2024-04-21T13:40:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11725.263335 secs 2024-04-21T13:40:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:14 smithi170 ceph-mon[31212]: pgmap v6346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:40:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11725.263335 secs 2024-04-21T13:40:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:14 smithi077 ceph-mon[27902]: pgmap v6346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:40:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11725.263335 secs 2024-04-21T13:40:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:14 smithi191 ceph-mon[31636]: pgmap v6346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T13:40:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:16 smithi170 ceph-mon[31212]: pgmap v6347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:40:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:16 smithi077 ceph-mon[27902]: pgmap v6347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:40:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:16 smithi191 ceph-mon[31636]: pgmap v6347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:40:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11728.503383 secs 2024-04-21T13:40:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11728.503383 secs 2024-04-21T13:40:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11728.503383 secs 2024-04-21T13:40:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:18 smithi170 ceph-mon[31212]: pgmap v6348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:40:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:18 smithi077 ceph-mon[27902]: pgmap v6348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:40:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:18 smithi191 ceph-mon[31636]: pgmap v6348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:40:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11730.263443 secs 2024-04-21T13:40:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11730.263443 secs 2024-04-21T13:40:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11730.263443 secs 2024-04-21T13:40:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:20 smithi170 ceph-mon[31212]: pgmap v6349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:40:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:20 smithi077 ceph-mon[27902]: pgmap v6349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:40:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:20 smithi191 ceph-mon[31636]: pgmap v6349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:40:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:22 smithi170 ceph-mon[31212]: pgmap v6350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:40:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11733.503501 secs 2024-04-21T13:40:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:22 smithi077 ceph-mon[27902]: pgmap v6350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:40:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11733.503501 secs 2024-04-21T13:40:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:22 smithi191 ceph-mon[31636]: pgmap v6350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:40:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11733.503501 secs 2024-04-21T13:40:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11735.263565 secs 2024-04-21T13:40:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:24 smithi170 ceph-mon[31212]: pgmap v6351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11735.263565 secs 2024-04-21T13:40:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:24 smithi077 ceph-mon[27902]: pgmap v6351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11735.263565 secs 2024-04-21T13:40:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:24 smithi191 ceph-mon[31636]: pgmap v6351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:26 smithi170 ceph-mon[31212]: pgmap v6352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:26 smithi077 ceph-mon[27902]: pgmap v6352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:26 smithi191 ceph-mon[31636]: pgmap v6352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11738.503595 secs 2024-04-21T13:40:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11738.503595 secs 2024-04-21T13:40:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11738.503595 secs 2024-04-21T13:40:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:28 smithi170 ceph-mon[31212]: pgmap v6353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:28 smithi077 ceph-mon[27902]: pgmap v6353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:28 smithi191 ceph-mon[31636]: pgmap v6353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11740.263626 secs 2024-04-21T13:40:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11740.263626 secs 2024-04-21T13:40:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11740.263626 secs 2024-04-21T13:40:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:30 smithi170 ceph-mon[31212]: pgmap v6354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:30 smithi077 ceph-mon[27902]: pgmap v6354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:30 smithi191 ceph-mon[31636]: pgmap v6354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:32 smithi170 ceph-mon[31212]: pgmap v6355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11743.503732 secs 2024-04-21T13:40:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:32 smithi077 ceph-mon[27902]: pgmap v6355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11743.503732 secs 2024-04-21T13:40:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:32 smithi191 ceph-mon[31636]: pgmap v6355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11743.503732 secs 2024-04-21T13:40:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11745.263739 secs 2024-04-21T13:40:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:34 smithi170 ceph-mon[31212]: pgmap v6356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:35.073 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11745.263739 secs 2024-04-21T13:40:35.074 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:34 smithi077 ceph-mon[27902]: pgmap v6356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11745.263739 secs 2024-04-21T13:40:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:34 smithi191 ceph-mon[31636]: pgmap v6356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:36 smithi077 ceph-mon[27902]: pgmap v6357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:36 smithi191 ceph-mon[31636]: pgmap v6357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:36 smithi170 ceph-mon[31212]: pgmap v6357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11748.503844 secs 2024-04-21T13:40:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11748.503844 secs 2024-04-21T13:40:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11748.503844 secs 2024-04-21T13:40:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:38 smithi077 ceph-mon[27902]: pgmap v6358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:38 smithi191 ceph-mon[31636]: pgmap v6358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:38 smithi170 ceph-mon[31212]: pgmap v6358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11750.263879 secs 2024-04-21T13:40:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11750.263879 secs 2024-04-21T13:40:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11750.263879 secs 2024-04-21T13:40:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:40 smithi077 ceph-mon[27902]: pgmap v6359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:40 smithi191 ceph-mon[31636]: pgmap v6359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:40 smithi170 ceph-mon[31212]: pgmap v6359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:42 smithi077 ceph-mon[27902]: pgmap v6360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11753.503954 secs 2024-04-21T13:40:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:42 smithi191 ceph-mon[31636]: pgmap v6360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11753.503954 secs 2024-04-21T13:40:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:42 smithi170 ceph-mon[31212]: pgmap v6360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11753.503954 secs 2024-04-21T13:40:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11755.264032 secs 2024-04-21T13:40:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:44 smithi077 ceph-mon[27902]: pgmap v6361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:40:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11755.264032 secs 2024-04-21T13:40:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:44 smithi191 ceph-mon[31636]: pgmap v6361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:40:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11755.264032 secs 2024-04-21T13:40:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:44 smithi170 ceph-mon[31212]: pgmap v6361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:40:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:40:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:40:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:40:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:40:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:40:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:40:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:40:46.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:40:46.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:40:47.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:46 smithi077 ceph-mon[27902]: pgmap v6362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:46 smithi191 ceph-mon[31636]: pgmap v6362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:46 smithi170 ceph-mon[31212]: pgmap v6362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11758.504078 secs 2024-04-21T13:40:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11758.504078 secs 2024-04-21T13:40:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11758.504078 secs 2024-04-21T13:40:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:48 smithi077 ceph-mon[27902]: pgmap v6363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:48 smithi170 ceph-mon[31212]: pgmap v6363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:48 smithi191 ceph-mon[31636]: pgmap v6363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 11760.264103 secs 2024-04-21T13:40:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:49 smithi077 ceph-mon[27902]: slow request 11521.717912 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:40:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:49 smithi077 ceph-mon[27902]: slow request 11521.706755 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:49 smithi077 ceph-mon[27902]: slow request 11521.658572 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:49 smithi077 ceph-mon[27902]: slow request 11521.627522 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:49 smithi077 ceph-mon[27902]: slow request 11521.583961 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 11760.264103 secs 2024-04-21T13:40:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:49 smithi191 ceph-mon[31636]: slow request 11521.717912 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:40:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:49 smithi191 ceph-mon[31636]: slow request 11521.706755 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:49 smithi191 ceph-mon[31636]: slow request 11521.658572 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:49 smithi191 ceph-mon[31636]: slow request 11521.627522 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:49 smithi191 ceph-mon[31636]: slow request 11521.583961 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 11760.264103 secs 2024-04-21T13:40:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:49 smithi170 ceph-mon[31212]: slow request 11521.717912 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:40:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:49 smithi170 ceph-mon[31212]: slow request 11521.706755 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:49 smithi170 ceph-mon[31212]: slow request 11521.658572 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:49 smithi170 ceph-mon[31212]: slow request 11521.627522 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:49 smithi170 ceph-mon[31212]: slow request 11521.583961 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:50 smithi077 ceph-mon[27902]: pgmap v6364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:50 smithi191 ceph-mon[31636]: pgmap v6364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:50 smithi170 ceph-mon[31212]: pgmap v6364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:52 smithi077 ceph-mon[27902]: pgmap v6365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11763.504195 secs 2024-04-21T13:40:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:52 smithi191 ceph-mon[31636]: pgmap v6365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11763.504195 secs 2024-04-21T13:40:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:52 smithi170 ceph-mon[31212]: pgmap v6365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11763.504195 secs 2024-04-21T13:40:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 11765.264221 secs 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: slow request 11526.456768 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: slow request 11526.447023 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: slow request 11526.428030 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: slow request 11526.426014 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: slow request 11526.418028 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:54 smithi077 ceph-mon[27902]: pgmap v6366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 11765.264221 secs 2024-04-21T13:40:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: slow request 11526.456768 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: slow request 11526.447023 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: slow request 11526.428030 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: slow request 11526.426014 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: slow request 11526.418028 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:54 smithi191 ceph-mon[31636]: pgmap v6366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 11765.264221 secs 2024-04-21T13:40:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: slow request 11526.456768 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: slow request 11526.447023 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: slow request 11526.428030 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: slow request 11526.426014 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: slow request 11526.418028 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:54 smithi170 ceph-mon[31212]: pgmap v6366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:40:55.978+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:40:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:40:55.978+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:40:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:40:55.978+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:40:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:40:55.978+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:40:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:56 smithi077 ceph-mon[27902]: pgmap v6367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:56 smithi191 ceph-mon[31636]: pgmap v6367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:56 smithi170 ceph-mon[31212]: pgmap v6367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:40:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11768.504259 secs 2024-04-21T13:40:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11768.504259 secs 2024-04-21T13:40:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11768.504259 secs 2024-04-21T13:40:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:58 smithi077 ceph-mon[27902]: pgmap v6368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:58 smithi191 ceph-mon[31636]: pgmap v6368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:40:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:58 smithi170 ceph-mon[31212]: pgmap v6368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 11770.264336 secs 2024-04-21T13:41:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:59 smithi077 ceph-mon[27902]: slow request 11531.411291 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:59 smithi077 ceph-mon[27902]: slow request 11531.402285 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:59 smithi077 ceph-mon[27902]: slow request 11531.397176 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:59 smithi077 ceph-mon[27902]: slow request 11531.381666 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:40:59 smithi077 ceph-mon[27902]: slow request 11531.372979 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 11770.264336 secs 2024-04-21T13:41:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:59 smithi191 ceph-mon[31636]: slow request 11531.411291 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:59 smithi191 ceph-mon[31636]: slow request 11531.402285 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:59 smithi191 ceph-mon[31636]: slow request 11531.397176 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:59 smithi191 ceph-mon[31636]: slow request 11531.381666 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:40:59 smithi191 ceph-mon[31636]: slow request 11531.372979 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 11770.264336 secs 2024-04-21T13:41:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:59 smithi170 ceph-mon[31212]: slow request 11531.411291 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:59 smithi170 ceph-mon[31212]: slow request 11531.402285 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:59 smithi170 ceph-mon[31212]: slow request 11531.397176 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:59 smithi170 ceph-mon[31212]: slow request 11531.381666 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:40:59 smithi170 ceph-mon[31212]: slow request 11531.372979 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T13:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:00 smithi077 ceph-mon[27902]: pgmap v6369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:00 smithi191 ceph-mon[31636]: pgmap v6369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:00 smithi170 ceph-mon[31212]: pgmap v6369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:02 smithi077 ceph-mon[27902]: pgmap v6370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:41:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11773.504378 secs 2024-04-21T13:41:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:02 smithi191 ceph-mon[31636]: pgmap v6370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:41:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11773.504378 secs 2024-04-21T13:41:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:02 smithi170 ceph-mon[31212]: pgmap v6370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:41:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11773.504378 secs 2024-04-21T13:41:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:03 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 11775.264404 secs 2024-04-21T13:41:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:03 smithi191 ceph-mon[31636]: slow request 11521.556287 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:03 smithi191 ceph-mon[31636]: slow request 11531.474482 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:03 smithi191 ceph-mon[31636]: slow request 11531.459611 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:03 smithi191 ceph-mon[31636]: pgmap v6371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:41:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:03 smithi191 ceph-mon[31636]: osdmap e469: 12 total, 12 up, 12 in 2024-04-21T13:41:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:03 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 11775.264404 secs 2024-04-21T13:41:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:03 smithi170 ceph-mon[31212]: slow request 11521.556287 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:03 smithi170 ceph-mon[31212]: slow request 11531.474482 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:03 smithi170 ceph-mon[31212]: slow request 11531.459611 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:03 smithi170 ceph-mon[31212]: pgmap v6371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:41:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:03 smithi170 ceph-mon[31212]: osdmap e469: 12 total, 12 up, 12 in 2024-04-21T13:41:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:03 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 11775.264404 secs 2024-04-21T13:41:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:03 smithi077 ceph-mon[27902]: slow request 11521.556287 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:03 smithi077 ceph-mon[27902]: slow request 11531.474482 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:03 smithi077 ceph-mon[27902]: slow request 11531.459611 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:41:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:03 smithi077 ceph-mon[27902]: pgmap v6371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:41:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:03 smithi077 ceph-mon[27902]: osdmap e469: 12 total, 12 up, 12 in 2024-04-21T13:41:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:06 smithi077 ceph-mon[27902]: pgmap v6373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:41:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:06 smithi191 ceph-mon[31636]: pgmap v6373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:41:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:06 smithi170 ceph-mon[31212]: pgmap v6373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:41:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11778.504473 secs 2024-04-21T13:41:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11778.504473 secs 2024-04-21T13:41:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11778.504473 secs 2024-04-21T13:41:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:08 smithi191 ceph-mon[31636]: pgmap v6374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:41:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:08 smithi170 ceph-mon[31212]: pgmap v6374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:41:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:08 smithi077 ceph-mon[27902]: pgmap v6374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:41:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11780.264544 secs 2024-04-21T13:41:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:09 smithi170 ceph-mon[31212]: osdmap e470: 12 total, 12 up, 12 in 2024-04-21T13:41:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11780.264544 secs 2024-04-21T13:41:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:09 smithi077 ceph-mon[27902]: osdmap e470: 12 total, 12 up, 12 in 2024-04-21T13:41:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11780.264544 secs 2024-04-21T13:41:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:09 smithi191 ceph-mon[31636]: osdmap e470: 12 total, 12 up, 12 in 2024-04-21T13:41:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:10 smithi170 ceph-mon[31212]: pgmap v6376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:41:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:10 smithi077 ceph-mon[27902]: pgmap v6376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:41:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:10 smithi191 ceph-mon[31636]: pgmap v6376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:41:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:12 smithi170 ceph-mon[31212]: pgmap v6377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:41:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11783.504589 secs 2024-04-21T13:41:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:12 smithi077 ceph-mon[27902]: pgmap v6377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:41:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11783.504589 secs 2024-04-21T13:41:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:12 smithi191 ceph-mon[31636]: pgmap v6377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:41:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11783.504589 secs 2024-04-21T13:41:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11785.264677 secs 2024-04-21T13:41:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:14 smithi170 ceph-mon[31212]: pgmap v6378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 316 B/s wr, 6 op/s 2024-04-21T13:41:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11785.264677 secs 2024-04-21T13:41:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:14 smithi077 ceph-mon[27902]: pgmap v6378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 316 B/s wr, 6 op/s 2024-04-21T13:41:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11785.264677 secs 2024-04-21T13:41:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:14 smithi191 ceph-mon[31636]: pgmap v6378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 316 B/s wr, 6 op/s 2024-04-21T13:41:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:16 smithi170 ceph-mon[31212]: pgmap v6379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:41:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:16 smithi077 ceph-mon[27902]: pgmap v6379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:41:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:16 smithi191 ceph-mon[31636]: pgmap v6379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:41:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11788.504650 secs 2024-04-21T13:41:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11788.504650 secs 2024-04-21T13:41:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11788.504650 secs 2024-04-21T13:41:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:18 smithi170 ceph-mon[31212]: pgmap v6380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:41:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:18 smithi077 ceph-mon[27902]: pgmap v6380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:41:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:18 smithi191 ceph-mon[31636]: pgmap v6380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:41:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11790.264765 secs 2024-04-21T13:41:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11790.264765 secs 2024-04-21T13:41:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11790.264765 secs 2024-04-21T13:41:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:20 smithi170 ceph-mon[31212]: pgmap v6381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:41:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:20 smithi077 ceph-mon[27902]: pgmap v6381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:41:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:20 smithi191 ceph-mon[31636]: pgmap v6381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:41:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:22 smithi170 ceph-mon[31212]: pgmap v6382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:41:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11793.504786 secs 2024-04-21T13:41:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:22 smithi077 ceph-mon[27902]: pgmap v6382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:41:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11793.504786 secs 2024-04-21T13:41:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:22 smithi191 ceph-mon[31636]: pgmap v6382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:41:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11793.504786 secs 2024-04-21T13:41:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11795.264881 secs 2024-04-21T13:41:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:24 smithi170 ceph-mon[31212]: pgmap v6383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11795.264881 secs 2024-04-21T13:41:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:24 smithi077 ceph-mon[27902]: pgmap v6383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11795.264881 secs 2024-04-21T13:41:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:24 smithi191 ceph-mon[31636]: pgmap v6383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:26 smithi170 ceph-mon[31212]: pgmap v6384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:26 smithi077 ceph-mon[27902]: pgmap v6384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:26 smithi191 ceph-mon[31636]: pgmap v6384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11798.504875 secs 2024-04-21T13:41:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11798.504875 secs 2024-04-21T13:41:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11798.504875 secs 2024-04-21T13:41:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:28 smithi170 ceph-mon[31212]: pgmap v6385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:28 smithi077 ceph-mon[27902]: pgmap v6385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:28 smithi191 ceph-mon[31636]: pgmap v6385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11800.264966 secs 2024-04-21T13:41:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11800.264966 secs 2024-04-21T13:41:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11800.264966 secs 2024-04-21T13:41:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:30 smithi077 ceph-mon[27902]: pgmap v6386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:30 smithi191 ceph-mon[31636]: pgmap v6386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:30 smithi170 ceph-mon[31212]: pgmap v6386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:32 smithi077 ceph-mon[27902]: pgmap v6387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11803.504982 secs 2024-04-21T13:41:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:32 smithi191 ceph-mon[31636]: pgmap v6387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11803.504982 secs 2024-04-21T13:41:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:32 smithi170 ceph-mon[31212]: pgmap v6387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11803.504982 secs 2024-04-21T13:41:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11805.265090 secs 2024-04-21T13:41:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:34 smithi077 ceph-mon[27902]: pgmap v6388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11805.265090 secs 2024-04-21T13:41:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:34 smithi191 ceph-mon[31636]: pgmap v6388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11805.265090 secs 2024-04-21T13:41:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:34 smithi170 ceph-mon[31212]: pgmap v6388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:36 smithi077 ceph-mon[27902]: pgmap v6389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:36 smithi191 ceph-mon[31636]: pgmap v6389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:36 smithi170 ceph-mon[31212]: pgmap v6389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11808.505094 secs 2024-04-21T13:41:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11808.505094 secs 2024-04-21T13:41:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11808.505094 secs 2024-04-21T13:41:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:38 smithi077 ceph-mon[27902]: pgmap v6390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:38 smithi191 ceph-mon[31636]: pgmap v6390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:38 smithi170 ceph-mon[31212]: pgmap v6390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 11995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11810.265191 secs 2024-04-21T13:41:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11810.265191 secs 2024-04-21T13:41:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11810.265191 secs 2024-04-21T13:41:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:40 smithi077 ceph-mon[27902]: pgmap v6391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:40 smithi191 ceph-mon[31636]: pgmap v6391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:40 smithi170 ceph-mon[31212]: pgmap v6391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:41:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:42 smithi077 ceph-mon[27902]: pgmap v6392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11813.505211 secs 2024-04-21T13:41:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:42 smithi191 ceph-mon[31636]: pgmap v6392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11813.505211 secs 2024-04-21T13:41:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:42 smithi170 ceph-mon[31212]: pgmap v6392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11813.505211 secs 2024-04-21T13:41:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11815.265305 secs 2024-04-21T13:41:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:44 smithi077 ceph-mon[27902]: pgmap v6393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11815.265305 secs 2024-04-21T13:41:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:44 smithi191 ceph-mon[31636]: pgmap v6393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11815.265305 secs 2024-04-21T13:41:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:44 smithi170 ceph-mon[31212]: pgmap v6393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:41:46.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:41:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:41:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:46 smithi077 ceph-mon[27902]: pgmap v6394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:41:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:41:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:41:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:46 smithi191 ceph-mon[31636]: pgmap v6394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:41:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:41:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:41:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:46 smithi170 ceph-mon[31212]: pgmap v6394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:41:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:41:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:41:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11818.505294 secs 2024-04-21T13:41:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11818.505294 secs 2024-04-21T13:41:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11818.505294 secs 2024-04-21T13:41:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:48 smithi077 ceph-mon[27902]: pgmap v6395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:48 smithi170 ceph-mon[31212]: pgmap v6395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:48 smithi191 ceph-mon[31636]: pgmap v6395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11820.265399 secs 2024-04-21T13:41:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11820.265399 secs 2024-04-21T13:41:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11820.265399 secs 2024-04-21T13:41:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:50 smithi077 ceph-mon[27902]: pgmap v6396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:50 smithi191 ceph-mon[31636]: pgmap v6396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:50 smithi170 ceph-mon[31212]: pgmap v6396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:52 smithi077 ceph-mon[27902]: pgmap v6397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11823.505430 secs 2024-04-21T13:41:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:52 smithi191 ceph-mon[31636]: pgmap v6397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11823.505430 secs 2024-04-21T13:41:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:52 smithi170 ceph-mon[31212]: pgmap v6397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11823.505430 secs 2024-04-21T13:41:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:41:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11825.265543 secs 2024-04-21T13:41:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:54 smithi077 ceph-mon[27902]: pgmap v6398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11825.265543 secs 2024-04-21T13:41:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:54 smithi191 ceph-mon[31636]: pgmap v6398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11825.265543 secs 2024-04-21T13:41:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:54 smithi170 ceph-mon[31212]: pgmap v6398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:56 smithi077 ceph-mon[27902]: pgmap v6399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:56 smithi191 ceph-mon[31636]: pgmap v6399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:56 smithi170 ceph-mon[31212]: pgmap v6399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:41:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11828.505506 secs 2024-04-21T13:41:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11828.505506 secs 2024-04-21T13:41:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11828.505506 secs 2024-04-21T13:41:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:58 smithi191 ceph-mon[31636]: pgmap v6400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:58 smithi170 ceph-mon[31212]: pgmap v6400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:41:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:58 smithi077 ceph-mon[27902]: pgmap v6400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11830.265659 secs 2024-04-21T13:42:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:41:59 smithi191 ceph-mon[31636]: pgmap v6401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11830.265659 secs 2024-04-21T13:42:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:41:59 smithi170 ceph-mon[31212]: pgmap v6401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11830.265659 secs 2024-04-21T13:42:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:41:59 smithi077 ceph-mon[27902]: pgmap v6401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:02 smithi191 ceph-mon[31636]: pgmap v6402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-04-21T13:42:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11833.505640 secs 2024-04-21T13:42:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:02 smithi170 ceph-mon[31212]: pgmap v6402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-04-21T13:42:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11833.505640 secs 2024-04-21T13:42:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:02 smithi077 ceph-mon[27902]: pgmap v6402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-04-21T13:42:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11833.505640 secs 2024-04-21T13:42:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11835.265739 secs 2024-04-21T13:42:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:04 smithi191 ceph-mon[31636]: pgmap v6403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-04-21T13:42:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:04 smithi191 ceph-mon[31636]: osdmap e471: 12 total, 12 up, 12 in 2024-04-21T13:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11835.265739 secs 2024-04-21T13:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:04 smithi170 ceph-mon[31212]: pgmap v6403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-04-21T13:42:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:04 smithi170 ceph-mon[31212]: osdmap e471: 12 total, 12 up, 12 in 2024-04-21T13:42:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11835.265739 secs 2024-04-21T13:42:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:04 smithi077 ceph-mon[27902]: pgmap v6403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-04-21T13:42:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:04 smithi077 ceph-mon[27902]: osdmap e471: 12 total, 12 up, 12 in 2024-04-21T13:42:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:06 smithi191 ceph-mon[31636]: pgmap v6405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:42:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:06 smithi170 ceph-mon[31212]: pgmap v6405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:42:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:06 smithi077 ceph-mon[27902]: pgmap v6405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:42:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11838.505752 secs 2024-04-21T13:42:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11838.505752 secs 2024-04-21T13:42:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11838.505752 secs 2024-04-21T13:42:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:08 smithi191 ceph-mon[31636]: pgmap v6406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:42:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:08 smithi170 ceph-mon[31212]: pgmap v6406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:42:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:08 smithi077 ceph-mon[27902]: pgmap v6406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:42:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11840.265889 secs 2024-04-21T13:42:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:09 smithi170 ceph-mon[31212]: osdmap e472: 12 total, 12 up, 12 in 2024-04-21T13:42:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11840.265889 secs 2024-04-21T13:42:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:09 smithi077 ceph-mon[27902]: osdmap e472: 12 total, 12 up, 12 in 2024-04-21T13:42:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11840.265889 secs 2024-04-21T13:42:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:09 smithi191 ceph-mon[31636]: osdmap e472: 12 total, 12 up, 12 in 2024-04-21T13:42:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:10 smithi170 ceph-mon[31212]: pgmap v6408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-04-21T13:42:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:10 smithi077 ceph-mon[27902]: pgmap v6408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-04-21T13:42:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:10 smithi191 ceph-mon[31636]: pgmap v6408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-04-21T13:42:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:12 smithi170 ceph-mon[31212]: pgmap v6409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-04-21T13:42:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11843.505842 secs 2024-04-21T13:42:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:12 smithi077 ceph-mon[27902]: pgmap v6409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-04-21T13:42:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11843.505842 secs 2024-04-21T13:42:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:12 smithi191 ceph-mon[31636]: pgmap v6409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-04-21T13:42:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11843.505842 secs 2024-04-21T13:42:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11845.266014 secs 2024-04-21T13:42:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:14 smithi170 ceph-mon[31212]: pgmap v6410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T13:42:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11845.266014 secs 2024-04-21T13:42:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:14 smithi077 ceph-mon[27902]: pgmap v6410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T13:42:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11845.266014 secs 2024-04-21T13:42:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:14 smithi191 ceph-mon[31636]: pgmap v6410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T13:42:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:16 smithi170 ceph-mon[31212]: pgmap v6411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:42:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:16 smithi077 ceph-mon[27902]: pgmap v6411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:42:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:16 smithi191 ceph-mon[31636]: pgmap v6411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:42:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11848.505955 secs 2024-04-21T13:42:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11848.505955 secs 2024-04-21T13:42:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11848.505955 secs 2024-04-21T13:42:19.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:18 smithi170 ceph-mon[31212]: pgmap v6412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:42:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:18 smithi077 ceph-mon[27902]: pgmap v6412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:42:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:18 smithi191 ceph-mon[31636]: pgmap v6412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:42:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11850.266126 secs 2024-04-21T13:42:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11850.266126 secs 2024-04-21T13:42:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11850.266126 secs 2024-04-21T13:42:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:20 smithi170 ceph-mon[31212]: pgmap v6413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:42:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:20 smithi077 ceph-mon[27902]: pgmap v6413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:42:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:20 smithi191 ceph-mon[31636]: pgmap v6413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:42:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:22 smithi170 ceph-mon[31212]: pgmap v6414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:42:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11853.506041 secs 2024-04-21T13:42:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:22 smithi077 ceph-mon[27902]: pgmap v6414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:42:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11853.506041 secs 2024-04-21T13:42:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:22 smithi191 ceph-mon[31636]: pgmap v6414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:42:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11853.506041 secs 2024-04-21T13:42:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11855.266251 secs 2024-04-21T13:42:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:24 smithi077 ceph-mon[27902]: pgmap v6415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11855.266251 secs 2024-04-21T13:42:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:24 smithi191 ceph-mon[31636]: pgmap v6415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11855.266251 secs 2024-04-21T13:42:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:24 smithi170 ceph-mon[31212]: pgmap v6415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:26 smithi077 ceph-mon[27902]: pgmap v6416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:26 smithi191 ceph-mon[31636]: pgmap v6416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:26 smithi170 ceph-mon[31212]: pgmap v6416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11858.506154 secs 2024-04-21T13:42:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11858.506154 secs 2024-04-21T13:42:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11858.506154 secs 2024-04-21T13:42:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:28 smithi077 ceph-mon[27902]: pgmap v6417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:28 smithi191 ceph-mon[31636]: pgmap v6417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:28 smithi170 ceph-mon[31212]: pgmap v6417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11860.266367 secs 2024-04-21T13:42:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11860.266367 secs 2024-04-21T13:42:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11860.266367 secs 2024-04-21T13:42:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:30 smithi077 ceph-mon[27902]: pgmap v6418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:30 smithi191 ceph-mon[31636]: pgmap v6418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:30 smithi170 ceph-mon[31212]: pgmap v6418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:32 smithi077 ceph-mon[27902]: pgmap v6419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11863.506279 secs 2024-04-21T13:42:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:32 smithi191 ceph-mon[31636]: pgmap v6419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11863.506279 secs 2024-04-21T13:42:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:32 smithi170 ceph-mon[31212]: pgmap v6419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11863.506279 secs 2024-04-21T13:42:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11865.266474 secs 2024-04-21T13:42:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:34 smithi077 ceph-mon[27902]: pgmap v6420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11865.266474 secs 2024-04-21T13:42:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:34 smithi191 ceph-mon[31636]: pgmap v6420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11865.266474 secs 2024-04-21T13:42:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:34 smithi170 ceph-mon[31212]: pgmap v6420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:36 smithi077 ceph-mon[27902]: pgmap v6421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:36 smithi191 ceph-mon[31636]: pgmap v6421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:36 smithi170 ceph-mon[31212]: pgmap v6421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11868.506396 secs 2024-04-21T13:42:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11868.506396 secs 2024-04-21T13:42:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11868.506396 secs 2024-04-21T13:42:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:38 smithi077 ceph-mon[27902]: pgmap v6422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:38 smithi191 ceph-mon[31636]: pgmap v6422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:38 smithi170 ceph-mon[31212]: pgmap v6422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11870.266619 secs 2024-04-21T13:42:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11870.266619 secs 2024-04-21T13:42:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11870.266619 secs 2024-04-21T13:42:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:40 smithi077 ceph-mon[27902]: pgmap v6423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:40 smithi191 ceph-mon[31636]: pgmap v6423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:40 smithi170 ceph-mon[31212]: pgmap v6423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:42 smithi077 ceph-mon[27902]: pgmap v6424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11873.506513 secs 2024-04-21T13:42:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:42 smithi191 ceph-mon[31636]: pgmap v6424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11873.506513 secs 2024-04-21T13:42:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:42 smithi170 ceph-mon[31212]: pgmap v6424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11873.506513 secs 2024-04-21T13:42:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11875.266763 secs 2024-04-21T13:42:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:44 smithi077 ceph-mon[27902]: pgmap v6425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11875.266763 secs 2024-04-21T13:42:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:44 smithi191 ceph-mon[31636]: pgmap v6425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11875.266763 secs 2024-04-21T13:42:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:44 smithi170 ceph-mon[31212]: pgmap v6425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:46 smithi077 ceph-mon[27902]: pgmap v6426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:42:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:46 smithi191 ceph-mon[31636]: pgmap v6426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:42:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:46 smithi170 ceph-mon[31212]: pgmap v6426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:42:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11878.506599 secs 2024-04-21T13:42:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:42:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:42:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:42:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11878.506599 secs 2024-04-21T13:42:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:42:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:42:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:42:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11878.506599 secs 2024-04-21T13:42:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:42:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:42:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:42:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:48 smithi077 ceph-mon[27902]: pgmap v6427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:48 smithi170 ceph-mon[31212]: pgmap v6427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:48 smithi191 ceph-mon[31636]: pgmap v6427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11880.266908 secs 2024-04-21T13:42:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11880.266908 secs 2024-04-21T13:42:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11880.266908 secs 2024-04-21T13:42:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:50 smithi077 ceph-mon[27902]: pgmap v6428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:50 smithi191 ceph-mon[31636]: pgmap v6428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:50 smithi170 ceph-mon[31212]: pgmap v6428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:52 smithi077 ceph-mon[27902]: pgmap v6429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11883.506727 secs 2024-04-21T13:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:52 smithi191 ceph-mon[31636]: pgmap v6429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11883.506727 secs 2024-04-21T13:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:52 smithi170 ceph-mon[31212]: pgmap v6429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11883.506727 secs 2024-04-21T13:42:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:42:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11885.267038 secs 2024-04-21T13:42:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:54 smithi077 ceph-mon[27902]: pgmap v6430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11885.267038 secs 2024-04-21T13:42:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:54 smithi191 ceph-mon[31636]: pgmap v6430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11885.267038 secs 2024-04-21T13:42:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:54 smithi170 ceph-mon[31212]: pgmap v6430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:56 smithi077 ceph-mon[27902]: pgmap v6431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:56 smithi191 ceph-mon[31636]: pgmap v6431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:56 smithi170 ceph-mon[31212]: pgmap v6431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:42:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11888.506845 secs 2024-04-21T13:42:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11888.506845 secs 2024-04-21T13:42:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11888.506845 secs 2024-04-21T13:42:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:58 smithi077 ceph-mon[27902]: pgmap v6432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:58 smithi191 ceph-mon[31636]: pgmap v6432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:42:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:58 smithi170 ceph-mon[31212]: pgmap v6432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:42:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11890.267149 secs 2024-04-21T13:43:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:42:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11890.267149 secs 2024-04-21T13:43:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:42:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11890.267149 secs 2024-04-21T13:43:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:00 smithi191 ceph-mon[31636]: pgmap v6433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:00 smithi170 ceph-mon[31212]: pgmap v6433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:00 smithi077 ceph-mon[27902]: pgmap v6433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:02 smithi191 ceph-mon[31636]: pgmap v6434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T13:43:03.254 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11893.506911 secs 2024-04-21T13:43:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:02 smithi170 ceph-mon[31212]: pgmap v6434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T13:43:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11893.506911 secs 2024-04-21T13:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:02 smithi077 ceph-mon[27902]: pgmap v6434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T13:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11893.506911 secs 2024-04-21T13:43:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11895.267241 secs 2024-04-21T13:43:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:03 smithi191 ceph-mon[31636]: pgmap v6435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T13:43:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:03 smithi191 ceph-mon[31636]: osdmap e473: 12 total, 12 up, 12 in 2024-04-21T13:43:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11895.267241 secs 2024-04-21T13:43:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:03 smithi170 ceph-mon[31212]: pgmap v6435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T13:43:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:03 smithi170 ceph-mon[31212]: osdmap e473: 12 total, 12 up, 12 in 2024-04-21T13:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11895.267241 secs 2024-04-21T13:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:03 smithi077 ceph-mon[27902]: pgmap v6435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T13:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:03 smithi077 ceph-mon[27902]: osdmap e473: 12 total, 12 up, 12 in 2024-04-21T13:43:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:06 smithi191 ceph-mon[31636]: pgmap v6437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:43:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:06 smithi170 ceph-mon[31212]: pgmap v6437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:43:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:06 smithi077 ceph-mon[27902]: pgmap v6437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:43:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11898.507031 secs 2024-04-21T13:43:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11898.507031 secs 2024-04-21T13:43:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11898.507031 secs 2024-04-21T13:43:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:08 smithi191 ceph-mon[31636]: pgmap v6438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:43:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:08 smithi170 ceph-mon[31212]: pgmap v6438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:43:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:08 smithi077 ceph-mon[27902]: pgmap v6438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:43:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11900.267366 secs 2024-04-21T13:43:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:09 smithi170 ceph-mon[31212]: osdmap e474: 12 total, 12 up, 12 in 2024-04-21T13:43:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11900.267366 secs 2024-04-21T13:43:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:09 smithi077 ceph-mon[27902]: osdmap e474: 12 total, 12 up, 12 in 2024-04-21T13:43:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11900.267366 secs 2024-04-21T13:43:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:09 smithi191 ceph-mon[31636]: osdmap e474: 12 total, 12 up, 12 in 2024-04-21T13:43:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:10 smithi170 ceph-mon[31212]: pgmap v6440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-04-21T13:43:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:10 smithi077 ceph-mon[27902]: pgmap v6440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-04-21T13:43:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:10 smithi191 ceph-mon[31636]: pgmap v6440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-04-21T13:43:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:12 smithi170 ceph-mon[31212]: pgmap v6441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T13:43:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11903.507137 secs 2024-04-21T13:43:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:12 smithi077 ceph-mon[27902]: pgmap v6441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T13:43:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11903.507137 secs 2024-04-21T13:43:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:12 smithi191 ceph-mon[31636]: pgmap v6441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T13:43:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11903.507137 secs 2024-04-21T13:43:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11905.267479 secs 2024-04-21T13:43:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:14 smithi170 ceph-mon[31212]: pgmap v6442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T13:43:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11905.267479 secs 2024-04-21T13:43:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:14 smithi077 ceph-mon[27902]: pgmap v6442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T13:43:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11905.267479 secs 2024-04-21T13:43:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:14 smithi191 ceph-mon[31636]: pgmap v6442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T13:43:17.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:16 smithi170 ceph-mon[31212]: pgmap v6443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:43:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:16 smithi077 ceph-mon[27902]: pgmap v6443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:43:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:16 smithi191 ceph-mon[31636]: pgmap v6443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:43:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11908.507245 secs 2024-04-21T13:43:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11908.507245 secs 2024-04-21T13:43:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11908.507245 secs 2024-04-21T13:43:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:18 smithi077 ceph-mon[27902]: pgmap v6444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:43:19.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:18 smithi170 ceph-mon[31212]: pgmap v6444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:43:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:18 smithi191 ceph-mon[31636]: pgmap v6444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:43:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11910.267589 secs 2024-04-21T13:43:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11910.267589 secs 2024-04-21T13:43:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11910.267589 secs 2024-04-21T13:43:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:20 smithi077 ceph-mon[27902]: pgmap v6445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:43:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:20 smithi191 ceph-mon[31636]: pgmap v6445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:43:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:20 smithi170 ceph-mon[31212]: pgmap v6445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:43:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:22 smithi077 ceph-mon[27902]: pgmap v6446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:43:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11913.507315 secs 2024-04-21T13:43:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:22 smithi191 ceph-mon[31636]: pgmap v6446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:43:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11913.507315 secs 2024-04-21T13:43:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:22 smithi170 ceph-mon[31212]: pgmap v6446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:43:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11913.507315 secs 2024-04-21T13:43:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11915.267709 secs 2024-04-21T13:43:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:24 smithi077 ceph-mon[27902]: pgmap v6447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11915.267709 secs 2024-04-21T13:43:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:24 smithi191 ceph-mon[31636]: pgmap v6447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11915.267709 secs 2024-04-21T13:43:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:24 smithi170 ceph-mon[31212]: pgmap v6447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:26 smithi077 ceph-mon[27902]: pgmap v6448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:26 smithi191 ceph-mon[31636]: pgmap v6448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:26 smithi170 ceph-mon[31212]: pgmap v6448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11918.507430 secs 2024-04-21T13:43:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11918.507430 secs 2024-04-21T13:43:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11918.507430 secs 2024-04-21T13:43:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:28 smithi077 ceph-mon[27902]: pgmap v6449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:28 smithi191 ceph-mon[31636]: pgmap v6449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:28 smithi170 ceph-mon[31212]: pgmap v6449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11920.267879 secs 2024-04-21T13:43:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11920.267879 secs 2024-04-21T13:43:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11920.267879 secs 2024-04-21T13:43:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:30 smithi077 ceph-mon[27902]: pgmap v6450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:30 smithi191 ceph-mon[31636]: pgmap v6450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:30 smithi170 ceph-mon[31212]: pgmap v6450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:32 smithi077 ceph-mon[27902]: pgmap v6451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11923.507570 secs 2024-04-21T13:43:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:32 smithi191 ceph-mon[31636]: pgmap v6451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11923.507570 secs 2024-04-21T13:43:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:32 smithi170 ceph-mon[31212]: pgmap v6451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11923.507570 secs 2024-04-21T13:43:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11925.267996 secs 2024-04-21T13:43:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:34 smithi077 ceph-mon[27902]: pgmap v6452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11925.267996 secs 2024-04-21T13:43:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:34 smithi191 ceph-mon[31636]: pgmap v6452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11925.267996 secs 2024-04-21T13:43:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:34 smithi170 ceph-mon[31212]: pgmap v6452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:36 smithi077 ceph-mon[27902]: pgmap v6453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:36 smithi191 ceph-mon[31636]: pgmap v6453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:36 smithi170 ceph-mon[31212]: pgmap v6453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11928.507669 secs 2024-04-21T13:43:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11928.507669 secs 2024-04-21T13:43:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11928.507669 secs 2024-04-21T13:43:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:38 smithi077 ceph-mon[27902]: pgmap v6454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:38 smithi191 ceph-mon[31636]: pgmap v6454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:38 smithi170 ceph-mon[31212]: pgmap v6454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11930.268114 secs 2024-04-21T13:43:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11930.268114 secs 2024-04-21T13:43:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11930.268114 secs 2024-04-21T13:43:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:40 smithi077 ceph-mon[27902]: pgmap v6455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:40 smithi191 ceph-mon[31636]: pgmap v6455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:40 smithi170 ceph-mon[31212]: pgmap v6455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:42 smithi077 ceph-mon[27902]: pgmap v6456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11933.507796 secs 2024-04-21T13:43:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:42 smithi191 ceph-mon[31636]: pgmap v6456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11933.507796 secs 2024-04-21T13:43:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:42 smithi170 ceph-mon[31212]: pgmap v6456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11933.507796 secs 2024-04-21T13:43:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 11935.268242 secs 2024-04-21T13:43:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:44 smithi077 ceph-mon[27902]: slow request 11523.532443 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:43:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:44 smithi077 ceph-mon[27902]: pgmap v6457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 11935.268242 secs 2024-04-21T13:43:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:44 smithi191 ceph-mon[31636]: slow request 11523.532443 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:43:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:44 smithi191 ceph-mon[31636]: pgmap v6457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 11935.268242 secs 2024-04-21T13:43:45.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:44 smithi170 ceph-mon[31212]: slow request 11523.532443 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T13:43:45.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:44 smithi170 ceph-mon[31212]: pgmap v6457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:46 smithi077 ceph-mon[27902]: pgmap v6458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:46 smithi191 ceph-mon[31636]: pgmap v6458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:46 smithi170 ceph-mon[31212]: pgmap v6458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11938.507835 secs 2024-04-21T13:43:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:43:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:43:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:43:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:43:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11938.507835 secs 2024-04-21T13:43:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:43:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:43:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:43:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:43:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11938.507835 secs 2024-04-21T13:43:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:43:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:43:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:43:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:43:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:48 smithi077 ceph-mon[27902]: pgmap v6459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:48 smithi170 ceph-mon[31212]: pgmap v6459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:48 smithi191 ceph-mon[31636]: pgmap v6459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11940.268349 secs 2024-04-21T13:43:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11940.268349 secs 2024-04-21T13:43:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11940.268349 secs 2024-04-21T13:43:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:50 smithi191 ceph-mon[31636]: pgmap v6460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:50 smithi170 ceph-mon[31212]: pgmap v6460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:50 smithi077 ceph-mon[27902]: pgmap v6460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:52 smithi191 ceph-mon[31636]: pgmap v6461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11943.507968 secs 2024-04-21T13:43:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:52 smithi170 ceph-mon[31212]: pgmap v6461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11943.507968 secs 2024-04-21T13:43:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:52 smithi077 ceph-mon[27902]: pgmap v6461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11943.507968 secs 2024-04-21T13:43:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.427+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T13:43:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.427+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T13:43:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.427+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:43:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.427+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T13:43:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.427+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:43:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.428+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.428+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a53b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efd700204f0 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a53b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efd700204f0 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a53b0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a53b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a53b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.432+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:54.433+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T13:43:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:43:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11945.268493 secs 2024-04-21T13:43:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:54 smithi191 ceph-mon[31636]: pgmap v6462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11945.268493 secs 2024-04-21T13:43:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:54 smithi170 ceph-mon[31212]: pgmap v6462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11945.268493 secs 2024-04-21T13:43:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:54 smithi077 ceph-mon[27902]: pgmap v6462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:56.003+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:43:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:56.003+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:43:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:56.003+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:43:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:43:56.003+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:43:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:55 smithi191 ceph-mon[31636]: pgmap v6463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:55 smithi170 ceph-mon[31212]: pgmap v6463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:55 smithi077 ceph-mon[27902]: pgmap v6463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:43:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11948.508077 secs 2024-04-21T13:43:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11948.508077 secs 2024-04-21T13:43:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11948.508077 secs 2024-04-21T13:43:58.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:58 smithi077 ceph-mon[27902]: pgmap v6464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:58 smithi170 ceph-mon[31212]: pgmap v6464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:58 smithi191 ceph-mon[31636]: pgmap v6464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:43:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11950.268621 secs 2024-04-21T13:43:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11950.268621 secs 2024-04-21T13:43:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11950.268621 secs 2024-04-21T13:44:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:00 smithi170 ceph-mon[31212]: pgmap v6465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:00 smithi077 ceph-mon[27902]: pgmap v6465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:00 smithi191 ceph-mon[31636]: pgmap v6465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:02 smithi191 ceph-mon[31636]: pgmap v6466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11953.508197 secs 2024-04-21T13:44:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:02 smithi170 ceph-mon[31212]: pgmap v6466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11953.508197 secs 2024-04-21T13:44:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:02 smithi077 ceph-mon[27902]: pgmap v6466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11953.508197 secs 2024-04-21T13:44:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11955.268684 secs 2024-04-21T13:44:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:04 smithi191 ceph-mon[31636]: pgmap v6467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:04 smithi191 ceph-mon[31636]: osdmap e475: 12 total, 12 up, 12 in 2024-04-21T13:44:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11955.268684 secs 2024-04-21T13:44:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:04 smithi170 ceph-mon[31212]: pgmap v6467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:04 smithi170 ceph-mon[31212]: osdmap e475: 12 total, 12 up, 12 in 2024-04-21T13:44:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11955.268684 secs 2024-04-21T13:44:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:04 smithi077 ceph-mon[27902]: pgmap v6467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:04 smithi077 ceph-mon[27902]: osdmap e475: 12 total, 12 up, 12 in 2024-04-21T13:44:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:06 smithi191 ceph-mon[31636]: pgmap v6469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:44:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:06 smithi170 ceph-mon[31212]: pgmap v6469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:44:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:06 smithi077 ceph-mon[27902]: pgmap v6469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:44:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11958.508260 secs 2024-04-21T13:44:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11958.508260 secs 2024-04-21T13:44:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11958.508260 secs 2024-04-21T13:44:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:08 smithi191 ceph-mon[31636]: pgmap v6470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:44:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:08 smithi170 ceph-mon[31212]: pgmap v6470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:44:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:08 smithi077 ceph-mon[27902]: pgmap v6470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:44:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11960.268798 secs 2024-04-21T13:44:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:09 smithi170 ceph-mon[31212]: osdmap e476: 12 total, 12 up, 12 in 2024-04-21T13:44:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11960.268798 secs 2024-04-21T13:44:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:09 smithi077 ceph-mon[27902]: osdmap e476: 12 total, 12 up, 12 in 2024-04-21T13:44:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11960.268798 secs 2024-04-21T13:44:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:09 smithi191 ceph-mon[31636]: osdmap e476: 12 total, 12 up, 12 in 2024-04-21T13:44:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:10 smithi170 ceph-mon[31212]: pgmap v6472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:44:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:10 smithi077 ceph-mon[27902]: pgmap v6472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:44:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:10 smithi191 ceph-mon[31636]: pgmap v6472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:44:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:12 smithi077 ceph-mon[27902]: pgmap v6473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:44:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11963.508357 secs 2024-04-21T13:44:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:12 smithi191 ceph-mon[31636]: pgmap v6473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:44:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11963.508357 secs 2024-04-21T13:44:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:12 smithi170 ceph-mon[31212]: pgmap v6473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:44:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11963.508357 secs 2024-04-21T13:44:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11965.268931 secs 2024-04-21T13:44:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:14 smithi077 ceph-mon[27902]: pgmap v6474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:44:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11965.268931 secs 2024-04-21T13:44:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:14 smithi191 ceph-mon[31636]: pgmap v6474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:44:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11965.268931 secs 2024-04-21T13:44:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:14 smithi170 ceph-mon[31212]: pgmap v6474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:44:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:16 smithi077 ceph-mon[27902]: pgmap v6475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:44:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:16 smithi191 ceph-mon[31636]: pgmap v6475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:44:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:16 smithi170 ceph-mon[31212]: pgmap v6475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:44:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11968.508476 secs 2024-04-21T13:44:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11968.508476 secs 2024-04-21T13:44:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11968.508476 secs 2024-04-21T13:44:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:18 smithi077 ceph-mon[27902]: pgmap v6476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:44:19.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:18 smithi170 ceph-mon[31212]: pgmap v6476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:44:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:18 smithi191 ceph-mon[31636]: pgmap v6476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:44:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11970.269073 secs 2024-04-21T13:44:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11970.269073 secs 2024-04-21T13:44:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11970.269073 secs 2024-04-21T13:44:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:20 smithi077 ceph-mon[27902]: pgmap v6477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:44:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:20 smithi191 ceph-mon[31636]: pgmap v6477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:44:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:20 smithi170 ceph-mon[31212]: pgmap v6477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:44:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:22 smithi077 ceph-mon[27902]: pgmap v6478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:44:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11973.508550 secs 2024-04-21T13:44:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:22 smithi191 ceph-mon[31636]: pgmap v6478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:44:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11973.508550 secs 2024-04-21T13:44:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:22 smithi170 ceph-mon[31212]: pgmap v6478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:44:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11973.508550 secs 2024-04-21T13:44:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11975.269186 secs 2024-04-21T13:44:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:24 smithi077 ceph-mon[27902]: pgmap v6479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11975.269186 secs 2024-04-21T13:44:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:24 smithi191 ceph-mon[31636]: pgmap v6479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11975.269186 secs 2024-04-21T13:44:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:24 smithi170 ceph-mon[31212]: pgmap v6479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:26 smithi077 ceph-mon[27902]: pgmap v6480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:26 smithi191 ceph-mon[31636]: pgmap v6480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:26 smithi170 ceph-mon[31212]: pgmap v6480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11978.508684 secs 2024-04-21T13:44:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11978.508684 secs 2024-04-21T13:44:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11978.508684 secs 2024-04-21T13:44:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:28 smithi077 ceph-mon[27902]: pgmap v6481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:28 smithi191 ceph-mon[31636]: pgmap v6481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:28 smithi170 ceph-mon[31212]: pgmap v6481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11980.269327 secs 2024-04-21T13:44:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11980.269327 secs 2024-04-21T13:44:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11980.269327 secs 2024-04-21T13:44:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:30 smithi077 ceph-mon[27902]: pgmap v6482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:30 smithi191 ceph-mon[31636]: pgmap v6482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:30 smithi170 ceph-mon[31212]: pgmap v6482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:32 smithi077 ceph-mon[27902]: pgmap v6483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11983.508803 secs 2024-04-21T13:44:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:32 smithi191 ceph-mon[31636]: pgmap v6483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11983.508803 secs 2024-04-21T13:44:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:32 smithi170 ceph-mon[31212]: pgmap v6483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11983.508803 secs 2024-04-21T13:44:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11985.269447 secs 2024-04-21T13:44:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:34 smithi077 ceph-mon[27902]: pgmap v6484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11985.269447 secs 2024-04-21T13:44:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:34 smithi191 ceph-mon[31636]: pgmap v6484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11985.269447 secs 2024-04-21T13:44:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:34 smithi170 ceph-mon[31212]: pgmap v6484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:36 smithi077 ceph-mon[27902]: pgmap v6485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:36 smithi191 ceph-mon[31636]: pgmap v6485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:36 smithi170 ceph-mon[31212]: pgmap v6485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11988.508919 secs 2024-04-21T13:44:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11988.508919 secs 2024-04-21T13:44:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11988.508919 secs 2024-04-21T13:44:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:38 smithi077 ceph-mon[27902]: pgmap v6486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:38 smithi191 ceph-mon[31636]: pgmap v6486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:38 smithi170 ceph-mon[31212]: pgmap v6486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11990.269578 secs 2024-04-21T13:44:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11990.269578 secs 2024-04-21T13:44:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11990.269578 secs 2024-04-21T13:44:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:40 smithi077 ceph-mon[27902]: pgmap v6487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:40 smithi191 ceph-mon[31636]: pgmap v6487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:40 smithi170 ceph-mon[31212]: pgmap v6487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11993.509027 secs 2024-04-21T13:44:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:42 smithi191 ceph-mon[31636]: pgmap v6488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11993.509027 secs 2024-04-21T13:44:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:42 smithi170 ceph-mon[31212]: pgmap v6488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11993.509027 secs 2024-04-21T13:44:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:42 smithi077 ceph-mon[27902]: pgmap v6488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 11995.269666 secs 2024-04-21T13:44:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:44 smithi191 ceph-mon[31636]: pgmap v6489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 11995.269666 secs 2024-04-21T13:44:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:44 smithi170 ceph-mon[31212]: pgmap v6489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 11995.269666 secs 2024-04-21T13:44:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:44 smithi077 ceph-mon[27902]: pgmap v6489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:46 smithi191 ceph-mon[31636]: pgmap v6490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:46 smithi170 ceph-mon[31212]: pgmap v6490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:46 smithi077 ceph-mon[27902]: pgmap v6490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 11998.509143 secs 2024-04-21T13:44:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:44:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 11998.509143 secs 2024-04-21T13:44:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:44:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 11998.509143 secs 2024-04-21T13:44:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:44:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:48 smithi170 ceph-mon[31212]: pgmap v6491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:44:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:44:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:44:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:48 smithi191 ceph-mon[31636]: pgmap v6491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:44:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:44:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:44:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:48 smithi077 ceph-mon[27902]: pgmap v6491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:44:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:44:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:44:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12000.269785 secs 2024-04-21T13:44:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12000.269785 secs 2024-04-21T13:44:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12000.269785 secs 2024-04-21T13:44:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:50 smithi191 ceph-mon[31636]: pgmap v6492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:50 smithi170 ceph-mon[31212]: pgmap v6492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:50 smithi077 ceph-mon[27902]: pgmap v6492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:51 smithi191 ceph-mon[31636]: pgmap v6493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:51 smithi170 ceph-mon[31212]: pgmap v6493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:51 smithi077 ceph-mon[27902]: pgmap v6493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12003.509265 secs 2024-04-21T13:44:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12003.509265 secs 2024-04-21T13:44:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12003.509265 secs 2024-04-21T13:44:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:53 smithi191 ceph-mon[31636]: pgmap v6494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:53 smithi170 ceph-mon[31212]: pgmap v6494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:53 smithi077 ceph-mon[27902]: pgmap v6494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:44:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12005.269959 secs 2024-04-21T13:44:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12005.269959 secs 2024-04-21T13:44:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12005.269959 secs 2024-04-21T13:44:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:55 smithi191 ceph-mon[31636]: pgmap v6495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:55 smithi170 ceph-mon[31212]: pgmap v6495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:55 smithi077 ceph-mon[27902]: pgmap v6495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:44:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12008.509379 secs 2024-04-21T13:44:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12008.509379 secs 2024-04-21T13:44:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12008.509379 secs 2024-04-21T13:44:58.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:58 smithi077 ceph-mon[27902]: pgmap v6496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:58 smithi170 ceph-mon[31212]: pgmap v6496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:58 smithi191 ceph-mon[31636]: pgmap v6496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:44:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12010.270031 secs 2024-04-21T13:44:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12010.270031 secs 2024-04-21T13:44:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12010.270031 secs 2024-04-21T13:45:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:00 smithi170 ceph-mon[31212]: pgmap v6497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:00 smithi077 ceph-mon[27902]: pgmap v6497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:00 smithi191 ceph-mon[31636]: pgmap v6497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12013.509510 secs 2024-04-21T13:45:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:02 smithi191 ceph-mon[31636]: pgmap v6498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12013.509510 secs 2024-04-21T13:45:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:02 smithi170 ceph-mon[31212]: pgmap v6498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12013.509510 secs 2024-04-21T13:45:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:02 smithi077 ceph-mon[27902]: pgmap v6498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12015.270153 secs 2024-04-21T13:45:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:04 smithi191 ceph-mon[31636]: pgmap v6499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:04 smithi191 ceph-mon[31636]: osdmap e477: 12 total, 12 up, 12 in 2024-04-21T13:45:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12015.270153 secs 2024-04-21T13:45:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:04 smithi170 ceph-mon[31212]: pgmap v6499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:04 smithi170 ceph-mon[31212]: osdmap e477: 12 total, 12 up, 12 in 2024-04-21T13:45:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12015.270153 secs 2024-04-21T13:45:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:04 smithi077 ceph-mon[27902]: pgmap v6499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:04 smithi077 ceph-mon[27902]: osdmap e477: 12 total, 12 up, 12 in 2024-04-21T13:45:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:06 smithi191 ceph-mon[31636]: pgmap v6501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:45:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:06 smithi170 ceph-mon[31212]: pgmap v6501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:45:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:06 smithi077 ceph-mon[27902]: pgmap v6501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:45:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12018.509619 secs 2024-04-21T13:45:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12018.509619 secs 2024-04-21T13:45:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12018.509619 secs 2024-04-21T13:45:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:08 smithi170 ceph-mon[31212]: pgmap v6502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:45:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:08 smithi077 ceph-mon[27902]: pgmap v6502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:45:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:08 smithi191 ceph-mon[31636]: pgmap v6502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:45:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12020.270241 secs 2024-04-21T13:45:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:09 smithi077 ceph-mon[27902]: osdmap e478: 12 total, 12 up, 12 in 2024-04-21T13:45:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12020.270241 secs 2024-04-21T13:45:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:09 smithi191 ceph-mon[31636]: osdmap e478: 12 total, 12 up, 12 in 2024-04-21T13:45:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12020.270241 secs 2024-04-21T13:45:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:09 smithi170 ceph-mon[31212]: osdmap e478: 12 total, 12 up, 12 in 2024-04-21T13:45:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:10 smithi077 ceph-mon[27902]: pgmap v6504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:45:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:10 smithi191 ceph-mon[31636]: pgmap v6504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:45:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:10 smithi170 ceph-mon[31212]: pgmap v6504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:45:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12023.509739 secs 2024-04-21T13:45:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:12 smithi077 ceph-mon[27902]: pgmap v6505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:45:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12023.509739 secs 2024-04-21T13:45:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:12 smithi191 ceph-mon[31636]: pgmap v6505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:45:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12023.509739 secs 2024-04-21T13:45:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:12 smithi170 ceph-mon[31212]: pgmap v6505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:45:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12025.270316 secs 2024-04-21T13:45:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:14 smithi077 ceph-mon[27902]: pgmap v6506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:45:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12025.270316 secs 2024-04-21T13:45:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:14 smithi191 ceph-mon[31636]: pgmap v6506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:45:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12025.270316 secs 2024-04-21T13:45:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:14 smithi170 ceph-mon[31212]: pgmap v6506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:45:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:16 smithi077 ceph-mon[27902]: pgmap v6507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:45:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:16 smithi191 ceph-mon[31636]: pgmap v6507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:45:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:16 smithi170 ceph-mon[31212]: pgmap v6507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:45:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12028.509849 secs 2024-04-21T13:45:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12028.509849 secs 2024-04-21T13:45:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12028.509849 secs 2024-04-21T13:45:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:18 smithi077 ceph-mon[27902]: pgmap v6508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:45:19.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:18 smithi170 ceph-mon[31212]: pgmap v6508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:45:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:18 smithi191 ceph-mon[31636]: pgmap v6508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:45:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12030.270448 secs 2024-04-21T13:45:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12030.270448 secs 2024-04-21T13:45:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12030.270448 secs 2024-04-21T13:45:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:20 smithi077 ceph-mon[27902]: pgmap v6509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:45:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:20 smithi191 ceph-mon[31636]: pgmap v6509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:45:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:20 smithi170 ceph-mon[31212]: pgmap v6509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:45:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12033.509968 secs 2024-04-21T13:45:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:22 smithi077 ceph-mon[27902]: pgmap v6510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:45:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12033.509968 secs 2024-04-21T13:45:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:22 smithi191 ceph-mon[31636]: pgmap v6510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:45:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12033.509968 secs 2024-04-21T13:45:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:22 smithi170 ceph-mon[31212]: pgmap v6510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:45:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12035.270544 secs 2024-04-21T13:45:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:24 smithi077 ceph-mon[27902]: pgmap v6511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12035.270544 secs 2024-04-21T13:45:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:24 smithi191 ceph-mon[31636]: pgmap v6511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12035.270544 secs 2024-04-21T13:45:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:24 smithi170 ceph-mon[31212]: pgmap v6511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:26 smithi077 ceph-mon[27902]: pgmap v6512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:26 smithi191 ceph-mon[31636]: pgmap v6512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:26 smithi170 ceph-mon[31212]: pgmap v6512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12038.510077 secs 2024-04-21T13:45:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12038.510077 secs 2024-04-21T13:45:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12038.510077 secs 2024-04-21T13:45:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:28 smithi077 ceph-mon[27902]: pgmap v6513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:28 smithi191 ceph-mon[31636]: pgmap v6513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:28 smithi170 ceph-mon[31212]: pgmap v6513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12040.270683 secs 2024-04-21T13:45:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12040.270683 secs 2024-04-21T13:45:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12040.270683 secs 2024-04-21T13:45:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:30 smithi077 ceph-mon[27902]: pgmap v6514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:30 smithi191 ceph-mon[31636]: pgmap v6514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:30 smithi170 ceph-mon[31212]: pgmap v6514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12043.510190 secs 2024-04-21T13:45:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:32 smithi077 ceph-mon[27902]: pgmap v6515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12043.510190 secs 2024-04-21T13:45:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:32 smithi191 ceph-mon[31636]: pgmap v6515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12043.510190 secs 2024-04-21T13:45:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:32 smithi170 ceph-mon[31212]: pgmap v6515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12045.270823 secs 2024-04-21T13:45:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:34 smithi077 ceph-mon[27902]: pgmap v6516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12045.270823 secs 2024-04-21T13:45:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:34 smithi191 ceph-mon[31636]: pgmap v6516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12045.270823 secs 2024-04-21T13:45:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:34 smithi170 ceph-mon[31212]: pgmap v6516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:36 smithi077 ceph-mon[27902]: pgmap v6517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:36 smithi191 ceph-mon[31636]: pgmap v6517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:36 smithi170 ceph-mon[31212]: pgmap v6517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12048.510325 secs 2024-04-21T13:45:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12048.510325 secs 2024-04-21T13:45:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12048.510325 secs 2024-04-21T13:45:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:38 smithi077 ceph-mon[27902]: pgmap v6518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:38 smithi191 ceph-mon[31636]: pgmap v6518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:38 smithi170 ceph-mon[31212]: pgmap v6518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12050.270872 secs 2024-04-21T13:45:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12050.270872 secs 2024-04-21T13:45:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12050.270872 secs 2024-04-21T13:45:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:40 smithi191 ceph-mon[31636]: pgmap v6519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:40 smithi170 ceph-mon[31212]: pgmap v6519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:40 smithi077 ceph-mon[27902]: pgmap v6519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12053.510460 secs 2024-04-21T13:45:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:42 smithi191 ceph-mon[31636]: pgmap v6520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12053.510460 secs 2024-04-21T13:45:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:42 smithi170 ceph-mon[31212]: pgmap v6520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12053.510460 secs 2024-04-21T13:45:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:42 smithi077 ceph-mon[27902]: pgmap v6520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12055.270990 secs 2024-04-21T13:45:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:44 smithi191 ceph-mon[31636]: pgmap v6521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12055.270990 secs 2024-04-21T13:45:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:44 smithi170 ceph-mon[31212]: pgmap v6521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12055.270990 secs 2024-04-21T13:45:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:44 smithi077 ceph-mon[27902]: pgmap v6521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:46 smithi191 ceph-mon[31636]: pgmap v6522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:46 smithi170 ceph-mon[31212]: pgmap v6522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:46 smithi077 ceph-mon[27902]: pgmap v6522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12058.510603 secs 2024-04-21T13:45:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12058.510603 secs 2024-04-21T13:45:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12058.510603 secs 2024-04-21T13:45:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:48 smithi170 ceph-mon[31212]: pgmap v6523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:45:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:48 smithi191 ceph-mon[31636]: pgmap v6523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:45:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:48 smithi077 ceph-mon[27902]: pgmap v6523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:45:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12060.271102 secs 2024-04-21T13:45:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12060.271102 secs 2024-04-21T13:45:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12060.271102 secs 2024-04-21T13:45:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: pgmap v6524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: pgmap v6524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: pgmap v6524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:45:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:45:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:45:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:45:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:45:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:45:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:45:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:45:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:45:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:45:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:45:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12063.510741 secs 2024-04-21T13:45:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:52 smithi191 ceph-mon[31636]: pgmap v6525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:45:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:45:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:45:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:45:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12063.510741 secs 2024-04-21T13:45:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:52 smithi170 ceph-mon[31212]: pgmap v6525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12063.510741 secs 2024-04-21T13:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:52 smithi077 ceph-mon[27902]: pgmap v6525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:53 smithi191 ceph-mon[31636]: pgmap v6526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:53 smithi170 ceph-mon[31212]: pgmap v6526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:53 smithi077 ceph-mon[27902]: pgmap v6526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:45:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12065.271224 secs 2024-04-21T13:45:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12065.271224 secs 2024-04-21T13:45:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12065.271224 secs 2024-04-21T13:45:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:55 smithi191 ceph-mon[31636]: pgmap v6527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:55 smithi170 ceph-mon[31212]: pgmap v6527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:55 smithi077 ceph-mon[27902]: pgmap v6527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:45:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12068.510859 secs 2024-04-21T13:45:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12068.510859 secs 2024-04-21T13:45:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12068.510859 secs 2024-04-21T13:45:58.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:58 smithi077 ceph-mon[27902]: pgmap v6528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:58 smithi170 ceph-mon[31212]: pgmap v6528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:58 smithi191 ceph-mon[31636]: pgmap v6528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:45:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12070.271336 secs 2024-04-21T13:45:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12070.271336 secs 2024-04-21T13:45:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12070.271336 secs 2024-04-21T13:46:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:00 smithi170 ceph-mon[31212]: pgmap v6529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:00 smithi077 ceph-mon[27902]: pgmap v6529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:00 smithi191 ceph-mon[31636]: pgmap v6529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12073.510923 secs 2024-04-21T13:46:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:02 smithi191 ceph-mon[31636]: pgmap v6530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12073.510923 secs 2024-04-21T13:46:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:02 smithi170 ceph-mon[31212]: pgmap v6530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12073.510923 secs 2024-04-21T13:46:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:02 smithi077 ceph-mon[27902]: pgmap v6530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12075.271486 secs 2024-04-21T13:46:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:04 smithi170 ceph-mon[31212]: pgmap v6531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:04 smithi170 ceph-mon[31212]: osdmap e479: 12 total, 12 up, 12 in 2024-04-21T13:46:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12075.271486 secs 2024-04-21T13:46:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:04 smithi077 ceph-mon[27902]: pgmap v6531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:04 smithi077 ceph-mon[27902]: osdmap e479: 12 total, 12 up, 12 in 2024-04-21T13:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12075.271486 secs 2024-04-21T13:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:04 smithi191 ceph-mon[31636]: pgmap v6531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:04 smithi191 ceph-mon[31636]: osdmap e479: 12 total, 12 up, 12 in 2024-04-21T13:46:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:06 smithi170 ceph-mon[31212]: pgmap v6533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:46:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:06 smithi077 ceph-mon[27902]: pgmap v6533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:46:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:06 smithi191 ceph-mon[31636]: pgmap v6533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:46:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12078.511017 secs 2024-04-21T13:46:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12078.511017 secs 2024-04-21T13:46:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12078.511017 secs 2024-04-21T13:46:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:08 smithi170 ceph-mon[31212]: pgmap v6534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:46:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:08 smithi077 ceph-mon[27902]: pgmap v6534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:46:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:08 smithi191 ceph-mon[31636]: pgmap v6534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:46:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12080.271579 secs 2024-04-21T13:46:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:09 smithi077 ceph-mon[27902]: osdmap e480: 12 total, 12 up, 12 in 2024-04-21T13:46:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12080.271579 secs 2024-04-21T13:46:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:09 smithi191 ceph-mon[31636]: osdmap e480: 12 total, 12 up, 12 in 2024-04-21T13:46:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12080.271579 secs 2024-04-21T13:46:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:09 smithi170 ceph-mon[31212]: osdmap e480: 12 total, 12 up, 12 in 2024-04-21T13:46:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:10 smithi077 ceph-mon[27902]: pgmap v6536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:46:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:10 smithi191 ceph-mon[31636]: pgmap v6536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:46:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:10 smithi170 ceph-mon[31212]: pgmap v6536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:46:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12083.511098 secs 2024-04-21T13:46:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:12 smithi077 ceph-mon[27902]: pgmap v6537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:46:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12083.511098 secs 2024-04-21T13:46:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:12 smithi191 ceph-mon[31636]: pgmap v6537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:46:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12083.511098 secs 2024-04-21T13:46:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:12 smithi170 ceph-mon[31212]: pgmap v6537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T13:46:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12085.271736 secs 2024-04-21T13:46:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:14 smithi077 ceph-mon[27902]: pgmap v6538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12085.271736 secs 2024-04-21T13:46:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:14 smithi191 ceph-mon[31636]: pgmap v6538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:46:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12085.271736 secs 2024-04-21T13:46:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:14 smithi170 ceph-mon[31212]: pgmap v6538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:46:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:16 smithi077 ceph-mon[27902]: pgmap v6539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:46:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:16 smithi191 ceph-mon[31636]: pgmap v6539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:46:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:16 smithi170 ceph-mon[31212]: pgmap v6539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:46:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12088.511203 secs 2024-04-21T13:46:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12088.511203 secs 2024-04-21T13:46:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12088.511203 secs 2024-04-21T13:46:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:18 smithi077 ceph-mon[27902]: pgmap v6540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:46:19.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:18 smithi170 ceph-mon[31212]: pgmap v6540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:46:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:18 smithi191 ceph-mon[31636]: pgmap v6540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:46:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12090.271869 secs 2024-04-21T13:46:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12090.271869 secs 2024-04-21T13:46:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12090.271869 secs 2024-04-21T13:46:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:20 smithi077 ceph-mon[27902]: pgmap v6541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:46:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:20 smithi191 ceph-mon[31636]: pgmap v6541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:46:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:20 smithi170 ceph-mon[31212]: pgmap v6541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:46:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12093.511316 secs 2024-04-21T13:46:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:22 smithi077 ceph-mon[27902]: pgmap v6542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:46:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12093.511316 secs 2024-04-21T13:46:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:22 smithi191 ceph-mon[31636]: pgmap v6542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:46:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12093.511316 secs 2024-04-21T13:46:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:22 smithi170 ceph-mon[31212]: pgmap v6542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:46:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12095.272026 secs 2024-04-21T13:46:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:24 smithi077 ceph-mon[27902]: pgmap v6543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12095.272026 secs 2024-04-21T13:46:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:24 smithi191 ceph-mon[31636]: pgmap v6543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12095.272026 secs 2024-04-21T13:46:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:24 smithi170 ceph-mon[31212]: pgmap v6543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:26 smithi077 ceph-mon[27902]: pgmap v6544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:26 smithi191 ceph-mon[31636]: pgmap v6544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:26 smithi170 ceph-mon[31212]: pgmap v6544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12098.511407 secs 2024-04-21T13:46:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12098.511407 secs 2024-04-21T13:46:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12098.511407 secs 2024-04-21T13:46:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:28 smithi077 ceph-mon[27902]: pgmap v6545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:28 smithi191 ceph-mon[31636]: pgmap v6545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:28 smithi170 ceph-mon[31212]: pgmap v6545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12100.272153 secs 2024-04-21T13:46:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12100.272153 secs 2024-04-21T13:46:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12100.272153 secs 2024-04-21T13:46:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:30 smithi077 ceph-mon[27902]: pgmap v6546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:30 smithi191 ceph-mon[31636]: pgmap v6546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:30 smithi170 ceph-mon[31212]: pgmap v6546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12103.511527 secs 2024-04-21T13:46:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:32 smithi077 ceph-mon[27902]: pgmap v6547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12103.511527 secs 2024-04-21T13:46:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:32 smithi191 ceph-mon[31636]: pgmap v6547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12103.511527 secs 2024-04-21T13:46:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:32 smithi170 ceph-mon[31212]: pgmap v6547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12105.272270 secs 2024-04-21T13:46:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:34 smithi077 ceph-mon[27902]: pgmap v6548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12105.272270 secs 2024-04-21T13:46:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:34 smithi191 ceph-mon[31636]: pgmap v6548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12105.272270 secs 2024-04-21T13:46:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:34 smithi170 ceph-mon[31212]: pgmap v6548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:36 smithi191 ceph-mon[31636]: pgmap v6549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:36 smithi170 ceph-mon[31212]: pgmap v6549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:36 smithi077 ceph-mon[27902]: pgmap v6549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12108.511638 secs 2024-04-21T13:46:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12108.511638 secs 2024-04-21T13:46:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12108.511638 secs 2024-04-21T13:46:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:38 smithi191 ceph-mon[31636]: pgmap v6550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:38 smithi170 ceph-mon[31212]: pgmap v6550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:38 smithi077 ceph-mon[27902]: pgmap v6550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12110.272406 secs 2024-04-21T13:46:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12110.272406 secs 2024-04-21T13:46:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12110.272406 secs 2024-04-21T13:46:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:40 smithi191 ceph-mon[31636]: pgmap v6551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:40 smithi170 ceph-mon[31212]: pgmap v6551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:40 smithi077 ceph-mon[27902]: pgmap v6551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12113.511793 secs 2024-04-21T13:46:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:42 smithi191 ceph-mon[31636]: pgmap v6552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12113.511793 secs 2024-04-21T13:46:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:42 smithi170 ceph-mon[31212]: pgmap v6552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12113.511793 secs 2024-04-21T13:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:42 smithi077 ceph-mon[27902]: pgmap v6552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12115.272551 secs 2024-04-21T13:46:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:44 smithi191 ceph-mon[31636]: pgmap v6553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12115.272551 secs 2024-04-21T13:46:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:44 smithi170 ceph-mon[31212]: pgmap v6553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12115.272551 secs 2024-04-21T13:46:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:44 smithi077 ceph-mon[27902]: pgmap v6553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:46 smithi191 ceph-mon[31636]: pgmap v6554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:46 smithi170 ceph-mon[31212]: pgmap v6554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:46 smithi077 ceph-mon[27902]: pgmap v6554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12118.511901 secs 2024-04-21T13:46:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12118.511901 secs 2024-04-21T13:46:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12118.511901 secs 2024-04-21T13:46:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:48 smithi170 ceph-mon[31212]: pgmap v6555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:48 smithi191 ceph-mon[31636]: pgmap v6555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:48 smithi077 ceph-mon[27902]: pgmap v6555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12120.272674 secs 2024-04-21T13:46:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12120.272674 secs 2024-04-21T13:46:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12120.272674 secs 2024-04-21T13:46:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:50 smithi191 ceph-mon[31636]: pgmap v6556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:50 smithi170 ceph-mon[31212]: pgmap v6556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:50 smithi077 ceph-mon[27902]: pgmap v6556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:46:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:52.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:51 smithi191 ceph-mon[31636]: pgmap v6557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:52.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:46:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:51 smithi170 ceph-mon[31212]: pgmap v6557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:46:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:52.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:51 smithi077 ceph-mon[27902]: pgmap v6557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12123.512029 secs 2024-04-21T13:46:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:46:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:46:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12123.512029 secs 2024-04-21T13:46:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:46:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:46:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12123.512029 secs 2024-04-21T13:46:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:46:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:46:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:46:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:53 smithi191 ceph-mon[31636]: pgmap v6558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:53 smithi170 ceph-mon[31212]: pgmap v6558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:53 smithi077 ceph-mon[27902]: pgmap v6558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:46:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12125.272805 secs 2024-04-21T13:46:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12125.272805 secs 2024-04-21T13:46:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12125.272805 secs 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:46:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:46:56.028+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:46:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:55 smithi191 ceph-mon[31636]: pgmap v6559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:55 smithi170 ceph-mon[31212]: pgmap v6559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:55 smithi077 ceph-mon[27902]: pgmap v6559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:46:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12128.512144 secs 2024-04-21T13:46:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12128.512144 secs 2024-04-21T13:46:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12128.512144 secs 2024-04-21T13:46:58.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:58 smithi077 ceph-mon[27902]: pgmap v6560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:58 smithi170 ceph-mon[31212]: pgmap v6560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:58 smithi191 ceph-mon[31636]: pgmap v6560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:46:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12130.272930 secs 2024-04-21T13:46:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12130.272930 secs 2024-04-21T13:46:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12130.272930 secs 2024-04-21T13:47:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:00 smithi170 ceph-mon[31212]: pgmap v6561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:00 smithi077 ceph-mon[27902]: pgmap v6561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:00 smithi191 ceph-mon[31636]: pgmap v6561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12133.512268 secs 2024-04-21T13:47:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:02 smithi170 ceph-mon[31212]: pgmap v6562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12133.512268 secs 2024-04-21T13:47:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:02 smithi077 ceph-mon[27902]: pgmap v6562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12133.512268 secs 2024-04-21T13:47:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:02 smithi191 ceph-mon[31636]: pgmap v6562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12135.273008 secs 2024-04-21T13:47:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:04 smithi170 ceph-mon[31212]: pgmap v6563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:04 smithi170 ceph-mon[31212]: osdmap e481: 12 total, 12 up, 12 in 2024-04-21T13:47:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12135.273008 secs 2024-04-21T13:47:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:04 smithi077 ceph-mon[27902]: pgmap v6563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:04 smithi077 ceph-mon[27902]: osdmap e481: 12 total, 12 up, 12 in 2024-04-21T13:47:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12135.273008 secs 2024-04-21T13:47:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:04 smithi191 ceph-mon[31636]: pgmap v6563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:04 smithi191 ceph-mon[31636]: osdmap e481: 12 total, 12 up, 12 in 2024-04-21T13:47:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:06 smithi170 ceph-mon[31212]: pgmap v6565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:47:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:06 smithi077 ceph-mon[27902]: pgmap v6565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:47:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:06 smithi191 ceph-mon[31636]: pgmap v6565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:47:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12138.512380 secs 2024-04-21T13:47:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12138.512380 secs 2024-04-21T13:47:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12138.512380 secs 2024-04-21T13:47:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:08 smithi170 ceph-mon[31212]: pgmap v6566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:47:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:08 smithi077 ceph-mon[27902]: pgmap v6566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:47:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:08 smithi191 ceph-mon[31636]: pgmap v6566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:47:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12140.273098 secs 2024-04-21T13:47:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:09 smithi077 ceph-mon[27902]: osdmap e482: 12 total, 12 up, 12 in 2024-04-21T13:47:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12140.273098 secs 2024-04-21T13:47:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:09 smithi191 ceph-mon[31636]: osdmap e482: 12 total, 12 up, 12 in 2024-04-21T13:47:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12140.273098 secs 2024-04-21T13:47:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:09 smithi170 ceph-mon[31212]: osdmap e482: 12 total, 12 up, 12 in 2024-04-21T13:47:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:10 smithi077 ceph-mon[27902]: pgmap v6568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:47:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:10 smithi191 ceph-mon[31636]: pgmap v6568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:47:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:10 smithi170 ceph-mon[31212]: pgmap v6568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:47:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12143.512513 secs 2024-04-21T13:47:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:12 smithi077 ceph-mon[27902]: pgmap v6569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:47:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12143.512513 secs 2024-04-21T13:47:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:12 smithi191 ceph-mon[31636]: pgmap v6569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:47:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12143.512513 secs 2024-04-21T13:47:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:12 smithi170 ceph-mon[31212]: pgmap v6569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:47:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12145.273214 secs 2024-04-21T13:47:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:14 smithi077 ceph-mon[27902]: pgmap v6570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:47:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12145.273214 secs 2024-04-21T13:47:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:14 smithi191 ceph-mon[31636]: pgmap v6570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:47:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12145.273214 secs 2024-04-21T13:47:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:14 smithi170 ceph-mon[31212]: pgmap v6570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:47:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:16 smithi077 ceph-mon[27902]: pgmap v6571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:47:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:16 smithi191 ceph-mon[31636]: pgmap v6571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:47:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:16 smithi170 ceph-mon[31212]: pgmap v6571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:47:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12148.512646 secs 2024-04-21T13:47:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12148.512646 secs 2024-04-21T13:47:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12148.512646 secs 2024-04-21T13:47:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:18 smithi077 ceph-mon[27902]: pgmap v6572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:47:19.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:18 smithi170 ceph-mon[31212]: pgmap v6572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:47:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:18 smithi191 ceph-mon[31636]: pgmap v6572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:47:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12150.273326 secs 2024-04-21T13:47:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12150.273326 secs 2024-04-21T13:47:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12150.273326 secs 2024-04-21T13:47:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:20 smithi077 ceph-mon[27902]: pgmap v6573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:47:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:20 smithi191 ceph-mon[31636]: pgmap v6573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:47:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:20 smithi170 ceph-mon[31212]: pgmap v6573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:47:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12153.512797 secs 2024-04-21T13:47:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:22 smithi077 ceph-mon[27902]: pgmap v6574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:47:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12153.512797 secs 2024-04-21T13:47:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:22 smithi191 ceph-mon[31636]: pgmap v6574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:47:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12153.512797 secs 2024-04-21T13:47:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:22 smithi170 ceph-mon[31212]: pgmap v6574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:47:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12155.273440 secs 2024-04-21T13:47:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:24 smithi077 ceph-mon[27902]: pgmap v6575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12155.273440 secs 2024-04-21T13:47:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:24 smithi191 ceph-mon[31636]: pgmap v6575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12155.273440 secs 2024-04-21T13:47:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:24 smithi170 ceph-mon[31212]: pgmap v6575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:26 smithi077 ceph-mon[27902]: pgmap v6576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:26 smithi191 ceph-mon[31636]: pgmap v6576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:26 smithi170 ceph-mon[31212]: pgmap v6576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12158.512913 secs 2024-04-21T13:47:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12158.512913 secs 2024-04-21T13:47:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12158.512913 secs 2024-04-21T13:47:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:28 smithi191 ceph-mon[31636]: pgmap v6577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:28 smithi170 ceph-mon[31212]: pgmap v6577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:28 smithi077 ceph-mon[27902]: pgmap v6577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12160.273561 secs 2024-04-21T13:47:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12160.273561 secs 2024-04-21T13:47:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12160.273561 secs 2024-04-21T13:47:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:30 smithi191 ceph-mon[31636]: pgmap v6578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:30 smithi170 ceph-mon[31212]: pgmap v6578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:30 smithi077 ceph-mon[27902]: pgmap v6578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12163.512975 secs 2024-04-21T13:47:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:32 smithi191 ceph-mon[31636]: pgmap v6579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12163.512975 secs 2024-04-21T13:47:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:32 smithi170 ceph-mon[31212]: pgmap v6579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12163.512975 secs 2024-04-21T13:47:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:32 smithi077 ceph-mon[27902]: pgmap v6579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12165.273682 secs 2024-04-21T13:47:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:34 smithi191 ceph-mon[31636]: pgmap v6580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12165.273682 secs 2024-04-21T13:47:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:34 smithi170 ceph-mon[31212]: pgmap v6580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12165.273682 secs 2024-04-21T13:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:34 smithi077 ceph-mon[27902]: pgmap v6580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:36 smithi191 ceph-mon[31636]: pgmap v6581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:36 smithi170 ceph-mon[31212]: pgmap v6581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:36 smithi077 ceph-mon[27902]: pgmap v6581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12168.513079 secs 2024-04-21T13:47:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12168.513079 secs 2024-04-21T13:47:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12168.513079 secs 2024-04-21T13:47:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:38 smithi191 ceph-mon[31636]: pgmap v6582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:38 smithi170 ceph-mon[31212]: pgmap v6582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:38 smithi077 ceph-mon[27902]: pgmap v6582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12170.273776 secs 2024-04-21T13:47:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12170.273776 secs 2024-04-21T13:47:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12170.273776 secs 2024-04-21T13:47:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:40 smithi191 ceph-mon[31636]: pgmap v6583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:40 smithi170 ceph-mon[31212]: pgmap v6583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:40 smithi077 ceph-mon[27902]: pgmap v6583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12173.513196 secs 2024-04-21T13:47:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:42 smithi191 ceph-mon[31636]: pgmap v6584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12173.513196 secs 2024-04-21T13:47:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:42 smithi170 ceph-mon[31212]: pgmap v6584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12173.513196 secs 2024-04-21T13:47:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:42 smithi077 ceph-mon[27902]: pgmap v6584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12175.273891 secs 2024-04-21T13:47:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:44 smithi191 ceph-mon[31636]: pgmap v6585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12175.273891 secs 2024-04-21T13:47:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:44 smithi170 ceph-mon[31212]: pgmap v6585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12175.273891 secs 2024-04-21T13:47:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:44 smithi077 ceph-mon[27902]: pgmap v6585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:46 smithi191 ceph-mon[31636]: pgmap v6586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:46 smithi170 ceph-mon[31212]: pgmap v6586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:46 smithi077 ceph-mon[27902]: pgmap v6586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12178.513308 secs 2024-04-21T13:47:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12178.513308 secs 2024-04-21T13:47:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12178.513308 secs 2024-04-21T13:47:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:48 smithi170 ceph-mon[31212]: pgmap v6587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:48 smithi191 ceph-mon[31636]: pgmap v6587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:48 smithi077 ceph-mon[27902]: pgmap v6587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12180.274005 secs 2024-04-21T13:47:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:49 smithi191 ceph-mon[31636]: pgmap v6588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12180.274005 secs 2024-04-21T13:47:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:49 smithi170 ceph-mon[31212]: pgmap v6588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12180.274005 secs 2024-04-21T13:47:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:49 smithi077 ceph-mon[27902]: pgmap v6588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12183.513412 secs 2024-04-21T13:47:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:52 smithi170 ceph-mon[31212]: pgmap v6589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:47:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12183.513412 secs 2024-04-21T13:47:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:52 smithi077 ceph-mon[27902]: pgmap v6589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:47:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12183.513412 secs 2024-04-21T13:47:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:52 smithi191 ceph-mon[31636]: pgmap v6589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:47:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:47:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:47:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:47:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:47:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:47:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:47:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:47:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:47:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12185.274073 secs 2024-04-21T13:47:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:54 smithi191 ceph-mon[31636]: pgmap v6590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12185.274073 secs 2024-04-21T13:47:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:54 smithi170 ceph-mon[31212]: pgmap v6590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12185.274073 secs 2024-04-21T13:47:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:54 smithi077 ceph-mon[27902]: pgmap v6590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:47:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:56 smithi191 ceph-mon[31636]: pgmap v6591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:56 smithi170 ceph-mon[31212]: pgmap v6591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:56 smithi077 ceph-mon[27902]: pgmap v6591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:47:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12188.513506 secs 2024-04-21T13:47:58.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12188.513506 secs 2024-04-21T13:47:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12188.513506 secs 2024-04-21T13:47:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:58 smithi191 ceph-mon[31636]: pgmap v6592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:58 smithi170 ceph-mon[31212]: pgmap v6592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:47:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:58 smithi077 ceph-mon[27902]: pgmap v6592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:47:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12190.274154 secs 2024-04-21T13:48:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:47:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12190.274154 secs 2024-04-21T13:48:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:47:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12190.274154 secs 2024-04-21T13:48:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:00 smithi191 ceph-mon[31636]: pgmap v6593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:00 smithi170 ceph-mon[31212]: pgmap v6593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:00 smithi077 ceph-mon[27902]: pgmap v6593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12193.513639 secs 2024-04-21T13:48:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:02 smithi191 ceph-mon[31636]: pgmap v6594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12193.513639 secs 2024-04-21T13:48:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:02 smithi170 ceph-mon[31212]: pgmap v6594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12193.513639 secs 2024-04-21T13:48:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:02 smithi077 ceph-mon[27902]: pgmap v6594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12195.274267 secs 2024-04-21T13:48:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:04 smithi191 ceph-mon[31636]: pgmap v6595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:04 smithi191 ceph-mon[31636]: osdmap e483: 12 total, 12 up, 12 in 2024-04-21T13:48:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12195.274267 secs 2024-04-21T13:48:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:04 smithi170 ceph-mon[31212]: pgmap v6595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:04 smithi170 ceph-mon[31212]: osdmap e483: 12 total, 12 up, 12 in 2024-04-21T13:48:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12195.274267 secs 2024-04-21T13:48:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:04 smithi077 ceph-mon[27902]: pgmap v6595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:04 smithi077 ceph-mon[27902]: osdmap e483: 12 total, 12 up, 12 in 2024-04-21T13:48:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:06 smithi191 ceph-mon[31636]: pgmap v6597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:48:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:06 smithi170 ceph-mon[31212]: pgmap v6597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:48:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:06 smithi077 ceph-mon[27902]: pgmap v6597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:48:08.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12198.513755 secs 2024-04-21T13:48:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12198.513755 secs 2024-04-21T13:48:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12198.513755 secs 2024-04-21T13:48:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:08 smithi191 ceph-mon[31636]: pgmap v6598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:48:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:08 smithi191 ceph-mon[31636]: osdmap e484: 12 total, 12 up, 12 in 2024-04-21T13:48:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:08 smithi170 ceph-mon[31212]: pgmap v6598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:48:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:08 smithi170 ceph-mon[31212]: osdmap e484: 12 total, 12 up, 12 in 2024-04-21T13:48:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:08 smithi077 ceph-mon[27902]: pgmap v6598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:48:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:08 smithi077 ceph-mon[27902]: osdmap e484: 12 total, 12 up, 12 in 2024-04-21T13:48:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12200.274376 secs 2024-04-21T13:48:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12200.274376 secs 2024-04-21T13:48:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12200.274376 secs 2024-04-21T13:48:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:10 smithi191 ceph-mon[31636]: pgmap v6600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:48:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:10 smithi170 ceph-mon[31212]: pgmap v6600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:48:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:10 smithi077 ceph-mon[27902]: pgmap v6600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:48:12.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:11 smithi191 ceph-mon[31636]: pgmap v6601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:48:12.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:11 smithi170 ceph-mon[31212]: pgmap v6601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:48:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:11 smithi077 ceph-mon[27902]: pgmap v6601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:48:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12203.513863 secs 2024-04-21T13:48:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12203.513863 secs 2024-04-21T13:48:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12203.513863 secs 2024-04-21T13:48:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:13 smithi191 ceph-mon[31636]: pgmap v6602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:48:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:13 smithi170 ceph-mon[31212]: pgmap v6602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:48:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:13 smithi077 ceph-mon[27902]: pgmap v6602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12205.274521 secs 2024-04-21T13:48:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12205.274521 secs 2024-04-21T13:48:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12205.274521 secs 2024-04-21T13:48:16.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:15 smithi191 ceph-mon[31636]: pgmap v6603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:48:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:15 smithi170 ceph-mon[31212]: pgmap v6603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:48:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:15 smithi077 ceph-mon[27902]: pgmap v6603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:48:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12208.513979 secs 2024-04-21T13:48:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12208.513979 secs 2024-04-21T13:48:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12208.513979 secs 2024-04-21T13:48:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:18 smithi170 ceph-mon[31212]: pgmap v6604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:48:18.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:18 smithi191 ceph-mon[31636]: pgmap v6604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:48:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:18 smithi077 ceph-mon[27902]: pgmap v6604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:48:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12210.274666 secs 2024-04-21T13:48:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12210.274666 secs 2024-04-21T13:48:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12210.274666 secs 2024-04-21T13:48:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:20 smithi170 ceph-mon[31212]: pgmap v6605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:48:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:20 smithi077 ceph-mon[27902]: pgmap v6605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:48:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:20 smithi191 ceph-mon[31636]: pgmap v6605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:48:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12213.514088 secs 2024-04-21T13:48:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:22 smithi170 ceph-mon[31212]: pgmap v6606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:48:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12213.514088 secs 2024-04-21T13:48:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:22 smithi077 ceph-mon[27902]: pgmap v6606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:48:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12213.514088 secs 2024-04-21T13:48:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:22 smithi191 ceph-mon[31636]: pgmap v6606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:48:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12215.274740 secs 2024-04-21T13:48:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:24 smithi170 ceph-mon[31212]: pgmap v6607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12215.274740 secs 2024-04-21T13:48:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:24 smithi077 ceph-mon[27902]: pgmap v6607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12215.274740 secs 2024-04-21T13:48:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:24 smithi191 ceph-mon[31636]: pgmap v6607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:27.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:26 smithi170 ceph-mon[31212]: pgmap v6608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:26 smithi077 ceph-mon[27902]: pgmap v6608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:26 smithi191 ceph-mon[31636]: pgmap v6608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:28.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12218.514194 secs 2024-04-21T13:48:28.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12218.514194 secs 2024-04-21T13:48:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12218.514194 secs 2024-04-21T13:48:29.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:28 smithi170 ceph-mon[31212]: pgmap v6609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:28 smithi077 ceph-mon[27902]: pgmap v6609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:28 smithi191 ceph-mon[31636]: pgmap v6609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12220.274851 secs 2024-04-21T13:48:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12220.274851 secs 2024-04-21T13:48:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12220.274851 secs 2024-04-21T13:48:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:30 smithi170 ceph-mon[31212]: pgmap v6610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:30 smithi077 ceph-mon[27902]: pgmap v6610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:30 smithi191 ceph-mon[31636]: pgmap v6610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12223.514333 secs 2024-04-21T13:48:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:32 smithi170 ceph-mon[31212]: pgmap v6611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12223.514333 secs 2024-04-21T13:48:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:32 smithi077 ceph-mon[27902]: pgmap v6611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12223.514333 secs 2024-04-21T13:48:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:32 smithi191 ceph-mon[31636]: pgmap v6611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12225.274972 secs 2024-04-21T13:48:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:34 smithi077 ceph-mon[27902]: pgmap v6612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12225.274972 secs 2024-04-21T13:48:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:34 smithi191 ceph-mon[31636]: pgmap v6612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12225.274972 secs 2024-04-21T13:48:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:34 smithi170 ceph-mon[31212]: pgmap v6612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:36 smithi077 ceph-mon[27902]: pgmap v6613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:36 smithi191 ceph-mon[31636]: pgmap v6613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:36 smithi170 ceph-mon[31212]: pgmap v6613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12228.514452 secs 2024-04-21T13:48:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12228.514452 secs 2024-04-21T13:48:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12228.514452 secs 2024-04-21T13:48:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:38 smithi077 ceph-mon[27902]: pgmap v6614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:38 smithi191 ceph-mon[31636]: pgmap v6614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:38 smithi170 ceph-mon[31212]: pgmap v6614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12230.275061 secs 2024-04-21T13:48:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12230.275061 secs 2024-04-21T13:48:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12230.275061 secs 2024-04-21T13:48:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:40 smithi077 ceph-mon[27902]: pgmap v6615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:40 smithi191 ceph-mon[31636]: pgmap v6615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:40 smithi170 ceph-mon[31212]: pgmap v6615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12233.514568 secs 2024-04-21T13:48:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:42 smithi077 ceph-mon[27902]: pgmap v6616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12233.514568 secs 2024-04-21T13:48:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:42 smithi191 ceph-mon[31636]: pgmap v6616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12233.514568 secs 2024-04-21T13:48:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:42 smithi170 ceph-mon[31212]: pgmap v6616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12235.275178 secs 2024-04-21T13:48:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:44 smithi077 ceph-mon[27902]: pgmap v6617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12235.275178 secs 2024-04-21T13:48:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:44 smithi191 ceph-mon[31636]: pgmap v6617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12235.275178 secs 2024-04-21T13:48:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:44 smithi170 ceph-mon[31212]: pgmap v6617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:46 smithi191 ceph-mon[31636]: pgmap v6618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:46 smithi170 ceph-mon[31212]: pgmap v6618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:46 smithi077 ceph-mon[27902]: pgmap v6618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12238.514682 secs 2024-04-21T13:48:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12238.514682 secs 2024-04-21T13:48:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12238.514682 secs 2024-04-21T13:48:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:48 smithi170 ceph-mon[31212]: pgmap v6619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:48 smithi191 ceph-mon[31636]: pgmap v6619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:48 smithi077 ceph-mon[27902]: pgmap v6619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12240.275271 secs 2024-04-21T13:48:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12240.275271 secs 2024-04-21T13:48:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12240.275271 secs 2024-04-21T13:48:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:50 smithi191 ceph-mon[31636]: pgmap v6620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:50 smithi170 ceph-mon[31212]: pgmap v6620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:50 smithi077 ceph-mon[27902]: pgmap v6620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12243.514799 secs 2024-04-21T13:48:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:52 smithi191 ceph-mon[31636]: pgmap v6621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12243.514799 secs 2024-04-21T13:48:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:52 smithi170 ceph-mon[31212]: pgmap v6621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12243.514799 secs 2024-04-21T13:48:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:52 smithi077 ceph-mon[27902]: pgmap v6621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:48:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:48:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:48:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:48:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12245.275392 secs 2024-04-21T13:48:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:54 smithi191 ceph-mon[31636]: pgmap v6622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:48:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:48:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:48:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12245.275392 secs 2024-04-21T13:48:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:54 smithi170 ceph-mon[31212]: pgmap v6622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:48:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:48:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12245.275392 secs 2024-04-21T13:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:54 smithi077 ceph-mon[27902]: pgmap v6622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:48:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:56 smithi191 ceph-mon[31636]: pgmap v6623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:56 smithi170 ceph-mon[31212]: pgmap v6623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:56 smithi077 ceph-mon[27902]: pgmap v6623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:48:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12248.514921 secs 2024-04-21T13:48:58.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12248.514921 secs 2024-04-21T13:48:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12248.514921 secs 2024-04-21T13:48:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:58 smithi191 ceph-mon[31636]: pgmap v6624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:58 smithi170 ceph-mon[31212]: pgmap v6624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:48:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:58 smithi077 ceph-mon[27902]: pgmap v6624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:48:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12250.275509 secs 2024-04-21T13:49:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:48:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12250.275509 secs 2024-04-21T13:49:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:48:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12250.275509 secs 2024-04-21T13:49:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:00 smithi191 ceph-mon[31636]: pgmap v6625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:00 smithi170 ceph-mon[31212]: pgmap v6625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:00 smithi077 ceph-mon[27902]: pgmap v6625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12253.514985 secs 2024-04-21T13:49:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:02 smithi191 ceph-mon[31636]: pgmap v6626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12253.514985 secs 2024-04-21T13:49:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:02 smithi170 ceph-mon[31212]: pgmap v6626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12253.514985 secs 2024-04-21T13:49:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:02 smithi077 ceph-mon[27902]: pgmap v6626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12255.275621 secs 2024-04-21T13:49:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:04 smithi191 ceph-mon[31636]: pgmap v6627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:04 smithi191 ceph-mon[31636]: osdmap e485: 12 total, 12 up, 12 in 2024-04-21T13:49:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12255.275621 secs 2024-04-21T13:49:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:04 smithi170 ceph-mon[31212]: pgmap v6627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:04 smithi170 ceph-mon[31212]: osdmap e485: 12 total, 12 up, 12 in 2024-04-21T13:49:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12255.275621 secs 2024-04-21T13:49:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:04 smithi077 ceph-mon[27902]: pgmap v6627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:04 smithi077 ceph-mon[27902]: osdmap e485: 12 total, 12 up, 12 in 2024-04-21T13:49:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:06 smithi191 ceph-mon[31636]: pgmap v6629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:49:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:06 smithi170 ceph-mon[31212]: pgmap v6629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:49:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:06 smithi077 ceph-mon[27902]: pgmap v6629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:49:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12258.515097 secs 2024-04-21T13:49:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12258.515097 secs 2024-04-21T13:49:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12258.515097 secs 2024-04-21T13:49:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:08 smithi191 ceph-mon[31636]: pgmap v6630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:49:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:08 smithi191 ceph-mon[31636]: osdmap e486: 12 total, 12 up, 12 in 2024-04-21T13:49:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:08 smithi170 ceph-mon[31212]: pgmap v6630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:49:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:08 smithi170 ceph-mon[31212]: osdmap e486: 12 total, 12 up, 12 in 2024-04-21T13:49:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:08 smithi077 ceph-mon[27902]: pgmap v6630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:49:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:08 smithi077 ceph-mon[27902]: osdmap e486: 12 total, 12 up, 12 in 2024-04-21T13:49:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12260.275730 secs 2024-04-21T13:49:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:09 smithi191 ceph-mon[31636]: pgmap v6632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:49:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12260.275730 secs 2024-04-21T13:49:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:09 smithi170 ceph-mon[31212]: pgmap v6632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:49:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12260.275730 secs 2024-04-21T13:49:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:09 smithi077 ceph-mon[27902]: pgmap v6632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:49:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12263.515214 secs 2024-04-21T13:49:13.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:12 smithi170 ceph-mon[31212]: pgmap v6633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:49:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12263.515214 secs 2024-04-21T13:49:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:12 smithi077 ceph-mon[27902]: pgmap v6633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:49:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12263.515214 secs 2024-04-21T13:49:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:12 smithi191 ceph-mon[31636]: pgmap v6633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:49:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12265.275842 secs 2024-04-21T13:49:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:14 smithi170 ceph-mon[31212]: pgmap v6634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:49:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12265.275842 secs 2024-04-21T13:49:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:14 smithi077 ceph-mon[27902]: pgmap v6634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:49:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12265.275842 secs 2024-04-21T13:49:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:14 smithi191 ceph-mon[31636]: pgmap v6634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T13:49:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:16 smithi170 ceph-mon[31212]: pgmap v6635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:49:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:16 smithi077 ceph-mon[27902]: pgmap v6635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:49:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:16 smithi191 ceph-mon[31636]: pgmap v6635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:49:18.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12268.515347 secs 2024-04-21T13:49:18.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12268.515347 secs 2024-04-21T13:49:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12268.515347 secs 2024-04-21T13:49:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:18 smithi170 ceph-mon[31212]: pgmap v6636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:49:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:18 smithi077 ceph-mon[27902]: pgmap v6636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:49:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:18 smithi191 ceph-mon[31636]: pgmap v6636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:49:20.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12270.275947 secs 2024-04-21T13:49:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12270.275947 secs 2024-04-21T13:49:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12270.275947 secs 2024-04-21T13:49:21.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:20 smithi170 ceph-mon[31212]: pgmap v6637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:49:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:20 smithi077 ceph-mon[27902]: pgmap v6637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:49:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:20 smithi191 ceph-mon[31636]: pgmap v6637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:49:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12273.515443 secs 2024-04-21T13:49:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:22 smithi170 ceph-mon[31212]: pgmap v6638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:49:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12273.515443 secs 2024-04-21T13:49:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:22 smithi077 ceph-mon[27902]: pgmap v6638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:49:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12273.515443 secs 2024-04-21T13:49:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:22 smithi191 ceph-mon[31636]: pgmap v6638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:49:25.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12275.276075 secs 2024-04-21T13:49:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:24 smithi170 ceph-mon[31212]: pgmap v6639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12275.276075 secs 2024-04-21T13:49:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:24 smithi077 ceph-mon[27902]: pgmap v6639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12275.276075 secs 2024-04-21T13:49:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:24 smithi191 ceph-mon[31636]: pgmap v6639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:26 smithi170 ceph-mon[31212]: pgmap v6640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:26 smithi077 ceph-mon[27902]: pgmap v6640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:26 smithi191 ceph-mon[31636]: pgmap v6640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12278.515590 secs 2024-04-21T13:49:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12278.515590 secs 2024-04-21T13:49:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12278.515590 secs 2024-04-21T13:49:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:28 smithi077 ceph-mon[27902]: pgmap v6641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:28 smithi191 ceph-mon[31636]: pgmap v6641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:28 smithi170 ceph-mon[31212]: pgmap v6641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12280.276210 secs 2024-04-21T13:49:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12280.276210 secs 2024-04-21T13:49:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12280.276210 secs 2024-04-21T13:49:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:30 smithi077 ceph-mon[27902]: pgmap v6642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:30 smithi191 ceph-mon[31636]: pgmap v6642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:30 smithi170 ceph-mon[31212]: pgmap v6642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12283.515726 secs 2024-04-21T13:49:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:32 smithi077 ceph-mon[27902]: pgmap v6643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12283.515726 secs 2024-04-21T13:49:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:32 smithi191 ceph-mon[31636]: pgmap v6643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12283.515726 secs 2024-04-21T13:49:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:32 smithi170 ceph-mon[31212]: pgmap v6643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12285.276275 secs 2024-04-21T13:49:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:34 smithi077 ceph-mon[27902]: pgmap v6644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12285.276275 secs 2024-04-21T13:49:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:34 smithi191 ceph-mon[31636]: pgmap v6644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12285.276275 secs 2024-04-21T13:49:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:34 smithi170 ceph-mon[31212]: pgmap v6644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:36 smithi077 ceph-mon[27902]: pgmap v6645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:36 smithi191 ceph-mon[31636]: pgmap v6645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:36 smithi170 ceph-mon[31212]: pgmap v6645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12288.515805 secs 2024-04-21T13:49:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12288.515805 secs 2024-04-21T13:49:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12288.515805 secs 2024-04-21T13:49:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:38 smithi077 ceph-mon[27902]: pgmap v6646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:38 smithi191 ceph-mon[31636]: pgmap v6646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:38 smithi170 ceph-mon[31212]: pgmap v6646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12290.276400 secs 2024-04-21T13:49:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12290.276400 secs 2024-04-21T13:49:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12290.276400 secs 2024-04-21T13:49:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:40 smithi077 ceph-mon[27902]: pgmap v6647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:40 smithi191 ceph-mon[31636]: pgmap v6647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:40 smithi170 ceph-mon[31212]: pgmap v6647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12293.515918 secs 2024-04-21T13:49:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:42 smithi077 ceph-mon[27902]: pgmap v6648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12293.515918 secs 2024-04-21T13:49:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:42 smithi191 ceph-mon[31636]: pgmap v6648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12293.515918 secs 2024-04-21T13:49:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:42 smithi170 ceph-mon[31212]: pgmap v6648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12295.276510 secs 2024-04-21T13:49:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:44 smithi077 ceph-mon[27902]: pgmap v6649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12295.276510 secs 2024-04-21T13:49:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:44 smithi191 ceph-mon[31636]: pgmap v6649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12295.276510 secs 2024-04-21T13:49:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:44 smithi170 ceph-mon[31212]: pgmap v6649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:46 smithi077 ceph-mon[27902]: pgmap v6650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:46 smithi191 ceph-mon[31636]: pgmap v6650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:46 smithi170 ceph-mon[31212]: pgmap v6650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12298.516027 secs 2024-04-21T13:49:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12298.516027 secs 2024-04-21T13:49:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12298.516027 secs 2024-04-21T13:49:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:48 smithi077 ceph-mon[27902]: pgmap v6651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:49.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:48 smithi170 ceph-mon[31212]: pgmap v6651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:48 smithi191 ceph-mon[31636]: pgmap v6651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12300.276624 secs 2024-04-21T13:49:50.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12300.276624 secs 2024-04-21T13:49:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12300.276624 secs 2024-04-21T13:49:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:50 smithi077 ceph-mon[27902]: pgmap v6652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:51.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:50 smithi191 ceph-mon[31636]: pgmap v6652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:50 smithi170 ceph-mon[31212]: pgmap v6652: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12303.516137 secs 2024-04-21T13:49:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:52 smithi077 ceph-mon[27902]: pgmap v6653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:53.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12303.516137 secs 2024-04-21T13:49:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:52 smithi191 ceph-mon[31636]: pgmap v6653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12303.516137 secs 2024-04-21T13:49:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:52 smithi170 ceph-mon[31212]: pgmap v6653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:49:55.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12305.276700 secs 2024-04-21T13:49:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:54 smithi191 ceph-mon[31636]: pgmap v6654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:49:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12305.276700 secs 2024-04-21T13:49:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:54 smithi170 ceph-mon[31212]: pgmap v6654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:49:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12305.276700 secs 2024-04-21T13:49:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:54 smithi077 ceph-mon[27902]: pgmap v6654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:49:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:49:56.053+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:49:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:49:56.053+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:49:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:49:56.053+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:49:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:49:56.053+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:49:56.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:49:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:49:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:49:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:49:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:49:56.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:49:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:49:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:49:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:49:57.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:56 smithi191 ceph-mon[31636]: pgmap v6655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:56 smithi170 ceph-mon[31212]: pgmap v6655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:56 smithi077 ceph-mon[27902]: pgmap v6655: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:49:58.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12308.516267 secs 2024-04-21T13:49:58.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12308.516267 secs 2024-04-21T13:49:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12308.516267 secs 2024-04-21T13:49:59.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:58 smithi191 ceph-mon[31636]: pgmap v6656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:58 smithi170 ceph-mon[31212]: pgmap v6656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:49:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:58 smithi077 ceph-mon[27902]: pgmap v6656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:00.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:49:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12310.276801 secs 2024-04-21T13:50:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:49:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12310.276801 secs 2024-04-21T13:50:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:49:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12310.276801 secs 2024-04-21T13:50:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:00 smithi191 ceph-mon[31636]: pgmap v6657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:01.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:50:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:00 smithi170 ceph-mon[31212]: pgmap v6657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:50:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:00 smithi077 ceph-mon[27902]: pgmap v6657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T13:50:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12313.516387 secs 2024-04-21T13:50:03.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:02 smithi191 ceph-mon[31636]: pgmap v6658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:50:03.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12313.516387 secs 2024-04-21T13:50:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:02 smithi170 ceph-mon[31212]: pgmap v6658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:50:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12313.516387 secs 2024-04-21T13:50:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:02 smithi077 ceph-mon[27902]: pgmap v6658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:50:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12315.276922 secs 2024-04-21T13:50:05.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:04 smithi191 ceph-mon[31636]: pgmap v6659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:50:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:04 smithi191 ceph-mon[31636]: osdmap e487: 12 total, 12 up, 12 in 2024-04-21T13:50:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12315.276922 secs 2024-04-21T13:50:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:04 smithi170 ceph-mon[31212]: pgmap v6659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:50:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:04 smithi170 ceph-mon[31212]: osdmap e487: 12 total, 12 up, 12 in 2024-04-21T13:50:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12315.276922 secs 2024-04-21T13:50:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:04 smithi077 ceph-mon[27902]: pgmap v6659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T13:50:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:04 smithi077 ceph-mon[27902]: osdmap e487: 12 total, 12 up, 12 in 2024-04-21T13:50:07.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:06 smithi191 ceph-mon[31636]: pgmap v6661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:50:07.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:06 smithi170 ceph-mon[31212]: pgmap v6661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:50:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:06 smithi077 ceph-mon[27902]: pgmap v6661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:50:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12318.516500 secs 2024-04-21T13:50:08.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12318.516500 secs 2024-04-21T13:50:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12318.516500 secs 2024-04-21T13:50:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:08 smithi191 ceph-mon[31636]: pgmap v6662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:50:09.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:08 smithi191 ceph-mon[31636]: osdmap e488: 12 total, 12 up, 12 in 2024-04-21T13:50:09.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:08 smithi170 ceph-mon[31212]: pgmap v6662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:50:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:08 smithi170 ceph-mon[31212]: osdmap e488: 12 total, 12 up, 12 in 2024-04-21T13:50:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:08 smithi077 ceph-mon[27902]: pgmap v6662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:50:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:08 smithi077 ceph-mon[27902]: osdmap e488: 12 total, 12 up, 12 in 2024-04-21T13:50:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:10.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12320.277000 secs 2024-04-21T13:50:10.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12320.277000 secs 2024-04-21T13:50:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12320.277000 secs 2024-04-21T13:50:11.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:10 smithi191 ceph-mon[31636]: pgmap v6664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:50:11.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:10 smithi170 ceph-mon[31212]: pgmap v6664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:50:11.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:10 smithi077 ceph-mon[27902]: pgmap v6664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:50:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12323.516650 secs 2024-04-21T13:50:13.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:12 smithi191 ceph-mon[31636]: pgmap v6665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:50:13.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12323.516650 secs 2024-04-21T13:50:13.385 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:12 smithi170 ceph-mon[31212]: pgmap v6665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:50:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12323.516650 secs 2024-04-21T13:50:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:12 smithi077 ceph-mon[27902]: pgmap v6665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:50:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12325.277115 secs 2024-04-21T13:50:15.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:14 smithi191 ceph-mon[31636]: pgmap v6666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 312 B/s wr, 6 op/s 2024-04-21T13:50:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12325.277115 secs 2024-04-21T13:50:15.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:14 smithi170 ceph-mon[31212]: pgmap v6666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 312 B/s wr, 6 op/s 2024-04-21T13:50:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12325.277115 secs 2024-04-21T13:50:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:14 smithi077 ceph-mon[27902]: pgmap v6666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 312 B/s wr, 6 op/s 2024-04-21T13:50:17.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:16 smithi191 ceph-mon[31636]: pgmap v6667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:50:17.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:16 smithi170 ceph-mon[31212]: pgmap v6667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:50:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:16 smithi077 ceph-mon[27902]: pgmap v6667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:50:18.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12328.516794 secs 2024-04-21T13:50:18.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12328.516794 secs 2024-04-21T13:50:18.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12328.516794 secs 2024-04-21T13:50:19.206 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:18 smithi170 ceph-mon[31212]: pgmap v6668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:50:19.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:18 smithi191 ceph-mon[31636]: pgmap v6668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:50:19.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:18 smithi077 ceph-mon[27902]: pgmap v6668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:50:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:20.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12330.277233 secs 2024-04-21T13:50:20.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12330.277233 secs 2024-04-21T13:50:20.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12330.277233 secs 2024-04-21T13:50:21.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:20 smithi191 ceph-mon[31636]: pgmap v6669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:50:21.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:20 smithi170 ceph-mon[31212]: pgmap v6669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:50:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:20 smithi077 ceph-mon[27902]: pgmap v6669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:50:23.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12333.516842 secs 2024-04-21T13:50:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:22 smithi191 ceph-mon[31636]: pgmap v6670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:50:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12333.516842 secs 2024-04-21T13:50:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:22 smithi170 ceph-mon[31212]: pgmap v6670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:50:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12333.516842 secs 2024-04-21T13:50:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:22 smithi077 ceph-mon[27902]: pgmap v6670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:50:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12335.277296 secs 2024-04-21T13:50:25.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:24 smithi191 ceph-mon[31636]: pgmap v6671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12335.277296 secs 2024-04-21T13:50:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:24 smithi170 ceph-mon[31212]: pgmap v6671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:25.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12335.277296 secs 2024-04-21T13:50:25.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:24 smithi077 ceph-mon[27902]: pgmap v6671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:26.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:25 smithi191 ceph-mon[31636]: pgmap v6672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:26.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:25 smithi170 ceph-mon[31212]: pgmap v6672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:25 smithi077 ceph-mon[27902]: pgmap v6672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:27.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12338.516957 secs 2024-04-21T13:50:27.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12338.516957 secs 2024-04-21T13:50:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12338.516957 secs 2024-04-21T13:50:28.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:28 smithi077 ceph-mon[27902]: pgmap v6673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:28.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:28 smithi191 ceph-mon[31636]: pgmap v6673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:28 smithi170 ceph-mon[31212]: pgmap v6673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:29.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12340.277416 secs 2024-04-21T13:50:29.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12340.277416 secs 2024-04-21T13:50:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12340.277416 secs 2024-04-21T13:50:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:30.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:30 smithi077 ceph-mon[27902]: pgmap v6674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:30.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:30 smithi191 ceph-mon[31636]: pgmap v6674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:30 smithi170 ceph-mon[31212]: pgmap v6674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12343.517079 secs 2024-04-21T13:50:33.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:32 smithi170 ceph-mon[31212]: pgmap v6675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:33.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12343.517079 secs 2024-04-21T13:50:33.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:32 smithi077 ceph-mon[27902]: pgmap v6675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:33.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12343.517079 secs 2024-04-21T13:50:33.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:32 smithi191 ceph-mon[31636]: pgmap v6675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:35.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12345.277535 secs 2024-04-21T13:50:35.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:34 smithi170 ceph-mon[31212]: pgmap v6676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12345.277535 secs 2024-04-21T13:50:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:34 smithi077 ceph-mon[27902]: pgmap v6676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:35.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12345.277535 secs 2024-04-21T13:50:35.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:34 smithi191 ceph-mon[31636]: pgmap v6676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:37.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:36 smithi170 ceph-mon[31212]: pgmap v6677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:37.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:36 smithi077 ceph-mon[27902]: pgmap v6677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:37.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:36 smithi191 ceph-mon[31636]: pgmap v6677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12348.517149 secs 2024-04-21T13:50:38.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12348.517149 secs 2024-04-21T13:50:38.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12348.517149 secs 2024-04-21T13:50:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:38 smithi077 ceph-mon[27902]: pgmap v6678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:39.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:38 smithi191 ceph-mon[31636]: pgmap v6678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:39.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:38 smithi170 ceph-mon[31212]: pgmap v6678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:40.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12350.277664 secs 2024-04-21T13:50:40.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12350.277664 secs 2024-04-21T13:50:40.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12350.277664 secs 2024-04-21T13:50:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:40 smithi077 ceph-mon[27902]: pgmap v6679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:41.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:40 smithi191 ceph-mon[31636]: pgmap v6679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:41.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:40 smithi170 ceph-mon[31212]: pgmap v6679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12353.517263 secs 2024-04-21T13:50:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:42 smithi077 ceph-mon[27902]: pgmap v6680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:43.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12353.517263 secs 2024-04-21T13:50:43.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:42 smithi191 ceph-mon[31636]: pgmap v6680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:43.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12353.517263 secs 2024-04-21T13:50:43.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:42 smithi170 ceph-mon[31212]: pgmap v6680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:45.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12355.277790 secs 2024-04-21T13:50:45.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:44 smithi077 ceph-mon[27902]: pgmap v6681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:45.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12355.277790 secs 2024-04-21T13:50:45.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:44 smithi191 ceph-mon[31636]: pgmap v6681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:45.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12355.277790 secs 2024-04-21T13:50:45.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:44 smithi170 ceph-mon[31212]: pgmap v6681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:47.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:46 smithi077 ceph-mon[27902]: pgmap v6682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:47.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:46 smithi191 ceph-mon[31636]: pgmap v6682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:47.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:46 smithi170 ceph-mon[31212]: pgmap v6682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:48.117 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12358.517377 secs 2024-04-21T13:50:48.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12358.517377 secs 2024-04-21T13:50:48.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12358.517377 secs 2024-04-21T13:50:49.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:48 smithi077 ceph-mon[27902]: pgmap v6683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:49.205 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:48 smithi170 ceph-mon[31212]: pgmap v6683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:49.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:48 smithi191 ceph-mon[31636]: pgmap v6683: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:50.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12360.277904 secs 2024-04-21T13:50:50.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12360.277904 secs 2024-04-21T13:50:50.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12360.277904 secs 2024-04-21T13:50:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:50 smithi077 ceph-mon[27902]: pgmap v6684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:51.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:50 smithi191 ceph-mon[31636]: pgmap v6684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:51.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:50 smithi170 ceph-mon[31212]: pgmap v6684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:53.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12363.517443 secs 2024-04-21T13:50:53.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:52 smithi077 ceph-mon[27902]: pgmap v6685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:53.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12363.517443 secs 2024-04-21T13:50:53.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:52 smithi191 ceph-mon[31636]: pgmap v6685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:53.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12363.517443 secs 2024-04-21T13:50:53.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:52 smithi170 ceph-mon[31212]: pgmap v6685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:50:55.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12365.278011 secs 2024-04-21T13:50:55.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:54 smithi077 ceph-mon[27902]: pgmap v6686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:55.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12365.278011 secs 2024-04-21T13:50:55.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:54 smithi191 ceph-mon[31636]: pgmap v6686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:55.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12365.278011 secs 2024-04-21T13:50:55.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:54 smithi170 ceph-mon[31212]: pgmap v6686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:56.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:50:56.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:50:56.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:50:57.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:56 smithi077 ceph-mon[27902]: pgmap v6687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:57.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:50:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:50:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:50:57.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:56 smithi191 ceph-mon[31636]: pgmap v6687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:57.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:50:57.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:50:57.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:50:57.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:56 smithi170 ceph-mon[31212]: pgmap v6687: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:50:57.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:50:57.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:50:57.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:50:58.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12368.517576 secs 2024-04-21T13:50:58.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12368.517576 secs 2024-04-21T13:50:58.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12368.517576 secs 2024-04-21T13:50:59.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:58 smithi077 ceph-mon[27902]: pgmap v6688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:59.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:58 smithi191 ceph-mon[31636]: pgmap v6688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:50:59.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:58 smithi170 ceph-mon[31212]: pgmap v6688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:00.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:50:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12370.278091 secs 2024-04-21T13:51:00.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:50:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12370.278091 secs 2024-04-21T13:51:00.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:50:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12370.278091 secs 2024-04-21T13:51:01.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:00 smithi077 ceph-mon[27902]: pgmap v6689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:01.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:00 smithi191 ceph-mon[31636]: pgmap v6689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:01.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:00 smithi170 ceph-mon[31212]: pgmap v6689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:03.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12373.517712 secs 2024-04-21T13:51:03.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:02 smithi077 ceph-mon[27902]: pgmap v6690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:51:03.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12373.517712 secs 2024-04-21T13:51:03.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:02 smithi191 ceph-mon[31636]: pgmap v6690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:51:03.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12373.517712 secs 2024-04-21T13:51:03.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:02 smithi170 ceph-mon[31212]: pgmap v6690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T13:51:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:05.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12375.278167 secs 2024-04-21T13:51:05.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:04 smithi077 ceph-mon[27902]: pgmap v6691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T13:51:05.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:04 smithi077 ceph-mon[27902]: osdmap e489: 12 total, 12 up, 12 in 2024-04-21T13:51:05.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12375.278167 secs 2024-04-21T13:51:05.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:04 smithi191 ceph-mon[31636]: pgmap v6691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T13:51:05.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:04 smithi191 ceph-mon[31636]: osdmap e489: 12 total, 12 up, 12 in 2024-04-21T13:51:05.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12375.278167 secs 2024-04-21T13:51:05.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:04 smithi170 ceph-mon[31212]: pgmap v6691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T13:51:05.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:04 smithi170 ceph-mon[31212]: osdmap e489: 12 total, 12 up, 12 in 2024-04-21T13:51:07.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:06 smithi077 ceph-mon[27902]: pgmap v6693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:51:07.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:06 smithi191 ceph-mon[31636]: pgmap v6693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:51:07.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:06 smithi170 ceph-mon[31212]: pgmap v6693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:51:08.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12378.517803 secs 2024-04-21T13:51:08.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12378.517803 secs 2024-04-21T13:51:08.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12378.517803 secs 2024-04-21T13:51:09.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:08 smithi191 ceph-mon[31636]: pgmap v6694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:51:09.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:08 smithi170 ceph-mon[31212]: pgmap v6694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:51:09.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:08 smithi077 ceph-mon[27902]: pgmap v6694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:51:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:10.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12380.278278 secs 2024-04-21T13:51:10.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:09 smithi191 ceph-mon[31636]: osdmap e490: 12 total, 12 up, 12 in 2024-04-21T13:51:10.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12380.278278 secs 2024-04-21T13:51:10.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:09 smithi170 ceph-mon[31212]: osdmap e490: 12 total, 12 up, 12 in 2024-04-21T13:51:10.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12380.278278 secs 2024-04-21T13:51:10.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:09 smithi077 ceph-mon[27902]: osdmap e490: 12 total, 12 up, 12 in 2024-04-21T13:51:11.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:10 smithi191 ceph-mon[31636]: pgmap v6696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:51:11.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:10 smithi170 ceph-mon[31212]: pgmap v6696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:51:11.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:10 smithi077 ceph-mon[27902]: pgmap v6696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-21T13:51:13.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12383.517918 secs 2024-04-21T13:51:13.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:12 smithi191 ceph-mon[31636]: pgmap v6697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:51:13.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12383.517918 secs 2024-04-21T13:51:13.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:12 smithi170 ceph-mon[31212]: pgmap v6697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:51:13.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12383.517918 secs 2024-04-21T13:51:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:12 smithi077 ceph-mon[27902]: pgmap v6697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T13:51:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:15.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12385.278385 secs 2024-04-21T13:51:15.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:14 smithi191 ceph-mon[31636]: pgmap v6698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 311 B/s wr, 6 op/s 2024-04-21T13:51:15.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12385.278385 secs 2024-04-21T13:51:15.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:14 smithi170 ceph-mon[31212]: pgmap v6698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 311 B/s wr, 6 op/s 2024-04-21T13:51:15.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12385.278385 secs 2024-04-21T13:51:15.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:14 smithi077 ceph-mon[27902]: pgmap v6698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 311 B/s wr, 6 op/s 2024-04-21T13:51:17.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:16 smithi191 ceph-mon[31636]: pgmap v6699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:51:17.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:16 smithi170 ceph-mon[31212]: pgmap v6699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:51:17.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:16 smithi077 ceph-mon[27902]: pgmap v6699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:51:18.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12388.518030 secs 2024-04-21T13:51:18.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12388.518030 secs 2024-04-21T13:51:18.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12388.518030 secs 2024-04-21T13:51:19.204 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:18 smithi170 ceph-mon[31212]: pgmap v6700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:51:19.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:18 smithi191 ceph-mon[31636]: pgmap v6700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:51:19.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:18 smithi077 ceph-mon[27902]: pgmap v6700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:51:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:20.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12390.278518 secs 2024-04-21T13:51:20.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12390.278518 secs 2024-04-21T13:51:20.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12390.278518 secs 2024-04-21T13:51:21.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:20 smithi191 ceph-mon[31636]: pgmap v6701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:51:21.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:20 smithi170 ceph-mon[31212]: pgmap v6701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:51:21.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:20 smithi077 ceph-mon[27902]: pgmap v6701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:51:23.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12393.518121 secs 2024-04-21T13:51:23.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:22 smithi191 ceph-mon[31636]: pgmap v6702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:51:23.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12393.518121 secs 2024-04-21T13:51:23.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:22 smithi170 ceph-mon[31212]: pgmap v6702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:51:23.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12393.518121 secs 2024-04-21T13:51:23.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:22 smithi077 ceph-mon[27902]: pgmap v6702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:51:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:25.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12395.278632 secs 2024-04-21T13:51:25.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:24 smithi191 ceph-mon[31636]: pgmap v6703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:25.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12395.278632 secs 2024-04-21T13:51:25.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:24 smithi170 ceph-mon[31212]: pgmap v6703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:25.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12395.278632 secs 2024-04-21T13:51:25.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:24 smithi077 ceph-mon[27902]: pgmap v6703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:27.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:26 smithi191 ceph-mon[31636]: pgmap v6704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:27.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:26 smithi170 ceph-mon[31212]: pgmap v6704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:27.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:26 smithi077 ceph-mon[27902]: pgmap v6704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:28.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12398.518233 secs 2024-04-21T13:51:28.283 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12398.518233 secs 2024-04-21T13:51:28.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12398.518233 secs 2024-04-21T13:51:29.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:28 smithi191 ceph-mon[31636]: pgmap v6705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:29.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:28 smithi170 ceph-mon[31212]: pgmap v6705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:29.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:28 smithi077 ceph-mon[27902]: pgmap v6705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:30.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12400.278744 secs 2024-04-21T13:51:30.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12400.278744 secs 2024-04-21T13:51:30.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12400.278744 secs 2024-04-21T13:51:31.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:30 smithi191 ceph-mon[31636]: pgmap v6706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:31.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:30 smithi170 ceph-mon[31212]: pgmap v6706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:31.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:30 smithi077 ceph-mon[27902]: pgmap v6706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:33.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12403.518367 secs 2024-04-21T13:51:33.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:32 smithi191 ceph-mon[31636]: pgmap v6707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:33.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12403.518367 secs 2024-04-21T13:51:33.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:32 smithi170 ceph-mon[31212]: pgmap v6707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:33.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12403.518367 secs 2024-04-21T13:51:33.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:32 smithi077 ceph-mon[27902]: pgmap v6707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:35.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12405.278878 secs 2024-04-21T13:51:35.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:34 smithi191 ceph-mon[31636]: pgmap v6708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:35.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12405.278878 secs 2024-04-21T13:51:35.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:34 smithi170 ceph-mon[31212]: pgmap v6708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:35.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12405.278878 secs 2024-04-21T13:51:35.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:34 smithi077 ceph-mon[27902]: pgmap v6708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:51:37.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:36 smithi191 ceph-mon[31636]: pgmap v6709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:37.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:36 smithi170 ceph-mon[31212]: pgmap v6709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:37.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:36 smithi077 ceph-mon[27902]: pgmap v6709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:38.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12408.518478 secs 2024-04-21T13:51:38.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12408.518478 secs 2024-04-21T13:51:38.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12408.518478 secs 2024-04-21T13:51:39.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:38 smithi191 ceph-mon[31636]: pgmap v6710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:39.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:38 smithi170 ceph-mon[31212]: pgmap v6710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:39.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:38 smithi077 ceph-mon[27902]: pgmap v6710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:40.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12410.278937 secs 2024-04-21T13:51:40.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12410.278937 secs 2024-04-21T13:51:40.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12410.278937 secs 2024-04-21T13:51:41.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:40 smithi170 ceph-mon[31212]: pgmap v6711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:41.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:40 smithi077 ceph-mon[27902]: pgmap v6711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:41.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:40 smithi191 ceph-mon[31636]: pgmap v6711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:42.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:41 smithi170 ceph-mon[31212]: pgmap v6712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:42.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:41 smithi077 ceph-mon[27902]: pgmap v6712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:42.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:41 smithi191 ceph-mon[31636]: pgmap v6712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:43.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12413.518590 secs 2024-04-21T13:51:43.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12413.518590 secs 2024-04-21T13:51:43.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12413.518590 secs 2024-04-21T13:51:44.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:43 smithi170 ceph-mon[31212]: pgmap v6713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:44.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:43 smithi077 ceph-mon[27902]: pgmap v6713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:44.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:43 smithi191 ceph-mon[31636]: pgmap v6713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:45.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12415.279056 secs 2024-04-21T13:51:45.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12415.279056 secs 2024-04-21T13:51:45.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12415.279056 secs 2024-04-21T13:51:46.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:45 smithi170 ceph-mon[31212]: pgmap v6714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:46.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:45 smithi077 ceph-mon[27902]: pgmap v6714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:46.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:45 smithi191 ceph-mon[31636]: pgmap v6714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:47.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12418.518710 secs 2024-04-21T13:51:47.714 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12418.518710 secs 2024-04-21T13:51:47.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12418.518710 secs 2024-04-21T13:51:48.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:48 smithi191 ceph-mon[31636]: pgmap v6715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:48.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:48 smithi077 ceph-mon[27902]: pgmap v6715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:48.802 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:48 smithi170 ceph-mon[31212]: pgmap v6715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:49.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12420.279151 secs 2024-04-21T13:51:49.704 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12420.279151 secs 2024-04-21T13:51:49.714 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12420.279151 secs 2024-04-21T13:51:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:50.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:50 smithi077 ceph-mon[27902]: pgmap v6716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:50.714 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:50 smithi191 ceph-mon[31636]: pgmap v6716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:51.005 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:50 smithi170 ceph-mon[31212]: pgmap v6716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:53.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12423.518816 secs 2024-04-21T13:51:53.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:52 smithi077 ceph-mon[27902]: pgmap v6717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:53.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12423.518816 secs 2024-04-21T13:51:53.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:52 smithi191 ceph-mon[31636]: pgmap v6717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:53.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12423.518816 secs 2024-04-21T13:51:53.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:52 smithi170 ceph-mon[31212]: pgmap v6717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:51:55.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12425.279268 secs 2024-04-21T13:51:55.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:54 smithi077 ceph-mon[27902]: pgmap v6718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:55.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12425.279268 secs 2024-04-21T13:51:55.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:54 smithi191 ceph-mon[31636]: pgmap v6718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:55.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12425.279268 secs 2024-04-21T13:51:55.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:54 smithi170 ceph-mon[31212]: pgmap v6718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:57.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:56 smithi077 ceph-mon[27902]: pgmap v6719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:57.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:51:57.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:56 smithi191 ceph-mon[31636]: pgmap v6719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:57.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:51:57.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:56 smithi170 ceph-mon[31212]: pgmap v6719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:51:57.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:51:58.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12428.518905 secs 2024-04-21T13:51:58.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12428.518905 secs 2024-04-21T13:51:58.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12428.518905 secs 2024-04-21T13:51:59.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:58 smithi077 ceph-mon[27902]: pgmap v6720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:59.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:58 smithi191 ceph-mon[31636]: pgmap v6720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:59.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:58 smithi170 ceph-mon[31212]: pgmap v6720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:51:59.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:51:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12430.279344 secs 2024-04-21T13:52:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:00.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:51:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12430.279344 secs 2024-04-21T13:52:00.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:51:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12430.279344 secs 2024-04-21T13:52:00.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:00 smithi077 ceph-mon[27902]: pgmap v6721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:00.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:00.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:00.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:52:00.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:52:00.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:01.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:00 smithi191 ceph-mon[31636]: pgmap v6721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:01.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:01.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:01.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:52:01.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:52:01.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:01.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:00 smithi170 ceph-mon[31212]: pgmap v6721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:01.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:01.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:01.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:52:01.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:52:01.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:52:03.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12433.519013 secs 2024-04-21T13:52:03.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:02 smithi077 ceph-mon[27902]: pgmap v6722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:03.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12433.519013 secs 2024-04-21T13:52:03.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:02 smithi191 ceph-mon[31636]: pgmap v6722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:03.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12433.519013 secs 2024-04-21T13:52:03.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:02 smithi170 ceph-mon[31212]: pgmap v6722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:05.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12435.279465 secs 2024-04-21T13:52:05.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:04 smithi077 ceph-mon[27902]: pgmap v6723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:04 smithi077 ceph-mon[27902]: osdmap e491: 12 total, 12 up, 12 in 2024-04-21T13:52:05.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12435.279465 secs 2024-04-21T13:52:05.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:04 smithi191 ceph-mon[31636]: pgmap v6723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:05.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:04 smithi191 ceph-mon[31636]: osdmap e491: 12 total, 12 up, 12 in 2024-04-21T13:52:05.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12435.279465 secs 2024-04-21T13:52:05.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:04 smithi170 ceph-mon[31212]: pgmap v6723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:05.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:04 smithi170 ceph-mon[31212]: osdmap e491: 12 total, 12 up, 12 in 2024-04-21T13:52:07.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:06 smithi077 ceph-mon[27902]: pgmap v6725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:52:07.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:06 smithi191 ceph-mon[31636]: pgmap v6725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:52:07.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:06 smithi170 ceph-mon[31212]: pgmap v6725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:52:08.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12438.519145 secs 2024-04-21T13:52:08.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12438.519145 secs 2024-04-21T13:52:08.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12438.519145 secs 2024-04-21T13:52:09.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:08 smithi077 ceph-mon[27902]: pgmap v6726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:52:09.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:08 smithi191 ceph-mon[31636]: pgmap v6726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:52:09.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:08 smithi170 ceph-mon[31212]: pgmap v6726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:52:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:10.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12440.279581 secs 2024-04-21T13:52:10.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:09 smithi191 ceph-mon[31636]: osdmap e492: 12 total, 12 up, 12 in 2024-04-21T13:52:10.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12440.279581 secs 2024-04-21T13:52:10.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:09 smithi170 ceph-mon[31212]: osdmap e492: 12 total, 12 up, 12 in 2024-04-21T13:52:10.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12440.279581 secs 2024-04-21T13:52:10.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:09 smithi077 ceph-mon[27902]: osdmap e492: 12 total, 12 up, 12 in 2024-04-21T13:52:11.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:10 smithi191 ceph-mon[31636]: pgmap v6728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:52:11.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:10 smithi170 ceph-mon[31212]: pgmap v6728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:52:11.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:10 smithi077 ceph-mon[27902]: pgmap v6728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:52:13.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12443.519200 secs 2024-04-21T13:52:13.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:12 smithi191 ceph-mon[31636]: pgmap v6729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:52:13.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12443.519200 secs 2024-04-21T13:52:13.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:12 smithi170 ceph-mon[31212]: pgmap v6729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:52:13.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12443.519200 secs 2024-04-21T13:52:13.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:12 smithi077 ceph-mon[27902]: pgmap v6729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:52:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:15.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12445.279698 secs 2024-04-21T13:52:15.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:14 smithi191 ceph-mon[31636]: pgmap v6730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:52:15.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12445.279698 secs 2024-04-21T13:52:15.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:14 smithi170 ceph-mon[31212]: pgmap v6730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:52:15.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12445.279698 secs 2024-04-21T13:52:15.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:14 smithi077 ceph-mon[27902]: pgmap v6730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:52:17.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:16 smithi191 ceph-mon[31636]: pgmap v6731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:52:17.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:16 smithi170 ceph-mon[31212]: pgmap v6731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:52:17.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:16 smithi077 ceph-mon[27902]: pgmap v6731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:52:18.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12448.519330 secs 2024-04-21T13:52:18.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12448.519330 secs 2024-04-21T13:52:18.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12448.519330 secs 2024-04-21T13:52:19.203 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:18 smithi170 ceph-mon[31212]: pgmap v6732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:52:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:18 smithi191 ceph-mon[31636]: pgmap v6732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:52:19.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:18 smithi077 ceph-mon[27902]: pgmap v6732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:52:20.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:20.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12450.279890 secs 2024-04-21T13:52:20.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12450.279890 secs 2024-04-21T13:52:20.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12450.279890 secs 2024-04-21T13:52:21.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:20 smithi191 ceph-mon[31636]: pgmap v6733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:52:21.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:20 smithi170 ceph-mon[31212]: pgmap v6733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:52:21.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:20 smithi077 ceph-mon[27902]: pgmap v6733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:52:23.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12453.519493 secs 2024-04-21T13:52:23.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:22 smithi191 ceph-mon[31636]: pgmap v6734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:52:23.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12453.519493 secs 2024-04-21T13:52:23.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:22 smithi170 ceph-mon[31212]: pgmap v6734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:52:23.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12453.519493 secs 2024-04-21T13:52:23.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:22 smithi077 ceph-mon[27902]: pgmap v6734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:52:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:25.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12455.280008 secs 2024-04-21T13:52:25.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:24 smithi191 ceph-mon[31636]: pgmap v6735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:25.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12455.280008 secs 2024-04-21T13:52:25.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:24 smithi170 ceph-mon[31212]: pgmap v6735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:25.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12455.280008 secs 2024-04-21T13:52:25.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:24 smithi077 ceph-mon[27902]: pgmap v6735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:27.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:26 smithi191 ceph-mon[31636]: pgmap v6736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:27.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:26 smithi170 ceph-mon[31212]: pgmap v6736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:27.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:26 smithi077 ceph-mon[27902]: pgmap v6736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:28.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12458.519610 secs 2024-04-21T13:52:28.281 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12458.519610 secs 2024-04-21T13:52:28.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12458.519610 secs 2024-04-21T13:52:29.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:28 smithi191 ceph-mon[31636]: pgmap v6737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:29.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:28 smithi170 ceph-mon[31212]: pgmap v6737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:29.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:28 smithi077 ceph-mon[27902]: pgmap v6737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:30.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:30.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12460.280156 secs 2024-04-21T13:52:30.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12460.280156 secs 2024-04-21T13:52:30.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12460.280156 secs 2024-04-21T13:52:31.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:30 smithi191 ceph-mon[31636]: pgmap v6738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:31.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:30 smithi170 ceph-mon[31212]: pgmap v6738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:31.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:30 smithi077 ceph-mon[27902]: pgmap v6738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:33.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12463.519728 secs 2024-04-21T13:52:33.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:32 smithi170 ceph-mon[31212]: pgmap v6739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:33.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12463.519728 secs 2024-04-21T13:52:33.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:32 smithi077 ceph-mon[27902]: pgmap v6739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:33.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12463.519728 secs 2024-04-21T13:52:33.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:32 smithi191 ceph-mon[31636]: pgmap v6739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:35.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12465.280281 secs 2024-04-21T13:52:35.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:34 smithi170 ceph-mon[31212]: pgmap v6740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:35.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12465.280281 secs 2024-04-21T13:52:35.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:34 smithi077 ceph-mon[27902]: pgmap v6740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:35.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12465.280281 secs 2024-04-21T13:52:35.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:34 smithi191 ceph-mon[31636]: pgmap v6740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:37.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:36 smithi170 ceph-mon[31212]: pgmap v6741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:37.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:36 smithi077 ceph-mon[27902]: pgmap v6741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:37.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:36 smithi191 ceph-mon[31636]: pgmap v6741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:38.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12468.519874 secs 2024-04-21T13:52:38.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12468.519874 secs 2024-04-21T13:52:38.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12468.519874 secs 2024-04-21T13:52:39.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:38 smithi170 ceph-mon[31212]: pgmap v6742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:39.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:38 smithi077 ceph-mon[27902]: pgmap v6742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:39.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:38 smithi191 ceph-mon[31636]: pgmap v6742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:40.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:40.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12470.280394 secs 2024-04-21T13:52:40.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:39 smithi170 ceph-mon[31212]: pgmap v6743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:40.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12470.280394 secs 2024-04-21T13:52:40.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:39 smithi077 ceph-mon[27902]: pgmap v6743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:40.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12470.280394 secs 2024-04-21T13:52:40.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:39 smithi191 ceph-mon[31636]: pgmap v6743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:43.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12473.519965 secs 2024-04-21T13:52:43.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:42 smithi077 ceph-mon[27902]: pgmap v6744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:43.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12473.519965 secs 2024-04-21T13:52:43.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:42 smithi191 ceph-mon[31636]: pgmap v6744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:43.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12473.519965 secs 2024-04-21T13:52:43.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:42 smithi170 ceph-mon[31212]: pgmap v6744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:45.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12475.280515 secs 2024-04-21T13:52:45.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:44 smithi077 ceph-mon[27902]: pgmap v6745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:45.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12475.280515 secs 2024-04-21T13:52:45.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:44 smithi191 ceph-mon[31636]: pgmap v6745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:45.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12475.280515 secs 2024-04-21T13:52:45.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:44 smithi170 ceph-mon[31212]: pgmap v6745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:47.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:46 smithi077 ceph-mon[27902]: pgmap v6746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:47.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:46 smithi191 ceph-mon[31636]: pgmap v6746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:47.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:46 smithi170 ceph-mon[31212]: pgmap v6746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:48.114 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12478.520072 secs 2024-04-21T13:52:48.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12478.520072 secs 2024-04-21T13:52:48.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12478.520072 secs 2024-04-21T13:52:49.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:48 smithi077 ceph-mon[27902]: pgmap v6747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:49.202 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:48 smithi170 ceph-mon[31212]: pgmap v6747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:49.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:48 smithi191 ceph-mon[31636]: pgmap v6747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:50.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12480.280574 secs 2024-04-21T13:52:50.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12480.280574 secs 2024-04-21T13:52:50.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12480.280574 secs 2024-04-21T13:52:51.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:50 smithi077 ceph-mon[27902]: pgmap v6748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:51.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:50 smithi191 ceph-mon[31636]: pgmap v6748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:51.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:50 smithi170 ceph-mon[31212]: pgmap v6748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:53.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12483.520184 secs 2024-04-21T13:52:53.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:52 smithi077 ceph-mon[27902]: pgmap v6749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:53.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12483.520184 secs 2024-04-21T13:52:53.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:52 smithi191 ceph-mon[31636]: pgmap v6749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:53.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12483.520184 secs 2024-04-21T13:52:53.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:52 smithi170 ceph-mon[31212]: pgmap v6749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:52:55.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12485.280712 secs 2024-04-21T13:52:55.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:54 smithi077 ceph-mon[27902]: pgmap v6750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:55.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12485.280712 secs 2024-04-21T13:52:55.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:54 smithi191 ceph-mon[31636]: pgmap v6750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:55.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12485.280712 secs 2024-04-21T13:52:55.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:54 smithi170 ceph-mon[31212]: pgmap v6750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:52:56.078+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:52:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:52:56.078+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:52:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:52:56.078+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:52:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:52:56.078+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:52:57.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:56 smithi077 ceph-mon[27902]: pgmap v6751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:57.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:56 smithi191 ceph-mon[31636]: pgmap v6751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:57.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:56 smithi170 ceph-mon[31212]: pgmap v6751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:52:58.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12488.520307 secs 2024-04-21T13:52:58.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12488.520307 secs 2024-04-21T13:52:58.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12488.520307 secs 2024-04-21T13:52:59.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:58 smithi077 ceph-mon[27902]: pgmap v6752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:59.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:58 smithi191 ceph-mon[31636]: pgmap v6752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:52:59.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:58 smithi170 ceph-mon[31212]: pgmap v6752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:00.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12490.280836 secs 2024-04-21T13:53:00.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12490.280836 secs 2024-04-21T13:53:00.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12490.280836 secs 2024-04-21T13:53:01.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:00 smithi191 ceph-mon[31636]: pgmap v6753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:01.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:53:01.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:00 smithi170 ceph-mon[31212]: pgmap v6753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:01.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:53:01.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:00 smithi077 ceph-mon[27902]: pgmap v6753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:01.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:53:03.057 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12493.520416 secs 2024-04-21T13:53:03.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:02 smithi191 ceph-mon[31636]: pgmap v6754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:03.156 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12493.520416 secs 2024-04-21T13:53:03.156 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:02 smithi170 ceph-mon[31212]: pgmap v6754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:03.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12493.520416 secs 2024-04-21T13:53:03.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:02 smithi077 ceph-mon[27902]: pgmap v6754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:05.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12495.280892 secs 2024-04-21T13:53:05.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: pgmap v6755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:05.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: osdmap e493: 12 total, 12 up, 12 in 2024-04-21T13:53:05.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:53:05.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:53:05.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12495.280892 secs 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: pgmap v6755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: osdmap e493: 12 total, 12 up, 12 in 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:53:05.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12495.280892 secs 2024-04-21T13:53:05.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: pgmap v6755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:05.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: osdmap e493: 12 total, 12 up, 12 in 2024-04-21T13:53:05.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:05.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:53:05.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:53:05.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:53:07.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:06 smithi191 ceph-mon[31636]: pgmap v6757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:53:07.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:06 smithi170 ceph-mon[31212]: pgmap v6757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:53:07.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:06 smithi077 ceph-mon[27902]: pgmap v6757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:53:08.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12498.520547 secs 2024-04-21T13:53:08.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12498.520547 secs 2024-04-21T13:53:08.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12498.520547 secs 2024-04-21T13:53:09.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:08 smithi191 ceph-mon[31636]: pgmap v6758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:53:09.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:08 smithi170 ceph-mon[31212]: pgmap v6758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:53:09.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:08 smithi077 ceph-mon[27902]: pgmap v6758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:53:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:10.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12500.281002 secs 2024-04-21T13:53:10.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:09 smithi191 ceph-mon[31636]: osdmap e494: 12 total, 12 up, 12 in 2024-04-21T13:53:10.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12500.281002 secs 2024-04-21T13:53:10.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:09 smithi170 ceph-mon[31212]: osdmap e494: 12 total, 12 up, 12 in 2024-04-21T13:53:10.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12500.281002 secs 2024-04-21T13:53:10.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:09 smithi077 ceph-mon[27902]: osdmap e494: 12 total, 12 up, 12 in 2024-04-21T13:53:11.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:10 smithi191 ceph-mon[31636]: pgmap v6760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:53:11.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:10 smithi170 ceph-mon[31212]: pgmap v6760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:53:11.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:10 smithi077 ceph-mon[27902]: pgmap v6760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:53:13.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12503.520678 secs 2024-04-21T13:53:13.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:12 smithi191 ceph-mon[31636]: pgmap v6761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:53:13.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12503.520678 secs 2024-04-21T13:53:13.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:12 smithi170 ceph-mon[31212]: pgmap v6761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:53:13.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12503.520678 secs 2024-04-21T13:53:13.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:12 smithi077 ceph-mon[27902]: pgmap v6761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:53:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:15.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12505.281113 secs 2024-04-21T13:53:15.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:14 smithi191 ceph-mon[31636]: pgmap v6762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:53:15.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12505.281113 secs 2024-04-21T13:53:15.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:14 smithi170 ceph-mon[31212]: pgmap v6762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:53:15.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12505.281113 secs 2024-04-21T13:53:15.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:14 smithi077 ceph-mon[27902]: pgmap v6762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:53:17.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:16 smithi191 ceph-mon[31636]: pgmap v6763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:53:17.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:16 smithi170 ceph-mon[31212]: pgmap v6763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:53:17.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:16 smithi077 ceph-mon[27902]: pgmap v6763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:53:18.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12508.520823 secs 2024-04-21T13:53:18.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12508.520823 secs 2024-04-21T13:53:18.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12508.520823 secs 2024-04-21T13:53:19.201 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:18 smithi170 ceph-mon[31212]: pgmap v6764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:53:19.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:18 smithi191 ceph-mon[31636]: pgmap v6764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:53:19.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:18 smithi077 ceph-mon[27902]: pgmap v6764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:53:20.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:20.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12510.281217 secs 2024-04-21T13:53:20.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12510.281217 secs 2024-04-21T13:53:20.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12510.281217 secs 2024-04-21T13:53:21.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:20 smithi191 ceph-mon[31636]: pgmap v6765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:53:21.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:20 smithi170 ceph-mon[31212]: pgmap v6765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:53:21.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:20 smithi077 ceph-mon[27902]: pgmap v6765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:53:23.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12513.520904 secs 2024-04-21T13:53:23.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:22 smithi191 ceph-mon[31636]: pgmap v6766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:53:23.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12513.520904 secs 2024-04-21T13:53:23.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:22 smithi170 ceph-mon[31212]: pgmap v6766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:53:23.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12513.520904 secs 2024-04-21T13:53:23.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:22 smithi077 ceph-mon[27902]: pgmap v6766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:53:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:25.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12515.281329 secs 2024-04-21T13:53:25.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:24 smithi191 ceph-mon[31636]: pgmap v6767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:25.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12515.281329 secs 2024-04-21T13:53:25.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:24 smithi170 ceph-mon[31212]: pgmap v6767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:25.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12515.281329 secs 2024-04-21T13:53:25.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:24 smithi077 ceph-mon[27902]: pgmap v6767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:27.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:26 smithi191 ceph-mon[31636]: pgmap v6768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:27.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:26 smithi170 ceph-mon[31212]: pgmap v6768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:27.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:26 smithi077 ceph-mon[27902]: pgmap v6768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:28.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12518.521016 secs 2024-04-21T13:53:28.280 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12518.521016 secs 2024-04-21T13:53:28.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12518.521016 secs 2024-04-21T13:53:29.296 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:28 smithi077 ceph-mon[27902]: pgmap v6769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:29.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:28 smithi170 ceph-mon[31212]: pgmap v6769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:29.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:28 smithi191 ceph-mon[31636]: pgmap v6769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:30.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:30.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12520.281444 secs 2024-04-21T13:53:30.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12520.281444 secs 2024-04-21T13:53:30.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12520.281444 secs 2024-04-21T13:53:31.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:30 smithi170 ceph-mon[31212]: pgmap v6770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:31.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:30 smithi077 ceph-mon[27902]: pgmap v6770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:31.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:30 smithi191 ceph-mon[31636]: pgmap v6770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:33.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12523.521119 secs 2024-04-21T13:53:33.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:32 smithi170 ceph-mon[31212]: pgmap v6771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:33.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12523.521119 secs 2024-04-21T13:53:33.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:32 smithi077 ceph-mon[27902]: pgmap v6771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:33.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12523.521119 secs 2024-04-21T13:53:33.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:32 smithi191 ceph-mon[31636]: pgmap v6771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:35.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12525.281553 secs 2024-04-21T13:53:35.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:34 smithi170 ceph-mon[31212]: pgmap v6772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:35.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12525.281553 secs 2024-04-21T13:53:35.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:34 smithi077 ceph-mon[27902]: pgmap v6772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:35.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12525.281553 secs 2024-04-21T13:53:35.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:34 smithi191 ceph-mon[31636]: pgmap v6772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:37.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:36 smithi170 ceph-mon[31212]: pgmap v6773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:37.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:36 smithi077 ceph-mon[27902]: pgmap v6773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:37.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:36 smithi191 ceph-mon[31636]: pgmap v6773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:38.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12528.521248 secs 2024-04-21T13:53:38.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12528.521248 secs 2024-04-21T13:53:38.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12528.521248 secs 2024-04-21T13:53:39.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:38 smithi170 ceph-mon[31212]: pgmap v6774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:39.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:38 smithi077 ceph-mon[27902]: pgmap v6774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:39.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:38 smithi191 ceph-mon[31636]: pgmap v6774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:40.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:40.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12530.281666 secs 2024-04-21T13:53:40.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:40 smithi170 ceph-mon[31212]: pgmap v6775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:40.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12530.281666 secs 2024-04-21T13:53:40.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:40 smithi077 ceph-mon[27902]: pgmap v6775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:40.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12530.281666 secs 2024-04-21T13:53:40.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:40 smithi191 ceph-mon[31636]: pgmap v6775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:43.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12533.521383 secs 2024-04-21T13:53:43.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:42 smithi077 ceph-mon[27902]: pgmap v6776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:43.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12533.521383 secs 2024-04-21T13:53:43.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:42 smithi191 ceph-mon[31636]: pgmap v6776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:43.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12533.521383 secs 2024-04-21T13:53:43.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:42 smithi170 ceph-mon[31212]: pgmap v6776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:45.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12535.281782 secs 2024-04-21T13:53:45.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:44 smithi077 ceph-mon[27902]: pgmap v6777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:45.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12535.281782 secs 2024-04-21T13:53:45.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:44 smithi191 ceph-mon[31636]: pgmap v6777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:45.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12535.281782 secs 2024-04-21T13:53:45.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:44 smithi170 ceph-mon[31212]: pgmap v6777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:47.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:46 smithi077 ceph-mon[27902]: pgmap v6778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:47.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:46 smithi191 ceph-mon[31636]: pgmap v6778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:47.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:46 smithi170 ceph-mon[31212]: pgmap v6778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:48.112 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12538.521500 secs 2024-04-21T13:53:48.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12538.521500 secs 2024-04-21T13:53:48.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12538.521500 secs 2024-04-21T13:53:49.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:48 smithi077 ceph-mon[27902]: pgmap v6779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:49.201 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:48 smithi170 ceph-mon[31212]: pgmap v6779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:49.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:48 smithi191 ceph-mon[31636]: pgmap v6779: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:50.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:50.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12540.281895 secs 2024-04-21T13:53:50.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12540.281895 secs 2024-04-21T13:53:50.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12540.281895 secs 2024-04-21T13:53:51.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:50 smithi077 ceph-mon[27902]: pgmap v6780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:51.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:50 smithi191 ceph-mon[31636]: pgmap v6780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:51.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:50 smithi170 ceph-mon[31212]: pgmap v6780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:53.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12543.521631 secs 2024-04-21T13:53:53.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:52 smithi077 ceph-mon[27902]: pgmap v6781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:53.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12543.521631 secs 2024-04-21T13:53:53.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:52 smithi191 ceph-mon[31636]: pgmap v6781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:53.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12543.521631 secs 2024-04-21T13:53:53.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:52 smithi170 ceph-mon[31212]: pgmap v6781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:55.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:53:55.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12545.281974 secs 2024-04-21T13:53:55.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:54 smithi077 ceph-mon[27902]: pgmap v6782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:55.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12545.281974 secs 2024-04-21T13:53:55.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:54 smithi191 ceph-mon[31636]: pgmap v6782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:55.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12545.281974 secs 2024-04-21T13:53:55.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:54 smithi170 ceph-mon[31212]: pgmap v6782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:57.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:56 smithi077 ceph-mon[27902]: pgmap v6783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:57.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:56 smithi191 ceph-mon[31636]: pgmap v6783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:57.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:56 smithi170 ceph-mon[31212]: pgmap v6783: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:53:58.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12548.521745 secs 2024-04-21T13:53:58.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12548.521745 secs 2024-04-21T13:53:58.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12548.521745 secs 2024-04-21T13:53:59.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:58 smithi191 ceph-mon[31636]: pgmap v6784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:59.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:58 smithi170 ceph-mon[31212]: pgmap v6784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:53:59.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:58 smithi077 ceph-mon[27902]: pgmap v6784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:00.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:53:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12550.282063 secs 2024-04-21T13:54:00.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:53:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12550.282063 secs 2024-04-21T13:54:00.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:53:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12550.282063 secs 2024-04-21T13:54:01.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:00 smithi191 ceph-mon[31636]: pgmap v6785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:01.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:00 smithi170 ceph-mon[31212]: pgmap v6785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:01.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:00 smithi077 ceph-mon[27902]: pgmap v6785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:03.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12553.521858 secs 2024-04-21T13:54:03.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:02 smithi191 ceph-mon[31636]: pgmap v6786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:03.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12553.521858 secs 2024-04-21T13:54:03.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:02 smithi170 ceph-mon[31212]: pgmap v6786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:03.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12553.521858 secs 2024-04-21T13:54:03.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:02 smithi077 ceph-mon[27902]: pgmap v6786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:05.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:05.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12555.282189 secs 2024-04-21T13:54:05.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:04 smithi191 ceph-mon[31636]: pgmap v6787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:05.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:04 smithi191 ceph-mon[31636]: osdmap e495: 12 total, 12 up, 12 in 2024-04-21T13:54:05.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:54:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12555.282189 secs 2024-04-21T13:54:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:04 smithi170 ceph-mon[31212]: pgmap v6787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:04 smithi170 ceph-mon[31212]: osdmap e495: 12 total, 12 up, 12 in 2024-04-21T13:54:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:54:05.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12555.282189 secs 2024-04-21T13:54:05.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:04 smithi077 ceph-mon[27902]: pgmap v6787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:05.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:04 smithi077 ceph-mon[27902]: osdmap e495: 12 total, 12 up, 12 in 2024-04-21T13:54:05.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:54:06.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:54:06.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:54:06.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:54:06.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:54:06.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:54:06.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:54:06.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:54:06.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:54:06.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:54:07.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:06 smithi191 ceph-mon[31636]: pgmap v6789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:54:07.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:06 smithi170 ceph-mon[31212]: pgmap v6789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:54:07.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:06 smithi077 ceph-mon[27902]: pgmap v6789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:54:08.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12558.521980 secs 2024-04-21T13:54:08.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12558.521980 secs 2024-04-21T13:54:08.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12558.521980 secs 2024-04-21T13:54:09.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:08 smithi191 ceph-mon[31636]: pgmap v6790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:54:09.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:08 smithi170 ceph-mon[31212]: pgmap v6790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:54:09.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:08 smithi077 ceph-mon[27902]: pgmap v6790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:54:10.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12560.282311 secs 2024-04-21T13:54:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:09 smithi191 ceph-mon[31636]: osdmap e496: 12 total, 12 up, 12 in 2024-04-21T13:54:10.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12560.282311 secs 2024-04-21T13:54:10.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:09 smithi170 ceph-mon[31212]: osdmap e496: 12 total, 12 up, 12 in 2024-04-21T13:54:10.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12560.282311 secs 2024-04-21T13:54:10.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:09 smithi077 ceph-mon[27902]: osdmap e496: 12 total, 12 up, 12 in 2024-04-21T13:54:11.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:10 smithi191 ceph-mon[31636]: pgmap v6792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:54:11.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:10 smithi170 ceph-mon[31212]: pgmap v6792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:54:11.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:10 smithi077 ceph-mon[27902]: pgmap v6792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:54:13.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12563.522107 secs 2024-04-21T13:54:13.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:12 smithi191 ceph-mon[31636]: pgmap v6793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:54:13.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12563.522107 secs 2024-04-21T13:54:13.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:12 smithi170 ceph-mon[31212]: pgmap v6793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:54:13.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12563.522107 secs 2024-04-21T13:54:13.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:12 smithi077 ceph-mon[27902]: pgmap v6793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:54:15.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:15.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12565.282427 secs 2024-04-21T13:54:15.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:14 smithi191 ceph-mon[31636]: pgmap v6794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:54:15.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12565.282427 secs 2024-04-21T13:54:15.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:14 smithi170 ceph-mon[31212]: pgmap v6794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:54:15.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12565.282427 secs 2024-04-21T13:54:15.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:14 smithi077 ceph-mon[27902]: pgmap v6794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:54:17.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:16 smithi191 ceph-mon[31636]: pgmap v6795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:54:17.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:16 smithi170 ceph-mon[31212]: pgmap v6795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:54:17.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:16 smithi077 ceph-mon[27902]: pgmap v6795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:54:18.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12568.522229 secs 2024-04-21T13:54:18.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12568.522229 secs 2024-04-21T13:54:18.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12568.522229 secs 2024-04-21T13:54:19.200 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:18 smithi170 ceph-mon[31212]: pgmap v6796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:54:19.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:18 smithi191 ceph-mon[31636]: pgmap v6796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:54:19.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:18 smithi077 ceph-mon[27902]: pgmap v6796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:54:20.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:20.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12570.282544 secs 2024-04-21T13:54:20.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12570.282544 secs 2024-04-21T13:54:20.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12570.282544 secs 2024-04-21T13:54:21.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:20 smithi191 ceph-mon[31636]: pgmap v6797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:54:21.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:20 smithi170 ceph-mon[31212]: pgmap v6797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:54:21.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:20 smithi077 ceph-mon[27902]: pgmap v6797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:54:23.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12573.522320 secs 2024-04-21T13:54:23.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:22 smithi191 ceph-mon[31636]: pgmap v6798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:54:23.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12573.522320 secs 2024-04-21T13:54:23.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:22 smithi170 ceph-mon[31212]: pgmap v6798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:54:23.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12573.522320 secs 2024-04-21T13:54:23.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:22 smithi077 ceph-mon[27902]: pgmap v6798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:54:25.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:25.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12575.282669 secs 2024-04-21T13:54:25.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:24 smithi191 ceph-mon[31636]: pgmap v6799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:25.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12575.282669 secs 2024-04-21T13:54:25.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:24 smithi170 ceph-mon[31212]: pgmap v6799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:25.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12575.282669 secs 2024-04-21T13:54:25.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:24 smithi077 ceph-mon[27902]: pgmap v6799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:27.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:26 smithi170 ceph-mon[31212]: pgmap v6800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:27.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:26 smithi077 ceph-mon[27902]: pgmap v6800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:27.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:26 smithi191 ceph-mon[31636]: pgmap v6800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:28.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12578.522436 secs 2024-04-21T13:54:28.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12578.522436 secs 2024-04-21T13:54:28.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12578.522436 secs 2024-04-21T13:54:29.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:28 smithi170 ceph-mon[31212]: pgmap v6801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:29.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:28 smithi077 ceph-mon[27902]: pgmap v6801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:29.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:28 smithi191 ceph-mon[31636]: pgmap v6801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:30.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:30.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12580.282782 secs 2024-04-21T13:54:30.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12580.282782 secs 2024-04-21T13:54:30.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12580.282782 secs 2024-04-21T13:54:31.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:30 smithi170 ceph-mon[31212]: pgmap v6802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:31.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:30 smithi077 ceph-mon[27902]: pgmap v6802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:31.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:30 smithi191 ceph-mon[31636]: pgmap v6802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:33.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12583.522583 secs 2024-04-21T13:54:33.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:32 smithi170 ceph-mon[31212]: pgmap v6803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:33.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12583.522583 secs 2024-04-21T13:54:33.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:32 smithi077 ceph-mon[27902]: pgmap v6803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:33.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12583.522583 secs 2024-04-21T13:54:33.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:32 smithi191 ceph-mon[31636]: pgmap v6803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:35.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:35.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12585.282894 secs 2024-04-21T13:54:35.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:34 smithi170 ceph-mon[31212]: pgmap v6804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:35.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12585.282894 secs 2024-04-21T13:54:35.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:34 smithi077 ceph-mon[27902]: pgmap v6804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:35.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12585.282894 secs 2024-04-21T13:54:35.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:34 smithi191 ceph-mon[31636]: pgmap v6804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:37.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:36 smithi170 ceph-mon[31212]: pgmap v6805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:37.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:36 smithi077 ceph-mon[27902]: pgmap v6805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:37.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:36 smithi191 ceph-mon[31636]: pgmap v6805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:38.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12588.522699 secs 2024-04-21T13:54:38.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12588.522699 secs 2024-04-21T13:54:38.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12588.522699 secs 2024-04-21T13:54:39.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:39 smithi170 ceph-mon[31212]: pgmap v6806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:39.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:39 smithi077 ceph-mon[27902]: pgmap v6806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:39.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:39 smithi191 ceph-mon[31636]: pgmap v6806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:40.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:40.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12590.283031 secs 2024-04-21T13:54:40.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:40 smithi170 ceph-mon[31212]: pgmap v6807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:40.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12590.283031 secs 2024-04-21T13:54:40.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:40 smithi077 ceph-mon[27902]: pgmap v6807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:40.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12590.283031 secs 2024-04-21T13:54:40.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:40 smithi191 ceph-mon[31636]: pgmap v6807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:43.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12593.522851 secs 2024-04-21T13:54:43.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:42 smithi077 ceph-mon[27902]: pgmap v6808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:43.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12593.522851 secs 2024-04-21T13:54:43.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:42 smithi191 ceph-mon[31636]: pgmap v6808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:43.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12593.522851 secs 2024-04-21T13:54:43.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:42 smithi170 ceph-mon[31212]: pgmap v6808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:45.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12595.283141 secs 2024-04-21T13:54:45.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:44 smithi077 ceph-mon[27902]: pgmap v6809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:45.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12595.283141 secs 2024-04-21T13:54:45.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:44 smithi191 ceph-mon[31636]: pgmap v6809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:45.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12595.283141 secs 2024-04-21T13:54:45.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:44 smithi170 ceph-mon[31212]: pgmap v6809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:47.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:46 smithi077 ceph-mon[27902]: pgmap v6810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:47.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:46 smithi191 ceph-mon[31636]: pgmap v6810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:47.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:46 smithi170 ceph-mon[31212]: pgmap v6810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:48.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12598.522958 secs 2024-04-21T13:54:48.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12598.522958 secs 2024-04-21T13:54:48.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12598.522958 secs 2024-04-21T13:54:49.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:48 smithi077 ceph-mon[27902]: pgmap v6811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:49.199 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:48 smithi170 ceph-mon[31212]: pgmap v6811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:49.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:48 smithi191 ceph-mon[31636]: pgmap v6811: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:50.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:50.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12600.283218 secs 2024-04-21T13:54:50.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12600.283218 secs 2024-04-21T13:54:50.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12600.283218 secs 2024-04-21T13:54:51.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:50 smithi191 ceph-mon[31636]: pgmap v6812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:51.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:50 smithi170 ceph-mon[31212]: pgmap v6812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:51.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:50 smithi077 ceph-mon[27902]: pgmap v6812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:53.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12603.523064 secs 2024-04-21T13:54:53.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:52 smithi191 ceph-mon[31636]: pgmap v6813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:53.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12603.523064 secs 2024-04-21T13:54:53.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:52 smithi170 ceph-mon[31212]: pgmap v6813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:53.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12603.523064 secs 2024-04-21T13:54:53.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:52 smithi077 ceph-mon[27902]: pgmap v6813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:55.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:54:55.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12605.283329 secs 2024-04-21T13:54:55.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:54 smithi191 ceph-mon[31636]: pgmap v6814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:55.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12605.283329 secs 2024-04-21T13:54:55.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:54 smithi170 ceph-mon[31212]: pgmap v6814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:55.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12605.283329 secs 2024-04-21T13:54:55.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:54 smithi077 ceph-mon[27902]: pgmap v6814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:57.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:56 smithi191 ceph-mon[31636]: pgmap v6815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:57.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:56 smithi170 ceph-mon[31212]: pgmap v6815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:57.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:56 smithi077 ceph-mon[27902]: pgmap v6815: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:54:58.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12608.523172 secs 2024-04-21T13:54:58.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12608.523172 secs 2024-04-21T13:54:58.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12608.523172 secs 2024-04-21T13:54:59.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:58 smithi191 ceph-mon[31636]: pgmap v6816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:59.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:58 smithi170 ceph-mon[31212]: pgmap v6816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:54:59.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:58 smithi077 ceph-mon[27902]: pgmap v6816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:00.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:54:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12610.283453 secs 2024-04-21T13:55:00.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:54:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12610.283453 secs 2024-04-21T13:55:00.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:54:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12610.283453 secs 2024-04-21T13:55:01.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:00 smithi191 ceph-mon[31636]: pgmap v6817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:01.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:00 smithi170 ceph-mon[31212]: pgmap v6817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:01.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:00 smithi077 ceph-mon[27902]: pgmap v6817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:03.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12613.523306 secs 2024-04-21T13:55:03.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:02 smithi191 ceph-mon[31636]: pgmap v6818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:03.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12613.523306 secs 2024-04-21T13:55:03.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:02 smithi170 ceph-mon[31212]: pgmap v6818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:03.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12613.523306 secs 2024-04-21T13:55:03.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:02 smithi077 ceph-mon[27902]: pgmap v6818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:05.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:05.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12615.283581 secs 2024-04-21T13:55:05.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:04 smithi191 ceph-mon[31636]: pgmap v6819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:05.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:04 smithi191 ceph-mon[31636]: osdmap e497: 12 total, 12 up, 12 in 2024-04-21T13:55:05.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12615.283581 secs 2024-04-21T13:55:05.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:04 smithi170 ceph-mon[31212]: pgmap v6819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:05.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:04 smithi170 ceph-mon[31212]: osdmap e497: 12 total, 12 up, 12 in 2024-04-21T13:55:05.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12615.283581 secs 2024-04-21T13:55:05.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:04 smithi077 ceph-mon[27902]: pgmap v6819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:05.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:04 smithi077 ceph-mon[27902]: osdmap e497: 12 total, 12 up, 12 in 2024-04-21T13:55:06.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:55:06.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:55:06.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:55:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:06 smithi191 ceph-mon[31636]: pgmap v6821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:55:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:55:07.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:55:07.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:55:07.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:06 smithi170 ceph-mon[31212]: pgmap v6821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:55:07.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:55:07.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:55:07.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:55:07.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:06 smithi077 ceph-mon[27902]: pgmap v6821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:55:07.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:55:07.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:55:07.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:55:08.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12618.523415 secs 2024-04-21T13:55:08.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12618.523415 secs 2024-04-21T13:55:08.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12618.523415 secs 2024-04-21T13:55:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:08 smithi191 ceph-mon[31636]: pgmap v6822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:55:09.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:08 smithi170 ceph-mon[31212]: pgmap v6822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:55:09.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:08 smithi077 ceph-mon[27902]: pgmap v6822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T13:55:10.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12620.283696 secs 2024-04-21T13:55:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:09 smithi191 ceph-mon[31636]: osdmap e498: 12 total, 12 up, 12 in 2024-04-21T13:55:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12620.283696 secs 2024-04-21T13:55:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:09 smithi170 ceph-mon[31212]: osdmap e498: 12 total, 12 up, 12 in 2024-04-21T13:55:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12620.283696 secs 2024-04-21T13:55:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:09 smithi077 ceph-mon[27902]: osdmap e498: 12 total, 12 up, 12 in 2024-04-21T13:55:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:11.096+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:55:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:11.096+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:55:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:11.097+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:55:11.088 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:11.097+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:55:11.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:10 smithi191 ceph-mon[31636]: pgmap v6824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:55:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:10 smithi170 ceph-mon[31212]: pgmap v6824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:55:11.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:10 smithi077 ceph-mon[27902]: pgmap v6824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T13:55:13.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12623.523519 secs 2024-04-21T13:55:13.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:12 smithi191 ceph-mon[31636]: pgmap v6825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:55:13.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12623.523519 secs 2024-04-21T13:55:13.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:12 smithi170 ceph-mon[31212]: pgmap v6825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:55:13.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12623.523519 secs 2024-04-21T13:55:13.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:12 smithi077 ceph-mon[27902]: pgmap v6825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:55:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:15.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12625.283792 secs 2024-04-21T13:55:15.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:14 smithi170 ceph-mon[31212]: pgmap v6826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:55:15.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12625.283792 secs 2024-04-21T13:55:15.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:14 smithi077 ceph-mon[27902]: pgmap v6826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:55:15.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12625.283792 secs 2024-04-21T13:55:15.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:14 smithi191 ceph-mon[31636]: pgmap v6826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:55:17.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:16 smithi170 ceph-mon[31212]: pgmap v6827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:55:17.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:16 smithi077 ceph-mon[27902]: pgmap v6827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:55:17.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:16 smithi191 ceph-mon[31636]: pgmap v6827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:55:18.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12628.523632 secs 2024-04-21T13:55:18.361 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12628.523632 secs 2024-04-21T13:55:18.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12628.523632 secs 2024-04-21T13:55:19.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:18 smithi170 ceph-mon[31212]: pgmap v6828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:55:19.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:18 smithi077 ceph-mon[27902]: pgmap v6828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:55:19.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:18 smithi191 ceph-mon[31636]: pgmap v6828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T13:55:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:20.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12630.283907 secs 2024-04-21T13:55:20.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12630.283907 secs 2024-04-21T13:55:20.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12630.283907 secs 2024-04-21T13:55:21.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:20 smithi170 ceph-mon[31212]: pgmap v6829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:55:21.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:20 smithi077 ceph-mon[27902]: pgmap v6829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:55:21.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:20 smithi191 ceph-mon[31636]: pgmap v6829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:55:23.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12633.523749 secs 2024-04-21T13:55:23.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:22 smithi170 ceph-mon[31212]: pgmap v6830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:55:23.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12633.523749 secs 2024-04-21T13:55:23.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:22 smithi077 ceph-mon[27902]: pgmap v6830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:55:23.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12633.523749 secs 2024-04-21T13:55:23.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:22 smithi191 ceph-mon[31636]: pgmap v6830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:55:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:25.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12635.284022 secs 2024-04-21T13:55:25.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:24 smithi170 ceph-mon[31212]: pgmap v6831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:25.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12635.284022 secs 2024-04-21T13:55:25.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:24 smithi077 ceph-mon[27902]: pgmap v6831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:25.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12635.284022 secs 2024-04-21T13:55:25.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:24 smithi191 ceph-mon[31636]: pgmap v6831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:27.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:26 smithi170 ceph-mon[31212]: pgmap v6832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:27.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:26 smithi077 ceph-mon[27902]: pgmap v6832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:27.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:26 smithi191 ceph-mon[31636]: pgmap v6832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:28.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12638.523879 secs 2024-04-21T13:55:28.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12638.523879 secs 2024-04-21T13:55:28.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12638.523879 secs 2024-04-21T13:55:29.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:29 smithi170 ceph-mon[31212]: pgmap v6833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:29.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:29 smithi077 ceph-mon[27902]: pgmap v6833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:29.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:29 smithi191 ceph-mon[31636]: pgmap v6833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:30.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:30.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12640.284135 secs 2024-04-21T13:55:30.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12640.284135 secs 2024-04-21T13:55:30.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12640.284135 secs 2024-04-21T13:55:31.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:31 smithi170 ceph-mon[31212]: pgmap v6834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:31.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:31 smithi077 ceph-mon[27902]: pgmap v6834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:31.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:31 smithi191 ceph-mon[31636]: pgmap v6834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:32.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:32 smithi170 ceph-mon[31212]: pgmap v6835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:32.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:32 smithi077 ceph-mon[27902]: pgmap v6835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:32.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:32 smithi191 ceph-mon[31636]: pgmap v6835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:33.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12643.523996 secs 2024-04-21T13:55:33.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12643.523996 secs 2024-04-21T13:55:33.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12643.523996 secs 2024-04-21T13:55:34.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:34 smithi170 ceph-mon[31212]: pgmap v6836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:34.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:34 smithi077 ceph-mon[27902]: pgmap v6836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:34.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:34 smithi191 ceph-mon[31636]: pgmap v6836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:35.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:35.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12645.284246 secs 2024-04-21T13:55:35.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12645.284246 secs 2024-04-21T13:55:35.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12645.284246 secs 2024-04-21T13:55:36.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:36 smithi170 ceph-mon[31212]: pgmap v6837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:36.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:36 smithi077 ceph-mon[27902]: pgmap v6837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:36.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:36 smithi191 ceph-mon[31636]: pgmap v6837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:37.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12648.524110 secs 2024-04-21T13:55:37.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12648.524110 secs 2024-04-21T13:55:37.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12648.524110 secs 2024-04-21T13:55:38.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:38 smithi077 ceph-mon[27902]: pgmap v6838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:38.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:38 smithi191 ceph-mon[31636]: pgmap v6838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:38.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:38 smithi170 ceph-mon[31212]: pgmap v6838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:39.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12650.284367 secs 2024-04-21T13:55:39.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12650.284367 secs 2024-04-21T13:55:39.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12650.284367 secs 2024-04-21T13:55:40.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:40.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:40 smithi077 ceph-mon[27902]: pgmap v6839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:40.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:40 smithi191 ceph-mon[31636]: pgmap v6839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:40.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:40 smithi170 ceph-mon[31212]: pgmap v6839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:43.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12653.524225 secs 2024-04-21T13:55:43.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:42 smithi191 ceph-mon[31636]: pgmap v6840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:43.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12653.524225 secs 2024-04-21T13:55:43.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:42 smithi170 ceph-mon[31212]: pgmap v6840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:43.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12653.524225 secs 2024-04-21T13:55:43.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:42 smithi077 ceph-mon[27902]: pgmap v6840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:45.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12655.284493 secs 2024-04-21T13:55:45.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:44 smithi191 ceph-mon[31636]: pgmap v6841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:45.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12655.284493 secs 2024-04-21T13:55:45.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:44 smithi170 ceph-mon[31212]: pgmap v6841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:45.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12655.284493 secs 2024-04-21T13:55:45.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:44 smithi077 ceph-mon[27902]: pgmap v6841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:47.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:46 smithi191 ceph-mon[31636]: pgmap v6842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:47.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:46 smithi170 ceph-mon[31212]: pgmap v6842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:47.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:46 smithi077 ceph-mon[27902]: pgmap v6842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:48.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12658.524322 secs 2024-04-21T13:55:48.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12658.524322 secs 2024-04-21T13:55:48.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12658.524322 secs 2024-04-21T13:55:49.198 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:48 smithi170 ceph-mon[31212]: pgmap v6843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:49.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:48 smithi191 ceph-mon[31636]: pgmap v6843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:49.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:48 smithi077 ceph-mon[27902]: pgmap v6843: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:50.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:50.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12660.284626 secs 2024-04-21T13:55:50.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12660.284626 secs 2024-04-21T13:55:50.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12660.284626 secs 2024-04-21T13:55:51.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:50 smithi191 ceph-mon[31636]: pgmap v6844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:51.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:50 smithi170 ceph-mon[31212]: pgmap v6844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:51.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:50 smithi077 ceph-mon[27902]: pgmap v6844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:53.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12663.524444 secs 2024-04-21T13:55:53.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:52 smithi191 ceph-mon[31636]: pgmap v6845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:53.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12663.524444 secs 2024-04-21T13:55:53.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:52 smithi170 ceph-mon[31212]: pgmap v6845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:53.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12663.524444 secs 2024-04-21T13:55:53.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:52 smithi077 ceph-mon[27902]: pgmap v6845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:55.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:55:55.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12665.284750 secs 2024-04-21T13:55:55.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:54 smithi191 ceph-mon[31636]: pgmap v6846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:55.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12665.284750 secs 2024-04-21T13:55:55.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:54 smithi170 ceph-mon[31212]: pgmap v6846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:55.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12665.284750 secs 2024-04-21T13:55:55.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:54 smithi077 ceph-mon[27902]: pgmap v6846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:56.103+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:55:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:56.103+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:55:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:56.103+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:55:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:55:56.103+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:55:57.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:56 smithi191 ceph-mon[31636]: pgmap v6847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:57.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:56 smithi170 ceph-mon[31212]: pgmap v6847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:57.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:56 smithi077 ceph-mon[27902]: pgmap v6847: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:55:58.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12668.524558 secs 2024-04-21T13:55:58.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12668.524558 secs 2024-04-21T13:55:58.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12668.524558 secs 2024-04-21T13:55:59.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:58 smithi191 ceph-mon[31636]: pgmap v6848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:59.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:58 smithi170 ceph-mon[31212]: pgmap v6848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:55:59.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:58 smithi077 ceph-mon[27902]: pgmap v6848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:00.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:55:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12670.284869 secs 2024-04-21T13:56:00.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:55:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12670.284869 secs 2024-04-21T13:56:00.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:55:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12670.284869 secs 2024-04-21T13:56:01.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:00 smithi191 ceph-mon[31636]: pgmap v6849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:01.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:00 smithi170 ceph-mon[31212]: pgmap v6849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:01.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:00 smithi077 ceph-mon[27902]: pgmap v6849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:03.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12673.524690 secs 2024-04-21T13:56:03.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:02 smithi191 ceph-mon[31636]: pgmap v6850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:03.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12673.524690 secs 2024-04-21T13:56:03.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:02 smithi170 ceph-mon[31212]: pgmap v6850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:03.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12673.524690 secs 2024-04-21T13:56:03.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:02 smithi077 ceph-mon[27902]: pgmap v6850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:05.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:05.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12675.284982 secs 2024-04-21T13:56:05.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:04 smithi191 ceph-mon[31636]: pgmap v6851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:05.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:04 smithi191 ceph-mon[31636]: osdmap e499: 12 total, 12 up, 12 in 2024-04-21T13:56:05.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12675.284982 secs 2024-04-21T13:56:05.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:04 smithi170 ceph-mon[31212]: pgmap v6851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:05.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:04 smithi170 ceph-mon[31212]: osdmap e499: 12 total, 12 up, 12 in 2024-04-21T13:56:05.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12675.284982 secs 2024-04-21T13:56:05.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:04 smithi077 ceph-mon[27902]: pgmap v6851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:05.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:04 smithi077 ceph-mon[27902]: osdmap e499: 12 total, 12 up, 12 in 2024-04-21T13:56:07.184 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:06 smithi077 ceph-mon[27902]: pgmap v6853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:56:07.185 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:56:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:06 smithi191 ceph-mon[31636]: pgmap v6853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:56:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:56:07.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:06 smithi170 ceph-mon[31212]: pgmap v6853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:56:07.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:56:08.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12678.524797 secs 2024-04-21T13:56:08.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12678.524797 secs 2024-04-21T13:56:08.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12678.524797 secs 2024-04-21T13:56:09.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: pgmap v6854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:56:09.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: pgmap v6854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: pgmap v6854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12680.285050 secs 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: osdmap e500: 12 total, 12 up, 12 in 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:56:10.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12680.285050 secs 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: osdmap e500: 12 total, 12 up, 12 in 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:56:10.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12680.285050 secs 2024-04-21T13:56:10.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: osdmap e500: 12 total, 12 up, 12 in 2024-04-21T13:56:10.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T13:56:10.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:56:10.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:56:10.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:56:11.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:56:11.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:56:11.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:56:11.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:56:11.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:56:11.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:56:11.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:10 smithi191 ceph-mon[31636]: pgmap v6856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:56:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:56:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:56:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:56:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:56:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:56:11.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:56:11.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:10 smithi170 ceph-mon[31212]: pgmap v6856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:56:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T13:56:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T13:56:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T13:56:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T13:56:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T13:56:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T13:56:11.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:10 smithi077 ceph-mon[27902]: pgmap v6856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:56:13.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12683.524863 secs 2024-04-21T13:56:13.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:12 smithi191 ceph-mon[31636]: pgmap v6857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:56:13.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12683.524863 secs 2024-04-21T13:56:13.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:12 smithi170 ceph-mon[31212]: pgmap v6857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:56:13.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12683.524863 secs 2024-04-21T13:56:13.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:12 smithi077 ceph-mon[27902]: pgmap v6857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:56:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:15.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12685.285183 secs 2024-04-21T13:56:15.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:14 smithi170 ceph-mon[31212]: pgmap v6858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:56:15.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12685.285183 secs 2024-04-21T13:56:15.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:14 smithi077 ceph-mon[27902]: pgmap v6858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:56:15.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12685.285183 secs 2024-04-21T13:56:15.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:14 smithi191 ceph-mon[31636]: pgmap v6858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:56:17.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:16 smithi170 ceph-mon[31212]: pgmap v6859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:56:17.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:16 smithi077 ceph-mon[27902]: pgmap v6859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:56:17.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:16 smithi191 ceph-mon[31636]: pgmap v6859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:56:18.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12688.524953 secs 2024-04-21T13:56:18.359 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12688.524953 secs 2024-04-21T13:56:18.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12688.524953 secs 2024-04-21T13:56:19.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:18 smithi170 ceph-mon[31212]: pgmap v6860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:56:19.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:18 smithi077 ceph-mon[27902]: pgmap v6860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:56:19.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:18 smithi191 ceph-mon[31636]: pgmap v6860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:56:20.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:20.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12690.285306 secs 2024-04-21T13:56:20.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12690.285306 secs 2024-04-21T13:56:20.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12690.285306 secs 2024-04-21T13:56:21.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:20 smithi170 ceph-mon[31212]: pgmap v6861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:56:21.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:20 smithi077 ceph-mon[27902]: pgmap v6861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:56:21.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:20 smithi191 ceph-mon[31636]: pgmap v6861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:56:23.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12693.525071 secs 2024-04-21T13:56:23.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:22 smithi170 ceph-mon[31212]: pgmap v6862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:56:23.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12693.525071 secs 2024-04-21T13:56:23.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:22 smithi077 ceph-mon[27902]: pgmap v6862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:56:23.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12693.525071 secs 2024-04-21T13:56:23.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:22 smithi191 ceph-mon[31636]: pgmap v6862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:56:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:25.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12695.285448 secs 2024-04-21T13:56:25.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:24 smithi170 ceph-mon[31212]: pgmap v6863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:25.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12695.285448 secs 2024-04-21T13:56:25.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:24 smithi077 ceph-mon[27902]: pgmap v6863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:25.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12695.285448 secs 2024-04-21T13:56:25.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:24 smithi191 ceph-mon[31636]: pgmap v6863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:27.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:26 smithi170 ceph-mon[31212]: pgmap v6864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:27.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:26 smithi077 ceph-mon[27902]: pgmap v6864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:27.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:26 smithi191 ceph-mon[31636]: pgmap v6864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:28.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12698.525163 secs 2024-04-21T13:56:28.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12698.525163 secs 2024-04-21T13:56:28.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12698.525163 secs 2024-04-21T13:56:29.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:29 smithi170 ceph-mon[31212]: pgmap v6865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:29.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:29 smithi077 ceph-mon[27902]: pgmap v6865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:29.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:29 smithi191 ceph-mon[31636]: pgmap v6865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:30.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:30.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12700.285549 secs 2024-04-21T13:56:30.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12700.285549 secs 2024-04-21T13:56:30.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12700.285549 secs 2024-04-21T13:56:31.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:31 smithi170 ceph-mon[31212]: pgmap v6866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:31.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:31 smithi077 ceph-mon[27902]: pgmap v6866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:31.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:31 smithi191 ceph-mon[31636]: pgmap v6866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:33.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12703.525282 secs 2024-04-21T13:56:33.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:33 smithi170 ceph-mon[31212]: pgmap v6867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:33.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12703.525282 secs 2024-04-21T13:56:33.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:33 smithi077 ceph-mon[27902]: pgmap v6867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:33.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12703.525282 secs 2024-04-21T13:56:33.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:33 smithi191 ceph-mon[31636]: pgmap v6867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:35.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12705.285710 secs 2024-04-21T13:56:35.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:35 smithi170 ceph-mon[31212]: pgmap v6868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:35.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12705.285710 secs 2024-04-21T13:56:35.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:35 smithi077 ceph-mon[27902]: pgmap v6868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:35.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12705.285710 secs 2024-04-21T13:56:35.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:35 smithi191 ceph-mon[31636]: pgmap v6868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:36.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:36 smithi170 ceph-mon[31212]: pgmap v6869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:36.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:36 smithi077 ceph-mon[27902]: pgmap v6869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:36.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:36 smithi191 ceph-mon[31636]: pgmap v6869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:37.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12708.525434 secs 2024-04-21T13:56:37.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12708.525434 secs 2024-04-21T13:56:37.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12708.525434 secs 2024-04-21T13:56:38.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:38 smithi077 ceph-mon[27902]: pgmap v6870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:38.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:38 smithi191 ceph-mon[31636]: pgmap v6870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:38.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:38 smithi170 ceph-mon[31212]: pgmap v6870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:39.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12710.285847 secs 2024-04-21T13:56:39.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12710.285847 secs 2024-04-21T13:56:39.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12710.285847 secs 2024-04-21T13:56:40.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:40.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:40 smithi077 ceph-mon[27902]: pgmap v6871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:40.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:40 smithi191 ceph-mon[31636]: pgmap v6871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:40.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:40 smithi170 ceph-mon[31212]: pgmap v6871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:43.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12713.525533 secs 2024-04-21T13:56:43.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:42 smithi191 ceph-mon[31636]: pgmap v6872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:43.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12713.525533 secs 2024-04-21T13:56:43.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:42 smithi170 ceph-mon[31212]: pgmap v6872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:43.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12713.525533 secs 2024-04-21T13:56:43.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:42 smithi077 ceph-mon[27902]: pgmap v6872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:45.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12715.285962 secs 2024-04-21T13:56:45.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:44 smithi191 ceph-mon[31636]: pgmap v6873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:45.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12715.285962 secs 2024-04-21T13:56:45.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:44 smithi170 ceph-mon[31212]: pgmap v6873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:45.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12715.285962 secs 2024-04-21T13:56:45.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:44 smithi077 ceph-mon[27902]: pgmap v6873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:47.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:46 smithi191 ceph-mon[31636]: pgmap v6874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:47.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:46 smithi170 ceph-mon[31212]: pgmap v6874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:47.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:46 smithi077 ceph-mon[27902]: pgmap v6874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:48.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12718.525647 secs 2024-04-21T13:56:48.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12718.525647 secs 2024-04-21T13:56:48.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12718.525647 secs 2024-04-21T13:56:49.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:48 smithi170 ceph-mon[31212]: pgmap v6875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:49.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:48 smithi191 ceph-mon[31636]: pgmap v6875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:49.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:48 smithi077 ceph-mon[27902]: pgmap v6875: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:50.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12720.286068 secs 2024-04-21T13:56:50.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12720.286068 secs 2024-04-21T13:56:50.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12720.286068 secs 2024-04-21T13:56:51.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:50 smithi191 ceph-mon[31636]: pgmap v6876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:51.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:50 smithi170 ceph-mon[31212]: pgmap v6876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:51.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:50 smithi077 ceph-mon[27902]: pgmap v6876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:53.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12723.525799 secs 2024-04-21T13:56:53.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:52 smithi191 ceph-mon[31636]: pgmap v6877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:53.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12723.525799 secs 2024-04-21T13:56:53.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:52 smithi170 ceph-mon[31212]: pgmap v6877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:53.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12723.525799 secs 2024-04-21T13:56:53.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:52 smithi077 ceph-mon[27902]: pgmap v6877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:55.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:56:55.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12725.286185 secs 2024-04-21T13:56:55.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:54 smithi191 ceph-mon[31636]: pgmap v6878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:55.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12725.286185 secs 2024-04-21T13:56:55.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:54 smithi170 ceph-mon[31212]: pgmap v6878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:55.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12725.286185 secs 2024-04-21T13:56:55.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:54 smithi077 ceph-mon[27902]: pgmap v6878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:57.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:56 smithi191 ceph-mon[31636]: pgmap v6879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:57.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:56 smithi170 ceph-mon[31212]: pgmap v6879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:57.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:56 smithi077 ceph-mon[27902]: pgmap v6879: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:56:58.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12728.525913 secs 2024-04-21T13:56:58.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12728.525913 secs 2024-04-21T13:56:58.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12728.525913 secs 2024-04-21T13:56:59.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:58 smithi191 ceph-mon[31636]: pgmap v6880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:59.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:58 smithi170 ceph-mon[31212]: pgmap v6880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:56:59.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:58 smithi077 ceph-mon[27902]: pgmap v6880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:00.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:00.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:56:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12730.286299 secs 2024-04-21T13:57:00.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:56:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12730.286299 secs 2024-04-21T13:57:00.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:56:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12730.286299 secs 2024-04-21T13:57:01.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:00 smithi191 ceph-mon[31636]: pgmap v6881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:01.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:00 smithi170 ceph-mon[31212]: pgmap v6881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:01.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:00 smithi077 ceph-mon[27902]: pgmap v6881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:03.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12733.526011 secs 2024-04-21T13:57:03.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:02 smithi191 ceph-mon[31636]: pgmap v6882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:03.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12733.526011 secs 2024-04-21T13:57:03.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:02 smithi170 ceph-mon[31212]: pgmap v6882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:03.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12733.526011 secs 2024-04-21T13:57:03.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:02 smithi077 ceph-mon[27902]: pgmap v6882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:05.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:05.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12735.286378 secs 2024-04-21T13:57:05.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:04 smithi191 ceph-mon[31636]: pgmap v6883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:05.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:04 smithi191 ceph-mon[31636]: osdmap e501: 12 total, 12 up, 12 in 2024-04-21T13:57:05.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12735.286378 secs 2024-04-21T13:57:05.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:04 smithi170 ceph-mon[31212]: pgmap v6883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:05.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:04 smithi170 ceph-mon[31212]: osdmap e501: 12 total, 12 up, 12 in 2024-04-21T13:57:05.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12735.286378 secs 2024-04-21T13:57:05.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:04 smithi077 ceph-mon[27902]: pgmap v6883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:05.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:04 smithi077 ceph-mon[27902]: osdmap e501: 12 total, 12 up, 12 in 2024-04-21T13:57:07.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:06 smithi191 ceph-mon[31636]: pgmap v6885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:57:07.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:06 smithi170 ceph-mon[31212]: pgmap v6885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:57:07.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:06 smithi077 ceph-mon[27902]: pgmap v6885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:57:08.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12738.526072 secs 2024-04-21T13:57:08.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12738.526072 secs 2024-04-21T13:57:08.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12738.526072 secs 2024-04-21T13:57:09.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:08 smithi170 ceph-mon[31212]: pgmap v6886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:57:09.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:08 smithi077 ceph-mon[27902]: pgmap v6886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:57:09.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:08 smithi191 ceph-mon[31636]: pgmap v6886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:57:10.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:10.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12740.286503 secs 2024-04-21T13:57:10.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:09 smithi170 ceph-mon[31212]: osdmap e502: 12 total, 12 up, 12 in 2024-04-21T13:57:10.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:57:10.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12740.286503 secs 2024-04-21T13:57:10.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:09 smithi077 ceph-mon[27902]: osdmap e502: 12 total, 12 up, 12 in 2024-04-21T13:57:10.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:57:10.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12740.286503 secs 2024-04-21T13:57:10.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:09 smithi191 ceph-mon[31636]: osdmap e502: 12 total, 12 up, 12 in 2024-04-21T13:57:10.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:57:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:10 smithi170 ceph-mon[31212]: pgmap v6888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:57:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:57:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:57:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:10 smithi077 ceph-mon[27902]: pgmap v6888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:57:11.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:57:11.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:57:11.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:10 smithi191 ceph-mon[31636]: pgmap v6888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:57:11.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:11.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:57:11.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:57:11.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:57:13.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12743.526217 secs 2024-04-21T13:57:13.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:12 smithi170 ceph-mon[31212]: pgmap v6889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:57:13.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12743.526217 secs 2024-04-21T13:57:13.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:12 smithi077 ceph-mon[27902]: pgmap v6889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:57:13.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12743.526217 secs 2024-04-21T13:57:13.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:12 smithi191 ceph-mon[31636]: pgmap v6889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:57:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:15.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12745.286619 secs 2024-04-21T13:57:15.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:14 smithi170 ceph-mon[31212]: pgmap v6890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:57:15.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12745.286619 secs 2024-04-21T13:57:15.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:14 smithi077 ceph-mon[27902]: pgmap v6890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:57:15.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12745.286619 secs 2024-04-21T13:57:15.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:14 smithi191 ceph-mon[31636]: pgmap v6890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:57:17.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:16 smithi170 ceph-mon[31212]: pgmap v6891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:57:17.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:16 smithi077 ceph-mon[27902]: pgmap v6891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:57:17.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:16 smithi191 ceph-mon[31636]: pgmap v6891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:57:18.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12748.526350 secs 2024-04-21T13:57:18.358 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12748.526350 secs 2024-04-21T13:57:18.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12748.526350 secs 2024-04-21T13:57:19.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:19 smithi170 ceph-mon[31212]: pgmap v6892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:57:19.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:19 smithi077 ceph-mon[27902]: pgmap v6892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:57:19.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:19 smithi191 ceph-mon[31636]: pgmap v6892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:57:20.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:20.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12750.286730 secs 2024-04-21T13:57:20.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12750.286730 secs 2024-04-21T13:57:20.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12750.286730 secs 2024-04-21T13:57:21.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:21 smithi170 ceph-mon[31212]: pgmap v6893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:57:21.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:21 smithi077 ceph-mon[27902]: pgmap v6893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:57:21.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:21 smithi191 ceph-mon[31636]: pgmap v6893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:57:23.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12753.526494 secs 2024-04-21T13:57:23.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:23 smithi170 ceph-mon[31212]: pgmap v6894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:57:23.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12753.526494 secs 2024-04-21T13:57:23.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:23 smithi077 ceph-mon[27902]: pgmap v6894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:57:23.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12753.526494 secs 2024-04-21T13:57:23.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:23 smithi191 ceph-mon[31636]: pgmap v6894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:57:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:25.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12755.286889 secs 2024-04-21T13:57:25.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:25 smithi170 ceph-mon[31212]: pgmap v6895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:25.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12755.286889 secs 2024-04-21T13:57:25.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:25 smithi077 ceph-mon[27902]: pgmap v6895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:25.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12755.286889 secs 2024-04-21T13:57:25.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:25 smithi191 ceph-mon[31636]: pgmap v6895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:27.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:27 smithi170 ceph-mon[31212]: pgmap v6896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:27.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:27 smithi077 ceph-mon[27902]: pgmap v6896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:27.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:27 smithi191 ceph-mon[31636]: pgmap v6896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:28.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12758.526634 secs 2024-04-21T13:57:28.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12758.526634 secs 2024-04-21T13:57:28.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12758.526634 secs 2024-04-21T13:57:29.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:29 smithi170 ceph-mon[31212]: pgmap v6897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:29.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:29 smithi077 ceph-mon[27902]: pgmap v6897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:29.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:29 smithi191 ceph-mon[31636]: pgmap v6897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:30.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12760.287002 secs 2024-04-21T13:57:30.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12760.287002 secs 2024-04-21T13:57:30.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12760.287002 secs 2024-04-21T13:57:31.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:31 smithi170 ceph-mon[31212]: pgmap v6898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:31.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:31 smithi077 ceph-mon[27902]: pgmap v6898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:31.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:31 smithi191 ceph-mon[31636]: pgmap v6898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:32.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:32 smithi170 ceph-mon[31212]: pgmap v6899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:32.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:32 smithi077 ceph-mon[27902]: pgmap v6899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:32.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:32 smithi191 ceph-mon[31636]: pgmap v6899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:33.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12763.526766 secs 2024-04-21T13:57:33.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12763.526766 secs 2024-04-21T13:57:33.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12763.526766 secs 2024-04-21T13:57:34.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:34 smithi170 ceph-mon[31212]: pgmap v6900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:34.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:34 smithi077 ceph-mon[27902]: pgmap v6900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:34.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:34 smithi191 ceph-mon[31636]: pgmap v6900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:35.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12765.287112 secs 2024-04-21T13:57:35.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12765.287112 secs 2024-04-21T13:57:35.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12765.287112 secs 2024-04-21T13:57:36.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:36 smithi077 ceph-mon[27902]: pgmap v6901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:36.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:36 smithi191 ceph-mon[31636]: pgmap v6901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:36.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:36 smithi170 ceph-mon[31212]: pgmap v6901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:37.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12768.526883 secs 2024-04-21T13:57:37.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12768.526883 secs 2024-04-21T13:57:37.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12768.526883 secs 2024-04-21T13:57:38.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:38 smithi077 ceph-mon[27902]: pgmap v6902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:38.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:38 smithi191 ceph-mon[31636]: pgmap v6902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:38.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:38 smithi170 ceph-mon[31212]: pgmap v6902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:39.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12770.287187 secs 2024-04-21T13:57:39.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12770.287187 secs 2024-04-21T13:57:39.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12770.287187 secs 2024-04-21T13:57:40.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:40.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:40 smithi191 ceph-mon[31636]: pgmap v6903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:40.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:40 smithi170 ceph-mon[31212]: pgmap v6903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:40.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:40 smithi077 ceph-mon[27902]: pgmap v6903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:43.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12773.527001 secs 2024-04-21T13:57:43.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:42 smithi191 ceph-mon[31636]: pgmap v6904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:43.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12773.527001 secs 2024-04-21T13:57:43.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:42 smithi170 ceph-mon[31212]: pgmap v6904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:43.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12773.527001 secs 2024-04-21T13:57:43.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:42 smithi077 ceph-mon[27902]: pgmap v6904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:45.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:45.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12775.287298 secs 2024-04-21T13:57:45.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:44 smithi191 ceph-mon[31636]: pgmap v6905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:45.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12775.287298 secs 2024-04-21T13:57:45.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:44 smithi170 ceph-mon[31212]: pgmap v6905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:45.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12775.287298 secs 2024-04-21T13:57:45.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:44 smithi077 ceph-mon[27902]: pgmap v6905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:47.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:46 smithi191 ceph-mon[31636]: pgmap v6906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:47.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:46 smithi170 ceph-mon[31212]: pgmap v6906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:47.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:46 smithi077 ceph-mon[27902]: pgmap v6906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:48.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12778.527121 secs 2024-04-21T13:57:48.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12778.527121 secs 2024-04-21T13:57:48.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12778.527121 secs 2024-04-21T13:57:49.196 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:48 smithi170 ceph-mon[31212]: pgmap v6907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:49.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:48 smithi191 ceph-mon[31636]: pgmap v6907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:49.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:48 smithi077 ceph-mon[27902]: pgmap v6907: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:50.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12780.287435 secs 2024-04-21T13:57:50.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12780.287435 secs 2024-04-21T13:57:50.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12780.287435 secs 2024-04-21T13:57:51.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:50 smithi191 ceph-mon[31636]: pgmap v6908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:51.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:50 smithi170 ceph-mon[31212]: pgmap v6908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:51.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:50 smithi077 ceph-mon[27902]: pgmap v6908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:53.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12783.527246 secs 2024-04-21T13:57:53.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:52 smithi191 ceph-mon[31636]: pgmap v6909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:53.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12783.527246 secs 2024-04-21T13:57:53.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:52 smithi170 ceph-mon[31212]: pgmap v6909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:53.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12783.527246 secs 2024-04-21T13:57:53.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:52 smithi077 ceph-mon[27902]: pgmap v6909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:55.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:57:55.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12785.287550 secs 2024-04-21T13:57:55.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:54 smithi191 ceph-mon[31636]: pgmap v6910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:55.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12785.287550 secs 2024-04-21T13:57:55.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:54 smithi170 ceph-mon[31212]: pgmap v6910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:55.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12785.287550 secs 2024-04-21T13:57:55.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:54 smithi077 ceph-mon[27902]: pgmap v6910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:57.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:56 smithi191 ceph-mon[31636]: pgmap v6911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:57.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:56 smithi170 ceph-mon[31212]: pgmap v6911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:57.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:56 smithi077 ceph-mon[27902]: pgmap v6911: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:57:58.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12788.527376 secs 2024-04-21T13:57:58.274 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12788.527376 secs 2024-04-21T13:57:58.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12788.527376 secs 2024-04-21T13:57:59.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:58 smithi191 ceph-mon[31636]: pgmap v6912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:59.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:58 smithi170 ceph-mon[31212]: pgmap v6912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:57:59.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:58 smithi077 ceph-mon[27902]: pgmap v6912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:00.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:00.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:57:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12790.287663 secs 2024-04-21T13:58:00.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:57:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12790.287663 secs 2024-04-21T13:58:00.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:57:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12790.287663 secs 2024-04-21T13:58:01.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:00 smithi191 ceph-mon[31636]: pgmap v6913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:01.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:00 smithi170 ceph-mon[31212]: pgmap v6913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:01.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:00 smithi077 ceph-mon[27902]: pgmap v6913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:03.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12793.527503 secs 2024-04-21T13:58:03.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:02 smithi170 ceph-mon[31212]: pgmap v6914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:03.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12793.527503 secs 2024-04-21T13:58:03.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:02 smithi077 ceph-mon[27902]: pgmap v6914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:03.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12793.527503 secs 2024-04-21T13:58:03.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:02 smithi191 ceph-mon[31636]: pgmap v6914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:05.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12795.287798 secs 2024-04-21T13:58:05.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:04 smithi170 ceph-mon[31212]: pgmap v6915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:05.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:04 smithi170 ceph-mon[31212]: osdmap e503: 12 total, 12 up, 12 in 2024-04-21T13:58:05.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12795.287798 secs 2024-04-21T13:58:05.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:04 smithi077 ceph-mon[27902]: pgmap v6915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:05.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:04 smithi077 ceph-mon[27902]: osdmap e503: 12 total, 12 up, 12 in 2024-04-21T13:58:05.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12795.287798 secs 2024-04-21T13:58:05.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:04 smithi191 ceph-mon[31636]: pgmap v6915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:05.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:04 smithi191 ceph-mon[31636]: osdmap e503: 12 total, 12 up, 12 in 2024-04-21T13:58:07.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:06 smithi170 ceph-mon[31212]: pgmap v6917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:58:07.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:06 smithi077 ceph-mon[27902]: pgmap v6917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:58:07.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:06 smithi191 ceph-mon[31636]: pgmap v6917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:58:08.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12798.527626 secs 2024-04-21T13:58:08.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12798.527626 secs 2024-04-21T13:58:08.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12798.527626 secs 2024-04-21T13:58:09.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:09 smithi170 ceph-mon[31212]: pgmap v6918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:58:09.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:08 smithi077 ceph-mon[27902]: pgmap v6918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:58:09.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:09 smithi191 ceph-mon[31636]: pgmap v6918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:58:10.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:10.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12800.287915 secs 2024-04-21T13:58:10.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:10 smithi170 ceph-mon[31212]: osdmap e504: 12 total, 12 up, 12 in 2024-04-21T13:58:10.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12800.287915 secs 2024-04-21T13:58:10.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:10 smithi077 ceph-mon[27902]: osdmap e504: 12 total, 12 up, 12 in 2024-04-21T13:58:10.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12800.287915 secs 2024-04-21T13:58:10.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:10 smithi191 ceph-mon[31636]: osdmap e504: 12 total, 12 up, 12 in 2024-04-21T13:58:11.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:11 smithi170 ceph-mon[31212]: pgmap v6920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:58:11.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:58:11.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:11 smithi077 ceph-mon[27902]: pgmap v6920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:58:11.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:58:11.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:11 smithi191 ceph-mon[31636]: pgmap v6920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T13:58:11.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:58:12.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12803.527715 secs 2024-04-21T13:58:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: pgmap v6921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:58:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:58:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:58:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.794 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12803.527715 secs 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: pgmap v6921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:58:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12803.527715 secs 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: pgmap v6921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T13:58:12.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:58:12.874 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:58:12.874 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:58:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:15.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12805.288038 secs 2024-04-21T13:58:15.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:14 smithi191 ceph-mon[31636]: pgmap v6922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:58:15.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12805.288038 secs 2024-04-21T13:58:15.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:14 smithi170 ceph-mon[31212]: pgmap v6922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:58:15.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12805.288038 secs 2024-04-21T13:58:15.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:14 smithi077 ceph-mon[27902]: pgmap v6922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T13:58:17.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:16 smithi191 ceph-mon[31636]: pgmap v6923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:58:17.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:16 smithi170 ceph-mon[31212]: pgmap v6923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:58:17.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:16 smithi077 ceph-mon[27902]: pgmap v6923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:58:18.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12808.527839 secs 2024-04-21T13:58:18.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12808.527839 secs 2024-04-21T13:58:18.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12808.527839 secs 2024-04-21T13:58:19.195 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:18 smithi170 ceph-mon[31212]: pgmap v6924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:58:19.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:18 smithi191 ceph-mon[31636]: pgmap v6924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:58:19.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:18 smithi077 ceph-mon[27902]: pgmap v6924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:58:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 12995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:20.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12810.288168 secs 2024-04-21T13:58:20.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12810.288168 secs 2024-04-21T13:58:20.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12810.288168 secs 2024-04-21T13:58:21.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:20 smithi191 ceph-mon[31636]: pgmap v6925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:58:21.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:20 smithi170 ceph-mon[31212]: pgmap v6925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:58:21.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:20 smithi077 ceph-mon[27902]: pgmap v6925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T13:58:23.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12813.527920 secs 2024-04-21T13:58:23.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:22 smithi191 ceph-mon[31636]: pgmap v6926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:58:23.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12813.527920 secs 2024-04-21T13:58:23.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:22 smithi170 ceph-mon[31212]: pgmap v6926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:58:23.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12813.527920 secs 2024-04-21T13:58:23.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:22 smithi077 ceph-mon[27902]: pgmap v6926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:58:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:25.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12815.288292 secs 2024-04-21T13:58:25.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:24 smithi191 ceph-mon[31636]: pgmap v6927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:25.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12815.288292 secs 2024-04-21T13:58:25.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:24 smithi170 ceph-mon[31212]: pgmap v6927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:25.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12815.288292 secs 2024-04-21T13:58:25.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:24 smithi077 ceph-mon[27902]: pgmap v6927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:27.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:26 smithi191 ceph-mon[31636]: pgmap v6928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:27.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:26 smithi170 ceph-mon[31212]: pgmap v6928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:27.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:26 smithi077 ceph-mon[27902]: pgmap v6928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:28.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12818.528001 secs 2024-04-21T13:58:28.274 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12818.528001 secs 2024-04-21T13:58:28.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12818.528001 secs 2024-04-21T13:58:29.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:28 smithi170 ceph-mon[31212]: pgmap v6929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:29.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:28 smithi077 ceph-mon[27902]: pgmap v6929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:29.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:28 smithi191 ceph-mon[31636]: pgmap v6929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:30.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12820.288411 secs 2024-04-21T13:58:30.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12820.288411 secs 2024-04-21T13:58:30.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12820.288411 secs 2024-04-21T13:58:31.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:30 smithi170 ceph-mon[31212]: pgmap v6930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:31.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:30 smithi077 ceph-mon[27902]: pgmap v6930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:31.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:30 smithi191 ceph-mon[31636]: pgmap v6930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:33.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12823.528132 secs 2024-04-21T13:58:33.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:32 smithi170 ceph-mon[31212]: pgmap v6931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:33.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12823.528132 secs 2024-04-21T13:58:33.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:32 smithi077 ceph-mon[27902]: pgmap v6931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:33.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12823.528132 secs 2024-04-21T13:58:33.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:32 smithi191 ceph-mon[31636]: pgmap v6931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:35.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12825.288545 secs 2024-04-21T13:58:35.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:34 smithi170 ceph-mon[31212]: pgmap v6932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:35.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12825.288545 secs 2024-04-21T13:58:35.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:34 smithi077 ceph-mon[27902]: pgmap v6932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:35.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12825.288545 secs 2024-04-21T13:58:35.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:34 smithi191 ceph-mon[31636]: pgmap v6932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:37.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:36 smithi170 ceph-mon[31212]: pgmap v6933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:37.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:36 smithi077 ceph-mon[27902]: pgmap v6933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:37.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:36 smithi191 ceph-mon[31636]: pgmap v6933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:38.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12828.528212 secs 2024-04-21T13:58:38.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12828.528212 secs 2024-04-21T13:58:38.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12828.528212 secs 2024-04-21T13:58:39.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:38 smithi170 ceph-mon[31212]: pgmap v6934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:39.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:38 smithi077 ceph-mon[27902]: pgmap v6934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:39.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:38 smithi191 ceph-mon[31636]: pgmap v6934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:40.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:40.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12830.288678 secs 2024-04-21T13:58:40.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12830.288678 secs 2024-04-21T13:58:40.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12830.288678 secs 2024-04-21T13:58:41.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:41 smithi170 ceph-mon[31212]: pgmap v6935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:41.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:41 smithi077 ceph-mon[27902]: pgmap v6935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:41.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:41 smithi191 ceph-mon[31636]: pgmap v6935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:43.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12833.528329 secs 2024-04-21T13:58:43.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:43 smithi170 ceph-mon[31212]: pgmap v6936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:43.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12833.528329 secs 2024-04-21T13:58:43.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:43 smithi077 ceph-mon[27902]: pgmap v6936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:43.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12833.528329 secs 2024-04-21T13:58:43.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:43 smithi191 ceph-mon[31636]: pgmap v6936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:45.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:45.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12835.288798 secs 2024-04-21T13:58:45.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:45 smithi170 ceph-mon[31212]: pgmap v6937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:45.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12835.288798 secs 2024-04-21T13:58:45.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:45 smithi077 ceph-mon[27902]: pgmap v6937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:45.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12835.288798 secs 2024-04-21T13:58:45.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:45 smithi191 ceph-mon[31636]: pgmap v6937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:47.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:47 smithi170 ceph-mon[31212]: pgmap v6938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:47.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:47 smithi077 ceph-mon[27902]: pgmap v6938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:47.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:47 smithi191 ceph-mon[31636]: pgmap v6938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:48.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12838.528458 secs 2024-04-21T13:58:48.357 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12838.528458 secs 2024-04-21T13:58:48.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12838.528458 secs 2024-04-21T13:58:49.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:49 smithi170 ceph-mon[31212]: pgmap v6939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:49.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:49 smithi077 ceph-mon[27902]: pgmap v6939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:49.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:49 smithi191 ceph-mon[31636]: pgmap v6939: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:50.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12840.288901 secs 2024-04-21T13:58:50.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12840.288901 secs 2024-04-21T13:58:50.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12840.288901 secs 2024-04-21T13:58:51.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:51 smithi170 ceph-mon[31212]: pgmap v6940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:51.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:51 smithi077 ceph-mon[27902]: pgmap v6940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:51.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:51 smithi191 ceph-mon[31636]: pgmap v6940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:53.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12843.528558 secs 2024-04-21T13:58:53.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:53 smithi170 ceph-mon[31212]: pgmap v6941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:53.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12843.528558 secs 2024-04-21T13:58:53.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:53 smithi077 ceph-mon[27902]: pgmap v6941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:53.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12843.528558 secs 2024-04-21T13:58:53.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:53 smithi191 ceph-mon[31636]: pgmap v6941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.428+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T13:58:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.428+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T13:58:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.428+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:58:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.428+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T13:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.428+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T13:58:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.429+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T13:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T13:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T13:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T13:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T13:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T13:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T13:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T13:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T13:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T13:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:54.435+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7005c040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T13:58:55.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:58:55.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12845.289043 secs 2024-04-21T13:58:55.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:55 smithi170 ceph-mon[31212]: pgmap v6942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:55.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12845.289043 secs 2024-04-21T13:58:55.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:55 smithi077 ceph-mon[27902]: pgmap v6942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:55.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12845.289043 secs 2024-04-21T13:58:55.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:55 smithi191 ceph-mon[31636]: pgmap v6942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:56.126+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:58:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:56.126+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:58:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:56.126+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T13:58:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T13:58:56.126+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T13:58:57.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:57 smithi170 ceph-mon[31212]: pgmap v6943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:57.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:57 smithi077 ceph-mon[27902]: pgmap v6943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:57.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:57 smithi191 ceph-mon[31636]: pgmap v6943: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:58:58.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12848.528694 secs 2024-04-21T13:58:58.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12848.528694 secs 2024-04-21T13:58:58.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12848.528694 secs 2024-04-21T13:58:59.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:58:59 smithi170 ceph-mon[31212]: pgmap v6944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:59.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:58:59 smithi077 ceph-mon[27902]: pgmap v6944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:58:59.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:58:59 smithi191 ceph-mon[31636]: pgmap v6944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:00.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:00.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12850.289165 secs 2024-04-21T13:59:00.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:00 smithi170 ceph-mon[31212]: pgmap v6945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:00.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12850.289165 secs 2024-04-21T13:59:00.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:00 smithi077 ceph-mon[27902]: pgmap v6945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:00.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12850.289165 secs 2024-04-21T13:59:00.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:00 smithi191 ceph-mon[31636]: pgmap v6945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:03.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12853.528831 secs 2024-04-21T13:59:03.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:02 smithi191 ceph-mon[31636]: pgmap v6946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:59:03.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12853.528831 secs 2024-04-21T13:59:03.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:02 smithi170 ceph-mon[31212]: pgmap v6946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:59:03.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12853.528831 secs 2024-04-21T13:59:03.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:02 smithi077 ceph-mon[27902]: pgmap v6946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T13:59:05.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:05.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12855.289285 secs 2024-04-21T13:59:05.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:04 smithi191 ceph-mon[31636]: pgmap v6947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T13:59:05.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:04 smithi191 ceph-mon[31636]: osdmap e505: 12 total, 12 up, 12 in 2024-04-21T13:59:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12855.289285 secs 2024-04-21T13:59:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:04 smithi170 ceph-mon[31212]: pgmap v6947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T13:59:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:04 smithi170 ceph-mon[31212]: osdmap e505: 12 total, 12 up, 12 in 2024-04-21T13:59:05.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12855.289285 secs 2024-04-21T13:59:05.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:04 smithi077 ceph-mon[27902]: pgmap v6947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T13:59:05.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:04 smithi077 ceph-mon[27902]: osdmap e505: 12 total, 12 up, 12 in 2024-04-21T13:59:07.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:06 smithi191 ceph-mon[31636]: pgmap v6949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:59:07.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:06 smithi170 ceph-mon[31212]: pgmap v6949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:59:07.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:06 smithi077 ceph-mon[27902]: pgmap v6949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:59:08.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12858.528955 secs 2024-04-21T13:59:08.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12858.528955 secs 2024-04-21T13:59:08.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12858.528955 secs 2024-04-21T13:59:09.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:08 smithi191 ceph-mon[31636]: pgmap v6950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:59:09.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:08 smithi170 ceph-mon[31212]: pgmap v6950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:59:09.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:08 smithi077 ceph-mon[27902]: pgmap v6950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T13:59:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:10.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12860.289360 secs 2024-04-21T13:59:10.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:10 smithi170 ceph-mon[31212]: osdmap e506: 12 total, 12 up, 12 in 2024-04-21T13:59:10.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12860.289360 secs 2024-04-21T13:59:10.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:10 smithi077 ceph-mon[27902]: osdmap e506: 12 total, 12 up, 12 in 2024-04-21T13:59:10.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12860.289360 secs 2024-04-21T13:59:10.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:10 smithi191 ceph-mon[31636]: osdmap e506: 12 total, 12 up, 12 in 2024-04-21T13:59:11.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:11 smithi170 ceph-mon[31212]: pgmap v6952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T13:59:11.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:11 smithi077 ceph-mon[27902]: pgmap v6952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T13:59:11.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:11 smithi191 ceph-mon[31636]: pgmap v6952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T13:59:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12863.529074 secs 2024-04-21T13:59:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:13 smithi170 ceph-mon[31212]: pgmap v6953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T13:59:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:59:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:59:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:59:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:59:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12863.529074 secs 2024-04-21T13:59:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:13 smithi077 ceph-mon[27902]: pgmap v6953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T13:59:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:59:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:59:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:59:13.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:59:13.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12863.529074 secs 2024-04-21T13:59:13.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:13 smithi191 ceph-mon[31636]: pgmap v6953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T13:59:13.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T13:59:13.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T13:59:13.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T13:59:13.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T13:59:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:15.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12865.289435 secs 2024-04-21T13:59:15.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:15 smithi170 ceph-mon[31212]: pgmap v6954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T13:59:15.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12865.289435 secs 2024-04-21T13:59:15.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:15 smithi077 ceph-mon[27902]: pgmap v6954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T13:59:15.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12865.289435 secs 2024-04-21T13:59:15.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:15 smithi191 ceph-mon[31636]: pgmap v6954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T13:59:17.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:17 smithi170 ceph-mon[31212]: pgmap v6955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:59:17.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:17 smithi077 ceph-mon[27902]: pgmap v6955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:59:17.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:17 smithi191 ceph-mon[31636]: pgmap v6955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:59:18.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12868.529203 secs 2024-04-21T13:59:18.356 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12868.529203 secs 2024-04-21T13:59:18.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12868.529203 secs 2024-04-21T13:59:19.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:19 smithi170 ceph-mon[31212]: pgmap v6956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:59:19.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:19 smithi077 ceph-mon[27902]: pgmap v6956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:59:19.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:19 smithi191 ceph-mon[31636]: pgmap v6956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T13:59:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:20.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12870.289545 secs 2024-04-21T13:59:20.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12870.289545 secs 2024-04-21T13:59:20.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12870.289545 secs 2024-04-21T13:59:21.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:21 smithi170 ceph-mon[31212]: pgmap v6957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T13:59:21.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:21 smithi077 ceph-mon[27902]: pgmap v6957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T13:59:21.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:21 smithi191 ceph-mon[31636]: pgmap v6957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T13:59:23.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12873.529320 secs 2024-04-21T13:59:23.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:23 smithi170 ceph-mon[31212]: pgmap v6958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:59:23.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12873.529320 secs 2024-04-21T13:59:23.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:23 smithi077 ceph-mon[27902]: pgmap v6958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:59:23.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12873.529320 secs 2024-04-21T13:59:23.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:23 smithi191 ceph-mon[31636]: pgmap v6958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T13:59:24.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12875.289654 secs 2024-04-21T13:59:24.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:24 smithi077 ceph-mon[27902]: pgmap v6959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:24.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12875.289654 secs 2024-04-21T13:59:24.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:24 smithi191 ceph-mon[31636]: pgmap v6959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:24.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12875.289654 secs 2024-04-21T13:59:24.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:24 smithi170 ceph-mon[31212]: pgmap v6959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:27.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:26 smithi191 ceph-mon[31636]: pgmap v6960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:27.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:26 smithi170 ceph-mon[31212]: pgmap v6960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:27.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:26 smithi077 ceph-mon[27902]: pgmap v6960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:28.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12878.529392 secs 2024-04-21T13:59:28.273 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12878.529392 secs 2024-04-21T13:59:28.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12878.529392 secs 2024-04-21T13:59:29.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:28 smithi191 ceph-mon[31636]: pgmap v6961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:29.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:28 smithi170 ceph-mon[31212]: pgmap v6961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:29.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:28 smithi077 ceph-mon[27902]: pgmap v6961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:30.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12880.289764 secs 2024-04-21T13:59:30.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12880.289764 secs 2024-04-21T13:59:30.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12880.289764 secs 2024-04-21T13:59:31.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:30 smithi191 ceph-mon[31636]: pgmap v6962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:31.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:30 smithi170 ceph-mon[31212]: pgmap v6962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:31.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:30 smithi077 ceph-mon[27902]: pgmap v6962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:33.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12883.529527 secs 2024-04-21T13:59:33.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:32 smithi170 ceph-mon[31212]: pgmap v6963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:33.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12883.529527 secs 2024-04-21T13:59:33.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:32 smithi077 ceph-mon[27902]: pgmap v6963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:33.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12883.529527 secs 2024-04-21T13:59:33.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:32 smithi191 ceph-mon[31636]: pgmap v6963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:35.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12885.289902 secs 2024-04-21T13:59:35.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:34 smithi170 ceph-mon[31212]: pgmap v6964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:35.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12885.289902 secs 2024-04-21T13:59:35.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:34 smithi077 ceph-mon[27902]: pgmap v6964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:35.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12885.289902 secs 2024-04-21T13:59:35.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:34 smithi191 ceph-mon[31636]: pgmap v6964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:37.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:36 smithi170 ceph-mon[31212]: pgmap v6965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:37.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:36 smithi077 ceph-mon[27902]: pgmap v6965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:37.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:36 smithi191 ceph-mon[31636]: pgmap v6965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:38.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12888.529644 secs 2024-04-21T13:59:38.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12888.529644 secs 2024-04-21T13:59:38.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12888.529644 secs 2024-04-21T13:59:39.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:38 smithi170 ceph-mon[31212]: pgmap v6966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:39.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:38 smithi077 ceph-mon[27902]: pgmap v6966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:39.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:38 smithi191 ceph-mon[31636]: pgmap v6966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:40.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12890.290004 secs 2024-04-21T13:59:40.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12890.290004 secs 2024-04-21T13:59:40.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12890.290004 secs 2024-04-21T13:59:41.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:41 smithi170 ceph-mon[31212]: pgmap v6967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:41.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:41 smithi077 ceph-mon[27902]: pgmap v6967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:41.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:41 smithi191 ceph-mon[31636]: pgmap v6967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T13:59:43.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12893.529742 secs 2024-04-21T13:59:43.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:43 smithi170 ceph-mon[31212]: pgmap v6968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:43.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12893.529742 secs 2024-04-21T13:59:43.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:43 smithi077 ceph-mon[27902]: pgmap v6968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:43.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12893.529742 secs 2024-04-21T13:59:43.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:43 smithi191 ceph-mon[31636]: pgmap v6968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:45.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12895.290140 secs 2024-04-21T13:59:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:45 smithi170 ceph-mon[31212]: pgmap v6969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:45.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12895.290140 secs 2024-04-21T13:59:45.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:45 smithi077 ceph-mon[27902]: pgmap v6969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:45.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12895.290140 secs 2024-04-21T13:59:45.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:45 smithi191 ceph-mon[31636]: pgmap v6969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:47.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:47 smithi170 ceph-mon[31212]: pgmap v6970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:47.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:47 smithi077 ceph-mon[27902]: pgmap v6970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:47.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:47 smithi191 ceph-mon[31636]: pgmap v6970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:48.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12898.529867 secs 2024-04-21T13:59:48.356 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12898.529867 secs 2024-04-21T13:59:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12898.529867 secs 2024-04-21T13:59:49.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:49 smithi170 ceph-mon[31212]: pgmap v6971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:49.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:49 smithi077 ceph-mon[27902]: pgmap v6971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:49.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:49 smithi191 ceph-mon[31636]: pgmap v6971: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:50.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:50.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12900.290254 secs 2024-04-21T13:59:50.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12900.290254 secs 2024-04-21T13:59:50.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12900.290254 secs 2024-04-21T13:59:51.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:51 smithi170 ceph-mon[31212]: pgmap v6972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:51.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:51 smithi077 ceph-mon[27902]: pgmap v6972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:51.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:51 smithi191 ceph-mon[31636]: pgmap v6972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:53.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12903.529934 secs 2024-04-21T13:59:53.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:53 smithi170 ceph-mon[31212]: pgmap v6973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:53.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12903.529934 secs 2024-04-21T13:59:53.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:53 smithi077 ceph-mon[27902]: pgmap v6973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:53.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12903.529934 secs 2024-04-21T13:59:53.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:53 smithi191 ceph-mon[31636]: pgmap v6973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:55.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T13:59:55.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12905.290383 secs 2024-04-21T13:59:55.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:55 smithi170 ceph-mon[31212]: pgmap v6974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:55.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12905.290383 secs 2024-04-21T13:59:55.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:55 smithi077 ceph-mon[27902]: pgmap v6974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:55.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12905.290383 secs 2024-04-21T13:59:55.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:55 smithi191 ceph-mon[31636]: pgmap v6974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:57.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:57 smithi170 ceph-mon[31212]: pgmap v6975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:57.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:57 smithi077 ceph-mon[27902]: pgmap v6975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:57.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:57 smithi191 ceph-mon[31636]: pgmap v6975: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T13:59:58.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12908.530058 secs 2024-04-21T13:59:58.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12908.530058 secs 2024-04-21T13:59:58.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12908.530058 secs 2024-04-21T13:59:59.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 13:59:59 smithi170 ceph-mon[31212]: pgmap v6976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:59.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 13:59:59 smithi077 ceph-mon[27902]: pgmap v6976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T13:59:59.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 13:59:59 smithi191 ceph-mon[31636]: pgmap v6976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:00.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12910.290516 secs 2024-04-21T14:00:00.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:00:00.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12910.290516 secs 2024-04-21T14:00:00.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:00:00.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12910.290516 secs 2024-04-21T14:00:00.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:00:01.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:01 smithi170 ceph-mon[31212]: pgmap v6977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:01.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:01 smithi077 ceph-mon[27902]: pgmap v6977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:01.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:01 smithi191 ceph-mon[31636]: pgmap v6977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:03.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12913.530175 secs 2024-04-21T14:00:03.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:03 smithi170 ceph-mon[31212]: pgmap v6978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:03.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12913.530175 secs 2024-04-21T14:00:03.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:03 smithi077 ceph-mon[27902]: pgmap v6978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:03.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12913.530175 secs 2024-04-21T14:00:03.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:03 smithi191 ceph-mon[31636]: pgmap v6978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:05.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12915.290652 secs 2024-04-21T14:00:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:05 smithi170 ceph-mon[31212]: pgmap v6979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:05 smithi170 ceph-mon[31212]: osdmap e507: 12 total, 12 up, 12 in 2024-04-21T14:00:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12915.290652 secs 2024-04-21T14:00:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:05 smithi077 ceph-mon[27902]: pgmap v6979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:05 smithi077 ceph-mon[27902]: osdmap e507: 12 total, 12 up, 12 in 2024-04-21T14:00:05.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12915.290652 secs 2024-04-21T14:00:05.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:05 smithi191 ceph-mon[31636]: pgmap v6979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:05.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:05 smithi191 ceph-mon[31636]: osdmap e507: 12 total, 12 up, 12 in 2024-04-21T14:00:06.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:06 smithi077 ceph-mon[27902]: pgmap v6981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:00:06.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:06 smithi191 ceph-mon[31636]: pgmap v6981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:00:06.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:06 smithi170 ceph-mon[31212]: pgmap v6981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:00:07.704 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12918.530291 secs 2024-04-21T14:00:07.793 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12918.530291 secs 2024-04-21T14:00:07.871 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12918.530291 secs 2024-04-21T14:00:08.704 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:08 smithi191 ceph-mon[31636]: pgmap v6982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:00:08.793 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:08 smithi170 ceph-mon[31212]: pgmap v6982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:00:08.871 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:08 smithi077 ceph-mon[27902]: pgmap v6982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:00:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:10.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12920.290722 secs 2024-04-21T14:00:10.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:10 smithi170 ceph-mon[31212]: osdmap e508: 12 total, 12 up, 12 in 2024-04-21T14:00:10.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12920.290722 secs 2024-04-21T14:00:10.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:10 smithi077 ceph-mon[27902]: osdmap e508: 12 total, 12 up, 12 in 2024-04-21T14:00:10.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12920.290722 secs 2024-04-21T14:00:10.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:10 smithi191 ceph-mon[31636]: osdmap e508: 12 total, 12 up, 12 in 2024-04-21T14:00:11.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:11 smithi170 ceph-mon[31212]: pgmap v6984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:00:11.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:11 smithi077 ceph-mon[27902]: pgmap v6984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:00:11.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:11 smithi191 ceph-mon[31636]: pgmap v6984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:00:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12923.530403 secs 2024-04-21T14:00:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:13 smithi170 ceph-mon[31212]: pgmap v6985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:00:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:00:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12923.530403 secs 2024-04-21T14:00:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:13 smithi077 ceph-mon[27902]: pgmap v6985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:00:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:00:13.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12923.530403 secs 2024-04-21T14:00:13.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:13 smithi191 ceph-mon[31636]: pgmap v6985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:00:13.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:00:14.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:00:14.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:00:14.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:00:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:00:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:00:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:00:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:00:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:00:14.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:00:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:15.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12925.290818 secs 2024-04-21T14:00:15.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:15 smithi170 ceph-mon[31212]: pgmap v6986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:00:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12925.290818 secs 2024-04-21T14:00:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:15 smithi077 ceph-mon[27902]: pgmap v6986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:00:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12925.290818 secs 2024-04-21T14:00:15.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:15 smithi191 ceph-mon[31636]: pgmap v6986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:00:17.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:17 smithi170 ceph-mon[31212]: pgmap v6987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:00:17.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:17 smithi077 ceph-mon[27902]: pgmap v6987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:00:17.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:17 smithi191 ceph-mon[31636]: pgmap v6987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:00:18.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12928.530518 secs 2024-04-21T14:00:18.356 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12928.530518 secs 2024-04-21T14:00:18.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12928.530518 secs 2024-04-21T14:00:19.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:19 smithi170 ceph-mon[31212]: pgmap v6988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:00:19.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:19 smithi077 ceph-mon[27902]: pgmap v6988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:00:19.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:19 smithi191 ceph-mon[31636]: pgmap v6988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:00:20.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:20.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12930.290892 secs 2024-04-21T14:00:20.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12930.290892 secs 2024-04-21T14:00:20.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12930.290892 secs 2024-04-21T14:00:21.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:21 smithi170 ceph-mon[31212]: pgmap v6989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:00:21.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:21 smithi077 ceph-mon[27902]: pgmap v6989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:00:21.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:21 smithi191 ceph-mon[31636]: pgmap v6989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:00:23.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12933.530616 secs 2024-04-21T14:00:23.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:23 smithi170 ceph-mon[31212]: pgmap v6990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:00:23.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12933.530616 secs 2024-04-21T14:00:23.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:23 smithi077 ceph-mon[27902]: pgmap v6990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:00:23.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12933.530616 secs 2024-04-21T14:00:23.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:23 smithi191 ceph-mon[31636]: pgmap v6990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:00:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:25.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12935.291002 secs 2024-04-21T14:00:25.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:25 smithi170 ceph-mon[31212]: pgmap v6991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:25.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12935.291002 secs 2024-04-21T14:00:25.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:25 smithi077 ceph-mon[27902]: pgmap v6991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:25.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12935.291002 secs 2024-04-21T14:00:25.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:25 smithi191 ceph-mon[31636]: pgmap v6991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:27.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:27 smithi170 ceph-mon[31212]: pgmap v6992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:27.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:27 smithi077 ceph-mon[27902]: pgmap v6992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:27.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:27 smithi191 ceph-mon[31636]: pgmap v6992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:28.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12938.530722 secs 2024-04-21T14:00:28.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12938.530722 secs 2024-04-21T14:00:28.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12938.530722 secs 2024-04-21T14:00:29.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:29 smithi170 ceph-mon[31212]: pgmap v6993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:29.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:29 smithi077 ceph-mon[27902]: pgmap v6993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:29.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:29 smithi191 ceph-mon[31636]: pgmap v6993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:30.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12940.291152 secs 2024-04-21T14:00:30.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12940.291152 secs 2024-04-21T14:00:30.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12940.291152 secs 2024-04-21T14:00:31.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:31 smithi170 ceph-mon[31212]: pgmap v6994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:31.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:31 smithi077 ceph-mon[27902]: pgmap v6994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:31.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:31 smithi191 ceph-mon[31636]: pgmap v6994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:33.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12943.530842 secs 2024-04-21T14:00:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:33 smithi170 ceph-mon[31212]: pgmap v6995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:33.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12943.530842 secs 2024-04-21T14:00:33.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:33 smithi077 ceph-mon[27902]: pgmap v6995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:33.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12943.530842 secs 2024-04-21T14:00:33.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:33 smithi191 ceph-mon[31636]: pgmap v6995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:35.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12945.291271 secs 2024-04-21T14:00:35.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:35 smithi170 ceph-mon[31212]: pgmap v6996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:35.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12945.291271 secs 2024-04-21T14:00:35.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:35 smithi077 ceph-mon[27902]: pgmap v6996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:35.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12945.291271 secs 2024-04-21T14:00:35.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:35 smithi191 ceph-mon[31636]: pgmap v6996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:37.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:37 smithi170 ceph-mon[31212]: pgmap v6997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:37.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:37 smithi077 ceph-mon[27902]: pgmap v6997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:37.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:37 smithi191 ceph-mon[31636]: pgmap v6997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:38.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12948.530920 secs 2024-04-21T14:00:38.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12948.530920 secs 2024-04-21T14:00:38.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12948.530920 secs 2024-04-21T14:00:39.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:39 smithi077 ceph-mon[27902]: pgmap v6998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:39.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:39 smithi191 ceph-mon[31636]: pgmap v6998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:39.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:39 smithi170 ceph-mon[31212]: pgmap v6998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:40.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12950.291388 secs 2024-04-21T14:00:40.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:40 smithi077 ceph-mon[27902]: pgmap v6999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:40.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12950.291388 secs 2024-04-21T14:00:40.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:40 smithi191 ceph-mon[31636]: pgmap v6999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:40.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12950.291388 secs 2024-04-21T14:00:40.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:40 smithi170 ceph-mon[31212]: pgmap v6999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:43.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12953.531039 secs 2024-04-21T14:00:43.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:42 smithi170 ceph-mon[31212]: pgmap v7000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:43.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12953.531039 secs 2024-04-21T14:00:43.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:42 smithi077 ceph-mon[27902]: pgmap v7000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:43.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12953.531039 secs 2024-04-21T14:00:43.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:42 smithi191 ceph-mon[31636]: pgmap v7000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:45.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:45.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12955.291509 secs 2024-04-21T14:00:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:44 smithi170 ceph-mon[31212]: pgmap v7001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:45.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12955.291509 secs 2024-04-21T14:00:45.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:44 smithi077 ceph-mon[27902]: pgmap v7001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:45.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12955.291509 secs 2024-04-21T14:00:45.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:44 smithi191 ceph-mon[31636]: pgmap v7001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:47.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:46 smithi170 ceph-mon[31212]: pgmap v7002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:47.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:46 smithi077 ceph-mon[27902]: pgmap v7002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:47.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:46 smithi191 ceph-mon[31636]: pgmap v7002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:48.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12958.531152 secs 2024-04-21T14:00:48.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12958.531152 secs 2024-04-21T14:00:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12958.531152 secs 2024-04-21T14:00:49.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:48 smithi170 ceph-mon[31212]: pgmap v7003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:49.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:48 smithi077 ceph-mon[27902]: pgmap v7003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:49.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:48 smithi191 ceph-mon[31636]: pgmap v7003: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:50.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12960.291653 secs 2024-04-21T14:00:50.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12960.291653 secs 2024-04-21T14:00:50.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12960.291653 secs 2024-04-21T14:00:51.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:50 smithi170 ceph-mon[31212]: pgmap v7004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:51.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:50 smithi077 ceph-mon[27902]: pgmap v7004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:51.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:50 smithi191 ceph-mon[31636]: pgmap v7004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:53.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12963.531296 secs 2024-04-21T14:00:53.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:52 smithi170 ceph-mon[31212]: pgmap v7005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:53.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12963.531296 secs 2024-04-21T14:00:53.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:52 smithi077 ceph-mon[27902]: pgmap v7005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:53.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12963.531296 secs 2024-04-21T14:00:53.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:52 smithi191 ceph-mon[31636]: pgmap v7005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:00:55.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12965.291802 secs 2024-04-21T14:00:55.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:55 smithi170 ceph-mon[31212]: pgmap v7006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:55.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12965.291802 secs 2024-04-21T14:00:55.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:55 smithi077 ceph-mon[27902]: pgmap v7006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:55.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12965.291802 secs 2024-04-21T14:00:55.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:55 smithi191 ceph-mon[31636]: pgmap v7006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:57.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:57 smithi170 ceph-mon[31212]: pgmap v7007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:57.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:57 smithi077 ceph-mon[27902]: pgmap v7007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:57.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:57 smithi191 ceph-mon[31636]: pgmap v7007: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:00:58.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12968.531408 secs 2024-04-21T14:00:58.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12968.531408 secs 2024-04-21T14:00:58.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12968.531408 secs 2024-04-21T14:00:59.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:00:59 smithi170 ceph-mon[31212]: pgmap v7008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:59.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:00:59 smithi077 ceph-mon[27902]: pgmap v7008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:00:59.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:00:59 smithi191 ceph-mon[31636]: pgmap v7008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:00.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12970.291921 secs 2024-04-21T14:01:00.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12970.291921 secs 2024-04-21T14:01:00.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12970.291921 secs 2024-04-21T14:01:01.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:01 smithi170 ceph-mon[31212]: pgmap v7009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:01.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:01 smithi077 ceph-mon[27902]: pgmap v7009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:01.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:01 smithi191 ceph-mon[31636]: pgmap v7009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12973.531556 secs 2024-04-21T14:01:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:03 smithi170 ceph-mon[31212]: pgmap v7010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:03.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12973.531556 secs 2024-04-21T14:01:03.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:03 smithi077 ceph-mon[27902]: pgmap v7010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:03.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12973.531556 secs 2024-04-21T14:01:03.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:03 smithi191 ceph-mon[31636]: pgmap v7010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12975.291983 secs 2024-04-21T14:01:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:05 smithi170 ceph-mon[31212]: pgmap v7011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:05 smithi170 ceph-mon[31212]: osdmap e509: 12 total, 12 up, 12 in 2024-04-21T14:01:05.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12975.291983 secs 2024-04-21T14:01:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:05 smithi077 ceph-mon[27902]: pgmap v7011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:05 smithi077 ceph-mon[27902]: osdmap e509: 12 total, 12 up, 12 in 2024-04-21T14:01:05.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12975.291983 secs 2024-04-21T14:01:05.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:05 smithi191 ceph-mon[31636]: pgmap v7011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:05.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:05 smithi191 ceph-mon[31636]: osdmap e509: 12 total, 12 up, 12 in 2024-04-21T14:01:07.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:07 smithi170 ceph-mon[31212]: pgmap v7013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:01:07.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:07 smithi077 ceph-mon[27902]: pgmap v7013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:01:07.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:07 smithi191 ceph-mon[31636]: pgmap v7013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:01:08.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12978.531656 secs 2024-04-21T14:01:08.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12978.531656 secs 2024-04-21T14:01:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12978.531656 secs 2024-04-21T14:01:09.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:09 smithi170 ceph-mon[31212]: pgmap v7014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:01:09.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:09 smithi170 ceph-mon[31212]: osdmap e510: 12 total, 12 up, 12 in 2024-04-21T14:01:09.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:09 smithi077 ceph-mon[27902]: pgmap v7014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:01:09.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:09 smithi077 ceph-mon[27902]: osdmap e510: 12 total, 12 up, 12 in 2024-04-21T14:01:09.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:09 smithi191 ceph-mon[31636]: pgmap v7014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:01:09.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:09 smithi191 ceph-mon[31636]: osdmap e510: 12 total, 12 up, 12 in 2024-04-21T14:01:10.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:10.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12980.292105 secs 2024-04-21T14:01:10.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12980.292105 secs 2024-04-21T14:01:10.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12980.292105 secs 2024-04-21T14:01:11.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:11 smithi170 ceph-mon[31212]: pgmap v7016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:01:11.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:11 smithi077 ceph-mon[27902]: pgmap v7016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:01:11.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:11 smithi191 ceph-mon[31636]: pgmap v7016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:01:13.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12983.531785 secs 2024-04-21T14:01:13.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:13 smithi170 ceph-mon[31212]: pgmap v7017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:01:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12983.531785 secs 2024-04-21T14:01:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:13 smithi077 ceph-mon[27902]: pgmap v7017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:01:13.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12983.531785 secs 2024-04-21T14:01:13.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:13 smithi191 ceph-mon[31636]: pgmap v7017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:01:14.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:01:14.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:01:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:01:15.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:15.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12985.292226 secs 2024-04-21T14:01:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:15 smithi077 ceph-mon[27902]: pgmap v7018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:01:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:01:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:01:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:01:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12985.292226 secs 2024-04-21T14:01:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:15 smithi191 ceph-mon[31636]: pgmap v7018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:01:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:01:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:01:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:01:15.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12985.292226 secs 2024-04-21T14:01:15.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:15 smithi170 ceph-mon[31212]: pgmap v7018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:01:15.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:01:15.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:01:15.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:01:17.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:17 smithi077 ceph-mon[27902]: pgmap v7019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:01:17.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:17 smithi191 ceph-mon[31636]: pgmap v7019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:01:17.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:17 smithi170 ceph-mon[31212]: pgmap v7019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:01:18.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12988.531929 secs 2024-04-21T14:01:18.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12988.531929 secs 2024-04-21T14:01:18.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12988.531929 secs 2024-04-21T14:01:19.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:19 smithi077 ceph-mon[27902]: pgmap v7020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:01:19.443 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:19 smithi170 ceph-mon[31212]: pgmap v7020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:01:19.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:19 smithi191 ceph-mon[31636]: pgmap v7020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:01:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:20.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12990.292320 secs 2024-04-21T14:01:20.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:20 smithi077 ceph-mon[27902]: pgmap v7021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:01:20.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12990.292320 secs 2024-04-21T14:01:20.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:20 smithi191 ceph-mon[31636]: pgmap v7021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:01:20.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12990.292320 secs 2024-04-21T14:01:20.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:20 smithi170 ceph-mon[31212]: pgmap v7021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:01:23.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12993.532046 secs 2024-04-21T14:01:23.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:22 smithi170 ceph-mon[31212]: pgmap v7022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:01:23.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12993.532046 secs 2024-04-21T14:01:23.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:22 smithi077 ceph-mon[27902]: pgmap v7022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:01:23.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12993.532046 secs 2024-04-21T14:01:23.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:22 smithi191 ceph-mon[31636]: pgmap v7022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:01:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:25.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 12995.292440 secs 2024-04-21T14:01:25.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:24 smithi170 ceph-mon[31212]: pgmap v7023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:25.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 12995.292440 secs 2024-04-21T14:01:25.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:24 smithi077 ceph-mon[27902]: pgmap v7023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:25.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 12995.292440 secs 2024-04-21T14:01:25.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:24 smithi191 ceph-mon[31636]: pgmap v7023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:27.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:26 smithi170 ceph-mon[31212]: pgmap v7024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:27.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:26 smithi077 ceph-mon[27902]: pgmap v7024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:27.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:26 smithi191 ceph-mon[31636]: pgmap v7024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:28.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 12998.532162 secs 2024-04-21T14:01:28.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 12998.532162 secs 2024-04-21T14:01:28.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 12998.532162 secs 2024-04-21T14:01:29.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:29 smithi170 ceph-mon[31212]: pgmap v7025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:29.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:29 smithi077 ceph-mon[27902]: pgmap v7025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:29.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:29 smithi191 ceph-mon[31636]: pgmap v7025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:30.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13000.292557 secs 2024-04-21T14:01:30.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13000.292557 secs 2024-04-21T14:01:30.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13000.292557 secs 2024-04-21T14:01:31.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:31 smithi170 ceph-mon[31212]: pgmap v7026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:31.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:31 smithi077 ceph-mon[27902]: pgmap v7026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:31.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:31 smithi191 ceph-mon[31636]: pgmap v7026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:01:33.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13003.532279 secs 2024-04-21T14:01:33.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:33 smithi170 ceph-mon[31212]: pgmap v7027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:33.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13003.532279 secs 2024-04-21T14:01:33.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:33 smithi077 ceph-mon[27902]: pgmap v7027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:33.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13003.532279 secs 2024-04-21T14:01:33.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:33 smithi191 ceph-mon[31636]: pgmap v7027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:35.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:35.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13005.292686 secs 2024-04-21T14:01:35.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:35 smithi170 ceph-mon[31212]: pgmap v7028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:35.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13005.292686 secs 2024-04-21T14:01:35.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:35 smithi077 ceph-mon[27902]: pgmap v7028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:35.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13005.292686 secs 2024-04-21T14:01:35.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:35 smithi191 ceph-mon[31636]: pgmap v7028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:37.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:37 smithi170 ceph-mon[31212]: pgmap v7029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:37.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:37 smithi077 ceph-mon[27902]: pgmap v7029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:37.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:37 smithi191 ceph-mon[31636]: pgmap v7029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:38.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13008.532393 secs 2024-04-21T14:01:38.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13008.532393 secs 2024-04-21T14:01:38.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13008.532393 secs 2024-04-21T14:01:39.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:39 smithi170 ceph-mon[31212]: pgmap v7030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:39.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:39 smithi077 ceph-mon[27902]: pgmap v7030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:39.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:39 smithi191 ceph-mon[31636]: pgmap v7030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:40.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:40.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13010.292834 secs 2024-04-21T14:01:40.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13010.292834 secs 2024-04-21T14:01:40.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13010.292834 secs 2024-04-21T14:01:41.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:41 smithi170 ceph-mon[31212]: pgmap v7031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:41.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:41 smithi077 ceph-mon[27902]: pgmap v7031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:41.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:41 smithi191 ceph-mon[31636]: pgmap v7031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:43.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13013.532509 secs 2024-04-21T14:01:43.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:43 smithi170 ceph-mon[31212]: pgmap v7032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:43.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13013.532509 secs 2024-04-21T14:01:43.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:43 smithi077 ceph-mon[27902]: pgmap v7032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:43.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13013.532509 secs 2024-04-21T14:01:43.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:43 smithi191 ceph-mon[31636]: pgmap v7032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:45.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13015.292963 secs 2024-04-21T14:01:45.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:45 smithi170 ceph-mon[31212]: pgmap v7033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:45.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13015.292963 secs 2024-04-21T14:01:45.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:45 smithi077 ceph-mon[27902]: pgmap v7033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:45.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13015.292963 secs 2024-04-21T14:01:45.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:45 smithi191 ceph-mon[31636]: pgmap v7033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:47.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:47 smithi170 ceph-mon[31212]: pgmap v7034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:47.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:47 smithi077 ceph-mon[27902]: pgmap v7034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:47.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:47 smithi191 ceph-mon[31636]: pgmap v7034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:48.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13018.532576 secs 2024-04-21T14:01:48.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13018.532576 secs 2024-04-21T14:01:48.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13018.532576 secs 2024-04-21T14:01:49.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:49 smithi170 ceph-mon[31212]: pgmap v7035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:49.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:49 smithi077 ceph-mon[27902]: pgmap v7035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:49.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:49 smithi191 ceph-mon[31636]: pgmap v7035: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:50.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:50.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13020.293056 secs 2024-04-21T14:01:50.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13020.293056 secs 2024-04-21T14:01:50.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13020.293056 secs 2024-04-21T14:01:51.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:51 smithi077 ceph-mon[27902]: pgmap v7036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:51.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:51 smithi191 ceph-mon[31636]: pgmap v7036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:51.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:51 smithi170 ceph-mon[31212]: pgmap v7036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:53.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13023.532708 secs 2024-04-21T14:01:53.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:53 smithi077 ceph-mon[27902]: pgmap v7037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:53.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13023.532708 secs 2024-04-21T14:01:53.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:53 smithi191 ceph-mon[31636]: pgmap v7037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:53.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13023.532708 secs 2024-04-21T14:01:53.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:53 smithi170 ceph-mon[31212]: pgmap v7037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:55.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:01:55.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13025.293188 secs 2024-04-21T14:01:55.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:55 smithi077 ceph-mon[27902]: pgmap v7038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:55.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13025.293188 secs 2024-04-21T14:01:55.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:55 smithi191 ceph-mon[31636]: pgmap v7038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:55.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13025.293188 secs 2024-04-21T14:01:55.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:55 smithi170 ceph-mon[31212]: pgmap v7038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:56.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:01:56.150+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:01:56.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:01:56.150+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:01:56.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:01:56.151+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:01:56.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:01:56.151+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:01:56.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:56 smithi077 ceph-mon[27902]: pgmap v7039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:56.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:56 smithi191 ceph-mon[31636]: pgmap v7039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:56.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:56 smithi170 ceph-mon[31212]: pgmap v7039: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:01:57.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13028.532840 secs 2024-04-21T14:01:57.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13028.532840 secs 2024-04-21T14:01:57.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13028.532840 secs 2024-04-21T14:01:58.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:58 smithi191 ceph-mon[31636]: pgmap v7040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:58.772 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:58 smithi077 ceph-mon[27902]: pgmap v7040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:58.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:58 smithi170 ceph-mon[31212]: pgmap v7040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:01:59.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:01:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13030.293264 secs 2024-04-21T14:01:59.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:01:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13030.293264 secs 2024-04-21T14:01:59.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:01:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13030.293264 secs 2024-04-21T14:02:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:00.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:00 smithi191 ceph-mon[31636]: pgmap v7041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:00.792 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:00 smithi170 ceph-mon[31212]: pgmap v7041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:00.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:00 smithi077 ceph-mon[27902]: pgmap v7041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13033.532975 secs 2024-04-21T14:02:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:03 smithi170 ceph-mon[31212]: pgmap v7042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:03.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13033.532975 secs 2024-04-21T14:02:03.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:03 smithi077 ceph-mon[27902]: pgmap v7042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:03.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13033.532975 secs 2024-04-21T14:02:03.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:03 smithi191 ceph-mon[31636]: pgmap v7042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:05.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:05.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13035.293389 secs 2024-04-21T14:02:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:05 smithi170 ceph-mon[31212]: pgmap v7043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:05 smithi170 ceph-mon[31212]: osdmap e511: 12 total, 12 up, 12 in 2024-04-21T14:02:05.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13035.293389 secs 2024-04-21T14:02:05.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:05 smithi077 ceph-mon[27902]: pgmap v7043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:05.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:05 smithi077 ceph-mon[27902]: osdmap e511: 12 total, 12 up, 12 in 2024-04-21T14:02:05.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13035.293389 secs 2024-04-21T14:02:05.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:05 smithi191 ceph-mon[31636]: pgmap v7043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:05.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:05 smithi191 ceph-mon[31636]: osdmap e511: 12 total, 12 up, 12 in 2024-04-21T14:02:07.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:07 smithi170 ceph-mon[31212]: pgmap v7045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:02:07.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:07 smithi077 ceph-mon[27902]: pgmap v7045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:02:07.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:07 smithi191 ceph-mon[31636]: pgmap v7045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:02:08.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13038.533070 secs 2024-04-21T14:02:08.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13038.533070 secs 2024-04-21T14:02:08.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13038.533070 secs 2024-04-21T14:02:09.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:09 smithi170 ceph-mon[31212]: pgmap v7046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:02:09.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:09 smithi077 ceph-mon[27902]: pgmap v7046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:02:09.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:09 smithi191 ceph-mon[31636]: pgmap v7046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:02:10.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:10.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13040.293468 secs 2024-04-21T14:02:10.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:10 smithi170 ceph-mon[31212]: osdmap e512: 12 total, 12 up, 12 in 2024-04-21T14:02:10.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13040.293468 secs 2024-04-21T14:02:10.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:10 smithi077 ceph-mon[27902]: osdmap e512: 12 total, 12 up, 12 in 2024-04-21T14:02:10.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13040.293468 secs 2024-04-21T14:02:10.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:10 smithi191 ceph-mon[31636]: osdmap e512: 12 total, 12 up, 12 in 2024-04-21T14:02:11.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:11 smithi170 ceph-mon[31212]: pgmap v7048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:02:11.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:11 smithi077 ceph-mon[27902]: pgmap v7048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:02:11.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:11 smithi191 ceph-mon[31636]: pgmap v7048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:02:13.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13043.533184 secs 2024-04-21T14:02:13.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:13 smithi170 ceph-mon[31212]: pgmap v7049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:02:13.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13043.533184 secs 2024-04-21T14:02:13.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:13 smithi077 ceph-mon[27902]: pgmap v7049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:02:13.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13043.533184 secs 2024-04-21T14:02:13.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:13 smithi191 ceph-mon[31636]: pgmap v7049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:02:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:15.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13045.293612 secs 2024-04-21T14:02:15.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:15 smithi077 ceph-mon[27902]: pgmap v7050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:02:15.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:02:15.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13045.293612 secs 2024-04-21T14:02:15.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:15 smithi191 ceph-mon[31636]: pgmap v7050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:02:15.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:02:15.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13045.293612 secs 2024-04-21T14:02:15.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:15 smithi170 ceph-mon[31212]: pgmap v7050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:02:15.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:02:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:02:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:02:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:02:16.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:02:16.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:02:16.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:02:16.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:02:16.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:02:16.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:02:17.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:17 smithi077 ceph-mon[27902]: pgmap v7051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:02:17.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:17 smithi191 ceph-mon[31636]: pgmap v7051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:02:17.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:17 smithi170 ceph-mon[31212]: pgmap v7051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:02:18.354 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13048.533297 secs 2024-04-21T14:02:18.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13048.533297 secs 2024-04-21T14:02:18.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13048.533297 secs 2024-04-21T14:02:19.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:19 smithi077 ceph-mon[27902]: pgmap v7052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:02:19.443 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:19 smithi170 ceph-mon[31212]: pgmap v7052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:02:19.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:19 smithi191 ceph-mon[31636]: pgmap v7052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:02:20.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:20.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13050.293702 secs 2024-04-21T14:02:20.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13050.293702 secs 2024-04-21T14:02:20.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13050.293702 secs 2024-04-21T14:02:21.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:21 smithi077 ceph-mon[27902]: pgmap v7053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:02:21.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:21 smithi191 ceph-mon[31636]: pgmap v7053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:02:21.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:21 smithi170 ceph-mon[31212]: pgmap v7053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:02:22.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:22 smithi077 ceph-mon[27902]: pgmap v7054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:02:22.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:22 smithi191 ceph-mon[31636]: pgmap v7054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:02:22.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:22 smithi170 ceph-mon[31212]: pgmap v7054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:02:23.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13053.533418 secs 2024-04-21T14:02:23.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13053.533418 secs 2024-04-21T14:02:23.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13053.533418 secs 2024-04-21T14:02:24.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:24 smithi077 ceph-mon[27902]: pgmap v7055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:24.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:24 smithi191 ceph-mon[31636]: pgmap v7055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:24.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:24 smithi170 ceph-mon[31212]: pgmap v7055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:25.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13055.293866 secs 2024-04-21T14:02:25.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13055.293866 secs 2024-04-21T14:02:25.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13055.293866 secs 2024-04-21T14:02:26.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:26 smithi077 ceph-mon[27902]: pgmap v7056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:26.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:26 smithi191 ceph-mon[31636]: pgmap v7056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:26.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:26 smithi170 ceph-mon[31212]: pgmap v7056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:27.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13058.533527 secs 2024-04-21T14:02:27.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13058.533527 secs 2024-04-21T14:02:27.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13058.533527 secs 2024-04-21T14:02:28.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:28 smithi191 ceph-mon[31636]: pgmap v7057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:28.771 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:28 smithi077 ceph-mon[27902]: pgmap v7057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:28.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:28 smithi170 ceph-mon[31212]: pgmap v7057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:29.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13060.293934 secs 2024-04-21T14:02:29.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13060.293934 secs 2024-04-21T14:02:29.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13060.293934 secs 2024-04-21T14:02:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:30.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:30 smithi191 ceph-mon[31636]: pgmap v7058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:30.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:30 smithi170 ceph-mon[31212]: pgmap v7058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:30.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:30 smithi077 ceph-mon[27902]: pgmap v7058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13063.533643 secs 2024-04-21T14:02:33.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:33 smithi170 ceph-mon[31212]: pgmap v7059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:33.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13063.533643 secs 2024-04-21T14:02:33.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:33 smithi077 ceph-mon[27902]: pgmap v7059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:33.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13063.533643 secs 2024-04-21T14:02:33.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:33 smithi191 ceph-mon[31636]: pgmap v7059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:35.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13065.294045 secs 2024-04-21T14:02:35.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:35 smithi170 ceph-mon[31212]: pgmap v7060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:35.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13065.294045 secs 2024-04-21T14:02:35.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:35 smithi077 ceph-mon[27902]: pgmap v7060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:35.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13065.294045 secs 2024-04-21T14:02:35.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:35 smithi191 ceph-mon[31636]: pgmap v7060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:37.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:37 smithi170 ceph-mon[31212]: pgmap v7061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:37.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:37 smithi077 ceph-mon[27902]: pgmap v7061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:37.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:37 smithi191 ceph-mon[31636]: pgmap v7061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:38.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13068.533756 secs 2024-04-21T14:02:38.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13068.533756 secs 2024-04-21T14:02:38.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13068.533756 secs 2024-04-21T14:02:39.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:39 smithi170 ceph-mon[31212]: pgmap v7062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:39.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:39 smithi077 ceph-mon[27902]: pgmap v7062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:39.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:39 smithi191 ceph-mon[31636]: pgmap v7062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:40.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:40.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13070.294186 secs 2024-04-21T14:02:40.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13070.294186 secs 2024-04-21T14:02:40.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13070.294186 secs 2024-04-21T14:02:41.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:41 smithi170 ceph-mon[31212]: pgmap v7063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:41.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:41 smithi077 ceph-mon[27902]: pgmap v7063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:41.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:41 smithi191 ceph-mon[31636]: pgmap v7063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:43.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13073.533865 secs 2024-04-21T14:02:43.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:43 smithi170 ceph-mon[31212]: pgmap v7064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:43.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13073.533865 secs 2024-04-21T14:02:43.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:43 smithi077 ceph-mon[27902]: pgmap v7064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:43.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13073.533865 secs 2024-04-21T14:02:43.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:43 smithi191 ceph-mon[31636]: pgmap v7064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:45.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13075.294317 secs 2024-04-21T14:02:45.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:45 smithi170 ceph-mon[31212]: pgmap v7065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:45.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13075.294317 secs 2024-04-21T14:02:45.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:45 smithi077 ceph-mon[27902]: pgmap v7065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:45.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13075.294317 secs 2024-04-21T14:02:45.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:45 smithi191 ceph-mon[31636]: pgmap v7065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:47.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:47 smithi170 ceph-mon[31212]: pgmap v7066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:47.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:47 smithi077 ceph-mon[27902]: pgmap v7066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:47.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:47 smithi191 ceph-mon[31636]: pgmap v7066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:48.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13078.533977 secs 2024-04-21T14:02:48.354 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13078.533977 secs 2024-04-21T14:02:48.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13078.533977 secs 2024-04-21T14:02:49.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:49 smithi170 ceph-mon[31212]: pgmap v7067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:49.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:49 smithi077 ceph-mon[27902]: pgmap v7067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:49.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:49 smithi191 ceph-mon[31636]: pgmap v7067: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:50.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:50.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13080.294437 secs 2024-04-21T14:02:50.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13080.294437 secs 2024-04-21T14:02:50.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13080.294437 secs 2024-04-21T14:02:51.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:51 smithi077 ceph-mon[27902]: pgmap v7068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:51.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:51 smithi191 ceph-mon[31636]: pgmap v7068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:51.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:51 smithi170 ceph-mon[31212]: pgmap v7068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:53.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13083.534106 secs 2024-04-21T14:02:53.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:53 smithi077 ceph-mon[27902]: pgmap v7069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:53.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13083.534106 secs 2024-04-21T14:02:53.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:53 smithi191 ceph-mon[31636]: pgmap v7069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:53.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13083.534106 secs 2024-04-21T14:02:53.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:53 smithi170 ceph-mon[31212]: pgmap v7069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:02:55.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13085.294508 secs 2024-04-21T14:02:55.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:55 smithi077 ceph-mon[27902]: pgmap v7070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:55.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13085.294508 secs 2024-04-21T14:02:55.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:55 smithi191 ceph-mon[31636]: pgmap v7070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:55.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13085.294508 secs 2024-04-21T14:02:55.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:55 smithi170 ceph-mon[31212]: pgmap v7070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:57.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:57 smithi077 ceph-mon[27902]: pgmap v7071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:57.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:57 smithi191 ceph-mon[31636]: pgmap v7071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:57.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:57 smithi170 ceph-mon[31212]: pgmap v7071: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:02:58.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13088.534219 secs 2024-04-21T14:02:58.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13088.534219 secs 2024-04-21T14:02:58.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13088.534219 secs 2024-04-21T14:02:59.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:02:59 smithi077 ceph-mon[27902]: pgmap v7072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:59.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:02:59 smithi191 ceph-mon[31636]: pgmap v7072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:02:59.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:02:59 smithi170 ceph-mon[31212]: pgmap v7072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:00.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13090.294639 secs 2024-04-21T14:03:00.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13090.294639 secs 2024-04-21T14:03:00.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13090.294639 secs 2024-04-21T14:03:01.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:01 smithi077 ceph-mon[27902]: pgmap v7073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:01.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:01 smithi191 ceph-mon[31636]: pgmap v7073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:01.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:01 smithi170 ceph-mon[31212]: pgmap v7073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:02.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:02 smithi077 ceph-mon[27902]: pgmap v7074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:02.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:02 smithi191 ceph-mon[31636]: pgmap v7074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:02.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:02 smithi170 ceph-mon[31212]: pgmap v7074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:03.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13093.534348 secs 2024-04-21T14:03:03.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13093.534348 secs 2024-04-21T14:03:03.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13093.534348 secs 2024-04-21T14:03:04.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:04 smithi077 ceph-mon[27902]: pgmap v7075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:04.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:04 smithi191 ceph-mon[31636]: pgmap v7075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:04.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:04 smithi170 ceph-mon[31212]: pgmap v7075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:05.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13095.294711 secs 2024-04-21T14:03:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:05 smithi077 ceph-mon[27902]: osdmap e513: 12 total, 12 up, 12 in 2024-04-21T14:03:05.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13095.294711 secs 2024-04-21T14:03:05.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:05 smithi191 ceph-mon[31636]: osdmap e513: 12 total, 12 up, 12 in 2024-04-21T14:03:05.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13095.294711 secs 2024-04-21T14:03:05.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:05 smithi170 ceph-mon[31212]: osdmap e513: 12 total, 12 up, 12 in 2024-04-21T14:03:06.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:06 smithi077 ceph-mon[27902]: pgmap v7077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:03:06.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:06 smithi191 ceph-mon[31636]: pgmap v7077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:03:06.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:06 smithi170 ceph-mon[31212]: pgmap v7077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:03:07.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13098.534463 secs 2024-04-21T14:03:07.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13098.534463 secs 2024-04-21T14:03:07.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13098.534463 secs 2024-04-21T14:03:08.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:08 smithi191 ceph-mon[31636]: pgmap v7078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:03:08.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:08 smithi170 ceph-mon[31212]: pgmap v7078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:03:08.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:08 smithi077 ceph-mon[27902]: pgmap v7078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:03:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:10.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13100.294775 secs 2024-04-21T14:03:10.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:10 smithi077 ceph-mon[27902]: osdmap e514: 12 total, 12 up, 12 in 2024-04-21T14:03:10.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13100.294775 secs 2024-04-21T14:03:10.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:10 smithi191 ceph-mon[31636]: osdmap e514: 12 total, 12 up, 12 in 2024-04-21T14:03:10.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13100.294775 secs 2024-04-21T14:03:10.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:10 smithi170 ceph-mon[31212]: osdmap e514: 12 total, 12 up, 12 in 2024-04-21T14:03:11.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:11 smithi077 ceph-mon[27902]: pgmap v7080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:03:11.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:11 smithi191 ceph-mon[31636]: pgmap v7080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:03:11.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:11 smithi170 ceph-mon[31212]: pgmap v7080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:03:13.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13103.534576 secs 2024-04-21T14:03:13.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:13 smithi077 ceph-mon[27902]: pgmap v7081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:03:13.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13103.534576 secs 2024-04-21T14:03:13.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:13 smithi191 ceph-mon[31636]: pgmap v7081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:03:13.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13103.534576 secs 2024-04-21T14:03:13.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:13 smithi170 ceph-mon[31212]: pgmap v7081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:03:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:15.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13105.294894 secs 2024-04-21T14:03:15.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:15 smithi077 ceph-mon[27902]: pgmap v7082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:03:15.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13105.294894 secs 2024-04-21T14:03:15.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:15 smithi191 ceph-mon[31636]: pgmap v7082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:03:15.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13105.294894 secs 2024-04-21T14:03:15.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:15 smithi170 ceph-mon[31212]: pgmap v7082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:03:16.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:03:16.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:03:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:03:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:03:16.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:03:16.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:03:16.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:03:16.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:03:16.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:03:16.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:03:16.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:03:16.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:03:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:17 smithi077 ceph-mon[27902]: pgmap v7083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:03:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:17 smithi191 ceph-mon[31636]: pgmap v7083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:03:17.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:17 smithi170 ceph-mon[31212]: pgmap v7083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:03:18.354 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13108.534724 secs 2024-04-21T14:03:18.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13108.534724 secs 2024-04-21T14:03:18.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13108.534724 secs 2024-04-21T14:03:19.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:19 smithi077 ceph-mon[27902]: pgmap v7084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:03:19.442 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:19 smithi170 ceph-mon[31212]: pgmap v7084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:03:19.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:19 smithi191 ceph-mon[31636]: pgmap v7084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:03:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:20.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13110.295010 secs 2024-04-21T14:03:20.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:20 smithi077 ceph-mon[27902]: pgmap v7085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:03:20.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13110.295010 secs 2024-04-21T14:03:20.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:20 smithi191 ceph-mon[31636]: pgmap v7085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:03:20.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13110.295010 secs 2024-04-21T14:03:20.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:20 smithi170 ceph-mon[31212]: pgmap v7085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:03:23.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13113.534843 secs 2024-04-21T14:03:23.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:23 smithi170 ceph-mon[31212]: pgmap v7086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:03:23.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13113.534843 secs 2024-04-21T14:03:23.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:23 smithi077 ceph-mon[27902]: pgmap v7086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:03:23.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13113.534843 secs 2024-04-21T14:03:23.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:23 smithi191 ceph-mon[31636]: pgmap v7086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:03:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:25.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13115.295125 secs 2024-04-21T14:03:25.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:25 smithi170 ceph-mon[31212]: pgmap v7087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:25.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13115.295125 secs 2024-04-21T14:03:25.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:25 smithi077 ceph-mon[27902]: pgmap v7087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:25.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13115.295125 secs 2024-04-21T14:03:25.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:25 smithi191 ceph-mon[31636]: pgmap v7087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:03:26.163+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:03:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:03:26.163+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:03:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:03:26.164+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:03:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:03:26.164+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:03:27.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:27 smithi170 ceph-mon[31212]: pgmap v7088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:27.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:27 smithi077 ceph-mon[27902]: pgmap v7088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:27.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:27 smithi191 ceph-mon[31636]: pgmap v7088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:28.270 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13118.534954 secs 2024-04-21T14:03:28.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13118.534954 secs 2024-04-21T14:03:28.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13118.534954 secs 2024-04-21T14:03:29.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:29 smithi170 ceph-mon[31212]: pgmap v7089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:29.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:29 smithi077 ceph-mon[27902]: pgmap v7089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:29.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:29 smithi191 ceph-mon[31636]: pgmap v7089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:30.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13120.295266 secs 2024-04-21T14:03:30.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13120.295266 secs 2024-04-21T14:03:30.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13120.295266 secs 2024-04-21T14:03:31.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:31 smithi170 ceph-mon[31212]: pgmap v7090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:31.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:31 smithi077 ceph-mon[27902]: pgmap v7090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:31.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:31 smithi191 ceph-mon[31636]: pgmap v7090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:33.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13123.535099 secs 2024-04-21T14:03:33.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:33 smithi170 ceph-mon[31212]: pgmap v7091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:33.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13123.535099 secs 2024-04-21T14:03:33.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:33 smithi077 ceph-mon[27902]: pgmap v7091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13123.535099 secs 2024-04-21T14:03:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:33 smithi191 ceph-mon[31636]: pgmap v7091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:35.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13125.295377 secs 2024-04-21T14:03:35.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:35 smithi170 ceph-mon[31212]: pgmap v7092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:35.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13125.295377 secs 2024-04-21T14:03:35.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:35 smithi077 ceph-mon[27902]: pgmap v7092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:35.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13125.295377 secs 2024-04-21T14:03:35.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:35 smithi191 ceph-mon[31636]: pgmap v7092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:37.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:37 smithi170 ceph-mon[31212]: pgmap v7093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:37.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:37 smithi077 ceph-mon[27902]: pgmap v7093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:37.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:37 smithi191 ceph-mon[31636]: pgmap v7093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:38.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13128.535210 secs 2024-04-21T14:03:38.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13128.535210 secs 2024-04-21T14:03:38.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13128.535210 secs 2024-04-21T14:03:39.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:39 smithi077 ceph-mon[27902]: pgmap v7094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:39.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:39 smithi191 ceph-mon[31636]: pgmap v7094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:39.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:39 smithi170 ceph-mon[31212]: pgmap v7094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:40.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:40.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13130.295501 secs 2024-04-21T14:03:40.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13130.295501 secs 2024-04-21T14:03:40.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13130.295501 secs 2024-04-21T14:03:41.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:41 smithi077 ceph-mon[27902]: pgmap v7095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:41.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:41 smithi191 ceph-mon[31636]: pgmap v7095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:41.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:41 smithi170 ceph-mon[31212]: pgmap v7095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:43.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13133.535290 secs 2024-04-21T14:03:43.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:43 smithi077 ceph-mon[27902]: pgmap v7096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:43.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13133.535290 secs 2024-04-21T14:03:43.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:43 smithi191 ceph-mon[31636]: pgmap v7096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:43.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13133.535290 secs 2024-04-21T14:03:43.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:43 smithi170 ceph-mon[31212]: pgmap v7096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:45.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13135.295611 secs 2024-04-21T14:03:45.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:45 smithi077 ceph-mon[27902]: pgmap v7097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:45.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13135.295611 secs 2024-04-21T14:03:45.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:45 smithi191 ceph-mon[31636]: pgmap v7097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:45.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13135.295611 secs 2024-04-21T14:03:45.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:45 smithi170 ceph-mon[31212]: pgmap v7097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:47.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:47 smithi077 ceph-mon[27902]: pgmap v7098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:47.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:47 smithi191 ceph-mon[31636]: pgmap v7098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:47.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:47 smithi170 ceph-mon[31212]: pgmap v7098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:48.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13138.535409 secs 2024-04-21T14:03:48.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13138.535409 secs 2024-04-21T14:03:48.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13138.535409 secs 2024-04-21T14:03:49.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:49 smithi077 ceph-mon[27902]: pgmap v7099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:49.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:49 smithi170 ceph-mon[31212]: pgmap v7099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:49.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:49 smithi191 ceph-mon[31636]: pgmap v7099: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:50.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:50.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13140.295742 secs 2024-04-21T14:03:50.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:50 smithi077 ceph-mon[27902]: pgmap v7100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:50.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13140.295742 secs 2024-04-21T14:03:50.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:50 smithi191 ceph-mon[31636]: pgmap v7100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:50.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13140.295742 secs 2024-04-21T14:03:50.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:50 smithi170 ceph-mon[31212]: pgmap v7100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:53.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13143.535522 secs 2024-04-21T14:03:53.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:53 smithi170 ceph-mon[31212]: pgmap v7101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:53.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13143.535522 secs 2024-04-21T14:03:53.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:53 smithi077 ceph-mon[27902]: pgmap v7101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:53.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13143.535522 secs 2024-04-21T14:03:53.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:53 smithi191 ceph-mon[31636]: pgmap v7101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:03:55.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13145.295832 secs 2024-04-21T14:03:55.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:55 smithi170 ceph-mon[31212]: pgmap v7102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:55.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13145.295832 secs 2024-04-21T14:03:55.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:55 smithi077 ceph-mon[27902]: pgmap v7102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:55.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13145.295832 secs 2024-04-21T14:03:55.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:55 smithi191 ceph-mon[31636]: pgmap v7102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:57.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:57 smithi170 ceph-mon[31212]: pgmap v7103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:57.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:57 smithi077 ceph-mon[27902]: pgmap v7103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:57.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:57 smithi191 ceph-mon[31636]: pgmap v7103: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:03:58.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13148.535627 secs 2024-04-21T14:03:58.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13148.535627 secs 2024-04-21T14:03:58.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13148.535627 secs 2024-04-21T14:03:59.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:03:59 smithi170 ceph-mon[31212]: pgmap v7104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:59.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:03:59 smithi077 ceph-mon[27902]: pgmap v7104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:03:59.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:03:59 smithi191 ceph-mon[31636]: pgmap v7104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:00.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13150.295947 secs 2024-04-21T14:04:00.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13150.295947 secs 2024-04-21T14:04:00.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13150.295947 secs 2024-04-21T14:04:01.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:01 smithi170 ceph-mon[31212]: pgmap v7105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:01.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:01 smithi077 ceph-mon[27902]: pgmap v7105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:01.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:01 smithi191 ceph-mon[31636]: pgmap v7105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:03.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13153.535745 secs 2024-04-21T14:04:03.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:03 smithi170 ceph-mon[31212]: pgmap v7106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:03.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13153.535745 secs 2024-04-21T14:04:03.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:03 smithi077 ceph-mon[27902]: pgmap v7106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:03.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13153.535745 secs 2024-04-21T14:04:03.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:03 smithi191 ceph-mon[31636]: pgmap v7106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13155.296065 secs 2024-04-21T14:04:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:05 smithi077 ceph-mon[27902]: pgmap v7107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:05 smithi077 ceph-mon[27902]: osdmap e515: 12 total, 12 up, 12 in 2024-04-21T14:04:05.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13155.296065 secs 2024-04-21T14:04:05.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:05 smithi191 ceph-mon[31636]: pgmap v7107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:05.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:05 smithi191 ceph-mon[31636]: osdmap e515: 12 total, 12 up, 12 in 2024-04-21T14:04:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13155.296065 secs 2024-04-21T14:04:05.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:05 smithi170 ceph-mon[31212]: pgmap v7107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:05.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:05 smithi170 ceph-mon[31212]: osdmap e515: 12 total, 12 up, 12 in 2024-04-21T14:04:07.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:07 smithi077 ceph-mon[27902]: pgmap v7109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:04:07.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:07 smithi191 ceph-mon[31636]: pgmap v7109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:04:07.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:07 smithi170 ceph-mon[31212]: pgmap v7109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:04:08.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13158.535800 secs 2024-04-21T14:04:08.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13158.535800 secs 2024-04-21T14:04:08.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13158.535800 secs 2024-04-21T14:04:09.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:09 smithi077 ceph-mon[27902]: pgmap v7110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:04:09.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:09 smithi191 ceph-mon[31636]: pgmap v7110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:04:09.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:09 smithi170 ceph-mon[31212]: pgmap v7110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:04:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:10.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13160.296172 secs 2024-04-21T14:04:10.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:10 smithi077 ceph-mon[27902]: osdmap e516: 12 total, 12 up, 12 in 2024-04-21T14:04:10.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13160.296172 secs 2024-04-21T14:04:10.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:10 smithi191 ceph-mon[31636]: osdmap e516: 12 total, 12 up, 12 in 2024-04-21T14:04:10.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13160.296172 secs 2024-04-21T14:04:10.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:10 smithi170 ceph-mon[31212]: osdmap e516: 12 total, 12 up, 12 in 2024-04-21T14:04:11.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:11 smithi077 ceph-mon[27902]: pgmap v7112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:04:11.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:11 smithi191 ceph-mon[31636]: pgmap v7112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:04:11.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:11 smithi170 ceph-mon[31212]: pgmap v7112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:04:13.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13163.535916 secs 2024-04-21T14:04:13.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:13 smithi077 ceph-mon[27902]: pgmap v7113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:04:13.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13163.535916 secs 2024-04-21T14:04:13.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:13 smithi191 ceph-mon[31636]: pgmap v7113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:04:13.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13163.535916 secs 2024-04-21T14:04:13.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:13 smithi170 ceph-mon[31212]: pgmap v7113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:04:14.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13165.296318 secs 2024-04-21T14:04:14.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:14 smithi191 ceph-mon[31636]: pgmap v7114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:04:14.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13165.296318 secs 2024-04-21T14:04:14.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:14 smithi170 ceph-mon[31212]: pgmap v7114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:04:14.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13165.296318 secs 2024-04-21T14:04:14.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:14 smithi077 ceph-mon[27902]: pgmap v7114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:04:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:17.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:17 smithi170 ceph-mon[31212]: pgmap v7115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:04:17.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:04:17.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:04:17.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:04:17.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:04:17.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:17 smithi077 ceph-mon[27902]: pgmap v7115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:04:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:04:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:04:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:04:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:04:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:17 smithi191 ceph-mon[31636]: pgmap v7115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:04:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:04:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:04:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:04:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:04:18.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13168.535985 secs 2024-04-21T14:04:18.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13168.535985 secs 2024-04-21T14:04:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13168.535985 secs 2024-04-21T14:04:19.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:19 smithi170 ceph-mon[31212]: pgmap v7116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:04:19.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:19 smithi077 ceph-mon[27902]: pgmap v7116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:04:19.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:19 smithi191 ceph-mon[31636]: pgmap v7116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:04:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:20.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13170.296388 secs 2024-04-21T14:04:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13170.296388 secs 2024-04-21T14:04:20.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13170.296388 secs 2024-04-21T14:04:21.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:21 smithi170 ceph-mon[31212]: pgmap v7117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:04:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:21 smithi077 ceph-mon[27902]: pgmap v7117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:04:21.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:21 smithi191 ceph-mon[31636]: pgmap v7117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:04:23.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13173.536102 secs 2024-04-21T14:04:23.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:23 smithi077 ceph-mon[27902]: pgmap v7118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:04:23.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13173.536102 secs 2024-04-21T14:04:23.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:23 smithi191 ceph-mon[31636]: pgmap v7118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:04:23.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13173.536102 secs 2024-04-21T14:04:23.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:23 smithi170 ceph-mon[31212]: pgmap v7118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:04:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:25.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13175.296510 secs 2024-04-21T14:04:25.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:25 smithi077 ceph-mon[27902]: pgmap v7119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:04:25.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13175.296510 secs 2024-04-21T14:04:25.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:25 smithi191 ceph-mon[31636]: pgmap v7119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:04:25.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13175.296510 secs 2024-04-21T14:04:25.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:25 smithi170 ceph-mon[31212]: pgmap v7119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:04:27.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:27 smithi077 ceph-mon[27902]: pgmap v7120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:27.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:27 smithi191 ceph-mon[31636]: pgmap v7120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:27.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:27 smithi170 ceph-mon[31212]: pgmap v7120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:28.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13178.536223 secs 2024-04-21T14:04:28.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13178.536223 secs 2024-04-21T14:04:28.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13178.536223 secs 2024-04-21T14:04:29.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:29 smithi077 ceph-mon[27902]: pgmap v7121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:29.500 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:29 smithi191 ceph-mon[31636]: pgmap v7121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:29.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:29 smithi170 ceph-mon[31212]: pgmap v7121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:30.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13180.296641 secs 2024-04-21T14:04:30.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13180.296641 secs 2024-04-21T14:04:30.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13180.296641 secs 2024-04-21T14:04:31.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:31 smithi077 ceph-mon[27902]: pgmap v7122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:31.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:31 smithi191 ceph-mon[31636]: pgmap v7122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:31.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:31 smithi170 ceph-mon[31212]: pgmap v7122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:33.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13183.536317 secs 2024-04-21T14:04:33.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:33 smithi077 ceph-mon[27902]: pgmap v7123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13183.536317 secs 2024-04-21T14:04:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:33 smithi191 ceph-mon[31636]: pgmap v7123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:33.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13183.536317 secs 2024-04-21T14:04:33.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:33 smithi170 ceph-mon[31212]: pgmap v7123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:35.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13185.296773 secs 2024-04-21T14:04:35.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:35 smithi077 ceph-mon[27902]: pgmap v7124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:35.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13185.296773 secs 2024-04-21T14:04:35.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:35 smithi191 ceph-mon[31636]: pgmap v7124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:35.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13185.296773 secs 2024-04-21T14:04:35.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:35 smithi170 ceph-mon[31212]: pgmap v7124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:37.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:37 smithi077 ceph-mon[27902]: pgmap v7125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:37.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:37 smithi191 ceph-mon[31636]: pgmap v7125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:37.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:37 smithi170 ceph-mon[31212]: pgmap v7125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:38.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13188.536432 secs 2024-04-21T14:04:38.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13188.536432 secs 2024-04-21T14:04:38.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13188.536432 secs 2024-04-21T14:04:39.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:39 smithi077 ceph-mon[27902]: pgmap v7126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:39.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:39 smithi191 ceph-mon[31636]: pgmap v7126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:39.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:39 smithi170 ceph-mon[31212]: pgmap v7126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:40.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:40.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13190.296891 secs 2024-04-21T14:04:40.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:40 smithi077 ceph-mon[27902]: pgmap v7127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:40.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13190.296891 secs 2024-04-21T14:04:40.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:40 smithi191 ceph-mon[31636]: pgmap v7127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:40.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13190.296891 secs 2024-04-21T14:04:40.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:40 smithi170 ceph-mon[31212]: pgmap v7127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:43.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13193.536541 secs 2024-04-21T14:04:43.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:43 smithi170 ceph-mon[31212]: pgmap v7128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:43.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13193.536541 secs 2024-04-21T14:04:43.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:43 smithi077 ceph-mon[27902]: pgmap v7128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:43.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13193.536541 secs 2024-04-21T14:04:43.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:43 smithi191 ceph-mon[31636]: pgmap v7128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:45.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13195.296989 secs 2024-04-21T14:04:45.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:45 smithi170 ceph-mon[31212]: pgmap v7129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:45.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13195.296989 secs 2024-04-21T14:04:45.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:45 smithi077 ceph-mon[27902]: pgmap v7129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:45.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13195.296989 secs 2024-04-21T14:04:45.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:45 smithi191 ceph-mon[31636]: pgmap v7129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:47.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:47 smithi170 ceph-mon[31212]: pgmap v7130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:47.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:47 smithi077 ceph-mon[27902]: pgmap v7130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:47.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:47 smithi191 ceph-mon[31636]: pgmap v7130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:48.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13198.536657 secs 2024-04-21T14:04:48.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13198.536657 secs 2024-04-21T14:04:48.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13198.536657 secs 2024-04-21T14:04:49.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:49 smithi077 ceph-mon[27902]: pgmap v7131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:49.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:49 smithi191 ceph-mon[31636]: pgmap v7131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:49.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:49 smithi170 ceph-mon[31212]: pgmap v7131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:50.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:50.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13200.297105 secs 2024-04-21T14:04:50.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13200.297105 secs 2024-04-21T14:04:50.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13200.297105 secs 2024-04-21T14:04:51.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:51 smithi077 ceph-mon[27902]: pgmap v7132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:51.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:51 smithi191 ceph-mon[31636]: pgmap v7132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:51.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:51 smithi170 ceph-mon[31212]: pgmap v7132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:53.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13203.536796 secs 2024-04-21T14:04:53.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:53 smithi077 ceph-mon[27902]: pgmap v7133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:53.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13203.536796 secs 2024-04-21T14:04:53.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:53 smithi191 ceph-mon[31636]: pgmap v7133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:53.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13203.536796 secs 2024-04-21T14:04:53.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:53 smithi170 ceph-mon[31212]: pgmap v7133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:55.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:04:55.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13205.297221 secs 2024-04-21T14:04:55.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:55 smithi077 ceph-mon[27902]: pgmap v7134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:55.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13205.297221 secs 2024-04-21T14:04:55.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:55 smithi191 ceph-mon[31636]: pgmap v7134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:55.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13205.297221 secs 2024-04-21T14:04:55.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:55 smithi170 ceph-mon[31212]: pgmap v7134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:04:56.177+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:04:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:04:56.177+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:04:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:04:56.177+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:04:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:04:56.177+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:04:57.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:57 smithi077 ceph-mon[27902]: pgmap v7135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:57.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:57 smithi191 ceph-mon[31636]: pgmap v7135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:57.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:57 smithi170 ceph-mon[31212]: pgmap v7135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:04:58.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13208.536885 secs 2024-04-21T14:04:58.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13208.536885 secs 2024-04-21T14:04:58.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13208.536885 secs 2024-04-21T14:04:59.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:04:59 smithi077 ceph-mon[27902]: pgmap v7136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:59.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:04:59 smithi191 ceph-mon[31636]: pgmap v7136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:04:59.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:04:59 smithi170 ceph-mon[31212]: pgmap v7136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:00.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13210.297334 secs 2024-04-21T14:05:00.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13210.297334 secs 2024-04-21T14:05:00.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13210.297334 secs 2024-04-21T14:05:01.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:01 smithi077 ceph-mon[27902]: pgmap v7137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:01.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:01 smithi191 ceph-mon[31636]: pgmap v7137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:01.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:01 smithi170 ceph-mon[31212]: pgmap v7137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:03.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13213.536967 secs 2024-04-21T14:05:03.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:03 smithi077 ceph-mon[27902]: pgmap v7138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:03.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13213.536967 secs 2024-04-21T14:05:03.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:03 smithi191 ceph-mon[31636]: pgmap v7138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:03.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13213.536967 secs 2024-04-21T14:05:03.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:03 smithi170 ceph-mon[31212]: pgmap v7138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:05.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13215.297470 secs 2024-04-21T14:05:05.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:05 smithi077 ceph-mon[27902]: pgmap v7139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:05.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:05 smithi077 ceph-mon[27902]: osdmap e517: 12 total, 12 up, 12 in 2024-04-21T14:05:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13215.297470 secs 2024-04-21T14:05:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:05 smithi191 ceph-mon[31636]: pgmap v7139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:05.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:05 smithi191 ceph-mon[31636]: osdmap e517: 12 total, 12 up, 12 in 2024-04-21T14:05:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13215.297470 secs 2024-04-21T14:05:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:05 smithi170 ceph-mon[31212]: pgmap v7139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:05 smithi170 ceph-mon[31212]: osdmap e517: 12 total, 12 up, 12 in 2024-04-21T14:05:06.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:06 smithi191 ceph-mon[31636]: pgmap v7141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:05:06.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:06 smithi170 ceph-mon[31212]: pgmap v7141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:05:06.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:06 smithi077 ceph-mon[27902]: pgmap v7141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:05:07.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13218.537103 secs 2024-04-21T14:05:07.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13218.537103 secs 2024-04-21T14:05:07.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13218.537103 secs 2024-04-21T14:05:08.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:08 smithi191 ceph-mon[31636]: pgmap v7142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:05:08.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:08 smithi170 ceph-mon[31212]: pgmap v7142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:05:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:08 smithi077 ceph-mon[27902]: pgmap v7142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:05:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:10.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13220.297602 secs 2024-04-21T14:05:10.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:10 smithi077 ceph-mon[27902]: osdmap e518: 12 total, 12 up, 12 in 2024-04-21T14:05:10.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13220.297602 secs 2024-04-21T14:05:10.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:10 smithi191 ceph-mon[31636]: osdmap e518: 12 total, 12 up, 12 in 2024-04-21T14:05:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13220.297602 secs 2024-04-21T14:05:10.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:10 smithi170 ceph-mon[31212]: osdmap e518: 12 total, 12 up, 12 in 2024-04-21T14:05:11.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:11 smithi077 ceph-mon[27902]: pgmap v7144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:05:11.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:11 smithi191 ceph-mon[31636]: pgmap v7144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:05:11.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:11 smithi170 ceph-mon[31212]: pgmap v7144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:05:13.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13223.537219 secs 2024-04-21T14:05:13.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:13 smithi077 ceph-mon[27902]: pgmap v7145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:05:13.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13223.537219 secs 2024-04-21T14:05:13.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:13 smithi191 ceph-mon[31636]: pgmap v7145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:05:13.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13223.537219 secs 2024-04-21T14:05:13.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:13 smithi170 ceph-mon[31212]: pgmap v7145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:05:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:15.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13225.297733 secs 2024-04-21T14:05:15.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:15 smithi077 ceph-mon[27902]: pgmap v7146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:05:15.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13225.297733 secs 2024-04-21T14:05:15.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:15 smithi191 ceph-mon[31636]: pgmap v7146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:05:15.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13225.297733 secs 2024-04-21T14:05:15.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:15 smithi170 ceph-mon[31212]: pgmap v7146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:05:16.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:16 smithi077 ceph-mon[27902]: pgmap v7147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:05:16.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:16 smithi191 ceph-mon[31636]: pgmap v7147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:05:16.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:16 smithi170 ceph-mon[31212]: pgmap v7147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:05:17.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:05:17.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:05:17.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:05:18.352 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13228.537311 secs 2024-04-21T14:05:18.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:05:18.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:05:18.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:05:18.353 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:18 smithi191 ceph-mon[31636]: pgmap v7148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:05:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13228.537311 secs 2024-04-21T14:05:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:05:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:05:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:05:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:18 smithi077 ceph-mon[27902]: pgmap v7148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:05:18.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13228.537311 secs 2024-04-21T14:05:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:05:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:05:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:05:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:18 smithi170 ceph-mon[31212]: pgmap v7148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:05:19.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13230.297837 secs 2024-04-21T14:05:19.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13230.297837 secs 2024-04-21T14:05:20.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13230.297837 secs 2024-04-21T14:05:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:20 smithi077 ceph-mon[27902]: pgmap v7149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:05:20.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:20 smithi191 ceph-mon[31636]: pgmap v7149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:05:21.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:20 smithi170 ceph-mon[31212]: pgmap v7149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:05:23.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13233.537451 secs 2024-04-21T14:05:23.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:23 smithi077 ceph-mon[27902]: pgmap v7150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:05:23.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13233.537451 secs 2024-04-21T14:05:23.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:23 smithi191 ceph-mon[31636]: pgmap v7150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:05:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13233.537451 secs 2024-04-21T14:05:23.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:23 smithi170 ceph-mon[31212]: pgmap v7150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:05:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:25.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13235.297948 secs 2024-04-21T14:05:25.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:25 smithi077 ceph-mon[27902]: pgmap v7151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:25.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13235.297948 secs 2024-04-21T14:05:25.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:25 smithi191 ceph-mon[31636]: pgmap v7151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:25.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13235.297948 secs 2024-04-21T14:05:25.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:25 smithi170 ceph-mon[31212]: pgmap v7151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:27.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:27 smithi077 ceph-mon[27902]: pgmap v7152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:27.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:27 smithi191 ceph-mon[31636]: pgmap v7152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:27.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:27 smithi170 ceph-mon[31212]: pgmap v7152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:28.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13238.537562 secs 2024-04-21T14:05:28.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13238.537562 secs 2024-04-21T14:05:28.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13238.537562 secs 2024-04-21T14:05:29.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:29 smithi077 ceph-mon[27902]: pgmap v7153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:29.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:29 smithi191 ceph-mon[31636]: pgmap v7153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:29.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:29 smithi170 ceph-mon[31212]: pgmap v7153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:30.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13240.298062 secs 2024-04-21T14:05:30.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13240.298062 secs 2024-04-21T14:05:30.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13240.298062 secs 2024-04-21T14:05:31.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:31 smithi077 ceph-mon[27902]: pgmap v7154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:31.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:31 smithi191 ceph-mon[31636]: pgmap v7154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:31.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:31 smithi170 ceph-mon[31212]: pgmap v7154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:33.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13243.537625 secs 2024-04-21T14:05:33.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:33 smithi077 ceph-mon[27902]: pgmap v7155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13243.537625 secs 2024-04-21T14:05:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:33 smithi191 ceph-mon[31636]: pgmap v7155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:33.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13243.537625 secs 2024-04-21T14:05:33.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:33 smithi170 ceph-mon[31212]: pgmap v7155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:35.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13245.298125 secs 2024-04-21T14:05:35.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:35 smithi077 ceph-mon[27902]: pgmap v7156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:35.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13245.298125 secs 2024-04-21T14:05:35.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:35 smithi191 ceph-mon[31636]: pgmap v7156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:35.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13245.298125 secs 2024-04-21T14:05:35.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:35 smithi170 ceph-mon[31212]: pgmap v7156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:37.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:37 smithi077 ceph-mon[27902]: pgmap v7157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:37.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:37 smithi191 ceph-mon[31636]: pgmap v7157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:37.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:37 smithi170 ceph-mon[31212]: pgmap v7157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:38.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13248.537756 secs 2024-04-21T14:05:38.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13248.537756 secs 2024-04-21T14:05:38.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13248.537756 secs 2024-04-21T14:05:39.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:39 smithi077 ceph-mon[27902]: pgmap v7158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:39.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:39 smithi191 ceph-mon[31636]: pgmap v7158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:39.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:39 smithi170 ceph-mon[31212]: pgmap v7158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:40.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13250.298202 secs 2024-04-21T14:05:40.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13250.298202 secs 2024-04-21T14:05:40.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13250.298202 secs 2024-04-21T14:05:41.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:41 smithi077 ceph-mon[27902]: pgmap v7159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:41.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:41 smithi191 ceph-mon[31636]: pgmap v7159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:41.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:41 smithi170 ceph-mon[31212]: pgmap v7159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:42.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:42 smithi077 ceph-mon[27902]: pgmap v7160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:42.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:42 smithi191 ceph-mon[31636]: pgmap v7160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:42.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:42 smithi170 ceph-mon[31212]: pgmap v7160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:43.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13253.537878 secs 2024-04-21T14:05:43.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13253.537878 secs 2024-04-21T14:05:43.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13253.537878 secs 2024-04-21T14:05:44.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:44 smithi077 ceph-mon[27902]: pgmap v7161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:44.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:44 smithi191 ceph-mon[31636]: pgmap v7161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:44.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:44 smithi170 ceph-mon[31212]: pgmap v7161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:45.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13255.298303 secs 2024-04-21T14:05:45.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13255.298303 secs 2024-04-21T14:05:45.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13255.298303 secs 2024-04-21T14:05:46.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:46 smithi077 ceph-mon[27902]: pgmap v7162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:46.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:46 smithi191 ceph-mon[31636]: pgmap v7162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:46.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:46 smithi170 ceph-mon[31212]: pgmap v7162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:47.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13258.537998 secs 2024-04-21T14:05:47.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13258.537998 secs 2024-04-21T14:05:47.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13258.537998 secs 2024-04-21T14:05:48.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:48 smithi191 ceph-mon[31636]: pgmap v7163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:48.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:48 smithi170 ceph-mon[31212]: pgmap v7163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:48.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:48 smithi077 ceph-mon[27902]: pgmap v7163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:49.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13260.298433 secs 2024-04-21T14:05:49.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13260.298433 secs 2024-04-21T14:05:49.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13260.298433 secs 2024-04-21T14:05:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:50.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:50 smithi191 ceph-mon[31636]: pgmap v7164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:50.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:50 smithi170 ceph-mon[31212]: pgmap v7164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:50.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:50 smithi077 ceph-mon[27902]: pgmap v7164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:53.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13263.538112 secs 2024-04-21T14:05:53.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:53 smithi077 ceph-mon[27902]: pgmap v7165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:53.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13263.538112 secs 2024-04-21T14:05:53.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:53 smithi191 ceph-mon[31636]: pgmap v7165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:53.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13263.538112 secs 2024-04-21T14:05:53.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:53 smithi170 ceph-mon[31212]: pgmap v7165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:55.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:05:55.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13265.298497 secs 2024-04-21T14:05:55.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:55 smithi077 ceph-mon[27902]: pgmap v7166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:55.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13265.298497 secs 2024-04-21T14:05:55.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:55 smithi191 ceph-mon[31636]: pgmap v7166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:55.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13265.298497 secs 2024-04-21T14:05:55.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:55 smithi170 ceph-mon[31212]: pgmap v7166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:57.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:57 smithi077 ceph-mon[27902]: pgmap v7167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:57.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:57 smithi191 ceph-mon[31636]: pgmap v7167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:57.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:57 smithi170 ceph-mon[31212]: pgmap v7167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:05:58.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13268.538224 secs 2024-04-21T14:05:58.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13268.538224 secs 2024-04-21T14:05:58.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13268.538224 secs 2024-04-21T14:05:59.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:05:59 smithi077 ceph-mon[27902]: pgmap v7168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:59.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:05:59 smithi191 ceph-mon[31636]: pgmap v7168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:05:59.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:05:59 smithi170 ceph-mon[31212]: pgmap v7168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:00.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13270.298622 secs 2024-04-21T14:06:00.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13270.298622 secs 2024-04-21T14:06:00.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13270.298622 secs 2024-04-21T14:06:01.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:01 smithi077 ceph-mon[27902]: pgmap v7169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:01.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:01 smithi191 ceph-mon[31636]: pgmap v7169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:01.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:01 smithi170 ceph-mon[31212]: pgmap v7169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:03.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13273.538287 secs 2024-04-21T14:06:03.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:03 smithi077 ceph-mon[27902]: pgmap v7170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:03.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13273.538287 secs 2024-04-21T14:06:03.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:03 smithi191 ceph-mon[31636]: pgmap v7170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:03.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13273.538287 secs 2024-04-21T14:06:03.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:03 smithi170 ceph-mon[31212]: pgmap v7170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:05.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13275.298760 secs 2024-04-21T14:06:05.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:05 smithi077 ceph-mon[27902]: pgmap v7171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:05.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:05 smithi077 ceph-mon[27902]: osdmap e519: 12 total, 12 up, 12 in 2024-04-21T14:06:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13275.298760 secs 2024-04-21T14:06:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:05 smithi191 ceph-mon[31636]: pgmap v7171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:05 smithi191 ceph-mon[31636]: osdmap e519: 12 total, 12 up, 12 in 2024-04-21T14:06:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13275.298760 secs 2024-04-21T14:06:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:05 smithi170 ceph-mon[31212]: pgmap v7171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:05 smithi170 ceph-mon[31212]: osdmap e519: 12 total, 12 up, 12 in 2024-04-21T14:06:07.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:07 smithi077 ceph-mon[27902]: pgmap v7173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:06:07.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:07 smithi191 ceph-mon[31636]: pgmap v7173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:06:07.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:07 smithi170 ceph-mon[31212]: pgmap v7173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:06:08.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13278.538394 secs 2024-04-21T14:06:08.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13278.538394 secs 2024-04-21T14:06:08.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13278.538394 secs 2024-04-21T14:06:09.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:09 smithi077 ceph-mon[27902]: pgmap v7174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:06:09.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:09 smithi077 ceph-mon[27902]: osdmap e520: 12 total, 12 up, 12 in 2024-04-21T14:06:09.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:09 smithi191 ceph-mon[31636]: pgmap v7174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:06:09.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:09 smithi191 ceph-mon[31636]: osdmap e520: 12 total, 12 up, 12 in 2024-04-21T14:06:09.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:09 smithi170 ceph-mon[31212]: pgmap v7174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:06:09.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:09 smithi170 ceph-mon[31212]: osdmap e520: 12 total, 12 up, 12 in 2024-04-21T14:06:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:10.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13280.298881 secs 2024-04-21T14:06:10.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:10 smithi077 ceph-mon[27902]: pgmap v7176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:06:10.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13280.298881 secs 2024-04-21T14:06:10.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:10 smithi191 ceph-mon[31636]: pgmap v7176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:06:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13280.298881 secs 2024-04-21T14:06:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:10 smithi170 ceph-mon[31212]: pgmap v7176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:06:13.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13283.538509 secs 2024-04-21T14:06:13.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:13 smithi077 ceph-mon[27902]: pgmap v7177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:06:13.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13283.538509 secs 2024-04-21T14:06:13.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:13 smithi191 ceph-mon[31636]: pgmap v7177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:06:13.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13283.538509 secs 2024-04-21T14:06:13.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:13 smithi170 ceph-mon[31212]: pgmap v7177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:06:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:15.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13285.299002 secs 2024-04-21T14:06:15.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:15 smithi077 ceph-mon[27902]: pgmap v7178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:06:15.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13285.299002 secs 2024-04-21T14:06:15.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:15 smithi191 ceph-mon[31636]: pgmap v7178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:06:15.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13285.299002 secs 2024-04-21T14:06:15.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:15 smithi170 ceph-mon[31212]: pgmap v7178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:06:17.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:17 smithi077 ceph-mon[27902]: pgmap v7179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:06:17.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:17 smithi191 ceph-mon[31636]: pgmap v7179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:06:17.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:17 smithi170 ceph-mon[31212]: pgmap v7179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:06:18.352 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13288.538641 secs 2024-04-21T14:06:18.352 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:06:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13288.538641 secs 2024-04-21T14:06:18.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:06:18.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13288.538641 secs 2024-04-21T14:06:18.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:06:19.088 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:19 smithi170 ceph-mon[31212]: pgmap v7180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:06:19.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:19 smithi077 ceph-mon[27902]: pgmap v7180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:06:19.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:19 smithi191 ceph-mon[31636]: pgmap v7180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:06:20.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:20.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13290.299115 secs 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13290.299115 secs 2024-04-21T14:06:20.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.441 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13290.299115 secs 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:20.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: pgmap v7181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:06:21.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:06:21.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: pgmap v7181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:06:21.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:06:21.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:21.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: pgmap v7181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:06:21.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:06:22.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:06:22.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:06:22.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:22 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:06:22.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:22 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:06:22.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:06:22.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:06:22.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:22 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:06:22.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:22 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:06:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:06:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:06:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:22 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:06:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:22 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:06:23.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13293.538757 secs 2024-04-21T14:06:23.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:23 smithi077 ceph-mon[27902]: pgmap v7182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:06:23.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13293.538757 secs 2024-04-21T14:06:23.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:23 smithi191 ceph-mon[31636]: pgmap v7182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:06:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13293.538757 secs 2024-04-21T14:06:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:23 smithi170 ceph-mon[31212]: pgmap v7182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:06:24.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:24 smithi077 ceph-mon[27902]: pgmap v7183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:24 smithi191 ceph-mon[31636]: pgmap v7183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:24.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:24 smithi170 ceph-mon[31212]: pgmap v7183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:25.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13295.299259 secs 2024-04-21T14:06:25.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13295.299259 secs 2024-04-21T14:06:25.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13295.299259 secs 2024-04-21T14:06:26.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:26 smithi077 ceph-mon[27902]: pgmap v7184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:26.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:26 smithi191 ceph-mon[31636]: pgmap v7184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:26.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:26 smithi170 ceph-mon[31212]: pgmap v7184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:27.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13298.538870 secs 2024-04-21T14:06:27.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13298.538870 secs 2024-04-21T14:06:27.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13298.538870 secs 2024-04-21T14:06:28.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:28 smithi191 ceph-mon[31636]: pgmap v7185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:28.769 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:28 smithi077 ceph-mon[27902]: pgmap v7185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:28.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:28 smithi170 ceph-mon[31212]: pgmap v7185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:30.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13300.299320 secs 2024-04-21T14:06:30.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13300.299320 secs 2024-04-21T14:06:30.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13300.299320 secs 2024-04-21T14:06:31.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:31 smithi077 ceph-mon[27902]: pgmap v7186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:31.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:31 smithi191 ceph-mon[31636]: pgmap v7186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:31.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:31 smithi170 ceph-mon[31212]: pgmap v7186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:32.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:32 smithi077 ceph-mon[27902]: pgmap v7187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:32.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:32 smithi191 ceph-mon[31636]: pgmap v7187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:32.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:32 smithi170 ceph-mon[31212]: pgmap v7187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:33.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13303.538986 secs 2024-04-21T14:06:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13303.538986 secs 2024-04-21T14:06:34.469 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:34 smithi077 ceph-mon[27902]: pgmap v7188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:34.469 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13303.538986 secs 2024-04-21T14:06:34.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:34 smithi191 ceph-mon[31636]: pgmap v7188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:34.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:34 smithi170 ceph-mon[31212]: pgmap v7188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:35.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13305.299463 secs 2024-04-21T14:06:35.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13305.299463 secs 2024-04-21T14:06:35.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13305.299463 secs 2024-04-21T14:06:36.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:36 smithi077 ceph-mon[27902]: pgmap v7189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:36.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:36 smithi191 ceph-mon[31636]: pgmap v7189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:36.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:36 smithi170 ceph-mon[31212]: pgmap v7189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:37.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13308.539114 secs 2024-04-21T14:06:37.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13308.539114 secs 2024-04-21T14:06:37.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13308.539114 secs 2024-04-21T14:06:38.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:38 smithi191 ceph-mon[31636]: pgmap v7190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:38.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:38 smithi170 ceph-mon[31212]: pgmap v7190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:38.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:38 smithi077 ceph-mon[27902]: pgmap v7190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:39.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13310.299581 secs 2024-04-21T14:06:39.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13310.299581 secs 2024-04-21T14:06:39.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13310.299581 secs 2024-04-21T14:06:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:40.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:40 smithi170 ceph-mon[31212]: pgmap v7191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:40.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:40 smithi077 ceph-mon[27902]: pgmap v7191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:40.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:40 smithi191 ceph-mon[31636]: pgmap v7191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:43.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13313.539249 secs 2024-04-21T14:06:43.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:43 smithi077 ceph-mon[27902]: pgmap v7192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:43.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13313.539249 secs 2024-04-21T14:06:43.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:43 smithi191 ceph-mon[31636]: pgmap v7192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:43.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13313.539249 secs 2024-04-21T14:06:43.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:43 smithi170 ceph-mon[31212]: pgmap v7192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:45.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13315.299722 secs 2024-04-21T14:06:45.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:45 smithi077 ceph-mon[27902]: pgmap v7193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:45.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13315.299722 secs 2024-04-21T14:06:45.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:45 smithi191 ceph-mon[31636]: pgmap v7193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:45.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13315.299722 secs 2024-04-21T14:06:45.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:45 smithi170 ceph-mon[31212]: pgmap v7193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:47.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:47 smithi077 ceph-mon[27902]: pgmap v7194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:47.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:47 smithi191 ceph-mon[31636]: pgmap v7194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:47.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:47 smithi170 ceph-mon[31212]: pgmap v7194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:48.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13318.539360 secs 2024-04-21T14:06:48.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13318.539360 secs 2024-04-21T14:06:48.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13318.539360 secs 2024-04-21T14:06:49.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:49 smithi077 ceph-mon[27902]: pgmap v7195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:49.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:49 smithi191 ceph-mon[31636]: pgmap v7195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:49.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:49 smithi170 ceph-mon[31212]: pgmap v7195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:50.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:50.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13320.299796 secs 2024-04-21T14:06:50.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13320.299796 secs 2024-04-21T14:06:50.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13320.299796 secs 2024-04-21T14:06:51.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:51 smithi077 ceph-mon[27902]: pgmap v7196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:51.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:51 smithi191 ceph-mon[31636]: pgmap v7196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:51.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:51 smithi170 ceph-mon[31212]: pgmap v7196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:53.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13323.539494 secs 2024-04-21T14:06:53.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:53 smithi077 ceph-mon[27902]: pgmap v7197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:53.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13323.539494 secs 2024-04-21T14:06:53.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:53 smithi191 ceph-mon[31636]: pgmap v7197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:53.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13323.539494 secs 2024-04-21T14:06:53.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:53 smithi170 ceph-mon[31212]: pgmap v7197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:55.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:06:55.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13325.299910 secs 2024-04-21T14:06:55.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:55 smithi077 ceph-mon[27902]: pgmap v7198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:55.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13325.299910 secs 2024-04-21T14:06:55.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:55 smithi191 ceph-mon[31636]: pgmap v7198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:55.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13325.299910 secs 2024-04-21T14:06:55.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:55 smithi170 ceph-mon[31212]: pgmap v7198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:57.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:57 smithi077 ceph-mon[27902]: pgmap v7199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:57.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:57 smithi191 ceph-mon[31636]: pgmap v7199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:57.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:57 smithi170 ceph-mon[31212]: pgmap v7199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:06:58.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13328.539624 secs 2024-04-21T14:06:58.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13328.539624 secs 2024-04-21T14:06:58.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13328.539624 secs 2024-04-21T14:06:59.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:06:59 smithi077 ceph-mon[27902]: pgmap v7200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:59.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:06:59 smithi191 ceph-mon[31636]: pgmap v7200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:06:59.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:06:59 smithi170 ceph-mon[31212]: pgmap v7200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:00.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13330.300017 secs 2024-04-21T14:07:00.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:00 smithi077 ceph-mon[27902]: pgmap v7201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:00.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13330.300017 secs 2024-04-21T14:07:00.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:00 smithi191 ceph-mon[31636]: pgmap v7201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:00.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13330.300017 secs 2024-04-21T14:07:00.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:00 smithi170 ceph-mon[31212]: pgmap v7201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:03.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13333.539740 secs 2024-04-21T14:07:03.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:03 smithi077 ceph-mon[27902]: pgmap v7202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T14:07:03.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13333.539740 secs 2024-04-21T14:07:03.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:03 smithi191 ceph-mon[31636]: pgmap v7202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T14:07:03.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13333.539740 secs 2024-04-21T14:07:03.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:03 smithi170 ceph-mon[31212]: pgmap v7202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T14:07:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13335.300110 secs 2024-04-21T14:07:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:05 smithi077 ceph-mon[27902]: pgmap v7203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T14:07:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:05 smithi077 ceph-mon[27902]: osdmap e521: 12 total, 12 up, 12 in 2024-04-21T14:07:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13335.300110 secs 2024-04-21T14:07:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:05 smithi191 ceph-mon[31636]: pgmap v7203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T14:07:05.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:05 smithi191 ceph-mon[31636]: osdmap e521: 12 total, 12 up, 12 in 2024-04-21T14:07:05.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13335.300110 secs 2024-04-21T14:07:05.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:05 smithi170 ceph-mon[31212]: pgmap v7203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T14:07:05.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:05 smithi170 ceph-mon[31212]: osdmap e521: 12 total, 12 up, 12 in 2024-04-21T14:07:07.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:07 smithi077 ceph-mon[27902]: pgmap v7205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:07:07.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:07 smithi191 ceph-mon[31636]: pgmap v7205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:07:07.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:07 smithi170 ceph-mon[31212]: pgmap v7205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:07:08.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13338.539871 secs 2024-04-21T14:07:08.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13338.539871 secs 2024-04-21T14:07:08.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13338.539871 secs 2024-04-21T14:07:09.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:09 smithi077 ceph-mon[27902]: pgmap v7206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:07:09.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:09 smithi191 ceph-mon[31636]: pgmap v7206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:07:09.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:09 smithi170 ceph-mon[31212]: pgmap v7206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:07:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13340.300175 secs 2024-04-21T14:07:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:10 smithi077 ceph-mon[27902]: osdmap e522: 12 total, 12 up, 12 in 2024-04-21T14:07:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13340.300175 secs 2024-04-21T14:07:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:10 smithi191 ceph-mon[31636]: osdmap e522: 12 total, 12 up, 12 in 2024-04-21T14:07:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13340.300175 secs 2024-04-21T14:07:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:10 smithi170 ceph-mon[31212]: osdmap e522: 12 total, 12 up, 12 in 2024-04-21T14:07:11.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:11 smithi077 ceph-mon[27902]: pgmap v7208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T14:07:11.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:11 smithi191 ceph-mon[31636]: pgmap v7208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T14:07:11.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:11 smithi170 ceph-mon[31212]: pgmap v7208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T14:07:12.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:12 smithi077 ceph-mon[27902]: pgmap v7209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T14:07:12.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:12 smithi191 ceph-mon[31636]: pgmap v7209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T14:07:12.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:12 smithi170 ceph-mon[31212]: pgmap v7209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T14:07:13.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13343.539987 secs 2024-04-21T14:07:13.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13343.539987 secs 2024-04-21T14:07:13.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13343.539987 secs 2024-04-21T14:07:14.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:14 smithi077 ceph-mon[27902]: pgmap v7210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T14:07:14.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:14 smithi191 ceph-mon[31636]: pgmap v7210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T14:07:14.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:14 smithi170 ceph-mon[31212]: pgmap v7210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T14:07:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:15.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13345.300288 secs 2024-04-21T14:07:15.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13345.300288 secs 2024-04-21T14:07:15.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13345.300288 secs 2024-04-21T14:07:16.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:16 smithi191 ceph-mon[31636]: pgmap v7211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:07:16.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:16 smithi170 ceph-mon[31212]: pgmap v7211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:07:16.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:16 smithi077 ceph-mon[27902]: pgmap v7211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:07:17.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13348.540049 secs 2024-04-21T14:07:17.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13348.540049 secs 2024-04-21T14:07:17.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13348.540049 secs 2024-04-21T14:07:18.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:18 smithi170 ceph-mon[31212]: pgmap v7212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:07:18.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:18 smithi077 ceph-mon[27902]: pgmap v7212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:07:18.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:18 smithi191 ceph-mon[31636]: pgmap v7212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:07:20.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:20.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13350.300401 secs 2024-04-21T14:07:20.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:20 smithi077 ceph-mon[27902]: pgmap v7213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:07:20.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13350.300401 secs 2024-04-21T14:07:20.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:20 smithi191 ceph-mon[31636]: pgmap v7213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:07:20.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13350.300401 secs 2024-04-21T14:07:20.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:20 smithi170 ceph-mon[31212]: pgmap v7213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:07:21.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:07:21.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:21.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:21.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:07:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:21.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:21.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:07:21.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:21.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:22.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:07:22.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:07:22.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:22.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:22 smithi077 ceph-mon[27902]: pgmap v7214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:07:22.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:07:22.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:07:22.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:22.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:22 smithi191 ceph-mon[31636]: pgmap v7214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:07:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:07:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:07:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:07:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:22 smithi170 ceph-mon[31212]: pgmap v7214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:07:23.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13353.540190 secs 2024-04-21T14:07:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13353.540190 secs 2024-04-21T14:07:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13353.540190 secs 2024-04-21T14:07:24.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:24 smithi077 ceph-mon[27902]: pgmap v7215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:24 smithi191 ceph-mon[31636]: pgmap v7215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:24.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:24 smithi170 ceph-mon[31212]: pgmap v7215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:25.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13355.300545 secs 2024-04-21T14:07:25.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13355.300545 secs 2024-04-21T14:07:25.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13355.300545 secs 2024-04-21T14:07:26.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:26 smithi191 ceph-mon[31636]: pgmap v7216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:26.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:26 smithi170 ceph-mon[31212]: pgmap v7216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:26.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:26 smithi077 ceph-mon[27902]: pgmap v7216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:27.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13358.540282 secs 2024-04-21T14:07:27.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13358.540282 secs 2024-04-21T14:07:27.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13358.540282 secs 2024-04-21T14:07:28.768 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:28 smithi077 ceph-mon[27902]: pgmap v7217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:28.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:28 smithi170 ceph-mon[31212]: pgmap v7217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:28.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:28 smithi191 ceph-mon[31636]: pgmap v7217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:29.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13360.300639 secs 2024-04-21T14:07:29.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13360.300639 secs 2024-04-21T14:07:29.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13360.300639 secs 2024-04-21T14:07:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:30.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:30 smithi170 ceph-mon[31212]: pgmap v7218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:30.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:30 smithi077 ceph-mon[27902]: pgmap v7218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:30.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:30 smithi191 ceph-mon[31636]: pgmap v7218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:33.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13363.540419 secs 2024-04-21T14:07:33.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:33 smithi077 ceph-mon[27902]: pgmap v7219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13363.540419 secs 2024-04-21T14:07:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:33 smithi191 ceph-mon[31636]: pgmap v7219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:33.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13363.540419 secs 2024-04-21T14:07:33.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:33 smithi170 ceph-mon[31212]: pgmap v7219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:35.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13365.300752 secs 2024-04-21T14:07:35.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:35 smithi077 ceph-mon[27902]: pgmap v7220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:35.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13365.300752 secs 2024-04-21T14:07:35.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:35 smithi191 ceph-mon[31636]: pgmap v7220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:35.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13365.300752 secs 2024-04-21T14:07:35.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:35 smithi170 ceph-mon[31212]: pgmap v7220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:37.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:37 smithi077 ceph-mon[27902]: pgmap v7221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:37.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:37 smithi191 ceph-mon[31636]: pgmap v7221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:37.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:37 smithi170 ceph-mon[31212]: pgmap v7221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:38.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13368.540533 secs 2024-04-21T14:07:38.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13368.540533 secs 2024-04-21T14:07:38.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13368.540533 secs 2024-04-21T14:07:39.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:39 smithi077 ceph-mon[27902]: pgmap v7222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:39.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:39 smithi191 ceph-mon[31636]: pgmap v7222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:39.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:39 smithi170 ceph-mon[31212]: pgmap v7222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:40.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:40.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13370.300885 secs 2024-04-21T14:07:40.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13370.300885 secs 2024-04-21T14:07:40.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13370.300885 secs 2024-04-21T14:07:41.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:41 smithi077 ceph-mon[27902]: pgmap v7223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:41.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:41 smithi191 ceph-mon[31636]: pgmap v7223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:41.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:41 smithi170 ceph-mon[31212]: pgmap v7223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:42.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:42 smithi191 ceph-mon[31636]: pgmap v7224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:42.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:42 smithi170 ceph-mon[31212]: pgmap v7224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:42.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:42 smithi077 ceph-mon[27902]: pgmap v7224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:43.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13373.540655 secs 2024-04-21T14:07:43.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13373.540655 secs 2024-04-21T14:07:43.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13373.540655 secs 2024-04-21T14:07:44.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13375.300966 secs 2024-04-21T14:07:44.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:44 smithi191 ceph-mon[31636]: pgmap v7225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:44.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13375.300966 secs 2024-04-21T14:07:44.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:44 smithi170 ceph-mon[31212]: pgmap v7225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:44.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13375.300966 secs 2024-04-21T14:07:44.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:44 smithi077 ceph-mon[27902]: pgmap v7225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:47.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:47 smithi077 ceph-mon[27902]: pgmap v7226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:47.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:47 smithi191 ceph-mon[31636]: pgmap v7226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:47.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:47 smithi170 ceph-mon[31212]: pgmap v7226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:48.351 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13378.540791 secs 2024-04-21T14:07:48.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13378.540791 secs 2024-04-21T14:07:48.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13378.540791 secs 2024-04-21T14:07:49.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:49 smithi077 ceph-mon[27902]: pgmap v7227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:49.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:49 smithi191 ceph-mon[31636]: pgmap v7227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:49.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:49 smithi170 ceph-mon[31212]: pgmap v7227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:50.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:50.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13380.301079 secs 2024-04-21T14:07:50.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13380.301079 secs 2024-04-21T14:07:50.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13380.301079 secs 2024-04-21T14:07:51.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:51 smithi077 ceph-mon[27902]: pgmap v7228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:51.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:51 smithi191 ceph-mon[31636]: pgmap v7228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:51.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:51 smithi170 ceph-mon[31212]: pgmap v7228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:53.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13383.540831 secs 2024-04-21T14:07:53.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:53 smithi077 ceph-mon[27902]: pgmap v7229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:53.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13383.540831 secs 2024-04-21T14:07:53.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:53 smithi191 ceph-mon[31636]: pgmap v7229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:53.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13383.540831 secs 2024-04-21T14:07:53.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:53 smithi170 ceph-mon[31212]: pgmap v7229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:55.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:07:55.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13385.301152 secs 2024-04-21T14:07:55.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:55 smithi077 ceph-mon[27902]: pgmap v7230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:55.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13385.301152 secs 2024-04-21T14:07:55.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:55 smithi191 ceph-mon[31636]: pgmap v7230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:55.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13385.301152 secs 2024-04-21T14:07:55.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:55 smithi170 ceph-mon[31212]: pgmap v7230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:07:56.200+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:07:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:07:56.200+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:07:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:07:56.201+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:07:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:07:56.201+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:07:57.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:57 smithi077 ceph-mon[27902]: pgmap v7231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:57.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:57 smithi191 ceph-mon[31636]: pgmap v7231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:57.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:57 smithi170 ceph-mon[31212]: pgmap v7231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:07:58.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13388.540964 secs 2024-04-21T14:07:58.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:58 smithi077 ceph-mon[27902]: pgmap v7232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:58.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13388.540964 secs 2024-04-21T14:07:58.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:58 smithi191 ceph-mon[31636]: pgmap v7232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13388.540964 secs 2024-04-21T14:07:58.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:58 smithi170 ceph-mon[31212]: pgmap v7232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:07:59.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13390.301268 secs 2024-04-21T14:07:59.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13390.301268 secs 2024-04-21T14:07:59.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13390.301268 secs 2024-04-21T14:08:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:00 smithi170 ceph-mon[31212]: pgmap v7233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:00.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:00 smithi077 ceph-mon[27902]: pgmap v7233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:00.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:00 smithi191 ceph-mon[31636]: pgmap v7233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:03.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13393.541079 secs 2024-04-21T14:08:03.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:03 smithi077 ceph-mon[27902]: pgmap v7234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T14:08:03.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13393.541079 secs 2024-04-21T14:08:03.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:03 smithi191 ceph-mon[31636]: pgmap v7234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T14:08:03.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13393.541079 secs 2024-04-21T14:08:03.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:03 smithi170 ceph-mon[31212]: pgmap v7234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T14:08:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13395.301385 secs 2024-04-21T14:08:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:05 smithi077 ceph-mon[27902]: pgmap v7235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T14:08:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:05 smithi077 ceph-mon[27902]: osdmap e523: 12 total, 12 up, 12 in 2024-04-21T14:08:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13395.301385 secs 2024-04-21T14:08:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:05 smithi191 ceph-mon[31636]: pgmap v7235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T14:08:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:05 smithi191 ceph-mon[31636]: osdmap e523: 12 total, 12 up, 12 in 2024-04-21T14:08:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13395.301385 secs 2024-04-21T14:08:05.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:05 smithi170 ceph-mon[31212]: pgmap v7235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T14:08:05.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:05 smithi170 ceph-mon[31212]: osdmap e523: 12 total, 12 up, 12 in 2024-04-21T14:08:07.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:07 smithi077 ceph-mon[27902]: pgmap v7237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:08:07.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:07 smithi191 ceph-mon[31636]: pgmap v7237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:08:07.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:07 smithi170 ceph-mon[31212]: pgmap v7237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:08:08.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13398.541198 secs 2024-04-21T14:08:08.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13398.541198 secs 2024-04-21T14:08:08.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13398.541198 secs 2024-04-21T14:08:09.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:09 smithi077 ceph-mon[27902]: pgmap v7238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:08:09.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:09 smithi191 ceph-mon[31636]: pgmap v7238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:08:09.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:09 smithi170 ceph-mon[31212]: pgmap v7238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:08:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13400.301499 secs 2024-04-21T14:08:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:10 smithi077 ceph-mon[27902]: osdmap e524: 12 total, 12 up, 12 in 2024-04-21T14:08:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:10 smithi077 ceph-mon[27902]: pgmap v7240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-04-21T14:08:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13400.301499 secs 2024-04-21T14:08:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:10 smithi191 ceph-mon[31636]: osdmap e524: 12 total, 12 up, 12 in 2024-04-21T14:08:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:10 smithi191 ceph-mon[31636]: pgmap v7240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-04-21T14:08:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13400.301499 secs 2024-04-21T14:08:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:10 smithi170 ceph-mon[31212]: osdmap e524: 12 total, 12 up, 12 in 2024-04-21T14:08:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:10 smithi170 ceph-mon[31212]: pgmap v7240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-04-21T14:08:13.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13403.541346 secs 2024-04-21T14:08:13.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:13 smithi077 ceph-mon[27902]: pgmap v7241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 21 op/s 2024-04-21T14:08:13.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13403.541346 secs 2024-04-21T14:08:13.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:13 smithi191 ceph-mon[31636]: pgmap v7241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 21 op/s 2024-04-21T14:08:13.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13403.541346 secs 2024-04-21T14:08:13.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:13 smithi170 ceph-mon[31212]: pgmap v7241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 21 op/s 2024-04-21T14:08:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:15.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13405.301625 secs 2024-04-21T14:08:15.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:15 smithi077 ceph-mon[27902]: pgmap v7242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T14:08:15.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13405.301625 secs 2024-04-21T14:08:15.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:15 smithi191 ceph-mon[31636]: pgmap v7242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T14:08:15.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13405.301625 secs 2024-04-21T14:08:15.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:15 smithi170 ceph-mon[31212]: pgmap v7242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T14:08:17.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:17 smithi077 ceph-mon[27902]: pgmap v7243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:08:17.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:17 smithi191 ceph-mon[31636]: pgmap v7243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:08:17.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:17 smithi170 ceph-mon[31212]: pgmap v7243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:08:18.351 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13408.541463 secs 2024-04-21T14:08:18.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13408.541463 secs 2024-04-21T14:08:18.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13408.541463 secs 2024-04-21T14:08:19.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:19 smithi077 ceph-mon[27902]: pgmap v7244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:08:19.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:19 smithi191 ceph-mon[31636]: pgmap v7244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:08:19.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:19 smithi170 ceph-mon[31212]: pgmap v7244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:08:20.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:20.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13410.301731 secs 2024-04-21T14:08:20.439 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13410.301731 secs 2024-04-21T14:08:20.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13410.301731 secs 2024-04-21T14:08:21.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:21 smithi077 ceph-mon[27902]: pgmap v7245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:08:21.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:21 smithi191 ceph-mon[31636]: pgmap v7245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:08:21.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:21 smithi170 ceph-mon[31212]: pgmap v7245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:08:22.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:08:22.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:22 smithi191 ceph-mon[31636]: pgmap v7246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:08:22.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:08:22.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:22 smithi170 ceph-mon[31212]: pgmap v7246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:08:22.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:08:22.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:22 smithi077 ceph-mon[27902]: pgmap v7246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13413.541563 secs 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:08:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13413.541563 secs 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:08:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13413.541563 secs 2024-04-21T14:08:23.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:23.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:08:23.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:08:23.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:08:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13415.301816 secs 2024-04-21T14:08:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:24 smithi077 ceph-mon[27902]: pgmap v7247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:24.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13415.301816 secs 2024-04-21T14:08:24.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:24 smithi191 ceph-mon[31636]: pgmap v7247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13415.301816 secs 2024-04-21T14:08:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:24 smithi170 ceph-mon[31212]: pgmap v7247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:27.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:27 smithi077 ceph-mon[27902]: pgmap v7248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:27.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:27 smithi191 ceph-mon[31636]: pgmap v7248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:27.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:27 smithi170 ceph-mon[31212]: pgmap v7248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:28.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13418.541672 secs 2024-04-21T14:08:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13418.541672 secs 2024-04-21T14:08:28.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13418.541672 secs 2024-04-21T14:08:29.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:29 smithi077 ceph-mon[27902]: pgmap v7249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:29.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:29 smithi191 ceph-mon[31636]: pgmap v7249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:29.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:29 smithi170 ceph-mon[31212]: pgmap v7249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13420.301931 secs 2024-04-21T14:08:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13420.301931 secs 2024-04-21T14:08:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13420.301931 secs 2024-04-21T14:08:31.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:31 smithi077 ceph-mon[27902]: pgmap v7250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:31.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:31 smithi191 ceph-mon[31636]: pgmap v7250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:31.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:31 smithi170 ceph-mon[31212]: pgmap v7250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:33.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13423.541791 secs 2024-04-21T14:08:33.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:33 smithi077 ceph-mon[27902]: pgmap v7251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13423.541791 secs 2024-04-21T14:08:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:33 smithi191 ceph-mon[31636]: pgmap v7251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:33.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13423.541791 secs 2024-04-21T14:08:33.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:33 smithi170 ceph-mon[31212]: pgmap v7251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:34 smithi077 ceph-mon[27902]: pgmap v7252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:34.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:34 smithi191 ceph-mon[31636]: pgmap v7252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:34.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:34 smithi170 ceph-mon[31212]: pgmap v7252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:35.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13425.302022 secs 2024-04-21T14:08:35.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13425.302022 secs 2024-04-21T14:08:35.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13425.302022 secs 2024-04-21T14:08:36.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:36 smithi191 ceph-mon[31636]: pgmap v7253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:36.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:36 smithi170 ceph-mon[31212]: pgmap v7253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:36.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:36 smithi077 ceph-mon[27902]: pgmap v7253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:37.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13428.541905 secs 2024-04-21T14:08:37.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13428.541905 secs 2024-04-21T14:08:37.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13428.541905 secs 2024-04-21T14:08:38.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:38 smithi170 ceph-mon[31212]: pgmap v7254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:38.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:38 smithi077 ceph-mon[27902]: pgmap v7254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:38.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:38 smithi191 ceph-mon[31636]: pgmap v7254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:39.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13430.302138 secs 2024-04-21T14:08:39.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13430.302138 secs 2024-04-21T14:08:39.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13430.302138 secs 2024-04-21T14:08:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:40.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:40 smithi170 ceph-mon[31212]: pgmap v7255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:40 smithi077 ceph-mon[27902]: pgmap v7255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:40.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:40 smithi191 ceph-mon[31636]: pgmap v7255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:43.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13433.542021 secs 2024-04-21T14:08:43.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:43 smithi077 ceph-mon[27902]: pgmap v7256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:43.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13433.542021 secs 2024-04-21T14:08:43.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:43 smithi191 ceph-mon[31636]: pgmap v7256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:43.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13433.542021 secs 2024-04-21T14:08:43.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:43 smithi170 ceph-mon[31212]: pgmap v7256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:45.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13435.302258 secs 2024-04-21T14:08:45.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:45 smithi077 ceph-mon[27902]: pgmap v7257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:45.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13435.302258 secs 2024-04-21T14:08:45.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:45 smithi191 ceph-mon[31636]: pgmap v7257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:45.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13435.302258 secs 2024-04-21T14:08:45.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:45 smithi170 ceph-mon[31212]: pgmap v7257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:47.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:47 smithi077 ceph-mon[27902]: pgmap v7258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:47.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:47 smithi191 ceph-mon[31636]: pgmap v7258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:47.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:47 smithi170 ceph-mon[31212]: pgmap v7258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:48.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13438.542136 secs 2024-04-21T14:08:48.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13438.542136 secs 2024-04-21T14:08:48.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13438.542136 secs 2024-04-21T14:08:49.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:49 smithi077 ceph-mon[27902]: pgmap v7259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:49.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:49 smithi191 ceph-mon[31636]: pgmap v7259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:49.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:49 smithi170 ceph-mon[31212]: pgmap v7259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:50.439 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13440.302318 secs 2024-04-21T14:08:50.440 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:50 smithi170 ceph-mon[31212]: pgmap v7260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:50.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13440.302318 secs 2024-04-21T14:08:50.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:50 smithi191 ceph-mon[31636]: pgmap v7260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:50.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13440.302318 secs 2024-04-21T14:08:50.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:50 smithi077 ceph-mon[27902]: pgmap v7260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:53.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13443.542226 secs 2024-04-21T14:08:53.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:53 smithi077 ceph-mon[27902]: pgmap v7261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:53.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13443.542226 secs 2024-04-21T14:08:53.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:53 smithi191 ceph-mon[31636]: pgmap v7261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:53.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13443.542226 secs 2024-04-21T14:08:53.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:53 smithi170 ceph-mon[31212]: pgmap v7261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:55.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:08:55.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13445.302434 secs 2024-04-21T14:08:55.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:55 smithi077 ceph-mon[27902]: pgmap v7262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:55.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13445.302434 secs 2024-04-21T14:08:55.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:55 smithi191 ceph-mon[31636]: pgmap v7262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:55.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13445.302434 secs 2024-04-21T14:08:55.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:55 smithi170 ceph-mon[31212]: pgmap v7262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:08:57.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:57 smithi077 ceph-mon[27902]: pgmap v7263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:57.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:57 smithi191 ceph-mon[31636]: pgmap v7263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:57.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:57 smithi170 ceph-mon[31212]: pgmap v7263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:08:58.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13448.542355 secs 2024-04-21T14:08:58.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13448.542355 secs 2024-04-21T14:08:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13448.542355 secs 2024-04-21T14:08:59.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:08:59 smithi077 ceph-mon[27902]: pgmap v7264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:08:59.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:08:59 smithi191 ceph-mon[31636]: pgmap v7264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:08:59.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:08:59 smithi170 ceph-mon[31212]: pgmap v7264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13450.302552 secs 2024-04-21T14:09:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:00 smithi191 ceph-mon[31636]: pgmap v7265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13450.302552 secs 2024-04-21T14:09:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:00 smithi170 ceph-mon[31212]: pgmap v7265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:00.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13450.302552 secs 2024-04-21T14:09:00.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:00 smithi077 ceph-mon[27902]: pgmap v7265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:03.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13453.542502 secs 2024-04-21T14:09:03.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:03 smithi077 ceph-mon[27902]: pgmap v7266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:03.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13453.542502 secs 2024-04-21T14:09:03.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:03 smithi191 ceph-mon[31636]: pgmap v7266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:03.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13453.542502 secs 2024-04-21T14:09:03.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:03 smithi170 ceph-mon[31212]: pgmap v7266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13455.302638 secs 2024-04-21T14:09:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:05 smithi077 ceph-mon[27902]: pgmap v7267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:05 smithi077 ceph-mon[27902]: osdmap e525: 12 total, 12 up, 12 in 2024-04-21T14:09:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13455.302638 secs 2024-04-21T14:09:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:05 smithi191 ceph-mon[31636]: pgmap v7267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:05 smithi191 ceph-mon[31636]: osdmap e525: 12 total, 12 up, 12 in 2024-04-21T14:09:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13455.302638 secs 2024-04-21T14:09:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:05 smithi170 ceph-mon[31212]: pgmap v7267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:09:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:05 smithi170 ceph-mon[31212]: osdmap e525: 12 total, 12 up, 12 in 2024-04-21T14:09:07.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:07 smithi077 ceph-mon[27902]: pgmap v7269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:09:07.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:07 smithi191 ceph-mon[31636]: pgmap v7269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:09:07.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:07 smithi170 ceph-mon[31212]: pgmap v7269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:09:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13458.542612 secs 2024-04-21T14:09:08.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:08 smithi191 ceph-mon[31636]: pgmap v7270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:09:08.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13458.542612 secs 2024-04-21T14:09:08.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:08 smithi170 ceph-mon[31212]: pgmap v7270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:09:08.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13458.542612 secs 2024-04-21T14:09:08.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:08 smithi077 ceph-mon[27902]: pgmap v7270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:09:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13460.302752 secs 2024-04-21T14:09:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:10 smithi191 ceph-mon[31636]: osdmap e526: 12 total, 12 up, 12 in 2024-04-21T14:09:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:10 smithi191 ceph-mon[31636]: pgmap v7272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:09:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13460.302752 secs 2024-04-21T14:09:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:10 smithi170 ceph-mon[31212]: osdmap e526: 12 total, 12 up, 12 in 2024-04-21T14:09:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:10 smithi170 ceph-mon[31212]: pgmap v7272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:09:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13460.302752 secs 2024-04-21T14:09:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:10 smithi077 ceph-mon[27902]: osdmap e526: 12 total, 12 up, 12 in 2024-04-21T14:09:10.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:10 smithi077 ceph-mon[27902]: pgmap v7272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:09:13.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13463.542747 secs 2024-04-21T14:09:13.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:13 smithi077 ceph-mon[27902]: pgmap v7273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:09:13.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13463.542747 secs 2024-04-21T14:09:13.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:13 smithi191 ceph-mon[31636]: pgmap v7273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:09:13.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13463.542747 secs 2024-04-21T14:09:13.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:13 smithi170 ceph-mon[31212]: pgmap v7273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:09:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:15.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13465.302898 secs 2024-04-21T14:09:15.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:15 smithi077 ceph-mon[27902]: pgmap v7274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:09:15.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13465.302898 secs 2024-04-21T14:09:15.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:15 smithi191 ceph-mon[31636]: pgmap v7274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:09:15.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13465.302898 secs 2024-04-21T14:09:15.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:15 smithi170 ceph-mon[31212]: pgmap v7274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:09:17.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:17 smithi077 ceph-mon[27902]: pgmap v7275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:09:17.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:17 smithi191 ceph-mon[31636]: pgmap v7275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:09:17.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:17 smithi170 ceph-mon[31212]: pgmap v7275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:09:18.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13468.542855 secs 2024-04-21T14:09:18.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13468.542855 secs 2024-04-21T14:09:18.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13468.542855 secs 2024-04-21T14:09:19.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:19 smithi191 ceph-mon[31636]: pgmap v7276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:09:19.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:19 smithi170 ceph-mon[31212]: pgmap v7276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:09:19.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:19 smithi077 ceph-mon[27902]: pgmap v7276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:09:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:20.439 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13470.303006 secs 2024-04-21T14:09:20.439 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:20 smithi170 ceph-mon[31212]: pgmap v7277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:09:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13470.303006 secs 2024-04-21T14:09:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:20 smithi191 ceph-mon[31636]: pgmap v7277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:09:20.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13470.303006 secs 2024-04-21T14:09:20.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:20 smithi077 ceph-mon[27902]: pgmap v7277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:09:23.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13473.542958 secs 2024-04-21T14:09:23.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:23 smithi077 ceph-mon[27902]: pgmap v7278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:09:23.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:09:23.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13473.542958 secs 2024-04-21T14:09:23.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:23 smithi191 ceph-mon[31636]: pgmap v7278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:09:23.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:09:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13473.542958 secs 2024-04-21T14:09:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:23 smithi170 ceph-mon[31212]: pgmap v7278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:09:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:09:24.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:09:24.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:09:24.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:09:24.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:09:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:09:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:09:24.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:09:24.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:09:24.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:09:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:25.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13475.303095 secs 2024-04-21T14:09:25.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:25 smithi077 ceph-mon[27902]: pgmap v7279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:25.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13475.303095 secs 2024-04-21T14:09:25.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:25 smithi191 ceph-mon[31636]: pgmap v7279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:25.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13475.303095 secs 2024-04-21T14:09:25.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:25 smithi170 ceph-mon[31212]: pgmap v7279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:27.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:27 smithi077 ceph-mon[27902]: pgmap v7280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:27.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:27 smithi191 ceph-mon[31636]: pgmap v7280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:27.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:27 smithi170 ceph-mon[31212]: pgmap v7280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13478.543072 secs 2024-04-21T14:09:28.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13478.543072 secs 2024-04-21T14:09:28.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13478.543072 secs 2024-04-21T14:09:29.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:29 smithi191 ceph-mon[31636]: pgmap v7281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:29.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:29 smithi170 ceph-mon[31212]: pgmap v7281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:29.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:29 smithi077 ceph-mon[27902]: pgmap v7281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13480.303210 secs 2024-04-21T14:09:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:30 smithi191 ceph-mon[31636]: pgmap v7282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13480.303210 secs 2024-04-21T14:09:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:30 smithi170 ceph-mon[31212]: pgmap v7282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:30.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13480.303210 secs 2024-04-21T14:09:30.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:30 smithi077 ceph-mon[27902]: pgmap v7282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:33.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13483.543187 secs 2024-04-21T14:09:33.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:33 smithi077 ceph-mon[27902]: pgmap v7283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:33.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13483.543187 secs 2024-04-21T14:09:33.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:33 smithi191 ceph-mon[31636]: pgmap v7283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:33.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13483.543187 secs 2024-04-21T14:09:33.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:33 smithi170 ceph-mon[31212]: pgmap v7283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:35.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13485.303312 secs 2024-04-21T14:09:35.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:35 smithi077 ceph-mon[27902]: pgmap v7284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:35.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13485.303312 secs 2024-04-21T14:09:35.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:35 smithi191 ceph-mon[31636]: pgmap v7284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:35.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13485.303312 secs 2024-04-21T14:09:35.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:35 smithi170 ceph-mon[31212]: pgmap v7284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:36.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:36 smithi191 ceph-mon[31636]: pgmap v7285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:36.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:36 smithi170 ceph-mon[31212]: pgmap v7285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:36.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:36 smithi077 ceph-mon[27902]: pgmap v7285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:37.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13488.543292 secs 2024-04-21T14:09:37.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13488.543292 secs 2024-04-21T14:09:37.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13488.543292 secs 2024-04-21T14:09:38.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:38 smithi170 ceph-mon[31212]: pgmap v7286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:38.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:38 smithi077 ceph-mon[27902]: pgmap v7286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:38.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:38 smithi191 ceph-mon[31636]: pgmap v7286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:39.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13490.303438 secs 2024-04-21T14:09:39.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13490.303438 secs 2024-04-21T14:09:39.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13490.303438 secs 2024-04-21T14:09:40.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:40.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:40 smithi170 ceph-mon[31212]: pgmap v7287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:40 smithi077 ceph-mon[27902]: pgmap v7287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:40.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:40 smithi191 ceph-mon[31636]: pgmap v7287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:43.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13493.543406 secs 2024-04-21T14:09:43.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:43 smithi077 ceph-mon[27902]: pgmap v7288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:43.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13493.543406 secs 2024-04-21T14:09:43.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:43 smithi191 ceph-mon[31636]: pgmap v7288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:43.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13493.543406 secs 2024-04-21T14:09:43.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:43 smithi170 ceph-mon[31212]: pgmap v7288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:45.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13495.303526 secs 2024-04-21T14:09:45.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:45 smithi191 ceph-mon[31636]: pgmap v7289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:45.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13495.303526 secs 2024-04-21T14:09:45.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:45 smithi170 ceph-mon[31212]: pgmap v7289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:45.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13495.303526 secs 2024-04-21T14:09:45.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:45 smithi077 ceph-mon[27902]: pgmap v7289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:46.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:46 smithi191 ceph-mon[31636]: pgmap v7290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:46.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:46 smithi170 ceph-mon[31212]: pgmap v7290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:46.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:46 smithi077 ceph-mon[27902]: pgmap v7290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:47.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13498.543521 secs 2024-04-21T14:09:47.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13498.543521 secs 2024-04-21T14:09:47.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13498.543521 secs 2024-04-21T14:09:48.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:48 smithi170 ceph-mon[31212]: pgmap v7291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:48.850 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:48 smithi191 ceph-mon[31636]: pgmap v7291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:48.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:48 smithi077 ceph-mon[27902]: pgmap v7291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:49.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13500.303645 secs 2024-04-21T14:09:49.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13500.303645 secs 2024-04-21T14:09:49.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13500.303645 secs 2024-04-21T14:09:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:50 smithi170 ceph-mon[31212]: pgmap v7292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:50.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:50 smithi077 ceph-mon[27902]: pgmap v7292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:50.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:50 smithi191 ceph-mon[31636]: pgmap v7292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:53.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13503.543669 secs 2024-04-21T14:09:53.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:53 smithi191 ceph-mon[31636]: pgmap v7293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:53.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13503.543669 secs 2024-04-21T14:09:53.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:53 smithi170 ceph-mon[31212]: pgmap v7293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:53.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13503.543669 secs 2024-04-21T14:09:53.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:53 smithi077 ceph-mon[27902]: pgmap v7293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:54.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13505.303759 secs 2024-04-21T14:09:54.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:54 smithi191 ceph-mon[31636]: pgmap v7294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:54.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13505.303759 secs 2024-04-21T14:09:54.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:54 smithi170 ceph-mon[31212]: pgmap v7294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:54.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13505.303759 secs 2024-04-21T14:09:54.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:54 smithi077 ceph-mon[27902]: pgmap v7294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:09:57.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:57 smithi191 ceph-mon[31636]: pgmap v7295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:57.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:57 smithi170 ceph-mon[31212]: pgmap v7295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:57.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:57 smithi077 ceph-mon[27902]: pgmap v7295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:09:58.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13508.543786 secs 2024-04-21T14:09:58.517 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13508.543786 secs 2024-04-21T14:09:58.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13508.543786 secs 2024-04-21T14:09:59.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:09:59 smithi191 ceph-mon[31636]: pgmap v7296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:59.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:09:59 smithi170 ceph-mon[31212]: pgmap v7296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:09:59.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:09:59 smithi077 ceph-mon[27902]: pgmap v7296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13510.303885 secs 2024-04-21T14:10:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:10:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:00 smithi191 ceph-mon[31636]: pgmap v7297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13510.303885 secs 2024-04-21T14:10:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:10:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:00 smithi170 ceph-mon[31212]: pgmap v7297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:00.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13510.303885 secs 2024-04-21T14:10:00.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:10:00.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:00 smithi077 ceph-mon[27902]: pgmap v7297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:03.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13513.543900 secs 2024-04-21T14:10:03.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:03 smithi191 ceph-mon[31636]: pgmap v7298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13513.543900 secs 2024-04-21T14:10:03.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:03 smithi170 ceph-mon[31212]: pgmap v7298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:03.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13513.543900 secs 2024-04-21T14:10:03.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:03 smithi077 ceph-mon[27902]: pgmap v7298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13515.303964 secs 2024-04-21T14:10:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:04 smithi191 ceph-mon[31636]: pgmap v7299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:04 smithi191 ceph-mon[31636]: osdmap e527: 12 total, 12 up, 12 in 2024-04-21T14:10:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13515.303964 secs 2024-04-21T14:10:04.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:04 smithi170 ceph-mon[31212]: pgmap v7299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:04.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:04 smithi170 ceph-mon[31212]: osdmap e527: 12 total, 12 up, 12 in 2024-04-21T14:10:04.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13515.303964 secs 2024-04-21T14:10:04.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:04 smithi077 ceph-mon[27902]: pgmap v7299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:04.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:04 smithi077 ceph-mon[27902]: osdmap e527: 12 total, 12 up, 12 in 2024-04-21T14:10:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:07.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:07 smithi191 ceph-mon[31636]: pgmap v7301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:10:07.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:07 smithi170 ceph-mon[31212]: pgmap v7301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:10:07.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:07 smithi077 ceph-mon[27902]: pgmap v7301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:10:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13518.543971 secs 2024-04-21T14:10:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:08 smithi191 ceph-mon[31636]: pgmap v7302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:10:08.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13518.543971 secs 2024-04-21T14:10:08.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:08 smithi170 ceph-mon[31212]: pgmap v7302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:10:08.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13518.543971 secs 2024-04-21T14:10:08.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:08 smithi077 ceph-mon[27902]: pgmap v7302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:10:10.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13520.304068 secs 2024-04-21T14:10:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:10 smithi191 ceph-mon[31636]: osdmap e528: 12 total, 12 up, 12 in 2024-04-21T14:10:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:10 smithi191 ceph-mon[31636]: pgmap v7304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:10:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13520.304068 secs 2024-04-21T14:10:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:10 smithi170 ceph-mon[31212]: osdmap e528: 12 total, 12 up, 12 in 2024-04-21T14:10:10.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:10 smithi170 ceph-mon[31212]: pgmap v7304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:10:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13520.304068 secs 2024-04-21T14:10:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:10 smithi077 ceph-mon[27902]: osdmap e528: 12 total, 12 up, 12 in 2024-04-21T14:10:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:10 smithi077 ceph-mon[27902]: pgmap v7304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:10:12.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:12 smithi191 ceph-mon[31636]: pgmap v7305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:10:12.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:12 smithi170 ceph-mon[31212]: pgmap v7305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:10:12.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:12 smithi077 ceph-mon[27902]: pgmap v7305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:10:13.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13523.544085 secs 2024-04-21T14:10:13.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13523.544085 secs 2024-04-21T14:10:13.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13523.544085 secs 2024-04-21T14:10:14.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13525.304190 secs 2024-04-21T14:10:14.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:14 smithi191 ceph-mon[31636]: pgmap v7306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:10:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13525.304190 secs 2024-04-21T14:10:14.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:14 smithi170 ceph-mon[31212]: pgmap v7306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:10:14.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13525.304190 secs 2024-04-21T14:10:14.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:14 smithi077 ceph-mon[27902]: pgmap v7306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:10:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:16.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:16 smithi191 ceph-mon[31636]: pgmap v7307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:10:16.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:16 smithi170 ceph-mon[31212]: pgmap v7307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:10:16.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:16 smithi077 ceph-mon[27902]: pgmap v7307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:10:17.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13528.544198 secs 2024-04-21T14:10:17.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13528.544198 secs 2024-04-21T14:10:17.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13528.544198 secs 2024-04-21T14:10:18.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:18 smithi170 ceph-mon[31212]: pgmap v7308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:10:18.851 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:18 smithi191 ceph-mon[31636]: pgmap v7308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:10:18.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:18 smithi077 ceph-mon[27902]: pgmap v7308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:10:19.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13530.304301 secs 2024-04-21T14:10:19.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13530.304301 secs 2024-04-21T14:10:19.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13530.304301 secs 2024-04-21T14:10:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:20.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:20 smithi170 ceph-mon[31212]: pgmap v7309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:10:20.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:20 smithi077 ceph-mon[27902]: pgmap v7309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:10:20.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:20 smithi191 ceph-mon[31636]: pgmap v7309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:10:22.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:22 smithi191 ceph-mon[31636]: pgmap v7310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:10:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:22 smithi170 ceph-mon[31212]: pgmap v7310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:10:22.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:22 smithi077 ceph-mon[27902]: pgmap v7310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:10:23.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13533.544314 secs 2024-04-21T14:10:23.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13533.544314 secs 2024-04-21T14:10:23.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13533.544314 secs 2024-04-21T14:10:24.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13535.304438 secs 2024-04-21T14:10:24.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:10:24.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:24 smithi191 ceph-mon[31636]: pgmap v7311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13535.304438 secs 2024-04-21T14:10:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:10:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:24 smithi170 ceph-mon[31212]: pgmap v7311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:24.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13535.304438 secs 2024-04-21T14:10:24.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:10:24.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:24 smithi077 ceph-mon[27902]: pgmap v7311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:25.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:10:25.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:10:25.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:10:25.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:10:25.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:10:25.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:10:25.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:10:25.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:10:25.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:10:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:26 smithi191 ceph-mon[31636]: pgmap v7312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:26 smithi170 ceph-mon[31212]: pgmap v7312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:26.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:26 smithi077 ceph-mon[27902]: pgmap v7312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:27.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13538.544434 secs 2024-04-21T14:10:27.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13538.544434 secs 2024-04-21T14:10:27.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13538.544434 secs 2024-04-21T14:10:28.767 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:28 smithi077 ceph-mon[27902]: pgmap v7313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:28.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:28 smithi170 ceph-mon[31212]: pgmap v7313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:28.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:28 smithi191 ceph-mon[31636]: pgmap v7313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:29.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13540.304590 secs 2024-04-21T14:10:29.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13540.304590 secs 2024-04-21T14:10:29.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13540.304590 secs 2024-04-21T14:10:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:30 smithi170 ceph-mon[31212]: pgmap v7314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:30.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:30 smithi077 ceph-mon[27902]: pgmap v7314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:30.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:30 smithi191 ceph-mon[31636]: pgmap v7314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:32.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:32 smithi191 ceph-mon[31636]: pgmap v7315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:32.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:32 smithi170 ceph-mon[31212]: pgmap v7315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:32.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:32 smithi077 ceph-mon[27902]: pgmap v7315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:33.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13543.544545 secs 2024-04-21T14:10:33.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13543.544545 secs 2024-04-21T14:10:33.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13543.544545 secs 2024-04-21T14:10:34.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13545.304722 secs 2024-04-21T14:10:34.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:34 smithi191 ceph-mon[31636]: pgmap v7316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13545.304722 secs 2024-04-21T14:10:34.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:34 smithi170 ceph-mon[31212]: pgmap v7316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:34.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13545.304722 secs 2024-04-21T14:10:34.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:34 smithi077 ceph-mon[27902]: pgmap v7316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:35.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:36.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:36 smithi191 ceph-mon[31636]: pgmap v7317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:36.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:36 smithi170 ceph-mon[31212]: pgmap v7317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:36.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:36 smithi077 ceph-mon[27902]: pgmap v7317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:37.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13548.544638 secs 2024-04-21T14:10:37.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13548.544638 secs 2024-04-21T14:10:37.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13548.544638 secs 2024-04-21T14:10:38.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:38 smithi170 ceph-mon[31212]: pgmap v7318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:38.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:38 smithi077 ceph-mon[27902]: pgmap v7318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:38.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:38 smithi191 ceph-mon[31636]: pgmap v7318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:39.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13550.304872 secs 2024-04-21T14:10:39.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13550.304872 secs 2024-04-21T14:10:39.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13550.304872 secs 2024-04-21T14:10:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:40.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:40 smithi170 ceph-mon[31212]: pgmap v7319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:40 smithi077 ceph-mon[27902]: pgmap v7319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:40.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:40 smithi191 ceph-mon[31636]: pgmap v7319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:42.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:42 smithi191 ceph-mon[31636]: pgmap v7320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:42.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:42 smithi170 ceph-mon[31212]: pgmap v7320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:42.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:42 smithi077 ceph-mon[27902]: pgmap v7320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:43.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13553.544790 secs 2024-04-21T14:10:43.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13553.544790 secs 2024-04-21T14:10:43.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13553.544790 secs 2024-04-21T14:10:44.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13555.304998 secs 2024-04-21T14:10:44.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:44 smithi191 ceph-mon[31636]: pgmap v7321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:44.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13555.304998 secs 2024-04-21T14:10:44.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:44 smithi170 ceph-mon[31212]: pgmap v7321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:44.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13555.304998 secs 2024-04-21T14:10:44.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:44 smithi077 ceph-mon[27902]: pgmap v7321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:46.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:46 smithi191 ceph-mon[31636]: pgmap v7322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:46.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:46 smithi170 ceph-mon[31212]: pgmap v7322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:46.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:46 smithi077 ceph-mon[27902]: pgmap v7322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:47.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13558.544920 secs 2024-04-21T14:10:47.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13558.544920 secs 2024-04-21T14:10:47.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13558.544920 secs 2024-04-21T14:10:48.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:48 smithi170 ceph-mon[31212]: pgmap v7323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:48.850 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:48 smithi191 ceph-mon[31636]: pgmap v7323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:48.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:48 smithi077 ceph-mon[27902]: pgmap v7323: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:49.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13560.305119 secs 2024-04-21T14:10:49.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13560.305119 secs 2024-04-21T14:10:49.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13560.305119 secs 2024-04-21T14:10:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:50 smithi170 ceph-mon[31212]: pgmap v7324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:50.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:50 smithi077 ceph-mon[27902]: pgmap v7324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:50.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:50 smithi191 ceph-mon[31636]: pgmap v7324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:52.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:52 smithi191 ceph-mon[31636]: pgmap v7325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:52.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:52 smithi170 ceph-mon[31212]: pgmap v7325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:52.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:52 smithi077 ceph-mon[27902]: pgmap v7325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:53.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13563.544985 secs 2024-04-21T14:10:53.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13563.544985 secs 2024-04-21T14:10:53.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13563.544985 secs 2024-04-21T14:10:54.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13565.305251 secs 2024-04-21T14:10:54.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:54 smithi191 ceph-mon[31636]: pgmap v7326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:54.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13565.305251 secs 2024-04-21T14:10:54.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:54 smithi170 ceph-mon[31212]: pgmap v7326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13565.305251 secs 2024-04-21T14:10:54.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:54 smithi077 ceph-mon[27902]: pgmap v7326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:10:56.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:10:56.225+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:10:56.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:10:56.225+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:10:56.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:10:56.225+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:10:56.206 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:10:56.225+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:10:56.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:56 smithi191 ceph-mon[31636]: pgmap v7327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:56.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:56 smithi170 ceph-mon[31212]: pgmap v7327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:56.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:56 smithi077 ceph-mon[27902]: pgmap v7327: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:10:57.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13568.545102 secs 2024-04-21T14:10:57.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13568.545102 secs 2024-04-21T14:10:57.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13568.545102 secs 2024-04-21T14:10:58.766 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:58 smithi077 ceph-mon[27902]: pgmap v7328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:58.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:58 smithi170 ceph-mon[31212]: pgmap v7328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:58.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:58 smithi191 ceph-mon[31636]: pgmap v7328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:10:59.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13570.305389 secs 2024-04-21T14:10:59.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13570.305389 secs 2024-04-21T14:10:59.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13570.305389 secs 2024-04-21T14:11:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:00.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:00 smithi170 ceph-mon[31212]: pgmap v7329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:00.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:00 smithi077 ceph-mon[27902]: pgmap v7329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:00.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:00 smithi191 ceph-mon[31636]: pgmap v7329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:02.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:02 smithi191 ceph-mon[31636]: pgmap v7330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:02.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:02 smithi170 ceph-mon[31212]: pgmap v7330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:02.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:02 smithi077 ceph-mon[27902]: pgmap v7330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:03.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13573.545253 secs 2024-04-21T14:11:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13573.545253 secs 2024-04-21T14:11:03.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13573.545253 secs 2024-04-21T14:11:04.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13575.305514 secs 2024-04-21T14:11:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:04 smithi191 ceph-mon[31636]: pgmap v7331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13575.305514 secs 2024-04-21T14:11:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:04 smithi170 ceph-mon[31212]: pgmap v7331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:04.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13575.305514 secs 2024-04-21T14:11:04.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:04 smithi077 ceph-mon[27902]: pgmap v7331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:05 smithi191 ceph-mon[31636]: osdmap e529: 12 total, 12 up, 12 in 2024-04-21T14:11:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:05 smithi170 ceph-mon[31212]: osdmap e529: 12 total, 12 up, 12 in 2024-04-21T14:11:05.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:05 smithi077 ceph-mon[27902]: osdmap e529: 12 total, 12 up, 12 in 2024-04-21T14:11:06.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:06 smithi191 ceph-mon[31636]: pgmap v7333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:11:06.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:06 smithi170 ceph-mon[31212]: pgmap v7333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:11:06.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:06 smithi077 ceph-mon[27902]: pgmap v7333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:11:07.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13578.545362 secs 2024-04-21T14:11:07.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13578.545362 secs 2024-04-21T14:11:07.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13578.545362 secs 2024-04-21T14:11:08.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:08 smithi170 ceph-mon[31212]: pgmap v7334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:11:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:08 smithi077 ceph-mon[27902]: pgmap v7334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:11:08.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:08 smithi191 ceph-mon[31636]: pgmap v7334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:11:10.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13580.305642 secs 2024-04-21T14:11:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:10 smithi191 ceph-mon[31636]: osdmap e530: 12 total, 12 up, 12 in 2024-04-21T14:11:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:10 smithi191 ceph-mon[31636]: pgmap v7336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:11:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13580.305642 secs 2024-04-21T14:11:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:10 smithi170 ceph-mon[31212]: osdmap e530: 12 total, 12 up, 12 in 2024-04-21T14:11:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:10 smithi170 ceph-mon[31212]: pgmap v7336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:11:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13580.305642 secs 2024-04-21T14:11:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:10 smithi077 ceph-mon[27902]: osdmap e530: 12 total, 12 up, 12 in 2024-04-21T14:11:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:10 smithi077 ceph-mon[27902]: pgmap v7336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:11:12.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:12 smithi191 ceph-mon[31636]: pgmap v7337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:11:12.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:12 smithi170 ceph-mon[31212]: pgmap v7337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:11:12.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:12 smithi077 ceph-mon[27902]: pgmap v7337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:11:13.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13583.545470 secs 2024-04-21T14:11:13.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13583.545470 secs 2024-04-21T14:11:13.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13583.545470 secs 2024-04-21T14:11:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13585.305738 secs 2024-04-21T14:11:14.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:14 smithi191 ceph-mon[31636]: pgmap v7338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:11:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13585.305738 secs 2024-04-21T14:11:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:14 smithi170 ceph-mon[31212]: pgmap v7338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:11:14.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13585.305738 secs 2024-04-21T14:11:14.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:14 smithi077 ceph-mon[27902]: pgmap v7338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:11:15.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:16.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:16 smithi191 ceph-mon[31636]: pgmap v7339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:11:16.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:16 smithi170 ceph-mon[31212]: pgmap v7339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:11:16.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:16 smithi077 ceph-mon[27902]: pgmap v7339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:11:17.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13588.545587 secs 2024-04-21T14:11:17.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13588.545587 secs 2024-04-21T14:11:17.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13588.545587 secs 2024-04-21T14:11:18.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:18 smithi170 ceph-mon[31212]: pgmap v7340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:11:18.850 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:18 smithi191 ceph-mon[31636]: pgmap v7340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:11:18.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:18 smithi077 ceph-mon[27902]: pgmap v7340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:11:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13590.305882 secs 2024-04-21T14:11:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:20 smithi191 ceph-mon[31636]: pgmap v7341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:11:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13590.305882 secs 2024-04-21T14:11:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:20 smithi170 ceph-mon[31212]: pgmap v7341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:11:20.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13590.305882 secs 2024-04-21T14:11:20.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:20 smithi077 ceph-mon[27902]: pgmap v7341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:11:22.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:22 smithi191 ceph-mon[31636]: pgmap v7342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:11:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:22 smithi170 ceph-mon[31212]: pgmap v7342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:11:22.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:22 smithi077 ceph-mon[27902]: pgmap v7342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:11:23.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13593.545702 secs 2024-04-21T14:11:23.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13593.545702 secs 2024-04-21T14:11:23.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13593.545702 secs 2024-04-21T14:11:24.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13595.306013 secs 2024-04-21T14:11:24.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:24 smithi191 ceph-mon[31636]: pgmap v7343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13595.306013 secs 2024-04-21T14:11:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:24 smithi170 ceph-mon[31212]: pgmap v7343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:24.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13595.306013 secs 2024-04-21T14:11:24.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:24 smithi077 ceph-mon[27902]: pgmap v7343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:25.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:11:25.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:11:25.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:11:26.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:11:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:11:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:11:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:26 smithi191 ceph-mon[31636]: pgmap v7344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:11:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:11:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:11:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:26 smithi170 ceph-mon[31212]: pgmap v7344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:26.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:11:26.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:11:26.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:11:26.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:26 smithi077 ceph-mon[27902]: pgmap v7344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:27.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13598.545812 secs 2024-04-21T14:11:27.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13598.545812 secs 2024-04-21T14:11:27.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13598.545812 secs 2024-04-21T14:11:28.767 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:28 smithi077 ceph-mon[27902]: pgmap v7345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:28.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:28 smithi170 ceph-mon[31212]: pgmap v7345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:28.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:28 smithi191 ceph-mon[31636]: pgmap v7345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:29.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13600.306136 secs 2024-04-21T14:11:29.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13600.306136 secs 2024-04-21T14:11:29.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13600.306136 secs 2024-04-21T14:11:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:30 smithi170 ceph-mon[31212]: pgmap v7346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:30 smithi077 ceph-mon[27902]: pgmap v7346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:30 smithi191 ceph-mon[31636]: pgmap v7346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:32.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:32 smithi191 ceph-mon[31636]: pgmap v7347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:32.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:32 smithi170 ceph-mon[31212]: pgmap v7347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:32.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:32 smithi077 ceph-mon[27902]: pgmap v7347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:33.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13603.545877 secs 2024-04-21T14:11:33.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13603.545877 secs 2024-04-21T14:11:33.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13603.545877 secs 2024-04-21T14:11:34.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13605.306251 secs 2024-04-21T14:11:34.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:34 smithi191 ceph-mon[31636]: pgmap v7348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13605.306251 secs 2024-04-21T14:11:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:34 smithi170 ceph-mon[31212]: pgmap v7348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13605.306251 secs 2024-04-21T14:11:34.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:34 smithi077 ceph-mon[27902]: pgmap v7348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:35.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:36.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:36 smithi191 ceph-mon[31636]: pgmap v7349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:36.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:36 smithi170 ceph-mon[31212]: pgmap v7349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:36.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:36 smithi077 ceph-mon[27902]: pgmap v7349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:37.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13608.545998 secs 2024-04-21T14:11:37.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13608.545998 secs 2024-04-21T14:11:37.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13608.545998 secs 2024-04-21T14:11:38.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:38 smithi170 ceph-mon[31212]: pgmap v7350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:38.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:38 smithi077 ceph-mon[27902]: pgmap v7350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:38.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:38 smithi191 ceph-mon[31636]: pgmap v7350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:39.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13610.306363 secs 2024-04-21T14:11:39.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13610.306363 secs 2024-04-21T14:11:39.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13610.306363 secs 2024-04-21T14:11:40.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:40.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:40 smithi170 ceph-mon[31212]: pgmap v7351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:40.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:40 smithi077 ceph-mon[27902]: pgmap v7351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:40 smithi191 ceph-mon[31636]: pgmap v7351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:11:41.232+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:11:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:11:41.232+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:11:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:11:41.232+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:11:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:11:41.232+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:11:42.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:42 smithi191 ceph-mon[31636]: pgmap v7352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:42.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:42 smithi170 ceph-mon[31212]: pgmap v7352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:42.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:42 smithi077 ceph-mon[27902]: pgmap v7352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:43.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13613.546123 secs 2024-04-21T14:11:43.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13613.546123 secs 2024-04-21T14:11:43.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13613.546123 secs 2024-04-21T14:11:44.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13615.306481 secs 2024-04-21T14:11:44.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:44 smithi191 ceph-mon[31636]: pgmap v7353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:44.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13615.306481 secs 2024-04-21T14:11:44.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:44 smithi170 ceph-mon[31212]: pgmap v7353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13615.306481 secs 2024-04-21T14:11:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:44 smithi077 ceph-mon[27902]: pgmap v7353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:46.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:46 smithi191 ceph-mon[31636]: pgmap v7354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:46.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:46 smithi170 ceph-mon[31212]: pgmap v7354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:46.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:46 smithi077 ceph-mon[27902]: pgmap v7354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:47.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13618.546238 secs 2024-04-21T14:11:47.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13618.546238 secs 2024-04-21T14:11:47.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13618.546238 secs 2024-04-21T14:11:48.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:48 smithi170 ceph-mon[31212]: pgmap v7355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:48.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:48 smithi191 ceph-mon[31636]: pgmap v7355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:48.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:48 smithi077 ceph-mon[27902]: pgmap v7355: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:49.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13620.306624 secs 2024-04-21T14:11:49.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13620.306624 secs 2024-04-21T14:11:49.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13620.306624 secs 2024-04-21T14:11:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:50 smithi170 ceph-mon[31212]: pgmap v7356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:50 smithi077 ceph-mon[27902]: pgmap v7356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:50.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:50 smithi191 ceph-mon[31636]: pgmap v7356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:11:52.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:52 smithi191 ceph-mon[31636]: pgmap v7357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:52.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:52 smithi170 ceph-mon[31212]: pgmap v7357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:52.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:52 smithi077 ceph-mon[27902]: pgmap v7357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:53.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13623.546354 secs 2024-04-21T14:11:53.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13623.546354 secs 2024-04-21T14:11:53.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13623.546354 secs 2024-04-21T14:11:54.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13625.306764 secs 2024-04-21T14:11:54.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:54 smithi191 ceph-mon[31636]: pgmap v7358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:11:54.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13625.306764 secs 2024-04-21T14:11:54.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:54 smithi170 ceph-mon[31212]: pgmap v7358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:11:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13625.306764 secs 2024-04-21T14:11:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:54 smithi077 ceph-mon[27902]: pgmap v7358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:11:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:11:56.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:56 smithi191 ceph-mon[31636]: pgmap v7359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:56.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:56 smithi170 ceph-mon[31212]: pgmap v7359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:56.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:56 smithi077 ceph-mon[27902]: pgmap v7359: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:11:57.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13628.546467 secs 2024-04-21T14:11:57.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13628.546467 secs 2024-04-21T14:11:57.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13628.546467 secs 2024-04-21T14:11:58.767 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:11:58 smithi077 ceph-mon[27902]: pgmap v7360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:11:58.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:11:58 smithi170 ceph-mon[31212]: pgmap v7360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:11:58.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:11:58 smithi191 ceph-mon[31636]: pgmap v7360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:12:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:00.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13630.306888 secs 2024-04-21T14:12:00.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:00 smithi191 ceph-mon[31636]: pgmap v7361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:12:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13630.306888 secs 2024-04-21T14:12:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:00 smithi170 ceph-mon[31212]: pgmap v7361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:12:00.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13630.306888 secs 2024-04-21T14:12:00.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:00 smithi077 ceph-mon[27902]: pgmap v7361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:12:02.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:02 smithi191 ceph-mon[31636]: pgmap v7362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:02.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:02 smithi170 ceph-mon[31212]: pgmap v7362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:02.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:02 smithi077 ceph-mon[27902]: pgmap v7362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:03.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13633.546603 secs 2024-04-21T14:12:03.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13633.546603 secs 2024-04-21T14:12:03.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13633.546603 secs 2024-04-21T14:12:04.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13635.306987 secs 2024-04-21T14:12:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:04 smithi191 ceph-mon[31636]: pgmap v7363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13635.306987 secs 2024-04-21T14:12:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:04 smithi170 ceph-mon[31212]: pgmap v7363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13635.306987 secs 2024-04-21T14:12:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:04 smithi077 ceph-mon[27902]: pgmap v7363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:05.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:05 smithi191 ceph-mon[31636]: osdmap e531: 12 total, 12 up, 12 in 2024-04-21T14:12:05.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:05 smithi170 ceph-mon[31212]: osdmap e531: 12 total, 12 up, 12 in 2024-04-21T14:12:05.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:05 smithi077 ceph-mon[27902]: osdmap e531: 12 total, 12 up, 12 in 2024-04-21T14:12:06.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:06 smithi170 ceph-mon[31212]: pgmap v7365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:12:06.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:06 smithi077 ceph-mon[27902]: pgmap v7365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:12:06.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:06 smithi191 ceph-mon[31636]: pgmap v7365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:12:07.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13638.546736 secs 2024-04-21T14:12:07.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13638.546736 secs 2024-04-21T14:12:07.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13638.546736 secs 2024-04-21T14:12:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:08 smithi170 ceph-mon[31212]: pgmap v7366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:12:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:08 smithi077 ceph-mon[27902]: pgmap v7366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:12:08.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:08 smithi191 ceph-mon[31636]: pgmap v7366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:12:10.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13640.307050 secs 2024-04-21T14:12:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:10 smithi191 ceph-mon[31636]: osdmap e532: 12 total, 12 up, 12 in 2024-04-21T14:12:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:10 smithi191 ceph-mon[31636]: pgmap v7368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:12:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13640.307050 secs 2024-04-21T14:12:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:10 smithi170 ceph-mon[31212]: osdmap e532: 12 total, 12 up, 12 in 2024-04-21T14:12:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:10 smithi170 ceph-mon[31212]: pgmap v7368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:12:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13640.307050 secs 2024-04-21T14:12:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:10 smithi077 ceph-mon[27902]: osdmap e532: 12 total, 12 up, 12 in 2024-04-21T14:12:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:10 smithi077 ceph-mon[27902]: pgmap v7368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:12:12.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:12 smithi191 ceph-mon[31636]: pgmap v7369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:12:12.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:12 smithi170 ceph-mon[31212]: pgmap v7369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:12:12.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:12 smithi077 ceph-mon[27902]: pgmap v7369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:12:13.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13643.546835 secs 2024-04-21T14:12:13.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13643.546835 secs 2024-04-21T14:12:13.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13643.546835 secs 2024-04-21T14:12:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13645.307129 secs 2024-04-21T14:12:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:14 smithi191 ceph-mon[31636]: pgmap v7370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:12:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13645.307129 secs 2024-04-21T14:12:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:14 smithi170 ceph-mon[31212]: pgmap v7370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:12:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13645.307129 secs 2024-04-21T14:12:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:14 smithi077 ceph-mon[27902]: pgmap v7370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:12:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:16.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:16 smithi191 ceph-mon[31636]: pgmap v7371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:12:16.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:16 smithi170 ceph-mon[31212]: pgmap v7371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:12:16.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:16 smithi077 ceph-mon[27902]: pgmap v7371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:12:17.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13648.546954 secs 2024-04-21T14:12:17.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13648.546954 secs 2024-04-21T14:12:17.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13648.546954 secs 2024-04-21T14:12:18.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:18 smithi170 ceph-mon[31212]: pgmap v7372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:12:18.850 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:18 smithi191 ceph-mon[31636]: pgmap v7372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:12:18.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:18 smithi077 ceph-mon[27902]: pgmap v7372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:12:19.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13650.307204 secs 2024-04-21T14:12:19.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13650.307204 secs 2024-04-21T14:12:19.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13650.307204 secs 2024-04-21T14:12:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:20.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:20 smithi170 ceph-mon[31212]: pgmap v7373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:12:20.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:20 smithi077 ceph-mon[27902]: pgmap v7373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:12:20.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:20 smithi191 ceph-mon[31636]: pgmap v7373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:12:22.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:22 smithi191 ceph-mon[31636]: pgmap v7374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:12:22.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:22 smithi170 ceph-mon[31212]: pgmap v7374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:12:22.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:22 smithi077 ceph-mon[27902]: pgmap v7374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:12:23.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13653.547070 secs 2024-04-21T14:12:23.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13653.547070 secs 2024-04-21T14:12:23.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13653.547070 secs 2024-04-21T14:12:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13655.307287 secs 2024-04-21T14:12:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:24 smithi170 ceph-mon[31212]: pgmap v7375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:24.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13655.307287 secs 2024-04-21T14:12:24.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:24 smithi077 ceph-mon[27902]: pgmap v7375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:24.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13655.307287 secs 2024-04-21T14:12:24.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:24 smithi191 ceph-mon[31636]: pgmap v7375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:25.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:12:25.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:12:25.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:12:26.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:26 smithi170 ceph-mon[31212]: pgmap v7376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:26.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:12:26.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:12:26.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:12:26.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:26 smithi077 ceph-mon[27902]: pgmap v7376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:26.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:12:26.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:12:26.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:12:26.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:26 smithi191 ceph-mon[31636]: pgmap v7376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:26.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:12:26.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:12:26.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:12:27.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13658.547176 secs 2024-04-21T14:12:27.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13658.547176 secs 2024-04-21T14:12:27.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13658.547176 secs 2024-04-21T14:12:28.767 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:28 smithi077 ceph-mon[27902]: pgmap v7377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:28 smithi170 ceph-mon[31212]: pgmap v7377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:28.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:28 smithi191 ceph-mon[31636]: pgmap v7377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:29.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13660.307363 secs 2024-04-21T14:12:29.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13660.307363 secs 2024-04-21T14:12:29.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13660.307363 secs 2024-04-21T14:12:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:30.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:30 smithi170 ceph-mon[31212]: pgmap v7378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:30 smithi077 ceph-mon[27902]: pgmap v7378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:30 smithi191 ceph-mon[31636]: pgmap v7378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:32.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:32 smithi191 ceph-mon[31636]: pgmap v7379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:32.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:32 smithi170 ceph-mon[31212]: pgmap v7379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:32.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:32 smithi077 ceph-mon[27902]: pgmap v7379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:33.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13663.547293 secs 2024-04-21T14:12:33.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13663.547293 secs 2024-04-21T14:12:33.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13663.547293 secs 2024-04-21T14:12:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13665.307485 secs 2024-04-21T14:12:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:34 smithi170 ceph-mon[31212]: pgmap v7380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13665.307485 secs 2024-04-21T14:12:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:34 smithi077 ceph-mon[27902]: pgmap v7380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:34.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13665.307485 secs 2024-04-21T14:12:34.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:34 smithi191 ceph-mon[31636]: pgmap v7380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:36.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:36 smithi191 ceph-mon[31636]: pgmap v7381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:36.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:36 smithi170 ceph-mon[31212]: pgmap v7381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:36.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:36 smithi077 ceph-mon[27902]: pgmap v7381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:37.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13668.547412 secs 2024-04-21T14:12:37.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13668.547412 secs 2024-04-21T14:12:37.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13668.547412 secs 2024-04-21T14:12:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:38 smithi170 ceph-mon[31212]: pgmap v7382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:38.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:38 smithi077 ceph-mon[27902]: pgmap v7382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:38.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:38 smithi191 ceph-mon[31636]: pgmap v7382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:39.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13670.307596 secs 2024-04-21T14:12:39.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13670.307596 secs 2024-04-21T14:12:39.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13670.307596 secs 2024-04-21T14:12:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:40 smithi170 ceph-mon[31212]: pgmap v7383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:40.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:40 smithi077 ceph-mon[27902]: pgmap v7383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:40 smithi191 ceph-mon[31636]: pgmap v7383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:42.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:42 smithi191 ceph-mon[31636]: pgmap v7384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:42.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:42 smithi170 ceph-mon[31212]: pgmap v7384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:42.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:42 smithi077 ceph-mon[27902]: pgmap v7384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:43.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13673.547528 secs 2024-04-21T14:12:43.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13673.547528 secs 2024-04-21T14:12:43.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13673.547528 secs 2024-04-21T14:12:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13675.307713 secs 2024-04-21T14:12:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:44 smithi170 ceph-mon[31212]: pgmap v7385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13675.307713 secs 2024-04-21T14:12:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:44 smithi077 ceph-mon[27902]: pgmap v7385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:44.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13675.307713 secs 2024-04-21T14:12:44.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:44 smithi191 ceph-mon[31636]: pgmap v7385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:46.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:46 smithi191 ceph-mon[31636]: pgmap v7386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:46.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:46 smithi170 ceph-mon[31212]: pgmap v7386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:46.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:46 smithi077 ceph-mon[27902]: pgmap v7386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:47.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13678.547593 secs 2024-04-21T14:12:47.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13678.547593 secs 2024-04-21T14:12:47.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13678.547593 secs 2024-04-21T14:12:48.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:48 smithi170 ceph-mon[31212]: pgmap v7387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:48.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:48 smithi191 ceph-mon[31636]: pgmap v7387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:48.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:48 smithi077 ceph-mon[27902]: pgmap v7387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:49.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13680.307826 secs 2024-04-21T14:12:49.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13680.307826 secs 2024-04-21T14:12:49.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13680.307826 secs 2024-04-21T14:12:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:50 smithi170 ceph-mon[31212]: pgmap v7388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:50 smithi077 ceph-mon[27902]: pgmap v7388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:50.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:50 smithi191 ceph-mon[31636]: pgmap v7388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:52.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:52 smithi191 ceph-mon[31636]: pgmap v7389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:52.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:52 smithi170 ceph-mon[31212]: pgmap v7389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:52.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:52 smithi077 ceph-mon[27902]: pgmap v7389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:53.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13683.547707 secs 2024-04-21T14:12:53.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13683.547707 secs 2024-04-21T14:12:53.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13683.547707 secs 2024-04-21T14:12:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13685.307952 secs 2024-04-21T14:12:54.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:54 smithi170 ceph-mon[31212]: pgmap v7390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13685.307952 secs 2024-04-21T14:12:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:54 smithi077 ceph-mon[27902]: pgmap v7390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:54.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13685.307952 secs 2024-04-21T14:12:54.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:54 smithi191 ceph-mon[31636]: pgmap v7390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:12:56.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:56 smithi170 ceph-mon[31212]: pgmap v7391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:56.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:56 smithi077 ceph-mon[27902]: pgmap v7391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:56.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:56 smithi191 ceph-mon[31636]: pgmap v7391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:12:57.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13688.547804 secs 2024-04-21T14:12:57.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13688.547804 secs 2024-04-21T14:12:57.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13688.547804 secs 2024-04-21T14:12:58.766 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:58 smithi077 ceph-mon[27902]: pgmap v7392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:58.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:58 smithi170 ceph-mon[31212]: pgmap v7392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:58.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:58 smithi191 ceph-mon[31636]: pgmap v7392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:12:59.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:12:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13690.308106 secs 2024-04-21T14:12:59.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:12:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13690.308106 secs 2024-04-21T14:12:59.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:12:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13690.308106 secs 2024-04-21T14:13:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:00.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:00 smithi170 ceph-mon[31212]: pgmap v7393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:00.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:00 smithi077 ceph-mon[27902]: pgmap v7393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:00.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:00 smithi191 ceph-mon[31636]: pgmap v7393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:02.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:02 smithi170 ceph-mon[31212]: pgmap v7394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:02.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:02 smithi077 ceph-mon[27902]: pgmap v7394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:02.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:02 smithi191 ceph-mon[31636]: pgmap v7394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13693.547887 secs 2024-04-21T14:13:03.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13693.547887 secs 2024-04-21T14:13:03.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13693.547887 secs 2024-04-21T14:13:04.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13695.308232 secs 2024-04-21T14:13:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:04 smithi170 ceph-mon[31212]: pgmap v7395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13695.308232 secs 2024-04-21T14:13:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:04 smithi077 ceph-mon[27902]: pgmap v7395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:04.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13695.308232 secs 2024-04-21T14:13:04.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:04 smithi191 ceph-mon[31636]: pgmap v7395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:05.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:05 smithi170 ceph-mon[31212]: osdmap e533: 12 total, 12 up, 12 in 2024-04-21T14:13:05.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:05 smithi077 ceph-mon[27902]: osdmap e533: 12 total, 12 up, 12 in 2024-04-21T14:13:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:05 smithi191 ceph-mon[31636]: osdmap e533: 12 total, 12 up, 12 in 2024-04-21T14:13:06.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:06 smithi170 ceph-mon[31212]: pgmap v7397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:13:06.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:06 smithi077 ceph-mon[27902]: pgmap v7397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:13:06.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:06 smithi191 ceph-mon[31636]: pgmap v7397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:13:07.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13698.547946 secs 2024-04-21T14:13:07.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13698.547946 secs 2024-04-21T14:13:07.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13698.547946 secs 2024-04-21T14:13:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:08 smithi170 ceph-mon[31212]: pgmap v7398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:13:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:08 smithi077 ceph-mon[27902]: pgmap v7398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:13:08.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:08 smithi191 ceph-mon[31636]: pgmap v7398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:13:10.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13700.308356 secs 2024-04-21T14:13:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:10 smithi191 ceph-mon[31636]: osdmap e534: 12 total, 12 up, 12 in 2024-04-21T14:13:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:10 smithi191 ceph-mon[31636]: pgmap v7400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:13:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13700.308356 secs 2024-04-21T14:13:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:10 smithi170 ceph-mon[31212]: osdmap e534: 12 total, 12 up, 12 in 2024-04-21T14:13:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:10 smithi170 ceph-mon[31212]: pgmap v7400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:13:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13700.308356 secs 2024-04-21T14:13:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:10 smithi077 ceph-mon[27902]: osdmap e534: 12 total, 12 up, 12 in 2024-04-21T14:13:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:10 smithi077 ceph-mon[27902]: pgmap v7400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:13:12.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:12 smithi170 ceph-mon[31212]: pgmap v7401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:13:12.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:12 smithi077 ceph-mon[27902]: pgmap v7401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:13:12.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:12 smithi191 ceph-mon[31636]: pgmap v7401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:13:13.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13703.548024 secs 2024-04-21T14:13:13.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13703.548024 secs 2024-04-21T14:13:13.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13703.548024 secs 2024-04-21T14:13:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13705.308478 secs 2024-04-21T14:13:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:14 smithi170 ceph-mon[31212]: pgmap v7402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:13:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13705.308478 secs 2024-04-21T14:13:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:14 smithi077 ceph-mon[27902]: pgmap v7402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:13:14.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13705.308478 secs 2024-04-21T14:13:14.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:14 smithi191 ceph-mon[31636]: pgmap v7402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:13:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:16.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:16 smithi170 ceph-mon[31212]: pgmap v7403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:13:16.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:16 smithi077 ceph-mon[27902]: pgmap v7403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:13:16.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:16 smithi191 ceph-mon[31636]: pgmap v7403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:13:17.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13708.548098 secs 2024-04-21T14:13:17.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13708.548098 secs 2024-04-21T14:13:17.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13708.548098 secs 2024-04-21T14:13:18.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:18 smithi170 ceph-mon[31212]: pgmap v7404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:13:18.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:18 smithi191 ceph-mon[31636]: pgmap v7404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:13:18.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:18 smithi077 ceph-mon[27902]: pgmap v7404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T14:13:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:20.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13710.308611 secs 2024-04-21T14:13:20.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:20 smithi191 ceph-mon[31636]: pgmap v7405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:13:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13710.308611 secs 2024-04-21T14:13:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:20 smithi170 ceph-mon[31212]: pgmap v7405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:13:20.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13710.308611 secs 2024-04-21T14:13:20.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:20 smithi077 ceph-mon[27902]: pgmap v7405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:13:22.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:22 smithi170 ceph-mon[31212]: pgmap v7406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:13:22.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:22 smithi077 ceph-mon[27902]: pgmap v7406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:13:22.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:22 smithi191 ceph-mon[31636]: pgmap v7406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:13:23.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13713.548213 secs 2024-04-21T14:13:23.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13713.548213 secs 2024-04-21T14:13:23.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13713.548213 secs 2024-04-21T14:13:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13715.308750 secs 2024-04-21T14:13:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:24 smithi170 ceph-mon[31212]: pgmap v7407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:13:24.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13715.308750 secs 2024-04-21T14:13:24.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:24 smithi077 ceph-mon[27902]: pgmap v7407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:13:24.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13715.308750 secs 2024-04-21T14:13:24.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:24 smithi191 ceph-mon[31636]: pgmap v7407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:13:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:26.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:26 smithi170 ceph-mon[31212]: pgmap v7408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:26.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:26 smithi077 ceph-mon[27902]: pgmap v7408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:26.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:26 smithi191 ceph-mon[31636]: pgmap v7408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:27.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:13:27.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:13:27.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:13:27.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:13:27.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:13:27.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:13:27.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:13:27.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:13:27.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:13:27.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:13:27.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:13:27.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:13:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13718.548277 secs 2024-04-21T14:13:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:28 smithi077 ceph-mon[27902]: pgmap v7409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13718.548277 secs 2024-04-21T14:13:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:28 smithi170 ceph-mon[31212]: pgmap v7409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13718.548277 secs 2024-04-21T14:13:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:28 smithi191 ceph-mon[31636]: pgmap v7409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:29.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13720.308889 secs 2024-04-21T14:13:29.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13720.308889 secs 2024-04-21T14:13:29.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13720.308889 secs 2024-04-21T14:13:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:30.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:30 smithi170 ceph-mon[31212]: pgmap v7410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:30.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:30 smithi077 ceph-mon[27902]: pgmap v7410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:30.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:30 smithi191 ceph-mon[31636]: pgmap v7410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:32.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:32 smithi170 ceph-mon[31212]: pgmap v7411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:32.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:32 smithi077 ceph-mon[27902]: pgmap v7411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:32.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:32 smithi191 ceph-mon[31636]: pgmap v7411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:33.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13723.548398 secs 2024-04-21T14:13:33.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13723.548398 secs 2024-04-21T14:13:33.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13723.548398 secs 2024-04-21T14:13:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13725.308956 secs 2024-04-21T14:13:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:34 smithi170 ceph-mon[31212]: pgmap v7412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13725.308956 secs 2024-04-21T14:13:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:34 smithi077 ceph-mon[27902]: pgmap v7412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:34.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13725.308956 secs 2024-04-21T14:13:34.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:34 smithi191 ceph-mon[31636]: pgmap v7412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:36.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:36 smithi170 ceph-mon[31212]: pgmap v7413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:36.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:36 smithi077 ceph-mon[27902]: pgmap v7413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:36.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:36 smithi191 ceph-mon[31636]: pgmap v7413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:37.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13728.548519 secs 2024-04-21T14:13:37.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13728.548519 secs 2024-04-21T14:13:37.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13728.548519 secs 2024-04-21T14:13:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:38 smithi170 ceph-mon[31212]: pgmap v7414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:38.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:38 smithi077 ceph-mon[27902]: pgmap v7414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:38.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:38 smithi191 ceph-mon[31636]: pgmap v7414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:39.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13730.309088 secs 2024-04-21T14:13:39.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13730.309088 secs 2024-04-21T14:13:39.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13730.309088 secs 2024-04-21T14:13:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:40 smithi170 ceph-mon[31212]: pgmap v7415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:40.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:40 smithi077 ceph-mon[27902]: pgmap v7415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:40 smithi191 ceph-mon[31636]: pgmap v7415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:42.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:42 smithi170 ceph-mon[31212]: pgmap v7416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:42.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:42 smithi077 ceph-mon[27902]: pgmap v7416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:42.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:42 smithi191 ceph-mon[31636]: pgmap v7416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:43.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13733.548640 secs 2024-04-21T14:13:43.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13733.548640 secs 2024-04-21T14:13:43.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13733.548640 secs 2024-04-21T14:13:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13735.309172 secs 2024-04-21T14:13:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:44 smithi170 ceph-mon[31212]: pgmap v7417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:44.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13735.309172 secs 2024-04-21T14:13:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:44 smithi077 ceph-mon[27902]: pgmap v7417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:44.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13735.309172 secs 2024-04-21T14:13:44.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:44 smithi191 ceph-mon[31636]: pgmap v7417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:46.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:46 smithi170 ceph-mon[31212]: pgmap v7418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:46.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:46 smithi077 ceph-mon[27902]: pgmap v7418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:46.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:46 smithi191 ceph-mon[31636]: pgmap v7418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:47.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13738.548757 secs 2024-04-21T14:13:47.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13738.548757 secs 2024-04-21T14:13:47.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13738.548757 secs 2024-04-21T14:13:48.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:48 smithi170 ceph-mon[31212]: pgmap v7419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:48.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:48 smithi191 ceph-mon[31636]: pgmap v7419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:48.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:48 smithi077 ceph-mon[27902]: pgmap v7419: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:49.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13740.309286 secs 2024-04-21T14:13:49.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13740.309286 secs 2024-04-21T14:13:49.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13740.309286 secs 2024-04-21T14:13:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:50 smithi170 ceph-mon[31212]: pgmap v7420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:50 smithi077 ceph-mon[27902]: pgmap v7420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:50.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:50 smithi191 ceph-mon[31636]: pgmap v7420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:52.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:52 smithi170 ceph-mon[31212]: pgmap v7421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:52.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:52 smithi077 ceph-mon[27902]: pgmap v7421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:52.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:52 smithi191 ceph-mon[31636]: pgmap v7421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:53.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13743.548897 secs 2024-04-21T14:13:53.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13743.548897 secs 2024-04-21T14:13:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13743.548897 secs 2024-04-21T14:13:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.429+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T14:13:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.429+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T14:13:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:13:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T14:13:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:13:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T14:13:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.430+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T14:13:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7005c040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7005c040 comp rx=0 tx=0).stop 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.438+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:13:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:54.439+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bc0 tx=0x7efd7001f000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T14:13:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13745.309401 secs 2024-04-21T14:13:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:54 smithi170 ceph-mon[31212]: pgmap v7422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13745.309401 secs 2024-04-21T14:13:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:54 smithi077 ceph-mon[27902]: pgmap v7422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:54.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13745.309401 secs 2024-04-21T14:13:54.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:54 smithi191 ceph-mon[31636]: pgmap v7422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:13:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:56.249+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:13:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:56.249+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:13:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:56.250+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:13:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:13:56.250+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:13:56.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:56 smithi170 ceph-mon[31212]: pgmap v7423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:56.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:56 smithi077 ceph-mon[27902]: pgmap v7423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:56.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:56 smithi191 ceph-mon[31636]: pgmap v7423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:13:57.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13748.549009 secs 2024-04-21T14:13:57.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13748.549009 secs 2024-04-21T14:13:57.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13748.549009 secs 2024-04-21T14:13:58.765 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:58 smithi077 ceph-mon[27902]: pgmap v7424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:58.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:58 smithi170 ceph-mon[31212]: pgmap v7424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:58.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:58 smithi191 ceph-mon[31636]: pgmap v7424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:13:59.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13750.309510 secs 2024-04-21T14:13:59.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13750.309510 secs 2024-04-21T14:13:59.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13750.309510 secs 2024-04-21T14:14:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:00.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:00 smithi170 ceph-mon[31212]: pgmap v7425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:00.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:00 smithi077 ceph-mon[27902]: pgmap v7425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:00.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:00 smithi191 ceph-mon[31636]: pgmap v7425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:02.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:02 smithi170 ceph-mon[31212]: pgmap v7426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:02.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:02 smithi077 ceph-mon[27902]: pgmap v7426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:02.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:02 smithi191 ceph-mon[31636]: pgmap v7426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:03.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13753.549126 secs 2024-04-21T14:14:03.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13753.549126 secs 2024-04-21T14:14:03.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13753.549126 secs 2024-04-21T14:14:04.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13755.309626 secs 2024-04-21T14:14:04.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:04 smithi170 ceph-mon[31212]: pgmap v7427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:04.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13755.309626 secs 2024-04-21T14:14:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:04 smithi077 ceph-mon[27902]: pgmap v7427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:04.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13755.309626 secs 2024-04-21T14:14:04.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:04 smithi191 ceph-mon[31636]: pgmap v7427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:05.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:05 smithi170 ceph-mon[31212]: osdmap e535: 12 total, 12 up, 12 in 2024-04-21T14:14:05.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:05 smithi077 ceph-mon[27902]: osdmap e535: 12 total, 12 up, 12 in 2024-04-21T14:14:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:05 smithi191 ceph-mon[31636]: osdmap e535: 12 total, 12 up, 12 in 2024-04-21T14:14:06.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:06 smithi170 ceph-mon[31212]: pgmap v7429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:14:06.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:06 smithi077 ceph-mon[27902]: pgmap v7429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:14:06.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:06 smithi191 ceph-mon[31636]: pgmap v7429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:14:07.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13758.549260 secs 2024-04-21T14:14:07.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13758.549260 secs 2024-04-21T14:14:07.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13758.549260 secs 2024-04-21T14:14:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:08 smithi170 ceph-mon[31212]: pgmap v7430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:14:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:08 smithi077 ceph-mon[27902]: pgmap v7430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:14:08.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:08 smithi191 ceph-mon[31636]: pgmap v7430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:14:10.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:10.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13760.309760 secs 2024-04-21T14:14:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:10 smithi191 ceph-mon[31636]: osdmap e536: 12 total, 12 up, 12 in 2024-04-21T14:14:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:10 smithi191 ceph-mon[31636]: pgmap v7432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:14:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13760.309760 secs 2024-04-21T14:14:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:10 smithi170 ceph-mon[31212]: osdmap e536: 12 total, 12 up, 12 in 2024-04-21T14:14:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:10 smithi170 ceph-mon[31212]: pgmap v7432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:14:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13760.309760 secs 2024-04-21T14:14:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:10 smithi077 ceph-mon[27902]: osdmap e536: 12 total, 12 up, 12 in 2024-04-21T14:14:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:10 smithi077 ceph-mon[27902]: pgmap v7432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:14:12.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:12 smithi170 ceph-mon[31212]: pgmap v7433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:14:12.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:12 smithi077 ceph-mon[27902]: pgmap v7433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:14:12.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:12 smithi191 ceph-mon[31636]: pgmap v7433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:14:13.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13763.549371 secs 2024-04-21T14:14:13.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13763.549371 secs 2024-04-21T14:14:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13763.549371 secs 2024-04-21T14:14:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13765.309890 secs 2024-04-21T14:14:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:14 smithi170 ceph-mon[31212]: pgmap v7434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:14:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13765.309890 secs 2024-04-21T14:14:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:14 smithi077 ceph-mon[27902]: pgmap v7434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:14:14.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13765.309890 secs 2024-04-21T14:14:14.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:14 smithi191 ceph-mon[31636]: pgmap v7434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:14:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:16.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:16 smithi170 ceph-mon[31212]: pgmap v7435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:14:16.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:16 smithi077 ceph-mon[27902]: pgmap v7435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:14:16.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:16 smithi191 ceph-mon[31636]: pgmap v7435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:14:17.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13768.549485 secs 2024-04-21T14:14:17.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13768.549485 secs 2024-04-21T14:14:17.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13768.549485 secs 2024-04-21T14:14:18.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:18 smithi170 ceph-mon[31212]: pgmap v7436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:14:18.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:18 smithi191 ceph-mon[31636]: pgmap v7436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:14:18.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:18 smithi077 ceph-mon[27902]: pgmap v7436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:14:19.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13770.310036 secs 2024-04-21T14:14:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13770.310036 secs 2024-04-21T14:14:19.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13770.310036 secs 2024-04-21T14:14:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:20.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:20 smithi170 ceph-mon[31212]: pgmap v7437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:14:20.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:20 smithi077 ceph-mon[27902]: pgmap v7437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:14:20.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:20 smithi191 ceph-mon[31636]: pgmap v7437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:14:22.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:22 smithi170 ceph-mon[31212]: pgmap v7438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:14:22.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:22 smithi077 ceph-mon[27902]: pgmap v7438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:14:22.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:22 smithi191 ceph-mon[31636]: pgmap v7438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:14:23.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13773.549603 secs 2024-04-21T14:14:23.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13773.549603 secs 2024-04-21T14:14:23.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13773.549603 secs 2024-04-21T14:14:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13775.310156 secs 2024-04-21T14:14:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:24 smithi170 ceph-mon[31212]: pgmap v7439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:24.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13775.310156 secs 2024-04-21T14:14:24.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:24 smithi077 ceph-mon[27902]: pgmap v7439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13775.310156 secs 2024-04-21T14:14:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:24 smithi191 ceph-mon[31636]: pgmap v7439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:26.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:26 smithi170 ceph-mon[31212]: pgmap v7440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:26.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:26 smithi077 ceph-mon[27902]: pgmap v7440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:26.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:26 smithi191 ceph-mon[31636]: pgmap v7440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:27.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:14:27.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:14:27.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:14:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13778.549690 secs 2024-04-21T14:14:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:14:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:14:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:14:28.516 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:28 smithi077 ceph-mon[27902]: pgmap v7441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13778.549690 secs 2024-04-21T14:14:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:14:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:14:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:14:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:28 smithi170 ceph-mon[31212]: pgmap v7441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:28.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13778.549690 secs 2024-04-21T14:14:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:14:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:14:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:14:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:28 smithi191 ceph-mon[31636]: pgmap v7441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:29.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13780.310270 secs 2024-04-21T14:14:30.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13780.310270 secs 2024-04-21T14:14:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:30.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13780.310270 secs 2024-04-21T14:14:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:30 smithi191 ceph-mon[31636]: pgmap v7442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:30 smithi170 ceph-mon[31212]: pgmap v7442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:31.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:30 smithi077 ceph-mon[27902]: pgmap v7442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:32.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:32 smithi170 ceph-mon[31212]: pgmap v7443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:32.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:32 smithi077 ceph-mon[27902]: pgmap v7443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:32.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:32 smithi191 ceph-mon[31636]: pgmap v7443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:33.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13783.549829 secs 2024-04-21T14:14:33.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13783.549829 secs 2024-04-21T14:14:33.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13783.549829 secs 2024-04-21T14:14:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13785.310409 secs 2024-04-21T14:14:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:34 smithi170 ceph-mon[31212]: pgmap v7444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13785.310409 secs 2024-04-21T14:14:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:34 smithi077 ceph-mon[27902]: pgmap v7444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13785.310409 secs 2024-04-21T14:14:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:34 smithi191 ceph-mon[31636]: pgmap v7444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:36.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:36 smithi170 ceph-mon[31212]: pgmap v7445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:36.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:36 smithi077 ceph-mon[27902]: pgmap v7445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:36.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:36 smithi191 ceph-mon[31636]: pgmap v7445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:37.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13788.549891 secs 2024-04-21T14:14:37.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13788.549891 secs 2024-04-21T14:14:37.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13788.549891 secs 2024-04-21T14:14:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:38 smithi170 ceph-mon[31212]: pgmap v7446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:38.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:38 smithi077 ceph-mon[27902]: pgmap v7446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:38.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:38 smithi191 ceph-mon[31636]: pgmap v7446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:39.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13790.310544 secs 2024-04-21T14:14:39.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13790.310544 secs 2024-04-21T14:14:39.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13790.310544 secs 2024-04-21T14:14:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:40 smithi170 ceph-mon[31212]: pgmap v7447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:40.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:40 smithi077 ceph-mon[27902]: pgmap v7447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:40 smithi191 ceph-mon[31636]: pgmap v7447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:42.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:42 smithi170 ceph-mon[31212]: pgmap v7448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:42.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:42 smithi077 ceph-mon[27902]: pgmap v7448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:42.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:42 smithi191 ceph-mon[31636]: pgmap v7448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:43.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13793.550005 secs 2024-04-21T14:14:43.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13793.550005 secs 2024-04-21T14:14:43.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13793.550005 secs 2024-04-21T14:14:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13795.310648 secs 2024-04-21T14:14:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:44 smithi170 ceph-mon[31212]: pgmap v7449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:44.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13795.310648 secs 2024-04-21T14:14:44.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:44 smithi077 ceph-mon[27902]: pgmap v7449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13795.310648 secs 2024-04-21T14:14:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:44 smithi191 ceph-mon[31636]: pgmap v7449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:46.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:46 smithi170 ceph-mon[31212]: pgmap v7450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:46.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:46 smithi077 ceph-mon[27902]: pgmap v7450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:46.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:46 smithi191 ceph-mon[31636]: pgmap v7450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:47.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13798.550114 secs 2024-04-21T14:14:47.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13798.550114 secs 2024-04-21T14:14:47.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13798.550114 secs 2024-04-21T14:14:48.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:48 smithi170 ceph-mon[31212]: pgmap v7451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:48.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:48 smithi191 ceph-mon[31636]: pgmap v7451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:48.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:48 smithi077 ceph-mon[27902]: pgmap v7451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13800.310778 secs 2024-04-21T14:14:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:50 smithi170 ceph-mon[31212]: pgmap v7452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13800.310778 secs 2024-04-21T14:14:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:50 smithi077 ceph-mon[27902]: pgmap v7452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13800.310778 secs 2024-04-21T14:14:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:50 smithi191 ceph-mon[31636]: pgmap v7452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:52.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:52 smithi170 ceph-mon[31212]: pgmap v7453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:52.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:52 smithi077 ceph-mon[27902]: pgmap v7453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:52.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:52 smithi191 ceph-mon[31636]: pgmap v7453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:53.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13803.550229 secs 2024-04-21T14:14:53.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13803.550229 secs 2024-04-21T14:14:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13803.550229 secs 2024-04-21T14:14:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13805.310897 secs 2024-04-21T14:14:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:54 smithi170 ceph-mon[31212]: pgmap v7454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13805.310897 secs 2024-04-21T14:14:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:54 smithi077 ceph-mon[27902]: pgmap v7454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:54.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13805.310897 secs 2024-04-21T14:14:54.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:54 smithi191 ceph-mon[31636]: pgmap v7454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:14:56.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:56 smithi170 ceph-mon[31212]: pgmap v7455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:56.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:56 smithi077 ceph-mon[27902]: pgmap v7455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:56.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:56 smithi191 ceph-mon[31636]: pgmap v7455: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:14:57.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13808.550295 secs 2024-04-21T14:14:57.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13808.550295 secs 2024-04-21T14:14:57.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13808.550295 secs 2024-04-21T14:14:58.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:58 smithi170 ceph-mon[31212]: pgmap v7456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:58.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:58 smithi077 ceph-mon[27902]: pgmap v7456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:58.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:58 smithi191 ceph-mon[31636]: pgmap v7456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:14:59.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13810.310958 secs 2024-04-21T14:14:59.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13810.310958 secs 2024-04-21T14:14:59.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13810.310958 secs 2024-04-21T14:15:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 13995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:00.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:00 smithi170 ceph-mon[31212]: pgmap v7457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:00.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:00 smithi077 ceph-mon[27902]: pgmap v7457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:00.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:00 smithi191 ceph-mon[31636]: pgmap v7457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:02.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:02 smithi170 ceph-mon[31212]: pgmap v7458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:02.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:02 smithi077 ceph-mon[27902]: pgmap v7458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:02.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:02 smithi191 ceph-mon[31636]: pgmap v7458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:03.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13813.550415 secs 2024-04-21T14:15:03.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13813.550415 secs 2024-04-21T14:15:03.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13813.550415 secs 2024-04-21T14:15:04.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13815.311083 secs 2024-04-21T14:15:04.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:04 smithi170 ceph-mon[31212]: pgmap v7459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:04.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13815.311083 secs 2024-04-21T14:15:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:04 smithi077 ceph-mon[27902]: pgmap v7459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:04.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13815.311083 secs 2024-04-21T14:15:04.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:04 smithi191 ceph-mon[31636]: pgmap v7459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:05.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:05 smithi170 ceph-mon[31212]: osdmap e537: 12 total, 12 up, 12 in 2024-04-21T14:15:05.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:05 smithi077 ceph-mon[27902]: osdmap e537: 12 total, 12 up, 12 in 2024-04-21T14:15:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:05 smithi191 ceph-mon[31636]: osdmap e537: 12 total, 12 up, 12 in 2024-04-21T14:15:06.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:06 smithi170 ceph-mon[31212]: pgmap v7461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:15:06.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:06 smithi077 ceph-mon[27902]: pgmap v7461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:15:06.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:06 smithi191 ceph-mon[31636]: pgmap v7461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:15:07.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13818.550545 secs 2024-04-21T14:15:07.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13818.550545 secs 2024-04-21T14:15:07.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13818.550545 secs 2024-04-21T14:15:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:08 smithi170 ceph-mon[31212]: pgmap v7462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:15:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:08 smithi077 ceph-mon[27902]: pgmap v7462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:15:08.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:08 smithi191 ceph-mon[31636]: pgmap v7462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:15:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:10.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13820.311195 secs 2024-04-21T14:15:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:10 smithi170 ceph-mon[31212]: osdmap e538: 12 total, 12 up, 12 in 2024-04-21T14:15:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:10 smithi170 ceph-mon[31212]: pgmap v7464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:15:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13820.311195 secs 2024-04-21T14:15:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:10 smithi077 ceph-mon[27902]: osdmap e538: 12 total, 12 up, 12 in 2024-04-21T14:15:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:10 smithi077 ceph-mon[27902]: pgmap v7464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:15:10.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13820.311195 secs 2024-04-21T14:15:10.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:10 smithi191 ceph-mon[31636]: osdmap e538: 12 total, 12 up, 12 in 2024-04-21T14:15:10.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:10 smithi191 ceph-mon[31636]: pgmap v7464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T14:15:12.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:12 smithi170 ceph-mon[31212]: pgmap v7465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:15:12.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:12 smithi077 ceph-mon[27902]: pgmap v7465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:15:12.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:12 smithi191 ceph-mon[31636]: pgmap v7465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:15:13.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13823.550659 secs 2024-04-21T14:15:13.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13823.550659 secs 2024-04-21T14:15:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13823.550659 secs 2024-04-21T14:15:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13825.311319 secs 2024-04-21T14:15:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:14 smithi170 ceph-mon[31212]: pgmap v7466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:15:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13825.311319 secs 2024-04-21T14:15:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:14 smithi077 ceph-mon[27902]: pgmap v7466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:15:14.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13825.311319 secs 2024-04-21T14:15:14.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:14 smithi191 ceph-mon[31636]: pgmap v7466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:15:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:16.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:16 smithi170 ceph-mon[31212]: pgmap v7467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:15:16.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:16 smithi077 ceph-mon[27902]: pgmap v7467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:15:16.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:16 smithi191 ceph-mon[31636]: pgmap v7467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:15:17.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13828.550793 secs 2024-04-21T14:15:17.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13828.550793 secs 2024-04-21T14:15:17.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13828.550793 secs 2024-04-21T14:15:18.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:18 smithi170 ceph-mon[31212]: pgmap v7468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:15:18.853 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:18 smithi191 ceph-mon[31636]: pgmap v7468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:15:18.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:18 smithi077 ceph-mon[27902]: pgmap v7468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:15:19.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13830.311381 secs 2024-04-21T14:15:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13830.311381 secs 2024-04-21T14:15:19.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13830.311381 secs 2024-04-21T14:15:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:20.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:20 smithi170 ceph-mon[31212]: pgmap v7469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:15:20.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:20 smithi077 ceph-mon[27902]: pgmap v7469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:15:20.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:20 smithi191 ceph-mon[31636]: pgmap v7469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T14:15:22.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:22 smithi170 ceph-mon[31212]: pgmap v7470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:15:22.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:22 smithi077 ceph-mon[27902]: pgmap v7470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:15:22.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:22 smithi191 ceph-mon[31636]: pgmap v7470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:15:23.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13833.550886 secs 2024-04-21T14:15:23.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13833.550886 secs 2024-04-21T14:15:23.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13833.550886 secs 2024-04-21T14:15:24.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13835.311521 secs 2024-04-21T14:15:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:24 smithi170 ceph-mon[31212]: pgmap v7471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:24.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13835.311521 secs 2024-04-21T14:15:24.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:24 smithi077 ceph-mon[27902]: pgmap v7471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13835.311521 secs 2024-04-21T14:15:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:24 smithi191 ceph-mon[31636]: pgmap v7471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:26.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:26 smithi170 ceph-mon[31212]: pgmap v7472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:26.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:26 smithi077 ceph-mon[27902]: pgmap v7472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:26.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:26 smithi191 ceph-mon[31636]: pgmap v7472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:27.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13838.550996 secs 2024-04-21T14:15:27.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13838.550996 secs 2024-04-21T14:15:27.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13838.550996 secs 2024-04-21T14:15:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:15:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:28 smithi170 ceph-mon[31212]: pgmap v7473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:15:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:15:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:15:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:15:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:28 smithi077 ceph-mon[27902]: pgmap v7473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:15:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:15:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:15:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:15:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:28 smithi191 ceph-mon[31636]: pgmap v7473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:15:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:15:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:15:29.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13840.311627 secs 2024-04-21T14:15:29.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13840.311627 secs 2024-04-21T14:15:29.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13840.311627 secs 2024-04-21T14:15:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:30.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:30 smithi170 ceph-mon[31212]: pgmap v7474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:30 smithi077 ceph-mon[27902]: pgmap v7474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:30 smithi191 ceph-mon[31636]: pgmap v7474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:32.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:32 smithi170 ceph-mon[31212]: pgmap v7475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:32.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:32 smithi077 ceph-mon[27902]: pgmap v7475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:32.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:32 smithi191 ceph-mon[31636]: pgmap v7475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:33.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13843.551078 secs 2024-04-21T14:15:33.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13843.551078 secs 2024-04-21T14:15:33.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13843.551078 secs 2024-04-21T14:15:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13845.311722 secs 2024-04-21T14:15:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:34 smithi170 ceph-mon[31212]: pgmap v7476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13845.311722 secs 2024-04-21T14:15:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:34 smithi077 ceph-mon[27902]: pgmap v7476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13845.311722 secs 2024-04-21T14:15:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:34 smithi191 ceph-mon[31636]: pgmap v7476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:36.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:36 smithi170 ceph-mon[31212]: pgmap v7477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:36.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:36 smithi077 ceph-mon[27902]: pgmap v7477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:36.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:36 smithi191 ceph-mon[31636]: pgmap v7477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:37.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13848.551198 secs 2024-04-21T14:15:37.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13848.551198 secs 2024-04-21T14:15:37.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13848.551198 secs 2024-04-21T14:15:38.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:38 smithi170 ceph-mon[31212]: pgmap v7478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:38.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:38 smithi077 ceph-mon[27902]: pgmap v7478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:38.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:38 smithi191 ceph-mon[31636]: pgmap v7478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:39.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13850.311866 secs 2024-04-21T14:15:39.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13850.311866 secs 2024-04-21T14:15:39.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13850.311866 secs 2024-04-21T14:15:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:40.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:40 smithi077 ceph-mon[27902]: pgmap v7479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:40 smithi191 ceph-mon[31636]: pgmap v7479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:40 smithi170 ceph-mon[31212]: pgmap v7479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:42.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:42 smithi170 ceph-mon[31212]: pgmap v7480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:42.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:42 smithi077 ceph-mon[27902]: pgmap v7480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:42.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:42 smithi191 ceph-mon[31636]: pgmap v7480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:43.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13853.551334 secs 2024-04-21T14:15:43.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13853.551334 secs 2024-04-21T14:15:43.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13853.551334 secs 2024-04-21T14:15:44.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13855.311975 secs 2024-04-21T14:15:44.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:44 smithi170 ceph-mon[31212]: pgmap v7481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:44.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13855.311975 secs 2024-04-21T14:15:44.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:44 smithi077 ceph-mon[27902]: pgmap v7481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13855.311975 secs 2024-04-21T14:15:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:44 smithi191 ceph-mon[31636]: pgmap v7481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:46.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:46 smithi170 ceph-mon[31212]: pgmap v7482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:46.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:46 smithi077 ceph-mon[27902]: pgmap v7482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:46.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:46 smithi191 ceph-mon[31636]: pgmap v7482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:47.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13858.551471 secs 2024-04-21T14:15:47.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13858.551471 secs 2024-04-21T14:15:47.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13858.551471 secs 2024-04-21T14:15:48.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:48 smithi170 ceph-mon[31212]: pgmap v7483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:48.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:48 smithi191 ceph-mon[31636]: pgmap v7483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:48.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:48 smithi077 ceph-mon[27902]: pgmap v7483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:49.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13860.312108 secs 2024-04-21T14:15:49.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13860.312108 secs 2024-04-21T14:15:49.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13860.312108 secs 2024-04-21T14:15:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:50.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:50 smithi170 ceph-mon[31212]: pgmap v7484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:50 smithi077 ceph-mon[27902]: pgmap v7484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:50.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:50 smithi191 ceph-mon[31636]: pgmap v7484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:15:52.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:52 smithi170 ceph-mon[31212]: pgmap v7485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:52.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:52 smithi077 ceph-mon[27902]: pgmap v7485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:52.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:52 smithi191 ceph-mon[31636]: pgmap v7485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:53.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13863.551605 secs 2024-04-21T14:15:53.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13863.551605 secs 2024-04-21T14:15:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13863.551605 secs 2024-04-21T14:15:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13865.312244 secs 2024-04-21T14:15:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:54 smithi170 ceph-mon[31212]: pgmap v7486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13865.312244 secs 2024-04-21T14:15:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:54 smithi077 ceph-mon[27902]: pgmap v7486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:54.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13865.312244 secs 2024-04-21T14:15:54.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:54 smithi191 ceph-mon[31636]: pgmap v7486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:15:56.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:56 smithi170 ceph-mon[31212]: pgmap v7487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:56.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:56 smithi077 ceph-mon[27902]: pgmap v7487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:56.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:56 smithi191 ceph-mon[31636]: pgmap v7487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:15:57.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13868.551740 secs 2024-04-21T14:15:57.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13868.551740 secs 2024-04-21T14:15:57.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13868.551740 secs 2024-04-21T14:15:58.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:58 smithi170 ceph-mon[31212]: pgmap v7488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:58.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:58 smithi077 ceph-mon[27902]: pgmap v7488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:58.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:58 smithi191 ceph-mon[31636]: pgmap v7488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:15:59.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13870.312313 secs 2024-04-21T14:15:59.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13870.312313 secs 2024-04-21T14:15:59.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13870.312313 secs 2024-04-21T14:16:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:00.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:00 smithi170 ceph-mon[31212]: pgmap v7489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T14:16:00.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:00 smithi077 ceph-mon[27902]: pgmap v7489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T14:16:00.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:00 smithi191 ceph-mon[31636]: pgmap v7489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T14:16:02.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:02 smithi170 ceph-mon[31212]: pgmap v7490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T14:16:02.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:02 smithi077 ceph-mon[27902]: pgmap v7490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T14:16:02.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:02 smithi191 ceph-mon[31636]: pgmap v7490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T14:16:03.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13873.551852 secs 2024-04-21T14:16:03.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13873.551852 secs 2024-04-21T14:16:03.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13873.551852 secs 2024-04-21T14:16:04.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13875.312431 secs 2024-04-21T14:16:04.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:04 smithi170 ceph-mon[31212]: pgmap v7491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T14:16:04.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13875.312431 secs 2024-04-21T14:16:04.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:04 smithi077 ceph-mon[27902]: pgmap v7491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T14:16:04.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13875.312431 secs 2024-04-21T14:16:04.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:04 smithi191 ceph-mon[31636]: pgmap v7491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T14:16:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:05.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:05 smithi170 ceph-mon[31212]: osdmap e539: 12 total, 12 up, 12 in 2024-04-21T14:16:05.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:05 smithi077 ceph-mon[27902]: osdmap e539: 12 total, 12 up, 12 in 2024-04-21T14:16:05.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:05 smithi191 ceph-mon[31636]: osdmap e539: 12 total, 12 up, 12 in 2024-04-21T14:16:06.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:06 smithi170 ceph-mon[31212]: pgmap v7493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:16:06.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:06 smithi077 ceph-mon[27902]: pgmap v7493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:16:06.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:06 smithi191 ceph-mon[31636]: pgmap v7493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:16:07.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13878.551990 secs 2024-04-21T14:16:07.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13878.551990 secs 2024-04-21T14:16:07.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13878.551990 secs 2024-04-21T14:16:08.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:08 smithi170 ceph-mon[31212]: pgmap v7494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:16:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:08 smithi077 ceph-mon[27902]: pgmap v7494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:16:08.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:08 smithi191 ceph-mon[31636]: pgmap v7494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:16:09.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13880.312561 secs 2024-04-21T14:16:09.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:09 smithi170 ceph-mon[31212]: osdmap e540: 12 total, 12 up, 12 in 2024-04-21T14:16:09.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13880.312561 secs 2024-04-21T14:16:09.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:09 smithi077 ceph-mon[27902]: osdmap e540: 12 total, 12 up, 12 in 2024-04-21T14:16:09.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13880.312561 secs 2024-04-21T14:16:09.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:09 smithi191 ceph-mon[31636]: osdmap e540: 12 total, 12 up, 12 in 2024-04-21T14:16:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:10.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:10 smithi077 ceph-mon[27902]: pgmap v7496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T14:16:10.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:10 smithi191 ceph-mon[31636]: pgmap v7496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T14:16:11.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:10 smithi170 ceph-mon[31212]: pgmap v7496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T14:16:12.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:12 smithi170 ceph-mon[31212]: pgmap v7497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T14:16:12.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:12 smithi077 ceph-mon[27902]: pgmap v7497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T14:16:12.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:12 smithi191 ceph-mon[31636]: pgmap v7497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T14:16:13.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13883.552115 secs 2024-04-21T14:16:13.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13883.552115 secs 2024-04-21T14:16:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13883.552115 secs 2024-04-21T14:16:14.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13885.312676 secs 2024-04-21T14:16:14.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:14 smithi170 ceph-mon[31212]: pgmap v7498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-21T14:16:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13885.312676 secs 2024-04-21T14:16:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:14 smithi077 ceph-mon[27902]: pgmap v7498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-21T14:16:14.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13885.312676 secs 2024-04-21T14:16:14.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:14 smithi191 ceph-mon[31636]: pgmap v7498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-21T14:16:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:16.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:16 smithi170 ceph-mon[31212]: pgmap v7499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:16:16.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:16 smithi077 ceph-mon[27902]: pgmap v7499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:16:16.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:16 smithi191 ceph-mon[31636]: pgmap v7499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:16:17.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13888.552230 secs 2024-04-21T14:16:17.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13888.552230 secs 2024-04-21T14:16:17.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13888.552230 secs 2024-04-21T14:16:18.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:18 smithi170 ceph-mon[31212]: pgmap v7500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:16:18.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:18 smithi191 ceph-mon[31636]: pgmap v7500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:16:18.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:18 smithi077 ceph-mon[27902]: pgmap v7500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:16:19.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13890.312807 secs 2024-04-21T14:16:19.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13890.312807 secs 2024-04-21T14:16:19.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13890.312807 secs 2024-04-21T14:16:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:20.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:20 smithi077 ceph-mon[27902]: pgmap v7501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:16:20.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:20 smithi191 ceph-mon[31636]: pgmap v7501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:16:21.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:20 smithi170 ceph-mon[31212]: pgmap v7501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:16:22.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:22 smithi170 ceph-mon[31212]: pgmap v7502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:16:22.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:22 smithi077 ceph-mon[27902]: pgmap v7502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:16:22.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:22 smithi191 ceph-mon[31636]: pgmap v7502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:16:23.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13893.552368 secs 2024-04-21T14:16:23.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13893.552368 secs 2024-04-21T14:16:23.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13893.552368 secs 2024-04-21T14:16:24.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13895.312943 secs 2024-04-21T14:16:24.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:24 smithi170 ceph-mon[31212]: pgmap v7503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:24.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13895.312943 secs 2024-04-21T14:16:24.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:24 smithi077 ceph-mon[27902]: pgmap v7503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13895.312943 secs 2024-04-21T14:16:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:24 smithi191 ceph-mon[31636]: pgmap v7503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:26.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:26 smithi170 ceph-mon[31212]: pgmap v7504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:26.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:26 smithi077 ceph-mon[27902]: pgmap v7504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:26.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:26 smithi191 ceph-mon[31636]: pgmap v7504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:27.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13898.552523 secs 2024-04-21T14:16:27.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13898.552523 secs 2024-04-21T14:16:27.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13898.552523 secs 2024-04-21T14:16:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:28 smithi170 ceph-mon[31212]: pgmap v7505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:28.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:28 smithi077 ceph-mon[27902]: pgmap v7505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:28 smithi191 ceph-mon[31636]: pgmap v7505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:29.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13900.313006 secs 2024-04-21T14:16:29.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:16:29.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13900.313006 secs 2024-04-21T14:16:29.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:16:29.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13900.313006 secs 2024-04-21T14:16:29.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:16:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: pgmap v7506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: pgmap v7506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: pgmap v7506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:31.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:16:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:16:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:16:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:32.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:16:32.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:16:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13903.552640 secs 2024-04-21T14:16:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:32 smithi077 ceph-mon[27902]: pgmap v7507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13903.552640 secs 2024-04-21T14:16:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:32 smithi191 ceph-mon[31636]: pgmap v7507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13903.552640 secs 2024-04-21T14:16:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:32 smithi170 ceph-mon[31212]: pgmap v7507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:34.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13905.313130 secs 2024-04-21T14:16:34.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:34 smithi170 ceph-mon[31212]: pgmap v7508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13905.313130 secs 2024-04-21T14:16:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:34 smithi077 ceph-mon[27902]: pgmap v7508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13905.313130 secs 2024-04-21T14:16:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:34 smithi191 ceph-mon[31636]: pgmap v7508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:36.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:36 smithi170 ceph-mon[31212]: pgmap v7509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:36.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:36 smithi191 ceph-mon[31636]: pgmap v7509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:36.698 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:36 smithi077 ceph-mon[27902]: pgmap v7509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:37.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13908.552754 secs 2024-04-21T14:16:37.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13908.552754 secs 2024-04-21T14:16:37.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13908.552754 secs 2024-04-21T14:16:38.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:38 smithi170 ceph-mon[31212]: pgmap v7510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:38.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:38 smithi077 ceph-mon[27902]: pgmap v7510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:38.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:38 smithi191 ceph-mon[31636]: pgmap v7510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:39.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13910.313251 secs 2024-04-21T14:16:39.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13910.313251 secs 2024-04-21T14:16:40.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13910.313251 secs 2024-04-21T14:16:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:40.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:40 smithi077 ceph-mon[27902]: pgmap v7511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:40.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:40 smithi191 ceph-mon[31636]: pgmap v7511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:40 smithi170 ceph-mon[31212]: pgmap v7511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:43.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13913.552887 secs 2024-04-21T14:16:43.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:43 smithi170 ceph-mon[31212]: pgmap v7512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:43.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13913.552887 secs 2024-04-21T14:16:43.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:43 smithi077 ceph-mon[27902]: pgmap v7512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:43.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13913.552887 secs 2024-04-21T14:16:43.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:43 smithi191 ceph-mon[31636]: pgmap v7512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:44.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13915.313355 secs 2024-04-21T14:16:44.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13915.313355 secs 2024-04-21T14:16:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13915.313355 secs 2024-04-21T14:16:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:45.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:45 smithi170 ceph-mon[31212]: pgmap v7513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:45.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:45 smithi077 ceph-mon[27902]: pgmap v7513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:45.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:45 smithi191 ceph-mon[31636]: pgmap v7513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:47.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:47 smithi170 ceph-mon[31212]: pgmap v7514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:47.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:47 smithi077 ceph-mon[27902]: pgmap v7514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:47.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:47 smithi191 ceph-mon[31636]: pgmap v7514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:48.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13918.553032 secs 2024-04-21T14:16:48.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13918.553032 secs 2024-04-21T14:16:48.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13918.553032 secs 2024-04-21T14:16:49.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:49 smithi170 ceph-mon[31212]: pgmap v7515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:49.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13920.313470 secs 2024-04-21T14:16:49.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:49 smithi077 ceph-mon[27902]: pgmap v7515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:49.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13920.313470 secs 2024-04-21T14:16:49.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:49 smithi191 ceph-mon[31636]: pgmap v7515: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:49.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13920.313470 secs 2024-04-21T14:16:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:51.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:51 smithi170 ceph-mon[31212]: pgmap v7516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:51.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:51 smithi077 ceph-mon[27902]: pgmap v7516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:51.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:51 smithi191 ceph-mon[31636]: pgmap v7516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:16:53.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13923.553152 secs 2024-04-21T14:16:53.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:53 smithi170 ceph-mon[31212]: pgmap v7517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:53.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13923.553152 secs 2024-04-21T14:16:53.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:53 smithi077 ceph-mon[27902]: pgmap v7517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13923.553152 secs 2024-04-21T14:16:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:53 smithi191 ceph-mon[31636]: pgmap v7517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:54.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13925.313578 secs 2024-04-21T14:16:54.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13925.313578 secs 2024-04-21T14:16:54.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13925.313578 secs 2024-04-21T14:16:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:16:55.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:55 smithi170 ceph-mon[31212]: pgmap v7518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:55.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:55 smithi077 ceph-mon[27902]: pgmap v7518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:55.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:55 smithi191 ceph-mon[31636]: pgmap v7518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:16:56.274+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:16:56.274+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:16:56.274+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:16:56.274+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:16:57.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:57 smithi170 ceph-mon[31212]: pgmap v7519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:57.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:57 smithi077 ceph-mon[27902]: pgmap v7519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:57.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:57 smithi191 ceph-mon[31636]: pgmap v7519: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:16:58.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13928.553266 secs 2024-04-21T14:16:58.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13928.553266 secs 2024-04-21T14:16:58.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13928.553266 secs 2024-04-21T14:16:59.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:59 smithi170 ceph-mon[31212]: pgmap v7520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:59.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13930.313689 secs 2024-04-21T14:16:59.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:59 smithi077 ceph-mon[27902]: pgmap v7520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:59.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13930.313689 secs 2024-04-21T14:16:59.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:59 smithi191 ceph-mon[31636]: pgmap v7520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:16:59.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13930.313689 secs 2024-04-21T14:17:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:01.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:01 smithi170 ceph-mon[31212]: pgmap v7521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:01.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:01 smithi077 ceph-mon[27902]: pgmap v7521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:01.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:01 smithi191 ceph-mon[31636]: pgmap v7521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:03.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13933.553384 secs 2024-04-21T14:17:03.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:03 smithi170 ceph-mon[31212]: pgmap v7522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T14:17:03.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13933.553384 secs 2024-04-21T14:17:03.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:03 smithi077 ceph-mon[27902]: pgmap v7522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T14:17:03.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13933.553384 secs 2024-04-21T14:17:03.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:03 smithi191 ceph-mon[31636]: pgmap v7522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T14:17:04.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13935.313769 secs 2024-04-21T14:17:04.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13935.313769 secs 2024-04-21T14:17:04.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13935.313769 secs 2024-04-21T14:17:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:05 smithi077 ceph-mon[27902]: pgmap v7523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T14:17:05.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:05 smithi077 ceph-mon[27902]: osdmap e541: 12 total, 12 up, 12 in 2024-04-21T14:17:05.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:05 smithi191 ceph-mon[31636]: pgmap v7523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T14:17:05.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:05 smithi191 ceph-mon[31636]: osdmap e541: 12 total, 12 up, 12 in 2024-04-21T14:17:05.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:05 smithi170 ceph-mon[31212]: pgmap v7523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T14:17:05.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:05 smithi170 ceph-mon[31212]: osdmap e541: 12 total, 12 up, 12 in 2024-04-21T14:17:07.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:07 smithi077 ceph-mon[27902]: pgmap v7525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:17:07.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:07 smithi191 ceph-mon[31636]: pgmap v7525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:17:07.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:07 smithi170 ceph-mon[31212]: pgmap v7525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:17:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13938.553510 secs 2024-04-21T14:17:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13938.553510 secs 2024-04-21T14:17:08.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13938.553510 secs 2024-04-21T14:17:09.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:09 smithi077 ceph-mon[27902]: pgmap v7526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:17:09.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13940.313883 secs 2024-04-21T14:17:09.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:09 smithi077 ceph-mon[27902]: osdmap e542: 12 total, 12 up, 12 in 2024-04-21T14:17:09.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:09 smithi191 ceph-mon[31636]: pgmap v7526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:17:09.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13940.313883 secs 2024-04-21T14:17:09.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:09 smithi191 ceph-mon[31636]: osdmap e542: 12 total, 12 up, 12 in 2024-04-21T14:17:09.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:09 smithi170 ceph-mon[31212]: pgmap v7526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:17:09.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13940.313883 secs 2024-04-21T14:17:09.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:09 smithi170 ceph-mon[31212]: osdmap e542: 12 total, 12 up, 12 in 2024-04-21T14:17:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:11.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:11 smithi077 ceph-mon[27902]: pgmap v7528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T14:17:11.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:11 smithi191 ceph-mon[31636]: pgmap v7528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T14:17:11.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:11 smithi170 ceph-mon[31212]: pgmap v7528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T14:17:13.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13943.553640 secs 2024-04-21T14:17:13.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:13 smithi077 ceph-mon[27902]: pgmap v7529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T14:17:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13943.553640 secs 2024-04-21T14:17:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:13 smithi191 ceph-mon[31636]: pgmap v7529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T14:17:13.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13943.553640 secs 2024-04-21T14:17:13.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:13 smithi170 ceph-mon[31212]: pgmap v7529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T14:17:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13945.314017 secs 2024-04-21T14:17:14.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13945.314017 secs 2024-04-21T14:17:14.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13945.314017 secs 2024-04-21T14:17:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:15.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:15 smithi077 ceph-mon[27902]: pgmap v7530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T14:17:15.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:15 smithi191 ceph-mon[31636]: pgmap v7530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T14:17:15.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:15 smithi170 ceph-mon[31212]: pgmap v7530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T14:17:17.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:17 smithi077 ceph-mon[27902]: pgmap v7531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:17:17.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:17 smithi191 ceph-mon[31636]: pgmap v7531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:17:17.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:17 smithi170 ceph-mon[31212]: pgmap v7531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:17:18.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13948.553775 secs 2024-04-21T14:17:18.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13948.553775 secs 2024-04-21T14:17:18.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13948.553775 secs 2024-04-21T14:17:19.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:19 smithi077 ceph-mon[27902]: pgmap v7532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:17:19.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13950.314104 secs 2024-04-21T14:17:19.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:19 smithi191 ceph-mon[31636]: pgmap v7532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:17:19.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13950.314104 secs 2024-04-21T14:17:19.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:19 smithi170 ceph-mon[31212]: pgmap v7532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:17:19.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13950.314104 secs 2024-04-21T14:17:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:21.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:21 smithi077 ceph-mon[27902]: pgmap v7533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:17:21.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:21 smithi191 ceph-mon[31636]: pgmap v7533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:17:21.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:21 smithi170 ceph-mon[31212]: pgmap v7533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:17:23.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13953.553869 secs 2024-04-21T14:17:23.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:23 smithi077 ceph-mon[27902]: pgmap v7534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:17:23.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13953.553869 secs 2024-04-21T14:17:23.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:23 smithi191 ceph-mon[31636]: pgmap v7534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:17:23.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13953.553869 secs 2024-04-21T14:17:23.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:23 smithi170 ceph-mon[31212]: pgmap v7534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:17:24.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13955.314182 secs 2024-04-21T14:17:24.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13955.314182 secs 2024-04-21T14:17:24.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13955.314182 secs 2024-04-21T14:17:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:25.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:25 smithi077 ceph-mon[27902]: pgmap v7535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:25.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:25 smithi191 ceph-mon[31636]: pgmap v7535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:25.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:25 smithi170 ceph-mon[31212]: pgmap v7535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:27.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:27 smithi077 ceph-mon[27902]: pgmap v7536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:27.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:27 smithi191 ceph-mon[31636]: pgmap v7536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:27.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:27 smithi170 ceph-mon[31212]: pgmap v7536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:28.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13958.553977 secs 2024-04-21T14:17:28.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13958.553977 secs 2024-04-21T14:17:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13958.553977 secs 2024-04-21T14:17:29.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:29 smithi077 ceph-mon[27902]: pgmap v7537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:29.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13960.314295 secs 2024-04-21T14:17:29.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:29 smithi191 ceph-mon[31636]: pgmap v7537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:29.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13960.314295 secs 2024-04-21T14:17:29.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:29 smithi170 ceph-mon[31212]: pgmap v7537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:29.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13960.314295 secs 2024-04-21T14:17:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:31.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:31 smithi077 ceph-mon[27902]: pgmap v7538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:31.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:17:31.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:31 smithi191 ceph-mon[31636]: pgmap v7538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:31.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:17:31.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:31 smithi170 ceph-mon[31212]: pgmap v7538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:31.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:17:32.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13963.554092 secs 2024-04-21T14:17:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:17:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:17:32.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:32.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13963.554092 secs 2024-04-21T14:17:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:17:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:17:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13963.554092 secs 2024-04-21T14:17:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:17:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:17:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:17:33.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:33 smithi077 ceph-mon[27902]: pgmap v7539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:33.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:33 smithi191 ceph-mon[31636]: pgmap v7539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:34.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:33 smithi170 ceph-mon[31212]: pgmap v7539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:34.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13965.314430 secs 2024-04-21T14:17:34.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13965.314430 secs 2024-04-21T14:17:35.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13965.314430 secs 2024-04-21T14:17:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:35.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:35 smithi077 ceph-mon[27902]: pgmap v7540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:35.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:35 smithi191 ceph-mon[31636]: pgmap v7540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:36.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:35 smithi170 ceph-mon[31212]: pgmap v7540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:37.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:37 smithi077 ceph-mon[27902]: pgmap v7541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:37.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13968.554207 secs 2024-04-21T14:17:37.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:37 smithi191 ceph-mon[31636]: pgmap v7541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:37.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13968.554207 secs 2024-04-21T14:17:38.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:37 smithi170 ceph-mon[31212]: pgmap v7541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:38.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13968.554207 secs 2024-04-21T14:17:39.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:39 smithi077 ceph-mon[27902]: pgmap v7542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:39.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13970.314545 secs 2024-04-21T14:17:39.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:39 smithi191 ceph-mon[31636]: pgmap v7542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:39.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13970.314545 secs 2024-04-21T14:17:40.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:39 smithi170 ceph-mon[31212]: pgmap v7542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:40.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13970.314545 secs 2024-04-21T14:17:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:41.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:41 smithi077 ceph-mon[27902]: pgmap v7543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:41.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:41 smithi191 ceph-mon[31636]: pgmap v7543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:42.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:41 smithi170 ceph-mon[31212]: pgmap v7543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:42.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13973.554317 secs 2024-04-21T14:17:42.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13973.554317 secs 2024-04-21T14:17:43.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13973.554317 secs 2024-04-21T14:17:43.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:43 smithi077 ceph-mon[27902]: pgmap v7544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:43.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:43 smithi191 ceph-mon[31636]: pgmap v7544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:44.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:43 smithi170 ceph-mon[31212]: pgmap v7544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:44.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13975.314666 secs 2024-04-21T14:17:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13975.314666 secs 2024-04-21T14:17:45.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13975.314666 secs 2024-04-21T14:17:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:45.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:45 smithi077 ceph-mon[27902]: pgmap v7545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:45.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:45 smithi191 ceph-mon[31636]: pgmap v7545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:46.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:45 smithi170 ceph-mon[31212]: pgmap v7545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:47.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:47 smithi077 ceph-mon[27902]: pgmap v7546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:47.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13978.554428 secs 2024-04-21T14:17:47.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:47 smithi191 ceph-mon[31636]: pgmap v7546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:47.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13978.554428 secs 2024-04-21T14:17:48.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:47 smithi170 ceph-mon[31212]: pgmap v7546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:48.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13978.554428 secs 2024-04-21T14:17:49.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:49 smithi077 ceph-mon[27902]: pgmap v7547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:49.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13980.314777 secs 2024-04-21T14:17:49.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:49 smithi191 ceph-mon[31636]: pgmap v7547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:49.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13980.314777 secs 2024-04-21T14:17:50.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:49 smithi170 ceph-mon[31212]: pgmap v7547: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:50.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13980.314777 secs 2024-04-21T14:17:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:51.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:51 smithi077 ceph-mon[27902]: pgmap v7548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:51.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:51 smithi191 ceph-mon[31636]: pgmap v7548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:52.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:51 smithi170 ceph-mon[31212]: pgmap v7548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:17:52.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13983.554548 secs 2024-04-21T14:17:52.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13983.554548 secs 2024-04-21T14:17:53.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13983.554548 secs 2024-04-21T14:17:53.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:53 smithi191 ceph-mon[31636]: pgmap v7549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:54.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:53 smithi170 ceph-mon[31212]: pgmap v7549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:54.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:53 smithi077 ceph-mon[27902]: pgmap v7549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:54.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13985.314888 secs 2024-04-21T14:17:55.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13985.314888 secs 2024-04-21T14:17:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:17:55.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13985.314888 secs 2024-04-21T14:17:55.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:55 smithi191 ceph-mon[31636]: pgmap v7550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:56.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:55 smithi170 ceph-mon[31212]: pgmap v7550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:56.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:55 smithi077 ceph-mon[27902]: pgmap v7550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:57.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:57 smithi191 ceph-mon[31636]: pgmap v7551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:57.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13988.554689 secs 2024-04-21T14:17:58.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:57 smithi170 ceph-mon[31212]: pgmap v7551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:58.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13988.554689 secs 2024-04-21T14:17:58.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:57 smithi077 ceph-mon[27902]: pgmap v7551: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:17:58.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13988.554689 secs 2024-04-21T14:17:59.916 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:59 smithi077 ceph-mon[27902]: pgmap v7552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:59.916 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13990.315000 secs 2024-04-21T14:17:59.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:59 smithi191 ceph-mon[31636]: pgmap v7552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:17:59.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13990.315000 secs 2024-04-21T14:18:00.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:59 smithi170 ceph-mon[31212]: pgmap v7552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:00.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13990.315000 secs 2024-04-21T14:18:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:01.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:01 smithi191 ceph-mon[31636]: pgmap v7553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:02.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:01 smithi170 ceph-mon[31212]: pgmap v7553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:02.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:01 smithi077 ceph-mon[27902]: pgmap v7553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:02.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13993.554780 secs 2024-04-21T14:18:03.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13993.554780 secs 2024-04-21T14:18:03.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13993.554780 secs 2024-04-21T14:18:03.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:03 smithi191 ceph-mon[31636]: pgmap v7554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:04.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:03 smithi170 ceph-mon[31212]: pgmap v7554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:04.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:03 smithi077 ceph-mon[27902]: pgmap v7554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:04.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 13995.315081 secs 2024-04-21T14:18:04.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:04 smithi191 ceph-mon[31636]: osdmap e543: 12 total, 12 up, 12 in 2024-04-21T14:18:05.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 13995.315081 secs 2024-04-21T14:18:05.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:04 smithi170 ceph-mon[31212]: osdmap e543: 12 total, 12 up, 12 in 2024-04-21T14:18:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:05.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 13995.315081 secs 2024-04-21T14:18:05.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:04 smithi077 ceph-mon[27902]: osdmap e543: 12 total, 12 up, 12 in 2024-04-21T14:18:05.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:05 smithi191 ceph-mon[31636]: pgmap v7556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:18:06.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:05 smithi170 ceph-mon[31212]: pgmap v7556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:18:06.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:05 smithi077 ceph-mon[27902]: pgmap v7556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:18:07.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:07 smithi191 ceph-mon[31636]: pgmap v7557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:18:07.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 13998.554842 secs 2024-04-21T14:18:08.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:07 smithi170 ceph-mon[31212]: pgmap v7557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:18:08.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 13998.554842 secs 2024-04-21T14:18:08.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:07 smithi077 ceph-mon[27902]: pgmap v7557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:18:08.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 13998.554842 secs 2024-04-21T14:18:09.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:09 smithi191 ceph-mon[31636]: pgmap v7558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:18:09.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14000.315171 secs 2024-04-21T14:18:09.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:09 smithi191 ceph-mon[31636]: osdmap e544: 12 total, 12 up, 12 in 2024-04-21T14:18:10.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:09 smithi170 ceph-mon[31212]: pgmap v7558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:18:10.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14000.315171 secs 2024-04-21T14:18:10.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:09 smithi170 ceph-mon[31212]: osdmap e544: 12 total, 12 up, 12 in 2024-04-21T14:18:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:10.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:09 smithi077 ceph-mon[27902]: pgmap v7558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:18:10.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14000.315171 secs 2024-04-21T14:18:10.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:09 smithi077 ceph-mon[27902]: osdmap e544: 12 total, 12 up, 12 in 2024-04-21T14:18:11.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:11 smithi191 ceph-mon[31636]: pgmap v7560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:18:12.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:11 smithi170 ceph-mon[31212]: pgmap v7560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:18:12.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:11 smithi077 ceph-mon[27902]: pgmap v7560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:18:12.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14003.554906 secs 2024-04-21T14:18:13.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14003.554906 secs 2024-04-21T14:18:13.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14003.554906 secs 2024-04-21T14:18:13.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:13 smithi191 ceph-mon[31636]: pgmap v7561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:18:14.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:13 smithi170 ceph-mon[31212]: pgmap v7561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:18:14.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:13 smithi077 ceph-mon[27902]: pgmap v7561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:18:14.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14005.315331 secs 2024-04-21T14:18:15.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14005.315331 secs 2024-04-21T14:18:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:15.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14005.315331 secs 2024-04-21T14:18:15.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:15 smithi191 ceph-mon[31636]: pgmap v7562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:18:16.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:15 smithi170 ceph-mon[31212]: pgmap v7562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:18:16.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:15 smithi077 ceph-mon[27902]: pgmap v7562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:18:17.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:17 smithi191 ceph-mon[31636]: pgmap v7563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:18:17.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14008.555034 secs 2024-04-21T14:18:18.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:17 smithi170 ceph-mon[31212]: pgmap v7563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:18:18.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14008.555034 secs 2024-04-21T14:18:18.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:17 smithi077 ceph-mon[27902]: pgmap v7563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:18:18.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14008.555034 secs 2024-04-21T14:18:19.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:19 smithi191 ceph-mon[31636]: pgmap v7564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:18:19.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14010.315435 secs 2024-04-21T14:18:20.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:19 smithi170 ceph-mon[31212]: pgmap v7564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:18:20.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14010.315435 secs 2024-04-21T14:18:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:20.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:19 smithi077 ceph-mon[27902]: pgmap v7564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:18:20.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14010.315435 secs 2024-04-21T14:18:21.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:21 smithi191 ceph-mon[31636]: pgmap v7565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:18:22.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:21 smithi170 ceph-mon[31212]: pgmap v7565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:18:22.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:21 smithi077 ceph-mon[27902]: pgmap v7565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:18:23.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14013.555116 secs 2024-04-21T14:18:23.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14013.555116 secs 2024-04-21T14:18:23.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14013.555116 secs 2024-04-21T14:18:24.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:23 smithi170 ceph-mon[31212]: pgmap v7566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:18:24.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:23 smithi077 ceph-mon[27902]: pgmap v7566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:18:24.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:23 smithi191 ceph-mon[31636]: pgmap v7566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:18:25.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14015.315527 secs 2024-04-21T14:18:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:25.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14015.315527 secs 2024-04-21T14:18:25.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14015.315527 secs 2024-04-21T14:18:26.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:25 smithi170 ceph-mon[31212]: pgmap v7567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:18:26.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:25 smithi077 ceph-mon[27902]: pgmap v7567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:18:26.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:25 smithi191 ceph-mon[31636]: pgmap v7567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:18:28.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:27 smithi170 ceph-mon[31212]: pgmap v7568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:28.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14018.555229 secs 2024-04-21T14:18:28.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:27 smithi077 ceph-mon[27902]: pgmap v7568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:28.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14018.555229 secs 2024-04-21T14:18:28.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:27 smithi191 ceph-mon[31636]: pgmap v7568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:28.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14018.555229 secs 2024-04-21T14:18:30.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:29 smithi170 ceph-mon[31212]: pgmap v7569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:18:30.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14020.315657 secs 2024-04-21T14:18:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:30.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:29 smithi077 ceph-mon[27902]: pgmap v7569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:18:30.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14020.315657 secs 2024-04-21T14:18:30.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:29 smithi191 ceph-mon[31636]: pgmap v7569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:18:30.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14020.315657 secs 2024-04-21T14:18:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:31 smithi170 ceph-mon[31212]: pgmap v7570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T14:18:32.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:31 smithi077 ceph-mon[27902]: pgmap v7570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T14:18:32.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:31 smithi191 ceph-mon[31636]: pgmap v7570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T14:18:33.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14023.555348 secs 2024-04-21T14:18:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:18:33.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14023.555348 secs 2024-04-21T14:18:33.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:18:33.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14023.555348 secs 2024-04-21T14:18:33.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:18:34.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: pgmap v7571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:18:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: pgmap v7571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:18:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: pgmap v7571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T14:18:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:18:34.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:18:34.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:18:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:35.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14025.315745 secs 2024-04-21T14:18:35.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14025.315745 secs 2024-04-21T14:18:35.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14025.315745 secs 2024-04-21T14:18:36.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:35 smithi191 ceph-mon[31636]: pgmap v7572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:36.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:35 smithi170 ceph-mon[31212]: pgmap v7572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:36.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:35 smithi077 ceph-mon[27902]: pgmap v7572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:38.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:37 smithi191 ceph-mon[31636]: pgmap v7573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:38.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14028.555474 secs 2024-04-21T14:18:38.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:37 smithi170 ceph-mon[31212]: pgmap v7573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:38.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14028.555474 secs 2024-04-21T14:18:38.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:37 smithi077 ceph-mon[27902]: pgmap v7573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:38.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14028.555474 secs 2024-04-21T14:18:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:40.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:39 smithi191 ceph-mon[31636]: pgmap v7574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:40.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14030.315873 secs 2024-04-21T14:18:40.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:39 smithi170 ceph-mon[31212]: pgmap v7574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:40.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14030.315873 secs 2024-04-21T14:18:40.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:39 smithi077 ceph-mon[27902]: pgmap v7574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:40.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14030.315873 secs 2024-04-21T14:18:42.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:41 smithi191 ceph-mon[31636]: pgmap v7575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:42.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:41 smithi170 ceph-mon[31212]: pgmap v7575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:42.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:41 smithi077 ceph-mon[27902]: pgmap v7575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:43.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14033.555586 secs 2024-04-21T14:18:43.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14033.555586 secs 2024-04-21T14:18:43.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14033.555586 secs 2024-04-21T14:18:44.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:43 smithi170 ceph-mon[31212]: pgmap v7576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:44.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:43 smithi077 ceph-mon[27902]: pgmap v7576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:44.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:43 smithi191 ceph-mon[31636]: pgmap v7576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:45.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14035.315984 secs 2024-04-21T14:18:45.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14035.315984 secs 2024-04-21T14:18:45.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14035.315984 secs 2024-04-21T14:18:46.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:45 smithi170 ceph-mon[31212]: pgmap v7577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:46.414 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:45 smithi077 ceph-mon[27902]: pgmap v7577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:46.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:45 smithi191 ceph-mon[31636]: pgmap v7577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:48.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:47 smithi170 ceph-mon[31212]: pgmap v7578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:48.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14038.555700 secs 2024-04-21T14:18:48.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:47 smithi077 ceph-mon[27902]: pgmap v7578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:48.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14038.555700 secs 2024-04-21T14:18:48.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:47 smithi191 ceph-mon[31636]: pgmap v7578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:48.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14038.555700 secs 2024-04-21T14:18:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:50.248 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:49 smithi191 ceph-mon[31636]: pgmap v7579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:50.248 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14040.316057 secs 2024-04-21T14:18:50.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:49 smithi170 ceph-mon[31212]: pgmap v7579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:50.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14040.316057 secs 2024-04-21T14:18:50.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:49 smithi077 ceph-mon[27902]: pgmap v7579: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:50.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14040.316057 secs 2024-04-21T14:18:52.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:51 smithi170 ceph-mon[31212]: pgmap v7580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:52.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:51 smithi077 ceph-mon[27902]: pgmap v7580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:52.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:51 smithi191 ceph-mon[31636]: pgmap v7580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:18:53.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14043.555810 secs 2024-04-21T14:18:53.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14043.555810 secs 2024-04-21T14:18:53.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14043.555810 secs 2024-04-21T14:18:54.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:53 smithi170 ceph-mon[31212]: pgmap v7581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:54.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:53 smithi077 ceph-mon[27902]: pgmap v7581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:54.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:53 smithi191 ceph-mon[31636]: pgmap v7581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:18:55.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14045.316118 secs 2024-04-21T14:18:55.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14045.316118 secs 2024-04-21T14:18:55.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14045.316118 secs 2024-04-21T14:18:56.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:56 smithi170 ceph-mon[31212]: pgmap v7582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:56.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:56 smithi077 ceph-mon[27902]: pgmap v7582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:56.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:56 smithi191 ceph-mon[31636]: pgmap v7582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:18:58.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:58 smithi170 ceph-mon[31212]: pgmap v7583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:58.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:18:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14048.555920 secs 2024-04-21T14:18:58.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:58 smithi077 ceph-mon[27902]: pgmap v7583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:58.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:18:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14048.555920 secs 2024-04-21T14:18:58.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:58 smithi191 ceph-mon[31636]: pgmap v7583: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:18:58.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:18:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14048.555920 secs 2024-04-21T14:19:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:00.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:00 smithi170 ceph-mon[31212]: pgmap v7584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:00.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14050.316179 secs 2024-04-21T14:19:00.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:00 smithi077 ceph-mon[27902]: pgmap v7584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:00.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14050.316179 secs 2024-04-21T14:19:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:00 smithi191 ceph-mon[31636]: pgmap v7584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14050.316179 secs 2024-04-21T14:19:02.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:02 smithi170 ceph-mon[31212]: pgmap v7585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:02.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:02 smithi077 ceph-mon[27902]: pgmap v7585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:02.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:02 smithi191 ceph-mon[31636]: pgmap v7585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:03.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14053.556042 secs 2024-04-21T14:19:03.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14053.556042 secs 2024-04-21T14:19:03.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14053.556042 secs 2024-04-21T14:19:04.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:04 smithi170 ceph-mon[31212]: pgmap v7586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:04.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:04 smithi077 ceph-mon[27902]: pgmap v7586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:04.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:04 smithi191 ceph-mon[31636]: pgmap v7586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:05.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14055.316296 secs 2024-04-21T14:19:05.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:05 smithi170 ceph-mon[31212]: osdmap e545: 12 total, 12 up, 12 in 2024-04-21T14:19:05.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14055.316296 secs 2024-04-21T14:19:05.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:05 smithi077 ceph-mon[27902]: osdmap e545: 12 total, 12 up, 12 in 2024-04-21T14:19:05.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14055.316296 secs 2024-04-21T14:19:05.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:05 smithi191 ceph-mon[31636]: osdmap e545: 12 total, 12 up, 12 in 2024-04-21T14:19:06.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:06 smithi170 ceph-mon[31212]: pgmap v7588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:19:06.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:06 smithi077 ceph-mon[27902]: pgmap v7588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:19:06.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:06 smithi191 ceph-mon[31636]: pgmap v7588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:19:08.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:08 smithi170 ceph-mon[31212]: pgmap v7589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:19:08.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14058.556121 secs 2024-04-21T14:19:08.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:08 smithi077 ceph-mon[27902]: pgmap v7589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:19:08.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14058.556121 secs 2024-04-21T14:19:08.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:08 smithi191 ceph-mon[31636]: pgmap v7589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:19:08.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14058.556121 secs 2024-04-21T14:19:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:10.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:10 smithi170 ceph-mon[31212]: pgmap v7590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:19:10.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14060.316413 secs 2024-04-21T14:19:10.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:10 smithi170 ceph-mon[31212]: osdmap e546: 12 total, 12 up, 12 in 2024-04-21T14:19:10.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:10 smithi077 ceph-mon[27902]: pgmap v7590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:19:10.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14060.316413 secs 2024-04-21T14:19:10.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:10 smithi077 ceph-mon[27902]: osdmap e546: 12 total, 12 up, 12 in 2024-04-21T14:19:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:10 smithi191 ceph-mon[31636]: pgmap v7590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:19:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14060.316413 secs 2024-04-21T14:19:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:10 smithi191 ceph-mon[31636]: osdmap e546: 12 total, 12 up, 12 in 2024-04-21T14:19:12.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:12 smithi170 ceph-mon[31212]: pgmap v7592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:19:12.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:12 smithi077 ceph-mon[27902]: pgmap v7592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:19:12.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:12 smithi191 ceph-mon[31636]: pgmap v7592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:19:13.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14063.556235 secs 2024-04-21T14:19:13.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14063.556235 secs 2024-04-21T14:19:13.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14063.556235 secs 2024-04-21T14:19:14.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:14 smithi170 ceph-mon[31212]: pgmap v7593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:19:14.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:14 smithi077 ceph-mon[27902]: pgmap v7593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:19:14.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:14 smithi191 ceph-mon[31636]: pgmap v7593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:19:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:15.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14065.316555 secs 2024-04-21T14:19:15.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14065.316555 secs 2024-04-21T14:19:15.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14065.316555 secs 2024-04-21T14:19:16.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:16 smithi077 ceph-mon[27902]: pgmap v7594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:19:16.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:16 smithi191 ceph-mon[31636]: pgmap v7594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:19:16.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:16 smithi170 ceph-mon[31212]: pgmap v7594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:19:18.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:18 smithi077 ceph-mon[27902]: pgmap v7595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:19:18.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14068.556350 secs 2024-04-21T14:19:18.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:18 smithi191 ceph-mon[31636]: pgmap v7595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:19:18.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14068.556350 secs 2024-04-21T14:19:18.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:18 smithi170 ceph-mon[31212]: pgmap v7595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:19:18.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14068.556350 secs 2024-04-21T14:19:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:20.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:20 smithi077 ceph-mon[27902]: pgmap v7596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:19:20.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14070.316691 secs 2024-04-21T14:19:20.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:20 smithi191 ceph-mon[31636]: pgmap v7596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:19:20.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14070.316691 secs 2024-04-21T14:19:20.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:20 smithi170 ceph-mon[31212]: pgmap v7596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:19:20.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14070.316691 secs 2024-04-21T14:19:22.343 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:22 smithi170 ceph-mon[31212]: pgmap v7597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:19:22.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:22 smithi077 ceph-mon[27902]: pgmap v7597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:19:22.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:22 smithi191 ceph-mon[31636]: pgmap v7597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:19:23.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14073.556414 secs 2024-04-21T14:19:23.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14073.556414 secs 2024-04-21T14:19:23.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14073.556414 secs 2024-04-21T14:19:24.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:24 smithi077 ceph-mon[27902]: pgmap v7598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:19:24.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:24 smithi191 ceph-mon[31636]: pgmap v7598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:19:24.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:24 smithi170 ceph-mon[31212]: pgmap v7598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:19:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:25.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14075.316781 secs 2024-04-21T14:19:25.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14075.316781 secs 2024-04-21T14:19:25.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14075.316781 secs 2024-04-21T14:19:26.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:26 smithi077 ceph-mon[27902]: pgmap v7599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:26.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:26 smithi191 ceph-mon[31636]: pgmap v7599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:26.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:26 smithi170 ceph-mon[31212]: pgmap v7599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:28.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:28 smithi077 ceph-mon[27902]: pgmap v7600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:28.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14078.556528 secs 2024-04-21T14:19:28.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:28 smithi191 ceph-mon[31636]: pgmap v7600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:28.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14078.556528 secs 2024-04-21T14:19:28.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:28 smithi170 ceph-mon[31212]: pgmap v7600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:28.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14078.556528 secs 2024-04-21T14:19:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:30.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:30 smithi077 ceph-mon[27902]: pgmap v7601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:30.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14080.316923 secs 2024-04-21T14:19:30.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:30 smithi191 ceph-mon[31636]: pgmap v7601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:30.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14080.316923 secs 2024-04-21T14:19:30.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:30 smithi170 ceph-mon[31212]: pgmap v7601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:30.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14080.316923 secs 2024-04-21T14:19:32.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:32 smithi077 ceph-mon[27902]: pgmap v7602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:32.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:32 smithi191 ceph-mon[31636]: pgmap v7602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:32.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:32 smithi170 ceph-mon[31212]: pgmap v7602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:33.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14083.556593 secs 2024-04-21T14:19:33.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14083.556593 secs 2024-04-21T14:19:33.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14083.556593 secs 2024-04-21T14:19:34.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:34 smithi077 ceph-mon[27902]: pgmap v7603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:34.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:19:34.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:34 smithi191 ceph-mon[31636]: pgmap v7603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:34.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:19:34.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:34 smithi170 ceph-mon[31212]: pgmap v7603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:34.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:19:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:35.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14085.317051 secs 2024-04-21T14:19:35.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:19:35.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:19:35.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:19:35.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14085.317051 secs 2024-04-21T14:19:35.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:19:35.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:19:35.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:19:35.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14085.317051 secs 2024-04-21T14:19:35.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:19:35.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:19:35.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:19:36.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:36 smithi077 ceph-mon[27902]: pgmap v7604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:36.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:36 smithi191 ceph-mon[31636]: pgmap v7604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:36.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:36 smithi170 ceph-mon[31212]: pgmap v7604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:38.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:38 smithi077 ceph-mon[27902]: pgmap v7605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:38.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14088.556705 secs 2024-04-21T14:19:38.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:38 smithi191 ceph-mon[31636]: pgmap v7605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:38.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14088.556705 secs 2024-04-21T14:19:38.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:38 smithi170 ceph-mon[31212]: pgmap v7605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:38.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14088.556705 secs 2024-04-21T14:19:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:40.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:40 smithi077 ceph-mon[27902]: pgmap v7606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:40.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14090.317117 secs 2024-04-21T14:19:40.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:40 smithi191 ceph-mon[31636]: pgmap v7606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:40.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14090.317117 secs 2024-04-21T14:19:40.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:40 smithi170 ceph-mon[31212]: pgmap v7606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:40.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14090.317117 secs 2024-04-21T14:19:42.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:42 smithi077 ceph-mon[27902]: pgmap v7607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:42.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:42 smithi191 ceph-mon[31636]: pgmap v7607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:42.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:42 smithi170 ceph-mon[31212]: pgmap v7607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:43.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14093.556837 secs 2024-04-21T14:19:43.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14093.556837 secs 2024-04-21T14:19:43.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14093.556837 secs 2024-04-21T14:19:44.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:44 smithi077 ceph-mon[27902]: pgmap v7608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:44.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:44 smithi191 ceph-mon[31636]: pgmap v7608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:44.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:44 smithi170 ceph-mon[31212]: pgmap v7608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:45.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14095.317184 secs 2024-04-21T14:19:45.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14095.317184 secs 2024-04-21T14:19:45.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14095.317184 secs 2024-04-21T14:19:46.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:46 smithi077 ceph-mon[27902]: pgmap v7609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:46.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:46 smithi191 ceph-mon[31636]: pgmap v7609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:46.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:46 smithi170 ceph-mon[31212]: pgmap v7609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:48.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:48 smithi077 ceph-mon[27902]: pgmap v7610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:48.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14098.556976 secs 2024-04-21T14:19:48.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:48 smithi191 ceph-mon[31636]: pgmap v7610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:48.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14098.556976 secs 2024-04-21T14:19:48.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:48 smithi170 ceph-mon[31212]: pgmap v7610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:48.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14098.556976 secs 2024-04-21T14:19:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:50.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:50 smithi191 ceph-mon[31636]: pgmap v7611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:50.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14100.317302 secs 2024-04-21T14:19:50.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:50 smithi170 ceph-mon[31212]: pgmap v7611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:50.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14100.317302 secs 2024-04-21T14:19:50.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:50 smithi077 ceph-mon[27902]: pgmap v7611: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14100.317302 secs 2024-04-21T14:19:52.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:52 smithi191 ceph-mon[31636]: pgmap v7612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:52 smithi170 ceph-mon[31212]: pgmap v7612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:52.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:52 smithi077 ceph-mon[27902]: pgmap v7612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:19:53.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14103.557072 secs 2024-04-21T14:19:53.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14103.557072 secs 2024-04-21T14:19:53.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14103.557072 secs 2024-04-21T14:19:54.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:54 smithi191 ceph-mon[31636]: pgmap v7613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:54.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:54 smithi170 ceph-mon[31212]: pgmap v7613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:54.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:54 smithi077 ceph-mon[27902]: pgmap v7613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:19:55.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14105.317380 secs 2024-04-21T14:19:55.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14105.317380 secs 2024-04-21T14:19:55.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14105.317380 secs 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.295+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.295+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.296+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.296+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.296+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.296+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.296+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:19:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:19:56.296+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:19:56.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:56 smithi191 ceph-mon[31636]: pgmap v7614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:56.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:56 smithi170 ceph-mon[31212]: pgmap v7614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:56.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:56 smithi077 ceph-mon[27902]: pgmap v7614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:19:58.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:58 smithi191 ceph-mon[31636]: pgmap v7615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:58.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:19:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14108.557149 secs 2024-04-21T14:19:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:58 smithi170 ceph-mon[31212]: pgmap v7615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:19:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14108.557149 secs 2024-04-21T14:19:58.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:58 smithi077 ceph-mon[27902]: pgmap v7615: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:19:58.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:19:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14108.557149 secs 2024-04-21T14:20:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:00.415 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:00 smithi077 ceph-mon[27902]: pgmap v7616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:00.415 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14110.317440 secs 2024-04-21T14:20:00.415 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:20:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:00 smithi191 ceph-mon[31636]: pgmap v7616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14110.317440 secs 2024-04-21T14:20:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:20:00.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:00 smithi170 ceph-mon[31212]: pgmap v7616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:00.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14110.317440 secs 2024-04-21T14:20:00.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:20:02.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:02 smithi191 ceph-mon[31636]: pgmap v7617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:02.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:02 smithi170 ceph-mon[31212]: pgmap v7617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:02.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:02 smithi077 ceph-mon[27902]: pgmap v7617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:03.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14113.557226 secs 2024-04-21T14:20:03.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14113.557226 secs 2024-04-21T14:20:03.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14113.557226 secs 2024-04-21T14:20:04.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:04 smithi191 ceph-mon[31636]: pgmap v7618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:04.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:04 smithi170 ceph-mon[31212]: pgmap v7618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:04.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:04 smithi077 ceph-mon[27902]: pgmap v7618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:05.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14115.317556 secs 2024-04-21T14:20:05.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:05 smithi191 ceph-mon[31636]: osdmap e547: 12 total, 12 up, 12 in 2024-04-21T14:20:05.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14115.317556 secs 2024-04-21T14:20:05.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:05 smithi170 ceph-mon[31212]: osdmap e547: 12 total, 12 up, 12 in 2024-04-21T14:20:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14115.317556 secs 2024-04-21T14:20:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:05 smithi077 ceph-mon[27902]: osdmap e547: 12 total, 12 up, 12 in 2024-04-21T14:20:06.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:06 smithi191 ceph-mon[31636]: pgmap v7620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:20:06.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:06 smithi170 ceph-mon[31212]: pgmap v7620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:20:06.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:06 smithi077 ceph-mon[27902]: pgmap v7620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:20:08.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:08 smithi191 ceph-mon[31636]: pgmap v7621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:08.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14118.557338 secs 2024-04-21T14:20:08.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:08 smithi170 ceph-mon[31212]: pgmap v7621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:08.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14118.557338 secs 2024-04-21T14:20:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:08 smithi077 ceph-mon[27902]: pgmap v7621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14118.557338 secs 2024-04-21T14:20:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:10 smithi191 ceph-mon[31636]: pgmap v7622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14120.317701 secs 2024-04-21T14:20:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:10 smithi191 ceph-mon[31636]: osdmap e548: 12 total, 12 up, 12 in 2024-04-21T14:20:10.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:10 smithi170 ceph-mon[31212]: pgmap v7622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:10.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14120.317701 secs 2024-04-21T14:20:10.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:10 smithi170 ceph-mon[31212]: osdmap e548: 12 total, 12 up, 12 in 2024-04-21T14:20:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:10 smithi077 ceph-mon[27902]: pgmap v7622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14120.317701 secs 2024-04-21T14:20:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:10 smithi077 ceph-mon[27902]: osdmap e548: 12 total, 12 up, 12 in 2024-04-21T14:20:12.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:12 smithi191 ceph-mon[31636]: pgmap v7624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:20:12.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:12 smithi170 ceph-mon[31212]: pgmap v7624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:20:12.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:12 smithi077 ceph-mon[27902]: pgmap v7624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:20:13.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14123.557453 secs 2024-04-21T14:20:13.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14123.557453 secs 2024-04-21T14:20:13.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14123.557453 secs 2024-04-21T14:20:14.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:14 smithi191 ceph-mon[31636]: pgmap v7625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T14:20:14.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:14 smithi170 ceph-mon[31212]: pgmap v7625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T14:20:14.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:14 smithi077 ceph-mon[27902]: pgmap v7625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T14:20:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:15.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14125.317768 secs 2024-04-21T14:20:15.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14125.317768 secs 2024-04-21T14:20:15.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14125.317768 secs 2024-04-21T14:20:16.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:16 smithi170 ceph-mon[31212]: pgmap v7626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:16.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:16 smithi077 ceph-mon[27902]: pgmap v7626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:16.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:16 smithi191 ceph-mon[31636]: pgmap v7626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:20:18.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:18 smithi170 ceph-mon[31212]: pgmap v7627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:20:18.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14128.557539 secs 2024-04-21T14:20:18.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:18 smithi077 ceph-mon[27902]: pgmap v7627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:20:18.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14128.557539 secs 2024-04-21T14:20:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:18 smithi191 ceph-mon[31636]: pgmap v7627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:20:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14128.557539 secs 2024-04-21T14:20:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:20.498 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:20 smithi191 ceph-mon[31636]: pgmap v7628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:20:20.498 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14130.317908 secs 2024-04-21T14:20:20.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:20 smithi170 ceph-mon[31212]: pgmap v7628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:20:20.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14130.317908 secs 2024-04-21T14:20:20.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:20 smithi077 ceph-mon[27902]: pgmap v7628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:20:20.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14130.317908 secs 2024-04-21T14:20:21.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:21 smithi170 ceph-mon[31212]: pgmap v7629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:20:21.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:21 smithi077 ceph-mon[27902]: pgmap v7629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:20:21.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:21 smithi191 ceph-mon[31636]: pgmap v7629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:20:23.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14133.557660 secs 2024-04-21T14:20:23.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:23 smithi170 ceph-mon[31212]: pgmap v7630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:20:23.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14133.557660 secs 2024-04-21T14:20:23.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:23 smithi077 ceph-mon[27902]: pgmap v7630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:20:23.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14133.557660 secs 2024-04-21T14:20:23.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:23 smithi191 ceph-mon[31636]: pgmap v7630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:20:24.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14135.317946 secs 2024-04-21T14:20:24.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14135.317946 secs 2024-04-21T14:20:24.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14135.317946 secs 2024-04-21T14:20:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:25.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:25 smithi170 ceph-mon[31212]: pgmap v7631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:25.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:25 smithi077 ceph-mon[27902]: pgmap v7631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:25.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:25 smithi191 ceph-mon[31636]: pgmap v7631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:27.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:27 smithi170 ceph-mon[31212]: pgmap v7632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:27.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:27 smithi077 ceph-mon[27902]: pgmap v7632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:27.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:27 smithi191 ceph-mon[31636]: pgmap v7632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:28.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14138.557792 secs 2024-04-21T14:20:28.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14138.557792 secs 2024-04-21T14:20:28.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14138.557792 secs 2024-04-21T14:20:29.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:29 smithi077 ceph-mon[27902]: pgmap v7633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:29.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14140.318062 secs 2024-04-21T14:20:29.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:29 smithi191 ceph-mon[31636]: pgmap v7633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:29.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14140.318062 secs 2024-04-21T14:20:29.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:29 smithi170 ceph-mon[31212]: pgmap v7633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:29.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14140.318062 secs 2024-04-21T14:20:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:31.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:31 smithi077 ceph-mon[27902]: pgmap v7634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:31.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:31 smithi191 ceph-mon[31636]: pgmap v7634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:31.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:31 smithi170 ceph-mon[31212]: pgmap v7634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:33.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14143.557912 secs 2024-04-21T14:20:33.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:33 smithi077 ceph-mon[27902]: pgmap v7635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:33.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14143.557912 secs 2024-04-21T14:20:33.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:33 smithi191 ceph-mon[31636]: pgmap v7635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:33.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14143.557912 secs 2024-04-21T14:20:33.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:33 smithi170 ceph-mon[31212]: pgmap v7635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:34.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14145.318122 secs 2024-04-21T14:20:34.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14145.318122 secs 2024-04-21T14:20:34.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14145.318122 secs 2024-04-21T14:20:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:35 smithi077 ceph-mon[27902]: pgmap v7636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:20:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:20:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:20:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:20:35.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:35 smithi191 ceph-mon[31636]: pgmap v7636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:35.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:20:35.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:20:35.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:20:35.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:20:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:35 smithi170 ceph-mon[31212]: pgmap v7636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:20:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:20:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:20:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:20:37.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:37 smithi077 ceph-mon[27902]: pgmap v7637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:37.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:37 smithi191 ceph-mon[31636]: pgmap v7637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:37.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:37 smithi170 ceph-mon[31212]: pgmap v7637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:38.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14148.558049 secs 2024-04-21T14:20:38.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14148.558049 secs 2024-04-21T14:20:38.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14148.558049 secs 2024-04-21T14:20:39.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:39 smithi077 ceph-mon[27902]: pgmap v7638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:39.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14150.318208 secs 2024-04-21T14:20:39.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:39 smithi191 ceph-mon[31636]: pgmap v7638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:39.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14150.318208 secs 2024-04-21T14:20:39.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:39 smithi170 ceph-mon[31212]: pgmap v7638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:39.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14150.318208 secs 2024-04-21T14:20:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:41 smithi077 ceph-mon[27902]: pgmap v7639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:41 smithi191 ceph-mon[31636]: pgmap v7639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:41 smithi170 ceph-mon[31212]: pgmap v7639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:43.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14153.558163 secs 2024-04-21T14:20:43.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:43 smithi077 ceph-mon[27902]: pgmap v7640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14153.558163 secs 2024-04-21T14:20:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:43 smithi191 ceph-mon[31636]: pgmap v7640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:43.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14153.558163 secs 2024-04-21T14:20:43.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:43 smithi170 ceph-mon[31212]: pgmap v7640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:44.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14155.318286 secs 2024-04-21T14:20:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14155.318286 secs 2024-04-21T14:20:44.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14155.318286 secs 2024-04-21T14:20:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:45.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:45 smithi077 ceph-mon[27902]: pgmap v7641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:45.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:45 smithi191 ceph-mon[31636]: pgmap v7641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:45.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:45 smithi170 ceph-mon[31212]: pgmap v7641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:47.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:47 smithi077 ceph-mon[27902]: pgmap v7642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:47.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:47 smithi191 ceph-mon[31636]: pgmap v7642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:47.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:47 smithi170 ceph-mon[31212]: pgmap v7642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:48.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14158.558236 secs 2024-04-21T14:20:48.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14158.558236 secs 2024-04-21T14:20:48.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14158.558236 secs 2024-04-21T14:20:49.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:49 smithi077 ceph-mon[27902]: pgmap v7643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:49.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14160.318440 secs 2024-04-21T14:20:49.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:49 smithi191 ceph-mon[31636]: pgmap v7643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:49.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14160.318440 secs 2024-04-21T14:20:49.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:49 smithi170 ceph-mon[31212]: pgmap v7643: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:49.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14160.318440 secs 2024-04-21T14:20:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:51.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:51 smithi077 ceph-mon[27902]: pgmap v7644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:51.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:51 smithi191 ceph-mon[31636]: pgmap v7644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:51.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:51 smithi170 ceph-mon[31212]: pgmap v7644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:20:53.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14163.558369 secs 2024-04-21T14:20:53.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:53 smithi077 ceph-mon[27902]: pgmap v7645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14163.558369 secs 2024-04-21T14:20:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:53 smithi191 ceph-mon[31636]: pgmap v7645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:53.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14163.558369 secs 2024-04-21T14:20:53.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:53 smithi170 ceph-mon[31212]: pgmap v7645: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:54.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14165.318575 secs 2024-04-21T14:20:54.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14165.318575 secs 2024-04-21T14:20:54.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14165.318575 secs 2024-04-21T14:20:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:20:55.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:55 smithi077 ceph-mon[27902]: pgmap v7646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:55.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:55 smithi191 ceph-mon[31636]: pgmap v7646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:55.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:55 smithi170 ceph-mon[31212]: pgmap v7646: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:57.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:57 smithi077 ceph-mon[27902]: pgmap v7647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:57.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:57 smithi191 ceph-mon[31636]: pgmap v7647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:57.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:57 smithi170 ceph-mon[31212]: pgmap v7647: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:20:58.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14168.558483 secs 2024-04-21T14:20:58.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14168.558483 secs 2024-04-21T14:20:58.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14168.558483 secs 2024-04-21T14:20:59.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:59 smithi191 ceph-mon[31636]: pgmap v7648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:59.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14170.318713 secs 2024-04-21T14:20:59.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:59 smithi170 ceph-mon[31212]: pgmap v7648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:59.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14170.318713 secs 2024-04-21T14:20:59.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:59 smithi077 ceph-mon[27902]: pgmap v7648: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:20:59.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14170.318713 secs 2024-04-21T14:21:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:01.664 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:01 smithi077 ceph-mon[27902]: pgmap v7649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:21:01.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:01 smithi191 ceph-mon[31636]: pgmap v7649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:21:01.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:01 smithi170 ceph-mon[31212]: pgmap v7649: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T14:21:03.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14173.558599 secs 2024-04-21T14:21:03.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:03 smithi191 ceph-mon[31636]: pgmap v7650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:03.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14173.558599 secs 2024-04-21T14:21:03.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:03 smithi170 ceph-mon[31212]: pgmap v7650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:03.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14173.558599 secs 2024-04-21T14:21:03.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:03 smithi077 ceph-mon[27902]: pgmap v7650: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:04.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14175.318846 secs 2024-04-21T14:21:04.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14175.318846 secs 2024-04-21T14:21:04.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14175.318846 secs 2024-04-21T14:21:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:05.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:05 smithi191 ceph-mon[31636]: pgmap v7651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:05.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:05 smithi191 ceph-mon[31636]: osdmap e549: 12 total, 12 up, 12 in 2024-04-21T14:21:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:05 smithi170 ceph-mon[31212]: pgmap v7651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:05 smithi170 ceph-mon[31212]: osdmap e549: 12 total, 12 up, 12 in 2024-04-21T14:21:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:05 smithi077 ceph-mon[27902]: pgmap v7651: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:05.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:05 smithi077 ceph-mon[27902]: osdmap e549: 12 total, 12 up, 12 in 2024-04-21T14:21:07.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:07 smithi191 ceph-mon[31636]: pgmap v7653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:21:07.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:07 smithi170 ceph-mon[31212]: pgmap v7653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:21:07.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:07 smithi077 ceph-mon[27902]: pgmap v7653: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:21:08.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14178.558706 secs 2024-04-21T14:21:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14178.558706 secs 2024-04-21T14:21:08.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14178.558706 secs 2024-04-21T14:21:09.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:09 smithi191 ceph-mon[31636]: pgmap v7654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:21:09.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14180.318919 secs 2024-04-21T14:21:09.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:09 smithi191 ceph-mon[31636]: osdmap e550: 12 total, 12 up, 12 in 2024-04-21T14:21:09.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:09 smithi170 ceph-mon[31212]: pgmap v7654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:21:09.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14180.318919 secs 2024-04-21T14:21:09.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:09 smithi170 ceph-mon[31212]: osdmap e550: 12 total, 12 up, 12 in 2024-04-21T14:21:09.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:09 smithi077 ceph-mon[27902]: pgmap v7654: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:21:09.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14180.318919 secs 2024-04-21T14:21:09.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:09 smithi077 ceph-mon[27902]: osdmap e550: 12 total, 12 up, 12 in 2024-04-21T14:21:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:11.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:11 smithi191 ceph-mon[31636]: pgmap v7656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:21:11.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:11 smithi170 ceph-mon[31212]: pgmap v7656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:21:11.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:11 smithi077 ceph-mon[27902]: pgmap v7656: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T14:21:13.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14183.558802 secs 2024-04-21T14:21:13.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:13 smithi191 ceph-mon[31636]: pgmap v7657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:21:13.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14183.558802 secs 2024-04-21T14:21:13.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:13 smithi170 ceph-mon[31212]: pgmap v7657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:21:13.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14183.558802 secs 2024-04-21T14:21:13.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:13 smithi077 ceph-mon[27902]: pgmap v7657: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:21:14.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14185.319052 secs 2024-04-21T14:21:14.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14185.319052 secs 2024-04-21T14:21:14.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14185.319052 secs 2024-04-21T14:21:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:15.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:15 smithi191 ceph-mon[31636]: pgmap v7658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:21:15.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:15 smithi170 ceph-mon[31212]: pgmap v7658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:21:15.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:15 smithi077 ceph-mon[27902]: pgmap v7658: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:21:17.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:17 smithi191 ceph-mon[31636]: pgmap v7659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:21:17.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:17 smithi170 ceph-mon[31212]: pgmap v7659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:21:17.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:17 smithi077 ceph-mon[27902]: pgmap v7659: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:21:18.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14188.558920 secs 2024-04-21T14:21:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14188.558920 secs 2024-04-21T14:21:18.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14188.558920 secs 2024-04-21T14:21:19.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:19 smithi191 ceph-mon[31636]: pgmap v7660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:21:19.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14190.319163 secs 2024-04-21T14:21:19.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:19 smithi170 ceph-mon[31212]: pgmap v7660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:21:19.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14190.319163 secs 2024-04-21T14:21:19.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:19 smithi077 ceph-mon[27902]: pgmap v7660: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:21:19.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14190.319163 secs 2024-04-21T14:21:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:21.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:21 smithi191 ceph-mon[31636]: pgmap v7661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:21:21.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:21 smithi170 ceph-mon[31212]: pgmap v7661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:21:21.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:21 smithi077 ceph-mon[27902]: pgmap v7661: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 6 op/s 2024-04-21T14:21:23.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14193.559029 secs 2024-04-21T14:21:23.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:23 smithi191 ceph-mon[31636]: pgmap v7662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:21:23.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14193.559029 secs 2024-04-21T14:21:23.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:23 smithi170 ceph-mon[31212]: pgmap v7662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:21:23.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14193.559029 secs 2024-04-21T14:21:23.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:23 smithi077 ceph-mon[27902]: pgmap v7662: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T14:21:24.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14195.319264 secs 2024-04-21T14:21:24.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14195.319264 secs 2024-04-21T14:21:24.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14195.319264 secs 2024-04-21T14:21:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:25.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:25 smithi191 ceph-mon[31636]: pgmap v7663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:25.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:25 smithi170 ceph-mon[31212]: pgmap v7663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:25.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:25 smithi077 ceph-mon[27902]: pgmap v7663: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:27.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:27 smithi191 ceph-mon[31636]: pgmap v7664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:27.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:27 smithi170 ceph-mon[31212]: pgmap v7664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:27.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:27 smithi077 ceph-mon[27902]: pgmap v7664: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:28.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14198.559138 secs 2024-04-21T14:21:28.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14198.559138 secs 2024-04-21T14:21:28.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14198.559138 secs 2024-04-21T14:21:29.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:29 smithi191 ceph-mon[31636]: pgmap v7665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:21:29.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14200.319407 secs 2024-04-21T14:21:29.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:29 smithi170 ceph-mon[31212]: pgmap v7665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:21:29.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14200.319407 secs 2024-04-21T14:21:29.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:29 smithi077 ceph-mon[27902]: pgmap v7665: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:21:29.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14200.319407 secs 2024-04-21T14:21:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:31.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:31 smithi191 ceph-mon[31636]: pgmap v7666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:31.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:31 smithi170 ceph-mon[31212]: pgmap v7666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:31.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:31 smithi077 ceph-mon[27902]: pgmap v7666: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:33.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14203.559257 secs 2024-04-21T14:21:33.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:33 smithi191 ceph-mon[31636]: pgmap v7667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-04-21T14:21:33.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14203.559257 secs 2024-04-21T14:21:33.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:33 smithi170 ceph-mon[31212]: pgmap v7667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-04-21T14:21:33.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14203.559257 secs 2024-04-21T14:21:33.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:33 smithi077 ceph-mon[27902]: pgmap v7667: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-04-21T14:21:34.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14205.319541 secs 2024-04-21T14:21:34.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14205.319541 secs 2024-04-21T14:21:34.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14205.319541 secs 2024-04-21T14:21:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:35.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:35 smithi170 ceph-mon[31212]: pgmap v7668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:21:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:21:35.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:35 smithi077 ceph-mon[27902]: pgmap v7668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:21:35.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:21:35.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:35 smithi191 ceph-mon[31636]: pgmap v7668: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:21:35.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:21:36.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:21:36.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:21:36.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:21:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:21:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:21:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:21:36.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:21:36.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:21:36.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:21:38.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:37 smithi191 ceph-mon[31636]: pgmap v7669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:38.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14208.559368 secs 2024-04-21T14:21:38.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:37 smithi170 ceph-mon[31212]: pgmap v7669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:38.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14208.559368 secs 2024-04-21T14:21:38.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:37 smithi077 ceph-mon[27902]: pgmap v7669: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:21:38.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14208.559368 secs 2024-04-21T14:21:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:40.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:39 smithi191 ceph-mon[31636]: pgmap v7670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:40.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14210.319663 secs 2024-04-21T14:21:40.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:39 smithi170 ceph-mon[31212]: pgmap v7670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:40.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14210.319663 secs 2024-04-21T14:21:40.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:39 smithi077 ceph-mon[27902]: pgmap v7670: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:40.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14210.319663 secs 2024-04-21T14:21:42.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:41 smithi191 ceph-mon[31636]: pgmap v7671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:42.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:41 smithi170 ceph-mon[31212]: pgmap v7671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:42.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:41 smithi077 ceph-mon[27902]: pgmap v7671: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:43.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14213.559479 secs 2024-04-21T14:21:43.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14213.559479 secs 2024-04-21T14:21:43.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14213.559479 secs 2024-04-21T14:21:44.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:43 smithi191 ceph-mon[31636]: pgmap v7672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:44.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:43 smithi170 ceph-mon[31212]: pgmap v7672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:44.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:43 smithi077 ceph-mon[27902]: pgmap v7672: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:45.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14215.319778 secs 2024-04-21T14:21:45.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14215.319778 secs 2024-04-21T14:21:45.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14215.319778 secs 2024-04-21T14:21:46.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:45 smithi191 ceph-mon[31636]: pgmap v7673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:46.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:45 smithi170 ceph-mon[31212]: pgmap v7673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:46.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:45 smithi077 ceph-mon[27902]: pgmap v7673: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:48.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:47 smithi191 ceph-mon[31636]: pgmap v7674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:48.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14218.559613 secs 2024-04-21T14:21:48.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:47 smithi170 ceph-mon[31212]: pgmap v7674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:48.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14218.559613 secs 2024-04-21T14:21:48.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:47 smithi077 ceph-mon[27902]: pgmap v7674: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:48.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14218.559613 secs 2024-04-21T14:21:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:50.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:49 smithi191 ceph-mon[31636]: pgmap v7675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:50.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14220.319890 secs 2024-04-21T14:21:50.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:49 smithi170 ceph-mon[31212]: pgmap v7675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:50.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14220.319890 secs 2024-04-21T14:21:50.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:49 smithi077 ceph-mon[27902]: pgmap v7675: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:50.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14220.319890 secs 2024-04-21T14:21:52.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:51 smithi191 ceph-mon[31636]: pgmap v7676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:52.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:51 smithi170 ceph-mon[31212]: pgmap v7676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:52.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:51 smithi077 ceph-mon[27902]: pgmap v7676: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:53.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14223.559730 secs 2024-04-21T14:21:53.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14223.559730 secs 2024-04-21T14:21:53.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14223.559730 secs 2024-04-21T14:21:54.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:53 smithi170 ceph-mon[31212]: pgmap v7677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:54.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:53 smithi077 ceph-mon[27902]: pgmap v7677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:54.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:53 smithi191 ceph-mon[31636]: pgmap v7677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:21:55.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14225.320005 secs 2024-04-21T14:21:55.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14225.320005 secs 2024-04-21T14:21:55.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14225.320005 secs 2024-04-21T14:21:56.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:55 smithi170 ceph-mon[31212]: pgmap v7678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:56.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:55 smithi077 ceph-mon[27902]: pgmap v7678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:56.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:55 smithi191 ceph-mon[31636]: pgmap v7678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:21:58.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:57 smithi170 ceph-mon[31212]: pgmap v7679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:58.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14228.559839 secs 2024-04-21T14:21:58.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:57 smithi077 ceph-mon[27902]: pgmap v7679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:58.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14228.559839 secs 2024-04-21T14:21:58.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:57 smithi191 ceph-mon[31636]: pgmap v7679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:21:58.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14228.559839 secs 2024-04-21T14:22:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:00.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:59 smithi170 ceph-mon[31212]: pgmap v7680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:00.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14230.320124 secs 2024-04-21T14:22:00.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:59 smithi077 ceph-mon[27902]: pgmap v7680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:00.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14230.320124 secs 2024-04-21T14:22:00.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:59 smithi191 ceph-mon[31636]: pgmap v7680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:00.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14230.320124 secs 2024-04-21T14:22:02.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:01 smithi170 ceph-mon[31212]: pgmap v7681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:02.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:01 smithi077 ceph-mon[27902]: pgmap v7681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:02.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:01 smithi191 ceph-mon[31636]: pgmap v7681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:03.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14233.559973 secs 2024-04-21T14:22:03.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14233.559973 secs 2024-04-21T14:22:03.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14233.559973 secs 2024-04-21T14:22:04.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:04 smithi170 ceph-mon[31212]: pgmap v7682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:04.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:04 smithi077 ceph-mon[27902]: pgmap v7682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:04.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:04 smithi191 ceph-mon[31636]: pgmap v7682: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:05.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14235.320197 secs 2024-04-21T14:22:05.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:05 smithi170 ceph-mon[31212]: osdmap e551: 12 total, 12 up, 12 in 2024-04-21T14:22:05.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14235.320197 secs 2024-04-21T14:22:05.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:05 smithi077 ceph-mon[27902]: osdmap e551: 12 total, 12 up, 12 in 2024-04-21T14:22:05.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14235.320197 secs 2024-04-21T14:22:05.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:05 smithi191 ceph-mon[31636]: osdmap e551: 12 total, 12 up, 12 in 2024-04-21T14:22:06.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:06 smithi170 ceph-mon[31212]: pgmap v7684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:22:06.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:06 smithi077 ceph-mon[27902]: pgmap v7684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:22:06.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:06 smithi191 ceph-mon[31636]: pgmap v7684: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:22:08.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:08 smithi170 ceph-mon[31212]: pgmap v7685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:22:08.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14238.560086 secs 2024-04-21T14:22:08.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:08 smithi077 ceph-mon[27902]: pgmap v7685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:22:08.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14238.560086 secs 2024-04-21T14:22:08.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:08 smithi191 ceph-mon[31636]: pgmap v7685: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:22:08.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14238.560086 secs 2024-04-21T14:22:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:10.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:10 smithi170 ceph-mon[31212]: pgmap v7686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:22:10.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14240.320317 secs 2024-04-21T14:22:10.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:10 smithi170 ceph-mon[31212]: osdmap e552: 12 total, 12 up, 12 in 2024-04-21T14:22:10.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:10 smithi077 ceph-mon[27902]: pgmap v7686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:22:10.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14240.320317 secs 2024-04-21T14:22:10.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:10 smithi077 ceph-mon[27902]: osdmap e552: 12 total, 12 up, 12 in 2024-04-21T14:22:10.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:10 smithi191 ceph-mon[31636]: pgmap v7686: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:22:10.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14240.320317 secs 2024-04-21T14:22:10.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:10 smithi191 ceph-mon[31636]: osdmap e552: 12 total, 12 up, 12 in 2024-04-21T14:22:12.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:12 smithi170 ceph-mon[31212]: pgmap v7688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:22:12.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:12 smithi077 ceph-mon[27902]: pgmap v7688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:22:12.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:12 smithi191 ceph-mon[31636]: pgmap v7688: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:22:13.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14243.560206 secs 2024-04-21T14:22:13.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14243.560206 secs 2024-04-21T14:22:13.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14243.560206 secs 2024-04-21T14:22:14.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:14 smithi170 ceph-mon[31212]: pgmap v7689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:22:14.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:14 smithi077 ceph-mon[27902]: pgmap v7689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:22:14.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:14 smithi191 ceph-mon[31636]: pgmap v7689: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:22:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:15.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14245.320433 secs 2024-04-21T14:22:15.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14245.320433 secs 2024-04-21T14:22:15.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14245.320433 secs 2024-04-21T14:22:16.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:16 smithi170 ceph-mon[31212]: pgmap v7690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:22:16.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:16 smithi077 ceph-mon[27902]: pgmap v7690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:22:16.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:16 smithi191 ceph-mon[31636]: pgmap v7690: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:22:18.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:18 smithi170 ceph-mon[31212]: pgmap v7691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:22:18.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14248.560320 secs 2024-04-21T14:22:18.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:18 smithi077 ceph-mon[27902]: pgmap v7691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:22:18.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14248.560320 secs 2024-04-21T14:22:18.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:18 smithi191 ceph-mon[31636]: pgmap v7691: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:22:18.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14248.560320 secs 2024-04-21T14:22:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:20.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:20 smithi170 ceph-mon[31212]: pgmap v7692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:22:20.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14250.320548 secs 2024-04-21T14:22:20.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:20 smithi077 ceph-mon[27902]: pgmap v7692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:22:20.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14250.320548 secs 2024-04-21T14:22:20.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:20 smithi191 ceph-mon[31636]: pgmap v7692: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:22:20.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14250.320548 secs 2024-04-21T14:22:22.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:22 smithi170 ceph-mon[31212]: pgmap v7693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:22:22.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:22 smithi077 ceph-mon[27902]: pgmap v7693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:22:22.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:22 smithi191 ceph-mon[31636]: pgmap v7693: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:22:23.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14253.560458 secs 2024-04-21T14:22:23.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14253.560458 secs 2024-04-21T14:22:23.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14253.560458 secs 2024-04-21T14:22:24.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:24 smithi077 ceph-mon[27902]: pgmap v7694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:24.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:24 smithi191 ceph-mon[31636]: pgmap v7694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:24.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:24 smithi170 ceph-mon[31212]: pgmap v7694: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:25.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:25.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14255.320645 secs 2024-04-21T14:22:25.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14255.320645 secs 2024-04-21T14:22:25.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14255.320645 secs 2024-04-21T14:22:26.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:26 smithi077 ceph-mon[27902]: pgmap v7695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:26.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:26 smithi191 ceph-mon[31636]: pgmap v7695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:26.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:26 smithi170 ceph-mon[31212]: pgmap v7695: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:28.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:28 smithi077 ceph-mon[27902]: pgmap v7696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:28.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14258.560572 secs 2024-04-21T14:22:28.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:28 smithi191 ceph-mon[31636]: pgmap v7696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:28.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14258.560572 secs 2024-04-21T14:22:28.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:28 smithi170 ceph-mon[31212]: pgmap v7696: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:28.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14258.560572 secs 2024-04-21T14:22:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:30.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:30 smithi077 ceph-mon[27902]: pgmap v7697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:30.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14260.320780 secs 2024-04-21T14:22:30.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:30 smithi191 ceph-mon[31636]: pgmap v7697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:30.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14260.320780 secs 2024-04-21T14:22:30.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:30 smithi170 ceph-mon[31212]: pgmap v7697: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:30.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14260.320780 secs 2024-04-21T14:22:32.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:32 smithi077 ceph-mon[27902]: pgmap v7698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:32.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:32 smithi191 ceph-mon[31636]: pgmap v7698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:32.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:32 smithi170 ceph-mon[31212]: pgmap v7698: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:33.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14263.560685 secs 2024-04-21T14:22:33.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14263.560685 secs 2024-04-21T14:22:33.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14263.560685 secs 2024-04-21T14:22:34.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:34 smithi077 ceph-mon[27902]: pgmap v7699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:34.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:34 smithi191 ceph-mon[31636]: pgmap v7699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:34.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:34 smithi170 ceph-mon[31212]: pgmap v7699: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:35.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14265.320840 secs 2024-04-21T14:22:35.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14265.320840 secs 2024-04-21T14:22:35.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14265.320840 secs 2024-04-21T14:22:36.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:36 smithi077 ceph-mon[27902]: pgmap v7700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:36.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:22:36.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:36 smithi191 ceph-mon[31636]: pgmap v7700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:36.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:22:36.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:36 smithi170 ceph-mon[31212]: pgmap v7700: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:36.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:22:38.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:38 smithi077 ceph-mon[27902]: pgmap v7701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:38.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14268.560838 secs 2024-04-21T14:22:38.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:38 smithi191 ceph-mon[31636]: pgmap v7701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:38.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14268.560838 secs 2024-04-21T14:22:38.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:38 smithi170 ceph-mon[31212]: pgmap v7701: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:38.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14268.560838 secs 2024-04-21T14:22:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:40.308 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:40 smithi077 ceph-mon[27902]: pgmap v7702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:40.308 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14270.320954 secs 2024-04-21T14:22:40.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:40 smithi191 ceph-mon[31636]: pgmap v7702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:40.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14270.320954 secs 2024-04-21T14:22:40.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:40 smithi170 ceph-mon[31212]: pgmap v7702: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:40.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14270.320954 secs 2024-04-21T14:22:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:41 smithi077 ceph-mon[27902]: pgmap v7703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:22:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:22:41.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:41 smithi191 ceph-mon[31636]: pgmap v7703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:22:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:22:41.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:41 smithi170 ceph-mon[31212]: pgmap v7703: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:22:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:22:41.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:22:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14273.560934 secs 2024-04-21T14:22:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:43 smithi191 ceph-mon[31636]: pgmap v7704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:43.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14273.560934 secs 2024-04-21T14:22:43.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:43 smithi170 ceph-mon[31212]: pgmap v7704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:43.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14273.560934 secs 2024-04-21T14:22:43.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:43 smithi077 ceph-mon[27902]: pgmap v7704: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14275.321088 secs 2024-04-21T14:22:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14275.321088 secs 2024-04-21T14:22:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14275.321088 secs 2024-04-21T14:22:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:45.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:45 smithi191 ceph-mon[31636]: pgmap v7705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:45.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:45 smithi170 ceph-mon[31212]: pgmap v7705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:45.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:45 smithi077 ceph-mon[27902]: pgmap v7705: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:47.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:47 smithi191 ceph-mon[31636]: pgmap v7706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:47.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:47 smithi170 ceph-mon[31212]: pgmap v7706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:47.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:47 smithi077 ceph-mon[27902]: pgmap v7706: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:48.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14278.560998 secs 2024-04-21T14:22:48.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14278.560998 secs 2024-04-21T14:22:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14278.560998 secs 2024-04-21T14:22:49.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:49 smithi191 ceph-mon[31636]: pgmap v7707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:49.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14280.321210 secs 2024-04-21T14:22:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:49 smithi170 ceph-mon[31212]: pgmap v7707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14280.321210 secs 2024-04-21T14:22:49.851 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:49 smithi077 ceph-mon[27902]: pgmap v7707: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:49.851 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14280.321210 secs 2024-04-21T14:22:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:51.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:51 smithi191 ceph-mon[31636]: pgmap v7708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:51.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:51 smithi170 ceph-mon[31212]: pgmap v7708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:51.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:51 smithi077 ceph-mon[27902]: pgmap v7708: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14283.561116 secs 2024-04-21T14:22:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:53 smithi191 ceph-mon[31636]: pgmap v7709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:53.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14283.561116 secs 2024-04-21T14:22:53.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:53 smithi170 ceph-mon[31212]: pgmap v7709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:53.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14283.561116 secs 2024-04-21T14:22:53.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:53 smithi077 ceph-mon[27902]: pgmap v7709: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:54.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14285.321340 secs 2024-04-21T14:22:54.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14285.321340 secs 2024-04-21T14:22:54.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14285.321340 secs 2024-04-21T14:22:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:22:55.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:55 smithi191 ceph-mon[31636]: pgmap v7710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:55.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:55 smithi170 ceph-mon[31212]: pgmap v7710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:55.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:55 smithi077 ceph-mon[27902]: pgmap v7710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:22:56.320+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:22:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:22:56.320+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:22:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:22:56.320+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:22:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:22:56.320+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:22:57.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:57 smithi191 ceph-mon[31636]: pgmap v7711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:57.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:57 smithi170 ceph-mon[31212]: pgmap v7711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:57.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:57 smithi077 ceph-mon[27902]: pgmap v7711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:22:58.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14288.561231 secs 2024-04-21T14:22:58.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14288.561231 secs 2024-04-21T14:22:58.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14288.561231 secs 2024-04-21T14:22:59.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:59 smithi191 ceph-mon[31636]: pgmap v7712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:59.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14290.321462 secs 2024-04-21T14:22:59.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:59 smithi170 ceph-mon[31212]: pgmap v7712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:59.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14290.321462 secs 2024-04-21T14:22:59.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:59 smithi077 ceph-mon[27902]: pgmap v7712: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:22:59.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14290.321462 secs 2024-04-21T14:23:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:01.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:01 smithi191 ceph-mon[31636]: pgmap v7713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:01.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:01 smithi170 ceph-mon[31212]: pgmap v7713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:01.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:01 smithi077 ceph-mon[27902]: pgmap v7713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:03.664 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14293.561364 secs 2024-04-21T14:23:03.664 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:03 smithi077 ceph-mon[27902]: pgmap v7714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:03.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14293.561364 secs 2024-04-21T14:23:03.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:03 smithi191 ceph-mon[31636]: pgmap v7714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:03.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14293.561364 secs 2024-04-21T14:23:03.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:03 smithi170 ceph-mon[31212]: pgmap v7714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:04.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14295.321589 secs 2024-04-21T14:23:04.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14295.321589 secs 2024-04-21T14:23:04.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14295.321589 secs 2024-04-21T14:23:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:05.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:05 smithi191 ceph-mon[31636]: pgmap v7715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:05.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:05 smithi191 ceph-mon[31636]: osdmap e553: 12 total, 12 up, 12 in 2024-04-21T14:23:05.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:05 smithi170 ceph-mon[31212]: pgmap v7715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:05.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:05 smithi170 ceph-mon[31212]: osdmap e553: 12 total, 12 up, 12 in 2024-04-21T14:23:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:05 smithi077 ceph-mon[27902]: pgmap v7715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:05 smithi077 ceph-mon[27902]: osdmap e553: 12 total, 12 up, 12 in 2024-04-21T14:23:07.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:07 smithi191 ceph-mon[31636]: pgmap v7717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:23:07.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:07 smithi170 ceph-mon[31212]: pgmap v7717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:23:07.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:07 smithi077 ceph-mon[27902]: pgmap v7717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:23:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14298.561425 secs 2024-04-21T14:23:08.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14298.561425 secs 2024-04-21T14:23:08.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14298.561425 secs 2024-04-21T14:23:09.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:09 smithi191 ceph-mon[31636]: pgmap v7718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:23:09.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14300.321654 secs 2024-04-21T14:23:09.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:09 smithi191 ceph-mon[31636]: osdmap e554: 12 total, 12 up, 12 in 2024-04-21T14:23:09.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:09 smithi170 ceph-mon[31212]: pgmap v7718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:23:09.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14300.321654 secs 2024-04-21T14:23:09.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:09 smithi170 ceph-mon[31212]: osdmap e554: 12 total, 12 up, 12 in 2024-04-21T14:23:09.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:09 smithi077 ceph-mon[27902]: pgmap v7718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:23:09.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14300.321654 secs 2024-04-21T14:23:09.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:09 smithi077 ceph-mon[27902]: osdmap e554: 12 total, 12 up, 12 in 2024-04-21T14:23:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:11.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:11 smithi191 ceph-mon[31636]: pgmap v7720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:23:11.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:11 smithi170 ceph-mon[31212]: pgmap v7720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:23:11.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:11 smithi077 ceph-mon[27902]: pgmap v7720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:23:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14303.561548 secs 2024-04-21T14:23:13.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:13 smithi191 ceph-mon[31636]: pgmap v7721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:23:13.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14303.561548 secs 2024-04-21T14:23:13.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:13 smithi170 ceph-mon[31212]: pgmap v7721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:23:13.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14303.561548 secs 2024-04-21T14:23:13.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:13 smithi077 ceph-mon[27902]: pgmap v7721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:23:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14305.321764 secs 2024-04-21T14:23:14.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14305.321764 secs 2024-04-21T14:23:14.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14305.321764 secs 2024-04-21T14:23:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:15.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:15 smithi170 ceph-mon[31212]: pgmap v7722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:23:15.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:15 smithi077 ceph-mon[27902]: pgmap v7722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:23:15.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:15 smithi191 ceph-mon[31636]: pgmap v7722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T14:23:17.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:17 smithi170 ceph-mon[31212]: pgmap v7723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:23:17.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:17 smithi077 ceph-mon[27902]: pgmap v7723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:23:17.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:17 smithi191 ceph-mon[31636]: pgmap v7723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:23:18.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14308.561678 secs 2024-04-21T14:23:18.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14308.561678 secs 2024-04-21T14:23:18.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14308.561678 secs 2024-04-21T14:23:19.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:19 smithi170 ceph-mon[31212]: pgmap v7724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:23:19.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14310.321880 secs 2024-04-21T14:23:19.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:19 smithi077 ceph-mon[27902]: pgmap v7724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:23:19.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14310.321880 secs 2024-04-21T14:23:19.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:19 smithi191 ceph-mon[31636]: pgmap v7724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:23:19.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14310.321880 secs 2024-04-21T14:23:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:21.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:21 smithi170 ceph-mon[31212]: pgmap v7725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:23:21.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:21 smithi077 ceph-mon[27902]: pgmap v7725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:23:21.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:21 smithi191 ceph-mon[31636]: pgmap v7725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:23:23.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14313.561796 secs 2024-04-21T14:23:23.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:23 smithi191 ceph-mon[31636]: pgmap v7726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:23.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14313.561796 secs 2024-04-21T14:23:23.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:23 smithi170 ceph-mon[31212]: pgmap v7726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:23.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14313.561796 secs 2024-04-21T14:23:23.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:23 smithi077 ceph-mon[27902]: pgmap v7726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:24.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14315.321927 secs 2024-04-21T14:23:24.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14315.321927 secs 2024-04-21T14:23:24.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14315.321927 secs 2024-04-21T14:23:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:25.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:25 smithi170 ceph-mon[31212]: pgmap v7727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:25.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:25 smithi077 ceph-mon[27902]: pgmap v7727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:25.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:25 smithi191 ceph-mon[31636]: pgmap v7727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:27.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:27 smithi170 ceph-mon[31212]: pgmap v7728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:27.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:27 smithi077 ceph-mon[27902]: pgmap v7728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:27.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:27 smithi191 ceph-mon[31636]: pgmap v7728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:28.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14318.561908 secs 2024-04-21T14:23:28.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14318.561908 secs 2024-04-21T14:23:28.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14318.561908 secs 2024-04-21T14:23:29.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:29 smithi170 ceph-mon[31212]: pgmap v7729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:29.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14320.321990 secs 2024-04-21T14:23:29.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:29 smithi077 ceph-mon[27902]: pgmap v7729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:29.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14320.321990 secs 2024-04-21T14:23:29.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:29 smithi191 ceph-mon[31636]: pgmap v7729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:29.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14320.321990 secs 2024-04-21T14:23:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:31.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:31 smithi170 ceph-mon[31212]: pgmap v7730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:31.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:31 smithi077 ceph-mon[27902]: pgmap v7730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:31.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:31 smithi191 ceph-mon[31636]: pgmap v7730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:33.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14323.561971 secs 2024-04-21T14:23:33.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:33 smithi170 ceph-mon[31212]: pgmap v7731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:33.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14323.561971 secs 2024-04-21T14:23:33.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:33 smithi077 ceph-mon[27902]: pgmap v7731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:33.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14323.561971 secs 2024-04-21T14:23:33.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:33 smithi191 ceph-mon[31636]: pgmap v7731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:34.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14325.322052 secs 2024-04-21T14:23:34.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14325.322052 secs 2024-04-21T14:23:34.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14325.322052 secs 2024-04-21T14:23:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:35.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:35 smithi170 ceph-mon[31212]: pgmap v7732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:35.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:35 smithi077 ceph-mon[27902]: pgmap v7732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:35.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:35 smithi191 ceph-mon[31636]: pgmap v7732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:37.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:37 smithi170 ceph-mon[31212]: pgmap v7733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:37.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:37 smithi077 ceph-mon[27902]: pgmap v7733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:37.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:37 smithi191 ceph-mon[31636]: pgmap v7733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:38.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14328.562086 secs 2024-04-21T14:23:38.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14328.562086 secs 2024-04-21T14:23:38.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14328.562086 secs 2024-04-21T14:23:39.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:39 smithi170 ceph-mon[31212]: pgmap v7734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:39.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14330.322115 secs 2024-04-21T14:23:39.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:39 smithi077 ceph-mon[27902]: pgmap v7734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:39.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14330.322115 secs 2024-04-21T14:23:39.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:39 smithi191 ceph-mon[31636]: pgmap v7734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:39.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14330.322115 secs 2024-04-21T14:23:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:41.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:41 smithi170 ceph-mon[31212]: pgmap v7735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:41.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:23:41.850 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:41 smithi191 ceph-mon[31636]: pgmap v7735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:41.850 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:23:41.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:41 smithi077 ceph-mon[27902]: pgmap v7735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:41.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:23:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14333.562157 secs 2024-04-21T14:23:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:43 smithi191 ceph-mon[31636]: pgmap v7736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:43.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14333.562157 secs 2024-04-21T14:23:43.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:43 smithi170 ceph-mon[31212]: pgmap v7736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:43.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14333.562157 secs 2024-04-21T14:23:43.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:43 smithi077 ceph-mon[27902]: pgmap v7736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:44.625 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14335.322194 secs 2024-04-21T14:23:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14335.322194 secs 2024-04-21T14:23:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14335.322194 secs 2024-04-21T14:23:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: pgmap v7737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:23:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: pgmap v7737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:46.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:23:46.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:23:46.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: pgmap v7737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:23:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:23:47.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:47 smithi191 ceph-mon[31636]: pgmap v7738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:47.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14338.562218 secs 2024-04-21T14:23:48.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:47 smithi170 ceph-mon[31212]: pgmap v7738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:48.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14338.562218 secs 2024-04-21T14:23:48.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:47 smithi077 ceph-mon[27902]: pgmap v7738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:48.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14338.562218 secs 2024-04-21T14:23:49.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:49 smithi191 ceph-mon[31636]: pgmap v7739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:49.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14340.322331 secs 2024-04-21T14:23:50.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:49 smithi170 ceph-mon[31212]: pgmap v7739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:50.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14340.322331 secs 2024-04-21T14:23:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:50.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:49 smithi077 ceph-mon[27902]: pgmap v7739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:50.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14340.322331 secs 2024-04-21T14:23:51.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:51 smithi191 ceph-mon[31636]: pgmap v7740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:52.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:51 smithi170 ceph-mon[31212]: pgmap v7740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:52.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:51 smithi077 ceph-mon[27902]: pgmap v7740: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:52.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14343.562284 secs 2024-04-21T14:23:53.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14343.562284 secs 2024-04-21T14:23:53.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14343.562284 secs 2024-04-21T14:23:53.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:53 smithi191 ceph-mon[31636]: pgmap v7741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:54.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:53 smithi170 ceph-mon[31212]: pgmap v7741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:54.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:53 smithi077 ceph-mon[27902]: pgmap v7741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:55.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14345.322458 secs 2024-04-21T14:23:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:23:55.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14345.322458 secs 2024-04-21T14:23:55.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14345.322458 secs 2024-04-21T14:23:55.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:55 smithi170 ceph-mon[31212]: pgmap v7742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:56.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:55 smithi077 ceph-mon[27902]: pgmap v7742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:56.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:55 smithi191 ceph-mon[31636]: pgmap v7742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:23:58.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:57 smithi170 ceph-mon[31212]: pgmap v7743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:58.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14348.562415 secs 2024-04-21T14:23:58.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:57 smithi077 ceph-mon[27902]: pgmap v7743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:58.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14348.562415 secs 2024-04-21T14:23:58.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:57 smithi191 ceph-mon[31636]: pgmap v7743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:23:58.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14348.562415 secs 2024-04-21T14:24:00.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:59 smithi170 ceph-mon[31212]: pgmap v7744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:00.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14350.322595 secs 2024-04-21T14:24:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:00.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:59 smithi077 ceph-mon[27902]: pgmap v7744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:00.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14350.322595 secs 2024-04-21T14:24:00.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:59 smithi191 ceph-mon[31636]: pgmap v7744: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:00.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14350.322595 secs 2024-04-21T14:24:02.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:01 smithi170 ceph-mon[31212]: pgmap v7745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T14:24:02.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:01 smithi077 ceph-mon[27902]: pgmap v7745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T14:24:02.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:01 smithi191 ceph-mon[31636]: pgmap v7745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T14:24:03.013 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14353.562536 secs 2024-04-21T14:24:03.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14353.562536 secs 2024-04-21T14:24:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14353.562536 secs 2024-04-21T14:24:04.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:03 smithi170 ceph-mon[31212]: pgmap v7746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T14:24:04.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:03 smithi077 ceph-mon[27902]: pgmap v7746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T14:24:04.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:03 smithi191 ceph-mon[31636]: pgmap v7746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T14:24:05.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14355.322677 secs 2024-04-21T14:24:05.022 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:04 smithi170 ceph-mon[31212]: osdmap e555: 12 total, 12 up, 12 in 2024-04-21T14:24:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:05.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14355.322677 secs 2024-04-21T14:24:05.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:04 smithi077 ceph-mon[27902]: osdmap e555: 12 total, 12 up, 12 in 2024-04-21T14:24:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14355.322677 secs 2024-04-21T14:24:05.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:04 smithi191 ceph-mon[31636]: osdmap e555: 12 total, 12 up, 12 in 2024-04-21T14:24:06.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:05 smithi170 ceph-mon[31212]: pgmap v7748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-04-21T14:24:06.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:05 smithi077 ceph-mon[27902]: pgmap v7748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-04-21T14:24:06.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:05 smithi191 ceph-mon[31636]: pgmap v7748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-04-21T14:24:08.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:07 smithi170 ceph-mon[31212]: pgmap v7749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:24:08.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14358.562657 secs 2024-04-21T14:24:08.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:07 smithi077 ceph-mon[27902]: pgmap v7749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:24:08.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14358.562657 secs 2024-04-21T14:24:08.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:07 smithi191 ceph-mon[31636]: pgmap v7749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:24:08.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14358.562657 secs 2024-04-21T14:24:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:09 smithi170 ceph-mon[31212]: pgmap v7750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:24:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14360.322788 secs 2024-04-21T14:24:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:09 smithi170 ceph-mon[31212]: osdmap e556: 12 total, 12 up, 12 in 2024-04-21T14:24:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:10.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:09 smithi077 ceph-mon[27902]: pgmap v7750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:24:10.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14360.322788 secs 2024-04-21T14:24:10.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:09 smithi077 ceph-mon[27902]: osdmap e556: 12 total, 12 up, 12 in 2024-04-21T14:24:10.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:09 smithi191 ceph-mon[31636]: pgmap v7750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:24:10.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14360.322788 secs 2024-04-21T14:24:10.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:09 smithi191 ceph-mon[31636]: osdmap e556: 12 total, 12 up, 12 in 2024-04-21T14:24:12.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:11 smithi170 ceph-mon[31212]: pgmap v7752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:24:12.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:11 smithi077 ceph-mon[27902]: pgmap v7752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:24:12.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:11 smithi191 ceph-mon[31636]: pgmap v7752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:24:13.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14363.562808 secs 2024-04-21T14:24:13.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14363.562808 secs 2024-04-21T14:24:13.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14363.562808 secs 2024-04-21T14:24:14.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:13 smithi170 ceph-mon[31212]: pgmap v7753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:24:14.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:13 smithi077 ceph-mon[27902]: pgmap v7753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:24:14.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:13 smithi191 ceph-mon[31636]: pgmap v7753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:24:15.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14365.322924 secs 2024-04-21T14:24:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:15.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14365.322924 secs 2024-04-21T14:24:15.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14365.322924 secs 2024-04-21T14:24:16.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:15 smithi170 ceph-mon[31212]: pgmap v7754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:24:16.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:15 smithi077 ceph-mon[27902]: pgmap v7754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:24:16.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:15 smithi191 ceph-mon[31636]: pgmap v7754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:24:18.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:17 smithi170 ceph-mon[31212]: pgmap v7755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:24:18.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14368.562921 secs 2024-04-21T14:24:18.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:17 smithi077 ceph-mon[27902]: pgmap v7755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:24:18.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14368.562921 secs 2024-04-21T14:24:18.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:17 smithi191 ceph-mon[31636]: pgmap v7755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:24:18.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14368.562921 secs 2024-04-21T14:24:20.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:19 smithi170 ceph-mon[31212]: pgmap v7756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:24:20.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14370.323007 secs 2024-04-21T14:24:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:20.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:19 smithi077 ceph-mon[27902]: pgmap v7756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:24:20.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14370.323007 secs 2024-04-21T14:24:20.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:19 smithi191 ceph-mon[31636]: pgmap v7756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:24:20.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14370.323007 secs 2024-04-21T14:24:22.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:21 smithi170 ceph-mon[31212]: pgmap v7757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:24:22.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:21 smithi077 ceph-mon[27902]: pgmap v7757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:24:22.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:21 smithi191 ceph-mon[31636]: pgmap v7757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:24:23.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14373.563009 secs 2024-04-21T14:24:23.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14373.563009 secs 2024-04-21T14:24:23.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14373.563009 secs 2024-04-21T14:24:24.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:23 smithi170 ceph-mon[31212]: pgmap v7758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:24.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:23 smithi077 ceph-mon[27902]: pgmap v7758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:24.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:23 smithi191 ceph-mon[31636]: pgmap v7758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:25.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14375.323163 secs 2024-04-21T14:24:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:25.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14375.323163 secs 2024-04-21T14:24:25.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14375.323163 secs 2024-04-21T14:24:26.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:25 smithi170 ceph-mon[31212]: pgmap v7759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:26.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:25 smithi077 ceph-mon[27902]: pgmap v7759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:26.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:25 smithi191 ceph-mon[31636]: pgmap v7759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:28.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:27 smithi170 ceph-mon[31212]: pgmap v7760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:28.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14378.563120 secs 2024-04-21T14:24:28.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:27 smithi077 ceph-mon[27902]: pgmap v7760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:28.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14378.563120 secs 2024-04-21T14:24:28.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:27 smithi191 ceph-mon[31636]: pgmap v7760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:28.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14378.563120 secs 2024-04-21T14:24:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:30.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:29 smithi077 ceph-mon[27902]: pgmap v7761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:30.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14380.323302 secs 2024-04-21T14:24:30.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:29 smithi191 ceph-mon[31636]: pgmap v7761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:30.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14380.323302 secs 2024-04-21T14:24:30.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:29 smithi170 ceph-mon[31212]: pgmap v7761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:30.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14380.323302 secs 2024-04-21T14:24:32.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:31 smithi077 ceph-mon[27902]: pgmap v7762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:32.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:31 smithi191 ceph-mon[31636]: pgmap v7762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:32.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:31 smithi170 ceph-mon[31212]: pgmap v7762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:33.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14383.563257 secs 2024-04-21T14:24:33.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14383.563257 secs 2024-04-21T14:24:33.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14383.563257 secs 2024-04-21T14:24:34.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:33 smithi077 ceph-mon[27902]: pgmap v7763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:34.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:33 smithi191 ceph-mon[31636]: pgmap v7763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:34.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:33 smithi170 ceph-mon[31212]: pgmap v7763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14385.323416 secs 2024-04-21T14:24:35.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14385.323416 secs 2024-04-21T14:24:35.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14385.323416 secs 2024-04-21T14:24:36.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:35 smithi077 ceph-mon[27902]: pgmap v7764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:36.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:35 smithi191 ceph-mon[31636]: pgmap v7764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:36.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:35 smithi170 ceph-mon[31212]: pgmap v7764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:38.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:37 smithi077 ceph-mon[27902]: pgmap v7765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:38.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14388.563401 secs 2024-04-21T14:24:38.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:37 smithi191 ceph-mon[31636]: pgmap v7765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:38.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14388.563401 secs 2024-04-21T14:24:38.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:37 smithi170 ceph-mon[31212]: pgmap v7765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:38.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14388.563401 secs 2024-04-21T14:24:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:40.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:39 smithi077 ceph-mon[27902]: pgmap v7766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:40.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14390.323515 secs 2024-04-21T14:24:40.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:39 smithi191 ceph-mon[31636]: pgmap v7766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:40.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14390.323515 secs 2024-04-21T14:24:40.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:39 smithi170 ceph-mon[31212]: pgmap v7766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:40.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14390.323515 secs 2024-04-21T14:24:42.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:41 smithi077 ceph-mon[27902]: pgmap v7767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:42.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:41 smithi191 ceph-mon[31636]: pgmap v7767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:42.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:41 smithi170 ceph-mon[31212]: pgmap v7767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:43.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14393.563526 secs 2024-04-21T14:24:43.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14393.563526 secs 2024-04-21T14:24:43.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14393.563526 secs 2024-04-21T14:24:44.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:43 smithi077 ceph-mon[27902]: pgmap v7768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:44.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:43 smithi191 ceph-mon[31636]: pgmap v7768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:44.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:43 smithi170 ceph-mon[31212]: pgmap v7768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:45.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14395.323650 secs 2024-04-21T14:24:45.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14395.323650 secs 2024-04-21T14:24:45.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14395.323650 secs 2024-04-21T14:24:46.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:45 smithi077 ceph-mon[27902]: pgmap v7769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:24:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:24:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:24:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:24:46.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:45 smithi191 ceph-mon[31636]: pgmap v7769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:46.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:24:46.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:24:46.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:24:46.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:24:46.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:45 smithi170 ceph-mon[31212]: pgmap v7769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:46.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:24:46.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:24:46.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:24:46.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:24:48.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:47 smithi077 ceph-mon[27902]: pgmap v7770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:48.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14398.563665 secs 2024-04-21T14:24:48.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:47 smithi191 ceph-mon[31636]: pgmap v7770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:48.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14398.563665 secs 2024-04-21T14:24:48.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:47 smithi170 ceph-mon[31212]: pgmap v7770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:48.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14398.563665 secs 2024-04-21T14:24:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:50.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:49 smithi077 ceph-mon[27902]: pgmap v7771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:50.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14400.323764 secs 2024-04-21T14:24:50.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:49 smithi191 ceph-mon[31636]: pgmap v7771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:50.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14400.323764 secs 2024-04-21T14:24:50.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:49 smithi170 ceph-mon[31212]: pgmap v7771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:50.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14400.323764 secs 2024-04-21T14:24:52.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:51 smithi077 ceph-mon[27902]: pgmap v7772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:52.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:51 smithi191 ceph-mon[31636]: pgmap v7772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:52.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:51 smithi170 ceph-mon[31212]: pgmap v7772: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:53.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14403.563791 secs 2024-04-21T14:24:53.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14403.563791 secs 2024-04-21T14:24:53.184 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14403.563791 secs 2024-04-21T14:24:54.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:53 smithi077 ceph-mon[27902]: pgmap v7773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:54.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:53 smithi191 ceph-mon[31636]: pgmap v7773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:54.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:53 smithi170 ceph-mon[31212]: pgmap v7773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:24:55.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14405.323902 secs 2024-04-21T14:24:55.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14405.323902 secs 2024-04-21T14:24:55.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14405.323902 secs 2024-04-21T14:24:56.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:55 smithi077 ceph-mon[27902]: pgmap v7774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:56.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:55 smithi191 ceph-mon[31636]: pgmap v7774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:56.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:55 smithi170 ceph-mon[31212]: pgmap v7774: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:24:58.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:57 smithi077 ceph-mon[27902]: pgmap v7775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:58.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14408.563912 secs 2024-04-21T14:24:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:57 smithi191 ceph-mon[31636]: pgmap v7775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14408.563912 secs 2024-04-21T14:24:58.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:57 smithi170 ceph-mon[31212]: pgmap v7775: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:24:58.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14408.563912 secs 2024-04-21T14:25:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:00.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:59 smithi077 ceph-mon[27902]: pgmap v7776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:00.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14410.323983 secs 2024-04-21T14:25:00.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:59 smithi191 ceph-mon[31636]: pgmap v7776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:00.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14410.323983 secs 2024-04-21T14:25:00.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:59 smithi170 ceph-mon[31212]: pgmap v7776: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:00.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14410.323983 secs 2024-04-21T14:25:02.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:01 smithi077 ceph-mon[27902]: pgmap v7777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:02.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:01 smithi191 ceph-mon[31636]: pgmap v7777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:02.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:01 smithi170 ceph-mon[31212]: pgmap v7777: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14413.564028 secs 2024-04-21T14:25:03.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14413.564028 secs 2024-04-21T14:25:03.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14413.564028 secs 2024-04-21T14:25:04.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:03 smithi191 ceph-mon[31636]: pgmap v7778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:04.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:03 smithi170 ceph-mon[31212]: pgmap v7778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:04.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:03 smithi077 ceph-mon[27902]: pgmap v7778: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14415.324080 secs 2024-04-21T14:25:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:04 smithi191 ceph-mon[31636]: osdmap e557: 12 total, 12 up, 12 in 2024-04-21T14:25:05.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14415.324080 secs 2024-04-21T14:25:05.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:04 smithi170 ceph-mon[31212]: osdmap e557: 12 total, 12 up, 12 in 2024-04-21T14:25:05.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14415.324080 secs 2024-04-21T14:25:05.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:04 smithi077 ceph-mon[27902]: osdmap e557: 12 total, 12 up, 12 in 2024-04-21T14:25:06.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:05 smithi191 ceph-mon[31636]: pgmap v7780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:25:06.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:05 smithi170 ceph-mon[31212]: pgmap v7780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:25:06.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:05 smithi077 ceph-mon[27902]: pgmap v7780: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:25:08.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:07 smithi191 ceph-mon[31636]: pgmap v7781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:25:08.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14418.564145 secs 2024-04-21T14:25:08.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:07 smithi170 ceph-mon[31212]: pgmap v7781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:25:08.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14418.564145 secs 2024-04-21T14:25:08.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:07 smithi077 ceph-mon[27902]: pgmap v7781: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:25:08.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14418.564145 secs 2024-04-21T14:25:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:10.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:09 smithi191 ceph-mon[31636]: pgmap v7782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:25:10.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14420.324214 secs 2024-04-21T14:25:10.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:09 smithi191 ceph-mon[31636]: osdmap e558: 12 total, 12 up, 12 in 2024-04-21T14:25:10.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:09 smithi170 ceph-mon[31212]: pgmap v7782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:25:10.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14420.324214 secs 2024-04-21T14:25:10.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:09 smithi170 ceph-mon[31212]: osdmap e558: 12 total, 12 up, 12 in 2024-04-21T14:25:10.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:09 smithi077 ceph-mon[27902]: pgmap v7782: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:25:10.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14420.324214 secs 2024-04-21T14:25:10.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:09 smithi077 ceph-mon[27902]: osdmap e558: 12 total, 12 up, 12 in 2024-04-21T14:25:12.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:11 smithi191 ceph-mon[31636]: pgmap v7784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:25:12.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:11 smithi170 ceph-mon[31212]: pgmap v7784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:25:12.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:11 smithi077 ceph-mon[27902]: pgmap v7784: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:25:13.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14423.564250 secs 2024-04-21T14:25:13.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14423.564250 secs 2024-04-21T14:25:13.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14423.564250 secs 2024-04-21T14:25:14.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:13 smithi191 ceph-mon[31636]: pgmap v7785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T14:25:14.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:13 smithi170 ceph-mon[31212]: pgmap v7785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T14:25:14.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:13 smithi077 ceph-mon[27902]: pgmap v7785: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T14:25:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:15.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14425.324338 secs 2024-04-21T14:25:15.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14425.324338 secs 2024-04-21T14:25:15.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14425.324338 secs 2024-04-21T14:25:16.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:15 smithi191 ceph-mon[31636]: pgmap v7786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:25:16.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:15 smithi170 ceph-mon[31212]: pgmap v7786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:25:16.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:15 smithi077 ceph-mon[27902]: pgmap v7786: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:25:18.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:17 smithi191 ceph-mon[31636]: pgmap v7787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:25:18.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14428.564369 secs 2024-04-21T14:25:18.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:17 smithi170 ceph-mon[31212]: pgmap v7787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:25:18.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14428.564369 secs 2024-04-21T14:25:18.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:17 smithi077 ceph-mon[27902]: pgmap v7787: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:25:18.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14428.564369 secs 2024-04-21T14:25:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:20.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:19 smithi191 ceph-mon[31636]: pgmap v7788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:25:20.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14430.324433 secs 2024-04-21T14:25:20.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:19 smithi170 ceph-mon[31212]: pgmap v7788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:25:20.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14430.324433 secs 2024-04-21T14:25:20.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:19 smithi077 ceph-mon[27902]: pgmap v7788: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:25:20.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14430.324433 secs 2024-04-21T14:25:22.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:21 smithi191 ceph-mon[31636]: pgmap v7789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:25:22.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:21 smithi170 ceph-mon[31212]: pgmap v7789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:25:22.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:21 smithi077 ceph-mon[27902]: pgmap v7789: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:25:23.184 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14433.564532 secs 2024-04-21T14:25:23.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14433.564532 secs 2024-04-21T14:25:23.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14433.564532 secs 2024-04-21T14:25:24.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:23 smithi191 ceph-mon[31636]: pgmap v7790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:24.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:23 smithi170 ceph-mon[31212]: pgmap v7790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:24.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:23 smithi077 ceph-mon[27902]: pgmap v7790: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:25.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14435.324530 secs 2024-04-21T14:25:25.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14435.324530 secs 2024-04-21T14:25:25.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14435.324530 secs 2024-04-21T14:25:26.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:25 smithi191 ceph-mon[31636]: pgmap v7791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:26.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:25 smithi170 ceph-mon[31212]: pgmap v7791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:26.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:25 smithi077 ceph-mon[27902]: pgmap v7791: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:28.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:27 smithi191 ceph-mon[31636]: pgmap v7792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:28.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14438.564654 secs 2024-04-21T14:25:28.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:27 smithi170 ceph-mon[31212]: pgmap v7792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:28.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14438.564654 secs 2024-04-21T14:25:28.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:27 smithi077 ceph-mon[27902]: pgmap v7792: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:28.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14438.564654 secs 2024-04-21T14:25:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:30.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:29 smithi191 ceph-mon[31636]: pgmap v7793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:30.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14440.324634 secs 2024-04-21T14:25:30.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:29 smithi170 ceph-mon[31212]: pgmap v7793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:30.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14440.324634 secs 2024-04-21T14:25:30.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:29 smithi077 ceph-mon[27902]: pgmap v7793: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:30.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14440.324634 secs 2024-04-21T14:25:32.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:31 smithi191 ceph-mon[31636]: pgmap v7794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:32.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:31 smithi170 ceph-mon[31212]: pgmap v7794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:32.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:31 smithi077 ceph-mon[27902]: pgmap v7794: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:33.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14443.564795 secs 2024-04-21T14:25:33.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14443.564795 secs 2024-04-21T14:25:33.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14443.564795 secs 2024-04-21T14:25:34.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:33 smithi170 ceph-mon[31212]: pgmap v7795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:34.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:33 smithi077 ceph-mon[27902]: pgmap v7795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:34.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:33 smithi191 ceph-mon[31636]: pgmap v7795: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:35.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14445.324706 secs 2024-04-21T14:25:35.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14445.324706 secs 2024-04-21T14:25:35.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14445.324706 secs 2024-04-21T14:25:36.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:35 smithi170 ceph-mon[31212]: pgmap v7796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:36.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:35 smithi077 ceph-mon[27902]: pgmap v7796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:36.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:35 smithi191 ceph-mon[31636]: pgmap v7796: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:38.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:37 smithi170 ceph-mon[31212]: pgmap v7797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:38.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14448.564933 secs 2024-04-21T14:25:38.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:37 smithi077 ceph-mon[27902]: pgmap v7797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:38.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14448.564933 secs 2024-04-21T14:25:38.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:37 smithi191 ceph-mon[31636]: pgmap v7797: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:38.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14448.564933 secs 2024-04-21T14:25:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:40.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:39 smithi170 ceph-mon[31212]: pgmap v7798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:40.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14450.324845 secs 2024-04-21T14:25:40.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:39 smithi077 ceph-mon[27902]: pgmap v7798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:40.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14450.324845 secs 2024-04-21T14:25:40.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:39 smithi191 ceph-mon[31636]: pgmap v7798: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:25:40.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14450.324845 secs 2024-04-21T14:25:42.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:41 smithi170 ceph-mon[31212]: pgmap v7799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:42.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:41 smithi077 ceph-mon[27902]: pgmap v7799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:42.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:41 smithi191 ceph-mon[31636]: pgmap v7799: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:43.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14453.565073 secs 2024-04-21T14:25:43.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14453.565073 secs 2024-04-21T14:25:43.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14453.565073 secs 2024-04-21T14:25:44.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:44 smithi170 ceph-mon[31212]: pgmap v7800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:44.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:43 smithi077 ceph-mon[27902]: pgmap v7800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:44.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:44 smithi191 ceph-mon[31636]: pgmap v7800: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:45.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14455.324959 secs 2024-04-21T14:25:45.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14455.324959 secs 2024-04-21T14:25:45.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14455.324959 secs 2024-04-21T14:25:46.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:46 smithi170 ceph-mon[31212]: pgmap v7801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:46.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:25:46.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:46 smithi077 ceph-mon[27902]: pgmap v7801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:46.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:25:46.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:46 smithi191 ceph-mon[31636]: pgmap v7801: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:46.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:25:47.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:25:47.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:25:47.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:25:47.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:25:47.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:25:47.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:25:47.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:25:47.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:25:47.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:25:48.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:48 smithi170 ceph-mon[31212]: pgmap v7802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:48.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14458.565138 secs 2024-04-21T14:25:48.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:48 smithi077 ceph-mon[27902]: pgmap v7802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:48.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14458.565138 secs 2024-04-21T14:25:48.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:48 smithi191 ceph-mon[31636]: pgmap v7802: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:48.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14458.565138 secs 2024-04-21T14:25:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:50.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:50 smithi170 ceph-mon[31212]: pgmap v7803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:50.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14460.325074 secs 2024-04-21T14:25:50.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:50 smithi077 ceph-mon[27902]: pgmap v7803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:50.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14460.325074 secs 2024-04-21T14:25:50.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:50 smithi191 ceph-mon[31636]: pgmap v7803: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:50.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14460.325074 secs 2024-04-21T14:25:52.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:52 smithi170 ceph-mon[31212]: pgmap v7804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:52.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:52 smithi077 ceph-mon[27902]: pgmap v7804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:52.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:52 smithi191 ceph-mon[31636]: pgmap v7804: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:53.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14463.565203 secs 2024-04-21T14:25:53.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14463.565203 secs 2024-04-21T14:25:53.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14463.565203 secs 2024-04-21T14:25:54.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:54 smithi170 ceph-mon[31212]: pgmap v7805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:54.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:54 smithi077 ceph-mon[27902]: pgmap v7805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:54.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:54 smithi191 ceph-mon[31636]: pgmap v7805: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:25:55.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14465.325225 secs 2024-04-21T14:25:55.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14465.325225 secs 2024-04-21T14:25:55.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14465.325225 secs 2024-04-21T14:25:56.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:56 smithi170 ceph-mon[31212]: pgmap v7806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:25:56.345+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:25:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:25:56.345+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:25:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:25:56.345+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:25:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:25:56.345+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:25:56.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:56 smithi077 ceph-mon[27902]: pgmap v7806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:56.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:56 smithi191 ceph-mon[31636]: pgmap v7806: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:25:58.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:58 smithi170 ceph-mon[31212]: pgmap v7807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:58.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:25:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14468.565284 secs 2024-04-21T14:25:58.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:58 smithi077 ceph-mon[27902]: pgmap v7807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:58.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:25:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14468.565284 secs 2024-04-21T14:25:58.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:58 smithi191 ceph-mon[31636]: pgmap v7807: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:25:58.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:25:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14468.565284 secs 2024-04-21T14:26:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:00.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:00 smithi170 ceph-mon[31212]: pgmap v7808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:00.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14470.325322 secs 2024-04-21T14:26:00.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:00 smithi077 ceph-mon[27902]: pgmap v7808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:00.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14470.325322 secs 2024-04-21T14:26:00.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:00 smithi191 ceph-mon[31636]: pgmap v7808: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:00.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14470.325322 secs 2024-04-21T14:26:02.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:02 smithi170 ceph-mon[31212]: pgmap v7809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:02.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:02 smithi077 ceph-mon[27902]: pgmap v7809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:02.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:02 smithi191 ceph-mon[31636]: pgmap v7809: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:03.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14473.565403 secs 2024-04-21T14:26:03.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14473.565403 secs 2024-04-21T14:26:03.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14473.565403 secs 2024-04-21T14:26:04.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:04 smithi077 ceph-mon[27902]: pgmap v7810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:04.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:04 smithi191 ceph-mon[31636]: pgmap v7810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:04.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:04 smithi170 ceph-mon[31212]: pgmap v7810: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:05.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14475.325440 secs 2024-04-21T14:26:05.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:05 smithi077 ceph-mon[27902]: osdmap e559: 12 total, 12 up, 12 in 2024-04-21T14:26:05.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14475.325440 secs 2024-04-21T14:26:05.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:05 smithi191 ceph-mon[31636]: osdmap e559: 12 total, 12 up, 12 in 2024-04-21T14:26:05.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14475.325440 secs 2024-04-21T14:26:05.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:05 smithi170 ceph-mon[31212]: osdmap e559: 12 total, 12 up, 12 in 2024-04-21T14:26:06.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:06 smithi077 ceph-mon[27902]: pgmap v7812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:26:06.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:06 smithi191 ceph-mon[31636]: pgmap v7812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:26:06.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:06 smithi170 ceph-mon[31212]: pgmap v7812: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:26:08.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:08 smithi077 ceph-mon[27902]: pgmap v7813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:26:08.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14478.565530 secs 2024-04-21T14:26:08.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:08 smithi191 ceph-mon[31636]: pgmap v7813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:26:08.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14478.565530 secs 2024-04-21T14:26:08.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:08 smithi170 ceph-mon[31212]: pgmap v7813: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:26:08.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14478.565530 secs 2024-04-21T14:26:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:10.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:10 smithi077 ceph-mon[27902]: pgmap v7814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:26:10.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14480.325561 secs 2024-04-21T14:26:10.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:10 smithi077 ceph-mon[27902]: osdmap e560: 12 total, 12 up, 12 in 2024-04-21T14:26:10.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:10 smithi191 ceph-mon[31636]: pgmap v7814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:26:10.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14480.325561 secs 2024-04-21T14:26:10.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:10 smithi191 ceph-mon[31636]: osdmap e560: 12 total, 12 up, 12 in 2024-04-21T14:26:10.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:10 smithi170 ceph-mon[31212]: pgmap v7814: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:26:10.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14480.325561 secs 2024-04-21T14:26:10.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:10 smithi170 ceph-mon[31212]: osdmap e560: 12 total, 12 up, 12 in 2024-04-21T14:26:12.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:12 smithi077 ceph-mon[27902]: pgmap v7816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:26:12.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:12 smithi191 ceph-mon[31636]: pgmap v7816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:26:12.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:12 smithi170 ceph-mon[31212]: pgmap v7816: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:26:13.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14483.565649 secs 2024-04-21T14:26:13.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14483.565649 secs 2024-04-21T14:26:13.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14483.565649 secs 2024-04-21T14:26:14.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:14 smithi077 ceph-mon[27902]: pgmap v7817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:26:14.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:14 smithi191 ceph-mon[31636]: pgmap v7817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:26:14.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:14 smithi170 ceph-mon[31212]: pgmap v7817: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:26:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:15.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14485.325677 secs 2024-04-21T14:26:15.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14485.325677 secs 2024-04-21T14:26:15.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14485.325677 secs 2024-04-21T14:26:16.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:16 smithi077 ceph-mon[27902]: pgmap v7818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:26:16.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:16 smithi191 ceph-mon[31636]: pgmap v7818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:26:16.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:16 smithi170 ceph-mon[31212]: pgmap v7818: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:26:18.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:18 smithi077 ceph-mon[27902]: pgmap v7819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:26:18.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14488.565745 secs 2024-04-21T14:26:18.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:18 smithi191 ceph-mon[31636]: pgmap v7819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:26:18.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14488.565745 secs 2024-04-21T14:26:18.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:18 smithi170 ceph-mon[31212]: pgmap v7819: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:26:18.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14488.565745 secs 2024-04-21T14:26:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:20.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:20 smithi077 ceph-mon[27902]: pgmap v7820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:26:20.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14490.325765 secs 2024-04-21T14:26:20.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:20 smithi191 ceph-mon[31636]: pgmap v7820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:26:20.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14490.325765 secs 2024-04-21T14:26:20.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:20 smithi170 ceph-mon[31212]: pgmap v7820: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:26:20.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14490.325765 secs 2024-04-21T14:26:22.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:22 smithi077 ceph-mon[27902]: pgmap v7821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:26:22.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:22 smithi191 ceph-mon[31636]: pgmap v7821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:26:22.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:22 smithi170 ceph-mon[31212]: pgmap v7821: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:26:23.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14493.565866 secs 2024-04-21T14:26:23.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14493.565866 secs 2024-04-21T14:26:23.434 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14493.565866 secs 2024-04-21T14:26:24.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:24 smithi077 ceph-mon[27902]: pgmap v7822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:24.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:24 smithi191 ceph-mon[31636]: pgmap v7822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:24.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:24 smithi170 ceph-mon[31212]: pgmap v7822: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:25.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14495.325898 secs 2024-04-21T14:26:25.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14495.325898 secs 2024-04-21T14:26:25.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14495.325898 secs 2024-04-21T14:26:26.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:26 smithi077 ceph-mon[27902]: pgmap v7823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:26.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:26 smithi191 ceph-mon[31636]: pgmap v7823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:26.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:26 smithi170 ceph-mon[31212]: pgmap v7823: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:28.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:28 smithi077 ceph-mon[27902]: pgmap v7824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:28.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14498.565985 secs 2024-04-21T14:26:28.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:28 smithi191 ceph-mon[31636]: pgmap v7824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:28.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14498.565985 secs 2024-04-21T14:26:28.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:28 smithi170 ceph-mon[31212]: pgmap v7824: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:28.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14498.565985 secs 2024-04-21T14:26:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:30.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:30 smithi191 ceph-mon[31636]: pgmap v7825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:30.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14500.325979 secs 2024-04-21T14:26:30.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:30 smithi170 ceph-mon[31212]: pgmap v7825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:30.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14500.325979 secs 2024-04-21T14:26:30.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:30 smithi077 ceph-mon[27902]: pgmap v7825: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:30.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14500.325979 secs 2024-04-21T14:26:32.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:32 smithi191 ceph-mon[31636]: pgmap v7826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:32.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:32 smithi170 ceph-mon[31212]: pgmap v7826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:32.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:32 smithi077 ceph-mon[27902]: pgmap v7826: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:33.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14503.566096 secs 2024-04-21T14:26:33.512 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14503.566096 secs 2024-04-21T14:26:33.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14503.566096 secs 2024-04-21T14:26:34.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:34 smithi191 ceph-mon[31636]: pgmap v7827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:34.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:34 smithi170 ceph-mon[31212]: pgmap v7827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:34.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:34 smithi077 ceph-mon[27902]: pgmap v7827: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:35.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14505.326090 secs 2024-04-21T14:26:35.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14505.326090 secs 2024-04-21T14:26:35.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14505.326090 secs 2024-04-21T14:26:36.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:36 smithi191 ceph-mon[31636]: pgmap v7828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:36.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:36 smithi170 ceph-mon[31212]: pgmap v7828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:36.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:36 smithi077 ceph-mon[27902]: pgmap v7828: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:38.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:38 smithi191 ceph-mon[31636]: pgmap v7829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:38.445 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14508.566210 secs 2024-04-21T14:26:38.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:38 smithi170 ceph-mon[31212]: pgmap v7829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:38.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14508.566210 secs 2024-04-21T14:26:38.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:38 smithi077 ceph-mon[27902]: pgmap v7829: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:38.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14508.566210 secs 2024-04-21T14:26:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:40.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:40 smithi191 ceph-mon[31636]: pgmap v7830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:40.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14510.326206 secs 2024-04-21T14:26:40.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:40 smithi170 ceph-mon[31212]: pgmap v7830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:40.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14510.326206 secs 2024-04-21T14:26:40.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:40 smithi077 ceph-mon[27902]: pgmap v7830: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:40.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14510.326206 secs 2024-04-21T14:26:42.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:42 smithi191 ceph-mon[31636]: pgmap v7831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:42.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:42 smithi170 ceph-mon[31212]: pgmap v7831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:42.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:42 smithi077 ceph-mon[27902]: pgmap v7831: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:43.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14513.566345 secs 2024-04-21T14:26:43.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14513.566345 secs 2024-04-21T14:26:43.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14513.566345 secs 2024-04-21T14:26:44.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:44 smithi191 ceph-mon[31636]: pgmap v7832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:44.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:44 smithi170 ceph-mon[31212]: pgmap v7832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:44.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:44 smithi077 ceph-mon[27902]: pgmap v7832: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:45.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14515.326320 secs 2024-04-21T14:26:45.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14515.326320 secs 2024-04-21T14:26:45.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14515.326320 secs 2024-04-21T14:26:46.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:46 smithi191 ceph-mon[31636]: pgmap v7833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:46.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:46 smithi170 ceph-mon[31212]: pgmap v7833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:46.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:46 smithi077 ceph-mon[27902]: pgmap v7833: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:47.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:26:47.483 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:26:47.496 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:26:48.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:48 smithi191 ceph-mon[31636]: pgmap v7834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:48.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14518.566471 secs 2024-04-21T14:26:48.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:48 smithi170 ceph-mon[31212]: pgmap v7834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:48.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14518.566471 secs 2024-04-21T14:26:48.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:48 smithi077 ceph-mon[27902]: pgmap v7834: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:48.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14518.566471 secs 2024-04-21T14:26:49.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: pgmap v7835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:49.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14520.326388 secs 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: pgmap v7835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14520.326388 secs 2024-04-21T14:26:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: pgmap v7835: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14520.326388 secs 2024-04-21T14:26:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:26:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:26:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:26:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:26:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:26:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:26:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:26:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:26:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:26:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:26:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:26:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:26:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:26:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:26:51.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:51 smithi077 ceph-mon[27902]: pgmap v7836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:51.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:51 smithi191 ceph-mon[31636]: pgmap v7836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:52.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:51 smithi170 ceph-mon[31212]: pgmap v7836: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14523.566550 secs 2024-04-21T14:26:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14523.566550 secs 2024-04-21T14:26:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14523.566550 secs 2024-04-21T14:26:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:53 smithi191 ceph-mon[31636]: pgmap v7837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:53.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:53 smithi077 ceph-mon[27902]: pgmap v7837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:53.934 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:53 smithi170 ceph-mon[31212]: pgmap v7837: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:54.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14525.326502 secs 2024-04-21T14:26:54.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14525.326502 secs 2024-04-21T14:26:55.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14525.326502 secs 2024-04-21T14:26:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:26:55.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:55 smithi077 ceph-mon[27902]: pgmap v7838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:55.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:55 smithi191 ceph-mon[31636]: pgmap v7838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:56.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:55 smithi170 ceph-mon[31212]: pgmap v7838: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:57 smithi077 ceph-mon[27902]: pgmap v7839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14528.566683 secs 2024-04-21T14:26:57.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:57 smithi191 ceph-mon[31636]: pgmap v7839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:57.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14528.566683 secs 2024-04-21T14:26:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:57 smithi170 ceph-mon[31212]: pgmap v7839: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:26:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14528.566683 secs 2024-04-21T14:26:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:59 smithi077 ceph-mon[27902]: pgmap v7840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14530.326620 secs 2024-04-21T14:26:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:59 smithi191 ceph-mon[31636]: pgmap v7840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:26:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14530.326620 secs 2024-04-21T14:27:00.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:59 smithi170 ceph-mon[31212]: pgmap v7840: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:00.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14530.326620 secs 2024-04-21T14:27:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:01.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:01 smithi077 ceph-mon[27902]: pgmap v7841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:01.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:01 smithi191 ceph-mon[31636]: pgmap v7841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:02.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:01 smithi170 ceph-mon[31212]: pgmap v7841: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14533.566813 secs 2024-04-21T14:27:02.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14533.566813 secs 2024-04-21T14:27:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14533.566813 secs 2024-04-21T14:27:03.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:03 smithi077 ceph-mon[27902]: pgmap v7842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:03.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:03 smithi191 ceph-mon[31636]: pgmap v7842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:04.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:03 smithi170 ceph-mon[31212]: pgmap v7842: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14535.326758 secs 2024-04-21T14:27:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:04 smithi191 ceph-mon[31636]: osdmap e561: 12 total, 12 up, 12 in 2024-04-21T14:27:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14535.326758 secs 2024-04-21T14:27:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:04 smithi170 ceph-mon[31212]: osdmap e561: 12 total, 12 up, 12 in 2024-04-21T14:27:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14535.326758 secs 2024-04-21T14:27:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:04 smithi077 ceph-mon[27902]: osdmap e561: 12 total, 12 up, 12 in 2024-04-21T14:27:05.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:05 smithi191 ceph-mon[31636]: pgmap v7844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:27:06.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:05 smithi170 ceph-mon[31212]: pgmap v7844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:27:06.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:05 smithi077 ceph-mon[27902]: pgmap v7844: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:27:07.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:07 smithi191 ceph-mon[31636]: pgmap v7845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:27:07.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14538.566925 secs 2024-04-21T14:27:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:07 smithi170 ceph-mon[31212]: pgmap v7845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:27:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14538.566925 secs 2024-04-21T14:27:08.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:07 smithi077 ceph-mon[27902]: pgmap v7845: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:27:08.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14538.566925 secs 2024-04-21T14:27:09.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:09 smithi191 ceph-mon[31636]: pgmap v7846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:27:09.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14540.326895 secs 2024-04-21T14:27:09.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:09 smithi191 ceph-mon[31636]: osdmap e562: 12 total, 12 up, 12 in 2024-04-21T14:27:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:09 smithi170 ceph-mon[31212]: pgmap v7846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:27:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14540.326895 secs 2024-04-21T14:27:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:09 smithi170 ceph-mon[31212]: osdmap e562: 12 total, 12 up, 12 in 2024-04-21T14:27:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:09 smithi077 ceph-mon[27902]: pgmap v7846: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:27:10.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14540.326895 secs 2024-04-21T14:27:10.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:09 smithi077 ceph-mon[27902]: osdmap e562: 12 total, 12 up, 12 in 2024-04-21T14:27:11.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:11 smithi191 ceph-mon[31636]: pgmap v7848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:27:12.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:11 smithi170 ceph-mon[31212]: pgmap v7848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:27:12.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:11 smithi077 ceph-mon[27902]: pgmap v7848: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:27:12.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14543.567038 secs 2024-04-21T14:27:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14543.567038 secs 2024-04-21T14:27:13.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14543.567038 secs 2024-04-21T14:27:13.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:13 smithi191 ceph-mon[31636]: pgmap v7849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:27:14.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:13 smithi170 ceph-mon[31212]: pgmap v7849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:27:14.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:13 smithi077 ceph-mon[27902]: pgmap v7849: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:27:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14545.327030 secs 2024-04-21T14:27:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14545.327030 secs 2024-04-21T14:27:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:15.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14545.327030 secs 2024-04-21T14:27:15.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:15 smithi191 ceph-mon[31636]: pgmap v7850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:27:16.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:15 smithi170 ceph-mon[31212]: pgmap v7850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:27:16.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:15 smithi077 ceph-mon[27902]: pgmap v7850: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:27:17.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:17 smithi191 ceph-mon[31636]: pgmap v7851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:27:17.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14548.567117 secs 2024-04-21T14:27:18.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:17 smithi170 ceph-mon[31212]: pgmap v7851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:27:18.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14548.567117 secs 2024-04-21T14:27:18.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:17 smithi077 ceph-mon[27902]: pgmap v7851: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:27:18.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14548.567117 secs 2024-04-21T14:27:19.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:19 smithi191 ceph-mon[31636]: pgmap v7852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:27:19.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14550.327107 secs 2024-04-21T14:27:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:19 smithi170 ceph-mon[31212]: pgmap v7852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:27:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14550.327107 secs 2024-04-21T14:27:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:20.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:19 smithi077 ceph-mon[27902]: pgmap v7852: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:27:20.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14550.327107 secs 2024-04-21T14:27:21.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:21 smithi191 ceph-mon[31636]: pgmap v7853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:27:22.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:21 smithi170 ceph-mon[31212]: pgmap v7853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:27:22.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:21 smithi077 ceph-mon[27902]: pgmap v7853: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:27:22.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14553.567234 secs 2024-04-21T14:27:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14553.567234 secs 2024-04-21T14:27:23.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14553.567234 secs 2024-04-21T14:27:23.934 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:23 smithi170 ceph-mon[31212]: pgmap v7854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:23.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:23 smithi191 ceph-mon[31636]: pgmap v7854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:24.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:23 smithi077 ceph-mon[27902]: pgmap v7854: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:24.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14555.327235 secs 2024-04-21T14:27:25.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14555.327235 secs 2024-04-21T14:27:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:25.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14555.327235 secs 2024-04-21T14:27:25.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:25 smithi191 ceph-mon[31636]: pgmap v7855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:26.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:25 smithi170 ceph-mon[31212]: pgmap v7855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:26.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:25 smithi077 ceph-mon[27902]: pgmap v7855: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:27.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:27 smithi191 ceph-mon[31636]: pgmap v7856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:27.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14558.567296 secs 2024-04-21T14:27:28.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:27 smithi170 ceph-mon[31212]: pgmap v7856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:28.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14558.567296 secs 2024-04-21T14:27:28.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:27 smithi077 ceph-mon[27902]: pgmap v7856: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:28.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14558.567296 secs 2024-04-21T14:27:29.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:29 smithi191 ceph-mon[31636]: pgmap v7857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:29.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14560.327350 secs 2024-04-21T14:27:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:29 smithi170 ceph-mon[31212]: pgmap v7857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14560.327350 secs 2024-04-21T14:27:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:30.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:29 smithi077 ceph-mon[27902]: pgmap v7857: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:30.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14560.327350 secs 2024-04-21T14:27:31.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:31 smithi191 ceph-mon[31636]: pgmap v7858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:32.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:31 smithi170 ceph-mon[31212]: pgmap v7858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:32.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:31 smithi077 ceph-mon[27902]: pgmap v7858: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:33.012 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14563.567418 secs 2024-04-21T14:27:33.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14563.567418 secs 2024-04-21T14:27:33.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14563.567418 secs 2024-04-21T14:27:34.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:33 smithi170 ceph-mon[31212]: pgmap v7859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:34.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:33 smithi077 ceph-mon[27902]: pgmap v7859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:34.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:33 smithi191 ceph-mon[31636]: pgmap v7859: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14565.327464 secs 2024-04-21T14:27:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:35.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14565.327464 secs 2024-04-21T14:27:35.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14565.327464 secs 2024-04-21T14:27:36.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:35 smithi170 ceph-mon[31212]: pgmap v7860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:36.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:35 smithi077 ceph-mon[27902]: pgmap v7860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:36.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:35 smithi191 ceph-mon[31636]: pgmap v7860: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:37 smithi170 ceph-mon[31212]: pgmap v7861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14568.567479 secs 2024-04-21T14:27:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:37 smithi077 ceph-mon[27902]: pgmap v7861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:38.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14568.567479 secs 2024-04-21T14:27:38.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:37 smithi191 ceph-mon[31636]: pgmap v7861: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:38.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14568.567479 secs 2024-04-21T14:27:40.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:39 smithi170 ceph-mon[31212]: pgmap v7862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:40.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14570.327598 secs 2024-04-21T14:27:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:39 smithi077 ceph-mon[27902]: pgmap v7862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14570.327598 secs 2024-04-21T14:27:40.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:39 smithi191 ceph-mon[31636]: pgmap v7862: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:40.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14570.327598 secs 2024-04-21T14:27:42.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:41 smithi170 ceph-mon[31212]: pgmap v7863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:42.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:41 smithi077 ceph-mon[27902]: pgmap v7863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:42.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:41 smithi191 ceph-mon[31636]: pgmap v7863: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:43.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14573.567596 secs 2024-04-21T14:27:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14573.567596 secs 2024-04-21T14:27:43.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14573.567596 secs 2024-04-21T14:27:44.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:43 smithi170 ceph-mon[31212]: pgmap v7864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:44.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:43 smithi077 ceph-mon[27902]: pgmap v7864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:44.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:43 smithi191 ceph-mon[31636]: pgmap v7864: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14575.327708 secs 2024-04-21T14:27:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:45.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14575.327708 secs 2024-04-21T14:27:45.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14575.327708 secs 2024-04-21T14:27:46.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:45 smithi170 ceph-mon[31212]: pgmap v7865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:46.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:45 smithi077 ceph-mon[27902]: pgmap v7865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:46.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:45 smithi191 ceph-mon[31636]: pgmap v7865: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:48.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:47 smithi170 ceph-mon[31212]: pgmap v7866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:48.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14578.567730 secs 2024-04-21T14:27:48.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:47 smithi077 ceph-mon[27902]: pgmap v7866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:48.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14578.567730 secs 2024-04-21T14:27:48.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:47 smithi191 ceph-mon[31636]: pgmap v7866: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:48.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14578.567730 secs 2024-04-21T14:27:50.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:49 smithi170 ceph-mon[31212]: pgmap v7867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:50.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14580.327864 secs 2024-04-21T14:27:50.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:27:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:49 smithi077 ceph-mon[27902]: pgmap v7867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:50.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14580.327864 secs 2024-04-21T14:27:50.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:27:50.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:49 smithi191 ceph-mon[31636]: pgmap v7867: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:50.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14580.327864 secs 2024-04-21T14:27:50.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:27:51.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:27:51.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:27:51.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:27:51.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:27:51.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:51.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:27:51.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:27:51.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:27:52.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:52 smithi170 ceph-mon[31212]: pgmap v7868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:52.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:52 smithi077 ceph-mon[27902]: pgmap v7868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:52 smithi191 ceph-mon[31636]: pgmap v7868: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:53.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14583.567811 secs 2024-04-21T14:27:53.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14583.567811 secs 2024-04-21T14:27:53.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14583.567811 secs 2024-04-21T14:27:54.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:54 smithi170 ceph-mon[31212]: pgmap v7869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:54.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:54 smithi077 ceph-mon[27902]: pgmap v7869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:54 smithi191 ceph-mon[31636]: pgmap v7869: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:27:55.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14585.327987 secs 2024-04-21T14:27:55.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14585.327987 secs 2024-04-21T14:27:55.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14585.327987 secs 2024-04-21T14:27:56.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:56 smithi170 ceph-mon[31212]: pgmap v7870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:56.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:56 smithi077 ceph-mon[27902]: pgmap v7870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:56.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:56 smithi191 ceph-mon[31636]: pgmap v7870: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:27:58.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:58 smithi170 ceph-mon[31212]: pgmap v7871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:58.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:27:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14588.567925 secs 2024-04-21T14:27:58.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:58 smithi077 ceph-mon[27902]: pgmap v7871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:58.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:27:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14588.567925 secs 2024-04-21T14:27:58.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:58 smithi191 ceph-mon[31636]: pgmap v7871: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:27:58.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:27:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14588.567925 secs 2024-04-21T14:28:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:00.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:00 smithi170 ceph-mon[31212]: pgmap v7872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:00.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14590.328081 secs 2024-04-21T14:28:00.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:00 smithi077 ceph-mon[27902]: pgmap v7872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:00.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14590.328081 secs 2024-04-21T14:28:00.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:00 smithi191 ceph-mon[31636]: pgmap v7872: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:00.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14590.328081 secs 2024-04-21T14:28:02.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:02 smithi170 ceph-mon[31212]: pgmap v7873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:02.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:02 smithi077 ceph-mon[27902]: pgmap v7873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:02.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:02 smithi191 ceph-mon[31636]: pgmap v7873: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:03.512 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14593.568003 secs 2024-04-21T14:28:03.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14593.568003 secs 2024-04-21T14:28:03.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14593.568003 secs 2024-04-21T14:28:04.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:04 smithi170 ceph-mon[31212]: pgmap v7874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:04.532 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:04 smithi077 ceph-mon[27902]: pgmap v7874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:04.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:04 smithi191 ceph-mon[31636]: pgmap v7874: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:05.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14595.328199 secs 2024-04-21T14:28:05.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:05 smithi170 ceph-mon[31212]: osdmap e563: 12 total, 12 up, 12 in 2024-04-21T14:28:05.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14595.328199 secs 2024-04-21T14:28:05.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:05 smithi077 ceph-mon[27902]: osdmap e563: 12 total, 12 up, 12 in 2024-04-21T14:28:05.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14595.328199 secs 2024-04-21T14:28:05.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:05 smithi191 ceph-mon[31636]: osdmap e563: 12 total, 12 up, 12 in 2024-04-21T14:28:06.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:06 smithi170 ceph-mon[31212]: pgmap v7876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:28:06.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:06 smithi077 ceph-mon[27902]: pgmap v7876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:28:06.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:06 smithi191 ceph-mon[31636]: pgmap v7876: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:28:08.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:08 smithi170 ceph-mon[31212]: pgmap v7877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:08.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14598.568115 secs 2024-04-21T14:28:08.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:08 smithi077 ceph-mon[27902]: pgmap v7877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:08.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14598.568115 secs 2024-04-21T14:28:08.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:08 smithi191 ceph-mon[31636]: pgmap v7877: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:08.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14598.568115 secs 2024-04-21T14:28:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:10.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:10 smithi170 ceph-mon[31212]: pgmap v7878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:10.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14600.328321 secs 2024-04-21T14:28:10.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:10 smithi170 ceph-mon[31212]: osdmap e564: 12 total, 12 up, 12 in 2024-04-21T14:28:10.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:10 smithi077 ceph-mon[27902]: pgmap v7878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:10.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14600.328321 secs 2024-04-21T14:28:10.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:10 smithi077 ceph-mon[27902]: osdmap e564: 12 total, 12 up, 12 in 2024-04-21T14:28:10.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:10 smithi191 ceph-mon[31636]: pgmap v7878: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:10.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14600.328321 secs 2024-04-21T14:28:10.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:10 smithi191 ceph-mon[31636]: osdmap e564: 12 total, 12 up, 12 in 2024-04-21T14:28:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:11.364+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:28:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:11.364+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:28:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:11.365+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:28:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:11.365+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:28:12.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:12 smithi170 ceph-mon[31212]: pgmap v7880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:28:12.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:12 smithi077 ceph-mon[27902]: pgmap v7880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:28:12.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:12 smithi191 ceph-mon[31636]: pgmap v7880: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:28:13.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14603.568228 secs 2024-04-21T14:28:13.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14603.568228 secs 2024-04-21T14:28:13.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14603.568228 secs 2024-04-21T14:28:14.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:14 smithi170 ceph-mon[31212]: pgmap v7881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T14:28:14.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:14 smithi077 ceph-mon[27902]: pgmap v7881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T14:28:14.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:14 smithi191 ceph-mon[31636]: pgmap v7881: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T14:28:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:15.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14605.328436 secs 2024-04-21T14:28:15.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14605.328436 secs 2024-04-21T14:28:15.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14605.328436 secs 2024-04-21T14:28:16.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:16 smithi170 ceph-mon[31212]: pgmap v7882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:16.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:16 smithi077 ceph-mon[27902]: pgmap v7882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:16.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:16 smithi191 ceph-mon[31636]: pgmap v7882: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:28:18.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:18 smithi170 ceph-mon[31212]: pgmap v7883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:28:18.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14608.568366 secs 2024-04-21T14:28:18.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:18 smithi077 ceph-mon[27902]: pgmap v7883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:28:18.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14608.568366 secs 2024-04-21T14:28:18.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:18 smithi191 ceph-mon[31636]: pgmap v7883: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:28:18.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14608.568366 secs 2024-04-21T14:28:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:20.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:20 smithi077 ceph-mon[27902]: pgmap v7884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:28:20.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14610.328571 secs 2024-04-21T14:28:20.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:20 smithi191 ceph-mon[31636]: pgmap v7884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:28:20.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14610.328571 secs 2024-04-21T14:28:20.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:20 smithi170 ceph-mon[31212]: pgmap v7884: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:28:20.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14610.328571 secs 2024-04-21T14:28:22.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:22 smithi077 ceph-mon[27902]: pgmap v7885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:28:22.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:22 smithi191 ceph-mon[31636]: pgmap v7885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:28:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:22 smithi170 ceph-mon[31212]: pgmap v7885: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:28:23.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14613.568498 secs 2024-04-21T14:28:23.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14613.568498 secs 2024-04-21T14:28:23.683 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14613.568498 secs 2024-04-21T14:28:24.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:24 smithi077 ceph-mon[27902]: pgmap v7886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:24 smithi191 ceph-mon[31636]: pgmap v7886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:24 smithi170 ceph-mon[31212]: pgmap v7886: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:25.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14615.328689 secs 2024-04-21T14:28:25.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:25 smithi077 ceph-mon[27902]: pgmap v7887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:25.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14615.328689 secs 2024-04-21T14:28:25.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:25 smithi191 ceph-mon[31636]: pgmap v7887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:25.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14615.328689 secs 2024-04-21T14:28:25.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:25 smithi170 ceph-mon[31212]: pgmap v7887: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:27.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:27 smithi191 ceph-mon[31636]: pgmap v7888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:27.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:27 smithi170 ceph-mon[31212]: pgmap v7888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:27.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:27 smithi077 ceph-mon[27902]: pgmap v7888: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:28.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14618.568611 secs 2024-04-21T14:28:28.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14618.568611 secs 2024-04-21T14:28:28.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14618.568611 secs 2024-04-21T14:28:29.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:29 smithi191 ceph-mon[31636]: pgmap v7889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:29.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14620.328752 secs 2024-04-21T14:28:29.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:29 smithi170 ceph-mon[31212]: pgmap v7889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:29.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14620.328752 secs 2024-04-21T14:28:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:29 smithi077 ceph-mon[27902]: pgmap v7889: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14620.328752 secs 2024-04-21T14:28:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:31.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:31 smithi170 ceph-mon[31212]: pgmap v7890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:31.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:31 smithi077 ceph-mon[27902]: pgmap v7890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:31.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:31 smithi191 ceph-mon[31636]: pgmap v7890: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:33.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14623.568725 secs 2024-04-21T14:28:33.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:33 smithi170 ceph-mon[31212]: pgmap v7891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:33.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14623.568725 secs 2024-04-21T14:28:33.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:33 smithi077 ceph-mon[27902]: pgmap v7891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:33.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14623.568725 secs 2024-04-21T14:28:33.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:33 smithi191 ceph-mon[31636]: pgmap v7891: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:34.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14625.328867 secs 2024-04-21T14:28:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14625.328867 secs 2024-04-21T14:28:34.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14625.328867 secs 2024-04-21T14:28:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:35.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:35 smithi170 ceph-mon[31212]: pgmap v7892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:35.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:35 smithi077 ceph-mon[27902]: pgmap v7892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:35.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:35 smithi191 ceph-mon[31636]: pgmap v7892: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:37.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:37 smithi170 ceph-mon[31212]: pgmap v7893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:37.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:37 smithi077 ceph-mon[27902]: pgmap v7893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:37.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:37 smithi191 ceph-mon[31636]: pgmap v7893: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:38.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14628.568798 secs 2024-04-21T14:28:38.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14628.568798 secs 2024-04-21T14:28:38.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14628.568798 secs 2024-04-21T14:28:39.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:39 smithi170 ceph-mon[31212]: pgmap v7894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:39.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14630.329008 secs 2024-04-21T14:28:39.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:39 smithi077 ceph-mon[27902]: pgmap v7894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:39.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14630.329008 secs 2024-04-21T14:28:39.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:39 smithi191 ceph-mon[31636]: pgmap v7894: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:39.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14630.329008 secs 2024-04-21T14:28:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:41.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:41 smithi170 ceph-mon[31212]: pgmap v7895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:41.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:41 smithi077 ceph-mon[27902]: pgmap v7895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:41.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:41 smithi191 ceph-mon[31636]: pgmap v7895: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:43.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14633.568937 secs 2024-04-21T14:28:43.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:43 smithi170 ceph-mon[31212]: pgmap v7896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:43.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14633.568937 secs 2024-04-21T14:28:43.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:43 smithi077 ceph-mon[27902]: pgmap v7896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:43.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14633.568937 secs 2024-04-21T14:28:43.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:43 smithi191 ceph-mon[31636]: pgmap v7896: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14635.329119 secs 2024-04-21T14:28:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14635.329119 secs 2024-04-21T14:28:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14635.329119 secs 2024-04-21T14:28:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:45.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:45 smithi170 ceph-mon[31212]: pgmap v7897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:45.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:45 smithi077 ceph-mon[27902]: pgmap v7897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:45.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:45 smithi191 ceph-mon[31636]: pgmap v7897: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:47.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:47 smithi170 ceph-mon[31212]: pgmap v7898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:47.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:47 smithi077 ceph-mon[27902]: pgmap v7898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:47.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:47 smithi191 ceph-mon[31636]: pgmap v7898: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:48.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14638.569058 secs 2024-04-21T14:28:48.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14638.569058 secs 2024-04-21T14:28:48.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14638.569058 secs 2024-04-21T14:28:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:49 smithi170 ceph-mon[31212]: pgmap v7899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14640.329230 secs 2024-04-21T14:28:49.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:49 smithi077 ceph-mon[27902]: pgmap v7899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:49.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14640.329230 secs 2024-04-21T14:28:49.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:49 smithi191 ceph-mon[31636]: pgmap v7899: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:49.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14640.329230 secs 2024-04-21T14:28:50.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:51.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:51 smithi170 ceph-mon[31212]: pgmap v7900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:51.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:28:51.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:51.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:51 smithi077 ceph-mon[27902]: pgmap v7900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:51.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:28:51.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:51.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:51 smithi191 ceph-mon[31636]: pgmap v7900: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:51.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:28:51.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:28:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:28:52.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:28:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:28:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:28:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:28:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:28:53.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14643.569127 secs 2024-04-21T14:28:53.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:53 smithi170 ceph-mon[31212]: pgmap v7901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14643.569127 secs 2024-04-21T14:28:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:53 smithi191 ceph-mon[31636]: pgmap v7901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:53.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14643.569127 secs 2024-04-21T14:28:53.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:53 smithi077 ceph-mon[27902]: pgmap v7901: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.429+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T14:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.429+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T14:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.429+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T14:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.430+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:28:54.405 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.430+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T14:28:54.406 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.430+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T14:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T14:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T14:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bc0 tx=0x7efd7001f000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bc0 tx=0x7efd7001f000 comp rx=0 tx=0).stop 2024-04-21T14:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T14:28:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T14:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T14:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T14:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:28:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:54.442+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7004c000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T14:28:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14645.329344 secs 2024-04-21T14:28:54.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14645.329344 secs 2024-04-21T14:28:54.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14645.329344 secs 2024-04-21T14:28:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:28:55.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:55 smithi170 ceph-mon[31212]: pgmap v7902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:55.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:55 smithi077 ceph-mon[27902]: pgmap v7902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:55.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:55 smithi191 ceph-mon[31636]: pgmap v7902: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:56.371+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:28:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:56.371+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:28:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:56.371+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:28:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:28:56.371+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:28:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:57 smithi170 ceph-mon[31212]: pgmap v7903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:57.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:57 smithi077 ceph-mon[27902]: pgmap v7903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:57.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:57 smithi191 ceph-mon[31636]: pgmap v7903: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:28:58.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14648.569253 secs 2024-04-21T14:28:58.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14648.569253 secs 2024-04-21T14:28:58.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14648.569253 secs 2024-04-21T14:28:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:59 smithi170 ceph-mon[31212]: pgmap v7904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14650.329478 secs 2024-04-21T14:28:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:59 smithi077 ceph-mon[27902]: pgmap v7904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14650.329478 secs 2024-04-21T14:28:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:59 smithi191 ceph-mon[31636]: pgmap v7904: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:28:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14650.329478 secs 2024-04-21T14:29:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:01.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:01 smithi170 ceph-mon[31212]: pgmap v7905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:01.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:01 smithi077 ceph-mon[27902]: pgmap v7905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:01.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:01 smithi191 ceph-mon[31636]: pgmap v7905: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:03.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14653.569389 secs 2024-04-21T14:29:03.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:03 smithi077 ceph-mon[27902]: pgmap v7906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:03.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14653.569389 secs 2024-04-21T14:29:03.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:03 smithi191 ceph-mon[31636]: pgmap v7906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:04.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14653.569389 secs 2024-04-21T14:29:04.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:03 smithi170 ceph-mon[31212]: pgmap v7906: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:04.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14655.329610 secs 2024-04-21T14:29:04.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:04 smithi077 ceph-mon[27902]: osdmap e565: 12 total, 12 up, 12 in 2024-04-21T14:29:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14655.329610 secs 2024-04-21T14:29:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:04 smithi191 ceph-mon[31636]: osdmap e565: 12 total, 12 up, 12 in 2024-04-21T14:29:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14655.329610 secs 2024-04-21T14:29:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:04 smithi170 ceph-mon[31212]: osdmap e565: 12 total, 12 up, 12 in 2024-04-21T14:29:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:05.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:05 smithi077 ceph-mon[27902]: pgmap v7908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:29:05.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:05 smithi191 ceph-mon[31636]: pgmap v7908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:29:06.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:05 smithi170 ceph-mon[31212]: pgmap v7908: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:29:07.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:07 smithi077 ceph-mon[27902]: pgmap v7909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:29:07.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:07 smithi191 ceph-mon[31636]: pgmap v7909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:29:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:07 smithi170 ceph-mon[31212]: pgmap v7909: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:29:08.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14658.569505 secs 2024-04-21T14:29:08.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14658.569505 secs 2024-04-21T14:29:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14658.569505 secs 2024-04-21T14:29:09.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:09 smithi077 ceph-mon[27902]: pgmap v7910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:29:09.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14660.329762 secs 2024-04-21T14:29:09.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:09 smithi077 ceph-mon[27902]: osdmap e566: 12 total, 12 up, 12 in 2024-04-21T14:29:09.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:09 smithi191 ceph-mon[31636]: pgmap v7910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:29:09.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14660.329762 secs 2024-04-21T14:29:09.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:09 smithi191 ceph-mon[31636]: osdmap e566: 12 total, 12 up, 12 in 2024-04-21T14:29:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:09 smithi170 ceph-mon[31212]: pgmap v7910: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:29:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14660.329762 secs 2024-04-21T14:29:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:09 smithi170 ceph-mon[31212]: osdmap e566: 12 total, 12 up, 12 in 2024-04-21T14:29:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:11.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:11 smithi077 ceph-mon[27902]: pgmap v7912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:29:11.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:11 smithi191 ceph-mon[31636]: pgmap v7912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:29:12.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:11 smithi170 ceph-mon[31212]: pgmap v7912: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:29:13.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14663.569638 secs 2024-04-21T14:29:13.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:13 smithi077 ceph-mon[27902]: pgmap v7913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:29:13.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14663.569638 secs 2024-04-21T14:29:13.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:13 smithi191 ceph-mon[31636]: pgmap v7913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:29:14.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14663.569638 secs 2024-04-21T14:29:14.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:13 smithi170 ceph-mon[31212]: pgmap v7913: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:29:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14665.329851 secs 2024-04-21T14:29:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14665.329851 secs 2024-04-21T14:29:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14665.329851 secs 2024-04-21T14:29:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:15.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:15 smithi077 ceph-mon[27902]: pgmap v7914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:29:15.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:15 smithi191 ceph-mon[31636]: pgmap v7914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:29:16.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:15 smithi170 ceph-mon[31212]: pgmap v7914: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:29:17.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:17 smithi077 ceph-mon[27902]: pgmap v7915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:29:17.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:17 smithi191 ceph-mon[31636]: pgmap v7915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:29:18.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:17 smithi170 ceph-mon[31212]: pgmap v7915: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:29:18.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14668.569751 secs 2024-04-21T14:29:18.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14668.569751 secs 2024-04-21T14:29:19.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14668.569751 secs 2024-04-21T14:29:19.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:19 smithi077 ceph-mon[27902]: pgmap v7916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:29:19.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14670.329964 secs 2024-04-21T14:29:19.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:19 smithi191 ceph-mon[31636]: pgmap v7916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:29:19.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14670.329964 secs 2024-04-21T14:29:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:19 smithi170 ceph-mon[31212]: pgmap v7916: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:29:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14670.329964 secs 2024-04-21T14:29:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:21.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:21 smithi077 ceph-mon[27902]: pgmap v7917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:29:21.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:21 smithi191 ceph-mon[31636]: pgmap v7917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:29:22.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:21 smithi170 ceph-mon[31212]: pgmap v7917: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:29:23.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14673.569871 secs 2024-04-21T14:29:23.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:23 smithi077 ceph-mon[27902]: pgmap v7918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:23.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14673.569871 secs 2024-04-21T14:29:23.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:23 smithi191 ceph-mon[31636]: pgmap v7918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:24.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14673.569871 secs 2024-04-21T14:29:24.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:23 smithi170 ceph-mon[31212]: pgmap v7918: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:24.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14675.330056 secs 2024-04-21T14:29:24.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14675.330056 secs 2024-04-21T14:29:25.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14675.330056 secs 2024-04-21T14:29:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:25.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:25 smithi077 ceph-mon[27902]: pgmap v7919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:25.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:25 smithi191 ceph-mon[31636]: pgmap v7919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:26.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:25 smithi170 ceph-mon[31212]: pgmap v7919: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:27.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:27 smithi077 ceph-mon[27902]: pgmap v7920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:27.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14678.569986 secs 2024-04-21T14:29:27.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:27 smithi191 ceph-mon[31636]: pgmap v7920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:27.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14678.569986 secs 2024-04-21T14:29:28.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:27 smithi170 ceph-mon[31212]: pgmap v7920: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:28.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14678.569986 secs 2024-04-21T14:29:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:29 smithi077 ceph-mon[27902]: pgmap v7921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14680.330172 secs 2024-04-21T14:29:29.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:29 smithi191 ceph-mon[31636]: pgmap v7921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:29.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14680.330172 secs 2024-04-21T14:29:30.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:29 smithi170 ceph-mon[31212]: pgmap v7921: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14680.330172 secs 2024-04-21T14:29:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:31.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:31 smithi077 ceph-mon[27902]: pgmap v7922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:31.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:31 smithi191 ceph-mon[31636]: pgmap v7922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:32.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:31 smithi170 ceph-mon[31212]: pgmap v7922: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14683.570071 secs 2024-04-21T14:29:32.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14683.570071 secs 2024-04-21T14:29:33.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14683.570071 secs 2024-04-21T14:29:33.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:33 smithi077 ceph-mon[27902]: pgmap v7923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:33.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:33 smithi191 ceph-mon[31636]: pgmap v7923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:34.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:33 smithi170 ceph-mon[31212]: pgmap v7923: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:34.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14685.330235 secs 2024-04-21T14:29:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14685.330235 secs 2024-04-21T14:29:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:35.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14685.330235 secs 2024-04-21T14:29:35.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:35 smithi191 ceph-mon[31636]: pgmap v7924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:36.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:35 smithi170 ceph-mon[31212]: pgmap v7924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:36.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:35 smithi077 ceph-mon[27902]: pgmap v7924: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:37.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:37 smithi191 ceph-mon[31636]: pgmap v7925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:37.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14688.570187 secs 2024-04-21T14:29:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:37 smithi170 ceph-mon[31212]: pgmap v7925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14688.570187 secs 2024-04-21T14:29:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:37 smithi077 ceph-mon[27902]: pgmap v7925: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14688.570187 secs 2024-04-21T14:29:39.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:39 smithi191 ceph-mon[31636]: pgmap v7926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:39.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14690.330336 secs 2024-04-21T14:29:40.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:39 smithi170 ceph-mon[31212]: pgmap v7926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:40.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14690.330336 secs 2024-04-21T14:29:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:39 smithi077 ceph-mon[27902]: pgmap v7926: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14690.330336 secs 2024-04-21T14:29:41.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:41 smithi191 ceph-mon[31636]: pgmap v7927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:42.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:41 smithi170 ceph-mon[31212]: pgmap v7927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:42.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:41 smithi077 ceph-mon[27902]: pgmap v7927: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:42.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14693.570304 secs 2024-04-21T14:29:43.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14693.570304 secs 2024-04-21T14:29:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14693.570304 secs 2024-04-21T14:29:43.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:43 smithi191 ceph-mon[31636]: pgmap v7928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:44.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:43 smithi170 ceph-mon[31212]: pgmap v7928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:44.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:43 smithi077 ceph-mon[27902]: pgmap v7928: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14695.330444 secs 2024-04-21T14:29:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14695.330444 secs 2024-04-21T14:29:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:45.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14695.330444 secs 2024-04-21T14:29:45.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:45 smithi191 ceph-mon[31636]: pgmap v7929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:46.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:45 smithi170 ceph-mon[31212]: pgmap v7929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:46.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:45 smithi077 ceph-mon[27902]: pgmap v7929: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:47.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:47 smithi191 ceph-mon[31636]: pgmap v7930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:47.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14698.570437 secs 2024-04-21T14:29:48.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:47 smithi170 ceph-mon[31212]: pgmap v7930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:48.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14698.570437 secs 2024-04-21T14:29:48.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:47 smithi077 ceph-mon[27902]: pgmap v7930: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:48.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14698.570437 secs 2024-04-21T14:29:49.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:49 smithi191 ceph-mon[31636]: pgmap v7931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:49.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14700.330560 secs 2024-04-21T14:29:50.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:49 smithi170 ceph-mon[31212]: pgmap v7931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:50.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14700.330560 secs 2024-04-21T14:29:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:49 smithi077 ceph-mon[27902]: pgmap v7931: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14700.330560 secs 2024-04-21T14:29:51.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:51 smithi191 ceph-mon[31636]: pgmap v7932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:52.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:51 smithi170 ceph-mon[31212]: pgmap v7932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:52.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:51 smithi077 ceph-mon[27902]: pgmap v7932: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14703.570555 secs 2024-04-21T14:29:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:29:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14703.570555 secs 2024-04-21T14:29:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:29:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14703.570555 secs 2024-04-21T14:29:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:29:53.933 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:53 smithi170 ceph-mon[31212]: pgmap v7933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:53.933 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:29:53.933 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:29:53.933 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:29:53.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:53 smithi191 ceph-mon[31636]: pgmap v7933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:53.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:29:53.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:29:53.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:29:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:53 smithi077 ceph-mon[27902]: pgmap v7933: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:29:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:29:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:29:54.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14705.330671 secs 2024-04-21T14:29:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14705.330671 secs 2024-04-21T14:29:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:29:55.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14705.330671 secs 2024-04-21T14:29:55.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:55 smithi191 ceph-mon[31636]: pgmap v7934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:56.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:55 smithi170 ceph-mon[31212]: pgmap v7934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:56.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:55 smithi077 ceph-mon[27902]: pgmap v7934: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:57.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:57 smithi191 ceph-mon[31636]: pgmap v7935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:57.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14708.570648 secs 2024-04-21T14:29:58.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:57 smithi170 ceph-mon[31212]: pgmap v7935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14708.570648 secs 2024-04-21T14:29:58.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:57 smithi077 ceph-mon[27902]: pgmap v7935: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:29:58.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14708.570648 secs 2024-04-21T14:29:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:59 smithi191 ceph-mon[31636]: pgmap v7936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:29:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14710.330778 secs 2024-04-21T14:30:00.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:59 smithi170 ceph-mon[31212]: pgmap v7936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:00.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14710.330778 secs 2024-04-21T14:30:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:00.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:59 smithi077 ceph-mon[27902]: pgmap v7936: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:00.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14710.330778 secs 2024-04-21T14:30:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:30:01.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:30:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:30:01.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:01 smithi191 ceph-mon[31636]: pgmap v7937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:02.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:01 smithi170 ceph-mon[31212]: pgmap v7937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:02.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:01 smithi077 ceph-mon[27902]: pgmap v7937: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:03.011 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14713.570743 secs 2024-04-21T14:30:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14713.570743 secs 2024-04-21T14:30:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14713.570743 secs 2024-04-21T14:30:04.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:03 smithi170 ceph-mon[31212]: pgmap v7938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:04.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:03 smithi077 ceph-mon[27902]: pgmap v7938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:04.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:03 smithi191 ceph-mon[31636]: pgmap v7938: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14715.330894 secs 2024-04-21T14:30:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:04 smithi170 ceph-mon[31212]: osdmap e567: 12 total, 12 up, 12 in 2024-04-21T14:30:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14715.330894 secs 2024-04-21T14:30:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:04 smithi077 ceph-mon[27902]: osdmap e567: 12 total, 12 up, 12 in 2024-04-21T14:30:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14715.330894 secs 2024-04-21T14:30:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:04 smithi191 ceph-mon[31636]: osdmap e567: 12 total, 12 up, 12 in 2024-04-21T14:30:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:05 smithi170 ceph-mon[31212]: pgmap v7940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:30:06.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:05 smithi077 ceph-mon[27902]: pgmap v7940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:30:06.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:05 smithi191 ceph-mon[31636]: pgmap v7940: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:30:08.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:07 smithi170 ceph-mon[31212]: pgmap v7941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:30:08.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14718.570808 secs 2024-04-21T14:30:08.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:07 smithi077 ceph-mon[27902]: pgmap v7941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:30:08.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14718.570808 secs 2024-04-21T14:30:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:07 smithi191 ceph-mon[31636]: pgmap v7941: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:30:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14718.570808 secs 2024-04-21T14:30:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:09 smithi170 ceph-mon[31212]: pgmap v7942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:30:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14720.331010 secs 2024-04-21T14:30:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:09 smithi170 ceph-mon[31212]: osdmap e568: 12 total, 12 up, 12 in 2024-04-21T14:30:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:09 smithi077 ceph-mon[27902]: pgmap v7942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:30:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14720.331010 secs 2024-04-21T14:30:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:09 smithi077 ceph-mon[27902]: osdmap e568: 12 total, 12 up, 12 in 2024-04-21T14:30:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:09 smithi191 ceph-mon[31636]: pgmap v7942: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:30:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14720.331010 secs 2024-04-21T14:30:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:09 smithi191 ceph-mon[31636]: osdmap e568: 12 total, 12 up, 12 in 2024-04-21T14:30:12.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:11 smithi170 ceph-mon[31212]: pgmap v7944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:30:12.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:11 smithi077 ceph-mon[27902]: pgmap v7944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:30:12.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:11 smithi191 ceph-mon[31636]: pgmap v7944: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:30:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14723.570925 secs 2024-04-21T14:30:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14723.570925 secs 2024-04-21T14:30:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14723.570925 secs 2024-04-21T14:30:14.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:13 smithi170 ceph-mon[31212]: pgmap v7945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:30:14.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:13 smithi077 ceph-mon[27902]: pgmap v7945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:30:14.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:13 smithi191 ceph-mon[31636]: pgmap v7945: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:30:15.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14725.331126 secs 2024-04-21T14:30:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:15.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14725.331126 secs 2024-04-21T14:30:15.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14725.331126 secs 2024-04-21T14:30:16.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:15 smithi170 ceph-mon[31212]: pgmap v7946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:30:16.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:15 smithi077 ceph-mon[27902]: pgmap v7946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:30:16.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:15 smithi191 ceph-mon[31636]: pgmap v7946: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:30:18.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:17 smithi170 ceph-mon[31212]: pgmap v7947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:30:18.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14728.571038 secs 2024-04-21T14:30:18.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:17 smithi077 ceph-mon[27902]: pgmap v7947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:30:18.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14728.571038 secs 2024-04-21T14:30:18.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:17 smithi191 ceph-mon[31636]: pgmap v7947: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:30:18.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14728.571038 secs 2024-04-21T14:30:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:19 smithi170 ceph-mon[31212]: pgmap v7948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:30:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14730.331247 secs 2024-04-21T14:30:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:20.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:19 smithi077 ceph-mon[27902]: pgmap v7948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:30:20.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14730.331247 secs 2024-04-21T14:30:20.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:19 smithi191 ceph-mon[31636]: pgmap v7948: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:30:20.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14730.331247 secs 2024-04-21T14:30:22.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:21 smithi170 ceph-mon[31212]: pgmap v7949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:30:22.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:21 smithi077 ceph-mon[27902]: pgmap v7949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:30:22.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:21 smithi191 ceph-mon[31636]: pgmap v7949: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:30:23.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14733.571155 secs 2024-04-21T14:30:23.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14733.571155 secs 2024-04-21T14:30:23.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14733.571155 secs 2024-04-21T14:30:24.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:23 smithi170 ceph-mon[31212]: pgmap v7950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:24.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:23 smithi077 ceph-mon[27902]: pgmap v7950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:24.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:23 smithi191 ceph-mon[31636]: pgmap v7950: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:25.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14735.331326 secs 2024-04-21T14:30:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:25.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14735.331326 secs 2024-04-21T14:30:25.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14735.331326 secs 2024-04-21T14:30:26.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:25 smithi170 ceph-mon[31212]: pgmap v7951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:26.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:25 smithi077 ceph-mon[27902]: pgmap v7951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:26.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:25 smithi191 ceph-mon[31636]: pgmap v7951: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:28.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:27 smithi170 ceph-mon[31212]: pgmap v7952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:28.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14738.571268 secs 2024-04-21T14:30:28.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:27 smithi077 ceph-mon[27902]: pgmap v7952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:28.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14738.571268 secs 2024-04-21T14:30:28.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:27 smithi191 ceph-mon[31636]: pgmap v7952: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:28.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14738.571268 secs 2024-04-21T14:30:30.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:29 smithi170 ceph-mon[31212]: pgmap v7953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14740.331460 secs 2024-04-21T14:30:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:30.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:29 smithi077 ceph-mon[27902]: pgmap v7953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:30.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14740.331460 secs 2024-04-21T14:30:30.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:29 smithi191 ceph-mon[31636]: pgmap v7953: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:30.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14740.331460 secs 2024-04-21T14:30:32.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:31 smithi077 ceph-mon[27902]: pgmap v7954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:32.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:31 smithi191 ceph-mon[31636]: pgmap v7954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:32.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:31 smithi170 ceph-mon[31212]: pgmap v7954: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:33.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14743.571382 secs 2024-04-21T14:30:33.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14743.571382 secs 2024-04-21T14:30:33.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14743.571382 secs 2024-04-21T14:30:34.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:33 smithi077 ceph-mon[27902]: pgmap v7955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:34.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:33 smithi191 ceph-mon[31636]: pgmap v7955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:34.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:33 smithi170 ceph-mon[31212]: pgmap v7955: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:35.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14745.331596 secs 2024-04-21T14:30:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:35.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14745.331596 secs 2024-04-21T14:30:35.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14745.331596 secs 2024-04-21T14:30:36.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:35 smithi077 ceph-mon[27902]: pgmap v7956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:36.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:35 smithi191 ceph-mon[31636]: pgmap v7956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:36.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:35 smithi170 ceph-mon[31212]: pgmap v7956: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:37 smithi077 ceph-mon[27902]: pgmap v7957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14748.571516 secs 2024-04-21T14:30:38.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:37 smithi191 ceph-mon[31636]: pgmap v7957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:38.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14748.571516 secs 2024-04-21T14:30:38.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:37 smithi170 ceph-mon[31212]: pgmap v7957: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:38.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14748.571516 secs 2024-04-21T14:30:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:40.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:39 smithi077 ceph-mon[27902]: pgmap v7958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14750.331711 secs 2024-04-21T14:30:40.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:39 smithi191 ceph-mon[31636]: pgmap v7958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:40.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14750.331711 secs 2024-04-21T14:30:40.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:39 smithi170 ceph-mon[31212]: pgmap v7958: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:40.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14750.331711 secs 2024-04-21T14:30:42.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:41 smithi077 ceph-mon[27902]: pgmap v7959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:42.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:41 smithi191 ceph-mon[31636]: pgmap v7959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:42.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:41 smithi170 ceph-mon[31212]: pgmap v7959: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14753.571629 secs 2024-04-21T14:30:43.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14753.571629 secs 2024-04-21T14:30:43.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14753.571629 secs 2024-04-21T14:30:44.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:43 smithi077 ceph-mon[27902]: pgmap v7960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:44.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:43 smithi191 ceph-mon[31636]: pgmap v7960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:44.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:43 smithi170 ceph-mon[31212]: pgmap v7960: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:45.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14755.331836 secs 2024-04-21T14:30:45.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14755.331836 secs 2024-04-21T14:30:45.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14755.331836 secs 2024-04-21T14:30:46.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:45 smithi077 ceph-mon[27902]: pgmap v7961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:46.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:45 smithi191 ceph-mon[31636]: pgmap v7961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:46.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:45 smithi170 ceph-mon[31212]: pgmap v7961: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:30:48.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:47 smithi077 ceph-mon[27902]: pgmap v7962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:48.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14758.571701 secs 2024-04-21T14:30:48.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:47 smithi191 ceph-mon[31636]: pgmap v7962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:48.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14758.571701 secs 2024-04-21T14:30:48.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:47 smithi170 ceph-mon[31212]: pgmap v7962: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:30:48.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14758.571701 secs 2024-04-21T14:30:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:49 smithi077 ceph-mon[27902]: pgmap v7963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14760.331874 secs 2024-04-21T14:30:50.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:49 smithi191 ceph-mon[31636]: pgmap v7963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:50.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14760.331874 secs 2024-04-21T14:30:50.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:49 smithi170 ceph-mon[31212]: pgmap v7963: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:50.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14760.331874 secs 2024-04-21T14:30:52.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:51 smithi077 ceph-mon[27902]: pgmap v7964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:52.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:51 smithi191 ceph-mon[31636]: pgmap v7964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:52.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:51 smithi170 ceph-mon[31212]: pgmap v7964: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14763.571816 secs 2024-04-21T14:30:53.183 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14763.571816 secs 2024-04-21T14:30:53.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14763.571816 secs 2024-04-21T14:30:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:53 smithi077 ceph-mon[27902]: pgmap v7965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:30:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:30:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:30:54.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:30:54.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:53 smithi191 ceph-mon[31636]: pgmap v7965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:54.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:30:54.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:30:54.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:30:54.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:30:54.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:53 smithi170 ceph-mon[31212]: pgmap v7965: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:54.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:30:54.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:30:54.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:30:54.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:30:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:30:55.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14765.331960 secs 2024-04-21T14:30:55.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14765.331960 secs 2024-04-21T14:30:55.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14765.331960 secs 2024-04-21T14:30:56.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:55 smithi077 ceph-mon[27902]: pgmap v7966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:56.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:55 smithi191 ceph-mon[31636]: pgmap v7966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:56.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:55 smithi170 ceph-mon[31212]: pgmap v7966: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:30:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:57 smithi191 ceph-mon[31636]: pgmap v7967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14768.571935 secs 2024-04-21T14:30:58.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:57 smithi170 ceph-mon[31212]: pgmap v7967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:58.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14768.571935 secs 2024-04-21T14:30:58.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:57 smithi077 ceph-mon[27902]: pgmap v7967: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:30:58.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14768.571935 secs 2024-04-21T14:31:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:00.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:59 smithi191 ceph-mon[31636]: pgmap v7968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:00.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14770.332039 secs 2024-04-21T14:31:00.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:59 smithi170 ceph-mon[31212]: pgmap v7968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:00.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14770.332039 secs 2024-04-21T14:31:00.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:59 smithi077 ceph-mon[27902]: pgmap v7968: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:00.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14770.332039 secs 2024-04-21T14:31:02.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:01 smithi191 ceph-mon[31636]: pgmap v7969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T14:31:02.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:01 smithi170 ceph-mon[31212]: pgmap v7969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T14:31:02.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:01 smithi077 ceph-mon[27902]: pgmap v7969: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T14:31:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14773.572047 secs 2024-04-21T14:31:03.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14773.572047 secs 2024-04-21T14:31:03.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14773.572047 secs 2024-04-21T14:31:04.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:03 smithi191 ceph-mon[31636]: pgmap v7970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T14:31:04.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:03 smithi170 ceph-mon[31212]: pgmap v7970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T14:31:04.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:03 smithi077 ceph-mon[27902]: pgmap v7970: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T14:31:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14775.332156 secs 2024-04-21T14:31:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:04 smithi191 ceph-mon[31636]: osdmap e569: 12 total, 12 up, 12 in 2024-04-21T14:31:05.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14775.332156 secs 2024-04-21T14:31:05.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:04 smithi170 ceph-mon[31212]: osdmap e569: 12 total, 12 up, 12 in 2024-04-21T14:31:05.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14775.332156 secs 2024-04-21T14:31:05.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:04 smithi077 ceph-mon[27902]: osdmap e569: 12 total, 12 up, 12 in 2024-04-21T14:31:06.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:05 smithi191 ceph-mon[31636]: pgmap v7972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:06.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:05 smithi170 ceph-mon[31212]: pgmap v7972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:06.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:05 smithi077 ceph-mon[27902]: pgmap v7972: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:07 smithi191 ceph-mon[31636]: pgmap v7973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14778.572162 secs 2024-04-21T14:31:08.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:07 smithi170 ceph-mon[31212]: pgmap v7973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:08.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14778.572162 secs 2024-04-21T14:31:08.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:07 smithi077 ceph-mon[27902]: pgmap v7973: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:08.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14778.572162 secs 2024-04-21T14:31:10.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:09 smithi191 ceph-mon[31636]: pgmap v7974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14780.332235 secs 2024-04-21T14:31:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:09 smithi191 ceph-mon[31636]: osdmap e570: 12 total, 12 up, 12 in 2024-04-21T14:31:10.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:09 smithi170 ceph-mon[31212]: pgmap v7974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:10.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14780.332235 secs 2024-04-21T14:31:10.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:09 smithi170 ceph-mon[31212]: osdmap e570: 12 total, 12 up, 12 in 2024-04-21T14:31:10.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:09 smithi077 ceph-mon[27902]: pgmap v7974: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:31:10.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14780.332235 secs 2024-04-21T14:31:10.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:09 smithi077 ceph-mon[27902]: osdmap e570: 12 total, 12 up, 12 in 2024-04-21T14:31:12.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:11 smithi191 ceph-mon[31636]: pgmap v7976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T14:31:12.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:11 smithi170 ceph-mon[31212]: pgmap v7976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T14:31:12.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:11 smithi077 ceph-mon[27902]: pgmap v7976: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T14:31:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14783.572301 secs 2024-04-21T14:31:13.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14783.572301 secs 2024-04-21T14:31:13.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14783.572301 secs 2024-04-21T14:31:14.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:13 smithi191 ceph-mon[31636]: pgmap v7977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 359 B/s wr, 8 op/s 2024-04-21T14:31:14.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:13 smithi170 ceph-mon[31212]: pgmap v7977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 359 B/s wr, 8 op/s 2024-04-21T14:31:14.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:13 smithi077 ceph-mon[27902]: pgmap v7977: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 359 B/s wr, 8 op/s 2024-04-21T14:31:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:15.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14785.332363 secs 2024-04-21T14:31:15.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14785.332363 secs 2024-04-21T14:31:15.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14785.332363 secs 2024-04-21T14:31:16.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:15 smithi191 ceph-mon[31636]: pgmap v7978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 307 B/s wr, 7 op/s 2024-04-21T14:31:16.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:15 smithi170 ceph-mon[31212]: pgmap v7978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 307 B/s wr, 7 op/s 2024-04-21T14:31:16.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:15 smithi077 ceph-mon[27902]: pgmap v7978: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 307 B/s wr, 7 op/s 2024-04-21T14:31:18.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:17 smithi191 ceph-mon[31636]: pgmap v7979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:31:18.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14788.572423 secs 2024-04-21T14:31:18.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:17 smithi170 ceph-mon[31212]: pgmap v7979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:31:18.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14788.572423 secs 2024-04-21T14:31:18.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:17 smithi077 ceph-mon[27902]: pgmap v7979: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:31:18.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14788.572423 secs 2024-04-21T14:31:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:20.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:19 smithi191 ceph-mon[31636]: pgmap v7980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:31:20.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14790.332497 secs 2024-04-21T14:31:20.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:19 smithi170 ceph-mon[31212]: pgmap v7980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:31:20.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14790.332497 secs 2024-04-21T14:31:20.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:19 smithi077 ceph-mon[27902]: pgmap v7980: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:31:20.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14790.332497 secs 2024-04-21T14:31:22.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:21 smithi191 ceph-mon[31636]: pgmap v7981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:31:22.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:21 smithi170 ceph-mon[31212]: pgmap v7981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:31:22.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:21 smithi077 ceph-mon[27902]: pgmap v7981: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:31:23.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14793.572537 secs 2024-04-21T14:31:23.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14793.572537 secs 2024-04-21T14:31:23.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14793.572537 secs 2024-04-21T14:31:24.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:23 smithi191 ceph-mon[31636]: pgmap v7982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:24.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:23 smithi170 ceph-mon[31212]: pgmap v7982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:24.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:23 smithi077 ceph-mon[27902]: pgmap v7982: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:25.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14795.332633 secs 2024-04-21T14:31:25.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14795.332633 secs 2024-04-21T14:31:25.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14795.332633 secs 2024-04-21T14:31:26.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:25 smithi170 ceph-mon[31212]: pgmap v7983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:26.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:25 smithi077 ceph-mon[27902]: pgmap v7983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:26.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:25 smithi191 ceph-mon[31636]: pgmap v7983: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:28.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:27 smithi170 ceph-mon[31212]: pgmap v7984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:28.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14798.572654 secs 2024-04-21T14:31:28.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:27 smithi077 ceph-mon[27902]: pgmap v7984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:28.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14798.572654 secs 2024-04-21T14:31:28.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:27 smithi191 ceph-mon[31636]: pgmap v7984: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:28.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14798.572654 secs 2024-04-21T14:31:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:30.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:29 smithi170 ceph-mon[31212]: pgmap v7985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:30.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14800.332767 secs 2024-04-21T14:31:30.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:29 smithi077 ceph-mon[27902]: pgmap v7985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:30.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14800.332767 secs 2024-04-21T14:31:30.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:29 smithi191 ceph-mon[31636]: pgmap v7985: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:30.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14800.332767 secs 2024-04-21T14:31:32.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:31 smithi170 ceph-mon[31212]: pgmap v7986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:32.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:31 smithi077 ceph-mon[27902]: pgmap v7986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:32.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:31 smithi191 ceph-mon[31636]: pgmap v7986: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:33.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14803.572750 secs 2024-04-21T14:31:33.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14803.572750 secs 2024-04-21T14:31:33.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14803.572750 secs 2024-04-21T14:31:34.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:33 smithi170 ceph-mon[31212]: pgmap v7987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:34.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:33 smithi077 ceph-mon[27902]: pgmap v7987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:34.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:33 smithi191 ceph-mon[31636]: pgmap v7987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:35.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14805.332886 secs 2024-04-21T14:31:35.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14805.332886 secs 2024-04-21T14:31:35.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14805.332886 secs 2024-04-21T14:31:36.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:35 smithi170 ceph-mon[31212]: pgmap v7988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:36.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:35 smithi077 ceph-mon[27902]: pgmap v7988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:36.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:35 smithi191 ceph-mon[31636]: pgmap v7988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:38.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:38 smithi170 ceph-mon[31212]: pgmap v7989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:38.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14808.572883 secs 2024-04-21T14:31:38.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:38 smithi077 ceph-mon[27902]: pgmap v7989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:38.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14808.572883 secs 2024-04-21T14:31:38.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:38 smithi191 ceph-mon[31636]: pgmap v7989: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:38.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14808.572883 secs 2024-04-21T14:31:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 14995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:40.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:40 smithi170 ceph-mon[31212]: pgmap v7990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:40.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14810.332997 secs 2024-04-21T14:31:40.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:40 smithi077 ceph-mon[27902]: pgmap v7990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:40.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14810.332997 secs 2024-04-21T14:31:40.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:40 smithi191 ceph-mon[31636]: pgmap v7990: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:40.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14810.332997 secs 2024-04-21T14:31:42.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:42 smithi170 ceph-mon[31212]: pgmap v7991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:42.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:42 smithi077 ceph-mon[27902]: pgmap v7991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:42.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:42 smithi191 ceph-mon[31636]: pgmap v7991: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:43.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14813.573002 secs 2024-04-21T14:31:43.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14813.573002 secs 2024-04-21T14:31:43.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14813.573002 secs 2024-04-21T14:31:44.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:44 smithi170 ceph-mon[31212]: pgmap v7992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:44.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:44 smithi077 ceph-mon[27902]: pgmap v7992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:44.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:44 smithi191 ceph-mon[31636]: pgmap v7992: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:45.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14815.333119 secs 2024-04-21T14:31:45.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14815.333119 secs 2024-04-21T14:31:45.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14815.333119 secs 2024-04-21T14:31:46.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:46 smithi170 ceph-mon[31212]: pgmap v7993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:46.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:46 smithi077 ceph-mon[27902]: pgmap v7993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:46.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:46 smithi191 ceph-mon[31636]: pgmap v7993: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:48.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:48 smithi170 ceph-mon[31212]: pgmap v7994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:48.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14818.573113 secs 2024-04-21T14:31:48.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:48 smithi077 ceph-mon[27902]: pgmap v7994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:48.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14818.573113 secs 2024-04-21T14:31:48.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:48 smithi191 ceph-mon[31636]: pgmap v7994: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:48.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14818.573113 secs 2024-04-21T14:31:50.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:50.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:50 smithi170 ceph-mon[31212]: pgmap v7995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:50.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14820.333232 secs 2024-04-21T14:31:50.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:50 smithi077 ceph-mon[27902]: pgmap v7995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:50.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14820.333232 secs 2024-04-21T14:31:50.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:50 smithi191 ceph-mon[31636]: pgmap v7995: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:50.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14820.333232 secs 2024-04-21T14:31:52.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:52 smithi170 ceph-mon[31212]: pgmap v7996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:52.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:52 smithi077 ceph-mon[27902]: pgmap v7996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:52.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:52 smithi191 ceph-mon[31636]: pgmap v7996: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:53.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14823.573204 secs 2024-04-21T14:31:53.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14823.573204 secs 2024-04-21T14:31:53.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14823.573204 secs 2024-04-21T14:31:54.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:54 smithi170 ceph-mon[31212]: pgmap v7997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:54.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:31:54.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:54 smithi077 ceph-mon[27902]: pgmap v7997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:54.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:31:54.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:54 smithi191 ceph-mon[31636]: pgmap v7997: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:54.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:31:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:31:55.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14825.333370 secs 2024-04-21T14:31:55.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:31:55.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:31:55.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:31:55.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14825.333370 secs 2024-04-21T14:31:55.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:31:55.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:31:55.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:31:55.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14825.333370 secs 2024-04-21T14:31:55.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:31:55.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:31:55.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:31:56.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:56 smithi170 ceph-mon[31212]: pgmap v7998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:56.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:56 smithi077 ceph-mon[27902]: pgmap v7998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:31:56.396+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:31:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:31:56.396+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:31:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:31:56.396+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:31:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:31:56.396+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd50006620 con 0x7efd78101130 2024-04-21T14:31:56.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:56 smithi191 ceph-mon[31636]: pgmap v7998: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:31:58.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:58 smithi170 ceph-mon[31212]: pgmap v7999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:58.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:31:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14828.573345 secs 2024-04-21T14:31:58.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:58 smithi077 ceph-mon[27902]: pgmap v7999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:58.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:31:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14828.573345 secs 2024-04-21T14:31:58.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:58 smithi191 ceph-mon[31636]: pgmap v7999: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:31:58.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:31:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14828.573345 secs 2024-04-21T14:32:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:00.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:00 smithi170 ceph-mon[31212]: pgmap v8000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:00.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14830.333507 secs 2024-04-21T14:32:00.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:00 smithi077 ceph-mon[27902]: pgmap v8000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:00.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14830.333507 secs 2024-04-21T14:32:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:00 smithi191 ceph-mon[31636]: pgmap v8000: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:00.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14830.333507 secs 2024-04-21T14:32:02.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:02 smithi170 ceph-mon[31212]: pgmap v8001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T14:32:02.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:02 smithi077 ceph-mon[27902]: pgmap v8001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T14:32:02.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:02 smithi191 ceph-mon[31636]: pgmap v8001: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T14:32:03.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14833.573425 secs 2024-04-21T14:32:03.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14833.573425 secs 2024-04-21T14:32:03.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14833.573425 secs 2024-04-21T14:32:04.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:04 smithi077 ceph-mon[27902]: pgmap v8002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T14:32:04.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:04 smithi191 ceph-mon[31636]: pgmap v8002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T14:32:04.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:04 smithi170 ceph-mon[31212]: pgmap v8002: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T14:32:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:05.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14835.333586 secs 2024-04-21T14:32:05.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:05 smithi077 ceph-mon[27902]: osdmap e571: 12 total, 12 up, 12 in 2024-04-21T14:32:05.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14835.333586 secs 2024-04-21T14:32:05.444 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:05 smithi191 ceph-mon[31636]: osdmap e571: 12 total, 12 up, 12 in 2024-04-21T14:32:05.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14835.333586 secs 2024-04-21T14:32:05.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:05 smithi170 ceph-mon[31212]: osdmap e571: 12 total, 12 up, 12 in 2024-04-21T14:32:06.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:06 smithi077 ceph-mon[27902]: pgmap v8004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T14:32:06.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:06 smithi191 ceph-mon[31636]: pgmap v8004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T14:32:06.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:06 smithi170 ceph-mon[31212]: pgmap v8004: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T14:32:08.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:08 smithi077 ceph-mon[27902]: pgmap v8005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:32:08.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14838.573537 secs 2024-04-21T14:32:08.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:08 smithi191 ceph-mon[31636]: pgmap v8005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:32:08.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14838.573537 secs 2024-04-21T14:32:08.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:08 smithi170 ceph-mon[31212]: pgmap v8005: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:32:08.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14838.573537 secs 2024-04-21T14:32:10.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:10.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14840.333647 secs 2024-04-21T14:32:10.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:10 smithi077 ceph-mon[27902]: pgmap v8006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:32:10.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:10 smithi077 ceph-mon[27902]: osdmap e572: 12 total, 12 up, 12 in 2024-04-21T14:32:10.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14840.333647 secs 2024-04-21T14:32:10.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:10 smithi191 ceph-mon[31636]: pgmap v8006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:32:10.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:10 smithi191 ceph-mon[31636]: osdmap e572: 12 total, 12 up, 12 in 2024-04-21T14:32:10.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14840.333647 secs 2024-04-21T14:32:10.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:10 smithi170 ceph-mon[31212]: pgmap v8006: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:32:10.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:10 smithi170 ceph-mon[31212]: osdmap e572: 12 total, 12 up, 12 in 2024-04-21T14:32:12.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:12 smithi077 ceph-mon[27902]: pgmap v8008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 29 op/s 2024-04-21T14:32:12.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:12 smithi191 ceph-mon[31636]: pgmap v8008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 29 op/s 2024-04-21T14:32:12.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:12 smithi170 ceph-mon[31212]: pgmap v8008: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 29 op/s 2024-04-21T14:32:13.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14843.573653 secs 2024-04-21T14:32:13.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14843.573653 secs 2024-04-21T14:32:13.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14843.573653 secs 2024-04-21T14:32:14.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:14 smithi077 ceph-mon[27902]: pgmap v8009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 KiB/s wr, 27 op/s 2024-04-21T14:32:14.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:14 smithi191 ceph-mon[31636]: pgmap v8009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 KiB/s wr, 27 op/s 2024-04-21T14:32:14.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:14 smithi170 ceph-mon[31212]: pgmap v8009: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 KiB/s wr, 27 op/s 2024-04-21T14:32:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:15.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14845.333764 secs 2024-04-21T14:32:15.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14845.333764 secs 2024-04-21T14:32:15.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14845.333764 secs 2024-04-21T14:32:16.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:16 smithi077 ceph-mon[27902]: pgmap v8010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T14:32:16.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:16 smithi191 ceph-mon[31636]: pgmap v8010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T14:32:16.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:16 smithi170 ceph-mon[31212]: pgmap v8010: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T14:32:18.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:18 smithi077 ceph-mon[27902]: pgmap v8011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:32:18.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14848.573776 secs 2024-04-21T14:32:18.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:18 smithi191 ceph-mon[31636]: pgmap v8011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:32:18.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14848.573776 secs 2024-04-21T14:32:18.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:18 smithi170 ceph-mon[31212]: pgmap v8011: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:32:18.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14848.573776 secs 2024-04-21T14:32:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:20.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14850.333910 secs 2024-04-21T14:32:20.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:20 smithi077 ceph-mon[27902]: pgmap v8012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:32:20.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14850.333910 secs 2024-04-21T14:32:20.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:20 smithi191 ceph-mon[31636]: pgmap v8012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:32:20.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14850.333910 secs 2024-04-21T14:32:20.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:20 smithi170 ceph-mon[31212]: pgmap v8012: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:32:22.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:22 smithi077 ceph-mon[27902]: pgmap v8013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:32:22.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:22 smithi191 ceph-mon[31636]: pgmap v8013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:32:22.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:22 smithi170 ceph-mon[31212]: pgmap v8013: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 93 B/s wr, 8 op/s 2024-04-21T14:32:23.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14853.573882 secs 2024-04-21T14:32:23.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14853.573882 secs 2024-04-21T14:32:23.432 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14853.573882 secs 2024-04-21T14:32:24.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:24 smithi077 ceph-mon[27902]: pgmap v8014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:24.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:24 smithi191 ceph-mon[31636]: pgmap v8014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:24.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:24 smithi170 ceph-mon[31212]: pgmap v8014: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:25.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14855.334003 secs 2024-04-21T14:32:25.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14855.334003 secs 2024-04-21T14:32:25.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14855.334003 secs 2024-04-21T14:32:26.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:26 smithi077 ceph-mon[27902]: pgmap v8015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:26.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:26 smithi191 ceph-mon[31636]: pgmap v8015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:26.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:26 smithi170 ceph-mon[31212]: pgmap v8015: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:28.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:28 smithi077 ceph-mon[27902]: pgmap v8016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:28.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14858.573945 secs 2024-04-21T14:32:28.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:28 smithi191 ceph-mon[31636]: pgmap v8016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:28.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14858.573945 secs 2024-04-21T14:32:28.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:28 smithi170 ceph-mon[31212]: pgmap v8016: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:28.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14858.573945 secs 2024-04-21T14:32:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:30.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14860.334075 secs 2024-04-21T14:32:30.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:30 smithi077 ceph-mon[27902]: pgmap v8017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:30.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14860.334075 secs 2024-04-21T14:32:30.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:30 smithi191 ceph-mon[31636]: pgmap v8017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:30.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14860.334075 secs 2024-04-21T14:32:30.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:30 smithi170 ceph-mon[31212]: pgmap v8017: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:32.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:32 smithi191 ceph-mon[31636]: pgmap v8018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:32.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:32 smithi170 ceph-mon[31212]: pgmap v8018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:32.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:32 smithi077 ceph-mon[27902]: pgmap v8018: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:33.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14863.574062 secs 2024-04-21T14:32:33.510 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14863.574062 secs 2024-04-21T14:32:33.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14863.574062 secs 2024-04-21T14:32:34.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:34 smithi191 ceph-mon[31636]: pgmap v8019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:34.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:34 smithi170 ceph-mon[31212]: pgmap v8019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:34.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:34 smithi077 ceph-mon[27902]: pgmap v8019: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:35.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14865.334191 secs 2024-04-21T14:32:35.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14865.334191 secs 2024-04-21T14:32:35.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14865.334191 secs 2024-04-21T14:32:36.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:36 smithi191 ceph-mon[31636]: pgmap v8020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:36.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:36 smithi170 ceph-mon[31212]: pgmap v8020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:36.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:36 smithi077 ceph-mon[27902]: pgmap v8020: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:38.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:38 smithi191 ceph-mon[31636]: pgmap v8021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:38.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14868.574150 secs 2024-04-21T14:32:38.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:38 smithi170 ceph-mon[31212]: pgmap v8021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:38.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14868.574150 secs 2024-04-21T14:32:38.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:38 smithi077 ceph-mon[27902]: pgmap v8021: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:38.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14868.574150 secs 2024-04-21T14:32:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:40.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14870.334282 secs 2024-04-21T14:32:40.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:40 smithi191 ceph-mon[31636]: pgmap v8022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:40.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14870.334282 secs 2024-04-21T14:32:40.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:40 smithi170 ceph-mon[31212]: pgmap v8022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:40.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14870.334282 secs 2024-04-21T14:32:40.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:40 smithi077 ceph-mon[27902]: pgmap v8022: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:42.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:42 smithi191 ceph-mon[31636]: pgmap v8023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:42.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:42 smithi170 ceph-mon[31212]: pgmap v8023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:42.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:42 smithi077 ceph-mon[27902]: pgmap v8023: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:43.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14873.574261 secs 2024-04-21T14:32:43.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14873.574261 secs 2024-04-21T14:32:43.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14873.574261 secs 2024-04-21T14:32:44.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:44 smithi191 ceph-mon[31636]: pgmap v8024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:44.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:44 smithi170 ceph-mon[31212]: pgmap v8024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:44.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:44 smithi077 ceph-mon[27902]: pgmap v8024: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:45.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14875.334419 secs 2024-04-21T14:32:45.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14875.334419 secs 2024-04-21T14:32:45.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14875.334419 secs 2024-04-21T14:32:46.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:46 smithi191 ceph-mon[31636]: pgmap v8025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:46.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:46 smithi170 ceph-mon[31212]: pgmap v8025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:46.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:46 smithi077 ceph-mon[27902]: pgmap v8025: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:48.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:48 smithi191 ceph-mon[31636]: pgmap v8026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:48.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14878.574378 secs 2024-04-21T14:32:48.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:48 smithi170 ceph-mon[31212]: pgmap v8026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:48.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14878.574378 secs 2024-04-21T14:32:48.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:48 smithi077 ceph-mon[27902]: pgmap v8026: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:48.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14878.574378 secs 2024-04-21T14:32:50.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:50.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14880.334481 secs 2024-04-21T14:32:50.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:50 smithi191 ceph-mon[31636]: pgmap v8027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:50.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14880.334481 secs 2024-04-21T14:32:50.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:50 smithi170 ceph-mon[31212]: pgmap v8027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:50.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14880.334481 secs 2024-04-21T14:32:50.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:50 smithi077 ceph-mon[27902]: pgmap v8027: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:52.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:52 smithi191 ceph-mon[31636]: pgmap v8028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:52.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:52 smithi170 ceph-mon[31212]: pgmap v8028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:52.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:52 smithi077 ceph-mon[27902]: pgmap v8028: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:53.432 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14883.574513 secs 2024-04-21T14:32:53.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14883.574513 secs 2024-04-21T14:32:53.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14883.574513 secs 2024-04-21T14:32:54.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:54 smithi191 ceph-mon[31636]: pgmap v8029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:54.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:54 smithi170 ceph-mon[31212]: pgmap v8029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:54.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:54 smithi077 ceph-mon[27902]: pgmap v8029: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:32:55.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14885.334597 secs 2024-04-21T14:32:55.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:32:55.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14885.334597 secs 2024-04-21T14:32:55.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:32:55.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14885.334597 secs 2024-04-21T14:32:55.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:32:56.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:56 smithi191 ceph-mon[31636]: pgmap v8030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:56.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:32:56.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:32:56.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:32:56.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:56 smithi170 ceph-mon[31212]: pgmap v8030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:56.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:32:56.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:32:56.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:32:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:56 smithi077 ceph-mon[27902]: pgmap v8030: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:32:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:32:56.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:32:56.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:32:58.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:58 smithi191 ceph-mon[31636]: pgmap v8031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:58.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:32:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14888.574624 secs 2024-04-21T14:32:58.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:58 smithi170 ceph-mon[31212]: pgmap v8031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:58.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:32:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14888.574624 secs 2024-04-21T14:32:58.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:58 smithi077 ceph-mon[27902]: pgmap v8031: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:32:58.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:32:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14888.574624 secs 2024-04-21T14:33:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14890.334716 secs 2024-04-21T14:33:00.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:00 smithi191 ceph-mon[31636]: pgmap v8032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:00.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14890.334716 secs 2024-04-21T14:33:00.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:00 smithi170 ceph-mon[31212]: pgmap v8032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:00.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14890.334716 secs 2024-04-21T14:33:00.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:00 smithi077 ceph-mon[27902]: pgmap v8032: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:02.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:02 smithi191 ceph-mon[31636]: pgmap v8033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:02.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:02 smithi170 ceph-mon[31212]: pgmap v8033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:02.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:02 smithi077 ceph-mon[27902]: pgmap v8033: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14893.574690 secs 2024-04-21T14:33:03.510 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14893.574690 secs 2024-04-21T14:33:03.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14893.574690 secs 2024-04-21T14:33:04.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:04 smithi191 ceph-mon[31636]: pgmap v8034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:04.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:04 smithi170 ceph-mon[31212]: pgmap v8034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:04.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:04 smithi077 ceph-mon[27902]: pgmap v8034: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:05.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14895.334848 secs 2024-04-21T14:33:05.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:05 smithi170 ceph-mon[31212]: osdmap e573: 12 total, 12 up, 12 in 2024-04-21T14:33:05.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14895.334848 secs 2024-04-21T14:33:05.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:05 smithi077 ceph-mon[27902]: osdmap e573: 12 total, 12 up, 12 in 2024-04-21T14:33:05.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14895.334848 secs 2024-04-21T14:33:05.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:05 smithi191 ceph-mon[31636]: osdmap e573: 12 total, 12 up, 12 in 2024-04-21T14:33:06.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:06 smithi170 ceph-mon[31212]: pgmap v8036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:33:06.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:06 smithi077 ceph-mon[27902]: pgmap v8036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:33:06.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:06 smithi191 ceph-mon[31636]: pgmap v8036: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:33:08.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:08 smithi170 ceph-mon[31212]: pgmap v8037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:33:08.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14898.574829 secs 2024-04-21T14:33:08.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:08 smithi077 ceph-mon[27902]: pgmap v8037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:33:08.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14898.574829 secs 2024-04-21T14:33:08.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:08 smithi191 ceph-mon[31636]: pgmap v8037: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:33:08.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14898.574829 secs 2024-04-21T14:33:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:10.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14900.334972 secs 2024-04-21T14:33:10.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:10 smithi170 ceph-mon[31212]: pgmap v8038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:33:10.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:10 smithi170 ceph-mon[31212]: osdmap e574: 12 total, 12 up, 12 in 2024-04-21T14:33:10.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14900.334972 secs 2024-04-21T14:33:10.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:10 smithi077 ceph-mon[27902]: pgmap v8038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:33:10.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:10 smithi077 ceph-mon[27902]: osdmap e574: 12 total, 12 up, 12 in 2024-04-21T14:33:10.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14900.334972 secs 2024-04-21T14:33:10.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:10 smithi191 ceph-mon[31636]: pgmap v8038: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:33:10.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:10 smithi191 ceph-mon[31636]: osdmap e574: 12 total, 12 up, 12 in 2024-04-21T14:33:12.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:12 smithi170 ceph-mon[31212]: pgmap v8040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:33:12.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:12 smithi077 ceph-mon[27902]: pgmap v8040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:33:12.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:12 smithi191 ceph-mon[31636]: pgmap v8040: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:33:13.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14903.574920 secs 2024-04-21T14:33:13.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14903.574920 secs 2024-04-21T14:33:13.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14903.574920 secs 2024-04-21T14:33:14.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:14 smithi170 ceph-mon[31212]: pgmap v8041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:33:14.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:14 smithi077 ceph-mon[27902]: pgmap v8041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:33:14.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:14 smithi191 ceph-mon[31636]: pgmap v8041: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:33:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:15.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14905.335123 secs 2024-04-21T14:33:15.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14905.335123 secs 2024-04-21T14:33:15.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14905.335123 secs 2024-04-21T14:33:16.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:16 smithi170 ceph-mon[31212]: pgmap v8042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:33:16.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:16 smithi077 ceph-mon[27902]: pgmap v8042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:33:16.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:16 smithi191 ceph-mon[31636]: pgmap v8042: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:33:18.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:18 smithi170 ceph-mon[31212]: pgmap v8043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:33:18.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14908.575028 secs 2024-04-21T14:33:18.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:18 smithi077 ceph-mon[27902]: pgmap v8043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:33:18.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14908.575028 secs 2024-04-21T14:33:18.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:18 smithi191 ceph-mon[31636]: pgmap v8043: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:33:18.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14908.575028 secs 2024-04-21T14:33:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:20.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14910.335201 secs 2024-04-21T14:33:20.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:20 smithi170 ceph-mon[31212]: pgmap v8044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:33:20.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14910.335201 secs 2024-04-21T14:33:20.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:20 smithi077 ceph-mon[27902]: pgmap v8044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:33:20.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14910.335201 secs 2024-04-21T14:33:20.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:20 smithi191 ceph-mon[31636]: pgmap v8044: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:33:22.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:22 smithi170 ceph-mon[31212]: pgmap v8045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:33:22.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:22 smithi077 ceph-mon[27902]: pgmap v8045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:33:22.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:22 smithi191 ceph-mon[31636]: pgmap v8045: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:33:23.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14913.575151 secs 2024-04-21T14:33:23.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14913.575151 secs 2024-04-21T14:33:23.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14913.575151 secs 2024-04-21T14:33:24.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:24 smithi170 ceph-mon[31212]: pgmap v8046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:24.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:24 smithi077 ceph-mon[27902]: pgmap v8046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:24.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:24 smithi191 ceph-mon[31636]: pgmap v8046: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:25.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14915.335322 secs 2024-04-21T14:33:25.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14915.335322 secs 2024-04-21T14:33:25.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14915.335322 secs 2024-04-21T14:33:26.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:26 smithi170 ceph-mon[31212]: pgmap v8047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:26.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:26 smithi077 ceph-mon[27902]: pgmap v8047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:26.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:26 smithi191 ceph-mon[31636]: pgmap v8047: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:28.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:28 smithi170 ceph-mon[31212]: pgmap v8048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:28.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14918.575210 secs 2024-04-21T14:33:28.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:28 smithi077 ceph-mon[27902]: pgmap v8048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:28.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14918.575210 secs 2024-04-21T14:33:28.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:28 smithi191 ceph-mon[31636]: pgmap v8048: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:28.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14918.575210 secs 2024-04-21T14:33:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:30.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14920.335385 secs 2024-04-21T14:33:30.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:30 smithi170 ceph-mon[31212]: pgmap v8049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:30.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14920.335385 secs 2024-04-21T14:33:30.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:30 smithi077 ceph-mon[27902]: pgmap v8049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:30.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14920.335385 secs 2024-04-21T14:33:30.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:30 smithi191 ceph-mon[31636]: pgmap v8049: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:32.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:32 smithi170 ceph-mon[31212]: pgmap v8050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:32.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:32 smithi077 ceph-mon[27902]: pgmap v8050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:32.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:32 smithi191 ceph-mon[31636]: pgmap v8050: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:33.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14923.575320 secs 2024-04-21T14:33:33.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14923.575320 secs 2024-04-21T14:33:33.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14923.575320 secs 2024-04-21T14:33:34.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:34 smithi170 ceph-mon[31212]: pgmap v8051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:34.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:34 smithi077 ceph-mon[27902]: pgmap v8051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:34.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:34 smithi191 ceph-mon[31636]: pgmap v8051: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:35.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14925.335525 secs 2024-04-21T14:33:35.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14925.335525 secs 2024-04-21T14:33:35.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14925.335525 secs 2024-04-21T14:33:36.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:36 smithi077 ceph-mon[27902]: pgmap v8052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:36.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:36 smithi191 ceph-mon[31636]: pgmap v8052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:36.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:36 smithi170 ceph-mon[31212]: pgmap v8052: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:38.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:38 smithi077 ceph-mon[27902]: pgmap v8053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:38.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14928.575432 secs 2024-04-21T14:33:38.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:38 smithi191 ceph-mon[31636]: pgmap v8053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:38.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14928.575432 secs 2024-04-21T14:33:38.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:38 smithi170 ceph-mon[31212]: pgmap v8053: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:38.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14928.575432 secs 2024-04-21T14:33:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:40.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14930.335634 secs 2024-04-21T14:33:40.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:40 smithi077 ceph-mon[27902]: pgmap v8054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:40.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14930.335634 secs 2024-04-21T14:33:40.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:40 smithi191 ceph-mon[31636]: pgmap v8054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:40.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14930.335634 secs 2024-04-21T14:33:40.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:40 smithi170 ceph-mon[31212]: pgmap v8054: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:42.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:42 smithi077 ceph-mon[27902]: pgmap v8055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:42.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:42 smithi191 ceph-mon[31636]: pgmap v8055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:42.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:42 smithi170 ceph-mon[31212]: pgmap v8055: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:43.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14933.575549 secs 2024-04-21T14:33:43.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14933.575549 secs 2024-04-21T14:33:43.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14933.575549 secs 2024-04-21T14:33:44.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:44 smithi077 ceph-mon[27902]: pgmap v8056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:44.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:44 smithi191 ceph-mon[31636]: pgmap v8056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:44.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:44 smithi170 ceph-mon[31212]: pgmap v8056: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:45.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14935.335727 secs 2024-04-21T14:33:45.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14935.335727 secs 2024-04-21T14:33:45.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14935.335727 secs 2024-04-21T14:33:46.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:46 smithi077 ceph-mon[27902]: pgmap v8057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:46.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:46 smithi191 ceph-mon[31636]: pgmap v8057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:46.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:46 smithi170 ceph-mon[31212]: pgmap v8057: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:48.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:48 smithi077 ceph-mon[27902]: pgmap v8058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:48.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14938.575659 secs 2024-04-21T14:33:48.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:48 smithi191 ceph-mon[31636]: pgmap v8058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:48.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14938.575659 secs 2024-04-21T14:33:48.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:48 smithi170 ceph-mon[31212]: pgmap v8058: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:48.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14938.575659 secs 2024-04-21T14:33:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:50.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14940.335847 secs 2024-04-21T14:33:50.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:50 smithi077 ceph-mon[27902]: pgmap v8059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:50.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14940.335847 secs 2024-04-21T14:33:50.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:50 smithi191 ceph-mon[31636]: pgmap v8059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:50.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14940.335847 secs 2024-04-21T14:33:50.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:50 smithi170 ceph-mon[31212]: pgmap v8059: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:52.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:52 smithi077 ceph-mon[27902]: pgmap v8060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:52.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:52 smithi191 ceph-mon[31636]: pgmap v8060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:52.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:52 smithi170 ceph-mon[31212]: pgmap v8060: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:53.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14943.575830 secs 2024-04-21T14:33:53.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14943.575830 secs 2024-04-21T14:33:53.682 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14943.575830 secs 2024-04-21T14:33:54.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:54 smithi077 ceph-mon[27902]: pgmap v8061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:54.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:54 smithi191 ceph-mon[31636]: pgmap v8061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:54.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:54 smithi170 ceph-mon[31212]: pgmap v8061: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:33:55.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14945.335973 secs 2024-04-21T14:33:55.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14945.335973 secs 2024-04-21T14:33:55.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14945.335973 secs 2024-04-21T14:33:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:56 smithi077 ceph-mon[27902]: pgmap v8062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:33:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:33:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:33:56.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:33:56.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:56 smithi191 ceph-mon[31636]: pgmap v8062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:56.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:33:56.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:33:56.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:33:56.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:33:56.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:56 smithi170 ceph-mon[31212]: pgmap v8062: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:56.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:33:56.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:33:56.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:33:56.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:33:57.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:57 smithi077 ceph-mon[27902]: pgmap v8063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:57.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:57 smithi191 ceph-mon[31636]: pgmap v8063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:57.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:57 smithi170 ceph-mon[31212]: pgmap v8063: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:33:58.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14948.575980 secs 2024-04-21T14:33:58.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14948.575980 secs 2024-04-21T14:33:58.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14948.575980 secs 2024-04-21T14:33:59.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:33:59 smithi077 ceph-mon[27902]: pgmap v8064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:59.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:33:59 smithi191 ceph-mon[31636]: pgmap v8064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:33:59.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:33:59 smithi170 ceph-mon[31212]: pgmap v8064: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:00.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14950.336060 secs 2024-04-21T14:34:00.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14950.336060 secs 2024-04-21T14:34:00.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14950.336060 secs 2024-04-21T14:34:01.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:01 smithi191 ceph-mon[31636]: pgmap v8065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:01.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:01 smithi170 ceph-mon[31212]: pgmap v8065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:01.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:01 smithi077 ceph-mon[27902]: pgmap v8065: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:03.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14953.576122 secs 2024-04-21T14:34:03.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:03 smithi170 ceph-mon[31212]: pgmap v8066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:03.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14953.576122 secs 2024-04-21T14:34:03.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:03 smithi077 ceph-mon[27902]: pgmap v8066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:03.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14953.576122 secs 2024-04-21T14:34:03.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:03 smithi191 ceph-mon[31636]: pgmap v8066: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14955.336182 secs 2024-04-21T14:34:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:04 smithi077 ceph-mon[27902]: osdmap e575: 12 total, 12 up, 12 in 2024-04-21T14:34:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14955.336182 secs 2024-04-21T14:34:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:04 smithi191 ceph-mon[31636]: osdmap e575: 12 total, 12 up, 12 in 2024-04-21T14:34:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14955.336182 secs 2024-04-21T14:34:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:04 smithi170 ceph-mon[31212]: osdmap e575: 12 total, 12 up, 12 in 2024-04-21T14:34:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:05.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:05 smithi077 ceph-mon[27902]: pgmap v8068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:34:05.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:05 smithi191 ceph-mon[31636]: pgmap v8068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:34:06.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:05 smithi170 ceph-mon[31212]: pgmap v8068: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:34:07.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:07 smithi077 ceph-mon[27902]: pgmap v8069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:34:07.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:07 smithi191 ceph-mon[31636]: pgmap v8069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:34:08.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:07 smithi170 ceph-mon[31212]: pgmap v8069: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:34:08.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14958.576245 secs 2024-04-21T14:34:08.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14958.576245 secs 2024-04-21T14:34:09.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14958.576245 secs 2024-04-21T14:34:09.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14960.336249 secs 2024-04-21T14:34:09.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:09 smithi077 ceph-mon[27902]: pgmap v8070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:34:09.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:09 smithi077 ceph-mon[27902]: osdmap e576: 12 total, 12 up, 12 in 2024-04-21T14:34:09.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14960.336249 secs 2024-04-21T14:34:09.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:09 smithi191 ceph-mon[31636]: pgmap v8070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:34:09.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:09 smithi191 ceph-mon[31636]: osdmap e576: 12 total, 12 up, 12 in 2024-04-21T14:34:10.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14960.336249 secs 2024-04-21T14:34:10.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:09 smithi170 ceph-mon[31212]: pgmap v8070: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:34:10.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:09 smithi170 ceph-mon[31212]: osdmap e576: 12 total, 12 up, 12 in 2024-04-21T14:34:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:11.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:11 smithi077 ceph-mon[27902]: pgmap v8072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:34:11.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:11 smithi191 ceph-mon[31636]: pgmap v8072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:34:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:11 smithi170 ceph-mon[31212]: pgmap v8072: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:34:13.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14963.576367 secs 2024-04-21T14:34:13.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:13 smithi077 ceph-mon[27902]: pgmap v8073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:34:13.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14963.576367 secs 2024-04-21T14:34:13.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:13 smithi191 ceph-mon[31636]: pgmap v8073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:34:14.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14963.576367 secs 2024-04-21T14:34:14.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:13 smithi170 ceph-mon[31212]: pgmap v8073: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:34:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14965.336389 secs 2024-04-21T14:34:14.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14965.336389 secs 2024-04-21T14:34:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14965.336389 secs 2024-04-21T14:34:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:15.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:15 smithi077 ceph-mon[27902]: pgmap v8074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:34:15.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:15 smithi191 ceph-mon[31636]: pgmap v8074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:34:16.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:15 smithi170 ceph-mon[31212]: pgmap v8074: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:34:17.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:17 smithi077 ceph-mon[27902]: pgmap v8075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:34:17.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:17 smithi191 ceph-mon[31636]: pgmap v8075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:34:18.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:17 smithi170 ceph-mon[31212]: pgmap v8075: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:34:18.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14968.576463 secs 2024-04-21T14:34:18.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14968.576463 secs 2024-04-21T14:34:19.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14968.576463 secs 2024-04-21T14:34:19.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14970.336498 secs 2024-04-21T14:34:19.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:19 smithi077 ceph-mon[27902]: pgmap v8076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:34:19.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14970.336498 secs 2024-04-21T14:34:19.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:19 smithi191 ceph-mon[31636]: pgmap v8076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:34:20.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14970.336498 secs 2024-04-21T14:34:20.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:19 smithi170 ceph-mon[31212]: pgmap v8076: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:34:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:21.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:21 smithi077 ceph-mon[27902]: pgmap v8077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:34:21.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:21 smithi191 ceph-mon[31636]: pgmap v8077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:34:22.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:21 smithi170 ceph-mon[31212]: pgmap v8077: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:34:23.833 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14973.576560 secs 2024-04-21T14:34:23.833 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:23 smithi170 ceph-mon[31212]: pgmap v8078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:23.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14973.576560 secs 2024-04-21T14:34:23.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:23 smithi077 ceph-mon[27902]: pgmap v8078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:23.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14973.576560 secs 2024-04-21T14:34:23.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:23 smithi191 ceph-mon[31636]: pgmap v8078: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14975.336613 secs 2024-04-21T14:34:24.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14975.336613 secs 2024-04-21T14:34:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14975.336613 secs 2024-04-21T14:34:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:25.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:25 smithi077 ceph-mon[27902]: pgmap v8079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:25.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:25 smithi191 ceph-mon[31636]: pgmap v8079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:26.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:25 smithi170 ceph-mon[31212]: pgmap v8079: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:27.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:27 smithi077 ceph-mon[27902]: pgmap v8080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:27.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:27 smithi191 ceph-mon[31636]: pgmap v8080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:28.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:27 smithi170 ceph-mon[31212]: pgmap v8080: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:28.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14978.576690 secs 2024-04-21T14:34:28.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14978.576690 secs 2024-04-21T14:34:29.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14978.576690 secs 2024-04-21T14:34:29.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14980.336719 secs 2024-04-21T14:34:29.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:29 smithi077 ceph-mon[27902]: pgmap v8081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:29.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14980.336719 secs 2024-04-21T14:34:29.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:29 smithi191 ceph-mon[31636]: pgmap v8081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:30.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14980.336719 secs 2024-04-21T14:34:30.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:29 smithi170 ceph-mon[31212]: pgmap v8081: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:31.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:31 smithi077 ceph-mon[27902]: pgmap v8082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:31.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:31 smithi191 ceph-mon[31636]: pgmap v8082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:32.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:31 smithi170 ceph-mon[31212]: pgmap v8082: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:33.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14983.576812 secs 2024-04-21T14:34:33.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:33 smithi077 ceph-mon[27902]: pgmap v8083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:33.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14983.576812 secs 2024-04-21T14:34:33.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:33 smithi191 ceph-mon[31636]: pgmap v8083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:34.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14983.576812 secs 2024-04-21T14:34:34.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:33 smithi170 ceph-mon[31212]: pgmap v8083: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14985.336791 secs 2024-04-21T14:34:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14985.336791 secs 2024-04-21T14:34:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:35.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14985.336791 secs 2024-04-21T14:34:35.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:35 smithi191 ceph-mon[31636]: pgmap v8084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:36.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:35 smithi170 ceph-mon[31212]: pgmap v8084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:36.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:35 smithi077 ceph-mon[27902]: pgmap v8084: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:37.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:37 smithi191 ceph-mon[31636]: pgmap v8085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:38.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:37 smithi170 ceph-mon[31212]: pgmap v8085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:38.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:37 smithi077 ceph-mon[27902]: pgmap v8085: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:38.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14988.576960 secs 2024-04-21T14:34:39.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14988.576960 secs 2024-04-21T14:34:39.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14988.576960 secs 2024-04-21T14:34:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14990.336886 secs 2024-04-21T14:34:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:39 smithi191 ceph-mon[31636]: pgmap v8086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14990.336886 secs 2024-04-21T14:34:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:39 smithi170 ceph-mon[31212]: pgmap v8086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14990.336886 secs 2024-04-21T14:34:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:39 smithi077 ceph-mon[27902]: pgmap v8086: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:41.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:41 smithi191 ceph-mon[31636]: pgmap v8087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:42.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:41 smithi170 ceph-mon[31212]: pgmap v8087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:42.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:41 smithi077 ceph-mon[27902]: pgmap v8087: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:43.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14993.577039 secs 2024-04-21T14:34:43.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:43 smithi191 ceph-mon[31636]: pgmap v8088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:44.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14993.577039 secs 2024-04-21T14:34:44.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:43 smithi170 ceph-mon[31212]: pgmap v8088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:44.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14993.577039 secs 2024-04-21T14:34:44.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:43 smithi077 ceph-mon[27902]: pgmap v8088: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:44.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 14995.337002 secs 2024-04-21T14:34:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 14995.337002 secs 2024-04-21T14:34:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:45.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 14995.337002 secs 2024-04-21T14:34:45.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:45 smithi191 ceph-mon[31636]: pgmap v8089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:46.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:45 smithi170 ceph-mon[31212]: pgmap v8089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:46.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:45 smithi077 ceph-mon[27902]: pgmap v8089: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:47.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:47 smithi191 ceph-mon[31636]: pgmap v8090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:47.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 14998.577099 secs 2024-04-21T14:34:48.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:47 smithi170 ceph-mon[31212]: pgmap v8090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:48.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 14998.577099 secs 2024-04-21T14:34:48.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:47 smithi077 ceph-mon[27902]: pgmap v8090: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:48.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 14998.577099 secs 2024-04-21T14:34:49.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15000.337067 secs 2024-04-21T14:34:49.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:49 smithi191 ceph-mon[31636]: pgmap v8091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:50.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15000.337067 secs 2024-04-21T14:34:50.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:49 smithi170 ceph-mon[31212]: pgmap v8091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:50.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15000.337067 secs 2024-04-21T14:34:50.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:49 smithi077 ceph-mon[27902]: pgmap v8091: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:34:51.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:51 smithi191 ceph-mon[31636]: pgmap v8092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:52.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:51 smithi170 ceph-mon[31212]: pgmap v8092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:52.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:51 smithi077 ceph-mon[27902]: pgmap v8092: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15003.577217 secs 2024-04-21T14:34:53.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15003.577217 secs 2024-04-21T14:34:53.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15003.577217 secs 2024-04-21T14:34:53.934 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:53 smithi170 ceph-mon[31212]: pgmap v8093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:34:53.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:53 smithi191 ceph-mon[31636]: pgmap v8093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:34:54.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:53 smithi077 ceph-mon[27902]: pgmap v8093: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:34:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15005.337188 secs 2024-04-21T14:34:55.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15005.337188 secs 2024-04-21T14:34:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:34:55.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15005.337188 secs 2024-04-21T14:34:55.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:55 smithi191 ceph-mon[31636]: pgmap v8094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:34:56.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:55 smithi170 ceph-mon[31212]: pgmap v8094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:34:56.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:55 smithi077 ceph-mon[27902]: pgmap v8094: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:34:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:34:56.422+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:34:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:34:56.422+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065f0 con 0x7efd78101130 2024-04-21T14:34:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:34:56.422+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:34:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:34:56.422+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065f0 con 0x7efd78101130 2024-04-21T14:34:56.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:34:57.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:34:57.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:34:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:57 smithi191 ceph-mon[31636]: pgmap v8095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15008.577280 secs 2024-04-21T14:34:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:34:57.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:34:57.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:34:58.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:57 smithi170 ceph-mon[31212]: pgmap v8095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:58.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15008.577280 secs 2024-04-21T14:34:58.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:34:58.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:34:58.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:34:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:57 smithi077 ceph-mon[27902]: pgmap v8095: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:34:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15008.577280 secs 2024-04-21T14:34:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:34:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:34:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:34:59.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15010.337263 secs 2024-04-21T14:34:59.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:34:59 smithi191 ceph-mon[31636]: pgmap v8096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:35:00.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15010.337263 secs 2024-04-21T14:35:00.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:34:59 smithi170 ceph-mon[31212]: pgmap v8096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:35:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:00.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15010.337263 secs 2024-04-21T14:35:00.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:34:59 smithi077 ceph-mon[27902]: pgmap v8096: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:35:01.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:01 smithi191 ceph-mon[31636]: pgmap v8097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:02.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:01 smithi170 ceph-mon[31212]: pgmap v8097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:02.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:01 smithi077 ceph-mon[27902]: pgmap v8097: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15013.577416 secs 2024-04-21T14:35:03.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15013.577416 secs 2024-04-21T14:35:03.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15013.577416 secs 2024-04-21T14:35:03.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:03 smithi191 ceph-mon[31636]: pgmap v8098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:04.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:03 smithi170 ceph-mon[31212]: pgmap v8098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:04.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:03 smithi077 ceph-mon[27902]: pgmap v8098: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15015.337381 secs 2024-04-21T14:35:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:04 smithi170 ceph-mon[31212]: osdmap e577: 12 total, 12 up, 12 in 2024-04-21T14:35:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15015.337381 secs 2024-04-21T14:35:05.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:04 smithi077 ceph-mon[27902]: osdmap e577: 12 total, 12 up, 12 in 2024-04-21T14:35:05.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15015.337381 secs 2024-04-21T14:35:05.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:04 smithi191 ceph-mon[31636]: osdmap e577: 12 total, 12 up, 12 in 2024-04-21T14:35:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:05 smithi170 ceph-mon[31212]: pgmap v8100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:35:06.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:05 smithi077 ceph-mon[27902]: pgmap v8100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:35:06.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:05 smithi191 ceph-mon[31636]: pgmap v8100: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:35:08.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:07 smithi170 ceph-mon[31212]: pgmap v8101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:35:08.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15018.577516 secs 2024-04-21T14:35:08.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:07 smithi077 ceph-mon[27902]: pgmap v8101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:35:08.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15018.577516 secs 2024-04-21T14:35:08.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:07 smithi191 ceph-mon[31636]: pgmap v8101: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:35:08.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15018.577516 secs 2024-04-21T14:35:10.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15020.337494 secs 2024-04-21T14:35:10.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:09 smithi170 ceph-mon[31212]: pgmap v8102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:35:10.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:09 smithi170 ceph-mon[31212]: osdmap e578: 12 total, 12 up, 12 in 2024-04-21T14:35:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15020.337494 secs 2024-04-21T14:35:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:09 smithi077 ceph-mon[27902]: pgmap v8102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:35:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:09 smithi077 ceph-mon[27902]: osdmap e578: 12 total, 12 up, 12 in 2024-04-21T14:35:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15020.337494 secs 2024-04-21T14:35:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:09 smithi191 ceph-mon[31636]: pgmap v8102: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:35:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:09 smithi191 ceph-mon[31636]: osdmap e578: 12 total, 12 up, 12 in 2024-04-21T14:35:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:11 smithi170 ceph-mon[31212]: pgmap v8104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:35:12.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:11 smithi077 ceph-mon[27902]: pgmap v8104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:35:12.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:11 smithi191 ceph-mon[31636]: pgmap v8104: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:35:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15023.577649 secs 2024-04-21T14:35:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15023.577649 secs 2024-04-21T14:35:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15023.577649 secs 2024-04-21T14:35:14.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:13 smithi170 ceph-mon[31212]: pgmap v8105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T14:35:14.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:13 smithi077 ceph-mon[27902]: pgmap v8105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T14:35:14.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:13 smithi191 ceph-mon[31636]: pgmap v8105: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T14:35:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15025.337610 secs 2024-04-21T14:35:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:15.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15025.337610 secs 2024-04-21T14:35:15.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15025.337610 secs 2024-04-21T14:35:16.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:15 smithi170 ceph-mon[31212]: pgmap v8106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:35:16.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:15 smithi077 ceph-mon[27902]: pgmap v8106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:35:16.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:15 smithi191 ceph-mon[31636]: pgmap v8106: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:35:18.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:17 smithi170 ceph-mon[31212]: pgmap v8107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:35:18.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15028.577740 secs 2024-04-21T14:35:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:17 smithi077 ceph-mon[27902]: pgmap v8107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:35:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15028.577740 secs 2024-04-21T14:35:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:17 smithi191 ceph-mon[31636]: pgmap v8107: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:35:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15028.577740 secs 2024-04-21T14:35:20.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15030.337673 secs 2024-04-21T14:35:20.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:19 smithi170 ceph-mon[31212]: pgmap v8108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:35:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:20.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15030.337673 secs 2024-04-21T14:35:20.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:19 smithi077 ceph-mon[27902]: pgmap v8108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:35:20.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15030.337673 secs 2024-04-21T14:35:20.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:19 smithi191 ceph-mon[31636]: pgmap v8108: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:35:22.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:21 smithi170 ceph-mon[31212]: pgmap v8109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:35:22.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:21 smithi077 ceph-mon[27902]: pgmap v8109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:35:22.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:21 smithi191 ceph-mon[31636]: pgmap v8109: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:35:23.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15033.577860 secs 2024-04-21T14:35:23.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15033.577860 secs 2024-04-21T14:35:23.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15033.577860 secs 2024-04-21T14:35:24.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:23 smithi170 ceph-mon[31212]: pgmap v8110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:24.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:23 smithi077 ceph-mon[27902]: pgmap v8110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:24.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:23 smithi191 ceph-mon[31636]: pgmap v8110: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15035.337738 secs 2024-04-21T14:35:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15035.337738 secs 2024-04-21T14:35:25.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15035.337738 secs 2024-04-21T14:35:26.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:25 smithi170 ceph-mon[31212]: pgmap v8111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:26.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:25 smithi077 ceph-mon[27902]: pgmap v8111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:26.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:25 smithi191 ceph-mon[31636]: pgmap v8111: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:28.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:27 smithi170 ceph-mon[31212]: pgmap v8112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:28.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15038.577976 secs 2024-04-21T14:35:28.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:27 smithi077 ceph-mon[27902]: pgmap v8112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:28.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15038.577976 secs 2024-04-21T14:35:28.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:27 smithi191 ceph-mon[31636]: pgmap v8112: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:28.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15038.577976 secs 2024-04-21T14:35:30.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15040.337813 secs 2024-04-21T14:35:30.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:29 smithi170 ceph-mon[31212]: pgmap v8113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:30.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15040.337813 secs 2024-04-21T14:35:30.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:29 smithi077 ceph-mon[27902]: pgmap v8113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:30.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15040.337813 secs 2024-04-21T14:35:30.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:29 smithi191 ceph-mon[31636]: pgmap v8113: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:32.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:31 smithi170 ceph-mon[31212]: pgmap v8114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:32.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:31 smithi077 ceph-mon[27902]: pgmap v8114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:32.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:31 smithi191 ceph-mon[31636]: pgmap v8114: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:33.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15043.578095 secs 2024-04-21T14:35:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15043.578095 secs 2024-04-21T14:35:33.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15043.578095 secs 2024-04-21T14:35:34.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:33 smithi170 ceph-mon[31212]: pgmap v8115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:34.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:33 smithi077 ceph-mon[27902]: pgmap v8115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:34.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:33 smithi191 ceph-mon[31636]: pgmap v8115: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15045.337930 secs 2024-04-21T14:35:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:35.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15045.337930 secs 2024-04-21T14:35:35.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15045.337930 secs 2024-04-21T14:35:36.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:35 smithi170 ceph-mon[31212]: pgmap v8116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:36.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:35 smithi077 ceph-mon[27902]: pgmap v8116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:36.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:35 smithi191 ceph-mon[31636]: pgmap v8116: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:38.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:37 smithi170 ceph-mon[31212]: pgmap v8117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:38.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15048.578209 secs 2024-04-21T14:35:38.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:37 smithi077 ceph-mon[27902]: pgmap v8117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:38.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15048.578209 secs 2024-04-21T14:35:38.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:37 smithi191 ceph-mon[31636]: pgmap v8117: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:38.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15048.578209 secs 2024-04-21T14:35:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15050.338050 secs 2024-04-21T14:35:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:39 smithi170 ceph-mon[31212]: pgmap v8118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15050.338050 secs 2024-04-21T14:35:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:39 smithi077 ceph-mon[27902]: pgmap v8118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:40.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15050.338050 secs 2024-04-21T14:35:40.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:39 smithi191 ceph-mon[31636]: pgmap v8118: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:42.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:41 smithi077 ceph-mon[27902]: pgmap v8119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:42.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:41 smithi191 ceph-mon[31636]: pgmap v8119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:42.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:41 smithi170 ceph-mon[31212]: pgmap v8119: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15053.578346 secs 2024-04-21T14:35:43.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15053.578346 secs 2024-04-21T14:35:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15053.578346 secs 2024-04-21T14:35:44.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:43 smithi077 ceph-mon[27902]: pgmap v8120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:44.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:43 smithi191 ceph-mon[31636]: pgmap v8120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:44.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:43 smithi170 ceph-mon[31212]: pgmap v8120: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15055.338170 secs 2024-04-21T14:35:45.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15055.338170 secs 2024-04-21T14:35:45.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15055.338170 secs 2024-04-21T14:35:46.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:45 smithi077 ceph-mon[27902]: pgmap v8121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:46.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:45 smithi191 ceph-mon[31636]: pgmap v8121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:46.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:45 smithi170 ceph-mon[31212]: pgmap v8121: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:48.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:47 smithi077 ceph-mon[27902]: pgmap v8122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:48.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15058.578462 secs 2024-04-21T14:35:48.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:47 smithi191 ceph-mon[31636]: pgmap v8122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:48.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15058.578462 secs 2024-04-21T14:35:48.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:47 smithi170 ceph-mon[31212]: pgmap v8122: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:48.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15058.578462 secs 2024-04-21T14:35:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:50.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15060.338234 secs 2024-04-21T14:35:50.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:49 smithi077 ceph-mon[27902]: pgmap v8123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:50.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15060.338234 secs 2024-04-21T14:35:50.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:49 smithi191 ceph-mon[31636]: pgmap v8123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15060.338234 secs 2024-04-21T14:35:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:49 smithi170 ceph-mon[31212]: pgmap v8123: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:52.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:51 smithi077 ceph-mon[27902]: pgmap v8124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:52.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:51 smithi191 ceph-mon[31636]: pgmap v8124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:52.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:51 smithi170 ceph-mon[31212]: pgmap v8124: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:53.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15063.578597 secs 2024-04-21T14:35:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15063.578597 secs 2024-04-21T14:35:53.181 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15063.578597 secs 2024-04-21T14:35:54.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:53 smithi077 ceph-mon[27902]: pgmap v8125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:54.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:53 smithi191 ceph-mon[31636]: pgmap v8125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:54.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:53 smithi170 ceph-mon[31212]: pgmap v8125: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:35:55.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15065.338297 secs 2024-04-21T14:35:55.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15065.338297 secs 2024-04-21T14:35:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15065.338297 secs 2024-04-21T14:35:56.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:55 smithi077 ceph-mon[27902]: pgmap v8126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:56.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:55 smithi191 ceph-mon[31636]: pgmap v8126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:56.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:55 smithi170 ceph-mon[31212]: pgmap v8126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:35:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:57 smithi077 ceph-mon[27902]: pgmap v8127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15068.578659 secs 2024-04-21T14:35:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:35:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:35:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:35:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:35:58.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:57 smithi191 ceph-mon[31636]: pgmap v8127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:58.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15068.578659 secs 2024-04-21T14:35:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:35:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:35:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:35:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:35:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:57 smithi170 ceph-mon[31212]: pgmap v8127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:35:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15068.578659 secs 2024-04-21T14:35:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:35:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:35:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:35:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:36:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:00.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15070.338421 secs 2024-04-21T14:36:00.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:35:59 smithi077 ceph-mon[27902]: pgmap v8128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:00.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15070.338421 secs 2024-04-21T14:36:00.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:35:59 smithi191 ceph-mon[31636]: pgmap v8128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15070.338421 secs 2024-04-21T14:36:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:35:59 smithi170 ceph-mon[31212]: pgmap v8128: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:01 smithi077 ceph-mon[27902]: pgmap v8129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:01 smithi191 ceph-mon[31636]: pgmap v8129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:02.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:01 smithi170 ceph-mon[31212]: pgmap v8129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15073.578740 secs 2024-04-21T14:36:03.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15073.578740 secs 2024-04-21T14:36:03.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15073.578740 secs 2024-04-21T14:36:04.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:03 smithi077 ceph-mon[27902]: pgmap v8130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:04.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:03 smithi191 ceph-mon[31636]: pgmap v8130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:04.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:03 smithi170 ceph-mon[31212]: pgmap v8130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:05.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15075.338529 secs 2024-04-21T14:36:05.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:04 smithi191 ceph-mon[31636]: osdmap e579: 12 total, 12 up, 12 in 2024-04-21T14:36:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15075.338529 secs 2024-04-21T14:36:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:04 smithi170 ceph-mon[31212]: osdmap e579: 12 total, 12 up, 12 in 2024-04-21T14:36:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15075.338529 secs 2024-04-21T14:36:05.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:04 smithi077 ceph-mon[27902]: osdmap e579: 12 total, 12 up, 12 in 2024-04-21T14:36:06.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:05 smithi191 ceph-mon[31636]: pgmap v8132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:36:06.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:05 smithi170 ceph-mon[31212]: pgmap v8132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:36:06.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:05 smithi077 ceph-mon[27902]: pgmap v8132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:36:08.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:07 smithi191 ceph-mon[31636]: pgmap v8133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:08.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15078.578849 secs 2024-04-21T14:36:08.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:07 smithi170 ceph-mon[31212]: pgmap v8133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:08.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15078.578849 secs 2024-04-21T14:36:08.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:07 smithi077 ceph-mon[27902]: pgmap v8133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:08.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15078.578849 secs 2024-04-21T14:36:10.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15080.338658 secs 2024-04-21T14:36:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:09 smithi191 ceph-mon[31636]: pgmap v8134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:09 smithi191 ceph-mon[31636]: osdmap e580: 12 total, 12 up, 12 in 2024-04-21T14:36:10.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15080.338658 secs 2024-04-21T14:36:10.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:09 smithi170 ceph-mon[31212]: pgmap v8134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:10.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:09 smithi170 ceph-mon[31212]: osdmap e580: 12 total, 12 up, 12 in 2024-04-21T14:36:10.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15080.338658 secs 2024-04-21T14:36:10.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:09 smithi077 ceph-mon[27902]: pgmap v8134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:10.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:09 smithi077 ceph-mon[27902]: osdmap e580: 12 total, 12 up, 12 in 2024-04-21T14:36:12.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:11 smithi191 ceph-mon[31636]: pgmap v8136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:36:12.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:11 smithi170 ceph-mon[31212]: pgmap v8136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:36:12.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:11 smithi077 ceph-mon[27902]: pgmap v8136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:36:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15083.578964 secs 2024-04-21T14:36:13.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15083.578964 secs 2024-04-21T14:36:13.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15083.578964 secs 2024-04-21T14:36:14.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:13 smithi191 ceph-mon[31636]: pgmap v8137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:36:14.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:13 smithi170 ceph-mon[31212]: pgmap v8137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:36:14.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:13 smithi077 ceph-mon[27902]: pgmap v8137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:36:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:15.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15085.338772 secs 2024-04-21T14:36:15.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15085.338772 secs 2024-04-21T14:36:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15085.338772 secs 2024-04-21T14:36:16.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:15 smithi191 ceph-mon[31636]: pgmap v8138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:16.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:15 smithi170 ceph-mon[31212]: pgmap v8138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:16.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:15 smithi077 ceph-mon[27902]: pgmap v8138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:36:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:17 smithi191 ceph-mon[31636]: pgmap v8139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:36:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15088.579071 secs 2024-04-21T14:36:18.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:17 smithi170 ceph-mon[31212]: pgmap v8139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:36:18.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15088.579071 secs 2024-04-21T14:36:18.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:17 smithi077 ceph-mon[27902]: pgmap v8139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:36:18.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15088.579071 secs 2024-04-21T14:36:20.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:20.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15090.338890 secs 2024-04-21T14:36:20.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:19 smithi191 ceph-mon[31636]: pgmap v8140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:36:20.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15090.338890 secs 2024-04-21T14:36:20.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:19 smithi170 ceph-mon[31212]: pgmap v8140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:36:20.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15090.338890 secs 2024-04-21T14:36:20.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:19 smithi077 ceph-mon[27902]: pgmap v8140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:36:22.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:21 smithi191 ceph-mon[31636]: pgmap v8141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:36:22.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:21 smithi170 ceph-mon[31212]: pgmap v8141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:36:22.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:21 smithi077 ceph-mon[27902]: pgmap v8141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:36:23.181 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15093.579188 secs 2024-04-21T14:36:23.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15093.579188 secs 2024-04-21T14:36:23.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15093.579188 secs 2024-04-21T14:36:24.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:23 smithi191 ceph-mon[31636]: pgmap v8142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:24.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:23 smithi170 ceph-mon[31212]: pgmap v8142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:24.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:23 smithi077 ceph-mon[27902]: pgmap v8142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:25.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15095.338956 secs 2024-04-21T14:36:25.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15095.338956 secs 2024-04-21T14:36:25.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15095.338956 secs 2024-04-21T14:36:26.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:25 smithi191 ceph-mon[31636]: pgmap v8143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:26.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:25 smithi170 ceph-mon[31212]: pgmap v8143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:26.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:25 smithi077 ceph-mon[27902]: pgmap v8143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:36:26.434+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065f0 con 0x7efd78101130 2024-04-21T14:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:36:26.434+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:36:26.435+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:36:26.435+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065f0 con 0x7efd78101130 2024-04-21T14:36:28.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:27 smithi191 ceph-mon[31636]: pgmap v8144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:28.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15098.579301 secs 2024-04-21T14:36:28.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:27 smithi170 ceph-mon[31212]: pgmap v8144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:28.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15098.579301 secs 2024-04-21T14:36:28.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:27 smithi077 ceph-mon[27902]: pgmap v8144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:28.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15098.579301 secs 2024-04-21T14:36:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:30.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15100.339022 secs 2024-04-21T14:36:30.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:29 smithi191 ceph-mon[31636]: pgmap v8145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:30.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15100.339022 secs 2024-04-21T14:36:30.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:29 smithi170 ceph-mon[31212]: pgmap v8145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:30.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15100.339022 secs 2024-04-21T14:36:30.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:29 smithi077 ceph-mon[27902]: pgmap v8145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:32.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:31 smithi191 ceph-mon[31636]: pgmap v8146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:32.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:31 smithi170 ceph-mon[31212]: pgmap v8146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:32.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:31 smithi077 ceph-mon[27902]: pgmap v8146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:33.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15103.579446 secs 2024-04-21T14:36:33.259 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15103.579446 secs 2024-04-21T14:36:33.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15103.579446 secs 2024-04-21T14:36:34.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:33 smithi191 ceph-mon[31636]: pgmap v8147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:34.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:33 smithi170 ceph-mon[31212]: pgmap v8147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:34.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:33 smithi077 ceph-mon[27902]: pgmap v8147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:35.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15105.339149 secs 2024-04-21T14:36:35.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15105.339149 secs 2024-04-21T14:36:35.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15105.339149 secs 2024-04-21T14:36:36.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:35 smithi170 ceph-mon[31212]: pgmap v8148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:36.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:35 smithi077 ceph-mon[27902]: pgmap v8148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:36.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:35 smithi191 ceph-mon[31636]: pgmap v8148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:38.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:37 smithi170 ceph-mon[31212]: pgmap v8149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:38.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15108.579559 secs 2024-04-21T14:36:38.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:37 smithi077 ceph-mon[27902]: pgmap v8149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:38.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15108.579559 secs 2024-04-21T14:36:38.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:37 smithi191 ceph-mon[31636]: pgmap v8149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:38.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15108.579559 secs 2024-04-21T14:36:40.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:40.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15110.339240 secs 2024-04-21T14:36:40.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:39 smithi170 ceph-mon[31212]: pgmap v8150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:40.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15110.339240 secs 2024-04-21T14:36:40.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:39 smithi077 ceph-mon[27902]: pgmap v8150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:40.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15110.339240 secs 2024-04-21T14:36:40.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:39 smithi191 ceph-mon[31636]: pgmap v8150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:42.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:41 smithi170 ceph-mon[31212]: pgmap v8151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:42.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:41 smithi077 ceph-mon[27902]: pgmap v8151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:42.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:41 smithi191 ceph-mon[31636]: pgmap v8151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15113.579677 secs 2024-04-21T14:36:43.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15113.579677 secs 2024-04-21T14:36:43.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15113.579677 secs 2024-04-21T14:36:44.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:43 smithi170 ceph-mon[31212]: pgmap v8152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:44.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:43 smithi077 ceph-mon[27902]: pgmap v8152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:44.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:43 smithi191 ceph-mon[31636]: pgmap v8152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15115.339322 secs 2024-04-21T14:36:45.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15115.339322 secs 2024-04-21T14:36:45.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15115.339322 secs 2024-04-21T14:36:46.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:46 smithi170 ceph-mon[31212]: pgmap v8153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:46.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:46 smithi077 ceph-mon[27902]: pgmap v8153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:46.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:46 smithi191 ceph-mon[31636]: pgmap v8153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:48.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:48 smithi170 ceph-mon[31212]: pgmap v8154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:48.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15118.579789 secs 2024-04-21T14:36:48.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:48 smithi077 ceph-mon[27902]: pgmap v8154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:48.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15118.579789 secs 2024-04-21T14:36:48.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:48 smithi191 ceph-mon[31636]: pgmap v8154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:48.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15118.579789 secs 2024-04-21T14:36:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15120.339404 secs 2024-04-21T14:36:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:50 smithi170 ceph-mon[31212]: pgmap v8155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:50.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15120.339404 secs 2024-04-21T14:36:50.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:50 smithi077 ceph-mon[27902]: pgmap v8155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:50.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15120.339404 secs 2024-04-21T14:36:50.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:50 smithi191 ceph-mon[31636]: pgmap v8155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:52.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:52 smithi170 ceph-mon[31212]: pgmap v8156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:52.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:52 smithi077 ceph-mon[27902]: pgmap v8156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:52.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:52 smithi191 ceph-mon[31636]: pgmap v8156: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:53.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15123.579907 secs 2024-04-21T14:36:53.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15123.579907 secs 2024-04-21T14:36:53.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15123.579907 secs 2024-04-21T14:36:54.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:54 smithi170 ceph-mon[31212]: pgmap v8157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:54.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:54 smithi077 ceph-mon[27902]: pgmap v8157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:54.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:54 smithi191 ceph-mon[31636]: pgmap v8157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:36:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15125.339525 secs 2024-04-21T14:36:55.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15125.339525 secs 2024-04-21T14:36:55.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15125.339525 secs 2024-04-21T14:36:56.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:56 smithi170 ceph-mon[31212]: pgmap v8158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:56.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:56 smithi077 ceph-mon[27902]: pgmap v8158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:56.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:56 smithi191 ceph-mon[31636]: pgmap v8158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:36:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:58 smithi170 ceph-mon[31212]: pgmap v8159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15128.579996 secs 2024-04-21T14:36:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:36:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:36:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:58 smithi077 ceph-mon[27902]: pgmap v8159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15128.579996 secs 2024-04-21T14:36:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:36:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:36:58.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:58 smithi191 ceph-mon[31636]: pgmap v8159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:36:58.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15128.579996 secs 2024-04-21T14:36:58.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:36:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:37:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15130.339633 secs 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: pgmap v8160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15130.339633 secs 2024-04-21T14:37:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: pgmap v8160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15130.339633 secs 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: pgmap v8160: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:00.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:37:01.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:01.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:37:01.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:37:01.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:37:02.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:02 smithi191 ceph-mon[31636]: pgmap v8161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:02.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:02 smithi170 ceph-mon[31212]: pgmap v8161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:02.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:02 smithi077 ceph-mon[27902]: pgmap v8161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15133.580147 secs 2024-04-21T14:37:03.509 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15133.580147 secs 2024-04-21T14:37:03.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15133.580147 secs 2024-04-21T14:37:04.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:04 smithi191 ceph-mon[31636]: pgmap v8162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:04.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:04 smithi170 ceph-mon[31212]: pgmap v8162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:04.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:04 smithi077 ceph-mon[27902]: pgmap v8162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:05.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15135.339782 secs 2024-04-21T14:37:05.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:05 smithi191 ceph-mon[31636]: osdmap e581: 12 total, 12 up, 12 in 2024-04-21T14:37:05.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15135.339782 secs 2024-04-21T14:37:05.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:05 smithi170 ceph-mon[31212]: osdmap e581: 12 total, 12 up, 12 in 2024-04-21T14:37:05.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15135.339782 secs 2024-04-21T14:37:05.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:05 smithi077 ceph-mon[27902]: osdmap e581: 12 total, 12 up, 12 in 2024-04-21T14:37:06.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:06 smithi191 ceph-mon[31636]: pgmap v8164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:37:06.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:06 smithi170 ceph-mon[31212]: pgmap v8164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:37:06.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:06 smithi077 ceph-mon[27902]: pgmap v8164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:37:08.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:08 smithi191 ceph-mon[31636]: pgmap v8165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:37:08.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15138.580243 secs 2024-04-21T14:37:08.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:08 smithi170 ceph-mon[31212]: pgmap v8165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:37:08.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15138.580243 secs 2024-04-21T14:37:08.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:08 smithi077 ceph-mon[27902]: pgmap v8165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:37:08.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15138.580243 secs 2024-04-21T14:37:10.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:10.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15140.339940 secs 2024-04-21T14:37:10.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:10 smithi191 ceph-mon[31636]: pgmap v8166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:37:10.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:10 smithi191 ceph-mon[31636]: osdmap e582: 12 total, 12 up, 12 in 2024-04-21T14:37:10.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15140.339940 secs 2024-04-21T14:37:10.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:10 smithi170 ceph-mon[31212]: pgmap v8166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:37:10.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:10 smithi170 ceph-mon[31212]: osdmap e582: 12 total, 12 up, 12 in 2024-04-21T14:37:10.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15140.339940 secs 2024-04-21T14:37:10.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:10 smithi077 ceph-mon[27902]: pgmap v8166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:37:10.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:10 smithi077 ceph-mon[27902]: osdmap e582: 12 total, 12 up, 12 in 2024-04-21T14:37:12.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:12 smithi191 ceph-mon[31636]: pgmap v8168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:37:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:12 smithi170 ceph-mon[31212]: pgmap v8168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:37:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:12 smithi077 ceph-mon[27902]: pgmap v8168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:37:13.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15143.580353 secs 2024-04-21T14:37:13.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15143.580353 secs 2024-04-21T14:37:13.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15143.580353 secs 2024-04-21T14:37:14.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:14 smithi191 ceph-mon[31636]: pgmap v8169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:37:14.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:14 smithi170 ceph-mon[31212]: pgmap v8169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:37:14.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:14 smithi077 ceph-mon[27902]: pgmap v8169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:37:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:15.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15145.340006 secs 2024-04-21T14:37:15.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15145.340006 secs 2024-04-21T14:37:15.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15145.340006 secs 2024-04-21T14:37:16.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:16 smithi170 ceph-mon[31212]: pgmap v8170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:37:16.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:16 smithi077 ceph-mon[27902]: pgmap v8170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:37:16.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:16 smithi191 ceph-mon[31636]: pgmap v8170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:37:18.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:18 smithi170 ceph-mon[31212]: pgmap v8171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:37:18.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15148.580491 secs 2024-04-21T14:37:18.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:18 smithi077 ceph-mon[27902]: pgmap v8171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:37:18.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15148.580491 secs 2024-04-21T14:37:18.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:18 smithi191 ceph-mon[31636]: pgmap v8171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:37:18.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15148.580491 secs 2024-04-21T14:37:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:20.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15150.340132 secs 2024-04-21T14:37:20.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:20 smithi170 ceph-mon[31212]: pgmap v8172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:37:20.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15150.340132 secs 2024-04-21T14:37:20.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:20 smithi077 ceph-mon[27902]: pgmap v8172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:37:20.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15150.340132 secs 2024-04-21T14:37:20.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:20 smithi191 ceph-mon[31636]: pgmap v8172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:37:22.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:22 smithi170 ceph-mon[31212]: pgmap v8173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:37:22.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:22 smithi077 ceph-mon[27902]: pgmap v8173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:37:22.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:22 smithi191 ceph-mon[31636]: pgmap v8173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:37:23.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15153.580608 secs 2024-04-21T14:37:23.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15153.580608 secs 2024-04-21T14:37:23.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15153.580608 secs 2024-04-21T14:37:24.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:24 smithi170 ceph-mon[31212]: pgmap v8174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:24.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:24 smithi077 ceph-mon[27902]: pgmap v8174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:24.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:24 smithi191 ceph-mon[31636]: pgmap v8174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:25.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15155.340213 secs 2024-04-21T14:37:25.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15155.340213 secs 2024-04-21T14:37:25.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15155.340213 secs 2024-04-21T14:37:26.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:26 smithi170 ceph-mon[31212]: pgmap v8175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:26.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:26 smithi077 ceph-mon[27902]: pgmap v8175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:26.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:26 smithi191 ceph-mon[31636]: pgmap v8175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:28.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:28 smithi170 ceph-mon[31212]: pgmap v8176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:28.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15158.580707 secs 2024-04-21T14:37:28.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:28 smithi077 ceph-mon[27902]: pgmap v8176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:28.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15158.580707 secs 2024-04-21T14:37:28.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:28 smithi191 ceph-mon[31636]: pgmap v8176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:28.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15158.580707 secs 2024-04-21T14:37:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:30.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15160.340294 secs 2024-04-21T14:37:30.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:30 smithi170 ceph-mon[31212]: pgmap v8177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:30.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15160.340294 secs 2024-04-21T14:37:30.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:30 smithi077 ceph-mon[27902]: pgmap v8177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:30.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15160.340294 secs 2024-04-21T14:37:30.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:30 smithi191 ceph-mon[31636]: pgmap v8177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:32.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:32 smithi170 ceph-mon[31212]: pgmap v8178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:32.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:32 smithi077 ceph-mon[27902]: pgmap v8178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:32.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:32 smithi191 ceph-mon[31636]: pgmap v8178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:33.509 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15163.580845 secs 2024-04-21T14:37:33.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15163.580845 secs 2024-04-21T14:37:33.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15163.580845 secs 2024-04-21T14:37:34.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:34 smithi170 ceph-mon[31212]: pgmap v8179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:34.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:34 smithi077 ceph-mon[27902]: pgmap v8179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:34.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:34 smithi191 ceph-mon[31636]: pgmap v8179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:35.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:35.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15165.340412 secs 2024-04-21T14:37:35.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15165.340412 secs 2024-04-21T14:37:35.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15165.340412 secs 2024-04-21T14:37:36.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:36 smithi170 ceph-mon[31212]: pgmap v8180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:36.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:36 smithi077 ceph-mon[27902]: pgmap v8180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:36.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:36 smithi191 ceph-mon[31636]: pgmap v8180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:38.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:38 smithi170 ceph-mon[31212]: pgmap v8181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:38.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15168.580992 secs 2024-04-21T14:37:38.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:38 smithi077 ceph-mon[27902]: pgmap v8181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:38.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15168.580992 secs 2024-04-21T14:37:38.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:38 smithi191 ceph-mon[31636]: pgmap v8181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:38.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15168.580992 secs 2024-04-21T14:37:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:40.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15170.340507 secs 2024-04-21T14:37:40.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:40 smithi170 ceph-mon[31212]: pgmap v8182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:40.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15170.340507 secs 2024-04-21T14:37:40.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:40 smithi077 ceph-mon[27902]: pgmap v8182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:40.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15170.340507 secs 2024-04-21T14:37:40.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:40 smithi191 ceph-mon[31636]: pgmap v8182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:42.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:42 smithi170 ceph-mon[31212]: pgmap v8183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:42.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:42 smithi077 ceph-mon[27902]: pgmap v8183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:42.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:42 smithi191 ceph-mon[31636]: pgmap v8183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:43.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15173.581109 secs 2024-04-21T14:37:43.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15173.581109 secs 2024-04-21T14:37:43.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15173.581109 secs 2024-04-21T14:37:44.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:44 smithi170 ceph-mon[31212]: pgmap v8184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:44.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:44 smithi077 ceph-mon[27902]: pgmap v8184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:44.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:44 smithi191 ceph-mon[31636]: pgmap v8184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:45.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15175.340616 secs 2024-04-21T14:37:45.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15175.340616 secs 2024-04-21T14:37:45.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15175.340616 secs 2024-04-21T14:37:46.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:46 smithi170 ceph-mon[31212]: pgmap v8185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:46.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:46 smithi077 ceph-mon[27902]: pgmap v8185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:46.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:46 smithi191 ceph-mon[31636]: pgmap v8185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:48.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:48 smithi170 ceph-mon[31212]: pgmap v8186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:48.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15178.581205 secs 2024-04-21T14:37:48.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:48 smithi077 ceph-mon[27902]: pgmap v8186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:48.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15178.581205 secs 2024-04-21T14:37:48.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:48 smithi191 ceph-mon[31636]: pgmap v8186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:48.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15178.581205 secs 2024-04-21T14:37:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:50.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15180.340742 secs 2024-04-21T14:37:50.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:50 smithi170 ceph-mon[31212]: pgmap v8187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:50.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15180.340742 secs 2024-04-21T14:37:50.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:50 smithi077 ceph-mon[27902]: pgmap v8187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:50.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15180.340742 secs 2024-04-21T14:37:50.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:50 smithi191 ceph-mon[31636]: pgmap v8187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:52.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:52 smithi170 ceph-mon[31212]: pgmap v8188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:52.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:52 smithi077 ceph-mon[27902]: pgmap v8188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:52.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:52 smithi191 ceph-mon[31636]: pgmap v8188: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:53.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15183.581324 secs 2024-04-21T14:37:53.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15183.581324 secs 2024-04-21T14:37:53.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15183.581324 secs 2024-04-21T14:37:54.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:54 smithi077 ceph-mon[27902]: pgmap v8189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:54.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:54 smithi191 ceph-mon[31636]: pgmap v8189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:54.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:54 smithi170 ceph-mon[31212]: pgmap v8189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:37:55.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15185.340880 secs 2024-04-21T14:37:55.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15185.340880 secs 2024-04-21T14:37:55.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15185.340880 secs 2024-04-21T14:37:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:37:56.448+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065f0 con 0x7efd78101130 2024-04-21T14:37:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:37:56.448+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:37:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:37:56.448+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:37:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:37:56.448+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065f0 con 0x7efd78101130 2024-04-21T14:37:56.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:56 smithi077 ceph-mon[27902]: pgmap v8190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:56.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:56 smithi191 ceph-mon[31636]: pgmap v8190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:56.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:56 smithi170 ceph-mon[31212]: pgmap v8190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:37:58.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:58 smithi077 ceph-mon[27902]: pgmap v8191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:58.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:37:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15188.581460 secs 2024-04-21T14:37:58.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:58 smithi191 ceph-mon[31636]: pgmap v8191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:58.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:37:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15188.581460 secs 2024-04-21T14:37:58.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:58 smithi170 ceph-mon[31212]: pgmap v8191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:37:58.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:37:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15188.581460 secs 2024-04-21T14:38:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:00.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15190.340945 secs 2024-04-21T14:38:00.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:00 smithi077 ceph-mon[27902]: pgmap v8192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:00.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:38:00.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15190.340945 secs 2024-04-21T14:38:00.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:00 smithi191 ceph-mon[31636]: pgmap v8192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:00.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:38:00.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15190.340945 secs 2024-04-21T14:38:00.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:00 smithi170 ceph-mon[31212]: pgmap v8192: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:00.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:38:02.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:01 smithi170 ceph-mon[31212]: pgmap v8193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:02.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:38:02.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:38:02.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:01 smithi077 ceph-mon[27902]: pgmap v8193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:38:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:38:02.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:01 smithi191 ceph-mon[31636]: pgmap v8193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:38:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:38:02.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:38:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15193.581520 secs 2024-04-21T14:38:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15193.581520 secs 2024-04-21T14:38:03.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15193.581520 secs 2024-04-21T14:38:04.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:03 smithi077 ceph-mon[27902]: pgmap v8194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:04.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:03 smithi191 ceph-mon[31636]: pgmap v8194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:04.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:03 smithi170 ceph-mon[31212]: pgmap v8194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15195.341042 secs 2024-04-21T14:38:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:04 smithi077 ceph-mon[27902]: osdmap e583: 12 total, 12 up, 12 in 2024-04-21T14:38:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15195.341042 secs 2024-04-21T14:38:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:04 smithi191 ceph-mon[31636]: osdmap e583: 12 total, 12 up, 12 in 2024-04-21T14:38:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15195.341042 secs 2024-04-21T14:38:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:04 smithi170 ceph-mon[31212]: osdmap e583: 12 total, 12 up, 12 in 2024-04-21T14:38:06.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:05 smithi077 ceph-mon[27902]: pgmap v8196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:38:06.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:05 smithi191 ceph-mon[31636]: pgmap v8196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:38:06.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:05 smithi170 ceph-mon[31212]: pgmap v8196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:38:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:07 smithi077 ceph-mon[27902]: pgmap v8197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:38:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15198.581595 secs 2024-04-21T14:38:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:07 smithi191 ceph-mon[31636]: pgmap v8197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:38:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15198.581595 secs 2024-04-21T14:38:08.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:07 smithi170 ceph-mon[31212]: pgmap v8197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:38:08.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15198.581595 secs 2024-04-21T14:38:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15200.341153 secs 2024-04-21T14:38:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:09 smithi077 ceph-mon[27902]: pgmap v8198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:38:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:09 smithi077 ceph-mon[27902]: osdmap e584: 12 total, 12 up, 12 in 2024-04-21T14:38:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15200.341153 secs 2024-04-21T14:38:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:09 smithi191 ceph-mon[31636]: pgmap v8198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:38:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:09 smithi191 ceph-mon[31636]: osdmap e584: 12 total, 12 up, 12 in 2024-04-21T14:38:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15200.341153 secs 2024-04-21T14:38:10.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:09 smithi170 ceph-mon[31212]: pgmap v8198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:38:10.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:09 smithi170 ceph-mon[31212]: osdmap e584: 12 total, 12 up, 12 in 2024-04-21T14:38:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:11 smithi077 ceph-mon[27902]: pgmap v8200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:38:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:11 smithi191 ceph-mon[31636]: pgmap v8200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:38:12.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:11 smithi170 ceph-mon[31212]: pgmap v8200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:38:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15203.581729 secs 2024-04-21T14:38:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15203.581729 secs 2024-04-21T14:38:13.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15203.581729 secs 2024-04-21T14:38:14.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:13 smithi077 ceph-mon[27902]: pgmap v8201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:38:14.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:13 smithi191 ceph-mon[31636]: pgmap v8201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:38:14.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:13 smithi170 ceph-mon[31212]: pgmap v8201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:38:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15205.341217 secs 2024-04-21T14:38:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15205.341217 secs 2024-04-21T14:38:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15205.341217 secs 2024-04-21T14:38:16.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:15 smithi077 ceph-mon[27902]: pgmap v8202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:38:16.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:15 smithi191 ceph-mon[31636]: pgmap v8202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:38:16.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:15 smithi170 ceph-mon[31212]: pgmap v8202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:38:18.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:17 smithi077 ceph-mon[27902]: pgmap v8203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:38:18.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15208.581851 secs 2024-04-21T14:38:18.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:17 smithi191 ceph-mon[31636]: pgmap v8203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:38:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15208.581851 secs 2024-04-21T14:38:18.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:17 smithi170 ceph-mon[31212]: pgmap v8203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:38:18.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15208.581851 secs 2024-04-21T14:38:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:20.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15210.341338 secs 2024-04-21T14:38:20.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:19 smithi077 ceph-mon[27902]: pgmap v8204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:38:20.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15210.341338 secs 2024-04-21T14:38:20.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:19 smithi191 ceph-mon[31636]: pgmap v8204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:38:20.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15210.341338 secs 2024-04-21T14:38:20.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:19 smithi170 ceph-mon[31212]: pgmap v8204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:38:22.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:21 smithi077 ceph-mon[27902]: pgmap v8205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:38:22.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:21 smithi191 ceph-mon[31636]: pgmap v8205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:38:22.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:21 smithi170 ceph-mon[31212]: pgmap v8205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:38:23.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15213.581944 secs 2024-04-21T14:38:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15213.581944 secs 2024-04-21T14:38:23.180 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15213.581944 secs 2024-04-21T14:38:24.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:23 smithi077 ceph-mon[27902]: pgmap v8206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:24.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:23 smithi191 ceph-mon[31636]: pgmap v8206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:24.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:23 smithi170 ceph-mon[31212]: pgmap v8206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15215.341416 secs 2024-04-21T14:38:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15215.341416 secs 2024-04-21T14:38:25.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15215.341416 secs 2024-04-21T14:38:26.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:25 smithi077 ceph-mon[27902]: pgmap v8207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:26.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:25 smithi191 ceph-mon[31636]: pgmap v8207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:26.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:25 smithi170 ceph-mon[31212]: pgmap v8207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:28.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:27 smithi077 ceph-mon[27902]: pgmap v8208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:28.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15218.582050 secs 2024-04-21T14:38:28.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:27 smithi191 ceph-mon[31636]: pgmap v8208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:28.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15218.582050 secs 2024-04-21T14:38:28.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:27 smithi170 ceph-mon[31212]: pgmap v8208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:28.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15218.582050 secs 2024-04-21T14:38:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:30.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15220.341557 secs 2024-04-21T14:38:30.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:29 smithi077 ceph-mon[27902]: pgmap v8209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:30.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15220.341557 secs 2024-04-21T14:38:30.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:29 smithi191 ceph-mon[31636]: pgmap v8209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:30.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15220.341557 secs 2024-04-21T14:38:30.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:29 smithi170 ceph-mon[31212]: pgmap v8209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:32.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:31 smithi077 ceph-mon[27902]: pgmap v8210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:32.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:31 smithi191 ceph-mon[31636]: pgmap v8210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:32.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:31 smithi170 ceph-mon[31212]: pgmap v8210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15223.582146 secs 2024-04-21T14:38:33.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15223.582146 secs 2024-04-21T14:38:33.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15223.582146 secs 2024-04-21T14:38:34.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:33 smithi191 ceph-mon[31636]: pgmap v8211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:34.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:33 smithi170 ceph-mon[31212]: pgmap v8211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:34.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:33 smithi077 ceph-mon[27902]: pgmap v8211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:35.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15225.341653 secs 2024-04-21T14:38:35.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15225.341653 secs 2024-04-21T14:38:35.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15225.341653 secs 2024-04-21T14:38:36.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:35 smithi191 ceph-mon[31636]: pgmap v8212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:36.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:35 smithi170 ceph-mon[31212]: pgmap v8212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:36.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:35 smithi077 ceph-mon[27902]: pgmap v8212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:38.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:37 smithi191 ceph-mon[31636]: pgmap v8213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:38.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15228.582235 secs 2024-04-21T14:38:38.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:37 smithi170 ceph-mon[31212]: pgmap v8213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:38.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15228.582235 secs 2024-04-21T14:38:38.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:37 smithi077 ceph-mon[27902]: pgmap v8213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:38.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15228.582235 secs 2024-04-21T14:38:40.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15230.341797 secs 2024-04-21T14:38:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:39 smithi191 ceph-mon[31636]: pgmap v8214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:40.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15230.341797 secs 2024-04-21T14:38:40.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:39 smithi170 ceph-mon[31212]: pgmap v8214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:40.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15230.341797 secs 2024-04-21T14:38:40.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:39 smithi077 ceph-mon[27902]: pgmap v8214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:42.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:41 smithi191 ceph-mon[31636]: pgmap v8215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:42.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:41 smithi170 ceph-mon[31212]: pgmap v8215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:42.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:41 smithi077 ceph-mon[27902]: pgmap v8215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:43.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15233.582354 secs 2024-04-21T14:38:43.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15233.582354 secs 2024-04-21T14:38:43.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15233.582354 secs 2024-04-21T14:38:44.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:43 smithi191 ceph-mon[31636]: pgmap v8216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:44.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:43 smithi170 ceph-mon[31212]: pgmap v8216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:44.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:43 smithi077 ceph-mon[27902]: pgmap v8216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:45.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15235.341914 secs 2024-04-21T14:38:45.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15235.341914 secs 2024-04-21T14:38:45.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15235.341914 secs 2024-04-21T14:38:46.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:45 smithi191 ceph-mon[31636]: pgmap v8217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:46.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:45 smithi170 ceph-mon[31212]: pgmap v8217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:46.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:45 smithi077 ceph-mon[27902]: pgmap v8217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:48.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:47 smithi191 ceph-mon[31636]: pgmap v8218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:48.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15238.582472 secs 2024-04-21T14:38:48.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:47 smithi170 ceph-mon[31212]: pgmap v8218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:48.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15238.582472 secs 2024-04-21T14:38:48.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:47 smithi077 ceph-mon[27902]: pgmap v8218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:48.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15238.582472 secs 2024-04-21T14:38:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:50.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15240.342030 secs 2024-04-21T14:38:50.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:49 smithi191 ceph-mon[31636]: pgmap v8219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:50.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15240.342030 secs 2024-04-21T14:38:50.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:49 smithi170 ceph-mon[31212]: pgmap v8219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:50.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15240.342030 secs 2024-04-21T14:38:50.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:49 smithi077 ceph-mon[27902]: pgmap v8219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:52.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:51 smithi191 ceph-mon[31636]: pgmap v8220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:52.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:51 smithi170 ceph-mon[31212]: pgmap v8220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:52.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:51 smithi077 ceph-mon[27902]: pgmap v8220: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:53.180 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15243.582570 secs 2024-04-21T14:38:53.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15243.582570 secs 2024-04-21T14:38:53.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15243.582570 secs 2024-04-21T14:38:54.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:53 smithi191 ceph-mon[31636]: pgmap v8221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:54.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:53 smithi170 ceph-mon[31212]: pgmap v8221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:54.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:53 smithi077 ceph-mon[27902]: pgmap v8221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:38:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15245.342146 secs 2024-04-21T14:38:55.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15245.342146 secs 2024-04-21T14:38:55.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15245.342146 secs 2024-04-21T14:38:56.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:55 smithi191 ceph-mon[31636]: pgmap v8222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:56.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:55 smithi170 ceph-mon[31212]: pgmap v8222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:56.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:55 smithi077 ceph-mon[27902]: pgmap v8222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:38:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:57 smithi191 ceph-mon[31636]: pgmap v8223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15248.582687 secs 2024-04-21T14:38:58.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:57 smithi170 ceph-mon[31212]: pgmap v8223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:58.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15248.582687 secs 2024-04-21T14:38:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:57 smithi077 ceph-mon[27902]: pgmap v8223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:38:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15248.582687 secs 2024-04-21T14:39:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:00.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15250.342263 secs 2024-04-21T14:39:00.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:38:59 smithi191 ceph-mon[31636]: pgmap v8224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15250.342263 secs 2024-04-21T14:39:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:38:59 smithi170 ceph-mon[31212]: pgmap v8224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15250.342263 secs 2024-04-21T14:39:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:38:59 smithi077 ceph-mon[27902]: pgmap v8224: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:02.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:01 smithi191 ceph-mon[31636]: pgmap v8225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T14:39:02.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:39:02.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:01 smithi170 ceph-mon[31212]: pgmap v8225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T14:39:02.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:39:02.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:01 smithi077 ceph-mon[27902]: pgmap v8225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T14:39:02.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:39:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15253.582752 secs 2024-04-21T14:39:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:39:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:39:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15253.582752 secs 2024-04-21T14:39:03.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:39:03.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:39:03.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15253.582752 secs 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:39:03.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:39:04.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:04 smithi191 ceph-mon[31636]: pgmap v8226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T14:39:04.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:04 smithi170 ceph-mon[31212]: pgmap v8226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T14:39:04.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:04 smithi077 ceph-mon[27902]: pgmap v8226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T14:39:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:05.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15255.342338 secs 2024-04-21T14:39:05.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:05 smithi191 ceph-mon[31636]: osdmap e585: 12 total, 12 up, 12 in 2024-04-21T14:39:05.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15255.342338 secs 2024-04-21T14:39:05.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:05 smithi170 ceph-mon[31212]: osdmap e585: 12 total, 12 up, 12 in 2024-04-21T14:39:05.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15255.342338 secs 2024-04-21T14:39:05.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:05 smithi077 ceph-mon[27902]: osdmap e585: 12 total, 12 up, 12 in 2024-04-21T14:39:06.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:06 smithi191 ceph-mon[31636]: pgmap v8228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T14:39:06.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:06 smithi170 ceph-mon[31212]: pgmap v8228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T14:39:06.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:06 smithi077 ceph-mon[27902]: pgmap v8228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T14:39:08.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:08 smithi170 ceph-mon[31212]: pgmap v8229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:39:08.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15258.582868 secs 2024-04-21T14:39:08.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:08 smithi077 ceph-mon[27902]: pgmap v8229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:39:08.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15258.582868 secs 2024-04-21T14:39:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:08 smithi191 ceph-mon[31636]: pgmap v8229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:39:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15258.582868 secs 2024-04-21T14:39:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:10.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15260.342455 secs 2024-04-21T14:39:10.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:10 smithi170 ceph-mon[31212]: pgmap v8230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:39:10.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:10 smithi170 ceph-mon[31212]: osdmap e586: 12 total, 12 up, 12 in 2024-04-21T14:39:10.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15260.342455 secs 2024-04-21T14:39:10.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:10 smithi077 ceph-mon[27902]: pgmap v8230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:39:10.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:10 smithi077 ceph-mon[27902]: osdmap e586: 12 total, 12 up, 12 in 2024-04-21T14:39:10.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15260.342455 secs 2024-04-21T14:39:10.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:10 smithi191 ceph-mon[31636]: pgmap v8230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:39:10.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:10 smithi191 ceph-mon[31636]: osdmap e586: 12 total, 12 up, 12 in 2024-04-21T14:39:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:12 smithi170 ceph-mon[31212]: pgmap v8232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T14:39:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:12 smithi077 ceph-mon[27902]: pgmap v8232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T14:39:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:12 smithi191 ceph-mon[31636]: pgmap v8232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T14:39:13.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15263.582985 secs 2024-04-21T14:39:13.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15263.582985 secs 2024-04-21T14:39:13.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15263.582985 secs 2024-04-21T14:39:14.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:14 smithi170 ceph-mon[31212]: pgmap v8233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-04-21T14:39:14.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:14 smithi077 ceph-mon[27902]: pgmap v8233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-04-21T14:39:14.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:14 smithi191 ceph-mon[31636]: pgmap v8233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-04-21T14:39:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:15.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15265.342575 secs 2024-04-21T14:39:15.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15265.342575 secs 2024-04-21T14:39:15.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15265.342575 secs 2024-04-21T14:39:16.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:16 smithi170 ceph-mon[31212]: pgmap v8234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T14:39:16.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:16 smithi077 ceph-mon[27902]: pgmap v8234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T14:39:16.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:16 smithi191 ceph-mon[31636]: pgmap v8234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T14:39:18.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:18 smithi170 ceph-mon[31212]: pgmap v8235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:39:18.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15268.583098 secs 2024-04-21T14:39:18.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:18 smithi077 ceph-mon[27902]: pgmap v8235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:39:18.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15268.583098 secs 2024-04-21T14:39:18.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:18 smithi191 ceph-mon[31636]: pgmap v8235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:39:18.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15268.583098 secs 2024-04-21T14:39:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:20.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15270.342692 secs 2024-04-21T14:39:20.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:20 smithi170 ceph-mon[31212]: pgmap v8236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:39:20.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15270.342692 secs 2024-04-21T14:39:20.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:20 smithi077 ceph-mon[27902]: pgmap v8236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:39:20.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15270.342692 secs 2024-04-21T14:39:20.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:20 smithi191 ceph-mon[31636]: pgmap v8236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:39:22.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:22 smithi170 ceph-mon[31212]: pgmap v8237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:39:22.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:22 smithi077 ceph-mon[27902]: pgmap v8237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:39:22.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:22 smithi191 ceph-mon[31636]: pgmap v8237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:39:23.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15273.583218 secs 2024-04-21T14:39:23.592 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15273.583218 secs 2024-04-21T14:39:23.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15273.583218 secs 2024-04-21T14:39:24.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:24 smithi170 ceph-mon[31212]: pgmap v8238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:24.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:24 smithi077 ceph-mon[27902]: pgmap v8238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:24.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:24 smithi191 ceph-mon[31636]: pgmap v8238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:25.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15275.342793 secs 2024-04-21T14:39:25.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15275.342793 secs 2024-04-21T14:39:25.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15275.342793 secs 2024-04-21T14:39:26.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:26 smithi170 ceph-mon[31212]: pgmap v8239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:26.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:26 smithi077 ceph-mon[27902]: pgmap v8239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:26.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:26 smithi191 ceph-mon[31636]: pgmap v8239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:28.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:28 smithi170 ceph-mon[31212]: pgmap v8240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:28.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15278.583289 secs 2024-04-21T14:39:28.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:28 smithi077 ceph-mon[27902]: pgmap v8240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:28.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15278.583289 secs 2024-04-21T14:39:28.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:28 smithi191 ceph-mon[31636]: pgmap v8240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:28.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15278.583289 secs 2024-04-21T14:39:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:30.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15280.342934 secs 2024-04-21T14:39:30.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:30 smithi170 ceph-mon[31212]: pgmap v8241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:30.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15280.342934 secs 2024-04-21T14:39:30.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:30 smithi077 ceph-mon[27902]: pgmap v8241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:30.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15280.342934 secs 2024-04-21T14:39:30.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:30 smithi191 ceph-mon[31636]: pgmap v8241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:32.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:32 smithi170 ceph-mon[31212]: pgmap v8242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:32.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:32 smithi077 ceph-mon[27902]: pgmap v8242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:32.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:32 smithi191 ceph-mon[31636]: pgmap v8242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:33.509 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15283.583409 secs 2024-04-21T14:39:33.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15283.583409 secs 2024-04-21T14:39:33.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15283.583409 secs 2024-04-21T14:39:34.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:34 smithi170 ceph-mon[31212]: pgmap v8243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:34.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:34 smithi077 ceph-mon[27902]: pgmap v8243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:34.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:34 smithi191 ceph-mon[31636]: pgmap v8243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:35.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:35.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15285.343055 secs 2024-04-21T14:39:35.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15285.343055 secs 2024-04-21T14:39:35.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15285.343055 secs 2024-04-21T14:39:36.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:36 smithi170 ceph-mon[31212]: pgmap v8244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:36.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:36 smithi077 ceph-mon[27902]: pgmap v8244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:36.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:36 smithi191 ceph-mon[31636]: pgmap v8244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:38.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:38 smithi170 ceph-mon[31212]: pgmap v8245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:38.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15288.583480 secs 2024-04-21T14:39:38.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:38 smithi077 ceph-mon[27902]: pgmap v8245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:38.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15288.583480 secs 2024-04-21T14:39:38.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:38 smithi191 ceph-mon[31636]: pgmap v8245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:38.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15288.583480 secs 2024-04-21T14:39:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:40.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15290.343179 secs 2024-04-21T14:39:40.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:40 smithi170 ceph-mon[31212]: pgmap v8246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:40.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15290.343179 secs 2024-04-21T14:39:40.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:40 smithi077 ceph-mon[27902]: pgmap v8246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:40.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15290.343179 secs 2024-04-21T14:39:40.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:40 smithi191 ceph-mon[31636]: pgmap v8246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:42.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:42 smithi170 ceph-mon[31212]: pgmap v8247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:42.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:42 smithi077 ceph-mon[27902]: pgmap v8247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:42.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:42 smithi191 ceph-mon[31636]: pgmap v8247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:43.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15293.583599 secs 2024-04-21T14:39:43.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15293.583599 secs 2024-04-21T14:39:43.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15293.583599 secs 2024-04-21T14:39:44.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:44 smithi077 ceph-mon[27902]: pgmap v8248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:44.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:44 smithi191 ceph-mon[31636]: pgmap v8248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:44.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:44 smithi170 ceph-mon[31212]: pgmap v8248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:45.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15295.343246 secs 2024-04-21T14:39:45.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15295.343246 secs 2024-04-21T14:39:45.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15295.343246 secs 2024-04-21T14:39:46.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:46 smithi077 ceph-mon[27902]: pgmap v8249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:46.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:46 smithi191 ceph-mon[31636]: pgmap v8249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:46.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:46 smithi170 ceph-mon[31212]: pgmap v8249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:48.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:48 smithi077 ceph-mon[27902]: pgmap v8250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:48.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15298.583692 secs 2024-04-21T14:39:48.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:48 smithi191 ceph-mon[31636]: pgmap v8250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:48.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15298.583692 secs 2024-04-21T14:39:48.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:48 smithi170 ceph-mon[31212]: pgmap v8250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:39:48.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15298.583692 secs 2024-04-21T14:39:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:50.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15300.343366 secs 2024-04-21T14:39:50.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:50 smithi077 ceph-mon[27902]: pgmap v8251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:50.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15300.343366 secs 2024-04-21T14:39:50.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:50 smithi191 ceph-mon[31636]: pgmap v8251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:50.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15300.343366 secs 2024-04-21T14:39:50.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:50 smithi170 ceph-mon[31212]: pgmap v8251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:39:52.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:52 smithi077 ceph-mon[27902]: pgmap v8252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:39:52.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:52 smithi191 ceph-mon[31636]: pgmap v8252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:39:52.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:52 smithi170 ceph-mon[31212]: pgmap v8252: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:39:53.592 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15303.583808 secs 2024-04-21T14:39:53.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15303.583808 secs 2024-04-21T14:39:53.680 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15303.583808 secs 2024-04-21T14:39:54.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:54 smithi077 ceph-mon[27902]: pgmap v8253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:39:54.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:54 smithi191 ceph-mon[31636]: pgmap v8253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:39:54.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:54 smithi170 ceph-mon[31212]: pgmap v8253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:39:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:39:55.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15305.343463 secs 2024-04-21T14:39:55.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15305.343463 secs 2024-04-21T14:39:55.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15305.343463 secs 2024-04-21T14:39:56.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:56 smithi077 ceph-mon[27902]: pgmap v8254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:39:56.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:56 smithi191 ceph-mon[31636]: pgmap v8254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:39:56.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:56 smithi170 ceph-mon[31212]: pgmap v8254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:39:58.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:58 smithi077 ceph-mon[27902]: pgmap v8255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:39:58.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:39:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15308.583837 secs 2024-04-21T14:39:58.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:58 smithi191 ceph-mon[31636]: pgmap v8255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:39:58.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:39:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15308.583837 secs 2024-04-21T14:39:58.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:58 smithi170 ceph-mon[31212]: pgmap v8255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:39:58.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:39:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15308.583837 secs 2024-04-21T14:40:00.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:00.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15310.343527 secs 2024-04-21T14:40:00.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:00 smithi077 ceph-mon[27902]: pgmap v8256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:40:00.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:40:00.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15310.343527 secs 2024-04-21T14:40:00.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:00 smithi191 ceph-mon[31636]: pgmap v8256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:40:00.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:40:00.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15310.343527 secs 2024-04-21T14:40:00.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:00 smithi170 ceph-mon[31212]: pgmap v8256: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:40:00.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:40:02.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:02 smithi077 ceph-mon[27902]: pgmap v8257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:40:02.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:02 smithi191 ceph-mon[31636]: pgmap v8257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:40:02.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:02 smithi170 ceph-mon[31212]: pgmap v8257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:40:03.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15313.583916 secs 2024-04-21T14:40:03.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:40:03.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15313.583916 secs 2024-04-21T14:40:03.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:40:03.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15313.583916 secs 2024-04-21T14:40:03.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:40:04.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:04 smithi077 ceph-mon[27902]: pgmap v8258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:04.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:40:04.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:40:04.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:40:04.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:04 smithi191 ceph-mon[31636]: pgmap v8258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:04.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:40:04.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:40:04.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:40:04.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:04 smithi170 ceph-mon[31212]: pgmap v8258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:04.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:40:04.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:40:04.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:40:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:05.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15315.343598 secs 2024-04-21T14:40:05.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:05 smithi077 ceph-mon[27902]: osdmap e587: 12 total, 12 up, 12 in 2024-04-21T14:40:05.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15315.343598 secs 2024-04-21T14:40:05.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:05 smithi191 ceph-mon[31636]: osdmap e587: 12 total, 12 up, 12 in 2024-04-21T14:40:05.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15315.343598 secs 2024-04-21T14:40:05.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:05 smithi170 ceph-mon[31212]: osdmap e587: 12 total, 12 up, 12 in 2024-04-21T14:40:06.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:06 smithi077 ceph-mon[27902]: pgmap v8260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:40:06.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:06 smithi191 ceph-mon[31636]: pgmap v8260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:40:06.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:06 smithi170 ceph-mon[31212]: pgmap v8260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:40:08.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:08 smithi077 ceph-mon[27902]: pgmap v8261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:40:08.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15318.583979 secs 2024-04-21T14:40:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:08 smithi191 ceph-mon[31636]: pgmap v8261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:40:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15318.583979 secs 2024-04-21T14:40:08.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:08 smithi170 ceph-mon[31212]: pgmap v8261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:40:08.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15318.583979 secs 2024-04-21T14:40:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:10.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15320.343679 secs 2024-04-21T14:40:10.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:10 smithi191 ceph-mon[31636]: pgmap v8262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:40:10.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:10 smithi191 ceph-mon[31636]: osdmap e588: 12 total, 12 up, 12 in 2024-04-21T14:40:10.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15320.343679 secs 2024-04-21T14:40:10.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:10 smithi170 ceph-mon[31212]: pgmap v8262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:40:10.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:10 smithi170 ceph-mon[31212]: osdmap e588: 12 total, 12 up, 12 in 2024-04-21T14:40:10.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15320.343679 secs 2024-04-21T14:40:10.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:10 smithi077 ceph-mon[27902]: pgmap v8262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:40:10.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:10 smithi077 ceph-mon[27902]: osdmap e588: 12 total, 12 up, 12 in 2024-04-21T14:40:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:12 smithi191 ceph-mon[31636]: pgmap v8264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:40:12.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:12 smithi170 ceph-mon[31212]: pgmap v8264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:40:12.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:12 smithi077 ceph-mon[27902]: pgmap v8264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:40:13.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15323.584087 secs 2024-04-21T14:40:13.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15323.584087 secs 2024-04-21T14:40:13.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15323.584087 secs 2024-04-21T14:40:14.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:14 smithi191 ceph-mon[31636]: pgmap v8265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T14:40:14.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:14 smithi170 ceph-mon[31212]: pgmap v8265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T14:40:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:14 smithi077 ceph-mon[27902]: pgmap v8265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T14:40:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:15.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15325.343800 secs 2024-04-21T14:40:15.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15325.343800 secs 2024-04-21T14:40:15.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15325.343800 secs 2024-04-21T14:40:16.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:16 smithi191 ceph-mon[31636]: pgmap v8266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:40:16.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:16 smithi170 ceph-mon[31212]: pgmap v8266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:40:16.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:16 smithi077 ceph-mon[27902]: pgmap v8266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:40:18.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:18 smithi191 ceph-mon[31636]: pgmap v8267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:40:18.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15328.584164 secs 2024-04-21T14:40:18.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:18 smithi170 ceph-mon[31212]: pgmap v8267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:40:18.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15328.584164 secs 2024-04-21T14:40:18.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:18 smithi077 ceph-mon[27902]: pgmap v8267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:40:18.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15328.584164 secs 2024-04-21T14:40:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:20.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15330.343896 secs 2024-04-21T14:40:20.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:20 smithi191 ceph-mon[31636]: pgmap v8268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:40:20.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15330.343896 secs 2024-04-21T14:40:20.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:20 smithi170 ceph-mon[31212]: pgmap v8268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:40:20.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15330.343896 secs 2024-04-21T14:40:20.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:20 smithi077 ceph-mon[27902]: pgmap v8268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:40:22.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:22 smithi191 ceph-mon[31636]: pgmap v8269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:40:22.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:22 smithi170 ceph-mon[31212]: pgmap v8269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:40:22.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:22 smithi077 ceph-mon[27902]: pgmap v8269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:40:23.680 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15333.584232 secs 2024-04-21T14:40:23.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15333.584232 secs 2024-04-21T14:40:23.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15333.584232 secs 2024-04-21T14:40:24.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:24 smithi191 ceph-mon[31636]: pgmap v8270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:24.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:24 smithi170 ceph-mon[31212]: pgmap v8270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:24.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:24 smithi077 ceph-mon[27902]: pgmap v8270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:25.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15335.344009 secs 2024-04-21T14:40:25.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15335.344009 secs 2024-04-21T14:40:25.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15335.344009 secs 2024-04-21T14:40:26.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:26 smithi191 ceph-mon[31636]: pgmap v8271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:26.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:26 smithi170 ceph-mon[31212]: pgmap v8271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:26.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:26 smithi077 ceph-mon[27902]: pgmap v8271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:27.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:27 smithi191 ceph-mon[31636]: pgmap v8272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:27.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:27 smithi170 ceph-mon[31212]: pgmap v8272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:27.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:27 smithi077 ceph-mon[27902]: pgmap v8272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:28.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15338.584348 secs 2024-04-21T14:40:28.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15338.584348 secs 2024-04-21T14:40:28.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15338.584348 secs 2024-04-21T14:40:29.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:29 smithi191 ceph-mon[31636]: pgmap v8273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:29.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:29 smithi170 ceph-mon[31212]: pgmap v8273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:29.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:29 smithi077 ceph-mon[27902]: pgmap v8273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:30.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15340.344136 secs 2024-04-21T14:40:30.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15340.344136 secs 2024-04-21T14:40:30.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15340.344136 secs 2024-04-21T14:40:31.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:31 smithi191 ceph-mon[31636]: pgmap v8274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:31.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:31 smithi170 ceph-mon[31212]: pgmap v8274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:31.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:31 smithi077 ceph-mon[27902]: pgmap v8274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:33.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15343.584438 secs 2024-04-21T14:40:33.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:33 smithi191 ceph-mon[31636]: pgmap v8275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:34.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15343.584438 secs 2024-04-21T14:40:34.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:33 smithi170 ceph-mon[31212]: pgmap v8275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:34.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15343.584438 secs 2024-04-21T14:40:34.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:33 smithi077 ceph-mon[27902]: pgmap v8275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:34.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15345.344216 secs 2024-04-21T14:40:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15345.344216 secs 2024-04-21T14:40:35.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:35.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15345.344216 secs 2024-04-21T14:40:35.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:35 smithi191 ceph-mon[31636]: pgmap v8276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:36.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:35 smithi170 ceph-mon[31212]: pgmap v8276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:36.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:35 smithi077 ceph-mon[27902]: pgmap v8276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:37.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:37 smithi191 ceph-mon[31636]: pgmap v8277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:38.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:37 smithi170 ceph-mon[31212]: pgmap v8277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:38.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:37 smithi077 ceph-mon[27902]: pgmap v8277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:38.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15348.584575 secs 2024-04-21T14:40:39.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15348.584575 secs 2024-04-21T14:40:39.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15348.584575 secs 2024-04-21T14:40:39.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15350.344349 secs 2024-04-21T14:40:39.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:39 smithi191 ceph-mon[31636]: pgmap v8278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:40.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15350.344349 secs 2024-04-21T14:40:40.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:39 smithi170 ceph-mon[31212]: pgmap v8278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:40.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15350.344349 secs 2024-04-21T14:40:40.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:39 smithi077 ceph-mon[27902]: pgmap v8278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:41.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:41 smithi191 ceph-mon[31636]: pgmap v8279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:42.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:41 smithi170 ceph-mon[31212]: pgmap v8279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:42.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:41 smithi077 ceph-mon[27902]: pgmap v8279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:43.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15353.584710 secs 2024-04-21T14:40:43.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:43 smithi191 ceph-mon[31636]: pgmap v8280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:44.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15353.584710 secs 2024-04-21T14:40:44.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:43 smithi170 ceph-mon[31212]: pgmap v8280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:44.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15353.584710 secs 2024-04-21T14:40:44.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:43 smithi077 ceph-mon[27902]: pgmap v8280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:44.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15355.344465 secs 2024-04-21T14:40:45.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15355.344465 secs 2024-04-21T14:40:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15355.344465 secs 2024-04-21T14:40:45.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:45 smithi191 ceph-mon[31636]: pgmap v8281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:46.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:45 smithi170 ceph-mon[31212]: pgmap v8281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:46.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:45 smithi077 ceph-mon[27902]: pgmap v8281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:47.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:47 smithi191 ceph-mon[31636]: pgmap v8282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:48.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:47 smithi170 ceph-mon[31212]: pgmap v8282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:48.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:47 smithi077 ceph-mon[27902]: pgmap v8282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:48.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15358.584837 secs 2024-04-21T14:40:49.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15358.584837 secs 2024-04-21T14:40:49.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15358.584837 secs 2024-04-21T14:40:49.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15360.344578 secs 2024-04-21T14:40:49.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:49 smithi191 ceph-mon[31636]: pgmap v8283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:50.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15360.344578 secs 2024-04-21T14:40:50.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:49 smithi170 ceph-mon[31212]: pgmap v8283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:50.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15360.344578 secs 2024-04-21T14:40:50.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:49 smithi077 ceph-mon[27902]: pgmap v8283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:51.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:51 smithi191 ceph-mon[31636]: pgmap v8284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:52.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:51 smithi170 ceph-mon[31212]: pgmap v8284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:52.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:51 smithi077 ceph-mon[27902]: pgmap v8284: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:53.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15363.584906 secs 2024-04-21T14:40:53.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15363.584906 secs 2024-04-21T14:40:53.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15363.584906 secs 2024-04-21T14:40:54.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:53 smithi170 ceph-mon[31212]: pgmap v8285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:54.092 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:53 smithi191 ceph-mon[31636]: pgmap v8285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:54.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:53 smithi077 ceph-mon[27902]: pgmap v8285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:55.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15365.344658 secs 2024-04-21T14:40:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:40:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15365.344658 secs 2024-04-21T14:40:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15365.344658 secs 2024-04-21T14:40:56.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:55 smithi170 ceph-mon[31212]: pgmap v8286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:56.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:55 smithi077 ceph-mon[27902]: pgmap v8286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:56.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:55 smithi191 ceph-mon[31636]: pgmap v8286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:40:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:40:56.474+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:40:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:40:56.474+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:40:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:40:56.474+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:40:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:40:56.474+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:40:58.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:57 smithi170 ceph-mon[31212]: pgmap v8287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:58.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15368.584996 secs 2024-04-21T14:40:58.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:57 smithi077 ceph-mon[27902]: pgmap v8287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:58.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15368.584996 secs 2024-04-21T14:40:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:57 smithi191 ceph-mon[31636]: pgmap v8287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:40:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15368.584996 secs 2024-04-21T14:41:00.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15370.344794 secs 2024-04-21T14:41:00.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:40:59 smithi170 ceph-mon[31212]: pgmap v8288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:00.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15370.344794 secs 2024-04-21T14:41:00.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:40:59 smithi077 ceph-mon[27902]: pgmap v8288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:00.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15370.344794 secs 2024-04-21T14:41:00.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:40:59 smithi191 ceph-mon[31636]: pgmap v8288: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:02.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:01 smithi170 ceph-mon[31212]: pgmap v8289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:02.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:01 smithi077 ceph-mon[27902]: pgmap v8289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:02.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:01 smithi191 ceph-mon[31636]: pgmap v8289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15373.585076 secs 2024-04-21T14:41:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15373.585076 secs 2024-04-21T14:41:03.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15373.585076 secs 2024-04-21T14:41:04.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:03 smithi170 ceph-mon[31212]: pgmap v8290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:04.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:41:04.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:03 smithi077 ceph-mon[27902]: pgmap v8290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:04.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:41:04.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:03 smithi191 ceph-mon[31636]: pgmap v8290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:04.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:41:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15375.344875 secs 2024-04-21T14:41:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:04 smithi170 ceph-mon[31212]: osdmap e589: 12 total, 12 up, 12 in 2024-04-21T14:41:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:41:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:41:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:41:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15375.344875 secs 2024-04-21T14:41:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:04 smithi077 ceph-mon[27902]: osdmap e589: 12 total, 12 up, 12 in 2024-04-21T14:41:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:41:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:41:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:41:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15375.344875 secs 2024-04-21T14:41:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:04 smithi191 ceph-mon[31636]: osdmap e589: 12 total, 12 up, 12 in 2024-04-21T14:41:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:41:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:41:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:41:06.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:05 smithi170 ceph-mon[31212]: pgmap v8292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:41:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:05 smithi077 ceph-mon[27902]: pgmap v8292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:41:06.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:05 smithi191 ceph-mon[31636]: pgmap v8292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:41:08.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:07 smithi170 ceph-mon[31212]: pgmap v8293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:41:08.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15378.585137 secs 2024-04-21T14:41:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:07 smithi077 ceph-mon[27902]: pgmap v8293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:41:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15378.585137 secs 2024-04-21T14:41:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:07 smithi191 ceph-mon[31636]: pgmap v8293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:41:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15378.585137 secs 2024-04-21T14:41:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15380.344990 secs 2024-04-21T14:41:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:09 smithi077 ceph-mon[27902]: pgmap v8294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:41:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:09 smithi077 ceph-mon[27902]: osdmap e590: 12 total, 12 up, 12 in 2024-04-21T14:41:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15380.344990 secs 2024-04-21T14:41:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:09 smithi191 ceph-mon[31636]: pgmap v8294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:41:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:09 smithi191 ceph-mon[31636]: osdmap e590: 12 total, 12 up, 12 in 2024-04-21T14:41:10.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15380.344990 secs 2024-04-21T14:41:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:09 smithi170 ceph-mon[31212]: pgmap v8294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:41:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:09 smithi170 ceph-mon[31212]: osdmap e590: 12 total, 12 up, 12 in 2024-04-21T14:41:12.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:11 smithi077 ceph-mon[27902]: pgmap v8296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:41:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:11 smithi191 ceph-mon[31636]: pgmap v8296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:41:12.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:11 smithi170 ceph-mon[31212]: pgmap v8296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:41:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15383.585206 secs 2024-04-21T14:41:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15383.585206 secs 2024-04-21T14:41:13.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15383.585206 secs 2024-04-21T14:41:14.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:13 smithi077 ceph-mon[27902]: pgmap v8297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:41:14.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:13 smithi191 ceph-mon[31636]: pgmap v8297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:41:14.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:13 smithi170 ceph-mon[31212]: pgmap v8297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:41:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15385.345110 secs 2024-04-21T14:41:15.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15385.345110 secs 2024-04-21T14:41:15.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15385.345110 secs 2024-04-21T14:41:16.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:15 smithi077 ceph-mon[27902]: pgmap v8298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:41:16.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:15 smithi191 ceph-mon[31636]: pgmap v8298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:41:16.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:15 smithi170 ceph-mon[31212]: pgmap v8298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:41:18.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:17 smithi077 ceph-mon[27902]: pgmap v8299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:41:18.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15388.585276 secs 2024-04-21T14:41:18.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:17 smithi191 ceph-mon[31636]: pgmap v8299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:41:18.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15388.585276 secs 2024-04-21T14:41:18.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:17 smithi170 ceph-mon[31212]: pgmap v8299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:41:18.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15388.585276 secs 2024-04-21T14:41:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:20.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15390.345229 secs 2024-04-21T14:41:20.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:19 smithi077 ceph-mon[27902]: pgmap v8300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:41:20.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15390.345229 secs 2024-04-21T14:41:20.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:19 smithi191 ceph-mon[31636]: pgmap v8300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:41:20.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15390.345229 secs 2024-04-21T14:41:20.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:19 smithi170 ceph-mon[31212]: pgmap v8300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:41:22.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:21 smithi077 ceph-mon[27902]: pgmap v8301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:41:22.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15393.585385 secs 2024-04-21T14:41:22.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:21 smithi191 ceph-mon[31636]: pgmap v8301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:41:22.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15393.585385 secs 2024-04-21T14:41:22.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:21 smithi170 ceph-mon[31212]: pgmap v8301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:41:22.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15393.585385 secs 2024-04-21T14:41:24.081 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:23 smithi170 ceph-mon[31212]: pgmap v8302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:24.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:23 smithi077 ceph-mon[27902]: pgmap v8302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:24.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:23 smithi191 ceph-mon[31636]: pgmap v8302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:25.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15395.345344 secs 2024-04-21T14:41:25.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15395.345344 secs 2024-04-21T14:41:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15395.345344 secs 2024-04-21T14:41:26.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:25 smithi077 ceph-mon[27902]: pgmap v8303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:26.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:25 smithi191 ceph-mon[31636]: pgmap v8303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:26.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:25 smithi170 ceph-mon[31212]: pgmap v8303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:27.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15398.585498 secs 2024-04-21T14:41:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15398.585498 secs 2024-04-21T14:41:27.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15398.585498 secs 2024-04-21T14:41:28.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:27 smithi077 ceph-mon[27902]: pgmap v8304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:28.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:27 smithi191 ceph-mon[31636]: pgmap v8304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:28.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:27 smithi170 ceph-mon[31212]: pgmap v8304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:30.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:30.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15400.345476 secs 2024-04-21T14:41:30.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:29 smithi077 ceph-mon[27902]: pgmap v8305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:30.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15400.345476 secs 2024-04-21T14:41:30.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:29 smithi191 ceph-mon[31636]: pgmap v8305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:30.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15400.345476 secs 2024-04-21T14:41:30.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:29 smithi170 ceph-mon[31212]: pgmap v8305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:32.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:31 smithi077 ceph-mon[27902]: pgmap v8306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:32.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15403.585633 secs 2024-04-21T14:41:32.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:31 smithi191 ceph-mon[31636]: pgmap v8306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:32.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15403.585633 secs 2024-04-21T14:41:32.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:31 smithi170 ceph-mon[31212]: pgmap v8306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:32.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15403.585633 secs 2024-04-21T14:41:34.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:33 smithi077 ceph-mon[27902]: pgmap v8307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:34.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:33 smithi191 ceph-mon[31636]: pgmap v8307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:34.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:33 smithi170 ceph-mon[31212]: pgmap v8307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15405.345595 secs 2024-04-21T14:41:35.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15405.345595 secs 2024-04-21T14:41:35.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15405.345595 secs 2024-04-21T14:41:36.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:35 smithi077 ceph-mon[27902]: pgmap v8308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:36.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:35 smithi191 ceph-mon[31636]: pgmap v8308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:36.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:35 smithi170 ceph-mon[31212]: pgmap v8308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:37.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15408.585747 secs 2024-04-21T14:41:37.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15408.585747 secs 2024-04-21T14:41:37.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15408.585747 secs 2024-04-21T14:41:38.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:37 smithi077 ceph-mon[27902]: pgmap v8309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:38.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:37 smithi191 ceph-mon[31636]: pgmap v8309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:38.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:37 smithi170 ceph-mon[31212]: pgmap v8309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:40.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:40.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15410.345716 secs 2024-04-21T14:41:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:39 smithi191 ceph-mon[31636]: pgmap v8310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:40.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15410.345716 secs 2024-04-21T14:41:40.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:39 smithi170 ceph-mon[31212]: pgmap v8310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:40.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15410.345716 secs 2024-04-21T14:41:40.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:39 smithi077 ceph-mon[27902]: pgmap v8310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:42.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:41 smithi191 ceph-mon[31636]: pgmap v8311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:42.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15413.585835 secs 2024-04-21T14:41:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:41 smithi170 ceph-mon[31212]: pgmap v8311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15413.585835 secs 2024-04-21T14:41:42.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:41 smithi077 ceph-mon[27902]: pgmap v8311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:42.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15413.585835 secs 2024-04-21T14:41:44.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:43 smithi191 ceph-mon[31636]: pgmap v8312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:44.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:43 smithi170 ceph-mon[31212]: pgmap v8312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:44.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:43 smithi077 ceph-mon[27902]: pgmap v8312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:45.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15415.345843 secs 2024-04-21T14:41:45.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15415.345843 secs 2024-04-21T14:41:45.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15415.345843 secs 2024-04-21T14:41:46.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:45 smithi191 ceph-mon[31636]: pgmap v8313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:46.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:45 smithi170 ceph-mon[31212]: pgmap v8313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:46.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:45 smithi077 ceph-mon[27902]: pgmap v8313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:47.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15418.585914 secs 2024-04-21T14:41:47.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15418.585914 secs 2024-04-21T14:41:47.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15418.585914 secs 2024-04-21T14:41:48.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:47 smithi191 ceph-mon[31636]: pgmap v8314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:48.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:47 smithi170 ceph-mon[31212]: pgmap v8314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:48.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:47 smithi077 ceph-mon[27902]: pgmap v8314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:50.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15420.345959 secs 2024-04-21T14:41:50.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:49 smithi191 ceph-mon[31636]: pgmap v8315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:50.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15420.345959 secs 2024-04-21T14:41:50.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:49 smithi170 ceph-mon[31212]: pgmap v8315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:50.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15420.345959 secs 2024-04-21T14:41:50.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:49 smithi077 ceph-mon[27902]: pgmap v8315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:52.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:51 smithi191 ceph-mon[31636]: pgmap v8316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:52.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15423.586035 secs 2024-04-21T14:41:52.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:51 smithi170 ceph-mon[31212]: pgmap v8316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:52.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15423.586035 secs 2024-04-21T14:41:52.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:51 smithi077 ceph-mon[27902]: pgmap v8316: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:52.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15423.586035 secs 2024-04-21T14:41:54.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:53 smithi191 ceph-mon[31636]: pgmap v8317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:54.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:53 smithi170 ceph-mon[31212]: pgmap v8317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:54.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:53 smithi077 ceph-mon[27902]: pgmap v8317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:55.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:41:55.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15425.346077 secs 2024-04-21T14:41:55.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15425.346077 secs 2024-04-21T14:41:55.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15425.346077 secs 2024-04-21T14:41:56.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:55 smithi191 ceph-mon[31636]: pgmap v8318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:56.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:55 smithi170 ceph-mon[31212]: pgmap v8318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:56.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:55 smithi077 ceph-mon[27902]: pgmap v8318: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:41:57.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15428.586151 secs 2024-04-21T14:41:57.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15428.586151 secs 2024-04-21T14:41:57.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15428.586151 secs 2024-04-21T14:41:58.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:57 smithi191 ceph-mon[31636]: pgmap v8319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:58.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:57 smithi170 ceph-mon[31212]: pgmap v8319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:41:58.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:57 smithi077 ceph-mon[27902]: pgmap v8319: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:00.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15430.346201 secs 2024-04-21T14:42:00.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:41:59 smithi191 ceph-mon[31636]: pgmap v8320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:00.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15430.346201 secs 2024-04-21T14:42:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:41:59 smithi170 ceph-mon[31212]: pgmap v8320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:00.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15430.346201 secs 2024-04-21T14:42:00.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:41:59 smithi077 ceph-mon[27902]: pgmap v8320: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:02.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:01 smithi191 ceph-mon[31636]: pgmap v8321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:02.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15433.586275 secs 2024-04-21T14:42:02.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:01 smithi170 ceph-mon[31212]: pgmap v8321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:02.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15433.586275 secs 2024-04-21T14:42:02.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:01 smithi077 ceph-mon[27902]: pgmap v8321: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:02.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15433.586275 secs 2024-04-21T14:42:04.159 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:03 smithi077 ceph-mon[27902]: pgmap v8322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:04.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:03 smithi191 ceph-mon[31636]: pgmap v8322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:04.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:03 smithi170 ceph-mon[31212]: pgmap v8322: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15435.346346 secs 2024-04-21T14:42:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:04 smithi191 ceph-mon[31636]: osdmap e591: 12 total, 12 up, 12 in 2024-04-21T14:42:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:42:05.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15435.346346 secs 2024-04-21T14:42:05.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:04 smithi170 ceph-mon[31212]: osdmap e591: 12 total, 12 up, 12 in 2024-04-21T14:42:05.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:42:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15435.346346 secs 2024-04-21T14:42:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:04 smithi077 ceph-mon[27902]: osdmap e591: 12 total, 12 up, 12 in 2024-04-21T14:42:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:42:06.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:05 smithi191 ceph-mon[31636]: pgmap v8324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:42:06.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:42:06.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:42:06.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:42:06.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:05 smithi170 ceph-mon[31212]: pgmap v8324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:42:06.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:42:06.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:42:06.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:42:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:05 smithi077 ceph-mon[27902]: pgmap v8324: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:42:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:42:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:42:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:42:07.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15438.586339 secs 2024-04-21T14:42:07.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15438.586339 secs 2024-04-21T14:42:07.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15438.586339 secs 2024-04-21T14:42:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:07 smithi191 ceph-mon[31636]: pgmap v8325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:42:08.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:07 smithi170 ceph-mon[31212]: pgmap v8325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:42:08.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:07 smithi077 ceph-mon[27902]: pgmap v8325: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:42:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15440.346502 secs 2024-04-21T14:42:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:09 smithi191 ceph-mon[31636]: pgmap v8326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:42:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:09 smithi191 ceph-mon[31636]: osdmap e592: 12 total, 12 up, 12 in 2024-04-21T14:42:10.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15440.346502 secs 2024-04-21T14:42:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:09 smithi170 ceph-mon[31212]: pgmap v8326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:42:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:09 smithi170 ceph-mon[31212]: osdmap e592: 12 total, 12 up, 12 in 2024-04-21T14:42:10.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15440.346502 secs 2024-04-21T14:42:10.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:09 smithi077 ceph-mon[27902]: pgmap v8326: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:42:10.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:09 smithi077 ceph-mon[27902]: osdmap e592: 12 total, 12 up, 12 in 2024-04-21T14:42:12.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:11 smithi191 ceph-mon[31636]: pgmap v8328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:42:12.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15443.586418 secs 2024-04-21T14:42:12.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:11 smithi170 ceph-mon[31212]: pgmap v8328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:42:12.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15443.586418 secs 2024-04-21T14:42:12.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:11 smithi077 ceph-mon[27902]: pgmap v8328: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:42:12.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15443.586418 secs 2024-04-21T14:42:14.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:13 smithi191 ceph-mon[31636]: pgmap v8329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:42:14.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:13 smithi170 ceph-mon[31212]: pgmap v8329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:42:14.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:13 smithi077 ceph-mon[27902]: pgmap v8329: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:42:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:15.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15445.346638 secs 2024-04-21T14:42:15.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15445.346638 secs 2024-04-21T14:42:15.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15445.346638 secs 2024-04-21T14:42:16.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:15 smithi170 ceph-mon[31212]: pgmap v8330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:42:16.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:15 smithi077 ceph-mon[27902]: pgmap v8330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:42:16.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:15 smithi191 ceph-mon[31636]: pgmap v8330: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:42:17.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15448.586478 secs 2024-04-21T14:42:17.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15448.586478 secs 2024-04-21T14:42:17.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15448.586478 secs 2024-04-21T14:42:18.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:17 smithi170 ceph-mon[31212]: pgmap v8331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:42:18.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:17 smithi077 ceph-mon[27902]: pgmap v8331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:42:18.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:17 smithi191 ceph-mon[31636]: pgmap v8331: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:42:20.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:20.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15450.346797 secs 2024-04-21T14:42:20.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:19 smithi170 ceph-mon[31212]: pgmap v8332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:42:20.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15450.346797 secs 2024-04-21T14:42:20.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:19 smithi077 ceph-mon[27902]: pgmap v8332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:42:20.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15450.346797 secs 2024-04-21T14:42:20.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:19 smithi191 ceph-mon[31636]: pgmap v8332: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:42:22.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:21 smithi170 ceph-mon[31212]: pgmap v8333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:42:22.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15453.586618 secs 2024-04-21T14:42:22.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:21 smithi077 ceph-mon[27902]: pgmap v8333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:42:22.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15453.586618 secs 2024-04-21T14:42:22.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:21 smithi191 ceph-mon[31636]: pgmap v8333: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:42:22.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15453.586618 secs 2024-04-21T14:42:24.242 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:23 smithi191 ceph-mon[31636]: pgmap v8334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:24.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:23 smithi170 ceph-mon[31212]: pgmap v8334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:24.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:23 smithi077 ceph-mon[27902]: pgmap v8334: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15455.346940 secs 2024-04-21T14:42:25.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15455.346940 secs 2024-04-21T14:42:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15455.346940 secs 2024-04-21T14:42:26.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:25 smithi170 ceph-mon[31212]: pgmap v8335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:26.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:25 smithi077 ceph-mon[27902]: pgmap v8335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:26.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:25 smithi191 ceph-mon[31636]: pgmap v8335: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:27.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15458.586737 secs 2024-04-21T14:42:27.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15458.586737 secs 2024-04-21T14:42:27.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15458.586737 secs 2024-04-21T14:42:28.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:28 smithi170 ceph-mon[31212]: pgmap v8336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:28.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:28 smithi077 ceph-mon[27902]: pgmap v8336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:28.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:28 smithi191 ceph-mon[31636]: pgmap v8336: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:30.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15460.347028 secs 2024-04-21T14:42:30.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:30 smithi170 ceph-mon[31212]: pgmap v8337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:30.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15460.347028 secs 2024-04-21T14:42:30.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:30 smithi077 ceph-mon[27902]: pgmap v8337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:30.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15460.347028 secs 2024-04-21T14:42:30.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:30 smithi191 ceph-mon[31636]: pgmap v8337: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:32.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:32 smithi170 ceph-mon[31212]: pgmap v8338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:32.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15463.586833 secs 2024-04-21T14:42:32.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:32 smithi077 ceph-mon[27902]: pgmap v8338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:32.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15463.586833 secs 2024-04-21T14:42:32.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:32 smithi191 ceph-mon[31636]: pgmap v8338: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:32.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15463.586833 secs 2024-04-21T14:42:34.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:34 smithi170 ceph-mon[31212]: pgmap v8339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:34.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:34 smithi077 ceph-mon[27902]: pgmap v8339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:34.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:34 smithi191 ceph-mon[31636]: pgmap v8339: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:35.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:35.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15465.347143 secs 2024-04-21T14:42:35.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15465.347143 secs 2024-04-21T14:42:35.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15465.347143 secs 2024-04-21T14:42:36.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:36 smithi170 ceph-mon[31212]: pgmap v8340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:36.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:36 smithi077 ceph-mon[27902]: pgmap v8340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:36.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:36 smithi191 ceph-mon[31636]: pgmap v8340: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:37.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15468.586924 secs 2024-04-21T14:42:37.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15468.586924 secs 2024-04-21T14:42:37.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15468.586924 secs 2024-04-21T14:42:38.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:38 smithi170 ceph-mon[31212]: pgmap v8341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:38.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:38 smithi077 ceph-mon[27902]: pgmap v8341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:38.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:38 smithi191 ceph-mon[31636]: pgmap v8341: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:40.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15470.347208 secs 2024-04-21T14:42:40.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:40 smithi170 ceph-mon[31212]: pgmap v8342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:40.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15470.347208 secs 2024-04-21T14:42:40.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:40 smithi077 ceph-mon[27902]: pgmap v8342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:40.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15470.347208 secs 2024-04-21T14:42:40.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:40 smithi191 ceph-mon[31636]: pgmap v8342: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:42 smithi170 ceph-mon[31212]: pgmap v8343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15473.587039 secs 2024-04-21T14:42:42.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:42 smithi077 ceph-mon[27902]: pgmap v8343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:42.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15473.587039 secs 2024-04-21T14:42:42.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:42 smithi191 ceph-mon[31636]: pgmap v8343: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:42.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15473.587039 secs 2024-04-21T14:42:44.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:44 smithi170 ceph-mon[31212]: pgmap v8344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:44.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:44 smithi077 ceph-mon[27902]: pgmap v8344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:44.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:44 smithi191 ceph-mon[31636]: pgmap v8344: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:45.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15475.347335 secs 2024-04-21T14:42:45.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15475.347335 secs 2024-04-21T14:42:45.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15475.347335 secs 2024-04-21T14:42:46.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:46 smithi170 ceph-mon[31212]: pgmap v8345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:46.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:46 smithi077 ceph-mon[27902]: pgmap v8345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:46.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:46 smithi191 ceph-mon[31636]: pgmap v8345: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:47.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15478.587101 secs 2024-04-21T14:42:47.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15478.587101 secs 2024-04-21T14:42:47.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15478.587101 secs 2024-04-21T14:42:48.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:48 smithi170 ceph-mon[31212]: pgmap v8346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:48.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:48 smithi077 ceph-mon[27902]: pgmap v8346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:48.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:48 smithi191 ceph-mon[31636]: pgmap v8346: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:50.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15480.347418 secs 2024-04-21T14:42:50.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:50 smithi077 ceph-mon[27902]: pgmap v8347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:50.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15480.347418 secs 2024-04-21T14:42:50.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:50 smithi191 ceph-mon[31636]: pgmap v8347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:50.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15480.347418 secs 2024-04-21T14:42:50.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:50 smithi170 ceph-mon[31212]: pgmap v8347: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:52.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:52 smithi077 ceph-mon[27902]: pgmap v8348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:52.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15483.587210 secs 2024-04-21T14:42:52.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:52 smithi191 ceph-mon[31636]: pgmap v8348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:52.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15483.587210 secs 2024-04-21T14:42:52.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:52 smithi170 ceph-mon[31212]: pgmap v8348: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:52.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15483.587210 secs 2024-04-21T14:42:54.330 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:54 smithi170 ceph-mon[31212]: pgmap v8349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:54.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:54 smithi077 ceph-mon[27902]: pgmap v8349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:54.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:54 smithi191 ceph-mon[31636]: pgmap v8349: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:55.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:42:55.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15485.347517 secs 2024-04-21T14:42:55.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15485.347517 secs 2024-04-21T14:42:55.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15485.347517 secs 2024-04-21T14:42:56.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:56 smithi077 ceph-mon[27902]: pgmap v8350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:56.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:56 smithi191 ceph-mon[31636]: pgmap v8350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:56.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:56 smithi170 ceph-mon[31212]: pgmap v8350: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:42:57.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15488.587324 secs 2024-04-21T14:42:57.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15488.587324 secs 2024-04-21T14:42:57.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15488.587324 secs 2024-04-21T14:42:58.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:42:58 smithi077 ceph-mon[27902]: pgmap v8351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:58.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:42:58 smithi191 ceph-mon[31636]: pgmap v8351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:42:58.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:42:58 smithi170 ceph-mon[31212]: pgmap v8351: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:00.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15490.347660 secs 2024-04-21T14:43:00.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:00 smithi077 ceph-mon[27902]: pgmap v8352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:00.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15490.347660 secs 2024-04-21T14:43:00.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:00 smithi191 ceph-mon[31636]: pgmap v8352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:00.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15490.347660 secs 2024-04-21T14:43:00.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:00 smithi170 ceph-mon[31212]: pgmap v8352: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:02.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:02 smithi077 ceph-mon[27902]: pgmap v8353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:02.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15493.587459 secs 2024-04-21T14:43:02.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:02 smithi191 ceph-mon[31636]: pgmap v8353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:02.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15493.587459 secs 2024-04-21T14:43:02.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:02 smithi170 ceph-mon[31212]: pgmap v8353: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:02.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15493.587459 secs 2024-04-21T14:43:04.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:04 smithi077 ceph-mon[27902]: pgmap v8354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:04.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:04 smithi191 ceph-mon[31636]: pgmap v8354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:04.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:04 smithi170 ceph-mon[31212]: pgmap v8354: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15495.347801 secs 2024-04-21T14:43:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:05 smithi077 ceph-mon[27902]: osdmap e593: 12 total, 12 up, 12 in 2024-04-21T14:43:05.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15495.347801 secs 2024-04-21T14:43:05.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:05 smithi191 ceph-mon[31636]: osdmap e593: 12 total, 12 up, 12 in 2024-04-21T14:43:05.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15495.347801 secs 2024-04-21T14:43:05.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:05 smithi170 ceph-mon[31212]: osdmap e593: 12 total, 12 up, 12 in 2024-04-21T14:43:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:06 smithi077 ceph-mon[27902]: pgmap v8356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:43:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:43:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:43:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:43:06.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:43:06.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:06 smithi191 ceph-mon[31636]: pgmap v8356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:43:06.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:43:06.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:43:06.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:43:06.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:43:06.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:06 smithi170 ceph-mon[31212]: pgmap v8356: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:43:06.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:43:06.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:43:06.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:43:06.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:43:07.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15498.587552 secs 2024-04-21T14:43:07.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15498.587552 secs 2024-04-21T14:43:07.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15498.587552 secs 2024-04-21T14:43:08.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:08 smithi077 ceph-mon[27902]: pgmap v8357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:08.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:08 smithi191 ceph-mon[31636]: pgmap v8357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:08.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:08 smithi170 ceph-mon[31212]: pgmap v8357: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:10.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15500.347942 secs 2024-04-21T14:43:10.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:10 smithi077 ceph-mon[27902]: pgmap v8358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:10.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:10 smithi077 ceph-mon[27902]: osdmap e594: 12 total, 12 up, 12 in 2024-04-21T14:43:10.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15500.347942 secs 2024-04-21T14:43:10.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:10 smithi191 ceph-mon[31636]: pgmap v8358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:10.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:10 smithi191 ceph-mon[31636]: osdmap e594: 12 total, 12 up, 12 in 2024-04-21T14:43:10.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15500.347942 secs 2024-04-21T14:43:10.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:10 smithi170 ceph-mon[31212]: pgmap v8358: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:10.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:10 smithi170 ceph-mon[31212]: osdmap e594: 12 total, 12 up, 12 in 2024-04-21T14:43:12.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:12 smithi077 ceph-mon[27902]: pgmap v8360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:43:12.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15503.587687 secs 2024-04-21T14:43:12.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:12 smithi191 ceph-mon[31636]: pgmap v8360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:43:12.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15503.587687 secs 2024-04-21T14:43:12.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:12 smithi170 ceph-mon[31212]: pgmap v8360: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:43:12.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15503.587687 secs 2024-04-21T14:43:14.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:14 smithi077 ceph-mon[27902]: pgmap v8361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:43:14.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:14 smithi191 ceph-mon[31636]: pgmap v8361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:43:14.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:14 smithi170 ceph-mon[31212]: pgmap v8361: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T14:43:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:15.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15505.348070 secs 2024-04-21T14:43:15.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15505.348070 secs 2024-04-21T14:43:15.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15505.348070 secs 2024-04-21T14:43:16.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:16 smithi077 ceph-mon[27902]: pgmap v8362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:16.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:16 smithi191 ceph-mon[31636]: pgmap v8362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:16.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:16 smithi170 ceph-mon[31212]: pgmap v8362: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:43:17.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15508.587807 secs 2024-04-21T14:43:17.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15508.587807 secs 2024-04-21T14:43:17.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15508.587807 secs 2024-04-21T14:43:18.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:18 smithi191 ceph-mon[31636]: pgmap v8363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:43:18.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:18 smithi170 ceph-mon[31212]: pgmap v8363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:43:18.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:18 smithi077 ceph-mon[27902]: pgmap v8363: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:43:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:20.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15510.348151 secs 2024-04-21T14:43:20.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:20 smithi191 ceph-mon[31636]: pgmap v8364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:43:20.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15510.348151 secs 2024-04-21T14:43:20.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:20 smithi170 ceph-mon[31212]: pgmap v8364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:43:20.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15510.348151 secs 2024-04-21T14:43:20.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:20 smithi077 ceph-mon[27902]: pgmap v8364: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:43:22.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:22 smithi191 ceph-mon[31636]: pgmap v8365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:43:22.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15513.587920 secs 2024-04-21T14:43:22.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:22 smithi170 ceph-mon[31212]: pgmap v8365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:43:22.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15513.587920 secs 2024-04-21T14:43:22.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:22 smithi077 ceph-mon[27902]: pgmap v8365: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:43:22.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15513.587920 secs 2024-04-21T14:43:24.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:24 smithi191 ceph-mon[31636]: pgmap v8366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:24.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:24 smithi170 ceph-mon[31212]: pgmap v8366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:24.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:24 smithi077 ceph-mon[27902]: pgmap v8366: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15515.348272 secs 2024-04-21T14:43:25.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15515.348272 secs 2024-04-21T14:43:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15515.348272 secs 2024-04-21T14:43:26.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:26 smithi191 ceph-mon[31636]: pgmap v8367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:26.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:26 smithi170 ceph-mon[31212]: pgmap v8367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:26.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:26 smithi077 ceph-mon[27902]: pgmap v8367: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:27.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15518.588033 secs 2024-04-21T14:43:27.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15518.588033 secs 2024-04-21T14:43:27.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15518.588033 secs 2024-04-21T14:43:28.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:28 smithi191 ceph-mon[31636]: pgmap v8368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:28.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:28 smithi170 ceph-mon[31212]: pgmap v8368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:28.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:28 smithi077 ceph-mon[27902]: pgmap v8368: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:30.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15520.348389 secs 2024-04-21T14:43:30.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:30 smithi191 ceph-mon[31636]: pgmap v8369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:30.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15520.348389 secs 2024-04-21T14:43:30.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:30 smithi170 ceph-mon[31212]: pgmap v8369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:30.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15520.348389 secs 2024-04-21T14:43:30.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:30 smithi077 ceph-mon[27902]: pgmap v8369: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:32.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:32 smithi191 ceph-mon[31636]: pgmap v8370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:32.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15523.588146 secs 2024-04-21T14:43:32.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:32 smithi170 ceph-mon[31212]: pgmap v8370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:32.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15523.588146 secs 2024-04-21T14:43:32.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:32 smithi077 ceph-mon[27902]: pgmap v8370: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:32.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15523.588146 secs 2024-04-21T14:43:34.408 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:34 smithi077 ceph-mon[27902]: pgmap v8371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:34.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:34 smithi191 ceph-mon[31636]: pgmap v8371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:34.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:34 smithi170 ceph-mon[31212]: pgmap v8371: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:35.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15525.348510 secs 2024-04-21T14:43:35.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15525.348510 secs 2024-04-21T14:43:35.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15525.348510 secs 2024-04-21T14:43:36.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:36 smithi191 ceph-mon[31636]: pgmap v8372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:36.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:36 smithi170 ceph-mon[31212]: pgmap v8372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:36.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:36 smithi077 ceph-mon[27902]: pgmap v8372: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:37.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15528.588272 secs 2024-04-21T14:43:37.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15528.588272 secs 2024-04-21T14:43:37.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15528.588272 secs 2024-04-21T14:43:38.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:38 smithi191 ceph-mon[31636]: pgmap v8373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:38.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:38 smithi170 ceph-mon[31212]: pgmap v8373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:38.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:38 smithi077 ceph-mon[27902]: pgmap v8373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:40.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:40.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15530.348653 secs 2024-04-21T14:43:40.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:40 smithi191 ceph-mon[31636]: pgmap v8374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:40.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15530.348653 secs 2024-04-21T14:43:40.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:40 smithi170 ceph-mon[31212]: pgmap v8374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:40.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15530.348653 secs 2024-04-21T14:43:40.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:40 smithi077 ceph-mon[27902]: pgmap v8374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:42.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:42 smithi191 ceph-mon[31636]: pgmap v8375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:42.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15533.588345 secs 2024-04-21T14:43:42.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:42 smithi170 ceph-mon[31212]: pgmap v8375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:42.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15533.588345 secs 2024-04-21T14:43:42.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:42 smithi077 ceph-mon[27902]: pgmap v8375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:42.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15533.588345 secs 2024-04-21T14:43:44.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:44 smithi191 ceph-mon[31636]: pgmap v8376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:44.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:44 smithi170 ceph-mon[31212]: pgmap v8376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:44.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:44 smithi077 ceph-mon[27902]: pgmap v8376: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:45.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15535.348719 secs 2024-04-21T14:43:45.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15535.348719 secs 2024-04-21T14:43:45.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15535.348719 secs 2024-04-21T14:43:46.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:46 smithi191 ceph-mon[31636]: pgmap v8377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:46.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:46 smithi170 ceph-mon[31212]: pgmap v8377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:46.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:46 smithi077 ceph-mon[27902]: pgmap v8377: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:47.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15538.588453 secs 2024-04-21T14:43:47.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15538.588453 secs 2024-04-21T14:43:47.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15538.588453 secs 2024-04-21T14:43:48.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:48 smithi191 ceph-mon[31636]: pgmap v8378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:48.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:48 smithi170 ceph-mon[31212]: pgmap v8378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:48.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:48 smithi077 ceph-mon[27902]: pgmap v8378: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:50.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15540.348877 secs 2024-04-21T14:43:50.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:50 smithi191 ceph-mon[31636]: pgmap v8379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:50.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15540.348877 secs 2024-04-21T14:43:50.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:50 smithi170 ceph-mon[31212]: pgmap v8379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:50.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15540.348877 secs 2024-04-21T14:43:50.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:50 smithi077 ceph-mon[27902]: pgmap v8379: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:52.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:52 smithi191 ceph-mon[31636]: pgmap v8380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:52.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15543.588571 secs 2024-04-21T14:43:52.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:52 smithi170 ceph-mon[31212]: pgmap v8380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:52.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15543.588571 secs 2024-04-21T14:43:52.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:52 smithi077 ceph-mon[27902]: pgmap v8380: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:52.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15543.588571 secs 2024-04-21T14:43:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.431+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000138) for more than 900000000 us, fault. 2024-04-21T14:43:54.402 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.431+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T14:43:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.432+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:43:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.432+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T14:43:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.432+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T14:43:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7004c000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7004c000 comp rx=0 tx=0).stop 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:43:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:54.446+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efd70020640 tx=0x7efd7002b040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T14:43:54.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:54 smithi170 ceph-mon[31212]: pgmap v8381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:54.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:54 smithi077 ceph-mon[27902]: pgmap v8381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:54.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:54 smithi191 ceph-mon[31636]: pgmap v8381: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:43:55.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15545.348947 secs 2024-04-21T14:43:55.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15545.348947 secs 2024-04-21T14:43:55.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15545.348947 secs 2024-04-21T14:43:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:56.498+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:43:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:56.498+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:43:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:56.499+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:43:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:43:56.499+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:43:56.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:56 smithi170 ceph-mon[31212]: pgmap v8382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:56.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:56 smithi077 ceph-mon[27902]: pgmap v8382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:56.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:56 smithi191 ceph-mon[31636]: pgmap v8382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:43:57.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15548.588693 secs 2024-04-21T14:43:57.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15548.588693 secs 2024-04-21T14:43:57.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15548.588693 secs 2024-04-21T14:43:58.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:58 smithi170 ceph-mon[31212]: pgmap v8383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:58.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:58 smithi077 ceph-mon[27902]: pgmap v8383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:58.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:58 smithi191 ceph-mon[31636]: pgmap v8383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:43:59.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15550.349044 secs 2024-04-21T14:43:59.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15550.349044 secs 2024-04-21T14:43:59.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15550.349044 secs 2024-04-21T14:44:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:00.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:00 smithi170 ceph-mon[31212]: pgmap v8384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:00.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:00 smithi077 ceph-mon[27902]: pgmap v8384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:00.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:00 smithi191 ceph-mon[31636]: pgmap v8384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:02.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:02 smithi170 ceph-mon[31212]: pgmap v8385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:02.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15553.588837 secs 2024-04-21T14:44:02.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:02 smithi077 ceph-mon[27902]: pgmap v8385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:02.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15553.588837 secs 2024-04-21T14:44:02.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:02 smithi191 ceph-mon[31636]: pgmap v8385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:02.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15553.588837 secs 2024-04-21T14:44:04.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:04 smithi170 ceph-mon[31212]: pgmap v8386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:04.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15555.349172 secs 2024-04-21T14:44:04.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:04 smithi077 ceph-mon[27902]: pgmap v8386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:04.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15555.349172 secs 2024-04-21T14:44:04.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:04 smithi191 ceph-mon[31636]: pgmap v8386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:04.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15555.349172 secs 2024-04-21T14:44:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:05.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:05 smithi170 ceph-mon[31212]: osdmap e595: 12 total, 12 up, 12 in 2024-04-21T14:44:05.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:05 smithi077 ceph-mon[27902]: osdmap e595: 12 total, 12 up, 12 in 2024-04-21T14:44:05.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:05 smithi191 ceph-mon[31636]: osdmap e595: 12 total, 12 up, 12 in 2024-04-21T14:44:06.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:06 smithi170 ceph-mon[31212]: pgmap v8388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:44:06.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:44:06.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:06 smithi077 ceph-mon[27902]: pgmap v8388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:44:06.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:44:06.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:06 smithi191 ceph-mon[31636]: pgmap v8388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:44:06.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:44:07.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15558.588932 secs 2024-04-21T14:44:07.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:44:07.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:44:07.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:44:07.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15558.588932 secs 2024-04-21T14:44:07.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:44:07.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:44:07.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:44:07.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15558.588932 secs 2024-04-21T14:44:07.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:44:07.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:44:07.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:44:08.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:08 smithi170 ceph-mon[31212]: pgmap v8389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:08.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:08 smithi077 ceph-mon[27902]: pgmap v8389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:08.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:08 smithi191 ceph-mon[31636]: pgmap v8389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:09.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15560.349294 secs 2024-04-21T14:44:09.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15560.349294 secs 2024-04-21T14:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15560.349294 secs 2024-04-21T14:44:10.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:10.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:10 smithi170 ceph-mon[31212]: pgmap v8390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:10.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:10 smithi170 ceph-mon[31212]: osdmap e596: 12 total, 12 up, 12 in 2024-04-21T14:44:10.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:10 smithi077 ceph-mon[27902]: pgmap v8390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:10.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:10 smithi077 ceph-mon[27902]: osdmap e596: 12 total, 12 up, 12 in 2024-04-21T14:44:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:10 smithi191 ceph-mon[31636]: pgmap v8390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:10 smithi191 ceph-mon[31636]: osdmap e596: 12 total, 12 up, 12 in 2024-04-21T14:44:12.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:12 smithi170 ceph-mon[31212]: pgmap v8392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:44:12.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15563.589050 secs 2024-04-21T14:44:12.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:12 smithi077 ceph-mon[27902]: pgmap v8392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:44:12.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15563.589050 secs 2024-04-21T14:44:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:12 smithi191 ceph-mon[31636]: pgmap v8392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:44:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15563.589050 secs 2024-04-21T14:44:14.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:14 smithi170 ceph-mon[31212]: pgmap v8393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:44:14.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15565.349376 secs 2024-04-21T14:44:14.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:14 smithi077 ceph-mon[27902]: pgmap v8393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:44:14.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15565.349376 secs 2024-04-21T14:44:14.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:14 smithi191 ceph-mon[31636]: pgmap v8393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:44:14.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15565.349376 secs 2024-04-21T14:44:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:16.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:16 smithi170 ceph-mon[31212]: pgmap v8394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:16.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:16 smithi077 ceph-mon[27902]: pgmap v8394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:16.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:16 smithi191 ceph-mon[31636]: pgmap v8394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:44:17.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15568.589164 secs 2024-04-21T14:44:17.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15568.589164 secs 2024-04-21T14:44:17.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15568.589164 secs 2024-04-21T14:44:18.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:18 smithi170 ceph-mon[31212]: pgmap v8395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:44:18.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:18 smithi077 ceph-mon[27902]: pgmap v8395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:44:18.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:18 smithi191 ceph-mon[31636]: pgmap v8395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:44:19.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15570.349529 secs 2024-04-21T14:44:19.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15570.349529 secs 2024-04-21T14:44:19.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15570.349529 secs 2024-04-21T14:44:20.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:20.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:20 smithi170 ceph-mon[31212]: pgmap v8396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:44:20.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:20 smithi077 ceph-mon[27902]: pgmap v8396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:44:20.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:20 smithi191 ceph-mon[31636]: pgmap v8396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:44:22.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:22 smithi077 ceph-mon[27902]: pgmap v8397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:44:22.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15573.589318 secs 2024-04-21T14:44:22.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:22 smithi191 ceph-mon[31636]: pgmap v8397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:44:22.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15573.589318 secs 2024-04-21T14:44:22.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:22 smithi170 ceph-mon[31212]: pgmap v8397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:44:22.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15573.589318 secs 2024-04-21T14:44:24.581 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:24 smithi170 ceph-mon[31212]: pgmap v8398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:24.582 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15575.349668 secs 2024-04-21T14:44:24.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:24 smithi077 ceph-mon[27902]: pgmap v8398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:24.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15575.349668 secs 2024-04-21T14:44:24.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:24 smithi191 ceph-mon[31636]: pgmap v8398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:24.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15575.349668 secs 2024-04-21T14:44:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:26.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:26 smithi077 ceph-mon[27902]: pgmap v8399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:26.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:26 smithi191 ceph-mon[31636]: pgmap v8399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:26.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:26 smithi170 ceph-mon[31212]: pgmap v8399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:27.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15578.589450 secs 2024-04-21T14:44:27.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15578.589450 secs 2024-04-21T14:44:27.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15578.589450 secs 2024-04-21T14:44:28.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:28 smithi077 ceph-mon[27902]: pgmap v8400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:28.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:28 smithi191 ceph-mon[31636]: pgmap v8400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:28.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:28 smithi170 ceph-mon[31212]: pgmap v8400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:29.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15580.349797 secs 2024-04-21T14:44:29.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15580.349797 secs 2024-04-21T14:44:29.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15580.349797 secs 2024-04-21T14:44:30.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:30.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:30 smithi077 ceph-mon[27902]: pgmap v8401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:30.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:30 smithi191 ceph-mon[31636]: pgmap v8401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:30.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:30 smithi170 ceph-mon[31212]: pgmap v8401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:32.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:32 smithi077 ceph-mon[27902]: pgmap v8402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:32.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15583.589551 secs 2024-04-21T14:44:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:32 smithi191 ceph-mon[31636]: pgmap v8402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15583.589551 secs 2024-04-21T14:44:32.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:32 smithi170 ceph-mon[31212]: pgmap v8402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:32.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15583.589551 secs 2024-04-21T14:44:34.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:34 smithi077 ceph-mon[27902]: pgmap v8403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:34.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15585.349927 secs 2024-04-21T14:44:34.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:34 smithi191 ceph-mon[31636]: pgmap v8403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:34.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15585.349927 secs 2024-04-21T14:44:34.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:34 smithi170 ceph-mon[31212]: pgmap v8403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:34.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15585.349927 secs 2024-04-21T14:44:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:36.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:36 smithi077 ceph-mon[27902]: pgmap v8404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:36.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:36 smithi191 ceph-mon[31636]: pgmap v8404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:36.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:36 smithi170 ceph-mon[31212]: pgmap v8404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:37.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15588.589666 secs 2024-04-21T14:44:37.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15588.589666 secs 2024-04-21T14:44:37.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15588.589666 secs 2024-04-21T14:44:38.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:38 smithi077 ceph-mon[27902]: pgmap v8405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:38.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:38 smithi191 ceph-mon[31636]: pgmap v8405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:38.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:38 smithi170 ceph-mon[31212]: pgmap v8405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:39.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15590.350051 secs 2024-04-21T14:44:39.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15590.350051 secs 2024-04-21T14:44:39.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15590.350051 secs 2024-04-21T14:44:40.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:40.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:40 smithi077 ceph-mon[27902]: pgmap v8406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:40.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:40 smithi191 ceph-mon[31636]: pgmap v8406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:40.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:40 smithi170 ceph-mon[31212]: pgmap v8406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:44:41.506+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:44:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:44:41.506+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:44:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:44:41.506+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:44:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:44:41.506+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:44:42.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:42 smithi077 ceph-mon[27902]: pgmap v8407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:42.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15593.589797 secs 2024-04-21T14:44:42.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:42 smithi191 ceph-mon[31636]: pgmap v8407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:42.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15593.589797 secs 2024-04-21T14:44:42.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:42 smithi170 ceph-mon[31212]: pgmap v8407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:42.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15593.589797 secs 2024-04-21T14:44:44.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:44 smithi077 ceph-mon[27902]: pgmap v8408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:44.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15595.350191 secs 2024-04-21T14:44:44.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:44 smithi191 ceph-mon[31636]: pgmap v8408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:44.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15595.350191 secs 2024-04-21T14:44:44.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:44 smithi170 ceph-mon[31212]: pgmap v8408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:44.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15595.350191 secs 2024-04-21T14:44:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:46.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:46 smithi077 ceph-mon[27902]: pgmap v8409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:46.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:46 smithi191 ceph-mon[31636]: pgmap v8409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:46.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:46 smithi170 ceph-mon[31212]: pgmap v8409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:47.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15598.589915 secs 2024-04-21T14:44:47.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15598.589915 secs 2024-04-21T14:44:47.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15598.589915 secs 2024-04-21T14:44:48.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:48 smithi077 ceph-mon[27902]: pgmap v8410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:48.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:48 smithi191 ceph-mon[31636]: pgmap v8410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:48.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:48 smithi170 ceph-mon[31212]: pgmap v8410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:49.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15600.350325 secs 2024-04-21T14:44:49.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15600.350325 secs 2024-04-21T14:44:49.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15600.350325 secs 2024-04-21T14:44:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:50.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:50 smithi077 ceph-mon[27902]: pgmap v8411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:50.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:50 smithi191 ceph-mon[31636]: pgmap v8411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:50.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:50 smithi170 ceph-mon[31212]: pgmap v8411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:52.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:52 smithi077 ceph-mon[27902]: pgmap v8412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:52.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15603.590001 secs 2024-04-21T14:44:52.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:52 smithi191 ceph-mon[31636]: pgmap v8412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:52.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15603.590001 secs 2024-04-21T14:44:52.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:52 smithi170 ceph-mon[31212]: pgmap v8412: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:52.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15603.590001 secs 2024-04-21T14:44:54.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:54 smithi077 ceph-mon[27902]: pgmap v8413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:54.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15605.350405 secs 2024-04-21T14:44:54.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:54 smithi191 ceph-mon[31636]: pgmap v8413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:54.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15605.350405 secs 2024-04-21T14:44:54.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:54 smithi170 ceph-mon[31212]: pgmap v8413: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:54.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15605.350405 secs 2024-04-21T14:44:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:44:56.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:56 smithi191 ceph-mon[31636]: pgmap v8414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:56.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:56 smithi170 ceph-mon[31212]: pgmap v8414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:56.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:56 smithi077 ceph-mon[27902]: pgmap v8414: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:44:57.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15608.590110 secs 2024-04-21T14:44:57.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15608.590110 secs 2024-04-21T14:44:57.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15608.590110 secs 2024-04-21T14:44:58.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:58 smithi191 ceph-mon[31636]: pgmap v8415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:58.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:58 smithi170 ceph-mon[31212]: pgmap v8415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:58.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:58 smithi077 ceph-mon[27902]: pgmap v8415: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:44:59.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15610.350524 secs 2024-04-21T14:44:59.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15610.350524 secs 2024-04-21T14:44:59.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15610.350524 secs 2024-04-21T14:45:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:00.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:00 smithi191 ceph-mon[31636]: pgmap v8416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:00.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:00 smithi170 ceph-mon[31212]: pgmap v8416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:00.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:00 smithi077 ceph-mon[27902]: pgmap v8416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:02.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:02 smithi191 ceph-mon[31636]: pgmap v8417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:02.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15613.590226 secs 2024-04-21T14:45:02.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:02 smithi170 ceph-mon[31212]: pgmap v8417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:02.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15613.590226 secs 2024-04-21T14:45:02.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:02 smithi077 ceph-mon[27902]: pgmap v8417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:02.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15613.590226 secs 2024-04-21T14:45:04.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:04 smithi077 ceph-mon[27902]: pgmap v8418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:04.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15615.350602 secs 2024-04-21T14:45:04.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:04 smithi191 ceph-mon[31636]: pgmap v8418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:04.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15615.350602 secs 2024-04-21T14:45:04.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:04 smithi170 ceph-mon[31212]: pgmap v8418: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:04.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15615.350602 secs 2024-04-21T14:45:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:05.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:05 smithi191 ceph-mon[31636]: osdmap e597: 12 total, 12 up, 12 in 2024-04-21T14:45:05.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:05 smithi170 ceph-mon[31212]: osdmap e597: 12 total, 12 up, 12 in 2024-04-21T14:45:05.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:05 smithi077 ceph-mon[27902]: osdmap e597: 12 total, 12 up, 12 in 2024-04-21T14:45:06.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:06 smithi191 ceph-mon[31636]: pgmap v8420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:45:06.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:06 smithi170 ceph-mon[31212]: pgmap v8420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:45:06.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:06 smithi077 ceph-mon[27902]: pgmap v8420: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:45:07.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15618.590356 secs 2024-04-21T14:45:07.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:45:07.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15618.590356 secs 2024-04-21T14:45:07.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:45:07.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15618.590356 secs 2024-04-21T14:45:07.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:45:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:08 smithi191 ceph-mon[31636]: pgmap v8421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:45:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:45:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:45:08.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:45:08.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:08 smithi170 ceph-mon[31212]: pgmap v8421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:45:08.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:45:08.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:45:08.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:45:08.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:08 smithi077 ceph-mon[27902]: pgmap v8421: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:45:08.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:45:08.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:45:08.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:45:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15620.350727 secs 2024-04-21T14:45:09.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15620.350727 secs 2024-04-21T14:45:09.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15620.350727 secs 2024-04-21T14:45:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:10 smithi191 ceph-mon[31636]: pgmap v8422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:45:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:10 smithi191 ceph-mon[31636]: osdmap e598: 12 total, 12 up, 12 in 2024-04-21T14:45:10.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:10 smithi170 ceph-mon[31212]: pgmap v8422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:45:10.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:10 smithi170 ceph-mon[31212]: osdmap e598: 12 total, 12 up, 12 in 2024-04-21T14:45:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:10 smithi077 ceph-mon[27902]: pgmap v8422: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:45:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:10 smithi077 ceph-mon[27902]: osdmap e598: 12 total, 12 up, 12 in 2024-04-21T14:45:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:12 smithi191 ceph-mon[31636]: pgmap v8424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:45:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15623.590490 secs 2024-04-21T14:45:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:12 smithi170 ceph-mon[31212]: pgmap v8424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:45:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15623.590490 secs 2024-04-21T14:45:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:12 smithi077 ceph-mon[27902]: pgmap v8424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:45:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15623.590490 secs 2024-04-21T14:45:14.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:14 smithi191 ceph-mon[31636]: pgmap v8425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:45:14.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15625.350892 secs 2024-04-21T14:45:14.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:14 smithi170 ceph-mon[31212]: pgmap v8425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:45:14.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15625.350892 secs 2024-04-21T14:45:14.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:14 smithi077 ceph-mon[27902]: pgmap v8425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T14:45:14.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15625.350892 secs 2024-04-21T14:45:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:16.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:16 smithi191 ceph-mon[31636]: pgmap v8426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:45:16.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:16 smithi170 ceph-mon[31212]: pgmap v8426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:45:16.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:16 smithi077 ceph-mon[27902]: pgmap v8426: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:45:17.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15628.590551 secs 2024-04-21T14:45:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15628.590551 secs 2024-04-21T14:45:17.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15628.590551 secs 2024-04-21T14:45:18.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:18 smithi191 ceph-mon[31636]: pgmap v8427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:45:18.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:18 smithi170 ceph-mon[31212]: pgmap v8427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:45:18.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:18 smithi077 ceph-mon[27902]: pgmap v8427: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:45:19.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15630.351008 secs 2024-04-21T14:45:19.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15630.351008 secs 2024-04-21T14:45:19.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15630.351008 secs 2024-04-21T14:45:20.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:20.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:20 smithi191 ceph-mon[31636]: pgmap v8428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:45:20.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:20 smithi170 ceph-mon[31212]: pgmap v8428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:45:20.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:20 smithi077 ceph-mon[27902]: pgmap v8428: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:45:22.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:22 smithi191 ceph-mon[31636]: pgmap v8429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:45:22.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15633.590673 secs 2024-04-21T14:45:22.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:22 smithi170 ceph-mon[31212]: pgmap v8429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:45:22.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15633.590673 secs 2024-04-21T14:45:22.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:22 smithi077 ceph-mon[27902]: pgmap v8429: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:45:22.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15633.590673 secs 2024-04-21T14:45:24.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:24 smithi170 ceph-mon[31212]: pgmap v8430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:24.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15635.351105 secs 2024-04-21T14:45:24.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:24 smithi077 ceph-mon[27902]: pgmap v8430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:24.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15635.351105 secs 2024-04-21T14:45:24.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:24 smithi191 ceph-mon[31636]: pgmap v8430: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:24.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15635.351105 secs 2024-04-21T14:45:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:26.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:26 smithi170 ceph-mon[31212]: pgmap v8431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:26.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:26 smithi077 ceph-mon[27902]: pgmap v8431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:26.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:26 smithi191 ceph-mon[31636]: pgmap v8431: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:27.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:27 smithi170 ceph-mon[31212]: pgmap v8432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:27.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15638.590821 secs 2024-04-21T14:45:27.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:27 smithi077 ceph-mon[27902]: pgmap v8432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:27.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15638.590821 secs 2024-04-21T14:45:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:27 smithi191 ceph-mon[31636]: pgmap v8432: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15638.590821 secs 2024-04-21T14:45:28.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15640.351233 secs 2024-04-21T14:45:28.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15640.351233 secs 2024-04-21T14:45:28.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15640.351233 secs 2024-04-21T14:45:29.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:29 smithi170 ceph-mon[31212]: pgmap v8433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:29.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:29 smithi077 ceph-mon[27902]: pgmap v8433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:29.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:29 smithi191 ceph-mon[31636]: pgmap v8433: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:30.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:32.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:31 smithi170 ceph-mon[31212]: pgmap v8434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:32.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:31 smithi077 ceph-mon[27902]: pgmap v8434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:32.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:31 smithi191 ceph-mon[31636]: pgmap v8434: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:33.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15643.590950 secs 2024-04-21T14:45:33.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15643.590950 secs 2024-04-21T14:45:33.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15643.590950 secs 2024-04-21T14:45:34.010 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:33 smithi077 ceph-mon[27902]: pgmap v8435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:34.011 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15645.351362 secs 2024-04-21T14:45:34.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:33 smithi170 ceph-mon[31212]: pgmap v8435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:34.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15645.351362 secs 2024-04-21T14:45:34.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:33 smithi191 ceph-mon[31636]: pgmap v8435: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:34.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15645.351362 secs 2024-04-21T14:45:35.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:36.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:35 smithi170 ceph-mon[31212]: pgmap v8436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:36.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:35 smithi077 ceph-mon[27902]: pgmap v8436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:36.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:35 smithi191 ceph-mon[31636]: pgmap v8436: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:37.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15648.591074 secs 2024-04-21T14:45:37.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15648.591074 secs 2024-04-21T14:45:37.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15648.591074 secs 2024-04-21T14:45:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:37 smithi170 ceph-mon[31212]: pgmap v8437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:38.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:37 smithi077 ceph-mon[27902]: pgmap v8437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:38.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:37 smithi191 ceph-mon[31636]: pgmap v8437: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:39.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15650.351488 secs 2024-04-21T14:45:39.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15650.351488 secs 2024-04-21T14:45:39.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15650.351488 secs 2024-04-21T14:45:40.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:39 smithi170 ceph-mon[31212]: pgmap v8438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:40.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:40.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:39 smithi077 ceph-mon[27902]: pgmap v8438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:40.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:39 smithi191 ceph-mon[31636]: pgmap v8438: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:42.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:41 smithi170 ceph-mon[31212]: pgmap v8439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:42.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15653.591135 secs 2024-04-21T14:45:42.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:41 smithi077 ceph-mon[27902]: pgmap v8439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:42.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15653.591135 secs 2024-04-21T14:45:42.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:41 smithi191 ceph-mon[31636]: pgmap v8439: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:42.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15653.591135 secs 2024-04-21T14:45:44.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:43 smithi170 ceph-mon[31212]: pgmap v8440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:44.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15655.351611 secs 2024-04-21T14:45:44.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:43 smithi077 ceph-mon[27902]: pgmap v8440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:44.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15655.351611 secs 2024-04-21T14:45:44.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:43 smithi191 ceph-mon[31636]: pgmap v8440: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:44.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15655.351611 secs 2024-04-21T14:45:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:46.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:45 smithi170 ceph-mon[31212]: pgmap v8441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:46.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:45 smithi077 ceph-mon[27902]: pgmap v8441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:46.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:45 smithi191 ceph-mon[31636]: pgmap v8441: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:47.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15658.591212 secs 2024-04-21T14:45:47.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15658.591212 secs 2024-04-21T14:45:47.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15658.591212 secs 2024-04-21T14:45:48.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:47 smithi170 ceph-mon[31212]: pgmap v8442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:48.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:47 smithi077 ceph-mon[27902]: pgmap v8442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:48.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:47 smithi191 ceph-mon[31636]: pgmap v8442: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:49.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15660.351720 secs 2024-04-21T14:45:49.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15660.351720 secs 2024-04-21T14:45:49.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15660.351720 secs 2024-04-21T14:45:50.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:49 smithi170 ceph-mon[31212]: pgmap v8443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:50.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:50.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:49 smithi077 ceph-mon[27902]: pgmap v8443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:50.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:49 smithi191 ceph-mon[31636]: pgmap v8443: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:52.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:51 smithi170 ceph-mon[31212]: pgmap v8444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:52.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15663.591322 secs 2024-04-21T14:45:52.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:51 smithi077 ceph-mon[27902]: pgmap v8444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:52.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15663.591322 secs 2024-04-21T14:45:52.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:51 smithi191 ceph-mon[31636]: pgmap v8444: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:52.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15663.591322 secs 2024-04-21T14:45:54.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:53 smithi170 ceph-mon[31212]: pgmap v8445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:54.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15665.351839 secs 2024-04-21T14:45:54.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:53 smithi077 ceph-mon[27902]: pgmap v8445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:54.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15665.351839 secs 2024-04-21T14:45:54.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:53 smithi191 ceph-mon[31636]: pgmap v8445: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:54.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15665.351839 secs 2024-04-21T14:45:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:45:56.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:55 smithi170 ceph-mon[31212]: pgmap v8446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:56.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:55 smithi077 ceph-mon[27902]: pgmap v8446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:56.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:55 smithi191 ceph-mon[31636]: pgmap v8446: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:45:57.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15668.591454 secs 2024-04-21T14:45:57.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15668.591454 secs 2024-04-21T14:45:57.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15668.591454 secs 2024-04-21T14:45:58.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:57 smithi077 ceph-mon[27902]: pgmap v8447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:58.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:57 smithi191 ceph-mon[31636]: pgmap v8447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:58.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:57 smithi170 ceph-mon[31212]: pgmap v8447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:45:59.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15670.351993 secs 2024-04-21T14:45:59.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15670.351993 secs 2024-04-21T14:45:59.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15670.351993 secs 2024-04-21T14:46:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:00.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:45:59 smithi077 ceph-mon[27902]: pgmap v8448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:00.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:45:59 smithi191 ceph-mon[31636]: pgmap v8448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:00.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:45:59 smithi170 ceph-mon[31212]: pgmap v8448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:02.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:01 smithi077 ceph-mon[27902]: pgmap v8449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:02.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15673.591591 secs 2024-04-21T14:46:02.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:01 smithi191 ceph-mon[31636]: pgmap v8449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:02.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15673.591591 secs 2024-04-21T14:46:02.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:01 smithi170 ceph-mon[31212]: pgmap v8449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:02.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15673.591591 secs 2024-04-21T14:46:04.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:03 smithi077 ceph-mon[27902]: pgmap v8450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:04.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15675.352110 secs 2024-04-21T14:46:04.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:03 smithi191 ceph-mon[31636]: pgmap v8450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:04.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15675.352110 secs 2024-04-21T14:46:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:03 smithi170 ceph-mon[31212]: pgmap v8450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:04.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15675.352110 secs 2024-04-21T14:46:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:05.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:04 smithi077 ceph-mon[27902]: osdmap e599: 12 total, 12 up, 12 in 2024-04-21T14:46:05.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:04 smithi191 ceph-mon[31636]: osdmap e599: 12 total, 12 up, 12 in 2024-04-21T14:46:05.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:04 smithi170 ceph-mon[31212]: osdmap e599: 12 total, 12 up, 12 in 2024-04-21T14:46:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:05 smithi077 ceph-mon[27902]: pgmap v8452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:46:06.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:05 smithi191 ceph-mon[31636]: pgmap v8452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:46:06.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:05 smithi170 ceph-mon[31212]: pgmap v8452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:46:07.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15678.591676 secs 2024-04-21T14:46:07.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15678.591676 secs 2024-04-21T14:46:07.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15678.591676 secs 2024-04-21T14:46:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:07 smithi077 ceph-mon[27902]: pgmap v8453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:46:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:46:08.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:07 smithi191 ceph-mon[31636]: pgmap v8453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:46:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:46:08.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:07 smithi170 ceph-mon[31212]: pgmap v8453: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:46:08.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:46:09.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:46:09.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:46:09.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:46:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15680.352230 secs 2024-04-21T14:46:09.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:46:09.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:46:09.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:46:09.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15680.352230 secs 2024-04-21T14:46:09.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:46:09.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:46:09.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:46:09.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15680.352230 secs 2024-04-21T14:46:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:10.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:10 smithi170 ceph-mon[31212]: pgmap v8454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:46:10.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:10 smithi170 ceph-mon[31212]: osdmap e600: 12 total, 12 up, 12 in 2024-04-21T14:46:10.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:10 smithi077 ceph-mon[27902]: pgmap v8454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:46:10.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:10 smithi077 ceph-mon[27902]: osdmap e600: 12 total, 12 up, 12 in 2024-04-21T14:46:10.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:10 smithi191 ceph-mon[31636]: pgmap v8454: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:46:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:10 smithi191 ceph-mon[31636]: osdmap e600: 12 total, 12 up, 12 in 2024-04-21T14:46:12.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:12 smithi170 ceph-mon[31212]: pgmap v8456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:46:12.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15683.591796 secs 2024-04-21T14:46:12.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:12 smithi077 ceph-mon[27902]: pgmap v8456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:46:12.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15683.591796 secs 2024-04-21T14:46:12.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:12 smithi191 ceph-mon[31636]: pgmap v8456: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:46:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15683.591796 secs 2024-04-21T14:46:14.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:14 smithi077 ceph-mon[27902]: pgmap v8457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:46:14.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15685.352299 secs 2024-04-21T14:46:14.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:14 smithi191 ceph-mon[31636]: pgmap v8457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:46:14.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15685.352299 secs 2024-04-21T14:46:14.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:14 smithi170 ceph-mon[31212]: pgmap v8457: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:46:14.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15685.352299 secs 2024-04-21T14:46:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:16.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:16 smithi077 ceph-mon[27902]: pgmap v8458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:46:16.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:16 smithi191 ceph-mon[31636]: pgmap v8458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:46:16.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:16 smithi170 ceph-mon[31212]: pgmap v8458: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:46:17.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15688.591930 secs 2024-04-21T14:46:17.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15688.591930 secs 2024-04-21T14:46:17.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15688.591930 secs 2024-04-21T14:46:18.609 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:18 smithi077 ceph-mon[27902]: pgmap v8459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:46:18.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:18 smithi191 ceph-mon[31636]: pgmap v8459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:46:18.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:18 smithi170 ceph-mon[31212]: pgmap v8459: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:46:19.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15690.352430 secs 2024-04-21T14:46:19.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15690.352430 secs 2024-04-21T14:46:19.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15690.352430 secs 2024-04-21T14:46:20.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:20.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:20 smithi077 ceph-mon[27902]: pgmap v8460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:46:20.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:20 smithi191 ceph-mon[31636]: pgmap v8460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:46:20.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:20 smithi170 ceph-mon[31212]: pgmap v8460: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:46:22.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:22 smithi077 ceph-mon[27902]: pgmap v8461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:46:22.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15693.592046 secs 2024-04-21T14:46:22.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:22 smithi191 ceph-mon[31636]: pgmap v8461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:46:22.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15693.592046 secs 2024-04-21T14:46:22.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:22 smithi170 ceph-mon[31212]: pgmap v8461: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:46:22.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15693.592046 secs 2024-04-21T14:46:24.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:24 smithi077 ceph-mon[27902]: pgmap v8462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:24.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15695.352532 secs 2024-04-21T14:46:24.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:24 smithi191 ceph-mon[31636]: pgmap v8462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:24.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15695.352532 secs 2024-04-21T14:46:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:24 smithi170 ceph-mon[31212]: pgmap v8462: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15695.352532 secs 2024-04-21T14:46:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:26.580 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:26 smithi170 ceph-mon[31212]: pgmap v8463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:26.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:26 smithi077 ceph-mon[27902]: pgmap v8463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:26.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:26 smithi191 ceph-mon[31636]: pgmap v8463: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:27.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15698.592123 secs 2024-04-21T14:46:27.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15698.592123 secs 2024-04-21T14:46:27.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15698.592123 secs 2024-04-21T14:46:28.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:28 smithi077 ceph-mon[27902]: pgmap v8464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:28.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:28 smithi191 ceph-mon[31636]: pgmap v8464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:28.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:28 smithi170 ceph-mon[31212]: pgmap v8464: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:29.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15700.352597 secs 2024-04-21T14:46:29.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15700.352597 secs 2024-04-21T14:46:29.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15700.352597 secs 2024-04-21T14:46:30.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:30.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:30 smithi077 ceph-mon[27902]: pgmap v8465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:30 smithi191 ceph-mon[31636]: pgmap v8465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:30 smithi170 ceph-mon[31212]: pgmap v8465: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:32.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:32 smithi077 ceph-mon[27902]: pgmap v8466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:32.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15703.592239 secs 2024-04-21T14:46:32.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:32 smithi191 ceph-mon[31636]: pgmap v8466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:32.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15703.592239 secs 2024-04-21T14:46:32.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:32 smithi170 ceph-mon[31212]: pgmap v8466: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:32.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15703.592239 secs 2024-04-21T14:46:34.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:34 smithi077 ceph-mon[27902]: pgmap v8467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:34.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15705.352717 secs 2024-04-21T14:46:34.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:34 smithi191 ceph-mon[31636]: pgmap v8467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:34.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15705.352717 secs 2024-04-21T14:46:34.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:34 smithi170 ceph-mon[31212]: pgmap v8467: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:34.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15705.352717 secs 2024-04-21T14:46:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:36.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:36 smithi077 ceph-mon[27902]: pgmap v8468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:36.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:36 smithi191 ceph-mon[31636]: pgmap v8468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:36.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:36 smithi170 ceph-mon[31212]: pgmap v8468: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:37.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15708.592328 secs 2024-04-21T14:46:37.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15708.592328 secs 2024-04-21T14:46:37.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15708.592328 secs 2024-04-21T14:46:38.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:38 smithi077 ceph-mon[27902]: pgmap v8469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:38.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:38 smithi191 ceph-mon[31636]: pgmap v8469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:38.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:38 smithi170 ceph-mon[31212]: pgmap v8469: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:39.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15710.352833 secs 2024-04-21T14:46:39.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15710.352833 secs 2024-04-21T14:46:39.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15710.352833 secs 2024-04-21T14:46:40.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:40.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:40 smithi077 ceph-mon[27902]: pgmap v8470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:40.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:40 smithi191 ceph-mon[31636]: pgmap v8470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:40.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:40 smithi170 ceph-mon[31212]: pgmap v8470: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:42.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:42 smithi077 ceph-mon[27902]: pgmap v8471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:42.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15713.592468 secs 2024-04-21T14:46:42.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:42 smithi191 ceph-mon[31636]: pgmap v8471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:42.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15713.592468 secs 2024-04-21T14:46:42.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:42 smithi170 ceph-mon[31212]: pgmap v8471: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:42.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15713.592468 secs 2024-04-21T14:46:44.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:44 smithi077 ceph-mon[27902]: pgmap v8472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:44.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15715.352927 secs 2024-04-21T14:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:44 smithi191 ceph-mon[31636]: pgmap v8472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15715.352927 secs 2024-04-21T14:46:44.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:44 smithi170 ceph-mon[31212]: pgmap v8472: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:44.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15715.352927 secs 2024-04-21T14:46:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:46.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:46 smithi077 ceph-mon[27902]: pgmap v8473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:46.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:46 smithi191 ceph-mon[31636]: pgmap v8473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:46.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:46 smithi170 ceph-mon[31212]: pgmap v8473: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:47.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15718.592603 secs 2024-04-21T14:46:47.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15718.592603 secs 2024-04-21T14:46:47.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15718.592603 secs 2024-04-21T14:46:48.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:48 smithi191 ceph-mon[31636]: pgmap v8474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:48.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:48 smithi170 ceph-mon[31212]: pgmap v8474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:48.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:48 smithi077 ceph-mon[27902]: pgmap v8474: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:49.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15720.353040 secs 2024-04-21T14:46:49.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15720.353040 secs 2024-04-21T14:46:49.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15720.353040 secs 2024-04-21T14:46:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:50.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:50 smithi191 ceph-mon[31636]: pgmap v8475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:50.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:50 smithi170 ceph-mon[31212]: pgmap v8475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:50.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:50 smithi077 ceph-mon[27902]: pgmap v8475: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:52.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:52 smithi191 ceph-mon[31636]: pgmap v8476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:52.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15723.592729 secs 2024-04-21T14:46:52.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:52 smithi170 ceph-mon[31212]: pgmap v8476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:52.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15723.592729 secs 2024-04-21T14:46:52.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:52 smithi077 ceph-mon[27902]: pgmap v8476: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:52.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15723.592729 secs 2024-04-21T14:46:54.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:54 smithi191 ceph-mon[31636]: pgmap v8477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:54.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15725.353169 secs 2024-04-21T14:46:54.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:54 smithi170 ceph-mon[31212]: pgmap v8477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:54.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15725.353169 secs 2024-04-21T14:46:54.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:54 smithi077 ceph-mon[27902]: pgmap v8477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:54.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15725.353169 secs 2024-04-21T14:46:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:46:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:46:56.524+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:46:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:46:56.524+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:46:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:46:56.524+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:46:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:46:56.524+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:46:56.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:56 smithi191 ceph-mon[31636]: pgmap v8478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:56.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:56 smithi170 ceph-mon[31212]: pgmap v8478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:56.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:56 smithi077 ceph-mon[27902]: pgmap v8478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:46:57.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15728.592846 secs 2024-04-21T14:46:57.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15728.592846 secs 2024-04-21T14:46:57.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15728.592846 secs 2024-04-21T14:46:58.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:58 smithi191 ceph-mon[31636]: pgmap v8479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:58.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:58 smithi170 ceph-mon[31212]: pgmap v8479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:58.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:58 smithi077 ceph-mon[27902]: pgmap v8479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:46:59.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15730.353292 secs 2024-04-21T14:46:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15730.353292 secs 2024-04-21T14:46:59.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15730.353292 secs 2024-04-21T14:47:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:00.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:00 smithi191 ceph-mon[31636]: pgmap v8480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:00.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:00 smithi170 ceph-mon[31212]: pgmap v8480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:00.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:00 smithi077 ceph-mon[27902]: pgmap v8480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:02.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:02 smithi191 ceph-mon[31636]: pgmap v8481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-04-21T14:47:02.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15733.592966 secs 2024-04-21T14:47:02.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:02 smithi170 ceph-mon[31212]: pgmap v8481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-04-21T14:47:02.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15733.592966 secs 2024-04-21T14:47:02.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:02 smithi077 ceph-mon[27902]: pgmap v8481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-04-21T14:47:02.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15733.592966 secs 2024-04-21T14:47:04.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:04 smithi191 ceph-mon[31636]: pgmap v8482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-04-21T14:47:04.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15735.353410 secs 2024-04-21T14:47:04.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:04 smithi170 ceph-mon[31212]: pgmap v8482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-04-21T14:47:04.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15735.353410 secs 2024-04-21T14:47:04.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:04 smithi077 ceph-mon[27902]: pgmap v8482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-04-21T14:47:04.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15735.353410 secs 2024-04-21T14:47:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:05.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:05 smithi191 ceph-mon[31636]: osdmap e601: 12 total, 12 up, 12 in 2024-04-21T14:47:05.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:05 smithi170 ceph-mon[31212]: osdmap e601: 12 total, 12 up, 12 in 2024-04-21T14:47:05.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:05 smithi077 ceph-mon[27902]: osdmap e601: 12 total, 12 up, 12 in 2024-04-21T14:47:06.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:06 smithi191 ceph-mon[31636]: pgmap v8484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 24 op/s 2024-04-21T14:47:06.758 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:06 smithi077 ceph-mon[27902]: pgmap v8484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 24 op/s 2024-04-21T14:47:06.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:06 smithi170 ceph-mon[31212]: pgmap v8484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 24 op/s 2024-04-21T14:47:07.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15738.593084 secs 2024-04-21T14:47:07.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15738.593084 secs 2024-04-21T14:47:07.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15738.593084 secs 2024-04-21T14:47:08.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:08 smithi191 ceph-mon[31636]: pgmap v8485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:47:08.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:47:08.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:08 smithi170 ceph-mon[31212]: pgmap v8485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:47:08.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:47:08.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:08 smithi077 ceph-mon[27902]: pgmap v8485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:47:08.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:47:09.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15740.353511 secs 2024-04-21T14:47:09.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15740.353511 secs 2024-04-21T14:47:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15740.353511 secs 2024-04-21T14:47:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:10.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: pgmap v8486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:47:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: pgmap v8486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:47:10.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: pgmap v8486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:10.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:11.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:47:11.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:47:11.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:47:11.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:47:11.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:11.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:47:11.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:47:12.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:47:12.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:47:12.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: pgmap v8487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:47:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:47:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:47:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:47:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15743.593201 secs 2024-04-21T14:47:12.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: pgmap v8487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:47:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15743.593201 secs 2024-04-21T14:47:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:47:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:47:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: pgmap v8487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:47:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:47:12.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:47:12.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:47:12.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15743.593201 secs 2024-04-21T14:47:14.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:14 smithi191 ceph-mon[31636]: pgmap v8488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:14.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15745.353650 secs 2024-04-21T14:47:14.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:14 smithi170 ceph-mon[31212]: pgmap v8488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:14.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15745.353650 secs 2024-04-21T14:47:14.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:14 smithi077 ceph-mon[27902]: pgmap v8488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:14.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15745.353650 secs 2024-04-21T14:47:15.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:15.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:15 smithi191 ceph-mon[31636]: osdmap e602: 12 total, 12 up, 12 in 2024-04-21T14:47:15.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:15 smithi191 ceph-mon[31636]: pgmap v8490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:16.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:15 smithi170 ceph-mon[31212]: osdmap e602: 12 total, 12 up, 12 in 2024-04-21T14:47:16.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:15 smithi170 ceph-mon[31212]: pgmap v8490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:16.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:15 smithi077 ceph-mon[27902]: osdmap e602: 12 total, 12 up, 12 in 2024-04-21T14:47:16.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:15 smithi077 ceph-mon[27902]: pgmap v8490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-04-21T14:47:17.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15748.593314 secs 2024-04-21T14:47:17.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15748.593314 secs 2024-04-21T14:47:17.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15748.593314 secs 2024-04-21T14:47:18.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:17 smithi077 ceph-mon[27902]: pgmap v8491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:47:18.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:17 smithi191 ceph-mon[31636]: pgmap v8491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:47:18.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:17 smithi170 ceph-mon[31212]: pgmap v8491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:47:19.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15750.353795 secs 2024-04-21T14:47:19.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15750.353795 secs 2024-04-21T14:47:19.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15750.353795 secs 2024-04-21T14:47:20.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:20.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:19 smithi077 ceph-mon[27902]: pgmap v8492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:47:20.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:19 smithi191 ceph-mon[31636]: pgmap v8492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:47:20.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:19 smithi170 ceph-mon[31212]: pgmap v8492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:47:22.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:21 smithi077 ceph-mon[27902]: pgmap v8493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:22.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15753.593448 secs 2024-04-21T14:47:22.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:21 smithi191 ceph-mon[31636]: pgmap v8493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:22.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15753.593448 secs 2024-04-21T14:47:22.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:21 smithi170 ceph-mon[31212]: pgmap v8493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:22.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15753.593448 secs 2024-04-21T14:47:24.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:23 smithi077 ceph-mon[27902]: pgmap v8494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:24.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15755.353877 secs 2024-04-21T14:47:24.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:23 smithi191 ceph-mon[31636]: pgmap v8494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:24.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15755.353877 secs 2024-04-21T14:47:24.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:23 smithi170 ceph-mon[31212]: pgmap v8494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:24.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15755.353877 secs 2024-04-21T14:47:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:26.079 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:25 smithi170 ceph-mon[31212]: pgmap v8495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:26.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:25 smithi077 ceph-mon[27902]: pgmap v8495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:26.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:25 smithi191 ceph-mon[31636]: pgmap v8495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:47:27.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15758.593566 secs 2024-04-21T14:47:27.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15758.593566 secs 2024-04-21T14:47:27.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15758.593566 secs 2024-04-21T14:47:28.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:27 smithi077 ceph-mon[27902]: pgmap v8496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:28.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:27 smithi191 ceph-mon[31636]: pgmap v8496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:28.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:27 smithi170 ceph-mon[31212]: pgmap v8496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:29.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15760.353996 secs 2024-04-21T14:47:29.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15760.353996 secs 2024-04-21T14:47:29.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15760.353996 secs 2024-04-21T14:47:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:30.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:29 smithi077 ceph-mon[27902]: pgmap v8497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:30.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:29 smithi191 ceph-mon[31636]: pgmap v8497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:30.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:29 smithi170 ceph-mon[31212]: pgmap v8497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:32.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:31 smithi077 ceph-mon[27902]: pgmap v8498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:32.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15763.593685 secs 2024-04-21T14:47:32.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:31 smithi191 ceph-mon[31636]: pgmap v8498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:32.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15763.593685 secs 2024-04-21T14:47:32.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:31 smithi170 ceph-mon[31212]: pgmap v8498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:32.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15763.593685 secs 2024-04-21T14:47:34.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:33 smithi077 ceph-mon[27902]: pgmap v8499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:34.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15765.354116 secs 2024-04-21T14:47:34.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:33 smithi191 ceph-mon[31636]: pgmap v8499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:34.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15765.354116 secs 2024-04-21T14:47:34.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:33 smithi170 ceph-mon[31212]: pgmap v8499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:34.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15765.354116 secs 2024-04-21T14:47:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:36.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:35 smithi077 ceph-mon[27902]: pgmap v8500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:36.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:35 smithi191 ceph-mon[31636]: pgmap v8500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:36.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:35 smithi170 ceph-mon[31212]: pgmap v8500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:37.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15768.593834 secs 2024-04-21T14:47:37.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15768.593834 secs 2024-04-21T14:47:37.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15768.593834 secs 2024-04-21T14:47:38.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:37 smithi077 ceph-mon[27902]: pgmap v8501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:38.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:37 smithi191 ceph-mon[31636]: pgmap v8501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:38.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:37 smithi170 ceph-mon[31212]: pgmap v8501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:39.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15770.354207 secs 2024-04-21T14:47:39.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15770.354207 secs 2024-04-21T14:47:39.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15770.354207 secs 2024-04-21T14:47:40.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:40.151 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:39 smithi077 ceph-mon[27902]: pgmap v8502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:40.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:39 smithi191 ceph-mon[31636]: pgmap v8502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:40.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:39 smithi170 ceph-mon[31212]: pgmap v8502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:42.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:41 smithi191 ceph-mon[31636]: pgmap v8503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:42.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15773.593913 secs 2024-04-21T14:47:42.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:41 smithi170 ceph-mon[31212]: pgmap v8503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15773.593913 secs 2024-04-21T14:47:42.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:41 smithi077 ceph-mon[27902]: pgmap v8503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:42.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15773.593913 secs 2024-04-21T14:47:44.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:43 smithi191 ceph-mon[31636]: pgmap v8504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:44.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15775.354287 secs 2024-04-21T14:47:44.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:43 smithi170 ceph-mon[31212]: pgmap v8504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:44.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15775.354287 secs 2024-04-21T14:47:44.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:43 smithi077 ceph-mon[27902]: pgmap v8504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:44.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15775.354287 secs 2024-04-21T14:47:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:46.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:45 smithi191 ceph-mon[31636]: pgmap v8505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:46.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:45 smithi170 ceph-mon[31212]: pgmap v8505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:46.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:45 smithi077 ceph-mon[27902]: pgmap v8505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:47.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15778.593990 secs 2024-04-21T14:47:47.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15778.593990 secs 2024-04-21T14:47:47.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15778.593990 secs 2024-04-21T14:47:48.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:47 smithi191 ceph-mon[31636]: pgmap v8506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:48.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:47 smithi170 ceph-mon[31212]: pgmap v8506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:48.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:47 smithi077 ceph-mon[27902]: pgmap v8506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:49.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15780.354362 secs 2024-04-21T14:47:49.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15780.354362 secs 2024-04-21T14:47:49.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15780.354362 secs 2024-04-21T14:47:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:50.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:49 smithi191 ceph-mon[31636]: pgmap v8507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:50.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:49 smithi170 ceph-mon[31212]: pgmap v8507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:50.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:49 smithi077 ceph-mon[27902]: pgmap v8507: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:52.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:51 smithi191 ceph-mon[31636]: pgmap v8508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:52.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15783.594052 secs 2024-04-21T14:47:52.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:51 smithi170 ceph-mon[31212]: pgmap v8508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:52.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15783.594052 secs 2024-04-21T14:47:52.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:51 smithi077 ceph-mon[27902]: pgmap v8508: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:52.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15783.594052 secs 2024-04-21T14:47:54.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:53 smithi191 ceph-mon[31636]: pgmap v8509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:54.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15785.354497 secs 2024-04-21T14:47:54.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:53 smithi170 ceph-mon[31212]: pgmap v8509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:54.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15785.354497 secs 2024-04-21T14:47:54.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:53 smithi077 ceph-mon[27902]: pgmap v8509: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:54.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15785.354497 secs 2024-04-21T14:47:55.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:47:56.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:55 smithi191 ceph-mon[31636]: pgmap v8510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:56.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:55 smithi170 ceph-mon[31212]: pgmap v8510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:56.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:55 smithi077 ceph-mon[27902]: pgmap v8510: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:47:57.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15788.594162 secs 2024-04-21T14:47:57.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15788.594162 secs 2024-04-21T14:47:57.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15788.594162 secs 2024-04-21T14:47:58.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:57 smithi191 ceph-mon[31636]: pgmap v8511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:58.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:57 smithi170 ceph-mon[31212]: pgmap v8511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:58.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:57 smithi077 ceph-mon[27902]: pgmap v8511: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:47:59.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15790.354640 secs 2024-04-21T14:47:59.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15790.354640 secs 2024-04-21T14:47:59.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15790.354640 secs 2024-04-21T14:48:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:00.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:47:59 smithi191 ceph-mon[31636]: pgmap v8512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:00.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:47:59 smithi170 ceph-mon[31212]: pgmap v8512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:00.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:47:59 smithi077 ceph-mon[27902]: pgmap v8512: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:02.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:01 smithi191 ceph-mon[31636]: pgmap v8513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T14:48:02.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15793.594286 secs 2024-04-21T14:48:02.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:01 smithi170 ceph-mon[31212]: pgmap v8513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T14:48:02.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15793.594286 secs 2024-04-21T14:48:02.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:01 smithi077 ceph-mon[27902]: pgmap v8513: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T14:48:02.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15793.594286 secs 2024-04-21T14:48:04.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:03 smithi191 ceph-mon[31636]: pgmap v8514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-21T14:48:04.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15795.354772 secs 2024-04-21T14:48:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:03 smithi170 ceph-mon[31212]: pgmap v8514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-21T14:48:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15795.354772 secs 2024-04-21T14:48:04.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:03 smithi077 ceph-mon[27902]: pgmap v8514: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-21T14:48:04.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15795.354772 secs 2024-04-21T14:48:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:05.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:04 smithi191 ceph-mon[31636]: osdmap e603: 12 total, 12 up, 12 in 2024-04-21T14:48:05.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:04 smithi170 ceph-mon[31212]: osdmap e603: 12 total, 12 up, 12 in 2024-04-21T14:48:05.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:04 smithi077 ceph-mon[27902]: osdmap e603: 12 total, 12 up, 12 in 2024-04-21T14:48:06.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:05 smithi191 ceph-mon[31636]: pgmap v8516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 7 op/s 2024-04-21T14:48:06.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:05 smithi170 ceph-mon[31212]: pgmap v8516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 7 op/s 2024-04-21T14:48:06.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:05 smithi077 ceph-mon[27902]: pgmap v8516: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 7 op/s 2024-04-21T14:48:07.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15798.594372 secs 2024-04-21T14:48:07.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15798.594372 secs 2024-04-21T14:48:07.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15798.594372 secs 2024-04-21T14:48:08.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:07 smithi191 ceph-mon[31636]: pgmap v8517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:48:08.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:07 smithi170 ceph-mon[31212]: pgmap v8517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:48:08.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:07 smithi077 ceph-mon[27902]: pgmap v8517: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:48:09.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15800.354888 secs 2024-04-21T14:48:09.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15800.354888 secs 2024-04-21T14:48:09.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15800.354888 secs 2024-04-21T14:48:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:10.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:09 smithi191 ceph-mon[31636]: pgmap v8518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:48:10.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:09 smithi191 ceph-mon[31636]: osdmap e604: 12 total, 12 up, 12 in 2024-04-21T14:48:10.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:09 smithi170 ceph-mon[31212]: pgmap v8518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:48:10.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:09 smithi170 ceph-mon[31212]: osdmap e604: 12 total, 12 up, 12 in 2024-04-21T14:48:10.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:09 smithi077 ceph-mon[27902]: pgmap v8518: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:48:10.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:09 smithi077 ceph-mon[27902]: osdmap e604: 12 total, 12 up, 12 in 2024-04-21T14:48:11.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:48:11.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:48:11.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:48:12.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: pgmap v8520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T14:48:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15803.594479 secs 2024-04-21T14:48:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:48:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:48:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: pgmap v8520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T14:48:12.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15803.594479 secs 2024-04-21T14:48:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:48:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:48:12.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: pgmap v8520: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15803.594479 secs 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:48:12.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:48:14.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:14 smithi191 ceph-mon[31636]: pgmap v8521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-04-21T14:48:14.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15805.355012 secs 2024-04-21T14:48:14.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:14 smithi170 ceph-mon[31212]: pgmap v8521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-04-21T14:48:14.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15805.355012 secs 2024-04-21T14:48:14.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:14 smithi077 ceph-mon[27902]: pgmap v8521: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-04-21T14:48:14.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15805.355012 secs 2024-04-21T14:48:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:16.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:16 smithi191 ceph-mon[31636]: pgmap v8522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T14:48:16.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:16 smithi170 ceph-mon[31212]: pgmap v8522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T14:48:16.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:16 smithi077 ceph-mon[27902]: pgmap v8522: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T14:48:17.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15808.594620 secs 2024-04-21T14:48:17.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15808.594620 secs 2024-04-21T14:48:17.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15808.594620 secs 2024-04-21T14:48:18.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:18 smithi191 ceph-mon[31636]: pgmap v8523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:48:18.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:18 smithi170 ceph-mon[31212]: pgmap v8523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:48:18.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:18 smithi077 ceph-mon[27902]: pgmap v8523: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:48:19.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15810.355124 secs 2024-04-21T14:48:19.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15810.355124 secs 2024-04-21T14:48:19.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15810.355124 secs 2024-04-21T14:48:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 15995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:20.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:20 smithi191 ceph-mon[31636]: pgmap v8524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:48:20.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:20 smithi170 ceph-mon[31212]: pgmap v8524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:48:20.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:20 smithi077 ceph-mon[27902]: pgmap v8524: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:48:22.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:22 smithi191 ceph-mon[31636]: pgmap v8525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:48:22.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15813.594788 secs 2024-04-21T14:48:22.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:22 smithi170 ceph-mon[31212]: pgmap v8525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:48:22.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15813.594788 secs 2024-04-21T14:48:22.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:22 smithi077 ceph-mon[27902]: pgmap v8525: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:48:22.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15813.594788 secs 2024-04-21T14:48:24.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:24 smithi191 ceph-mon[31636]: pgmap v8526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:24.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15815.355243 secs 2024-04-21T14:48:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:24 smithi170 ceph-mon[31212]: pgmap v8526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15815.355243 secs 2024-04-21T14:48:24.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:24 smithi077 ceph-mon[27902]: pgmap v8526: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:24.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15815.355243 secs 2024-04-21T14:48:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:26.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:26 smithi191 ceph-mon[31636]: pgmap v8527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:26.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:26 smithi170 ceph-mon[31212]: pgmap v8527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:26.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:26 smithi077 ceph-mon[27902]: pgmap v8527: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:27.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15818.594874 secs 2024-04-21T14:48:27.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15818.594874 secs 2024-04-21T14:48:27.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15818.594874 secs 2024-04-21T14:48:28.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:28 smithi191 ceph-mon[31636]: pgmap v8528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:28.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:28 smithi170 ceph-mon[31212]: pgmap v8528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:28.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:28 smithi077 ceph-mon[27902]: pgmap v8528: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:29.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15820.355361 secs 2024-04-21T14:48:29.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15820.355361 secs 2024-04-21T14:48:29.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15820.355361 secs 2024-04-21T14:48:30.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:30 smithi191 ceph-mon[31636]: pgmap v8529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:30 smithi170 ceph-mon[31212]: pgmap v8529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:30.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:30 smithi077 ceph-mon[27902]: pgmap v8529: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:32 smithi191 ceph-mon[31636]: pgmap v8530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15823.594995 secs 2024-04-21T14:48:32.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:32 smithi170 ceph-mon[31212]: pgmap v8530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:32.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15823.594995 secs 2024-04-21T14:48:32.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:32 smithi077 ceph-mon[27902]: pgmap v8530: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:32.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15823.594995 secs 2024-04-21T14:48:34.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:34 smithi191 ceph-mon[31636]: pgmap v8531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:34.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15825.355480 secs 2024-04-21T14:48:34.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:34 smithi170 ceph-mon[31212]: pgmap v8531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:34.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15825.355480 secs 2024-04-21T14:48:34.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:34 smithi077 ceph-mon[27902]: pgmap v8531: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:34.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15825.355480 secs 2024-04-21T14:48:35.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:36.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:36 smithi191 ceph-mon[31636]: pgmap v8532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:36.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:36 smithi170 ceph-mon[31212]: pgmap v8532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:36.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:36 smithi077 ceph-mon[27902]: pgmap v8532: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:37.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15828.595081 secs 2024-04-21T14:48:37.756 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15828.595081 secs 2024-04-21T14:48:37.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15828.595081 secs 2024-04-21T14:48:38.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:38 smithi191 ceph-mon[31636]: pgmap v8533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:38.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:38 smithi170 ceph-mon[31212]: pgmap v8533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:38.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:38 smithi077 ceph-mon[27902]: pgmap v8533: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:39.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15830.355596 secs 2024-04-21T14:48:39.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15830.355596 secs 2024-04-21T14:48:39.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15830.355596 secs 2024-04-21T14:48:40.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:40.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:40 smithi170 ceph-mon[31212]: pgmap v8534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:40.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:40 smithi077 ceph-mon[27902]: pgmap v8534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:40.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:40 smithi191 ceph-mon[31636]: pgmap v8534: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:42.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:42 smithi170 ceph-mon[31212]: pgmap v8535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:42.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15833.595192 secs 2024-04-21T14:48:42.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:42 smithi077 ceph-mon[27902]: pgmap v8535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:42.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15833.595192 secs 2024-04-21T14:48:42.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:42 smithi191 ceph-mon[31636]: pgmap v8535: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:42.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15833.595192 secs 2024-04-21T14:48:44.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:44 smithi170 ceph-mon[31212]: pgmap v8536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:44.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15835.355718 secs 2024-04-21T14:48:44.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:44 smithi077 ceph-mon[27902]: pgmap v8536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:44.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15835.355718 secs 2024-04-21T14:48:44.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:44 smithi191 ceph-mon[31636]: pgmap v8536: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:44.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15835.355718 secs 2024-04-21T14:48:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:46.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:46 smithi170 ceph-mon[31212]: pgmap v8537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:46.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:46 smithi077 ceph-mon[27902]: pgmap v8537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:46.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:46 smithi191 ceph-mon[31636]: pgmap v8537: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:47.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15838.595315 secs 2024-04-21T14:48:47.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15838.595315 secs 2024-04-21T14:48:47.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15838.595315 secs 2024-04-21T14:48:48.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:48 smithi170 ceph-mon[31212]: pgmap v8538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:48.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:48 smithi077 ceph-mon[27902]: pgmap v8538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:48.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:48 smithi191 ceph-mon[31636]: pgmap v8538: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:49.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15840.355789 secs 2024-04-21T14:48:49.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15840.355789 secs 2024-04-21T14:48:49.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15840.355789 secs 2024-04-21T14:48:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:50.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:50 smithi170 ceph-mon[31212]: pgmap v8539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:50.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:50 smithi077 ceph-mon[27902]: pgmap v8539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:50.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:50 smithi191 ceph-mon[31636]: pgmap v8539: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:52.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:52 smithi170 ceph-mon[31212]: pgmap v8540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:52.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15843.595434 secs 2024-04-21T14:48:52.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:52 smithi077 ceph-mon[27902]: pgmap v8540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:52.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15843.595434 secs 2024-04-21T14:48:52.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:52 smithi191 ceph-mon[31636]: pgmap v8540: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:52.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15843.595434 secs 2024-04-21T14:48:54.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:54 smithi191 ceph-mon[31636]: pgmap v8541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:54.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15845.355918 secs 2024-04-21T14:48:54.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:54 smithi170 ceph-mon[31212]: pgmap v8541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:54.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15845.355918 secs 2024-04-21T14:48:54.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:54 smithi077 ceph-mon[27902]: pgmap v8541: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:54.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15845.355918 secs 2024-04-21T14:48:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:48:56.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:56 smithi170 ceph-mon[31212]: pgmap v8542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:56.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:56 smithi077 ceph-mon[27902]: pgmap v8542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:56.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:56 smithi191 ceph-mon[31636]: pgmap v8542: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:57.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15848.595545 secs 2024-04-21T14:48:57.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15848.595545 secs 2024-04-21T14:48:57.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15848.595545 secs 2024-04-21T14:48:58.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:58 smithi170 ceph-mon[31212]: pgmap v8543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:58.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:58 smithi077 ceph-mon[27902]: pgmap v8543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:58.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:58 smithi191 ceph-mon[31636]: pgmap v8543: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:48:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15850.356031 secs 2024-04-21T14:48:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:48:59 smithi170 ceph-mon[31212]: pgmap v8544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:59.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15850.356031 secs 2024-04-21T14:48:59.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:48:59 smithi077 ceph-mon[27902]: pgmap v8544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:48:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15850.356031 secs 2024-04-21T14:48:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:48:59 smithi191 ceph-mon[31636]: pgmap v8544: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:02.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:01 smithi077 ceph-mon[27902]: pgmap v8545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:02.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15853.595625 secs 2024-04-21T14:49:02.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:01 smithi191 ceph-mon[31636]: pgmap v8545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:02.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15853.595625 secs 2024-04-21T14:49:02.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:01 smithi170 ceph-mon[31212]: pgmap v8545: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:02.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15853.595625 secs 2024-04-21T14:49:04.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:03 smithi077 ceph-mon[27902]: pgmap v8546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:04.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15855.356128 secs 2024-04-21T14:49:04.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:03 smithi191 ceph-mon[31636]: pgmap v8546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:04.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15855.356128 secs 2024-04-21T14:49:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:03 smithi170 ceph-mon[31212]: pgmap v8546: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15855.356128 secs 2024-04-21T14:49:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:05.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:04 smithi077 ceph-mon[27902]: osdmap e605: 12 total, 12 up, 12 in 2024-04-21T14:49:05.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:04 smithi191 ceph-mon[31636]: osdmap e605: 12 total, 12 up, 12 in 2024-04-21T14:49:05.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:04 smithi170 ceph-mon[31212]: osdmap e605: 12 total, 12 up, 12 in 2024-04-21T14:49:06.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:05 smithi077 ceph-mon[27902]: pgmap v8548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:49:06.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:05 smithi191 ceph-mon[31636]: pgmap v8548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:49:06.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:05 smithi170 ceph-mon[31212]: pgmap v8548: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:49:07.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15858.595783 secs 2024-04-21T14:49:07.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15858.595783 secs 2024-04-21T14:49:07.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15858.595783 secs 2024-04-21T14:49:08.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:07 smithi077 ceph-mon[27902]: pgmap v8549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:49:08.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:07 smithi191 ceph-mon[31636]: pgmap v8549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:49:08.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:07 smithi170 ceph-mon[31212]: pgmap v8549: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:49:09.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15860.356244 secs 2024-04-21T14:49:09.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15860.356244 secs 2024-04-21T14:49:09.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15860.356244 secs 2024-04-21T14:49:10.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:10.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:09 smithi077 ceph-mon[27902]: pgmap v8550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:49:10.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:09 smithi077 ceph-mon[27902]: osdmap e606: 12 total, 12 up, 12 in 2024-04-21T14:49:10.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:09 smithi191 ceph-mon[31636]: pgmap v8550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:49:10.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:09 smithi191 ceph-mon[31636]: osdmap e606: 12 total, 12 up, 12 in 2024-04-21T14:49:10.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:09 smithi170 ceph-mon[31212]: pgmap v8550: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:49:10.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:09 smithi170 ceph-mon[31212]: osdmap e606: 12 total, 12 up, 12 in 2024-04-21T14:49:12.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:11 smithi077 ceph-mon[27902]: pgmap v8552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:49:12.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15863.595846 secs 2024-04-21T14:49:12.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:11 smithi191 ceph-mon[31636]: pgmap v8552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:49:12.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15863.595846 secs 2024-04-21T14:49:12.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:11 smithi170 ceph-mon[31212]: pgmap v8552: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:49:12.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15863.595846 secs 2024-04-21T14:49:13.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:49:13.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:49:13.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:49:13.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:13.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:14.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:13 smithi077 ceph-mon[27902]: pgmap v8553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:49:14.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:49:14.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:49:14.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:14.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15865.356381 secs 2024-04-21T14:49:14.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:13 smithi191 ceph-mon[31636]: pgmap v8553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:49:14.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:49:14.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:49:14.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:14.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15865.356381 secs 2024-04-21T14:49:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:13 smithi170 ceph-mon[31212]: pgmap v8553: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:49:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:49:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:49:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:49:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15865.356381 secs 2024-04-21T14:49:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:15 smithi077 ceph-mon[27902]: pgmap v8554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:49:16.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:15 smithi191 ceph-mon[31636]: pgmap v8554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:49:16.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:15 smithi170 ceph-mon[31212]: pgmap v8554: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:49:17.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15868.595934 secs 2024-04-21T14:49:17.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15868.595934 secs 2024-04-21T14:49:17.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15868.595934 secs 2024-04-21T14:49:18.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:17 smithi077 ceph-mon[27902]: pgmap v8555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:49:18.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:17 smithi191 ceph-mon[31636]: pgmap v8555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:49:18.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:17 smithi170 ceph-mon[31212]: pgmap v8555: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:49:19.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15870.356476 secs 2024-04-21T14:49:19.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15870.356476 secs 2024-04-21T14:49:19.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15870.356476 secs 2024-04-21T14:49:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:20.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:19 smithi077 ceph-mon[27902]: pgmap v8556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:49:20.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:19 smithi191 ceph-mon[31636]: pgmap v8556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:49:20.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:19 smithi170 ceph-mon[31212]: pgmap v8556: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:49:22.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:21 smithi077 ceph-mon[27902]: pgmap v8557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:49:22.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15873.596033 secs 2024-04-21T14:49:22.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:21 smithi191 ceph-mon[31636]: pgmap v8557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:49:22.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15873.596033 secs 2024-04-21T14:49:22.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:21 smithi170 ceph-mon[31212]: pgmap v8557: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:49:22.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15873.596033 secs 2024-04-21T14:49:24.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:23 smithi077 ceph-mon[27902]: pgmap v8558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:24.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15875.356550 secs 2024-04-21T14:49:24.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:23 smithi191 ceph-mon[31636]: pgmap v8558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:24.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15875.356550 secs 2024-04-21T14:49:24.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:23 smithi170 ceph-mon[31212]: pgmap v8558: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:24.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15875.356550 secs 2024-04-21T14:49:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:26.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:25 smithi077 ceph-mon[27902]: pgmap v8559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:26.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:25 smithi191 ceph-mon[31636]: pgmap v8559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:26.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:25 smithi170 ceph-mon[31212]: pgmap v8559: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:27.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15878.596099 secs 2024-04-21T14:49:27.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15878.596099 secs 2024-04-21T14:49:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15878.596099 secs 2024-04-21T14:49:28.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:27 smithi077 ceph-mon[27902]: pgmap v8560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:28.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:27 smithi191 ceph-mon[31636]: pgmap v8560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:28.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:27 smithi170 ceph-mon[31212]: pgmap v8560: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:29.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15880.356666 secs 2024-04-21T14:49:29.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15880.356666 secs 2024-04-21T14:49:29.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15880.356666 secs 2024-04-21T14:49:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:30.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:29 smithi191 ceph-mon[31636]: pgmap v8561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:30.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:29 smithi170 ceph-mon[31212]: pgmap v8561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:30.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:29 smithi077 ceph-mon[27902]: pgmap v8561: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:32.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:31 smithi191 ceph-mon[31636]: pgmap v8562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:32.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15883.596220 secs 2024-04-21T14:49:32.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:31 smithi170 ceph-mon[31212]: pgmap v8562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:32.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15883.596220 secs 2024-04-21T14:49:32.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:31 smithi077 ceph-mon[27902]: pgmap v8562: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:32.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15883.596220 secs 2024-04-21T14:49:34.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:33 smithi191 ceph-mon[31636]: pgmap v8563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:34.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15885.356786 secs 2024-04-21T14:49:34.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:33 smithi170 ceph-mon[31212]: pgmap v8563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:34.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15885.356786 secs 2024-04-21T14:49:34.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:33 smithi077 ceph-mon[27902]: pgmap v8563: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:34.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15885.356786 secs 2024-04-21T14:49:35.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:36.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:35 smithi191 ceph-mon[31636]: pgmap v8564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:36.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:35 smithi170 ceph-mon[31212]: pgmap v8564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:36.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:35 smithi077 ceph-mon[27902]: pgmap v8564: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:37.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15888.596340 secs 2024-04-21T14:49:37.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15888.596340 secs 2024-04-21T14:49:37.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15888.596340 secs 2024-04-21T14:49:38.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:37 smithi191 ceph-mon[31636]: pgmap v8565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:38.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:37 smithi170 ceph-mon[31212]: pgmap v8565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:38.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:37 smithi077 ceph-mon[27902]: pgmap v8565: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:39.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15890.356907 secs 2024-04-21T14:49:39.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15890.356907 secs 2024-04-21T14:49:39.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15890.356907 secs 2024-04-21T14:49:40.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:40.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:39 smithi191 ceph-mon[31636]: pgmap v8566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:40.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:39 smithi170 ceph-mon[31212]: pgmap v8566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:40.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:39 smithi077 ceph-mon[27902]: pgmap v8566: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:42.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:41 smithi191 ceph-mon[31636]: pgmap v8567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:42.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15893.596475 secs 2024-04-21T14:49:42.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:41 smithi170 ceph-mon[31212]: pgmap v8567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:42.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15893.596475 secs 2024-04-21T14:49:42.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:41 smithi077 ceph-mon[27902]: pgmap v8567: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:42.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15893.596475 secs 2024-04-21T14:49:44.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:43 smithi191 ceph-mon[31636]: pgmap v8568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:44.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15895.357022 secs 2024-04-21T14:49:44.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:43 smithi170 ceph-mon[31212]: pgmap v8568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:44.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15895.357022 secs 2024-04-21T14:49:44.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:43 smithi077 ceph-mon[27902]: pgmap v8568: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:44.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15895.357022 secs 2024-04-21T14:49:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:46.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:45 smithi191 ceph-mon[31636]: pgmap v8569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:46.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:45 smithi170 ceph-mon[31212]: pgmap v8569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:46.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:45 smithi077 ceph-mon[27902]: pgmap v8569: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:47.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15898.596535 secs 2024-04-21T14:49:47.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15898.596535 secs 2024-04-21T14:49:47.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15898.596535 secs 2024-04-21T14:49:48.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:47 smithi191 ceph-mon[31636]: pgmap v8570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:48.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:47 smithi170 ceph-mon[31212]: pgmap v8570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:48.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:47 smithi077 ceph-mon[27902]: pgmap v8570: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:49.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15900.357145 secs 2024-04-21T14:49:49.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15900.357145 secs 2024-04-21T14:49:49.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15900.357145 secs 2024-04-21T14:49:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:50.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:49 smithi191 ceph-mon[31636]: pgmap v8571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:50.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:49 smithi170 ceph-mon[31212]: pgmap v8571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:50.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:49 smithi077 ceph-mon[27902]: pgmap v8571: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:52.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:51 smithi191 ceph-mon[31636]: pgmap v8572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:52.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15903.596654 secs 2024-04-21T14:49:52.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:51 smithi170 ceph-mon[31212]: pgmap v8572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:52.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15903.596654 secs 2024-04-21T14:49:52.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:51 smithi077 ceph-mon[27902]: pgmap v8572: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:52.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15903.596654 secs 2024-04-21T14:49:54.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:53 smithi191 ceph-mon[31636]: pgmap v8573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:54.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15905.357262 secs 2024-04-21T14:49:54.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:53 smithi170 ceph-mon[31212]: pgmap v8573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:54.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15905.357262 secs 2024-04-21T14:49:54.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:53 smithi077 ceph-mon[27902]: pgmap v8573: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:54.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15905.357262 secs 2024-04-21T14:49:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:49:56.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:55 smithi191 ceph-mon[31636]: pgmap v8574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:56.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:55 smithi170 ceph-mon[31212]: pgmap v8574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:56.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:55 smithi077 ceph-mon[27902]: pgmap v8574: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:49:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:49:56.550+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:49:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:49:56.550+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:49:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:49:56.550+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:49:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:49:56.550+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:49:57.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15908.596782 secs 2024-04-21T14:49:57.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15908.596782 secs 2024-04-21T14:49:57.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15908.596782 secs 2024-04-21T14:49:58.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:57 smithi191 ceph-mon[31636]: pgmap v8575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:58.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:57 smithi170 ceph-mon[31212]: pgmap v8575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:58.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:57 smithi077 ceph-mon[27902]: pgmap v8575: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:49:59.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15910.357387 secs 2024-04-21T14:49:59.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15910.357387 secs 2024-04-21T14:49:59.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15910.357387 secs 2024-04-21T14:50:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:00.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:49:59 smithi191 ceph-mon[31636]: pgmap v8576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:00.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:49:59 smithi170 ceph-mon[31212]: pgmap v8576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:00.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:49:59 smithi077 ceph-mon[27902]: pgmap v8576: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:01.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:50:01.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:50:01.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T14:50:02.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:01 smithi191 ceph-mon[31636]: pgmap v8577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:50:02.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15913.596896 secs 2024-04-21T14:50:02.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:01 smithi170 ceph-mon[31212]: pgmap v8577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:50:02.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15913.596896 secs 2024-04-21T14:50:02.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:01 smithi077 ceph-mon[27902]: pgmap v8577: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T14:50:02.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15913.596896 secs 2024-04-21T14:50:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:03 smithi170 ceph-mon[31212]: pgmap v8578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:50:04.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15915.357506 secs 2024-04-21T14:50:04.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:03 smithi077 ceph-mon[27902]: pgmap v8578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:50:04.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15915.357506 secs 2024-04-21T14:50:04.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:03 smithi191 ceph-mon[31636]: pgmap v8578: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T14:50:04.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15915.357506 secs 2024-04-21T14:50:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:05.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:04 smithi170 ceph-mon[31212]: osdmap e607: 12 total, 12 up, 12 in 2024-04-21T14:50:05.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:04 smithi077 ceph-mon[27902]: osdmap e607: 12 total, 12 up, 12 in 2024-04-21T14:50:05.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:04 smithi191 ceph-mon[31636]: osdmap e607: 12 total, 12 up, 12 in 2024-04-21T14:50:06.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:05 smithi170 ceph-mon[31212]: pgmap v8580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T14:50:06.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:05 smithi077 ceph-mon[27902]: pgmap v8580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T14:50:06.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:05 smithi191 ceph-mon[31636]: pgmap v8580: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T14:50:07.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15918.597007 secs 2024-04-21T14:50:07.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15918.597007 secs 2024-04-21T14:50:07.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15918.597007 secs 2024-04-21T14:50:08.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:07 smithi170 ceph-mon[31212]: pgmap v8581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:08.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:07 smithi077 ceph-mon[27902]: pgmap v8581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:07 smithi191 ceph-mon[31636]: pgmap v8581: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:09.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15920.357624 secs 2024-04-21T14:50:09.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15920.357624 secs 2024-04-21T14:50:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15920.357624 secs 2024-04-21T14:50:10.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:10.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:10 smithi170 ceph-mon[31212]: pgmap v8582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:10.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:10 smithi170 ceph-mon[31212]: osdmap e608: 12 total, 12 up, 12 in 2024-04-21T14:50:10.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:10 smithi077 ceph-mon[27902]: pgmap v8582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:10.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:10 smithi077 ceph-mon[27902]: osdmap e608: 12 total, 12 up, 12 in 2024-04-21T14:50:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:10 smithi191 ceph-mon[31636]: pgmap v8582: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:10 smithi191 ceph-mon[31636]: osdmap e608: 12 total, 12 up, 12 in 2024-04-21T14:50:12.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:12 smithi170 ceph-mon[31212]: pgmap v8584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:50:12.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15923.597121 secs 2024-04-21T14:50:12.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:12 smithi077 ceph-mon[27902]: pgmap v8584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:50:12.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15923.597121 secs 2024-04-21T14:50:12.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:12 smithi191 ceph-mon[31636]: pgmap v8584: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:50:12.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15923.597121 secs 2024-04-21T14:50:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:14 smithi170 ceph-mon[31212]: pgmap v8585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T14:50:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:50:14.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15925.357729 secs 2024-04-21T14:50:14.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:14 smithi077 ceph-mon[27902]: pgmap v8585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T14:50:14.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:50:14.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15925.357729 secs 2024-04-21T14:50:14.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:14 smithi191 ceph-mon[31636]: pgmap v8585: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T14:50:14.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:50:14.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15925.357729 secs 2024-04-21T14:50:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:15.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:50:15.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:50:15.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:50:15.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:50:15.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:50:15.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:50:15.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:50:15.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:50:15.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:50:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:16 smithi191 ceph-mon[31636]: pgmap v8586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:16.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:16 smithi170 ceph-mon[31212]: pgmap v8586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:16.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:16 smithi077 ceph-mon[27902]: pgmap v8586: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:50:17.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15928.597257 secs 2024-04-21T14:50:17.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15928.597257 secs 2024-04-21T14:50:17.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15928.597257 secs 2024-04-21T14:50:18.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:18 smithi191 ceph-mon[31636]: pgmap v8587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:50:18.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:18 smithi170 ceph-mon[31212]: pgmap v8587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:50:18.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:18 smithi077 ceph-mon[27902]: pgmap v8587: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:50:19.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15930.357851 secs 2024-04-21T14:50:19.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15930.357851 secs 2024-04-21T14:50:19.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15930.357851 secs 2024-04-21T14:50:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:20 smithi191 ceph-mon[31636]: pgmap v8588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:50:20.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:20 smithi170 ceph-mon[31212]: pgmap v8588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:50:20.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:20 smithi077 ceph-mon[27902]: pgmap v8588: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:50:22.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:22 smithi191 ceph-mon[31636]: pgmap v8589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:50:22.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15933.597372 secs 2024-04-21T14:50:22.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:22 smithi170 ceph-mon[31212]: pgmap v8589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:50:22.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15933.597372 secs 2024-04-21T14:50:22.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:22 smithi077 ceph-mon[27902]: pgmap v8589: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:50:22.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15933.597372 secs 2024-04-21T14:50:24.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:24 smithi191 ceph-mon[31636]: pgmap v8590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:24.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15935.357953 secs 2024-04-21T14:50:24.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:24 smithi170 ceph-mon[31212]: pgmap v8590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:24.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15935.357953 secs 2024-04-21T14:50:24.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:24 smithi077 ceph-mon[27902]: pgmap v8590: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:24.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15935.357953 secs 2024-04-21T14:50:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:26.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:26 smithi191 ceph-mon[31636]: pgmap v8591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:26.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:26 smithi170 ceph-mon[31212]: pgmap v8591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:26.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:26 smithi077 ceph-mon[27902]: pgmap v8591: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:27.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15938.597486 secs 2024-04-21T14:50:27.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15938.597486 secs 2024-04-21T14:50:27.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15938.597486 secs 2024-04-21T14:50:28.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:28 smithi191 ceph-mon[31636]: pgmap v8592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:28.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:28 smithi170 ceph-mon[31212]: pgmap v8592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:28.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:28 smithi077 ceph-mon[27902]: pgmap v8592: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:29.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15940.358018 secs 2024-04-21T14:50:29.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15940.358018 secs 2024-04-21T14:50:29.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15940.358018 secs 2024-04-21T14:50:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:30.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:30 smithi191 ceph-mon[31636]: pgmap v8593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:30.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:30 smithi170 ceph-mon[31212]: pgmap v8593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:30.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:30 smithi077 ceph-mon[27902]: pgmap v8593: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:32.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:32 smithi191 ceph-mon[31636]: pgmap v8594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:32.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15943.597620 secs 2024-04-21T14:50:32.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:32 smithi170 ceph-mon[31212]: pgmap v8594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:32.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15943.597620 secs 2024-04-21T14:50:32.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:32 smithi077 ceph-mon[27902]: pgmap v8594: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:32.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15943.597620 secs 2024-04-21T14:50:34.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:34 smithi191 ceph-mon[31636]: pgmap v8595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:34.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15945.358139 secs 2024-04-21T14:50:34.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:34 smithi170 ceph-mon[31212]: pgmap v8595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:34.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15945.358139 secs 2024-04-21T14:50:34.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:34 smithi077 ceph-mon[27902]: pgmap v8595: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:34.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15945.358139 secs 2024-04-21T14:50:35.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:36.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:36 smithi191 ceph-mon[31636]: pgmap v8596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:36.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:36 smithi170 ceph-mon[31212]: pgmap v8596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:36.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:36 smithi077 ceph-mon[27902]: pgmap v8596: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:37.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15948.597731 secs 2024-04-21T14:50:37.507 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15948.597731 secs 2024-04-21T14:50:37.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15948.597731 secs 2024-04-21T14:50:38.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:38 smithi191 ceph-mon[31636]: pgmap v8597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:38.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:38 smithi170 ceph-mon[31212]: pgmap v8597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:38.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:38 smithi077 ceph-mon[27902]: pgmap v8597: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:39.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15950.358228 secs 2024-04-21T14:50:39.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15950.358228 secs 2024-04-21T14:50:39.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15950.358228 secs 2024-04-21T14:50:40.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:40 smithi191 ceph-mon[31636]: pgmap v8598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:40.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:40 smithi170 ceph-mon[31212]: pgmap v8598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:40.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:40 smithi077 ceph-mon[27902]: pgmap v8598: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:42.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:42 smithi191 ceph-mon[31636]: pgmap v8599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:42.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15953.597850 secs 2024-04-21T14:50:42.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:42 smithi170 ceph-mon[31212]: pgmap v8599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:42.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15953.597850 secs 2024-04-21T14:50:42.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:42 smithi077 ceph-mon[27902]: pgmap v8599: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:42.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15953.597850 secs 2024-04-21T14:50:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:44 smithi191 ceph-mon[31636]: pgmap v8600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:44.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15955.358344 secs 2024-04-21T14:50:44.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:44 smithi170 ceph-mon[31212]: pgmap v8600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:44.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15955.358344 secs 2024-04-21T14:50:44.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:44 smithi077 ceph-mon[27902]: pgmap v8600: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:44.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15955.358344 secs 2024-04-21T14:50:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:46 smithi191 ceph-mon[31636]: pgmap v8601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:46.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:46 smithi170 ceph-mon[31212]: pgmap v8601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:46.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:46 smithi077 ceph-mon[27902]: pgmap v8601: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:47.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15958.597960 secs 2024-04-21T14:50:47.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15958.597960 secs 2024-04-21T14:50:47.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15958.597960 secs 2024-04-21T14:50:48.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:48 smithi170 ceph-mon[31212]: pgmap v8602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:48.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:48 smithi077 ceph-mon[27902]: pgmap v8602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:48.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:48 smithi191 ceph-mon[31636]: pgmap v8602: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:49.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15960.358428 secs 2024-04-21T14:50:49.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15960.358428 secs 2024-04-21T14:50:49.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15960.358428 secs 2024-04-21T14:50:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:50.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:50 smithi170 ceph-mon[31212]: pgmap v8603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:50.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:50 smithi077 ceph-mon[27902]: pgmap v8603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:50.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:50 smithi191 ceph-mon[31636]: pgmap v8603: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:52.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:52 smithi170 ceph-mon[31212]: pgmap v8604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:52.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15963.598080 secs 2024-04-21T14:50:52.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:52 smithi077 ceph-mon[27902]: pgmap v8604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:52.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15963.598080 secs 2024-04-21T14:50:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:52 smithi191 ceph-mon[31636]: pgmap v8604: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15963.598080 secs 2024-04-21T14:50:54.491 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:54 smithi191 ceph-mon[31636]: pgmap v8605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:54.491 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15965.358545 secs 2024-04-21T14:50:54.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:54 smithi170 ceph-mon[31212]: pgmap v8605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:54.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15965.358545 secs 2024-04-21T14:50:54.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:54 smithi077 ceph-mon[27902]: pgmap v8605: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:54.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15965.358545 secs 2024-04-21T14:50:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:50:56.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:56 smithi170 ceph-mon[31212]: pgmap v8606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:56.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:56 smithi077 ceph-mon[27902]: pgmap v8606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:56.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:56 smithi191 ceph-mon[31636]: pgmap v8606: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:50:57.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15968.598159 secs 2024-04-21T14:50:57.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15968.598159 secs 2024-04-21T14:50:57.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15968.598159 secs 2024-04-21T14:50:58.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:58 smithi170 ceph-mon[31212]: pgmap v8607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:58.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:58 smithi077 ceph-mon[27902]: pgmap v8607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:58.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:58 smithi191 ceph-mon[31636]: pgmap v8607: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:50:59.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:50:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15970.358659 secs 2024-04-21T14:50:59.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:50:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15970.358659 secs 2024-04-21T14:50:59.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:50:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15970.358659 secs 2024-04-21T14:51:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:00.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:00 smithi170 ceph-mon[31212]: pgmap v8608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:00.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:00 smithi077 ceph-mon[27902]: pgmap v8608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:00 smithi191 ceph-mon[31636]: pgmap v8608: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:02.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:02 smithi170 ceph-mon[31212]: pgmap v8609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:02.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15973.598224 secs 2024-04-21T14:51:02.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:02 smithi077 ceph-mon[27902]: pgmap v8609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:02.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15973.598224 secs 2024-04-21T14:51:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:02 smithi191 ceph-mon[31636]: pgmap v8609: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15973.598224 secs 2024-04-21T14:51:04.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:04 smithi170 ceph-mon[31212]: pgmap v8610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:04.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15975.358778 secs 2024-04-21T14:51:04.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:04 smithi077 ceph-mon[27902]: pgmap v8610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:04.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15975.358778 secs 2024-04-21T14:51:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:04 smithi191 ceph-mon[31636]: pgmap v8610: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15975.358778 secs 2024-04-21T14:51:05.098 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:05.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:05 smithi170 ceph-mon[31212]: osdmap e609: 12 total, 12 up, 12 in 2024-04-21T14:51:05.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:05 smithi077 ceph-mon[27902]: osdmap e609: 12 total, 12 up, 12 in 2024-04-21T14:51:05.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:05 smithi191 ceph-mon[31636]: osdmap e609: 12 total, 12 up, 12 in 2024-04-21T14:51:06.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:06 smithi170 ceph-mon[31212]: pgmap v8612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:51:06.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:06 smithi077 ceph-mon[27902]: pgmap v8612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:51:06.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:06 smithi191 ceph-mon[31636]: pgmap v8612: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:51:07.506 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15978.598359 secs 2024-04-21T14:51:07.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15978.598359 secs 2024-04-21T14:51:07.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15978.598359 secs 2024-04-21T14:51:08.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:08 smithi170 ceph-mon[31212]: pgmap v8613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:51:08.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:08 smithi077 ceph-mon[27902]: pgmap v8613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:51:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:08 smithi191 ceph-mon[31636]: pgmap v8613: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:51:09.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15980.358921 secs 2024-04-21T14:51:09.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15980.358921 secs 2024-04-21T14:51:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15980.358921 secs 2024-04-21T14:51:10.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:10.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:10 smithi170 ceph-mon[31212]: pgmap v8614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:51:10.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:10 smithi170 ceph-mon[31212]: osdmap e610: 12 total, 12 up, 12 in 2024-04-21T14:51:10.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:10 smithi077 ceph-mon[27902]: pgmap v8614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:51:10.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:10 smithi077 ceph-mon[27902]: osdmap e610: 12 total, 12 up, 12 in 2024-04-21T14:51:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:10 smithi191 ceph-mon[31636]: pgmap v8614: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:51:10.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:10 smithi191 ceph-mon[31636]: osdmap e610: 12 total, 12 up, 12 in 2024-04-21T14:51:12.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:12 smithi170 ceph-mon[31212]: pgmap v8616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:51:12.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15983.598502 secs 2024-04-21T14:51:12.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:12 smithi077 ceph-mon[27902]: pgmap v8616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:51:12.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15983.598502 secs 2024-04-21T14:51:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:12 smithi191 ceph-mon[31636]: pgmap v8616: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:51:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15983.598502 secs 2024-04-21T14:51:14.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:14 smithi170 ceph-mon[31212]: pgmap v8617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T14:51:14.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15985.359061 secs 2024-04-21T14:51:14.527 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:51:14.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:14 smithi077 ceph-mon[27902]: pgmap v8617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T14:51:14.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15985.359061 secs 2024-04-21T14:51:14.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:51:14.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:14 smithi191 ceph-mon[31636]: pgmap v8617: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T14:51:14.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15985.359061 secs 2024-04-21T14:51:14.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:51:15.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:15.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:51:15.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:51:15.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:51:15.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:51:15.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:51:15.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:51:15.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:51:15.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:51:15.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:51:16.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:16 smithi077 ceph-mon[27902]: pgmap v8618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:51:16.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:16 smithi191 ceph-mon[31636]: pgmap v8618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:51:16.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:16 smithi170 ceph-mon[31212]: pgmap v8618: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:51:17.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15988.598640 secs 2024-04-21T14:51:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15988.598640 secs 2024-04-21T14:51:17.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15988.598640 secs 2024-04-21T14:51:18.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:18 smithi077 ceph-mon[27902]: pgmap v8619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:51:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:18 smithi191 ceph-mon[31636]: pgmap v8619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:51:18.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:18 smithi170 ceph-mon[31212]: pgmap v8619: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:51:19.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15990.359218 secs 2024-04-21T14:51:19.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15990.359218 secs 2024-04-21T14:51:19.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15990.359218 secs 2024-04-21T14:51:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:20.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:20 smithi077 ceph-mon[27902]: pgmap v8620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:51:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:20 smithi191 ceph-mon[31636]: pgmap v8620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:51:20.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:20 smithi170 ceph-mon[31212]: pgmap v8620: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:51:22.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:22 smithi077 ceph-mon[27902]: pgmap v8621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:51:22.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15993.598724 secs 2024-04-21T14:51:22.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:22 smithi191 ceph-mon[31636]: pgmap v8621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:51:22.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15993.598724 secs 2024-04-21T14:51:22.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:22 smithi170 ceph-mon[31212]: pgmap v8621: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:51:22.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15993.598724 secs 2024-04-21T14:51:24.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:24 smithi077 ceph-mon[27902]: pgmap v8622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:24.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 15995.359303 secs 2024-04-21T14:51:24.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:24 smithi191 ceph-mon[31636]: pgmap v8622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:24.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 15995.359303 secs 2024-04-21T14:51:24.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:24 smithi170 ceph-mon[31212]: pgmap v8622: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 15995.359303 secs 2024-04-21T14:51:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:26.579 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:26 smithi170 ceph-mon[31212]: pgmap v8623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:26.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:26 smithi077 ceph-mon[27902]: pgmap v8623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:26.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:26 smithi191 ceph-mon[31636]: pgmap v8623: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:27.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 15998.598844 secs 2024-04-21T14:51:27.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 15998.598844 secs 2024-04-21T14:51:27.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 15998.598844 secs 2024-04-21T14:51:28.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:28 smithi077 ceph-mon[27902]: pgmap v8624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:28.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:28 smithi191 ceph-mon[31636]: pgmap v8624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:28.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:28 smithi170 ceph-mon[31212]: pgmap v8624: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:29.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16000.359424 secs 2024-04-21T14:51:29.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16000.359424 secs 2024-04-21T14:51:29.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16000.359424 secs 2024-04-21T14:51:30.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:30.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:30 smithi077 ceph-mon[27902]: pgmap v8625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:30 smithi191 ceph-mon[31636]: pgmap v8625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:30 smithi170 ceph-mon[31212]: pgmap v8625: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:32.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:32 smithi077 ceph-mon[27902]: pgmap v8626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:32.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16003.598964 secs 2024-04-21T14:51:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:32 smithi191 ceph-mon[31636]: pgmap v8626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16003.598964 secs 2024-04-21T14:51:32.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:32 smithi170 ceph-mon[31212]: pgmap v8626: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:32.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16003.598964 secs 2024-04-21T14:51:34.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:34 smithi077 ceph-mon[27902]: pgmap v8627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:34.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16005.359541 secs 2024-04-21T14:51:34.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:34 smithi191 ceph-mon[31636]: pgmap v8627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:34.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16005.359541 secs 2024-04-21T14:51:34.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:34 smithi170 ceph-mon[31212]: pgmap v8627: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:34.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16005.359541 secs 2024-04-21T14:51:35.098 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:36.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:36 smithi077 ceph-mon[27902]: pgmap v8628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:36.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:36 smithi191 ceph-mon[31636]: pgmap v8628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:36.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:36 smithi170 ceph-mon[31212]: pgmap v8628: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:37.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16008.599108 secs 2024-04-21T14:51:37.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16008.599108 secs 2024-04-21T14:51:37.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16008.599108 secs 2024-04-21T14:51:38.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:38 smithi077 ceph-mon[27902]: pgmap v8629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:38.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:38 smithi191 ceph-mon[31636]: pgmap v8629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:38.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:38 smithi170 ceph-mon[31212]: pgmap v8629: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:39.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16010.359678 secs 2024-04-21T14:51:39.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16010.359678 secs 2024-04-21T14:51:39.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16010.359678 secs 2024-04-21T14:51:40.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:40.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:40 smithi077 ceph-mon[27902]: pgmap v8630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:40 smithi191 ceph-mon[31636]: pgmap v8630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:40.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:40 smithi170 ceph-mon[31212]: pgmap v8630: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:51:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:42 smithi191 ceph-mon[31636]: pgmap v8631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16013.599225 secs 2024-04-21T14:51:42.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:42 smithi170 ceph-mon[31212]: pgmap v8631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:42.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16013.599225 secs 2024-04-21T14:51:42.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:42 smithi077 ceph-mon[27902]: pgmap v8631: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:42.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16013.599225 secs 2024-04-21T14:51:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:44 smithi191 ceph-mon[31636]: pgmap v8632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16015.359795 secs 2024-04-21T14:51:44.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:44 smithi170 ceph-mon[31212]: pgmap v8632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:44.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16015.359795 secs 2024-04-21T14:51:44.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:44 smithi077 ceph-mon[27902]: pgmap v8632: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:44.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16015.359795 secs 2024-04-21T14:51:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:46.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:46 smithi191 ceph-mon[31636]: pgmap v8633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:46.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:46 smithi170 ceph-mon[31212]: pgmap v8633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:46.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:46 smithi077 ceph-mon[27902]: pgmap v8633: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:47.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16018.599370 secs 2024-04-21T14:51:47.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16018.599370 secs 2024-04-21T14:51:47.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16018.599370 secs 2024-04-21T14:51:48.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:48 smithi191 ceph-mon[31636]: pgmap v8634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:48.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:48 smithi170 ceph-mon[31212]: pgmap v8634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:48.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:48 smithi077 ceph-mon[27902]: pgmap v8634: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:49.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16020.359912 secs 2024-04-21T14:51:49.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16020.359912 secs 2024-04-21T14:51:49.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16020.359912 secs 2024-04-21T14:51:50.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:50.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:50 smithi191 ceph-mon[31636]: pgmap v8635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:50.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:50 smithi170 ceph-mon[31212]: pgmap v8635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:50.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:50 smithi077 ceph-mon[27902]: pgmap v8635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:52 smithi191 ceph-mon[31636]: pgmap v8636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16023.599466 secs 2024-04-21T14:51:52.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:52 smithi170 ceph-mon[31212]: pgmap v8636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:52.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16023.599466 secs 2024-04-21T14:51:52.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:52 smithi077 ceph-mon[27902]: pgmap v8636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:52.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16023.599466 secs 2024-04-21T14:51:54.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:54 smithi191 ceph-mon[31636]: pgmap v8637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:54.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16025.360042 secs 2024-04-21T14:51:54.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:54 smithi170 ceph-mon[31212]: pgmap v8637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:54.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16025.360042 secs 2024-04-21T14:51:54.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:54 smithi077 ceph-mon[27902]: pgmap v8637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:54.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16025.360042 secs 2024-04-21T14:51:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:51:56.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:56 smithi191 ceph-mon[31636]: pgmap v8638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:56.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:56 smithi170 ceph-mon[31212]: pgmap v8638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:56.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:56 smithi077 ceph-mon[27902]: pgmap v8638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:51:57.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16028.599530 secs 2024-04-21T14:51:57.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16028.599530 secs 2024-04-21T14:51:57.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16028.599530 secs 2024-04-21T14:51:58.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:58 smithi191 ceph-mon[31636]: pgmap v8639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:58.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:58 smithi170 ceph-mon[31212]: pgmap v8639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:58.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:58 smithi077 ceph-mon[27902]: pgmap v8639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:51:59.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:51:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16030.360130 secs 2024-04-21T14:51:59.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:51:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16030.360130 secs 2024-04-21T14:51:59.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:51:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16030.360130 secs 2024-04-21T14:52:00.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:00 smithi191 ceph-mon[31636]: pgmap v8640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:00.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:00 smithi170 ceph-mon[31212]: pgmap v8640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:00.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:00 smithi077 ceph-mon[27902]: pgmap v8640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:02 smithi191 ceph-mon[31636]: pgmap v8641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16033.599595 secs 2024-04-21T14:52:02.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:02 smithi170 ceph-mon[31212]: pgmap v8641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:02.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16033.599595 secs 2024-04-21T14:52:02.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:02 smithi077 ceph-mon[27902]: pgmap v8641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:02.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16033.599595 secs 2024-04-21T14:52:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:04 smithi191 ceph-mon[31636]: pgmap v8642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:04.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16035.360243 secs 2024-04-21T14:52:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:04 smithi170 ceph-mon[31212]: pgmap v8642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16035.360243 secs 2024-04-21T14:52:04.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:04 smithi077 ceph-mon[27902]: pgmap v8642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:04.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16035.360243 secs 2024-04-21T14:52:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:05.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:05 smithi191 ceph-mon[31636]: osdmap e611: 12 total, 12 up, 12 in 2024-04-21T14:52:05.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:05 smithi170 ceph-mon[31212]: osdmap e611: 12 total, 12 up, 12 in 2024-04-21T14:52:05.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:05 smithi077 ceph-mon[27902]: osdmap e611: 12 total, 12 up, 12 in 2024-04-21T14:52:06.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:06 smithi191 ceph-mon[31636]: pgmap v8644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:06.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:06 smithi170 ceph-mon[31212]: pgmap v8644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:06.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:06 smithi077 ceph-mon[27902]: pgmap v8644: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:07.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16038.599735 secs 2024-04-21T14:52:07.756 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16038.599735 secs 2024-04-21T14:52:07.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16038.599735 secs 2024-04-21T14:52:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:08 smithi191 ceph-mon[31636]: pgmap v8645: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:52:08.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:08 smithi170 ceph-mon[31212]: pgmap v8645: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:52:08.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:08 smithi077 ceph-mon[27902]: pgmap v8645: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:52:09.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16040.360365 secs 2024-04-21T14:52:09.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16040.360365 secs 2024-04-21T14:52:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16040.360365 secs 2024-04-21T14:52:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:10.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:10 smithi170 ceph-mon[31212]: pgmap v8646: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:52:10.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:10 smithi170 ceph-mon[31212]: osdmap e612: 12 total, 12 up, 12 in 2024-04-21T14:52:10.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:10 smithi077 ceph-mon[27902]: pgmap v8646: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:52:10.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:10 smithi077 ceph-mon[27902]: osdmap e612: 12 total, 12 up, 12 in 2024-04-21T14:52:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:10 smithi191 ceph-mon[31636]: pgmap v8646: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:52:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:10 smithi191 ceph-mon[31636]: osdmap e612: 12 total, 12 up, 12 in 2024-04-21T14:52:12.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:12 smithi170 ceph-mon[31212]: pgmap v8648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:52:12.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16043.599859 secs 2024-04-21T14:52:12.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:12 smithi077 ceph-mon[27902]: pgmap v8648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:52:12.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16043.599859 secs 2024-04-21T14:52:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:12 smithi191 ceph-mon[31636]: pgmap v8648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:52:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16043.599859 secs 2024-04-21T14:52:14.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:14 smithi170 ceph-mon[31212]: pgmap v8649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:52:14.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16045.360511 secs 2024-04-21T14:52:14.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:14 smithi077 ceph-mon[27902]: pgmap v8649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:52:14.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16045.360511 secs 2024-04-21T14:52:14.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:14 smithi191 ceph-mon[31636]: pgmap v8649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T14:52:14.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16045.360511 secs 2024-04-21T14:52:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:16.026 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:15 smithi170 ceph-mon[31212]: osdmap e613: 12 total, 12 up, 12 in 2024-04-21T14:52:16.026 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:15 smithi170 ceph-mon[31212]: pgmap v8651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-21T14:52:16.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:52:16.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:52:16.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:52:16.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:52:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:15 smithi077 ceph-mon[27902]: osdmap e613: 12 total, 12 up, 12 in 2024-04-21T14:52:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:15 smithi077 ceph-mon[27902]: pgmap v8651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-21T14:52:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:52:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:52:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:52:16.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:52:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:15 smithi191 ceph-mon[31636]: osdmap e613: 12 total, 12 up, 12 in 2024-04-21T14:52:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:15 smithi191 ceph-mon[31636]: pgmap v8651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-21T14:52:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:52:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:52:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:52:16.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:52:17.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16048.599980 secs 2024-04-21T14:52:17.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16048.599980 secs 2024-04-21T14:52:17.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16048.599980 secs 2024-04-21T14:52:18.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:17 smithi077 ceph-mon[27902]: pgmap v8652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-21T14:52:18.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:17 smithi191 ceph-mon[31636]: pgmap v8652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-21T14:52:18.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:17 smithi170 ceph-mon[31212]: pgmap v8652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-21T14:52:19.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16050.360626 secs 2024-04-21T14:52:19.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16050.360626 secs 2024-04-21T14:52:19.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16050.360626 secs 2024-04-21T14:52:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:20.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:19 smithi077 ceph-mon[27902]: pgmap v8653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 112 B/s wr, 6 op/s 2024-04-21T14:52:20.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:19 smithi191 ceph-mon[31636]: pgmap v8653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 112 B/s wr, 6 op/s 2024-04-21T14:52:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:19 smithi170 ceph-mon[31212]: pgmap v8653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 112 B/s wr, 6 op/s 2024-04-21T14:52:22.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:21 smithi077 ceph-mon[27902]: pgmap v8654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:22.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16053.600050 secs 2024-04-21T14:52:22.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:21 smithi191 ceph-mon[31636]: pgmap v8654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:22.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16053.600050 secs 2024-04-21T14:52:22.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:21 smithi170 ceph-mon[31212]: pgmap v8654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:22.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16053.600050 secs 2024-04-21T14:52:24.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:23 smithi191 ceph-mon[31636]: pgmap v8655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:24.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16055.360770 secs 2024-04-21T14:52:24.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:23 smithi170 ceph-mon[31212]: pgmap v8655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:24.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16055.360770 secs 2024-04-21T14:52:24.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:23 smithi077 ceph-mon[27902]: pgmap v8655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:24.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16055.360770 secs 2024-04-21T14:52:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:26.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:25 smithi191 ceph-mon[31636]: pgmap v8656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:26.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:25 smithi170 ceph-mon[31212]: pgmap v8656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:26.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:25 smithi077 ceph-mon[27902]: pgmap v8656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:52:27.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16058.600171 secs 2024-04-21T14:52:27.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16058.600171 secs 2024-04-21T14:52:27.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16058.600171 secs 2024-04-21T14:52:28.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:27 smithi191 ceph-mon[31636]: pgmap v8657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:28.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:27 smithi170 ceph-mon[31212]: pgmap v8657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:28.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:27 smithi077 ceph-mon[27902]: pgmap v8657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:29.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16060.360884 secs 2024-04-21T14:52:29.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16060.360884 secs 2024-04-21T14:52:29.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16060.360884 secs 2024-04-21T14:52:30.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:30.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:29 smithi191 ceph-mon[31636]: pgmap v8658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:30.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:29 smithi170 ceph-mon[31212]: pgmap v8658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:30.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:29 smithi077 ceph-mon[27902]: pgmap v8658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:32.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:31 smithi191 ceph-mon[31636]: pgmap v8659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:32.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:31 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16063.600292 secs 2024-04-21T14:52:32.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:31 smithi170 ceph-mon[31212]: pgmap v8659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:32.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:31 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16063.600292 secs 2024-04-21T14:52:32.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:31 smithi077 ceph-mon[27902]: pgmap v8659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:32.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:31 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16063.600292 secs 2024-04-21T14:52:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:33 smithi191 ceph-mon[31636]: pgmap v8660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16065.360981 secs 2024-04-21T14:52:34.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:33 smithi170 ceph-mon[31212]: pgmap v8660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:34.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16065.360981 secs 2024-04-21T14:52:34.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:33 smithi077 ceph-mon[27902]: pgmap v8660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:34.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16065.360981 secs 2024-04-21T14:52:35.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:36.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:35 smithi191 ceph-mon[31636]: pgmap v8661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:36.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:35 smithi170 ceph-mon[31212]: pgmap v8661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:36.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:35 smithi077 ceph-mon[27902]: pgmap v8661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:37.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16068.600426 secs 2024-04-21T14:52:37.256 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16068.600426 secs 2024-04-21T14:52:37.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16068.600426 secs 2024-04-21T14:52:38.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:37 smithi191 ceph-mon[31636]: pgmap v8662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:38.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:37 smithi170 ceph-mon[31212]: pgmap v8662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:38.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:37 smithi077 ceph-mon[27902]: pgmap v8662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:39.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16070.361095 secs 2024-04-21T14:52:39.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16070.361095 secs 2024-04-21T14:52:39.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16070.361095 secs 2024-04-21T14:52:40.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:40.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:39 smithi191 ceph-mon[31636]: pgmap v8663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:40.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:39 smithi170 ceph-mon[31212]: pgmap v8663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:40.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:39 smithi077 ceph-mon[27902]: pgmap v8663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:42.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:41 smithi191 ceph-mon[31636]: pgmap v8664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:42.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16073.600570 secs 2024-04-21T14:52:42.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:41 smithi170 ceph-mon[31212]: pgmap v8664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:42.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16073.600570 secs 2024-04-21T14:52:42.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:41 smithi077 ceph-mon[27902]: pgmap v8664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:42.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16073.600570 secs 2024-04-21T14:52:44.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:43 smithi191 ceph-mon[31636]: pgmap v8665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:44.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16075.361215 secs 2024-04-21T14:52:44.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:43 smithi170 ceph-mon[31212]: pgmap v8665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:44.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16075.361215 secs 2024-04-21T14:52:44.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:43 smithi077 ceph-mon[27902]: pgmap v8665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:44.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16075.361215 secs 2024-04-21T14:52:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:46.026 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:45 smithi170 ceph-mon[31212]: pgmap v8666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:46.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:45 smithi077 ceph-mon[27902]: pgmap v8666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:46.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:45 smithi191 ceph-mon[31636]: pgmap v8666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:47.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:46 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16078.600691 secs 2024-04-21T14:52:47.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:46 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16078.600691 secs 2024-04-21T14:52:47.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:46 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16078.600691 secs 2024-04-21T14:52:48.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:47 smithi077 ceph-mon[27902]: pgmap v8667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:48.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:47 smithi191 ceph-mon[31636]: pgmap v8667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:48.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:47 smithi170 ceph-mon[31212]: pgmap v8667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:49.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16080.361279 secs 2024-04-21T14:52:49.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16080.361279 secs 2024-04-21T14:52:49.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16080.361279 secs 2024-04-21T14:52:50.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:50.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:49 smithi191 ceph-mon[31636]: pgmap v8668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:50.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:49 smithi170 ceph-mon[31212]: pgmap v8668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:50.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:49 smithi077 ceph-mon[27902]: pgmap v8668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:52.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:51 smithi191 ceph-mon[31636]: pgmap v8669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:52.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:51 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16083.600820 secs 2024-04-21T14:52:52.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:51 smithi170 ceph-mon[31212]: pgmap v8669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:52.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:51 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16083.600820 secs 2024-04-21T14:52:52.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:51 smithi077 ceph-mon[27902]: pgmap v8669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:52.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:51 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16083.600820 secs 2024-04-21T14:52:54.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:53 smithi191 ceph-mon[31636]: pgmap v8670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:54.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16085.361409 secs 2024-04-21T14:52:54.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:53 smithi170 ceph-mon[31212]: pgmap v8670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:54.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16085.361409 secs 2024-04-21T14:52:54.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:53 smithi077 ceph-mon[27902]: pgmap v8670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:54.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16085.361409 secs 2024-04-21T14:52:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:52:56.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:55 smithi191 ceph-mon[31636]: pgmap v8671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:56.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:55 smithi170 ceph-mon[31212]: pgmap v8671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:56.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:55 smithi077 ceph-mon[27902]: pgmap v8671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:52:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:52:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:52:56.576+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:52:57.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16088.600912 secs 2024-04-21T14:52:57.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16088.600912 secs 2024-04-21T14:52:57.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16088.600912 secs 2024-04-21T14:52:58.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:57 smithi191 ceph-mon[31636]: pgmap v8672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:58.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:57 smithi170 ceph-mon[31212]: pgmap v8672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:58.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:57 smithi077 ceph-mon[27902]: pgmap v8672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:52:59.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16090.361529 secs 2024-04-21T14:52:59.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16090.361529 secs 2024-04-21T14:52:59.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16090.361529 secs 2024-04-21T14:53:00.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:00.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:52:59 smithi191 ceph-mon[31636]: pgmap v8673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:00.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:52:59 smithi170 ceph-mon[31212]: pgmap v8673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:00.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:52:59 smithi077 ceph-mon[27902]: pgmap v8673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:02.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:01 smithi191 ceph-mon[31636]: pgmap v8674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:02.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16093.600977 secs 2024-04-21T14:53:02.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:01 smithi170 ceph-mon[31212]: pgmap v8674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:02.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16093.600977 secs 2024-04-21T14:53:02.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:01 smithi077 ceph-mon[27902]: pgmap v8674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:02.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16093.600977 secs 2024-04-21T14:53:04.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:03 smithi191 ceph-mon[31636]: pgmap v8675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:04.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16095.361650 secs 2024-04-21T14:53:04.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:03 smithi170 ceph-mon[31212]: pgmap v8675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:04.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16095.361650 secs 2024-04-21T14:53:04.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:03 smithi077 ceph-mon[27902]: pgmap v8675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:04.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16095.361650 secs 2024-04-21T14:53:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:05.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:04 smithi191 ceph-mon[31636]: osdmap e614: 12 total, 12 up, 12 in 2024-04-21T14:53:05.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:04 smithi170 ceph-mon[31212]: osdmap e614: 12 total, 12 up, 12 in 2024-04-21T14:53:05.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:04 smithi077 ceph-mon[27902]: osdmap e614: 12 total, 12 up, 12 in 2024-04-21T14:53:06.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:05 smithi191 ceph-mon[31636]: pgmap v8677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:53:06.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:05 smithi170 ceph-mon[31212]: pgmap v8677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:53:06.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:05 smithi077 ceph-mon[27902]: pgmap v8677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:53:07.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16098.601082 secs 2024-04-21T14:53:07.256 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16098.601082 secs 2024-04-21T14:53:07.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16098.601082 secs 2024-04-21T14:53:08.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:07 smithi191 ceph-mon[31636]: pgmap v8678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:53:08.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:07 smithi170 ceph-mon[31212]: pgmap v8678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:53:08.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:07 smithi077 ceph-mon[27902]: pgmap v8678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:53:09.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16100.361713 secs 2024-04-21T14:53:09.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16100.361713 secs 2024-04-21T14:53:09.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16100.361713 secs 2024-04-21T14:53:10.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:10.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:09 smithi191 ceph-mon[31636]: pgmap v8679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:53:10.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:09 smithi191 ceph-mon[31636]: osdmap e615: 12 total, 12 up, 12 in 2024-04-21T14:53:10.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:09 smithi170 ceph-mon[31212]: pgmap v8679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:53:10.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:09 smithi170 ceph-mon[31212]: osdmap e615: 12 total, 12 up, 12 in 2024-04-21T14:53:10.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:09 smithi077 ceph-mon[27902]: pgmap v8679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:53:10.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:09 smithi077 ceph-mon[27902]: osdmap e615: 12 total, 12 up, 12 in 2024-04-21T14:53:12.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:11 smithi191 ceph-mon[31636]: pgmap v8681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:53:12.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:11 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16103.601207 secs 2024-04-21T14:53:12.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:11 smithi170 ceph-mon[31212]: pgmap v8681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:53:12.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:11 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16103.601207 secs 2024-04-21T14:53:12.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:11 smithi077 ceph-mon[27902]: pgmap v8681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:53:12.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:11 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16103.601207 secs 2024-04-21T14:53:14.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:13 smithi191 ceph-mon[31636]: pgmap v8682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:53:14.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16105.361832 secs 2024-04-21T14:53:14.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:13 smithi170 ceph-mon[31212]: pgmap v8682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:53:14.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16105.361832 secs 2024-04-21T14:53:14.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:13 smithi077 ceph-mon[27902]: pgmap v8682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:53:14.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16105.361832 secs 2024-04-21T14:53:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:15 smithi191 ceph-mon[31636]: pgmap v8683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:53:16.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:53:16.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:15 smithi170 ceph-mon[31212]: pgmap v8683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:53:16.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:53:16.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:15 smithi077 ceph-mon[27902]: pgmap v8683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:53:16.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:53:17.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16108.601284 secs 2024-04-21T14:53:17.263 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16108.601284 secs 2024-04-21T14:53:17.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16108.601284 secs 2024-04-21T14:53:18.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:17 smithi191 ceph-mon[31636]: pgmap v8684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:53:18.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:17 smithi170 ceph-mon[31212]: pgmap v8684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:53:18.304 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:17 smithi077 ceph-mon[27902]: pgmap v8684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:53:19.254 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16110.361946 secs 2024-04-21T14:53:19.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16110.361946 secs 2024-04-21T14:53:19.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16110.361946 secs 2024-04-21T14:53:20.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:19 smithi170 ceph-mon[31212]: pgmap v8685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:53:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:53:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:53:20.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:19 smithi077 ceph-mon[27902]: pgmap v8685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:53:20.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:53:20.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:53:20.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:19 smithi191 ceph-mon[31636]: pgmap v8685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:53:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:53:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:53:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:53:22.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:21 smithi170 ceph-mon[31212]: pgmap v8686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:53:22.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16113.601348 secs 2024-04-21T14:53:22.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:21 smithi077 ceph-mon[27902]: pgmap v8686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:53:22.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16113.601348 secs 2024-04-21T14:53:22.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:21 smithi191 ceph-mon[31636]: pgmap v8686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:53:22.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16113.601348 secs 2024-04-21T14:53:24.240 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:23 smithi191 ceph-mon[31636]: pgmap v8687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:24.241 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16115.362012 secs 2024-04-21T14:53:24.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:23 smithi170 ceph-mon[31212]: pgmap v8687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:24.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16115.362012 secs 2024-04-21T14:53:24.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:23 smithi077 ceph-mon[27902]: pgmap v8687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:24.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16115.362012 secs 2024-04-21T14:53:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:26.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:25 smithi170 ceph-mon[31212]: pgmap v8688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:26.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:25 smithi077 ceph-mon[27902]: pgmap v8688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:26.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:25 smithi191 ceph-mon[31636]: pgmap v8688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:27.277 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16118.601405 secs 2024-04-21T14:53:27.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16118.601405 secs 2024-04-21T14:53:27.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16118.601405 secs 2024-04-21T14:53:28.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:27 smithi170 ceph-mon[31212]: pgmap v8689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:28.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:27 smithi077 ceph-mon[27902]: pgmap v8689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:27 smithi191 ceph-mon[31636]: pgmap v8689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:29.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16120.362090 secs 2024-04-21T14:53:29.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16120.362090 secs 2024-04-21T14:53:29.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16120.362090 secs 2024-04-21T14:53:30.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:30.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:29 smithi170 ceph-mon[31212]: pgmap v8690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:30.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:29 smithi077 ceph-mon[27902]: pgmap v8690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:30.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:29 smithi191 ceph-mon[31636]: pgmap v8690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:32.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:32 smithi170 ceph-mon[31212]: pgmap v8691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:32.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16123.601523 secs 2024-04-21T14:53:32.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:32 smithi077 ceph-mon[27902]: pgmap v8691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:32.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16123.601523 secs 2024-04-21T14:53:32.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:32 smithi191 ceph-mon[31636]: pgmap v8691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:32.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16123.601523 secs 2024-04-21T14:53:34.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:34 smithi170 ceph-mon[31212]: pgmap v8692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:34.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16125.362164 secs 2024-04-21T14:53:34.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:34 smithi077 ceph-mon[27902]: pgmap v8692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:34.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16125.362164 secs 2024-04-21T14:53:34.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:34 smithi191 ceph-mon[31636]: pgmap v8692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:34.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16125.362164 secs 2024-04-21T14:53:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:36.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:36 smithi170 ceph-mon[31212]: pgmap v8693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:36.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:36 smithi077 ceph-mon[27902]: pgmap v8693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:36.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:36 smithi191 ceph-mon[31636]: pgmap v8693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:37.256 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16128.601635 secs 2024-04-21T14:53:37.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16128.601635 secs 2024-04-21T14:53:37.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16128.601635 secs 2024-04-21T14:53:38.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:38 smithi170 ceph-mon[31212]: pgmap v8694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:38.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:38 smithi077 ceph-mon[27902]: pgmap v8694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:38.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:38 smithi191 ceph-mon[31636]: pgmap v8694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:39.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16130.362260 secs 2024-04-21T14:53:39.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16130.362260 secs 2024-04-21T14:53:39.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16130.362260 secs 2024-04-21T14:53:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:40.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:40 smithi170 ceph-mon[31212]: pgmap v8695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:40.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:40 smithi077 ceph-mon[27902]: pgmap v8695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:40.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:40 smithi191 ceph-mon[31636]: pgmap v8695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:42.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:42 smithi170 ceph-mon[31212]: pgmap v8696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:42.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16133.601751 secs 2024-04-21T14:53:42.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:42 smithi077 ceph-mon[27902]: pgmap v8696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:42.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16133.601751 secs 2024-04-21T14:53:42.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:42 smithi191 ceph-mon[31636]: pgmap v8696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:42.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16133.601751 secs 2024-04-21T14:53:44.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:44 smithi170 ceph-mon[31212]: pgmap v8697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:44.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16135.362402 secs 2024-04-21T14:53:44.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:44 smithi077 ceph-mon[27902]: pgmap v8697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:44.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16135.362402 secs 2024-04-21T14:53:44.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:44 smithi191 ceph-mon[31636]: pgmap v8697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16135.362402 secs 2024-04-21T14:53:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:46.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:46 smithi170 ceph-mon[31212]: pgmap v8698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:46.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:46 smithi077 ceph-mon[27902]: pgmap v8698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:46 smithi191 ceph-mon[31636]: pgmap v8698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:47.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16138.601870 secs 2024-04-21T14:53:47.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16138.601870 secs 2024-04-21T14:53:47.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16138.601870 secs 2024-04-21T14:53:48.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:48 smithi170 ceph-mon[31212]: pgmap v8699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:48.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:48 smithi077 ceph-mon[27902]: pgmap v8699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:48.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:48 smithi191 ceph-mon[31636]: pgmap v8699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:49.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16140.362522 secs 2024-04-21T14:53:49.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16140.362522 secs 2024-04-21T14:53:49.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16140.362522 secs 2024-04-21T14:53:50.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:50.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:50 smithi170 ceph-mon[31212]: pgmap v8700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:50.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:50 smithi077 ceph-mon[27902]: pgmap v8700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:50.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:50 smithi191 ceph-mon[31636]: pgmap v8700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:52.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:52 smithi170 ceph-mon[31212]: pgmap v8701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:52.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16143.601950 secs 2024-04-21T14:53:52.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:52 smithi077 ceph-mon[27902]: pgmap v8701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:52.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16143.601950 secs 2024-04-21T14:53:52.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:52 smithi191 ceph-mon[31636]: pgmap v8701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:52.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16143.601950 secs 2024-04-21T14:53:54.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:54 smithi170 ceph-mon[31212]: pgmap v8702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:54.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16145.362656 secs 2024-04-21T14:53:54.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:54 smithi077 ceph-mon[27902]: pgmap v8702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:54.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16145.362656 secs 2024-04-21T14:53:54.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:54 smithi191 ceph-mon[31636]: pgmap v8702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:54.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16145.362656 secs 2024-04-21T14:53:55.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:53:56.276 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:56 smithi170 ceph-mon[31212]: pgmap v8703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:56.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:56 smithi077 ceph-mon[27902]: pgmap v8703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:56.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:56 smithi191 ceph-mon[31636]: pgmap v8703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:53:57.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16148.602069 secs 2024-04-21T14:53:57.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16148.602069 secs 2024-04-21T14:53:57.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16148.602069 secs 2024-04-21T14:53:58.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:58 smithi077 ceph-mon[27902]: pgmap v8704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:58 smithi191 ceph-mon[31636]: pgmap v8704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:58.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:58 smithi170 ceph-mon[31212]: pgmap v8704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:53:59.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:53:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16150.362777 secs 2024-04-21T14:53:59.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:53:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16150.362777 secs 2024-04-21T14:53:59.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:53:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16150.362777 secs 2024-04-21T14:54:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:00.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:00 smithi077 ceph-mon[27902]: pgmap v8705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:00.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:00 smithi191 ceph-mon[31636]: pgmap v8705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:00.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:00 smithi170 ceph-mon[31212]: pgmap v8705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:02.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:02 smithi077 ceph-mon[27902]: pgmap v8706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:02.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16153.602186 secs 2024-04-21T14:54:02.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:02 smithi191 ceph-mon[31636]: pgmap v8706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:02.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16153.602186 secs 2024-04-21T14:54:02.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:02 smithi170 ceph-mon[31212]: pgmap v8706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:02.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16153.602186 secs 2024-04-21T14:54:04.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:04 smithi077 ceph-mon[27902]: pgmap v8707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:04.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16155.362896 secs 2024-04-21T14:54:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:04 smithi191 ceph-mon[31636]: pgmap v8707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16155.362896 secs 2024-04-21T14:54:04.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:04 smithi170 ceph-mon[31212]: pgmap v8707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:04.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16155.362896 secs 2024-04-21T14:54:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:05.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:05 smithi077 ceph-mon[27902]: osdmap e616: 12 total, 12 up, 12 in 2024-04-21T14:54:05.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:05 smithi191 ceph-mon[31636]: osdmap e616: 12 total, 12 up, 12 in 2024-04-21T14:54:05.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:05 smithi170 ceph-mon[31212]: osdmap e616: 12 total, 12 up, 12 in 2024-04-21T14:54:06.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:06 smithi077 ceph-mon[27902]: pgmap v8709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:54:06.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:06 smithi191 ceph-mon[31636]: pgmap v8709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:54:06.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:06 smithi170 ceph-mon[31212]: pgmap v8709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:54:07.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16158.602322 secs 2024-04-21T14:54:07.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16158.602322 secs 2024-04-21T14:54:07.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16158.602322 secs 2024-04-21T14:54:08.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:08 smithi077 ceph-mon[27902]: pgmap v8710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:54:08.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:08 smithi191 ceph-mon[31636]: pgmap v8710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:54:08.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:08 smithi170 ceph-mon[31212]: pgmap v8710: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:54:09.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16160.363011 secs 2024-04-21T14:54:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16160.363011 secs 2024-04-21T14:54:09.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16160.363011 secs 2024-04-21T14:54:10.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:10.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:10 smithi077 ceph-mon[27902]: pgmap v8711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:54:10.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:10 smithi077 ceph-mon[27902]: osdmap e617: 12 total, 12 up, 12 in 2024-04-21T14:54:10.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:10 smithi191 ceph-mon[31636]: pgmap v8711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:54:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:10 smithi191 ceph-mon[31636]: osdmap e617: 12 total, 12 up, 12 in 2024-04-21T14:54:10.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:10 smithi170 ceph-mon[31212]: pgmap v8711: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:54:10.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:10 smithi170 ceph-mon[31212]: osdmap e617: 12 total, 12 up, 12 in 2024-04-21T14:54:12.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:12 smithi077 ceph-mon[27902]: pgmap v8713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:54:12.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16163.602387 secs 2024-04-21T14:54:12.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:12 smithi191 ceph-mon[31636]: pgmap v8713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:54:12.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16163.602387 secs 2024-04-21T14:54:12.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:12 smithi170 ceph-mon[31212]: pgmap v8713: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:54:12.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16163.602387 secs 2024-04-21T14:54:14.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:14 smithi077 ceph-mon[27902]: pgmap v8714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:54:14.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16165.363127 secs 2024-04-21T14:54:14.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:14 smithi191 ceph-mon[31636]: pgmap v8714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:54:14.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16165.363127 secs 2024-04-21T14:54:14.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:14 smithi170 ceph-mon[31212]: pgmap v8714: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T14:54:14.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16165.363127 secs 2024-04-21T14:54:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:16.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:16 smithi077 ceph-mon[27902]: pgmap v8715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:54:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:16 smithi191 ceph-mon[31636]: pgmap v8715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:54:16.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:16 smithi170 ceph-mon[31212]: pgmap v8715: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:54:17.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16168.602526 secs 2024-04-21T14:54:17.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16168.602526 secs 2024-04-21T14:54:17.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16168.602526 secs 2024-04-21T14:54:18.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:18 smithi077 ceph-mon[27902]: pgmap v8716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:54:18.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:18 smithi191 ceph-mon[31636]: pgmap v8716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:54:18.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:18 smithi170 ceph-mon[31212]: pgmap v8716: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:54:19.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16170.363224 secs 2024-04-21T14:54:19.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16170.363224 secs 2024-04-21T14:54:19.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16170.363224 secs 2024-04-21T14:54:20.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:20.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:20 smithi191 ceph-mon[31636]: pgmap v8717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:54:20.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:20 smithi170 ceph-mon[31212]: pgmap v8717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:54:20.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:20 smithi077 ceph-mon[27902]: pgmap v8717: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:54:21.411 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:54:21.414 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:54:21.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:54:22.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:22 smithi191 ceph-mon[31636]: pgmap v8718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:54:22.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16173.602590 secs 2024-04-21T14:54:22.455 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:22 smithi170 ceph-mon[31212]: pgmap v8718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:54:22.455 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16173.602590 secs 2024-04-21T14:54:22.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:22 smithi077 ceph-mon[27902]: pgmap v8718: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:54:22.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16173.602590 secs 2024-04-21T14:54:24.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:24 smithi170 ceph-mon[31212]: pgmap v8719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:24.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16175.363297 secs 2024-04-21T14:54:24.298 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:24 smithi191 ceph-mon[31636]: pgmap v8719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:24.298 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16175.363297 secs 2024-04-21T14:54:24.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:24 smithi077 ceph-mon[27902]: pgmap v8719: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:24.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16175.363297 secs 2024-04-21T14:54:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:54:25.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:54:25.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:54:25.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:54:25.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:54:26.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:26 smithi170 ceph-mon[31212]: pgmap v8720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:26.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:26 smithi077 ceph-mon[27902]: pgmap v8720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:26.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:26 smithi191 ceph-mon[31636]: pgmap v8720: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:27.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16178.602728 secs 2024-04-21T14:54:27.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16178.602728 secs 2024-04-21T14:54:27.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16178.602728 secs 2024-04-21T14:54:28.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:28 smithi170 ceph-mon[31212]: pgmap v8721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:28.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:28 smithi077 ceph-mon[27902]: pgmap v8721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:28.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:28 smithi191 ceph-mon[31636]: pgmap v8721: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:29.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16180.363387 secs 2024-04-21T14:54:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16180.363387 secs 2024-04-21T14:54:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16180.363387 secs 2024-04-21T14:54:30.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:30.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:30 smithi170 ceph-mon[31212]: pgmap v8722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:30.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:30 smithi077 ceph-mon[27902]: pgmap v8722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:30 smithi191 ceph-mon[31636]: pgmap v8722: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:32.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:32 smithi170 ceph-mon[31212]: pgmap v8723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:32.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16183.602859 secs 2024-04-21T14:54:32.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:32 smithi077 ceph-mon[27902]: pgmap v8723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:32.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16183.602859 secs 2024-04-21T14:54:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:32 smithi191 ceph-mon[31636]: pgmap v8723: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16183.602859 secs 2024-04-21T14:54:34.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:34 smithi170 ceph-mon[31212]: pgmap v8724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:34.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16185.363520 secs 2024-04-21T14:54:34.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:34 smithi077 ceph-mon[27902]: pgmap v8724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:34.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16185.363520 secs 2024-04-21T14:54:34.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:34 smithi191 ceph-mon[31636]: pgmap v8724: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:34.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16185.363520 secs 2024-04-21T14:54:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:36.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:36 smithi170 ceph-mon[31212]: pgmap v8725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:36.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:36 smithi077 ceph-mon[27902]: pgmap v8725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:36 smithi191 ceph-mon[31636]: pgmap v8725: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:37.524 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16188.602980 secs 2024-04-21T14:54:37.525 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16188.602980 secs 2024-04-21T14:54:37.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16188.602980 secs 2024-04-21T14:54:38.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:38 smithi170 ceph-mon[31212]: pgmap v8726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:38.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:38 smithi077 ceph-mon[27902]: pgmap v8726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:38.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:38 smithi191 ceph-mon[31636]: pgmap v8726: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:39.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16190.363653 secs 2024-04-21T14:54:39.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16190.363653 secs 2024-04-21T14:54:39.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16190.363653 secs 2024-04-21T14:54:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:40.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:40 smithi077 ceph-mon[27902]: pgmap v8727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:40 smithi191 ceph-mon[31636]: pgmap v8727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:40.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:40 smithi170 ceph-mon[31212]: pgmap v8727: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:42.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:42 smithi077 ceph-mon[27902]: pgmap v8728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:42.605 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16193.603105 secs 2024-04-21T14:54:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:42 smithi191 ceph-mon[31636]: pgmap v8728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16193.603105 secs 2024-04-21T14:54:42.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:42 smithi170 ceph-mon[31212]: pgmap v8728: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:42.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16193.603105 secs 2024-04-21T14:54:44.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:44 smithi077 ceph-mon[27902]: pgmap v8729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:44.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16195.363800 secs 2024-04-21T14:54:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:44 smithi191 ceph-mon[31636]: pgmap v8729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16195.363800 secs 2024-04-21T14:54:44.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:44 smithi170 ceph-mon[31212]: pgmap v8729: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:44.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16195.363800 secs 2024-04-21T14:54:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:46.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:46 smithi077 ceph-mon[27902]: pgmap v8730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:46.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:46 smithi191 ceph-mon[31636]: pgmap v8730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:46.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:46 smithi170 ceph-mon[31212]: pgmap v8730: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:47.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16198.603163 secs 2024-04-21T14:54:47.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16198.603163 secs 2024-04-21T14:54:47.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16198.603163 secs 2024-04-21T14:54:48.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:48 smithi077 ceph-mon[27902]: pgmap v8731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:48.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:48 smithi191 ceph-mon[31636]: pgmap v8731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:48.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:48 smithi170 ceph-mon[31212]: pgmap v8731: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:49.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16200.363943 secs 2024-04-21T14:54:49.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16200.363943 secs 2024-04-21T14:54:49.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16200.363943 secs 2024-04-21T14:54:50.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:50.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:50 smithi077 ceph-mon[27902]: pgmap v8732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:50.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:50 smithi191 ceph-mon[31636]: pgmap v8732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:50.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:50 smithi170 ceph-mon[31212]: pgmap v8732: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:52.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:52 smithi077 ceph-mon[27902]: pgmap v8733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:52.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16203.603309 secs 2024-04-21T14:54:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:52 smithi191 ceph-mon[31636]: pgmap v8733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16203.603309 secs 2024-04-21T14:54:52.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:52 smithi170 ceph-mon[31212]: pgmap v8733: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:52.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16203.603309 secs 2024-04-21T14:54:54.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:54 smithi077 ceph-mon[27902]: pgmap v8734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:54.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16205.364053 secs 2024-04-21T14:54:54.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:54 smithi191 ceph-mon[31636]: pgmap v8734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:54.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16205.364053 secs 2024-04-21T14:54:54.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:54 smithi170 ceph-mon[31212]: pgmap v8734: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:54.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16205.364053 secs 2024-04-21T14:54:55.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:54:56.578 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:56 smithi170 ceph-mon[31212]: pgmap v8735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:56.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:56 smithi077 ceph-mon[27902]: pgmap v8735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:56.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:56 smithi191 ceph-mon[31636]: pgmap v8735: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:54:57.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16208.603370 secs 2024-04-21T14:54:57.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16208.603370 secs 2024-04-21T14:54:57.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16208.603370 secs 2024-04-21T14:54:58.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:58 smithi077 ceph-mon[27902]: pgmap v8736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:58.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:58 smithi191 ceph-mon[31636]: pgmap v8736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:58.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:58 smithi170 ceph-mon[31212]: pgmap v8736: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:54:59.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:54:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16210.364183 secs 2024-04-21T14:54:59.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:54:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16210.364183 secs 2024-04-21T14:54:59.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:54:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16210.364183 secs 2024-04-21T14:55:00.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:00.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:00 smithi077 ceph-mon[27902]: pgmap v8737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:00.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:00 smithi191 ceph-mon[31636]: pgmap v8737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:00.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:00 smithi170 ceph-mon[31212]: pgmap v8737: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:02.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:02 smithi077 ceph-mon[27902]: pgmap v8738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T14:55:02.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16213.603488 secs 2024-04-21T14:55:02.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:02 smithi191 ceph-mon[31636]: pgmap v8738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T14:55:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16213.603488 secs 2024-04-21T14:55:02.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:02 smithi170 ceph-mon[31212]: pgmap v8738: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T14:55:02.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16213.603488 secs 2024-04-21T14:55:04.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:04 smithi077 ceph-mon[27902]: pgmap v8739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-04-21T14:55:04.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16215.364320 secs 2024-04-21T14:55:04.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:04 smithi191 ceph-mon[31636]: pgmap v8739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-04-21T14:55:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16215.364320 secs 2024-04-21T14:55:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:04 smithi170 ceph-mon[31212]: pgmap v8739: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-04-21T14:55:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16215.364320 secs 2024-04-21T14:55:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:05.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:05 smithi077 ceph-mon[27902]: osdmap e618: 12 total, 12 up, 12 in 2024-04-21T14:55:05.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:05 smithi191 ceph-mon[31636]: osdmap e618: 12 total, 12 up, 12 in 2024-04-21T14:55:05.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:05 smithi170 ceph-mon[31212]: osdmap e618: 12 total, 12 up, 12 in 2024-04-21T14:55:06.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:06 smithi077 ceph-mon[27902]: pgmap v8741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-04-21T14:55:06.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:06 smithi191 ceph-mon[31636]: pgmap v8741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-04-21T14:55:06.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:06 smithi170 ceph-mon[31212]: pgmap v8741: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-04-21T14:55:07.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16218.603632 secs 2024-04-21T14:55:07.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16218.603632 secs 2024-04-21T14:55:07.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16218.603632 secs 2024-04-21T14:55:08.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:08 smithi077 ceph-mon[27902]: pgmap v8742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:55:08.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:08 smithi191 ceph-mon[31636]: pgmap v8742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:55:08.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:08 smithi170 ceph-mon[31212]: pgmap v8742: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:55:09.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16220.364413 secs 2024-04-21T14:55:09.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16220.364413 secs 2024-04-21T14:55:09.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16220.364413 secs 2024-04-21T14:55:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:10.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:10 smithi191 ceph-mon[31636]: pgmap v8743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:55:10.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:10 smithi191 ceph-mon[31636]: osdmap e619: 12 total, 12 up, 12 in 2024-04-21T14:55:10.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:10 smithi170 ceph-mon[31212]: pgmap v8743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:55:10.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:10 smithi170 ceph-mon[31212]: osdmap e619: 12 total, 12 up, 12 in 2024-04-21T14:55:10.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:10 smithi077 ceph-mon[27902]: pgmap v8743: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:55:10.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:10 smithi077 ceph-mon[27902]: osdmap e619: 12 total, 12 up, 12 in 2024-04-21T14:55:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:12 smithi191 ceph-mon[31636]: pgmap v8745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 26 op/s 2024-04-21T14:55:12.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16223.603749 secs 2024-04-21T14:55:12.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:12 smithi170 ceph-mon[31212]: pgmap v8745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 26 op/s 2024-04-21T14:55:12.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16223.603749 secs 2024-04-21T14:55:12.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:12 smithi077 ceph-mon[27902]: pgmap v8745: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 26 op/s 2024-04-21T14:55:12.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16223.603749 secs 2024-04-21T14:55:14.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:14 smithi191 ceph-mon[31636]: pgmap v8746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 25 op/s 2024-04-21T14:55:14.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16225.364526 secs 2024-04-21T14:55:14.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:14 smithi170 ceph-mon[31212]: pgmap v8746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 25 op/s 2024-04-21T14:55:14.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16225.364526 secs 2024-04-21T14:55:14.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:14 smithi077 ceph-mon[27902]: pgmap v8746: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 25 op/s 2024-04-21T14:55:14.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16225.364526 secs 2024-04-21T14:55:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:16.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:16 smithi191 ceph-mon[31636]: pgmap v8747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-04-21T14:55:16.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:16 smithi170 ceph-mon[31212]: pgmap v8747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-04-21T14:55:16.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:16 smithi077 ceph-mon[27902]: pgmap v8747: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 21 op/s 2024-04-21T14:55:17.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16228.603799 secs 2024-04-21T14:55:17.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16228.603799 secs 2024-04-21T14:55:17.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16228.603799 secs 2024-04-21T14:55:18.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:18 smithi191 ceph-mon[31636]: pgmap v8748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:55:18.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:18 smithi170 ceph-mon[31212]: pgmap v8748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:55:18.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:18 smithi077 ceph-mon[27902]: pgmap v8748: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:55:19.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16230.364644 secs 2024-04-21T14:55:19.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16230.364644 secs 2024-04-21T14:55:19.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16230.364644 secs 2024-04-21T14:55:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:20.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:20 smithi191 ceph-mon[31636]: pgmap v8749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:55:20.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:20 smithi170 ceph-mon[31212]: pgmap v8749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:55:20.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:20 smithi077 ceph-mon[27902]: pgmap v8749: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:55:22.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:22 smithi191 ceph-mon[31636]: pgmap v8750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:55:22.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16233.603916 secs 2024-04-21T14:55:22.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:22 smithi170 ceph-mon[31212]: pgmap v8750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:55:22.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16233.603916 secs 2024-04-21T14:55:22.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:22 smithi077 ceph-mon[27902]: pgmap v8750: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:55:22.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16233.603916 secs 2024-04-21T14:55:24.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:24 smithi191 ceph-mon[31636]: pgmap v8751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:24.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16235.364765 secs 2024-04-21T14:55:24.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:24 smithi170 ceph-mon[31212]: pgmap v8751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:24.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16235.364765 secs 2024-04-21T14:55:24.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:24 smithi077 ceph-mon[27902]: pgmap v8751: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:24.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16235.364765 secs 2024-04-21T14:55:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:25.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:55:25.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:55:25.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:55:26.677 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:26 smithi170 ceph-mon[31212]: pgmap v8752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:26.677 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:55:26.677 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:55:26.677 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:55:26.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:26 smithi191 ceph-mon[31636]: pgmap v8752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:26.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:55:26.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:55:26.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:55:26.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:26 smithi077 ceph-mon[27902]: pgmap v8752: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:26.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:55:26.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:55:26.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:55:27.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16238.604034 secs 2024-04-21T14:55:27.693 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16238.604034 secs 2024-04-21T14:55:27.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16238.604034 secs 2024-04-21T14:55:28.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:28 smithi191 ceph-mon[31636]: pgmap v8753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:28.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:28 smithi170 ceph-mon[31212]: pgmap v8753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:28.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:28 smithi077 ceph-mon[27902]: pgmap v8753: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16240.364900 secs 2024-04-21T14:55:29.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16240.364900 secs 2024-04-21T14:55:29.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16240.364900 secs 2024-04-21T14:55:30.097 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:30 smithi191 ceph-mon[31636]: pgmap v8754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:30 smithi170 ceph-mon[31212]: pgmap v8754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:30.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:30 smithi077 ceph-mon[27902]: pgmap v8754: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:32.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:32 smithi191 ceph-mon[31636]: pgmap v8755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16243.604154 secs 2024-04-21T14:55:32.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:32 smithi170 ceph-mon[31212]: pgmap v8755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:32.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16243.604154 secs 2024-04-21T14:55:32.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:32 smithi077 ceph-mon[27902]: pgmap v8755: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:32.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16243.604154 secs 2024-04-21T14:55:34.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:34 smithi191 ceph-mon[31636]: pgmap v8756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:34.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16245.365017 secs 2024-04-21T14:55:34.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:34 smithi170 ceph-mon[31212]: pgmap v8756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:34.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16245.365017 secs 2024-04-21T14:55:34.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:34 smithi077 ceph-mon[27902]: pgmap v8756: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:34.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16245.365017 secs 2024-04-21T14:55:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:36 smithi191 ceph-mon[31636]: pgmap v8757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:36.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:36 smithi170 ceph-mon[31212]: pgmap v8757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:36.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:36 smithi077 ceph-mon[27902]: pgmap v8757: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:37.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16248.604228 secs 2024-04-21T14:55:37.755 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16248.604228 secs 2024-04-21T14:55:37.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16248.604228 secs 2024-04-21T14:55:38.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:38 smithi191 ceph-mon[31636]: pgmap v8758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:38.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:38 smithi170 ceph-mon[31212]: pgmap v8758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:38.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:38 smithi077 ceph-mon[27902]: pgmap v8758: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:39.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16250.365157 secs 2024-04-21T14:55:39.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16250.365157 secs 2024-04-21T14:55:39.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16250.365157 secs 2024-04-21T14:55:40.097 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:40.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:40 smithi170 ceph-mon[31212]: pgmap v8759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:40.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:40 smithi077 ceph-mon[27902]: pgmap v8759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:40 smithi191 ceph-mon[31636]: pgmap v8759: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:42.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:42 smithi170 ceph-mon[31212]: pgmap v8760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:42.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16253.604365 secs 2024-04-21T14:55:42.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:42 smithi077 ceph-mon[27902]: pgmap v8760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:42.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16253.604365 secs 2024-04-21T14:55:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:42 smithi191 ceph-mon[31636]: pgmap v8760: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16253.604365 secs 2024-04-21T14:55:44.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:44 smithi170 ceph-mon[31212]: pgmap v8761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:44.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16255.365285 secs 2024-04-21T14:55:44.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:44 smithi077 ceph-mon[27902]: pgmap v8761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:44.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16255.365285 secs 2024-04-21T14:55:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:44 smithi191 ceph-mon[31636]: pgmap v8761: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16255.365285 secs 2024-04-21T14:55:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:46.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:46 smithi170 ceph-mon[31212]: pgmap v8762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:46.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:46 smithi077 ceph-mon[27902]: pgmap v8762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:46 smithi191 ceph-mon[31636]: pgmap v8762: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:47.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16258.604494 secs 2024-04-21T14:55:47.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16258.604494 secs 2024-04-21T14:55:47.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16258.604494 secs 2024-04-21T14:55:48.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:48 smithi170 ceph-mon[31212]: pgmap v8763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:48.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:48 smithi077 ceph-mon[27902]: pgmap v8763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:48 smithi191 ceph-mon[31636]: pgmap v8763: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:49.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16260.365346 secs 2024-04-21T14:55:49.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16260.365346 secs 2024-04-21T14:55:49.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16260.365346 secs 2024-04-21T14:55:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:50.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:50 smithi170 ceph-mon[31212]: pgmap v8764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:50.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:50 smithi077 ceph-mon[27902]: pgmap v8764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:50 smithi191 ceph-mon[31636]: pgmap v8764: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:52.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:52 smithi170 ceph-mon[31212]: pgmap v8765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:52.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16263.604630 secs 2024-04-21T14:55:52.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:52 smithi077 ceph-mon[27902]: pgmap v8765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:52.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16263.604630 secs 2024-04-21T14:55:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:52 smithi191 ceph-mon[31636]: pgmap v8765: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16263.604630 secs 2024-04-21T14:55:54.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:54 smithi191 ceph-mon[31636]: pgmap v8766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:54.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16265.365465 secs 2024-04-21T14:55:54.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:54 smithi170 ceph-mon[31212]: pgmap v8766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:54.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16265.365465 secs 2024-04-21T14:55:54.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:54 smithi077 ceph-mon[27902]: pgmap v8766: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:54.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16265.365465 secs 2024-04-21T14:55:55.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:55:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:55:56.600+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:55:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:55:56.600+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:55:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:55:56.600+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:55:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:55:56.600+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:55:56.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:56 smithi170 ceph-mon[31212]: pgmap v8767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:56.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:56 smithi077 ceph-mon[27902]: pgmap v8767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:56 smithi191 ceph-mon[31636]: pgmap v8767: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:55:57.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16268.604738 secs 2024-04-21T14:55:57.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16268.604738 secs 2024-04-21T14:55:57.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16268.604738 secs 2024-04-21T14:55:58.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:58 smithi170 ceph-mon[31212]: pgmap v8768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:58.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:58 smithi077 ceph-mon[27902]: pgmap v8768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:58 smithi191 ceph-mon[31636]: pgmap v8768: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:55:59.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:55:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16270.365538 secs 2024-04-21T14:55:59.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:55:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16270.365538 secs 2024-04-21T14:55:59.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:55:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16270.365538 secs 2024-04-21T14:56:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:00.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:00 smithi170 ceph-mon[31212]: pgmap v8769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:00.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:00 smithi077 ceph-mon[27902]: pgmap v8769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:00 smithi191 ceph-mon[31636]: pgmap v8769: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:02.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:02 smithi170 ceph-mon[31212]: pgmap v8770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-04-21T14:56:02.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16273.604855 secs 2024-04-21T14:56:02.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:02 smithi077 ceph-mon[27902]: pgmap v8770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-04-21T14:56:02.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16273.604855 secs 2024-04-21T14:56:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:02 smithi191 ceph-mon[31636]: pgmap v8770: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-04-21T14:56:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16273.604855 secs 2024-04-21T14:56:04.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:04 smithi170 ceph-mon[31212]: pgmap v8771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-04-21T14:56:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16275.365649 secs 2024-04-21T14:56:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:04 smithi170 ceph-mon[31212]: osdmap e620: 12 total, 12 up, 12 in 2024-04-21T14:56:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:04 smithi077 ceph-mon[27902]: pgmap v8771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-04-21T14:56:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16275.365649 secs 2024-04-21T14:56:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:04 smithi077 ceph-mon[27902]: osdmap e620: 12 total, 12 up, 12 in 2024-04-21T14:56:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:04 smithi191 ceph-mon[31636]: pgmap v8771: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-04-21T14:56:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16275.365649 secs 2024-04-21T14:56:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:04 smithi191 ceph-mon[31636]: osdmap e620: 12 total, 12 up, 12 in 2024-04-21T14:56:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:06.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:06 smithi170 ceph-mon[31212]: pgmap v8773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2024-04-21T14:56:06.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:06 smithi077 ceph-mon[27902]: pgmap v8773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2024-04-21T14:56:06.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:06 smithi191 ceph-mon[31636]: pgmap v8773: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2024-04-21T14:56:07.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16278.604969 secs 2024-04-21T14:56:07.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16278.604969 secs 2024-04-21T14:56:07.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16278.604969 secs 2024-04-21T14:56:08.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:08 smithi170 ceph-mon[31212]: pgmap v8774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:56:08.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:08 smithi077 ceph-mon[27902]: pgmap v8774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:56:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:08 smithi191 ceph-mon[31636]: pgmap v8774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:56:09.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16280.365762 secs 2024-04-21T14:56:09.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16280.365762 secs 2024-04-21T14:56:10.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16280.365762 secs 2024-04-21T14:56:10.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:10.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:10 smithi077 ceph-mon[27902]: pgmap v8775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:56:10.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:10 smithi077 ceph-mon[27902]: osdmap e621: 12 total, 12 up, 12 in 2024-04-21T14:56:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:10 smithi191 ceph-mon[31636]: pgmap v8775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:56:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:10 smithi191 ceph-mon[31636]: osdmap e621: 12 total, 12 up, 12 in 2024-04-21T14:56:11.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:10 smithi170 ceph-mon[31212]: pgmap v8775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:56:11.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:10 smithi170 ceph-mon[31212]: osdmap e621: 12 total, 12 up, 12 in 2024-04-21T14:56:12.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:12 smithi077 ceph-mon[27902]: pgmap v8777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 32 op/s 2024-04-21T14:56:12.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16283.605077 secs 2024-04-21T14:56:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:12 smithi191 ceph-mon[31636]: pgmap v8777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 32 op/s 2024-04-21T14:56:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16283.605077 secs 2024-04-21T14:56:13.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:12 smithi170 ceph-mon[31212]: pgmap v8777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 32 op/s 2024-04-21T14:56:13.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16283.605077 secs 2024-04-21T14:56:14.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:14 smithi077 ceph-mon[27902]: pgmap v8778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T14:56:14.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16285.365880 secs 2024-04-21T14:56:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:14 smithi191 ceph-mon[31636]: pgmap v8778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T14:56:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16285.365880 secs 2024-04-21T14:56:15.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:14 smithi170 ceph-mon[31212]: pgmap v8778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T14:56:15.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16285.365880 secs 2024-04-21T14:56:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:16.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:16 smithi077 ceph-mon[27902]: pgmap v8779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T14:56:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:16 smithi191 ceph-mon[31636]: pgmap v8779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T14:56:17.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:16 smithi170 ceph-mon[31212]: pgmap v8779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-04-21T14:56:17.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16288.605193 secs 2024-04-21T14:56:17.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16288.605193 secs 2024-04-21T14:56:18.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16288.605193 secs 2024-04-21T14:56:18.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:18 smithi077 ceph-mon[27902]: pgmap v8780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:56:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:18 smithi191 ceph-mon[31636]: pgmap v8780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:56:19.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:18 smithi170 ceph-mon[31212]: pgmap v8780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:56:19.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16290.365971 secs 2024-04-21T14:56:19.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:19 smithi077 ceph-mon[27902]: pgmap v8781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:56:19.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16290.365971 secs 2024-04-21T14:56:19.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:19 smithi191 ceph-mon[31636]: pgmap v8781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:56:20.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16290.365971 secs 2024-04-21T14:56:20.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:19 smithi170 ceph-mon[31212]: pgmap v8781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:56:20.098 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:22.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:21 smithi191 ceph-mon[31636]: pgmap v8782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:56:22.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16293.605339 secs 2024-04-21T14:56:22.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:21 smithi170 ceph-mon[31212]: pgmap v8782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:56:22.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16293.605339 secs 2024-04-21T14:56:22.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:21 smithi077 ceph-mon[27902]: pgmap v8782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:56:22.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16293.605339 secs 2024-04-21T14:56:24.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:23 smithi191 ceph-mon[31636]: pgmap v8783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:24.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16295.366086 secs 2024-04-21T14:56:24.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:23 smithi170 ceph-mon[31212]: pgmap v8783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:24.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16295.366086 secs 2024-04-21T14:56:24.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:23 smithi077 ceph-mon[27902]: pgmap v8783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:24.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16295.366086 secs 2024-04-21T14:56:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:26.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:25 smithi191 ceph-mon[31636]: pgmap v8784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:26.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:56:26.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:25 smithi170 ceph-mon[31212]: pgmap v8784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:26.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:56:26.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:25 smithi077 ceph-mon[27902]: pgmap v8784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:26.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:56:27.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:56:27.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:56:27.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:56:27.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16298.605412 secs 2024-04-21T14:56:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:56:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:56:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:56:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16298.605412 secs 2024-04-21T14:56:27.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:56:27.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:56:27.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:56:27.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16298.605412 secs 2024-04-21T14:56:28.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:28 smithi191 ceph-mon[31636]: pgmap v8785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:28.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:28 smithi170 ceph-mon[31212]: pgmap v8785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:28.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:28 smithi077 ceph-mon[27902]: pgmap v8785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16300.366203 secs 2024-04-21T14:56:29.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16300.366203 secs 2024-04-21T14:56:29.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16300.366203 secs 2024-04-21T14:56:30.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:30 smithi191 ceph-mon[31636]: pgmap v8786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:30 smithi170 ceph-mon[31212]: pgmap v8786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:30.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:30 smithi077 ceph-mon[27902]: pgmap v8786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:32.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:32 smithi191 ceph-mon[31636]: pgmap v8787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:32.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16303.605531 secs 2024-04-21T14:56:32.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:32 smithi170 ceph-mon[31212]: pgmap v8787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:32.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16303.605531 secs 2024-04-21T14:56:32.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:32 smithi077 ceph-mon[27902]: pgmap v8787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:32.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16303.605531 secs 2024-04-21T14:56:34.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:34 smithi191 ceph-mon[31636]: pgmap v8788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:34.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16305.366334 secs 2024-04-21T14:56:34.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:34 smithi170 ceph-mon[31212]: pgmap v8788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:34.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16305.366334 secs 2024-04-21T14:56:34.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:34 smithi077 ceph-mon[27902]: pgmap v8788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:34.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16305.366334 secs 2024-04-21T14:56:35.097 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:36 smithi191 ceph-mon[31636]: pgmap v8789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:36.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:36 smithi170 ceph-mon[31212]: pgmap v8789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:36.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:36 smithi077 ceph-mon[27902]: pgmap v8789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:37.755 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16308.605674 secs 2024-04-21T14:56:37.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16308.605674 secs 2024-04-21T14:56:37.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16308.605674 secs 2024-04-21T14:56:38.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:38 smithi170 ceph-mon[31212]: pgmap v8790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:38.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:38 smithi077 ceph-mon[27902]: pgmap v8790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:38.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:38 smithi191 ceph-mon[31636]: pgmap v8790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:39.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16310.366460 secs 2024-04-21T14:56:39.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16310.366460 secs 2024-04-21T14:56:39.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16310.366460 secs 2024-04-21T14:56:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:40.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:40 smithi170 ceph-mon[31212]: pgmap v8791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:40.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:40 smithi077 ceph-mon[27902]: pgmap v8791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:40 smithi191 ceph-mon[31636]: pgmap v8791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:42.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:42 smithi170 ceph-mon[31212]: pgmap v8792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:42.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16313.605828 secs 2024-04-21T14:56:42.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:42 smithi077 ceph-mon[27902]: pgmap v8792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:42.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16313.605828 secs 2024-04-21T14:56:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:42 smithi191 ceph-mon[31636]: pgmap v8792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16313.605828 secs 2024-04-21T14:56:44.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:44 smithi170 ceph-mon[31212]: pgmap v8793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:44.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16315.366597 secs 2024-04-21T14:56:44.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:44 smithi077 ceph-mon[27902]: pgmap v8793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:44.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16315.366597 secs 2024-04-21T14:56:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:44 smithi191 ceph-mon[31636]: pgmap v8793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16315.366597 secs 2024-04-21T14:56:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:46.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:46 smithi170 ceph-mon[31212]: pgmap v8794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:46.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:46 smithi077 ceph-mon[27902]: pgmap v8794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:46 smithi191 ceph-mon[31636]: pgmap v8794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:47.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16318.605921 secs 2024-04-21T14:56:47.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16318.605921 secs 2024-04-21T14:56:47.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16318.605921 secs 2024-04-21T14:56:48.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:48 smithi170 ceph-mon[31212]: pgmap v8795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:48.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:48 smithi077 ceph-mon[27902]: pgmap v8795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:48 smithi191 ceph-mon[31636]: pgmap v8795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:49.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16320.366668 secs 2024-04-21T14:56:49.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16320.366668 secs 2024-04-21T14:56:49.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16320.366668 secs 2024-04-21T14:56:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:50.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:50 smithi170 ceph-mon[31212]: pgmap v8796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:50.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:50 smithi077 ceph-mon[27902]: pgmap v8796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:50 smithi191 ceph-mon[31636]: pgmap v8796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:52.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:52 smithi170 ceph-mon[31212]: pgmap v8797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:52.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16323.606046 secs 2024-04-21T14:56:52.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:52 smithi077 ceph-mon[27902]: pgmap v8797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:52.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16323.606046 secs 2024-04-21T14:56:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:52 smithi191 ceph-mon[31636]: pgmap v8797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16323.606046 secs 2024-04-21T14:56:54.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:54 smithi191 ceph-mon[31636]: pgmap v8798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:54.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16325.366794 secs 2024-04-21T14:56:54.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:54 smithi170 ceph-mon[31212]: pgmap v8798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:54.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16325.366794 secs 2024-04-21T14:56:54.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:54 smithi077 ceph-mon[27902]: pgmap v8798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:54.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16325.366794 secs 2024-04-21T14:56:55.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:56:56.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:56 smithi170 ceph-mon[31212]: pgmap v8799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:56.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:56 smithi077 ceph-mon[27902]: pgmap v8799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:56 smithi191 ceph-mon[31636]: pgmap v8799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:56:57.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16328.606126 secs 2024-04-21T14:56:57.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16328.606126 secs 2024-04-21T14:56:57.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16328.606126 secs 2024-04-21T14:56:58.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:58 smithi170 ceph-mon[31212]: pgmap v8800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:58.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:58 smithi077 ceph-mon[27902]: pgmap v8800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:58 smithi191 ceph-mon[31636]: pgmap v8800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:56:59.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:56:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16330.366914 secs 2024-04-21T14:56:59.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:56:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16330.366914 secs 2024-04-21T14:56:59.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:56:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16330.366914 secs 2024-04-21T14:57:00.097 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:00.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:00 smithi170 ceph-mon[31212]: pgmap v8801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:00.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:00 smithi077 ceph-mon[27902]: pgmap v8801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:00 smithi191 ceph-mon[31636]: pgmap v8801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:02.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:02 smithi170 ceph-mon[31212]: pgmap v8802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:02.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16333.606271 secs 2024-04-21T14:57:02.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:02 smithi077 ceph-mon[27902]: pgmap v8802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:02.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16333.606271 secs 2024-04-21T14:57:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:02 smithi191 ceph-mon[31636]: pgmap v8802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16333.606271 secs 2024-04-21T14:57:04.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:04 smithi170 ceph-mon[31212]: pgmap v8803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:04.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16335.367022 secs 2024-04-21T14:57:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:04 smithi170 ceph-mon[31212]: osdmap e622: 12 total, 12 up, 12 in 2024-04-21T14:57:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:04 smithi077 ceph-mon[27902]: pgmap v8803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16335.367022 secs 2024-04-21T14:57:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:04 smithi077 ceph-mon[27902]: osdmap e622: 12 total, 12 up, 12 in 2024-04-21T14:57:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:04 smithi191 ceph-mon[31636]: pgmap v8803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16335.367022 secs 2024-04-21T14:57:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:04 smithi191 ceph-mon[31636]: osdmap e622: 12 total, 12 up, 12 in 2024-04-21T14:57:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:06.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:06 smithi170 ceph-mon[31212]: pgmap v8805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:57:06.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:06 smithi077 ceph-mon[27902]: pgmap v8805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:57:06.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:06 smithi191 ceph-mon[31636]: pgmap v8805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:57:07.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16338.606393 secs 2024-04-21T14:57:07.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16338.606393 secs 2024-04-21T14:57:08.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16338.606393 secs 2024-04-21T14:57:08.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:08 smithi077 ceph-mon[27902]: pgmap v8806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:57:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:08 smithi191 ceph-mon[31636]: pgmap v8806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:57:09.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:08 smithi170 ceph-mon[31212]: pgmap v8806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:57:09.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16340.367138 secs 2024-04-21T14:57:09.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16340.367138 secs 2024-04-21T14:57:10.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16340.367138 secs 2024-04-21T14:57:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:10.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:10 smithi077 ceph-mon[27902]: pgmap v8807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:57:10.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:10 smithi077 ceph-mon[27902]: osdmap e623: 12 total, 12 up, 12 in 2024-04-21T14:57:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:10 smithi191 ceph-mon[31636]: pgmap v8807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:57:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:10 smithi191 ceph-mon[31636]: osdmap e623: 12 total, 12 up, 12 in 2024-04-21T14:57:11.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:10 smithi170 ceph-mon[31212]: pgmap v8807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:57:11.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:10 smithi170 ceph-mon[31212]: osdmap e623: 12 total, 12 up, 12 in 2024-04-21T14:57:12.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:12 smithi077 ceph-mon[27902]: pgmap v8809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:57:12.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16343.606540 secs 2024-04-21T14:57:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:12 smithi191 ceph-mon[31636]: pgmap v8809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:57:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16343.606540 secs 2024-04-21T14:57:13.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:12 smithi170 ceph-mon[31212]: pgmap v8809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:57:13.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16343.606540 secs 2024-04-21T14:57:14.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:14 smithi077 ceph-mon[27902]: pgmap v8810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T14:57:14.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16345.367250 secs 2024-04-21T14:57:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:14 smithi191 ceph-mon[31636]: pgmap v8810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T14:57:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16345.367250 secs 2024-04-21T14:57:15.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:14 smithi170 ceph-mon[31212]: pgmap v8810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T14:57:15.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16345.367250 secs 2024-04-21T14:57:15.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:16.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:16 smithi077 ceph-mon[27902]: pgmap v8811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:57:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:16 smithi191 ceph-mon[31636]: pgmap v8811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:57:17.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:16 smithi170 ceph-mon[31212]: pgmap v8811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:57:17.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16348.606644 secs 2024-04-21T14:57:17.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16348.606644 secs 2024-04-21T14:57:18.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16348.606644 secs 2024-04-21T14:57:18.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:18 smithi077 ceph-mon[27902]: pgmap v8812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:57:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:18 smithi191 ceph-mon[31636]: pgmap v8812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:57:19.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:18 smithi170 ceph-mon[31212]: pgmap v8812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:57:19.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16350.367334 secs 2024-04-21T14:57:19.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:19 smithi077 ceph-mon[27902]: pgmap v8813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:57:19.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16350.367334 secs 2024-04-21T14:57:19.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:19 smithi191 ceph-mon[31636]: pgmap v8813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:57:20.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16350.367334 secs 2024-04-21T14:57:20.025 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:19 smithi170 ceph-mon[31212]: pgmap v8813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:57:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:22.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:21 smithi191 ceph-mon[31636]: pgmap v8814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:57:22.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:21 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16353.606794 secs 2024-04-21T14:57:22.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:21 smithi170 ceph-mon[31212]: pgmap v8814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:57:22.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:21 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16353.606794 secs 2024-04-21T14:57:22.353 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:21 smithi077 ceph-mon[27902]: pgmap v8814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:57:22.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:21 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16353.606794 secs 2024-04-21T14:57:24.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:23 smithi191 ceph-mon[31636]: pgmap v8815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:24.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16355.367470 secs 2024-04-21T14:57:24.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:23 smithi170 ceph-mon[31212]: pgmap v8815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:24.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16355.367470 secs 2024-04-21T14:57:24.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:23 smithi077 ceph-mon[27902]: pgmap v8815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:24.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16355.367470 secs 2024-04-21T14:57:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:26.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:25 smithi191 ceph-mon[31636]: pgmap v8816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:26.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:25 smithi170 ceph-mon[31212]: pgmap v8816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:26.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:25 smithi077 ceph-mon[27902]: pgmap v8816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:27.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:57:27.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:26 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16358.606888 secs 2024-04-21T14:57:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:57:27.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:26 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16358.606888 secs 2024-04-21T14:57:27.309 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:57:27.309 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:26 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16358.606888 secs 2024-04-21T14:57:28.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:27 smithi191 ceph-mon[31636]: pgmap v8817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:28.275 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:27 smithi170 ceph-mon[31212]: pgmap v8817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:28.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:27 smithi077 ceph-mon[27902]: pgmap v8817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:29.525 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.525 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.525 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.526 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16360.367539 secs 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16360.367539 secs 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:29.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16360.367539 secs 2024-04-21T14:57:30.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:30.339 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: pgmap v8818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:30.339 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.339 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.339 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.339 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.340 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:57:30.341 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.341 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:57:30.341 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.341 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:57:30.341 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:57:30.341 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:57:30.603 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:57:30.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: pgmap v8818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:57:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: pgmap v8818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T14:57:30.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:57:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:57:32.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:32 smithi077 ceph-mon[27902]: pgmap v8819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:32.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16363.607003 secs 2024-04-21T14:57:32.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:32 smithi191 ceph-mon[31636]: pgmap v8819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:32.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16363.607003 secs 2024-04-21T14:57:32.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:32 smithi170 ceph-mon[31212]: pgmap v8819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:32.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16363.607003 secs 2024-04-21T14:57:34.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:34 smithi077 ceph-mon[27902]: pgmap v8820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:34.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16365.367646 secs 2024-04-21T14:57:34.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:34 smithi191 ceph-mon[31636]: pgmap v8820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:34.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16365.367646 secs 2024-04-21T14:57:34.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:34 smithi170 ceph-mon[31212]: pgmap v8820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:34.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16365.367646 secs 2024-04-21T14:57:35.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:36.604 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:36 smithi077 ceph-mon[27902]: pgmap v8821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:36 smithi191 ceph-mon[31636]: pgmap v8821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:36.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:36 smithi170 ceph-mon[31212]: pgmap v8821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:37.603 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16368.607154 secs 2024-04-21T14:57:37.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16368.607154 secs 2024-04-21T14:57:37.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16368.607154 secs 2024-04-21T14:57:38.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:38 smithi191 ceph-mon[31636]: pgmap v8822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:38.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:38 smithi170 ceph-mon[31212]: pgmap v8822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:38.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:38 smithi077 ceph-mon[27902]: pgmap v8822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:39.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16370.367718 secs 2024-04-21T14:57:39.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16370.367718 secs 2024-04-21T14:57:39.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16370.367718 secs 2024-04-21T14:57:40.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:40.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:40 smithi191 ceph-mon[31636]: pgmap v8823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:40.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:40 smithi170 ceph-mon[31212]: pgmap v8823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:40.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:40 smithi077 ceph-mon[27902]: pgmap v8823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:42.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:42 smithi191 ceph-mon[31636]: pgmap v8824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:42.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16373.607236 secs 2024-04-21T14:57:42.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:42 smithi170 ceph-mon[31212]: pgmap v8824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:42.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16373.607236 secs 2024-04-21T14:57:42.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:42 smithi077 ceph-mon[27902]: pgmap v8824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:42.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16373.607236 secs 2024-04-21T14:57:44.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:44 smithi191 ceph-mon[31636]: pgmap v8825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:44.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16375.367841 secs 2024-04-21T14:57:44.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:44 smithi170 ceph-mon[31212]: pgmap v8825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:44.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16375.367841 secs 2024-04-21T14:57:44.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:44 smithi077 ceph-mon[27902]: pgmap v8825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:44.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16375.367841 secs 2024-04-21T14:57:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:46.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:46 smithi191 ceph-mon[31636]: pgmap v8826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:46.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:46 smithi170 ceph-mon[31212]: pgmap v8826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:46.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:46 smithi077 ceph-mon[27902]: pgmap v8826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:47.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16378.607369 secs 2024-04-21T14:57:47.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16378.607369 secs 2024-04-21T14:57:47.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16378.607369 secs 2024-04-21T14:57:48.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:48 smithi191 ceph-mon[31636]: pgmap v8827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:48.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:48 smithi170 ceph-mon[31212]: pgmap v8827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:48.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:48 smithi077 ceph-mon[27902]: pgmap v8827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:49.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16380.367890 secs 2024-04-21T14:57:49.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16380.367890 secs 2024-04-21T14:57:49.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16380.367890 secs 2024-04-21T14:57:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:50.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:50 smithi191 ceph-mon[31636]: pgmap v8828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:50.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:50 smithi170 ceph-mon[31212]: pgmap v8828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:50.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:50 smithi077 ceph-mon[27902]: pgmap v8828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:52.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:52 smithi191 ceph-mon[31636]: pgmap v8829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:52.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16383.607506 secs 2024-04-21T14:57:52.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:52 smithi170 ceph-mon[31212]: pgmap v8829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:52.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16383.607506 secs 2024-04-21T14:57:52.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:52 smithi077 ceph-mon[27902]: pgmap v8829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:52.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16383.607506 secs 2024-04-21T14:57:54.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:54 smithi191 ceph-mon[31636]: pgmap v8830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:54.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16385.368041 secs 2024-04-21T14:57:54.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:54 smithi170 ceph-mon[31212]: pgmap v8830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:54.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16385.368041 secs 2024-04-21T14:57:54.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:54 smithi077 ceph-mon[27902]: pgmap v8830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:54.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16385.368041 secs 2024-04-21T14:57:55.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:57:56.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:56 smithi191 ceph-mon[31636]: pgmap v8831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:56.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:56 smithi170 ceph-mon[31212]: pgmap v8831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:56.853 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:56 smithi077 ceph-mon[27902]: pgmap v8831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:57:57.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16388.607617 secs 2024-04-21T14:57:57.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16388.607617 secs 2024-04-21T14:57:57.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16388.607617 secs 2024-04-21T14:57:58.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:58 smithi191 ceph-mon[31636]: pgmap v8832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:58.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:58 smithi170 ceph-mon[31212]: pgmap v8832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:58.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:58 smithi077 ceph-mon[27902]: pgmap v8832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:57:59.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:57:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16390.368153 secs 2024-04-21T14:57:59.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:57:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16390.368153 secs 2024-04-21T14:57:59.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:57:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16390.368153 secs 2024-04-21T14:58:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:00.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:00 smithi191 ceph-mon[31636]: pgmap v8833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:00.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:00 smithi170 ceph-mon[31212]: pgmap v8833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:00.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:00 smithi077 ceph-mon[27902]: pgmap v8833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:02.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:02 smithi191 ceph-mon[31636]: pgmap v8834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:02.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16393.607776 secs 2024-04-21T14:58:02.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:02 smithi170 ceph-mon[31212]: pgmap v8834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:02.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16393.607776 secs 2024-04-21T14:58:02.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:02 smithi077 ceph-mon[27902]: pgmap v8834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:02.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16393.607776 secs 2024-04-21T14:58:04.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:04 smithi191 ceph-mon[31636]: pgmap v8835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:04.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16395.368214 secs 2024-04-21T14:58:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:04 smithi170 ceph-mon[31212]: pgmap v8835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:04.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16395.368214 secs 2024-04-21T14:58:04.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:04 smithi077 ceph-mon[27902]: pgmap v8835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:04.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16395.368214 secs 2024-04-21T14:58:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:05.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:05 smithi191 ceph-mon[31636]: osdmap e624: 12 total, 12 up, 12 in 2024-04-21T14:58:05.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:05 smithi170 ceph-mon[31212]: osdmap e624: 12 total, 12 up, 12 in 2024-04-21T14:58:05.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:05 smithi077 ceph-mon[27902]: osdmap e624: 12 total, 12 up, 12 in 2024-04-21T14:58:06.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:06 smithi191 ceph-mon[31636]: pgmap v8837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:58:06.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:06 smithi170 ceph-mon[31212]: pgmap v8837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:58:06.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:06 smithi077 ceph-mon[27902]: pgmap v8837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:58:07.756 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16398.607826 secs 2024-04-21T14:58:07.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16398.607826 secs 2024-04-21T14:58:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16398.607826 secs 2024-04-21T14:58:08.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:08 smithi170 ceph-mon[31212]: pgmap v8838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:58:08.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:08 smithi077 ceph-mon[27902]: pgmap v8838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:58:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:08 smithi191 ceph-mon[31636]: pgmap v8838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:58:09.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16400.368339 secs 2024-04-21T14:58:09.854 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16400.368339 secs 2024-04-21T14:58:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16400.368339 secs 2024-04-21T14:58:10.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:10.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:10 smithi170 ceph-mon[31212]: pgmap v8839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:58:10.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:10 smithi170 ceph-mon[31212]: osdmap e625: 12 total, 12 up, 12 in 2024-04-21T14:58:10.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:10 smithi077 ceph-mon[27902]: pgmap v8839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:58:10.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:10 smithi077 ceph-mon[27902]: osdmap e625: 12 total, 12 up, 12 in 2024-04-21T14:58:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:10 smithi191 ceph-mon[31636]: pgmap v8839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T14:58:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:10 smithi191 ceph-mon[31636]: osdmap e625: 12 total, 12 up, 12 in 2024-04-21T14:58:12.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:12 smithi170 ceph-mon[31212]: pgmap v8841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:58:12.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16403.607940 secs 2024-04-21T14:58:12.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:12 smithi077 ceph-mon[27902]: pgmap v8841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:58:12.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16403.607940 secs 2024-04-21T14:58:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:12 smithi191 ceph-mon[31636]: pgmap v8841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T14:58:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16403.607940 secs 2024-04-21T14:58:14.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:14 smithi170 ceph-mon[31212]: pgmap v8842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T14:58:14.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16405.368479 secs 2024-04-21T14:58:14.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:14 smithi077 ceph-mon[27902]: pgmap v8842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T14:58:14.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16405.368479 secs 2024-04-21T14:58:14.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:14 smithi191 ceph-mon[31636]: pgmap v8842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T14:58:14.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16405.368479 secs 2024-04-21T14:58:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:16.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:16 smithi170 ceph-mon[31212]: pgmap v8843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:58:16.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:16 smithi077 ceph-mon[27902]: pgmap v8843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:58:16.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:16 smithi191 ceph-mon[31636]: pgmap v8843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:58:17.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16408.608058 secs 2024-04-21T14:58:17.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16408.608058 secs 2024-04-21T14:58:17.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16408.608058 secs 2024-04-21T14:58:18.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:18 smithi170 ceph-mon[31212]: pgmap v8844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:58:18.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:18 smithi077 ceph-mon[27902]: pgmap v8844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:58:18.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:18 smithi191 ceph-mon[31636]: pgmap v8844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:58:19.776 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16410.368546 secs 2024-04-21T14:58:19.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16410.368546 secs 2024-04-21T14:58:19.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16410.368546 secs 2024-04-21T14:58:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:20.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:20 smithi170 ceph-mon[31212]: pgmap v8845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:58:20.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:20 smithi077 ceph-mon[27902]: pgmap v8845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:58:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:20 smithi191 ceph-mon[31636]: pgmap v8845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:58:22.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:22 smithi170 ceph-mon[31212]: pgmap v8846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:58:22.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16413.608178 secs 2024-04-21T14:58:22.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:22 smithi077 ceph-mon[27902]: pgmap v8846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:58:22.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16413.608178 secs 2024-04-21T14:58:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:22 smithi191 ceph-mon[31636]: pgmap v8846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:58:22.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16413.608178 secs 2024-04-21T14:58:24.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:24 smithi191 ceph-mon[31636]: pgmap v8847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:24.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16415.368664 secs 2024-04-21T14:58:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:24 smithi170 ceph-mon[31212]: pgmap v8847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:24.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16415.368664 secs 2024-04-21T14:58:24.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:24 smithi077 ceph-mon[27902]: pgmap v8847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:24.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16415.368664 secs 2024-04-21T14:58:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:26.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:26 smithi170 ceph-mon[31212]: pgmap v8848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:26.855 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:26 smithi077 ceph-mon[27902]: pgmap v8848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:26.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:26 smithi191 ceph-mon[31636]: pgmap v8848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:27.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16418.608289 secs 2024-04-21T14:58:27.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16418.608289 secs 2024-04-21T14:58:27.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16418.608289 secs 2024-04-21T14:58:28.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:28 smithi170 ceph-mon[31212]: pgmap v8849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:28.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:28 smithi077 ceph-mon[27902]: pgmap v8849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:28.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:28 smithi191 ceph-mon[31636]: pgmap v8849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:29.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16420.368788 secs 2024-04-21T14:58:29.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:58:29.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16420.368788 secs 2024-04-21T14:58:29.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:58:29.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16420.368788 secs 2024-04-21T14:58:29.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:58:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:30 smithi170 ceph-mon[31212]: pgmap v8850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:30.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:30.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:30 smithi077 ceph-mon[27902]: pgmap v8850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:30.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:30.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:30.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:30 smithi191 ceph-mon[31636]: pgmap v8850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:30.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:30.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:31.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:58:31.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:58:31.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:31.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:58:31.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:58:31.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:31.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:58:31.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:58:31.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:58:32.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:32 smithi170 ceph-mon[31212]: pgmap v8851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:32.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16423.608446 secs 2024-04-21T14:58:32.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:32 smithi077 ceph-mon[27902]: pgmap v8851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:32.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16423.608446 secs 2024-04-21T14:58:32.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:32 smithi191 ceph-mon[31636]: pgmap v8851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:32.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16423.608446 secs 2024-04-21T14:58:34.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:34 smithi170 ceph-mon[31212]: pgmap v8852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:34.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16425.368914 secs 2024-04-21T14:58:34.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:34 smithi077 ceph-mon[27902]: pgmap v8852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:34.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16425.368914 secs 2024-04-21T14:58:34.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:34 smithi191 ceph-mon[31636]: pgmap v8852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:34.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16425.368914 secs 2024-04-21T14:58:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:36.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:35 smithi077 ceph-mon[27902]: pgmap v8853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:36.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:35 smithi191 ceph-mon[31636]: pgmap v8853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:36.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:35 smithi170 ceph-mon[31212]: pgmap v8853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:37.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:36 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16428.608590 secs 2024-04-21T14:58:37.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:36 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16428.608590 secs 2024-04-21T14:58:37.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:36 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16428.608590 secs 2024-04-21T14:58:38.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:37 smithi170 ceph-mon[31212]: pgmap v8854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:38.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:37 smithi077 ceph-mon[27902]: pgmap v8854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:38.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:37 smithi191 ceph-mon[31636]: pgmap v8854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:39.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16430.369072 secs 2024-04-21T14:58:39.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16430.369072 secs 2024-04-21T14:58:39.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16430.369072 secs 2024-04-21T14:58:40.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:40.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:39 smithi170 ceph-mon[31212]: pgmap v8855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:40.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:39 smithi077 ceph-mon[27902]: pgmap v8855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:40.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:39 smithi191 ceph-mon[31636]: pgmap v8855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:41 smithi170 ceph-mon[31212]: pgmap v8856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:42.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:41 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16433.608739 secs 2024-04-21T14:58:42.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:41 smithi077 ceph-mon[27902]: pgmap v8856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:42.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:41 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16433.608739 secs 2024-04-21T14:58:42.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:41 smithi191 ceph-mon[31636]: pgmap v8856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:42.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:41 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16433.608739 secs 2024-04-21T14:58:44.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:43 smithi170 ceph-mon[31212]: pgmap v8857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:44.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16435.369195 secs 2024-04-21T14:58:44.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:43 smithi077 ceph-mon[27902]: pgmap v8857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:44.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16435.369195 secs 2024-04-21T14:58:44.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:43 smithi191 ceph-mon[31636]: pgmap v8857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:44.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16435.369195 secs 2024-04-21T14:58:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:46.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:45 smithi170 ceph-mon[31212]: pgmap v8858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:46.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:45 smithi077 ceph-mon[27902]: pgmap v8858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:46.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:45 smithi191 ceph-mon[31636]: pgmap v8858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:58:47.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16438.608860 secs 2024-04-21T14:58:47.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16438.608860 secs 2024-04-21T14:58:47.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16438.608860 secs 2024-04-21T14:58:48.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:48 smithi170 ceph-mon[31212]: pgmap v8859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:48.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:48 smithi077 ceph-mon[27902]: pgmap v8859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:48.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:48 smithi191 ceph-mon[31636]: pgmap v8859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:49.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16440.369260 secs 2024-04-21T14:58:49.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16440.369260 secs 2024-04-21T14:58:49.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16440.369260 secs 2024-04-21T14:58:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:50.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:50 smithi170 ceph-mon[31212]: pgmap v8860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:50.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:50 smithi077 ceph-mon[27902]: pgmap v8860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:50.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:50 smithi191 ceph-mon[31636]: pgmap v8860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:52.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:52 smithi170 ceph-mon[31212]: pgmap v8861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:52.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16443.608926 secs 2024-04-21T14:58:52.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:52 smithi077 ceph-mon[27902]: pgmap v8861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:52.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16443.608926 secs 2024-04-21T14:58:52.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:52 smithi191 ceph-mon[31636]: pgmap v8861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:52.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16443.608926 secs 2024-04-21T14:58:54.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:54 smithi191 ceph-mon[31636]: pgmap v8862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:54.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16445.369378 secs 2024-04-21T14:58:54.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:54 smithi170 ceph-mon[31212]: pgmap v8862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:54.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16445.369378 secs 2024-04-21T14:58:54.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:54 smithi077 ceph-mon[27902]: pgmap v8862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:54.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16445.369378 secs 2024-04-21T14:58:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.431+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T14:58:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.431+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T14:58:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.431+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:58:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.431+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T14:58:54.403 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.431+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:58:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.432+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T14:58:54.404 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.432+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T14:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T14:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T14:58:54.422 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efd70020640 tx=0x7efd7002b040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efd70020640 tx=0x7efd7002b040 comp rx=0 tx=0).stop 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T14:58:54.423 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:54.450+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7005c070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T14:58:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:58:56.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:56 smithi170 ceph-mon[31212]: pgmap v8863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:56.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:56 smithi077 ceph-mon[27902]: pgmap v8863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:56.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:56 smithi191 ceph-mon[31636]: pgmap v8863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:58:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:56.624+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:58:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:56.624+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:58:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:56.625+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T14:58:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T14:58:56.625+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T14:58:57.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16448.609006 secs 2024-04-21T14:58:57.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16448.609006 secs 2024-04-21T14:58:57.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16448.609006 secs 2024-04-21T14:58:58.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:58 smithi170 ceph-mon[31212]: pgmap v8864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:58 smithi077 ceph-mon[27902]: pgmap v8864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:58.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:58 smithi191 ceph-mon[31636]: pgmap v8864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:58:59.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:58:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16450.369495 secs 2024-04-21T14:58:59.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:58:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16450.369495 secs 2024-04-21T14:58:59.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:58:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16450.369495 secs 2024-04-21T14:59:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:00 smithi170 ceph-mon[31212]: pgmap v8865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:00 smithi077 ceph-mon[27902]: pgmap v8865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:00.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:00 smithi191 ceph-mon[31636]: pgmap v8865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:02.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:02 smithi170 ceph-mon[31212]: pgmap v8866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:02.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16453.609088 secs 2024-04-21T14:59:02.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:02 smithi077 ceph-mon[27902]: pgmap v8866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:02.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16453.609088 secs 2024-04-21T14:59:02.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:02 smithi191 ceph-mon[31636]: pgmap v8866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:02.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16453.609088 secs 2024-04-21T14:59:04.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:04 smithi170 ceph-mon[31212]: pgmap v8867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:04.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16455.369614 secs 2024-04-21T14:59:04.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:04 smithi077 ceph-mon[27902]: pgmap v8867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:04.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16455.369614 secs 2024-04-21T14:59:04.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:04 smithi191 ceph-mon[31636]: pgmap v8867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:04.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16455.369614 secs 2024-04-21T14:59:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:05 smithi077 ceph-mon[27902]: osdmap e626: 12 total, 12 up, 12 in 2024-04-21T14:59:05.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:05 smithi191 ceph-mon[31636]: osdmap e626: 12 total, 12 up, 12 in 2024-04-21T14:59:05.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:05 smithi170 ceph-mon[31212]: osdmap e626: 12 total, 12 up, 12 in 2024-04-21T14:59:06.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:06 smithi077 ceph-mon[27902]: pgmap v8869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:59:06.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:06 smithi191 ceph-mon[31636]: pgmap v8869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:59:06.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:06 smithi170 ceph-mon[31212]: pgmap v8869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T14:59:07.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16458.609221 secs 2024-04-21T14:59:07.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16458.609221 secs 2024-04-21T14:59:07.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16458.609221 secs 2024-04-21T14:59:08.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:08 smithi077 ceph-mon[27902]: pgmap v8870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:08.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:08 smithi191 ceph-mon[31636]: pgmap v8870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:08.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:08 smithi170 ceph-mon[31212]: pgmap v8870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:09.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16460.369734 secs 2024-04-21T14:59:09.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16460.369734 secs 2024-04-21T14:59:09.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16460.369734 secs 2024-04-21T14:59:10.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:10.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:10 smithi077 ceph-mon[27902]: pgmap v8871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:10.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:10 smithi077 ceph-mon[27902]: osdmap e627: 12 total, 12 up, 12 in 2024-04-21T14:59:10.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:10 smithi191 ceph-mon[31636]: pgmap v8871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:10.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:10 smithi191 ceph-mon[31636]: osdmap e627: 12 total, 12 up, 12 in 2024-04-21T14:59:10.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:10 smithi170 ceph-mon[31212]: pgmap v8871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:10.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:10 smithi170 ceph-mon[31212]: osdmap e627: 12 total, 12 up, 12 in 2024-04-21T14:59:12.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:12 smithi077 ceph-mon[27902]: pgmap v8873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:59:12.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16463.609353 secs 2024-04-21T14:59:12.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:12 smithi191 ceph-mon[31636]: pgmap v8873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:59:12.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16463.609353 secs 2024-04-21T14:59:12.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:12 smithi170 ceph-mon[31212]: pgmap v8873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T14:59:12.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16463.609353 secs 2024-04-21T14:59:14.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:14 smithi077 ceph-mon[27902]: pgmap v8874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:59:14.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16465.369901 secs 2024-04-21T14:59:14.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:14 smithi191 ceph-mon[31636]: pgmap v8874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:59:14.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16465.369901 secs 2024-04-21T14:59:14.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:14 smithi170 ceph-mon[31212]: pgmap v8874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T14:59:14.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16465.369901 secs 2024-04-21T14:59:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:16.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:16 smithi077 ceph-mon[27902]: pgmap v8875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:16.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:16 smithi191 ceph-mon[31636]: pgmap v8875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:16.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:16 smithi170 ceph-mon[31212]: pgmap v8875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T14:59:17.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16468.609448 secs 2024-04-21T14:59:17.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16468.609448 secs 2024-04-21T14:59:17.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16468.609448 secs 2024-04-21T14:59:18.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:18 smithi077 ceph-mon[27902]: pgmap v8876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:59:18.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:18 smithi191 ceph-mon[31636]: pgmap v8876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:59:18.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:18 smithi170 ceph-mon[31212]: pgmap v8876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:59:19.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16470.369948 secs 2024-04-21T14:59:19.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16470.369948 secs 2024-04-21T14:59:19.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16470.369948 secs 2024-04-21T14:59:20.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:20.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:20 smithi077 ceph-mon[27902]: pgmap v8877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:59:20.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:20 smithi191 ceph-mon[31636]: pgmap v8877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:59:20.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:20 smithi170 ceph-mon[31212]: pgmap v8877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T14:59:22.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:22 smithi077 ceph-mon[27902]: pgmap v8878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:59:22.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16473.609562 secs 2024-04-21T14:59:22.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:22 smithi191 ceph-mon[31636]: pgmap v8878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:59:22.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16473.609562 secs 2024-04-21T14:59:22.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:22 smithi170 ceph-mon[31212]: pgmap v8878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T14:59:22.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16473.609562 secs 2024-04-21T14:59:24.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:24 smithi077 ceph-mon[27902]: pgmap v8879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:59:24.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16475.370104 secs 2024-04-21T14:59:24.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:24 smithi191 ceph-mon[31636]: pgmap v8879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:59:24.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16475.370104 secs 2024-04-21T14:59:24.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:24 smithi170 ceph-mon[31212]: pgmap v8879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:59:24.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16475.370104 secs 2024-04-21T14:59:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:26.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:26 smithi170 ceph-mon[31212]: pgmap v8880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:59:26.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:26 smithi077 ceph-mon[27902]: pgmap v8880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:59:26.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:26 smithi191 ceph-mon[31636]: pgmap v8880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T14:59:27.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16478.609675 secs 2024-04-21T14:59:27.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16478.609675 secs 2024-04-21T14:59:27.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16478.609675 secs 2024-04-21T14:59:28.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:28 smithi077 ceph-mon[27902]: pgmap v8881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:28 smithi191 ceph-mon[31636]: pgmap v8881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:28.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:28 smithi170 ceph-mon[31212]: pgmap v8881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:29.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16480.370223 secs 2024-04-21T14:59:29.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16480.370223 secs 2024-04-21T14:59:29.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16480.370223 secs 2024-04-21T14:59:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:30.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:30 smithi077 ceph-mon[27902]: pgmap v8882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:30.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:30 smithi191 ceph-mon[31636]: pgmap v8882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:30.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:30 smithi170 ceph-mon[31212]: pgmap v8882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:31.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:59:31.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:59:31.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T14:59:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: pgmap v8883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16483.609789 secs 2024-04-21T14:59:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:59:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:59:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: pgmap v8883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16483.609789 secs 2024-04-21T14:59:32.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:59:32.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:59:32.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: pgmap v8883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16483.609789 secs 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T14:59:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T14:59:32.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T14:59:34.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:34 smithi191 ceph-mon[31636]: pgmap v8884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:34.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16485.370360 secs 2024-04-21T14:59:34.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:34 smithi170 ceph-mon[31212]: pgmap v8884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:34.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16485.370360 secs 2024-04-21T14:59:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:34 smithi077 ceph-mon[27902]: pgmap v8884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16485.370360 secs 2024-04-21T14:59:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:36.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:36 smithi191 ceph-mon[31636]: pgmap v8885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:36.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:36 smithi170 ceph-mon[31212]: pgmap v8885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:36.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:36 smithi077 ceph-mon[27902]: pgmap v8885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:37.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16488.609811 secs 2024-04-21T14:59:37.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16488.609811 secs 2024-04-21T14:59:37.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16488.609811 secs 2024-04-21T14:59:38.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:38 smithi191 ceph-mon[31636]: pgmap v8886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:38.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:38 smithi170 ceph-mon[31212]: pgmap v8886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:38.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:38 smithi077 ceph-mon[27902]: pgmap v8886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:39.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16490.370501 secs 2024-04-21T14:59:39.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16490.370501 secs 2024-04-21T14:59:39.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16490.370501 secs 2024-04-21T14:59:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:40.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:40 smithi191 ceph-mon[31636]: pgmap v8887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:40.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:40 smithi170 ceph-mon[31212]: pgmap v8887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:40.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:40 smithi077 ceph-mon[27902]: pgmap v8887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:42.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:42 smithi191 ceph-mon[31636]: pgmap v8888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:42.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16493.609913 secs 2024-04-21T14:59:42.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:42 smithi170 ceph-mon[31212]: pgmap v8888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:42.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16493.609913 secs 2024-04-21T14:59:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:42 smithi077 ceph-mon[27902]: pgmap v8888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16493.609913 secs 2024-04-21T14:59:44.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:44 smithi191 ceph-mon[31636]: pgmap v8889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:44.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16495.370642 secs 2024-04-21T14:59:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:44 smithi170 ceph-mon[31212]: pgmap v8889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16495.370642 secs 2024-04-21T14:59:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:44 smithi077 ceph-mon[27902]: pgmap v8889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16495.370642 secs 2024-04-21T14:59:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:46.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:46 smithi191 ceph-mon[31636]: pgmap v8890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:46.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:46 smithi170 ceph-mon[31212]: pgmap v8890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:46.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:46 smithi077 ceph-mon[27902]: pgmap v8890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:47.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16498.610026 secs 2024-04-21T14:59:47.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16498.610026 secs 2024-04-21T14:59:47.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16498.610026 secs 2024-04-21T14:59:48.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:48 smithi191 ceph-mon[31636]: pgmap v8891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:48.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:48 smithi170 ceph-mon[31212]: pgmap v8891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:48.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:48 smithi077 ceph-mon[27902]: pgmap v8891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16500.370786 secs 2024-04-21T14:59:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16500.370786 secs 2024-04-21T14:59:49.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16500.370786 secs 2024-04-21T14:59:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:50.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:50 smithi191 ceph-mon[31636]: pgmap v8892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:50.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:50 smithi170 ceph-mon[31212]: pgmap v8892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:50.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:50 smithi077 ceph-mon[27902]: pgmap v8892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:52 smithi191 ceph-mon[31636]: pgmap v8893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16503.610116 secs 2024-04-21T14:59:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:52 smithi170 ceph-mon[31212]: pgmap v8893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16503.610116 secs 2024-04-21T14:59:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:52 smithi077 ceph-mon[27902]: pgmap v8893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16503.610116 secs 2024-04-21T14:59:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:54 smithi191 ceph-mon[31636]: pgmap v8894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16505.370937 secs 2024-04-21T14:59:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:54 smithi170 ceph-mon[31212]: pgmap v8894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16505.370937 secs 2024-04-21T14:59:54.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:54 smithi077 ceph-mon[27902]: pgmap v8894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:54.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16505.370937 secs 2024-04-21T14:59:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T14:59:56.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:56 smithi191 ceph-mon[31636]: pgmap v8895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:56.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:56 smithi170 ceph-mon[31212]: pgmap v8895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:56.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:56 smithi077 ceph-mon[27902]: pgmap v8895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T14:59:57.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16508.610233 secs 2024-04-21T14:59:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16508.610233 secs 2024-04-21T14:59:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16508.610233 secs 2024-04-21T14:59:58.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:58 smithi170 ceph-mon[31212]: pgmap v8896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:58.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:58 smithi077 ceph-mon[27902]: pgmap v8896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:58.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:58 smithi191 ceph-mon[31636]: pgmap v8896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T14:59:59.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 14:59:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16510.371002 secs 2024-04-21T14:59:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 14:59:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16510.371002 secs 2024-04-21T14:59:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 14:59:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16510.371002 secs 2024-04-21T15:00:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:00 smithi170 ceph-mon[31212]: pgmap v8897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:00:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:00 smithi077 ceph-mon[27902]: pgmap v8897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:00:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:00 smithi191 ceph-mon[31636]: pgmap v8897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:00:02.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:02 smithi170 ceph-mon[31212]: pgmap v8898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:02.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16513.610350 secs 2024-04-21T15:00:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:02 smithi077 ceph-mon[27902]: pgmap v8898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:02.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16513.610350 secs 2024-04-21T15:00:02.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:02 smithi191 ceph-mon[31636]: pgmap v8898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:02.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16513.610350 secs 2024-04-21T15:00:04.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:04 smithi170 ceph-mon[31212]: pgmap v8899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:04.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16515.371092 secs 2024-04-21T15:00:04.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:04 smithi077 ceph-mon[27902]: pgmap v8899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:04.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16515.371092 secs 2024-04-21T15:00:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:04 smithi191 ceph-mon[31636]: pgmap v8899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:04.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16515.371092 secs 2024-04-21T15:00:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:05.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:05 smithi170 ceph-mon[31212]: osdmap e628: 12 total, 12 up, 12 in 2024-04-21T15:00:05.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:05 smithi077 ceph-mon[27902]: osdmap e628: 12 total, 12 up, 12 in 2024-04-21T15:00:05.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:05 smithi191 ceph-mon[31636]: osdmap e628: 12 total, 12 up, 12 in 2024-04-21T15:00:06.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:06 smithi170 ceph-mon[31212]: pgmap v8901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:00:06.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:06 smithi077 ceph-mon[27902]: pgmap v8901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:00:06.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:06 smithi191 ceph-mon[31636]: pgmap v8901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:00:07.763 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16518.610443 secs 2024-04-21T15:00:07.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16518.610443 secs 2024-04-21T15:00:07.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16518.610443 secs 2024-04-21T15:00:08.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:08 smithi170 ceph-mon[31212]: pgmap v8902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:00:08.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:08 smithi077 ceph-mon[27902]: pgmap v8902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:00:08.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:08 smithi191 ceph-mon[31636]: pgmap v8902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:00:09.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16520.371190 secs 2024-04-21T15:00:09.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16520.371190 secs 2024-04-21T15:00:09.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16520.371190 secs 2024-04-21T15:00:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:10.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:10 smithi170 ceph-mon[31212]: pgmap v8903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:00:10.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:10 smithi170 ceph-mon[31212]: osdmap e629: 12 total, 12 up, 12 in 2024-04-21T15:00:10.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:10 smithi077 ceph-mon[27902]: pgmap v8903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:00:10.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:10 smithi077 ceph-mon[27902]: osdmap e629: 12 total, 12 up, 12 in 2024-04-21T15:00:10.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:10 smithi191 ceph-mon[31636]: pgmap v8903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:00:10.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:10 smithi191 ceph-mon[31636]: osdmap e629: 12 total, 12 up, 12 in 2024-04-21T15:00:12.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:12 smithi170 ceph-mon[31212]: pgmap v8905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:00:12.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16523.610584 secs 2024-04-21T15:00:12.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:12 smithi077 ceph-mon[27902]: pgmap v8905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:00:12.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16523.610584 secs 2024-04-21T15:00:12.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:12 smithi191 ceph-mon[31636]: pgmap v8905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:00:12.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16523.610584 secs 2024-04-21T15:00:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:14 smithi170 ceph-mon[31212]: pgmap v8906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T15:00:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16525.371312 secs 2024-04-21T15:00:14.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:14 smithi077 ceph-mon[27902]: pgmap v8906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T15:00:14.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16525.371312 secs 2024-04-21T15:00:14.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:14 smithi191 ceph-mon[31636]: pgmap v8906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T15:00:14.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16525.371312 secs 2024-04-21T15:00:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:16.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:16 smithi170 ceph-mon[31212]: pgmap v8907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:00:16.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:16 smithi077 ceph-mon[27902]: pgmap v8907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:00:16.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:16 smithi191 ceph-mon[31636]: pgmap v8907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:00:17.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16528.610677 secs 2024-04-21T15:00:17.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16528.610677 secs 2024-04-21T15:00:17.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16528.610677 secs 2024-04-21T15:00:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:18 smithi170 ceph-mon[31212]: pgmap v8908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:00:18.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:18 smithi077 ceph-mon[27902]: pgmap v8908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:00:18.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:18 smithi191 ceph-mon[31636]: pgmap v8908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:00:19.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16530.371445 secs 2024-04-21T15:00:19.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16530.371445 secs 2024-04-21T15:00:19.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16530.371445 secs 2024-04-21T15:00:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:20 smithi170 ceph-mon[31212]: pgmap v8909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:00:20.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:20 smithi077 ceph-mon[27902]: pgmap v8909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:00:20.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:20 smithi191 ceph-mon[31636]: pgmap v8909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:00:22.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:22 smithi170 ceph-mon[31212]: pgmap v8910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:00:22.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16533.610742 secs 2024-04-21T15:00:22.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:22 smithi077 ceph-mon[27902]: pgmap v8910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:00:22.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16533.610742 secs 2024-04-21T15:00:22.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:22 smithi191 ceph-mon[31636]: pgmap v8910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:00:22.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16533.610742 secs 2024-04-21T15:00:24.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:24 smithi170 ceph-mon[31212]: pgmap v8911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:24.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16535.371601 secs 2024-04-21T15:00:24.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:24 smithi077 ceph-mon[27902]: pgmap v8911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:24.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16535.371601 secs 2024-04-21T15:00:24.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:24 smithi191 ceph-mon[31636]: pgmap v8911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:24.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16535.371601 secs 2024-04-21T15:00:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:26.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:26 smithi170 ceph-mon[31212]: pgmap v8912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:26.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:26 smithi077 ceph-mon[27902]: pgmap v8912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:26.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:26 smithi191 ceph-mon[31636]: pgmap v8912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:27.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16538.610849 secs 2024-04-21T15:00:27.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16538.610849 secs 2024-04-21T15:00:27.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16538.610849 secs 2024-04-21T15:00:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:28 smithi170 ceph-mon[31212]: pgmap v8913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:28.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:28 smithi077 ceph-mon[27902]: pgmap v8913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:28.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:28 smithi191 ceph-mon[31636]: pgmap v8913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:29.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16540.371738 secs 2024-04-21T15:00:29.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16540.371738 secs 2024-04-21T15:00:30.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16540.371738 secs 2024-04-21T15:00:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:30 smithi077 ceph-mon[27902]: pgmap v8914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:30.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:30 smithi191 ceph-mon[31636]: pgmap v8914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:31.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:30 smithi170 ceph-mon[31212]: pgmap v8914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:32.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:32 smithi077 ceph-mon[27902]: pgmap v8915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:32.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16543.610917 secs 2024-04-21T15:00:32.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:00:32.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:32 smithi191 ceph-mon[31636]: pgmap v8915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:32.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16543.610917 secs 2024-04-21T15:00:32.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:00:33.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:32 smithi170 ceph-mon[31212]: pgmap v8915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:33.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16543.610917 secs 2024-04-21T15:00:33.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:00:33.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:00:33.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:00:33.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:00:33.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:00:33.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:00:33.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:00:34.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:00:34.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:00:34.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:00:34.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:34 smithi077 ceph-mon[27902]: pgmap v8916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:34.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16545.371828 secs 2024-04-21T15:00:34.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:34 smithi191 ceph-mon[31636]: pgmap v8916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:34.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16545.371828 secs 2024-04-21T15:00:35.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:34 smithi170 ceph-mon[31212]: pgmap v8916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:35.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16545.371828 secs 2024-04-21T15:00:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:36.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:36 smithi077 ceph-mon[27902]: pgmap v8917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:36.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:36 smithi191 ceph-mon[31636]: pgmap v8917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:37.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:36 smithi170 ceph-mon[31212]: pgmap v8917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:37.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16548.610977 secs 2024-04-21T15:00:37.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16548.610977 secs 2024-04-21T15:00:38.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16548.610977 secs 2024-04-21T15:00:38.853 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:38 smithi170 ceph-mon[31212]: pgmap v8918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:38.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:38 smithi077 ceph-mon[27902]: pgmap v8918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:38.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:38 smithi191 ceph-mon[31636]: pgmap v8918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:39.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16550.371951 secs 2024-04-21T15:00:39.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16550.371951 secs 2024-04-21T15:00:40.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16550.371951 secs 2024-04-21T15:00:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:40.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:40 smithi077 ceph-mon[27902]: pgmap v8919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:40.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:40 smithi191 ceph-mon[31636]: pgmap v8919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:40 smithi170 ceph-mon[31212]: pgmap v8919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:42.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:42 smithi077 ceph-mon[27902]: pgmap v8920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:42.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16553.611093 secs 2024-04-21T15:00:42.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:42 smithi191 ceph-mon[31636]: pgmap v8920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:42.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16553.611093 secs 2024-04-21T15:00:43.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:42 smithi170 ceph-mon[31212]: pgmap v8920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:43.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16553.611093 secs 2024-04-21T15:00:44.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:44 smithi077 ceph-mon[27902]: pgmap v8921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:44.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16555.372066 secs 2024-04-21T15:00:44.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:44 smithi191 ceph-mon[31636]: pgmap v8921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:44.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16555.372066 secs 2024-04-21T15:00:45.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:44 smithi170 ceph-mon[31212]: pgmap v8921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:45.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16555.372066 secs 2024-04-21T15:00:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:46.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:46 smithi077 ceph-mon[27902]: pgmap v8922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:46.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:46 smithi191 ceph-mon[31636]: pgmap v8922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:47.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:46 smithi170 ceph-mon[31212]: pgmap v8922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:00:47.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16558.611209 secs 2024-04-21T15:00:47.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16558.611209 secs 2024-04-21T15:00:48.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16558.611209 secs 2024-04-21T15:00:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:48 smithi077 ceph-mon[27902]: pgmap v8923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:48.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:48 smithi191 ceph-mon[31636]: pgmap v8923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:49.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:48 smithi170 ceph-mon[31212]: pgmap v8923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:49.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16560.372181 secs 2024-04-21T15:00:49.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16560.372181 secs 2024-04-21T15:00:50.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16560.372181 secs 2024-04-21T15:00:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:50 smithi077 ceph-mon[27902]: pgmap v8924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:50.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:50 smithi191 ceph-mon[31636]: pgmap v8924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:51.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:50 smithi170 ceph-mon[31212]: pgmap v8924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:52.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:52 smithi077 ceph-mon[27902]: pgmap v8925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:52.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16563.611283 secs 2024-04-21T15:00:52.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:52 smithi191 ceph-mon[31636]: pgmap v8925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:52.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16563.611283 secs 2024-04-21T15:00:53.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:52 smithi170 ceph-mon[31212]: pgmap v8925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:53.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16563.611283 secs 2024-04-21T15:00:53.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:53 smithi191 ceph-mon[31636]: pgmap v8926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:53.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16565.372283 secs 2024-04-21T15:00:54.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:53 smithi170 ceph-mon[31212]: pgmap v8926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:54.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16565.372283 secs 2024-04-21T15:00:54.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:53 smithi077 ceph-mon[27902]: pgmap v8926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:54.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16565.372283 secs 2024-04-21T15:00:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:00:56.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:56 smithi170 ceph-mon[31212]: pgmap v8927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:56.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:56 smithi077 ceph-mon[27902]: pgmap v8927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:56.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:56 smithi191 ceph-mon[31636]: pgmap v8927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:00:57.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16568.611393 secs 2024-04-21T15:00:57.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16568.611393 secs 2024-04-21T15:00:57.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16568.611393 secs 2024-04-21T15:00:58.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:58 smithi170 ceph-mon[31212]: pgmap v8928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:58.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:58 smithi077 ceph-mon[27902]: pgmap v8928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:58.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:58 smithi191 ceph-mon[31636]: pgmap v8928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:00:59.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:00:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16570.372407 secs 2024-04-21T15:00:59.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:00:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16570.372407 secs 2024-04-21T15:00:59.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:00:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16570.372407 secs 2024-04-21T15:01:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:00.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:00 smithi170 ceph-mon[31212]: pgmap v8929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:00.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:00 smithi077 ceph-mon[27902]: pgmap v8929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:00.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:00 smithi191 ceph-mon[31636]: pgmap v8929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:02.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:02 smithi170 ceph-mon[31212]: pgmap v8930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:02.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16573.611523 secs 2024-04-21T15:01:02.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:02 smithi077 ceph-mon[27902]: pgmap v8930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:02.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16573.611523 secs 2024-04-21T15:01:02.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:02 smithi191 ceph-mon[31636]: pgmap v8930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:02.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16573.611523 secs 2024-04-21T15:01:04.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:04 smithi170 ceph-mon[31212]: pgmap v8931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:04.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16575.372503 secs 2024-04-21T15:01:04.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:04 smithi077 ceph-mon[27902]: pgmap v8931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:04.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16575.372503 secs 2024-04-21T15:01:04.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:04 smithi191 ceph-mon[31636]: pgmap v8931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:04.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16575.372503 secs 2024-04-21T15:01:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:05.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:05 smithi170 ceph-mon[31212]: osdmap e630: 12 total, 12 up, 12 in 2024-04-21T15:01:05.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:05 smithi077 ceph-mon[27902]: osdmap e630: 12 total, 12 up, 12 in 2024-04-21T15:01:05.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:05 smithi191 ceph-mon[31636]: osdmap e630: 12 total, 12 up, 12 in 2024-04-21T15:01:06.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:06 smithi170 ceph-mon[31212]: pgmap v8933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:01:06.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:06 smithi077 ceph-mon[27902]: pgmap v8933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:01:06.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:06 smithi191 ceph-mon[31636]: pgmap v8933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:01:07.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16578.611634 secs 2024-04-21T15:01:07.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16578.611634 secs 2024-04-21T15:01:07.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16578.611634 secs 2024-04-21T15:01:08.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:08 smithi077 ceph-mon[27902]: pgmap v8934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:01:08.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:08 smithi191 ceph-mon[31636]: pgmap v8934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:01:08.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:08 smithi170 ceph-mon[31212]: pgmap v8934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:01:09.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16580.372587 secs 2024-04-21T15:01:09.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16580.372587 secs 2024-04-21T15:01:09.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16580.372587 secs 2024-04-21T15:01:10.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:10.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:10 smithi077 ceph-mon[27902]: pgmap v8935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:01:10.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:10 smithi077 ceph-mon[27902]: osdmap e631: 12 total, 12 up, 12 in 2024-04-21T15:01:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:10 smithi191 ceph-mon[31636]: pgmap v8935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:01:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:10 smithi191 ceph-mon[31636]: osdmap e631: 12 total, 12 up, 12 in 2024-04-21T15:01:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:10 smithi170 ceph-mon[31212]: pgmap v8935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:01:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:10 smithi170 ceph-mon[31212]: osdmap e631: 12 total, 12 up, 12 in 2024-04-21T15:01:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:11.644+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:01:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:11.644+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:01:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:11.644+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:01:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:11.644+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:01:12.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:12 smithi077 ceph-mon[27902]: pgmap v8937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:01:12.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16583.611781 secs 2024-04-21T15:01:12.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:12 smithi191 ceph-mon[31636]: pgmap v8937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:01:12.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16583.611781 secs 2024-04-21T15:01:12.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:12 smithi170 ceph-mon[31212]: pgmap v8937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:01:12.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16583.611781 secs 2024-04-21T15:01:14.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:14 smithi077 ceph-mon[27902]: pgmap v8938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:01:14.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16585.372725 secs 2024-04-21T15:01:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:14 smithi191 ceph-mon[31636]: pgmap v8938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:01:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16585.372725 secs 2024-04-21T15:01:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:14 smithi170 ceph-mon[31212]: pgmap v8938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:01:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16585.372725 secs 2024-04-21T15:01:15.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:16.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:16 smithi077 ceph-mon[27902]: pgmap v8939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:01:16.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:16 smithi191 ceph-mon[31636]: pgmap v8939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:01:16.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:16 smithi170 ceph-mon[31212]: pgmap v8939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:01:17.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16588.611901 secs 2024-04-21T15:01:17.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16588.611901 secs 2024-04-21T15:01:17.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16588.611901 secs 2024-04-21T15:01:18.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:18 smithi077 ceph-mon[27902]: pgmap v8940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:01:18.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:18 smithi191 ceph-mon[31636]: pgmap v8940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:01:18.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:18 smithi170 ceph-mon[31212]: pgmap v8940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:01:19.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16590.372840 secs 2024-04-21T15:01:19.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16590.372840 secs 2024-04-21T15:01:19.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16590.372840 secs 2024-04-21T15:01:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:20.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:20 smithi077 ceph-mon[27902]: pgmap v8941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:01:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:20 smithi191 ceph-mon[31636]: pgmap v8941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:01:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:20 smithi170 ceph-mon[31212]: pgmap v8941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:01:22.080 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:22 smithi077 ceph-mon[27902]: pgmap v8942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:01:22.080 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16593.612018 secs 2024-04-21T15:01:22.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:22 smithi191 ceph-mon[31636]: pgmap v8942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:01:22.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16593.612018 secs 2024-04-21T15:01:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:22 smithi170 ceph-mon[31212]: pgmap v8942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:01:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16593.612018 secs 2024-04-21T15:01:24.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:24 smithi077 ceph-mon[27902]: pgmap v8943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:24.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16595.372959 secs 2024-04-21T15:01:24.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:24 smithi191 ceph-mon[31636]: pgmap v8943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:24.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16595.372959 secs 2024-04-21T15:01:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:24 smithi170 ceph-mon[31212]: pgmap v8943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16595.372959 secs 2024-04-21T15:01:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:26.339 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:26 smithi170 ceph-mon[31212]: pgmap v8944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:26.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:26 smithi077 ceph-mon[27902]: pgmap v8944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:26 smithi191 ceph-mon[31636]: pgmap v8944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:27.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16598.612092 secs 2024-04-21T15:01:27.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16598.612092 secs 2024-04-21T15:01:27.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16598.612092 secs 2024-04-21T15:01:28.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:28 smithi077 ceph-mon[27902]: pgmap v8945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:28 smithi191 ceph-mon[31636]: pgmap v8945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:28 smithi170 ceph-mon[31212]: pgmap v8945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:29.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16600.373037 secs 2024-04-21T15:01:29.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16600.373037 secs 2024-04-21T15:01:29.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16600.373037 secs 2024-04-21T15:01:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:30 smithi077 ceph-mon[27902]: pgmap v8946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:30 smithi191 ceph-mon[31636]: pgmap v8946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:30.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:30 smithi170 ceph-mon[31212]: pgmap v8946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:32.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:32 smithi077 ceph-mon[27902]: pgmap v8947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:32.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16603.612209 secs 2024-04-21T15:01:32.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:32 smithi191 ceph-mon[31636]: pgmap v8947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:32.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16603.612209 secs 2024-04-21T15:01:32.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:32 smithi170 ceph-mon[31212]: pgmap v8947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:32.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16603.612209 secs 2024-04-21T15:01:33.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:01:33.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:01:33.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:01:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:34 smithi077 ceph-mon[27902]: pgmap v8948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16605.373112 secs 2024-04-21T15:01:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:01:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:01:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:01:34.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:34 smithi191 ceph-mon[31636]: pgmap v8948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:34.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16605.373112 secs 2024-04-21T15:01:34.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:01:34.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:01:34.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:01:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:34 smithi170 ceph-mon[31212]: pgmap v8948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16605.373112 secs 2024-04-21T15:01:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:01:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:01:34.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:01:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:36.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:36 smithi077 ceph-mon[27902]: pgmap v8949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:36.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:36 smithi191 ceph-mon[31636]: pgmap v8949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:36.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:36 smithi170 ceph-mon[31212]: pgmap v8949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:37.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16608.612319 secs 2024-04-21T15:01:37.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16608.612319 secs 2024-04-21T15:01:37.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16608.612319 secs 2024-04-21T15:01:38.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:38 smithi191 ceph-mon[31636]: pgmap v8950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:38.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:38 smithi170 ceph-mon[31212]: pgmap v8950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:38.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:38 smithi077 ceph-mon[27902]: pgmap v8950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:39.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16610.373229 secs 2024-04-21T15:01:39.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16610.373229 secs 2024-04-21T15:01:39.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16610.373229 secs 2024-04-21T15:01:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:40.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:40 smithi191 ceph-mon[31636]: pgmap v8951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:40.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:40 smithi170 ceph-mon[31212]: pgmap v8951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:40.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:40 smithi077 ceph-mon[27902]: pgmap v8951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:42.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:42 smithi191 ceph-mon[31636]: pgmap v8952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:42.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16613.612457 secs 2024-04-21T15:01:42.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:42 smithi170 ceph-mon[31212]: pgmap v8952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:42.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16613.612457 secs 2024-04-21T15:01:42.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:42 smithi077 ceph-mon[27902]: pgmap v8952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:42.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16613.612457 secs 2024-04-21T15:01:44.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:44 smithi191 ceph-mon[31636]: pgmap v8953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:44.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16615.373321 secs 2024-04-21T15:01:44.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:44 smithi170 ceph-mon[31212]: pgmap v8953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:44.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16615.373321 secs 2024-04-21T15:01:44.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:44 smithi077 ceph-mon[27902]: pgmap v8953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:44.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16615.373321 secs 2024-04-21T15:01:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:46.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:46 smithi191 ceph-mon[31636]: pgmap v8954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:46.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:46 smithi170 ceph-mon[31212]: pgmap v8954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:46.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:46 smithi077 ceph-mon[27902]: pgmap v8954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:47.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16618.612567 secs 2024-04-21T15:01:47.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16618.612567 secs 2024-04-21T15:01:47.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16618.612567 secs 2024-04-21T15:01:48.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:48 smithi191 ceph-mon[31636]: pgmap v8955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:48.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:48 smithi170 ceph-mon[31212]: pgmap v8955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:48.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:48 smithi077 ceph-mon[27902]: pgmap v8955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:49.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16620.373439 secs 2024-04-21T15:01:49.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16620.373439 secs 2024-04-21T15:01:49.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16620.373439 secs 2024-04-21T15:01:50.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:50.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:50 smithi191 ceph-mon[31636]: pgmap v8956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:50.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:50 smithi170 ceph-mon[31212]: pgmap v8956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:50.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:50 smithi077 ceph-mon[27902]: pgmap v8956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:52.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:52 smithi191 ceph-mon[31636]: pgmap v8957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:52.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16623.612685 secs 2024-04-21T15:01:52.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:52 smithi170 ceph-mon[31212]: pgmap v8957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:52.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16623.612685 secs 2024-04-21T15:01:52.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:52 smithi077 ceph-mon[27902]: pgmap v8957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:52.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16623.612685 secs 2024-04-21T15:01:54.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:54 smithi191 ceph-mon[31636]: pgmap v8958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:54.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16625.373536 secs 2024-04-21T15:01:54.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:54 smithi170 ceph-mon[31212]: pgmap v8958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:54.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16625.373536 secs 2024-04-21T15:01:54.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:54 smithi077 ceph-mon[27902]: pgmap v8958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:54.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16625.373536 secs 2024-04-21T15:01:55.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:01:56.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:56 smithi191 ceph-mon[31636]: pgmap v8959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:56.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:56 smithi170 ceph-mon[31212]: pgmap v8959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:56.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:56 smithi077 ceph-mon[27902]: pgmap v8959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:01:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:56.650+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:01:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:56.650+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:01:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:56.651+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:01:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:01:56.651+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:01:57.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16628.612794 secs 2024-04-21T15:01:57.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16628.612794 secs 2024-04-21T15:01:57.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16628.612794 secs 2024-04-21T15:01:58.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:58 smithi191 ceph-mon[31636]: pgmap v8960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:58 smithi170 ceph-mon[31212]: pgmap v8960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:58.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:58 smithi077 ceph-mon[27902]: pgmap v8960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:01:59.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:01:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16630.373656 secs 2024-04-21T15:01:59.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:01:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16630.373656 secs 2024-04-21T15:01:59.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:01:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16630.373656 secs 2024-04-21T15:02:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:00.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:00 smithi191 ceph-mon[31636]: pgmap v8961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:00.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:00 smithi170 ceph-mon[31212]: pgmap v8961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:00.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:00 smithi077 ceph-mon[27902]: pgmap v8961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:02.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:02 smithi191 ceph-mon[31636]: pgmap v8962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T15:02:02.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16633.612890 secs 2024-04-21T15:02:02.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:02 smithi170 ceph-mon[31212]: pgmap v8962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T15:02:02.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16633.612890 secs 2024-04-21T15:02:02.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:02 smithi077 ceph-mon[27902]: pgmap v8962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T15:02:02.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16633.612890 secs 2024-04-21T15:02:04.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:04 smithi191 ceph-mon[31636]: pgmap v8963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T15:02:04.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16635.373756 secs 2024-04-21T15:02:04.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:04 smithi170 ceph-mon[31212]: pgmap v8963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T15:02:04.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16635.373756 secs 2024-04-21T15:02:04.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:04 smithi077 ceph-mon[27902]: pgmap v8963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T15:02:04.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16635.373756 secs 2024-04-21T15:02:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:05.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:05 smithi191 ceph-mon[31636]: osdmap e632: 12 total, 12 up, 12 in 2024-04-21T15:02:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:05 smithi170 ceph-mon[31212]: osdmap e632: 12 total, 12 up, 12 in 2024-04-21T15:02:05.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:05 smithi077 ceph-mon[27902]: osdmap e632: 12 total, 12 up, 12 in 2024-04-21T15:02:06.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:06 smithi191 ceph-mon[31636]: pgmap v8965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T15:02:06.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:06 smithi170 ceph-mon[31212]: pgmap v8965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T15:02:06.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:06 smithi077 ceph-mon[27902]: pgmap v8965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T15:02:07.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16638.613013 secs 2024-04-21T15:02:07.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16638.613013 secs 2024-04-21T15:02:07.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16638.613013 secs 2024-04-21T15:02:08.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:08 smithi191 ceph-mon[31636]: pgmap v8966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:02:08.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:08 smithi170 ceph-mon[31212]: pgmap v8966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:02:08.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:08 smithi077 ceph-mon[27902]: pgmap v8966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:02:09.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16640.373885 secs 2024-04-21T15:02:09.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16640.373885 secs 2024-04-21T15:02:09.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16640.373885 secs 2024-04-21T15:02:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:10 smithi170 ceph-mon[31212]: pgmap v8967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:02:10.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:10 smithi170 ceph-mon[31212]: osdmap e633: 12 total, 12 up, 12 in 2024-04-21T15:02:10.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:10 smithi077 ceph-mon[27902]: pgmap v8967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:02:10.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:10 smithi077 ceph-mon[27902]: osdmap e633: 12 total, 12 up, 12 in 2024-04-21T15:02:10.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:10 smithi191 ceph-mon[31636]: pgmap v8967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:02:10.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:10 smithi191 ceph-mon[31636]: osdmap e633: 12 total, 12 up, 12 in 2024-04-21T15:02:12.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:12 smithi170 ceph-mon[31212]: pgmap v8969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T15:02:12.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16643.613117 secs 2024-04-21T15:02:12.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:12 smithi077 ceph-mon[27902]: pgmap v8969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T15:02:12.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16643.613117 secs 2024-04-21T15:02:12.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:12 smithi191 ceph-mon[31636]: pgmap v8969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T15:02:12.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16643.613117 secs 2024-04-21T15:02:14.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:14 smithi170 ceph-mon[31212]: pgmap v8970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T15:02:14.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16645.374001 secs 2024-04-21T15:02:14.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:14 smithi077 ceph-mon[27902]: pgmap v8970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T15:02:14.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16645.374001 secs 2024-04-21T15:02:14.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:14 smithi191 ceph-mon[31636]: pgmap v8970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T15:02:14.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16645.374001 secs 2024-04-21T15:02:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:16.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:16 smithi170 ceph-mon[31212]: pgmap v8971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T15:02:16.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:16 smithi077 ceph-mon[27902]: pgmap v8971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T15:02:16.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:16 smithi191 ceph-mon[31636]: pgmap v8971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T15:02:17.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16648.613193 secs 2024-04-21T15:02:17.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16648.613193 secs 2024-04-21T15:02:17.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16648.613193 secs 2024-04-21T15:02:18.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:18 smithi170 ceph-mon[31212]: pgmap v8972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:02:18.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:18 smithi077 ceph-mon[27902]: pgmap v8972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:02:18.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:18 smithi191 ceph-mon[31636]: pgmap v8972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:02:19.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16650.374096 secs 2024-04-21T15:02:19.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16650.374096 secs 2024-04-21T15:02:19.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16650.374096 secs 2024-04-21T15:02:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:20.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:20 smithi170 ceph-mon[31212]: pgmap v8973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:02:20.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:20 smithi077 ceph-mon[27902]: pgmap v8973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:02:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:20 smithi191 ceph-mon[31636]: pgmap v8973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:02:22.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:22 smithi170 ceph-mon[31212]: pgmap v8974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:02:22.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16653.613322 secs 2024-04-21T15:02:22.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:22 smithi077 ceph-mon[27902]: pgmap v8974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:02:22.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16653.613322 secs 2024-04-21T15:02:22.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:22 smithi191 ceph-mon[31636]: pgmap v8974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:02:22.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16653.613322 secs 2024-04-21T15:02:24.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:24 smithi170 ceph-mon[31212]: pgmap v8975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:24.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16655.374197 secs 2024-04-21T15:02:24.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:24 smithi077 ceph-mon[27902]: pgmap v8975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:24.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16655.374197 secs 2024-04-21T15:02:24.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:24 smithi191 ceph-mon[31636]: pgmap v8975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:24.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16655.374197 secs 2024-04-21T15:02:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:26.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:26 smithi191 ceph-mon[31636]: pgmap v8976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:26.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:26 smithi170 ceph-mon[31212]: pgmap v8976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:26.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:26 smithi077 ceph-mon[27902]: pgmap v8976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:27.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16658.613431 secs 2024-04-21T15:02:27.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16658.613431 secs 2024-04-21T15:02:27.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16658.613431 secs 2024-04-21T15:02:28.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:28 smithi170 ceph-mon[31212]: pgmap v8977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:28.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:28 smithi077 ceph-mon[27902]: pgmap v8977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:28.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:28 smithi191 ceph-mon[31636]: pgmap v8977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:29.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16660.374338 secs 2024-04-21T15:02:29.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16660.374338 secs 2024-04-21T15:02:29.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16660.374338 secs 2024-04-21T15:02:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:30.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:30 smithi170 ceph-mon[31212]: pgmap v8978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:30.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:30 smithi077 ceph-mon[27902]: pgmap v8978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:30.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:30 smithi191 ceph-mon[31636]: pgmap v8978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:32.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:32 smithi170 ceph-mon[31212]: pgmap v8979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:32.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16663.613550 secs 2024-04-21T15:02:32.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:32 smithi077 ceph-mon[27902]: pgmap v8979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:32.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16663.613550 secs 2024-04-21T15:02:32.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:32 smithi191 ceph-mon[31636]: pgmap v8979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:32.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16663.613550 secs 2024-04-21T15:02:34.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:34 smithi170 ceph-mon[31212]: pgmap v8980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:34.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16665.374411 secs 2024-04-21T15:02:34.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:02:34.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:34 smithi077 ceph-mon[27902]: pgmap v8980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:34.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16665.374411 secs 2024-04-21T15:02:34.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:02:34.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:34 smithi191 ceph-mon[31636]: pgmap v8980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:34.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16665.374411 secs 2024-04-21T15:02:34.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:02:35.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:35.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:02:35.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:02:35.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:02:35.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:02:35.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:02:35.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:02:35.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:02:35.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:02:35.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:02:36.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:36 smithi077 ceph-mon[27902]: pgmap v8981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:36.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:36 smithi191 ceph-mon[31636]: pgmap v8981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:36.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:36 smithi170 ceph-mon[31212]: pgmap v8981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:37.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16668.613663 secs 2024-04-21T15:02:37.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16668.613663 secs 2024-04-21T15:02:37.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16668.613663 secs 2024-04-21T15:02:38.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:38 smithi191 ceph-mon[31636]: pgmap v8982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:38.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:38 smithi170 ceph-mon[31212]: pgmap v8982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:38.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:38 smithi077 ceph-mon[27902]: pgmap v8982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:39.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16670.374523 secs 2024-04-21T15:02:39.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16670.374523 secs 2024-04-21T15:02:39.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16670.374523 secs 2024-04-21T15:02:40.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:40.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:40 smithi191 ceph-mon[31636]: pgmap v8983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:40.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:40 smithi170 ceph-mon[31212]: pgmap v8983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:40.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:40 smithi077 ceph-mon[27902]: pgmap v8983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:42.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:42 smithi191 ceph-mon[31636]: pgmap v8984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:42.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16673.613795 secs 2024-04-21T15:02:42.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:42 smithi170 ceph-mon[31212]: pgmap v8984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:42.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16673.613795 secs 2024-04-21T15:02:42.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:42 smithi077 ceph-mon[27902]: pgmap v8984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:42.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16673.613795 secs 2024-04-21T15:02:44.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:44 smithi191 ceph-mon[31636]: pgmap v8985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:44.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16675.374631 secs 2024-04-21T15:02:44.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:44 smithi170 ceph-mon[31212]: pgmap v8985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:44.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16675.374631 secs 2024-04-21T15:02:44.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:44 smithi077 ceph-mon[27902]: pgmap v8985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:44.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16675.374631 secs 2024-04-21T15:02:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:46.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:46 smithi191 ceph-mon[31636]: pgmap v8986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:46.793 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:46 smithi170 ceph-mon[31212]: pgmap v8986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:46.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:46 smithi077 ceph-mon[27902]: pgmap v8986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:47.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16678.613906 secs 2024-04-21T15:02:47.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16678.613906 secs 2024-04-21T15:02:47.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16678.613906 secs 2024-04-21T15:02:48.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:48 smithi191 ceph-mon[31636]: pgmap v8987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:48.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:48 smithi170 ceph-mon[31212]: pgmap v8987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:48.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:48 smithi077 ceph-mon[27902]: pgmap v8987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:49.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16680.374752 secs 2024-04-21T15:02:49.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16680.374752 secs 2024-04-21T15:02:49.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16680.374752 secs 2024-04-21T15:02:50.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:50.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:50 smithi191 ceph-mon[31636]: pgmap v8988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:50.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:50 smithi170 ceph-mon[31212]: pgmap v8988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:50.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:50 smithi077 ceph-mon[27902]: pgmap v8988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:52.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:52 smithi191 ceph-mon[31636]: pgmap v8989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:52.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16683.613981 secs 2024-04-21T15:02:52.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:52 smithi170 ceph-mon[31212]: pgmap v8989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:52.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16683.613981 secs 2024-04-21T15:02:52.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:52 smithi077 ceph-mon[27902]: pgmap v8989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:52.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16683.613981 secs 2024-04-21T15:02:54.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:54 smithi191 ceph-mon[31636]: pgmap v8990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:54.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16685.374870 secs 2024-04-21T15:02:54.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:54 smithi170 ceph-mon[31212]: pgmap v8990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:54.793 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16685.374870 secs 2024-04-21T15:02:54.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:54 smithi077 ceph-mon[27902]: pgmap v8990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:54.871 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16685.374870 secs 2024-04-21T15:02:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:02:56.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:56 smithi191 ceph-mon[31636]: pgmap v8991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:56.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:56 smithi170 ceph-mon[31212]: pgmap v8991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:56.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:56 smithi077 ceph-mon[27902]: pgmap v8991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:02:57.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16688.614094 secs 2024-04-21T15:02:57.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16688.614094 secs 2024-04-21T15:02:57.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16688.614094 secs 2024-04-21T15:02:58.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:58 smithi191 ceph-mon[31636]: pgmap v8992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:58.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:58 smithi170 ceph-mon[31212]: pgmap v8992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:58.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:58 smithi077 ceph-mon[27902]: pgmap v8992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:02:59.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:02:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16690.374996 secs 2024-04-21T15:02:59.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:02:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16690.374996 secs 2024-04-21T15:02:59.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:02:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16690.374996 secs 2024-04-21T15:03:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:00.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:00 smithi191 ceph-mon[31636]: pgmap v8993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:00.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:00 smithi170 ceph-mon[31212]: pgmap v8993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:00.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:00 smithi077 ceph-mon[27902]: pgmap v8993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:02.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:02 smithi191 ceph-mon[31636]: pgmap v8994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T15:03:02.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16693.614244 secs 2024-04-21T15:03:02.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:02 smithi170 ceph-mon[31212]: pgmap v8994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T15:03:02.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16693.614244 secs 2024-04-21T15:03:02.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:02 smithi077 ceph-mon[27902]: pgmap v8994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T15:03:02.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16693.614244 secs 2024-04-21T15:03:04.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:04 smithi191 ceph-mon[31636]: pgmap v8995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T15:03:04.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16695.375091 secs 2024-04-21T15:03:04.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:04 smithi170 ceph-mon[31212]: pgmap v8995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T15:03:04.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16695.375091 secs 2024-04-21T15:03:04.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:04 smithi077 ceph-mon[27902]: pgmap v8995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T15:03:04.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16695.375091 secs 2024-04-21T15:03:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:05.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:05 smithi191 ceph-mon[31636]: osdmap e634: 12 total, 12 up, 12 in 2024-04-21T15:03:05.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:05 smithi170 ceph-mon[31212]: osdmap e634: 12 total, 12 up, 12 in 2024-04-21T15:03:05.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:05 smithi077 ceph-mon[27902]: osdmap e634: 12 total, 12 up, 12 in 2024-04-21T15:03:06.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:06 smithi191 ceph-mon[31636]: pgmap v8997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T15:03:06.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:06 smithi170 ceph-mon[31212]: pgmap v8997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T15:03:06.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:06 smithi077 ceph-mon[27902]: pgmap v8997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T15:03:07.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16698.614348 secs 2024-04-21T15:03:07.771 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16698.614348 secs 2024-04-21T15:03:07.792 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16698.614348 secs 2024-04-21T15:03:08.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:08 smithi170 ceph-mon[31212]: pgmap v8998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:03:08.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:08 smithi077 ceph-mon[27902]: pgmap v8998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:03:08.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:08 smithi191 ceph-mon[31636]: pgmap v8998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:03:09.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16700.375215 secs 2024-04-21T15:03:09.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16700.375215 secs 2024-04-21T15:03:09.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16700.375215 secs 2024-04-21T15:03:10.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:10.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:10 smithi170 ceph-mon[31212]: pgmap v8999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:03:10.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:10 smithi077 ceph-mon[27902]: pgmap v8999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:03:10.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:10 smithi191 ceph-mon[31636]: pgmap v8999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:03:12.792 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:12 smithi170 ceph-mon[31212]: pgmap v9000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:12.792 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16703.614494 secs 2024-04-21T15:03:12.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:12 smithi077 ceph-mon[27902]: pgmap v9000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:12.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16703.614494 secs 2024-04-21T15:03:12.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:12 smithi191 ceph-mon[31636]: pgmap v9000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:12.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16703.614494 secs 2024-04-21T15:03:14.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:14 smithi170 ceph-mon[31212]: pgmap v9001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:14.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16705.375355 secs 2024-04-21T15:03:14.871 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:14 smithi077 ceph-mon[27902]: pgmap v9001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:14.871 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16705.375355 secs 2024-04-21T15:03:14.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:14 smithi191 ceph-mon[31636]: pgmap v9001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:14.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16705.375355 secs 2024-04-21T15:03:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:15 smithi191 ceph-mon[31636]: osdmap e635: 12 total, 12 up, 12 in 2024-04-21T15:03:16.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:15 smithi191 ceph-mon[31636]: pgmap v9003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:16.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:15 smithi170 ceph-mon[31212]: osdmap e635: 12 total, 12 up, 12 in 2024-04-21T15:03:16.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:15 smithi170 ceph-mon[31212]: pgmap v9003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:15 smithi077 ceph-mon[27902]: osdmap e635: 12 total, 12 up, 12 in 2024-04-21T15:03:16.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:15 smithi077 ceph-mon[27902]: pgmap v9003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T15:03:17.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:16 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16708.614554 secs 2024-04-21T15:03:17.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:16 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16708.614554 secs 2024-04-21T15:03:17.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:16 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16708.614554 secs 2024-04-21T15:03:18.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:17 smithi170 ceph-mon[31212]: pgmap v9004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:03:18.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:17 smithi077 ceph-mon[27902]: pgmap v9004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:03:18.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:17 smithi191 ceph-mon[31636]: pgmap v9004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:03:19.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16710.375476 secs 2024-04-21T15:03:19.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16710.375476 secs 2024-04-21T15:03:19.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16710.375476 secs 2024-04-21T15:03:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:20.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:19 smithi170 ceph-mon[31212]: pgmap v9005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:03:20.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:19 smithi077 ceph-mon[27902]: pgmap v9005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:03:20.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:19 smithi191 ceph-mon[31636]: pgmap v9005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:03:22.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:22 smithi077 ceph-mon[27902]: pgmap v9006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:22.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16713.614666 secs 2024-04-21T15:03:22.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:22 smithi191 ceph-mon[31636]: pgmap v9006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:22.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16713.614666 secs 2024-04-21T15:03:22.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:22 smithi170 ceph-mon[31212]: pgmap v9006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:22.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16713.614666 secs 2024-04-21T15:03:24.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:24 smithi077 ceph-mon[27902]: pgmap v9007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:24.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16715.375618 secs 2024-04-21T15:03:24.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:24 smithi191 ceph-mon[31636]: pgmap v9007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:24.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16715.375618 secs 2024-04-21T15:03:24.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:24 smithi170 ceph-mon[31212]: pgmap v9007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:24.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16715.375618 secs 2024-04-21T15:03:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:26.345 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:26 smithi170 ceph-mon[31212]: pgmap v9008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:26.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:26 smithi077 ceph-mon[27902]: pgmap v9008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:26.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:26 smithi191 ceph-mon[31636]: pgmap v9008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:03:27.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16718.614832 secs 2024-04-21T15:03:27.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16718.614832 secs 2024-04-21T15:03:27.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16718.614832 secs 2024-04-21T15:03:28.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:28 smithi077 ceph-mon[27902]: pgmap v9009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:28.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:28 smithi191 ceph-mon[31636]: pgmap v9009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:28.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:28 smithi170 ceph-mon[31212]: pgmap v9009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:29.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16720.375745 secs 2024-04-21T15:03:29.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16720.375745 secs 2024-04-21T15:03:29.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16720.375745 secs 2024-04-21T15:03:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:30.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:30 smithi077 ceph-mon[27902]: pgmap v9010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:30.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:30 smithi191 ceph-mon[31636]: pgmap v9010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:30.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:30 smithi170 ceph-mon[31212]: pgmap v9010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:32.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:32 smithi077 ceph-mon[27902]: pgmap v9011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:32.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16723.614960 secs 2024-04-21T15:03:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:32 smithi191 ceph-mon[31636]: pgmap v9011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16723.614960 secs 2024-04-21T15:03:32.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:32 smithi170 ceph-mon[31212]: pgmap v9011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:32.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16723.614960 secs 2024-04-21T15:03:34.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:34 smithi077 ceph-mon[27902]: pgmap v9012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:34.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16725.375886 secs 2024-04-21T15:03:34.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:34 smithi191 ceph-mon[31636]: pgmap v9012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:34.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16725.375886 secs 2024-04-21T15:03:34.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:34 smithi170 ceph-mon[31212]: pgmap v9012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:34.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16725.375886 secs 2024-04-21T15:03:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:35.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:03:35.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:03:35.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:03:36.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:36 smithi077 ceph-mon[27902]: pgmap v9013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:36.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:03:36.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:03:36.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:03:36.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:36 smithi191 ceph-mon[31636]: pgmap v9013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:36.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:03:36.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:03:36.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:03:36.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:36 smithi170 ceph-mon[31212]: pgmap v9013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:36.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:03:36.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:03:36.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:03:37.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16728.615075 secs 2024-04-21T15:03:37.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16728.615075 secs 2024-04-21T15:03:37.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16728.615075 secs 2024-04-21T15:03:38.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:38 smithi077 ceph-mon[27902]: pgmap v9014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:38.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:38 smithi191 ceph-mon[31636]: pgmap v9014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:38 smithi170 ceph-mon[31212]: pgmap v9014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:39.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16730.376008 secs 2024-04-21T15:03:39.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16730.376008 secs 2024-04-21T15:03:39.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16730.376008 secs 2024-04-21T15:03:40.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:40.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:40 smithi077 ceph-mon[27902]: pgmap v9015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:40.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:40 smithi191 ceph-mon[31636]: pgmap v9015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:40.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:40 smithi170 ceph-mon[31212]: pgmap v9015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:42.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:42 smithi077 ceph-mon[27902]: pgmap v9016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:42.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16733.615188 secs 2024-04-21T15:03:42.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:42 smithi191 ceph-mon[31636]: pgmap v9016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:42.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16733.615188 secs 2024-04-21T15:03:42.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:42 smithi170 ceph-mon[31212]: pgmap v9016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:42.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16733.615188 secs 2024-04-21T15:03:44.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:44 smithi077 ceph-mon[27902]: pgmap v9017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:44.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16735.376129 secs 2024-04-21T15:03:44.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:44 smithi191 ceph-mon[31636]: pgmap v9017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:44.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16735.376129 secs 2024-04-21T15:03:44.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:44 smithi170 ceph-mon[31212]: pgmap v9017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:44.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16735.376129 secs 2024-04-21T15:03:45.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:46 smithi077 ceph-mon[27902]: pgmap v9018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:46.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:46 smithi191 ceph-mon[31636]: pgmap v9018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:46.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:46 smithi170 ceph-mon[31212]: pgmap v9018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:47.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16738.615323 secs 2024-04-21T15:03:47.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16738.615323 secs 2024-04-21T15:03:47.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16738.615323 secs 2024-04-21T15:03:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:48 smithi077 ceph-mon[27902]: pgmap v9019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:48.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:48 smithi191 ceph-mon[31636]: pgmap v9019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:48.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:48 smithi170 ceph-mon[31212]: pgmap v9019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:49.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16740.376253 secs 2024-04-21T15:03:49.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16740.376253 secs 2024-04-21T15:03:49.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16740.376253 secs 2024-04-21T15:03:50.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:50.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:50 smithi191 ceph-mon[31636]: pgmap v9020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:50.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:50 smithi170 ceph-mon[31212]: pgmap v9020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:50.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:50 smithi077 ceph-mon[27902]: pgmap v9020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:52.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:52 smithi191 ceph-mon[31636]: pgmap v9021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:52.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16743.615387 secs 2024-04-21T15:03:52.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:52 smithi170 ceph-mon[31212]: pgmap v9021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:52.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16743.615387 secs 2024-04-21T15:03:52.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:52 smithi077 ceph-mon[27902]: pgmap v9021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:52.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16743.615387 secs 2024-04-21T15:03:54.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:54 smithi191 ceph-mon[31636]: pgmap v9022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:54.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16745.376370 secs 2024-04-21T15:03:54.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:54 smithi170 ceph-mon[31212]: pgmap v9022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:54.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16745.376370 secs 2024-04-21T15:03:54.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:54 smithi077 ceph-mon[27902]: pgmap v9022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:54.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16745.376370 secs 2024-04-21T15:03:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:03:56.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:56 smithi191 ceph-mon[31636]: pgmap v9023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:56.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:56 smithi170 ceph-mon[31212]: pgmap v9023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:56.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:56 smithi077 ceph-mon[27902]: pgmap v9023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:03:57.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16748.615500 secs 2024-04-21T15:03:57.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16748.615500 secs 2024-04-21T15:03:57.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16748.615500 secs 2024-04-21T15:03:58.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:58 smithi191 ceph-mon[31636]: pgmap v9024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:58.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:58 smithi170 ceph-mon[31212]: pgmap v9024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:58.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:58 smithi077 ceph-mon[27902]: pgmap v9024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:03:59.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:03:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16750.376487 secs 2024-04-21T15:03:59.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:03:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16750.376487 secs 2024-04-21T15:03:59.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:03:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16750.376487 secs 2024-04-21T15:04:00.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:00.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:00 smithi191 ceph-mon[31636]: pgmap v9025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:00.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:00 smithi170 ceph-mon[31212]: pgmap v9025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:00.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:00 smithi077 ceph-mon[27902]: pgmap v9025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:02.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:02 smithi191 ceph-mon[31636]: pgmap v9026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T15:04:02.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16753.615621 secs 2024-04-21T15:04:02.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:02 smithi170 ceph-mon[31212]: pgmap v9026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T15:04:02.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16753.615621 secs 2024-04-21T15:04:02.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:02 smithi077 ceph-mon[27902]: pgmap v9026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T15:04:02.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16753.615621 secs 2024-04-21T15:04:04.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:04 smithi191 ceph-mon[31636]: pgmap v9027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:04:04.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16755.376605 secs 2024-04-21T15:04:04.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:04 smithi170 ceph-mon[31212]: pgmap v9027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:04:04.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16755.376605 secs 2024-04-21T15:04:04.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:04 smithi077 ceph-mon[27902]: pgmap v9027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:04:04.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16755.376605 secs 2024-04-21T15:04:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:05.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:05 smithi191 ceph-mon[31636]: osdmap e636: 12 total, 12 up, 12 in 2024-04-21T15:04:05.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:05 smithi170 ceph-mon[31212]: osdmap e636: 12 total, 12 up, 12 in 2024-04-21T15:04:05.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:05 smithi077 ceph-mon[27902]: osdmap e636: 12 total, 12 up, 12 in 2024-04-21T15:04:06.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:06 smithi191 ceph-mon[31636]: pgmap v9029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-04-21T15:04:06.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:06 smithi170 ceph-mon[31212]: pgmap v9029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-04-21T15:04:06.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:06 smithi077 ceph-mon[27902]: pgmap v9029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-04-21T15:04:07.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16758.615734 secs 2024-04-21T15:04:07.525 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16758.615734 secs 2024-04-21T15:04:07.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16758.615734 secs 2024-04-21T15:04:08.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:08 smithi191 ceph-mon[31636]: pgmap v9030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:08.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:08 smithi170 ceph-mon[31212]: pgmap v9030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:08.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:08 smithi077 ceph-mon[27902]: pgmap v9030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:09.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16760.376702 secs 2024-04-21T15:04:09.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16760.376702 secs 2024-04-21T15:04:09.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16760.376702 secs 2024-04-21T15:04:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:10.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:10 smithi191 ceph-mon[31636]: pgmap v9031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:10.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:10 smithi191 ceph-mon[31636]: osdmap e637: 12 total, 12 up, 12 in 2024-04-21T15:04:10.543 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:10 smithi170 ceph-mon[31212]: pgmap v9031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:10.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:10 smithi170 ceph-mon[31212]: osdmap e637: 12 total, 12 up, 12 in 2024-04-21T15:04:10.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:10 smithi077 ceph-mon[27902]: pgmap v9031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:10.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:10 smithi077 ceph-mon[27902]: osdmap e637: 12 total, 12 up, 12 in 2024-04-21T15:04:12.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:12 smithi191 ceph-mon[31636]: pgmap v9033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:04:12.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16763.615815 secs 2024-04-21T15:04:12.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:12 smithi170 ceph-mon[31212]: pgmap v9033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:04:12.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16763.615815 secs 2024-04-21T15:04:12.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:12 smithi077 ceph-mon[27902]: pgmap v9033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:04:12.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16763.615815 secs 2024-04-21T15:04:14.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:14 smithi191 ceph-mon[31636]: pgmap v9034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:04:14.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16765.376822 secs 2024-04-21T15:04:14.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:14 smithi170 ceph-mon[31212]: pgmap v9034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:04:14.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16765.376822 secs 2024-04-21T15:04:14.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:14 smithi077 ceph-mon[27902]: pgmap v9034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:04:14.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16765.376822 secs 2024-04-21T15:04:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:16.455 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:16 smithi191 ceph-mon[31636]: pgmap v9035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:16.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:16 smithi170 ceph-mon[31212]: pgmap v9035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:16.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:16 smithi077 ceph-mon[27902]: pgmap v9035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:04:17.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16768.615935 secs 2024-04-21T15:04:17.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16768.615935 secs 2024-04-21T15:04:17.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16768.615935 secs 2024-04-21T15:04:18.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:18 smithi191 ceph-mon[31636]: pgmap v9036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:04:18.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:18 smithi170 ceph-mon[31212]: pgmap v9036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:04:18.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:18 smithi077 ceph-mon[27902]: pgmap v9036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:04:19.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16770.376935 secs 2024-04-21T15:04:19.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16770.376935 secs 2024-04-21T15:04:19.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16770.376935 secs 2024-04-21T15:04:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:20.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:20 smithi170 ceph-mon[31212]: pgmap v9037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:04:20.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:20 smithi077 ceph-mon[27902]: pgmap v9037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:04:20.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:20 smithi191 ceph-mon[31636]: pgmap v9037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:04:22.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:22 smithi170 ceph-mon[31212]: pgmap v9038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:04:22.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16773.616048 secs 2024-04-21T15:04:22.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:22 smithi077 ceph-mon[27902]: pgmap v9038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:04:22.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16773.616048 secs 2024-04-21T15:04:22.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:22 smithi191 ceph-mon[31636]: pgmap v9038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:04:22.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16773.616048 secs 2024-04-21T15:04:24.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:24 smithi170 ceph-mon[31212]: pgmap v9039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:24.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16775.377054 secs 2024-04-21T15:04:24.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:24 smithi077 ceph-mon[27902]: pgmap v9039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:24.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16775.377054 secs 2024-04-21T15:04:24.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:24 smithi191 ceph-mon[31636]: pgmap v9039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:24.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16775.377054 secs 2024-04-21T15:04:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:26.508 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:26 smithi191 ceph-mon[31636]: pgmap v9040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:26.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:26 smithi170 ceph-mon[31212]: pgmap v9040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:26.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:26 smithi077 ceph-mon[27902]: pgmap v9040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:27.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16778.616166 secs 2024-04-21T15:04:27.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16778.616166 secs 2024-04-21T15:04:27.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16778.616166 secs 2024-04-21T15:04:28.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:28 smithi170 ceph-mon[31212]: pgmap v9041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:28.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:28 smithi077 ceph-mon[27902]: pgmap v9041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:28.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:28 smithi191 ceph-mon[31636]: pgmap v9041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:29.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16780.377220 secs 2024-04-21T15:04:29.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16780.377220 secs 2024-04-21T15:04:29.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16780.377220 secs 2024-04-21T15:04:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:30.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:30 smithi170 ceph-mon[31212]: pgmap v9042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:30.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:30 smithi077 ceph-mon[27902]: pgmap v9042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:30.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:30 smithi191 ceph-mon[31636]: pgmap v9042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:32.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:32 smithi170 ceph-mon[31212]: pgmap v9043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:32.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16783.616303 secs 2024-04-21T15:04:32.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:32 smithi077 ceph-mon[27902]: pgmap v9043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:32.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16783.616303 secs 2024-04-21T15:04:32.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:32 smithi191 ceph-mon[31636]: pgmap v9043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:32.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16783.616303 secs 2024-04-21T15:04:34.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:34 smithi170 ceph-mon[31212]: pgmap v9044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:34.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16785.377292 secs 2024-04-21T15:04:34.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:34 smithi077 ceph-mon[27902]: pgmap v9044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:34.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16785.377292 secs 2024-04-21T15:04:34.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:34 smithi191 ceph-mon[31636]: pgmap v9044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:34.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16785.377292 secs 2024-04-21T15:04:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:36.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:36 smithi170 ceph-mon[31212]: pgmap v9045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:36.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:04:36.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:04:36.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:04:36.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:04:36.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:36 smithi077 ceph-mon[27902]: pgmap v9045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:36.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:04:36.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:04:36.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:04:36.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:04:36.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:36 smithi191 ceph-mon[31636]: pgmap v9045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:36.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:04:36.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:04:36.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:04:36.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:04:37.525 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16788.616359 secs 2024-04-21T15:04:37.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16788.616359 secs 2024-04-21T15:04:37.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16788.616359 secs 2024-04-21T15:04:38.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:38 smithi170 ceph-mon[31212]: pgmap v9046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:38.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:38 smithi077 ceph-mon[27902]: pgmap v9046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:38.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:38 smithi191 ceph-mon[31636]: pgmap v9046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:39.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16790.377401 secs 2024-04-21T15:04:39.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16790.377401 secs 2024-04-21T15:04:39.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16790.377401 secs 2024-04-21T15:04:40.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:40.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:40 smithi170 ceph-mon[31212]: pgmap v9047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:40.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:40 smithi077 ceph-mon[27902]: pgmap v9047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:40.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:40 smithi191 ceph-mon[31636]: pgmap v9047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:42.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:42 smithi170 ceph-mon[31212]: pgmap v9048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:42.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16793.616470 secs 2024-04-21T15:04:42.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:42 smithi077 ceph-mon[27902]: pgmap v9048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:42.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16793.616470 secs 2024-04-21T15:04:42.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:42 smithi191 ceph-mon[31636]: pgmap v9048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:42.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16793.616470 secs 2024-04-21T15:04:44.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:44 smithi170 ceph-mon[31212]: pgmap v9049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:44.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16795.377543 secs 2024-04-21T15:04:44.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:44 smithi077 ceph-mon[27902]: pgmap v9049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:44.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16795.377543 secs 2024-04-21T15:04:44.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:44 smithi191 ceph-mon[31636]: pgmap v9049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:44.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16795.377543 secs 2024-04-21T15:04:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:46.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:46 smithi170 ceph-mon[31212]: pgmap v9050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:46.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:46 smithi077 ceph-mon[27902]: pgmap v9050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:46.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:46 smithi191 ceph-mon[31636]: pgmap v9050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:47.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16798.616582 secs 2024-04-21T15:04:47.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16798.616582 secs 2024-04-21T15:04:47.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16798.616582 secs 2024-04-21T15:04:48.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:48 smithi170 ceph-mon[31212]: pgmap v9051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:48.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:48 smithi077 ceph-mon[27902]: pgmap v9051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:48.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:48 smithi191 ceph-mon[31636]: pgmap v9051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:49.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16800.377672 secs 2024-04-21T15:04:49.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16800.377672 secs 2024-04-21T15:04:49.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16800.377672 secs 2024-04-21T15:04:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:50.545 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:50 smithi170 ceph-mon[31212]: pgmap v9052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:50.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:50 smithi077 ceph-mon[27902]: pgmap v9052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:50.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:50 smithi191 ceph-mon[31636]: pgmap v9052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:52.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:52 smithi077 ceph-mon[27902]: pgmap v9053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:52.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16803.616708 secs 2024-04-21T15:04:52.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:52 smithi191 ceph-mon[31636]: pgmap v9053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:52.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16803.616708 secs 2024-04-21T15:04:52.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:52 smithi170 ceph-mon[31212]: pgmap v9053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:52.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16803.616708 secs 2024-04-21T15:04:54.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:54 smithi077 ceph-mon[27902]: pgmap v9054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:54.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16805.377809 secs 2024-04-21T15:04:54.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:54 smithi191 ceph-mon[31636]: pgmap v9054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:54.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16805.377809 secs 2024-04-21T15:04:54.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:54 smithi170 ceph-mon[31212]: pgmap v9054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:54.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16805.377809 secs 2024-04-21T15:04:55.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:04:56.597 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:56 smithi170 ceph-mon[31212]: pgmap v9055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:56.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:56 smithi077 ceph-mon[27902]: pgmap v9055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:04:56.676+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:04:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:04:56.676+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:04:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:04:56.676+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:04:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:04:56.676+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:04:56.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:56 smithi191 ceph-mon[31636]: pgmap v9055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:04:57.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16808.616822 secs 2024-04-21T15:04:57.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16808.616822 secs 2024-04-21T15:04:57.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16808.616822 secs 2024-04-21T15:04:58.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:58 smithi077 ceph-mon[27902]: pgmap v9056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:58.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:58 smithi191 ceph-mon[31636]: pgmap v9056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:58.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:58 smithi170 ceph-mon[31212]: pgmap v9056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:04:59.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:04:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16810.377930 secs 2024-04-21T15:04:59.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:04:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16810.377930 secs 2024-04-21T15:04:59.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:04:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16810.377930 secs 2024-04-21T15:05:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 16995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:00.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:00 smithi077 ceph-mon[27902]: pgmap v9057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:00.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:00 smithi191 ceph-mon[31636]: pgmap v9057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:00.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:00 smithi170 ceph-mon[31212]: pgmap v9057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:02.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:02 smithi077 ceph-mon[27902]: pgmap v9058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:02.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16813.616924 secs 2024-04-21T15:05:02.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:02 smithi191 ceph-mon[31636]: pgmap v9058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:02.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16813.616924 secs 2024-04-21T15:05:02.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:02 smithi170 ceph-mon[31212]: pgmap v9058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:02.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16813.616924 secs 2024-04-21T15:05:04.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:04 smithi077 ceph-mon[27902]: pgmap v9059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:04.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16815.378056 secs 2024-04-21T15:05:04.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:04 smithi191 ceph-mon[31636]: pgmap v9059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:04.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16815.378056 secs 2024-04-21T15:05:04.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:04 smithi170 ceph-mon[31212]: pgmap v9059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:04.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16815.378056 secs 2024-04-21T15:05:05.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:05.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:05 smithi077 ceph-mon[27902]: osdmap e638: 12 total, 12 up, 12 in 2024-04-21T15:05:05.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:05 smithi191 ceph-mon[31636]: osdmap e638: 12 total, 12 up, 12 in 2024-04-21T15:05:05.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:05 smithi170 ceph-mon[31212]: osdmap e638: 12 total, 12 up, 12 in 2024-04-21T15:05:06.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:06 smithi077 ceph-mon[27902]: pgmap v9061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:05:06.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:06 smithi191 ceph-mon[31636]: pgmap v9061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:05:06.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:06 smithi170 ceph-mon[31212]: pgmap v9061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:05:07.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16818.616986 secs 2024-04-21T15:05:07.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16818.616986 secs 2024-04-21T15:05:07.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16818.616986 secs 2024-04-21T15:05:08.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:08 smithi077 ceph-mon[27902]: pgmap v9062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:05:08.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:08 smithi191 ceph-mon[31636]: pgmap v9062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:05:08.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:08 smithi170 ceph-mon[31212]: pgmap v9062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:05:09.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16820.378128 secs 2024-04-21T15:05:09.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16820.378128 secs 2024-04-21T15:05:09.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16820.378128 secs 2024-04-21T15:05:10.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:10.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:10 smithi077 ceph-mon[27902]: pgmap v9063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:05:10.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:10 smithi077 ceph-mon[27902]: osdmap e639: 12 total, 12 up, 12 in 2024-04-21T15:05:10.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:10 smithi191 ceph-mon[31636]: pgmap v9063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:05:10.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:10 smithi191 ceph-mon[31636]: osdmap e639: 12 total, 12 up, 12 in 2024-04-21T15:05:10.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:10 smithi170 ceph-mon[31212]: pgmap v9063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:05:10.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:10 smithi170 ceph-mon[31212]: osdmap e639: 12 total, 12 up, 12 in 2024-04-21T15:05:12.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:12 smithi077 ceph-mon[27902]: pgmap v9065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:05:12.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16823.617084 secs 2024-04-21T15:05:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:12 smithi191 ceph-mon[31636]: pgmap v9065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:05:12.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16823.617084 secs 2024-04-21T15:05:12.795 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:12 smithi170 ceph-mon[31212]: pgmap v9065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:05:12.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16823.617084 secs 2024-04-21T15:05:14.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:14 smithi077 ceph-mon[27902]: pgmap v9066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T15:05:14.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16825.378189 secs 2024-04-21T15:05:14.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:14 smithi191 ceph-mon[31636]: pgmap v9066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T15:05:14.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16825.378189 secs 2024-04-21T15:05:14.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:14 smithi170 ceph-mon[31212]: pgmap v9066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T15:05:14.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16825.378189 secs 2024-04-21T15:05:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:16.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:16 smithi077 ceph-mon[27902]: pgmap v9067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:05:16.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:16 smithi191 ceph-mon[31636]: pgmap v9067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:05:16.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:16 smithi170 ceph-mon[31212]: pgmap v9067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:05:17.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16828.617198 secs 2024-04-21T15:05:17.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16828.617198 secs 2024-04-21T15:05:17.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16828.617198 secs 2024-04-21T15:05:18.624 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:18 smithi077 ceph-mon[27902]: pgmap v9068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:05:18.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:18 smithi191 ceph-mon[31636]: pgmap v9068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:05:18.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:18 smithi170 ceph-mon[31212]: pgmap v9068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:05:19.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16830.378307 secs 2024-04-21T15:05:19.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16830.378307 secs 2024-04-21T15:05:19.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16830.378307 secs 2024-04-21T15:05:20.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:20.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:20 smithi191 ceph-mon[31636]: pgmap v9069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:05:20.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:20 smithi170 ceph-mon[31212]: pgmap v9069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:05:20.874 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:20 smithi077 ceph-mon[27902]: pgmap v9069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:05:22.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:22 smithi191 ceph-mon[31636]: pgmap v9070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:05:22.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16833.617310 secs 2024-04-21T15:05:22.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:22 smithi170 ceph-mon[31212]: pgmap v9070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:05:22.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16833.617310 secs 2024-04-21T15:05:22.874 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:22 smithi077 ceph-mon[27902]: pgmap v9070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:05:22.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16833.617310 secs 2024-04-21T15:05:24.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:24 smithi191 ceph-mon[31636]: pgmap v9071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:24.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16835.378410 secs 2024-04-21T15:05:24.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:24 smithi170 ceph-mon[31212]: pgmap v9071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:24.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16835.378410 secs 2024-04-21T15:05:24.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:24 smithi077 ceph-mon[27902]: pgmap v9071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:24.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16835.378410 secs 2024-04-21T15:05:25.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:26.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:26 smithi191 ceph-mon[31636]: pgmap v9072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:26.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:26 smithi170 ceph-mon[31212]: pgmap v9072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:26.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:26 smithi077 ceph-mon[27902]: pgmap v9072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:27.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16838.617427 secs 2024-04-21T15:05:27.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16838.617427 secs 2024-04-21T15:05:27.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16838.617427 secs 2024-04-21T15:05:28.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:28 smithi191 ceph-mon[31636]: pgmap v9073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:28.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:28 smithi170 ceph-mon[31212]: pgmap v9073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:28.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:28 smithi077 ceph-mon[27902]: pgmap v9073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:29.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16840.378522 secs 2024-04-21T15:05:29.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16840.378522 secs 2024-04-21T15:05:29.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16840.378522 secs 2024-04-21T15:05:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:30.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:30 smithi191 ceph-mon[31636]: pgmap v9074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:30.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:30 smithi170 ceph-mon[31212]: pgmap v9074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:30.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:30 smithi077 ceph-mon[27902]: pgmap v9074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:32.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:32 smithi191 ceph-mon[31636]: pgmap v9075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:32.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16843.617562 secs 2024-04-21T15:05:32.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:32 smithi170 ceph-mon[31212]: pgmap v9075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:32.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16843.617562 secs 2024-04-21T15:05:32.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:32 smithi077 ceph-mon[27902]: pgmap v9075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:32.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16843.617562 secs 2024-04-21T15:05:34.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:34 smithi191 ceph-mon[31636]: pgmap v9076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:34.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16845.378634 secs 2024-04-21T15:05:34.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:34 smithi170 ceph-mon[31212]: pgmap v9076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:34.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16845.378634 secs 2024-04-21T15:05:34.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:34 smithi077 ceph-mon[27902]: pgmap v9076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:34.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16845.378634 secs 2024-04-21T15:05:35.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:36.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:36 smithi191 ceph-mon[31636]: pgmap v9077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:36.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:05:36.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:36 smithi170 ceph-mon[31212]: pgmap v9077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:36.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:05:36.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:36 smithi077 ceph-mon[27902]: pgmap v9077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:36.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:05:37.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:05:37.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:05:37.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:05:37.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16848.617625 secs 2024-04-21T15:05:37.776 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:05:37.776 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:05:37.776 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:05:37.776 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16848.617625 secs 2024-04-21T15:05:37.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:05:37.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:05:37.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:05:37.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16848.617625 secs 2024-04-21T15:05:38.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:38 smithi191 ceph-mon[31636]: pgmap v9078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:38.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:38 smithi170 ceph-mon[31212]: pgmap v9078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:38.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:38 smithi077 ceph-mon[27902]: pgmap v9078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:39.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16850.378752 secs 2024-04-21T15:05:39.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16850.378752 secs 2024-04-21T15:05:39.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16850.378752 secs 2024-04-21T15:05:40.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:40.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:40 smithi191 ceph-mon[31636]: pgmap v9079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:40.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:40 smithi170 ceph-mon[31212]: pgmap v9079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:40.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:40 smithi077 ceph-mon[27902]: pgmap v9079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:42.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:42 smithi191 ceph-mon[31636]: pgmap v9080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:42.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16853.617774 secs 2024-04-21T15:05:42.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:42 smithi170 ceph-mon[31212]: pgmap v9080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:42.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16853.617774 secs 2024-04-21T15:05:42.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:42 smithi077 ceph-mon[27902]: pgmap v9080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:42.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16853.617774 secs 2024-04-21T15:05:44.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:44 smithi191 ceph-mon[31636]: pgmap v9081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:44.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16855.378880 secs 2024-04-21T15:05:44.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:44 smithi170 ceph-mon[31212]: pgmap v9081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:44.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16855.378880 secs 2024-04-21T15:05:44.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:44 smithi077 ceph-mon[27902]: pgmap v9081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:44.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16855.378880 secs 2024-04-21T15:05:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:46.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:46 smithi191 ceph-mon[31636]: pgmap v9082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:46.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:46 smithi170 ceph-mon[31212]: pgmap v9082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:46.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:46 smithi077 ceph-mon[27902]: pgmap v9082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:47.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16858.617872 secs 2024-04-21T15:05:47.796 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16858.617872 secs 2024-04-21T15:05:47.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16858.617872 secs 2024-04-21T15:05:48.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:48 smithi191 ceph-mon[31636]: pgmap v9083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:48.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:48 smithi170 ceph-mon[31212]: pgmap v9083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:48.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:48 smithi077 ceph-mon[27902]: pgmap v9083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:49.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16860.378992 secs 2024-04-21T15:05:49.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16860.378992 secs 2024-04-21T15:05:49.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16860.378992 secs 2024-04-21T15:05:50.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:50.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:50 smithi191 ceph-mon[31636]: pgmap v9084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:50.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:50 smithi170 ceph-mon[31212]: pgmap v9084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:50.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:50 smithi077 ceph-mon[27902]: pgmap v9084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:52.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:52 smithi191 ceph-mon[31636]: pgmap v9085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:52.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16863.617987 secs 2024-04-21T15:05:52.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:52 smithi170 ceph-mon[31212]: pgmap v9085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:52.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16863.617987 secs 2024-04-21T15:05:52.875 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:52 smithi077 ceph-mon[27902]: pgmap v9085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:52.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16863.617987 secs 2024-04-21T15:05:54.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:54 smithi191 ceph-mon[31636]: pgmap v9086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:54.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16865.379118 secs 2024-04-21T15:05:54.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:54 smithi170 ceph-mon[31212]: pgmap v9086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:54.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16865.379118 secs 2024-04-21T15:05:54.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:54 smithi077 ceph-mon[27902]: pgmap v9086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:54.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16865.379118 secs 2024-04-21T15:05:55.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:05:56.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:56 smithi170 ceph-mon[31212]: pgmap v9087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:56.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:56 smithi077 ceph-mon[27902]: pgmap v9087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:56.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:56 smithi191 ceph-mon[31636]: pgmap v9087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:05:57.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16868.618101 secs 2024-04-21T15:05:57.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16868.618101 secs 2024-04-21T15:05:57.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16868.618101 secs 2024-04-21T15:05:58.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:58 smithi170 ceph-mon[31212]: pgmap v9088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:58.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:58 smithi077 ceph-mon[27902]: pgmap v9088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:58.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:58 smithi191 ceph-mon[31636]: pgmap v9088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:05:59.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:05:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16870.379242 secs 2024-04-21T15:05:59.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:05:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16870.379242 secs 2024-04-21T15:05:59.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:05:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16870.379242 secs 2024-04-21T15:06:00.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:00.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:00 smithi170 ceph-mon[31212]: pgmap v9089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:00.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:00 smithi077 ceph-mon[27902]: pgmap v9089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:00.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:00 smithi191 ceph-mon[31636]: pgmap v9089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:02.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:02 smithi170 ceph-mon[31212]: pgmap v9090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:02.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16873.618166 secs 2024-04-21T15:06:02.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:02 smithi077 ceph-mon[27902]: pgmap v9090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:02.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16873.618166 secs 2024-04-21T15:06:02.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:02 smithi191 ceph-mon[31636]: pgmap v9090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:02.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16873.618166 secs 2024-04-21T15:06:04.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:04 smithi170 ceph-mon[31212]: pgmap v9091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:04.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16875.379361 secs 2024-04-21T15:06:04.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:04 smithi077 ceph-mon[27902]: pgmap v9091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:04.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16875.379361 secs 2024-04-21T15:06:04.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:04 smithi191 ceph-mon[31636]: pgmap v9091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:04.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16875.379361 secs 2024-04-21T15:06:05.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:05 smithi170 ceph-mon[31212]: osdmap e640: 12 total, 12 up, 12 in 2024-04-21T15:06:05.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:05 smithi077 ceph-mon[27902]: osdmap e640: 12 total, 12 up, 12 in 2024-04-21T15:06:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:05 smithi191 ceph-mon[31636]: osdmap e640: 12 total, 12 up, 12 in 2024-04-21T15:06:06.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:06 smithi170 ceph-mon[31212]: pgmap v9093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:06:06.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:06 smithi077 ceph-mon[27902]: pgmap v9093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:06:06.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:06 smithi191 ceph-mon[31636]: pgmap v9093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:06:07.778 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16878.618284 secs 2024-04-21T15:06:07.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16878.618284 secs 2024-04-21T15:06:07.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16878.618284 secs 2024-04-21T15:06:08.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:08 smithi170 ceph-mon[31212]: pgmap v9094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:06:08.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:08 smithi077 ceph-mon[27902]: pgmap v9094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:06:08.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:08 smithi191 ceph-mon[31636]: pgmap v9094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:06:09.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16880.379444 secs 2024-04-21T15:06:09.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16880.379444 secs 2024-04-21T15:06:09.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16880.379444 secs 2024-04-21T15:06:10.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:10.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:10 smithi170 ceph-mon[31212]: pgmap v9095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:06:10.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:10 smithi170 ceph-mon[31212]: osdmap e641: 12 total, 12 up, 12 in 2024-04-21T15:06:10.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:10 smithi077 ceph-mon[27902]: pgmap v9095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:06:10.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:10 smithi077 ceph-mon[27902]: osdmap e641: 12 total, 12 up, 12 in 2024-04-21T15:06:10.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:10 smithi191 ceph-mon[31636]: pgmap v9095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:06:10.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:10 smithi191 ceph-mon[31636]: osdmap e641: 12 total, 12 up, 12 in 2024-04-21T15:06:12.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:12 smithi170 ceph-mon[31212]: pgmap v9097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:06:12.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16883.618357 secs 2024-04-21T15:06:12.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:12 smithi077 ceph-mon[27902]: pgmap v9097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:06:12.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16883.618357 secs 2024-04-21T15:06:12.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:12 smithi191 ceph-mon[31636]: pgmap v9097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:06:12.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16883.618357 secs 2024-04-21T15:06:14.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:14 smithi170 ceph-mon[31212]: pgmap v9098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T15:06:14.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16885.379557 secs 2024-04-21T15:06:14.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:14 smithi077 ceph-mon[27902]: pgmap v9098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T15:06:14.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16885.379557 secs 2024-04-21T15:06:14.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:14 smithi191 ceph-mon[31636]: pgmap v9098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T15:06:14.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16885.379557 secs 2024-04-21T15:06:15.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:16.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:16 smithi170 ceph-mon[31212]: pgmap v9099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:06:16.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:16 smithi077 ceph-mon[27902]: pgmap v9099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:06:16.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:16 smithi191 ceph-mon[31636]: pgmap v9099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:06:17.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16888.618488 secs 2024-04-21T15:06:17.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16888.618488 secs 2024-04-21T15:06:17.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16888.618488 secs 2024-04-21T15:06:18.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:18 smithi170 ceph-mon[31212]: pgmap v9100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:06:18.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:18 smithi077 ceph-mon[27902]: pgmap v9100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:06:18.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:18 smithi191 ceph-mon[31636]: pgmap v9100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:06:19.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16890.379707 secs 2024-04-21T15:06:19.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16890.379707 secs 2024-04-21T15:06:19.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16890.379707 secs 2024-04-21T15:06:20.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:20.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:20 smithi170 ceph-mon[31212]: pgmap v9101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:06:20.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:20 smithi077 ceph-mon[27902]: pgmap v9101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:06:20.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:20 smithi191 ceph-mon[31636]: pgmap v9101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:06:22.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:22 smithi170 ceph-mon[31212]: pgmap v9102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:06:22.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16893.618605 secs 2024-04-21T15:06:22.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:22 smithi077 ceph-mon[27902]: pgmap v9102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:06:22.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16893.618605 secs 2024-04-21T15:06:22.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:22 smithi191 ceph-mon[31636]: pgmap v9102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:06:22.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16893.618605 secs 2024-04-21T15:06:24.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:24 smithi170 ceph-mon[31212]: pgmap v9103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:24.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16895.379823 secs 2024-04-21T15:06:24.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:24 smithi077 ceph-mon[27902]: pgmap v9103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:24.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16895.379823 secs 2024-04-21T15:06:24.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:24 smithi191 ceph-mon[31636]: pgmap v9103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:24.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16895.379823 secs 2024-04-21T15:06:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:26.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:26 smithi170 ceph-mon[31212]: pgmap v9104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:26.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:26 smithi077 ceph-mon[27902]: pgmap v9104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:26.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:26 smithi191 ceph-mon[31636]: pgmap v9104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:27.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16898.618713 secs 2024-04-21T15:06:27.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16898.618713 secs 2024-04-21T15:06:28.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16898.618713 secs 2024-04-21T15:06:28.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:28 smithi077 ceph-mon[27902]: pgmap v9105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:28.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:28 smithi191 ceph-mon[31636]: pgmap v9105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:29.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:28 smithi170 ceph-mon[31212]: pgmap v9105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:29.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16900.379940 secs 2024-04-21T15:06:29.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16900.379940 secs 2024-04-21T15:06:30.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16900.379940 secs 2024-04-21T15:06:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:30.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:30 smithi077 ceph-mon[27902]: pgmap v9106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:30.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:30 smithi191 ceph-mon[31636]: pgmap v9106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:31.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:30 smithi170 ceph-mon[31212]: pgmap v9106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:32.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:32 smithi077 ceph-mon[27902]: pgmap v9107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:32.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16903.618800 secs 2024-04-21T15:06:32.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:32 smithi191 ceph-mon[31636]: pgmap v9107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:32.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16903.618800 secs 2024-04-21T15:06:33.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:32 smithi170 ceph-mon[31212]: pgmap v9107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:33.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16903.618800 secs 2024-04-21T15:06:34.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:34 smithi077 ceph-mon[27902]: pgmap v9108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:34.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16905.380074 secs 2024-04-21T15:06:34.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:34 smithi191 ceph-mon[31636]: pgmap v9108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:34.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16905.380074 secs 2024-04-21T15:06:35.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:34 smithi170 ceph-mon[31212]: pgmap v9108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:35.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16905.380074 secs 2024-04-21T15:06:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:36.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:36 smithi077 ceph-mon[27902]: pgmap v9109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:36.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:36 smithi191 ceph-mon[31636]: pgmap v9109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:37.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:36 smithi170 ceph-mon[31212]: pgmap v9109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:37.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16908.618906 secs 2024-04-21T15:06:37.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:06:37.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:06:37.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:06:37.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:06:37.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16908.618906 secs 2024-04-21T15:06:37.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:06:37.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:06:37.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:06:37.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:06:38.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16908.618906 secs 2024-04-21T15:06:38.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:06:38.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:06:38.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:06:38.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:06:38.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:38 smithi077 ceph-mon[27902]: pgmap v9110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:38.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:38 smithi191 ceph-mon[31636]: pgmap v9110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:39.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:38 smithi170 ceph-mon[31212]: pgmap v9110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:39.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16910.380187 secs 2024-04-21T15:06:39.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16910.380187 secs 2024-04-21T15:06:40.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16910.380187 secs 2024-04-21T15:06:40.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:40.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:40 smithi077 ceph-mon[27902]: pgmap v9111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:40.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:40 smithi191 ceph-mon[31636]: pgmap v9111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:41.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:40 smithi170 ceph-mon[31212]: pgmap v9111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:42.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:42 smithi077 ceph-mon[27902]: pgmap v9112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:42.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16913.619023 secs 2024-04-21T15:06:42.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:42 smithi191 ceph-mon[31636]: pgmap v9112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:42.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16913.619023 secs 2024-04-21T15:06:43.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:42 smithi170 ceph-mon[31212]: pgmap v9112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:43.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16913.619023 secs 2024-04-21T15:06:44.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:44 smithi077 ceph-mon[27902]: pgmap v9113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:44.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16915.380302 secs 2024-04-21T15:06:44.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:44 smithi191 ceph-mon[31636]: pgmap v9113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:44.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16915.380302 secs 2024-04-21T15:06:45.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:44 smithi170 ceph-mon[31212]: pgmap v9113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:45.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16915.380302 secs 2024-04-21T15:06:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:46.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:46 smithi077 ceph-mon[27902]: pgmap v9114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:46.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:46 smithi191 ceph-mon[31636]: pgmap v9114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:47.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:46 smithi170 ceph-mon[31212]: pgmap v9114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:47.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16918.619110 secs 2024-04-21T15:06:47.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16918.619110 secs 2024-04-21T15:06:48.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16918.619110 secs 2024-04-21T15:06:48.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:48 smithi077 ceph-mon[27902]: pgmap v9115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:48.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:48 smithi191 ceph-mon[31636]: pgmap v9115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:49.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:48 smithi170 ceph-mon[31212]: pgmap v9115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:49.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16920.380454 secs 2024-04-21T15:06:49.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16920.380454 secs 2024-04-21T15:06:50.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16920.380454 secs 2024-04-21T15:06:50.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:50.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:50 smithi077 ceph-mon[27902]: pgmap v9116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:50.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:50 smithi191 ceph-mon[31636]: pgmap v9116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:51.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:50 smithi170 ceph-mon[31212]: pgmap v9116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:52.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:52 smithi077 ceph-mon[27902]: pgmap v9117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:52.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16923.619226 secs 2024-04-21T15:06:52.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:52 smithi191 ceph-mon[31636]: pgmap v9117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:52.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16923.619226 secs 2024-04-21T15:06:53.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:52 smithi170 ceph-mon[31212]: pgmap v9117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:53.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16923.619226 secs 2024-04-21T15:06:54.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:54 smithi077 ceph-mon[27902]: pgmap v9118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:54.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16925.380551 secs 2024-04-21T15:06:54.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:54 smithi191 ceph-mon[31636]: pgmap v9118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:54.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16925.380551 secs 2024-04-21T15:06:55.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:54 smithi170 ceph-mon[31212]: pgmap v9118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:55.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16925.380551 secs 2024-04-21T15:06:55.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:06:56.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:56 smithi077 ceph-mon[27902]: pgmap v9119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:56.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:56 smithi191 ceph-mon[31636]: pgmap v9119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:57.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:56 smithi170 ceph-mon[31212]: pgmap v9119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:06:57.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16928.619355 secs 2024-04-21T15:06:57.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16928.619355 secs 2024-04-21T15:06:58.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16928.619355 secs 2024-04-21T15:06:58.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:58 smithi077 ceph-mon[27902]: pgmap v9120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:58.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:58 smithi191 ceph-mon[31636]: pgmap v9120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:59.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:58 smithi170 ceph-mon[31212]: pgmap v9120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:06:59.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:06:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16930.380679 secs 2024-04-21T15:06:59.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:06:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16930.380679 secs 2024-04-21T15:07:00.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:06:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16930.380679 secs 2024-04-21T15:07:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:00.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:00 smithi191 ceph-mon[31636]: pgmap v9121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:01.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:00 smithi170 ceph-mon[31212]: pgmap v9121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:01.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:00 smithi077 ceph-mon[27902]: pgmap v9121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:02.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:02 smithi191 ceph-mon[31636]: pgmap v9122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:02.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16933.619456 secs 2024-04-21T15:07:03.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:02 smithi170 ceph-mon[31212]: pgmap v9122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:03.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16933.619456 secs 2024-04-21T15:07:03.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:02 smithi077 ceph-mon[27902]: pgmap v9122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:03.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16933.619456 secs 2024-04-21T15:07:04.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:04 smithi191 ceph-mon[31636]: pgmap v9123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:04.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16935.380779 secs 2024-04-21T15:07:04.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:04 smithi191 ceph-mon[31636]: osdmap e642: 12 total, 12 up, 12 in 2024-04-21T15:07:05.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:04 smithi170 ceph-mon[31212]: pgmap v9123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:05.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16935.380779 secs 2024-04-21T15:07:05.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:04 smithi170 ceph-mon[31212]: osdmap e642: 12 total, 12 up, 12 in 2024-04-21T15:07:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:05.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:04 smithi077 ceph-mon[27902]: pgmap v9123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:05.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16935.380779 secs 2024-04-21T15:07:05.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:04 smithi077 ceph-mon[27902]: osdmap e642: 12 total, 12 up, 12 in 2024-04-21T15:07:06.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:06 smithi191 ceph-mon[31636]: pgmap v9125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:07:07.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:06 smithi170 ceph-mon[31212]: pgmap v9125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:07:07.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:06 smithi077 ceph-mon[27902]: pgmap v9125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:07:07.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16938.619587 secs 2024-04-21T15:07:08.028 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16938.619587 secs 2024-04-21T15:07:08.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16938.619587 secs 2024-04-21T15:07:08.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:08 smithi191 ceph-mon[31636]: pgmap v9126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:09.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:08 smithi170 ceph-mon[31212]: pgmap v9126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:09.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:08 smithi077 ceph-mon[27902]: pgmap v9126: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:09.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16940.380940 secs 2024-04-21T15:07:10.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16940.380940 secs 2024-04-21T15:07:10.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:10.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16940.380940 secs 2024-04-21T15:07:10.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:10 smithi191 ceph-mon[31636]: pgmap v9127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:10.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:10 smithi191 ceph-mon[31636]: osdmap e643: 12 total, 12 up, 12 in 2024-04-21T15:07:11.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:10 smithi170 ceph-mon[31212]: pgmap v9127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:11.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:10 smithi170 ceph-mon[31212]: osdmap e643: 12 total, 12 up, 12 in 2024-04-21T15:07:11.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:10 smithi077 ceph-mon[27902]: pgmap v9127: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:11.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:10 smithi077 ceph-mon[27902]: osdmap e643: 12 total, 12 up, 12 in 2024-04-21T15:07:12.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:12 smithi191 ceph-mon[31636]: pgmap v9129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:07:12.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16943.619679 secs 2024-04-21T15:07:13.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:12 smithi170 ceph-mon[31212]: pgmap v9129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:07:13.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16943.619679 secs 2024-04-21T15:07:13.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:12 smithi077 ceph-mon[27902]: pgmap v9129: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:07:13.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16943.619679 secs 2024-04-21T15:07:14.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:13 smithi170 ceph-mon[31212]: pgmap v9130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T15:07:14.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16945.381059 secs 2024-04-21T15:07:14.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:13 smithi077 ceph-mon[27902]: pgmap v9130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T15:07:14.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16945.381059 secs 2024-04-21T15:07:14.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:13 smithi191 ceph-mon[31636]: pgmap v9130: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T15:07:14.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16945.381059 secs 2024-04-21T15:07:15.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:16.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:16 smithi077 ceph-mon[27902]: pgmap v9131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:16.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:16 smithi191 ceph-mon[31636]: pgmap v9131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:16.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:16 smithi170 ceph-mon[31212]: pgmap v9131: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:07:17.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16948.619792 secs 2024-04-21T15:07:17.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16948.619792 secs 2024-04-21T15:07:17.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16948.619792 secs 2024-04-21T15:07:18.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:18 smithi191 ceph-mon[31636]: pgmap v9132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:07:18.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:18 smithi170 ceph-mon[31212]: pgmap v9132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:07:18.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:18 smithi077 ceph-mon[27902]: pgmap v9132: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:07:19.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16950.381156 secs 2024-04-21T15:07:19.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16950.381156 secs 2024-04-21T15:07:19.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16950.381156 secs 2024-04-21T15:07:20.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:20.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:20 smithi191 ceph-mon[31636]: pgmap v9133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:07:20.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:20 smithi170 ceph-mon[31212]: pgmap v9133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:07:20.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:20 smithi077 ceph-mon[27902]: pgmap v9133: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:07:22.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:22 smithi191 ceph-mon[31636]: pgmap v9134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:07:22.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16953.619882 secs 2024-04-21T15:07:22.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:22 smithi170 ceph-mon[31212]: pgmap v9134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:07:22.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16953.619882 secs 2024-04-21T15:07:22.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:22 smithi077 ceph-mon[27902]: pgmap v9134: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:07:22.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16953.619882 secs 2024-04-21T15:07:24.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:24 smithi191 ceph-mon[31636]: pgmap v9135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:24.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16955.381274 secs 2024-04-21T15:07:24.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:24 smithi170 ceph-mon[31212]: pgmap v9135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:24.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16955.381274 secs 2024-04-21T15:07:24.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:24 smithi077 ceph-mon[27902]: pgmap v9135: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:24.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16955.381274 secs 2024-04-21T15:07:25.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:26.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:26 smithi191 ceph-mon[31636]: pgmap v9136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:26.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:26 smithi170 ceph-mon[31212]: pgmap v9136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:26.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:26 smithi077 ceph-mon[27902]: pgmap v9136: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:27.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16958.619990 secs 2024-04-21T15:07:27.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16958.619990 secs 2024-04-21T15:07:27.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16958.619990 secs 2024-04-21T15:07:28.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:28 smithi191 ceph-mon[31636]: pgmap v9137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:28.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:28 smithi170 ceph-mon[31212]: pgmap v9137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:28.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:28 smithi077 ceph-mon[27902]: pgmap v9137: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:29.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16960.381394 secs 2024-04-21T15:07:29.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16960.381394 secs 2024-04-21T15:07:29.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16960.381394 secs 2024-04-21T15:07:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:30.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:30 smithi191 ceph-mon[31636]: pgmap v9138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:30.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:30 smithi170 ceph-mon[31212]: pgmap v9138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:30.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:30 smithi077 ceph-mon[27902]: pgmap v9138: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:32.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:32 smithi191 ceph-mon[31636]: pgmap v9139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:32.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16963.620104 secs 2024-04-21T15:07:32.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:32 smithi170 ceph-mon[31212]: pgmap v9139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:32.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16963.620104 secs 2024-04-21T15:07:32.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:32 smithi077 ceph-mon[27902]: pgmap v9139: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:32.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16963.620104 secs 2024-04-21T15:07:34.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:34 smithi191 ceph-mon[31636]: pgmap v9140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:34.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16965.381531 secs 2024-04-21T15:07:34.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:34 smithi170 ceph-mon[31212]: pgmap v9140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:34.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16965.381531 secs 2024-04-21T15:07:34.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:34 smithi077 ceph-mon[27902]: pgmap v9140: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:34.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16965.381531 secs 2024-04-21T15:07:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:36.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:36 smithi191 ceph-mon[31636]: pgmap v9141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:36.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:36 smithi170 ceph-mon[31212]: pgmap v9141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:36.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:36 smithi077 ceph-mon[27902]: pgmap v9141: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:37.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16968.620237 secs 2024-04-21T15:07:37.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16968.620237 secs 2024-04-21T15:07:37.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16968.620237 secs 2024-04-21T15:07:38.431 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:38 smithi191 ceph-mon[31636]: pgmap v9142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:38.486 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:07:38.528 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:38 smithi077 ceph-mon[27902]: pgmap v9142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:38.529 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:07:38.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:38 smithi170 ceph-mon[31212]: pgmap v9142: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:38.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:07:39.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16970.381599 secs 2024-04-21T15:07:39.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16970.381599 secs 2024-04-21T15:07:39.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16970.381599 secs 2024-04-21T15:07:40.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:40.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: pgmap v9143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:40.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:07:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:07:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: pgmap v9143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:07:40.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:07:40.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: pgmap v9143: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:40.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:07:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:07:40.714 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:07:40.714 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:07:41.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:07:41.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:07:41.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:07:41.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:07:41.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:07:41.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:07:41.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:07:41.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:07:41.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:07:41.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:07:41.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:07:41.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:07:41.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:07:41.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:07:41.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:07:41.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:07:41.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:07:41.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:07:42.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:42 smithi170 ceph-mon[31212]: pgmap v9144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:42.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16973.620349 secs 2024-04-21T15:07:42.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:42 smithi077 ceph-mon[27902]: pgmap v9144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:42.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16973.620349 secs 2024-04-21T15:07:42.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:42 smithi191 ceph-mon[31636]: pgmap v9144: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:42.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16973.620349 secs 2024-04-21T15:07:44.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:44 smithi170 ceph-mon[31212]: pgmap v9145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:44.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16975.381714 secs 2024-04-21T15:07:44.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:44 smithi077 ceph-mon[27902]: pgmap v9145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:44.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16975.381714 secs 2024-04-21T15:07:44.711 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:44 smithi191 ceph-mon[31636]: pgmap v9145: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:44.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16975.381714 secs 2024-04-21T15:07:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:46.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:46 smithi170 ceph-mon[31212]: pgmap v9146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:46.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:46 smithi077 ceph-mon[27902]: pgmap v9146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:46.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:46 smithi191 ceph-mon[31636]: pgmap v9146: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:47.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16978.620461 secs 2024-04-21T15:07:47.628 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16978.620461 secs 2024-04-21T15:07:47.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16978.620461 secs 2024-04-21T15:07:48.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:48 smithi170 ceph-mon[31212]: pgmap v9147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:48.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:48 smithi077 ceph-mon[27902]: pgmap v9147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:48.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:48 smithi191 ceph-mon[31636]: pgmap v9147: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:49.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16980.381830 secs 2024-04-21T15:07:49.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16980.381830 secs 2024-04-21T15:07:49.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16980.381830 secs 2024-04-21T15:07:50.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:50.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:50 smithi170 ceph-mon[31212]: pgmap v9148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:50.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:50 smithi077 ceph-mon[27902]: pgmap v9148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:50.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:50 smithi191 ceph-mon[31636]: pgmap v9148: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:52.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:52 smithi170 ceph-mon[31212]: pgmap v9149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:52.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16983.620533 secs 2024-04-21T15:07:52.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:52 smithi077 ceph-mon[27902]: pgmap v9149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:52.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16983.620533 secs 2024-04-21T15:07:52.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:52 smithi191 ceph-mon[31636]: pgmap v9149: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:52.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16983.620533 secs 2024-04-21T15:07:54.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:54 smithi170 ceph-mon[31212]: pgmap v9150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:54.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16985.381947 secs 2024-04-21T15:07:54.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:54 smithi077 ceph-mon[27902]: pgmap v9150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:54.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16985.381947 secs 2024-04-21T15:07:54.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:54 smithi191 ceph-mon[31636]: pgmap v9150: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:54.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16985.381947 secs 2024-04-21T15:07:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:07:56.624 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:56 smithi170 ceph-mon[31212]: pgmap v9151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:56.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:56 smithi077 ceph-mon[27902]: pgmap v9151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:07:56.702+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:07:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:07:56.702+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:07:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:07:56.702+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:07:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:07:56.702+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:07:56.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:56 smithi191 ceph-mon[31636]: pgmap v9151: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:07:57.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16988.620623 secs 2024-04-21T15:07:57.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16988.620623 secs 2024-04-21T15:07:57.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16988.620623 secs 2024-04-21T15:07:58.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:58 smithi077 ceph-mon[27902]: pgmap v9152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:58.711 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:58 smithi191 ceph-mon[31636]: pgmap v9152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:58.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:58 smithi170 ceph-mon[31212]: pgmap v9152: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:07:59.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16990.382033 secs 2024-04-21T15:07:59.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16990.382033 secs 2024-04-21T15:07:59.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16990.382033 secs 2024-04-21T15:08:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:00.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:00 smithi077 ceph-mon[27902]: pgmap v9153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:00.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:00 smithi191 ceph-mon[31636]: pgmap v9153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:00.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:00 smithi170 ceph-mon[31212]: pgmap v9153: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:02.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:02 smithi077 ceph-mon[27902]: pgmap v9154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:02.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16993.620746 secs 2024-04-21T15:08:02.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:02 smithi191 ceph-mon[31636]: pgmap v9154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:02.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16993.620746 secs 2024-04-21T15:08:02.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:02 smithi170 ceph-mon[31212]: pgmap v9154: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:02.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16993.620746 secs 2024-04-21T15:08:04.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:04 smithi077 ceph-mon[27902]: pgmap v9155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:04.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 16995.382151 secs 2024-04-21T15:08:04.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:04 smithi191 ceph-mon[31636]: pgmap v9155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:04.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 16995.382151 secs 2024-04-21T15:08:04.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:04 smithi170 ceph-mon[31212]: pgmap v9155: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:04.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 16995.382151 secs 2024-04-21T15:08:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:05.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:05 smithi077 ceph-mon[27902]: osdmap e644: 12 total, 12 up, 12 in 2024-04-21T15:08:05.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:05 smithi191 ceph-mon[31636]: osdmap e644: 12 total, 12 up, 12 in 2024-04-21T15:08:05.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:05 smithi170 ceph-mon[31212]: osdmap e644: 12 total, 12 up, 12 in 2024-04-21T15:08:06.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:06 smithi077 ceph-mon[27902]: pgmap v9157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:08:06.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:06 smithi191 ceph-mon[31636]: pgmap v9157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:08:06.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:06 smithi170 ceph-mon[31212]: pgmap v9157: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:08:07.615 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 16998.620879 secs 2024-04-21T15:08:07.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 16998.620879 secs 2024-04-21T15:08:07.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 16998.620879 secs 2024-04-21T15:08:08.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:08 smithi077 ceph-mon[27902]: pgmap v9158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:08:08.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:08 smithi191 ceph-mon[31636]: pgmap v9158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:08:08.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:08 smithi170 ceph-mon[31212]: pgmap v9158: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:08:09.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17000.382296 secs 2024-04-21T15:08:09.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17000.382296 secs 2024-04-21T15:08:09.800 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17000.382296 secs 2024-04-21T15:08:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:10.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:10 smithi077 ceph-mon[27902]: pgmap v9159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:08:10.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:10 smithi077 ceph-mon[27902]: osdmap e645: 12 total, 12 up, 12 in 2024-04-21T15:08:10.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:10 smithi191 ceph-mon[31636]: pgmap v9159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:08:10.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:10 smithi191 ceph-mon[31636]: osdmap e645: 12 total, 12 up, 12 in 2024-04-21T15:08:10.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:10 smithi170 ceph-mon[31212]: pgmap v9159: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:08:10.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:10 smithi170 ceph-mon[31212]: osdmap e645: 12 total, 12 up, 12 in 2024-04-21T15:08:12.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:12 smithi077 ceph-mon[27902]: pgmap v9161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:08:12.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17003.620997 secs 2024-04-21T15:08:12.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:12 smithi191 ceph-mon[31636]: pgmap v9161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:08:12.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17003.620997 secs 2024-04-21T15:08:12.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:12 smithi170 ceph-mon[31212]: pgmap v9161: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:08:12.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17003.620997 secs 2024-04-21T15:08:14.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:14 smithi077 ceph-mon[27902]: pgmap v9162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T15:08:14.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17005.382436 secs 2024-04-21T15:08:14.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:14 smithi191 ceph-mon[31636]: pgmap v9162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T15:08:14.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17005.382436 secs 2024-04-21T15:08:14.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:14 smithi170 ceph-mon[31212]: pgmap v9162: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T15:08:14.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17005.382436 secs 2024-04-21T15:08:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:16.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:16 smithi077 ceph-mon[27902]: pgmap v9163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:08:16.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:16 smithi191 ceph-mon[31636]: pgmap v9163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:08:16.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:16 smithi170 ceph-mon[31212]: pgmap v9163: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:08:17.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17008.621110 secs 2024-04-21T15:08:17.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17008.621110 secs 2024-04-21T15:08:17.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17008.621110 secs 2024-04-21T15:08:18.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:18 smithi077 ceph-mon[27902]: pgmap v9164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:08:18.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:18 smithi191 ceph-mon[31636]: pgmap v9164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:08:18.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:18 smithi170 ceph-mon[31212]: pgmap v9164: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:08:19.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17010.382555 secs 2024-04-21T15:08:19.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17010.382555 secs 2024-04-21T15:08:19.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17010.382555 secs 2024-04-21T15:08:20.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:20.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:20 smithi077 ceph-mon[27902]: pgmap v9165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:08:20.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:20 smithi191 ceph-mon[31636]: pgmap v9165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:08:20.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:20 smithi170 ceph-mon[31212]: pgmap v9165: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:08:22.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:22 smithi191 ceph-mon[31636]: pgmap v9166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:08:22.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17013.621222 secs 2024-04-21T15:08:22.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:22 smithi170 ceph-mon[31212]: pgmap v9166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:08:22.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17013.621222 secs 2024-04-21T15:08:22.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:22 smithi077 ceph-mon[27902]: pgmap v9166: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:08:22.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17013.621222 secs 2024-04-21T15:08:24.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:24 smithi191 ceph-mon[31636]: pgmap v9167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:24.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17015.382675 secs 2024-04-21T15:08:24.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:24 smithi170 ceph-mon[31212]: pgmap v9167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:24.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17015.382675 secs 2024-04-21T15:08:24.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:24 smithi077 ceph-mon[27902]: pgmap v9167: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:24.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17015.382675 secs 2024-04-21T15:08:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:26.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:26 smithi191 ceph-mon[31636]: pgmap v9168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:26.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:26 smithi170 ceph-mon[31212]: pgmap v9168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:26.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:26 smithi077 ceph-mon[27902]: pgmap v9168: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:27.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17018.621337 secs 2024-04-21T15:08:27.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17018.621337 secs 2024-04-21T15:08:27.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17018.621337 secs 2024-04-21T15:08:28.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:28 smithi191 ceph-mon[31636]: pgmap v9169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:28.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:28 smithi170 ceph-mon[31212]: pgmap v9169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:28.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:28 smithi077 ceph-mon[27902]: pgmap v9169: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:29.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17020.382796 secs 2024-04-21T15:08:29.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17020.382796 secs 2024-04-21T15:08:29.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17020.382796 secs 2024-04-21T15:08:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:30.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:30 smithi191 ceph-mon[31636]: pgmap v9170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:30.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:30 smithi170 ceph-mon[31212]: pgmap v9170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:30.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:30 smithi077 ceph-mon[27902]: pgmap v9170: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:32.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:32 smithi191 ceph-mon[31636]: pgmap v9171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:32.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17023.621472 secs 2024-04-21T15:08:32.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:32 smithi170 ceph-mon[31212]: pgmap v9171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:32.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17023.621472 secs 2024-04-21T15:08:32.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:32 smithi077 ceph-mon[27902]: pgmap v9171: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:32.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17023.621472 secs 2024-04-21T15:08:34.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:34 smithi191 ceph-mon[31636]: pgmap v9172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:34.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17025.382904 secs 2024-04-21T15:08:34.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:34 smithi170 ceph-mon[31212]: pgmap v9172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:34.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17025.382904 secs 2024-04-21T15:08:34.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:34 smithi077 ceph-mon[27902]: pgmap v9172: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:34.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17025.382904 secs 2024-04-21T15:08:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:36.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:36 smithi191 ceph-mon[31636]: pgmap v9173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:36.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:36 smithi170 ceph-mon[31212]: pgmap v9173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:36.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:36 smithi077 ceph-mon[27902]: pgmap v9173: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:37.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17028.621583 secs 2024-04-21T15:08:37.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17028.621583 secs 2024-04-21T15:08:37.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17028.621583 secs 2024-04-21T15:08:38.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:38 smithi191 ceph-mon[31636]: pgmap v9174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:38.781 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:38 smithi077 ceph-mon[27902]: pgmap v9174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:38.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:38 smithi170 ceph-mon[31212]: pgmap v9174: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:39.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17030.383025 secs 2024-04-21T15:08:39.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17030.383025 secs 2024-04-21T15:08:39.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17030.383025 secs 2024-04-21T15:08:40.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:40 smithi191 ceph-mon[31636]: pgmap v9175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:40.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:08:40.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:40 smithi170 ceph-mon[31212]: pgmap v9175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:40.801 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:08:40.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:40 smithi077 ceph-mon[27902]: pgmap v9175: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:40.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:08:41.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:41.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:41.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:08:41.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:08:41.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:41.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:41.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:41.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:08:41.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:08:41.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:42.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:42.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:42.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:08:42.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:08:42.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:08:42.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:42 smithi077 ceph-mon[27902]: pgmap v9176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:42.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17033.621704 secs 2024-04-21T15:08:42.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:42 smithi191 ceph-mon[31636]: pgmap v9176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:42.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17033.621704 secs 2024-04-21T15:08:43.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:42 smithi170 ceph-mon[31212]: pgmap v9176: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:43.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17033.621704 secs 2024-04-21T15:08:44.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:44 smithi077 ceph-mon[27902]: pgmap v9177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:44.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17035.383136 secs 2024-04-21T15:08:44.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:44 smithi191 ceph-mon[31636]: pgmap v9177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:44.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17035.383136 secs 2024-04-21T15:08:45.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:44 smithi170 ceph-mon[31212]: pgmap v9177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:45.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17035.383136 secs 2024-04-21T15:08:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:46.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:46 smithi077 ceph-mon[27902]: pgmap v9178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:46.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:46 smithi191 ceph-mon[31636]: pgmap v9178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:47.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:46 smithi170 ceph-mon[31212]: pgmap v9178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:47.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17038.621844 secs 2024-04-21T15:08:47.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17038.621844 secs 2024-04-21T15:08:48.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17038.621844 secs 2024-04-21T15:08:48.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:48 smithi077 ceph-mon[27902]: pgmap v9179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:48.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:48 smithi191 ceph-mon[31636]: pgmap v9179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:49.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:48 smithi170 ceph-mon[31212]: pgmap v9179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:49.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17040.383254 secs 2024-04-21T15:08:49.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17040.383254 secs 2024-04-21T15:08:50.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17040.383254 secs 2024-04-21T15:08:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:50.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:50 smithi077 ceph-mon[27902]: pgmap v9180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:50.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:50 smithi191 ceph-mon[31636]: pgmap v9180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:51.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:50 smithi170 ceph-mon[31212]: pgmap v9180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:52.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:52 smithi077 ceph-mon[27902]: pgmap v9181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:52.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17043.621976 secs 2024-04-21T15:08:52.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:52 smithi191 ceph-mon[31636]: pgmap v9181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:52.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17043.621976 secs 2024-04-21T15:08:53.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:52 smithi170 ceph-mon[31212]: pgmap v9181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:53.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17043.621976 secs 2024-04-21T15:08:54.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:54 smithi077 ceph-mon[27902]: pgmap v9182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:54.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17045.383369 secs 2024-04-21T15:08:54.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:54 smithi191 ceph-mon[31636]: pgmap v9182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:54.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17045.383369 secs 2024-04-21T15:08:55.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:54 smithi170 ceph-mon[31212]: pgmap v9182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:55.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17045.383369 secs 2024-04-21T15:08:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:08:56.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:56 smithi077 ceph-mon[27902]: pgmap v9183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:56.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:56 smithi191 ceph-mon[31636]: pgmap v9183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:57.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:56 smithi170 ceph-mon[31212]: pgmap v9183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:08:57.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17048.622073 secs 2024-04-21T15:08:57.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17048.622073 secs 2024-04-21T15:08:58.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17048.622073 secs 2024-04-21T15:08:58.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:58 smithi077 ceph-mon[27902]: pgmap v9184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:58.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:58 smithi191 ceph-mon[31636]: pgmap v9184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:59.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:58 smithi170 ceph-mon[31212]: pgmap v9184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:08:59.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17050.383514 secs 2024-04-21T15:09:00.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17050.383514 secs 2024-04-21T15:09:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:00.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17050.383514 secs 2024-04-21T15:09:00.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:00 smithi191 ceph-mon[31636]: pgmap v9185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:01.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:00 smithi170 ceph-mon[31212]: pgmap v9185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:01.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:00 smithi077 ceph-mon[27902]: pgmap v9185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:02.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:02 smithi191 ceph-mon[31636]: pgmap v9186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:02.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17053.622152 secs 2024-04-21T15:09:03.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:02 smithi170 ceph-mon[31212]: pgmap v9186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:03.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17053.622152 secs 2024-04-21T15:09:03.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:02 smithi077 ceph-mon[27902]: pgmap v9186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:03.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17053.622152 secs 2024-04-21T15:09:04.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:04 smithi191 ceph-mon[31636]: pgmap v9187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:04.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17055.383647 secs 2024-04-21T15:09:04.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:04 smithi191 ceph-mon[31636]: osdmap e646: 12 total, 12 up, 12 in 2024-04-21T15:09:05.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:04 smithi170 ceph-mon[31212]: pgmap v9187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:05.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17055.383647 secs 2024-04-21T15:09:05.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:04 smithi170 ceph-mon[31212]: osdmap e646: 12 total, 12 up, 12 in 2024-04-21T15:09:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:05.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:04 smithi077 ceph-mon[27902]: pgmap v9187: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:05.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17055.383647 secs 2024-04-21T15:09:05.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:04 smithi077 ceph-mon[27902]: osdmap e646: 12 total, 12 up, 12 in 2024-04-21T15:09:06.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:06 smithi191 ceph-mon[31636]: pgmap v9189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:09:07.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:06 smithi170 ceph-mon[31212]: pgmap v9189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:09:07.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:06 smithi077 ceph-mon[27902]: pgmap v9189: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:09:07.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17058.622302 secs 2024-04-21T15:09:08.034 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17058.622302 secs 2024-04-21T15:09:08.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17058.622302 secs 2024-04-21T15:09:08.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:08 smithi191 ceph-mon[31636]: pgmap v9190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:09:09.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:08 smithi170 ceph-mon[31212]: pgmap v9190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:09:09.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:08 smithi077 ceph-mon[27902]: pgmap v9190: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:09:09.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17060.383782 secs 2024-04-21T15:09:10.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17060.383782 secs 2024-04-21T15:09:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:10.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17060.383782 secs 2024-04-21T15:09:10.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:10 smithi191 ceph-mon[31636]: pgmap v9191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:09:10.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:10 smithi191 ceph-mon[31636]: osdmap e647: 12 total, 12 up, 12 in 2024-04-21T15:09:11.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:10 smithi170 ceph-mon[31212]: pgmap v9191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:09:11.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:10 smithi170 ceph-mon[31212]: osdmap e647: 12 total, 12 up, 12 in 2024-04-21T15:09:11.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:10 smithi077 ceph-mon[27902]: pgmap v9191: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:09:11.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:10 smithi077 ceph-mon[27902]: osdmap e647: 12 total, 12 up, 12 in 2024-04-21T15:09:12.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:12 smithi191 ceph-mon[31636]: pgmap v9193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:09:12.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17063.622429 secs 2024-04-21T15:09:13.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:12 smithi170 ceph-mon[31212]: pgmap v9193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:09:13.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17063.622429 secs 2024-04-21T15:09:13.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:12 smithi077 ceph-mon[27902]: pgmap v9193: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:09:13.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17063.622429 secs 2024-04-21T15:09:14.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:14 smithi191 ceph-mon[31636]: pgmap v9194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:09:14.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17065.383896 secs 2024-04-21T15:09:15.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:14 smithi170 ceph-mon[31212]: pgmap v9194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:09:15.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17065.383896 secs 2024-04-21T15:09:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:15.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:14 smithi077 ceph-mon[27902]: pgmap v9194: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:09:15.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17065.383896 secs 2024-04-21T15:09:16.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:16 smithi191 ceph-mon[31636]: pgmap v9195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:09:17.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:16 smithi170 ceph-mon[31212]: pgmap v9195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:09:17.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:16 smithi077 ceph-mon[27902]: pgmap v9195: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:09:17.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17068.622598 secs 2024-04-21T15:09:18.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17068.622598 secs 2024-04-21T15:09:18.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17068.622598 secs 2024-04-21T15:09:18.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:18 smithi191 ceph-mon[31636]: pgmap v9196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:09:19.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:18 smithi170 ceph-mon[31212]: pgmap v9196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:09:19.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:18 smithi077 ceph-mon[27902]: pgmap v9196: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:09:19.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17070.384014 secs 2024-04-21T15:09:20.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17070.384014 secs 2024-04-21T15:09:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:20.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17070.384014 secs 2024-04-21T15:09:20.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:20 smithi191 ceph-mon[31636]: pgmap v9197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:09:21.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:20 smithi170 ceph-mon[31212]: pgmap v9197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:09:21.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:20 smithi077 ceph-mon[27902]: pgmap v9197: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:09:22.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:22 smithi191 ceph-mon[31636]: pgmap v9198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:09:22.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17073.622729 secs 2024-04-21T15:09:23.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:22 smithi170 ceph-mon[31212]: pgmap v9198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:09:23.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17073.622729 secs 2024-04-21T15:09:23.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:22 smithi077 ceph-mon[27902]: pgmap v9198: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 92 B/s wr, 8 op/s 2024-04-21T15:09:23.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17073.622729 secs 2024-04-21T15:09:23.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:23 smithi191 ceph-mon[31636]: pgmap v9199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:24.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:23 smithi170 ceph-mon[31212]: pgmap v9199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:24.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:23 smithi077 ceph-mon[27902]: pgmap v9199: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:24.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17075.384124 secs 2024-04-21T15:09:25.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17075.384124 secs 2024-04-21T15:09:25.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:25.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17075.384124 secs 2024-04-21T15:09:25.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:25 smithi191 ceph-mon[31636]: pgmap v9200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:26.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:25 smithi170 ceph-mon[31212]: pgmap v9200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:26.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:25 smithi077 ceph-mon[27902]: pgmap v9200: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:09:26.713+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:09:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:09:26.713+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:09:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:09:26.713+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:09:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:09:26.713+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:09:27.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17078.622837 secs 2024-04-21T15:09:27.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17078.622837 secs 2024-04-21T15:09:27.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17078.622837 secs 2024-04-21T15:09:28.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:28 smithi170 ceph-mon[31212]: pgmap v9201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:28.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:28 smithi077 ceph-mon[27902]: pgmap v9201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:28.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:28 smithi191 ceph-mon[31636]: pgmap v9201: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:29.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17080.384244 secs 2024-04-21T15:09:29.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17080.384244 secs 2024-04-21T15:09:29.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17080.384244 secs 2024-04-21T15:09:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:30.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:30 smithi170 ceph-mon[31212]: pgmap v9202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:30.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:30 smithi077 ceph-mon[27902]: pgmap v9202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:30.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:30 smithi191 ceph-mon[31636]: pgmap v9202: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:32.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:32 smithi191 ceph-mon[31636]: pgmap v9203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:32.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17083.622954 secs 2024-04-21T15:09:32.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:32 smithi170 ceph-mon[31212]: pgmap v9203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:32.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17083.622954 secs 2024-04-21T15:09:32.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:32 smithi077 ceph-mon[27902]: pgmap v9203: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:32.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17083.622954 secs 2024-04-21T15:09:34.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:34 smithi191 ceph-mon[31636]: pgmap v9204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:34.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17085.384306 secs 2024-04-21T15:09:34.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:34 smithi170 ceph-mon[31212]: pgmap v9204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:34.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17085.384306 secs 2024-04-21T15:09:34.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:34 smithi077 ceph-mon[27902]: pgmap v9204: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:34.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17085.384306 secs 2024-04-21T15:09:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:36.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:36 smithi191 ceph-mon[31636]: pgmap v9205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:36.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:36 smithi170 ceph-mon[31212]: pgmap v9205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:36.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:36 smithi077 ceph-mon[27902]: pgmap v9205: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:37.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17088.623060 secs 2024-04-21T15:09:37.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17088.623060 secs 2024-04-21T15:09:37.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17088.623060 secs 2024-04-21T15:09:38.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:38 smithi191 ceph-mon[31636]: pgmap v9206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:38.533 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:38 smithi077 ceph-mon[27902]: pgmap v9206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:38.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:38 smithi170 ceph-mon[31212]: pgmap v9206: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:39.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17090.384427 secs 2024-04-21T15:09:39.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17090.384427 secs 2024-04-21T15:09:39.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17090.384427 secs 2024-04-21T15:09:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:40.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:40 smithi191 ceph-mon[31636]: pgmap v9207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:40 smithi170 ceph-mon[31212]: pgmap v9207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:40.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:40 smithi077 ceph-mon[27902]: pgmap v9207: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:42.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: pgmap v9208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:42.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:09:42.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17093.623127 secs 2024-04-21T15:09:42.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: pgmap v9208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17093.623127 secs 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: pgmap v9208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:42.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:09:42.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17093.623127 secs 2024-04-21T15:09:42.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:42.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:43.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:09:43.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:09:43.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:43.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:09:43.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:09:43.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:43.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:09:43.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:09:43.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:09:44.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:44 smithi077 ceph-mon[27902]: pgmap v9209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:44.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17095.384493 secs 2024-04-21T15:09:44.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:44 smithi191 ceph-mon[31636]: pgmap v9209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:44.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17095.384493 secs 2024-04-21T15:09:45.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:44 smithi170 ceph-mon[31212]: pgmap v9209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:45.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17095.384493 secs 2024-04-21T15:09:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:46.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:46 smithi077 ceph-mon[27902]: pgmap v9210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:46.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:46 smithi191 ceph-mon[31636]: pgmap v9210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:47.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:46 smithi170 ceph-mon[31212]: pgmap v9210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:09:47.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17098.623246 secs 2024-04-21T15:09:47.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17098.623246 secs 2024-04-21T15:09:48.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17098.623246 secs 2024-04-21T15:09:48.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:48 smithi077 ceph-mon[27902]: pgmap v9211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:48.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:48 smithi191 ceph-mon[31636]: pgmap v9211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:49.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:48 smithi170 ceph-mon[31212]: pgmap v9211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:49.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17100.384571 secs 2024-04-21T15:09:49.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17100.384571 secs 2024-04-21T15:09:50.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17100.384571 secs 2024-04-21T15:09:50.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:50.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:50 smithi077 ceph-mon[27902]: pgmap v9212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:50.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:50 smithi191 ceph-mon[31636]: pgmap v9212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:51.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:50 smithi170 ceph-mon[31212]: pgmap v9212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:52.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:52 smithi077 ceph-mon[27902]: pgmap v9213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:52.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17103.623357 secs 2024-04-21T15:09:52.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:52 smithi191 ceph-mon[31636]: pgmap v9213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:52.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17103.623357 secs 2024-04-21T15:09:53.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:52 smithi170 ceph-mon[31212]: pgmap v9213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:53.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17103.623357 secs 2024-04-21T15:09:54.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:54 smithi077 ceph-mon[27902]: pgmap v9214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:54.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17105.384686 secs 2024-04-21T15:09:54.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:54 smithi191 ceph-mon[31636]: pgmap v9214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:54.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17105.384686 secs 2024-04-21T15:09:55.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:54 smithi170 ceph-mon[31212]: pgmap v9214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:55.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17105.384686 secs 2024-04-21T15:09:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:09:56.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:56 smithi077 ceph-mon[27902]: pgmap v9215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:56.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:56 smithi191 ceph-mon[31636]: pgmap v9215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:57.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:56 smithi170 ceph-mon[31212]: pgmap v9215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:09:57.866 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17108.623460 secs 2024-04-21T15:09:57.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17108.623460 secs 2024-04-21T15:09:57.954 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17108.623460 secs 2024-04-21T15:09:58.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:58 smithi077 ceph-mon[27902]: pgmap v9216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:58.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:58 smithi191 ceph-mon[31636]: pgmap v9216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:59.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:58 smithi170 ceph-mon[31212]: pgmap v9216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:09:59.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17110.384806 secs 2024-04-21T15:09:59.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17110.384806 secs 2024-04-21T15:10:00.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17110.384806 secs 2024-04-21T15:10:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:00.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:00 smithi077 ceph-mon[27902]: pgmap v9217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:00.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:10:00.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:00 smithi191 ceph-mon[31636]: pgmap v9217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:00.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:10:01.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:00 smithi170 ceph-mon[31212]: pgmap v9217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:01.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:10:02.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:02 smithi077 ceph-mon[27902]: pgmap v9218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T15:10:02.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17113.623585 secs 2024-04-21T15:10:02.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:02 smithi191 ceph-mon[31636]: pgmap v9218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T15:10:02.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17113.623585 secs 2024-04-21T15:10:03.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:02 smithi170 ceph-mon[31212]: pgmap v9218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T15:10:03.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17113.623585 secs 2024-04-21T15:10:04.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:04 smithi077 ceph-mon[27902]: pgmap v9219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T15:10:04.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17115.384956 secs 2024-04-21T15:10:04.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:04 smithi077 ceph-mon[27902]: osdmap e648: 12 total, 12 up, 12 in 2024-04-21T15:10:04.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:04 smithi191 ceph-mon[31636]: pgmap v9219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T15:10:04.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17115.384956 secs 2024-04-21T15:10:04.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:04 smithi191 ceph-mon[31636]: osdmap e648: 12 total, 12 up, 12 in 2024-04-21T15:10:05.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:04 smithi170 ceph-mon[31212]: pgmap v9219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T15:10:05.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17115.384956 secs 2024-04-21T15:10:05.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:04 smithi170 ceph-mon[31212]: osdmap e648: 12 total, 12 up, 12 in 2024-04-21T15:10:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:06.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:06 smithi077 ceph-mon[27902]: pgmap v9221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T15:10:06.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:06 smithi191 ceph-mon[31636]: pgmap v9221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T15:10:07.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:06 smithi170 ceph-mon[31212]: pgmap v9221: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T15:10:07.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17118.623726 secs 2024-04-21T15:10:07.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17118.623726 secs 2024-04-21T15:10:08.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17118.623726 secs 2024-04-21T15:10:08.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:08 smithi077 ceph-mon[27902]: pgmap v9222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:10:08.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:08 smithi191 ceph-mon[31636]: pgmap v9222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:10:09.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:08 smithi170 ceph-mon[31212]: pgmap v9222: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:10:09.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17120.385073 secs 2024-04-21T15:10:09.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17120.385073 secs 2024-04-21T15:10:10.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17120.385073 secs 2024-04-21T15:10:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:10.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:10 smithi077 ceph-mon[27902]: pgmap v9223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:10:10.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:10 smithi077 ceph-mon[27902]: osdmap e649: 12 total, 12 up, 12 in 2024-04-21T15:10:10.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:10 smithi191 ceph-mon[31636]: pgmap v9223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:10:10.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:10 smithi191 ceph-mon[31636]: osdmap e649: 12 total, 12 up, 12 in 2024-04-21T15:10:11.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:10 smithi170 ceph-mon[31212]: pgmap v9223: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:10:11.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:10 smithi170 ceph-mon[31212]: osdmap e649: 12 total, 12 up, 12 in 2024-04-21T15:10:12.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:12 smithi077 ceph-mon[27902]: pgmap v9225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T15:10:12.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17123.623844 secs 2024-04-21T15:10:12.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:12 smithi191 ceph-mon[31636]: pgmap v9225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T15:10:12.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17123.623844 secs 2024-04-21T15:10:13.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:12 smithi170 ceph-mon[31212]: pgmap v9225: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T15:10:13.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17123.623844 secs 2024-04-21T15:10:14.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:14 smithi191 ceph-mon[31636]: pgmap v9226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 KiB/s wr, 24 op/s 2024-04-21T15:10:14.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17125.385182 secs 2024-04-21T15:10:15.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:14 smithi170 ceph-mon[31212]: pgmap v9226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 KiB/s wr, 24 op/s 2024-04-21T15:10:15.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17125.385182 secs 2024-04-21T15:10:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:15.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:14 smithi077 ceph-mon[27902]: pgmap v9226: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 KiB/s wr, 24 op/s 2024-04-21T15:10:15.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17125.385182 secs 2024-04-21T15:10:16.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:16 smithi191 ceph-mon[31636]: pgmap v9227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T15:10:17.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:16 smithi170 ceph-mon[31212]: pgmap v9227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T15:10:17.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:16 smithi077 ceph-mon[27902]: pgmap v9227: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T15:10:17.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17128.623952 secs 2024-04-21T15:10:18.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17128.623952 secs 2024-04-21T15:10:18.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17128.623952 secs 2024-04-21T15:10:18.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:18 smithi191 ceph-mon[31636]: pgmap v9228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:10:19.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:18 smithi170 ceph-mon[31212]: pgmap v9228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:10:19.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:18 smithi077 ceph-mon[27902]: pgmap v9228: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:10:19.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17130.385299 secs 2024-04-21T15:10:20.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17130.385299 secs 2024-04-21T15:10:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:20.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17130.385299 secs 2024-04-21T15:10:20.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:20 smithi191 ceph-mon[31636]: pgmap v9229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:10:21.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:20 smithi170 ceph-mon[31212]: pgmap v9229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:10:21.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:20 smithi077 ceph-mon[27902]: pgmap v9229: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:10:22.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:22 smithi191 ceph-mon[31636]: pgmap v9230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:10:22.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17133.624060 secs 2024-04-21T15:10:23.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:22 smithi170 ceph-mon[31212]: pgmap v9230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:10:23.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17133.624060 secs 2024-04-21T15:10:23.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:22 smithi077 ceph-mon[27902]: pgmap v9230: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:10:23.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17133.624060 secs 2024-04-21T15:10:24.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:24 smithi191 ceph-mon[31636]: pgmap v9231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:24.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17135.385418 secs 2024-04-21T15:10:25.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:24 smithi170 ceph-mon[31212]: pgmap v9231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:25.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17135.385418 secs 2024-04-21T15:10:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:25.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:24 smithi077 ceph-mon[27902]: pgmap v9231: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:25.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17135.385418 secs 2024-04-21T15:10:26.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:26 smithi191 ceph-mon[31636]: pgmap v9232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:27.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:26 smithi170 ceph-mon[31212]: pgmap v9232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:27.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:26 smithi077 ceph-mon[27902]: pgmap v9232: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:27.955 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17138.624217 secs 2024-04-21T15:10:27.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17138.624217 secs 2024-04-21T15:10:28.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17138.624217 secs 2024-04-21T15:10:28.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:28 smithi191 ceph-mon[31636]: pgmap v9233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:29.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:28 smithi170 ceph-mon[31212]: pgmap v9233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:29.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:28 smithi077 ceph-mon[27902]: pgmap v9233: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:29.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17140.385532 secs 2024-04-21T15:10:30.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17140.385532 secs 2024-04-21T15:10:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:30.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17140.385532 secs 2024-04-21T15:10:30.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:30 smithi191 ceph-mon[31636]: pgmap v9234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:31.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:30 smithi170 ceph-mon[31212]: pgmap v9234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:31.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:30 smithi077 ceph-mon[27902]: pgmap v9234: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:32.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:32 smithi191 ceph-mon[31636]: pgmap v9235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:32.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17143.624355 secs 2024-04-21T15:10:33.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:32 smithi170 ceph-mon[31212]: pgmap v9235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:33.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17143.624355 secs 2024-04-21T15:10:33.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:32 smithi077 ceph-mon[27902]: pgmap v9235: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:33.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17143.624355 secs 2024-04-21T15:10:34.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:34 smithi191 ceph-mon[31636]: pgmap v9236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:34.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17145.385673 secs 2024-04-21T15:10:35.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:34 smithi170 ceph-mon[31212]: pgmap v9236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:35.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17145.385673 secs 2024-04-21T15:10:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:35.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:34 smithi077 ceph-mon[27902]: pgmap v9236: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:35.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17145.385673 secs 2024-04-21T15:10:36.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:36 smithi191 ceph-mon[31636]: pgmap v9237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:37.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:36 smithi170 ceph-mon[31212]: pgmap v9237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:37.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:36 smithi077 ceph-mon[27902]: pgmap v9237: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:37.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17148.624478 secs 2024-04-21T15:10:38.034 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17148.624478 secs 2024-04-21T15:10:38.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17148.624478 secs 2024-04-21T15:10:38.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:38 smithi191 ceph-mon[31636]: pgmap v9238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:39.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:38 smithi170 ceph-mon[31212]: pgmap v9238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:38 smithi077 ceph-mon[27902]: pgmap v9238: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:39.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17150.385795 secs 2024-04-21T15:10:40.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17150.385795 secs 2024-04-21T15:10:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:40.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17150.385795 secs 2024-04-21T15:10:40.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:40 smithi191 ceph-mon[31636]: pgmap v9239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:41.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:40 smithi170 ceph-mon[31212]: pgmap v9239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:41.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:40 smithi077 ceph-mon[27902]: pgmap v9239: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:42.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:42 smithi191 ceph-mon[31636]: pgmap v9240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:42.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17153.624620 secs 2024-04-21T15:10:42.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:10:43.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:42 smithi170 ceph-mon[31212]: pgmap v9240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:43.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17153.624620 secs 2024-04-21T15:10:43.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:10:43.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:42 smithi077 ceph-mon[27902]: pgmap v9240: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17153.624620 secs 2024-04-21T15:10:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:10:43.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:43 smithi191 ceph-mon[31636]: pgmap v9241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:43.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:10:43.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:10:43.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:10:44.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:43 smithi170 ceph-mon[31212]: pgmap v9241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:44.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:10:44.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:10:44.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:10:44.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:43 smithi077 ceph-mon[27902]: pgmap v9241: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:44.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:10:44.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:10:44.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:10:45.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17155.385938 secs 2024-04-21T15:10:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:45.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17155.385938 secs 2024-04-21T15:10:45.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17155.385938 secs 2024-04-21T15:10:46.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:45 smithi170 ceph-mon[31212]: pgmap v9242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:46.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:45 smithi077 ceph-mon[27902]: pgmap v9242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:46.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:45 smithi191 ceph-mon[31636]: pgmap v9242: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:47.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17158.624744 secs 2024-04-21T15:10:47.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17158.624744 secs 2024-04-21T15:10:47.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17158.624744 secs 2024-04-21T15:10:48.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:48 smithi170 ceph-mon[31212]: pgmap v9243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:48.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:48 smithi077 ceph-mon[27902]: pgmap v9243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:48.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:48 smithi191 ceph-mon[31636]: pgmap v9243: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:49.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17160.386068 secs 2024-04-21T15:10:49.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17160.386068 secs 2024-04-21T15:10:49.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17160.386068 secs 2024-04-21T15:10:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:50.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:50 smithi170 ceph-mon[31212]: pgmap v9244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:50.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:50 smithi077 ceph-mon[27902]: pgmap v9244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:50.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:50 smithi191 ceph-mon[31636]: pgmap v9244: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:52.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:52 smithi191 ceph-mon[31636]: pgmap v9245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:52.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17163.624863 secs 2024-04-21T15:10:52.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:52 smithi170 ceph-mon[31212]: pgmap v9245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:52.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17163.624863 secs 2024-04-21T15:10:52.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:52 smithi077 ceph-mon[27902]: pgmap v9245: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:52.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17163.624863 secs 2024-04-21T15:10:54.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:54 smithi191 ceph-mon[31636]: pgmap v9246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:54.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17165.386148 secs 2024-04-21T15:10:54.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:54 smithi170 ceph-mon[31212]: pgmap v9246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:54.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17165.386148 secs 2024-04-21T15:10:54.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:54 smithi077 ceph-mon[27902]: pgmap v9246: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:54.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17165.386148 secs 2024-04-21T15:10:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:10:56.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:56 smithi191 ceph-mon[31636]: pgmap v9247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:56.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:56 smithi170 ceph-mon[31212]: pgmap v9247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:56.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:56 smithi077 ceph-mon[27902]: pgmap v9247: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:10:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:10:56.727+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:10:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:10:56.727+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:10:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:10:56.727+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:10:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:10:56.727+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:10:57.456 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17168.624978 secs 2024-04-21T15:10:57.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17168.624978 secs 2024-04-21T15:10:57.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17168.624978 secs 2024-04-21T15:10:58.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:58 smithi191 ceph-mon[31636]: pgmap v9248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:58.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:58 smithi170 ceph-mon[31212]: pgmap v9248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:58.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:58 smithi077 ceph-mon[27902]: pgmap v9248: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:10:59.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17170.386255 secs 2024-04-21T15:10:59.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17170.386255 secs 2024-04-21T15:10:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17170.386255 secs 2024-04-21T15:11:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:00.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:00 smithi170 ceph-mon[31212]: pgmap v9249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:00 smithi077 ceph-mon[27902]: pgmap v9249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:00.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:00 smithi191 ceph-mon[31636]: pgmap v9249: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:02.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:02 smithi170 ceph-mon[31212]: pgmap v9250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:02.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17173.625094 secs 2024-04-21T15:11:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:02 smithi077 ceph-mon[27902]: pgmap v9250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17173.625094 secs 2024-04-21T15:11:02.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:02 smithi191 ceph-mon[31636]: pgmap v9250: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:02.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17173.625094 secs 2024-04-21T15:11:04.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:04 smithi170 ceph-mon[31212]: pgmap v9251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:04.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17175.386377 secs 2024-04-21T15:11:04.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:04 smithi077 ceph-mon[27902]: pgmap v9251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:04.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17175.386377 secs 2024-04-21T15:11:04.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:04 smithi191 ceph-mon[31636]: pgmap v9251: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:04.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17175.386377 secs 2024-04-21T15:11:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:05.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:05 smithi170 ceph-mon[31212]: osdmap e650: 12 total, 12 up, 12 in 2024-04-21T15:11:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:05 smithi077 ceph-mon[27902]: osdmap e650: 12 total, 12 up, 12 in 2024-04-21T15:11:05.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:05 smithi191 ceph-mon[31636]: osdmap e650: 12 total, 12 up, 12 in 2024-04-21T15:11:06.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:06 smithi170 ceph-mon[31212]: pgmap v9253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:11:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:06 smithi077 ceph-mon[27902]: pgmap v9253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:11:06.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:06 smithi191 ceph-mon[31636]: pgmap v9253: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T15:11:07.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17178.625172 secs 2024-04-21T15:11:07.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17178.625172 secs 2024-04-21T15:11:07.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17178.625172 secs 2024-04-21T15:11:08.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:08 smithi077 ceph-mon[27902]: pgmap v9254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:11:08.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:08 smithi170 ceph-mon[31212]: pgmap v9254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:11:08.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:08 smithi191 ceph-mon[31636]: pgmap v9254: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:11:09.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17180.386485 secs 2024-04-21T15:11:09.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17180.386485 secs 2024-04-21T15:11:09.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17180.386485 secs 2024-04-21T15:11:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:10.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:10 smithi170 ceph-mon[31212]: pgmap v9255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:11:10.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:10 smithi170 ceph-mon[31212]: osdmap e651: 12 total, 12 up, 12 in 2024-04-21T15:11:10.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:10 smithi077 ceph-mon[27902]: pgmap v9255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:11:10.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:10 smithi077 ceph-mon[27902]: osdmap e651: 12 total, 12 up, 12 in 2024-04-21T15:11:10.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:10 smithi191 ceph-mon[31636]: pgmap v9255: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:11:10.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:10 smithi191 ceph-mon[31636]: osdmap e651: 12 total, 12 up, 12 in 2024-04-21T15:11:12.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:12 smithi170 ceph-mon[31212]: pgmap v9257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:11:12.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17183.625288 secs 2024-04-21T15:11:12.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:12 smithi077 ceph-mon[27902]: pgmap v9257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:11:12.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17183.625288 secs 2024-04-21T15:11:12.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:12 smithi191 ceph-mon[31636]: pgmap v9257: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:11:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17183.625288 secs 2024-04-21T15:11:14.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:14 smithi170 ceph-mon[31212]: pgmap v9258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:11:14.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17185.386602 secs 2024-04-21T15:11:14.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:14 smithi077 ceph-mon[27902]: pgmap v9258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:11:14.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17185.386602 secs 2024-04-21T15:11:14.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:14 smithi191 ceph-mon[31636]: pgmap v9258: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:11:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17185.386602 secs 2024-04-21T15:11:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:16.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:16 smithi170 ceph-mon[31212]: pgmap v9259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:11:16.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:16 smithi077 ceph-mon[27902]: pgmap v9259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:11:16.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:16 smithi191 ceph-mon[31636]: pgmap v9259: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:11:17.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17188.625402 secs 2024-04-21T15:11:17.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17188.625402 secs 2024-04-21T15:11:17.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17188.625402 secs 2024-04-21T15:11:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:18 smithi170 ceph-mon[31212]: pgmap v9260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:11:18.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:18 smithi077 ceph-mon[27902]: pgmap v9260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:11:18.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:18 smithi191 ceph-mon[31636]: pgmap v9260: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:11:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17190.386723 secs 2024-04-21T15:11:19.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17190.386723 secs 2024-04-21T15:11:19.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17190.386723 secs 2024-04-21T15:11:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:20 smithi170 ceph-mon[31212]: pgmap v9261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:11:20.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:20 smithi077 ceph-mon[27902]: pgmap v9261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:11:20.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:20 smithi191 ceph-mon[31636]: pgmap v9261: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:11:22.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:22 smithi170 ceph-mon[31212]: pgmap v9262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:11:22.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17193.625543 secs 2024-04-21T15:11:22.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:22 smithi077 ceph-mon[27902]: pgmap v9262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:11:22.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17193.625543 secs 2024-04-21T15:11:22.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:22 smithi191 ceph-mon[31636]: pgmap v9262: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:11:22.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17193.625543 secs 2024-04-21T15:11:24.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:24 smithi170 ceph-mon[31212]: pgmap v9263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:24.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17195.386842 secs 2024-04-21T15:11:24.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:24 smithi077 ceph-mon[27902]: pgmap v9263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:24.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17195.386842 secs 2024-04-21T15:11:24.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:24 smithi191 ceph-mon[31636]: pgmap v9263: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:24.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17195.386842 secs 2024-04-21T15:11:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:26.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:26 smithi170 ceph-mon[31212]: pgmap v9264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:26.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:26 smithi077 ceph-mon[27902]: pgmap v9264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:26.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:26 smithi191 ceph-mon[31636]: pgmap v9264: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17198.625682 secs 2024-04-21T15:11:27.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17198.625682 secs 2024-04-21T15:11:27.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17198.625682 secs 2024-04-21T15:11:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:28 smithi170 ceph-mon[31212]: pgmap v9265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:28.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:28 smithi077 ceph-mon[27902]: pgmap v9265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:28.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:28 smithi191 ceph-mon[31636]: pgmap v9265: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:29.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17200.386996 secs 2024-04-21T15:11:29.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17200.386996 secs 2024-04-21T15:11:29.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17200.386996 secs 2024-04-21T15:11:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:30.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:30 smithi077 ceph-mon[27902]: pgmap v9266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:30.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:30 smithi191 ceph-mon[31636]: pgmap v9266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:30 smithi170 ceph-mon[31212]: pgmap v9266: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:32.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:32 smithi077 ceph-mon[27902]: pgmap v9267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:32.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17203.625783 secs 2024-04-21T15:11:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:32 smithi191 ceph-mon[31636]: pgmap v9267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:32.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17203.625783 secs 2024-04-21T15:11:32.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:32 smithi170 ceph-mon[31212]: pgmap v9267: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:32.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17203.625783 secs 2024-04-21T15:11:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:34 smithi077 ceph-mon[27902]: pgmap v9268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17205.387109 secs 2024-04-21T15:11:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:34 smithi191 ceph-mon[31636]: pgmap v9268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17205.387109 secs 2024-04-21T15:11:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:34 smithi170 ceph-mon[31212]: pgmap v9268: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17205.387109 secs 2024-04-21T15:11:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:36 smithi077 ceph-mon[27902]: pgmap v9269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:36.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:36 smithi191 ceph-mon[31636]: pgmap v9269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:36.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:36 smithi170 ceph-mon[31212]: pgmap v9269: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:37.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17208.625857 secs 2024-04-21T15:11:37.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17208.625857 secs 2024-04-21T15:11:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17208.625857 secs 2024-04-21T15:11:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:38 smithi077 ceph-mon[27902]: pgmap v9270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:38 smithi191 ceph-mon[31636]: pgmap v9270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:38 smithi170 ceph-mon[31212]: pgmap v9270: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17210.387224 secs 2024-04-21T15:11:39.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17210.387224 secs 2024-04-21T15:11:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17210.387224 secs 2024-04-21T15:11:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:40 smithi077 ceph-mon[27902]: pgmap v9271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:40 smithi191 ceph-mon[31636]: pgmap v9271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:40 smithi170 ceph-mon[31212]: pgmap v9271: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:42 smithi077 ceph-mon[27902]: pgmap v9272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17213.625974 secs 2024-04-21T15:11:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:42 smithi191 ceph-mon[31636]: pgmap v9272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17213.625974 secs 2024-04-21T15:11:42.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:42 smithi170 ceph-mon[31212]: pgmap v9272: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:42.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17213.625974 secs 2024-04-21T15:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:44 smithi077 ceph-mon[27902]: pgmap v9273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17215.387313 secs 2024-04-21T15:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:11:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:44 smithi191 ceph-mon[31636]: pgmap v9273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:11:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17215.387313 secs 2024-04-21T15:11:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:11:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:11:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:11:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:44 smithi170 ceph-mon[31212]: pgmap v9273: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:11:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17215.387313 secs 2024-04-21T15:11:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:11:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:11:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:11:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:46.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:46 smithi077 ceph-mon[27902]: pgmap v9274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:11:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:46 smithi191 ceph-mon[31636]: pgmap v9274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:11:46.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:46 smithi170 ceph-mon[31212]: pgmap v9274: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:11:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17218.626045 secs 2024-04-21T15:11:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17218.626045 secs 2024-04-21T15:11:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17218.626045 secs 2024-04-21T15:11:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:48 smithi077 ceph-mon[27902]: pgmap v9275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:48 smithi191 ceph-mon[31636]: pgmap v9275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:48 smithi170 ceph-mon[31212]: pgmap v9275: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17220.387449 secs 2024-04-21T15:11:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17220.387449 secs 2024-04-21T15:11:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17220.387449 secs 2024-04-21T15:11:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:50 smithi077 ceph-mon[27902]: pgmap v9276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:50 smithi191 ceph-mon[31636]: pgmap v9276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:50.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:50 smithi170 ceph-mon[31212]: pgmap v9276: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:52 smithi077 ceph-mon[27902]: pgmap v9277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17223.626125 secs 2024-04-21T15:11:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:52 smithi191 ceph-mon[31636]: pgmap v9277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17223.626125 secs 2024-04-21T15:11:52.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:52 smithi170 ceph-mon[31212]: pgmap v9277: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:52.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17223.626125 secs 2024-04-21T15:11:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:54 smithi077 ceph-mon[27902]: pgmap v9278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17225.387566 secs 2024-04-21T15:11:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:54 smithi191 ceph-mon[31636]: pgmap v9278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17225.387566 secs 2024-04-21T15:11:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:54 smithi170 ceph-mon[31212]: pgmap v9278: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:11:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17225.387566 secs 2024-04-21T15:11:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:11:56.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:56 smithi191 ceph-mon[31636]: pgmap v9279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:11:56.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:56 smithi170 ceph-mon[31212]: pgmap v9279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:11:56.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:56 smithi077 ceph-mon[27902]: pgmap v9279: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:11:57.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17228.626238 secs 2024-04-21T15:11:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17228.626238 secs 2024-04-21T15:11:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17228.626238 secs 2024-04-21T15:11:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:58 smithi191 ceph-mon[31636]: pgmap v9280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:58 smithi170 ceph-mon[31212]: pgmap v9280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:58 smithi077 ceph-mon[27902]: pgmap v9280: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:11:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17230.387703 secs 2024-04-21T15:11:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17230.387703 secs 2024-04-21T15:11:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17230.387703 secs 2024-04-21T15:12:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:00 smithi191 ceph-mon[31636]: pgmap v9281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:00 smithi170 ceph-mon[31212]: pgmap v9281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:00 smithi077 ceph-mon[27902]: pgmap v9281: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:02 smithi191 ceph-mon[31636]: pgmap v9282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:02.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17233.626354 secs 2024-04-21T15:12:02.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:02 smithi170 ceph-mon[31212]: pgmap v9282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:02.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17233.626354 secs 2024-04-21T15:12:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:02 smithi077 ceph-mon[27902]: pgmap v9282: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:02.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17233.626354 secs 2024-04-21T15:12:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:04 smithi191 ceph-mon[31636]: pgmap v9283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17235.387840 secs 2024-04-21T15:12:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:04 smithi170 ceph-mon[31212]: pgmap v9283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17235.387840 secs 2024-04-21T15:12:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:04 smithi077 ceph-mon[27902]: pgmap v9283: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17235.387840 secs 2024-04-21T15:12:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:05 smithi191 ceph-mon[31636]: osdmap e652: 12 total, 12 up, 12 in 2024-04-21T15:12:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:05 smithi170 ceph-mon[31212]: osdmap e652: 12 total, 12 up, 12 in 2024-04-21T15:12:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:05 smithi077 ceph-mon[27902]: osdmap e652: 12 total, 12 up, 12 in 2024-04-21T15:12:06.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:06 smithi191 ceph-mon[31636]: pgmap v9285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T15:12:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:06 smithi170 ceph-mon[31212]: pgmap v9285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T15:12:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:06 smithi077 ceph-mon[27902]: pgmap v9285: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T15:12:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17238.626471 secs 2024-04-21T15:12:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17238.626471 secs 2024-04-21T15:12:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17238.626471 secs 2024-04-21T15:12:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:08 smithi191 ceph-mon[31636]: pgmap v9286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:12:08.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:08 smithi077 ceph-mon[27902]: pgmap v9286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:12:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:08 smithi170 ceph-mon[31212]: pgmap v9286: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:12:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17240.387952 secs 2024-04-21T15:12:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17240.387952 secs 2024-04-21T15:12:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17240.387952 secs 2024-04-21T15:12:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:10 smithi191 ceph-mon[31636]: pgmap v9287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:12:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:10 smithi191 ceph-mon[31636]: osdmap e653: 12 total, 12 up, 12 in 2024-04-21T15:12:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:10 smithi170 ceph-mon[31212]: pgmap v9287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:12:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:10 smithi170 ceph-mon[31212]: osdmap e653: 12 total, 12 up, 12 in 2024-04-21T15:12:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:10 smithi077 ceph-mon[27902]: pgmap v9287: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:12:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:10 smithi077 ceph-mon[27902]: osdmap e653: 12 total, 12 up, 12 in 2024-04-21T15:12:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:12 smithi191 ceph-mon[31636]: pgmap v9289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:12:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17243.626610 secs 2024-04-21T15:12:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:12 smithi170 ceph-mon[31212]: pgmap v9289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:12:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17243.626610 secs 2024-04-21T15:12:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:12 smithi077 ceph-mon[27902]: pgmap v9289: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:12:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17243.626610 secs 2024-04-21T15:12:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:14 smithi191 ceph-mon[31636]: pgmap v9290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T15:12:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17245.388019 secs 2024-04-21T15:12:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:14 smithi170 ceph-mon[31212]: pgmap v9290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T15:12:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17245.388019 secs 2024-04-21T15:12:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:14 smithi077 ceph-mon[27902]: pgmap v9290: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T15:12:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17245.388019 secs 2024-04-21T15:12:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:16.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:16 smithi191 ceph-mon[31636]: pgmap v9291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T15:12:16.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:16 smithi170 ceph-mon[31212]: pgmap v9291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T15:12:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:16 smithi077 ceph-mon[27902]: pgmap v9291: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T15:12:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17248.626744 secs 2024-04-21T15:12:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17248.626744 secs 2024-04-21T15:12:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17248.626744 secs 2024-04-21T15:12:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:18 smithi191 ceph-mon[31636]: pgmap v9292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:12:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:18 smithi170 ceph-mon[31212]: pgmap v9292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:12:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:18 smithi077 ceph-mon[27902]: pgmap v9292: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:12:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17250.388086 secs 2024-04-21T15:12:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17250.388086 secs 2024-04-21T15:12:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17250.388086 secs 2024-04-21T15:12:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:20 smithi191 ceph-mon[31636]: pgmap v9293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:12:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:20 smithi170 ceph-mon[31212]: pgmap v9293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:12:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:20 smithi077 ceph-mon[27902]: pgmap v9293: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:12:22.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:22 smithi191 ceph-mon[31636]: pgmap v9294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:12:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17253.626796 secs 2024-04-21T15:12:22.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:22 smithi170 ceph-mon[31212]: pgmap v9294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:12:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17253.626796 secs 2024-04-21T15:12:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:22 smithi077 ceph-mon[27902]: pgmap v9294: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:12:22.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17253.626796 secs 2024-04-21T15:12:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:24 smithi191 ceph-mon[31636]: pgmap v9295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17255.388204 secs 2024-04-21T15:12:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:24 smithi170 ceph-mon[31212]: pgmap v9295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17255.388204 secs 2024-04-21T15:12:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:24 smithi077 ceph-mon[27902]: pgmap v9295: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17255.388204 secs 2024-04-21T15:12:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:26 smithi170 ceph-mon[31212]: pgmap v9296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:26.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:26 smithi077 ceph-mon[27902]: pgmap v9296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:26.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:26 smithi191 ceph-mon[31636]: pgmap v9296: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17258.626841 secs 2024-04-21T15:12:27.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17258.626841 secs 2024-04-21T15:12:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17258.626841 secs 2024-04-21T15:12:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:28 smithi170 ceph-mon[31212]: pgmap v9297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:28 smithi077 ceph-mon[27902]: pgmap v9297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:28 smithi191 ceph-mon[31636]: pgmap v9297: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17260.388300 secs 2024-04-21T15:12:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17260.388300 secs 2024-04-21T15:12:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17260.388300 secs 2024-04-21T15:12:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:30 smithi170 ceph-mon[31212]: pgmap v9298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:30 smithi077 ceph-mon[27902]: pgmap v9298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:30 smithi191 ceph-mon[31636]: pgmap v9298: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:32 smithi170 ceph-mon[31212]: pgmap v9299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:32.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17263.626906 secs 2024-04-21T15:12:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:32 smithi077 ceph-mon[27902]: pgmap v9299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17263.626906 secs 2024-04-21T15:12:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:32 smithi191 ceph-mon[31636]: pgmap v9299: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17263.626906 secs 2024-04-21T15:12:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:34 smithi170 ceph-mon[31212]: pgmap v9300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17265.388411 secs 2024-04-21T15:12:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:34 smithi077 ceph-mon[27902]: pgmap v9300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17265.388411 secs 2024-04-21T15:12:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:34 smithi191 ceph-mon[31636]: pgmap v9300: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17265.388411 secs 2024-04-21T15:12:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:36 smithi170 ceph-mon[31212]: pgmap v9301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:36 smithi077 ceph-mon[27902]: pgmap v9301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:36 smithi191 ceph-mon[31636]: pgmap v9301: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17268.626970 secs 2024-04-21T15:12:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17268.626970 secs 2024-04-21T15:12:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17268.626970 secs 2024-04-21T15:12:38.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:38 smithi077 ceph-mon[27902]: pgmap v9302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:38 smithi170 ceph-mon[31212]: pgmap v9302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:38 smithi191 ceph-mon[31636]: pgmap v9302: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17270.388487 secs 2024-04-21T15:12:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17270.388487 secs 2024-04-21T15:12:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17270.388487 secs 2024-04-21T15:12:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:40 smithi170 ceph-mon[31212]: pgmap v9303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:40 smithi077 ceph-mon[27902]: pgmap v9303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:40 smithi191 ceph-mon[31636]: pgmap v9303: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:42 smithi170 ceph-mon[31212]: pgmap v9304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17273.627039 secs 2024-04-21T15:12:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:42 smithi077 ceph-mon[27902]: pgmap v9304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17273.627039 secs 2024-04-21T15:12:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:42 smithi191 ceph-mon[31636]: pgmap v9304: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17273.627039 secs 2024-04-21T15:12:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:44 smithi170 ceph-mon[31212]: pgmap v9305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17275.388624 secs 2024-04-21T15:12:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:12:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:44 smithi077 ceph-mon[27902]: pgmap v9305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17275.388624 secs 2024-04-21T15:12:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:12:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:44 smithi191 ceph-mon[31636]: pgmap v9305: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17275.388624 secs 2024-04-21T15:12:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:12:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:12:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:12:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:12:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:12:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:12:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:12:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:12:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:12:45.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:12:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:46 smithi170 ceph-mon[31212]: pgmap v9306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:46 smithi077 ceph-mon[27902]: pgmap v9306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:46 smithi191 ceph-mon[31636]: pgmap v9306: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17278.627116 secs 2024-04-21T15:12:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17278.627116 secs 2024-04-21T15:12:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17278.627116 secs 2024-04-21T15:12:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:48 smithi170 ceph-mon[31212]: pgmap v9307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:12:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:48 smithi077 ceph-mon[27902]: pgmap v9307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:12:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:48 smithi191 ceph-mon[31636]: pgmap v9307: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:12:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17280.388741 secs 2024-04-21T15:12:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17280.388741 secs 2024-04-21T15:12:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17280.388741 secs 2024-04-21T15:12:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:50 smithi170 ceph-mon[31212]: pgmap v9308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:50 smithi077 ceph-mon[27902]: pgmap v9308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:50 smithi191 ceph-mon[31636]: pgmap v9308: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:52 smithi170 ceph-mon[31212]: pgmap v9309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17283.627194 secs 2024-04-21T15:12:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:52 smithi077 ceph-mon[27902]: pgmap v9309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17283.627194 secs 2024-04-21T15:12:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:52 smithi191 ceph-mon[31636]: pgmap v9309: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:12:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17283.627194 secs 2024-04-21T15:12:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:54 smithi170 ceph-mon[31212]: pgmap v9310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17285.388880 secs 2024-04-21T15:12:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:54 smithi077 ceph-mon[27902]: pgmap v9310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17285.388880 secs 2024-04-21T15:12:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:54 smithi191 ceph-mon[31636]: pgmap v9310: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:12:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17285.388880 secs 2024-04-21T15:12:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:12:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:56 smithi170 ceph-mon[31212]: pgmap v9311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:56 smithi077 ceph-mon[27902]: pgmap v9311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:56 smithi191 ceph-mon[31636]: pgmap v9311: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:12:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17288.627309 secs 2024-04-21T15:12:57.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17288.627309 secs 2024-04-21T15:12:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17288.627309 secs 2024-04-21T15:12:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:58 smithi170 ceph-mon[31212]: pgmap v9312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:12:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:58 smithi077 ceph-mon[27902]: pgmap v9312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:12:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:58 smithi191 ceph-mon[31636]: pgmap v9312: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:12:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:12:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17290.388998 secs 2024-04-21T15:12:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:12:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17290.388998 secs 2024-04-21T15:12:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:12:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17290.388998 secs 2024-04-21T15:13:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:00 smithi170 ceph-mon[31212]: pgmap v9313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:00 smithi077 ceph-mon[27902]: pgmap v9313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:00 smithi191 ceph-mon[31636]: pgmap v9313: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:02 smithi077 ceph-mon[27902]: pgmap v9314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17293.627445 secs 2024-04-21T15:13:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:02 smithi191 ceph-mon[31636]: pgmap v9314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17293.627445 secs 2024-04-21T15:13:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:02 smithi170 ceph-mon[31212]: pgmap v9314: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17293.627445 secs 2024-04-21T15:13:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:04 smithi077 ceph-mon[27902]: pgmap v9315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17295.389075 secs 2024-04-21T15:13:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:04 smithi077 ceph-mon[27902]: osdmap e654: 12 total, 12 up, 12 in 2024-04-21T15:13:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:04 smithi191 ceph-mon[31636]: pgmap v9315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17295.389075 secs 2024-04-21T15:13:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:04 smithi191 ceph-mon[31636]: osdmap e654: 12 total, 12 up, 12 in 2024-04-21T15:13:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:04 smithi170 ceph-mon[31212]: pgmap v9315: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17295.389075 secs 2024-04-21T15:13:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:04 smithi170 ceph-mon[31212]: osdmap e654: 12 total, 12 up, 12 in 2024-04-21T15:13:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:06 smithi077 ceph-mon[27902]: pgmap v9317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:06 smithi191 ceph-mon[31636]: pgmap v9317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:06 smithi170 ceph-mon[31212]: pgmap v9317: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17298.627576 secs 2024-04-21T15:13:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17298.627576 secs 2024-04-21T15:13:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17298.627576 secs 2024-04-21T15:13:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:08 smithi077 ceph-mon[27902]: pgmap v9318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:08 smithi191 ceph-mon[31636]: pgmap v9318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:08 smithi170 ceph-mon[31212]: pgmap v9318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17300.389196 secs 2024-04-21T15:13:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17300.389196 secs 2024-04-21T15:13:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17300.389196 secs 2024-04-21T15:13:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:10 smithi077 ceph-mon[27902]: pgmap v9319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:10 smithi077 ceph-mon[27902]: osdmap e655: 12 total, 12 up, 12 in 2024-04-21T15:13:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:10 smithi191 ceph-mon[31636]: pgmap v9319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:10 smithi191 ceph-mon[31636]: osdmap e655: 12 total, 12 up, 12 in 2024-04-21T15:13:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:10 smithi170 ceph-mon[31212]: pgmap v9319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:13:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:10 smithi170 ceph-mon[31212]: osdmap e655: 12 total, 12 up, 12 in 2024-04-21T15:13:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:12 smithi077 ceph-mon[27902]: pgmap v9321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:13:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17303.627698 secs 2024-04-21T15:13:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:12 smithi191 ceph-mon[31636]: pgmap v9321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:13:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17303.627698 secs 2024-04-21T15:13:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:12 smithi170 ceph-mon[31212]: pgmap v9321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:13:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17303.627698 secs 2024-04-21T15:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:14 smithi077 ceph-mon[27902]: pgmap v9322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:13:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17305.389313 secs 2024-04-21T15:13:14.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:14 smithi191 ceph-mon[31636]: pgmap v9322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:13:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17305.389313 secs 2024-04-21T15:13:15.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:14 smithi170 ceph-mon[31212]: pgmap v9322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:13:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17305.389313 secs 2024-04-21T15:13:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:16 smithi077 ceph-mon[27902]: pgmap v9323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:13:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:16 smithi191 ceph-mon[31636]: pgmap v9323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:13:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:16 smithi170 ceph-mon[31212]: pgmap v9323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:13:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17308.627820 secs 2024-04-21T15:13:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17308.627820 secs 2024-04-21T15:13:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17308.627820 secs 2024-04-21T15:13:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:18 smithi077 ceph-mon[27902]: pgmap v9324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:13:18.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:18 smithi191 ceph-mon[31636]: pgmap v9324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:13:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:18 smithi170 ceph-mon[31212]: pgmap v9324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:13:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17310.389430 secs 2024-04-21T15:13:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17310.389430 secs 2024-04-21T15:13:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17310.389430 secs 2024-04-21T15:13:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:20 smithi077 ceph-mon[27902]: pgmap v9325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:13:20.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:20 smithi191 ceph-mon[31636]: pgmap v9325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:13:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:20 smithi170 ceph-mon[31212]: pgmap v9325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:13:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:22 smithi077 ceph-mon[27902]: pgmap v9326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:13:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17313.627929 secs 2024-04-21T15:13:22.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:22 smithi191 ceph-mon[31636]: pgmap v9326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:13:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17313.627929 secs 2024-04-21T15:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:22 smithi170 ceph-mon[31212]: pgmap v9326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:13:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17313.627929 secs 2024-04-21T15:13:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:24 smithi077 ceph-mon[27902]: pgmap v9327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17315.389530 secs 2024-04-21T15:13:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:24 smithi191 ceph-mon[31636]: pgmap v9327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17315.389530 secs 2024-04-21T15:13:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:24 smithi170 ceph-mon[31212]: pgmap v9327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17315.389530 secs 2024-04-21T15:13:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:26 smithi077 ceph-mon[27902]: pgmap v9328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:26 smithi191 ceph-mon[31636]: pgmap v9328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:26 smithi170 ceph-mon[31212]: pgmap v9328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17318.628076 secs 2024-04-21T15:13:27.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17318.628076 secs 2024-04-21T15:13:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17318.628076 secs 2024-04-21T15:13:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:28 smithi077 ceph-mon[27902]: pgmap v9329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:28 smithi191 ceph-mon[31636]: pgmap v9329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:28 smithi170 ceph-mon[31212]: pgmap v9329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17320.389650 secs 2024-04-21T15:13:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17320.389650 secs 2024-04-21T15:13:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17320.389650 secs 2024-04-21T15:13:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:30 smithi077 ceph-mon[27902]: pgmap v9330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:30 smithi191 ceph-mon[31636]: pgmap v9330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:30 smithi170 ceph-mon[31212]: pgmap v9330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:32 smithi077 ceph-mon[27902]: pgmap v9331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17323.628181 secs 2024-04-21T15:13:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:32 smithi191 ceph-mon[31636]: pgmap v9331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17323.628181 secs 2024-04-21T15:13:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:32 smithi170 ceph-mon[31212]: pgmap v9331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17323.628181 secs 2024-04-21T15:13:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:34 smithi191 ceph-mon[31636]: pgmap v9332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17325.389769 secs 2024-04-21T15:13:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:34 smithi170 ceph-mon[31212]: pgmap v9332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17325.389769 secs 2024-04-21T15:13:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:34 smithi077 ceph-mon[27902]: pgmap v9332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17325.389769 secs 2024-04-21T15:13:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:36 smithi191 ceph-mon[31636]: pgmap v9333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:36 smithi170 ceph-mon[31212]: pgmap v9333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:36 smithi077 ceph-mon[27902]: pgmap v9333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17328.628291 secs 2024-04-21T15:13:38.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17328.628291 secs 2024-04-21T15:13:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17328.628291 secs 2024-04-21T15:13:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:38 smithi191 ceph-mon[31636]: pgmap v9334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:38 smithi170 ceph-mon[31212]: pgmap v9334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:38 smithi077 ceph-mon[27902]: pgmap v9334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17330.389886 secs 2024-04-21T15:13:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17330.389886 secs 2024-04-21T15:13:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17330.389886 secs 2024-04-21T15:13:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:40 smithi191 ceph-mon[31636]: pgmap v9335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:40 smithi170 ceph-mon[31212]: pgmap v9335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:40 smithi077 ceph-mon[27902]: pgmap v9335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:42 smithi191 ceph-mon[31636]: pgmap v9336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17333.628365 secs 2024-04-21T15:13:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:42 smithi170 ceph-mon[31212]: pgmap v9336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17333.628365 secs 2024-04-21T15:13:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:42 smithi077 ceph-mon[27902]: pgmap v9336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17333.628365 secs 2024-04-21T15:13:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:44 smithi191 ceph-mon[31636]: pgmap v9337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17335.389999 secs 2024-04-21T15:13:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:44 smithi170 ceph-mon[31212]: pgmap v9337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17335.389999 secs 2024-04-21T15:13:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:44 smithi077 ceph-mon[27902]: pgmap v9337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17335.389999 secs 2024-04-21T15:13:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:13:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:13:46.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:13:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:46 smithi191 ceph-mon[31636]: pgmap v9338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:13:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:13:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:13:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:46 smithi170 ceph-mon[31212]: pgmap v9338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:13:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:13:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:13:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:46 smithi077 ceph-mon[27902]: pgmap v9338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:13:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:13:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:13:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17338.628501 secs 2024-04-21T15:13:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17338.628501 secs 2024-04-21T15:13:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17338.628501 secs 2024-04-21T15:13:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:48 smithi191 ceph-mon[31636]: pgmap v9339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:48 smithi170 ceph-mon[31212]: pgmap v9339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:48 smithi077 ceph-mon[27902]: pgmap v9339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17340.390076 secs 2024-04-21T15:13:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17340.390076 secs 2024-04-21T15:13:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17340.390076 secs 2024-04-21T15:13:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:50 smithi191 ceph-mon[31636]: pgmap v9340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:50 smithi170 ceph-mon[31212]: pgmap v9340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:50 smithi077 ceph-mon[27902]: pgmap v9340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:52 smithi191 ceph-mon[31636]: pgmap v9341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17343.628616 secs 2024-04-21T15:13:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:52 smithi170 ceph-mon[31212]: pgmap v9341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17343.628616 secs 2024-04-21T15:13:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:52 smithi077 ceph-mon[27902]: pgmap v9341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:13:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17343.628616 secs 2024-04-21T15:13:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.433+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T15:13:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.433+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T15:13:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.433+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:13:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.433+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T15:13:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.434+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:13:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.434+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T15:13:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.434+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T15:13:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7005c070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7005c070 comp rx=0 tx=0).stop 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.453+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.454+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.454+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:13:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:54.454+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7004c000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T15:13:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:54 smithi191 ceph-mon[31636]: pgmap v9342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17345.390191 secs 2024-04-21T15:13:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:54 smithi170 ceph-mon[31212]: pgmap v9342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17345.390191 secs 2024-04-21T15:13:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:13:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:54 smithi077 ceph-mon[27902]: pgmap v9342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:13:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17345.390191 secs 2024-04-21T15:13:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:56.752+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:13:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:56.752+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:13:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:56.752+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:13:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:13:56.752+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:13:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:56 smithi191 ceph-mon[31636]: pgmap v9343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:56 smithi170 ceph-mon[31212]: pgmap v9343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:56 smithi077 ceph-mon[27902]: pgmap v9343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:13:57.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17348.628733 secs 2024-04-21T15:13:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17348.628733 secs 2024-04-21T15:13:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17348.628733 secs 2024-04-21T15:13:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:58 smithi191 ceph-mon[31636]: pgmap v9344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:58 smithi170 ceph-mon[31212]: pgmap v9344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:58 smithi077 ceph-mon[27902]: pgmap v9344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:13:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17350.390288 secs 2024-04-21T15:14:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17350.390288 secs 2024-04-21T15:14:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17350.390288 secs 2024-04-21T15:14:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:00 smithi191 ceph-mon[31636]: pgmap v9345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:00 smithi170 ceph-mon[31212]: pgmap v9345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:00 smithi077 ceph-mon[27902]: pgmap v9345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:02 smithi191 ceph-mon[31636]: pgmap v9346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17353.628886 secs 2024-04-21T15:14:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:02 smithi170 ceph-mon[31212]: pgmap v9346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17353.628886 secs 2024-04-21T15:14:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:02 smithi077 ceph-mon[27902]: pgmap v9346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17353.628886 secs 2024-04-21T15:14:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:04 smithi191 ceph-mon[31636]: pgmap v9347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17355.390406 secs 2024-04-21T15:14:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:04 smithi191 ceph-mon[31636]: osdmap e656: 12 total, 12 up, 12 in 2024-04-21T15:14:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:04 smithi170 ceph-mon[31212]: pgmap v9347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17355.390406 secs 2024-04-21T15:14:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:04 smithi170 ceph-mon[31212]: osdmap e656: 12 total, 12 up, 12 in 2024-04-21T15:14:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:04 smithi077 ceph-mon[27902]: pgmap v9347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17355.390406 secs 2024-04-21T15:14:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:04 smithi077 ceph-mon[27902]: osdmap e656: 12 total, 12 up, 12 in 2024-04-21T15:14:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:06 smithi191 ceph-mon[31636]: pgmap v9349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:14:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:06 smithi170 ceph-mon[31212]: pgmap v9349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:14:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:06 smithi077 ceph-mon[27902]: pgmap v9349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:14:08.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17358.628936 secs 2024-04-21T15:14:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17358.628936 secs 2024-04-21T15:14:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17358.628936 secs 2024-04-21T15:14:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:08 smithi170 ceph-mon[31212]: pgmap v9350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:14:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:08 smithi077 ceph-mon[27902]: pgmap v9350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:14:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:08 smithi191 ceph-mon[31636]: pgmap v9350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:14:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17360.390520 secs 2024-04-21T15:14:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17360.390520 secs 2024-04-21T15:14:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17360.390520 secs 2024-04-21T15:14:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:10 smithi170 ceph-mon[31212]: pgmap v9351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:14:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:10 smithi170 ceph-mon[31212]: osdmap e657: 12 total, 12 up, 12 in 2024-04-21T15:14:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:10 smithi077 ceph-mon[27902]: pgmap v9351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:14:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:10 smithi077 ceph-mon[27902]: osdmap e657: 12 total, 12 up, 12 in 2024-04-21T15:14:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:10 smithi191 ceph-mon[31636]: pgmap v9351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:14:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:10 smithi191 ceph-mon[31636]: osdmap e657: 12 total, 12 up, 12 in 2024-04-21T15:14:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:12 smithi170 ceph-mon[31212]: pgmap v9353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:14:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17363.629054 secs 2024-04-21T15:14:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:12 smithi077 ceph-mon[27902]: pgmap v9353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:14:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17363.629054 secs 2024-04-21T15:14:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:12 smithi191 ceph-mon[31636]: pgmap v9353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:14:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17363.629054 secs 2024-04-21T15:14:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:14 smithi170 ceph-mon[31212]: pgmap v9354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:14:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17365.390641 secs 2024-04-21T15:14:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:14 smithi077 ceph-mon[27902]: pgmap v9354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:14:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17365.390641 secs 2024-04-21T15:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:14 smithi191 ceph-mon[31636]: pgmap v9354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17365.390641 secs 2024-04-21T15:14:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:16 smithi170 ceph-mon[31212]: pgmap v9355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:14:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:16 smithi077 ceph-mon[27902]: pgmap v9355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:14:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:16 smithi191 ceph-mon[31636]: pgmap v9355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:14:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17368.629151 secs 2024-04-21T15:14:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17368.629151 secs 2024-04-21T15:14:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17368.629151 secs 2024-04-21T15:14:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:18 smithi170 ceph-mon[31212]: pgmap v9356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:14:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:18 smithi077 ceph-mon[27902]: pgmap v9356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:14:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:18 smithi191 ceph-mon[31636]: pgmap v9356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:14:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17370.390758 secs 2024-04-21T15:14:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:19 smithi170 ceph-mon[31212]: pgmap v9357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:14:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17370.390758 secs 2024-04-21T15:14:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:19 smithi077 ceph-mon[27902]: pgmap v9357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:14:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17370.390758 secs 2024-04-21T15:14:20.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:19 smithi191 ceph-mon[31636]: pgmap v9357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:14:22.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:22 smithi170 ceph-mon[31212]: pgmap v9358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:14:22.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17373.629253 secs 2024-04-21T15:14:22.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:22 smithi077 ceph-mon[27902]: pgmap v9358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:14:22.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17373.629253 secs 2024-04-21T15:14:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:22 smithi191 ceph-mon[31636]: pgmap v9358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:14:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17373.629253 secs 2024-04-21T15:14:24.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:24 smithi170 ceph-mon[31212]: pgmap v9359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:24.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17375.390898 secs 2024-04-21T15:14:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:24 smithi077 ceph-mon[27902]: pgmap v9359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17375.390898 secs 2024-04-21T15:14:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:24 smithi191 ceph-mon[31636]: pgmap v9359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17375.390898 secs 2024-04-21T15:14:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:26 smithi170 ceph-mon[31212]: pgmap v9360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:26 smithi077 ceph-mon[27902]: pgmap v9360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:26 smithi191 ceph-mon[31636]: pgmap v9360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:27.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17378.629404 secs 2024-04-21T15:14:27.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17378.629404 secs 2024-04-21T15:14:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17378.629404 secs 2024-04-21T15:14:28.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:28 smithi170 ceph-mon[31212]: pgmap v9361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:28.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:28 smithi077 ceph-mon[27902]: pgmap v9361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:28 smithi191 ceph-mon[31636]: pgmap v9361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17380.391017 secs 2024-04-21T15:14:29.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17380.391017 secs 2024-04-21T15:14:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17380.391017 secs 2024-04-21T15:14:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:30.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:30 smithi170 ceph-mon[31212]: pgmap v9362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:30 smithi077 ceph-mon[27902]: pgmap v9362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:30 smithi191 ceph-mon[31636]: pgmap v9362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:32 smithi170 ceph-mon[31212]: pgmap v9363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17383.629540 secs 2024-04-21T15:14:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:32 smithi077 ceph-mon[27902]: pgmap v9363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17383.629540 secs 2024-04-21T15:14:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:32 smithi191 ceph-mon[31636]: pgmap v9363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17383.629540 secs 2024-04-21T15:14:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:34 smithi170 ceph-mon[31212]: pgmap v9364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17385.391117 secs 2024-04-21T15:14:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:34 smithi077 ceph-mon[27902]: pgmap v9364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17385.391117 secs 2024-04-21T15:14:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:34 smithi191 ceph-mon[31636]: pgmap v9364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17385.391117 secs 2024-04-21T15:14:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:36.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:36 smithi170 ceph-mon[31212]: pgmap v9365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:36.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:36 smithi077 ceph-mon[27902]: pgmap v9365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:36 smithi191 ceph-mon[31636]: pgmap v9365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:37.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17388.629652 secs 2024-04-21T15:14:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17388.629652 secs 2024-04-21T15:14:37.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17388.629652 secs 2024-04-21T15:14:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:38 smithi170 ceph-mon[31212]: pgmap v9366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:38.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:38 smithi077 ceph-mon[27902]: pgmap v9366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:38 smithi191 ceph-mon[31636]: pgmap v9366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:39.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17390.391237 secs 2024-04-21T15:14:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17390.391237 secs 2024-04-21T15:14:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17390.391237 secs 2024-04-21T15:14:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:40 smithi170 ceph-mon[31212]: pgmap v9367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:40 smithi077 ceph-mon[27902]: pgmap v9367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:40 smithi191 ceph-mon[31636]: pgmap v9367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:42 smithi170 ceph-mon[31212]: pgmap v9368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17393.629749 secs 2024-04-21T15:14:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:42 smithi077 ceph-mon[27902]: pgmap v9368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17393.629749 secs 2024-04-21T15:14:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:42 smithi191 ceph-mon[31636]: pgmap v9368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17393.629749 secs 2024-04-21T15:14:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:44 smithi170 ceph-mon[31212]: pgmap v9369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17395.391373 secs 2024-04-21T15:14:44.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:44 smithi077 ceph-mon[27902]: pgmap v9369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17395.391373 secs 2024-04-21T15:14:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:44 smithi191 ceph-mon[31636]: pgmap v9369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17395.391373 secs 2024-04-21T15:14:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:46 smithi170 ceph-mon[31212]: pgmap v9370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:14:46.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:46 smithi077 ceph-mon[27902]: pgmap v9370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:14:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:46 smithi191 ceph-mon[31636]: pgmap v9370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:14:47.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:14:47.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:14:47.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:14:47.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17398.629808 secs 2024-04-21T15:14:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:14:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:14:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:14:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17398.629808 secs 2024-04-21T15:14:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:14:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:14:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:14:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17398.629808 secs 2024-04-21T15:14:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:48 smithi170 ceph-mon[31212]: pgmap v9371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:48 smithi077 ceph-mon[27902]: pgmap v9371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:48 smithi191 ceph-mon[31636]: pgmap v9371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:49.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17400.391434 secs 2024-04-21T15:14:49.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17400.391434 secs 2024-04-21T15:14:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17400.391434 secs 2024-04-21T15:14:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:50 smithi170 ceph-mon[31212]: pgmap v9372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:50 smithi077 ceph-mon[27902]: pgmap v9372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:50 smithi191 ceph-mon[31636]: pgmap v9372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:52 smithi170 ceph-mon[31212]: pgmap v9373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17403.629926 secs 2024-04-21T15:14:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:52 smithi077 ceph-mon[27902]: pgmap v9373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17403.629926 secs 2024-04-21T15:14:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:52 smithi191 ceph-mon[31636]: pgmap v9373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:14:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17403.629926 secs 2024-04-21T15:14:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:54 smithi170 ceph-mon[31212]: pgmap v9374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17405.391553 secs 2024-04-21T15:14:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:54 smithi077 ceph-mon[27902]: pgmap v9374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17405.391553 secs 2024-04-21T15:14:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:54 smithi191 ceph-mon[31636]: pgmap v9374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:14:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17405.391553 secs 2024-04-21T15:14:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:14:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:56 smithi170 ceph-mon[31212]: pgmap v9375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:56 smithi077 ceph-mon[27902]: pgmap v9375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:56 smithi191 ceph-mon[31636]: pgmap v9375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:14:57.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17408.630041 secs 2024-04-21T15:14:57.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17408.630041 secs 2024-04-21T15:14:57.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17408.630041 secs 2024-04-21T15:14:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:58 smithi170 ceph-mon[31212]: pgmap v9376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:58 smithi077 ceph-mon[27902]: pgmap v9376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:58 smithi191 ceph-mon[31636]: pgmap v9376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:14:59.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17410.391695 secs 2024-04-21T15:14:59.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17410.391695 secs 2024-04-21T15:14:59.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17410.391695 secs 2024-04-21T15:15:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:00 smithi170 ceph-mon[31212]: pgmap v9377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:00 smithi077 ceph-mon[27902]: pgmap v9377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:00 smithi191 ceph-mon[31636]: pgmap v9377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:02 smithi170 ceph-mon[31212]: pgmap v9378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17413.630178 secs 2024-04-21T15:15:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:02 smithi077 ceph-mon[27902]: pgmap v9378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17413.630178 secs 2024-04-21T15:15:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:02 smithi191 ceph-mon[31636]: pgmap v9378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17413.630178 secs 2024-04-21T15:15:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:04 smithi170 ceph-mon[31212]: pgmap v9379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17415.391786 secs 2024-04-21T15:15:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:04 smithi077 ceph-mon[27902]: pgmap v9379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17415.391786 secs 2024-04-21T15:15:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:04 smithi191 ceph-mon[31636]: pgmap v9379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17415.391786 secs 2024-04-21T15:15:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:05 smithi170 ceph-mon[31212]: osdmap e658: 12 total, 12 up, 12 in 2024-04-21T15:15:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:05 smithi077 ceph-mon[27902]: osdmap e658: 12 total, 12 up, 12 in 2024-04-21T15:15:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:05 smithi191 ceph-mon[31636]: osdmap e658: 12 total, 12 up, 12 in 2024-04-21T15:15:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:06 smithi170 ceph-mon[31212]: pgmap v9381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:06 smithi077 ceph-mon[27902]: pgmap v9381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:06 smithi191 ceph-mon[31636]: pgmap v9381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:07.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17418.630283 secs 2024-04-21T15:15:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17418.630283 secs 2024-04-21T15:15:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17418.630283 secs 2024-04-21T15:15:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:08 smithi170 ceph-mon[31212]: pgmap v9382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:08 smithi077 ceph-mon[27902]: pgmap v9382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:08 smithi191 ceph-mon[31636]: pgmap v9382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:09.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17420.391914 secs 2024-04-21T15:15:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17420.391914 secs 2024-04-21T15:15:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17420.391914 secs 2024-04-21T15:15:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:10 smithi170 ceph-mon[31212]: pgmap v9383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:10 smithi170 ceph-mon[31212]: osdmap e659: 12 total, 12 up, 12 in 2024-04-21T15:15:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:10 smithi077 ceph-mon[27902]: pgmap v9383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:10 smithi077 ceph-mon[27902]: osdmap e659: 12 total, 12 up, 12 in 2024-04-21T15:15:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:10 smithi191 ceph-mon[31636]: pgmap v9383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:15:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:10 smithi191 ceph-mon[31636]: osdmap e659: 12 total, 12 up, 12 in 2024-04-21T15:15:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:12 smithi170 ceph-mon[31212]: pgmap v9385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:15:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17423.630349 secs 2024-04-21T15:15:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:12 smithi077 ceph-mon[27902]: pgmap v9385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:15:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17423.630349 secs 2024-04-21T15:15:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:12 smithi191 ceph-mon[31636]: pgmap v9385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:15:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17423.630349 secs 2024-04-21T15:15:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:14 smithi077 ceph-mon[27902]: pgmap v9386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T15:15:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17425.392024 secs 2024-04-21T15:15:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:14 smithi191 ceph-mon[31636]: pgmap v9386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T15:15:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17425.392024 secs 2024-04-21T15:15:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:14 smithi170 ceph-mon[31212]: pgmap v9386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T15:15:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17425.392024 secs 2024-04-21T15:15:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:16 smithi077 ceph-mon[27902]: pgmap v9387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:15:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:16 smithi191 ceph-mon[31636]: pgmap v9387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:15:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:16 smithi170 ceph-mon[31212]: pgmap v9387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:15:17.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17428.630486 secs 2024-04-21T15:15:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17428.630486 secs 2024-04-21T15:15:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17428.630486 secs 2024-04-21T15:15:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:18 smithi077 ceph-mon[27902]: pgmap v9388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:15:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:18 smithi191 ceph-mon[31636]: pgmap v9388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:15:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:18 smithi170 ceph-mon[31212]: pgmap v9388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:15:19.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17430.392139 secs 2024-04-21T15:15:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17430.392139 secs 2024-04-21T15:15:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17430.392139 secs 2024-04-21T15:15:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:20 smithi077 ceph-mon[27902]: pgmap v9389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:15:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:20 smithi191 ceph-mon[31636]: pgmap v9389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:15:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:20 smithi170 ceph-mon[31212]: pgmap v9389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:15:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:22 smithi077 ceph-mon[27902]: pgmap v9390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:15:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17433.630623 secs 2024-04-21T15:15:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:22 smithi191 ceph-mon[31636]: pgmap v9390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:15:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17433.630623 secs 2024-04-21T15:15:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:22 smithi170 ceph-mon[31212]: pgmap v9390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:15:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17433.630623 secs 2024-04-21T15:15:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:24 smithi077 ceph-mon[27902]: pgmap v9391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17435.392231 secs 2024-04-21T15:15:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:24 smithi191 ceph-mon[31636]: pgmap v9391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17435.392231 secs 2024-04-21T15:15:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:24 smithi170 ceph-mon[31212]: pgmap v9391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17435.392231 secs 2024-04-21T15:15:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:26 smithi077 ceph-mon[27902]: pgmap v9392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:26 smithi191 ceph-mon[31636]: pgmap v9392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:26 smithi170 ceph-mon[31212]: pgmap v9392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:27.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17438.630787 secs 2024-04-21T15:15:27.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17438.630787 secs 2024-04-21T15:15:27.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17438.630787 secs 2024-04-21T15:15:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:28 smithi077 ceph-mon[27902]: pgmap v9393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:28 smithi191 ceph-mon[31636]: pgmap v9393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:29.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:28 smithi170 ceph-mon[31212]: pgmap v9393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17440.392347 secs 2024-04-21T15:15:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17440.392347 secs 2024-04-21T15:15:30.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17440.392347 secs 2024-04-21T15:15:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:30 smithi077 ceph-mon[27902]: pgmap v9394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:30 smithi191 ceph-mon[31636]: pgmap v9394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:30 smithi170 ceph-mon[31212]: pgmap v9394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:32 smithi077 ceph-mon[27902]: pgmap v9395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17443.630885 secs 2024-04-21T15:15:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:32 smithi191 ceph-mon[31636]: pgmap v9395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17443.630885 secs 2024-04-21T15:15:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:32 smithi170 ceph-mon[31212]: pgmap v9395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17443.630885 secs 2024-04-21T15:15:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:34 smithi077 ceph-mon[27902]: pgmap v9396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17445.392480 secs 2024-04-21T15:15:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:34 smithi191 ceph-mon[31636]: pgmap v9396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:34.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17445.392480 secs 2024-04-21T15:15:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:34 smithi170 ceph-mon[31212]: pgmap v9396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17445.392480 secs 2024-04-21T15:15:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:36 smithi077 ceph-mon[27902]: pgmap v9397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:36.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:36 smithi191 ceph-mon[31636]: pgmap v9397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:37.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:36 smithi170 ceph-mon[31212]: pgmap v9397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:37.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17448.631008 secs 2024-04-21T15:15:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17448.631008 secs 2024-04-21T15:15:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17448.631008 secs 2024-04-21T15:15:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:38 smithi077 ceph-mon[27902]: pgmap v9398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:38 smithi191 ceph-mon[31636]: pgmap v9398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:38 smithi170 ceph-mon[31212]: pgmap v9398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:39.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17450.392614 secs 2024-04-21T15:15:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17450.392614 secs 2024-04-21T15:15:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17450.392614 secs 2024-04-21T15:15:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:40 smithi077 ceph-mon[27902]: pgmap v9399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:40 smithi191 ceph-mon[31636]: pgmap v9399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:40 smithi170 ceph-mon[31212]: pgmap v9399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:42 smithi077 ceph-mon[27902]: pgmap v9400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:42.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17453.631126 secs 2024-04-21T15:15:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:42 smithi191 ceph-mon[31636]: pgmap v9400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17453.631126 secs 2024-04-21T15:15:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:42 smithi170 ceph-mon[31212]: pgmap v9400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17453.631126 secs 2024-04-21T15:15:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:44 smithi077 ceph-mon[27902]: pgmap v9401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:44.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17455.392732 secs 2024-04-21T15:15:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:44 smithi191 ceph-mon[31636]: pgmap v9401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:44.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17455.392732 secs 2024-04-21T15:15:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:44 smithi170 ceph-mon[31212]: pgmap v9401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17455.392732 secs 2024-04-21T15:15:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:46.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:46 smithi191 ceph-mon[31636]: pgmap v9402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:46.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:15:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:46 smithi170 ceph-mon[31212]: pgmap v9402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:15:47.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:46 smithi077 ceph-mon[27902]: pgmap v9402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:47.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:15:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17458.631218 secs 2024-04-21T15:15:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:15:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:15:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:15:48.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17458.631218 secs 2024-04-21T15:15:48.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:15:48.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:15:48.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:15:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17458.631218 secs 2024-04-21T15:15:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:15:48.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:15:48.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:15:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:48 smithi191 ceph-mon[31636]: pgmap v9403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:48 smithi170 ceph-mon[31212]: pgmap v9403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:48 smithi077 ceph-mon[27902]: pgmap v9403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17460.392870 secs 2024-04-21T15:15:50.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17460.392870 secs 2024-04-21T15:15:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17460.392870 secs 2024-04-21T15:15:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:50 smithi191 ceph-mon[31636]: pgmap v9404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:50 smithi170 ceph-mon[31212]: pgmap v9404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:50 smithi077 ceph-mon[27902]: pgmap v9404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:52.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:52 smithi191 ceph-mon[31636]: pgmap v9405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:52.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17463.631332 secs 2024-04-21T15:15:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:52 smithi170 ceph-mon[31212]: pgmap v9405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17463.631332 secs 2024-04-21T15:15:53.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:52 smithi077 ceph-mon[27902]: pgmap v9405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:15:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17463.631332 secs 2024-04-21T15:15:54.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:54 smithi191 ceph-mon[31636]: pgmap v9406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:54.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17465.392959 secs 2024-04-21T15:15:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:54 smithi170 ceph-mon[31212]: pgmap v9406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17465.392959 secs 2024-04-21T15:15:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:15:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:54 smithi077 ceph-mon[27902]: pgmap v9406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:15:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17465.392959 secs 2024-04-21T15:15:56.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:56 smithi191 ceph-mon[31636]: pgmap v9407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:56 smithi170 ceph-mon[31212]: pgmap v9407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:57.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:56 smithi077 ceph-mon[27902]: pgmap v9407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:15:57.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17468.631462 secs 2024-04-21T15:15:57.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17468.631462 secs 2024-04-21T15:15:58.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17468.631462 secs 2024-04-21T15:15:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:58 smithi191 ceph-mon[31636]: pgmap v9408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:58 smithi170 ceph-mon[31212]: pgmap v9408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:58 smithi077 ceph-mon[27902]: pgmap v9408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:15:59.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17470.393075 secs 2024-04-21T15:16:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17470.393075 secs 2024-04-21T15:16:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17470.393075 secs 2024-04-21T15:16:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:00 smithi191 ceph-mon[31636]: pgmap v9409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:00 smithi170 ceph-mon[31212]: pgmap v9409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:00 smithi077 ceph-mon[27902]: pgmap v9409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:02.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:02 smithi191 ceph-mon[31636]: pgmap v9410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:02.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17473.631581 secs 2024-04-21T15:16:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:02 smithi170 ceph-mon[31212]: pgmap v9410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17473.631581 secs 2024-04-21T15:16:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:02 smithi077 ceph-mon[27902]: pgmap v9410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17473.631581 secs 2024-04-21T15:16:04.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:04 smithi191 ceph-mon[31636]: pgmap v9411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:04.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17475.393176 secs 2024-04-21T15:16:04.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:04 smithi191 ceph-mon[31636]: osdmap e660: 12 total, 12 up, 12 in 2024-04-21T15:16:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:04 smithi170 ceph-mon[31212]: pgmap v9411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17475.393176 secs 2024-04-21T15:16:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:04 smithi170 ceph-mon[31212]: osdmap e660: 12 total, 12 up, 12 in 2024-04-21T15:16:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:04 smithi077 ceph-mon[27902]: pgmap v9411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17475.393176 secs 2024-04-21T15:16:05.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:04 smithi077 ceph-mon[27902]: osdmap e660: 12 total, 12 up, 12 in 2024-04-21T15:16:06.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:06 smithi191 ceph-mon[31636]: pgmap v9413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:06 smithi170 ceph-mon[31212]: pgmap v9413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:07.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:06 smithi077 ceph-mon[27902]: pgmap v9413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:07.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17478.631723 secs 2024-04-21T15:16:08.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17478.631723 secs 2024-04-21T15:16:08.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17478.631723 secs 2024-04-21T15:16:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:08 smithi191 ceph-mon[31636]: pgmap v9414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:08 smithi170 ceph-mon[31212]: pgmap v9414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:08 smithi077 ceph-mon[27902]: pgmap v9414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17480.393294 secs 2024-04-21T15:16:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17480.393294 secs 2024-04-21T15:16:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17480.393294 secs 2024-04-21T15:16:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:10 smithi191 ceph-mon[31636]: pgmap v9415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:10 smithi191 ceph-mon[31636]: osdmap e661: 12 total, 12 up, 12 in 2024-04-21T15:16:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:10 smithi170 ceph-mon[31212]: pgmap v9415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:10 smithi170 ceph-mon[31212]: osdmap e661: 12 total, 12 up, 12 in 2024-04-21T15:16:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:10 smithi077 ceph-mon[27902]: pgmap v9415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:16:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:10 smithi077 ceph-mon[27902]: osdmap e661: 12 total, 12 up, 12 in 2024-04-21T15:16:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:12 smithi191 ceph-mon[31636]: pgmap v9417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:16:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17483.631830 secs 2024-04-21T15:16:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:12 smithi170 ceph-mon[31212]: pgmap v9417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:16:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17483.631830 secs 2024-04-21T15:16:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:12 smithi077 ceph-mon[27902]: pgmap v9417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:16:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17483.631830 secs 2024-04-21T15:16:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:14 smithi191 ceph-mon[31636]: pgmap v9418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:16:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17485.393415 secs 2024-04-21T15:16:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:14 smithi170 ceph-mon[31212]: pgmap v9418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:16:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17485.393415 secs 2024-04-21T15:16:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:14 smithi077 ceph-mon[27902]: pgmap v9418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:16:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17485.393415 secs 2024-04-21T15:16:16.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:16 smithi191 ceph-mon[31636]: pgmap v9419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:16:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:16 smithi170 ceph-mon[31212]: pgmap v9419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:16:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:16 smithi077 ceph-mon[27902]: pgmap v9419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:16:18.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17488.631952 secs 2024-04-21T15:16:18.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17488.631952 secs 2024-04-21T15:16:18.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17488.631952 secs 2024-04-21T15:16:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:18 smithi170 ceph-mon[31212]: pgmap v9420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:16:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:18 smithi077 ceph-mon[27902]: pgmap v9420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:16:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:18 smithi191 ceph-mon[31636]: pgmap v9420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:16:20.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17490.393532 secs 2024-04-21T15:16:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:20.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17490.393532 secs 2024-04-21T15:16:20.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17490.393532 secs 2024-04-21T15:16:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:20 smithi170 ceph-mon[31212]: pgmap v9421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:16:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:20 smithi077 ceph-mon[27902]: pgmap v9421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:16:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:20 smithi191 ceph-mon[31636]: pgmap v9421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:16:23.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:22 smithi170 ceph-mon[31212]: pgmap v9422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:16:23.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17493.632033 secs 2024-04-21T15:16:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:22 smithi077 ceph-mon[27902]: pgmap v9422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:16:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17493.632033 secs 2024-04-21T15:16:23.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:22 smithi191 ceph-mon[31636]: pgmap v9422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:16:23.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17493.632033 secs 2024-04-21T15:16:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:24 smithi170 ceph-mon[31212]: pgmap v9423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17495.393644 secs 2024-04-21T15:16:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:24 smithi077 ceph-mon[27902]: pgmap v9423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17495.393644 secs 2024-04-21T15:16:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:24 smithi191 ceph-mon[31636]: pgmap v9423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17495.393644 secs 2024-04-21T15:16:27.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:26 smithi191 ceph-mon[31636]: pgmap v9424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:26 smithi170 ceph-mon[31212]: pgmap v9424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:26 smithi077 ceph-mon[27902]: pgmap v9424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:28.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17498.632178 secs 2024-04-21T15:16:28.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17498.632178 secs 2024-04-21T15:16:28.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17498.632178 secs 2024-04-21T15:16:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:28 smithi170 ceph-mon[31212]: pgmap v9425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:28 smithi077 ceph-mon[27902]: pgmap v9425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:28 smithi191 ceph-mon[31636]: pgmap v9425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:30.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17500.393770 secs 2024-04-21T15:16:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:30.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17500.393770 secs 2024-04-21T15:16:30.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17500.393770 secs 2024-04-21T15:16:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:30 smithi170 ceph-mon[31212]: pgmap v9426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:30 smithi077 ceph-mon[27902]: pgmap v9426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:30 smithi191 ceph-mon[31636]: pgmap v9426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:32 smithi170 ceph-mon[31212]: pgmap v9427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:33.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17503.632260 secs 2024-04-21T15:16:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:32 smithi077 ceph-mon[27902]: pgmap v9427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17503.632260 secs 2024-04-21T15:16:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:32 smithi191 ceph-mon[31636]: pgmap v9427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17503.632260 secs 2024-04-21T15:16:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:34 smithi170 ceph-mon[31212]: pgmap v9428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:35.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17505.393950 secs 2024-04-21T15:16:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:34 smithi077 ceph-mon[27902]: pgmap v9428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17505.393950 secs 2024-04-21T15:16:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:34 smithi191 ceph-mon[31636]: pgmap v9428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17505.393950 secs 2024-04-21T15:16:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:36 smithi170 ceph-mon[31212]: pgmap v9429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:36 smithi077 ceph-mon[27902]: pgmap v9429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:36 smithi191 ceph-mon[31636]: pgmap v9429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:38.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17508.632326 secs 2024-04-21T15:16:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17508.632326 secs 2024-04-21T15:16:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17508.632326 secs 2024-04-21T15:16:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:38 smithi170 ceph-mon[31212]: pgmap v9430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:38 smithi077 ceph-mon[27902]: pgmap v9430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:38 smithi191 ceph-mon[31636]: pgmap v9430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17510.394107 secs 2024-04-21T15:16:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:40.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17510.394107 secs 2024-04-21T15:16:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17510.394107 secs 2024-04-21T15:16:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:40 smithi170 ceph-mon[31212]: pgmap v9431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:40 smithi077 ceph-mon[27902]: pgmap v9431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:40 smithi191 ceph-mon[31636]: pgmap v9431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:42.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:41 smithi170 ceph-mon[31212]: pgmap v9432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:42.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:41 smithi077 ceph-mon[27902]: pgmap v9432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:42.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:41 smithi191 ceph-mon[31636]: pgmap v9432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:43.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17513.632433 secs 2024-04-21T15:16:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17513.632433 secs 2024-04-21T15:16:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17513.632433 secs 2024-04-21T15:16:44.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:43 smithi170 ceph-mon[31212]: pgmap v9433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:44.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17515.394219 secs 2024-04-21T15:16:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:43 smithi077 ceph-mon[27902]: pgmap v9433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17515.394219 secs 2024-04-21T15:16:44.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:43 smithi191 ceph-mon[31636]: pgmap v9433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:44.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17515.394219 secs 2024-04-21T15:16:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:46.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:46 smithi170 ceph-mon[31212]: pgmap v9434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:46 smithi077 ceph-mon[27902]: pgmap v9434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:46.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:46 smithi191 ceph-mon[31636]: pgmap v9434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:47.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17518.632542 secs 2024-04-21T15:16:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17518.632542 secs 2024-04-21T15:16:47.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17518.632542 secs 2024-04-21T15:16:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:48 smithi170 ceph-mon[31212]: pgmap v9435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:16:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:16:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:16:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:16:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:48 smithi077 ceph-mon[27902]: pgmap v9435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:16:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:16:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:16:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:16:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:48 smithi191 ceph-mon[31636]: pgmap v9435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:16:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:16:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:16:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:16:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17520.394365 secs 2024-04-21T15:16:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17520.394365 secs 2024-04-21T15:16:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17520.394365 secs 2024-04-21T15:16:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:50.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:50 smithi170 ceph-mon[31212]: pgmap v9436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:50 smithi077 ceph-mon[27902]: pgmap v9436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:50 smithi191 ceph-mon[31636]: pgmap v9436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:52.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:52 smithi077 ceph-mon[27902]: pgmap v9437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:52.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17523.632673 secs 2024-04-21T15:16:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:52 smithi191 ceph-mon[31636]: pgmap v9437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:52.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17523.632673 secs 2024-04-21T15:16:52.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:52 smithi170 ceph-mon[31212]: pgmap v9437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:16:52.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17523.632673 secs 2024-04-21T15:16:54.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:54 smithi077 ceph-mon[27902]: pgmap v9438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:54.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17525.394473 secs 2024-04-21T15:16:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:54 smithi191 ceph-mon[31636]: pgmap v9438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:54.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17525.394473 secs 2024-04-21T15:16:54.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:54 smithi170 ceph-mon[31212]: pgmap v9438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:16:54.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17525.394473 secs 2024-04-21T15:16:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:16:56.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:56 smithi077 ceph-mon[27902]: pgmap v9439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:56.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:56 smithi191 ceph-mon[31636]: pgmap v9439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:16:56.777+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:16:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:16:56.777+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:16:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:16:56.777+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:16:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:16:56.777+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:16:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:56 smithi170 ceph-mon[31212]: pgmap v9439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:16:57.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17528.632794 secs 2024-04-21T15:16:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17528.632794 secs 2024-04-21T15:16:57.711 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17528.632794 secs 2024-04-21T15:16:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:58 smithi077 ceph-mon[27902]: pgmap v9440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:58 smithi191 ceph-mon[31636]: pgmap v9440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:58.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:58 smithi170 ceph-mon[31212]: pgmap v9440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:16:59.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17530.394600 secs 2024-04-21T15:16:59.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17530.394600 secs 2024-04-21T15:16:59.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17530.394600 secs 2024-04-21T15:17:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:00 smithi077 ceph-mon[27902]: pgmap v9441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:00 smithi191 ceph-mon[31636]: pgmap v9441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:00.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:00 smithi170 ceph-mon[31212]: pgmap v9441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:02 smithi077 ceph-mon[27902]: pgmap v9442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T15:17:02.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17533.632906 secs 2024-04-21T15:17:02.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:02 smithi191 ceph-mon[31636]: pgmap v9442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T15:17:02.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17533.632906 secs 2024-04-21T15:17:02.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:02 smithi170 ceph-mon[31212]: pgmap v9442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T15:17:02.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17533.632906 secs 2024-04-21T15:17:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:04 smithi077 ceph-mon[27902]: pgmap v9443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T15:17:04.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17535.394713 secs 2024-04-21T15:17:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:04 smithi191 ceph-mon[31636]: pgmap v9443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T15:17:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17535.394713 secs 2024-04-21T15:17:04.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:04 smithi170 ceph-mon[31212]: pgmap v9443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T15:17:04.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17535.394713 secs 2024-04-21T15:17:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:05 smithi077 ceph-mon[27902]: osdmap e662: 12 total, 12 up, 12 in 2024-04-21T15:17:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:05 smithi191 ceph-mon[31636]: osdmap e662: 12 total, 12 up, 12 in 2024-04-21T15:17:05.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:05 smithi170 ceph-mon[31212]: osdmap e662: 12 total, 12 up, 12 in 2024-04-21T15:17:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:06 smithi077 ceph-mon[27902]: pgmap v9445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:06 smithi191 ceph-mon[31636]: pgmap v9445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:06.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:06 smithi170 ceph-mon[31212]: pgmap v9445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17538.632992 secs 2024-04-21T15:17:07.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17538.632992 secs 2024-04-21T15:17:07.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17538.632992 secs 2024-04-21T15:17:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:08 smithi077 ceph-mon[27902]: pgmap v9446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:08 smithi191 ceph-mon[31636]: pgmap v9446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:08.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:08 smithi170 ceph-mon[31212]: pgmap v9446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17540.394887 secs 2024-04-21T15:17:09.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17540.394887 secs 2024-04-21T15:17:09.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17540.394887 secs 2024-04-21T15:17:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:10 smithi077 ceph-mon[27902]: pgmap v9447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:10.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:10 smithi077 ceph-mon[27902]: osdmap e663: 12 total, 12 up, 12 in 2024-04-21T15:17:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:10 smithi191 ceph-mon[31636]: pgmap v9447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:10 smithi191 ceph-mon[31636]: osdmap e663: 12 total, 12 up, 12 in 2024-04-21T15:17:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:10 smithi170 ceph-mon[31212]: pgmap v9447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:17:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:10 smithi170 ceph-mon[31212]: osdmap e663: 12 total, 12 up, 12 in 2024-04-21T15:17:12.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:12 smithi077 ceph-mon[27902]: pgmap v9449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T15:17:12.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17543.633109 secs 2024-04-21T15:17:12.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:12 smithi191 ceph-mon[31636]: pgmap v9449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T15:17:12.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17543.633109 secs 2024-04-21T15:17:12.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:12 smithi170 ceph-mon[31212]: pgmap v9449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T15:17:12.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17543.633109 secs 2024-04-21T15:17:14.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:14 smithi077 ceph-mon[27902]: pgmap v9450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-04-21T15:17:14.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17545.394997 secs 2024-04-21T15:17:14.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:14 smithi191 ceph-mon[31636]: pgmap v9450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-04-21T15:17:14.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17545.394997 secs 2024-04-21T15:17:14.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:14 smithi170 ceph-mon[31212]: pgmap v9450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-04-21T15:17:14.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17545.394997 secs 2024-04-21T15:17:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:16.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:16 smithi077 ceph-mon[27902]: pgmap v9451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:16.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:16 smithi191 ceph-mon[31636]: pgmap v9451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:16.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:16 smithi170 ceph-mon[31212]: pgmap v9451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:17.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17548.633254 secs 2024-04-21T15:17:17.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17548.633254 secs 2024-04-21T15:17:17.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17548.633254 secs 2024-04-21T15:17:18.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:18 smithi077 ceph-mon[27902]: pgmap v9452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:18.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:18 smithi191 ceph-mon[31636]: pgmap v9452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:18.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:18 smithi170 ceph-mon[31212]: pgmap v9452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:19.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17550.395108 secs 2024-04-21T15:17:19.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17550.395108 secs 2024-04-21T15:17:19.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17550.395108 secs 2024-04-21T15:17:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:20.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:20 smithi191 ceph-mon[31636]: pgmap v9453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:20.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:20 smithi170 ceph-mon[31212]: pgmap v9453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:20.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:20 smithi077 ceph-mon[27902]: pgmap v9453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:17:22.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:22 smithi191 ceph-mon[31636]: pgmap v9454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:17:22.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17553.633391 secs 2024-04-21T15:17:22.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:22 smithi170 ceph-mon[31212]: pgmap v9454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:17:22.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17553.633391 secs 2024-04-21T15:17:22.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:22 smithi077 ceph-mon[27902]: pgmap v9454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:17:22.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17553.633391 secs 2024-04-21T15:17:24.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:24 smithi191 ceph-mon[31636]: pgmap v9455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:24.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17555.395184 secs 2024-04-21T15:17:24.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:24 smithi170 ceph-mon[31212]: pgmap v9455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:24.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17555.395184 secs 2024-04-21T15:17:24.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:24 smithi077 ceph-mon[27902]: pgmap v9455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:24.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17555.395184 secs 2024-04-21T15:17:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:26.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:26 smithi191 ceph-mon[31636]: pgmap v9456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:26.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:26 smithi170 ceph-mon[31212]: pgmap v9456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:26.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:26 smithi077 ceph-mon[27902]: pgmap v9456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:27.711 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17558.633504 secs 2024-04-21T15:17:27.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17558.633504 secs 2024-04-21T15:17:27.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17558.633504 secs 2024-04-21T15:17:28.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:28 smithi191 ceph-mon[31636]: pgmap v9457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:28.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:28 smithi170 ceph-mon[31212]: pgmap v9457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:28.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:28 smithi077 ceph-mon[27902]: pgmap v9457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:29.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17560.395298 secs 2024-04-21T15:17:29.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17560.395298 secs 2024-04-21T15:17:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17560.395298 secs 2024-04-21T15:17:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:30.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:30 smithi191 ceph-mon[31636]: pgmap v9458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:17:30.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:30 smithi170 ceph-mon[31212]: pgmap v9458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:17:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:30 smithi077 ceph-mon[27902]: pgmap v9458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:17:32.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:32 smithi191 ceph-mon[31636]: pgmap v9459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:32.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17563.633624 secs 2024-04-21T15:17:32.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:32 smithi170 ceph-mon[31212]: pgmap v9459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:32.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17563.633624 secs 2024-04-21T15:17:32.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:32 smithi077 ceph-mon[27902]: pgmap v9459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:32.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17563.633624 secs 2024-04-21T15:17:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:34 smithi191 ceph-mon[31636]: pgmap v9460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:17:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17565.395362 secs 2024-04-21T15:17:34.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:34 smithi170 ceph-mon[31212]: pgmap v9460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:17:34.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17565.395362 secs 2024-04-21T15:17:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:34 smithi077 ceph-mon[27902]: pgmap v9460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:17:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17565.395362 secs 2024-04-21T15:17:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:36.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:36 smithi191 ceph-mon[31636]: pgmap v9461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T15:17:36.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:36 smithi170 ceph-mon[31212]: pgmap v9461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T15:17:36.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:36 smithi077 ceph-mon[27902]: pgmap v9461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T15:17:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17568.633737 secs 2024-04-21T15:17:37.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17568.633737 secs 2024-04-21T15:17:37.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17568.633737 secs 2024-04-21T15:17:38.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:38 smithi191 ceph-mon[31636]: pgmap v9462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:38.790 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:38 smithi077 ceph-mon[27902]: pgmap v9462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:38.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:38 smithi170 ceph-mon[31212]: pgmap v9462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:39.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17570.395494 secs 2024-04-21T15:17:39.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17570.395494 secs 2024-04-21T15:17:39.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17570.395494 secs 2024-04-21T15:17:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:40.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:40 smithi191 ceph-mon[31636]: pgmap v9463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:40 smithi170 ceph-mon[31212]: pgmap v9463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:40.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:40 smithi077 ceph-mon[27902]: pgmap v9463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:17:41.783+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:17:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:17:41.783+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:17:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:17:41.783+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:17:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:17:41.783+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:17:42.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:42 smithi191 ceph-mon[31636]: pgmap v9464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:42.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17573.633871 secs 2024-04-21T15:17:42.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:42 smithi170 ceph-mon[31212]: pgmap v9464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:42.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17573.633871 secs 2024-04-21T15:17:42.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:42 smithi077 ceph-mon[27902]: pgmap v9464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:42.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17573.633871 secs 2024-04-21T15:17:44.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:44 smithi191 ceph-mon[31636]: pgmap v9465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:44.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17575.395590 secs 2024-04-21T15:17:44.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:44 smithi170 ceph-mon[31212]: pgmap v9465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:44.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17575.395590 secs 2024-04-21T15:17:44.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:44 smithi077 ceph-mon[27902]: pgmap v9465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17575.395590 secs 2024-04-21T15:17:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:46.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:46 smithi191 ceph-mon[31636]: pgmap v9466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:46.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:46 smithi170 ceph-mon[31212]: pgmap v9466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:46.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:46 smithi077 ceph-mon[27902]: pgmap v9466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:47.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17578.633992 secs 2024-04-21T15:17:47.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17578.633992 secs 2024-04-21T15:17:47.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17578.633992 secs 2024-04-21T15:17:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:48 smithi191 ceph-mon[31636]: pgmap v9467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:17:48.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:48 smithi170 ceph-mon[31212]: pgmap v9467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:48.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:17:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:48 smithi077 ceph-mon[27902]: pgmap v9467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:17:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17580.395696 secs 2024-04-21T15:17:49.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17580.395696 secs 2024-04-21T15:17:49.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17580.395696 secs 2024-04-21T15:17:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:50.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: pgmap v9468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:50.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: pgmap v9468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: pgmap v9468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:17:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:17:51.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:17:51.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:17:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:17:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:17:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:17:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:17:51.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:17:53.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:52 smithi170 ceph-mon[31212]: pgmap v9469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:53.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17583.634107 secs 2024-04-21T15:17:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:52 smithi077 ceph-mon[27902]: pgmap v9469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17583.634107 secs 2024-04-21T15:17:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:52 smithi191 ceph-mon[31636]: pgmap v9469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:17:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17583.634107 secs 2024-04-21T15:17:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:54 smithi170 ceph-mon[31212]: pgmap v9470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17585.395797 secs 2024-04-21T15:17:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:17:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:54 smithi077 ceph-mon[27902]: pgmap v9470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17585.395797 secs 2024-04-21T15:17:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:54 smithi191 ceph-mon[31636]: pgmap v9470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:17:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17585.395797 secs 2024-04-21T15:17:57.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:56 smithi191 ceph-mon[31636]: pgmap v9471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:57.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:56 smithi170 ceph-mon[31212]: pgmap v9471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:56 smithi077 ceph-mon[27902]: pgmap v9471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:17:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17588.634224 secs 2024-04-21T15:17:58.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17588.634224 secs 2024-04-21T15:17:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17588.634224 secs 2024-04-21T15:17:59.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:58 smithi170 ceph-mon[31212]: pgmap v9472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:58 smithi077 ceph-mon[27902]: pgmap v9472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:17:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:58 smithi191 ceph-mon[31636]: pgmap v9472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17590.395903 secs 2024-04-21T15:18:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17590.395903 secs 2024-04-21T15:18:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17590.395903 secs 2024-04-21T15:18:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:00 smithi170 ceph-mon[31212]: pgmap v9473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:00 smithi077 ceph-mon[27902]: pgmap v9473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:00 smithi191 ceph-mon[31636]: pgmap v9473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:03.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:02 smithi170 ceph-mon[31212]: pgmap v9474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:18:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17593.634344 secs 2024-04-21T15:18:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:02 smithi077 ceph-mon[27902]: pgmap v9474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:18:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17593.634344 secs 2024-04-21T15:18:03.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:02 smithi191 ceph-mon[31636]: pgmap v9474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:18:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17593.634344 secs 2024-04-21T15:18:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:04 smithi170 ceph-mon[31212]: pgmap v9475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:18:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17595.396034 secs 2024-04-21T15:18:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:04 smithi170 ceph-mon[31212]: osdmap e664: 12 total, 12 up, 12 in 2024-04-21T15:18:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:04 smithi077 ceph-mon[27902]: pgmap v9475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:18:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17595.396034 secs 2024-04-21T15:18:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:04 smithi077 ceph-mon[27902]: osdmap e664: 12 total, 12 up, 12 in 2024-04-21T15:18:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:04 smithi191 ceph-mon[31636]: pgmap v9475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:18:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17595.396034 secs 2024-04-21T15:18:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:04 smithi191 ceph-mon[31636]: osdmap e664: 12 total, 12 up, 12 in 2024-04-21T15:18:07.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:06 smithi170 ceph-mon[31212]: pgmap v9477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:07.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:06 smithi077 ceph-mon[27902]: pgmap v9477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:07.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:06 smithi191 ceph-mon[31636]: pgmap v9477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:08.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17598.634441 secs 2024-04-21T15:18:08.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17598.634441 secs 2024-04-21T15:18:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17598.634441 secs 2024-04-21T15:18:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:08 smithi170 ceph-mon[31212]: pgmap v9478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:08 smithi077 ceph-mon[27902]: pgmap v9478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:08 smithi191 ceph-mon[31636]: pgmap v9478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:10.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17600.396175 secs 2024-04-21T15:18:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:10.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17600.396175 secs 2024-04-21T15:18:10.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17600.396175 secs 2024-04-21T15:18:11.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:10 smithi170 ceph-mon[31212]: pgmap v9479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:10 smithi170 ceph-mon[31212]: osdmap e665: 12 total, 12 up, 12 in 2024-04-21T15:18:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:10 smithi077 ceph-mon[27902]: pgmap v9479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:10 smithi077 ceph-mon[27902]: osdmap e665: 12 total, 12 up, 12 in 2024-04-21T15:18:11.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:10 smithi191 ceph-mon[31636]: pgmap v9479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:18:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:10 smithi191 ceph-mon[31636]: osdmap e665: 12 total, 12 up, 12 in 2024-04-21T15:18:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:12 smithi170 ceph-mon[31212]: pgmap v9481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:18:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17603.634554 secs 2024-04-21T15:18:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:12 smithi077 ceph-mon[27902]: pgmap v9481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:18:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17603.634554 secs 2024-04-21T15:18:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:12 smithi191 ceph-mon[31636]: pgmap v9481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:18:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17603.634554 secs 2024-04-21T15:18:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:14 smithi170 ceph-mon[31212]: pgmap v9482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:18:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17605.396327 secs 2024-04-21T15:18:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:14 smithi077 ceph-mon[27902]: pgmap v9482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:18:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17605.396327 secs 2024-04-21T15:18:15.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:14 smithi191 ceph-mon[31636]: pgmap v9482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:18:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17605.396327 secs 2024-04-21T15:18:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:16 smithi170 ceph-mon[31212]: pgmap v9483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:16 smithi077 ceph-mon[27902]: pgmap v9483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:17.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:16 smithi191 ceph-mon[31636]: pgmap v9483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17608.634667 secs 2024-04-21T15:18:18.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17608.634667 secs 2024-04-21T15:18:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17608.634667 secs 2024-04-21T15:18:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:18 smithi170 ceph-mon[31212]: pgmap v9484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:18 smithi077 ceph-mon[27902]: pgmap v9484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:18 smithi191 ceph-mon[31636]: pgmap v9484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17610.396437 secs 2024-04-21T15:18:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:19 smithi170 ceph-mon[31212]: pgmap v9485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17610.396437 secs 2024-04-21T15:18:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:19 smithi077 ceph-mon[27902]: pgmap v9485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17610.396437 secs 2024-04-21T15:18:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:19 smithi191 ceph-mon[31636]: pgmap v9485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:18:22.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:22 smithi077 ceph-mon[27902]: pgmap v9486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:18:22.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17613.634817 secs 2024-04-21T15:18:22.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:22 smithi191 ceph-mon[31636]: pgmap v9486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:18:22.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17613.634817 secs 2024-04-21T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:22 smithi170 ceph-mon[31212]: pgmap v9486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:18:22.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17613.634817 secs 2024-04-21T15:18:24.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:24 smithi077 ceph-mon[27902]: pgmap v9487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:24.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17615.396570 secs 2024-04-21T15:18:24.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:24 smithi191 ceph-mon[31636]: pgmap v9487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:24.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17615.396570 secs 2024-04-21T15:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:24 smithi170 ceph-mon[31212]: pgmap v9487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17615.396570 secs 2024-04-21T15:18:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:26.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:26 smithi077 ceph-mon[27902]: pgmap v9488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:26.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:26 smithi191 ceph-mon[31636]: pgmap v9488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:26.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:26 smithi170 ceph-mon[31212]: pgmap v9488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:27.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17618.634931 secs 2024-04-21T15:18:27.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17618.634931 secs 2024-04-21T15:18:27.712 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17618.634931 secs 2024-04-21T15:18:28.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:28 smithi077 ceph-mon[27902]: pgmap v9489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:28.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:28 smithi191 ceph-mon[31636]: pgmap v9489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:28 smithi170 ceph-mon[31212]: pgmap v9489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:29.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17620.396682 secs 2024-04-21T15:18:29.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17620.396682 secs 2024-04-21T15:18:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17620.396682 secs 2024-04-21T15:18:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:30.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:30 smithi077 ceph-mon[27902]: pgmap v9490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:30 smithi191 ceph-mon[31636]: pgmap v9490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:30 smithi170 ceph-mon[31212]: pgmap v9490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:32 smithi077 ceph-mon[27902]: pgmap v9491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17623.635045 secs 2024-04-21T15:18:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:32 smithi191 ceph-mon[31636]: pgmap v9491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17623.635045 secs 2024-04-21T15:18:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:32 smithi170 ceph-mon[31212]: pgmap v9491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17623.635045 secs 2024-04-21T15:18:34.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:34 smithi077 ceph-mon[27902]: pgmap v9492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:34.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17625.396819 secs 2024-04-21T15:18:34.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:34 smithi191 ceph-mon[31636]: pgmap v9492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:34.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17625.396819 secs 2024-04-21T15:18:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:34 smithi170 ceph-mon[31212]: pgmap v9492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17625.396819 secs 2024-04-21T15:18:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:36.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:36 smithi077 ceph-mon[27902]: pgmap v9493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:36.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:36 smithi191 ceph-mon[31636]: pgmap v9493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:36.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:36 smithi170 ceph-mon[31212]: pgmap v9493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:37.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17628.635169 secs 2024-04-21T15:18:37.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17628.635169 secs 2024-04-21T15:18:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17628.635169 secs 2024-04-21T15:18:38.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:38 smithi077 ceph-mon[27902]: pgmap v9494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:38.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:38 smithi191 ceph-mon[31636]: pgmap v9494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:38 smithi170 ceph-mon[31212]: pgmap v9494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17630.396939 secs 2024-04-21T15:18:39.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17630.396939 secs 2024-04-21T15:18:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17630.396939 secs 2024-04-21T15:18:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:40.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:40 smithi077 ceph-mon[27902]: pgmap v9495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:40.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:40 smithi191 ceph-mon[31636]: pgmap v9495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:40.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:40 smithi170 ceph-mon[31212]: pgmap v9495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:42.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:42 smithi077 ceph-mon[27902]: pgmap v9496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:42.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17633.635290 secs 2024-04-21T15:18:42.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:42 smithi191 ceph-mon[31636]: pgmap v9496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:42.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17633.635290 secs 2024-04-21T15:18:42.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:42 smithi170 ceph-mon[31212]: pgmap v9496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:42.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17633.635290 secs 2024-04-21T15:18:44.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:44 smithi077 ceph-mon[27902]: pgmap v9497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:44.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17635.397017 secs 2024-04-21T15:18:44.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:44 smithi191 ceph-mon[31636]: pgmap v9497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:44.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17635.397017 secs 2024-04-21T15:18:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:44 smithi170 ceph-mon[31212]: pgmap v9497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17635.397017 secs 2024-04-21T15:18:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:46.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:46 smithi077 ceph-mon[27902]: pgmap v9498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:46.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:46 smithi191 ceph-mon[31636]: pgmap v9498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:46.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:46 smithi170 ceph-mon[31212]: pgmap v9498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:47.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17638.635409 secs 2024-04-21T15:18:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17638.635409 secs 2024-04-21T15:18:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17638.635409 secs 2024-04-21T15:18:48.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:48 smithi191 ceph-mon[31636]: pgmap v9499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:48.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:48 smithi170 ceph-mon[31212]: pgmap v9499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:48 smithi077 ceph-mon[27902]: pgmap v9499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:49.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17640.397133 secs 2024-04-21T15:18:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17640.397133 secs 2024-04-21T15:18:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17640.397133 secs 2024-04-21T15:18:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:50 smithi191 ceph-mon[31636]: pgmap v9500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:50 smithi170 ceph-mon[31212]: pgmap v9500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:50 smithi077 ceph-mon[27902]: pgmap v9500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:18:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:18:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:18:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:52.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:52 smithi191 ceph-mon[31636]: pgmap v9501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:52.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17643.635521 secs 2024-04-21T15:18:52.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:18:52.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:18:52.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:52 smithi170 ceph-mon[31212]: pgmap v9501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17643.635521 secs 2024-04-21T15:18:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:18:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:18:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:52 smithi077 ceph-mon[27902]: pgmap v9501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:18:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17643.635521 secs 2024-04-21T15:18:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:18:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:18:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:18:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:54 smithi191 ceph-mon[31636]: pgmap v9502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17645.397229 secs 2024-04-21T15:18:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:54 smithi170 ceph-mon[31212]: pgmap v9502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17645.397229 secs 2024-04-21T15:18:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:54 smithi077 ceph-mon[27902]: pgmap v9502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:18:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17645.397229 secs 2024-04-21T15:18:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:18:56.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:56 smithi191 ceph-mon[31636]: pgmap v9503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:56.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:56 smithi170 ceph-mon[31212]: pgmap v9503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:56.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:56 smithi077 ceph-mon[27902]: pgmap v9503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:18:57.712 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17648.635616 secs 2024-04-21T15:18:57.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17648.635616 secs 2024-04-21T15:18:57.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17648.635616 secs 2024-04-21T15:18:58.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:58 smithi191 ceph-mon[31636]: pgmap v9504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:58 smithi170 ceph-mon[31212]: pgmap v9504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:58 smithi077 ceph-mon[27902]: pgmap v9504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:18:59.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17650.397328 secs 2024-04-21T15:18:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17650.397328 secs 2024-04-21T15:18:59.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17650.397328 secs 2024-04-21T15:19:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:00 smithi191 ceph-mon[31636]: pgmap v9505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:00 smithi170 ceph-mon[31212]: pgmap v9505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:00 smithi077 ceph-mon[27902]: pgmap v9505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:02.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:02 smithi191 ceph-mon[31636]: pgmap v9506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:02.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17653.635732 secs 2024-04-21T15:19:02.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:02 smithi170 ceph-mon[31212]: pgmap v9506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:02.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17653.635732 secs 2024-04-21T15:19:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:02 smithi077 ceph-mon[27902]: pgmap v9506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17653.635732 secs 2024-04-21T15:19:04.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:04 smithi191 ceph-mon[31636]: pgmap v9507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:04.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17655.397444 secs 2024-04-21T15:19:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:04 smithi170 ceph-mon[31212]: pgmap v9507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17655.397444 secs 2024-04-21T15:19:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:04 smithi077 ceph-mon[27902]: pgmap v9507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17655.397444 secs 2024-04-21T15:19:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:05 smithi191 ceph-mon[31636]: osdmap e666: 12 total, 12 up, 12 in 2024-04-21T15:19:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:05 smithi170 ceph-mon[31212]: osdmap e666: 12 total, 12 up, 12 in 2024-04-21T15:19:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:05 smithi077 ceph-mon[27902]: osdmap e666: 12 total, 12 up, 12 in 2024-04-21T15:19:06.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:06 smithi191 ceph-mon[31636]: pgmap v9509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:06.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:06 smithi170 ceph-mon[31212]: pgmap v9509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:06.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:06 smithi077 ceph-mon[27902]: pgmap v9509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:07.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17658.635855 secs 2024-04-21T15:19:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17658.635855 secs 2024-04-21T15:19:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17658.635855 secs 2024-04-21T15:19:08.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:08 smithi191 ceph-mon[31636]: pgmap v9510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:08.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:08 smithi077 ceph-mon[27902]: pgmap v9510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:08 smithi170 ceph-mon[31212]: pgmap v9510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:09.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17660.397566 secs 2024-04-21T15:19:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17660.397566 secs 2024-04-21T15:19:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17660.397566 secs 2024-04-21T15:19:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:10 smithi191 ceph-mon[31636]: pgmap v9511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:10 smithi191 ceph-mon[31636]: osdmap e667: 12 total, 12 up, 12 in 2024-04-21T15:19:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:10 smithi170 ceph-mon[31212]: pgmap v9511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:10 smithi170 ceph-mon[31212]: osdmap e667: 12 total, 12 up, 12 in 2024-04-21T15:19:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:10 smithi077 ceph-mon[27902]: pgmap v9511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:19:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:10 smithi077 ceph-mon[27902]: osdmap e667: 12 total, 12 up, 12 in 2024-04-21T15:19:12.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:12 smithi191 ceph-mon[31636]: pgmap v9513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:19:12.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17663.635928 secs 2024-04-21T15:19:12.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:12 smithi170 ceph-mon[31212]: pgmap v9513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:19:12.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17663.635928 secs 2024-04-21T15:19:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:12 smithi077 ceph-mon[27902]: pgmap v9513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:19:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17663.635928 secs 2024-04-21T15:19:14.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:14 smithi191 ceph-mon[31636]: pgmap v9514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:19:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17665.397663 secs 2024-04-21T15:19:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:14 smithi170 ceph-mon[31212]: pgmap v9514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:19:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17665.397663 secs 2024-04-21T15:19:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:14 smithi077 ceph-mon[27902]: pgmap v9514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:19:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17665.397663 secs 2024-04-21T15:19:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:16.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:16 smithi170 ceph-mon[31212]: pgmap v9515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:19:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:16 smithi077 ceph-mon[27902]: pgmap v9515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:19:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:16 smithi191 ceph-mon[31636]: pgmap v9515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:19:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17668.636041 secs 2024-04-21T15:19:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17668.636041 secs 2024-04-21T15:19:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17668.636041 secs 2024-04-21T15:19:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:18 smithi170 ceph-mon[31212]: pgmap v9516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:19:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:18 smithi077 ceph-mon[27902]: pgmap v9516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:19:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:18 smithi191 ceph-mon[31636]: pgmap v9516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:19:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17670.397772 secs 2024-04-21T15:19:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17670.397772 secs 2024-04-21T15:19:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17670.397772 secs 2024-04-21T15:19:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:20.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:20 smithi170 ceph-mon[31212]: pgmap v9517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:19:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:20 smithi077 ceph-mon[27902]: pgmap v9517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:19:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:20 smithi191 ceph-mon[31636]: pgmap v9517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:19:22.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:22 smithi170 ceph-mon[31212]: pgmap v9518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:19:22.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17673.636178 secs 2024-04-21T15:19:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:22 smithi077 ceph-mon[27902]: pgmap v9518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:19:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17673.636178 secs 2024-04-21T15:19:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:22 smithi191 ceph-mon[31636]: pgmap v9518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:19:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17673.636178 secs 2024-04-21T15:19:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:24 smithi170 ceph-mon[31212]: pgmap v9519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:24.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17675.397839 secs 2024-04-21T15:19:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:24 smithi077 ceph-mon[27902]: pgmap v9519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17675.397839 secs 2024-04-21T15:19:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:24 smithi191 ceph-mon[31636]: pgmap v9519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17675.397839 secs 2024-04-21T15:19:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:26.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:26 smithi170 ceph-mon[31212]: pgmap v9520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:26 smithi077 ceph-mon[27902]: pgmap v9520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:26 smithi191 ceph-mon[31636]: pgmap v9520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17678.636309 secs 2024-04-21T15:19:27.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17678.636309 secs 2024-04-21T15:19:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17678.636309 secs 2024-04-21T15:19:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:28 smithi170 ceph-mon[31212]: pgmap v9521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:28 smithi077 ceph-mon[27902]: pgmap v9521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:28 smithi191 ceph-mon[31636]: pgmap v9521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17680.397933 secs 2024-04-21T15:19:29.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17680.397933 secs 2024-04-21T15:19:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17680.397933 secs 2024-04-21T15:19:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:30 smithi170 ceph-mon[31212]: pgmap v9522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:30 smithi077 ceph-mon[27902]: pgmap v9522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:30 smithi191 ceph-mon[31636]: pgmap v9522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:32 smithi170 ceph-mon[31212]: pgmap v9523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:32.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17683.636429 secs 2024-04-21T15:19:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:32 smithi077 ceph-mon[27902]: pgmap v9523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17683.636429 secs 2024-04-21T15:19:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:32 smithi191 ceph-mon[31636]: pgmap v9523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:32.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17683.636429 secs 2024-04-21T15:19:34.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:34 smithi170 ceph-mon[31212]: pgmap v9524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:34.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17685.398015 secs 2024-04-21T15:19:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:34 smithi077 ceph-mon[27902]: pgmap v9524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17685.398015 secs 2024-04-21T15:19:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:34 smithi191 ceph-mon[31636]: pgmap v9524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17685.398015 secs 2024-04-21T15:19:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:36.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:36 smithi170 ceph-mon[31212]: pgmap v9525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:36.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:36 smithi077 ceph-mon[27902]: pgmap v9525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:36 smithi191 ceph-mon[31636]: pgmap v9525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:37.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17688.636558 secs 2024-04-21T15:19:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17688.636558 secs 2024-04-21T15:19:37.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17688.636558 secs 2024-04-21T15:19:38.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:38 smithi077 ceph-mon[27902]: pgmap v9526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:38.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:38 smithi170 ceph-mon[31212]: pgmap v9526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:38 smithi191 ceph-mon[31636]: pgmap v9526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17690.398134 secs 2024-04-21T15:19:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17690.398134 secs 2024-04-21T15:19:39.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17690.398134 secs 2024-04-21T15:19:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:40.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:40 smithi170 ceph-mon[31212]: pgmap v9527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:40 smithi077 ceph-mon[27902]: pgmap v9527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:40 smithi191 ceph-mon[31636]: pgmap v9527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:42.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:42 smithi170 ceph-mon[31212]: pgmap v9528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:42.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17693.636677 secs 2024-04-21T15:19:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:42 smithi077 ceph-mon[27902]: pgmap v9528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17693.636677 secs 2024-04-21T15:19:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:42 smithi191 ceph-mon[31636]: pgmap v9528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17693.636677 secs 2024-04-21T15:19:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:44 smithi170 ceph-mon[31212]: pgmap v9529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17695.398254 secs 2024-04-21T15:19:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:44 smithi077 ceph-mon[27902]: pgmap v9529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17695.398254 secs 2024-04-21T15:19:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:44 smithi191 ceph-mon[31636]: pgmap v9529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17695.398254 secs 2024-04-21T15:19:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:46.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:46 smithi170 ceph-mon[31212]: pgmap v9530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:46.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:46 smithi077 ceph-mon[27902]: pgmap v9530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:46 smithi191 ceph-mon[31636]: pgmap v9530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T15:19:47.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17698.636777 secs 2024-04-21T15:19:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17698.636777 secs 2024-04-21T15:19:47.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17698.636777 secs 2024-04-21T15:19:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:48 smithi170 ceph-mon[31212]: pgmap v9531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:48 smithi077 ceph-mon[27902]: pgmap v9531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:48 smithi191 ceph-mon[31636]: pgmap v9531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17700.398354 secs 2024-04-21T15:19:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17700.398354 secs 2024-04-21T15:19:50.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17700.398354 secs 2024-04-21T15:19:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:50 smithi077 ceph-mon[27902]: pgmap v9532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:50 smithi191 ceph-mon[31636]: pgmap v9532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:50 smithi170 ceph-mon[31212]: pgmap v9532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:52.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:52 smithi077 ceph-mon[27902]: pgmap v9533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:52.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17703.636867 secs 2024-04-21T15:19:52.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:19:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:52 smithi191 ceph-mon[31636]: pgmap v9533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17703.636867 secs 2024-04-21T15:19:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:19:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:52 smithi170 ceph-mon[31212]: pgmap v9533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:19:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17703.636867 secs 2024-04-21T15:19:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:19:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:53.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:19:53.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:19:53.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:19:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:19:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:19:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:19:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:54 smithi170 ceph-mon[31212]: pgmap v9534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17705.398449 secs 2024-04-21T15:19:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:19:55.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:54 smithi077 ceph-mon[27902]: pgmap v9534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:55.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17705.398449 secs 2024-04-21T15:19:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:54 smithi191 ceph-mon[31636]: pgmap v9534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:19:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17705.398449 secs 2024-04-21T15:19:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:19:56.800+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:19:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:19:56.800+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:19:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:19:56.801+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:19:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:19:56.801+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:19:57.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:56 smithi191 ceph-mon[31636]: pgmap v9535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:19:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:56 smithi170 ceph-mon[31212]: pgmap v9535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:19:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:56 smithi077 ceph-mon[27902]: pgmap v9535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:19:58.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17708.636984 secs 2024-04-21T15:19:58.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17708.636984 secs 2024-04-21T15:19:58.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17708.636984 secs 2024-04-21T15:19:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:58 smithi170 ceph-mon[31212]: pgmap v9536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:58 smithi077 ceph-mon[27902]: pgmap v9536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:19:59.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:58 smithi191 ceph-mon[31636]: pgmap v9536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:00.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17710.398547 secs 2024-04-21T15:20:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:00.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17710.398547 secs 2024-04-21T15:20:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17710.398547 secs 2024-04-21T15:20:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:00 smithi170 ceph-mon[31212]: pgmap v9537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:20:01.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:00 smithi077 ceph-mon[27902]: pgmap v9537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:01.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:20:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:00 smithi191 ceph-mon[31636]: pgmap v9537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:01.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:20:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:02 smithi170 ceph-mon[31212]: pgmap v9538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:20:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17713.637109 secs 2024-04-21T15:20:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:02 smithi077 ceph-mon[27902]: pgmap v9538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:20:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17713.637109 secs 2024-04-21T15:20:03.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:02 smithi191 ceph-mon[31636]: pgmap v9538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:20:03.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17713.637109 secs 2024-04-21T15:20:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:04 smithi170 ceph-mon[31212]: pgmap v9539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:20:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17715.398697 secs 2024-04-21T15:20:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:04 smithi170 ceph-mon[31212]: osdmap e668: 12 total, 12 up, 12 in 2024-04-21T15:20:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:04 smithi077 ceph-mon[27902]: pgmap v9539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:20:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17715.398697 secs 2024-04-21T15:20:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:04 smithi077 ceph-mon[27902]: osdmap e668: 12 total, 12 up, 12 in 2024-04-21T15:20:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:04 smithi191 ceph-mon[31636]: pgmap v9539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:20:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17715.398697 secs 2024-04-21T15:20:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:04 smithi191 ceph-mon[31636]: osdmap e668: 12 total, 12 up, 12 in 2024-04-21T15:20:07.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:06 smithi170 ceph-mon[31212]: pgmap v9541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:07.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:06 smithi077 ceph-mon[27902]: pgmap v9541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:07.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:06 smithi191 ceph-mon[31636]: pgmap v9541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:08.042 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17718.637236 secs 2024-04-21T15:20:08.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17718.637236 secs 2024-04-21T15:20:08.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17718.637236 secs 2024-04-21T15:20:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:08 smithi170 ceph-mon[31212]: pgmap v9542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:08 smithi077 ceph-mon[27902]: pgmap v9542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:09.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:08 smithi191 ceph-mon[31636]: pgmap v9542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:10.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17720.398819 secs 2024-04-21T15:20:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17720.398819 secs 2024-04-21T15:20:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17720.398819 secs 2024-04-21T15:20:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:10 smithi170 ceph-mon[31212]: pgmap v9543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:10 smithi170 ceph-mon[31212]: osdmap e669: 12 total, 12 up, 12 in 2024-04-21T15:20:11.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:10 smithi077 ceph-mon[27902]: pgmap v9543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:11.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:10 smithi077 ceph-mon[27902]: osdmap e669: 12 total, 12 up, 12 in 2024-04-21T15:20:11.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:10 smithi191 ceph-mon[31636]: pgmap v9543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:20:11.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:10 smithi191 ceph-mon[31636]: osdmap e669: 12 total, 12 up, 12 in 2024-04-21T15:20:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:12 smithi170 ceph-mon[31212]: pgmap v9545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:20:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17723.637355 secs 2024-04-21T15:20:13.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:12 smithi077 ceph-mon[27902]: pgmap v9545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:20:13.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17723.637355 secs 2024-04-21T15:20:13.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:12 smithi191 ceph-mon[31636]: pgmap v9545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:20:13.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17723.637355 secs 2024-04-21T15:20:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:14 smithi170 ceph-mon[31212]: pgmap v9546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:20:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17725.398934 secs 2024-04-21T15:20:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:14 smithi077 ceph-mon[27902]: pgmap v9546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:20:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17725.398934 secs 2024-04-21T15:20:15.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:14 smithi191 ceph-mon[31636]: pgmap v9546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:20:15.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17725.398934 secs 2024-04-21T15:20:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:16 smithi170 ceph-mon[31212]: pgmap v9547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:20:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:16 smithi077 ceph-mon[27902]: pgmap v9547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:20:17.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:16 smithi191 ceph-mon[31636]: pgmap v9547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T15:20:18.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17728.637425 secs 2024-04-21T15:20:18.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17728.637425 secs 2024-04-21T15:20:18.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17728.637425 secs 2024-04-21T15:20:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:18 smithi170 ceph-mon[31212]: pgmap v9548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:20:19.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:18 smithi077 ceph-mon[27902]: pgmap v9548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:20:19.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:18 smithi191 ceph-mon[31636]: pgmap v9548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:20:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:20.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17730.399010 secs 2024-04-21T15:20:20.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17730.399010 secs 2024-04-21T15:20:20.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17730.399010 secs 2024-04-21T15:20:21.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:20 smithi077 ceph-mon[27902]: pgmap v9549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:20:21.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:20 smithi191 ceph-mon[31636]: pgmap v9549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:20:21.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:20 smithi170 ceph-mon[31212]: pgmap v9549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:20:22.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:21 smithi077 ceph-mon[27902]: pgmap v9550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:20:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:21 smithi191 ceph-mon[31636]: pgmap v9550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:20:22.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:21 smithi170 ceph-mon[31212]: pgmap v9550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:20:23.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17733.637542 secs 2024-04-21T15:20:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17733.637542 secs 2024-04-21T15:20:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17733.637542 secs 2024-04-21T15:20:24.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:23 smithi077 ceph-mon[27902]: pgmap v9551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:24.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17735.399127 secs 2024-04-21T15:20:24.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:23 smithi191 ceph-mon[31636]: pgmap v9551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:24.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17735.399127 secs 2024-04-21T15:20:24.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:23 smithi170 ceph-mon[31212]: pgmap v9551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:24.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17735.399127 secs 2024-04-21T15:20:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:26.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:26 smithi077 ceph-mon[27902]: pgmap v9552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:20:26.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:26 smithi191 ceph-mon[31636]: pgmap v9552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:20:26.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:26 smithi170 ceph-mon[31212]: pgmap v9552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:20:27.625 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17738.637648 secs 2024-04-21T15:20:27.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17738.637648 secs 2024-04-21T15:20:27.713 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17738.637648 secs 2024-04-21T15:20:28.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:28 smithi077 ceph-mon[27902]: pgmap v9553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:28.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:28 smithi191 ceph-mon[31636]: pgmap v9553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:28 smithi170 ceph-mon[31212]: pgmap v9553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:29.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17740.399229 secs 2024-04-21T15:20:29.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17740.399229 secs 2024-04-21T15:20:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17740.399229 secs 2024-04-21T15:20:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:30.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:30 smithi077 ceph-mon[27902]: pgmap v9554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:30 smithi191 ceph-mon[31636]: pgmap v9554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:30 smithi170 ceph-mon[31212]: pgmap v9554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:32.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:32 smithi077 ceph-mon[27902]: pgmap v9555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:32.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17743.637783 secs 2024-04-21T15:20:32.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:32 smithi191 ceph-mon[31636]: pgmap v9555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:32.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17743.637783 secs 2024-04-21T15:20:32.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:32 smithi170 ceph-mon[31212]: pgmap v9555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:32.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17743.637783 secs 2024-04-21T15:20:34.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:34 smithi077 ceph-mon[27902]: pgmap v9556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:34.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17745.399342 secs 2024-04-21T15:20:34.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:34 smithi191 ceph-mon[31636]: pgmap v9556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:34.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17745.399342 secs 2024-04-21T15:20:34.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:34 smithi170 ceph-mon[31212]: pgmap v9556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:34.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17745.399342 secs 2024-04-21T15:20:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:36.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:36 smithi077 ceph-mon[27902]: pgmap v9557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:20:36.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:36 smithi191 ceph-mon[31636]: pgmap v9557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:20:36.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:36 smithi170 ceph-mon[31212]: pgmap v9557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-04-21T15:20:37.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17748.637852 secs 2024-04-21T15:20:37.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17748.637852 secs 2024-04-21T15:20:37.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17748.637852 secs 2024-04-21T15:20:38.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:38 smithi191 ceph-mon[31636]: pgmap v9558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:38.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:38 smithi077 ceph-mon[27902]: pgmap v9558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:38.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:38 smithi170 ceph-mon[31212]: pgmap v9558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:39.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17750.399478 secs 2024-04-21T15:20:39.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17750.399478 secs 2024-04-21T15:20:39.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17750.399478 secs 2024-04-21T15:20:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:40.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:40 smithi191 ceph-mon[31636]: pgmap v9559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:40 smithi170 ceph-mon[31212]: pgmap v9559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:40 smithi077 ceph-mon[27902]: pgmap v9559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:42.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:42 smithi191 ceph-mon[31636]: pgmap v9560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:42.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17753.637976 secs 2024-04-21T15:20:42.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:42 smithi170 ceph-mon[31212]: pgmap v9560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:42.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17753.637976 secs 2024-04-21T15:20:42.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:42 smithi077 ceph-mon[27902]: pgmap v9560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:42.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17753.637976 secs 2024-04-21T15:20:44.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:44 smithi191 ceph-mon[31636]: pgmap v9561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:44.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17755.399613 secs 2024-04-21T15:20:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:44 smithi170 ceph-mon[31212]: pgmap v9561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17755.399613 secs 2024-04-21T15:20:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:44 smithi077 ceph-mon[27902]: pgmap v9561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17755.399613 secs 2024-04-21T15:20:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:46.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:46 smithi191 ceph-mon[31636]: pgmap v9562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:46.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:46 smithi170 ceph-mon[31212]: pgmap v9562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:46.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:46 smithi077 ceph-mon[27902]: pgmap v9562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:47.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17758.638075 secs 2024-04-21T15:20:47.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17758.638075 secs 2024-04-21T15:20:47.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17758.638075 secs 2024-04-21T15:20:48.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:48 smithi191 ceph-mon[31636]: pgmap v9563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:48 smithi170 ceph-mon[31212]: pgmap v9563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:48 smithi077 ceph-mon[27902]: pgmap v9563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T15:20:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17760.399731 secs 2024-04-21T15:20:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17760.399731 secs 2024-04-21T15:20:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17760.399731 secs 2024-04-21T15:20:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:50.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:50 smithi191 ceph-mon[31636]: pgmap v9564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:50.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:50 smithi170 ceph-mon[31212]: pgmap v9564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:50 smithi077 ceph-mon[27902]: pgmap v9564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:52.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:52 smithi191 ceph-mon[31636]: pgmap v9565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:52.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17763.638226 secs 2024-04-21T15:20:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:52 smithi170 ceph-mon[31212]: pgmap v9565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17763.638226 secs 2024-04-21T15:20:52.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:52 smithi077 ceph-mon[27902]: pgmap v9565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:52.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17763.638226 secs 2024-04-21T15:20:54.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:54 smithi191 ceph-mon[31636]: pgmap v9566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:54.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:20:54.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17765.399828 secs 2024-04-21T15:20:54.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:20:54.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:20:54.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:20:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:54 smithi170 ceph-mon[31212]: pgmap v9566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:20:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17765.399828 secs 2024-04-21T15:20:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:20:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:20:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:20:54.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:54 smithi077 ceph-mon[27902]: pgmap v9566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:54.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:20:54.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17765.399828 secs 2024-04-21T15:20:54.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:20:54.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:20:54.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:20:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:20:56.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:56 smithi191 ceph-mon[31636]: pgmap v9567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:56.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:56 smithi170 ceph-mon[31212]: pgmap v9567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:56.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:56 smithi077 ceph-mon[27902]: pgmap v9567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:20:57.714 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17768.638359 secs 2024-04-21T15:20:57.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17768.638359 secs 2024-04-21T15:20:57.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17768.638359 secs 2024-04-21T15:20:58.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:58 smithi191 ceph-mon[31636]: pgmap v9568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:58.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:58 smithi170 ceph-mon[31212]: pgmap v9568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:58.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:58 smithi077 ceph-mon[27902]: pgmap v9568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:20:59.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17770.399945 secs 2024-04-21T15:20:59.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17770.399945 secs 2024-04-21T15:20:59.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17770.399945 secs 2024-04-21T15:21:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:00.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:00 smithi191 ceph-mon[31636]: pgmap v9569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:00.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:00 smithi170 ceph-mon[31212]: pgmap v9569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:00.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:00 smithi077 ceph-mon[27902]: pgmap v9569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:02.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:02 smithi191 ceph-mon[31636]: pgmap v9570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:02.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17773.638495 secs 2024-04-21T15:21:02.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:02 smithi170 ceph-mon[31212]: pgmap v9570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:02.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17773.638495 secs 2024-04-21T15:21:02.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:02 smithi077 ceph-mon[27902]: pgmap v9570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:02.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17773.638495 secs 2024-04-21T15:21:04.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:04 smithi191 ceph-mon[31636]: pgmap v9571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:04.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17775.400012 secs 2024-04-21T15:21:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:04 smithi170 ceph-mon[31212]: pgmap v9571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17775.400012 secs 2024-04-21T15:21:04.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:04 smithi077 ceph-mon[27902]: pgmap v9571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:04.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17775.400012 secs 2024-04-21T15:21:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:05.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:05 smithi191 ceph-mon[31636]: osdmap e670: 12 total, 12 up, 12 in 2024-04-21T15:21:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:05 smithi170 ceph-mon[31212]: osdmap e670: 12 total, 12 up, 12 in 2024-04-21T15:21:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:05 smithi077 ceph-mon[27902]: osdmap e670: 12 total, 12 up, 12 in 2024-04-21T15:21:06.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:06 smithi191 ceph-mon[31636]: pgmap v9573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:06.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:06 smithi170 ceph-mon[31212]: pgmap v9573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:06.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:06 smithi077 ceph-mon[27902]: pgmap v9573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:07.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17778.638603 secs 2024-04-21T15:21:07.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17778.638603 secs 2024-04-21T15:21:07.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17778.638603 secs 2024-04-21T15:21:08.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:08 smithi077 ceph-mon[27902]: pgmap v9574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:08.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:08 smithi170 ceph-mon[31212]: pgmap v9574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:08 smithi191 ceph-mon[31636]: pgmap v9574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17780.400130 secs 2024-04-21T15:21:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17780.400130 secs 2024-04-21T15:21:09.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17780.400130 secs 2024-04-21T15:21:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:10 smithi170 ceph-mon[31212]: pgmap v9575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:10.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:10 smithi170 ceph-mon[31212]: osdmap e671: 12 total, 12 up, 12 in 2024-04-21T15:21:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:10 smithi077 ceph-mon[27902]: pgmap v9575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:10 smithi077 ceph-mon[27902]: osdmap e671: 12 total, 12 up, 12 in 2024-04-21T15:21:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:10 smithi191 ceph-mon[31636]: pgmap v9575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:21:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:10 smithi191 ceph-mon[31636]: osdmap e671: 12 total, 12 up, 12 in 2024-04-21T15:21:12.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:12 smithi170 ceph-mon[31212]: pgmap v9577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:21:12.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17783.638738 secs 2024-04-21T15:21:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:12 smithi077 ceph-mon[27902]: pgmap v9577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:21:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17783.638738 secs 2024-04-21T15:21:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:12 smithi191 ceph-mon[31636]: pgmap v9577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:21:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17783.638738 secs 2024-04-21T15:21:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:14 smithi170 ceph-mon[31212]: pgmap v9578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:21:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17785.400217 secs 2024-04-21T15:21:14.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:14 smithi077 ceph-mon[27902]: pgmap v9578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:21:14.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17785.400217 secs 2024-04-21T15:21:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:14 smithi191 ceph-mon[31636]: pgmap v9578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T15:21:14.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17785.400217 secs 2024-04-21T15:21:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:16 smithi170 ceph-mon[31212]: pgmap v9579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:16 smithi077 ceph-mon[27902]: pgmap v9579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:16 smithi191 ceph-mon[31636]: pgmap v9579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:17.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17788.638858 secs 2024-04-21T15:21:17.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17788.638858 secs 2024-04-21T15:21:17.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17788.638858 secs 2024-04-21T15:21:18.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:18 smithi170 ceph-mon[31212]: pgmap v9580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:18 smithi077 ceph-mon[27902]: pgmap v9580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:18 smithi191 ceph-mon[31636]: pgmap v9580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17790.400337 secs 2024-04-21T15:21:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17790.400337 secs 2024-04-21T15:21:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17790.400337 secs 2024-04-21T15:21:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:20.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:20 smithi170 ceph-mon[31212]: pgmap v9581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:20 smithi077 ceph-mon[27902]: pgmap v9581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:20 smithi191 ceph-mon[31636]: pgmap v9581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:21:22.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:22 smithi170 ceph-mon[31212]: pgmap v9582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:21:22.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17793.638972 secs 2024-04-21T15:21:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:22 smithi077 ceph-mon[27902]: pgmap v9582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:21:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17793.638972 secs 2024-04-21T15:21:22.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:22 smithi191 ceph-mon[31636]: pgmap v9582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T15:21:22.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17793.638972 secs 2024-04-21T15:21:24.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:24 smithi170 ceph-mon[31212]: pgmap v9583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:24.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17795.400459 secs 2024-04-21T15:21:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:24 smithi077 ceph-mon[27902]: pgmap v9583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17795.400459 secs 2024-04-21T15:21:24.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:24 smithi191 ceph-mon[31636]: pgmap v9583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:24.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17795.400459 secs 2024-04-21T15:21:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:26.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:26 smithi170 ceph-mon[31212]: pgmap v9584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:26.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:26 smithi077 ceph-mon[27902]: pgmap v9584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:26 smithi191 ceph-mon[31636]: pgmap v9584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:27.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17798.639079 secs 2024-04-21T15:21:27.876 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17798.639079 secs 2024-04-21T15:21:27.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17798.639079 secs 2024-04-21T15:21:28.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:28 smithi170 ceph-mon[31212]: pgmap v9585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:28 smithi077 ceph-mon[27902]: pgmap v9585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:28 smithi191 ceph-mon[31636]: pgmap v9585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:29.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17800.400560 secs 2024-04-21T15:21:29.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17800.400560 secs 2024-04-21T15:21:29.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17800.400560 secs 2024-04-21T15:21:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:30 smithi170 ceph-mon[31212]: pgmap v9586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:30 smithi077 ceph-mon[27902]: pgmap v9586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:30 smithi191 ceph-mon[31636]: pgmap v9586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:32.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:32 smithi170 ceph-mon[31212]: pgmap v9587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:32.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17803.639189 secs 2024-04-21T15:21:32.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:32 smithi077 ceph-mon[27902]: pgmap v9587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:32.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17803.639189 secs 2024-04-21T15:21:32.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:32 smithi191 ceph-mon[31636]: pgmap v9587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:32.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17803.639189 secs 2024-04-21T15:21:34.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:34 smithi170 ceph-mon[31212]: pgmap v9588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:34.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17805.400706 secs 2024-04-21T15:21:34.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:34 smithi077 ceph-mon[27902]: pgmap v9588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:34.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17805.400706 secs 2024-04-21T15:21:34.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:34 smithi191 ceph-mon[31636]: pgmap v9588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:34.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17805.400706 secs 2024-04-21T15:21:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:36.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:36 smithi170 ceph-mon[31212]: pgmap v9589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:36.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:36 smithi077 ceph-mon[27902]: pgmap v9589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:36.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:36 smithi191 ceph-mon[31636]: pgmap v9589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:37.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17808.639263 secs 2024-04-21T15:21:37.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17808.639263 secs 2024-04-21T15:21:37.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17808.639263 secs 2024-04-21T15:21:38.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:38 smithi170 ceph-mon[31212]: pgmap v9590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:38.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:38 smithi077 ceph-mon[27902]: pgmap v9590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:38 smithi191 ceph-mon[31636]: pgmap v9590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:39.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17810.400823 secs 2024-04-21T15:21:39.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17810.400823 secs 2024-04-21T15:21:39.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17810.400823 secs 2024-04-21T15:21:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 17995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:40 smithi077 ceph-mon[27902]: pgmap v9591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:40.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:40 smithi191 ceph-mon[31636]: pgmap v9591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:41.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:40 smithi170 ceph-mon[31212]: pgmap v9591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:42.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:42 smithi077 ceph-mon[27902]: pgmap v9592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:42.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17813.639335 secs 2024-04-21T15:21:42.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:42 smithi191 ceph-mon[31636]: pgmap v9592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:42.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17813.639335 secs 2024-04-21T15:21:43.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:42 smithi170 ceph-mon[31212]: pgmap v9592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:43.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17813.639335 secs 2024-04-21T15:21:44.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:44 smithi077 ceph-mon[27902]: pgmap v9593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:44.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17815.400940 secs 2024-04-21T15:21:44.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:44 smithi191 ceph-mon[31636]: pgmap v9593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:44.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17815.400940 secs 2024-04-21T15:21:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:44 smithi170 ceph-mon[31212]: pgmap v9593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17815.400940 secs 2024-04-21T15:21:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:46.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:46 smithi077 ceph-mon[27902]: pgmap v9594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:46.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:46 smithi191 ceph-mon[31636]: pgmap v9594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:47.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:46 smithi170 ceph-mon[31212]: pgmap v9594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:47.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17818.639404 secs 2024-04-21T15:21:47.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17818.639404 secs 2024-04-21T15:21:48.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17818.639404 secs 2024-04-21T15:21:48.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:48 smithi077 ceph-mon[27902]: pgmap v9595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:48.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:48 smithi191 ceph-mon[31636]: pgmap v9595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:49.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:48 smithi170 ceph-mon[31212]: pgmap v9595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17820.401052 secs 2024-04-21T15:21:49.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17820.401052 secs 2024-04-21T15:21:50.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17820.401052 secs 2024-04-21T15:21:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:50.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:50 smithi077 ceph-mon[27902]: pgmap v9596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:50.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:50 smithi191 ceph-mon[31636]: pgmap v9596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:50 smithi170 ceph-mon[31212]: pgmap v9596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:52.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:52 smithi077 ceph-mon[27902]: pgmap v9597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:52.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17823.639518 secs 2024-04-21T15:21:52.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:52 smithi191 ceph-mon[31636]: pgmap v9597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:52.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17823.639518 secs 2024-04-21T15:21:53.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:52 smithi170 ceph-mon[31212]: pgmap v9597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17823.639518 secs 2024-04-21T15:21:54.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:54 smithi077 ceph-mon[27902]: pgmap v9598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:54.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17825.401159 secs 2024-04-21T15:21:54.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:21:54.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:54 smithi191 ceph-mon[31636]: pgmap v9598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:54.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17825.401159 secs 2024-04-21T15:21:54.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:21:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:54 smithi170 ceph-mon[31212]: pgmap v9598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17825.401159 secs 2024-04-21T15:21:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:21:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:21:55.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:21:55.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:21:55.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:21:55.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:21:55.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:21:55.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:21:56.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:21:56.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:21:56.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:21:56.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:56 smithi077 ceph-mon[27902]: pgmap v9599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:56.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:56 smithi191 ceph-mon[31636]: pgmap v9599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:57.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:56 smithi170 ceph-mon[31212]: pgmap v9599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:21:57.876 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17828.639628 secs 2024-04-21T15:21:57.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17828.639628 secs 2024-04-21T15:21:57.964 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17828.639628 secs 2024-04-21T15:21:58.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:58 smithi077 ceph-mon[27902]: pgmap v9600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:58.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:58 smithi191 ceph-mon[31636]: pgmap v9600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:59.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:58 smithi170 ceph-mon[31212]: pgmap v9600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:21:59.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17830.401294 secs 2024-04-21T15:21:59.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17830.401294 secs 2024-04-21T15:22:00.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17830.401294 secs 2024-04-21T15:22:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:00.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:00 smithi077 ceph-mon[27902]: pgmap v9601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:00.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:00 smithi191 ceph-mon[31636]: pgmap v9601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:01.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:00 smithi170 ceph-mon[31212]: pgmap v9601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:02.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:02 smithi077 ceph-mon[27902]: pgmap v9602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:02.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17833.639796 secs 2024-04-21T15:22:02.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:02 smithi191 ceph-mon[31636]: pgmap v9602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:02.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17833.639796 secs 2024-04-21T15:22:03.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:02 smithi170 ceph-mon[31212]: pgmap v9602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:03.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17833.639796 secs 2024-04-21T15:22:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:04 smithi077 ceph-mon[27902]: pgmap v9603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17835.401413 secs 2024-04-21T15:22:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:04 smithi077 ceph-mon[27902]: osdmap e672: 12 total, 12 up, 12 in 2024-04-21T15:22:04.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:04 smithi191 ceph-mon[31636]: pgmap v9603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:04.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17835.401413 secs 2024-04-21T15:22:04.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:04 smithi191 ceph-mon[31636]: osdmap e672: 12 total, 12 up, 12 in 2024-04-21T15:22:05.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:04 smithi170 ceph-mon[31212]: pgmap v9603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:05.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17835.401413 secs 2024-04-21T15:22:05.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:04 smithi170 ceph-mon[31212]: osdmap e672: 12 total, 12 up, 12 in 2024-04-21T15:22:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:06.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:06 smithi077 ceph-mon[27902]: pgmap v9605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:06.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:06 smithi191 ceph-mon[31636]: pgmap v9605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:07.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:06 smithi170 ceph-mon[31212]: pgmap v9605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:07.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17838.639905 secs 2024-04-21T15:22:07.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17838.639905 secs 2024-04-21T15:22:08.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17838.639905 secs 2024-04-21T15:22:08.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:08 smithi077 ceph-mon[27902]: pgmap v9606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:08.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:08 smithi191 ceph-mon[31636]: pgmap v9606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:09.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:08 smithi170 ceph-mon[31212]: pgmap v9606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:09.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17840.401529 secs 2024-04-21T15:22:10.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17840.401529 secs 2024-04-21T15:22:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:10.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17840.401529 secs 2024-04-21T15:22:10.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:10 smithi191 ceph-mon[31636]: pgmap v9607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:10.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:10 smithi191 ceph-mon[31636]: osdmap e673: 12 total, 12 up, 12 in 2024-04-21T15:22:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:10 smithi170 ceph-mon[31212]: pgmap v9607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:10 smithi170 ceph-mon[31212]: osdmap e673: 12 total, 12 up, 12 in 2024-04-21T15:22:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:10 smithi077 ceph-mon[27902]: pgmap v9607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:22:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:10 smithi077 ceph-mon[27902]: osdmap e673: 12 total, 12 up, 12 in 2024-04-21T15:22:12.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:12 smithi191 ceph-mon[31636]: pgmap v9609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:22:12.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17843.639984 secs 2024-04-21T15:22:13.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:12 smithi170 ceph-mon[31212]: pgmap v9609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:22:13.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17843.639984 secs 2024-04-21T15:22:13.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:12 smithi077 ceph-mon[27902]: pgmap v9609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:22:13.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17843.639984 secs 2024-04-21T15:22:14.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:14 smithi191 ceph-mon[31636]: pgmap v9610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:22:14.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17845.401659 secs 2024-04-21T15:22:15.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:14 smithi170 ceph-mon[31212]: pgmap v9610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:22:15.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17845.401659 secs 2024-04-21T15:22:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:14 smithi077 ceph-mon[27902]: pgmap v9610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:22:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17845.401659 secs 2024-04-21T15:22:16.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:16 smithi191 ceph-mon[31636]: pgmap v9611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:17.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:16 smithi170 ceph-mon[31212]: pgmap v9611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:17.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:16 smithi077 ceph-mon[27902]: pgmap v9611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:17.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17848.640097 secs 2024-04-21T15:22:18.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17848.640097 secs 2024-04-21T15:22:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17848.640097 secs 2024-04-21T15:22:18.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:18 smithi191 ceph-mon[31636]: pgmap v9612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:19.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:18 smithi170 ceph-mon[31212]: pgmap v9612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:19.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:18 smithi077 ceph-mon[27902]: pgmap v9612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:19.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17850.401773 secs 2024-04-21T15:22:20.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17850.401773 secs 2024-04-21T15:22:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:20.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17850.401773 secs 2024-04-21T15:22:20.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:20 smithi191 ceph-mon[31636]: pgmap v9613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:21.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:20 smithi170 ceph-mon[31212]: pgmap v9613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:20 smithi077 ceph-mon[27902]: pgmap v9613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:22:22.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:22 smithi191 ceph-mon[31636]: pgmap v9614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:22:22.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17853.640239 secs 2024-04-21T15:22:23.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:22 smithi170 ceph-mon[31212]: pgmap v9614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:22:23.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17853.640239 secs 2024-04-21T15:22:23.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:22 smithi077 ceph-mon[27902]: pgmap v9614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:22:23.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17853.640239 secs 2024-04-21T15:22:24.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:24 smithi191 ceph-mon[31636]: pgmap v9615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:24.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17855.401892 secs 2024-04-21T15:22:25.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:24 smithi170 ceph-mon[31212]: pgmap v9615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:25.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17855.401892 secs 2024-04-21T15:22:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:25.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:24 smithi077 ceph-mon[27902]: pgmap v9615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:25.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17855.401892 secs 2024-04-21T15:22:26.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:26 smithi191 ceph-mon[31636]: pgmap v9616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:27.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:26 smithi170 ceph-mon[31212]: pgmap v9616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:27.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:26 smithi077 ceph-mon[27902]: pgmap v9616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:27.965 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17858.640376 secs 2024-04-21T15:22:27.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17858.640376 secs 2024-04-21T15:22:28.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17858.640376 secs 2024-04-21T15:22:28.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:28 smithi191 ceph-mon[31636]: pgmap v9617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:29.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:28 smithi170 ceph-mon[31212]: pgmap v9617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:29.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:28 smithi077 ceph-mon[27902]: pgmap v9617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:29.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17860.401944 secs 2024-04-21T15:22:30.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17860.401944 secs 2024-04-21T15:22:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:30.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17860.401944 secs 2024-04-21T15:22:30.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:30 smithi191 ceph-mon[31636]: pgmap v9618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:31.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:30 smithi170 ceph-mon[31212]: pgmap v9618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:31.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:30 smithi077 ceph-mon[27902]: pgmap v9618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:32.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:32 smithi191 ceph-mon[31636]: pgmap v9619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:32.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17863.640499 secs 2024-04-21T15:22:33.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:32 smithi170 ceph-mon[31212]: pgmap v9619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:33.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17863.640499 secs 2024-04-21T15:22:33.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:32 smithi077 ceph-mon[27902]: pgmap v9619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:33.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17863.640499 secs 2024-04-21T15:22:34.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:34 smithi191 ceph-mon[31636]: pgmap v9620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:34.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17865.402014 secs 2024-04-21T15:22:35.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:34 smithi170 ceph-mon[31212]: pgmap v9620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:35.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17865.402014 secs 2024-04-21T15:22:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:35.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:34 smithi077 ceph-mon[27902]: pgmap v9620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:35.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17865.402014 secs 2024-04-21T15:22:36.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:36 smithi191 ceph-mon[31636]: pgmap v9621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:37.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:36 smithi170 ceph-mon[31212]: pgmap v9621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:37.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:36 smithi077 ceph-mon[27902]: pgmap v9621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:37.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17868.640610 secs 2024-04-21T15:22:38.043 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17868.640610 secs 2024-04-21T15:22:38.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17868.640610 secs 2024-04-21T15:22:38.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:38 smithi191 ceph-mon[31636]: pgmap v9622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:39.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:38 smithi170 ceph-mon[31212]: pgmap v9622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:39.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:38 smithi077 ceph-mon[27902]: pgmap v9622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:39.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17870.402132 secs 2024-04-21T15:22:40.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17870.402132 secs 2024-04-21T15:22:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:40.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17870.402132 secs 2024-04-21T15:22:40.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:40 smithi191 ceph-mon[31636]: pgmap v9623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:41.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:40 smithi170 ceph-mon[31212]: pgmap v9623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:41.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:40 smithi077 ceph-mon[27902]: pgmap v9623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:43.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:42 smithi170 ceph-mon[31212]: pgmap v9624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:43.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17873.640770 secs 2024-04-21T15:22:43.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:42 smithi077 ceph-mon[27902]: pgmap v9624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:43.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17873.640770 secs 2024-04-21T15:22:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:42 smithi191 ceph-mon[31636]: pgmap v9624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17873.640770 secs 2024-04-21T15:22:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:44 smithi170 ceph-mon[31212]: pgmap v9625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:45.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17875.402256 secs 2024-04-21T15:22:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:45.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:44 smithi077 ceph-mon[27902]: pgmap v9625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:45.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17875.402256 secs 2024-04-21T15:22:45.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:44 smithi191 ceph-mon[31636]: pgmap v9625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:45.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17875.402256 secs 2024-04-21T15:22:47.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:46 smithi170 ceph-mon[31212]: pgmap v9626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:47.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:46 smithi077 ceph-mon[27902]: pgmap v9626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:47.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:46 smithi191 ceph-mon[31636]: pgmap v9626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:48.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17878.640884 secs 2024-04-21T15:22:48.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17878.640884 secs 2024-04-21T15:22:48.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17878.640884 secs 2024-04-21T15:22:49.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:48 smithi170 ceph-mon[31212]: pgmap v9627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:49.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:48 smithi077 ceph-mon[27902]: pgmap v9627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:49.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:48 smithi191 ceph-mon[31636]: pgmap v9627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:50.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17880.402378 secs 2024-04-21T15:22:50.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17880.402378 secs 2024-04-21T15:22:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17880.402378 secs 2024-04-21T15:22:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:50 smithi170 ceph-mon[31212]: pgmap v9628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:51.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:50 smithi077 ceph-mon[27902]: pgmap v9628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:51.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:50 smithi191 ceph-mon[31636]: pgmap v9628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:52 smithi170 ceph-mon[31212]: pgmap v9629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17883.641004 secs 2024-04-21T15:22:53.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:52 smithi077 ceph-mon[27902]: pgmap v9629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:53.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17883.641004 secs 2024-04-21T15:22:53.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:52 smithi191 ceph-mon[31636]: pgmap v9629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:53.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17883.641004 secs 2024-04-21T15:22:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:54 smithi170 ceph-mon[31212]: pgmap v9630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:55.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17885.402507 secs 2024-04-21T15:22:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:22:55.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:54 smithi077 ceph-mon[27902]: pgmap v9630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:55.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17885.402507 secs 2024-04-21T15:22:55.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:54 smithi191 ceph-mon[31636]: pgmap v9630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:55.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17885.402507 secs 2024-04-21T15:22:56.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:22:56.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:22:56.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:22:56.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:22:56.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:22:56.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:22:56.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:22:56.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:22:56.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:22:56.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:22:56.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:22:56.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:22:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:22:56.825+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:22:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:22:56.825+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:22:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:22:56.826+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:22:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:22:56.826+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:22:57.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:56 smithi170 ceph-mon[31212]: pgmap v9631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:57.126 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:56 smithi191 ceph-mon[31636]: pgmap v9631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:57.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:56 smithi077 ceph-mon[27902]: pgmap v9631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:22:58.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17888.641086 secs 2024-04-21T15:22:58.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17888.641086 secs 2024-04-21T15:22:58.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17888.641086 secs 2024-04-21T15:22:59.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:58 smithi170 ceph-mon[31212]: pgmap v9632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:59.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:58 smithi077 ceph-mon[27902]: pgmap v9632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:22:59.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:58 smithi191 ceph-mon[31636]: pgmap v9632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:00.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17890.402646 secs 2024-04-21T15:23:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:00.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17890.402646 secs 2024-04-21T15:23:00.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17890.402646 secs 2024-04-21T15:23:01.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:00 smithi170 ceph-mon[31212]: pgmap v9633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:01.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:00 smithi077 ceph-mon[27902]: pgmap v9633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:01.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:00 smithi191 ceph-mon[31636]: pgmap v9633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:03.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:02 smithi170 ceph-mon[31212]: pgmap v9634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:03.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17893.641150 secs 2024-04-21T15:23:03.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:02 smithi077 ceph-mon[27902]: pgmap v9634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:03.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17893.641150 secs 2024-04-21T15:23:03.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:02 smithi191 ceph-mon[31636]: pgmap v9634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:03.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17893.641150 secs 2024-04-21T15:23:05.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:04 smithi170 ceph-mon[31212]: pgmap v9635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:05.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17895.402764 secs 2024-04-21T15:23:05.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:04 smithi170 ceph-mon[31212]: osdmap e674: 12 total, 12 up, 12 in 2024-04-21T15:23:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:04 smithi077 ceph-mon[27902]: pgmap v9635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17895.402764 secs 2024-04-21T15:23:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:04 smithi077 ceph-mon[27902]: osdmap e674: 12 total, 12 up, 12 in 2024-04-21T15:23:05.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:04 smithi191 ceph-mon[31636]: pgmap v9635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:05.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17895.402764 secs 2024-04-21T15:23:05.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:04 smithi191 ceph-mon[31636]: osdmap e674: 12 total, 12 up, 12 in 2024-04-21T15:23:07.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:06 smithi170 ceph-mon[31212]: pgmap v9637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:07.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:06 smithi077 ceph-mon[27902]: pgmap v9637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:07.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:06 smithi191 ceph-mon[31636]: pgmap v9637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:08.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17898.641265 secs 2024-04-21T15:23:08.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17898.641265 secs 2024-04-21T15:23:08.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17898.641265 secs 2024-04-21T15:23:09.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:08 smithi170 ceph-mon[31212]: pgmap v9638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:09.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:08 smithi077 ceph-mon[27902]: pgmap v9638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:09.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:08 smithi191 ceph-mon[31636]: pgmap v9638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:10.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17900.402910 secs 2024-04-21T15:23:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:10.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17900.402910 secs 2024-04-21T15:23:10.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17900.402910 secs 2024-04-21T15:23:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:10 smithi170 ceph-mon[31212]: pgmap v9639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:10 smithi170 ceph-mon[31212]: osdmap e675: 12 total, 12 up, 12 in 2024-04-21T15:23:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:10 smithi077 ceph-mon[27902]: pgmap v9639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:10 smithi077 ceph-mon[27902]: osdmap e675: 12 total, 12 up, 12 in 2024-04-21T15:23:11.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:10 smithi191 ceph-mon[31636]: pgmap v9639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:23:11.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:10 smithi191 ceph-mon[31636]: osdmap e675: 12 total, 12 up, 12 in 2024-04-21T15:23:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:12 smithi170 ceph-mon[31212]: pgmap v9641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:23:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17903.641339 secs 2024-04-21T15:23:13.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:12 smithi077 ceph-mon[27902]: pgmap v9641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:23:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17903.641339 secs 2024-04-21T15:23:13.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:12 smithi191 ceph-mon[31636]: pgmap v9641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:23:13.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17903.641339 secs 2024-04-21T15:23:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:14 smithi077 ceph-mon[27902]: pgmap v9642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:23:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17905.403022 secs 2024-04-21T15:23:15.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:14 smithi191 ceph-mon[31636]: pgmap v9642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:23:15.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17905.403022 secs 2024-04-21T15:23:15.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:14 smithi170 ceph-mon[31212]: pgmap v9642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:23:15.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17905.403022 secs 2024-04-21T15:23:17.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:16 smithi077 ceph-mon[27902]: pgmap v9643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:16 smithi191 ceph-mon[31636]: pgmap v9643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:17.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:16 smithi170 ceph-mon[31212]: pgmap v9643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17908.641454 secs 2024-04-21T15:23:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17908.641454 secs 2024-04-21T15:23:18.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17908.641454 secs 2024-04-21T15:23:19.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:18 smithi077 ceph-mon[27902]: pgmap v9644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:19.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:18 smithi191 ceph-mon[31636]: pgmap v9644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:19.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:18 smithi170 ceph-mon[31212]: pgmap v9644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:20.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17910.403137 secs 2024-04-21T15:23:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17910.403137 secs 2024-04-21T15:23:20.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17910.403137 secs 2024-04-21T15:23:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:20 smithi077 ceph-mon[27902]: pgmap v9645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:20 smithi191 ceph-mon[31636]: pgmap v9645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:20 smithi170 ceph-mon[31212]: pgmap v9645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:23:23.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:22 smithi077 ceph-mon[27902]: pgmap v9646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:23:23.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17913.641596 secs 2024-04-21T15:23:23.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:22 smithi191 ceph-mon[31636]: pgmap v9646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:23:23.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17913.641596 secs 2024-04-21T15:23:23.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:22 smithi170 ceph-mon[31212]: pgmap v9646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:23:23.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17913.641596 secs 2024-04-21T15:23:24.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:23 smithi077 ceph-mon[27902]: pgmap v9647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:24.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17915.403260 secs 2024-04-21T15:23:24.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:23 smithi191 ceph-mon[31636]: pgmap v9647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:24.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17915.403260 secs 2024-04-21T15:23:24.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:23 smithi170 ceph-mon[31212]: pgmap v9647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:24.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17915.403260 secs 2024-04-21T15:23:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:26.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:26 smithi191 ceph-mon[31636]: pgmap v9648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:26.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:26 smithi170 ceph-mon[31212]: pgmap v9648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:26.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:26 smithi077 ceph-mon[27902]: pgmap v9648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:27.715 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17918.641711 secs 2024-04-21T15:23:27.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17918.641711 secs 2024-04-21T15:23:27.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17918.641711 secs 2024-04-21T15:23:28.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:28 smithi191 ceph-mon[31636]: pgmap v9649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:28.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:28 smithi170 ceph-mon[31212]: pgmap v9649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:28.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:28 smithi077 ceph-mon[27902]: pgmap v9649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:29.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17920.403384 secs 2024-04-21T15:23:29.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17920.403384 secs 2024-04-21T15:23:29.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17920.403384 secs 2024-04-21T15:23:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:30.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:30 smithi191 ceph-mon[31636]: pgmap v9650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:30.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:30 smithi170 ceph-mon[31212]: pgmap v9650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:30.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:30 smithi077 ceph-mon[27902]: pgmap v9650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:32.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:32 smithi191 ceph-mon[31636]: pgmap v9651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:32.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17923.641839 secs 2024-04-21T15:23:32.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:32 smithi170 ceph-mon[31212]: pgmap v9651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:32.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17923.641839 secs 2024-04-21T15:23:32.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:32 smithi077 ceph-mon[27902]: pgmap v9651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:32.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17923.641839 secs 2024-04-21T15:23:34.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:34 smithi191 ceph-mon[31636]: pgmap v9652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:34.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17925.403506 secs 2024-04-21T15:23:34.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:34 smithi170 ceph-mon[31212]: pgmap v9652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:34.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17925.403506 secs 2024-04-21T15:23:34.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:34 smithi077 ceph-mon[27902]: pgmap v9652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:34.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17925.403506 secs 2024-04-21T15:23:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:36.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:36 smithi191 ceph-mon[31636]: pgmap v9653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:36.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:36 smithi170 ceph-mon[31212]: pgmap v9653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:36.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:36 smithi077 ceph-mon[27902]: pgmap v9653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:37.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17928.641902 secs 2024-04-21T15:23:37.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17928.641902 secs 2024-04-21T15:23:37.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17928.641902 secs 2024-04-21T15:23:38.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:38 smithi191 ceph-mon[31636]: pgmap v9654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:38.794 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:38 smithi077 ceph-mon[27902]: pgmap v9654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:38.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:38 smithi170 ceph-mon[31212]: pgmap v9654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:39.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17930.403607 secs 2024-04-21T15:23:39.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17930.403607 secs 2024-04-21T15:23:39.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17930.403607 secs 2024-04-21T15:23:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:40 smithi191 ceph-mon[31636]: pgmap v9655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:40.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:40 smithi170 ceph-mon[31212]: pgmap v9655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:40.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:40 smithi077 ceph-mon[27902]: pgmap v9655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:42.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:42 smithi191 ceph-mon[31636]: pgmap v9656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:42.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17933.642025 secs 2024-04-21T15:23:42.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:42 smithi170 ceph-mon[31212]: pgmap v9656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:42.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17933.642025 secs 2024-04-21T15:23:42.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:42 smithi077 ceph-mon[27902]: pgmap v9656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:42.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17933.642025 secs 2024-04-21T15:23:44.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:44 smithi191 ceph-mon[31636]: pgmap v9657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:44.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17935.403746 secs 2024-04-21T15:23:44.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:44 smithi170 ceph-mon[31212]: pgmap v9657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:44.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17935.403746 secs 2024-04-21T15:23:44.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:44 smithi077 ceph-mon[27902]: pgmap v9657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:44.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17935.403746 secs 2024-04-21T15:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:46.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:46 smithi170 ceph-mon[31212]: pgmap v9658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:46.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:46 smithi077 ceph-mon[27902]: pgmap v9658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:46.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:46 smithi191 ceph-mon[31636]: pgmap v9658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:47.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17938.642155 secs 2024-04-21T15:23:47.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17938.642155 secs 2024-04-21T15:23:47.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17938.642155 secs 2024-04-21T15:23:48.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:48 smithi170 ceph-mon[31212]: pgmap v9659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:48.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:48 smithi077 ceph-mon[27902]: pgmap v9659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:48.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:48 smithi191 ceph-mon[31636]: pgmap v9659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:49.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17940.403882 secs 2024-04-21T15:23:49.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17940.403882 secs 2024-04-21T15:23:49.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17940.403882 secs 2024-04-21T15:23:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:50.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:50 smithi170 ceph-mon[31212]: pgmap v9660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:50.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:50 smithi077 ceph-mon[27902]: pgmap v9660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:50.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:50 smithi191 ceph-mon[31636]: pgmap v9660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:52.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:52 smithi170 ceph-mon[31212]: pgmap v9661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:52.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17943.642238 secs 2024-04-21T15:23:52.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:52 smithi077 ceph-mon[27902]: pgmap v9661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:52.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17943.642238 secs 2024-04-21T15:23:52.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:52 smithi191 ceph-mon[31636]: pgmap v9661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:52.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17943.642238 secs 2024-04-21T15:23:54.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:54 smithi170 ceph-mon[31212]: pgmap v9662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:54.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17945.403977 secs 2024-04-21T15:23:54.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:54 smithi077 ceph-mon[27902]: pgmap v9662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:54.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17945.403977 secs 2024-04-21T15:23:54.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:54 smithi191 ceph-mon[31636]: pgmap v9662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:54.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17945.403977 secs 2024-04-21T15:23:55.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:23:56.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:56 smithi170 ceph-mon[31212]: pgmap v9663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:56.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:23:56.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:56 smithi077 ceph-mon[27902]: pgmap v9663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:56.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:23:56.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:56 smithi191 ceph-mon[31636]: pgmap v9663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:23:56.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:23:57.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17948.642402 secs 2024-04-21T15:23:57.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17948.642402 secs 2024-04-21T15:23:57.877 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17948.642402 secs 2024-04-21T15:23:58.736 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:58 smithi077 ceph-mon[27902]: pgmap v9664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:58.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:58 smithi170 ceph-mon[31212]: pgmap v9664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:58.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:58 smithi191 ceph-mon[31636]: pgmap v9664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:23:59.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17950.404113 secs 2024-04-21T15:23:59.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17950.404113 secs 2024-04-21T15:23:59.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17950.404113 secs 2024-04-21T15:24:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:00.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:00 smithi170 ceph-mon[31212]: pgmap v9665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:00.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:24:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:24:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:00 smithi077 ceph-mon[27902]: pgmap v9665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:24:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:24:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:00 smithi191 ceph-mon[31636]: pgmap v9665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:24:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:24:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:24:02.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:02 smithi170 ceph-mon[31212]: pgmap v9666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T15:24:02.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17953.642524 secs 2024-04-21T15:24:02.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:02 smithi077 ceph-mon[27902]: pgmap v9666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T15:24:02.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17953.642524 secs 2024-04-21T15:24:02.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:02 smithi191 ceph-mon[31636]: pgmap v9666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T15:24:02.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17953.642524 secs 2024-04-21T15:24:04.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:04 smithi170 ceph-mon[31212]: pgmap v9667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T15:24:04.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17955.404210 secs 2024-04-21T15:24:04.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:04 smithi077 ceph-mon[27902]: pgmap v9667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T15:24:04.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17955.404210 secs 2024-04-21T15:24:04.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:04 smithi191 ceph-mon[31636]: pgmap v9667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T15:24:04.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17955.404210 secs 2024-04-21T15:24:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:05.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:05 smithi170 ceph-mon[31212]: osdmap e676: 12 total, 12 up, 12 in 2024-04-21T15:24:05.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:05 smithi077 ceph-mon[27902]: osdmap e676: 12 total, 12 up, 12 in 2024-04-21T15:24:05.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:05 smithi191 ceph-mon[31636]: osdmap e676: 12 total, 12 up, 12 in 2024-04-21T15:24:06.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:06 smithi170 ceph-mon[31212]: pgmap v9669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:06.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:06 smithi077 ceph-mon[27902]: pgmap v9669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:06.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:06 smithi191 ceph-mon[31636]: pgmap v9669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:07.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17958.642585 secs 2024-04-21T15:24:07.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17958.642585 secs 2024-04-21T15:24:07.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17958.642585 secs 2024-04-21T15:24:08.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:08 smithi170 ceph-mon[31212]: pgmap v9670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:08.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:08 smithi077 ceph-mon[27902]: pgmap v9670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:08.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:08 smithi191 ceph-mon[31636]: pgmap v9670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17960.404326 secs 2024-04-21T15:24:09.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17960.404326 secs 2024-04-21T15:24:09.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17960.404326 secs 2024-04-21T15:24:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:10.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:10 smithi170 ceph-mon[31212]: pgmap v9671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:10.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:10 smithi170 ceph-mon[31212]: osdmap e677: 12 total, 12 up, 12 in 2024-04-21T15:24:10.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:10 smithi077 ceph-mon[27902]: pgmap v9671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:10.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:10 smithi077 ceph-mon[27902]: osdmap e677: 12 total, 12 up, 12 in 2024-04-21T15:24:10.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:10 smithi191 ceph-mon[31636]: pgmap v9671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:24:10.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:10 smithi191 ceph-mon[31636]: osdmap e677: 12 total, 12 up, 12 in 2024-04-21T15:24:12.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:12 smithi170 ceph-mon[31212]: pgmap v9673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T15:24:12.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17963.642706 secs 2024-04-21T15:24:12.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:12 smithi077 ceph-mon[27902]: pgmap v9673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T15:24:12.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17963.642706 secs 2024-04-21T15:24:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:12 smithi191 ceph-mon[31636]: pgmap v9673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T15:24:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17963.642706 secs 2024-04-21T15:24:14.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:14 smithi170 ceph-mon[31212]: pgmap v9674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 347 B/s wr, 7 op/s 2024-04-21T15:24:14.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17965.404462 secs 2024-04-21T15:24:14.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:14 smithi077 ceph-mon[27902]: pgmap v9674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 347 B/s wr, 7 op/s 2024-04-21T15:24:14.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17965.404462 secs 2024-04-21T15:24:14.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:14 smithi191 ceph-mon[31636]: pgmap v9674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 347 B/s wr, 7 op/s 2024-04-21T15:24:14.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17965.404462 secs 2024-04-21T15:24:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:16.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:16 smithi077 ceph-mon[27902]: pgmap v9675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:16.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:16 smithi191 ceph-mon[31636]: pgmap v9675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:17.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:16 smithi170 ceph-mon[31212]: pgmap v9675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:17.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17968.642832 secs 2024-04-21T15:24:17.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17968.642832 secs 2024-04-21T15:24:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17968.642832 secs 2024-04-21T15:24:18.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:18 smithi077 ceph-mon[27902]: pgmap v9676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:18.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:18 smithi191 ceph-mon[31636]: pgmap v9676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:19.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:18 smithi170 ceph-mon[31212]: pgmap v9676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:19.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17970.404571 secs 2024-04-21T15:24:19.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17970.404571 secs 2024-04-21T15:24:20.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17970.404571 secs 2024-04-21T15:24:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:20.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:20 smithi077 ceph-mon[27902]: pgmap v9677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:20.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:20 smithi191 ceph-mon[31636]: pgmap v9677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:21.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:20 smithi170 ceph-mon[31212]: pgmap v9677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:24:22.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:22 smithi077 ceph-mon[27902]: pgmap v9678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:24:22.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17973.642955 secs 2024-04-21T15:24:22.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:22 smithi191 ceph-mon[31636]: pgmap v9678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:24:22.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17973.642955 secs 2024-04-21T15:24:23.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:22 smithi170 ceph-mon[31212]: pgmap v9678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:24:23.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17973.642955 secs 2024-04-21T15:24:24.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:24 smithi077 ceph-mon[27902]: pgmap v9679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:24.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17975.404686 secs 2024-04-21T15:24:24.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:24 smithi191 ceph-mon[31636]: pgmap v9679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:24.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17975.404686 secs 2024-04-21T15:24:25.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:24 smithi170 ceph-mon[31212]: pgmap v9679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:25.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17975.404686 secs 2024-04-21T15:24:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:26.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:26 smithi077 ceph-mon[27902]: pgmap v9680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:26.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:26 smithi191 ceph-mon[31636]: pgmap v9680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:27.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:26 smithi170 ceph-mon[31212]: pgmap v9680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:27.877 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17978.643015 secs 2024-04-21T15:24:27.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17978.643015 secs 2024-04-21T15:24:27.965 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17978.643015 secs 2024-04-21T15:24:28.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:28 smithi077 ceph-mon[27902]: pgmap v9681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:28.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:28 smithi191 ceph-mon[31636]: pgmap v9681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:29.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:28 smithi170 ceph-mon[31212]: pgmap v9681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:29.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17980.404823 secs 2024-04-21T15:24:29.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17980.404823 secs 2024-04-21T15:24:30.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17980.404823 secs 2024-04-21T15:24:30.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:30.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:30 smithi077 ceph-mon[27902]: pgmap v9682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:30.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:30 smithi191 ceph-mon[31636]: pgmap v9682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:31.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:30 smithi170 ceph-mon[31212]: pgmap v9682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:32.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:32 smithi077 ceph-mon[27902]: pgmap v9683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:32.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17983.643082 secs 2024-04-21T15:24:32.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:32 smithi191 ceph-mon[31636]: pgmap v9683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:32.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17983.643082 secs 2024-04-21T15:24:33.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:32 smithi170 ceph-mon[31212]: pgmap v9683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:33.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17983.643082 secs 2024-04-21T15:24:34.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:34 smithi077 ceph-mon[27902]: pgmap v9684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:34.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17985.404950 secs 2024-04-21T15:24:34.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:34 smithi191 ceph-mon[31636]: pgmap v9684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:34.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17985.404950 secs 2024-04-21T15:24:35.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:34 smithi170 ceph-mon[31212]: pgmap v9684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:35.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17985.404950 secs 2024-04-21T15:24:35.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:36.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:36 smithi077 ceph-mon[27902]: pgmap v9685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:36.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:36 smithi191 ceph-mon[31636]: pgmap v9685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:37.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:36 smithi170 ceph-mon[31212]: pgmap v9685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:37.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17988.643146 secs 2024-04-21T15:24:37.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17988.643146 secs 2024-04-21T15:24:38.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17988.643146 secs 2024-04-21T15:24:38.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:38 smithi077 ceph-mon[27902]: pgmap v9686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:38.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:38 smithi191 ceph-mon[31636]: pgmap v9686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:39.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:38 smithi170 ceph-mon[31212]: pgmap v9686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:39.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17990.405047 secs 2024-04-21T15:24:39.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17990.405047 secs 2024-04-21T15:24:40.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17990.405047 secs 2024-04-21T15:24:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:40.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:40 smithi077 ceph-mon[27902]: pgmap v9687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:40.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:40 smithi191 ceph-mon[31636]: pgmap v9687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:41.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:40 smithi170 ceph-mon[31212]: pgmap v9687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:42.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:42 smithi077 ceph-mon[27902]: pgmap v9688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:42.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17993.643299 secs 2024-04-21T15:24:42.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:42 smithi191 ceph-mon[31636]: pgmap v9688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:42.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17993.643299 secs 2024-04-21T15:24:43.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:42 smithi170 ceph-mon[31212]: pgmap v9688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17993.643299 secs 2024-04-21T15:24:44.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:44 smithi191 ceph-mon[31636]: pgmap v9689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:44.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 17995.405114 secs 2024-04-21T15:24:45.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:44 smithi170 ceph-mon[31212]: pgmap v9689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:45.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 17995.405114 secs 2024-04-21T15:24:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:45.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:44 smithi077 ceph-mon[27902]: pgmap v9689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:24:45.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 17995.405114 secs 2024-04-21T15:24:46.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:46 smithi191 ceph-mon[31636]: pgmap v9690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:47.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:46 smithi170 ceph-mon[31212]: pgmap v9690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:47.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:46 smithi077 ceph-mon[27902]: pgmap v9690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:47.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 17998.643458 secs 2024-04-21T15:24:48.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 17998.643458 secs 2024-04-21T15:24:48.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 17998.643458 secs 2024-04-21T15:24:48.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:48 smithi191 ceph-mon[31636]: pgmap v9691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:49.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:48 smithi170 ceph-mon[31212]: pgmap v9691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:49.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:48 smithi077 ceph-mon[27902]: pgmap v9691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:49.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18000.405240 secs 2024-04-21T15:24:50.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18000.405240 secs 2024-04-21T15:24:50.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18000.405240 secs 2024-04-21T15:24:50.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:50 smithi191 ceph-mon[31636]: pgmap v9692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:51.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:50 smithi170 ceph-mon[31212]: pgmap v9692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:51.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:50 smithi077 ceph-mon[27902]: pgmap v9692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:52.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:52 smithi191 ceph-mon[31636]: pgmap v9693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:52.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18003.643597 secs 2024-04-21T15:24:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:52 smithi170 ceph-mon[31212]: pgmap v9693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18003.643597 secs 2024-04-21T15:24:53.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:52 smithi077 ceph-mon[27902]: pgmap v9693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:53.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18003.643597 secs 2024-04-21T15:24:54.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:54 smithi191 ceph-mon[31636]: pgmap v9694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:54.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18005.405351 secs 2024-04-21T15:24:55.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:54 smithi170 ceph-mon[31212]: pgmap v9694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:55.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18005.405351 secs 2024-04-21T15:24:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:24:55.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:54 smithi077 ceph-mon[27902]: pgmap v9694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:55.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18005.405351 secs 2024-04-21T15:24:56.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:56 smithi191 ceph-mon[31636]: pgmap v9695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:57.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:56 smithi170 ceph-mon[31212]: pgmap v9695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:57.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:56 smithi077 ceph-mon[27902]: pgmap v9695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:24:57.966 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18008.643712 secs 2024-04-21T15:24:57.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18008.643712 secs 2024-04-21T15:24:58.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18008.643712 secs 2024-04-21T15:24:58.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:58 smithi191 ceph-mon[31636]: pgmap v9696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:59.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:58 smithi170 ceph-mon[31212]: pgmap v9696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:59.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:58 smithi077 ceph-mon[27902]: pgmap v9696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:24:59.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18010.405494 secs 2024-04-21T15:25:00.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18010.405494 secs 2024-04-21T15:25:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:00.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18010.405494 secs 2024-04-21T15:25:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:00 smithi191 ceph-mon[31636]: pgmap v9697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:00.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:25:01.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:00 smithi170 ceph-mon[31212]: pgmap v9697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:01.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:25:01.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:00 smithi077 ceph-mon[27902]: pgmap v9697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:01.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:25:02.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:02 smithi191 ceph-mon[31636]: pgmap v9698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T15:25:02.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18013.643825 secs 2024-04-21T15:25:02.998 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:02 smithi170 ceph-mon[31212]: pgmap v9698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T15:25:02.998 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18013.643825 secs 2024-04-21T15:25:03.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:02 smithi077 ceph-mon[27902]: pgmap v9698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T15:25:03.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18013.643825 secs 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: pgmap v9699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18015.405590 secs 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: osdmap e678: 12 total, 12 up, 12 in 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:25:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: pgmap v9699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18015.405590 secs 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: osdmap e678: 12 total, 12 up, 12 in 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:25:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: pgmap v9699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T15:25:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18015.405590 secs 2024-04-21T15:25:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: osdmap e678: 12 total, 12 up, 12 in 2024-04-21T15:25:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:25:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:25:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:25:06.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:06 smithi191 ceph-mon[31636]: pgmap v9701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:07.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:06 smithi170 ceph-mon[31212]: pgmap v9701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:07.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:06 smithi077 ceph-mon[27902]: pgmap v9701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:07.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18018.643940 secs 2024-04-21T15:25:08.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18018.643940 secs 2024-04-21T15:25:08.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18018.643940 secs 2024-04-21T15:25:08.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:08 smithi191 ceph-mon[31636]: pgmap v9702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:09.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:08 smithi170 ceph-mon[31212]: pgmap v9702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:09.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:08 smithi077 ceph-mon[27902]: pgmap v9702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:09.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18020.405716 secs 2024-04-21T15:25:10.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18020.405716 secs 2024-04-21T15:25:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:10.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18020.405716 secs 2024-04-21T15:25:10.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:10 smithi191 ceph-mon[31636]: pgmap v9703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:10.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:10 smithi191 ceph-mon[31636]: osdmap e679: 12 total, 12 up, 12 in 2024-04-21T15:25:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:10 smithi170 ceph-mon[31212]: pgmap v9703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:10 smithi170 ceph-mon[31212]: osdmap e679: 12 total, 12 up, 12 in 2024-04-21T15:25:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:10 smithi077 ceph-mon[27902]: pgmap v9703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:25:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:10 smithi077 ceph-mon[27902]: osdmap e679: 12 total, 12 up, 12 in 2024-04-21T15:25:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:12 smithi191 ceph-mon[31636]: pgmap v9705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 KiB/s wr, 28 op/s 2024-04-21T15:25:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18023.644053 secs 2024-04-21T15:25:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:12 smithi170 ceph-mon[31212]: pgmap v9705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 KiB/s wr, 28 op/s 2024-04-21T15:25:13.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18023.644053 secs 2024-04-21T15:25:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:12 smithi077 ceph-mon[27902]: pgmap v9705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 KiB/s wr, 28 op/s 2024-04-21T15:25:13.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18023.644053 secs 2024-04-21T15:25:14.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:14 smithi191 ceph-mon[31636]: pgmap v9706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:25:14.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18025.405846 secs 2024-04-21T15:25:15.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:14 smithi170 ceph-mon[31212]: pgmap v9706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:25:15.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18025.405846 secs 2024-04-21T15:25:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:15.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:14 smithi077 ceph-mon[27902]: pgmap v9706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:25:15.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18025.405846 secs 2024-04-21T15:25:16.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:16 smithi191 ceph-mon[31636]: pgmap v9707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:17.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:16 smithi170 ceph-mon[31212]: pgmap v9707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:16 smithi077 ceph-mon[27902]: pgmap v9707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:18.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18028.644180 secs 2024-04-21T15:25:18.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18028.644180 secs 2024-04-21T15:25:18.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18028.644180 secs 2024-04-21T15:25:19.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:18 smithi170 ceph-mon[31212]: pgmap v9708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:19.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:18 smithi077 ceph-mon[27902]: pgmap v9708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:19.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:18 smithi191 ceph-mon[31636]: pgmap v9708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:20.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18030.405919 secs 2024-04-21T15:25:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:20.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18030.405919 secs 2024-04-21T15:25:20.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18030.405919 secs 2024-04-21T15:25:21.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:20 smithi170 ceph-mon[31212]: pgmap v9709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:21.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:20 smithi077 ceph-mon[27902]: pgmap v9709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:21.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:20 smithi191 ceph-mon[31636]: pgmap v9709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:25:23.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:22 smithi170 ceph-mon[31212]: pgmap v9710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:25:23.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18033.644294 secs 2024-04-21T15:25:23.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:22 smithi077 ceph-mon[27902]: pgmap v9710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:25:23.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18033.644294 secs 2024-04-21T15:25:23.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:22 smithi191 ceph-mon[31636]: pgmap v9710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:25:23.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18033.644294 secs 2024-04-21T15:25:25.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:24 smithi170 ceph-mon[31212]: pgmap v9711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:25.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18035.406042 secs 2024-04-21T15:25:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:25.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:24 smithi077 ceph-mon[27902]: pgmap v9711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:25.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18035.406042 secs 2024-04-21T15:25:25.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:24 smithi191 ceph-mon[31636]: pgmap v9711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:25.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18035.406042 secs 2024-04-21T15:25:27.029 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:26 smithi191 ceph-mon[31636]: pgmap v9712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:27.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:26 smithi170 ceph-mon[31212]: pgmap v9712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:27.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:26 smithi077 ceph-mon[27902]: pgmap v9712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:28.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18038.644440 secs 2024-04-21T15:25:28.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18038.644440 secs 2024-04-21T15:25:28.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18038.644440 secs 2024-04-21T15:25:29.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:28 smithi170 ceph-mon[31212]: pgmap v9713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:29.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:28 smithi077 ceph-mon[27902]: pgmap v9713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:29.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:28 smithi191 ceph-mon[31636]: pgmap v9713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:30.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18040.406161 secs 2024-04-21T15:25:30.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:30.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18040.406161 secs 2024-04-21T15:25:30.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18040.406161 secs 2024-04-21T15:25:31.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:30 smithi170 ceph-mon[31212]: pgmap v9714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:31.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:30 smithi077 ceph-mon[27902]: pgmap v9714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:31.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:30 smithi191 ceph-mon[31636]: pgmap v9714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:33.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:32 smithi170 ceph-mon[31212]: pgmap v9715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:33.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18043.644537 secs 2024-04-21T15:25:33.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:32 smithi077 ceph-mon[27902]: pgmap v9715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:33.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18043.644537 secs 2024-04-21T15:25:33.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:32 smithi191 ceph-mon[31636]: pgmap v9715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:33.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18043.644537 secs 2024-04-21T15:25:35.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:34 smithi170 ceph-mon[31212]: pgmap v9716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:35.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18045.406284 secs 2024-04-21T15:25:35.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:35.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:34 smithi077 ceph-mon[27902]: pgmap v9716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:35.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18045.406284 secs 2024-04-21T15:25:35.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:34 smithi191 ceph-mon[31636]: pgmap v9716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:35.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18045.406284 secs 2024-04-21T15:25:37.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:36 smithi170 ceph-mon[31212]: pgmap v9717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:37.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:36 smithi077 ceph-mon[27902]: pgmap v9717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:37.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:36 smithi191 ceph-mon[31636]: pgmap v9717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:38.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18048.644618 secs 2024-04-21T15:25:38.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18048.644618 secs 2024-04-21T15:25:38.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18048.644618 secs 2024-04-21T15:25:39.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:38 smithi170 ceph-mon[31212]: pgmap v9718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:39.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:38 smithi077 ceph-mon[27902]: pgmap v9718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:39.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:38 smithi191 ceph-mon[31636]: pgmap v9718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:40.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18050.406432 secs 2024-04-21T15:25:40.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:40.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18050.406432 secs 2024-04-21T15:25:40.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18050.406432 secs 2024-04-21T15:25:41.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:40 smithi170 ceph-mon[31212]: pgmap v9719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:41.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:40 smithi077 ceph-mon[27902]: pgmap v9719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:41.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:40 smithi191 ceph-mon[31636]: pgmap v9719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:42 smithi170 ceph-mon[31212]: pgmap v9720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18053.644737 secs 2024-04-21T15:25:43.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:42 smithi077 ceph-mon[27902]: pgmap v9720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:43.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18053.644737 secs 2024-04-21T15:25:43.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:42 smithi191 ceph-mon[31636]: pgmap v9720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:43.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18053.644737 secs 2024-04-21T15:25:45.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:44 smithi170 ceph-mon[31212]: pgmap v9721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:45.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18055.406579 secs 2024-04-21T15:25:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:44 smithi077 ceph-mon[27902]: pgmap v9721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18055.406579 secs 2024-04-21T15:25:45.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:44 smithi191 ceph-mon[31636]: pgmap v9721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:45.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18055.406579 secs 2024-04-21T15:25:47.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:46 smithi170 ceph-mon[31212]: pgmap v9722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:47.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:46 smithi077 ceph-mon[27902]: pgmap v9722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:47.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:46 smithi191 ceph-mon[31636]: pgmap v9722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:48.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18058.644864 secs 2024-04-21T15:25:48.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18058.644864 secs 2024-04-21T15:25:48.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18058.644864 secs 2024-04-21T15:25:49.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:48 smithi170 ceph-mon[31212]: pgmap v9723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:49.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:48 smithi077 ceph-mon[27902]: pgmap v9723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:49.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:48 smithi191 ceph-mon[31636]: pgmap v9723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:50.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18060.406703 secs 2024-04-21T15:25:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18060.406703 secs 2024-04-21T15:25:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18060.406703 secs 2024-04-21T15:25:51.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:50 smithi077 ceph-mon[27902]: pgmap v9724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:51.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:50 smithi191 ceph-mon[31636]: pgmap v9724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:51.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:50 smithi170 ceph-mon[31212]: pgmap v9724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:53.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:52 smithi077 ceph-mon[27902]: pgmap v9725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:53.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18063.644929 secs 2024-04-21T15:25:53.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:52 smithi191 ceph-mon[31636]: pgmap v9725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:53.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18063.644929 secs 2024-04-21T15:25:53.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:52 smithi170 ceph-mon[31212]: pgmap v9725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:53.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18063.644929 secs 2024-04-21T15:25:55.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:25:55.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:54 smithi077 ceph-mon[27902]: pgmap v9726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:55.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18065.406796 secs 2024-04-21T15:25:55.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:54 smithi191 ceph-mon[31636]: pgmap v9726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:55.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18065.406796 secs 2024-04-21T15:25:55.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:54 smithi170 ceph-mon[31212]: pgmap v9726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:55.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18065.406796 secs 2024-04-21T15:25:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.850+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.850+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.850+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.850+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.850+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.850+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.851+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:25:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:25:56.851+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:25:57.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:56 smithi170 ceph-mon[31212]: pgmap v9727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:57.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:56 smithi077 ceph-mon[27902]: pgmap v9727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:57.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:56 smithi191 ceph-mon[31636]: pgmap v9727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:25:58.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18068.645037 secs 2024-04-21T15:25:58.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18068.645037 secs 2024-04-21T15:25:58.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18068.645037 secs 2024-04-21T15:25:59.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:58 smithi077 ceph-mon[27902]: pgmap v9728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:59.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:58 smithi191 ceph-mon[31636]: pgmap v9728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:25:59.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:58 smithi170 ceph-mon[31212]: pgmap v9728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:00.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18070.406896 secs 2024-04-21T15:26:00.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18070.406896 secs 2024-04-21T15:26:00.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18070.406896 secs 2024-04-21T15:26:01.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:00 smithi077 ceph-mon[27902]: pgmap v9729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:01.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:00 smithi191 ceph-mon[31636]: pgmap v9729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:01.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:00 smithi170 ceph-mon[31212]: pgmap v9729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:03.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:02 smithi077 ceph-mon[27902]: pgmap v9730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:03.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18073.645188 secs 2024-04-21T15:26:03.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:02 smithi191 ceph-mon[31636]: pgmap v9730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:03.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18073.645188 secs 2024-04-21T15:26:03.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:02 smithi170 ceph-mon[31212]: pgmap v9730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:03.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18073.645188 secs 2024-04-21T15:26:05.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:04 smithi077 ceph-mon[27902]: pgmap v9731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18075.407029 secs 2024-04-21T15:26:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:04 smithi077 ceph-mon[27902]: osdmap e680: 12 total, 12 up, 12 in 2024-04-21T15:26:05.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:04 smithi191 ceph-mon[31636]: pgmap v9731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:05.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18075.407029 secs 2024-04-21T15:26:05.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:04 smithi191 ceph-mon[31636]: osdmap e680: 12 total, 12 up, 12 in 2024-04-21T15:26:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:04 smithi170 ceph-mon[31212]: pgmap v9731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18075.407029 secs 2024-04-21T15:26:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:04 smithi170 ceph-mon[31212]: osdmap e680: 12 total, 12 up, 12 in 2024-04-21T15:26:06.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:26:06.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:26:06.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:26:06.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:26:06.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:26:06.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:26:06.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:26:06.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:26:06.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:26:06.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:26:06.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:26:06.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:26:07.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:06 smithi077 ceph-mon[27902]: pgmap v9733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:07.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:06 smithi191 ceph-mon[31636]: pgmap v9733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:07.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:06 smithi170 ceph-mon[31212]: pgmap v9733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:08.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18078.645306 secs 2024-04-21T15:26:08.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18078.645306 secs 2024-04-21T15:26:08.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18078.645306 secs 2024-04-21T15:26:09.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:08 smithi077 ceph-mon[27902]: pgmap v9734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:09.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:08 smithi191 ceph-mon[31636]: pgmap v9734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:09.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:08 smithi170 ceph-mon[31212]: pgmap v9734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:10.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:10.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18080.407152 secs 2024-04-21T15:26:10.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18080.407152 secs 2024-04-21T15:26:10.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18080.407152 secs 2024-04-21T15:26:11.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:10 smithi077 ceph-mon[27902]: pgmap v9735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:11.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:10 smithi077 ceph-mon[27902]: osdmap e681: 12 total, 12 up, 12 in 2024-04-21T15:26:11.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:10 smithi191 ceph-mon[31636]: pgmap v9735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:11.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:10 smithi191 ceph-mon[31636]: osdmap e681: 12 total, 12 up, 12 in 2024-04-21T15:26:11.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:10 smithi170 ceph-mon[31212]: pgmap v9735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:26:11.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:10 smithi170 ceph-mon[31212]: osdmap e681: 12 total, 12 up, 12 in 2024-04-21T15:26:12.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:11 smithi077 ceph-mon[27902]: pgmap v9737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:26:12.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:11 smithi191 ceph-mon[31636]: pgmap v9737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:26:12.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:11 smithi170 ceph-mon[31212]: pgmap v9737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:26:13.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18083.645424 secs 2024-04-21T15:26:13.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18083.645424 secs 2024-04-21T15:26:13.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18083.645424 secs 2024-04-21T15:26:14.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:13 smithi077 ceph-mon[27902]: pgmap v9738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:26:14.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18085.407274 secs 2024-04-21T15:26:14.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:13 smithi191 ceph-mon[31636]: pgmap v9738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:26:14.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18085.407274 secs 2024-04-21T15:26:14.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:13 smithi170 ceph-mon[31212]: pgmap v9738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:26:14.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18085.407274 secs 2024-04-21T15:26:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:16.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:16 smithi191 ceph-mon[31636]: pgmap v9739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:16.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:16 smithi170 ceph-mon[31212]: pgmap v9739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:16.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:16 smithi077 ceph-mon[27902]: pgmap v9739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:17.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18088.645533 secs 2024-04-21T15:26:17.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18088.645533 secs 2024-04-21T15:26:17.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18088.645533 secs 2024-04-21T15:26:18.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:18 smithi191 ceph-mon[31636]: pgmap v9740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:18.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:18 smithi170 ceph-mon[31212]: pgmap v9740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:18.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:18 smithi077 ceph-mon[27902]: pgmap v9740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:19.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18090.407397 secs 2024-04-21T15:26:19.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18090.407397 secs 2024-04-21T15:26:19.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18090.407397 secs 2024-04-21T15:26:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:20.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:20 smithi170 ceph-mon[31212]: pgmap v9741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:20.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:20 smithi077 ceph-mon[27902]: pgmap v9741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:20.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:20 smithi191 ceph-mon[31636]: pgmap v9741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:26:22.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:22 smithi170 ceph-mon[31212]: pgmap v9742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:26:22.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18093.645655 secs 2024-04-21T15:26:22.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:22 smithi077 ceph-mon[27902]: pgmap v9742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:26:22.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18093.645655 secs 2024-04-21T15:26:22.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:22 smithi191 ceph-mon[31636]: pgmap v9742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:26:22.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18093.645655 secs 2024-04-21T15:26:24.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:24 smithi170 ceph-mon[31212]: pgmap v9743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:24.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18095.407553 secs 2024-04-21T15:26:24.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:24 smithi077 ceph-mon[27902]: pgmap v9743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:24.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18095.407553 secs 2024-04-21T15:26:24.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:24 smithi191 ceph-mon[31636]: pgmap v9743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:24.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18095.407553 secs 2024-04-21T15:26:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:26.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:26 smithi170 ceph-mon[31212]: pgmap v9744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:26.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:26 smithi077 ceph-mon[27902]: pgmap v9744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:26.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:26 smithi191 ceph-mon[31636]: pgmap v9744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:27.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18098.645775 secs 2024-04-21T15:26:27.878 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18098.645775 secs 2024-04-21T15:26:27.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18098.645775 secs 2024-04-21T15:26:28.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:28 smithi170 ceph-mon[31212]: pgmap v9745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:28.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:28 smithi077 ceph-mon[27902]: pgmap v9745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:28.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:28 smithi191 ceph-mon[31636]: pgmap v9745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:29.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18100.407701 secs 2024-04-21T15:26:29.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18100.407701 secs 2024-04-21T15:26:29.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18100.407701 secs 2024-04-21T15:26:30.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:30.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:30 smithi170 ceph-mon[31212]: pgmap v9746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:30.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:30 smithi077 ceph-mon[27902]: pgmap v9746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:30.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:30 smithi191 ceph-mon[31636]: pgmap v9746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:32.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:32 smithi170 ceph-mon[31212]: pgmap v9747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:32.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18103.645847 secs 2024-04-21T15:26:32.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:32 smithi077 ceph-mon[27902]: pgmap v9747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:32.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18103.645847 secs 2024-04-21T15:26:32.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:32 smithi191 ceph-mon[31636]: pgmap v9747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:32.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18103.645847 secs 2024-04-21T15:26:34.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:34 smithi170 ceph-mon[31212]: pgmap v9748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:34.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18105.407824 secs 2024-04-21T15:26:34.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:34 smithi077 ceph-mon[27902]: pgmap v9748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:34.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18105.407824 secs 2024-04-21T15:26:34.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:34 smithi191 ceph-mon[31636]: pgmap v9748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:34.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18105.407824 secs 2024-04-21T15:26:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:36.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:36 smithi170 ceph-mon[31212]: pgmap v9749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:36.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:36 smithi077 ceph-mon[27902]: pgmap v9749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:36.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:36 smithi191 ceph-mon[31636]: pgmap v9749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:37.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18108.645956 secs 2024-04-21T15:26:37.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18108.645956 secs 2024-04-21T15:26:37.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18108.645956 secs 2024-04-21T15:26:38.795 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:38 smithi077 ceph-mon[27902]: pgmap v9750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:38.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:38 smithi170 ceph-mon[31212]: pgmap v9750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:38.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:38 smithi191 ceph-mon[31636]: pgmap v9750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:39.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18110.407966 secs 2024-04-21T15:26:39.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18110.407966 secs 2024-04-21T15:26:39.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18110.407966 secs 2024-04-21T15:26:40.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:40.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:40 smithi170 ceph-mon[31212]: pgmap v9751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:40.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:40 smithi077 ceph-mon[27902]: pgmap v9751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:40.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:40 smithi191 ceph-mon[31636]: pgmap v9751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:42.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:42 smithi170 ceph-mon[31212]: pgmap v9752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:42.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18113.646039 secs 2024-04-21T15:26:42.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:42 smithi077 ceph-mon[27902]: pgmap v9752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:42.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18113.646039 secs 2024-04-21T15:26:42.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:42 smithi191 ceph-mon[31636]: pgmap v9752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:42.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18113.646039 secs 2024-04-21T15:26:44.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:44 smithi170 ceph-mon[31212]: pgmap v9753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:44.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18115.408094 secs 2024-04-21T15:26:44.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:44 smithi077 ceph-mon[27902]: pgmap v9753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:44.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18115.408094 secs 2024-04-21T15:26:44.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:44 smithi191 ceph-mon[31636]: pgmap v9753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:44.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18115.408094 secs 2024-04-21T15:26:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:46.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:46 smithi170 ceph-mon[31212]: pgmap v9754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:46.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:46 smithi077 ceph-mon[27902]: pgmap v9754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:46.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:46 smithi191 ceph-mon[31636]: pgmap v9754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:47.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18118.646174 secs 2024-04-21T15:26:47.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18118.646174 secs 2024-04-21T15:26:47.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18118.646174 secs 2024-04-21T15:26:48.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:48 smithi170 ceph-mon[31212]: pgmap v9755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:48.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:48 smithi077 ceph-mon[27902]: pgmap v9755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:48.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:48 smithi191 ceph-mon[31636]: pgmap v9755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:49.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18120.408162 secs 2024-04-21T15:26:49.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18120.408162 secs 2024-04-21T15:26:49.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18120.408162 secs 2024-04-21T15:26:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:50.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:50 smithi170 ceph-mon[31212]: pgmap v9756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:50.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:50 smithi077 ceph-mon[27902]: pgmap v9756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:50.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:50 smithi191 ceph-mon[31636]: pgmap v9756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:52.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:52 smithi170 ceph-mon[31212]: pgmap v9757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:52.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18123.646290 secs 2024-04-21T15:26:52.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:52 smithi077 ceph-mon[27902]: pgmap v9757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:52.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18123.646290 secs 2024-04-21T15:26:52.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:52 smithi191 ceph-mon[31636]: pgmap v9757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:52.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18123.646290 secs 2024-04-21T15:26:54.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:54 smithi170 ceph-mon[31212]: pgmap v9758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:54.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18125.408287 secs 2024-04-21T15:26:54.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:54 smithi077 ceph-mon[27902]: pgmap v9758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:54.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18125.408287 secs 2024-04-21T15:26:54.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:54 smithi191 ceph-mon[31636]: pgmap v9758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:54.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18125.408287 secs 2024-04-21T15:26:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:26:56.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:56 smithi170 ceph-mon[31212]: pgmap v9759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:56.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:56 smithi077 ceph-mon[27902]: pgmap v9759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:56.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:56 smithi191 ceph-mon[31636]: pgmap v9759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:26:57.879 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18128.646387 secs 2024-04-21T15:26:57.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18128.646387 secs 2024-04-21T15:26:58.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18128.646387 secs 2024-04-21T15:26:58.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:58 smithi077 ceph-mon[27902]: pgmap v9760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:58.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:58 smithi191 ceph-mon[31636]: pgmap v9760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:59.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:58 smithi170 ceph-mon[31212]: pgmap v9760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:26:59.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18130.408409 secs 2024-04-21T15:26:59.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18130.408409 secs 2024-04-21T15:27:00.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18130.408409 secs 2024-04-21T15:27:00.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:00.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:00 smithi077 ceph-mon[27902]: pgmap v9761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:00.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:00 smithi191 ceph-mon[31636]: pgmap v9761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:01.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:00 smithi170 ceph-mon[31212]: pgmap v9761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:02.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:02 smithi077 ceph-mon[27902]: pgmap v9762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:02.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18133.646505 secs 2024-04-21T15:27:02.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:02 smithi191 ceph-mon[31636]: pgmap v9762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:02.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18133.646505 secs 2024-04-21T15:27:03.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:02 smithi170 ceph-mon[31212]: pgmap v9762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:03.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18133.646505 secs 2024-04-21T15:27:04.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:04 smithi077 ceph-mon[27902]: pgmap v9763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:04.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18135.408557 secs 2024-04-21T15:27:04.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:04 smithi077 ceph-mon[27902]: osdmap e682: 12 total, 12 up, 12 in 2024-04-21T15:27:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:04 smithi191 ceph-mon[31636]: pgmap v9763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18135.408557 secs 2024-04-21T15:27:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:04 smithi191 ceph-mon[31636]: osdmap e682: 12 total, 12 up, 12 in 2024-04-21T15:27:05.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:04 smithi170 ceph-mon[31212]: pgmap v9763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:05.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18135.408557 secs 2024-04-21T15:27:05.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:04 smithi170 ceph-mon[31212]: osdmap e682: 12 total, 12 up, 12 in 2024-04-21T15:27:05.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:06.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:06 smithi077 ceph-mon[27902]: pgmap v9765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:06.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:27:06.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:27:06.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:27:06.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:27:06.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:06 smithi191 ceph-mon[31636]: pgmap v9765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:06.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:27:06.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:27:06.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:27:06.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:27:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:06 smithi170 ceph-mon[31212]: pgmap v9765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:27:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:27:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:27:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:27:07.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18138.646627 secs 2024-04-21T15:27:07.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18138.646627 secs 2024-04-21T15:27:08.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18138.646627 secs 2024-04-21T15:27:08.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:08 smithi077 ceph-mon[27902]: pgmap v9766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:08.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:08 smithi191 ceph-mon[31636]: pgmap v9766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:09.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:08 smithi170 ceph-mon[31212]: pgmap v9766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:09.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18140.408662 secs 2024-04-21T15:27:09.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18140.408662 secs 2024-04-21T15:27:10.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18140.408662 secs 2024-04-21T15:27:10.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:10.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:10 smithi077 ceph-mon[27902]: pgmap v9767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:10.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:10 smithi077 ceph-mon[27902]: osdmap e683: 12 total, 12 up, 12 in 2024-04-21T15:27:10.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:10 smithi191 ceph-mon[31636]: pgmap v9767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:10.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:10 smithi191 ceph-mon[31636]: osdmap e683: 12 total, 12 up, 12 in 2024-04-21T15:27:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:10 smithi170 ceph-mon[31212]: pgmap v9767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:27:11.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:10 smithi170 ceph-mon[31212]: osdmap e683: 12 total, 12 up, 12 in 2024-04-21T15:27:12.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:12 smithi077 ceph-mon[27902]: pgmap v9769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:27:12.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18143.646779 secs 2024-04-21T15:27:12.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:12 smithi191 ceph-mon[31636]: pgmap v9769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:27:12.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18143.646779 secs 2024-04-21T15:27:13.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:12 smithi170 ceph-mon[31212]: pgmap v9769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:27:13.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18143.646779 secs 2024-04-21T15:27:14.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:14 smithi077 ceph-mon[27902]: pgmap v9770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:27:14.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18145.408778 secs 2024-04-21T15:27:14.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:14 smithi191 ceph-mon[31636]: pgmap v9770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:27:14.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18145.408778 secs 2024-04-21T15:27:15.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:14 smithi170 ceph-mon[31212]: pgmap v9770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:27:15.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18145.408778 secs 2024-04-21T15:27:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:16.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:16 smithi077 ceph-mon[27902]: pgmap v9771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:16.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:16 smithi191 ceph-mon[31636]: pgmap v9771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:17.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:16 smithi170 ceph-mon[31212]: pgmap v9771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:17.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18148.646903 secs 2024-04-21T15:27:17.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18148.646903 secs 2024-04-21T15:27:18.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18148.646903 secs 2024-04-21T15:27:18.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:18 smithi077 ceph-mon[27902]: pgmap v9772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:18.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:18 smithi191 ceph-mon[31636]: pgmap v9772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:19.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:18 smithi170 ceph-mon[31212]: pgmap v9772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:19.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18150.408891 secs 2024-04-21T15:27:19.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18150.408891 secs 2024-04-21T15:27:20.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18150.408891 secs 2024-04-21T15:27:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:20.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:20 smithi077 ceph-mon[27902]: pgmap v9773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:20.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:20 smithi191 ceph-mon[31636]: pgmap v9773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:21.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:20 smithi170 ceph-mon[31212]: pgmap v9773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:27:22.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:22 smithi077 ceph-mon[27902]: pgmap v9774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:27:22.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18153.647018 secs 2024-04-21T15:27:22.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:22 smithi191 ceph-mon[31636]: pgmap v9774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:27:22.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18153.647018 secs 2024-04-21T15:27:23.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:22 smithi170 ceph-mon[31212]: pgmap v9774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:27:23.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18153.647018 secs 2024-04-21T15:27:24.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:24 smithi077 ceph-mon[27902]: pgmap v9775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:24.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18155.409009 secs 2024-04-21T15:27:24.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:24 smithi191 ceph-mon[31636]: pgmap v9775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:24.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18155.409009 secs 2024-04-21T15:27:25.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:24 smithi170 ceph-mon[31212]: pgmap v9775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:25.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18155.409009 secs 2024-04-21T15:27:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:26.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:26 smithi191 ceph-mon[31636]: pgmap v9776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:27.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:26 smithi170 ceph-mon[31212]: pgmap v9776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:27.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:26 smithi077 ceph-mon[27902]: pgmap v9776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:27.967 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18158.647131 secs 2024-04-21T15:27:27.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18158.647131 secs 2024-04-21T15:27:28.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18158.647131 secs 2024-04-21T15:27:28.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:28 smithi191 ceph-mon[31636]: pgmap v9777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:29.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:28 smithi170 ceph-mon[31212]: pgmap v9777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:29.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:28 smithi077 ceph-mon[27902]: pgmap v9777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:29.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18160.409104 secs 2024-04-21T15:27:30.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18160.409104 secs 2024-04-21T15:27:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:30.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18160.409104 secs 2024-04-21T15:27:30.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:30 smithi191 ceph-mon[31636]: pgmap v9778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:31.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:30 smithi170 ceph-mon[31212]: pgmap v9778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:31.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:30 smithi077 ceph-mon[27902]: pgmap v9778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:32.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:32 smithi191 ceph-mon[31636]: pgmap v9779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:32.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18163.647246 secs 2024-04-21T15:27:33.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:32 smithi170 ceph-mon[31212]: pgmap v9779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:33.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18163.647246 secs 2024-04-21T15:27:33.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:32 smithi077 ceph-mon[27902]: pgmap v9779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:33.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18163.647246 secs 2024-04-21T15:27:34.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:34 smithi191 ceph-mon[31636]: pgmap v9780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:34.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18165.409223 secs 2024-04-21T15:27:35.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:34 smithi170 ceph-mon[31212]: pgmap v9780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:35.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18165.409223 secs 2024-04-21T15:27:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:35.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:34 smithi077 ceph-mon[27902]: pgmap v9780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:35.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18165.409223 secs 2024-04-21T15:27:36.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:36 smithi191 ceph-mon[31636]: pgmap v9781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:37.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:36 smithi170 ceph-mon[31212]: pgmap v9781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:37.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:36 smithi077 ceph-mon[27902]: pgmap v9781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:37.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18168.647359 secs 2024-04-21T15:27:38.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18168.647359 secs 2024-04-21T15:27:38.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18168.647359 secs 2024-04-21T15:27:38.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:38 smithi191 ceph-mon[31636]: pgmap v9782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:39.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:38 smithi170 ceph-mon[31212]: pgmap v9782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:39.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:38 smithi077 ceph-mon[27902]: pgmap v9782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:39.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18170.409354 secs 2024-04-21T15:27:40.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18170.409354 secs 2024-04-21T15:27:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:40.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18170.409354 secs 2024-04-21T15:27:40.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:40 smithi191 ceph-mon[31636]: pgmap v9783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:41.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:40 smithi170 ceph-mon[31212]: pgmap v9783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:41.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:40 smithi077 ceph-mon[27902]: pgmap v9783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:42.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:42 smithi191 ceph-mon[31636]: pgmap v9784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:42.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18173.647494 secs 2024-04-21T15:27:43.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:42 smithi170 ceph-mon[31212]: pgmap v9784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:43.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18173.647494 secs 2024-04-21T15:27:43.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:42 smithi077 ceph-mon[27902]: pgmap v9784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:43.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18173.647494 secs 2024-04-21T15:27:44.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:44 smithi191 ceph-mon[31636]: pgmap v9785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:44.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18175.409490 secs 2024-04-21T15:27:45.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:44 smithi170 ceph-mon[31212]: pgmap v9785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:45.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18175.409490 secs 2024-04-21T15:27:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:44 smithi077 ceph-mon[27902]: pgmap v9785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:45.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18175.409490 secs 2024-04-21T15:27:46.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:46 smithi191 ceph-mon[31636]: pgmap v9786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:47.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:46 smithi170 ceph-mon[31212]: pgmap v9786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:47.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:46 smithi077 ceph-mon[27902]: pgmap v9786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:47.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18178.647616 secs 2024-04-21T15:27:48.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18178.647616 secs 2024-04-21T15:27:48.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18178.647616 secs 2024-04-21T15:27:48.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:48 smithi191 ceph-mon[31636]: pgmap v9787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:49.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:48 smithi170 ceph-mon[31212]: pgmap v9787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:49.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:48 smithi077 ceph-mon[27902]: pgmap v9787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:49.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18180.409621 secs 2024-04-21T15:27:50.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18180.409621 secs 2024-04-21T15:27:50.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:50.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18180.409621 secs 2024-04-21T15:27:50.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:50 smithi191 ceph-mon[31636]: pgmap v9788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:51.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:50 smithi170 ceph-mon[31212]: pgmap v9788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:51.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:50 smithi077 ceph-mon[27902]: pgmap v9788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:52.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:52 smithi191 ceph-mon[31636]: pgmap v9789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:52.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18183.647710 secs 2024-04-21T15:27:53.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:52 smithi170 ceph-mon[31212]: pgmap v9789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:53.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18183.647710 secs 2024-04-21T15:27:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:52 smithi077 ceph-mon[27902]: pgmap v9789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18183.647710 secs 2024-04-21T15:27:54.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:54 smithi191 ceph-mon[31636]: pgmap v9790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:54.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18185.409739 secs 2024-04-21T15:27:55.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:54 smithi170 ceph-mon[31212]: pgmap v9790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:55.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18185.409739 secs 2024-04-21T15:27:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:27:55.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:54 smithi077 ceph-mon[27902]: pgmap v9790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:55.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18185.409739 secs 2024-04-21T15:27:56.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:56 smithi191 ceph-mon[31636]: pgmap v9791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:57.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:56 smithi170 ceph-mon[31212]: pgmap v9791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:57.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:56 smithi077 ceph-mon[27902]: pgmap v9791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:27:58.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18188.647854 secs 2024-04-21T15:27:58.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18188.647854 secs 2024-04-21T15:27:58.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18188.647854 secs 2024-04-21T15:27:59.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:58 smithi170 ceph-mon[31212]: pgmap v9792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:59.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:58 smithi077 ceph-mon[27902]: pgmap v9792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:27:59.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:58 smithi191 ceph-mon[31636]: pgmap v9792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:00.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18190.409887 secs 2024-04-21T15:28:00.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:00.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18190.409887 secs 2024-04-21T15:28:00.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18190.409887 secs 2024-04-21T15:28:01.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:00 smithi170 ceph-mon[31212]: pgmap v9793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:01.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:00 smithi077 ceph-mon[27902]: pgmap v9793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:01.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:00 smithi191 ceph-mon[31636]: pgmap v9793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:03.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:02 smithi170 ceph-mon[31212]: pgmap v9794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:03.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18193.647983 secs 2024-04-21T15:28:03.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:02 smithi077 ceph-mon[27902]: pgmap v9794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:03.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18193.647983 secs 2024-04-21T15:28:03.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:02 smithi191 ceph-mon[31636]: pgmap v9794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:03.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18193.647983 secs 2024-04-21T15:28:05.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:04 smithi170 ceph-mon[31212]: pgmap v9795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:05.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18195.409938 secs 2024-04-21T15:28:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:04 smithi170 ceph-mon[31212]: osdmap e684: 12 total, 12 up, 12 in 2024-04-21T15:28:05.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:04 smithi077 ceph-mon[27902]: pgmap v9795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18195.409938 secs 2024-04-21T15:28:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:04 smithi077 ceph-mon[27902]: osdmap e684: 12 total, 12 up, 12 in 2024-04-21T15:28:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:04 smithi191 ceph-mon[31636]: pgmap v9795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18195.409938 secs 2024-04-21T15:28:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:04 smithi191 ceph-mon[31636]: osdmap e684: 12 total, 12 up, 12 in 2024-04-21T15:28:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:06 smithi170 ceph-mon[31212]: pgmap v9797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:07.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:28:07.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:06 smithi077 ceph-mon[27902]: pgmap v9797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:07.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:28:07.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:06 smithi191 ceph-mon[31636]: pgmap v9797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:07.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:28:08.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18198.648045 secs 2024-04-21T15:28:08.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18198.648045 secs 2024-04-21T15:28:08.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18198.648045 secs 2024-04-21T15:28:09.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: pgmap v9798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:09.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: pgmap v9798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: pgmap v9798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18200.410004 secs 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:28:10.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18200.410004 secs 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:28:10.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:28:10.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18200.410004 secs 2024-04-21T15:28:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:28:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:28:10.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:28:10.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:28:11.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:28:11.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:28:11.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:28:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:28:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: pgmap v9799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:28:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:28:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:10 smithi170 ceph-mon[31212]: osdmap e685: 12 total, 12 up, 12 in 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: pgmap v9799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:28:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:10 smithi077 ceph-mon[27902]: osdmap e685: 12 total, 12 up, 12 in 2024-04-21T15:28:11.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:28:11.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:28:11.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:28:11.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:28:11.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: pgmap v9799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:28:11.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:28:11.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:28:11.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:10 smithi191 ceph-mon[31636]: osdmap e685: 12 total, 12 up, 12 in 2024-04-21T15:28:13.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:12 smithi170 ceph-mon[31212]: pgmap v9801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:28:13.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18203.648128 secs 2024-04-21T15:28:13.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:12 smithi077 ceph-mon[27902]: pgmap v9801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:28:13.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18203.648128 secs 2024-04-21T15:28:13.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:12 smithi191 ceph-mon[31636]: pgmap v9801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:28:13.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18203.648128 secs 2024-04-21T15:28:15.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:14 smithi170 ceph-mon[31212]: pgmap v9802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:28:15.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18205.410113 secs 2024-04-21T15:28:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:15.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:14 smithi077 ceph-mon[27902]: pgmap v9802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:28:15.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18205.410113 secs 2024-04-21T15:28:15.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:14 smithi191 ceph-mon[31636]: pgmap v9802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:28:15.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18205.410113 secs 2024-04-21T15:28:17.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:16 smithi170 ceph-mon[31212]: pgmap v9803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:17.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:16 smithi077 ceph-mon[27902]: pgmap v9803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:17.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:16 smithi191 ceph-mon[31636]: pgmap v9803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:18.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18208.648241 secs 2024-04-21T15:28:18.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18208.648241 secs 2024-04-21T15:28:18.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18208.648241 secs 2024-04-21T15:28:19.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:18 smithi170 ceph-mon[31212]: pgmap v9804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:19.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:18 smithi077 ceph-mon[27902]: pgmap v9804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:19.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:18 smithi191 ceph-mon[31636]: pgmap v9804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:20.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18210.410229 secs 2024-04-21T15:28:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:20.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18210.410229 secs 2024-04-21T15:28:20.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18210.410229 secs 2024-04-21T15:28:21.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:20 smithi170 ceph-mon[31212]: pgmap v9805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:21.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:20 smithi077 ceph-mon[27902]: pgmap v9805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:21.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:20 smithi191 ceph-mon[31636]: pgmap v9805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:28:23.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:22 smithi170 ceph-mon[31212]: pgmap v9806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:28:23.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18213.648324 secs 2024-04-21T15:28:23.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:22 smithi077 ceph-mon[27902]: pgmap v9806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:28:23.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18213.648324 secs 2024-04-21T15:28:23.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:22 smithi191 ceph-mon[31636]: pgmap v9806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:28:23.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18213.648324 secs 2024-04-21T15:28:25.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:24 smithi170 ceph-mon[31212]: pgmap v9807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:25.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18215.410338 secs 2024-04-21T15:28:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:25.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:24 smithi077 ceph-mon[27902]: pgmap v9807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:25.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18215.410338 secs 2024-04-21T15:28:25.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:24 smithi191 ceph-mon[31636]: pgmap v9807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:25.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18215.410338 secs 2024-04-21T15:28:27.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:26 smithi191 ceph-mon[31636]: pgmap v9808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:27.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:26 smithi170 ceph-mon[31212]: pgmap v9808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:27.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:26 smithi077 ceph-mon[27902]: pgmap v9808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:28.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18218.648465 secs 2024-04-21T15:28:28.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18218.648465 secs 2024-04-21T15:28:28.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18218.648465 secs 2024-04-21T15:28:29.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:28 smithi170 ceph-mon[31212]: pgmap v9809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:29.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:28 smithi077 ceph-mon[27902]: pgmap v9809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:29.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:28 smithi191 ceph-mon[31636]: pgmap v9809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:30.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18220.410486 secs 2024-04-21T15:28:30.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:30.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18220.410486 secs 2024-04-21T15:28:30.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18220.410486 secs 2024-04-21T15:28:31.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:30 smithi170 ceph-mon[31212]: pgmap v9810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:31.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:30 smithi077 ceph-mon[27902]: pgmap v9810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:31.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:30 smithi191 ceph-mon[31636]: pgmap v9810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:33.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:32 smithi170 ceph-mon[31212]: pgmap v9811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:33.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18223.648592 secs 2024-04-21T15:28:33.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:32 smithi077 ceph-mon[27902]: pgmap v9811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:33.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18223.648592 secs 2024-04-21T15:28:33.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:32 smithi191 ceph-mon[31636]: pgmap v9811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:33.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18223.648592 secs 2024-04-21T15:28:35.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:35.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:34 smithi077 ceph-mon[27902]: pgmap v9812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:35.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18225.410602 secs 2024-04-21T15:28:35.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:34 smithi191 ceph-mon[31636]: pgmap v9812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:35.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18225.410602 secs 2024-04-21T15:28:35.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:34 smithi170 ceph-mon[31212]: pgmap v9812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T15:28:35.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18225.410602 secs 2024-04-21T15:28:37.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:36 smithi077 ceph-mon[27902]: pgmap v9813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:37.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:36 smithi191 ceph-mon[31636]: pgmap v9813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:37.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:36 smithi170 ceph-mon[31212]: pgmap v9813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T15:28:38.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18228.648706 secs 2024-04-21T15:28:38.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18228.648706 secs 2024-04-21T15:28:38.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18228.648706 secs 2024-04-21T15:28:39.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:38 smithi077 ceph-mon[27902]: pgmap v9814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:39.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:38 smithi191 ceph-mon[31636]: pgmap v9814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:39.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:38 smithi170 ceph-mon[31212]: pgmap v9814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:40.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18230.410727 secs 2024-04-21T15:28:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:40.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18230.410727 secs 2024-04-21T15:28:40.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18230.410727 secs 2024-04-21T15:28:41.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:40 smithi077 ceph-mon[27902]: pgmap v9815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:41.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:40 smithi191 ceph-mon[31636]: pgmap v9815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:41.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:40 smithi170 ceph-mon[31212]: pgmap v9815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:43.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:42 smithi077 ceph-mon[27902]: pgmap v9816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:43.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18233.648851 secs 2024-04-21T15:28:43.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:42 smithi191 ceph-mon[31636]: pgmap v9816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:43.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18233.648851 secs 2024-04-21T15:28:43.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:42 smithi170 ceph-mon[31212]: pgmap v9816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:43.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18233.648851 secs 2024-04-21T15:28:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:45.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:44 smithi077 ceph-mon[27902]: pgmap v9817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:45.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18235.410838 secs 2024-04-21T15:28:45.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:44 smithi191 ceph-mon[31636]: pgmap v9817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:45.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18235.410838 secs 2024-04-21T15:28:45.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:44 smithi170 ceph-mon[31212]: pgmap v9817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:45.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18235.410838 secs 2024-04-21T15:28:47.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:46 smithi077 ceph-mon[27902]: pgmap v9818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:47.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:46 smithi191 ceph-mon[31636]: pgmap v9818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:47.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:46 smithi170 ceph-mon[31212]: pgmap v9818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:48.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18238.648959 secs 2024-04-21T15:28:48.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18238.648959 secs 2024-04-21T15:28:48.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18238.648959 secs 2024-04-21T15:28:49.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:48 smithi077 ceph-mon[27902]: pgmap v9819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:49.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:48 smithi191 ceph-mon[31636]: pgmap v9819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:49.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:48 smithi170 ceph-mon[31212]: pgmap v9819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:50.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:50.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18240.410933 secs 2024-04-21T15:28:50.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18240.410933 secs 2024-04-21T15:28:50.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18240.410933 secs 2024-04-21T15:28:51.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:50 smithi077 ceph-mon[27902]: pgmap v9820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:51.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:50 smithi191 ceph-mon[31636]: pgmap v9820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:51.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:50 smithi170 ceph-mon[31212]: pgmap v9820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:52 smithi077 ceph-mon[27902]: pgmap v9821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18243.649081 secs 2024-04-21T15:28:53.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:52 smithi191 ceph-mon[31636]: pgmap v9821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:53.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18243.649081 secs 2024-04-21T15:28:53.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:52 smithi170 ceph-mon[31212]: pgmap v9821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:53.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18243.649081 secs 2024-04-21T15:28:54.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.437+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T15:28:54.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.437+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T15:28:54.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.437+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:28:54.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.437+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T15:28:54.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.437+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:28:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.438+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T15:28:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.438+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T15:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T15:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T15:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7004c000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f80 tx=0x7efd7004c000 comp rx=0 tx=0).stop 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.458+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:54.459+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7002b070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T15:28:55.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:28:55.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:54 smithi077 ceph-mon[27902]: pgmap v9822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:55.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18245.410998 secs 2024-04-21T15:28:55.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:54 smithi191 ceph-mon[31636]: pgmap v9822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:55.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18245.410998 secs 2024-04-21T15:28:55.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:54 smithi170 ceph-mon[31212]: pgmap v9822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:55.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18245.410998 secs 2024-04-21T15:28:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:56.875+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:28:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:56.875+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:28:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:56.875+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:28:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:28:56.875+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:28:57.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:56 smithi077 ceph-mon[27902]: pgmap v9823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:57.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:56 smithi191 ceph-mon[31636]: pgmap v9823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:57.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:56 smithi170 ceph-mon[31212]: pgmap v9823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:28:58.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18248.649212 secs 2024-04-21T15:28:58.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18248.649212 secs 2024-04-21T15:28:58.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18248.649212 secs 2024-04-21T15:28:59.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:58 smithi077 ceph-mon[27902]: pgmap v9824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:59.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:58 smithi191 ceph-mon[31636]: pgmap v9824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:28:59.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:58 smithi170 ceph-mon[31212]: pgmap v9824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:00.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18250.411098 secs 2024-04-21T15:29:00.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18250.411098 secs 2024-04-21T15:29:00.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18250.411098 secs 2024-04-21T15:29:01.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:00 smithi077 ceph-mon[27902]: pgmap v9825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:01.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:00 smithi191 ceph-mon[31636]: pgmap v9825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:01.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:00 smithi170 ceph-mon[31212]: pgmap v9825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:03.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:02 smithi077 ceph-mon[27902]: pgmap v9826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:03.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18253.649351 secs 2024-04-21T15:29:03.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:02 smithi191 ceph-mon[31636]: pgmap v9826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:03.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18253.649351 secs 2024-04-21T15:29:03.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:02 smithi170 ceph-mon[31212]: pgmap v9826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:03.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18253.649351 secs 2024-04-21T15:29:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:04 smithi077 ceph-mon[27902]: pgmap v9827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18255.411221 secs 2024-04-21T15:29:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:04 smithi077 ceph-mon[27902]: osdmap e686: 12 total, 12 up, 12 in 2024-04-21T15:29:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:04 smithi191 ceph-mon[31636]: pgmap v9827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:05.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18255.411221 secs 2024-04-21T15:29:05.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:04 smithi191 ceph-mon[31636]: osdmap e686: 12 total, 12 up, 12 in 2024-04-21T15:29:05.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:04 smithi170 ceph-mon[31212]: pgmap v9827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:05.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18255.411221 secs 2024-04-21T15:29:05.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:04 smithi170 ceph-mon[31212]: osdmap e686: 12 total, 12 up, 12 in 2024-04-21T15:29:07.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:06 smithi077 ceph-mon[27902]: pgmap v9829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:07.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:06 smithi191 ceph-mon[31636]: pgmap v9829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:07.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:06 smithi170 ceph-mon[31212]: pgmap v9829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:08.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18258.649489 secs 2024-04-21T15:29:08.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18258.649489 secs 2024-04-21T15:29:08.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18258.649489 secs 2024-04-21T15:29:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:08 smithi191 ceph-mon[31636]: pgmap v9830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:09.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:08 smithi170 ceph-mon[31212]: pgmap v9830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:09.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:08 smithi077 ceph-mon[27902]: pgmap v9830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:10.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18260.411343 secs 2024-04-21T15:29:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:09 smithi191 ceph-mon[31636]: pgmap v9831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:29:10.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18260.411343 secs 2024-04-21T15:29:10.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:09 smithi170 ceph-mon[31212]: pgmap v9831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:10.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:29:10.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18260.411343 secs 2024-04-21T15:29:10.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:09 smithi077 ceph-mon[27902]: pgmap v9831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:29:10.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:29:11.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:11 smithi077 ceph-mon[27902]: osdmap e687: 12 total, 12 up, 12 in 2024-04-21T15:29:11.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:29:11.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:29:11.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.479 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.479 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:11 smithi191 ceph-mon[31636]: osdmap e687: 12 total, 12 up, 12 in 2024-04-21T15:29:11.479 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:29:11.479 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:29:11.479 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:11.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:11 smithi170 ceph-mon[31212]: osdmap e687: 12 total, 12 up, 12 in 2024-04-21T15:29:11.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:29:11.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:29:11.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:29:12.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:12 smithi077 ceph-mon[27902]: pgmap v9833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:29:12.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:12 smithi191 ceph-mon[31636]: pgmap v9833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:29:12.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:12 smithi170 ceph-mon[31212]: pgmap v9833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:29:13.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18263.649630 secs 2024-04-21T15:29:13.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18263.649630 secs 2024-04-21T15:29:13.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18263.649630 secs 2024-04-21T15:29:14.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:14 smithi077 ceph-mon[27902]: pgmap v9834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:29:14.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18265.411486 secs 2024-04-21T15:29:14.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:14 smithi191 ceph-mon[31636]: pgmap v9834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:29:14.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18265.411486 secs 2024-04-21T15:29:14.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:14 smithi170 ceph-mon[31212]: pgmap v9834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T15:29:14.567 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18265.411486 secs 2024-04-21T15:29:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:16.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:16 smithi170 ceph-mon[31212]: pgmap v9835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:16.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:16 smithi077 ceph-mon[27902]: pgmap v9835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:16.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:16 smithi191 ceph-mon[31636]: pgmap v9835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:17.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18268.649740 secs 2024-04-21T15:29:17.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18268.649740 secs 2024-04-21T15:29:17.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18268.649740 secs 2024-04-21T15:29:18.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:18 smithi170 ceph-mon[31212]: pgmap v9836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:18.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:18 smithi077 ceph-mon[27902]: pgmap v9836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:18.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:18 smithi191 ceph-mon[31636]: pgmap v9836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:19.818 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18270.411625 secs 2024-04-21T15:29:19.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18270.411625 secs 2024-04-21T15:29:19.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18270.411625 secs 2024-04-21T15:29:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:20.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:20 smithi170 ceph-mon[31212]: pgmap v9837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:20.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:20 smithi077 ceph-mon[27902]: pgmap v9837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:20.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:20 smithi191 ceph-mon[31636]: pgmap v9837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:29:22.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:22 smithi170 ceph-mon[31212]: pgmap v9838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:29:22.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18273.649860 secs 2024-04-21T15:29:22.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:22 smithi077 ceph-mon[27902]: pgmap v9838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:29:22.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18273.649860 secs 2024-04-21T15:29:22.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:22 smithi191 ceph-mon[31636]: pgmap v9838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 6 op/s 2024-04-21T15:29:22.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18273.649860 secs 2024-04-21T15:29:24.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:24 smithi170 ceph-mon[31212]: pgmap v9839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:24.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18275.411736 secs 2024-04-21T15:29:24.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:24 smithi077 ceph-mon[27902]: pgmap v9839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:24.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18275.411736 secs 2024-04-21T15:29:24.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:24 smithi191 ceph-mon[31636]: pgmap v9839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:24.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18275.411736 secs 2024-04-21T15:29:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:26.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:26 smithi170 ceph-mon[31212]: pgmap v9840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:26.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:26 smithi077 ceph-mon[27902]: pgmap v9840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:26.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:26 smithi191 ceph-mon[31636]: pgmap v9840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:27.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18278.649935 secs 2024-04-21T15:29:27.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18278.649935 secs 2024-04-21T15:29:27.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18278.649935 secs 2024-04-21T15:29:28.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:28 smithi170 ceph-mon[31212]: pgmap v9841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:28.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:28 smithi077 ceph-mon[27902]: pgmap v9841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:28.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:28 smithi191 ceph-mon[31636]: pgmap v9841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:29.818 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18280.411800 secs 2024-04-21T15:29:29.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18280.411800 secs 2024-04-21T15:29:29.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18280.411800 secs 2024-04-21T15:29:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:30.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:30 smithi170 ceph-mon[31212]: pgmap v9842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:30.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:30 smithi077 ceph-mon[27902]: pgmap v9842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:30.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:30 smithi191 ceph-mon[31636]: pgmap v9842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:32.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:32 smithi170 ceph-mon[31212]: pgmap v9843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:32.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18283.650000 secs 2024-04-21T15:29:32.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:32 smithi077 ceph-mon[27902]: pgmap v9843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:32.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18283.650000 secs 2024-04-21T15:29:32.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:32 smithi191 ceph-mon[31636]: pgmap v9843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:32.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18283.650000 secs 2024-04-21T15:29:34.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:34 smithi077 ceph-mon[27902]: pgmap v9844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:34.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18285.411912 secs 2024-04-21T15:29:34.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:34 smithi191 ceph-mon[31636]: pgmap v9844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:34.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18285.411912 secs 2024-04-21T15:29:35.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:34 smithi170 ceph-mon[31212]: pgmap v9844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:35.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18285.411912 secs 2024-04-21T15:29:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:36.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:36 smithi077 ceph-mon[27902]: pgmap v9845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:36.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:36 smithi191 ceph-mon[31636]: pgmap v9845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:37.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:36 smithi170 ceph-mon[31212]: pgmap v9845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:37.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18288.650124 secs 2024-04-21T15:29:37.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18288.650124 secs 2024-04-21T15:29:38.069 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18288.650124 secs 2024-04-21T15:29:38.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:38 smithi077 ceph-mon[27902]: pgmap v9846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:38.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:38 smithi191 ceph-mon[31636]: pgmap v9846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:39.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:38 smithi170 ceph-mon[31212]: pgmap v9846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:39.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18290.412025 secs 2024-04-21T15:29:39.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18290.412025 secs 2024-04-21T15:29:40.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18290.412025 secs 2024-04-21T15:29:40.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:40.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:40 smithi077 ceph-mon[27902]: pgmap v9847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:40.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:40 smithi191 ceph-mon[31636]: pgmap v9847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:41.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:40 smithi170 ceph-mon[31212]: pgmap v9847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:42.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:42 smithi077 ceph-mon[27902]: pgmap v9848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:42.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18293.650249 secs 2024-04-21T15:29:42.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:42 smithi191 ceph-mon[31636]: pgmap v9848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:42.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18293.650249 secs 2024-04-21T15:29:43.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:42 smithi170 ceph-mon[31212]: pgmap v9848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:43.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18293.650249 secs 2024-04-21T15:29:44.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:44 smithi077 ceph-mon[27902]: pgmap v9849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:44.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18295.412143 secs 2024-04-21T15:29:44.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:44 smithi191 ceph-mon[31636]: pgmap v9849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:44.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18295.412143 secs 2024-04-21T15:29:45.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:44 smithi170 ceph-mon[31212]: pgmap v9849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:45.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18295.412143 secs 2024-04-21T15:29:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:46.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:46 smithi077 ceph-mon[27902]: pgmap v9850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:46.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:46 smithi191 ceph-mon[31636]: pgmap v9850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:47.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:46 smithi170 ceph-mon[31212]: pgmap v9850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:47.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18298.650365 secs 2024-04-21T15:29:47.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18298.650365 secs 2024-04-21T15:29:48.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18298.650365 secs 2024-04-21T15:29:48.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:48 smithi077 ceph-mon[27902]: pgmap v9851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:48.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:48 smithi191 ceph-mon[31636]: pgmap v9851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:49.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:48 smithi170 ceph-mon[31212]: pgmap v9851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:49.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18300.412278 secs 2024-04-21T15:29:49.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18300.412278 secs 2024-04-21T15:29:50.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18300.412278 secs 2024-04-21T15:29:50.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:50.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:50 smithi077 ceph-mon[27902]: pgmap v9852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:50.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:50 smithi191 ceph-mon[31636]: pgmap v9852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:51.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:50 smithi170 ceph-mon[31212]: pgmap v9852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:52.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:52 smithi077 ceph-mon[27902]: pgmap v9853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:52.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18303.650501 secs 2024-04-21T15:29:52.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:52 smithi191 ceph-mon[31636]: pgmap v9853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:52.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18303.650501 secs 2024-04-21T15:29:53.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:52 smithi170 ceph-mon[31212]: pgmap v9853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:53.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18303.650501 secs 2024-04-21T15:29:54.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:54 smithi077 ceph-mon[27902]: pgmap v9854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:54.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18305.412392 secs 2024-04-21T15:29:54.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:54 smithi191 ceph-mon[31636]: pgmap v9854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:54.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18305.412392 secs 2024-04-21T15:29:55.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:54 smithi170 ceph-mon[31212]: pgmap v9854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:55.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18305.412392 secs 2024-04-21T15:29:55.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:29:56.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:56 smithi077 ceph-mon[27902]: pgmap v9855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:56.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:56 smithi191 ceph-mon[31636]: pgmap v9855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:57.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:56 smithi170 ceph-mon[31212]: pgmap v9855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:29:57.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18308.650626 secs 2024-04-21T15:29:57.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18308.650626 secs 2024-04-21T15:29:57.968 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18308.650626 secs 2024-04-21T15:29:58.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:58 smithi077 ceph-mon[27902]: pgmap v9856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:58.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:58 smithi191 ceph-mon[31636]: pgmap v9856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:59.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:58 smithi170 ceph-mon[31212]: pgmap v9856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:29:59.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18310.412502 secs 2024-04-21T15:29:59.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18310.412502 secs 2024-04-21T15:30:00.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18310.412502 secs 2024-04-21T15:30:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:00.895 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:00 smithi077 ceph-mon[27902]: pgmap v9857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:00.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:30:00.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:00 smithi191 ceph-mon[31636]: pgmap v9857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:00.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:30:01.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:00 smithi170 ceph-mon[31212]: pgmap v9857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:01.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:30:02.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:02 smithi077 ceph-mon[27902]: pgmap v9858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:02.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18313.650784 secs 2024-04-21T15:30:02.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:02 smithi191 ceph-mon[31636]: pgmap v9858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:02.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18313.650784 secs 2024-04-21T15:30:03.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:02 smithi170 ceph-mon[31212]: pgmap v9858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:03.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18313.650784 secs 2024-04-21T15:30:04.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:04 smithi077 ceph-mon[27902]: pgmap v9859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:04.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18315.412623 secs 2024-04-21T15:30:04.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:04 smithi077 ceph-mon[27902]: osdmap e688: 12 total, 12 up, 12 in 2024-04-21T15:30:04.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:04 smithi191 ceph-mon[31636]: pgmap v9859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:04.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18315.412623 secs 2024-04-21T15:30:04.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:04 smithi191 ceph-mon[31636]: osdmap e688: 12 total, 12 up, 12 in 2024-04-21T15:30:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:04 smithi170 ceph-mon[31212]: pgmap v9859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18315.412623 secs 2024-04-21T15:30:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:04 smithi170 ceph-mon[31212]: osdmap e688: 12 total, 12 up, 12 in 2024-04-21T15:30:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:06.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:06 smithi191 ceph-mon[31636]: pgmap v9861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:07.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:06 smithi170 ceph-mon[31212]: pgmap v9861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:07.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:06 smithi077 ceph-mon[27902]: pgmap v9861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:07.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18318.650897 secs 2024-04-21T15:30:08.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18318.650897 secs 2024-04-21T15:30:08.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18318.650897 secs 2024-04-21T15:30:08.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:08 smithi191 ceph-mon[31636]: pgmap v9862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:09.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:08 smithi170 ceph-mon[31212]: pgmap v9862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:09.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:08 smithi077 ceph-mon[27902]: pgmap v9862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:09.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18320.412747 secs 2024-04-21T15:30:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18320.412747 secs 2024-04-21T15:30:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18320.412747 secs 2024-04-21T15:30:10.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:10 smithi191 ceph-mon[31636]: pgmap v9863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:10.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:10 smithi191 ceph-mon[31636]: osdmap e689: 12 total, 12 up, 12 in 2024-04-21T15:30:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:10 smithi170 ceph-mon[31212]: pgmap v9863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:10 smithi170 ceph-mon[31212]: osdmap e689: 12 total, 12 up, 12 in 2024-04-21T15:30:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:10 smithi077 ceph-mon[27902]: pgmap v9863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:30:11.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:10 smithi077 ceph-mon[27902]: osdmap e689: 12 total, 12 up, 12 in 2024-04-21T15:30:11.729 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:30:11.729 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.729 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.729 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.729 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:30:11.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:11.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:12.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:30:12.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:12.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:12.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:12.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:12.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:12 smithi191 ceph-mon[31636]: pgmap v9865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:30:12.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18323.650983 secs 2024-04-21T15:30:12.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:30:12.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:30:12.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:12 smithi170 ceph-mon[31212]: pgmap v9865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:30:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18323.650983 secs 2024-04-21T15:30:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:30:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:30:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:13.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:12 smithi077 ceph-mon[27902]: pgmap v9865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:30:13.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18323.650983 secs 2024-04-21T15:30:13.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:30:13.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:30:13.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:30:14.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:14 smithi191 ceph-mon[31636]: pgmap v9866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:30:14.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18325.412882 secs 2024-04-21T15:30:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:14 smithi170 ceph-mon[31212]: pgmap v9866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:30:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18325.412882 secs 2024-04-21T15:30:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:14 smithi077 ceph-mon[27902]: pgmap v9866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:30:15.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18325.412882 secs 2024-04-21T15:30:16.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:16 smithi191 ceph-mon[31636]: pgmap v9867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:17.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:16 smithi170 ceph-mon[31212]: pgmap v9867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:17.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:16 smithi077 ceph-mon[27902]: pgmap v9867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:17.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18328.651072 secs 2024-04-21T15:30:18.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18328.651072 secs 2024-04-21T15:30:18.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18328.651072 secs 2024-04-21T15:30:18.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:18 smithi191 ceph-mon[31636]: pgmap v9868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:19.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:18 smithi170 ceph-mon[31212]: pgmap v9868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:19.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:18 smithi077 ceph-mon[27902]: pgmap v9868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:19.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18330.412979 secs 2024-04-21T15:30:20.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18330.412979 secs 2024-04-21T15:30:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:20.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18330.412979 secs 2024-04-21T15:30:20.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:20 smithi191 ceph-mon[31636]: pgmap v9869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:21.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:20 smithi170 ceph-mon[31212]: pgmap v9869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:21.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:20 smithi077 ceph-mon[27902]: pgmap v9869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:30:22.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:22 smithi191 ceph-mon[31636]: pgmap v9870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:30:22.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18333.651193 secs 2024-04-21T15:30:23.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:22 smithi170 ceph-mon[31212]: pgmap v9870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:30:23.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18333.651193 secs 2024-04-21T15:30:23.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:22 smithi077 ceph-mon[27902]: pgmap v9870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:30:23.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18333.651193 secs 2024-04-21T15:30:24.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:24 smithi191 ceph-mon[31636]: pgmap v9871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:24.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18335.413120 secs 2024-04-21T15:30:25.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:24 smithi170 ceph-mon[31212]: pgmap v9871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:25.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18335.413120 secs 2024-04-21T15:30:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:25.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:24 smithi077 ceph-mon[27902]: pgmap v9871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:25.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18335.413120 secs 2024-04-21T15:30:26.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:26 smithi191 ceph-mon[31636]: pgmap v9872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:27.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:26 smithi170 ceph-mon[31212]: pgmap v9872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:27.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:26 smithi077 ceph-mon[27902]: pgmap v9872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:27.968 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18338.651305 secs 2024-04-21T15:30:27.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18338.651305 secs 2024-04-21T15:30:28.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18338.651305 secs 2024-04-21T15:30:28.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:28 smithi191 ceph-mon[31636]: pgmap v9873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:29.069 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:28 smithi170 ceph-mon[31212]: pgmap v9873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:29.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:28 smithi077 ceph-mon[27902]: pgmap v9873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:29.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18340.413242 secs 2024-04-21T15:30:30.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18340.413242 secs 2024-04-21T15:30:30.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:30.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18340.413242 secs 2024-04-21T15:30:30.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:30 smithi191 ceph-mon[31636]: pgmap v9874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:31.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:30 smithi170 ceph-mon[31212]: pgmap v9874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:31.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:30 smithi077 ceph-mon[27902]: pgmap v9874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:32.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:32 smithi191 ceph-mon[31636]: pgmap v9875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:32.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18343.651422 secs 2024-04-21T15:30:33.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:32 smithi170 ceph-mon[31212]: pgmap v9875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:33.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18343.651422 secs 2024-04-21T15:30:33.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:32 smithi077 ceph-mon[27902]: pgmap v9875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:33.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18343.651422 secs 2024-04-21T15:30:35.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:34 smithi170 ceph-mon[31212]: pgmap v9876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:35.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18345.413351 secs 2024-04-21T15:30:35.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:35.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:34 smithi077 ceph-mon[27902]: pgmap v9876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:35.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18345.413351 secs 2024-04-21T15:30:35.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:34 smithi191 ceph-mon[31636]: pgmap v9876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:35.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18345.413351 secs 2024-04-21T15:30:37.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:36 smithi170 ceph-mon[31212]: pgmap v9877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:37.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:36 smithi077 ceph-mon[27902]: pgmap v9877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:37.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:36 smithi191 ceph-mon[31636]: pgmap v9877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:38.048 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18348.651537 secs 2024-04-21T15:30:38.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18348.651537 secs 2024-04-21T15:30:38.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18348.651537 secs 2024-04-21T15:30:39.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:38 smithi170 ceph-mon[31212]: pgmap v9878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:39.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:38 smithi077 ceph-mon[27902]: pgmap v9878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:39.231 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:38 smithi191 ceph-mon[31636]: pgmap v9878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:40.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18350.413428 secs 2024-04-21T15:30:40.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:40.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18350.413428 secs 2024-04-21T15:30:40.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18350.413428 secs 2024-04-21T15:30:41.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:40 smithi170 ceph-mon[31212]: pgmap v9879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:41.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:40 smithi077 ceph-mon[27902]: pgmap v9879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:41.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:40 smithi191 ceph-mon[31636]: pgmap v9879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:43.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:42 smithi170 ceph-mon[31212]: pgmap v9880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:43.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18353.651627 secs 2024-04-21T15:30:43.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:42 smithi077 ceph-mon[27902]: pgmap v9880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:43.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18353.651627 secs 2024-04-21T15:30:43.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:42 smithi191 ceph-mon[31636]: pgmap v9880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:43.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18353.651627 secs 2024-04-21T15:30:45.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:44 smithi170 ceph-mon[31212]: pgmap v9881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:45.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18355.413547 secs 2024-04-21T15:30:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:45.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:44 smithi077 ceph-mon[27902]: pgmap v9881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:45.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18355.413547 secs 2024-04-21T15:30:45.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:44 smithi191 ceph-mon[31636]: pgmap v9881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:45.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18355.413547 secs 2024-04-21T15:30:47.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:46 smithi170 ceph-mon[31212]: pgmap v9882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:47.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:46 smithi077 ceph-mon[27902]: pgmap v9882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:47.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:46 smithi191 ceph-mon[31636]: pgmap v9882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:48.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18358.651787 secs 2024-04-21T15:30:48.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18358.651787 secs 2024-04-21T15:30:48.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18358.651787 secs 2024-04-21T15:30:49.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:48 smithi170 ceph-mon[31212]: pgmap v9883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:49.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:48 smithi077 ceph-mon[27902]: pgmap v9883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:49.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:48 smithi191 ceph-mon[31636]: pgmap v9883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:50.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18360.413661 secs 2024-04-21T15:30:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:50.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18360.413661 secs 2024-04-21T15:30:50.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18360.413661 secs 2024-04-21T15:30:51.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:50 smithi170 ceph-mon[31212]: pgmap v9884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:51.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:50 smithi077 ceph-mon[27902]: pgmap v9884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:51.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:50 smithi191 ceph-mon[31636]: pgmap v9884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:53.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:52 smithi170 ceph-mon[31212]: pgmap v9885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:53.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18363.651830 secs 2024-04-21T15:30:53.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:52 smithi077 ceph-mon[27902]: pgmap v9885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:53.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18363.651830 secs 2024-04-21T15:30:53.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:52 smithi191 ceph-mon[31636]: pgmap v9885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:53.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18363.651830 secs 2024-04-21T15:30:55.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:54 smithi170 ceph-mon[31212]: pgmap v9886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:55.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18365.413795 secs 2024-04-21T15:30:55.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:30:55.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:54 smithi077 ceph-mon[27902]: pgmap v9886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:55.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18365.413795 secs 2024-04-21T15:30:55.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:54 smithi191 ceph-mon[31636]: pgmap v9886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:55.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18365.413795 secs 2024-04-21T15:30:57.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:56 smithi170 ceph-mon[31212]: pgmap v9887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:57.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:56 smithi077 ceph-mon[27902]: pgmap v9887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:57.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:56 smithi191 ceph-mon[31636]: pgmap v9887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:30:58.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18368.651892 secs 2024-04-21T15:30:58.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18368.651892 secs 2024-04-21T15:30:58.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18368.651892 secs 2024-04-21T15:30:59.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:58 smithi170 ceph-mon[31212]: pgmap v9888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:59.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:58 smithi077 ceph-mon[27902]: pgmap v9888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:30:59.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:58 smithi191 ceph-mon[31636]: pgmap v9888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:00.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18370.413928 secs 2024-04-21T15:31:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:00.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18370.413928 secs 2024-04-21T15:31:00.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18370.413928 secs 2024-04-21T15:31:01.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:00 smithi170 ceph-mon[31212]: pgmap v9889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:01.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:00 smithi077 ceph-mon[27902]: pgmap v9889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:01.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:00 smithi191 ceph-mon[31636]: pgmap v9889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:03.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:02 smithi170 ceph-mon[31212]: pgmap v9890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T15:31:03.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18373.651980 secs 2024-04-21T15:31:03.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:02 smithi077 ceph-mon[27902]: pgmap v9890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T15:31:03.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18373.651980 secs 2024-04-21T15:31:03.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:02 smithi191 ceph-mon[31636]: pgmap v9890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T15:31:03.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18373.651980 secs 2024-04-21T15:31:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:04 smithi170 ceph-mon[31212]: pgmap v9891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T15:31:05.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18375.414043 secs 2024-04-21T15:31:05.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:04 smithi170 ceph-mon[31212]: osdmap e690: 12 total, 12 up, 12 in 2024-04-21T15:31:05.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:05.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:04 smithi077 ceph-mon[27902]: pgmap v9891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T15:31:05.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18375.414043 secs 2024-04-21T15:31:05.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:04 smithi077 ceph-mon[27902]: osdmap e690: 12 total, 12 up, 12 in 2024-04-21T15:31:05.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:04 smithi191 ceph-mon[31636]: pgmap v9891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T15:31:05.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18375.414043 secs 2024-04-21T15:31:05.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:04 smithi191 ceph-mon[31636]: osdmap e690: 12 total, 12 up, 12 in 2024-04-21T15:31:07.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:06 smithi077 ceph-mon[27902]: pgmap v9893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:07.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:06 smithi191 ceph-mon[31636]: pgmap v9893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:07.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:06 smithi170 ceph-mon[31212]: pgmap v9893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:08.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18378.652095 secs 2024-04-21T15:31:08.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18378.652095 secs 2024-04-21T15:31:08.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18378.652095 secs 2024-04-21T15:31:09.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:08 smithi077 ceph-mon[27902]: pgmap v9894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:09.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:08 smithi191 ceph-mon[31636]: pgmap v9894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:09.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:08 smithi170 ceph-mon[31212]: pgmap v9894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:10.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:10.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18380.414162 secs 2024-04-21T15:31:10.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18380.414162 secs 2024-04-21T15:31:10.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18380.414162 secs 2024-04-21T15:31:11.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:10 smithi077 ceph-mon[27902]: pgmap v9895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:11.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:10 smithi077 ceph-mon[27902]: osdmap e691: 12 total, 12 up, 12 in 2024-04-21T15:31:11.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:10 smithi191 ceph-mon[31636]: pgmap v9895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:11.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:10 smithi191 ceph-mon[31636]: osdmap e691: 12 total, 12 up, 12 in 2024-04-21T15:31:11.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:10 smithi170 ceph-mon[31212]: pgmap v9895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:31:11.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:10 smithi170 ceph-mon[31212]: osdmap e691: 12 total, 12 up, 12 in 2024-04-21T15:31:13.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:12 smithi077 ceph-mon[27902]: pgmap v9897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T15:31:13.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18383.652231 secs 2024-04-21T15:31:13.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:31:13.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:12 smithi191 ceph-mon[31636]: pgmap v9897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T15:31:13.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18383.652231 secs 2024-04-21T15:31:13.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:31:13.319 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:12 smithi170 ceph-mon[31212]: pgmap v9897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T15:31:13.319 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18383.652231 secs 2024-04-21T15:31:13.319 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:31:14.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:31:14.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:31:14.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:31:14.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:31:14.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:31:14.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:31:14.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:31:14.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:31:14.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:31:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:15.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:14 smithi077 ceph-mon[27902]: pgmap v9898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 317 B/s wr, 6 op/s 2024-04-21T15:31:15.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18385.414270 secs 2024-04-21T15:31:15.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:14 smithi191 ceph-mon[31636]: pgmap v9898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 317 B/s wr, 6 op/s 2024-04-21T15:31:15.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18385.414270 secs 2024-04-21T15:31:15.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:14 smithi170 ceph-mon[31212]: pgmap v9898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 317 B/s wr, 6 op/s 2024-04-21T15:31:15.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18385.414270 secs 2024-04-21T15:31:17.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:16 smithi077 ceph-mon[27902]: pgmap v9899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:17.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:16 smithi191 ceph-mon[31636]: pgmap v9899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:17.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:16 smithi170 ceph-mon[31212]: pgmap v9899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:18.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18388.652371 secs 2024-04-21T15:31:18.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18388.652371 secs 2024-04-21T15:31:18.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18388.652371 secs 2024-04-21T15:31:19.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:18 smithi077 ceph-mon[27902]: pgmap v9900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:19.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:18 smithi191 ceph-mon[31636]: pgmap v9900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:19.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:18 smithi170 ceph-mon[31212]: pgmap v9900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:20.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18390.414391 secs 2024-04-21T15:31:20.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18390.414391 secs 2024-04-21T15:31:20.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18390.414391 secs 2024-04-21T15:31:21.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:20 smithi077 ceph-mon[27902]: pgmap v9901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:21.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:20 smithi191 ceph-mon[31636]: pgmap v9901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:21.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:20 smithi170 ceph-mon[31212]: pgmap v9901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:31:23.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:22 smithi077 ceph-mon[27902]: pgmap v9902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:31:23.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18393.652530 secs 2024-04-21T15:31:23.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:22 smithi191 ceph-mon[31636]: pgmap v9902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:31:23.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18393.652530 secs 2024-04-21T15:31:23.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:22 smithi170 ceph-mon[31212]: pgmap v9902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:31:23.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18393.652530 secs 2024-04-21T15:31:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:25.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:24 smithi077 ceph-mon[27902]: pgmap v9903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:25.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18395.414507 secs 2024-04-21T15:31:25.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:24 smithi191 ceph-mon[31636]: pgmap v9903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:25.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18395.414507 secs 2024-04-21T15:31:25.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:24 smithi170 ceph-mon[31212]: pgmap v9903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:25.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18395.414507 secs 2024-04-21T15:31:27.120 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:26 smithi170 ceph-mon[31212]: pgmap v9904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:27.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:26 smithi077 ceph-mon[27902]: pgmap v9904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:27.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:26 smithi191 ceph-mon[31636]: pgmap v9904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:28.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18398.652634 secs 2024-04-21T15:31:28.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18398.652634 secs 2024-04-21T15:31:28.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18398.652634 secs 2024-04-21T15:31:29.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:28 smithi077 ceph-mon[27902]: pgmap v9905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:29.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:28 smithi191 ceph-mon[31636]: pgmap v9905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:29.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:28 smithi170 ceph-mon[31212]: pgmap v9905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:30.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:30.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18400.414620 secs 2024-04-21T15:31:30.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18400.414620 secs 2024-04-21T15:31:30.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18400.414620 secs 2024-04-21T15:31:31.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:30 smithi077 ceph-mon[27902]: pgmap v9906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:31.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:30 smithi191 ceph-mon[31636]: pgmap v9906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:31.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:30 smithi170 ceph-mon[31212]: pgmap v9906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:33.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:32 smithi077 ceph-mon[27902]: pgmap v9907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:33.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18403.652817 secs 2024-04-21T15:31:33.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:32 smithi191 ceph-mon[31636]: pgmap v9907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:33.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18403.652817 secs 2024-04-21T15:31:33.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:32 smithi170 ceph-mon[31212]: pgmap v9907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:33.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18403.652817 secs 2024-04-21T15:31:35.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:35.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:34 smithi077 ceph-mon[27902]: pgmap v9908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:35.147 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18405.414756 secs 2024-04-21T15:31:35.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:34 smithi191 ceph-mon[31636]: pgmap v9908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:35.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18405.414756 secs 2024-04-21T15:31:35.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:34 smithi170 ceph-mon[31212]: pgmap v9908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:35.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18405.414756 secs 2024-04-21T15:31:37.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:36 smithi077 ceph-mon[27902]: pgmap v9909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:37.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:36 smithi191 ceph-mon[31636]: pgmap v9909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:37.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:36 smithi170 ceph-mon[31212]: pgmap v9909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:38.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18408.652930 secs 2024-04-21T15:31:38.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18408.652930 secs 2024-04-21T15:31:38.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18408.652930 secs 2024-04-21T15:31:39.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:38 smithi191 ceph-mon[31636]: pgmap v9910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:39.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:38 smithi170 ceph-mon[31212]: pgmap v9910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:39.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:38 smithi077 ceph-mon[27902]: pgmap v9910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:40.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:40.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18410.414917 secs 2024-04-21T15:31:40.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18410.414917 secs 2024-04-21T15:31:40.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18410.414917 secs 2024-04-21T15:31:41.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:40 smithi191 ceph-mon[31636]: pgmap v9911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:41.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:40 smithi170 ceph-mon[31212]: pgmap v9911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:41.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:40 smithi077 ceph-mon[27902]: pgmap v9911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:43.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:42 smithi191 ceph-mon[31636]: pgmap v9912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:43.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18413.653053 secs 2024-04-21T15:31:43.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:42 smithi170 ceph-mon[31212]: pgmap v9912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:43.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18413.653053 secs 2024-04-21T15:31:43.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:42 smithi077 ceph-mon[27902]: pgmap v9912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:43.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18413.653053 secs 2024-04-21T15:31:45.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:45.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:44 smithi191 ceph-mon[31636]: pgmap v9913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:45.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18415.415019 secs 2024-04-21T15:31:45.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:44 smithi170 ceph-mon[31212]: pgmap v9913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:45.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18415.415019 secs 2024-04-21T15:31:45.397 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:44 smithi077 ceph-mon[27902]: pgmap v9913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:45.397 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18415.415019 secs 2024-04-21T15:31:47.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:46 smithi191 ceph-mon[31636]: pgmap v9914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:47.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:46 smithi170 ceph-mon[31212]: pgmap v9914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:47.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:46 smithi077 ceph-mon[27902]: pgmap v9914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:48.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18418.653148 secs 2024-04-21T15:31:48.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18418.653148 secs 2024-04-21T15:31:48.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18418.653148 secs 2024-04-21T15:31:49.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:48 smithi191 ceph-mon[31636]: pgmap v9915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:49.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:48 smithi170 ceph-mon[31212]: pgmap v9915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:49.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:48 smithi077 ceph-mon[27902]: pgmap v9915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:50.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:50.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18420.415149 secs 2024-04-21T15:31:50.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18420.415149 secs 2024-04-21T15:31:50.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18420.415149 secs 2024-04-21T15:31:51.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:50 smithi191 ceph-mon[31636]: pgmap v9916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:51.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:50 smithi170 ceph-mon[31212]: pgmap v9916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:51.397 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:50 smithi077 ceph-mon[27902]: pgmap v9916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:52.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:51 smithi191 ceph-mon[31636]: pgmap v9917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:52.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:51 smithi170 ceph-mon[31212]: pgmap v9917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:52.397 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:51 smithi077 ceph-mon[27902]: pgmap v9917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:53.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18423.653271 secs 2024-04-21T15:31:53.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18423.653271 secs 2024-04-21T15:31:53.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18423.653271 secs 2024-04-21T15:31:54.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:53 smithi191 ceph-mon[31636]: pgmap v9918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:54.230 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18425.415277 secs 2024-04-21T15:31:54.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:53 smithi170 ceph-mon[31212]: pgmap v9918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:54.318 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18425.415277 secs 2024-04-21T15:31:54.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:53 smithi077 ceph-mon[27902]: pgmap v9918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:54.397 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18425.415277 secs 2024-04-21T15:31:55.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:31:56.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:56 smithi077 ceph-mon[27902]: pgmap v9919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:56.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:31:56.901+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:31:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:31:56.901+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:31:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:31:56.901+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:31:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:31:56.901+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:31:56.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:56 smithi191 ceph-mon[31636]: pgmap v9919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:57.020 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:56 smithi170 ceph-mon[31212]: pgmap v9919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:31:57.881 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18428.653412 secs 2024-04-21T15:31:57.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18428.653412 secs 2024-04-21T15:31:58.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18428.653412 secs 2024-04-21T15:31:58.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:58 smithi077 ceph-mon[27902]: pgmap v9920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:58.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:58 smithi191 ceph-mon[31636]: pgmap v9920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:59.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:58 smithi170 ceph-mon[31212]: pgmap v9920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:31:59.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18430.415417 secs 2024-04-21T15:31:59.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18430.415417 secs 2024-04-21T15:32:00.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18430.415417 secs 2024-04-21T15:32:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:00.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:00 smithi077 ceph-mon[27902]: pgmap v9921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:00.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:00 smithi191 ceph-mon[31636]: pgmap v9921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:01.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:00 smithi170 ceph-mon[31212]: pgmap v9921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:02.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:02 smithi077 ceph-mon[27902]: pgmap v9922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T15:32:02.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18433.653519 secs 2024-04-21T15:32:02.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:02 smithi191 ceph-mon[31636]: pgmap v9922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T15:32:02.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18433.653519 secs 2024-04-21T15:32:03.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:02 smithi170 ceph-mon[31212]: pgmap v9922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T15:32:03.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18433.653519 secs 2024-04-21T15:32:04.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:04 smithi077 ceph-mon[27902]: pgmap v9923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T15:32:04.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18435.415553 secs 2024-04-21T15:32:04.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:04 smithi077 ceph-mon[27902]: osdmap e692: 12 total, 12 up, 12 in 2024-04-21T15:32:04.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:04 smithi191 ceph-mon[31636]: pgmap v9923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T15:32:04.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18435.415553 secs 2024-04-21T15:32:04.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:04 smithi191 ceph-mon[31636]: osdmap e692: 12 total, 12 up, 12 in 2024-04-21T15:32:05.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:04 smithi170 ceph-mon[31212]: pgmap v9923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T15:32:05.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18435.415553 secs 2024-04-21T15:32:05.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:04 smithi170 ceph-mon[31212]: osdmap e692: 12 total, 12 up, 12 in 2024-04-21T15:32:05.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:06.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:06 smithi077 ceph-mon[27902]: pgmap v9925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:06.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:06 smithi191 ceph-mon[31636]: pgmap v9925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:07.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:06 smithi170 ceph-mon[31212]: pgmap v9925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:07.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18438.653613 secs 2024-04-21T15:32:07.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18438.653613 secs 2024-04-21T15:32:08.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18438.653613 secs 2024-04-21T15:32:08.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:08 smithi077 ceph-mon[27902]: pgmap v9926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:08.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:08 smithi191 ceph-mon[31636]: pgmap v9926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:09.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:08 smithi170 ceph-mon[31212]: pgmap v9926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:09.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18440.415690 secs 2024-04-21T15:32:09.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18440.415690 secs 2024-04-21T15:32:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18440.415690 secs 2024-04-21T15:32:10.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:10.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:10 smithi077 ceph-mon[27902]: pgmap v9927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:10.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:10 smithi077 ceph-mon[27902]: osdmap e693: 12 total, 12 up, 12 in 2024-04-21T15:32:10.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:10 smithi191 ceph-mon[31636]: pgmap v9927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:10.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:10 smithi191 ceph-mon[31636]: osdmap e693: 12 total, 12 up, 12 in 2024-04-21T15:32:11.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:10 smithi170 ceph-mon[31212]: pgmap v9927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:32:11.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:10 smithi170 ceph-mon[31212]: osdmap e693: 12 total, 12 up, 12 in 2024-04-21T15:32:12.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:12 smithi077 ceph-mon[27902]: pgmap v9929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-04-21T15:32:12.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18443.653710 secs 2024-04-21T15:32:12.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:12 smithi191 ceph-mon[31636]: pgmap v9929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-04-21T15:32:12.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18443.653710 secs 2024-04-21T15:32:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:12 smithi170 ceph-mon[31212]: pgmap v9929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-04-21T15:32:13.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18443.653710 secs 2024-04-21T15:32:13.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:32:13.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:32:14.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:32:14.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:14 smithi077 ceph-mon[27902]: pgmap v9930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-04-21T15:32:14.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18445.415778 secs 2024-04-21T15:32:14.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:32:14.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:32:14.897 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:32:14.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:14 smithi191 ceph-mon[31636]: pgmap v9930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-04-21T15:32:14.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18445.415778 secs 2024-04-21T15:32:14.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:32:14.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:32:14.980 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:32:15.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:14 smithi170 ceph-mon[31212]: pgmap v9930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-04-21T15:32:15.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18445.415778 secs 2024-04-21T15:32:15.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:32:15.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:32:15.069 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:32:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:16.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:16 smithi077 ceph-mon[27902]: pgmap v9931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:16.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:16 smithi191 ceph-mon[31636]: pgmap v9931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:17.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:16 smithi170 ceph-mon[31212]: pgmap v9931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:17.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18448.653840 secs 2024-04-21T15:32:17.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18448.653840 secs 2024-04-21T15:32:18.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18448.653840 secs 2024-04-21T15:32:18.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:18 smithi077 ceph-mon[27902]: pgmap v9932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:18.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:18 smithi191 ceph-mon[31636]: pgmap v9932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:19.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:18 smithi170 ceph-mon[31212]: pgmap v9932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:19.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18450.415897 secs 2024-04-21T15:32:19.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18450.415897 secs 2024-04-21T15:32:20.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18450.415897 secs 2024-04-21T15:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:20.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:20 smithi077 ceph-mon[27902]: pgmap v9933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:20.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:20 smithi191 ceph-mon[31636]: pgmap v9933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:21.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:20 smithi170 ceph-mon[31212]: pgmap v9933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:32:22.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:22 smithi077 ceph-mon[27902]: pgmap v9934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:32:22.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18453.653948 secs 2024-04-21T15:32:22.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:22 smithi191 ceph-mon[31636]: pgmap v9934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:32:22.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18453.653948 secs 2024-04-21T15:32:23.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:22 smithi170 ceph-mon[31212]: pgmap v9934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:32:23.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18453.653948 secs 2024-04-21T15:32:24.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:24 smithi191 ceph-mon[31636]: pgmap v9935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:24.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18455.416023 secs 2024-04-21T15:32:25.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:24 smithi170 ceph-mon[31212]: pgmap v9935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:25.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18455.416023 secs 2024-04-21T15:32:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:25.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:24 smithi077 ceph-mon[27902]: pgmap v9935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:25.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18455.416023 secs 2024-04-21T15:32:26.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:26 smithi191 ceph-mon[31636]: pgmap v9936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:27.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:26 smithi170 ceph-mon[31212]: pgmap v9936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:27.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:26 smithi077 ceph-mon[27902]: pgmap v9936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:27.969 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18458.654024 secs 2024-04-21T15:32:27.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18458.654024 secs 2024-04-21T15:32:28.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18458.654024 secs 2024-04-21T15:32:28.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:28 smithi191 ceph-mon[31636]: pgmap v9937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:29.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:28 smithi170 ceph-mon[31212]: pgmap v9937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:29.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:28 smithi077 ceph-mon[27902]: pgmap v9937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:29.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18460.416149 secs 2024-04-21T15:32:30.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18460.416149 secs 2024-04-21T15:32:30.144 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:30.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18460.416149 secs 2024-04-21T15:32:30.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:30 smithi191 ceph-mon[31636]: pgmap v9938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:31.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:30 smithi170 ceph-mon[31212]: pgmap v9938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:31.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:30 smithi077 ceph-mon[27902]: pgmap v9938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:32.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:32 smithi191 ceph-mon[31636]: pgmap v9939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:32.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18463.654143 secs 2024-04-21T15:32:33.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:32 smithi170 ceph-mon[31212]: pgmap v9939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:33.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18463.654143 secs 2024-04-21T15:32:33.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:32 smithi077 ceph-mon[27902]: pgmap v9939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:33.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18463.654143 secs 2024-04-21T15:32:34.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:34 smithi191 ceph-mon[31636]: pgmap v9940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:34.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18465.416259 secs 2024-04-21T15:32:35.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:34 smithi170 ceph-mon[31212]: pgmap v9940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:35.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18465.416259 secs 2024-04-21T15:32:35.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:35.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:34 smithi077 ceph-mon[27902]: pgmap v9940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:35.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18465.416259 secs 2024-04-21T15:32:36.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:36 smithi191 ceph-mon[31636]: pgmap v9941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:37.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:36 smithi170 ceph-mon[31212]: pgmap v9941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:37.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:36 smithi077 ceph-mon[27902]: pgmap v9941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:37.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18468.654255 secs 2024-04-21T15:32:38.047 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18468.654255 secs 2024-04-21T15:32:38.068 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18468.654255 secs 2024-04-21T15:32:38.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:38 smithi191 ceph-mon[31636]: pgmap v9942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:39.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:38 smithi170 ceph-mon[31212]: pgmap v9942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:39.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:38 smithi077 ceph-mon[27902]: pgmap v9942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:39.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18470.416382 secs 2024-04-21T15:32:40.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18470.416382 secs 2024-04-21T15:32:40.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:40.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18470.416382 secs 2024-04-21T15:32:40.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:40 smithi191 ceph-mon[31636]: pgmap v9943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:41.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:40 smithi170 ceph-mon[31212]: pgmap v9943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:41.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:40 smithi077 ceph-mon[27902]: pgmap v9943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:42.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:42 smithi191 ceph-mon[31636]: pgmap v9944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:42.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18473.654374 secs 2024-04-21T15:32:43.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:42 smithi170 ceph-mon[31212]: pgmap v9944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:43.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18473.654374 secs 2024-04-21T15:32:43.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:42 smithi077 ceph-mon[27902]: pgmap v9944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:43.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18473.654374 secs 2024-04-21T15:32:44.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:44 smithi191 ceph-mon[31636]: pgmap v9945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:44.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18475.416499 secs 2024-04-21T15:32:45.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:44 smithi170 ceph-mon[31212]: pgmap v9945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:45.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18475.416499 secs 2024-04-21T15:32:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:45.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:44 smithi077 ceph-mon[27902]: pgmap v9945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:45.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18475.416499 secs 2024-04-21T15:32:46.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:46 smithi191 ceph-mon[31636]: pgmap v9946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:47.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:46 smithi170 ceph-mon[31212]: pgmap v9946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:47.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:46 smithi077 ceph-mon[27902]: pgmap v9946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:47.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18478.654504 secs 2024-04-21T15:32:48.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18478.654504 secs 2024-04-21T15:32:48.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18478.654504 secs 2024-04-21T15:32:48.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:48 smithi191 ceph-mon[31636]: pgmap v9947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:49.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:48 smithi170 ceph-mon[31212]: pgmap v9947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:49.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:48 smithi077 ceph-mon[27902]: pgmap v9947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:49.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18480.416621 secs 2024-04-21T15:32:50.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18480.416621 secs 2024-04-21T15:32:50.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:50.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18480.416621 secs 2024-04-21T15:32:50.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:50 smithi191 ceph-mon[31636]: pgmap v9948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:51.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:50 smithi170 ceph-mon[31212]: pgmap v9948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:51.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:50 smithi077 ceph-mon[27902]: pgmap v9948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:52.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:52 smithi191 ceph-mon[31636]: pgmap v9949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:52.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18483.654641 secs 2024-04-21T15:32:53.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:52 smithi170 ceph-mon[31212]: pgmap v9949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:53.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18483.654641 secs 2024-04-21T15:32:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:52 smithi077 ceph-mon[27902]: pgmap v9949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:53.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18483.654641 secs 2024-04-21T15:32:54.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:54 smithi191 ceph-mon[31636]: pgmap v9950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:54.979 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18485.416772 secs 2024-04-21T15:32:55.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:54 smithi170 ceph-mon[31212]: pgmap v9950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:55.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18485.416772 secs 2024-04-21T15:32:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:32:55.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:54 smithi077 ceph-mon[27902]: pgmap v9950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:55.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18485.416772 secs 2024-04-21T15:32:56.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:56 smithi191 ceph-mon[31636]: pgmap v9951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:57.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:56 smithi170 ceph-mon[31212]: pgmap v9951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:57.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:56 smithi077 ceph-mon[27902]: pgmap v9951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:32:57.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18488.654795 secs 2024-04-21T15:32:58.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18488.654795 secs 2024-04-21T15:32:58.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18488.654795 secs 2024-04-21T15:32:59.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:58 smithi170 ceph-mon[31212]: pgmap v9952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:59.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:58 smithi077 ceph-mon[27902]: pgmap v9952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:32:59.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:58 smithi191 ceph-mon[31636]: pgmap v9952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:00.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18490.416868 secs 2024-04-21T15:33:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:00.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18490.416868 secs 2024-04-21T15:33:00.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18490.416868 secs 2024-04-21T15:33:01.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:00 smithi170 ceph-mon[31212]: pgmap v9953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:01.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:00 smithi077 ceph-mon[27902]: pgmap v9953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:01.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:00 smithi191 ceph-mon[31636]: pgmap v9953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:03.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:02 smithi170 ceph-mon[31212]: pgmap v9954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:03.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18493.654908 secs 2024-04-21T15:33:03.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:02 smithi077 ceph-mon[27902]: pgmap v9954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:03.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18493.654908 secs 2024-04-21T15:33:03.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:02 smithi191 ceph-mon[31636]: pgmap v9954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:03.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18493.654908 secs 2024-04-21T15:33:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:04 smithi170 ceph-mon[31212]: pgmap v9955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18495.416980 secs 2024-04-21T15:33:05.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:04 smithi170 ceph-mon[31212]: osdmap e694: 12 total, 12 up, 12 in 2024-04-21T15:33:05.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:04 smithi077 ceph-mon[27902]: pgmap v9955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18495.416980 secs 2024-04-21T15:33:05.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:04 smithi077 ceph-mon[27902]: osdmap e694: 12 total, 12 up, 12 in 2024-04-21T15:33:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:04 smithi191 ceph-mon[31636]: pgmap v9955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:05.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18495.416980 secs 2024-04-21T15:33:05.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:04 smithi191 ceph-mon[31636]: osdmap e694: 12 total, 12 up, 12 in 2024-04-21T15:33:07.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:06 smithi170 ceph-mon[31212]: pgmap v9957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:07.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:06 smithi077 ceph-mon[27902]: pgmap v9957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:07.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:06 smithi191 ceph-mon[31636]: pgmap v9957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:08.047 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18498.655022 secs 2024-04-21T15:33:08.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18498.655022 secs 2024-04-21T15:33:08.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18498.655022 secs 2024-04-21T15:33:09.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:08 smithi170 ceph-mon[31212]: pgmap v9958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:09.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:08 smithi077 ceph-mon[27902]: pgmap v9958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:09.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:08 smithi191 ceph-mon[31636]: pgmap v9958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:10.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18500.417097 secs 2024-04-21T15:33:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:10.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18500.417097 secs 2024-04-21T15:33:10.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18500.417097 secs 2024-04-21T15:33:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:10 smithi170 ceph-mon[31212]: pgmap v9959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:11.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:10 smithi170 ceph-mon[31212]: osdmap e695: 12 total, 12 up, 12 in 2024-04-21T15:33:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:10 smithi077 ceph-mon[27902]: pgmap v9959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:11.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:10 smithi077 ceph-mon[27902]: osdmap e695: 12 total, 12 up, 12 in 2024-04-21T15:33:11.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:10 smithi191 ceph-mon[31636]: pgmap v9959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:33:11.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:10 smithi191 ceph-mon[31636]: osdmap e695: 12 total, 12 up, 12 in 2024-04-21T15:33:13.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:12 smithi170 ceph-mon[31212]: pgmap v9961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:33:13.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18503.655145 secs 2024-04-21T15:33:13.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:12 smithi077 ceph-mon[27902]: pgmap v9961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:33:13.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18503.655145 secs 2024-04-21T15:33:13.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:12 smithi191 ceph-mon[31636]: pgmap v9961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:33:13.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18503.655145 secs 2024-04-21T15:33:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:14 smithi170 ceph-mon[31212]: pgmap v9962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:33:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18505.417214 secs 2024-04-21T15:33:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:33:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:33:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:33:15.067 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:33:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:14 smithi077 ceph-mon[27902]: pgmap v9962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:33:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18505.417214 secs 2024-04-21T15:33:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:33:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:33:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:33:15.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:33:15.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:14 smithi191 ceph-mon[31636]: pgmap v9962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:33:15.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18505.417214 secs 2024-04-21T15:33:15.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:33:15.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:33:15.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:33:15.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:33:17.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:16 smithi170 ceph-mon[31212]: pgmap v9963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:17.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:16 smithi077 ceph-mon[27902]: pgmap v9963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:17.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:16 smithi191 ceph-mon[31636]: pgmap v9963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:18.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18508.655261 secs 2024-04-21T15:33:18.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18508.655261 secs 2024-04-21T15:33:18.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18508.655261 secs 2024-04-21T15:33:19.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:18 smithi170 ceph-mon[31212]: pgmap v9964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:19.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:18 smithi077 ceph-mon[27902]: pgmap v9964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:19.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:18 smithi191 ceph-mon[31636]: pgmap v9964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:20.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18510.417321 secs 2024-04-21T15:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:20.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18510.417321 secs 2024-04-21T15:33:20.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18510.417321 secs 2024-04-21T15:33:21.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:20 smithi170 ceph-mon[31212]: pgmap v9965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:21.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:20 smithi077 ceph-mon[27902]: pgmap v9965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:21.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:20 smithi191 ceph-mon[31636]: pgmap v9965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:33:23.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:22 smithi170 ceph-mon[31212]: pgmap v9966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:33:23.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18513.655352 secs 2024-04-21T15:33:23.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:22 smithi077 ceph-mon[27902]: pgmap v9966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:33:23.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18513.655352 secs 2024-04-21T15:33:23.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:22 smithi191 ceph-mon[31636]: pgmap v9966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:33:23.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18513.655352 secs 2024-04-21T15:33:25.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:24 smithi170 ceph-mon[31212]: pgmap v9967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:25.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18515.417447 secs 2024-04-21T15:33:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:25.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:24 smithi077 ceph-mon[27902]: pgmap v9967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:25.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18515.417447 secs 2024-04-21T15:33:25.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:24 smithi191 ceph-mon[31636]: pgmap v9967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:25.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18515.417447 secs 2024-04-21T15:33:27.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:26 smithi170 ceph-mon[31212]: pgmap v9968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:27.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:26 smithi077 ceph-mon[27902]: pgmap v9968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:27.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:26 smithi191 ceph-mon[31636]: pgmap v9968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:28.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18518.655464 secs 2024-04-21T15:33:28.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18518.655464 secs 2024-04-21T15:33:28.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18518.655464 secs 2024-04-21T15:33:29.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:28 smithi170 ceph-mon[31212]: pgmap v9969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:29.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:28 smithi077 ceph-mon[27902]: pgmap v9969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:29.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:28 smithi191 ceph-mon[31636]: pgmap v9969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:30.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18520.417558 secs 2024-04-21T15:33:30.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:30.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18520.417558 secs 2024-04-21T15:33:30.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18520.417558 secs 2024-04-21T15:33:31.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:30 smithi170 ceph-mon[31212]: pgmap v9970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:31.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:30 smithi077 ceph-mon[27902]: pgmap v9970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:31.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:30 smithi191 ceph-mon[31636]: pgmap v9970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:33.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:32 smithi077 ceph-mon[27902]: pgmap v9971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:33.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18523.655607 secs 2024-04-21T15:33:33.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:32 smithi191 ceph-mon[31636]: pgmap v9971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:33.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18523.655607 secs 2024-04-21T15:33:33.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:32 smithi170 ceph-mon[31212]: pgmap v9971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:33.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18523.655607 secs 2024-04-21T15:33:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:35.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:34 smithi077 ceph-mon[27902]: pgmap v9972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:35.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18525.417657 secs 2024-04-21T15:33:35.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:34 smithi191 ceph-mon[31636]: pgmap v9972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:35.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18525.417657 secs 2024-04-21T15:33:35.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:34 smithi170 ceph-mon[31212]: pgmap v9972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:35.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18525.417657 secs 2024-04-21T15:33:37.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:36 smithi077 ceph-mon[27902]: pgmap v9973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:37.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:36 smithi191 ceph-mon[31636]: pgmap v9973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:37.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:36 smithi170 ceph-mon[31212]: pgmap v9973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:38.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18528.655728 secs 2024-04-21T15:33:38.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18528.655728 secs 2024-04-21T15:33:38.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18528.655728 secs 2024-04-21T15:33:39.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:38 smithi077 ceph-mon[27902]: pgmap v9974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:39.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:38 smithi191 ceph-mon[31636]: pgmap v9974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:39.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:38 smithi170 ceph-mon[31212]: pgmap v9974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:40.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:40.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18530.417779 secs 2024-04-21T15:33:40.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18530.417779 secs 2024-04-21T15:33:40.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18530.417779 secs 2024-04-21T15:33:41.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:40 smithi077 ceph-mon[27902]: pgmap v9975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:41.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:40 smithi191 ceph-mon[31636]: pgmap v9975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:41.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:40 smithi170 ceph-mon[31212]: pgmap v9975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:43.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:42 smithi077 ceph-mon[27902]: pgmap v9976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:43.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18533.655847 secs 2024-04-21T15:33:43.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:42 smithi191 ceph-mon[31636]: pgmap v9976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:43.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18533.655847 secs 2024-04-21T15:33:43.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:42 smithi170 ceph-mon[31212]: pgmap v9976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:43.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18533.655847 secs 2024-04-21T15:33:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:44 smithi077 ceph-mon[27902]: pgmap v9977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18535.417911 secs 2024-04-21T15:33:45.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:44 smithi191 ceph-mon[31636]: pgmap v9977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:45.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18535.417911 secs 2024-04-21T15:33:45.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:44 smithi170 ceph-mon[31212]: pgmap v9977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:45.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18535.417911 secs 2024-04-21T15:33:47.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:46 smithi077 ceph-mon[27902]: pgmap v9978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:47.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:46 smithi191 ceph-mon[31636]: pgmap v9978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:47.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:46 smithi170 ceph-mon[31212]: pgmap v9978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:48.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18538.655953 secs 2024-04-21T15:33:48.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18538.655953 secs 2024-04-21T15:33:48.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18538.655953 secs 2024-04-21T15:33:49.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:48 smithi077 ceph-mon[27902]: pgmap v9979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:49.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:48 smithi191 ceph-mon[31636]: pgmap v9979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:49.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:48 smithi170 ceph-mon[31212]: pgmap v9979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:50.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18540.417993 secs 2024-04-21T15:33:50.229 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18540.417993 secs 2024-04-21T15:33:50.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18540.417993 secs 2024-04-21T15:33:51.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:50 smithi077 ceph-mon[27902]: pgmap v9980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:51.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:50 smithi191 ceph-mon[31636]: pgmap v9980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:51.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:50 smithi170 ceph-mon[31212]: pgmap v9980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:33:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:52 smithi077 ceph-mon[27902]: pgmap v9981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:53.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18543.656066 secs 2024-04-21T15:33:53.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:52 smithi191 ceph-mon[31636]: pgmap v9981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:53.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18543.656066 secs 2024-04-21T15:33:53.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:52 smithi170 ceph-mon[31212]: pgmap v9981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:53.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18543.656066 secs 2024-04-21T15:33:55.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:33:55.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:54 smithi077 ceph-mon[27902]: pgmap v9982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:55.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18545.418109 secs 2024-04-21T15:33:55.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:54 smithi191 ceph-mon[31636]: pgmap v9982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:55.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18545.418109 secs 2024-04-21T15:33:55.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:54 smithi170 ceph-mon[31212]: pgmap v9982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:55.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18545.418109 secs 2024-04-21T15:33:57.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:56 smithi077 ceph-mon[27902]: pgmap v9983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:57.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:56 smithi191 ceph-mon[31636]: pgmap v9983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:57.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:56 smithi170 ceph-mon[31212]: pgmap v9983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:33:58.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18548.656179 secs 2024-04-21T15:33:58.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18548.656179 secs 2024-04-21T15:33:58.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18548.656179 secs 2024-04-21T15:33:59.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:58 smithi077 ceph-mon[27902]: pgmap v9984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:59.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:58 smithi191 ceph-mon[31636]: pgmap v9984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:33:59.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:58 smithi170 ceph-mon[31212]: pgmap v9984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:00.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:33:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18550.418233 secs 2024-04-21T15:34:00.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:33:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18550.418233 secs 2024-04-21T15:34:00.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:33:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18550.418233 secs 2024-04-21T15:34:01.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:00 smithi191 ceph-mon[31636]: pgmap v9985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:01.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:00 smithi170 ceph-mon[31212]: pgmap v9985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:01.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:00 smithi077 ceph-mon[27902]: pgmap v9985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:03.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:02 smithi191 ceph-mon[31636]: pgmap v9986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:03.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18553.656320 secs 2024-04-21T15:34:03.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:02 smithi170 ceph-mon[31212]: pgmap v9986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:03.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18553.656320 secs 2024-04-21T15:34:03.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:02 smithi077 ceph-mon[27902]: pgmap v9986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:03.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18553.656320 secs 2024-04-21T15:34:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:05.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:04 smithi191 ceph-mon[31636]: pgmap v9987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18555.418368 secs 2024-04-21T15:34:05.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:04 smithi191 ceph-mon[31636]: osdmap e696: 12 total, 12 up, 12 in 2024-04-21T15:34:05.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:04 smithi170 ceph-mon[31212]: pgmap v9987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:05.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18555.418368 secs 2024-04-21T15:34:05.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:04 smithi170 ceph-mon[31212]: osdmap e696: 12 total, 12 up, 12 in 2024-04-21T15:34:05.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:04 smithi077 ceph-mon[27902]: pgmap v9987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:05.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18555.418368 secs 2024-04-21T15:34:05.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:04 smithi077 ceph-mon[27902]: osdmap e696: 12 total, 12 up, 12 in 2024-04-21T15:34:07.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:06 smithi191 ceph-mon[31636]: pgmap v9989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:07.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:06 smithi170 ceph-mon[31212]: pgmap v9989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:07.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:06 smithi077 ceph-mon[27902]: pgmap v9989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:08.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18558.656470 secs 2024-04-21T15:34:08.295 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18558.656470 secs 2024-04-21T15:34:08.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18558.656470 secs 2024-04-21T15:34:09.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:08 smithi191 ceph-mon[31636]: pgmap v9990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:09.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:08 smithi170 ceph-mon[31212]: pgmap v9990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:09.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:08 smithi077 ceph-mon[27902]: pgmap v9990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:10.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:10.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18560.418487 secs 2024-04-21T15:34:10.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18560.418487 secs 2024-04-21T15:34:10.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18560.418487 secs 2024-04-21T15:34:11.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:10 smithi191 ceph-mon[31636]: pgmap v9991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:11.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:10 smithi191 ceph-mon[31636]: osdmap e697: 12 total, 12 up, 12 in 2024-04-21T15:34:11.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:10 smithi170 ceph-mon[31212]: pgmap v9991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:11.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:10 smithi170 ceph-mon[31212]: osdmap e697: 12 total, 12 up, 12 in 2024-04-21T15:34:11.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:10 smithi077 ceph-mon[27902]: pgmap v9991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:34:11.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:10 smithi077 ceph-mon[27902]: osdmap e697: 12 total, 12 up, 12 in 2024-04-21T15:34:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:11.919+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:34:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:11.919+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:34:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:11.922+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:34:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:11.922+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:34:13.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:12 smithi191 ceph-mon[31636]: pgmap v9993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:34:13.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18563.656608 secs 2024-04-21T15:34:13.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:12 smithi170 ceph-mon[31212]: pgmap v9993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:34:13.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18563.656608 secs 2024-04-21T15:34:13.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:12 smithi077 ceph-mon[27902]: pgmap v9993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:34:13.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18563.656608 secs 2024-04-21T15:34:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:15.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:14 smithi191 ceph-mon[31636]: pgmap v9994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:34:15.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18565.418622 secs 2024-04-21T15:34:15.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:34:15.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:14 smithi170 ceph-mon[31212]: pgmap v9994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:34:15.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18565.418622 secs 2024-04-21T15:34:15.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:34:15.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:14 smithi077 ceph-mon[27902]: pgmap v9994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:34:15.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18565.418622 secs 2024-04-21T15:34:15.395 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:34:16.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:34:16.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:34:16.228 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:34:16.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:34:16.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:34:16.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:34:16.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:34:16.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:34:16.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:34:17.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:16 smithi191 ceph-mon[31636]: pgmap v9995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:17.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:16 smithi170 ceph-mon[31212]: pgmap v9995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:17.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:16 smithi077 ceph-mon[27902]: pgmap v9995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:18.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18568.656773 secs 2024-04-21T15:34:18.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18568.656773 secs 2024-04-21T15:34:18.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18568.656773 secs 2024-04-21T15:34:19.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:18 smithi191 ceph-mon[31636]: pgmap v9996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:19.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:18 smithi170 ceph-mon[31212]: pgmap v9996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:19.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:18 smithi077 ceph-mon[27902]: pgmap v9996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:20.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18570.418743 secs 2024-04-21T15:34:20.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18570.418743 secs 2024-04-21T15:34:20.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18570.418743 secs 2024-04-21T15:34:21.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:20 smithi191 ceph-mon[31636]: pgmap v9997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:21.316 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:20 smithi170 ceph-mon[31212]: pgmap v9997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:21.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:20 smithi077 ceph-mon[27902]: pgmap v9997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:34:22.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:21 smithi191 ceph-mon[31636]: pgmap v9998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:34:22.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:21 smithi170 ceph-mon[31212]: pgmap v9998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:34:22.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:21 smithi077 ceph-mon[27902]: pgmap v9998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:34:23.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18573.656887 secs 2024-04-21T15:34:23.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18573.656887 secs 2024-04-21T15:34:23.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18573.656887 secs 2024-04-21T15:34:24.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:23 smithi191 ceph-mon[31636]: pgmap v9999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:24.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18575.418882 secs 2024-04-21T15:34:24.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:23 smithi170 ceph-mon[31212]: pgmap v9999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:24.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18575.418882 secs 2024-04-21T15:34:24.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:23 smithi077 ceph-mon[27902]: pgmap v9999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:24.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18575.418882 secs 2024-04-21T15:34:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:26.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:26 smithi077 ceph-mon[27902]: pgmap v10000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:26.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:26 smithi191 ceph-mon[31636]: pgmap v10000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:27.018 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:26 smithi170 ceph-mon[31212]: pgmap v10000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:27.879 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18578.656972 secs 2024-04-21T15:34:27.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18578.656972 secs 2024-04-21T15:34:28.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18578.656972 secs 2024-04-21T15:34:28.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:28 smithi077 ceph-mon[27902]: pgmap v10001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:28.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:28 smithi191 ceph-mon[31636]: pgmap v10001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:29.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:28 smithi170 ceph-mon[31212]: pgmap v10001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:29.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18580.419003 secs 2024-04-21T15:34:29.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18580.419003 secs 2024-04-21T15:34:30.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18580.419003 secs 2024-04-21T15:34:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:30.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:30 smithi077 ceph-mon[27902]: pgmap v10002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:30.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:30 smithi191 ceph-mon[31636]: pgmap v10002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:31.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:30 smithi170 ceph-mon[31212]: pgmap v10002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:32.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:32 smithi077 ceph-mon[27902]: pgmap v10003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:32.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18583.657075 secs 2024-04-21T15:34:32.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:32 smithi191 ceph-mon[31636]: pgmap v10003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:32.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18583.657075 secs 2024-04-21T15:34:33.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:32 smithi170 ceph-mon[31212]: pgmap v10003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:33.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18583.657075 secs 2024-04-21T15:34:34.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:34 smithi077 ceph-mon[27902]: pgmap v10004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:34.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18585.419114 secs 2024-04-21T15:34:34.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:34 smithi191 ceph-mon[31636]: pgmap v10004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:34.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18585.419114 secs 2024-04-21T15:34:35.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:34 smithi170 ceph-mon[31212]: pgmap v10004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:35.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18585.419114 secs 2024-04-21T15:34:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:36.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:36 smithi077 ceph-mon[27902]: pgmap v10005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:36.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:36 smithi191 ceph-mon[31636]: pgmap v10005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:37.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:36 smithi170 ceph-mon[31212]: pgmap v10005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:37.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18588.657203 secs 2024-04-21T15:34:37.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18588.657203 secs 2024-04-21T15:34:38.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18588.657203 secs 2024-04-21T15:34:38.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:38 smithi077 ceph-mon[27902]: pgmap v10006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:38.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:38 smithi191 ceph-mon[31636]: pgmap v10006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:39.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:38 smithi170 ceph-mon[31212]: pgmap v10006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:39.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18590.419206 secs 2024-04-21T15:34:39.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18590.419206 secs 2024-04-21T15:34:40.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18590.419206 secs 2024-04-21T15:34:40.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:40.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:40 smithi077 ceph-mon[27902]: pgmap v10007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:40.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:40 smithi191 ceph-mon[31636]: pgmap v10007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:41.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:40 smithi170 ceph-mon[31212]: pgmap v10007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:42.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:42 smithi191 ceph-mon[31636]: pgmap v10008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:42.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18593.657299 secs 2024-04-21T15:34:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:42 smithi170 ceph-mon[31212]: pgmap v10008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18593.657299 secs 2024-04-21T15:34:43.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:42 smithi077 ceph-mon[27902]: pgmap v10008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:43.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18593.657299 secs 2024-04-21T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:44 smithi191 ceph-mon[31636]: pgmap v10009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18595.419322 secs 2024-04-21T15:34:45.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:44 smithi170 ceph-mon[31212]: pgmap v10009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:45.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18595.419322 secs 2024-04-21T15:34:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:44 smithi077 ceph-mon[27902]: pgmap v10009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:45.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18595.419322 secs 2024-04-21T15:34:46.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:46 smithi191 ceph-mon[31636]: pgmap v10010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:47.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:46 smithi170 ceph-mon[31212]: pgmap v10010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:47.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:46 smithi077 ceph-mon[27902]: pgmap v10010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:47.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18598.657408 secs 2024-04-21T15:34:48.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18598.657408 secs 2024-04-21T15:34:48.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18598.657408 secs 2024-04-21T15:34:48.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:48 smithi191 ceph-mon[31636]: pgmap v10011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:49.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:48 smithi170 ceph-mon[31212]: pgmap v10011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:49.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:48 smithi077 ceph-mon[27902]: pgmap v10011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:49.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18600.419466 secs 2024-04-21T15:34:50.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18600.419466 secs 2024-04-21T15:34:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:50.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18600.419466 secs 2024-04-21T15:34:50.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:50 smithi191 ceph-mon[31636]: pgmap v10012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:51.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:50 smithi170 ceph-mon[31212]: pgmap v10012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:51.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:50 smithi077 ceph-mon[27902]: pgmap v10012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:52.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:52 smithi191 ceph-mon[31636]: pgmap v10013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:52.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18603.657547 secs 2024-04-21T15:34:53.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:52 smithi170 ceph-mon[31212]: pgmap v10013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:53.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18603.657547 secs 2024-04-21T15:34:53.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:52 smithi077 ceph-mon[27902]: pgmap v10013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:53.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18603.657547 secs 2024-04-21T15:34:54.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18605.419590 secs 2024-04-21T15:34:54.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:54 smithi191 ceph-mon[31636]: pgmap v10014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:55.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18605.419590 secs 2024-04-21T15:34:55.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:54 smithi170 ceph-mon[31212]: pgmap v10014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:34:55.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18605.419590 secs 2024-04-21T15:34:55.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:54 smithi077 ceph-mon[27902]: pgmap v10014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:56.925+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:34:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:56.925+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:34:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:56.926+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:34:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:34:56.926+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:34:56.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:56 smithi191 ceph-mon[31636]: pgmap v10015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:57.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:56 smithi170 ceph-mon[31212]: pgmap v10015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:57.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:56 smithi077 ceph-mon[27902]: pgmap v10015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:34:57.966 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18608.657666 secs 2024-04-21T15:34:57.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18608.657666 secs 2024-04-21T15:34:58.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18608.657666 secs 2024-04-21T15:34:58.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:58 smithi191 ceph-mon[31636]: pgmap v10016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:59.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:58 smithi170 ceph-mon[31212]: pgmap v10016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:59.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:58 smithi077 ceph-mon[27902]: pgmap v10016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:34:59.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18610.419679 secs 2024-04-21T15:35:00.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18610.419679 secs 2024-04-21T15:35:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:00.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18610.419679 secs 2024-04-21T15:35:00.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:00 smithi191 ceph-mon[31636]: pgmap v10017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:01.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:00 smithi170 ceph-mon[31212]: pgmap v10017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:01.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:00 smithi077 ceph-mon[27902]: pgmap v10017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:02.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:02 smithi191 ceph-mon[31636]: pgmap v10018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:02.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18613.657805 secs 2024-04-21T15:35:03.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:02 smithi170 ceph-mon[31212]: pgmap v10018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:03.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18613.657805 secs 2024-04-21T15:35:03.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:02 smithi077 ceph-mon[27902]: pgmap v10018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:03.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18613.657805 secs 2024-04-21T15:35:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18615.419797 secs 2024-04-21T15:35:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:04 smithi191 ceph-mon[31636]: pgmap v10019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:04.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:04 smithi191 ceph-mon[31636]: osdmap e698: 12 total, 12 up, 12 in 2024-04-21T15:35:05.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18615.419797 secs 2024-04-21T15:35:05.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:04 smithi170 ceph-mon[31212]: pgmap v10019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:05.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:04 smithi170 ceph-mon[31212]: osdmap e698: 12 total, 12 up, 12 in 2024-04-21T15:35:05.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18615.419797 secs 2024-04-21T15:35:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:04 smithi077 ceph-mon[27902]: pgmap v10019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:05.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:04 smithi077 ceph-mon[27902]: osdmap e698: 12 total, 12 up, 12 in 2024-04-21T15:35:06.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:06 smithi191 ceph-mon[31636]: pgmap v10021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:07.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:06 smithi170 ceph-mon[31212]: pgmap v10021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:07.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:06 smithi077 ceph-mon[27902]: pgmap v10021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:07.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18618.657938 secs 2024-04-21T15:35:08.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18618.657938 secs 2024-04-21T15:35:08.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18618.657938 secs 2024-04-21T15:35:08.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:08 smithi191 ceph-mon[31636]: pgmap v10022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:09.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:08 smithi170 ceph-mon[31212]: pgmap v10022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:09.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:08 smithi077 ceph-mon[27902]: pgmap v10022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:09.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18620.419890 secs 2024-04-21T15:35:10.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18620.419890 secs 2024-04-21T15:35:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:10.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18620.419890 secs 2024-04-21T15:35:10.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:10 smithi191 ceph-mon[31636]: pgmap v10023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:10.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:10 smithi191 ceph-mon[31636]: osdmap e699: 12 total, 12 up, 12 in 2024-04-21T15:35:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:10 smithi170 ceph-mon[31212]: pgmap v10023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:11.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:10 smithi170 ceph-mon[31212]: osdmap e699: 12 total, 12 up, 12 in 2024-04-21T15:35:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:10 smithi077 ceph-mon[27902]: pgmap v10023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:35:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:10 smithi077 ceph-mon[27902]: osdmap e699: 12 total, 12 up, 12 in 2024-04-21T15:35:12.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:12 smithi191 ceph-mon[31636]: pgmap v10025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:35:12.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18623.658052 secs 2024-04-21T15:35:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:12 smithi170 ceph-mon[31212]: pgmap v10025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:35:13.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18623.658052 secs 2024-04-21T15:35:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:12 smithi077 ceph-mon[27902]: pgmap v10025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:35:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18623.658052 secs 2024-04-21T15:35:15.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18625.420013 secs 2024-04-21T15:35:15.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:14 smithi170 ceph-mon[31212]: pgmap v10026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:35:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:15.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18625.420013 secs 2024-04-21T15:35:15.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:14 smithi077 ceph-mon[27902]: pgmap v10026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:35:15.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18625.420013 secs 2024-04-21T15:35:15.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:14 smithi191 ceph-mon[31636]: pgmap v10026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:35:16.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:35:16.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:35:16.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:35:17.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:16 smithi170 ceph-mon[31212]: pgmap v10027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:17.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:35:17.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:35:17.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:35:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:16 smithi077 ceph-mon[27902]: pgmap v10027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:35:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:35:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:35:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:16 smithi191 ceph-mon[31636]: pgmap v10027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:35:17.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:35:17.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:35:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18628.658140 secs 2024-04-21T15:35:18.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18628.658140 secs 2024-04-21T15:35:18.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18628.658140 secs 2024-04-21T15:35:19.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:18 smithi170 ceph-mon[31212]: pgmap v10028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:19.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:18 smithi077 ceph-mon[27902]: pgmap v10028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:19.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:18 smithi191 ceph-mon[31636]: pgmap v10028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:20.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18630.420130 secs 2024-04-21T15:35:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:20.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18630.420130 secs 2024-04-21T15:35:20.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18630.420130 secs 2024-04-21T15:35:21.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:20 smithi170 ceph-mon[31212]: pgmap v10029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:21.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:20 smithi077 ceph-mon[27902]: pgmap v10029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:21.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:20 smithi191 ceph-mon[31636]: pgmap v10029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:35:23.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:22 smithi170 ceph-mon[31212]: pgmap v10030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:35:23.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18633.658290 secs 2024-04-21T15:35:23.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:22 smithi077 ceph-mon[27902]: pgmap v10030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:35:23.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18633.658290 secs 2024-04-21T15:35:23.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:22 smithi191 ceph-mon[31636]: pgmap v10030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:35:23.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18633.658290 secs 2024-04-21T15:35:25.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18635.420248 secs 2024-04-21T15:35:25.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:24 smithi170 ceph-mon[31212]: pgmap v10031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:25.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18635.420248 secs 2024-04-21T15:35:25.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:24 smithi077 ceph-mon[27902]: pgmap v10031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:25.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18635.420248 secs 2024-04-21T15:35:25.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:24 smithi191 ceph-mon[31636]: pgmap v10031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:27.029 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:26 smithi191 ceph-mon[31636]: pgmap v10032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:27.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:26 smithi170 ceph-mon[31212]: pgmap v10032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:27.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:26 smithi077 ceph-mon[27902]: pgmap v10032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:28.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18638.658375 secs 2024-04-21T15:35:28.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18638.658375 secs 2024-04-21T15:35:28.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18638.658375 secs 2024-04-21T15:35:29.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:28 smithi170 ceph-mon[31212]: pgmap v10033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:29.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:28 smithi077 ceph-mon[27902]: pgmap v10033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:29.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:28 smithi191 ceph-mon[31636]: pgmap v10033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:30.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18640.420319 secs 2024-04-21T15:35:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:30.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18640.420319 secs 2024-04-21T15:35:30.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18640.420319 secs 2024-04-21T15:35:31.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:30 smithi170 ceph-mon[31212]: pgmap v10034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:31.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:30 smithi077 ceph-mon[27902]: pgmap v10034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:31.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:30 smithi191 ceph-mon[31636]: pgmap v10034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:33.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:32 smithi170 ceph-mon[31212]: pgmap v10035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:33.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18643.658456 secs 2024-04-21T15:35:33.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:32 smithi077 ceph-mon[27902]: pgmap v10035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:33.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18643.658456 secs 2024-04-21T15:35:33.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:32 smithi191 ceph-mon[31636]: pgmap v10035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:33.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18643.658456 secs 2024-04-21T15:35:35.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18645.420431 secs 2024-04-21T15:35:35.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:34 smithi170 ceph-mon[31212]: pgmap v10036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:35.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18645.420431 secs 2024-04-21T15:35:35.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:34 smithi077 ceph-mon[27902]: pgmap v10036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:35.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18645.420431 secs 2024-04-21T15:35:35.227 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:34 smithi191 ceph-mon[31636]: pgmap v10036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:37.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:36 smithi170 ceph-mon[31212]: pgmap v10037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:37.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:36 smithi077 ceph-mon[27902]: pgmap v10037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:37.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:36 smithi191 ceph-mon[31636]: pgmap v10037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:38.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18648.658588 secs 2024-04-21T15:35:38.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18648.658588 secs 2024-04-21T15:35:38.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18648.658588 secs 2024-04-21T15:35:39.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:38 smithi170 ceph-mon[31212]: pgmap v10038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:39.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:38 smithi077 ceph-mon[27902]: pgmap v10038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:39.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:38 smithi191 ceph-mon[31636]: pgmap v10038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:40.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18650.420573 secs 2024-04-21T15:35:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:40.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18650.420573 secs 2024-04-21T15:35:40.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18650.420573 secs 2024-04-21T15:35:41.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:40 smithi170 ceph-mon[31212]: pgmap v10039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:41.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:40 smithi077 ceph-mon[27902]: pgmap v10039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:41.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:40 smithi191 ceph-mon[31636]: pgmap v10039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:42 smithi170 ceph-mon[31212]: pgmap v10040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:43.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18653.658730 secs 2024-04-21T15:35:43.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:42 smithi077 ceph-mon[27902]: pgmap v10040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:43.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18653.658730 secs 2024-04-21T15:35:43.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:42 smithi191 ceph-mon[31636]: pgmap v10040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:43.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18653.658730 secs 2024-04-21T15:35:45.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18655.420693 secs 2024-04-21T15:35:45.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:44 smithi170 ceph-mon[31212]: pgmap v10041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:45.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18655.420693 secs 2024-04-21T15:35:45.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:44 smithi077 ceph-mon[27902]: pgmap v10041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:45.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18655.420693 secs 2024-04-21T15:35:45.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:44 smithi191 ceph-mon[31636]: pgmap v10041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:47.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:46 smithi170 ceph-mon[31212]: pgmap v10042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:47.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:46 smithi077 ceph-mon[27902]: pgmap v10042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:47.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:46 smithi191 ceph-mon[31636]: pgmap v10042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:48.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18658.658848 secs 2024-04-21T15:35:48.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18658.658848 secs 2024-04-21T15:35:48.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18658.658848 secs 2024-04-21T15:35:49.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:48 smithi077 ceph-mon[27902]: pgmap v10043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:49.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:48 smithi191 ceph-mon[31636]: pgmap v10043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:49.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:48 smithi170 ceph-mon[31212]: pgmap v10043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18660.420792 secs 2024-04-21T15:35:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18660.420792 secs 2024-04-21T15:35:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18660.420792 secs 2024-04-21T15:35:51.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:50 smithi077 ceph-mon[27902]: pgmap v10044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:51.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:50 smithi191 ceph-mon[31636]: pgmap v10044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:51.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:50 smithi170 ceph-mon[31212]: pgmap v10044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:53.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:52 smithi077 ceph-mon[27902]: pgmap v10045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:53.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18663.658910 secs 2024-04-21T15:35:53.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:52 smithi191 ceph-mon[31636]: pgmap v10045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:53.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18663.658910 secs 2024-04-21T15:35:53.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:52 smithi170 ceph-mon[31212]: pgmap v10045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:53.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18663.658910 secs 2024-04-21T15:35:55.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:35:55.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18665.420885 secs 2024-04-21T15:35:55.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:54 smithi077 ceph-mon[27902]: pgmap v10046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:55.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18665.420885 secs 2024-04-21T15:35:55.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:54 smithi191 ceph-mon[31636]: pgmap v10046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:55.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18665.420885 secs 2024-04-21T15:35:55.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:54 smithi170 ceph-mon[31212]: pgmap v10046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:57.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:56 smithi170 ceph-mon[31212]: pgmap v10047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:57.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:56 smithi077 ceph-mon[27902]: pgmap v10047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:57.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:56 smithi191 ceph-mon[31636]: pgmap v10047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:35:58.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18668.658974 secs 2024-04-21T15:35:58.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18668.658974 secs 2024-04-21T15:35:58.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18668.658974 secs 2024-04-21T15:35:59.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:58 smithi077 ceph-mon[27902]: pgmap v10048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:59.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:58 smithi191 ceph-mon[31636]: pgmap v10048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:35:59.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:58 smithi170 ceph-mon[31212]: pgmap v10048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:00.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18670.420997 secs 2024-04-21T15:36:00.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18670.420997 secs 2024-04-21T15:36:00.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18670.420997 secs 2024-04-21T15:36:01.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:00 smithi077 ceph-mon[27902]: pgmap v10049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:01.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:00 smithi191 ceph-mon[31636]: pgmap v10049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:01.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:00 smithi170 ceph-mon[31212]: pgmap v10049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:03.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:02 smithi077 ceph-mon[27902]: pgmap v10050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:03.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18673.659073 secs 2024-04-21T15:36:03.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:02 smithi191 ceph-mon[31636]: pgmap v10050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:03.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18673.659073 secs 2024-04-21T15:36:03.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:02 smithi170 ceph-mon[31212]: pgmap v10050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:03.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18673.659073 secs 2024-04-21T15:36:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18675.421115 secs 2024-04-21T15:36:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:04 smithi077 ceph-mon[27902]: pgmap v10051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:05.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:04 smithi077 ceph-mon[27902]: osdmap e700: 12 total, 12 up, 12 in 2024-04-21T15:36:05.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18675.421115 secs 2024-04-21T15:36:05.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:04 smithi191 ceph-mon[31636]: pgmap v10051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:05.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:04 smithi191 ceph-mon[31636]: osdmap e700: 12 total, 12 up, 12 in 2024-04-21T15:36:05.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18675.421115 secs 2024-04-21T15:36:05.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:04 smithi170 ceph-mon[31212]: pgmap v10051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:05.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:04 smithi170 ceph-mon[31212]: osdmap e700: 12 total, 12 up, 12 in 2024-04-21T15:36:07.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:06 smithi077 ceph-mon[27902]: pgmap v10053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:07.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:06 smithi191 ceph-mon[31636]: pgmap v10053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:07.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:06 smithi170 ceph-mon[31212]: pgmap v10053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:08.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18678.659179 secs 2024-04-21T15:36:08.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18678.659179 secs 2024-04-21T15:36:08.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18678.659179 secs 2024-04-21T15:36:09.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:08 smithi077 ceph-mon[27902]: pgmap v10054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:09.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:08 smithi191 ceph-mon[31636]: pgmap v10054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:09.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:08 smithi170 ceph-mon[31212]: pgmap v10054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:10.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18680.421203 secs 2024-04-21T15:36:10.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18680.421203 secs 2024-04-21T15:36:10.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18680.421203 secs 2024-04-21T15:36:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:10 smithi077 ceph-mon[27902]: pgmap v10055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:11.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:10 smithi077 ceph-mon[27902]: osdmap e701: 12 total, 12 up, 12 in 2024-04-21T15:36:11.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:10 smithi191 ceph-mon[31636]: pgmap v10055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:11.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:10 smithi191 ceph-mon[31636]: osdmap e701: 12 total, 12 up, 12 in 2024-04-21T15:36:11.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:10 smithi170 ceph-mon[31212]: pgmap v10055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:36:11.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:10 smithi170 ceph-mon[31212]: osdmap e701: 12 total, 12 up, 12 in 2024-04-21T15:36:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:12 smithi077 ceph-mon[27902]: pgmap v10057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:36:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18683.659279 secs 2024-04-21T15:36:13.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:12 smithi191 ceph-mon[31636]: pgmap v10057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:36:13.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18683.659279 secs 2024-04-21T15:36:13.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:12 smithi170 ceph-mon[31212]: pgmap v10057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:36:13.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18683.659279 secs 2024-04-21T15:36:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18685.421280 secs 2024-04-21T15:36:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:14 smithi077 ceph-mon[27902]: pgmap v10058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:36:15.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18685.421280 secs 2024-04-21T15:36:15.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:14 smithi191 ceph-mon[31636]: pgmap v10058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:36:15.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18685.421280 secs 2024-04-21T15:36:15.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:14 smithi170 ceph-mon[31212]: pgmap v10058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T15:36:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:16 smithi191 ceph-mon[31636]: pgmap v10059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:36:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:36:17.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:36:17.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:16 smithi170 ceph-mon[31212]: pgmap v10059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:17.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:36:17.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:36:17.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:36:17.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:16 smithi077 ceph-mon[27902]: pgmap v10059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:17.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:36:17.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:36:17.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:36:18.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18688.659416 secs 2024-04-21T15:36:18.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:36:18.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18688.659416 secs 2024-04-21T15:36:18.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:36:18.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18688.659416 secs 2024-04-21T15:36:18.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:36:19.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:18 smithi191 ceph-mon[31636]: pgmap v10060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:19.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:18 smithi170 ceph-mon[31212]: pgmap v10060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:19.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:18 smithi077 ceph-mon[27902]: pgmap v10060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:20.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18690.421396 secs 2024-04-21T15:36:20.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18690.421396 secs 2024-04-21T15:36:20.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18690.421396 secs 2024-04-21T15:36:21.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:20 smithi191 ceph-mon[31636]: pgmap v10061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:20 smithi170 ceph-mon[31212]: pgmap v10061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:21.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:20 smithi077 ceph-mon[27902]: pgmap v10061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:36:23.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:22 smithi191 ceph-mon[31636]: pgmap v10062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:36:23.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18693.659533 secs 2024-04-21T15:36:23.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:22 smithi170 ceph-mon[31212]: pgmap v10062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:36:23.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18693.659533 secs 2024-04-21T15:36:23.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:22 smithi077 ceph-mon[27902]: pgmap v10062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:36:23.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18693.659533 secs 2024-04-21T15:36:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:25.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18695.421511 secs 2024-04-21T15:36:25.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:24 smithi191 ceph-mon[31636]: pgmap v10063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:25.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18695.421511 secs 2024-04-21T15:36:25.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:24 smithi170 ceph-mon[31212]: pgmap v10063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:25.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18695.421511 secs 2024-04-21T15:36:25.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:24 smithi077 ceph-mon[27902]: pgmap v10063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:27.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:26 smithi191 ceph-mon[31636]: pgmap v10064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:27.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:26 smithi170 ceph-mon[31212]: pgmap v10064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:27.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:26 smithi077 ceph-mon[27902]: pgmap v10064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:28.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18698.659638 secs 2024-04-21T15:36:28.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18698.659638 secs 2024-04-21T15:36:28.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18698.659638 secs 2024-04-21T15:36:29.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:28 smithi191 ceph-mon[31636]: pgmap v10065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:29.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:28 smithi170 ceph-mon[31212]: pgmap v10065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:29.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:28 smithi077 ceph-mon[27902]: pgmap v10065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:30.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18700.421629 secs 2024-04-21T15:36:30.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18700.421629 secs 2024-04-21T15:36:30.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18700.421629 secs 2024-04-21T15:36:31.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:30 smithi191 ceph-mon[31636]: pgmap v10066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:31.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:30 smithi170 ceph-mon[31212]: pgmap v10066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:30 smithi077 ceph-mon[27902]: pgmap v10066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:33.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:32 smithi191 ceph-mon[31636]: pgmap v10067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:33.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18703.659798 secs 2024-04-21T15:36:33.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:32 smithi170 ceph-mon[31212]: pgmap v10067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:33.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18703.659798 secs 2024-04-21T15:36:33.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:32 smithi077 ceph-mon[27902]: pgmap v10067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:33.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18703.659798 secs 2024-04-21T15:36:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:35.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18705.421745 secs 2024-04-21T15:36:35.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:34 smithi191 ceph-mon[31636]: pgmap v10068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:35.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18705.421745 secs 2024-04-21T15:36:35.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:34 smithi170 ceph-mon[31212]: pgmap v10068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:35.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18705.421745 secs 2024-04-21T15:36:35.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:34 smithi077 ceph-mon[27902]: pgmap v10068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:36 smithi191 ceph-mon[31636]: pgmap v10069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:37.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:36 smithi170 ceph-mon[31212]: pgmap v10069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:37.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:36 smithi077 ceph-mon[27902]: pgmap v10069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18708.659874 secs 2024-04-21T15:36:38.294 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18708.659874 secs 2024-04-21T15:36:38.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18708.659874 secs 2024-04-21T15:36:39.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:38 smithi191 ceph-mon[31636]: pgmap v10070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:39.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:38 smithi170 ceph-mon[31212]: pgmap v10070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:39.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:38 smithi077 ceph-mon[27902]: pgmap v10070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18710.421803 secs 2024-04-21T15:36:40.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18710.421803 secs 2024-04-21T15:36:40.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18710.421803 secs 2024-04-21T15:36:41.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:40 smithi191 ceph-mon[31636]: pgmap v10071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:41.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:40 smithi170 ceph-mon[31212]: pgmap v10071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:41.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:40 smithi077 ceph-mon[27902]: pgmap v10071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:42 smithi191 ceph-mon[31636]: pgmap v10072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:43.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18713.659991 secs 2024-04-21T15:36:43.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:42 smithi170 ceph-mon[31212]: pgmap v10072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:43.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18713.659991 secs 2024-04-21T15:36:43.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:42 smithi077 ceph-mon[27902]: pgmap v10072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:43.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18713.659991 secs 2024-04-21T15:36:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:45.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18715.421917 secs 2024-04-21T15:36:45.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:44 smithi191 ceph-mon[31636]: pgmap v10073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:45.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18715.421917 secs 2024-04-21T15:36:45.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:44 smithi170 ceph-mon[31212]: pgmap v10073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:45.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18715.421917 secs 2024-04-21T15:36:45.403 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:44 smithi077 ceph-mon[27902]: pgmap v10073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:46.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:46 smithi170 ceph-mon[31212]: pgmap v10074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:46.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:46 smithi077 ceph-mon[27902]: pgmap v10074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:46.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:46 smithi191 ceph-mon[31636]: pgmap v10074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:47.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18718.660112 secs 2024-04-21T15:36:47.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18718.660112 secs 2024-04-21T15:36:47.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18718.660112 secs 2024-04-21T15:36:48.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:48 smithi170 ceph-mon[31212]: pgmap v10075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:48.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:48 smithi077 ceph-mon[27902]: pgmap v10075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:48 smithi191 ceph-mon[31636]: pgmap v10075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:49.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18720.422013 secs 2024-04-21T15:36:49.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18720.422013 secs 2024-04-21T15:36:49.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18720.422013 secs 2024-04-21T15:36:50.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:50.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:50 smithi170 ceph-mon[31212]: pgmap v10076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:50.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:50 smithi077 ceph-mon[27902]: pgmap v10076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:50.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:50 smithi191 ceph-mon[31636]: pgmap v10076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:52.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:52 smithi191 ceph-mon[31636]: pgmap v10077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:52.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18723.660239 secs 2024-04-21T15:36:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:52 smithi170 ceph-mon[31212]: pgmap v10077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:53.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18723.660239 secs 2024-04-21T15:36:53.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:52 smithi077 ceph-mon[27902]: pgmap v10077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:53.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18723.660239 secs 2024-04-21T15:36:54.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18725.422101 secs 2024-04-21T15:36:54.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:54 smithi191 ceph-mon[31636]: pgmap v10078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18725.422101 secs 2024-04-21T15:36:55.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:54 smithi170 ceph-mon[31212]: pgmap v10078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:36:55.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18725.422101 secs 2024-04-21T15:36:55.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:54 smithi077 ceph-mon[27902]: pgmap v10078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:56.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:56 smithi191 ceph-mon[31636]: pgmap v10079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:57.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:56 smithi170 ceph-mon[31212]: pgmap v10079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:57.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:56 smithi077 ceph-mon[27902]: pgmap v10079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:36:57.965 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18728.660359 secs 2024-04-21T15:36:57.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18728.660359 secs 2024-04-21T15:36:58.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18728.660359 secs 2024-04-21T15:36:58.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:58 smithi191 ceph-mon[31636]: pgmap v10080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:59.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:58 smithi170 ceph-mon[31212]: pgmap v10080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:59.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:58 smithi077 ceph-mon[27902]: pgmap v10080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:36:59.978 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:36:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18730.422207 secs 2024-04-21T15:37:00.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:36:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18730.422207 secs 2024-04-21T15:37:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:00.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:36:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18730.422207 secs 2024-04-21T15:37:00.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:00 smithi191 ceph-mon[31636]: pgmap v10081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:01.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:00 smithi170 ceph-mon[31212]: pgmap v10081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:01.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:00 smithi077 ceph-mon[27902]: pgmap v10081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:02.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:02 smithi191 ceph-mon[31636]: pgmap v10082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:02.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18733.660478 secs 2024-04-21T15:37:03.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:02 smithi170 ceph-mon[31212]: pgmap v10082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:03.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18733.660478 secs 2024-04-21T15:37:03.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:02 smithi077 ceph-mon[27902]: pgmap v10082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:03.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18733.660478 secs 2024-04-21T15:37:04.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18735.422321 secs 2024-04-21T15:37:04.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:04 smithi191 ceph-mon[31636]: pgmap v10083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:04.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:04 smithi191 ceph-mon[31636]: osdmap e702: 12 total, 12 up, 12 in 2024-04-21T15:37:05.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18735.422321 secs 2024-04-21T15:37:05.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:04 smithi170 ceph-mon[31212]: pgmap v10083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:05.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:04 smithi170 ceph-mon[31212]: osdmap e702: 12 total, 12 up, 12 in 2024-04-21T15:37:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18735.422321 secs 2024-04-21T15:37:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:04 smithi077 ceph-mon[27902]: pgmap v10083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:05.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:04 smithi077 ceph-mon[27902]: osdmap e702: 12 total, 12 up, 12 in 2024-04-21T15:37:06.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:06 smithi191 ceph-mon[31636]: pgmap v10085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:07.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:06 smithi170 ceph-mon[31212]: pgmap v10085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:07.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:06 smithi077 ceph-mon[27902]: pgmap v10085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:07.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18738.660578 secs 2024-04-21T15:37:08.043 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18738.660578 secs 2024-04-21T15:37:08.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18738.660578 secs 2024-04-21T15:37:08.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:08 smithi191 ceph-mon[31636]: pgmap v10086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:09.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:08 smithi170 ceph-mon[31212]: pgmap v10086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:09.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:08 smithi077 ceph-mon[27902]: pgmap v10086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:09.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18740.422399 secs 2024-04-21T15:37:10.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18740.422399 secs 2024-04-21T15:37:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:10.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18740.422399 secs 2024-04-21T15:37:10.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:10 smithi191 ceph-mon[31636]: pgmap v10087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:11.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:10 smithi191 ceph-mon[31636]: osdmap e703: 12 total, 12 up, 12 in 2024-04-21T15:37:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:10 smithi170 ceph-mon[31212]: pgmap v10087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:10 smithi170 ceph-mon[31212]: osdmap e703: 12 total, 12 up, 12 in 2024-04-21T15:37:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:10 smithi077 ceph-mon[27902]: pgmap v10087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:37:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:10 smithi077 ceph-mon[27902]: osdmap e703: 12 total, 12 up, 12 in 2024-04-21T15:37:12.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:12 smithi191 ceph-mon[31636]: pgmap v10089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:37:12.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18743.660702 secs 2024-04-21T15:37:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:12 smithi170 ceph-mon[31212]: pgmap v10089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:37:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18743.660702 secs 2024-04-21T15:37:13.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:12 smithi077 ceph-mon[27902]: pgmap v10089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:37:13.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18743.660702 secs 2024-04-21T15:37:14.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18745.422528 secs 2024-04-21T15:37:14.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:14 smithi191 ceph-mon[31636]: pgmap v10090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:37:15.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18745.422528 secs 2024-04-21T15:37:15.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:14 smithi170 ceph-mon[31212]: pgmap v10090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:37:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18745.422528 secs 2024-04-21T15:37:15.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:14 smithi077 ceph-mon[27902]: pgmap v10090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:37:16.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:16 smithi191 ceph-mon[31636]: pgmap v10091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:17.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:16 smithi170 ceph-mon[31212]: pgmap v10091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:17.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:16 smithi077 ceph-mon[27902]: pgmap v10091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18748.660821 secs 2024-04-21T15:37:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:37:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:37:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:37:18.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:37:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18748.660821 secs 2024-04-21T15:37:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:37:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:37:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:37:18.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:37:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18748.660821 secs 2024-04-21T15:37:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:37:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:37:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:37:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:37:19.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:18 smithi170 ceph-mon[31212]: pgmap v10092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:19.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:18 smithi077 ceph-mon[27902]: pgmap v10092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:19.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:18 smithi191 ceph-mon[31636]: pgmap v10092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:20.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18750.422646 secs 2024-04-21T15:37:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:20.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18750.422646 secs 2024-04-21T15:37:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18750.422646 secs 2024-04-21T15:37:21.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:20 smithi170 ceph-mon[31212]: pgmap v10093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:20 smithi077 ceph-mon[27902]: pgmap v10093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:20 smithi191 ceph-mon[31636]: pgmap v10093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:37:23.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:22 smithi170 ceph-mon[31212]: pgmap v10094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:37:23.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18753.660964 secs 2024-04-21T15:37:23.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:22 smithi077 ceph-mon[27902]: pgmap v10094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:37:23.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18753.660964 secs 2024-04-21T15:37:23.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:22 smithi191 ceph-mon[31636]: pgmap v10094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:37:23.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18753.660964 secs 2024-04-21T15:37:25.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18755.422743 secs 2024-04-21T15:37:25.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:24 smithi170 ceph-mon[31212]: pgmap v10095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:25.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18755.422743 secs 2024-04-21T15:37:25.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:24 smithi077 ceph-mon[27902]: pgmap v10095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:25.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18755.422743 secs 2024-04-21T15:37:25.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:24 smithi191 ceph-mon[31636]: pgmap v10095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:27.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:26 smithi191 ceph-mon[31636]: pgmap v10096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:27.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:26 smithi170 ceph-mon[31212]: pgmap v10096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:27.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:26 smithi077 ceph-mon[27902]: pgmap v10096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:28.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18758.661025 secs 2024-04-21T15:37:28.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18758.661025 secs 2024-04-21T15:37:28.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18758.661025 secs 2024-04-21T15:37:29.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:28 smithi170 ceph-mon[31212]: pgmap v10097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:29.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:28 smithi077 ceph-mon[27902]: pgmap v10097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:29.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:28 smithi191 ceph-mon[31636]: pgmap v10097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:30.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18760.422842 secs 2024-04-21T15:37:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:30.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18760.422842 secs 2024-04-21T15:37:30.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18760.422842 secs 2024-04-21T15:37:31.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:30 smithi170 ceph-mon[31212]: pgmap v10098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:31.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:30 smithi077 ceph-mon[27902]: pgmap v10098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:31.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:30 smithi191 ceph-mon[31636]: pgmap v10098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:33.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:32 smithi170 ceph-mon[31212]: pgmap v10099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:33.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18763.661153 secs 2024-04-21T15:37:33.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:32 smithi077 ceph-mon[27902]: pgmap v10099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:33.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18763.661153 secs 2024-04-21T15:37:33.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:32 smithi191 ceph-mon[31636]: pgmap v10099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:33.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18763.661153 secs 2024-04-21T15:37:35.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18765.422991 secs 2024-04-21T15:37:35.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:34 smithi170 ceph-mon[31212]: pgmap v10100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:35.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18765.422991 secs 2024-04-21T15:37:35.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:34 smithi077 ceph-mon[27902]: pgmap v10100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:35.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18765.422991 secs 2024-04-21T15:37:35.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:34 smithi191 ceph-mon[31636]: pgmap v10100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:37.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:36 smithi170 ceph-mon[31212]: pgmap v10101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:37.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:36 smithi077 ceph-mon[27902]: pgmap v10101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:37.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:36 smithi191 ceph-mon[31636]: pgmap v10101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:38.043 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18768.661269 secs 2024-04-21T15:37:38.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18768.661269 secs 2024-04-21T15:37:38.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18768.661269 secs 2024-04-21T15:37:39.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:38 smithi170 ceph-mon[31212]: pgmap v10102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:39.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:38 smithi077 ceph-mon[27902]: pgmap v10102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:39.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:38 smithi191 ceph-mon[31636]: pgmap v10102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:40.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18770.423130 secs 2024-04-21T15:37:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:40.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18770.423130 secs 2024-04-21T15:37:40.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18770.423130 secs 2024-04-21T15:37:41.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:40 smithi170 ceph-mon[31212]: pgmap v10103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:41.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:40 smithi077 ceph-mon[27902]: pgmap v10103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:41.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:40 smithi191 ceph-mon[31636]: pgmap v10103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:43.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:42 smithi170 ceph-mon[31212]: pgmap v10104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:43.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18773.661390 secs 2024-04-21T15:37:43.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:42 smithi077 ceph-mon[27902]: pgmap v10104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:43.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18773.661390 secs 2024-04-21T15:37:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:42 smithi191 ceph-mon[31636]: pgmap v10104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18773.661390 secs 2024-04-21T15:37:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18775.423241 secs 2024-04-21T15:37:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:44 smithi170 ceph-mon[31212]: pgmap v10105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18775.423241 secs 2024-04-21T15:37:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:44 smithi077 ceph-mon[27902]: pgmap v10105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:45.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18775.423241 secs 2024-04-21T15:37:45.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:44 smithi191 ceph-mon[31636]: pgmap v10105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:47.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:46 smithi170 ceph-mon[31212]: pgmap v10106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:47.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:46 smithi077 ceph-mon[27902]: pgmap v10106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:47.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:46 smithi191 ceph-mon[31636]: pgmap v10106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:48.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18778.661529 secs 2024-04-21T15:37:48.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18778.661529 secs 2024-04-21T15:37:48.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18778.661529 secs 2024-04-21T15:37:49.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:48 smithi170 ceph-mon[31212]: pgmap v10107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:49.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:48 smithi077 ceph-mon[27902]: pgmap v10107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:49.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:48 smithi191 ceph-mon[31636]: pgmap v10107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:50.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18780.423353 secs 2024-04-21T15:37:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18780.423353 secs 2024-04-21T15:37:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18780.423353 secs 2024-04-21T15:37:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:50 smithi170 ceph-mon[31212]: pgmap v10108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:51.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:50 smithi077 ceph-mon[27902]: pgmap v10108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:51.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:50 smithi191 ceph-mon[31636]: pgmap v10108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:53.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:52 smithi170 ceph-mon[31212]: pgmap v10109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:53.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18783.661633 secs 2024-04-21T15:37:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:52 smithi077 ceph-mon[27902]: pgmap v10109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:53.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18783.661633 secs 2024-04-21T15:37:53.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:52 smithi191 ceph-mon[31636]: pgmap v10109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:53.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18783.661633 secs 2024-04-21T15:37:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18785.423470 secs 2024-04-21T15:37:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:54 smithi170 ceph-mon[31212]: pgmap v10110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:37:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18785.423470 secs 2024-04-21T15:37:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:54 smithi077 ceph-mon[27902]: pgmap v10110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:55.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18785.423470 secs 2024-04-21T15:37:55.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:54 smithi191 ceph-mon[31636]: pgmap v10110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:37:56.951+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:37:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:37:56.951+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:37:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:37:56.951+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:37:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:37:56.951+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:37:57.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:56 smithi077 ceph-mon[27902]: pgmap v10111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:57.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:56 smithi191 ceph-mon[31636]: pgmap v10111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:57.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:56 smithi170 ceph-mon[31212]: pgmap v10111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:37:58.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18788.661751 secs 2024-04-21T15:37:58.215 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18788.661751 secs 2024-04-21T15:37:58.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18788.661751 secs 2024-04-21T15:37:59.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:58 smithi077 ceph-mon[27902]: pgmap v10112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:59.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:58 smithi191 ceph-mon[31636]: pgmap v10112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:37:59.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:58 smithi170 ceph-mon[31212]: pgmap v10112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:00.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18790.423566 secs 2024-04-21T15:38:00.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18790.423566 secs 2024-04-21T15:38:00.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18790.423566 secs 2024-04-21T15:38:01.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:00 smithi077 ceph-mon[27902]: pgmap v10113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:01.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:00 smithi191 ceph-mon[31636]: pgmap v10113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:01.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:00 smithi170 ceph-mon[31212]: pgmap v10113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:03.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:02 smithi077 ceph-mon[27902]: pgmap v10114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T15:38:03.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18793.661868 secs 2024-04-21T15:38:03.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:02 smithi191 ceph-mon[31636]: pgmap v10114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T15:38:03.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18793.661868 secs 2024-04-21T15:38:03.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:02 smithi170 ceph-mon[31212]: pgmap v10114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T15:38:03.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18793.661868 secs 2024-04-21T15:38:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18795.423679 secs 2024-04-21T15:38:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:04 smithi077 ceph-mon[27902]: pgmap v10115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T15:38:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:04 smithi077 ceph-mon[27902]: osdmap e704: 12 total, 12 up, 12 in 2024-04-21T15:38:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18795.423679 secs 2024-04-21T15:38:05.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:04 smithi191 ceph-mon[31636]: pgmap v10115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T15:38:05.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:04 smithi191 ceph-mon[31636]: osdmap e704: 12 total, 12 up, 12 in 2024-04-21T15:38:05.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18795.423679 secs 2024-04-21T15:38:05.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:04 smithi170 ceph-mon[31212]: pgmap v10115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T15:38:05.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:04 smithi170 ceph-mon[31212]: osdmap e704: 12 total, 12 up, 12 in 2024-04-21T15:38:07.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:06 smithi077 ceph-mon[27902]: pgmap v10117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:07.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:06 smithi191 ceph-mon[31636]: pgmap v10117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:07.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:06 smithi170 ceph-mon[31212]: pgmap v10117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:08.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18798.661963 secs 2024-04-21T15:38:08.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18798.661963 secs 2024-04-21T15:38:08.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18798.661963 secs 2024-04-21T15:38:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:08 smithi077 ceph-mon[27902]: pgmap v10118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:09.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:08 smithi191 ceph-mon[31636]: pgmap v10118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:09.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:08 smithi170 ceph-mon[31212]: pgmap v10118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:10.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18800.423795 secs 2024-04-21T15:38:10.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18800.423795 secs 2024-04-21T15:38:10.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18800.423795 secs 2024-04-21T15:38:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:10 smithi077 ceph-mon[27902]: pgmap v10119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:11.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:10 smithi077 ceph-mon[27902]: osdmap e705: 12 total, 12 up, 12 in 2024-04-21T15:38:11.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:10 smithi191 ceph-mon[31636]: pgmap v10119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:11.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:10 smithi191 ceph-mon[31636]: osdmap e705: 12 total, 12 up, 12 in 2024-04-21T15:38:11.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:10 smithi170 ceph-mon[31212]: pgmap v10119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:38:11.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:10 smithi170 ceph-mon[31212]: osdmap e705: 12 total, 12 up, 12 in 2024-04-21T15:38:13.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:12 smithi077 ceph-mon[27902]: pgmap v10121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T15:38:13.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18803.662052 secs 2024-04-21T15:38:13.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:12 smithi191 ceph-mon[31636]: pgmap v10121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T15:38:13.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18803.662052 secs 2024-04-21T15:38:13.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:12 smithi170 ceph-mon[31212]: pgmap v10121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T15:38:13.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18803.662052 secs 2024-04-21T15:38:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:15.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18805.423912 secs 2024-04-21T15:38:15.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:14 smithi077 ceph-mon[27902]: pgmap v10122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T15:38:15.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18805.423912 secs 2024-04-21T15:38:15.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:14 smithi191 ceph-mon[31636]: pgmap v10122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T15:38:15.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18805.423912 secs 2024-04-21T15:38:15.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:14 smithi170 ceph-mon[31212]: pgmap v10122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T15:38:17.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:16 smithi077 ceph-mon[27902]: pgmap v10123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:17.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:16 smithi191 ceph-mon[31636]: pgmap v10123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:17.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:16 smithi170 ceph-mon[31212]: pgmap v10123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:18.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18808.662128 secs 2024-04-21T15:38:18.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:38:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18808.662128 secs 2024-04-21T15:38:18.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:38:18.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18808.662128 secs 2024-04-21T15:38:18.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:38:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:18 smithi191 ceph-mon[31636]: pgmap v10124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:19.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:18 smithi077 ceph-mon[27902]: pgmap v10124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:19.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:18 smithi170 ceph-mon[31212]: pgmap v10124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 18995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:20.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18810.424023 secs 2024-04-21T15:38:20.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18810.424023 secs 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18810.424023 secs 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:20.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:21.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: pgmap v10125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:38:21.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:38:21.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: pgmap v10125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:38:21.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:38:21.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: pgmap v10125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:38:21.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:38:22.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:38:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:38:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:38:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:38:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:38:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:38:22.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:38:22.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:38:22.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:38:22.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:38:22.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:38:22.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:38:22.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:38:22.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:38:22.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:38:22.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:38:22.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:38:22.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:38:23.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:22 smithi077 ceph-mon[27902]: pgmap v10126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:38:23.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18813.662189 secs 2024-04-21T15:38:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:22 smithi191 ceph-mon[31636]: pgmap v10126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:38:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18813.662189 secs 2024-04-21T15:38:23.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:22 smithi170 ceph-mon[31212]: pgmap v10126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:38:23.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18813.662189 secs 2024-04-21T15:38:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:25.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18815.424158 secs 2024-04-21T15:38:25.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:24 smithi077 ceph-mon[27902]: pgmap v10127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:25.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18815.424158 secs 2024-04-21T15:38:25.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:24 smithi191 ceph-mon[31636]: pgmap v10127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:25.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18815.424158 secs 2024-04-21T15:38:25.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:24 smithi170 ceph-mon[31212]: pgmap v10127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:27.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:26 smithi077 ceph-mon[27902]: pgmap v10128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:27.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:26 smithi191 ceph-mon[31636]: pgmap v10128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:27.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:26 smithi170 ceph-mon[31212]: pgmap v10128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:28.214 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18818.662342 secs 2024-04-21T15:38:28.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18818.662342 secs 2024-04-21T15:38:28.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18818.662342 secs 2024-04-21T15:38:29.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:28 smithi191 ceph-mon[31636]: pgmap v10129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:29.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:28 smithi170 ceph-mon[31212]: pgmap v10129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:29.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:28 smithi077 ceph-mon[27902]: pgmap v10129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:30.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18820.424219 secs 2024-04-21T15:38:30.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18820.424219 secs 2024-04-21T15:38:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18820.424219 secs 2024-04-21T15:38:31.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:30 smithi191 ceph-mon[31636]: pgmap v10130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:31.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:30 smithi170 ceph-mon[31212]: pgmap v10130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:30 smithi077 ceph-mon[27902]: pgmap v10130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:33.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:32 smithi191 ceph-mon[31636]: pgmap v10131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:33.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18823.662485 secs 2024-04-21T15:38:33.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:32 smithi170 ceph-mon[31212]: pgmap v10131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:33.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18823.662485 secs 2024-04-21T15:38:33.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:32 smithi077 ceph-mon[27902]: pgmap v10131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:33.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18823.662485 secs 2024-04-21T15:38:35.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:35.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18825.424336 secs 2024-04-21T15:38:35.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:34 smithi191 ceph-mon[31636]: pgmap v10132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:35.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18825.424336 secs 2024-04-21T15:38:35.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:34 smithi170 ceph-mon[31212]: pgmap v10132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:35.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18825.424336 secs 2024-04-21T15:38:35.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:34 smithi077 ceph-mon[27902]: pgmap v10132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:37.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:36 smithi191 ceph-mon[31636]: pgmap v10133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:37.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:36 smithi170 ceph-mon[31212]: pgmap v10133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:37.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:36 smithi077 ceph-mon[27902]: pgmap v10133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:38.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18828.662607 secs 2024-04-21T15:38:38.293 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18828.662607 secs 2024-04-21T15:38:38.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18828.662607 secs 2024-04-21T15:38:39.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:38 smithi191 ceph-mon[31636]: pgmap v10134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:39.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:38 smithi170 ceph-mon[31212]: pgmap v10134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:39.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:38 smithi077 ceph-mon[27902]: pgmap v10134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:40.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18830.424452 secs 2024-04-21T15:38:40.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18830.424452 secs 2024-04-21T15:38:40.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18830.424452 secs 2024-04-21T15:38:41.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:40 smithi191 ceph-mon[31636]: pgmap v10135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:40 smithi170 ceph-mon[31212]: pgmap v10135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:41.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:40 smithi077 ceph-mon[27902]: pgmap v10135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:42 smithi191 ceph-mon[31636]: pgmap v10136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:43.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18833.662750 secs 2024-04-21T15:38:43.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:42 smithi170 ceph-mon[31212]: pgmap v10136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:43.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18833.662750 secs 2024-04-21T15:38:43.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:42 smithi077 ceph-mon[27902]: pgmap v10136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:43.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18833.662750 secs 2024-04-21T15:38:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:45.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18835.424567 secs 2024-04-21T15:38:45.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:44 smithi191 ceph-mon[31636]: pgmap v10137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:45.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18835.424567 secs 2024-04-21T15:38:45.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:44 smithi170 ceph-mon[31212]: pgmap v10137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:45.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18835.424567 secs 2024-04-21T15:38:45.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:44 smithi077 ceph-mon[27902]: pgmap v10137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:47.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:46 smithi191 ceph-mon[31636]: pgmap v10138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:47.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:46 smithi170 ceph-mon[31212]: pgmap v10138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:47.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:46 smithi077 ceph-mon[27902]: pgmap v10138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:48.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18838.662873 secs 2024-04-21T15:38:48.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18838.662873 secs 2024-04-21T15:38:48.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18838.662873 secs 2024-04-21T15:38:49.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:48 smithi191 ceph-mon[31636]: pgmap v10139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:49.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:48 smithi170 ceph-mon[31212]: pgmap v10139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:49.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:48 smithi077 ceph-mon[27902]: pgmap v10139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18840.424683 secs 2024-04-21T15:38:50.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18840.424683 secs 2024-04-21T15:38:50.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18840.424683 secs 2024-04-21T15:38:51.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:50 smithi191 ceph-mon[31636]: pgmap v10140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:51.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:50 smithi170 ceph-mon[31212]: pgmap v10140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:51.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:50 smithi077 ceph-mon[27902]: pgmap v10140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:38:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:52 smithi191 ceph-mon[31636]: pgmap v10141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18843.663007 secs 2024-04-21T15:38:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:52 smithi170 ceph-mon[31212]: pgmap v10141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:53.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18843.663007 secs 2024-04-21T15:38:53.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:52 smithi077 ceph-mon[27902]: pgmap v10141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:53.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18843.663007 secs 2024-04-21T15:38:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:38:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18845.424802 secs 2024-04-21T15:38:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:54 smithi191 ceph-mon[31636]: pgmap v10142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18845.424802 secs 2024-04-21T15:38:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:54 smithi170 ceph-mon[31212]: pgmap v10142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18845.424802 secs 2024-04-21T15:38:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:54 smithi077 ceph-mon[27902]: pgmap v10142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:57.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:56 smithi191 ceph-mon[31636]: pgmap v10143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:57.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:56 smithi170 ceph-mon[31212]: pgmap v10143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:57.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:56 smithi077 ceph-mon[27902]: pgmap v10143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:38:58.214 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18848.663112 secs 2024-04-21T15:38:58.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18848.663112 secs 2024-04-21T15:38:58.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18848.663112 secs 2024-04-21T15:38:59.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:58 smithi191 ceph-mon[31636]: pgmap v10144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:59.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:58 smithi170 ceph-mon[31212]: pgmap v10144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:38:59.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:58 smithi077 ceph-mon[27902]: pgmap v10144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18850.424931 secs 2024-04-21T15:39:00.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18850.424931 secs 2024-04-21T15:39:00.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18850.424931 secs 2024-04-21T15:39:01.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:00 smithi170 ceph-mon[31212]: pgmap v10145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:01.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:00 smithi077 ceph-mon[27902]: pgmap v10145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:01.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:00 smithi191 ceph-mon[31636]: pgmap v10145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:03.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:02 smithi170 ceph-mon[31212]: pgmap v10146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:39:03.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18853.663222 secs 2024-04-21T15:39:03.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:02 smithi077 ceph-mon[27902]: pgmap v10146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:39:03.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18853.663222 secs 2024-04-21T15:39:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:02 smithi191 ceph-mon[31636]: pgmap v10146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:39:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18853.663222 secs 2024-04-21T15:39:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18855.425081 secs 2024-04-21T15:39:05.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:04 smithi170 ceph-mon[31212]: pgmap v10147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:39:05.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:04 smithi170 ceph-mon[31212]: osdmap e706: 12 total, 12 up, 12 in 2024-04-21T15:39:05.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18855.425081 secs 2024-04-21T15:39:05.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:04 smithi077 ceph-mon[27902]: pgmap v10147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:39:05.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:04 smithi077 ceph-mon[27902]: osdmap e706: 12 total, 12 up, 12 in 2024-04-21T15:39:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18855.425081 secs 2024-04-21T15:39:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:04 smithi191 ceph-mon[31636]: pgmap v10147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:39:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:04 smithi191 ceph-mon[31636]: osdmap e706: 12 total, 12 up, 12 in 2024-04-21T15:39:06.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:06 smithi170 ceph-mon[31212]: pgmap v10149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:06.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:06 smithi077 ceph-mon[27902]: pgmap v10149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:06.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:06 smithi191 ceph-mon[31636]: pgmap v10149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:07.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18858.663283 secs 2024-04-21T15:39:07.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18858.663283 secs 2024-04-21T15:39:07.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18858.663283 secs 2024-04-21T15:39:08.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:08 smithi170 ceph-mon[31212]: pgmap v10150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:08.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:08 smithi077 ceph-mon[27902]: pgmap v10150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:08.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:08 smithi191 ceph-mon[31636]: pgmap v10150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18860.425205 secs 2024-04-21T15:39:09.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18860.425205 secs 2024-04-21T15:39:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18860.425205 secs 2024-04-21T15:39:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:10.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:10 smithi077 ceph-mon[27902]: pgmap v10151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:10.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:10 smithi191 ceph-mon[31636]: pgmap v10151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:10 smithi170 ceph-mon[31212]: pgmap v10151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:39:11.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:11 smithi191 ceph-mon[31636]: osdmap e707: 12 total, 12 up, 12 in 2024-04-21T15:39:11.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:11 smithi170 ceph-mon[31212]: osdmap e707: 12 total, 12 up, 12 in 2024-04-21T15:39:11.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:11 smithi077 ceph-mon[27902]: osdmap e707: 12 total, 12 up, 12 in 2024-04-21T15:39:12.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:12 smithi191 ceph-mon[31636]: pgmap v10153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:39:12.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18863.663400 secs 2024-04-21T15:39:12.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:12 smithi170 ceph-mon[31212]: pgmap v10153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:39:12.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18863.663400 secs 2024-04-21T15:39:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:12 smithi077 ceph-mon[27902]: pgmap v10153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:39:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18863.663400 secs 2024-04-21T15:39:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18865.425330 secs 2024-04-21T15:39:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:14 smithi191 ceph-mon[31636]: pgmap v10154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:39:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18865.425330 secs 2024-04-21T15:39:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:14 smithi170 ceph-mon[31212]: pgmap v10154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:39:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:15.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18865.425330 secs 2024-04-21T15:39:15.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:14 smithi077 ceph-mon[27902]: pgmap v10154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:39:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:16 smithi191 ceph-mon[31636]: pgmap v10155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:16 smithi170 ceph-mon[31212]: pgmap v10155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:17.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:16 smithi077 ceph-mon[27902]: pgmap v10155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:17.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18868.663513 secs 2024-04-21T15:39:18.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18868.663513 secs 2024-04-21T15:39:18.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18868.663513 secs 2024-04-21T15:39:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:18 smithi191 ceph-mon[31636]: pgmap v10156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:18 smithi170 ceph-mon[31212]: pgmap v10156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:19.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:18 smithi077 ceph-mon[27902]: pgmap v10156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18870.425453 secs 2024-04-21T15:39:20.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18870.425453 secs 2024-04-21T15:39:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:20.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18870.425453 secs 2024-04-21T15:39:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:20 smithi191 ceph-mon[31636]: pgmap v10157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:39:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:20 smithi170 ceph-mon[31212]: pgmap v10157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:39:21.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:20 smithi077 ceph-mon[27902]: pgmap v10157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:39:21.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:39:22.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:39:22.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:39:22.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:39:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:39:22.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:39:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:39:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:39:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:22 smithi170 ceph-mon[31212]: pgmap v10158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:39:23.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18873.663638 secs 2024-04-21T15:39:23.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:22 smithi077 ceph-mon[27902]: pgmap v10158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:39:23.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18873.663638 secs 2024-04-21T15:39:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:22 smithi191 ceph-mon[31636]: pgmap v10158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:39:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18873.663638 secs 2024-04-21T15:39:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18875.425576 secs 2024-04-21T15:39:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:24 smithi170 ceph-mon[31212]: pgmap v10159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18875.425576 secs 2024-04-21T15:39:25.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:24 smithi077 ceph-mon[27902]: pgmap v10159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:25.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18875.425576 secs 2024-04-21T15:39:25.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:24 smithi191 ceph-mon[31636]: pgmap v10159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:27.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:26 smithi191 ceph-mon[31636]: pgmap v10160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:26 smithi170 ceph-mon[31212]: pgmap v10160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:27.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:26 smithi077 ceph-mon[27902]: pgmap v10160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:28.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18878.663734 secs 2024-04-21T15:39:28.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18878.663734 secs 2024-04-21T15:39:28.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18878.663734 secs 2024-04-21T15:39:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:28 smithi170 ceph-mon[31212]: pgmap v10161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:29.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:28 smithi077 ceph-mon[27902]: pgmap v10161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:29.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:28 smithi191 ceph-mon[31636]: pgmap v10161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:30.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18880.425719 secs 2024-04-21T15:39:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:30.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18880.425719 secs 2024-04-21T15:39:30.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18880.425719 secs 2024-04-21T15:39:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:30 smithi170 ceph-mon[31212]: pgmap v10162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:31.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:30 smithi077 ceph-mon[27902]: pgmap v10162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:31.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:30 smithi191 ceph-mon[31636]: pgmap v10162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:32 smithi170 ceph-mon[31212]: pgmap v10163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18883.663870 secs 2024-04-21T15:39:33.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:32 smithi077 ceph-mon[27902]: pgmap v10163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:33.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18883.663870 secs 2024-04-21T15:39:33.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:32 smithi191 ceph-mon[31636]: pgmap v10163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:33.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18883.663870 secs 2024-04-21T15:39:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18885.425836 secs 2024-04-21T15:39:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:34 smithi170 ceph-mon[31212]: pgmap v10164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:35.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18885.425836 secs 2024-04-21T15:39:35.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:34 smithi077 ceph-mon[27902]: pgmap v10164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:35.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18885.425836 secs 2024-04-21T15:39:35.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:34 smithi191 ceph-mon[31636]: pgmap v10164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:36 smithi170 ceph-mon[31212]: pgmap v10165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:37.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:36 smithi077 ceph-mon[27902]: pgmap v10165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:37.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:36 smithi191 ceph-mon[31636]: pgmap v10165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:38.042 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18888.663983 secs 2024-04-21T15:39:38.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18888.663983 secs 2024-04-21T15:39:38.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18888.663983 secs 2024-04-21T15:39:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:38 smithi170 ceph-mon[31212]: pgmap v10166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:39.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:38 smithi077 ceph-mon[27902]: pgmap v10166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:39.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:38 smithi191 ceph-mon[31636]: pgmap v10166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:40.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18890.425965 secs 2024-04-21T15:39:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:40.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18890.425965 secs 2024-04-21T15:39:40.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18890.425965 secs 2024-04-21T15:39:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:40 smithi170 ceph-mon[31212]: pgmap v10167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:40 smithi077 ceph-mon[27902]: pgmap v10167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:41.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:40 smithi191 ceph-mon[31636]: pgmap v10167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:42 smithi170 ceph-mon[31212]: pgmap v10168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18893.664117 secs 2024-04-21T15:39:43.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:42 smithi077 ceph-mon[27902]: pgmap v10168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:43.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18893.664117 secs 2024-04-21T15:39:43.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:42 smithi191 ceph-mon[31636]: pgmap v10168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:43.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18893.664117 secs 2024-04-21T15:39:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18895.426028 secs 2024-04-21T15:39:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:44 smithi170 ceph-mon[31212]: pgmap v10169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18895.426028 secs 2024-04-21T15:39:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:44 smithi077 ceph-mon[27902]: pgmap v10169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:45.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18895.426028 secs 2024-04-21T15:39:45.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:44 smithi191 ceph-mon[31636]: pgmap v10169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:47.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:46 smithi077 ceph-mon[27902]: pgmap v10170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:47.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:46 smithi191 ceph-mon[31636]: pgmap v10170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:47.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:46 smithi170 ceph-mon[31212]: pgmap v10170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:48.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18898.664231 secs 2024-04-21T15:39:48.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18898.664231 secs 2024-04-21T15:39:48.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18898.664231 secs 2024-04-21T15:39:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:48 smithi077 ceph-mon[27902]: pgmap v10171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:49.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:48 smithi191 ceph-mon[31636]: pgmap v10171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:49.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:48 smithi170 ceph-mon[31212]: pgmap v10171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18900.426114 secs 2024-04-21T15:39:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18900.426114 secs 2024-04-21T15:39:50.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18900.426114 secs 2024-04-21T15:39:51.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:50 smithi077 ceph-mon[27902]: pgmap v10172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:51.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:50 smithi191 ceph-mon[31636]: pgmap v10172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:51.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:50 smithi170 ceph-mon[31212]: pgmap v10172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:52 smithi077 ceph-mon[27902]: pgmap v10173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18903.664359 secs 2024-04-21T15:39:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:52 smithi191 ceph-mon[31636]: pgmap v10173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18903.664359 secs 2024-04-21T15:39:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:52 smithi170 ceph-mon[31212]: pgmap v10173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18903.664359 secs 2024-04-21T15:39:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:39:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18905.426218 secs 2024-04-21T15:39:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:54 smithi077 ceph-mon[27902]: pgmap v10174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18905.426218 secs 2024-04-21T15:39:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:54 smithi191 ceph-mon[31636]: pgmap v10174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:55.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18905.426218 secs 2024-04-21T15:39:55.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:54 smithi170 ceph-mon[31212]: pgmap v10174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:57.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:56 smithi077 ceph-mon[27902]: pgmap v10175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:57.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:56 smithi191 ceph-mon[31636]: pgmap v10175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:57.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:56 smithi170 ceph-mon[31212]: pgmap v10175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:39:58.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18908.664502 secs 2024-04-21T15:39:58.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18908.664502 secs 2024-04-21T15:39:58.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18908.664502 secs 2024-04-21T15:39:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:58 smithi077 ceph-mon[27902]: pgmap v10176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:59.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:58 smithi191 ceph-mon[31636]: pgmap v10176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:39:59.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:58 smithi170 ceph-mon[31212]: pgmap v10176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:00.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18910.426367 secs 2024-04-21T15:40:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18910.426367 secs 2024-04-21T15:40:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18910.426367 secs 2024-04-21T15:40:01.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:00 smithi077 ceph-mon[27902]: pgmap v10177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:01.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:40:01.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:00 smithi191 ceph-mon[31636]: pgmap v10177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:01.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:40:01.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:00 smithi170 ceph-mon[31212]: pgmap v10177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:01.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:40:03.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:02 smithi077 ceph-mon[27902]: pgmap v10178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:03.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18913.664620 secs 2024-04-21T15:40:03.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:02 smithi191 ceph-mon[31636]: pgmap v10178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:03.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18913.664620 secs 2024-04-21T15:40:03.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:02 smithi170 ceph-mon[31212]: pgmap v10178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:03.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18913.664620 secs 2024-04-21T15:40:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18915.426512 secs 2024-04-21T15:40:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:04 smithi077 ceph-mon[27902]: pgmap v10179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:04 smithi077 ceph-mon[27902]: osdmap e708: 12 total, 12 up, 12 in 2024-04-21T15:40:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18915.426512 secs 2024-04-21T15:40:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:04 smithi191 ceph-mon[31636]: pgmap v10179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:04 smithi191 ceph-mon[31636]: osdmap e708: 12 total, 12 up, 12 in 2024-04-21T15:40:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18915.426512 secs 2024-04-21T15:40:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:04 smithi170 ceph-mon[31212]: pgmap v10179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:04 smithi170 ceph-mon[31212]: osdmap e708: 12 total, 12 up, 12 in 2024-04-21T15:40:07.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:06 smithi077 ceph-mon[27902]: pgmap v10181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:07.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:06 smithi191 ceph-mon[31636]: pgmap v10181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:07.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:06 smithi170 ceph-mon[31212]: pgmap v10181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:08.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18918.664736 secs 2024-04-21T15:40:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18918.664736 secs 2024-04-21T15:40:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18918.664736 secs 2024-04-21T15:40:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:08 smithi077 ceph-mon[27902]: pgmap v10182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:09.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:08 smithi191 ceph-mon[31636]: pgmap v10182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:09.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:08 smithi170 ceph-mon[31212]: pgmap v10182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18920.426650 secs 2024-04-21T15:40:10.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18920.426650 secs 2024-04-21T15:40:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18920.426650 secs 2024-04-21T15:40:11.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:10 smithi077 ceph-mon[27902]: pgmap v10183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:11.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:10 smithi077 ceph-mon[27902]: osdmap e709: 12 total, 12 up, 12 in 2024-04-21T15:40:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:10 smithi191 ceph-mon[31636]: pgmap v10183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:11.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:10 smithi191 ceph-mon[31636]: osdmap e709: 12 total, 12 up, 12 in 2024-04-21T15:40:11.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:10 smithi170 ceph-mon[31212]: pgmap v10183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:40:11.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:10 smithi170 ceph-mon[31212]: osdmap e709: 12 total, 12 up, 12 in 2024-04-21T15:40:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:12 smithi077 ceph-mon[27902]: pgmap v10185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:40:13.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18923.664850 secs 2024-04-21T15:40:13.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:12 smithi191 ceph-mon[31636]: pgmap v10185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:40:13.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18923.664850 secs 2024-04-21T15:40:13.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:12 smithi170 ceph-mon[31212]: pgmap v10185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:40:13.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18923.664850 secs 2024-04-21T15:40:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18925.426794 secs 2024-04-21T15:40:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:14 smithi077 ceph-mon[27902]: pgmap v10186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:40:15.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18925.426794 secs 2024-04-21T15:40:15.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:14 smithi191 ceph-mon[31636]: pgmap v10186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:40:15.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18925.426794 secs 2024-04-21T15:40:15.400 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:14 smithi170 ceph-mon[31212]: pgmap v10186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:40:17.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:16 smithi077 ceph-mon[27902]: pgmap v10187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:16 smithi191 ceph-mon[31636]: pgmap v10187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:17.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:16 smithi170 ceph-mon[31212]: pgmap v10187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:18.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18928.664968 secs 2024-04-21T15:40:18.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18928.664968 secs 2024-04-21T15:40:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18928.664968 secs 2024-04-21T15:40:19.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:18 smithi191 ceph-mon[31636]: pgmap v10188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:19.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:18 smithi170 ceph-mon[31212]: pgmap v10188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:18 smithi077 ceph-mon[27902]: pgmap v10188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:20.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18930.426890 secs 2024-04-21T15:40:20.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18930.426890 secs 2024-04-21T15:40:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18930.426890 secs 2024-04-21T15:40:21.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:20 smithi191 ceph-mon[31636]: pgmap v10189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:21.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:20 smithi170 ceph-mon[31212]: pgmap v10189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:20 smithi077 ceph-mon[27902]: pgmap v10189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:40:22.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:40:22.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:40:22.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: pgmap v10190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18933.665097 secs 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:40:23.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: pgmap v10190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18933.665097 secs 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:40:23.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: pgmap v10190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:40:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18933.665097 secs 2024-04-21T15:40:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:40:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:40:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:40:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18935.427004 secs 2024-04-21T15:40:25.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:24 smithi191 ceph-mon[31636]: pgmap v10191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:25.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18935.427004 secs 2024-04-21T15:40:25.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:24 smithi170 ceph-mon[31212]: pgmap v10191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18935.427004 secs 2024-04-21T15:40:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:24 smithi077 ceph-mon[27902]: pgmap v10191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:27.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:26 smithi191 ceph-mon[31636]: pgmap v10192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:27.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:26 smithi170 ceph-mon[31212]: pgmap v10192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:26 smithi077 ceph-mon[27902]: pgmap v10192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:28.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18938.665194 secs 2024-04-21T15:40:28.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18938.665194 secs 2024-04-21T15:40:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18938.665194 secs 2024-04-21T15:40:29.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:28 smithi191 ceph-mon[31636]: pgmap v10193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:29.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:28 smithi170 ceph-mon[31212]: pgmap v10193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:28 smithi077 ceph-mon[27902]: pgmap v10193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:30.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18940.427126 secs 2024-04-21T15:40:30.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18940.427126 secs 2024-04-21T15:40:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18940.427126 secs 2024-04-21T15:40:31.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:30 smithi191 ceph-mon[31636]: pgmap v10194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:31.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:30 smithi170 ceph-mon[31212]: pgmap v10194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:30 smithi077 ceph-mon[27902]: pgmap v10194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:33.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:32 smithi191 ceph-mon[31636]: pgmap v10195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:33.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18943.665295 secs 2024-04-21T15:40:33.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:32 smithi170 ceph-mon[31212]: pgmap v10195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:33.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18943.665295 secs 2024-04-21T15:40:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:32 smithi077 ceph-mon[27902]: pgmap v10195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18943.665295 secs 2024-04-21T15:40:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:35.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18945.427205 secs 2024-04-21T15:40:35.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:34 smithi191 ceph-mon[31636]: pgmap v10196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:35.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18945.427205 secs 2024-04-21T15:40:35.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:34 smithi170 ceph-mon[31212]: pgmap v10196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18945.427205 secs 2024-04-21T15:40:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:34 smithi077 ceph-mon[27902]: pgmap v10196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:37.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:36 smithi191 ceph-mon[31636]: pgmap v10197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:37.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:36 smithi170 ceph-mon[31212]: pgmap v10197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:36 smithi077 ceph-mon[27902]: pgmap v10197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:38.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18948.665440 secs 2024-04-21T15:40:38.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18948.665440 secs 2024-04-21T15:40:38.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18948.665440 secs 2024-04-21T15:40:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:38 smithi191 ceph-mon[31636]: pgmap v10198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:39.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:38 smithi170 ceph-mon[31212]: pgmap v10198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:38 smithi077 ceph-mon[27902]: pgmap v10198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18950.427306 secs 2024-04-21T15:40:40.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18950.427306 secs 2024-04-21T15:40:40.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18950.427306 secs 2024-04-21T15:40:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:40 smithi191 ceph-mon[31636]: pgmap v10199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:40 smithi170 ceph-mon[31212]: pgmap v10199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:40 smithi077 ceph-mon[27902]: pgmap v10199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:43.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:42 smithi170 ceph-mon[31212]: pgmap v10200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:43.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18953.665530 secs 2024-04-21T15:40:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:42 smithi077 ceph-mon[27902]: pgmap v10200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18953.665530 secs 2024-04-21T15:40:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:42 smithi191 ceph-mon[31636]: pgmap v10200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18953.665530 secs 2024-04-21T15:40:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:45.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18955.427433 secs 2024-04-21T15:40:45.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:44 smithi170 ceph-mon[31212]: pgmap v10201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18955.427433 secs 2024-04-21T15:40:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:44 smithi077 ceph-mon[27902]: pgmap v10201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18955.427433 secs 2024-04-21T15:40:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:44 smithi191 ceph-mon[31636]: pgmap v10201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:47.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:46 smithi170 ceph-mon[31212]: pgmap v10202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:47.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:46 smithi077 ceph-mon[27902]: pgmap v10202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:46 smithi191 ceph-mon[31636]: pgmap v10202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:48.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18958.665676 secs 2024-04-21T15:40:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18958.665676 secs 2024-04-21T15:40:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18958.665676 secs 2024-04-21T15:40:49.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:48 smithi170 ceph-mon[31212]: pgmap v10203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:48 smithi077 ceph-mon[27902]: pgmap v10203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:48 smithi191 ceph-mon[31636]: pgmap v10203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:50.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18960.427577 secs 2024-04-21T15:40:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18960.427577 secs 2024-04-21T15:40:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18960.427577 secs 2024-04-21T15:40:51.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:50 smithi170 ceph-mon[31212]: pgmap v10204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:50 smithi077 ceph-mon[27902]: pgmap v10204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:50 smithi191 ceph-mon[31636]: pgmap v10204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:52 smithi170 ceph-mon[31212]: pgmap v10205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18963.665799 secs 2024-04-21T15:40:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:52 smithi077 ceph-mon[27902]: pgmap v10205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18963.665799 secs 2024-04-21T15:40:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:52 smithi191 ceph-mon[31636]: pgmap v10205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18963.665799 secs 2024-04-21T15:40:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:40:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18965.427640 secs 2024-04-21T15:40:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:54 smithi170 ceph-mon[31212]: pgmap v10206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18965.427640 secs 2024-04-21T15:40:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:54 smithi077 ceph-mon[27902]: pgmap v10206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18965.427640 secs 2024-04-21T15:40:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:54 smithi191 ceph-mon[31636]: pgmap v10206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:40:56.975+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:40:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:40:56.975+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:40:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:40:56.975+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:40:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:40:56.975+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:40:57.276 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:57 smithi191 ceph-mon[31636]: pgmap v10207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:57.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:57 smithi170 ceph-mon[31212]: pgmap v10207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:57.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:56 smithi077 ceph-mon[27902]: pgmap v10207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:40:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18968.665908 secs 2024-04-21T15:40:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:58 smithi170 ceph-mon[31212]: pgmap v10208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18968.665908 secs 2024-04-21T15:40:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:58 smithi077 ceph-mon[27902]: pgmap v10208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:58.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18968.665908 secs 2024-04-21T15:40:58.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:58 smithi191 ceph-mon[31636]: pgmap v10208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:40:59.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18970.427758 secs 2024-04-21T15:40:59.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18970.427758 secs 2024-04-21T15:40:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18970.427758 secs 2024-04-21T15:41:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:00 smithi170 ceph-mon[31212]: pgmap v10209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:00.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:00 smithi077 ceph-mon[27902]: pgmap v10209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:00 smithi191 ceph-mon[31636]: pgmap v10209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:02 smithi191 ceph-mon[31636]: pgmap v10210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:02.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18973.666017 secs 2024-04-21T15:41:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:02 smithi170 ceph-mon[31212]: pgmap v10210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18973.666017 secs 2024-04-21T15:41:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:02 smithi077 ceph-mon[27902]: pgmap v10210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18973.666017 secs 2024-04-21T15:41:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18975.427900 secs 2024-04-21T15:41:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:04 smithi170 ceph-mon[31212]: pgmap v10211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:04 smithi170 ceph-mon[31212]: osdmap e710: 12 total, 12 up, 12 in 2024-04-21T15:41:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18975.427900 secs 2024-04-21T15:41:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:04 smithi077 ceph-mon[27902]: pgmap v10211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:04 smithi077 ceph-mon[27902]: osdmap e710: 12 total, 12 up, 12 in 2024-04-21T15:41:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18975.427900 secs 2024-04-21T15:41:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:04 smithi191 ceph-mon[31636]: pgmap v10211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:04 smithi191 ceph-mon[31636]: osdmap e710: 12 total, 12 up, 12 in 2024-04-21T15:41:07.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:06 smithi170 ceph-mon[31212]: pgmap v10213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:06 smithi077 ceph-mon[27902]: pgmap v10213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:07.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:06 smithi191 ceph-mon[31636]: pgmap v10213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:08.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18978.666135 secs 2024-04-21T15:41:08.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18978.666135 secs 2024-04-21T15:41:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18978.666135 secs 2024-04-21T15:41:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:08 smithi170 ceph-mon[31212]: pgmap v10214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:08 smithi077 ceph-mon[27902]: pgmap v10214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:08 smithi191 ceph-mon[31636]: pgmap v10214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:10.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18980.427965 secs 2024-04-21T15:41:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18980.427965 secs 2024-04-21T15:41:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18980.427965 secs 2024-04-21T15:41:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:10 smithi170 ceph-mon[31212]: pgmap v10215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:10 smithi170 ceph-mon[31212]: osdmap e711: 12 total, 12 up, 12 in 2024-04-21T15:41:11.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:10 smithi077 ceph-mon[27902]: pgmap v10215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:11.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:10 smithi077 ceph-mon[27902]: osdmap e711: 12 total, 12 up, 12 in 2024-04-21T15:41:11.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:10 smithi191 ceph-mon[31636]: pgmap v10215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:41:11.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:10 smithi191 ceph-mon[31636]: osdmap e711: 12 total, 12 up, 12 in 2024-04-21T15:41:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:12 smithi170 ceph-mon[31212]: pgmap v10217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:41:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18983.666277 secs 2024-04-21T15:41:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:12 smithi077 ceph-mon[27902]: pgmap v10217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:41:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18983.666277 secs 2024-04-21T15:41:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:12 smithi191 ceph-mon[31636]: pgmap v10217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:41:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18983.666277 secs 2024-04-21T15:41:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18985.428109 secs 2024-04-21T15:41:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:14 smithi170 ceph-mon[31212]: pgmap v10218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18985.428109 secs 2024-04-21T15:41:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:14 smithi077 ceph-mon[27902]: pgmap v10218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:41:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18985.428109 secs 2024-04-21T15:41:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:14 smithi191 ceph-mon[31636]: pgmap v10218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:41:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:16 smithi170 ceph-mon[31212]: pgmap v10219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:16 smithi077 ceph-mon[27902]: pgmap v10219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:16 smithi191 ceph-mon[31636]: pgmap v10219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:18.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18988.666409 secs 2024-04-21T15:41:18.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18988.666409 secs 2024-04-21T15:41:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18988.666409 secs 2024-04-21T15:41:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:18 smithi170 ceph-mon[31212]: pgmap v10220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:18 smithi077 ceph-mon[27902]: pgmap v10220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:18 smithi191 ceph-mon[31636]: pgmap v10220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:20.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18990.428204 secs 2024-04-21T15:41:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:20.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18990.428204 secs 2024-04-21T15:41:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18990.428204 secs 2024-04-21T15:41:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:20 smithi170 ceph-mon[31212]: pgmap v10221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:20 smithi077 ceph-mon[27902]: pgmap v10221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:20 smithi191 ceph-mon[31636]: pgmap v10221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:41:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:22 smithi170 ceph-mon[31212]: pgmap v10222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:41:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18993.666521 secs 2024-04-21T15:41:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:22 smithi077 ceph-mon[27902]: pgmap v10222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:41:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18993.666521 secs 2024-04-21T15:41:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:22 smithi191 ceph-mon[31636]: pgmap v10222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:41:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18993.666521 secs 2024-04-21T15:41:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:41:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:41:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:41:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:41:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:41:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:41:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:41:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:41:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:41:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:41:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:41:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:41:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 18995.428352 secs 2024-04-21T15:41:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:24 smithi170 ceph-mon[31212]: pgmap v10223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 18995.428352 secs 2024-04-21T15:41:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:24 smithi077 ceph-mon[27902]: pgmap v10223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 18995.428352 secs 2024-04-21T15:41:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:24 smithi191 ceph-mon[31636]: pgmap v10223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:26 smithi170 ceph-mon[31212]: pgmap v10224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:26 smithi077 ceph-mon[27902]: pgmap v10224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:26 smithi191 ceph-mon[31636]: pgmap v10224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:28.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 18998.666611 secs 2024-04-21T15:41:28.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 18998.666611 secs 2024-04-21T15:41:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 18998.666611 secs 2024-04-21T15:41:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:28 smithi170 ceph-mon[31212]: pgmap v10225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:29.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:28 smithi077 ceph-mon[27902]: pgmap v10225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:28 smithi191 ceph-mon[31636]: pgmap v10225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:30.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19000.428486 secs 2024-04-21T15:41:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:30.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19000.428486 secs 2024-04-21T15:41:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19000.428486 secs 2024-04-21T15:41:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:30 smithi170 ceph-mon[31212]: pgmap v10226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:31.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:30 smithi077 ceph-mon[27902]: pgmap v10226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:30 smithi191 ceph-mon[31636]: pgmap v10226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:32 smithi170 ceph-mon[31212]: pgmap v10227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19003.666696 secs 2024-04-21T15:41:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:32 smithi077 ceph-mon[27902]: pgmap v10227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19003.666696 secs 2024-04-21T15:41:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:32 smithi191 ceph-mon[31636]: pgmap v10227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19003.666696 secs 2024-04-21T15:41:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19005.428606 secs 2024-04-21T15:41:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:34 smithi170 ceph-mon[31212]: pgmap v10228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19005.428606 secs 2024-04-21T15:41:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:34 smithi077 ceph-mon[27902]: pgmap v10228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19005.428606 secs 2024-04-21T15:41:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:34 smithi191 ceph-mon[31636]: pgmap v10228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:36 smithi170 ceph-mon[31212]: pgmap v10229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:37.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:36 smithi077 ceph-mon[27902]: pgmap v10229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:37.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:36 smithi191 ceph-mon[31636]: pgmap v10229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:38.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19008.666811 secs 2024-04-21T15:41:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19008.666811 secs 2024-04-21T15:41:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19008.666811 secs 2024-04-21T15:41:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:38 smithi077 ceph-mon[27902]: pgmap v10230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:38 smithi191 ceph-mon[31636]: pgmap v10230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:38 smithi170 ceph-mon[31212]: pgmap v10230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:40.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19010.428749 secs 2024-04-21T15:41:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19010.428749 secs 2024-04-21T15:41:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19010.428749 secs 2024-04-21T15:41:41.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:40 smithi077 ceph-mon[27902]: pgmap v10231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:40 smithi191 ceph-mon[31636]: pgmap v10231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:40 smithi170 ceph-mon[31212]: pgmap v10231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:42 smithi077 ceph-mon[27902]: pgmap v10232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19013.666932 secs 2024-04-21T15:41:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:42 smithi191 ceph-mon[31636]: pgmap v10232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19013.666932 secs 2024-04-21T15:41:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:42 smithi170 ceph-mon[31212]: pgmap v10232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:43.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19013.666932 secs 2024-04-21T15:41:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19015.428890 secs 2024-04-21T15:41:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:44 smithi077 ceph-mon[27902]: pgmap v10233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19015.428890 secs 2024-04-21T15:41:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:44 smithi191 ceph-mon[31636]: pgmap v10233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19015.428890 secs 2024-04-21T15:41:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:44 smithi170 ceph-mon[31212]: pgmap v10233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:46 smithi077 ceph-mon[27902]: pgmap v10234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:46 smithi191 ceph-mon[31636]: pgmap v10234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:46 smithi170 ceph-mon[31212]: pgmap v10234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:48.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19018.667045 secs 2024-04-21T15:41:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19018.667045 secs 2024-04-21T15:41:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19018.667045 secs 2024-04-21T15:41:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:48 smithi077 ceph-mon[27902]: pgmap v10235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:48 smithi191 ceph-mon[31636]: pgmap v10235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:48 smithi170 ceph-mon[31212]: pgmap v10235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19020.428959 secs 2024-04-21T15:41:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19020.428959 secs 2024-04-21T15:41:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19020.428959 secs 2024-04-21T15:41:51.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:50 smithi077 ceph-mon[27902]: pgmap v10236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:50 smithi191 ceph-mon[31636]: pgmap v10236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:50 smithi170 ceph-mon[31212]: pgmap v10236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:52 smithi077 ceph-mon[27902]: pgmap v10237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19023.667167 secs 2024-04-21T15:41:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:52 smithi191 ceph-mon[31636]: pgmap v10237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19023.667167 secs 2024-04-21T15:41:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:52 smithi170 ceph-mon[31212]: pgmap v10237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19023.667167 secs 2024-04-21T15:41:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:41:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19025.429085 secs 2024-04-21T15:41:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:54 smithi077 ceph-mon[27902]: pgmap v10238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19025.429085 secs 2024-04-21T15:41:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:54 smithi191 ceph-mon[31636]: pgmap v10238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19025.429085 secs 2024-04-21T15:41:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:54 smithi170 ceph-mon[31212]: pgmap v10238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:56 smithi077 ceph-mon[27902]: pgmap v10239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:56 smithi191 ceph-mon[31636]: pgmap v10239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:56 smithi170 ceph-mon[31212]: pgmap v10239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:41:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19028.667287 secs 2024-04-21T15:41:58.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19028.667287 secs 2024-04-21T15:41:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19028.667287 secs 2024-04-21T15:41:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:58 smithi077 ceph-mon[27902]: pgmap v10240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:58 smithi191 ceph-mon[31636]: pgmap v10240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:41:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:58 smithi170 ceph-mon[31212]: pgmap v10240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:00.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:41:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19030.429216 secs 2024-04-21T15:42:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:41:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19030.429216 secs 2024-04-21T15:42:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:41:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19030.429216 secs 2024-04-21T15:42:01.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:00 smithi077 ceph-mon[27902]: pgmap v10241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:00 smithi191 ceph-mon[31636]: pgmap v10241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:00 smithi170 ceph-mon[31212]: pgmap v10241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:02 smithi077 ceph-mon[27902]: pgmap v10242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19033.667407 secs 2024-04-21T15:42:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:02 smithi191 ceph-mon[31636]: pgmap v10242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19033.667407 secs 2024-04-21T15:42:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:02 smithi170 ceph-mon[31212]: pgmap v10242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19033.667407 secs 2024-04-21T15:42:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19035.429345 secs 2024-04-21T15:42:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:04 smithi191 ceph-mon[31636]: pgmap v10243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:04 smithi191 ceph-mon[31636]: osdmap e712: 12 total, 12 up, 12 in 2024-04-21T15:42:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19035.429345 secs 2024-04-21T15:42:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:04 smithi170 ceph-mon[31212]: pgmap v10243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:04 smithi170 ceph-mon[31212]: osdmap e712: 12 total, 12 up, 12 in 2024-04-21T15:42:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19035.429345 secs 2024-04-21T15:42:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:04 smithi077 ceph-mon[27902]: pgmap v10243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:04 smithi077 ceph-mon[27902]: osdmap e712: 12 total, 12 up, 12 in 2024-04-21T15:42:07.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:06 smithi191 ceph-mon[31636]: pgmap v10245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:06 smithi170 ceph-mon[31212]: pgmap v10245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:07.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:06 smithi077 ceph-mon[27902]: pgmap v10245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19038.667493 secs 2024-04-21T15:42:08.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19038.667493 secs 2024-04-21T15:42:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19038.667493 secs 2024-04-21T15:42:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:08 smithi191 ceph-mon[31636]: pgmap v10246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:08 smithi170 ceph-mon[31212]: pgmap v10246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:08 smithi077 ceph-mon[27902]: pgmap v10246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19040.429471 secs 2024-04-21T15:42:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19040.429471 secs 2024-04-21T15:42:10.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19040.429471 secs 2024-04-21T15:42:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:10 smithi191 ceph-mon[31636]: pgmap v10247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:10 smithi191 ceph-mon[31636]: osdmap e713: 12 total, 12 up, 12 in 2024-04-21T15:42:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:10 smithi170 ceph-mon[31212]: pgmap v10247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:11.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:10 smithi170 ceph-mon[31212]: osdmap e713: 12 total, 12 up, 12 in 2024-04-21T15:42:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:10 smithi077 ceph-mon[27902]: pgmap v10247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:42:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:10 smithi077 ceph-mon[27902]: osdmap e713: 12 total, 12 up, 12 in 2024-04-21T15:42:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:12 smithi191 ceph-mon[31636]: pgmap v10249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:42:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19043.667608 secs 2024-04-21T15:42:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:12 smithi170 ceph-mon[31212]: pgmap v10249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:42:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19043.667608 secs 2024-04-21T15:42:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:12 smithi077 ceph-mon[27902]: pgmap v10249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:42:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19043.667608 secs 2024-04-21T15:42:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19045.429602 secs 2024-04-21T15:42:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:14 smithi191 ceph-mon[31636]: pgmap v10250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:42:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19045.429602 secs 2024-04-21T15:42:15.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:14 smithi170 ceph-mon[31212]: pgmap v10250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:42:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19045.429602 secs 2024-04-21T15:42:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:14 smithi077 ceph-mon[27902]: pgmap v10250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:42:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:16 smithi191 ceph-mon[31636]: pgmap v10251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:16 smithi170 ceph-mon[31212]: pgmap v10251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:17.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:16 smithi077 ceph-mon[27902]: pgmap v10251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19048.667743 secs 2024-04-21T15:42:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19048.667743 secs 2024-04-21T15:42:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19048.667743 secs 2024-04-21T15:42:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:18 smithi191 ceph-mon[31636]: pgmap v10252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:18 smithi170 ceph-mon[31212]: pgmap v10252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:18 smithi077 ceph-mon[27902]: pgmap v10252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19050.429723 secs 2024-04-21T15:42:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19050.429723 secs 2024-04-21T15:42:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19050.429723 secs 2024-04-21T15:42:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:20 smithi191 ceph-mon[31636]: pgmap v10253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:20 smithi170 ceph-mon[31212]: pgmap v10253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:20 smithi077 ceph-mon[27902]: pgmap v10253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:42:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:22 smithi191 ceph-mon[31636]: pgmap v10254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:42:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19053.667798 secs 2024-04-21T15:42:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:22 smithi170 ceph-mon[31212]: pgmap v10254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:42:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19053.667798 secs 2024-04-21T15:42:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:22 smithi077 ceph-mon[27902]: pgmap v10254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:42:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19053.667798 secs 2024-04-21T15:42:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:42:24.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:42:24.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:42:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19055.429844 secs 2024-04-21T15:42:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:24 smithi191 ceph-mon[31636]: pgmap v10255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:42:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:42:25.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:42:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19055.429844 secs 2024-04-21T15:42:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:24 smithi170 ceph-mon[31212]: pgmap v10255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:42:25.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:42:25.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:42:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19055.429844 secs 2024-04-21T15:42:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:24 smithi077 ceph-mon[27902]: pgmap v10255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:42:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:42:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:42:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:42:26.987+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:42:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:42:26.987+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:42:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:42:26.988+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:42:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:42:26.988+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:42:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:26 smithi191 ceph-mon[31636]: pgmap v10256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:26 smithi170 ceph-mon[31212]: pgmap v10256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:26 smithi077 ceph-mon[27902]: pgmap v10256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:28.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19058.667938 secs 2024-04-21T15:42:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19058.667938 secs 2024-04-21T15:42:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19058.667938 secs 2024-04-21T15:42:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:28 smithi191 ceph-mon[31636]: pgmap v10257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:28 smithi170 ceph-mon[31212]: pgmap v10257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:28 smithi077 ceph-mon[27902]: pgmap v10257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19060.429957 secs 2024-04-21T15:42:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19060.429957 secs 2024-04-21T15:42:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19060.429957 secs 2024-04-21T15:42:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:30 smithi191 ceph-mon[31636]: pgmap v10258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:30 smithi170 ceph-mon[31212]: pgmap v10258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:30 smithi077 ceph-mon[27902]: pgmap v10258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:32 smithi170 ceph-mon[31212]: pgmap v10259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19063.668052 secs 2024-04-21T15:42:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:32 smithi077 ceph-mon[27902]: pgmap v10259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19063.668052 secs 2024-04-21T15:42:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:32 smithi191 ceph-mon[31636]: pgmap v10259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19063.668052 secs 2024-04-21T15:42:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19065.430074 secs 2024-04-21T15:42:35.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:34 smithi170 ceph-mon[31212]: pgmap v10260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19065.430074 secs 2024-04-21T15:42:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:34 smithi077 ceph-mon[27902]: pgmap v10260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19065.430074 secs 2024-04-21T15:42:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:34 smithi191 ceph-mon[31636]: pgmap v10260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:36 smithi170 ceph-mon[31212]: pgmap v10261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:36 smithi077 ceph-mon[27902]: pgmap v10261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:36 smithi191 ceph-mon[31636]: pgmap v10261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:38.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19068.668121 secs 2024-04-21T15:42:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19068.668121 secs 2024-04-21T15:42:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19068.668121 secs 2024-04-21T15:42:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:38 smithi170 ceph-mon[31212]: pgmap v10262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:38 smithi077 ceph-mon[27902]: pgmap v10262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:38 smithi191 ceph-mon[31636]: pgmap v10262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19070.430187 secs 2024-04-21T15:42:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19070.430187 secs 2024-04-21T15:42:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19070.430187 secs 2024-04-21T15:42:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:40 smithi170 ceph-mon[31212]: pgmap v10263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:40 smithi077 ceph-mon[27902]: pgmap v10263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:40 smithi191 ceph-mon[31636]: pgmap v10263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:42 smithi170 ceph-mon[31212]: pgmap v10264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19073.668221 secs 2024-04-21T15:42:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:42 smithi077 ceph-mon[27902]: pgmap v10264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19073.668221 secs 2024-04-21T15:42:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:42 smithi191 ceph-mon[31636]: pgmap v10264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19073.668221 secs 2024-04-21T15:42:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19075.430300 secs 2024-04-21T15:42:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:44 smithi170 ceph-mon[31212]: pgmap v10265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19075.430300 secs 2024-04-21T15:42:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:44 smithi077 ceph-mon[27902]: pgmap v10265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19075.430300 secs 2024-04-21T15:42:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:44 smithi191 ceph-mon[31636]: pgmap v10265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:47.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:47 smithi170 ceph-mon[31212]: pgmap v10266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:47.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:47 smithi077 ceph-mon[27902]: pgmap v10266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:47 smithi191 ceph-mon[31636]: pgmap v10266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19078.668283 secs 2024-04-21T15:42:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19078.668283 secs 2024-04-21T15:42:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19078.668283 secs 2024-04-21T15:42:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:49 smithi170 ceph-mon[31212]: pgmap v10267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:49 smithi077 ceph-mon[27902]: pgmap v10267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:49 smithi191 ceph-mon[31636]: pgmap v10267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19080.430415 secs 2024-04-21T15:42:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19080.430415 secs 2024-04-21T15:42:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19080.430415 secs 2024-04-21T15:42:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:51 smithi170 ceph-mon[31212]: pgmap v10268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:51 smithi077 ceph-mon[27902]: pgmap v10268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:51 smithi191 ceph-mon[31636]: pgmap v10268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:42:52.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:52 smithi077 ceph-mon[27902]: pgmap v10269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:52.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:52 smithi191 ceph-mon[31636]: pgmap v10269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:52.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:52 smithi170 ceph-mon[31212]: pgmap v10269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19083.668423 secs 2024-04-21T15:42:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19083.668423 secs 2024-04-21T15:42:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19083.668423 secs 2024-04-21T15:42:54.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19085.430526 secs 2024-04-21T15:42:54.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:54 smithi077 ceph-mon[27902]: pgmap v10270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:54.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19085.430526 secs 2024-04-21T15:42:54.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:54 smithi191 ceph-mon[31636]: pgmap v10270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:54.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19085.430526 secs 2024-04-21T15:42:54.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:54 smithi170 ceph-mon[31212]: pgmap v10270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:42:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:56 smithi170 ceph-mon[31212]: pgmap v10271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:56 smithi077 ceph-mon[27902]: pgmap v10271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:57.176 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:56 smithi191 ceph-mon[31636]: pgmap v10271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:42:58.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19088.668483 secs 2024-04-21T15:42:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19088.668483 secs 2024-04-21T15:42:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19088.668483 secs 2024-04-21T15:42:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:58 smithi170 ceph-mon[31212]: pgmap v10272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:58 smithi077 ceph-mon[27902]: pgmap v10272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:42:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:58 smithi191 ceph-mon[31636]: pgmap v10272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:42:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19090.430655 secs 2024-04-21T15:43:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:42:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19090.430655 secs 2024-04-21T15:43:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:42:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19090.430655 secs 2024-04-21T15:43:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:00 smithi170 ceph-mon[31212]: pgmap v10273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:00 smithi077 ceph-mon[27902]: pgmap v10273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:00 smithi191 ceph-mon[31636]: pgmap v10273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:02 smithi170 ceph-mon[31212]: pgmap v10274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19093.668598 secs 2024-04-21T15:43:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:02 smithi077 ceph-mon[27902]: pgmap v10274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19093.668598 secs 2024-04-21T15:43:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:02 smithi191 ceph-mon[31636]: pgmap v10274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19093.668598 secs 2024-04-21T15:43:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19095.430776 secs 2024-04-21T15:43:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:04 smithi170 ceph-mon[31212]: pgmap v10275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:04 smithi170 ceph-mon[31212]: osdmap e714: 12 total, 12 up, 12 in 2024-04-21T15:43:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19095.430776 secs 2024-04-21T15:43:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:04 smithi077 ceph-mon[27902]: pgmap v10275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:04 smithi077 ceph-mon[27902]: osdmap e714: 12 total, 12 up, 12 in 2024-04-21T15:43:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19095.430776 secs 2024-04-21T15:43:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:04 smithi191 ceph-mon[31636]: pgmap v10275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:04 smithi191 ceph-mon[31636]: osdmap e714: 12 total, 12 up, 12 in 2024-04-21T15:43:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:06 smithi170 ceph-mon[31212]: pgmap v10277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:07.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:06 smithi077 ceph-mon[27902]: pgmap v10277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:07.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:06 smithi191 ceph-mon[31636]: pgmap v10277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:08.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19098.668738 secs 2024-04-21T15:43:08.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19098.668738 secs 2024-04-21T15:43:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19098.668738 secs 2024-04-21T15:43:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:08 smithi170 ceph-mon[31212]: pgmap v10278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:08 smithi077 ceph-mon[27902]: pgmap v10278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:08 smithi191 ceph-mon[31636]: pgmap v10278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:10.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19100.430923 secs 2024-04-21T15:43:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:10.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19100.430923 secs 2024-04-21T15:43:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19100.430923 secs 2024-04-21T15:43:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:10 smithi170 ceph-mon[31212]: pgmap v10279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:10 smithi170 ceph-mon[31212]: osdmap e715: 12 total, 12 up, 12 in 2024-04-21T15:43:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:10 smithi077 ceph-mon[27902]: pgmap v10279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:11.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:10 smithi077 ceph-mon[27902]: osdmap e715: 12 total, 12 up, 12 in 2024-04-21T15:43:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:10 smithi191 ceph-mon[31636]: pgmap v10279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:43:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:10 smithi191 ceph-mon[31636]: osdmap e715: 12 total, 12 up, 12 in 2024-04-21T15:43:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:12 smithi170 ceph-mon[31212]: pgmap v10281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:43:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19103.668851 secs 2024-04-21T15:43:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:12 smithi077 ceph-mon[27902]: pgmap v10281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:43:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19103.668851 secs 2024-04-21T15:43:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:12 smithi191 ceph-mon[31636]: pgmap v10281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:43:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19103.668851 secs 2024-04-21T15:43:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19105.431037 secs 2024-04-21T15:43:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:14 smithi170 ceph-mon[31212]: pgmap v10282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:43:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19105.431037 secs 2024-04-21T15:43:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:14 smithi077 ceph-mon[27902]: pgmap v10282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:43:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19105.431037 secs 2024-04-21T15:43:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:14 smithi191 ceph-mon[31636]: pgmap v10282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:43:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:16 smithi170 ceph-mon[31212]: pgmap v10283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:16 smithi077 ceph-mon[27902]: pgmap v10283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:16 smithi191 ceph-mon[31636]: pgmap v10283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19108.668944 secs 2024-04-21T15:43:18.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19108.668944 secs 2024-04-21T15:43:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19108.668944 secs 2024-04-21T15:43:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:18 smithi170 ceph-mon[31212]: pgmap v10284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:18 smithi077 ceph-mon[27902]: pgmap v10284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:18 smithi191 ceph-mon[31636]: pgmap v10284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19110.431169 secs 2024-04-21T15:43:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19110.431169 secs 2024-04-21T15:43:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19110.431169 secs 2024-04-21T15:43:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:20 smithi077 ceph-mon[27902]: pgmap v10285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:20 smithi191 ceph-mon[31636]: pgmap v10285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:20 smithi170 ceph-mon[31212]: pgmap v10285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:43:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:22 smithi077 ceph-mon[27902]: pgmap v10286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:43:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19113.669060 secs 2024-04-21T15:43:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:22 smithi191 ceph-mon[31636]: pgmap v10286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:43:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19113.669060 secs 2024-04-21T15:43:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:22 smithi170 ceph-mon[31212]: pgmap v10286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:43:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19113.669060 secs 2024-04-21T15:43:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19115.431332 secs 2024-04-21T15:43:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:24 smithi077 ceph-mon[27902]: pgmap v10287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:43:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19115.431332 secs 2024-04-21T15:43:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:24 smithi191 ceph-mon[31636]: pgmap v10287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:43:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19115.431332 secs 2024-04-21T15:43:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:24 smithi170 ceph-mon[31212]: pgmap v10287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:43:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:43:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:43:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:43:26.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:43:26.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:43:26.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:43:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:43:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:43:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:43:27.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:26 smithi191 ceph-mon[31636]: pgmap v10288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:26 smithi077 ceph-mon[27902]: pgmap v10288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:26 smithi170 ceph-mon[31212]: pgmap v10288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:28.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19118.669186 secs 2024-04-21T15:43:28.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19118.669186 secs 2024-04-21T15:43:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19118.669186 secs 2024-04-21T15:43:29.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:28 smithi077 ceph-mon[27902]: pgmap v10289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:28 smithi191 ceph-mon[31636]: pgmap v10289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:28 smithi170 ceph-mon[31212]: pgmap v10289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:30.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19120.431461 secs 2024-04-21T15:43:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19120.431461 secs 2024-04-21T15:43:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19120.431461 secs 2024-04-21T15:43:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:30 smithi077 ceph-mon[27902]: pgmap v10290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:30 smithi191 ceph-mon[31636]: pgmap v10290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:30 smithi170 ceph-mon[31212]: pgmap v10290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:32 smithi077 ceph-mon[27902]: pgmap v10291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19123.669296 secs 2024-04-21T15:43:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:32 smithi191 ceph-mon[31636]: pgmap v10291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19123.669296 secs 2024-04-21T15:43:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:32 smithi170 ceph-mon[31212]: pgmap v10291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19123.669296 secs 2024-04-21T15:43:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19125.431587 secs 2024-04-21T15:43:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:34 smithi077 ceph-mon[27902]: pgmap v10292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19125.431587 secs 2024-04-21T15:43:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:34 smithi191 ceph-mon[31636]: pgmap v10292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19125.431587 secs 2024-04-21T15:43:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:34 smithi170 ceph-mon[31212]: pgmap v10292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:36 smithi077 ceph-mon[27902]: pgmap v10293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:37.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:36 smithi191 ceph-mon[31636]: pgmap v10293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:36 smithi170 ceph-mon[31212]: pgmap v10293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:38.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19128.669411 secs 2024-04-21T15:43:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19128.669411 secs 2024-04-21T15:43:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19128.669411 secs 2024-04-21T15:43:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:38 smithi077 ceph-mon[27902]: pgmap v10294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:38 smithi191 ceph-mon[31636]: pgmap v10294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:38 smithi170 ceph-mon[31212]: pgmap v10294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19130.431711 secs 2024-04-21T15:43:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19130.431711 secs 2024-04-21T15:43:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19130.431711 secs 2024-04-21T15:43:41.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:40 smithi077 ceph-mon[27902]: pgmap v10295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:40 smithi191 ceph-mon[31636]: pgmap v10295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:40 smithi170 ceph-mon[31212]: pgmap v10295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:42 smithi077 ceph-mon[27902]: pgmap v10296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19133.669541 secs 2024-04-21T15:43:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:42 smithi191 ceph-mon[31636]: pgmap v10296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19133.669541 secs 2024-04-21T15:43:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:42 smithi170 ceph-mon[31212]: pgmap v10296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19133.669541 secs 2024-04-21T15:43:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19135.431807 secs 2024-04-21T15:43:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:44 smithi077 ceph-mon[27902]: pgmap v10297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19135.431807 secs 2024-04-21T15:43:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:44 smithi191 ceph-mon[31636]: pgmap v10297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19135.431807 secs 2024-04-21T15:43:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:44 smithi170 ceph-mon[31212]: pgmap v10297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:46 smithi077 ceph-mon[27902]: pgmap v10298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:46 smithi191 ceph-mon[31636]: pgmap v10298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:46 smithi170 ceph-mon[31212]: pgmap v10298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19138.669646 secs 2024-04-21T15:43:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19138.669646 secs 2024-04-21T15:43:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19138.669646 secs 2024-04-21T15:43:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:48 smithi077 ceph-mon[27902]: pgmap v10299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:48 smithi191 ceph-mon[31636]: pgmap v10299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:48 smithi170 ceph-mon[31212]: pgmap v10299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19140.431908 secs 2024-04-21T15:43:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19140.431908 secs 2024-04-21T15:43:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19140.431908 secs 2024-04-21T15:43:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:50 smithi191 ceph-mon[31636]: pgmap v10300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:50 smithi170 ceph-mon[31212]: pgmap v10300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:50 smithi077 ceph-mon[27902]: pgmap v10300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:52 smithi191 ceph-mon[31636]: pgmap v10301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19143.669778 secs 2024-04-21T15:43:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:52 smithi170 ceph-mon[31212]: pgmap v10301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19143.669778 secs 2024-04-21T15:43:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:52 smithi077 ceph-mon[27902]: pgmap v10301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19143.669778 secs 2024-04-21T15:43:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T15:43:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T15:43:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:43:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T15:43:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:43:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T15:43:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.438+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7002b070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7002b070 comp rx=0 tx=0).stop 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T15:43:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T15:43:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:43:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:54.462+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bd0 tx=0x7efd70062000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T15:43:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:43:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19145.432011 secs 2024-04-21T15:43:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:54 smithi191 ceph-mon[31636]: pgmap v10302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19145.432011 secs 2024-04-21T15:43:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:54 smithi170 ceph-mon[31212]: pgmap v10302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19145.432011 secs 2024-04-21T15:43:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:54 smithi077 ceph-mon[27902]: pgmap v10302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:57.001+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:43:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:57.001+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:43:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:57.001+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:43:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:43:57.001+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:43:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:56 smithi191 ceph-mon[31636]: pgmap v10303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:56 smithi170 ceph-mon[31212]: pgmap v10303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:56 smithi077 ceph-mon[27902]: pgmap v10303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:43:58.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19148.669876 secs 2024-04-21T15:43:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19148.669876 secs 2024-04-21T15:43:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19148.669876 secs 2024-04-21T15:43:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:58 smithi191 ceph-mon[31636]: pgmap v10304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:58 smithi170 ceph-mon[31212]: pgmap v10304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:43:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:58 smithi077 ceph-mon[27902]: pgmap v10304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19150.432135 secs 2024-04-21T15:44:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19150.432135 secs 2024-04-21T15:44:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19150.432135 secs 2024-04-21T15:44:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:00 smithi191 ceph-mon[31636]: pgmap v10305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:00 smithi170 ceph-mon[31212]: pgmap v10305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:00 smithi077 ceph-mon[27902]: pgmap v10305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:02 smithi191 ceph-mon[31636]: pgmap v10306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19153.669995 secs 2024-04-21T15:44:03.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:02 smithi170 ceph-mon[31212]: pgmap v10306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:03.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19153.669995 secs 2024-04-21T15:44:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:02 smithi077 ceph-mon[27902]: pgmap v10306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19153.669995 secs 2024-04-21T15:44:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19155.432255 secs 2024-04-21T15:44:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:04 smithi191 ceph-mon[31636]: pgmap v10307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:04 smithi191 ceph-mon[31636]: osdmap e716: 12 total, 12 up, 12 in 2024-04-21T15:44:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19155.432255 secs 2024-04-21T15:44:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:04 smithi170 ceph-mon[31212]: pgmap v10307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:04 smithi170 ceph-mon[31212]: osdmap e716: 12 total, 12 up, 12 in 2024-04-21T15:44:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19155.432255 secs 2024-04-21T15:44:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:04 smithi077 ceph-mon[27902]: pgmap v10307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:04 smithi077 ceph-mon[27902]: osdmap e716: 12 total, 12 up, 12 in 2024-04-21T15:44:07.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:06 smithi191 ceph-mon[31636]: pgmap v10309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:06 smithi170 ceph-mon[31212]: pgmap v10309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:06 smithi077 ceph-mon[27902]: pgmap v10309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19158.670076 secs 2024-04-21T15:44:08.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19158.670076 secs 2024-04-21T15:44:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19158.670076 secs 2024-04-21T15:44:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:08 smithi191 ceph-mon[31636]: pgmap v10310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:08 smithi170 ceph-mon[31212]: pgmap v10310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:08 smithi077 ceph-mon[27902]: pgmap v10310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19160.432380 secs 2024-04-21T15:44:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19160.432380 secs 2024-04-21T15:44:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19160.432380 secs 2024-04-21T15:44:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:10 smithi191 ceph-mon[31636]: pgmap v10311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:10 smithi191 ceph-mon[31636]: osdmap e717: 12 total, 12 up, 12 in 2024-04-21T15:44:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:10 smithi170 ceph-mon[31212]: pgmap v10311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:10 smithi170 ceph-mon[31212]: osdmap e717: 12 total, 12 up, 12 in 2024-04-21T15:44:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:10 smithi077 ceph-mon[27902]: pgmap v10311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:44:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:10 smithi077 ceph-mon[27902]: osdmap e717: 12 total, 12 up, 12 in 2024-04-21T15:44:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:12 smithi191 ceph-mon[31636]: pgmap v10313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:44:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19163.670189 secs 2024-04-21T15:44:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:12 smithi170 ceph-mon[31212]: pgmap v10313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:44:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19163.670189 secs 2024-04-21T15:44:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:12 smithi077 ceph-mon[27902]: pgmap v10313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:44:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19163.670189 secs 2024-04-21T15:44:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19165.432501 secs 2024-04-21T15:44:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:14 smithi191 ceph-mon[31636]: pgmap v10314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:44:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19165.432501 secs 2024-04-21T15:44:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:14 smithi170 ceph-mon[31212]: pgmap v10314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:44:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19165.432501 secs 2024-04-21T15:44:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:14 smithi077 ceph-mon[27902]: pgmap v10314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:44:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:16 smithi191 ceph-mon[31636]: pgmap v10315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:16 smithi170 ceph-mon[31212]: pgmap v10315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:16 smithi077 ceph-mon[27902]: pgmap v10315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19168.670306 secs 2024-04-21T15:44:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19168.670306 secs 2024-04-21T15:44:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19168.670306 secs 2024-04-21T15:44:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:18 smithi191 ceph-mon[31636]: pgmap v10316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:18 smithi170 ceph-mon[31212]: pgmap v10316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:18 smithi077 ceph-mon[27902]: pgmap v10316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19170.432641 secs 2024-04-21T15:44:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19170.432641 secs 2024-04-21T15:44:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19170.432641 secs 2024-04-21T15:44:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:20 smithi191 ceph-mon[31636]: pgmap v10317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:20 smithi170 ceph-mon[31212]: pgmap v10317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:20 smithi077 ceph-mon[27902]: pgmap v10317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:44:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:22 smithi191 ceph-mon[31636]: pgmap v10318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:44:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19173.670440 secs 2024-04-21T15:44:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:22 smithi170 ceph-mon[31212]: pgmap v10318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:44:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19173.670440 secs 2024-04-21T15:44:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:22 smithi077 ceph-mon[27902]: pgmap v10318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:44:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19173.670440 secs 2024-04-21T15:44:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19175.432765 secs 2024-04-21T15:44:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:24 smithi170 ceph-mon[31212]: pgmap v10319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19175.432765 secs 2024-04-21T15:44:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:24 smithi077 ceph-mon[27902]: pgmap v10319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19175.432765 secs 2024-04-21T15:44:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:24 smithi191 ceph-mon[31636]: pgmap v10319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:44:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:44:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:44:26.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:44:26.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:44:26.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:44:26.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:44:26.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:44:26.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:44:26.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:44:26.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:44:26.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:44:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:26 smithi170 ceph-mon[31212]: pgmap v10320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:27.374 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:26 smithi191 ceph-mon[31636]: pgmap v10320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:26 smithi077 ceph-mon[27902]: pgmap v10320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19178.670585 secs 2024-04-21T15:44:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19178.670585 secs 2024-04-21T15:44:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19178.670585 secs 2024-04-21T15:44:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:28 smithi170 ceph-mon[31212]: pgmap v10321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:28 smithi077 ceph-mon[27902]: pgmap v10321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:28 smithi191 ceph-mon[31636]: pgmap v10321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19180.432941 secs 2024-04-21T15:44:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19180.432941 secs 2024-04-21T15:44:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19180.432941 secs 2024-04-21T15:44:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:30 smithi170 ceph-mon[31212]: pgmap v10322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:30 smithi077 ceph-mon[27902]: pgmap v10322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:30 smithi191 ceph-mon[31636]: pgmap v10322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:32 smithi170 ceph-mon[31212]: pgmap v10323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19183.670726 secs 2024-04-21T15:44:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:32 smithi077 ceph-mon[27902]: pgmap v10323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19183.670726 secs 2024-04-21T15:44:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:32 smithi191 ceph-mon[31636]: pgmap v10323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19183.670726 secs 2024-04-21T15:44:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19185.433058 secs 2024-04-21T15:44:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:35 smithi170 ceph-mon[31212]: pgmap v10324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19185.433058 secs 2024-04-21T15:44:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:35 smithi077 ceph-mon[27902]: pgmap v10324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19185.433058 secs 2024-04-21T15:44:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:35 smithi191 ceph-mon[31636]: pgmap v10324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:37 smithi170 ceph-mon[31212]: pgmap v10325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:37 smithi077 ceph-mon[27902]: pgmap v10325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:37 smithi191 ceph-mon[31636]: pgmap v10325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:38.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19188.670857 secs 2024-04-21T15:44:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19188.670857 secs 2024-04-21T15:44:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19188.670857 secs 2024-04-21T15:44:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:39 smithi170 ceph-mon[31212]: pgmap v10326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:39 smithi077 ceph-mon[27902]: pgmap v10326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:39 smithi191 ceph-mon[31636]: pgmap v10326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19190.433180 secs 2024-04-21T15:44:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19190.433180 secs 2024-04-21T15:44:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19190.433180 secs 2024-04-21T15:44:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:41 smithi170 ceph-mon[31212]: pgmap v10327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:41 smithi077 ceph-mon[27902]: pgmap v10327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:41 smithi191 ceph-mon[31636]: pgmap v10327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:43 smithi170 ceph-mon[31212]: pgmap v10328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19193.670981 secs 2024-04-21T15:44:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:43 smithi077 ceph-mon[27902]: pgmap v10328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19193.670981 secs 2024-04-21T15:44:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:43 smithi191 ceph-mon[31636]: pgmap v10328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19193.670981 secs 2024-04-21T15:44:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19195.433304 secs 2024-04-21T15:44:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:45 smithi170 ceph-mon[31212]: pgmap v10329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19195.433304 secs 2024-04-21T15:44:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:45 smithi077 ceph-mon[27902]: pgmap v10329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19195.433304 secs 2024-04-21T15:44:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:45 smithi191 ceph-mon[31636]: pgmap v10329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:47 smithi170 ceph-mon[31212]: pgmap v10330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:47 smithi077 ceph-mon[27902]: pgmap v10330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:47 smithi191 ceph-mon[31636]: pgmap v10330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19198.671109 secs 2024-04-21T15:44:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19198.671109 secs 2024-04-21T15:44:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19198.671109 secs 2024-04-21T15:44:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:49 smithi170 ceph-mon[31212]: pgmap v10331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:49 smithi077 ceph-mon[27902]: pgmap v10331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:49 smithi191 ceph-mon[31636]: pgmap v10331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19200.433425 secs 2024-04-21T15:44:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:50 smithi170 ceph-mon[31212]: pgmap v10332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19200.433425 secs 2024-04-21T15:44:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:50 smithi077 ceph-mon[27902]: pgmap v10332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19200.433425 secs 2024-04-21T15:44:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:50 smithi191 ceph-mon[31636]: pgmap v10332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:52 smithi170 ceph-mon[31212]: pgmap v10333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19203.671252 secs 2024-04-21T15:44:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:52 smithi077 ceph-mon[27902]: pgmap v10333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19203.671252 secs 2024-04-21T15:44:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:52 smithi191 ceph-mon[31636]: pgmap v10333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19203.671252 secs 2024-04-21T15:44:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19205.433557 secs 2024-04-21T15:44:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:54 smithi170 ceph-mon[31212]: pgmap v10334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:44:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19205.433557 secs 2024-04-21T15:44:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:54 smithi077 ceph-mon[27902]: pgmap v10334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19205.433557 secs 2024-04-21T15:44:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:54 smithi191 ceph-mon[31636]: pgmap v10334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:56 smithi170 ceph-mon[31212]: pgmap v10335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:56 smithi077 ceph-mon[27902]: pgmap v10335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:56 smithi191 ceph-mon[31636]: pgmap v10335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:44:58.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19208.671376 secs 2024-04-21T15:44:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19208.671376 secs 2024-04-21T15:44:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19208.671376 secs 2024-04-21T15:44:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:58 smithi170 ceph-mon[31212]: pgmap v10336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:58 smithi077 ceph-mon[27902]: pgmap v10336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:44:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:58 smithi191 ceph-mon[31636]: pgmap v10336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19210.433701 secs 2024-04-21T15:45:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19210.433701 secs 2024-04-21T15:45:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19210.433701 secs 2024-04-21T15:45:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:00 smithi170 ceph-mon[31212]: pgmap v10337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:00 smithi077 ceph-mon[27902]: pgmap v10337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:00 smithi191 ceph-mon[31636]: pgmap v10337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:02 smithi170 ceph-mon[31212]: pgmap v10338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T15:45:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19213.671473 secs 2024-04-21T15:45:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:02 smithi077 ceph-mon[27902]: pgmap v10338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T15:45:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19213.671473 secs 2024-04-21T15:45:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:02 smithi191 ceph-mon[31636]: pgmap v10338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T15:45:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19213.671473 secs 2024-04-21T15:45:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19215.433832 secs 2024-04-21T15:45:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:04 smithi077 ceph-mon[27902]: pgmap v10339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T15:45:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:04 smithi077 ceph-mon[27902]: osdmap e718: 12 total, 12 up, 12 in 2024-04-21T15:45:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19215.433832 secs 2024-04-21T15:45:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:04 smithi191 ceph-mon[31636]: pgmap v10339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T15:45:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:04 smithi191 ceph-mon[31636]: osdmap e718: 12 total, 12 up, 12 in 2024-04-21T15:45:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19215.433832 secs 2024-04-21T15:45:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:04 smithi170 ceph-mon[31212]: pgmap v10339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T15:45:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:04 smithi170 ceph-mon[31212]: osdmap e718: 12 total, 12 up, 12 in 2024-04-21T15:45:07.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:06 smithi077 ceph-mon[27902]: pgmap v10341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:07.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:06 smithi191 ceph-mon[31636]: pgmap v10341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:06 smithi170 ceph-mon[31212]: pgmap v10341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:08.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19218.671594 secs 2024-04-21T15:45:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19218.671594 secs 2024-04-21T15:45:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19218.671594 secs 2024-04-21T15:45:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:08 smithi077 ceph-mon[27902]: pgmap v10342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:08 smithi191 ceph-mon[31636]: pgmap v10342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:08 smithi170 ceph-mon[31212]: pgmap v10342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:10.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19220.433949 secs 2024-04-21T15:45:10.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19220.433949 secs 2024-04-21T15:45:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19220.433949 secs 2024-04-21T15:45:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:10 smithi077 ceph-mon[27902]: pgmap v10343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:10 smithi077 ceph-mon[27902]: osdmap e719: 12 total, 12 up, 12 in 2024-04-21T15:45:11.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:10 smithi191 ceph-mon[31636]: pgmap v10343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:10 smithi191 ceph-mon[31636]: osdmap e719: 12 total, 12 up, 12 in 2024-04-21T15:45:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:10 smithi170 ceph-mon[31212]: pgmap v10343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:45:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:10 smithi170 ceph-mon[31212]: osdmap e719: 12 total, 12 up, 12 in 2024-04-21T15:45:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:12 smithi077 ceph-mon[27902]: pgmap v10345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T15:45:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19223.671720 secs 2024-04-21T15:45:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:12 smithi191 ceph-mon[31636]: pgmap v10345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T15:45:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19223.671720 secs 2024-04-21T15:45:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:12 smithi170 ceph-mon[31212]: pgmap v10345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T15:45:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19223.671720 secs 2024-04-21T15:45:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19225.434052 secs 2024-04-21T15:45:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:14 smithi077 ceph-mon[27902]: pgmap v10346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T15:45:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19225.434052 secs 2024-04-21T15:45:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:14 smithi191 ceph-mon[31636]: pgmap v10346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T15:45:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19225.434052 secs 2024-04-21T15:45:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:14 smithi170 ceph-mon[31212]: pgmap v10346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T15:45:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:16 smithi077 ceph-mon[27902]: pgmap v10347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:16 smithi191 ceph-mon[31636]: pgmap v10347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:16 smithi170 ceph-mon[31212]: pgmap v10347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:18.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19228.671848 secs 2024-04-21T15:45:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19228.671848 secs 2024-04-21T15:45:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19228.671848 secs 2024-04-21T15:45:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:18 smithi077 ceph-mon[27902]: pgmap v10348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:18 smithi191 ceph-mon[31636]: pgmap v10348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:18 smithi170 ceph-mon[31212]: pgmap v10348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19230.434145 secs 2024-04-21T15:45:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19230.434145 secs 2024-04-21T15:45:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19230.434145 secs 2024-04-21T15:45:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:20 smithi077 ceph-mon[27902]: pgmap v10349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:20 smithi191 ceph-mon[31636]: pgmap v10349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:20 smithi170 ceph-mon[31212]: pgmap v10349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:45:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:22 smithi077 ceph-mon[27902]: pgmap v10350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:45:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19233.671972 secs 2024-04-21T15:45:23.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:22 smithi191 ceph-mon[31636]: pgmap v10350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:45:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19233.671972 secs 2024-04-21T15:45:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:22 smithi170 ceph-mon[31212]: pgmap v10350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:45:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19233.671972 secs 2024-04-21T15:45:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19235.434264 secs 2024-04-21T15:45:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:24 smithi077 ceph-mon[27902]: pgmap v10351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19235.434264 secs 2024-04-21T15:45:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:24 smithi191 ceph-mon[31636]: pgmap v10351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:25.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19235.434264 secs 2024-04-21T15:45:25.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:24 smithi170 ceph-mon[31212]: pgmap v10351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:26 smithi077 ceph-mon[27902]: pgmap v10352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:45:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:45:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:45:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:45:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:26 smithi191 ceph-mon[31636]: pgmap v10352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:45:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:45:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:45:27.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:45:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:26 smithi170 ceph-mon[31212]: pgmap v10352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:45:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:45:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:45:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:45:28.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19238.672073 secs 2024-04-21T15:45:28.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19238.672073 secs 2024-04-21T15:45:28.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19238.672073 secs 2024-04-21T15:45:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:28 smithi077 ceph-mon[27902]: pgmap v10353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:28 smithi191 ceph-mon[31636]: pgmap v10353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:28 smithi170 ceph-mon[31212]: pgmap v10353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:30.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19240.434360 secs 2024-04-21T15:45:30.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19240.434360 secs 2024-04-21T15:45:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19240.434360 secs 2024-04-21T15:45:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:30 smithi077 ceph-mon[27902]: pgmap v10354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:31.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:30 smithi191 ceph-mon[31636]: pgmap v10354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:30 smithi170 ceph-mon[31212]: pgmap v10354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:32 smithi077 ceph-mon[27902]: pgmap v10355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19243.672196 secs 2024-04-21T15:45:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:32 smithi191 ceph-mon[31636]: pgmap v10355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19243.672196 secs 2024-04-21T15:45:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:32 smithi170 ceph-mon[31212]: pgmap v10355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19243.672196 secs 2024-04-21T15:45:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:35.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19245.434512 secs 2024-04-21T15:45:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:34 smithi191 ceph-mon[31636]: pgmap v10356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19245.434512 secs 2024-04-21T15:45:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:34 smithi170 ceph-mon[31212]: pgmap v10356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19245.434512 secs 2024-04-21T15:45:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:34 smithi077 ceph-mon[27902]: pgmap v10356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:37.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:36 smithi191 ceph-mon[31636]: pgmap v10357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:36 smithi170 ceph-mon[31212]: pgmap v10357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:36 smithi077 ceph-mon[27902]: pgmap v10357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19248.672321 secs 2024-04-21T15:45:38.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19248.672321 secs 2024-04-21T15:45:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19248.672321 secs 2024-04-21T15:45:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:38 smithi191 ceph-mon[31636]: pgmap v10358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:38 smithi170 ceph-mon[31212]: pgmap v10358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:38 smithi077 ceph-mon[27902]: pgmap v10358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19250.434651 secs 2024-04-21T15:45:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19250.434651 secs 2024-04-21T15:45:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19250.434651 secs 2024-04-21T15:45:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:40 smithi191 ceph-mon[31636]: pgmap v10359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:40 smithi170 ceph-mon[31212]: pgmap v10359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:40 smithi077 ceph-mon[27902]: pgmap v10359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:42 smithi191 ceph-mon[31636]: pgmap v10360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19253.672444 secs 2024-04-21T15:45:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:42 smithi170 ceph-mon[31212]: pgmap v10360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19253.672444 secs 2024-04-21T15:45:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:42 smithi077 ceph-mon[27902]: pgmap v10360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19253.672444 secs 2024-04-21T15:45:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19255.434726 secs 2024-04-21T15:45:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:44 smithi191 ceph-mon[31636]: pgmap v10361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19255.434726 secs 2024-04-21T15:45:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:44 smithi170 ceph-mon[31212]: pgmap v10361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19255.434726 secs 2024-04-21T15:45:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:44 smithi077 ceph-mon[27902]: pgmap v10361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:46 smithi191 ceph-mon[31636]: pgmap v10362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:46 smithi170 ceph-mon[31212]: pgmap v10362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:46 smithi077 ceph-mon[27902]: pgmap v10362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19258.672564 secs 2024-04-21T15:45:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19258.672564 secs 2024-04-21T15:45:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19258.672564 secs 2024-04-21T15:45:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:48 smithi191 ceph-mon[31636]: pgmap v10363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:48 smithi170 ceph-mon[31212]: pgmap v10363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:48 smithi077 ceph-mon[27902]: pgmap v10363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19260.435137 secs 2024-04-21T15:45:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19260.435137 secs 2024-04-21T15:45:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19260.435137 secs 2024-04-21T15:45:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:50 smithi191 ceph-mon[31636]: pgmap v10364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:50 smithi170 ceph-mon[31212]: pgmap v10364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:50 smithi077 ceph-mon[27902]: pgmap v10364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:52 smithi191 ceph-mon[31636]: pgmap v10365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19263.672639 secs 2024-04-21T15:45:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:52 smithi170 ceph-mon[31212]: pgmap v10365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19263.672639 secs 2024-04-21T15:45:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:52 smithi077 ceph-mon[27902]: pgmap v10365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19263.672639 secs 2024-04-21T15:45:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:45:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19265.435196 secs 2024-04-21T15:45:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:54 smithi191 ceph-mon[31636]: pgmap v10366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19265.435196 secs 2024-04-21T15:45:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:54 smithi170 ceph-mon[31212]: pgmap v10366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19265.435196 secs 2024-04-21T15:45:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:54 smithi077 ceph-mon[27902]: pgmap v10366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:57.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:56 smithi191 ceph-mon[31636]: pgmap v10367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:56 smithi170 ceph-mon[31212]: pgmap v10367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:56 smithi077 ceph-mon[27902]: pgmap v10367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:45:58.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19268.672773 secs 2024-04-21T15:45:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19268.672773 secs 2024-04-21T15:45:58.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19268.672773 secs 2024-04-21T15:45:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:58 smithi191 ceph-mon[31636]: pgmap v10368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:58 smithi170 ceph-mon[31212]: pgmap v10368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:45:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:58 smithi077 ceph-mon[27902]: pgmap v10368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19270.435257 secs 2024-04-21T15:46:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19270.435257 secs 2024-04-21T15:46:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19270.435257 secs 2024-04-21T15:46:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:00 smithi191 ceph-mon[31636]: pgmap v10369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:00 smithi170 ceph-mon[31212]: pgmap v10369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:00 smithi077 ceph-mon[27902]: pgmap v10369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:03.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:02 smithi191 ceph-mon[31636]: pgmap v10370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:46:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19273.672898 secs 2024-04-21T15:46:03.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:02 smithi170 ceph-mon[31212]: pgmap v10370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:46:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19273.672898 secs 2024-04-21T15:46:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:02 smithi077 ceph-mon[27902]: pgmap v10370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T15:46:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19273.672898 secs 2024-04-21T15:46:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19275.435321 secs 2024-04-21T15:46:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:04 smithi191 ceph-mon[31636]: pgmap v10371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:46:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:04 smithi191 ceph-mon[31636]: osdmap e720: 12 total, 12 up, 12 in 2024-04-21T15:46:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19275.435321 secs 2024-04-21T15:46:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:04 smithi170 ceph-mon[31212]: pgmap v10371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:46:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:04 smithi170 ceph-mon[31212]: osdmap e720: 12 total, 12 up, 12 in 2024-04-21T15:46:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19275.435321 secs 2024-04-21T15:46:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:04 smithi077 ceph-mon[27902]: pgmap v10371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T15:46:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:04 smithi077 ceph-mon[27902]: osdmap e720: 12 total, 12 up, 12 in 2024-04-21T15:46:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:06 smithi170 ceph-mon[31212]: pgmap v10373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:07.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:06 smithi077 ceph-mon[27902]: pgmap v10373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:06 smithi191 ceph-mon[31636]: pgmap v10373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:08.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19278.673011 secs 2024-04-21T15:46:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19278.673011 secs 2024-04-21T15:46:08.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19278.673011 secs 2024-04-21T15:46:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:08 smithi170 ceph-mon[31212]: pgmap v10374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:08 smithi077 ceph-mon[27902]: pgmap v10374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:08 smithi191 ceph-mon[31636]: pgmap v10374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19280.435385 secs 2024-04-21T15:46:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19280.435385 secs 2024-04-21T15:46:10.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19280.435385 secs 2024-04-21T15:46:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:10 smithi170 ceph-mon[31212]: pgmap v10375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:10 smithi170 ceph-mon[31212]: osdmap e721: 12 total, 12 up, 12 in 2024-04-21T15:46:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:10 smithi077 ceph-mon[27902]: pgmap v10375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:10 smithi077 ceph-mon[27902]: osdmap e721: 12 total, 12 up, 12 in 2024-04-21T15:46:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:10 smithi191 ceph-mon[31636]: pgmap v10375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:46:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:10 smithi191 ceph-mon[31636]: osdmap e721: 12 total, 12 up, 12 in 2024-04-21T15:46:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:12 smithi170 ceph-mon[31212]: pgmap v10377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:46:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19283.673127 secs 2024-04-21T15:46:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:12 smithi077 ceph-mon[27902]: pgmap v10377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:46:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19283.673127 secs 2024-04-21T15:46:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:12 smithi191 ceph-mon[31636]: pgmap v10377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:46:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19283.673127 secs 2024-04-21T15:46:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19285.435517 secs 2024-04-21T15:46:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:14 smithi170 ceph-mon[31212]: pgmap v10378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:46:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19285.435517 secs 2024-04-21T15:46:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:14 smithi077 ceph-mon[27902]: pgmap v10378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:46:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19285.435517 secs 2024-04-21T15:46:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:14 smithi191 ceph-mon[31636]: pgmap v10378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:46:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:16 smithi170 ceph-mon[31212]: pgmap v10379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:16 smithi077 ceph-mon[27902]: pgmap v10379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:16 smithi191 ceph-mon[31636]: pgmap v10379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19288.673276 secs 2024-04-21T15:46:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19288.673276 secs 2024-04-21T15:46:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19288.673276 secs 2024-04-21T15:46:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:19 smithi170 ceph-mon[31212]: pgmap v10380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:19 smithi077 ceph-mon[27902]: pgmap v10380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:19 smithi191 ceph-mon[31636]: pgmap v10380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19290.435666 secs 2024-04-21T15:46:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19290.435666 secs 2024-04-21T15:46:20.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19290.435666 secs 2024-04-21T15:46:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:21 smithi170 ceph-mon[31212]: pgmap v10381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:21 smithi077 ceph-mon[27902]: pgmap v10381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:21 smithi191 ceph-mon[31636]: pgmap v10381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:46:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:23 smithi170 ceph-mon[31212]: pgmap v10382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:46:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19293.673398 secs 2024-04-21T15:46:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:23 smithi077 ceph-mon[27902]: pgmap v10382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:46:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19293.673398 secs 2024-04-21T15:46:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:23 smithi191 ceph-mon[31636]: pgmap v10382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:46:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19293.673398 secs 2024-04-21T15:46:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19295.435790 secs 2024-04-21T15:46:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:25 smithi170 ceph-mon[31212]: pgmap v10383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19295.435790 secs 2024-04-21T15:46:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:25 smithi077 ceph-mon[27902]: pgmap v10383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19295.435790 secs 2024-04-21T15:46:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:25 smithi191 ceph-mon[31636]: pgmap v10383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:27.275 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:27 smithi191 ceph-mon[31636]: pgmap v10384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:27.275 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:46:27.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:27 smithi170 ceph-mon[31212]: pgmap v10384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:46:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:27 smithi077 ceph-mon[27902]: pgmap v10384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:46:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19298.673470 secs 2024-04-21T15:46:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:46:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:46:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:46:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19298.673470 secs 2024-04-21T15:46:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:46:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:46:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:46:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19298.673470 secs 2024-04-21T15:46:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:46:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:46:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:46:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:29 smithi170 ceph-mon[31212]: pgmap v10385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:29 smithi077 ceph-mon[27902]: pgmap v10385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:29 smithi191 ceph-mon[31636]: pgmap v10385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19300.435916 secs 2024-04-21T15:46:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19300.435916 secs 2024-04-21T15:46:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19300.435916 secs 2024-04-21T15:46:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:31 smithi170 ceph-mon[31212]: pgmap v10386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:31 smithi077 ceph-mon[27902]: pgmap v10386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:31 smithi191 ceph-mon[31636]: pgmap v10386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:33 smithi170 ceph-mon[31212]: pgmap v10387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19303.673612 secs 2024-04-21T15:46:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:33 smithi077 ceph-mon[27902]: pgmap v10387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19303.673612 secs 2024-04-21T15:46:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:33 smithi191 ceph-mon[31636]: pgmap v10387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19303.673612 secs 2024-04-21T15:46:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19305.435994 secs 2024-04-21T15:46:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:35 smithi170 ceph-mon[31212]: pgmap v10388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19305.435994 secs 2024-04-21T15:46:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:35 smithi077 ceph-mon[27902]: pgmap v10388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19305.435994 secs 2024-04-21T15:46:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:35 smithi191 ceph-mon[31636]: pgmap v10388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:37 smithi170 ceph-mon[31212]: pgmap v10389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:37 smithi077 ceph-mon[27902]: pgmap v10389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:37 smithi191 ceph-mon[31636]: pgmap v10389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:38.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19308.673741 secs 2024-04-21T15:46:38.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19308.673741 secs 2024-04-21T15:46:38.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19308.673741 secs 2024-04-21T15:46:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:39 smithi170 ceph-mon[31212]: pgmap v10390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:39 smithi077 ceph-mon[27902]: pgmap v10390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:39 smithi191 ceph-mon[31636]: pgmap v10390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19310.436118 secs 2024-04-21T15:46:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19310.436118 secs 2024-04-21T15:46:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19310.436118 secs 2024-04-21T15:46:41.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:41 smithi170 ceph-mon[31212]: pgmap v10391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:41 smithi077 ceph-mon[27902]: pgmap v10391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:41 smithi191 ceph-mon[31636]: pgmap v10391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:42.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:42 smithi077 ceph-mon[27902]: pgmap v10392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:42.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:42 smithi191 ceph-mon[31636]: pgmap v10392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:42.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:42 smithi170 ceph-mon[31212]: pgmap v10392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19313.673856 secs 2024-04-21T15:46:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19313.673856 secs 2024-04-21T15:46:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19313.673856 secs 2024-04-21T15:46:44.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19315.436213 secs 2024-04-21T15:46:44.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:44 smithi077 ceph-mon[27902]: pgmap v10393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:44.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19315.436213 secs 2024-04-21T15:46:44.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:44 smithi191 ceph-mon[31636]: pgmap v10393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:44.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19315.436213 secs 2024-04-21T15:46:44.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:44 smithi170 ceph-mon[31212]: pgmap v10393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:46 smithi077 ceph-mon[27902]: pgmap v10394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:46 smithi191 ceph-mon[31636]: pgmap v10394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:46 smithi170 ceph-mon[31212]: pgmap v10394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19318.673992 secs 2024-04-21T15:46:48.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19318.673992 secs 2024-04-21T15:46:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19318.673992 secs 2024-04-21T15:46:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:48 smithi077 ceph-mon[27902]: pgmap v10395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:48 smithi191 ceph-mon[31636]: pgmap v10395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:48 smithi170 ceph-mon[31212]: pgmap v10395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19320.436330 secs 2024-04-21T15:46:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19320.436330 secs 2024-04-21T15:46:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19320.436330 secs 2024-04-21T15:46:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:50 smithi077 ceph-mon[27902]: pgmap v10396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:50 smithi191 ceph-mon[31636]: pgmap v10396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:50 smithi170 ceph-mon[31212]: pgmap v10396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:52 smithi077 ceph-mon[27902]: pgmap v10397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19323.674101 secs 2024-04-21T15:46:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:52 smithi191 ceph-mon[31636]: pgmap v10397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19323.674101 secs 2024-04-21T15:46:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:52 smithi170 ceph-mon[31212]: pgmap v10397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19323.674101 secs 2024-04-21T15:46:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:46:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19325.436461 secs 2024-04-21T15:46:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:54 smithi077 ceph-mon[27902]: pgmap v10398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:55.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19325.436461 secs 2024-04-21T15:46:55.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:54 smithi191 ceph-mon[31636]: pgmap v10398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19325.436461 secs 2024-04-21T15:46:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:54 smithi170 ceph-mon[31212]: pgmap v10398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:46:57.025+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:46:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:46:57.025+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:46:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:46:57.025+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:46:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:46:57.025+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:46:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:56 smithi077 ceph-mon[27902]: pgmap v10399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:56 smithi191 ceph-mon[31636]: pgmap v10399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:56 smithi170 ceph-mon[31212]: pgmap v10399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:46:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19328.674252 secs 2024-04-21T15:46:58.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19328.674252 secs 2024-04-21T15:46:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19328.674252 secs 2024-04-21T15:46:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:58 smithi077 ceph-mon[27902]: pgmap v10400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:58 smithi191 ceph-mon[31636]: pgmap v10400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:46:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:58 smithi170 ceph-mon[31212]: pgmap v10400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19330.436584 secs 2024-04-21T15:47:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19330.436584 secs 2024-04-21T15:47:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19330.436584 secs 2024-04-21T15:47:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:00 smithi077 ceph-mon[27902]: pgmap v10401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:00 smithi191 ceph-mon[31636]: pgmap v10401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:00 smithi170 ceph-mon[31212]: pgmap v10401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:02 smithi077 ceph-mon[27902]: pgmap v10402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19333.674390 secs 2024-04-21T15:47:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:02 smithi191 ceph-mon[31636]: pgmap v10402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19333.674390 secs 2024-04-21T15:47:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:02 smithi170 ceph-mon[31212]: pgmap v10402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19333.674390 secs 2024-04-21T15:47:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19335.436722 secs 2024-04-21T15:47:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:04 smithi077 ceph-mon[27902]: pgmap v10403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:04 smithi077 ceph-mon[27902]: osdmap e722: 12 total, 12 up, 12 in 2024-04-21T15:47:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19335.436722 secs 2024-04-21T15:47:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:04 smithi191 ceph-mon[31636]: pgmap v10403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:04 smithi191 ceph-mon[31636]: osdmap e722: 12 total, 12 up, 12 in 2024-04-21T15:47:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19335.436722 secs 2024-04-21T15:47:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:04 smithi170 ceph-mon[31212]: pgmap v10403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:04 smithi170 ceph-mon[31212]: osdmap e722: 12 total, 12 up, 12 in 2024-04-21T15:47:07.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:06 smithi077 ceph-mon[27902]: pgmap v10405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:07.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:06 smithi191 ceph-mon[31636]: pgmap v10405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:06 smithi170 ceph-mon[31212]: pgmap v10405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:08.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19338.674485 secs 2024-04-21T15:47:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19338.674485 secs 2024-04-21T15:47:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19338.674485 secs 2024-04-21T15:47:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:08 smithi077 ceph-mon[27902]: pgmap v10406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:08 smithi191 ceph-mon[31636]: pgmap v10406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:08 smithi170 ceph-mon[31212]: pgmap v10406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:10.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19340.436888 secs 2024-04-21T15:47:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19340.436888 secs 2024-04-21T15:47:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19340.436888 secs 2024-04-21T15:47:11.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:10 smithi191 ceph-mon[31636]: pgmap v10407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:10 smithi191 ceph-mon[31636]: osdmap e723: 12 total, 12 up, 12 in 2024-04-21T15:47:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:10 smithi170 ceph-mon[31212]: pgmap v10407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:10 smithi170 ceph-mon[31212]: osdmap e723: 12 total, 12 up, 12 in 2024-04-21T15:47:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:10 smithi077 ceph-mon[27902]: pgmap v10407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:47:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:10 smithi077 ceph-mon[27902]: osdmap e723: 12 total, 12 up, 12 in 2024-04-21T15:47:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:12 smithi191 ceph-mon[31636]: pgmap v10409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:47:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19343.674548 secs 2024-04-21T15:47:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:12 smithi170 ceph-mon[31212]: pgmap v10409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:47:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19343.674548 secs 2024-04-21T15:47:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:12 smithi077 ceph-mon[27902]: pgmap v10409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:47:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19343.674548 secs 2024-04-21T15:47:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:15.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19345.437006 secs 2024-04-21T15:47:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:14 smithi191 ceph-mon[31636]: pgmap v10410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:47:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19345.437006 secs 2024-04-21T15:47:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:14 smithi170 ceph-mon[31212]: pgmap v10410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:47:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19345.437006 secs 2024-04-21T15:47:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:14 smithi077 ceph-mon[27902]: pgmap v10410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:47:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:16 smithi191 ceph-mon[31636]: pgmap v10411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:17.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:16 smithi170 ceph-mon[31212]: pgmap v10411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:16 smithi077 ceph-mon[27902]: pgmap v10411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19348.674666 secs 2024-04-21T15:47:18.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19348.674666 secs 2024-04-21T15:47:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19348.674666 secs 2024-04-21T15:47:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:18 smithi191 ceph-mon[31636]: pgmap v10412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:19.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:18 smithi170 ceph-mon[31212]: pgmap v10412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:18 smithi077 ceph-mon[27902]: pgmap v10412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19350.437147 secs 2024-04-21T15:47:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19350.437147 secs 2024-04-21T15:47:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19350.437147 secs 2024-04-21T15:47:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:20 smithi191 ceph-mon[31636]: pgmap v10413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:20 smithi170 ceph-mon[31212]: pgmap v10413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:20 smithi077 ceph-mon[27902]: pgmap v10413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:47:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:22 smithi191 ceph-mon[31636]: pgmap v10414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:47:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19353.674785 secs 2024-04-21T15:47:23.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:22 smithi170 ceph-mon[31212]: pgmap v10414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:47:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19353.674785 secs 2024-04-21T15:47:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:22 smithi077 ceph-mon[27902]: pgmap v10414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:47:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19353.674785 secs 2024-04-21T15:47:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19355.437260 secs 2024-04-21T15:47:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:24 smithi191 ceph-mon[31636]: pgmap v10415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19355.437260 secs 2024-04-21T15:47:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:24 smithi170 ceph-mon[31212]: pgmap v10415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19355.437260 secs 2024-04-21T15:47:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:24 smithi077 ceph-mon[27902]: pgmap v10415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:26 smithi191 ceph-mon[31636]: pgmap v10416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:26 smithi170 ceph-mon[31212]: pgmap v10416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:26 smithi077 ceph-mon[27902]: pgmap v10416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:28.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19358.674904 secs 2024-04-21T15:47:28.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:47:28.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19358.674904 secs 2024-04-21T15:47:28.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:47:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19358.674904 secs 2024-04-21T15:47:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:47:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:28 smithi191 ceph-mon[31636]: pgmap v10417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:47:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:47:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:47:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:28 smithi170 ceph-mon[31212]: pgmap v10417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:47:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:47:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:47:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:28 smithi077 ceph-mon[27902]: pgmap v10417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:47:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:47:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:47:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:30.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19360.437361 secs 2024-04-21T15:47:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19360.437361 secs 2024-04-21T15:47:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19360.437361 secs 2024-04-21T15:47:31.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:30 smithi191 ceph-mon[31636]: pgmap v10418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:30 smithi170 ceph-mon[31212]: pgmap v10418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:30 smithi077 ceph-mon[27902]: pgmap v10418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:32 smithi191 ceph-mon[31636]: pgmap v10419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19363.675025 secs 2024-04-21T15:47:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:32 smithi170 ceph-mon[31212]: pgmap v10419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19363.675025 secs 2024-04-21T15:47:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:32 smithi077 ceph-mon[27902]: pgmap v10419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19363.675025 secs 2024-04-21T15:47:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:35.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19365.437458 secs 2024-04-21T15:47:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:34 smithi191 ceph-mon[31636]: pgmap v10420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19365.437458 secs 2024-04-21T15:47:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:34 smithi170 ceph-mon[31212]: pgmap v10420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19365.437458 secs 2024-04-21T15:47:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:34 smithi077 ceph-mon[27902]: pgmap v10420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:37.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:36 smithi191 ceph-mon[31636]: pgmap v10421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:37.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:36 smithi170 ceph-mon[31212]: pgmap v10421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:36 smithi077 ceph-mon[27902]: pgmap v10421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19368.675154 secs 2024-04-21T15:47:38.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19368.675154 secs 2024-04-21T15:47:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19368.675154 secs 2024-04-21T15:47:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:38 smithi191 ceph-mon[31636]: pgmap v10422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:38 smithi170 ceph-mon[31212]: pgmap v10422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:38 smithi077 ceph-mon[27902]: pgmap v10422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19370.437531 secs 2024-04-21T15:47:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19370.437531 secs 2024-04-21T15:47:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19370.437531 secs 2024-04-21T15:47:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:40 smithi191 ceph-mon[31636]: pgmap v10423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:41.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:40 smithi170 ceph-mon[31212]: pgmap v10423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:40 smithi077 ceph-mon[27902]: pgmap v10423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:42 smithi191 ceph-mon[31636]: pgmap v10424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19373.675255 secs 2024-04-21T15:47:43.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:42 smithi170 ceph-mon[31212]: pgmap v10424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19373.675255 secs 2024-04-21T15:47:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:42 smithi077 ceph-mon[27902]: pgmap v10424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19373.675255 secs 2024-04-21T15:47:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19375.437649 secs 2024-04-21T15:47:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:44 smithi191 ceph-mon[31636]: pgmap v10425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19375.437649 secs 2024-04-21T15:47:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:44 smithi170 ceph-mon[31212]: pgmap v10425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19375.437649 secs 2024-04-21T15:47:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:44 smithi077 ceph-mon[27902]: pgmap v10425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:46 smithi191 ceph-mon[31636]: pgmap v10426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:46 smithi170 ceph-mon[31212]: pgmap v10426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:46 smithi077 ceph-mon[27902]: pgmap v10426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19378.675342 secs 2024-04-21T15:47:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19378.675342 secs 2024-04-21T15:47:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19378.675342 secs 2024-04-21T15:47:49.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:48 smithi170 ceph-mon[31212]: pgmap v10427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:48 smithi077 ceph-mon[27902]: pgmap v10427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:49.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:48 smithi191 ceph-mon[31636]: pgmap v10427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:50.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19380.437738 secs 2024-04-21T15:47:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19380.437738 secs 2024-04-21T15:47:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19380.437738 secs 2024-04-21T15:47:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:50 smithi170 ceph-mon[31212]: pgmap v10428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:50 smithi077 ceph-mon[27902]: pgmap v10428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:50 smithi191 ceph-mon[31636]: pgmap v10428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:47:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:52 smithi170 ceph-mon[31212]: pgmap v10429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19383.675460 secs 2024-04-21T15:47:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:52 smithi077 ceph-mon[27902]: pgmap v10429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19383.675460 secs 2024-04-21T15:47:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:52 smithi191 ceph-mon[31636]: pgmap v10429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19383.675460 secs 2024-04-21T15:47:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:47:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19385.437876 secs 2024-04-21T15:47:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:54 smithi170 ceph-mon[31212]: pgmap v10430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19385.437876 secs 2024-04-21T15:47:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:54 smithi077 ceph-mon[27902]: pgmap v10430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19385.437876 secs 2024-04-21T15:47:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:54 smithi191 ceph-mon[31636]: pgmap v10430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:57.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:56 smithi191 ceph-mon[31636]: pgmap v10431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:56 smithi170 ceph-mon[31212]: pgmap v10431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:56 smithi077 ceph-mon[27902]: pgmap v10431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:47:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19388.675594 secs 2024-04-21T15:47:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19388.675594 secs 2024-04-21T15:47:58.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19388.675594 secs 2024-04-21T15:47:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:47:58 smithi170 ceph-mon[31212]: pgmap v10432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:47:58 smithi077 ceph-mon[27902]: pgmap v10432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:47:59.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:47:58 smithi191 ceph-mon[31636]: pgmap v10432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19390.438007 secs 2024-04-21T15:48:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19390.438007 secs 2024-04-21T15:48:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19390.438007 secs 2024-04-21T15:48:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:01 smithi170 ceph-mon[31212]: pgmap v10433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:01 smithi077 ceph-mon[27902]: pgmap v10433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:01.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:01 smithi191 ceph-mon[31636]: pgmap v10433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:03 smithi170 ceph-mon[31212]: pgmap v10434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19393.675689 secs 2024-04-21T15:48:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:03 smithi077 ceph-mon[27902]: pgmap v10434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19393.675689 secs 2024-04-21T15:48:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:03 smithi191 ceph-mon[31636]: pgmap v10434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19393.675689 secs 2024-04-21T15:48:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19395.438129 secs 2024-04-21T15:48:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:05 smithi170 ceph-mon[31212]: pgmap v10435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:05 smithi170 ceph-mon[31212]: osdmap e724: 12 total, 12 up, 12 in 2024-04-21T15:48:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19395.438129 secs 2024-04-21T15:48:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:05 smithi077 ceph-mon[27902]: pgmap v10435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:05 smithi077 ceph-mon[27902]: osdmap e724: 12 total, 12 up, 12 in 2024-04-21T15:48:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19395.438129 secs 2024-04-21T15:48:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:05 smithi191 ceph-mon[31636]: pgmap v10435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:05 smithi191 ceph-mon[31636]: osdmap e724: 12 total, 12 up, 12 in 2024-04-21T15:48:07.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:07 smithi170 ceph-mon[31212]: pgmap v10437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:07 smithi077 ceph-mon[27902]: pgmap v10437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:07 smithi191 ceph-mon[31636]: pgmap v10437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:08.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19398.675831 secs 2024-04-21T15:48:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19398.675831 secs 2024-04-21T15:48:08.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19398.675831 secs 2024-04-21T15:48:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:09 smithi170 ceph-mon[31212]: pgmap v10438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:09 smithi077 ceph-mon[27902]: pgmap v10438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:09 smithi191 ceph-mon[31636]: pgmap v10438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19400.438248 secs 2024-04-21T15:48:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19400.438248 secs 2024-04-21T15:48:10.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19400.438248 secs 2024-04-21T15:48:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:11 smithi170 ceph-mon[31212]: pgmap v10439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:11 smithi170 ceph-mon[31212]: osdmap e725: 12 total, 12 up, 12 in 2024-04-21T15:48:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:11 smithi077 ceph-mon[27902]: pgmap v10439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:11 smithi077 ceph-mon[27902]: osdmap e725: 12 total, 12 up, 12 in 2024-04-21T15:48:11.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:11 smithi191 ceph-mon[31636]: pgmap v10439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:48:11.511 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:11 smithi191 ceph-mon[31636]: osdmap e725: 12 total, 12 up, 12 in 2024-04-21T15:48:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:13 smithi170 ceph-mon[31212]: pgmap v10441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:48:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19403.675915 secs 2024-04-21T15:48:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:13 smithi077 ceph-mon[27902]: pgmap v10441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:48:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19403.675915 secs 2024-04-21T15:48:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:13 smithi191 ceph-mon[31636]: pgmap v10441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:48:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19403.675915 secs 2024-04-21T15:48:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19405.438407 secs 2024-04-21T15:48:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:15 smithi170 ceph-mon[31212]: pgmap v10442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:48:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19405.438407 secs 2024-04-21T15:48:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:15 smithi077 ceph-mon[27902]: pgmap v10442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:48:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19405.438407 secs 2024-04-21T15:48:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:15 smithi191 ceph-mon[31636]: pgmap v10442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:48:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:17 smithi170 ceph-mon[31212]: pgmap v10443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:17 smithi077 ceph-mon[27902]: pgmap v10443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:17 smithi191 ceph-mon[31636]: pgmap v10443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19408.676007 secs 2024-04-21T15:48:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19408.676007 secs 2024-04-21T15:48:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19408.676007 secs 2024-04-21T15:48:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:19 smithi170 ceph-mon[31212]: pgmap v10444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:19 smithi077 ceph-mon[27902]: pgmap v10444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:19 smithi191 ceph-mon[31636]: pgmap v10444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:20.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19410.438552 secs 2024-04-21T15:48:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19410.438552 secs 2024-04-21T15:48:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19410.438552 secs 2024-04-21T15:48:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:21 smithi077 ceph-mon[27902]: pgmap v10445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:21 smithi191 ceph-mon[31636]: pgmap v10445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:21 smithi170 ceph-mon[31212]: pgmap v10445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:48:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:23 smithi077 ceph-mon[27902]: pgmap v10446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:48:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19413.676117 secs 2024-04-21T15:48:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:23 smithi191 ceph-mon[31636]: pgmap v10446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:48:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19413.676117 secs 2024-04-21T15:48:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:23 smithi170 ceph-mon[31212]: pgmap v10446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:48:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19413.676117 secs 2024-04-21T15:48:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19415.438693 secs 2024-04-21T15:48:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:25 smithi077 ceph-mon[27902]: pgmap v10447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19415.438693 secs 2024-04-21T15:48:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:25 smithi191 ceph-mon[31636]: pgmap v10447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19415.438693 secs 2024-04-21T15:48:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:25 smithi170 ceph-mon[31212]: pgmap v10447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:27 smithi077 ceph-mon[27902]: pgmap v10448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:27.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:27 smithi191 ceph-mon[31636]: pgmap v10448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:27 smithi170 ceph-mon[31212]: pgmap v10448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19418.676212 secs 2024-04-21T15:48:28.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19418.676212 secs 2024-04-21T15:48:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19418.676212 secs 2024-04-21T15:48:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:29 smithi077 ceph-mon[27902]: pgmap v10449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:48:29.390 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:29 smithi170 ceph-mon[31212]: pgmap v10449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:29.390 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:48:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:29 smithi191 ceph-mon[31636]: pgmap v10449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:48:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19420.438792 secs 2024-04-21T15:48:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19420.438792 secs 2024-04-21T15:48:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19420.438792 secs 2024-04-21T15:48:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: pgmap v10450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:48:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:48:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:48:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:48:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:48:31.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:48:31.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:48:31.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:48:31.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: pgmap v10450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:48:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:48:31.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:48:31.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:48:31.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:48:31.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: pgmap v10450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:48:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:48:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:48:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:48:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:48:31.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:48:31.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:48:32.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:32 smithi077 ceph-mon[27902]: pgmap v10451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:32.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:32 smithi191 ceph-mon[31636]: pgmap v10451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:32.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:32 smithi170 ceph-mon[31212]: pgmap v10451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19423.676309 secs 2024-04-21T15:48:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19423.676309 secs 2024-04-21T15:48:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19423.676309 secs 2024-04-21T15:48:34.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19425.438907 secs 2024-04-21T15:48:34.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:34 smithi077 ceph-mon[27902]: pgmap v10452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:34.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19425.438907 secs 2024-04-21T15:48:34.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:34 smithi191 ceph-mon[31636]: pgmap v10452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:34.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19425.438907 secs 2024-04-21T15:48:34.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:34 smithi170 ceph-mon[31212]: pgmap v10452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:36 smithi077 ceph-mon[27902]: pgmap v10453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:37.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:36 smithi191 ceph-mon[31636]: pgmap v10453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:36 smithi170 ceph-mon[31212]: pgmap v10453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19428.676428 secs 2024-04-21T15:48:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19428.676428 secs 2024-04-21T15:48:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19428.676428 secs 2024-04-21T15:48:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:38 smithi077 ceph-mon[27902]: pgmap v10454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:38 smithi191 ceph-mon[31636]: pgmap v10454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:38 smithi170 ceph-mon[31212]: pgmap v10454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19430.439066 secs 2024-04-21T15:48:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19430.439066 secs 2024-04-21T15:48:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19430.439066 secs 2024-04-21T15:48:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:40 smithi077 ceph-mon[27902]: pgmap v10455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:40 smithi191 ceph-mon[31636]: pgmap v10455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:40 smithi170 ceph-mon[31212]: pgmap v10455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:42 smithi077 ceph-mon[27902]: pgmap v10456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19433.676558 secs 2024-04-21T15:48:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:42 smithi191 ceph-mon[31636]: pgmap v10456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19433.676558 secs 2024-04-21T15:48:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:42 smithi170 ceph-mon[31212]: pgmap v10456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19433.676558 secs 2024-04-21T15:48:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19435.439145 secs 2024-04-21T15:48:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:44 smithi077 ceph-mon[27902]: pgmap v10457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19435.439145 secs 2024-04-21T15:48:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:44 smithi191 ceph-mon[31636]: pgmap v10457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:45.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19435.439145 secs 2024-04-21T15:48:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:44 smithi170 ceph-mon[31212]: pgmap v10457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:46 smithi077 ceph-mon[27902]: pgmap v10458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:46 smithi191 ceph-mon[31636]: pgmap v10458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:46 smithi170 ceph-mon[31212]: pgmap v10458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19438.676632 secs 2024-04-21T15:48:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19438.676632 secs 2024-04-21T15:48:48.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19438.676632 secs 2024-04-21T15:48:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:48 smithi077 ceph-mon[27902]: pgmap v10459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:48 smithi191 ceph-mon[31636]: pgmap v10459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:49.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:48 smithi170 ceph-mon[31212]: pgmap v10459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19440.439262 secs 2024-04-21T15:48:50.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19440.439262 secs 2024-04-21T15:48:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19440.439262 secs 2024-04-21T15:48:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:50 smithi191 ceph-mon[31636]: pgmap v10460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:50 smithi170 ceph-mon[31212]: pgmap v10460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:50 smithi077 ceph-mon[27902]: pgmap v10460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:52 smithi191 ceph-mon[31636]: pgmap v10461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19443.676786 secs 2024-04-21T15:48:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:52 smithi170 ceph-mon[31212]: pgmap v10461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19443.676786 secs 2024-04-21T15:48:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:52 smithi077 ceph-mon[27902]: pgmap v10461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19443.676786 secs 2024-04-21T15:48:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:48:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19445.439385 secs 2024-04-21T15:48:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:54 smithi191 ceph-mon[31636]: pgmap v10462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:55.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19445.439385 secs 2024-04-21T15:48:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:54 smithi170 ceph-mon[31212]: pgmap v10462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19445.439385 secs 2024-04-21T15:48:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:54 smithi077 ceph-mon[27902]: pgmap v10462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:48:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:56 smithi191 ceph-mon[31636]: pgmap v10463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:57.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:56 smithi170 ceph-mon[31212]: pgmap v10463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:56 smithi077 ceph-mon[27902]: pgmap v10463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:48:58.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19448.676896 secs 2024-04-21T15:48:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19448.676896 secs 2024-04-21T15:48:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19448.676896 secs 2024-04-21T15:48:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:58 smithi191 ceph-mon[31636]: pgmap v10464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:59.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:58 smithi170 ceph-mon[31212]: pgmap v10464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:48:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:58 smithi077 ceph-mon[27902]: pgmap v10464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:48:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19450.439513 secs 2024-04-21T15:49:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:48:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19450.439513 secs 2024-04-21T15:49:00.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:48:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19450.439513 secs 2024-04-21T15:49:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:00 smithi191 ceph-mon[31636]: pgmap v10465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:00 smithi170 ceph-mon[31212]: pgmap v10465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:00 smithi077 ceph-mon[27902]: pgmap v10465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:03.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:02 smithi191 ceph-mon[31636]: pgmap v10466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19453.677012 secs 2024-04-21T15:49:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:02 smithi170 ceph-mon[31212]: pgmap v10466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19453.677012 secs 2024-04-21T15:49:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:02 smithi077 ceph-mon[27902]: pgmap v10466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19453.677012 secs 2024-04-21T15:49:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19455.439622 secs 2024-04-21T15:49:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:04 smithi191 ceph-mon[31636]: pgmap v10467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:04 smithi191 ceph-mon[31636]: osdmap e726: 12 total, 12 up, 12 in 2024-04-21T15:49:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19455.439622 secs 2024-04-21T15:49:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:04 smithi170 ceph-mon[31212]: pgmap v10467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:04 smithi170 ceph-mon[31212]: osdmap e726: 12 total, 12 up, 12 in 2024-04-21T15:49:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19455.439622 secs 2024-04-21T15:49:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:04 smithi077 ceph-mon[27902]: pgmap v10467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:04 smithi077 ceph-mon[27902]: osdmap e726: 12 total, 12 up, 12 in 2024-04-21T15:49:07.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:06 smithi191 ceph-mon[31636]: pgmap v10469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:07.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:06 smithi170 ceph-mon[31212]: pgmap v10469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:06 smithi077 ceph-mon[27902]: pgmap v10469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19458.677127 secs 2024-04-21T15:49:08.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19458.677127 secs 2024-04-21T15:49:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19458.677127 secs 2024-04-21T15:49:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:08 smithi191 ceph-mon[31636]: pgmap v10470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:08 smithi170 ceph-mon[31212]: pgmap v10470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:08 smithi077 ceph-mon[27902]: pgmap v10470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:10.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19460.439768 secs 2024-04-21T15:49:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19460.439768 secs 2024-04-21T15:49:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19460.439768 secs 2024-04-21T15:49:11.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:10 smithi191 ceph-mon[31636]: pgmap v10471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:10 smithi191 ceph-mon[31636]: osdmap e727: 12 total, 12 up, 12 in 2024-04-21T15:49:11.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:10 smithi170 ceph-mon[31212]: pgmap v10471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:10 smithi170 ceph-mon[31212]: osdmap e727: 12 total, 12 up, 12 in 2024-04-21T15:49:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:10 smithi077 ceph-mon[27902]: pgmap v10471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:49:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:10 smithi077 ceph-mon[27902]: osdmap e727: 12 total, 12 up, 12 in 2024-04-21T15:49:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:12 smithi191 ceph-mon[31636]: pgmap v10473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:49:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19463.677224 secs 2024-04-21T15:49:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:12 smithi170 ceph-mon[31212]: pgmap v10473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:49:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19463.677224 secs 2024-04-21T15:49:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:12 smithi077 ceph-mon[27902]: pgmap v10473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:49:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19463.677224 secs 2024-04-21T15:49:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:15.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19465.439879 secs 2024-04-21T15:49:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:14 smithi191 ceph-mon[31636]: pgmap v10474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:49:15.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19465.439879 secs 2024-04-21T15:49:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:14 smithi170 ceph-mon[31212]: pgmap v10474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:49:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19465.439879 secs 2024-04-21T15:49:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:14 smithi077 ceph-mon[27902]: pgmap v10474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:49:17.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:16 smithi191 ceph-mon[31636]: pgmap v10475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:17.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:16 smithi170 ceph-mon[31212]: pgmap v10475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:16 smithi077 ceph-mon[27902]: pgmap v10475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19468.677349 secs 2024-04-21T15:49:18.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19468.677349 secs 2024-04-21T15:49:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19468.677349 secs 2024-04-21T15:49:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:18 smithi170 ceph-mon[31212]: pgmap v10476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:18 smithi077 ceph-mon[27902]: pgmap v10476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:18 smithi191 ceph-mon[31636]: pgmap v10476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:20.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19470.439997 secs 2024-04-21T15:49:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19470.439997 secs 2024-04-21T15:49:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19470.439997 secs 2024-04-21T15:49:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:20 smithi170 ceph-mon[31212]: pgmap v10477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:20 smithi077 ceph-mon[27902]: pgmap v10477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:20 smithi191 ceph-mon[31636]: pgmap v10477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:49:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:22 smithi170 ceph-mon[31212]: pgmap v10478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:49:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19473.677485 secs 2024-04-21T15:49:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:22 smithi077 ceph-mon[27902]: pgmap v10478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:49:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19473.677485 secs 2024-04-21T15:49:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:22 smithi191 ceph-mon[31636]: pgmap v10478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:49:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19473.677485 secs 2024-04-21T15:49:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19475.440107 secs 2024-04-21T15:49:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:24 smithi170 ceph-mon[31212]: pgmap v10479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19475.440107 secs 2024-04-21T15:49:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:24 smithi077 ceph-mon[27902]: pgmap v10479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19475.440107 secs 2024-04-21T15:49:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:24 smithi191 ceph-mon[31636]: pgmap v10479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:27.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:26 smithi191 ceph-mon[31636]: pgmap v10480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:27.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:26 smithi170 ceph-mon[31212]: pgmap v10480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:26 smithi077 ceph-mon[27902]: pgmap v10480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:28.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19478.677604 secs 2024-04-21T15:49:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19478.677604 secs 2024-04-21T15:49:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19478.677604 secs 2024-04-21T15:49:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:28 smithi170 ceph-mon[31212]: pgmap v10481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:28 smithi077 ceph-mon[27902]: pgmap v10481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:28 smithi191 ceph-mon[31636]: pgmap v10481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19480.440232 secs 2024-04-21T15:49:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19480.440232 secs 2024-04-21T15:49:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19480.440232 secs 2024-04-21T15:49:31.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:31 smithi170 ceph-mon[31212]: pgmap v10482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:49:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:31 smithi077 ceph-mon[27902]: pgmap v10482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:49:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:31 smithi191 ceph-mon[31636]: pgmap v10482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:49:32.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:32 smithi077 ceph-mon[27902]: pgmap v10483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:49:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:49:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:32 smithi191 ceph-mon[31636]: pgmap v10483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:49:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:49:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:32 smithi170 ceph-mon[31212]: pgmap v10483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:49:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:49:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:49:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19483.677694 secs 2024-04-21T15:49:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19483.677694 secs 2024-04-21T15:49:33.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19483.677694 secs 2024-04-21T15:49:34.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19485.440378 secs 2024-04-21T15:49:34.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:34 smithi077 ceph-mon[27902]: pgmap v10484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19485.440378 secs 2024-04-21T15:49:34.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:34 smithi191 ceph-mon[31636]: pgmap v10484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19485.440378 secs 2024-04-21T15:49:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:34 smithi170 ceph-mon[31212]: pgmap v10484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:36 smithi077 ceph-mon[27902]: pgmap v10485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:37.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:36 smithi191 ceph-mon[31636]: pgmap v10485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:36 smithi170 ceph-mon[31212]: pgmap v10485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19488.677845 secs 2024-04-21T15:49:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19488.677845 secs 2024-04-21T15:49:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19488.677845 secs 2024-04-21T15:49:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:38 smithi077 ceph-mon[27902]: pgmap v10486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:38 smithi191 ceph-mon[31636]: pgmap v10486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:38 smithi170 ceph-mon[31212]: pgmap v10486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19490.440515 secs 2024-04-21T15:49:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19490.440515 secs 2024-04-21T15:49:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19490.440515 secs 2024-04-21T15:49:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:40 smithi077 ceph-mon[27902]: pgmap v10487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:40 smithi191 ceph-mon[31636]: pgmap v10487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:41.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:40 smithi170 ceph-mon[31212]: pgmap v10487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:42 smithi077 ceph-mon[27902]: pgmap v10488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19493.677934 secs 2024-04-21T15:49:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:42 smithi191 ceph-mon[31636]: pgmap v10488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19493.677934 secs 2024-04-21T15:49:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:42 smithi170 ceph-mon[31212]: pgmap v10488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19493.677934 secs 2024-04-21T15:49:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19495.440654 secs 2024-04-21T15:49:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:44 smithi077 ceph-mon[27902]: pgmap v10489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19495.440654 secs 2024-04-21T15:49:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:44 smithi191 ceph-mon[31636]: pgmap v10489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19495.440654 secs 2024-04-21T15:49:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:44 smithi170 ceph-mon[31212]: pgmap v10489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:46 smithi077 ceph-mon[27902]: pgmap v10490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:46 smithi191 ceph-mon[31636]: pgmap v10490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:46 smithi170 ceph-mon[31212]: pgmap v10490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19498.678046 secs 2024-04-21T15:49:48.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19498.678046 secs 2024-04-21T15:49:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19498.678046 secs 2024-04-21T15:49:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:48 smithi191 ceph-mon[31636]: pgmap v10491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:49.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:48 smithi170 ceph-mon[31212]: pgmap v10491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:48 smithi077 ceph-mon[27902]: pgmap v10491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19500.440777 secs 2024-04-21T15:49:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19500.440777 secs 2024-04-21T15:49:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19500.440777 secs 2024-04-21T15:49:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:50 smithi191 ceph-mon[31636]: pgmap v10492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:51.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:50 smithi170 ceph-mon[31212]: pgmap v10492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:50 smithi077 ceph-mon[27902]: pgmap v10492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19503.678163 secs 2024-04-21T15:49:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:52 smithi191 ceph-mon[31636]: pgmap v10493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:53.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19503.678163 secs 2024-04-21T15:49:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:52 smithi170 ceph-mon[31212]: pgmap v10493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19503.678163 secs 2024-04-21T15:49:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:52 smithi077 ceph-mon[27902]: pgmap v10493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:49:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19505.440895 secs 2024-04-21T15:49:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:54 smithi191 ceph-mon[31636]: pgmap v10494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19505.440895 secs 2024-04-21T15:49:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:54 smithi170 ceph-mon[31212]: pgmap v10494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19505.440895 secs 2024-04-21T15:49:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:54 smithi077 ceph-mon[27902]: pgmap v10494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:49:57.050+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:49:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:49:57.050+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:49:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:49:57.050+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:49:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:49:57.050+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:49:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:56 smithi191 ceph-mon[31636]: pgmap v10495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:56 smithi170 ceph-mon[31212]: pgmap v10495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:56 smithi077 ceph-mon[27902]: pgmap v10495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:49:58.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19508.678302 secs 2024-04-21T15:49:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19508.678302 secs 2024-04-21T15:49:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19508.678302 secs 2024-04-21T15:49:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:58 smithi191 ceph-mon[31636]: pgmap v10496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:58 smithi170 ceph-mon[31212]: pgmap v10496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:49:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:58 smithi077 ceph-mon[27902]: pgmap v10496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:49:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19510.441014 secs 2024-04-21T15:50:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:49:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19510.441014 secs 2024-04-21T15:50:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:49:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19510.441014 secs 2024-04-21T15:50:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:00 smithi191 ceph-mon[31636]: pgmap v10497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:50:01.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:00 smithi170 ceph-mon[31212]: pgmap v10497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:50:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:00 smithi077 ceph-mon[27902]: pgmap v10497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T15:50:03.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19513.678429 secs 2024-04-21T15:50:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:02 smithi191 ceph-mon[31636]: pgmap v10498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19513.678429 secs 2024-04-21T15:50:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:02 smithi170 ceph-mon[31212]: pgmap v10498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19513.678429 secs 2024-04-21T15:50:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:02 smithi077 ceph-mon[27902]: pgmap v10498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19515.441131 secs 2024-04-21T15:50:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:04 smithi191 ceph-mon[31636]: pgmap v10499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:04 smithi191 ceph-mon[31636]: osdmap e728: 12 total, 12 up, 12 in 2024-04-21T15:50:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19515.441131 secs 2024-04-21T15:50:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:04 smithi170 ceph-mon[31212]: pgmap v10499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:04 smithi170 ceph-mon[31212]: osdmap e728: 12 total, 12 up, 12 in 2024-04-21T15:50:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19515.441131 secs 2024-04-21T15:50:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:04 smithi077 ceph-mon[27902]: pgmap v10499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:04 smithi077 ceph-mon[27902]: osdmap e728: 12 total, 12 up, 12 in 2024-04-21T15:50:07.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:06 smithi191 ceph-mon[31636]: pgmap v10501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:07.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:06 smithi170 ceph-mon[31212]: pgmap v10501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:06 smithi077 ceph-mon[27902]: pgmap v10501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19518.678540 secs 2024-04-21T15:50:08.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19518.678540 secs 2024-04-21T15:50:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19518.678540 secs 2024-04-21T15:50:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:08 smithi191 ceph-mon[31636]: pgmap v10502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:08 smithi170 ceph-mon[31212]: pgmap v10502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:08 smithi077 ceph-mon[27902]: pgmap v10502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:10.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19520.441254 secs 2024-04-21T15:50:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19520.441254 secs 2024-04-21T15:50:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19520.441254 secs 2024-04-21T15:50:11.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:10 smithi191 ceph-mon[31636]: pgmap v10503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:10 smithi191 ceph-mon[31636]: osdmap e729: 12 total, 12 up, 12 in 2024-04-21T15:50:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:10 smithi170 ceph-mon[31212]: pgmap v10503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:10 smithi170 ceph-mon[31212]: osdmap e729: 12 total, 12 up, 12 in 2024-04-21T15:50:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:10 smithi077 ceph-mon[27902]: pgmap v10503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T15:50:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:10 smithi077 ceph-mon[27902]: osdmap e729: 12 total, 12 up, 12 in 2024-04-21T15:50:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19523.678647 secs 2024-04-21T15:50:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:12 smithi170 ceph-mon[31212]: pgmap v10505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:50:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19523.678647 secs 2024-04-21T15:50:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:12 smithi077 ceph-mon[27902]: pgmap v10505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:50:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19523.678647 secs 2024-04-21T15:50:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:12 smithi191 ceph-mon[31636]: pgmap v10505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T15:50:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19525.441322 secs 2024-04-21T15:50:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:14 smithi170 ceph-mon[31212]: pgmap v10506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:50:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19525.441322 secs 2024-04-21T15:50:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:14 smithi077 ceph-mon[27902]: pgmap v10506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:50:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19525.441322 secs 2024-04-21T15:50:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:14 smithi191 ceph-mon[31636]: pgmap v10506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:50:17.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:16 smithi170 ceph-mon[31212]: pgmap v10507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:16 smithi077 ceph-mon[27902]: pgmap v10507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:17.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:16 smithi191 ceph-mon[31636]: pgmap v10507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19528.678805 secs 2024-04-21T15:50:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19528.678805 secs 2024-04-21T15:50:18.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19528.678805 secs 2024-04-21T15:50:19.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:18 smithi170 ceph-mon[31212]: pgmap v10508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:18 smithi077 ceph-mon[27902]: pgmap v10508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:18 smithi191 ceph-mon[31636]: pgmap v10508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19530.441444 secs 2024-04-21T15:50:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19530.441444 secs 2024-04-21T15:50:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19530.441444 secs 2024-04-21T15:50:21.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:20 smithi170 ceph-mon[31212]: pgmap v10509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:20 smithi077 ceph-mon[27902]: pgmap v10509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:20 smithi191 ceph-mon[31636]: pgmap v10509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:50:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19533.678918 secs 2024-04-21T15:50:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:23 smithi170 ceph-mon[31212]: pgmap v10510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:50:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19533.678918 secs 2024-04-21T15:50:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:23 smithi077 ceph-mon[27902]: pgmap v10510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:50:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19533.678918 secs 2024-04-21T15:50:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:23 smithi191 ceph-mon[31636]: pgmap v10510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:50:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19535.441600 secs 2024-04-21T15:50:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:25 smithi170 ceph-mon[31212]: pgmap v10511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19535.441600 secs 2024-04-21T15:50:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:25 smithi077 ceph-mon[27902]: pgmap v10511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19535.441600 secs 2024-04-21T15:50:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:25 smithi191 ceph-mon[31636]: pgmap v10511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:27.273 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:27 smithi191 ceph-mon[31636]: pgmap v10512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:27.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:27 smithi170 ceph-mon[31212]: pgmap v10512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:27 smithi077 ceph-mon[27902]: pgmap v10512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:28.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19538.679001 secs 2024-04-21T15:50:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19538.679001 secs 2024-04-21T15:50:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19538.679001 secs 2024-04-21T15:50:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:29 smithi170 ceph-mon[31212]: pgmap v10513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:29 smithi077 ceph-mon[27902]: pgmap v10513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:29 smithi191 ceph-mon[31636]: pgmap v10513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19540.441725 secs 2024-04-21T15:50:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19540.441725 secs 2024-04-21T15:50:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19540.441725 secs 2024-04-21T15:50:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:31 smithi170 ceph-mon[31212]: pgmap v10514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:31 smithi077 ceph-mon[27902]: pgmap v10514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:31 smithi191 ceph-mon[31636]: pgmap v10514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19543.679122 secs 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: pgmap v10515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19543.679122 secs 2024-04-21T15:50:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: pgmap v10515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:50:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19543.679122 secs 2024-04-21T15:50:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: pgmap v10515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:50:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:34.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:50:34.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:50:34.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:34.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:50:34.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:50:34.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:34.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:50:34.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:50:34.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:50:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:35.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19545.441816 secs 2024-04-21T15:50:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:35 smithi170 ceph-mon[31212]: pgmap v10516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19545.441816 secs 2024-04-21T15:50:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:35 smithi077 ceph-mon[27902]: pgmap v10516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19545.441816 secs 2024-04-21T15:50:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:35 smithi191 ceph-mon[31636]: pgmap v10516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:37 smithi170 ceph-mon[31212]: pgmap v10517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:37 smithi077 ceph-mon[27902]: pgmap v10517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:37 smithi191 ceph-mon[31636]: pgmap v10517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:38.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19548.679206 secs 2024-04-21T15:50:38.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19548.679206 secs 2024-04-21T15:50:38.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19548.679206 secs 2024-04-21T15:50:39.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:39 smithi170 ceph-mon[31212]: pgmap v10518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:39 smithi077 ceph-mon[27902]: pgmap v10518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:39.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:39 smithi191 ceph-mon[31636]: pgmap v10518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19550.441938 secs 2024-04-21T15:50:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19550.441938 secs 2024-04-21T15:50:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19550.441938 secs 2024-04-21T15:50:41.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:41 smithi170 ceph-mon[31212]: pgmap v10519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:41 smithi077 ceph-mon[27902]: pgmap v10519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:41 smithi191 ceph-mon[31636]: pgmap v10519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:42.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:50:42.056+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:50:42.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:50:42.056+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:50:42.060 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:50:42.056+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:50:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:50:42.056+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:50:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19553.679278 secs 2024-04-21T15:50:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:43 smithi170 ceph-mon[31212]: pgmap v10520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19553.679278 secs 2024-04-21T15:50:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:43 smithi077 ceph-mon[27902]: pgmap v10520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19553.679278 secs 2024-04-21T15:50:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:43 smithi191 ceph-mon[31636]: pgmap v10520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:45.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19555.442061 secs 2024-04-21T15:50:45.317 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:45 smithi170 ceph-mon[31212]: pgmap v10521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19555.442061 secs 2024-04-21T15:50:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:45 smithi077 ceph-mon[27902]: pgmap v10521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:45.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19555.442061 secs 2024-04-21T15:50:45.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:45 smithi191 ceph-mon[31636]: pgmap v10521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:47 smithi077 ceph-mon[27902]: pgmap v10522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:47 smithi191 ceph-mon[31636]: pgmap v10522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:47 smithi170 ceph-mon[31212]: pgmap v10522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19558.679360 secs 2024-04-21T15:50:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19558.679360 secs 2024-04-21T15:50:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19558.679360 secs 2024-04-21T15:50:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:49 smithi077 ceph-mon[27902]: pgmap v10523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:49.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:49 smithi191 ceph-mon[31636]: pgmap v10523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:49 smithi170 ceph-mon[31212]: pgmap v10523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19560.442187 secs 2024-04-21T15:50:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19560.442187 secs 2024-04-21T15:50:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19560.442187 secs 2024-04-21T15:50:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:51 smithi077 ceph-mon[27902]: pgmap v10524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:51 smithi191 ceph-mon[31636]: pgmap v10524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:51.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:51 smithi170 ceph-mon[31212]: pgmap v10524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19563.679486 secs 2024-04-21T15:50:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:53 smithi077 ceph-mon[27902]: pgmap v10525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19563.679486 secs 2024-04-21T15:50:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:53 smithi191 ceph-mon[31636]: pgmap v10525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19563.679486 secs 2024-04-21T15:50:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:53 smithi170 ceph-mon[31212]: pgmap v10525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:50:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19565.442310 secs 2024-04-21T15:50:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:55 smithi077 ceph-mon[27902]: pgmap v10526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19565.442310 secs 2024-04-21T15:50:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:55 smithi191 ceph-mon[31636]: pgmap v10526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19565.442310 secs 2024-04-21T15:50:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:55 smithi170 ceph-mon[31212]: pgmap v10526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:57 smithi077 ceph-mon[27902]: pgmap v10527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:57.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:57 smithi191 ceph-mon[31636]: pgmap v10527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:57.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:57 smithi170 ceph-mon[31212]: pgmap v10527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:50:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19568.679623 secs 2024-04-21T15:50:58.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19568.679623 secs 2024-04-21T15:50:58.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19568.679623 secs 2024-04-21T15:50:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:50:59 smithi077 ceph-mon[27902]: pgmap v10528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:59.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:50:59 smithi191 ceph-mon[31636]: pgmap v10528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:50:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:50:59 smithi170 ceph-mon[31212]: pgmap v10528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19570.442451 secs 2024-04-21T15:51:00.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19570.442451 secs 2024-04-21T15:51:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19570.442451 secs 2024-04-21T15:51:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:01 smithi077 ceph-mon[27902]: pgmap v10529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:01.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:01 smithi191 ceph-mon[31636]: pgmap v10529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:01 smithi170 ceph-mon[31212]: pgmap v10529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:02.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:02 smithi077 ceph-mon[27902]: pgmap v10530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:02.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:02 smithi191 ceph-mon[31636]: pgmap v10530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:02.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:02 smithi170 ceph-mon[31212]: pgmap v10530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19573.679728 secs 2024-04-21T15:51:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19573.679728 secs 2024-04-21T15:51:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19573.679728 secs 2024-04-21T15:51:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19575.442544 secs 2024-04-21T15:51:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:04 smithi077 ceph-mon[27902]: pgmap v10531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:04.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19575.442544 secs 2024-04-21T15:51:04.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:04 smithi191 ceph-mon[31636]: pgmap v10531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:04.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19575.442544 secs 2024-04-21T15:51:04.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:04 smithi170 ceph-mon[31212]: pgmap v10531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:05 smithi077 ceph-mon[27902]: osdmap e730: 12 total, 12 up, 12 in 2024-04-21T15:51:05.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:05 smithi191 ceph-mon[31636]: osdmap e730: 12 total, 12 up, 12 in 2024-04-21T15:51:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:05 smithi170 ceph-mon[31212]: osdmap e730: 12 total, 12 up, 12 in 2024-04-21T15:51:06.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:06 smithi077 ceph-mon[27902]: pgmap v10533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:06.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:06 smithi191 ceph-mon[31636]: pgmap v10533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:06 smithi170 ceph-mon[31212]: pgmap v10533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19578.679854 secs 2024-04-21T15:51:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19578.679854 secs 2024-04-21T15:51:08.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19578.679854 secs 2024-04-21T15:51:08.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:08 smithi077 ceph-mon[27902]: pgmap v10534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:08 smithi191 ceph-mon[31636]: pgmap v10534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:08 smithi170 ceph-mon[31212]: pgmap v10534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19580.442668 secs 2024-04-21T15:51:09.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19580.442668 secs 2024-04-21T15:51:10.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19580.442668 secs 2024-04-21T15:51:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:10 smithi077 ceph-mon[27902]: pgmap v10535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:10 smithi077 ceph-mon[27902]: osdmap e731: 12 total, 12 up, 12 in 2024-04-21T15:51:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:10 smithi191 ceph-mon[31636]: pgmap v10535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:10 smithi191 ceph-mon[31636]: osdmap e731: 12 total, 12 up, 12 in 2024-04-21T15:51:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:10 smithi170 ceph-mon[31212]: pgmap v10535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:51:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:10 smithi170 ceph-mon[31212]: osdmap e731: 12 total, 12 up, 12 in 2024-04-21T15:51:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19583.679967 secs 2024-04-21T15:51:13.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:12 smithi191 ceph-mon[31636]: pgmap v10537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:51:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19583.679967 secs 2024-04-21T15:51:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:12 smithi170 ceph-mon[31212]: pgmap v10537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:51:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19583.679967 secs 2024-04-21T15:51:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:12 smithi077 ceph-mon[27902]: pgmap v10537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:51:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:15.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19585.442783 secs 2024-04-21T15:51:15.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:14 smithi191 ceph-mon[31636]: pgmap v10538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:51:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19585.442783 secs 2024-04-21T15:51:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:14 smithi170 ceph-mon[31212]: pgmap v10538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:51:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19585.442783 secs 2024-04-21T15:51:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:14 smithi077 ceph-mon[27902]: pgmap v10538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:51:17.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:16 smithi191 ceph-mon[31636]: pgmap v10539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:17.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:16 smithi170 ceph-mon[31212]: pgmap v10539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:16 smithi077 ceph-mon[27902]: pgmap v10539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19588.680035 secs 2024-04-21T15:51:18.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19588.680035 secs 2024-04-21T15:51:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19588.680035 secs 2024-04-21T15:51:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:18 smithi191 ceph-mon[31636]: pgmap v10540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:19.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:18 smithi170 ceph-mon[31212]: pgmap v10540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:18 smithi077 ceph-mon[27902]: pgmap v10540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19590.442916 secs 2024-04-21T15:51:20.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19590.442916 secs 2024-04-21T15:51:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19590.442916 secs 2024-04-21T15:51:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:20 smithi191 ceph-mon[31636]: pgmap v10541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:21.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:20 smithi170 ceph-mon[31212]: pgmap v10541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:20 smithi077 ceph-mon[27902]: pgmap v10541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:51:23.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19593.680109 secs 2024-04-21T15:51:23.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:22 smithi191 ceph-mon[31636]: pgmap v10542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:51:23.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19593.680109 secs 2024-04-21T15:51:23.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:22 smithi170 ceph-mon[31212]: pgmap v10542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:51:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19593.680109 secs 2024-04-21T15:51:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:22 smithi077 ceph-mon[27902]: pgmap v10542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:51:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19595.443059 secs 2024-04-21T15:51:25.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:24 smithi191 ceph-mon[31636]: pgmap v10543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19595.443059 secs 2024-04-21T15:51:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:24 smithi170 ceph-mon[31212]: pgmap v10543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19595.443059 secs 2024-04-21T15:51:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:24 smithi077 ceph-mon[27902]: pgmap v10543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:27.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:26 smithi191 ceph-mon[31636]: pgmap v10544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:27.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:26 smithi170 ceph-mon[31212]: pgmap v10544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:26 smithi077 ceph-mon[27902]: pgmap v10544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:28.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19598.680226 secs 2024-04-21T15:51:28.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19598.680226 secs 2024-04-21T15:51:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19598.680226 secs 2024-04-21T15:51:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:28 smithi191 ceph-mon[31636]: pgmap v10545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:28 smithi170 ceph-mon[31212]: pgmap v10545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:28 smithi077 ceph-mon[27902]: pgmap v10545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:30.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19600.443142 secs 2024-04-21T15:51:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19600.443142 secs 2024-04-21T15:51:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19600.443142 secs 2024-04-21T15:51:31.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:30 smithi191 ceph-mon[31636]: pgmap v10546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:31.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:30 smithi170 ceph-mon[31212]: pgmap v10546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:30 smithi077 ceph-mon[27902]: pgmap v10546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:33.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19603.680343 secs 2024-04-21T15:51:33.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:32 smithi191 ceph-mon[31636]: pgmap v10547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:33.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19603.680343 secs 2024-04-21T15:51:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:32 smithi170 ceph-mon[31212]: pgmap v10547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19603.680343 secs 2024-04-21T15:51:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:32 smithi077 ceph-mon[27902]: pgmap v10547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:34.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:51:34.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:51:34.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:51:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:35.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19605.443213 secs 2024-04-21T15:51:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:34 smithi191 ceph-mon[31636]: pgmap v10548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:51:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:51:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:51:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19605.443213 secs 2024-04-21T15:51:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:34 smithi170 ceph-mon[31212]: pgmap v10548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:51:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:51:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:51:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19605.443213 secs 2024-04-21T15:51:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:34 smithi077 ceph-mon[27902]: pgmap v10548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:51:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:51:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:51:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:51:37.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:36 smithi191 ceph-mon[31636]: pgmap v10549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:36 smithi170 ceph-mon[31212]: pgmap v10549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:36 smithi077 ceph-mon[27902]: pgmap v10549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19608.680461 secs 2024-04-21T15:51:38.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19608.680461 secs 2024-04-21T15:51:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19608.680461 secs 2024-04-21T15:51:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:38 smithi191 ceph-mon[31636]: pgmap v10550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:39.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:38 smithi170 ceph-mon[31212]: pgmap v10550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:38 smithi077 ceph-mon[27902]: pgmap v10550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19610.443336 secs 2024-04-21T15:51:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19610.443336 secs 2024-04-21T15:51:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19610.443336 secs 2024-04-21T15:51:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:40 smithi191 ceph-mon[31636]: pgmap v10551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:41.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:40 smithi170 ceph-mon[31212]: pgmap v10551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:40 smithi077 ceph-mon[27902]: pgmap v10551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19613.680598 secs 2024-04-21T15:51:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:42 smithi170 ceph-mon[31212]: pgmap v10552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19613.680598 secs 2024-04-21T15:51:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:42 smithi077 ceph-mon[27902]: pgmap v10552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19613.680598 secs 2024-04-21T15:51:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:42 smithi191 ceph-mon[31636]: pgmap v10552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19615.443426 secs 2024-04-21T15:51:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:44 smithi170 ceph-mon[31212]: pgmap v10553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19615.443426 secs 2024-04-21T15:51:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:44 smithi077 ceph-mon[27902]: pgmap v10553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:45.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19615.443426 secs 2024-04-21T15:51:45.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:44 smithi191 ceph-mon[31636]: pgmap v10553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:47.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:46 smithi170 ceph-mon[31212]: pgmap v10554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:46 smithi077 ceph-mon[27902]: pgmap v10554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:46 smithi191 ceph-mon[31636]: pgmap v10554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19618.680718 secs 2024-04-21T15:51:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19618.680718 secs 2024-04-21T15:51:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19618.680718 secs 2024-04-21T15:51:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:48 smithi170 ceph-mon[31212]: pgmap v10555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:48 smithi077 ceph-mon[27902]: pgmap v10555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:49.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:48 smithi191 ceph-mon[31636]: pgmap v10555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:50.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19620.443581 secs 2024-04-21T15:51:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19620.443581 secs 2024-04-21T15:51:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19620.443581 secs 2024-04-21T15:51:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:50 smithi170 ceph-mon[31212]: pgmap v10556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:50 smithi077 ceph-mon[27902]: pgmap v10556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:50 smithi191 ceph-mon[31636]: pgmap v10556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:53.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19623.680831 secs 2024-04-21T15:51:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:52 smithi170 ceph-mon[31212]: pgmap v10557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19623.680831 secs 2024-04-21T15:51:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:52 smithi077 ceph-mon[27902]: pgmap v10557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19623.680831 secs 2024-04-21T15:51:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:52 smithi191 ceph-mon[31636]: pgmap v10557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:51:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19625.443706 secs 2024-04-21T15:51:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:54 smithi170 ceph-mon[31212]: pgmap v10558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19625.443706 secs 2024-04-21T15:51:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:54 smithi077 ceph-mon[27902]: pgmap v10558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19625.443706 secs 2024-04-21T15:51:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:54 smithi191 ceph-mon[31636]: pgmap v10558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:57.275 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:57 smithi191 ceph-mon[31636]: pgmap v10559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:57.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:57 smithi170 ceph-mon[31212]: pgmap v10559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:57 smithi077 ceph-mon[27902]: pgmap v10559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:51:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19628.680969 secs 2024-04-21T15:51:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19628.680969 secs 2024-04-21T15:51:58.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19628.680969 secs 2024-04-21T15:51:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:51:59 smithi170 ceph-mon[31212]: pgmap v10560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:51:59 smithi077 ceph-mon[27902]: pgmap v10560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:51:59.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:51:59 smithi191 ceph-mon[31636]: pgmap v10560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19630.443837 secs 2024-04-21T15:52:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19630.443837 secs 2024-04-21T15:52:00.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19630.443837 secs 2024-04-21T15:52:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:01 smithi170 ceph-mon[31212]: pgmap v10561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:01 smithi077 ceph-mon[27902]: pgmap v10561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:01.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:01 smithi191 ceph-mon[31636]: pgmap v10561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19633.681065 secs 2024-04-21T15:52:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:03 smithi170 ceph-mon[31212]: pgmap v10562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:52:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19633.681065 secs 2024-04-21T15:52:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:03 smithi077 ceph-mon[27902]: pgmap v10562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:52:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19633.681065 secs 2024-04-21T15:52:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:03 smithi191 ceph-mon[31636]: pgmap v10562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:52:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19635.443965 secs 2024-04-21T15:52:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:05 smithi170 ceph-mon[31212]: pgmap v10563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T15:52:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:05 smithi170 ceph-mon[31212]: osdmap e732: 12 total, 12 up, 12 in 2024-04-21T15:52:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19635.443965 secs 2024-04-21T15:52:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:05 smithi077 ceph-mon[27902]: pgmap v10563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T15:52:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:05 smithi077 ceph-mon[27902]: osdmap e732: 12 total, 12 up, 12 in 2024-04-21T15:52:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19635.443965 secs 2024-04-21T15:52:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:05 smithi191 ceph-mon[31636]: pgmap v10563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T15:52:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:05 smithi191 ceph-mon[31636]: osdmap e732: 12 total, 12 up, 12 in 2024-04-21T15:52:07.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:07 smithi170 ceph-mon[31212]: pgmap v10565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:07 smithi077 ceph-mon[27902]: pgmap v10565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:07 smithi191 ceph-mon[31636]: pgmap v10565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:08.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19638.681185 secs 2024-04-21T15:52:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19638.681185 secs 2024-04-21T15:52:08.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19638.681185 secs 2024-04-21T15:52:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:09 smithi170 ceph-mon[31212]: pgmap v10566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:09 smithi077 ceph-mon[27902]: pgmap v10566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:09 smithi191 ceph-mon[31636]: pgmap v10566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19640.444044 secs 2024-04-21T15:52:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19640.444044 secs 2024-04-21T15:52:10.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19640.444044 secs 2024-04-21T15:52:11.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:11 smithi170 ceph-mon[31212]: pgmap v10567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:11 smithi170 ceph-mon[31212]: osdmap e733: 12 total, 12 up, 12 in 2024-04-21T15:52:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:11 smithi077 ceph-mon[27902]: pgmap v10567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:11 smithi077 ceph-mon[27902]: osdmap e733: 12 total, 12 up, 12 in 2024-04-21T15:52:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:11 smithi191 ceph-mon[31636]: pgmap v10567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:52:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:11 smithi191 ceph-mon[31636]: osdmap e733: 12 total, 12 up, 12 in 2024-04-21T15:52:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19643.681294 secs 2024-04-21T15:52:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:13 smithi170 ceph-mon[31212]: pgmap v10569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-04-21T15:52:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19643.681294 secs 2024-04-21T15:52:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:13 smithi077 ceph-mon[27902]: pgmap v10569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-04-21T15:52:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19643.681294 secs 2024-04-21T15:52:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:13 smithi191 ceph-mon[31636]: pgmap v10569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-04-21T15:52:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:15.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19645.444162 secs 2024-04-21T15:52:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:15 smithi170 ceph-mon[31212]: pgmap v10570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 20 KiB/s wr, 7 op/s 2024-04-21T15:52:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19645.444162 secs 2024-04-21T15:52:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:15 smithi077 ceph-mon[27902]: pgmap v10570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 20 KiB/s wr, 7 op/s 2024-04-21T15:52:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19645.444162 secs 2024-04-21T15:52:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:15 smithi191 ceph-mon[31636]: pgmap v10570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 20 KiB/s wr, 7 op/s 2024-04-21T15:52:17.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:17 smithi170 ceph-mon[31212]: pgmap v10571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:17 smithi077 ceph-mon[27902]: pgmap v10571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:17.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:17 smithi191 ceph-mon[31636]: pgmap v10571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19648.681410 secs 2024-04-21T15:52:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19648.681410 secs 2024-04-21T15:52:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19648.681410 secs 2024-04-21T15:52:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:19 smithi077 ceph-mon[27902]: pgmap v10572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:19 smithi191 ceph-mon[31636]: pgmap v10572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:19 smithi170 ceph-mon[31212]: pgmap v10572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19650.444248 secs 2024-04-21T15:52:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19650.444248 secs 2024-04-21T15:52:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19650.444248 secs 2024-04-21T15:52:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:21 smithi077 ceph-mon[27902]: pgmap v10573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:21 smithi191 ceph-mon[31636]: pgmap v10573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:21.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:21 smithi170 ceph-mon[31212]: pgmap v10573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:52:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19653.681534 secs 2024-04-21T15:52:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:23 smithi077 ceph-mon[27902]: pgmap v10574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:52:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19653.681534 secs 2024-04-21T15:52:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:23 smithi191 ceph-mon[31636]: pgmap v10574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:52:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19653.681534 secs 2024-04-21T15:52:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:23 smithi170 ceph-mon[31212]: pgmap v10574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:52:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19655.444364 secs 2024-04-21T15:52:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:25 smithi077 ceph-mon[27902]: pgmap v10575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19655.444364 secs 2024-04-21T15:52:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:25 smithi191 ceph-mon[31636]: pgmap v10575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19655.444364 secs 2024-04-21T15:52:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:25 smithi170 ceph-mon[31212]: pgmap v10575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:27 smithi077 ceph-mon[27902]: pgmap v10576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:27.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:27 smithi191 ceph-mon[31636]: pgmap v10576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:27 smithi170 ceph-mon[31212]: pgmap v10576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19658.681684 secs 2024-04-21T15:52:28.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19658.681684 secs 2024-04-21T15:52:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19658.681684 secs 2024-04-21T15:52:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:29 smithi077 ceph-mon[27902]: pgmap v10577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:29 smithi191 ceph-mon[31636]: pgmap v10577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:29.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:29 smithi170 ceph-mon[31212]: pgmap v10577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19660.444506 secs 2024-04-21T15:52:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19660.444506 secs 2024-04-21T15:52:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19660.444506 secs 2024-04-21T15:52:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:31 smithi077 ceph-mon[27902]: pgmap v10578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:31 smithi191 ceph-mon[31636]: pgmap v10578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:31 smithi170 ceph-mon[31212]: pgmap v10578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19663.681779 secs 2024-04-21T15:52:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:33 smithi077 ceph-mon[27902]: pgmap v10579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19663.681779 secs 2024-04-21T15:52:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:33 smithi191 ceph-mon[31636]: pgmap v10579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19663.681779 secs 2024-04-21T15:52:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:33 smithi170 ceph-mon[31212]: pgmap v10579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19665.444640 secs 2024-04-21T15:52:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:35 smithi077 ceph-mon[27902]: pgmap v10580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:52:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:52:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:52:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:52:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19665.444640 secs 2024-04-21T15:52:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:35 smithi191 ceph-mon[31636]: pgmap v10580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:52:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:52:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:52:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:52:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19665.444640 secs 2024-04-21T15:52:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:35 smithi170 ceph-mon[31212]: pgmap v10580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:52:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:52:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:52:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:52:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:37 smithi077 ceph-mon[27902]: pgmap v10581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:37 smithi191 ceph-mon[31636]: pgmap v10581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:37.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:37 smithi170 ceph-mon[31212]: pgmap v10581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:38.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19668.681875 secs 2024-04-21T15:52:38.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19668.681875 secs 2024-04-21T15:52:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19668.681875 secs 2024-04-21T15:52:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:39 smithi077 ceph-mon[27902]: pgmap v10582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:39.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:39 smithi191 ceph-mon[31636]: pgmap v10582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:39 smithi170 ceph-mon[31212]: pgmap v10582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19670.444765 secs 2024-04-21T15:52:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19670.444765 secs 2024-04-21T15:52:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19670.444765 secs 2024-04-21T15:52:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:41 smithi077 ceph-mon[27902]: pgmap v10583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:41 smithi191 ceph-mon[31636]: pgmap v10583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:41 smithi170 ceph-mon[31212]: pgmap v10583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:42.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:42 smithi077 ceph-mon[27902]: pgmap v10584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:42.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:42 smithi191 ceph-mon[31636]: pgmap v10584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:42.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:42 smithi170 ceph-mon[31212]: pgmap v10584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19673.681972 secs 2024-04-21T15:52:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19673.681972 secs 2024-04-21T15:52:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19673.681972 secs 2024-04-21T15:52:44.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19675.444888 secs 2024-04-21T15:52:44.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:44 smithi077 ceph-mon[27902]: pgmap v10585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:44.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19675.444888 secs 2024-04-21T15:52:44.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:44 smithi191 ceph-mon[31636]: pgmap v10585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:44.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19675.444888 secs 2024-04-21T15:52:44.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:44 smithi170 ceph-mon[31212]: pgmap v10585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:46 smithi191 ceph-mon[31636]: pgmap v10586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:47.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:46 smithi170 ceph-mon[31212]: pgmap v10586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:46 smithi077 ceph-mon[27902]: pgmap v10586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19678.682088 secs 2024-04-21T15:52:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19678.682088 secs 2024-04-21T15:52:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19678.682088 secs 2024-04-21T15:52:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:48 smithi191 ceph-mon[31636]: pgmap v10587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:49.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:48 smithi170 ceph-mon[31212]: pgmap v10587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:48 smithi077 ceph-mon[27902]: pgmap v10587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19680.445005 secs 2024-04-21T15:52:50.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19680.445005 secs 2024-04-21T15:52:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19680.445005 secs 2024-04-21T15:52:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:50 smithi191 ceph-mon[31636]: pgmap v10588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:50 smithi170 ceph-mon[31212]: pgmap v10588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:50 smithi077 ceph-mon[27902]: pgmap v10588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19683.682205 secs 2024-04-21T15:52:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:52 smithi191 ceph-mon[31636]: pgmap v10589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:53.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19683.682205 secs 2024-04-21T15:52:53.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:52 smithi170 ceph-mon[31212]: pgmap v10589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19683.682205 secs 2024-04-21T15:52:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:52 smithi077 ceph-mon[27902]: pgmap v10589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:52:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19685.445082 secs 2024-04-21T15:52:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:54 smithi191 ceph-mon[31636]: pgmap v10590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19685.445082 secs 2024-04-21T15:52:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:54 smithi170 ceph-mon[31212]: pgmap v10590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19685.445082 secs 2024-04-21T15:52:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:54 smithi077 ceph-mon[27902]: pgmap v10590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:57.079 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:52:57.075+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:52:57.079 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:52:57.075+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:52:57.079 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:52:57.075+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:52:57.079 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:52:57.075+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:52:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:56 smithi191 ceph-mon[31636]: pgmap v10591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:56 smithi170 ceph-mon[31212]: pgmap v10591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:56 smithi077 ceph-mon[27902]: pgmap v10591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:52:58.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19688.682325 secs 2024-04-21T15:52:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19688.682325 secs 2024-04-21T15:52:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19688.682325 secs 2024-04-21T15:52:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:58 smithi191 ceph-mon[31636]: pgmap v10592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:59.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:58 smithi170 ceph-mon[31212]: pgmap v10592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:52:59.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:58 smithi077 ceph-mon[27902]: pgmap v10592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19690.445210 secs 2024-04-21T15:53:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19690.445210 secs 2024-04-21T15:53:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19690.445210 secs 2024-04-21T15:53:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:00 smithi191 ceph-mon[31636]: pgmap v10593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:01.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:00 smithi170 ceph-mon[31212]: pgmap v10593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:00 smithi077 ceph-mon[27902]: pgmap v10593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:03.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19693.682438 secs 2024-04-21T15:53:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:02 smithi191 ceph-mon[31636]: pgmap v10594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-21T15:53:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19693.682438 secs 2024-04-21T15:53:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:02 smithi170 ceph-mon[31212]: pgmap v10594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-21T15:53:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19693.682438 secs 2024-04-21T15:53:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:02 smithi077 ceph-mon[27902]: pgmap v10594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-21T15:53:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19695.445324 secs 2024-04-21T15:53:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:04 smithi191 ceph-mon[31636]: pgmap v10595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-21T15:53:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:04 smithi191 ceph-mon[31636]: osdmap e734: 12 total, 12 up, 12 in 2024-04-21T15:53:05.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19695.445324 secs 2024-04-21T15:53:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:04 smithi170 ceph-mon[31212]: pgmap v10595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-21T15:53:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:04 smithi170 ceph-mon[31212]: osdmap e734: 12 total, 12 up, 12 in 2024-04-21T15:53:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19695.445324 secs 2024-04-21T15:53:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:04 smithi077 ceph-mon[27902]: pgmap v10595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-21T15:53:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:04 smithi077 ceph-mon[27902]: osdmap e734: 12 total, 12 up, 12 in 2024-04-21T15:53:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:06 smithi170 ceph-mon[31212]: pgmap v10597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:06 smithi077 ceph-mon[27902]: pgmap v10597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:06 smithi191 ceph-mon[31636]: pgmap v10597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:08.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19698.682559 secs 2024-04-21T15:53:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19698.682559 secs 2024-04-21T15:53:08.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19698.682559 secs 2024-04-21T15:53:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:08 smithi170 ceph-mon[31212]: pgmap v10598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:08 smithi077 ceph-mon[27902]: pgmap v10598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:08 smithi191 ceph-mon[31636]: pgmap v10598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19700.445446 secs 2024-04-21T15:53:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19700.445446 secs 2024-04-21T15:53:10.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19700.445446 secs 2024-04-21T15:53:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:10 smithi170 ceph-mon[31212]: pgmap v10599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:10 smithi170 ceph-mon[31212]: osdmap e735: 12 total, 12 up, 12 in 2024-04-21T15:53:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:10 smithi077 ceph-mon[27902]: pgmap v10599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:10 smithi077 ceph-mon[27902]: osdmap e735: 12 total, 12 up, 12 in 2024-04-21T15:53:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:10 smithi191 ceph-mon[31636]: pgmap v10599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:53:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:10 smithi191 ceph-mon[31636]: osdmap e735: 12 total, 12 up, 12 in 2024-04-21T15:53:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19703.682677 secs 2024-04-21T15:53:13.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:12 smithi170 ceph-mon[31212]: pgmap v10601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-04-21T15:53:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19703.682677 secs 2024-04-21T15:53:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:12 smithi077 ceph-mon[27902]: pgmap v10601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-04-21T15:53:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19703.682677 secs 2024-04-21T15:53:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:12 smithi191 ceph-mon[31636]: pgmap v10601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-04-21T15:53:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:15.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19705.445563 secs 2024-04-21T15:53:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:14 smithi170 ceph-mon[31212]: pgmap v10602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2024-04-21T15:53:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19705.445563 secs 2024-04-21T15:53:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:14 smithi077 ceph-mon[27902]: pgmap v10602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2024-04-21T15:53:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19705.445563 secs 2024-04-21T15:53:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:14 smithi191 ceph-mon[31636]: pgmap v10602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2024-04-21T15:53:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:16 smithi170 ceph-mon[31212]: pgmap v10603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:16 smithi077 ceph-mon[27902]: pgmap v10603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:17.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:16 smithi191 ceph-mon[31636]: pgmap v10603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19708.682829 secs 2024-04-21T15:53:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19708.682829 secs 2024-04-21T15:53:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19708.682829 secs 2024-04-21T15:53:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:19 smithi170 ceph-mon[31212]: pgmap v10604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:19 smithi077 ceph-mon[27902]: pgmap v10604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:19 smithi191 ceph-mon[31636]: pgmap v10604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19710.445657 secs 2024-04-21T15:53:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19710.445657 secs 2024-04-21T15:53:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19710.445657 secs 2024-04-21T15:53:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:21 smithi170 ceph-mon[31212]: pgmap v10605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:21 smithi077 ceph-mon[27902]: pgmap v10605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:21 smithi191 ceph-mon[31636]: pgmap v10605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:53:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19713.682945 secs 2024-04-21T15:53:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:23 smithi170 ceph-mon[31212]: pgmap v10606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:53:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19713.682945 secs 2024-04-21T15:53:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:23 smithi077 ceph-mon[27902]: pgmap v10606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:53:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19713.682945 secs 2024-04-21T15:53:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:23 smithi191 ceph-mon[31636]: pgmap v10606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:53:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19715.445773 secs 2024-04-21T15:53:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:25 smithi170 ceph-mon[31212]: pgmap v10607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19715.445773 secs 2024-04-21T15:53:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:25 smithi077 ceph-mon[27902]: pgmap v10607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19715.445773 secs 2024-04-21T15:53:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:25 smithi191 ceph-mon[31636]: pgmap v10607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:27.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:27 smithi170 ceph-mon[31212]: pgmap v10608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:27 smithi077 ceph-mon[27902]: pgmap v10608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:27.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:27 smithi191 ceph-mon[31636]: pgmap v10608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19718.683066 secs 2024-04-21T15:53:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19718.683066 secs 2024-04-21T15:53:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19718.683066 secs 2024-04-21T15:53:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:29 smithi170 ceph-mon[31212]: pgmap v10609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:29 smithi077 ceph-mon[27902]: pgmap v10609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:29 smithi191 ceph-mon[31636]: pgmap v10609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19720.445924 secs 2024-04-21T15:53:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19720.445924 secs 2024-04-21T15:53:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19720.445924 secs 2024-04-21T15:53:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:31 smithi170 ceph-mon[31212]: pgmap v10610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:31 smithi077 ceph-mon[27902]: pgmap v10610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:31 smithi191 ceph-mon[31636]: pgmap v10610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19723.683183 secs 2024-04-21T15:53:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:33 smithi170 ceph-mon[31212]: pgmap v10611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19723.683183 secs 2024-04-21T15:53:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:33 smithi077 ceph-mon[27902]: pgmap v10611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19723.683183 secs 2024-04-21T15:53:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:33 smithi191 ceph-mon[31636]: pgmap v10611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:35.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19725.446044 secs 2024-04-21T15:53:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:35 smithi170 ceph-mon[31212]: pgmap v10612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:53:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19725.446044 secs 2024-04-21T15:53:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:35 smithi077 ceph-mon[27902]: pgmap v10612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:53:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19725.446044 secs 2024-04-21T15:53:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:35 smithi191 ceph-mon[31636]: pgmap v10612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:53:36.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:53:36.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:53:36.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:53:36.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:53:36.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:53:36.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:53:36.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:53:36.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:53:36.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:53:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:37 smithi170 ceph-mon[31212]: pgmap v10613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:37 smithi077 ceph-mon[27902]: pgmap v10613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:37 smithi191 ceph-mon[31636]: pgmap v10613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19728.683306 secs 2024-04-21T15:53:38.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19728.683306 secs 2024-04-21T15:53:38.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19728.683306 secs 2024-04-21T15:53:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:39 smithi077 ceph-mon[27902]: pgmap v10614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:39.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:39 smithi191 ceph-mon[31636]: pgmap v10614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:39 smithi170 ceph-mon[31212]: pgmap v10614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19730.446166 secs 2024-04-21T15:53:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19730.446166 secs 2024-04-21T15:53:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19730.446166 secs 2024-04-21T15:53:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:41 smithi077 ceph-mon[27902]: pgmap v10615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:41 smithi191 ceph-mon[31636]: pgmap v10615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:41 smithi170 ceph-mon[31212]: pgmap v10615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19733.683430 secs 2024-04-21T15:53:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:43 smithi077 ceph-mon[27902]: pgmap v10616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19733.683430 secs 2024-04-21T15:53:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:43 smithi191 ceph-mon[31636]: pgmap v10616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19733.683430 secs 2024-04-21T15:53:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:43 smithi170 ceph-mon[31212]: pgmap v10616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19735.446247 secs 2024-04-21T15:53:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:45 smithi077 ceph-mon[27902]: pgmap v10617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19735.446247 secs 2024-04-21T15:53:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:45 smithi191 ceph-mon[31636]: pgmap v10617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19735.446247 secs 2024-04-21T15:53:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:45 smithi170 ceph-mon[31212]: pgmap v10617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:47 smithi077 ceph-mon[27902]: pgmap v10618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:47 smithi191 ceph-mon[31636]: pgmap v10618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:47 smithi170 ceph-mon[31212]: pgmap v10618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19738.683548 secs 2024-04-21T15:53:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19738.683548 secs 2024-04-21T15:53:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19738.683548 secs 2024-04-21T15:53:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:49 smithi077 ceph-mon[27902]: pgmap v10619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:49.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:49 smithi191 ceph-mon[31636]: pgmap v10619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:49 smithi170 ceph-mon[31212]: pgmap v10619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19740.446314 secs 2024-04-21T15:53:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19740.446314 secs 2024-04-21T15:53:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19740.446314 secs 2024-04-21T15:53:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:51 smithi077 ceph-mon[27902]: pgmap v10620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:51 smithi191 ceph-mon[31636]: pgmap v10620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:51 smithi170 ceph-mon[31212]: pgmap v10620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19743.683684 secs 2024-04-21T15:53:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:53 smithi077 ceph-mon[27902]: pgmap v10621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19743.683684 secs 2024-04-21T15:53:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:53 smithi191 ceph-mon[31636]: pgmap v10621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19743.683684 secs 2024-04-21T15:53:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:53 smithi170 ceph-mon[31212]: pgmap v10621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:53:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19745.446433 secs 2024-04-21T15:53:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:55 smithi077 ceph-mon[27902]: pgmap v10622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19745.446433 secs 2024-04-21T15:53:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:55 smithi191 ceph-mon[31636]: pgmap v10622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19745.446433 secs 2024-04-21T15:53:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:55 smithi170 ceph-mon[31212]: pgmap v10622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:57 smithi077 ceph-mon[27902]: pgmap v10623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:57.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:57 smithi191 ceph-mon[31636]: pgmap v10623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:57.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:57 smithi170 ceph-mon[31212]: pgmap v10623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:53:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19748.683785 secs 2024-04-21T15:53:58.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19748.683785 secs 2024-04-21T15:53:58.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19748.683785 secs 2024-04-21T15:53:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:53:59 smithi077 ceph-mon[27902]: pgmap v10624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:59.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:53:59 smithi191 ceph-mon[31636]: pgmap v10624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:53:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:53:59 smithi170 ceph-mon[31212]: pgmap v10624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19750.446558 secs 2024-04-21T15:54:00.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19750.446558 secs 2024-04-21T15:54:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19750.446558 secs 2024-04-21T15:54:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:01 smithi077 ceph-mon[27902]: pgmap v10625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:01.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:01 smithi191 ceph-mon[31636]: pgmap v10625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:01 smithi170 ceph-mon[31212]: pgmap v10625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19753.683916 secs 2024-04-21T15:54:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:03 smithi077 ceph-mon[27902]: pgmap v10626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19753.683916 secs 2024-04-21T15:54:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:03 smithi191 ceph-mon[31636]: pgmap v10626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19753.683916 secs 2024-04-21T15:54:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:03 smithi170 ceph-mon[31212]: pgmap v10626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19755.446675 secs 2024-04-21T15:54:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:05 smithi077 ceph-mon[27902]: pgmap v10627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:05 smithi077 ceph-mon[27902]: osdmap e736: 12 total, 12 up, 12 in 2024-04-21T15:54:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19755.446675 secs 2024-04-21T15:54:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:05 smithi191 ceph-mon[31636]: pgmap v10627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:05 smithi191 ceph-mon[31636]: osdmap e736: 12 total, 12 up, 12 in 2024-04-21T15:54:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19755.446675 secs 2024-04-21T15:54:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:05 smithi170 ceph-mon[31212]: pgmap v10627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:05 smithi170 ceph-mon[31212]: osdmap e736: 12 total, 12 up, 12 in 2024-04-21T15:54:06.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:06 smithi191 ceph-mon[31636]: pgmap v10629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:06.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:06 smithi170 ceph-mon[31212]: pgmap v10629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:06.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:06 smithi077 ceph-mon[27902]: pgmap v10629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:07.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19758.684022 secs 2024-04-21T15:54:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19758.684022 secs 2024-04-21T15:54:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19758.684022 secs 2024-04-21T15:54:08.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:08 smithi191 ceph-mon[31636]: pgmap v10630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:08.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:08 smithi077 ceph-mon[27902]: pgmap v10630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:08 smithi170 ceph-mon[31212]: pgmap v10630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:09.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19760.446772 secs 2024-04-21T15:54:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19760.446772 secs 2024-04-21T15:54:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19760.446772 secs 2024-04-21T15:54:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:10 smithi191 ceph-mon[31636]: pgmap v10631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:10 smithi170 ceph-mon[31212]: pgmap v10631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:10 smithi077 ceph-mon[27902]: pgmap v10631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:54:11.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:11 smithi077 ceph-mon[27902]: osdmap e737: 12 total, 12 up, 12 in 2024-04-21T15:54:11.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:11 smithi191 ceph-mon[31636]: osdmap e737: 12 total, 12 up, 12 in 2024-04-21T15:54:12.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:11 smithi170 ceph-mon[31212]: osdmap e737: 12 total, 12 up, 12 in 2024-04-21T15:54:12.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19763.684124 secs 2024-04-21T15:54:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:12 smithi077 ceph-mon[27902]: pgmap v10633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:54:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19763.684124 secs 2024-04-21T15:54:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:12 smithi191 ceph-mon[31636]: pgmap v10633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:54:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19763.684124 secs 2024-04-21T15:54:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:12 smithi170 ceph-mon[31212]: pgmap v10633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:54:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19765.446910 secs 2024-04-21T15:54:15.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:14 smithi191 ceph-mon[31636]: pgmap v10634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:54:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19765.446910 secs 2024-04-21T15:54:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:14 smithi170 ceph-mon[31212]: pgmap v10634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:54:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19765.446910 secs 2024-04-21T15:54:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:14 smithi077 ceph-mon[27902]: pgmap v10634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T15:54:17.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:16 smithi191 ceph-mon[31636]: pgmap v10635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:17.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:16 smithi170 ceph-mon[31212]: pgmap v10635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:16 smithi077 ceph-mon[27902]: pgmap v10635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19768.684238 secs 2024-04-21T15:54:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19768.684238 secs 2024-04-21T15:54:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19768.684238 secs 2024-04-21T15:54:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:18 smithi191 ceph-mon[31636]: pgmap v10636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:18 smithi170 ceph-mon[31212]: pgmap v10636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:18 smithi077 ceph-mon[27902]: pgmap v10636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19770.447059 secs 2024-04-21T15:54:20.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19770.447059 secs 2024-04-21T15:54:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19770.447059 secs 2024-04-21T15:54:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:20 smithi191 ceph-mon[31636]: pgmap v10637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:21.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:20 smithi170 ceph-mon[31212]: pgmap v10637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:20 smithi077 ceph-mon[27902]: pgmap v10637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:54:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19773.684368 secs 2024-04-21T15:54:23.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:22 smithi191 ceph-mon[31636]: pgmap v10638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:54:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19773.684368 secs 2024-04-21T15:54:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:22 smithi170 ceph-mon[31212]: pgmap v10638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:54:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19773.684368 secs 2024-04-21T15:54:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:22 smithi077 ceph-mon[27902]: pgmap v10638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:54:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19775.447149 secs 2024-04-21T15:54:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:24 smithi191 ceph-mon[31636]: pgmap v10639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19775.447149 secs 2024-04-21T15:54:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:24 smithi170 ceph-mon[31212]: pgmap v10639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19775.447149 secs 2024-04-21T15:54:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:24 smithi077 ceph-mon[27902]: pgmap v10639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:27.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:26 smithi191 ceph-mon[31636]: pgmap v10640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:26 smithi170 ceph-mon[31212]: pgmap v10640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:26 smithi077 ceph-mon[27902]: pgmap v10640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19778.684462 secs 2024-04-21T15:54:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19778.684462 secs 2024-04-21T15:54:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19778.684462 secs 2024-04-21T15:54:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:28 smithi170 ceph-mon[31212]: pgmap v10641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:28 smithi077 ceph-mon[27902]: pgmap v10641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:28 smithi191 ceph-mon[31636]: pgmap v10641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19780.447230 secs 2024-04-21T15:54:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19780.447230 secs 2024-04-21T15:54:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19780.447230 secs 2024-04-21T15:54:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:30 smithi170 ceph-mon[31212]: pgmap v10642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:30 smithi077 ceph-mon[27902]: pgmap v10642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:30 smithi191 ceph-mon[31636]: pgmap v10642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19783.684577 secs 2024-04-21T15:54:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:32 smithi170 ceph-mon[31212]: pgmap v10643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19783.684577 secs 2024-04-21T15:54:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:32 smithi077 ceph-mon[27902]: pgmap v10643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:33.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19783.684577 secs 2024-04-21T15:54:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:32 smithi191 ceph-mon[31636]: pgmap v10643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19785.447292 secs 2024-04-21T15:54:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:34 smithi170 ceph-mon[31212]: pgmap v10644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19785.447292 secs 2024-04-21T15:54:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:34 smithi077 ceph-mon[27902]: pgmap v10644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19785.447292 secs 2024-04-21T15:54:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:34 smithi191 ceph-mon[31636]: pgmap v10644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:36.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:54:36.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:54:36.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:54:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:36 smithi170 ceph-mon[31212]: pgmap v10645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:37.326 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:36 smithi077 ceph-mon[27902]: pgmap v10645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:36 smithi191 ceph-mon[31636]: pgmap v10645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19788.684731 secs 2024-04-21T15:54:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19788.684731 secs 2024-04-21T15:54:38.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19788.684731 secs 2024-04-21T15:54:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:39 smithi170 ceph-mon[31212]: pgmap v10646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:39.332 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:39 smithi077 ceph-mon[27902]: pgmap v10646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:39.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:39 smithi191 ceph-mon[31636]: pgmap v10646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19790.447401 secs 2024-04-21T15:54:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19790.447401 secs 2024-04-21T15:54:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19790.447401 secs 2024-04-21T15:54:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:41 smithi170 ceph-mon[31212]: pgmap v10647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:54:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:54:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:41 smithi077 ceph-mon[27902]: pgmap v10647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:54:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:54:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:41 smithi191 ceph-mon[31636]: pgmap v10647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:54:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:54:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:54:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19793.684851 secs 2024-04-21T15:54:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:43 smithi170 ceph-mon[31212]: pgmap v10648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19793.684851 secs 2024-04-21T15:54:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:43 smithi077 ceph-mon[27902]: pgmap v10648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19793.684851 secs 2024-04-21T15:54:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:43 smithi191 ceph-mon[31636]: pgmap v10648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:45.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19795.447522 secs 2024-04-21T15:54:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:45 smithi170 ceph-mon[31212]: pgmap v10649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19795.447522 secs 2024-04-21T15:54:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:45 smithi077 ceph-mon[27902]: pgmap v10649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19795.447522 secs 2024-04-21T15:54:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:45 smithi191 ceph-mon[31636]: pgmap v10649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:47 smithi170 ceph-mon[31212]: pgmap v10650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:47 smithi077 ceph-mon[27902]: pgmap v10650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:47 smithi191 ceph-mon[31636]: pgmap v10650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19798.684976 secs 2024-04-21T15:54:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19798.684976 secs 2024-04-21T15:54:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19798.684976 secs 2024-04-21T15:54:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:49 smithi077 ceph-mon[27902]: pgmap v10651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:49.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:49 smithi191 ceph-mon[31636]: pgmap v10651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:49 smithi170 ceph-mon[31212]: pgmap v10651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19800.447657 secs 2024-04-21T15:54:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19800.447657 secs 2024-04-21T15:54:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19800.447657 secs 2024-04-21T15:54:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:51 smithi077 ceph-mon[27902]: pgmap v10652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:51 smithi191 ceph-mon[31636]: pgmap v10652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:51 smithi170 ceph-mon[31212]: pgmap v10652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19803.685101 secs 2024-04-21T15:54:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:53 smithi077 ceph-mon[27902]: pgmap v10653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19803.685101 secs 2024-04-21T15:54:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:53 smithi191 ceph-mon[31636]: pgmap v10653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19803.685101 secs 2024-04-21T15:54:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:53 smithi170 ceph-mon[31212]: pgmap v10653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:54:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19805.447787 secs 2024-04-21T15:54:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:55 smithi077 ceph-mon[27902]: pgmap v10654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19805.447787 secs 2024-04-21T15:54:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:55 smithi191 ceph-mon[31636]: pgmap v10654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19805.447787 secs 2024-04-21T15:54:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:55 smithi170 ceph-mon[31212]: pgmap v10654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:57 smithi077 ceph-mon[27902]: pgmap v10655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:57.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:57 smithi191 ceph-mon[31636]: pgmap v10655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:57.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:57 smithi170 ceph-mon[31212]: pgmap v10655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:54:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19808.685229 secs 2024-04-21T15:54:58.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19808.685229 secs 2024-04-21T15:54:58.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19808.685229 secs 2024-04-21T15:54:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:54:59 smithi077 ceph-mon[27902]: pgmap v10656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:59.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:54:59 smithi191 ceph-mon[31636]: pgmap v10656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:54:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:54:59 smithi170 ceph-mon[31212]: pgmap v10656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 19995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19810.447918 secs 2024-04-21T15:55:00.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19810.447918 secs 2024-04-21T15:55:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19810.447918 secs 2024-04-21T15:55:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:01 smithi077 ceph-mon[27902]: pgmap v10657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:01 smithi191 ceph-mon[31636]: pgmap v10657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:01 smithi170 ceph-mon[31212]: pgmap v10657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19813.685345 secs 2024-04-21T15:55:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:03 smithi077 ceph-mon[27902]: pgmap v10658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19813.685345 secs 2024-04-21T15:55:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:03 smithi191 ceph-mon[31636]: pgmap v10658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19813.685345 secs 2024-04-21T15:55:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:03 smithi170 ceph-mon[31212]: pgmap v10658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19815.448033 secs 2024-04-21T15:55:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:05 smithi077 ceph-mon[27902]: pgmap v10659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:05 smithi077 ceph-mon[27902]: osdmap e738: 12 total, 12 up, 12 in 2024-04-21T15:55:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19815.448033 secs 2024-04-21T15:55:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:05 smithi191 ceph-mon[31636]: pgmap v10659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:05 smithi191 ceph-mon[31636]: osdmap e738: 12 total, 12 up, 12 in 2024-04-21T15:55:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19815.448033 secs 2024-04-21T15:55:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:05 smithi170 ceph-mon[31212]: pgmap v10659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:05 smithi170 ceph-mon[31212]: osdmap e738: 12 total, 12 up, 12 in 2024-04-21T15:55:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:07 smithi077 ceph-mon[27902]: pgmap v10661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:07 smithi191 ceph-mon[31636]: pgmap v10661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:07 smithi170 ceph-mon[31212]: pgmap v10661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:08.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19818.685474 secs 2024-04-21T15:55:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19818.685474 secs 2024-04-21T15:55:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19818.685474 secs 2024-04-21T15:55:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:09 smithi077 ceph-mon[27902]: pgmap v10662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:09 smithi191 ceph-mon[31636]: pgmap v10662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:09.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:09 smithi170 ceph-mon[31212]: pgmap v10662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19820.448153 secs 2024-04-21T15:55:10.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19820.448153 secs 2024-04-21T15:55:10.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19820.448153 secs 2024-04-21T15:55:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:11 smithi077 ceph-mon[27902]: pgmap v10663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:11 smithi077 ceph-mon[27902]: osdmap e739: 12 total, 12 up, 12 in 2024-04-21T15:55:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:11 smithi191 ceph-mon[31636]: pgmap v10663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:11 smithi191 ceph-mon[31636]: osdmap e739: 12 total, 12 up, 12 in 2024-04-21T15:55:11.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:11 smithi170 ceph-mon[31212]: pgmap v10663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:55:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:11 smithi170 ceph-mon[31212]: osdmap e739: 12 total, 12 up, 12 in 2024-04-21T15:55:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19823.685618 secs 2024-04-21T15:55:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:13 smithi077 ceph-mon[27902]: pgmap v10665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:55:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19823.685618 secs 2024-04-21T15:55:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:13 smithi191 ceph-mon[31636]: pgmap v10665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:55:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19823.685618 secs 2024-04-21T15:55:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:13 smithi170 ceph-mon[31212]: pgmap v10665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:55:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19825.448268 secs 2024-04-21T15:55:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:15 smithi077 ceph-mon[27902]: pgmap v10666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:55:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19825.448268 secs 2024-04-21T15:55:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:15 smithi191 ceph-mon[31636]: pgmap v10666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:55:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19825.448268 secs 2024-04-21T15:55:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:15 smithi170 ceph-mon[31212]: pgmap v10666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:55:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:17 smithi077 ceph-mon[27902]: pgmap v10667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:17 smithi191 ceph-mon[31636]: pgmap v10667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:17 smithi170 ceph-mon[31212]: pgmap v10667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19828.685782 secs 2024-04-21T15:55:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19828.685782 secs 2024-04-21T15:55:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19828.685782 secs 2024-04-21T15:55:19.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:19 smithi077 ceph-mon[27902]: pgmap v10668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:19.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:19 smithi191 ceph-mon[31636]: pgmap v10668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:19 smithi170 ceph-mon[31212]: pgmap v10668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19830.448402 secs 2024-04-21T15:55:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19830.448402 secs 2024-04-21T15:55:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19830.448402 secs 2024-04-21T15:55:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:21 smithi191 ceph-mon[31636]: pgmap v10669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:21 smithi170 ceph-mon[31212]: pgmap v10669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:21.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:21 smithi077 ceph-mon[27902]: pgmap v10669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:55:22.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:22 smithi191 ceph-mon[31636]: pgmap v10670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:55:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:22 smithi170 ceph-mon[31212]: pgmap v10670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:55:22.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:22 smithi077 ceph-mon[27902]: pgmap v10670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T15:55:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19833.685835 secs 2024-04-21T15:55:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19833.685835 secs 2024-04-21T15:55:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19833.685835 secs 2024-04-21T15:55:24.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19835.448536 secs 2024-04-21T15:55:24.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:24 smithi191 ceph-mon[31636]: pgmap v10671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:24.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19835.448536 secs 2024-04-21T15:55:24.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:24 smithi170 ceph-mon[31212]: pgmap v10671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:24.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19835.448536 secs 2024-04-21T15:55:24.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:24 smithi077 ceph-mon[27902]: pgmap v10671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:27.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:26 smithi191 ceph-mon[31636]: pgmap v10672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:26 smithi170 ceph-mon[31212]: pgmap v10672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:26 smithi077 ceph-mon[27902]: pgmap v10672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19838.685904 secs 2024-04-21T15:55:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19838.685904 secs 2024-04-21T15:55:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19838.685904 secs 2024-04-21T15:55:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:28 smithi170 ceph-mon[31212]: pgmap v10673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:28 smithi077 ceph-mon[27902]: pgmap v10673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:28 smithi191 ceph-mon[31636]: pgmap v10673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19840.448651 secs 2024-04-21T15:55:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19840.448651 secs 2024-04-21T15:55:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19840.448651 secs 2024-04-21T15:55:31.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:30 smithi170 ceph-mon[31212]: pgmap v10674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:30 smithi077 ceph-mon[27902]: pgmap v10674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:30 smithi191 ceph-mon[31636]: pgmap v10674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:55:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19843.685994 secs 2024-04-21T15:55:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:32 smithi170 ceph-mon[31212]: pgmap v10675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19843.685994 secs 2024-04-21T15:55:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:32 smithi077 ceph-mon[27902]: pgmap v10675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19843.685994 secs 2024-04-21T15:55:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:32 smithi191 ceph-mon[31636]: pgmap v10675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19845.448765 secs 2024-04-21T15:55:35.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:34 smithi170 ceph-mon[31212]: pgmap v10676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19845.448765 secs 2024-04-21T15:55:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:34 smithi077 ceph-mon[27902]: pgmap v10676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19845.448765 secs 2024-04-21T15:55:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:34 smithi191 ceph-mon[31636]: pgmap v10676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:36 smithi170 ceph-mon[31212]: pgmap v10677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:37.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:36 smithi077 ceph-mon[27902]: pgmap v10677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:36 smithi191 ceph-mon[31636]: pgmap v10677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:38.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19848.686109 secs 2024-04-21T15:55:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19848.686109 secs 2024-04-21T15:55:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19848.686109 secs 2024-04-21T15:55:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:39 smithi170 ceph-mon[31212]: pgmap v10678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:39 smithi077 ceph-mon[27902]: pgmap v10678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:39 smithi191 ceph-mon[31636]: pgmap v10678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19850.448882 secs 2024-04-21T15:55:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19850.448882 secs 2024-04-21T15:55:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19850.448882 secs 2024-04-21T15:55:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:41 smithi170 ceph-mon[31212]: pgmap v10679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:55:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:41 smithi077 ceph-mon[27902]: pgmap v10679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:55:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:41 smithi191 ceph-mon[31636]: pgmap v10679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:55:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19853.686176 secs 2024-04-21T15:55:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:43 smithi191 ceph-mon[31636]: pgmap v10680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19853.686176 secs 2024-04-21T15:55:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:43 smithi170 ceph-mon[31212]: pgmap v10680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19853.686176 secs 2024-04-21T15:55:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:43 smithi077 ceph-mon[27902]: pgmap v10680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19855.448949 secs 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: pgmap v10681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:55:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19855.448949 secs 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: pgmap v10681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:55:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19855.448949 secs 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: pgmap v10681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:55:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:55:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:47 smithi170 ceph-mon[31212]: pgmap v10682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:47 smithi077 ceph-mon[27902]: pgmap v10682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:47 smithi191 ceph-mon[31636]: pgmap v10682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19858.686295 secs 2024-04-21T15:55:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19858.686295 secs 2024-04-21T15:55:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19858.686295 secs 2024-04-21T15:55:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:49 smithi170 ceph-mon[31212]: pgmap v10683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:49 smithi077 ceph-mon[27902]: pgmap v10683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:49 smithi191 ceph-mon[31636]: pgmap v10683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19860.449069 secs 2024-04-21T15:55:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19860.449069 secs 2024-04-21T15:55:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19860.449069 secs 2024-04-21T15:55:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:51 smithi170 ceph-mon[31212]: pgmap v10684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:51 smithi077 ceph-mon[27902]: pgmap v10684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:51 smithi191 ceph-mon[31636]: pgmap v10684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19863.686411 secs 2024-04-21T15:55:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:53 smithi170 ceph-mon[31212]: pgmap v10685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19863.686411 secs 2024-04-21T15:55:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:53 smithi077 ceph-mon[27902]: pgmap v10685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19863.686411 secs 2024-04-21T15:55:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:53 smithi191 ceph-mon[31636]: pgmap v10685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:55:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19865.449193 secs 2024-04-21T15:55:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:55 smithi170 ceph-mon[31212]: pgmap v10686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19865.449193 secs 2024-04-21T15:55:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:55 smithi077 ceph-mon[27902]: pgmap v10686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19865.449193 secs 2024-04-21T15:55:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:55 smithi191 ceph-mon[31636]: pgmap v10686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:55:57.100+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:55:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:55:57.100+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:55:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:55:57.100+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:55:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:55:57.100+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:55:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:57 smithi170 ceph-mon[31212]: pgmap v10687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:57 smithi077 ceph-mon[27902]: pgmap v10687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:57.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:57 smithi191 ceph-mon[31636]: pgmap v10687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:55:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19868.686529 secs 2024-04-21T15:55:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19868.686529 secs 2024-04-21T15:55:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19868.686529 secs 2024-04-21T15:55:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:55:59 smithi170 ceph-mon[31212]: pgmap v10688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:55:59 smithi077 ceph-mon[27902]: pgmap v10688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:55:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:55:59 smithi191 ceph-mon[31636]: pgmap v10688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19870.449276 secs 2024-04-21T15:56:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19870.449276 secs 2024-04-21T15:56:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19870.449276 secs 2024-04-21T15:56:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:01 smithi077 ceph-mon[27902]: pgmap v10689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:01.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:01 smithi191 ceph-mon[31636]: pgmap v10689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:01 smithi170 ceph-mon[31212]: pgmap v10689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19873.686641 secs 2024-04-21T15:56:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:03 smithi077 ceph-mon[27902]: pgmap v10690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19873.686641 secs 2024-04-21T15:56:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:03 smithi191 ceph-mon[31636]: pgmap v10690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19873.686641 secs 2024-04-21T15:56:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:03 smithi170 ceph-mon[31212]: pgmap v10690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19875.449376 secs 2024-04-21T15:56:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:05 smithi077 ceph-mon[27902]: pgmap v10691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:05 smithi077 ceph-mon[27902]: osdmap e740: 12 total, 12 up, 12 in 2024-04-21T15:56:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19875.449376 secs 2024-04-21T15:56:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:05 smithi191 ceph-mon[31636]: pgmap v10691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:05 smithi191 ceph-mon[31636]: osdmap e740: 12 total, 12 up, 12 in 2024-04-21T15:56:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19875.449376 secs 2024-04-21T15:56:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:05 smithi170 ceph-mon[31212]: pgmap v10691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:05 smithi170 ceph-mon[31212]: osdmap e740: 12 total, 12 up, 12 in 2024-04-21T15:56:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:07 smithi077 ceph-mon[27902]: pgmap v10693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:07 smithi191 ceph-mon[31636]: pgmap v10693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:07 smithi170 ceph-mon[31212]: pgmap v10693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:08.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19878.686757 secs 2024-04-21T15:56:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19878.686757 secs 2024-04-21T15:56:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19878.686757 secs 2024-04-21T15:56:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:09 smithi170 ceph-mon[31212]: pgmap v10694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:09 smithi077 ceph-mon[27902]: pgmap v10694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:09 smithi191 ceph-mon[31636]: pgmap v10694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19880.449518 secs 2024-04-21T15:56:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19880.449518 secs 2024-04-21T15:56:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19880.449518 secs 2024-04-21T15:56:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:11 smithi077 ceph-mon[27902]: pgmap v10695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:11 smithi077 ceph-mon[27902]: osdmap e741: 12 total, 12 up, 12 in 2024-04-21T15:56:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:11 smithi191 ceph-mon[31636]: pgmap v10695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:11 smithi191 ceph-mon[31636]: osdmap e741: 12 total, 12 up, 12 in 2024-04-21T15:56:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:11 smithi170 ceph-mon[31212]: pgmap v10695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:56:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:11 smithi170 ceph-mon[31212]: osdmap e741: 12 total, 12 up, 12 in 2024-04-21T15:56:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19883.686870 secs 2024-04-21T15:56:13.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:13 smithi077 ceph-mon[27902]: pgmap v10697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:56:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19883.686870 secs 2024-04-21T15:56:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:13 smithi191 ceph-mon[31636]: pgmap v10697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:56:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19883.686870 secs 2024-04-21T15:56:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:13 smithi170 ceph-mon[31212]: pgmap v10697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:56:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19885.449635 secs 2024-04-21T15:56:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:15 smithi077 ceph-mon[27902]: pgmap v10698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:56:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19885.449635 secs 2024-04-21T15:56:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:15 smithi191 ceph-mon[31636]: pgmap v10698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:56:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19885.449635 secs 2024-04-21T15:56:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:15 smithi170 ceph-mon[31212]: pgmap v10698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:56:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:17 smithi077 ceph-mon[27902]: pgmap v10699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:17 smithi191 ceph-mon[31636]: pgmap v10699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:17 smithi170 ceph-mon[31212]: pgmap v10699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19888.686930 secs 2024-04-21T15:56:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19888.686930 secs 2024-04-21T15:56:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19888.686930 secs 2024-04-21T15:56:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:19 smithi077 ceph-mon[27902]: pgmap v10700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:19 smithi191 ceph-mon[31636]: pgmap v10700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:19 smithi170 ceph-mon[31212]: pgmap v10700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19890.449753 secs 2024-04-21T15:56:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19890.449753 secs 2024-04-21T15:56:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19890.449753 secs 2024-04-21T15:56:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:21 smithi077 ceph-mon[27902]: pgmap v10701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:21 smithi191 ceph-mon[31636]: pgmap v10701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:21 smithi170 ceph-mon[31212]: pgmap v10701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:56:23.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19893.687060 secs 2024-04-21T15:56:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:23 smithi077 ceph-mon[27902]: pgmap v10702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:56:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19893.687060 secs 2024-04-21T15:56:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:23 smithi191 ceph-mon[31636]: pgmap v10702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:56:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19893.687060 secs 2024-04-21T15:56:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:23 smithi170 ceph-mon[31212]: pgmap v10702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:56:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19895.449905 secs 2024-04-21T15:56:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:25 smithi077 ceph-mon[27902]: pgmap v10703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19895.449905 secs 2024-04-21T15:56:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:25 smithi191 ceph-mon[31636]: pgmap v10703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19895.449905 secs 2024-04-21T15:56:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:25 smithi170 ceph-mon[31212]: pgmap v10703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:27.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:27 smithi077 ceph-mon[27902]: pgmap v10704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:27 smithi191 ceph-mon[31636]: pgmap v10704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:27 smithi170 ceph-mon[31212]: pgmap v10704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:28.461 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19898.687111 secs 2024-04-21T15:56:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19898.687111 secs 2024-04-21T15:56:28.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19898.687111 secs 2024-04-21T15:56:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:29 smithi191 ceph-mon[31636]: pgmap v10705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:29 smithi170 ceph-mon[31212]: pgmap v10705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:29.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:29 smithi077 ceph-mon[27902]: pgmap v10705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19900.450020 secs 2024-04-21T15:56:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19900.450020 secs 2024-04-21T15:56:30.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19900.450020 secs 2024-04-21T15:56:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:31 smithi191 ceph-mon[31636]: pgmap v10706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:31 smithi170 ceph-mon[31212]: pgmap v10706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:31.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:31 smithi077 ceph-mon[27902]: pgmap v10706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:32.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:32 smithi191 ceph-mon[31636]: pgmap v10707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:32.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:32 smithi170 ceph-mon[31212]: pgmap v10707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:32.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:32 smithi077 ceph-mon[27902]: pgmap v10707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19903.687227 secs 2024-04-21T15:56:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19903.687227 secs 2024-04-21T15:56:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19903.687227 secs 2024-04-21T15:56:34.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19905.450130 secs 2024-04-21T15:56:34.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:34 smithi191 ceph-mon[31636]: pgmap v10708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:34.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19905.450130 secs 2024-04-21T15:56:34.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:34 smithi170 ceph-mon[31212]: pgmap v10708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:34.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19905.450130 secs 2024-04-21T15:56:34.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:34 smithi077 ceph-mon[27902]: pgmap v10708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:36 smithi170 ceph-mon[31212]: pgmap v10709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:36 smithi077 ceph-mon[27902]: pgmap v10709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:36 smithi191 ceph-mon[31636]: pgmap v10709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:38.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19908.687343 secs 2024-04-21T15:56:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19908.687343 secs 2024-04-21T15:56:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19908.687343 secs 2024-04-21T15:56:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:38 smithi170 ceph-mon[31212]: pgmap v10710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:38 smithi077 ceph-mon[27902]: pgmap v10710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:38 smithi191 ceph-mon[31636]: pgmap v10710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19910.450247 secs 2024-04-21T15:56:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19910.450247 secs 2024-04-21T15:56:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19910.450247 secs 2024-04-21T15:56:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:40 smithi170 ceph-mon[31212]: pgmap v10711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:40 smithi077 ceph-mon[27902]: pgmap v10711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:40 smithi191 ceph-mon[31636]: pgmap v10711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19913.687457 secs 2024-04-21T15:56:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:43 smithi170 ceph-mon[31212]: pgmap v10712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19913.687457 secs 2024-04-21T15:56:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:43 smithi077 ceph-mon[27902]: pgmap v10712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19913.687457 secs 2024-04-21T15:56:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:43 smithi191 ceph-mon[31636]: pgmap v10712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19915.450364 secs 2024-04-21T15:56:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:45 smithi170 ceph-mon[31212]: pgmap v10713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:56:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19915.450364 secs 2024-04-21T15:56:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:45 smithi077 ceph-mon[27902]: pgmap v10713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:56:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19915.450364 secs 2024-04-21T15:56:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:45 smithi191 ceph-mon[31636]: pgmap v10713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:56:46.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:56:46.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:56:46.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:56:46.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:56:46.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:56:46.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:56:46.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:56:46.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:56:46.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:56:47.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:47 smithi170 ceph-mon[31212]: pgmap v10714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:47 smithi077 ceph-mon[27902]: pgmap v10714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:47 smithi191 ceph-mon[31636]: pgmap v10714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19918.687558 secs 2024-04-21T15:56:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19918.687558 secs 2024-04-21T15:56:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19918.687558 secs 2024-04-21T15:56:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:49 smithi170 ceph-mon[31212]: pgmap v10715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:49 smithi077 ceph-mon[27902]: pgmap v10715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:49 smithi191 ceph-mon[31636]: pgmap v10715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19920.450436 secs 2024-04-21T15:56:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19920.450436 secs 2024-04-21T15:56:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19920.450436 secs 2024-04-21T15:56:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:51 smithi170 ceph-mon[31212]: pgmap v10716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:51 smithi077 ceph-mon[27902]: pgmap v10716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:51 smithi191 ceph-mon[31636]: pgmap v10716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19923.687669 secs 2024-04-21T15:56:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:53 smithi170 ceph-mon[31212]: pgmap v10717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19923.687669 secs 2024-04-21T15:56:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:53 smithi077 ceph-mon[27902]: pgmap v10717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19923.687669 secs 2024-04-21T15:56:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:53 smithi191 ceph-mon[31636]: pgmap v10717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:56:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19925.450567 secs 2024-04-21T15:56:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:55 smithi170 ceph-mon[31212]: pgmap v10718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19925.450567 secs 2024-04-21T15:56:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:55 smithi077 ceph-mon[27902]: pgmap v10718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19925.450567 secs 2024-04-21T15:56:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:55 smithi191 ceph-mon[31636]: pgmap v10718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:57 smithi170 ceph-mon[31212]: pgmap v10719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:57 smithi077 ceph-mon[27902]: pgmap v10719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:57 smithi191 ceph-mon[31636]: pgmap v10719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:56:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19928.687794 secs 2024-04-21T15:56:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19928.687794 secs 2024-04-21T15:56:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19928.687794 secs 2024-04-21T15:56:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:56:59 smithi170 ceph-mon[31212]: pgmap v10720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:56:59 smithi077 ceph-mon[27902]: pgmap v10720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:56:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:56:59 smithi191 ceph-mon[31636]: pgmap v10720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19930.450640 secs 2024-04-21T15:57:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19930.450640 secs 2024-04-21T15:57:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19930.450640 secs 2024-04-21T15:57:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:01 smithi170 ceph-mon[31212]: pgmap v10721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:01.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:01 smithi077 ceph-mon[27902]: pgmap v10721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:01 smithi191 ceph-mon[31636]: pgmap v10721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19933.687911 secs 2024-04-21T15:57:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:03 smithi170 ceph-mon[31212]: pgmap v10722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:03.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19933.687911 secs 2024-04-21T15:57:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:03 smithi077 ceph-mon[27902]: pgmap v10722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19933.687911 secs 2024-04-21T15:57:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:03 smithi191 ceph-mon[31636]: pgmap v10722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19935.450755 secs 2024-04-21T15:57:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:05 smithi077 ceph-mon[27902]: pgmap v10723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:05 smithi077 ceph-mon[27902]: osdmap e742: 12 total, 12 up, 12 in 2024-04-21T15:57:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19935.450755 secs 2024-04-21T15:57:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:05 smithi191 ceph-mon[31636]: pgmap v10723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:05 smithi191 ceph-mon[31636]: osdmap e742: 12 total, 12 up, 12 in 2024-04-21T15:57:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19935.450755 secs 2024-04-21T15:57:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:05 smithi170 ceph-mon[31212]: pgmap v10723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:05 smithi170 ceph-mon[31212]: osdmap e742: 12 total, 12 up, 12 in 2024-04-21T15:57:07.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:07 smithi077 ceph-mon[27902]: pgmap v10725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:07 smithi191 ceph-mon[31636]: pgmap v10725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:07 smithi170 ceph-mon[31212]: pgmap v10725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19938.688030 secs 2024-04-21T15:57:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19938.688030 secs 2024-04-21T15:57:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19938.688030 secs 2024-04-21T15:57:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:09 smithi077 ceph-mon[27902]: pgmap v10726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:09 smithi191 ceph-mon[31636]: pgmap v10726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:09 smithi170 ceph-mon[31212]: pgmap v10726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:10.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19940.450890 secs 2024-04-21T15:57:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19940.450890 secs 2024-04-21T15:57:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19940.450890 secs 2024-04-21T15:57:11.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:11 smithi077 ceph-mon[27902]: pgmap v10727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:11 smithi077 ceph-mon[27902]: osdmap e743: 12 total, 12 up, 12 in 2024-04-21T15:57:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:11 smithi191 ceph-mon[31636]: pgmap v10727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:11 smithi191 ceph-mon[31636]: osdmap e743: 12 total, 12 up, 12 in 2024-04-21T15:57:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:11 smithi170 ceph-mon[31212]: pgmap v10727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:57:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:11 smithi170 ceph-mon[31212]: osdmap e743: 12 total, 12 up, 12 in 2024-04-21T15:57:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19943.688152 secs 2024-04-21T15:57:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:13 smithi077 ceph-mon[27902]: pgmap v10729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:57:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19943.688152 secs 2024-04-21T15:57:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:13 smithi191 ceph-mon[31636]: pgmap v10729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:57:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19943.688152 secs 2024-04-21T15:57:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:13 smithi170 ceph-mon[31212]: pgmap v10729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:57:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:15.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19945.451004 secs 2024-04-21T15:57:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:15 smithi077 ceph-mon[27902]: pgmap v10730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:57:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19945.451004 secs 2024-04-21T15:57:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:15 smithi191 ceph-mon[31636]: pgmap v10730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:57:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19945.451004 secs 2024-04-21T15:57:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:15 smithi170 ceph-mon[31212]: pgmap v10730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:57:17.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:17 smithi077 ceph-mon[27902]: pgmap v10731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:17 smithi191 ceph-mon[31636]: pgmap v10731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:17 smithi170 ceph-mon[31212]: pgmap v10731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19948.688270 secs 2024-04-21T15:57:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19948.688270 secs 2024-04-21T15:57:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19948.688270 secs 2024-04-21T15:57:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:19 smithi077 ceph-mon[27902]: pgmap v10732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:19 smithi191 ceph-mon[31636]: pgmap v10732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:19 smithi170 ceph-mon[31212]: pgmap v10732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19950.451146 secs 2024-04-21T15:57:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19950.451146 secs 2024-04-21T15:57:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19950.451146 secs 2024-04-21T15:57:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:21 smithi077 ceph-mon[27902]: pgmap v10733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:21 smithi191 ceph-mon[31636]: pgmap v10733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:21 smithi170 ceph-mon[31212]: pgmap v10733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:57:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19953.688389 secs 2024-04-21T15:57:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:23 smithi077 ceph-mon[27902]: pgmap v10734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:57:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19953.688389 secs 2024-04-21T15:57:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:23 smithi191 ceph-mon[31636]: pgmap v10734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:57:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19953.688389 secs 2024-04-21T15:57:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:23 smithi170 ceph-mon[31212]: pgmap v10734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:57:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19955.451269 secs 2024-04-21T15:57:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:25 smithi077 ceph-mon[27902]: pgmap v10735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19955.451269 secs 2024-04-21T15:57:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:25 smithi191 ceph-mon[31636]: pgmap v10735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19955.451269 secs 2024-04-21T15:57:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:25 smithi170 ceph-mon[31212]: pgmap v10735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:27 smithi077 ceph-mon[27902]: pgmap v10736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:27 smithi191 ceph-mon[31636]: pgmap v10736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:27 smithi170 ceph-mon[31212]: pgmap v10736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19958.688498 secs 2024-04-21T15:57:28.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19958.688498 secs 2024-04-21T15:57:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19958.688498 secs 2024-04-21T15:57:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:29 smithi077 ceph-mon[27902]: pgmap v10737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:29 smithi191 ceph-mon[31636]: pgmap v10737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:29 smithi170 ceph-mon[31212]: pgmap v10737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19960.451345 secs 2024-04-21T15:57:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19960.451345 secs 2024-04-21T15:57:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19960.451345 secs 2024-04-21T15:57:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:31 smithi191 ceph-mon[31636]: pgmap v10738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:31 smithi170 ceph-mon[31212]: pgmap v10738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:31.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:31 smithi077 ceph-mon[27902]: pgmap v10738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19963.688617 secs 2024-04-21T15:57:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:33 smithi191 ceph-mon[31636]: pgmap v10739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19963.688617 secs 2024-04-21T15:57:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:33 smithi170 ceph-mon[31212]: pgmap v10739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19963.688617 secs 2024-04-21T15:57:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:33 smithi077 ceph-mon[27902]: pgmap v10739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19965.451464 secs 2024-04-21T15:57:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:35 smithi191 ceph-mon[31636]: pgmap v10740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19965.451464 secs 2024-04-21T15:57:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:35 smithi170 ceph-mon[31212]: pgmap v10740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19965.451464 secs 2024-04-21T15:57:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:35 smithi077 ceph-mon[27902]: pgmap v10740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:37 smithi191 ceph-mon[31636]: pgmap v10741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:37 smithi170 ceph-mon[31212]: pgmap v10741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:37.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:37 smithi077 ceph-mon[27902]: pgmap v10741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19968.688732 secs 2024-04-21T15:57:38.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19968.688732 secs 2024-04-21T15:57:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19968.688732 secs 2024-04-21T15:57:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:39 smithi191 ceph-mon[31636]: pgmap v10742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:39 smithi170 ceph-mon[31212]: pgmap v10742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:39 smithi077 ceph-mon[27902]: pgmap v10742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19970.451579 secs 2024-04-21T15:57:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19970.451579 secs 2024-04-21T15:57:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19970.451579 secs 2024-04-21T15:57:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:41 smithi191 ceph-mon[31636]: pgmap v10743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:41 smithi170 ceph-mon[31212]: pgmap v10743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:41 smithi077 ceph-mon[27902]: pgmap v10743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:42.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:42 smithi191 ceph-mon[31636]: pgmap v10744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:42.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:42 smithi170 ceph-mon[31212]: pgmap v10744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:42.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:42 smithi077 ceph-mon[27902]: pgmap v10744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19973.688856 secs 2024-04-21T15:57:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19973.688856 secs 2024-04-21T15:57:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19973.688856 secs 2024-04-21T15:57:44.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19975.451714 secs 2024-04-21T15:57:44.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:44 smithi191 ceph-mon[31636]: pgmap v10745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:44.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19975.451714 secs 2024-04-21T15:57:44.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:44 smithi170 ceph-mon[31212]: pgmap v10745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:44.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19975.451714 secs 2024-04-21T15:57:44.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:44 smithi077 ceph-mon[27902]: pgmap v10745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:46.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:57:46.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:57:46.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:57:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:46 smithi170 ceph-mon[31212]: pgmap v10746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:57:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:57:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:57:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:46 smithi077 ceph-mon[27902]: pgmap v10746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:57:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:57:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:57:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:46 smithi191 ceph-mon[31636]: pgmap v10746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:57:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:57:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:57:48.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19978.688938 secs 2024-04-21T15:57:48.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19978.688938 secs 2024-04-21T15:57:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19978.688938 secs 2024-04-21T15:57:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:48 smithi170 ceph-mon[31212]: pgmap v10747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:48 smithi077 ceph-mon[27902]: pgmap v10747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:48 smithi191 ceph-mon[31636]: pgmap v10747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19980.451847 secs 2024-04-21T15:57:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19980.451847 secs 2024-04-21T15:57:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19980.451847 secs 2024-04-21T15:57:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:50 smithi170 ceph-mon[31212]: pgmap v10748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:50 smithi077 ceph-mon[27902]: pgmap v10748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:50 smithi191 ceph-mon[31636]: pgmap v10748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19983.689059 secs 2024-04-21T15:57:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:53 smithi170 ceph-mon[31212]: pgmap v10749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19983.689059 secs 2024-04-21T15:57:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:53 smithi077 ceph-mon[27902]: pgmap v10749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19983.689059 secs 2024-04-21T15:57:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:53 smithi191 ceph-mon[31636]: pgmap v10749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:57:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19985.451967 secs 2024-04-21T15:57:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:55 smithi170 ceph-mon[31212]: pgmap v10750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19985.451967 secs 2024-04-21T15:57:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:55 smithi077 ceph-mon[27902]: pgmap v10750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19985.451967 secs 2024-04-21T15:57:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:55 smithi191 ceph-mon[31636]: pgmap v10750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:57.275 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:57 smithi191 ceph-mon[31636]: pgmap v10751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:57.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:57 smithi170 ceph-mon[31212]: pgmap v10751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:57 smithi077 ceph-mon[27902]: pgmap v10751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:57:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19988.689173 secs 2024-04-21T15:57:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19988.689173 secs 2024-04-21T15:57:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19988.689173 secs 2024-04-21T15:57:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:57:59 smithi170 ceph-mon[31212]: pgmap v10752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:57:59 smithi077 ceph-mon[27902]: pgmap v10752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:57:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:57:59 smithi191 ceph-mon[31636]: pgmap v10752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19990.452082 secs 2024-04-21T15:58:00.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19990.452082 secs 2024-04-21T15:58:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19990.452082 secs 2024-04-21T15:58:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:01 smithi170 ceph-mon[31212]: pgmap v10753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:01.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:01 smithi077 ceph-mon[27902]: pgmap v10753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:01 smithi191 ceph-mon[31636]: pgmap v10753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19993.689237 secs 2024-04-21T15:58:03.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:03 smithi170 ceph-mon[31212]: pgmap v10754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19993.689237 secs 2024-04-21T15:58:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:03 smithi077 ceph-mon[27902]: pgmap v10754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19993.689237 secs 2024-04-21T15:58:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:03 smithi191 ceph-mon[31636]: pgmap v10754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 19995.452200 secs 2024-04-21T15:58:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:05 smithi170 ceph-mon[31212]: pgmap v10755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:05 smithi170 ceph-mon[31212]: osdmap e744: 12 total, 12 up, 12 in 2024-04-21T15:58:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 19995.452200 secs 2024-04-21T15:58:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:05 smithi077 ceph-mon[27902]: pgmap v10755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:05 smithi077 ceph-mon[27902]: osdmap e744: 12 total, 12 up, 12 in 2024-04-21T15:58:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 19995.452200 secs 2024-04-21T15:58:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:05 smithi191 ceph-mon[31636]: pgmap v10755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:05 smithi191 ceph-mon[31636]: osdmap e744: 12 total, 12 up, 12 in 2024-04-21T15:58:07.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:07 smithi170 ceph-mon[31212]: pgmap v10757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:07.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:07 smithi077 ceph-mon[27902]: pgmap v10757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:07 smithi191 ceph-mon[31636]: pgmap v10757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 19998.689342 secs 2024-04-21T15:58:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 19998.689342 secs 2024-04-21T15:58:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 19998.689342 secs 2024-04-21T15:58:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:09 smithi170 ceph-mon[31212]: pgmap v10758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:09 smithi077 ceph-mon[27902]: pgmap v10758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:09 smithi191 ceph-mon[31636]: pgmap v10758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20000.452345 secs 2024-04-21T15:58:10.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20000.452345 secs 2024-04-21T15:58:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20000.452345 secs 2024-04-21T15:58:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:11 smithi077 ceph-mon[27902]: pgmap v10759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:11 smithi077 ceph-mon[27902]: osdmap e745: 12 total, 12 up, 12 in 2024-04-21T15:58:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:11 smithi191 ceph-mon[31636]: pgmap v10759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:11 smithi191 ceph-mon[31636]: osdmap e745: 12 total, 12 up, 12 in 2024-04-21T15:58:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:11 smithi170 ceph-mon[31212]: pgmap v10759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:58:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:11 smithi170 ceph-mon[31212]: osdmap e745: 12 total, 12 up, 12 in 2024-04-21T15:58:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20003.689462 secs 2024-04-21T15:58:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:13 smithi077 ceph-mon[27902]: pgmap v10761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:58:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20003.689462 secs 2024-04-21T15:58:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:13 smithi191 ceph-mon[31636]: pgmap v10761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:58:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20003.689462 secs 2024-04-21T15:58:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:13 smithi170 ceph-mon[31212]: pgmap v10761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T15:58:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20005.452478 secs 2024-04-21T15:58:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:15 smithi077 ceph-mon[27902]: pgmap v10762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:58:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20005.452478 secs 2024-04-21T15:58:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:15 smithi191 ceph-mon[31636]: pgmap v10762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:58:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20005.452478 secs 2024-04-21T15:58:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:15 smithi170 ceph-mon[31212]: pgmap v10762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T15:58:17.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:17 smithi077 ceph-mon[27902]: pgmap v10763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:17 smithi191 ceph-mon[31636]: pgmap v10763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:17 smithi170 ceph-mon[31212]: pgmap v10763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20008.689577 secs 2024-04-21T15:58:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20008.689577 secs 2024-04-21T15:58:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20008.689577 secs 2024-04-21T15:58:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:19 smithi077 ceph-mon[27902]: pgmap v10764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:19 smithi191 ceph-mon[31636]: pgmap v10764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:19 smithi170 ceph-mon[31212]: pgmap v10764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20010.452611 secs 2024-04-21T15:58:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20010.452611 secs 2024-04-21T15:58:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20010.452611 secs 2024-04-21T15:58:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:21 smithi077 ceph-mon[27902]: pgmap v10765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:21 smithi191 ceph-mon[31636]: pgmap v10765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:21 smithi170 ceph-mon[31212]: pgmap v10765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:58:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20013.689711 secs 2024-04-21T15:58:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:23 smithi077 ceph-mon[27902]: pgmap v10766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:58:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20013.689711 secs 2024-04-21T15:58:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:23 smithi191 ceph-mon[31636]: pgmap v10766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:58:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20013.689711 secs 2024-04-21T15:58:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:23 smithi170 ceph-mon[31212]: pgmap v10766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:58:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20015.452732 secs 2024-04-21T15:58:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:25 smithi077 ceph-mon[27902]: pgmap v10767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20015.452732 secs 2024-04-21T15:58:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:25 smithi191 ceph-mon[31636]: pgmap v10767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20015.452732 secs 2024-04-21T15:58:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:25 smithi170 ceph-mon[31212]: pgmap v10767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:27 smithi077 ceph-mon[27902]: pgmap v10768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:27 smithi191 ceph-mon[31636]: pgmap v10768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:27 smithi170 ceph-mon[31212]: pgmap v10768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20018.689848 secs 2024-04-21T15:58:28.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20018.689848 secs 2024-04-21T15:58:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20018.689848 secs 2024-04-21T15:58:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:29 smithi077 ceph-mon[27902]: pgmap v10769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:29 smithi191 ceph-mon[31636]: pgmap v10769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:29 smithi170 ceph-mon[31212]: pgmap v10769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20020.452844 secs 2024-04-21T15:58:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20020.452844 secs 2024-04-21T15:58:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20020.452844 secs 2024-04-21T15:58:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:31 smithi077 ceph-mon[27902]: pgmap v10770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:31 smithi191 ceph-mon[31636]: pgmap v10770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:31 smithi170 ceph-mon[31212]: pgmap v10770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20023.689966 secs 2024-04-21T15:58:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:33 smithi077 ceph-mon[27902]: pgmap v10771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20023.689966 secs 2024-04-21T15:58:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:33 smithi191 ceph-mon[31636]: pgmap v10771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20023.689966 secs 2024-04-21T15:58:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:33 smithi170 ceph-mon[31212]: pgmap v10771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20025.452947 secs 2024-04-21T15:58:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:35 smithi077 ceph-mon[27902]: pgmap v10772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20025.452947 secs 2024-04-21T15:58:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:35 smithi191 ceph-mon[31636]: pgmap v10772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20025.452947 secs 2024-04-21T15:58:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:35 smithi170 ceph-mon[31212]: pgmap v10772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:37 smithi077 ceph-mon[27902]: pgmap v10773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:37 smithi191 ceph-mon[31636]: pgmap v10773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:37 smithi170 ceph-mon[31212]: pgmap v10773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20028.690034 secs 2024-04-21T15:58:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20028.690034 secs 2024-04-21T15:58:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20028.690034 secs 2024-04-21T15:58:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:39 smithi077 ceph-mon[27902]: pgmap v10774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:39 smithi191 ceph-mon[31636]: pgmap v10774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:39 smithi170 ceph-mon[31212]: pgmap v10774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20030.453063 secs 2024-04-21T15:58:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20030.453063 secs 2024-04-21T15:58:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20030.453063 secs 2024-04-21T15:58:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:41 smithi077 ceph-mon[27902]: pgmap v10775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:41 smithi191 ceph-mon[31636]: pgmap v10775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:41 smithi170 ceph-mon[31212]: pgmap v10775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20033.690144 secs 2024-04-21T15:58:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:43 smithi077 ceph-mon[27902]: pgmap v10776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20033.690144 secs 2024-04-21T15:58:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:43 smithi191 ceph-mon[31636]: pgmap v10776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20033.690144 secs 2024-04-21T15:58:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:43 smithi170 ceph-mon[31212]: pgmap v10776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20035.453191 secs 2024-04-21T15:58:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:45 smithi077 ceph-mon[27902]: pgmap v10777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20035.453191 secs 2024-04-21T15:58:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:45 smithi191 ceph-mon[31636]: pgmap v10777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20035.453191 secs 2024-04-21T15:58:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:45 smithi170 ceph-mon[31212]: pgmap v10777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:47 smithi191 ceph-mon[31636]: pgmap v10778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:58:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:47 smithi170 ceph-mon[31212]: pgmap v10778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:58:47.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:47 smithi077 ceph-mon[27902]: pgmap v10778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:47.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:58:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20038.690243 secs 2024-04-21T15:58:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20038.690243 secs 2024-04-21T15:58:48.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20038.690243 secs 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: pgmap v10779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: pgmap v10779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: pgmap v10779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20040.453268 secs 2024-04-21T15:58:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:58:50.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:58:50.478 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20040.453268 secs 2024-04-21T15:58:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20040.453268 secs 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:58:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:58:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:51 smithi191 ceph-mon[31636]: pgmap v10780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:58:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:58:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:58:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:58:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:58:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:58:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:51 smithi170 ceph-mon[31212]: pgmap v10780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T15:58:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:51 smithi077 ceph-mon[27902]: pgmap v10780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20043.690354 secs 2024-04-21T15:58:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:53 smithi191 ceph-mon[31636]: pgmap v10781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20043.690354 secs 2024-04-21T15:58:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:53 smithi170 ceph-mon[31212]: pgmap v10781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20043.690354 secs 2024-04-21T15:58:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:53 smithi077 ceph-mon[27902]: pgmap v10781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.439+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T15:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.439+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T15:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.439+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.440+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T15:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.440+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.441+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T15:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.441+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T15:58:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bd0 tx=0x7efd70062000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bd0 tx=0x7efd70062000 comp rx=0 tx=0).stop 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.467+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T15:58:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:54.468+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7001f000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T15:58:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:58:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20045.453380 secs 2024-04-21T15:58:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:55 smithi191 ceph-mon[31636]: pgmap v10782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20045.453380 secs 2024-04-21T15:58:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:55 smithi170 ceph-mon[31212]: pgmap v10782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20045.453380 secs 2024-04-21T15:58:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:55 smithi077 ceph-mon[27902]: pgmap v10782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T15:58:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:58:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:58:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T15:58:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:58:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T15:58:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:58:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T15:58:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T15:58:57.126+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T15:58:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:57 smithi191 ceph-mon[31636]: pgmap v10783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:57 smithi170 ceph-mon[31212]: pgmap v10783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:57 smithi077 ceph-mon[27902]: pgmap v10783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:58:58.461 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20048.690475 secs 2024-04-21T15:58:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20048.690475 secs 2024-04-21T15:58:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20048.690475 secs 2024-04-21T15:58:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:58:59 smithi191 ceph-mon[31636]: pgmap v10784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:58:59 smithi170 ceph-mon[31212]: pgmap v10784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:58:59.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:58:59 smithi077 ceph-mon[27902]: pgmap v10784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20050.453477 secs 2024-04-21T15:59:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20050.453477 secs 2024-04-21T15:59:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20050.453477 secs 2024-04-21T15:59:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:01 smithi191 ceph-mon[31636]: pgmap v10785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:01 smithi170 ceph-mon[31212]: pgmap v10785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:01 smithi077 ceph-mon[27902]: pgmap v10785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:02.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:02 smithi191 ceph-mon[31636]: pgmap v10786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:59:02.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:02 smithi170 ceph-mon[31212]: pgmap v10786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:59:02.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:02 smithi077 ceph-mon[27902]: pgmap v10786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-04-21T15:59:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20053.690589 secs 2024-04-21T15:59:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20053.690589 secs 2024-04-21T15:59:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20053.690589 secs 2024-04-21T15:59:04.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20055.453608 secs 2024-04-21T15:59:04.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:04 smithi191 ceph-mon[31636]: pgmap v10787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T15:59:04.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20055.453608 secs 2024-04-21T15:59:04.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:04 smithi170 ceph-mon[31212]: pgmap v10787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T15:59:04.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20055.453608 secs 2024-04-21T15:59:04.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:04 smithi077 ceph-mon[27902]: pgmap v10787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T15:59:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:05 smithi191 ceph-mon[31636]: osdmap e746: 12 total, 12 up, 12 in 2024-04-21T15:59:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:05 smithi170 ceph-mon[31212]: osdmap e746: 12 total, 12 up, 12 in 2024-04-21T15:59:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:05 smithi077 ceph-mon[27902]: osdmap e746: 12 total, 12 up, 12 in 2024-04-21T15:59:06.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:06 smithi191 ceph-mon[31636]: pgmap v10789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:06.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:06 smithi170 ceph-mon[31212]: pgmap v10789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:06.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:06 smithi077 ceph-mon[27902]: pgmap v10789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20058.690706 secs 2024-04-21T15:59:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20058.690706 secs 2024-04-21T15:59:07.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20058.690706 secs 2024-04-21T15:59:08.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:08 smithi077 ceph-mon[27902]: pgmap v10790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:08 smithi170 ceph-mon[31212]: pgmap v10790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:08 smithi191 ceph-mon[31636]: pgmap v10790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20060.453729 secs 2024-04-21T15:59:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20060.453729 secs 2024-04-21T15:59:09.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20060.453729 secs 2024-04-21T15:59:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:10 smithi170 ceph-mon[31212]: pgmap v10791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:10 smithi077 ceph-mon[27902]: pgmap v10791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:10 smithi191 ceph-mon[31636]: pgmap v10791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T15:59:11.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:11 smithi191 ceph-mon[31636]: osdmap e747: 12 total, 12 up, 12 in 2024-04-21T15:59:12.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:11 smithi170 ceph-mon[31212]: osdmap e747: 12 total, 12 up, 12 in 2024-04-21T15:59:12.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:11 smithi077 ceph-mon[27902]: osdmap e747: 12 total, 12 up, 12 in 2024-04-21T15:59:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20063.690855 secs 2024-04-21T15:59:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:12 smithi191 ceph-mon[31636]: pgmap v10793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-04-21T15:59:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20063.690855 secs 2024-04-21T15:59:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:12 smithi170 ceph-mon[31212]: pgmap v10793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-04-21T15:59:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20063.690855 secs 2024-04-21T15:59:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:12 smithi077 ceph-mon[27902]: pgmap v10793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-04-21T15:59:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20065.453876 secs 2024-04-21T15:59:15.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:15 smithi170 ceph-mon[31212]: pgmap v10794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 20 KiB/s wr, 7 op/s 2024-04-21T15:59:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20065.453876 secs 2024-04-21T15:59:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:15 smithi077 ceph-mon[27902]: pgmap v10794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 20 KiB/s wr, 7 op/s 2024-04-21T15:59:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20065.453876 secs 2024-04-21T15:59:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:15 smithi191 ceph-mon[31636]: pgmap v10794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 20 KiB/s wr, 7 op/s 2024-04-21T15:59:17.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:17 smithi170 ceph-mon[31212]: pgmap v10795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:17.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:17 smithi077 ceph-mon[27902]: pgmap v10795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:17 smithi191 ceph-mon[31636]: pgmap v10795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20068.690988 secs 2024-04-21T15:59:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20068.690988 secs 2024-04-21T15:59:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20068.690988 secs 2024-04-21T15:59:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:19 smithi170 ceph-mon[31212]: pgmap v10796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:19 smithi077 ceph-mon[27902]: pgmap v10796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:19 smithi191 ceph-mon[31636]: pgmap v10796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20070.453979 secs 2024-04-21T15:59:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20070.453979 secs 2024-04-21T15:59:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20070.453979 secs 2024-04-21T15:59:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:21 smithi170 ceph-mon[31212]: pgmap v10797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:21 smithi077 ceph-mon[27902]: pgmap v10797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:21 smithi191 ceph-mon[31636]: pgmap v10797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T15:59:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20073.691101 secs 2024-04-21T15:59:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:23 smithi170 ceph-mon[31212]: pgmap v10798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:59:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20073.691101 secs 2024-04-21T15:59:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:23 smithi077 ceph-mon[27902]: pgmap v10798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:59:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20073.691101 secs 2024-04-21T15:59:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:23 smithi191 ceph-mon[31636]: pgmap v10798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T15:59:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20075.454088 secs 2024-04-21T15:59:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:25 smithi170 ceph-mon[31212]: pgmap v10799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20075.454088 secs 2024-04-21T15:59:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:25 smithi077 ceph-mon[27902]: pgmap v10799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20075.454088 secs 2024-04-21T15:59:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:25 smithi191 ceph-mon[31636]: pgmap v10799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:27 smithi170 ceph-mon[31212]: pgmap v10800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:27 smithi077 ceph-mon[27902]: pgmap v10800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:27 smithi191 ceph-mon[31636]: pgmap v10800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20078.691221 secs 2024-04-21T15:59:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20078.691221 secs 2024-04-21T15:59:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20078.691221 secs 2024-04-21T15:59:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:29 smithi077 ceph-mon[27902]: pgmap v10801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:29 smithi191 ceph-mon[31636]: pgmap v10801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:29 smithi170 ceph-mon[31212]: pgmap v10801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20080.454152 secs 2024-04-21T15:59:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20080.454152 secs 2024-04-21T15:59:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20080.454152 secs 2024-04-21T15:59:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:31 smithi077 ceph-mon[27902]: pgmap v10802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:31 smithi191 ceph-mon[31636]: pgmap v10802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:31 smithi170 ceph-mon[31212]: pgmap v10802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20083.691335 secs 2024-04-21T15:59:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:33 smithi077 ceph-mon[27902]: pgmap v10803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20083.691335 secs 2024-04-21T15:59:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:33 smithi191 ceph-mon[31636]: pgmap v10803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20083.691335 secs 2024-04-21T15:59:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:33 smithi170 ceph-mon[31212]: pgmap v10803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20085.454299 secs 2024-04-21T15:59:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:35 smithi077 ceph-mon[27902]: pgmap v10804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20085.454299 secs 2024-04-21T15:59:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:35 smithi191 ceph-mon[31636]: pgmap v10804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20085.454299 secs 2024-04-21T15:59:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:35 smithi170 ceph-mon[31212]: pgmap v10804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:37 smithi077 ceph-mon[27902]: pgmap v10805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:37 smithi191 ceph-mon[31636]: pgmap v10805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:37 smithi170 ceph-mon[31212]: pgmap v10805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20088.691460 secs 2024-04-21T15:59:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20088.691460 secs 2024-04-21T15:59:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20088.691460 secs 2024-04-21T15:59:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:39 smithi077 ceph-mon[27902]: pgmap v10806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:39 smithi191 ceph-mon[31636]: pgmap v10806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:39 smithi170 ceph-mon[31212]: pgmap v10806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20090.454413 secs 2024-04-21T15:59:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20090.454413 secs 2024-04-21T15:59:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20090.454413 secs 2024-04-21T15:59:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:41 smithi077 ceph-mon[27902]: pgmap v10807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:41 smithi191 ceph-mon[31636]: pgmap v10807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:41 smithi170 ceph-mon[31212]: pgmap v10807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20093.691568 secs 2024-04-21T15:59:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:43 smithi077 ceph-mon[27902]: pgmap v10808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20093.691568 secs 2024-04-21T15:59:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:43 smithi191 ceph-mon[31636]: pgmap v10808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20093.691568 secs 2024-04-21T15:59:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:43 smithi170 ceph-mon[31212]: pgmap v10808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20095.454548 secs 2024-04-21T15:59:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:45 smithi077 ceph-mon[27902]: pgmap v10809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20095.454548 secs 2024-04-21T15:59:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:45 smithi191 ceph-mon[31636]: pgmap v10809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20095.454548 secs 2024-04-21T15:59:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:45 smithi170 ceph-mon[31212]: pgmap v10809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:47.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:47 smithi077 ceph-mon[27902]: pgmap v10810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:47 smithi191 ceph-mon[31636]: pgmap v10810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:47 smithi170 ceph-mon[31212]: pgmap v10810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20098.691682 secs 2024-04-21T15:59:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20098.691682 secs 2024-04-21T15:59:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20098.691682 secs 2024-04-21T15:59:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:49 smithi077 ceph-mon[27902]: pgmap v10811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:49 smithi191 ceph-mon[31636]: pgmap v10811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:49 smithi170 ceph-mon[31212]: pgmap v10811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20100.454628 secs 2024-04-21T15:59:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:59:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20100.454628 secs 2024-04-21T15:59:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:59:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20100.454628 secs 2024-04-21T15:59:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T15:59:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:51 smithi077 ceph-mon[27902]: pgmap v10812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:59:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:59:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:51 smithi191 ceph-mon[31636]: pgmap v10812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:59:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:59:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:51 smithi170 ceph-mon[31212]: pgmap v10812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T15:59:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T15:59:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T15:59:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20103.691799 secs 2024-04-21T15:59:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:53 smithi077 ceph-mon[27902]: pgmap v10813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20103.691799 secs 2024-04-21T15:59:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:53 smithi191 ceph-mon[31636]: pgmap v10813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20103.691799 secs 2024-04-21T15:59:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:53 smithi170 ceph-mon[31212]: pgmap v10813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T15:59:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20105.454744 secs 2024-04-21T15:59:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:55 smithi077 ceph-mon[27902]: pgmap v10814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20105.454744 secs 2024-04-21T15:59:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:55 smithi191 ceph-mon[31636]: pgmap v10814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20105.454744 secs 2024-04-21T15:59:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:55 smithi170 ceph-mon[31212]: pgmap v10814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:57.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:57 smithi077 ceph-mon[27902]: pgmap v10815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:57 smithi191 ceph-mon[31636]: pgmap v10815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:57 smithi170 ceph-mon[31212]: pgmap v10815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T15:59:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20108.691889 secs 2024-04-21T15:59:58.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20108.691889 secs 2024-04-21T15:59:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20108.691889 secs 2024-04-21T15:59:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 15:59:59 smithi191 ceph-mon[31636]: pgmap v10816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 15:59:59 smithi170 ceph-mon[31212]: pgmap v10816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T15:59:59.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 15:59:59 smithi077 ceph-mon[27902]: pgmap v10816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20110.454893 secs 2024-04-21T16:00:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:00:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20110.454893 secs 2024-04-21T16:00:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:00:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20110.454893 secs 2024-04-21T16:00:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:00:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:01 smithi191 ceph-mon[31636]: pgmap v10817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:01 smithi170 ceph-mon[31212]: pgmap v10817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:01 smithi077 ceph-mon[27902]: pgmap v10817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20113.692007 secs 2024-04-21T16:00:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:03 smithi191 ceph-mon[31636]: pgmap v10818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-21T16:00:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20113.692007 secs 2024-04-21T16:00:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:03 smithi170 ceph-mon[31212]: pgmap v10818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-21T16:00:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20113.692007 secs 2024-04-21T16:00:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:03 smithi077 ceph-mon[27902]: pgmap v10818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-21T16:00:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20115.454982 secs 2024-04-21T16:00:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:05 smithi191 ceph-mon[31636]: pgmap v10819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-21T16:00:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:05 smithi191 ceph-mon[31636]: osdmap e748: 12 total, 12 up, 12 in 2024-04-21T16:00:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20115.454982 secs 2024-04-21T16:00:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:05 smithi170 ceph-mon[31212]: pgmap v10819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-21T16:00:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:05 smithi170 ceph-mon[31212]: osdmap e748: 12 total, 12 up, 12 in 2024-04-21T16:00:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20115.454982 secs 2024-04-21T16:00:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:05 smithi077 ceph-mon[27902]: pgmap v10819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-21T16:00:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:05 smithi077 ceph-mon[27902]: osdmap e748: 12 total, 12 up, 12 in 2024-04-21T16:00:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:07 smithi191 ceph-mon[31636]: pgmap v10821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:07 smithi170 ceph-mon[31212]: pgmap v10821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:07.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:07 smithi077 ceph-mon[27902]: pgmap v10821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20118.692125 secs 2024-04-21T16:00:08.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20118.692125 secs 2024-04-21T16:00:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20118.692125 secs 2024-04-21T16:00:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:09 smithi191 ceph-mon[31636]: pgmap v10822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:09 smithi170 ceph-mon[31212]: pgmap v10822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:09 smithi077 ceph-mon[27902]: pgmap v10822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20120.455111 secs 2024-04-21T16:00:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20120.455111 secs 2024-04-21T16:00:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20120.455111 secs 2024-04-21T16:00:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:11 smithi191 ceph-mon[31636]: pgmap v10823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:11 smithi191 ceph-mon[31636]: osdmap e749: 12 total, 12 up, 12 in 2024-04-21T16:00:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:11 smithi170 ceph-mon[31212]: pgmap v10823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:11 smithi170 ceph-mon[31212]: osdmap e749: 12 total, 12 up, 12 in 2024-04-21T16:00:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:11 smithi077 ceph-mon[27902]: pgmap v10823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:00:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:11 smithi077 ceph-mon[27902]: osdmap e749: 12 total, 12 up, 12 in 2024-04-21T16:00:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20123.692243 secs 2024-04-21T16:00:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:13 smithi191 ceph-mon[31636]: pgmap v10825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T16:00:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20123.692243 secs 2024-04-21T16:00:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:13 smithi170 ceph-mon[31212]: pgmap v10825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20123.692243 secs 2024-04-21T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:13 smithi077 ceph-mon[27902]: pgmap v10825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T16:00:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20125.455191 secs 2024-04-21T16:00:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:15 smithi191 ceph-mon[31636]: pgmap v10826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-04-21T16:00:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20125.455191 secs 2024-04-21T16:00:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:15 smithi170 ceph-mon[31212]: pgmap v10826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-04-21T16:00:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20125.455191 secs 2024-04-21T16:00:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:15 smithi077 ceph-mon[27902]: pgmap v10826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-04-21T16:00:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:17 smithi191 ceph-mon[31636]: pgmap v10827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:17 smithi170 ceph-mon[31212]: pgmap v10827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:17 smithi077 ceph-mon[27902]: pgmap v10827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20128.692356 secs 2024-04-21T16:00:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:18 smithi191 ceph-mon[31636]: pgmap v10828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20128.692356 secs 2024-04-21T16:00:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:18 smithi170 ceph-mon[31212]: pgmap v10828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20128.692356 secs 2024-04-21T16:00:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:18 smithi077 ceph-mon[27902]: pgmap v10828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20130.455268 secs 2024-04-21T16:00:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20130.455268 secs 2024-04-21T16:00:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20130.455268 secs 2024-04-21T16:00:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:20 smithi191 ceph-mon[31636]: pgmap v10829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:20 smithi170 ceph-mon[31212]: pgmap v10829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:20 smithi077 ceph-mon[27902]: pgmap v10829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:00:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20133.692469 secs 2024-04-21T16:00:23.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:23 smithi170 ceph-mon[31212]: pgmap v10830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:00:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20133.692469 secs 2024-04-21T16:00:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:23 smithi077 ceph-mon[27902]: pgmap v10830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:00:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20133.692469 secs 2024-04-21T16:00:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:23 smithi191 ceph-mon[31636]: pgmap v10830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:00:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20135.455411 secs 2024-04-21T16:00:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:25 smithi170 ceph-mon[31212]: pgmap v10831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20135.455411 secs 2024-04-21T16:00:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:25 smithi077 ceph-mon[27902]: pgmap v10831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20135.455411 secs 2024-04-21T16:00:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:25 smithi191 ceph-mon[31636]: pgmap v10831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:27.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:27 smithi170 ceph-mon[31212]: pgmap v10832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:27 smithi077 ceph-mon[27902]: pgmap v10832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:27 smithi191 ceph-mon[31636]: pgmap v10832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20138.692589 secs 2024-04-21T16:00:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20138.692589 secs 2024-04-21T16:00:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20138.692589 secs 2024-04-21T16:00:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:29 smithi077 ceph-mon[27902]: pgmap v10833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:29 smithi191 ceph-mon[31636]: pgmap v10833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:29 smithi170 ceph-mon[31212]: pgmap v10833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20140.455528 secs 2024-04-21T16:00:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20140.455528 secs 2024-04-21T16:00:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20140.455528 secs 2024-04-21T16:00:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:31 smithi077 ceph-mon[27902]: pgmap v10834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:31 smithi191 ceph-mon[31636]: pgmap v10834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:31 smithi170 ceph-mon[31212]: pgmap v10834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20143.692702 secs 2024-04-21T16:00:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:33 smithi077 ceph-mon[27902]: pgmap v10835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20143.692702 secs 2024-04-21T16:00:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:33 smithi191 ceph-mon[31636]: pgmap v10835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20143.692702 secs 2024-04-21T16:00:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:33 smithi170 ceph-mon[31212]: pgmap v10835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20145.455651 secs 2024-04-21T16:00:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:35 smithi077 ceph-mon[27902]: pgmap v10836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20145.455651 secs 2024-04-21T16:00:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:35 smithi191 ceph-mon[31636]: pgmap v10836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20145.455651 secs 2024-04-21T16:00:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:35 smithi170 ceph-mon[31212]: pgmap v10836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:37 smithi077 ceph-mon[27902]: pgmap v10837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:37 smithi191 ceph-mon[31636]: pgmap v10837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:37 smithi170 ceph-mon[31212]: pgmap v10837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20148.692846 secs 2024-04-21T16:00:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20148.692846 secs 2024-04-21T16:00:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20148.692846 secs 2024-04-21T16:00:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:39 smithi077 ceph-mon[27902]: pgmap v10838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:39 smithi191 ceph-mon[31636]: pgmap v10838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:39 smithi170 ceph-mon[31212]: pgmap v10838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20150.455798 secs 2024-04-21T16:00:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20150.455798 secs 2024-04-21T16:00:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20150.455798 secs 2024-04-21T16:00:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:41 smithi077 ceph-mon[27902]: pgmap v10839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:41 smithi191 ceph-mon[31636]: pgmap v10839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:41 smithi170 ceph-mon[31212]: pgmap v10839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20153.692967 secs 2024-04-21T16:00:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:43 smithi077 ceph-mon[27902]: pgmap v10840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20153.692967 secs 2024-04-21T16:00:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:43 smithi191 ceph-mon[31636]: pgmap v10840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20153.692967 secs 2024-04-21T16:00:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:43 smithi170 ceph-mon[31212]: pgmap v10840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20155.455865 secs 2024-04-21T16:00:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:45 smithi077 ceph-mon[27902]: pgmap v10841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20155.455865 secs 2024-04-21T16:00:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:45 smithi191 ceph-mon[31636]: pgmap v10841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20155.455865 secs 2024-04-21T16:00:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:45 smithi170 ceph-mon[31212]: pgmap v10841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:47.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:47 smithi077 ceph-mon[27902]: pgmap v10842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:47 smithi191 ceph-mon[31636]: pgmap v10842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:47 smithi170 ceph-mon[31212]: pgmap v10842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20158.693031 secs 2024-04-21T16:00:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20158.693031 secs 2024-04-21T16:00:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20158.693031 secs 2024-04-21T16:00:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:49 smithi077 ceph-mon[27902]: pgmap v10843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:49 smithi191 ceph-mon[31636]: pgmap v10843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:49 smithi170 ceph-mon[31212]: pgmap v10843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20160.455951 secs 2024-04-21T16:00:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20160.455951 secs 2024-04-21T16:00:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20160.455951 secs 2024-04-21T16:00:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:51 smithi077 ceph-mon[27902]: pgmap v10844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:00:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:51 smithi191 ceph-mon[31636]: pgmap v10844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:00:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:51 smithi170 ceph-mon[31212]: pgmap v10844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:00:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20163.693124 secs 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: pgmap v10845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:00:52.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20163.693124 secs 2024-04-21T16:00:52.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: pgmap v10845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:52.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:00:52.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:00:52.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20163.693124 secs 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: pgmap v10845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:00:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:00:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:00:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20165.456062 secs 2024-04-21T16:00:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:55 smithi170 ceph-mon[31212]: pgmap v10846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20165.456062 secs 2024-04-21T16:00:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:55 smithi077 ceph-mon[27902]: pgmap v10846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20165.456062 secs 2024-04-21T16:00:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:55 smithi191 ceph-mon[31636]: pgmap v10846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:57.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:57 smithi077 ceph-mon[27902]: pgmap v10847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:57 smithi191 ceph-mon[31636]: pgmap v10847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:57 smithi170 ceph-mon[31212]: pgmap v10847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:00:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20168.693251 secs 2024-04-21T16:00:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20168.693251 secs 2024-04-21T16:00:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20168.693251 secs 2024-04-21T16:00:59.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:00:59 smithi077 ceph-mon[27902]: pgmap v10848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:00:59 smithi191 ceph-mon[31636]: pgmap v10848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:00:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:00:59 smithi170 ceph-mon[31212]: pgmap v10848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:00.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20170.456145 secs 2024-04-21T16:01:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20170.456145 secs 2024-04-21T16:01:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20170.456145 secs 2024-04-21T16:01:01.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:01 smithi077 ceph-mon[27902]: pgmap v10849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:01 smithi191 ceph-mon[31636]: pgmap v10849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:01 smithi170 ceph-mon[31212]: pgmap v10849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20173.693379 secs 2024-04-21T16:01:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:03 smithi077 ceph-mon[27902]: pgmap v10850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20173.693379 secs 2024-04-21T16:01:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:03 smithi191 ceph-mon[31636]: pgmap v10850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20173.693379 secs 2024-04-21T16:01:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:03 smithi170 ceph-mon[31212]: pgmap v10850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20175.456262 secs 2024-04-21T16:01:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:05 smithi077 ceph-mon[27902]: pgmap v10851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:05 smithi077 ceph-mon[27902]: osdmap e750: 12 total, 12 up, 12 in 2024-04-21T16:01:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20175.456262 secs 2024-04-21T16:01:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:05 smithi191 ceph-mon[31636]: pgmap v10851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:05 smithi191 ceph-mon[31636]: osdmap e750: 12 total, 12 up, 12 in 2024-04-21T16:01:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20175.456262 secs 2024-04-21T16:01:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:05 smithi170 ceph-mon[31212]: pgmap v10851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:05 smithi170 ceph-mon[31212]: osdmap e750: 12 total, 12 up, 12 in 2024-04-21T16:01:07.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:07 smithi077 ceph-mon[27902]: pgmap v10853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:07 smithi191 ceph-mon[31636]: pgmap v10853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:07 smithi170 ceph-mon[31212]: pgmap v10853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20178.693496 secs 2024-04-21T16:01:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20178.693496 secs 2024-04-21T16:01:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20178.693496 secs 2024-04-21T16:01:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:09 smithi077 ceph-mon[27902]: pgmap v10854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:09 smithi191 ceph-mon[31636]: pgmap v10854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:09 smithi170 ceph-mon[31212]: pgmap v10854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:10.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20180.456403 secs 2024-04-21T16:01:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20180.456403 secs 2024-04-21T16:01:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20180.456403 secs 2024-04-21T16:01:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:11 smithi077 ceph-mon[27902]: pgmap v10855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:11 smithi077 ceph-mon[27902]: osdmap e751: 12 total, 12 up, 12 in 2024-04-21T16:01:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:11 smithi191 ceph-mon[31636]: pgmap v10855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:11 smithi191 ceph-mon[31636]: osdmap e751: 12 total, 12 up, 12 in 2024-04-21T16:01:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:11 smithi170 ceph-mon[31212]: pgmap v10855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:01:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:11 smithi170 ceph-mon[31212]: osdmap e751: 12 total, 12 up, 12 in 2024-04-21T16:01:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20183.693622 secs 2024-04-21T16:01:13.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:13 smithi077 ceph-mon[27902]: pgmap v10857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:01:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20183.693622 secs 2024-04-21T16:01:13.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:13 smithi191 ceph-mon[31636]: pgmap v10857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:01:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20183.693622 secs 2024-04-21T16:01:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:13 smithi170 ceph-mon[31212]: pgmap v10857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:01:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20185.456476 secs 2024-04-21T16:01:15.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:15 smithi077 ceph-mon[27902]: pgmap v10858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:01:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20185.456476 secs 2024-04-21T16:01:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:15 smithi191 ceph-mon[31636]: pgmap v10858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:01:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20185.456476 secs 2024-04-21T16:01:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:15 smithi170 ceph-mon[31212]: pgmap v10858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:01:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:16 smithi170 ceph-mon[31212]: pgmap v10859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:16 smithi077 ceph-mon[27902]: pgmap v10859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:17.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:16 smithi191 ceph-mon[31636]: pgmap v10859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20188.693772 secs 2024-04-21T16:01:18.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20188.693772 secs 2024-04-21T16:01:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20188.693772 secs 2024-04-21T16:01:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:18 smithi170 ceph-mon[31212]: pgmap v10860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:18 smithi077 ceph-mon[27902]: pgmap v10860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:18 smithi191 ceph-mon[31636]: pgmap v10860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20190.456554 secs 2024-04-21T16:01:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:20.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20190.456554 secs 2024-04-21T16:01:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20190.456554 secs 2024-04-21T16:01:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:20 smithi170 ceph-mon[31212]: pgmap v10861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:20 smithi077 ceph-mon[27902]: pgmap v10861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:20 smithi191 ceph-mon[31636]: pgmap v10861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:01:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20193.693863 secs 2024-04-21T16:01:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:23 smithi077 ceph-mon[27902]: pgmap v10862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:01:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20193.693863 secs 2024-04-21T16:01:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:23 smithi191 ceph-mon[31636]: pgmap v10862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:01:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20193.693863 secs 2024-04-21T16:01:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:23 smithi170 ceph-mon[31212]: pgmap v10862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:01:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20195.456666 secs 2024-04-21T16:01:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:25 smithi077 ceph-mon[27902]: pgmap v10863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20195.456666 secs 2024-04-21T16:01:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:25 smithi191 ceph-mon[31636]: pgmap v10863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20195.456666 secs 2024-04-21T16:01:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:25 smithi170 ceph-mon[31212]: pgmap v10863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:27 smithi077 ceph-mon[27902]: pgmap v10864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:27 smithi191 ceph-mon[31636]: pgmap v10864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:27 smithi170 ceph-mon[31212]: pgmap v10864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20198.693932 secs 2024-04-21T16:01:28.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20198.693932 secs 2024-04-21T16:01:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20198.693932 secs 2024-04-21T16:01:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:29 smithi077 ceph-mon[27902]: pgmap v10865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:29 smithi191 ceph-mon[31636]: pgmap v10865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:29 smithi170 ceph-mon[31212]: pgmap v10865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20200.456725 secs 2024-04-21T16:01:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20200.456725 secs 2024-04-21T16:01:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20200.456725 secs 2024-04-21T16:01:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:31 smithi077 ceph-mon[27902]: pgmap v10866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:31 smithi191 ceph-mon[31636]: pgmap v10866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:31 smithi170 ceph-mon[31212]: pgmap v10866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20203.694031 secs 2024-04-21T16:01:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:33 smithi077 ceph-mon[27902]: pgmap v10867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20203.694031 secs 2024-04-21T16:01:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:33 smithi191 ceph-mon[31636]: pgmap v10867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20203.694031 secs 2024-04-21T16:01:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:33 smithi170 ceph-mon[31212]: pgmap v10867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20205.456847 secs 2024-04-21T16:01:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:35 smithi077 ceph-mon[27902]: pgmap v10868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20205.456847 secs 2024-04-21T16:01:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:35 smithi191 ceph-mon[31636]: pgmap v10868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20205.456847 secs 2024-04-21T16:01:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:35 smithi170 ceph-mon[31212]: pgmap v10868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:37 smithi077 ceph-mon[27902]: pgmap v10869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:37 smithi191 ceph-mon[31636]: pgmap v10869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:37 smithi170 ceph-mon[31212]: pgmap v10869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20208.694120 secs 2024-04-21T16:01:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20208.694120 secs 2024-04-21T16:01:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20208.694120 secs 2024-04-21T16:01:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:39 smithi077 ceph-mon[27902]: pgmap v10870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:39 smithi191 ceph-mon[31636]: pgmap v10870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:39 smithi170 ceph-mon[31212]: pgmap v10870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20210.456939 secs 2024-04-21T16:01:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20210.456939 secs 2024-04-21T16:01:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20210.456939 secs 2024-04-21T16:01:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:41 smithi077 ceph-mon[27902]: pgmap v10871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:41 smithi191 ceph-mon[31636]: pgmap v10871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:41 smithi170 ceph-mon[31212]: pgmap v10871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20213.694188 secs 2024-04-21T16:01:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:43 smithi077 ceph-mon[27902]: pgmap v10872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20213.694188 secs 2024-04-21T16:01:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:43 smithi191 ceph-mon[31636]: pgmap v10872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20213.694188 secs 2024-04-21T16:01:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:43 smithi170 ceph-mon[31212]: pgmap v10872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20215.457018 secs 2024-04-21T16:01:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:45 smithi077 ceph-mon[27902]: pgmap v10873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20215.457018 secs 2024-04-21T16:01:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:45 smithi191 ceph-mon[31636]: pgmap v10873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20215.457018 secs 2024-04-21T16:01:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:45 smithi170 ceph-mon[31212]: pgmap v10873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:47.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:47 smithi077 ceph-mon[27902]: pgmap v10874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:47 smithi191 ceph-mon[31636]: pgmap v10874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:47 smithi170 ceph-mon[31212]: pgmap v10874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20218.694317 secs 2024-04-21T16:01:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20218.694317 secs 2024-04-21T16:01:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20218.694317 secs 2024-04-21T16:01:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:49 smithi077 ceph-mon[27902]: pgmap v10875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:49 smithi191 ceph-mon[31636]: pgmap v10875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:49 smithi170 ceph-mon[31212]: pgmap v10875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20220.457135 secs 2024-04-21T16:01:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20220.457135 secs 2024-04-21T16:01:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20220.457135 secs 2024-04-21T16:01:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:51 smithi077 ceph-mon[27902]: pgmap v10876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:51 smithi191 ceph-mon[31636]: pgmap v10876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:51 smithi170 ceph-mon[31212]: pgmap v10876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20223.694441 secs 2024-04-21T16:01:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:53 smithi191 ceph-mon[31636]: pgmap v10877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:01:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:01:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:01:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:01:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20223.694441 secs 2024-04-21T16:01:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:53 smithi170 ceph-mon[31212]: pgmap v10877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:01:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:01:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:01:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:01:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20223.694441 secs 2024-04-21T16:01:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:53 smithi077 ceph-mon[27902]: pgmap v10877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:01:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:01:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:01:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:01:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:01:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20225.457227 secs 2024-04-21T16:01:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:55 smithi191 ceph-mon[31636]: pgmap v10878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20225.457227 secs 2024-04-21T16:01:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:55 smithi170 ceph-mon[31212]: pgmap v10878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20225.457227 secs 2024-04-21T16:01:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:55 smithi077 ceph-mon[27902]: pgmap v10878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:01:57.150+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:01:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:01:57.150+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:01:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:01:57.150+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:01:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:01:57.150+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:01:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:57 smithi191 ceph-mon[31636]: pgmap v10879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:57 smithi170 ceph-mon[31212]: pgmap v10879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:57 smithi077 ceph-mon[27902]: pgmap v10879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:01:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20228.694570 secs 2024-04-21T16:01:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20228.694570 secs 2024-04-21T16:01:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20228.694570 secs 2024-04-21T16:01:59.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:01:59 smithi191 ceph-mon[31636]: pgmap v10880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:59.492 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:01:59 smithi170 ceph-mon[31212]: pgmap v10880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:01:59.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:01:59 smithi077 ceph-mon[27902]: pgmap v10880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:00.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20230.457290 secs 2024-04-21T16:02:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20230.457290 secs 2024-04-21T16:02:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20230.457290 secs 2024-04-21T16:02:01.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:01 smithi077 ceph-mon[27902]: pgmap v10881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:01 smithi191 ceph-mon[31636]: pgmap v10881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:01 smithi170 ceph-mon[31212]: pgmap v10881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20233.694694 secs 2024-04-21T16:02:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:03 smithi191 ceph-mon[31636]: pgmap v10882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20233.694694 secs 2024-04-21T16:02:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:03 smithi170 ceph-mon[31212]: pgmap v10882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20233.694694 secs 2024-04-21T16:02:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:03 smithi077 ceph-mon[27902]: pgmap v10882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20235.457430 secs 2024-04-21T16:02:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:05 smithi191 ceph-mon[31636]: pgmap v10883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:05 smithi191 ceph-mon[31636]: osdmap e752: 12 total, 12 up, 12 in 2024-04-21T16:02:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20235.457430 secs 2024-04-21T16:02:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:05 smithi170 ceph-mon[31212]: pgmap v10883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:05 smithi170 ceph-mon[31212]: osdmap e752: 12 total, 12 up, 12 in 2024-04-21T16:02:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20235.457430 secs 2024-04-21T16:02:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:05 smithi077 ceph-mon[27902]: pgmap v10883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:05 smithi077 ceph-mon[27902]: osdmap e752: 12 total, 12 up, 12 in 2024-04-21T16:02:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:07 smithi191 ceph-mon[31636]: pgmap v10885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:07 smithi170 ceph-mon[31212]: pgmap v10885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:07 smithi077 ceph-mon[27902]: pgmap v10885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20238.694825 secs 2024-04-21T16:02:08.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20238.694825 secs 2024-04-21T16:02:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20238.694825 secs 2024-04-21T16:02:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:09 smithi191 ceph-mon[31636]: pgmap v10886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:09.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:09 smithi170 ceph-mon[31212]: pgmap v10886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:09 smithi077 ceph-mon[27902]: pgmap v10886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20240.457511 secs 2024-04-21T16:02:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20240.457511 secs 2024-04-21T16:02:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20240.457511 secs 2024-04-21T16:02:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:11 smithi077 ceph-mon[27902]: pgmap v10887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:11 smithi077 ceph-mon[27902]: osdmap e753: 12 total, 12 up, 12 in 2024-04-21T16:02:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:11 smithi191 ceph-mon[31636]: pgmap v10887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:11 smithi191 ceph-mon[31636]: osdmap e753: 12 total, 12 up, 12 in 2024-04-21T16:02:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:11 smithi170 ceph-mon[31212]: pgmap v10887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:02:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:11 smithi170 ceph-mon[31212]: osdmap e753: 12 total, 12 up, 12 in 2024-04-21T16:02:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20243.695012 secs 2024-04-21T16:02:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:13 smithi191 ceph-mon[31636]: pgmap v10889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:02:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20243.695012 secs 2024-04-21T16:02:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:13 smithi170 ceph-mon[31212]: pgmap v10889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:02:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20243.695012 secs 2024-04-21T16:02:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:13 smithi077 ceph-mon[27902]: pgmap v10889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:02:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20245.457629 secs 2024-04-21T16:02:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:15 smithi191 ceph-mon[31636]: pgmap v10890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:02:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20245.457629 secs 2024-04-21T16:02:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:15 smithi170 ceph-mon[31212]: pgmap v10890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:02:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20245.457629 secs 2024-04-21T16:02:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:15 smithi077 ceph-mon[27902]: pgmap v10890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:02:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:17 smithi191 ceph-mon[31636]: pgmap v10891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:17 smithi170 ceph-mon[31212]: pgmap v10891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:17 smithi077 ceph-mon[27902]: pgmap v10891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20248.695128 secs 2024-04-21T16:02:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20248.695128 secs 2024-04-21T16:02:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20248.695128 secs 2024-04-21T16:02:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:19 smithi191 ceph-mon[31636]: pgmap v10892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:19.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20250.457766 secs 2024-04-21T16:02:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:19 smithi170 ceph-mon[31212]: pgmap v10892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20250.457766 secs 2024-04-21T16:02:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:19 smithi077 ceph-mon[27902]: pgmap v10892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20250.457766 secs 2024-04-21T16:02:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:20 smithi191 ceph-mon[31636]: pgmap v10893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:20 smithi170 ceph-mon[31212]: pgmap v10893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:20 smithi077 ceph-mon[27902]: pgmap v10893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:02:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20253.695243 secs 2024-04-21T16:02:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:23 smithi077 ceph-mon[27902]: pgmap v10894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:02:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20253.695243 secs 2024-04-21T16:02:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:23 smithi191 ceph-mon[31636]: pgmap v10894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:02:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20253.695243 secs 2024-04-21T16:02:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:23 smithi170 ceph-mon[31212]: pgmap v10894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:02:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20255.457884 secs 2024-04-21T16:02:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:25 smithi077 ceph-mon[27902]: pgmap v10895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20255.457884 secs 2024-04-21T16:02:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:25 smithi191 ceph-mon[31636]: pgmap v10895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20255.457884 secs 2024-04-21T16:02:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:25 smithi170 ceph-mon[31212]: pgmap v10895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:27 smithi077 ceph-mon[27902]: pgmap v10896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:27 smithi191 ceph-mon[31636]: pgmap v10896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:27 smithi170 ceph-mon[31212]: pgmap v10896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20258.695367 secs 2024-04-21T16:02:28.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20258.695367 secs 2024-04-21T16:02:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20258.695367 secs 2024-04-21T16:02:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:29 smithi077 ceph-mon[27902]: pgmap v10897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:29 smithi191 ceph-mon[31636]: pgmap v10897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:29.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:29 smithi170 ceph-mon[31212]: pgmap v10897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20260.457964 secs 2024-04-21T16:02:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20260.457964 secs 2024-04-21T16:02:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20260.457964 secs 2024-04-21T16:02:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:31 smithi077 ceph-mon[27902]: pgmap v10898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:31 smithi191 ceph-mon[31636]: pgmap v10898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:31 smithi170 ceph-mon[31212]: pgmap v10898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20263.695444 secs 2024-04-21T16:02:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:33 smithi077 ceph-mon[27902]: pgmap v10899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:33.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20263.695444 secs 2024-04-21T16:02:33.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:33 smithi191 ceph-mon[31636]: pgmap v10899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20263.695444 secs 2024-04-21T16:02:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:33 smithi170 ceph-mon[31212]: pgmap v10899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20265.458073 secs 2024-04-21T16:02:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:35 smithi077 ceph-mon[27902]: pgmap v10900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20265.458073 secs 2024-04-21T16:02:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:35 smithi191 ceph-mon[31636]: pgmap v10900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20265.458073 secs 2024-04-21T16:02:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:35 smithi170 ceph-mon[31212]: pgmap v10900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:37 smithi077 ceph-mon[27902]: pgmap v10901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:37 smithi191 ceph-mon[31636]: pgmap v10901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:37 smithi170 ceph-mon[31212]: pgmap v10901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20268.695567 secs 2024-04-21T16:02:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20268.695567 secs 2024-04-21T16:02:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20268.695567 secs 2024-04-21T16:02:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:39 smithi077 ceph-mon[27902]: pgmap v10902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:39 smithi191 ceph-mon[31636]: pgmap v10902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:39 smithi170 ceph-mon[31212]: pgmap v10902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20270.458153 secs 2024-04-21T16:02:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20270.458153 secs 2024-04-21T16:02:40.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20270.458153 secs 2024-04-21T16:02:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:41 smithi077 ceph-mon[27902]: pgmap v10903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:41 smithi191 ceph-mon[31636]: pgmap v10903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:41 smithi170 ceph-mon[31212]: pgmap v10903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20273.695686 secs 2024-04-21T16:02:43.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:43 smithi077 ceph-mon[27902]: pgmap v10904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20273.695686 secs 2024-04-21T16:02:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:43 smithi191 ceph-mon[31636]: pgmap v10904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20273.695686 secs 2024-04-21T16:02:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:43 smithi170 ceph-mon[31212]: pgmap v10904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20275.458234 secs 2024-04-21T16:02:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:45 smithi191 ceph-mon[31636]: pgmap v10905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20275.458234 secs 2024-04-21T16:02:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:45 smithi170 ceph-mon[31212]: pgmap v10905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20275.458234 secs 2024-04-21T16:02:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:45 smithi077 ceph-mon[27902]: pgmap v10905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:46 smithi170 ceph-mon[31212]: pgmap v10906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:46 smithi077 ceph-mon[27902]: pgmap v10906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:47.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:46 smithi191 ceph-mon[31636]: pgmap v10906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:48.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20278.695815 secs 2024-04-21T16:02:48.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20278.695815 secs 2024-04-21T16:02:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20278.695815 secs 2024-04-21T16:02:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:48 smithi170 ceph-mon[31212]: pgmap v10907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:48 smithi077 ceph-mon[27902]: pgmap v10907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:48 smithi191 ceph-mon[31636]: pgmap v10907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20280.458381 secs 2024-04-21T16:02:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20280.458381 secs 2024-04-21T16:02:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20280.458381 secs 2024-04-21T16:02:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:50 smithi170 ceph-mon[31212]: pgmap v10908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:51.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:50 smithi077 ceph-mon[27902]: pgmap v10908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:50 smithi191 ceph-mon[31636]: pgmap v10908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20283.695916 secs 2024-04-21T16:02:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:53 smithi077 ceph-mon[27902]: pgmap v10909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20283.695916 secs 2024-04-21T16:02:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:53 smithi191 ceph-mon[31636]: pgmap v10909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20283.695916 secs 2024-04-21T16:02:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:53 smithi170 ceph-mon[31212]: pgmap v10909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:54.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:02:54.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:02:54.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:02:54.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:02:54.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:02:54.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:02:54.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:02:54.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:02:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:02:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:02:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:02:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:02:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:02:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20285.458447 secs 2024-04-21T16:02:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:55 smithi077 ceph-mon[27902]: pgmap v10910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20285.458447 secs 2024-04-21T16:02:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:55 smithi191 ceph-mon[31636]: pgmap v10910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20285.458447 secs 2024-04-21T16:02:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:55 smithi170 ceph-mon[31212]: pgmap v10910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:57.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:57 smithi077 ceph-mon[27902]: pgmap v10911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:57 smithi191 ceph-mon[31636]: pgmap v10911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:57 smithi170 ceph-mon[31212]: pgmap v10911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:02:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20288.696044 secs 2024-04-21T16:02:58.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20288.696044 secs 2024-04-21T16:02:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20288.696044 secs 2024-04-21T16:02:59.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:02:59 smithi077 ceph-mon[27902]: pgmap v10912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:02:59 smithi191 ceph-mon[31636]: pgmap v10912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:02:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:02:59 smithi170 ceph-mon[31212]: pgmap v10912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:00.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20290.458568 secs 2024-04-21T16:03:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20290.458568 secs 2024-04-21T16:03:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20290.458568 secs 2024-04-21T16:03:01.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:01 smithi077 ceph-mon[27902]: pgmap v10913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:01 smithi191 ceph-mon[31636]: pgmap v10913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:01 smithi170 ceph-mon[31212]: pgmap v10913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20293.696192 secs 2024-04-21T16:03:03.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:03 smithi077 ceph-mon[27902]: pgmap v10914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20293.696192 secs 2024-04-21T16:03:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:03 smithi191 ceph-mon[31636]: pgmap v10914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20293.696192 secs 2024-04-21T16:03:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:03 smithi170 ceph-mon[31212]: pgmap v10914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20295.458702 secs 2024-04-21T16:03:05.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:05 smithi077 ceph-mon[27902]: pgmap v10915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:05.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:05 smithi077 ceph-mon[27902]: osdmap e754: 12 total, 12 up, 12 in 2024-04-21T16:03:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20295.458702 secs 2024-04-21T16:03:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:05 smithi191 ceph-mon[31636]: pgmap v10915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:05 smithi191 ceph-mon[31636]: osdmap e754: 12 total, 12 up, 12 in 2024-04-21T16:03:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20295.458702 secs 2024-04-21T16:03:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:05 smithi170 ceph-mon[31212]: pgmap v10915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:05 smithi170 ceph-mon[31212]: osdmap e754: 12 total, 12 up, 12 in 2024-04-21T16:03:07.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:07 smithi077 ceph-mon[27902]: pgmap v10917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:07.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:07 smithi191 ceph-mon[31636]: pgmap v10917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:07 smithi170 ceph-mon[31212]: pgmap v10917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20298.696279 secs 2024-04-21T16:03:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20298.696279 secs 2024-04-21T16:03:08.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20298.696279 secs 2024-04-21T16:03:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:09 smithi077 ceph-mon[27902]: pgmap v10918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:09.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:09 smithi191 ceph-mon[31636]: pgmap v10918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:09 smithi170 ceph-mon[31212]: pgmap v10918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20300.458825 secs 2024-04-21T16:03:10.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20300.458825 secs 2024-04-21T16:03:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20300.458825 secs 2024-04-21T16:03:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:11 smithi191 ceph-mon[31636]: pgmap v10919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:11.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:11 smithi191 ceph-mon[31636]: osdmap e755: 12 total, 12 up, 12 in 2024-04-21T16:03:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:11 smithi170 ceph-mon[31212]: pgmap v10919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:11 smithi170 ceph-mon[31212]: osdmap e755: 12 total, 12 up, 12 in 2024-04-21T16:03:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:11 smithi077 ceph-mon[27902]: pgmap v10919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:03:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:11 smithi077 ceph-mon[27902]: osdmap e755: 12 total, 12 up, 12 in 2024-04-21T16:03:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20303.696419 secs 2024-04-21T16:03:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:13 smithi191 ceph-mon[31636]: pgmap v10921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:03:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20303.696419 secs 2024-04-21T16:03:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:13 smithi170 ceph-mon[31212]: pgmap v10921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:03:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20303.696419 secs 2024-04-21T16:03:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:13 smithi077 ceph-mon[27902]: pgmap v10921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:03:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20305.458939 secs 2024-04-21T16:03:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:15 smithi191 ceph-mon[31636]: pgmap v10922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:03:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20305.458939 secs 2024-04-21T16:03:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:15 smithi170 ceph-mon[31212]: pgmap v10922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:03:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20305.458939 secs 2024-04-21T16:03:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:15 smithi077 ceph-mon[27902]: pgmap v10922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:03:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:17 smithi191 ceph-mon[31636]: pgmap v10923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:17 smithi170 ceph-mon[31212]: pgmap v10923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:17 smithi077 ceph-mon[27902]: pgmap v10923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20308.696542 secs 2024-04-21T16:03:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20308.696542 secs 2024-04-21T16:03:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20308.696542 secs 2024-04-21T16:03:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:19 smithi191 ceph-mon[31636]: pgmap v10924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:19.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:19 smithi170 ceph-mon[31212]: pgmap v10924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:19 smithi077 ceph-mon[27902]: pgmap v10924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:20.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20310.459070 secs 2024-04-21T16:03:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20310.459070 secs 2024-04-21T16:03:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20310.459070 secs 2024-04-21T16:03:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:21 smithi191 ceph-mon[31636]: pgmap v10925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:21 smithi170 ceph-mon[31212]: pgmap v10925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:21 smithi077 ceph-mon[27902]: pgmap v10925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:03:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20313.696679 secs 2024-04-21T16:03:23.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:23 smithi191 ceph-mon[31636]: pgmap v10926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:03:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20313.696679 secs 2024-04-21T16:03:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:23 smithi170 ceph-mon[31212]: pgmap v10926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:03:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20313.696679 secs 2024-04-21T16:03:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:23 smithi077 ceph-mon[27902]: pgmap v10926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:03:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20315.459191 secs 2024-04-21T16:03:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:25 smithi191 ceph-mon[31636]: pgmap v10927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20315.459191 secs 2024-04-21T16:03:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:25 smithi170 ceph-mon[31212]: pgmap v10927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20315.459191 secs 2024-04-21T16:03:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:25 smithi077 ceph-mon[27902]: pgmap v10927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:27.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:27 smithi191 ceph-mon[31636]: pgmap v10928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:27 smithi170 ceph-mon[31212]: pgmap v10928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:27.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:27 smithi077 ceph-mon[27902]: pgmap v10928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:28.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20318.696798 secs 2024-04-21T16:03:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20318.696798 secs 2024-04-21T16:03:28.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20318.696798 secs 2024-04-21T16:03:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:29 smithi191 ceph-mon[31636]: pgmap v10929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:29.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:29 smithi170 ceph-mon[31212]: pgmap v10929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:29.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:29 smithi077 ceph-mon[27902]: pgmap v10929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20320.459307 secs 2024-04-21T16:03:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20320.459307 secs 2024-04-21T16:03:30.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20320.459307 secs 2024-04-21T16:03:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:31 smithi191 ceph-mon[31636]: pgmap v10930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:31 smithi170 ceph-mon[31212]: pgmap v10930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:31.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:31 smithi077 ceph-mon[27902]: pgmap v10930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20323.696927 secs 2024-04-21T16:03:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:33 smithi191 ceph-mon[31636]: pgmap v10931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20323.696927 secs 2024-04-21T16:03:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:33 smithi170 ceph-mon[31212]: pgmap v10931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20323.696927 secs 2024-04-21T16:03:33.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:33 smithi077 ceph-mon[27902]: pgmap v10931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20325.459401 secs 2024-04-21T16:03:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:35 smithi191 ceph-mon[31636]: pgmap v10932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20325.459401 secs 2024-04-21T16:03:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:35 smithi170 ceph-mon[31212]: pgmap v10932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20325.459401 secs 2024-04-21T16:03:35.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:35 smithi077 ceph-mon[27902]: pgmap v10932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:37.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:37 smithi191 ceph-mon[31636]: pgmap v10933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:37 smithi170 ceph-mon[31212]: pgmap v10933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:37.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:37 smithi077 ceph-mon[27902]: pgmap v10933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:38.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20328.697027 secs 2024-04-21T16:03:38.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20328.697027 secs 2024-04-21T16:03:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20328.697027 secs 2024-04-21T16:03:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:39 smithi191 ceph-mon[31636]: pgmap v10934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:39.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:39 smithi170 ceph-mon[31212]: pgmap v10934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:39 smithi077 ceph-mon[27902]: pgmap v10934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20330.459500 secs 2024-04-21T16:03:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20330.459500 secs 2024-04-21T16:03:40.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20330.459500 secs 2024-04-21T16:03:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:41 smithi191 ceph-mon[31636]: pgmap v10935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:41 smithi170 ceph-mon[31212]: pgmap v10935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:41 smithi077 ceph-mon[27902]: pgmap v10935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:42.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:42 smithi170 ceph-mon[31212]: pgmap v10936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:42.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:42 smithi077 ceph-mon[27902]: pgmap v10936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:42.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:42 smithi191 ceph-mon[31636]: pgmap v10936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20333.697114 secs 2024-04-21T16:03:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20333.697114 secs 2024-04-21T16:03:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20333.697114 secs 2024-04-21T16:03:44.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20335.459613 secs 2024-04-21T16:03:44.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:44 smithi170 ceph-mon[31212]: pgmap v10937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:44.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20335.459613 secs 2024-04-21T16:03:44.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:44 smithi077 ceph-mon[27902]: pgmap v10937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:44.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20335.459613 secs 2024-04-21T16:03:44.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:44 smithi191 ceph-mon[31636]: pgmap v10937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:47.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:47 smithi077 ceph-mon[27902]: pgmap v10938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:47 smithi191 ceph-mon[31636]: pgmap v10938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:47 smithi170 ceph-mon[31212]: pgmap v10938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20338.697223 secs 2024-04-21T16:03:48.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20338.697223 secs 2024-04-21T16:03:48.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20338.697223 secs 2024-04-21T16:03:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:49 smithi077 ceph-mon[27902]: pgmap v10939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:49.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:49 smithi191 ceph-mon[31636]: pgmap v10939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:49 smithi170 ceph-mon[31212]: pgmap v10939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20340.459746 secs 2024-04-21T16:03:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20340.459746 secs 2024-04-21T16:03:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20340.459746 secs 2024-04-21T16:03:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:51 smithi077 ceph-mon[27902]: pgmap v10940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:51 smithi191 ceph-mon[31636]: pgmap v10940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:51 smithi170 ceph-mon[31212]: pgmap v10940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20343.697297 secs 2024-04-21T16:03:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:53 smithi077 ceph-mon[27902]: pgmap v10941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20343.697297 secs 2024-04-21T16:03:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:53 smithi191 ceph-mon[31636]: pgmap v10941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20343.697297 secs 2024-04-21T16:03:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:53 smithi170 ceph-mon[31212]: pgmap v10941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:54.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:03:54.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:03:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:03:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:03:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20345.459883 secs 2024-04-21T16:03:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:55 smithi077 ceph-mon[27902]: pgmap v10942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:03:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:03:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:03:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20345.459883 secs 2024-04-21T16:03:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:55 smithi191 ceph-mon[31636]: pgmap v10942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:03:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:03:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:03:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20345.459883 secs 2024-04-21T16:03:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:55 smithi170 ceph-mon[31212]: pgmap v10942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:03:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:03:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:03:57.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:57 smithi077 ceph-mon[27902]: pgmap v10943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:57 smithi191 ceph-mon[31636]: pgmap v10943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:57 smithi170 ceph-mon[31212]: pgmap v10943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:03:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20348.697427 secs 2024-04-21T16:03:58.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20348.697427 secs 2024-04-21T16:03:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20348.697427 secs 2024-04-21T16:03:59.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:03:59 smithi191 ceph-mon[31636]: pgmap v10944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:03:59 smithi170 ceph-mon[31212]: pgmap v10944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:03:59.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:03:59 smithi077 ceph-mon[27902]: pgmap v10944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20350.459978 secs 2024-04-21T16:04:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20350.459978 secs 2024-04-21T16:04:00.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20350.459978 secs 2024-04-21T16:04:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:01 smithi191 ceph-mon[31636]: pgmap v10945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:01 smithi170 ceph-mon[31212]: pgmap v10945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:01 smithi077 ceph-mon[27902]: pgmap v10945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20353.697548 secs 2024-04-21T16:04:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:03 smithi191 ceph-mon[31636]: pgmap v10946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20353.697548 secs 2024-04-21T16:04:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:03 smithi170 ceph-mon[31212]: pgmap v10946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20353.697548 secs 2024-04-21T16:04:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:03 smithi077 ceph-mon[27902]: pgmap v10946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20355.460097 secs 2024-04-21T16:04:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:05 smithi191 ceph-mon[31636]: pgmap v10947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:05 smithi191 ceph-mon[31636]: osdmap e756: 12 total, 12 up, 12 in 2024-04-21T16:04:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20355.460097 secs 2024-04-21T16:04:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:05 smithi170 ceph-mon[31212]: pgmap v10947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:05 smithi170 ceph-mon[31212]: osdmap e756: 12 total, 12 up, 12 in 2024-04-21T16:04:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20355.460097 secs 2024-04-21T16:04:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:05 smithi077 ceph-mon[27902]: pgmap v10947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:05 smithi077 ceph-mon[27902]: osdmap e756: 12 total, 12 up, 12 in 2024-04-21T16:04:07.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:07 smithi191 ceph-mon[31636]: pgmap v10949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:07.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:07 smithi170 ceph-mon[31212]: pgmap v10949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:07 smithi077 ceph-mon[27902]: pgmap v10949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20358.697676 secs 2024-04-21T16:04:08.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20358.697676 secs 2024-04-21T16:04:08.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20358.697676 secs 2024-04-21T16:04:09.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:09 smithi191 ceph-mon[31636]: pgmap v10950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:09.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:09 smithi170 ceph-mon[31212]: pgmap v10950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:09 smithi077 ceph-mon[27902]: pgmap v10950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20360.460212 secs 2024-04-21T16:04:10.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20360.460212 secs 2024-04-21T16:04:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20360.460212 secs 2024-04-21T16:04:11.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:11 smithi191 ceph-mon[31636]: pgmap v10951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:11.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:11 smithi191 ceph-mon[31636]: osdmap e757: 12 total, 12 up, 12 in 2024-04-21T16:04:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:11 smithi170 ceph-mon[31212]: pgmap v10951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:11 smithi170 ceph-mon[31212]: osdmap e757: 12 total, 12 up, 12 in 2024-04-21T16:04:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:11 smithi077 ceph-mon[27902]: pgmap v10951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:04:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:11 smithi077 ceph-mon[27902]: osdmap e757: 12 total, 12 up, 12 in 2024-04-21T16:04:13.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20363.697817 secs 2024-04-21T16:04:13.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:13 smithi191 ceph-mon[31636]: pgmap v10953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:04:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20363.697817 secs 2024-04-21T16:04:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:13 smithi170 ceph-mon[31212]: pgmap v10953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:04:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20363.697817 secs 2024-04-21T16:04:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:13 smithi077 ceph-mon[27902]: pgmap v10953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:04:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20365.460329 secs 2024-04-21T16:04:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:15 smithi191 ceph-mon[31636]: pgmap v10954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:04:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20365.460329 secs 2024-04-21T16:04:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:15 smithi170 ceph-mon[31212]: pgmap v10954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:04:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20365.460329 secs 2024-04-21T16:04:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:15 smithi077 ceph-mon[27902]: pgmap v10954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:04:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:17 smithi191 ceph-mon[31636]: pgmap v10955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:17.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:17 smithi170 ceph-mon[31212]: pgmap v10955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:17 smithi077 ceph-mon[27902]: pgmap v10955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:18.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20368.697957 secs 2024-04-21T16:04:18.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20368.697957 secs 2024-04-21T16:04:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20368.697957 secs 2024-04-21T16:04:19.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:19 smithi191 ceph-mon[31636]: pgmap v10956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:19.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:19 smithi170 ceph-mon[31212]: pgmap v10956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:19 smithi077 ceph-mon[27902]: pgmap v10956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:20.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20370.460448 secs 2024-04-21T16:04:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20370.460448 secs 2024-04-21T16:04:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20370.460448 secs 2024-04-21T16:04:21.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:21 smithi191 ceph-mon[31636]: pgmap v10957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:21 smithi170 ceph-mon[31212]: pgmap v10957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:21 smithi077 ceph-mon[27902]: pgmap v10957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:04:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20373.698081 secs 2024-04-21T16:04:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:23 smithi191 ceph-mon[31636]: pgmap v10958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:04:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20373.698081 secs 2024-04-21T16:04:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:23 smithi170 ceph-mon[31212]: pgmap v10958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:04:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20373.698081 secs 2024-04-21T16:04:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:23 smithi077 ceph-mon[27902]: pgmap v10958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:04:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20375.460580 secs 2024-04-21T16:04:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:25 smithi191 ceph-mon[31636]: pgmap v10959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20375.460580 secs 2024-04-21T16:04:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:25 smithi170 ceph-mon[31212]: pgmap v10959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20375.460580 secs 2024-04-21T16:04:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:25 smithi077 ceph-mon[27902]: pgmap v10959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:27.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:27 smithi191 ceph-mon[31636]: pgmap v10960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:27.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:27 smithi170 ceph-mon[31212]: pgmap v10960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:27.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:27 smithi077 ceph-mon[27902]: pgmap v10960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20378.698205 secs 2024-04-21T16:04:28.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20378.698205 secs 2024-04-21T16:04:28.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20378.698205 secs 2024-04-21T16:04:29.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:29 smithi191 ceph-mon[31636]: pgmap v10961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:29.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:29 smithi170 ceph-mon[31212]: pgmap v10961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:29.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:29 smithi077 ceph-mon[27902]: pgmap v10961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:30.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20380.460694 secs 2024-04-21T16:04:30.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20380.460694 secs 2024-04-21T16:04:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20380.460694 secs 2024-04-21T16:04:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:31 smithi170 ceph-mon[31212]: pgmap v10962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:31.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:31 smithi077 ceph-mon[27902]: pgmap v10962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:31.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:31 smithi191 ceph-mon[31636]: pgmap v10962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:32.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:32 smithi170 ceph-mon[31212]: pgmap v10963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:32.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:32 smithi077 ceph-mon[27902]: pgmap v10963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:32 smithi191 ceph-mon[31636]: pgmap v10963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20383.698334 secs 2024-04-21T16:04:33.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20383.698334 secs 2024-04-21T16:04:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20383.698334 secs 2024-04-21T16:04:34.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20385.460777 secs 2024-04-21T16:04:34.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:34 smithi170 ceph-mon[31212]: pgmap v10964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:34.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20385.460777 secs 2024-04-21T16:04:34.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:34 smithi077 ceph-mon[27902]: pgmap v10964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:34.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20385.460777 secs 2024-04-21T16:04:34.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:34 smithi191 ceph-mon[31636]: pgmap v10964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:37 smithi077 ceph-mon[27902]: pgmap v10965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:37.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:37 smithi191 ceph-mon[31636]: pgmap v10965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:37.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:37 smithi170 ceph-mon[31212]: pgmap v10965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20388.698458 secs 2024-04-21T16:04:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20388.698458 secs 2024-04-21T16:04:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20388.698458 secs 2024-04-21T16:04:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:39 smithi077 ceph-mon[27902]: pgmap v10966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:39.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:39 smithi191 ceph-mon[31636]: pgmap v10966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:39.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:39 smithi170 ceph-mon[31212]: pgmap v10966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20390.460911 secs 2024-04-21T16:04:40.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20390.460911 secs 2024-04-21T16:04:40.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20390.460911 secs 2024-04-21T16:04:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:41 smithi077 ceph-mon[27902]: pgmap v10967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:41 smithi191 ceph-mon[31636]: pgmap v10967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:41.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:41 smithi170 ceph-mon[31212]: pgmap v10967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20393.698599 secs 2024-04-21T16:04:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:43 smithi191 ceph-mon[31636]: pgmap v10968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20393.698599 secs 2024-04-21T16:04:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:43 smithi170 ceph-mon[31212]: pgmap v10968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20393.698599 secs 2024-04-21T16:04:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:43 smithi077 ceph-mon[27902]: pgmap v10968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20395.461027 secs 2024-04-21T16:04:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:45 smithi191 ceph-mon[31636]: pgmap v10969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20395.461027 secs 2024-04-21T16:04:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:45 smithi170 ceph-mon[31212]: pgmap v10969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20395.461027 secs 2024-04-21T16:04:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:45 smithi077 ceph-mon[27902]: pgmap v10969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:47 smithi191 ceph-mon[31636]: pgmap v10970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:47 smithi170 ceph-mon[31212]: pgmap v10970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:47.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:47 smithi077 ceph-mon[27902]: pgmap v10970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:48.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20398.698721 secs 2024-04-21T16:04:48.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20398.698721 secs 2024-04-21T16:04:48.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20398.698721 secs 2024-04-21T16:04:49.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:49 smithi191 ceph-mon[31636]: pgmap v10971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:49 smithi170 ceph-mon[31212]: pgmap v10971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:49 smithi077 ceph-mon[27902]: pgmap v10971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20400.461141 secs 2024-04-21T16:04:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20400.461141 secs 2024-04-21T16:04:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20400.461141 secs 2024-04-21T16:04:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:51 smithi191 ceph-mon[31636]: pgmap v10972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:51 smithi170 ceph-mon[31212]: pgmap v10972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:51 smithi077 ceph-mon[27902]: pgmap v10972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:04:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20403.698844 secs 2024-04-21T16:04:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:53 smithi191 ceph-mon[31636]: pgmap v10973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20403.698844 secs 2024-04-21T16:04:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:53 smithi170 ceph-mon[31212]: pgmap v10973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20403.698844 secs 2024-04-21T16:04:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:53 smithi077 ceph-mon[27902]: pgmap v10973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:04:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20405.461208 secs 2024-04-21T16:04:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:55 smithi191 ceph-mon[31636]: pgmap v10974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:04:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:04:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20405.461208 secs 2024-04-21T16:04:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:55 smithi170 ceph-mon[31212]: pgmap v10974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:04:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:04:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20405.461208 secs 2024-04-21T16:04:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:55 smithi077 ceph-mon[27902]: pgmap v10974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:04:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:04:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:04:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:04:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:04:56.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:04:56.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:04:56.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:04:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:04:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:04:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:04:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:04:57.174+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:04:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:04:57.174+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:04:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:04:57.177+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:04:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:04:57.177+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:04:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:57 smithi191 ceph-mon[31636]: pgmap v10975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:57 smithi170 ceph-mon[31212]: pgmap v10975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:57 smithi077 ceph-mon[27902]: pgmap v10975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:04:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20408.698985 secs 2024-04-21T16:04:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20408.698985 secs 2024-04-21T16:04:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20408.698985 secs 2024-04-21T16:04:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:04:59 smithi191 ceph-mon[31636]: pgmap v10976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:04:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:04:59 smithi170 ceph-mon[31212]: pgmap v10976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:04:59.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:04:59 smithi077 ceph-mon[27902]: pgmap v10976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:05:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:00.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20410.461299 secs 2024-04-21T16:05:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20410.461299 secs 2024-04-21T16:05:00.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20410.461299 secs 2024-04-21T16:05:01.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:01 smithi191 ceph-mon[31636]: pgmap v10977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:05:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:01 smithi170 ceph-mon[31212]: pgmap v10977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:05:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:01 smithi077 ceph-mon[27902]: pgmap v10977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:05:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20413.699139 secs 2024-04-21T16:05:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:03 smithi191 ceph-mon[31636]: pgmap v10978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20413.699139 secs 2024-04-21T16:05:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:03 smithi170 ceph-mon[31212]: pgmap v10978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20413.699139 secs 2024-04-21T16:05:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:03 smithi077 ceph-mon[27902]: pgmap v10978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20415.461419 secs 2024-04-21T16:05:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:05 smithi191 ceph-mon[31636]: pgmap v10979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:05 smithi191 ceph-mon[31636]: osdmap e758: 12 total, 12 up, 12 in 2024-04-21T16:05:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20415.461419 secs 2024-04-21T16:05:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:05 smithi170 ceph-mon[31212]: pgmap v10979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:05 smithi170 ceph-mon[31212]: osdmap e758: 12 total, 12 up, 12 in 2024-04-21T16:05:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20415.461419 secs 2024-04-21T16:05:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:05 smithi077 ceph-mon[27902]: pgmap v10979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:05 smithi077 ceph-mon[27902]: osdmap e758: 12 total, 12 up, 12 in 2024-04-21T16:05:07.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:07 smithi191 ceph-mon[31636]: pgmap v10981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:07.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:07 smithi170 ceph-mon[31212]: pgmap v10981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:07 smithi077 ceph-mon[27902]: pgmap v10981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:08.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20418.699282 secs 2024-04-21T16:05:08.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20418.699282 secs 2024-04-21T16:05:08.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20418.699282 secs 2024-04-21T16:05:09.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:09 smithi191 ceph-mon[31636]: pgmap v10982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:09.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:09 smithi170 ceph-mon[31212]: pgmap v10982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:09 smithi077 ceph-mon[27902]: pgmap v10982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:10.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20420.461552 secs 2024-04-21T16:05:10.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20420.461552 secs 2024-04-21T16:05:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20420.461552 secs 2024-04-21T16:05:11.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:11 smithi191 ceph-mon[31636]: pgmap v10983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:11.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:11 smithi191 ceph-mon[31636]: osdmap e759: 12 total, 12 up, 12 in 2024-04-21T16:05:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:11 smithi170 ceph-mon[31212]: pgmap v10983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:11 smithi170 ceph-mon[31212]: osdmap e759: 12 total, 12 up, 12 in 2024-04-21T16:05:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:11 smithi077 ceph-mon[27902]: pgmap v10983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:05:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:11 smithi077 ceph-mon[27902]: osdmap e759: 12 total, 12 up, 12 in 2024-04-21T16:05:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20423.699406 secs 2024-04-21T16:05:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:13 smithi170 ceph-mon[31212]: pgmap v10985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:05:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20423.699406 secs 2024-04-21T16:05:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:13 smithi077 ceph-mon[27902]: pgmap v10985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:05:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20423.699406 secs 2024-04-21T16:05:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:13 smithi191 ceph-mon[31636]: pgmap v10985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:05:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20425.461687 secs 2024-04-21T16:05:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:15 smithi170 ceph-mon[31212]: pgmap v10986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:05:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20425.461687 secs 2024-04-21T16:05:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:15 smithi077 ceph-mon[27902]: pgmap v10986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:05:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20425.461687 secs 2024-04-21T16:05:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:15 smithi191 ceph-mon[31636]: pgmap v10986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:05:16.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:16 smithi170 ceph-mon[31212]: pgmap v10987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:16.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:16 smithi077 ceph-mon[27902]: pgmap v10987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:16.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:16 smithi191 ceph-mon[31636]: pgmap v10987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:17.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20428.699540 secs 2024-04-21T16:05:17.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20428.699540 secs 2024-04-21T16:05:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20428.699540 secs 2024-04-21T16:05:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:18 smithi170 ceph-mon[31212]: pgmap v10988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:18 smithi077 ceph-mon[27902]: pgmap v10988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:18 smithi191 ceph-mon[31636]: pgmap v10988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20430.461809 secs 2024-04-21T16:05:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20430.461809 secs 2024-04-21T16:05:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20430.461809 secs 2024-04-21T16:05:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:20 smithi170 ceph-mon[31212]: pgmap v10989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:20 smithi077 ceph-mon[27902]: pgmap v10989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:20 smithi191 ceph-mon[31636]: pgmap v10989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:05:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20433.699639 secs 2024-04-21T16:05:23.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:23 smithi077 ceph-mon[27902]: pgmap v10990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:05:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20433.699639 secs 2024-04-21T16:05:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:23 smithi191 ceph-mon[31636]: pgmap v10990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:05:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20433.699639 secs 2024-04-21T16:05:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:23 smithi170 ceph-mon[31212]: pgmap v10990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:05:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:25.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20435.461940 secs 2024-04-21T16:05:25.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:25 smithi077 ceph-mon[27902]: pgmap v10991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20435.461940 secs 2024-04-21T16:05:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:25 smithi191 ceph-mon[31636]: pgmap v10991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20435.461940 secs 2024-04-21T16:05:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:25 smithi170 ceph-mon[31212]: pgmap v10991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:27.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:27 smithi191 ceph-mon[31636]: pgmap v10992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:27.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:27 smithi170 ceph-mon[31212]: pgmap v10992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:27.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:27 smithi077 ceph-mon[27902]: pgmap v10992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:28.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20438.699784 secs 2024-04-21T16:05:28.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20438.699784 secs 2024-04-21T16:05:28.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20438.699784 secs 2024-04-21T16:05:29.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:29 smithi191 ceph-mon[31636]: pgmap v10993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:29.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:29 smithi170 ceph-mon[31212]: pgmap v10993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:29.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:29 smithi077 ceph-mon[27902]: pgmap v10993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:30.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20440.462022 secs 2024-04-21T16:05:30.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20440.462022 secs 2024-04-21T16:05:30.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20440.462022 secs 2024-04-21T16:05:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:31 smithi191 ceph-mon[31636]: pgmap v10994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:31 smithi170 ceph-mon[31212]: pgmap v10994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:31.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:31 smithi077 ceph-mon[27902]: pgmap v10994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20443.699845 secs 2024-04-21T16:05:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:33 smithi191 ceph-mon[31636]: pgmap v10995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20443.699845 secs 2024-04-21T16:05:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:33 smithi170 ceph-mon[31212]: pgmap v10995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:33.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20443.699845 secs 2024-04-21T16:05:33.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:33 smithi077 ceph-mon[27902]: pgmap v10995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20445.462141 secs 2024-04-21T16:05:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:35 smithi191 ceph-mon[31636]: pgmap v10996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20445.462141 secs 2024-04-21T16:05:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:35 smithi170 ceph-mon[31212]: pgmap v10996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:35.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20445.462141 secs 2024-04-21T16:05:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:35 smithi077 ceph-mon[27902]: pgmap v10996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:37.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:37 smithi191 ceph-mon[31636]: pgmap v10997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:37.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:37 smithi170 ceph-mon[31212]: pgmap v10997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:37.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:37 smithi077 ceph-mon[27902]: pgmap v10997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:38.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20448.699956 secs 2024-04-21T16:05:38.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20448.699956 secs 2024-04-21T16:05:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20448.699956 secs 2024-04-21T16:05:39.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:39 smithi191 ceph-mon[31636]: pgmap v10998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:39.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:39 smithi170 ceph-mon[31212]: pgmap v10998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:39 smithi077 ceph-mon[27902]: pgmap v10998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:40.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20450.462293 secs 2024-04-21T16:05:40.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20450.462293 secs 2024-04-21T16:05:40.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20450.462293 secs 2024-04-21T16:05:41.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:41 smithi191 ceph-mon[31636]: pgmap v10999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:41.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:41 smithi170 ceph-mon[31212]: pgmap v10999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:41 smithi077 ceph-mon[27902]: pgmap v10999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20453.700041 secs 2024-04-21T16:05:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:43 smithi191 ceph-mon[31636]: pgmap v11000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20453.700041 secs 2024-04-21T16:05:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:43 smithi170 ceph-mon[31212]: pgmap v11000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20453.700041 secs 2024-04-21T16:05:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:43 smithi077 ceph-mon[27902]: pgmap v11000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20455.462415 secs 2024-04-21T16:05:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:45 smithi191 ceph-mon[31636]: pgmap v11001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20455.462415 secs 2024-04-21T16:05:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:45 smithi170 ceph-mon[31212]: pgmap v11001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20455.462415 secs 2024-04-21T16:05:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:45 smithi077 ceph-mon[27902]: pgmap v11001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:47 smithi191 ceph-mon[31636]: pgmap v11002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:47 smithi170 ceph-mon[31212]: pgmap v11002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:47.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:47 smithi077 ceph-mon[27902]: pgmap v11002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:48.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20458.700167 secs 2024-04-21T16:05:48.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20458.700167 secs 2024-04-21T16:05:48.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20458.700167 secs 2024-04-21T16:05:49.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:49 smithi191 ceph-mon[31636]: pgmap v11003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:49 smithi170 ceph-mon[31212]: pgmap v11003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:49.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:49 smithi077 ceph-mon[27902]: pgmap v11003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20460.462554 secs 2024-04-21T16:05:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20460.462554 secs 2024-04-21T16:05:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20460.462554 secs 2024-04-21T16:05:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:51 smithi191 ceph-mon[31636]: pgmap v11004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:51 smithi170 ceph-mon[31212]: pgmap v11004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:51 smithi077 ceph-mon[27902]: pgmap v11004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20463.700295 secs 2024-04-21T16:05:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:53 smithi191 ceph-mon[31636]: pgmap v11005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20463.700295 secs 2024-04-21T16:05:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:53 smithi170 ceph-mon[31212]: pgmap v11005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20463.700295 secs 2024-04-21T16:05:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:53 smithi077 ceph-mon[27902]: pgmap v11005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:05:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20465.462706 secs 2024-04-21T16:05:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:55 smithi191 ceph-mon[31636]: pgmap v11006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20465.462706 secs 2024-04-21T16:05:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:55 smithi170 ceph-mon[31212]: pgmap v11006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20465.462706 secs 2024-04-21T16:05:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:55 smithi077 ceph-mon[27902]: pgmap v11006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:05:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:05:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:05:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:05:56.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:05:56.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:05:56.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:05:56.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:05:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:05:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:05:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:05:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:05:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:57 smithi191 ceph-mon[31636]: pgmap v11007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:57 smithi170 ceph-mon[31212]: pgmap v11007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:57.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:57 smithi077 ceph-mon[27902]: pgmap v11007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:05:58.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20468.700418 secs 2024-04-21T16:05:58.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20468.700418 secs 2024-04-21T16:05:58.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20468.700418 secs 2024-04-21T16:05:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:05:59 smithi170 ceph-mon[31212]: pgmap v11008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:59.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:05:59 smithi077 ceph-mon[27902]: pgmap v11008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:05:59.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:05:59 smithi191 ceph-mon[31636]: pgmap v11008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20470.462830 secs 2024-04-21T16:06:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20470.462830 secs 2024-04-21T16:06:00.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20470.462830 secs 2024-04-21T16:06:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:01 smithi170 ceph-mon[31212]: pgmap v11009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:01.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:01 smithi077 ceph-mon[27902]: pgmap v11009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:01 smithi191 ceph-mon[31636]: pgmap v11009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20473.700549 secs 2024-04-21T16:06:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:03 smithi170 ceph-mon[31212]: pgmap v11010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T16:06:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20473.700549 secs 2024-04-21T16:06:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:03 smithi077 ceph-mon[27902]: pgmap v11010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T16:06:03.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20473.700549 secs 2024-04-21T16:06:03.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:03 smithi191 ceph-mon[31636]: pgmap v11010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T16:06:04.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20475.462954 secs 2024-04-21T16:06:04.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20475.462954 secs 2024-04-21T16:06:04.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20475.462954 secs 2024-04-21T16:06:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:05 smithi170 ceph-mon[31212]: pgmap v11011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:06:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:05 smithi170 ceph-mon[31212]: osdmap e760: 12 total, 12 up, 12 in 2024-04-21T16:06:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:05 smithi077 ceph-mon[27902]: pgmap v11011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:06:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:05 smithi077 ceph-mon[27902]: osdmap e760: 12 total, 12 up, 12 in 2024-04-21T16:06:05.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:05 smithi191 ceph-mon[31636]: pgmap v11011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:06:05.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:05 smithi191 ceph-mon[31636]: osdmap e760: 12 total, 12 up, 12 in 2024-04-21T16:06:06.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:06 smithi170 ceph-mon[31212]: pgmap v11013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:06.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:06 smithi077 ceph-mon[27902]: pgmap v11013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:06.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:06 smithi191 ceph-mon[31636]: pgmap v11013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:07.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20478.700675 secs 2024-04-21T16:06:07.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20478.700675 secs 2024-04-21T16:06:07.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20478.700675 secs 2024-04-21T16:06:08.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:08 smithi170 ceph-mon[31212]: pgmap v11014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:08.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:08 smithi077 ceph-mon[27902]: pgmap v11014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:08 smithi191 ceph-mon[31636]: pgmap v11014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20480.463083 secs 2024-04-21T16:06:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20480.463083 secs 2024-04-21T16:06:09.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20480.463083 secs 2024-04-21T16:06:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:10 smithi077 ceph-mon[27902]: pgmap v11015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:10 smithi191 ceph-mon[31636]: pgmap v11015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:10 smithi170 ceph-mon[31212]: pgmap v11015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:06:12.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:11 smithi170 ceph-mon[31212]: osdmap e761: 12 total, 12 up, 12 in 2024-04-21T16:06:12.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:11 smithi077 ceph-mon[27902]: osdmap e761: 12 total, 12 up, 12 in 2024-04-21T16:06:12.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:11 smithi191 ceph-mon[31636]: osdmap e761: 12 total, 12 up, 12 in 2024-04-21T16:06:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20483.700797 secs 2024-04-21T16:06:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:12 smithi170 ceph-mon[31212]: pgmap v11017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T16:06:13.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20483.700797 secs 2024-04-21T16:06:13.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:12 smithi077 ceph-mon[27902]: pgmap v11017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T16:06:13.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20483.700797 secs 2024-04-21T16:06:13.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:12 smithi191 ceph-mon[31636]: pgmap v11017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T16:06:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20485.463208 secs 2024-04-21T16:06:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:15 smithi191 ceph-mon[31636]: pgmap v11018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:06:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20485.463208 secs 2024-04-21T16:06:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:15 smithi170 ceph-mon[31212]: pgmap v11018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:06:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20485.463208 secs 2024-04-21T16:06:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:15 smithi077 ceph-mon[27902]: pgmap v11018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:06:17.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:17 smithi191 ceph-mon[31636]: pgmap v11019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:17.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:17 smithi170 ceph-mon[31212]: pgmap v11019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:17.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:17 smithi077 ceph-mon[27902]: pgmap v11019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:18.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20488.700865 secs 2024-04-21T16:06:18.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20488.700865 secs 2024-04-21T16:06:18.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20488.700865 secs 2024-04-21T16:06:19.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:19 smithi191 ceph-mon[31636]: pgmap v11020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:19.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:19 smithi170 ceph-mon[31212]: pgmap v11020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:19 smithi077 ceph-mon[27902]: pgmap v11020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:20.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20490.463293 secs 2024-04-21T16:06:20.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20490.463293 secs 2024-04-21T16:06:20.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20490.463293 secs 2024-04-21T16:06:21.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:21 smithi191 ceph-mon[31636]: pgmap v11021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:21 smithi170 ceph-mon[31212]: pgmap v11021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:21.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:21 smithi077 ceph-mon[27902]: pgmap v11021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:06:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20493.700989 secs 2024-04-21T16:06:23.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:23 smithi191 ceph-mon[31636]: pgmap v11022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:06:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20493.700989 secs 2024-04-21T16:06:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:23 smithi170 ceph-mon[31212]: pgmap v11022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:06:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20493.700989 secs 2024-04-21T16:06:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:23 smithi077 ceph-mon[27902]: pgmap v11022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:06:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20495.463369 secs 2024-04-21T16:06:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:25 smithi191 ceph-mon[31636]: pgmap v11023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20495.463369 secs 2024-04-21T16:06:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:25 smithi170 ceph-mon[31212]: pgmap v11023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20495.463369 secs 2024-04-21T16:06:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:25 smithi077 ceph-mon[27902]: pgmap v11023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:27.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:27 smithi191 ceph-mon[31636]: pgmap v11024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:27.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:27 smithi170 ceph-mon[31212]: pgmap v11024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:27.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:27 smithi077 ceph-mon[27902]: pgmap v11024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:28.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20498.701079 secs 2024-04-21T16:06:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20498.701079 secs 2024-04-21T16:06:28.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20498.701079 secs 2024-04-21T16:06:29.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:29 smithi191 ceph-mon[31636]: pgmap v11025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:29 smithi170 ceph-mon[31212]: pgmap v11025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:29.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:29 smithi077 ceph-mon[27902]: pgmap v11025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20500.463509 secs 2024-04-21T16:06:30.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20500.463509 secs 2024-04-21T16:06:30.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20500.463509 secs 2024-04-21T16:06:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:31 smithi191 ceph-mon[31636]: pgmap v11026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:31 smithi170 ceph-mon[31212]: pgmap v11026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:31.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:31 smithi077 ceph-mon[27902]: pgmap v11026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20503.701204 secs 2024-04-21T16:06:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:33 smithi191 ceph-mon[31636]: pgmap v11027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20503.701204 secs 2024-04-21T16:06:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:33 smithi170 ceph-mon[31212]: pgmap v11027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20503.701204 secs 2024-04-21T16:06:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:33 smithi077 ceph-mon[27902]: pgmap v11027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20505.463631 secs 2024-04-21T16:06:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:35 smithi191 ceph-mon[31636]: pgmap v11028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20505.463631 secs 2024-04-21T16:06:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:35 smithi170 ceph-mon[31212]: pgmap v11028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20505.463631 secs 2024-04-21T16:06:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:35 smithi077 ceph-mon[27902]: pgmap v11028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:37.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:37 smithi191 ceph-mon[31636]: pgmap v11029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:37.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:37 smithi170 ceph-mon[31212]: pgmap v11029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:37.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:37 smithi077 ceph-mon[27902]: pgmap v11029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:38.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20508.701322 secs 2024-04-21T16:06:38.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20508.701322 secs 2024-04-21T16:06:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20508.701322 secs 2024-04-21T16:06:39.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:39 smithi191 ceph-mon[31636]: pgmap v11030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:39.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:39 smithi170 ceph-mon[31212]: pgmap v11030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:39 smithi077 ceph-mon[27902]: pgmap v11030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:40.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20510.463758 secs 2024-04-21T16:06:40.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20510.463758 secs 2024-04-21T16:06:40.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20510.463758 secs 2024-04-21T16:06:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:41 smithi170 ceph-mon[31212]: pgmap v11031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:41 smithi077 ceph-mon[27902]: pgmap v11031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:41.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:41 smithi191 ceph-mon[31636]: pgmap v11031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20513.701465 secs 2024-04-21T16:06:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:43 smithi170 ceph-mon[31212]: pgmap v11032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20513.701465 secs 2024-04-21T16:06:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:43 smithi077 ceph-mon[27902]: pgmap v11032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20513.701465 secs 2024-04-21T16:06:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:43 smithi191 ceph-mon[31636]: pgmap v11032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20515.463901 secs 2024-04-21T16:06:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:45 smithi170 ceph-mon[31212]: pgmap v11033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20515.463901 secs 2024-04-21T16:06:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:45 smithi077 ceph-mon[27902]: pgmap v11033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:45.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20515.463901 secs 2024-04-21T16:06:45.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:45 smithi191 ceph-mon[31636]: pgmap v11033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:47 smithi170 ceph-mon[31212]: pgmap v11034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:47.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:47 smithi077 ceph-mon[27902]: pgmap v11034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:47.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:47 smithi191 ceph-mon[31636]: pgmap v11034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20518.701593 secs 2024-04-21T16:06:48.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20518.701593 secs 2024-04-21T16:06:48.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20518.701593 secs 2024-04-21T16:06:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:49 smithi170 ceph-mon[31212]: pgmap v11035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20520.464025 secs 2024-04-21T16:06:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:49 smithi077 ceph-mon[27902]: pgmap v11035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20520.464025 secs 2024-04-21T16:06:49.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:49 smithi191 ceph-mon[31636]: pgmap v11035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20520.464025 secs 2024-04-21T16:06:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:50 smithi170 ceph-mon[31212]: pgmap v11036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:50 smithi077 ceph-mon[27902]: pgmap v11036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:50 smithi191 ceph-mon[31636]: pgmap v11036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20523.701734 secs 2024-04-21T16:06:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:53 smithi191 ceph-mon[31636]: pgmap v11037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20523.701734 secs 2024-04-21T16:06:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:53 smithi170 ceph-mon[31212]: pgmap v11037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20523.701734 secs 2024-04-21T16:06:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:53 smithi077 ceph-mon[27902]: pgmap v11037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:06:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20525.464084 secs 2024-04-21T16:06:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:55 smithi191 ceph-mon[31636]: pgmap v11038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20525.464084 secs 2024-04-21T16:06:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:55 smithi170 ceph-mon[31212]: pgmap v11038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20525.464084 secs 2024-04-21T16:06:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:55 smithi077 ceph-mon[27902]: pgmap v11038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:57 smithi191 ceph-mon[31636]: pgmap v11039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:06:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:06:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:06:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:06:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:57 smithi170 ceph-mon[31212]: pgmap v11039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:06:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:06:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:06:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:06:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:57 smithi077 ceph-mon[27902]: pgmap v11039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:06:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:06:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:06:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:06:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:06:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20528.701827 secs 2024-04-21T16:06:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20528.701827 secs 2024-04-21T16:06:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20528.701827 secs 2024-04-21T16:06:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:06:59 smithi191 ceph-mon[31636]: pgmap v11040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:06:59 smithi170 ceph-mon[31212]: pgmap v11040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:06:59.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:06:59 smithi077 ceph-mon[27902]: pgmap v11040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20530.464242 secs 2024-04-21T16:07:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20530.464242 secs 2024-04-21T16:07:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20530.464242 secs 2024-04-21T16:07:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:01 smithi191 ceph-mon[31636]: pgmap v11041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:01 smithi170 ceph-mon[31212]: pgmap v11041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:01 smithi077 ceph-mon[27902]: pgmap v11041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20533.701916 secs 2024-04-21T16:07:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:03 smithi191 ceph-mon[31636]: pgmap v11042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20533.701916 secs 2024-04-21T16:07:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:03 smithi170 ceph-mon[31212]: pgmap v11042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20533.701916 secs 2024-04-21T16:07:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:03 smithi077 ceph-mon[27902]: pgmap v11042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20535.464319 secs 2024-04-21T16:07:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:05 smithi191 ceph-mon[31636]: pgmap v11043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:05 smithi191 ceph-mon[31636]: osdmap e762: 12 total, 12 up, 12 in 2024-04-21T16:07:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20535.464319 secs 2024-04-21T16:07:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:05 smithi170 ceph-mon[31212]: pgmap v11043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:05 smithi170 ceph-mon[31212]: osdmap e762: 12 total, 12 up, 12 in 2024-04-21T16:07:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20535.464319 secs 2024-04-21T16:07:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:05 smithi077 ceph-mon[27902]: pgmap v11043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:05 smithi077 ceph-mon[27902]: osdmap e762: 12 total, 12 up, 12 in 2024-04-21T16:07:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:07 smithi191 ceph-mon[31636]: pgmap v11045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:07 smithi170 ceph-mon[31212]: pgmap v11045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:07 smithi077 ceph-mon[27902]: pgmap v11045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20538.701981 secs 2024-04-21T16:07:08.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20538.701981 secs 2024-04-21T16:07:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20538.701981 secs 2024-04-21T16:07:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:09 smithi191 ceph-mon[31636]: pgmap v11046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:09 smithi170 ceph-mon[31212]: pgmap v11046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:09 smithi077 ceph-mon[27902]: pgmap v11046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20540.464420 secs 2024-04-21T16:07:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20540.464420 secs 2024-04-21T16:07:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20540.464420 secs 2024-04-21T16:07:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:11 smithi191 ceph-mon[31636]: pgmap v11047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:11 smithi191 ceph-mon[31636]: osdmap e763: 12 total, 12 up, 12 in 2024-04-21T16:07:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:11 smithi170 ceph-mon[31212]: pgmap v11047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:11 smithi170 ceph-mon[31212]: osdmap e763: 12 total, 12 up, 12 in 2024-04-21T16:07:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:11 smithi077 ceph-mon[27902]: pgmap v11047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:07:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:11 smithi077 ceph-mon[27902]: osdmap e763: 12 total, 12 up, 12 in 2024-04-21T16:07:12.196 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:12.191+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:07:12.196 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:12.191+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:07:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:12.191+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:07:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:12.191+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:07:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20543.702130 secs 2024-04-21T16:07:13.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:13 smithi191 ceph-mon[31636]: pgmap v11049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:07:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20543.702130 secs 2024-04-21T16:07:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:13 smithi170 ceph-mon[31212]: pgmap v11049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:07:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20543.702130 secs 2024-04-21T16:07:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:13 smithi077 ceph-mon[27902]: pgmap v11049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:07:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:15.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20545.464534 secs 2024-04-21T16:07:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:15 smithi191 ceph-mon[31636]: pgmap v11050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:07:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20545.464534 secs 2024-04-21T16:07:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:15 smithi170 ceph-mon[31212]: pgmap v11050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:07:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20545.464534 secs 2024-04-21T16:07:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:15 smithi077 ceph-mon[27902]: pgmap v11050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:07:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:17 smithi170 ceph-mon[31212]: pgmap v11051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:17 smithi077 ceph-mon[27902]: pgmap v11051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:17.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:17 smithi191 ceph-mon[31636]: pgmap v11051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20548.702281 secs 2024-04-21T16:07:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20548.702281 secs 2024-04-21T16:07:18.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20548.702281 secs 2024-04-21T16:07:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:19 smithi170 ceph-mon[31212]: pgmap v11052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:19 smithi077 ceph-mon[27902]: pgmap v11052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:19.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:19 smithi191 ceph-mon[31636]: pgmap v11052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20550.464668 secs 2024-04-21T16:07:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20550.464668 secs 2024-04-21T16:07:20.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20550.464668 secs 2024-04-21T16:07:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:21 smithi170 ceph-mon[31212]: pgmap v11053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:21 smithi077 ceph-mon[27902]: pgmap v11053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:21.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:21 smithi191 ceph-mon[31636]: pgmap v11053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:07:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20553.702406 secs 2024-04-21T16:07:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:23 smithi170 ceph-mon[31212]: pgmap v11054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:07:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20553.702406 secs 2024-04-21T16:07:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:23 smithi077 ceph-mon[27902]: pgmap v11054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:07:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20553.702406 secs 2024-04-21T16:07:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:23 smithi191 ceph-mon[31636]: pgmap v11054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:07:24.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20555.464792 secs 2024-04-21T16:07:24.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:24 smithi170 ceph-mon[31212]: pgmap v11055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:24.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20555.464792 secs 2024-04-21T16:07:24.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:24 smithi077 ceph-mon[27902]: pgmap v11055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:24.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20555.464792 secs 2024-04-21T16:07:24.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:24 smithi191 ceph-mon[31636]: pgmap v11055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:27.426 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:27 smithi191 ceph-mon[31636]: pgmap v11056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:27 smithi170 ceph-mon[31212]: pgmap v11056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:27.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:27 smithi077 ceph-mon[27902]: pgmap v11056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:28.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20558.702473 secs 2024-04-21T16:07:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20558.702473 secs 2024-04-21T16:07:28.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20558.702473 secs 2024-04-21T16:07:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:29 smithi191 ceph-mon[31636]: pgmap v11057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:29 smithi170 ceph-mon[31212]: pgmap v11057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:29.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:29 smithi077 ceph-mon[27902]: pgmap v11057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20560.464910 secs 2024-04-21T16:07:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20560.464910 secs 2024-04-21T16:07:30.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20560.464910 secs 2024-04-21T16:07:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:31 smithi191 ceph-mon[31636]: pgmap v11058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:31 smithi170 ceph-mon[31212]: pgmap v11058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:31.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:31 smithi077 ceph-mon[27902]: pgmap v11058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20563.702601 secs 2024-04-21T16:07:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:33 smithi191 ceph-mon[31636]: pgmap v11059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20563.702601 secs 2024-04-21T16:07:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:33 smithi170 ceph-mon[31212]: pgmap v11059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20563.702601 secs 2024-04-21T16:07:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:33 smithi077 ceph-mon[27902]: pgmap v11059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20565.465066 secs 2024-04-21T16:07:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:35 smithi191 ceph-mon[31636]: pgmap v11060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20565.465066 secs 2024-04-21T16:07:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:35 smithi170 ceph-mon[31212]: pgmap v11060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20565.465066 secs 2024-04-21T16:07:35.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:35 smithi077 ceph-mon[27902]: pgmap v11060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:37 smithi191 ceph-mon[31636]: pgmap v11061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:37 smithi170 ceph-mon[31212]: pgmap v11061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:37.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:37 smithi077 ceph-mon[27902]: pgmap v11061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20568.702738 secs 2024-04-21T16:07:38.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20568.702738 secs 2024-04-21T16:07:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20568.702738 secs 2024-04-21T16:07:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:39 smithi191 ceph-mon[31636]: pgmap v11062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:39 smithi170 ceph-mon[31212]: pgmap v11062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:39 smithi077 ceph-mon[27902]: pgmap v11062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20570.465183 secs 2024-04-21T16:07:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20570.465183 secs 2024-04-21T16:07:40.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20570.465183 secs 2024-04-21T16:07:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:41 smithi170 ceph-mon[31212]: pgmap v11063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:41 smithi077 ceph-mon[27902]: pgmap v11063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:41 smithi191 ceph-mon[31636]: pgmap v11063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T16:07:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20573.702862 secs 2024-04-21T16:07:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:43 smithi170 ceph-mon[31212]: pgmap v11064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20573.702862 secs 2024-04-21T16:07:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:43 smithi077 ceph-mon[27902]: pgmap v11064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20573.702862 secs 2024-04-21T16:07:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:43 smithi191 ceph-mon[31636]: pgmap v11064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T16:07:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20575.465246 secs 2024-04-21T16:07:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:45 smithi170 ceph-mon[31212]: pgmap v11065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20575.465246 secs 2024-04-21T16:07:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:45 smithi077 ceph-mon[27902]: pgmap v11065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:45.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20575.465246 secs 2024-04-21T16:07:45.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:45 smithi191 ceph-mon[31636]: pgmap v11065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:47 smithi170 ceph-mon[31212]: pgmap v11066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:47.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:47 smithi077 ceph-mon[27902]: pgmap v11066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:47.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:47 smithi191 ceph-mon[31636]: pgmap v11066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20578.702967 secs 2024-04-21T16:07:48.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20578.702967 secs 2024-04-21T16:07:48.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20578.702967 secs 2024-04-21T16:07:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:49 smithi170 ceph-mon[31212]: pgmap v11067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:49 smithi077 ceph-mon[27902]: pgmap v11067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:49.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:49 smithi191 ceph-mon[31636]: pgmap v11067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20580.465370 secs 2024-04-21T16:07:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20580.465370 secs 2024-04-21T16:07:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20580.465370 secs 2024-04-21T16:07:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:51 smithi170 ceph-mon[31212]: pgmap v11068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:51 smithi077 ceph-mon[27902]: pgmap v11068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:51 smithi191 ceph-mon[31636]: pgmap v11068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20583.703084 secs 2024-04-21T16:07:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:53 smithi170 ceph-mon[31212]: pgmap v11069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20583.703084 secs 2024-04-21T16:07:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:53 smithi077 ceph-mon[27902]: pgmap v11069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:53.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20583.703084 secs 2024-04-21T16:07:53.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:53 smithi191 ceph-mon[31636]: pgmap v11069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:54.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20585.465496 secs 2024-04-21T16:07:54.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:54 smithi170 ceph-mon[31212]: pgmap v11070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:54.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20585.465496 secs 2024-04-21T16:07:54.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:54 smithi077 ceph-mon[27902]: pgmap v11070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20585.465496 secs 2024-04-21T16:07:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:54 smithi191 ceph-mon[31636]: pgmap v11070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:07:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:57.197+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:07:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:57.197+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:07:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:57.197+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:07:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:07:57.197+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:07:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:57 smithi191 ceph-mon[31636]: pgmap v11071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:07:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:57 smithi170 ceph-mon[31212]: pgmap v11071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:07:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:57 smithi077 ceph-mon[27902]: pgmap v11071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:07:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:07:58.462 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20588.703166 secs 2024-04-21T16:07:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:07:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:07:58.463 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:07:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20588.703166 secs 2024-04-21T16:07:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:07:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:07:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:07:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20588.703166 secs 2024-04-21T16:07:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:07:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:07:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:07:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:07:59 smithi191 ceph-mon[31636]: pgmap v11072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:07:59 smithi170 ceph-mon[31212]: pgmap v11072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:07:59.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:07:59 smithi077 ceph-mon[27902]: pgmap v11072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20590.465633 secs 2024-04-21T16:08:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20590.465633 secs 2024-04-21T16:08:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20590.465633 secs 2024-04-21T16:08:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:01 smithi191 ceph-mon[31636]: pgmap v11073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:01 smithi170 ceph-mon[31212]: pgmap v11073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:01 smithi077 ceph-mon[27902]: pgmap v11073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20593.703273 secs 2024-04-21T16:08:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:03 smithi191 ceph-mon[31636]: pgmap v11074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20593.703273 secs 2024-04-21T16:08:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:03 smithi170 ceph-mon[31212]: pgmap v11074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20593.703273 secs 2024-04-21T16:08:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:03 smithi077 ceph-mon[27902]: pgmap v11074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20595.465760 secs 2024-04-21T16:08:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:05 smithi191 ceph-mon[31636]: pgmap v11075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:05 smithi191 ceph-mon[31636]: osdmap e764: 12 total, 12 up, 12 in 2024-04-21T16:08:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20595.465760 secs 2024-04-21T16:08:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:05 smithi170 ceph-mon[31212]: pgmap v11075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:05 smithi170 ceph-mon[31212]: osdmap e764: 12 total, 12 up, 12 in 2024-04-21T16:08:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20595.465760 secs 2024-04-21T16:08:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:05 smithi077 ceph-mon[27902]: pgmap v11075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:05 smithi077 ceph-mon[27902]: osdmap e764: 12 total, 12 up, 12 in 2024-04-21T16:08:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:07 smithi191 ceph-mon[31636]: pgmap v11077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:07 smithi170 ceph-mon[31212]: pgmap v11077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:07 smithi077 ceph-mon[27902]: pgmap v11077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20598.703378 secs 2024-04-21T16:08:08.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20598.703378 secs 2024-04-21T16:08:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20598.703378 secs 2024-04-21T16:08:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:09 smithi191 ceph-mon[31636]: pgmap v11078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:09 smithi170 ceph-mon[31212]: pgmap v11078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:09 smithi077 ceph-mon[27902]: pgmap v11078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20600.465910 secs 2024-04-21T16:08:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20600.465910 secs 2024-04-21T16:08:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20600.465910 secs 2024-04-21T16:08:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:11 smithi191 ceph-mon[31636]: pgmap v11079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:11 smithi191 ceph-mon[31636]: osdmap e765: 12 total, 12 up, 12 in 2024-04-21T16:08:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:11 smithi170 ceph-mon[31212]: pgmap v11079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:11 smithi170 ceph-mon[31212]: osdmap e765: 12 total, 12 up, 12 in 2024-04-21T16:08:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:11 smithi077 ceph-mon[27902]: pgmap v11079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:08:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:11 smithi077 ceph-mon[27902]: osdmap e765: 12 total, 12 up, 12 in 2024-04-21T16:08:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20603.703518 secs 2024-04-21T16:08:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:13 smithi170 ceph-mon[31212]: pgmap v11081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:08:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20603.703518 secs 2024-04-21T16:08:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:13 smithi077 ceph-mon[27902]: pgmap v11081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:08:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20603.703518 secs 2024-04-21T16:08:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:13 smithi191 ceph-mon[31636]: pgmap v11081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:08:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20605.466038 secs 2024-04-21T16:08:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:15 smithi170 ceph-mon[31212]: pgmap v11082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:08:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20605.466038 secs 2024-04-21T16:08:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:15 smithi077 ceph-mon[27902]: pgmap v11082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:08:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20605.466038 secs 2024-04-21T16:08:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:15 smithi191 ceph-mon[31636]: pgmap v11082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:08:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:17 smithi170 ceph-mon[31212]: pgmap v11083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:17.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:17 smithi077 ceph-mon[27902]: pgmap v11083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:17.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:17 smithi191 ceph-mon[31636]: pgmap v11083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:18.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20608.703637 secs 2024-04-21T16:08:18.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20608.703637 secs 2024-04-21T16:08:18.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20608.703637 secs 2024-04-21T16:08:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:19 smithi170 ceph-mon[31212]: pgmap v11084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:19 smithi077 ceph-mon[27902]: pgmap v11084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:19.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:19 smithi191 ceph-mon[31636]: pgmap v11084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:20.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20610.466157 secs 2024-04-21T16:08:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20610.466157 secs 2024-04-21T16:08:20.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20610.466157 secs 2024-04-21T16:08:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:21 smithi170 ceph-mon[31212]: pgmap v11085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:21 smithi077 ceph-mon[27902]: pgmap v11085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:21.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:21 smithi191 ceph-mon[31636]: pgmap v11085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:08:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20613.703745 secs 2024-04-21T16:08:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:23 smithi170 ceph-mon[31212]: pgmap v11086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:08:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20613.703745 secs 2024-04-21T16:08:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:23 smithi077 ceph-mon[27902]: pgmap v11086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:08:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20613.703745 secs 2024-04-21T16:08:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:23 smithi191 ceph-mon[31636]: pgmap v11086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-21T16:08:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20615.466279 secs 2024-04-21T16:08:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:25 smithi170 ceph-mon[31212]: pgmap v11087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20615.466279 secs 2024-04-21T16:08:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:25 smithi077 ceph-mon[27902]: pgmap v11087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20615.466279 secs 2024-04-21T16:08:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:25 smithi191 ceph-mon[31636]: pgmap v11087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:27.525 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:27 smithi191 ceph-mon[31636]: pgmap v11088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:27 smithi170 ceph-mon[31212]: pgmap v11088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:27.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:27 smithi077 ceph-mon[27902]: pgmap v11088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20618.703831 secs 2024-04-21T16:08:28.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20618.703831 secs 2024-04-21T16:08:28.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20618.703831 secs 2024-04-21T16:08:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:29 smithi170 ceph-mon[31212]: pgmap v11089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:29.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:29 smithi077 ceph-mon[27902]: pgmap v11089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:29.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:29 smithi191 ceph-mon[31636]: pgmap v11089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:30.268 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20620.466430 secs 2024-04-21T16:08:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20620.466430 secs 2024-04-21T16:08:30.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20620.466430 secs 2024-04-21T16:08:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:31 smithi170 ceph-mon[31212]: pgmap v11090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:31.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:31 smithi077 ceph-mon[27902]: pgmap v11090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:31 smithi191 ceph-mon[31636]: pgmap v11090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:32.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:32 smithi170 ceph-mon[31212]: pgmap v11091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:32.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:32 smithi077 ceph-mon[27902]: pgmap v11091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:32.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:32 smithi191 ceph-mon[31636]: pgmap v11091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20623.703947 secs 2024-04-21T16:08:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20623.703947 secs 2024-04-21T16:08:33.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20623.703947 secs 2024-04-21T16:08:34.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20625.466568 secs 2024-04-21T16:08:34.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:34 smithi170 ceph-mon[31212]: pgmap v11092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:34.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20625.466568 secs 2024-04-21T16:08:34.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:34 smithi077 ceph-mon[27902]: pgmap v11092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:34.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20625.466568 secs 2024-04-21T16:08:34.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:34 smithi191 ceph-mon[31636]: pgmap v11092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:36 smithi077 ceph-mon[27902]: pgmap v11093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:37.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:36 smithi191 ceph-mon[31636]: pgmap v11093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:37.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:36 smithi170 ceph-mon[31212]: pgmap v11093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20628.704073 secs 2024-04-21T16:08:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20628.704073 secs 2024-04-21T16:08:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20628.704073 secs 2024-04-21T16:08:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:38 smithi077 ceph-mon[27902]: pgmap v11094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:38 smithi191 ceph-mon[31636]: pgmap v11094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:39.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:38 smithi170 ceph-mon[31212]: pgmap v11094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20630.466679 secs 2024-04-21T16:08:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20630.466679 secs 2024-04-21T16:08:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20630.466679 secs 2024-04-21T16:08:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:40 smithi077 ceph-mon[27902]: pgmap v11095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:40 smithi191 ceph-mon[31636]: pgmap v11095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:40 smithi170 ceph-mon[31212]: pgmap v11095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20633.704194 secs 2024-04-21T16:08:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:43 smithi191 ceph-mon[31636]: pgmap v11096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20633.704194 secs 2024-04-21T16:08:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:43 smithi170 ceph-mon[31212]: pgmap v11096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20633.704194 secs 2024-04-21T16:08:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:43 smithi077 ceph-mon[27902]: pgmap v11096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20635.466826 secs 2024-04-21T16:08:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:45 smithi191 ceph-mon[31636]: pgmap v11097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20635.466826 secs 2024-04-21T16:08:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:45 smithi170 ceph-mon[31212]: pgmap v11097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:45.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20635.466826 secs 2024-04-21T16:08:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:45 smithi077 ceph-mon[27902]: pgmap v11097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:47 smithi191 ceph-mon[31636]: pgmap v11098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:47 smithi170 ceph-mon[31212]: pgmap v11098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:47 smithi077 ceph-mon[27902]: pgmap v11098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:48.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20638.704325 secs 2024-04-21T16:08:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20638.704325 secs 2024-04-21T16:08:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20638.704325 secs 2024-04-21T16:08:49.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:49 smithi191 ceph-mon[31636]: pgmap v11099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:49 smithi170 ceph-mon[31212]: pgmap v11099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:49 smithi077 ceph-mon[27902]: pgmap v11099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:50.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20640.466953 secs 2024-04-21T16:08:50.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20640.466953 secs 2024-04-21T16:08:50.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20640.466953 secs 2024-04-21T16:08:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:51 smithi191 ceph-mon[31636]: pgmap v11100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:51 smithi170 ceph-mon[31212]: pgmap v11100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:51.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:51 smithi077 ceph-mon[27902]: pgmap v11100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:08:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20643.704461 secs 2024-04-21T16:08:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:53 smithi191 ceph-mon[31636]: pgmap v11101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20643.704461 secs 2024-04-21T16:08:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:53 smithi170 ceph-mon[31212]: pgmap v11101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20643.704461 secs 2024-04-21T16:08:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:53 smithi077 ceph-mon[27902]: pgmap v11101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:08:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20645.467017 secs 2024-04-21T16:08:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:55 smithi191 ceph-mon[31636]: pgmap v11102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20645.467017 secs 2024-04-21T16:08:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:55 smithi170 ceph-mon[31212]: pgmap v11102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20645.467017 secs 2024-04-21T16:08:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:55 smithi077 ceph-mon[27902]: pgmap v11102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:57 smithi170 ceph-mon[31212]: pgmap v11103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:57.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:57 smithi077 ceph-mon[27902]: pgmap v11103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:57.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:57 smithi191 ceph-mon[31636]: pgmap v11103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:08:58.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20648.704576 secs 2024-04-21T16:08:58.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:08:58.628 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20648.704576 secs 2024-04-21T16:08:58.628 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:08:58.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20648.704576 secs 2024-04-21T16:08:58.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:08:59.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:08:59 smithi170 ceph-mon[31212]: pgmap v11104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:59.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:08:59 smithi077 ceph-mon[27902]: pgmap v11104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:08:59.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:08:59 smithi191 ceph-mon[31636]: pgmap v11104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20650.467096 secs 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20650.467096 secs 2024-04-21T16:09:00.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20650.467096 secs 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:00.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: pgmap v11105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:09:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:09:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:09:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:09:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: pgmap v11105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:09:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:09:01.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: pgmap v11105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:09:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:09:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:09:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:09:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:09:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:09:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20653.704692 secs 2024-04-21T16:09:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:03 smithi170 ceph-mon[31212]: pgmap v11106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20653.704692 secs 2024-04-21T16:09:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:03 smithi077 ceph-mon[27902]: pgmap v11106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20653.704692 secs 2024-04-21T16:09:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:03 smithi191 ceph-mon[31636]: pgmap v11106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20655.467168 secs 2024-04-21T16:09:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:05 smithi170 ceph-mon[31212]: pgmap v11107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:05 smithi170 ceph-mon[31212]: osdmap e766: 12 total, 12 up, 12 in 2024-04-21T16:09:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20655.467168 secs 2024-04-21T16:09:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:05 smithi077 ceph-mon[27902]: pgmap v11107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:05 smithi077 ceph-mon[27902]: osdmap e766: 12 total, 12 up, 12 in 2024-04-21T16:09:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20655.467168 secs 2024-04-21T16:09:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:05 smithi191 ceph-mon[31636]: pgmap v11107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:05 smithi191 ceph-mon[31636]: osdmap e766: 12 total, 12 up, 12 in 2024-04-21T16:09:07.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:07 smithi170 ceph-mon[31212]: pgmap v11109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:09:07.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:07 smithi077 ceph-mon[27902]: pgmap v11109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:09:07.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:07 smithi191 ceph-mon[31636]: pgmap v11109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:09:08.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20658.704814 secs 2024-04-21T16:09:08.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20658.704814 secs 2024-04-21T16:09:08.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20658.704814 secs 2024-04-21T16:09:09.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:09 smithi170 ceph-mon[31212]: pgmap v11110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:09:09.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:09 smithi077 ceph-mon[27902]: pgmap v11110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:09:09.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:09 smithi191 ceph-mon[31636]: pgmap v11110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:09:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:10.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20660.467239 secs 2024-04-21T16:09:10.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20660.467239 secs 2024-04-21T16:09:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20660.467239 secs 2024-04-21T16:09:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:11 smithi170 ceph-mon[31212]: pgmap v11111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:09:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:11 smithi170 ceph-mon[31212]: osdmap e767: 12 total, 12 up, 12 in 2024-04-21T16:09:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:11 smithi077 ceph-mon[27902]: pgmap v11111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:09:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:11 smithi077 ceph-mon[27902]: osdmap e767: 12 total, 12 up, 12 in 2024-04-21T16:09:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:11 smithi191 ceph-mon[31636]: pgmap v11111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:09:11.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:11 smithi191 ceph-mon[31636]: osdmap e767: 12 total, 12 up, 12 in 2024-04-21T16:09:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20663.704925 secs 2024-04-21T16:09:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:13 smithi170 ceph-mon[31212]: pgmap v11113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:09:13.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20663.704925 secs 2024-04-21T16:09:13.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:13 smithi077 ceph-mon[27902]: pgmap v11113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:09:13.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20663.704925 secs 2024-04-21T16:09:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:13 smithi191 ceph-mon[31636]: pgmap v11113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:09:14.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20665.467371 secs 2024-04-21T16:09:14.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:14 smithi077 ceph-mon[27902]: pgmap v11114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:09:14.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20665.467371 secs 2024-04-21T16:09:14.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:14 smithi191 ceph-mon[31636]: pgmap v11114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:09:14.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20665.467371 secs 2024-04-21T16:09:14.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:14 smithi170 ceph-mon[31212]: pgmap v11114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:09:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:17.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:17 smithi191 ceph-mon[31636]: pgmap v11115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:09:17.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:17 smithi170 ceph-mon[31212]: pgmap v11115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:09:17.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:17 smithi077 ceph-mon[27902]: pgmap v11115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:09:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20668.705061 secs 2024-04-21T16:09:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20668.705061 secs 2024-04-21T16:09:18.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20668.705061 secs 2024-04-21T16:09:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:19 smithi191 ceph-mon[31636]: pgmap v11116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:09:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:19 smithi170 ceph-mon[31212]: pgmap v11116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:09:19.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:19 smithi077 ceph-mon[27902]: pgmap v11116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:09:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20670.467472 secs 2024-04-21T16:09:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20670.467472 secs 2024-04-21T16:09:20.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20670.467472 secs 2024-04-21T16:09:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:21 smithi191 ceph-mon[31636]: pgmap v11117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:09:21.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:21 smithi170 ceph-mon[31212]: pgmap v11117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:09:21.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:21 smithi077 ceph-mon[27902]: pgmap v11117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:09:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20673.705176 secs 2024-04-21T16:09:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:23 smithi191 ceph-mon[31636]: pgmap v11118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:09:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20673.705176 secs 2024-04-21T16:09:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:23 smithi170 ceph-mon[31212]: pgmap v11118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:09:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20673.705176 secs 2024-04-21T16:09:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:23 smithi077 ceph-mon[27902]: pgmap v11118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:09:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20675.467563 secs 2024-04-21T16:09:25.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:25 smithi191 ceph-mon[31636]: pgmap v11119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20675.467563 secs 2024-04-21T16:09:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:25 smithi170 ceph-mon[31212]: pgmap v11119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20675.467563 secs 2024-04-21T16:09:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:25 smithi077 ceph-mon[27902]: pgmap v11119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:27 smithi170 ceph-mon[31212]: pgmap v11120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:27.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:27 smithi077 ceph-mon[27902]: pgmap v11120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:27.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:27 smithi191 ceph-mon[31636]: pgmap v11120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20678.705287 secs 2024-04-21T16:09:28.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20678.705287 secs 2024-04-21T16:09:28.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20678.705287 secs 2024-04-21T16:09:29.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:29 smithi170 ceph-mon[31212]: pgmap v11121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:29.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:29 smithi077 ceph-mon[27902]: pgmap v11121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:29.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:29 smithi191 ceph-mon[31636]: pgmap v11121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20680.467702 secs 2024-04-21T16:09:30.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20680.467702 secs 2024-04-21T16:09:30.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20680.467702 secs 2024-04-21T16:09:31.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:31 smithi170 ceph-mon[31212]: pgmap v11122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:31.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:31 smithi077 ceph-mon[27902]: pgmap v11122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:31.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:31 smithi191 ceph-mon[31636]: pgmap v11122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20683.705418 secs 2024-04-21T16:09:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:33 smithi170 ceph-mon[31212]: pgmap v11123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20683.705418 secs 2024-04-21T16:09:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:33 smithi077 ceph-mon[27902]: pgmap v11123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20683.705418 secs 2024-04-21T16:09:33.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:33 smithi191 ceph-mon[31636]: pgmap v11123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20685.467824 secs 2024-04-21T16:09:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:35 smithi170 ceph-mon[31212]: pgmap v11124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:35.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20685.467824 secs 2024-04-21T16:09:35.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:35 smithi077 ceph-mon[27902]: pgmap v11124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20685.467824 secs 2024-04-21T16:09:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:35 smithi191 ceph-mon[31636]: pgmap v11124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:37.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:37 smithi170 ceph-mon[31212]: pgmap v11125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:37.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:37 smithi077 ceph-mon[27902]: pgmap v11125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:37 smithi191 ceph-mon[31636]: pgmap v11125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:38.540 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20688.705517 secs 2024-04-21T16:09:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20688.705517 secs 2024-04-21T16:09:38.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20688.705517 secs 2024-04-21T16:09:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:39 smithi170 ceph-mon[31212]: pgmap v11126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:39.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:39 smithi077 ceph-mon[27902]: pgmap v11126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:39.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:39 smithi191 ceph-mon[31636]: pgmap v11126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:40.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20690.467931 secs 2024-04-21T16:09:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20690.467931 secs 2024-04-21T16:09:40.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20690.467931 secs 2024-04-21T16:09:41.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:41 smithi170 ceph-mon[31212]: pgmap v11127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:41 smithi077 ceph-mon[27902]: pgmap v11127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:41 smithi191 ceph-mon[31636]: pgmap v11127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20693.705640 secs 2024-04-21T16:09:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:43 smithi170 ceph-mon[31212]: pgmap v11128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20693.705640 secs 2024-04-21T16:09:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:43 smithi077 ceph-mon[27902]: pgmap v11128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20693.705640 secs 2024-04-21T16:09:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:43 smithi191 ceph-mon[31636]: pgmap v11128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20695.468013 secs 2024-04-21T16:09:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:45 smithi170 ceph-mon[31212]: pgmap v11129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:45.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20695.468013 secs 2024-04-21T16:09:45.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:45 smithi077 ceph-mon[27902]: pgmap v11129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20695.468013 secs 2024-04-21T16:09:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:45 smithi191 ceph-mon[31636]: pgmap v11129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:47 smithi170 ceph-mon[31212]: pgmap v11130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:47 smithi077 ceph-mon[27902]: pgmap v11130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:47.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:47 smithi191 ceph-mon[31636]: pgmap v11130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20698.705744 secs 2024-04-21T16:09:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20698.705744 secs 2024-04-21T16:09:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20698.705744 secs 2024-04-21T16:09:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:49 smithi170 ceph-mon[31212]: pgmap v11131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20700.468085 secs 2024-04-21T16:09:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:49 smithi077 ceph-mon[27902]: pgmap v11131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20700.468085 secs 2024-04-21T16:09:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:49 smithi191 ceph-mon[31636]: pgmap v11131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20700.468085 secs 2024-04-21T16:09:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:50.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:50 smithi170 ceph-mon[31212]: pgmap v11132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:50.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:50 smithi077 ceph-mon[27902]: pgmap v11132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:50.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:50 smithi191 ceph-mon[31636]: pgmap v11132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:09:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20703.705857 secs 2024-04-21T16:09:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:53 smithi191 ceph-mon[31636]: pgmap v11133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20703.705857 secs 2024-04-21T16:09:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:53 smithi170 ceph-mon[31212]: pgmap v11133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20703.705857 secs 2024-04-21T16:09:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:53 smithi077 ceph-mon[27902]: pgmap v11133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:09:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:09:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20705.468219 secs 2024-04-21T16:09:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:55 smithi191 ceph-mon[31636]: pgmap v11134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20705.468219 secs 2024-04-21T16:09:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:55 smithi170 ceph-mon[31212]: pgmap v11134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20705.468219 secs 2024-04-21T16:09:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:55 smithi077 ceph-mon[27902]: pgmap v11134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:57.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:57 smithi191 ceph-mon[31636]: pgmap v11135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:57.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:57 smithi170 ceph-mon[31212]: pgmap v11135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:57.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:57 smithi077 ceph-mon[27902]: pgmap v11135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:09:58.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20708.705952 secs 2024-04-21T16:09:58.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20708.705952 secs 2024-04-21T16:09:58.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20708.705952 secs 2024-04-21T16:09:59.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:09:59 smithi170 ceph-mon[31212]: pgmap v11136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:59.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:09:59 smithi077 ceph-mon[27902]: pgmap v11136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:09:59.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:09:59 smithi191 ceph-mon[31636]: pgmap v11136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20710.468317 secs 2024-04-21T16:10:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:10:00.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20710.468317 secs 2024-04-21T16:10:00.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:10:00.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20710.468317 secs 2024-04-21T16:10:00.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:10:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:01 smithi170 ceph-mon[31212]: pgmap v11137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:10:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:01.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:01 smithi077 ceph-mon[27902]: pgmap v11137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:01.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:10:01.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:01.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:01.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:01 smithi191 ceph-mon[31636]: pgmap v11137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:01.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:10:01.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:01.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:02.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:10:02.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:10:02.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:02.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:10:02.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:10:02.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:02.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:10:02.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:10:02.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:10:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20713.706018 secs 2024-04-21T16:10:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:03 smithi170 ceph-mon[31212]: pgmap v11138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20713.706018 secs 2024-04-21T16:10:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:03 smithi077 ceph-mon[27902]: pgmap v11138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20713.706018 secs 2024-04-21T16:10:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:03 smithi191 ceph-mon[31636]: pgmap v11138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20715.468464 secs 2024-04-21T16:10:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:05 smithi170 ceph-mon[31212]: pgmap v11139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:05 smithi170 ceph-mon[31212]: osdmap e768: 12 total, 12 up, 12 in 2024-04-21T16:10:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20715.468464 secs 2024-04-21T16:10:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:05 smithi077 ceph-mon[27902]: pgmap v11139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:05 smithi077 ceph-mon[27902]: osdmap e768: 12 total, 12 up, 12 in 2024-04-21T16:10:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20715.468464 secs 2024-04-21T16:10:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:05 smithi191 ceph-mon[31636]: pgmap v11139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:05 smithi191 ceph-mon[31636]: osdmap e768: 12 total, 12 up, 12 in 2024-04-21T16:10:07.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:07 smithi170 ceph-mon[31212]: pgmap v11141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:07.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:07 smithi077 ceph-mon[27902]: pgmap v11141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:07.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:07 smithi191 ceph-mon[31636]: pgmap v11141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:08.540 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20718.706101 secs 2024-04-21T16:10:08.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20718.706101 secs 2024-04-21T16:10:08.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20718.706101 secs 2024-04-21T16:10:09.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:09 smithi170 ceph-mon[31212]: pgmap v11142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:09.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:09 smithi077 ceph-mon[27902]: pgmap v11142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:09.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:09 smithi191 ceph-mon[31636]: pgmap v11142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:10.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20720.468587 secs 2024-04-21T16:10:10.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20720.468587 secs 2024-04-21T16:10:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20720.468587 secs 2024-04-21T16:10:11.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:11 smithi170 ceph-mon[31212]: pgmap v11143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:11.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:11 smithi170 ceph-mon[31212]: osdmap e769: 12 total, 12 up, 12 in 2024-04-21T16:10:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:11 smithi077 ceph-mon[27902]: pgmap v11143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:11 smithi077 ceph-mon[27902]: osdmap e769: 12 total, 12 up, 12 in 2024-04-21T16:10:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:11 smithi191 ceph-mon[31636]: pgmap v11143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:10:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:11 smithi191 ceph-mon[31636]: osdmap e769: 12 total, 12 up, 12 in 2024-04-21T16:10:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20723.706179 secs 2024-04-21T16:10:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:13 smithi170 ceph-mon[31212]: pgmap v11145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:10:13.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20723.706179 secs 2024-04-21T16:10:13.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:13 smithi077 ceph-mon[27902]: pgmap v11145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:10:13.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20723.706179 secs 2024-04-21T16:10:13.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:13 smithi191 ceph-mon[31636]: pgmap v11145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:10:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20725.468711 secs 2024-04-21T16:10:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:15 smithi170 ceph-mon[31212]: pgmap v11146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:10:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20725.468711 secs 2024-04-21T16:10:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:15 smithi077 ceph-mon[27902]: pgmap v11146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:10:15.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20725.468711 secs 2024-04-21T16:10:15.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:15 smithi191 ceph-mon[31636]: pgmap v11146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:10:17.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:17 smithi170 ceph-mon[31212]: pgmap v11147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:10:17.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:17 smithi077 ceph-mon[27902]: pgmap v11147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:10:17.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:17 smithi191 ceph-mon[31636]: pgmap v11147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:10:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20728.706298 secs 2024-04-21T16:10:18.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20728.706298 secs 2024-04-21T16:10:18.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20728.706298 secs 2024-04-21T16:10:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:19 smithi170 ceph-mon[31212]: pgmap v11148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:10:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20730.468830 secs 2024-04-21T16:10:19.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:19 smithi077 ceph-mon[27902]: pgmap v11148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:10:19.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20730.468830 secs 2024-04-21T16:10:19.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:19 smithi191 ceph-mon[31636]: pgmap v11148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:10:19.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20730.468830 secs 2024-04-21T16:10:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:20 smithi170 ceph-mon[31212]: pgmap v11149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:10:20.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:20 smithi077 ceph-mon[27902]: pgmap v11149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:10:20.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:20 smithi191 ceph-mon[31636]: pgmap v11149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:10:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20733.706414 secs 2024-04-21T16:10:23.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:23 smithi191 ceph-mon[31636]: pgmap v11150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:10:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20733.706414 secs 2024-04-21T16:10:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:23 smithi170 ceph-mon[31212]: pgmap v11150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:10:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20733.706414 secs 2024-04-21T16:10:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:23 smithi077 ceph-mon[27902]: pgmap v11150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:10:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20735.468944 secs 2024-04-21T16:10:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:25 smithi170 ceph-mon[31212]: pgmap v11151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20735.468944 secs 2024-04-21T16:10:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:25 smithi077 ceph-mon[27902]: pgmap v11151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20735.468944 secs 2024-04-21T16:10:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:25 smithi191 ceph-mon[31636]: pgmap v11151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:27.524 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:27 smithi191 ceph-mon[31636]: pgmap v11152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:27 smithi170 ceph-mon[31212]: pgmap v11152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:27.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:27 smithi077 ceph-mon[27902]: pgmap v11152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:28.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20738.706533 secs 2024-04-21T16:10:28.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20738.706533 secs 2024-04-21T16:10:28.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20738.706533 secs 2024-04-21T16:10:29.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:29 smithi170 ceph-mon[31212]: pgmap v11153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:29.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:29 smithi077 ceph-mon[27902]: pgmap v11153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:29.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:29 smithi191 ceph-mon[31636]: pgmap v11153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:30.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20740.469071 secs 2024-04-21T16:10:30.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20740.469071 secs 2024-04-21T16:10:30.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20740.469071 secs 2024-04-21T16:10:31.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:31 smithi170 ceph-mon[31212]: pgmap v11154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:31.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:31 smithi077 ceph-mon[27902]: pgmap v11154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:31.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:31 smithi191 ceph-mon[31636]: pgmap v11154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20743.706649 secs 2024-04-21T16:10:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:33 smithi170 ceph-mon[31212]: pgmap v11155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20743.706649 secs 2024-04-21T16:10:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:33 smithi077 ceph-mon[27902]: pgmap v11155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20743.706649 secs 2024-04-21T16:10:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:33 smithi191 ceph-mon[31636]: pgmap v11155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20745.469167 secs 2024-04-21T16:10:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:35 smithi170 ceph-mon[31212]: pgmap v11156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:35.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20745.469167 secs 2024-04-21T16:10:35.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:35 smithi077 ceph-mon[27902]: pgmap v11156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20745.469167 secs 2024-04-21T16:10:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:35 smithi191 ceph-mon[31636]: pgmap v11156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:37.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:37 smithi170 ceph-mon[31212]: pgmap v11157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:37.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:37 smithi077 ceph-mon[27902]: pgmap v11157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:37 smithi191 ceph-mon[31636]: pgmap v11157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:38.540 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20748.706756 secs 2024-04-21T16:10:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20748.706756 secs 2024-04-21T16:10:38.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20748.706756 secs 2024-04-21T16:10:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:39 smithi170 ceph-mon[31212]: pgmap v11158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:39.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:39 smithi077 ceph-mon[27902]: pgmap v11158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:39.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:39 smithi191 ceph-mon[31636]: pgmap v11158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:40.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20750.469247 secs 2024-04-21T16:10:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20750.469247 secs 2024-04-21T16:10:40.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20750.469247 secs 2024-04-21T16:10:41.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:41 smithi170 ceph-mon[31212]: pgmap v11159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:41 smithi077 ceph-mon[27902]: pgmap v11159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:41 smithi191 ceph-mon[31636]: pgmap v11159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20753.706875 secs 2024-04-21T16:10:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:43 smithi170 ceph-mon[31212]: pgmap v11160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20753.706875 secs 2024-04-21T16:10:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:43 smithi077 ceph-mon[27902]: pgmap v11160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20753.706875 secs 2024-04-21T16:10:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:43 smithi191 ceph-mon[31636]: pgmap v11160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20755.469333 secs 2024-04-21T16:10:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:45 smithi170 ceph-mon[31212]: pgmap v11161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20755.469333 secs 2024-04-21T16:10:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:45 smithi077 ceph-mon[27902]: pgmap v11161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20755.469333 secs 2024-04-21T16:10:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:45 smithi191 ceph-mon[31636]: pgmap v11161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:47 smithi170 ceph-mon[31212]: pgmap v11162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:47 smithi077 ceph-mon[27902]: pgmap v11162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:47.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:47 smithi191 ceph-mon[31636]: pgmap v11162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20758.707009 secs 2024-04-21T16:10:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20758.707009 secs 2024-04-21T16:10:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20758.707009 secs 2024-04-21T16:10:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:49 smithi170 ceph-mon[31212]: pgmap v11163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20760.469470 secs 2024-04-21T16:10:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:49 smithi077 ceph-mon[27902]: pgmap v11163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20760.469470 secs 2024-04-21T16:10:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:49 smithi191 ceph-mon[31636]: pgmap v11163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20760.469470 secs 2024-04-21T16:10:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:50.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:50 smithi077 ceph-mon[27902]: pgmap v11164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:50.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:50 smithi191 ceph-mon[31636]: pgmap v11164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:50.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:50 smithi170 ceph-mon[31212]: pgmap v11164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:10:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20763.707104 secs 2024-04-21T16:10:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:53 smithi170 ceph-mon[31212]: pgmap v11165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20763.707104 secs 2024-04-21T16:10:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:53 smithi077 ceph-mon[27902]: pgmap v11165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20763.707104 secs 2024-04-21T16:10:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:53 smithi191 ceph-mon[31636]: pgmap v11165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:10:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:10:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20765.469533 secs 2024-04-21T16:10:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:55 smithi170 ceph-mon[31212]: pgmap v11166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20765.469533 secs 2024-04-21T16:10:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:55 smithi077 ceph-mon[27902]: pgmap v11166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:55.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20765.469533 secs 2024-04-21T16:10:55.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:55 smithi191 ceph-mon[31636]: pgmap v11166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:10:57.221+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:10:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:10:57.221+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:10:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:10:57.221+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:10:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:10:57.222+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:10:57.524 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:57 smithi191 ceph-mon[31636]: pgmap v11167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:57.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:57 smithi170 ceph-mon[31212]: pgmap v11167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:57.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:57 smithi077 ceph-mon[27902]: pgmap v11167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:10:58.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20768.707216 secs 2024-04-21T16:10:58.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20768.707216 secs 2024-04-21T16:10:58.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20768.707216 secs 2024-04-21T16:10:59.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:10:59 smithi170 ceph-mon[31212]: pgmap v11168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:59.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:10:59 smithi077 ceph-mon[27902]: pgmap v11168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:10:59.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:10:59 smithi191 ceph-mon[31636]: pgmap v11168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20770.469625 secs 2024-04-21T16:11:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20770.469625 secs 2024-04-21T16:11:00.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20770.469625 secs 2024-04-21T16:11:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:01 smithi170 ceph-mon[31212]: pgmap v11169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:01.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:01 smithi077 ceph-mon[27902]: pgmap v11169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:01.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:01 smithi191 ceph-mon[31636]: pgmap v11169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:02.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:11:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:11:02.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:11:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20773.707289 secs 2024-04-21T16:11:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: pgmap v11170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:11:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:11:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20773.707289 secs 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: pgmap v11170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:11:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20773.707289 secs 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: pgmap v11170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:11:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:11:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:11:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20775.469759 secs 2024-04-21T16:11:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:05 smithi170 ceph-mon[31212]: pgmap v11171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:05 smithi170 ceph-mon[31212]: osdmap e770: 12 total, 12 up, 12 in 2024-04-21T16:11:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20775.469759 secs 2024-04-21T16:11:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:05 smithi077 ceph-mon[27902]: pgmap v11171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:05 smithi077 ceph-mon[27902]: osdmap e770: 12 total, 12 up, 12 in 2024-04-21T16:11:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20775.469759 secs 2024-04-21T16:11:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:05 smithi191 ceph-mon[31636]: pgmap v11171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:05 smithi191 ceph-mon[31636]: osdmap e770: 12 total, 12 up, 12 in 2024-04-21T16:11:06.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:06 smithi077 ceph-mon[27902]: pgmap v11173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:06.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:06 smithi191 ceph-mon[31636]: pgmap v11173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:06.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:06 smithi170 ceph-mon[31212]: pgmap v11173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20778.707403 secs 2024-04-21T16:11:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20778.707403 secs 2024-04-21T16:11:08.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20778.707403 secs 2024-04-21T16:11:08.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:08 smithi077 ceph-mon[27902]: pgmap v11174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:08 smithi191 ceph-mon[31636]: pgmap v11174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:09.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:08 smithi170 ceph-mon[31212]: pgmap v11174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:09.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20780.469894 secs 2024-04-21T16:11:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20780.469894 secs 2024-04-21T16:11:10.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20780.469894 secs 2024-04-21T16:11:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:10 smithi077 ceph-mon[27902]: pgmap v11175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:10 smithi191 ceph-mon[31636]: pgmap v11175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:11.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:10 smithi170 ceph-mon[31212]: pgmap v11175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:11:12.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:11 smithi077 ceph-mon[27902]: osdmap e771: 12 total, 12 up, 12 in 2024-04-21T16:11:12.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:11 smithi191 ceph-mon[31636]: osdmap e771: 12 total, 12 up, 12 in 2024-04-21T16:11:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:11 smithi170 ceph-mon[31212]: osdmap e771: 12 total, 12 up, 12 in 2024-04-21T16:11:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20783.707520 secs 2024-04-21T16:11:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:12 smithi077 ceph-mon[27902]: pgmap v11177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:11:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20783.707520 secs 2024-04-21T16:11:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:12 smithi191 ceph-mon[31636]: pgmap v11177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:11:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20783.707520 secs 2024-04-21T16:11:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:12 smithi170 ceph-mon[31212]: pgmap v11177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:11:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20785.469951 secs 2024-04-21T16:11:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:15 smithi170 ceph-mon[31212]: pgmap v11178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:11:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20785.469951 secs 2024-04-21T16:11:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:15 smithi077 ceph-mon[27902]: pgmap v11178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:11:15.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20785.469951 secs 2024-04-21T16:11:15.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:15 smithi191 ceph-mon[31636]: pgmap v11178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:11:17.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:17 smithi170 ceph-mon[31212]: pgmap v11179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:11:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:17 smithi077 ceph-mon[27902]: pgmap v11179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:11:17.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:17 smithi191 ceph-mon[31636]: pgmap v11179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:11:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20788.707621 secs 2024-04-21T16:11:18.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20788.707621 secs 2024-04-21T16:11:18.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20788.707621 secs 2024-04-21T16:11:19.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:19 smithi170 ceph-mon[31212]: pgmap v11180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:11:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:19 smithi077 ceph-mon[27902]: pgmap v11180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:11:19.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:19 smithi191 ceph-mon[31636]: pgmap v11180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:11:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20790.470065 secs 2024-04-21T16:11:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20790.470065 secs 2024-04-21T16:11:20.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20790.470065 secs 2024-04-21T16:11:21.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:21 smithi170 ceph-mon[31212]: pgmap v11181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:11:21.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:21 smithi077 ceph-mon[27902]: pgmap v11181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:11:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:21 smithi191 ceph-mon[31636]: pgmap v11181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:11:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20793.707777 secs 2024-04-21T16:11:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:23 smithi170 ceph-mon[31212]: pgmap v11182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:11:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20793.707777 secs 2024-04-21T16:11:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:23 smithi077 ceph-mon[27902]: pgmap v11182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:11:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20793.707777 secs 2024-04-21T16:11:23.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:23 smithi191 ceph-mon[31636]: pgmap v11182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:11:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20795.470157 secs 2024-04-21T16:11:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:25 smithi170 ceph-mon[31212]: pgmap v11183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20795.470157 secs 2024-04-21T16:11:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:25 smithi077 ceph-mon[27902]: pgmap v11183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20795.470157 secs 2024-04-21T16:11:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:25 smithi191 ceph-mon[31636]: pgmap v11183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:27.524 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:27 smithi191 ceph-mon[31636]: pgmap v11184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:27.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:27 smithi170 ceph-mon[31212]: pgmap v11184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:27.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:27 smithi077 ceph-mon[27902]: pgmap v11184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:28.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20798.707827 secs 2024-04-21T16:11:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20798.707827 secs 2024-04-21T16:11:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20798.707827 secs 2024-04-21T16:11:29.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:29 smithi170 ceph-mon[31212]: pgmap v11185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:29 smithi077 ceph-mon[27902]: pgmap v11185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:29.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:29 smithi191 ceph-mon[31636]: pgmap v11185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:30.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20800.470225 secs 2024-04-21T16:11:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20800.470225 secs 2024-04-21T16:11:30.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20800.470225 secs 2024-04-21T16:11:31.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:31 smithi170 ceph-mon[31212]: pgmap v11186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:31.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:31 smithi077 ceph-mon[27902]: pgmap v11186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:31 smithi191 ceph-mon[31636]: pgmap v11186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20803.707904 secs 2024-04-21T16:11:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:33 smithi170 ceph-mon[31212]: pgmap v11187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20803.707904 secs 2024-04-21T16:11:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:33 smithi077 ceph-mon[27902]: pgmap v11187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20803.707904 secs 2024-04-21T16:11:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:33 smithi191 ceph-mon[31636]: pgmap v11187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20805.470323 secs 2024-04-21T16:11:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:35 smithi170 ceph-mon[31212]: pgmap v11188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20805.470323 secs 2024-04-21T16:11:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:35 smithi077 ceph-mon[27902]: pgmap v11188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20805.470323 secs 2024-04-21T16:11:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:35 smithi191 ceph-mon[31636]: pgmap v11188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:37.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:37 smithi170 ceph-mon[31212]: pgmap v11189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:37 smithi077 ceph-mon[27902]: pgmap v11189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:37 smithi191 ceph-mon[31636]: pgmap v11189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20808.708016 secs 2024-04-21T16:11:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20808.708016 secs 2024-04-21T16:11:38.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20808.708016 secs 2024-04-21T16:11:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:39 smithi170 ceph-mon[31212]: pgmap v11190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20810.470440 secs 2024-04-21T16:11:39.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:39 smithi077 ceph-mon[27902]: pgmap v11190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:39.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20810.470440 secs 2024-04-21T16:11:39.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:39 smithi191 ceph-mon[31636]: pgmap v11190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:39.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20810.470440 secs 2024-04-21T16:11:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 20995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:40.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:40 smithi170 ceph-mon[31212]: pgmap v11191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:40 smithi077 ceph-mon[27902]: pgmap v11191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:40 smithi191 ceph-mon[31636]: pgmap v11191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20813.708129 secs 2024-04-21T16:11:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:43 smithi170 ceph-mon[31212]: pgmap v11192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20813.708129 secs 2024-04-21T16:11:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:43 smithi077 ceph-mon[27902]: pgmap v11192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20813.708129 secs 2024-04-21T16:11:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:43 smithi191 ceph-mon[31636]: pgmap v11192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20815.470552 secs 2024-04-21T16:11:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:45 smithi170 ceph-mon[31212]: pgmap v11193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20815.470552 secs 2024-04-21T16:11:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:45 smithi077 ceph-mon[27902]: pgmap v11193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20815.470552 secs 2024-04-21T16:11:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:45 smithi191 ceph-mon[31636]: pgmap v11193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:47 smithi170 ceph-mon[31212]: pgmap v11194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:47 smithi077 ceph-mon[27902]: pgmap v11194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:47.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:47 smithi191 ceph-mon[31636]: pgmap v11194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20818.708226 secs 2024-04-21T16:11:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20818.708226 secs 2024-04-21T16:11:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20818.708226 secs 2024-04-21T16:11:49.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:49 smithi170 ceph-mon[31212]: pgmap v11195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:49 smithi077 ceph-mon[27902]: pgmap v11195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:49 smithi191 ceph-mon[31636]: pgmap v11195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:50.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20820.470670 secs 2024-04-21T16:11:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20820.470670 secs 2024-04-21T16:11:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20820.470670 secs 2024-04-21T16:11:51.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:51 smithi170 ceph-mon[31212]: pgmap v11196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:51.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:51 smithi077 ceph-mon[27902]: pgmap v11196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:51.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:51 smithi191 ceph-mon[31636]: pgmap v11196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:11:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20823.708320 secs 2024-04-21T16:11:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:53 smithi170 ceph-mon[31212]: pgmap v11197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20823.708320 secs 2024-04-21T16:11:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:53 smithi077 ceph-mon[27902]: pgmap v11197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20823.708320 secs 2024-04-21T16:11:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:53 smithi191 ceph-mon[31636]: pgmap v11197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:11:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:11:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20825.470800 secs 2024-04-21T16:11:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:55 smithi170 ceph-mon[31212]: pgmap v11198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20825.470800 secs 2024-04-21T16:11:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:55 smithi077 ceph-mon[27902]: pgmap v11198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20825.470800 secs 2024-04-21T16:11:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:55 smithi191 ceph-mon[31636]: pgmap v11198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:57.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:57 smithi170 ceph-mon[31212]: pgmap v11199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:57 smithi077 ceph-mon[27902]: pgmap v11199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:57.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:57 smithi191 ceph-mon[31636]: pgmap v11199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:11:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20828.708442 secs 2024-04-21T16:11:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20828.708442 secs 2024-04-21T16:11:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20828.708442 secs 2024-04-21T16:11:59.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:11:59 smithi170 ceph-mon[31212]: pgmap v11200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:59.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:11:59 smithi077 ceph-mon[27902]: pgmap v11200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:11:59.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:11:59 smithi191 ceph-mon[31636]: pgmap v11200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20830.470917 secs 2024-04-21T16:12:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20830.470917 secs 2024-04-21T16:12:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20830.470917 secs 2024-04-21T16:12:01.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:01 smithi170 ceph-mon[31212]: pgmap v11201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:12:01.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:01 smithi077 ceph-mon[27902]: pgmap v11201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:12:01.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:01 smithi191 ceph-mon[31636]: pgmap v11201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:12:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20833.708559 secs 2024-04-21T16:12:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:03 smithi170 ceph-mon[31212]: pgmap v11202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T16:12:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:12:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20833.708559 secs 2024-04-21T16:12:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:03 smithi077 ceph-mon[27902]: pgmap v11202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T16:12:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:12:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20833.708559 secs 2024-04-21T16:12:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:03 smithi191 ceph-mon[31636]: pgmap v11202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T16:12:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:12:04.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20835.470984 secs 2024-04-21T16:12:04.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:12:04.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:12:04.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:12:04.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:04 smithi170 ceph-mon[31212]: pgmap v11203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:12:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20835.470984 secs 2024-04-21T16:12:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:12:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:12:04.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:12:04.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:04 smithi077 ceph-mon[27902]: pgmap v11203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:12:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20835.470984 secs 2024-04-21T16:12:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:12:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:12:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:12:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:04 smithi191 ceph-mon[31636]: pgmap v11203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:12:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:05 smithi170 ceph-mon[31212]: osdmap e772: 12 total, 12 up, 12 in 2024-04-21T16:12:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:05 smithi077 ceph-mon[27902]: osdmap e772: 12 total, 12 up, 12 in 2024-04-21T16:12:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:05 smithi191 ceph-mon[31636]: osdmap e772: 12 total, 12 up, 12 in 2024-04-21T16:12:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:06 smithi170 ceph-mon[31212]: pgmap v11205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:12:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:06 smithi077 ceph-mon[27902]: pgmap v11205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:12:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:06 smithi191 ceph-mon[31636]: pgmap v11205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:12:07.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20838.708681 secs 2024-04-21T16:12:07.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20838.708681 secs 2024-04-21T16:12:08.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20838.708681 secs 2024-04-21T16:12:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:08 smithi077 ceph-mon[27902]: pgmap v11206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:12:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:08 smithi191 ceph-mon[31636]: pgmap v11206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:12:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:08 smithi170 ceph-mon[31212]: pgmap v11206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:12:09.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20840.471050 secs 2024-04-21T16:12:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20840.471050 secs 2024-04-21T16:12:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20840.471050 secs 2024-04-21T16:12:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:10 smithi077 ceph-mon[27902]: pgmap v11207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:12:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:10 smithi191 ceph-mon[31636]: pgmap v11207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:12:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:10 smithi170 ceph-mon[31212]: pgmap v11207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:12:12.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:11 smithi077 ceph-mon[27902]: osdmap e773: 12 total, 12 up, 12 in 2024-04-21T16:12:12.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:11 smithi191 ceph-mon[31636]: osdmap e773: 12 total, 12 up, 12 in 2024-04-21T16:12:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:11 smithi170 ceph-mon[31212]: osdmap e773: 12 total, 12 up, 12 in 2024-04-21T16:12:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20843.708819 secs 2024-04-21T16:12:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:12 smithi077 ceph-mon[27902]: pgmap v11209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T16:12:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20843.708819 secs 2024-04-21T16:12:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:12 smithi191 ceph-mon[31636]: pgmap v11209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T16:12:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20843.708819 secs 2024-04-21T16:12:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:12 smithi170 ceph-mon[31212]: pgmap v11209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T16:12:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20845.471167 secs 2024-04-21T16:12:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:15 smithi170 ceph-mon[31212]: pgmap v11210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:12:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20845.471167 secs 2024-04-21T16:12:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:15 smithi077 ceph-mon[27902]: pgmap v11210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:12:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20845.471167 secs 2024-04-21T16:12:15.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:15 smithi191 ceph-mon[31636]: pgmap v11210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:12:17.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:17 smithi170 ceph-mon[31212]: pgmap v11211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:12:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:17 smithi077 ceph-mon[27902]: pgmap v11211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:12:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:17 smithi191 ceph-mon[31636]: pgmap v11211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:12:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20848.708930 secs 2024-04-21T16:12:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20848.708930 secs 2024-04-21T16:12:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20848.708930 secs 2024-04-21T16:12:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:19 smithi170 ceph-mon[31212]: pgmap v11212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:12:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:19 smithi077 ceph-mon[27902]: pgmap v11212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:12:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:19 smithi191 ceph-mon[31636]: pgmap v11212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:12:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20850.471281 secs 2024-04-21T16:12:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20850.471281 secs 2024-04-21T16:12:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20850.471281 secs 2024-04-21T16:12:21.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:21 smithi170 ceph-mon[31212]: pgmap v11213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:12:21.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:21 smithi077 ceph-mon[27902]: pgmap v11213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:12:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:21 smithi191 ceph-mon[31636]: pgmap v11213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:12:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20853.709011 secs 2024-04-21T16:12:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:23 smithi170 ceph-mon[31212]: pgmap v11214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:12:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20853.709011 secs 2024-04-21T16:12:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:23 smithi077 ceph-mon[27902]: pgmap v11214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:12:23.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20853.709011 secs 2024-04-21T16:12:23.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:23 smithi191 ceph-mon[31636]: pgmap v11214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:12:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20855.471393 secs 2024-04-21T16:12:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:25 smithi170 ceph-mon[31212]: pgmap v11215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20855.471393 secs 2024-04-21T16:12:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:25 smithi077 ceph-mon[27902]: pgmap v11215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20855.471393 secs 2024-04-21T16:12:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:25 smithi191 ceph-mon[31636]: pgmap v11215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:27 smithi170 ceph-mon[31212]: pgmap v11216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:27.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:27 smithi077 ceph-mon[27902]: pgmap v11216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:27.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:27 smithi191 ceph-mon[31636]: pgmap v11216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20858.709156 secs 2024-04-21T16:12:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20858.709156 secs 2024-04-21T16:12:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20858.709156 secs 2024-04-21T16:12:29.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:29 smithi170 ceph-mon[31212]: pgmap v11217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:29 smithi077 ceph-mon[27902]: pgmap v11217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:29 smithi191 ceph-mon[31636]: pgmap v11217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20860.471482 secs 2024-04-21T16:12:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20860.471482 secs 2024-04-21T16:12:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20860.471482 secs 2024-04-21T16:12:31.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:31 smithi170 ceph-mon[31212]: pgmap v11218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:31.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:31 smithi077 ceph-mon[27902]: pgmap v11218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:31 smithi191 ceph-mon[31636]: pgmap v11218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20863.709276 secs 2024-04-21T16:12:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:33 smithi170 ceph-mon[31212]: pgmap v11219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20863.709276 secs 2024-04-21T16:12:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:33 smithi077 ceph-mon[27902]: pgmap v11219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20863.709276 secs 2024-04-21T16:12:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:33 smithi191 ceph-mon[31636]: pgmap v11219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20865.471613 secs 2024-04-21T16:12:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20865.471613 secs 2024-04-21T16:12:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20865.471613 secs 2024-04-21T16:12:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:35 smithi170 ceph-mon[31212]: pgmap v11220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:35 smithi077 ceph-mon[27902]: pgmap v11220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:35 smithi191 ceph-mon[31636]: pgmap v11220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:36 smithi170 ceph-mon[31212]: pgmap v11221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:36 smithi077 ceph-mon[27902]: pgmap v11221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:36 smithi191 ceph-mon[31636]: pgmap v11221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:37.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20868.709389 secs 2024-04-21T16:12:37.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20868.709389 secs 2024-04-21T16:12:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20868.709389 secs 2024-04-21T16:12:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:38 smithi077 ceph-mon[27902]: pgmap v11222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:38 smithi191 ceph-mon[31636]: pgmap v11222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:38 smithi170 ceph-mon[31212]: pgmap v11222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:39.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20870.471723 secs 2024-04-21T16:12:39.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20870.471723 secs 2024-04-21T16:12:40.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20870.471723 secs 2024-04-21T16:12:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:40 smithi077 ceph-mon[27902]: pgmap v11223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:40 smithi191 ceph-mon[31636]: pgmap v11223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:40 smithi170 ceph-mon[31212]: pgmap v11223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20873.709522 secs 2024-04-21T16:12:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:43 smithi170 ceph-mon[31212]: pgmap v11224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20873.709522 secs 2024-04-21T16:12:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:43 smithi077 ceph-mon[27902]: pgmap v11224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20873.709522 secs 2024-04-21T16:12:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:43 smithi191 ceph-mon[31636]: pgmap v11224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20875.471884 secs 2024-04-21T16:12:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:45 smithi170 ceph-mon[31212]: pgmap v11225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20875.471884 secs 2024-04-21T16:12:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:45 smithi077 ceph-mon[27902]: pgmap v11225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20875.471884 secs 2024-04-21T16:12:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:45 smithi191 ceph-mon[31636]: pgmap v11225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:47.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:47 smithi170 ceph-mon[31212]: pgmap v11226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:47 smithi077 ceph-mon[27902]: pgmap v11226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:47.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:47 smithi191 ceph-mon[31636]: pgmap v11226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20878.709641 secs 2024-04-21T16:12:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20878.709641 secs 2024-04-21T16:12:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20878.709641 secs 2024-04-21T16:12:49.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:49 smithi170 ceph-mon[31212]: pgmap v11227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:49 smithi077 ceph-mon[27902]: pgmap v11227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:49 smithi191 ceph-mon[31636]: pgmap v11227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20880.472000 secs 2024-04-21T16:12:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20880.472000 secs 2024-04-21T16:12:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20880.472000 secs 2024-04-21T16:12:51.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:51 smithi170 ceph-mon[31212]: pgmap v11228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:51.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:51 smithi077 ceph-mon[27902]: pgmap v11228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:51.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:51 smithi191 ceph-mon[31636]: pgmap v11228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:12:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20883.709785 secs 2024-04-21T16:12:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:53 smithi170 ceph-mon[31212]: pgmap v11229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20883.709785 secs 2024-04-21T16:12:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:53 smithi077 ceph-mon[27902]: pgmap v11229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20883.709785 secs 2024-04-21T16:12:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:53 smithi191 ceph-mon[31636]: pgmap v11229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:12:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:12:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20885.472113 secs 2024-04-21T16:12:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:55 smithi170 ceph-mon[31212]: pgmap v11230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20885.472113 secs 2024-04-21T16:12:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:55 smithi077 ceph-mon[27902]: pgmap v11230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20885.472113 secs 2024-04-21T16:12:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:55 smithi191 ceph-mon[31636]: pgmap v11230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:57.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:57 smithi170 ceph-mon[31212]: pgmap v11231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:57 smithi077 ceph-mon[27902]: pgmap v11231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:57.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:57 smithi191 ceph-mon[31636]: pgmap v11231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:12:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20888.709815 secs 2024-04-21T16:12:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20888.709815 secs 2024-04-21T16:12:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20888.709815 secs 2024-04-21T16:12:59.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:12:59 smithi170 ceph-mon[31212]: pgmap v11232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:59.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:12:59 smithi077 ceph-mon[27902]: pgmap v11232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:12:59.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:12:59 smithi191 ceph-mon[31636]: pgmap v11232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20890.472222 secs 2024-04-21T16:13:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20890.472222 secs 2024-04-21T16:13:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20890.472222 secs 2024-04-21T16:13:01.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:01 smithi170 ceph-mon[31212]: pgmap v11233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:01.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:01 smithi077 ceph-mon[27902]: pgmap v11233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:01.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:01 smithi191 ceph-mon[31636]: pgmap v11233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:02 smithi170 ceph-mon[31212]: pgmap v11234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T16:13:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:02 smithi077 ceph-mon[27902]: pgmap v11234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T16:13:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:02 smithi191 ceph-mon[31636]: pgmap v11234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T16:13:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20893.709905 secs 2024-04-21T16:13:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20893.709905 secs 2024-04-21T16:13:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20893.709905 secs 2024-04-21T16:13:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20895.472341 secs 2024-04-21T16:13:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:13:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:04 smithi077 ceph-mon[27902]: pgmap v11235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T16:13:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20895.472341 secs 2024-04-21T16:13:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:13:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:04 smithi191 ceph-mon[31636]: pgmap v11235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T16:13:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20895.472341 secs 2024-04-21T16:13:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:13:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:04 smithi170 ceph-mon[31212]: pgmap v11235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T16:13:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:05 smithi077 ceph-mon[27902]: osdmap e774: 12 total, 12 up, 12 in 2024-04-21T16:13:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:13:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:13:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:13:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:05 smithi191 ceph-mon[31636]: osdmap e774: 12 total, 12 up, 12 in 2024-04-21T16:13:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:13:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:13:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:13:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:05 smithi170 ceph-mon[31212]: osdmap e774: 12 total, 12 up, 12 in 2024-04-21T16:13:05.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:13:05.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:13:05.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:13:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:06 smithi077 ceph-mon[27902]: pgmap v11237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:13:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:06 smithi191 ceph-mon[31636]: pgmap v11237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:13:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:06 smithi170 ceph-mon[31212]: pgmap v11237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:13:07.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20898.710025 secs 2024-04-21T16:13:07.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20898.710025 secs 2024-04-21T16:13:08.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20898.710025 secs 2024-04-21T16:13:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:08 smithi077 ceph-mon[27902]: pgmap v11238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:13:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:08 smithi191 ceph-mon[31636]: pgmap v11238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:13:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:08 smithi170 ceph-mon[31212]: pgmap v11238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:13:09.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20900.472447 secs 2024-04-21T16:13:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20900.472447 secs 2024-04-21T16:13:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20900.472447 secs 2024-04-21T16:13:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:10 smithi077 ceph-mon[27902]: pgmap v11239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:13:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:10 smithi191 ceph-mon[31636]: pgmap v11239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:13:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:10 smithi170 ceph-mon[31212]: pgmap v11239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:13:12.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:11 smithi077 ceph-mon[27902]: osdmap e775: 12 total, 12 up, 12 in 2024-04-21T16:13:12.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:11 smithi191 ceph-mon[31636]: osdmap e775: 12 total, 12 up, 12 in 2024-04-21T16:13:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:11 smithi170 ceph-mon[31212]: osdmap e775: 12 total, 12 up, 12 in 2024-04-21T16:13:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20903.710141 secs 2024-04-21T16:13:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:12 smithi191 ceph-mon[31636]: pgmap v11241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:13:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20903.710141 secs 2024-04-21T16:13:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:12 smithi170 ceph-mon[31212]: pgmap v11241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:13:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20903.710141 secs 2024-04-21T16:13:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:12 smithi077 ceph-mon[27902]: pgmap v11241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:13:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20905.472566 secs 2024-04-21T16:13:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:15 smithi170 ceph-mon[31212]: pgmap v11242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:13:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20905.472566 secs 2024-04-21T16:13:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:15 smithi077 ceph-mon[27902]: pgmap v11242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:13:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20905.472566 secs 2024-04-21T16:13:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:15 smithi191 ceph-mon[31636]: pgmap v11242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:13:17.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:17 smithi170 ceph-mon[31212]: pgmap v11243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:13:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:17 smithi077 ceph-mon[27902]: pgmap v11243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:13:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:17 smithi191 ceph-mon[31636]: pgmap v11243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:13:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20908.710258 secs 2024-04-21T16:13:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20908.710258 secs 2024-04-21T16:13:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20908.710258 secs 2024-04-21T16:13:19.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:19 smithi170 ceph-mon[31212]: pgmap v11244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:13:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:19 smithi077 ceph-mon[27902]: pgmap v11244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:13:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:19 smithi191 ceph-mon[31636]: pgmap v11244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:13:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20910.472697 secs 2024-04-21T16:13:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20910.472697 secs 2024-04-21T16:13:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20910.472697 secs 2024-04-21T16:13:21.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:21 smithi170 ceph-mon[31212]: pgmap v11245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:13:21.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:21 smithi077 ceph-mon[27902]: pgmap v11245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:13:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:21 smithi191 ceph-mon[31636]: pgmap v11245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:13:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20913.710395 secs 2024-04-21T16:13:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:23 smithi170 ceph-mon[31212]: pgmap v11246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:13:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20913.710395 secs 2024-04-21T16:13:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:23 smithi077 ceph-mon[27902]: pgmap v11246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:13:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20913.710395 secs 2024-04-21T16:13:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:23 smithi191 ceph-mon[31636]: pgmap v11246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:13:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20915.472760 secs 2024-04-21T16:13:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:25 smithi170 ceph-mon[31212]: pgmap v11247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20915.472760 secs 2024-04-21T16:13:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:25 smithi077 ceph-mon[27902]: pgmap v11247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20915.472760 secs 2024-04-21T16:13:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:25 smithi191 ceph-mon[31636]: pgmap v11247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:27 smithi170 ceph-mon[31212]: pgmap v11248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:27.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:27 smithi077 ceph-mon[27902]: pgmap v11248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:27.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:27 smithi191 ceph-mon[31636]: pgmap v11248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20918.710513 secs 2024-04-21T16:13:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20918.710513 secs 2024-04-21T16:13:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20918.710513 secs 2024-04-21T16:13:29.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:29 smithi170 ceph-mon[31212]: pgmap v11249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:29.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20920.472878 secs 2024-04-21T16:13:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:29 smithi077 ceph-mon[27902]: pgmap v11249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20920.472878 secs 2024-04-21T16:13:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:29 smithi191 ceph-mon[31636]: pgmap v11249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20920.472878 secs 2024-04-21T16:13:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:31.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:31 smithi170 ceph-mon[31212]: pgmap v11250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:31.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:31 smithi077 ceph-mon[27902]: pgmap v11250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:31 smithi191 ceph-mon[31636]: pgmap v11250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:32 smithi077 ceph-mon[27902]: pgmap v11251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:32 smithi191 ceph-mon[31636]: pgmap v11251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:32 smithi170 ceph-mon[31212]: pgmap v11251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20923.710655 secs 2024-04-21T16:13:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20923.710655 secs 2024-04-21T16:13:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20923.710655 secs 2024-04-21T16:13:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20925.472904 secs 2024-04-21T16:13:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:34 smithi077 ceph-mon[27902]: pgmap v11252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20925.472904 secs 2024-04-21T16:13:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:34 smithi191 ceph-mon[31636]: pgmap v11252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20925.472904 secs 2024-04-21T16:13:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:34 smithi170 ceph-mon[31212]: pgmap v11252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:37 smithi170 ceph-mon[31212]: pgmap v11253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:37 smithi077 ceph-mon[27902]: pgmap v11253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:37 smithi191 ceph-mon[31636]: pgmap v11253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:38.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20928.710788 secs 2024-04-21T16:13:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20928.710788 secs 2024-04-21T16:13:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20928.710788 secs 2024-04-21T16:13:39.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:39 smithi170 ceph-mon[31212]: pgmap v11254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:39.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:39 smithi077 ceph-mon[27902]: pgmap v11254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:39.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:39 smithi191 ceph-mon[31636]: pgmap v11254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20930.473021 secs 2024-04-21T16:13:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20930.473021 secs 2024-04-21T16:13:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20930.473021 secs 2024-04-21T16:13:41.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:41 smithi170 ceph-mon[31212]: pgmap v11255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:41 smithi077 ceph-mon[27902]: pgmap v11255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:41.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:41 smithi191 ceph-mon[31636]: pgmap v11255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20933.710848 secs 2024-04-21T16:13:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:43 smithi170 ceph-mon[31212]: pgmap v11256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20933.710848 secs 2024-04-21T16:13:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:43 smithi077 ceph-mon[27902]: pgmap v11256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20933.710848 secs 2024-04-21T16:13:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:43 smithi191 ceph-mon[31636]: pgmap v11256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20935.473111 secs 2024-04-21T16:13:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:45 smithi170 ceph-mon[31212]: pgmap v11257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20935.473111 secs 2024-04-21T16:13:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:45 smithi077 ceph-mon[27902]: pgmap v11257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20935.473111 secs 2024-04-21T16:13:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:45 smithi191 ceph-mon[31636]: pgmap v11257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:47.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:47 smithi170 ceph-mon[31212]: pgmap v11258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:47 smithi077 ceph-mon[27902]: pgmap v11258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:47.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:47 smithi191 ceph-mon[31636]: pgmap v11258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20938.710915 secs 2024-04-21T16:13:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20938.710915 secs 2024-04-21T16:13:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20938.710915 secs 2024-04-21T16:13:49.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:49 smithi170 ceph-mon[31212]: pgmap v11259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20940.473215 secs 2024-04-21T16:13:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:49 smithi077 ceph-mon[27902]: pgmap v11259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20940.473215 secs 2024-04-21T16:13:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:49 smithi191 ceph-mon[31636]: pgmap v11259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20940.473215 secs 2024-04-21T16:13:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:50 smithi077 ceph-mon[27902]: pgmap v11260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:50 smithi191 ceph-mon[31636]: pgmap v11260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:50 smithi170 ceph-mon[31212]: pgmap v11260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:13:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20943.711059 secs 2024-04-21T16:13:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:53 smithi170 ceph-mon[31212]: pgmap v11261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20943.711059 secs 2024-04-21T16:13:53.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:53 smithi077 ceph-mon[27902]: pgmap v11261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20943.711059 secs 2024-04-21T16:13:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:53 smithi191 ceph-mon[31636]: pgmap v11261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:13:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.440+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T16:13:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.440+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T16:13:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.440+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:13:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.440+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T16:13:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.440+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:13:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.441+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T16:13:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.441+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7001f000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7001f000 comp rx=0 tx=0).stop 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T16:13:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:13:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:54.470+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efd700108f0 tx=0x7efd7004c000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T16:13:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:13:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20945.473331 secs 2024-04-21T16:13:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:55 smithi170 ceph-mon[31212]: pgmap v11262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20945.473331 secs 2024-04-21T16:13:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:55 smithi077 ceph-mon[27902]: pgmap v11262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20945.473331 secs 2024-04-21T16:13:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:55 smithi191 ceph-mon[31636]: pgmap v11262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:57.247+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:13:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:57.247+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:13:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:57.247+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:13:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:13:57.247+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:13:57.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:57 smithi170 ceph-mon[31212]: pgmap v11263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:57 smithi077 ceph-mon[27902]: pgmap v11263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:57.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:57 smithi191 ceph-mon[31636]: pgmap v11263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:13:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20948.711175 secs 2024-04-21T16:13:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20948.711175 secs 2024-04-21T16:13:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20948.711175 secs 2024-04-21T16:13:59.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:13:59 smithi170 ceph-mon[31212]: pgmap v11264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:59.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:13:59 smithi077 ceph-mon[27902]: pgmap v11264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:13:59.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:13:59 smithi191 ceph-mon[31636]: pgmap v11264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20950.473442 secs 2024-04-21T16:14:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20950.473442 secs 2024-04-21T16:14:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20950.473442 secs 2024-04-21T16:14:01.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:01 smithi170 ceph-mon[31212]: pgmap v11265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:01.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:01 smithi077 ceph-mon[27902]: pgmap v11265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:01.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:01 smithi191 ceph-mon[31636]: pgmap v11265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:02 smithi077 ceph-mon[27902]: pgmap v11266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:02 smithi191 ceph-mon[31636]: pgmap v11266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:02 smithi170 ceph-mon[31212]: pgmap v11266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20953.711252 secs 2024-04-21T16:14:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20953.711252 secs 2024-04-21T16:14:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20953.711252 secs 2024-04-21T16:14:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20955.473565 secs 2024-04-21T16:14:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:04 smithi077 ceph-mon[27902]: pgmap v11267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20955.473565 secs 2024-04-21T16:14:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:04 smithi191 ceph-mon[31636]: pgmap v11267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20955.473565 secs 2024-04-21T16:14:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:04 smithi170 ceph-mon[31212]: pgmap v11267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:05.370 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:05 smithi170 ceph-mon[31212]: osdmap e776: 12 total, 12 up, 12 in 2024-04-21T16:14:05.370 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:14:05.371 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:14:05.372 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:14:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:05 smithi077 ceph-mon[27902]: osdmap e776: 12 total, 12 up, 12 in 2024-04-21T16:14:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:14:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:14:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:14:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:14:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:05 smithi191 ceph-mon[31636]: osdmap e776: 12 total, 12 up, 12 in 2024-04-21T16:14:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:14:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:14:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:14:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:14:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:14:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:06 smithi077 ceph-mon[27902]: pgmap v11269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:14:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:06 smithi191 ceph-mon[31636]: pgmap v11269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:14:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:06 smithi170 ceph-mon[31212]: pgmap v11269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:14:07.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20958.711372 secs 2024-04-21T16:14:07.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20958.711372 secs 2024-04-21T16:14:08.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20958.711372 secs 2024-04-21T16:14:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:08 smithi077 ceph-mon[27902]: pgmap v11270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:14:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:08 smithi191 ceph-mon[31636]: pgmap v11270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:14:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:08 smithi170 ceph-mon[31212]: pgmap v11270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:14:09.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20960.473664 secs 2024-04-21T16:14:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20960.473664 secs 2024-04-21T16:14:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20960.473664 secs 2024-04-21T16:14:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:10 smithi077 ceph-mon[27902]: pgmap v11271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:14:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:10 smithi191 ceph-mon[31636]: pgmap v11271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:14:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:10 smithi170 ceph-mon[31212]: pgmap v11271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:14:12.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:11 smithi191 ceph-mon[31636]: osdmap e777: 12 total, 12 up, 12 in 2024-04-21T16:14:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:11 smithi170 ceph-mon[31212]: osdmap e777: 12 total, 12 up, 12 in 2024-04-21T16:14:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:11 smithi077 ceph-mon[27902]: osdmap e777: 12 total, 12 up, 12 in 2024-04-21T16:14:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20963.711491 secs 2024-04-21T16:14:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:12 smithi191 ceph-mon[31636]: pgmap v11273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:14:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20963.711491 secs 2024-04-21T16:14:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:12 smithi170 ceph-mon[31212]: pgmap v11273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:14:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20963.711491 secs 2024-04-21T16:14:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:12 smithi077 ceph-mon[27902]: pgmap v11273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:14:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20965.473777 secs 2024-04-21T16:14:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:15 smithi170 ceph-mon[31212]: pgmap v11274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:14:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20965.473777 secs 2024-04-21T16:14:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:15 smithi077 ceph-mon[27902]: pgmap v11274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:14:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20965.473777 secs 2024-04-21T16:14:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:15 smithi191 ceph-mon[31636]: pgmap v11274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:14:17.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:17 smithi170 ceph-mon[31212]: pgmap v11275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:14:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:17 smithi077 ceph-mon[27902]: pgmap v11275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:14:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:17 smithi191 ceph-mon[31636]: pgmap v11275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:14:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20968.711615 secs 2024-04-21T16:14:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20968.711615 secs 2024-04-21T16:14:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20968.711615 secs 2024-04-21T16:14:19.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:19 smithi170 ceph-mon[31212]: pgmap v11276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:14:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:19 smithi077 ceph-mon[27902]: pgmap v11276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:14:19.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:19 smithi191 ceph-mon[31636]: pgmap v11276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:14:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20970.473896 secs 2024-04-21T16:14:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20970.473896 secs 2024-04-21T16:14:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20970.473896 secs 2024-04-21T16:14:21.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:21 smithi170 ceph-mon[31212]: pgmap v11277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:14:21.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:21 smithi077 ceph-mon[27902]: pgmap v11277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:14:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:21 smithi191 ceph-mon[31636]: pgmap v11277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:14:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20973.711732 secs 2024-04-21T16:14:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:23 smithi170 ceph-mon[31212]: pgmap v11278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:14:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20973.711732 secs 2024-04-21T16:14:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:23 smithi077 ceph-mon[27902]: pgmap v11278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:14:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20973.711732 secs 2024-04-21T16:14:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:23 smithi191 ceph-mon[31636]: pgmap v11278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:14:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20975.474003 secs 2024-04-21T16:14:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:25 smithi077 ceph-mon[27902]: pgmap v11279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:14:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20975.474003 secs 2024-04-21T16:14:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:25 smithi191 ceph-mon[31636]: pgmap v11279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:14:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20975.474003 secs 2024-04-21T16:14:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:25 smithi170 ceph-mon[31212]: pgmap v11279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:14:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:26 smithi191 ceph-mon[31636]: pgmap v11280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:26 smithi170 ceph-mon[31212]: pgmap v11280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:27.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:26 smithi077 ceph-mon[27902]: pgmap v11280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:28.210 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20978.711856 secs 2024-04-21T16:14:28.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20978.711856 secs 2024-04-21T16:14:28.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20978.711856 secs 2024-04-21T16:14:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:28 smithi191 ceph-mon[31636]: pgmap v11281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:28 smithi170 ceph-mon[31212]: pgmap v11281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:29.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:28 smithi077 ceph-mon[27902]: pgmap v11281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:30.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20980.474126 secs 2024-04-21T16:14:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20980.474126 secs 2024-04-21T16:14:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20980.474126 secs 2024-04-21T16:14:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:30 smithi191 ceph-mon[31636]: pgmap v11282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:30 smithi170 ceph-mon[31212]: pgmap v11282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:31.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:30 smithi077 ceph-mon[27902]: pgmap v11282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20983.711979 secs 2024-04-21T16:14:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:33 smithi170 ceph-mon[31212]: pgmap v11283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20983.711979 secs 2024-04-21T16:14:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:33 smithi077 ceph-mon[27902]: pgmap v11283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20983.711979 secs 2024-04-21T16:14:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:33 smithi191 ceph-mon[31636]: pgmap v11283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20985.474235 secs 2024-04-21T16:14:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:35 smithi170 ceph-mon[31212]: pgmap v11284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20985.474235 secs 2024-04-21T16:14:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:35 smithi077 ceph-mon[27902]: pgmap v11284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20985.474235 secs 2024-04-21T16:14:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:35 smithi191 ceph-mon[31636]: pgmap v11284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:37 smithi170 ceph-mon[31212]: pgmap v11285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:37.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:37 smithi077 ceph-mon[27902]: pgmap v11285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:37 smithi191 ceph-mon[31636]: pgmap v11285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20988.712100 secs 2024-04-21T16:14:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20988.712100 secs 2024-04-21T16:14:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20988.712100 secs 2024-04-21T16:14:39.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:39 smithi077 ceph-mon[27902]: pgmap v11286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:39.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:39 smithi191 ceph-mon[31636]: pgmap v11286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:39.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:39 smithi170 ceph-mon[31212]: pgmap v11286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20990.474359 secs 2024-04-21T16:14:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20990.474359 secs 2024-04-21T16:14:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20990.474359 secs 2024-04-21T16:14:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:41 smithi077 ceph-mon[27902]: pgmap v11287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:41.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:41 smithi191 ceph-mon[31636]: pgmap v11287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:41.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:41 smithi170 ceph-mon[31212]: pgmap v11287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:42 smithi077 ceph-mon[27902]: pgmap v11288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:42 smithi191 ceph-mon[31636]: pgmap v11288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:42 smithi170 ceph-mon[31212]: pgmap v11288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20993.712198 secs 2024-04-21T16:14:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20993.712198 secs 2024-04-21T16:14:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20993.712198 secs 2024-04-21T16:14:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 20995.474494 secs 2024-04-21T16:14:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:44 smithi077 ceph-mon[27902]: pgmap v11289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 20995.474494 secs 2024-04-21T16:14:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:44 smithi191 ceph-mon[31636]: pgmap v11289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 20995.474494 secs 2024-04-21T16:14:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:44 smithi170 ceph-mon[31212]: pgmap v11289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:47.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:47 smithi170 ceph-mon[31212]: pgmap v11290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:47 smithi077 ceph-mon[27902]: pgmap v11290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:47.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:47 smithi191 ceph-mon[31636]: pgmap v11290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 20998.712321 secs 2024-04-21T16:14:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 20998.712321 secs 2024-04-21T16:14:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 20998.712321 secs 2024-04-21T16:14:49.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:49 smithi170 ceph-mon[31212]: pgmap v11291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:49 smithi077 ceph-mon[27902]: pgmap v11291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:49 smithi191 ceph-mon[31636]: pgmap v11291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21000.474648 secs 2024-04-21T16:14:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21000.474648 secs 2024-04-21T16:14:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21000.474648 secs 2024-04-21T16:14:51.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:51 smithi077 ceph-mon[27902]: pgmap v11292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:51.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:51 smithi191 ceph-mon[31636]: pgmap v11292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:51.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:51 smithi170 ceph-mon[31212]: pgmap v11292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:14:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21003.712443 secs 2024-04-21T16:14:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:53 smithi077 ceph-mon[27902]: pgmap v11293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21003.712443 secs 2024-04-21T16:14:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:53 smithi191 ceph-mon[31636]: pgmap v11293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21003.712443 secs 2024-04-21T16:14:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:53 smithi170 ceph-mon[31212]: pgmap v11293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:14:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21005.474742 secs 2024-04-21T16:14:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21005.474742 secs 2024-04-21T16:14:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21005.474742 secs 2024-04-21T16:14:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:14:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:55 smithi077 ceph-mon[27902]: pgmap v11294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:55 smithi191 ceph-mon[31636]: pgmap v11294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:55 smithi170 ceph-mon[31212]: pgmap v11294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:56 smithi077 ceph-mon[27902]: pgmap v11295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:56 smithi191 ceph-mon[31636]: pgmap v11295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:56 smithi170 ceph-mon[31212]: pgmap v11295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:14:57.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21008.712566 secs 2024-04-21T16:14:57.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21008.712566 secs 2024-04-21T16:14:58.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21008.712566 secs 2024-04-21T16:14:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:58 smithi077 ceph-mon[27902]: pgmap v11296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:58 smithi170 ceph-mon[31212]: pgmap v11296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:58 smithi191 ceph-mon[31636]: pgmap v11296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:14:59.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21010.474880 secs 2024-04-21T16:14:59.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21010.474880 secs 2024-04-21T16:15:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21010.474880 secs 2024-04-21T16:15:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:00 smithi077 ceph-mon[27902]: pgmap v11297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:00 smithi191 ceph-mon[31636]: pgmap v11297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:00 smithi170 ceph-mon[31212]: pgmap v11297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21013.712683 secs 2024-04-21T16:15:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:03 smithi170 ceph-mon[31212]: pgmap v11298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21013.712683 secs 2024-04-21T16:15:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:03 smithi077 ceph-mon[27902]: pgmap v11298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21013.712683 secs 2024-04-21T16:15:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:03 smithi191 ceph-mon[31636]: pgmap v11298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21015.474994 secs 2024-04-21T16:15:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:05 smithi170 ceph-mon[31212]: pgmap v11299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:05 smithi170 ceph-mon[31212]: osdmap e778: 12 total, 12 up, 12 in 2024-04-21T16:15:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21015.474994 secs 2024-04-21T16:15:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:05 smithi077 ceph-mon[27902]: pgmap v11299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:05 smithi077 ceph-mon[27902]: osdmap e778: 12 total, 12 up, 12 in 2024-04-21T16:15:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21015.474994 secs 2024-04-21T16:15:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:05 smithi191 ceph-mon[31636]: pgmap v11299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:05 smithi191 ceph-mon[31636]: osdmap e778: 12 total, 12 up, 12 in 2024-04-21T16:15:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:15:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:15:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:15:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:15:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:15:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:15:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:15:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:15:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:15:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:15:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:15:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:15:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:07 smithi170 ceph-mon[31212]: pgmap v11301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:15:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:07 smithi077 ceph-mon[27902]: pgmap v11301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:15:07.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:07 smithi191 ceph-mon[31636]: pgmap v11301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:15:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21018.712803 secs 2024-04-21T16:15:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21018.712803 secs 2024-04-21T16:15:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21018.712803 secs 2024-04-21T16:15:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:09 smithi077 ceph-mon[27902]: pgmap v11302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:15:09.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:09 smithi191 ceph-mon[31636]: pgmap v11302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:15:09.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:09 smithi170 ceph-mon[31212]: pgmap v11302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:15:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21020.475109 secs 2024-04-21T16:15:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21020.475109 secs 2024-04-21T16:15:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21020.475109 secs 2024-04-21T16:15:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:11 smithi077 ceph-mon[27902]: pgmap v11303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:15:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:11 smithi077 ceph-mon[27902]: osdmap e779: 12 total, 12 up, 12 in 2024-04-21T16:15:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:11 smithi191 ceph-mon[31636]: pgmap v11303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:15:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:11 smithi191 ceph-mon[31636]: osdmap e779: 12 total, 12 up, 12 in 2024-04-21T16:15:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:11 smithi170 ceph-mon[31212]: pgmap v11303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:15:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:11 smithi170 ceph-mon[31212]: osdmap e779: 12 total, 12 up, 12 in 2024-04-21T16:15:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:12 smithi077 ceph-mon[27902]: pgmap v11305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:15:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:12 smithi191 ceph-mon[31636]: pgmap v11305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:15:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:12 smithi170 ceph-mon[31212]: pgmap v11305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:15:13.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21023.712886 secs 2024-04-21T16:15:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21023.712886 secs 2024-04-21T16:15:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21023.712886 secs 2024-04-21T16:15:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21025.475236 secs 2024-04-21T16:15:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:14 smithi077 ceph-mon[27902]: pgmap v11306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:15:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21025.475236 secs 2024-04-21T16:15:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:14 smithi191 ceph-mon[31636]: pgmap v11306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:15:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21025.475236 secs 2024-04-21T16:15:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:14 smithi170 ceph-mon[31212]: pgmap v11306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:15:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:17.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:17 smithi170 ceph-mon[31212]: pgmap v11307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:15:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:17 smithi077 ceph-mon[27902]: pgmap v11307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:15:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:17 smithi191 ceph-mon[31636]: pgmap v11307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:15:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21028.713025 secs 2024-04-21T16:15:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21028.713025 secs 2024-04-21T16:15:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21028.713025 secs 2024-04-21T16:15:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:19 smithi077 ceph-mon[27902]: pgmap v11308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:15:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:19 smithi191 ceph-mon[31636]: pgmap v11308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:15:19.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:19 smithi170 ceph-mon[31212]: pgmap v11308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:15:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21030.475384 secs 2024-04-21T16:15:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21030.475384 secs 2024-04-21T16:15:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21030.475384 secs 2024-04-21T16:15:21.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:21 smithi077 ceph-mon[27902]: pgmap v11309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:15:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:21 smithi191 ceph-mon[31636]: pgmap v11309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:15:21.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:21 smithi170 ceph-mon[31212]: pgmap v11309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:15:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:22 smithi077 ceph-mon[27902]: pgmap v11310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:15:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:22 smithi191 ceph-mon[31636]: pgmap v11310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:15:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:22 smithi170 ceph-mon[31212]: pgmap v11310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:15:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21033.713162 secs 2024-04-21T16:15:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21033.713162 secs 2024-04-21T16:15:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21033.713162 secs 2024-04-21T16:15:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21035.475453 secs 2024-04-21T16:15:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:24 smithi077 ceph-mon[27902]: pgmap v11311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21035.475453 secs 2024-04-21T16:15:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:24 smithi191 ceph-mon[31636]: pgmap v11311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21035.475453 secs 2024-04-21T16:15:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:24 smithi170 ceph-mon[31212]: pgmap v11311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:15:27.259+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:15:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:15:27.259+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:15:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:15:27.259+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:15:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:15:27.259+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:15:27.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:27 smithi077 ceph-mon[27902]: pgmap v11312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:27.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:27 smithi191 ceph-mon[31636]: pgmap v11312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:27.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:27 smithi170 ceph-mon[31212]: pgmap v11312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21038.713284 secs 2024-04-21T16:15:28.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21038.713284 secs 2024-04-21T16:15:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21038.713284 secs 2024-04-21T16:15:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:29 smithi077 ceph-mon[27902]: pgmap v11313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:29 smithi191 ceph-mon[31636]: pgmap v11313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:29 smithi170 ceph-mon[31212]: pgmap v11313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21040.475584 secs 2024-04-21T16:15:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21040.475584 secs 2024-04-21T16:15:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21040.475584 secs 2024-04-21T16:15:31.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:31 smithi077 ceph-mon[27902]: pgmap v11314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:31 smithi191 ceph-mon[31636]: pgmap v11314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:31 smithi170 ceph-mon[31212]: pgmap v11314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:32 smithi077 ceph-mon[27902]: pgmap v11315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:32 smithi191 ceph-mon[31636]: pgmap v11315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:32 smithi170 ceph-mon[31212]: pgmap v11315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21043.713426 secs 2024-04-21T16:15:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21043.713426 secs 2024-04-21T16:15:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21043.713426 secs 2024-04-21T16:15:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21045.475705 secs 2024-04-21T16:15:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:34 smithi077 ceph-mon[27902]: pgmap v11316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21045.475705 secs 2024-04-21T16:15:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:34 smithi191 ceph-mon[31636]: pgmap v11316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21045.475705 secs 2024-04-21T16:15:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:34 smithi170 ceph-mon[31212]: pgmap v11316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:37 smithi077 ceph-mon[27902]: pgmap v11317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:37 smithi191 ceph-mon[31636]: pgmap v11317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:37.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:37 smithi170 ceph-mon[31212]: pgmap v11317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21048.713557 secs 2024-04-21T16:15:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21048.713557 secs 2024-04-21T16:15:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21048.713557 secs 2024-04-21T16:15:39.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:39 smithi077 ceph-mon[27902]: pgmap v11318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:39.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21050.475824 secs 2024-04-21T16:15:39.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:39 smithi191 ceph-mon[31636]: pgmap v11318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:39.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21050.475824 secs 2024-04-21T16:15:39.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:39 smithi170 ceph-mon[31212]: pgmap v11318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:39.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21050.475824 secs 2024-04-21T16:15:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:40 smithi077 ceph-mon[27902]: pgmap v11319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:40 smithi191 ceph-mon[31636]: pgmap v11319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:40 smithi170 ceph-mon[31212]: pgmap v11319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21053.713688 secs 2024-04-21T16:15:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:43 smithi077 ceph-mon[27902]: pgmap v11320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21053.713688 secs 2024-04-21T16:15:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:43 smithi191 ceph-mon[31636]: pgmap v11320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21053.713688 secs 2024-04-21T16:15:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:43 smithi170 ceph-mon[31212]: pgmap v11320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21055.475955 secs 2024-04-21T16:15:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:45 smithi077 ceph-mon[27902]: pgmap v11321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21055.475955 secs 2024-04-21T16:15:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:45 smithi191 ceph-mon[31636]: pgmap v11321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21055.475955 secs 2024-04-21T16:15:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:45 smithi170 ceph-mon[31212]: pgmap v11321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:47 smithi077 ceph-mon[27902]: pgmap v11322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:47.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:47 smithi191 ceph-mon[31636]: pgmap v11322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:47.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:47 smithi170 ceph-mon[31212]: pgmap v11322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21058.713828 secs 2024-04-21T16:15:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21058.713828 secs 2024-04-21T16:15:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21058.713828 secs 2024-04-21T16:15:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:49 smithi077 ceph-mon[27902]: pgmap v11323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21060.476089 secs 2024-04-21T16:15:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:49 smithi191 ceph-mon[31636]: pgmap v11323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:49.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21060.476089 secs 2024-04-21T16:15:49.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:49 smithi170 ceph-mon[31212]: pgmap v11323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:49.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21060.476089 secs 2024-04-21T16:15:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:50 smithi077 ceph-mon[27902]: pgmap v11324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:50 smithi191 ceph-mon[31636]: pgmap v11324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:50 smithi170 ceph-mon[31212]: pgmap v11324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:15:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21063.713949 secs 2024-04-21T16:15:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:53 smithi077 ceph-mon[27902]: pgmap v11325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21063.713949 secs 2024-04-21T16:15:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:53 smithi191 ceph-mon[31636]: pgmap v11325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21063.713949 secs 2024-04-21T16:15:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:53 smithi170 ceph-mon[31212]: pgmap v11325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:15:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:15:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21065.476214 secs 2024-04-21T16:15:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:55 smithi077 ceph-mon[27902]: pgmap v11326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21065.476214 secs 2024-04-21T16:15:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:55 smithi191 ceph-mon[31636]: pgmap v11326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21065.476214 secs 2024-04-21T16:15:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:55 smithi170 ceph-mon[31212]: pgmap v11326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:57 smithi077 ceph-mon[27902]: pgmap v11327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:57.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:57 smithi191 ceph-mon[31636]: pgmap v11327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:57.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:57 smithi170 ceph-mon[31212]: pgmap v11327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:15:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21068.714051 secs 2024-04-21T16:15:58.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21068.714051 secs 2024-04-21T16:15:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21068.714051 secs 2024-04-21T16:15:59.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:59 smithi077 ceph-mon[27902]: pgmap v11328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:59.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21070.476324 secs 2024-04-21T16:15:59.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:59 smithi191 ceph-mon[31636]: pgmap v11328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:59.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21070.476324 secs 2024-04-21T16:15:59.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:59 smithi170 ceph-mon[31212]: pgmap v11328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:15:59.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21070.476324 secs 2024-04-21T16:16:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:00 smithi077 ceph-mon[27902]: pgmap v11329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:00 smithi191 ceph-mon[31636]: pgmap v11329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:00 smithi170 ceph-mon[31212]: pgmap v11329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21073.714167 secs 2024-04-21T16:16:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:03 smithi077 ceph-mon[27902]: pgmap v11330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21073.714167 secs 2024-04-21T16:16:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:03 smithi191 ceph-mon[31636]: pgmap v11330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21073.714167 secs 2024-04-21T16:16:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:03 smithi170 ceph-mon[31212]: pgmap v11330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21075.476433 secs 2024-04-21T16:16:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:05 smithi077 ceph-mon[27902]: pgmap v11331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:05 smithi077 ceph-mon[27902]: osdmap e780: 12 total, 12 up, 12 in 2024-04-21T16:16:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21075.476433 secs 2024-04-21T16:16:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:05 smithi191 ceph-mon[31636]: pgmap v11331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:05 smithi191 ceph-mon[31636]: osdmap e780: 12 total, 12 up, 12 in 2024-04-21T16:16:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21075.476433 secs 2024-04-21T16:16:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:05 smithi170 ceph-mon[31212]: pgmap v11331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:05 smithi170 ceph-mon[31212]: osdmap e780: 12 total, 12 up, 12 in 2024-04-21T16:16:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:16:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:16:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:16:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:07 smithi077 ceph-mon[27902]: pgmap v11333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:16:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:16:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:16:07.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:07 smithi191 ceph-mon[31636]: pgmap v11333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:07.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:16:07.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:16:07.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:16:07.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:07 smithi170 ceph-mon[31212]: pgmap v11333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:07.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:16:07.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:16:07.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:16:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21078.714228 secs 2024-04-21T16:16:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:08 smithi077 ceph-mon[27902]: pgmap v11334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21078.714228 secs 2024-04-21T16:16:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:08 smithi191 ceph-mon[31636]: pgmap v11334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21078.714228 secs 2024-04-21T16:16:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:08 smithi170 ceph-mon[31212]: pgmap v11334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21080.476589 secs 2024-04-21T16:16:09.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21080.476589 secs 2024-04-21T16:16:09.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21080.476589 secs 2024-04-21T16:16:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:10 smithi077 ceph-mon[27902]: pgmap v11335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:10 smithi191 ceph-mon[31636]: pgmap v11335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:10 smithi170 ceph-mon[31212]: pgmap v11335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:16:12.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:11 smithi191 ceph-mon[31636]: osdmap e781: 12 total, 12 up, 12 in 2024-04-21T16:16:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:11 smithi170 ceph-mon[31212]: osdmap e781: 12 total, 12 up, 12 in 2024-04-21T16:16:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:11 smithi077 ceph-mon[27902]: osdmap e781: 12 total, 12 up, 12 in 2024-04-21T16:16:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21083.714372 secs 2024-04-21T16:16:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:12 smithi191 ceph-mon[31636]: pgmap v11337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:16:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21083.714372 secs 2024-04-21T16:16:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:12 smithi170 ceph-mon[31212]: pgmap v11337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:16:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21083.714372 secs 2024-04-21T16:16:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:12 smithi077 ceph-mon[27902]: pgmap v11337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:16:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21085.476733 secs 2024-04-21T16:16:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:15 smithi077 ceph-mon[27902]: pgmap v11338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:16:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21085.476733 secs 2024-04-21T16:16:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:15 smithi191 ceph-mon[31636]: pgmap v11338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:16:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21085.476733 secs 2024-04-21T16:16:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:15 smithi170 ceph-mon[31212]: pgmap v11338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:16:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:17 smithi077 ceph-mon[27902]: pgmap v11339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:16:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:17 smithi191 ceph-mon[31636]: pgmap v11339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:16:17.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:17 smithi170 ceph-mon[31212]: pgmap v11339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:16:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21088.714497 secs 2024-04-21T16:16:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21088.714497 secs 2024-04-21T16:16:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21088.714497 secs 2024-04-21T16:16:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:19 smithi077 ceph-mon[27902]: pgmap v11340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:16:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21090.476884 secs 2024-04-21T16:16:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:19 smithi191 ceph-mon[31636]: pgmap v11340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:16:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21090.476884 secs 2024-04-21T16:16:19.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:19 smithi170 ceph-mon[31212]: pgmap v11340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:16:19.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21090.476884 secs 2024-04-21T16:16:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:20 smithi077 ceph-mon[27902]: pgmap v11341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:16:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:20 smithi191 ceph-mon[31636]: pgmap v11341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:16:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:20 smithi170 ceph-mon[31212]: pgmap v11341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:16:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21093.714618 secs 2024-04-21T16:16:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:23 smithi077 ceph-mon[27902]: pgmap v11342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:16:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21093.714618 secs 2024-04-21T16:16:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:23 smithi191 ceph-mon[31636]: pgmap v11342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:16:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21093.714618 secs 2024-04-21T16:16:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:23 smithi170 ceph-mon[31212]: pgmap v11342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:16:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21095.476996 secs 2024-04-21T16:16:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:24 smithi077 ceph-mon[27902]: pgmap v11343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21095.476996 secs 2024-04-21T16:16:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:24 smithi191 ceph-mon[31636]: pgmap v11343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21095.476996 secs 2024-04-21T16:16:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:24 smithi170 ceph-mon[31212]: pgmap v11343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:27.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:27 smithi077 ceph-mon[27902]: pgmap v11344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:27.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:27 smithi191 ceph-mon[31636]: pgmap v11344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:27.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:27 smithi170 ceph-mon[31212]: pgmap v11344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21098.714795 secs 2024-04-21T16:16:28.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21098.714795 secs 2024-04-21T16:16:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21098.714795 secs 2024-04-21T16:16:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:29 smithi077 ceph-mon[27902]: pgmap v11345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:29.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21100.477124 secs 2024-04-21T16:16:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:29 smithi191 ceph-mon[31636]: pgmap v11345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21100.477124 secs 2024-04-21T16:16:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:29 smithi170 ceph-mon[31212]: pgmap v11345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21100.477124 secs 2024-04-21T16:16:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:30 smithi077 ceph-mon[27902]: pgmap v11346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:30 smithi191 ceph-mon[31636]: pgmap v11346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:30 smithi170 ceph-mon[31212]: pgmap v11346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21103.714893 secs 2024-04-21T16:16:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:33 smithi077 ceph-mon[27902]: pgmap v11347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21103.714893 secs 2024-04-21T16:16:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:33 smithi191 ceph-mon[31636]: pgmap v11347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21103.714893 secs 2024-04-21T16:16:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:33 smithi170 ceph-mon[31212]: pgmap v11347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21105.477221 secs 2024-04-21T16:16:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21105.477221 secs 2024-04-21T16:16:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21105.477221 secs 2024-04-21T16:16:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:35 smithi077 ceph-mon[27902]: pgmap v11348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:35 smithi191 ceph-mon[31636]: pgmap v11348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:35 smithi170 ceph-mon[31212]: pgmap v11348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:36 smithi077 ceph-mon[27902]: pgmap v11349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:36 smithi191 ceph-mon[31636]: pgmap v11349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:36 smithi170 ceph-mon[31212]: pgmap v11349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:37.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21108.715017 secs 2024-04-21T16:16:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21108.715017 secs 2024-04-21T16:16:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21108.715017 secs 2024-04-21T16:16:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:38 smithi191 ceph-mon[31636]: pgmap v11350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:38 smithi170 ceph-mon[31212]: pgmap v11350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:38 smithi077 ceph-mon[27902]: pgmap v11350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21110.477346 secs 2024-04-21T16:16:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21110.477346 secs 2024-04-21T16:16:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21110.477346 secs 2024-04-21T16:16:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:40 smithi191 ceph-mon[31636]: pgmap v11351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:40 smithi170 ceph-mon[31212]: pgmap v11351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:40 smithi077 ceph-mon[27902]: pgmap v11351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21113.715135 secs 2024-04-21T16:16:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:43 smithi077 ceph-mon[27902]: pgmap v11352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21113.715135 secs 2024-04-21T16:16:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:43 smithi191 ceph-mon[31636]: pgmap v11352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21113.715135 secs 2024-04-21T16:16:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:43 smithi170 ceph-mon[31212]: pgmap v11352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21115.477459 secs 2024-04-21T16:16:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21115.477459 secs 2024-04-21T16:16:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21115.477459 secs 2024-04-21T16:16:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:45 smithi077 ceph-mon[27902]: pgmap v11353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:45 smithi191 ceph-mon[31636]: pgmap v11353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:45 smithi170 ceph-mon[31212]: pgmap v11353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:46 smithi077 ceph-mon[27902]: pgmap v11354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:46 smithi191 ceph-mon[31636]: pgmap v11354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:46 smithi170 ceph-mon[31212]: pgmap v11354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21118.715210 secs 2024-04-21T16:16:48.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21118.715210 secs 2024-04-21T16:16:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21118.715210 secs 2024-04-21T16:16:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:48 smithi191 ceph-mon[31636]: pgmap v11355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:48 smithi170 ceph-mon[31212]: pgmap v11355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:48 smithi077 ceph-mon[27902]: pgmap v11355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:49.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21120.477607 secs 2024-04-21T16:16:50.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21120.477607 secs 2024-04-21T16:16:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21120.477607 secs 2024-04-21T16:16:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:50 smithi191 ceph-mon[31636]: pgmap v11356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:50 smithi170 ceph-mon[31212]: pgmap v11356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:50 smithi077 ceph-mon[27902]: pgmap v11356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:16:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21123.715273 secs 2024-04-21T16:16:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:53 smithi077 ceph-mon[27902]: pgmap v11357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21123.715273 secs 2024-04-21T16:16:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:53 smithi191 ceph-mon[31636]: pgmap v11357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21123.715273 secs 2024-04-21T16:16:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:53 smithi170 ceph-mon[31212]: pgmap v11357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:16:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21125.477725 secs 2024-04-21T16:16:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:54 smithi077 ceph-mon[27902]: pgmap v11358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21125.477725 secs 2024-04-21T16:16:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:54 smithi191 ceph-mon[31636]: pgmap v11358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21125.477725 secs 2024-04-21T16:16:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:54 smithi170 ceph-mon[31212]: pgmap v11358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:16:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:56 smithi077 ceph-mon[27902]: pgmap v11359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:56 smithi191 ceph-mon[31636]: pgmap v11359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:56 smithi170 ceph-mon[31212]: pgmap v11359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:16:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:16:57.271+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:16:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:16:57.271+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:16:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:16:57.271+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:16:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:16:57.271+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:16:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21128.715414 secs 2024-04-21T16:16:58.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21128.715414 secs 2024-04-21T16:16:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21128.715414 secs 2024-04-21T16:16:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:58 smithi170 ceph-mon[31212]: pgmap v11360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:58 smithi191 ceph-mon[31636]: pgmap v11360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:58 smithi077 ceph-mon[27902]: pgmap v11360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:16:59.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21130.477815 secs 2024-04-21T16:17:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21130.477815 secs 2024-04-21T16:17:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21130.477815 secs 2024-04-21T16:17:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:00 smithi191 ceph-mon[31636]: pgmap v11361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:17:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:00 smithi170 ceph-mon[31212]: pgmap v11361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:17:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:00 smithi077 ceph-mon[27902]: pgmap v11361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T16:17:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:02 smithi077 ceph-mon[27902]: pgmap v11362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:17:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:02 smithi191 ceph-mon[31636]: pgmap v11362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:17:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:02 smithi170 ceph-mon[31212]: pgmap v11362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T16:17:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21133.715487 secs 2024-04-21T16:17:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21133.715487 secs 2024-04-21T16:17:03.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21133.715487 secs 2024-04-21T16:17:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21135.477928 secs 2024-04-21T16:17:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:04 smithi191 ceph-mon[31636]: pgmap v11363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21135.477928 secs 2024-04-21T16:17:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:04 smithi170 ceph-mon[31212]: pgmap v11363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21135.477928 secs 2024-04-21T16:17:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:04 smithi077 ceph-mon[27902]: pgmap v11363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:05 smithi191 ceph-mon[31636]: osdmap e782: 12 total, 12 up, 12 in 2024-04-21T16:17:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:05 smithi170 ceph-mon[31212]: osdmap e782: 12 total, 12 up, 12 in 2024-04-21T16:17:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:05 smithi077 ceph-mon[27902]: osdmap e782: 12 total, 12 up, 12 in 2024-04-21T16:17:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:06 smithi191 ceph-mon[31636]: pgmap v11365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:17:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:06 smithi170 ceph-mon[31212]: pgmap v11365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:17:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:06 smithi077 ceph-mon[27902]: pgmap v11365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:17:07.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:17:07.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:17:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:17:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21138.715606 secs 2024-04-21T16:17:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:17:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:17:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:17:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:08 smithi191 ceph-mon[31636]: pgmap v11366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:17:08.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21138.715606 secs 2024-04-21T16:17:08.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:17:08.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:17:08.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:17:08.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:08 smithi077 ceph-mon[27902]: pgmap v11366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:17:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21138.715606 secs 2024-04-21T16:17:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:17:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:17:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:17:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:08 smithi170 ceph-mon[31212]: pgmap v11366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:17:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21140.478000 secs 2024-04-21T16:17:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21140.478000 secs 2024-04-21T16:17:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21140.478000 secs 2024-04-21T16:17:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:10 smithi191 ceph-mon[31636]: pgmap v11367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:17:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:10 smithi170 ceph-mon[31212]: pgmap v11367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:17:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:10 smithi077 ceph-mon[27902]: pgmap v11367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:17:12.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:11 smithi191 ceph-mon[31636]: osdmap e783: 12 total, 12 up, 12 in 2024-04-21T16:17:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:11 smithi170 ceph-mon[31212]: osdmap e783: 12 total, 12 up, 12 in 2024-04-21T16:17:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:11 smithi077 ceph-mon[27902]: osdmap e783: 12 total, 12 up, 12 in 2024-04-21T16:17:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21143.715711 secs 2024-04-21T16:17:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:12 smithi191 ceph-mon[31636]: pgmap v11369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:17:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21143.715711 secs 2024-04-21T16:17:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:12 smithi170 ceph-mon[31212]: pgmap v11369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:17:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21143.715711 secs 2024-04-21T16:17:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:12 smithi077 ceph-mon[27902]: pgmap v11369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:17:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21145.478099 secs 2024-04-21T16:17:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:14 smithi077 ceph-mon[27902]: pgmap v11370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:17:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21145.478099 secs 2024-04-21T16:17:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:14 smithi191 ceph-mon[31636]: pgmap v11370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:17:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21145.478099 secs 2024-04-21T16:17:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:14 smithi170 ceph-mon[31212]: pgmap v11370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:17:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:16 smithi191 ceph-mon[31636]: pgmap v11371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:17:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:16 smithi170 ceph-mon[31212]: pgmap v11371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:17:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:16 smithi077 ceph-mon[27902]: pgmap v11371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:17:17.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21148.715836 secs 2024-04-21T16:17:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21148.715836 secs 2024-04-21T16:17:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21148.715836 secs 2024-04-21T16:17:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:18 smithi191 ceph-mon[31636]: pgmap v11372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:17:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:18 smithi170 ceph-mon[31212]: pgmap v11372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:17:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:18 smithi077 ceph-mon[27902]: pgmap v11372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:17:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21150.478215 secs 2024-04-21T16:17:20.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21150.478215 secs 2024-04-21T16:17:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21150.478215 secs 2024-04-21T16:17:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:20 smithi191 ceph-mon[31636]: pgmap v11373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-04-21T16:17:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:20 smithi170 ceph-mon[31212]: pgmap v11373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-04-21T16:17:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:20 smithi077 ceph-mon[27902]: pgmap v11373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-04-21T16:17:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:22 smithi191 ceph-mon[31636]: pgmap v11374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:17:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:22 smithi170 ceph-mon[31212]: pgmap v11374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:17:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:22 smithi077 ceph-mon[27902]: pgmap v11374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:17:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21153.715904 secs 2024-04-21T16:17:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21153.715904 secs 2024-04-21T16:17:23.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21153.715904 secs 2024-04-21T16:17:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21155.478339 secs 2024-04-21T16:17:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:24 smithi191 ceph-mon[31636]: pgmap v11375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21155.478339 secs 2024-04-21T16:17:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:24 smithi170 ceph-mon[31212]: pgmap v11375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21155.478339 secs 2024-04-21T16:17:24.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:24 smithi077 ceph-mon[27902]: pgmap v11375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:26 smithi191 ceph-mon[31636]: pgmap v11376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:26 smithi170 ceph-mon[31212]: pgmap v11376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:26 smithi077 ceph-mon[27902]: pgmap v11376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21158.715966 secs 2024-04-21T16:17:28.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21158.715966 secs 2024-04-21T16:17:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21158.715966 secs 2024-04-21T16:17:28.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:28 smithi170 ceph-mon[31212]: pgmap v11377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:28 smithi191 ceph-mon[31636]: pgmap v11377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:28 smithi077 ceph-mon[27902]: pgmap v11377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21160.478482 secs 2024-04-21T16:17:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21160.478482 secs 2024-04-21T16:17:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21160.478482 secs 2024-04-21T16:17:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:30 smithi191 ceph-mon[31636]: pgmap v11378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T16:17:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:30 smithi170 ceph-mon[31212]: pgmap v11378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T16:17:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:30 smithi077 ceph-mon[27902]: pgmap v11378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T16:17:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:32 smithi191 ceph-mon[31636]: pgmap v11379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T16:17:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:32 smithi170 ceph-mon[31212]: pgmap v11379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T16:17:32.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:32 smithi077 ceph-mon[27902]: pgmap v11379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T16:17:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21163.716082 secs 2024-04-21T16:17:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21163.716082 secs 2024-04-21T16:17:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21163.716082 secs 2024-04-21T16:17:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21165.478600 secs 2024-04-21T16:17:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:34 smithi191 ceph-mon[31636]: pgmap v11380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21165.478600 secs 2024-04-21T16:17:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:34 smithi170 ceph-mon[31212]: pgmap v11380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21165.478600 secs 2024-04-21T16:17:34.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:34 smithi077 ceph-mon[27902]: pgmap v11380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:36 smithi191 ceph-mon[31636]: pgmap v11381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:36 smithi170 ceph-mon[31212]: pgmap v11381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:36 smithi077 ceph-mon[27902]: pgmap v11381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:37.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21168.716194 secs 2024-04-21T16:17:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21168.716194 secs 2024-04-21T16:17:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21168.716194 secs 2024-04-21T16:17:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:38 smithi191 ceph-mon[31636]: pgmap v11382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:39.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:38 smithi077 ceph-mon[27902]: pgmap v11382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:38 smithi170 ceph-mon[31212]: pgmap v11382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:39.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21170.478720 secs 2024-04-21T16:17:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21170.478720 secs 2024-04-21T16:17:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21170.478720 secs 2024-04-21T16:17:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:40 smithi191 ceph-mon[31636]: pgmap v11383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T16:17:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:40 smithi170 ceph-mon[31212]: pgmap v11383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T16:17:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:40 smithi077 ceph-mon[27902]: pgmap v11383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T16:17:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:42 smithi191 ceph-mon[31636]: pgmap v11384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T16:17:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:42 smithi170 ceph-mon[31212]: pgmap v11384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T16:17:42.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:42 smithi077 ceph-mon[27902]: pgmap v11384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T16:17:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21173.716317 secs 2024-04-21T16:17:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21173.716317 secs 2024-04-21T16:17:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21173.716317 secs 2024-04-21T16:17:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21175.478876 secs 2024-04-21T16:17:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:44 smithi191 ceph-mon[31636]: pgmap v11385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:17:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21175.478876 secs 2024-04-21T16:17:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:44 smithi170 ceph-mon[31212]: pgmap v11385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:17:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21175.478876 secs 2024-04-21T16:17:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:44 smithi077 ceph-mon[27902]: pgmap v11385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:17:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:46.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:46 smithi191 ceph-mon[31636]: pgmap v11386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:46 smithi170 ceph-mon[31212]: pgmap v11386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:46 smithi077 ceph-mon[27902]: pgmap v11386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21178.716458 secs 2024-04-21T16:17:48.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21178.716458 secs 2024-04-21T16:17:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21178.716458 secs 2024-04-21T16:17:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:48 smithi191 ceph-mon[31636]: pgmap v11387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:17:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:48 smithi170 ceph-mon[31212]: pgmap v11387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:17:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:48 smithi077 ceph-mon[27902]: pgmap v11387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:17:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21180.478998 secs 2024-04-21T16:17:50.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21180.478998 secs 2024-04-21T16:17:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21180.478998 secs 2024-04-21T16:17:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:50 smithi191 ceph-mon[31636]: pgmap v11388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:50 smithi170 ceph-mon[31212]: pgmap v11388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:50 smithi077 ceph-mon[27902]: pgmap v11388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:52 smithi191 ceph-mon[31636]: pgmap v11389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T16:17:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:52 smithi170 ceph-mon[31212]: pgmap v11389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T16:17:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:52 smithi077 ceph-mon[27902]: pgmap v11389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T16:17:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21183.716582 secs 2024-04-21T16:17:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21183.716582 secs 2024-04-21T16:17:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21183.716582 secs 2024-04-21T16:17:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21185.479115 secs 2024-04-21T16:17:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:54 smithi191 ceph-mon[31636]: pgmap v11390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21185.479115 secs 2024-04-21T16:17:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:54 smithi170 ceph-mon[31212]: pgmap v11390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21185.479115 secs 2024-04-21T16:17:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:54 smithi077 ceph-mon[27902]: pgmap v11390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:17:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:56 smithi191 ceph-mon[31636]: pgmap v11391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:56 smithi170 ceph-mon[31212]: pgmap v11391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:56 smithi077 ceph-mon[27902]: pgmap v11391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:17:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21188.716708 secs 2024-04-21T16:17:58.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21188.716708 secs 2024-04-21T16:17:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21188.716708 secs 2024-04-21T16:17:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:58 smithi170 ceph-mon[31212]: pgmap v11392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:58 smithi191 ceph-mon[31636]: pgmap v11392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:58 smithi077 ceph-mon[27902]: pgmap v11392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:17:59.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21190.479200 secs 2024-04-21T16:18:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21190.479200 secs 2024-04-21T16:18:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21190.479200 secs 2024-04-21T16:18:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:00 smithi191 ceph-mon[31636]: pgmap v11393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:00 smithi170 ceph-mon[31212]: pgmap v11393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:00 smithi077 ceph-mon[27902]: pgmap v11393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:02 smithi191 ceph-mon[31636]: pgmap v11394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:02 smithi170 ceph-mon[31212]: pgmap v11394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:02 smithi077 ceph-mon[27902]: pgmap v11394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21193.716852 secs 2024-04-21T16:18:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21193.716852 secs 2024-04-21T16:18:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21193.716852 secs 2024-04-21T16:18:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21195.479309 secs 2024-04-21T16:18:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:04 smithi191 ceph-mon[31636]: pgmap v11395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21195.479309 secs 2024-04-21T16:18:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:04 smithi170 ceph-mon[31212]: pgmap v11395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21195.479309 secs 2024-04-21T16:18:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:04 smithi077 ceph-mon[27902]: pgmap v11395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:05 smithi191 ceph-mon[31636]: osdmap e784: 12 total, 12 up, 12 in 2024-04-21T16:18:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:05 smithi170 ceph-mon[31212]: osdmap e784: 12 total, 12 up, 12 in 2024-04-21T16:18:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:05 smithi077 ceph-mon[27902]: osdmap e784: 12 total, 12 up, 12 in 2024-04-21T16:18:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:06 smithi191 ceph-mon[31636]: pgmap v11397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:18:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:06 smithi170 ceph-mon[31212]: pgmap v11397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:18:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:06 smithi077 ceph-mon[27902]: pgmap v11397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:18:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21198.716947 secs 2024-04-21T16:18:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21198.716947 secs 2024-04-21T16:18:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21198.716947 secs 2024-04-21T16:18:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:18:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:08 smithi191 ceph-mon[31636]: pgmap v11398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:18:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:18:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:18:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:18:09.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:18:09.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:08 smithi077 ceph-mon[27902]: pgmap v11398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:18:09.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:18:09.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:18:09.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:18:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:18:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:08 smithi170 ceph-mon[31212]: pgmap v11398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:18:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:18:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:18:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:18:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21200.479393 secs 2024-04-21T16:18:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21200.479393 secs 2024-04-21T16:18:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21200.479393 secs 2024-04-21T16:18:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:10 smithi191 ceph-mon[31636]: pgmap v11399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:18:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:10 smithi170 ceph-mon[31212]: pgmap v11399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:18:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:10 smithi077 ceph-mon[27902]: pgmap v11399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:18:12.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:11 smithi191 ceph-mon[31636]: osdmap e785: 12 total, 12 up, 12 in 2024-04-21T16:18:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:11 smithi170 ceph-mon[31212]: osdmap e785: 12 total, 12 up, 12 in 2024-04-21T16:18:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:11 smithi077 ceph-mon[27902]: osdmap e785: 12 total, 12 up, 12 in 2024-04-21T16:18:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21203.717090 secs 2024-04-21T16:18:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:12 smithi191 ceph-mon[31636]: pgmap v11401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:18:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21203.717090 secs 2024-04-21T16:18:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:12 smithi170 ceph-mon[31212]: pgmap v11401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:18:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21203.717090 secs 2024-04-21T16:18:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:12 smithi077 ceph-mon[27902]: pgmap v11401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:18:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21205.479533 secs 2024-04-21T16:18:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:14 smithi191 ceph-mon[31636]: pgmap v11402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:18:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21205.479533 secs 2024-04-21T16:18:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:14 smithi170 ceph-mon[31212]: pgmap v11402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:18:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21205.479533 secs 2024-04-21T16:18:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:14 smithi077 ceph-mon[27902]: pgmap v11402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:18:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:16 smithi191 ceph-mon[31636]: pgmap v11403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:18:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:16 smithi170 ceph-mon[31212]: pgmap v11403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:18:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:16 smithi077 ceph-mon[27902]: pgmap v11403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:18:17.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21208.717236 secs 2024-04-21T16:18:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21208.717236 secs 2024-04-21T16:18:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21208.717236 secs 2024-04-21T16:18:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:18 smithi191 ceph-mon[31636]: pgmap v11404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:18:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:18 smithi170 ceph-mon[31212]: pgmap v11404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:18:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:18 smithi077 ceph-mon[27902]: pgmap v11404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:18:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21210.479655 secs 2024-04-21T16:18:20.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21210.479655 secs 2024-04-21T16:18:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21210.479655 secs 2024-04-21T16:18:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:20 smithi191 ceph-mon[31636]: pgmap v11405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:18:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:20 smithi170 ceph-mon[31212]: pgmap v11405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:18:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:20 smithi077 ceph-mon[27902]: pgmap v11405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:18:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:22 smithi191 ceph-mon[31636]: pgmap v11406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:18:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:22 smithi170 ceph-mon[31212]: pgmap v11406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:18:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:22 smithi077 ceph-mon[27902]: pgmap v11406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:18:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21213.717363 secs 2024-04-21T16:18:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21213.717363 secs 2024-04-21T16:18:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21213.717363 secs 2024-04-21T16:18:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21215.479795 secs 2024-04-21T16:18:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:24 smithi191 ceph-mon[31636]: pgmap v11407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21215.479795 secs 2024-04-21T16:18:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:24 smithi170 ceph-mon[31212]: pgmap v11407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21215.479795 secs 2024-04-21T16:18:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:24 smithi077 ceph-mon[27902]: pgmap v11407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:26 smithi191 ceph-mon[31636]: pgmap v11408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:26 smithi170 ceph-mon[31212]: pgmap v11408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:26 smithi077 ceph-mon[27902]: pgmap v11408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:27.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21218.717457 secs 2024-04-21T16:18:28.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21218.717457 secs 2024-04-21T16:18:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21218.717457 secs 2024-04-21T16:18:28.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:28 smithi170 ceph-mon[31212]: pgmap v11409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:28 smithi191 ceph-mon[31636]: pgmap v11409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:28 smithi077 ceph-mon[27902]: pgmap v11409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21220.479916 secs 2024-04-21T16:18:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21220.479916 secs 2024-04-21T16:18:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21220.479916 secs 2024-04-21T16:18:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:30 smithi191 ceph-mon[31636]: pgmap v11410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:30 smithi170 ceph-mon[31212]: pgmap v11410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:30 smithi077 ceph-mon[27902]: pgmap v11410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:32 smithi191 ceph-mon[31636]: pgmap v11411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:32 smithi170 ceph-mon[31212]: pgmap v11411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:32 smithi077 ceph-mon[27902]: pgmap v11411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21223.717605 secs 2024-04-21T16:18:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21223.717605 secs 2024-04-21T16:18:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21223.717605 secs 2024-04-21T16:18:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21225.480043 secs 2024-04-21T16:18:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:34 smithi191 ceph-mon[31636]: pgmap v11412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21225.480043 secs 2024-04-21T16:18:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:34 smithi170 ceph-mon[31212]: pgmap v11412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21225.480043 secs 2024-04-21T16:18:34.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:34 smithi077 ceph-mon[27902]: pgmap v11412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:36 smithi191 ceph-mon[31636]: pgmap v11413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:36 smithi170 ceph-mon[31212]: pgmap v11413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:36 smithi077 ceph-mon[27902]: pgmap v11413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21228.717735 secs 2024-04-21T16:18:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21228.717735 secs 2024-04-21T16:18:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21228.717735 secs 2024-04-21T16:18:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:38 smithi191 ceph-mon[31636]: pgmap v11414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:39.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:38 smithi077 ceph-mon[27902]: pgmap v11414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:38 smithi170 ceph-mon[31212]: pgmap v11414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21230.480179 secs 2024-04-21T16:18:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21230.480179 secs 2024-04-21T16:18:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21230.480179 secs 2024-04-21T16:18:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:40 smithi191 ceph-mon[31636]: pgmap v11415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:40 smithi170 ceph-mon[31212]: pgmap v11415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:40 smithi077 ceph-mon[27902]: pgmap v11415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:42 smithi191 ceph-mon[31636]: pgmap v11416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:42 smithi170 ceph-mon[31212]: pgmap v11416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:42 smithi077 ceph-mon[27902]: pgmap v11416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21233.717817 secs 2024-04-21T16:18:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21233.717817 secs 2024-04-21T16:18:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21233.717817 secs 2024-04-21T16:18:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21235.480289 secs 2024-04-21T16:18:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:44 smithi191 ceph-mon[31636]: pgmap v11417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21235.480289 secs 2024-04-21T16:18:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:44 smithi170 ceph-mon[31212]: pgmap v11417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21235.480289 secs 2024-04-21T16:18:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:44 smithi077 ceph-mon[27902]: pgmap v11417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:46 smithi191 ceph-mon[31636]: pgmap v11418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:46 smithi170 ceph-mon[31212]: pgmap v11418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:46 smithi077 ceph-mon[27902]: pgmap v11418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21238.717905 secs 2024-04-21T16:18:48.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21238.717905 secs 2024-04-21T16:18:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21238.717905 secs 2024-04-21T16:18:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:48 smithi191 ceph-mon[31636]: pgmap v11419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:48 smithi170 ceph-mon[31212]: pgmap v11419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:48 smithi077 ceph-mon[27902]: pgmap v11419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21240.480442 secs 2024-04-21T16:18:50.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21240.480442 secs 2024-04-21T16:18:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21240.480442 secs 2024-04-21T16:18:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:50 smithi191 ceph-mon[31636]: pgmap v11420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:50 smithi170 ceph-mon[31212]: pgmap v11420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:50 smithi077 ceph-mon[27902]: pgmap v11420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:52 smithi191 ceph-mon[31636]: pgmap v11421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:52 smithi170 ceph-mon[31212]: pgmap v11421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:52 smithi077 ceph-mon[27902]: pgmap v11421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21243.717969 secs 2024-04-21T16:18:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21243.717969 secs 2024-04-21T16:18:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21243.717969 secs 2024-04-21T16:18:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21245.480532 secs 2024-04-21T16:18:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:54 smithi191 ceph-mon[31636]: pgmap v11422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21245.480532 secs 2024-04-21T16:18:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:54 smithi170 ceph-mon[31212]: pgmap v11422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21245.480532 secs 2024-04-21T16:18:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:54 smithi077 ceph-mon[27902]: pgmap v11422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:18:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:56 smithi191 ceph-mon[31636]: pgmap v11423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:56 smithi170 ceph-mon[31212]: pgmap v11423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:56 smithi077 ceph-mon[27902]: pgmap v11423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:18:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21248.718103 secs 2024-04-21T16:18:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21248.718103 secs 2024-04-21T16:18:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21248.718103 secs 2024-04-21T16:18:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:58 smithi170 ceph-mon[31212]: pgmap v11424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:58 smithi191 ceph-mon[31636]: pgmap v11424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:58 smithi077 ceph-mon[27902]: pgmap v11424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:18:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21250.480647 secs 2024-04-21T16:19:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21250.480647 secs 2024-04-21T16:19:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21250.480647 secs 2024-04-21T16:19:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:00 smithi191 ceph-mon[31636]: pgmap v11425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T16:19:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:00 smithi170 ceph-mon[31212]: pgmap v11425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T16:19:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:00 smithi077 ceph-mon[27902]: pgmap v11425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T16:19:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:02 smithi191 ceph-mon[31636]: pgmap v11426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:19:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:02 smithi170 ceph-mon[31212]: pgmap v11426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:19:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:02 smithi077 ceph-mon[27902]: pgmap v11426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:19:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21253.718259 secs 2024-04-21T16:19:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21253.718259 secs 2024-04-21T16:19:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21253.718259 secs 2024-04-21T16:19:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21255.480767 secs 2024-04-21T16:19:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:04 smithi191 ceph-mon[31636]: pgmap v11427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:19:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21255.480767 secs 2024-04-21T16:19:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:04 smithi170 ceph-mon[31212]: pgmap v11427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:19:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21255.480767 secs 2024-04-21T16:19:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:04 smithi077 ceph-mon[27902]: pgmap v11427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:19:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:05 smithi191 ceph-mon[31636]: osdmap e786: 12 total, 12 up, 12 in 2024-04-21T16:19:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:05 smithi170 ceph-mon[31212]: osdmap e786: 12 total, 12 up, 12 in 2024-04-21T16:19:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:05 smithi077 ceph-mon[27902]: osdmap e786: 12 total, 12 up, 12 in 2024-04-21T16:19:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:06 smithi191 ceph-mon[31636]: pgmap v11429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:19:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:06 smithi170 ceph-mon[31212]: pgmap v11429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:19:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:06 smithi077 ceph-mon[27902]: pgmap v11429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:19:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21258.718390 secs 2024-04-21T16:19:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21258.718390 secs 2024-04-21T16:19:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21258.718390 secs 2024-04-21T16:19:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:08 smithi191 ceph-mon[31636]: pgmap v11430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:19:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:19:09.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:08 smithi077 ceph-mon[27902]: pgmap v11430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:19:09.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:19:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:08 smithi170 ceph-mon[31212]: pgmap v11430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:19:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:19:09.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21260.480874 secs 2024-04-21T16:19:09.739 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21260.480874 secs 2024-04-21T16:19:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21260.480874 secs 2024-04-21T16:19:11.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: pgmap v11431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: osdmap e787: 12 total, 12 up, 12 in 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:19:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: pgmap v11431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: osdmap e787: 12 total, 12 up, 12 in 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:19:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: pgmap v11431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: osdmap e787: 12 total, 12 up, 12 in 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:19:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:19:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:19:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:19:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:19:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:19:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:19:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:19:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:19:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:19:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:19:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:19:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:19:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:19:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:19:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:19:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:19:12.897 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:19:12.897 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:19:12.897 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:19:12.897 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:19:12.897 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:19:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21263.718505 secs 2024-04-21T16:19:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:13 smithi077 ceph-mon[27902]: pgmap v11433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 29 op/s 2024-04-21T16:19:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21263.718505 secs 2024-04-21T16:19:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:13 smithi191 ceph-mon[31636]: pgmap v11433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 29 op/s 2024-04-21T16:19:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21263.718505 secs 2024-04-21T16:19:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:13 smithi170 ceph-mon[31212]: pgmap v11433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 29 op/s 2024-04-21T16:19:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21265.480932 secs 2024-04-21T16:19:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:15 smithi077 ceph-mon[27902]: pgmap v11434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:19:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21265.480932 secs 2024-04-21T16:19:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:15 smithi191 ceph-mon[31636]: pgmap v11434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:19:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21265.480932 secs 2024-04-21T16:19:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:15 smithi170 ceph-mon[31212]: pgmap v11434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:19:17.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:17 smithi077 ceph-mon[27902]: pgmap v11435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:19:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:17 smithi191 ceph-mon[31636]: pgmap v11435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:19:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:17 smithi170 ceph-mon[31212]: pgmap v11435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:19:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21268.718605 secs 2024-04-21T16:19:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21268.718605 secs 2024-04-21T16:19:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21268.718605 secs 2024-04-21T16:19:19.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:19 smithi077 ceph-mon[27902]: pgmap v11436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:19:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21270.481059 secs 2024-04-21T16:19:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:19 smithi191 ceph-mon[31636]: pgmap v11436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:19:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21270.481059 secs 2024-04-21T16:19:19.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:19 smithi170 ceph-mon[31212]: pgmap v11436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:19:19.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21270.481059 secs 2024-04-21T16:19:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:20 smithi077 ceph-mon[27902]: pgmap v11437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:19:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:20 smithi191 ceph-mon[31636]: pgmap v11437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:19:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:20 smithi170 ceph-mon[31212]: pgmap v11437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:19:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:22 smithi191 ceph-mon[31636]: pgmap v11438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:19:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:22 smithi170 ceph-mon[31212]: pgmap v11438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:19:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:22 smithi077 ceph-mon[27902]: pgmap v11438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:19:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21273.718723 secs 2024-04-21T16:19:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21273.718723 secs 2024-04-21T16:19:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21273.718723 secs 2024-04-21T16:19:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21275.481168 secs 2024-04-21T16:19:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:24 smithi191 ceph-mon[31636]: pgmap v11439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21275.481168 secs 2024-04-21T16:19:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:24 smithi170 ceph-mon[31212]: pgmap v11439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21275.481168 secs 2024-04-21T16:19:24.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:24 smithi077 ceph-mon[27902]: pgmap v11439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:26 smithi191 ceph-mon[31636]: pgmap v11440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:26 smithi170 ceph-mon[31212]: pgmap v11440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:26 smithi077 ceph-mon[27902]: pgmap v11440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21278.718842 secs 2024-04-21T16:19:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21278.718842 secs 2024-04-21T16:19:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21278.718842 secs 2024-04-21T16:19:28.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:28 smithi170 ceph-mon[31212]: pgmap v11441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:28 smithi191 ceph-mon[31636]: pgmap v11441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:28 smithi077 ceph-mon[27902]: pgmap v11441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21280.481313 secs 2024-04-21T16:19:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21280.481313 secs 2024-04-21T16:19:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21280.481313 secs 2024-04-21T16:19:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:30 smithi191 ceph-mon[31636]: pgmap v11442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:30 smithi170 ceph-mon[31212]: pgmap v11442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:30 smithi077 ceph-mon[27902]: pgmap v11442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:32 smithi191 ceph-mon[31636]: pgmap v11443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:32 smithi170 ceph-mon[31212]: pgmap v11443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:32 smithi077 ceph-mon[27902]: pgmap v11443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21283.718935 secs 2024-04-21T16:19:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21283.718935 secs 2024-04-21T16:19:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21283.718935 secs 2024-04-21T16:19:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21285.481435 secs 2024-04-21T16:19:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:34 smithi191 ceph-mon[31636]: pgmap v11444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21285.481435 secs 2024-04-21T16:19:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:34 smithi170 ceph-mon[31212]: pgmap v11444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21285.481435 secs 2024-04-21T16:19:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:34 smithi077 ceph-mon[27902]: pgmap v11444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:36 smithi191 ceph-mon[31636]: pgmap v11445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:36 smithi170 ceph-mon[31212]: pgmap v11445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:36 smithi077 ceph-mon[27902]: pgmap v11445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21288.719016 secs 2024-04-21T16:19:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21288.719016 secs 2024-04-21T16:19:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21288.719016 secs 2024-04-21T16:19:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:38 smithi191 ceph-mon[31636]: pgmap v11446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:39.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:38 smithi077 ceph-mon[27902]: pgmap v11446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:38 smithi170 ceph-mon[31212]: pgmap v11446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21290.481552 secs 2024-04-21T16:19:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21290.481552 secs 2024-04-21T16:19:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21290.481552 secs 2024-04-21T16:19:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:40 smithi191 ceph-mon[31636]: pgmap v11447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:40 smithi170 ceph-mon[31212]: pgmap v11447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:40 smithi077 ceph-mon[27902]: pgmap v11447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:42 smithi191 ceph-mon[31636]: pgmap v11448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:42 smithi170 ceph-mon[31212]: pgmap v11448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:42 smithi077 ceph-mon[27902]: pgmap v11448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21293.719139 secs 2024-04-21T16:19:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21293.719139 secs 2024-04-21T16:19:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21293.719139 secs 2024-04-21T16:19:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21295.481667 secs 2024-04-21T16:19:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:44 smithi191 ceph-mon[31636]: pgmap v11449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21295.481667 secs 2024-04-21T16:19:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:44 smithi170 ceph-mon[31212]: pgmap v11449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21295.481667 secs 2024-04-21T16:19:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:44 smithi077 ceph-mon[27902]: pgmap v11449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:46 smithi191 ceph-mon[31636]: pgmap v11450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:46 smithi170 ceph-mon[31212]: pgmap v11450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:46 smithi077 ceph-mon[27902]: pgmap v11450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21298.719260 secs 2024-04-21T16:19:48.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21298.719260 secs 2024-04-21T16:19:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21298.719260 secs 2024-04-21T16:19:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:48 smithi191 ceph-mon[31636]: pgmap v11451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:48 smithi170 ceph-mon[31212]: pgmap v11451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:48 smithi077 ceph-mon[27902]: pgmap v11451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21300.481787 secs 2024-04-21T16:19:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21300.481787 secs 2024-04-21T16:19:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21300.481787 secs 2024-04-21T16:19:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:50 smithi191 ceph-mon[31636]: pgmap v11452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:50 smithi170 ceph-mon[31212]: pgmap v11452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:50 smithi077 ceph-mon[27902]: pgmap v11452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:52 smithi191 ceph-mon[31636]: pgmap v11453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:52 smithi170 ceph-mon[31212]: pgmap v11453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:52 smithi077 ceph-mon[27902]: pgmap v11453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21303.719382 secs 2024-04-21T16:19:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21303.719382 secs 2024-04-21T16:19:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21303.719382 secs 2024-04-21T16:19:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21305.481848 secs 2024-04-21T16:19:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:54 smithi191 ceph-mon[31636]: pgmap v11454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21305.481848 secs 2024-04-21T16:19:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:54 smithi170 ceph-mon[31212]: pgmap v11454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21305.481848 secs 2024-04-21T16:19:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:54 smithi077 ceph-mon[27902]: pgmap v11454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:19:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:56 smithi191 ceph-mon[31636]: pgmap v11455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:56 smithi170 ceph-mon[31212]: pgmap v11455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:56 smithi077 ceph-mon[27902]: pgmap v11455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:19:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:19:57.296+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:19:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:19:57.296+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:19:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:19:57.297+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:19:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:19:57.297+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:19:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21308.719486 secs 2024-04-21T16:19:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21308.719486 secs 2024-04-21T16:19:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21308.719486 secs 2024-04-21T16:19:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:58 smithi170 ceph-mon[31212]: pgmap v11456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:58 smithi191 ceph-mon[31636]: pgmap v11456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:58 smithi077 ceph-mon[27902]: pgmap v11456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:19:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21310.481967 secs 2024-04-21T16:20:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21310.481967 secs 2024-04-21T16:20:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21310.481967 secs 2024-04-21T16:20:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:20:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:00 smithi191 ceph-mon[31636]: pgmap v11457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:20:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:00 smithi170 ceph-mon[31212]: pgmap v11457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:20:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:00 smithi077 ceph-mon[27902]: pgmap v11457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:02 smithi191 ceph-mon[31636]: pgmap v11458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:02 smithi170 ceph-mon[31212]: pgmap v11458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:02 smithi077 ceph-mon[27902]: pgmap v11458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21313.719604 secs 2024-04-21T16:20:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21313.719604 secs 2024-04-21T16:20:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21313.719604 secs 2024-04-21T16:20:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21315.482033 secs 2024-04-21T16:20:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:04 smithi191 ceph-mon[31636]: pgmap v11459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21315.482033 secs 2024-04-21T16:20:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:04 smithi170 ceph-mon[31212]: pgmap v11459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21315.482033 secs 2024-04-21T16:20:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:04 smithi077 ceph-mon[27902]: pgmap v11459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:05 smithi191 ceph-mon[31636]: osdmap e788: 12 total, 12 up, 12 in 2024-04-21T16:20:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:05 smithi170 ceph-mon[31212]: osdmap e788: 12 total, 12 up, 12 in 2024-04-21T16:20:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:05 smithi077 ceph-mon[27902]: osdmap e788: 12 total, 12 up, 12 in 2024-04-21T16:20:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:06 smithi191 ceph-mon[31636]: pgmap v11461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:20:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:06 smithi170 ceph-mon[31212]: pgmap v11461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:20:06.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:06 smithi077 ceph-mon[27902]: pgmap v11461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:20:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21318.719733 secs 2024-04-21T16:20:08.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21318.719733 secs 2024-04-21T16:20:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21318.719733 secs 2024-04-21T16:20:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:08 smithi191 ceph-mon[31636]: pgmap v11462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:20:09.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:08 smithi077 ceph-mon[27902]: pgmap v11462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:20:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:08 smithi170 ceph-mon[31212]: pgmap v11462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:20:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21320.482146 secs 2024-04-21T16:20:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21320.482146 secs 2024-04-21T16:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21320.482146 secs 2024-04-21T16:20:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:10 smithi191 ceph-mon[31636]: pgmap v11463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:20:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:10 smithi170 ceph-mon[31212]: pgmap v11463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:20:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:10 smithi077 ceph-mon[27902]: pgmap v11463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:20:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:11 smithi170 ceph-mon[31212]: osdmap e789: 12 total, 12 up, 12 in 2024-04-21T16:20:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:20:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:11 smithi077 ceph-mon[27902]: osdmap e789: 12 total, 12 up, 12 in 2024-04-21T16:20:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:20:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:11 smithi191 ceph-mon[31636]: osdmap e789: 12 total, 12 up, 12 in 2024-04-21T16:20:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:20:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21323.719847 secs 2024-04-21T16:20:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:20:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:20:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:12 smithi170 ceph-mon[31212]: pgmap v11465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:20:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21323.719847 secs 2024-04-21T16:20:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:20:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:20:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:12 smithi077 ceph-mon[27902]: pgmap v11465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:20:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21323.719847 secs 2024-04-21T16:20:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:20:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:20:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:12 smithi191 ceph-mon[31636]: pgmap v11465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:20:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:20:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21325.482227 secs 2024-04-21T16:20:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:14 smithi191 ceph-mon[31636]: pgmap v11466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:20:14.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21325.482227 secs 2024-04-21T16:20:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:14 smithi170 ceph-mon[31212]: pgmap v11466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:20:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21325.482227 secs 2024-04-21T16:20:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:14 smithi077 ceph-mon[27902]: pgmap v11466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:20:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:16 smithi191 ceph-mon[31636]: pgmap v11467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:20:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:16 smithi170 ceph-mon[31212]: pgmap v11467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:20:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:16 smithi077 ceph-mon[27902]: pgmap v11467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:20:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21328.719978 secs 2024-04-21T16:20:18.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21328.719978 secs 2024-04-21T16:20:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21328.719978 secs 2024-04-21T16:20:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:18 smithi191 ceph-mon[31636]: pgmap v11468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:20:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:18 smithi170 ceph-mon[31212]: pgmap v11468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:20:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:18 smithi077 ceph-mon[27902]: pgmap v11468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:20:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21330.482302 secs 2024-04-21T16:20:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21330.482302 secs 2024-04-21T16:20:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21330.482302 secs 2024-04-21T16:20:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:20 smithi191 ceph-mon[31636]: pgmap v11469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:20:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:20 smithi170 ceph-mon[31212]: pgmap v11469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:20:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:20 smithi077 ceph-mon[27902]: pgmap v11469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:20:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:22 smithi191 ceph-mon[31636]: pgmap v11470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:20:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:22 smithi170 ceph-mon[31212]: pgmap v11470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:20:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:22 smithi077 ceph-mon[27902]: pgmap v11470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:20:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21333.720097 secs 2024-04-21T16:20:23.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21333.720097 secs 2024-04-21T16:20:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21333.720097 secs 2024-04-21T16:20:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21335.482418 secs 2024-04-21T16:20:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:24 smithi191 ceph-mon[31636]: pgmap v11471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21335.482418 secs 2024-04-21T16:20:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:24 smithi170 ceph-mon[31212]: pgmap v11471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21335.482418 secs 2024-04-21T16:20:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:24 smithi077 ceph-mon[27902]: pgmap v11471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:26 smithi191 ceph-mon[31636]: pgmap v11472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:26 smithi170 ceph-mon[31212]: pgmap v11472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:26 smithi077 ceph-mon[27902]: pgmap v11472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21338.720255 secs 2024-04-21T16:20:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21338.720255 secs 2024-04-21T16:20:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21338.720255 secs 2024-04-21T16:20:28.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:28 smithi170 ceph-mon[31212]: pgmap v11473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:28 smithi191 ceph-mon[31636]: pgmap v11473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:28 smithi077 ceph-mon[27902]: pgmap v11473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21340.482501 secs 2024-04-21T16:20:30.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21340.482501 secs 2024-04-21T16:20:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21340.482501 secs 2024-04-21T16:20:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:30 smithi191 ceph-mon[31636]: pgmap v11474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:30 smithi170 ceph-mon[31212]: pgmap v11474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:30 smithi077 ceph-mon[27902]: pgmap v11474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:32 smithi191 ceph-mon[31636]: pgmap v11475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:32 smithi170 ceph-mon[31212]: pgmap v11475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:32 smithi077 ceph-mon[27902]: pgmap v11475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21343.720376 secs 2024-04-21T16:20:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21343.720376 secs 2024-04-21T16:20:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21343.720376 secs 2024-04-21T16:20:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21345.482637 secs 2024-04-21T16:20:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:34 smithi191 ceph-mon[31636]: pgmap v11476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21345.482637 secs 2024-04-21T16:20:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:34 smithi170 ceph-mon[31212]: pgmap v11476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21345.482637 secs 2024-04-21T16:20:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:34 smithi077 ceph-mon[27902]: pgmap v11476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:36 smithi191 ceph-mon[31636]: pgmap v11477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:36 smithi170 ceph-mon[31212]: pgmap v11477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:36 smithi077 ceph-mon[27902]: pgmap v11477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21348.720505 secs 2024-04-21T16:20:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21348.720505 secs 2024-04-21T16:20:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21348.720505 secs 2024-04-21T16:20:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:38 smithi191 ceph-mon[31636]: pgmap v11478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:39.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:38 smithi077 ceph-mon[27902]: pgmap v11478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:38 smithi170 ceph-mon[31212]: pgmap v11478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21350.482710 secs 2024-04-21T16:20:40.058 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21350.482710 secs 2024-04-21T16:20:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21350.482710 secs 2024-04-21T16:20:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:40 smithi191 ceph-mon[31636]: pgmap v11479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:40 smithi170 ceph-mon[31212]: pgmap v11479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:40 smithi077 ceph-mon[27902]: pgmap v11479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:42 smithi191 ceph-mon[31636]: pgmap v11480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:42 smithi170 ceph-mon[31212]: pgmap v11480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:42 smithi077 ceph-mon[27902]: pgmap v11480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:43.675 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21353.720652 secs 2024-04-21T16:20:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21353.720652 secs 2024-04-21T16:20:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21353.720652 secs 2024-04-21T16:20:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21355.482829 secs 2024-04-21T16:20:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:44 smithi191 ceph-mon[31636]: pgmap v11481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21355.482829 secs 2024-04-21T16:20:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:44 smithi170 ceph-mon[31212]: pgmap v11481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21355.482829 secs 2024-04-21T16:20:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:44 smithi077 ceph-mon[27902]: pgmap v11481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:46 smithi191 ceph-mon[31636]: pgmap v11482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:46 smithi170 ceph-mon[31212]: pgmap v11482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:46 smithi077 ceph-mon[27902]: pgmap v11482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21358.720821 secs 2024-04-21T16:20:48.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21358.720821 secs 2024-04-21T16:20:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21358.720821 secs 2024-04-21T16:20:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:48 smithi191 ceph-mon[31636]: pgmap v11483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:48 smithi170 ceph-mon[31212]: pgmap v11483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:48 smithi077 ceph-mon[27902]: pgmap v11483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21360.482948 secs 2024-04-21T16:20:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21360.482948 secs 2024-04-21T16:20:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21360.482948 secs 2024-04-21T16:20:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:50 smithi191 ceph-mon[31636]: pgmap v11484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:50 smithi170 ceph-mon[31212]: pgmap v11484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:50 smithi077 ceph-mon[27902]: pgmap v11484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:52 smithi191 ceph-mon[31636]: pgmap v11485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:52 smithi170 ceph-mon[31212]: pgmap v11485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:52 smithi077 ceph-mon[27902]: pgmap v11485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21363.720930 secs 2024-04-21T16:20:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21363.720930 secs 2024-04-21T16:20:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21363.720930 secs 2024-04-21T16:20:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21365.483063 secs 2024-04-21T16:20:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:54 smithi191 ceph-mon[31636]: pgmap v11486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21365.483063 secs 2024-04-21T16:20:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:54 smithi170 ceph-mon[31212]: pgmap v11486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21365.483063 secs 2024-04-21T16:20:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:54 smithi077 ceph-mon[27902]: pgmap v11486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:20:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:56 smithi191 ceph-mon[31636]: pgmap v11487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:56 smithi170 ceph-mon[31212]: pgmap v11487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:56 smithi077 ceph-mon[27902]: pgmap v11487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:20:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21368.721064 secs 2024-04-21T16:20:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21368.721064 secs 2024-04-21T16:20:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21368.721064 secs 2024-04-21T16:20:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:58 smithi170 ceph-mon[31212]: pgmap v11488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:58 smithi191 ceph-mon[31636]: pgmap v11488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:58 smithi077 ceph-mon[27902]: pgmap v11488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:20:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21370.483184 secs 2024-04-21T16:21:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21370.483184 secs 2024-04-21T16:21:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21370.483184 secs 2024-04-21T16:21:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:00 smithi191 ceph-mon[31636]: pgmap v11489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:00 smithi170 ceph-mon[31212]: pgmap v11489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:00 smithi077 ceph-mon[27902]: pgmap v11489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:02 smithi191 ceph-mon[31636]: pgmap v11490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:02 smithi170 ceph-mon[31212]: pgmap v11490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:02 smithi077 ceph-mon[27902]: pgmap v11490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21373.721204 secs 2024-04-21T16:21:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21373.721204 secs 2024-04-21T16:21:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21373.721204 secs 2024-04-21T16:21:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21375.483260 secs 2024-04-21T16:21:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:04 smithi191 ceph-mon[31636]: pgmap v11491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21375.483260 secs 2024-04-21T16:21:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:04 smithi170 ceph-mon[31212]: pgmap v11491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21375.483260 secs 2024-04-21T16:21:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:04 smithi077 ceph-mon[27902]: pgmap v11491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:05 smithi191 ceph-mon[31636]: osdmap e790: 12 total, 12 up, 12 in 2024-04-21T16:21:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:05 smithi170 ceph-mon[31212]: osdmap e790: 12 total, 12 up, 12 in 2024-04-21T16:21:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:05 smithi077 ceph-mon[27902]: osdmap e790: 12 total, 12 up, 12 in 2024-04-21T16:21:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:06 smithi191 ceph-mon[31636]: pgmap v11493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:21:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:06 smithi170 ceph-mon[31212]: pgmap v11493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:21:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:06 smithi077 ceph-mon[27902]: pgmap v11493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:21:07.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21378.721335 secs 2024-04-21T16:21:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21378.721335 secs 2024-04-21T16:21:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21378.721335 secs 2024-04-21T16:21:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:08 smithi191 ceph-mon[31636]: pgmap v11494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:21:09.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:08 smithi077 ceph-mon[27902]: pgmap v11494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:21:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:08 smithi170 ceph-mon[31212]: pgmap v11494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:21:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21380.483374 secs 2024-04-21T16:21:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21380.483374 secs 2024-04-21T16:21:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21380.483374 secs 2024-04-21T16:21:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:10 smithi191 ceph-mon[31636]: pgmap v11495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:21:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:10 smithi170 ceph-mon[31212]: pgmap v11495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:21:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:10 smithi077 ceph-mon[27902]: pgmap v11495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:21:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:11 smithi170 ceph-mon[31212]: osdmap e791: 12 total, 12 up, 12 in 2024-04-21T16:21:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:11 smithi077 ceph-mon[27902]: osdmap e791: 12 total, 12 up, 12 in 2024-04-21T16:21:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:11 smithi191 ceph-mon[31636]: osdmap e791: 12 total, 12 up, 12 in 2024-04-21T16:21:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21383.721459 secs 2024-04-21T16:21:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:12 smithi170 ceph-mon[31212]: pgmap v11497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:21:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:21:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21383.721459 secs 2024-04-21T16:21:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:12 smithi077 ceph-mon[27902]: pgmap v11497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:21:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:21:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21383.721459 secs 2024-04-21T16:21:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:12 smithi191 ceph-mon[31636]: pgmap v11497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:21:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:21:14.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:21:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:21:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:21:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:21:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:21:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:21:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21385.483507 secs 2024-04-21T16:21:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:15 smithi170 ceph-mon[31212]: pgmap v11498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:21:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21385.483507 secs 2024-04-21T16:21:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:15 smithi077 ceph-mon[27902]: pgmap v11498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:21:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21385.483507 secs 2024-04-21T16:21:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:15 smithi191 ceph-mon[31636]: pgmap v11498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:21:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:16 smithi191 ceph-mon[31636]: pgmap v11499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:21:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:16 smithi170 ceph-mon[31212]: pgmap v11499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:21:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:16 smithi077 ceph-mon[27902]: pgmap v11499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:21:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21388.721595 secs 2024-04-21T16:21:18.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21388.721595 secs 2024-04-21T16:21:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21388.721595 secs 2024-04-21T16:21:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:18 smithi191 ceph-mon[31636]: pgmap v11500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:21:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:18 smithi170 ceph-mon[31212]: pgmap v11500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:21:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:18 smithi077 ceph-mon[27902]: pgmap v11500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:21:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21390.483628 secs 2024-04-21T16:21:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21390.483628 secs 2024-04-21T16:21:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21390.483628 secs 2024-04-21T16:21:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:20 smithi191 ceph-mon[31636]: pgmap v11501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:21:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:20 smithi170 ceph-mon[31212]: pgmap v11501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:21:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:20 smithi077 ceph-mon[27902]: pgmap v11501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:21:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:22 smithi191 ceph-mon[31636]: pgmap v11502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:21:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:22 smithi170 ceph-mon[31212]: pgmap v11502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:21:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:22 smithi077 ceph-mon[27902]: pgmap v11502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:21:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21393.721723 secs 2024-04-21T16:21:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21393.721723 secs 2024-04-21T16:21:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21393.721723 secs 2024-04-21T16:21:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21395.483748 secs 2024-04-21T16:21:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:24 smithi191 ceph-mon[31636]: pgmap v11503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21395.483748 secs 2024-04-21T16:21:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:24 smithi170 ceph-mon[31212]: pgmap v11503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21395.483748 secs 2024-04-21T16:21:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:24 smithi077 ceph-mon[27902]: pgmap v11503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:26 smithi191 ceph-mon[31636]: pgmap v11504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:26 smithi170 ceph-mon[31212]: pgmap v11504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:26 smithi077 ceph-mon[27902]: pgmap v11504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:27.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21398.721851 secs 2024-04-21T16:21:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21398.721851 secs 2024-04-21T16:21:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21398.721851 secs 2024-04-21T16:21:28.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:28 smithi170 ceph-mon[31212]: pgmap v11505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:28 smithi191 ceph-mon[31636]: pgmap v11505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:28 smithi077 ceph-mon[27902]: pgmap v11505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21400.483877 secs 2024-04-21T16:21:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21400.483877 secs 2024-04-21T16:21:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21400.483877 secs 2024-04-21T16:21:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:30 smithi191 ceph-mon[31636]: pgmap v11506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:30 smithi170 ceph-mon[31212]: pgmap v11506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:30 smithi077 ceph-mon[27902]: pgmap v11506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:32 smithi191 ceph-mon[31636]: pgmap v11507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:32 smithi170 ceph-mon[31212]: pgmap v11507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:32 smithi077 ceph-mon[27902]: pgmap v11507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21403.721953 secs 2024-04-21T16:21:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21403.721953 secs 2024-04-21T16:21:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21403.721953 secs 2024-04-21T16:21:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21405.483936 secs 2024-04-21T16:21:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:34 smithi191 ceph-mon[31636]: pgmap v11508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21405.483936 secs 2024-04-21T16:21:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:34 smithi170 ceph-mon[31212]: pgmap v11508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21405.483936 secs 2024-04-21T16:21:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:34 smithi077 ceph-mon[27902]: pgmap v11508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:36 smithi191 ceph-mon[31636]: pgmap v11509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:36 smithi170 ceph-mon[31212]: pgmap v11509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:36 smithi077 ceph-mon[27902]: pgmap v11509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21408.722048 secs 2024-04-21T16:21:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21408.722048 secs 2024-04-21T16:21:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21408.722048 secs 2024-04-21T16:21:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:38 smithi191 ceph-mon[31636]: pgmap v11510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:39.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:38 smithi077 ceph-mon[27902]: pgmap v11510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:38 smithi170 ceph-mon[31212]: pgmap v11510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21410.484015 secs 2024-04-21T16:21:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21410.484015 secs 2024-04-21T16:21:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21410.484015 secs 2024-04-21T16:21:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:40 smithi191 ceph-mon[31636]: pgmap v11511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:40 smithi170 ceph-mon[31212]: pgmap v11511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:40 smithi077 ceph-mon[27902]: pgmap v11511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:42 smithi191 ceph-mon[31636]: pgmap v11512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:42 smithi170 ceph-mon[31212]: pgmap v11512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:42 smithi077 ceph-mon[27902]: pgmap v11512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21413.722110 secs 2024-04-21T16:21:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21413.722110 secs 2024-04-21T16:21:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21413.722110 secs 2024-04-21T16:21:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21415.484080 secs 2024-04-21T16:21:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:44 smithi191 ceph-mon[31636]: pgmap v11513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21415.484080 secs 2024-04-21T16:21:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:44 smithi170 ceph-mon[31212]: pgmap v11513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21415.484080 secs 2024-04-21T16:21:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:44 smithi077 ceph-mon[27902]: pgmap v11513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:46 smithi191 ceph-mon[31636]: pgmap v11514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:46 smithi170 ceph-mon[31212]: pgmap v11514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:46 smithi077 ceph-mon[27902]: pgmap v11514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:47.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21418.722250 secs 2024-04-21T16:21:48.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21418.722250 secs 2024-04-21T16:21:48.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21418.722250 secs 2024-04-21T16:21:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:48 smithi191 ceph-mon[31636]: pgmap v11515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:48 smithi170 ceph-mon[31212]: pgmap v11515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:48 smithi077 ceph-mon[27902]: pgmap v11515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:21:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21420.484224 secs 2024-04-21T16:21:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21420.484224 secs 2024-04-21T16:21:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21420.484224 secs 2024-04-21T16:21:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:50 smithi191 ceph-mon[31636]: pgmap v11516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:50 smithi170 ceph-mon[31212]: pgmap v11516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:50 smithi077 ceph-mon[27902]: pgmap v11516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:52 smithi191 ceph-mon[31636]: pgmap v11517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:52 smithi170 ceph-mon[31212]: pgmap v11517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:52 smithi077 ceph-mon[27902]: pgmap v11517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21423.722379 secs 2024-04-21T16:21:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21423.722379 secs 2024-04-21T16:21:53.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21423.722379 secs 2024-04-21T16:21:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21425.484338 secs 2024-04-21T16:21:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:54 smithi191 ceph-mon[31636]: pgmap v11518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21425.484338 secs 2024-04-21T16:21:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:54 smithi170 ceph-mon[31212]: pgmap v11518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21425.484338 secs 2024-04-21T16:21:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:54 smithi077 ceph-mon[27902]: pgmap v11518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:21:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:56 smithi191 ceph-mon[31636]: pgmap v11519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:56 smithi170 ceph-mon[31212]: pgmap v11519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:56 smithi077 ceph-mon[27902]: pgmap v11519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:21:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21428.722537 secs 2024-04-21T16:21:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21428.722537 secs 2024-04-21T16:21:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21428.722537 secs 2024-04-21T16:21:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:58 smithi170 ceph-mon[31212]: pgmap v11520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:58 smithi191 ceph-mon[31636]: pgmap v11520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:58 smithi077 ceph-mon[27902]: pgmap v11520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:21:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21430.484457 secs 2024-04-21T16:22:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21430.484457 secs 2024-04-21T16:22:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21430.484457 secs 2024-04-21T16:22:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:00 smithi191 ceph-mon[31636]: pgmap v11521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:00 smithi170 ceph-mon[31212]: pgmap v11521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:00 smithi077 ceph-mon[27902]: pgmap v11521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:02 smithi191 ceph-mon[31636]: pgmap v11522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:02 smithi170 ceph-mon[31212]: pgmap v11522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:02 smithi077 ceph-mon[27902]: pgmap v11522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21433.722675 secs 2024-04-21T16:22:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21433.722675 secs 2024-04-21T16:22:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21433.722675 secs 2024-04-21T16:22:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21435.484573 secs 2024-04-21T16:22:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:04 smithi191 ceph-mon[31636]: pgmap v11523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21435.484573 secs 2024-04-21T16:22:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:04 smithi170 ceph-mon[31212]: pgmap v11523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21435.484573 secs 2024-04-21T16:22:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:04 smithi077 ceph-mon[27902]: pgmap v11523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:05 smithi191 ceph-mon[31636]: osdmap e792: 12 total, 12 up, 12 in 2024-04-21T16:22:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:05 smithi170 ceph-mon[31212]: osdmap e792: 12 total, 12 up, 12 in 2024-04-21T16:22:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:05 smithi077 ceph-mon[27902]: osdmap e792: 12 total, 12 up, 12 in 2024-04-21T16:22:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:06 smithi191 ceph-mon[31636]: pgmap v11525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:22:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:06 smithi170 ceph-mon[31212]: pgmap v11525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:22:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:06 smithi077 ceph-mon[27902]: pgmap v11525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:22:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21438.722739 secs 2024-04-21T16:22:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21438.722739 secs 2024-04-21T16:22:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21438.722739 secs 2024-04-21T16:22:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:08 smithi191 ceph-mon[31636]: pgmap v11526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:22:09.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:08 smithi077 ceph-mon[27902]: pgmap v11526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:22:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:08 smithi170 ceph-mon[31212]: pgmap v11526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:22:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21440.484708 secs 2024-04-21T16:22:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21440.484708 secs 2024-04-21T16:22:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21440.484708 secs 2024-04-21T16:22:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:10 smithi191 ceph-mon[31636]: pgmap v11527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:22:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:10 smithi170 ceph-mon[31212]: pgmap v11527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:22:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:10 smithi077 ceph-mon[27902]: pgmap v11527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:22:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:12 smithi170 ceph-mon[31212]: osdmap e793: 12 total, 12 up, 12 in 2024-04-21T16:22:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:12 smithi077 ceph-mon[27902]: osdmap e793: 12 total, 12 up, 12 in 2024-04-21T16:22:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:12 smithi191 ceph-mon[31636]: osdmap e793: 12 total, 12 up, 12 in 2024-04-21T16:22:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21443.722862 secs 2024-04-21T16:22:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:13 smithi170 ceph-mon[31212]: pgmap v11529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:22:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21443.722862 secs 2024-04-21T16:22:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:13 smithi077 ceph-mon[27902]: pgmap v11529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:22:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21443.722862 secs 2024-04-21T16:22:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:13 smithi191 ceph-mon[31636]: pgmap v11529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:22:14.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:22:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:22:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:22:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21445.484826 secs 2024-04-21T16:22:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:15 smithi170 ceph-mon[31212]: pgmap v11530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:22:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:22:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:22:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:22:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21445.484826 secs 2024-04-21T16:22:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:15 smithi077 ceph-mon[27902]: pgmap v11530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:22:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:22:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:22:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:22:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21445.484826 secs 2024-04-21T16:22:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:15 smithi191 ceph-mon[31636]: pgmap v11530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:22:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:22:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:22:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:22:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:16 smithi191 ceph-mon[31636]: pgmap v11531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:22:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:16 smithi170 ceph-mon[31212]: pgmap v11531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:22:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:16 smithi077 ceph-mon[27902]: pgmap v11531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:22:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21448.722981 secs 2024-04-21T16:22:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21448.722981 secs 2024-04-21T16:22:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21448.722981 secs 2024-04-21T16:22:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:18 smithi191 ceph-mon[31636]: pgmap v11532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:22:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:18 smithi170 ceph-mon[31212]: pgmap v11532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:22:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:18 smithi077 ceph-mon[27902]: pgmap v11532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:22:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21450.484884 secs 2024-04-21T16:22:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21450.484884 secs 2024-04-21T16:22:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21450.484884 secs 2024-04-21T16:22:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:20 smithi191 ceph-mon[31636]: pgmap v11533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:22:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:20 smithi170 ceph-mon[31212]: pgmap v11533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:22:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:20 smithi077 ceph-mon[27902]: pgmap v11533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:22:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:22 smithi191 ceph-mon[31636]: pgmap v11534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:22:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:22 smithi170 ceph-mon[31212]: pgmap v11534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:22:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:22 smithi077 ceph-mon[27902]: pgmap v11534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:22:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21453.723126 secs 2024-04-21T16:22:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21453.723126 secs 2024-04-21T16:22:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21453.723126 secs 2024-04-21T16:22:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21455.484998 secs 2024-04-21T16:22:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:24 smithi191 ceph-mon[31636]: pgmap v11535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21455.484998 secs 2024-04-21T16:22:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:24 smithi170 ceph-mon[31212]: pgmap v11535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21455.484998 secs 2024-04-21T16:22:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:24 smithi077 ceph-mon[27902]: pgmap v11535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:26 smithi191 ceph-mon[31636]: pgmap v11536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:26 smithi170 ceph-mon[31212]: pgmap v11536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:26 smithi077 ceph-mon[27902]: pgmap v11536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21458.723225 secs 2024-04-21T16:22:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21458.723225 secs 2024-04-21T16:22:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21458.723225 secs 2024-04-21T16:22:28.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:28 smithi170 ceph-mon[31212]: pgmap v11537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:28 smithi191 ceph-mon[31636]: pgmap v11537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:28 smithi077 ceph-mon[27902]: pgmap v11537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21460.485120 secs 2024-04-21T16:22:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21460.485120 secs 2024-04-21T16:22:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21460.485120 secs 2024-04-21T16:22:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:30 smithi191 ceph-mon[31636]: pgmap v11538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:30 smithi170 ceph-mon[31212]: pgmap v11538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:30 smithi077 ceph-mon[27902]: pgmap v11538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:32 smithi191 ceph-mon[31636]: pgmap v11539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:32 smithi170 ceph-mon[31212]: pgmap v11539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:32 smithi077 ceph-mon[27902]: pgmap v11539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21463.723310 secs 2024-04-21T16:22:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21463.723310 secs 2024-04-21T16:22:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21463.723310 secs 2024-04-21T16:22:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21465.485217 secs 2024-04-21T16:22:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:34 smithi191 ceph-mon[31636]: pgmap v11540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21465.485217 secs 2024-04-21T16:22:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:34 smithi170 ceph-mon[31212]: pgmap v11540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21465.485217 secs 2024-04-21T16:22:34.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:34 smithi077 ceph-mon[27902]: pgmap v11540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:36 smithi191 ceph-mon[31636]: pgmap v11541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:36 smithi170 ceph-mon[31212]: pgmap v11541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:36 smithi077 ceph-mon[27902]: pgmap v11541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21468.723431 secs 2024-04-21T16:22:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21468.723431 secs 2024-04-21T16:22:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21468.723431 secs 2024-04-21T16:22:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:38 smithi191 ceph-mon[31636]: pgmap v11542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:39.039 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:38 smithi077 ceph-mon[27902]: pgmap v11542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:38 smithi170 ceph-mon[31212]: pgmap v11542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21470.485332 secs 2024-04-21T16:22:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21470.485332 secs 2024-04-21T16:22:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21470.485332 secs 2024-04-21T16:22:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:40 smithi191 ceph-mon[31636]: pgmap v11543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:40 smithi170 ceph-mon[31212]: pgmap v11543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:40 smithi077 ceph-mon[27902]: pgmap v11543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:42 smithi191 ceph-mon[31636]: pgmap v11544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:42 smithi170 ceph-mon[31212]: pgmap v11544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:42 smithi077 ceph-mon[27902]: pgmap v11544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21473.723559 secs 2024-04-21T16:22:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21473.723559 secs 2024-04-21T16:22:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21473.723559 secs 2024-04-21T16:22:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21475.485454 secs 2024-04-21T16:22:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:44 smithi191 ceph-mon[31636]: pgmap v11545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21475.485454 secs 2024-04-21T16:22:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:44 smithi170 ceph-mon[31212]: pgmap v11545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21475.485454 secs 2024-04-21T16:22:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:44 smithi077 ceph-mon[27902]: pgmap v11545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:46 smithi191 ceph-mon[31636]: pgmap v11546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:46 smithi170 ceph-mon[31212]: pgmap v11546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:46 smithi077 ceph-mon[27902]: pgmap v11546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21478.723693 secs 2024-04-21T16:22:48.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21478.723693 secs 2024-04-21T16:22:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21478.723693 secs 2024-04-21T16:22:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:48 smithi191 ceph-mon[31636]: pgmap v11547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:48 smithi170 ceph-mon[31212]: pgmap v11547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:48 smithi077 ceph-mon[27902]: pgmap v11547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21480.485591 secs 2024-04-21T16:22:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21480.485591 secs 2024-04-21T16:22:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21480.485591 secs 2024-04-21T16:22:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:50 smithi191 ceph-mon[31636]: pgmap v11548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:50 smithi170 ceph-mon[31212]: pgmap v11548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:50 smithi077 ceph-mon[27902]: pgmap v11548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:52 smithi191 ceph-mon[31636]: pgmap v11549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:52 smithi170 ceph-mon[31212]: pgmap v11549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:52 smithi077 ceph-mon[27902]: pgmap v11549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21483.723816 secs 2024-04-21T16:22:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21483.723816 secs 2024-04-21T16:22:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21483.723816 secs 2024-04-21T16:22:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21485.485683 secs 2024-04-21T16:22:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:54 smithi191 ceph-mon[31636]: pgmap v11550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21485.485683 secs 2024-04-21T16:22:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:54 smithi170 ceph-mon[31212]: pgmap v11550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21485.485683 secs 2024-04-21T16:22:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:54 smithi077 ceph-mon[27902]: pgmap v11550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:22:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:56 smithi191 ceph-mon[31636]: pgmap v11551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:56 smithi170 ceph-mon[31212]: pgmap v11551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:56 smithi077 ceph-mon[27902]: pgmap v11551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:22:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:22:57.321+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:22:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:22:57.321+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:22:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:22:57.322+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:22:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:22:57.322+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:22:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21488.723940 secs 2024-04-21T16:22:58.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21488.723940 secs 2024-04-21T16:22:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21488.723940 secs 2024-04-21T16:22:58.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:58 smithi170 ceph-mon[31212]: pgmap v11552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:58 smithi191 ceph-mon[31636]: pgmap v11552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:58 smithi077 ceph-mon[27902]: pgmap v11552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:22:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21490.485800 secs 2024-04-21T16:23:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21490.485800 secs 2024-04-21T16:23:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21490.485800 secs 2024-04-21T16:23:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:00 smithi191 ceph-mon[31636]: pgmap v11553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:00 smithi170 ceph-mon[31212]: pgmap v11553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:00 smithi077 ceph-mon[27902]: pgmap v11553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:02 smithi191 ceph-mon[31636]: pgmap v11554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:02 smithi170 ceph-mon[31212]: pgmap v11554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:02 smithi077 ceph-mon[27902]: pgmap v11554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21493.724038 secs 2024-04-21T16:23:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21493.724038 secs 2024-04-21T16:23:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21493.724038 secs 2024-04-21T16:23:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21495.485919 secs 2024-04-21T16:23:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:04 smithi191 ceph-mon[31636]: pgmap v11555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21495.485919 secs 2024-04-21T16:23:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:04 smithi170 ceph-mon[31212]: pgmap v11555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21495.485919 secs 2024-04-21T16:23:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:04 smithi077 ceph-mon[27902]: pgmap v11555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:05 smithi191 ceph-mon[31636]: osdmap e794: 12 total, 12 up, 12 in 2024-04-21T16:23:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:05 smithi170 ceph-mon[31212]: osdmap e794: 12 total, 12 up, 12 in 2024-04-21T16:23:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:05 smithi077 ceph-mon[27902]: osdmap e794: 12 total, 12 up, 12 in 2024-04-21T16:23:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:06 smithi191 ceph-mon[31636]: pgmap v11557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:06 smithi170 ceph-mon[31212]: pgmap v11557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:06 smithi077 ceph-mon[27902]: pgmap v11557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21498.724162 secs 2024-04-21T16:23:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21498.724162 secs 2024-04-21T16:23:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21498.724162 secs 2024-04-21T16:23:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:08 smithi191 ceph-mon[31636]: pgmap v11558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:09.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:08 smithi077 ceph-mon[27902]: pgmap v11558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:08 smithi170 ceph-mon[31212]: pgmap v11558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21500.486037 secs 2024-04-21T16:23:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21500.486037 secs 2024-04-21T16:23:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21500.486037 secs 2024-04-21T16:23:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:10 smithi191 ceph-mon[31636]: pgmap v11559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:10 smithi170 ceph-mon[31212]: pgmap v11559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:10 smithi077 ceph-mon[27902]: pgmap v11559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:23:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:12 smithi170 ceph-mon[31212]: osdmap e795: 12 total, 12 up, 12 in 2024-04-21T16:23:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:12 smithi077 ceph-mon[27902]: osdmap e795: 12 total, 12 up, 12 in 2024-04-21T16:23:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:12 smithi191 ceph-mon[31636]: osdmap e795: 12 total, 12 up, 12 in 2024-04-21T16:23:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21503.724283 secs 2024-04-21T16:23:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:13 smithi170 ceph-mon[31212]: pgmap v11561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:23:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21503.724283 secs 2024-04-21T16:23:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:13 smithi077 ceph-mon[27902]: pgmap v11561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:23:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21503.724283 secs 2024-04-21T16:23:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:13 smithi191 ceph-mon[31636]: pgmap v11561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T16:23:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21505.486153 secs 2024-04-21T16:23:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:14 smithi191 ceph-mon[31636]: pgmap v11562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:23:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21505.486153 secs 2024-04-21T16:23:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:14 smithi170 ceph-mon[31212]: pgmap v11562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:23:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21505.486153 secs 2024-04-21T16:23:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:14 smithi077 ceph-mon[27902]: pgmap v11562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:23:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:23:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:23:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:23:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:23:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:23:15.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:23:15.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:23:15.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:23:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:23:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:23:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:23:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:23:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:16 smithi191 ceph-mon[31636]: pgmap v11563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:23:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:16 smithi170 ceph-mon[31212]: pgmap v11563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:23:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:16 smithi077 ceph-mon[27902]: pgmap v11563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:23:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21508.724422 secs 2024-04-21T16:23:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21508.724422 secs 2024-04-21T16:23:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21508.724422 secs 2024-04-21T16:23:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:18 smithi191 ceph-mon[31636]: pgmap v11564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:23:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:18 smithi170 ceph-mon[31212]: pgmap v11564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:23:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:18 smithi077 ceph-mon[27902]: pgmap v11564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:23:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21510.486304 secs 2024-04-21T16:23:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21510.486304 secs 2024-04-21T16:23:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21510.486304 secs 2024-04-21T16:23:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:20 smithi191 ceph-mon[31636]: pgmap v11565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:23:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:20 smithi170 ceph-mon[31212]: pgmap v11565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:23:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:20 smithi077 ceph-mon[27902]: pgmap v11565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:23:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21513.724544 secs 2024-04-21T16:23:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:23 smithi191 ceph-mon[31636]: pgmap v11566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:23:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21513.724544 secs 2024-04-21T16:23:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:23 smithi170 ceph-mon[31212]: pgmap v11566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:23:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21513.724544 secs 2024-04-21T16:23:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:23 smithi077 ceph-mon[27902]: pgmap v11566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:23:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21515.486384 secs 2024-04-21T16:23:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21515.486384 secs 2024-04-21T16:23:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21515.486384 secs 2024-04-21T16:23:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:25 smithi191 ceph-mon[31636]: pgmap v11567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:25 smithi170 ceph-mon[31212]: pgmap v11567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:25 smithi077 ceph-mon[27902]: pgmap v11567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:27.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:27 smithi191 ceph-mon[31636]: pgmap v11568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:27.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:27 smithi170 ceph-mon[31212]: pgmap v11568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:27.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:27 smithi077 ceph-mon[27902]: pgmap v11568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21518.724680 secs 2024-04-21T16:23:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21518.724680 secs 2024-04-21T16:23:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21518.724680 secs 2024-04-21T16:23:29.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:29 smithi191 ceph-mon[31636]: pgmap v11569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:29.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21520.486457 secs 2024-04-21T16:23:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:29 smithi170 ceph-mon[31212]: pgmap v11569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21520.486457 secs 2024-04-21T16:23:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:29 smithi077 ceph-mon[27902]: pgmap v11569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21520.486457 secs 2024-04-21T16:23:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:31.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:31 smithi170 ceph-mon[31212]: pgmap v11570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:31 smithi077 ceph-mon[27902]: pgmap v11570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:31 smithi191 ceph-mon[31636]: pgmap v11570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21523.724818 secs 2024-04-21T16:23:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:33 smithi170 ceph-mon[31212]: pgmap v11571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21523.724818 secs 2024-04-21T16:23:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:33 smithi077 ceph-mon[27902]: pgmap v11571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21523.724818 secs 2024-04-21T16:23:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:33 smithi191 ceph-mon[31636]: pgmap v11571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21525.486542 secs 2024-04-21T16:23:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21525.486542 secs 2024-04-21T16:23:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21525.486542 secs 2024-04-21T16:23:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:35.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:35 smithi170 ceph-mon[31212]: pgmap v11572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:35 smithi077 ceph-mon[27902]: pgmap v11572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:35.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:35 smithi191 ceph-mon[31636]: pgmap v11572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:37.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:37 smithi170 ceph-mon[31212]: pgmap v11573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:37.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:37 smithi077 ceph-mon[27902]: pgmap v11573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:37 smithi191 ceph-mon[31636]: pgmap v11573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21528.724938 secs 2024-04-21T16:23:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21528.724938 secs 2024-04-21T16:23:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21528.724938 secs 2024-04-21T16:23:39.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:39 smithi077 ceph-mon[27902]: pgmap v11574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:39.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21530.486662 secs 2024-04-21T16:23:39.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:39 smithi170 ceph-mon[31212]: pgmap v11574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:39.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21530.486662 secs 2024-04-21T16:23:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:39 smithi191 ceph-mon[31636]: pgmap v11574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:39.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21530.486662 secs 2024-04-21T16:23:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:41.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:41 smithi170 ceph-mon[31212]: pgmap v11575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:41.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:41 smithi077 ceph-mon[27902]: pgmap v11575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:41.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:41 smithi191 ceph-mon[31636]: pgmap v11575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:23:42.328+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:23:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:23:42.328+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:23:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:23:42.328+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:23:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:23:42.328+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:23:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21533.725023 secs 2024-04-21T16:23:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:43 smithi170 ceph-mon[31212]: pgmap v11576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21533.725023 secs 2024-04-21T16:23:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:43 smithi077 ceph-mon[27902]: pgmap v11576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21533.725023 secs 2024-04-21T16:23:43.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:43 smithi191 ceph-mon[31636]: pgmap v11576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21535.486796 secs 2024-04-21T16:23:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21535.486796 secs 2024-04-21T16:23:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21535.486796 secs 2024-04-21T16:23:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:45 smithi170 ceph-mon[31212]: pgmap v11577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:45 smithi077 ceph-mon[27902]: pgmap v11577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:45.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:45 smithi191 ceph-mon[31636]: pgmap v11577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:47.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:47 smithi170 ceph-mon[31212]: pgmap v11578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:47.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:47 smithi077 ceph-mon[27902]: pgmap v11578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:47 smithi191 ceph-mon[31636]: pgmap v11578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21538.725134 secs 2024-04-21T16:23:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21538.725134 secs 2024-04-21T16:23:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21538.725134 secs 2024-04-21T16:23:49.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:49 smithi170 ceph-mon[31212]: pgmap v11579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:49.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21540.486927 secs 2024-04-21T16:23:49.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:49 smithi077 ceph-mon[27902]: pgmap v11579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:49.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21540.486927 secs 2024-04-21T16:23:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:49 smithi191 ceph-mon[31636]: pgmap v11579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21540.486927 secs 2024-04-21T16:23:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:51 smithi170 ceph-mon[31212]: pgmap v11580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:51 smithi077 ceph-mon[27902]: pgmap v11580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:51 smithi191 ceph-mon[31636]: pgmap v11580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21543.725287 secs 2024-04-21T16:23:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:53 smithi170 ceph-mon[31212]: pgmap v11581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21543.725287 secs 2024-04-21T16:23:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:53 smithi077 ceph-mon[27902]: pgmap v11581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21543.725287 secs 2024-04-21T16:23:53.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:53 smithi191 ceph-mon[31636]: pgmap v11581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21545.487012 secs 2024-04-21T16:23:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21545.487012 secs 2024-04-21T16:23:54.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21545.487012 secs 2024-04-21T16:23:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:23:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:55 smithi170 ceph-mon[31212]: pgmap v11582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:55 smithi077 ceph-mon[27902]: pgmap v11582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:55 smithi191 ceph-mon[31636]: pgmap v11582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:57.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:57 smithi170 ceph-mon[31212]: pgmap v11583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:57.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:57 smithi077 ceph-mon[27902]: pgmap v11583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:57 smithi191 ceph-mon[31636]: pgmap v11583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:23:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21548.725398 secs 2024-04-21T16:23:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21548.725398 secs 2024-04-21T16:23:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21548.725398 secs 2024-04-21T16:23:59.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:59 smithi170 ceph-mon[31212]: pgmap v11584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:59.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21550.487134 secs 2024-04-21T16:23:59.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:59 smithi077 ceph-mon[27902]: pgmap v11584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:59.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21550.487134 secs 2024-04-21T16:23:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:59 smithi191 ceph-mon[31636]: pgmap v11584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:23:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21550.487134 secs 2024-04-21T16:24:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:01.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:01 smithi170 ceph-mon[31212]: pgmap v11585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:01.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:01 smithi077 ceph-mon[27902]: pgmap v11585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:01 smithi191 ceph-mon[31636]: pgmap v11585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21553.725511 secs 2024-04-21T16:24:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:03 smithi170 ceph-mon[31212]: pgmap v11586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21553.725511 secs 2024-04-21T16:24:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:03 smithi077 ceph-mon[27902]: pgmap v11586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21553.725511 secs 2024-04-21T16:24:03.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:03 smithi191 ceph-mon[31636]: pgmap v11586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21555.487242 secs 2024-04-21T16:24:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21555.487242 secs 2024-04-21T16:24:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21555.487242 secs 2024-04-21T16:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:05 smithi077 ceph-mon[27902]: pgmap v11587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:05 smithi077 ceph-mon[27902]: osdmap e796: 12 total, 12 up, 12 in 2024-04-21T16:24:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:05 smithi191 ceph-mon[31636]: pgmap v11587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:05 smithi191 ceph-mon[31636]: osdmap e796: 12 total, 12 up, 12 in 2024-04-21T16:24:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:05 smithi170 ceph-mon[31212]: pgmap v11587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:05 smithi170 ceph-mon[31212]: osdmap e796: 12 total, 12 up, 12 in 2024-04-21T16:24:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:07 smithi077 ceph-mon[27902]: pgmap v11589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:24:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:07 smithi191 ceph-mon[31636]: pgmap v11589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:24:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:07 smithi170 ceph-mon[31212]: pgmap v11589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:24:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21558.725635 secs 2024-04-21T16:24:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21558.725635 secs 2024-04-21T16:24:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21558.725635 secs 2024-04-21T16:24:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:09 smithi077 ceph-mon[27902]: pgmap v11590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:24:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21560.487357 secs 2024-04-21T16:24:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:09 smithi191 ceph-mon[31636]: pgmap v11590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:24:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21560.487357 secs 2024-04-21T16:24:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:09 smithi170 ceph-mon[31212]: pgmap v11590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:24:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21560.487357 secs 2024-04-21T16:24:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:12.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:12 smithi170 ceph-mon[31212]: pgmap v11591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:24:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:12 smithi170 ceph-mon[31212]: osdmap e797: 12 total, 12 up, 12 in 2024-04-21T16:24:12.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:12 smithi077 ceph-mon[27902]: pgmap v11591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:24:12.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:12 smithi077 ceph-mon[27902]: osdmap e797: 12 total, 12 up, 12 in 2024-04-21T16:24:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:12 smithi191 ceph-mon[31636]: pgmap v11591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:24:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:12 smithi191 ceph-mon[31636]: osdmap e797: 12 total, 12 up, 12 in 2024-04-21T16:24:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21563.725794 secs 2024-04-21T16:24:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21563.725794 secs 2024-04-21T16:24:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21563.725794 secs 2024-04-21T16:24:14.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:14 smithi170 ceph-mon[31212]: pgmap v11593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:24:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:14 smithi077 ceph-mon[27902]: pgmap v11593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:24:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:14 smithi191 ceph-mon[31636]: pgmap v11593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:24:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21565.487467 secs 2024-04-21T16:24:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21565.487467 secs 2024-04-21T16:24:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21565.487467 secs 2024-04-21T16:24:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:16 smithi170 ceph-mon[31212]: pgmap v11594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:24:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:24:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:24:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:24:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:24:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:16 smithi077 ceph-mon[27902]: pgmap v11594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:24:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:24:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:24:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:24:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:24:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:16 smithi191 ceph-mon[31636]: pgmap v11594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:24:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:24:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:24:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:24:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:24:18.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:18 smithi170 ceph-mon[31212]: pgmap v11595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:24:18.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21568.725924 secs 2024-04-21T16:24:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:18 smithi077 ceph-mon[27902]: pgmap v11595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:24:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21568.725924 secs 2024-04-21T16:24:18.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:18 smithi191 ceph-mon[31636]: pgmap v11595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:24:18.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21568.725924 secs 2024-04-21T16:24:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:20.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:20 smithi170 ceph-mon[31212]: pgmap v11596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:24:20.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21570.487581 secs 2024-04-21T16:24:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:20 smithi077 ceph-mon[27902]: pgmap v11596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:24:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21570.487581 secs 2024-04-21T16:24:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:20 smithi191 ceph-mon[31636]: pgmap v11596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:24:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21570.487581 secs 2024-04-21T16:24:22.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:22 smithi170 ceph-mon[31212]: pgmap v11597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:24:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:22 smithi077 ceph-mon[27902]: pgmap v11597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:24:22.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:22 smithi191 ceph-mon[31636]: pgmap v11597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:24:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21573.725987 secs 2024-04-21T16:24:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21573.725987 secs 2024-04-21T16:24:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21573.725987 secs 2024-04-21T16:24:24.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:24 smithi077 ceph-mon[27902]: pgmap v11598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:24:24.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:24 smithi191 ceph-mon[31636]: pgmap v11598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:24:24.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:24 smithi170 ceph-mon[31212]: pgmap v11598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:24:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21575.487661 secs 2024-04-21T16:24:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21575.487661 secs 2024-04-21T16:24:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21575.487661 secs 2024-04-21T16:24:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:26 smithi077 ceph-mon[27902]: pgmap v11599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:26 smithi191 ceph-mon[31636]: pgmap v11599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:26 smithi170 ceph-mon[31212]: pgmap v11599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:28.361 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:28 smithi170 ceph-mon[31212]: pgmap v11600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:28.361 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21578.726108 secs 2024-04-21T16:24:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:28 smithi077 ceph-mon[27902]: pgmap v11600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21578.726108 secs 2024-04-21T16:24:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:28 smithi191 ceph-mon[31636]: pgmap v11600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21578.726108 secs 2024-04-21T16:24:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:30.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:30 smithi077 ceph-mon[27902]: pgmap v11601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:30.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21580.487776 secs 2024-04-21T16:24:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:30 smithi191 ceph-mon[31636]: pgmap v11601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21580.487776 secs 2024-04-21T16:24:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:30 smithi170 ceph-mon[31212]: pgmap v11601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21580.487776 secs 2024-04-21T16:24:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:32 smithi077 ceph-mon[27902]: pgmap v11602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:32.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:32 smithi191 ceph-mon[31636]: pgmap v11602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:32 smithi170 ceph-mon[31212]: pgmap v11602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21583.726253 secs 2024-04-21T16:24:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21583.726253 secs 2024-04-21T16:24:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21583.726253 secs 2024-04-21T16:24:34.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:34 smithi077 ceph-mon[27902]: pgmap v11603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:34 smithi191 ceph-mon[31636]: pgmap v11603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:34 smithi170 ceph-mon[31212]: pgmap v11603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21585.487920 secs 2024-04-21T16:24:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21585.487920 secs 2024-04-21T16:24:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21585.487920 secs 2024-04-21T16:24:36.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:36 smithi077 ceph-mon[27902]: pgmap v11604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:36 smithi191 ceph-mon[31636]: pgmap v11604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:36.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:36 smithi170 ceph-mon[31212]: pgmap v11604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:38.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:38 smithi077 ceph-mon[27902]: pgmap v11605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:38.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21588.726386 secs 2024-04-21T16:24:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:38 smithi191 ceph-mon[31636]: pgmap v11605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21588.726386 secs 2024-04-21T16:24:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:38 smithi170 ceph-mon[31212]: pgmap v11605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21588.726386 secs 2024-04-21T16:24:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:40 smithi077 ceph-mon[27902]: pgmap v11606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21590.487992 secs 2024-04-21T16:24:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:40 smithi191 ceph-mon[31636]: pgmap v11606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21590.487992 secs 2024-04-21T16:24:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:40 smithi170 ceph-mon[31212]: pgmap v11606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21590.487992 secs 2024-04-21T16:24:42.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:42 smithi077 ceph-mon[27902]: pgmap v11607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:42 smithi191 ceph-mon[31636]: pgmap v11607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:42 smithi170 ceph-mon[31212]: pgmap v11607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21593.726520 secs 2024-04-21T16:24:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21593.726520 secs 2024-04-21T16:24:43.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21593.726520 secs 2024-04-21T16:24:44.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:44 smithi077 ceph-mon[27902]: pgmap v11608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:44 smithi191 ceph-mon[31636]: pgmap v11608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:44 smithi170 ceph-mon[31212]: pgmap v11608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21595.488116 secs 2024-04-21T16:24:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21595.488116 secs 2024-04-21T16:24:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21595.488116 secs 2024-04-21T16:24:46.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:46 smithi077 ceph-mon[27902]: pgmap v11609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:46 smithi191 ceph-mon[31636]: pgmap v11609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:46 smithi170 ceph-mon[31212]: pgmap v11609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:24:48.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:48 smithi077 ceph-mon[27902]: pgmap v11610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:48.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21598.726618 secs 2024-04-21T16:24:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:48 smithi191 ceph-mon[31636]: pgmap v11610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21598.726618 secs 2024-04-21T16:24:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:48 smithi170 ceph-mon[31212]: pgmap v11610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21598.726618 secs 2024-04-21T16:24:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:50.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:50 smithi077 ceph-mon[27902]: pgmap v11611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:50.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21600.488200 secs 2024-04-21T16:24:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:50 smithi191 ceph-mon[31636]: pgmap v11611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21600.488200 secs 2024-04-21T16:24:50.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:50 smithi170 ceph-mon[31212]: pgmap v11611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21600.488200 secs 2024-04-21T16:24:52.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:52 smithi077 ceph-mon[27902]: pgmap v11612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:52 smithi191 ceph-mon[31636]: pgmap v11612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:52 smithi170 ceph-mon[31212]: pgmap v11612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21603.726735 secs 2024-04-21T16:24:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21603.726735 secs 2024-04-21T16:24:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21603.726735 secs 2024-04-21T16:24:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:54 smithi191 ceph-mon[31636]: pgmap v11613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:54 smithi170 ceph-mon[31212]: pgmap v11613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:54 smithi077 ceph-mon[27902]: pgmap v11613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:24:55.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21605.488319 secs 2024-04-21T16:24:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21605.488319 secs 2024-04-21T16:24:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21605.488319 secs 2024-04-21T16:24:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:56 smithi191 ceph-mon[31636]: pgmap v11614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:56.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:56 smithi170 ceph-mon[31212]: pgmap v11614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:56 smithi077 ceph-mon[27902]: pgmap v11614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:24:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:58 smithi191 ceph-mon[31636]: pgmap v11615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:24:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21608.726855 secs 2024-04-21T16:24:58.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:58 smithi170 ceph-mon[31212]: pgmap v11615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:24:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21608.726855 secs 2024-04-21T16:24:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:58 smithi077 ceph-mon[27902]: pgmap v11615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:24:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:24:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21608.726855 secs 2024-04-21T16:25:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:00 smithi191 ceph-mon[31636]: pgmap v11616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21610.488397 secs 2024-04-21T16:25:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:00 smithi170 ceph-mon[31212]: pgmap v11616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21610.488397 secs 2024-04-21T16:25:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:00 smithi077 ceph-mon[27902]: pgmap v11616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21610.488397 secs 2024-04-21T16:25:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:02 smithi191 ceph-mon[31636]: pgmap v11617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T16:25:02.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:02 smithi170 ceph-mon[31212]: pgmap v11617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T16:25:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:02 smithi077 ceph-mon[27902]: pgmap v11617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T16:25:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21613.726972 secs 2024-04-21T16:25:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21613.726972 secs 2024-04-21T16:25:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21613.726972 secs 2024-04-21T16:25:04.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:04 smithi191 ceph-mon[31636]: pgmap v11618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:25:04.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:04 smithi170 ceph-mon[31212]: pgmap v11618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:25:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:04 smithi077 ceph-mon[27902]: pgmap v11618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T16:25:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21615.488516 secs 2024-04-21T16:25:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:05 smithi191 ceph-mon[31636]: osdmap e798: 12 total, 12 up, 12 in 2024-04-21T16:25:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21615.488516 secs 2024-04-21T16:25:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:05 smithi170 ceph-mon[31212]: osdmap e798: 12 total, 12 up, 12 in 2024-04-21T16:25:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21615.488516 secs 2024-04-21T16:25:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:05 smithi077 ceph-mon[27902]: osdmap e798: 12 total, 12 up, 12 in 2024-04-21T16:25:06.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:06 smithi191 ceph-mon[31636]: pgmap v11620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:25:06.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:06 smithi170 ceph-mon[31212]: pgmap v11620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:25:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:06 smithi077 ceph-mon[27902]: pgmap v11620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:25:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:08 smithi191 ceph-mon[31636]: pgmap v11621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:25:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21618.727064 secs 2024-04-21T16:25:08.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:08 smithi170 ceph-mon[31212]: pgmap v11621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:25:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21618.727064 secs 2024-04-21T16:25:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:08 smithi077 ceph-mon[27902]: pgmap v11621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:25:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21618.727064 secs 2024-04-21T16:25:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:10 smithi191 ceph-mon[31636]: pgmap v11622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:25:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21620.488632 secs 2024-04-21T16:25:10.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:10 smithi170 ceph-mon[31212]: pgmap v11622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:25:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21620.488632 secs 2024-04-21T16:25:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:10 smithi077 ceph-mon[27902]: pgmap v11622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:25:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21620.488632 secs 2024-04-21T16:25:12.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:12 smithi170 ceph-mon[31212]: pgmap v11623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:25:12.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:12 smithi170 ceph-mon[31212]: osdmap e799: 12 total, 12 up, 12 in 2024-04-21T16:25:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:12 smithi077 ceph-mon[27902]: pgmap v11623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:25:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:12 smithi077 ceph-mon[27902]: osdmap e799: 12 total, 12 up, 12 in 2024-04-21T16:25:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:12 smithi191 ceph-mon[31636]: pgmap v11623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:25:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:12 smithi191 ceph-mon[31636]: osdmap e799: 12 total, 12 up, 12 in 2024-04-21T16:25:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21623.727184 secs 2024-04-21T16:25:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21623.727184 secs 2024-04-21T16:25:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21623.727184 secs 2024-04-21T16:25:14.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:14 smithi170 ceph-mon[31212]: pgmap v11625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-04-21T16:25:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:14 smithi077 ceph-mon[27902]: pgmap v11625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-04-21T16:25:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:14 smithi191 ceph-mon[31636]: pgmap v11625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-04-21T16:25:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21625.488745 secs 2024-04-21T16:25:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21625.488745 secs 2024-04-21T16:25:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21625.488745 secs 2024-04-21T16:25:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:16 smithi077 ceph-mon[27902]: pgmap v11626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:25:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:16 smithi191 ceph-mon[31636]: pgmap v11626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:25:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:16 smithi170 ceph-mon[31212]: pgmap v11626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T16:25:17.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:25:17.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:25:17.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:25:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:18 smithi077 ceph-mon[27902]: pgmap v11627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:25:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21628.727301 secs 2024-04-21T16:25:18.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:18 smithi191 ceph-mon[31636]: pgmap v11627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:25:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21628.727301 secs 2024-04-21T16:25:18.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:18 smithi170 ceph-mon[31212]: pgmap v11627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:25:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21628.727301 secs 2024-04-21T16:25:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:20.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:20 smithi077 ceph-mon[27902]: pgmap v11628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:25:20.277 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21630.488868 secs 2024-04-21T16:25:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:20 smithi191 ceph-mon[31636]: pgmap v11628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:25:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21630.488868 secs 2024-04-21T16:25:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:20 smithi170 ceph-mon[31212]: pgmap v11628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:25:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21630.488868 secs 2024-04-21T16:25:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:25:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:25:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:25:21.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:25:21.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:21.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:25:21.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:25:21.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:25:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:22 smithi191 ceph-mon[31636]: pgmap v11629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:25:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:22 smithi170 ceph-mon[31212]: pgmap v11629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:25:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:22 smithi077 ceph-mon[27902]: pgmap v11629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:25:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21633.727437 secs 2024-04-21T16:25:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:23 smithi191 ceph-mon[31636]: pgmap v11630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:25:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21633.727437 secs 2024-04-21T16:25:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:23 smithi170 ceph-mon[31212]: pgmap v11630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:25:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21633.727437 secs 2024-04-21T16:25:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:23 smithi077 ceph-mon[27902]: pgmap v11630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:25:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21635.488978 secs 2024-04-21T16:25:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21635.488978 secs 2024-04-21T16:25:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21635.488978 secs 2024-04-21T16:25:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:25 smithi191 ceph-mon[31636]: pgmap v11631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:25 smithi170 ceph-mon[31212]: pgmap v11631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:25 smithi077 ceph-mon[27902]: pgmap v11631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:27.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:27 smithi170 ceph-mon[31212]: pgmap v11632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:27.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:27 smithi077 ceph-mon[27902]: pgmap v11632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:27 smithi191 ceph-mon[31636]: pgmap v11632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21638.727551 secs 2024-04-21T16:25:28.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21638.727551 secs 2024-04-21T16:25:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21638.727551 secs 2024-04-21T16:25:29.760 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:29 smithi077 ceph-mon[27902]: pgmap v11633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:29.760 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21640.489109 secs 2024-04-21T16:25:29.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:29 smithi170 ceph-mon[31212]: pgmap v11633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21640.489109 secs 2024-04-21T16:25:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:29 smithi191 ceph-mon[31636]: pgmap v11633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21640.489109 secs 2024-04-21T16:25:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:31 smithi170 ceph-mon[31212]: pgmap v11634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:31 smithi077 ceph-mon[27902]: pgmap v11634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:31.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:31 smithi191 ceph-mon[31636]: pgmap v11634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21643.727667 secs 2024-04-21T16:25:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:33 smithi170 ceph-mon[31212]: pgmap v11635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21643.727667 secs 2024-04-21T16:25:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:33 smithi077 ceph-mon[27902]: pgmap v11635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21643.727667 secs 2024-04-21T16:25:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:33 smithi191 ceph-mon[31636]: pgmap v11635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21645.489176 secs 2024-04-21T16:25:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21645.489176 secs 2024-04-21T16:25:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21645.489176 secs 2024-04-21T16:25:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:35 smithi170 ceph-mon[31212]: pgmap v11636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:35 smithi077 ceph-mon[27902]: pgmap v11636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:35.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:35 smithi191 ceph-mon[31636]: pgmap v11636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:37.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:37 smithi170 ceph-mon[31212]: pgmap v11637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:37.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:37 smithi077 ceph-mon[27902]: pgmap v11637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:37 smithi191 ceph-mon[31636]: pgmap v11637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21648.727786 secs 2024-04-21T16:25:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21648.727786 secs 2024-04-21T16:25:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21648.727786 secs 2024-04-21T16:25:39.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:39 smithi170 ceph-mon[31212]: pgmap v11638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:39.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21650.489307 secs 2024-04-21T16:25:39.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:39 smithi077 ceph-mon[27902]: pgmap v11638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:39.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21650.489307 secs 2024-04-21T16:25:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:39 smithi191 ceph-mon[31636]: pgmap v11638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:39.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21650.489307 secs 2024-04-21T16:25:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:41.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:41 smithi170 ceph-mon[31212]: pgmap v11639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:41.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:41 smithi077 ceph-mon[27902]: pgmap v11639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:41.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:41 smithi191 ceph-mon[31636]: pgmap v11639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21653.727858 secs 2024-04-21T16:25:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:43 smithi170 ceph-mon[31212]: pgmap v11640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21653.727858 secs 2024-04-21T16:25:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:43 smithi077 ceph-mon[27902]: pgmap v11640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21653.727858 secs 2024-04-21T16:25:43.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:43 smithi191 ceph-mon[31636]: pgmap v11640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21655.489385 secs 2024-04-21T16:25:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21655.489385 secs 2024-04-21T16:25:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21655.489385 secs 2024-04-21T16:25:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:45 smithi170 ceph-mon[31212]: pgmap v11641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:45 smithi077 ceph-mon[27902]: pgmap v11641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:45.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:45 smithi191 ceph-mon[31636]: pgmap v11641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:47.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:47 smithi170 ceph-mon[31212]: pgmap v11642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:47.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:47 smithi077 ceph-mon[27902]: pgmap v11642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:47 smithi191 ceph-mon[31636]: pgmap v11642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21658.727975 secs 2024-04-21T16:25:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21658.727975 secs 2024-04-21T16:25:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21658.727975 secs 2024-04-21T16:25:49.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:49 smithi170 ceph-mon[31212]: pgmap v11643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:49.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21660.489501 secs 2024-04-21T16:25:49.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:49 smithi077 ceph-mon[27902]: pgmap v11643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:49.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21660.489501 secs 2024-04-21T16:25:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:49 smithi191 ceph-mon[31636]: pgmap v11643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:49.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21660.489501 secs 2024-04-21T16:25:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:51 smithi170 ceph-mon[31212]: pgmap v11644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:51 smithi077 ceph-mon[27902]: pgmap v11644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:51 smithi191 ceph-mon[31636]: pgmap v11644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21663.728090 secs 2024-04-21T16:25:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:53 smithi170 ceph-mon[31212]: pgmap v11645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21663.728090 secs 2024-04-21T16:25:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:53 smithi077 ceph-mon[27902]: pgmap v11645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:53.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21663.728090 secs 2024-04-21T16:25:53.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:53 smithi191 ceph-mon[31636]: pgmap v11645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21665.489614 secs 2024-04-21T16:25:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21665.489614 secs 2024-04-21T16:25:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21665.489614 secs 2024-04-21T16:25:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:25:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:55 smithi170 ceph-mon[31212]: pgmap v11646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:55 smithi077 ceph-mon[27902]: pgmap v11646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:55 smithi191 ceph-mon[31636]: pgmap v11646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:25:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:25:57.347+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:25:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:25:57.347+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:25:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:25:57.348+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:25:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:25:57.348+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:25:57.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:57 smithi170 ceph-mon[31212]: pgmap v11647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:57.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:57 smithi077 ceph-mon[27902]: pgmap v11647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:57 smithi191 ceph-mon[31636]: pgmap v11647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:25:58.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21668.728169 secs 2024-04-21T16:25:58.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21668.728169 secs 2024-04-21T16:25:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21668.728169 secs 2024-04-21T16:25:59.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:59 smithi077 ceph-mon[27902]: pgmap v11648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:59.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21670.489727 secs 2024-04-21T16:25:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:59 smithi191 ceph-mon[31636]: pgmap v11648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:25:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21670.489727 secs 2024-04-21T16:26:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:59 smithi170 ceph-mon[31212]: pgmap v11648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:00.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21670.489727 secs 2024-04-21T16:26:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:01.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:01 smithi077 ceph-mon[27902]: pgmap v11649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:01.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:01 smithi191 ceph-mon[31636]: pgmap v11649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:02.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:01 smithi170 ceph-mon[31212]: pgmap v11649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21673.728292 secs 2024-04-21T16:26:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:03 smithi077 ceph-mon[27902]: pgmap v11650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21673.728292 secs 2024-04-21T16:26:03.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:03 smithi191 ceph-mon[31636]: pgmap v11650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:04.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21673.728292 secs 2024-04-21T16:26:04.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:03 smithi170 ceph-mon[31212]: pgmap v11650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21675.489842 secs 2024-04-21T16:26:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21675.489842 secs 2024-04-21T16:26:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21675.489842 secs 2024-04-21T16:26:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:05 smithi077 ceph-mon[27902]: pgmap v11651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:05 smithi077 ceph-mon[27902]: osdmap e800: 12 total, 12 up, 12 in 2024-04-21T16:26:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:05 smithi191 ceph-mon[31636]: pgmap v11651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:05 smithi191 ceph-mon[31636]: osdmap e800: 12 total, 12 up, 12 in 2024-04-21T16:26:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:05 smithi170 ceph-mon[31212]: pgmap v11651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:05 smithi170 ceph-mon[31212]: osdmap e800: 12 total, 12 up, 12 in 2024-04-21T16:26:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:07 smithi077 ceph-mon[27902]: pgmap v11653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:26:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:07 smithi191 ceph-mon[31636]: pgmap v11653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:26:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:07 smithi170 ceph-mon[31212]: pgmap v11653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:26:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21678.728417 secs 2024-04-21T16:26:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21678.728417 secs 2024-04-21T16:26:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21678.728417 secs 2024-04-21T16:26:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:09 smithi077 ceph-mon[27902]: pgmap v11654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:26:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21680.489937 secs 2024-04-21T16:26:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:09 smithi191 ceph-mon[31636]: pgmap v11654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:26:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21680.489937 secs 2024-04-21T16:26:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:09 smithi170 ceph-mon[31212]: pgmap v11654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:26:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21680.489937 secs 2024-04-21T16:26:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:12 smithi077 ceph-mon[27902]: pgmap v11655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:26:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:12 smithi077 ceph-mon[27902]: osdmap e801: 12 total, 12 up, 12 in 2024-04-21T16:26:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:12 smithi191 ceph-mon[31636]: pgmap v11655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:26:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:12 smithi191 ceph-mon[31636]: osdmap e801: 12 total, 12 up, 12 in 2024-04-21T16:26:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:12 smithi170 ceph-mon[31212]: pgmap v11655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:26:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:12 smithi170 ceph-mon[31212]: osdmap e801: 12 total, 12 up, 12 in 2024-04-21T16:26:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21683.728553 secs 2024-04-21T16:26:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21683.728553 secs 2024-04-21T16:26:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21683.728553 secs 2024-04-21T16:26:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:14 smithi077 ceph-mon[27902]: pgmap v11657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:26:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:14 smithi191 ceph-mon[31636]: pgmap v11657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:26:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:14 smithi170 ceph-mon[31212]: pgmap v11657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T16:26:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21685.490060 secs 2024-04-21T16:26:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21685.490060 secs 2024-04-21T16:26:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21685.490060 secs 2024-04-21T16:26:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:16 smithi077 ceph-mon[27902]: pgmap v11658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:26:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:16 smithi191 ceph-mon[31636]: pgmap v11658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:26:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:16 smithi170 ceph-mon[31212]: pgmap v11658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T16:26:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:18 smithi077 ceph-mon[27902]: pgmap v11659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:26:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21688.728676 secs 2024-04-21T16:26:18.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:18 smithi191 ceph-mon[31636]: pgmap v11659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:26:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21688.728676 secs 2024-04-21T16:26:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:18 smithi170 ceph-mon[31212]: pgmap v11659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:26:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21688.728676 secs 2024-04-21T16:26:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:20 smithi077 ceph-mon[27902]: pgmap v11660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:26:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21690.490126 secs 2024-04-21T16:26:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:20 smithi191 ceph-mon[31636]: pgmap v11660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:26:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21690.490126 secs 2024-04-21T16:26:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:20 smithi170 ceph-mon[31212]: pgmap v11660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:26:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21690.490126 secs 2024-04-21T16:26:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:26:21.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:26:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:26:22.155 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:22 smithi170 ceph-mon[31212]: pgmap v11661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:26:22.180 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:22 smithi191 ceph-mon[31636]: pgmap v11661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:26:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:22 smithi077 ceph-mon[27902]: pgmap v11661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:26:23.198 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21693.728819 secs 2024-04-21T16:26:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21693.728819 secs 2024-04-21T16:26:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21693.728819 secs 2024-04-21T16:26:24.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:24 smithi077 ceph-mon[27902]: pgmap v11662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:26:24.410 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:24 smithi170 ceph-mon[31212]: pgmap v11662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:26:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:24 smithi191 ceph-mon[31636]: pgmap v11662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:26:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:25.349 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21695.490211 secs 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:26:25.350 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21695.490211 secs 2024-04-21T16:26:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:26:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:26:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21695.490211 secs 2024-04-21T16:26:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:26:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:26:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:26:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:26 smithi077 ceph-mon[27902]: pgmap v11663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:26 smithi191 ceph-mon[31636]: pgmap v11663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:26 smithi170 ceph-mon[31212]: pgmap v11663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:28.361 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:28 smithi170 ceph-mon[31212]: pgmap v11664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:28.361 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21698.728935 secs 2024-04-21T16:26:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:28 smithi077 ceph-mon[27902]: pgmap v11664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21698.728935 secs 2024-04-21T16:26:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:28 smithi191 ceph-mon[31636]: pgmap v11664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21698.728935 secs 2024-04-21T16:26:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:30.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:30 smithi077 ceph-mon[27902]: pgmap v11665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:30.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21700.490322 secs 2024-04-21T16:26:30.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:30 smithi191 ceph-mon[31636]: pgmap v11665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21700.490322 secs 2024-04-21T16:26:30.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:30 smithi170 ceph-mon[31212]: pgmap v11665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21700.490322 secs 2024-04-21T16:26:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:32 smithi077 ceph-mon[27902]: pgmap v11666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:32.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:32 smithi191 ceph-mon[31636]: pgmap v11666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:32 smithi170 ceph-mon[31212]: pgmap v11666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21703.729066 secs 2024-04-21T16:26:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21703.729066 secs 2024-04-21T16:26:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21703.729066 secs 2024-04-21T16:26:34.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:34 smithi077 ceph-mon[27902]: pgmap v11667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:34 smithi191 ceph-mon[31636]: pgmap v11667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:34 smithi170 ceph-mon[31212]: pgmap v11667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21705.490455 secs 2024-04-21T16:26:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21705.490455 secs 2024-04-21T16:26:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21705.490455 secs 2024-04-21T16:26:36.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:36 smithi077 ceph-mon[27902]: pgmap v11668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:36 smithi191 ceph-mon[31636]: pgmap v11668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:36.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:36 smithi170 ceph-mon[31212]: pgmap v11668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:38.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:38 smithi077 ceph-mon[27902]: pgmap v11669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:38.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21708.729187 secs 2024-04-21T16:26:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:38 smithi191 ceph-mon[31636]: pgmap v11669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21708.729187 secs 2024-04-21T16:26:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:38 smithi170 ceph-mon[31212]: pgmap v11669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21708.729187 secs 2024-04-21T16:26:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:40 smithi077 ceph-mon[27902]: pgmap v11670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21710.490589 secs 2024-04-21T16:26:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:40 smithi191 ceph-mon[31636]: pgmap v11670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21710.490589 secs 2024-04-21T16:26:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:40 smithi170 ceph-mon[31212]: pgmap v11670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21710.490589 secs 2024-04-21T16:26:42.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:42 smithi077 ceph-mon[27902]: pgmap v11671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:42 smithi191 ceph-mon[31636]: pgmap v11671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:42 smithi170 ceph-mon[31212]: pgmap v11671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21713.729285 secs 2024-04-21T16:26:43.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21713.729285 secs 2024-04-21T16:26:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21713.729285 secs 2024-04-21T16:26:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:44 smithi191 ceph-mon[31636]: pgmap v11672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:44 smithi170 ceph-mon[31212]: pgmap v11672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:44 smithi077 ceph-mon[27902]: pgmap v11672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21715.490726 secs 2024-04-21T16:26:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21715.490726 secs 2024-04-21T16:26:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21715.490726 secs 2024-04-21T16:26:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:46 smithi191 ceph-mon[31636]: pgmap v11673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:46 smithi170 ceph-mon[31212]: pgmap v11673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:46 smithi077 ceph-mon[27902]: pgmap v11673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:48 smithi191 ceph-mon[31636]: pgmap v11674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21718.729421 secs 2024-04-21T16:26:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:48 smithi170 ceph-mon[31212]: pgmap v11674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21718.729421 secs 2024-04-21T16:26:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:48 smithi077 ceph-mon[27902]: pgmap v11674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21718.729421 secs 2024-04-21T16:26:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:50 smithi191 ceph-mon[31636]: pgmap v11675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21720.490887 secs 2024-04-21T16:26:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:50 smithi170 ceph-mon[31212]: pgmap v11675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21720.490887 secs 2024-04-21T16:26:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:50 smithi077 ceph-mon[27902]: pgmap v11675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21720.490887 secs 2024-04-21T16:26:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:52 smithi191 ceph-mon[31636]: pgmap v11676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:52 smithi170 ceph-mon[31212]: pgmap v11676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:52 smithi077 ceph-mon[27902]: pgmap v11676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21723.729528 secs 2024-04-21T16:26:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21723.729528 secs 2024-04-21T16:26:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21723.729528 secs 2024-04-21T16:26:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:54 smithi191 ceph-mon[31636]: pgmap v11677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:54 smithi170 ceph-mon[31212]: pgmap v11677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:54 smithi077 ceph-mon[27902]: pgmap v11677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:26:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21725.490997 secs 2024-04-21T16:26:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21725.490997 secs 2024-04-21T16:26:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21725.490997 secs 2024-04-21T16:26:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:56 smithi191 ceph-mon[31636]: pgmap v11678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:56.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:56 smithi170 ceph-mon[31212]: pgmap v11678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:56 smithi077 ceph-mon[27902]: pgmap v11678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:26:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:58 smithi191 ceph-mon[31636]: pgmap v11679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:26:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21728.729646 secs 2024-04-21T16:26:58.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:58 smithi170 ceph-mon[31212]: pgmap v11679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:26:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21728.729646 secs 2024-04-21T16:26:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:58 smithi077 ceph-mon[27902]: pgmap v11679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:26:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:26:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21728.729646 secs 2024-04-21T16:27:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:00 smithi191 ceph-mon[31636]: pgmap v11680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21730.491057 secs 2024-04-21T16:27:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:00 smithi170 ceph-mon[31212]: pgmap v11680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21730.491057 secs 2024-04-21T16:27:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:00 smithi077 ceph-mon[27902]: pgmap v11680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21730.491057 secs 2024-04-21T16:27:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:02 smithi191 ceph-mon[31636]: pgmap v11681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:02.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:02 smithi170 ceph-mon[31212]: pgmap v11681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:02 smithi077 ceph-mon[27902]: pgmap v11681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21733.729800 secs 2024-04-21T16:27:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21733.729800 secs 2024-04-21T16:27:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21733.729800 secs 2024-04-21T16:27:04.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:04 smithi191 ceph-mon[31636]: pgmap v11682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:04.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:04 smithi170 ceph-mon[31212]: pgmap v11682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:04.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:04 smithi077 ceph-mon[27902]: pgmap v11682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21735.491169 secs 2024-04-21T16:27:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:05 smithi191 ceph-mon[31636]: osdmap e802: 12 total, 12 up, 12 in 2024-04-21T16:27:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21735.491169 secs 2024-04-21T16:27:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:05 smithi170 ceph-mon[31212]: osdmap e802: 12 total, 12 up, 12 in 2024-04-21T16:27:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21735.491169 secs 2024-04-21T16:27:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:05 smithi077 ceph-mon[27902]: osdmap e802: 12 total, 12 up, 12 in 2024-04-21T16:27:06.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:06 smithi191 ceph-mon[31636]: pgmap v11684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:27:06.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:06 smithi170 ceph-mon[31212]: pgmap v11684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:27:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:06 smithi077 ceph-mon[27902]: pgmap v11684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:27:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:08 smithi191 ceph-mon[31636]: pgmap v11685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:27:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21738.729922 secs 2024-04-21T16:27:08.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:08 smithi170 ceph-mon[31212]: pgmap v11685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:27:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21738.729922 secs 2024-04-21T16:27:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:08 smithi077 ceph-mon[27902]: pgmap v11685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:27:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21738.729922 secs 2024-04-21T16:27:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:10 smithi191 ceph-mon[31636]: pgmap v11686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:27:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21740.491249 secs 2024-04-21T16:27:10.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:10 smithi170 ceph-mon[31212]: pgmap v11686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:27:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21740.491249 secs 2024-04-21T16:27:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:10 smithi077 ceph-mon[27902]: pgmap v11686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:27:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21740.491249 secs 2024-04-21T16:27:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:12 smithi077 ceph-mon[27902]: pgmap v11687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:27:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:12 smithi077 ceph-mon[27902]: osdmap e803: 12 total, 12 up, 12 in 2024-04-21T16:27:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:12 smithi191 ceph-mon[31636]: pgmap v11687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:27:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:12 smithi191 ceph-mon[31636]: osdmap e803: 12 total, 12 up, 12 in 2024-04-21T16:27:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:12 smithi170 ceph-mon[31212]: pgmap v11687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:27:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:12 smithi170 ceph-mon[31212]: osdmap e803: 12 total, 12 up, 12 in 2024-04-21T16:27:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21743.730002 secs 2024-04-21T16:27:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21743.730002 secs 2024-04-21T16:27:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21743.730002 secs 2024-04-21T16:27:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:14 smithi077 ceph-mon[27902]: pgmap v11689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:27:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:14 smithi191 ceph-mon[31636]: pgmap v11689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:27:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:14 smithi170 ceph-mon[31212]: pgmap v11689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:27:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21745.491360 secs 2024-04-21T16:27:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21745.491360 secs 2024-04-21T16:27:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21745.491360 secs 2024-04-21T16:27:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:16 smithi077 ceph-mon[27902]: pgmap v11690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:27:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:16 smithi191 ceph-mon[31636]: pgmap v11690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:27:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:16 smithi170 ceph-mon[31212]: pgmap v11690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:27:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:18 smithi077 ceph-mon[27902]: pgmap v11691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:27:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21748.730119 secs 2024-04-21T16:27:18.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:18 smithi191 ceph-mon[31636]: pgmap v11691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:27:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21748.730119 secs 2024-04-21T16:27:18.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:18 smithi170 ceph-mon[31212]: pgmap v11691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:27:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21748.730119 secs 2024-04-21T16:27:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:20 smithi077 ceph-mon[27902]: pgmap v11692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:27:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21750.491458 secs 2024-04-21T16:27:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:20 smithi191 ceph-mon[31636]: pgmap v11692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:27:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21750.491458 secs 2024-04-21T16:27:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:20 smithi170 ceph-mon[31212]: pgmap v11692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:27:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21750.491458 secs 2024-04-21T16:27:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:22 smithi077 ceph-mon[27902]: pgmap v11693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:27:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:22 smithi191 ceph-mon[31636]: pgmap v11693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:27:22.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:22 smithi170 ceph-mon[31212]: pgmap v11693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:27:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21753.730259 secs 2024-04-21T16:27:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21753.730259 secs 2024-04-21T16:27:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21753.730259 secs 2024-04-21T16:27:24.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:24 smithi077 ceph-mon[27902]: pgmap v11694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:27:24.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:24 smithi191 ceph-mon[31636]: pgmap v11694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:27:24.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:24 smithi170 ceph-mon[31212]: pgmap v11694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:27:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21755.491530 secs 2024-04-21T16:27:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21755.491530 secs 2024-04-21T16:27:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21755.491530 secs 2024-04-21T16:27:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:26 smithi077 ceph-mon[27902]: pgmap v11695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:27:26.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:27:26.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:27:26.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:27:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:26 smithi191 ceph-mon[31636]: pgmap v11695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:27:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:27:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:27:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:27:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:26 smithi170 ceph-mon[31212]: pgmap v11695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:27:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:27:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:27:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:27:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:28 smithi077 ceph-mon[27902]: pgmap v11696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21758.730323 secs 2024-04-21T16:27:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:28 smithi191 ceph-mon[31636]: pgmap v11696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21758.730323 secs 2024-04-21T16:27:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:28 smithi170 ceph-mon[31212]: pgmap v11696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21758.730323 secs 2024-04-21T16:27:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:30.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:30 smithi077 ceph-mon[27902]: pgmap v11697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:30.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21760.491652 secs 2024-04-21T16:27:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:30 smithi191 ceph-mon[31636]: pgmap v11697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21760.491652 secs 2024-04-21T16:27:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:30 smithi170 ceph-mon[31212]: pgmap v11697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21760.491652 secs 2024-04-21T16:27:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:32 smithi077 ceph-mon[27902]: pgmap v11698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:32.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:32 smithi191 ceph-mon[31636]: pgmap v11698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:32 smithi170 ceph-mon[31212]: pgmap v11698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21763.730463 secs 2024-04-21T16:27:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21763.730463 secs 2024-04-21T16:27:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21763.730463 secs 2024-04-21T16:27:34.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:34 smithi077 ceph-mon[27902]: pgmap v11699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:34 smithi191 ceph-mon[31636]: pgmap v11699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:34 smithi170 ceph-mon[31212]: pgmap v11699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21765.491787 secs 2024-04-21T16:27:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21765.491787 secs 2024-04-21T16:27:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21765.491787 secs 2024-04-21T16:27:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:36 smithi191 ceph-mon[31636]: pgmap v11700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:36 smithi170 ceph-mon[31212]: pgmap v11700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:36 smithi077 ceph-mon[27902]: pgmap v11700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:38 smithi191 ceph-mon[31636]: pgmap v11701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21768.730579 secs 2024-04-21T16:27:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:38 smithi170 ceph-mon[31212]: pgmap v11701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21768.730579 secs 2024-04-21T16:27:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:38 smithi077 ceph-mon[27902]: pgmap v11701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21768.730579 secs 2024-04-21T16:27:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:40 smithi191 ceph-mon[31636]: pgmap v11702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21770.491927 secs 2024-04-21T16:27:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:40 smithi170 ceph-mon[31212]: pgmap v11702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21770.491927 secs 2024-04-21T16:27:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:40 smithi077 ceph-mon[27902]: pgmap v11702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21770.491927 secs 2024-04-21T16:27:42.439 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:42 smithi077 ceph-mon[27902]: pgmap v11703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:42 smithi191 ceph-mon[31636]: pgmap v11703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:42 smithi170 ceph-mon[31212]: pgmap v11703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21773.730699 secs 2024-04-21T16:27:43.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21773.730699 secs 2024-04-21T16:27:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21773.730699 secs 2024-04-21T16:27:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:44 smithi191 ceph-mon[31636]: pgmap v11704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:44 smithi170 ceph-mon[31212]: pgmap v11704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:44 smithi077 ceph-mon[27902]: pgmap v11704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21775.492043 secs 2024-04-21T16:27:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21775.492043 secs 2024-04-21T16:27:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21775.492043 secs 2024-04-21T16:27:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:46 smithi191 ceph-mon[31636]: pgmap v11705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:46 smithi170 ceph-mon[31212]: pgmap v11705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:46 smithi077 ceph-mon[27902]: pgmap v11705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:48 smithi191 ceph-mon[31636]: pgmap v11706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21778.730839 secs 2024-04-21T16:27:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:48 smithi170 ceph-mon[31212]: pgmap v11706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21778.730839 secs 2024-04-21T16:27:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:48 smithi077 ceph-mon[27902]: pgmap v11706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21778.730839 secs 2024-04-21T16:27:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:50 smithi191 ceph-mon[31636]: pgmap v11707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21780.492160 secs 2024-04-21T16:27:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:50 smithi170 ceph-mon[31212]: pgmap v11707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21780.492160 secs 2024-04-21T16:27:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:50 smithi077 ceph-mon[27902]: pgmap v11707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21780.492160 secs 2024-04-21T16:27:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:52 smithi191 ceph-mon[31636]: pgmap v11708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:52 smithi170 ceph-mon[31212]: pgmap v11708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:52 smithi077 ceph-mon[27902]: pgmap v11708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21783.730955 secs 2024-04-21T16:27:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21783.730955 secs 2024-04-21T16:27:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21783.730955 secs 2024-04-21T16:27:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:54 smithi191 ceph-mon[31636]: pgmap v11709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:54 smithi170 ceph-mon[31212]: pgmap v11709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:54 smithi077 ceph-mon[27902]: pgmap v11709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:27:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21785.492269 secs 2024-04-21T16:27:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21785.492269 secs 2024-04-21T16:27:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21785.492269 secs 2024-04-21T16:27:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:56 smithi191 ceph-mon[31636]: pgmap v11710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:56.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:56 smithi170 ceph-mon[31212]: pgmap v11710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:56 smithi077 ceph-mon[27902]: pgmap v11710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:27:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:58 smithi191 ceph-mon[31636]: pgmap v11711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:27:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21788.731060 secs 2024-04-21T16:27:58.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:58 smithi170 ceph-mon[31212]: pgmap v11711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:27:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21788.731060 secs 2024-04-21T16:27:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:58 smithi077 ceph-mon[27902]: pgmap v11711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:27:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:27:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21788.731060 secs 2024-04-21T16:28:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:00 smithi191 ceph-mon[31636]: pgmap v11712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21790.492349 secs 2024-04-21T16:28:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:00 smithi170 ceph-mon[31212]: pgmap v11712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21790.492349 secs 2024-04-21T16:28:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:00 smithi077 ceph-mon[27902]: pgmap v11712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21790.492349 secs 2024-04-21T16:28:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:02 smithi191 ceph-mon[31636]: pgmap v11713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:02 smithi170 ceph-mon[31212]: pgmap v11713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:02 smithi077 ceph-mon[27902]: pgmap v11713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21793.731169 secs 2024-04-21T16:28:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21793.731169 secs 2024-04-21T16:28:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21793.731169 secs 2024-04-21T16:28:04.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:04 smithi191 ceph-mon[31636]: pgmap v11714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:04.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:04 smithi170 ceph-mon[31212]: pgmap v11714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:04 smithi077 ceph-mon[27902]: pgmap v11714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21795.492462 secs 2024-04-21T16:28:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:05 smithi191 ceph-mon[31636]: osdmap e804: 12 total, 12 up, 12 in 2024-04-21T16:28:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21795.492462 secs 2024-04-21T16:28:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:05 smithi170 ceph-mon[31212]: osdmap e804: 12 total, 12 up, 12 in 2024-04-21T16:28:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21795.492462 secs 2024-04-21T16:28:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:05 smithi077 ceph-mon[27902]: osdmap e804: 12 total, 12 up, 12 in 2024-04-21T16:28:06.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:06 smithi191 ceph-mon[31636]: pgmap v11716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:28:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:06 smithi170 ceph-mon[31212]: pgmap v11716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:28:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:06 smithi077 ceph-mon[27902]: pgmap v11716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:28:08.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:08 smithi170 ceph-mon[31212]: pgmap v11717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:28:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21798.731290 secs 2024-04-21T16:28:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:08 smithi077 ceph-mon[27902]: pgmap v11717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:28:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21798.731290 secs 2024-04-21T16:28:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:08 smithi191 ceph-mon[31636]: pgmap v11717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:28:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21798.731290 secs 2024-04-21T16:28:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:10.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:10 smithi170 ceph-mon[31212]: pgmap v11718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:28:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21800.492581 secs 2024-04-21T16:28:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:10 smithi077 ceph-mon[27902]: pgmap v11718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:28:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21800.492581 secs 2024-04-21T16:28:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:10 smithi191 ceph-mon[31636]: pgmap v11718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:28:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21800.492581 secs 2024-04-21T16:28:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:12 smithi077 ceph-mon[27902]: pgmap v11719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:28:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:12 smithi077 ceph-mon[27902]: osdmap e805: 12 total, 12 up, 12 in 2024-04-21T16:28:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:12 smithi191 ceph-mon[31636]: pgmap v11719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:28:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:12 smithi191 ceph-mon[31636]: osdmap e805: 12 total, 12 up, 12 in 2024-04-21T16:28:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:12 smithi170 ceph-mon[31212]: pgmap v11719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:28:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:12 smithi170 ceph-mon[31212]: osdmap e805: 12 total, 12 up, 12 in 2024-04-21T16:28:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21803.731380 secs 2024-04-21T16:28:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21803.731380 secs 2024-04-21T16:28:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21803.731380 secs 2024-04-21T16:28:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:14 smithi077 ceph-mon[27902]: pgmap v11721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:28:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:14 smithi191 ceph-mon[31636]: pgmap v11721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:28:14.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:14 smithi170 ceph-mon[31212]: pgmap v11721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:28:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21805.492719 secs 2024-04-21T16:28:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21805.492719 secs 2024-04-21T16:28:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21805.492719 secs 2024-04-21T16:28:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:16 smithi077 ceph-mon[27902]: pgmap v11722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:28:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:16 smithi191 ceph-mon[31636]: pgmap v11722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:28:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:16 smithi170 ceph-mon[31212]: pgmap v11722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:28:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:18 smithi077 ceph-mon[27902]: pgmap v11723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:28:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21808.731502 secs 2024-04-21T16:28:18.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:18 smithi191 ceph-mon[31636]: pgmap v11723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:28:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21808.731502 secs 2024-04-21T16:28:18.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:18 smithi170 ceph-mon[31212]: pgmap v11723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:28:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21808.731502 secs 2024-04-21T16:28:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 21995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:20 smithi077 ceph-mon[27902]: pgmap v11724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:28:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21810.492833 secs 2024-04-21T16:28:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:20 smithi191 ceph-mon[31636]: pgmap v11724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:28:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21810.492833 secs 2024-04-21T16:28:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:20 smithi170 ceph-mon[31212]: pgmap v11724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:28:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21810.492833 secs 2024-04-21T16:28:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:22 smithi077 ceph-mon[27902]: pgmap v11725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:28:22.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:22 smithi191 ceph-mon[31636]: pgmap v11725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:28:22.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:22 smithi170 ceph-mon[31212]: pgmap v11725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:28:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21813.731615 secs 2024-04-21T16:28:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21813.731615 secs 2024-04-21T16:28:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21813.731615 secs 2024-04-21T16:28:24.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:24 smithi077 ceph-mon[27902]: pgmap v11726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:28:24.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:24 smithi191 ceph-mon[31636]: pgmap v11726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:28:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:24 smithi170 ceph-mon[31212]: pgmap v11726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:28:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21815.492950 secs 2024-04-21T16:28:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21815.492950 secs 2024-04-21T16:28:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21815.492950 secs 2024-04-21T16:28:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:26 smithi077 ceph-mon[27902]: pgmap v11727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:28:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:26 smithi191 ceph-mon[31636]: pgmap v11727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:28:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:26 smithi170 ceph-mon[31212]: pgmap v11727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:28:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:28:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:28:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:28:27.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:28:27.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:28:27.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:28:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:28:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:28:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:28:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:28 smithi077 ceph-mon[27902]: pgmap v11728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21818.731702 secs 2024-04-21T16:28:28.460 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:28 smithi170 ceph-mon[31212]: pgmap v11728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:28.460 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21818.731702 secs 2024-04-21T16:28:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:28 smithi191 ceph-mon[31636]: pgmap v11728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:28.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21818.731702 secs 2024-04-21T16:28:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:30.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:30 smithi191 ceph-mon[31636]: pgmap v11729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21820.493061 secs 2024-04-21T16:28:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:30 smithi170 ceph-mon[31212]: pgmap v11729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21820.493061 secs 2024-04-21T16:28:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:30 smithi077 ceph-mon[27902]: pgmap v11729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21820.493061 secs 2024-04-21T16:28:32.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:32 smithi191 ceph-mon[31636]: pgmap v11730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:32 smithi170 ceph-mon[31212]: pgmap v11730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:32 smithi077 ceph-mon[27902]: pgmap v11730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21823.731835 secs 2024-04-21T16:28:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21823.731835 secs 2024-04-21T16:28:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21823.731835 secs 2024-04-21T16:28:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:34 smithi191 ceph-mon[31636]: pgmap v11731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:34 smithi170 ceph-mon[31212]: pgmap v11731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:34 smithi077 ceph-mon[27902]: pgmap v11731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:35.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21825.493174 secs 2024-04-21T16:28:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21825.493174 secs 2024-04-21T16:28:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21825.493174 secs 2024-04-21T16:28:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:36 smithi191 ceph-mon[31636]: pgmap v11732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:36.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:36 smithi170 ceph-mon[31212]: pgmap v11732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:36 smithi077 ceph-mon[27902]: pgmap v11732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:38 smithi191 ceph-mon[31636]: pgmap v11733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21828.731952 secs 2024-04-21T16:28:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:38 smithi170 ceph-mon[31212]: pgmap v11733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21828.731952 secs 2024-04-21T16:28:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:38 smithi077 ceph-mon[27902]: pgmap v11733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21828.731952 secs 2024-04-21T16:28:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:40 smithi191 ceph-mon[31636]: pgmap v11734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21830.493270 secs 2024-04-21T16:28:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:40 smithi170 ceph-mon[31212]: pgmap v11734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21830.493270 secs 2024-04-21T16:28:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:40 smithi077 ceph-mon[27902]: pgmap v11734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21830.493270 secs 2024-04-21T16:28:42.439 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:42 smithi077 ceph-mon[27902]: pgmap v11735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:42 smithi191 ceph-mon[31636]: pgmap v11735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:42 smithi170 ceph-mon[31212]: pgmap v11735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21833.732033 secs 2024-04-21T16:28:43.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21833.732033 secs 2024-04-21T16:28:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21833.732033 secs 2024-04-21T16:28:44.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:44 smithi191 ceph-mon[31636]: pgmap v11736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:44 smithi170 ceph-mon[31212]: pgmap v11736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:44 smithi077 ceph-mon[27902]: pgmap v11736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21835.493394 secs 2024-04-21T16:28:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21835.493394 secs 2024-04-21T16:28:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21835.493394 secs 2024-04-21T16:28:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:46 smithi191 ceph-mon[31636]: pgmap v11737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:46 smithi170 ceph-mon[31212]: pgmap v11737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:46 smithi077 ceph-mon[27902]: pgmap v11737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:48 smithi191 ceph-mon[31636]: pgmap v11738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21838.732146 secs 2024-04-21T16:28:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:48 smithi170 ceph-mon[31212]: pgmap v11738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21838.732146 secs 2024-04-21T16:28:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:48 smithi077 ceph-mon[27902]: pgmap v11738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21838.732146 secs 2024-04-21T16:28:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:50 smithi191 ceph-mon[31636]: pgmap v11739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21840.493469 secs 2024-04-21T16:28:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:50 smithi170 ceph-mon[31212]: pgmap v11739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21840.493469 secs 2024-04-21T16:28:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:50 smithi077 ceph-mon[27902]: pgmap v11739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21840.493469 secs 2024-04-21T16:28:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:52 smithi191 ceph-mon[31636]: pgmap v11740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:52 smithi170 ceph-mon[31212]: pgmap v11740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:52 smithi077 ceph-mon[27902]: pgmap v11740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21843.732280 secs 2024-04-21T16:28:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21843.732280 secs 2024-04-21T16:28:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21843.732280 secs 2024-04-21T16:28:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.441+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000199) for more than 900000000 us, fault. 2024-04-21T16:28:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.441+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T16:28:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.441+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:28:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.442+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T16:28:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.442+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T16:28:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:54 smithi191 ceph-mon[31636]: pgmap v11741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efd700108f0 tx=0x7efd7004c000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efd700108f0 tx=0x7efd7004c000 comp rx=0 tx=0).stop 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T16:28:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T16:28:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T16:28:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:28:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:54.474+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd7002a000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T16:28:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:54 smithi170 ceph-mon[31212]: pgmap v11741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:54 smithi077 ceph-mon[27902]: pgmap v11741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:28:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21845.493583 secs 2024-04-21T16:28:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21845.493583 secs 2024-04-21T16:28:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21845.493583 secs 2024-04-21T16:28:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:56 smithi191 ceph-mon[31636]: pgmap v11742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:56.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:56 smithi170 ceph-mon[31212]: pgmap v11742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:56 smithi077 ceph-mon[27902]: pgmap v11742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:28:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:57.374+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:28:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:57.374+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:28:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:57.374+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:28:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:28:57.374+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:28:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:58 smithi191 ceph-mon[31636]: pgmap v11743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:28:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21848.732397 secs 2024-04-21T16:28:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:58 smithi170 ceph-mon[31212]: pgmap v11743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:28:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21848.732397 secs 2024-04-21T16:28:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:58 smithi077 ceph-mon[27902]: pgmap v11743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:28:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:28:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21848.732397 secs 2024-04-21T16:29:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:00 smithi191 ceph-mon[31636]: pgmap v11744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21850.493702 secs 2024-04-21T16:29:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:00 smithi170 ceph-mon[31212]: pgmap v11744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21850.493702 secs 2024-04-21T16:29:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:00 smithi077 ceph-mon[27902]: pgmap v11744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21850.493702 secs 2024-04-21T16:29:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:02 smithi191 ceph-mon[31636]: pgmap v11745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:02.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:02 smithi170 ceph-mon[31212]: pgmap v11745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:02 smithi077 ceph-mon[27902]: pgmap v11745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21853.732515 secs 2024-04-21T16:29:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21853.732515 secs 2024-04-21T16:29:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21853.732515 secs 2024-04-21T16:29:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:04 smithi170 ceph-mon[31212]: pgmap v11746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:04 smithi077 ceph-mon[27902]: pgmap v11746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:04 smithi191 ceph-mon[31636]: pgmap v11746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21855.493833 secs 2024-04-21T16:29:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:05 smithi170 ceph-mon[31212]: osdmap e806: 12 total, 12 up, 12 in 2024-04-21T16:29:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21855.493833 secs 2024-04-21T16:29:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:05 smithi077 ceph-mon[27902]: osdmap e806: 12 total, 12 up, 12 in 2024-04-21T16:29:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21855.493833 secs 2024-04-21T16:29:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:05 smithi191 ceph-mon[31636]: osdmap e806: 12 total, 12 up, 12 in 2024-04-21T16:29:06.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:06 smithi170 ceph-mon[31212]: pgmap v11748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:29:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:06 smithi077 ceph-mon[27902]: pgmap v11748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:29:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:06 smithi191 ceph-mon[31636]: pgmap v11748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:29:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:08 smithi170 ceph-mon[31212]: pgmap v11749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21858.732632 secs 2024-04-21T16:29:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:08 smithi077 ceph-mon[27902]: pgmap v11749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21858.732632 secs 2024-04-21T16:29:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:08 smithi191 ceph-mon[31636]: pgmap v11749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21858.732632 secs 2024-04-21T16:29:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:10 smithi170 ceph-mon[31212]: pgmap v11750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21860.493946 secs 2024-04-21T16:29:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:10 smithi077 ceph-mon[27902]: pgmap v11750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21860.493946 secs 2024-04-21T16:29:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:10 smithi191 ceph-mon[31636]: pgmap v11750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21860.493946 secs 2024-04-21T16:29:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:12 smithi077 ceph-mon[27902]: pgmap v11751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:12 smithi077 ceph-mon[27902]: osdmap e807: 12 total, 12 up, 12 in 2024-04-21T16:29:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:12 smithi191 ceph-mon[31636]: pgmap v11751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:12 smithi191 ceph-mon[31636]: osdmap e807: 12 total, 12 up, 12 in 2024-04-21T16:29:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:12 smithi170 ceph-mon[31212]: pgmap v11751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:12 smithi170 ceph-mon[31212]: osdmap e807: 12 total, 12 up, 12 in 2024-04-21T16:29:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21863.732802 secs 2024-04-21T16:29:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21863.732802 secs 2024-04-21T16:29:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21863.732802 secs 2024-04-21T16:29:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:14 smithi077 ceph-mon[27902]: pgmap v11753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T16:29:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:14 smithi191 ceph-mon[31636]: pgmap v11753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T16:29:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:14 smithi170 ceph-mon[31212]: pgmap v11753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T16:29:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21865.494095 secs 2024-04-21T16:29:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21865.494095 secs 2024-04-21T16:29:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21865.494095 secs 2024-04-21T16:29:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:16 smithi077 ceph-mon[27902]: pgmap v11754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:16 smithi191 ceph-mon[31636]: pgmap v11754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:16 smithi170 ceph-mon[31212]: pgmap v11754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:29:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:18 smithi077 ceph-mon[27902]: pgmap v11755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:29:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21868.732932 secs 2024-04-21T16:29:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:18 smithi191 ceph-mon[31636]: pgmap v11755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:29:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21868.732932 secs 2024-04-21T16:29:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:18 smithi170 ceph-mon[31212]: pgmap v11755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:29:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21868.732932 secs 2024-04-21T16:29:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:20 smithi077 ceph-mon[27902]: pgmap v11756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:29:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21870.494231 secs 2024-04-21T16:29:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:20 smithi191 ceph-mon[31636]: pgmap v11756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:29:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21870.494231 secs 2024-04-21T16:29:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:20 smithi170 ceph-mon[31212]: pgmap v11756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:29:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21870.494231 secs 2024-04-21T16:29:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:22 smithi077 ceph-mon[27902]: pgmap v11757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:29:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:22 smithi191 ceph-mon[31636]: pgmap v11757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:29:22.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:22 smithi170 ceph-mon[31212]: pgmap v11757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:29:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21873.733007 secs 2024-04-21T16:29:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21873.733007 secs 2024-04-21T16:29:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21873.733007 secs 2024-04-21T16:29:24.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:24 smithi191 ceph-mon[31636]: pgmap v11758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:29:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:24 smithi170 ceph-mon[31212]: pgmap v11758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:29:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:24 smithi077 ceph-mon[27902]: pgmap v11758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:29:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21875.494346 secs 2024-04-21T16:29:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21875.494346 secs 2024-04-21T16:29:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21875.494346 secs 2024-04-21T16:29:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:26 smithi191 ceph-mon[31636]: pgmap v11759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:26 smithi170 ceph-mon[31212]: pgmap v11759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:26 smithi077 ceph-mon[27902]: pgmap v11759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:27.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:29:27.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:29:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:29:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:28 smithi191 ceph-mon[31636]: pgmap v11760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21878.733125 secs 2024-04-21T16:29:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:28 smithi170 ceph-mon[31212]: pgmap v11760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21878.733125 secs 2024-04-21T16:29:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:28 smithi077 ceph-mon[27902]: pgmap v11760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21878.733125 secs 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: pgmap v11761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21880.494433 secs 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: pgmap v11761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:29.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21880.494433 secs 2024-04-21T16:29:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: pgmap v11761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21880.494433 secs 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:29.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:29:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:29:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:29:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:29:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:29:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:29:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:29:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:29:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:29:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:29:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:29:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:29:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:29:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:29:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:29:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:29:32.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:31 smithi170 ceph-mon[31212]: pgmap v11762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:31 smithi077 ceph-mon[27902]: pgmap v11762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:31 smithi191 ceph-mon[31636]: pgmap v11762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21883.733274 secs 2024-04-21T16:29:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21883.733274 secs 2024-04-21T16:29:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21883.733274 secs 2024-04-21T16:29:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:33 smithi170 ceph-mon[31212]: pgmap v11763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:34.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:33 smithi077 ceph-mon[27902]: pgmap v11763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:34.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:33 smithi191 ceph-mon[31636]: pgmap v11763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21885.494548 secs 2024-04-21T16:29:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21885.494548 secs 2024-04-21T16:29:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21885.494548 secs 2024-04-21T16:29:36.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:35 smithi170 ceph-mon[31212]: pgmap v11764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:35 smithi077 ceph-mon[27902]: pgmap v11764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:36.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:35 smithi191 ceph-mon[31636]: pgmap v11764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:37 smithi170 ceph-mon[31212]: pgmap v11765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:38.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21888.733431 secs 2024-04-21T16:29:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:37 smithi077 ceph-mon[27902]: pgmap v11765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:38.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21888.733431 secs 2024-04-21T16:29:38.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:37 smithi191 ceph-mon[31636]: pgmap v11765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21888.733431 secs 2024-04-21T16:29:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:39 smithi170 ceph-mon[31212]: pgmap v11766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21890.494666 secs 2024-04-21T16:29:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:39 smithi077 ceph-mon[27902]: pgmap v11766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21890.494666 secs 2024-04-21T16:29:40.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:39 smithi191 ceph-mon[31636]: pgmap v11766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21890.494666 secs 2024-04-21T16:29:42.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:41 smithi170 ceph-mon[31212]: pgmap v11767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:42.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:41 smithi077 ceph-mon[27902]: pgmap v11767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:42.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:41 smithi191 ceph-mon[31636]: pgmap v11767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21893.733561 secs 2024-04-21T16:29:43.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21893.733561 secs 2024-04-21T16:29:43.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21893.733561 secs 2024-04-21T16:29:44.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:43 smithi170 ceph-mon[31212]: pgmap v11768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:43 smithi077 ceph-mon[27902]: pgmap v11768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:44.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:43 smithi191 ceph-mon[31636]: pgmap v11768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:45.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21895.494788 secs 2024-04-21T16:29:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21895.494788 secs 2024-04-21T16:29:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21895.494788 secs 2024-04-21T16:29:46.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:45 smithi077 ceph-mon[27902]: pgmap v11769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:46.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:45 smithi191 ceph-mon[31636]: pgmap v11769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:45 smithi170 ceph-mon[31212]: pgmap v11769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:47 smithi077 ceph-mon[27902]: pgmap v11770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:48.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21898.733704 secs 2024-04-21T16:29:48.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:47 smithi191 ceph-mon[31636]: pgmap v11770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:48.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21898.733704 secs 2024-04-21T16:29:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:47 smithi170 ceph-mon[31212]: pgmap v11770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21898.733704 secs 2024-04-21T16:29:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:49 smithi077 ceph-mon[27902]: pgmap v11771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:50.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21900.494869 secs 2024-04-21T16:29:50.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:49 smithi191 ceph-mon[31636]: pgmap v11771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:50.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21900.494869 secs 2024-04-21T16:29:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:49 smithi170 ceph-mon[31212]: pgmap v11771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21900.494869 secs 2024-04-21T16:29:52.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:51 smithi077 ceph-mon[27902]: pgmap v11772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:52.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:51 smithi191 ceph-mon[31636]: pgmap v11772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:51 smithi170 ceph-mon[31212]: pgmap v11772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:53.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21903.733807 secs 2024-04-21T16:29:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21903.733807 secs 2024-04-21T16:29:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21903.733807 secs 2024-04-21T16:29:54.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:53 smithi077 ceph-mon[27902]: pgmap v11773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:54.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:53 smithi191 ceph-mon[31636]: pgmap v11773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:54.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:53 smithi170 ceph-mon[31212]: pgmap v11773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:29:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21905.494997 secs 2024-04-21T16:29:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21905.494997 secs 2024-04-21T16:29:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21905.494997 secs 2024-04-21T16:29:56.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:55 smithi077 ceph-mon[27902]: pgmap v11774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:56.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:55 smithi191 ceph-mon[31636]: pgmap v11774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:56.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:55 smithi170 ceph-mon[31212]: pgmap v11774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:29:58.110 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:57 smithi170 ceph-mon[31212]: pgmap v11775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:58.111 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21908.733941 secs 2024-04-21T16:29:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:57 smithi077 ceph-mon[27902]: pgmap v11775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21908.733941 secs 2024-04-21T16:29:58.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:57 smithi191 ceph-mon[31636]: pgmap v11775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:29:58.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21908.733941 secs 2024-04-21T16:30:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:59 smithi077 ceph-mon[27902]: pgmap v11776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21910.495113 secs 2024-04-21T16:30:00.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:59 smithi191 ceph-mon[31636]: pgmap v11776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:00.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21910.495113 secs 2024-04-21T16:30:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:59 smithi170 ceph-mon[31212]: pgmap v11776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21910.495113 secs 2024-04-21T16:30:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:30:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:30:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:30:02.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:01 smithi077 ceph-mon[27902]: pgmap v11777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:02.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:01 smithi191 ceph-mon[31636]: pgmap v11777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:02.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:01 smithi170 ceph-mon[31212]: pgmap v11777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21913.734074 secs 2024-04-21T16:30:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21913.734074 secs 2024-04-21T16:30:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21913.734074 secs 2024-04-21T16:30:04.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:03 smithi077 ceph-mon[27902]: pgmap v11778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:03 smithi191 ceph-mon[31636]: pgmap v11778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:04.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:03 smithi170 ceph-mon[31212]: pgmap v11778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21915.495224 secs 2024-04-21T16:30:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:04 smithi077 ceph-mon[27902]: osdmap e808: 12 total, 12 up, 12 in 2024-04-21T16:30:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21915.495224 secs 2024-04-21T16:30:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:04 smithi191 ceph-mon[31636]: osdmap e808: 12 total, 12 up, 12 in 2024-04-21T16:30:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21915.495224 secs 2024-04-21T16:30:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:04 smithi170 ceph-mon[31212]: osdmap e808: 12 total, 12 up, 12 in 2024-04-21T16:30:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:05 smithi077 ceph-mon[27902]: pgmap v11780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:30:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:05 smithi191 ceph-mon[31636]: pgmap v11780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:30:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:05 smithi170 ceph-mon[31212]: pgmap v11780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:30:08.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:07 smithi077 ceph-mon[27902]: pgmap v11781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:30:08.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21918.734159 secs 2024-04-21T16:30:08.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:07 smithi191 ceph-mon[31636]: pgmap v11781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:30:08.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21918.734159 secs 2024-04-21T16:30:08.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:07 smithi170 ceph-mon[31212]: pgmap v11781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:30:08.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21918.734159 secs 2024-04-21T16:30:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:09 smithi077 ceph-mon[27902]: pgmap v11782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:30:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21920.495341 secs 2024-04-21T16:30:10.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:09 smithi191 ceph-mon[31636]: pgmap v11782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:30:10.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21920.495341 secs 2024-04-21T16:30:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:09 smithi170 ceph-mon[31212]: pgmap v11782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:30:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21920.495341 secs 2024-04-21T16:30:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:12 smithi077 ceph-mon[27902]: pgmap v11783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:30:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:12 smithi077 ceph-mon[27902]: osdmap e809: 12 total, 12 up, 12 in 2024-04-21T16:30:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:12 smithi191 ceph-mon[31636]: pgmap v11783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:30:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:12 smithi191 ceph-mon[31636]: osdmap e809: 12 total, 12 up, 12 in 2024-04-21T16:30:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:12 smithi170 ceph-mon[31212]: pgmap v11783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:30:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:12 smithi170 ceph-mon[31212]: osdmap e809: 12 total, 12 up, 12 in 2024-04-21T16:30:13.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21923.734274 secs 2024-04-21T16:30:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21923.734274 secs 2024-04-21T16:30:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21923.734274 secs 2024-04-21T16:30:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:14 smithi077 ceph-mon[27902]: pgmap v11785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T16:30:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:14 smithi191 ceph-mon[31636]: pgmap v11785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T16:30:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:14 smithi170 ceph-mon[31212]: pgmap v11785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T16:30:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21925.495417 secs 2024-04-21T16:30:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21925.495417 secs 2024-04-21T16:30:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21925.495417 secs 2024-04-21T16:30:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:16 smithi077 ceph-mon[27902]: pgmap v11786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:30:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:16 smithi191 ceph-mon[31636]: pgmap v11786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:30:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:16 smithi170 ceph-mon[31212]: pgmap v11786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:30:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:18 smithi077 ceph-mon[27902]: pgmap v11787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:30:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21928.734341 secs 2024-04-21T16:30:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:18 smithi191 ceph-mon[31636]: pgmap v11787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:30:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21928.734341 secs 2024-04-21T16:30:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:18 smithi170 ceph-mon[31212]: pgmap v11787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:30:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21928.734341 secs 2024-04-21T16:30:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:20 smithi077 ceph-mon[27902]: pgmap v11788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:30:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21930.495550 secs 2024-04-21T16:30:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:20 smithi191 ceph-mon[31636]: pgmap v11788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:30:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21930.495550 secs 2024-04-21T16:30:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:20 smithi170 ceph-mon[31212]: pgmap v11788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:30:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21930.495550 secs 2024-04-21T16:30:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:22 smithi191 ceph-mon[31636]: pgmap v11789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:30:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:22 smithi170 ceph-mon[31212]: pgmap v11789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:30:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:22 smithi077 ceph-mon[27902]: pgmap v11789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:30:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21933.734479 secs 2024-04-21T16:30:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21933.734479 secs 2024-04-21T16:30:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21933.734479 secs 2024-04-21T16:30:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:24 smithi191 ceph-mon[31636]: pgmap v11790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:30:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:24 smithi170 ceph-mon[31212]: pgmap v11790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:30:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:24 smithi077 ceph-mon[27902]: pgmap v11790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:30:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21935.495613 secs 2024-04-21T16:30:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21935.495613 secs 2024-04-21T16:30:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21935.495613 secs 2024-04-21T16:30:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:26 smithi191 ceph-mon[31636]: pgmap v11791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:26 smithi170 ceph-mon[31212]: pgmap v11791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:26 smithi077 ceph-mon[27902]: pgmap v11791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:28 smithi191 ceph-mon[31636]: pgmap v11792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21938.734633 secs 2024-04-21T16:30:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:28 smithi170 ceph-mon[31212]: pgmap v11792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21938.734633 secs 2024-04-21T16:30:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:28 smithi077 ceph-mon[27902]: pgmap v11792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21938.734633 secs 2024-04-21T16:30:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:30.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:30 smithi191 ceph-mon[31636]: pgmap v11793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21940.495732 secs 2024-04-21T16:30:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:30:30.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:30 smithi170 ceph-mon[31212]: pgmap v11793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21940.495732 secs 2024-04-21T16:30:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:30:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:30 smithi077 ceph-mon[27902]: pgmap v11793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21940.495732 secs 2024-04-21T16:30:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:30:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:30:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:30:31.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:30:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:30:31.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:31.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:30:31.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:30:31.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:30:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:32 smithi191 ceph-mon[31636]: pgmap v11794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:32 smithi170 ceph-mon[31212]: pgmap v11794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:32 smithi077 ceph-mon[27902]: pgmap v11794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21943.734785 secs 2024-04-21T16:30:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21943.734785 secs 2024-04-21T16:30:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21943.734785 secs 2024-04-21T16:30:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:34 smithi191 ceph-mon[31636]: pgmap v11795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:34 smithi170 ceph-mon[31212]: pgmap v11795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:34 smithi077 ceph-mon[27902]: pgmap v11795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21945.495862 secs 2024-04-21T16:30:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21945.495862 secs 2024-04-21T16:30:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21945.495862 secs 2024-04-21T16:30:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:36 smithi191 ceph-mon[31636]: pgmap v11796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:36 smithi170 ceph-mon[31212]: pgmap v11796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:36 smithi077 ceph-mon[27902]: pgmap v11796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:38 smithi191 ceph-mon[31636]: pgmap v11797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21948.734904 secs 2024-04-21T16:30:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:38 smithi170 ceph-mon[31212]: pgmap v11797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21948.734904 secs 2024-04-21T16:30:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:38 smithi077 ceph-mon[27902]: pgmap v11797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21948.734904 secs 2024-04-21T16:30:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:40 smithi191 ceph-mon[31636]: pgmap v11798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21950.495989 secs 2024-04-21T16:30:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:40 smithi170 ceph-mon[31212]: pgmap v11798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21950.495989 secs 2024-04-21T16:30:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:40 smithi077 ceph-mon[27902]: pgmap v11798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21950.495989 secs 2024-04-21T16:30:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:42 smithi191 ceph-mon[31636]: pgmap v11799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:42 smithi170 ceph-mon[31212]: pgmap v11799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:42 smithi077 ceph-mon[27902]: pgmap v11799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21953.735018 secs 2024-04-21T16:30:43.788 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21953.735018 secs 2024-04-21T16:30:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21953.735018 secs 2024-04-21T16:30:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:44 smithi191 ceph-mon[31636]: pgmap v11800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:44.803 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:44 smithi077 ceph-mon[27902]: pgmap v11800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:44 smithi170 ceph-mon[31212]: pgmap v11800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21955.496115 secs 2024-04-21T16:30:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21955.496115 secs 2024-04-21T16:30:45.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21955.496115 secs 2024-04-21T16:30:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:46 smithi191 ceph-mon[31636]: pgmap v11801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:46 smithi170 ceph-mon[31212]: pgmap v11801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:46 smithi077 ceph-mon[27902]: pgmap v11801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:48 smithi191 ceph-mon[31636]: pgmap v11802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21958.735096 secs 2024-04-21T16:30:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:48 smithi170 ceph-mon[31212]: pgmap v11802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21958.735096 secs 2024-04-21T16:30:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:48 smithi077 ceph-mon[27902]: pgmap v11802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21958.735096 secs 2024-04-21T16:30:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:50 smithi191 ceph-mon[31636]: pgmap v11803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21960.496229 secs 2024-04-21T16:30:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:50 smithi170 ceph-mon[31212]: pgmap v11803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21960.496229 secs 2024-04-21T16:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:50 smithi077 ceph-mon[27902]: pgmap v11803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21960.496229 secs 2024-04-21T16:30:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:52 smithi191 ceph-mon[31636]: pgmap v11804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:52 smithi170 ceph-mon[31212]: pgmap v11804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:52 smithi077 ceph-mon[27902]: pgmap v11804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21963.735211 secs 2024-04-21T16:30:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21963.735211 secs 2024-04-21T16:30:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21963.735211 secs 2024-04-21T16:30:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:54 smithi191 ceph-mon[31636]: pgmap v11805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:54 smithi170 ceph-mon[31212]: pgmap v11805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:54 smithi077 ceph-mon[27902]: pgmap v11805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:30:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21965.496337 secs 2024-04-21T16:30:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21965.496337 secs 2024-04-21T16:30:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21965.496337 secs 2024-04-21T16:30:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:56 smithi191 ceph-mon[31636]: pgmap v11806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:56 smithi170 ceph-mon[31212]: pgmap v11806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:56 smithi077 ceph-mon[27902]: pgmap v11806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:58 smithi170 ceph-mon[31212]: pgmap v11807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21968.735275 secs 2024-04-21T16:30:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:58 smithi077 ceph-mon[27902]: pgmap v11807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21968.735275 secs 2024-04-21T16:30:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:58 smithi191 ceph-mon[31636]: pgmap v11807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:30:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21968.735275 secs 2024-04-21T16:30:59.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:59 smithi170 ceph-mon[31212]: pgmap v11808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:59.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21970.496473 secs 2024-04-21T16:30:59.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:59 smithi077 ceph-mon[27902]: pgmap v11808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:59.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21970.496473 secs 2024-04-21T16:30:59.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:59 smithi191 ceph-mon[31636]: pgmap v11808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:30:59.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21970.496473 secs 2024-04-21T16:31:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:01.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:01 smithi077 ceph-mon[27902]: pgmap v11809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T16:31:01.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:01 smithi191 ceph-mon[31636]: pgmap v11809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T16:31:02.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:01 smithi170 ceph-mon[31212]: pgmap v11809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T16:31:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21973.735395 secs 2024-04-21T16:31:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:03 smithi077 ceph-mon[27902]: pgmap v11810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:31:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21973.735395 secs 2024-04-21T16:31:03.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:03 smithi191 ceph-mon[31636]: pgmap v11810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:31:04.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21973.735395 secs 2024-04-21T16:31:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:03 smithi170 ceph-mon[31212]: pgmap v11810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:31:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21975.496606 secs 2024-04-21T16:31:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21975.496606 secs 2024-04-21T16:31:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21975.496606 secs 2024-04-21T16:31:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:05 smithi077 ceph-mon[27902]: pgmap v11811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:31:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:05 smithi077 ceph-mon[27902]: osdmap e810: 12 total, 12 up, 12 in 2024-04-21T16:31:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:05 smithi191 ceph-mon[31636]: pgmap v11811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:31:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:05 smithi191 ceph-mon[31636]: osdmap e810: 12 total, 12 up, 12 in 2024-04-21T16:31:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:05 smithi170 ceph-mon[31212]: pgmap v11811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:31:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:05 smithi170 ceph-mon[31212]: osdmap e810: 12 total, 12 up, 12 in 2024-04-21T16:31:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:07 smithi077 ceph-mon[27902]: pgmap v11813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:31:07.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:07 smithi191 ceph-mon[31636]: pgmap v11813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:31:08.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:07 smithi170 ceph-mon[31212]: pgmap v11813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:31:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21978.735548 secs 2024-04-21T16:31:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21978.735548 secs 2024-04-21T16:31:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21978.735548 secs 2024-04-21T16:31:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:09 smithi077 ceph-mon[27902]: pgmap v11814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:31:09.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21980.496726 secs 2024-04-21T16:31:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:09 smithi191 ceph-mon[31636]: pgmap v11814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:31:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21980.496726 secs 2024-04-21T16:31:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:09 smithi170 ceph-mon[31212]: pgmap v11814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:31:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21980.496726 secs 2024-04-21T16:31:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:12 smithi077 ceph-mon[27902]: pgmap v11815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:31:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:12 smithi077 ceph-mon[27902]: osdmap e811: 12 total, 12 up, 12 in 2024-04-21T16:31:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:12 smithi191 ceph-mon[31636]: pgmap v11815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:31:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:12 smithi191 ceph-mon[31636]: osdmap e811: 12 total, 12 up, 12 in 2024-04-21T16:31:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:12 smithi170 ceph-mon[31212]: pgmap v11815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:31:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:12 smithi170 ceph-mon[31212]: osdmap e811: 12 total, 12 up, 12 in 2024-04-21T16:31:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21983.735667 secs 2024-04-21T16:31:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21983.735667 secs 2024-04-21T16:31:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21983.735667 secs 2024-04-21T16:31:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:14 smithi191 ceph-mon[31636]: pgmap v11817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T16:31:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:14 smithi170 ceph-mon[31212]: pgmap v11817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T16:31:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:14 smithi077 ceph-mon[27902]: pgmap v11817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-04-21T16:31:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21985.496819 secs 2024-04-21T16:31:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21985.496819 secs 2024-04-21T16:31:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21985.496819 secs 2024-04-21T16:31:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:16 smithi191 ceph-mon[31636]: pgmap v11818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:31:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:16 smithi170 ceph-mon[31212]: pgmap v11818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:31:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:16 smithi077 ceph-mon[27902]: pgmap v11818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T16:31:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:18 smithi191 ceph-mon[31636]: pgmap v11819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:31:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21988.735770 secs 2024-04-21T16:31:18.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:18 smithi170 ceph-mon[31212]: pgmap v11819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:31:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21988.735770 secs 2024-04-21T16:31:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:18 smithi077 ceph-mon[27902]: pgmap v11819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:31:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21988.735770 secs 2024-04-21T16:31:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:20 smithi191 ceph-mon[31636]: pgmap v11820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:31:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21990.496919 secs 2024-04-21T16:31:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:20 smithi170 ceph-mon[31212]: pgmap v11820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:31:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21990.496919 secs 2024-04-21T16:31:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:20 smithi077 ceph-mon[27902]: pgmap v11820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:31:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21990.496919 secs 2024-04-21T16:31:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:22 smithi191 ceph-mon[31636]: pgmap v11821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:31:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:22 smithi170 ceph-mon[31212]: pgmap v11821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:31:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:22 smithi077 ceph-mon[27902]: pgmap v11821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:31:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21993.735885 secs 2024-04-21T16:31:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21993.735885 secs 2024-04-21T16:31:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21993.735885 secs 2024-04-21T16:31:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:24 smithi191 ceph-mon[31636]: pgmap v11822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:31:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:24 smithi170 ceph-mon[31212]: pgmap v11822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:31:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:24 smithi077 ceph-mon[27902]: pgmap v11822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:31:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 21995.497035 secs 2024-04-21T16:31:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 21995.497035 secs 2024-04-21T16:31:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 21995.497035 secs 2024-04-21T16:31:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:26 smithi191 ceph-mon[31636]: pgmap v11823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:26 smithi170 ceph-mon[31212]: pgmap v11823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:26 smithi077 ceph-mon[27902]: pgmap v11823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:28 smithi191 ceph-mon[31636]: pgmap v11824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 21998.736000 secs 2024-04-21T16:31:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:28 smithi170 ceph-mon[31212]: pgmap v11824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 21998.736000 secs 2024-04-21T16:31:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:28 smithi077 ceph-mon[27902]: pgmap v11824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 21998.736000 secs 2024-04-21T16:31:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:30.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:30 smithi191 ceph-mon[31636]: pgmap v11825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:30.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22000.497150 secs 2024-04-21T16:31:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:30 smithi170 ceph-mon[31212]: pgmap v11825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22000.497150 secs 2024-04-21T16:31:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:30 smithi077 ceph-mon[27902]: pgmap v11825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22000.497150 secs 2024-04-21T16:31:32.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:32 smithi191 ceph-mon[31636]: pgmap v11826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:31:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:32 smithi170 ceph-mon[31212]: pgmap v11826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:31:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:32 smithi077 ceph-mon[27902]: pgmap v11826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:31:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22003.736066 secs 2024-04-21T16:31:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:31:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:31:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22003.736066 secs 2024-04-21T16:31:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:31:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:31:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22003.736066 secs 2024-04-21T16:31:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:31:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:31:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:31:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:34 smithi077 ceph-mon[27902]: pgmap v11827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:34 smithi191 ceph-mon[31636]: pgmap v11827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:34 smithi170 ceph-mon[31212]: pgmap v11827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22005.497218 secs 2024-04-21T16:31:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22005.497218 secs 2024-04-21T16:31:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22005.497218 secs 2024-04-21T16:31:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:36 smithi191 ceph-mon[31636]: pgmap v11828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:36 smithi170 ceph-mon[31212]: pgmap v11828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:36 smithi077 ceph-mon[27902]: pgmap v11828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:38 smithi191 ceph-mon[31636]: pgmap v11829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22008.736186 secs 2024-04-21T16:31:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:38 smithi170 ceph-mon[31212]: pgmap v11829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22008.736186 secs 2024-04-21T16:31:38.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:38 smithi077 ceph-mon[27902]: pgmap v11829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22008.736186 secs 2024-04-21T16:31:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:40 smithi191 ceph-mon[31636]: pgmap v11830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22010.497332 secs 2024-04-21T16:31:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:40 smithi170 ceph-mon[31212]: pgmap v11830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22010.497332 secs 2024-04-21T16:31:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:40 smithi077 ceph-mon[27902]: pgmap v11830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22010.497332 secs 2024-04-21T16:31:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:42 smithi191 ceph-mon[31636]: pgmap v11831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:42 smithi170 ceph-mon[31212]: pgmap v11831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:42 smithi077 ceph-mon[27902]: pgmap v11831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22013.736260 secs 2024-04-21T16:31:43.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22013.736260 secs 2024-04-21T16:31:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22013.736260 secs 2024-04-21T16:31:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:44 smithi191 ceph-mon[31636]: pgmap v11832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:44 smithi170 ceph-mon[31212]: pgmap v11832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:44 smithi077 ceph-mon[27902]: pgmap v11832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22015.497430 secs 2024-04-21T16:31:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22015.497430 secs 2024-04-21T16:31:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22015.497430 secs 2024-04-21T16:31:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:46 smithi191 ceph-mon[31636]: pgmap v11833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:46 smithi170 ceph-mon[31212]: pgmap v11833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:46.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:46 smithi077 ceph-mon[27902]: pgmap v11833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:48 smithi191 ceph-mon[31636]: pgmap v11834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22018.736374 secs 2024-04-21T16:31:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:48 smithi170 ceph-mon[31212]: pgmap v11834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22018.736374 secs 2024-04-21T16:31:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:48 smithi077 ceph-mon[27902]: pgmap v11834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22018.736374 secs 2024-04-21T16:31:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:50 smithi191 ceph-mon[31636]: pgmap v11835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22020.497551 secs 2024-04-21T16:31:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:50 smithi170 ceph-mon[31212]: pgmap v11835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22020.497551 secs 2024-04-21T16:31:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:50 smithi077 ceph-mon[27902]: pgmap v11835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22020.497551 secs 2024-04-21T16:31:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:52 smithi191 ceph-mon[31636]: pgmap v11836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:52 smithi170 ceph-mon[31212]: pgmap v11836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:52 smithi077 ceph-mon[27902]: pgmap v11836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22023.736490 secs 2024-04-21T16:31:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22023.736490 secs 2024-04-21T16:31:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22023.736490 secs 2024-04-21T16:31:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:54 smithi191 ceph-mon[31636]: pgmap v11837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:54 smithi170 ceph-mon[31212]: pgmap v11837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:54 smithi077 ceph-mon[27902]: pgmap v11837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:31:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22025.497654 secs 2024-04-21T16:31:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22025.497654 secs 2024-04-21T16:31:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22025.497654 secs 2024-04-21T16:31:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:56 smithi191 ceph-mon[31636]: pgmap v11838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:56 smithi170 ceph-mon[31212]: pgmap v11838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:56 smithi077 ceph-mon[27902]: pgmap v11838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:31:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.397+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:31:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.397+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:31:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.398+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T16:31:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.398+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:31:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.398+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T16:31:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.398+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:31:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.398+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:31:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:31:57.398+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:31:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:58 smithi191 ceph-mon[31636]: pgmap v11839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:31:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22028.736625 secs 2024-04-21T16:31:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:58 smithi170 ceph-mon[31212]: pgmap v11839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:31:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22028.736625 secs 2024-04-21T16:31:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:58 smithi077 ceph-mon[27902]: pgmap v11839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:31:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:31:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22028.736625 secs 2024-04-21T16:32:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:00 smithi191 ceph-mon[31636]: pgmap v11840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22030.497797 secs 2024-04-21T16:32:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:00 smithi170 ceph-mon[31212]: pgmap v11840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22030.497797 secs 2024-04-21T16:32:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:00 smithi077 ceph-mon[27902]: pgmap v11840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22030.497797 secs 2024-04-21T16:32:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:02 smithi191 ceph-mon[31636]: pgmap v11841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T16:32:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:02 smithi170 ceph-mon[31212]: pgmap v11841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T16:32:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:02 smithi077 ceph-mon[27902]: pgmap v11841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T16:32:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22033.736740 secs 2024-04-21T16:32:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22033.736740 secs 2024-04-21T16:32:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22033.736740 secs 2024-04-21T16:32:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:04 smithi191 ceph-mon[31636]: pgmap v11842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T16:32:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:04 smithi170 ceph-mon[31212]: pgmap v11842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T16:32:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:04 smithi077 ceph-mon[27902]: pgmap v11842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T16:32:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22035.497925 secs 2024-04-21T16:32:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:05 smithi170 ceph-mon[31212]: osdmap e812: 12 total, 12 up, 12 in 2024-04-21T16:32:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22035.497925 secs 2024-04-21T16:32:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:05 smithi077 ceph-mon[27902]: osdmap e812: 12 total, 12 up, 12 in 2024-04-21T16:32:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22035.497925 secs 2024-04-21T16:32:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:05 smithi191 ceph-mon[31636]: osdmap e812: 12 total, 12 up, 12 in 2024-04-21T16:32:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:06 smithi170 ceph-mon[31212]: pgmap v11844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-21T16:32:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:06 smithi077 ceph-mon[27902]: pgmap v11844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-21T16:32:06.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:06 smithi191 ceph-mon[31636]: pgmap v11844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-21T16:32:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:08 smithi170 ceph-mon[31212]: pgmap v11845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:32:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22038.736856 secs 2024-04-21T16:32:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:08 smithi077 ceph-mon[27902]: pgmap v11845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:32:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22038.736856 secs 2024-04-21T16:32:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:08 smithi191 ceph-mon[31636]: pgmap v11845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:32:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22038.736856 secs 2024-04-21T16:32:09.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22040.497995 secs 2024-04-21T16:32:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22040.497995 secs 2024-04-21T16:32:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22040.497995 secs 2024-04-21T16:32:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:10 smithi170 ceph-mon[31212]: pgmap v11846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:32:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:10 smithi077 ceph-mon[27902]: pgmap v11846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:32:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:10 smithi191 ceph-mon[31636]: pgmap v11846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:32:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:12 smithi191 ceph-mon[31636]: pgmap v11847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T16:32:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:12 smithi191 ceph-mon[31636]: osdmap e813: 12 total, 12 up, 12 in 2024-04-21T16:32:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:12 smithi170 ceph-mon[31212]: pgmap v11847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T16:32:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:12 smithi170 ceph-mon[31212]: osdmap e813: 12 total, 12 up, 12 in 2024-04-21T16:32:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:12 smithi077 ceph-mon[27902]: pgmap v11847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T16:32:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:12 smithi077 ceph-mon[27902]: osdmap e813: 12 total, 12 up, 12 in 2024-04-21T16:32:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22043.736977 secs 2024-04-21T16:32:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22043.736977 secs 2024-04-21T16:32:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22043.736977 secs 2024-04-21T16:32:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:14 smithi191 ceph-mon[31636]: pgmap v11849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T16:32:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:14 smithi170 ceph-mon[31212]: pgmap v11849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T16:32:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:14 smithi077 ceph-mon[27902]: pgmap v11849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 31 op/s 2024-04-21T16:32:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22045.498092 secs 2024-04-21T16:32:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22045.498092 secs 2024-04-21T16:32:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22045.498092 secs 2024-04-21T16:32:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:16 smithi191 ceph-mon[31636]: pgmap v11850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T16:32:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:16 smithi170 ceph-mon[31212]: pgmap v11850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T16:32:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:16 smithi077 ceph-mon[27902]: pgmap v11850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T16:32:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:18 smithi191 ceph-mon[31636]: pgmap v11851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:32:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22048.737092 secs 2024-04-21T16:32:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:18 smithi170 ceph-mon[31212]: pgmap v11851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:32:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22048.737092 secs 2024-04-21T16:32:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:18 smithi077 ceph-mon[27902]: pgmap v11851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:32:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22048.737092 secs 2024-04-21T16:32:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:20 smithi191 ceph-mon[31636]: pgmap v11852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:32:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22050.498210 secs 2024-04-21T16:32:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:20 smithi170 ceph-mon[31212]: pgmap v11852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:32:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22050.498210 secs 2024-04-21T16:32:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:20 smithi077 ceph-mon[27902]: pgmap v11852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:32:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22050.498210 secs 2024-04-21T16:32:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:22 smithi191 ceph-mon[31636]: pgmap v11853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:32:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:22 smithi170 ceph-mon[31212]: pgmap v11853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:32:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:22 smithi077 ceph-mon[27902]: pgmap v11853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:32:23.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22053.737179 secs 2024-04-21T16:32:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22053.737179 secs 2024-04-21T16:32:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22053.737179 secs 2024-04-21T16:32:24.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:24 smithi191 ceph-mon[31636]: pgmap v11854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:32:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:24 smithi170 ceph-mon[31212]: pgmap v11854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:32:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:24 smithi077 ceph-mon[27902]: pgmap v11854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:32:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22055.498333 secs 2024-04-21T16:32:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22055.498333 secs 2024-04-21T16:32:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22055.498333 secs 2024-04-21T16:32:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:26 smithi191 ceph-mon[31636]: pgmap v11855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:26 smithi170 ceph-mon[31212]: pgmap v11855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:26 smithi077 ceph-mon[27902]: pgmap v11855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:28 smithi191 ceph-mon[31636]: pgmap v11856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22058.737316 secs 2024-04-21T16:32:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:28 smithi170 ceph-mon[31212]: pgmap v11856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22058.737316 secs 2024-04-21T16:32:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:28 smithi077 ceph-mon[27902]: pgmap v11856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22058.737316 secs 2024-04-21T16:32:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:30 smithi191 ceph-mon[31636]: pgmap v11857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22060.498413 secs 2024-04-21T16:32:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:30 smithi170 ceph-mon[31212]: pgmap v11857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22060.498413 secs 2024-04-21T16:32:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:30 smithi077 ceph-mon[27902]: pgmap v11857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22060.498413 secs 2024-04-21T16:32:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:32 smithi191 ceph-mon[31636]: pgmap v11858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:32 smithi170 ceph-mon[31212]: pgmap v11858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:32 smithi077 ceph-mon[27902]: pgmap v11858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22063.737384 secs 2024-04-21T16:32:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:32:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:32:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:32:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:32:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22063.737384 secs 2024-04-21T16:32:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:32:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:32:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:32:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:32:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22063.737384 secs 2024-04-21T16:32:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:32:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:32:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:32:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:32:34.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:34 smithi191 ceph-mon[31636]: pgmap v11859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:34 smithi170 ceph-mon[31212]: pgmap v11859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:34 smithi077 ceph-mon[27902]: pgmap v11859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22065.498554 secs 2024-04-21T16:32:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22065.498554 secs 2024-04-21T16:32:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22065.498554 secs 2024-04-21T16:32:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:36 smithi191 ceph-mon[31636]: pgmap v11860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:36 smithi170 ceph-mon[31212]: pgmap v11860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:36 smithi077 ceph-mon[27902]: pgmap v11860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:38 smithi191 ceph-mon[31636]: pgmap v11861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22068.737523 secs 2024-04-21T16:32:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:38 smithi170 ceph-mon[31212]: pgmap v11861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22068.737523 secs 2024-04-21T16:32:38.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:38 smithi077 ceph-mon[27902]: pgmap v11861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:38.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22068.737523 secs 2024-04-21T16:32:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:40 smithi170 ceph-mon[31212]: pgmap v11862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22070.498689 secs 2024-04-21T16:32:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:40 smithi077 ceph-mon[27902]: pgmap v11862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22070.498689 secs 2024-04-21T16:32:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:40 smithi191 ceph-mon[31636]: pgmap v11862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22070.498689 secs 2024-04-21T16:32:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:42 smithi170 ceph-mon[31212]: pgmap v11863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:42 smithi077 ceph-mon[27902]: pgmap v11863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:42 smithi191 ceph-mon[31636]: pgmap v11863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:43.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22073.737642 secs 2024-04-21T16:32:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22073.737642 secs 2024-04-21T16:32:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22073.737642 secs 2024-04-21T16:32:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:44 smithi170 ceph-mon[31212]: pgmap v11864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:44 smithi077 ceph-mon[27902]: pgmap v11864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:44 smithi191 ceph-mon[31636]: pgmap v11864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22075.498802 secs 2024-04-21T16:32:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22075.498802 secs 2024-04-21T16:32:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22075.498802 secs 2024-04-21T16:32:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:46 smithi170 ceph-mon[31212]: pgmap v11865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:46 smithi077 ceph-mon[27902]: pgmap v11865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:46 smithi191 ceph-mon[31636]: pgmap v11865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:48 smithi170 ceph-mon[31212]: pgmap v11866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22078.737799 secs 2024-04-21T16:32:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:48 smithi077 ceph-mon[27902]: pgmap v11866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22078.737799 secs 2024-04-21T16:32:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:48 smithi191 ceph-mon[31636]: pgmap v11866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22078.737799 secs 2024-04-21T16:32:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:50 smithi170 ceph-mon[31212]: pgmap v11867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22080.498910 secs 2024-04-21T16:32:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:50 smithi077 ceph-mon[27902]: pgmap v11867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22080.498910 secs 2024-04-21T16:32:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:50 smithi191 ceph-mon[31636]: pgmap v11867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22080.498910 secs 2024-04-21T16:32:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:52 smithi170 ceph-mon[31212]: pgmap v11868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:52 smithi077 ceph-mon[27902]: pgmap v11868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:52 smithi191 ceph-mon[31636]: pgmap v11868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22083.737834 secs 2024-04-21T16:32:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22083.737834 secs 2024-04-21T16:32:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22083.737834 secs 2024-04-21T16:32:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:54 smithi170 ceph-mon[31212]: pgmap v11869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:54 smithi077 ceph-mon[27902]: pgmap v11869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:54 smithi191 ceph-mon[31636]: pgmap v11869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:32:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22085.498976 secs 2024-04-21T16:32:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22085.498976 secs 2024-04-21T16:32:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22085.498976 secs 2024-04-21T16:32:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:56 smithi170 ceph-mon[31212]: pgmap v11870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:56 smithi077 ceph-mon[27902]: pgmap v11870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:56 smithi191 ceph-mon[31636]: pgmap v11870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:32:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:58 smithi170 ceph-mon[31212]: pgmap v11871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:32:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22088.737914 secs 2024-04-21T16:32:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:58 smithi077 ceph-mon[27902]: pgmap v11871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:32:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22088.737914 secs 2024-04-21T16:32:58.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:58 smithi191 ceph-mon[31636]: pgmap v11871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:32:58.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:32:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22088.737914 secs 2024-04-21T16:33:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:00 smithi170 ceph-mon[31212]: pgmap v11872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22090.499054 secs 2024-04-21T16:33:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:00 smithi077 ceph-mon[27902]: pgmap v11872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22090.499054 secs 2024-04-21T16:33:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:00 smithi191 ceph-mon[31636]: pgmap v11872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22090.499054 secs 2024-04-21T16:33:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:02 smithi170 ceph-mon[31212]: pgmap v11873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:02 smithi077 ceph-mon[27902]: pgmap v11873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:02 smithi191 ceph-mon[31636]: pgmap v11873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22093.738039 secs 2024-04-21T16:33:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22093.738039 secs 2024-04-21T16:33:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22093.738039 secs 2024-04-21T16:33:04.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:04 smithi170 ceph-mon[31212]: pgmap v11874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:04 smithi077 ceph-mon[27902]: pgmap v11874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:04 smithi191 ceph-mon[31636]: pgmap v11874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22095.499172 secs 2024-04-21T16:33:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:05 smithi170 ceph-mon[31212]: osdmap e814: 12 total, 12 up, 12 in 2024-04-21T16:33:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22095.499172 secs 2024-04-21T16:33:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:05 smithi077 ceph-mon[27902]: osdmap e814: 12 total, 12 up, 12 in 2024-04-21T16:33:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22095.499172 secs 2024-04-21T16:33:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:05 smithi191 ceph-mon[31636]: osdmap e814: 12 total, 12 up, 12 in 2024-04-21T16:33:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:06 smithi170 ceph-mon[31212]: pgmap v11876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:33:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:06 smithi077 ceph-mon[27902]: pgmap v11876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:33:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:06 smithi191 ceph-mon[31636]: pgmap v11876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:33:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:08 smithi170 ceph-mon[31212]: pgmap v11877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:33:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22098.738137 secs 2024-04-21T16:33:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:08 smithi077 ceph-mon[27902]: pgmap v11877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:33:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22098.738137 secs 2024-04-21T16:33:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:08 smithi191 ceph-mon[31636]: pgmap v11877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:33:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22098.738137 secs 2024-04-21T16:33:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:10 smithi077 ceph-mon[27902]: pgmap v11878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:33:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22100.499266 secs 2024-04-21T16:33:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:10 smithi191 ceph-mon[31636]: pgmap v11878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:33:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22100.499266 secs 2024-04-21T16:33:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:10 smithi170 ceph-mon[31212]: pgmap v11878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:33:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22100.499266 secs 2024-04-21T16:33:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:12 smithi191 ceph-mon[31636]: pgmap v11879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:33:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:12 smithi191 ceph-mon[31636]: osdmap e815: 12 total, 12 up, 12 in 2024-04-21T16:33:12.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:12 smithi170 ceph-mon[31212]: pgmap v11879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:33:12.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:12 smithi170 ceph-mon[31212]: osdmap e815: 12 total, 12 up, 12 in 2024-04-21T16:33:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:12 smithi077 ceph-mon[27902]: pgmap v11879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:33:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:12 smithi077 ceph-mon[27902]: osdmap e815: 12 total, 12 up, 12 in 2024-04-21T16:33:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22103.738199 secs 2024-04-21T16:33:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22103.738199 secs 2024-04-21T16:33:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22103.738199 secs 2024-04-21T16:33:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:14 smithi191 ceph-mon[31636]: pgmap v11881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:33:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:14 smithi170 ceph-mon[31212]: pgmap v11881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:33:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:14 smithi077 ceph-mon[27902]: pgmap v11881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:33:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22105.499362 secs 2024-04-21T16:33:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22105.499362 secs 2024-04-21T16:33:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22105.499362 secs 2024-04-21T16:33:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:16 smithi191 ceph-mon[31636]: pgmap v11882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:33:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:16 smithi170 ceph-mon[31212]: pgmap v11882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:33:16.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:16 smithi077 ceph-mon[27902]: pgmap v11882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:33:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:18 smithi191 ceph-mon[31636]: pgmap v11883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:33:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22108.738308 secs 2024-04-21T16:33:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:18 smithi170 ceph-mon[31212]: pgmap v11883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:33:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22108.738308 secs 2024-04-21T16:33:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:18 smithi077 ceph-mon[27902]: pgmap v11883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:33:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22108.738308 secs 2024-04-21T16:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:20 smithi191 ceph-mon[31636]: pgmap v11884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:33:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22110.499475 secs 2024-04-21T16:33:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:20 smithi170 ceph-mon[31212]: pgmap v11884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:33:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22110.499475 secs 2024-04-21T16:33:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:20 smithi077 ceph-mon[27902]: pgmap v11884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:33:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22110.499475 secs 2024-04-21T16:33:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:22 smithi191 ceph-mon[31636]: pgmap v11885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:33:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:22 smithi170 ceph-mon[31212]: pgmap v11885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:33:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:22 smithi077 ceph-mon[27902]: pgmap v11885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:33:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22113.738431 secs 2024-04-21T16:33:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22113.738431 secs 2024-04-21T16:33:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22113.738431 secs 2024-04-21T16:33:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:24 smithi191 ceph-mon[31636]: pgmap v11886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:33:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:24 smithi170 ceph-mon[31212]: pgmap v11886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:33:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:24 smithi077 ceph-mon[27902]: pgmap v11886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:33:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:25.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22115.499595 secs 2024-04-21T16:33:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22115.499595 secs 2024-04-21T16:33:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22115.499595 secs 2024-04-21T16:33:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:26 smithi191 ceph-mon[31636]: pgmap v11887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:26 smithi170 ceph-mon[31212]: pgmap v11887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:26.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:26 smithi077 ceph-mon[27902]: pgmap v11887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:28 smithi191 ceph-mon[31636]: pgmap v11888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22118.738560 secs 2024-04-21T16:33:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:28 smithi170 ceph-mon[31212]: pgmap v11888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22118.738560 secs 2024-04-21T16:33:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:28 smithi077 ceph-mon[27902]: pgmap v11888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22118.738560 secs 2024-04-21T16:33:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:30 smithi191 ceph-mon[31636]: pgmap v11889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22120.499707 secs 2024-04-21T16:33:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:30 smithi170 ceph-mon[31212]: pgmap v11889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22120.499707 secs 2024-04-21T16:33:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:30 smithi077 ceph-mon[27902]: pgmap v11889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22120.499707 secs 2024-04-21T16:33:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:32 smithi191 ceph-mon[31636]: pgmap v11890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:32 smithi170 ceph-mon[31212]: pgmap v11890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:32 smithi077 ceph-mon[27902]: pgmap v11890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22123.738659 secs 2024-04-21T16:33:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22123.738659 secs 2024-04-21T16:33:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22123.738659 secs 2024-04-21T16:33:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:34 smithi170 ceph-mon[31212]: pgmap v11891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:33:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:33:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:33:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:33:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:34 smithi077 ceph-mon[27902]: pgmap v11891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:33:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:33:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:33:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:33:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:34 smithi191 ceph-mon[31636]: pgmap v11891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:33:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:33:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:33:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:33:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22125.499791 secs 2024-04-21T16:33:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22125.499791 secs 2024-04-21T16:33:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22125.499791 secs 2024-04-21T16:33:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:36 smithi170 ceph-mon[31212]: pgmap v11892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:36 smithi077 ceph-mon[27902]: pgmap v11892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:36 smithi191 ceph-mon[31636]: pgmap v11892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:38 smithi170 ceph-mon[31212]: pgmap v11893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22128.738786 secs 2024-04-21T16:33:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:38 smithi077 ceph-mon[27902]: pgmap v11893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22128.738786 secs 2024-04-21T16:33:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:38 smithi191 ceph-mon[31636]: pgmap v11893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22128.738786 secs 2024-04-21T16:33:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:40 smithi170 ceph-mon[31212]: pgmap v11894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22130.499913 secs 2024-04-21T16:33:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:40 smithi077 ceph-mon[27902]: pgmap v11894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22130.499913 secs 2024-04-21T16:33:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:40 smithi191 ceph-mon[31636]: pgmap v11894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22130.499913 secs 2024-04-21T16:33:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:42 smithi170 ceph-mon[31212]: pgmap v11895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:42 smithi077 ceph-mon[27902]: pgmap v11895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:42 smithi191 ceph-mon[31636]: pgmap v11895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:43.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22133.738884 secs 2024-04-21T16:33:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22133.738884 secs 2024-04-21T16:33:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22133.738884 secs 2024-04-21T16:33:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:44 smithi170 ceph-mon[31212]: pgmap v11896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:44 smithi077 ceph-mon[27902]: pgmap v11896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:44 smithi191 ceph-mon[31636]: pgmap v11896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22135.500028 secs 2024-04-21T16:33:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22135.500028 secs 2024-04-21T16:33:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22135.500028 secs 2024-04-21T16:33:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:46 smithi170 ceph-mon[31212]: pgmap v11897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:46 smithi077 ceph-mon[27902]: pgmap v11897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:46 smithi191 ceph-mon[31636]: pgmap v11897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:48 smithi170 ceph-mon[31212]: pgmap v11898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22138.738947 secs 2024-04-21T16:33:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:48 smithi077 ceph-mon[27902]: pgmap v11898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22138.738947 secs 2024-04-21T16:33:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:48 smithi191 ceph-mon[31636]: pgmap v11898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22138.738947 secs 2024-04-21T16:33:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:50 smithi170 ceph-mon[31212]: pgmap v11899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22140.500169 secs 2024-04-21T16:33:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:50 smithi077 ceph-mon[27902]: pgmap v11899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22140.500169 secs 2024-04-21T16:33:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:50 smithi191 ceph-mon[31636]: pgmap v11899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22140.500169 secs 2024-04-21T16:33:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:52 smithi170 ceph-mon[31212]: pgmap v11900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:52 smithi077 ceph-mon[27902]: pgmap v11900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:52 smithi191 ceph-mon[31636]: pgmap v11900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22143.739055 secs 2024-04-21T16:33:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22143.739055 secs 2024-04-21T16:33:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22143.739055 secs 2024-04-21T16:33:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:54 smithi170 ceph-mon[31212]: pgmap v11901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:54 smithi077 ceph-mon[27902]: pgmap v11901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:54 smithi191 ceph-mon[31636]: pgmap v11901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:33:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22145.500274 secs 2024-04-21T16:33:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22145.500274 secs 2024-04-21T16:33:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22145.500274 secs 2024-04-21T16:33:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:56 smithi170 ceph-mon[31212]: pgmap v11902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:56 smithi077 ceph-mon[27902]: pgmap v11902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:56 smithi191 ceph-mon[31636]: pgmap v11902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:33:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:58 smithi170 ceph-mon[31212]: pgmap v11903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:33:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22148.739114 secs 2024-04-21T16:33:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:58 smithi077 ceph-mon[27902]: pgmap v11903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:33:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22148.739114 secs 2024-04-21T16:33:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:58 smithi191 ceph-mon[31636]: pgmap v11903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:33:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:33:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22148.739114 secs 2024-04-21T16:34:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:00 smithi170 ceph-mon[31212]: pgmap v11904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:34:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22150.500394 secs 2024-04-21T16:34:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:00 smithi077 ceph-mon[27902]: pgmap v11904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:34:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22150.500394 secs 2024-04-21T16:34:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:00 smithi191 ceph-mon[31636]: pgmap v11904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:34:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22150.500394 secs 2024-04-21T16:34:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:02 smithi170 ceph-mon[31212]: pgmap v11905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:02 smithi077 ceph-mon[27902]: pgmap v11905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:02 smithi191 ceph-mon[31636]: pgmap v11905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22153.739235 secs 2024-04-21T16:34:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22153.739235 secs 2024-04-21T16:34:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22153.739235 secs 2024-04-21T16:34:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:04 smithi170 ceph-mon[31212]: pgmap v11906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:34:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:04 smithi077 ceph-mon[27902]: pgmap v11906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:34:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:04 smithi191 ceph-mon[31636]: pgmap v11906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:34:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22155.500511 secs 2024-04-21T16:34:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:05 smithi077 ceph-mon[27902]: osdmap e816: 12 total, 12 up, 12 in 2024-04-21T16:34:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22155.500511 secs 2024-04-21T16:34:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:05 smithi191 ceph-mon[31636]: osdmap e816: 12 total, 12 up, 12 in 2024-04-21T16:34:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22155.500511 secs 2024-04-21T16:34:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:05 smithi170 ceph-mon[31212]: osdmap e816: 12 total, 12 up, 12 in 2024-04-21T16:34:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:06 smithi077 ceph-mon[27902]: pgmap v11908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:34:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:06 smithi191 ceph-mon[31636]: pgmap v11908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:34:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:06 smithi170 ceph-mon[31212]: pgmap v11908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:34:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:08 smithi077 ceph-mon[27902]: pgmap v11909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:34:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22158.739352 secs 2024-04-21T16:34:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:08 smithi191 ceph-mon[31636]: pgmap v11909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:34:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22158.739352 secs 2024-04-21T16:34:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:08 smithi170 ceph-mon[31212]: pgmap v11909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:34:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22158.739352 secs 2024-04-21T16:34:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:10 smithi077 ceph-mon[27902]: pgmap v11910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:34:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22160.500645 secs 2024-04-21T16:34:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:10 smithi191 ceph-mon[31636]: pgmap v11910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:34:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22160.500645 secs 2024-04-21T16:34:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:10 smithi170 ceph-mon[31212]: pgmap v11910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:34:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22160.500645 secs 2024-04-21T16:34:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:12 smithi191 ceph-mon[31636]: pgmap v11911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:34:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:12 smithi191 ceph-mon[31636]: osdmap e817: 12 total, 12 up, 12 in 2024-04-21T16:34:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:12 smithi170 ceph-mon[31212]: pgmap v11911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:34:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:12 smithi170 ceph-mon[31212]: osdmap e817: 12 total, 12 up, 12 in 2024-04-21T16:34:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:12 smithi077 ceph-mon[27902]: pgmap v11911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:34:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:12 smithi077 ceph-mon[27902]: osdmap e817: 12 total, 12 up, 12 in 2024-04-21T16:34:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22163.739468 secs 2024-04-21T16:34:13.538 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22163.739468 secs 2024-04-21T16:34:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22163.739468 secs 2024-04-21T16:34:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:14 smithi191 ceph-mon[31636]: pgmap v11913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:34:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:14 smithi170 ceph-mon[31212]: pgmap v11913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:34:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:14 smithi077 ceph-mon[27902]: pgmap v11913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:34:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22165.500731 secs 2024-04-21T16:34:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22165.500731 secs 2024-04-21T16:34:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22165.500731 secs 2024-04-21T16:34:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:16 smithi191 ceph-mon[31636]: pgmap v11914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:34:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:16 smithi170 ceph-mon[31212]: pgmap v11914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:34:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:16 smithi077 ceph-mon[27902]: pgmap v11914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:34:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:18 smithi191 ceph-mon[31636]: pgmap v11915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:34:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22168.739584 secs 2024-04-21T16:34:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:18 smithi170 ceph-mon[31212]: pgmap v11915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:34:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22168.739584 secs 2024-04-21T16:34:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:18 smithi077 ceph-mon[27902]: pgmap v11915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:34:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22168.739584 secs 2024-04-21T16:34:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:20 smithi191 ceph-mon[31636]: pgmap v11916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:34:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22170.500879 secs 2024-04-21T16:34:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:20 smithi170 ceph-mon[31212]: pgmap v11916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:34:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22170.500879 secs 2024-04-21T16:34:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:20 smithi077 ceph-mon[27902]: pgmap v11916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:34:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22170.500879 secs 2024-04-21T16:34:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:22 smithi191 ceph-mon[31636]: pgmap v11917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:34:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:22 smithi170 ceph-mon[31212]: pgmap v11917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:34:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:22 smithi077 ceph-mon[27902]: pgmap v11917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:34:23.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22173.739717 secs 2024-04-21T16:34:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22173.739717 secs 2024-04-21T16:34:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22173.739717 secs 2024-04-21T16:34:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:24 smithi191 ceph-mon[31636]: pgmap v11918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:34:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:24 smithi170 ceph-mon[31212]: pgmap v11918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:34:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:24 smithi077 ceph-mon[27902]: pgmap v11918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:34:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22175.500989 secs 2024-04-21T16:34:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22175.500989 secs 2024-04-21T16:34:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22175.500989 secs 2024-04-21T16:34:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:26 smithi191 ceph-mon[31636]: pgmap v11919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:26 smithi170 ceph-mon[31212]: pgmap v11919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:26.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:26 smithi077 ceph-mon[27902]: pgmap v11919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:28 smithi170 ceph-mon[31212]: pgmap v11920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22178.739831 secs 2024-04-21T16:34:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:28 smithi077 ceph-mon[27902]: pgmap v11920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22178.739831 secs 2024-04-21T16:34:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:28 smithi191 ceph-mon[31636]: pgmap v11920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22178.739831 secs 2024-04-21T16:34:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:30 smithi170 ceph-mon[31212]: pgmap v11921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22180.501097 secs 2024-04-21T16:34:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:30 smithi077 ceph-mon[27902]: pgmap v11921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22180.501097 secs 2024-04-21T16:34:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:30 smithi191 ceph-mon[31636]: pgmap v11921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22180.501097 secs 2024-04-21T16:34:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:32 smithi170 ceph-mon[31212]: pgmap v11922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:32 smithi077 ceph-mon[27902]: pgmap v11922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:32 smithi191 ceph-mon[31636]: pgmap v11922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22183.739946 secs 2024-04-21T16:34:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22183.739946 secs 2024-04-21T16:34:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22183.739946 secs 2024-04-21T16:34:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:34 smithi170 ceph-mon[31212]: pgmap v11923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:34:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:34 smithi077 ceph-mon[27902]: pgmap v11923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:34:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:34 smithi191 ceph-mon[31636]: pgmap v11923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:34:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22185.501161 secs 2024-04-21T16:34:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:34:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:34:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:34:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22185.501161 secs 2024-04-21T16:34:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:34:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:34:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:34:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22185.501161 secs 2024-04-21T16:34:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:34:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:34:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:34:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:36 smithi170 ceph-mon[31212]: pgmap v11924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:36 smithi077 ceph-mon[27902]: pgmap v11924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:36 smithi191 ceph-mon[31636]: pgmap v11924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:38 smithi170 ceph-mon[31212]: pgmap v11925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22188.740094 secs 2024-04-21T16:34:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:38 smithi077 ceph-mon[27902]: pgmap v11925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22188.740094 secs 2024-04-21T16:34:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:38 smithi191 ceph-mon[31636]: pgmap v11925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22188.740094 secs 2024-04-21T16:34:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:40 smithi170 ceph-mon[31212]: pgmap v11926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22190.501278 secs 2024-04-21T16:34:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:40 smithi077 ceph-mon[27902]: pgmap v11926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22190.501278 secs 2024-04-21T16:34:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:40 smithi191 ceph-mon[31636]: pgmap v11926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22190.501278 secs 2024-04-21T16:34:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:42 smithi170 ceph-mon[31212]: pgmap v11927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:42 smithi077 ceph-mon[27902]: pgmap v11927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:42 smithi191 ceph-mon[31636]: pgmap v11927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:43.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22193.740220 secs 2024-04-21T16:34:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22193.740220 secs 2024-04-21T16:34:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22193.740220 secs 2024-04-21T16:34:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:44 smithi170 ceph-mon[31212]: pgmap v11928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:44 smithi077 ceph-mon[27902]: pgmap v11928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:44 smithi191 ceph-mon[31636]: pgmap v11928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22195.501369 secs 2024-04-21T16:34:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22195.501369 secs 2024-04-21T16:34:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22195.501369 secs 2024-04-21T16:34:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:46 smithi170 ceph-mon[31212]: pgmap v11929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:46 smithi077 ceph-mon[27902]: pgmap v11929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:46 smithi191 ceph-mon[31636]: pgmap v11929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:48 smithi170 ceph-mon[31212]: pgmap v11930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22198.740364 secs 2024-04-21T16:34:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:48 smithi077 ceph-mon[27902]: pgmap v11930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22198.740364 secs 2024-04-21T16:34:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:48 smithi191 ceph-mon[31636]: pgmap v11930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22198.740364 secs 2024-04-21T16:34:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:50 smithi170 ceph-mon[31212]: pgmap v11931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22200.501485 secs 2024-04-21T16:34:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:50 smithi077 ceph-mon[27902]: pgmap v11931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22200.501485 secs 2024-04-21T16:34:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:50 smithi191 ceph-mon[31636]: pgmap v11931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22200.501485 secs 2024-04-21T16:34:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:52 smithi170 ceph-mon[31212]: pgmap v11932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:52 smithi077 ceph-mon[27902]: pgmap v11932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:52 smithi191 ceph-mon[31636]: pgmap v11932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22203.740483 secs 2024-04-21T16:34:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22203.740483 secs 2024-04-21T16:34:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22203.740483 secs 2024-04-21T16:34:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:54 smithi170 ceph-mon[31212]: pgmap v11933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:54 smithi077 ceph-mon[27902]: pgmap v11933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:54 smithi191 ceph-mon[31636]: pgmap v11933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:34:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22205.501575 secs 2024-04-21T16:34:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22205.501575 secs 2024-04-21T16:34:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22205.501575 secs 2024-04-21T16:34:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:56 smithi170 ceph-mon[31212]: pgmap v11934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:56 smithi077 ceph-mon[27902]: pgmap v11934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:56 smithi191 ceph-mon[31636]: pgmap v11934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:34:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:34:57.424+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:34:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:34:57.424+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:34:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:34:57.424+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:34:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:34:57.424+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:34:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:58 smithi170 ceph-mon[31212]: pgmap v11935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:34:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22208.740601 secs 2024-04-21T16:34:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:58 smithi077 ceph-mon[27902]: pgmap v11935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:34:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22208.740601 secs 2024-04-21T16:34:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:58 smithi191 ceph-mon[31636]: pgmap v11935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:34:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:34:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22208.740601 secs 2024-04-21T16:35:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:00 smithi170 ceph-mon[31212]: pgmap v11936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22210.501742 secs 2024-04-21T16:35:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:00 smithi077 ceph-mon[27902]: pgmap v11936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22210.501742 secs 2024-04-21T16:35:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:00 smithi191 ceph-mon[31636]: pgmap v11936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22210.501742 secs 2024-04-21T16:35:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:02 smithi170 ceph-mon[31212]: pgmap v11937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:02 smithi077 ceph-mon[27902]: pgmap v11937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:02 smithi191 ceph-mon[31636]: pgmap v11937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22213.740726 secs 2024-04-21T16:35:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22213.740726 secs 2024-04-21T16:35:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22213.740726 secs 2024-04-21T16:35:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:04 smithi077 ceph-mon[27902]: pgmap v11938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:04 smithi191 ceph-mon[31636]: pgmap v11938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:04 smithi170 ceph-mon[31212]: pgmap v11938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22215.501879 secs 2024-04-21T16:35:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:05 smithi077 ceph-mon[27902]: osdmap e818: 12 total, 12 up, 12 in 2024-04-21T16:35:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22215.501879 secs 2024-04-21T16:35:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:05 smithi191 ceph-mon[31636]: osdmap e818: 12 total, 12 up, 12 in 2024-04-21T16:35:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22215.501879 secs 2024-04-21T16:35:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:05 smithi170 ceph-mon[31212]: osdmap e818: 12 total, 12 up, 12 in 2024-04-21T16:35:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:06 smithi077 ceph-mon[27902]: pgmap v11940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:35:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:06 smithi191 ceph-mon[31636]: pgmap v11940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:35:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:06 smithi170 ceph-mon[31212]: pgmap v11940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:35:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:08 smithi077 ceph-mon[27902]: pgmap v11941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:35:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22218.740855 secs 2024-04-21T16:35:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:08 smithi191 ceph-mon[31636]: pgmap v11941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:35:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22218.740855 secs 2024-04-21T16:35:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:08 smithi170 ceph-mon[31212]: pgmap v11941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:35:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22218.740855 secs 2024-04-21T16:35:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:10 smithi077 ceph-mon[27902]: pgmap v11942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:35:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22220.501953 secs 2024-04-21T16:35:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:10 smithi191 ceph-mon[31636]: pgmap v11942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:35:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22220.501953 secs 2024-04-21T16:35:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:10 smithi170 ceph-mon[31212]: pgmap v11942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:35:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22220.501953 secs 2024-04-21T16:35:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:12 smithi191 ceph-mon[31636]: pgmap v11943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:35:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:12 smithi191 ceph-mon[31636]: osdmap e819: 12 total, 12 up, 12 in 2024-04-21T16:35:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:12 smithi170 ceph-mon[31212]: pgmap v11943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:35:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:12 smithi170 ceph-mon[31212]: osdmap e819: 12 total, 12 up, 12 in 2024-04-21T16:35:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:12 smithi077 ceph-mon[27902]: pgmap v11943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:35:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:12 smithi077 ceph-mon[27902]: osdmap e819: 12 total, 12 up, 12 in 2024-04-21T16:35:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22223.740917 secs 2024-04-21T16:35:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22223.740917 secs 2024-04-21T16:35:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22223.740917 secs 2024-04-21T16:35:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:14 smithi191 ceph-mon[31636]: pgmap v11945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:35:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:14 smithi170 ceph-mon[31212]: pgmap v11945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:35:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:14 smithi077 ceph-mon[27902]: pgmap v11945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:35:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22225.502038 secs 2024-04-21T16:35:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22225.502038 secs 2024-04-21T16:35:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22225.502038 secs 2024-04-21T16:35:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:16 smithi191 ceph-mon[31636]: pgmap v11946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:35:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:16 smithi170 ceph-mon[31212]: pgmap v11946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:35:16.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:16 smithi077 ceph-mon[27902]: pgmap v11946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:35:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:18 smithi191 ceph-mon[31636]: pgmap v11947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:35:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22228.740996 secs 2024-04-21T16:35:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:18 smithi170 ceph-mon[31212]: pgmap v11947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:35:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22228.740996 secs 2024-04-21T16:35:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:18 smithi077 ceph-mon[27902]: pgmap v11947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:35:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22228.740996 secs 2024-04-21T16:35:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:20 smithi191 ceph-mon[31636]: pgmap v11948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:35:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22230.502150 secs 2024-04-21T16:35:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:20 smithi170 ceph-mon[31212]: pgmap v11948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:35:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22230.502150 secs 2024-04-21T16:35:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:20 smithi077 ceph-mon[27902]: pgmap v11948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:35:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22230.502150 secs 2024-04-21T16:35:22.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:22 smithi191 ceph-mon[31636]: pgmap v11949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:35:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:22 smithi170 ceph-mon[31212]: pgmap v11949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:35:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:22 smithi077 ceph-mon[27902]: pgmap v11949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:35:23.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22233.741116 secs 2024-04-21T16:35:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22233.741116 secs 2024-04-21T16:35:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22233.741116 secs 2024-04-21T16:35:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:24 smithi191 ceph-mon[31636]: pgmap v11950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:35:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:24 smithi170 ceph-mon[31212]: pgmap v11950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:35:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:24 smithi077 ceph-mon[27902]: pgmap v11950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:35:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22235.502265 secs 2024-04-21T16:35:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22235.502265 secs 2024-04-21T16:35:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22235.502265 secs 2024-04-21T16:35:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:26 smithi170 ceph-mon[31212]: pgmap v11951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:26 smithi077 ceph-mon[27902]: pgmap v11951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:26 smithi191 ceph-mon[31636]: pgmap v11951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:28 smithi191 ceph-mon[31636]: pgmap v11952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22238.741257 secs 2024-04-21T16:35:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:28 smithi170 ceph-mon[31212]: pgmap v11952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22238.741257 secs 2024-04-21T16:35:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:28 smithi077 ceph-mon[27902]: pgmap v11952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22238.741257 secs 2024-04-21T16:35:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:30 smithi170 ceph-mon[31212]: pgmap v11953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22240.502341 secs 2024-04-21T16:35:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:30 smithi077 ceph-mon[27902]: pgmap v11953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22240.502341 secs 2024-04-21T16:35:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:30 smithi191 ceph-mon[31636]: pgmap v11953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22240.502341 secs 2024-04-21T16:35:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:32 smithi170 ceph-mon[31212]: pgmap v11954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:32 smithi077 ceph-mon[27902]: pgmap v11954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:32 smithi191 ceph-mon[31636]: pgmap v11954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22243.741375 secs 2024-04-21T16:35:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22243.741375 secs 2024-04-21T16:35:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22243.741375 secs 2024-04-21T16:35:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:34 smithi170 ceph-mon[31212]: pgmap v11955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:34 smithi077 ceph-mon[27902]: pgmap v11955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:34 smithi191 ceph-mon[31636]: pgmap v11955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22245.502432 secs 2024-04-21T16:35:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:35:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22245.502432 secs 2024-04-21T16:35:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:35:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22245.502432 secs 2024-04-21T16:35:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:35:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:36 smithi170 ceph-mon[31212]: pgmap v11956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:35:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:35:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:35:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:36 smithi077 ceph-mon[27902]: pgmap v11956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:35:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:35:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:35:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:36 smithi191 ceph-mon[31636]: pgmap v11956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:35:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:35:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:35:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:38 smithi170 ceph-mon[31212]: pgmap v11957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22248.741503 secs 2024-04-21T16:35:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:38 smithi077 ceph-mon[27902]: pgmap v11957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22248.741503 secs 2024-04-21T16:35:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:38 smithi191 ceph-mon[31636]: pgmap v11957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22248.741503 secs 2024-04-21T16:35:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:40 smithi170 ceph-mon[31212]: pgmap v11958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22250.502547 secs 2024-04-21T16:35:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:40 smithi077 ceph-mon[27902]: pgmap v11958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22250.502547 secs 2024-04-21T16:35:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:40 smithi191 ceph-mon[31636]: pgmap v11958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22250.502547 secs 2024-04-21T16:35:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:42 smithi170 ceph-mon[31212]: pgmap v11959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:42 smithi077 ceph-mon[27902]: pgmap v11959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:42 smithi191 ceph-mon[31636]: pgmap v11959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:43.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22253.741625 secs 2024-04-21T16:35:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22253.741625 secs 2024-04-21T16:35:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22253.741625 secs 2024-04-21T16:35:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:44 smithi170 ceph-mon[31212]: pgmap v11960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:44 smithi077 ceph-mon[27902]: pgmap v11960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:44 smithi191 ceph-mon[31636]: pgmap v11960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22255.502663 secs 2024-04-21T16:35:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22255.502663 secs 2024-04-21T16:35:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22255.502663 secs 2024-04-21T16:35:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:46 smithi170 ceph-mon[31212]: pgmap v11961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:46 smithi077 ceph-mon[27902]: pgmap v11961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:46 smithi191 ceph-mon[31636]: pgmap v11961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:48 smithi170 ceph-mon[31212]: pgmap v11962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22258.741806 secs 2024-04-21T16:35:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:48 smithi077 ceph-mon[27902]: pgmap v11962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22258.741806 secs 2024-04-21T16:35:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:48 smithi191 ceph-mon[31636]: pgmap v11962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22258.741806 secs 2024-04-21T16:35:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:50 smithi170 ceph-mon[31212]: pgmap v11963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22260.502763 secs 2024-04-21T16:35:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:50 smithi077 ceph-mon[27902]: pgmap v11963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22260.502763 secs 2024-04-21T16:35:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:50 smithi191 ceph-mon[31636]: pgmap v11963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22260.502763 secs 2024-04-21T16:35:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:52 smithi170 ceph-mon[31212]: pgmap v11964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:52 smithi077 ceph-mon[27902]: pgmap v11964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:52 smithi191 ceph-mon[31636]: pgmap v11964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22263.741907 secs 2024-04-21T16:35:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22263.741907 secs 2024-04-21T16:35:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22263.741907 secs 2024-04-21T16:35:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:54 smithi170 ceph-mon[31212]: pgmap v11965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:54 smithi077 ceph-mon[27902]: pgmap v11965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:54 smithi191 ceph-mon[31636]: pgmap v11965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:35:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22265.502879 secs 2024-04-21T16:35:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22265.502879 secs 2024-04-21T16:35:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22265.502879 secs 2024-04-21T16:35:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:56 smithi077 ceph-mon[27902]: pgmap v11966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:56 smithi191 ceph-mon[31636]: pgmap v11966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:56 smithi170 ceph-mon[31212]: pgmap v11966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:35:58.614 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:58 smithi170 ceph-mon[31212]: pgmap v11967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:58.614 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:35:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22268.742028 secs 2024-04-21T16:35:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:58 smithi077 ceph-mon[27902]: pgmap v11967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:35:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22268.742028 secs 2024-04-21T16:35:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:58 smithi191 ceph-mon[31636]: pgmap v11967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:35:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:35:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22268.742028 secs 2024-04-21T16:36:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:00 smithi077 ceph-mon[27902]: pgmap v11968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:36:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22270.503013 secs 2024-04-21T16:36:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:00 smithi191 ceph-mon[31636]: pgmap v11968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:36:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22270.503013 secs 2024-04-21T16:36:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:00 smithi170 ceph-mon[31212]: pgmap v11968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:36:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22270.503013 secs 2024-04-21T16:36:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:02 smithi077 ceph-mon[27902]: pgmap v11969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:02 smithi191 ceph-mon[31636]: pgmap v11969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:02 smithi170 ceph-mon[31212]: pgmap v11969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22273.742149 secs 2024-04-21T16:36:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22273.742149 secs 2024-04-21T16:36:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22273.742149 secs 2024-04-21T16:36:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:04 smithi077 ceph-mon[27902]: pgmap v11970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:36:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:04 smithi191 ceph-mon[31636]: pgmap v11970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:36:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:04 smithi170 ceph-mon[31212]: pgmap v11970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:36:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22275.503092 secs 2024-04-21T16:36:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:05 smithi077 ceph-mon[27902]: osdmap e820: 12 total, 12 up, 12 in 2024-04-21T16:36:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22275.503092 secs 2024-04-21T16:36:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:05 smithi191 ceph-mon[31636]: osdmap e820: 12 total, 12 up, 12 in 2024-04-21T16:36:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22275.503092 secs 2024-04-21T16:36:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:05 smithi170 ceph-mon[31212]: osdmap e820: 12 total, 12 up, 12 in 2024-04-21T16:36:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:06 smithi077 ceph-mon[27902]: pgmap v11972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:36:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:06 smithi191 ceph-mon[31636]: pgmap v11972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:36:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:06 smithi170 ceph-mon[31212]: pgmap v11972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:36:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:08 smithi077 ceph-mon[27902]: pgmap v11973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22278.742239 secs 2024-04-21T16:36:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:08 smithi191 ceph-mon[31636]: pgmap v11973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22278.742239 secs 2024-04-21T16:36:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:08 smithi170 ceph-mon[31212]: pgmap v11973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22278.742239 secs 2024-04-21T16:36:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:10 smithi077 ceph-mon[27902]: pgmap v11974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22280.503216 secs 2024-04-21T16:36:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:10 smithi191 ceph-mon[31636]: pgmap v11974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22280.503216 secs 2024-04-21T16:36:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:10 smithi170 ceph-mon[31212]: pgmap v11974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22280.503216 secs 2024-04-21T16:36:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:12 smithi191 ceph-mon[31636]: pgmap v11975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:12 smithi191 ceph-mon[31636]: osdmap e821: 12 total, 12 up, 12 in 2024-04-21T16:36:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:12 smithi170 ceph-mon[31212]: pgmap v11975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:12 smithi170 ceph-mon[31212]: osdmap e821: 12 total, 12 up, 12 in 2024-04-21T16:36:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:12 smithi077 ceph-mon[27902]: pgmap v11975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:12 smithi077 ceph-mon[27902]: osdmap e821: 12 total, 12 up, 12 in 2024-04-21T16:36:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22283.742308 secs 2024-04-21T16:36:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22283.742308 secs 2024-04-21T16:36:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22283.742308 secs 2024-04-21T16:36:14.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:14 smithi191 ceph-mon[31636]: pgmap v11977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:36:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:14 smithi170 ceph-mon[31212]: pgmap v11977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:36:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:14 smithi077 ceph-mon[27902]: pgmap v11977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:36:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22285.503282 secs 2024-04-21T16:36:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22285.503282 secs 2024-04-21T16:36:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22285.503282 secs 2024-04-21T16:36:16.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:16 smithi191 ceph-mon[31636]: pgmap v11978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:16 smithi170 ceph-mon[31212]: pgmap v11978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:16.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:16 smithi077 ceph-mon[27902]: pgmap v11978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:36:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:18 smithi191 ceph-mon[31636]: pgmap v11979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:36:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22288.742432 secs 2024-04-21T16:36:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:18 smithi170 ceph-mon[31212]: pgmap v11979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:36:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22288.742432 secs 2024-04-21T16:36:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:18 smithi077 ceph-mon[27902]: pgmap v11979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:36:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22288.742432 secs 2024-04-21T16:36:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:20 smithi170 ceph-mon[31212]: pgmap v11980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:36:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22290.503398 secs 2024-04-21T16:36:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:20 smithi077 ceph-mon[27902]: pgmap v11980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:36:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22290.503398 secs 2024-04-21T16:36:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:20 smithi191 ceph-mon[31636]: pgmap v11980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:36:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22290.503398 secs 2024-04-21T16:36:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:22 smithi170 ceph-mon[31212]: pgmap v11981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:36:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:22 smithi077 ceph-mon[27902]: pgmap v11981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:36:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:22 smithi191 ceph-mon[31636]: pgmap v11981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:36:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22293.742572 secs 2024-04-21T16:36:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22293.742572 secs 2024-04-21T16:36:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22293.742572 secs 2024-04-21T16:36:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:24 smithi170 ceph-mon[31212]: pgmap v11982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:36:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:24 smithi077 ceph-mon[27902]: pgmap v11982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:36:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:24 smithi191 ceph-mon[31636]: pgmap v11982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:36:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22295.503457 secs 2024-04-21T16:36:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22295.503457 secs 2024-04-21T16:36:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22295.503457 secs 2024-04-21T16:36:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:26 smithi170 ceph-mon[31212]: pgmap v11983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:26.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:26 smithi077 ceph-mon[27902]: pgmap v11983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:26 smithi191 ceph-mon[31636]: pgmap v11983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:28 smithi191 ceph-mon[31636]: pgmap v11984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22298.742674 secs 2024-04-21T16:36:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:28 smithi170 ceph-mon[31212]: pgmap v11984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22298.742674 secs 2024-04-21T16:36:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:28 smithi077 ceph-mon[27902]: pgmap v11984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22298.742674 secs 2024-04-21T16:36:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:30 smithi170 ceph-mon[31212]: pgmap v11985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22300.503588 secs 2024-04-21T16:36:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:30 smithi077 ceph-mon[27902]: pgmap v11985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22300.503588 secs 2024-04-21T16:36:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:30 smithi191 ceph-mon[31636]: pgmap v11985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22300.503588 secs 2024-04-21T16:36:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:32 smithi170 ceph-mon[31212]: pgmap v11986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:32 smithi077 ceph-mon[27902]: pgmap v11986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:32 smithi191 ceph-mon[31636]: pgmap v11986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22303.742789 secs 2024-04-21T16:36:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22303.742789 secs 2024-04-21T16:36:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22303.742789 secs 2024-04-21T16:36:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:34 smithi170 ceph-mon[31212]: pgmap v11987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:34 smithi077 ceph-mon[27902]: pgmap v11987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:34 smithi191 ceph-mon[31636]: pgmap v11987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22305.503700 secs 2024-04-21T16:36:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22305.503700 secs 2024-04-21T16:36:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22305.503700 secs 2024-04-21T16:36:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:36 smithi170 ceph-mon[31212]: pgmap v11988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:36:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:36 smithi077 ceph-mon[27902]: pgmap v11988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:36:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:36 smithi191 ceph-mon[31636]: pgmap v11988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:36:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:36:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:36:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:36:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:36:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:36:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:36:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:36:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:36:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:36:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:38 smithi170 ceph-mon[31212]: pgmap v11989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22308.742913 secs 2024-04-21T16:36:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:38 smithi077 ceph-mon[27902]: pgmap v11989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22308.742913 secs 2024-04-21T16:36:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:38 smithi191 ceph-mon[31636]: pgmap v11989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22308.742913 secs 2024-04-21T16:36:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:40 smithi170 ceph-mon[31212]: pgmap v11990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22310.503837 secs 2024-04-21T16:36:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:40 smithi077 ceph-mon[27902]: pgmap v11990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22310.503837 secs 2024-04-21T16:36:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:40 smithi191 ceph-mon[31636]: pgmap v11990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22310.503837 secs 2024-04-21T16:36:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:42 smithi170 ceph-mon[31212]: pgmap v11991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:42 smithi077 ceph-mon[27902]: pgmap v11991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:42 smithi191 ceph-mon[31636]: pgmap v11991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22313.743031 secs 2024-04-21T16:36:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22313.743031 secs 2024-04-21T16:36:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22313.743031 secs 2024-04-21T16:36:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:44 smithi170 ceph-mon[31212]: pgmap v11992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:44 smithi077 ceph-mon[27902]: pgmap v11992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:44 smithi191 ceph-mon[31636]: pgmap v11992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22315.503972 secs 2024-04-21T16:36:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22315.503972 secs 2024-04-21T16:36:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22315.503972 secs 2024-04-21T16:36:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:46 smithi170 ceph-mon[31212]: pgmap v11993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:46 smithi077 ceph-mon[27902]: pgmap v11993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:46 smithi191 ceph-mon[31636]: pgmap v11993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:48 smithi170 ceph-mon[31212]: pgmap v11994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22318.743151 secs 2024-04-21T16:36:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:48 smithi077 ceph-mon[27902]: pgmap v11994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22318.743151 secs 2024-04-21T16:36:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:48 smithi191 ceph-mon[31636]: pgmap v11994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22318.743151 secs 2024-04-21T16:36:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:50 smithi077 ceph-mon[27902]: pgmap v11995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22320.504067 secs 2024-04-21T16:36:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:50 smithi191 ceph-mon[31636]: pgmap v11995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22320.504067 secs 2024-04-21T16:36:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:50 smithi170 ceph-mon[31212]: pgmap v11995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22320.504067 secs 2024-04-21T16:36:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:52 smithi077 ceph-mon[27902]: pgmap v11996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:52 smithi191 ceph-mon[31636]: pgmap v11996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:52 smithi170 ceph-mon[31212]: pgmap v11996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22323.743247 secs 2024-04-21T16:36:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22323.743247 secs 2024-04-21T16:36:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22323.743247 secs 2024-04-21T16:36:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:54 smithi077 ceph-mon[27902]: pgmap v11997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:54 smithi191 ceph-mon[31636]: pgmap v11997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:54 smithi170 ceph-mon[31212]: pgmap v11997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:36:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22325.504190 secs 2024-04-21T16:36:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22325.504190 secs 2024-04-21T16:36:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22325.504190 secs 2024-04-21T16:36:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:56 smithi077 ceph-mon[27902]: pgmap v11998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:56 smithi191 ceph-mon[31636]: pgmap v11998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:56 smithi170 ceph-mon[31212]: pgmap v11998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:36:58.611 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:58 smithi170 ceph-mon[31212]: pgmap v11999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:58.612 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:36:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22328.743329 secs 2024-04-21T16:36:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:58 smithi077 ceph-mon[27902]: pgmap v11999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:36:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22328.743329 secs 2024-04-21T16:36:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:58 smithi191 ceph-mon[31636]: pgmap v11999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:36:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:36:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22328.743329 secs 2024-04-21T16:37:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:00 smithi077 ceph-mon[27902]: pgmap v12000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22330.504305 secs 2024-04-21T16:37:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:00 smithi191 ceph-mon[31636]: pgmap v12000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22330.504305 secs 2024-04-21T16:37:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:00 smithi170 ceph-mon[31212]: pgmap v12000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22330.504305 secs 2024-04-21T16:37:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:02 smithi077 ceph-mon[27902]: pgmap v12001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:02 smithi191 ceph-mon[31636]: pgmap v12001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:02 smithi170 ceph-mon[31212]: pgmap v12001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22333.743474 secs 2024-04-21T16:37:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22333.743474 secs 2024-04-21T16:37:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22333.743474 secs 2024-04-21T16:37:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:04 smithi077 ceph-mon[27902]: pgmap v12002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:04 smithi191 ceph-mon[31636]: pgmap v12002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:04 smithi170 ceph-mon[31212]: pgmap v12002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22335.504427 secs 2024-04-21T16:37:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:05 smithi077 ceph-mon[27902]: osdmap e822: 12 total, 12 up, 12 in 2024-04-21T16:37:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22335.504427 secs 2024-04-21T16:37:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:05 smithi191 ceph-mon[31636]: osdmap e822: 12 total, 12 up, 12 in 2024-04-21T16:37:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22335.504427 secs 2024-04-21T16:37:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:05 smithi170 ceph-mon[31212]: osdmap e822: 12 total, 12 up, 12 in 2024-04-21T16:37:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:06 smithi077 ceph-mon[27902]: pgmap v12004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:37:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:06 smithi191 ceph-mon[31636]: pgmap v12004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:37:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:06 smithi170 ceph-mon[31212]: pgmap v12004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:37:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:08 smithi077 ceph-mon[27902]: pgmap v12005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:37:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22338.743588 secs 2024-04-21T16:37:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:08 smithi191 ceph-mon[31636]: pgmap v12005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:37:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22338.743588 secs 2024-04-21T16:37:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:08 smithi170 ceph-mon[31212]: pgmap v12005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:37:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22338.743588 secs 2024-04-21T16:37:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:10 smithi077 ceph-mon[27902]: pgmap v12006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:37:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22340.504543 secs 2024-04-21T16:37:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:10 smithi191 ceph-mon[31636]: pgmap v12006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:37:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22340.504543 secs 2024-04-21T16:37:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:10 smithi170 ceph-mon[31212]: pgmap v12006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:37:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22340.504543 secs 2024-04-21T16:37:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:12 smithi191 ceph-mon[31636]: pgmap v12007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:37:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:12 smithi191 ceph-mon[31636]: osdmap e823: 12 total, 12 up, 12 in 2024-04-21T16:37:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:12 smithi170 ceph-mon[31212]: pgmap v12007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:37:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:12 smithi170 ceph-mon[31212]: osdmap e823: 12 total, 12 up, 12 in 2024-04-21T16:37:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:12 smithi077 ceph-mon[27902]: pgmap v12007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:37:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:12 smithi077 ceph-mon[27902]: osdmap e823: 12 total, 12 up, 12 in 2024-04-21T16:37:13.538 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22343.743711 secs 2024-04-21T16:37:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22343.743711 secs 2024-04-21T16:37:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22343.743711 secs 2024-04-21T16:37:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:14 smithi170 ceph-mon[31212]: pgmap v12009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:37:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:14 smithi077 ceph-mon[27902]: pgmap v12009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:37:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:14 smithi191 ceph-mon[31636]: pgmap v12009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T16:37:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22345.504667 secs 2024-04-21T16:37:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22345.504667 secs 2024-04-21T16:37:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22345.504667 secs 2024-04-21T16:37:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:16 smithi170 ceph-mon[31212]: pgmap v12010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:37:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:16 smithi077 ceph-mon[27902]: pgmap v12010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:37:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:16 smithi191 ceph-mon[31636]: pgmap v12010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:37:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:18 smithi170 ceph-mon[31212]: pgmap v12011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:37:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22348.743832 secs 2024-04-21T16:37:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:18 smithi077 ceph-mon[27902]: pgmap v12011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:37:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22348.743832 secs 2024-04-21T16:37:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:18 smithi191 ceph-mon[31636]: pgmap v12011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:37:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22348.743832 secs 2024-04-21T16:37:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:20 smithi170 ceph-mon[31212]: pgmap v12012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:37:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22350.504787 secs 2024-04-21T16:37:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:20 smithi077 ceph-mon[27902]: pgmap v12012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:37:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22350.504787 secs 2024-04-21T16:37:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:20 smithi191 ceph-mon[31636]: pgmap v12012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:37:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22350.504787 secs 2024-04-21T16:37:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:22 smithi170 ceph-mon[31212]: pgmap v12013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:37:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:22 smithi077 ceph-mon[27902]: pgmap v12013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:37:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:22 smithi191 ceph-mon[31636]: pgmap v12013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:37:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22353.743974 secs 2024-04-21T16:37:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22353.743974 secs 2024-04-21T16:37:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22353.743974 secs 2024-04-21T16:37:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:24 smithi170 ceph-mon[31212]: pgmap v12014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:37:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:24 smithi077 ceph-mon[27902]: pgmap v12014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:37:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:24 smithi191 ceph-mon[31636]: pgmap v12014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:37:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22355.504924 secs 2024-04-21T16:37:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22355.504924 secs 2024-04-21T16:37:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22355.504924 secs 2024-04-21T16:37:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:26 smithi170 ceph-mon[31212]: pgmap v12015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:26.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:26 smithi077 ceph-mon[27902]: pgmap v12015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:26 smithi191 ceph-mon[31636]: pgmap v12015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:28 smithi191 ceph-mon[31636]: pgmap v12016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22358.744100 secs 2024-04-21T16:37:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:28 smithi170 ceph-mon[31212]: pgmap v12016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22358.744100 secs 2024-04-21T16:37:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:28 smithi077 ceph-mon[27902]: pgmap v12016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22358.744100 secs 2024-04-21T16:37:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22360.505035 secs 2024-04-21T16:37:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:30 smithi170 ceph-mon[31212]: pgmap v12017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22360.505035 secs 2024-04-21T16:37:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:30 smithi077 ceph-mon[27902]: pgmap v12017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22360.505035 secs 2024-04-21T16:37:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:30 smithi191 ceph-mon[31636]: pgmap v12017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:32 smithi170 ceph-mon[31212]: pgmap v12018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:32 smithi077 ceph-mon[27902]: pgmap v12018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:32 smithi191 ceph-mon[31636]: pgmap v12018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22363.744226 secs 2024-04-21T16:37:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22363.744226 secs 2024-04-21T16:37:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22363.744226 secs 2024-04-21T16:37:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:34 smithi170 ceph-mon[31212]: pgmap v12019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:34 smithi077 ceph-mon[27902]: pgmap v12019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:34 smithi191 ceph-mon[31636]: pgmap v12019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22365.505153 secs 2024-04-21T16:37:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22365.505153 secs 2024-04-21T16:37:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22365.505153 secs 2024-04-21T16:37:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:36 smithi170 ceph-mon[31212]: pgmap v12020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:36 smithi077 ceph-mon[27902]: pgmap v12020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:36 smithi191 ceph-mon[31636]: pgmap v12020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:37:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:37:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:37:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:37:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:37:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:37:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:37:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:37:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:37:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:37:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:37:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:37:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:38 smithi170 ceph-mon[31212]: pgmap v12021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22368.744295 secs 2024-04-21T16:37:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:38 smithi077 ceph-mon[27902]: pgmap v12021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22368.744295 secs 2024-04-21T16:37:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:38 smithi191 ceph-mon[31636]: pgmap v12021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22368.744295 secs 2024-04-21T16:37:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22370.505269 secs 2024-04-21T16:37:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:40 smithi170 ceph-mon[31212]: pgmap v12022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22370.505269 secs 2024-04-21T16:37:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:40 smithi077 ceph-mon[27902]: pgmap v12022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22370.505269 secs 2024-04-21T16:37:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:40 smithi191 ceph-mon[31636]: pgmap v12022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:42 smithi170 ceph-mon[31212]: pgmap v12023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:42 smithi077 ceph-mon[27902]: pgmap v12023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:42 smithi191 ceph-mon[31636]: pgmap v12023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22373.744424 secs 2024-04-21T16:37:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22373.744424 secs 2024-04-21T16:37:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22373.744424 secs 2024-04-21T16:37:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:44 smithi077 ceph-mon[27902]: pgmap v12024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:44 smithi191 ceph-mon[31636]: pgmap v12024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:44 smithi170 ceph-mon[31212]: pgmap v12024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22375.505409 secs 2024-04-21T16:37:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22375.505409 secs 2024-04-21T16:37:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22375.505409 secs 2024-04-21T16:37:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:46 smithi077 ceph-mon[27902]: pgmap v12025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:46 smithi191 ceph-mon[31636]: pgmap v12025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:46 smithi170 ceph-mon[31212]: pgmap v12025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:48 smithi077 ceph-mon[27902]: pgmap v12026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22378.744542 secs 2024-04-21T16:37:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:48 smithi191 ceph-mon[31636]: pgmap v12026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22378.744542 secs 2024-04-21T16:37:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:48 smithi170 ceph-mon[31212]: pgmap v12026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22378.744542 secs 2024-04-21T16:37:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22380.505543 secs 2024-04-21T16:37:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:50 smithi077 ceph-mon[27902]: pgmap v12027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22380.505543 secs 2024-04-21T16:37:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:50 smithi191 ceph-mon[31636]: pgmap v12027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22380.505543 secs 2024-04-21T16:37:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:50 smithi170 ceph-mon[31212]: pgmap v12027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:52 smithi077 ceph-mon[27902]: pgmap v12028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:52 smithi191 ceph-mon[31636]: pgmap v12028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:52 smithi170 ceph-mon[31212]: pgmap v12028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22383.744663 secs 2024-04-21T16:37:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22383.744663 secs 2024-04-21T16:37:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22383.744663 secs 2024-04-21T16:37:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:54 smithi077 ceph-mon[27902]: pgmap v12029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:54 smithi191 ceph-mon[31636]: pgmap v12029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:54 smithi170 ceph-mon[31212]: pgmap v12029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:37:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22385.505675 secs 2024-04-21T16:37:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22385.505675 secs 2024-04-21T16:37:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22385.505675 secs 2024-04-21T16:37:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:56 smithi077 ceph-mon[27902]: pgmap v12030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:56 smithi191 ceph-mon[31636]: pgmap v12030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:56 smithi170 ceph-mon[31212]: pgmap v12030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:37:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:37:57.449+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:37:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:37:57.449+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:37:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:37:57.449+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:37:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:37:57.449+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:37:58.612 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:58 smithi170 ceph-mon[31212]: pgmap v12031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:58.612 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:37:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22388.744724 secs 2024-04-21T16:37:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:58 smithi077 ceph-mon[27902]: pgmap v12031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:37:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22388.744724 secs 2024-04-21T16:37:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:58 smithi191 ceph-mon[31636]: pgmap v12031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:37:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:37:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22388.744724 secs 2024-04-21T16:38:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22390.505792 secs 2024-04-21T16:38:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:00 smithi077 ceph-mon[27902]: pgmap v12032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22390.505792 secs 2024-04-21T16:38:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:00 smithi191 ceph-mon[31636]: pgmap v12032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22390.505792 secs 2024-04-21T16:38:00.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:00 smithi170 ceph-mon[31212]: pgmap v12032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:02 smithi077 ceph-mon[27902]: pgmap v12033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:38:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:02 smithi191 ceph-mon[31636]: pgmap v12033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:38:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:02 smithi170 ceph-mon[31212]: pgmap v12033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T16:38:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22393.744835 secs 2024-04-21T16:38:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22393.744835 secs 2024-04-21T16:38:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22393.744835 secs 2024-04-21T16:38:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:04 smithi077 ceph-mon[27902]: pgmap v12034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T16:38:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:04 smithi191 ceph-mon[31636]: pgmap v12034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T16:38:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:04 smithi170 ceph-mon[31212]: pgmap v12034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T16:38:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22395.505927 secs 2024-04-21T16:38:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:05 smithi077 ceph-mon[27902]: osdmap e824: 12 total, 12 up, 12 in 2024-04-21T16:38:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22395.505927 secs 2024-04-21T16:38:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:05 smithi191 ceph-mon[31636]: osdmap e824: 12 total, 12 up, 12 in 2024-04-21T16:38:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22395.505927 secs 2024-04-21T16:38:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:05 smithi170 ceph-mon[31212]: osdmap e824: 12 total, 12 up, 12 in 2024-04-21T16:38:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:06 smithi077 ceph-mon[27902]: pgmap v12036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T16:38:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:06 smithi191 ceph-mon[31636]: pgmap v12036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T16:38:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:06 smithi170 ceph-mon[31212]: pgmap v12036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T16:38:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:08 smithi077 ceph-mon[27902]: pgmap v12037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:38:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22398.744955 secs 2024-04-21T16:38:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:08 smithi191 ceph-mon[31636]: pgmap v12037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:38:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22398.744955 secs 2024-04-21T16:38:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:08 smithi170 ceph-mon[31212]: pgmap v12037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:38:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22398.744955 secs 2024-04-21T16:38:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22400.506016 secs 2024-04-21T16:38:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:10 smithi191 ceph-mon[31636]: pgmap v12038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:38:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22400.506016 secs 2024-04-21T16:38:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:10 smithi170 ceph-mon[31212]: pgmap v12038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:38:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22400.506016 secs 2024-04-21T16:38:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:10 smithi077 ceph-mon[27902]: pgmap v12038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:38:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:12 smithi170 ceph-mon[31212]: pgmap v12039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T16:38:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:12 smithi170 ceph-mon[31212]: osdmap e825: 12 total, 12 up, 12 in 2024-04-21T16:38:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:12 smithi077 ceph-mon[27902]: pgmap v12039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T16:38:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:12 smithi077 ceph-mon[27902]: osdmap e825: 12 total, 12 up, 12 in 2024-04-21T16:38:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:12 smithi191 ceph-mon[31636]: pgmap v12039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T16:38:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:12 smithi191 ceph-mon[31636]: osdmap e825: 12 total, 12 up, 12 in 2024-04-21T16:38:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22403.745072 secs 2024-04-21T16:38:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22403.745072 secs 2024-04-21T16:38:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22403.745072 secs 2024-04-21T16:38:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:14 smithi170 ceph-mon[31212]: pgmap v12041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-04-21T16:38:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:14 smithi077 ceph-mon[27902]: pgmap v12041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-04-21T16:38:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:14 smithi191 ceph-mon[31636]: pgmap v12041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-04-21T16:38:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22405.506135 secs 2024-04-21T16:38:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22405.506135 secs 2024-04-21T16:38:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22405.506135 secs 2024-04-21T16:38:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:16 smithi170 ceph-mon[31212]: pgmap v12042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T16:38:16.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:16 smithi077 ceph-mon[27902]: pgmap v12042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T16:38:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:16 smithi191 ceph-mon[31636]: pgmap v12042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T16:38:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:18 smithi170 ceph-mon[31212]: pgmap v12043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:38:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22408.745138 secs 2024-04-21T16:38:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:18 smithi077 ceph-mon[27902]: pgmap v12043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:38:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22408.745138 secs 2024-04-21T16:38:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:18 smithi191 ceph-mon[31636]: pgmap v12043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:38:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22408.745138 secs 2024-04-21T16:38:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22410.506215 secs 2024-04-21T16:38:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:20 smithi170 ceph-mon[31212]: pgmap v12044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:38:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22410.506215 secs 2024-04-21T16:38:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:20 smithi077 ceph-mon[27902]: pgmap v12044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:38:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22410.506215 secs 2024-04-21T16:38:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:20 smithi191 ceph-mon[31636]: pgmap v12044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:38:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:22 smithi170 ceph-mon[31212]: pgmap v12045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:38:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:22 smithi077 ceph-mon[27902]: pgmap v12045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:38:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:22 smithi191 ceph-mon[31636]: pgmap v12045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:38:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22413.745276 secs 2024-04-21T16:38:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22413.745276 secs 2024-04-21T16:38:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22413.745276 secs 2024-04-21T16:38:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:24 smithi170 ceph-mon[31212]: pgmap v12046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:38:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:24 smithi077 ceph-mon[27902]: pgmap v12046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:38:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:24 smithi191 ceph-mon[31636]: pgmap v12046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:38:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22415.506306 secs 2024-04-21T16:38:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22415.506306 secs 2024-04-21T16:38:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22415.506306 secs 2024-04-21T16:38:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:26 smithi170 ceph-mon[31212]: pgmap v12047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:26.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:26 smithi077 ceph-mon[27902]: pgmap v12047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:26 smithi191 ceph-mon[31636]: pgmap v12047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:28.523 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:28 smithi191 ceph-mon[31636]: pgmap v12048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:28.524 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22418.745412 secs 2024-04-21T16:38:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:28 smithi170 ceph-mon[31212]: pgmap v12048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22418.745412 secs 2024-04-21T16:38:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:28 smithi077 ceph-mon[27902]: pgmap v12048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22418.745412 secs 2024-04-21T16:38:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22420.506406 secs 2024-04-21T16:38:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:30 smithi170 ceph-mon[31212]: pgmap v12049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22420.506406 secs 2024-04-21T16:38:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:30 smithi077 ceph-mon[27902]: pgmap v12049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22420.506406 secs 2024-04-21T16:38:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:30 smithi191 ceph-mon[31636]: pgmap v12049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:32 smithi170 ceph-mon[31212]: pgmap v12050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:32 smithi077 ceph-mon[27902]: pgmap v12050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:32 smithi191 ceph-mon[31636]: pgmap v12050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22423.745508 secs 2024-04-21T16:38:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22423.745508 secs 2024-04-21T16:38:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22423.745508 secs 2024-04-21T16:38:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:34 smithi170 ceph-mon[31212]: pgmap v12051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:34 smithi077 ceph-mon[27902]: pgmap v12051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:34 smithi191 ceph-mon[31636]: pgmap v12051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22425.506558 secs 2024-04-21T16:38:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22425.506558 secs 2024-04-21T16:38:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22425.506558 secs 2024-04-21T16:38:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:36 smithi170 ceph-mon[31212]: pgmap v12052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:36 smithi077 ceph-mon[27902]: pgmap v12052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:36 smithi191 ceph-mon[31636]: pgmap v12052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:38:37.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:38:37.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:38:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:38 smithi170 ceph-mon[31212]: pgmap v12053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22428.745629 secs 2024-04-21T16:38:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:38:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:38:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:38:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:38 smithi077 ceph-mon[27902]: pgmap v12053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22428.745629 secs 2024-04-21T16:38:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:38:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:38:38.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:38:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:38 smithi191 ceph-mon[31636]: pgmap v12053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22428.745629 secs 2024-04-21T16:38:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:38:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:38:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:38:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22430.506691 secs 2024-04-21T16:38:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:40 smithi170 ceph-mon[31212]: pgmap v12054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22430.506691 secs 2024-04-21T16:38:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:40 smithi077 ceph-mon[27902]: pgmap v12054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22430.506691 secs 2024-04-21T16:38:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:40 smithi191 ceph-mon[31636]: pgmap v12054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:42 smithi170 ceph-mon[31212]: pgmap v12055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:42 smithi077 ceph-mon[27902]: pgmap v12055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:42.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:42 smithi191 ceph-mon[31636]: pgmap v12055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22433.745750 secs 2024-04-21T16:38:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22433.745750 secs 2024-04-21T16:38:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22433.745750 secs 2024-04-21T16:38:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:44 smithi077 ceph-mon[27902]: pgmap v12056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:44 smithi191 ceph-mon[31636]: pgmap v12056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:44 smithi170 ceph-mon[31212]: pgmap v12056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22435.506824 secs 2024-04-21T16:38:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22435.506824 secs 2024-04-21T16:38:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22435.506824 secs 2024-04-21T16:38:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:46 smithi077 ceph-mon[27902]: pgmap v12057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:46 smithi191 ceph-mon[31636]: pgmap v12057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:46 smithi170 ceph-mon[31212]: pgmap v12057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:48 smithi077 ceph-mon[27902]: pgmap v12058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22438.745898 secs 2024-04-21T16:38:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:48 smithi191 ceph-mon[31636]: pgmap v12058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22438.745898 secs 2024-04-21T16:38:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:48 smithi170 ceph-mon[31212]: pgmap v12058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22438.745898 secs 2024-04-21T16:38:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22440.506944 secs 2024-04-21T16:38:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:50 smithi077 ceph-mon[27902]: pgmap v12059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22440.506944 secs 2024-04-21T16:38:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:50 smithi191 ceph-mon[31636]: pgmap v12059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22440.506944 secs 2024-04-21T16:38:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:50 smithi170 ceph-mon[31212]: pgmap v12059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:52 smithi077 ceph-mon[27902]: pgmap v12060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:52 smithi191 ceph-mon[31636]: pgmap v12060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:52 smithi170 ceph-mon[31212]: pgmap v12060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22443.746042 secs 2024-04-21T16:38:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22443.746042 secs 2024-04-21T16:38:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22443.746042 secs 2024-04-21T16:38:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:54 smithi077 ceph-mon[27902]: pgmap v12061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:54 smithi191 ceph-mon[31636]: pgmap v12061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:54 smithi170 ceph-mon[31212]: pgmap v12061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:38:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22445.507060 secs 2024-04-21T16:38:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22445.507060 secs 2024-04-21T16:38:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22445.507060 secs 2024-04-21T16:38:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:56 smithi077 ceph-mon[27902]: pgmap v12062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:56 smithi191 ceph-mon[31636]: pgmap v12062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:56 smithi170 ceph-mon[31212]: pgmap v12062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:38:58.612 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:58 smithi170 ceph-mon[31212]: pgmap v12063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:58.612 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:38:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22448.746159 secs 2024-04-21T16:38:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:58 smithi077 ceph-mon[27902]: pgmap v12063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:38:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22448.746159 secs 2024-04-21T16:38:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:58 smithi191 ceph-mon[31636]: pgmap v12063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:38:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:38:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22448.746159 secs 2024-04-21T16:39:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22450.507164 secs 2024-04-21T16:39:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:00 smithi077 ceph-mon[27902]: pgmap v12064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22450.507164 secs 2024-04-21T16:39:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:00 smithi191 ceph-mon[31636]: pgmap v12064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22450.507164 secs 2024-04-21T16:39:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:00 smithi170 ceph-mon[31212]: pgmap v12064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:02 smithi077 ceph-mon[27902]: pgmap v12065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:02 smithi191 ceph-mon[31636]: pgmap v12065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:02 smithi170 ceph-mon[31212]: pgmap v12065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22453.746281 secs 2024-04-21T16:39:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22453.746281 secs 2024-04-21T16:39:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22453.746281 secs 2024-04-21T16:39:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:04 smithi077 ceph-mon[27902]: pgmap v12066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:04 smithi191 ceph-mon[31636]: pgmap v12066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:04 smithi170 ceph-mon[31212]: pgmap v12066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22455.507276 secs 2024-04-21T16:39:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:05 smithi077 ceph-mon[27902]: osdmap e826: 12 total, 12 up, 12 in 2024-04-21T16:39:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22455.507276 secs 2024-04-21T16:39:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:05 smithi191 ceph-mon[31636]: osdmap e826: 12 total, 12 up, 12 in 2024-04-21T16:39:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22455.507276 secs 2024-04-21T16:39:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:05 smithi170 ceph-mon[31212]: osdmap e826: 12 total, 12 up, 12 in 2024-04-21T16:39:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:06 smithi077 ceph-mon[27902]: pgmap v12068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:39:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:06 smithi191 ceph-mon[31636]: pgmap v12068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:39:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:06 smithi170 ceph-mon[31212]: pgmap v12068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:39:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:08 smithi077 ceph-mon[27902]: pgmap v12069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:39:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22458.746404 secs 2024-04-21T16:39:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:08 smithi191 ceph-mon[31636]: pgmap v12069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:39:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22458.746404 secs 2024-04-21T16:39:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:08 smithi170 ceph-mon[31212]: pgmap v12069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:39:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22458.746404 secs 2024-04-21T16:39:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22460.507392 secs 2024-04-21T16:39:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:10 smithi077 ceph-mon[27902]: pgmap v12070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:39:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22460.507392 secs 2024-04-21T16:39:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:10 smithi191 ceph-mon[31636]: pgmap v12070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:39:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22460.507392 secs 2024-04-21T16:39:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:10 smithi170 ceph-mon[31212]: pgmap v12070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:39:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:12 smithi170 ceph-mon[31212]: pgmap v12071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:39:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:12 smithi170 ceph-mon[31212]: osdmap e827: 12 total, 12 up, 12 in 2024-04-21T16:39:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:12 smithi077 ceph-mon[27902]: pgmap v12071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:39:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:12 smithi077 ceph-mon[27902]: osdmap e827: 12 total, 12 up, 12 in 2024-04-21T16:39:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:12 smithi191 ceph-mon[31636]: pgmap v12071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:39:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:12 smithi191 ceph-mon[31636]: osdmap e827: 12 total, 12 up, 12 in 2024-04-21T16:39:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22463.746529 secs 2024-04-21T16:39:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22463.746529 secs 2024-04-21T16:39:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22463.746529 secs 2024-04-21T16:39:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:14 smithi170 ceph-mon[31212]: pgmap v12073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:39:14.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:14 smithi077 ceph-mon[27902]: pgmap v12073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:39:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:14 smithi191 ceph-mon[31636]: pgmap v12073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:39:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22465.507504 secs 2024-04-21T16:39:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22465.507504 secs 2024-04-21T16:39:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22465.507504 secs 2024-04-21T16:39:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:16 smithi170 ceph-mon[31212]: pgmap v12074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:39:16.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:16 smithi077 ceph-mon[27902]: pgmap v12074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:39:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:16 smithi191 ceph-mon[31636]: pgmap v12074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:39:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:18 smithi170 ceph-mon[31212]: pgmap v12075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:39:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22468.746628 secs 2024-04-21T16:39:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:18 smithi077 ceph-mon[27902]: pgmap v12075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:39:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22468.746628 secs 2024-04-21T16:39:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:18 smithi191 ceph-mon[31636]: pgmap v12075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:39:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22468.746628 secs 2024-04-21T16:39:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22470.507635 secs 2024-04-21T16:39:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:20 smithi170 ceph-mon[31212]: pgmap v12076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:39:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22470.507635 secs 2024-04-21T16:39:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:20 smithi077 ceph-mon[27902]: pgmap v12076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:39:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22470.507635 secs 2024-04-21T16:39:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:20 smithi191 ceph-mon[31636]: pgmap v12076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:39:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:22 smithi170 ceph-mon[31212]: pgmap v12077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:39:22.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:22 smithi077 ceph-mon[27902]: pgmap v12077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:39:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:22 smithi191 ceph-mon[31636]: pgmap v12077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:39:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22473.746748 secs 2024-04-21T16:39:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22473.746748 secs 2024-04-21T16:39:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22473.746748 secs 2024-04-21T16:39:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:24 smithi170 ceph-mon[31212]: pgmap v12078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:39:24.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:24 smithi077 ceph-mon[27902]: pgmap v12078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:39:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:24 smithi191 ceph-mon[31636]: pgmap v12078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:39:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22475.507767 secs 2024-04-21T16:39:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22475.507767 secs 2024-04-21T16:39:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22475.507767 secs 2024-04-21T16:39:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:26 smithi170 ceph-mon[31212]: pgmap v12079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:26.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:26 smithi077 ceph-mon[27902]: pgmap v12079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:26 smithi191 ceph-mon[31636]: pgmap v12079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:28 smithi170 ceph-mon[31212]: pgmap v12080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22478.746865 secs 2024-04-21T16:39:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:28 smithi077 ceph-mon[27902]: pgmap v12080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22478.746865 secs 2024-04-21T16:39:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:28 smithi191 ceph-mon[31636]: pgmap v12080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22478.746865 secs 2024-04-21T16:39:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22480.507894 secs 2024-04-21T16:39:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:30 smithi170 ceph-mon[31212]: pgmap v12081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22480.507894 secs 2024-04-21T16:39:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:30 smithi077 ceph-mon[27902]: pgmap v12081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22480.507894 secs 2024-04-21T16:39:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:30 smithi191 ceph-mon[31636]: pgmap v12081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:32 smithi170 ceph-mon[31212]: pgmap v12082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:32 smithi077 ceph-mon[27902]: pgmap v12082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:32 smithi191 ceph-mon[31636]: pgmap v12082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22483.746999 secs 2024-04-21T16:39:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22483.746999 secs 2024-04-21T16:39:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22483.746999 secs 2024-04-21T16:39:34.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:34 smithi170 ceph-mon[31212]: pgmap v12083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:34.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:34 smithi077 ceph-mon[27902]: pgmap v12083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:34 smithi191 ceph-mon[31636]: pgmap v12083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22485.508013 secs 2024-04-21T16:39:35.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22485.508013 secs 2024-04-21T16:39:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22485.508013 secs 2024-04-21T16:39:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:36 smithi170 ceph-mon[31212]: pgmap v12084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:36 smithi077 ceph-mon[27902]: pgmap v12084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:36 smithi191 ceph-mon[31636]: pgmap v12084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:38 smithi077 ceph-mon[27902]: pgmap v12085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22488.747119 secs 2024-04-21T16:39:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:39:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:38 smithi191 ceph-mon[31636]: pgmap v12085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22488.747119 secs 2024-04-21T16:39:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:39:38.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:38 smithi170 ceph-mon[31212]: pgmap v12085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:38.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22488.747119 secs 2024-04-21T16:39:38.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:39:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22490.508073 secs 2024-04-21T16:39:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: pgmap v12086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22490.508073 secs 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: pgmap v12086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22490.508073 secs 2024-04-21T16:39:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: pgmap v12086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:39:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:39:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:39:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:39:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:41.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:39:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:39:41.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:39:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:39:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:42 smithi077 ceph-mon[27902]: pgmap v12087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:42 smithi191 ceph-mon[31636]: pgmap v12087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:42 smithi170 ceph-mon[31212]: pgmap v12087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22493.747238 secs 2024-04-21T16:39:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22493.747238 secs 2024-04-21T16:39:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22493.747238 secs 2024-04-21T16:39:44.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:44 smithi077 ceph-mon[27902]: pgmap v12088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:44 smithi191 ceph-mon[31636]: pgmap v12088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:44 smithi170 ceph-mon[31212]: pgmap v12088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22495.508213 secs 2024-04-21T16:39:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22495.508213 secs 2024-04-21T16:39:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22495.508213 secs 2024-04-21T16:39:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:46 smithi077 ceph-mon[27902]: pgmap v12089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:46 smithi191 ceph-mon[31636]: pgmap v12089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:46 smithi170 ceph-mon[31212]: pgmap v12089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:48 smithi077 ceph-mon[27902]: pgmap v12090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22498.747355 secs 2024-04-21T16:39:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:48 smithi191 ceph-mon[31636]: pgmap v12090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22498.747355 secs 2024-04-21T16:39:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:48 smithi170 ceph-mon[31212]: pgmap v12090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22498.747355 secs 2024-04-21T16:39:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22500.508332 secs 2024-04-21T16:39:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:50 smithi077 ceph-mon[27902]: pgmap v12091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22500.508332 secs 2024-04-21T16:39:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:50 smithi191 ceph-mon[31636]: pgmap v12091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22500.508332 secs 2024-04-21T16:39:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:50 smithi170 ceph-mon[31212]: pgmap v12091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:52 smithi077 ceph-mon[27902]: pgmap v12092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:52 smithi191 ceph-mon[31636]: pgmap v12092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:52 smithi170 ceph-mon[31212]: pgmap v12092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22503.747476 secs 2024-04-21T16:39:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22503.747476 secs 2024-04-21T16:39:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22503.747476 secs 2024-04-21T16:39:54.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:54 smithi077 ceph-mon[27902]: pgmap v12093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:54 smithi191 ceph-mon[31636]: pgmap v12093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:54 smithi170 ceph-mon[31212]: pgmap v12093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:39:55.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22505.508466 secs 2024-04-21T16:39:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22505.508466 secs 2024-04-21T16:39:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22505.508466 secs 2024-04-21T16:39:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:56 smithi077 ceph-mon[27902]: pgmap v12094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:56 smithi191 ceph-mon[31636]: pgmap v12094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:56 smithi170 ceph-mon[31212]: pgmap v12094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:39:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:58 smithi077 ceph-mon[27902]: pgmap v12095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:39:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22508.747573 secs 2024-04-21T16:39:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:58 smithi191 ceph-mon[31636]: pgmap v12095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:39:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22508.747573 secs 2024-04-21T16:39:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:58 smithi170 ceph-mon[31212]: pgmap v12095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:39:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:39:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22508.747573 secs 2024-04-21T16:40:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22510.508603 secs 2024-04-21T16:40:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:00 smithi077 ceph-mon[27902]: pgmap v12096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:40:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22510.508603 secs 2024-04-21T16:40:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:00 smithi191 ceph-mon[31636]: pgmap v12096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:40:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22510.508603 secs 2024-04-21T16:40:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:00 smithi170 ceph-mon[31212]: pgmap v12096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:40:02.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:02 smithi077 ceph-mon[27902]: pgmap v12097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:02 smithi191 ceph-mon[31636]: pgmap v12097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:02 smithi170 ceph-mon[31212]: pgmap v12097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22513.747717 secs 2024-04-21T16:40:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22513.747717 secs 2024-04-21T16:40:03.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22513.747717 secs 2024-04-21T16:40:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:04 smithi191 ceph-mon[31636]: pgmap v12098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:04 smithi170 ceph-mon[31212]: pgmap v12098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:04 smithi077 ceph-mon[27902]: pgmap v12098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22515.508744 secs 2024-04-21T16:40:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:05 smithi191 ceph-mon[31636]: osdmap e828: 12 total, 12 up, 12 in 2024-04-21T16:40:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22515.508744 secs 2024-04-21T16:40:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:05 smithi170 ceph-mon[31212]: osdmap e828: 12 total, 12 up, 12 in 2024-04-21T16:40:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22515.508744 secs 2024-04-21T16:40:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:05 smithi077 ceph-mon[27902]: osdmap e828: 12 total, 12 up, 12 in 2024-04-21T16:40:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:06 smithi191 ceph-mon[31636]: pgmap v12100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:06 smithi170 ceph-mon[31212]: pgmap v12100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:06.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:06 smithi077 ceph-mon[27902]: pgmap v12100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:08 smithi191 ceph-mon[31636]: pgmap v12101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:40:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22518.747840 secs 2024-04-21T16:40:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:08 smithi170 ceph-mon[31212]: pgmap v12101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:40:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22518.747840 secs 2024-04-21T16:40:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:08 smithi077 ceph-mon[27902]: pgmap v12101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:40:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22518.747840 secs 2024-04-21T16:40:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22520.508878 secs 2024-04-21T16:40:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:10 smithi191 ceph-mon[31636]: pgmap v12102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:40:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22520.508878 secs 2024-04-21T16:40:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:10 smithi170 ceph-mon[31212]: pgmap v12102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:40:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22520.508878 secs 2024-04-21T16:40:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:10 smithi077 ceph-mon[27902]: pgmap v12102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:40:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:12.468+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:40:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:12.468+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:40:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:12.468+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:40:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:12.468+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:40:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:12 smithi191 ceph-mon[31636]: pgmap v12103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:40:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:12 smithi170 ceph-mon[31212]: pgmap v12103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:40:12.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:12 smithi077 ceph-mon[27902]: pgmap v12103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:40:13.668 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22523.747965 secs 2024-04-21T16:40:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22523.747965 secs 2024-04-21T16:40:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22523.747965 secs 2024-04-21T16:40:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:14 smithi191 ceph-mon[31636]: pgmap v12104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:40:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:14 smithi170 ceph-mon[31212]: pgmap v12104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:40:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:14 smithi077 ceph-mon[27902]: pgmap v12104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:40:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22525.508990 secs 2024-04-21T16:40:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22525.508990 secs 2024-04-21T16:40:15.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22525.508990 secs 2024-04-21T16:40:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:16 smithi191 ceph-mon[31636]: pgmap v12105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:40:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:16 smithi191 ceph-mon[31636]: osdmap e829: 12 total, 12 up, 12 in 2024-04-21T16:40:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:16 smithi170 ceph-mon[31212]: pgmap v12105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:40:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:16 smithi170 ceph-mon[31212]: osdmap e829: 12 total, 12 up, 12 in 2024-04-21T16:40:16.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:16 smithi077 ceph-mon[27902]: pgmap v12105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:40:16.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:16 smithi077 ceph-mon[27902]: osdmap e829: 12 total, 12 up, 12 in 2024-04-21T16:40:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:18 smithi191 ceph-mon[31636]: pgmap v12107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:40:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22528.748039 secs 2024-04-21T16:40:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:18 smithi170 ceph-mon[31212]: pgmap v12107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:40:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22528.748039 secs 2024-04-21T16:40:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:18 smithi077 ceph-mon[27902]: pgmap v12107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:40:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22528.748039 secs 2024-04-21T16:40:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22530.509107 secs 2024-04-21T16:40:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:20 smithi191 ceph-mon[31636]: pgmap v12108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:40:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22530.509107 secs 2024-04-21T16:40:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:20 smithi170 ceph-mon[31212]: pgmap v12108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:40:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22530.509107 secs 2024-04-21T16:40:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:20 smithi077 ceph-mon[27902]: pgmap v12108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:40:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:22 smithi191 ceph-mon[31636]: pgmap v12109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:22 smithi170 ceph-mon[31212]: pgmap v12109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:22.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:22 smithi077 ceph-mon[27902]: pgmap v12109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22533.748161 secs 2024-04-21T16:40:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22533.748161 secs 2024-04-21T16:40:23.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22533.748161 secs 2024-04-21T16:40:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:24 smithi191 ceph-mon[31636]: pgmap v12110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:24 smithi170 ceph-mon[31212]: pgmap v12110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:24.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:24 smithi077 ceph-mon[27902]: pgmap v12110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22535.509228 secs 2024-04-21T16:40:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22535.509228 secs 2024-04-21T16:40:25.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22535.509228 secs 2024-04-21T16:40:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:26 smithi191 ceph-mon[31636]: pgmap v12111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:26 smithi170 ceph-mon[31212]: pgmap v12111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:26.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:26 smithi077 ceph-mon[27902]: pgmap v12111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:40:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:28 smithi191 ceph-mon[31636]: pgmap v12112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:40:28.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22538.748223 secs 2024-04-21T16:40:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:28 smithi170 ceph-mon[31212]: pgmap v12112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:40:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22538.748223 secs 2024-04-21T16:40:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:28 smithi077 ceph-mon[27902]: pgmap v12112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:40:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22538.748223 secs 2024-04-21T16:40:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22540.509345 secs 2024-04-21T16:40:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:30 smithi170 ceph-mon[31212]: pgmap v12113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22540.509345 secs 2024-04-21T16:40:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:30 smithi077 ceph-mon[27902]: pgmap v12113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22540.509345 secs 2024-04-21T16:40:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:30 smithi191 ceph-mon[31636]: pgmap v12113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:32 smithi170 ceph-mon[31212]: pgmap v12114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:32.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:32 smithi077 ceph-mon[27902]: pgmap v12114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:32 smithi191 ceph-mon[31636]: pgmap v12114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22543.748352 secs 2024-04-21T16:40:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22543.748352 secs 2024-04-21T16:40:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22543.748352 secs 2024-04-21T16:40:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:34 smithi170 ceph-mon[31212]: pgmap v12115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:34.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:34 smithi077 ceph-mon[27902]: pgmap v12115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:34.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:34 smithi191 ceph-mon[31636]: pgmap v12115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22545.509479 secs 2024-04-21T16:40:35.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22545.509479 secs 2024-04-21T16:40:35.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22545.509479 secs 2024-04-21T16:40:36.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:36 smithi170 ceph-mon[31212]: pgmap v12116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:36 smithi077 ceph-mon[27902]: pgmap v12116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:36 smithi191 ceph-mon[31636]: pgmap v12116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:38 smithi170 ceph-mon[31212]: pgmap v12117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:38.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22548.748486 secs 2024-04-21T16:40:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:38 smithi077 ceph-mon[27902]: pgmap v12117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22548.748486 secs 2024-04-21T16:40:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:38 smithi191 ceph-mon[31636]: pgmap v12117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22548.748486 secs 2024-04-21T16:40:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22550.509586 secs 2024-04-21T16:40:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:40 smithi170 ceph-mon[31212]: pgmap v12118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:40:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22550.509586 secs 2024-04-21T16:40:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:40 smithi077 ceph-mon[27902]: pgmap v12118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:40:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22550.509586 secs 2024-04-21T16:40:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:40 smithi191 ceph-mon[31636]: pgmap v12118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:40:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:40:42.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:41 smithi191 ceph-mon[31636]: pgmap v12119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:42.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:40:42.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:40:42.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:41 smithi170 ceph-mon[31212]: pgmap v12119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:42.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:40:42.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:40:42.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:41 smithi077 ceph-mon[27902]: pgmap v12119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:40:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:40:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:40:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22553.748612 secs 2024-04-21T16:40:43.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22553.748612 secs 2024-04-21T16:40:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22553.748612 secs 2024-04-21T16:40:44.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:43 smithi191 ceph-mon[31636]: pgmap v12120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:43 smithi170 ceph-mon[31212]: pgmap v12120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:44.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:43 smithi077 ceph-mon[27902]: pgmap v12120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22555.509728 secs 2024-04-21T16:40:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22555.509728 secs 2024-04-21T16:40:45.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22555.509728 secs 2024-04-21T16:40:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:45 smithi170 ceph-mon[31212]: pgmap v12121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:46.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:45 smithi077 ceph-mon[27902]: pgmap v12121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:46.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:45 smithi191 ceph-mon[31636]: pgmap v12121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:47 smithi170 ceph-mon[31212]: pgmap v12122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22558.748731 secs 2024-04-21T16:40:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:47 smithi077 ceph-mon[27902]: pgmap v12122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22558.748731 secs 2024-04-21T16:40:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:47 smithi191 ceph-mon[31636]: pgmap v12122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22558.748731 secs 2024-04-21T16:40:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22560.509791 secs 2024-04-21T16:40:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:49 smithi170 ceph-mon[31212]: pgmap v12123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22560.509791 secs 2024-04-21T16:40:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:49 smithi077 ceph-mon[27902]: pgmap v12123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22560.509791 secs 2024-04-21T16:40:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:49 smithi191 ceph-mon[31636]: pgmap v12123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:52.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:51 smithi170 ceph-mon[31212]: pgmap v12124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:52.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:51 smithi077 ceph-mon[27902]: pgmap v12124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:52.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:51 smithi191 ceph-mon[31636]: pgmap v12124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:53.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22563.748852 secs 2024-04-21T16:40:53.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22563.748852 secs 2024-04-21T16:40:53.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22563.748852 secs 2024-04-21T16:40:54.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:53 smithi170 ceph-mon[31212]: pgmap v12125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:54.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:53 smithi077 ceph-mon[27902]: pgmap v12125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:54.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:53 smithi191 ceph-mon[31636]: pgmap v12125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:40:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22565.509947 secs 2024-04-21T16:40:55.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22565.509947 secs 2024-04-21T16:40:55.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22565.509947 secs 2024-04-21T16:40:56.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:56 smithi170 ceph-mon[31212]: pgmap v12126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:56.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:55 smithi077 ceph-mon[27902]: pgmap v12126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:56.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:55 smithi191 ceph-mon[31636]: pgmap v12126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:40:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:57.474+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:40:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:57.474+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:40:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:57.474+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:40:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:40:57.474+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:40:58.273 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:58 smithi191 ceph-mon[31636]: pgmap v12127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:58.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:40:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22568.748974 secs 2024-04-21T16:40:58.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:58 smithi170 ceph-mon[31212]: pgmap v12127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:58.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:40:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22568.748974 secs 2024-04-21T16:40:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:58 smithi077 ceph-mon[27902]: pgmap v12127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:40:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:40:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22568.748974 secs 2024-04-21T16:41:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22570.510060 secs 2024-04-21T16:41:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:00 smithi170 ceph-mon[31212]: pgmap v12128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22570.510060 secs 2024-04-21T16:41:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:00 smithi077 ceph-mon[27902]: pgmap v12128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22570.510060 secs 2024-04-21T16:41:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:00 smithi191 ceph-mon[31636]: pgmap v12128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:02.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:02 smithi170 ceph-mon[31212]: pgmap v12129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:02.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:02 smithi077 ceph-mon[27902]: pgmap v12129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:02 smithi191 ceph-mon[31636]: pgmap v12129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22573.749079 secs 2024-04-21T16:41:03.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22573.749079 secs 2024-04-21T16:41:03.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22573.749079 secs 2024-04-21T16:41:04.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:04 smithi170 ceph-mon[31212]: pgmap v12130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:04 smithi077 ceph-mon[27902]: pgmap v12130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:04 smithi191 ceph-mon[31636]: pgmap v12130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22575.510205 secs 2024-04-21T16:41:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:05 smithi170 ceph-mon[31212]: osdmap e830: 12 total, 12 up, 12 in 2024-04-21T16:41:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22575.510205 secs 2024-04-21T16:41:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:05 smithi077 ceph-mon[27902]: osdmap e830: 12 total, 12 up, 12 in 2024-04-21T16:41:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22575.510205 secs 2024-04-21T16:41:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:05 smithi191 ceph-mon[31636]: osdmap e830: 12 total, 12 up, 12 in 2024-04-21T16:41:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:06 smithi170 ceph-mon[31212]: pgmap v12132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:41:06.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:06 smithi077 ceph-mon[27902]: pgmap v12132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:41:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:06 smithi191 ceph-mon[31636]: pgmap v12132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:41:08.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:08 smithi170 ceph-mon[31212]: pgmap v12133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:41:08.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22578.749176 secs 2024-04-21T16:41:08.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:08 smithi077 ceph-mon[27902]: pgmap v12133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:41:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22578.749176 secs 2024-04-21T16:41:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:08 smithi191 ceph-mon[31636]: pgmap v12133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:41:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22578.749176 secs 2024-04-21T16:41:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22580.510347 secs 2024-04-21T16:41:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:10 smithi170 ceph-mon[31212]: pgmap v12134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:41:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22580.510347 secs 2024-04-21T16:41:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:10 smithi077 ceph-mon[27902]: pgmap v12134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:41:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22580.510347 secs 2024-04-21T16:41:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:10 smithi191 ceph-mon[31636]: pgmap v12134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:41:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:12 smithi170 ceph-mon[31212]: pgmap v12135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:41:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:12 smithi170 ceph-mon[31212]: osdmap e831: 12 total, 12 up, 12 in 2024-04-21T16:41:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:12 smithi077 ceph-mon[27902]: pgmap v12135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:41:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:12 smithi077 ceph-mon[27902]: osdmap e831: 12 total, 12 up, 12 in 2024-04-21T16:41:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:12 smithi191 ceph-mon[31636]: pgmap v12135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:41:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:12 smithi191 ceph-mon[31636]: osdmap e831: 12 total, 12 up, 12 in 2024-04-21T16:41:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22583.749290 secs 2024-04-21T16:41:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22583.749290 secs 2024-04-21T16:41:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22583.749290 secs 2024-04-21T16:41:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:14 smithi170 ceph-mon[31212]: pgmap v12137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T16:41:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:14 smithi077 ceph-mon[27902]: pgmap v12137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T16:41:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:14 smithi191 ceph-mon[31636]: pgmap v12137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T16:41:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22585.510404 secs 2024-04-21T16:41:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22585.510404 secs 2024-04-21T16:41:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22585.510404 secs 2024-04-21T16:41:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:16 smithi170 ceph-mon[31212]: pgmap v12138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:41:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:16 smithi077 ceph-mon[27902]: pgmap v12138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:41:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:16 smithi191 ceph-mon[31636]: pgmap v12138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:41:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:18 smithi170 ceph-mon[31212]: pgmap v12139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:41:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22588.749430 secs 2024-04-21T16:41:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:18 smithi077 ceph-mon[27902]: pgmap v12139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:41:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22588.749430 secs 2024-04-21T16:41:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:18 smithi191 ceph-mon[31636]: pgmap v12139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:41:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22588.749430 secs 2024-04-21T16:41:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22590.510550 secs 2024-04-21T16:41:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:20 smithi170 ceph-mon[31212]: pgmap v12140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:41:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22590.510550 secs 2024-04-21T16:41:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:20 smithi077 ceph-mon[27902]: pgmap v12140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:41:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22590.510550 secs 2024-04-21T16:41:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:20 smithi191 ceph-mon[31636]: pgmap v12140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:41:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:22 smithi170 ceph-mon[31212]: pgmap v12141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:41:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:22 smithi077 ceph-mon[27902]: pgmap v12141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:41:22.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:22 smithi191 ceph-mon[31636]: pgmap v12141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:41:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22593.749571 secs 2024-04-21T16:41:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22593.749571 secs 2024-04-21T16:41:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22593.749571 secs 2024-04-21T16:41:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:24 smithi170 ceph-mon[31212]: pgmap v12142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:41:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:24 smithi077 ceph-mon[27902]: pgmap v12142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:41:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:24 smithi191 ceph-mon[31636]: pgmap v12142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:41:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22595.510672 secs 2024-04-21T16:41:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22595.510672 secs 2024-04-21T16:41:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22595.510672 secs 2024-04-21T16:41:26.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:26 smithi170 ceph-mon[31212]: pgmap v12143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:26 smithi077 ceph-mon[27902]: pgmap v12143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:26.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:26 smithi191 ceph-mon[31636]: pgmap v12143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:28 smithi170 ceph-mon[31212]: pgmap v12144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22598.749680 secs 2024-04-21T16:41:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:28 smithi077 ceph-mon[27902]: pgmap v12144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22598.749680 secs 2024-04-21T16:41:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:28 smithi191 ceph-mon[31636]: pgmap v12144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22598.749680 secs 2024-04-21T16:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22600.510794 secs 2024-04-21T16:41:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:30 smithi077 ceph-mon[27902]: pgmap v12145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22600.510794 secs 2024-04-21T16:41:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:30 smithi191 ceph-mon[31636]: pgmap v12145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22600.510794 secs 2024-04-21T16:41:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:30 smithi170 ceph-mon[31212]: pgmap v12145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:32 smithi077 ceph-mon[27902]: pgmap v12146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:32 smithi191 ceph-mon[31636]: pgmap v12146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:32 smithi170 ceph-mon[31212]: pgmap v12146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22603.749797 secs 2024-04-21T16:41:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22603.749797 secs 2024-04-21T16:41:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22603.749797 secs 2024-04-21T16:41:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:34 smithi077 ceph-mon[27902]: pgmap v12147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:34 smithi191 ceph-mon[31636]: pgmap v12147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:34 smithi170 ceph-mon[31212]: pgmap v12147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22605.510916 secs 2024-04-21T16:41:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22605.510916 secs 2024-04-21T16:41:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22605.510916 secs 2024-04-21T16:41:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:36 smithi077 ceph-mon[27902]: pgmap v12148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:36 smithi191 ceph-mon[31636]: pgmap v12148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:36 smithi170 ceph-mon[31212]: pgmap v12148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:38 smithi077 ceph-mon[27902]: pgmap v12149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22608.749917 secs 2024-04-21T16:41:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:38 smithi191 ceph-mon[31636]: pgmap v12149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22608.749917 secs 2024-04-21T16:41:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:38 smithi170 ceph-mon[31212]: pgmap v12149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22608.749917 secs 2024-04-21T16:41:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22610.511033 secs 2024-04-21T16:41:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:40 smithi077 ceph-mon[27902]: pgmap v12150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22610.511033 secs 2024-04-21T16:41:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:40 smithi191 ceph-mon[31636]: pgmap v12150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22610.511033 secs 2024-04-21T16:41:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:40 smithi170 ceph-mon[31212]: pgmap v12150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:42 smithi077 ceph-mon[27902]: pgmap v12151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:41:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:42 smithi191 ceph-mon[31636]: pgmap v12151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:41:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:42 smithi170 ceph-mon[31212]: pgmap v12151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:41:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22613.749993 secs 2024-04-21T16:41:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:41:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:41:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22613.749993 secs 2024-04-21T16:41:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:41:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:41:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22613.749993 secs 2024-04-21T16:41:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:41:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:41:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:41:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:44 smithi077 ceph-mon[27902]: pgmap v12152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:44 smithi191 ceph-mon[31636]: pgmap v12152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:44 smithi170 ceph-mon[31212]: pgmap v12152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22615.511150 secs 2024-04-21T16:41:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22615.511150 secs 2024-04-21T16:41:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22615.511150 secs 2024-04-21T16:41:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:46 smithi077 ceph-mon[27902]: pgmap v12153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:46 smithi191 ceph-mon[31636]: pgmap v12153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:46 smithi170 ceph-mon[31212]: pgmap v12153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:48 smithi077 ceph-mon[27902]: pgmap v12154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22618.750117 secs 2024-04-21T16:41:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:48 smithi191 ceph-mon[31636]: pgmap v12154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22618.750117 secs 2024-04-21T16:41:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:48 smithi170 ceph-mon[31212]: pgmap v12154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22618.750117 secs 2024-04-21T16:41:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22620.511274 secs 2024-04-21T16:41:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:50 smithi077 ceph-mon[27902]: pgmap v12155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22620.511274 secs 2024-04-21T16:41:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:50 smithi191 ceph-mon[31636]: pgmap v12155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22620.511274 secs 2024-04-21T16:41:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:50 smithi170 ceph-mon[31212]: pgmap v12155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:52 smithi077 ceph-mon[27902]: pgmap v12156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:52 smithi191 ceph-mon[31636]: pgmap v12156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:52 smithi170 ceph-mon[31212]: pgmap v12156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22623.750239 secs 2024-04-21T16:41:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22623.750239 secs 2024-04-21T16:41:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22623.750239 secs 2024-04-21T16:41:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:54 smithi077 ceph-mon[27902]: pgmap v12157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:54 smithi191 ceph-mon[31636]: pgmap v12157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:54 smithi170 ceph-mon[31212]: pgmap v12157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:41:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22625.511415 secs 2024-04-21T16:41:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22625.511415 secs 2024-04-21T16:41:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22625.511415 secs 2024-04-21T16:41:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:56 smithi077 ceph-mon[27902]: pgmap v12158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:56 smithi191 ceph-mon[31636]: pgmap v12158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:56 smithi170 ceph-mon[31212]: pgmap v12158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:41:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:58 smithi077 ceph-mon[27902]: pgmap v12159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:41:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22628.750329 secs 2024-04-21T16:41:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:58 smithi191 ceph-mon[31636]: pgmap v12159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:41:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22628.750329 secs 2024-04-21T16:41:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:58 smithi170 ceph-mon[31212]: pgmap v12159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:41:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:41:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22628.750329 secs 2024-04-21T16:42:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22630.511552 secs 2024-04-21T16:42:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:00 smithi077 ceph-mon[27902]: pgmap v12160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22630.511552 secs 2024-04-21T16:42:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:00 smithi191 ceph-mon[31636]: pgmap v12160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22630.511552 secs 2024-04-21T16:42:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:00 smithi170 ceph-mon[31212]: pgmap v12160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:02 smithi191 ceph-mon[31636]: pgmap v12161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:02 smithi170 ceph-mon[31212]: pgmap v12161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:02 smithi077 ceph-mon[27902]: pgmap v12161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22633.750455 secs 2024-04-21T16:42:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22633.750455 secs 2024-04-21T16:42:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22633.750455 secs 2024-04-21T16:42:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:04 smithi191 ceph-mon[31636]: pgmap v12162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:04 smithi170 ceph-mon[31212]: pgmap v12162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:04 smithi077 ceph-mon[27902]: pgmap v12162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22635.511681 secs 2024-04-21T16:42:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:05 smithi191 ceph-mon[31636]: osdmap e832: 12 total, 12 up, 12 in 2024-04-21T16:42:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22635.511681 secs 2024-04-21T16:42:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:05 smithi170 ceph-mon[31212]: osdmap e832: 12 total, 12 up, 12 in 2024-04-21T16:42:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22635.511681 secs 2024-04-21T16:42:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:05 smithi077 ceph-mon[27902]: osdmap e832: 12 total, 12 up, 12 in 2024-04-21T16:42:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:06 smithi191 ceph-mon[31636]: pgmap v12164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:42:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:06 smithi170 ceph-mon[31212]: pgmap v12164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:42:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:06 smithi077 ceph-mon[27902]: pgmap v12164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:42:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:08 smithi191 ceph-mon[31636]: pgmap v12165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22638.750576 secs 2024-04-21T16:42:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:08 smithi170 ceph-mon[31212]: pgmap v12165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22638.750576 secs 2024-04-21T16:42:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:08 smithi077 ceph-mon[27902]: pgmap v12165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22638.750576 secs 2024-04-21T16:42:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22640.511779 secs 2024-04-21T16:42:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:10 smithi191 ceph-mon[31636]: pgmap v12166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22640.511779 secs 2024-04-21T16:42:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:10 smithi170 ceph-mon[31212]: pgmap v12166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22640.511779 secs 2024-04-21T16:42:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:10 smithi077 ceph-mon[27902]: pgmap v12166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:12 smithi170 ceph-mon[31212]: pgmap v12167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:12 smithi170 ceph-mon[31212]: osdmap e833: 12 total, 12 up, 12 in 2024-04-21T16:42:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:12 smithi077 ceph-mon[27902]: pgmap v12167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:12 smithi077 ceph-mon[27902]: osdmap e833: 12 total, 12 up, 12 in 2024-04-21T16:42:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:12 smithi191 ceph-mon[31636]: pgmap v12167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:12 smithi191 ceph-mon[31636]: osdmap e833: 12 total, 12 up, 12 in 2024-04-21T16:42:13.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22643.750719 secs 2024-04-21T16:42:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22643.750719 secs 2024-04-21T16:42:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22643.750719 secs 2024-04-21T16:42:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:14 smithi170 ceph-mon[31212]: pgmap v12169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:42:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:14 smithi077 ceph-mon[27902]: pgmap v12169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:42:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:14 smithi191 ceph-mon[31636]: pgmap v12169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:42:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22645.511927 secs 2024-04-21T16:42:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22645.511927 secs 2024-04-21T16:42:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22645.511927 secs 2024-04-21T16:42:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:16 smithi170 ceph-mon[31212]: pgmap v12170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:16 smithi077 ceph-mon[27902]: pgmap v12170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:16 smithi191 ceph-mon[31636]: pgmap v12170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:42:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:18 smithi170 ceph-mon[31212]: pgmap v12171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:42:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22648.750802 secs 2024-04-21T16:42:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:18 smithi077 ceph-mon[27902]: pgmap v12171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:42:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22648.750802 secs 2024-04-21T16:42:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:18 smithi191 ceph-mon[31636]: pgmap v12171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:42:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22648.750802 secs 2024-04-21T16:42:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22650.512051 secs 2024-04-21T16:42:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:20 smithi170 ceph-mon[31212]: pgmap v12172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:42:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22650.512051 secs 2024-04-21T16:42:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:20 smithi077 ceph-mon[27902]: pgmap v12172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:42:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22650.512051 secs 2024-04-21T16:42:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:20 smithi191 ceph-mon[31636]: pgmap v12172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:42:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:22 smithi170 ceph-mon[31212]: pgmap v12173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:42:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:22 smithi077 ceph-mon[27902]: pgmap v12173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:42:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:22 smithi191 ceph-mon[31636]: pgmap v12173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:42:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22653.750896 secs 2024-04-21T16:42:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22653.750896 secs 2024-04-21T16:42:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22653.750896 secs 2024-04-21T16:42:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:24 smithi077 ceph-mon[27902]: pgmap v12174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:42:24.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:24 smithi191 ceph-mon[31636]: pgmap v12174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:42:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:24 smithi170 ceph-mon[31212]: pgmap v12174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:42:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22655.512164 secs 2024-04-21T16:42:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22655.512164 secs 2024-04-21T16:42:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22655.512164 secs 2024-04-21T16:42:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:26 smithi077 ceph-mon[27902]: pgmap v12175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:26 smithi191 ceph-mon[31636]: pgmap v12175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:26 smithi170 ceph-mon[31212]: pgmap v12175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:28.611 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:28 smithi170 ceph-mon[31212]: pgmap v12176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:28.611 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22658.750965 secs 2024-04-21T16:42:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:28 smithi077 ceph-mon[27902]: pgmap v12176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22658.750965 secs 2024-04-21T16:42:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:28 smithi191 ceph-mon[31636]: pgmap v12176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22658.750965 secs 2024-04-21T16:42:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22660.512285 secs 2024-04-21T16:42:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:30 smithi077 ceph-mon[27902]: pgmap v12177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22660.512285 secs 2024-04-21T16:42:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:30 smithi191 ceph-mon[31636]: pgmap v12177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22660.512285 secs 2024-04-21T16:42:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:30 smithi170 ceph-mon[31212]: pgmap v12177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:32 smithi077 ceph-mon[27902]: pgmap v12178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:32 smithi191 ceph-mon[31636]: pgmap v12178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:32 smithi170 ceph-mon[31212]: pgmap v12178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22663.751076 secs 2024-04-21T16:42:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22663.751076 secs 2024-04-21T16:42:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22663.751076 secs 2024-04-21T16:42:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:34 smithi077 ceph-mon[27902]: pgmap v12179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:34 smithi191 ceph-mon[31636]: pgmap v12179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:34 smithi170 ceph-mon[31212]: pgmap v12179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22665.512392 secs 2024-04-21T16:42:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22665.512392 secs 2024-04-21T16:42:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22665.512392 secs 2024-04-21T16:42:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:36 smithi077 ceph-mon[27902]: pgmap v12180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:36.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:36 smithi191 ceph-mon[31636]: pgmap v12180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:36 smithi170 ceph-mon[31212]: pgmap v12180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:38 smithi077 ceph-mon[27902]: pgmap v12181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22668.751140 secs 2024-04-21T16:42:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:38 smithi191 ceph-mon[31636]: pgmap v12181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22668.751140 secs 2024-04-21T16:42:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:38 smithi170 ceph-mon[31212]: pgmap v12181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22668.751140 secs 2024-04-21T16:42:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22670.512458 secs 2024-04-21T16:42:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:40 smithi077 ceph-mon[27902]: pgmap v12182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22670.512458 secs 2024-04-21T16:42:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:40 smithi191 ceph-mon[31636]: pgmap v12182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22670.512458 secs 2024-04-21T16:42:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:40 smithi170 ceph-mon[31212]: pgmap v12182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:42 smithi077 ceph-mon[27902]: pgmap v12183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:42 smithi191 ceph-mon[31636]: pgmap v12183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:42 smithi170 ceph-mon[31212]: pgmap v12183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22673.751263 secs 2024-04-21T16:42:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:42:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22673.751263 secs 2024-04-21T16:42:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:42:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22673.751263 secs 2024-04-21T16:42:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:42:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:44 smithi077 ceph-mon[27902]: pgmap v12184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:42:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:42:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:42:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:44 smithi191 ceph-mon[31636]: pgmap v12184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:42:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:42:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:42:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:44 smithi170 ceph-mon[31212]: pgmap v12184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:42:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:42:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:42:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22675.512651 secs 2024-04-21T16:42:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22675.512651 secs 2024-04-21T16:42:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22675.512651 secs 2024-04-21T16:42:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:46 smithi077 ceph-mon[27902]: pgmap v12185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:46 smithi191 ceph-mon[31636]: pgmap v12185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:46 smithi170 ceph-mon[31212]: pgmap v12185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:48 smithi077 ceph-mon[27902]: pgmap v12186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22678.751376 secs 2024-04-21T16:42:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:48 smithi191 ceph-mon[31636]: pgmap v12186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22678.751376 secs 2024-04-21T16:42:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:48 smithi170 ceph-mon[31212]: pgmap v12186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22678.751376 secs 2024-04-21T16:42:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22680.512764 secs 2024-04-21T16:42:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:50 smithi077 ceph-mon[27902]: pgmap v12187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22680.512764 secs 2024-04-21T16:42:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:50 smithi191 ceph-mon[31636]: pgmap v12187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22680.512764 secs 2024-04-21T16:42:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:50 smithi170 ceph-mon[31212]: pgmap v12187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:52 smithi077 ceph-mon[27902]: pgmap v12188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:52 smithi191 ceph-mon[31636]: pgmap v12188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:52 smithi170 ceph-mon[31212]: pgmap v12188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22683.751514 secs 2024-04-21T16:42:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22683.751514 secs 2024-04-21T16:42:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22683.751514 secs 2024-04-21T16:42:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:54 smithi191 ceph-mon[31636]: pgmap v12189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:54 smithi170 ceph-mon[31212]: pgmap v12189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:54 smithi077 ceph-mon[27902]: pgmap v12189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:42:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22685.512881 secs 2024-04-21T16:42:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22685.512881 secs 2024-04-21T16:42:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22685.512881 secs 2024-04-21T16:42:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:56 smithi191 ceph-mon[31636]: pgmap v12190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:56 smithi170 ceph-mon[31212]: pgmap v12190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:56 smithi077 ceph-mon[27902]: pgmap v12190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:42:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:58 smithi191 ceph-mon[31636]: pgmap v12191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:42:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22688.751575 secs 2024-04-21T16:42:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:58 smithi170 ceph-mon[31212]: pgmap v12191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:42:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22688.751575 secs 2024-04-21T16:42:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:58 smithi077 ceph-mon[27902]: pgmap v12191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:42:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:42:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22688.751575 secs 2024-04-21T16:43:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22690.512982 secs 2024-04-21T16:43:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:00 smithi191 ceph-mon[31636]: pgmap v12192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22690.512982 secs 2024-04-21T16:43:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:00 smithi170 ceph-mon[31212]: pgmap v12192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22690.512982 secs 2024-04-21T16:43:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:00 smithi077 ceph-mon[27902]: pgmap v12192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:02 smithi191 ceph-mon[31636]: pgmap v12193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:02 smithi170 ceph-mon[31212]: pgmap v12193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:02 smithi077 ceph-mon[27902]: pgmap v12193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22693.751701 secs 2024-04-21T16:43:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22693.751701 secs 2024-04-21T16:43:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22693.751701 secs 2024-04-21T16:43:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:04 smithi191 ceph-mon[31636]: pgmap v12194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:43:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:04 smithi170 ceph-mon[31212]: pgmap v12194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:43:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:04 smithi077 ceph-mon[27902]: pgmap v12194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:43:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22695.513061 secs 2024-04-21T16:43:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:05 smithi191 ceph-mon[31636]: osdmap e834: 12 total, 12 up, 12 in 2024-04-21T16:43:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22695.513061 secs 2024-04-21T16:43:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:05 smithi170 ceph-mon[31212]: osdmap e834: 12 total, 12 up, 12 in 2024-04-21T16:43:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22695.513061 secs 2024-04-21T16:43:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:05 smithi077 ceph-mon[27902]: osdmap e834: 12 total, 12 up, 12 in 2024-04-21T16:43:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:06 smithi191 ceph-mon[31636]: pgmap v12196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:43:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:06 smithi170 ceph-mon[31212]: pgmap v12196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:43:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:06 smithi077 ceph-mon[27902]: pgmap v12196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:43:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:08 smithi191 ceph-mon[31636]: pgmap v12197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:43:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22698.751769 secs 2024-04-21T16:43:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:08 smithi170 ceph-mon[31212]: pgmap v12197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:43:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22698.751769 secs 2024-04-21T16:43:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:08 smithi077 ceph-mon[27902]: pgmap v12197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:43:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22698.751769 secs 2024-04-21T16:43:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22700.513176 secs 2024-04-21T16:43:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:10 smithi191 ceph-mon[31636]: pgmap v12198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:43:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22700.513176 secs 2024-04-21T16:43:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:10 smithi170 ceph-mon[31212]: pgmap v12198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:43:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22700.513176 secs 2024-04-21T16:43:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:10 smithi077 ceph-mon[27902]: pgmap v12198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:43:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:12 smithi170 ceph-mon[31212]: pgmap v12199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:43:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:12 smithi170 ceph-mon[31212]: osdmap e835: 12 total, 12 up, 12 in 2024-04-21T16:43:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:12 smithi077 ceph-mon[27902]: pgmap v12199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:43:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:12 smithi077 ceph-mon[27902]: osdmap e835: 12 total, 12 up, 12 in 2024-04-21T16:43:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:12 smithi191 ceph-mon[31636]: pgmap v12199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:43:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:12 smithi191 ceph-mon[31636]: osdmap e835: 12 total, 12 up, 12 in 2024-04-21T16:43:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22703.751887 secs 2024-04-21T16:43:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22703.751887 secs 2024-04-21T16:43:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22703.751887 secs 2024-04-21T16:43:14.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:14 smithi170 ceph-mon[31212]: pgmap v12201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:43:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:14 smithi077 ceph-mon[27902]: pgmap v12201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:43:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:14 smithi191 ceph-mon[31636]: pgmap v12201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:43:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22705.513258 secs 2024-04-21T16:43:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22705.513258 secs 2024-04-21T16:43:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22705.513258 secs 2024-04-21T16:43:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:16 smithi170 ceph-mon[31212]: pgmap v12202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:43:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:16 smithi077 ceph-mon[27902]: pgmap v12202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:43:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:16 smithi191 ceph-mon[31636]: pgmap v12202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:43:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:18 smithi077 ceph-mon[27902]: pgmap v12203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:43:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22708.752008 secs 2024-04-21T16:43:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:18 smithi191 ceph-mon[31636]: pgmap v12203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:43:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22708.752008 secs 2024-04-21T16:43:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:18 smithi170 ceph-mon[31212]: pgmap v12203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:43:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22708.752008 secs 2024-04-21T16:43:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22710.513337 secs 2024-04-21T16:43:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:20 smithi077 ceph-mon[27902]: pgmap v12204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:43:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22710.513337 secs 2024-04-21T16:43:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:20 smithi191 ceph-mon[31636]: pgmap v12204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:43:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22710.513337 secs 2024-04-21T16:43:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:20 smithi170 ceph-mon[31212]: pgmap v12204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:43:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:22 smithi077 ceph-mon[27902]: pgmap v12205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:43:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:22 smithi191 ceph-mon[31636]: pgmap v12205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:43:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:22 smithi170 ceph-mon[31212]: pgmap v12205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:43:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22713.752072 secs 2024-04-21T16:43:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22713.752072 secs 2024-04-21T16:43:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22713.752072 secs 2024-04-21T16:43:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:24 smithi077 ceph-mon[27902]: pgmap v12206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:43:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:24 smithi191 ceph-mon[31636]: pgmap v12206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:43:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:24 smithi170 ceph-mon[31212]: pgmap v12206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:43:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22715.513453 secs 2024-04-21T16:43:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22715.513453 secs 2024-04-21T16:43:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22715.513453 secs 2024-04-21T16:43:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:26 smithi077 ceph-mon[27902]: pgmap v12207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:26 smithi191 ceph-mon[31636]: pgmap v12207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:26 smithi170 ceph-mon[31212]: pgmap v12207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:28.611 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:28 smithi170 ceph-mon[31212]: pgmap v12208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:28.611 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22718.752191 secs 2024-04-21T16:43:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:28 smithi077 ceph-mon[27902]: pgmap v12208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22718.752191 secs 2024-04-21T16:43:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:28 smithi191 ceph-mon[31636]: pgmap v12208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22718.752191 secs 2024-04-21T16:43:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22720.513568 secs 2024-04-21T16:43:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:30 smithi077 ceph-mon[27902]: pgmap v12209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22720.513568 secs 2024-04-21T16:43:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:30 smithi191 ceph-mon[31636]: pgmap v12209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22720.513568 secs 2024-04-21T16:43:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:30 smithi170 ceph-mon[31212]: pgmap v12209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:32 smithi077 ceph-mon[27902]: pgmap v12210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:32 smithi191 ceph-mon[31636]: pgmap v12210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:32 smithi170 ceph-mon[31212]: pgmap v12210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22723.752328 secs 2024-04-21T16:43:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22723.752328 secs 2024-04-21T16:43:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22723.752328 secs 2024-04-21T16:43:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:34 smithi077 ceph-mon[27902]: pgmap v12211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:34.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:34 smithi191 ceph-mon[31636]: pgmap v12211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:34 smithi170 ceph-mon[31212]: pgmap v12211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22725.513682 secs 2024-04-21T16:43:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22725.513682 secs 2024-04-21T16:43:35.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22725.513682 secs 2024-04-21T16:43:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:36 smithi077 ceph-mon[27902]: pgmap v12212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:36 smithi191 ceph-mon[31636]: pgmap v12212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:36 smithi170 ceph-mon[31212]: pgmap v12212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:38 smithi077 ceph-mon[27902]: pgmap v12213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22728.752436 secs 2024-04-21T16:43:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:38 smithi191 ceph-mon[31636]: pgmap v12213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22728.752436 secs 2024-04-21T16:43:38.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:38 smithi170 ceph-mon[31212]: pgmap v12213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:38.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22728.752436 secs 2024-04-21T16:43:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22730.513795 secs 2024-04-21T16:43:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:40 smithi077 ceph-mon[27902]: pgmap v12214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22730.513795 secs 2024-04-21T16:43:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:40 smithi191 ceph-mon[31636]: pgmap v12214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22730.513795 secs 2024-04-21T16:43:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:40 smithi170 ceph-mon[31212]: pgmap v12214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:42 smithi077 ceph-mon[27902]: pgmap v12215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:42 smithi191 ceph-mon[31636]: pgmap v12215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:42 smithi170 ceph-mon[31212]: pgmap v12215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22733.752528 secs 2024-04-21T16:43:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22733.752528 secs 2024-04-21T16:43:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22733.752528 secs 2024-04-21T16:43:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:44 smithi077 ceph-mon[27902]: pgmap v12216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:43:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:44 smithi191 ceph-mon[31636]: pgmap v12216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:43:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:44 smithi170 ceph-mon[31212]: pgmap v12216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:43:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22735.513885 secs 2024-04-21T16:43:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:43:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:43:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:43:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22735.513885 secs 2024-04-21T16:43:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:43:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:43:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:43:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22735.513885 secs 2024-04-21T16:43:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:43:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:43:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:43:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:46 smithi170 ceph-mon[31212]: pgmap v12217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:46 smithi077 ceph-mon[27902]: pgmap v12217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:46.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:46 smithi191 ceph-mon[31636]: pgmap v12217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:48 smithi170 ceph-mon[31212]: pgmap v12218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22738.752661 secs 2024-04-21T16:43:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:48 smithi077 ceph-mon[27902]: pgmap v12218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22738.752661 secs 2024-04-21T16:43:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:48 smithi191 ceph-mon[31636]: pgmap v12218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22738.752661 secs 2024-04-21T16:43:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22740.514014 secs 2024-04-21T16:43:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:50 smithi170 ceph-mon[31212]: pgmap v12219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22740.514014 secs 2024-04-21T16:43:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:50 smithi077 ceph-mon[27902]: pgmap v12219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22740.514014 secs 2024-04-21T16:43:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:50 smithi191 ceph-mon[31636]: pgmap v12219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:52 smithi170 ceph-mon[31212]: pgmap v12220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:52 smithi077 ceph-mon[27902]: pgmap v12220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:52 smithi191 ceph-mon[31636]: pgmap v12220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22743.752789 secs 2024-04-21T16:43:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22743.752789 secs 2024-04-21T16:43:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22743.752789 secs 2024-04-21T16:43:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T16:43:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T16:43:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:43:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T16:43:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:43:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T16:43:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.443+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T16:43:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T16:43:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T16:43:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd7002a000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:43:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efd70012740 tx=0x7efd7002a000 comp rx=0 tx=0).stop 2024-04-21T16:43:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T16:43:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T16:43:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T16:43:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T16:43:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:43:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:54.479+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efd700097c0 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T16:43:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:54 smithi170 ceph-mon[31212]: pgmap v12221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:54 smithi077 ceph-mon[27902]: pgmap v12221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:54 smithi191 ceph-mon[31636]: pgmap v12221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:43:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22745.514102 secs 2024-04-21T16:43:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22745.514102 secs 2024-04-21T16:43:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22745.514102 secs 2024-04-21T16:43:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:56 smithi170 ceph-mon[31212]: pgmap v12222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:56 smithi077 ceph-mon[27902]: pgmap v12222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:56 smithi191 ceph-mon[31636]: pgmap v12222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:43:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:57.500+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:43:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:57.500+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:43:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:57.500+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:43:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:43:57.500+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:43:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:58 smithi170 ceph-mon[31212]: pgmap v12223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:43:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22748.752829 secs 2024-04-21T16:43:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:58 smithi077 ceph-mon[27902]: pgmap v12223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:43:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22748.752829 secs 2024-04-21T16:43:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:58 smithi191 ceph-mon[31636]: pgmap v12223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:43:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:43:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22748.752829 secs 2024-04-21T16:44:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22750.514235 secs 2024-04-21T16:44:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:00 smithi077 ceph-mon[27902]: pgmap v12224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22750.514235 secs 2024-04-21T16:44:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:00 smithi191 ceph-mon[31636]: pgmap v12224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22750.514235 secs 2024-04-21T16:44:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:00 smithi170 ceph-mon[31212]: pgmap v12224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:02 smithi077 ceph-mon[27902]: pgmap v12225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T16:44:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:02 smithi191 ceph-mon[31636]: pgmap v12225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T16:44:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:02 smithi170 ceph-mon[31212]: pgmap v12225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T16:44:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22753.752940 secs 2024-04-21T16:44:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22753.752940 secs 2024-04-21T16:44:04.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22753.752940 secs 2024-04-21T16:44:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:04 smithi077 ceph-mon[27902]: pgmap v12226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T16:44:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:04 smithi191 ceph-mon[31636]: pgmap v12226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T16:44:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:04 smithi170 ceph-mon[31212]: pgmap v12226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T16:44:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22755.514311 secs 2024-04-21T16:44:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:05 smithi077 ceph-mon[27902]: osdmap e836: 12 total, 12 up, 12 in 2024-04-21T16:44:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22755.514311 secs 2024-04-21T16:44:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:05 smithi191 ceph-mon[31636]: osdmap e836: 12 total, 12 up, 12 in 2024-04-21T16:44:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22755.514311 secs 2024-04-21T16:44:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:05 smithi170 ceph-mon[31212]: osdmap e836: 12 total, 12 up, 12 in 2024-04-21T16:44:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:06 smithi077 ceph-mon[27902]: pgmap v12228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:06 smithi191 ceph-mon[31636]: pgmap v12228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:07.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:06 smithi170 ceph-mon[31212]: pgmap v12228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:08 smithi077 ceph-mon[27902]: pgmap v12229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22758.753056 secs 2024-04-21T16:44:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:08 smithi191 ceph-mon[31636]: pgmap v12229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22758.753056 secs 2024-04-21T16:44:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:08 smithi170 ceph-mon[31212]: pgmap v12229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22758.753056 secs 2024-04-21T16:44:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22760.514389 secs 2024-04-21T16:44:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22760.514389 secs 2024-04-21T16:44:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22760.514389 secs 2024-04-21T16:44:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:10 smithi077 ceph-mon[27902]: pgmap v12230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:10 smithi191 ceph-mon[31636]: pgmap v12230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:10 smithi170 ceph-mon[31212]: pgmap v12230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:44:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:12 smithi077 ceph-mon[27902]: pgmap v12231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:44:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:12 smithi077 ceph-mon[27902]: osdmap e837: 12 total, 12 up, 12 in 2024-04-21T16:44:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:12 smithi191 ceph-mon[31636]: pgmap v12231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:44:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:12 smithi191 ceph-mon[31636]: osdmap e837: 12 total, 12 up, 12 in 2024-04-21T16:44:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:12 smithi170 ceph-mon[31212]: pgmap v12231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:44:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:12 smithi170 ceph-mon[31212]: osdmap e837: 12 total, 12 up, 12 in 2024-04-21T16:44:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22763.753172 secs 2024-04-21T16:44:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22763.753172 secs 2024-04-21T16:44:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22763.753172 secs 2024-04-21T16:44:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:14 smithi077 ceph-mon[27902]: pgmap v12233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 375 B/s wr, 8 op/s 2024-04-21T16:44:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:14 smithi191 ceph-mon[31636]: pgmap v12233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 375 B/s wr, 8 op/s 2024-04-21T16:44:14.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:14 smithi170 ceph-mon[31212]: pgmap v12233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 375 B/s wr, 8 op/s 2024-04-21T16:44:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22765.514531 secs 2024-04-21T16:44:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22765.514531 secs 2024-04-21T16:44:15.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22765.514531 secs 2024-04-21T16:44:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:16 smithi077 ceph-mon[27902]: pgmap v12234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:44:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:16 smithi191 ceph-mon[31636]: pgmap v12234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:44:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:16 smithi170 ceph-mon[31212]: pgmap v12234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:44:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:18 smithi077 ceph-mon[27902]: pgmap v12235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:44:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22768.753283 secs 2024-04-21T16:44:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:18 smithi191 ceph-mon[31636]: pgmap v12235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:44:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22768.753283 secs 2024-04-21T16:44:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:18 smithi170 ceph-mon[31212]: pgmap v12235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:44:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22768.753283 secs 2024-04-21T16:44:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22770.514671 secs 2024-04-21T16:44:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:20 smithi077 ceph-mon[27902]: pgmap v12236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:44:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22770.514671 secs 2024-04-21T16:44:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:20 smithi191 ceph-mon[31636]: pgmap v12236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:44:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22770.514671 secs 2024-04-21T16:44:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:20 smithi170 ceph-mon[31212]: pgmap v12236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:44:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:22 smithi077 ceph-mon[27902]: pgmap v12237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:44:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:22 smithi191 ceph-mon[31636]: pgmap v12237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:44:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:22 smithi170 ceph-mon[31212]: pgmap v12237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:44:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22773.753425 secs 2024-04-21T16:44:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22773.753425 secs 2024-04-21T16:44:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22773.753425 secs 2024-04-21T16:44:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:24 smithi077 ceph-mon[27902]: pgmap v12238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:44:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:24 smithi191 ceph-mon[31636]: pgmap v12238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:44:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:24 smithi170 ceph-mon[31212]: pgmap v12238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:44:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22775.514807 secs 2024-04-21T16:44:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22775.514807 secs 2024-04-21T16:44:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22775.514807 secs 2024-04-21T16:44:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:26 smithi077 ceph-mon[27902]: pgmap v12239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:26 smithi191 ceph-mon[31636]: pgmap v12239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:26 smithi170 ceph-mon[31212]: pgmap v12239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:28.610 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:28 smithi170 ceph-mon[31212]: pgmap v12240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:28.610 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22778.753495 secs 2024-04-21T16:44:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:28 smithi077 ceph-mon[27902]: pgmap v12240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22778.753495 secs 2024-04-21T16:44:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:28 smithi191 ceph-mon[31636]: pgmap v12240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22778.753495 secs 2024-04-21T16:44:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22780.514949 secs 2024-04-21T16:44:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:30 smithi077 ceph-mon[27902]: pgmap v12241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22780.514949 secs 2024-04-21T16:44:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:30 smithi191 ceph-mon[31636]: pgmap v12241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22780.514949 secs 2024-04-21T16:44:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:30 smithi170 ceph-mon[31212]: pgmap v12241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:32 smithi077 ceph-mon[27902]: pgmap v12242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:32 smithi191 ceph-mon[31636]: pgmap v12242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:32 smithi170 ceph-mon[31212]: pgmap v12242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22783.753606 secs 2024-04-21T16:44:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22783.753606 secs 2024-04-21T16:44:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22783.753606 secs 2024-04-21T16:44:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:34 smithi077 ceph-mon[27902]: pgmap v12243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:34 smithi191 ceph-mon[31636]: pgmap v12243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:34 smithi170 ceph-mon[31212]: pgmap v12243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22785.515063 secs 2024-04-21T16:44:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22785.515063 secs 2024-04-21T16:44:35.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22785.515063 secs 2024-04-21T16:44:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:36 smithi077 ceph-mon[27902]: pgmap v12244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:36 smithi191 ceph-mon[31636]: pgmap v12244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:36 smithi170 ceph-mon[31212]: pgmap v12244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:38 smithi191 ceph-mon[31636]: pgmap v12245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22788.753740 secs 2024-04-21T16:44:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:38 smithi170 ceph-mon[31212]: pgmap v12245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22788.753740 secs 2024-04-21T16:44:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:38 smithi077 ceph-mon[27902]: pgmap v12245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22788.753740 secs 2024-04-21T16:44:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22790.515200 secs 2024-04-21T16:44:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:40 smithi191 ceph-mon[31636]: pgmap v12246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22790.515200 secs 2024-04-21T16:44:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:40 smithi170 ceph-mon[31212]: pgmap v12246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22790.515200 secs 2024-04-21T16:44:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:40 smithi077 ceph-mon[27902]: pgmap v12246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:42 smithi191 ceph-mon[31636]: pgmap v12247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:42 smithi170 ceph-mon[31212]: pgmap v12247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:42 smithi077 ceph-mon[27902]: pgmap v12247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22793.753852 secs 2024-04-21T16:44:43.788 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22793.753852 secs 2024-04-21T16:44:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22793.753852 secs 2024-04-21T16:44:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:44 smithi191 ceph-mon[31636]: pgmap v12248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:44 smithi170 ceph-mon[31212]: pgmap v12248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:44 smithi077 ceph-mon[27902]: pgmap v12248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22795.515346 secs 2024-04-21T16:44:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:44:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:44:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:44:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:44:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22795.515346 secs 2024-04-21T16:44:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:44:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:44:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:44:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:44:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22795.515346 secs 2024-04-21T16:44:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:44:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:44:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:44:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:44:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:46 smithi191 ceph-mon[31636]: pgmap v12249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:46 smithi170 ceph-mon[31212]: pgmap v12249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:46 smithi077 ceph-mon[27902]: pgmap v12249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:48 smithi191 ceph-mon[31636]: pgmap v12250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22798.753959 secs 2024-04-21T16:44:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:48 smithi170 ceph-mon[31212]: pgmap v12250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22798.753959 secs 2024-04-21T16:44:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:48 smithi077 ceph-mon[27902]: pgmap v12250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22798.753959 secs 2024-04-21T16:44:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22800.515457 secs 2024-04-21T16:44:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:50 smithi191 ceph-mon[31636]: pgmap v12251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22800.515457 secs 2024-04-21T16:44:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:50 smithi170 ceph-mon[31212]: pgmap v12251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22800.515457 secs 2024-04-21T16:44:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:50 smithi077 ceph-mon[27902]: pgmap v12251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:52 smithi191 ceph-mon[31636]: pgmap v12252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:52 smithi170 ceph-mon[31212]: pgmap v12252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:52 smithi077 ceph-mon[27902]: pgmap v12252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22803.754042 secs 2024-04-21T16:44:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22803.754042 secs 2024-04-21T16:44:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22803.754042 secs 2024-04-21T16:44:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:54 smithi191 ceph-mon[31636]: pgmap v12253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:54 smithi170 ceph-mon[31212]: pgmap v12253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:54 smithi077 ceph-mon[27902]: pgmap v12253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:44:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22805.515572 secs 2024-04-21T16:44:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22805.515572 secs 2024-04-21T16:44:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22805.515572 secs 2024-04-21T16:44:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:56 smithi191 ceph-mon[31636]: pgmap v12254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:56 smithi170 ceph-mon[31212]: pgmap v12254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:56 smithi077 ceph-mon[27902]: pgmap v12254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:44:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:58 smithi191 ceph-mon[31636]: pgmap v12255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:44:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22808.754178 secs 2024-04-21T16:44:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:58 smithi170 ceph-mon[31212]: pgmap v12255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:44:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22808.754178 secs 2024-04-21T16:44:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:58 smithi077 ceph-mon[27902]: pgmap v12255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:44:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:44:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22808.754178 secs 2024-04-21T16:45:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 22995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22810.515707 secs 2024-04-21T16:45:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:00 smithi191 ceph-mon[31636]: pgmap v12256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22810.515707 secs 2024-04-21T16:45:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:00 smithi170 ceph-mon[31212]: pgmap v12256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22810.515707 secs 2024-04-21T16:45:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:00 smithi077 ceph-mon[27902]: pgmap v12256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:02 smithi191 ceph-mon[31636]: pgmap v12257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-04-21T16:45:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:02 smithi170 ceph-mon[31212]: pgmap v12257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-04-21T16:45:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:02 smithi077 ceph-mon[27902]: pgmap v12257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-04-21T16:45:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22813.754306 secs 2024-04-21T16:45:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22813.754306 secs 2024-04-21T16:45:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22813.754306 secs 2024-04-21T16:45:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:04 smithi191 ceph-mon[31636]: pgmap v12258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:45:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:04 smithi170 ceph-mon[31212]: pgmap v12258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:45:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:04 smithi077 ceph-mon[27902]: pgmap v12258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T16:45:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22815.515824 secs 2024-04-21T16:45:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:05 smithi191 ceph-mon[31636]: osdmap e838: 12 total, 12 up, 12 in 2024-04-21T16:45:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22815.515824 secs 2024-04-21T16:45:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:05 smithi170 ceph-mon[31212]: osdmap e838: 12 total, 12 up, 12 in 2024-04-21T16:45:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22815.515824 secs 2024-04-21T16:45:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:05 smithi077 ceph-mon[27902]: osdmap e838: 12 total, 12 up, 12 in 2024-04-21T16:45:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:06 smithi191 ceph-mon[31636]: pgmap v12260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T16:45:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:06 smithi170 ceph-mon[31212]: pgmap v12260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T16:45:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:06 smithi077 ceph-mon[27902]: pgmap v12260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T16:45:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:08 smithi191 ceph-mon[31636]: pgmap v12261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:45:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22818.754440 secs 2024-04-21T16:45:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:08 smithi170 ceph-mon[31212]: pgmap v12261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:45:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22818.754440 secs 2024-04-21T16:45:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:08 smithi077 ceph-mon[27902]: pgmap v12261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:45:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22818.754440 secs 2024-04-21T16:45:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22820.515942 secs 2024-04-21T16:45:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:10 smithi191 ceph-mon[31636]: pgmap v12262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:45:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22820.515942 secs 2024-04-21T16:45:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:10 smithi170 ceph-mon[31212]: pgmap v12262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:45:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22820.515942 secs 2024-04-21T16:45:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:10 smithi077 ceph-mon[27902]: pgmap v12262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:45:12.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:12 smithi077 ceph-mon[27902]: pgmap v12263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T16:45:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:12 smithi077 ceph-mon[27902]: osdmap e839: 12 total, 12 up, 12 in 2024-04-21T16:45:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:12 smithi191 ceph-mon[31636]: pgmap v12263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T16:45:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:12 smithi191 ceph-mon[31636]: osdmap e839: 12 total, 12 up, 12 in 2024-04-21T16:45:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:12 smithi170 ceph-mon[31212]: pgmap v12263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T16:45:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:12 smithi170 ceph-mon[31212]: osdmap e839: 12 total, 12 up, 12 in 2024-04-21T16:45:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22823.754555 secs 2024-04-21T16:45:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22823.754555 secs 2024-04-21T16:45:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22823.754555 secs 2024-04-21T16:45:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:14 smithi077 ceph-mon[27902]: pgmap v12265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 KiB/s wr, 21 op/s 2024-04-21T16:45:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:14 smithi191 ceph-mon[31636]: pgmap v12265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 KiB/s wr, 21 op/s 2024-04-21T16:45:14.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:14 smithi170 ceph-mon[31212]: pgmap v12265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 KiB/s wr, 21 op/s 2024-04-21T16:45:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22825.516053 secs 2024-04-21T16:45:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22825.516053 secs 2024-04-21T16:45:15.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22825.516053 secs 2024-04-21T16:45:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:16 smithi077 ceph-mon[27902]: pgmap v12266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T16:45:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:16 smithi191 ceph-mon[31636]: pgmap v12266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T16:45:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:16 smithi170 ceph-mon[31212]: pgmap v12266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-21T16:45:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:18 smithi077 ceph-mon[27902]: pgmap v12267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:45:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22828.754698 secs 2024-04-21T16:45:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:18 smithi191 ceph-mon[31636]: pgmap v12267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:45:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22828.754698 secs 2024-04-21T16:45:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:18 smithi170 ceph-mon[31212]: pgmap v12267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:45:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22828.754698 secs 2024-04-21T16:45:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22830.516167 secs 2024-04-21T16:45:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:20 smithi077 ceph-mon[27902]: pgmap v12268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:45:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22830.516167 secs 2024-04-21T16:45:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:20 smithi191 ceph-mon[31636]: pgmap v12268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:45:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22830.516167 secs 2024-04-21T16:45:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:20 smithi170 ceph-mon[31212]: pgmap v12268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:45:22.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:22 smithi077 ceph-mon[27902]: pgmap v12269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:45:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:22 smithi191 ceph-mon[31636]: pgmap v12269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:45:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:22 smithi170 ceph-mon[31212]: pgmap v12269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:45:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22833.754793 secs 2024-04-21T16:45:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22833.754793 secs 2024-04-21T16:45:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22833.754793 secs 2024-04-21T16:45:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:24 smithi077 ceph-mon[27902]: pgmap v12270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:45:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:24 smithi191 ceph-mon[31636]: pgmap v12270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:45:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:24 smithi170 ceph-mon[31212]: pgmap v12270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:45:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22835.516290 secs 2024-04-21T16:45:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22835.516290 secs 2024-04-21T16:45:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22835.516290 secs 2024-04-21T16:45:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:26 smithi077 ceph-mon[27902]: pgmap v12271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:26 smithi191 ceph-mon[31636]: pgmap v12271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:26 smithi170 ceph-mon[31212]: pgmap v12271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:28 smithi077 ceph-mon[27902]: pgmap v12272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22838.754907 secs 2024-04-21T16:45:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:28 smithi191 ceph-mon[31636]: pgmap v12272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22838.754907 secs 2024-04-21T16:45:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:28 smithi170 ceph-mon[31212]: pgmap v12272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22838.754907 secs 2024-04-21T16:45:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22840.516374 secs 2024-04-21T16:45:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:30 smithi077 ceph-mon[27902]: pgmap v12273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22840.516374 secs 2024-04-21T16:45:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:30 smithi191 ceph-mon[31636]: pgmap v12273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22840.516374 secs 2024-04-21T16:45:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:30 smithi170 ceph-mon[31212]: pgmap v12273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:32 smithi077 ceph-mon[27902]: pgmap v12274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:32 smithi191 ceph-mon[31636]: pgmap v12274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:32 smithi170 ceph-mon[31212]: pgmap v12274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22843.755019 secs 2024-04-21T16:45:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22843.755019 secs 2024-04-21T16:45:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22843.755019 secs 2024-04-21T16:45:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:34 smithi077 ceph-mon[27902]: pgmap v12275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:34 smithi191 ceph-mon[31636]: pgmap v12275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:34 smithi170 ceph-mon[31212]: pgmap v12275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22845.516497 secs 2024-04-21T16:45:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22845.516497 secs 2024-04-21T16:45:35.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22845.516497 secs 2024-04-21T16:45:36.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:36 smithi077 ceph-mon[27902]: pgmap v12276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:36 smithi191 ceph-mon[31636]: pgmap v12276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:36 smithi170 ceph-mon[31212]: pgmap v12276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:38 smithi191 ceph-mon[31636]: pgmap v12277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22848.755137 secs 2024-04-21T16:45:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:38 smithi170 ceph-mon[31212]: pgmap v12277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22848.755137 secs 2024-04-21T16:45:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:38 smithi077 ceph-mon[27902]: pgmap v12277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22848.755137 secs 2024-04-21T16:45:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22850.516613 secs 2024-04-21T16:45:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:40 smithi191 ceph-mon[31636]: pgmap v12278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22850.516613 secs 2024-04-21T16:45:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:40 smithi170 ceph-mon[31212]: pgmap v12278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22850.516613 secs 2024-04-21T16:45:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:40 smithi077 ceph-mon[27902]: pgmap v12278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:42 smithi191 ceph-mon[31636]: pgmap v12279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:42.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:42 smithi170 ceph-mon[31212]: pgmap v12279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:42 smithi077 ceph-mon[27902]: pgmap v12279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22853.755200 secs 2024-04-21T16:45:43.788 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22853.755200 secs 2024-04-21T16:45:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22853.755200 secs 2024-04-21T16:45:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:44 smithi191 ceph-mon[31636]: pgmap v12280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:44 smithi170 ceph-mon[31212]: pgmap v12280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:44 smithi077 ceph-mon[27902]: pgmap v12280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22855.516729 secs 2024-04-21T16:45:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22855.516729 secs 2024-04-21T16:45:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22855.516729 secs 2024-04-21T16:45:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:46 smithi191 ceph-mon[31636]: pgmap v12281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:45:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:45:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:45:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:45:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:46 smithi170 ceph-mon[31212]: pgmap v12281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:45:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:45:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:45:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:45:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:46 smithi077 ceph-mon[27902]: pgmap v12281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:45:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:45:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:45:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:45:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:48 smithi191 ceph-mon[31636]: pgmap v12282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22858.755335 secs 2024-04-21T16:45:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:48 smithi170 ceph-mon[31212]: pgmap v12282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22858.755335 secs 2024-04-21T16:45:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:48 smithi077 ceph-mon[27902]: pgmap v12282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22858.755335 secs 2024-04-21T16:45:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22860.516847 secs 2024-04-21T16:45:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:50 smithi191 ceph-mon[31636]: pgmap v12283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22860.516847 secs 2024-04-21T16:45:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:50 smithi170 ceph-mon[31212]: pgmap v12283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22860.516847 secs 2024-04-21T16:45:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:50 smithi077 ceph-mon[27902]: pgmap v12283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:52 smithi191 ceph-mon[31636]: pgmap v12284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:52 smithi170 ceph-mon[31212]: pgmap v12284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:52 smithi077 ceph-mon[27902]: pgmap v12284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22863.755487 secs 2024-04-21T16:45:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22863.755487 secs 2024-04-21T16:45:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22863.755487 secs 2024-04-21T16:45:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:54 smithi191 ceph-mon[31636]: pgmap v12285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:54 smithi170 ceph-mon[31212]: pgmap v12285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:54 smithi077 ceph-mon[27902]: pgmap v12285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:45:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22865.516970 secs 2024-04-21T16:45:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22865.516970 secs 2024-04-21T16:45:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22865.516970 secs 2024-04-21T16:45:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:56 smithi191 ceph-mon[31636]: pgmap v12286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:56 smithi170 ceph-mon[31212]: pgmap v12286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:56 smithi077 ceph-mon[27902]: pgmap v12286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:45:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:58 smithi191 ceph-mon[31636]: pgmap v12287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:45:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22868.755608 secs 2024-04-21T16:45:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:58 smithi170 ceph-mon[31212]: pgmap v12287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:45:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22868.755608 secs 2024-04-21T16:45:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:58 smithi077 ceph-mon[27902]: pgmap v12287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:45:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:45:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22868.755608 secs 2024-04-21T16:46:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22870.517107 secs 2024-04-21T16:46:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:00 smithi191 ceph-mon[31636]: pgmap v12288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22870.517107 secs 2024-04-21T16:46:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:00 smithi170 ceph-mon[31212]: pgmap v12288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22870.517107 secs 2024-04-21T16:46:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:00 smithi077 ceph-mon[27902]: pgmap v12288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:02 smithi191 ceph-mon[31636]: pgmap v12289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:02 smithi170 ceph-mon[31212]: pgmap v12289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:02 smithi077 ceph-mon[27902]: pgmap v12289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22873.755730 secs 2024-04-21T16:46:03.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22873.755730 secs 2024-04-21T16:46:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22873.755730 secs 2024-04-21T16:46:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:04 smithi191 ceph-mon[31636]: pgmap v12290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:04 smithi170 ceph-mon[31212]: pgmap v12290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:04 smithi077 ceph-mon[27902]: pgmap v12290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22875.517201 secs 2024-04-21T16:46:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:05 smithi191 ceph-mon[31636]: osdmap e840: 12 total, 12 up, 12 in 2024-04-21T16:46:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22875.517201 secs 2024-04-21T16:46:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:05 smithi170 ceph-mon[31212]: osdmap e840: 12 total, 12 up, 12 in 2024-04-21T16:46:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22875.517201 secs 2024-04-21T16:46:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:05 smithi077 ceph-mon[27902]: osdmap e840: 12 total, 12 up, 12 in 2024-04-21T16:46:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:06 smithi191 ceph-mon[31636]: pgmap v12292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:46:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:06 smithi170 ceph-mon[31212]: pgmap v12292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:46:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:06 smithi077 ceph-mon[27902]: pgmap v12292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:46:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:08 smithi170 ceph-mon[31212]: pgmap v12293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:46:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22878.755845 secs 2024-04-21T16:46:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:08 smithi077 ceph-mon[27902]: pgmap v12293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:46:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22878.755845 secs 2024-04-21T16:46:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:08 smithi191 ceph-mon[31636]: pgmap v12293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:46:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22878.755845 secs 2024-04-21T16:46:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22880.517339 secs 2024-04-21T16:46:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:10 smithi170 ceph-mon[31212]: pgmap v12294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:46:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22880.517339 secs 2024-04-21T16:46:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:10 smithi077 ceph-mon[27902]: pgmap v12294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:46:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22880.517339 secs 2024-04-21T16:46:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:10 smithi191 ceph-mon[31636]: pgmap v12294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:46:12.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:12 smithi077 ceph-mon[27902]: pgmap v12295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:46:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:12 smithi077 ceph-mon[27902]: osdmap e841: 12 total, 12 up, 12 in 2024-04-21T16:46:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:12 smithi191 ceph-mon[31636]: pgmap v12295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:46:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:12 smithi191 ceph-mon[31636]: osdmap e841: 12 total, 12 up, 12 in 2024-04-21T16:46:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:12 smithi170 ceph-mon[31212]: pgmap v12295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:46:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:12 smithi170 ceph-mon[31212]: osdmap e841: 12 total, 12 up, 12 in 2024-04-21T16:46:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22883.755955 secs 2024-04-21T16:46:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22883.755955 secs 2024-04-21T16:46:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22883.755955 secs 2024-04-21T16:46:14.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:14 smithi077 ceph-mon[27902]: pgmap v12297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:46:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:14 smithi191 ceph-mon[31636]: pgmap v12297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:46:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:14 smithi170 ceph-mon[31212]: pgmap v12297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:46:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22885.517458 secs 2024-04-21T16:46:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22885.517458 secs 2024-04-21T16:46:15.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22885.517458 secs 2024-04-21T16:46:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:16 smithi077 ceph-mon[27902]: pgmap v12298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:46:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:16 smithi191 ceph-mon[31636]: pgmap v12298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:46:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:16 smithi170 ceph-mon[31212]: pgmap v12298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:46:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:18 smithi077 ceph-mon[27902]: pgmap v12299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T16:46:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22888.756068 secs 2024-04-21T16:46:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:18 smithi191 ceph-mon[31636]: pgmap v12299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T16:46:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22888.756068 secs 2024-04-21T16:46:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:18 smithi170 ceph-mon[31212]: pgmap v12299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T16:46:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22888.756068 secs 2024-04-21T16:46:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22890.517603 secs 2024-04-21T16:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:20 smithi077 ceph-mon[27902]: pgmap v12300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T16:46:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22890.517603 secs 2024-04-21T16:46:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:20 smithi191 ceph-mon[31636]: pgmap v12300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T16:46:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22890.517603 secs 2024-04-21T16:46:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:20 smithi170 ceph-mon[31212]: pgmap v12300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T16:46:22.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:22 smithi077 ceph-mon[27902]: pgmap v12301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:46:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:22 smithi191 ceph-mon[31636]: pgmap v12301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:46:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:22 smithi170 ceph-mon[31212]: pgmap v12301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:46:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22893.756184 secs 2024-04-21T16:46:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22893.756184 secs 2024-04-21T16:46:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22893.756184 secs 2024-04-21T16:46:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:24 smithi077 ceph-mon[27902]: pgmap v12302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:46:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:24 smithi191 ceph-mon[31636]: pgmap v12302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:46:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:24 smithi170 ceph-mon[31212]: pgmap v12302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:46:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22895.517757 secs 2024-04-21T16:46:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22895.517757 secs 2024-04-21T16:46:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22895.517757 secs 2024-04-21T16:46:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:26 smithi077 ceph-mon[27902]: pgmap v12303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:26 smithi191 ceph-mon[31636]: pgmap v12303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:26 smithi170 ceph-mon[31212]: pgmap v12303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:28 smithi077 ceph-mon[27902]: pgmap v12304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22898.756272 secs 2024-04-21T16:46:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:28 smithi191 ceph-mon[31636]: pgmap v12304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22898.756272 secs 2024-04-21T16:46:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:28 smithi170 ceph-mon[31212]: pgmap v12304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22898.756272 secs 2024-04-21T16:46:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22900.517905 secs 2024-04-21T16:46:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:30 smithi077 ceph-mon[27902]: pgmap v12305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22900.517905 secs 2024-04-21T16:46:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:30 smithi191 ceph-mon[31636]: pgmap v12305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22900.517905 secs 2024-04-21T16:46:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:30 smithi170 ceph-mon[31212]: pgmap v12305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:32 smithi077 ceph-mon[27902]: pgmap v12306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:32 smithi191 ceph-mon[31636]: pgmap v12306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:32 smithi170 ceph-mon[31212]: pgmap v12306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22903.756389 secs 2024-04-21T16:46:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22903.756389 secs 2024-04-21T16:46:33.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22903.756389 secs 2024-04-21T16:46:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:34 smithi191 ceph-mon[31636]: pgmap v12307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:34 smithi170 ceph-mon[31212]: pgmap v12307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:34 smithi077 ceph-mon[27902]: pgmap v12307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22905.518049 secs 2024-04-21T16:46:35.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22905.518049 secs 2024-04-21T16:46:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22905.518049 secs 2024-04-21T16:46:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:36 smithi191 ceph-mon[31636]: pgmap v12308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:36 smithi170 ceph-mon[31212]: pgmap v12308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:36 smithi077 ceph-mon[27902]: pgmap v12308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:38 smithi191 ceph-mon[31636]: pgmap v12309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22908.756528 secs 2024-04-21T16:46:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:38 smithi170 ceph-mon[31212]: pgmap v12309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22908.756528 secs 2024-04-21T16:46:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:38 smithi077 ceph-mon[27902]: pgmap v12309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22908.756528 secs 2024-04-21T16:46:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22910.518172 secs 2024-04-21T16:46:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:40 smithi191 ceph-mon[31636]: pgmap v12310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22910.518172 secs 2024-04-21T16:46:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:40 smithi170 ceph-mon[31212]: pgmap v12310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22910.518172 secs 2024-04-21T16:46:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:40 smithi077 ceph-mon[27902]: pgmap v12310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:42 smithi191 ceph-mon[31636]: pgmap v12311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:42 smithi170 ceph-mon[31212]: pgmap v12311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:42 smithi077 ceph-mon[27902]: pgmap v12311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22913.756600 secs 2024-04-21T16:46:43.788 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22913.756600 secs 2024-04-21T16:46:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22913.756600 secs 2024-04-21T16:46:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:44 smithi191 ceph-mon[31636]: pgmap v12312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:44.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:44 smithi170 ceph-mon[31212]: pgmap v12312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:44 smithi077 ceph-mon[27902]: pgmap v12312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22915.518244 secs 2024-04-21T16:46:45.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22915.518244 secs 2024-04-21T16:46:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22915.518244 secs 2024-04-21T16:46:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:46 smithi191 ceph-mon[31636]: pgmap v12313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:46:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:46 smithi170 ceph-mon[31212]: pgmap v12313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:46:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:46 smithi077 ceph-mon[27902]: pgmap v12313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:46:47.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:46:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:46:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:46:47.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:46:47.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:46:47.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:46:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:46:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:46:47.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:46:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:48 smithi191 ceph-mon[31636]: pgmap v12314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22918.756695 secs 2024-04-21T16:46:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:48 smithi170 ceph-mon[31212]: pgmap v12314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22918.756695 secs 2024-04-21T16:46:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:48 smithi077 ceph-mon[27902]: pgmap v12314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22918.756695 secs 2024-04-21T16:46:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22920.518368 secs 2024-04-21T16:46:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:50 smithi191 ceph-mon[31636]: pgmap v12315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22920.518368 secs 2024-04-21T16:46:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:50 smithi170 ceph-mon[31212]: pgmap v12315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22920.518368 secs 2024-04-21T16:46:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:50 smithi077 ceph-mon[27902]: pgmap v12315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:52 smithi191 ceph-mon[31636]: pgmap v12316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:52 smithi170 ceph-mon[31212]: pgmap v12316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:52 smithi077 ceph-mon[27902]: pgmap v12316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22923.756813 secs 2024-04-21T16:46:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22923.756813 secs 2024-04-21T16:46:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22923.756813 secs 2024-04-21T16:46:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:54 smithi191 ceph-mon[31636]: pgmap v12317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:54 smithi170 ceph-mon[31212]: pgmap v12317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:54 smithi077 ceph-mon[27902]: pgmap v12317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:46:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22925.518493 secs 2024-04-21T16:46:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22925.518493 secs 2024-04-21T16:46:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22925.518493 secs 2024-04-21T16:46:56.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:56 smithi191 ceph-mon[31636]: pgmap v12318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:56 smithi170 ceph-mon[31212]: pgmap v12318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:56 smithi077 ceph-mon[27902]: pgmap v12318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:46:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:46:57.525+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:46:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:46:57.525+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:46:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:46:57.525+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:46:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:46:57.525+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:46:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:58 smithi191 ceph-mon[31636]: pgmap v12319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:46:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22928.756930 secs 2024-04-21T16:46:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:58 smithi170 ceph-mon[31212]: pgmap v12319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:46:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22928.756930 secs 2024-04-21T16:46:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:58 smithi077 ceph-mon[27902]: pgmap v12319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:46:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:46:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22928.756930 secs 2024-04-21T16:47:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22930.518612 secs 2024-04-21T16:47:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:00 smithi191 ceph-mon[31636]: pgmap v12320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22930.518612 secs 2024-04-21T16:47:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:00 smithi170 ceph-mon[31212]: pgmap v12320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22930.518612 secs 2024-04-21T16:47:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:00 smithi077 ceph-mon[27902]: pgmap v12320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:02 smithi191 ceph-mon[31636]: pgmap v12321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:02 smithi170 ceph-mon[31212]: pgmap v12321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:02 smithi077 ceph-mon[27902]: pgmap v12321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22933.757050 secs 2024-04-21T16:47:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22933.757050 secs 2024-04-21T16:47:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22933.757050 secs 2024-04-21T16:47:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:04 smithi170 ceph-mon[31212]: pgmap v12322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:04 smithi077 ceph-mon[27902]: pgmap v12322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:04 smithi191 ceph-mon[31636]: pgmap v12322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22935.518732 secs 2024-04-21T16:47:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:05 smithi170 ceph-mon[31212]: osdmap e842: 12 total, 12 up, 12 in 2024-04-21T16:47:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22935.518732 secs 2024-04-21T16:47:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:05 smithi077 ceph-mon[27902]: osdmap e842: 12 total, 12 up, 12 in 2024-04-21T16:47:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22935.518732 secs 2024-04-21T16:47:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:05 smithi191 ceph-mon[31636]: osdmap e842: 12 total, 12 up, 12 in 2024-04-21T16:47:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:06 smithi170 ceph-mon[31212]: pgmap v12324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:06 smithi077 ceph-mon[27902]: pgmap v12324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:06 smithi191 ceph-mon[31636]: pgmap v12324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:08 smithi170 ceph-mon[31212]: pgmap v12325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:47:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22938.757166 secs 2024-04-21T16:47:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:08 smithi077 ceph-mon[27902]: pgmap v12325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:47:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22938.757166 secs 2024-04-21T16:47:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:08 smithi191 ceph-mon[31636]: pgmap v12325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:47:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22938.757166 secs 2024-04-21T16:47:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22940.518846 secs 2024-04-21T16:47:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:10 smithi170 ceph-mon[31212]: pgmap v12326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:47:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22940.518846 secs 2024-04-21T16:47:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:10 smithi077 ceph-mon[27902]: pgmap v12326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:47:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22940.518846 secs 2024-04-21T16:47:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:10 smithi191 ceph-mon[31636]: pgmap v12326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:47:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:12 smithi170 ceph-mon[31212]: pgmap v12327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:47:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:12 smithi077 ceph-mon[27902]: pgmap v12327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:47:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:12 smithi191 ceph-mon[31636]: pgmap v12327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:47:13.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22943.757293 secs 2024-04-21T16:47:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22943.757293 secs 2024-04-21T16:47:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22943.757293 secs 2024-04-21T16:47:14.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:14 smithi170 ceph-mon[31212]: pgmap v12328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:47:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:14 smithi077 ceph-mon[27902]: pgmap v12328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:47:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:14 smithi191 ceph-mon[31636]: pgmap v12328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:47:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:15.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22945.518924 secs 2024-04-21T16:47:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22945.518924 secs 2024-04-21T16:47:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22945.518924 secs 2024-04-21T16:47:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:16 smithi170 ceph-mon[31212]: pgmap v12329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:47:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:16 smithi170 ceph-mon[31212]: osdmap e843: 12 total, 12 up, 12 in 2024-04-21T16:47:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:16 smithi077 ceph-mon[27902]: pgmap v12329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:47:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:16 smithi077 ceph-mon[27902]: osdmap e843: 12 total, 12 up, 12 in 2024-04-21T16:47:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:16 smithi191 ceph-mon[31636]: pgmap v12329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:47:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:16 smithi191 ceph-mon[31636]: osdmap e843: 12 total, 12 up, 12 in 2024-04-21T16:47:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:18 smithi170 ceph-mon[31212]: pgmap v12331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:47:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22948.757446 secs 2024-04-21T16:47:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:18 smithi077 ceph-mon[27902]: pgmap v12331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:47:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22948.757446 secs 2024-04-21T16:47:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:18 smithi191 ceph-mon[31636]: pgmap v12331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:47:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22948.757446 secs 2024-04-21T16:47:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22950.519046 secs 2024-04-21T16:47:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:20 smithi170 ceph-mon[31212]: pgmap v12332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:47:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22950.519046 secs 2024-04-21T16:47:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:20 smithi077 ceph-mon[27902]: pgmap v12332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:47:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22950.519046 secs 2024-04-21T16:47:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:20 smithi191 ceph-mon[31636]: pgmap v12332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:47:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:22 smithi170 ceph-mon[31212]: pgmap v12333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:22 smithi077 ceph-mon[27902]: pgmap v12333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:22 smithi191 ceph-mon[31636]: pgmap v12333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22953.757555 secs 2024-04-21T16:47:23.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22953.757555 secs 2024-04-21T16:47:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22953.757555 secs 2024-04-21T16:47:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:24 smithi170 ceph-mon[31212]: pgmap v12334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:24 smithi077 ceph-mon[27902]: pgmap v12334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:24 smithi191 ceph-mon[31636]: pgmap v12334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:25.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22955.519113 secs 2024-04-21T16:47:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22955.519113 secs 2024-04-21T16:47:25.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22955.519113 secs 2024-04-21T16:47:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:26 smithi170 ceph-mon[31212]: pgmap v12335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:26 smithi077 ceph-mon[27902]: pgmap v12335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:26 smithi191 ceph-mon[31636]: pgmap v12335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:47:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:28 smithi170 ceph-mon[31212]: pgmap v12336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:47:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22958.757671 secs 2024-04-21T16:47:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:28 smithi077 ceph-mon[27902]: pgmap v12336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:47:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22958.757671 secs 2024-04-21T16:47:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:28 smithi191 ceph-mon[31636]: pgmap v12336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:47:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22958.757671 secs 2024-04-21T16:47:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22960.519192 secs 2024-04-21T16:47:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:30 smithi170 ceph-mon[31212]: pgmap v12337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22960.519192 secs 2024-04-21T16:47:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:30 smithi077 ceph-mon[27902]: pgmap v12337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22960.519192 secs 2024-04-21T16:47:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:30 smithi191 ceph-mon[31636]: pgmap v12337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:32 smithi077 ceph-mon[27902]: pgmap v12338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:32 smithi191 ceph-mon[31636]: pgmap v12338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:32 smithi170 ceph-mon[31212]: pgmap v12338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:33.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22963.757796 secs 2024-04-21T16:47:33.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22963.757796 secs 2024-04-21T16:47:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22963.757796 secs 2024-04-21T16:47:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:34 smithi077 ceph-mon[27902]: pgmap v12339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:34 smithi191 ceph-mon[31636]: pgmap v12339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:34 smithi170 ceph-mon[31212]: pgmap v12339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22965.519305 secs 2024-04-21T16:47:35.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22965.519305 secs 2024-04-21T16:47:36.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22965.519305 secs 2024-04-21T16:47:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:36 smithi077 ceph-mon[27902]: pgmap v12340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:36 smithi191 ceph-mon[31636]: pgmap v12340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:37.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:36 smithi170 ceph-mon[31212]: pgmap v12340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:38 smithi077 ceph-mon[27902]: pgmap v12341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22968.757857 secs 2024-04-21T16:47:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:38 smithi191 ceph-mon[31636]: pgmap v12341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22968.757857 secs 2024-04-21T16:47:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:38 smithi170 ceph-mon[31212]: pgmap v12341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22968.757857 secs 2024-04-21T16:47:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22970.519456 secs 2024-04-21T16:47:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:40 smithi077 ceph-mon[27902]: pgmap v12342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22970.519456 secs 2024-04-21T16:47:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:40 smithi191 ceph-mon[31636]: pgmap v12342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22970.519456 secs 2024-04-21T16:47:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:40 smithi170 ceph-mon[31212]: pgmap v12342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:42 smithi077 ceph-mon[27902]: pgmap v12343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:42 smithi191 ceph-mon[31636]: pgmap v12343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:42 smithi170 ceph-mon[31212]: pgmap v12343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:43.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22973.757924 secs 2024-04-21T16:47:43.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22973.757924 secs 2024-04-21T16:47:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22973.757924 secs 2024-04-21T16:47:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:44 smithi077 ceph-mon[27902]: pgmap v12344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:44 smithi191 ceph-mon[31636]: pgmap v12344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:44 smithi170 ceph-mon[31212]: pgmap v12344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22975.519593 secs 2024-04-21T16:47:45.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22975.519593 secs 2024-04-21T16:47:46.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22975.519593 secs 2024-04-21T16:47:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:46 smithi077 ceph-mon[27902]: pgmap v12345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:46 smithi191 ceph-mon[31636]: pgmap v12345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:46 smithi170 ceph-mon[31212]: pgmap v12345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:47:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:47:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:47:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:48 smithi077 ceph-mon[27902]: pgmap v12346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22978.758042 secs 2024-04-21T16:47:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:47:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:47:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:47:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:48 smithi191 ceph-mon[31636]: pgmap v12346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22978.758042 secs 2024-04-21T16:47:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:47:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:47:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:47:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:48 smithi170 ceph-mon[31212]: pgmap v12346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22978.758042 secs 2024-04-21T16:47:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:47:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:47:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:47:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22980.519668 secs 2024-04-21T16:47:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:50 smithi077 ceph-mon[27902]: pgmap v12347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22980.519668 secs 2024-04-21T16:47:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:50 smithi191 ceph-mon[31636]: pgmap v12347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22980.519668 secs 2024-04-21T16:47:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:50 smithi170 ceph-mon[31212]: pgmap v12347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:52 smithi077 ceph-mon[27902]: pgmap v12348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:52 smithi191 ceph-mon[31636]: pgmap v12348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:52 smithi170 ceph-mon[31212]: pgmap v12348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22983.758149 secs 2024-04-21T16:47:53.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22983.758149 secs 2024-04-21T16:47:54.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22983.758149 secs 2024-04-21T16:47:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:54 smithi077 ceph-mon[27902]: pgmap v12349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22985.519803 secs 2024-04-21T16:47:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:54 smithi191 ceph-mon[31636]: pgmap v12349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22985.519803 secs 2024-04-21T16:47:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:54 smithi170 ceph-mon[31212]: pgmap v12349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22985.519803 secs 2024-04-21T16:47:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:47:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:56 smithi077 ceph-mon[27902]: pgmap v12350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:56 smithi191 ceph-mon[31636]: pgmap v12350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:57.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:56 smithi170 ceph-mon[31212]: pgmap v12350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:47:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:58 smithi077 ceph-mon[27902]: pgmap v12351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22988.758215 secs 2024-04-21T16:47:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:58 smithi191 ceph-mon[31636]: pgmap v12351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22988.758215 secs 2024-04-21T16:47:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:58 smithi170 ceph-mon[31212]: pgmap v12351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:47:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22988.758215 secs 2024-04-21T16:47:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:47:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22990.519955 secs 2024-04-21T16:48:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:47:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22990.519955 secs 2024-04-21T16:48:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:47:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22990.519955 secs 2024-04-21T16:48:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:00 smithi191 ceph-mon[31636]: pgmap v12352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:00 smithi170 ceph-mon[31212]: pgmap v12352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:00 smithi077 ceph-mon[27902]: pgmap v12352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:01.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:01 smithi191 ceph-mon[31636]: pgmap v12353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:02.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:01 smithi170 ceph-mon[31212]: pgmap v12353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:02.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:01 smithi077 ceph-mon[27902]: pgmap v12353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22993.758279 secs 2024-04-21T16:48:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22993.758279 secs 2024-04-21T16:48:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22993.758279 secs 2024-04-21T16:48:04.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:03 smithi191 ceph-mon[31636]: pgmap v12354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:03 smithi170 ceph-mon[31212]: pgmap v12354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:03 smithi077 ceph-mon[27902]: pgmap v12354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 22995.520018 secs 2024-04-21T16:48:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:04 smithi191 ceph-mon[31636]: osdmap e844: 12 total, 12 up, 12 in 2024-04-21T16:48:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 22995.520018 secs 2024-04-21T16:48:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:04 smithi170 ceph-mon[31212]: osdmap e844: 12 total, 12 up, 12 in 2024-04-21T16:48:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 22995.520018 secs 2024-04-21T16:48:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:04 smithi077 ceph-mon[27902]: osdmap e844: 12 total, 12 up, 12 in 2024-04-21T16:48:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:05 smithi191 ceph-mon[31636]: pgmap v12356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:48:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:05 smithi170 ceph-mon[31212]: pgmap v12356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:48:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:05 smithi077 ceph-mon[27902]: pgmap v12356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:48:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:07 smithi191 ceph-mon[31636]: pgmap v12357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:48:08.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 22998.758358 secs 2024-04-21T16:48:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:07 smithi170 ceph-mon[31212]: pgmap v12357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:48:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 22998.758358 secs 2024-04-21T16:48:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:07 smithi077 ceph-mon[27902]: pgmap v12357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:48:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 22998.758358 secs 2024-04-21T16:48:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23000.520115 secs 2024-04-21T16:48:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:09 smithi191 ceph-mon[31636]: pgmap v12358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:48:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23000.520115 secs 2024-04-21T16:48:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:09 smithi170 ceph-mon[31212]: pgmap v12358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:48:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23000.520115 secs 2024-04-21T16:48:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:09 smithi077 ceph-mon[27902]: pgmap v12358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:48:12.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:12 smithi077 ceph-mon[27902]: pgmap v12359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:48:12.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:12 smithi077 ceph-mon[27902]: osdmap e845: 12 total, 12 up, 12 in 2024-04-21T16:48:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:12 smithi191 ceph-mon[31636]: pgmap v12359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:48:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:12 smithi191 ceph-mon[31636]: osdmap e845: 12 total, 12 up, 12 in 2024-04-21T16:48:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:12 smithi170 ceph-mon[31212]: pgmap v12359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:48:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:12 smithi170 ceph-mon[31212]: osdmap e845: 12 total, 12 up, 12 in 2024-04-21T16:48:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23003.758468 secs 2024-04-21T16:48:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23003.758468 secs 2024-04-21T16:48:13.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23003.758468 secs 2024-04-21T16:48:14.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:14 smithi077 ceph-mon[27902]: pgmap v12361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T16:48:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:14 smithi191 ceph-mon[31636]: pgmap v12361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T16:48:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:14 smithi170 ceph-mon[31212]: pgmap v12361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T16:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23005.520177 secs 2024-04-21T16:48:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23005.520177 secs 2024-04-21T16:48:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23005.520177 secs 2024-04-21T16:48:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:16 smithi077 ceph-mon[27902]: pgmap v12362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:48:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:16 smithi191 ceph-mon[31636]: pgmap v12362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:48:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:16 smithi170 ceph-mon[31212]: pgmap v12362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:48:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:18 smithi077 ceph-mon[27902]: pgmap v12363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:48:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23008.758583 secs 2024-04-21T16:48:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:18 smithi191 ceph-mon[31636]: pgmap v12363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:48:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23008.758583 secs 2024-04-21T16:48:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:18 smithi170 ceph-mon[31212]: pgmap v12363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:48:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23008.758583 secs 2024-04-21T16:48:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23010.520300 secs 2024-04-21T16:48:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:20 smithi191 ceph-mon[31636]: pgmap v12364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:48:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23010.520300 secs 2024-04-21T16:48:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:20 smithi170 ceph-mon[31212]: pgmap v12364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:48:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23010.520300 secs 2024-04-21T16:48:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:20 smithi077 ceph-mon[27902]: pgmap v12364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:48:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:22 smithi191 ceph-mon[31636]: pgmap v12365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:48:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:22 smithi170 ceph-mon[31212]: pgmap v12365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:22 smithi077 ceph-mon[27902]: pgmap v12365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:48:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23013.758701 secs 2024-04-21T16:48:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23013.758701 secs 2024-04-21T16:48:23.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23013.758701 secs 2024-04-21T16:48:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:24 smithi191 ceph-mon[31636]: pgmap v12366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:48:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:24 smithi170 ceph-mon[31212]: pgmap v12366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:48:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:24 smithi077 ceph-mon[27902]: pgmap v12366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:48:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23015.520394 secs 2024-04-21T16:48:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23015.520394 secs 2024-04-21T16:48:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23015.520394 secs 2024-04-21T16:48:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:26 smithi191 ceph-mon[31636]: pgmap v12367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:26 smithi170 ceph-mon[31212]: pgmap v12367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:26 smithi077 ceph-mon[27902]: pgmap v12367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:48:27.537+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:48:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:48:27.537+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:48:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:48:27.537+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:48:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:48:27.537+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:48:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:28 smithi191 ceph-mon[31636]: pgmap v12368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23018.758817 secs 2024-04-21T16:48:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:28 smithi170 ceph-mon[31212]: pgmap v12368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23018.758817 secs 2024-04-21T16:48:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:28 smithi077 ceph-mon[27902]: pgmap v12368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23018.758817 secs 2024-04-21T16:48:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23020.520511 secs 2024-04-21T16:48:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:30 smithi191 ceph-mon[31636]: pgmap v12369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23020.520511 secs 2024-04-21T16:48:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:30 smithi170 ceph-mon[31212]: pgmap v12369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23020.520511 secs 2024-04-21T16:48:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:30 smithi077 ceph-mon[27902]: pgmap v12369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:32 smithi191 ceph-mon[31636]: pgmap v12370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:32 smithi170 ceph-mon[31212]: pgmap v12370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:32 smithi077 ceph-mon[27902]: pgmap v12370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23023.758931 secs 2024-04-21T16:48:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23023.758931 secs 2024-04-21T16:48:33.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23023.758931 secs 2024-04-21T16:48:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:34 smithi191 ceph-mon[31636]: pgmap v12371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:34 smithi170 ceph-mon[31212]: pgmap v12371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:34 smithi077 ceph-mon[27902]: pgmap v12371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23025.520642 secs 2024-04-21T16:48:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23025.520642 secs 2024-04-21T16:48:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23025.520642 secs 2024-04-21T16:48:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:36 smithi191 ceph-mon[31636]: pgmap v12372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:36 smithi170 ceph-mon[31212]: pgmap v12372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:36 smithi077 ceph-mon[27902]: pgmap v12372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:38 smithi191 ceph-mon[31636]: pgmap v12373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23028.759043 secs 2024-04-21T16:48:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:38 smithi170 ceph-mon[31212]: pgmap v12373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23028.759043 secs 2024-04-21T16:48:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:38 smithi077 ceph-mon[27902]: pgmap v12373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23028.759043 secs 2024-04-21T16:48:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23030.520793 secs 2024-04-21T16:48:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:40 smithi191 ceph-mon[31636]: pgmap v12374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23030.520793 secs 2024-04-21T16:48:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:40 smithi170 ceph-mon[31212]: pgmap v12374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23030.520793 secs 2024-04-21T16:48:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:40 smithi077 ceph-mon[27902]: pgmap v12374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:42 smithi191 ceph-mon[31636]: pgmap v12375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:42 smithi170 ceph-mon[31212]: pgmap v12375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:42 smithi077 ceph-mon[27902]: pgmap v12375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23033.759160 secs 2024-04-21T16:48:43.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23033.759160 secs 2024-04-21T16:48:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23033.759160 secs 2024-04-21T16:48:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:44 smithi191 ceph-mon[31636]: pgmap v12376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:44 smithi170 ceph-mon[31212]: pgmap v12376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:44 smithi077 ceph-mon[27902]: pgmap v12376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23035.520902 secs 2024-04-21T16:48:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23035.520902 secs 2024-04-21T16:48:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23035.520902 secs 2024-04-21T16:48:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:46 smithi191 ceph-mon[31636]: pgmap v12377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:46 smithi170 ceph-mon[31212]: pgmap v12377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:46 smithi077 ceph-mon[27902]: pgmap v12377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:48 smithi191 ceph-mon[31636]: pgmap v12378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23038.759276 secs 2024-04-21T16:48:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:48:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:48:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:48:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:48:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:48 smithi170 ceph-mon[31212]: pgmap v12378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23038.759276 secs 2024-04-21T16:48:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:48:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:48:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:48:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:48:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:48 smithi077 ceph-mon[27902]: pgmap v12378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23038.759276 secs 2024-04-21T16:48:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:48:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:48:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:48:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:48:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:50 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 23040.520989 secs 2024-04-21T16:48:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:50 smithi191 ceph-mon[31636]: slow request 23040.520988 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T16:48:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:50 smithi191 ceph-mon[31636]: pgmap v12379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:50 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 23040.520989 secs 2024-04-21T16:48:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:50 smithi170 ceph-mon[31212]: slow request 23040.520988 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T16:48:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:50 smithi170 ceph-mon[31212]: pgmap v12379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:50 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 23040.520989 secs 2024-04-21T16:48:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:50 smithi077 ceph-mon[27902]: slow request 23040.520988 seconds old, received at 2024-04-21T10:24:48.132616+0000: peer_request:mds.1:1146 currently dispatched 2024-04-21T16:48:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:50 smithi077 ceph-mon[27902]: pgmap v12379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:52 smithi170 ceph-mon[31212]: pgmap v12380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:52 smithi077 ceph-mon[27902]: pgmap v12380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:52 smithi191 ceph-mon[31636]: pgmap v12380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:53 smithi170 ceph-mon[31212]: 1 slow requests, 1 included below; oldest blocked for > 23043.759388 secs 2024-04-21T16:48:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:53 smithi170 ceph-mon[31212]: slow request 23043.759387 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T16:48:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:53 smithi077 ceph-mon[27902]: 1 slow requests, 1 included below; oldest blocked for > 23043.759388 secs 2024-04-21T16:48:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:53 smithi077 ceph-mon[27902]: slow request 23043.759387 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T16:48:53.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:53 smithi191 ceph-mon[31636]: 1 slow requests, 1 included below; oldest blocked for > 23043.759388 secs 2024-04-21T16:48:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:53 smithi191 ceph-mon[31636]: slow request 23043.759387 seconds old, received at 2024-04-21T10:24:48.132326+0000: internal op exportdir:mds.1:1146 currently failed to acquire quiesce lock 2024-04-21T16:48:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:54 smithi170 ceph-mon[31212]: pgmap v12381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:54 smithi077 ceph-mon[27902]: pgmap v12381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:54 smithi191 ceph-mon[31636]: pgmap v12381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:48:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23045.521068 secs 2024-04-21T16:48:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23045.521068 secs 2024-04-21T16:48:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23045.521068 secs 2024-04-21T16:48:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:56 smithi170 ceph-mon[31212]: pgmap v12382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:56 smithi077 ceph-mon[27902]: pgmap v12382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:56 smithi191 ceph-mon[31636]: pgmap v12382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:48:58.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:58 smithi191 ceph-mon[31636]: pgmap v12383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:58.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:48:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23048.759483 secs 2024-04-21T16:48:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:58 smithi170 ceph-mon[31212]: pgmap v12383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:48:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23048.759483 secs 2024-04-21T16:48:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:58 smithi077 ceph-mon[27902]: pgmap v12383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:48:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:48:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23048.759483 secs 2024-04-21T16:49:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23050.521184 secs 2024-04-21T16:49:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:00 smithi170 ceph-mon[31212]: pgmap v12384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23050.521184 secs 2024-04-21T16:49:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:00 smithi077 ceph-mon[27902]: pgmap v12384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23050.521184 secs 2024-04-21T16:49:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:00 smithi191 ceph-mon[31636]: pgmap v12384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:02 smithi170 ceph-mon[31212]: pgmap v12385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:02 smithi077 ceph-mon[27902]: pgmap v12385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:02 smithi191 ceph-mon[31636]: pgmap v12385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23053.759618 secs 2024-04-21T16:49:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23053.759618 secs 2024-04-21T16:49:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23053.759618 secs 2024-04-21T16:49:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:04 smithi170 ceph-mon[31212]: pgmap v12386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:04 smithi077 ceph-mon[27902]: pgmap v12386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:04 smithi191 ceph-mon[31636]: pgmap v12386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23055.521326 secs 2024-04-21T16:49:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:05 smithi170 ceph-mon[31212]: osdmap e846: 12 total, 12 up, 12 in 2024-04-21T16:49:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23055.521326 secs 2024-04-21T16:49:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:05 smithi077 ceph-mon[27902]: osdmap e846: 12 total, 12 up, 12 in 2024-04-21T16:49:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23055.521326 secs 2024-04-21T16:49:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:05 smithi191 ceph-mon[31636]: osdmap e846: 12 total, 12 up, 12 in 2024-04-21T16:49:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:06 smithi170 ceph-mon[31212]: pgmap v12388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:49:06.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:06 smithi077 ceph-mon[27902]: pgmap v12388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:49:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:06 smithi191 ceph-mon[31636]: pgmap v12388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:49:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:08 smithi170 ceph-mon[31212]: pgmap v12389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23058.759733 secs 2024-04-21T16:49:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:08 smithi077 ceph-mon[27902]: pgmap v12389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23058.759733 secs 2024-04-21T16:49:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:08 smithi191 ceph-mon[31636]: pgmap v12389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23058.759733 secs 2024-04-21T16:49:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23060.521445 secs 2024-04-21T16:49:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:10 smithi170 ceph-mon[31212]: pgmap v12390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23060.521445 secs 2024-04-21T16:49:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:10 smithi077 ceph-mon[27902]: pgmap v12390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23060.521445 secs 2024-04-21T16:49:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:10 smithi191 ceph-mon[31636]: pgmap v12390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:12 smithi077 ceph-mon[27902]: pgmap v12391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:12 smithi077 ceph-mon[27902]: osdmap e847: 12 total, 12 up, 12 in 2024-04-21T16:49:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:12 smithi191 ceph-mon[31636]: pgmap v12391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:12 smithi191 ceph-mon[31636]: osdmap e847: 12 total, 12 up, 12 in 2024-04-21T16:49:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:12 smithi170 ceph-mon[31212]: pgmap v12391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:12 smithi170 ceph-mon[31212]: osdmap e847: 12 total, 12 up, 12 in 2024-04-21T16:49:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23063.759855 secs 2024-04-21T16:49:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23063.759855 secs 2024-04-21T16:49:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23063.759855 secs 2024-04-21T16:49:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:14 smithi191 ceph-mon[31636]: pgmap v12393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:49:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:14 smithi170 ceph-mon[31212]: pgmap v12393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:49:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:14 smithi077 ceph-mon[27902]: pgmap v12393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:49:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23065.521564 secs 2024-04-21T16:49:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23065.521564 secs 2024-04-21T16:49:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23065.521564 secs 2024-04-21T16:49:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:16 smithi191 ceph-mon[31636]: pgmap v12394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:16 smithi170 ceph-mon[31212]: pgmap v12394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:16 smithi077 ceph-mon[27902]: pgmap v12394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:49:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:18 smithi191 ceph-mon[31636]: pgmap v12395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:49:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23068.759945 secs 2024-04-21T16:49:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:18 smithi170 ceph-mon[31212]: pgmap v12395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:49:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23068.759945 secs 2024-04-21T16:49:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:18 smithi077 ceph-mon[27902]: pgmap v12395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:49:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23068.759945 secs 2024-04-21T16:49:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23070.521698 secs 2024-04-21T16:49:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:20 smithi191 ceph-mon[31636]: pgmap v12396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:49:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23070.521698 secs 2024-04-21T16:49:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:20 smithi170 ceph-mon[31212]: pgmap v12396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:49:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23070.521698 secs 2024-04-21T16:49:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:20 smithi077 ceph-mon[27902]: pgmap v12396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:49:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:22 smithi191 ceph-mon[31636]: pgmap v12397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:49:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:22 smithi170 ceph-mon[31212]: pgmap v12397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:49:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:22 smithi077 ceph-mon[27902]: pgmap v12397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:49:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23073.760097 secs 2024-04-21T16:49:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23073.760097 secs 2024-04-21T16:49:23.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23073.760097 secs 2024-04-21T16:49:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:24 smithi191 ceph-mon[31636]: pgmap v12398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:49:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:24 smithi170 ceph-mon[31212]: pgmap v12398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:49:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:24 smithi077 ceph-mon[27902]: pgmap v12398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:49:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23075.521833 secs 2024-04-21T16:49:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23075.521833 secs 2024-04-21T16:49:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23075.521833 secs 2024-04-21T16:49:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:26 smithi191 ceph-mon[31636]: pgmap v12399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:26 smithi170 ceph-mon[31212]: pgmap v12399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:26 smithi077 ceph-mon[27902]: pgmap v12399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:28 smithi191 ceph-mon[31636]: pgmap v12400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23078.760204 secs 2024-04-21T16:49:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:28 smithi170 ceph-mon[31212]: pgmap v12400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23078.760204 secs 2024-04-21T16:49:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:28 smithi077 ceph-mon[27902]: pgmap v12400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23078.760204 secs 2024-04-21T16:49:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23080.521977 secs 2024-04-21T16:49:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:30 smithi191 ceph-mon[31636]: pgmap v12401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23080.521977 secs 2024-04-21T16:49:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:30 smithi170 ceph-mon[31212]: pgmap v12401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23080.521977 secs 2024-04-21T16:49:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:30 smithi077 ceph-mon[27902]: pgmap v12401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:32 smithi191 ceph-mon[31636]: pgmap v12402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:32 smithi170 ceph-mon[31212]: pgmap v12402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:32 smithi077 ceph-mon[27902]: pgmap v12402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23083.760278 secs 2024-04-21T16:49:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23083.760278 secs 2024-04-21T16:49:33.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23083.760278 secs 2024-04-21T16:49:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:34 smithi191 ceph-mon[31636]: pgmap v12403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:34 smithi170 ceph-mon[31212]: pgmap v12403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:34 smithi077 ceph-mon[27902]: pgmap v12403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23085.522053 secs 2024-04-21T16:49:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23085.522053 secs 2024-04-21T16:49:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23085.522053 secs 2024-04-21T16:49:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:36 smithi191 ceph-mon[31636]: pgmap v12404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:36 smithi170 ceph-mon[31212]: pgmap v12404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:36 smithi077 ceph-mon[27902]: pgmap v12404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:38 smithi191 ceph-mon[31636]: pgmap v12405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23088.760375 secs 2024-04-21T16:49:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:38 smithi170 ceph-mon[31212]: pgmap v12405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23088.760375 secs 2024-04-21T16:49:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:38 smithi077 ceph-mon[27902]: pgmap v12405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23088.760375 secs 2024-04-21T16:49:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23090.522138 secs 2024-04-21T16:49:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:40 smithi191 ceph-mon[31636]: pgmap v12406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23090.522138 secs 2024-04-21T16:49:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:40 smithi170 ceph-mon[31212]: pgmap v12406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23090.522138 secs 2024-04-21T16:49:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:40 smithi077 ceph-mon[27902]: pgmap v12406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:42 smithi191 ceph-mon[31636]: pgmap v12407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:42 smithi170 ceph-mon[31212]: pgmap v12407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:42 smithi077 ceph-mon[27902]: pgmap v12407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23093.760510 secs 2024-04-21T16:49:43.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23093.760510 secs 2024-04-21T16:49:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23093.760510 secs 2024-04-21T16:49:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:44 smithi191 ceph-mon[31636]: pgmap v12408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:44 smithi170 ceph-mon[31212]: pgmap v12408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:44 smithi077 ceph-mon[27902]: pgmap v12408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23095.522251 secs 2024-04-21T16:49:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23095.522251 secs 2024-04-21T16:49:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23095.522251 secs 2024-04-21T16:49:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:46 smithi191 ceph-mon[31636]: pgmap v12409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:46 smithi170 ceph-mon[31212]: pgmap v12409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:46 smithi077 ceph-mon[27902]: pgmap v12409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:48 smithi170 ceph-mon[31212]: pgmap v12410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23098.760622 secs 2024-04-21T16:49:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:48 smithi077 ceph-mon[27902]: pgmap v12410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23098.760622 secs 2024-04-21T16:49:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:48 smithi191 ceph-mon[31636]: pgmap v12410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23098.760622 secs 2024-04-21T16:49:49.582 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:49:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:49:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:49:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23100.522323 secs 2024-04-21T16:49:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: pgmap v12411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23100.522323 secs 2024-04-21T16:49:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: pgmap v12411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23100.522323 secs 2024-04-21T16:49:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: pgmap v12411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:49:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:51.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:49:51.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:49:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:49:51.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T16:49:51.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:49:51.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:49:51.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:49:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: pgmap v12412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:49:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:49:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:49:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:49:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:49:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: pgmap v12412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:49:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:49:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: pgmap v12412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T16:49:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T16:49:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T16:49:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T16:49:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T16:49:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T16:49:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23103.760778 secs 2024-04-21T16:49:53.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23103.760778 secs 2024-04-21T16:49:53.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23103.760778 secs 2024-04-21T16:49:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:54 smithi170 ceph-mon[31212]: pgmap v12413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:49:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:54 smithi077 ceph-mon[27902]: pgmap v12413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:49:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:54 smithi191 ceph-mon[31636]: pgmap v12413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:49:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:49:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23105.522458 secs 2024-04-21T16:49:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23105.522458 secs 2024-04-21T16:49:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23105.522458 secs 2024-04-21T16:49:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:56 smithi170 ceph-mon[31212]: pgmap v12414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:49:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:56 smithi077 ceph-mon[27902]: pgmap v12414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:49:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:56 smithi191 ceph-mon[31636]: pgmap v12414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:49:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:49:57.550+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:49:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:49:57.550+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:49:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:49:57.550+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:49:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:49:57.550+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:49:58.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:58 smithi191 ceph-mon[31636]: pgmap v12415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:58.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:49:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23108.760903 secs 2024-04-21T16:49:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:58 smithi170 ceph-mon[31212]: pgmap v12415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:49:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23108.760903 secs 2024-04-21T16:49:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:58 smithi077 ceph-mon[27902]: pgmap v12415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:49:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:49:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23108.760903 secs 2024-04-21T16:50:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23110.522573 secs 2024-04-21T16:50:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:00 smithi170 ceph-mon[31212]: pgmap v12416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:50:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:50:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23110.522573 secs 2024-04-21T16:50:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:00 smithi077 ceph-mon[27902]: pgmap v12416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:50:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:50:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23110.522573 secs 2024-04-21T16:50:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:00 smithi191 ceph-mon[31636]: pgmap v12416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:50:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T16:50:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:02 smithi170 ceph-mon[31212]: pgmap v12417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:02 smithi077 ceph-mon[27902]: pgmap v12417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:02 smithi191 ceph-mon[31636]: pgmap v12417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23113.760967 secs 2024-04-21T16:50:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23113.760967 secs 2024-04-21T16:50:03.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23113.760967 secs 2024-04-21T16:50:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:04 smithi170 ceph-mon[31212]: pgmap v12418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:04 smithi077 ceph-mon[27902]: pgmap v12418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:04 smithi191 ceph-mon[31636]: pgmap v12418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23115.522722 secs 2024-04-21T16:50:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:05 smithi170 ceph-mon[31212]: osdmap e848: 12 total, 12 up, 12 in 2024-04-21T16:50:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23115.522722 secs 2024-04-21T16:50:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:05 smithi077 ceph-mon[27902]: osdmap e848: 12 total, 12 up, 12 in 2024-04-21T16:50:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23115.522722 secs 2024-04-21T16:50:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:05 smithi191 ceph-mon[31636]: osdmap e848: 12 total, 12 up, 12 in 2024-04-21T16:50:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:06 smithi170 ceph-mon[31212]: pgmap v12420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:50:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:06 smithi077 ceph-mon[27902]: pgmap v12420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:50:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:06 smithi191 ceph-mon[31636]: pgmap v12420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:50:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:08 smithi170 ceph-mon[31212]: pgmap v12421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:50:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23118.761090 secs 2024-04-21T16:50:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:08 smithi077 ceph-mon[27902]: pgmap v12421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:50:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23118.761090 secs 2024-04-21T16:50:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:08 smithi191 ceph-mon[31636]: pgmap v12421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:50:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23118.761090 secs 2024-04-21T16:50:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23120.522845 secs 2024-04-21T16:50:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:10 smithi170 ceph-mon[31212]: pgmap v12422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:50:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23120.522845 secs 2024-04-21T16:50:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:10 smithi077 ceph-mon[27902]: pgmap v12422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:50:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23120.522845 secs 2024-04-21T16:50:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:10 smithi191 ceph-mon[31636]: pgmap v12422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:50:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:12 smithi191 ceph-mon[31636]: pgmap v12423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:50:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:12 smithi191 ceph-mon[31636]: osdmap e849: 12 total, 12 up, 12 in 2024-04-21T16:50:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:12 smithi170 ceph-mon[31212]: pgmap v12423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:50:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:12 smithi170 ceph-mon[31212]: osdmap e849: 12 total, 12 up, 12 in 2024-04-21T16:50:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:12 smithi077 ceph-mon[27902]: pgmap v12423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:50:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:12 smithi077 ceph-mon[27902]: osdmap e849: 12 total, 12 up, 12 in 2024-04-21T16:50:13.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23123.761217 secs 2024-04-21T16:50:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23123.761217 secs 2024-04-21T16:50:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23123.761217 secs 2024-04-21T16:50:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:14 smithi191 ceph-mon[31636]: pgmap v12425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:50:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:14 smithi170 ceph-mon[31212]: pgmap v12425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:50:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:14 smithi077 ceph-mon[27902]: pgmap v12425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:50:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23125.522933 secs 2024-04-21T16:50:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23125.522933 secs 2024-04-21T16:50:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23125.522933 secs 2024-04-21T16:50:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:16 smithi191 ceph-mon[31636]: pgmap v12426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:50:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:16 smithi170 ceph-mon[31212]: pgmap v12426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:50:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:16 smithi077 ceph-mon[27902]: pgmap v12426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:50:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23128.761362 secs 2024-04-21T16:50:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23128.761362 secs 2024-04-21T16:50:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23128.761362 secs 2024-04-21T16:50:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:18 smithi191 ceph-mon[31636]: pgmap v12427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:50:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:18 smithi170 ceph-mon[31212]: pgmap v12427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:50:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:18 smithi077 ceph-mon[27902]: pgmap v12427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:50:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23130.523002 secs 2024-04-21T16:50:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:20 smithi191 ceph-mon[31636]: pgmap v12428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:50:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23130.523002 secs 2024-04-21T16:50:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:20 smithi170 ceph-mon[31212]: pgmap v12428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:50:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23130.523002 secs 2024-04-21T16:50:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:20 smithi077 ceph-mon[27902]: pgmap v12428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:50:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:22 smithi191 ceph-mon[31636]: pgmap v12429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:50:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23133.761511 secs 2024-04-21T16:50:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:22 smithi170 ceph-mon[31212]: pgmap v12429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:50:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23133.761511 secs 2024-04-21T16:50:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:22 smithi077 ceph-mon[27902]: pgmap v12429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:50:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23133.761511 secs 2024-04-21T16:50:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:24 smithi191 ceph-mon[31636]: pgmap v12430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:50:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:24 smithi170 ceph-mon[31212]: pgmap v12430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:50:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:24 smithi077 ceph-mon[27902]: pgmap v12430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:50:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23135.523089 secs 2024-04-21T16:50:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23135.523089 secs 2024-04-21T16:50:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23135.523089 secs 2024-04-21T16:50:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:26 smithi191 ceph-mon[31636]: pgmap v12431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:26 smithi170 ceph-mon[31212]: pgmap v12431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:26 smithi077 ceph-mon[27902]: pgmap v12431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23138.761634 secs 2024-04-21T16:50:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23138.761634 secs 2024-04-21T16:50:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23138.761634 secs 2024-04-21T16:50:28.709 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:28 smithi170 ceph-mon[31212]: pgmap v12432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:28 smithi191 ceph-mon[31636]: pgmap v12432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:28 smithi077 ceph-mon[27902]: pgmap v12432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23140.523167 secs 2024-04-21T16:50:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:30 smithi191 ceph-mon[31636]: pgmap v12433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23140.523167 secs 2024-04-21T16:50:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:30 smithi170 ceph-mon[31212]: pgmap v12433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23140.523167 secs 2024-04-21T16:50:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:30 smithi077 ceph-mon[27902]: pgmap v12433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:32 smithi191 ceph-mon[31636]: pgmap v12434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23143.761780 secs 2024-04-21T16:50:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:32 smithi170 ceph-mon[31212]: pgmap v12434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23143.761780 secs 2024-04-21T16:50:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:32 smithi077 ceph-mon[27902]: pgmap v12434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23143.761780 secs 2024-04-21T16:50:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:34 smithi191 ceph-mon[31636]: pgmap v12435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:34 smithi170 ceph-mon[31212]: pgmap v12435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:34 smithi077 ceph-mon[27902]: pgmap v12435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23145.523283 secs 2024-04-21T16:50:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23145.523283 secs 2024-04-21T16:50:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23145.523283 secs 2024-04-21T16:50:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:36 smithi191 ceph-mon[31636]: pgmap v12436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:36 smithi170 ceph-mon[31212]: pgmap v12436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:36 smithi077 ceph-mon[27902]: pgmap v12436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23148.761855 secs 2024-04-21T16:50:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23148.761855 secs 2024-04-21T16:50:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23148.761855 secs 2024-04-21T16:50:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:38 smithi191 ceph-mon[31636]: pgmap v12437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:38 smithi170 ceph-mon[31212]: pgmap v12437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:38 smithi077 ceph-mon[27902]: pgmap v12437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23150.523399 secs 2024-04-21T16:50:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:40 smithi170 ceph-mon[31212]: pgmap v12438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23150.523399 secs 2024-04-21T16:50:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:40 smithi077 ceph-mon[27902]: pgmap v12438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23150.523399 secs 2024-04-21T16:50:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:40 smithi191 ceph-mon[31636]: pgmap v12438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:42 smithi170 ceph-mon[31212]: pgmap v12439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23153.761971 secs 2024-04-21T16:50:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:42 smithi077 ceph-mon[27902]: pgmap v12439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23153.761971 secs 2024-04-21T16:50:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:42 smithi191 ceph-mon[31636]: pgmap v12439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23153.761971 secs 2024-04-21T16:50:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:44 smithi170 ceph-mon[31212]: pgmap v12440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:44 smithi077 ceph-mon[27902]: pgmap v12440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:44 smithi191 ceph-mon[31636]: pgmap v12440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23155.523545 secs 2024-04-21T16:50:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23155.523545 secs 2024-04-21T16:50:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23155.523545 secs 2024-04-21T16:50:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:46 smithi170 ceph-mon[31212]: pgmap v12441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:46 smithi077 ceph-mon[27902]: pgmap v12441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:46 smithi191 ceph-mon[31636]: pgmap v12441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23158.762036 secs 2024-04-21T16:50:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23158.762036 secs 2024-04-21T16:50:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23158.762036 secs 2024-04-21T16:50:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:48 smithi170 ceph-mon[31212]: pgmap v12442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:48 smithi077 ceph-mon[27902]: pgmap v12442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:48 smithi191 ceph-mon[31636]: pgmap v12442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23160.523683 secs 2024-04-21T16:50:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:50 smithi170 ceph-mon[31212]: pgmap v12443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23160.523683 secs 2024-04-21T16:50:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:50 smithi077 ceph-mon[27902]: pgmap v12443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23160.523683 secs 2024-04-21T16:50:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:50 smithi191 ceph-mon[31636]: pgmap v12443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:51.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:50:51.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:50:51.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:50:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: pgmap v12444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23163.762160 secs 2024-04-21T16:50:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:50:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:50:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: pgmap v12444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23163.762160 secs 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:50:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: pgmap v12444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23163.762160 secs 2024-04-21T16:50:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:50:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:50:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:50:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:54 smithi077 ceph-mon[27902]: pgmap v12445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:54 smithi191 ceph-mon[31636]: pgmap v12445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:54 smithi170 ceph-mon[31212]: pgmap v12445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:50:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23165.523800 secs 2024-04-21T16:50:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23165.523800 secs 2024-04-21T16:50:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23165.523800 secs 2024-04-21T16:50:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:56 smithi077 ceph-mon[27902]: pgmap v12446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:56 smithi191 ceph-mon[31636]: pgmap v12446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:56 smithi170 ceph-mon[31212]: pgmap v12446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:50:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23168.762285 secs 2024-04-21T16:50:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23168.762285 secs 2024-04-21T16:50:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23168.762285 secs 2024-04-21T16:50:58.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:50:58 smithi191 ceph-mon[31636]: pgmap v12447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:50:58 smithi077 ceph-mon[27902]: pgmap v12447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:50:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:50:58 smithi170 ceph-mon[31212]: pgmap v12447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23170.523970 secs 2024-04-21T16:51:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:00 smithi077 ceph-mon[27902]: pgmap v12448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23170.523970 secs 2024-04-21T16:51:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:00 smithi191 ceph-mon[31636]: pgmap v12448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23170.523970 secs 2024-04-21T16:51:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:00 smithi170 ceph-mon[31212]: pgmap v12448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:02 smithi077 ceph-mon[27902]: pgmap v12449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T16:51:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23173.762426 secs 2024-04-21T16:51:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:02 smithi191 ceph-mon[31636]: pgmap v12449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T16:51:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23173.762426 secs 2024-04-21T16:51:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:02 smithi170 ceph-mon[31212]: pgmap v12449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T16:51:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23173.762426 secs 2024-04-21T16:51:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:04 smithi077 ceph-mon[27902]: pgmap v12450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T16:51:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:04 smithi191 ceph-mon[31636]: pgmap v12450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T16:51:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:04 smithi170 ceph-mon[31212]: pgmap v12450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T16:51:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23175.524053 secs 2024-04-21T16:51:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:05 smithi077 ceph-mon[27902]: osdmap e850: 12 total, 12 up, 12 in 2024-04-21T16:51:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23175.524053 secs 2024-04-21T16:51:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:05 smithi191 ceph-mon[31636]: osdmap e850: 12 total, 12 up, 12 in 2024-04-21T16:51:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23175.524053 secs 2024-04-21T16:51:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:05 smithi170 ceph-mon[31212]: osdmap e850: 12 total, 12 up, 12 in 2024-04-21T16:51:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:06 smithi077 ceph-mon[27902]: pgmap v12452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:06 smithi191 ceph-mon[31636]: pgmap v12452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:06 smithi170 ceph-mon[31212]: pgmap v12452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23178.762550 secs 2024-04-21T16:51:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23178.762550 secs 2024-04-21T16:51:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23178.762550 secs 2024-04-21T16:51:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:08 smithi191 ceph-mon[31636]: pgmap v12453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:08 smithi170 ceph-mon[31212]: pgmap v12453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:08 smithi077 ceph-mon[27902]: pgmap v12453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23180.524166 secs 2024-04-21T16:51:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23180.524166 secs 2024-04-21T16:51:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23180.524166 secs 2024-04-21T16:51:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:10 smithi191 ceph-mon[31636]: pgmap v12454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:10 smithi170 ceph-mon[31212]: pgmap v12454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:10 smithi077 ceph-mon[27902]: pgmap v12454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:51:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:12 smithi191 ceph-mon[31636]: pgmap v12455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:51:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:12 smithi191 ceph-mon[31636]: osdmap e851: 12 total, 12 up, 12 in 2024-04-21T16:51:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23183.762669 secs 2024-04-21T16:51:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:12 smithi170 ceph-mon[31212]: pgmap v12455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:51:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:12 smithi170 ceph-mon[31212]: osdmap e851: 12 total, 12 up, 12 in 2024-04-21T16:51:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23183.762669 secs 2024-04-21T16:51:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:12 smithi077 ceph-mon[27902]: pgmap v12455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:51:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:12 smithi077 ceph-mon[27902]: osdmap e851: 12 total, 12 up, 12 in 2024-04-21T16:51:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23183.762669 secs 2024-04-21T16:51:14.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:14 smithi077 ceph-mon[27902]: pgmap v12457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 371 B/s wr, 8 op/s 2024-04-21T16:51:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:14 smithi191 ceph-mon[31636]: pgmap v12457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 371 B/s wr, 8 op/s 2024-04-21T16:51:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:14 smithi170 ceph-mon[31212]: pgmap v12457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 371 B/s wr, 8 op/s 2024-04-21T16:51:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23185.524289 secs 2024-04-21T16:51:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23185.524289 secs 2024-04-21T16:51:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23185.524289 secs 2024-04-21T16:51:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:16 smithi191 ceph-mon[31636]: pgmap v12458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:51:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:16 smithi170 ceph-mon[31212]: pgmap v12458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:51:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:16 smithi077 ceph-mon[27902]: pgmap v12458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T16:51:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23188.762811 secs 2024-04-21T16:51:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23188.762811 secs 2024-04-21T16:51:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23188.762811 secs 2024-04-21T16:51:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:18 smithi191 ceph-mon[31636]: pgmap v12459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:51:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:18 smithi170 ceph-mon[31212]: pgmap v12459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:51:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:18 smithi077 ceph-mon[27902]: pgmap v12459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:51:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23190.524410 secs 2024-04-21T16:51:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:20 smithi191 ceph-mon[31636]: pgmap v12460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:51:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23190.524410 secs 2024-04-21T16:51:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:20 smithi170 ceph-mon[31212]: pgmap v12460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:51:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23190.524410 secs 2024-04-21T16:51:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:20 smithi077 ceph-mon[27902]: pgmap v12460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:51:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:22 smithi191 ceph-mon[31636]: pgmap v12461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:51:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23193.762937 secs 2024-04-21T16:51:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:22 smithi170 ceph-mon[31212]: pgmap v12461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:51:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23193.762937 secs 2024-04-21T16:51:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:22 smithi077 ceph-mon[27902]: pgmap v12461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:51:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23193.762937 secs 2024-04-21T16:51:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:24 smithi191 ceph-mon[31636]: pgmap v12462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:51:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:24 smithi170 ceph-mon[31212]: pgmap v12462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:51:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:24 smithi077 ceph-mon[27902]: pgmap v12462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:51:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23195.524538 secs 2024-04-21T16:51:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23195.524538 secs 2024-04-21T16:51:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23195.524538 secs 2024-04-21T16:51:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:26 smithi191 ceph-mon[31636]: pgmap v12463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:26 smithi170 ceph-mon[31212]: pgmap v12463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:26 smithi077 ceph-mon[27902]: pgmap v12463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23198.763019 secs 2024-04-21T16:51:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23198.763019 secs 2024-04-21T16:51:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23198.763019 secs 2024-04-21T16:51:28.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:28 smithi170 ceph-mon[31212]: pgmap v12464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:28 smithi191 ceph-mon[31636]: pgmap v12464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:28 smithi077 ceph-mon[27902]: pgmap v12464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23200.524613 secs 2024-04-21T16:51:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:30 smithi191 ceph-mon[31636]: pgmap v12465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23200.524613 secs 2024-04-21T16:51:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:30 smithi170 ceph-mon[31212]: pgmap v12465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23200.524613 secs 2024-04-21T16:51:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:30 smithi077 ceph-mon[27902]: pgmap v12465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:32 smithi191 ceph-mon[31636]: pgmap v12466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23203.763139 secs 2024-04-21T16:51:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:32 smithi170 ceph-mon[31212]: pgmap v12466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23203.763139 secs 2024-04-21T16:51:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:32 smithi077 ceph-mon[27902]: pgmap v12466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23203.763139 secs 2024-04-21T16:51:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:34 smithi191 ceph-mon[31636]: pgmap v12467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:34 smithi170 ceph-mon[31212]: pgmap v12467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:34 smithi077 ceph-mon[27902]: pgmap v12467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23205.524772 secs 2024-04-21T16:51:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23205.524772 secs 2024-04-21T16:51:35.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23205.524772 secs 2024-04-21T16:51:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:36 smithi170 ceph-mon[31212]: pgmap v12468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:36 smithi077 ceph-mon[27902]: pgmap v12468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:36 smithi191 ceph-mon[31636]: pgmap v12468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:51:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23208.763284 secs 2024-04-21T16:51:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23208.763284 secs 2024-04-21T16:51:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23208.763284 secs 2024-04-21T16:51:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:38 smithi170 ceph-mon[31212]: pgmap v12469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:38 smithi077 ceph-mon[27902]: pgmap v12469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:38 smithi191 ceph-mon[31636]: pgmap v12469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23210.524871 secs 2024-04-21T16:51:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:40 smithi170 ceph-mon[31212]: pgmap v12470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23210.524871 secs 2024-04-21T16:51:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:40 smithi077 ceph-mon[27902]: pgmap v12470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23210.524871 secs 2024-04-21T16:51:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:40 smithi191 ceph-mon[31636]: pgmap v12470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:42 smithi170 ceph-mon[31212]: pgmap v12471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23213.763381 secs 2024-04-21T16:51:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:42 smithi077 ceph-mon[27902]: pgmap v12471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23213.763381 secs 2024-04-21T16:51:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:42 smithi191 ceph-mon[31636]: pgmap v12471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23213.763381 secs 2024-04-21T16:51:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:44 smithi170 ceph-mon[31212]: pgmap v12472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:44 smithi077 ceph-mon[27902]: pgmap v12472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:44 smithi191 ceph-mon[31636]: pgmap v12472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23215.524973 secs 2024-04-21T16:51:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23215.524973 secs 2024-04-21T16:51:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23215.524973 secs 2024-04-21T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:46 smithi170 ceph-mon[31212]: pgmap v12473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:46 smithi077 ceph-mon[27902]: pgmap v12473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:46 smithi191 ceph-mon[31636]: pgmap v12473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23218.763511 secs 2024-04-21T16:51:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23218.763511 secs 2024-04-21T16:51:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23218.763511 secs 2024-04-21T16:51:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:48 smithi170 ceph-mon[31212]: pgmap v12474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:48 smithi077 ceph-mon[27902]: pgmap v12474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:48 smithi191 ceph-mon[31636]: pgmap v12474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23220.525075 secs 2024-04-21T16:51:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:50 smithi170 ceph-mon[31212]: pgmap v12475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23220.525075 secs 2024-04-21T16:51:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:50 smithi077 ceph-mon[27902]: pgmap v12475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23220.525075 secs 2024-04-21T16:51:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:50 smithi191 ceph-mon[31636]: pgmap v12475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:52 smithi170 ceph-mon[31212]: pgmap v12476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23223.763667 secs 2024-04-21T16:51:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:51:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:52 smithi077 ceph-mon[27902]: pgmap v12476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23223.763667 secs 2024-04-21T16:51:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:51:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:52 smithi191 ceph-mon[31636]: pgmap v12476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23223.763667 secs 2024-04-21T16:51:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:51:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: pgmap v12477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:51:54.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:51:54.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: pgmap v12477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:51:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:51:54.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: pgmap v12477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:51:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:51:54.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:51:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:51:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23225.525136 secs 2024-04-21T16:51:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23225.525136 secs 2024-04-21T16:51:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23225.525136 secs 2024-04-21T16:51:56.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:55 smithi191 ceph-mon[31636]: pgmap v12478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:55 smithi170 ceph-mon[31212]: pgmap v12478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:56.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:55 smithi077 ceph-mon[27902]: pgmap v12478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:51:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:56 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23228.763802 secs 2024-04-21T16:51:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:56 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23228.763802 secs 2024-04-21T16:51:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:56 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23228.763802 secs 2024-04-21T16:51:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:57 smithi170 ceph-mon[31212]: pgmap v12479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:58.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:57 smithi191 ceph-mon[31636]: pgmap v12479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:51:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:57 smithi077 ceph-mon[27902]: pgmap v12479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23230.525255 secs 2024-04-21T16:52:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:51:59 smithi191 ceph-mon[31636]: pgmap v12480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23230.525255 secs 2024-04-21T16:52:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:51:59 smithi170 ceph-mon[31212]: pgmap v12480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23230.525255 secs 2024-04-21T16:52:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:51:59 smithi077 ceph-mon[27902]: pgmap v12480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:02.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:01 smithi191 ceph-mon[31636]: pgmap v12481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:02.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:01 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23233.763882 secs 2024-04-21T16:52:02.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:01 smithi170 ceph-mon[31212]: pgmap v12481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:02.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:01 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23233.763882 secs 2024-04-21T16:52:02.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:01 smithi077 ceph-mon[27902]: pgmap v12481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:02.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:01 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23233.763882 secs 2024-04-21T16:52:04.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:03 smithi191 ceph-mon[31636]: pgmap v12482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:03 smithi170 ceph-mon[31212]: pgmap v12482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:03 smithi077 ceph-mon[27902]: pgmap v12482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23235.525319 secs 2024-04-21T16:52:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:04 smithi191 ceph-mon[31636]: osdmap e852: 12 total, 12 up, 12 in 2024-04-21T16:52:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23235.525319 secs 2024-04-21T16:52:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:04 smithi170 ceph-mon[31212]: osdmap e852: 12 total, 12 up, 12 in 2024-04-21T16:52:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23235.525319 secs 2024-04-21T16:52:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:04 smithi077 ceph-mon[27902]: osdmap e852: 12 total, 12 up, 12 in 2024-04-21T16:52:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:05 smithi191 ceph-mon[31636]: pgmap v12484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:52:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:05 smithi170 ceph-mon[31212]: pgmap v12484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:52:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:05 smithi077 ceph-mon[27902]: pgmap v12484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:52:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:06 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23238.764006 secs 2024-04-21T16:52:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:06 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23238.764006 secs 2024-04-21T16:52:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:06 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23238.764006 secs 2024-04-21T16:52:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:07 smithi191 ceph-mon[31636]: pgmap v12485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:52:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:07 smithi170 ceph-mon[31212]: pgmap v12485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:52:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:07 smithi077 ceph-mon[27902]: pgmap v12485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:52:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23240.525436 secs 2024-04-21T16:52:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:09 smithi170 ceph-mon[31212]: pgmap v12486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:52:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23240.525436 secs 2024-04-21T16:52:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:09 smithi077 ceph-mon[27902]: pgmap v12486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:52:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23240.525436 secs 2024-04-21T16:52:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:09 smithi191 ceph-mon[31636]: pgmap v12486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:52:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:12 smithi191 ceph-mon[31636]: pgmap v12487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:52:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:12 smithi191 ceph-mon[31636]: osdmap e853: 12 total, 12 up, 12 in 2024-04-21T16:52:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23243.764087 secs 2024-04-21T16:52:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:12 smithi170 ceph-mon[31212]: pgmap v12487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:52:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:12 smithi170 ceph-mon[31212]: osdmap e853: 12 total, 12 up, 12 in 2024-04-21T16:52:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23243.764087 secs 2024-04-21T16:52:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:12 smithi077 ceph-mon[27902]: pgmap v12487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:52:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:12 smithi077 ceph-mon[27902]: osdmap e853: 12 total, 12 up, 12 in 2024-04-21T16:52:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23243.764087 secs 2024-04-21T16:52:14.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:14 smithi077 ceph-mon[27902]: pgmap v12489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T16:52:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:14 smithi191 ceph-mon[31636]: pgmap v12489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T16:52:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:14 smithi170 ceph-mon[31212]: pgmap v12489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T16:52:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23245.525556 secs 2024-04-21T16:52:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23245.525556 secs 2024-04-21T16:52:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23245.525556 secs 2024-04-21T16:52:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:16 smithi191 ceph-mon[31636]: pgmap v12490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:52:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:16 smithi170 ceph-mon[31212]: pgmap v12490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:52:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:16 smithi077 ceph-mon[27902]: pgmap v12490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:52:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23248.764232 secs 2024-04-21T16:52:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23248.764232 secs 2024-04-21T16:52:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23248.764232 secs 2024-04-21T16:52:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:18 smithi191 ceph-mon[31636]: pgmap v12491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:52:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:18 smithi170 ceph-mon[31212]: pgmap v12491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:52:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:18 smithi077 ceph-mon[27902]: pgmap v12491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:52:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23250.525692 secs 2024-04-21T16:52:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:20 smithi191 ceph-mon[31636]: pgmap v12492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:52:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23250.525692 secs 2024-04-21T16:52:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:20 smithi170 ceph-mon[31212]: pgmap v12492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:52:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23250.525692 secs 2024-04-21T16:52:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:20 smithi077 ceph-mon[27902]: pgmap v12492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:52:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:22 smithi191 ceph-mon[31636]: pgmap v12493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:52:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23253.764305 secs 2024-04-21T16:52:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:22 smithi170 ceph-mon[31212]: pgmap v12493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:52:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23253.764305 secs 2024-04-21T16:52:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:22 smithi077 ceph-mon[27902]: pgmap v12493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:52:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23253.764305 secs 2024-04-21T16:52:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:24 smithi191 ceph-mon[31636]: pgmap v12494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:52:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:24 smithi170 ceph-mon[31212]: pgmap v12494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:52:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:24 smithi077 ceph-mon[27902]: pgmap v12494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:52:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23255.525785 secs 2024-04-21T16:52:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23255.525785 secs 2024-04-21T16:52:25.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23255.525785 secs 2024-04-21T16:52:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:26 smithi191 ceph-mon[31636]: pgmap v12495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:26 smithi170 ceph-mon[31212]: pgmap v12495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:26 smithi077 ceph-mon[27902]: pgmap v12495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23258.764431 secs 2024-04-21T16:52:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23258.764431 secs 2024-04-21T16:52:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23258.764431 secs 2024-04-21T16:52:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:28 smithi170 ceph-mon[31212]: pgmap v12496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:28 smithi077 ceph-mon[27902]: pgmap v12496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:28 smithi191 ceph-mon[31636]: pgmap v12496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23260.525911 secs 2024-04-21T16:52:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:30 smithi170 ceph-mon[31212]: pgmap v12497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23260.525911 secs 2024-04-21T16:52:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:30 smithi077 ceph-mon[27902]: pgmap v12497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23260.525911 secs 2024-04-21T16:52:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:30 smithi191 ceph-mon[31636]: pgmap v12497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:32 smithi170 ceph-mon[31212]: pgmap v12498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23263.764575 secs 2024-04-21T16:52:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:32 smithi077 ceph-mon[27902]: pgmap v12498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23263.764575 secs 2024-04-21T16:52:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:32 smithi191 ceph-mon[31636]: pgmap v12498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23263.764575 secs 2024-04-21T16:52:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:34 smithi170 ceph-mon[31212]: pgmap v12499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:34 smithi077 ceph-mon[27902]: pgmap v12499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:34 smithi191 ceph-mon[31636]: pgmap v12499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23265.525990 secs 2024-04-21T16:52:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23265.525990 secs 2024-04-21T16:52:35.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23265.525990 secs 2024-04-21T16:52:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:36 smithi170 ceph-mon[31212]: pgmap v12500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:36 smithi077 ceph-mon[27902]: pgmap v12500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:36 smithi191 ceph-mon[31636]: pgmap v12500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23268.764708 secs 2024-04-21T16:52:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23268.764708 secs 2024-04-21T16:52:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23268.764708 secs 2024-04-21T16:52:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:38 smithi170 ceph-mon[31212]: pgmap v12501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:38 smithi077 ceph-mon[27902]: pgmap v12501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:38 smithi191 ceph-mon[31636]: pgmap v12501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23270.526105 secs 2024-04-21T16:52:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:40 smithi170 ceph-mon[31212]: pgmap v12502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23270.526105 secs 2024-04-21T16:52:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:40 smithi077 ceph-mon[27902]: pgmap v12502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23270.526105 secs 2024-04-21T16:52:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:40 smithi191 ceph-mon[31636]: pgmap v12502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:42 smithi170 ceph-mon[31212]: pgmap v12503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23273.764827 secs 2024-04-21T16:52:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:42 smithi077 ceph-mon[27902]: pgmap v12503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23273.764827 secs 2024-04-21T16:52:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:42 smithi191 ceph-mon[31636]: pgmap v12503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23273.764827 secs 2024-04-21T16:52:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:44 smithi170 ceph-mon[31212]: pgmap v12504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:44 smithi077 ceph-mon[27902]: pgmap v12504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:44 smithi191 ceph-mon[31636]: pgmap v12504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23275.526195 secs 2024-04-21T16:52:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23275.526195 secs 2024-04-21T16:52:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23275.526195 secs 2024-04-21T16:52:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:46 smithi170 ceph-mon[31212]: pgmap v12505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:46 smithi077 ceph-mon[27902]: pgmap v12505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:46 smithi191 ceph-mon[31636]: pgmap v12505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23278.764910 secs 2024-04-21T16:52:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23278.764910 secs 2024-04-21T16:52:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23278.764910 secs 2024-04-21T16:52:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:48 smithi170 ceph-mon[31212]: pgmap v12506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:48 smithi077 ceph-mon[27902]: pgmap v12506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:48 smithi191 ceph-mon[31636]: pgmap v12506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:49 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 23280.526333 secs 2024-04-21T16:52:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:49 smithi170 ceph-mon[31212]: slow request 23041.980141 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:52:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:49 smithi170 ceph-mon[31212]: slow request 23041.968985 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:49 smithi170 ceph-mon[31212]: slow request 23041.920802 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:49 smithi170 ceph-mon[31212]: slow request 23041.889752 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:49 smithi170 ceph-mon[31212]: slow request 23041.846190 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:49 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 23280.526333 secs 2024-04-21T16:52:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:49 smithi077 ceph-mon[27902]: slow request 23041.980141 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:52:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:49 smithi077 ceph-mon[27902]: slow request 23041.968985 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:49 smithi077 ceph-mon[27902]: slow request 23041.920802 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:49 smithi077 ceph-mon[27902]: slow request 23041.889752 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:49 smithi077 ceph-mon[27902]: slow request 23041.846190 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:49 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 23280.526333 secs 2024-04-21T16:52:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:49 smithi191 ceph-mon[31636]: slow request 23041.980141 seconds old, received at 2024-04-21T10:28:46.678807+0000: client_request(client.24824:3144 lookup #0x10000000006/base 2024-04-21T10:28:46.677292+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:52:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:49 smithi191 ceph-mon[31636]: slow request 23041.968985 seconds old, received at 2024-04-21T10:28:46.689964+0000: client_request(client.24824:3145 lookup #0x10000000006/base 2024-04-21T10:28:46.688291+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:49 smithi191 ceph-mon[31636]: slow request 23041.920802 seconds old, received at 2024-04-21T10:28:46.738147+0000: client_request(client.24824:3146 lookup #0x10000000006/base 2024-04-21T10:28:46.736290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:49 smithi191 ceph-mon[31636]: slow request 23041.889752 seconds old, received at 2024-04-21T10:28:46.769197+0000: client_request(client.24824:3147 lookup #0x10000000006/base 2024-04-21T10:28:46.768290+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:49 smithi191 ceph-mon[31636]: slow request 23041.846190 seconds old, received at 2024-04-21T10:28:46.812758+0000: client_request(client.24824:3150 lookup #0x10000000006/base 2024-04-21T10:28:46.811289+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:50 smithi170 ceph-mon[31212]: pgmap v12507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:50 smithi077 ceph-mon[27902]: pgmap v12507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:50 smithi191 ceph-mon[31636]: pgmap v12507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:52 smithi170 ceph-mon[31212]: pgmap v12508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23283.765028 secs 2024-04-21T16:52:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:52 smithi077 ceph-mon[27902]: pgmap v12508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23283.765028 secs 2024-04-21T16:52:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:52 smithi191 ceph-mon[31636]: pgmap v12508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23283.765028 secs 2024-04-21T16:52:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: pgmap v12509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 23285.526534 secs 2024-04-21T16:52:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: slow request 23046.719081 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: slow request 23046.709336 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: slow request 23046.690344 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: slow request 23046.688328 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: slow request 23046.680341 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:52:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:52:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: pgmap v12509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 23285.526534 secs 2024-04-21T16:52:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: slow request 23046.719081 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: slow request 23046.709336 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: slow request 23046.690344 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: slow request 23046.688328 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: slow request 23046.680341 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:52:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:52:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:52:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:52:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: pgmap v12509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 23285.526534 secs 2024-04-21T16:52:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: slow request 23046.719081 seconds old, received at 2024-04-21T10:28:46.940069+0000: client_request(client.24824:3151 lookup #0x10000000006/base 2024-04-21T10:28:46.938287+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: slow request 23046.709336 seconds old, received at 2024-04-21T10:28:46.949814+0000: client_request(client.24824:3152 lookup #0x10000000006/base 2024-04-21T10:28:46.948286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: slow request 23046.690344 seconds old, received at 2024-04-21T10:28:46.968806+0000: client_request(client.24824:3153 lookup #0x10000000006/base 2024-04-21T10:28:46.967286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: slow request 23046.688328 seconds old, received at 2024-04-21T10:28:46.970822+0000: client_request(client.24824:3154 lookup #0x10000000006/base 2024-04-21T10:28:46.969286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: slow request 23046.680341 seconds old, received at 2024-04-21T10:28:46.978809+0000: client_request(client.24824:3155 lookup #0x10000000006/base 2024-04-21T10:28:46.977286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:52:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:52:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:52:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:56 smithi170 ceph-mon[31212]: pgmap v12510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:56 smithi077 ceph-mon[27902]: pgmap v12510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:56 smithi191 ceph-mon[31636]: pgmap v12510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:52:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:52:57.574+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:52:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:52:57.574+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:52:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:52:57.575+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:52:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:52:57.575+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:52:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23288.765143 secs 2024-04-21T16:52:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23288.765143 secs 2024-04-21T16:52:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23288.765143 secs 2024-04-21T16:52:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:58 smithi170 ceph-mon[31212]: pgmap v12511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:58 smithi191 ceph-mon[31636]: pgmap v12511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:58 smithi077 ceph-mon[27902]: pgmap v12511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:52:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 5 included below; oldest blocked for > 23290.526549 secs 2024-04-21T16:52:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:59 smithi077 ceph-mon[27902]: slow request 23051.673503 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:59 smithi077 ceph-mon[27902]: slow request 23051.664497 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:59 smithi077 ceph-mon[27902]: slow request 23051.659388 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:59 smithi077 ceph-mon[27902]: slow request 23051.643879 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:52:59 smithi077 ceph-mon[27902]: slow request 23051.635191 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 5 included below; oldest blocked for > 23290.526549 secs 2024-04-21T16:52:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:59 smithi191 ceph-mon[31636]: slow request 23051.673503 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:59 smithi191 ceph-mon[31636]: slow request 23051.664497 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:59 smithi191 ceph-mon[31636]: slow request 23051.659388 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:59 smithi191 ceph-mon[31636]: slow request 23051.643879 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:52:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:52:59 smithi191 ceph-mon[31636]: slow request 23051.635191 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:53:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 5 included below; oldest blocked for > 23290.526549 secs 2024-04-21T16:53:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:59 smithi170 ceph-mon[31212]: slow request 23051.673503 seconds old, received at 2024-04-21T10:28:46.985661+0000: client_request(client.24824:3156 lookup #0x10000000006/base 2024-04-21T10:28:46.984286+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:53:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:59 smithi170 ceph-mon[31212]: slow request 23051.664497 seconds old, received at 2024-04-21T10:28:46.994668+0000: client_request(client.24824:3157 lookup #0x10000000006/base 2024-04-21T10:28:46.993285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:53:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:59 smithi170 ceph-mon[31212]: slow request 23051.659388 seconds old, received at 2024-04-21T10:28:46.999777+0000: client_request(client.24824:3158 lookup #0x10000000006/base 2024-04-21T10:28:46.998285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:53:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:59 smithi170 ceph-mon[31212]: slow request 23051.643879 seconds old, received at 2024-04-21T10:28:47.015286+0000: client_request(client.24824:3159 lookup #0x10000000006/base 2024-04-21T10:28:47.014285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:53:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:52:59 smithi170 ceph-mon[31212]: slow request 23051.635191 seconds old, received at 2024-04-21T10:28:47.023974+0000: client_request(client.24824:3160 lookup #0x10000000006/base 2024-04-21T10:28:47.022285+0000 caller_uid=26, caller_gid=26{26,}) currently joining batch lookup 2024-04-21T16:53:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:00 smithi077 ceph-mon[27902]: pgmap v12512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:00 smithi191 ceph-mon[31636]: pgmap v12512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:00 smithi170 ceph-mon[31212]: pgmap v12512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:02 smithi077 ceph-mon[27902]: pgmap v12513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23293.765257 secs 2024-04-21T16:53:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:02 smithi191 ceph-mon[31636]: pgmap v12513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23293.765257 secs 2024-04-21T16:53:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:02 smithi170 ceph-mon[31212]: pgmap v12513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23293.765257 secs 2024-04-21T16:53:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:04 smithi077 ceph-mon[27902]: pgmap v12514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 3 included below; oldest blocked for > 23295.526689 secs 2024-04-21T16:53:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:04 smithi077 ceph-mon[27902]: slow request 23041.818571 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:04 smithi077 ceph-mon[27902]: slow request 23051.736767 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:04 smithi077 ceph-mon[27902]: slow request 23051.721896 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:04 smithi191 ceph-mon[31636]: pgmap v12514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 3 included below; oldest blocked for > 23295.526689 secs 2024-04-21T16:53:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:04 smithi191 ceph-mon[31636]: slow request 23041.818571 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:04 smithi191 ceph-mon[31636]: slow request 23051.736767 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:04 smithi191 ceph-mon[31636]: slow request 23051.721896 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:04 smithi170 ceph-mon[31212]: pgmap v12514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 3 included below; oldest blocked for > 23295.526689 secs 2024-04-21T16:53:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:04 smithi170 ceph-mon[31212]: slow request 23041.818571 seconds old, received at 2024-04-21T10:29:01.840733+0000: client_request(client.24824:3163 lookup #0x10000000006/pg_wal 2024-04-21T10:29:01.838994+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:04 smithi170 ceph-mon[31212]: slow request 23051.736767 seconds old, received at 2024-04-21T10:28:51.922537+0000: client_request(client.24824:3161 lookup #0x10000000006/pg_stat_tmp 2024-04-21T10:28:51.921189+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:04 smithi170 ceph-mon[31212]: slow request 23051.721896 seconds old, received at 2024-04-21T10:28:51.937408+0000: client_request(client.24824:3162 open #0x10000000006/postmaster.pid 2024-04-21T10:28:51.936188+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:53:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:05 smithi077 ceph-mon[27902]: osdmap e854: 12 total, 12 up, 12 in 2024-04-21T16:53:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:05 smithi191 ceph-mon[31636]: osdmap e854: 12 total, 12 up, 12 in 2024-04-21T16:53:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:05 smithi170 ceph-mon[31212]: osdmap e854: 12 total, 12 up, 12 in 2024-04-21T16:53:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:06 smithi077 ceph-mon[27902]: pgmap v12516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:53:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:06 smithi191 ceph-mon[31636]: pgmap v12516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:53:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:06 smithi170 ceph-mon[31212]: pgmap v12516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:53:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23298.765349 secs 2024-04-21T16:53:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23298.765349 secs 2024-04-21T16:53:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23298.765349 secs 2024-04-21T16:53:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:08 smithi077 ceph-mon[27902]: pgmap v12517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:53:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:08 smithi191 ceph-mon[31636]: pgmap v12517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:53:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:08 smithi170 ceph-mon[31212]: pgmap v12517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:53:09.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23300.526815 secs 2024-04-21T16:53:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23300.526815 secs 2024-04-21T16:53:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23300.526815 secs 2024-04-21T16:53:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:10 smithi077 ceph-mon[27902]: pgmap v12518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:53:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:10 smithi191 ceph-mon[31636]: pgmap v12518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:53:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:10 smithi170 ceph-mon[31212]: pgmap v12518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:53:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:12 smithi191 ceph-mon[31636]: pgmap v12519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:53:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:12 smithi191 ceph-mon[31636]: osdmap e855: 12 total, 12 up, 12 in 2024-04-21T16:53:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23303.765445 secs 2024-04-21T16:53:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:12 smithi170 ceph-mon[31212]: pgmap v12519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:53:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:12 smithi170 ceph-mon[31212]: osdmap e855: 12 total, 12 up, 12 in 2024-04-21T16:53:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23303.765445 secs 2024-04-21T16:53:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:12 smithi077 ceph-mon[27902]: pgmap v12519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:53:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:12 smithi077 ceph-mon[27902]: osdmap e855: 12 total, 12 up, 12 in 2024-04-21T16:53:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23303.765445 secs 2024-04-21T16:53:14.688 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:14 smithi077 ceph-mon[27902]: pgmap v12521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:53:14.688 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23305.526920 secs 2024-04-21T16:53:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:14 smithi191 ceph-mon[31636]: pgmap v12521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:53:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23305.526920 secs 2024-04-21T16:53:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:14 smithi170 ceph-mon[31212]: pgmap v12521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:53:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23305.526920 secs 2024-04-21T16:53:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:16 smithi191 ceph-mon[31636]: pgmap v12522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:53:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:16 smithi170 ceph-mon[31212]: pgmap v12522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:53:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:16 smithi077 ceph-mon[27902]: pgmap v12522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:53:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23308.765572 secs 2024-04-21T16:53:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23308.765572 secs 2024-04-21T16:53:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23308.765572 secs 2024-04-21T16:53:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:18 smithi191 ceph-mon[31636]: pgmap v12523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:53:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:18 smithi170 ceph-mon[31212]: pgmap v12523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:53:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:18 smithi077 ceph-mon[27902]: pgmap v12523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:53:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23310.527035 secs 2024-04-21T16:53:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23310.527035 secs 2024-04-21T16:53:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23310.527035 secs 2024-04-21T16:53:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:20 smithi191 ceph-mon[31636]: pgmap v12524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:53:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:20 smithi170 ceph-mon[31212]: pgmap v12524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:53:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:20 smithi077 ceph-mon[27902]: pgmap v12524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:53:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:22 smithi191 ceph-mon[31636]: pgmap v12525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:53:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23313.765667 secs 2024-04-21T16:53:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:22 smithi170 ceph-mon[31212]: pgmap v12525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:53:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23313.765667 secs 2024-04-21T16:53:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:22 smithi077 ceph-mon[27902]: pgmap v12525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:53:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23313.765667 secs 2024-04-21T16:53:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:24 smithi191 ceph-mon[31636]: pgmap v12526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:53:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23315.527151 secs 2024-04-21T16:53:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:24 smithi170 ceph-mon[31212]: pgmap v12526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:53:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23315.527151 secs 2024-04-21T16:53:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:24 smithi077 ceph-mon[27902]: pgmap v12526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:53:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23315.527151 secs 2024-04-21T16:53:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:26 smithi191 ceph-mon[31636]: pgmap v12527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:26 smithi170 ceph-mon[31212]: pgmap v12527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:26 smithi077 ceph-mon[27902]: pgmap v12527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23318.765800 secs 2024-04-21T16:53:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23318.765800 secs 2024-04-21T16:53:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23318.765800 secs 2024-04-21T16:53:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:28 smithi170 ceph-mon[31212]: pgmap v12528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:28 smithi077 ceph-mon[27902]: pgmap v12528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:28 smithi191 ceph-mon[31636]: pgmap v12528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23320.527230 secs 2024-04-21T16:53:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23320.527230 secs 2024-04-21T16:53:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23320.527230 secs 2024-04-21T16:53:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:30 smithi170 ceph-mon[31212]: pgmap v12529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:30 smithi077 ceph-mon[27902]: pgmap v12529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:30 smithi191 ceph-mon[31636]: pgmap v12529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:32 smithi170 ceph-mon[31212]: pgmap v12530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23323.765868 secs 2024-04-21T16:53:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:32 smithi077 ceph-mon[27902]: pgmap v12530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23323.765868 secs 2024-04-21T16:53:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:32 smithi191 ceph-mon[31636]: pgmap v12530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23323.765868 secs 2024-04-21T16:53:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:34 smithi170 ceph-mon[31212]: pgmap v12531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23325.527359 secs 2024-04-21T16:53:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:34 smithi077 ceph-mon[27902]: pgmap v12531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23325.527359 secs 2024-04-21T16:53:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:34 smithi191 ceph-mon[31636]: pgmap v12531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23325.527359 secs 2024-04-21T16:53:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:36 smithi170 ceph-mon[31212]: pgmap v12532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:36 smithi077 ceph-mon[27902]: pgmap v12532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:36 smithi191 ceph-mon[31636]: pgmap v12532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23328.765948 secs 2024-04-21T16:53:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23328.765948 secs 2024-04-21T16:53:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23328.765948 secs 2024-04-21T16:53:38.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:38 smithi170 ceph-mon[31212]: pgmap v12533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:38 smithi077 ceph-mon[27902]: pgmap v12533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:38 smithi191 ceph-mon[31636]: pgmap v12533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23330.527462 secs 2024-04-21T16:53:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23330.527462 secs 2024-04-21T16:53:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23330.527462 secs 2024-04-21T16:53:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:40 smithi170 ceph-mon[31212]: pgmap v12534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:40 smithi077 ceph-mon[27902]: pgmap v12534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:40 smithi191 ceph-mon[31636]: pgmap v12534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:42 smithi170 ceph-mon[31212]: pgmap v12535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23333.766066 secs 2024-04-21T16:53:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:42 smithi077 ceph-mon[27902]: pgmap v12535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23333.766066 secs 2024-04-21T16:53:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:42 smithi191 ceph-mon[31636]: pgmap v12535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23333.766066 secs 2024-04-21T16:53:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:44 smithi170 ceph-mon[31212]: pgmap v12536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23335.527607 secs 2024-04-21T16:53:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:44 smithi077 ceph-mon[27902]: pgmap v12536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23335.527607 secs 2024-04-21T16:53:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:44 smithi191 ceph-mon[31636]: pgmap v12536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23335.527607 secs 2024-04-21T16:53:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:46 smithi170 ceph-mon[31212]: pgmap v12537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:46 smithi077 ceph-mon[27902]: pgmap v12537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:46 smithi191 ceph-mon[31636]: pgmap v12537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23338.766174 secs 2024-04-21T16:53:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23338.766174 secs 2024-04-21T16:53:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23338.766174 secs 2024-04-21T16:53:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:48 smithi170 ceph-mon[31212]: pgmap v12538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:48 smithi077 ceph-mon[27902]: pgmap v12538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:48 smithi191 ceph-mon[31636]: pgmap v12538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23340.527743 secs 2024-04-21T16:53:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23340.527743 secs 2024-04-21T16:53:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23340.527743 secs 2024-04-21T16:53:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:50 smithi170 ceph-mon[31212]: pgmap v12539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:50 smithi077 ceph-mon[27902]: pgmap v12539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:50 smithi191 ceph-mon[31636]: pgmap v12539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:52 smithi170 ceph-mon[31212]: pgmap v12540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23343.766245 secs 2024-04-21T16:53:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:52 smithi077 ceph-mon[27902]: pgmap v12540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23343.766245 secs 2024-04-21T16:53:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:52 smithi191 ceph-mon[31636]: pgmap v12540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23343.766245 secs 2024-04-21T16:53:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:54 smithi170 ceph-mon[31212]: pgmap v12541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23345.527894 secs 2024-04-21T16:53:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:53:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:54 smithi077 ceph-mon[27902]: pgmap v12541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23345.527894 secs 2024-04-21T16:53:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:53:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:54 smithi191 ceph-mon[31636]: pgmap v12541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23345.527894 secs 2024-04-21T16:53:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:53:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:53:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:53:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:53:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:53:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:53:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:53:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:53:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:53:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:53:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:53:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:56 smithi170 ceph-mon[31212]: pgmap v12542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:56 smithi077 ceph-mon[27902]: pgmap v12542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:56 smithi191 ceph-mon[31636]: pgmap v12542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:53:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23348.766385 secs 2024-04-21T16:53:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23348.766385 secs 2024-04-21T16:53:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23348.766385 secs 2024-04-21T16:53:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:58 smithi170 ceph-mon[31212]: pgmap v12543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:58 smithi191 ceph-mon[31636]: pgmap v12543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:58 smithi077 ceph-mon[27902]: pgmap v12543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:53:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:53:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23350.528025 secs 2024-04-21T16:53:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:53:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23350.528025 secs 2024-04-21T16:54:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:53:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23350.528025 secs 2024-04-21T16:54:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:00 smithi077 ceph-mon[27902]: pgmap v12544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:00 smithi191 ceph-mon[31636]: pgmap v12544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:00 smithi170 ceph-mon[31212]: pgmap v12544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:02 smithi077 ceph-mon[27902]: pgmap v12545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23353.766505 secs 2024-04-21T16:54:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:02 smithi191 ceph-mon[31636]: pgmap v12545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23353.766505 secs 2024-04-21T16:54:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:02 smithi170 ceph-mon[31212]: pgmap v12545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23353.766505 secs 2024-04-21T16:54:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:04 smithi077 ceph-mon[27902]: pgmap v12546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23355.528116 secs 2024-04-21T16:54:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:04 smithi191 ceph-mon[31636]: pgmap v12546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23355.528116 secs 2024-04-21T16:54:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:04 smithi170 ceph-mon[31212]: pgmap v12546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23355.528116 secs 2024-04-21T16:54:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:05 smithi077 ceph-mon[27902]: osdmap e856: 12 total, 12 up, 12 in 2024-04-21T16:54:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:05 smithi191 ceph-mon[31636]: osdmap e856: 12 total, 12 up, 12 in 2024-04-21T16:54:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:05 smithi170 ceph-mon[31212]: osdmap e856: 12 total, 12 up, 12 in 2024-04-21T16:54:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:06 smithi077 ceph-mon[27902]: pgmap v12548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:54:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:06 smithi191 ceph-mon[31636]: pgmap v12548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:54:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:06 smithi170 ceph-mon[31212]: pgmap v12548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:54:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23358.766632 secs 2024-04-21T16:54:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23358.766632 secs 2024-04-21T16:54:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23358.766632 secs 2024-04-21T16:54:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:08 smithi077 ceph-mon[27902]: pgmap v12549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:08 smithi191 ceph-mon[31636]: pgmap v12549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:08 smithi170 ceph-mon[31212]: pgmap v12549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:09.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23360.528240 secs 2024-04-21T16:54:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23360.528240 secs 2024-04-21T16:54:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23360.528240 secs 2024-04-21T16:54:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:10 smithi077 ceph-mon[27902]: pgmap v12550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:10 smithi191 ceph-mon[31636]: pgmap v12550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:10 smithi170 ceph-mon[31212]: pgmap v12550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:12 smithi191 ceph-mon[31636]: pgmap v12551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:12 smithi191 ceph-mon[31636]: osdmap e857: 12 total, 12 up, 12 in 2024-04-21T16:54:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23363.766722 secs 2024-04-21T16:54:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:12 smithi170 ceph-mon[31212]: pgmap v12551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:12 smithi170 ceph-mon[31212]: osdmap e857: 12 total, 12 up, 12 in 2024-04-21T16:54:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23363.766722 secs 2024-04-21T16:54:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:12 smithi077 ceph-mon[27902]: pgmap v12551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:12 smithi077 ceph-mon[27902]: osdmap e857: 12 total, 12 up, 12 in 2024-04-21T16:54:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23363.766722 secs 2024-04-21T16:54:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:14 smithi191 ceph-mon[31636]: pgmap v12553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:54:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23365.528317 secs 2024-04-21T16:54:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:14 smithi170 ceph-mon[31212]: pgmap v12553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:54:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23365.528317 secs 2024-04-21T16:54:14.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:14 smithi077 ceph-mon[27902]: pgmap v12553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:54:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23365.528317 secs 2024-04-21T16:54:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:16 smithi191 ceph-mon[31636]: pgmap v12554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:16 smithi170 ceph-mon[31212]: pgmap v12554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:16 smithi077 ceph-mon[27902]: pgmap v12554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:54:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23368.766818 secs 2024-04-21T16:54:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23368.766818 secs 2024-04-21T16:54:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23368.766818 secs 2024-04-21T16:54:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:18 smithi191 ceph-mon[31636]: pgmap v12555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:54:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:18 smithi170 ceph-mon[31212]: pgmap v12555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:54:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:18 smithi077 ceph-mon[27902]: pgmap v12555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:54:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23370.528439 secs 2024-04-21T16:54:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23370.528439 secs 2024-04-21T16:54:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23370.528439 secs 2024-04-21T16:54:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:20 smithi170 ceph-mon[31212]: pgmap v12556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:54:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:20 smithi077 ceph-mon[27902]: pgmap v12556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:54:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:20 smithi191 ceph-mon[31636]: pgmap v12556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:54:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:22 smithi170 ceph-mon[31212]: pgmap v12557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:54:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23373.766944 secs 2024-04-21T16:54:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:22 smithi077 ceph-mon[27902]: pgmap v12557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:54:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23373.766944 secs 2024-04-21T16:54:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:22 smithi191 ceph-mon[31636]: pgmap v12557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:54:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23373.766944 secs 2024-04-21T16:54:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:24 smithi170 ceph-mon[31212]: pgmap v12558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:54:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23375.528586 secs 2024-04-21T16:54:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:24 smithi077 ceph-mon[27902]: pgmap v12558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:54:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23375.528586 secs 2024-04-21T16:54:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:24 smithi191 ceph-mon[31636]: pgmap v12558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:54:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23375.528586 secs 2024-04-21T16:54:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:26 smithi170 ceph-mon[31212]: pgmap v12559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:26 smithi077 ceph-mon[27902]: pgmap v12559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:26 smithi191 ceph-mon[31636]: pgmap v12559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23378.767023 secs 2024-04-21T16:54:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23378.767023 secs 2024-04-21T16:54:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23378.767023 secs 2024-04-21T16:54:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:28 smithi170 ceph-mon[31212]: pgmap v12560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:28 smithi191 ceph-mon[31636]: pgmap v12560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:28 smithi077 ceph-mon[27902]: pgmap v12560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23380.528709 secs 2024-04-21T16:54:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23380.528709 secs 2024-04-21T16:54:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23380.528709 secs 2024-04-21T16:54:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:30 smithi170 ceph-mon[31212]: pgmap v12561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:30 smithi077 ceph-mon[27902]: pgmap v12561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:30 smithi191 ceph-mon[31636]: pgmap v12561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:32 smithi170 ceph-mon[31212]: pgmap v12562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23383.767138 secs 2024-04-21T16:54:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:32 smithi077 ceph-mon[27902]: pgmap v12562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23383.767138 secs 2024-04-21T16:54:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:32 smithi191 ceph-mon[31636]: pgmap v12562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23383.767138 secs 2024-04-21T16:54:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:34 smithi170 ceph-mon[31212]: pgmap v12563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23385.528876 secs 2024-04-21T16:54:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:34 smithi077 ceph-mon[27902]: pgmap v12563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23385.528876 secs 2024-04-21T16:54:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:34 smithi191 ceph-mon[31636]: pgmap v12563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23385.528876 secs 2024-04-21T16:54:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:36 smithi170 ceph-mon[31212]: pgmap v12564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:36 smithi077 ceph-mon[27902]: pgmap v12564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:36 smithi191 ceph-mon[31636]: pgmap v12564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23388.767240 secs 2024-04-21T16:54:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23388.767240 secs 2024-04-21T16:54:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23388.767240 secs 2024-04-21T16:54:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:38 smithi170 ceph-mon[31212]: pgmap v12565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:38 smithi077 ceph-mon[27902]: pgmap v12565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:38 smithi191 ceph-mon[31636]: pgmap v12565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23390.528994 secs 2024-04-21T16:54:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23390.528994 secs 2024-04-21T16:54:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23390.528994 secs 2024-04-21T16:54:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:40 smithi170 ceph-mon[31212]: pgmap v12566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:40 smithi077 ceph-mon[27902]: pgmap v12566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:40 smithi191 ceph-mon[31636]: pgmap v12566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:42 smithi170 ceph-mon[31212]: pgmap v12567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23393.767382 secs 2024-04-21T16:54:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:42 smithi077 ceph-mon[27902]: pgmap v12567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23393.767382 secs 2024-04-21T16:54:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:42 smithi191 ceph-mon[31636]: pgmap v12567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23393.767382 secs 2024-04-21T16:54:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:44 smithi170 ceph-mon[31212]: pgmap v12568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23395.529108 secs 2024-04-21T16:54:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:44 smithi077 ceph-mon[27902]: pgmap v12568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23395.529108 secs 2024-04-21T16:54:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:44 smithi191 ceph-mon[31636]: pgmap v12568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23395.529108 secs 2024-04-21T16:54:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:46 smithi170 ceph-mon[31212]: pgmap v12569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:46 smithi077 ceph-mon[27902]: pgmap v12569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:46 smithi191 ceph-mon[31636]: pgmap v12569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23398.767497 secs 2024-04-21T16:54:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23398.767497 secs 2024-04-21T16:54:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23398.767497 secs 2024-04-21T16:54:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:48 smithi170 ceph-mon[31212]: pgmap v12570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:48 smithi077 ceph-mon[27902]: pgmap v12570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:48 smithi191 ceph-mon[31636]: pgmap v12570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23400.529207 secs 2024-04-21T16:54:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23400.529207 secs 2024-04-21T16:54:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23400.529207 secs 2024-04-21T16:54:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:50 smithi170 ceph-mon[31212]: pgmap v12571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:50 smithi077 ceph-mon[27902]: pgmap v12571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:50 smithi191 ceph-mon[31636]: pgmap v12571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:52 smithi170 ceph-mon[31212]: pgmap v12572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23403.767610 secs 2024-04-21T16:54:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:52 smithi077 ceph-mon[27902]: pgmap v12572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23403.767610 secs 2024-04-21T16:54:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:52 smithi191 ceph-mon[31636]: pgmap v12572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23403.767610 secs 2024-04-21T16:54:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:54 smithi170 ceph-mon[31212]: pgmap v12573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23405.529286 secs 2024-04-21T16:54:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:54 smithi077 ceph-mon[27902]: pgmap v12573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23405.529286 secs 2024-04-21T16:54:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:54 smithi191 ceph-mon[31636]: pgmap v12573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23405.529286 secs 2024-04-21T16:54:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:54:55.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:54:55.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:54:56.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:54:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:56 smithi077 ceph-mon[27902]: pgmap v12574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:54:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:54:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:54:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:56 smithi191 ceph-mon[31636]: pgmap v12574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:54:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:54:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:54:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:56 smithi170 ceph-mon[31212]: pgmap v12574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:54:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:54:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:54:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:54:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23408.767728 secs 2024-04-21T16:54:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23408.767728 secs 2024-04-21T16:54:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23408.767728 secs 2024-04-21T16:54:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:58 smithi191 ceph-mon[31636]: pgmap v12575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:58 smithi077 ceph-mon[27902]: pgmap v12575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:58 smithi170 ceph-mon[31212]: pgmap v12575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:54:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:54:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23410.529390 secs 2024-04-21T16:54:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:54:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23410.529390 secs 2024-04-21T16:55:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:54:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23410.529390 secs 2024-04-21T16:55:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:00 smithi077 ceph-mon[27902]: pgmap v12576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:00 smithi191 ceph-mon[31636]: pgmap v12576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:00 smithi170 ceph-mon[31212]: pgmap v12576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:02 smithi077 ceph-mon[27902]: pgmap v12577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23413.767866 secs 2024-04-21T16:55:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:02 smithi191 ceph-mon[31636]: pgmap v12577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23413.767866 secs 2024-04-21T16:55:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:02 smithi170 ceph-mon[31212]: pgmap v12577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23413.767866 secs 2024-04-21T16:55:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:04 smithi077 ceph-mon[27902]: pgmap v12578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23415.529522 secs 2024-04-21T16:55:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:04 smithi191 ceph-mon[31636]: pgmap v12578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23415.529522 secs 2024-04-21T16:55:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:04 smithi170 ceph-mon[31212]: pgmap v12578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23415.529522 secs 2024-04-21T16:55:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:05 smithi077 ceph-mon[27902]: osdmap e858: 12 total, 12 up, 12 in 2024-04-21T16:55:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:05 smithi191 ceph-mon[31636]: osdmap e858: 12 total, 12 up, 12 in 2024-04-21T16:55:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:05 smithi170 ceph-mon[31212]: osdmap e858: 12 total, 12 up, 12 in 2024-04-21T16:55:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:06 smithi077 ceph-mon[27902]: pgmap v12580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:55:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:06 smithi191 ceph-mon[31636]: pgmap v12580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:55:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:06 smithi170 ceph-mon[31212]: pgmap v12580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:55:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23418.767931 secs 2024-04-21T16:55:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23418.767931 secs 2024-04-21T16:55:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23418.767931 secs 2024-04-21T16:55:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:08 smithi077 ceph-mon[27902]: pgmap v12581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:08 smithi191 ceph-mon[31636]: pgmap v12581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:08 smithi170 ceph-mon[31212]: pgmap v12581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:09.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23420.529638 secs 2024-04-21T16:55:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23420.529638 secs 2024-04-21T16:55:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23420.529638 secs 2024-04-21T16:55:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:10 smithi077 ceph-mon[27902]: pgmap v12582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:10 smithi191 ceph-mon[31636]: pgmap v12582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:10 smithi170 ceph-mon[31212]: pgmap v12582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:12 smithi191 ceph-mon[31636]: pgmap v12583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:12 smithi191 ceph-mon[31636]: osdmap e859: 12 total, 12 up, 12 in 2024-04-21T16:55:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23423.768006 secs 2024-04-21T16:55:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:12 smithi170 ceph-mon[31212]: pgmap v12583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:12 smithi170 ceph-mon[31212]: osdmap e859: 12 total, 12 up, 12 in 2024-04-21T16:55:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23423.768006 secs 2024-04-21T16:55:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:12 smithi077 ceph-mon[27902]: pgmap v12583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:12 smithi077 ceph-mon[27902]: osdmap e859: 12 total, 12 up, 12 in 2024-04-21T16:55:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23423.768006 secs 2024-04-21T16:55:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:14 smithi191 ceph-mon[31636]: pgmap v12585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:55:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23425.529777 secs 2024-04-21T16:55:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:14 smithi170 ceph-mon[31212]: pgmap v12585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:55:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23425.529777 secs 2024-04-21T16:55:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:14 smithi077 ceph-mon[27902]: pgmap v12585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:55:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23425.529777 secs 2024-04-21T16:55:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:16 smithi191 ceph-mon[31636]: pgmap v12586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:16 smithi170 ceph-mon[31212]: pgmap v12586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:16 smithi077 ceph-mon[27902]: pgmap v12586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:55:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23428.768121 secs 2024-04-21T16:55:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23428.768121 secs 2024-04-21T16:55:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23428.768121 secs 2024-04-21T16:55:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:18 smithi170 ceph-mon[31212]: pgmap v12587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:55:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:18 smithi077 ceph-mon[27902]: pgmap v12587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:55:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:18 smithi191 ceph-mon[31636]: pgmap v12587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:55:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23430.529899 secs 2024-04-21T16:55:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23430.529899 secs 2024-04-21T16:55:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23430.529899 secs 2024-04-21T16:55:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:20 smithi170 ceph-mon[31212]: pgmap v12588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:55:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:20 smithi077 ceph-mon[27902]: pgmap v12588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:55:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:20 smithi191 ceph-mon[31636]: pgmap v12588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:55:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:22 smithi170 ceph-mon[31212]: pgmap v12589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:55:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23433.768243 secs 2024-04-21T16:55:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:22 smithi077 ceph-mon[27902]: pgmap v12589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:55:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23433.768243 secs 2024-04-21T16:55:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:22 smithi191 ceph-mon[31636]: pgmap v12589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:55:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23433.768243 secs 2024-04-21T16:55:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:24 smithi170 ceph-mon[31212]: pgmap v12590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:55:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23435.529936 secs 2024-04-21T16:55:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:24 smithi077 ceph-mon[27902]: pgmap v12590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:55:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23435.529936 secs 2024-04-21T16:55:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:24 smithi191 ceph-mon[31636]: pgmap v12590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:55:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23435.529936 secs 2024-04-21T16:55:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:26 smithi170 ceph-mon[31212]: pgmap v12591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:26 smithi077 ceph-mon[27902]: pgmap v12591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:26 smithi191 ceph-mon[31636]: pgmap v12591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23438.768362 secs 2024-04-21T16:55:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23438.768362 secs 2024-04-21T16:55:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23438.768362 secs 2024-04-21T16:55:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:28 smithi170 ceph-mon[31212]: pgmap v12592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:28 smithi191 ceph-mon[31636]: pgmap v12592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:28 smithi077 ceph-mon[27902]: pgmap v12592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23440.530002 secs 2024-04-21T16:55:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23440.530002 secs 2024-04-21T16:55:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23440.530002 secs 2024-04-21T16:55:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:30 smithi170 ceph-mon[31212]: pgmap v12593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:30 smithi077 ceph-mon[27902]: pgmap v12593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:30 smithi191 ceph-mon[31636]: pgmap v12593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:32 smithi170 ceph-mon[31212]: pgmap v12594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23443.768504 secs 2024-04-21T16:55:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:32 smithi077 ceph-mon[27902]: pgmap v12594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23443.768504 secs 2024-04-21T16:55:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:32 smithi191 ceph-mon[31636]: pgmap v12594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23443.768504 secs 2024-04-21T16:55:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:34 smithi170 ceph-mon[31212]: pgmap v12595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23445.530092 secs 2024-04-21T16:55:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:34 smithi077 ceph-mon[27902]: pgmap v12595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23445.530092 secs 2024-04-21T16:55:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:34 smithi191 ceph-mon[31636]: pgmap v12595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23445.530092 secs 2024-04-21T16:55:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:36 smithi170 ceph-mon[31212]: pgmap v12596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:36 smithi077 ceph-mon[27902]: pgmap v12596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:36 smithi191 ceph-mon[31636]: pgmap v12596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23448.768629 secs 2024-04-21T16:55:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23448.768629 secs 2024-04-21T16:55:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23448.768629 secs 2024-04-21T16:55:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:38 smithi170 ceph-mon[31212]: pgmap v12597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:38 smithi077 ceph-mon[27902]: pgmap v12597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:38 smithi191 ceph-mon[31636]: pgmap v12597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23450.530203 secs 2024-04-21T16:55:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23450.530203 secs 2024-04-21T16:55:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23450.530203 secs 2024-04-21T16:55:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:40 smithi170 ceph-mon[31212]: pgmap v12598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:40 smithi077 ceph-mon[27902]: pgmap v12598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:40 smithi191 ceph-mon[31636]: pgmap v12598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:42 smithi170 ceph-mon[31212]: pgmap v12599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23453.768674 secs 2024-04-21T16:55:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:42 smithi077 ceph-mon[27902]: pgmap v12599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23453.768674 secs 2024-04-21T16:55:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:42 smithi191 ceph-mon[31636]: pgmap v12599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23453.768674 secs 2024-04-21T16:55:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:44 smithi170 ceph-mon[31212]: pgmap v12600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:44 smithi170 ceph-mon[31212]: 20 slow requests, 1 included below; oldest blocked for > 23455.530316 secs 2024-04-21T16:55:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:44 smithi170 ceph-mon[31212]: slow request 23043.794517 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:55:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:44 smithi077 ceph-mon[27902]: pgmap v12600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:44 smithi077 ceph-mon[27902]: 20 slow requests, 1 included below; oldest blocked for > 23455.530316 secs 2024-04-21T16:55:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:44 smithi077 ceph-mon[27902]: slow request 23043.794517 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:55:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:44 smithi191 ceph-mon[31636]: pgmap v12600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:44 smithi191 ceph-mon[31636]: 20 slow requests, 1 included below; oldest blocked for > 23455.530316 secs 2024-04-21T16:55:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:44 smithi191 ceph-mon[31636]: slow request 23043.794517 seconds old, received at 2024-04-21T10:31:39.868415+0000: client_request(client.24824:3165 lookup #0x10000000006/pg_xact 2024-04-21T10:31:39.867897+0000 caller_uid=26, caller_gid=26{26,}) currently failed to authpin, subtree is being exported 2024-04-21T16:55:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:46 smithi170 ceph-mon[31212]: pgmap v12601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:46 smithi077 ceph-mon[27902]: pgmap v12601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:46 smithi191 ceph-mon[31636]: pgmap v12601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23458.768863 secs 2024-04-21T16:55:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23458.768863 secs 2024-04-21T16:55:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23458.768863 secs 2024-04-21T16:55:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:48 smithi170 ceph-mon[31212]: pgmap v12602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:48 smithi077 ceph-mon[27902]: pgmap v12602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:48 smithi191 ceph-mon[31636]: pgmap v12602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23460.530444 secs 2024-04-21T16:55:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23460.530444 secs 2024-04-21T16:55:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23460.530444 secs 2024-04-21T16:55:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:50 smithi077 ceph-mon[27902]: pgmap v12603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:50 smithi191 ceph-mon[31636]: pgmap v12603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:50 smithi170 ceph-mon[31212]: pgmap v12603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:52 smithi077 ceph-mon[27902]: pgmap v12604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23463.768978 secs 2024-04-21T16:55:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:52 smithi191 ceph-mon[31636]: pgmap v12604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23463.768978 secs 2024-04-21T16:55:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:52 smithi170 ceph-mon[31212]: pgmap v12604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23463.768978 secs 2024-04-21T16:55:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:54 smithi077 ceph-mon[27902]: pgmap v12605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23465.530559 secs 2024-04-21T16:55:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:54 smithi191 ceph-mon[31636]: pgmap v12605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23465.530559 secs 2024-04-21T16:55:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:54 smithi170 ceph-mon[31212]: pgmap v12605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23465.530559 secs 2024-04-21T16:55:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:55:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:56 smithi077 ceph-mon[27902]: pgmap v12606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:55:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:56 smithi191 ceph-mon[31636]: pgmap v12606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:55:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:56 smithi170 ceph-mon[31212]: pgmap v12606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:55:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:55:57.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:55:57.599+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:55:57.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:55:57.599+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:55:57.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:55:57.600+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:55:57.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:55:57.600+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:55:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23468.769098 secs 2024-04-21T16:55:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23468.769098 secs 2024-04-21T16:55:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23468.769098 secs 2024-04-21T16:55:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:58 smithi191 ceph-mon[31636]: pgmap v12607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:58.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:58 smithi077 ceph-mon[27902]: pgmap v12607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:58 smithi170 ceph-mon[31212]: pgmap v12607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:55:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:55:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23470.530675 secs 2024-04-21T16:55:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:55:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23470.530675 secs 2024-04-21T16:56:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:55:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23470.530675 secs 2024-04-21T16:56:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:00.842 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:00 smithi077 ceph-mon[27902]: pgmap v12608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:00.842 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:00.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:00.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:56:00.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:56:00.843 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:00 smithi191 ceph-mon[31636]: pgmap v12608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:56:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:56:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:00 smithi170 ceph-mon[31212]: pgmap v12608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:56:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:56:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:56:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:02 smithi077 ceph-mon[27902]: pgmap v12609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23473.769253 secs 2024-04-21T16:56:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:02 smithi191 ceph-mon[31636]: pgmap v12609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23473.769253 secs 2024-04-21T16:56:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:02 smithi170 ceph-mon[31212]: pgmap v12609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23473.769253 secs 2024-04-21T16:56:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:04 smithi077 ceph-mon[27902]: pgmap v12610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23475.530783 secs 2024-04-21T16:56:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:04 smithi191 ceph-mon[31636]: pgmap v12610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23475.530783 secs 2024-04-21T16:56:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:04 smithi170 ceph-mon[31212]: pgmap v12610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23475.530783 secs 2024-04-21T16:56:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:05 smithi077 ceph-mon[27902]: osdmap e860: 12 total, 12 up, 12 in 2024-04-21T16:56:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:05 smithi191 ceph-mon[31636]: osdmap e860: 12 total, 12 up, 12 in 2024-04-21T16:56:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:05 smithi170 ceph-mon[31212]: osdmap e860: 12 total, 12 up, 12 in 2024-04-21T16:56:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:06 smithi077 ceph-mon[27902]: pgmap v12612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:06 smithi191 ceph-mon[31636]: pgmap v12612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:06 smithi170 ceph-mon[31212]: pgmap v12612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23478.769335 secs 2024-04-21T16:56:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23478.769335 secs 2024-04-21T16:56:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23478.769335 secs 2024-04-21T16:56:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:08 smithi077 ceph-mon[27902]: pgmap v12613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:56:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:08 smithi191 ceph-mon[31636]: pgmap v12613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:56:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:08 smithi170 ceph-mon[31212]: pgmap v12613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:56:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23480.530900 secs 2024-04-21T16:56:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23480.530900 secs 2024-04-21T16:56:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23480.530900 secs 2024-04-21T16:56:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:10 smithi077 ceph-mon[27902]: pgmap v12614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:56:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:10 smithi191 ceph-mon[31636]: pgmap v12614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:56:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:10 smithi170 ceph-mon[31212]: pgmap v12614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:56:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:12 smithi077 ceph-mon[27902]: pgmap v12615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:56:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23483.769496 secs 2024-04-21T16:56:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:12 smithi191 ceph-mon[31636]: pgmap v12615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:56:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23483.769496 secs 2024-04-21T16:56:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:12 smithi170 ceph-mon[31212]: pgmap v12615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:56:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23483.769496 secs 2024-04-21T16:56:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:14 smithi077 ceph-mon[27902]: pgmap v12616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:56:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23485.530964 secs 2024-04-21T16:56:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:14 smithi191 ceph-mon[31636]: pgmap v12616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:56:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23485.530964 secs 2024-04-21T16:56:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:14 smithi170 ceph-mon[31212]: pgmap v12616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:56:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23485.530964 secs 2024-04-21T16:56:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:16 smithi191 ceph-mon[31636]: pgmap v12617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:56:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:16 smithi191 ceph-mon[31636]: osdmap e861: 12 total, 12 up, 12 in 2024-04-21T16:56:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:16 smithi170 ceph-mon[31212]: pgmap v12617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:56:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:16 smithi170 ceph-mon[31212]: osdmap e861: 12 total, 12 up, 12 in 2024-04-21T16:56:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:16 smithi077 ceph-mon[27902]: pgmap v12617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-04-21T16:56:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:16 smithi077 ceph-mon[27902]: osdmap e861: 12 total, 12 up, 12 in 2024-04-21T16:56:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23488.769628 secs 2024-04-21T16:56:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23488.769628 secs 2024-04-21T16:56:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23488.769628 secs 2024-04-21T16:56:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:18 smithi191 ceph-mon[31636]: pgmap v12619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:56:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:18 smithi170 ceph-mon[31212]: pgmap v12619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:56:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:18 smithi077 ceph-mon[27902]: pgmap v12619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:56:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23490.531107 secs 2024-04-21T16:56:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23490.531107 secs 2024-04-21T16:56:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23490.531107 secs 2024-04-21T16:56:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:20 smithi191 ceph-mon[31636]: pgmap v12620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:56:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:20 smithi170 ceph-mon[31212]: pgmap v12620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:56:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:20 smithi077 ceph-mon[27902]: pgmap v12620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:56:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:22 smithi191 ceph-mon[31636]: pgmap v12621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23493.769717 secs 2024-04-21T16:56:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:22 smithi170 ceph-mon[31212]: pgmap v12621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23493.769717 secs 2024-04-21T16:56:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:22 smithi077 ceph-mon[27902]: pgmap v12621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23493.769717 secs 2024-04-21T16:56:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:24 smithi191 ceph-mon[31636]: pgmap v12622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23495.531191 secs 2024-04-21T16:56:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:24 smithi170 ceph-mon[31212]: pgmap v12622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23495.531191 secs 2024-04-21T16:56:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:24 smithi077 ceph-mon[27902]: pgmap v12622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23495.531191 secs 2024-04-21T16:56:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:26 smithi191 ceph-mon[31636]: pgmap v12623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:26 smithi170 ceph-mon[31212]: pgmap v12623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:26 smithi077 ceph-mon[27902]: pgmap v12623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:56:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23498.769840 secs 2024-04-21T16:56:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23498.769840 secs 2024-04-21T16:56:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23498.769840 secs 2024-04-21T16:56:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:28 smithi170 ceph-mon[31212]: pgmap v12624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:56:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:28 smithi191 ceph-mon[31636]: pgmap v12624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:56:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:28 smithi077 ceph-mon[27902]: pgmap v12624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T16:56:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23500.531308 secs 2024-04-21T16:56:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23500.531308 secs 2024-04-21T16:56:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23500.531308 secs 2024-04-21T16:56:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:30 smithi191 ceph-mon[31636]: pgmap v12625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:30 smithi170 ceph-mon[31212]: pgmap v12625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:30 smithi077 ceph-mon[27902]: pgmap v12625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:32 smithi191 ceph-mon[31636]: pgmap v12626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23503.769905 secs 2024-04-21T16:56:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:32 smithi170 ceph-mon[31212]: pgmap v12626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23503.769905 secs 2024-04-21T16:56:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:32 smithi077 ceph-mon[27902]: pgmap v12626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23503.769905 secs 2024-04-21T16:56:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:34 smithi191 ceph-mon[31636]: pgmap v12627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23505.531432 secs 2024-04-21T16:56:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:34 smithi170 ceph-mon[31212]: pgmap v12627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23505.531432 secs 2024-04-21T16:56:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:34 smithi077 ceph-mon[27902]: pgmap v12627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23505.531432 secs 2024-04-21T16:56:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:36 smithi191 ceph-mon[31636]: pgmap v12628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:36 smithi170 ceph-mon[31212]: pgmap v12628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:36 smithi077 ceph-mon[27902]: pgmap v12628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23508.770027 secs 2024-04-21T16:56:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23508.770027 secs 2024-04-21T16:56:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23508.770027 secs 2024-04-21T16:56:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:38 smithi191 ceph-mon[31636]: pgmap v12629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23510.531527 secs 2024-04-21T16:56:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:38 smithi170 ceph-mon[31212]: pgmap v12629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23510.531527 secs 2024-04-21T16:56:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:38 smithi077 ceph-mon[27902]: pgmap v12629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23510.531527 secs 2024-04-21T16:56:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:40 smithi191 ceph-mon[31636]: pgmap v12630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:40 smithi170 ceph-mon[31212]: pgmap v12630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:40 smithi077 ceph-mon[27902]: pgmap v12630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:42.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:56:42.606+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:56:42.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:56:42.606+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:56:42.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:56:42.606+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:56:42.606 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:56:42.606+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:56:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:42 smithi191 ceph-mon[31636]: pgmap v12631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23513.770147 secs 2024-04-21T16:56:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:42 smithi170 ceph-mon[31212]: pgmap v12631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23513.770147 secs 2024-04-21T16:56:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:42 smithi077 ceph-mon[27902]: pgmap v12631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23513.770147 secs 2024-04-21T16:56:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23515.531658 secs 2024-04-21T16:56:44.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23515.531658 secs 2024-04-21T16:56:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23515.531658 secs 2024-04-21T16:56:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:44 smithi191 ceph-mon[31636]: pgmap v12632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:44 smithi170 ceph-mon[31212]: pgmap v12632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:44 smithi077 ceph-mon[27902]: pgmap v12632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:46 smithi191 ceph-mon[31636]: pgmap v12633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:46 smithi170 ceph-mon[31212]: pgmap v12633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:46 smithi077 ceph-mon[27902]: pgmap v12633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23518.770303 secs 2024-04-21T16:56:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23518.770303 secs 2024-04-21T16:56:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23518.770303 secs 2024-04-21T16:56:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:48 smithi170 ceph-mon[31212]: pgmap v12634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23520.531776 secs 2024-04-21T16:56:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:48 smithi077 ceph-mon[27902]: pgmap v12634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23520.531776 secs 2024-04-21T16:56:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:48 smithi191 ceph-mon[31636]: pgmap v12634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23520.531776 secs 2024-04-21T16:56:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:50 smithi170 ceph-mon[31212]: pgmap v12635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:50 smithi077 ceph-mon[27902]: pgmap v12635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:50 smithi191 ceph-mon[31636]: pgmap v12635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:52.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:51 smithi170 ceph-mon[31212]: pgmap v12636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:52.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:51 smithi077 ceph-mon[27902]: pgmap v12636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:51 smithi191 ceph-mon[31636]: pgmap v12636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23523.770426 secs 2024-04-21T16:56:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23523.770426 secs 2024-04-21T16:56:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23523.770426 secs 2024-04-21T16:56:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:53 smithi170 ceph-mon[31212]: pgmap v12637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23525.531930 secs 2024-04-21T16:56:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:53 smithi077 ceph-mon[27902]: pgmap v12637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23525.531930 secs 2024-04-21T16:56:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:53 smithi191 ceph-mon[31636]: pgmap v12637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23525.531930 secs 2024-04-21T16:56:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:56:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:56 smithi170 ceph-mon[31212]: pgmap v12638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:56.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:56 smithi077 ceph-mon[27902]: pgmap v12638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:56.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:56 smithi191 ceph-mon[31636]: pgmap v12638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:56:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23528.770544 secs 2024-04-21T16:56:57.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23528.770544 secs 2024-04-21T16:56:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23528.770544 secs 2024-04-21T16:56:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:58 smithi170 ceph-mon[31212]: pgmap v12639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:58.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:58 smithi191 ceph-mon[31636]: pgmap v12639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:58 smithi077 ceph-mon[27902]: pgmap v12639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:56:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:56:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23530.532050 secs 2024-04-21T16:56:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:56:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23530.532050 secs 2024-04-21T16:56:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:56:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23530.532050 secs 2024-04-21T16:57:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:00 smithi170 ceph-mon[31212]: pgmap v12640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:00 smithi077 ceph-mon[27902]: pgmap v12640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:00 smithi191 ceph-mon[31636]: pgmap v12640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:57:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:57:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:57:02.080 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:02 smithi170 ceph-mon[31212]: pgmap v12641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T16:57:02.080 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23533.770658 secs 2024-04-21T16:57:02.138 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:02 smithi191 ceph-mon[31636]: pgmap v12641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T16:57:02.138 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23533.770658 secs 2024-04-21T16:57:02.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:02 smithi077 ceph-mon[27902]: pgmap v12641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T16:57:02.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23533.770658 secs 2024-04-21T16:57:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:04 smithi170 ceph-mon[31212]: pgmap v12642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-04-21T16:57:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23535.532113 secs 2024-04-21T16:57:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:04 smithi077 ceph-mon[27902]: pgmap v12642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-04-21T16:57:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23535.532113 secs 2024-04-21T16:57:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:04 smithi191 ceph-mon[31636]: pgmap v12642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-04-21T16:57:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23535.532113 secs 2024-04-21T16:57:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: osdmap e862: 12 total, 12 up, 12 in 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:57:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: osdmap e862: 12 total, 12 up, 12 in 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:57:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: osdmap e862: 12 total, 12 up, 12 in 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:57:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:57:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:57:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:06 smithi077 ceph-mon[27902]: pgmap v12644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:57:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:06 smithi191 ceph-mon[31636]: pgmap v12644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:57:06.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:06 smithi170 ceph-mon[31212]: pgmap v12644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T16:57:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23538.770793 secs 2024-04-21T16:57:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23538.770793 secs 2024-04-21T16:57:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23538.770793 secs 2024-04-21T16:57:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:08 smithi077 ceph-mon[27902]: pgmap v12645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:57:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:08 smithi191 ceph-mon[31636]: pgmap v12645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:57:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:08 smithi170 ceph-mon[31212]: pgmap v12645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:57:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23540.532206 secs 2024-04-21T16:57:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23540.532206 secs 2024-04-21T16:57:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23540.532206 secs 2024-04-21T16:57:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:10 smithi077 ceph-mon[27902]: pgmap v12646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:57:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:10 smithi191 ceph-mon[31636]: pgmap v12646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:57:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:10 smithi170 ceph-mon[31212]: pgmap v12646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:57:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:12 smithi170 ceph-mon[31212]: pgmap v12647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-21T16:57:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:12 smithi170 ceph-mon[31212]: osdmap e863: 12 total, 12 up, 12 in 2024-04-21T16:57:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23543.770857 secs 2024-04-21T16:57:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:12 smithi077 ceph-mon[27902]: pgmap v12647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-21T16:57:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:12 smithi077 ceph-mon[27902]: osdmap e863: 12 total, 12 up, 12 in 2024-04-21T16:57:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23543.770857 secs 2024-04-21T16:57:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:12 smithi191 ceph-mon[31636]: pgmap v12647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-21T16:57:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:12 smithi191 ceph-mon[31636]: osdmap e863: 12 total, 12 up, 12 in 2024-04-21T16:57:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23543.770857 secs 2024-04-21T16:57:14.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:14 smithi170 ceph-mon[31212]: pgmap v12649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-04-21T16:57:14.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23545.532330 secs 2024-04-21T16:57:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:14 smithi077 ceph-mon[27902]: pgmap v12649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-04-21T16:57:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23545.532330 secs 2024-04-21T16:57:14.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:14 smithi191 ceph-mon[31636]: pgmap v12649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-04-21T16:57:14.927 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23545.532330 secs 2024-04-21T16:57:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:16 smithi170 ceph-mon[31212]: pgmap v12650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-21T16:57:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:16 smithi077 ceph-mon[27902]: pgmap v12650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-21T16:57:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:16 smithi191 ceph-mon[31636]: pgmap v12650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-21T16:57:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23548.770961 secs 2024-04-21T16:57:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23548.770961 secs 2024-04-21T16:57:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23548.770961 secs 2024-04-21T16:57:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:18 smithi170 ceph-mon[31212]: pgmap v12651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:57:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:18 smithi077 ceph-mon[27902]: pgmap v12651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:57:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:18 smithi191 ceph-mon[31636]: pgmap v12651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:57:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23550.532447 secs 2024-04-21T16:57:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23550.532447 secs 2024-04-21T16:57:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23550.532447 secs 2024-04-21T16:57:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:20 smithi170 ceph-mon[31212]: pgmap v12652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:57:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:20 smithi077 ceph-mon[27902]: pgmap v12652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:57:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:20 smithi191 ceph-mon[31636]: pgmap v12652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:57:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:22 smithi170 ceph-mon[31212]: pgmap v12653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:57:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23553.771085 secs 2024-04-21T16:57:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:22 smithi077 ceph-mon[27902]: pgmap v12653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:57:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23553.771085 secs 2024-04-21T16:57:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:22 smithi191 ceph-mon[31636]: pgmap v12653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:57:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23553.771085 secs 2024-04-21T16:57:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:24 smithi170 ceph-mon[31212]: pgmap v12654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:57:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23555.532582 secs 2024-04-21T16:57:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:24 smithi077 ceph-mon[27902]: pgmap v12654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:57:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23555.532582 secs 2024-04-21T16:57:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:24 smithi191 ceph-mon[31636]: pgmap v12654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:57:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23555.532582 secs 2024-04-21T16:57:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:26 smithi170 ceph-mon[31212]: pgmap v12655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:26 smithi077 ceph-mon[27902]: pgmap v12655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:26 smithi191 ceph-mon[31636]: pgmap v12655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23558.771202 secs 2024-04-21T16:57:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23558.771202 secs 2024-04-21T16:57:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23558.771202 secs 2024-04-21T16:57:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:28 smithi170 ceph-mon[31212]: pgmap v12656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:28 smithi191 ceph-mon[31636]: pgmap v12656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:28 smithi077 ceph-mon[27902]: pgmap v12656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23560.532724 secs 2024-04-21T16:57:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23560.532724 secs 2024-04-21T16:57:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23560.532724 secs 2024-04-21T16:57:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:30 smithi170 ceph-mon[31212]: pgmap v12657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:30 smithi077 ceph-mon[27902]: pgmap v12657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:30 smithi191 ceph-mon[31636]: pgmap v12657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:32 smithi170 ceph-mon[31212]: pgmap v12658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23563.771266 secs 2024-04-21T16:57:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:32 smithi077 ceph-mon[27902]: pgmap v12658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23563.771266 secs 2024-04-21T16:57:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:32 smithi191 ceph-mon[31636]: pgmap v12658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23563.771266 secs 2024-04-21T16:57:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:34 smithi170 ceph-mon[31212]: pgmap v12659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23565.532870 secs 2024-04-21T16:57:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:34 smithi077 ceph-mon[27902]: pgmap v12659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23565.532870 secs 2024-04-21T16:57:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:34 smithi191 ceph-mon[31636]: pgmap v12659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23565.532870 secs 2024-04-21T16:57:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:36 smithi170 ceph-mon[31212]: pgmap v12660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:36 smithi077 ceph-mon[27902]: pgmap v12660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:36 smithi191 ceph-mon[31636]: pgmap v12660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:57:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23568.771386 secs 2024-04-21T16:57:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23568.771386 secs 2024-04-21T16:57:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23568.771386 secs 2024-04-21T16:57:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:38 smithi170 ceph-mon[31212]: pgmap v12661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:38 smithi077 ceph-mon[27902]: pgmap v12661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:38 smithi191 ceph-mon[31636]: pgmap v12661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23570.532989 secs 2024-04-21T16:57:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23570.532989 secs 2024-04-21T16:57:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23570.532989 secs 2024-04-21T16:57:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:40 smithi077 ceph-mon[27902]: pgmap v12662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:40 smithi191 ceph-mon[31636]: pgmap v12662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:40 smithi170 ceph-mon[31212]: pgmap v12662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:42 smithi077 ceph-mon[27902]: pgmap v12663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23573.771525 secs 2024-04-21T16:57:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:42 smithi191 ceph-mon[31636]: pgmap v12663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23573.771525 secs 2024-04-21T16:57:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:42 smithi170 ceph-mon[31212]: pgmap v12663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23573.771525 secs 2024-04-21T16:57:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:44 smithi077 ceph-mon[27902]: pgmap v12664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23575.533081 secs 2024-04-21T16:57:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:44 smithi191 ceph-mon[31636]: pgmap v12664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23575.533081 secs 2024-04-21T16:57:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:44 smithi170 ceph-mon[31212]: pgmap v12664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23575.533081 secs 2024-04-21T16:57:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:46 smithi077 ceph-mon[27902]: pgmap v12665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:46 smithi191 ceph-mon[31636]: pgmap v12665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:46 smithi170 ceph-mon[31212]: pgmap v12665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23578.771660 secs 2024-04-21T16:57:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23578.771660 secs 2024-04-21T16:57:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23578.771660 secs 2024-04-21T16:57:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:48 smithi077 ceph-mon[27902]: pgmap v12666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:48 smithi191 ceph-mon[31636]: pgmap v12666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:48 smithi170 ceph-mon[31212]: pgmap v12666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23580.533179 secs 2024-04-21T16:57:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23580.533179 secs 2024-04-21T16:57:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23580.533179 secs 2024-04-21T16:57:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:50 smithi077 ceph-mon[27902]: pgmap v12667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:50 smithi191 ceph-mon[31636]: pgmap v12667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:50 smithi170 ceph-mon[31212]: pgmap v12667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:52 smithi077 ceph-mon[27902]: pgmap v12668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23583.771791 secs 2024-04-21T16:57:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:52 smithi191 ceph-mon[31636]: pgmap v12668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23583.771791 secs 2024-04-21T16:57:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:52 smithi170 ceph-mon[31212]: pgmap v12668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23583.771791 secs 2024-04-21T16:57:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:54 smithi077 ceph-mon[27902]: pgmap v12669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23585.533246 secs 2024-04-21T16:57:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:54 smithi191 ceph-mon[31636]: pgmap v12669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23585.533246 secs 2024-04-21T16:57:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:54 smithi170 ceph-mon[31212]: pgmap v12669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23585.533246 secs 2024-04-21T16:57:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:57:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:56 smithi077 ceph-mon[27902]: pgmap v12670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:56 smithi191 ceph-mon[31636]: pgmap v12670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:56 smithi170 ceph-mon[31212]: pgmap v12670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:57:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23588.771898 secs 2024-04-21T16:57:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23588.771898 secs 2024-04-21T16:57:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23588.771898 secs 2024-04-21T16:57:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:58 smithi191 ceph-mon[31636]: pgmap v12671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:58 smithi077 ceph-mon[27902]: pgmap v12671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:58 smithi170 ceph-mon[31212]: pgmap v12671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:57:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:57:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23590.533312 secs 2024-04-21T16:57:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:57:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23590.533312 secs 2024-04-21T16:58:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:57:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23590.533312 secs 2024-04-21T16:58:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:00 smithi077 ceph-mon[27902]: pgmap v12672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:00 smithi191 ceph-mon[31636]: pgmap v12672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:00 smithi170 ceph-mon[31212]: pgmap v12672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:02 smithi077 ceph-mon[27902]: pgmap v12673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23593.772034 secs 2024-04-21T16:58:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:02 smithi191 ceph-mon[31636]: pgmap v12673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23593.772034 secs 2024-04-21T16:58:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:02 smithi170 ceph-mon[31212]: pgmap v12673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23593.772034 secs 2024-04-21T16:58:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:04 smithi077 ceph-mon[27902]: pgmap v12674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23595.533449 secs 2024-04-21T16:58:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:04 smithi191 ceph-mon[31636]: pgmap v12674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23595.533449 secs 2024-04-21T16:58:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:04 smithi170 ceph-mon[31212]: pgmap v12674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23595.533449 secs 2024-04-21T16:58:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:05 smithi077 ceph-mon[27902]: osdmap e864: 12 total, 12 up, 12 in 2024-04-21T16:58:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:58:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:05 smithi191 ceph-mon[31636]: osdmap e864: 12 total, 12 up, 12 in 2024-04-21T16:58:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:58:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:05 smithi170 ceph-mon[31212]: osdmap e864: 12 total, 12 up, 12 in 2024-04-21T16:58:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:58:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:06 smithi077 ceph-mon[27902]: pgmap v12676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:58:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:58:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:58:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:58:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:06 smithi191 ceph-mon[31636]: pgmap v12676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:58:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:58:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:58:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:58:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:06 smithi170 ceph-mon[31212]: pgmap v12676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:58:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:58:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:58:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:58:07.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23598.772136 secs 2024-04-21T16:58:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23598.772136 secs 2024-04-21T16:58:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23598.772136 secs 2024-04-21T16:58:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:08 smithi077 ceph-mon[27902]: pgmap v12677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:58:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:08 smithi191 ceph-mon[31636]: pgmap v12677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:58:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:08 smithi170 ceph-mon[31212]: pgmap v12677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:58:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23600.533511 secs 2024-04-21T16:58:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23600.533511 secs 2024-04-21T16:58:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23600.533511 secs 2024-04-21T16:58:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:10 smithi191 ceph-mon[31636]: pgmap v12678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:58:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:10 smithi170 ceph-mon[31212]: pgmap v12678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:58:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:10 smithi077 ceph-mon[27902]: pgmap v12678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:58:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:12 smithi170 ceph-mon[31212]: pgmap v12679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:58:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:12 smithi170 ceph-mon[31212]: osdmap e865: 12 total, 12 up, 12 in 2024-04-21T16:58:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23603.772198 secs 2024-04-21T16:58:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:12 smithi077 ceph-mon[27902]: pgmap v12679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:58:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:12 smithi077 ceph-mon[27902]: osdmap e865: 12 total, 12 up, 12 in 2024-04-21T16:58:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23603.772198 secs 2024-04-21T16:58:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:12 smithi191 ceph-mon[31636]: pgmap v12679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:58:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:12 smithi191 ceph-mon[31636]: osdmap e865: 12 total, 12 up, 12 in 2024-04-21T16:58:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23603.772198 secs 2024-04-21T16:58:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:14 smithi170 ceph-mon[31212]: pgmap v12681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:58:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23605.533657 secs 2024-04-21T16:58:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:14 smithi077 ceph-mon[27902]: pgmap v12681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:58:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23605.533657 secs 2024-04-21T16:58:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:14 smithi191 ceph-mon[31636]: pgmap v12681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:58:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23605.533657 secs 2024-04-21T16:58:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:16 smithi170 ceph-mon[31212]: pgmap v12682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:58:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:16 smithi077 ceph-mon[27902]: pgmap v12682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:58:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:16 smithi191 ceph-mon[31636]: pgmap v12682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:58:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23608.772315 secs 2024-04-21T16:58:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23608.772315 secs 2024-04-21T16:58:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23608.772315 secs 2024-04-21T16:58:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:18 smithi170 ceph-mon[31212]: pgmap v12683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:58:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:18 smithi077 ceph-mon[27902]: pgmap v12683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:58:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:18 smithi191 ceph-mon[31636]: pgmap v12683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:58:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23610.533764 secs 2024-04-21T16:58:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23610.533764 secs 2024-04-21T16:58:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23610.533764 secs 2024-04-21T16:58:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:20 smithi170 ceph-mon[31212]: pgmap v12684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:58:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:20 smithi077 ceph-mon[27902]: pgmap v12684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:58:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:20 smithi191 ceph-mon[31636]: pgmap v12684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:58:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:22 smithi170 ceph-mon[31212]: pgmap v12685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:58:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23613.772433 secs 2024-04-21T16:58:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:22 smithi077 ceph-mon[27902]: pgmap v12685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:58:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23613.772433 secs 2024-04-21T16:58:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:22 smithi191 ceph-mon[31636]: pgmap v12685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:58:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23613.772433 secs 2024-04-21T16:58:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:24 smithi170 ceph-mon[31212]: pgmap v12686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:58:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23615.533903 secs 2024-04-21T16:58:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:24 smithi077 ceph-mon[27902]: pgmap v12686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:58:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23615.533903 secs 2024-04-21T16:58:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:24 smithi191 ceph-mon[31636]: pgmap v12686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:58:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23615.533903 secs 2024-04-21T16:58:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:26 smithi170 ceph-mon[31212]: pgmap v12687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:26 smithi077 ceph-mon[27902]: pgmap v12687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:26 smithi191 ceph-mon[31636]: pgmap v12687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23618.772571 secs 2024-04-21T16:58:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23618.772571 secs 2024-04-21T16:58:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23618.772571 secs 2024-04-21T16:58:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:28 smithi170 ceph-mon[31212]: pgmap v12688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:28 smithi191 ceph-mon[31636]: pgmap v12688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:28 smithi077 ceph-mon[27902]: pgmap v12688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23620.533967 secs 2024-04-21T16:58:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23620.533967 secs 2024-04-21T16:58:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23620.533967 secs 2024-04-21T16:58:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:30 smithi170 ceph-mon[31212]: pgmap v12689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:30 smithi077 ceph-mon[27902]: pgmap v12689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:30 smithi191 ceph-mon[31636]: pgmap v12689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:32 smithi170 ceph-mon[31212]: pgmap v12690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23623.772688 secs 2024-04-21T16:58:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:32 smithi077 ceph-mon[27902]: pgmap v12690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23623.772688 secs 2024-04-21T16:58:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:32 smithi191 ceph-mon[31636]: pgmap v12690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23623.772688 secs 2024-04-21T16:58:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:34 smithi170 ceph-mon[31212]: pgmap v12691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23625.534094 secs 2024-04-21T16:58:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:34 smithi077 ceph-mon[27902]: pgmap v12691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23625.534094 secs 2024-04-21T16:58:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:34 smithi191 ceph-mon[31636]: pgmap v12691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23625.534094 secs 2024-04-21T16:58:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:36 smithi170 ceph-mon[31212]: pgmap v12692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:36 smithi077 ceph-mon[27902]: pgmap v12692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:36 smithi191 ceph-mon[31636]: pgmap v12692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23628.772783 secs 2024-04-21T16:58:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23628.772783 secs 2024-04-21T16:58:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23628.772783 secs 2024-04-21T16:58:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:38 smithi077 ceph-mon[27902]: pgmap v12693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:38 smithi191 ceph-mon[31636]: pgmap v12693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:38 smithi170 ceph-mon[31212]: pgmap v12693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23630.534191 secs 2024-04-21T16:58:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23630.534191 secs 2024-04-21T16:58:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23630.534191 secs 2024-04-21T16:58:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:40 smithi077 ceph-mon[27902]: pgmap v12694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:40 smithi191 ceph-mon[31636]: pgmap v12694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:40 smithi170 ceph-mon[31212]: pgmap v12694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:42 smithi077 ceph-mon[27902]: pgmap v12695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23633.772832 secs 2024-04-21T16:58:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:42 smithi191 ceph-mon[31636]: pgmap v12695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23633.772832 secs 2024-04-21T16:58:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:42 smithi170 ceph-mon[31212]: pgmap v12695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23633.772832 secs 2024-04-21T16:58:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:44 smithi077 ceph-mon[27902]: pgmap v12696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23635.534306 secs 2024-04-21T16:58:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:44 smithi191 ceph-mon[31636]: pgmap v12696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23635.534306 secs 2024-04-21T16:58:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:44 smithi170 ceph-mon[31212]: pgmap v12696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23635.534306 secs 2024-04-21T16:58:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:46 smithi077 ceph-mon[27902]: pgmap v12697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:46 smithi191 ceph-mon[31636]: pgmap v12697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:46 smithi170 ceph-mon[31212]: pgmap v12697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23638.772909 secs 2024-04-21T16:58:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23638.772909 secs 2024-04-21T16:58:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23638.772909 secs 2024-04-21T16:58:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:48 smithi077 ceph-mon[27902]: pgmap v12698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:48 smithi191 ceph-mon[31636]: pgmap v12698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:48 smithi170 ceph-mon[31212]: pgmap v12698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23640.534425 secs 2024-04-21T16:58:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23640.534425 secs 2024-04-21T16:58:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23640.534425 secs 2024-04-21T16:58:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:50 smithi077 ceph-mon[27902]: pgmap v12699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:50 smithi191 ceph-mon[31636]: pgmap v12699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:50 smithi170 ceph-mon[31212]: pgmap v12699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:58:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:52 smithi077 ceph-mon[27902]: pgmap v12700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23643.772996 secs 2024-04-21T16:58:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:52 smithi191 ceph-mon[31636]: pgmap v12700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23643.772996 secs 2024-04-21T16:58:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:52 smithi170 ceph-mon[31212]: pgmap v12700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23643.772996 secs 2024-04-21T16:58:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.442+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T16:58:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.442+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T16:58:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.442+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.442+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T16:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.442+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T16:58:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.443+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T16:58:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T16:58:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T16:58:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efd700097c0 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T16:58:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efd700097c0 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T16:58:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T16:58:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T16:58:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T16:58:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T16:58:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.482+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T16:58:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:54.483+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd70062000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T16:58:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:54 smithi077 ceph-mon[27902]: pgmap v12701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:58:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23645.534556 secs 2024-04-21T16:58:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:54 smithi191 ceph-mon[31636]: pgmap v12701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:58:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23645.534556 secs 2024-04-21T16:58:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:54 smithi170 ceph-mon[31212]: pgmap v12701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:58:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23645.534556 secs 2024-04-21T16:58:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:58:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:56 smithi077 ceph-mon[27902]: pgmap v12702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:58:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:56 smithi191 ceph-mon[31636]: pgmap v12702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:58:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:56 smithi170 ceph-mon[31212]: pgmap v12702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:58:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:57.623+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:58:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:57.623+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:58:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:57.624+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T16:58:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T16:58:57.624+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T16:58:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23648.773118 secs 2024-04-21T16:58:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23648.773118 secs 2024-04-21T16:58:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23648.773118 secs 2024-04-21T16:58:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:58 smithi191 ceph-mon[31636]: pgmap v12703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:58 smithi077 ceph-mon[27902]: pgmap v12703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:58 smithi170 ceph-mon[31212]: pgmap v12703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:58:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:58:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23650.534690 secs 2024-04-21T16:58:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:58:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23650.534690 secs 2024-04-21T16:59:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:58:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23650.534690 secs 2024-04-21T16:59:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:00 smithi077 ceph-mon[27902]: pgmap v12704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:59:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:00 smithi191 ceph-mon[31636]: pgmap v12704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:59:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:00 smithi170 ceph-mon[31212]: pgmap v12704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T16:59:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:02 smithi077 ceph-mon[27902]: pgmap v12705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23653.773255 secs 2024-04-21T16:59:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:02 smithi191 ceph-mon[31636]: pgmap v12705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23653.773255 secs 2024-04-21T16:59:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:02 smithi170 ceph-mon[31212]: pgmap v12705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23653.773255 secs 2024-04-21T16:59:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:04 smithi191 ceph-mon[31636]: pgmap v12706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23655.534826 secs 2024-04-21T16:59:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:04 smithi170 ceph-mon[31212]: pgmap v12706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23655.534826 secs 2024-04-21T16:59:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:04 smithi077 ceph-mon[27902]: pgmap v12706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23655.534826 secs 2024-04-21T16:59:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:05 smithi191 ceph-mon[31636]: osdmap e866: 12 total, 12 up, 12 in 2024-04-21T16:59:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:05 smithi170 ceph-mon[31212]: osdmap e866: 12 total, 12 up, 12 in 2024-04-21T16:59:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:05 smithi077 ceph-mon[27902]: osdmap e866: 12 total, 12 up, 12 in 2024-04-21T16:59:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:06 smithi191 ceph-mon[31636]: pgmap v12708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:59:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:59:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:59:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:59:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:59:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:06 smithi170 ceph-mon[31212]: pgmap v12708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:59:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:59:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:59:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:59:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:59:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:06 smithi077 ceph-mon[27902]: pgmap v12708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:59:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T16:59:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T16:59:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T16:59:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T16:59:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23658.773375 secs 2024-04-21T16:59:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23658.773375 secs 2024-04-21T16:59:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23658.773375 secs 2024-04-21T16:59:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:08 smithi191 ceph-mon[31636]: pgmap v12709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:59:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:08 smithi170 ceph-mon[31212]: pgmap v12709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:59:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:08 smithi077 ceph-mon[27902]: pgmap v12709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:59:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23660.534875 secs 2024-04-21T16:59:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23660.534875 secs 2024-04-21T16:59:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23660.534875 secs 2024-04-21T16:59:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:10 smithi191 ceph-mon[31636]: pgmap v12710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:59:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:10 smithi170 ceph-mon[31212]: pgmap v12710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:59:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:10 smithi077 ceph-mon[27902]: pgmap v12710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T16:59:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:12 smithi170 ceph-mon[31212]: pgmap v12711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:59:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:12 smithi170 ceph-mon[31212]: osdmap e867: 12 total, 12 up, 12 in 2024-04-21T16:59:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23663.773494 secs 2024-04-21T16:59:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:12 smithi077 ceph-mon[27902]: pgmap v12711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:59:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:12 smithi077 ceph-mon[27902]: osdmap e867: 12 total, 12 up, 12 in 2024-04-21T16:59:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23663.773494 secs 2024-04-21T16:59:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:12 smithi191 ceph-mon[31636]: pgmap v12711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:59:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:12 smithi191 ceph-mon[31636]: osdmap e867: 12 total, 12 up, 12 in 2024-04-21T16:59:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23663.773494 secs 2024-04-21T16:59:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:14 smithi170 ceph-mon[31212]: pgmap v12713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:59:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23665.534939 secs 2024-04-21T16:59:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:14 smithi077 ceph-mon[27902]: pgmap v12713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:59:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23665.534939 secs 2024-04-21T16:59:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:14 smithi191 ceph-mon[31636]: pgmap v12713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T16:59:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23665.534939 secs 2024-04-21T16:59:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:16 smithi170 ceph-mon[31212]: pgmap v12714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:59:16.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:16 smithi077 ceph-mon[27902]: pgmap v12714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:59:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:16 smithi191 ceph-mon[31636]: pgmap v12714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T16:59:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23668.773613 secs 2024-04-21T16:59:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23668.773613 secs 2024-04-21T16:59:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23668.773613 secs 2024-04-21T16:59:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:18 smithi170 ceph-mon[31212]: pgmap v12715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:59:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:18 smithi077 ceph-mon[27902]: pgmap v12715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:59:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:18 smithi191 ceph-mon[31636]: pgmap v12715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:59:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23670.535058 secs 2024-04-21T16:59:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23670.535058 secs 2024-04-21T16:59:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23670.535058 secs 2024-04-21T16:59:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:20 smithi170 ceph-mon[31212]: pgmap v12716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:59:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:20 smithi077 ceph-mon[27902]: pgmap v12716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:59:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:20 smithi191 ceph-mon[31636]: pgmap v12716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T16:59:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:22 smithi170 ceph-mon[31212]: pgmap v12717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:59:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23673.773715 secs 2024-04-21T16:59:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:22 smithi077 ceph-mon[27902]: pgmap v12717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:59:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23673.773715 secs 2024-04-21T16:59:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:22 smithi191 ceph-mon[31636]: pgmap v12717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T16:59:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23673.773715 secs 2024-04-21T16:59:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:24 smithi170 ceph-mon[31212]: pgmap v12718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:59:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23675.535122 secs 2024-04-21T16:59:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:24 smithi077 ceph-mon[27902]: pgmap v12718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:59:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23675.535122 secs 2024-04-21T16:59:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:24 smithi191 ceph-mon[31636]: pgmap v12718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T16:59:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23675.535122 secs 2024-04-21T16:59:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:26 smithi170 ceph-mon[31212]: pgmap v12719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:26 smithi077 ceph-mon[27902]: pgmap v12719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:26 smithi191 ceph-mon[31636]: pgmap v12719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23678.773845 secs 2024-04-21T16:59:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23678.773845 secs 2024-04-21T16:59:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23678.773845 secs 2024-04-21T16:59:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:28 smithi170 ceph-mon[31212]: pgmap v12720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:28 smithi191 ceph-mon[31636]: pgmap v12720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:28 smithi077 ceph-mon[27902]: pgmap v12720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23680.535236 secs 2024-04-21T16:59:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23680.535236 secs 2024-04-21T16:59:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23680.535236 secs 2024-04-21T16:59:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:30 smithi077 ceph-mon[27902]: pgmap v12721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:30 smithi191 ceph-mon[31636]: pgmap v12721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:30 smithi170 ceph-mon[31212]: pgmap v12721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:32 smithi077 ceph-mon[27902]: pgmap v12722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23683.773912 secs 2024-04-21T16:59:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:32 smithi191 ceph-mon[31636]: pgmap v12722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23683.773912 secs 2024-04-21T16:59:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:32 smithi170 ceph-mon[31212]: pgmap v12722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23683.773912 secs 2024-04-21T16:59:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:34 smithi077 ceph-mon[27902]: pgmap v12723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23685.535353 secs 2024-04-21T16:59:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:34 smithi191 ceph-mon[31636]: pgmap v12723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23685.535353 secs 2024-04-21T16:59:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:34 smithi170 ceph-mon[31212]: pgmap v12723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23685.535353 secs 2024-04-21T16:59:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:36 smithi077 ceph-mon[27902]: pgmap v12724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:36 smithi191 ceph-mon[31636]: pgmap v12724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:36 smithi170 ceph-mon[31212]: pgmap v12724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23688.774044 secs 2024-04-21T16:59:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23688.774044 secs 2024-04-21T16:59:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23688.774044 secs 2024-04-21T16:59:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:38 smithi077 ceph-mon[27902]: pgmap v12725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:38 smithi191 ceph-mon[31636]: pgmap v12725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:38 smithi170 ceph-mon[31212]: pgmap v12725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23690.535491 secs 2024-04-21T16:59:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23690.535491 secs 2024-04-21T16:59:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23690.535491 secs 2024-04-21T16:59:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:40 smithi077 ceph-mon[27902]: pgmap v12726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:40 smithi191 ceph-mon[31636]: pgmap v12726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:40 smithi170 ceph-mon[31212]: pgmap v12726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:42 smithi077 ceph-mon[27902]: pgmap v12727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23693.774141 secs 2024-04-21T16:59:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:42 smithi191 ceph-mon[31636]: pgmap v12727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23693.774141 secs 2024-04-21T16:59:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:42 smithi170 ceph-mon[31212]: pgmap v12727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23693.774141 secs 2024-04-21T16:59:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:44 smithi077 ceph-mon[27902]: pgmap v12728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23695.535589 secs 2024-04-21T16:59:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:44 smithi191 ceph-mon[31636]: pgmap v12728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23695.535589 secs 2024-04-21T16:59:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:44 smithi170 ceph-mon[31212]: pgmap v12728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23695.535589 secs 2024-04-21T16:59:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:46 smithi077 ceph-mon[27902]: pgmap v12729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:46 smithi191 ceph-mon[31636]: pgmap v12729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:46 smithi170 ceph-mon[31212]: pgmap v12729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23698.774208 secs 2024-04-21T16:59:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23698.774208 secs 2024-04-21T16:59:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23698.774208 secs 2024-04-21T16:59:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:48 smithi077 ceph-mon[27902]: pgmap v12730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:48 smithi191 ceph-mon[31636]: pgmap v12730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:48 smithi170 ceph-mon[31212]: pgmap v12730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23700.535708 secs 2024-04-21T16:59:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23700.535708 secs 2024-04-21T16:59:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23700.535708 secs 2024-04-21T16:59:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:50 smithi077 ceph-mon[27902]: pgmap v12731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:50 smithi191 ceph-mon[31636]: pgmap v12731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:50 smithi170 ceph-mon[31212]: pgmap v12731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:52 smithi077 ceph-mon[27902]: pgmap v12732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23703.774285 secs 2024-04-21T16:59:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:52 smithi191 ceph-mon[31636]: pgmap v12732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23703.774285 secs 2024-04-21T16:59:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:52 smithi170 ceph-mon[31212]: pgmap v12732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23703.774285 secs 2024-04-21T16:59:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:54 smithi077 ceph-mon[27902]: pgmap v12733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23705.535825 secs 2024-04-21T16:59:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:54 smithi191 ceph-mon[31636]: pgmap v12733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23705.535825 secs 2024-04-21T16:59:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:54 smithi170 ceph-mon[31212]: pgmap v12733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23705.535825 secs 2024-04-21T16:59:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T16:59:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:56 smithi077 ceph-mon[27902]: pgmap v12734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:56 smithi191 ceph-mon[31636]: pgmap v12734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:56 smithi170 ceph-mon[31212]: pgmap v12734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T16:59:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23708.774406 secs 2024-04-21T16:59:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23708.774406 secs 2024-04-21T16:59:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23708.774406 secs 2024-04-21T16:59:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:58 smithi170 ceph-mon[31212]: pgmap v12735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:58 smithi191 ceph-mon[31636]: pgmap v12735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:58 smithi077 ceph-mon[27902]: pgmap v12735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T16:59:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 16:59:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23710.535956 secs 2024-04-21T17:00:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 16:59:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23710.535956 secs 2024-04-21T17:00:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 16:59:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23710.535956 secs 2024-04-21T17:00:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:00 smithi191 ceph-mon[31636]: pgmap v12736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:00:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:00 smithi170 ceph-mon[31212]: pgmap v12736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:00:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:00 smithi077 ceph-mon[27902]: pgmap v12736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:00:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:02 smithi191 ceph-mon[31636]: pgmap v12737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23713.774534 secs 2024-04-21T17:00:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:02 smithi170 ceph-mon[31212]: pgmap v12737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23713.774534 secs 2024-04-21T17:00:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:02 smithi077 ceph-mon[27902]: pgmap v12737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23713.774534 secs 2024-04-21T17:00:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:04 smithi191 ceph-mon[31636]: pgmap v12738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23715.536076 secs 2024-04-21T17:00:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:04 smithi170 ceph-mon[31212]: pgmap v12738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23715.536076 secs 2024-04-21T17:00:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:04 smithi077 ceph-mon[27902]: pgmap v12738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23715.536076 secs 2024-04-21T17:00:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:05 smithi191 ceph-mon[31636]: osdmap e868: 12 total, 12 up, 12 in 2024-04-21T17:00:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:05 smithi170 ceph-mon[31212]: osdmap e868: 12 total, 12 up, 12 in 2024-04-21T17:00:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:05 smithi077 ceph-mon[27902]: osdmap e868: 12 total, 12 up, 12 in 2024-04-21T17:00:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:06 smithi191 ceph-mon[31636]: pgmap v12740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:00:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:06 smithi170 ceph-mon[31212]: pgmap v12740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:00:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:06 smithi077 ceph-mon[27902]: pgmap v12740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:00:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:00:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23718.774623 secs 2024-04-21T17:00:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:00:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23718.774623 secs 2024-04-21T17:00:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:00:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23718.774623 secs 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: pgmap v12741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: pgmap v12741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: pgmap v12741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23720.536141 secs 2024-04-21T17:00:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:00:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:00:09.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23720.536141 secs 2024-04-21T17:00:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:00:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:00:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23720.536141 secs 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:00:10.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: pgmap v12742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:00:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:00:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: pgmap v12742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:00:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:00:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:00:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:00:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:00:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:00:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:00:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: pgmap v12742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:00:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:00:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:00:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:00:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:00:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:00:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:00:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:12 smithi170 ceph-mon[31212]: pgmap v12743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:00:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:12 smithi170 ceph-mon[31212]: osdmap e869: 12 total, 12 up, 12 in 2024-04-21T17:00:12.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23723.774790 secs 2024-04-21T17:00:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:12 smithi077 ceph-mon[27902]: pgmap v12743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:00:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:12 smithi077 ceph-mon[27902]: osdmap e869: 12 total, 12 up, 12 in 2024-04-21T17:00:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23723.774790 secs 2024-04-21T17:00:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:12 smithi191 ceph-mon[31636]: pgmap v12743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:00:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:12 smithi191 ceph-mon[31636]: osdmap e869: 12 total, 12 up, 12 in 2024-04-21T17:00:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23723.774790 secs 2024-04-21T17:00:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:14 smithi170 ceph-mon[31212]: pgmap v12745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T17:00:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23725.536219 secs 2024-04-21T17:00:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:14 smithi077 ceph-mon[27902]: pgmap v12745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T17:00:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23725.536219 secs 2024-04-21T17:00:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:14 smithi191 ceph-mon[31636]: pgmap v12745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T17:00:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23725.536219 secs 2024-04-21T17:00:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:16 smithi170 ceph-mon[31212]: pgmap v12746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:00:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:16 smithi077 ceph-mon[27902]: pgmap v12746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:00:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:16 smithi191 ceph-mon[31636]: pgmap v12746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:00:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23728.774901 secs 2024-04-21T17:00:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23728.774901 secs 2024-04-21T17:00:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23728.774901 secs 2024-04-21T17:00:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:18 smithi170 ceph-mon[31212]: pgmap v12747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:00:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:18 smithi077 ceph-mon[27902]: pgmap v12747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:00:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:18 smithi191 ceph-mon[31636]: pgmap v12747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:00:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23730.536328 secs 2024-04-21T17:00:19.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23730.536328 secs 2024-04-21T17:00:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23730.536328 secs 2024-04-21T17:00:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:20 smithi170 ceph-mon[31212]: pgmap v12748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:00:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:20 smithi077 ceph-mon[27902]: pgmap v12748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:00:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:20 smithi191 ceph-mon[31636]: pgmap v12748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:00:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:22 smithi077 ceph-mon[27902]: pgmap v12749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:00:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23733.775021 secs 2024-04-21T17:00:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:22 smithi191 ceph-mon[31636]: pgmap v12749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:00:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23733.775021 secs 2024-04-21T17:00:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:22 smithi170 ceph-mon[31212]: pgmap v12749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:00:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23733.775021 secs 2024-04-21T17:00:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:24 smithi077 ceph-mon[27902]: pgmap v12750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:00:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23735.536469 secs 2024-04-21T17:00:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:24 smithi191 ceph-mon[31636]: pgmap v12750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:00:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23735.536469 secs 2024-04-21T17:00:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:24 smithi170 ceph-mon[31212]: pgmap v12750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:00:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23735.536469 secs 2024-04-21T17:00:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:26 smithi077 ceph-mon[27902]: pgmap v12751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:26 smithi191 ceph-mon[31636]: pgmap v12751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:26 smithi170 ceph-mon[31212]: pgmap v12751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23738.775136 secs 2024-04-21T17:00:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23738.775136 secs 2024-04-21T17:00:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23738.775136 secs 2024-04-21T17:00:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:28 smithi191 ceph-mon[31636]: pgmap v12752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:28 smithi077 ceph-mon[27902]: pgmap v12752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:28 smithi170 ceph-mon[31212]: pgmap v12752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23740.536604 secs 2024-04-21T17:00:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23740.536604 secs 2024-04-21T17:00:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23740.536604 secs 2024-04-21T17:00:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:30 smithi077 ceph-mon[27902]: pgmap v12753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:30 smithi191 ceph-mon[31636]: pgmap v12753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:30 smithi170 ceph-mon[31212]: pgmap v12753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:32 smithi077 ceph-mon[27902]: pgmap v12754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23743.775275 secs 2024-04-21T17:00:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:32 smithi191 ceph-mon[31636]: pgmap v12754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23743.775275 secs 2024-04-21T17:00:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:32 smithi170 ceph-mon[31212]: pgmap v12754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23743.775275 secs 2024-04-21T17:00:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:34 smithi077 ceph-mon[27902]: pgmap v12755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23745.536734 secs 2024-04-21T17:00:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:34 smithi191 ceph-mon[31636]: pgmap v12755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23745.536734 secs 2024-04-21T17:00:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:34 smithi170 ceph-mon[31212]: pgmap v12755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23745.536734 secs 2024-04-21T17:00:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:36 smithi077 ceph-mon[27902]: pgmap v12756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:36 smithi191 ceph-mon[31636]: pgmap v12756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:36 smithi170 ceph-mon[31212]: pgmap v12756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23748.775413 secs 2024-04-21T17:00:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23748.775413 secs 2024-04-21T17:00:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23748.775413 secs 2024-04-21T17:00:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:38 smithi077 ceph-mon[27902]: pgmap v12757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:38 smithi191 ceph-mon[31636]: pgmap v12757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:38 smithi170 ceph-mon[31212]: pgmap v12757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23750.536842 secs 2024-04-21T17:00:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23750.536842 secs 2024-04-21T17:00:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23750.536842 secs 2024-04-21T17:00:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:40 smithi077 ceph-mon[27902]: pgmap v12758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:40 smithi191 ceph-mon[31636]: pgmap v12758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:40 smithi170 ceph-mon[31212]: pgmap v12758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:42 smithi077 ceph-mon[27902]: pgmap v12759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23753.775527 secs 2024-04-21T17:00:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:42 smithi191 ceph-mon[31636]: pgmap v12759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23753.775527 secs 2024-04-21T17:00:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:42 smithi170 ceph-mon[31212]: pgmap v12759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23753.775527 secs 2024-04-21T17:00:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:44 smithi077 ceph-mon[27902]: pgmap v12760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23755.536931 secs 2024-04-21T17:00:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:44 smithi191 ceph-mon[31636]: pgmap v12760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23755.536931 secs 2024-04-21T17:00:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:44 smithi170 ceph-mon[31212]: pgmap v12760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23755.536931 secs 2024-04-21T17:00:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:46 smithi077 ceph-mon[27902]: pgmap v12761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:46 smithi191 ceph-mon[31636]: pgmap v12761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:46 smithi170 ceph-mon[31212]: pgmap v12761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23758.775629 secs 2024-04-21T17:00:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23758.775629 secs 2024-04-21T17:00:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23758.775629 secs 2024-04-21T17:00:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:48 smithi077 ceph-mon[27902]: pgmap v12762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:48 smithi191 ceph-mon[31636]: pgmap v12762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:48 smithi170 ceph-mon[31212]: pgmap v12762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23760.537047 secs 2024-04-21T17:00:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23760.537047 secs 2024-04-21T17:00:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23760.537047 secs 2024-04-21T17:00:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:50 smithi077 ceph-mon[27902]: pgmap v12763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:50 smithi191 ceph-mon[31636]: pgmap v12763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:50 smithi170 ceph-mon[31212]: pgmap v12763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:52 smithi077 ceph-mon[27902]: pgmap v12764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23763.775753 secs 2024-04-21T17:00:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:52 smithi191 ceph-mon[31636]: pgmap v12764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23763.775753 secs 2024-04-21T17:00:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:52 smithi170 ceph-mon[31212]: pgmap v12764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23763.775753 secs 2024-04-21T17:00:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:54 smithi191 ceph-mon[31636]: pgmap v12765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23765.537113 secs 2024-04-21T17:00:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:54 smithi170 ceph-mon[31212]: pgmap v12765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23765.537113 secs 2024-04-21T17:00:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:00:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:54 smithi077 ceph-mon[27902]: pgmap v12765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23765.537113 secs 2024-04-21T17:00:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:56 smithi191 ceph-mon[31636]: pgmap v12766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:56 smithi170 ceph-mon[31212]: pgmap v12766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:56 smithi077 ceph-mon[27902]: pgmap v12766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:00:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23768.775897 secs 2024-04-21T17:00:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23768.775897 secs 2024-04-21T17:00:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23768.775897 secs 2024-04-21T17:00:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:58 smithi170 ceph-mon[31212]: pgmap v12767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:58 smithi191 ceph-mon[31636]: pgmap v12767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:58 smithi077 ceph-mon[27902]: pgmap v12767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:00:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:00:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23770.537194 secs 2024-04-21T17:01:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:00:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23770.537194 secs 2024-04-21T17:01:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:00:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23770.537194 secs 2024-04-21T17:01:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:00 smithi191 ceph-mon[31636]: pgmap v12768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:00 smithi170 ceph-mon[31212]: pgmap v12768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:00 smithi077 ceph-mon[27902]: pgmap v12768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:02 smithi191 ceph-mon[31636]: pgmap v12769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23773.775985 secs 2024-04-21T17:01:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:02 smithi170 ceph-mon[31212]: pgmap v12769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23773.775985 secs 2024-04-21T17:01:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:02 smithi077 ceph-mon[27902]: pgmap v12769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23773.775985 secs 2024-04-21T17:01:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:04 smithi191 ceph-mon[31636]: pgmap v12770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23775.537284 secs 2024-04-21T17:01:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:04 smithi170 ceph-mon[31212]: pgmap v12770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23775.537284 secs 2024-04-21T17:01:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:05.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:04 smithi077 ceph-mon[27902]: pgmap v12770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:05.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23775.537284 secs 2024-04-21T17:01:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:05 smithi191 ceph-mon[31636]: osdmap e870: 12 total, 12 up, 12 in 2024-04-21T17:01:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:05 smithi170 ceph-mon[31212]: osdmap e870: 12 total, 12 up, 12 in 2024-04-21T17:01:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:05 smithi077 ceph-mon[27902]: osdmap e870: 12 total, 12 up, 12 in 2024-04-21T17:01:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:06 smithi191 ceph-mon[31636]: pgmap v12772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:06 smithi170 ceph-mon[31212]: pgmap v12772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:06 smithi077 ceph-mon[27902]: pgmap v12772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23778.776069 secs 2024-04-21T17:01:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23778.776069 secs 2024-04-21T17:01:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23778.776069 secs 2024-04-21T17:01:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:08 smithi191 ceph-mon[31636]: pgmap v12773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:01:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:08 smithi170 ceph-mon[31212]: pgmap v12773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:01:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:08 smithi077 ceph-mon[27902]: pgmap v12773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:01:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23780.537403 secs 2024-04-21T17:01:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23780.537403 secs 2024-04-21T17:01:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23780.537403 secs 2024-04-21T17:01:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:10 smithi191 ceph-mon[31636]: pgmap v12774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:01:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:01:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:10 smithi170 ceph-mon[31212]: pgmap v12774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:01:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:01:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:10 smithi077 ceph-mon[27902]: pgmap v12774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:01:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:01:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:01:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:01:11.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:01:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:01:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:12.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:01:12.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:01:12.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:01:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:12 smithi191 ceph-mon[31636]: pgmap v12775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:01:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23783.776181 secs 2024-04-21T17:01:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:12 smithi170 ceph-mon[31212]: pgmap v12775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:01:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23783.776181 secs 2024-04-21T17:01:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:12 smithi077 ceph-mon[27902]: pgmap v12775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:01:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23783.776181 secs 2024-04-21T17:01:14.954 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:14 smithi077 ceph-mon[27902]: pgmap v12776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:01:14.954 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23785.537514 secs 2024-04-21T17:01:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:14 smithi191 ceph-mon[31636]: pgmap v12776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:01:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23785.537514 secs 2024-04-21T17:01:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:14 smithi170 ceph-mon[31212]: pgmap v12776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:01:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23785.537514 secs 2024-04-21T17:01:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:16 smithi191 ceph-mon[31636]: pgmap v12777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 51 KiB/s wr, 26 op/s 2024-04-21T17:01:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:16 smithi191 ceph-mon[31636]: osdmap e871: 12 total, 12 up, 12 in 2024-04-21T17:01:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:16 smithi170 ceph-mon[31212]: pgmap v12777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 51 KiB/s wr, 26 op/s 2024-04-21T17:01:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:16 smithi170 ceph-mon[31212]: osdmap e871: 12 total, 12 up, 12 in 2024-04-21T17:01:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:16 smithi077 ceph-mon[27902]: pgmap v12777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 51 KiB/s wr, 26 op/s 2024-04-21T17:01:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:16 smithi077 ceph-mon[27902]: osdmap e871: 12 total, 12 up, 12 in 2024-04-21T17:01:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23788.776294 secs 2024-04-21T17:01:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23788.776294 secs 2024-04-21T17:01:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23788.776294 secs 2024-04-21T17:01:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:18 smithi191 ceph-mon[31636]: pgmap v12779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:01:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:18 smithi170 ceph-mon[31212]: pgmap v12779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:01:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:18 smithi077 ceph-mon[27902]: pgmap v12779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:01:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23790.537629 secs 2024-04-21T17:01:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23790.537629 secs 2024-04-21T17:01:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23790.537629 secs 2024-04-21T17:01:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:20 smithi191 ceph-mon[31636]: pgmap v12780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:01:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:20 smithi170 ceph-mon[31212]: pgmap v12780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:01:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:20 smithi077 ceph-mon[27902]: pgmap v12780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:01:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:22 smithi170 ceph-mon[31212]: pgmap v12781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23793.776413 secs 2024-04-21T17:01:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:22 smithi077 ceph-mon[27902]: pgmap v12781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23793.776413 secs 2024-04-21T17:01:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:22 smithi191 ceph-mon[31636]: pgmap v12781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23793.776413 secs 2024-04-21T17:01:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:24 smithi170 ceph-mon[31212]: pgmap v12782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23795.537744 secs 2024-04-21T17:01:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:24 smithi077 ceph-mon[27902]: pgmap v12782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23795.537744 secs 2024-04-21T17:01:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:24 smithi191 ceph-mon[31636]: pgmap v12782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23795.537744 secs 2024-04-21T17:01:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:26 smithi170 ceph-mon[31212]: pgmap v12783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:26 smithi077 ceph-mon[27902]: pgmap v12783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:26 smithi191 ceph-mon[31636]: pgmap v12783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:01:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23798.776553 secs 2024-04-21T17:01:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23798.776553 secs 2024-04-21T17:01:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23798.776553 secs 2024-04-21T17:01:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:28 smithi170 ceph-mon[31212]: pgmap v12784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T17:01:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23800.537885 secs 2024-04-21T17:01:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:28 smithi077 ceph-mon[27902]: pgmap v12784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T17:01:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23800.537885 secs 2024-04-21T17:01:29.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:28 smithi191 ceph-mon[31636]: pgmap v12784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T17:01:29.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23800.537885 secs 2024-04-21T17:01:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:30 smithi170 ceph-mon[31212]: pgmap v12785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:30 smithi077 ceph-mon[27902]: pgmap v12785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:30 smithi191 ceph-mon[31636]: pgmap v12785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:32 smithi170 ceph-mon[31212]: pgmap v12786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23803.776708 secs 2024-04-21T17:01:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:32 smithi077 ceph-mon[27902]: pgmap v12786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23803.776708 secs 2024-04-21T17:01:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:32 smithi191 ceph-mon[31636]: pgmap v12786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23803.776708 secs 2024-04-21T17:01:34.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23805.537972 secs 2024-04-21T17:01:34.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23805.537972 secs 2024-04-21T17:01:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23805.537972 secs 2024-04-21T17:01:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:34 smithi170 ceph-mon[31212]: pgmap v12787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:34 smithi077 ceph-mon[27902]: pgmap v12787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:34 smithi191 ceph-mon[31636]: pgmap v12787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:36 smithi170 ceph-mon[31212]: pgmap v12788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:36 smithi077 ceph-mon[27902]: pgmap v12788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:36 smithi191 ceph-mon[31636]: pgmap v12788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23808.776829 secs 2024-04-21T17:01:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23808.776829 secs 2024-04-21T17:01:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23808.776829 secs 2024-04-21T17:01:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:38 smithi170 ceph-mon[31212]: pgmap v12789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23810.538095 secs 2024-04-21T17:01:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:38 smithi077 ceph-mon[27902]: pgmap v12789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23810.538095 secs 2024-04-21T17:01:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:38 smithi191 ceph-mon[31636]: pgmap v12789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23810.538095 secs 2024-04-21T17:01:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 23995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:40 smithi170 ceph-mon[31212]: pgmap v12790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:40 smithi077 ceph-mon[27902]: pgmap v12790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:40 smithi191 ceph-mon[31636]: pgmap v12790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:42 smithi170 ceph-mon[31212]: pgmap v12791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23813.776972 secs 2024-04-21T17:01:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:42 smithi077 ceph-mon[27902]: pgmap v12791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23813.776972 secs 2024-04-21T17:01:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:42 smithi191 ceph-mon[31636]: pgmap v12791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23813.776972 secs 2024-04-21T17:01:44.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23815.538180 secs 2024-04-21T17:01:44.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23815.538180 secs 2024-04-21T17:01:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23815.538180 secs 2024-04-21T17:01:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:44 smithi170 ceph-mon[31212]: pgmap v12792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:44 smithi077 ceph-mon[27902]: pgmap v12792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:44 smithi191 ceph-mon[31636]: pgmap v12792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:45 smithi170 ceph-mon[31212]: pgmap v12793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:46.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:45 smithi077 ceph-mon[27902]: pgmap v12793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:46.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:45 smithi191 ceph-mon[31636]: pgmap v12793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23818.777081 secs 2024-04-21T17:01:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23818.777081 secs 2024-04-21T17:01:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23818.777081 secs 2024-04-21T17:01:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:48 smithi170 ceph-mon[31212]: pgmap v12794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:48 smithi077 ceph-mon[27902]: pgmap v12794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:48.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:48 smithi191 ceph-mon[31636]: pgmap v12794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23820.538309 secs 2024-04-21T17:01:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23820.538309 secs 2024-04-21T17:01:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23820.538309 secs 2024-04-21T17:01:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:50 smithi077 ceph-mon[27902]: pgmap v12795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:50 smithi191 ceph-mon[31636]: pgmap v12795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:50 smithi170 ceph-mon[31212]: pgmap v12795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:52 smithi077 ceph-mon[27902]: pgmap v12796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23823.777209 secs 2024-04-21T17:01:52.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:52 smithi191 ceph-mon[31636]: pgmap v12796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:52.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23823.777209 secs 2024-04-21T17:01:52.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:52 smithi170 ceph-mon[31212]: pgmap v12796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:52.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23823.777209 secs 2024-04-21T17:01:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:54 smithi077 ceph-mon[27902]: pgmap v12797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23825.538410 secs 2024-04-21T17:01:54.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:54 smithi191 ceph-mon[31636]: pgmap v12797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:54.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23825.538410 secs 2024-04-21T17:01:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:54 smithi170 ceph-mon[31212]: pgmap v12797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:54.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23825.538410 secs 2024-04-21T17:01:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:01:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:56 smithi077 ceph-mon[27902]: pgmap v12798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:56.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:56 smithi191 ceph-mon[31636]: pgmap v12798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:56.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:56 smithi170 ceph-mon[31212]: pgmap v12798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:01:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23828.777352 secs 2024-04-21T17:01:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23828.777352 secs 2024-04-21T17:01:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23828.777352 secs 2024-04-21T17:01:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:01:57.647+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:01:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:01:57.647+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:01:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:01:57.648+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:01:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:01:57.648+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:01:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:58 smithi077 ceph-mon[27902]: pgmap v12799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:58.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:58 smithi170 ceph-mon[31212]: pgmap v12799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:58 smithi191 ceph-mon[31636]: pgmap v12799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:01:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:01:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23830.538527 secs 2024-04-21T17:01:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:01:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23830.538527 secs 2024-04-21T17:01:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:01:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23830.538527 secs 2024-04-21T17:02:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:00 smithi191 ceph-mon[31636]: pgmap v12800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:00 smithi170 ceph-mon[31212]: pgmap v12800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:00 smithi077 ceph-mon[27902]: pgmap v12800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:02.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:02 smithi191 ceph-mon[31636]: pgmap v12801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:02.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23833.777493 secs 2024-04-21T17:02:02.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:02 smithi170 ceph-mon[31212]: pgmap v12801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:02.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23833.777493 secs 2024-04-21T17:02:02.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:02 smithi077 ceph-mon[27902]: pgmap v12801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:02.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23833.777493 secs 2024-04-21T17:02:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:04 smithi191 ceph-mon[31636]: pgmap v12802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23835.538643 secs 2024-04-21T17:02:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:04 smithi170 ceph-mon[31212]: pgmap v12802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23835.538643 secs 2024-04-21T17:02:04.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:04 smithi077 ceph-mon[27902]: pgmap v12802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:04.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23835.538643 secs 2024-04-21T17:02:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:05 smithi191 ceph-mon[31636]: osdmap e872: 12 total, 12 up, 12 in 2024-04-21T17:02:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:05 smithi170 ceph-mon[31212]: osdmap e872: 12 total, 12 up, 12 in 2024-04-21T17:02:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:05 smithi077 ceph-mon[27902]: osdmap e872: 12 total, 12 up, 12 in 2024-04-21T17:02:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:06 smithi191 ceph-mon[31636]: pgmap v12804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:02:06.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:06 smithi170 ceph-mon[31212]: pgmap v12804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:02:06.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:06 smithi077 ceph-mon[27902]: pgmap v12804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:02:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23838.777635 secs 2024-04-21T17:02:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23838.777635 secs 2024-04-21T17:02:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23838.777635 secs 2024-04-21T17:02:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:08 smithi191 ceph-mon[31636]: pgmap v12805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:08 smithi170 ceph-mon[31212]: pgmap v12805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:08 smithi077 ceph-mon[27902]: pgmap v12805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23840.538773 secs 2024-04-21T17:02:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23840.538773 secs 2024-04-21T17:02:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23840.538773 secs 2024-04-21T17:02:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:10 smithi191 ceph-mon[31636]: pgmap v12806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:10 smithi170 ceph-mon[31212]: pgmap v12806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:10 smithi077 ceph-mon[27902]: pgmap v12806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:02:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:02:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: pgmap v12807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: osdmap e873: 12 total, 12 up, 12 in 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23843.777699 secs 2024-04-21T17:02:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:02:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:02:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: pgmap v12807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: osdmap e873: 12 total, 12 up, 12 in 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23843.777699 secs 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:02:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: pgmap v12807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: osdmap e873: 12 total, 12 up, 12 in 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23843.777699 secs 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:02:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:02:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:14 smithi077 ceph-mon[27902]: pgmap v12809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:02:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23845.538925 secs 2024-04-21T17:02:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:14 smithi191 ceph-mon[31636]: pgmap v12809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:02:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23845.538925 secs 2024-04-21T17:02:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:14 smithi170 ceph-mon[31212]: pgmap v12809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:02:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23845.538925 secs 2024-04-21T17:02:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:16 smithi077 ceph-mon[27902]: pgmap v12810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:16 smithi191 ceph-mon[31636]: pgmap v12810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:16 smithi170 ceph-mon[31212]: pgmap v12810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:02:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23848.777819 secs 2024-04-21T17:02:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23848.777819 secs 2024-04-21T17:02:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23848.777819 secs 2024-04-21T17:02:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:18 smithi077 ceph-mon[27902]: pgmap v12811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:02:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:18 smithi191 ceph-mon[31636]: pgmap v12811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:02:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:18 smithi170 ceph-mon[31212]: pgmap v12811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:02:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23850.539014 secs 2024-04-21T17:02:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23850.539014 secs 2024-04-21T17:02:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23850.539014 secs 2024-04-21T17:02:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:20 smithi077 ceph-mon[27902]: pgmap v12812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:02:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:20 smithi191 ceph-mon[31636]: pgmap v12812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:02:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:20 smithi170 ceph-mon[31212]: pgmap v12812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:02:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:22 smithi077 ceph-mon[27902]: pgmap v12813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:02:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23853.777913 secs 2024-04-21T17:02:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:22 smithi191 ceph-mon[31636]: pgmap v12813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:02:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23853.777913 secs 2024-04-21T17:02:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:22 smithi170 ceph-mon[31212]: pgmap v12813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:02:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23853.777913 secs 2024-04-21T17:02:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:24 smithi077 ceph-mon[27902]: pgmap v12814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:02:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23855.539106 secs 2024-04-21T17:02:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:24 smithi191 ceph-mon[31636]: pgmap v12814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:02:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23855.539106 secs 2024-04-21T17:02:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:24 smithi170 ceph-mon[31212]: pgmap v12814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:02:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23855.539106 secs 2024-04-21T17:02:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:26 smithi077 ceph-mon[27902]: pgmap v12815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:26 smithi191 ceph-mon[31636]: pgmap v12815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:26 smithi170 ceph-mon[31212]: pgmap v12815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23858.778026 secs 2024-04-21T17:02:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23858.778026 secs 2024-04-21T17:02:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23858.778026 secs 2024-04-21T17:02:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:28 smithi191 ceph-mon[31636]: pgmap v12816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:28 smithi077 ceph-mon[27902]: pgmap v12816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:28 smithi170 ceph-mon[31212]: pgmap v12816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23860.539216 secs 2024-04-21T17:02:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23860.539216 secs 2024-04-21T17:02:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23860.539216 secs 2024-04-21T17:02:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:30 smithi077 ceph-mon[27902]: pgmap v12817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:30 smithi191 ceph-mon[31636]: pgmap v12817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:30 smithi170 ceph-mon[31212]: pgmap v12817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:32 smithi077 ceph-mon[27902]: pgmap v12818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23863.778142 secs 2024-04-21T17:02:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:32 smithi191 ceph-mon[31636]: pgmap v12818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23863.778142 secs 2024-04-21T17:02:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:32 smithi170 ceph-mon[31212]: pgmap v12818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23863.778142 secs 2024-04-21T17:02:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:34 smithi077 ceph-mon[27902]: pgmap v12819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23865.539329 secs 2024-04-21T17:02:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:34 smithi191 ceph-mon[31636]: pgmap v12819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23865.539329 secs 2024-04-21T17:02:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:34 smithi170 ceph-mon[31212]: pgmap v12819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23865.539329 secs 2024-04-21T17:02:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:36 smithi077 ceph-mon[27902]: pgmap v12820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:36 smithi191 ceph-mon[31636]: pgmap v12820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:36 smithi170 ceph-mon[31212]: pgmap v12820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23868.778255 secs 2024-04-21T17:02:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23868.778255 secs 2024-04-21T17:02:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23868.778255 secs 2024-04-21T17:02:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:38 smithi077 ceph-mon[27902]: pgmap v12821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:38 smithi191 ceph-mon[31636]: pgmap v12821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:38 smithi170 ceph-mon[31212]: pgmap v12821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23870.539468 secs 2024-04-21T17:02:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23870.539468 secs 2024-04-21T17:02:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23870.539468 secs 2024-04-21T17:02:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:40 smithi077 ceph-mon[27902]: pgmap v12822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:40 smithi191 ceph-mon[31636]: pgmap v12822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:40 smithi170 ceph-mon[31212]: pgmap v12822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:42 smithi077 ceph-mon[27902]: pgmap v12823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23873.778355 secs 2024-04-21T17:02:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:42 smithi191 ceph-mon[31636]: pgmap v12823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23873.778355 secs 2024-04-21T17:02:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:42 smithi170 ceph-mon[31212]: pgmap v12823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23873.778355 secs 2024-04-21T17:02:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:44 smithi077 ceph-mon[27902]: pgmap v12824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23875.539585 secs 2024-04-21T17:02:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:44 smithi191 ceph-mon[31636]: pgmap v12824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23875.539585 secs 2024-04-21T17:02:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:44 smithi170 ceph-mon[31212]: pgmap v12824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23875.539585 secs 2024-04-21T17:02:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:46 smithi191 ceph-mon[31636]: pgmap v12825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:46 smithi170 ceph-mon[31212]: pgmap v12825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:46 smithi077 ceph-mon[27902]: pgmap v12825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23878.778489 secs 2024-04-21T17:02:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23878.778489 secs 2024-04-21T17:02:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23878.778489 secs 2024-04-21T17:02:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:48 smithi191 ceph-mon[31636]: pgmap v12826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:48 smithi170 ceph-mon[31212]: pgmap v12826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:48 smithi077 ceph-mon[27902]: pgmap v12826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23880.539701 secs 2024-04-21T17:02:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23880.539701 secs 2024-04-21T17:02:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23880.539701 secs 2024-04-21T17:02:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:50 smithi191 ceph-mon[31636]: pgmap v12827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:50 smithi170 ceph-mon[31212]: pgmap v12827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:50 smithi077 ceph-mon[27902]: pgmap v12827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:52 smithi191 ceph-mon[31636]: pgmap v12828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23883.778585 secs 2024-04-21T17:02:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:52 smithi170 ceph-mon[31212]: pgmap v12828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23883.778585 secs 2024-04-21T17:02:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:52 smithi077 ceph-mon[27902]: pgmap v12828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23883.778585 secs 2024-04-21T17:02:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:54 smithi191 ceph-mon[31636]: pgmap v12829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23885.539790 secs 2024-04-21T17:02:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:54 smithi170 ceph-mon[31212]: pgmap v12829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23885.539790 secs 2024-04-21T17:02:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:02:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:54 smithi077 ceph-mon[27902]: pgmap v12829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23885.539790 secs 2024-04-21T17:02:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:56 smithi191 ceph-mon[31636]: pgmap v12830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:56 smithi170 ceph-mon[31212]: pgmap v12830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:56 smithi077 ceph-mon[27902]: pgmap v12830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:02:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23888.778748 secs 2024-04-21T17:02:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23888.778748 secs 2024-04-21T17:02:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23888.778748 secs 2024-04-21T17:02:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:58 smithi170 ceph-mon[31212]: pgmap v12831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:58 smithi191 ceph-mon[31636]: pgmap v12831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:58 smithi077 ceph-mon[27902]: pgmap v12831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:02:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:02:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23890.539888 secs 2024-04-21T17:03:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:02:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23890.539888 secs 2024-04-21T17:03:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:02:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23890.539888 secs 2024-04-21T17:03:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:00 smithi191 ceph-mon[31636]: pgmap v12832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:00 smithi170 ceph-mon[31212]: pgmap v12832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:00 smithi077 ceph-mon[27902]: pgmap v12832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:02 smithi191 ceph-mon[31636]: pgmap v12833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23893.778859 secs 2024-04-21T17:03:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:02 smithi170 ceph-mon[31212]: pgmap v12833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23893.778859 secs 2024-04-21T17:03:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:02 smithi077 ceph-mon[27902]: pgmap v12833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23893.778859 secs 2024-04-21T17:03:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:04 smithi191 ceph-mon[31636]: pgmap v12834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23895.539961 secs 2024-04-21T17:03:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:04 smithi191 ceph-mon[31636]: osdmap e874: 12 total, 12 up, 12 in 2024-04-21T17:03:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:04 smithi170 ceph-mon[31212]: pgmap v12834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23895.539961 secs 2024-04-21T17:03:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:04 smithi170 ceph-mon[31212]: osdmap e874: 12 total, 12 up, 12 in 2024-04-21T17:03:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:04 smithi077 ceph-mon[27902]: pgmap v12834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23895.539961 secs 2024-04-21T17:03:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:04 smithi077 ceph-mon[27902]: osdmap e874: 12 total, 12 up, 12 in 2024-04-21T17:03:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:06 smithi191 ceph-mon[31636]: pgmap v12836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:03:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:06 smithi170 ceph-mon[31212]: pgmap v12836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:03:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:06 smithi077 ceph-mon[27902]: pgmap v12836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:03:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23898.778989 secs 2024-04-21T17:03:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23898.778989 secs 2024-04-21T17:03:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23898.778989 secs 2024-04-21T17:03:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:08 smithi191 ceph-mon[31636]: pgmap v12837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:03:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:08 smithi170 ceph-mon[31212]: pgmap v12837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:03:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:08 smithi077 ceph-mon[27902]: pgmap v12837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:03:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23900.540042 secs 2024-04-21T17:03:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23900.540042 secs 2024-04-21T17:03:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23900.540042 secs 2024-04-21T17:03:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:10 smithi191 ceph-mon[31636]: pgmap v12838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:03:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:10 smithi170 ceph-mon[31212]: pgmap v12838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:03:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:10 smithi077 ceph-mon[27902]: pgmap v12838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:03:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:12 smithi077 ceph-mon[27902]: pgmap v12839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:03:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:12 smithi077 ceph-mon[27902]: osdmap e875: 12 total, 12 up, 12 in 2024-04-21T17:03:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23903.779112 secs 2024-04-21T17:03:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:03:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:12 smithi191 ceph-mon[31636]: pgmap v12839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:03:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:12 smithi191 ceph-mon[31636]: osdmap e875: 12 total, 12 up, 12 in 2024-04-21T17:03:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23903.779112 secs 2024-04-21T17:03:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:03:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:12 smithi170 ceph-mon[31212]: pgmap v12839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:03:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:12 smithi170 ceph-mon[31212]: osdmap e875: 12 total, 12 up, 12 in 2024-04-21T17:03:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23903.779112 secs 2024-04-21T17:03:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:03:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:03:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:03:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:03:13.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:03:13.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:03:13.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:03:14.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:03:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:03:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:03:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:14 smithi077 ceph-mon[27902]: pgmap v12841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:03:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23905.540125 secs 2024-04-21T17:03:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:14 smithi191 ceph-mon[31636]: pgmap v12841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:03:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23905.540125 secs 2024-04-21T17:03:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:14 smithi170 ceph-mon[31212]: pgmap v12841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:03:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23905.540125 secs 2024-04-21T17:03:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:16 smithi077 ceph-mon[27902]: pgmap v12842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:03:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:16 smithi191 ceph-mon[31636]: pgmap v12842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:03:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:16 smithi170 ceph-mon[31212]: pgmap v12842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:03:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23908.779241 secs 2024-04-21T17:03:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23908.779241 secs 2024-04-21T17:03:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23908.779241 secs 2024-04-21T17:03:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:18 smithi077 ceph-mon[27902]: pgmap v12843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:03:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:18 smithi191 ceph-mon[31636]: pgmap v12843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:03:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:18 smithi170 ceph-mon[31212]: pgmap v12843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:03:19.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23910.540235 secs 2024-04-21T17:03:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23910.540235 secs 2024-04-21T17:03:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23910.540235 secs 2024-04-21T17:03:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:20 smithi077 ceph-mon[27902]: pgmap v12844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:03:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:20 smithi191 ceph-mon[31636]: pgmap v12844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:03:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:20 smithi170 ceph-mon[31212]: pgmap v12844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:03:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:22 smithi077 ceph-mon[27902]: pgmap v12845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:03:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23913.779369 secs 2024-04-21T17:03:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:22 smithi191 ceph-mon[31636]: pgmap v12845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:03:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23913.779369 secs 2024-04-21T17:03:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:22 smithi170 ceph-mon[31212]: pgmap v12845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:03:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23913.779369 secs 2024-04-21T17:03:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:24 smithi077 ceph-mon[27902]: pgmap v12846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:03:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23915.540368 secs 2024-04-21T17:03:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:24 smithi191 ceph-mon[31636]: pgmap v12846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:03:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23915.540368 secs 2024-04-21T17:03:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:24 smithi170 ceph-mon[31212]: pgmap v12846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:03:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23915.540368 secs 2024-04-21T17:03:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:26 smithi077 ceph-mon[27902]: pgmap v12847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:26 smithi191 ceph-mon[31636]: pgmap v12847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:26 smithi170 ceph-mon[31212]: pgmap v12847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23918.779500 secs 2024-04-21T17:03:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23918.779500 secs 2024-04-21T17:03:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23918.779500 secs 2024-04-21T17:03:28.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:28 smithi191 ceph-mon[31636]: pgmap v12848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:28 smithi077 ceph-mon[27902]: pgmap v12848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:28 smithi170 ceph-mon[31212]: pgmap v12848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23920.540482 secs 2024-04-21T17:03:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23920.540482 secs 2024-04-21T17:03:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23920.540482 secs 2024-04-21T17:03:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:30 smithi077 ceph-mon[27902]: pgmap v12849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:30 smithi191 ceph-mon[31636]: pgmap v12849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:30 smithi170 ceph-mon[31212]: pgmap v12849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:32 smithi077 ceph-mon[27902]: pgmap v12850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23923.779591 secs 2024-04-21T17:03:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:32 smithi191 ceph-mon[31636]: pgmap v12850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23923.779591 secs 2024-04-21T17:03:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:32 smithi170 ceph-mon[31212]: pgmap v12850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23923.779591 secs 2024-04-21T17:03:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:34 smithi077 ceph-mon[27902]: pgmap v12851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23925.540594 secs 2024-04-21T17:03:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:34 smithi191 ceph-mon[31636]: pgmap v12851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23925.540594 secs 2024-04-21T17:03:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:34 smithi170 ceph-mon[31212]: pgmap v12851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23925.540594 secs 2024-04-21T17:03:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:36 smithi077 ceph-mon[27902]: pgmap v12852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:36 smithi191 ceph-mon[31636]: pgmap v12852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:36 smithi170 ceph-mon[31212]: pgmap v12852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23928.779709 secs 2024-04-21T17:03:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23928.779709 secs 2024-04-21T17:03:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23928.779709 secs 2024-04-21T17:03:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:38 smithi191 ceph-mon[31636]: pgmap v12853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:38 smithi170 ceph-mon[31212]: pgmap v12853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:38 smithi077 ceph-mon[27902]: pgmap v12853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23930.540719 secs 2024-04-21T17:03:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23930.540719 secs 2024-04-21T17:03:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23930.540719 secs 2024-04-21T17:03:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:40 smithi191 ceph-mon[31636]: pgmap v12854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:40 smithi170 ceph-mon[31212]: pgmap v12854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:40 smithi077 ceph-mon[27902]: pgmap v12854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:42 smithi191 ceph-mon[31636]: pgmap v12855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23933.779789 secs 2024-04-21T17:03:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:42 smithi170 ceph-mon[31212]: pgmap v12855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23933.779789 secs 2024-04-21T17:03:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:42 smithi077 ceph-mon[27902]: pgmap v12855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23933.779789 secs 2024-04-21T17:03:44.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:44 smithi077 ceph-mon[27902]: pgmap v12856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:44.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23935.540795 secs 2024-04-21T17:03:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:44 smithi191 ceph-mon[31636]: pgmap v12856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23935.540795 secs 2024-04-21T17:03:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:44 smithi170 ceph-mon[31212]: pgmap v12856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23935.540795 secs 2024-04-21T17:03:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:46 smithi191 ceph-mon[31636]: pgmap v12857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:46 smithi170 ceph-mon[31212]: pgmap v12857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:46 smithi077 ceph-mon[27902]: pgmap v12857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23938.779924 secs 2024-04-21T17:03:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23938.779924 secs 2024-04-21T17:03:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23938.779924 secs 2024-04-21T17:03:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:48 smithi191 ceph-mon[31636]: pgmap v12858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:48 smithi170 ceph-mon[31212]: pgmap v12858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:48 smithi077 ceph-mon[27902]: pgmap v12858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23940.540908 secs 2024-04-21T17:03:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23940.540908 secs 2024-04-21T17:03:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23940.540908 secs 2024-04-21T17:03:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:50 smithi191 ceph-mon[31636]: pgmap v12859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:50 smithi170 ceph-mon[31212]: pgmap v12859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:50 smithi077 ceph-mon[27902]: pgmap v12859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:52 smithi191 ceph-mon[31636]: pgmap v12860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23943.780045 secs 2024-04-21T17:03:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:52 smithi170 ceph-mon[31212]: pgmap v12860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23943.780045 secs 2024-04-21T17:03:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:52 smithi077 ceph-mon[27902]: pgmap v12860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23943.780045 secs 2024-04-21T17:03:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:54 smithi191 ceph-mon[31636]: pgmap v12861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23945.541030 secs 2024-04-21T17:03:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:54 smithi170 ceph-mon[31212]: pgmap v12861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23945.541030 secs 2024-04-21T17:03:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:03:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:54 smithi077 ceph-mon[27902]: pgmap v12861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23945.541030 secs 2024-04-21T17:03:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:56 smithi191 ceph-mon[31636]: pgmap v12862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:56 smithi170 ceph-mon[31212]: pgmap v12862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:56 smithi077 ceph-mon[27902]: pgmap v12862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:03:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23948.780162 secs 2024-04-21T17:03:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23948.780162 secs 2024-04-21T17:03:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23948.780162 secs 2024-04-21T17:03:58.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:58 smithi170 ceph-mon[31212]: pgmap v12863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:58 smithi191 ceph-mon[31636]: pgmap v12863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:58 smithi077 ceph-mon[27902]: pgmap v12863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:03:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:03:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23950.541152 secs 2024-04-21T17:04:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:03:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23950.541152 secs 2024-04-21T17:04:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:03:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23950.541152 secs 2024-04-21T17:04:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:00 smithi191 ceph-mon[31636]: pgmap v12864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:00 smithi170 ceph-mon[31212]: pgmap v12864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:00 smithi077 ceph-mon[27902]: pgmap v12864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:02 smithi191 ceph-mon[31636]: pgmap v12865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T17:04:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23953.780294 secs 2024-04-21T17:04:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:02 smithi170 ceph-mon[31212]: pgmap v12865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T17:04:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23953.780294 secs 2024-04-21T17:04:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:02 smithi077 ceph-mon[27902]: pgmap v12865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T17:04:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23953.780294 secs 2024-04-21T17:04:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:04 smithi191 ceph-mon[31636]: pgmap v12866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T17:04:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23955.541244 secs 2024-04-21T17:04:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:04 smithi191 ceph-mon[31636]: osdmap e876: 12 total, 12 up, 12 in 2024-04-21T17:04:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:04 smithi170 ceph-mon[31212]: pgmap v12866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T17:04:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23955.541244 secs 2024-04-21T17:04:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:04 smithi170 ceph-mon[31212]: osdmap e876: 12 total, 12 up, 12 in 2024-04-21T17:04:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:04 smithi077 ceph-mon[27902]: pgmap v12866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T17:04:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23955.541244 secs 2024-04-21T17:04:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:04 smithi077 ceph-mon[27902]: osdmap e876: 12 total, 12 up, 12 in 2024-04-21T17:04:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:06 smithi191 ceph-mon[31636]: pgmap v12868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T17:04:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:06 smithi170 ceph-mon[31212]: pgmap v12868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T17:04:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:06 smithi077 ceph-mon[27902]: pgmap v12868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T17:04:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23958.780413 secs 2024-04-21T17:04:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23958.780413 secs 2024-04-21T17:04:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23958.780413 secs 2024-04-21T17:04:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:08 smithi170 ceph-mon[31212]: pgmap v12869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:04:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:08 smithi077 ceph-mon[27902]: pgmap v12869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:04:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:08 smithi191 ceph-mon[31636]: pgmap v12869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:04:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23960.541367 secs 2024-04-21T17:04:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23960.541367 secs 2024-04-21T17:04:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23960.541367 secs 2024-04-21T17:04:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:10 smithi170 ceph-mon[31212]: pgmap v12870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:04:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:10 smithi077 ceph-mon[27902]: pgmap v12870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:04:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:10 smithi191 ceph-mon[31636]: pgmap v12870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:04:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:12 smithi077 ceph-mon[27902]: pgmap v12871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T17:04:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:12 smithi077 ceph-mon[27902]: osdmap e877: 12 total, 12 up, 12 in 2024-04-21T17:04:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23963.780534 secs 2024-04-21T17:04:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:12 smithi191 ceph-mon[31636]: pgmap v12871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T17:04:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:12 smithi191 ceph-mon[31636]: osdmap e877: 12 total, 12 up, 12 in 2024-04-21T17:04:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23963.780534 secs 2024-04-21T17:04:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:12 smithi170 ceph-mon[31212]: pgmap v12871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T17:04:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:12 smithi170 ceph-mon[31212]: osdmap e877: 12 total, 12 up, 12 in 2024-04-21T17:04:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23963.780534 secs 2024-04-21T17:04:13.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:04:13.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:04:14.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:04:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:14 smithi077 ceph-mon[27902]: pgmap v12873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-04-21T17:04:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23965.541458 secs 2024-04-21T17:04:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:04:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:04:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:04:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:14 smithi191 ceph-mon[31636]: pgmap v12873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-04-21T17:04:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23965.541458 secs 2024-04-21T17:04:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:04:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:04:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:04:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:14 smithi170 ceph-mon[31212]: pgmap v12873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-04-21T17:04:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23965.541458 secs 2024-04-21T17:04:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:04:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:04:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:04:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:16 smithi077 ceph-mon[27902]: pgmap v12874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T17:04:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:16 smithi191 ceph-mon[31636]: pgmap v12874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T17:04:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:16 smithi170 ceph-mon[31212]: pgmap v12874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-04-21T17:04:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23968.780633 secs 2024-04-21T17:04:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23968.780633 secs 2024-04-21T17:04:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23968.780633 secs 2024-04-21T17:04:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:18 smithi077 ceph-mon[27902]: pgmap v12875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:04:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:18 smithi191 ceph-mon[31636]: pgmap v12875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:04:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:18 smithi170 ceph-mon[31212]: pgmap v12875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:04:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23970.541592 secs 2024-04-21T17:04:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23970.541592 secs 2024-04-21T17:04:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23970.541592 secs 2024-04-21T17:04:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:20 smithi077 ceph-mon[27902]: pgmap v12876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:04:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:20 smithi191 ceph-mon[31636]: pgmap v12876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:04:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:20 smithi170 ceph-mon[31212]: pgmap v12876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:04:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:22 smithi077 ceph-mon[27902]: pgmap v12877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:04:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23973.780783 secs 2024-04-21T17:04:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:22 smithi191 ceph-mon[31636]: pgmap v12877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:04:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23973.780783 secs 2024-04-21T17:04:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:22 smithi170 ceph-mon[31212]: pgmap v12877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:04:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23973.780783 secs 2024-04-21T17:04:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:24 smithi077 ceph-mon[27902]: pgmap v12878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:04:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23975.541737 secs 2024-04-21T17:04:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:24 smithi191 ceph-mon[31636]: pgmap v12878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:04:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23975.541737 secs 2024-04-21T17:04:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:24 smithi170 ceph-mon[31212]: pgmap v12878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:04:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23975.541737 secs 2024-04-21T17:04:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:26 smithi077 ceph-mon[27902]: pgmap v12879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:26 smithi191 ceph-mon[31636]: pgmap v12879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:26 smithi170 ceph-mon[31212]: pgmap v12879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23978.780901 secs 2024-04-21T17:04:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23978.780901 secs 2024-04-21T17:04:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23978.780901 secs 2024-04-21T17:04:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:28 smithi077 ceph-mon[27902]: pgmap v12880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:28 smithi170 ceph-mon[31212]: pgmap v12880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:28 smithi191 ceph-mon[31636]: pgmap v12880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23980.541895 secs 2024-04-21T17:04:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23980.541895 secs 2024-04-21T17:04:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23980.541895 secs 2024-04-21T17:04:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:30 smithi191 ceph-mon[31636]: pgmap v12881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:30 smithi170 ceph-mon[31212]: pgmap v12881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:30 smithi077 ceph-mon[27902]: pgmap v12881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:32 smithi191 ceph-mon[31636]: pgmap v12882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23983.781009 secs 2024-04-21T17:04:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:32 smithi170 ceph-mon[31212]: pgmap v12882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23983.781009 secs 2024-04-21T17:04:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:32 smithi077 ceph-mon[27902]: pgmap v12882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23983.781009 secs 2024-04-21T17:04:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:34 smithi191 ceph-mon[31636]: pgmap v12883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23985.542027 secs 2024-04-21T17:04:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:34 smithi170 ceph-mon[31212]: pgmap v12883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23985.542027 secs 2024-04-21T17:04:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:34 smithi077 ceph-mon[27902]: pgmap v12883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23985.542027 secs 2024-04-21T17:04:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:36 smithi191 ceph-mon[31636]: pgmap v12884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:36 smithi170 ceph-mon[31212]: pgmap v12884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:36 smithi077 ceph-mon[27902]: pgmap v12884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:04:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23988.781132 secs 2024-04-21T17:04:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23988.781132 secs 2024-04-21T17:04:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23988.781132 secs 2024-04-21T17:04:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:38 smithi191 ceph-mon[31636]: pgmap v12885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:38 smithi170 ceph-mon[31212]: pgmap v12885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:38 smithi077 ceph-mon[27902]: pgmap v12885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23990.542136 secs 2024-04-21T17:04:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23990.542136 secs 2024-04-21T17:04:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23990.542136 secs 2024-04-21T17:04:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:40 smithi191 ceph-mon[31636]: pgmap v12886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:40 smithi170 ceph-mon[31212]: pgmap v12886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:40 smithi077 ceph-mon[27902]: pgmap v12886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:42 smithi191 ceph-mon[31636]: pgmap v12887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23993.781200 secs 2024-04-21T17:04:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:42 smithi170 ceph-mon[31212]: pgmap v12887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23993.781200 secs 2024-04-21T17:04:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:42 smithi077 ceph-mon[27902]: pgmap v12887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23993.781200 secs 2024-04-21T17:04:44.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:44 smithi077 ceph-mon[27902]: pgmap v12888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:44.939 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 23995.542200 secs 2024-04-21T17:04:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:44 smithi191 ceph-mon[31636]: pgmap v12888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 23995.542200 secs 2024-04-21T17:04:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:44 smithi170 ceph-mon[31212]: pgmap v12888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 23995.542200 secs 2024-04-21T17:04:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:46 smithi191 ceph-mon[31636]: pgmap v12889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:46 smithi170 ceph-mon[31212]: pgmap v12889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:46 smithi077 ceph-mon[27902]: pgmap v12889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 23998.781280 secs 2024-04-21T17:04:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 23998.781280 secs 2024-04-21T17:04:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 23998.781280 secs 2024-04-21T17:04:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:48 smithi191 ceph-mon[31636]: pgmap v12890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:48 smithi170 ceph-mon[31212]: pgmap v12890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:48 smithi077 ceph-mon[27902]: pgmap v12890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24000.542274 secs 2024-04-21T17:04:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24000.542274 secs 2024-04-21T17:04:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24000.542274 secs 2024-04-21T17:04:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:50 smithi191 ceph-mon[31636]: pgmap v12891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:50 smithi170 ceph-mon[31212]: pgmap v12891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:50 smithi077 ceph-mon[27902]: pgmap v12891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:52 smithi191 ceph-mon[31636]: pgmap v12892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24003.781415 secs 2024-04-21T17:04:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:52 smithi170 ceph-mon[31212]: pgmap v12892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24003.781415 secs 2024-04-21T17:04:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:52 smithi077 ceph-mon[27902]: pgmap v12892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24003.781415 secs 2024-04-21T17:04:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:54 smithi191 ceph-mon[31636]: pgmap v12893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24005.542351 secs 2024-04-21T17:04:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:54 smithi170 ceph-mon[31212]: pgmap v12893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24005.542351 secs 2024-04-21T17:04:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:04:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:54 smithi077 ceph-mon[27902]: pgmap v12893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24005.542351 secs 2024-04-21T17:04:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:56 smithi191 ceph-mon[31636]: pgmap v12894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:56 smithi170 ceph-mon[31212]: pgmap v12894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:56 smithi077 ceph-mon[27902]: pgmap v12894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:04:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:04:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:04:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:04:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:04:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:04:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:04:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:04:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:04:57.672+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:04:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24008.781555 secs 2024-04-21T17:04:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24008.781555 secs 2024-04-21T17:04:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24008.781555 secs 2024-04-21T17:04:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:58 smithi191 ceph-mon[31636]: pgmap v12895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:58 smithi170 ceph-mon[31212]: pgmap v12895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:04:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:58 smithi077 ceph-mon[27902]: pgmap v12895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:04:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24010.542429 secs 2024-04-21T17:05:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:04:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24010.542429 secs 2024-04-21T17:05:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:04:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24010.542429 secs 2024-04-21T17:05:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:00 smithi170 ceph-mon[31212]: pgmap v12896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:00 smithi077 ceph-mon[27902]: pgmap v12896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:00 smithi191 ceph-mon[31636]: pgmap v12896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:02 smithi170 ceph-mon[31212]: pgmap v12897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24013.781673 secs 2024-04-21T17:05:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:02 smithi077 ceph-mon[27902]: pgmap v12897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24013.781673 secs 2024-04-21T17:05:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:02 smithi191 ceph-mon[31636]: pgmap v12897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24013.781673 secs 2024-04-21T17:05:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:04 smithi170 ceph-mon[31212]: pgmap v12898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24015.542553 secs 2024-04-21T17:05:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:04 smithi170 ceph-mon[31212]: osdmap e878: 12 total, 12 up, 12 in 2024-04-21T17:05:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:04 smithi077 ceph-mon[27902]: pgmap v12898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24015.542553 secs 2024-04-21T17:05:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:04 smithi077 ceph-mon[27902]: osdmap e878: 12 total, 12 up, 12 in 2024-04-21T17:05:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:04 smithi191 ceph-mon[31636]: pgmap v12898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24015.542553 secs 2024-04-21T17:05:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:04 smithi191 ceph-mon[31636]: osdmap e878: 12 total, 12 up, 12 in 2024-04-21T17:05:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:06 smithi170 ceph-mon[31212]: pgmap v12900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:05:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:06 smithi077 ceph-mon[27902]: pgmap v12900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:05:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:06 smithi191 ceph-mon[31636]: pgmap v12900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:05:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24018.781790 secs 2024-04-21T17:05:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24018.781790 secs 2024-04-21T17:05:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24018.781790 secs 2024-04-21T17:05:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:08 smithi170 ceph-mon[31212]: pgmap v12901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:05:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:08 smithi077 ceph-mon[27902]: pgmap v12901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:05:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:08 smithi191 ceph-mon[31636]: pgmap v12901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:05:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24020.542669 secs 2024-04-21T17:05:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24020.542669 secs 2024-04-21T17:05:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24020.542669 secs 2024-04-21T17:05:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:10 smithi170 ceph-mon[31212]: pgmap v12902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:05:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:10 smithi077 ceph-mon[27902]: pgmap v12902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:05:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:10 smithi191 ceph-mon[31636]: pgmap v12902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:05:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:12 smithi077 ceph-mon[27902]: pgmap v12903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:05:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:12 smithi077 ceph-mon[27902]: osdmap e879: 12 total, 12 up, 12 in 2024-04-21T17:05:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24023.781857 secs 2024-04-21T17:05:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:12 smithi191 ceph-mon[31636]: pgmap v12903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:05:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:12 smithi191 ceph-mon[31636]: osdmap e879: 12 total, 12 up, 12 in 2024-04-21T17:05:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24023.781857 secs 2024-04-21T17:05:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:12 smithi170 ceph-mon[31212]: pgmap v12903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:05:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:12 smithi170 ceph-mon[31212]: osdmap e879: 12 total, 12 up, 12 in 2024-04-21T17:05:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24023.781857 secs 2024-04-21T17:05:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:14 smithi077 ceph-mon[27902]: pgmap v12905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:05:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24025.542802 secs 2024-04-21T17:05:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:05:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:14 smithi191 ceph-mon[31636]: pgmap v12905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:05:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24025.542802 secs 2024-04-21T17:05:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:05:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:14 smithi170 ceph-mon[31212]: pgmap v12905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:05:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24025.542802 secs 2024-04-21T17:05:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:05:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:05:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:05:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:05:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:05:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:05:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:05:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:05:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:05:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:05:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:16 smithi077 ceph-mon[27902]: pgmap v12906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:05:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:16 smithi191 ceph-mon[31636]: pgmap v12906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:05:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:16 smithi170 ceph-mon[31212]: pgmap v12906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:05:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24028.781968 secs 2024-04-21T17:05:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24028.781968 secs 2024-04-21T17:05:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24028.781968 secs 2024-04-21T17:05:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:18 smithi077 ceph-mon[27902]: pgmap v12907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:05:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:18 smithi191 ceph-mon[31636]: pgmap v12907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:05:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:18 smithi170 ceph-mon[31212]: pgmap v12907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:05:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24030.542898 secs 2024-04-21T17:05:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24030.542898 secs 2024-04-21T17:05:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24030.542898 secs 2024-04-21T17:05:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:20 smithi191 ceph-mon[31636]: pgmap v12908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:05:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:20 smithi170 ceph-mon[31212]: pgmap v12908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:05:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:20 smithi077 ceph-mon[27902]: pgmap v12908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:05:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:22 smithi191 ceph-mon[31636]: pgmap v12909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:05:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24033.782084 secs 2024-04-21T17:05:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:22 smithi170 ceph-mon[31212]: pgmap v12909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:05:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24033.782084 secs 2024-04-21T17:05:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:22 smithi077 ceph-mon[27902]: pgmap v12909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:05:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24033.782084 secs 2024-04-21T17:05:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:24 smithi191 ceph-mon[31636]: pgmap v12910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:05:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24035.542986 secs 2024-04-21T17:05:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:24 smithi170 ceph-mon[31212]: pgmap v12910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:05:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24035.542986 secs 2024-04-21T17:05:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:24 smithi077 ceph-mon[27902]: pgmap v12910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:05:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24035.542986 secs 2024-04-21T17:05:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:26 smithi191 ceph-mon[31636]: pgmap v12911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:26 smithi170 ceph-mon[31212]: pgmap v12911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:26 smithi077 ceph-mon[27902]: pgmap v12911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24038.782202 secs 2024-04-21T17:05:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24038.782202 secs 2024-04-21T17:05:28.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24038.782202 secs 2024-04-21T17:05:28.961 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:28 smithi170 ceph-mon[31212]: pgmap v12912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:28 smithi191 ceph-mon[31636]: pgmap v12912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:28 smithi077 ceph-mon[27902]: pgmap v12912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24040.543105 secs 2024-04-21T17:05:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24040.543105 secs 2024-04-21T17:05:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24040.543105 secs 2024-04-21T17:05:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:30 smithi191 ceph-mon[31636]: pgmap v12913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:30 smithi170 ceph-mon[31212]: pgmap v12913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:30 smithi077 ceph-mon[27902]: pgmap v12913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:32 smithi191 ceph-mon[31636]: pgmap v12914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24043.782278 secs 2024-04-21T17:05:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:32 smithi170 ceph-mon[31212]: pgmap v12914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24043.782278 secs 2024-04-21T17:05:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:32 smithi077 ceph-mon[27902]: pgmap v12914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24043.782278 secs 2024-04-21T17:05:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:34 smithi191 ceph-mon[31636]: pgmap v12915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24045.543178 secs 2024-04-21T17:05:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:34 smithi170 ceph-mon[31212]: pgmap v12915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24045.543178 secs 2024-04-21T17:05:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:34 smithi077 ceph-mon[27902]: pgmap v12915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24045.543178 secs 2024-04-21T17:05:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:36 smithi191 ceph-mon[31636]: pgmap v12916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:36 smithi170 ceph-mon[31212]: pgmap v12916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:36 smithi077 ceph-mon[27902]: pgmap v12916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24048.782396 secs 2024-04-21T17:05:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24048.782396 secs 2024-04-21T17:05:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24048.782396 secs 2024-04-21T17:05:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:38 smithi191 ceph-mon[31636]: pgmap v12917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:38 smithi170 ceph-mon[31212]: pgmap v12917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:38 smithi077 ceph-mon[27902]: pgmap v12917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24050.543298 secs 2024-04-21T17:05:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24050.543298 secs 2024-04-21T17:05:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24050.543298 secs 2024-04-21T17:05:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:40 smithi191 ceph-mon[31636]: pgmap v12918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:40 smithi170 ceph-mon[31212]: pgmap v12918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:40 smithi077 ceph-mon[27902]: pgmap v12918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:42 smithi191 ceph-mon[31636]: pgmap v12919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24053.782518 secs 2024-04-21T17:05:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:42 smithi170 ceph-mon[31212]: pgmap v12919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24053.782518 secs 2024-04-21T17:05:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:42 smithi077 ceph-mon[27902]: pgmap v12919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24053.782518 secs 2024-04-21T17:05:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:44 smithi191 ceph-mon[31636]: pgmap v12920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24055.543372 secs 2024-04-21T17:05:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:44 smithi170 ceph-mon[31212]: pgmap v12920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24055.543372 secs 2024-04-21T17:05:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:44 smithi077 ceph-mon[27902]: pgmap v12920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24055.543372 secs 2024-04-21T17:05:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:46 smithi191 ceph-mon[31636]: pgmap v12921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:46 smithi170 ceph-mon[31212]: pgmap v12921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:46 smithi077 ceph-mon[27902]: pgmap v12921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24058.782635 secs 2024-04-21T17:05:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24058.782635 secs 2024-04-21T17:05:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24058.782635 secs 2024-04-21T17:05:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:48 smithi191 ceph-mon[31636]: pgmap v12922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:48 smithi170 ceph-mon[31212]: pgmap v12922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:48 smithi077 ceph-mon[27902]: pgmap v12922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24060.543488 secs 2024-04-21T17:05:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24060.543488 secs 2024-04-21T17:05:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24060.543488 secs 2024-04-21T17:05:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:50 smithi191 ceph-mon[31636]: pgmap v12923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:50 smithi170 ceph-mon[31212]: pgmap v12923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:50 smithi077 ceph-mon[27902]: pgmap v12923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:52 smithi170 ceph-mon[31212]: pgmap v12924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24063.782755 secs 2024-04-21T17:05:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:52 smithi077 ceph-mon[27902]: pgmap v12924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24063.782755 secs 2024-04-21T17:05:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:52 smithi191 ceph-mon[31636]: pgmap v12924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24063.782755 secs 2024-04-21T17:05:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:54 smithi170 ceph-mon[31212]: pgmap v12925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24065.543607 secs 2024-04-21T17:05:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:05:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:54 smithi077 ceph-mon[27902]: pgmap v12925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24065.543607 secs 2024-04-21T17:05:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:54 smithi191 ceph-mon[31636]: pgmap v12925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24065.543607 secs 2024-04-21T17:05:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:56 smithi170 ceph-mon[31212]: pgmap v12926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:56 smithi077 ceph-mon[27902]: pgmap v12926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:56 smithi191 ceph-mon[31636]: pgmap v12926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:05:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24068.782872 secs 2024-04-21T17:05:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24068.782872 secs 2024-04-21T17:05:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24068.782872 secs 2024-04-21T17:05:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:58 smithi170 ceph-mon[31212]: pgmap v12927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:58 smithi077 ceph-mon[27902]: pgmap v12927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:05:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:58 smithi191 ceph-mon[31636]: pgmap v12927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:05:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24070.543726 secs 2024-04-21T17:06:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:05:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24070.543726 secs 2024-04-21T17:06:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:05:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24070.543726 secs 2024-04-21T17:06:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:00 smithi170 ceph-mon[31212]: pgmap v12928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:00 smithi077 ceph-mon[27902]: pgmap v12928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:00 smithi191 ceph-mon[31636]: pgmap v12928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:02 smithi170 ceph-mon[31212]: pgmap v12929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24073.782999 secs 2024-04-21T17:06:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:02 smithi077 ceph-mon[27902]: pgmap v12929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24073.782999 secs 2024-04-21T17:06:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:02 smithi191 ceph-mon[31636]: pgmap v12929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24073.782999 secs 2024-04-21T17:06:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:04 smithi170 ceph-mon[31212]: pgmap v12930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24075.543839 secs 2024-04-21T17:06:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:04 smithi170 ceph-mon[31212]: osdmap e880: 12 total, 12 up, 12 in 2024-04-21T17:06:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:04 smithi077 ceph-mon[27902]: pgmap v12930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24075.543839 secs 2024-04-21T17:06:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:04 smithi077 ceph-mon[27902]: osdmap e880: 12 total, 12 up, 12 in 2024-04-21T17:06:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:04 smithi191 ceph-mon[31636]: pgmap v12930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24075.543839 secs 2024-04-21T17:06:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:04 smithi191 ceph-mon[31636]: osdmap e880: 12 total, 12 up, 12 in 2024-04-21T17:06:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:06 smithi170 ceph-mon[31212]: pgmap v12932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:06:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:06 smithi077 ceph-mon[27902]: pgmap v12932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:06:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:06 smithi191 ceph-mon[31636]: pgmap v12932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:06:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24078.783099 secs 2024-04-21T17:06:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24078.783099 secs 2024-04-21T17:06:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24078.783099 secs 2024-04-21T17:06:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:08 smithi170 ceph-mon[31212]: pgmap v12933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:06:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:08 smithi077 ceph-mon[27902]: pgmap v12933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:06:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:08 smithi191 ceph-mon[31636]: pgmap v12933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:06:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24080.543956 secs 2024-04-21T17:06:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24080.543956 secs 2024-04-21T17:06:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24080.543956 secs 2024-04-21T17:06:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:10 smithi170 ceph-mon[31212]: pgmap v12934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:06:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:10 smithi077 ceph-mon[27902]: pgmap v12934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:06:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:10 smithi191 ceph-mon[31636]: pgmap v12934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:06:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:12 smithi077 ceph-mon[27902]: pgmap v12935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:06:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:12 smithi077 ceph-mon[27902]: osdmap e881: 12 total, 12 up, 12 in 2024-04-21T17:06:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24083.783206 secs 2024-04-21T17:06:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:12 smithi191 ceph-mon[31636]: pgmap v12935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:06:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:12 smithi191 ceph-mon[31636]: osdmap e881: 12 total, 12 up, 12 in 2024-04-21T17:06:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24083.783206 secs 2024-04-21T17:06:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:12 smithi170 ceph-mon[31212]: pgmap v12935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:06:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:12 smithi170 ceph-mon[31212]: osdmap e881: 12 total, 12 up, 12 in 2024-04-21T17:06:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24083.783206 secs 2024-04-21T17:06:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:14 smithi077 ceph-mon[27902]: pgmap v12937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:06:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24085.544090 secs 2024-04-21T17:06:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:14 smithi191 ceph-mon[31636]: pgmap v12937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:06:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24085.544090 secs 2024-04-21T17:06:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:14 smithi170 ceph-mon[31212]: pgmap v12937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:06:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24085.544090 secs 2024-04-21T17:06:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:06:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:06:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:06:15.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:06:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:06:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:06:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:06:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:06:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:06:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:06:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:06:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:06:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:16 smithi077 ceph-mon[27902]: pgmap v12938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:06:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:16 smithi191 ceph-mon[31636]: pgmap v12938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:06:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:16 smithi170 ceph-mon[31212]: pgmap v12938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:06:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24088.783306 secs 2024-04-21T17:06:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24088.783306 secs 2024-04-21T17:06:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24088.783306 secs 2024-04-21T17:06:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:18 smithi191 ceph-mon[31636]: pgmap v12939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:06:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:18 smithi170 ceph-mon[31212]: pgmap v12939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:06:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:18 smithi077 ceph-mon[27902]: pgmap v12939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:06:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24090.544199 secs 2024-04-21T17:06:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24090.544199 secs 2024-04-21T17:06:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24090.544199 secs 2024-04-21T17:06:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:20 smithi191 ceph-mon[31636]: pgmap v12940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:06:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:20 smithi170 ceph-mon[31212]: pgmap v12940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:06:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:20 smithi077 ceph-mon[27902]: pgmap v12940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:06:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:22 smithi191 ceph-mon[31636]: pgmap v12941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:06:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24093.783423 secs 2024-04-21T17:06:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:22 smithi170 ceph-mon[31212]: pgmap v12941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:06:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24093.783423 secs 2024-04-21T17:06:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:22 smithi077 ceph-mon[27902]: pgmap v12941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:06:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24093.783423 secs 2024-04-21T17:06:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:24 smithi191 ceph-mon[31636]: pgmap v12942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:06:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24095.544313 secs 2024-04-21T17:06:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:24 smithi170 ceph-mon[31212]: pgmap v12942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:06:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24095.544313 secs 2024-04-21T17:06:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:24 smithi077 ceph-mon[27902]: pgmap v12942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:06:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24095.544313 secs 2024-04-21T17:06:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:26 smithi191 ceph-mon[31636]: pgmap v12943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:06:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:26 smithi170 ceph-mon[31212]: pgmap v12943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:06:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:26 smithi077 ceph-mon[27902]: pgmap v12943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:06:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24098.783548 secs 2024-04-21T17:06:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24098.783548 secs 2024-04-21T17:06:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24098.783548 secs 2024-04-21T17:06:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:28 smithi170 ceph-mon[31212]: pgmap v12944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:28 smithi191 ceph-mon[31636]: pgmap v12944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:28 smithi077 ceph-mon[27902]: pgmap v12944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24100.544392 secs 2024-04-21T17:06:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24100.544392 secs 2024-04-21T17:06:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24100.544392 secs 2024-04-21T17:06:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:30 smithi191 ceph-mon[31636]: pgmap v12945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:06:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:30 smithi170 ceph-mon[31212]: pgmap v12945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:06:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:30 smithi077 ceph-mon[27902]: pgmap v12945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:06:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:32 smithi191 ceph-mon[31636]: pgmap v12946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24103.783698 secs 2024-04-21T17:06:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:32 smithi170 ceph-mon[31212]: pgmap v12946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24103.783698 secs 2024-04-21T17:06:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:32 smithi077 ceph-mon[27902]: pgmap v12946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24103.783698 secs 2024-04-21T17:06:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:34 smithi191 ceph-mon[31636]: pgmap v12947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:06:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24105.544497 secs 2024-04-21T17:06:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:34 smithi170 ceph-mon[31212]: pgmap v12947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:06:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24105.544497 secs 2024-04-21T17:06:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:34 smithi077 ceph-mon[27902]: pgmap v12947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:06:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24105.544497 secs 2024-04-21T17:06:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:36 smithi191 ceph-mon[31636]: pgmap v12948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:06:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:36 smithi170 ceph-mon[31212]: pgmap v12948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:06:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:36 smithi077 ceph-mon[27902]: pgmap v12948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:06:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24108.783820 secs 2024-04-21T17:06:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24108.783820 secs 2024-04-21T17:06:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24108.783820 secs 2024-04-21T17:06:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:38 smithi191 ceph-mon[31636]: pgmap v12949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:38 smithi170 ceph-mon[31212]: pgmap v12949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:38 smithi077 ceph-mon[27902]: pgmap v12949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24110.544634 secs 2024-04-21T17:06:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24110.544634 secs 2024-04-21T17:06:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24110.544634 secs 2024-04-21T17:06:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:40 smithi191 ceph-mon[31636]: pgmap v12950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:40 smithi170 ceph-mon[31212]: pgmap v12950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:40 smithi077 ceph-mon[27902]: pgmap v12950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:42 smithi191 ceph-mon[31636]: pgmap v12951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24113.783936 secs 2024-04-21T17:06:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:42 smithi170 ceph-mon[31212]: pgmap v12951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24113.783936 secs 2024-04-21T17:06:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:42 smithi077 ceph-mon[27902]: pgmap v12951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24113.783936 secs 2024-04-21T17:06:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:44 smithi191 ceph-mon[31636]: pgmap v12952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24115.544749 secs 2024-04-21T17:06:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:44 smithi170 ceph-mon[31212]: pgmap v12952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24115.544749 secs 2024-04-21T17:06:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:44 smithi077 ceph-mon[27902]: pgmap v12952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24115.544749 secs 2024-04-21T17:06:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:46 smithi191 ceph-mon[31636]: pgmap v12953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:06:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:46 smithi170 ceph-mon[31212]: pgmap v12953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:06:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:46 smithi077 ceph-mon[27902]: pgmap v12953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:06:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24118.784037 secs 2024-04-21T17:06:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24118.784037 secs 2024-04-21T17:06:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24118.784037 secs 2024-04-21T17:06:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:48 smithi191 ceph-mon[31636]: pgmap v12954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:48 smithi170 ceph-mon[31212]: pgmap v12954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:48 smithi077 ceph-mon[27902]: pgmap v12954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24120.544873 secs 2024-04-21T17:06:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24120.544873 secs 2024-04-21T17:06:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24120.544873 secs 2024-04-21T17:06:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:50 smithi170 ceph-mon[31212]: pgmap v12955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:50 smithi077 ceph-mon[27902]: pgmap v12955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:50 smithi191 ceph-mon[31636]: pgmap v12955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:52 smithi170 ceph-mon[31212]: pgmap v12956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24123.784155 secs 2024-04-21T17:06:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:52 smithi077 ceph-mon[27902]: pgmap v12956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24123.784155 secs 2024-04-21T17:06:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:52 smithi191 ceph-mon[31636]: pgmap v12956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:06:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24123.784155 secs 2024-04-21T17:06:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:54 smithi170 ceph-mon[31212]: pgmap v12957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24125.544936 secs 2024-04-21T17:06:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:06:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:54 smithi077 ceph-mon[27902]: pgmap v12957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24125.544936 secs 2024-04-21T17:06:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:54 smithi191 ceph-mon[31636]: pgmap v12957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:06:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24125.544936 secs 2024-04-21T17:06:57.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:56 smithi170 ceph-mon[31212]: pgmap v12958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:06:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:56 smithi077 ceph-mon[27902]: pgmap v12958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:06:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:56 smithi191 ceph-mon[31636]: pgmap v12958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:06:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24128.784270 secs 2024-04-21T17:06:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24128.784270 secs 2024-04-21T17:06:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24128.784270 secs 2024-04-21T17:06:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:58 smithi170 ceph-mon[31212]: pgmap v12959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:58 smithi077 ceph-mon[27902]: pgmap v12959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:06:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:58 smithi191 ceph-mon[31636]: pgmap v12959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:06:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24130.545003 secs 2024-04-21T17:07:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:06:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24130.545003 secs 2024-04-21T17:07:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:06:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24130.545003 secs 2024-04-21T17:07:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:00 smithi170 ceph-mon[31212]: pgmap v12960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:00 smithi077 ceph-mon[27902]: pgmap v12960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:00 smithi191 ceph-mon[31636]: pgmap v12960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:02 smithi170 ceph-mon[31212]: pgmap v12961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24133.784390 secs 2024-04-21T17:07:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:02 smithi077 ceph-mon[27902]: pgmap v12961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24133.784390 secs 2024-04-21T17:07:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:02 smithi191 ceph-mon[31636]: pgmap v12961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24133.784390 secs 2024-04-21T17:07:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:04 smithi170 ceph-mon[31212]: pgmap v12962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24135.545083 secs 2024-04-21T17:07:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:04 smithi170 ceph-mon[31212]: osdmap e882: 12 total, 12 up, 12 in 2024-04-21T17:07:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:04 smithi077 ceph-mon[27902]: pgmap v12962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24135.545083 secs 2024-04-21T17:07:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:04 smithi077 ceph-mon[27902]: osdmap e882: 12 total, 12 up, 12 in 2024-04-21T17:07:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:04 smithi191 ceph-mon[31636]: pgmap v12962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24135.545083 secs 2024-04-21T17:07:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:04 smithi191 ceph-mon[31636]: osdmap e882: 12 total, 12 up, 12 in 2024-04-21T17:07:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:06 smithi170 ceph-mon[31212]: pgmap v12964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:06 smithi077 ceph-mon[27902]: pgmap v12964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:06 smithi191 ceph-mon[31636]: pgmap v12964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24138.784487 secs 2024-04-21T17:07:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24138.784487 secs 2024-04-21T17:07:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24138.784487 secs 2024-04-21T17:07:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:08 smithi170 ceph-mon[31212]: pgmap v12965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:08 smithi077 ceph-mon[27902]: pgmap v12965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:08 smithi191 ceph-mon[31636]: pgmap v12965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24140.545201 secs 2024-04-21T17:07:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24140.545201 secs 2024-04-21T17:07:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24140.545201 secs 2024-04-21T17:07:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:10 smithi170 ceph-mon[31212]: pgmap v12966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:10 smithi077 ceph-mon[27902]: pgmap v12966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:10 smithi191 ceph-mon[31636]: pgmap v12966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:07:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:12 smithi077 ceph-mon[27902]: pgmap v12967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:07:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:12 smithi077 ceph-mon[27902]: osdmap e883: 12 total, 12 up, 12 in 2024-04-21T17:07:12.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24143.784613 secs 2024-04-21T17:07:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:12 smithi191 ceph-mon[31636]: pgmap v12967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:07:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:12 smithi191 ceph-mon[31636]: osdmap e883: 12 total, 12 up, 12 in 2024-04-21T17:07:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24143.784613 secs 2024-04-21T17:07:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:12 smithi170 ceph-mon[31212]: pgmap v12967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:07:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:12 smithi170 ceph-mon[31212]: osdmap e883: 12 total, 12 up, 12 in 2024-04-21T17:07:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24143.784613 secs 2024-04-21T17:07:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:14 smithi077 ceph-mon[27902]: pgmap v12969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:07:14.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24145.545318 secs 2024-04-21T17:07:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:14 smithi191 ceph-mon[31636]: pgmap v12969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:07:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24145.545318 secs 2024-04-21T17:07:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:14 smithi170 ceph-mon[31212]: pgmap v12969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:07:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24145.545318 secs 2024-04-21T17:07:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:15.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:07:16.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:07:16.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:07:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:16 smithi191 ceph-mon[31636]: pgmap v12970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:07:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:07:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:07:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:07:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:16 smithi170 ceph-mon[31212]: pgmap v12970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:07:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:07:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:07:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:07:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:16 smithi077 ceph-mon[27902]: pgmap v12970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:07:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:07:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:07:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:07:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24148.784750 secs 2024-04-21T17:07:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24148.784750 secs 2024-04-21T17:07:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24148.784750 secs 2024-04-21T17:07:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:18 smithi191 ceph-mon[31636]: pgmap v12971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:07:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:18 smithi170 ceph-mon[31212]: pgmap v12971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:07:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:18 smithi077 ceph-mon[27902]: pgmap v12971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:07:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24150.545450 secs 2024-04-21T17:07:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24150.545450 secs 2024-04-21T17:07:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24150.545450 secs 2024-04-21T17:07:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:20 smithi191 ceph-mon[31636]: pgmap v12972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:07:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:20 smithi170 ceph-mon[31212]: pgmap v12972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:07:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:20 smithi077 ceph-mon[27902]: pgmap v12972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:07:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:22 smithi191 ceph-mon[31636]: pgmap v12973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:07:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24153.784864 secs 2024-04-21T17:07:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:22 smithi170 ceph-mon[31212]: pgmap v12973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:07:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24153.784864 secs 2024-04-21T17:07:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:22 smithi077 ceph-mon[27902]: pgmap v12973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:07:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24153.784864 secs 2024-04-21T17:07:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:24 smithi191 ceph-mon[31636]: pgmap v12974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:07:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24155.545567 secs 2024-04-21T17:07:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:24 smithi170 ceph-mon[31212]: pgmap v12974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:07:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24155.545567 secs 2024-04-21T17:07:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:24 smithi077 ceph-mon[27902]: pgmap v12974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:07:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24155.545567 secs 2024-04-21T17:07:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:26 smithi191 ceph-mon[31636]: pgmap v12975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:26 smithi170 ceph-mon[31212]: pgmap v12975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:26 smithi077 ceph-mon[27902]: pgmap v12975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24158.785001 secs 2024-04-21T17:07:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24158.785001 secs 2024-04-21T17:07:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24158.785001 secs 2024-04-21T17:07:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:28 smithi170 ceph-mon[31212]: pgmap v12976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:28 smithi191 ceph-mon[31636]: pgmap v12976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:28 smithi077 ceph-mon[27902]: pgmap v12976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24160.545643 secs 2024-04-21T17:07:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24160.545643 secs 2024-04-21T17:07:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24160.545643 secs 2024-04-21T17:07:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:30 smithi191 ceph-mon[31636]: pgmap v12977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:30 smithi170 ceph-mon[31212]: pgmap v12977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:30 smithi077 ceph-mon[27902]: pgmap v12977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:32 smithi191 ceph-mon[31636]: pgmap v12978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24163.785102 secs 2024-04-21T17:07:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:32 smithi170 ceph-mon[31212]: pgmap v12978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24163.785102 secs 2024-04-21T17:07:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:32 smithi077 ceph-mon[27902]: pgmap v12978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24163.785102 secs 2024-04-21T17:07:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:34 smithi191 ceph-mon[31636]: pgmap v12979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24165.545705 secs 2024-04-21T17:07:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:34 smithi170 ceph-mon[31212]: pgmap v12979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24165.545705 secs 2024-04-21T17:07:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:34 smithi077 ceph-mon[27902]: pgmap v12979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24165.545705 secs 2024-04-21T17:07:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:36 smithi191 ceph-mon[31636]: pgmap v12980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:36 smithi170 ceph-mon[31212]: pgmap v12980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:36 smithi077 ceph-mon[27902]: pgmap v12980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24168.785224 secs 2024-04-21T17:07:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24168.785224 secs 2024-04-21T17:07:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24168.785224 secs 2024-04-21T17:07:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:38 smithi191 ceph-mon[31636]: pgmap v12981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:38 smithi170 ceph-mon[31212]: pgmap v12981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:38 smithi077 ceph-mon[27902]: pgmap v12981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:07:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24170.545822 secs 2024-04-21T17:07:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24170.545822 secs 2024-04-21T17:07:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24170.545822 secs 2024-04-21T17:07:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:40 smithi191 ceph-mon[31636]: pgmap v12982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:40 smithi170 ceph-mon[31212]: pgmap v12982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:40 smithi077 ceph-mon[27902]: pgmap v12982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:42 smithi191 ceph-mon[31636]: pgmap v12983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24173.785294 secs 2024-04-21T17:07:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:42 smithi170 ceph-mon[31212]: pgmap v12983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24173.785294 secs 2024-04-21T17:07:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:42 smithi077 ceph-mon[27902]: pgmap v12983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24173.785294 secs 2024-04-21T17:07:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:44 smithi191 ceph-mon[31636]: pgmap v12984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24175.545951 secs 2024-04-21T17:07:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:44 smithi170 ceph-mon[31212]: pgmap v12984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24175.545951 secs 2024-04-21T17:07:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:44 smithi077 ceph-mon[27902]: pgmap v12984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:07:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24175.545951 secs 2024-04-21T17:07:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:46 smithi170 ceph-mon[31212]: pgmap v12985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:46 smithi077 ceph-mon[27902]: pgmap v12985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:46 smithi191 ceph-mon[31636]: pgmap v12985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:07:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24178.785430 secs 2024-04-21T17:07:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24178.785430 secs 2024-04-21T17:07:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24178.785430 secs 2024-04-21T17:07:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:48 smithi170 ceph-mon[31212]: pgmap v12986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T17:07:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:48 smithi077 ceph-mon[27902]: pgmap v12986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T17:07:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:48 smithi191 ceph-mon[31636]: pgmap v12986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T17:07:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24180.546067 secs 2024-04-21T17:07:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24180.546067 secs 2024-04-21T17:07:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24180.546067 secs 2024-04-21T17:07:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:50 smithi170 ceph-mon[31212]: pgmap v12987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:07:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:50 smithi077 ceph-mon[27902]: pgmap v12987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:07:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:50 smithi191 ceph-mon[31636]: pgmap v12987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:07:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:52 smithi170 ceph-mon[31212]: pgmap v12988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24183.785571 secs 2024-04-21T17:07:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:52 smithi077 ceph-mon[27902]: pgmap v12988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24183.785571 secs 2024-04-21T17:07:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:52 smithi191 ceph-mon[31636]: pgmap v12988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:07:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24183.785571 secs 2024-04-21T17:07:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:54 smithi170 ceph-mon[31212]: pgmap v12989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:07:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24185.546176 secs 2024-04-21T17:07:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:07:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:54 smithi077 ceph-mon[27902]: pgmap v12989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:07:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24185.546176 secs 2024-04-21T17:07:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:54 smithi191 ceph-mon[31636]: pgmap v12989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:07:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24185.546176 secs 2024-04-21T17:07:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:56 smithi170 ceph-mon[31212]: pgmap v12990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:07:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:56 smithi077 ceph-mon[27902]: pgmap v12990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:07:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:56 smithi191 ceph-mon[31636]: pgmap v12990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-21T17:07:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:07:57.696+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:07:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:07:57.696+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:07:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:07:57.696+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:07:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:07:57.696+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:07:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24188.785690 secs 2024-04-21T17:07:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24188.785690 secs 2024-04-21T17:07:58.149 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24188.785690 secs 2024-04-21T17:07:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:58 smithi170 ceph-mon[31212]: pgmap v12991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T17:07:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:58 smithi077 ceph-mon[27902]: pgmap v12991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T17:07:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:58 smithi191 ceph-mon[31636]: pgmap v12991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-21T17:08:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24190.546258 secs 2024-04-21T17:08:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24190.546258 secs 2024-04-21T17:08:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24190.546258 secs 2024-04-21T17:08:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:00 smithi170 ceph-mon[31212]: pgmap v12992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:00 smithi077 ceph-mon[27902]: pgmap v12992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:00 smithi191 ceph-mon[31636]: pgmap v12992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:02 smithi170 ceph-mon[31212]: pgmap v12993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24193.785810 secs 2024-04-21T17:08:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:02 smithi077 ceph-mon[27902]: pgmap v12993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24193.785810 secs 2024-04-21T17:08:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:02 smithi191 ceph-mon[31636]: pgmap v12993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24193.785810 secs 2024-04-21T17:08:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:04 smithi170 ceph-mon[31212]: pgmap v12994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24195.546379 secs 2024-04-21T17:08:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:04 smithi170 ceph-mon[31212]: osdmap e884: 12 total, 12 up, 12 in 2024-04-21T17:08:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:04 smithi077 ceph-mon[27902]: pgmap v12994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24195.546379 secs 2024-04-21T17:08:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:04 smithi077 ceph-mon[27902]: osdmap e884: 12 total, 12 up, 12 in 2024-04-21T17:08:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:04 smithi191 ceph-mon[31636]: pgmap v12994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24195.546379 secs 2024-04-21T17:08:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:04 smithi191 ceph-mon[31636]: osdmap e884: 12 total, 12 up, 12 in 2024-04-21T17:08:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:06 smithi170 ceph-mon[31212]: pgmap v12996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:08:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:06 smithi077 ceph-mon[27902]: pgmap v12996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:08:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:06 smithi191 ceph-mon[31636]: pgmap v12996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:08:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24198.785904 secs 2024-04-21T17:08:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24198.785904 secs 2024-04-21T17:08:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24198.785904 secs 2024-04-21T17:08:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:08 smithi170 ceph-mon[31212]: pgmap v12997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:08 smithi077 ceph-mon[27902]: pgmap v12997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:08 smithi191 ceph-mon[31636]: pgmap v12997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24200.546454 secs 2024-04-21T17:08:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24200.546454 secs 2024-04-21T17:08:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24200.546454 secs 2024-04-21T17:08:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:10 smithi170 ceph-mon[31212]: pgmap v12998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:10 smithi077 ceph-mon[27902]: pgmap v12998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:10 smithi191 ceph-mon[31636]: pgmap v12998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:12 smithi191 ceph-mon[31636]: pgmap v12999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:12 smithi191 ceph-mon[31636]: osdmap e885: 12 total, 12 up, 12 in 2024-04-21T17:08:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24203.786025 secs 2024-04-21T17:08:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:12 smithi170 ceph-mon[31212]: pgmap v12999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:12 smithi170 ceph-mon[31212]: osdmap e885: 12 total, 12 up, 12 in 2024-04-21T17:08:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24203.786025 secs 2024-04-21T17:08:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:12 smithi077 ceph-mon[27902]: pgmap v12999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:08:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:12 smithi077 ceph-mon[27902]: osdmap e885: 12 total, 12 up, 12 in 2024-04-21T17:08:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24203.786025 secs 2024-04-21T17:08:14.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:14 smithi077 ceph-mon[27902]: pgmap v13001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T17:08:14.939 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24205.546569 secs 2024-04-21T17:08:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:14 smithi191 ceph-mon[31636]: pgmap v13001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T17:08:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24205.546569 secs 2024-04-21T17:08:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:14 smithi170 ceph-mon[31212]: pgmap v13001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T17:08:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24205.546569 secs 2024-04-21T17:08:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:16 smithi191 ceph-mon[31636]: pgmap v13002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:08:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:08:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:16 smithi170 ceph-mon[31212]: pgmap v13002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:08:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:08:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:16 smithi077 ceph-mon[27902]: pgmap v13002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:08:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:08:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24208.786089 secs 2024-04-21T17:08:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:08:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:08:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:08:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24208.786089 secs 2024-04-21T17:08:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:08:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:08:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:08:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24208.786089 secs 2024-04-21T17:08:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:08:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:08:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:08:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:18 smithi191 ceph-mon[31636]: pgmap v13003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:08:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:18 smithi170 ceph-mon[31212]: pgmap v13003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:08:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:18 smithi077 ceph-mon[27902]: pgmap v13003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:08:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24210.546695 secs 2024-04-21T17:08:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24210.546695 secs 2024-04-21T17:08:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24210.546695 secs 2024-04-21T17:08:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:20 smithi191 ceph-mon[31636]: pgmap v13004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:08:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:20 smithi170 ceph-mon[31212]: pgmap v13004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:08:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:20 smithi077 ceph-mon[27902]: pgmap v13004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:08:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:22 smithi191 ceph-mon[31636]: pgmap v13005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:08:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24213.786162 secs 2024-04-21T17:08:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:22 smithi170 ceph-mon[31212]: pgmap v13005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:08:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24213.786162 secs 2024-04-21T17:08:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:22 smithi077 ceph-mon[27902]: pgmap v13005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:08:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24213.786162 secs 2024-04-21T17:08:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:24 smithi191 ceph-mon[31636]: pgmap v13006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:08:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24215.546816 secs 2024-04-21T17:08:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:24 smithi170 ceph-mon[31212]: pgmap v13006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:08:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24215.546816 secs 2024-04-21T17:08:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:24 smithi077 ceph-mon[27902]: pgmap v13006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:08:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24215.546816 secs 2024-04-21T17:08:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:26 smithi191 ceph-mon[31636]: pgmap v13007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:26 smithi170 ceph-mon[31212]: pgmap v13007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:26 smithi077 ceph-mon[27902]: pgmap v13007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24218.786285 secs 2024-04-21T17:08:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24218.786285 secs 2024-04-21T17:08:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24218.786285 secs 2024-04-21T17:08:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:28 smithi170 ceph-mon[31212]: pgmap v13008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:28 smithi191 ceph-mon[31636]: pgmap v13008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:28 smithi077 ceph-mon[27902]: pgmap v13008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24220.546876 secs 2024-04-21T17:08:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24220.546876 secs 2024-04-21T17:08:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24220.546876 secs 2024-04-21T17:08:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:30 smithi191 ceph-mon[31636]: pgmap v13009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:30 smithi170 ceph-mon[31212]: pgmap v13009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:30 smithi077 ceph-mon[27902]: pgmap v13009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:32 smithi191 ceph-mon[31636]: pgmap v13010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24223.786435 secs 2024-04-21T17:08:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:32 smithi170 ceph-mon[31212]: pgmap v13010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24223.786435 secs 2024-04-21T17:08:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:32 smithi077 ceph-mon[27902]: pgmap v13010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24223.786435 secs 2024-04-21T17:08:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:34 smithi191 ceph-mon[31636]: pgmap v13011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24225.546991 secs 2024-04-21T17:08:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:34 smithi170 ceph-mon[31212]: pgmap v13011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24225.546991 secs 2024-04-21T17:08:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:34 smithi077 ceph-mon[27902]: pgmap v13011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24225.546991 secs 2024-04-21T17:08:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:36 smithi191 ceph-mon[31636]: pgmap v13012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:36 smithi170 ceph-mon[31212]: pgmap v13012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:36 smithi077 ceph-mon[27902]: pgmap v13012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24228.786590 secs 2024-04-21T17:08:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24228.786590 secs 2024-04-21T17:08:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24228.786590 secs 2024-04-21T17:08:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:38 smithi191 ceph-mon[31636]: pgmap v13013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:38 smithi170 ceph-mon[31212]: pgmap v13013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:38 smithi077 ceph-mon[27902]: pgmap v13013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24230.547100 secs 2024-04-21T17:08:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24230.547100 secs 2024-04-21T17:08:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24230.547100 secs 2024-04-21T17:08:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:40 smithi191 ceph-mon[31636]: pgmap v13014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:40 smithi170 ceph-mon[31212]: pgmap v13014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:40 smithi077 ceph-mon[27902]: pgmap v13014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:42 smithi191 ceph-mon[31636]: pgmap v13015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24233.786710 secs 2024-04-21T17:08:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:42 smithi170 ceph-mon[31212]: pgmap v13015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24233.786710 secs 2024-04-21T17:08:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:42 smithi077 ceph-mon[27902]: pgmap v13015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24233.786710 secs 2024-04-21T17:08:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:44 smithi191 ceph-mon[31636]: pgmap v13016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24235.547213 secs 2024-04-21T17:08:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:44 smithi170 ceph-mon[31212]: pgmap v13016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24235.547213 secs 2024-04-21T17:08:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:44 smithi077 ceph-mon[27902]: pgmap v13016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24235.547213 secs 2024-04-21T17:08:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:46 smithi191 ceph-mon[31636]: pgmap v13017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:46 smithi170 ceph-mon[31212]: pgmap v13017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:46 smithi077 ceph-mon[27902]: pgmap v13017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24238.786828 secs 2024-04-21T17:08:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24238.786828 secs 2024-04-21T17:08:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24238.786828 secs 2024-04-21T17:08:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:48 smithi170 ceph-mon[31212]: pgmap v13018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:48 smithi077 ceph-mon[27902]: pgmap v13018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:48 smithi191 ceph-mon[31636]: pgmap v13018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24240.547315 secs 2024-04-21T17:08:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24240.547315 secs 2024-04-21T17:08:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24240.547315 secs 2024-04-21T17:08:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:50 smithi170 ceph-mon[31212]: pgmap v13019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:50 smithi077 ceph-mon[27902]: pgmap v13019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:50 smithi191 ceph-mon[31636]: pgmap v13019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:52 smithi170 ceph-mon[31212]: pgmap v13020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24243.786922 secs 2024-04-21T17:08:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:52 smithi077 ceph-mon[27902]: pgmap v13020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24243.786922 secs 2024-04-21T17:08:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:52 smithi191 ceph-mon[31636]: pgmap v13020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:08:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24243.786922 secs 2024-04-21T17:08:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:54 smithi170 ceph-mon[31212]: pgmap v13021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24245.547412 secs 2024-04-21T17:08:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:08:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:54 smithi077 ceph-mon[27902]: pgmap v13021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24245.547412 secs 2024-04-21T17:08:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:54 smithi191 ceph-mon[31636]: pgmap v13021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:08:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24245.547412 secs 2024-04-21T17:08:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:56 smithi170 ceph-mon[31212]: pgmap v13022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:56 smithi077 ceph-mon[27902]: pgmap v13022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:56 smithi191 ceph-mon[31636]: pgmap v13022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:08:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24248.787044 secs 2024-04-21T17:08:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24248.787044 secs 2024-04-21T17:08:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24248.787044 secs 2024-04-21T17:08:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:58 smithi170 ceph-mon[31212]: pgmap v13023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:58 smithi077 ceph-mon[27902]: pgmap v13023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:08:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:58 smithi191 ceph-mon[31636]: pgmap v13023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24250.547552 secs 2024-04-21T17:09:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24250.547552 secs 2024-04-21T17:09:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24250.547552 secs 2024-04-21T17:09:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:00 smithi170 ceph-mon[31212]: pgmap v13024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:00 smithi077 ceph-mon[27902]: pgmap v13024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:00 smithi191 ceph-mon[31636]: pgmap v13024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:02 smithi170 ceph-mon[31212]: pgmap v13025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24253.787167 secs 2024-04-21T17:09:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:02 smithi077 ceph-mon[27902]: pgmap v13025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24253.787167 secs 2024-04-21T17:09:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:02 smithi191 ceph-mon[31636]: pgmap v13025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24253.787167 secs 2024-04-21T17:09:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:04 smithi170 ceph-mon[31212]: pgmap v13026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24255.547685 secs 2024-04-21T17:09:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:04 smithi170 ceph-mon[31212]: osdmap e886: 12 total, 12 up, 12 in 2024-04-21T17:09:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:04 smithi077 ceph-mon[27902]: pgmap v13026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24255.547685 secs 2024-04-21T17:09:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:04 smithi077 ceph-mon[27902]: osdmap e886: 12 total, 12 up, 12 in 2024-04-21T17:09:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:04 smithi191 ceph-mon[31636]: pgmap v13026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24255.547685 secs 2024-04-21T17:09:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:04 smithi191 ceph-mon[31636]: osdmap e886: 12 total, 12 up, 12 in 2024-04-21T17:09:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:06 smithi170 ceph-mon[31212]: pgmap v13028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:06 smithi077 ceph-mon[27902]: pgmap v13028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:06 smithi191 ceph-mon[31636]: pgmap v13028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24258.787287 secs 2024-04-21T17:09:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24258.787287 secs 2024-04-21T17:09:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24258.787287 secs 2024-04-21T17:09:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:08 smithi170 ceph-mon[31212]: pgmap v13029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:08 smithi077 ceph-mon[27902]: pgmap v13029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:08 smithi191 ceph-mon[31636]: pgmap v13029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24260.547826 secs 2024-04-21T17:09:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24260.547826 secs 2024-04-21T17:09:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24260.547826 secs 2024-04-21T17:09:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:10 smithi170 ceph-mon[31212]: pgmap v13030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:10 smithi077 ceph-mon[27902]: pgmap v13030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:10 smithi191 ceph-mon[31636]: pgmap v13030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:09:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:12 smithi191 ceph-mon[31636]: pgmap v13031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:09:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:12 smithi191 ceph-mon[31636]: osdmap e887: 12 total, 12 up, 12 in 2024-04-21T17:09:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24263.787373 secs 2024-04-21T17:09:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:12 smithi170 ceph-mon[31212]: pgmap v13031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:09:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:12 smithi170 ceph-mon[31212]: osdmap e887: 12 total, 12 up, 12 in 2024-04-21T17:09:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24263.787373 secs 2024-04-21T17:09:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:12 smithi077 ceph-mon[27902]: pgmap v13031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:09:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:12 smithi077 ceph-mon[27902]: osdmap e887: 12 total, 12 up, 12 in 2024-04-21T17:09:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24263.787373 secs 2024-04-21T17:09:14.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:14 smithi077 ceph-mon[27902]: pgmap v13033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:09:14.939 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24265.547928 secs 2024-04-21T17:09:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:14 smithi191 ceph-mon[31636]: pgmap v13033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:09:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24265.547928 secs 2024-04-21T17:09:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:14 smithi170 ceph-mon[31212]: pgmap v13033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:09:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24265.547928 secs 2024-04-21T17:09:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:16 smithi191 ceph-mon[31636]: pgmap v13034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:09:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:16 smithi170 ceph-mon[31212]: pgmap v13034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:09:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:16 smithi077 ceph-mon[27902]: pgmap v13034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-21T17:09:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24268.787514 secs 2024-04-21T17:09:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:09:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24268.787514 secs 2024-04-21T17:09:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:09:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24268.787514 secs 2024-04-21T17:09:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:09:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:18 smithi191 ceph-mon[31636]: pgmap v13035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:09:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:09:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:09:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:09:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:18 smithi170 ceph-mon[31212]: pgmap v13035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:09:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:09:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:09:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:09:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:18 smithi077 ceph-mon[27902]: pgmap v13035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:09:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:09:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:09:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:09:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24270.548009 secs 2024-04-21T17:09:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24270.548009 secs 2024-04-21T17:09:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24270.548009 secs 2024-04-21T17:09:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:20 smithi191 ceph-mon[31636]: pgmap v13036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:09:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:20 smithi170 ceph-mon[31212]: pgmap v13036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:09:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:20 smithi077 ceph-mon[27902]: pgmap v13036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:09:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:22 smithi191 ceph-mon[31636]: pgmap v13037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:09:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24273.787628 secs 2024-04-21T17:09:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:22 smithi170 ceph-mon[31212]: pgmap v13037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:09:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24273.787628 secs 2024-04-21T17:09:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:22 smithi077 ceph-mon[27902]: pgmap v13037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:09:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24273.787628 secs 2024-04-21T17:09:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:24 smithi191 ceph-mon[31636]: pgmap v13038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:09:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24275.548110 secs 2024-04-21T17:09:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:24 smithi170 ceph-mon[31212]: pgmap v13038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:09:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24275.548110 secs 2024-04-21T17:09:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:24 smithi077 ceph-mon[27902]: pgmap v13038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:09:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24275.548110 secs 2024-04-21T17:09:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:26 smithi191 ceph-mon[31636]: pgmap v13039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:26 smithi170 ceph-mon[31212]: pgmap v13039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:26 smithi077 ceph-mon[27902]: pgmap v13039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24278.787752 secs 2024-04-21T17:09:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24278.787752 secs 2024-04-21T17:09:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24278.787752 secs 2024-04-21T17:09:28.958 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:28 smithi170 ceph-mon[31212]: pgmap v13040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:28 smithi191 ceph-mon[31636]: pgmap v13040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:28 smithi077 ceph-mon[27902]: pgmap v13040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24280.548228 secs 2024-04-21T17:09:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24280.548228 secs 2024-04-21T17:09:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24280.548228 secs 2024-04-21T17:09:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:30 smithi191 ceph-mon[31636]: pgmap v13041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:30 smithi170 ceph-mon[31212]: pgmap v13041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:30 smithi077 ceph-mon[27902]: pgmap v13041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:32 smithi191 ceph-mon[31636]: pgmap v13042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24283.787873 secs 2024-04-21T17:09:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:32 smithi170 ceph-mon[31212]: pgmap v13042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24283.787873 secs 2024-04-21T17:09:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:32 smithi077 ceph-mon[27902]: pgmap v13042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24283.787873 secs 2024-04-21T17:09:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:34 smithi191 ceph-mon[31636]: pgmap v13043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24285.548348 secs 2024-04-21T17:09:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:34 smithi170 ceph-mon[31212]: pgmap v13043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24285.548348 secs 2024-04-21T17:09:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:34 smithi077 ceph-mon[27902]: pgmap v13043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24285.548348 secs 2024-04-21T17:09:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:36 smithi191 ceph-mon[31636]: pgmap v13044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:36 smithi170 ceph-mon[31212]: pgmap v13044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:36 smithi077 ceph-mon[27902]: pgmap v13044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24288.787995 secs 2024-04-21T17:09:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24288.787995 secs 2024-04-21T17:09:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24288.787995 secs 2024-04-21T17:09:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:38 smithi191 ceph-mon[31636]: pgmap v13045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:38 smithi170 ceph-mon[31212]: pgmap v13045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:38 smithi077 ceph-mon[27902]: pgmap v13045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24290.548492 secs 2024-04-21T17:09:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24290.548492 secs 2024-04-21T17:09:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24290.548492 secs 2024-04-21T17:09:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:40 smithi170 ceph-mon[31212]: pgmap v13046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:40 smithi077 ceph-mon[27902]: pgmap v13046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:40 smithi191 ceph-mon[31636]: pgmap v13046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:42 smithi170 ceph-mon[31212]: pgmap v13047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24293.788059 secs 2024-04-21T17:09:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:42 smithi077 ceph-mon[27902]: pgmap v13047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24293.788059 secs 2024-04-21T17:09:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:42 smithi191 ceph-mon[31636]: pgmap v13047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24293.788059 secs 2024-04-21T17:09:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:44 smithi170 ceph-mon[31212]: pgmap v13048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24295.548605 secs 2024-04-21T17:09:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:44 smithi077 ceph-mon[27902]: pgmap v13048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24295.548605 secs 2024-04-21T17:09:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:44 smithi191 ceph-mon[31636]: pgmap v13048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24295.548605 secs 2024-04-21T17:09:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:46 smithi170 ceph-mon[31212]: pgmap v13049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:46 smithi077 ceph-mon[27902]: pgmap v13049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:46 smithi191 ceph-mon[31636]: pgmap v13049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24298.788195 secs 2024-04-21T17:09:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24298.788195 secs 2024-04-21T17:09:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24298.788195 secs 2024-04-21T17:09:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:48 smithi170 ceph-mon[31212]: pgmap v13050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:48 smithi077 ceph-mon[27902]: pgmap v13050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:48 smithi191 ceph-mon[31636]: pgmap v13050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24300.548676 secs 2024-04-21T17:09:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24300.548676 secs 2024-04-21T17:09:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24300.548676 secs 2024-04-21T17:09:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:50 smithi170 ceph-mon[31212]: pgmap v13051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:50 smithi077 ceph-mon[27902]: pgmap v13051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:50 smithi191 ceph-mon[31636]: pgmap v13051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:52 smithi170 ceph-mon[31212]: pgmap v13052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24303.788315 secs 2024-04-21T17:09:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:52 smithi077 ceph-mon[27902]: pgmap v13052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24303.788315 secs 2024-04-21T17:09:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:52 smithi191 ceph-mon[31636]: pgmap v13052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:09:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24303.788315 secs 2024-04-21T17:09:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:54 smithi170 ceph-mon[31212]: pgmap v13053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24305.548801 secs 2024-04-21T17:09:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:09:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:54 smithi077 ceph-mon[27902]: pgmap v13053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24305.548801 secs 2024-04-21T17:09:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:54 smithi191 ceph-mon[31636]: pgmap v13053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:09:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24305.548801 secs 2024-04-21T17:09:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:56 smithi170 ceph-mon[31212]: pgmap v13054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:56 smithi077 ceph-mon[27902]: pgmap v13054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:56 smithi191 ceph-mon[31636]: pgmap v13054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:09:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24308.788451 secs 2024-04-21T17:09:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24308.788451 secs 2024-04-21T17:09:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24308.788451 secs 2024-04-21T17:09:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:58 smithi170 ceph-mon[31212]: pgmap v13055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:58 smithi077 ceph-mon[27902]: pgmap v13055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:09:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:58 smithi191 ceph-mon[31636]: pgmap v13055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24310.548896 secs 2024-04-21T17:10:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24310.548896 secs 2024-04-21T17:10:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24310.548896 secs 2024-04-21T17:10:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:00 smithi170 ceph-mon[31212]: pgmap v13056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:10:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:00 smithi077 ceph-mon[27902]: pgmap v13056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:10:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:00 smithi191 ceph-mon[31636]: pgmap v13056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:10:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:02 smithi170 ceph-mon[31212]: pgmap v13057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T17:10:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24313.788568 secs 2024-04-21T17:10:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:02 smithi077 ceph-mon[27902]: pgmap v13057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T17:10:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24313.788568 secs 2024-04-21T17:10:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:02 smithi191 ceph-mon[31636]: pgmap v13057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-21T17:10:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24313.788568 secs 2024-04-21T17:10:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:04 smithi170 ceph-mon[31212]: pgmap v13058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T17:10:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24315.549007 secs 2024-04-21T17:10:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:04 smithi170 ceph-mon[31212]: osdmap e888: 12 total, 12 up, 12 in 2024-04-21T17:10:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:04 smithi077 ceph-mon[27902]: pgmap v13058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T17:10:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24315.549007 secs 2024-04-21T17:10:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:04 smithi077 ceph-mon[27902]: osdmap e888: 12 total, 12 up, 12 in 2024-04-21T17:10:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:04 smithi191 ceph-mon[31636]: pgmap v13058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T17:10:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24315.549007 secs 2024-04-21T17:10:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:04 smithi191 ceph-mon[31636]: osdmap e888: 12 total, 12 up, 12 in 2024-04-21T17:10:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:06 smithi170 ceph-mon[31212]: pgmap v13060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:06 smithi077 ceph-mon[27902]: pgmap v13060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:06 smithi191 ceph-mon[31636]: pgmap v13060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24318.788675 secs 2024-04-21T17:10:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24318.788675 secs 2024-04-21T17:10:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24318.788675 secs 2024-04-21T17:10:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:08 smithi077 ceph-mon[27902]: pgmap v13061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:08 smithi191 ceph-mon[31636]: pgmap v13061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:08 smithi170 ceph-mon[31212]: pgmap v13061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24320.549125 secs 2024-04-21T17:10:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24320.549125 secs 2024-04-21T17:10:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24320.549125 secs 2024-04-21T17:10:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:10 smithi077 ceph-mon[27902]: pgmap v13062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:10 smithi191 ceph-mon[31636]: pgmap v13062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:10 smithi170 ceph-mon[31212]: pgmap v13062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:10:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:12 smithi191 ceph-mon[31636]: pgmap v13063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-04-21T17:10:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:12 smithi191 ceph-mon[31636]: osdmap e889: 12 total, 12 up, 12 in 2024-04-21T17:10:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24323.788754 secs 2024-04-21T17:10:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:12 smithi170 ceph-mon[31212]: pgmap v13063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-04-21T17:10:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:12 smithi170 ceph-mon[31212]: osdmap e889: 12 total, 12 up, 12 in 2024-04-21T17:10:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24323.788754 secs 2024-04-21T17:10:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:12 smithi077 ceph-mon[27902]: pgmap v13063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-04-21T17:10:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:12 smithi077 ceph-mon[27902]: osdmap e889: 12 total, 12 up, 12 in 2024-04-21T17:10:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24323.788754 secs 2024-04-21T17:10:14.937 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:14 smithi077 ceph-mon[27902]: pgmap v13065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T17:10:14.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24325.549206 secs 2024-04-21T17:10:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:14 smithi191 ceph-mon[31636]: pgmap v13065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T17:10:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24325.549206 secs 2024-04-21T17:10:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:14 smithi170 ceph-mon[31212]: pgmap v13065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-04-21T17:10:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24325.549206 secs 2024-04-21T17:10:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:16 smithi191 ceph-mon[31636]: pgmap v13066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:16 smithi170 ceph-mon[31212]: pgmap v13066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:16 smithi077 ceph-mon[27902]: pgmap v13066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24328.788874 secs 2024-04-21T17:10:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24328.788874 secs 2024-04-21T17:10:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24328.788874 secs 2024-04-21T17:10:18.941 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:18 smithi170 ceph-mon[31212]: pgmap v13067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:18.941 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:10:18.946 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:18 smithi077 ceph-mon[27902]: pgmap v13067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:18.946 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:10:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:18 smithi191 ceph-mon[31636]: pgmap v13067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24330.549284 secs 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24330.549284 secs 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24330.549284 secs 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: pgmap v13068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:10:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: pgmap v13068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:10:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: pgmap v13068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:10:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:10:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:10:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:10:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:10:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:10:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:10:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:10:21.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:10:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:10:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:10:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:10:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:10:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:10:22.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:10:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:10:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:10:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:10:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:10:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:10:22.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:10:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:22 smithi191 ceph-mon[31636]: pgmap v13069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:10:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24333.788990 secs 2024-04-21T17:10:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:22 smithi170 ceph-mon[31212]: pgmap v13069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:10:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24333.788990 secs 2024-04-21T17:10:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:22 smithi077 ceph-mon[27902]: pgmap v13069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:10:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24333.788990 secs 2024-04-21T17:10:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:24 smithi191 ceph-mon[31636]: pgmap v13070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:10:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24335.549403 secs 2024-04-21T17:10:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:24 smithi170 ceph-mon[31212]: pgmap v13070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:10:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24335.549403 secs 2024-04-21T17:10:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:24 smithi077 ceph-mon[27902]: pgmap v13070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:10:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24335.549403 secs 2024-04-21T17:10:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:26 smithi191 ceph-mon[31636]: pgmap v13071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:26 smithi170 ceph-mon[31212]: pgmap v13071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:26 smithi077 ceph-mon[27902]: pgmap v13071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24338.789112 secs 2024-04-21T17:10:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24338.789112 secs 2024-04-21T17:10:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24338.789112 secs 2024-04-21T17:10:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:28 smithi191 ceph-mon[31636]: pgmap v13072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:28.974 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:28 smithi170 ceph-mon[31212]: pgmap v13072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:28 smithi077 ceph-mon[27902]: pgmap v13072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24340.549467 secs 2024-04-21T17:10:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24340.549467 secs 2024-04-21T17:10:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24340.549467 secs 2024-04-21T17:10:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:30 smithi170 ceph-mon[31212]: pgmap v13073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:30 smithi077 ceph-mon[27902]: pgmap v13073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:30 smithi191 ceph-mon[31636]: pgmap v13073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:32 smithi170 ceph-mon[31212]: pgmap v13074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24343.789225 secs 2024-04-21T17:10:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:32 smithi077 ceph-mon[27902]: pgmap v13074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24343.789225 secs 2024-04-21T17:10:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:32 smithi191 ceph-mon[31636]: pgmap v13074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24343.789225 secs 2024-04-21T17:10:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:34 smithi170 ceph-mon[31212]: pgmap v13075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24345.549589 secs 2024-04-21T17:10:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:34 smithi077 ceph-mon[27902]: pgmap v13075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24345.549589 secs 2024-04-21T17:10:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:34 smithi191 ceph-mon[31636]: pgmap v13075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24345.549589 secs 2024-04-21T17:10:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:36 smithi170 ceph-mon[31212]: pgmap v13076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:36 smithi077 ceph-mon[27902]: pgmap v13076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:36 smithi191 ceph-mon[31636]: pgmap v13076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24348.789345 secs 2024-04-21T17:10:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24348.789345 secs 2024-04-21T17:10:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24348.789345 secs 2024-04-21T17:10:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:38 smithi170 ceph-mon[31212]: pgmap v13077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:38 smithi077 ceph-mon[27902]: pgmap v13077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:38 smithi191 ceph-mon[31636]: pgmap v13077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24350.549670 secs 2024-04-21T17:10:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24350.549670 secs 2024-04-21T17:10:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24350.549670 secs 2024-04-21T17:10:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:40 smithi170 ceph-mon[31212]: pgmap v13078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:40 smithi077 ceph-mon[27902]: pgmap v13078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:40 smithi191 ceph-mon[31636]: pgmap v13078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:42 smithi170 ceph-mon[31212]: pgmap v13079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24353.789478 secs 2024-04-21T17:10:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:42 smithi077 ceph-mon[27902]: pgmap v13079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24353.789478 secs 2024-04-21T17:10:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:42 smithi191 ceph-mon[31636]: pgmap v13079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24353.789478 secs 2024-04-21T17:10:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:44 smithi170 ceph-mon[31212]: pgmap v13080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24355.549801 secs 2024-04-21T17:10:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:44 smithi077 ceph-mon[27902]: pgmap v13080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24355.549801 secs 2024-04-21T17:10:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:44 smithi191 ceph-mon[31636]: pgmap v13080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24355.549801 secs 2024-04-21T17:10:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:46 smithi170 ceph-mon[31212]: pgmap v13081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:46 smithi077 ceph-mon[27902]: pgmap v13081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:46 smithi191 ceph-mon[31636]: pgmap v13081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24358.789619 secs 2024-04-21T17:10:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24358.789619 secs 2024-04-21T17:10:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24358.789619 secs 2024-04-21T17:10:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:48 smithi170 ceph-mon[31212]: pgmap v13082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:48 smithi077 ceph-mon[27902]: pgmap v13082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:48 smithi191 ceph-mon[31636]: pgmap v13082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24360.549945 secs 2024-04-21T17:10:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24360.549945 secs 2024-04-21T17:10:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24360.549945 secs 2024-04-21T17:10:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:50 smithi170 ceph-mon[31212]: pgmap v13083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:50 smithi077 ceph-mon[27902]: pgmap v13083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:50 smithi191 ceph-mon[31636]: pgmap v13083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:52 smithi170 ceph-mon[31212]: pgmap v13084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24363.789741 secs 2024-04-21T17:10:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:52 smithi077 ceph-mon[27902]: pgmap v13084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24363.789741 secs 2024-04-21T17:10:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:52 smithi191 ceph-mon[31636]: pgmap v13084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:10:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24363.789741 secs 2024-04-21T17:10:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:54 smithi170 ceph-mon[31212]: pgmap v13085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24365.550069 secs 2024-04-21T17:10:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:10:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:54 smithi077 ceph-mon[27902]: pgmap v13085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24365.550069 secs 2024-04-21T17:10:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:54 smithi191 ceph-mon[31636]: pgmap v13085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:10:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24365.550069 secs 2024-04-21T17:10:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:56 smithi170 ceph-mon[31212]: pgmap v13086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:56 smithi077 ceph-mon[27902]: pgmap v13086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:56 smithi191 ceph-mon[31636]: pgmap v13086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:10:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:10:57.721+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:10:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:10:57.721+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:10:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:10:57.721+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:10:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:10:57.721+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:10:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24368.789856 secs 2024-04-21T17:10:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24368.789856 secs 2024-04-21T17:10:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24368.789856 secs 2024-04-21T17:10:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:58 smithi170 ceph-mon[31212]: pgmap v13087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:58 smithi077 ceph-mon[27902]: pgmap v13087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:10:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:58 smithi191 ceph-mon[31636]: pgmap v13087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24370.550192 secs 2024-04-21T17:11:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24370.550192 secs 2024-04-21T17:11:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24370.550192 secs 2024-04-21T17:11:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:00 smithi170 ceph-mon[31212]: pgmap v13088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:00 smithi077 ceph-mon[27902]: pgmap v13088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:00 smithi191 ceph-mon[31636]: pgmap v13088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:02 smithi170 ceph-mon[31212]: pgmap v13089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:11:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24373.789936 secs 2024-04-21T17:11:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:02 smithi077 ceph-mon[27902]: pgmap v13089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:11:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24373.789936 secs 2024-04-21T17:11:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:02 smithi191 ceph-mon[31636]: pgmap v13089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:11:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24373.789936 secs 2024-04-21T17:11:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:04 smithi077 ceph-mon[27902]: pgmap v13090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:11:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24375.550335 secs 2024-04-21T17:11:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:04 smithi077 ceph-mon[27902]: osdmap e890: 12 total, 12 up, 12 in 2024-04-21T17:11:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:04 smithi191 ceph-mon[31636]: pgmap v13090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:11:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24375.550335 secs 2024-04-21T17:11:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:04 smithi191 ceph-mon[31636]: osdmap e890: 12 total, 12 up, 12 in 2024-04-21T17:11:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:04 smithi170 ceph-mon[31212]: pgmap v13090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:11:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24375.550335 secs 2024-04-21T17:11:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:04 smithi170 ceph-mon[31212]: osdmap e890: 12 total, 12 up, 12 in 2024-04-21T17:11:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:06 smithi077 ceph-mon[27902]: pgmap v13092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:06 smithi191 ceph-mon[31636]: pgmap v13092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:06 smithi170 ceph-mon[31212]: pgmap v13092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24378.790079 secs 2024-04-21T17:11:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24378.790079 secs 2024-04-21T17:11:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24378.790079 secs 2024-04-21T17:11:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:08 smithi077 ceph-mon[27902]: pgmap v13093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:08 smithi191 ceph-mon[31636]: pgmap v13093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:08 smithi170 ceph-mon[31212]: pgmap v13093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24380.550420 secs 2024-04-21T17:11:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24380.550420 secs 2024-04-21T17:11:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24380.550420 secs 2024-04-21T17:11:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:10 smithi077 ceph-mon[27902]: pgmap v13094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:10 smithi191 ceph-mon[31636]: pgmap v13094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:10 smithi170 ceph-mon[31212]: pgmap v13094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:11:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:12 smithi191 ceph-mon[31636]: pgmap v13095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:11:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:12 smithi191 ceph-mon[31636]: osdmap e891: 12 total, 12 up, 12 in 2024-04-21T17:11:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24383.790160 secs 2024-04-21T17:11:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:12 smithi170 ceph-mon[31212]: pgmap v13095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:11:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:12 smithi170 ceph-mon[31212]: osdmap e891: 12 total, 12 up, 12 in 2024-04-21T17:11:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24383.790160 secs 2024-04-21T17:11:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:12 smithi077 ceph-mon[27902]: pgmap v13095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:11:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:12 smithi077 ceph-mon[27902]: osdmap e891: 12 total, 12 up, 12 in 2024-04-21T17:11:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24383.790160 secs 2024-04-21T17:11:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:14 smithi191 ceph-mon[31636]: pgmap v13097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:11:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24385.550534 secs 2024-04-21T17:11:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:14 smithi170 ceph-mon[31212]: pgmap v13097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:11:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24385.550534 secs 2024-04-21T17:11:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:14 smithi077 ceph-mon[27902]: pgmap v13097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:11:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24385.550534 secs 2024-04-21T17:11:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:16 smithi191 ceph-mon[31636]: pgmap v13098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:16 smithi170 ceph-mon[31212]: pgmap v13098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:16 smithi077 ceph-mon[27902]: pgmap v13098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24388.790271 secs 2024-04-21T17:11:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24388.790271 secs 2024-04-21T17:11:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24388.790271 secs 2024-04-21T17:11:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:18 smithi191 ceph-mon[31636]: pgmap v13099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:18 smithi170 ceph-mon[31212]: pgmap v13099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:18 smithi077 ceph-mon[27902]: pgmap v13099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24390.550676 secs 2024-04-21T17:11:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24390.550676 secs 2024-04-21T17:11:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24390.550676 secs 2024-04-21T17:11:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:20 smithi191 ceph-mon[31636]: pgmap v13100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:11:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:20 smithi170 ceph-mon[31212]: pgmap v13100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:11:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:20 smithi077 ceph-mon[27902]: pgmap v13100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:11:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:11:22.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:21 smithi191 ceph-mon[31636]: pgmap v13101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:11:22.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:11:22.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:11:22.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:21 smithi170 ceph-mon[31212]: pgmap v13101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:11:22.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:11:22.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:11:22.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:21 smithi077 ceph-mon[27902]: pgmap v13101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:11:22.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:11:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:11:22.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:11:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24393.790409 secs 2024-04-21T17:11:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24393.790409 secs 2024-04-21T17:11:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24393.790409 secs 2024-04-21T17:11:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:23 smithi191 ceph-mon[31636]: pgmap v13102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:11:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24395.550809 secs 2024-04-21T17:11:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:23 smithi170 ceph-mon[31212]: pgmap v13102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:11:24.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24395.550809 secs 2024-04-21T17:11:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:23 smithi077 ceph-mon[27902]: pgmap v13102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:11:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24395.550809 secs 2024-04-21T17:11:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:26 smithi170 ceph-mon[31212]: pgmap v13103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:26 smithi077 ceph-mon[27902]: pgmap v13103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:26 smithi191 ceph-mon[31636]: pgmap v13103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24398.790545 secs 2024-04-21T17:11:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24398.790545 secs 2024-04-21T17:11:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24398.790545 secs 2024-04-21T17:11:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:28 smithi170 ceph-mon[31212]: pgmap v13104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:28.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:28 smithi191 ceph-mon[31636]: pgmap v13104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:28 smithi077 ceph-mon[27902]: pgmap v13104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24400.550936 secs 2024-04-21T17:11:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24400.550936 secs 2024-04-21T17:11:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24400.550936 secs 2024-04-21T17:11:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:30 smithi170 ceph-mon[31212]: pgmap v13105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:30 smithi077 ceph-mon[27902]: pgmap v13105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:30 smithi191 ceph-mon[31636]: pgmap v13105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:32 smithi170 ceph-mon[31212]: pgmap v13106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24403.790663 secs 2024-04-21T17:11:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:32 smithi077 ceph-mon[27902]: pgmap v13106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24403.790663 secs 2024-04-21T17:11:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:32 smithi191 ceph-mon[31636]: pgmap v13106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24403.790663 secs 2024-04-21T17:11:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:34 smithi077 ceph-mon[27902]: pgmap v13107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24405.550997 secs 2024-04-21T17:11:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:34 smithi191 ceph-mon[31636]: pgmap v13107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24405.550997 secs 2024-04-21T17:11:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:34 smithi170 ceph-mon[31212]: pgmap v13107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24405.550997 secs 2024-04-21T17:11:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:36.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:36 smithi077 ceph-mon[27902]: pgmap v13108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:36 smithi191 ceph-mon[31636]: pgmap v13108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:36 smithi170 ceph-mon[31212]: pgmap v13108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24408.790768 secs 2024-04-21T17:11:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24408.790768 secs 2024-04-21T17:11:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24408.790768 secs 2024-04-21T17:11:38.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:38 smithi077 ceph-mon[27902]: pgmap v13109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:38 smithi191 ceph-mon[31636]: pgmap v13109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:38 smithi170 ceph-mon[31212]: pgmap v13109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:39.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24410.551095 secs 2024-04-21T17:11:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24410.551095 secs 2024-04-21T17:11:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24410.551095 secs 2024-04-21T17:11:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:40 smithi077 ceph-mon[27902]: pgmap v13110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:40 smithi191 ceph-mon[31636]: pgmap v13110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:40 smithi170 ceph-mon[31212]: pgmap v13110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:42.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:42 smithi077 ceph-mon[27902]: pgmap v13111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:42.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24413.790883 secs 2024-04-21T17:11:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:42 smithi191 ceph-mon[31636]: pgmap v13111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24413.790883 secs 2024-04-21T17:11:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:42 smithi170 ceph-mon[31212]: pgmap v13111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24413.790883 secs 2024-04-21T17:11:44.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:44 smithi077 ceph-mon[27902]: pgmap v13112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:44.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24415.551193 secs 2024-04-21T17:11:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:44 smithi191 ceph-mon[31636]: pgmap v13112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24415.551193 secs 2024-04-21T17:11:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:44 smithi170 ceph-mon[31212]: pgmap v13112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24415.551193 secs 2024-04-21T17:11:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:46.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:46 smithi077 ceph-mon[27902]: pgmap v13113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:46 smithi191 ceph-mon[31636]: pgmap v13113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:46 smithi170 ceph-mon[31212]: pgmap v13113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:47.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24418.791000 secs 2024-04-21T17:11:47.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24418.791000 secs 2024-04-21T17:11:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24418.791000 secs 2024-04-21T17:11:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:48 smithi077 ceph-mon[27902]: pgmap v13114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:48 smithi191 ceph-mon[31636]: pgmap v13114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:48 smithi170 ceph-mon[31212]: pgmap v13114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24420.551316 secs 2024-04-21T17:11:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24420.551316 secs 2024-04-21T17:11:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24420.551316 secs 2024-04-21T17:11:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:50 smithi077 ceph-mon[27902]: pgmap v13115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:50 smithi191 ceph-mon[31636]: pgmap v13115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:50 smithi170 ceph-mon[31212]: pgmap v13115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:52.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:52 smithi077 ceph-mon[27902]: pgmap v13116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:52.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24423.791132 secs 2024-04-21T17:11:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:52 smithi191 ceph-mon[31636]: pgmap v13116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24423.791132 secs 2024-04-21T17:11:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:52 smithi170 ceph-mon[31212]: pgmap v13116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:11:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24423.791132 secs 2024-04-21T17:11:54.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:54 smithi077 ceph-mon[27902]: pgmap v13117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:54.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24425.551424 secs 2024-04-21T17:11:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:54 smithi191 ceph-mon[31636]: pgmap v13117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24425.551424 secs 2024-04-21T17:11:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:54 smithi170 ceph-mon[31212]: pgmap v13117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:11:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24425.551424 secs 2024-04-21T17:11:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:11:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:56 smithi077 ceph-mon[27902]: pgmap v13118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:56.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:56 smithi191 ceph-mon[31636]: pgmap v13118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:56 smithi170 ceph-mon[31212]: pgmap v13118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:11:57.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24428.791234 secs 2024-04-21T17:11:57.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24428.791234 secs 2024-04-21T17:11:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24428.791234 secs 2024-04-21T17:11:58.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:58 smithi191 ceph-mon[31636]: pgmap v13119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:58.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:58 smithi077 ceph-mon[27902]: pgmap v13119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:58.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:58 smithi170 ceph-mon[31212]: pgmap v13119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:11:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24430.551541 secs 2024-04-21T17:11:59.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24430.551541 secs 2024-04-21T17:11:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24430.551541 secs 2024-04-21T17:12:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:00 smithi077 ceph-mon[27902]: pgmap v13120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:00 smithi191 ceph-mon[31636]: pgmap v13120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:00 smithi170 ceph-mon[31212]: pgmap v13120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:02.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:02 smithi077 ceph-mon[27902]: pgmap v13121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:02.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24433.791351 secs 2024-04-21T17:12:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:02 smithi191 ceph-mon[31636]: pgmap v13121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24433.791351 secs 2024-04-21T17:12:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:02 smithi170 ceph-mon[31212]: pgmap v13121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24433.791351 secs 2024-04-21T17:12:04.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:04 smithi077 ceph-mon[27902]: pgmap v13122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:04.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24435.551689 secs 2024-04-21T17:12:04.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:04 smithi191 ceph-mon[31636]: pgmap v13122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:04.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24435.551689 secs 2024-04-21T17:12:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:04 smithi170 ceph-mon[31212]: pgmap v13122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24435.551689 secs 2024-04-21T17:12:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:05 smithi191 ceph-mon[31636]: osdmap e892: 12 total, 12 up, 12 in 2024-04-21T17:12:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:05 smithi170 ceph-mon[31212]: osdmap e892: 12 total, 12 up, 12 in 2024-04-21T17:12:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:05 smithi077 ceph-mon[27902]: osdmap e892: 12 total, 12 up, 12 in 2024-04-21T17:12:06.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:06 smithi191 ceph-mon[31636]: pgmap v13124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:06 smithi170 ceph-mon[31212]: pgmap v13124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:06 smithi077 ceph-mon[27902]: pgmap v13124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24438.791473 secs 2024-04-21T17:12:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24438.791473 secs 2024-04-21T17:12:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24438.791473 secs 2024-04-21T17:12:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:08 smithi191 ceph-mon[31636]: pgmap v13125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:08 smithi170 ceph-mon[31212]: pgmap v13125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:08 smithi077 ceph-mon[27902]: pgmap v13125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24440.551810 secs 2024-04-21T17:12:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24440.551810 secs 2024-04-21T17:12:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24440.551810 secs 2024-04-21T17:12:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:10 smithi191 ceph-mon[31636]: pgmap v13126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:10 smithi170 ceph-mon[31212]: pgmap v13126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:10 smithi077 ceph-mon[27902]: pgmap v13126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:12:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:12 smithi191 ceph-mon[31636]: pgmap v13127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:12:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24443.791599 secs 2024-04-21T17:12:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:12 smithi170 ceph-mon[31212]: pgmap v13127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:12:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24443.791599 secs 2024-04-21T17:12:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:12 smithi077 ceph-mon[27902]: pgmap v13127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:12:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24443.791599 secs 2024-04-21T17:12:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:14 smithi170 ceph-mon[31212]: pgmap v13128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:12:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24445.551930 secs 2024-04-21T17:12:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:14 smithi077 ceph-mon[27902]: pgmap v13128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:12:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24445.551930 secs 2024-04-21T17:12:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:14 smithi191 ceph-mon[31636]: pgmap v13128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:12:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24445.551930 secs 2024-04-21T17:12:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:16 smithi170 ceph-mon[31212]: pgmap v13129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-04-21T17:12:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:16 smithi170 ceph-mon[31212]: osdmap e893: 12 total, 12 up, 12 in 2024-04-21T17:12:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:16 smithi077 ceph-mon[27902]: pgmap v13129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-04-21T17:12:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:16 smithi077 ceph-mon[27902]: osdmap e893: 12 total, 12 up, 12 in 2024-04-21T17:12:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:16 smithi191 ceph-mon[31636]: pgmap v13129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-04-21T17:12:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:16 smithi191 ceph-mon[31636]: osdmap e893: 12 total, 12 up, 12 in 2024-04-21T17:12:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24448.792153 secs 2024-04-21T17:12:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24448.792153 secs 2024-04-21T17:12:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24448.792153 secs 2024-04-21T17:12:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:18 smithi170 ceph-mon[31212]: pgmap v13131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:12:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:18 smithi077 ceph-mon[27902]: pgmap v13131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:12:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:18 smithi191 ceph-mon[31636]: pgmap v13131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:12:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24450.552045 secs 2024-04-21T17:12:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24450.552045 secs 2024-04-21T17:12:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24450.552045 secs 2024-04-21T17:12:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:20 smithi170 ceph-mon[31212]: pgmap v13132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:12:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:20 smithi077 ceph-mon[27902]: pgmap v13132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:12:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:20 smithi191 ceph-mon[31636]: pgmap v13132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:12:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: pgmap v13133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:12:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24453.792225 secs 2024-04-21T17:12:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: pgmap v13133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24453.792225 secs 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: pgmap v13133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:12:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24453.792225 secs 2024-04-21T17:12:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:24.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:12:24.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:12:24.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:12:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:12:24.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:12:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:12:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:12:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:24 smithi170 ceph-mon[31212]: pgmap v13134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24455.552158 secs 2024-04-21T17:12:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:24 smithi077 ceph-mon[27902]: pgmap v13134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24455.552158 secs 2024-04-21T17:12:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:24 smithi191 ceph-mon[31636]: pgmap v13134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24455.552158 secs 2024-04-21T17:12:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:26 smithi170 ceph-mon[31212]: pgmap v13135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:26 smithi077 ceph-mon[27902]: pgmap v13135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:26 smithi191 ceph-mon[31636]: pgmap v13135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:12:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24458.792341 secs 2024-04-21T17:12:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24458.792341 secs 2024-04-21T17:12:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24458.792341 secs 2024-04-21T17:12:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:28 smithi170 ceph-mon[31212]: pgmap v13136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T17:12:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:28 smithi077 ceph-mon[27902]: pgmap v13136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T17:12:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:28 smithi191 ceph-mon[31636]: pgmap v13136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T17:12:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24460.552278 secs 2024-04-21T17:12:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24460.552278 secs 2024-04-21T17:12:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24460.552278 secs 2024-04-21T17:12:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:30 smithi170 ceph-mon[31212]: pgmap v13137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:30 smithi077 ceph-mon[27902]: pgmap v13137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:30 smithi191 ceph-mon[31636]: pgmap v13137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:32 smithi170 ceph-mon[31212]: pgmap v13138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24463.792455 secs 2024-04-21T17:12:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:32 smithi077 ceph-mon[27902]: pgmap v13138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24463.792455 secs 2024-04-21T17:12:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:32 smithi191 ceph-mon[31636]: pgmap v13138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24463.792455 secs 2024-04-21T17:12:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:34 smithi170 ceph-mon[31212]: pgmap v13139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24465.552422 secs 2024-04-21T17:12:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:34 smithi077 ceph-mon[27902]: pgmap v13139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24465.552422 secs 2024-04-21T17:12:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:34 smithi191 ceph-mon[31636]: pgmap v13139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24465.552422 secs 2024-04-21T17:12:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:36 smithi170 ceph-mon[31212]: pgmap v13140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:12:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:36 smithi077 ceph-mon[27902]: pgmap v13140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:12:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:36 smithi191 ceph-mon[31636]: pgmap v13140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T17:12:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24468.792565 secs 2024-04-21T17:12:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24468.792565 secs 2024-04-21T17:12:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24468.792565 secs 2024-04-21T17:12:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:38 smithi170 ceph-mon[31212]: pgmap v13141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:12:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:38 smithi077 ceph-mon[27902]: pgmap v13141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:12:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:38 smithi191 ceph-mon[31636]: pgmap v13141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:12:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24470.552571 secs 2024-04-21T17:12:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24470.552571 secs 2024-04-21T17:12:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24470.552571 secs 2024-04-21T17:12:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:40 smithi170 ceph-mon[31212]: pgmap v13142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:40 smithi077 ceph-mon[27902]: pgmap v13142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:40 smithi191 ceph-mon[31636]: pgmap v13142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:42 smithi170 ceph-mon[31212]: pgmap v13143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24473.792677 secs 2024-04-21T17:12:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:42 smithi077 ceph-mon[27902]: pgmap v13143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24473.792677 secs 2024-04-21T17:12:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:42 smithi191 ceph-mon[31636]: pgmap v13143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24473.792677 secs 2024-04-21T17:12:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:44 smithi170 ceph-mon[31212]: pgmap v13144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24475.552692 secs 2024-04-21T17:12:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:44 smithi077 ceph-mon[27902]: pgmap v13144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24475.552692 secs 2024-04-21T17:12:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:44 smithi191 ceph-mon[31636]: pgmap v13144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24475.552692 secs 2024-04-21T17:12:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:46 smithi077 ceph-mon[27902]: pgmap v13145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:46 smithi191 ceph-mon[31636]: pgmap v13145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:46 smithi170 ceph-mon[31212]: pgmap v13145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24478.792803 secs 2024-04-21T17:12:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24478.792803 secs 2024-04-21T17:12:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24478.792803 secs 2024-04-21T17:12:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:48 smithi077 ceph-mon[27902]: pgmap v13146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:12:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:48 smithi191 ceph-mon[31636]: pgmap v13146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:12:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:48 smithi170 ceph-mon[31212]: pgmap v13146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T17:12:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24480.552826 secs 2024-04-21T17:12:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24480.552826 secs 2024-04-21T17:12:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24480.552826 secs 2024-04-21T17:12:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:50 smithi077 ceph-mon[27902]: pgmap v13147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:50 smithi191 ceph-mon[31636]: pgmap v13147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:50 smithi170 ceph-mon[31212]: pgmap v13147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:52 smithi077 ceph-mon[27902]: pgmap v13148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24483.792911 secs 2024-04-21T17:12:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:52 smithi191 ceph-mon[31636]: pgmap v13148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24483.792911 secs 2024-04-21T17:12:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:52 smithi170 ceph-mon[31212]: pgmap v13148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24483.792911 secs 2024-04-21T17:12:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:54 smithi077 ceph-mon[27902]: pgmap v13149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24485.552944 secs 2024-04-21T17:12:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:54 smithi191 ceph-mon[31636]: pgmap v13149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24485.552944 secs 2024-04-21T17:12:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:54 smithi170 ceph-mon[31212]: pgmap v13149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24485.552944 secs 2024-04-21T17:12:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:56 smithi077 ceph-mon[27902]: pgmap v13150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:56 smithi191 ceph-mon[31636]: pgmap v13150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:56 smithi170 ceph-mon[31212]: pgmap v13150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:12:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24488.793029 secs 2024-04-21T17:12:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24488.793029 secs 2024-04-21T17:12:58.209 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24488.793029 secs 2024-04-21T17:12:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:58 smithi077 ceph-mon[27902]: pgmap v13151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:12:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24490.553092 secs 2024-04-21T17:12:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:58 smithi191 ceph-mon[31636]: pgmap v13151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:12:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24490.553092 secs 2024-04-21T17:12:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:58 smithi170 ceph-mon[31212]: pgmap v13151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:12:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:12:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24490.553092 secs 2024-04-21T17:13:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:00 smithi077 ceph-mon[27902]: pgmap v13152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:00 smithi191 ceph-mon[31636]: pgmap v13152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:00 smithi170 ceph-mon[31212]: pgmap v13152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:02 smithi077 ceph-mon[27902]: pgmap v13153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24493.793129 secs 2024-04-21T17:13:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:02 smithi191 ceph-mon[31636]: pgmap v13153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24493.793129 secs 2024-04-21T17:13:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:02 smithi170 ceph-mon[31212]: pgmap v13153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24493.793129 secs 2024-04-21T17:13:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24495.553216 secs 2024-04-21T17:13:04.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24495.553216 secs 2024-04-21T17:13:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24495.553216 secs 2024-04-21T17:13:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:04 smithi077 ceph-mon[27902]: pgmap v13154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:04 smithi077 ceph-mon[27902]: osdmap e894: 12 total, 12 up, 12 in 2024-04-21T17:13:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:04 smithi191 ceph-mon[31636]: pgmap v13154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:04 smithi191 ceph-mon[31636]: osdmap e894: 12 total, 12 up, 12 in 2024-04-21T17:13:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:04 smithi170 ceph-mon[31212]: pgmap v13154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:04 smithi170 ceph-mon[31212]: osdmap e894: 12 total, 12 up, 12 in 2024-04-21T17:13:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:06 smithi077 ceph-mon[27902]: pgmap v13156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:13:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:06 smithi077 ceph-mon[27902]: osdmap e895: 12 total, 12 up, 12 in 2024-04-21T17:13:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:06 smithi191 ceph-mon[31636]: pgmap v13156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:13:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:06 smithi191 ceph-mon[31636]: osdmap e895: 12 total, 12 up, 12 in 2024-04-21T17:13:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:06 smithi170 ceph-mon[31212]: pgmap v13156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:13:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:06 smithi170 ceph-mon[31212]: osdmap e895: 12 total, 12 up, 12 in 2024-04-21T17:13:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24498.793196 secs 2024-04-21T17:13:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24498.793196 secs 2024-04-21T17:13:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24498.793196 secs 2024-04-21T17:13:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:08 smithi077 ceph-mon[27902]: pgmap v13158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:13:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24500.553345 secs 2024-04-21T17:13:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:08 smithi191 ceph-mon[31636]: pgmap v13158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:13:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24500.553345 secs 2024-04-21T17:13:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:08 smithi170 ceph-mon[31212]: pgmap v13158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:13:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24500.553345 secs 2024-04-21T17:13:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:10 smithi077 ceph-mon[27902]: pgmap v13159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:13:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:10 smithi191 ceph-mon[31636]: pgmap v13159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:13:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:10 smithi170 ceph-mon[31212]: pgmap v13159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:13:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:12.740+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:13:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:12.740+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:13:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:12.740+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:13:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:12.740+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:13:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:12 smithi077 ceph-mon[27902]: pgmap v13160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:13:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24503.793311 secs 2024-04-21T17:13:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:12 smithi191 ceph-mon[31636]: pgmap v13160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:13:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24503.793311 secs 2024-04-21T17:13:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:12 smithi170 ceph-mon[31212]: pgmap v13160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:13:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24503.793311 secs 2024-04-21T17:13:14.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24505.553465 secs 2024-04-21T17:13:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24505.553465 secs 2024-04-21T17:13:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24505.553465 secs 2024-04-21T17:13:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:14 smithi191 ceph-mon[31636]: pgmap v13161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:13:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:14 smithi170 ceph-mon[31212]: pgmap v13161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:13:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:14 smithi077 ceph-mon[27902]: pgmap v13161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:13:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:16 smithi191 ceph-mon[31636]: pgmap v13162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:13:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:16 smithi170 ceph-mon[31212]: pgmap v13162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:13:17.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:16 smithi077 ceph-mon[27902]: pgmap v13162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:13:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24508.793425 secs 2024-04-21T17:13:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24508.793425 secs 2024-04-21T17:13:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24508.793425 secs 2024-04-21T17:13:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:18 smithi191 ceph-mon[31636]: pgmap v13163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T17:13:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24510.553592 secs 2024-04-21T17:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:18 smithi170 ceph-mon[31212]: pgmap v13163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T17:13:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24510.553592 secs 2024-04-21T17:13:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:18 smithi077 ceph-mon[27902]: pgmap v13163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 97 B/s wr, 5 op/s 2024-04-21T17:13:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24510.553592 secs 2024-04-21T17:13:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:19 smithi191 ceph-mon[31636]: pgmap v13164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:13:20.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:19 smithi170 ceph-mon[31212]: pgmap v13164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:13:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:19 smithi077 ceph-mon[27902]: pgmap v13164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:13:22.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:22 smithi077 ceph-mon[27902]: pgmap v13165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:13:22.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24513.793492 secs 2024-04-21T17:13:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:22 smithi191 ceph-mon[31636]: pgmap v13165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:13:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24513.793492 secs 2024-04-21T17:13:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:22 smithi170 ceph-mon[31212]: pgmap v13165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:13:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24513.793492 secs 2024-04-21T17:13:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:13:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:13:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:13:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:24 smithi077 ceph-mon[27902]: pgmap v13166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24515.553711 secs 2024-04-21T17:13:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:13:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:13:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:13:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:24 smithi191 ceph-mon[31636]: pgmap v13166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24515.553711 secs 2024-04-21T17:13:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:13:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:13:24.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:13:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:24 smithi170 ceph-mon[31212]: pgmap v13166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24515.553711 secs 2024-04-21T17:13:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:13:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:13:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:13:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:26 smithi077 ceph-mon[27902]: pgmap v13167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:26 smithi191 ceph-mon[31636]: pgmap v13167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:26 smithi170 ceph-mon[31212]: pgmap v13167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24518.793605 secs 2024-04-21T17:13:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24518.793605 secs 2024-04-21T17:13:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24518.793605 secs 2024-04-21T17:13:28.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:28 smithi191 ceph-mon[31636]: pgmap v13168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:28 smithi077 ceph-mon[27902]: pgmap v13168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:28.709 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:28 smithi170 ceph-mon[31212]: pgmap v13168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24520.553876 secs 2024-04-21T17:13:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24520.553876 secs 2024-04-21T17:13:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24520.553876 secs 2024-04-21T17:13:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:30 smithi077 ceph-mon[27902]: pgmap v13169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:30 smithi191 ceph-mon[31636]: pgmap v13169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:30 smithi170 ceph-mon[31212]: pgmap v13169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:32 smithi077 ceph-mon[27902]: pgmap v13170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24523.793717 secs 2024-04-21T17:13:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:32 smithi191 ceph-mon[31636]: pgmap v13170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24523.793717 secs 2024-04-21T17:13:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:32 smithi170 ceph-mon[31212]: pgmap v13170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24523.793717 secs 2024-04-21T17:13:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:34 smithi077 ceph-mon[27902]: pgmap v13171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24525.553966 secs 2024-04-21T17:13:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:34 smithi191 ceph-mon[31636]: pgmap v13171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24525.553966 secs 2024-04-21T17:13:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:34 smithi170 ceph-mon[31212]: pgmap v13171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24525.553966 secs 2024-04-21T17:13:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:36.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:36 smithi077 ceph-mon[27902]: pgmap v13172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:36 smithi191 ceph-mon[31636]: pgmap v13172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:36 smithi170 ceph-mon[31212]: pgmap v13172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24528.793831 secs 2024-04-21T17:13:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24528.793831 secs 2024-04-21T17:13:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24528.793831 secs 2024-04-21T17:13:38.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:38 smithi077 ceph-mon[27902]: pgmap v13173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:38 smithi191 ceph-mon[31636]: pgmap v13173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:38 smithi170 ceph-mon[31212]: pgmap v13173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24530.554058 secs 2024-04-21T17:13:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24530.554058 secs 2024-04-21T17:13:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24530.554058 secs 2024-04-21T17:13:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:40 smithi077 ceph-mon[27902]: pgmap v13174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:40 smithi191 ceph-mon[31636]: pgmap v13174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:40 smithi170 ceph-mon[31212]: pgmap v13174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:42.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:42 smithi077 ceph-mon[27902]: pgmap v13175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:42.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24533.793938 secs 2024-04-21T17:13:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:42 smithi191 ceph-mon[31636]: pgmap v13175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24533.793938 secs 2024-04-21T17:13:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:42 smithi170 ceph-mon[31212]: pgmap v13175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24533.793938 secs 2024-04-21T17:13:44.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:44 smithi077 ceph-mon[27902]: pgmap v13176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:44.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24535.554185 secs 2024-04-21T17:13:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:44 smithi191 ceph-mon[31636]: pgmap v13176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24535.554185 secs 2024-04-21T17:13:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:44 smithi170 ceph-mon[31212]: pgmap v13176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24535.554185 secs 2024-04-21T17:13:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:46.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:46 smithi077 ceph-mon[27902]: pgmap v13177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:46 smithi191 ceph-mon[31636]: pgmap v13177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:46 smithi170 ceph-mon[31212]: pgmap v13177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:47.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24538.794068 secs 2024-04-21T17:13:47.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24538.794068 secs 2024-04-21T17:13:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24538.794068 secs 2024-04-21T17:13:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:48 smithi191 ceph-mon[31636]: pgmap v13178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:48 smithi170 ceph-mon[31212]: pgmap v13178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:48 smithi077 ceph-mon[27902]: pgmap v13178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24540.554314 secs 2024-04-21T17:13:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24540.554314 secs 2024-04-21T17:13:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24540.554314 secs 2024-04-21T17:13:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:50 smithi191 ceph-mon[31636]: pgmap v13179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:50 smithi170 ceph-mon[31212]: pgmap v13179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:50 smithi077 ceph-mon[27902]: pgmap v13179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:52 smithi191 ceph-mon[31636]: pgmap v13180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24543.794182 secs 2024-04-21T17:13:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:52 smithi170 ceph-mon[31212]: pgmap v13180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24543.794182 secs 2024-04-21T17:13:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:52 smithi077 ceph-mon[27902]: pgmap v13180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24543.794182 secs 2024-04-21T17:13:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T17:13:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T17:13:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:13:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T17:13:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:13:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T17:13:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.443+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd70062000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd70062000 comp rx=0 tx=0).stop 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T17:13:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T17:13:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T17:13:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:13:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:54.487+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7002b070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T17:13:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:54 smithi191 ceph-mon[31636]: pgmap v13181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24545.554415 secs 2024-04-21T17:13:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:54 smithi170 ceph-mon[31212]: pgmap v13181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24545.554415 secs 2024-04-21T17:13:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:54 smithi077 ceph-mon[27902]: pgmap v13181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24545.554415 secs 2024-04-21T17:13:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:13:56.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:56 smithi191 ceph-mon[31636]: pgmap v13182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:56 smithi170 ceph-mon[31212]: pgmap v13182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:56 smithi077 ceph-mon[27902]: pgmap v13182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:13:57.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24548.794293 secs 2024-04-21T17:13:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:57.745+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:13:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:57.745+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:13:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:57.746+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:13:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:13:57.746+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:13:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24548.794293 secs 2024-04-21T17:13:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24548.794293 secs 2024-04-21T17:13:58.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:58 smithi170 ceph-mon[31212]: pgmap v13183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:58 smithi191 ceph-mon[31636]: pgmap v13183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:58 smithi077 ceph-mon[27902]: pgmap v13183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:13:59.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24550.554538 secs 2024-04-21T17:13:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24550.554538 secs 2024-04-21T17:13:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24550.554538 secs 2024-04-21T17:14:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:00 smithi191 ceph-mon[31636]: pgmap v13184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:00 smithi170 ceph-mon[31212]: pgmap v13184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:00 smithi077 ceph-mon[27902]: pgmap v13184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:02 smithi191 ceph-mon[31636]: pgmap v13185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24553.794412 secs 2024-04-21T17:14:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:02 smithi170 ceph-mon[31212]: pgmap v13185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24553.794412 secs 2024-04-21T17:14:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:02 smithi077 ceph-mon[27902]: pgmap v13185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24553.794412 secs 2024-04-21T17:14:04.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:04 smithi191 ceph-mon[31636]: pgmap v13186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:04.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24555.554675 secs 2024-04-21T17:14:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:04 smithi170 ceph-mon[31212]: pgmap v13186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24555.554675 secs 2024-04-21T17:14:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:04 smithi077 ceph-mon[27902]: pgmap v13186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24555.554675 secs 2024-04-21T17:14:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:05 smithi191 ceph-mon[31636]: osdmap e896: 12 total, 12 up, 12 in 2024-04-21T17:14:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:05 smithi170 ceph-mon[31212]: osdmap e896: 12 total, 12 up, 12 in 2024-04-21T17:14:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:05 smithi077 ceph-mon[27902]: osdmap e896: 12 total, 12 up, 12 in 2024-04-21T17:14:06.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:06 smithi191 ceph-mon[31636]: pgmap v13188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:14:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:06 smithi170 ceph-mon[31212]: pgmap v13188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:14:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:06 smithi077 ceph-mon[27902]: pgmap v13188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:14:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:07 smithi170 ceph-mon[31212]: osdmap e897: 12 total, 12 up, 12 in 2024-04-21T17:14:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24558.794516 secs 2024-04-21T17:14:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:07 smithi077 ceph-mon[27902]: osdmap e897: 12 total, 12 up, 12 in 2024-04-21T17:14:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24558.794516 secs 2024-04-21T17:14:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:07 smithi191 ceph-mon[31636]: osdmap e897: 12 total, 12 up, 12 in 2024-04-21T17:14:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24558.794516 secs 2024-04-21T17:14:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:08 smithi170 ceph-mon[31212]: pgmap v13190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:14:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:08 smithi077 ceph-mon[27902]: pgmap v13190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:14:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:08 smithi191 ceph-mon[31636]: pgmap v13190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:14:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24560.554783 secs 2024-04-21T17:14:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24560.554783 secs 2024-04-21T17:14:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24560.554783 secs 2024-04-21T17:14:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:10 smithi170 ceph-mon[31212]: pgmap v13191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:14:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:10 smithi077 ceph-mon[27902]: pgmap v13191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:14:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:10 smithi191 ceph-mon[31636]: pgmap v13191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:14:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:12 smithi170 ceph-mon[31212]: pgmap v13192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:14:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24563.794632 secs 2024-04-21T17:14:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:12 smithi077 ceph-mon[27902]: pgmap v13192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:14:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24563.794632 secs 2024-04-21T17:14:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:12 smithi191 ceph-mon[31636]: pgmap v13192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:14:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24563.794632 secs 2024-04-21T17:14:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:14 smithi170 ceph-mon[31212]: pgmap v13193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:14:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24565.554919 secs 2024-04-21T17:14:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:14 smithi077 ceph-mon[27902]: pgmap v13193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:14:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24565.554919 secs 2024-04-21T17:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:14 smithi191 ceph-mon[31636]: pgmap v13193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:14:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24565.554919 secs 2024-04-21T17:14:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:16 smithi170 ceph-mon[31212]: pgmap v13194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:14:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:16 smithi077 ceph-mon[27902]: pgmap v13194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:14:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:16 smithi191 ceph-mon[31636]: pgmap v13194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:14:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24568.794785 secs 2024-04-21T17:14:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24568.794785 secs 2024-04-21T17:14:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24568.794785 secs 2024-04-21T17:14:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:18 smithi170 ceph-mon[31212]: pgmap v13195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:14:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:18 smithi077 ceph-mon[27902]: pgmap v13195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:14:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:18 smithi191 ceph-mon[31636]: pgmap v13195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:14:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24570.555044 secs 2024-04-21T17:14:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24570.555044 secs 2024-04-21T17:14:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24570.555044 secs 2024-04-21T17:14:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:20 smithi170 ceph-mon[31212]: pgmap v13196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:14:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:20 smithi077 ceph-mon[27902]: pgmap v13196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:14:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:20 smithi191 ceph-mon[31636]: pgmap v13196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:14:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:22 smithi170 ceph-mon[31212]: pgmap v13197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:14:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24573.794886 secs 2024-04-21T17:14:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:22 smithi077 ceph-mon[27902]: pgmap v13197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:14:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24573.794886 secs 2024-04-21T17:14:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:22 smithi191 ceph-mon[31636]: pgmap v13197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:14:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24573.794886 secs 2024-04-21T17:14:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:24 smithi170 ceph-mon[31212]: pgmap v13198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24575.555166 secs 2024-04-21T17:14:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:14:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:14:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:14:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:14:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:24 smithi077 ceph-mon[27902]: pgmap v13198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24575.555166 secs 2024-04-21T17:14:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:14:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:14:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:14:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:14:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:24 smithi191 ceph-mon[31636]: pgmap v13198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24575.555166 secs 2024-04-21T17:14:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:14:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:14:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:14:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:14:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:26 smithi170 ceph-mon[31212]: pgmap v13199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:26 smithi077 ceph-mon[27902]: pgmap v13199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:26 smithi191 ceph-mon[31636]: pgmap v13199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24578.795008 secs 2024-04-21T17:14:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24578.795008 secs 2024-04-21T17:14:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24578.795008 secs 2024-04-21T17:14:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:28 smithi170 ceph-mon[31212]: pgmap v13200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:28 smithi077 ceph-mon[27902]: pgmap v13200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:28 smithi191 ceph-mon[31636]: pgmap v13200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24580.555289 secs 2024-04-21T17:14:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24580.555289 secs 2024-04-21T17:14:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24580.555289 secs 2024-04-21T17:14:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:30 smithi170 ceph-mon[31212]: pgmap v13201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:30 smithi077 ceph-mon[27902]: pgmap v13201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:30 smithi191 ceph-mon[31636]: pgmap v13201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:32 smithi170 ceph-mon[31212]: pgmap v13202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24583.795121 secs 2024-04-21T17:14:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:32 smithi077 ceph-mon[27902]: pgmap v13202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24583.795121 secs 2024-04-21T17:14:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:32 smithi191 ceph-mon[31636]: pgmap v13202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24583.795121 secs 2024-04-21T17:14:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:34 smithi170 ceph-mon[31212]: pgmap v13203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24585.555420 secs 2024-04-21T17:14:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:34 smithi077 ceph-mon[27902]: pgmap v13203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24585.555420 secs 2024-04-21T17:14:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:34 smithi191 ceph-mon[31636]: pgmap v13203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24585.555420 secs 2024-04-21T17:14:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:36 smithi170 ceph-mon[31212]: pgmap v13204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:36 smithi077 ceph-mon[27902]: pgmap v13204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:36 smithi191 ceph-mon[31636]: pgmap v13204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24588.795238 secs 2024-04-21T17:14:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24588.795238 secs 2024-04-21T17:14:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24588.795238 secs 2024-04-21T17:14:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:38 smithi170 ceph-mon[31212]: pgmap v13205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:38 smithi077 ceph-mon[27902]: pgmap v13205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:38 smithi191 ceph-mon[31636]: pgmap v13205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24590.555543 secs 2024-04-21T17:14:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24590.555543 secs 2024-04-21T17:14:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24590.555543 secs 2024-04-21T17:14:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:40 smithi077 ceph-mon[27902]: pgmap v13206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:40 smithi191 ceph-mon[31636]: pgmap v13206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:40 smithi170 ceph-mon[31212]: pgmap v13206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:42 smithi077 ceph-mon[27902]: pgmap v13207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24593.795352 secs 2024-04-21T17:14:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:42 smithi191 ceph-mon[31636]: pgmap v13207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24593.795352 secs 2024-04-21T17:14:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:42 smithi170 ceph-mon[31212]: pgmap v13207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24593.795352 secs 2024-04-21T17:14:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:44 smithi077 ceph-mon[27902]: pgmap v13208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24595.555667 secs 2024-04-21T17:14:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:44 smithi191 ceph-mon[31636]: pgmap v13208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24595.555667 secs 2024-04-21T17:14:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:44 smithi170 ceph-mon[31212]: pgmap v13208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24595.555667 secs 2024-04-21T17:14:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:46 smithi077 ceph-mon[27902]: pgmap v13209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:46 smithi191 ceph-mon[31636]: pgmap v13209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:47.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:46 smithi170 ceph-mon[31212]: pgmap v13209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24598.795490 secs 2024-04-21T17:14:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24598.795490 secs 2024-04-21T17:14:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24598.795490 secs 2024-04-21T17:14:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:48 smithi077 ceph-mon[27902]: pgmap v13210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:48 smithi191 ceph-mon[31636]: pgmap v13210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:48 smithi170 ceph-mon[31212]: pgmap v13210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24600.555782 secs 2024-04-21T17:14:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24600.555782 secs 2024-04-21T17:14:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24600.555782 secs 2024-04-21T17:14:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:50 smithi077 ceph-mon[27902]: pgmap v13211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:50 smithi191 ceph-mon[31636]: pgmap v13211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:50 smithi170 ceph-mon[31212]: pgmap v13211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:52 smithi077 ceph-mon[27902]: pgmap v13212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24603.795617 secs 2024-04-21T17:14:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:52 smithi191 ceph-mon[31636]: pgmap v13212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24603.795617 secs 2024-04-21T17:14:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:52 smithi170 ceph-mon[31212]: pgmap v13212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24603.795617 secs 2024-04-21T17:14:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:14:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:54 smithi077 ceph-mon[27902]: pgmap v13213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24605.555902 secs 2024-04-21T17:14:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:54 smithi191 ceph-mon[31636]: pgmap v13213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24605.555902 secs 2024-04-21T17:14:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:54 smithi170 ceph-mon[31212]: pgmap v13213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:14:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24605.555902 secs 2024-04-21T17:14:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:56 smithi077 ceph-mon[27902]: pgmap v13214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:56 smithi191 ceph-mon[31636]: pgmap v13214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:56 smithi170 ceph-mon[31212]: pgmap v13214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:14:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24608.795741 secs 2024-04-21T17:14:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24608.795741 secs 2024-04-21T17:14:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24608.795741 secs 2024-04-21T17:14:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:58 smithi077 ceph-mon[27902]: pgmap v13215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:58 smithi191 ceph-mon[31636]: pgmap v13215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:14:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:58 smithi170 ceph-mon[31212]: pgmap v13215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24610.556002 secs 2024-04-21T17:15:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24610.556002 secs 2024-04-21T17:15:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24610.556002 secs 2024-04-21T17:15:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:00 smithi077 ceph-mon[27902]: pgmap v13216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:00 smithi191 ceph-mon[31636]: pgmap v13216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:00 smithi170 ceph-mon[31212]: pgmap v13216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:02 smithi077 ceph-mon[27902]: pgmap v13217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24613.795887 secs 2024-04-21T17:15:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:02 smithi191 ceph-mon[31636]: pgmap v13217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24613.795887 secs 2024-04-21T17:15:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:02 smithi170 ceph-mon[31212]: pgmap v13217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24613.795887 secs 2024-04-21T17:15:04.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24615.556082 secs 2024-04-21T17:15:04.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24615.556082 secs 2024-04-21T17:15:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24615.556082 secs 2024-04-21T17:15:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:04 smithi077 ceph-mon[27902]: pgmap v13218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:04 smithi077 ceph-mon[27902]: osdmap e898: 12 total, 12 up, 12 in 2024-04-21T17:15:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:04 smithi191 ceph-mon[31636]: pgmap v13218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:04 smithi191 ceph-mon[31636]: osdmap e898: 12 total, 12 up, 12 in 2024-04-21T17:15:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:04 smithi170 ceph-mon[31212]: pgmap v13218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:04 smithi170 ceph-mon[31212]: osdmap e898: 12 total, 12 up, 12 in 2024-04-21T17:15:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:06 smithi077 ceph-mon[27902]: pgmap v13220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:15:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:06 smithi077 ceph-mon[27902]: osdmap e899: 12 total, 12 up, 12 in 2024-04-21T17:15:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:06 smithi191 ceph-mon[31636]: pgmap v13220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:15:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:06 smithi191 ceph-mon[31636]: osdmap e899: 12 total, 12 up, 12 in 2024-04-21T17:15:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:06 smithi170 ceph-mon[31212]: pgmap v13220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:15:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:06 smithi170 ceph-mon[31212]: osdmap e899: 12 total, 12 up, 12 in 2024-04-21T17:15:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24618.796042 secs 2024-04-21T17:15:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24618.796042 secs 2024-04-21T17:15:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24618.796042 secs 2024-04-21T17:15:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:08 smithi191 ceph-mon[31636]: pgmap v13222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:15:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24620.556161 secs 2024-04-21T17:15:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:08 smithi170 ceph-mon[31212]: pgmap v13222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:15:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24620.556161 secs 2024-04-21T17:15:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:08 smithi077 ceph-mon[27902]: pgmap v13222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:15:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24620.556161 secs 2024-04-21T17:15:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:10 smithi191 ceph-mon[31636]: pgmap v13223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:15:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:10 smithi170 ceph-mon[31212]: pgmap v13223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:15:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:10 smithi077 ceph-mon[27902]: pgmap v13223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:15:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:12 smithi191 ceph-mon[31636]: pgmap v13224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:15:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24623.796155 secs 2024-04-21T17:15:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:12 smithi170 ceph-mon[31212]: pgmap v13224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:15:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24623.796155 secs 2024-04-21T17:15:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:12 smithi077 ceph-mon[27902]: pgmap v13224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:15:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24623.796155 secs 2024-04-21T17:15:14.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24625.556295 secs 2024-04-21T17:15:14.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24625.556295 secs 2024-04-21T17:15:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24625.556295 secs 2024-04-21T17:15:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:14 smithi191 ceph-mon[31636]: pgmap v13225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:15:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:14 smithi170 ceph-mon[31212]: pgmap v13225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:15:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:14 smithi077 ceph-mon[27902]: pgmap v13225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:15:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:16 smithi191 ceph-mon[31636]: pgmap v13226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:15:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:16 smithi170 ceph-mon[31212]: pgmap v13226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:15:17.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:16 smithi077 ceph-mon[27902]: pgmap v13226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:15:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24628.796266 secs 2024-04-21T17:15:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24628.796266 secs 2024-04-21T17:15:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24628.796266 secs 2024-04-21T17:15:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:18 smithi191 ceph-mon[31636]: pgmap v13227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:15:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24630.556415 secs 2024-04-21T17:15:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:18 smithi170 ceph-mon[31212]: pgmap v13227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:15:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24630.556415 secs 2024-04-21T17:15:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:18 smithi077 ceph-mon[27902]: pgmap v13227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:15:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24630.556415 secs 2024-04-21T17:15:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:20 smithi191 ceph-mon[31636]: pgmap v13228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:15:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:20 smithi170 ceph-mon[31212]: pgmap v13228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:15:21.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:20 smithi077 ceph-mon[27902]: pgmap v13228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:15:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:22 smithi191 ceph-mon[31636]: pgmap v13229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:15:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24633.796403 secs 2024-04-21T17:15:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:22 smithi170 ceph-mon[31212]: pgmap v13229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:15:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24633.796403 secs 2024-04-21T17:15:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:22 smithi077 ceph-mon[27902]: pgmap v13229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:15:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24633.796403 secs 2024-04-21T17:15:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:23 smithi191 ceph-mon[31636]: pgmap v13230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24635.556539 secs 2024-04-21T17:15:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:23 smithi170 ceph-mon[31212]: pgmap v13230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24635.556539 secs 2024-04-21T17:15:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:23 smithi077 ceph-mon[27902]: pgmap v13230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24635.556539 secs 2024-04-21T17:15:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:15:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:15:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:15:26.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:15:26.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:15:26.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:15:26.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:25 smithi191 ceph-mon[31636]: pgmap v13231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:15:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:15:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:15:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:25 smithi170 ceph-mon[31212]: pgmap v13231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:15:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:15:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:15:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:25 smithi077 ceph-mon[27902]: pgmap v13231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24638.796543 secs 2024-04-21T17:15:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24638.796543 secs 2024-04-21T17:15:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24638.796543 secs 2024-04-21T17:15:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:28 smithi170 ceph-mon[31212]: pgmap v13232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:28.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:28 smithi191 ceph-mon[31636]: pgmap v13232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:28 smithi077 ceph-mon[27902]: pgmap v13232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24640.556689 secs 2024-04-21T17:15:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24640.556689 secs 2024-04-21T17:15:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24640.556689 secs 2024-04-21T17:15:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:30 smithi170 ceph-mon[31212]: pgmap v13233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:30 smithi077 ceph-mon[27902]: pgmap v13233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:30 smithi191 ceph-mon[31636]: pgmap v13233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:32 smithi077 ceph-mon[27902]: pgmap v13234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24643.796619 secs 2024-04-21T17:15:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:32 smithi191 ceph-mon[31636]: pgmap v13234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24643.796619 secs 2024-04-21T17:15:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:32 smithi170 ceph-mon[31212]: pgmap v13234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24643.796619 secs 2024-04-21T17:15:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:34 smithi077 ceph-mon[27902]: pgmap v13235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24645.556828 secs 2024-04-21T17:15:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:34 smithi191 ceph-mon[31636]: pgmap v13235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24645.556828 secs 2024-04-21T17:15:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:34 smithi170 ceph-mon[31212]: pgmap v13235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24645.556828 secs 2024-04-21T17:15:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:36 smithi077 ceph-mon[27902]: pgmap v13236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:36 smithi191 ceph-mon[31636]: pgmap v13236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:36 smithi170 ceph-mon[31212]: pgmap v13236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24648.796772 secs 2024-04-21T17:15:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24648.796772 secs 2024-04-21T17:15:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24648.796772 secs 2024-04-21T17:15:38.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:38 smithi077 ceph-mon[27902]: pgmap v13237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:38 smithi191 ceph-mon[31636]: pgmap v13237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:38 smithi170 ceph-mon[31212]: pgmap v13237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24650.556975 secs 2024-04-21T17:15:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24650.556975 secs 2024-04-21T17:15:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24650.556975 secs 2024-04-21T17:15:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:40 smithi077 ceph-mon[27902]: pgmap v13238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:40 smithi191 ceph-mon[31636]: pgmap v13238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:40 smithi170 ceph-mon[31212]: pgmap v13238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:15:42.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:42 smithi077 ceph-mon[27902]: pgmap v13239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:42.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24653.796883 secs 2024-04-21T17:15:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:42 smithi191 ceph-mon[31636]: pgmap v13239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24653.796883 secs 2024-04-21T17:15:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:42 smithi170 ceph-mon[31212]: pgmap v13239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24653.796883 secs 2024-04-21T17:15:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:44 smithi191 ceph-mon[31636]: pgmap v13240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24655.557032 secs 2024-04-21T17:15:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:44 smithi170 ceph-mon[31212]: pgmap v13240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24655.557032 secs 2024-04-21T17:15:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:44 smithi077 ceph-mon[27902]: pgmap v13240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24655.557032 secs 2024-04-21T17:15:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:46 smithi191 ceph-mon[31636]: pgmap v13241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:46 smithi170 ceph-mon[31212]: pgmap v13241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:46 smithi077 ceph-mon[27902]: pgmap v13241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:47.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24658.797009 secs 2024-04-21T17:15:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24658.797009 secs 2024-04-21T17:15:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24658.797009 secs 2024-04-21T17:15:48.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:48 smithi191 ceph-mon[31636]: pgmap v13242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:48 smithi170 ceph-mon[31212]: pgmap v13242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:48 smithi077 ceph-mon[27902]: pgmap v13242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24660.557105 secs 2024-04-21T17:15:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24660.557105 secs 2024-04-21T17:15:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24660.557105 secs 2024-04-21T17:15:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:50 smithi191 ceph-mon[31636]: pgmap v13243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:50 smithi170 ceph-mon[31212]: pgmap v13243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:50 smithi077 ceph-mon[27902]: pgmap v13243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:52 smithi191 ceph-mon[31636]: pgmap v13244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24663.797153 secs 2024-04-21T17:15:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:52 smithi170 ceph-mon[31212]: pgmap v13244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24663.797153 secs 2024-04-21T17:15:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:52 smithi077 ceph-mon[27902]: pgmap v13244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24663.797153 secs 2024-04-21T17:15:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:54 smithi191 ceph-mon[31636]: pgmap v13245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24665.557166 secs 2024-04-21T17:15:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:54 smithi170 ceph-mon[31212]: pgmap v13245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24665.557166 secs 2024-04-21T17:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:54 smithi077 ceph-mon[27902]: pgmap v13245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24665.557166 secs 2024-04-21T17:15:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:15:56.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:56 smithi191 ceph-mon[31636]: pgmap v13246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:56 smithi170 ceph-mon[31212]: pgmap v13246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:56 smithi077 ceph-mon[27902]: pgmap v13246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:15:57.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24668.797262 secs 2024-04-21T17:15:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24668.797262 secs 2024-04-21T17:15:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24668.797262 secs 2024-04-21T17:15:58.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:58 smithi170 ceph-mon[31212]: pgmap v13247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:58 smithi191 ceph-mon[31636]: pgmap v13247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:58 smithi077 ceph-mon[27902]: pgmap v13247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:15:59.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24670.557268 secs 2024-04-21T17:15:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24670.557268 secs 2024-04-21T17:15:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24670.557268 secs 2024-04-21T17:16:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:00 smithi191 ceph-mon[31636]: pgmap v13248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:00 smithi170 ceph-mon[31212]: pgmap v13248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:00.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:00 smithi077 ceph-mon[27902]: pgmap v13248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:02 smithi191 ceph-mon[31636]: pgmap v13249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:02.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24673.797378 secs 2024-04-21T17:16:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:02 smithi170 ceph-mon[31212]: pgmap v13249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:02.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24673.797378 secs 2024-04-21T17:16:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:02 smithi077 ceph-mon[27902]: pgmap v13249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24673.797378 secs 2024-04-21T17:16:04.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:04 smithi191 ceph-mon[31636]: pgmap v13250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:04.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24675.557342 secs 2024-04-21T17:16:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:04 smithi170 ceph-mon[31212]: pgmap v13250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24675.557342 secs 2024-04-21T17:16:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:04 smithi077 ceph-mon[27902]: pgmap v13250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24675.557342 secs 2024-04-21T17:16:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:05 smithi191 ceph-mon[31636]: osdmap e900: 12 total, 12 up, 12 in 2024-04-21T17:16:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:05 smithi170 ceph-mon[31212]: osdmap e900: 12 total, 12 up, 12 in 2024-04-21T17:16:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:05 smithi077 ceph-mon[27902]: osdmap e900: 12 total, 12 up, 12 in 2024-04-21T17:16:06.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:06 smithi191 ceph-mon[31636]: pgmap v13252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:06 smithi170 ceph-mon[31212]: pgmap v13252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:06 smithi077 ceph-mon[27902]: pgmap v13252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24678.797500 secs 2024-04-21T17:16:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24678.797500 secs 2024-04-21T17:16:07.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24678.797500 secs 2024-04-21T17:16:08.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:08 smithi191 ceph-mon[31636]: pgmap v13253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:08 smithi170 ceph-mon[31212]: pgmap v13253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:08.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:08 smithi077 ceph-mon[27902]: pgmap v13253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:09.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24680.557478 secs 2024-04-21T17:16:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24680.557478 secs 2024-04-21T17:16:09.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24680.557478 secs 2024-04-21T17:16:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:10 smithi191 ceph-mon[31636]: pgmap v13254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:10 smithi170 ceph-mon[31212]: pgmap v13254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:10.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:10 smithi077 ceph-mon[27902]: pgmap v13254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:16:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:12 smithi170 ceph-mon[31212]: pgmap v13255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:16:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:12 smithi170 ceph-mon[31212]: osdmap e901: 12 total, 12 up, 12 in 2024-04-21T17:16:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24683.797597 secs 2024-04-21T17:16:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:12 smithi077 ceph-mon[27902]: pgmap v13255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:16:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:12 smithi077 ceph-mon[27902]: osdmap e901: 12 total, 12 up, 12 in 2024-04-21T17:16:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24683.797597 secs 2024-04-21T17:16:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:12 smithi191 ceph-mon[31636]: pgmap v13255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:16:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:12 smithi191 ceph-mon[31636]: osdmap e901: 12 total, 12 up, 12 in 2024-04-21T17:16:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24683.797597 secs 2024-04-21T17:16:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:14 smithi170 ceph-mon[31212]: pgmap v13257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:16:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24685.557591 secs 2024-04-21T17:16:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:14 smithi077 ceph-mon[27902]: pgmap v13257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:16:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24685.557591 secs 2024-04-21T17:16:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:14 smithi191 ceph-mon[31636]: pgmap v13257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:16:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24685.557591 secs 2024-04-21T17:16:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:16 smithi170 ceph-mon[31212]: pgmap v13258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:16 smithi077 ceph-mon[27902]: pgmap v13258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:16 smithi191 ceph-mon[31636]: pgmap v13258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24688.797737 secs 2024-04-21T17:16:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24688.797737 secs 2024-04-21T17:16:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24688.797737 secs 2024-04-21T17:16:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:18 smithi170 ceph-mon[31212]: pgmap v13259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:18 smithi077 ceph-mon[27902]: pgmap v13259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:18 smithi191 ceph-mon[31636]: pgmap v13259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24690.557726 secs 2024-04-21T17:16:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24690.557726 secs 2024-04-21T17:16:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24690.557726 secs 2024-04-21T17:16:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:20 smithi170 ceph-mon[31212]: pgmap v13260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:20 smithi077 ceph-mon[27902]: pgmap v13260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:20 smithi191 ceph-mon[31636]: pgmap v13260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:16:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:22 smithi170 ceph-mon[31212]: pgmap v13261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:16:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24693.797802 secs 2024-04-21T17:16:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:22 smithi077 ceph-mon[27902]: pgmap v13261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:16:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24693.797802 secs 2024-04-21T17:16:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:22 smithi191 ceph-mon[31636]: pgmap v13261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:16:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24693.797802 secs 2024-04-21T17:16:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:24 smithi170 ceph-mon[31212]: pgmap v13262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:16:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24695.557837 secs 2024-04-21T17:16:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:24 smithi077 ceph-mon[27902]: pgmap v13262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:16:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24695.557837 secs 2024-04-21T17:16:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:24 smithi191 ceph-mon[31636]: pgmap v13262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:16:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24695.557837 secs 2024-04-21T17:16:26.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:16:26.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:16:26.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:16:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:26 smithi170 ceph-mon[31212]: pgmap v13263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:16:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:16:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:16:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:26 smithi077 ceph-mon[27902]: pgmap v13263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:16:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:16:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:16:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:26 smithi191 ceph-mon[31636]: pgmap v13263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:16:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:16:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:16:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24698.797896 secs 2024-04-21T17:16:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24698.797896 secs 2024-04-21T17:16:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24698.797896 secs 2024-04-21T17:16:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:28 smithi077 ceph-mon[27902]: pgmap v13264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:28 smithi191 ceph-mon[31636]: pgmap v13264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:28 smithi170 ceph-mon[31212]: pgmap v13264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:30.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24700.557930 secs 2024-04-21T17:16:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24700.557930 secs 2024-04-21T17:16:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24700.557930 secs 2024-04-21T17:16:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:30 smithi077 ceph-mon[27902]: pgmap v13265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:30 smithi191 ceph-mon[31636]: pgmap v13265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:30 smithi170 ceph-mon[31212]: pgmap v13265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:32 smithi077 ceph-mon[27902]: pgmap v13266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24703.798012 secs 2024-04-21T17:16:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:32 smithi191 ceph-mon[31636]: pgmap v13266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24703.798012 secs 2024-04-21T17:16:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:32 smithi170 ceph-mon[31212]: pgmap v13266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24703.798012 secs 2024-04-21T17:16:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:34 smithi077 ceph-mon[27902]: pgmap v13267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24705.558050 secs 2024-04-21T17:16:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:34 smithi191 ceph-mon[31636]: pgmap v13267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24705.558050 secs 2024-04-21T17:16:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:34 smithi170 ceph-mon[31212]: pgmap v13267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24705.558050 secs 2024-04-21T17:16:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:36 smithi077 ceph-mon[27902]: pgmap v13268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:36 smithi191 ceph-mon[31636]: pgmap v13268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:36 smithi170 ceph-mon[31212]: pgmap v13268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24708.798136 secs 2024-04-21T17:16:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24708.798136 secs 2024-04-21T17:16:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24708.798136 secs 2024-04-21T17:16:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:38 smithi077 ceph-mon[27902]: pgmap v13269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:38 smithi191 ceph-mon[31636]: pgmap v13269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:38 smithi170 ceph-mon[31212]: pgmap v13269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24710.558164 secs 2024-04-21T17:16:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24710.558164 secs 2024-04-21T17:16:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24710.558164 secs 2024-04-21T17:16:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:40 smithi077 ceph-mon[27902]: pgmap v13270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:40 smithi191 ceph-mon[31636]: pgmap v13270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:40 smithi170 ceph-mon[31212]: pgmap v13270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:42 smithi077 ceph-mon[27902]: pgmap v13271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24713.798228 secs 2024-04-21T17:16:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:42 smithi191 ceph-mon[31636]: pgmap v13271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24713.798228 secs 2024-04-21T17:16:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:42 smithi170 ceph-mon[31212]: pgmap v13271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24713.798228 secs 2024-04-21T17:16:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:44 smithi077 ceph-mon[27902]: pgmap v13272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24715.558243 secs 2024-04-21T17:16:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:44 smithi191 ceph-mon[31636]: pgmap v13272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24715.558243 secs 2024-04-21T17:16:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:44 smithi170 ceph-mon[31212]: pgmap v13272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:16:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24715.558243 secs 2024-04-21T17:16:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:46 smithi077 ceph-mon[27902]: pgmap v13273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:46 smithi191 ceph-mon[31636]: pgmap v13273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:46 smithi170 ceph-mon[31212]: pgmap v13273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24718.798350 secs 2024-04-21T17:16:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24718.798350 secs 2024-04-21T17:16:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24718.798350 secs 2024-04-21T17:16:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:48 smithi077 ceph-mon[27902]: pgmap v13274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:48 smithi191 ceph-mon[31636]: pgmap v13274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:48 smithi170 ceph-mon[31212]: pgmap v13274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24720.558358 secs 2024-04-21T17:16:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24720.558358 secs 2024-04-21T17:16:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24720.558358 secs 2024-04-21T17:16:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:50 smithi077 ceph-mon[27902]: pgmap v13275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:50 smithi191 ceph-mon[31636]: pgmap v13275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:50 smithi170 ceph-mon[31212]: pgmap v13275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:52 smithi077 ceph-mon[27902]: pgmap v13276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24723.798428 secs 2024-04-21T17:16:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:52 smithi191 ceph-mon[31636]: pgmap v13276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24723.798428 secs 2024-04-21T17:16:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:52 smithi170 ceph-mon[31212]: pgmap v13276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24723.798428 secs 2024-04-21T17:16:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:16:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:54 smithi077 ceph-mon[27902]: pgmap v13277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24725.558466 secs 2024-04-21T17:16:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:54 smithi191 ceph-mon[31636]: pgmap v13277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24725.558466 secs 2024-04-21T17:16:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:54 smithi170 ceph-mon[31212]: pgmap v13277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24725.558466 secs 2024-04-21T17:16:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:56 smithi077 ceph-mon[27902]: pgmap v13278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:56 smithi191 ceph-mon[31636]: pgmap v13278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:56 smithi170 ceph-mon[31212]: pgmap v13278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:16:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:16:57.770+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:16:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:16:57.770+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:16:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:16:57.770+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:16:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:16:57.770+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:16:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24728.798522 secs 2024-04-21T17:16:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24728.798522 secs 2024-04-21T17:16:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24728.798522 secs 2024-04-21T17:16:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:58 smithi077 ceph-mon[27902]: pgmap v13279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:58 smithi191 ceph-mon[31636]: pgmap v13279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:16:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:58 smithi170 ceph-mon[31212]: pgmap v13279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24730.558536 secs 2024-04-21T17:17:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24730.558536 secs 2024-04-21T17:17:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24730.558536 secs 2024-04-21T17:17:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:00 smithi077 ceph-mon[27902]: pgmap v13280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:00 smithi191 ceph-mon[31636]: pgmap v13280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:00 smithi170 ceph-mon[31212]: pgmap v13280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:02 smithi191 ceph-mon[31636]: pgmap v13281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T17:17:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24733.798644 secs 2024-04-21T17:17:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:02 smithi170 ceph-mon[31212]: pgmap v13281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T17:17:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24733.798644 secs 2024-04-21T17:17:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:02 smithi077 ceph-mon[27902]: pgmap v13281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T17:17:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24733.798644 secs 2024-04-21T17:17:04.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24735.558668 secs 2024-04-21T17:17:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24735.558668 secs 2024-04-21T17:17:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24735.558668 secs 2024-04-21T17:17:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:04 smithi191 ceph-mon[31636]: pgmap v13282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T17:17:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:04 smithi191 ceph-mon[31636]: osdmap e902: 12 total, 12 up, 12 in 2024-04-21T17:17:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:04 smithi170 ceph-mon[31212]: pgmap v13282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T17:17:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:04 smithi170 ceph-mon[31212]: osdmap e902: 12 total, 12 up, 12 in 2024-04-21T17:17:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:04 smithi077 ceph-mon[27902]: pgmap v13282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T17:17:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:04 smithi077 ceph-mon[27902]: osdmap e902: 12 total, 12 up, 12 in 2024-04-21T17:17:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:06 smithi191 ceph-mon[31636]: pgmap v13284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:17:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:06 smithi191 ceph-mon[31636]: osdmap e903: 12 total, 12 up, 12 in 2024-04-21T17:17:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:06 smithi170 ceph-mon[31212]: pgmap v13284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:17:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:06 smithi170 ceph-mon[31212]: osdmap e903: 12 total, 12 up, 12 in 2024-04-21T17:17:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:06 smithi077 ceph-mon[27902]: pgmap v13284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:17:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:06 smithi077 ceph-mon[27902]: osdmap e903: 12 total, 12 up, 12 in 2024-04-21T17:17:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24738.798792 secs 2024-04-21T17:17:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24738.798792 secs 2024-04-21T17:17:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24738.798792 secs 2024-04-21T17:17:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:08 smithi191 ceph-mon[31636]: pgmap v13286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:17:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24740.558729 secs 2024-04-21T17:17:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:08 smithi170 ceph-mon[31212]: pgmap v13286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:17:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24740.558729 secs 2024-04-21T17:17:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:08 smithi077 ceph-mon[27902]: pgmap v13286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:17:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24740.558729 secs 2024-04-21T17:17:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:10 smithi191 ceph-mon[31636]: pgmap v13287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-04-21T17:17:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:10 smithi170 ceph-mon[31212]: pgmap v13287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-04-21T17:17:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:10 smithi077 ceph-mon[27902]: pgmap v13287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-04-21T17:17:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:12 smithi191 ceph-mon[31636]: pgmap v13288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T17:17:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24743.798907 secs 2024-04-21T17:17:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:12 smithi170 ceph-mon[31212]: pgmap v13288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T17:17:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24743.798907 secs 2024-04-21T17:17:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:12 smithi077 ceph-mon[27902]: pgmap v13288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T17:17:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24743.798907 secs 2024-04-21T17:17:14.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24745.558844 secs 2024-04-21T17:17:14.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24745.558844 secs 2024-04-21T17:17:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24745.558844 secs 2024-04-21T17:17:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:14 smithi191 ceph-mon[31636]: pgmap v13289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 KiB/s wr, 25 op/s 2024-04-21T17:17:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:14 smithi170 ceph-mon[31212]: pgmap v13289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 KiB/s wr, 25 op/s 2024-04-21T17:17:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:14 smithi077 ceph-mon[27902]: pgmap v13289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 KiB/s wr, 25 op/s 2024-04-21T17:17:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:16 smithi191 ceph-mon[31636]: pgmap v13290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:17:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:16 smithi170 ceph-mon[31212]: pgmap v13290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:17:17.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:16 smithi077 ceph-mon[27902]: pgmap v13290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:17:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24748.799011 secs 2024-04-21T17:17:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24748.799011 secs 2024-04-21T17:17:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24748.799011 secs 2024-04-21T17:17:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:18 smithi191 ceph-mon[31636]: pgmap v13291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:17:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24750.558982 secs 2024-04-21T17:17:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:18 smithi170 ceph-mon[31212]: pgmap v13291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:17:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24750.558982 secs 2024-04-21T17:17:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:18 smithi077 ceph-mon[27902]: pgmap v13291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:17:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24750.558982 secs 2024-04-21T17:17:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:20 smithi191 ceph-mon[31636]: pgmap v13292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:17:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:20 smithi170 ceph-mon[31212]: pgmap v13292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:17:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:20 smithi077 ceph-mon[27902]: pgmap v13292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:17:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:22 smithi191 ceph-mon[31636]: pgmap v13293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:17:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24753.799138 secs 2024-04-21T17:17:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:22 smithi170 ceph-mon[31212]: pgmap v13293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:17:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24753.799138 secs 2024-04-21T17:17:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:22 smithi077 ceph-mon[27902]: pgmap v13293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:17:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24753.799138 secs 2024-04-21T17:17:24.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:23 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24755.559073 secs 2024-04-21T17:17:24.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:23 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24755.559073 secs 2024-04-21T17:17:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:23 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24755.559073 secs 2024-04-21T17:17:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:24 smithi191 ceph-mon[31636]: pgmap v13294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:24 smithi170 ceph-mon[31212]: pgmap v13294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:24 smithi077 ceph-mon[27902]: pgmap v13294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:26.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:25 smithi191 ceph-mon[31636]: pgmap v13295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:26.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:25 smithi170 ceph-mon[31212]: pgmap v13295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:25 smithi077 ceph-mon[27902]: pgmap v13295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:17:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:17:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:17:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:17:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:17:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:17:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:17:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:17:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:17:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:17:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:17:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:17:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24758.799284 secs 2024-04-21T17:17:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:27 smithi170 ceph-mon[31212]: pgmap v13296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24758.799284 secs 2024-04-21T17:17:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:27 smithi191 ceph-mon[31636]: pgmap v13296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24758.799284 secs 2024-04-21T17:17:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:27 smithi077 ceph-mon[27902]: pgmap v13296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24760.559196 secs 2024-04-21T17:17:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24760.559196 secs 2024-04-21T17:17:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24760.559196 secs 2024-04-21T17:17:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:29 smithi191 ceph-mon[31636]: pgmap v13297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:29 smithi170 ceph-mon[31212]: pgmap v13297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:29 smithi077 ceph-mon[27902]: pgmap v13297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:32 smithi191 ceph-mon[31636]: pgmap v13298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24763.799450 secs 2024-04-21T17:17:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:32 smithi170 ceph-mon[31212]: pgmap v13298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24763.799450 secs 2024-04-21T17:17:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:32 smithi077 ceph-mon[27902]: pgmap v13298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24763.799450 secs 2024-04-21T17:17:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:34 smithi191 ceph-mon[31636]: pgmap v13299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24765.559311 secs 2024-04-21T17:17:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:34 smithi170 ceph-mon[31212]: pgmap v13299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24765.559311 secs 2024-04-21T17:17:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:34 smithi077 ceph-mon[27902]: pgmap v13299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24765.559311 secs 2024-04-21T17:17:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:36 smithi191 ceph-mon[31636]: pgmap v13300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:36 smithi170 ceph-mon[31212]: pgmap v13300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:36 smithi077 ceph-mon[27902]: pgmap v13300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24768.799592 secs 2024-04-21T17:17:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24768.799592 secs 2024-04-21T17:17:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24768.799592 secs 2024-04-21T17:17:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:38 smithi191 ceph-mon[31636]: pgmap v13301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:38 smithi170 ceph-mon[31212]: pgmap v13301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:38 smithi077 ceph-mon[27902]: pgmap v13301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24770.559450 secs 2024-04-21T17:17:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24770.559450 secs 2024-04-21T17:17:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24770.559450 secs 2024-04-21T17:17:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:40 smithi191 ceph-mon[31636]: pgmap v13302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:40 smithi170 ceph-mon[31212]: pgmap v13302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:40 smithi077 ceph-mon[27902]: pgmap v13302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:42 smithi191 ceph-mon[31636]: pgmap v13303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:42.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24773.799715 secs 2024-04-21T17:17:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:42 smithi170 ceph-mon[31212]: pgmap v13303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24773.799715 secs 2024-04-21T17:17:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:42 smithi077 ceph-mon[27902]: pgmap v13303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24773.799715 secs 2024-04-21T17:17:44.688 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:44 smithi077 ceph-mon[27902]: pgmap v13304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:44.688 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24775.559595 secs 2024-04-21T17:17:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:44 smithi191 ceph-mon[31636]: pgmap v13304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:44.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24775.559595 secs 2024-04-21T17:17:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:44 smithi170 ceph-mon[31212]: pgmap v13304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24775.559595 secs 2024-04-21T17:17:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:46 smithi191 ceph-mon[31636]: pgmap v13305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:46 smithi170 ceph-mon[31212]: pgmap v13305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:46 smithi077 ceph-mon[27902]: pgmap v13305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24778.799819 secs 2024-04-21T17:17:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24778.799819 secs 2024-04-21T17:17:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24778.799819 secs 2024-04-21T17:17:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:48 smithi191 ceph-mon[31636]: pgmap v13306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:48 smithi170 ceph-mon[31212]: pgmap v13306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:48 smithi077 ceph-mon[27902]: pgmap v13306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24780.559741 secs 2024-04-21T17:17:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24780.559741 secs 2024-04-21T17:17:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24780.559741 secs 2024-04-21T17:17:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:50 smithi191 ceph-mon[31636]: pgmap v13307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:50 smithi170 ceph-mon[31212]: pgmap v13307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:50 smithi077 ceph-mon[27902]: pgmap v13307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:52 smithi191 ceph-mon[31636]: pgmap v13308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:52.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24783.799953 secs 2024-04-21T17:17:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:52 smithi170 ceph-mon[31212]: pgmap v13308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24783.799953 secs 2024-04-21T17:17:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:52 smithi077 ceph-mon[27902]: pgmap v13308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24783.799953 secs 2024-04-21T17:17:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:54 smithi191 ceph-mon[31636]: pgmap v13309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:54.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24785.559884 secs 2024-04-21T17:17:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:54 smithi170 ceph-mon[31212]: pgmap v13309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24785.559884 secs 2024-04-21T17:17:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:54 smithi077 ceph-mon[27902]: pgmap v13309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:54.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24785.559884 secs 2024-04-21T17:17:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:17:56.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:56 smithi191 ceph-mon[31636]: pgmap v13310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:56.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:56 smithi170 ceph-mon[31212]: pgmap v13310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:56 smithi077 ceph-mon[27902]: pgmap v13310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:17:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24788.800109 secs 2024-04-21T17:17:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24788.800109 secs 2024-04-21T17:17:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24788.800109 secs 2024-04-21T17:17:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:58 smithi170 ceph-mon[31212]: pgmap v13311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:58 smithi077 ceph-mon[27902]: pgmap v13311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:17:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:58 smithi191 ceph-mon[31636]: pgmap v13311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24790.559958 secs 2024-04-21T17:18:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24790.559958 secs 2024-04-21T17:18:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24790.559958 secs 2024-04-21T17:18:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:00 smithi170 ceph-mon[31212]: pgmap v13312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:00 smithi077 ceph-mon[27902]: pgmap v13312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:00 smithi191 ceph-mon[31636]: pgmap v13312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:02 smithi170 ceph-mon[31212]: pgmap v13313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24793.800236 secs 2024-04-21T17:18:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:02 smithi077 ceph-mon[27902]: pgmap v13313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24793.800236 secs 2024-04-21T17:18:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:02 smithi191 ceph-mon[31636]: pgmap v13313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24793.800236 secs 2024-04-21T17:18:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:04 smithi077 ceph-mon[27902]: pgmap v13314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24795.560055 secs 2024-04-21T17:18:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:04 smithi077 ceph-mon[27902]: osdmap e904: 12 total, 12 up, 12 in 2024-04-21T17:18:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:04 smithi191 ceph-mon[31636]: pgmap v13314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24795.560055 secs 2024-04-21T17:18:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:04 smithi191 ceph-mon[31636]: osdmap e904: 12 total, 12 up, 12 in 2024-04-21T17:18:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:04 smithi170 ceph-mon[31212]: pgmap v13314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24795.560055 secs 2024-04-21T17:18:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:04 smithi170 ceph-mon[31212]: osdmap e904: 12 total, 12 up, 12 in 2024-04-21T17:18:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:06 smithi077 ceph-mon[27902]: pgmap v13316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:18:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:06 smithi077 ceph-mon[27902]: osdmap e905: 12 total, 12 up, 12 in 2024-04-21T17:18:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:06 smithi191 ceph-mon[31636]: pgmap v13316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:18:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:06 smithi191 ceph-mon[31636]: osdmap e905: 12 total, 12 up, 12 in 2024-04-21T17:18:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:06 smithi170 ceph-mon[31212]: pgmap v13316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:18:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:06 smithi170 ceph-mon[31212]: osdmap e905: 12 total, 12 up, 12 in 2024-04-21T17:18:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24798.800348 secs 2024-04-21T17:18:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24798.800348 secs 2024-04-21T17:18:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24798.800348 secs 2024-04-21T17:18:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:08 smithi077 ceph-mon[27902]: pgmap v13318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:18:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:08 smithi191 ceph-mon[31636]: pgmap v13318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:18:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:08 smithi170 ceph-mon[31212]: pgmap v13318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:18:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24800.560132 secs 2024-04-21T17:18:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24800.560132 secs 2024-04-21T17:18:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24800.560132 secs 2024-04-21T17:18:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:10 smithi077 ceph-mon[27902]: pgmap v13319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:18:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:10 smithi191 ceph-mon[31636]: pgmap v13319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:18:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:10 smithi170 ceph-mon[31212]: pgmap v13319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:18:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:12 smithi077 ceph-mon[27902]: pgmap v13320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:18:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24803.800469 secs 2024-04-21T17:18:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:12 smithi191 ceph-mon[31636]: pgmap v13320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:18:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24803.800469 secs 2024-04-21T17:18:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:12 smithi170 ceph-mon[31212]: pgmap v13320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:18:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24803.800469 secs 2024-04-21T17:18:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:14 smithi077 ceph-mon[27902]: pgmap v13321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:18:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24805.560206 secs 2024-04-21T17:18:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:14 smithi191 ceph-mon[31636]: pgmap v13321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:18:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24805.560206 secs 2024-04-21T17:18:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:14 smithi170 ceph-mon[31212]: pgmap v13321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:18:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24805.560206 secs 2024-04-21T17:18:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:16 smithi077 ceph-mon[27902]: pgmap v13322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:18:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:16 smithi191 ceph-mon[31636]: pgmap v13322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:18:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:16 smithi170 ceph-mon[31212]: pgmap v13322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:18:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24808.800605 secs 2024-04-21T17:18:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24808.800605 secs 2024-04-21T17:18:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24808.800605 secs 2024-04-21T17:18:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:18 smithi077 ceph-mon[27902]: pgmap v13323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:18:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:18 smithi191 ceph-mon[31636]: pgmap v13323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:18:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:18 smithi170 ceph-mon[31212]: pgmap v13323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:18:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 24995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24810.560351 secs 2024-04-21T17:18:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24810.560351 secs 2024-04-21T17:18:20.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24810.560351 secs 2024-04-21T17:18:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:20 smithi077 ceph-mon[27902]: pgmap v13324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:18:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:20 smithi191 ceph-mon[31636]: pgmap v13324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:18:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:20 smithi170 ceph-mon[31212]: pgmap v13324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:18:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:22 smithi077 ceph-mon[27902]: pgmap v13325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:18:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24813.800726 secs 2024-04-21T17:18:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:22 smithi191 ceph-mon[31636]: pgmap v13325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:18:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24813.800726 secs 2024-04-21T17:18:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:22 smithi170 ceph-mon[31212]: pgmap v13325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:18:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24813.800726 secs 2024-04-21T17:18:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:24 smithi077 ceph-mon[27902]: pgmap v13326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24815.560466 secs 2024-04-21T17:18:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:24 smithi191 ceph-mon[31636]: pgmap v13326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24815.560466 secs 2024-04-21T17:18:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:24 smithi170 ceph-mon[31212]: pgmap v13326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24815.560466 secs 2024-04-21T17:18:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:26 smithi077 ceph-mon[27902]: pgmap v13327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:26 smithi191 ceph-mon[31636]: pgmap v13327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:26 smithi170 ceph-mon[31212]: pgmap v13327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:18:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24818.800822 secs 2024-04-21T17:18:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:18:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:18:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24818.800822 secs 2024-04-21T17:18:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:18:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:18:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:18:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:18:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24818.800822 secs 2024-04-21T17:18:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:18:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:18:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:18:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:28 smithi077 ceph-mon[27902]: pgmap v13328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:28 smithi191 ceph-mon[31636]: pgmap v13328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:28 smithi170 ceph-mon[31212]: pgmap v13328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24820.560586 secs 2024-04-21T17:18:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24820.560586 secs 2024-04-21T17:18:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24820.560586 secs 2024-04-21T17:18:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:30 smithi077 ceph-mon[27902]: pgmap v13329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:30 smithi191 ceph-mon[31636]: pgmap v13329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:30 smithi170 ceph-mon[31212]: pgmap v13329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:32 smithi077 ceph-mon[27902]: pgmap v13330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24823.800905 secs 2024-04-21T17:18:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:32 smithi191 ceph-mon[31636]: pgmap v13330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24823.800905 secs 2024-04-21T17:18:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:32 smithi170 ceph-mon[31212]: pgmap v13330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24823.800905 secs 2024-04-21T17:18:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:34 smithi077 ceph-mon[27902]: pgmap v13331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24825.560701 secs 2024-04-21T17:18:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:34 smithi191 ceph-mon[31636]: pgmap v13331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24825.560701 secs 2024-04-21T17:18:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:34 smithi170 ceph-mon[31212]: pgmap v13331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24825.560701 secs 2024-04-21T17:18:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:36 smithi077 ceph-mon[27902]: pgmap v13332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:36 smithi191 ceph-mon[31636]: pgmap v13332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:36 smithi170 ceph-mon[31212]: pgmap v13332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24828.801036 secs 2024-04-21T17:18:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24828.801036 secs 2024-04-21T17:18:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24828.801036 secs 2024-04-21T17:18:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:38 smithi191 ceph-mon[31636]: pgmap v13333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:38 smithi170 ceph-mon[31212]: pgmap v13333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:38 smithi077 ceph-mon[27902]: pgmap v13333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24830.560836 secs 2024-04-21T17:18:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24830.560836 secs 2024-04-21T17:18:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24830.560836 secs 2024-04-21T17:18:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:40 smithi191 ceph-mon[31636]: pgmap v13334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:40 smithi170 ceph-mon[31212]: pgmap v13334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:40 smithi077 ceph-mon[27902]: pgmap v13334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:42 smithi191 ceph-mon[31636]: pgmap v13335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24833.801168 secs 2024-04-21T17:18:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:42 smithi170 ceph-mon[31212]: pgmap v13335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24833.801168 secs 2024-04-21T17:18:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:42 smithi077 ceph-mon[27902]: pgmap v13335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24833.801168 secs 2024-04-21T17:18:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24835.560925 secs 2024-04-21T17:18:44.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24835.560925 secs 2024-04-21T17:18:44.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24835.560925 secs 2024-04-21T17:18:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:44 smithi191 ceph-mon[31636]: pgmap v13336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:44 smithi170 ceph-mon[31212]: pgmap v13336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:44 smithi077 ceph-mon[27902]: pgmap v13336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:46 smithi191 ceph-mon[31636]: pgmap v13337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:46 smithi170 ceph-mon[31212]: pgmap v13337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:46 smithi077 ceph-mon[27902]: pgmap v13337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24838.801252 secs 2024-04-21T17:18:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24838.801252 secs 2024-04-21T17:18:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24838.801252 secs 2024-04-21T17:18:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:48 smithi191 ceph-mon[31636]: pgmap v13338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24840.561021 secs 2024-04-21T17:18:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:48 smithi170 ceph-mon[31212]: pgmap v13338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24840.561021 secs 2024-04-21T17:18:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:48 smithi077 ceph-mon[27902]: pgmap v13338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24840.561021 secs 2024-04-21T17:18:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:50 smithi191 ceph-mon[31636]: pgmap v13339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:50 smithi170 ceph-mon[31212]: pgmap v13339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:50 smithi077 ceph-mon[27902]: pgmap v13339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:52 smithi191 ceph-mon[31636]: pgmap v13340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24843.801346 secs 2024-04-21T17:18:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:52 smithi170 ceph-mon[31212]: pgmap v13340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24843.801346 secs 2024-04-21T17:18:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:52 smithi077 ceph-mon[27902]: pgmap v13340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24843.801346 secs 2024-04-21T17:18:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24845.561087 secs 2024-04-21T17:18:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24845.561087 secs 2024-04-21T17:18:54.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24845.561087 secs 2024-04-21T17:18:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:54 smithi191 ceph-mon[31636]: pgmap v13341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:54 smithi170 ceph-mon[31212]: pgmap v13341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:54 smithi077 ceph-mon[27902]: pgmap v13341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:56 smithi191 ceph-mon[31636]: pgmap v13342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:56 smithi170 ceph-mon[31212]: pgmap v13342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:56 smithi077 ceph-mon[27902]: pgmap v13342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:18:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24848.801500 secs 2024-04-21T17:18:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24848.801500 secs 2024-04-21T17:18:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24848.801500 secs 2024-04-21T17:18:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:58 smithi191 ceph-mon[31636]: pgmap v13343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:18:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24850.561203 secs 2024-04-21T17:18:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:58 smithi170 ceph-mon[31212]: pgmap v13343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:18:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24850.561203 secs 2024-04-21T17:18:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:58 smithi077 ceph-mon[27902]: pgmap v13343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:18:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:18:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24850.561203 secs 2024-04-21T17:19:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:00 smithi191 ceph-mon[31636]: pgmap v13344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:00 smithi170 ceph-mon[31212]: pgmap v13344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:00 smithi077 ceph-mon[27902]: pgmap v13344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:02 smithi191 ceph-mon[31636]: pgmap v13345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24853.801634 secs 2024-04-21T17:19:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:02 smithi170 ceph-mon[31212]: pgmap v13345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24853.801634 secs 2024-04-21T17:19:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:02 smithi077 ceph-mon[27902]: pgmap v13345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24853.801634 secs 2024-04-21T17:19:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24855.561282 secs 2024-04-21T17:19:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24855.561282 secs 2024-04-21T17:19:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24855.561282 secs 2024-04-21T17:19:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:04 smithi191 ceph-mon[31636]: pgmap v13346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:04 smithi191 ceph-mon[31636]: osdmap e906: 12 total, 12 up, 12 in 2024-04-21T17:19:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:04 smithi170 ceph-mon[31212]: pgmap v13346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:04 smithi170 ceph-mon[31212]: osdmap e906: 12 total, 12 up, 12 in 2024-04-21T17:19:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:04 smithi077 ceph-mon[27902]: pgmap v13346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:04 smithi077 ceph-mon[27902]: osdmap e906: 12 total, 12 up, 12 in 2024-04-21T17:19:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:05 smithi191 ceph-mon[31636]: pgmap v13348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:19:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:05 smithi170 ceph-mon[31212]: pgmap v13348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:19:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:05 smithi077 ceph-mon[27902]: pgmap v13348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:19:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:07 smithi170 ceph-mon[31212]: osdmap e907: 12 total, 12 up, 12 in 2024-04-21T17:19:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24858.801803 secs 2024-04-21T17:19:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:07 smithi077 ceph-mon[27902]: osdmap e907: 12 total, 12 up, 12 in 2024-04-21T17:19:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24858.801803 secs 2024-04-21T17:19:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:07 smithi191 ceph-mon[31636]: osdmap e907: 12 total, 12 up, 12 in 2024-04-21T17:19:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24858.801803 secs 2024-04-21T17:19:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:08 smithi170 ceph-mon[31212]: pgmap v13350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:19:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:08 smithi077 ceph-mon[27902]: pgmap v13350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:19:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:08 smithi191 ceph-mon[31636]: pgmap v13350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:19:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24860.561419 secs 2024-04-21T17:19:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24860.561419 secs 2024-04-21T17:19:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24860.561419 secs 2024-04-21T17:19:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:10 smithi077 ceph-mon[27902]: pgmap v13351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:19:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:10 smithi191 ceph-mon[31636]: pgmap v13351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:19:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:10 smithi170 ceph-mon[31212]: pgmap v13351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:19:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:12 smithi077 ceph-mon[27902]: pgmap v13352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:19:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24863.801940 secs 2024-04-21T17:19:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:12 smithi191 ceph-mon[31636]: pgmap v13352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:19:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24863.801940 secs 2024-04-21T17:19:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:12 smithi170 ceph-mon[31212]: pgmap v13352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:19:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24863.801940 secs 2024-04-21T17:19:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:14 smithi077 ceph-mon[27902]: pgmap v13353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:19:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24865.561529 secs 2024-04-21T17:19:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:14 smithi191 ceph-mon[31636]: pgmap v13353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:19:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24865.561529 secs 2024-04-21T17:19:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:14 smithi170 ceph-mon[31212]: pgmap v13353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:19:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24865.561529 secs 2024-04-21T17:19:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:16 smithi077 ceph-mon[27902]: pgmap v13354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:19:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:16 smithi191 ceph-mon[31636]: pgmap v13354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:19:17.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:16 smithi170 ceph-mon[31212]: pgmap v13354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:19:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24868.802008 secs 2024-04-21T17:19:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24868.802008 secs 2024-04-21T17:19:18.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24868.802008 secs 2024-04-21T17:19:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:18 smithi077 ceph-mon[27902]: pgmap v13355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:19:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:18 smithi191 ceph-mon[31636]: pgmap v13355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:19:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:18 smithi170 ceph-mon[31212]: pgmap v13355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:19:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24870.561643 secs 2024-04-21T17:19:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24870.561643 secs 2024-04-21T17:19:20.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24870.561643 secs 2024-04-21T17:19:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:20 smithi077 ceph-mon[27902]: pgmap v13356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:19:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:20 smithi191 ceph-mon[31636]: pgmap v13356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:19:21.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:20 smithi170 ceph-mon[31212]: pgmap v13356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:19:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:22 smithi077 ceph-mon[27902]: pgmap v13357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:19:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24873.802136 secs 2024-04-21T17:19:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:22 smithi191 ceph-mon[31636]: pgmap v13357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:19:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24873.802136 secs 2024-04-21T17:19:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:22 smithi170 ceph-mon[31212]: pgmap v13357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:19:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24873.802136 secs 2024-04-21T17:19:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:24 smithi077 ceph-mon[27902]: pgmap v13358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24875.561778 secs 2024-04-21T17:19:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:24 smithi191 ceph-mon[31636]: pgmap v13358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24875.561778 secs 2024-04-21T17:19:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:24 smithi170 ceph-mon[31212]: pgmap v13358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24875.561778 secs 2024-04-21T17:19:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:26 smithi077 ceph-mon[27902]: pgmap v13359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:26 smithi191 ceph-mon[31636]: pgmap v13359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:26 smithi170 ceph-mon[31212]: pgmap v13359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:28.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24878.802266 secs 2024-04-21T17:19:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:19:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24878.802266 secs 2024-04-21T17:19:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:19:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24878.802266 secs 2024-04-21T17:19:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:19:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:28 smithi077 ceph-mon[27902]: pgmap v13360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:19:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:19:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:19:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:28 smithi191 ceph-mon[31636]: pgmap v13360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:19:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:19:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:19:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:28 smithi170 ceph-mon[31212]: pgmap v13360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:19:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:19:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:19:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24880.561930 secs 2024-04-21T17:19:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24880.561930 secs 2024-04-21T17:19:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24880.561930 secs 2024-04-21T17:19:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:30 smithi077 ceph-mon[27902]: pgmap v13361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:30 smithi191 ceph-mon[31636]: pgmap v13361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:30 smithi170 ceph-mon[31212]: pgmap v13361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:32 smithi077 ceph-mon[27902]: pgmap v13362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24883.802378 secs 2024-04-21T17:19:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:32 smithi191 ceph-mon[31636]: pgmap v13362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24883.802378 secs 2024-04-21T17:19:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:32 smithi170 ceph-mon[31212]: pgmap v13362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24883.802378 secs 2024-04-21T17:19:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:34 smithi077 ceph-mon[27902]: pgmap v13363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24885.562039 secs 2024-04-21T17:19:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:34 smithi191 ceph-mon[31636]: pgmap v13363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24885.562039 secs 2024-04-21T17:19:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:34 smithi170 ceph-mon[31212]: pgmap v13363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24885.562039 secs 2024-04-21T17:19:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:36 smithi077 ceph-mon[27902]: pgmap v13364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:36 smithi191 ceph-mon[31636]: pgmap v13364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:36 smithi170 ceph-mon[31212]: pgmap v13364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24888.802509 secs 2024-04-21T17:19:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24888.802509 secs 2024-04-21T17:19:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24888.802509 secs 2024-04-21T17:19:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:38 smithi077 ceph-mon[27902]: pgmap v13365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:38 smithi191 ceph-mon[31636]: pgmap v13365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:38 smithi170 ceph-mon[31212]: pgmap v13365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24890.562155 secs 2024-04-21T17:19:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24890.562155 secs 2024-04-21T17:19:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24890.562155 secs 2024-04-21T17:19:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:40 smithi191 ceph-mon[31636]: pgmap v13366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:40 smithi170 ceph-mon[31212]: pgmap v13366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:40 smithi077 ceph-mon[27902]: pgmap v13366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:42 smithi191 ceph-mon[31636]: pgmap v13367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24893.802647 secs 2024-04-21T17:19:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:42 smithi170 ceph-mon[31212]: pgmap v13367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24893.802647 secs 2024-04-21T17:19:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:42 smithi077 ceph-mon[27902]: pgmap v13367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24893.802647 secs 2024-04-21T17:19:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:45.188 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:44 smithi077 ceph-mon[27902]: pgmap v13368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:45.188 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24895.562244 secs 2024-04-21T17:19:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:44 smithi191 ceph-mon[31636]: pgmap v13368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24895.562244 secs 2024-04-21T17:19:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:44 smithi170 ceph-mon[31212]: pgmap v13368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24895.562244 secs 2024-04-21T17:19:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:46 smithi191 ceph-mon[31636]: pgmap v13369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:46 smithi170 ceph-mon[31212]: pgmap v13369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:46 smithi077 ceph-mon[27902]: pgmap v13369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24898.802807 secs 2024-04-21T17:19:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24898.802807 secs 2024-04-21T17:19:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24898.802807 secs 2024-04-21T17:19:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:48 smithi191 ceph-mon[31636]: pgmap v13370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:48 smithi170 ceph-mon[31212]: pgmap v13370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:48 smithi077 ceph-mon[27902]: pgmap v13370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24900.562359 secs 2024-04-21T17:19:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24900.562359 secs 2024-04-21T17:19:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24900.562359 secs 2024-04-21T17:19:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:50 smithi191 ceph-mon[31636]: pgmap v13371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:50 smithi170 ceph-mon[31212]: pgmap v13371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:50 smithi077 ceph-mon[27902]: pgmap v13371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:52 smithi191 ceph-mon[31636]: pgmap v13372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24903.802864 secs 2024-04-21T17:19:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:52 smithi170 ceph-mon[31212]: pgmap v13372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24903.802864 secs 2024-04-21T17:19:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:52 smithi077 ceph-mon[27902]: pgmap v13372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24903.802864 secs 2024-04-21T17:19:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24905.562456 secs 2024-04-21T17:19:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24905.562456 secs 2024-04-21T17:19:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24905.562456 secs 2024-04-21T17:19:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:19:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:54 smithi191 ceph-mon[31636]: pgmap v13373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:54 smithi170 ceph-mon[31212]: pgmap v13373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:54 smithi077 ceph-mon[27902]: pgmap v13373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:56 smithi191 ceph-mon[31636]: pgmap v13374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:56 smithi170 ceph-mon[31212]: pgmap v13374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:56 smithi077 ceph-mon[27902]: pgmap v13374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:19:57.796+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:19:57.796+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:19:57.796+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:19:57.796+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:19:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24908.802932 secs 2024-04-21T17:19:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24908.802932 secs 2024-04-21T17:19:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24908.802932 secs 2024-04-21T17:19:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:58 smithi191 ceph-mon[31636]: pgmap v13375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:19:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24910.562569 secs 2024-04-21T17:19:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:58 smithi170 ceph-mon[31212]: pgmap v13375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:19:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24910.562569 secs 2024-04-21T17:19:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:58 smithi077 ceph-mon[27902]: pgmap v13375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:19:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:19:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24910.562569 secs 2024-04-21T17:20:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:00 smithi191 ceph-mon[31636]: pgmap v13376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:20:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:00 smithi170 ceph-mon[31212]: pgmap v13376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:20:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:00 smithi077 ceph-mon[27902]: pgmap v13376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:20:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:02 smithi191 ceph-mon[31636]: pgmap v13377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24913.802999 secs 2024-04-21T17:20:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:02 smithi170 ceph-mon[31212]: pgmap v13377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24913.802999 secs 2024-04-21T17:20:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:02 smithi077 ceph-mon[27902]: pgmap v13377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24913.802999 secs 2024-04-21T17:20:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24915.562702 secs 2024-04-21T17:20:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24915.562702 secs 2024-04-21T17:20:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24915.562702 secs 2024-04-21T17:20:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:04 smithi191 ceph-mon[31636]: pgmap v13378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:04 smithi191 ceph-mon[31636]: osdmap e908: 12 total, 12 up, 12 in 2024-04-21T17:20:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:04 smithi170 ceph-mon[31212]: pgmap v13378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:04 smithi170 ceph-mon[31212]: osdmap e908: 12 total, 12 up, 12 in 2024-04-21T17:20:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:04 smithi077 ceph-mon[27902]: pgmap v13378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:04 smithi077 ceph-mon[27902]: osdmap e908: 12 total, 12 up, 12 in 2024-04-21T17:20:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:06 smithi191 ceph-mon[31636]: pgmap v13380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:20:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:06 smithi191 ceph-mon[31636]: osdmap e909: 12 total, 12 up, 12 in 2024-04-21T17:20:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:06 smithi170 ceph-mon[31212]: pgmap v13380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:20:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:06 smithi170 ceph-mon[31212]: osdmap e909: 12 total, 12 up, 12 in 2024-04-21T17:20:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:06 smithi077 ceph-mon[27902]: pgmap v13380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:20:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:06 smithi077 ceph-mon[27902]: osdmap e909: 12 total, 12 up, 12 in 2024-04-21T17:20:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24918.803124 secs 2024-04-21T17:20:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24918.803124 secs 2024-04-21T17:20:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24918.803124 secs 2024-04-21T17:20:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:08 smithi191 ceph-mon[31636]: pgmap v13382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:20:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24920.562817 secs 2024-04-21T17:20:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:08 smithi170 ceph-mon[31212]: pgmap v13382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:20:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24920.562817 secs 2024-04-21T17:20:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:08 smithi077 ceph-mon[27902]: pgmap v13382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:20:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24920.562817 secs 2024-04-21T17:20:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:10 smithi191 ceph-mon[31636]: pgmap v13383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:20:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:10 smithi170 ceph-mon[31212]: pgmap v13383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:20:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:10 smithi077 ceph-mon[27902]: pgmap v13383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:20:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:12 smithi191 ceph-mon[31636]: pgmap v13384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:20:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24923.803259 secs 2024-04-21T17:20:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:12 smithi170 ceph-mon[31212]: pgmap v13384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:20:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24923.803259 secs 2024-04-21T17:20:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:12 smithi077 ceph-mon[27902]: pgmap v13384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:20:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24923.803259 secs 2024-04-21T17:20:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24925.562931 secs 2024-04-21T17:20:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24925.562931 secs 2024-04-21T17:20:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24925.562931 secs 2024-04-21T17:20:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:15.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:14 smithi077 ceph-mon[27902]: pgmap v13385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:20:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:14 smithi170 ceph-mon[31212]: pgmap v13385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:20:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:14 smithi191 ceph-mon[31636]: pgmap v13385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:20:16.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:15 smithi170 ceph-mon[31212]: pgmap v13386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:20:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:15 smithi077 ceph-mon[27902]: pgmap v13386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:20:16.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:15 smithi191 ceph-mon[31636]: pgmap v13386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:20:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24928.803392 secs 2024-04-21T17:20:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24928.803392 secs 2024-04-21T17:20:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24928.803392 secs 2024-04-21T17:20:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:18 smithi170 ceph-mon[31212]: pgmap v13387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:20:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:18 smithi077 ceph-mon[27902]: pgmap v13387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:20:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:18 smithi191 ceph-mon[31636]: pgmap v13387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:20:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24930.563068 secs 2024-04-21T17:20:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24930.563068 secs 2024-04-21T17:20:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24930.563068 secs 2024-04-21T17:20:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:20 smithi170 ceph-mon[31212]: pgmap v13388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:20:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:20 smithi077 ceph-mon[27902]: pgmap v13388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:20:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:20 smithi191 ceph-mon[31636]: pgmap v13388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:20:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:22 smithi077 ceph-mon[27902]: pgmap v13389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:20:23.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24933.803483 secs 2024-04-21T17:20:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:22 smithi191 ceph-mon[31636]: pgmap v13389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:20:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24933.803483 secs 2024-04-21T17:20:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:22 smithi170 ceph-mon[31212]: pgmap v13389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:20:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24933.803483 secs 2024-04-21T17:20:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:24 smithi077 ceph-mon[27902]: pgmap v13390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24935.563144 secs 2024-04-21T17:20:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:24 smithi191 ceph-mon[31636]: pgmap v13390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24935.563144 secs 2024-04-21T17:20:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:24 smithi170 ceph-mon[31212]: pgmap v13390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24935.563144 secs 2024-04-21T17:20:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:26 smithi077 ceph-mon[27902]: pgmap v13391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:26 smithi191 ceph-mon[31636]: pgmap v13391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:26 smithi170 ceph-mon[31212]: pgmap v13391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:28.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24938.803604 secs 2024-04-21T17:20:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24938.803604 secs 2024-04-21T17:20:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24938.803604 secs 2024-04-21T17:20:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:28 smithi077 ceph-mon[27902]: pgmap v13392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:20:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:28 smithi191 ceph-mon[31636]: pgmap v13392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:20:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:28 smithi170 ceph-mon[31212]: pgmap v13392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:20:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24940.563233 secs 2024-04-21T17:20:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24940.563233 secs 2024-04-21T17:20:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24940.563233 secs 2024-04-21T17:20:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: pgmap v13393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: pgmap v13393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: pgmap v13393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:32.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:20:32.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:20:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:20:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:20:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:20:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:20:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:20:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:20:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:20:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:20:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:20:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:20:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:20:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:32 smithi077 ceph-mon[27902]: pgmap v13394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24943.803753 secs 2024-04-21T17:20:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:32 smithi191 ceph-mon[31636]: pgmap v13394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24943.803753 secs 2024-04-21T17:20:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:32 smithi170 ceph-mon[31212]: pgmap v13394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24943.803753 secs 2024-04-21T17:20:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:34 smithi077 ceph-mon[27902]: pgmap v13395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24945.563328 secs 2024-04-21T17:20:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:34 smithi191 ceph-mon[31636]: pgmap v13395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24945.563328 secs 2024-04-21T17:20:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:34 smithi170 ceph-mon[31212]: pgmap v13395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24945.563328 secs 2024-04-21T17:20:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:36 smithi077 ceph-mon[27902]: pgmap v13396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:36 smithi191 ceph-mon[31636]: pgmap v13396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:36 smithi170 ceph-mon[31212]: pgmap v13396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24948.803886 secs 2024-04-21T17:20:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24948.803886 secs 2024-04-21T17:20:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24948.803886 secs 2024-04-21T17:20:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:38 smithi077 ceph-mon[27902]: pgmap v13397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:38 smithi191 ceph-mon[31636]: pgmap v13397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:38 smithi170 ceph-mon[31212]: pgmap v13397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24950.563432 secs 2024-04-21T17:20:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24950.563432 secs 2024-04-21T17:20:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24950.563432 secs 2024-04-21T17:20:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:40 smithi077 ceph-mon[27902]: pgmap v13398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:40 smithi191 ceph-mon[31636]: pgmap v13398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:40 smithi170 ceph-mon[31212]: pgmap v13398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:42 smithi191 ceph-mon[31636]: pgmap v13399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24953.804008 secs 2024-04-21T17:20:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:42 smithi170 ceph-mon[31212]: pgmap v13399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24953.804008 secs 2024-04-21T17:20:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:42 smithi077 ceph-mon[27902]: pgmap v13399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24953.804008 secs 2024-04-21T17:20:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:45.188 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:44 smithi077 ceph-mon[27902]: pgmap v13400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:45.188 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24955.563539 secs 2024-04-21T17:20:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:44 smithi191 ceph-mon[31636]: pgmap v13400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24955.563539 secs 2024-04-21T17:20:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:44 smithi170 ceph-mon[31212]: pgmap v13400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24955.563539 secs 2024-04-21T17:20:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:46 smithi191 ceph-mon[31636]: pgmap v13401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:46 smithi170 ceph-mon[31212]: pgmap v13401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:46 smithi077 ceph-mon[27902]: pgmap v13401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24958.804137 secs 2024-04-21T17:20:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24958.804137 secs 2024-04-21T17:20:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24958.804137 secs 2024-04-21T17:20:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:48 smithi191 ceph-mon[31636]: pgmap v13402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:48 smithi170 ceph-mon[31212]: pgmap v13402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:48 smithi077 ceph-mon[27902]: pgmap v13402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24960.563657 secs 2024-04-21T17:20:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24960.563657 secs 2024-04-21T17:20:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24960.563657 secs 2024-04-21T17:20:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:50 smithi191 ceph-mon[31636]: pgmap v13403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:50 smithi170 ceph-mon[31212]: pgmap v13403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:50 smithi077 ceph-mon[27902]: pgmap v13403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:52 smithi191 ceph-mon[31636]: pgmap v13404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24963.804270 secs 2024-04-21T17:20:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:52 smithi170 ceph-mon[31212]: pgmap v13404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24963.804270 secs 2024-04-21T17:20:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:52 smithi077 ceph-mon[27902]: pgmap v13404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24963.804270 secs 2024-04-21T17:20:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:20:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:54 smithi191 ceph-mon[31636]: pgmap v13405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24965.563791 secs 2024-04-21T17:20:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:54 smithi170 ceph-mon[31212]: pgmap v13405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24965.563791 secs 2024-04-21T17:20:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:54 smithi077 ceph-mon[27902]: pgmap v13405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24965.563791 secs 2024-04-21T17:20:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:56 smithi191 ceph-mon[31636]: pgmap v13406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:56 smithi170 ceph-mon[31212]: pgmap v13406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:56 smithi077 ceph-mon[27902]: pgmap v13406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:20:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24968.804357 secs 2024-04-21T17:20:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24968.804357 secs 2024-04-21T17:20:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24968.804357 secs 2024-04-21T17:20:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:58 smithi191 ceph-mon[31636]: pgmap v13407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:20:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24970.563897 secs 2024-04-21T17:20:59.220 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:58 smithi170 ceph-mon[31212]: pgmap v13407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:59.220 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:20:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24970.563897 secs 2024-04-21T17:20:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:58 smithi077 ceph-mon[27902]: pgmap v13407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:20:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:20:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24970.563897 secs 2024-04-21T17:21:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:00 smithi191 ceph-mon[31636]: pgmap v13408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:00 smithi170 ceph-mon[31212]: pgmap v13408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:00 smithi077 ceph-mon[27902]: pgmap v13408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:02 smithi191 ceph-mon[31636]: pgmap v13409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24973.804482 secs 2024-04-21T17:21:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:02 smithi170 ceph-mon[31212]: pgmap v13409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24973.804482 secs 2024-04-21T17:21:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:02 smithi077 ceph-mon[27902]: pgmap v13409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24973.804482 secs 2024-04-21T17:21:04.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24975.563983 secs 2024-04-21T17:21:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24975.563983 secs 2024-04-21T17:21:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24975.563983 secs 2024-04-21T17:21:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:04 smithi191 ceph-mon[31636]: pgmap v13410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:04 smithi191 ceph-mon[31636]: osdmap e910: 12 total, 12 up, 12 in 2024-04-21T17:21:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:04 smithi170 ceph-mon[31212]: pgmap v13410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:04 smithi170 ceph-mon[31212]: osdmap e910: 12 total, 12 up, 12 in 2024-04-21T17:21:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:04 smithi077 ceph-mon[27902]: pgmap v13410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:04 smithi077 ceph-mon[27902]: osdmap e910: 12 total, 12 up, 12 in 2024-04-21T17:21:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:06 smithi191 ceph-mon[31636]: pgmap v13412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:21:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:06 smithi191 ceph-mon[31636]: osdmap e911: 12 total, 12 up, 12 in 2024-04-21T17:21:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:06 smithi170 ceph-mon[31212]: pgmap v13412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:21:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:06 smithi170 ceph-mon[31212]: osdmap e911: 12 total, 12 up, 12 in 2024-04-21T17:21:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:06 smithi077 ceph-mon[27902]: pgmap v13412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:21:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:06 smithi077 ceph-mon[27902]: osdmap e911: 12 total, 12 up, 12 in 2024-04-21T17:21:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24978.804610 secs 2024-04-21T17:21:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24978.804610 secs 2024-04-21T17:21:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24978.804610 secs 2024-04-21T17:21:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:08 smithi191 ceph-mon[31636]: pgmap v13414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:21:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24980.564102 secs 2024-04-21T17:21:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:08 smithi170 ceph-mon[31212]: pgmap v13414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:21:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24980.564102 secs 2024-04-21T17:21:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:08 smithi077 ceph-mon[27902]: pgmap v13414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:21:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24980.564102 secs 2024-04-21T17:21:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:10 smithi191 ceph-mon[31636]: pgmap v13415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:21:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:10 smithi170 ceph-mon[31212]: pgmap v13415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:21:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:10 smithi077 ceph-mon[27902]: pgmap v13415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:21:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:12 smithi191 ceph-mon[31636]: pgmap v13416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:21:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24983.804694 secs 2024-04-21T17:21:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:12 smithi170 ceph-mon[31212]: pgmap v13416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:21:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24983.804694 secs 2024-04-21T17:21:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:12 smithi077 ceph-mon[27902]: pgmap v13416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:21:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24983.804694 secs 2024-04-21T17:21:14.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24985.564210 secs 2024-04-21T17:21:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24985.564210 secs 2024-04-21T17:21:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24985.564210 secs 2024-04-21T17:21:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:14 smithi191 ceph-mon[31636]: pgmap v13417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:21:15.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:14 smithi077 ceph-mon[27902]: pgmap v13417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:21:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:14 smithi170 ceph-mon[31212]: pgmap v13417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:21:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:16 smithi170 ceph-mon[31212]: pgmap v13418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:21:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:16 smithi077 ceph-mon[27902]: pgmap v13418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:21:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:16 smithi191 ceph-mon[31636]: pgmap v13418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:21:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24988.804750 secs 2024-04-21T17:21:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24988.804750 secs 2024-04-21T17:21:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24988.804750 secs 2024-04-21T17:21:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:18 smithi170 ceph-mon[31212]: pgmap v13419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:21:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24990.564274 secs 2024-04-21T17:21:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:18 smithi077 ceph-mon[27902]: pgmap v13419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:21:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24990.564274 secs 2024-04-21T17:21:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:18 smithi191 ceph-mon[31636]: pgmap v13419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:21:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24990.564274 secs 2024-04-21T17:21:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:19 smithi170 ceph-mon[31212]: pgmap v13420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:21:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:19 smithi077 ceph-mon[27902]: pgmap v13420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:21:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:19 smithi191 ceph-mon[31636]: pgmap v13420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:21:22.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:22 smithi191 ceph-mon[31636]: pgmap v13421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:21:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24993.804872 secs 2024-04-21T17:21:22.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:22 smithi170 ceph-mon[31212]: pgmap v13421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:21:22.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24993.804872 secs 2024-04-21T17:21:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:22 smithi077 ceph-mon[27902]: pgmap v13421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:21:22.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24993.804872 secs 2024-04-21T17:21:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:24 smithi191 ceph-mon[31636]: pgmap v13422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 24995.564396 secs 2024-04-21T17:21:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:24 smithi170 ceph-mon[31212]: pgmap v13422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:24.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 24995.564396 secs 2024-04-21T17:21:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:24 smithi077 ceph-mon[27902]: pgmap v13422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:24.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 24995.564396 secs 2024-04-21T17:21:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:26 smithi191 ceph-mon[31636]: pgmap v13423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:26 smithi170 ceph-mon[31212]: pgmap v13423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:26.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:26 smithi077 ceph-mon[27902]: pgmap v13423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 24998.804999 secs 2024-04-21T17:21:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 24998.804999 secs 2024-04-21T17:21:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:21:27.808+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:21:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:21:27.808+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:21:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:21:27.808+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:21:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:21:27.808+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:21:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 24998.804999 secs 2024-04-21T17:21:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:28 smithi170 ceph-mon[31212]: pgmap v13424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:28 smithi077 ceph-mon[27902]: pgmap v13424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:28.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:28 smithi191 ceph-mon[31636]: pgmap v13424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25000.564509 secs 2024-04-21T17:21:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25000.564509 secs 2024-04-21T17:21:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25000.564509 secs 2024-04-21T17:21:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:30 smithi170 ceph-mon[31212]: pgmap v13425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:30 smithi077 ceph-mon[27902]: pgmap v13425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:30 smithi191 ceph-mon[31636]: pgmap v13425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:21:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:21:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:21:31.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:32 smithi170 ceph-mon[31212]: pgmap v13426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25003.805103 secs 2024-04-21T17:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:21:32.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:32 smithi077 ceph-mon[27902]: pgmap v13426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25003.805103 secs 2024-04-21T17:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:21:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:32 smithi191 ceph-mon[31636]: pgmap v13426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25003.805103 secs 2024-04-21T17:21:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:21:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:21:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:21:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:34 smithi170 ceph-mon[31212]: pgmap v13427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25005.564650 secs 2024-04-21T17:21:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:34 smithi077 ceph-mon[27902]: pgmap v13427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25005.564650 secs 2024-04-21T17:21:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:34 smithi191 ceph-mon[31636]: pgmap v13427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25005.564650 secs 2024-04-21T17:21:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:36 smithi170 ceph-mon[31212]: pgmap v13428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:36.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:36 smithi077 ceph-mon[27902]: pgmap v13428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:36 smithi191 ceph-mon[31636]: pgmap v13428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25008.805237 secs 2024-04-21T17:21:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25008.805237 secs 2024-04-21T17:21:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25008.805237 secs 2024-04-21T17:21:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:38 smithi170 ceph-mon[31212]: pgmap v13429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:38 smithi077 ceph-mon[27902]: pgmap v13429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:38 smithi191 ceph-mon[31636]: pgmap v13429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25010.564765 secs 2024-04-21T17:21:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25010.564765 secs 2024-04-21T17:21:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25010.564765 secs 2024-04-21T17:21:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:40 smithi170 ceph-mon[31212]: pgmap v13430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:40 smithi077 ceph-mon[27902]: pgmap v13430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:40 smithi191 ceph-mon[31636]: pgmap v13430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:42 smithi170 ceph-mon[31212]: pgmap v13431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:42.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25013.805354 secs 2024-04-21T17:21:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:42 smithi077 ceph-mon[27902]: pgmap v13431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25013.805354 secs 2024-04-21T17:21:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:42 smithi191 ceph-mon[31636]: pgmap v13431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25013.805354 secs 2024-04-21T17:21:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:44 smithi170 ceph-mon[31212]: pgmap v13432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25015.564884 secs 2024-04-21T17:21:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:44 smithi077 ceph-mon[27902]: pgmap v13432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25015.564884 secs 2024-04-21T17:21:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:44 smithi191 ceph-mon[31636]: pgmap v13432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25015.564884 secs 2024-04-21T17:21:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:46 smithi170 ceph-mon[31212]: pgmap v13433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:46 smithi077 ceph-mon[27902]: pgmap v13433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:46 smithi191 ceph-mon[31636]: pgmap v13433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25018.805413 secs 2024-04-21T17:21:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25018.805413 secs 2024-04-21T17:21:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25018.805413 secs 2024-04-21T17:21:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:48 smithi170 ceph-mon[31212]: pgmap v13434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:48 smithi077 ceph-mon[27902]: pgmap v13434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:48 smithi191 ceph-mon[31636]: pgmap v13434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25020.564977 secs 2024-04-21T17:21:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25020.564977 secs 2024-04-21T17:21:49.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25020.564977 secs 2024-04-21T17:21:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:50 smithi170 ceph-mon[31212]: pgmap v13435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:50 smithi077 ceph-mon[27902]: pgmap v13435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:50.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:50 smithi191 ceph-mon[31636]: pgmap v13435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:52 smithi170 ceph-mon[31212]: pgmap v13436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25023.805560 secs 2024-04-21T17:21:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:52 smithi077 ceph-mon[27902]: pgmap v13436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25023.805560 secs 2024-04-21T17:21:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:52 smithi191 ceph-mon[31636]: pgmap v13436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25023.805560 secs 2024-04-21T17:21:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:54 smithi170 ceph-mon[31212]: pgmap v13437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25025.565086 secs 2024-04-21T17:21:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:54 smithi077 ceph-mon[27902]: pgmap v13437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25025.565086 secs 2024-04-21T17:21:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:54 smithi191 ceph-mon[31636]: pgmap v13437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25025.565086 secs 2024-04-21T17:21:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:21:56.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:56 smithi170 ceph-mon[31212]: pgmap v13438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:56 smithi077 ceph-mon[27902]: pgmap v13438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:56 smithi191 ceph-mon[31636]: pgmap v13438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:21:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25028.805682 secs 2024-04-21T17:21:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25028.805682 secs 2024-04-21T17:21:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25028.805682 secs 2024-04-21T17:21:58.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:58 smithi191 ceph-mon[31636]: pgmap v13439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:58.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:58 smithi077 ceph-mon[27902]: pgmap v13439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:58 smithi170 ceph-mon[31212]: pgmap v13439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:21:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25030.565210 secs 2024-04-21T17:21:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25030.565210 secs 2024-04-21T17:22:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25030.565210 secs 2024-04-21T17:22:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:00.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:00 smithi077 ceph-mon[27902]: pgmap v13440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:00 smithi191 ceph-mon[31636]: pgmap v13440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:00 smithi170 ceph-mon[31212]: pgmap v13440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:02 smithi077 ceph-mon[27902]: pgmap v13441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25033.805825 secs 2024-04-21T17:22:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:02 smithi191 ceph-mon[31636]: pgmap v13441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25033.805825 secs 2024-04-21T17:22:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:02 smithi170 ceph-mon[31212]: pgmap v13441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25033.805825 secs 2024-04-21T17:22:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:04 smithi077 ceph-mon[27902]: pgmap v13442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25035.565327 secs 2024-04-21T17:22:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:04 smithi191 ceph-mon[31636]: pgmap v13442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25035.565327 secs 2024-04-21T17:22:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:04 smithi170 ceph-mon[31212]: pgmap v13442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25035.565327 secs 2024-04-21T17:22:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:05 smithi077 ceph-mon[27902]: osdmap e912: 12 total, 12 up, 12 in 2024-04-21T17:22:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:05 smithi191 ceph-mon[31636]: osdmap e912: 12 total, 12 up, 12 in 2024-04-21T17:22:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:05 smithi170 ceph-mon[31212]: osdmap e912: 12 total, 12 up, 12 in 2024-04-21T17:22:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:06 smithi077 ceph-mon[27902]: pgmap v13444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:22:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:06 smithi191 ceph-mon[31636]: pgmap v13444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:22:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:06 smithi170 ceph-mon[31212]: pgmap v13444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:22:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:07 smithi077 ceph-mon[27902]: osdmap e913: 12 total, 12 up, 12 in 2024-04-21T17:22:08.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25038.805977 secs 2024-04-21T17:22:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:07 smithi191 ceph-mon[31636]: osdmap e913: 12 total, 12 up, 12 in 2024-04-21T17:22:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25038.805977 secs 2024-04-21T17:22:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:07 smithi170 ceph-mon[31212]: osdmap e913: 12 total, 12 up, 12 in 2024-04-21T17:22:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25038.805977 secs 2024-04-21T17:22:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:08 smithi077 ceph-mon[27902]: pgmap v13446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:22:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:08 smithi191 ceph-mon[31636]: pgmap v13446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:22:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:08 smithi170 ceph-mon[31212]: pgmap v13446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:22:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25040.565439 secs 2024-04-21T17:22:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25040.565439 secs 2024-04-21T17:22:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25040.565439 secs 2024-04-21T17:22:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:10 smithi077 ceph-mon[27902]: pgmap v13447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:22:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:10 smithi191 ceph-mon[31636]: pgmap v13447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:22:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:10 smithi170 ceph-mon[31212]: pgmap v13447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:22:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:12 smithi077 ceph-mon[27902]: pgmap v13448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:22:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25043.806121 secs 2024-04-21T17:22:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:12 smithi191 ceph-mon[31636]: pgmap v13448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:22:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25043.806121 secs 2024-04-21T17:22:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:12 smithi170 ceph-mon[31212]: pgmap v13448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:22:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25043.806121 secs 2024-04-21T17:22:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:14 smithi077 ceph-mon[27902]: pgmap v13449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:22:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25045.565536 secs 2024-04-21T17:22:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:14 smithi191 ceph-mon[31636]: pgmap v13449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:22:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25045.565536 secs 2024-04-21T17:22:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:14 smithi170 ceph-mon[31212]: pgmap v13449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:22:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25045.565536 secs 2024-04-21T17:22:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:16 smithi077 ceph-mon[27902]: pgmap v13450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:22:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:16 smithi191 ceph-mon[31636]: pgmap v13450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:22:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:16 smithi170 ceph-mon[31212]: pgmap v13450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:22:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25048.806240 secs 2024-04-21T17:22:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25048.806240 secs 2024-04-21T17:22:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25048.806240 secs 2024-04-21T17:22:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:18 smithi077 ceph-mon[27902]: pgmap v13451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:22:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:18 smithi191 ceph-mon[31636]: pgmap v13451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:22:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:18 smithi170 ceph-mon[31212]: pgmap v13451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:22:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25050.565608 secs 2024-04-21T17:22:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25050.565608 secs 2024-04-21T17:22:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25050.565608 secs 2024-04-21T17:22:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:20 smithi077 ceph-mon[27902]: pgmap v13452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:22:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:20 smithi191 ceph-mon[31636]: pgmap v13452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:22:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:20 smithi170 ceph-mon[31212]: pgmap v13452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:22:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:22 smithi191 ceph-mon[31636]: pgmap v13453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:22:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25053.806329 secs 2024-04-21T17:22:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:22 smithi170 ceph-mon[31212]: pgmap v13453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:22:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25053.806329 secs 2024-04-21T17:22:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:22 smithi077 ceph-mon[27902]: pgmap v13453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:22:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25053.806329 secs 2024-04-21T17:22:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:24 smithi191 ceph-mon[31636]: pgmap v13454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25055.565701 secs 2024-04-21T17:22:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:24 smithi170 ceph-mon[31212]: pgmap v13454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25055.565701 secs 2024-04-21T17:22:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:24 smithi077 ceph-mon[27902]: pgmap v13454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25055.565701 secs 2024-04-21T17:22:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:26 smithi191 ceph-mon[31636]: pgmap v13455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:26 smithi170 ceph-mon[31212]: pgmap v13455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:26 smithi077 ceph-mon[27902]: pgmap v13455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25058.806447 secs 2024-04-21T17:22:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25058.806447 secs 2024-04-21T17:22:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25058.806447 secs 2024-04-21T17:22:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:28 smithi191 ceph-mon[31636]: pgmap v13456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:28 smithi170 ceph-mon[31212]: pgmap v13456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:28 smithi077 ceph-mon[27902]: pgmap v13456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25060.565820 secs 2024-04-21T17:22:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25060.565820 secs 2024-04-21T17:22:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25060.565820 secs 2024-04-21T17:22:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:30 smithi191 ceph-mon[31636]: pgmap v13457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:30 smithi170 ceph-mon[31212]: pgmap v13457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:30 smithi077 ceph-mon[27902]: pgmap v13457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: pgmap v13458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25063.806574 secs 2024-04-21T17:22:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:22:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: pgmap v13458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25063.806574 secs 2024-04-21T17:22:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:22:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: pgmap v13458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25063.806574 secs 2024-04-21T17:22:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:22:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:22:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:22:34.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:22:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:22:34.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:22:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:22:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:22:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:34 smithi191 ceph-mon[31636]: pgmap v13459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25065.565905 secs 2024-04-21T17:22:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:34 smithi170 ceph-mon[31212]: pgmap v13459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25065.565905 secs 2024-04-21T17:22:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:34 smithi077 ceph-mon[27902]: pgmap v13459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25065.565905 secs 2024-04-21T17:22:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:36 smithi191 ceph-mon[31636]: pgmap v13460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:36 smithi170 ceph-mon[31212]: pgmap v13460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:36 smithi077 ceph-mon[27902]: pgmap v13460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25068.806662 secs 2024-04-21T17:22:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25068.806662 secs 2024-04-21T17:22:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25068.806662 secs 2024-04-21T17:22:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:38 smithi191 ceph-mon[31636]: pgmap v13461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25070.565995 secs 2024-04-21T17:22:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:38 smithi170 ceph-mon[31212]: pgmap v13461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25070.565995 secs 2024-04-21T17:22:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:38 smithi077 ceph-mon[27902]: pgmap v13461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25070.565995 secs 2024-04-21T17:22:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:40 smithi191 ceph-mon[31636]: pgmap v13462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:40 smithi170 ceph-mon[31212]: pgmap v13462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:40 smithi077 ceph-mon[27902]: pgmap v13462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:42 smithi191 ceph-mon[31636]: pgmap v13463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25073.806814 secs 2024-04-21T17:22:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:42 smithi170 ceph-mon[31212]: pgmap v13463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25073.806814 secs 2024-04-21T17:22:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:42 smithi077 ceph-mon[27902]: pgmap v13463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25073.806814 secs 2024-04-21T17:22:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25075.566104 secs 2024-04-21T17:22:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25075.566104 secs 2024-04-21T17:22:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25075.566104 secs 2024-04-21T17:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:44 smithi191 ceph-mon[31636]: pgmap v13464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:44 smithi170 ceph-mon[31212]: pgmap v13464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:44 smithi077 ceph-mon[27902]: pgmap v13464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:46 smithi191 ceph-mon[31636]: pgmap v13465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:46 smithi170 ceph-mon[31212]: pgmap v13465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:46 smithi077 ceph-mon[27902]: pgmap v13465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25078.806937 secs 2024-04-21T17:22:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25078.806937 secs 2024-04-21T17:22:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25078.806937 secs 2024-04-21T17:22:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:48 smithi191 ceph-mon[31636]: pgmap v13466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25080.566220 secs 2024-04-21T17:22:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:48 smithi170 ceph-mon[31212]: pgmap v13466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25080.566220 secs 2024-04-21T17:22:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:48 smithi077 ceph-mon[27902]: pgmap v13466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25080.566220 secs 2024-04-21T17:22:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:50 smithi191 ceph-mon[31636]: pgmap v13467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:50 smithi170 ceph-mon[31212]: pgmap v13467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:50 smithi077 ceph-mon[27902]: pgmap v13467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:52 smithi170 ceph-mon[31212]: pgmap v13468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25083.807093 secs 2024-04-21T17:22:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:52 smithi077 ceph-mon[27902]: pgmap v13468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25083.807093 secs 2024-04-21T17:22:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:52 smithi191 ceph-mon[31636]: pgmap v13468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25083.807093 secs 2024-04-21T17:22:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25085.566385 secs 2024-04-21T17:22:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25085.566385 secs 2024-04-21T17:22:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25085.566385 secs 2024-04-21T17:22:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:22:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:54 smithi170 ceph-mon[31212]: pgmap v13469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:54 smithi077 ceph-mon[27902]: pgmap v13469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:54 smithi191 ceph-mon[31636]: pgmap v13469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:56 smithi170 ceph-mon[31212]: pgmap v13470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:56 smithi077 ceph-mon[27902]: pgmap v13470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:56 smithi191 ceph-mon[31636]: pgmap v13470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:22:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:22:57.821+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:22:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:22:57.821+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:22:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:22:57.821+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:22:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:22:57.821+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:22:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25088.807169 secs 2024-04-21T17:22:58.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25088.807169 secs 2024-04-21T17:22:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25088.807169 secs 2024-04-21T17:22:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:58 smithi170 ceph-mon[31212]: pgmap v13471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:22:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25090.566508 secs 2024-04-21T17:22:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:58 smithi077 ceph-mon[27902]: pgmap v13471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:22:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25090.566508 secs 2024-04-21T17:22:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:58 smithi191 ceph-mon[31636]: pgmap v13471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:22:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:22:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25090.566508 secs 2024-04-21T17:23:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:00 smithi170 ceph-mon[31212]: pgmap v13472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:00 smithi077 ceph-mon[27902]: pgmap v13472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:00 smithi191 ceph-mon[31636]: pgmap v13472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:02.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:02 smithi170 ceph-mon[31212]: pgmap v13473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T17:23:02.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:02 smithi077 ceph-mon[27902]: pgmap v13473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T17:23:02.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:02 smithi191 ceph-mon[31636]: pgmap v13473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T17:23:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25093.807308 secs 2024-04-21T17:23:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25093.807308 secs 2024-04-21T17:23:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25093.807308 secs 2024-04-21T17:23:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:04 smithi170 ceph-mon[31212]: pgmap v13474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T17:23:04.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25095.566645 secs 2024-04-21T17:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:04 smithi077 ceph-mon[27902]: pgmap v13474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T17:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25095.566645 secs 2024-04-21T17:23:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:04 smithi191 ceph-mon[31636]: pgmap v13474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T17:23:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25095.566645 secs 2024-04-21T17:23:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:05 smithi170 ceph-mon[31212]: osdmap e914: 12 total, 12 up, 12 in 2024-04-21T17:23:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:05 smithi077 ceph-mon[27902]: osdmap e914: 12 total, 12 up, 12 in 2024-04-21T17:23:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:05 smithi191 ceph-mon[31636]: osdmap e914: 12 total, 12 up, 12 in 2024-04-21T17:23:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:06 smithi077 ceph-mon[27902]: pgmap v13476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:23:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:06 smithi191 ceph-mon[31636]: pgmap v13476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:23:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:06 smithi170 ceph-mon[31212]: pgmap v13476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:23:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:07 smithi077 ceph-mon[27902]: osdmap e915: 12 total, 12 up, 12 in 2024-04-21T17:23:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25098.807440 secs 2024-04-21T17:23:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:07 smithi191 ceph-mon[31636]: osdmap e915: 12 total, 12 up, 12 in 2024-04-21T17:23:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25098.807440 secs 2024-04-21T17:23:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:07 smithi170 ceph-mon[31212]: osdmap e915: 12 total, 12 up, 12 in 2024-04-21T17:23:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25098.807440 secs 2024-04-21T17:23:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:08 smithi077 ceph-mon[27902]: pgmap v13478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:23:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:08 smithi191 ceph-mon[31636]: pgmap v13478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:23:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:08 smithi170 ceph-mon[31212]: pgmap v13478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:23:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25100.566782 secs 2024-04-21T17:23:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25100.566782 secs 2024-04-21T17:23:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25100.566782 secs 2024-04-21T17:23:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:10 smithi077 ceph-mon[27902]: pgmap v13479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T17:23:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:10 smithi191 ceph-mon[31636]: pgmap v13479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T17:23:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:10 smithi170 ceph-mon[31212]: pgmap v13479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T17:23:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:12 smithi077 ceph-mon[27902]: pgmap v13480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T17:23:13.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25103.807590 secs 2024-04-21T17:23:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:12 smithi191 ceph-mon[31636]: pgmap v13480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T17:23:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25103.807590 secs 2024-04-21T17:23:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:12 smithi170 ceph-mon[31212]: pgmap v13480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T17:23:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25103.807590 secs 2024-04-21T17:23:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:14 smithi077 ceph-mon[27902]: pgmap v13481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-04-21T17:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25105.566890 secs 2024-04-21T17:23:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:14 smithi191 ceph-mon[31636]: pgmap v13481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-04-21T17:23:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25105.566890 secs 2024-04-21T17:23:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:14 smithi170 ceph-mon[31212]: pgmap v13481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-04-21T17:23:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25105.566890 secs 2024-04-21T17:23:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:16 smithi077 ceph-mon[27902]: pgmap v13482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T17:23:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:16 smithi191 ceph-mon[31636]: pgmap v13482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T17:23:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:16 smithi170 ceph-mon[31212]: pgmap v13482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T17:23:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25108.807734 secs 2024-04-21T17:23:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25108.807734 secs 2024-04-21T17:23:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25108.807734 secs 2024-04-21T17:23:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:18 smithi077 ceph-mon[27902]: pgmap v13483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:23:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:18 smithi191 ceph-mon[31636]: pgmap v13483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:23:19.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:18 smithi170 ceph-mon[31212]: pgmap v13483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:23:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25110.567008 secs 2024-04-21T17:23:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25110.567008 secs 2024-04-21T17:23:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25110.567008 secs 2024-04-21T17:23:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:20 smithi191 ceph-mon[31636]: pgmap v13484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T17:23:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:20 smithi170 ceph-mon[31212]: pgmap v13484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T17:23:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:20 smithi077 ceph-mon[27902]: pgmap v13484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T17:23:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:22 smithi191 ceph-mon[31636]: pgmap v13485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:23:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25113.807877 secs 2024-04-21T17:23:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:22 smithi170 ceph-mon[31212]: pgmap v13485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:23:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25113.807877 secs 2024-04-21T17:23:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:22 smithi077 ceph-mon[27902]: pgmap v13485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:23:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25113.807877 secs 2024-04-21T17:23:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:24 smithi191 ceph-mon[31636]: pgmap v13486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:23:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25115.567118 secs 2024-04-21T17:23:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:24 smithi170 ceph-mon[31212]: pgmap v13486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:23:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25115.567118 secs 2024-04-21T17:23:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:24 smithi077 ceph-mon[27902]: pgmap v13486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:23:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25115.567118 secs 2024-04-21T17:23:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:26 smithi191 ceph-mon[31636]: pgmap v13487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:26 smithi170 ceph-mon[31212]: pgmap v13487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:26 smithi077 ceph-mon[27902]: pgmap v13487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25118.807939 secs 2024-04-21T17:23:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25118.807939 secs 2024-04-21T17:23:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25118.807939 secs 2024-04-21T17:23:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:28 smithi191 ceph-mon[31636]: pgmap v13488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:28 smithi170 ceph-mon[31212]: pgmap v13488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:28 smithi077 ceph-mon[27902]: pgmap v13488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25120.567271 secs 2024-04-21T17:23:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25120.567271 secs 2024-04-21T17:23:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25120.567271 secs 2024-04-21T17:23:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:30 smithi191 ceph-mon[31636]: pgmap v13489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:30 smithi170 ceph-mon[31212]: pgmap v13489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:30 smithi077 ceph-mon[27902]: pgmap v13489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:32 smithi191 ceph-mon[31636]: pgmap v13490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25123.808074 secs 2024-04-21T17:23:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:32 smithi170 ceph-mon[31212]: pgmap v13490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25123.808074 secs 2024-04-21T17:23:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:32 smithi077 ceph-mon[27902]: pgmap v13490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25123.808074 secs 2024-04-21T17:23:34.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:23:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:23:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:23:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:34 smithi191 ceph-mon[31636]: pgmap v13491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25125.567365 secs 2024-04-21T17:23:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:23:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:23:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:23:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:34 smithi170 ceph-mon[31212]: pgmap v13491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25125.567365 secs 2024-04-21T17:23:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:23:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:23:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:23:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:34 smithi077 ceph-mon[27902]: pgmap v13491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25125.567365 secs 2024-04-21T17:23:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:23:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:23:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:23:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:36 smithi191 ceph-mon[31636]: pgmap v13492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:36 smithi170 ceph-mon[31212]: pgmap v13492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:36 smithi077 ceph-mon[27902]: pgmap v13492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25128.808153 secs 2024-04-21T17:23:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25128.808153 secs 2024-04-21T17:23:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25128.808153 secs 2024-04-21T17:23:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:38 smithi191 ceph-mon[31636]: pgmap v13493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:38 smithi170 ceph-mon[31212]: pgmap v13493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:38 smithi077 ceph-mon[27902]: pgmap v13493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25130.567480 secs 2024-04-21T17:23:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25130.567480 secs 2024-04-21T17:23:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25130.567480 secs 2024-04-21T17:23:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:40 smithi191 ceph-mon[31636]: pgmap v13494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:40 smithi170 ceph-mon[31212]: pgmap v13494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:40 smithi077 ceph-mon[27902]: pgmap v13494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:42 smithi191 ceph-mon[31636]: pgmap v13495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25133.808297 secs 2024-04-21T17:23:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:42 smithi170 ceph-mon[31212]: pgmap v13495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25133.808297 secs 2024-04-21T17:23:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:42 smithi077 ceph-mon[27902]: pgmap v13495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25133.808297 secs 2024-04-21T17:23:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25135.567631 secs 2024-04-21T17:23:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25135.567631 secs 2024-04-21T17:23:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25135.567631 secs 2024-04-21T17:23:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:44 smithi191 ceph-mon[31636]: pgmap v13496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:44 smithi170 ceph-mon[31212]: pgmap v13496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:44 smithi077 ceph-mon[27902]: pgmap v13496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:46 smithi191 ceph-mon[31636]: pgmap v13497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:46 smithi170 ceph-mon[31212]: pgmap v13497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:46 smithi077 ceph-mon[27902]: pgmap v13497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25138.808438 secs 2024-04-21T17:23:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25138.808438 secs 2024-04-21T17:23:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25138.808438 secs 2024-04-21T17:23:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:48 smithi170 ceph-mon[31212]: pgmap v13498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25140.567751 secs 2024-04-21T17:23:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:48 smithi077 ceph-mon[27902]: pgmap v13498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25140.567751 secs 2024-04-21T17:23:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:48 smithi191 ceph-mon[31636]: pgmap v13498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25140.567751 secs 2024-04-21T17:23:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:50 smithi170 ceph-mon[31212]: pgmap v13499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:50 smithi077 ceph-mon[27902]: pgmap v13499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:50 smithi191 ceph-mon[31636]: pgmap v13499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:52 smithi170 ceph-mon[31212]: pgmap v13500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25143.808557 secs 2024-04-21T17:23:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:52 smithi077 ceph-mon[27902]: pgmap v13500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25143.808557 secs 2024-04-21T17:23:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:52 smithi191 ceph-mon[31636]: pgmap v13500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25143.808557 secs 2024-04-21T17:23:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25145.567888 secs 2024-04-21T17:23:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25145.567888 secs 2024-04-21T17:23:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25145.567888 secs 2024-04-21T17:23:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:23:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:54 smithi170 ceph-mon[31212]: pgmap v13501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:54 smithi077 ceph-mon[27902]: pgmap v13501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:54 smithi191 ceph-mon[31636]: pgmap v13501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:56 smithi170 ceph-mon[31212]: pgmap v13502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:56 smithi077 ceph-mon[27902]: pgmap v13502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:56 smithi191 ceph-mon[31636]: pgmap v13502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:23:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25148.808702 secs 2024-04-21T17:23:58.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25148.808702 secs 2024-04-21T17:23:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25148.808702 secs 2024-04-21T17:23:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:58 smithi170 ceph-mon[31212]: pgmap v13503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:23:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25150.568011 secs 2024-04-21T17:23:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:58 smithi077 ceph-mon[27902]: pgmap v13503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:23:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25150.568011 secs 2024-04-21T17:23:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:58 smithi191 ceph-mon[31636]: pgmap v13503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:23:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:23:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25150.568011 secs 2024-04-21T17:24:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:00 smithi170 ceph-mon[31212]: pgmap v13504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:00 smithi077 ceph-mon[27902]: pgmap v13504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:00 smithi191 ceph-mon[31636]: pgmap v13504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:03 smithi170 ceph-mon[31212]: pgmap v13505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25153.808855 secs 2024-04-21T17:24:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:02 smithi077 ceph-mon[27902]: pgmap v13505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25153.808855 secs 2024-04-21T17:24:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:03 smithi191 ceph-mon[31636]: pgmap v13505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25153.808855 secs 2024-04-21T17:24:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25155.568126 secs 2024-04-21T17:24:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25155.568126 secs 2024-04-21T17:24:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25155.568126 secs 2024-04-21T17:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:05 smithi170 ceph-mon[31212]: pgmap v13506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:05 smithi170 ceph-mon[31212]: osdmap e916: 12 total, 12 up, 12 in 2024-04-21T17:24:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:05 smithi077 ceph-mon[27902]: pgmap v13506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:05 smithi077 ceph-mon[27902]: osdmap e916: 12 total, 12 up, 12 in 2024-04-21T17:24:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:05 smithi191 ceph-mon[31636]: pgmap v13506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:05 smithi191 ceph-mon[31636]: osdmap e916: 12 total, 12 up, 12 in 2024-04-21T17:24:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:06 smithi170 ceph-mon[31212]: pgmap v13508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:24:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:06 smithi077 ceph-mon[27902]: pgmap v13508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:24:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:06 smithi191 ceph-mon[31636]: pgmap v13508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:24:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:07 smithi077 ceph-mon[27902]: osdmap e917: 12 total, 12 up, 12 in 2024-04-21T17:24:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25158.808980 secs 2024-04-21T17:24:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:07 smithi191 ceph-mon[31636]: osdmap e917: 12 total, 12 up, 12 in 2024-04-21T17:24:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25158.808980 secs 2024-04-21T17:24:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:07 smithi170 ceph-mon[31212]: osdmap e917: 12 total, 12 up, 12 in 2024-04-21T17:24:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25158.808980 secs 2024-04-21T17:24:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:08 smithi077 ceph-mon[27902]: pgmap v13510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:24:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:08 smithi191 ceph-mon[31636]: pgmap v13510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:24:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:08 smithi170 ceph-mon[31212]: pgmap v13510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:24:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25160.568268 secs 2024-04-21T17:24:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25160.568268 secs 2024-04-21T17:24:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25160.568268 secs 2024-04-21T17:24:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:10 smithi077 ceph-mon[27902]: pgmap v13511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:24:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:10 smithi191 ceph-mon[31636]: pgmap v13511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:24:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:10 smithi170 ceph-mon[31212]: pgmap v13511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:24:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:12 smithi191 ceph-mon[31636]: pgmap v13512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:24:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25163.809100 secs 2024-04-21T17:24:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:12 smithi170 ceph-mon[31212]: pgmap v13512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:24:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25163.809100 secs 2024-04-21T17:24:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:12 smithi077 ceph-mon[27902]: pgmap v13512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:24:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25163.809100 secs 2024-04-21T17:24:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:14 smithi191 ceph-mon[31636]: pgmap v13513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:24:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25165.568392 secs 2024-04-21T17:24:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:14 smithi170 ceph-mon[31212]: pgmap v13513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:24:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25165.568392 secs 2024-04-21T17:24:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:14 smithi077 ceph-mon[27902]: pgmap v13513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T17:24:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25165.568392 secs 2024-04-21T17:24:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:16 smithi191 ceph-mon[31636]: pgmap v13514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:24:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:16 smithi170 ceph-mon[31212]: pgmap v13514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:24:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:16 smithi077 ceph-mon[27902]: pgmap v13514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:24:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25168.809233 secs 2024-04-21T17:24:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25168.809233 secs 2024-04-21T17:24:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25168.809233 secs 2024-04-21T17:24:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:18 smithi191 ceph-mon[31636]: pgmap v13515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:24:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:18 smithi170 ceph-mon[31212]: pgmap v13515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:24:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:18 smithi077 ceph-mon[27902]: pgmap v13515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:24:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25170.568504 secs 2024-04-21T17:24:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25170.568504 secs 2024-04-21T17:24:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25170.568504 secs 2024-04-21T17:24:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:20 smithi191 ceph-mon[31636]: pgmap v13516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:24:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:20 smithi170 ceph-mon[31212]: pgmap v13516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:24:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:20 smithi077 ceph-mon[27902]: pgmap v13516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:24:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:22 smithi191 ceph-mon[31636]: pgmap v13517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:24:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25173.809357 secs 2024-04-21T17:24:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:22 smithi170 ceph-mon[31212]: pgmap v13517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:24:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25173.809357 secs 2024-04-21T17:24:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:22 smithi077 ceph-mon[27902]: pgmap v13517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:24:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25173.809357 secs 2024-04-21T17:24:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:24 smithi191 ceph-mon[31636]: pgmap v13518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25175.568625 secs 2024-04-21T17:24:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:24 smithi170 ceph-mon[31212]: pgmap v13518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25175.568625 secs 2024-04-21T17:24:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:24 smithi077 ceph-mon[27902]: pgmap v13518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25175.568625 secs 2024-04-21T17:24:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:26 smithi191 ceph-mon[31636]: pgmap v13519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:24:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:26 smithi170 ceph-mon[31212]: pgmap v13519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:24:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:26 smithi077 ceph-mon[27902]: pgmap v13519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:24:28.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25178.809477 secs 2024-04-21T17:24:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25178.809477 secs 2024-04-21T17:24:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25178.809477 secs 2024-04-21T17:24:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:28 smithi191 ceph-mon[31636]: pgmap v13520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:28 smithi170 ceph-mon[31212]: pgmap v13520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:28 smithi077 ceph-mon[27902]: pgmap v13520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25180.568747 secs 2024-04-21T17:24:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25180.568747 secs 2024-04-21T17:24:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25180.568747 secs 2024-04-21T17:24:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:30 smithi191 ceph-mon[31636]: pgmap v13521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:30 smithi170 ceph-mon[31212]: pgmap v13521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:30 smithi077 ceph-mon[27902]: pgmap v13521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:24:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:32 smithi191 ceph-mon[31636]: pgmap v13522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:24:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25183.809599 secs 2024-04-21T17:24:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:32 smithi170 ceph-mon[31212]: pgmap v13522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:24:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25183.809599 secs 2024-04-21T17:24:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:32 smithi077 ceph-mon[27902]: pgmap v13522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:24:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25183.809599 secs 2024-04-21T17:24:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:34 smithi191 ceph-mon[31636]: pgmap v13523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25185.568830 secs 2024-04-21T17:24:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:24:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:34 smithi170 ceph-mon[31212]: pgmap v13523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25185.568830 secs 2024-04-21T17:24:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:24:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:34 smithi077 ceph-mon[27902]: pgmap v13523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25185.568830 secs 2024-04-21T17:24:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:24:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:24:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:24:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:24:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:24:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:24:36.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:24:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:24:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:24:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:24:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:36 smithi191 ceph-mon[31636]: pgmap v13524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:36 smithi170 ceph-mon[31212]: pgmap v13524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:36 smithi077 ceph-mon[27902]: pgmap v13524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25188.809664 secs 2024-04-21T17:24:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25188.809664 secs 2024-04-21T17:24:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25188.809664 secs 2024-04-21T17:24:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:38 smithi191 ceph-mon[31636]: pgmap v13525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25190.568928 secs 2024-04-21T17:24:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:38 smithi170 ceph-mon[31212]: pgmap v13525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25190.568928 secs 2024-04-21T17:24:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:38 smithi077 ceph-mon[27902]: pgmap v13525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25190.568928 secs 2024-04-21T17:24:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:40 smithi191 ceph-mon[31636]: pgmap v13526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:40 smithi170 ceph-mon[31212]: pgmap v13526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:40 smithi077 ceph-mon[27902]: pgmap v13526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:42 smithi191 ceph-mon[31636]: pgmap v13527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25193.809793 secs 2024-04-21T17:24:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:42 smithi170 ceph-mon[31212]: pgmap v13527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25193.809793 secs 2024-04-21T17:24:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:42 smithi077 ceph-mon[27902]: pgmap v13527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25193.809793 secs 2024-04-21T17:24:44.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25195.569053 secs 2024-04-21T17:24:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25195.569053 secs 2024-04-21T17:24:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25195.569053 secs 2024-04-21T17:24:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:44 smithi191 ceph-mon[31636]: pgmap v13528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:44 smithi170 ceph-mon[31212]: pgmap v13528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:44 smithi077 ceph-mon[27902]: pgmap v13528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:46 smithi191 ceph-mon[31636]: pgmap v13529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:46 smithi170 ceph-mon[31212]: pgmap v13529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:46 smithi077 ceph-mon[27902]: pgmap v13529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25198.809915 secs 2024-04-21T17:24:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25198.809915 secs 2024-04-21T17:24:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25198.809915 secs 2024-04-21T17:24:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:48 smithi170 ceph-mon[31212]: pgmap v13530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25200.569181 secs 2024-04-21T17:24:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:48 smithi077 ceph-mon[27902]: pgmap v13530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25200.569181 secs 2024-04-21T17:24:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:48 smithi191 ceph-mon[31636]: pgmap v13530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25200.569181 secs 2024-04-21T17:24:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:50 smithi170 ceph-mon[31212]: pgmap v13531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:50 smithi077 ceph-mon[27902]: pgmap v13531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:50 smithi191 ceph-mon[31636]: pgmap v13531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:52 smithi170 ceph-mon[31212]: pgmap v13532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25203.810014 secs 2024-04-21T17:24:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:52 smithi077 ceph-mon[27902]: pgmap v13532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25203.810014 secs 2024-04-21T17:24:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:52 smithi191 ceph-mon[31636]: pgmap v13532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25203.810014 secs 2024-04-21T17:24:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25205.569305 secs 2024-04-21T17:24:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25205.569305 secs 2024-04-21T17:24:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25205.569305 secs 2024-04-21T17:24:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:24:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:54 smithi170 ceph-mon[31212]: pgmap v13533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:54 smithi077 ceph-mon[27902]: pgmap v13533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:54 smithi191 ceph-mon[31636]: pgmap v13533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:56 smithi170 ceph-mon[31212]: pgmap v13534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:56 smithi077 ceph-mon[27902]: pgmap v13534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:56 smithi191 ceph-mon[31636]: pgmap v13534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:24:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25208.810158 secs 2024-04-21T17:24:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25208.810158 secs 2024-04-21T17:24:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25208.810158 secs 2024-04-21T17:24:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:58 smithi170 ceph-mon[31212]: pgmap v13535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:24:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25210.569424 secs 2024-04-21T17:24:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:58 smithi077 ceph-mon[27902]: pgmap v13535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:24:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25210.569424 secs 2024-04-21T17:24:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:58 smithi191 ceph-mon[31636]: pgmap v13535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:24:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:24:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25210.569424 secs 2024-04-21T17:25:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:01 smithi170 ceph-mon[31212]: pgmap v13536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:01 smithi077 ceph-mon[27902]: pgmap v13536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:01 smithi191 ceph-mon[31636]: pgmap v13536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:03 smithi170 ceph-mon[31212]: pgmap v13537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25213.810305 secs 2024-04-21T17:25:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:03 smithi077 ceph-mon[27902]: pgmap v13537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25213.810305 secs 2024-04-21T17:25:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:03 smithi191 ceph-mon[31636]: pgmap v13537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25213.810305 secs 2024-04-21T17:25:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25215.569523 secs 2024-04-21T17:25:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25215.569523 secs 2024-04-21T17:25:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25215.569523 secs 2024-04-21T17:25:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:05 smithi170 ceph-mon[31212]: pgmap v13538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:05 smithi170 ceph-mon[31212]: osdmap e918: 12 total, 12 up, 12 in 2024-04-21T17:25:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:05 smithi077 ceph-mon[27902]: pgmap v13538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:05 smithi077 ceph-mon[27902]: osdmap e918: 12 total, 12 up, 12 in 2024-04-21T17:25:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:05 smithi191 ceph-mon[31636]: pgmap v13538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:05 smithi191 ceph-mon[31636]: osdmap e918: 12 total, 12 up, 12 in 2024-04-21T17:25:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:06 smithi077 ceph-mon[27902]: pgmap v13540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:25:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:06 smithi191 ceph-mon[31636]: pgmap v13540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:25:06.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:06 smithi170 ceph-mon[31212]: pgmap v13540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:25:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:07 smithi191 ceph-mon[31636]: osdmap e919: 12 total, 12 up, 12 in 2024-04-21T17:25:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25218.810429 secs 2024-04-21T17:25:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:07 smithi170 ceph-mon[31212]: osdmap e919: 12 total, 12 up, 12 in 2024-04-21T17:25:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25218.810429 secs 2024-04-21T17:25:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:07 smithi077 ceph-mon[27902]: osdmap e919: 12 total, 12 up, 12 in 2024-04-21T17:25:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25218.810429 secs 2024-04-21T17:25:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:08 smithi191 ceph-mon[31636]: pgmap v13542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:25:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:08 smithi170 ceph-mon[31212]: pgmap v13542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:25:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:08 smithi077 ceph-mon[27902]: pgmap v13542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:25:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25220.569666 secs 2024-04-21T17:25:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25220.569666 secs 2024-04-21T17:25:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25220.569666 secs 2024-04-21T17:25:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:10 smithi191 ceph-mon[31636]: pgmap v13543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:25:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:10 smithi170 ceph-mon[31212]: pgmap v13543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:25:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:10 smithi077 ceph-mon[27902]: pgmap v13543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:25:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:12 smithi191 ceph-mon[31636]: pgmap v13544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:25:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25223.810519 secs 2024-04-21T17:25:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:12 smithi170 ceph-mon[31212]: pgmap v13544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:25:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25223.810519 secs 2024-04-21T17:25:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:12 smithi077 ceph-mon[27902]: pgmap v13544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:25:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25223.810519 secs 2024-04-21T17:25:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:14 smithi191 ceph-mon[31636]: pgmap v13545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:25:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25225.569788 secs 2024-04-21T17:25:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:14 smithi170 ceph-mon[31212]: pgmap v13545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:25:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25225.569788 secs 2024-04-21T17:25:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:14 smithi077 ceph-mon[27902]: pgmap v13545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:25:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25225.569788 secs 2024-04-21T17:25:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:16 smithi191 ceph-mon[31636]: pgmap v13546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:25:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:16 smithi170 ceph-mon[31212]: pgmap v13546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:25:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:16 smithi077 ceph-mon[27902]: pgmap v13546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:25:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25228.810599 secs 2024-04-21T17:25:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25228.810599 secs 2024-04-21T17:25:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25228.810599 secs 2024-04-21T17:25:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:18 smithi191 ceph-mon[31636]: pgmap v13547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:25:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:18 smithi170 ceph-mon[31212]: pgmap v13547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:25:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:18 smithi077 ceph-mon[27902]: pgmap v13547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:25:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25230.569908 secs 2024-04-21T17:25:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25230.569908 secs 2024-04-21T17:25:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25230.569908 secs 2024-04-21T17:25:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:20 smithi191 ceph-mon[31636]: pgmap v13548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:25:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:20 smithi170 ceph-mon[31212]: pgmap v13548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:25:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:20 smithi077 ceph-mon[27902]: pgmap v13548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:25:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:22 smithi191 ceph-mon[31636]: pgmap v13549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:25:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25233.810745 secs 2024-04-21T17:25:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:22 smithi170 ceph-mon[31212]: pgmap v13549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:25:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25233.810745 secs 2024-04-21T17:25:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:22 smithi077 ceph-mon[27902]: pgmap v13549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:25:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25233.810745 secs 2024-04-21T17:25:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:24 smithi191 ceph-mon[31636]: pgmap v13550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25235.570051 secs 2024-04-21T17:25:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:24 smithi170 ceph-mon[31212]: pgmap v13550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25235.570051 secs 2024-04-21T17:25:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:24 smithi077 ceph-mon[27902]: pgmap v13550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25235.570051 secs 2024-04-21T17:25:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:26 smithi191 ceph-mon[31636]: pgmap v13551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:26 smithi170 ceph-mon[31212]: pgmap v13551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:26 smithi077 ceph-mon[27902]: pgmap v13551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:28.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25238.810852 secs 2024-04-21T17:25:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25238.810852 secs 2024-04-21T17:25:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25238.810852 secs 2024-04-21T17:25:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:28 smithi191 ceph-mon[31636]: pgmap v13552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:28 smithi170 ceph-mon[31212]: pgmap v13552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:28 smithi077 ceph-mon[27902]: pgmap v13552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25240.570138 secs 2024-04-21T17:25:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25240.570138 secs 2024-04-21T17:25:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25240.570138 secs 2024-04-21T17:25:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:30 smithi191 ceph-mon[31636]: pgmap v13553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:30 smithi170 ceph-mon[31212]: pgmap v13553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:30 smithi077 ceph-mon[27902]: pgmap v13553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:32 smithi191 ceph-mon[31636]: pgmap v13554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25243.810951 secs 2024-04-21T17:25:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:32 smithi170 ceph-mon[31212]: pgmap v13554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25243.810951 secs 2024-04-21T17:25:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:32 smithi077 ceph-mon[27902]: pgmap v13554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25243.810951 secs 2024-04-21T17:25:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:34 smithi191 ceph-mon[31636]: pgmap v13555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25245.570260 secs 2024-04-21T17:25:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:34 smithi170 ceph-mon[31212]: pgmap v13555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25245.570260 secs 2024-04-21T17:25:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:34 smithi077 ceph-mon[27902]: pgmap v13555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25245.570260 secs 2024-04-21T17:25:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:25:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:25:36.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:25:36.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:25:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:25:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:25:36.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:25:36.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:25:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:25:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:25:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:25:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:25:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:36 smithi191 ceph-mon[31636]: pgmap v13556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:36 smithi170 ceph-mon[31212]: pgmap v13556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:36 smithi077 ceph-mon[27902]: pgmap v13556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25248.811086 secs 2024-04-21T17:25:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25248.811086 secs 2024-04-21T17:25:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25248.811086 secs 2024-04-21T17:25:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:38 smithi191 ceph-mon[31636]: pgmap v13557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25250.570389 secs 2024-04-21T17:25:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:38 smithi170 ceph-mon[31212]: pgmap v13557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25250.570389 secs 2024-04-21T17:25:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:38 smithi077 ceph-mon[27902]: pgmap v13557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25250.570389 secs 2024-04-21T17:25:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:40 smithi170 ceph-mon[31212]: pgmap v13558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:40 smithi077 ceph-mon[27902]: pgmap v13558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:40 smithi191 ceph-mon[31636]: pgmap v13558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:42 smithi170 ceph-mon[31212]: pgmap v13559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25253.811208 secs 2024-04-21T17:25:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:42 smithi077 ceph-mon[27902]: pgmap v13559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25253.811208 secs 2024-04-21T17:25:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:42 smithi191 ceph-mon[31636]: pgmap v13559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25253.811208 secs 2024-04-21T17:25:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25255.570532 secs 2024-04-21T17:25:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25255.570532 secs 2024-04-21T17:25:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25255.570532 secs 2024-04-21T17:25:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:44 smithi170 ceph-mon[31212]: pgmap v13560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:44 smithi077 ceph-mon[27902]: pgmap v13560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:44 smithi191 ceph-mon[31636]: pgmap v13560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:46 smithi170 ceph-mon[31212]: pgmap v13561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:46 smithi077 ceph-mon[27902]: pgmap v13561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:46 smithi191 ceph-mon[31636]: pgmap v13561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25258.811310 secs 2024-04-21T17:25:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25258.811310 secs 2024-04-21T17:25:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25258.811310 secs 2024-04-21T17:25:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:48 smithi170 ceph-mon[31212]: pgmap v13562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25260.570599 secs 2024-04-21T17:25:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:48 smithi077 ceph-mon[27902]: pgmap v13562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25260.570599 secs 2024-04-21T17:25:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:48 smithi191 ceph-mon[31636]: pgmap v13562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25260.570599 secs 2024-04-21T17:25:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:50 smithi170 ceph-mon[31212]: pgmap v13563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:50 smithi077 ceph-mon[27902]: pgmap v13563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:50 smithi191 ceph-mon[31636]: pgmap v13563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:53 smithi170 ceph-mon[31212]: pgmap v13564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25263.811411 secs 2024-04-21T17:25:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:53 smithi077 ceph-mon[27902]: pgmap v13564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25263.811411 secs 2024-04-21T17:25:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:53 smithi191 ceph-mon[31636]: pgmap v13564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25263.811411 secs 2024-04-21T17:25:54.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25265.570719 secs 2024-04-21T17:25:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25265.570719 secs 2024-04-21T17:25:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25265.570719 secs 2024-04-21T17:25:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:25:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:55 smithi170 ceph-mon[31212]: pgmap v13565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:55 smithi077 ceph-mon[27902]: pgmap v13565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:55 smithi191 ceph-mon[31636]: pgmap v13565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:57 smithi170 ceph-mon[31212]: pgmap v13566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:57 smithi077 ceph-mon[27902]: pgmap v13566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:57 smithi191 ceph-mon[31636]: pgmap v13566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:25:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:25:57.846+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:25:57.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:25:57.846+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:25:57.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:25:57.847+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:25:57.847 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:25:57.847+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:25:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25268.811542 secs 2024-04-21T17:25:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25268.811542 secs 2024-04-21T17:25:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25268.811542 secs 2024-04-21T17:25:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:59 smithi170 ceph-mon[31212]: pgmap v13567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25270.570810 secs 2024-04-21T17:25:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:59 smithi077 ceph-mon[27902]: pgmap v13567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25270.570810 secs 2024-04-21T17:25:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:59 smithi191 ceph-mon[31636]: pgmap v13567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:25:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25270.570810 secs 2024-04-21T17:26:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:00 smithi170 ceph-mon[31212]: pgmap v13568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:00 smithi077 ceph-mon[27902]: pgmap v13568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:00 smithi191 ceph-mon[31636]: pgmap v13568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:02 smithi170 ceph-mon[31212]: pgmap v13569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:02.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25273.811641 secs 2024-04-21T17:26:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:02 smithi077 ceph-mon[27902]: pgmap v13569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25273.811641 secs 2024-04-21T17:26:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:02 smithi191 ceph-mon[31636]: pgmap v13569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25273.811641 secs 2024-04-21T17:26:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:04 smithi170 ceph-mon[31212]: pgmap v13570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25275.570927 secs 2024-04-21T17:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:04 smithi077 ceph-mon[27902]: pgmap v13570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25275.570927 secs 2024-04-21T17:26:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:04 smithi191 ceph-mon[31636]: pgmap v13570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25275.570927 secs 2024-04-21T17:26:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:05 smithi170 ceph-mon[31212]: osdmap e920: 12 total, 12 up, 12 in 2024-04-21T17:26:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:05 smithi077 ceph-mon[27902]: osdmap e920: 12 total, 12 up, 12 in 2024-04-21T17:26:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:05 smithi191 ceph-mon[31636]: osdmap e920: 12 total, 12 up, 12 in 2024-04-21T17:26:06.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:06 smithi170 ceph-mon[31212]: pgmap v13572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:26:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:06 smithi077 ceph-mon[27902]: pgmap v13572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:26:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:06 smithi191 ceph-mon[31636]: pgmap v13572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:26:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:07 smithi191 ceph-mon[31636]: osdmap e921: 12 total, 12 up, 12 in 2024-04-21T17:26:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25278.811795 secs 2024-04-21T17:26:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:07 smithi170 ceph-mon[31212]: osdmap e921: 12 total, 12 up, 12 in 2024-04-21T17:26:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25278.811795 secs 2024-04-21T17:26:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:07 smithi077 ceph-mon[27902]: osdmap e921: 12 total, 12 up, 12 in 2024-04-21T17:26:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25278.811795 secs 2024-04-21T17:26:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:08 smithi191 ceph-mon[31636]: pgmap v13574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:26:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:08 smithi170 ceph-mon[31212]: pgmap v13574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:26:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:08 smithi077 ceph-mon[27902]: pgmap v13574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:26:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25280.571073 secs 2024-04-21T17:26:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25280.571073 secs 2024-04-21T17:26:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25280.571073 secs 2024-04-21T17:26:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:10 smithi191 ceph-mon[31636]: pgmap v13575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:26:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:10 smithi170 ceph-mon[31212]: pgmap v13575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:26:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:10 smithi077 ceph-mon[27902]: pgmap v13575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:26:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:12 smithi191 ceph-mon[31636]: pgmap v13576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:26:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25283.811858 secs 2024-04-21T17:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:12 smithi170 ceph-mon[31212]: pgmap v13576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:26:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25283.811858 secs 2024-04-21T17:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:12 smithi077 ceph-mon[27902]: pgmap v13576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:26:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25283.811858 secs 2024-04-21T17:26:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:14 smithi191 ceph-mon[31636]: pgmap v13577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:26:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25285.571191 secs 2024-04-21T17:26:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:14 smithi170 ceph-mon[31212]: pgmap v13577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:26:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25285.571191 secs 2024-04-21T17:26:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:14 smithi077 ceph-mon[27902]: pgmap v13577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:26:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25285.571191 secs 2024-04-21T17:26:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:16 smithi191 ceph-mon[31636]: pgmap v13578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:26:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:16 smithi170 ceph-mon[31212]: pgmap v13578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:26:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:16 smithi077 ceph-mon[27902]: pgmap v13578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:26:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25288.811996 secs 2024-04-21T17:26:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25288.811996 secs 2024-04-21T17:26:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25288.811996 secs 2024-04-21T17:26:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:18 smithi191 ceph-mon[31636]: pgmap v13579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:26:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:18 smithi170 ceph-mon[31212]: pgmap v13579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:26:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:18 smithi077 ceph-mon[27902]: pgmap v13579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:26:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25290.571298 secs 2024-04-21T17:26:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25290.571298 secs 2024-04-21T17:26:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25290.571298 secs 2024-04-21T17:26:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:20 smithi191 ceph-mon[31636]: pgmap v13580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:26:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:20 smithi170 ceph-mon[31212]: pgmap v13580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:26:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:20 smithi077 ceph-mon[27902]: pgmap v13580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:26:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:22 smithi191 ceph-mon[31636]: pgmap v13581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:26:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25293.812087 secs 2024-04-21T17:26:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:22 smithi170 ceph-mon[31212]: pgmap v13581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:26:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25293.812087 secs 2024-04-21T17:26:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:22 smithi077 ceph-mon[27902]: pgmap v13581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:26:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25293.812087 secs 2024-04-21T17:26:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:24 smithi191 ceph-mon[31636]: pgmap v13582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25295.571459 secs 2024-04-21T17:26:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:24 smithi170 ceph-mon[31212]: pgmap v13582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25295.571459 secs 2024-04-21T17:26:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:24 smithi077 ceph-mon[27902]: pgmap v13582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25295.571459 secs 2024-04-21T17:26:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:26 smithi191 ceph-mon[31636]: pgmap v13583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:26 smithi170 ceph-mon[31212]: pgmap v13583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:26 smithi077 ceph-mon[27902]: pgmap v13583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:28.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25298.812183 secs 2024-04-21T17:26:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25298.812183 secs 2024-04-21T17:26:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25298.812183 secs 2024-04-21T17:26:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:28 smithi191 ceph-mon[31636]: pgmap v13584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:28 smithi170 ceph-mon[31212]: pgmap v13584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:28 smithi077 ceph-mon[27902]: pgmap v13584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25300.571564 secs 2024-04-21T17:26:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25300.571564 secs 2024-04-21T17:26:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25300.571564 secs 2024-04-21T17:26:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:30 smithi191 ceph-mon[31636]: pgmap v13585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:30 smithi170 ceph-mon[31212]: pgmap v13585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:30 smithi077 ceph-mon[27902]: pgmap v13585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:32 smithi191 ceph-mon[31636]: pgmap v13586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25303.812252 secs 2024-04-21T17:26:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:32 smithi170 ceph-mon[31212]: pgmap v13586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25303.812252 secs 2024-04-21T17:26:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:32 smithi077 ceph-mon[27902]: pgmap v13586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25303.812252 secs 2024-04-21T17:26:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25305.571681 secs 2024-04-21T17:26:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25305.571681 secs 2024-04-21T17:26:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25305.571681 secs 2024-04-21T17:26:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:34 smithi170 ceph-mon[31212]: pgmap v13587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:34 smithi077 ceph-mon[27902]: pgmap v13587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:34 smithi191 ceph-mon[31636]: pgmap v13587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:36.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:26:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:26:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:26:37.239 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:36 smithi077 ceph-mon[27902]: pgmap v13588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:36 smithi170 ceph-mon[31212]: pgmap v13588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:36 smithi191 ceph-mon[31636]: pgmap v13588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:38.300 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25308.812406 secs 2024-04-21T17:26:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25308.812406 secs 2024-04-21T17:26:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25308.812406 secs 2024-04-21T17:26:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:38 smithi077 ceph-mon[27902]: pgmap v13589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25310.571804 secs 2024-04-21T17:26:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:38 smithi170 ceph-mon[31212]: pgmap v13589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25310.571804 secs 2024-04-21T17:26:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:38 smithi191 ceph-mon[31636]: pgmap v13589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25310.571804 secs 2024-04-21T17:26:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:40 smithi077 ceph-mon[27902]: pgmap v13590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:26:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:26:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:40 smithi170 ceph-mon[31212]: pgmap v13590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:26:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:26:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:40 smithi191 ceph-mon[31636]: pgmap v13590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:26:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:26:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:26:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:42 smithi170 ceph-mon[31212]: pgmap v13591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25313.812509 secs 2024-04-21T17:26:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:42 smithi077 ceph-mon[27902]: pgmap v13591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25313.812509 secs 2024-04-21T17:26:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:42 smithi191 ceph-mon[31636]: pgmap v13591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25313.812509 secs 2024-04-21T17:26:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:43 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25315.571955 secs 2024-04-21T17:26:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:43 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25315.571955 secs 2024-04-21T17:26:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:43 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25315.571955 secs 2024-04-21T17:26:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:45 smithi170 ceph-mon[31212]: pgmap v13592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:45 smithi077 ceph-mon[27902]: pgmap v13592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:45 smithi191 ceph-mon[31636]: pgmap v13592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:47 smithi170 ceph-mon[31212]: pgmap v13593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:47 smithi077 ceph-mon[27902]: pgmap v13593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:47 smithi191 ceph-mon[31636]: pgmap v13593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25318.812629 secs 2024-04-21T17:26:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25318.812629 secs 2024-04-21T17:26:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25318.812629 secs 2024-04-21T17:26:49.296 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:49 smithi077 ceph-mon[27902]: pgmap v13594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:49.297 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25320.572071 secs 2024-04-21T17:26:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:49 smithi170 ceph-mon[31212]: pgmap v13594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25320.572071 secs 2024-04-21T17:26:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:49 smithi191 ceph-mon[31636]: pgmap v13594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25320.572071 secs 2024-04-21T17:26:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:51 smithi170 ceph-mon[31212]: pgmap v13595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:51 smithi077 ceph-mon[27902]: pgmap v13595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:51 smithi191 ceph-mon[31636]: pgmap v13595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:53 smithi170 ceph-mon[31212]: pgmap v13596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25323.812745 secs 2024-04-21T17:26:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:53 smithi077 ceph-mon[27902]: pgmap v13596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25323.812745 secs 2024-04-21T17:26:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:53 smithi191 ceph-mon[31636]: pgmap v13596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25323.812745 secs 2024-04-21T17:26:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25325.572195 secs 2024-04-21T17:26:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25325.572195 secs 2024-04-21T17:26:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25325.572195 secs 2024-04-21T17:26:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:26:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:55 smithi170 ceph-mon[31212]: pgmap v13597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:55 smithi077 ceph-mon[27902]: pgmap v13597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:55 smithi191 ceph-mon[31636]: pgmap v13597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:57 smithi170 ceph-mon[31212]: pgmap v13598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:57 smithi077 ceph-mon[27902]: pgmap v13598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:57 smithi191 ceph-mon[31636]: pgmap v13598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:26:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25328.812876 secs 2024-04-21T17:26:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:58 smithi170 ceph-mon[31212]: pgmap v13599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25328.812876 secs 2024-04-21T17:26:58.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:58 smithi191 ceph-mon[31636]: pgmap v13599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25328.812876 secs 2024-04-21T17:26:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:58 smithi077 ceph-mon[27902]: pgmap v13599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:26:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25330.572315 secs 2024-04-21T17:26:59.335 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25330.572315 secs 2024-04-21T17:26:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25330.572315 secs 2024-04-21T17:27:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:00 smithi170 ceph-mon[31212]: pgmap v13600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:00 smithi077 ceph-mon[27902]: pgmap v13600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:00 smithi191 ceph-mon[31636]: pgmap v13600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:02 smithi077 ceph-mon[27902]: pgmap v13601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25333.813008 secs 2024-04-21T17:27:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:02 smithi191 ceph-mon[31636]: pgmap v13601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25333.813008 secs 2024-04-21T17:27:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:02 smithi170 ceph-mon[31212]: pgmap v13601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25333.813008 secs 2024-04-21T17:27:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:04 smithi077 ceph-mon[27902]: pgmap v13602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25335.572392 secs 2024-04-21T17:27:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:04 smithi191 ceph-mon[31636]: pgmap v13602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25335.572392 secs 2024-04-21T17:27:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:04 smithi170 ceph-mon[31212]: pgmap v13602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:05.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25335.572392 secs 2024-04-21T17:27:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:05 smithi077 ceph-mon[27902]: osdmap e922: 12 total, 12 up, 12 in 2024-04-21T17:27:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:05 smithi191 ceph-mon[31636]: osdmap e922: 12 total, 12 up, 12 in 2024-04-21T17:27:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:05 smithi170 ceph-mon[31212]: osdmap e922: 12 total, 12 up, 12 in 2024-04-21T17:27:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:06 smithi077 ceph-mon[27902]: pgmap v13604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:27:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:06 smithi191 ceph-mon[31636]: pgmap v13604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:27:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:06 smithi170 ceph-mon[31212]: pgmap v13604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:27:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:07 smithi191 ceph-mon[31636]: osdmap e923: 12 total, 12 up, 12 in 2024-04-21T17:27:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25338.813112 secs 2024-04-21T17:27:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:07 smithi170 ceph-mon[31212]: osdmap e923: 12 total, 12 up, 12 in 2024-04-21T17:27:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25338.813112 secs 2024-04-21T17:27:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:07 smithi077 ceph-mon[27902]: osdmap e923: 12 total, 12 up, 12 in 2024-04-21T17:27:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25338.813112 secs 2024-04-21T17:27:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:08 smithi191 ceph-mon[31636]: pgmap v13606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:27:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:08 smithi170 ceph-mon[31212]: pgmap v13606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:27:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:08 smithi077 ceph-mon[27902]: pgmap v13606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:27:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25340.572506 secs 2024-04-21T17:27:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25340.572506 secs 2024-04-21T17:27:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25340.572506 secs 2024-04-21T17:27:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:10 smithi191 ceph-mon[31636]: pgmap v13607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:27:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:10 smithi170 ceph-mon[31212]: pgmap v13607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:27:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:10 smithi077 ceph-mon[27902]: pgmap v13607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:27:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:12 smithi191 ceph-mon[31636]: pgmap v13608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:27:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25343.813243 secs 2024-04-21T17:27:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:12 smithi170 ceph-mon[31212]: pgmap v13608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:27:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25343.813243 secs 2024-04-21T17:27:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:12 smithi077 ceph-mon[27902]: pgmap v13608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:27:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25343.813243 secs 2024-04-21T17:27:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:14 smithi191 ceph-mon[31636]: pgmap v13609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:27:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25345.572644 secs 2024-04-21T17:27:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:14 smithi170 ceph-mon[31212]: pgmap v13609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:27:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25345.572644 secs 2024-04-21T17:27:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:14 smithi077 ceph-mon[27902]: pgmap v13609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:27:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25345.572644 secs 2024-04-21T17:27:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:16 smithi191 ceph-mon[31636]: pgmap v13610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:27:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:16 smithi170 ceph-mon[31212]: pgmap v13610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:27:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:16 smithi077 ceph-mon[27902]: pgmap v13610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:27:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25348.813324 secs 2024-04-21T17:27:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25348.813324 secs 2024-04-21T17:27:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25348.813324 secs 2024-04-21T17:27:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:18 smithi191 ceph-mon[31636]: pgmap v13611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:27:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:18 smithi170 ceph-mon[31212]: pgmap v13611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:27:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:18 smithi077 ceph-mon[27902]: pgmap v13611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:27:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25350.572771 secs 2024-04-21T17:27:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25350.572771 secs 2024-04-21T17:27:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25350.572771 secs 2024-04-21T17:27:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:20 smithi191 ceph-mon[31636]: pgmap v13612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:27:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:20 smithi170 ceph-mon[31212]: pgmap v13612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:27:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:20 smithi077 ceph-mon[27902]: pgmap v13612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:27:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:22 smithi191 ceph-mon[31636]: pgmap v13613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:27:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25353.813472 secs 2024-04-21T17:27:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:22 smithi170 ceph-mon[31212]: pgmap v13613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:27:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25353.813472 secs 2024-04-21T17:27:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:22 smithi077 ceph-mon[27902]: pgmap v13613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:27:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25353.813472 secs 2024-04-21T17:27:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:24 smithi191 ceph-mon[31636]: pgmap v13614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25355.572910 secs 2024-04-21T17:27:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:24 smithi170 ceph-mon[31212]: pgmap v13614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25355.572910 secs 2024-04-21T17:27:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:24 smithi077 ceph-mon[27902]: pgmap v13614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25355.572910 secs 2024-04-21T17:27:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:26 smithi191 ceph-mon[31636]: pgmap v13615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:26 smithi170 ceph-mon[31212]: pgmap v13615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:26 smithi077 ceph-mon[27902]: pgmap v13615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25358.813594 secs 2024-04-21T17:27:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25358.813594 secs 2024-04-21T17:27:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25358.813594 secs 2024-04-21T17:27:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:28 smithi191 ceph-mon[31636]: pgmap v13616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:28 smithi170 ceph-mon[31212]: pgmap v13616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:28 smithi077 ceph-mon[27902]: pgmap v13616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25360.573038 secs 2024-04-21T17:27:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25360.573038 secs 2024-04-21T17:27:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25360.573038 secs 2024-04-21T17:27:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:30 smithi170 ceph-mon[31212]: pgmap v13617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:30 smithi077 ceph-mon[27902]: pgmap v13617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:30 smithi191 ceph-mon[31636]: pgmap v13617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:32 smithi170 ceph-mon[31212]: pgmap v13618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25363.813721 secs 2024-04-21T17:27:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:32 smithi077 ceph-mon[27902]: pgmap v13618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25363.813721 secs 2024-04-21T17:27:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:32 smithi191 ceph-mon[31636]: pgmap v13618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25363.813721 secs 2024-04-21T17:27:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25365.573178 secs 2024-04-21T17:27:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25365.573178 secs 2024-04-21T17:27:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25365.573178 secs 2024-04-21T17:27:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:34 smithi170 ceph-mon[31212]: pgmap v13619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:34 smithi077 ceph-mon[27902]: pgmap v13619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:34 smithi191 ceph-mon[31636]: pgmap v13619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:36 smithi170 ceph-mon[31212]: pgmap v13620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:36 smithi077 ceph-mon[27902]: pgmap v13620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:36 smithi191 ceph-mon[31636]: pgmap v13620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25368.813865 secs 2024-04-21T17:27:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25368.813865 secs 2024-04-21T17:27:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25368.813865 secs 2024-04-21T17:27:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:38 smithi170 ceph-mon[31212]: pgmap v13621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:38 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25370.573243 secs 2024-04-21T17:27:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:38 smithi077 ceph-mon[27902]: pgmap v13621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:38 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25370.573243 secs 2024-04-21T17:27:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:38 smithi191 ceph-mon[31636]: pgmap v13621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:38 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25370.573243 secs 2024-04-21T17:27:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:40 smithi170 ceph-mon[31212]: pgmap v13622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:27:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:40 smithi077 ceph-mon[27902]: pgmap v13622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:27:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:40 smithi191 ceph-mon[31636]: pgmap v13622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:27:43.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:43 smithi170 ceph-mon[31212]: pgmap v13623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:43.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25373.813933 secs 2024-04-21T17:27:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:43 smithi191 ceph-mon[31636]: pgmap v13623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25373.813933 secs 2024-04-21T17:27:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:43 smithi077 ceph-mon[27902]: pgmap v13623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25373.813933 secs 2024-04-21T17:27:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25375.573334 secs 2024-04-21T17:27:44.350 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25375.573334 secs 2024-04-21T17:27:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25375.573334 secs 2024-04-21T17:27:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: pgmap v13624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:27:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: pgmap v13624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:27:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:27:45.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: pgmap v13624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:27:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:27:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:47 smithi170 ceph-mon[31212]: pgmap v13625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:47 smithi077 ceph-mon[27902]: pgmap v13625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:47 smithi191 ceph-mon[31636]: pgmap v13625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25378.814038 secs 2024-04-21T17:27:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25378.814038 secs 2024-04-21T17:27:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25378.814038 secs 2024-04-21T17:27:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:49 smithi170 ceph-mon[31212]: pgmap v13626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25380.573477 secs 2024-04-21T17:27:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:49 smithi077 ceph-mon[27902]: pgmap v13626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25380.573477 secs 2024-04-21T17:27:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:49 smithi191 ceph-mon[31636]: pgmap v13626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25380.573477 secs 2024-04-21T17:27:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:51 smithi170 ceph-mon[31212]: pgmap v13627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:51 smithi077 ceph-mon[27902]: pgmap v13627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:51 smithi191 ceph-mon[31636]: pgmap v13627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:53 smithi170 ceph-mon[31212]: pgmap v13628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25383.814103 secs 2024-04-21T17:27:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:53 smithi077 ceph-mon[27902]: pgmap v13628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25383.814103 secs 2024-04-21T17:27:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:53 smithi191 ceph-mon[31636]: pgmap v13628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25383.814103 secs 2024-04-21T17:27:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25385.573619 secs 2024-04-21T17:27:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25385.573619 secs 2024-04-21T17:27:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25385.573619 secs 2024-04-21T17:27:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:55 smithi170 ceph-mon[31212]: pgmap v13629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:27:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:55 smithi191 ceph-mon[31636]: pgmap v13629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:55 smithi077 ceph-mon[27902]: pgmap v13629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:57 smithi170 ceph-mon[31212]: pgmap v13630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:57 smithi077 ceph-mon[27902]: pgmap v13630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:57 smithi191 ceph-mon[31636]: pgmap v13630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:27:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25388.814241 secs 2024-04-21T17:27:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25388.814241 secs 2024-04-21T17:27:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25388.814241 secs 2024-04-21T17:27:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:59 smithi170 ceph-mon[31212]: pgmap v13631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25390.573744 secs 2024-04-21T17:27:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:59 smithi077 ceph-mon[27902]: pgmap v13631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25390.573744 secs 2024-04-21T17:27:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:59 smithi191 ceph-mon[31636]: pgmap v13631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:27:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25390.573744 secs 2024-04-21T17:28:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:00 smithi170 ceph-mon[31212]: pgmap v13632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:00 smithi077 ceph-mon[27902]: pgmap v13632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:00 smithi191 ceph-mon[31636]: pgmap v13632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:02 smithi077 ceph-mon[27902]: pgmap v13633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25393.814329 secs 2024-04-21T17:28:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:02 smithi191 ceph-mon[31636]: pgmap v13633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25393.814329 secs 2024-04-21T17:28:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:02 smithi170 ceph-mon[31212]: pgmap v13633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25393.814329 secs 2024-04-21T17:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:04 smithi077 ceph-mon[27902]: pgmap v13634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25395.573876 secs 2024-04-21T17:28:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:04 smithi191 ceph-mon[31636]: pgmap v13634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25395.573876 secs 2024-04-21T17:28:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:04 smithi170 ceph-mon[31212]: pgmap v13634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25395.573876 secs 2024-04-21T17:28:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:05 smithi077 ceph-mon[27902]: osdmap e924: 12 total, 12 up, 12 in 2024-04-21T17:28:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:05 smithi191 ceph-mon[31636]: osdmap e924: 12 total, 12 up, 12 in 2024-04-21T17:28:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:05 smithi170 ceph-mon[31212]: osdmap e924: 12 total, 12 up, 12 in 2024-04-21T17:28:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:06 smithi077 ceph-mon[27902]: pgmap v13636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:28:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:06 smithi191 ceph-mon[31636]: pgmap v13636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:28:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:06 smithi170 ceph-mon[31212]: pgmap v13636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:28:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:07 smithi191 ceph-mon[31636]: osdmap e925: 12 total, 12 up, 12 in 2024-04-21T17:28:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25398.814449 secs 2024-04-21T17:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:07 smithi170 ceph-mon[31212]: osdmap e925: 12 total, 12 up, 12 in 2024-04-21T17:28:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25398.814449 secs 2024-04-21T17:28:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:07 smithi077 ceph-mon[27902]: osdmap e925: 12 total, 12 up, 12 in 2024-04-21T17:28:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25398.814449 secs 2024-04-21T17:28:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:08 smithi191 ceph-mon[31636]: pgmap v13638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:28:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:08 smithi170 ceph-mon[31212]: pgmap v13638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:28:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:08 smithi077 ceph-mon[27902]: pgmap v13638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:28:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25400.573997 secs 2024-04-21T17:28:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25400.573997 secs 2024-04-21T17:28:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25400.573997 secs 2024-04-21T17:28:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:10 smithi191 ceph-mon[31636]: pgmap v13639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:28:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:10 smithi170 ceph-mon[31212]: pgmap v13639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:28:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:10 smithi077 ceph-mon[27902]: pgmap v13639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:28:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:12 smithi191 ceph-mon[31636]: pgmap v13640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:28:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25403.814548 secs 2024-04-21T17:28:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:12 smithi170 ceph-mon[31212]: pgmap v13640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:28:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25403.814548 secs 2024-04-21T17:28:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:12 smithi077 ceph-mon[27902]: pgmap v13640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:28:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25403.814548 secs 2024-04-21T17:28:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:14 smithi191 ceph-mon[31636]: pgmap v13641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:28:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25405.574108 secs 2024-04-21T17:28:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:14 smithi170 ceph-mon[31212]: pgmap v13641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:28:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25405.574108 secs 2024-04-21T17:28:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:14 smithi077 ceph-mon[27902]: pgmap v13641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:28:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25405.574108 secs 2024-04-21T17:28:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:16 smithi191 ceph-mon[31636]: pgmap v13642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:28:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:16 smithi170 ceph-mon[31212]: pgmap v13642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:28:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:16 smithi077 ceph-mon[27902]: pgmap v13642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:28:18.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25408.814692 secs 2024-04-21T17:28:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25408.814692 secs 2024-04-21T17:28:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25408.814692 secs 2024-04-21T17:28:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:18 smithi191 ceph-mon[31636]: pgmap v13643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:28:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:18 smithi170 ceph-mon[31212]: pgmap v13643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:28:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:18 smithi077 ceph-mon[27902]: pgmap v13643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:20.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25410.574220 secs 2024-04-21T17:28:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25410.574220 secs 2024-04-21T17:28:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25410.574220 secs 2024-04-21T17:28:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:20 smithi191 ceph-mon[31636]: pgmap v13644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:28:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:20 smithi170 ceph-mon[31212]: pgmap v13644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:28:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:20 smithi077 ceph-mon[27902]: pgmap v13644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:28:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:22 smithi170 ceph-mon[31212]: pgmap v13645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:28:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25413.814823 secs 2024-04-21T17:28:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:22 smithi077 ceph-mon[27902]: pgmap v13645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:28:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25413.814823 secs 2024-04-21T17:28:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:22 smithi191 ceph-mon[31636]: pgmap v13645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:28:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25413.814823 secs 2024-04-21T17:28:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:24 smithi170 ceph-mon[31212]: pgmap v13646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25415.574328 secs 2024-04-21T17:28:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:24 smithi077 ceph-mon[27902]: pgmap v13646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25415.574328 secs 2024-04-21T17:28:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:24 smithi191 ceph-mon[31636]: pgmap v13646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25415.574328 secs 2024-04-21T17:28:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:26 smithi170 ceph-mon[31212]: pgmap v13647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:26 smithi077 ceph-mon[27902]: pgmap v13647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:26 smithi191 ceph-mon[31636]: pgmap v13647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25418.814934 secs 2024-04-21T17:28:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25418.814934 secs 2024-04-21T17:28:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25418.814934 secs 2024-04-21T17:28:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:28 smithi170 ceph-mon[31212]: pgmap v13648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25420.574467 secs 2024-04-21T17:28:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:28 smithi077 ceph-mon[27902]: pgmap v13648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25420.574467 secs 2024-04-21T17:28:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:28 smithi191 ceph-mon[31636]: pgmap v13648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25420.574467 secs 2024-04-21T17:28:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:30 smithi170 ceph-mon[31212]: pgmap v13649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:30 smithi077 ceph-mon[27902]: pgmap v13649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:30 smithi191 ceph-mon[31636]: pgmap v13649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:32 smithi170 ceph-mon[31212]: pgmap v13650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25423.815051 secs 2024-04-21T17:28:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:32 smithi077 ceph-mon[27902]: pgmap v13650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25423.815051 secs 2024-04-21T17:28:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:32 smithi191 ceph-mon[31636]: pgmap v13650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25423.815051 secs 2024-04-21T17:28:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:33 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25425.574618 secs 2024-04-21T17:28:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:33 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25425.574618 secs 2024-04-21T17:28:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:33 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25425.574618 secs 2024-04-21T17:28:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:34 smithi170 ceph-mon[31212]: pgmap v13651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:34 smithi077 ceph-mon[27902]: pgmap v13651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:34 smithi191 ceph-mon[31636]: pgmap v13651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:37 smithi170 ceph-mon[31212]: pgmap v13652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:36 smithi077 ceph-mon[27902]: pgmap v13652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:37 smithi191 ceph-mon[31636]: pgmap v13652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25428.815170 secs 2024-04-21T17:28:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25428.815170 secs 2024-04-21T17:28:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25428.815170 secs 2024-04-21T17:28:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:39 smithi170 ceph-mon[31212]: pgmap v13653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25430.574747 secs 2024-04-21T17:28:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:39 smithi077 ceph-mon[27902]: pgmap v13653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25430.574747 secs 2024-04-21T17:28:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:39 smithi191 ceph-mon[31636]: pgmap v13653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25430.574747 secs 2024-04-21T17:28:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:41 smithi170 ceph-mon[31212]: pgmap v13654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:41 smithi077 ceph-mon[27902]: pgmap v13654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:41 smithi191 ceph-mon[31636]: pgmap v13654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:43 smithi170 ceph-mon[31212]: pgmap v13655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25433.815320 secs 2024-04-21T17:28:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:43 smithi077 ceph-mon[27902]: pgmap v13655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25433.815320 secs 2024-04-21T17:28:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:43 smithi191 ceph-mon[31636]: pgmap v13655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25433.815320 secs 2024-04-21T17:28:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25435.574847 secs 2024-04-21T17:28:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25435.574847 secs 2024-04-21T17:28:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25435.574847 secs 2024-04-21T17:28:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:45 smithi170 ceph-mon[31212]: pgmap v13656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:45 smithi077 ceph-mon[27902]: pgmap v13656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:45 smithi191 ceph-mon[31636]: pgmap v13656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:28:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:28:46.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:28:46.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:28:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:28:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:28:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:28:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:28:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:28:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:28:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:28:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:28:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:47 smithi170 ceph-mon[31212]: pgmap v13657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:47 smithi077 ceph-mon[27902]: pgmap v13657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:47 smithi191 ceph-mon[31636]: pgmap v13657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25438.815458 secs 2024-04-21T17:28:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25438.815458 secs 2024-04-21T17:28:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25438.815458 secs 2024-04-21T17:28:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:49 smithi170 ceph-mon[31212]: pgmap v13658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25440.574966 secs 2024-04-21T17:28:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:49 smithi077 ceph-mon[27902]: pgmap v13658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25440.574966 secs 2024-04-21T17:28:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:49 smithi191 ceph-mon[31636]: pgmap v13658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25440.574966 secs 2024-04-21T17:28:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:51 smithi170 ceph-mon[31212]: pgmap v13659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:51 smithi077 ceph-mon[27902]: pgmap v13659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:51 smithi191 ceph-mon[31636]: pgmap v13659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:53 smithi170 ceph-mon[31212]: pgmap v13660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25443.815596 secs 2024-04-21T17:28:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:53 smithi077 ceph-mon[27902]: pgmap v13660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25443.815596 secs 2024-04-21T17:28:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:53 smithi191 ceph-mon[31636]: pgmap v13660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25443.815596 secs 2024-04-21T17:28:54.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25445.575071 secs 2024-04-21T17:28:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25445.575071 secs 2024-04-21T17:28:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.444+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T17:28:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.444+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T17:28:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.444+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:28:54.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.444+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T17:28:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.445+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:28:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.445+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T17:28:54.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.445+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T17:28:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25445.575071 secs 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7002b070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7002b070 comp rx=0 tx=0).stop 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:28:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:54.488+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efd700108f0 tx=0x7efd7003e070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T17:28:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:28:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:55 smithi170 ceph-mon[31212]: pgmap v13661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:55 smithi077 ceph-mon[27902]: pgmap v13661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:55 smithi191 ceph-mon[31636]: pgmap v13661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:57 smithi170 ceph-mon[31212]: pgmap v13662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:57 smithi077 ceph-mon[27902]: pgmap v13662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:57 smithi191 ceph-mon[31636]: pgmap v13662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:28:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:57.872+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:28:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:57.872+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:28:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:57.872+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:28:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:28:57.872+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:28:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25448.815720 secs 2024-04-21T17:28:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25448.815720 secs 2024-04-21T17:28:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25448.815720 secs 2024-04-21T17:28:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:59 smithi077 ceph-mon[27902]: pgmap v13663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25450.575135 secs 2024-04-21T17:28:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:59 smithi191 ceph-mon[31636]: pgmap v13663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25450.575135 secs 2024-04-21T17:28:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:59 smithi170 ceph-mon[31212]: pgmap v13663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:28:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25450.575135 secs 2024-04-21T17:29:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:00 smithi077 ceph-mon[27902]: pgmap v13664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:00 smithi191 ceph-mon[31636]: pgmap v13664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:00 smithi170 ceph-mon[31212]: pgmap v13664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:02 smithi077 ceph-mon[27902]: pgmap v13665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T17:29:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25453.815866 secs 2024-04-21T17:29:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:02 smithi191 ceph-mon[31636]: pgmap v13665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T17:29:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25453.815866 secs 2024-04-21T17:29:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:02 smithi170 ceph-mon[31212]: pgmap v13665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T17:29:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25453.815866 secs 2024-04-21T17:29:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:04 smithi077 ceph-mon[27902]: pgmap v13666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T17:29:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25455.575242 secs 2024-04-21T17:29:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:04 smithi191 ceph-mon[31636]: pgmap v13666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T17:29:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25455.575242 secs 2024-04-21T17:29:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:04 smithi170 ceph-mon[31212]: pgmap v13666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T17:29:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25455.575242 secs 2024-04-21T17:29:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:05 smithi077 ceph-mon[27902]: osdmap e926: 12 total, 12 up, 12 in 2024-04-21T17:29:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:05 smithi191 ceph-mon[31636]: osdmap e926: 12 total, 12 up, 12 in 2024-04-21T17:29:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:05 smithi170 ceph-mon[31212]: osdmap e926: 12 total, 12 up, 12 in 2024-04-21T17:29:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:06 smithi077 ceph-mon[27902]: pgmap v13668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:29:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:06 smithi191 ceph-mon[31636]: pgmap v13668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:29:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:06 smithi170 ceph-mon[31212]: pgmap v13668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:29:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:07 smithi191 ceph-mon[31636]: osdmap e927: 12 total, 12 up, 12 in 2024-04-21T17:29:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25458.815945 secs 2024-04-21T17:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:07 smithi170 ceph-mon[31212]: osdmap e927: 12 total, 12 up, 12 in 2024-04-21T17:29:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25458.815945 secs 2024-04-21T17:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:07 smithi077 ceph-mon[27902]: osdmap e927: 12 total, 12 up, 12 in 2024-04-21T17:29:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25458.815945 secs 2024-04-21T17:29:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:08 smithi191 ceph-mon[31636]: pgmap v13670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:29:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:08 smithi170 ceph-mon[31212]: pgmap v13670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:29:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:08 smithi077 ceph-mon[27902]: pgmap v13670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:29:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25460.575356 secs 2024-04-21T17:29:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25460.575356 secs 2024-04-21T17:29:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25460.575356 secs 2024-04-21T17:29:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:10 smithi191 ceph-mon[31636]: pgmap v13671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T17:29:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:10 smithi170 ceph-mon[31212]: pgmap v13671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T17:29:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:10 smithi077 ceph-mon[27902]: pgmap v13671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T17:29:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:12 smithi191 ceph-mon[31636]: pgmap v13672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T17:29:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25463.816055 secs 2024-04-21T17:29:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:12 smithi170 ceph-mon[31212]: pgmap v13672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T17:29:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25463.816055 secs 2024-04-21T17:29:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:12 smithi077 ceph-mon[27902]: pgmap v13672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T17:29:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25463.816055 secs 2024-04-21T17:29:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:14 smithi191 ceph-mon[31636]: pgmap v13673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T17:29:15.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25465.575470 secs 2024-04-21T17:29:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:14 smithi170 ceph-mon[31212]: pgmap v13673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T17:29:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25465.575470 secs 2024-04-21T17:29:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:14 smithi077 ceph-mon[27902]: pgmap v13673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T17:29:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25465.575470 secs 2024-04-21T17:29:17.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:16 smithi191 ceph-mon[31636]: pgmap v13674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:29:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:16 smithi170 ceph-mon[31212]: pgmap v13674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:29:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:16 smithi077 ceph-mon[27902]: pgmap v13674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:29:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25468.816173 secs 2024-04-21T17:29:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25468.816173 secs 2024-04-21T17:29:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25468.816173 secs 2024-04-21T17:29:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:18 smithi170 ceph-mon[31212]: pgmap v13675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:29:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:18 smithi077 ceph-mon[27902]: pgmap v13675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:29:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:18 smithi191 ceph-mon[31636]: pgmap v13675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:29:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:20.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25470.575581 secs 2024-04-21T17:29:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25470.575581 secs 2024-04-21T17:29:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25470.575581 secs 2024-04-21T17:29:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:20 smithi170 ceph-mon[31212]: pgmap v13676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:29:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:20 smithi077 ceph-mon[27902]: pgmap v13676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:29:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:20 smithi191 ceph-mon[31636]: pgmap v13676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:29:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:22 smithi170 ceph-mon[31212]: pgmap v13677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:29:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25473.816297 secs 2024-04-21T17:29:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:22 smithi077 ceph-mon[27902]: pgmap v13677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:29:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25473.816297 secs 2024-04-21T17:29:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:22 smithi191 ceph-mon[31636]: pgmap v13677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:29:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25473.816297 secs 2024-04-21T17:29:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:24 smithi170 ceph-mon[31212]: pgmap v13678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25475.575703 secs 2024-04-21T17:29:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:24 smithi077 ceph-mon[27902]: pgmap v13678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25475.575703 secs 2024-04-21T17:29:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:24 smithi191 ceph-mon[31636]: pgmap v13678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25475.575703 secs 2024-04-21T17:29:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:26 smithi170 ceph-mon[31212]: pgmap v13679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:26 smithi077 ceph-mon[27902]: pgmap v13679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:26 smithi191 ceph-mon[31636]: pgmap v13679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25478.816415 secs 2024-04-21T17:29:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25478.816415 secs 2024-04-21T17:29:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25478.816415 secs 2024-04-21T17:29:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:28 smithi170 ceph-mon[31212]: pgmap v13680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:28 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25480.575822 secs 2024-04-21T17:29:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:28 smithi077 ceph-mon[27902]: pgmap v13680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:28 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25480.575822 secs 2024-04-21T17:29:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:28 smithi191 ceph-mon[31636]: pgmap v13680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:28 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25480.575822 secs 2024-04-21T17:29:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:30 smithi170 ceph-mon[31212]: pgmap v13681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:30 smithi077 ceph-mon[27902]: pgmap v13681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:30 smithi191 ceph-mon[31636]: pgmap v13681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:33 smithi170 ceph-mon[31212]: pgmap v13682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25483.816559 secs 2024-04-21T17:29:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:33 smithi077 ceph-mon[27902]: pgmap v13682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25483.816559 secs 2024-04-21T17:29:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:33 smithi191 ceph-mon[31636]: pgmap v13682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25483.816559 secs 2024-04-21T17:29:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25485.575973 secs 2024-04-21T17:29:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25485.575973 secs 2024-04-21T17:29:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25485.575973 secs 2024-04-21T17:29:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:35 smithi170 ceph-mon[31212]: pgmap v13683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:35 smithi077 ceph-mon[27902]: pgmap v13683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:35 smithi191 ceph-mon[31636]: pgmap v13683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:37 smithi170 ceph-mon[31212]: pgmap v13684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:37 smithi077 ceph-mon[27902]: pgmap v13684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:37 smithi191 ceph-mon[31636]: pgmap v13684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25488.816625 secs 2024-04-21T17:29:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25488.816625 secs 2024-04-21T17:29:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25488.816625 secs 2024-04-21T17:29:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:39 smithi170 ceph-mon[31212]: pgmap v13685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25490.576089 secs 2024-04-21T17:29:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:39 smithi077 ceph-mon[27902]: pgmap v13685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25490.576089 secs 2024-04-21T17:29:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:39 smithi191 ceph-mon[31636]: pgmap v13685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25490.576089 secs 2024-04-21T17:29:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:41 smithi170 ceph-mon[31212]: pgmap v13686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:41 smithi077 ceph-mon[27902]: pgmap v13686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:41 smithi191 ceph-mon[31636]: pgmap v13686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:29:42.879+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:29:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:29:42.879+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:29:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:29:42.879+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:29:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:29:42.879+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:29:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:43 smithi170 ceph-mon[31212]: pgmap v13687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25493.816700 secs 2024-04-21T17:29:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:43 smithi077 ceph-mon[27902]: pgmap v13687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25493.816700 secs 2024-04-21T17:29:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:43 smithi191 ceph-mon[31636]: pgmap v13687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25493.816700 secs 2024-04-21T17:29:44.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25495.576203 secs 2024-04-21T17:29:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25495.576203 secs 2024-04-21T17:29:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25495.576203 secs 2024-04-21T17:29:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:45 smithi170 ceph-mon[31212]: pgmap v13688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:45 smithi077 ceph-mon[27902]: pgmap v13688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:45 smithi191 ceph-mon[31636]: pgmap v13688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:46.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:29:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:29:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:29:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:47 smithi170 ceph-mon[31212]: pgmap v13689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:29:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:29:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:29:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:47 smithi077 ceph-mon[27902]: pgmap v13689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:29:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:29:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:29:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:47 smithi191 ceph-mon[31636]: pgmap v13689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:29:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:29:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:29:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25498.816791 secs 2024-04-21T17:29:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25498.816791 secs 2024-04-21T17:29:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25498.816791 secs 2024-04-21T17:29:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:49 smithi170 ceph-mon[31212]: pgmap v13690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25500.576282 secs 2024-04-21T17:29:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:49 smithi077 ceph-mon[27902]: pgmap v13690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25500.576282 secs 2024-04-21T17:29:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:49 smithi191 ceph-mon[31636]: pgmap v13690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25500.576282 secs 2024-04-21T17:29:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:51 smithi170 ceph-mon[31212]: pgmap v13691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:51 smithi077 ceph-mon[27902]: pgmap v13691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:51 smithi191 ceph-mon[31636]: pgmap v13691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:53 smithi077 ceph-mon[27902]: pgmap v13692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25503.816907 secs 2024-04-21T17:29:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:53 smithi191 ceph-mon[31636]: pgmap v13692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25503.816907 secs 2024-04-21T17:29:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:53 smithi170 ceph-mon[31212]: pgmap v13692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25503.816907 secs 2024-04-21T17:29:54.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25505.576396 secs 2024-04-21T17:29:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25505.576396 secs 2024-04-21T17:29:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25505.576396 secs 2024-04-21T17:29:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:29:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:55 smithi077 ceph-mon[27902]: pgmap v13693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:55 smithi191 ceph-mon[31636]: pgmap v13693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:55 smithi170 ceph-mon[31212]: pgmap v13693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:56.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:56 smithi077 ceph-mon[27902]: pgmap v13694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:56.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:56 smithi191 ceph-mon[31636]: pgmap v13694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:56.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:56 smithi170 ceph-mon[31212]: pgmap v13694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:29:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25508.817028 secs 2024-04-21T17:29:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25508.817028 secs 2024-04-21T17:29:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25508.817028 secs 2024-04-21T17:29:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:58 smithi170 ceph-mon[31212]: pgmap v13695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:58.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:58 smithi191 ceph-mon[31636]: pgmap v13695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:58 smithi077 ceph-mon[27902]: pgmap v13695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:29:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25510.576507 secs 2024-04-21T17:29:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25510.576507 secs 2024-04-21T17:29:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25510.576507 secs 2024-04-21T17:30:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:00 smithi077 ceph-mon[27902]: pgmap v13696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:30:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:00 smithi191 ceph-mon[31636]: pgmap v13696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:30:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:00 smithi170 ceph-mon[31212]: pgmap v13696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:30:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:02 smithi077 ceph-mon[27902]: pgmap v13697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T17:30:02.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25513.817133 secs 2024-04-21T17:30:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:02 smithi191 ceph-mon[31636]: pgmap v13697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T17:30:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25513.817133 secs 2024-04-21T17:30:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:02 smithi170 ceph-mon[31212]: pgmap v13697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T17:30:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25513.817133 secs 2024-04-21T17:30:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:04 smithi077 ceph-mon[27902]: pgmap v13698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T17:30:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25515.576624 secs 2024-04-21T17:30:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:04 smithi191 ceph-mon[31636]: pgmap v13698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T17:30:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25515.576624 secs 2024-04-21T17:30:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:04 smithi170 ceph-mon[31212]: pgmap v13698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T17:30:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25515.576624 secs 2024-04-21T17:30:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:05 smithi077 ceph-mon[27902]: osdmap e928: 12 total, 12 up, 12 in 2024-04-21T17:30:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:05 smithi191 ceph-mon[31636]: osdmap e928: 12 total, 12 up, 12 in 2024-04-21T17:30:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:05 smithi170 ceph-mon[31212]: osdmap e928: 12 total, 12 up, 12 in 2024-04-21T17:30:06.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:06 smithi077 ceph-mon[27902]: pgmap v13700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:30:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:06 smithi191 ceph-mon[31636]: pgmap v13700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:30:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:06 smithi170 ceph-mon[31212]: pgmap v13700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:30:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25518.817254 secs 2024-04-21T17:30:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:07 smithi191 ceph-mon[31636]: osdmap e929: 12 total, 12 up, 12 in 2024-04-21T17:30:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25518.817254 secs 2024-04-21T17:30:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:07 smithi170 ceph-mon[31212]: osdmap e929: 12 total, 12 up, 12 in 2024-04-21T17:30:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25518.817254 secs 2024-04-21T17:30:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:07 smithi077 ceph-mon[27902]: osdmap e929: 12 total, 12 up, 12 in 2024-04-21T17:30:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:08 smithi191 ceph-mon[31636]: pgmap v13702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:30:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:08 smithi170 ceph-mon[31212]: pgmap v13702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:30:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:08 smithi077 ceph-mon[27902]: pgmap v13702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:30:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25520.576737 secs 2024-04-21T17:30:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25520.576737 secs 2024-04-21T17:30:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25520.576737 secs 2024-04-21T17:30:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:10 smithi170 ceph-mon[31212]: pgmap v13703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-04-21T17:30:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:10 smithi077 ceph-mon[27902]: pgmap v13703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-04-21T17:30:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:10 smithi191 ceph-mon[31636]: pgmap v13703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-04-21T17:30:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:12 smithi170 ceph-mon[31212]: pgmap v13704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T17:30:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25523.817377 secs 2024-04-21T17:30:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:12 smithi077 ceph-mon[27902]: pgmap v13704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T17:30:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25523.817377 secs 2024-04-21T17:30:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:12 smithi191 ceph-mon[31636]: pgmap v13704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T17:30:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25523.817377 secs 2024-04-21T17:30:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:14 smithi170 ceph-mon[31212]: pgmap v13705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T17:30:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25525.576851 secs 2024-04-21T17:30:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:14 smithi077 ceph-mon[27902]: pgmap v13705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T17:30:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25525.576851 secs 2024-04-21T17:30:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:14 smithi191 ceph-mon[31636]: pgmap v13705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T17:30:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25525.576851 secs 2024-04-21T17:30:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:16 smithi170 ceph-mon[31212]: pgmap v13706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:30:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:16 smithi077 ceph-mon[27902]: pgmap v13706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:30:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:16 smithi191 ceph-mon[31636]: pgmap v13706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:30:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25528.817522 secs 2024-04-21T17:30:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25528.817522 secs 2024-04-21T17:30:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25528.817522 secs 2024-04-21T17:30:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:18 smithi170 ceph-mon[31212]: pgmap v13707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:30:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:18 smithi077 ceph-mon[27902]: pgmap v13707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:30:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:18 smithi191 ceph-mon[31636]: pgmap v13707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:30:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25530.576952 secs 2024-04-21T17:30:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25530.576952 secs 2024-04-21T17:30:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25530.576952 secs 2024-04-21T17:30:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:21 smithi170 ceph-mon[31212]: pgmap v13708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:30:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:21 smithi077 ceph-mon[27902]: pgmap v13708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:30:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:21 smithi191 ceph-mon[31636]: pgmap v13708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:30:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:23 smithi170 ceph-mon[31212]: pgmap v13709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:30:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25533.817670 secs 2024-04-21T17:30:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:23 smithi077 ceph-mon[27902]: pgmap v13709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:30:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25533.817670 secs 2024-04-21T17:30:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:23 smithi191 ceph-mon[31636]: pgmap v13709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:30:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25533.817670 secs 2024-04-21T17:30:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25535.577107 secs 2024-04-21T17:30:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25535.577107 secs 2024-04-21T17:30:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25535.577107 secs 2024-04-21T17:30:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:25 smithi170 ceph-mon[31212]: pgmap v13710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:25 smithi077 ceph-mon[27902]: pgmap v13710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:25 smithi191 ceph-mon[31636]: pgmap v13710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:27 smithi170 ceph-mon[31212]: pgmap v13711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:27 smithi077 ceph-mon[27902]: pgmap v13711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:27 smithi191 ceph-mon[31636]: pgmap v13711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25538.817802 secs 2024-04-21T17:30:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25538.817802 secs 2024-04-21T17:30:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25538.817802 secs 2024-04-21T17:30:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:29 smithi170 ceph-mon[31212]: pgmap v13712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25540.577171 secs 2024-04-21T17:30:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:29 smithi077 ceph-mon[27902]: pgmap v13712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25540.577171 secs 2024-04-21T17:30:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:29 smithi191 ceph-mon[31636]: pgmap v13712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25540.577171 secs 2024-04-21T17:30:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:31 smithi170 ceph-mon[31212]: pgmap v13713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:31 smithi077 ceph-mon[27902]: pgmap v13713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:31 smithi191 ceph-mon[31636]: pgmap v13713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:33 smithi170 ceph-mon[31212]: pgmap v13714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25543.817927 secs 2024-04-21T17:30:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:33 smithi077 ceph-mon[27902]: pgmap v13714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25543.817927 secs 2024-04-21T17:30:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:33 smithi191 ceph-mon[31636]: pgmap v13714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25543.817927 secs 2024-04-21T17:30:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25545.577306 secs 2024-04-21T17:30:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25545.577306 secs 2024-04-21T17:30:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25545.577306 secs 2024-04-21T17:30:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:35 smithi170 ceph-mon[31212]: pgmap v13715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:35 smithi077 ceph-mon[27902]: pgmap v13715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:35 smithi191 ceph-mon[31636]: pgmap v13715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:37 smithi170 ceph-mon[31212]: pgmap v13716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:37 smithi077 ceph-mon[27902]: pgmap v13716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:37 smithi191 ceph-mon[31636]: pgmap v13716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25548.818049 secs 2024-04-21T17:30:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25548.818049 secs 2024-04-21T17:30:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25548.818049 secs 2024-04-21T17:30:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:39 smithi170 ceph-mon[31212]: pgmap v13717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25550.577402 secs 2024-04-21T17:30:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:39 smithi077 ceph-mon[27902]: pgmap v13717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25550.577402 secs 2024-04-21T17:30:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:39 smithi191 ceph-mon[31636]: pgmap v13717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25550.577402 secs 2024-04-21T17:30:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:41 smithi077 ceph-mon[27902]: pgmap v13718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:41 smithi191 ceph-mon[31636]: pgmap v13718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:41 smithi170 ceph-mon[31212]: pgmap v13718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:43 smithi077 ceph-mon[27902]: pgmap v13719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25553.818189 secs 2024-04-21T17:30:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:43 smithi191 ceph-mon[31636]: pgmap v13719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25553.818189 secs 2024-04-21T17:30:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:43 smithi170 ceph-mon[31212]: pgmap v13719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25553.818189 secs 2024-04-21T17:30:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25555.577520 secs 2024-04-21T17:30:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25555.577520 secs 2024-04-21T17:30:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25555.577520 secs 2024-04-21T17:30:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:45 smithi077 ceph-mon[27902]: pgmap v13720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:45 smithi191 ceph-mon[31636]: pgmap v13720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:45 smithi170 ceph-mon[31212]: pgmap v13720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:46.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:46 smithi077 ceph-mon[27902]: pgmap v13721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:46 smithi191 ceph-mon[31636]: pgmap v13721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:46 smithi170 ceph-mon[31212]: pgmap v13721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:30:47.448 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:30:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:30:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25558.818276 secs 2024-04-21T17:30:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:48 smithi077 ceph-mon[27902]: pgmap v13722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25558.818276 secs 2024-04-21T17:30:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:48 smithi191 ceph-mon[31636]: pgmap v13722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25558.818276 secs 2024-04-21T17:30:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:48 smithi170 ceph-mon[31212]: pgmap v13722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25560.577608 secs 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25560.577608 secs 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25560.577608 secs 2024-04-21T17:30:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:30:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:50 smithi191 ceph-mon[31636]: pgmap v13723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:30:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:50 smithi170 ceph-mon[31212]: pgmap v13723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:30:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:50 smithi077 ceph-mon[27902]: pgmap v13723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:52 smithi077 ceph-mon[27902]: pgmap v13724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:52.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25563.818397 secs 2024-04-21T17:30:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:52 smithi191 ceph-mon[31636]: pgmap v13724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25563.818397 secs 2024-04-21T17:30:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:52 smithi170 ceph-mon[31212]: pgmap v13724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25563.818397 secs 2024-04-21T17:30:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:54 smithi077 ceph-mon[27902]: pgmap v13725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25565.577740 secs 2024-04-21T17:30:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:54 smithi191 ceph-mon[31636]: pgmap v13725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25565.577740 secs 2024-04-21T17:30:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:54 smithi170 ceph-mon[31212]: pgmap v13725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25565.577740 secs 2024-04-21T17:30:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:30:56.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:56 smithi077 ceph-mon[27902]: pgmap v13726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:56 smithi191 ceph-mon[31636]: pgmap v13726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:56 smithi170 ceph-mon[31212]: pgmap v13726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:30:57.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25568.818513 secs 2024-04-21T17:30:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25568.818513 secs 2024-04-21T17:30:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25568.818513 secs 2024-04-21T17:30:58.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:58 smithi170 ceph-mon[31212]: pgmap v13727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:58 smithi191 ceph-mon[31636]: pgmap v13727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:58 smithi077 ceph-mon[27902]: pgmap v13727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:30:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25570.577898 secs 2024-04-21T17:31:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25570.577898 secs 2024-04-21T17:31:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25570.577898 secs 2024-04-21T17:31:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:00 smithi191 ceph-mon[31636]: pgmap v13728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:00 smithi170 ceph-mon[31212]: pgmap v13728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:00 smithi077 ceph-mon[27902]: pgmap v13728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:02 smithi191 ceph-mon[31636]: pgmap v13729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25573.818632 secs 2024-04-21T17:31:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:02 smithi170 ceph-mon[31212]: pgmap v13729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25573.818632 secs 2024-04-21T17:31:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:02 smithi077 ceph-mon[27902]: pgmap v13729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25573.818632 secs 2024-04-21T17:31:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:04 smithi191 ceph-mon[31636]: pgmap v13730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25575.578021 secs 2024-04-21T17:31:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:04 smithi170 ceph-mon[31212]: pgmap v13730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25575.578021 secs 2024-04-21T17:31:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:04 smithi077 ceph-mon[27902]: pgmap v13730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25575.578021 secs 2024-04-21T17:31:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:05 smithi191 ceph-mon[31636]: osdmap e930: 12 total, 12 up, 12 in 2024-04-21T17:31:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:05 smithi170 ceph-mon[31212]: osdmap e930: 12 total, 12 up, 12 in 2024-04-21T17:31:06.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:05 smithi077 ceph-mon[27902]: osdmap e930: 12 total, 12 up, 12 in 2024-04-21T17:31:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:06 smithi191 ceph-mon[31636]: pgmap v13732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:31:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:06 smithi170 ceph-mon[31212]: pgmap v13732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:31:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:06 smithi077 ceph-mon[27902]: pgmap v13732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25578.818757 secs 2024-04-21T17:31:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:07 smithi170 ceph-mon[31212]: osdmap e931: 12 total, 12 up, 12 in 2024-04-21T17:31:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25578.818757 secs 2024-04-21T17:31:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:07 smithi077 ceph-mon[27902]: osdmap e931: 12 total, 12 up, 12 in 2024-04-21T17:31:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25578.818757 secs 2024-04-21T17:31:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:07 smithi191 ceph-mon[31636]: osdmap e931: 12 total, 12 up, 12 in 2024-04-21T17:31:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:08 smithi170 ceph-mon[31212]: pgmap v13734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:31:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:08 smithi077 ceph-mon[27902]: pgmap v13734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:31:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:08 smithi191 ceph-mon[31636]: pgmap v13734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:31:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25580.578086 secs 2024-04-21T17:31:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25580.578086 secs 2024-04-21T17:31:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25580.578086 secs 2024-04-21T17:31:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:10 smithi170 ceph-mon[31212]: pgmap v13735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:31:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:10 smithi077 ceph-mon[27902]: pgmap v13735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:31:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:10 smithi191 ceph-mon[31636]: pgmap v13735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:31:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:12 smithi170 ceph-mon[31212]: pgmap v13736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:31:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25583.818871 secs 2024-04-21T17:31:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:12 smithi077 ceph-mon[27902]: pgmap v13736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:31:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25583.818871 secs 2024-04-21T17:31:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:12 smithi191 ceph-mon[31636]: pgmap v13736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:31:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25583.818871 secs 2024-04-21T17:31:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:14 smithi170 ceph-mon[31212]: pgmap v13737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:31:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25585.578211 secs 2024-04-21T17:31:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:14 smithi077 ceph-mon[27902]: pgmap v13737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:31:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25585.578211 secs 2024-04-21T17:31:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:14 smithi191 ceph-mon[31636]: pgmap v13737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:31:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25585.578211 secs 2024-04-21T17:31:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:17 smithi170 ceph-mon[31212]: pgmap v13738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:31:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:16 smithi077 ceph-mon[27902]: pgmap v13738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:31:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:16 smithi191 ceph-mon[31636]: pgmap v13738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:31:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25588.818948 secs 2024-04-21T17:31:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25588.818948 secs 2024-04-21T17:31:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25588.818948 secs 2024-04-21T17:31:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:19 smithi170 ceph-mon[31212]: pgmap v13739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:31:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25590.578330 secs 2024-04-21T17:31:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:19 smithi077 ceph-mon[27902]: pgmap v13739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:31:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25590.578330 secs 2024-04-21T17:31:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:19 smithi191 ceph-mon[31636]: pgmap v13739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:31:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25590.578330 secs 2024-04-21T17:31:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:21 smithi170 ceph-mon[31212]: pgmap v13740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:31:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:21 smithi077 ceph-mon[27902]: pgmap v13740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:31:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:21 smithi191 ceph-mon[31636]: pgmap v13740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:31:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:23 smithi170 ceph-mon[31212]: pgmap v13741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:31:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25593.819045 secs 2024-04-21T17:31:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:23 smithi077 ceph-mon[27902]: pgmap v13741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:31:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25593.819045 secs 2024-04-21T17:31:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:23 smithi191 ceph-mon[31636]: pgmap v13741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:31:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25593.819045 secs 2024-04-21T17:31:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25595.578459 secs 2024-04-21T17:31:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25595.578459 secs 2024-04-21T17:31:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25595.578459 secs 2024-04-21T17:31:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:25 smithi170 ceph-mon[31212]: pgmap v13742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:25 smithi077 ceph-mon[27902]: pgmap v13742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:25 smithi191 ceph-mon[31636]: pgmap v13742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:27 smithi170 ceph-mon[31212]: pgmap v13743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:27 smithi077 ceph-mon[27902]: pgmap v13743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:27 smithi191 ceph-mon[31636]: pgmap v13743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25598.819169 secs 2024-04-21T17:31:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25598.819169 secs 2024-04-21T17:31:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25598.819169 secs 2024-04-21T17:31:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:29 smithi170 ceph-mon[31212]: pgmap v13744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25600.578577 secs 2024-04-21T17:31:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:29 smithi077 ceph-mon[27902]: pgmap v13744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25600.578577 secs 2024-04-21T17:31:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:29 smithi191 ceph-mon[31636]: pgmap v13744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25600.578577 secs 2024-04-21T17:31:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:31 smithi170 ceph-mon[31212]: pgmap v13745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:31 smithi077 ceph-mon[27902]: pgmap v13745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:31 smithi191 ceph-mon[31636]: pgmap v13745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:33 smithi170 ceph-mon[31212]: pgmap v13746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25603.819288 secs 2024-04-21T17:31:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:33 smithi077 ceph-mon[27902]: pgmap v13746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25603.819288 secs 2024-04-21T17:31:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:33 smithi191 ceph-mon[31636]: pgmap v13746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25603.819288 secs 2024-04-21T17:31:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25605.578729 secs 2024-04-21T17:31:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25605.578729 secs 2024-04-21T17:31:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25605.578729 secs 2024-04-21T17:31:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:35 smithi170 ceph-mon[31212]: pgmap v13747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:35 smithi077 ceph-mon[27902]: pgmap v13747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:35 smithi191 ceph-mon[31636]: pgmap v13747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:37 smithi170 ceph-mon[31212]: pgmap v13748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:37 smithi077 ceph-mon[27902]: pgmap v13748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:37 smithi191 ceph-mon[31636]: pgmap v13748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25608.819407 secs 2024-04-21T17:31:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25608.819407 secs 2024-04-21T17:31:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25608.819407 secs 2024-04-21T17:31:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:39 smithi077 ceph-mon[27902]: pgmap v13749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25610.578846 secs 2024-04-21T17:31:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:39 smithi191 ceph-mon[31636]: pgmap v13749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25610.578846 secs 2024-04-21T17:31:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:39 smithi170 ceph-mon[31212]: pgmap v13749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25610.578846 secs 2024-04-21T17:31:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:41 smithi077 ceph-mon[27902]: pgmap v13750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:41 smithi191 ceph-mon[31636]: pgmap v13750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:41 smithi170 ceph-mon[31212]: pgmap v13750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:43 smithi077 ceph-mon[27902]: pgmap v13751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25613.819468 secs 2024-04-21T17:31:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:43 smithi191 ceph-mon[31636]: pgmap v13751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25613.819468 secs 2024-04-21T17:31:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:43 smithi170 ceph-mon[31212]: pgmap v13751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25613.819468 secs 2024-04-21T17:31:44.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25615.578947 secs 2024-04-21T17:31:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25615.578947 secs 2024-04-21T17:31:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25615.578947 secs 2024-04-21T17:31:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:45 smithi077 ceph-mon[27902]: pgmap v13752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:45 smithi191 ceph-mon[31636]: pgmap v13752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:45 smithi170 ceph-mon[31212]: pgmap v13752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:47 smithi077 ceph-mon[27902]: pgmap v13753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:47 smithi191 ceph-mon[31636]: pgmap v13753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:47 smithi170 ceph-mon[31212]: pgmap v13753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25618.819565 secs 2024-04-21T17:31:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25618.819565 secs 2024-04-21T17:31:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25618.819565 secs 2024-04-21T17:31:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:49 smithi077 ceph-mon[27902]: pgmap v13754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25620.579032 secs 2024-04-21T17:31:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:49 smithi191 ceph-mon[31636]: pgmap v13754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25620.579032 secs 2024-04-21T17:31:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:49 smithi170 ceph-mon[31212]: pgmap v13754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25620.579032 secs 2024-04-21T17:31:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:50 smithi077 ceph-mon[27902]: pgmap v13755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:31:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:50 smithi191 ceph-mon[31636]: pgmap v13755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:31:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:50 smithi170 ceph-mon[31212]: pgmap v13755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:31:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:31:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:31:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:31:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:31:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:31:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:31:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:31:52.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:52 smithi191 ceph-mon[31636]: pgmap v13756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:52 smithi170 ceph-mon[31212]: pgmap v13756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:52 smithi077 ceph-mon[27902]: pgmap v13756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25623.819681 secs 2024-04-21T17:31:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25623.819681 secs 2024-04-21T17:31:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25623.819681 secs 2024-04-21T17:31:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:54 smithi191 ceph-mon[31636]: pgmap v13757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:54.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25625.579104 secs 2024-04-21T17:31:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:54 smithi170 ceph-mon[31212]: pgmap v13757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25625.579104 secs 2024-04-21T17:31:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:54 smithi077 ceph-mon[27902]: pgmap v13757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25625.579104 secs 2024-04-21T17:31:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:31:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:56 smithi191 ceph-mon[31636]: pgmap v13758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:56 smithi170 ceph-mon[31212]: pgmap v13758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:56 smithi077 ceph-mon[27902]: pgmap v13758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:31:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:31:57.897+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:31:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:31:57.897+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:31:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:31:57.897+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:31:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:31:57.897+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:31:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25628.819798 secs 2024-04-21T17:31:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25628.819798 secs 2024-04-21T17:31:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25628.819798 secs 2024-04-21T17:31:58.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:58 smithi170 ceph-mon[31212]: pgmap v13759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:58 smithi191 ceph-mon[31636]: pgmap v13759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:58 smithi077 ceph-mon[27902]: pgmap v13759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:31:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25630.579217 secs 2024-04-21T17:32:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25630.579217 secs 2024-04-21T17:32:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25630.579217 secs 2024-04-21T17:32:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:00 smithi191 ceph-mon[31636]: pgmap v13760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:00 smithi170 ceph-mon[31212]: pgmap v13760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:00 smithi077 ceph-mon[27902]: pgmap v13760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:02 smithi191 ceph-mon[31636]: pgmap v13761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25633.819862 secs 2024-04-21T17:32:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:02 smithi170 ceph-mon[31212]: pgmap v13761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25633.819862 secs 2024-04-21T17:32:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:02 smithi077 ceph-mon[27902]: pgmap v13761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25633.819862 secs 2024-04-21T17:32:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:04 smithi191 ceph-mon[31636]: pgmap v13762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25635.579355 secs 2024-04-21T17:32:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:04 smithi170 ceph-mon[31212]: pgmap v13762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25635.579355 secs 2024-04-21T17:32:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:04 smithi077 ceph-mon[27902]: pgmap v13762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25635.579355 secs 2024-04-21T17:32:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:05 smithi191 ceph-mon[31636]: osdmap e932: 12 total, 12 up, 12 in 2024-04-21T17:32:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:05 smithi170 ceph-mon[31212]: osdmap e932: 12 total, 12 up, 12 in 2024-04-21T17:32:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:05 smithi077 ceph-mon[27902]: osdmap e932: 12 total, 12 up, 12 in 2024-04-21T17:32:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:06 smithi191 ceph-mon[31636]: pgmap v13764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:06 smithi170 ceph-mon[31212]: pgmap v13764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:06 smithi077 ceph-mon[27902]: pgmap v13764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25638.819983 secs 2024-04-21T17:32:08.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25638.819983 secs 2024-04-21T17:32:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25638.819983 secs 2024-04-21T17:32:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:08 smithi191 ceph-mon[31636]: pgmap v13765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:08 smithi170 ceph-mon[31212]: pgmap v13765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:08 smithi077 ceph-mon[27902]: pgmap v13765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25640.579505 secs 2024-04-21T17:32:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25640.579505 secs 2024-04-21T17:32:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25640.579505 secs 2024-04-21T17:32:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:10 smithi191 ceph-mon[31636]: pgmap v13766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:10 smithi170 ceph-mon[31212]: pgmap v13766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:10 smithi077 ceph-mon[27902]: pgmap v13766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:32:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:12 smithi170 ceph-mon[31212]: pgmap v13767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:32:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25643.820083 secs 2024-04-21T17:32:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:12 smithi170 ceph-mon[31212]: osdmap e933: 12 total, 12 up, 12 in 2024-04-21T17:32:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:12 smithi077 ceph-mon[27902]: pgmap v13767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:32:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25643.820083 secs 2024-04-21T17:32:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:12 smithi077 ceph-mon[27902]: osdmap e933: 12 total, 12 up, 12 in 2024-04-21T17:32:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:12 smithi191 ceph-mon[31636]: pgmap v13767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:32:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25643.820083 secs 2024-04-21T17:32:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:12 smithi191 ceph-mon[31636]: osdmap e933: 12 total, 12 up, 12 in 2024-04-21T17:32:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:14 smithi170 ceph-mon[31212]: pgmap v13769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:32:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25645.579605 secs 2024-04-21T17:32:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:14 smithi077 ceph-mon[27902]: pgmap v13769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:32:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25645.579605 secs 2024-04-21T17:32:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:14 smithi191 ceph-mon[31636]: pgmap v13769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:32:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25645.579605 secs 2024-04-21T17:32:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:16 smithi170 ceph-mon[31212]: pgmap v13770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:16 smithi077 ceph-mon[27902]: pgmap v13770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:16 smithi191 ceph-mon[31636]: pgmap v13770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25648.820197 secs 2024-04-21T17:32:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25648.820197 secs 2024-04-21T17:32:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25648.820197 secs 2024-04-21T17:32:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:18 smithi170 ceph-mon[31212]: pgmap v13771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:18 smithi077 ceph-mon[27902]: pgmap v13771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:18 smithi191 ceph-mon[31636]: pgmap v13771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25650.579723 secs 2024-04-21T17:32:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25650.579723 secs 2024-04-21T17:32:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25650.579723 secs 2024-04-21T17:32:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:21 smithi170 ceph-mon[31212]: pgmap v13772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:21 smithi077 ceph-mon[27902]: pgmap v13772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:21 smithi191 ceph-mon[31636]: pgmap v13772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:32:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:23 smithi170 ceph-mon[31212]: pgmap v13773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:32:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25653.820348 secs 2024-04-21T17:32:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:23 smithi077 ceph-mon[27902]: pgmap v13773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:32:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25653.820348 secs 2024-04-21T17:32:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:23 smithi191 ceph-mon[31636]: pgmap v13773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T17:32:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25653.820348 secs 2024-04-21T17:32:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:25 smithi170 ceph-mon[31212]: pgmap v13774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:32:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25655.579833 secs 2024-04-21T17:32:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:25 smithi077 ceph-mon[27902]: pgmap v13774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:32:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25655.579833 secs 2024-04-21T17:32:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:25 smithi191 ceph-mon[31636]: pgmap v13774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:32:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25655.579833 secs 2024-04-21T17:32:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:27 smithi170 ceph-mon[31212]: pgmap v13775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:27 smithi077 ceph-mon[27902]: pgmap v13775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:27 smithi191 ceph-mon[31636]: pgmap v13775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25658.820491 secs 2024-04-21T17:32:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25658.820491 secs 2024-04-21T17:32:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25658.820491 secs 2024-04-21T17:32:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:29 smithi170 ceph-mon[31212]: pgmap v13776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25660.579965 secs 2024-04-21T17:32:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:29 smithi077 ceph-mon[27902]: pgmap v13776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25660.579965 secs 2024-04-21T17:32:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:29 smithi191 ceph-mon[31636]: pgmap v13776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25660.579965 secs 2024-04-21T17:32:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:31 smithi170 ceph-mon[31212]: pgmap v13777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:31 smithi077 ceph-mon[27902]: pgmap v13777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:31 smithi191 ceph-mon[31636]: pgmap v13777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:33 smithi170 ceph-mon[31212]: pgmap v13778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25663.820587 secs 2024-04-21T17:32:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:33 smithi077 ceph-mon[27902]: pgmap v13778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25663.820587 secs 2024-04-21T17:32:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:33 smithi191 ceph-mon[31636]: pgmap v13778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25663.820587 secs 2024-04-21T17:32:34.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25665.580097 secs 2024-04-21T17:32:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25665.580097 secs 2024-04-21T17:32:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25665.580097 secs 2024-04-21T17:32:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:35 smithi170 ceph-mon[31212]: pgmap v13779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:35 smithi077 ceph-mon[27902]: pgmap v13779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:35 smithi191 ceph-mon[31636]: pgmap v13779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:37 smithi170 ceph-mon[31212]: pgmap v13780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:37 smithi077 ceph-mon[27902]: pgmap v13780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:37 smithi191 ceph-mon[31636]: pgmap v13780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25668.820708 secs 2024-04-21T17:32:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25668.820708 secs 2024-04-21T17:32:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25668.820708 secs 2024-04-21T17:32:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:39 smithi170 ceph-mon[31212]: pgmap v13781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25670.580222 secs 2024-04-21T17:32:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:39 smithi077 ceph-mon[27902]: pgmap v13781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25670.580222 secs 2024-04-21T17:32:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:39 smithi191 ceph-mon[31636]: pgmap v13781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25670.580222 secs 2024-04-21T17:32:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:41 smithi170 ceph-mon[31212]: pgmap v13782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:41 smithi077 ceph-mon[27902]: pgmap v13782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:41 smithi191 ceph-mon[31636]: pgmap v13782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:43 smithi170 ceph-mon[31212]: pgmap v13783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25673.820812 secs 2024-04-21T17:32:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:43 smithi077 ceph-mon[27902]: pgmap v13783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25673.820812 secs 2024-04-21T17:32:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:43 smithi191 ceph-mon[31636]: pgmap v13783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:43.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25673.820812 secs 2024-04-21T17:32:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25675.580336 secs 2024-04-21T17:32:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25675.580336 secs 2024-04-21T17:32:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25675.580336 secs 2024-04-21T17:32:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:45 smithi077 ceph-mon[27902]: pgmap v13784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:45 smithi191 ceph-mon[31636]: pgmap v13784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:45 smithi170 ceph-mon[31212]: pgmap v13784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:47 smithi077 ceph-mon[27902]: pgmap v13785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:47 smithi191 ceph-mon[31636]: pgmap v13785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:47 smithi170 ceph-mon[31212]: pgmap v13785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25678.820924 secs 2024-04-21T17:32:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25678.820924 secs 2024-04-21T17:32:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25678.820924 secs 2024-04-21T17:32:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:49 smithi077 ceph-mon[27902]: pgmap v13786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25680.580432 secs 2024-04-21T17:32:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:49 smithi191 ceph-mon[31636]: pgmap v13786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25680.580432 secs 2024-04-21T17:32:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:49 smithi170 ceph-mon[31212]: pgmap v13786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25680.580432 secs 2024-04-21T17:32:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:51 smithi077 ceph-mon[27902]: pgmap v13787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:32:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:51 smithi191 ceph-mon[31636]: pgmap v13787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:32:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:51 smithi170 ceph-mon[31212]: pgmap v13787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:32:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: pgmap v13788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25683.821016 secs 2024-04-21T17:32:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:32:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:32:52.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: pgmap v13788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25683.821016 secs 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:32:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: pgmap v13788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25683.821016 secs 2024-04-21T17:32:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:32:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:32:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:32:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:54 smithi191 ceph-mon[31636]: pgmap v13789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25685.580567 secs 2024-04-21T17:32:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:54 smithi170 ceph-mon[31212]: pgmap v13789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25685.580567 secs 2024-04-21T17:32:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:32:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:54 smithi077 ceph-mon[27902]: pgmap v13789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25685.580567 secs 2024-04-21T17:32:56.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:56 smithi191 ceph-mon[31636]: pgmap v13790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:56 smithi170 ceph-mon[31212]: pgmap v13790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:56 smithi077 ceph-mon[27902]: pgmap v13790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:32:57.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25688.821135 secs 2024-04-21T17:32:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25688.821135 secs 2024-04-21T17:32:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25688.821135 secs 2024-04-21T17:32:58.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:58 smithi170 ceph-mon[31212]: pgmap v13791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:58 smithi191 ceph-mon[31636]: pgmap v13791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:58 smithi077 ceph-mon[27902]: pgmap v13791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:32:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25690.580682 secs 2024-04-21T17:33:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25690.580682 secs 2024-04-21T17:33:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25690.580682 secs 2024-04-21T17:33:00.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:00 smithi191 ceph-mon[31636]: pgmap v13792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:00 smithi170 ceph-mon[31212]: pgmap v13792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:00 smithi077 ceph-mon[27902]: pgmap v13792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:02 smithi191 ceph-mon[31636]: pgmap v13793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:02.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25693.821249 secs 2024-04-21T17:33:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:02 smithi170 ceph-mon[31212]: pgmap v13793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25693.821249 secs 2024-04-21T17:33:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:02 smithi077 ceph-mon[27902]: pgmap v13793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25693.821249 secs 2024-04-21T17:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:04 smithi191 ceph-mon[31636]: pgmap v13794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25695.580814 secs 2024-04-21T17:33:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:04 smithi170 ceph-mon[31212]: pgmap v13794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25695.580814 secs 2024-04-21T17:33:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:04 smithi077 ceph-mon[27902]: pgmap v13794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25695.580814 secs 2024-04-21T17:33:05.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:05 smithi191 ceph-mon[31636]: osdmap e934: 12 total, 12 up, 12 in 2024-04-21T17:33:06.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:05 smithi170 ceph-mon[31212]: osdmap e934: 12 total, 12 up, 12 in 2024-04-21T17:33:06.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:05 smithi077 ceph-mon[27902]: osdmap e934: 12 total, 12 up, 12 in 2024-04-21T17:33:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:06 smithi191 ceph-mon[31636]: pgmap v13796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:33:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:06 smithi170 ceph-mon[31212]: pgmap v13796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:33:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:06 smithi077 ceph-mon[27902]: pgmap v13796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25698.821366 secs 2024-04-21T17:33:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:08 smithi170 ceph-mon[31212]: osdmap e935: 12 total, 12 up, 12 in 2024-04-21T17:33:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25698.821366 secs 2024-04-21T17:33:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:08 smithi077 ceph-mon[27902]: osdmap e935: 12 total, 12 up, 12 in 2024-04-21T17:33:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25698.821366 secs 2024-04-21T17:33:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:08 smithi191 ceph-mon[31636]: osdmap e935: 12 total, 12 up, 12 in 2024-04-21T17:33:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:09 smithi170 ceph-mon[31212]: pgmap v13798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:33:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:09 smithi077 ceph-mon[27902]: pgmap v13798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:33:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:09 smithi191 ceph-mon[31636]: pgmap v13798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:33:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25700.580964 secs 2024-04-21T17:33:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25700.580964 secs 2024-04-21T17:33:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25700.580964 secs 2024-04-21T17:33:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:11 smithi170 ceph-mon[31212]: pgmap v13799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:33:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:11 smithi077 ceph-mon[27902]: pgmap v13799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:33:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:11 smithi191 ceph-mon[31636]: pgmap v13799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:33:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:13 smithi170 ceph-mon[31212]: pgmap v13800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:33:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25703.821503 secs 2024-04-21T17:33:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:13 smithi077 ceph-mon[27902]: pgmap v13800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:33:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25703.821503 secs 2024-04-21T17:33:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:13 smithi191 ceph-mon[31636]: pgmap v13800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:33:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25703.821503 secs 2024-04-21T17:33:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:15 smithi170 ceph-mon[31212]: pgmap v13801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:33:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25705.581084 secs 2024-04-21T17:33:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:15 smithi077 ceph-mon[27902]: pgmap v13801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:33:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25705.581084 secs 2024-04-21T17:33:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:15 smithi191 ceph-mon[31636]: pgmap v13801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T17:33:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25705.581084 secs 2024-04-21T17:33:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:17 smithi170 ceph-mon[31212]: pgmap v13802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:33:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:17 smithi077 ceph-mon[27902]: pgmap v13802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:33:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:17 smithi191 ceph-mon[31636]: pgmap v13802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:33:18.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25708.821621 secs 2024-04-21T17:33:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25708.821621 secs 2024-04-21T17:33:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25708.821621 secs 2024-04-21T17:33:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:19 smithi170 ceph-mon[31212]: pgmap v13803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:33:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25710.581210 secs 2024-04-21T17:33:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:19 smithi077 ceph-mon[27902]: pgmap v13803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:33:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25710.581210 secs 2024-04-21T17:33:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:19 smithi191 ceph-mon[31636]: pgmap v13803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:33:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25710.581210 secs 2024-04-21T17:33:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:21 smithi170 ceph-mon[31212]: pgmap v13804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:33:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:21 smithi077 ceph-mon[27902]: pgmap v13804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:33:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:21 smithi191 ceph-mon[31636]: pgmap v13804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:33:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:23 smithi170 ceph-mon[31212]: pgmap v13805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:33:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25713.821737 secs 2024-04-21T17:33:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:23 smithi077 ceph-mon[27902]: pgmap v13805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:33:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25713.821737 secs 2024-04-21T17:33:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:23 smithi191 ceph-mon[31636]: pgmap v13805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:33:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25713.821737 secs 2024-04-21T17:33:24.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25715.581343 secs 2024-04-21T17:33:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25715.581343 secs 2024-04-21T17:33:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25715.581343 secs 2024-04-21T17:33:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:25 smithi170 ceph-mon[31212]: pgmap v13806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:25 smithi077 ceph-mon[27902]: pgmap v13806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:25 smithi191 ceph-mon[31636]: pgmap v13806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:27 smithi170 ceph-mon[31212]: pgmap v13807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:27 smithi077 ceph-mon[27902]: pgmap v13807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:27 smithi191 ceph-mon[31636]: pgmap v13807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25718.821826 secs 2024-04-21T17:33:28.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25718.821826 secs 2024-04-21T17:33:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25718.821826 secs 2024-04-21T17:33:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:29 smithi170 ceph-mon[31212]: pgmap v13808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25720.581458 secs 2024-04-21T17:33:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:29 smithi077 ceph-mon[27902]: pgmap v13808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25720.581458 secs 2024-04-21T17:33:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:29 smithi191 ceph-mon[31636]: pgmap v13808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25720.581458 secs 2024-04-21T17:33:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:31 smithi170 ceph-mon[31212]: pgmap v13809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:31 smithi077 ceph-mon[27902]: pgmap v13809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:31 smithi191 ceph-mon[31636]: pgmap v13809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:33 smithi077 ceph-mon[27902]: pgmap v13810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25723.821904 secs 2024-04-21T17:33:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:33 smithi191 ceph-mon[31636]: pgmap v13810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25723.821904 secs 2024-04-21T17:33:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:33 smithi170 ceph-mon[31212]: pgmap v13810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25723.821904 secs 2024-04-21T17:33:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25725.581571 secs 2024-04-21T17:33:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25725.581571 secs 2024-04-21T17:33:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25725.581571 secs 2024-04-21T17:33:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:35 smithi077 ceph-mon[27902]: pgmap v13811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:35 smithi191 ceph-mon[31636]: pgmap v13811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:35 smithi170 ceph-mon[31212]: pgmap v13811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:37 smithi077 ceph-mon[27902]: pgmap v13812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:37 smithi191 ceph-mon[31636]: pgmap v13812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:37 smithi170 ceph-mon[31212]: pgmap v13812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25728.822012 secs 2024-04-21T17:33:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25728.822012 secs 2024-04-21T17:33:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25728.822012 secs 2024-04-21T17:33:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:39 smithi077 ceph-mon[27902]: pgmap v13813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25730.581691 secs 2024-04-21T17:33:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:39 smithi191 ceph-mon[31636]: pgmap v13813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25730.581691 secs 2024-04-21T17:33:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:39 smithi170 ceph-mon[31212]: pgmap v13813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25730.581691 secs 2024-04-21T17:33:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:41 smithi077 ceph-mon[27902]: pgmap v13814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:41 smithi191 ceph-mon[31636]: pgmap v13814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:41 smithi170 ceph-mon[31212]: pgmap v13814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:43 smithi077 ceph-mon[27902]: pgmap v13815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25733.822118 secs 2024-04-21T17:33:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:43 smithi191 ceph-mon[31636]: pgmap v13815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25733.822118 secs 2024-04-21T17:33:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:43 smithi170 ceph-mon[31212]: pgmap v13815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25733.822118 secs 2024-04-21T17:33:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25735.581842 secs 2024-04-21T17:33:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25735.581842 secs 2024-04-21T17:33:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25735.581842 secs 2024-04-21T17:33:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:45 smithi077 ceph-mon[27902]: pgmap v13816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:45 smithi191 ceph-mon[31636]: pgmap v13816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:45 smithi170 ceph-mon[31212]: pgmap v13816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:47 smithi077 ceph-mon[27902]: pgmap v13817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:47 smithi191 ceph-mon[31636]: pgmap v13817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:47 smithi170 ceph-mon[31212]: pgmap v13817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25738.822199 secs 2024-04-21T17:33:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25738.822199 secs 2024-04-21T17:33:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25738.822199 secs 2024-04-21T17:33:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:49 smithi077 ceph-mon[27902]: pgmap v13818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25740.581952 secs 2024-04-21T17:33:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:49 smithi191 ceph-mon[31636]: pgmap v13818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25740.581952 secs 2024-04-21T17:33:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:49 smithi170 ceph-mon[31212]: pgmap v13818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25740.581952 secs 2024-04-21T17:33:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:50 smithi077 ceph-mon[27902]: pgmap v13819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:50 smithi191 ceph-mon[31636]: pgmap v13819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:50 smithi170 ceph-mon[31212]: pgmap v13819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:52 smithi191 ceph-mon[31636]: pgmap v13820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25743.822292 secs 2024-04-21T17:33:52.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:33:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:52 smithi170 ceph-mon[31212]: pgmap v13820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25743.822292 secs 2024-04-21T17:33:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:33:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:52 smithi077 ceph-mon[27902]: pgmap v13820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25743.822292 secs 2024-04-21T17:33:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:33:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:33:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:33:53.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:33:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:33:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:33:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:33:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:33:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:33:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:33:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:33:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:54 smithi191 ceph-mon[31636]: pgmap v13821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25745.582060 secs 2024-04-21T17:33:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:54 smithi170 ceph-mon[31212]: pgmap v13821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25745.582060 secs 2024-04-21T17:33:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:54 smithi077 ceph-mon[27902]: pgmap v13821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:33:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25745.582060 secs 2024-04-21T17:33:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:56 smithi191 ceph-mon[31636]: pgmap v13822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:56 smithi170 ceph-mon[31212]: pgmap v13822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:56 smithi077 ceph-mon[27902]: pgmap v13822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:33:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25748.822418 secs 2024-04-21T17:33:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25748.822418 secs 2024-04-21T17:33:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25748.822418 secs 2024-04-21T17:33:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:58 smithi191 ceph-mon[31636]: pgmap v13823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:58 smithi170 ceph-mon[31212]: pgmap v13823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:33:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:58 smithi077 ceph-mon[27902]: pgmap v13823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:33:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25750.582171 secs 2024-04-21T17:34:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:33:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25750.582171 secs 2024-04-21T17:34:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:33:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25750.582171 secs 2024-04-21T17:34:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:00 smithi170 ceph-mon[31212]: pgmap v13824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:00 smithi077 ceph-mon[27902]: pgmap v13824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:00 smithi191 ceph-mon[31636]: pgmap v13824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:02 smithi170 ceph-mon[31212]: pgmap v13825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25753.822493 secs 2024-04-21T17:34:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:02 smithi077 ceph-mon[27902]: pgmap v13825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25753.822493 secs 2024-04-21T17:34:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:02 smithi191 ceph-mon[31636]: pgmap v13825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25753.822493 secs 2024-04-21T17:34:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:04 smithi170 ceph-mon[31212]: pgmap v13826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25755.582281 secs 2024-04-21T17:34:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:04 smithi170 ceph-mon[31212]: osdmap e936: 12 total, 12 up, 12 in 2024-04-21T17:34:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:04 smithi077 ceph-mon[27902]: pgmap v13826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25755.582281 secs 2024-04-21T17:34:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:04 smithi077 ceph-mon[27902]: osdmap e936: 12 total, 12 up, 12 in 2024-04-21T17:34:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:04 smithi191 ceph-mon[31636]: pgmap v13826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25755.582281 secs 2024-04-21T17:34:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:04 smithi191 ceph-mon[31636]: osdmap e936: 12 total, 12 up, 12 in 2024-04-21T17:34:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:06 smithi170 ceph-mon[31212]: pgmap v13828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:34:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:06 smithi077 ceph-mon[27902]: pgmap v13828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:34:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:06 smithi191 ceph-mon[31636]: pgmap v13828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:34:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25758.822630 secs 2024-04-21T17:34:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:08 smithi170 ceph-mon[31212]: osdmap e937: 12 total, 12 up, 12 in 2024-04-21T17:34:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25758.822630 secs 2024-04-21T17:34:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:08 smithi077 ceph-mon[27902]: osdmap e937: 12 total, 12 up, 12 in 2024-04-21T17:34:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25758.822630 secs 2024-04-21T17:34:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:08 smithi191 ceph-mon[31636]: osdmap e937: 12 total, 12 up, 12 in 2024-04-21T17:34:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:09 smithi170 ceph-mon[31212]: pgmap v13830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:34:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:09 smithi077 ceph-mon[27902]: pgmap v13830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:34:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:09 smithi191 ceph-mon[31636]: pgmap v13830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:34:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25760.582390 secs 2024-04-21T17:34:10.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25760.582390 secs 2024-04-21T17:34:10.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25760.582390 secs 2024-04-21T17:34:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:11 smithi170 ceph-mon[31212]: pgmap v13831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:34:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:11 smithi077 ceph-mon[27902]: pgmap v13831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:34:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:11 smithi191 ceph-mon[31636]: pgmap v13831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:34:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:13 smithi170 ceph-mon[31212]: pgmap v13832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:34:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25763.822745 secs 2024-04-21T17:34:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:13 smithi077 ceph-mon[27902]: pgmap v13832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:34:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25763.822745 secs 2024-04-21T17:34:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:13 smithi191 ceph-mon[31636]: pgmap v13832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:34:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25763.822745 secs 2024-04-21T17:34:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25765.582501 secs 2024-04-21T17:34:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25765.582501 secs 2024-04-21T17:34:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25765.582501 secs 2024-04-21T17:34:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:15 smithi077 ceph-mon[27902]: pgmap v13833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T17:34:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:15 smithi191 ceph-mon[31636]: pgmap v13833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T17:34:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:15 smithi170 ceph-mon[31212]: pgmap v13833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T17:34:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:17 smithi077 ceph-mon[27902]: pgmap v13834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:34:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:17 smithi191 ceph-mon[31636]: pgmap v13834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:34:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:17 smithi170 ceph-mon[31212]: pgmap v13834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:34:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25768.822829 secs 2024-04-21T17:34:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25768.822829 secs 2024-04-21T17:34:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25768.822829 secs 2024-04-21T17:34:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:19 smithi077 ceph-mon[27902]: pgmap v13835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:34:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25770.582641 secs 2024-04-21T17:34:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:19 smithi191 ceph-mon[31636]: pgmap v13835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:34:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25770.582641 secs 2024-04-21T17:34:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:19 smithi170 ceph-mon[31212]: pgmap v13835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:34:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25770.582641 secs 2024-04-21T17:34:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:21 smithi077 ceph-mon[27902]: pgmap v13836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:34:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:21 smithi191 ceph-mon[31636]: pgmap v13836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:34:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:21 smithi170 ceph-mon[31212]: pgmap v13836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:34:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:23 smithi077 ceph-mon[27902]: pgmap v13837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:34:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25773.822939 secs 2024-04-21T17:34:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:23 smithi191 ceph-mon[31636]: pgmap v13837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:34:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25773.822939 secs 2024-04-21T17:34:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:23 smithi170 ceph-mon[31212]: pgmap v13837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:34:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25773.822939 secs 2024-04-21T17:34:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25775.582782 secs 2024-04-21T17:34:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25775.582782 secs 2024-04-21T17:34:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25775.582782 secs 2024-04-21T17:34:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:25 smithi077 ceph-mon[27902]: pgmap v13838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:25 smithi191 ceph-mon[31636]: pgmap v13838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:25 smithi170 ceph-mon[31212]: pgmap v13838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:26 smithi191 ceph-mon[31636]: pgmap v13839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:26 smithi170 ceph-mon[31212]: pgmap v13839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:26 smithi077 ceph-mon[27902]: pgmap v13839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25778.823054 secs 2024-04-21T17:34:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25778.823054 secs 2024-04-21T17:34:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25778.823054 secs 2024-04-21T17:34:28.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:28 smithi191 ceph-mon[31636]: pgmap v13840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:28 smithi077 ceph-mon[27902]: pgmap v13840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:28.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:28 smithi170 ceph-mon[31212]: pgmap v13840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25780.582925 secs 2024-04-21T17:34:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25780.582925 secs 2024-04-21T17:34:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25780.582925 secs 2024-04-21T17:34:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:30 smithi077 ceph-mon[27902]: pgmap v13841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:30 smithi191 ceph-mon[31636]: pgmap v13841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:30 smithi170 ceph-mon[31212]: pgmap v13841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:32 smithi191 ceph-mon[31636]: pgmap v13842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25783.823168 secs 2024-04-21T17:34:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:32 smithi170 ceph-mon[31212]: pgmap v13842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25783.823168 secs 2024-04-21T17:34:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:32 smithi077 ceph-mon[27902]: pgmap v13842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25783.823168 secs 2024-04-21T17:34:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:34 smithi191 ceph-mon[31636]: pgmap v13843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:34.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25785.583053 secs 2024-04-21T17:34:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:34 smithi170 ceph-mon[31212]: pgmap v13843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25785.583053 secs 2024-04-21T17:34:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:34 smithi077 ceph-mon[27902]: pgmap v13843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25785.583053 secs 2024-04-21T17:34:36.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:36 smithi191 ceph-mon[31636]: pgmap v13844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:37.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:36 smithi170 ceph-mon[31212]: pgmap v13844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:36 smithi077 ceph-mon[27902]: pgmap v13844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:37.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25788.823285 secs 2024-04-21T17:34:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25788.823285 secs 2024-04-21T17:34:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25788.823285 secs 2024-04-21T17:34:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:38 smithi191 ceph-mon[31636]: pgmap v13845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:38 smithi170 ceph-mon[31212]: pgmap v13845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:38 smithi077 ceph-mon[27902]: pgmap v13845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25790.583134 secs 2024-04-21T17:34:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25790.583134 secs 2024-04-21T17:34:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25790.583134 secs 2024-04-21T17:34:40.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:40 smithi191 ceph-mon[31636]: pgmap v13846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:40 smithi170 ceph-mon[31212]: pgmap v13846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:40 smithi077 ceph-mon[27902]: pgmap v13846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:42 smithi191 ceph-mon[31636]: pgmap v13847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25793.823400 secs 2024-04-21T17:34:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:42 smithi170 ceph-mon[31212]: pgmap v13847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25793.823400 secs 2024-04-21T17:34:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:42 smithi077 ceph-mon[27902]: pgmap v13847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25793.823400 secs 2024-04-21T17:34:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:44 smithi191 ceph-mon[31636]: pgmap v13848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25795.583246 secs 2024-04-21T17:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:44 smithi170 ceph-mon[31212]: pgmap v13848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25795.583246 secs 2024-04-21T17:34:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:44 smithi077 ceph-mon[27902]: pgmap v13848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T17:34:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25795.583246 secs 2024-04-21T17:34:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:46 smithi170 ceph-mon[31212]: pgmap v13849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:46 smithi077 ceph-mon[27902]: pgmap v13849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:46 smithi191 ceph-mon[31636]: pgmap v13849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:34:48.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25798.823513 secs 2024-04-21T17:34:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25798.823513 secs 2024-04-21T17:34:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25798.823513 secs 2024-04-21T17:34:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:48 smithi170 ceph-mon[31212]: pgmap v13850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:48 smithi077 ceph-mon[27902]: pgmap v13850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:48 smithi191 ceph-mon[31636]: pgmap v13850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25800.583372 secs 2024-04-21T17:34:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25800.583372 secs 2024-04-21T17:34:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25800.583372 secs 2024-04-21T17:34:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:50 smithi170 ceph-mon[31212]: pgmap v13851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:50 smithi077 ceph-mon[27902]: pgmap v13851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:50 smithi191 ceph-mon[31636]: pgmap v13851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:52 smithi170 ceph-mon[31212]: pgmap v13852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25803.823632 secs 2024-04-21T17:34:53.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:52 smithi077 ceph-mon[27902]: pgmap v13852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25803.823632 secs 2024-04-21T17:34:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:52 smithi191 ceph-mon[31636]: pgmap v13852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25803.823632 secs 2024-04-21T17:34:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:34:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:34:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:34:54.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:34:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:34:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:34:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:34:54.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:34:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:34:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:34:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:34:54.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:34:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:54 smithi170 ceph-mon[31212]: pgmap v13853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25805.583507 secs 2024-04-21T17:34:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:34:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:54 smithi077 ceph-mon[27902]: pgmap v13853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25805.583507 secs 2024-04-21T17:34:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:54 smithi191 ceph-mon[31636]: pgmap v13853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25805.583507 secs 2024-04-21T17:34:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:56 smithi170 ceph-mon[31212]: pgmap v13854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:56 smithi077 ceph-mon[27902]: pgmap v13854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:56 smithi191 ceph-mon[31636]: pgmap v13854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:34:57.922 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:34:57.923+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:34:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:34:57.923+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:34:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:34:57.923+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:34:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:34:57.923+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:34:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25808.823751 secs 2024-04-21T17:34:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25808.823751 secs 2024-04-21T17:34:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25808.823751 secs 2024-04-21T17:34:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:34:59 smithi170 ceph-mon[31212]: pgmap v13855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:34:59 smithi077 ceph-mon[27902]: pgmap v13855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:34:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:34:59 smithi191 ceph-mon[31636]: pgmap v13855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 25995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25810.583623 secs 2024-04-21T17:35:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25810.583623 secs 2024-04-21T17:35:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25810.583623 secs 2024-04-21T17:35:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:01 smithi170 ceph-mon[31212]: pgmap v13856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:01 smithi077 ceph-mon[27902]: pgmap v13856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:01 smithi191 ceph-mon[31636]: pgmap v13856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:03 smithi170 ceph-mon[31212]: pgmap v13857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25813.823869 secs 2024-04-21T17:35:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:03 smithi077 ceph-mon[27902]: pgmap v13857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25813.823869 secs 2024-04-21T17:35:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:03 smithi191 ceph-mon[31636]: pgmap v13857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25813.823869 secs 2024-04-21T17:35:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25815.583748 secs 2024-04-21T17:35:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25815.583748 secs 2024-04-21T17:35:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25815.583748 secs 2024-04-21T17:35:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:05 smithi170 ceph-mon[31212]: pgmap v13858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:05 smithi170 ceph-mon[31212]: osdmap e938: 12 total, 12 up, 12 in 2024-04-21T17:35:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:05 smithi077 ceph-mon[27902]: pgmap v13858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:05 smithi077 ceph-mon[27902]: osdmap e938: 12 total, 12 up, 12 in 2024-04-21T17:35:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:05 smithi191 ceph-mon[31636]: pgmap v13858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:05 smithi191 ceph-mon[31636]: osdmap e938: 12 total, 12 up, 12 in 2024-04-21T17:35:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:07 smithi170 ceph-mon[31212]: pgmap v13860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:35:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:07 smithi170 ceph-mon[31212]: osdmap e939: 12 total, 12 up, 12 in 2024-04-21T17:35:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:07 smithi077 ceph-mon[27902]: pgmap v13860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:35:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:07 smithi077 ceph-mon[27902]: osdmap e939: 12 total, 12 up, 12 in 2024-04-21T17:35:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:07 smithi191 ceph-mon[31636]: pgmap v13860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:35:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:07 smithi191 ceph-mon[31636]: osdmap e939: 12 total, 12 up, 12 in 2024-04-21T17:35:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25818.823977 secs 2024-04-21T17:35:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25818.823977 secs 2024-04-21T17:35:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25818.823977 secs 2024-04-21T17:35:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:09 smithi170 ceph-mon[31212]: pgmap v13862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:35:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25820.583890 secs 2024-04-21T17:35:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:09 smithi077 ceph-mon[27902]: pgmap v13862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:35:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25820.583890 secs 2024-04-21T17:35:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:09 smithi191 ceph-mon[31636]: pgmap v13862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:35:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25820.583890 secs 2024-04-21T17:35:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:11 smithi077 ceph-mon[27902]: pgmap v13863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:35:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:11 smithi191 ceph-mon[31636]: pgmap v13863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:35:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:11 smithi170 ceph-mon[31212]: pgmap v13863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:35:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:13 smithi077 ceph-mon[27902]: pgmap v13864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:35:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25823.824114 secs 2024-04-21T17:35:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:13 smithi191 ceph-mon[31636]: pgmap v13864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:35:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25823.824114 secs 2024-04-21T17:35:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:13 smithi170 ceph-mon[31212]: pgmap v13864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:35:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25823.824114 secs 2024-04-21T17:35:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25825.584013 secs 2024-04-21T17:35:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25825.584013 secs 2024-04-21T17:35:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25825.584013 secs 2024-04-21T17:35:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:15 smithi077 ceph-mon[27902]: pgmap v13865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:35:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:15 smithi191 ceph-mon[31636]: pgmap v13865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:35:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:15 smithi170 ceph-mon[31212]: pgmap v13865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T17:35:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:17 smithi077 ceph-mon[27902]: pgmap v13866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:35:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:17 smithi191 ceph-mon[31636]: pgmap v13866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:35:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:17 smithi170 ceph-mon[31212]: pgmap v13866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:35:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25828.824243 secs 2024-04-21T17:35:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25828.824243 secs 2024-04-21T17:35:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25828.824243 secs 2024-04-21T17:35:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:19 smithi077 ceph-mon[27902]: pgmap v13867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:35:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25830.584148 secs 2024-04-21T17:35:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:19 smithi191 ceph-mon[31636]: pgmap v13867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:35:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25830.584148 secs 2024-04-21T17:35:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:19 smithi170 ceph-mon[31212]: pgmap v13867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:35:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25830.584148 secs 2024-04-21T17:35:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:21 smithi077 ceph-mon[27902]: pgmap v13868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:35:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:21 smithi191 ceph-mon[31636]: pgmap v13868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:35:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:21 smithi170 ceph-mon[31212]: pgmap v13868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:35:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:23 smithi077 ceph-mon[27902]: pgmap v13869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:35:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25833.824362 secs 2024-04-21T17:35:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:23 smithi191 ceph-mon[31636]: pgmap v13869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:35:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25833.824362 secs 2024-04-21T17:35:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:23 smithi170 ceph-mon[31212]: pgmap v13869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:35:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25833.824362 secs 2024-04-21T17:35:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25835.584231 secs 2024-04-21T17:35:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25835.584231 secs 2024-04-21T17:35:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25835.584231 secs 2024-04-21T17:35:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:25 smithi077 ceph-mon[27902]: pgmap v13870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:25 smithi191 ceph-mon[31636]: pgmap v13870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:25 smithi170 ceph-mon[31212]: pgmap v13870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:27 smithi077 ceph-mon[27902]: pgmap v13871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:27 smithi191 ceph-mon[31636]: pgmap v13871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:27 smithi170 ceph-mon[31212]: pgmap v13871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25838.824462 secs 2024-04-21T17:35:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25838.824462 secs 2024-04-21T17:35:28.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25838.824462 secs 2024-04-21T17:35:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:29 smithi077 ceph-mon[27902]: pgmap v13872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25840.584310 secs 2024-04-21T17:35:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:29 smithi191 ceph-mon[31636]: pgmap v13872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25840.584310 secs 2024-04-21T17:35:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:29 smithi170 ceph-mon[31212]: pgmap v13872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25840.584310 secs 2024-04-21T17:35:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:31 smithi077 ceph-mon[27902]: pgmap v13873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:31 smithi191 ceph-mon[31636]: pgmap v13873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:31 smithi170 ceph-mon[31212]: pgmap v13873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:33 smithi077 ceph-mon[27902]: pgmap v13874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25843.824598 secs 2024-04-21T17:35:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:33 smithi191 ceph-mon[31636]: pgmap v13874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25843.824598 secs 2024-04-21T17:35:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:33 smithi170 ceph-mon[31212]: pgmap v13874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25843.824598 secs 2024-04-21T17:35:34.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25845.584381 secs 2024-04-21T17:35:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25845.584381 secs 2024-04-21T17:35:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25845.584381 secs 2024-04-21T17:35:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:35 smithi077 ceph-mon[27902]: pgmap v13875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:35 smithi191 ceph-mon[31636]: pgmap v13875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:35 smithi170 ceph-mon[31212]: pgmap v13875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:36.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:36 smithi077 ceph-mon[27902]: pgmap v13876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:36 smithi191 ceph-mon[31636]: pgmap v13876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:36 smithi170 ceph-mon[31212]: pgmap v13876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25848.824718 secs 2024-04-21T17:35:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25848.824718 secs 2024-04-21T17:35:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25848.824718 secs 2024-04-21T17:35:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:38 smithi077 ceph-mon[27902]: pgmap v13877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:38 smithi191 ceph-mon[31636]: pgmap v13877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:38 smithi170 ceph-mon[31212]: pgmap v13877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25850.584494 secs 2024-04-21T17:35:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25850.584494 secs 2024-04-21T17:35:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25850.584494 secs 2024-04-21T17:35:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:40 smithi077 ceph-mon[27902]: pgmap v13878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:40 smithi191 ceph-mon[31636]: pgmap v13878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:40 smithi170 ceph-mon[31212]: pgmap v13878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:42 smithi191 ceph-mon[31636]: pgmap v13879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:42.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25853.824830 secs 2024-04-21T17:35:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:42 smithi170 ceph-mon[31212]: pgmap v13879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25853.824830 secs 2024-04-21T17:35:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:42 smithi077 ceph-mon[27902]: pgmap v13879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25853.824830 secs 2024-04-21T17:35:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:44 smithi191 ceph-mon[31636]: pgmap v13880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25855.584617 secs 2024-04-21T17:35:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:44 smithi170 ceph-mon[31212]: pgmap v13880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25855.584617 secs 2024-04-21T17:35:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:44 smithi077 ceph-mon[27902]: pgmap v13880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25855.584617 secs 2024-04-21T17:35:46.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:46 smithi191 ceph-mon[31636]: pgmap v13881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:46 smithi170 ceph-mon[31212]: pgmap v13881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:46 smithi077 ceph-mon[27902]: pgmap v13881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25858.824943 secs 2024-04-21T17:35:48.035 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25858.824943 secs 2024-04-21T17:35:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25858.824943 secs 2024-04-21T17:35:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:48 smithi170 ceph-mon[31212]: pgmap v13882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:48 smithi077 ceph-mon[27902]: pgmap v13882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:48 smithi191 ceph-mon[31636]: pgmap v13882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25860.584727 secs 2024-04-21T17:35:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25860.584727 secs 2024-04-21T17:35:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25860.584727 secs 2024-04-21T17:35:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:50 smithi170 ceph-mon[31212]: pgmap v13883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:50 smithi077 ceph-mon[27902]: pgmap v13883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:50 smithi191 ceph-mon[31636]: pgmap v13883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:52 smithi170 ceph-mon[31212]: pgmap v13884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25863.825062 secs 2024-04-21T17:35:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:52 smithi077 ceph-mon[27902]: pgmap v13884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25863.825062 secs 2024-04-21T17:35:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:52 smithi191 ceph-mon[31636]: pgmap v13884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25863.825062 secs 2024-04-21T17:35:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:54 smithi170 ceph-mon[31212]: pgmap v13885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25865.584865 secs 2024-04-21T17:35:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:35:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:35:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:35:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:35:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:35:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:54 smithi077 ceph-mon[27902]: pgmap v13885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25865.584865 secs 2024-04-21T17:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:54 smithi191 ceph-mon[31636]: pgmap v13885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25865.584865 secs 2024-04-21T17:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:35:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:35:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:56 smithi170 ceph-mon[31212]: pgmap v13886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:56 smithi077 ceph-mon[27902]: pgmap v13886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:56 smithi191 ceph-mon[31636]: pgmap v13886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:35:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25868.825184 secs 2024-04-21T17:35:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25868.825184 secs 2024-04-21T17:35:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25868.825184 secs 2024-04-21T17:35:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:58 smithi170 ceph-mon[31212]: pgmap v13887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:58 smithi077 ceph-mon[27902]: pgmap v13887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:35:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:58 smithi191 ceph-mon[31636]: pgmap v13887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25870.584983 secs 2024-04-21T17:36:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25870.584983 secs 2024-04-21T17:36:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25870.584983 secs 2024-04-21T17:36:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:00 smithi170 ceph-mon[31212]: pgmap v13888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:00 smithi077 ceph-mon[27902]: pgmap v13888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:00 smithi191 ceph-mon[31636]: pgmap v13888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:02 smithi170 ceph-mon[31212]: pgmap v13889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T17:36:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25873.825301 secs 2024-04-21T17:36:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:02 smithi077 ceph-mon[27902]: pgmap v13889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T17:36:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25873.825301 secs 2024-04-21T17:36:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:02 smithi191 ceph-mon[31636]: pgmap v13889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-21T17:36:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25873.825301 secs 2024-04-21T17:36:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:04 smithi170 ceph-mon[31212]: pgmap v13890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T17:36:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25875.585076 secs 2024-04-21T17:36:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:04 smithi170 ceph-mon[31212]: osdmap e940: 12 total, 12 up, 12 in 2024-04-21T17:36:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:04 smithi077 ceph-mon[27902]: pgmap v13890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T17:36:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25875.585076 secs 2024-04-21T17:36:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:04 smithi077 ceph-mon[27902]: osdmap e940: 12 total, 12 up, 12 in 2024-04-21T17:36:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:04 smithi191 ceph-mon[31636]: pgmap v13890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T17:36:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25875.585076 secs 2024-04-21T17:36:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:04 smithi191 ceph-mon[31636]: osdmap e940: 12 total, 12 up, 12 in 2024-04-21T17:36:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:06 smithi170 ceph-mon[31212]: pgmap v13892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:36:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:06 smithi077 ceph-mon[27902]: pgmap v13892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:36:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:06 smithi191 ceph-mon[31636]: pgmap v13892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:36:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25878.825428 secs 2024-04-21T17:36:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:08 smithi170 ceph-mon[31212]: osdmap e941: 12 total, 12 up, 12 in 2024-04-21T17:36:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25878.825428 secs 2024-04-21T17:36:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:08 smithi077 ceph-mon[27902]: osdmap e941: 12 total, 12 up, 12 in 2024-04-21T17:36:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25878.825428 secs 2024-04-21T17:36:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:08 smithi191 ceph-mon[31636]: osdmap e941: 12 total, 12 up, 12 in 2024-04-21T17:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:09 smithi170 ceph-mon[31212]: pgmap v13894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:36:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25880.585193 secs 2024-04-21T17:36:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:09 smithi077 ceph-mon[27902]: pgmap v13894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:36:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25880.585193 secs 2024-04-21T17:36:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:09 smithi191 ceph-mon[31636]: pgmap v13894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:36:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25880.585193 secs 2024-04-21T17:36:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:11 smithi170 ceph-mon[31212]: pgmap v13895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-04-21T17:36:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:11 smithi077 ceph-mon[27902]: pgmap v13895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-04-21T17:36:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:11 smithi191 ceph-mon[31636]: pgmap v13895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-04-21T17:36:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:13 smithi077 ceph-mon[27902]: pgmap v13896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T17:36:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25883.825552 secs 2024-04-21T17:36:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:13 smithi191 ceph-mon[31636]: pgmap v13896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T17:36:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25883.825552 secs 2024-04-21T17:36:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:13 smithi170 ceph-mon[31212]: pgmap v13896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T17:36:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25883.825552 secs 2024-04-21T17:36:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25885.585291 secs 2024-04-21T17:36:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25885.585291 secs 2024-04-21T17:36:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25885.585291 secs 2024-04-21T17:36:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:15 smithi077 ceph-mon[27902]: pgmap v13897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T17:36:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:15 smithi191 ceph-mon[31636]: pgmap v13897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T17:36:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:15 smithi170 ceph-mon[31212]: pgmap v13897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-04-21T17:36:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:17 smithi077 ceph-mon[27902]: pgmap v13898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:36:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:17 smithi191 ceph-mon[31636]: pgmap v13898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:36:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:17 smithi170 ceph-mon[31212]: pgmap v13898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:36:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25888.825688 secs 2024-04-21T17:36:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25888.825688 secs 2024-04-21T17:36:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25888.825688 secs 2024-04-21T17:36:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:19 smithi077 ceph-mon[27902]: pgmap v13899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:36:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25890.585425 secs 2024-04-21T17:36:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:19 smithi191 ceph-mon[31636]: pgmap v13899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:36:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25890.585425 secs 2024-04-21T17:36:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:19 smithi170 ceph-mon[31212]: pgmap v13899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:36:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25890.585425 secs 2024-04-21T17:36:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:21 smithi077 ceph-mon[27902]: pgmap v13900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:36:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:21 smithi191 ceph-mon[31636]: pgmap v13900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:36:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:21 smithi170 ceph-mon[31212]: pgmap v13900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:36:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:23 smithi077 ceph-mon[27902]: pgmap v13901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:36:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25893.825805 secs 2024-04-21T17:36:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:23 smithi191 ceph-mon[31636]: pgmap v13901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:36:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25893.825805 secs 2024-04-21T17:36:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:23 smithi170 ceph-mon[31212]: pgmap v13901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:36:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25893.825805 secs 2024-04-21T17:36:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25895.585544 secs 2024-04-21T17:36:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25895.585544 secs 2024-04-21T17:36:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25895.585544 secs 2024-04-21T17:36:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:25 smithi077 ceph-mon[27902]: pgmap v13902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:25 smithi191 ceph-mon[31636]: pgmap v13902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:25 smithi170 ceph-mon[31212]: pgmap v13902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:27 smithi077 ceph-mon[27902]: pgmap v13903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:27 smithi191 ceph-mon[31636]: pgmap v13903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:27 smithi170 ceph-mon[31212]: pgmap v13903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25898.825924 secs 2024-04-21T17:36:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25898.825924 secs 2024-04-21T17:36:28.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25898.825924 secs 2024-04-21T17:36:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:29 smithi077 ceph-mon[27902]: pgmap v13904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25900.585670 secs 2024-04-21T17:36:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:29 smithi191 ceph-mon[31636]: pgmap v13904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25900.585670 secs 2024-04-21T17:36:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:29 smithi170 ceph-mon[31212]: pgmap v13904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25900.585670 secs 2024-04-21T17:36:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:31 smithi077 ceph-mon[27902]: pgmap v13905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:31 smithi191 ceph-mon[31636]: pgmap v13905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:31 smithi170 ceph-mon[31212]: pgmap v13905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:33 smithi077 ceph-mon[27902]: pgmap v13906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25903.826046 secs 2024-04-21T17:36:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:33 smithi191 ceph-mon[31636]: pgmap v13906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25903.826046 secs 2024-04-21T17:36:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:33 smithi170 ceph-mon[31212]: pgmap v13906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25903.826046 secs 2024-04-21T17:36:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25905.585802 secs 2024-04-21T17:36:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25905.585802 secs 2024-04-21T17:36:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25905.585802 secs 2024-04-21T17:36:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:35 smithi077 ceph-mon[27902]: pgmap v13907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:35 smithi191 ceph-mon[31636]: pgmap v13907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:35 smithi170 ceph-mon[31212]: pgmap v13907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:37 smithi077 ceph-mon[27902]: pgmap v13908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:37 smithi191 ceph-mon[31636]: pgmap v13908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:37 smithi170 ceph-mon[31212]: pgmap v13908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25908.826148 secs 2024-04-21T17:36:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25908.826148 secs 2024-04-21T17:36:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25908.826148 secs 2024-04-21T17:36:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:39 smithi077 ceph-mon[27902]: pgmap v13909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25910.585923 secs 2024-04-21T17:36:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:39 smithi191 ceph-mon[31636]: pgmap v13909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25910.585923 secs 2024-04-21T17:36:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:39 smithi170 ceph-mon[31212]: pgmap v13909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25910.585923 secs 2024-04-21T17:36:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:41 smithi077 ceph-mon[27902]: pgmap v13910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:41 smithi191 ceph-mon[31636]: pgmap v13910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:41 smithi170 ceph-mon[31212]: pgmap v13910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:42.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:42 smithi077 ceph-mon[27902]: pgmap v13911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:42.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:42 smithi191 ceph-mon[31636]: pgmap v13911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:42 smithi170 ceph-mon[31212]: pgmap v13911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25913.826289 secs 2024-04-21T17:36:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25913.826289 secs 2024-04-21T17:36:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25913.826289 secs 2024-04-21T17:36:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:44 smithi191 ceph-mon[31636]: pgmap v13912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25915.586050 secs 2024-04-21T17:36:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:44 smithi170 ceph-mon[31212]: pgmap v13912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:44.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25915.586050 secs 2024-04-21T17:36:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:44 smithi077 ceph-mon[27902]: pgmap v13912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25915.586050 secs 2024-04-21T17:36:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:46 smithi170 ceph-mon[31212]: pgmap v13913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:46 smithi077 ceph-mon[27902]: pgmap v13913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:46 smithi191 ceph-mon[31636]: pgmap v13913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:48.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25918.826417 secs 2024-04-21T17:36:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25918.826417 secs 2024-04-21T17:36:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25918.826417 secs 2024-04-21T17:36:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:48 smithi170 ceph-mon[31212]: pgmap v13914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:48 smithi077 ceph-mon[27902]: pgmap v13914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:48 smithi191 ceph-mon[31636]: pgmap v13914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25920.586141 secs 2024-04-21T17:36:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25920.586141 secs 2024-04-21T17:36:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25920.586141 secs 2024-04-21T17:36:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:50 smithi170 ceph-mon[31212]: pgmap v13915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:50 smithi077 ceph-mon[27902]: pgmap v13915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:50 smithi191 ceph-mon[31636]: pgmap v13915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:52 smithi170 ceph-mon[31212]: pgmap v13916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25923.826540 secs 2024-04-21T17:36:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:52 smithi077 ceph-mon[27902]: pgmap v13916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25923.826540 secs 2024-04-21T17:36:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:52 smithi191 ceph-mon[31636]: pgmap v13916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25923.826540 secs 2024-04-21T17:36:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:54 smithi170 ceph-mon[31212]: pgmap v13917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25925.586224 secs 2024-04-21T17:36:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:36:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:36:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:54 smithi077 ceph-mon[27902]: pgmap v13917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25925.586224 secs 2024-04-21T17:36:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:36:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:54 smithi191 ceph-mon[31636]: pgmap v13917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25925.586224 secs 2024-04-21T17:36:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:36:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:36:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:36:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:36:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:36:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:36:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:36:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:36:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:36:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:36:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:56 smithi170 ceph-mon[31212]: pgmap v13918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:56 smithi077 ceph-mon[27902]: pgmap v13918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:56 smithi191 ceph-mon[31636]: pgmap v13918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:36:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25928.826683 secs 2024-04-21T17:36:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25928.826683 secs 2024-04-21T17:36:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25928.826683 secs 2024-04-21T17:36:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:58 smithi170 ceph-mon[31212]: pgmap v13919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:58 smithi077 ceph-mon[27902]: pgmap v13919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:36:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:58 smithi191 ceph-mon[31636]: pgmap v13919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:36:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25930.586284 secs 2024-04-21T17:37:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:36:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25930.586284 secs 2024-04-21T17:37:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:36:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25930.586284 secs 2024-04-21T17:37:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:00 smithi170 ceph-mon[31212]: pgmap v13920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:01.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:00 smithi077 ceph-mon[27902]: pgmap v13920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:00 smithi191 ceph-mon[31636]: pgmap v13920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:02 smithi170 ceph-mon[31212]: pgmap v13921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25933.826805 secs 2024-04-21T17:37:03.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:02 smithi077 ceph-mon[27902]: pgmap v13921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25933.826805 secs 2024-04-21T17:37:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:02 smithi191 ceph-mon[31636]: pgmap v13921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25933.826805 secs 2024-04-21T17:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:04 smithi170 ceph-mon[31212]: pgmap v13922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25935.586367 secs 2024-04-21T17:37:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:04 smithi170 ceph-mon[31212]: osdmap e942: 12 total, 12 up, 12 in 2024-04-21T17:37:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:04 smithi077 ceph-mon[27902]: pgmap v13922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25935.586367 secs 2024-04-21T17:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:04 smithi077 ceph-mon[27902]: osdmap e942: 12 total, 12 up, 12 in 2024-04-21T17:37:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:04 smithi191 ceph-mon[31636]: pgmap v13922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25935.586367 secs 2024-04-21T17:37:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:04 smithi191 ceph-mon[31636]: osdmap e942: 12 total, 12 up, 12 in 2024-04-21T17:37:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:06 smithi170 ceph-mon[31212]: pgmap v13924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:37:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:06 smithi077 ceph-mon[27902]: pgmap v13924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:37:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:06 smithi191 ceph-mon[31636]: pgmap v13924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:37:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25938.826915 secs 2024-04-21T17:37:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:08 smithi077 ceph-mon[27902]: osdmap e943: 12 total, 12 up, 12 in 2024-04-21T17:37:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25938.826915 secs 2024-04-21T17:37:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:08 smithi191 ceph-mon[31636]: osdmap e943: 12 total, 12 up, 12 in 2024-04-21T17:37:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25938.826915 secs 2024-04-21T17:37:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:08 smithi170 ceph-mon[31212]: osdmap e943: 12 total, 12 up, 12 in 2024-04-21T17:37:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:09 smithi077 ceph-mon[27902]: pgmap v13926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:37:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25940.586481 secs 2024-04-21T17:37:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:09 smithi191 ceph-mon[31636]: pgmap v13926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:37:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25940.586481 secs 2024-04-21T17:37:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:09 smithi170 ceph-mon[31212]: pgmap v13926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:37:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25940.586481 secs 2024-04-21T17:37:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:11 smithi077 ceph-mon[27902]: pgmap v13927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:37:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:11 smithi191 ceph-mon[31636]: pgmap v13927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:37:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:11 smithi170 ceph-mon[31212]: pgmap v13927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:37:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:13 smithi077 ceph-mon[27902]: pgmap v13928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:37:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25943.826997 secs 2024-04-21T17:37:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:13 smithi191 ceph-mon[31636]: pgmap v13928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:37:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25943.826997 secs 2024-04-21T17:37:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:13 smithi170 ceph-mon[31212]: pgmap v13928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:37:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25943.826997 secs 2024-04-21T17:37:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25945.586622 secs 2024-04-21T17:37:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25945.586622 secs 2024-04-21T17:37:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25945.586622 secs 2024-04-21T17:37:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:15 smithi077 ceph-mon[27902]: pgmap v13929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:37:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:15 smithi191 ceph-mon[31636]: pgmap v13929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:37:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:15 smithi170 ceph-mon[31212]: pgmap v13929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:37:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:17 smithi077 ceph-mon[27902]: pgmap v13930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:37:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:17 smithi191 ceph-mon[31636]: pgmap v13930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:37:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:17 smithi170 ceph-mon[31212]: pgmap v13930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:37:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25948.827068 secs 2024-04-21T17:37:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25948.827068 secs 2024-04-21T17:37:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25948.827068 secs 2024-04-21T17:37:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:19 smithi077 ceph-mon[27902]: pgmap v13931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:37:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25950.586744 secs 2024-04-21T17:37:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:19 smithi191 ceph-mon[31636]: pgmap v13931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:37:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25950.586744 secs 2024-04-21T17:37:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:19 smithi170 ceph-mon[31212]: pgmap v13931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:37:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25950.586744 secs 2024-04-21T17:37:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:21 smithi077 ceph-mon[27902]: pgmap v13932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:37:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:21 smithi191 ceph-mon[31636]: pgmap v13932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:37:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:21 smithi170 ceph-mon[31212]: pgmap v13932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:37:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:23 smithi077 ceph-mon[27902]: pgmap v13933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:37:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25953.827189 secs 2024-04-21T17:37:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:23 smithi191 ceph-mon[31636]: pgmap v13933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:37:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25953.827189 secs 2024-04-21T17:37:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:23 smithi170 ceph-mon[31212]: pgmap v13933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:37:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25953.827189 secs 2024-04-21T17:37:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25955.586874 secs 2024-04-21T17:37:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25955.586874 secs 2024-04-21T17:37:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25955.586874 secs 2024-04-21T17:37:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:25 smithi077 ceph-mon[27902]: pgmap v13934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:25 smithi191 ceph-mon[31636]: pgmap v13934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:25 smithi170 ceph-mon[31212]: pgmap v13934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:27 smithi077 ceph-mon[27902]: pgmap v13935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:27 smithi191 ceph-mon[31636]: pgmap v13935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:27 smithi170 ceph-mon[31212]: pgmap v13935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25958.827326 secs 2024-04-21T17:37:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25958.827326 secs 2024-04-21T17:37:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25958.827326 secs 2024-04-21T17:37:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:29 smithi077 ceph-mon[27902]: pgmap v13936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25960.587001 secs 2024-04-21T17:37:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:29 smithi191 ceph-mon[31636]: pgmap v13936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25960.587001 secs 2024-04-21T17:37:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:29 smithi170 ceph-mon[31212]: pgmap v13936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25960.587001 secs 2024-04-21T17:37:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:31 smithi077 ceph-mon[27902]: pgmap v13937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:31 smithi191 ceph-mon[31636]: pgmap v13937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:31 smithi170 ceph-mon[31212]: pgmap v13937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:33 smithi077 ceph-mon[27902]: pgmap v13938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25963.827445 secs 2024-04-21T17:37:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:33 smithi191 ceph-mon[31636]: pgmap v13938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25963.827445 secs 2024-04-21T17:37:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:33 smithi170 ceph-mon[31212]: pgmap v13938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25963.827445 secs 2024-04-21T17:37:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25965.587121 secs 2024-04-21T17:37:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25965.587121 secs 2024-04-21T17:37:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25965.587121 secs 2024-04-21T17:37:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:35 smithi077 ceph-mon[27902]: pgmap v13939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:35 smithi191 ceph-mon[31636]: pgmap v13939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:35 smithi170 ceph-mon[31212]: pgmap v13939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:37 smithi077 ceph-mon[27902]: pgmap v13940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:37 smithi191 ceph-mon[31636]: pgmap v13940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:37.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:37 smithi170 ceph-mon[31212]: pgmap v13940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25968.827566 secs 2024-04-21T17:37:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25968.827566 secs 2024-04-21T17:37:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25968.827566 secs 2024-04-21T17:37:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:39 smithi077 ceph-mon[27902]: pgmap v13941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25970.587188 secs 2024-04-21T17:37:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:39 smithi191 ceph-mon[31636]: pgmap v13941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25970.587188 secs 2024-04-21T17:37:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:39 smithi170 ceph-mon[31212]: pgmap v13941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25970.587188 secs 2024-04-21T17:37:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:41 smithi077 ceph-mon[27902]: pgmap v13942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:41 smithi191 ceph-mon[31636]: pgmap v13942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:41 smithi170 ceph-mon[31212]: pgmap v13942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:43 smithi191 ceph-mon[31636]: pgmap v13943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25973.827657 secs 2024-04-21T17:37:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:43 smithi170 ceph-mon[31212]: pgmap v13943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25973.827657 secs 2024-04-21T17:37:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:43 smithi077 ceph-mon[27902]: pgmap v13943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25973.827657 secs 2024-04-21T17:37:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25975.587249 secs 2024-04-21T17:37:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25975.587249 secs 2024-04-21T17:37:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25975.587249 secs 2024-04-21T17:37:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:45 smithi191 ceph-mon[31636]: pgmap v13944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:45 smithi170 ceph-mon[31212]: pgmap v13944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:45 smithi077 ceph-mon[27902]: pgmap v13944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:46.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:46 smithi191 ceph-mon[31636]: pgmap v13945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:46.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:46 smithi170 ceph-mon[31212]: pgmap v13945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:46.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:46 smithi077 ceph-mon[27902]: pgmap v13945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25978.827775 secs 2024-04-21T17:37:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25978.827775 secs 2024-04-21T17:37:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25978.827775 secs 2024-04-21T17:37:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:48 smithi077 ceph-mon[27902]: pgmap v13946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:48 smithi191 ceph-mon[31636]: pgmap v13946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:48 smithi170 ceph-mon[31212]: pgmap v13946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25980.587315 secs 2024-04-21T17:37:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25980.587315 secs 2024-04-21T17:37:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25980.587315 secs 2024-04-21T17:37:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:50 smithi077 ceph-mon[27902]: pgmap v13947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:50 smithi191 ceph-mon[31636]: pgmap v13947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:50 smithi170 ceph-mon[31212]: pgmap v13947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:52 smithi170 ceph-mon[31212]: pgmap v13948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25983.827880 secs 2024-04-21T17:37:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:52 smithi077 ceph-mon[27902]: pgmap v13948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25983.827880 secs 2024-04-21T17:37:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:52 smithi191 ceph-mon[31636]: pgmap v13948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25983.827880 secs 2024-04-21T17:37:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:54 smithi170 ceph-mon[31212]: pgmap v13949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25985.587414 secs 2024-04-21T17:37:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:37:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:54 smithi077 ceph-mon[27902]: pgmap v13949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25985.587414 secs 2024-04-21T17:37:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:54 smithi191 ceph-mon[31636]: pgmap v13949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25985.587414 secs 2024-04-21T17:37:56.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:37:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:37:56.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:37:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:56 smithi170 ceph-mon[31212]: pgmap v13950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:37:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:37:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:37:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:56 smithi077 ceph-mon[27902]: pgmap v13950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:37:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:37:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:37:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:56 smithi191 ceph-mon[31636]: pgmap v13950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:37:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:37:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:37:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:37:57.948 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.947+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:37:57.948 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.947+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:37:57.948 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.947+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T17:37:57.948 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.947+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:37:57.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.947+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T17:37:57.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.948+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:37:57.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.948+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:37:57.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:37:57.948+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:37:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25988.827948 secs 2024-04-21T17:37:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25988.827948 secs 2024-04-21T17:37:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25988.827948 secs 2024-04-21T17:37:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:58 smithi170 ceph-mon[31212]: pgmap v13951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:58 smithi077 ceph-mon[27902]: pgmap v13951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:37:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:58 smithi191 ceph-mon[31636]: pgmap v13951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:00.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25990.587543 secs 2024-04-21T17:38:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25990.587543 secs 2024-04-21T17:38:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25990.587543 secs 2024-04-21T17:38:01.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:00 smithi170 ceph-mon[31212]: pgmap v13952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:00 smithi077 ceph-mon[27902]: pgmap v13952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:00 smithi191 ceph-mon[31636]: pgmap v13952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:02 smithi170 ceph-mon[31212]: pgmap v13953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:03.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25993.828042 secs 2024-04-21T17:38:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:02 smithi077 ceph-mon[27902]: pgmap v13953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25993.828042 secs 2024-04-21T17:38:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:02 smithi191 ceph-mon[31636]: pgmap v13953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25993.828042 secs 2024-04-21T17:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:04 smithi170 ceph-mon[31212]: pgmap v13954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 25995.587662 secs 2024-04-21T17:38:05.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:04 smithi170 ceph-mon[31212]: osdmap e944: 12 total, 12 up, 12 in 2024-04-21T17:38:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:04 smithi077 ceph-mon[27902]: pgmap v13954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 25995.587662 secs 2024-04-21T17:38:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:04 smithi077 ceph-mon[27902]: osdmap e944: 12 total, 12 up, 12 in 2024-04-21T17:38:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:04 smithi191 ceph-mon[31636]: pgmap v13954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 25995.587662 secs 2024-04-21T17:38:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:04 smithi191 ceph-mon[31636]: osdmap e944: 12 total, 12 up, 12 in 2024-04-21T17:38:07.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:06 smithi170 ceph-mon[31212]: pgmap v13956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:38:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:06 smithi077 ceph-mon[27902]: pgmap v13956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:38:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:06 smithi191 ceph-mon[31636]: pgmap v13956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:38:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 25998.828160 secs 2024-04-21T17:38:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:08 smithi077 ceph-mon[27902]: osdmap e945: 12 total, 12 up, 12 in 2024-04-21T17:38:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 25998.828160 secs 2024-04-21T17:38:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:08 smithi191 ceph-mon[31636]: osdmap e945: 12 total, 12 up, 12 in 2024-04-21T17:38:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 25998.828160 secs 2024-04-21T17:38:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:08 smithi170 ceph-mon[31212]: osdmap e945: 12 total, 12 up, 12 in 2024-04-21T17:38:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:09 smithi077 ceph-mon[27902]: pgmap v13958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:38:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26000.587779 secs 2024-04-21T17:38:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:09 smithi191 ceph-mon[31636]: pgmap v13958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:38:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26000.587779 secs 2024-04-21T17:38:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:09 smithi170 ceph-mon[31212]: pgmap v13958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:38:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26000.587779 secs 2024-04-21T17:38:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:11 smithi077 ceph-mon[27902]: pgmap v13959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:38:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:11 smithi191 ceph-mon[31636]: pgmap v13959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:38:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:11 smithi170 ceph-mon[31212]: pgmap v13959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:38:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:13 smithi077 ceph-mon[27902]: pgmap v13960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:38:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26003.828257 secs 2024-04-21T17:38:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:13 smithi191 ceph-mon[31636]: pgmap v13960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:38:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26003.828257 secs 2024-04-21T17:38:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:13 smithi170 ceph-mon[31212]: pgmap v13960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:38:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26003.828257 secs 2024-04-21T17:38:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26005.587878 secs 2024-04-21T17:38:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26005.587878 secs 2024-04-21T17:38:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26005.587878 secs 2024-04-21T17:38:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:15 smithi077 ceph-mon[27902]: pgmap v13961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:38:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:15 smithi191 ceph-mon[31636]: pgmap v13961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:38:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:15 smithi170 ceph-mon[31212]: pgmap v13961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:38:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:17 smithi077 ceph-mon[27902]: pgmap v13962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:38:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:17 smithi191 ceph-mon[31636]: pgmap v13962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:38:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:17 smithi170 ceph-mon[31212]: pgmap v13962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:38:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26008.828375 secs 2024-04-21T17:38:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26008.828375 secs 2024-04-21T17:38:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26008.828375 secs 2024-04-21T17:38:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:19 smithi077 ceph-mon[27902]: pgmap v13963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:38:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26010.588002 secs 2024-04-21T17:38:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:19 smithi191 ceph-mon[31636]: pgmap v13963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:38:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26010.588002 secs 2024-04-21T17:38:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:19 smithi170 ceph-mon[31212]: pgmap v13963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:38:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26010.588002 secs 2024-04-21T17:38:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:21 smithi077 ceph-mon[27902]: pgmap v13964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:38:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:21 smithi191 ceph-mon[31636]: pgmap v13964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:38:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:21 smithi170 ceph-mon[31212]: pgmap v13964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:38:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:23 smithi077 ceph-mon[27902]: pgmap v13965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:38:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26013.828484 secs 2024-04-21T17:38:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:23 smithi191 ceph-mon[31636]: pgmap v13965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:38:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26013.828484 secs 2024-04-21T17:38:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:23 smithi170 ceph-mon[31212]: pgmap v13965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:38:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26013.828484 secs 2024-04-21T17:38:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26015.588085 secs 2024-04-21T17:38:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26015.588085 secs 2024-04-21T17:38:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26015.588085 secs 2024-04-21T17:38:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:25 smithi077 ceph-mon[27902]: pgmap v13966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:25 smithi191 ceph-mon[31636]: pgmap v13966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:25 smithi170 ceph-mon[31212]: pgmap v13966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:27 smithi077 ceph-mon[27902]: pgmap v13967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:27 smithi191 ceph-mon[31636]: pgmap v13967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:27 smithi170 ceph-mon[31212]: pgmap v13967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26018.828547 secs 2024-04-21T17:38:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26018.828547 secs 2024-04-21T17:38:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26018.828547 secs 2024-04-21T17:38:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:29 smithi077 ceph-mon[27902]: pgmap v13968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26020.588152 secs 2024-04-21T17:38:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:29 smithi191 ceph-mon[31636]: pgmap v13968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26020.588152 secs 2024-04-21T17:38:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:29 smithi170 ceph-mon[31212]: pgmap v13968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26020.588152 secs 2024-04-21T17:38:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:31 smithi077 ceph-mon[27902]: pgmap v13969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:31 smithi191 ceph-mon[31636]: pgmap v13969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:31 smithi170 ceph-mon[31212]: pgmap v13969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:33 smithi077 ceph-mon[27902]: pgmap v13970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26023.828647 secs 2024-04-21T17:38:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:33 smithi191 ceph-mon[31636]: pgmap v13970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26023.828647 secs 2024-04-21T17:38:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:33 smithi170 ceph-mon[31212]: pgmap v13970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26023.828647 secs 2024-04-21T17:38:34.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26025.588269 secs 2024-04-21T17:38:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26025.588269 secs 2024-04-21T17:38:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26025.588269 secs 2024-04-21T17:38:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:35 smithi077 ceph-mon[27902]: pgmap v13971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:35 smithi191 ceph-mon[31636]: pgmap v13971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:35 smithi170 ceph-mon[31212]: pgmap v13971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:37 smithi191 ceph-mon[31636]: pgmap v13972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:37 smithi170 ceph-mon[31212]: pgmap v13972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:37 smithi077 ceph-mon[27902]: pgmap v13972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26028.828777 secs 2024-04-21T17:38:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26028.828777 secs 2024-04-21T17:38:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26028.828777 secs 2024-04-21T17:38:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:39 smithi191 ceph-mon[31636]: pgmap v13973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26030.588387 secs 2024-04-21T17:38:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:39 smithi170 ceph-mon[31212]: pgmap v13973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26030.588387 secs 2024-04-21T17:38:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:39 smithi077 ceph-mon[27902]: pgmap v13973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26030.588387 secs 2024-04-21T17:38:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:40 smithi191 ceph-mon[31636]: pgmap v13974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:40 smithi170 ceph-mon[31212]: pgmap v13974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:40 smithi077 ceph-mon[27902]: pgmap v13974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:42 smithi170 ceph-mon[31212]: pgmap v13975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26033.828843 secs 2024-04-21T17:38:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:42 smithi077 ceph-mon[27902]: pgmap v13975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26033.828843 secs 2024-04-21T17:38:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:42 smithi191 ceph-mon[31636]: pgmap v13975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26033.828843 secs 2024-04-21T17:38:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:44 smithi170 ceph-mon[31212]: pgmap v13976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26035.588504 secs 2024-04-21T17:38:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:44 smithi077 ceph-mon[27902]: pgmap v13976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26035.588504 secs 2024-04-21T17:38:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:44 smithi191 ceph-mon[31636]: pgmap v13976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26035.588504 secs 2024-04-21T17:38:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:46 smithi170 ceph-mon[31212]: pgmap v13977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:46 smithi077 ceph-mon[27902]: pgmap v13977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:46 smithi191 ceph-mon[31636]: pgmap v13977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:48.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26038.828965 secs 2024-04-21T17:38:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26038.828965 secs 2024-04-21T17:38:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26038.828965 secs 2024-04-21T17:38:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:48 smithi170 ceph-mon[31212]: pgmap v13978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:48 smithi077 ceph-mon[27902]: pgmap v13978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:48 smithi191 ceph-mon[31636]: pgmap v13978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26040.588656 secs 2024-04-21T17:38:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26040.588656 secs 2024-04-21T17:38:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26040.588656 secs 2024-04-21T17:38:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:50 smithi170 ceph-mon[31212]: pgmap v13979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:50 smithi077 ceph-mon[27902]: pgmap v13979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:50 smithi191 ceph-mon[31636]: pgmap v13979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:52 smithi170 ceph-mon[31212]: pgmap v13980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26043.829075 secs 2024-04-21T17:38:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:52 smithi077 ceph-mon[27902]: pgmap v13980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26043.829075 secs 2024-04-21T17:38:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:52 smithi191 ceph-mon[31636]: pgmap v13980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26043.829075 secs 2024-04-21T17:38:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:54 smithi170 ceph-mon[31212]: pgmap v13981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26045.588763 secs 2024-04-21T17:38:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:38:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:54 smithi077 ceph-mon[27902]: pgmap v13981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26045.588763 secs 2024-04-21T17:38:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:54 smithi191 ceph-mon[31636]: pgmap v13981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26045.588763 secs 2024-04-21T17:38:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:56 smithi170 ceph-mon[31212]: pgmap v13982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:57.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:38:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:56 smithi077 ceph-mon[27902]: pgmap v13982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:38:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:56 smithi191 ceph-mon[31636]: pgmap v13982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:38:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:38:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:38:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:38:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:38:58.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26048.829167 secs 2024-04-21T17:38:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:38:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:38:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:38:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26048.829167 secs 2024-04-21T17:38:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:38:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:38:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:38:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26048.829167 secs 2024-04-21T17:38:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:58 smithi077 ceph-mon[27902]: pgmap v13983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:58 smithi191 ceph-mon[31636]: pgmap v13983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:38:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:58 smithi170 ceph-mon[31212]: pgmap v13983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26050.588881 secs 2024-04-21T17:39:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26050.588881 secs 2024-04-21T17:39:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26050.588881 secs 2024-04-21T17:39:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:00 smithi077 ceph-mon[27902]: pgmap v13984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:00 smithi191 ceph-mon[31636]: pgmap v13984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:00 smithi170 ceph-mon[31212]: pgmap v13984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:02 smithi077 ceph-mon[27902]: pgmap v13985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26053.829249 secs 2024-04-21T17:39:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:02 smithi191 ceph-mon[31636]: pgmap v13985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26053.829249 secs 2024-04-21T17:39:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:02 smithi170 ceph-mon[31212]: pgmap v13985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26053.829249 secs 2024-04-21T17:39:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:04 smithi077 ceph-mon[27902]: pgmap v13986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26055.589001 secs 2024-04-21T17:39:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:04 smithi077 ceph-mon[27902]: osdmap e946: 12 total, 12 up, 12 in 2024-04-21T17:39:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:04 smithi191 ceph-mon[31636]: pgmap v13986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26055.589001 secs 2024-04-21T17:39:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:04 smithi191 ceph-mon[31636]: osdmap e946: 12 total, 12 up, 12 in 2024-04-21T17:39:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:04 smithi170 ceph-mon[31212]: pgmap v13986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26055.589001 secs 2024-04-21T17:39:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:04 smithi170 ceph-mon[31212]: osdmap e946: 12 total, 12 up, 12 in 2024-04-21T17:39:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:06 smithi191 ceph-mon[31636]: pgmap v13988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:39:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:06 smithi170 ceph-mon[31212]: pgmap v13988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:39:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:06 smithi077 ceph-mon[27902]: pgmap v13988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:39:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26058.829346 secs 2024-04-21T17:39:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:08 smithi077 ceph-mon[27902]: osdmap e947: 12 total, 12 up, 12 in 2024-04-21T17:39:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26058.829346 secs 2024-04-21T17:39:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:08 smithi191 ceph-mon[31636]: osdmap e947: 12 total, 12 up, 12 in 2024-04-21T17:39:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26058.829346 secs 2024-04-21T17:39:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:08 smithi170 ceph-mon[31212]: osdmap e947: 12 total, 12 up, 12 in 2024-04-21T17:39:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:09 smithi077 ceph-mon[27902]: pgmap v13990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:39:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26060.589117 secs 2024-04-21T17:39:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:09 smithi191 ceph-mon[31636]: pgmap v13990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:39:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26060.589117 secs 2024-04-21T17:39:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:09 smithi170 ceph-mon[31212]: pgmap v13990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:39:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26060.589117 secs 2024-04-21T17:39:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:11 smithi077 ceph-mon[27902]: pgmap v13991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:39:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:11 smithi191 ceph-mon[31636]: pgmap v13991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:39:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:11 smithi170 ceph-mon[31212]: pgmap v13991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:39:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:13 smithi077 ceph-mon[27902]: pgmap v13992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:39:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26063.829464 secs 2024-04-21T17:39:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:13 smithi191 ceph-mon[31636]: pgmap v13992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:39:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26063.829464 secs 2024-04-21T17:39:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:13 smithi170 ceph-mon[31212]: pgmap v13992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:39:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26063.829464 secs 2024-04-21T17:39:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26065.589177 secs 2024-04-21T17:39:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26065.589177 secs 2024-04-21T17:39:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26065.589177 secs 2024-04-21T17:39:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:15 smithi077 ceph-mon[27902]: pgmap v13993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:39:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:15 smithi191 ceph-mon[31636]: pgmap v13993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:39:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:15 smithi170 ceph-mon[31212]: pgmap v13993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:39:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:17 smithi077 ceph-mon[27902]: pgmap v13994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:39:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:17 smithi191 ceph-mon[31636]: pgmap v13994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:39:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:17 smithi170 ceph-mon[31212]: pgmap v13994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:39:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26068.829584 secs 2024-04-21T17:39:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26068.829584 secs 2024-04-21T17:39:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26068.829584 secs 2024-04-21T17:39:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:19 smithi077 ceph-mon[27902]: pgmap v13995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:39:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26070.589308 secs 2024-04-21T17:39:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:19 smithi191 ceph-mon[31636]: pgmap v13995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:39:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26070.589308 secs 2024-04-21T17:39:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:19 smithi170 ceph-mon[31212]: pgmap v13995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:39:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26070.589308 secs 2024-04-21T17:39:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:21 smithi077 ceph-mon[27902]: pgmap v13996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:39:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:21 smithi191 ceph-mon[31636]: pgmap v13996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:39:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:21 smithi170 ceph-mon[31212]: pgmap v13996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:39:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:23 smithi077 ceph-mon[27902]: pgmap v13997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:39:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26073.829656 secs 2024-04-21T17:39:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:23 smithi191 ceph-mon[31636]: pgmap v13997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:39:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26073.829656 secs 2024-04-21T17:39:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:23 smithi170 ceph-mon[31212]: pgmap v13997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:39:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26073.829656 secs 2024-04-21T17:39:24.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26075.589427 secs 2024-04-21T17:39:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26075.589427 secs 2024-04-21T17:39:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26075.589427 secs 2024-04-21T17:39:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:25 smithi077 ceph-mon[27902]: pgmap v13998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:25 smithi191 ceph-mon[31636]: pgmap v13998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:25 smithi170 ceph-mon[31212]: pgmap v13998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:27 smithi077 ceph-mon[27902]: pgmap v13999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:27 smithi191 ceph-mon[31636]: pgmap v13999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:27 smithi170 ceph-mon[31212]: pgmap v13999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26078.829787 secs 2024-04-21T17:39:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26078.829787 secs 2024-04-21T17:39:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26078.829787 secs 2024-04-21T17:39:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:29 smithi077 ceph-mon[27902]: pgmap v14000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26080.589535 secs 2024-04-21T17:39:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:29 smithi191 ceph-mon[31636]: pgmap v14000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26080.589535 secs 2024-04-21T17:39:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:29 smithi170 ceph-mon[31212]: pgmap v14000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26080.589535 secs 2024-04-21T17:39:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:31 smithi191 ceph-mon[31636]: pgmap v14001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:31 smithi170 ceph-mon[31212]: pgmap v14001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:31 smithi077 ceph-mon[27902]: pgmap v14001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:33 smithi191 ceph-mon[31636]: pgmap v14002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26083.829840 secs 2024-04-21T17:39:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:33 smithi170 ceph-mon[31212]: pgmap v14002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26083.829840 secs 2024-04-21T17:39:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:33 smithi077 ceph-mon[27902]: pgmap v14002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26083.829840 secs 2024-04-21T17:39:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26085.589651 secs 2024-04-21T17:39:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26085.589651 secs 2024-04-21T17:39:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26085.589651 secs 2024-04-21T17:39:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:35 smithi191 ceph-mon[31636]: pgmap v14003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:35 smithi170 ceph-mon[31212]: pgmap v14003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:35 smithi077 ceph-mon[27902]: pgmap v14003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:37 smithi191 ceph-mon[31636]: pgmap v14004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:37 smithi170 ceph-mon[31212]: pgmap v14004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:37 smithi077 ceph-mon[27902]: pgmap v14004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26088.829914 secs 2024-04-21T17:39:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26088.829914 secs 2024-04-21T17:39:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26088.829914 secs 2024-04-21T17:39:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:39 smithi191 ceph-mon[31636]: pgmap v14005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26090.589770 secs 2024-04-21T17:39:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:39 smithi170 ceph-mon[31212]: pgmap v14005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26090.589770 secs 2024-04-21T17:39:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:39 smithi077 ceph-mon[27902]: pgmap v14005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26090.589770 secs 2024-04-21T17:39:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:40 smithi191 ceph-mon[31636]: pgmap v14006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:40 smithi170 ceph-mon[31212]: pgmap v14006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:40 smithi077 ceph-mon[27902]: pgmap v14006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:42 smithi170 ceph-mon[31212]: pgmap v14007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26093.829992 secs 2024-04-21T17:39:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:42 smithi077 ceph-mon[27902]: pgmap v14007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26093.829992 secs 2024-04-21T17:39:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:42 smithi191 ceph-mon[31636]: pgmap v14007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26093.829992 secs 2024-04-21T17:39:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26095.589880 secs 2024-04-21T17:39:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:44 smithi170 ceph-mon[31212]: pgmap v14008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26095.589880 secs 2024-04-21T17:39:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:44 smithi077 ceph-mon[27902]: pgmap v14008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26095.589880 secs 2024-04-21T17:39:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:44 smithi191 ceph-mon[31636]: pgmap v14008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:46 smithi170 ceph-mon[31212]: pgmap v14009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:47.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:46 smithi077 ceph-mon[27902]: pgmap v14009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:46 smithi191 ceph-mon[31636]: pgmap v14009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:48.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26098.830096 secs 2024-04-21T17:39:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26098.830096 secs 2024-04-21T17:39:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26098.830096 secs 2024-04-21T17:39:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:48 smithi170 ceph-mon[31212]: pgmap v14010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:48 smithi077 ceph-mon[27902]: pgmap v14010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:48 smithi191 ceph-mon[31636]: pgmap v14010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:50.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26100.589953 secs 2024-04-21T17:39:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26100.589953 secs 2024-04-21T17:39:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26100.589953 secs 2024-04-21T17:39:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:50 smithi170 ceph-mon[31212]: pgmap v14011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:50 smithi077 ceph-mon[27902]: pgmap v14011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:50 smithi191 ceph-mon[31636]: pgmap v14011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:53.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:52 smithi170 ceph-mon[31212]: pgmap v14012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26103.830178 secs 2024-04-21T17:39:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:52 smithi077 ceph-mon[27902]: pgmap v14012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26103.830178 secs 2024-04-21T17:39:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:52 smithi191 ceph-mon[31636]: pgmap v14012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26103.830178 secs 2024-04-21T17:39:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26105.590066 secs 2024-04-21T17:39:55.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:54 smithi170 ceph-mon[31212]: pgmap v14013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:39:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26105.590066 secs 2024-04-21T17:39:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:54 smithi077 ceph-mon[27902]: pgmap v14013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26105.590066 secs 2024-04-21T17:39:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:54 smithi191 ceph-mon[31636]: pgmap v14013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:56 smithi077 ceph-mon[27902]: pgmap v14014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:56 smithi191 ceph-mon[31636]: pgmap v14014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:56 smithi170 ceph-mon[31212]: pgmap v14014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:39:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26108.830315 secs 2024-04-21T17:39:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:39:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:39:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:39:58.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:39:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26108.830315 secs 2024-04-21T17:39:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:39:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:39:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:39:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:39:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26108.830315 secs 2024-04-21T17:39:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:39:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:39:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:39:58.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:39:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:58 smithi077 ceph-mon[27902]: pgmap v14015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:58 smithi191 ceph-mon[31636]: pgmap v14015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:39:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:58 smithi170 ceph-mon[31212]: pgmap v14015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26110.590202 secs 2024-04-21T17:40:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26110.590202 secs 2024-04-21T17:40:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26110.590202 secs 2024-04-21T17:40:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:00 smithi077 ceph-mon[27902]: pgmap v14016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:40:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:00 smithi191 ceph-mon[31636]: pgmap v14016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:00 smithi170 ceph-mon[31212]: pgmap v14016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:40:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:02 smithi077 ceph-mon[27902]: pgmap v14017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26113.830431 secs 2024-04-21T17:40:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:02 smithi191 ceph-mon[31636]: pgmap v14017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26113.830431 secs 2024-04-21T17:40:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:02 smithi170 ceph-mon[31212]: pgmap v14017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26113.830431 secs 2024-04-21T17:40:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26115.590319 secs 2024-04-21T17:40:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:04 smithi077 ceph-mon[27902]: pgmap v14018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:04 smithi077 ceph-mon[27902]: osdmap e948: 12 total, 12 up, 12 in 2024-04-21T17:40:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26115.590319 secs 2024-04-21T17:40:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:04 smithi191 ceph-mon[31636]: pgmap v14018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:04 smithi191 ceph-mon[31636]: osdmap e948: 12 total, 12 up, 12 in 2024-04-21T17:40:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26115.590319 secs 2024-04-21T17:40:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:04 smithi170 ceph-mon[31212]: pgmap v14018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:04 smithi170 ceph-mon[31212]: osdmap e948: 12 total, 12 up, 12 in 2024-04-21T17:40:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:06 smithi077 ceph-mon[27902]: pgmap v14020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:40:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:06 smithi191 ceph-mon[31636]: pgmap v14020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:40:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:06 smithi170 ceph-mon[31212]: pgmap v14020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26118.830540 secs 2024-04-21T17:40:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:08 smithi077 ceph-mon[27902]: osdmap e949: 12 total, 12 up, 12 in 2024-04-21T17:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26118.830540 secs 2024-04-21T17:40:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:08 smithi191 ceph-mon[31636]: osdmap e949: 12 total, 12 up, 12 in 2024-04-21T17:40:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26118.830540 secs 2024-04-21T17:40:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:08 smithi170 ceph-mon[31212]: osdmap e949: 12 total, 12 up, 12 in 2024-04-21T17:40:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:09 smithi077 ceph-mon[27902]: pgmap v14022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:40:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26120.590436 secs 2024-04-21T17:40:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:09 smithi191 ceph-mon[31636]: pgmap v14022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:40:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26120.590436 secs 2024-04-21T17:40:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:09 smithi170 ceph-mon[31212]: pgmap v14022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:40:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26120.590436 secs 2024-04-21T17:40:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:11 smithi077 ceph-mon[27902]: pgmap v14023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:40:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:11 smithi191 ceph-mon[31636]: pgmap v14023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:40:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:11 smithi170 ceph-mon[31212]: pgmap v14023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:40:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:13 smithi077 ceph-mon[27902]: pgmap v14024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:40:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26123.830654 secs 2024-04-21T17:40:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:13 smithi191 ceph-mon[31636]: pgmap v14024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:40:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26123.830654 secs 2024-04-21T17:40:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:13 smithi170 ceph-mon[31212]: pgmap v14024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:40:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26123.830654 secs 2024-04-21T17:40:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26125.590550 secs 2024-04-21T17:40:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26125.590550 secs 2024-04-21T17:40:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26125.590550 secs 2024-04-21T17:40:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:15 smithi077 ceph-mon[27902]: pgmap v14025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:40:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:15 smithi191 ceph-mon[31636]: pgmap v14025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:40:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:15 smithi170 ceph-mon[31212]: pgmap v14025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:40:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:17 smithi077 ceph-mon[27902]: pgmap v14026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:40:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:17 smithi191 ceph-mon[31636]: pgmap v14026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:40:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:17 smithi170 ceph-mon[31212]: pgmap v14026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:40:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26128.830791 secs 2024-04-21T17:40:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26128.830791 secs 2024-04-21T17:40:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26128.830791 secs 2024-04-21T17:40:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:19 smithi077 ceph-mon[27902]: pgmap v14027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:40:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26130.590686 secs 2024-04-21T17:40:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:19 smithi191 ceph-mon[31636]: pgmap v14027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:40:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26130.590686 secs 2024-04-21T17:40:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:19 smithi170 ceph-mon[31212]: pgmap v14027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:40:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26130.590686 secs 2024-04-21T17:40:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:21 smithi077 ceph-mon[27902]: pgmap v14028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:40:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:21 smithi191 ceph-mon[31636]: pgmap v14028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:40:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:21 smithi170 ceph-mon[31212]: pgmap v14028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:40:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:23 smithi077 ceph-mon[27902]: pgmap v14029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:40:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26133.830897 secs 2024-04-21T17:40:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:23 smithi191 ceph-mon[31636]: pgmap v14029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:40:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26133.830897 secs 2024-04-21T17:40:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:23 smithi170 ceph-mon[31212]: pgmap v14029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:40:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26133.830897 secs 2024-04-21T17:40:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26135.590805 secs 2024-04-21T17:40:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26135.590805 secs 2024-04-21T17:40:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26135.590805 secs 2024-04-21T17:40:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:25 smithi191 ceph-mon[31636]: pgmap v14030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:25 smithi170 ceph-mon[31212]: pgmap v14030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:25 smithi077 ceph-mon[27902]: pgmap v14030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:27 smithi191 ceph-mon[31636]: pgmap v14031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:27 smithi170 ceph-mon[31212]: pgmap v14031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:27 smithi077 ceph-mon[27902]: pgmap v14031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:28.458 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26138.831030 secs 2024-04-21T17:40:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26138.831030 secs 2024-04-21T17:40:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26138.831030 secs 2024-04-21T17:40:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:29 smithi191 ceph-mon[31636]: pgmap v14032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26140.590932 secs 2024-04-21T17:40:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:29 smithi170 ceph-mon[31212]: pgmap v14032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26140.590932 secs 2024-04-21T17:40:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:29 smithi077 ceph-mon[27902]: pgmap v14032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26140.590932 secs 2024-04-21T17:40:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:31 smithi191 ceph-mon[31636]: pgmap v14033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:31 smithi170 ceph-mon[31212]: pgmap v14033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:31 smithi077 ceph-mon[27902]: pgmap v14033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:33 smithi191 ceph-mon[31636]: pgmap v14034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26143.831140 secs 2024-04-21T17:40:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:33 smithi170 ceph-mon[31212]: pgmap v14034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26143.831140 secs 2024-04-21T17:40:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:33 smithi077 ceph-mon[27902]: pgmap v14034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26143.831140 secs 2024-04-21T17:40:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26145.591022 secs 2024-04-21T17:40:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26145.591022 secs 2024-04-21T17:40:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26145.591022 secs 2024-04-21T17:40:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:35 smithi191 ceph-mon[31636]: pgmap v14035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:35 smithi170 ceph-mon[31212]: pgmap v14035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:35 smithi077 ceph-mon[27902]: pgmap v14035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:37 smithi191 ceph-mon[31636]: pgmap v14036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:37 smithi170 ceph-mon[31212]: pgmap v14036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:37 smithi077 ceph-mon[27902]: pgmap v14036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26148.831254 secs 2024-04-21T17:40:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26148.831254 secs 2024-04-21T17:40:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26148.831254 secs 2024-04-21T17:40:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:39 smithi191 ceph-mon[31636]: pgmap v14037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26150.591129 secs 2024-04-21T17:40:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:39 smithi170 ceph-mon[31212]: pgmap v14037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26150.591129 secs 2024-04-21T17:40:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:39 smithi077 ceph-mon[27902]: pgmap v14037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26150.591129 secs 2024-04-21T17:40:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:40 smithi191 ceph-mon[31636]: pgmap v14038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:40 smithi170 ceph-mon[31212]: pgmap v14038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:40 smithi077 ceph-mon[27902]: pgmap v14038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:42 smithi170 ceph-mon[31212]: pgmap v14039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:43.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26153.831349 secs 2024-04-21T17:40:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:42 smithi077 ceph-mon[27902]: pgmap v14039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26153.831349 secs 2024-04-21T17:40:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:42 smithi191 ceph-mon[31636]: pgmap v14039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26153.831349 secs 2024-04-21T17:40:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26155.591238 secs 2024-04-21T17:40:45.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:44 smithi170 ceph-mon[31212]: pgmap v14040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26155.591238 secs 2024-04-21T17:40:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:44 smithi077 ceph-mon[27902]: pgmap v14040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26155.591238 secs 2024-04-21T17:40:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:44 smithi191 ceph-mon[31636]: pgmap v14040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:47.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:46 smithi170 ceph-mon[31212]: pgmap v14041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:46 smithi077 ceph-mon[27902]: pgmap v14041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:46 smithi191 ceph-mon[31636]: pgmap v14041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:48.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26158.831486 secs 2024-04-21T17:40:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26158.831486 secs 2024-04-21T17:40:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26158.831486 secs 2024-04-21T17:40:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:48 smithi077 ceph-mon[27902]: pgmap v14042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:48 smithi191 ceph-mon[31636]: pgmap v14042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:48 smithi170 ceph-mon[31212]: pgmap v14042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26160.591314 secs 2024-04-21T17:40:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26160.591314 secs 2024-04-21T17:40:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26160.591314 secs 2024-04-21T17:40:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:50 smithi077 ceph-mon[27902]: pgmap v14043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:50 smithi191 ceph-mon[31636]: pgmap v14043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:50 smithi170 ceph-mon[31212]: pgmap v14043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:52 smithi077 ceph-mon[27902]: pgmap v14044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26163.831620 secs 2024-04-21T17:40:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:52 smithi191 ceph-mon[31636]: pgmap v14044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26163.831620 secs 2024-04-21T17:40:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:52 smithi170 ceph-mon[31212]: pgmap v14044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26163.831620 secs 2024-04-21T17:40:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:40:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26165.591428 secs 2024-04-21T17:40:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:54 smithi077 ceph-mon[27902]: pgmap v14045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26165.591428 secs 2024-04-21T17:40:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:54 smithi191 ceph-mon[31636]: pgmap v14045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26165.591428 secs 2024-04-21T17:40:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:54 smithi170 ceph-mon[31212]: pgmap v14045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:56 smithi077 ceph-mon[27902]: pgmap v14046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:56 smithi191 ceph-mon[31636]: pgmap v14046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:56 smithi170 ceph-mon[31212]: pgmap v14046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:40:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:40:57.972+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:40:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:40:57.972+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:40:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:40:57.973+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:40:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:40:57.973+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:40:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26168.831733 secs 2024-04-21T17:40:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:40:58.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26168.831733 secs 2024-04-21T17:40:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:40:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26168.831733 secs 2024-04-21T17:40:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:40:58.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:58 smithi191 ceph-mon[31636]: pgmap v14047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:59.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:58 smithi170 ceph-mon[31212]: pgmap v14047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:40:59.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:58 smithi077 ceph-mon[27902]: pgmap v14047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26170.591542 secs 2024-04-21T17:41:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:40:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26170.591542 secs 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:40:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26170.591542 secs 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:40:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: pgmap v14048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:41:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: pgmap v14048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:41:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:41:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:41:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:41:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: pgmap v14048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:41:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:41:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:41:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:41:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:41:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:41:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:02 smithi077 ceph-mon[27902]: pgmap v14049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26173.831855 secs 2024-04-21T17:41:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:02 smithi191 ceph-mon[31636]: pgmap v14049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26173.831855 secs 2024-04-21T17:41:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:02 smithi170 ceph-mon[31212]: pgmap v14049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26173.831855 secs 2024-04-21T17:41:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:05.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26175.591680 secs 2024-04-21T17:41:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:04 smithi077 ceph-mon[27902]: pgmap v14050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:04 smithi077 ceph-mon[27902]: osdmap e950: 12 total, 12 up, 12 in 2024-04-21T17:41:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26175.591680 secs 2024-04-21T17:41:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:04 smithi191 ceph-mon[31636]: pgmap v14050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:04 smithi191 ceph-mon[31636]: osdmap e950: 12 total, 12 up, 12 in 2024-04-21T17:41:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26175.591680 secs 2024-04-21T17:41:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:04 smithi170 ceph-mon[31212]: pgmap v14050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:04 smithi170 ceph-mon[31212]: osdmap e950: 12 total, 12 up, 12 in 2024-04-21T17:41:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:06 smithi077 ceph-mon[27902]: pgmap v14052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:41:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:06 smithi191 ceph-mon[31636]: pgmap v14052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:41:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:06 smithi170 ceph-mon[31212]: pgmap v14052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:41:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26178.831980 secs 2024-04-21T17:41:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:08 smithi077 ceph-mon[27902]: osdmap e951: 12 total, 12 up, 12 in 2024-04-21T17:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26178.831980 secs 2024-04-21T17:41:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:08 smithi191 ceph-mon[31636]: osdmap e951: 12 total, 12 up, 12 in 2024-04-21T17:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26178.831980 secs 2024-04-21T17:41:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:08 smithi170 ceph-mon[31212]: osdmap e951: 12 total, 12 up, 12 in 2024-04-21T17:41:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:09 smithi077 ceph-mon[27902]: pgmap v14054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:41:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26180.591819 secs 2024-04-21T17:41:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:09 smithi191 ceph-mon[31636]: pgmap v14054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:41:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26180.591819 secs 2024-04-21T17:41:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:09 smithi170 ceph-mon[31212]: pgmap v14054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:41:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26180.591819 secs 2024-04-21T17:41:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:11 smithi077 ceph-mon[27902]: pgmap v14055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:41:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:11 smithi191 ceph-mon[31636]: pgmap v14055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:41:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:11 smithi170 ceph-mon[31212]: pgmap v14055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:41:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:13 smithi077 ceph-mon[27902]: pgmap v14056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:41:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26183.832059 secs 2024-04-21T17:41:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:13 smithi191 ceph-mon[31636]: pgmap v14056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:41:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26183.832059 secs 2024-04-21T17:41:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:13 smithi170 ceph-mon[31212]: pgmap v14056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:41:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26183.832059 secs 2024-04-21T17:41:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26185.591945 secs 2024-04-21T17:41:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26185.591945 secs 2024-04-21T17:41:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26185.591945 secs 2024-04-21T17:41:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:15 smithi077 ceph-mon[27902]: pgmap v14057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:41:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:15 smithi191 ceph-mon[31636]: pgmap v14057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:41:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:15 smithi170 ceph-mon[31212]: pgmap v14057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:41:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:17 smithi077 ceph-mon[27902]: pgmap v14058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:41:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:17 smithi191 ceph-mon[31636]: pgmap v14058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:41:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:17 smithi170 ceph-mon[31212]: pgmap v14058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:41:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26188.832135 secs 2024-04-21T17:41:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26188.832135 secs 2024-04-21T17:41:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26188.832135 secs 2024-04-21T17:41:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:19 smithi191 ceph-mon[31636]: pgmap v14059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:41:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26190.592055 secs 2024-04-21T17:41:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:19 smithi170 ceph-mon[31212]: pgmap v14059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:41:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26190.592055 secs 2024-04-21T17:41:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:19 smithi077 ceph-mon[27902]: pgmap v14059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:41:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26190.592055 secs 2024-04-21T17:41:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:21 smithi191 ceph-mon[31636]: pgmap v14060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:41:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:21 smithi170 ceph-mon[31212]: pgmap v14060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:41:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:21 smithi077 ceph-mon[27902]: pgmap v14060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:41:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:23 smithi191 ceph-mon[31636]: pgmap v14061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:41:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26193.832253 secs 2024-04-21T17:41:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:23 smithi170 ceph-mon[31212]: pgmap v14061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:41:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26193.832253 secs 2024-04-21T17:41:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:23 smithi077 ceph-mon[27902]: pgmap v14061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:41:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26193.832253 secs 2024-04-21T17:41:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26195.592117 secs 2024-04-21T17:41:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26195.592117 secs 2024-04-21T17:41:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26195.592117 secs 2024-04-21T17:41:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:25 smithi191 ceph-mon[31636]: pgmap v14062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:25 smithi170 ceph-mon[31212]: pgmap v14062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:25 smithi077 ceph-mon[27902]: pgmap v14062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:27 smithi191 ceph-mon[31636]: pgmap v14063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:27 smithi170 ceph-mon[31212]: pgmap v14063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:27 smithi077 ceph-mon[27902]: pgmap v14063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26198.832370 secs 2024-04-21T17:41:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26198.832370 secs 2024-04-21T17:41:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26198.832370 secs 2024-04-21T17:41:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:29 smithi191 ceph-mon[31636]: pgmap v14064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26200.592237 secs 2024-04-21T17:41:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:29 smithi170 ceph-mon[31212]: pgmap v14064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26200.592237 secs 2024-04-21T17:41:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:29 smithi077 ceph-mon[27902]: pgmap v14064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26200.592237 secs 2024-04-21T17:41:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:31 smithi191 ceph-mon[31636]: pgmap v14065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:31 smithi170 ceph-mon[31212]: pgmap v14065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:31 smithi077 ceph-mon[27902]: pgmap v14065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:33 smithi191 ceph-mon[31636]: pgmap v14066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26203.832509 secs 2024-04-21T17:41:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:33 smithi170 ceph-mon[31212]: pgmap v14066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26203.832509 secs 2024-04-21T17:41:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:33 smithi077 ceph-mon[27902]: pgmap v14066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26203.832509 secs 2024-04-21T17:41:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26205.592355 secs 2024-04-21T17:41:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26205.592355 secs 2024-04-21T17:41:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26205.592355 secs 2024-04-21T17:41:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:35 smithi191 ceph-mon[31636]: pgmap v14067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:35 smithi170 ceph-mon[31212]: pgmap v14067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:35 smithi077 ceph-mon[27902]: pgmap v14067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:36 smithi191 ceph-mon[31636]: pgmap v14068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:36 smithi170 ceph-mon[31212]: pgmap v14068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:36 smithi077 ceph-mon[27902]: pgmap v14068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26208.832612 secs 2024-04-21T17:41:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26208.832612 secs 2024-04-21T17:41:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26208.832612 secs 2024-04-21T17:41:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:38 smithi191 ceph-mon[31636]: pgmap v14069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:38 smithi170 ceph-mon[31212]: pgmap v14069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:38 smithi077 ceph-mon[27902]: pgmap v14069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26210.592492 secs 2024-04-21T17:41:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26210.592492 secs 2024-04-21T17:41:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26210.592492 secs 2024-04-21T17:41:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:40 smithi191 ceph-mon[31636]: pgmap v14070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:40 smithi170 ceph-mon[31212]: pgmap v14070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:40 smithi077 ceph-mon[27902]: pgmap v14070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:42 smithi077 ceph-mon[27902]: pgmap v14071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26213.832730 secs 2024-04-21T17:41:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:42 smithi191 ceph-mon[31636]: pgmap v14071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26213.832730 secs 2024-04-21T17:41:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:42 smithi170 ceph-mon[31212]: pgmap v14071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26213.832730 secs 2024-04-21T17:41:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26215.592629 secs 2024-04-21T17:41:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:44 smithi077 ceph-mon[27902]: pgmap v14072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26215.592629 secs 2024-04-21T17:41:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:44 smithi191 ceph-mon[31636]: pgmap v14072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26215.592629 secs 2024-04-21T17:41:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:44 smithi170 ceph-mon[31212]: pgmap v14072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:46 smithi077 ceph-mon[27902]: pgmap v14073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:46 smithi191 ceph-mon[31636]: pgmap v14073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:46 smithi170 ceph-mon[31212]: pgmap v14073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26218.832848 secs 2024-04-21T17:41:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26218.832848 secs 2024-04-21T17:41:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26218.832848 secs 2024-04-21T17:41:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:48 smithi077 ceph-mon[27902]: pgmap v14074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:48 smithi191 ceph-mon[31636]: pgmap v14074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:48 smithi170 ceph-mon[31212]: pgmap v14074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26220.592720 secs 2024-04-21T17:41:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26220.592720 secs 2024-04-21T17:41:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26220.592720 secs 2024-04-21T17:41:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:50 smithi077 ceph-mon[27902]: pgmap v14075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:50 smithi191 ceph-mon[31636]: pgmap v14075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:50 smithi170 ceph-mon[31212]: pgmap v14075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:52 smithi077 ceph-mon[27902]: pgmap v14076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26223.832939 secs 2024-04-21T17:41:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:52 smithi191 ceph-mon[31636]: pgmap v14076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26223.832939 secs 2024-04-21T17:41:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:52 smithi170 ceph-mon[31212]: pgmap v14076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26223.832939 secs 2024-04-21T17:41:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:41:55.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26225.592790 secs 2024-04-21T17:41:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:54 smithi077 ceph-mon[27902]: pgmap v14077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26225.592790 secs 2024-04-21T17:41:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:54 smithi191 ceph-mon[31636]: pgmap v14077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26225.592790 secs 2024-04-21T17:41:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:54 smithi170 ceph-mon[31212]: pgmap v14077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:56 smithi077 ceph-mon[27902]: pgmap v14078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:56 smithi191 ceph-mon[31636]: pgmap v14078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:56 smithi170 ceph-mon[31212]: pgmap v14078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:41:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26228.833066 secs 2024-04-21T17:41:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26228.833066 secs 2024-04-21T17:41:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26228.833066 secs 2024-04-21T17:41:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:58 smithi077 ceph-mon[27902]: pgmap v14079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:58 smithi191 ceph-mon[31636]: pgmap v14079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:41:59.223 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:58 smithi170 ceph-mon[31212]: pgmap v14079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:41:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26230.592905 secs 2024-04-21T17:42:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:41:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26230.592905 secs 2024-04-21T17:42:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:41:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26230.592905 secs 2024-04-21T17:42:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:00 smithi077 ceph-mon[27902]: pgmap v14080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:42:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:00 smithi191 ceph-mon[31636]: pgmap v14080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:42:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:00 smithi170 ceph-mon[31212]: pgmap v14080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:42:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:42:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:42:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:42:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:42:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:42:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:42:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:42:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:02 smithi077 ceph-mon[27902]: pgmap v14081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T17:42:03.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26233.833179 secs 2024-04-21T17:42:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:02 smithi191 ceph-mon[31636]: pgmap v14081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T17:42:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26233.833179 secs 2024-04-21T17:42:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:02 smithi170 ceph-mon[31212]: pgmap v14081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T17:42:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26233.833179 secs 2024-04-21T17:42:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26235.592998 secs 2024-04-21T17:42:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:04 smithi077 ceph-mon[27902]: pgmap v14082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T17:42:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:04 smithi077 ceph-mon[27902]: osdmap e952: 12 total, 12 up, 12 in 2024-04-21T17:42:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26235.592998 secs 2024-04-21T17:42:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:04 smithi191 ceph-mon[31636]: pgmap v14082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T17:42:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:04 smithi191 ceph-mon[31636]: osdmap e952: 12 total, 12 up, 12 in 2024-04-21T17:42:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26235.592998 secs 2024-04-21T17:42:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:04 smithi170 ceph-mon[31212]: pgmap v14082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T17:42:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:04 smithi170 ceph-mon[31212]: osdmap e952: 12 total, 12 up, 12 in 2024-04-21T17:42:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:06 smithi077 ceph-mon[27902]: pgmap v14084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:42:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:06 smithi191 ceph-mon[31636]: pgmap v14084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:42:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:06 smithi170 ceph-mon[31212]: pgmap v14084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:42:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26238.833294 secs 2024-04-21T17:42:08.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:08 smithi077 ceph-mon[27902]: osdmap e953: 12 total, 12 up, 12 in 2024-04-21T17:42:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26238.833294 secs 2024-04-21T17:42:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:08 smithi191 ceph-mon[31636]: osdmap e953: 12 total, 12 up, 12 in 2024-04-21T17:42:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26238.833294 secs 2024-04-21T17:42:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:08 smithi170 ceph-mon[31212]: osdmap e953: 12 total, 12 up, 12 in 2024-04-21T17:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:09 smithi077 ceph-mon[27902]: pgmap v14086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:42:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26240.593070 secs 2024-04-21T17:42:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:09 smithi191 ceph-mon[31636]: pgmap v14086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:42:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26240.593070 secs 2024-04-21T17:42:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:09 smithi170 ceph-mon[31212]: pgmap v14086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:42:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26240.593070 secs 2024-04-21T17:42:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:11 smithi077 ceph-mon[27902]: pgmap v14087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T17:42:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:11 smithi191 ceph-mon[31636]: pgmap v14087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T17:42:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:11 smithi170 ceph-mon[31212]: pgmap v14087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T17:42:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:13 smithi077 ceph-mon[27902]: pgmap v14088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 33 KiB/s wr, 26 op/s 2024-04-21T17:42:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26243.833410 secs 2024-04-21T17:42:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:13 smithi191 ceph-mon[31636]: pgmap v14088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 33 KiB/s wr, 26 op/s 2024-04-21T17:42:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26243.833410 secs 2024-04-21T17:42:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:13 smithi170 ceph-mon[31212]: pgmap v14088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 33 KiB/s wr, 26 op/s 2024-04-21T17:42:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26243.833410 secs 2024-04-21T17:42:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26245.593192 secs 2024-04-21T17:42:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26245.593192 secs 2024-04-21T17:42:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26245.593192 secs 2024-04-21T17:42:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:15 smithi191 ceph-mon[31636]: pgmap v14089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T17:42:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:15 smithi170 ceph-mon[31212]: pgmap v14089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T17:42:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:15 smithi077 ceph-mon[27902]: pgmap v14089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T17:42:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:17 smithi191 ceph-mon[31636]: pgmap v14090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:42:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:17 smithi170 ceph-mon[31212]: pgmap v14090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:42:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:17 smithi077 ceph-mon[27902]: pgmap v14090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:42:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26248.833547 secs 2024-04-21T17:42:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26248.833547 secs 2024-04-21T17:42:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26248.833547 secs 2024-04-21T17:42:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:19 smithi191 ceph-mon[31636]: pgmap v14091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:42:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26250.593309 secs 2024-04-21T17:42:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:19 smithi170 ceph-mon[31212]: pgmap v14091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:42:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26250.593309 secs 2024-04-21T17:42:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:19 smithi077 ceph-mon[27902]: pgmap v14091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:42:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26250.593309 secs 2024-04-21T17:42:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:21 smithi191 ceph-mon[31636]: pgmap v14092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:42:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:21 smithi170 ceph-mon[31212]: pgmap v14092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:42:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:21 smithi077 ceph-mon[27902]: pgmap v14092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:42:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:23 smithi191 ceph-mon[31636]: pgmap v14093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:42:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26253.833685 secs 2024-04-21T17:42:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:23 smithi170 ceph-mon[31212]: pgmap v14093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:42:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26253.833685 secs 2024-04-21T17:42:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:23 smithi077 ceph-mon[27902]: pgmap v14093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:42:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26253.833685 secs 2024-04-21T17:42:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26255.593439 secs 2024-04-21T17:42:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26255.593439 secs 2024-04-21T17:42:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26255.593439 secs 2024-04-21T17:42:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:25 smithi191 ceph-mon[31636]: pgmap v14094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:25 smithi170 ceph-mon[31212]: pgmap v14094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:25 smithi077 ceph-mon[27902]: pgmap v14094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:27 smithi191 ceph-mon[31636]: pgmap v14095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:27 smithi170 ceph-mon[31212]: pgmap v14095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:27 smithi077 ceph-mon[27902]: pgmap v14095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26258.833757 secs 2024-04-21T17:42:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26258.833757 secs 2024-04-21T17:42:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26258.833757 secs 2024-04-21T17:42:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:29 smithi191 ceph-mon[31636]: pgmap v14096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26260.593590 secs 2024-04-21T17:42:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:29 smithi170 ceph-mon[31212]: pgmap v14096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26260.593590 secs 2024-04-21T17:42:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:29 smithi077 ceph-mon[27902]: pgmap v14096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26260.593590 secs 2024-04-21T17:42:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:31 smithi191 ceph-mon[31636]: pgmap v14097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:31 smithi170 ceph-mon[31212]: pgmap v14097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:31 smithi077 ceph-mon[27902]: pgmap v14097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:33 smithi191 ceph-mon[31636]: pgmap v14098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26263.833836 secs 2024-04-21T17:42:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:33 smithi170 ceph-mon[31212]: pgmap v14098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26263.833836 secs 2024-04-21T17:42:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:33 smithi077 ceph-mon[27902]: pgmap v14098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26263.833836 secs 2024-04-21T17:42:34.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26265.593722 secs 2024-04-21T17:42:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26265.593722 secs 2024-04-21T17:42:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26265.593722 secs 2024-04-21T17:42:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:35 smithi191 ceph-mon[31636]: pgmap v14099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:35 smithi170 ceph-mon[31212]: pgmap v14099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:35 smithi077 ceph-mon[27902]: pgmap v14099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:36.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:36 smithi191 ceph-mon[31636]: pgmap v14100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:36 smithi170 ceph-mon[31212]: pgmap v14100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:36 smithi077 ceph-mon[27902]: pgmap v14100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26268.833940 secs 2024-04-21T17:42:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26268.833940 secs 2024-04-21T17:42:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26268.833940 secs 2024-04-21T17:42:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:38 smithi191 ceph-mon[31636]: pgmap v14101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:38 smithi170 ceph-mon[31212]: pgmap v14101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:38 smithi077 ceph-mon[27902]: pgmap v14101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26270.593836 secs 2024-04-21T17:42:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26270.593836 secs 2024-04-21T17:42:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26270.593836 secs 2024-04-21T17:42:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:40 smithi191 ceph-mon[31636]: pgmap v14102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:40 smithi170 ceph-mon[31212]: pgmap v14102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:40 smithi077 ceph-mon[27902]: pgmap v14102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:42 smithi077 ceph-mon[27902]: pgmap v14103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26273.834080 secs 2024-04-21T17:42:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:42 smithi191 ceph-mon[31636]: pgmap v14103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26273.834080 secs 2024-04-21T17:42:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:42 smithi170 ceph-mon[31212]: pgmap v14103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26273.834080 secs 2024-04-21T17:42:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26275.593951 secs 2024-04-21T17:42:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:44 smithi077 ceph-mon[27902]: pgmap v14104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26275.593951 secs 2024-04-21T17:42:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:44 smithi191 ceph-mon[31636]: pgmap v14104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26275.593951 secs 2024-04-21T17:42:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:44 smithi170 ceph-mon[31212]: pgmap v14104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:46 smithi077 ceph-mon[27902]: pgmap v14105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:46 smithi191 ceph-mon[31636]: pgmap v14105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:46 smithi170 ceph-mon[31212]: pgmap v14105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26278.834199 secs 2024-04-21T17:42:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26278.834199 secs 2024-04-21T17:42:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26278.834199 secs 2024-04-21T17:42:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:48 smithi077 ceph-mon[27902]: pgmap v14106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:48 smithi191 ceph-mon[31636]: pgmap v14106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:48 smithi170 ceph-mon[31212]: pgmap v14106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26280.594016 secs 2024-04-21T17:42:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26280.594016 secs 2024-04-21T17:42:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26280.594016 secs 2024-04-21T17:42:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:50 smithi077 ceph-mon[27902]: pgmap v14107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:50 smithi191 ceph-mon[31636]: pgmap v14107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:50 smithi170 ceph-mon[31212]: pgmap v14107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:52 smithi077 ceph-mon[27902]: pgmap v14108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:53.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26283.834274 secs 2024-04-21T17:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:52 smithi191 ceph-mon[31636]: pgmap v14108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26283.834274 secs 2024-04-21T17:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:52 smithi170 ceph-mon[31212]: pgmap v14108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26283.834274 secs 2024-04-21T17:42:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:42:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26285.594119 secs 2024-04-21T17:42:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:54 smithi077 ceph-mon[27902]: pgmap v14109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26285.594119 secs 2024-04-21T17:42:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:54 smithi191 ceph-mon[31636]: pgmap v14109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26285.594119 secs 2024-04-21T17:42:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:54 smithi170 ceph-mon[31212]: pgmap v14109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:57.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:56 smithi077 ceph-mon[27902]: pgmap v14110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:56 smithi191 ceph-mon[31636]: pgmap v14110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:56 smithi170 ceph-mon[31212]: pgmap v14110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:42:58.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26288.834345 secs 2024-04-21T17:42:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26288.834345 secs 2024-04-21T17:42:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26288.834345 secs 2024-04-21T17:42:59.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:58 smithi077 ceph-mon[27902]: pgmap v14111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:58 smithi191 ceph-mon[31636]: pgmap v14111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:42:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:58 smithi170 ceph-mon[31212]: pgmap v14111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:00.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:42:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26290.594213 secs 2024-04-21T17:43:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:42:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26290.594213 secs 2024-04-21T17:43:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:42:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26290.594213 secs 2024-04-21T17:43:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:00 smithi077 ceph-mon[27902]: pgmap v14112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:00 smithi191 ceph-mon[31636]: pgmap v14112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:00 smithi170 ceph-mon[31212]: pgmap v14112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:02.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:43:02.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:43:02.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: pgmap v14113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26293.834431 secs 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:43:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:43:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: pgmap v14113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T17:43:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26293.834431 secs 2024-04-21T17:43:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:43:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:43:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: pgmap v14113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T17:43:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26293.834431 secs 2024-04-21T17:43:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:43:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:43:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:43:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26295.594316 secs 2024-04-21T17:43:04.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26295.594316 secs 2024-04-21T17:43:04.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26295.594316 secs 2024-04-21T17:43:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:05 smithi077 ceph-mon[27902]: pgmap v14114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:43:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:05 smithi077 ceph-mon[27902]: osdmap e954: 12 total, 12 up, 12 in 2024-04-21T17:43:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:05 smithi191 ceph-mon[31636]: pgmap v14114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:43:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:05 smithi191 ceph-mon[31636]: osdmap e954: 12 total, 12 up, 12 in 2024-04-21T17:43:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:05 smithi170 ceph-mon[31212]: pgmap v14114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T17:43:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:05 smithi170 ceph-mon[31212]: osdmap e954: 12 total, 12 up, 12 in 2024-04-21T17:43:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:07 smithi077 ceph-mon[27902]: pgmap v14116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:43:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:07 smithi191 ceph-mon[31636]: pgmap v14116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:43:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:07 smithi170 ceph-mon[31212]: pgmap v14116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:43:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26298.834532 secs 2024-04-21T17:43:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:08 smithi191 ceph-mon[31636]: osdmap e955: 12 total, 12 up, 12 in 2024-04-21T17:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26298.834532 secs 2024-04-21T17:43:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:08 smithi170 ceph-mon[31212]: osdmap e955: 12 total, 12 up, 12 in 2024-04-21T17:43:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26298.834532 secs 2024-04-21T17:43:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:08 smithi077 ceph-mon[27902]: osdmap e955: 12 total, 12 up, 12 in 2024-04-21T17:43:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:09 smithi191 ceph-mon[31636]: pgmap v14118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:43:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26300.594405 secs 2024-04-21T17:43:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:09 smithi170 ceph-mon[31212]: pgmap v14118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:43:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26300.594405 secs 2024-04-21T17:43:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:09 smithi077 ceph-mon[27902]: pgmap v14118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:43:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26300.594405 secs 2024-04-21T17:43:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:11 smithi191 ceph-mon[31636]: pgmap v14119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:43:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:11 smithi170 ceph-mon[31212]: pgmap v14119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:43:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:11 smithi077 ceph-mon[27902]: pgmap v14119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:43:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:13 smithi191 ceph-mon[31636]: pgmap v14120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:43:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26303.834651 secs 2024-04-21T17:43:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:13 smithi170 ceph-mon[31212]: pgmap v14120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:43:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26303.834651 secs 2024-04-21T17:43:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:13 smithi077 ceph-mon[27902]: pgmap v14120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:43:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26303.834651 secs 2024-04-21T17:43:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26305.594539 secs 2024-04-21T17:43:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26305.594539 secs 2024-04-21T17:43:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26305.594539 secs 2024-04-21T17:43:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:15 smithi191 ceph-mon[31636]: pgmap v14121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T17:43:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:15 smithi170 ceph-mon[31212]: pgmap v14121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T17:43:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:15 smithi077 ceph-mon[27902]: pgmap v14121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T17:43:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:17 smithi191 ceph-mon[31636]: pgmap v14122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:43:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:17 smithi170 ceph-mon[31212]: pgmap v14122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:43:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:17 smithi077 ceph-mon[27902]: pgmap v14122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:43:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26308.834793 secs 2024-04-21T17:43:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26308.834793 secs 2024-04-21T17:43:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26308.834793 secs 2024-04-21T17:43:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:19 smithi191 ceph-mon[31636]: pgmap v14123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:43:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26310.594642 secs 2024-04-21T17:43:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:19 smithi170 ceph-mon[31212]: pgmap v14123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:43:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26310.594642 secs 2024-04-21T17:43:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:19 smithi077 ceph-mon[27902]: pgmap v14123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:43:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26310.594642 secs 2024-04-21T17:43:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:21 smithi191 ceph-mon[31636]: pgmap v14124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:43:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:21 smithi170 ceph-mon[31212]: pgmap v14124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:43:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:21 smithi077 ceph-mon[27902]: pgmap v14124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:43:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:23 smithi191 ceph-mon[31636]: pgmap v14125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:43:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26313.834859 secs 2024-04-21T17:43:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:23 smithi170 ceph-mon[31212]: pgmap v14125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:43:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26313.834859 secs 2024-04-21T17:43:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:23 smithi077 ceph-mon[27902]: pgmap v14125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:43:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26313.834859 secs 2024-04-21T17:43:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26315.594765 secs 2024-04-21T17:43:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26315.594765 secs 2024-04-21T17:43:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26315.594765 secs 2024-04-21T17:43:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:25 smithi191 ceph-mon[31636]: pgmap v14126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:25 smithi170 ceph-mon[31212]: pgmap v14126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:25 smithi077 ceph-mon[27902]: pgmap v14126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:27 smithi191 ceph-mon[31636]: pgmap v14127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:27 smithi170 ceph-mon[31212]: pgmap v14127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:27 smithi077 ceph-mon[27902]: pgmap v14127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26318.834932 secs 2024-04-21T17:43:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26318.834932 secs 2024-04-21T17:43:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26318.834932 secs 2024-04-21T17:43:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:29 smithi191 ceph-mon[31636]: pgmap v14128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26320.594922 secs 2024-04-21T17:43:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:29 smithi170 ceph-mon[31212]: pgmap v14128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26320.594922 secs 2024-04-21T17:43:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:29 smithi077 ceph-mon[27902]: pgmap v14128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26320.594922 secs 2024-04-21T17:43:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:30 smithi191 ceph-mon[31636]: pgmap v14129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:30 smithi170 ceph-mon[31212]: pgmap v14129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:30 smithi077 ceph-mon[27902]: pgmap v14129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:32 smithi077 ceph-mon[27902]: pgmap v14130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26323.835055 secs 2024-04-21T17:43:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:32 smithi191 ceph-mon[31636]: pgmap v14130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:33.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26323.835055 secs 2024-04-21T17:43:33.379 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:32 smithi170 ceph-mon[31212]: pgmap v14130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:33.379 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26323.835055 secs 2024-04-21T17:43:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26325.595037 secs 2024-04-21T17:43:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:34 smithi077 ceph-mon[27902]: pgmap v14131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26325.595037 secs 2024-04-21T17:43:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:34 smithi191 ceph-mon[31636]: pgmap v14131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26325.595037 secs 2024-04-21T17:43:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:34 smithi170 ceph-mon[31212]: pgmap v14131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:36 smithi077 ceph-mon[27902]: pgmap v14132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:36 smithi191 ceph-mon[31636]: pgmap v14132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:36 smithi170 ceph-mon[31212]: pgmap v14132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26328.835179 secs 2024-04-21T17:43:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26328.835179 secs 2024-04-21T17:43:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26328.835179 secs 2024-04-21T17:43:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:38 smithi077 ceph-mon[27902]: pgmap v14133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:38 smithi191 ceph-mon[31636]: pgmap v14133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:38 smithi170 ceph-mon[31212]: pgmap v14133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26330.595153 secs 2024-04-21T17:43:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26330.595153 secs 2024-04-21T17:43:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26330.595153 secs 2024-04-21T17:43:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:40 smithi077 ceph-mon[27902]: pgmap v14134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:40 smithi191 ceph-mon[31636]: pgmap v14134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:40 smithi170 ceph-mon[31212]: pgmap v14134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:42 smithi077 ceph-mon[27902]: pgmap v14135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:43.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26333.835284 secs 2024-04-21T17:43:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:42 smithi191 ceph-mon[31636]: pgmap v14135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26333.835284 secs 2024-04-21T17:43:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:42 smithi170 ceph-mon[31212]: pgmap v14135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26333.835284 secs 2024-04-21T17:43:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:45.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26335.595263 secs 2024-04-21T17:43:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:44 smithi077 ceph-mon[27902]: pgmap v14136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26335.595263 secs 2024-04-21T17:43:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:44 smithi191 ceph-mon[31636]: pgmap v14136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26335.595263 secs 2024-04-21T17:43:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:44 smithi170 ceph-mon[31212]: pgmap v14136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:43:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:46 smithi077 ceph-mon[27902]: pgmap v14137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:46 smithi191 ceph-mon[31636]: pgmap v14137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:46 smithi170 ceph-mon[31212]: pgmap v14137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26338.835401 secs 2024-04-21T17:43:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26338.835401 secs 2024-04-21T17:43:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26338.835401 secs 2024-04-21T17:43:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:48 smithi077 ceph-mon[27902]: pgmap v14138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:48 smithi191 ceph-mon[31636]: pgmap v14138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:48 smithi170 ceph-mon[31212]: pgmap v14138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26340.595343 secs 2024-04-21T17:43:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26340.595343 secs 2024-04-21T17:43:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26340.595343 secs 2024-04-21T17:43:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:50 smithi191 ceph-mon[31636]: pgmap v14139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:50 smithi170 ceph-mon[31212]: pgmap v14139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:50 smithi077 ceph-mon[27902]: pgmap v14139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:52 smithi191 ceph-mon[31636]: pgmap v14140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26343.835533 secs 2024-04-21T17:43:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:52 smithi170 ceph-mon[31212]: pgmap v14140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26343.835533 secs 2024-04-21T17:43:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:52 smithi077 ceph-mon[27902]: pgmap v14140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26343.835533 secs 2024-04-21T17:43:54.446 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.446+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T17:43:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.446+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T17:43:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.446+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:43:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.446+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T17:43:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.447+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:43:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.448+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T17:43:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.448+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T17:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efd700108f0 tx=0x7efd7003e070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efd700108f0 tx=0x7efd7003e070 comp rx=0 tx=0).stop 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:43:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:54.491+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd70062000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T17:43:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:43:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26345.595454 secs 2024-04-21T17:43:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:54 smithi191 ceph-mon[31636]: pgmap v14141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26345.595454 secs 2024-04-21T17:43:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:54 smithi170 ceph-mon[31212]: pgmap v14141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26345.595454 secs 2024-04-21T17:43:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:54 smithi077 ceph-mon[27902]: pgmap v14141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:56 smithi191 ceph-mon[31636]: pgmap v14142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:56 smithi170 ceph-mon[31212]: pgmap v14142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:56 smithi077 ceph-mon[27902]: pgmap v14142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:43:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:57.997+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:43:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:57.997+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:43:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:57.998+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:43:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:43:57.998+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:43:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26348.835654 secs 2024-04-21T17:43:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26348.835654 secs 2024-04-21T17:43:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26348.835654 secs 2024-04-21T17:43:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:58 smithi191 ceph-mon[31636]: pgmap v14143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:58 smithi170 ceph-mon[31212]: pgmap v14143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:43:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:58 smithi077 ceph-mon[27902]: pgmap v14143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26350.595587 secs 2024-04-21T17:44:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26350.595587 secs 2024-04-21T17:44:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26350.595587 secs 2024-04-21T17:44:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:00 smithi191 ceph-mon[31636]: pgmap v14144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:00 smithi170 ceph-mon[31212]: pgmap v14144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:00 smithi077 ceph-mon[27902]: pgmap v14144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:02 smithi191 ceph-mon[31636]: pgmap v14145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26353.835793 secs 2024-04-21T17:44:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:44:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:02 smithi170 ceph-mon[31212]: pgmap v14145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26353.835793 secs 2024-04-21T17:44:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:44:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:02 smithi077 ceph-mon[27902]: pgmap v14145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26353.835793 secs 2024-04-21T17:44:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:44:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:44:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:44:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:44:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:44:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:44:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:44:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:44:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:44:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:44:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26355.595690 secs 2024-04-21T17:44:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:04 smithi191 ceph-mon[31636]: pgmap v14146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:04 smithi191 ceph-mon[31636]: osdmap e956: 12 total, 12 up, 12 in 2024-04-21T17:44:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26355.595690 secs 2024-04-21T17:44:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:04 smithi170 ceph-mon[31212]: pgmap v14146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:04 smithi170 ceph-mon[31212]: osdmap e956: 12 total, 12 up, 12 in 2024-04-21T17:44:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26355.595690 secs 2024-04-21T17:44:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:04 smithi077 ceph-mon[27902]: pgmap v14146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:04 smithi077 ceph-mon[27902]: osdmap e956: 12 total, 12 up, 12 in 2024-04-21T17:44:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:06 smithi191 ceph-mon[31636]: pgmap v14148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:44:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:06 smithi170 ceph-mon[31212]: pgmap v14148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:44:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:06 smithi077 ceph-mon[27902]: pgmap v14148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:44:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26358.835917 secs 2024-04-21T17:44:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:08 smithi191 ceph-mon[31636]: osdmap e957: 12 total, 12 up, 12 in 2024-04-21T17:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26358.835917 secs 2024-04-21T17:44:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:08 smithi170 ceph-mon[31212]: osdmap e957: 12 total, 12 up, 12 in 2024-04-21T17:44:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26358.835917 secs 2024-04-21T17:44:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:08 smithi077 ceph-mon[27902]: osdmap e957: 12 total, 12 up, 12 in 2024-04-21T17:44:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:09 smithi191 ceph-mon[31636]: pgmap v14150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:44:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26360.595825 secs 2024-04-21T17:44:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:09 smithi170 ceph-mon[31212]: pgmap v14150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:44:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26360.595825 secs 2024-04-21T17:44:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:09 smithi077 ceph-mon[27902]: pgmap v14150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:44:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26360.595825 secs 2024-04-21T17:44:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:11 smithi191 ceph-mon[31636]: pgmap v14151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:44:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:11 smithi170 ceph-mon[31212]: pgmap v14151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:44:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:11 smithi077 ceph-mon[27902]: pgmap v14151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:44:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:13 smithi191 ceph-mon[31636]: pgmap v14152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:44:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26363.836036 secs 2024-04-21T17:44:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:13 smithi170 ceph-mon[31212]: pgmap v14152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:44:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26363.836036 secs 2024-04-21T17:44:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:13 smithi077 ceph-mon[27902]: pgmap v14152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:44:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26363.836036 secs 2024-04-21T17:44:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26365.595904 secs 2024-04-21T17:44:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26365.595904 secs 2024-04-21T17:44:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26365.595904 secs 2024-04-21T17:44:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:15 smithi191 ceph-mon[31636]: pgmap v14153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T17:44:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:15 smithi170 ceph-mon[31212]: pgmap v14153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T17:44:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:15 smithi077 ceph-mon[27902]: pgmap v14153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T17:44:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:17 smithi191 ceph-mon[31636]: pgmap v14154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:44:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:17 smithi170 ceph-mon[31212]: pgmap v14154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:44:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:17 smithi077 ceph-mon[27902]: pgmap v14154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:44:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26368.836148 secs 2024-04-21T17:44:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26368.836148 secs 2024-04-21T17:44:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26368.836148 secs 2024-04-21T17:44:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:19 smithi191 ceph-mon[31636]: pgmap v14155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:44:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26370.595969 secs 2024-04-21T17:44:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:19 smithi170 ceph-mon[31212]: pgmap v14155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:44:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26370.595969 secs 2024-04-21T17:44:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:19 smithi077 ceph-mon[27902]: pgmap v14155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:44:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26370.595969 secs 2024-04-21T17:44:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:21 smithi191 ceph-mon[31636]: pgmap v14156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:44:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:21 smithi170 ceph-mon[31212]: pgmap v14156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:44:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:21 smithi077 ceph-mon[27902]: pgmap v14156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:44:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:23 smithi191 ceph-mon[31636]: pgmap v14157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:44:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26373.836293 secs 2024-04-21T17:44:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:23 smithi170 ceph-mon[31212]: pgmap v14157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:44:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26373.836293 secs 2024-04-21T17:44:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:23 smithi077 ceph-mon[27902]: pgmap v14157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:44:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26373.836293 secs 2024-04-21T17:44:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26375.596081 secs 2024-04-21T17:44:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26375.596081 secs 2024-04-21T17:44:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26375.596081 secs 2024-04-21T17:44:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:25 smithi191 ceph-mon[31636]: pgmap v14158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:25 smithi170 ceph-mon[31212]: pgmap v14158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:25 smithi077 ceph-mon[27902]: pgmap v14158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:27 smithi191 ceph-mon[31636]: pgmap v14159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:27 smithi170 ceph-mon[31212]: pgmap v14159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:27 smithi077 ceph-mon[27902]: pgmap v14159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26378.836411 secs 2024-04-21T17:44:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26378.836411 secs 2024-04-21T17:44:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26378.836411 secs 2024-04-21T17:44:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:29 smithi191 ceph-mon[31636]: pgmap v14160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26380.596198 secs 2024-04-21T17:44:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:29 smithi170 ceph-mon[31212]: pgmap v14160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26380.596198 secs 2024-04-21T17:44:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:29 smithi077 ceph-mon[27902]: pgmap v14160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26380.596198 secs 2024-04-21T17:44:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:30 smithi170 ceph-mon[31212]: pgmap v14161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:30 smithi077 ceph-mon[27902]: pgmap v14161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:30 smithi191 ceph-mon[31636]: pgmap v14161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:32 smithi077 ceph-mon[27902]: pgmap v14162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26383.836530 secs 2024-04-21T17:44:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:32 smithi191 ceph-mon[31636]: pgmap v14162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26383.836530 secs 2024-04-21T17:44:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:32 smithi170 ceph-mon[31212]: pgmap v14162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26383.836530 secs 2024-04-21T17:44:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26385.596296 secs 2024-04-21T17:44:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:34 smithi077 ceph-mon[27902]: pgmap v14163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26385.596296 secs 2024-04-21T17:44:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:34 smithi191 ceph-mon[31636]: pgmap v14163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26385.596296 secs 2024-04-21T17:44:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:34 smithi170 ceph-mon[31212]: pgmap v14163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:36 smithi077 ceph-mon[27902]: pgmap v14164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:44:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:36 smithi191 ceph-mon[31636]: pgmap v14164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:44:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:36 smithi170 ceph-mon[31212]: pgmap v14164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T17:44:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26388.836665 secs 2024-04-21T17:44:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26388.836665 secs 2024-04-21T17:44:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26388.836665 secs 2024-04-21T17:44:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:38 smithi077 ceph-mon[27902]: pgmap v14165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:38 smithi191 ceph-mon[31636]: pgmap v14165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:38 smithi170 ceph-mon[31212]: pgmap v14165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26390.596415 secs 2024-04-21T17:44:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26390.596415 secs 2024-04-21T17:44:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26390.596415 secs 2024-04-21T17:44:41.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:40 smithi077 ceph-mon[27902]: pgmap v14166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:40 smithi191 ceph-mon[31636]: pgmap v14166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:40 smithi170 ceph-mon[31212]: pgmap v14166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:42 smithi191 ceph-mon[31636]: pgmap v14167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26393.836786 secs 2024-04-21T17:44:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:42 smithi170 ceph-mon[31212]: pgmap v14167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26393.836786 secs 2024-04-21T17:44:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:42 smithi077 ceph-mon[27902]: pgmap v14167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26393.836786 secs 2024-04-21T17:44:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26395.596533 secs 2024-04-21T17:44:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:44 smithi191 ceph-mon[31636]: pgmap v14168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26395.596533 secs 2024-04-21T17:44:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:44 smithi170 ceph-mon[31212]: pgmap v14168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26395.596533 secs 2024-04-21T17:44:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:44 smithi077 ceph-mon[27902]: pgmap v14168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T17:44:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:46 smithi191 ceph-mon[31636]: pgmap v14169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:46 smithi170 ceph-mon[31212]: pgmap v14169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:46 smithi077 ceph-mon[27902]: pgmap v14169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26398.836904 secs 2024-04-21T17:44:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26398.836904 secs 2024-04-21T17:44:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26398.836904 secs 2024-04-21T17:44:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:48 smithi191 ceph-mon[31636]: pgmap v14170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:48 smithi170 ceph-mon[31212]: pgmap v14170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:48 smithi077 ceph-mon[27902]: pgmap v14170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26400.596656 secs 2024-04-21T17:44:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26400.596656 secs 2024-04-21T17:44:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26400.596656 secs 2024-04-21T17:44:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:50 smithi191 ceph-mon[31636]: pgmap v14171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:50 smithi170 ceph-mon[31212]: pgmap v14171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:50 smithi077 ceph-mon[27902]: pgmap v14171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:52 smithi191 ceph-mon[31636]: pgmap v14172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26403.837024 secs 2024-04-21T17:44:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:52 smithi170 ceph-mon[31212]: pgmap v14172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26403.837024 secs 2024-04-21T17:44:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:52 smithi077 ceph-mon[27902]: pgmap v14172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26403.837024 secs 2024-04-21T17:44:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:44:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26405.596774 secs 2024-04-21T17:44:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:54 smithi191 ceph-mon[31636]: pgmap v14173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26405.596774 secs 2024-04-21T17:44:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:54 smithi170 ceph-mon[31212]: pgmap v14173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26405.596774 secs 2024-04-21T17:44:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:54 smithi077 ceph-mon[27902]: pgmap v14173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:56 smithi191 ceph-mon[31636]: pgmap v14174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:56 smithi170 ceph-mon[31212]: pgmap v14174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:56 smithi077 ceph-mon[27902]: pgmap v14174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:44:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26408.837101 secs 2024-04-21T17:44:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26408.837101 secs 2024-04-21T17:44:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26408.837101 secs 2024-04-21T17:44:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:58 smithi191 ceph-mon[31636]: pgmap v14175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:58 smithi170 ceph-mon[31212]: pgmap v14175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:44:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:58 smithi077 ceph-mon[27902]: pgmap v14175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26410.596899 secs 2024-04-21T17:45:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26410.596899 secs 2024-04-21T17:45:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26410.596899 secs 2024-04-21T17:45:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:00 smithi191 ceph-mon[31636]: pgmap v14176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:00 smithi170 ceph-mon[31212]: pgmap v14176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:00 smithi077 ceph-mon[27902]: pgmap v14176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:02 smithi191 ceph-mon[31636]: pgmap v14177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26413.837216 secs 2024-04-21T17:45:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:02 smithi170 ceph-mon[31212]: pgmap v14177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26413.837216 secs 2024-04-21T17:45:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:02 smithi077 ceph-mon[27902]: pgmap v14177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26413.837216 secs 2024-04-21T17:45:04.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:45:04.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:45:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:45:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26415.596971 secs 2024-04-21T17:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:04 smithi191 ceph-mon[31636]: pgmap v14178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:04 smithi191 ceph-mon[31636]: osdmap e958: 12 total, 12 up, 12 in 2024-04-21T17:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:45:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26415.596971 secs 2024-04-21T17:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:04 smithi170 ceph-mon[31212]: pgmap v14178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:04 smithi170 ceph-mon[31212]: osdmap e958: 12 total, 12 up, 12 in 2024-04-21T17:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:45:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26415.596971 secs 2024-04-21T17:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:04 smithi077 ceph-mon[27902]: pgmap v14178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:04 smithi077 ceph-mon[27902]: osdmap e958: 12 total, 12 up, 12 in 2024-04-21T17:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:45:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:45:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:06 smithi191 ceph-mon[31636]: pgmap v14180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:45:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:06 smithi170 ceph-mon[31212]: pgmap v14180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:45:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:06 smithi077 ceph-mon[27902]: pgmap v14180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:45:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26418.837298 secs 2024-04-21T17:45:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:08 smithi191 ceph-mon[31636]: osdmap e959: 12 total, 12 up, 12 in 2024-04-21T17:45:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26418.837298 secs 2024-04-21T17:45:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:08 smithi170 ceph-mon[31212]: osdmap e959: 12 total, 12 up, 12 in 2024-04-21T17:45:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26418.837298 secs 2024-04-21T17:45:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:08 smithi077 ceph-mon[27902]: osdmap e959: 12 total, 12 up, 12 in 2024-04-21T17:45:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:09 smithi191 ceph-mon[31636]: pgmap v14182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:45:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26420.597035 secs 2024-04-21T17:45:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:09 smithi170 ceph-mon[31212]: pgmap v14182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:45:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26420.597035 secs 2024-04-21T17:45:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:09 smithi077 ceph-mon[27902]: pgmap v14182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:45:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26420.597035 secs 2024-04-21T17:45:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:11 smithi191 ceph-mon[31636]: pgmap v14183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:45:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:11 smithi170 ceph-mon[31212]: pgmap v14183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:45:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:11 smithi077 ceph-mon[27902]: pgmap v14183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:45:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:13 smithi191 ceph-mon[31636]: pgmap v14184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:45:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26423.837415 secs 2024-04-21T17:45:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:13 smithi170 ceph-mon[31212]: pgmap v14184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:45:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26423.837415 secs 2024-04-21T17:45:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:13 smithi077 ceph-mon[27902]: pgmap v14184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:45:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26423.837415 secs 2024-04-21T17:45:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26425.597154 secs 2024-04-21T17:45:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26425.597154 secs 2024-04-21T17:45:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26425.597154 secs 2024-04-21T17:45:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:15 smithi191 ceph-mon[31636]: pgmap v14185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:45:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:15 smithi170 ceph-mon[31212]: pgmap v14185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:45:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:15 smithi077 ceph-mon[27902]: pgmap v14185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:45:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:17 smithi191 ceph-mon[31636]: pgmap v14186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:45:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:17 smithi170 ceph-mon[31212]: pgmap v14186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:45:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:17 smithi077 ceph-mon[27902]: pgmap v14186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:45:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26428.837536 secs 2024-04-21T17:45:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26428.837536 secs 2024-04-21T17:45:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26428.837536 secs 2024-04-21T17:45:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:19 smithi191 ceph-mon[31636]: pgmap v14187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:45:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26430.597270 secs 2024-04-21T17:45:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:19 smithi170 ceph-mon[31212]: pgmap v14187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:45:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26430.597270 secs 2024-04-21T17:45:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:19 smithi077 ceph-mon[27902]: pgmap v14187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:45:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26430.597270 secs 2024-04-21T17:45:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:21 smithi191 ceph-mon[31636]: pgmap v14188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:45:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:21 smithi170 ceph-mon[31212]: pgmap v14188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:45:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:21 smithi077 ceph-mon[27902]: pgmap v14188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:45:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:23 smithi191 ceph-mon[31636]: pgmap v14189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:45:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26433.837658 secs 2024-04-21T17:45:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:23 smithi170 ceph-mon[31212]: pgmap v14189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:45:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26433.837658 secs 2024-04-21T17:45:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:23 smithi077 ceph-mon[27902]: pgmap v14189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:45:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26433.837658 secs 2024-04-21T17:45:24.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26435.597407 secs 2024-04-21T17:45:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26435.597407 secs 2024-04-21T17:45:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26435.597407 secs 2024-04-21T17:45:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:25 smithi191 ceph-mon[31636]: pgmap v14190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:25 smithi170 ceph-mon[31212]: pgmap v14190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:25 smithi077 ceph-mon[27902]: pgmap v14190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:26 smithi170 ceph-mon[31212]: pgmap v14191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:26 smithi077 ceph-mon[27902]: pgmap v14191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:26 smithi191 ceph-mon[31636]: pgmap v14191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26438.837786 secs 2024-04-21T17:45:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26438.837786 secs 2024-04-21T17:45:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26438.837786 secs 2024-04-21T17:45:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:28 smithi170 ceph-mon[31212]: pgmap v14192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:28 smithi191 ceph-mon[31636]: pgmap v14192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:28 smithi077 ceph-mon[27902]: pgmap v14192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26440.597516 secs 2024-04-21T17:45:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26440.597516 secs 2024-04-21T17:45:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26440.597516 secs 2024-04-21T17:45:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:30 smithi191 ceph-mon[31636]: pgmap v14193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:30 smithi170 ceph-mon[31212]: pgmap v14193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:30 smithi077 ceph-mon[27902]: pgmap v14193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:32 smithi077 ceph-mon[27902]: pgmap v14194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:33.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26443.837873 secs 2024-04-21T17:45:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:32 smithi191 ceph-mon[31636]: pgmap v14194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26443.837873 secs 2024-04-21T17:45:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:32 smithi170 ceph-mon[31212]: pgmap v14194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26443.837873 secs 2024-04-21T17:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26445.597584 secs 2024-04-21T17:45:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:34 smithi077 ceph-mon[27902]: pgmap v14195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26445.597584 secs 2024-04-21T17:45:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:34 smithi191 ceph-mon[31636]: pgmap v14195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26445.597584 secs 2024-04-21T17:45:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:34 smithi170 ceph-mon[31212]: pgmap v14195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:36 smithi077 ceph-mon[27902]: pgmap v14196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:36 smithi191 ceph-mon[31636]: pgmap v14196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:36 smithi170 ceph-mon[31212]: pgmap v14196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26448.837994 secs 2024-04-21T17:45:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26448.837994 secs 2024-04-21T17:45:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26448.837994 secs 2024-04-21T17:45:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:38 smithi191 ceph-mon[31636]: pgmap v14197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:38 smithi170 ceph-mon[31212]: pgmap v14197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:38 smithi077 ceph-mon[27902]: pgmap v14197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26450.597682 secs 2024-04-21T17:45:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26450.597682 secs 2024-04-21T17:45:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26450.597682 secs 2024-04-21T17:45:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:40 smithi191 ceph-mon[31636]: pgmap v14198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:40 smithi170 ceph-mon[31212]: pgmap v14198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:40 smithi077 ceph-mon[27902]: pgmap v14198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:42 smithi191 ceph-mon[31636]: pgmap v14199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26453.838061 secs 2024-04-21T17:45:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:42 smithi170 ceph-mon[31212]: pgmap v14199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26453.838061 secs 2024-04-21T17:45:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:42 smithi077 ceph-mon[27902]: pgmap v14199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26453.838061 secs 2024-04-21T17:45:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26455.597796 secs 2024-04-21T17:45:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:44 smithi191 ceph-mon[31636]: pgmap v14200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26455.597796 secs 2024-04-21T17:45:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:44 smithi170 ceph-mon[31212]: pgmap v14200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26455.597796 secs 2024-04-21T17:45:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:44 smithi077 ceph-mon[27902]: pgmap v14200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:46 smithi191 ceph-mon[31636]: pgmap v14201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:46 smithi170 ceph-mon[31212]: pgmap v14201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:46 smithi077 ceph-mon[27902]: pgmap v14201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26458.838179 secs 2024-04-21T17:45:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26458.838179 secs 2024-04-21T17:45:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26458.838179 secs 2024-04-21T17:45:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:48 smithi191 ceph-mon[31636]: pgmap v14202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:48 smithi170 ceph-mon[31212]: pgmap v14202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:48 smithi077 ceph-mon[27902]: pgmap v14202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26460.597878 secs 2024-04-21T17:45:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26460.597878 secs 2024-04-21T17:45:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26460.597878 secs 2024-04-21T17:45:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:50 smithi191 ceph-mon[31636]: pgmap v14203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:50 smithi170 ceph-mon[31212]: pgmap v14203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:50 smithi077 ceph-mon[27902]: pgmap v14203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:52 smithi191 ceph-mon[31636]: pgmap v14204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26463.838312 secs 2024-04-21T17:45:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:52 smithi170 ceph-mon[31212]: pgmap v14204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26463.838312 secs 2024-04-21T17:45:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:52 smithi077 ceph-mon[27902]: pgmap v14204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26463.838312 secs 2024-04-21T17:45:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:45:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26465.597988 secs 2024-04-21T17:45:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:54 smithi191 ceph-mon[31636]: pgmap v14205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26465.597988 secs 2024-04-21T17:45:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:54 smithi170 ceph-mon[31212]: pgmap v14205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26465.597988 secs 2024-04-21T17:45:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:54 smithi077 ceph-mon[27902]: pgmap v14205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:56 smithi191 ceph-mon[31636]: pgmap v14206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:56 smithi170 ceph-mon[31212]: pgmap v14206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:56 smithi077 ceph-mon[27902]: pgmap v14206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:45:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26468.838423 secs 2024-04-21T17:45:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26468.838423 secs 2024-04-21T17:45:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26468.838423 secs 2024-04-21T17:45:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:58 smithi191 ceph-mon[31636]: pgmap v14207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:58 smithi170 ceph-mon[31212]: pgmap v14207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:45:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:58 smithi077 ceph-mon[27902]: pgmap v14207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26470.598104 secs 2024-04-21T17:46:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26470.598104 secs 2024-04-21T17:46:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26470.598104 secs 2024-04-21T17:46:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:00 smithi191 ceph-mon[31636]: pgmap v14208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:00 smithi170 ceph-mon[31212]: pgmap v14208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:00 smithi077 ceph-mon[27902]: pgmap v14208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:02 smithi191 ceph-mon[31636]: pgmap v14209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26473.838545 secs 2024-04-21T17:46:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:02 smithi170 ceph-mon[31212]: pgmap v14209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26473.838545 secs 2024-04-21T17:46:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:02 smithi077 ceph-mon[27902]: pgmap v14209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26473.838545 secs 2024-04-21T17:46:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26475.598221 secs 2024-04-21T17:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:04 smithi191 ceph-mon[31636]: pgmap v14210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:04 smithi191 ceph-mon[31636]: osdmap e960: 12 total, 12 up, 12 in 2024-04-21T17:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26475.598221 secs 2024-04-21T17:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:04 smithi170 ceph-mon[31212]: pgmap v14210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:04 smithi170 ceph-mon[31212]: osdmap e960: 12 total, 12 up, 12 in 2024-04-21T17:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26475.598221 secs 2024-04-21T17:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:04 smithi077 ceph-mon[27902]: pgmap v14210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:04 smithi077 ceph-mon[27902]: osdmap e960: 12 total, 12 up, 12 in 2024-04-21T17:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:46:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:46:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:46:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:46:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:46:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:46:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:46:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:46:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:46:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:46:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:07 smithi077 ceph-mon[27902]: pgmap v14212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:46:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:07 smithi191 ceph-mon[31636]: pgmap v14212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:46:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:07 smithi170 ceph-mon[31212]: pgmap v14212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:46:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26478.838660 secs 2024-04-21T17:46:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:08 smithi191 ceph-mon[31636]: osdmap e961: 12 total, 12 up, 12 in 2024-04-21T17:46:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26478.838660 secs 2024-04-21T17:46:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:08 smithi170 ceph-mon[31212]: osdmap e961: 12 total, 12 up, 12 in 2024-04-21T17:46:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26478.838660 secs 2024-04-21T17:46:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:08 smithi077 ceph-mon[27902]: osdmap e961: 12 total, 12 up, 12 in 2024-04-21T17:46:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:09 smithi191 ceph-mon[31636]: pgmap v14214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:46:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26480.598368 secs 2024-04-21T17:46:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:09 smithi170 ceph-mon[31212]: pgmap v14214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:46:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26480.598368 secs 2024-04-21T17:46:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:09 smithi077 ceph-mon[27902]: pgmap v14214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:46:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26480.598368 secs 2024-04-21T17:46:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:11 smithi191 ceph-mon[31636]: pgmap v14215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:46:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:11 smithi170 ceph-mon[31212]: pgmap v14215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:46:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:11 smithi077 ceph-mon[27902]: pgmap v14215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:46:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:13.016+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:46:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:13.016+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:46:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:13.016+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:46:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:13.016+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:46:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:13 smithi191 ceph-mon[31636]: pgmap v14216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:46:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26483.838799 secs 2024-04-21T17:46:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:13 smithi170 ceph-mon[31212]: pgmap v14216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:46:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26483.838799 secs 2024-04-21T17:46:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:13 smithi077 ceph-mon[27902]: pgmap v14216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:46:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26483.838799 secs 2024-04-21T17:46:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26485.598489 secs 2024-04-21T17:46:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26485.598489 secs 2024-04-21T17:46:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26485.598489 secs 2024-04-21T17:46:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:15 smithi191 ceph-mon[31636]: pgmap v14217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:46:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:15 smithi170 ceph-mon[31212]: pgmap v14217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:46:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:15 smithi077 ceph-mon[27902]: pgmap v14217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:46:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:17 smithi191 ceph-mon[31636]: pgmap v14218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:46:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:17 smithi170 ceph-mon[31212]: pgmap v14218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:46:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:17 smithi077 ceph-mon[27902]: pgmap v14218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:46:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26488.838922 secs 2024-04-21T17:46:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26488.838922 secs 2024-04-21T17:46:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26488.838922 secs 2024-04-21T17:46:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:19 smithi191 ceph-mon[31636]: pgmap v14219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:46:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26490.598564 secs 2024-04-21T17:46:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:19 smithi170 ceph-mon[31212]: pgmap v14219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:46:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26490.598564 secs 2024-04-21T17:46:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:19 smithi077 ceph-mon[27902]: pgmap v14219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:46:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26490.598564 secs 2024-04-21T17:46:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:21 smithi191 ceph-mon[31636]: pgmap v14220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:46:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:21 smithi170 ceph-mon[31212]: pgmap v14220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:46:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:21 smithi077 ceph-mon[27902]: pgmap v14220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:46:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:23 smithi170 ceph-mon[31212]: pgmap v14221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:46:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26493.839029 secs 2024-04-21T17:46:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:23 smithi077 ceph-mon[27902]: pgmap v14221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:46:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26493.839029 secs 2024-04-21T17:46:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:23 smithi191 ceph-mon[31636]: pgmap v14221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:46:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26493.839029 secs 2024-04-21T17:46:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26495.598697 secs 2024-04-21T17:46:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26495.598697 secs 2024-04-21T17:46:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26495.598697 secs 2024-04-21T17:46:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:25 smithi170 ceph-mon[31212]: pgmap v14222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:25 smithi077 ceph-mon[27902]: pgmap v14222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:25 smithi191 ceph-mon[31636]: pgmap v14222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:26 smithi170 ceph-mon[31212]: pgmap v14223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:26.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:26 smithi077 ceph-mon[27902]: pgmap v14223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:26 smithi191 ceph-mon[31636]: pgmap v14223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26498.839147 secs 2024-04-21T17:46:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26498.839147 secs 2024-04-21T17:46:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26498.839147 secs 2024-04-21T17:46:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:28 smithi170 ceph-mon[31212]: pgmap v14224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:28 smithi191 ceph-mon[31636]: pgmap v14224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:28.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:28 smithi077 ceph-mon[27902]: pgmap v14224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26500.598840 secs 2024-04-21T17:46:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26500.598840 secs 2024-04-21T17:46:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26500.598840 secs 2024-04-21T17:46:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:30 smithi191 ceph-mon[31636]: pgmap v14225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:30 smithi170 ceph-mon[31212]: pgmap v14225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:30 smithi077 ceph-mon[27902]: pgmap v14225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:32 smithi191 ceph-mon[31636]: pgmap v14226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26503.839293 secs 2024-04-21T17:46:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:32 smithi170 ceph-mon[31212]: pgmap v14226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26503.839293 secs 2024-04-21T17:46:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:32 smithi077 ceph-mon[27902]: pgmap v14226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26503.839293 secs 2024-04-21T17:46:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26505.598937 secs 2024-04-21T17:46:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:34 smithi191 ceph-mon[31636]: pgmap v14227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26505.598937 secs 2024-04-21T17:46:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:34 smithi170 ceph-mon[31212]: pgmap v14227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26505.598937 secs 2024-04-21T17:46:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:34 smithi077 ceph-mon[27902]: pgmap v14227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:36 smithi191 ceph-mon[31636]: pgmap v14228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:36 smithi170 ceph-mon[31212]: pgmap v14228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:36 smithi077 ceph-mon[27902]: pgmap v14228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26508.839446 secs 2024-04-21T17:46:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26508.839446 secs 2024-04-21T17:46:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26508.839446 secs 2024-04-21T17:46:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:38 smithi191 ceph-mon[31636]: pgmap v14229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:38 smithi170 ceph-mon[31212]: pgmap v14229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:38 smithi077 ceph-mon[27902]: pgmap v14229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26510.599018 secs 2024-04-21T17:46:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26510.599018 secs 2024-04-21T17:46:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26510.599018 secs 2024-04-21T17:46:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:40 smithi191 ceph-mon[31636]: pgmap v14230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:40 smithi170 ceph-mon[31212]: pgmap v14230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:40 smithi077 ceph-mon[27902]: pgmap v14230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:42 smithi191 ceph-mon[31636]: pgmap v14231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26513.839561 secs 2024-04-21T17:46:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:42 smithi170 ceph-mon[31212]: pgmap v14231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26513.839561 secs 2024-04-21T17:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:42 smithi077 ceph-mon[27902]: pgmap v14231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26513.839561 secs 2024-04-21T17:46:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26515.599133 secs 2024-04-21T17:46:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:44 smithi191 ceph-mon[31636]: pgmap v14232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26515.599133 secs 2024-04-21T17:46:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:44 smithi170 ceph-mon[31212]: pgmap v14232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26515.599133 secs 2024-04-21T17:46:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:44 smithi077 ceph-mon[27902]: pgmap v14232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:46 smithi191 ceph-mon[31636]: pgmap v14233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:46 smithi170 ceph-mon[31212]: pgmap v14233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:46 smithi077 ceph-mon[27902]: pgmap v14233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26518.839679 secs 2024-04-21T17:46:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26518.839679 secs 2024-04-21T17:46:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26518.839679 secs 2024-04-21T17:46:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:48 smithi191 ceph-mon[31636]: pgmap v14234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:48 smithi170 ceph-mon[31212]: pgmap v14234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:48 smithi077 ceph-mon[27902]: pgmap v14234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26520.599277 secs 2024-04-21T17:46:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26520.599277 secs 2024-04-21T17:46:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26520.599277 secs 2024-04-21T17:46:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:50 smithi191 ceph-mon[31636]: pgmap v14235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:50 smithi170 ceph-mon[31212]: pgmap v14235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:50 smithi077 ceph-mon[27902]: pgmap v14235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:52 smithi191 ceph-mon[31636]: pgmap v14236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26523.839813 secs 2024-04-21T17:46:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:52 smithi170 ceph-mon[31212]: pgmap v14236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26523.839813 secs 2024-04-21T17:46:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:52 smithi077 ceph-mon[27902]: pgmap v14236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26523.839813 secs 2024-04-21T17:46:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:46:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26525.599339 secs 2024-04-21T17:46:55.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:54 smithi191 ceph-mon[31636]: pgmap v14237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26525.599339 secs 2024-04-21T17:46:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:54 smithi170 ceph-mon[31212]: pgmap v14237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26525.599339 secs 2024-04-21T17:46:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:54 smithi077 ceph-mon[27902]: pgmap v14237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:56 smithi191 ceph-mon[31636]: pgmap v14238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:56 smithi170 ceph-mon[31212]: pgmap v14238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:56 smithi077 ceph-mon[27902]: pgmap v14238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:46:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:58.022+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:46:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:58.022+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:46:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:58.023+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:46:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:46:58.023+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:46:58.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26528.839935 secs 2024-04-21T17:46:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26528.839935 secs 2024-04-21T17:46:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26528.839935 secs 2024-04-21T17:46:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:58 smithi191 ceph-mon[31636]: pgmap v14239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:58 smithi170 ceph-mon[31212]: pgmap v14239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:46:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:58 smithi077 ceph-mon[27902]: pgmap v14239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26530.599464 secs 2024-04-21T17:47:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26530.599464 secs 2024-04-21T17:47:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26530.599464 secs 2024-04-21T17:47:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:00 smithi191 ceph-mon[31636]: pgmap v14240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:00 smithi170 ceph-mon[31212]: pgmap v14240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:00 smithi077 ceph-mon[27902]: pgmap v14240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:02 smithi191 ceph-mon[31636]: pgmap v14241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26533.840001 secs 2024-04-21T17:47:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:02 smithi170 ceph-mon[31212]: pgmap v14241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26533.840001 secs 2024-04-21T17:47:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:02 smithi077 ceph-mon[27902]: pgmap v14241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26533.840001 secs 2024-04-21T17:47:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26535.599580 secs 2024-04-21T17:47:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:04 smithi170 ceph-mon[31212]: pgmap v14242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:04 smithi170 ceph-mon[31212]: osdmap e962: 12 total, 12 up, 12 in 2024-04-21T17:47:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26535.599580 secs 2024-04-21T17:47:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:04 smithi077 ceph-mon[27902]: pgmap v14242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:04 smithi077 ceph-mon[27902]: osdmap e962: 12 total, 12 up, 12 in 2024-04-21T17:47:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26535.599580 secs 2024-04-21T17:47:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:04 smithi191 ceph-mon[31636]: pgmap v14242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:04 smithi191 ceph-mon[31636]: osdmap e962: 12 total, 12 up, 12 in 2024-04-21T17:47:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:47:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:47:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:47:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:47:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:47:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:47:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:47:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:47:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:47:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:47:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:47:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:47:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:06 smithi170 ceph-mon[31212]: pgmap v14244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:47:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:06 smithi077 ceph-mon[27902]: pgmap v14244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:47:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:06 smithi191 ceph-mon[31636]: pgmap v14244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:47:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26538.840122 secs 2024-04-21T17:47:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:08 smithi191 ceph-mon[31636]: osdmap e963: 12 total, 12 up, 12 in 2024-04-21T17:47:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26538.840122 secs 2024-04-21T17:47:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:08 smithi170 ceph-mon[31212]: osdmap e963: 12 total, 12 up, 12 in 2024-04-21T17:47:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26538.840122 secs 2024-04-21T17:47:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:08 smithi077 ceph-mon[27902]: osdmap e963: 12 total, 12 up, 12 in 2024-04-21T17:47:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:09 smithi191 ceph-mon[31636]: pgmap v14246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:47:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26540.599697 secs 2024-04-21T17:47:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:09 smithi170 ceph-mon[31212]: pgmap v14246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:47:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26540.599697 secs 2024-04-21T17:47:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:09 smithi077 ceph-mon[27902]: pgmap v14246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:47:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26540.599697 secs 2024-04-21T17:47:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:11 smithi191 ceph-mon[31636]: pgmap v14247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:47:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:11 smithi170 ceph-mon[31212]: pgmap v14247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:47:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:11 smithi077 ceph-mon[27902]: pgmap v14247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:47:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:13 smithi191 ceph-mon[31636]: pgmap v14248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:47:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26543.840240 secs 2024-04-21T17:47:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:13 smithi170 ceph-mon[31212]: pgmap v14248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:47:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26543.840240 secs 2024-04-21T17:47:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:13 smithi077 ceph-mon[27902]: pgmap v14248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:47:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26543.840240 secs 2024-04-21T17:47:14.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26545.599813 secs 2024-04-21T17:47:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26545.599813 secs 2024-04-21T17:47:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26545.599813 secs 2024-04-21T17:47:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:15 smithi191 ceph-mon[31636]: pgmap v14249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:47:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:15 smithi170 ceph-mon[31212]: pgmap v14249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:47:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:15 smithi077 ceph-mon[27902]: pgmap v14249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:47:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:17 smithi191 ceph-mon[31636]: pgmap v14250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:47:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:17 smithi170 ceph-mon[31212]: pgmap v14250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:47:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:17 smithi077 ceph-mon[27902]: pgmap v14250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:47:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26548.840381 secs 2024-04-21T17:47:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26548.840381 secs 2024-04-21T17:47:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26548.840381 secs 2024-04-21T17:47:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:19 smithi170 ceph-mon[31212]: pgmap v14251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:47:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26550.599950 secs 2024-04-21T17:47:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:19 smithi077 ceph-mon[27902]: pgmap v14251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:47:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26550.599950 secs 2024-04-21T17:47:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:19 smithi191 ceph-mon[31636]: pgmap v14251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:47:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26550.599950 secs 2024-04-21T17:47:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:21 smithi170 ceph-mon[31212]: pgmap v14252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:47:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:21 smithi077 ceph-mon[27902]: pgmap v14252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:47:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:21 smithi191 ceph-mon[31636]: pgmap v14252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:47:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:23 smithi170 ceph-mon[31212]: pgmap v14253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:47:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26553.840500 secs 2024-04-21T17:47:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:23 smithi077 ceph-mon[27902]: pgmap v14253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:47:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26553.840500 secs 2024-04-21T17:47:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:23 smithi191 ceph-mon[31636]: pgmap v14253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:47:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26553.840500 secs 2024-04-21T17:47:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26555.600034 secs 2024-04-21T17:47:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:24 smithi170 ceph-mon[31212]: pgmap v14254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26555.600034 secs 2024-04-21T17:47:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:24 smithi077 ceph-mon[27902]: pgmap v14254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26555.600034 secs 2024-04-21T17:47:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:24 smithi191 ceph-mon[31636]: pgmap v14254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:26 smithi191 ceph-mon[31636]: pgmap v14255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:26 smithi170 ceph-mon[31212]: pgmap v14255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:26 smithi077 ceph-mon[27902]: pgmap v14255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:28.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26558.840623 secs 2024-04-21T17:47:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26558.840623 secs 2024-04-21T17:47:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26558.840623 secs 2024-04-21T17:47:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:28 smithi191 ceph-mon[31636]: pgmap v14256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:28 smithi170 ceph-mon[31212]: pgmap v14256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:28 smithi077 ceph-mon[27902]: pgmap v14256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26560.600174 secs 2024-04-21T17:47:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26560.600174 secs 2024-04-21T17:47:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26560.600174 secs 2024-04-21T17:47:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:30 smithi191 ceph-mon[31636]: pgmap v14257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:30 smithi170 ceph-mon[31212]: pgmap v14257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:30 smithi077 ceph-mon[27902]: pgmap v14257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:32 smithi191 ceph-mon[31636]: pgmap v14258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26563.840775 secs 2024-04-21T17:47:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:32 smithi170 ceph-mon[31212]: pgmap v14258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26563.840775 secs 2024-04-21T17:47:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:32 smithi077 ceph-mon[27902]: pgmap v14258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26563.840775 secs 2024-04-21T17:47:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26565.600243 secs 2024-04-21T17:47:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:34 smithi191 ceph-mon[31636]: pgmap v14259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26565.600243 secs 2024-04-21T17:47:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:34 smithi170 ceph-mon[31212]: pgmap v14259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26565.600243 secs 2024-04-21T17:47:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:34 smithi077 ceph-mon[27902]: pgmap v14259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:36 smithi191 ceph-mon[31636]: pgmap v14260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:36 smithi170 ceph-mon[31212]: pgmap v14260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:36 smithi077 ceph-mon[27902]: pgmap v14260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26568.840837 secs 2024-04-21T17:47:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26568.840837 secs 2024-04-21T17:47:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26568.840837 secs 2024-04-21T17:47:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:38 smithi191 ceph-mon[31636]: pgmap v14261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:38 smithi170 ceph-mon[31212]: pgmap v14261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:38 smithi077 ceph-mon[27902]: pgmap v14261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26570.600319 secs 2024-04-21T17:47:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26570.600319 secs 2024-04-21T17:47:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26570.600319 secs 2024-04-21T17:47:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:40 smithi191 ceph-mon[31636]: pgmap v14262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:40 smithi170 ceph-mon[31212]: pgmap v14262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:40 smithi077 ceph-mon[27902]: pgmap v14262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:42 smithi191 ceph-mon[31636]: pgmap v14263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:43.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26573.840954 secs 2024-04-21T17:47:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:42 smithi170 ceph-mon[31212]: pgmap v14263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26573.840954 secs 2024-04-21T17:47:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:42 smithi077 ceph-mon[27902]: pgmap v14263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26573.840954 secs 2024-04-21T17:47:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26575.600382 secs 2024-04-21T17:47:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:44 smithi191 ceph-mon[31636]: pgmap v14264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26575.600382 secs 2024-04-21T17:47:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:44 smithi170 ceph-mon[31212]: pgmap v14264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26575.600382 secs 2024-04-21T17:47:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:44 smithi077 ceph-mon[27902]: pgmap v14264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:46 smithi191 ceph-mon[31636]: pgmap v14265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:46 smithi170 ceph-mon[31212]: pgmap v14265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:46 smithi077 ceph-mon[27902]: pgmap v14265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:48.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26578.841030 secs 2024-04-21T17:47:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26578.841030 secs 2024-04-21T17:47:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26578.841030 secs 2024-04-21T17:47:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:48 smithi191 ceph-mon[31636]: pgmap v14266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:48 smithi170 ceph-mon[31212]: pgmap v14266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:48 smithi077 ceph-mon[27902]: pgmap v14266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26580.600457 secs 2024-04-21T17:47:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26580.600457 secs 2024-04-21T17:47:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26580.600457 secs 2024-04-21T17:47:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:50 smithi170 ceph-mon[31212]: pgmap v14267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:50 smithi077 ceph-mon[27902]: pgmap v14267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:50 smithi191 ceph-mon[31636]: pgmap v14267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:52 smithi170 ceph-mon[31212]: pgmap v14268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26583.841147 secs 2024-04-21T17:47:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:52 smithi077 ceph-mon[27902]: pgmap v14268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26583.841147 secs 2024-04-21T17:47:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:52 smithi191 ceph-mon[31636]: pgmap v14268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26583.841147 secs 2024-04-21T17:47:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:47:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26585.600567 secs 2024-04-21T17:47:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:54 smithi170 ceph-mon[31212]: pgmap v14269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26585.600567 secs 2024-04-21T17:47:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:54 smithi077 ceph-mon[27902]: pgmap v14269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26585.600567 secs 2024-04-21T17:47:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:54 smithi191 ceph-mon[31636]: pgmap v14269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:56 smithi170 ceph-mon[31212]: pgmap v14270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:56 smithi077 ceph-mon[27902]: pgmap v14270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:56 smithi191 ceph-mon[31636]: pgmap v14270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:47:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26588.841258 secs 2024-04-21T17:47:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26588.841258 secs 2024-04-21T17:47:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26588.841258 secs 2024-04-21T17:47:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:58 smithi170 ceph-mon[31212]: pgmap v14271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:58 smithi077 ceph-mon[27902]: pgmap v14271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:47:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:47:58 smithi191 ceph-mon[31636]: pgmap v14271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:47:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26590.600639 secs 2024-04-21T17:48:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:47:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26590.600639 secs 2024-04-21T17:48:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26590.600639 secs 2024-04-21T17:48:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:01 smithi170 ceph-mon[31212]: pgmap v14272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:01 smithi077 ceph-mon[27902]: pgmap v14272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:01 smithi191 ceph-mon[31636]: pgmap v14272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:03 smithi170 ceph-mon[31212]: pgmap v14273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T17:48:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26593.841374 secs 2024-04-21T17:48:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:03 smithi077 ceph-mon[27902]: pgmap v14273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T17:48:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26593.841374 secs 2024-04-21T17:48:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:03 smithi191 ceph-mon[31636]: pgmap v14273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T17:48:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26593.841374 secs 2024-04-21T17:48:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26595.600759 secs 2024-04-21T17:48:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:05 smithi170 ceph-mon[31212]: pgmap v14274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T17:48:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:05 smithi170 ceph-mon[31212]: osdmap e964: 12 total, 12 up, 12 in 2024-04-21T17:48:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26595.600759 secs 2024-04-21T17:48:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:05 smithi077 ceph-mon[27902]: pgmap v14274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T17:48:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:05 smithi077 ceph-mon[27902]: osdmap e964: 12 total, 12 up, 12 in 2024-04-21T17:48:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26595.600759 secs 2024-04-21T17:48:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:05 smithi191 ceph-mon[31636]: pgmap v14274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T17:48:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:05 smithi191 ceph-mon[31636]: osdmap e964: 12 total, 12 up, 12 in 2024-04-21T17:48:06.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:48:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:48:06.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:48:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:07 smithi170 ceph-mon[31212]: pgmap v14276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:48:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:48:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:48:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:48:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:07 smithi077 ceph-mon[27902]: pgmap v14276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:48:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:48:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:48:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:48:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:07 smithi191 ceph-mon[31636]: pgmap v14276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:48:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:48:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:48:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:48:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26598.841457 secs 2024-04-21T17:48:08.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:08 smithi191 ceph-mon[31636]: osdmap e965: 12 total, 12 up, 12 in 2024-04-21T17:48:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26598.841457 secs 2024-04-21T17:48:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:08 smithi170 ceph-mon[31212]: osdmap e965: 12 total, 12 up, 12 in 2024-04-21T17:48:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26598.841457 secs 2024-04-21T17:48:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:08 smithi077 ceph-mon[27902]: osdmap e965: 12 total, 12 up, 12 in 2024-04-21T17:48:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:09 smithi191 ceph-mon[31636]: pgmap v14278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:48:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26600.600875 secs 2024-04-21T17:48:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:09 smithi170 ceph-mon[31212]: pgmap v14278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:48:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26600.600875 secs 2024-04-21T17:48:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:09 smithi077 ceph-mon[27902]: pgmap v14278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:48:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26600.600875 secs 2024-04-21T17:48:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:11 smithi191 ceph-mon[31636]: pgmap v14279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-04-21T17:48:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:11 smithi170 ceph-mon[31212]: pgmap v14279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-04-21T17:48:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:11 smithi077 ceph-mon[27902]: pgmap v14279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-04-21T17:48:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:13 smithi170 ceph-mon[31212]: pgmap v14280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-21T17:48:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26603.841578 secs 2024-04-21T17:48:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:13 smithi077 ceph-mon[27902]: pgmap v14280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-21T17:48:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26603.841578 secs 2024-04-21T17:48:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:13 smithi191 ceph-mon[31636]: pgmap v14280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-21T17:48:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26603.841578 secs 2024-04-21T17:48:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26605.600948 secs 2024-04-21T17:48:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26605.600948 secs 2024-04-21T17:48:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26605.600948 secs 2024-04-21T17:48:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:15 smithi170 ceph-mon[31212]: pgmap v14281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T17:48:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:15 smithi077 ceph-mon[27902]: pgmap v14281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T17:48:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:15 smithi191 ceph-mon[31636]: pgmap v14281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T17:48:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:17 smithi170 ceph-mon[31212]: pgmap v14282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:48:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:17 smithi077 ceph-mon[27902]: pgmap v14282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:48:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:17 smithi191 ceph-mon[31636]: pgmap v14282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:48:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26608.841694 secs 2024-04-21T17:48:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26608.841694 secs 2024-04-21T17:48:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26608.841694 secs 2024-04-21T17:48:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:19 smithi170 ceph-mon[31212]: pgmap v14283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:48:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26610.601057 secs 2024-04-21T17:48:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:19 smithi077 ceph-mon[27902]: pgmap v14283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:48:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26610.601057 secs 2024-04-21T17:48:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:19 smithi191 ceph-mon[31636]: pgmap v14283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:48:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26610.601057 secs 2024-04-21T17:48:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:20 smithi170 ceph-mon[31212]: pgmap v14284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:48:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:20 smithi077 ceph-mon[27902]: pgmap v14284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:48:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:20 smithi191 ceph-mon[31636]: pgmap v14284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:48:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:22 smithi191 ceph-mon[31636]: pgmap v14285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:48:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26613.841812 secs 2024-04-21T17:48:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:22 smithi170 ceph-mon[31212]: pgmap v14285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:48:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26613.841812 secs 2024-04-21T17:48:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:22 smithi077 ceph-mon[27902]: pgmap v14285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:48:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26613.841812 secs 2024-04-21T17:48:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26615.601171 secs 2024-04-21T17:48:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:24 smithi191 ceph-mon[31636]: pgmap v14286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26615.601171 secs 2024-04-21T17:48:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:24 smithi170 ceph-mon[31212]: pgmap v14286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26615.601171 secs 2024-04-21T17:48:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:24 smithi077 ceph-mon[27902]: pgmap v14286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:26 smithi191 ceph-mon[31636]: pgmap v14287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:26 smithi170 ceph-mon[31212]: pgmap v14287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:26 smithi077 ceph-mon[27902]: pgmap v14287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:28.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26618.841947 secs 2024-04-21T17:48:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26618.841947 secs 2024-04-21T17:48:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26618.841947 secs 2024-04-21T17:48:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:28 smithi191 ceph-mon[31636]: pgmap v14288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:28 smithi170 ceph-mon[31212]: pgmap v14288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:28 smithi077 ceph-mon[27902]: pgmap v14288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26620.601291 secs 2024-04-21T17:48:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26620.601291 secs 2024-04-21T17:48:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26620.601291 secs 2024-04-21T17:48:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:30 smithi191 ceph-mon[31636]: pgmap v14289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:30 smithi170 ceph-mon[31212]: pgmap v14289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:30 smithi077 ceph-mon[27902]: pgmap v14289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:32 smithi191 ceph-mon[31636]: pgmap v14290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26623.842084 secs 2024-04-21T17:48:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:32 smithi170 ceph-mon[31212]: pgmap v14290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26623.842084 secs 2024-04-21T17:48:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:32 smithi077 ceph-mon[27902]: pgmap v14290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26623.842084 secs 2024-04-21T17:48:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26625.601407 secs 2024-04-21T17:48:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:34 smithi191 ceph-mon[31636]: pgmap v14291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26625.601407 secs 2024-04-21T17:48:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:34 smithi170 ceph-mon[31212]: pgmap v14291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26625.601407 secs 2024-04-21T17:48:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:34 smithi077 ceph-mon[27902]: pgmap v14291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:36 smithi191 ceph-mon[31636]: pgmap v14292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:36 smithi170 ceph-mon[31212]: pgmap v14292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:36 smithi077 ceph-mon[27902]: pgmap v14292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26628.842197 secs 2024-04-21T17:48:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26628.842197 secs 2024-04-21T17:48:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26628.842197 secs 2024-04-21T17:48:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:38 smithi170 ceph-mon[31212]: pgmap v14293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:38 smithi077 ceph-mon[27902]: pgmap v14293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:38 smithi191 ceph-mon[31636]: pgmap v14293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26630.601520 secs 2024-04-21T17:48:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26630.601520 secs 2024-04-21T17:48:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26630.601520 secs 2024-04-21T17:48:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:40 smithi170 ceph-mon[31212]: pgmap v14294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:40 smithi077 ceph-mon[27902]: pgmap v14294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:40 smithi191 ceph-mon[31636]: pgmap v14294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:42 smithi170 ceph-mon[31212]: pgmap v14295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26633.842310 secs 2024-04-21T17:48:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:42 smithi077 ceph-mon[27902]: pgmap v14295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26633.842310 secs 2024-04-21T17:48:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:42 smithi191 ceph-mon[31636]: pgmap v14295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26633.842310 secs 2024-04-21T17:48:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26635.601671 secs 2024-04-21T17:48:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:44 smithi170 ceph-mon[31212]: pgmap v14296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26635.601671 secs 2024-04-21T17:48:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:44 smithi077 ceph-mon[27902]: pgmap v14296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26635.601671 secs 2024-04-21T17:48:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:44 smithi191 ceph-mon[31636]: pgmap v14296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:46 smithi170 ceph-mon[31212]: pgmap v14297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:46 smithi077 ceph-mon[27902]: pgmap v14297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:46 smithi191 ceph-mon[31636]: pgmap v14297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26638.842426 secs 2024-04-21T17:48:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26638.842426 secs 2024-04-21T17:48:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26638.842426 secs 2024-04-21T17:48:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:48 smithi170 ceph-mon[31212]: pgmap v14298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:48 smithi077 ceph-mon[27902]: pgmap v14298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:48 smithi191 ceph-mon[31636]: pgmap v14298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26640.601801 secs 2024-04-21T17:48:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26640.601801 secs 2024-04-21T17:48:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26640.601801 secs 2024-04-21T17:48:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:51 smithi170 ceph-mon[31212]: pgmap v14299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:51 smithi077 ceph-mon[27902]: pgmap v14299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:51 smithi191 ceph-mon[31636]: pgmap v14299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:53 smithi170 ceph-mon[31212]: pgmap v14300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26643.842561 secs 2024-04-21T17:48:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:53 smithi077 ceph-mon[27902]: pgmap v14300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26643.842561 secs 2024-04-21T17:48:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:53 smithi191 ceph-mon[31636]: pgmap v14300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26643.842561 secs 2024-04-21T17:48:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:48:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26645.601928 secs 2024-04-21T17:48:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:55 smithi170 ceph-mon[31212]: pgmap v14301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26645.601928 secs 2024-04-21T17:48:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:55 smithi077 ceph-mon[27902]: pgmap v14301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26645.601928 secs 2024-04-21T17:48:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:55 smithi191 ceph-mon[31636]: pgmap v14301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:57 smithi170 ceph-mon[31212]: pgmap v14302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:57 smithi077 ceph-mon[27902]: pgmap v14302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:57 smithi191 ceph-mon[31636]: pgmap v14302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:48:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26648.842704 secs 2024-04-21T17:48:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26648.842704 secs 2024-04-21T17:48:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26648.842704 secs 2024-04-21T17:48:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:48:59 smithi170 ceph-mon[31212]: pgmap v14303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:48:59 smithi077 ceph-mon[27902]: pgmap v14303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:48:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:48:59 smithi191 ceph-mon[31636]: pgmap v14303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26650.602046 secs 2024-04-21T17:49:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26650.602046 secs 2024-04-21T17:49:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26650.602046 secs 2024-04-21T17:49:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:01 smithi170 ceph-mon[31212]: pgmap v14304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:01 smithi077 ceph-mon[27902]: pgmap v14304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:01 smithi191 ceph-mon[31636]: pgmap v14304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:03 smithi170 ceph-mon[31212]: pgmap v14305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T17:49:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26653.842840 secs 2024-04-21T17:49:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:03 smithi077 ceph-mon[27902]: pgmap v14305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T17:49:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26653.842840 secs 2024-04-21T17:49:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:03 smithi191 ceph-mon[31636]: pgmap v14305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T17:49:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26653.842840 secs 2024-04-21T17:49:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26655.602163 secs 2024-04-21T17:49:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:05 smithi170 ceph-mon[31212]: pgmap v14306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T17:49:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:05 smithi170 ceph-mon[31212]: osdmap e966: 12 total, 12 up, 12 in 2024-04-21T17:49:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26655.602163 secs 2024-04-21T17:49:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:05 smithi077 ceph-mon[27902]: pgmap v14306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T17:49:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:05 smithi077 ceph-mon[27902]: osdmap e966: 12 total, 12 up, 12 in 2024-04-21T17:49:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26655.602163 secs 2024-04-21T17:49:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:05 smithi191 ceph-mon[31636]: pgmap v14306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-04-21T17:49:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:05 smithi191 ceph-mon[31636]: osdmap e966: 12 total, 12 up, 12 in 2024-04-21T17:49:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:07 smithi170 ceph-mon[31212]: pgmap v14308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:49:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:49:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:07 smithi077 ceph-mon[27902]: pgmap v14308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:49:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:49:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:07 smithi191 ceph-mon[31636]: pgmap v14308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:49:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:49:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26658.842906 secs 2024-04-21T17:49:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:08 smithi170 ceph-mon[31212]: osdmap e967: 12 total, 12 up, 12 in 2024-04-21T17:49:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:49:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:49:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26658.842906 secs 2024-04-21T17:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:08 smithi077 ceph-mon[27902]: osdmap e967: 12 total, 12 up, 12 in 2024-04-21T17:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:49:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:49:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26658.842906 secs 2024-04-21T17:49:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:08 smithi191 ceph-mon[31636]: osdmap e967: 12 total, 12 up, 12 in 2024-04-21T17:49:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:49:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:49:08.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:49:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:09 smithi170 ceph-mon[31212]: pgmap v14310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:49:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26660.602288 secs 2024-04-21T17:49:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:09 smithi077 ceph-mon[27902]: pgmap v14310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:49:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26660.602288 secs 2024-04-21T17:49:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:09 smithi191 ceph-mon[31636]: pgmap v14310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:49:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26660.602288 secs 2024-04-21T17:49:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:11 smithi170 ceph-mon[31212]: pgmap v14311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T17:49:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:11 smithi077 ceph-mon[27902]: pgmap v14311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T17:49:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:11 smithi191 ceph-mon[31636]: pgmap v14311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T17:49:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:13 smithi170 ceph-mon[31212]: pgmap v14312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T17:49:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26663.843004 secs 2024-04-21T17:49:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:13 smithi077 ceph-mon[27902]: pgmap v14312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T17:49:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26663.843004 secs 2024-04-21T17:49:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:13 smithi191 ceph-mon[31636]: pgmap v14312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T17:49:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26663.843004 secs 2024-04-21T17:49:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26665.602438 secs 2024-04-21T17:49:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26665.602438 secs 2024-04-21T17:49:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26665.602438 secs 2024-04-21T17:49:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:15 smithi170 ceph-mon[31212]: pgmap v14313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-21T17:49:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:15 smithi077 ceph-mon[27902]: pgmap v14313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-21T17:49:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:15 smithi191 ceph-mon[31636]: pgmap v14313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-21T17:49:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:17 smithi170 ceph-mon[31212]: pgmap v14314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:49:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:17 smithi077 ceph-mon[27902]: pgmap v14314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:49:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:17 smithi191 ceph-mon[31636]: pgmap v14314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:49:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26668.843123 secs 2024-04-21T17:49:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26668.843123 secs 2024-04-21T17:49:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26668.843123 secs 2024-04-21T17:49:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:19 smithi170 ceph-mon[31212]: pgmap v14315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:49:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26670.602592 secs 2024-04-21T17:49:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:19 smithi077 ceph-mon[27902]: pgmap v14315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:49:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26670.602592 secs 2024-04-21T17:49:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:19 smithi191 ceph-mon[31636]: pgmap v14315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2024-04-21T17:49:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26670.602592 secs 2024-04-21T17:49:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:21 smithi170 ceph-mon[31212]: pgmap v14316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:49:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:21 smithi077 ceph-mon[27902]: pgmap v14316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:49:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:21 smithi191 ceph-mon[31636]: pgmap v14316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:49:22.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:22 smithi170 ceph-mon[31212]: pgmap v14317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:49:22.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:22 smithi077 ceph-mon[27902]: pgmap v14317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:49:22.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:22 smithi191 ceph-mon[31636]: pgmap v14317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:49:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26673.843190 secs 2024-04-21T17:49:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26673.843190 secs 2024-04-21T17:49:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26673.843190 secs 2024-04-21T17:49:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26675.602731 secs 2024-04-21T17:49:24.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:24 smithi077 ceph-mon[27902]: pgmap v14318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26675.602731 secs 2024-04-21T17:49:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:24 smithi191 ceph-mon[31636]: pgmap v14318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26675.602731 secs 2024-04-21T17:49:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:24 smithi170 ceph-mon[31212]: pgmap v14318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:26 smithi191 ceph-mon[31636]: pgmap v14319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:26 smithi170 ceph-mon[31212]: pgmap v14319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:26 smithi077 ceph-mon[27902]: pgmap v14319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:28.207 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26678.843332 secs 2024-04-21T17:49:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26678.843332 secs 2024-04-21T17:49:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26678.843332 secs 2024-04-21T17:49:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:28 smithi191 ceph-mon[31636]: pgmap v14320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:28 smithi170 ceph-mon[31212]: pgmap v14320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:28 smithi077 ceph-mon[27902]: pgmap v14320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26680.602899 secs 2024-04-21T17:49:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26680.602899 secs 2024-04-21T17:49:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26680.602899 secs 2024-04-21T17:49:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:30 smithi191 ceph-mon[31636]: pgmap v14321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:30 smithi170 ceph-mon[31212]: pgmap v14321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:31.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:30 smithi077 ceph-mon[27902]: pgmap v14321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:32 smithi191 ceph-mon[31636]: pgmap v14322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:33.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26683.843452 secs 2024-04-21T17:49:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:32 smithi170 ceph-mon[31212]: pgmap v14322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26683.843452 secs 2024-04-21T17:49:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:32 smithi077 ceph-mon[27902]: pgmap v14322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26683.843452 secs 2024-04-21T17:49:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26685.602992 secs 2024-04-21T17:49:35.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:34 smithi191 ceph-mon[31636]: pgmap v14323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26685.602992 secs 2024-04-21T17:49:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:34 smithi170 ceph-mon[31212]: pgmap v14323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26685.602992 secs 2024-04-21T17:49:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:34 smithi077 ceph-mon[27902]: pgmap v14323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:36 smithi170 ceph-mon[31212]: pgmap v14324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:36 smithi077 ceph-mon[27902]: pgmap v14324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:36 smithi191 ceph-mon[31636]: pgmap v14324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26688.843522 secs 2024-04-21T17:49:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26688.843522 secs 2024-04-21T17:49:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26688.843522 secs 2024-04-21T17:49:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:38 smithi170 ceph-mon[31212]: pgmap v14325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:38 smithi077 ceph-mon[27902]: pgmap v14325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:38 smithi191 ceph-mon[31636]: pgmap v14325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26690.603078 secs 2024-04-21T17:49:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26690.603078 secs 2024-04-21T17:49:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26690.603078 secs 2024-04-21T17:49:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:40 smithi170 ceph-mon[31212]: pgmap v14326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:40 smithi077 ceph-mon[27902]: pgmap v14326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:40 smithi191 ceph-mon[31636]: pgmap v14326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:42 smithi170 ceph-mon[31212]: pgmap v14327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:43.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26693.843637 secs 2024-04-21T17:49:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:42 smithi077 ceph-mon[27902]: pgmap v14327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26693.843637 secs 2024-04-21T17:49:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:42 smithi191 ceph-mon[31636]: pgmap v14327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26693.843637 secs 2024-04-21T17:49:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26695.603221 secs 2024-04-21T17:49:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:44 smithi170 ceph-mon[31212]: pgmap v14328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26695.603221 secs 2024-04-21T17:49:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:44 smithi077 ceph-mon[27902]: pgmap v14328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26695.603221 secs 2024-04-21T17:49:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:44 smithi191 ceph-mon[31636]: pgmap v14328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:46 smithi170 ceph-mon[31212]: pgmap v14329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:46 smithi077 ceph-mon[27902]: pgmap v14329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:46 smithi191 ceph-mon[31636]: pgmap v14329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26698.843733 secs 2024-04-21T17:49:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26698.843733 secs 2024-04-21T17:49:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26698.843733 secs 2024-04-21T17:49:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:49 smithi170 ceph-mon[31212]: pgmap v14330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:49 smithi077 ceph-mon[27902]: pgmap v14330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:49 smithi191 ceph-mon[31636]: pgmap v14330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26700.603368 secs 2024-04-21T17:49:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26700.603368 secs 2024-04-21T17:49:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26700.603368 secs 2024-04-21T17:49:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:51 smithi170 ceph-mon[31212]: pgmap v14331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:51 smithi077 ceph-mon[27902]: pgmap v14331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:51 smithi191 ceph-mon[31636]: pgmap v14331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:53 smithi170 ceph-mon[31212]: pgmap v14332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26703.843868 secs 2024-04-21T17:49:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:53 smithi077 ceph-mon[27902]: pgmap v14332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26703.843868 secs 2024-04-21T17:49:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:53 smithi191 ceph-mon[31636]: pgmap v14332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26703.843868 secs 2024-04-21T17:49:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:49:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26705.603475 secs 2024-04-21T17:49:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:55 smithi170 ceph-mon[31212]: pgmap v14333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26705.603475 secs 2024-04-21T17:49:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:55 smithi077 ceph-mon[27902]: pgmap v14333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26705.603475 secs 2024-04-21T17:49:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:55 smithi191 ceph-mon[31636]: pgmap v14333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:57 smithi170 ceph-mon[31212]: pgmap v14334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:57 smithi077 ceph-mon[27902]: pgmap v14334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:57 smithi191 ceph-mon[31636]: pgmap v14334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:49:58.048+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:49:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:49:58.048+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:49:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:49:58.048+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:49:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:49:58.048+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:49:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26708.843948 secs 2024-04-21T17:49:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26708.843948 secs 2024-04-21T17:49:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26708.843948 secs 2024-04-21T17:49:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:49:59 smithi170 ceph-mon[31212]: pgmap v14335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:49:59 smithi077 ceph-mon[27902]: pgmap v14335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:49:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:49:59 smithi191 ceph-mon[31636]: pgmap v14335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26710.603591 secs 2024-04-21T17:50:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:50:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26710.603591 secs 2024-04-21T17:50:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:50:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26710.603591 secs 2024-04-21T17:50:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T17:50:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:01 smithi170 ceph-mon[31212]: pgmap v14336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:01 smithi077 ceph-mon[27902]: pgmap v14336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:01 smithi191 ceph-mon[31636]: pgmap v14336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:03 smithi170 ceph-mon[31212]: pgmap v14337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26713.844068 secs 2024-04-21T17:50:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:03 smithi077 ceph-mon[27902]: pgmap v14337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26713.844068 secs 2024-04-21T17:50:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:03 smithi191 ceph-mon[31636]: pgmap v14337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26713.844068 secs 2024-04-21T17:50:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26715.603716 secs 2024-04-21T17:50:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:05 smithi170 ceph-mon[31212]: pgmap v14338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:05 smithi170 ceph-mon[31212]: osdmap e968: 12 total, 12 up, 12 in 2024-04-21T17:50:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26715.603716 secs 2024-04-21T17:50:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:05 smithi077 ceph-mon[27902]: pgmap v14338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:05 smithi077 ceph-mon[27902]: osdmap e968: 12 total, 12 up, 12 in 2024-04-21T17:50:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26715.603716 secs 2024-04-21T17:50:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:05 smithi191 ceph-mon[31636]: pgmap v14338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:05 smithi191 ceph-mon[31636]: osdmap e968: 12 total, 12 up, 12 in 2024-04-21T17:50:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:07 smithi170 ceph-mon[31212]: pgmap v14340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:50:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:07 smithi077 ceph-mon[27902]: pgmap v14340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:50:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:07 smithi191 ceph-mon[31636]: pgmap v14340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:50:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26718.844218 secs 2024-04-21T17:50:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:08 smithi170 ceph-mon[31212]: osdmap e969: 12 total, 12 up, 12 in 2024-04-21T17:50:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:50:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26718.844218 secs 2024-04-21T17:50:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:08 smithi077 ceph-mon[27902]: osdmap e969: 12 total, 12 up, 12 in 2024-04-21T17:50:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:50:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26718.844218 secs 2024-04-21T17:50:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:08 smithi191 ceph-mon[31636]: osdmap e969: 12 total, 12 up, 12 in 2024-04-21T17:50:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:50:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:09 smithi170 ceph-mon[31212]: pgmap v14342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:50:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:50:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:50:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:50:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26720.603868 secs 2024-04-21T17:50:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:09 smithi077 ceph-mon[27902]: pgmap v14342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:50:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:50:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:50:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:50:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26720.603868 secs 2024-04-21T17:50:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:09 smithi191 ceph-mon[31636]: pgmap v14342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:50:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:50:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:50:09.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:50:09.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26720.603868 secs 2024-04-21T17:50:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:11 smithi170 ceph-mon[31212]: pgmap v14343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:50:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:11 smithi077 ceph-mon[27902]: pgmap v14343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:50:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:11 smithi191 ceph-mon[31636]: pgmap v14343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:50:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:13 smithi170 ceph-mon[31212]: pgmap v14344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:50:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26723.844367 secs 2024-04-21T17:50:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:13 smithi077 ceph-mon[27902]: pgmap v14344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:50:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26723.844367 secs 2024-04-21T17:50:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:13 smithi191 ceph-mon[31636]: pgmap v14344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:50:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26723.844367 secs 2024-04-21T17:50:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26725.603982 secs 2024-04-21T17:50:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26725.603982 secs 2024-04-21T17:50:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26725.603982 secs 2024-04-21T17:50:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:15 smithi170 ceph-mon[31212]: pgmap v14345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:50:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:15 smithi077 ceph-mon[27902]: pgmap v14345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:50:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:15 smithi191 ceph-mon[31636]: pgmap v14345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:50:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:17 smithi170 ceph-mon[31212]: pgmap v14346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:50:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:17 smithi077 ceph-mon[27902]: pgmap v14346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:50:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:17 smithi191 ceph-mon[31636]: pgmap v14346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:50:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26728.844463 secs 2024-04-21T17:50:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26728.844463 secs 2024-04-21T17:50:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26728.844463 secs 2024-04-21T17:50:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:19 smithi170 ceph-mon[31212]: pgmap v14347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:50:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26730.604100 secs 2024-04-21T17:50:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:19 smithi077 ceph-mon[27902]: pgmap v14347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:50:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26730.604100 secs 2024-04-21T17:50:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:19 smithi191 ceph-mon[31636]: pgmap v14347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:50:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26730.604100 secs 2024-04-21T17:50:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:20 smithi170 ceph-mon[31212]: pgmap v14348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:50:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:20 smithi077 ceph-mon[27902]: pgmap v14348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:50:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:20 smithi191 ceph-mon[31636]: pgmap v14348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:50:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:22 smithi191 ceph-mon[31636]: pgmap v14349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:50:23.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26733.844598 secs 2024-04-21T17:50:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:22 smithi170 ceph-mon[31212]: pgmap v14349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:50:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26733.844598 secs 2024-04-21T17:50:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:22 smithi077 ceph-mon[27902]: pgmap v14349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:50:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26733.844598 secs 2024-04-21T17:50:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26735.604206 secs 2024-04-21T17:50:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:24 smithi191 ceph-mon[31636]: pgmap v14350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26735.604206 secs 2024-04-21T17:50:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:24 smithi170 ceph-mon[31212]: pgmap v14350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26735.604206 secs 2024-04-21T17:50:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:24 smithi077 ceph-mon[27902]: pgmap v14350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:26 smithi191 ceph-mon[31636]: pgmap v14351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:26 smithi170 ceph-mon[31212]: pgmap v14351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:26 smithi077 ceph-mon[27902]: pgmap v14351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26738.844660 secs 2024-04-21T17:50:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26738.844660 secs 2024-04-21T17:50:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26738.844660 secs 2024-04-21T17:50:29.233 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:28 smithi077 ceph-mon[27902]: pgmap v14352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:28 smithi170 ceph-mon[31212]: pgmap v14352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:28 smithi191 ceph-mon[31636]: pgmap v14352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26740.604286 secs 2024-04-21T17:50:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26740.604286 secs 2024-04-21T17:50:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26740.604286 secs 2024-04-21T17:50:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:30 smithi170 ceph-mon[31212]: pgmap v14353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:30 smithi077 ceph-mon[27902]: pgmap v14353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:30 smithi191 ceph-mon[31636]: pgmap v14353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:32 smithi170 ceph-mon[31212]: pgmap v14354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26743.844791 secs 2024-04-21T17:50:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:32 smithi077 ceph-mon[27902]: pgmap v14354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26743.844791 secs 2024-04-21T17:50:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:32 smithi191 ceph-mon[31636]: pgmap v14354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26743.844791 secs 2024-04-21T17:50:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26745.604427 secs 2024-04-21T17:50:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:34 smithi170 ceph-mon[31212]: pgmap v14355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26745.604427 secs 2024-04-21T17:50:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:34 smithi077 ceph-mon[27902]: pgmap v14355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26745.604427 secs 2024-04-21T17:50:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:34 smithi191 ceph-mon[31636]: pgmap v14355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:36 smithi170 ceph-mon[31212]: pgmap v14356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:36 smithi077 ceph-mon[27902]: pgmap v14356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:36 smithi191 ceph-mon[31636]: pgmap v14356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26748.844930 secs 2024-04-21T17:50:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26748.844930 secs 2024-04-21T17:50:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26748.844930 secs 2024-04-21T17:50:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:39 smithi170 ceph-mon[31212]: pgmap v14357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:39 smithi077 ceph-mon[27902]: pgmap v14357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:39 smithi191 ceph-mon[31636]: pgmap v14357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26750.604537 secs 2024-04-21T17:50:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26750.604537 secs 2024-04-21T17:50:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26750.604537 secs 2024-04-21T17:50:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:41 smithi170 ceph-mon[31212]: pgmap v14358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:41 smithi077 ceph-mon[27902]: pgmap v14358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:41 smithi191 ceph-mon[31636]: pgmap v14358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:43 smithi170 ceph-mon[31212]: pgmap v14359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26753.845008 secs 2024-04-21T17:50:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:43 smithi077 ceph-mon[27902]: pgmap v14359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26753.845008 secs 2024-04-21T17:50:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:43 smithi191 ceph-mon[31636]: pgmap v14359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26753.845008 secs 2024-04-21T17:50:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26755.604665 secs 2024-04-21T17:50:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:45 smithi170 ceph-mon[31212]: pgmap v14360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26755.604665 secs 2024-04-21T17:50:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:45 smithi077 ceph-mon[27902]: pgmap v14360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26755.604665 secs 2024-04-21T17:50:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:45 smithi191 ceph-mon[31636]: pgmap v14360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:47 smithi170 ceph-mon[31212]: pgmap v14361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:47 smithi077 ceph-mon[27902]: pgmap v14361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:47 smithi191 ceph-mon[31636]: pgmap v14361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:48.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26758.845126 secs 2024-04-21T17:50:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26758.845126 secs 2024-04-21T17:50:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26758.845126 secs 2024-04-21T17:50:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:49 smithi170 ceph-mon[31212]: pgmap v14362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:49 smithi077 ceph-mon[27902]: pgmap v14362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:49 smithi191 ceph-mon[31636]: pgmap v14362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26760.604799 secs 2024-04-21T17:50:50.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26760.604799 secs 2024-04-21T17:50:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26760.604799 secs 2024-04-21T17:50:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:51 smithi170 ceph-mon[31212]: pgmap v14363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:51 smithi077 ceph-mon[27902]: pgmap v14363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:51 smithi191 ceph-mon[31636]: pgmap v14363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:53 smithi170 ceph-mon[31212]: pgmap v14364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26763.845242 secs 2024-04-21T17:50:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:53 smithi077 ceph-mon[27902]: pgmap v14364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26763.845242 secs 2024-04-21T17:50:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:53 smithi191 ceph-mon[31636]: pgmap v14364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26763.845242 secs 2024-04-21T17:50:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:50:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26765.604933 secs 2024-04-21T17:50:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:55 smithi170 ceph-mon[31212]: pgmap v14365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26765.604933 secs 2024-04-21T17:50:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:55 smithi077 ceph-mon[27902]: pgmap v14365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26765.604933 secs 2024-04-21T17:50:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:55 smithi191 ceph-mon[31636]: pgmap v14365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:57 smithi170 ceph-mon[31212]: pgmap v14366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:57 smithi077 ceph-mon[27902]: pgmap v14366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:57 smithi191 ceph-mon[31636]: pgmap v14366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:50:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26768.845379 secs 2024-04-21T17:50:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26768.845379 secs 2024-04-21T17:50:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26768.845379 secs 2024-04-21T17:50:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:50:59 smithi170 ceph-mon[31212]: pgmap v14367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:50:59 smithi077 ceph-mon[27902]: pgmap v14367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:50:59.385 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:50:59 smithi191 ceph-mon[31636]: pgmap v14367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:00.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26770.605044 secs 2024-04-21T17:51:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26770.605044 secs 2024-04-21T17:51:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26770.605044 secs 2024-04-21T17:51:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:01 smithi077 ceph-mon[27902]: pgmap v14368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:01 smithi191 ceph-mon[31636]: pgmap v14368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:01 smithi170 ceph-mon[31212]: pgmap v14368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:03 smithi077 ceph-mon[27902]: pgmap v14369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26773.845493 secs 2024-04-21T17:51:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:03 smithi191 ceph-mon[31636]: pgmap v14369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26773.845493 secs 2024-04-21T17:51:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:03 smithi170 ceph-mon[31212]: pgmap v14369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26773.845493 secs 2024-04-21T17:51:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26775.605131 secs 2024-04-21T17:51:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:05 smithi077 ceph-mon[27902]: pgmap v14370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:05 smithi077 ceph-mon[27902]: osdmap e970: 12 total, 12 up, 12 in 2024-04-21T17:51:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26775.605131 secs 2024-04-21T17:51:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:05 smithi191 ceph-mon[31636]: pgmap v14370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:05 smithi191 ceph-mon[31636]: osdmap e970: 12 total, 12 up, 12 in 2024-04-21T17:51:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26775.605131 secs 2024-04-21T17:51:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:05 smithi170 ceph-mon[31212]: pgmap v14370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:05 smithi170 ceph-mon[31212]: osdmap e970: 12 total, 12 up, 12 in 2024-04-21T17:51:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:07 smithi077 ceph-mon[27902]: pgmap v14372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:51:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:07 smithi191 ceph-mon[31636]: pgmap v14372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:51:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:07 smithi170 ceph-mon[31212]: pgmap v14372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:51:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26778.845606 secs 2024-04-21T17:51:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:08 smithi170 ceph-mon[31212]: osdmap e971: 12 total, 12 up, 12 in 2024-04-21T17:51:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26778.845606 secs 2024-04-21T17:51:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:08 smithi077 ceph-mon[27902]: osdmap e971: 12 total, 12 up, 12 in 2024-04-21T17:51:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26778.845606 secs 2024-04-21T17:51:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:08 smithi191 ceph-mon[31636]: osdmap e971: 12 total, 12 up, 12 in 2024-04-21T17:51:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:09 smithi191 ceph-mon[31636]: pgmap v14374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:51:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:51:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26780.605224 secs 2024-04-21T17:51:09.507 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:09 smithi077 ceph-mon[27902]: pgmap v14374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:51:09.507 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:51:09.507 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26780.605224 secs 2024-04-21T17:51:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:09 smithi170 ceph-mon[31212]: pgmap v14374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:51:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:51:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26780.605224 secs 2024-04-21T17:51:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: pgmap v14375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:51:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: pgmap v14375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: pgmap v14375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:51:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:51:11.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:12 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:51:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:12 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:12 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:51:12.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:12 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T17:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T17:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T17:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T17:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:12 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T17:51:12.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:12 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T17:51:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:13 smithi077 ceph-mon[27902]: pgmap v14376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:51:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26783.845719 secs 2024-04-21T17:51:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:13 smithi191 ceph-mon[31636]: pgmap v14376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:51:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26783.845719 secs 2024-04-21T17:51:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:13 smithi170 ceph-mon[31212]: pgmap v14376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:51:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26783.845719 secs 2024-04-21T17:51:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26785.605299 secs 2024-04-21T17:51:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:15 smithi077 ceph-mon[27902]: pgmap v14377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:51:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26785.605299 secs 2024-04-21T17:51:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:15 smithi191 ceph-mon[31636]: pgmap v14377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:51:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26785.605299 secs 2024-04-21T17:51:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:15 smithi170 ceph-mon[31212]: pgmap v14377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:51:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:17 smithi077 ceph-mon[27902]: pgmap v14378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:51:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:17 smithi191 ceph-mon[31636]: pgmap v14378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:51:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:17 smithi170 ceph-mon[31212]: pgmap v14378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:51:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26788.845837 secs 2024-04-21T17:51:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26788.845837 secs 2024-04-21T17:51:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26788.845837 secs 2024-04-21T17:51:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:19 smithi077 ceph-mon[27902]: pgmap v14379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:51:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:19 smithi191 ceph-mon[31636]: pgmap v14379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:51:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:19 smithi170 ceph-mon[31212]: pgmap v14379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:51:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26790.605417 secs 2024-04-21T17:51:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26790.605417 secs 2024-04-21T17:51:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26790.605417 secs 2024-04-21T17:51:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:21 smithi077 ceph-mon[27902]: pgmap v14380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:51:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:21 smithi191 ceph-mon[31636]: pgmap v14380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:51:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:21 smithi170 ceph-mon[31212]: pgmap v14380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:51:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:23 smithi170 ceph-mon[31212]: pgmap v14381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:51:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26793.845982 secs 2024-04-21T17:51:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:23 smithi077 ceph-mon[27902]: pgmap v14381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:51:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26793.845982 secs 2024-04-21T17:51:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:23 smithi191 ceph-mon[31636]: pgmap v14381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:51:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26793.845982 secs 2024-04-21T17:51:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26795.605556 secs 2024-04-21T17:51:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26795.605556 secs 2024-04-21T17:51:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26795.605556 secs 2024-04-21T17:51:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:25 smithi170 ceph-mon[31212]: pgmap v14382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:25 smithi077 ceph-mon[27902]: pgmap v14382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:25 smithi191 ceph-mon[31636]: pgmap v14382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:27 smithi170 ceph-mon[31212]: pgmap v14383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:27 smithi077 ceph-mon[27902]: pgmap v14383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:27 smithi191 ceph-mon[31636]: pgmap v14383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26798.846119 secs 2024-04-21T17:51:28.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26798.846119 secs 2024-04-21T17:51:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26798.846119 secs 2024-04-21T17:51:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:29 smithi170 ceph-mon[31212]: pgmap v14384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26800.605674 secs 2024-04-21T17:51:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:29 smithi077 ceph-mon[27902]: pgmap v14384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26800.605674 secs 2024-04-21T17:51:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:29 smithi191 ceph-mon[31636]: pgmap v14384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26800.605674 secs 2024-04-21T17:51:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:30 smithi077 ceph-mon[27902]: pgmap v14385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:30 smithi191 ceph-mon[31636]: pgmap v14385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:30 smithi170 ceph-mon[31212]: pgmap v14385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:32 smithi170 ceph-mon[31212]: pgmap v14386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26803.846258 secs 2024-04-21T17:51:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:32 smithi077 ceph-mon[27902]: pgmap v14386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26803.846258 secs 2024-04-21T17:51:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:32 smithi191 ceph-mon[31636]: pgmap v14386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26803.846258 secs 2024-04-21T17:51:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26805.605805 secs 2024-04-21T17:51:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:34 smithi170 ceph-mon[31212]: pgmap v14387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26805.605805 secs 2024-04-21T17:51:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:34 smithi077 ceph-mon[27902]: pgmap v14387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26805.605805 secs 2024-04-21T17:51:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:34 smithi191 ceph-mon[31636]: pgmap v14387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:36 smithi170 ceph-mon[31212]: pgmap v14388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:36 smithi077 ceph-mon[27902]: pgmap v14388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:36 smithi191 ceph-mon[31636]: pgmap v14388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26808.846394 secs 2024-04-21T17:51:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26808.846394 secs 2024-04-21T17:51:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26808.846394 secs 2024-04-21T17:51:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:39 smithi170 ceph-mon[31212]: pgmap v14389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26810.605926 secs 2024-04-21T17:51:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:39 smithi077 ceph-mon[27902]: pgmap v14389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26810.605926 secs 2024-04-21T17:51:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:39 smithi191 ceph-mon[31636]: pgmap v14389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26810.605926 secs 2024-04-21T17:51:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 26995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:41 smithi170 ceph-mon[31212]: pgmap v14390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:41 smithi077 ceph-mon[27902]: pgmap v14390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:41 smithi191 ceph-mon[31636]: pgmap v14390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:43 smithi170 ceph-mon[31212]: pgmap v14391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26813.846527 secs 2024-04-21T17:51:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:43 smithi077 ceph-mon[27902]: pgmap v14391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26813.846527 secs 2024-04-21T17:51:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:43 smithi191 ceph-mon[31636]: pgmap v14391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26813.846527 secs 2024-04-21T17:51:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26815.606014 secs 2024-04-21T17:51:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:44 smithi170 ceph-mon[31212]: pgmap v14392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26815.606014 secs 2024-04-21T17:51:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:44 smithi077 ceph-mon[27902]: pgmap v14392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26815.606014 secs 2024-04-21T17:51:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:44 smithi191 ceph-mon[31636]: pgmap v14392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:46 smithi170 ceph-mon[31212]: pgmap v14393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:47.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:46 smithi077 ceph-mon[27902]: pgmap v14393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:46 smithi191 ceph-mon[31636]: pgmap v14393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:48.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26818.846664 secs 2024-04-21T17:51:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26818.846664 secs 2024-04-21T17:51:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26818.846664 secs 2024-04-21T17:51:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:48 smithi170 ceph-mon[31212]: pgmap v14394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:48 smithi077 ceph-mon[27902]: pgmap v14394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:48 smithi191 ceph-mon[31636]: pgmap v14394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:50.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26820.606138 secs 2024-04-21T17:51:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26820.606138 secs 2024-04-21T17:51:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26820.606138 secs 2024-04-21T17:51:51.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:51 smithi170 ceph-mon[31212]: pgmap v14395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:51 smithi077 ceph-mon[27902]: pgmap v14395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:51 smithi191 ceph-mon[31636]: pgmap v14395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:53.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:53 smithi170 ceph-mon[31212]: pgmap v14396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26823.846799 secs 2024-04-21T17:51:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:53 smithi077 ceph-mon[27902]: pgmap v14396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26823.846799 secs 2024-04-21T17:51:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:53 smithi191 ceph-mon[31636]: pgmap v14396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26823.846799 secs 2024-04-21T17:51:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:51:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26825.606210 secs 2024-04-21T17:51:55.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:55 smithi170 ceph-mon[31212]: pgmap v14397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26825.606210 secs 2024-04-21T17:51:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:55 smithi077 ceph-mon[27902]: pgmap v14397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26825.606210 secs 2024-04-21T17:51:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:55 smithi191 ceph-mon[31636]: pgmap v14397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:57.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:57 smithi170 ceph-mon[31212]: pgmap v14398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:57.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:57 smithi077 ceph-mon[27902]: pgmap v14398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:57 smithi191 ceph-mon[31636]: pgmap v14398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:51:58.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26828.846918 secs 2024-04-21T17:51:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26828.846918 secs 2024-04-21T17:51:58.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26828.846918 secs 2024-04-21T17:51:59.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:51:59 smithi170 ceph-mon[31212]: pgmap v14399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:51:59 smithi077 ceph-mon[27902]: pgmap v14399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:51:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:51:59 smithi191 ceph-mon[31636]: pgmap v14399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:00.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26830.606354 secs 2024-04-21T17:52:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26830.606354 secs 2024-04-21T17:52:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26830.606354 secs 2024-04-21T17:52:01.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:01 smithi170 ceph-mon[31212]: pgmap v14400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:01 smithi077 ceph-mon[27902]: pgmap v14400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:01.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:01 smithi191 ceph-mon[31636]: pgmap v14400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:03 smithi170 ceph-mon[31212]: pgmap v14401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26833.847037 secs 2024-04-21T17:52:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:03 smithi077 ceph-mon[27902]: pgmap v14401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26833.847037 secs 2024-04-21T17:52:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:03 smithi191 ceph-mon[31636]: pgmap v14401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26833.847037 secs 2024-04-21T17:52:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26835.606479 secs 2024-04-21T17:52:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:05 smithi170 ceph-mon[31212]: pgmap v14402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:05 smithi170 ceph-mon[31212]: osdmap e972: 12 total, 12 up, 12 in 2024-04-21T17:52:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26835.606479 secs 2024-04-21T17:52:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:05 smithi077 ceph-mon[27902]: pgmap v14402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:05 smithi077 ceph-mon[27902]: osdmap e972: 12 total, 12 up, 12 in 2024-04-21T17:52:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26835.606479 secs 2024-04-21T17:52:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:05 smithi191 ceph-mon[31636]: pgmap v14402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:05 smithi191 ceph-mon[31636]: osdmap e972: 12 total, 12 up, 12 in 2024-04-21T17:52:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:07 smithi170 ceph-mon[31212]: pgmap v14404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:52:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:07 smithi077 ceph-mon[27902]: pgmap v14404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:52:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:07 smithi191 ceph-mon[31636]: pgmap v14404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:52:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26838.847150 secs 2024-04-21T17:52:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:08 smithi170 ceph-mon[31212]: osdmap e973: 12 total, 12 up, 12 in 2024-04-21T17:52:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26838.847150 secs 2024-04-21T17:52:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:08 smithi077 ceph-mon[27902]: osdmap e973: 12 total, 12 up, 12 in 2024-04-21T17:52:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26838.847150 secs 2024-04-21T17:52:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:08 smithi191 ceph-mon[31636]: osdmap e973: 12 total, 12 up, 12 in 2024-04-21T17:52:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:09 smithi170 ceph-mon[31212]: pgmap v14406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:52:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26840.606594 secs 2024-04-21T17:52:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:09 smithi077 ceph-mon[27902]: pgmap v14406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:52:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26840.606594 secs 2024-04-21T17:52:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:09 smithi191 ceph-mon[31636]: pgmap v14406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:52:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26840.606594 secs 2024-04-21T17:52:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:11 smithi170 ceph-mon[31212]: pgmap v14407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:52:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:52:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:11 smithi077 ceph-mon[27902]: pgmap v14407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:52:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:52:11.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:11 smithi191 ceph-mon[31636]: pgmap v14407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:52:11.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: pgmap v14408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26843.847273 secs 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:52:12.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: pgmap v14408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26843.847273 secs 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:52:12.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: pgmap v14408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:52:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26843.847273 secs 2024-04-21T17:52:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:52:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:52:12.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:52:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26845.606712 secs 2024-04-21T17:52:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:14 smithi170 ceph-mon[31212]: pgmap v14409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:52:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26845.606712 secs 2024-04-21T17:52:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:14 smithi077 ceph-mon[27902]: pgmap v14409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:52:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26845.606712 secs 2024-04-21T17:52:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:14 smithi191 ceph-mon[31636]: pgmap v14409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:52:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:16 smithi170 ceph-mon[31212]: pgmap v14410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:52:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:16 smithi077 ceph-mon[27902]: pgmap v14410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:52:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:16 smithi191 ceph-mon[31636]: pgmap v14410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:52:18.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26848.847409 secs 2024-04-21T17:52:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26848.847409 secs 2024-04-21T17:52:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26848.847409 secs 2024-04-21T17:52:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:19 smithi170 ceph-mon[31212]: pgmap v14411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:52:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:19 smithi077 ceph-mon[27902]: pgmap v14411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:52:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:19 smithi191 ceph-mon[31636]: pgmap v14411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:52:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26850.606846 secs 2024-04-21T17:52:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26850.606846 secs 2024-04-21T17:52:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26850.606846 secs 2024-04-21T17:52:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:21 smithi170 ceph-mon[31212]: pgmap v14412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:52:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:21 smithi077 ceph-mon[27902]: pgmap v14412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:52:21.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:21 smithi191 ceph-mon[31636]: pgmap v14412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:52:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:23 smithi170 ceph-mon[31212]: pgmap v14413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:52:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26853.847526 secs 2024-04-21T17:52:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:23 smithi077 ceph-mon[27902]: pgmap v14413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:52:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26853.847526 secs 2024-04-21T17:52:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:23 smithi191 ceph-mon[31636]: pgmap v14413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:52:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26853.847526 secs 2024-04-21T17:52:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26855.606960 secs 2024-04-21T17:52:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:25 smithi170 ceph-mon[31212]: pgmap v14414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26855.606960 secs 2024-04-21T17:52:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:25 smithi077 ceph-mon[27902]: pgmap v14414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26855.606960 secs 2024-04-21T17:52:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:25 smithi191 ceph-mon[31636]: pgmap v14414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:27 smithi170 ceph-mon[31212]: pgmap v14415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:27.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:27 smithi077 ceph-mon[27902]: pgmap v14415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:27 smithi191 ceph-mon[31636]: pgmap v14415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26858.847643 secs 2024-04-21T17:52:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26858.847643 secs 2024-04-21T17:52:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26858.847643 secs 2024-04-21T17:52:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:29 smithi170 ceph-mon[31212]: pgmap v14416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:29.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:29 smithi077 ceph-mon[27902]: pgmap v14416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:29 smithi191 ceph-mon[31636]: pgmap v14416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26860.607093 secs 2024-04-21T17:52:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26860.607093 secs 2024-04-21T17:52:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26860.607093 secs 2024-04-21T17:52:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:31 smithi170 ceph-mon[31212]: pgmap v14417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:31.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:31 smithi077 ceph-mon[27902]: pgmap v14417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:31 smithi191 ceph-mon[31636]: pgmap v14417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:33 smithi170 ceph-mon[31212]: pgmap v14418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26863.847788 secs 2024-04-21T17:52:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:33 smithi077 ceph-mon[27902]: pgmap v14418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26863.847788 secs 2024-04-21T17:52:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:33 smithi191 ceph-mon[31636]: pgmap v14418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26863.847788 secs 2024-04-21T17:52:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26865.607182 secs 2024-04-21T17:52:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:35 smithi170 ceph-mon[31212]: pgmap v14419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26865.607182 secs 2024-04-21T17:52:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:35 smithi077 ceph-mon[27902]: pgmap v14419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26865.607182 secs 2024-04-21T17:52:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:35 smithi191 ceph-mon[31636]: pgmap v14419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:37 smithi170 ceph-mon[31212]: pgmap v14420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:37 smithi077 ceph-mon[27902]: pgmap v14420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:37 smithi191 ceph-mon[31636]: pgmap v14420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26868.847902 secs 2024-04-21T17:52:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26868.847902 secs 2024-04-21T17:52:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26868.847902 secs 2024-04-21T17:52:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:39 smithi170 ceph-mon[31212]: pgmap v14421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:39 smithi077 ceph-mon[27902]: pgmap v14421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:39 smithi191 ceph-mon[31636]: pgmap v14421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26870.607294 secs 2024-04-21T17:52:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26870.607294 secs 2024-04-21T17:52:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26870.607294 secs 2024-04-21T17:52:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:41 smithi077 ceph-mon[27902]: pgmap v14422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:41 smithi191 ceph-mon[31636]: pgmap v14422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:41 smithi170 ceph-mon[31212]: pgmap v14422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:43 smithi077 ceph-mon[27902]: pgmap v14423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26873.848020 secs 2024-04-21T17:52:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:43 smithi191 ceph-mon[31636]: pgmap v14423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26873.848020 secs 2024-04-21T17:52:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:43 smithi170 ceph-mon[31212]: pgmap v14423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26873.848020 secs 2024-04-21T17:52:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26875.607427 secs 2024-04-21T17:52:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:45 smithi077 ceph-mon[27902]: pgmap v14424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26875.607427 secs 2024-04-21T17:52:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:45 smithi191 ceph-mon[31636]: pgmap v14424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26875.607427 secs 2024-04-21T17:52:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:45 smithi170 ceph-mon[31212]: pgmap v14424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:47 smithi077 ceph-mon[27902]: pgmap v14425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:47 smithi191 ceph-mon[31636]: pgmap v14425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:47 smithi170 ceph-mon[31212]: pgmap v14425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:48.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26878.848140 secs 2024-04-21T17:52:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26878.848140 secs 2024-04-21T17:52:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26878.848140 secs 2024-04-21T17:52:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:49 smithi077 ceph-mon[27902]: pgmap v14426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:49 smithi191 ceph-mon[31636]: pgmap v14426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:49 smithi170 ceph-mon[31212]: pgmap v14426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26880.607561 secs 2024-04-21T17:52:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26880.607561 secs 2024-04-21T17:52:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26880.607561 secs 2024-04-21T17:52:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:51 smithi077 ceph-mon[27902]: pgmap v14427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:51 smithi191 ceph-mon[31636]: pgmap v14427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:51 smithi170 ceph-mon[31212]: pgmap v14427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:53 smithi077 ceph-mon[27902]: pgmap v14428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26883.848261 secs 2024-04-21T17:52:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:53 smithi191 ceph-mon[31636]: pgmap v14428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26883.848261 secs 2024-04-21T17:52:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:53 smithi170 ceph-mon[31212]: pgmap v14428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26883.848261 secs 2024-04-21T17:52:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:52:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26885.607689 secs 2024-04-21T17:52:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:55 smithi077 ceph-mon[27902]: pgmap v14429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26885.607689 secs 2024-04-21T17:52:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:55 smithi191 ceph-mon[31636]: pgmap v14429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26885.607689 secs 2024-04-21T17:52:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:55 smithi170 ceph-mon[31212]: pgmap v14429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:57 smithi077 ceph-mon[27902]: pgmap v14430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:57 smithi191 ceph-mon[31636]: pgmap v14430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:57 smithi170 ceph-mon[31212]: pgmap v14430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:52:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:52:58.071+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:52:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:52:58.071+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:52:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:52:58.072+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:52:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:52:58.072+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:52:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26888.848344 secs 2024-04-21T17:52:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26888.848344 secs 2024-04-21T17:52:58.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26888.848344 secs 2024-04-21T17:52:59.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:52:59 smithi077 ceph-mon[27902]: pgmap v14431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:52:59 smithi191 ceph-mon[31636]: pgmap v14431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:52:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:52:59 smithi170 ceph-mon[31212]: pgmap v14431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26890.607822 secs 2024-04-21T17:53:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26890.607822 secs 2024-04-21T17:53:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26890.607822 secs 2024-04-21T17:53:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:01 smithi077 ceph-mon[27902]: pgmap v14432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:01 smithi191 ceph-mon[31636]: pgmap v14432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:01 smithi170 ceph-mon[31212]: pgmap v14432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:03 smithi077 ceph-mon[27902]: pgmap v14433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26893.848457 secs 2024-04-21T17:53:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:03 smithi191 ceph-mon[31636]: pgmap v14433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26893.848457 secs 2024-04-21T17:53:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:03 smithi170 ceph-mon[31212]: pgmap v14433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26893.848457 secs 2024-04-21T17:53:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26895.607955 secs 2024-04-21T17:53:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:05 smithi077 ceph-mon[27902]: pgmap v14434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:05 smithi077 ceph-mon[27902]: osdmap e974: 12 total, 12 up, 12 in 2024-04-21T17:53:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26895.607955 secs 2024-04-21T17:53:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:05 smithi191 ceph-mon[31636]: pgmap v14434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:05 smithi191 ceph-mon[31636]: osdmap e974: 12 total, 12 up, 12 in 2024-04-21T17:53:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26895.607955 secs 2024-04-21T17:53:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:05 smithi170 ceph-mon[31212]: pgmap v14434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:05 smithi170 ceph-mon[31212]: osdmap e974: 12 total, 12 up, 12 in 2024-04-21T17:53:07.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:07 smithi077 ceph-mon[27902]: pgmap v14436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:53:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:07 smithi191 ceph-mon[31636]: pgmap v14436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:53:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:07 smithi170 ceph-mon[31212]: pgmap v14436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:53:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26898.848593 secs 2024-04-21T17:53:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:08 smithi170 ceph-mon[31212]: osdmap e975: 12 total, 12 up, 12 in 2024-04-21T17:53:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26898.848593 secs 2024-04-21T17:53:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:08 smithi077 ceph-mon[27902]: osdmap e975: 12 total, 12 up, 12 in 2024-04-21T17:53:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26898.848593 secs 2024-04-21T17:53:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:08 smithi191 ceph-mon[31636]: osdmap e975: 12 total, 12 up, 12 in 2024-04-21T17:53:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:09 smithi170 ceph-mon[31212]: pgmap v14438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:53:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26900.608067 secs 2024-04-21T17:53:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:09 smithi077 ceph-mon[27902]: pgmap v14438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:53:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26900.608067 secs 2024-04-21T17:53:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:09 smithi191 ceph-mon[31636]: pgmap v14438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:53:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26900.608067 secs 2024-04-21T17:53:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:11.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:11 smithi170 ceph-mon[31212]: pgmap v14439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:53:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:11 smithi077 ceph-mon[27902]: pgmap v14439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:53:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:11 smithi191 ceph-mon[31636]: pgmap v14439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:53:12.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:53:12.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:53:12.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:53:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:13 smithi170 ceph-mon[31212]: pgmap v14440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:53:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26903.848717 secs 2024-04-21T17:53:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:13 smithi077 ceph-mon[27902]: pgmap v14440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:53:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26903.848717 secs 2024-04-21T17:53:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:13 smithi191 ceph-mon[31636]: pgmap v14440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:53:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26903.848717 secs 2024-04-21T17:53:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26905.608183 secs 2024-04-21T17:53:14.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:14 smithi170 ceph-mon[31212]: pgmap v14441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:53:14.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:53:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:53:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26905.608183 secs 2024-04-21T17:53:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:14 smithi077 ceph-mon[27902]: pgmap v14441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:53:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:53:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:53:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:53:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26905.608183 secs 2024-04-21T17:53:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:14 smithi191 ceph-mon[31636]: pgmap v14441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:53:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:17 smithi170 ceph-mon[31212]: pgmap v14442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T17:53:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:17 smithi077 ceph-mon[27902]: pgmap v14442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T17:53:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:17 smithi191 ceph-mon[31636]: pgmap v14442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T17:53:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26908.848837 secs 2024-04-21T17:53:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26908.848837 secs 2024-04-21T17:53:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26908.848837 secs 2024-04-21T17:53:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:19 smithi170 ceph-mon[31212]: pgmap v14443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:53:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26910.608271 secs 2024-04-21T17:53:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:19 smithi077 ceph-mon[27902]: pgmap v14443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:53:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26910.608271 secs 2024-04-21T17:53:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:19 smithi191 ceph-mon[31636]: pgmap v14443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:53:19.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26910.608271 secs 2024-04-21T17:53:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:21 smithi170 ceph-mon[31212]: pgmap v14444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T17:53:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:21 smithi077 ceph-mon[27902]: pgmap v14444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T17:53:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:21 smithi191 ceph-mon[31636]: pgmap v14444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T17:53:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:23 smithi170 ceph-mon[31212]: pgmap v14445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:53:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26913.848948 secs 2024-04-21T17:53:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:23 smithi077 ceph-mon[27902]: pgmap v14445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:53:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26913.848948 secs 2024-04-21T17:53:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:23 smithi191 ceph-mon[31636]: pgmap v14445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:53:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26913.848948 secs 2024-04-21T17:53:24.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26915.608388 secs 2024-04-21T17:53:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26915.608388 secs 2024-04-21T17:53:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26915.608388 secs 2024-04-21T17:53:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:25 smithi170 ceph-mon[31212]: pgmap v14446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:25 smithi077 ceph-mon[27902]: pgmap v14446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:25 smithi191 ceph-mon[31636]: pgmap v14446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:26 smithi170 ceph-mon[31212]: pgmap v14447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:26 smithi077 ceph-mon[27902]: pgmap v14447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:26 smithi191 ceph-mon[31636]: pgmap v14447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26918.849091 secs 2024-04-21T17:53:27.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26918.849091 secs 2024-04-21T17:53:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26918.849091 secs 2024-04-21T17:53:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:28 smithi170 ceph-mon[31212]: pgmap v14448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:28 smithi191 ceph-mon[31636]: pgmap v14448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:28 smithi077 ceph-mon[27902]: pgmap v14448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26920.608509 secs 2024-04-21T17:53:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26920.608509 secs 2024-04-21T17:53:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26920.608509 secs 2024-04-21T17:53:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:30 smithi170 ceph-mon[31212]: pgmap v14449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:30 smithi077 ceph-mon[27902]: pgmap v14449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:30 smithi191 ceph-mon[31636]: pgmap v14449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:33 smithi170 ceph-mon[31212]: pgmap v14450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26923.849203 secs 2024-04-21T17:53:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:33 smithi077 ceph-mon[27902]: pgmap v14450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26923.849203 secs 2024-04-21T17:53:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:33 smithi191 ceph-mon[31636]: pgmap v14450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26923.849203 secs 2024-04-21T17:53:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26925.608622 secs 2024-04-21T17:53:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:35 smithi170 ceph-mon[31212]: pgmap v14451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26925.608622 secs 2024-04-21T17:53:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:35 smithi077 ceph-mon[27902]: pgmap v14451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26925.608622 secs 2024-04-21T17:53:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:35 smithi191 ceph-mon[31636]: pgmap v14451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:37 smithi170 ceph-mon[31212]: pgmap v14452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:37 smithi077 ceph-mon[27902]: pgmap v14452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:37 smithi191 ceph-mon[31636]: pgmap v14452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26928.849287 secs 2024-04-21T17:53:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26928.849287 secs 2024-04-21T17:53:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26928.849287 secs 2024-04-21T17:53:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:39 smithi170 ceph-mon[31212]: pgmap v14453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:39 smithi077 ceph-mon[27902]: pgmap v14453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:39 smithi191 ceph-mon[31636]: pgmap v14453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26930.608732 secs 2024-04-21T17:53:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26930.608732 secs 2024-04-21T17:53:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26930.608732 secs 2024-04-21T17:53:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:41 smithi170 ceph-mon[31212]: pgmap v14454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:41 smithi077 ceph-mon[27902]: pgmap v14454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:41 smithi191 ceph-mon[31636]: pgmap v14454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:43 smithi170 ceph-mon[31212]: pgmap v14455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:43.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26933.849380 secs 2024-04-21T17:53:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:43 smithi077 ceph-mon[27902]: pgmap v14455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26933.849380 secs 2024-04-21T17:53:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:43 smithi191 ceph-mon[31636]: pgmap v14455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26933.849380 secs 2024-04-21T17:53:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26935.608876 secs 2024-04-21T17:53:45.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:45 smithi170 ceph-mon[31212]: pgmap v14456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26935.608876 secs 2024-04-21T17:53:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:45 smithi077 ceph-mon[27902]: pgmap v14456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26935.608876 secs 2024-04-21T17:53:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:45 smithi191 ceph-mon[31636]: pgmap v14456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:47.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:47 smithi170 ceph-mon[31212]: pgmap v14457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:47 smithi077 ceph-mon[27902]: pgmap v14457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:47 smithi191 ceph-mon[31636]: pgmap v14457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:48.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26938.849491 secs 2024-04-21T17:53:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26938.849491 secs 2024-04-21T17:53:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26938.849491 secs 2024-04-21T17:53:49.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:49 smithi170 ceph-mon[31212]: pgmap v14458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:49.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:49 smithi077 ceph-mon[27902]: pgmap v14458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:49 smithi191 ceph-mon[31636]: pgmap v14458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26940.608961 secs 2024-04-21T17:53:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26940.608961 secs 2024-04-21T17:53:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26940.608961 secs 2024-04-21T17:53:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:51 smithi077 ceph-mon[27902]: pgmap v14459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:51 smithi191 ceph-mon[31636]: pgmap v14459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:51 smithi170 ceph-mon[31212]: pgmap v14459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:53 smithi077 ceph-mon[27902]: pgmap v14460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26943.849607 secs 2024-04-21T17:53:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:53 smithi191 ceph-mon[31636]: pgmap v14460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26943.849607 secs 2024-04-21T17:53:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:53 smithi170 ceph-mon[31212]: pgmap v14460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26943.849607 secs 2024-04-21T17:53:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:53:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26945.609064 secs 2024-04-21T17:53:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:55 smithi077 ceph-mon[27902]: pgmap v14461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26945.609064 secs 2024-04-21T17:53:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:55 smithi191 ceph-mon[31636]: pgmap v14461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26945.609064 secs 2024-04-21T17:53:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:55 smithi170 ceph-mon[31212]: pgmap v14461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:57 smithi077 ceph-mon[27902]: pgmap v14462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:57 smithi191 ceph-mon[31636]: pgmap v14462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:57 smithi170 ceph-mon[31212]: pgmap v14462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:53:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26948.849748 secs 2024-04-21T17:53:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26948.849748 secs 2024-04-21T17:53:58.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26948.849748 secs 2024-04-21T17:53:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:53:59 smithi077 ceph-mon[27902]: pgmap v14463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:53:59 smithi191 ceph-mon[31636]: pgmap v14463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:53:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:53:59 smithi170 ceph-mon[31212]: pgmap v14463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26950.609194 secs 2024-04-21T17:54:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26950.609194 secs 2024-04-21T17:54:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26950.609194 secs 2024-04-21T17:54:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:01 smithi077 ceph-mon[27902]: pgmap v14464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:01 smithi191 ceph-mon[31636]: pgmap v14464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:01 smithi170 ceph-mon[31212]: pgmap v14464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:03 smithi077 ceph-mon[27902]: pgmap v14465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T17:54:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26953.849863 secs 2024-04-21T17:54:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:03 smithi191 ceph-mon[31636]: pgmap v14465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T17:54:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26953.849863 secs 2024-04-21T17:54:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:03 smithi170 ceph-mon[31212]: pgmap v14465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T17:54:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26953.849863 secs 2024-04-21T17:54:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26955.609319 secs 2024-04-21T17:54:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:05 smithi077 ceph-mon[27902]: pgmap v14466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T17:54:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:05 smithi077 ceph-mon[27902]: osdmap e976: 12 total, 12 up, 12 in 2024-04-21T17:54:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26955.609319 secs 2024-04-21T17:54:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:05 smithi191 ceph-mon[31636]: pgmap v14466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T17:54:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:05 smithi191 ceph-mon[31636]: osdmap e976: 12 total, 12 up, 12 in 2024-04-21T17:54:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26955.609319 secs 2024-04-21T17:54:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:05 smithi170 ceph-mon[31212]: pgmap v14466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-04-21T17:54:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:05 smithi170 ceph-mon[31212]: osdmap e976: 12 total, 12 up, 12 in 2024-04-21T17:54:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:07 smithi077 ceph-mon[27902]: pgmap v14468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:54:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:07 smithi191 ceph-mon[31636]: pgmap v14468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:54:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:07 smithi170 ceph-mon[31212]: pgmap v14468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:54:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26958.849988 secs 2024-04-21T17:54:08.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:08 smithi170 ceph-mon[31212]: osdmap e977: 12 total, 12 up, 12 in 2024-04-21T17:54:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26958.849988 secs 2024-04-21T17:54:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:08 smithi077 ceph-mon[27902]: osdmap e977: 12 total, 12 up, 12 in 2024-04-21T17:54:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26958.849988 secs 2024-04-21T17:54:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:08 smithi191 ceph-mon[31636]: osdmap e977: 12 total, 12 up, 12 in 2024-04-21T17:54:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:09 smithi170 ceph-mon[31212]: pgmap v14470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:54:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26960.609422 secs 2024-04-21T17:54:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:09 smithi077 ceph-mon[27902]: pgmap v14470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:54:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26960.609422 secs 2024-04-21T17:54:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:09 smithi191 ceph-mon[31636]: pgmap v14470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:54:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26960.609422 secs 2024-04-21T17:54:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:10.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:10 smithi170 ceph-mon[31212]: pgmap v14471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T17:54:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:10 smithi077 ceph-mon[27902]: pgmap v14471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T17:54:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:10 smithi191 ceph-mon[31636]: pgmap v14471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T17:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:13 smithi170 ceph-mon[31212]: pgmap v14472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-04-21T17:54:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26963.850135 secs 2024-04-21T17:54:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:13 smithi077 ceph-mon[27902]: pgmap v14472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-04-21T17:54:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26963.850135 secs 2024-04-21T17:54:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:13 smithi191 ceph-mon[31636]: pgmap v14472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-04-21T17:54:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26963.850135 secs 2024-04-21T17:54:14.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:54:14.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:54:14.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:54:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26965.609512 secs 2024-04-21T17:54:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:15 smithi170 ceph-mon[31212]: pgmap v14473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-04-21T17:54:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:54:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:54:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:54:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26965.609512 secs 2024-04-21T17:54:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:15 smithi077 ceph-mon[27902]: pgmap v14473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-04-21T17:54:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:54:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:54:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:54:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26965.609512 secs 2024-04-21T17:54:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:15 smithi191 ceph-mon[31636]: pgmap v14473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-04-21T17:54:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:54:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:54:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:54:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:17 smithi170 ceph-mon[31212]: pgmap v14474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:54:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:17 smithi077 ceph-mon[27902]: pgmap v14474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:54:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:17 smithi191 ceph-mon[31636]: pgmap v14474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:54:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26968.850215 secs 2024-04-21T17:54:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26968.850215 secs 2024-04-21T17:54:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26968.850215 secs 2024-04-21T17:54:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:19 smithi170 ceph-mon[31212]: pgmap v14475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:54:19.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:19 smithi077 ceph-mon[27902]: pgmap v14475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:54:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:19 smithi191 ceph-mon[31636]: pgmap v14475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:54:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26970.609648 secs 2024-04-21T17:54:20.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26970.609648 secs 2024-04-21T17:54:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26970.609648 secs 2024-04-21T17:54:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:21 smithi170 ceph-mon[31212]: pgmap v14476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:54:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:21 smithi077 ceph-mon[27902]: pgmap v14476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:54:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:21 smithi191 ceph-mon[31636]: pgmap v14476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:54:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:23 smithi077 ceph-mon[27902]: pgmap v14477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:54:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26973.850325 secs 2024-04-21T17:54:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:23 smithi191 ceph-mon[31636]: pgmap v14477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:54:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26973.850325 secs 2024-04-21T17:54:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:23 smithi170 ceph-mon[31212]: pgmap v14477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:54:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26973.850325 secs 2024-04-21T17:54:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26975.609797 secs 2024-04-21T17:54:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:25 smithi077 ceph-mon[27902]: pgmap v14478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26975.609797 secs 2024-04-21T17:54:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:25 smithi191 ceph-mon[31636]: pgmap v14478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26975.609797 secs 2024-04-21T17:54:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:25 smithi170 ceph-mon[31212]: pgmap v14478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:27 smithi077 ceph-mon[27902]: pgmap v14479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:27 smithi191 ceph-mon[31636]: pgmap v14479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:27 smithi170 ceph-mon[31212]: pgmap v14479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:54:28.084+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:54:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:54:28.084+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:54:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:54:28.084+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:54:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:54:28.084+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:54:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26978.850404 secs 2024-04-21T17:54:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26978.850404 secs 2024-04-21T17:54:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26978.850404 secs 2024-04-21T17:54:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:29 smithi077 ceph-mon[27902]: pgmap v14480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:29 smithi191 ceph-mon[31636]: pgmap v14480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:29 smithi170 ceph-mon[31212]: pgmap v14480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26980.609958 secs 2024-04-21T17:54:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26980.609958 secs 2024-04-21T17:54:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26980.609958 secs 2024-04-21T17:54:31.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:31 smithi077 ceph-mon[27902]: pgmap v14481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:31 smithi191 ceph-mon[31636]: pgmap v14481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:31 smithi170 ceph-mon[31212]: pgmap v14481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:33 smithi077 ceph-mon[27902]: pgmap v14482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26983.850540 secs 2024-04-21T17:54:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:33 smithi191 ceph-mon[31636]: pgmap v14482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26983.850540 secs 2024-04-21T17:54:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:33 smithi170 ceph-mon[31212]: pgmap v14482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26983.850540 secs 2024-04-21T17:54:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26985.610070 secs 2024-04-21T17:54:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:35 smithi077 ceph-mon[27902]: pgmap v14483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26985.610070 secs 2024-04-21T17:54:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:35 smithi191 ceph-mon[31636]: pgmap v14483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26985.610070 secs 2024-04-21T17:54:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:35 smithi170 ceph-mon[31212]: pgmap v14483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:37.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:37 smithi077 ceph-mon[27902]: pgmap v14484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:37 smithi191 ceph-mon[31636]: pgmap v14484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:37 smithi170 ceph-mon[31212]: pgmap v14484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26988.850676 secs 2024-04-21T17:54:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26988.850676 secs 2024-04-21T17:54:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26988.850676 secs 2024-04-21T17:54:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:39 smithi077 ceph-mon[27902]: pgmap v14485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:39 smithi191 ceph-mon[31636]: pgmap v14485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:39 smithi170 ceph-mon[31212]: pgmap v14485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26990.610167 secs 2024-04-21T17:54:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26990.610167 secs 2024-04-21T17:54:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26990.610167 secs 2024-04-21T17:54:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:41 smithi077 ceph-mon[27902]: pgmap v14486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:41 smithi191 ceph-mon[31636]: pgmap v14486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:41 smithi170 ceph-mon[31212]: pgmap v14486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26993.850829 secs 2024-04-21T17:54:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:43 smithi077 ceph-mon[27902]: pgmap v14487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26993.850829 secs 2024-04-21T17:54:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:43 smithi191 ceph-mon[31636]: pgmap v14487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26993.850829 secs 2024-04-21T17:54:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:43 smithi170 ceph-mon[31212]: pgmap v14487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 26995.610280 secs 2024-04-21T17:54:45.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:45 smithi077 ceph-mon[27902]: pgmap v14488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 26995.610280 secs 2024-04-21T17:54:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:45 smithi191 ceph-mon[31636]: pgmap v14488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 26995.610280 secs 2024-04-21T17:54:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:45 smithi170 ceph-mon[31212]: pgmap v14488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:47 smithi077 ceph-mon[27902]: pgmap v14489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:47 smithi191 ceph-mon[31636]: pgmap v14489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:47 smithi170 ceph-mon[31212]: pgmap v14489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 26998.850940 secs 2024-04-21T17:54:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 26998.850940 secs 2024-04-21T17:54:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 26998.850940 secs 2024-04-21T17:54:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:49 smithi077 ceph-mon[27902]: pgmap v14490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:49 smithi191 ceph-mon[31636]: pgmap v14490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:49 smithi170 ceph-mon[31212]: pgmap v14490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27000.610396 secs 2024-04-21T17:54:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27000.610396 secs 2024-04-21T17:54:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27000.610396 secs 2024-04-21T17:54:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:51 smithi077 ceph-mon[27902]: pgmap v14491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:51 smithi191 ceph-mon[31636]: pgmap v14491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:51 smithi170 ceph-mon[31212]: pgmap v14491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27003.851057 secs 2024-04-21T17:54:53.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:53 smithi077 ceph-mon[27902]: pgmap v14492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27003.851057 secs 2024-04-21T17:54:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:53 smithi191 ceph-mon[31636]: pgmap v14492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27003.851057 secs 2024-04-21T17:54:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:53 smithi170 ceph-mon[31212]: pgmap v14492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:54:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27005.610494 secs 2024-04-21T17:54:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:55 smithi077 ceph-mon[27902]: pgmap v14493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27005.610494 secs 2024-04-21T17:54:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:55 smithi191 ceph-mon[31636]: pgmap v14493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27005.610494 secs 2024-04-21T17:54:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:55 smithi170 ceph-mon[31212]: pgmap v14493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:57 smithi191 ceph-mon[31636]: pgmap v14494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:57 smithi170 ceph-mon[31212]: pgmap v14494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:57 smithi077 ceph-mon[27902]: pgmap v14494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:54:58.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27008.851123 secs 2024-04-21T17:54:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27008.851123 secs 2024-04-21T17:54:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27008.851123 secs 2024-04-21T17:54:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:54:59 smithi191 ceph-mon[31636]: pgmap v14495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:54:59 smithi170 ceph-mon[31212]: pgmap v14495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:54:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:54:59 smithi077 ceph-mon[27902]: pgmap v14495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27010.610640 secs 2024-04-21T17:55:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27010.610640 secs 2024-04-21T17:55:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27010.610640 secs 2024-04-21T17:55:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:01 smithi191 ceph-mon[31636]: pgmap v14496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:01 smithi170 ceph-mon[31212]: pgmap v14496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:01 smithi077 ceph-mon[27902]: pgmap v14496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27013.851256 secs 2024-04-21T17:55:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:03 smithi191 ceph-mon[31636]: pgmap v14497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27013.851256 secs 2024-04-21T17:55:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:03 smithi170 ceph-mon[31212]: pgmap v14497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27013.851256 secs 2024-04-21T17:55:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:03 smithi077 ceph-mon[27902]: pgmap v14497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27015.610733 secs 2024-04-21T17:55:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:05 smithi191 ceph-mon[31636]: pgmap v14498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:05 smithi191 ceph-mon[31636]: osdmap e978: 12 total, 12 up, 12 in 2024-04-21T17:55:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27015.610733 secs 2024-04-21T17:55:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:05 smithi170 ceph-mon[31212]: pgmap v14498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:05 smithi170 ceph-mon[31212]: osdmap e978: 12 total, 12 up, 12 in 2024-04-21T17:55:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27015.610733 secs 2024-04-21T17:55:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:05 smithi077 ceph-mon[27902]: pgmap v14498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:05 smithi077 ceph-mon[27902]: osdmap e978: 12 total, 12 up, 12 in 2024-04-21T17:55:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:07 smithi191 ceph-mon[31636]: pgmap v14500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:55:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:07 smithi170 ceph-mon[31212]: pgmap v14500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:55:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:07 smithi077 ceph-mon[27902]: pgmap v14500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:55:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27018.851399 secs 2024-04-21T17:55:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:08 smithi077 ceph-mon[27902]: osdmap e979: 12 total, 12 up, 12 in 2024-04-21T17:55:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27018.851399 secs 2024-04-21T17:55:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:08 smithi191 ceph-mon[31636]: osdmap e979: 12 total, 12 up, 12 in 2024-04-21T17:55:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27018.851399 secs 2024-04-21T17:55:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:08 smithi170 ceph-mon[31212]: osdmap e979: 12 total, 12 up, 12 in 2024-04-21T17:55:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:09 smithi077 ceph-mon[27902]: pgmap v14502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:55:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27020.610829 secs 2024-04-21T17:55:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:09 smithi191 ceph-mon[31636]: pgmap v14502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:55:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27020.610829 secs 2024-04-21T17:55:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:09 smithi170 ceph-mon[31212]: pgmap v14502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:55:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27020.610829 secs 2024-04-21T17:55:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:10 smithi077 ceph-mon[27902]: pgmap v14503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:55:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:10 smithi191 ceph-mon[31636]: pgmap v14503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:55:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:10 smithi170 ceph-mon[31212]: pgmap v14503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:55:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27023.851508 secs 2024-04-21T17:55:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:13 smithi170 ceph-mon[31212]: pgmap v14504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:55:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27023.851508 secs 2024-04-21T17:55:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:13 smithi077 ceph-mon[27902]: pgmap v14504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:55:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27023.851508 secs 2024-04-21T17:55:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:13 smithi191 ceph-mon[31636]: pgmap v14504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:55:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27025.610928 secs 2024-04-21T17:55:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:15 smithi170 ceph-mon[31212]: pgmap v14505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:55:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:55:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:55:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:55:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:55:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27025.610928 secs 2024-04-21T17:55:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:15 smithi077 ceph-mon[27902]: pgmap v14505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:55:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:55:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:55:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:55:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:55:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27025.610928 secs 2024-04-21T17:55:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:15 smithi191 ceph-mon[31636]: pgmap v14505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:55:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:55:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:55:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:55:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:55:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:17 smithi170 ceph-mon[31212]: pgmap v14506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:55:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:17 smithi077 ceph-mon[27902]: pgmap v14506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:55:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:17 smithi191 ceph-mon[31636]: pgmap v14506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:55:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27028.851659 secs 2024-04-21T17:55:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27028.851659 secs 2024-04-21T17:55:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27028.851659 secs 2024-04-21T17:55:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:19 smithi077 ceph-mon[27902]: pgmap v14507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:55:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:19 smithi191 ceph-mon[31636]: pgmap v14507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:55:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:19 smithi170 ceph-mon[31212]: pgmap v14507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:55:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27030.611052 secs 2024-04-21T17:55:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27030.611052 secs 2024-04-21T17:55:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27030.611052 secs 2024-04-21T17:55:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:21 smithi077 ceph-mon[27902]: pgmap v14508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:55:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:21 smithi191 ceph-mon[31636]: pgmap v14508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:55:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:21 smithi170 ceph-mon[31212]: pgmap v14508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:55:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27033.851776 secs 2024-04-21T17:55:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:23 smithi077 ceph-mon[27902]: pgmap v14509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:55:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27033.851776 secs 2024-04-21T17:55:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:23 smithi191 ceph-mon[31636]: pgmap v14509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:55:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27033.851776 secs 2024-04-21T17:55:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:23 smithi170 ceph-mon[31212]: pgmap v14509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:55:24.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27035.611173 secs 2024-04-21T17:55:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27035.611173 secs 2024-04-21T17:55:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27035.611173 secs 2024-04-21T17:55:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:25 smithi077 ceph-mon[27902]: pgmap v14510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:25 smithi191 ceph-mon[31636]: pgmap v14510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:25 smithi170 ceph-mon[31212]: pgmap v14510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:26 smithi077 ceph-mon[27902]: pgmap v14511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:26.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:26 smithi191 ceph-mon[31636]: pgmap v14511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:26.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:26 smithi170 ceph-mon[31212]: pgmap v14511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27038.851870 secs 2024-04-21T17:55:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27038.851870 secs 2024-04-21T17:55:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27038.851870 secs 2024-04-21T17:55:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:28 smithi170 ceph-mon[31212]: pgmap v14512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:28 smithi191 ceph-mon[31636]: pgmap v14512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:28 smithi077 ceph-mon[27902]: pgmap v14512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27040.611251 secs 2024-04-21T17:55:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27040.611251 secs 2024-04-21T17:55:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27040.611251 secs 2024-04-21T17:55:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:30 smithi170 ceph-mon[31212]: pgmap v14513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:30 smithi077 ceph-mon[27902]: pgmap v14513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:30 smithi191 ceph-mon[31636]: pgmap v14513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27043.851993 secs 2024-04-21T17:55:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:33 smithi170 ceph-mon[31212]: pgmap v14514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27043.851993 secs 2024-04-21T17:55:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:33 smithi077 ceph-mon[27902]: pgmap v14514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27043.851993 secs 2024-04-21T17:55:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:33 smithi191 ceph-mon[31636]: pgmap v14514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27045.611369 secs 2024-04-21T17:55:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:35 smithi170 ceph-mon[31212]: pgmap v14515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27045.611369 secs 2024-04-21T17:55:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:35 smithi077 ceph-mon[27902]: pgmap v14515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27045.611369 secs 2024-04-21T17:55:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:35 smithi191 ceph-mon[31636]: pgmap v14515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:37 smithi077 ceph-mon[27902]: pgmap v14516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:37 smithi191 ceph-mon[31636]: pgmap v14516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:37 smithi170 ceph-mon[31212]: pgmap v14516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27048.852057 secs 2024-04-21T17:55:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27048.852057 secs 2024-04-21T17:55:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27048.852057 secs 2024-04-21T17:55:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:39 smithi077 ceph-mon[27902]: pgmap v14517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:39 smithi191 ceph-mon[31636]: pgmap v14517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:39 smithi170 ceph-mon[31212]: pgmap v14517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:40.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27050.611461 secs 2024-04-21T17:55:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27050.611461 secs 2024-04-21T17:55:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27050.611461 secs 2024-04-21T17:55:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:41 smithi077 ceph-mon[27902]: pgmap v14518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:41 smithi191 ceph-mon[31636]: pgmap v14518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:41 smithi170 ceph-mon[31212]: pgmap v14518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27053.852152 secs 2024-04-21T17:55:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:43 smithi077 ceph-mon[27902]: pgmap v14519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27053.852152 secs 2024-04-21T17:55:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:43 smithi191 ceph-mon[31636]: pgmap v14519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27053.852152 secs 2024-04-21T17:55:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:43 smithi170 ceph-mon[31212]: pgmap v14519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27055.611577 secs 2024-04-21T17:55:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:45 smithi077 ceph-mon[27902]: pgmap v14520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27055.611577 secs 2024-04-21T17:55:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:45 smithi191 ceph-mon[31636]: pgmap v14520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27055.611577 secs 2024-04-21T17:55:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:45 smithi170 ceph-mon[31212]: pgmap v14520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:47.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:47 smithi077 ceph-mon[27902]: pgmap v14521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:47 smithi191 ceph-mon[31636]: pgmap v14521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:47 smithi170 ceph-mon[31212]: pgmap v14521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27058.852271 secs 2024-04-21T17:55:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27058.852271 secs 2024-04-21T17:55:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27058.852271 secs 2024-04-21T17:55:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:49 smithi077 ceph-mon[27902]: pgmap v14522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:49 smithi191 ceph-mon[31636]: pgmap v14522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:49 smithi170 ceph-mon[31212]: pgmap v14522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:50.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27060.611666 secs 2024-04-21T17:55:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27060.611666 secs 2024-04-21T17:55:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27060.611666 secs 2024-04-21T17:55:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:51 smithi077 ceph-mon[27902]: pgmap v14523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:51 smithi191 ceph-mon[31636]: pgmap v14523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:51 smithi170 ceph-mon[31212]: pgmap v14523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27063.852410 secs 2024-04-21T17:55:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:53 smithi077 ceph-mon[27902]: pgmap v14524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27063.852410 secs 2024-04-21T17:55:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:53 smithi191 ceph-mon[31636]: pgmap v14524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27063.852410 secs 2024-04-21T17:55:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:53 smithi170 ceph-mon[31212]: pgmap v14524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:55:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27065.611781 secs 2024-04-21T17:55:55.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:55 smithi077 ceph-mon[27902]: pgmap v14525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27065.611781 secs 2024-04-21T17:55:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:55 smithi191 ceph-mon[31636]: pgmap v14525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27065.611781 secs 2024-04-21T17:55:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:55 smithi170 ceph-mon[31212]: pgmap v14525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:57 smithi077 ceph-mon[27902]: pgmap v14526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:57 smithi191 ceph-mon[31636]: pgmap v14526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:57 smithi170 ceph-mon[31212]: pgmap v14526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:55:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:55:58.096+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:55:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:55:58.096+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:55:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:55:58.096+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:55:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:55:58.096+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:55:58.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27068.852515 secs 2024-04-21T17:55:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27068.852515 secs 2024-04-21T17:55:58.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27068.852515 secs 2024-04-21T17:55:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:55:59 smithi077 ceph-mon[27902]: pgmap v14527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:55:59 smithi191 ceph-mon[31636]: pgmap v14527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:55:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:55:59 smithi170 ceph-mon[31212]: pgmap v14527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27070.611880 secs 2024-04-21T17:56:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27070.611880 secs 2024-04-21T17:56:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27070.611880 secs 2024-04-21T17:56:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:01 smithi077 ceph-mon[27902]: pgmap v14528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:01 smithi191 ceph-mon[31636]: pgmap v14528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:01 smithi170 ceph-mon[31212]: pgmap v14528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27073.852650 secs 2024-04-21T17:56:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:03 smithi077 ceph-mon[27902]: pgmap v14529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27073.852650 secs 2024-04-21T17:56:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:03 smithi191 ceph-mon[31636]: pgmap v14529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27073.852650 secs 2024-04-21T17:56:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:03 smithi170 ceph-mon[31212]: pgmap v14529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27075.612003 secs 2024-04-21T17:56:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:05 smithi077 ceph-mon[27902]: pgmap v14530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:05 smithi077 ceph-mon[27902]: osdmap e980: 12 total, 12 up, 12 in 2024-04-21T17:56:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27075.612003 secs 2024-04-21T17:56:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:05 smithi191 ceph-mon[31636]: pgmap v14530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:05 smithi191 ceph-mon[31636]: osdmap e980: 12 total, 12 up, 12 in 2024-04-21T17:56:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27075.612003 secs 2024-04-21T17:56:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:05 smithi170 ceph-mon[31212]: pgmap v14530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:05 smithi170 ceph-mon[31212]: osdmap e980: 12 total, 12 up, 12 in 2024-04-21T17:56:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:07 smithi191 ceph-mon[31636]: pgmap v14532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:56:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:07 smithi170 ceph-mon[31212]: pgmap v14532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:56:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:07 smithi077 ceph-mon[27902]: pgmap v14532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:56:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27078.852784 secs 2024-04-21T17:56:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:08 smithi077 ceph-mon[27902]: osdmap e981: 12 total, 12 up, 12 in 2024-04-21T17:56:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:08 smithi077 ceph-mon[27902]: pgmap v14534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:56:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27078.852784 secs 2024-04-21T17:56:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:08 smithi191 ceph-mon[31636]: osdmap e981: 12 total, 12 up, 12 in 2024-04-21T17:56:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:08 smithi191 ceph-mon[31636]: pgmap v14534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:56:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27078.852784 secs 2024-04-21T17:56:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:08 smithi170 ceph-mon[31212]: osdmap e981: 12 total, 12 up, 12 in 2024-04-21T17:56:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:08 smithi170 ceph-mon[31212]: pgmap v14534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:56:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27080.612123 secs 2024-04-21T17:56:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27080.612123 secs 2024-04-21T17:56:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27080.612123 secs 2024-04-21T17:56:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:10 smithi077 ceph-mon[27902]: pgmap v14535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:56:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:10 smithi191 ceph-mon[31636]: pgmap v14535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:56:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:10 smithi170 ceph-mon[31212]: pgmap v14535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:56:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27083.852903 secs 2024-04-21T17:56:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:13 smithi077 ceph-mon[27902]: pgmap v14536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:56:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27083.852903 secs 2024-04-21T17:56:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:13 smithi191 ceph-mon[31636]: pgmap v14536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:56:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27083.852903 secs 2024-04-21T17:56:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:13 smithi170 ceph-mon[31212]: pgmap v14536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:56:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27085.612231 secs 2024-04-21T17:56:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:15 smithi077 ceph-mon[27902]: pgmap v14537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:56:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:56:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27085.612231 secs 2024-04-21T17:56:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:15 smithi191 ceph-mon[31636]: pgmap v14537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:56:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:56:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27085.612231 secs 2024-04-21T17:56:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:15 smithi170 ceph-mon[31212]: pgmap v14537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:56:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:56:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:56:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:56:16.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:56:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:56:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:56:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:56:16.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:56:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:56:16.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:56:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:17 smithi077 ceph-mon[27902]: pgmap v14538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:56:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:17 smithi191 ceph-mon[31636]: pgmap v14538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:56:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:17 smithi170 ceph-mon[31212]: pgmap v14538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:56:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27088.852971 secs 2024-04-21T17:56:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27088.852971 secs 2024-04-21T17:56:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27088.852971 secs 2024-04-21T17:56:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:19 smithi077 ceph-mon[27902]: pgmap v14539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:56:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:19 smithi191 ceph-mon[31636]: pgmap v14539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:56:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:19 smithi170 ceph-mon[31212]: pgmap v14539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:56:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27090.612292 secs 2024-04-21T17:56:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27090.612292 secs 2024-04-21T17:56:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27090.612292 secs 2024-04-21T17:56:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:21 smithi077 ceph-mon[27902]: pgmap v14540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:56:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:21 smithi191 ceph-mon[31636]: pgmap v14540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:56:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:21 smithi170 ceph-mon[31212]: pgmap v14540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:56:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27093.853081 secs 2024-04-21T17:56:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:23 smithi077 ceph-mon[27902]: pgmap v14541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:56:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27093.853081 secs 2024-04-21T17:56:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:23 smithi191 ceph-mon[31636]: pgmap v14541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:56:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27093.853081 secs 2024-04-21T17:56:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:23 smithi170 ceph-mon[31212]: pgmap v14541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:56:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27095.612388 secs 2024-04-21T17:56:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:25 smithi077 ceph-mon[27902]: pgmap v14542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27095.612388 secs 2024-04-21T17:56:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:25 smithi191 ceph-mon[31636]: pgmap v14542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27095.612388 secs 2024-04-21T17:56:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:25 smithi170 ceph-mon[31212]: pgmap v14542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:27 smithi077 ceph-mon[27902]: pgmap v14543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:27 smithi191 ceph-mon[31636]: pgmap v14543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:27 smithi170 ceph-mon[31212]: pgmap v14543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:28.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27098.853200 secs 2024-04-21T17:56:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27098.853200 secs 2024-04-21T17:56:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27098.853200 secs 2024-04-21T17:56:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:29 smithi077 ceph-mon[27902]: pgmap v14544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:29 smithi191 ceph-mon[31636]: pgmap v14544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:29 smithi170 ceph-mon[31212]: pgmap v14544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27100.612452 secs 2024-04-21T17:56:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27100.612452 secs 2024-04-21T17:56:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27100.612452 secs 2024-04-21T17:56:31.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:31 smithi077 ceph-mon[27902]: pgmap v14545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:31 smithi191 ceph-mon[31636]: pgmap v14545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:31 smithi170 ceph-mon[31212]: pgmap v14545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:33.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27103.853330 secs 2024-04-21T17:56:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:33 smithi077 ceph-mon[27902]: pgmap v14546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27103.853330 secs 2024-04-21T17:56:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:33 smithi191 ceph-mon[31636]: pgmap v14546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27103.853330 secs 2024-04-21T17:56:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:33 smithi170 ceph-mon[31212]: pgmap v14546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27105.612547 secs 2024-04-21T17:56:35.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:35 smithi077 ceph-mon[27902]: pgmap v14547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27105.612547 secs 2024-04-21T17:56:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:35 smithi191 ceph-mon[31636]: pgmap v14547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27105.612547 secs 2024-04-21T17:56:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:35 smithi170 ceph-mon[31212]: pgmap v14547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:37 smithi077 ceph-mon[27902]: pgmap v14548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:37 smithi191 ceph-mon[31636]: pgmap v14548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:37 smithi170 ceph-mon[31212]: pgmap v14548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:38.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27108.853445 secs 2024-04-21T17:56:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27108.853445 secs 2024-04-21T17:56:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27108.853445 secs 2024-04-21T17:56:39.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:39 smithi077 ceph-mon[27902]: pgmap v14549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:39 smithi191 ceph-mon[31636]: pgmap v14549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:39 smithi170 ceph-mon[31212]: pgmap v14549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27110.612657 secs 2024-04-21T17:56:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27110.612657 secs 2024-04-21T17:56:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27110.612657 secs 2024-04-21T17:56:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:41 smithi191 ceph-mon[31636]: pgmap v14550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:41 smithi170 ceph-mon[31212]: pgmap v14550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:41 smithi077 ceph-mon[27902]: pgmap v14550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27113.853561 secs 2024-04-21T17:56:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:43 smithi191 ceph-mon[31636]: pgmap v14551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27113.853561 secs 2024-04-21T17:56:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:43 smithi170 ceph-mon[31212]: pgmap v14551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27113.853561 secs 2024-04-21T17:56:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:43 smithi077 ceph-mon[27902]: pgmap v14551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27115.612772 secs 2024-04-21T17:56:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:45 smithi191 ceph-mon[31636]: pgmap v14552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27115.612772 secs 2024-04-21T17:56:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:45 smithi170 ceph-mon[31212]: pgmap v14552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27115.612772 secs 2024-04-21T17:56:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:45 smithi077 ceph-mon[27902]: pgmap v14552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:47 smithi191 ceph-mon[31636]: pgmap v14553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:47 smithi170 ceph-mon[31212]: pgmap v14553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:47 smithi077 ceph-mon[27902]: pgmap v14553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27118.853690 secs 2024-04-21T17:56:48.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27118.853690 secs 2024-04-21T17:56:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27118.853690 secs 2024-04-21T17:56:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:49 smithi191 ceph-mon[31636]: pgmap v14554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:49 smithi170 ceph-mon[31212]: pgmap v14554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:49 smithi077 ceph-mon[27902]: pgmap v14554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27120.612889 secs 2024-04-21T17:56:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27120.612889 secs 2024-04-21T17:56:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27120.612889 secs 2024-04-21T17:56:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:51 smithi191 ceph-mon[31636]: pgmap v14555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:51 smithi170 ceph-mon[31212]: pgmap v14555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:51 smithi077 ceph-mon[27902]: pgmap v14555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27123.853818 secs 2024-04-21T17:56:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:53 smithi191 ceph-mon[31636]: pgmap v14556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27123.853818 secs 2024-04-21T17:56:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:53 smithi170 ceph-mon[31212]: pgmap v14556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27123.853818 secs 2024-04-21T17:56:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:53 smithi077 ceph-mon[27902]: pgmap v14556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:56:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27125.613005 secs 2024-04-21T17:56:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:55 smithi191 ceph-mon[31636]: pgmap v14557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27125.613005 secs 2024-04-21T17:56:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:55 smithi170 ceph-mon[31212]: pgmap v14557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27125.613005 secs 2024-04-21T17:56:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:55 smithi077 ceph-mon[27902]: pgmap v14557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:57 smithi191 ceph-mon[31636]: pgmap v14558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:57 smithi170 ceph-mon[31212]: pgmap v14558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:57 smithi077 ceph-mon[27902]: pgmap v14558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:56:58.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27128.853890 secs 2024-04-21T17:56:58.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27128.853890 secs 2024-04-21T17:56:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27128.853890 secs 2024-04-21T17:56:59.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:56:59 smithi191 ceph-mon[31636]: pgmap v14559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:59.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:56:59 smithi170 ceph-mon[31212]: pgmap v14559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:56:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:56:59 smithi077 ceph-mon[27902]: pgmap v14559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:00.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27130.613123 secs 2024-04-21T17:57:00.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27130.613123 secs 2024-04-21T17:57:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27130.613123 secs 2024-04-21T17:57:01.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:01 smithi191 ceph-mon[31636]: pgmap v14560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:01 smithi170 ceph-mon[31212]: pgmap v14560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:01 smithi077 ceph-mon[27902]: pgmap v14560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27133.854006 secs 2024-04-21T17:57:03.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:03 smithi191 ceph-mon[31636]: pgmap v14561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27133.854006 secs 2024-04-21T17:57:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:03 smithi170 ceph-mon[31212]: pgmap v14561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27133.854006 secs 2024-04-21T17:57:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:03 smithi077 ceph-mon[27902]: pgmap v14561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27135.613247 secs 2024-04-21T17:57:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:05 smithi191 ceph-mon[31636]: pgmap v14562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:05 smithi191 ceph-mon[31636]: osdmap e982: 12 total, 12 up, 12 in 2024-04-21T17:57:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27135.613247 secs 2024-04-21T17:57:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:05 smithi170 ceph-mon[31212]: pgmap v14562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:05 smithi170 ceph-mon[31212]: osdmap e982: 12 total, 12 up, 12 in 2024-04-21T17:57:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27135.613247 secs 2024-04-21T17:57:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:05 smithi077 ceph-mon[27902]: pgmap v14562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:05 smithi077 ceph-mon[27902]: osdmap e982: 12 total, 12 up, 12 in 2024-04-21T17:57:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:07 smithi191 ceph-mon[31636]: pgmap v14564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:57:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:07 smithi170 ceph-mon[31212]: pgmap v14564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:57:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:07 smithi077 ceph-mon[27902]: pgmap v14564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:57:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27138.854113 secs 2024-04-21T17:57:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:08 smithi077 ceph-mon[27902]: osdmap e983: 12 total, 12 up, 12 in 2024-04-21T17:57:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:08 smithi077 ceph-mon[27902]: pgmap v14566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:57:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27138.854113 secs 2024-04-21T17:57:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:08 smithi191 ceph-mon[31636]: osdmap e983: 12 total, 12 up, 12 in 2024-04-21T17:57:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:08 smithi191 ceph-mon[31636]: pgmap v14566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:57:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27138.854113 secs 2024-04-21T17:57:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:08 smithi170 ceph-mon[31212]: osdmap e983: 12 total, 12 up, 12 in 2024-04-21T17:57:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:08 smithi170 ceph-mon[31212]: pgmap v14566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:57:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27140.613421 secs 2024-04-21T17:57:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27140.613421 secs 2024-04-21T17:57:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27140.613421 secs 2024-04-21T17:57:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:10 smithi077 ceph-mon[27902]: pgmap v14567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:57:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:10 smithi191 ceph-mon[31636]: pgmap v14567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:57:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:10 smithi170 ceph-mon[31212]: pgmap v14567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:57:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27143.854250 secs 2024-04-21T17:57:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:13 smithi077 ceph-mon[27902]: pgmap v14568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:57:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27143.854250 secs 2024-04-21T17:57:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:13 smithi191 ceph-mon[31636]: pgmap v14568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:57:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27143.854250 secs 2024-04-21T17:57:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:13 smithi170 ceph-mon[31212]: pgmap v14568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:57:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27145.613535 secs 2024-04-21T17:57:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:15 smithi077 ceph-mon[27902]: pgmap v14569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:57:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27145.613535 secs 2024-04-21T17:57:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:15 smithi191 ceph-mon[31636]: pgmap v14569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:57:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27145.613535 secs 2024-04-21T17:57:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:15 smithi170 ceph-mon[31212]: pgmap v14569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:57:16.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:57:16.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:57:16.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:57:17.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:17 smithi077 ceph-mon[27902]: pgmap v14570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:57:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:17 smithi191 ceph-mon[31636]: pgmap v14570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:57:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:17 smithi170 ceph-mon[31212]: pgmap v14570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:57:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27148.854355 secs 2024-04-21T17:57:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27148.854355 secs 2024-04-21T17:57:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27148.854355 secs 2024-04-21T17:57:19.349 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:19 smithi077 ceph-mon[27902]: pgmap v14571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:57:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:19 smithi191 ceph-mon[31636]: pgmap v14571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:57:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:19 smithi170 ceph-mon[31212]: pgmap v14571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:57:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27150.613674 secs 2024-04-21T17:57:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27150.613674 secs 2024-04-21T17:57:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27150.613674 secs 2024-04-21T17:57:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:21 smithi077 ceph-mon[27902]: pgmap v14572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:57:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:57:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:57:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:21 smithi191 ceph-mon[31636]: pgmap v14572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:57:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:57:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:57:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:21 smithi170 ceph-mon[31212]: pgmap v14572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:57:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:57:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:57:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:57:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27153.854470 secs 2024-04-21T17:57:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:23 smithi191 ceph-mon[31636]: pgmap v14573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:57:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27153.854470 secs 2024-04-21T17:57:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:23 smithi170 ceph-mon[31212]: pgmap v14573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:57:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27153.854470 secs 2024-04-21T17:57:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:23 smithi077 ceph-mon[27902]: pgmap v14573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:57:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27155.613790 secs 2024-04-21T17:57:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:25 smithi191 ceph-mon[31636]: pgmap v14574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27155.613790 secs 2024-04-21T17:57:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:25 smithi170 ceph-mon[31212]: pgmap v14574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27155.613790 secs 2024-04-21T17:57:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:25 smithi077 ceph-mon[27902]: pgmap v14574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:27 smithi191 ceph-mon[31636]: pgmap v14575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:27 smithi170 ceph-mon[31212]: pgmap v14575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:27 smithi077 ceph-mon[27902]: pgmap v14575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27158.854587 secs 2024-04-21T17:57:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27158.854587 secs 2024-04-21T17:57:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27158.854587 secs 2024-04-21T17:57:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:29 smithi191 ceph-mon[31636]: pgmap v14576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:29 smithi170 ceph-mon[31212]: pgmap v14576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:29 smithi077 ceph-mon[27902]: pgmap v14576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27160.613887 secs 2024-04-21T17:57:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27160.613887 secs 2024-04-21T17:57:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27160.613887 secs 2024-04-21T17:57:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:31 smithi191 ceph-mon[31636]: pgmap v14577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:31 smithi170 ceph-mon[31212]: pgmap v14577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:31 smithi077 ceph-mon[27902]: pgmap v14577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27163.854700 secs 2024-04-21T17:57:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:33 smithi191 ceph-mon[31636]: pgmap v14578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27163.854700 secs 2024-04-21T17:57:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:33 smithi170 ceph-mon[31212]: pgmap v14578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27163.854700 secs 2024-04-21T17:57:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:33 smithi077 ceph-mon[27902]: pgmap v14578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27165.613999 secs 2024-04-21T17:57:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:35 smithi191 ceph-mon[31636]: pgmap v14579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27165.613999 secs 2024-04-21T17:57:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:35 smithi170 ceph-mon[31212]: pgmap v14579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27165.613999 secs 2024-04-21T17:57:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:35 smithi077 ceph-mon[27902]: pgmap v14579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:37 smithi191 ceph-mon[31636]: pgmap v14580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:37 smithi170 ceph-mon[31212]: pgmap v14580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:37 smithi077 ceph-mon[27902]: pgmap v14580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27168.854849 secs 2024-04-21T17:57:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27168.854849 secs 2024-04-21T17:57:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27168.854849 secs 2024-04-21T17:57:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:39 smithi191 ceph-mon[31636]: pgmap v14581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:39 smithi170 ceph-mon[31212]: pgmap v14581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:39 smithi077 ceph-mon[27902]: pgmap v14581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27170.614066 secs 2024-04-21T17:57:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27170.614066 secs 2024-04-21T17:57:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27170.614066 secs 2024-04-21T17:57:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:41 smithi191 ceph-mon[31636]: pgmap v14582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:41 smithi170 ceph-mon[31212]: pgmap v14582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:41 smithi077 ceph-mon[27902]: pgmap v14582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27173.854974 secs 2024-04-21T17:57:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:43 smithi191 ceph-mon[31636]: pgmap v14583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27173.854974 secs 2024-04-21T17:57:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:43 smithi170 ceph-mon[31212]: pgmap v14583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27173.854974 secs 2024-04-21T17:57:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:43 smithi077 ceph-mon[27902]: pgmap v14583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27175.614175 secs 2024-04-21T17:57:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:45 smithi191 ceph-mon[31636]: pgmap v14584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27175.614175 secs 2024-04-21T17:57:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:45 smithi170 ceph-mon[31212]: pgmap v14584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27175.614175 secs 2024-04-21T17:57:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:45 smithi077 ceph-mon[27902]: pgmap v14584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:47 smithi191 ceph-mon[31636]: pgmap v14585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:47 smithi170 ceph-mon[31212]: pgmap v14585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:47 smithi077 ceph-mon[27902]: pgmap v14585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27178.855091 secs 2024-04-21T17:57:48.538 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27178.855091 secs 2024-04-21T17:57:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27178.855091 secs 2024-04-21T17:57:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:49 smithi191 ceph-mon[31636]: pgmap v14586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:49 smithi170 ceph-mon[31212]: pgmap v14586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:49 smithi077 ceph-mon[27902]: pgmap v14586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27180.614326 secs 2024-04-21T17:57:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27180.614326 secs 2024-04-21T17:57:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27180.614326 secs 2024-04-21T17:57:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:51 smithi191 ceph-mon[31636]: pgmap v14587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:51 smithi170 ceph-mon[31212]: pgmap v14587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:51 smithi077 ceph-mon[27902]: pgmap v14587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27183.855202 secs 2024-04-21T17:57:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:53 smithi191 ceph-mon[31636]: pgmap v14588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27183.855202 secs 2024-04-21T17:57:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:53 smithi170 ceph-mon[31212]: pgmap v14588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27183.855202 secs 2024-04-21T17:57:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:53 smithi077 ceph-mon[27902]: pgmap v14588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:57:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27185.614467 secs 2024-04-21T17:57:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:55 smithi191 ceph-mon[31636]: pgmap v14589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27185.614467 secs 2024-04-21T17:57:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:55 smithi170 ceph-mon[31212]: pgmap v14589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27185.614467 secs 2024-04-21T17:57:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:55 smithi077 ceph-mon[27902]: pgmap v14589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:57 smithi191 ceph-mon[31636]: pgmap v14590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:57 smithi170 ceph-mon[31212]: pgmap v14590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:57 smithi077 ceph-mon[27902]: pgmap v14590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:57:58.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27188.855318 secs 2024-04-21T17:57:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27188.855318 secs 2024-04-21T17:57:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27188.855318 secs 2024-04-21T17:57:59.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:57:59 smithi170 ceph-mon[31212]: pgmap v14591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:57:59 smithi077 ceph-mon[27902]: pgmap v14591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:57:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:57:59 smithi191 ceph-mon[31636]: pgmap v14591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27190.614598 secs 2024-04-21T17:58:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27190.614598 secs 2024-04-21T17:58:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27190.614598 secs 2024-04-21T17:58:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:01 smithi170 ceph-mon[31212]: pgmap v14592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:01 smithi077 ceph-mon[27902]: pgmap v14592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:01 smithi191 ceph-mon[31636]: pgmap v14592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27193.855416 secs 2024-04-21T17:58:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:03 smithi170 ceph-mon[31212]: pgmap v14593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27193.855416 secs 2024-04-21T17:58:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:03 smithi077 ceph-mon[27902]: pgmap v14593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27193.855416 secs 2024-04-21T17:58:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:03 smithi191 ceph-mon[31636]: pgmap v14593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27195.614716 secs 2024-04-21T17:58:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:05 smithi170 ceph-mon[31212]: pgmap v14594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:05 smithi170 ceph-mon[31212]: osdmap e984: 12 total, 12 up, 12 in 2024-04-21T17:58:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27195.614716 secs 2024-04-21T17:58:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:05 smithi077 ceph-mon[27902]: pgmap v14594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:05 smithi077 ceph-mon[27902]: osdmap e984: 12 total, 12 up, 12 in 2024-04-21T17:58:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27195.614716 secs 2024-04-21T17:58:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:05 smithi191 ceph-mon[31636]: pgmap v14594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:05 smithi191 ceph-mon[31636]: osdmap e984: 12 total, 12 up, 12 in 2024-04-21T17:58:07.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:07 smithi170 ceph-mon[31212]: pgmap v14596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:58:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:07 smithi077 ceph-mon[27902]: pgmap v14596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:58:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:07 smithi191 ceph-mon[31636]: pgmap v14596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T17:58:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27198.855536 secs 2024-04-21T17:58:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:08 smithi077 ceph-mon[27902]: osdmap e985: 12 total, 12 up, 12 in 2024-04-21T17:58:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:08 smithi077 ceph-mon[27902]: pgmap v14598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:58:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27198.855536 secs 2024-04-21T17:58:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:08 smithi191 ceph-mon[31636]: osdmap e985: 12 total, 12 up, 12 in 2024-04-21T17:58:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:08 smithi191 ceph-mon[31636]: pgmap v14598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:58:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27198.855536 secs 2024-04-21T17:58:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:08 smithi170 ceph-mon[31212]: osdmap e985: 12 total, 12 up, 12 in 2024-04-21T17:58:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:08 smithi170 ceph-mon[31212]: pgmap v14598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:58:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27200.614835 secs 2024-04-21T17:58:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27200.614835 secs 2024-04-21T17:58:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27200.614835 secs 2024-04-21T17:58:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:10 smithi077 ceph-mon[27902]: pgmap v14599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:58:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:10 smithi191 ceph-mon[31636]: pgmap v14599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:58:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:10 smithi170 ceph-mon[31212]: pgmap v14599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T17:58:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27203.855652 secs 2024-04-21T17:58:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:13 smithi077 ceph-mon[27902]: pgmap v14600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:58:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27203.855652 secs 2024-04-21T17:58:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:13 smithi191 ceph-mon[31636]: pgmap v14600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:58:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27203.855652 secs 2024-04-21T17:58:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:13 smithi170 ceph-mon[31212]: pgmap v14600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:58:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:15.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27205.614949 secs 2024-04-21T17:58:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:15 smithi077 ceph-mon[27902]: pgmap v14601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:58:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27205.614949 secs 2024-04-21T17:58:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:15 smithi191 ceph-mon[31636]: pgmap v14601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:58:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27205.614949 secs 2024-04-21T17:58:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:15 smithi170 ceph-mon[31212]: pgmap v14601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:58:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:17 smithi077 ceph-mon[27902]: pgmap v14602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:58:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:17 smithi191 ceph-mon[31636]: pgmap v14602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:58:17.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:17 smithi170 ceph-mon[31212]: pgmap v14602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:58:18.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27208.855791 secs 2024-04-21T17:58:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27208.855791 secs 2024-04-21T17:58:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27208.855791 secs 2024-04-21T17:58:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:19 smithi077 ceph-mon[27902]: pgmap v14603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:58:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:19 smithi191 ceph-mon[31636]: pgmap v14603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:58:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:19 smithi170 ceph-mon[31212]: pgmap v14603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:58:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27210.615068 secs 2024-04-21T17:58:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27210.615068 secs 2024-04-21T17:58:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27210.615068 secs 2024-04-21T17:58:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:21 smithi077 ceph-mon[27902]: pgmap v14604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:58:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:58:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:21 smithi191 ceph-mon[31636]: pgmap v14604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:58:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:58:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:21 smithi170 ceph-mon[31212]: pgmap v14604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:58:21.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:58:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27213.855873 secs 2024-04-21T17:58:23.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:23 smithi191 ceph-mon[31636]: pgmap v14605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:58:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27213.855873 secs 2024-04-21T17:58:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:23 smithi170 ceph-mon[31212]: pgmap v14605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:58:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27213.855873 secs 2024-04-21T17:58:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:23 smithi077 ceph-mon[27902]: pgmap v14605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:58:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27215.615159 secs 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: pgmap v14606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:58:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27215.615159 secs 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: pgmap v14606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:58:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27215.615159 secs 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: pgmap v14606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:58:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:27 smithi191 ceph-mon[31636]: pgmap v14607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:27 smithi170 ceph-mon[31212]: pgmap v14607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:27 smithi077 ceph-mon[27902]: pgmap v14607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27218.855983 secs 2024-04-21T17:58:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27218.855983 secs 2024-04-21T17:58:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27218.855983 secs 2024-04-21T17:58:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:29 smithi191 ceph-mon[31636]: pgmap v14608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:29 smithi170 ceph-mon[31212]: pgmap v14608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:29 smithi077 ceph-mon[27902]: pgmap v14608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27220.615228 secs 2024-04-21T17:58:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27220.615228 secs 2024-04-21T17:58:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27220.615228 secs 2024-04-21T17:58:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:31 smithi191 ceph-mon[31636]: pgmap v14609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:31 smithi170 ceph-mon[31212]: pgmap v14609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:31 smithi077 ceph-mon[27902]: pgmap v14609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27223.856105 secs 2024-04-21T17:58:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:33 smithi191 ceph-mon[31636]: pgmap v14610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27223.856105 secs 2024-04-21T17:58:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:33 smithi170 ceph-mon[31212]: pgmap v14610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27223.856105 secs 2024-04-21T17:58:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:33 smithi077 ceph-mon[27902]: pgmap v14610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27225.615362 secs 2024-04-21T17:58:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:35 smithi191 ceph-mon[31636]: pgmap v14611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27225.615362 secs 2024-04-21T17:58:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:35 smithi170 ceph-mon[31212]: pgmap v14611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27225.615362 secs 2024-04-21T17:58:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:35 smithi077 ceph-mon[27902]: pgmap v14611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:37 smithi191 ceph-mon[31636]: pgmap v14612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:37 smithi170 ceph-mon[31212]: pgmap v14612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:37 smithi077 ceph-mon[27902]: pgmap v14612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:38.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27228.856234 secs 2024-04-21T17:58:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27228.856234 secs 2024-04-21T17:58:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27228.856234 secs 2024-04-21T17:58:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:39 smithi191 ceph-mon[31636]: pgmap v14613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:39 smithi170 ceph-mon[31212]: pgmap v14613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:39 smithi077 ceph-mon[27902]: pgmap v14613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27230.615435 secs 2024-04-21T17:58:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27230.615435 secs 2024-04-21T17:58:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27230.615435 secs 2024-04-21T17:58:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:41 smithi191 ceph-mon[31636]: pgmap v14614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:41 smithi170 ceph-mon[31212]: pgmap v14614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:41 smithi077 ceph-mon[27902]: pgmap v14614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27233.856345 secs 2024-04-21T17:58:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:43 smithi191 ceph-mon[31636]: pgmap v14615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27233.856345 secs 2024-04-21T17:58:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:43 smithi170 ceph-mon[31212]: pgmap v14615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27233.856345 secs 2024-04-21T17:58:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:43 smithi077 ceph-mon[27902]: pgmap v14615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27235.615555 secs 2024-04-21T17:58:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:45 smithi191 ceph-mon[31636]: pgmap v14616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27235.615555 secs 2024-04-21T17:58:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:45 smithi170 ceph-mon[31212]: pgmap v14616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27235.615555 secs 2024-04-21T17:58:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:45 smithi077 ceph-mon[27902]: pgmap v14616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:47 smithi191 ceph-mon[31636]: pgmap v14617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:47 smithi170 ceph-mon[31212]: pgmap v14617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:47 smithi077 ceph-mon[27902]: pgmap v14617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27238.856457 secs 2024-04-21T17:58:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27238.856457 secs 2024-04-21T17:58:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27238.856457 secs 2024-04-21T17:58:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:49 smithi191 ceph-mon[31636]: pgmap v14618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:49 smithi170 ceph-mon[31212]: pgmap v14618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:49 smithi077 ceph-mon[27902]: pgmap v14618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27240.615652 secs 2024-04-21T17:58:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27240.615652 secs 2024-04-21T17:58:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27240.615652 secs 2024-04-21T17:58:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:51 smithi191 ceph-mon[31636]: pgmap v14619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:51 smithi170 ceph-mon[31212]: pgmap v14619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:51 smithi077 ceph-mon[27902]: pgmap v14619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27243.856574 secs 2024-04-21T17:58:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:53 smithi191 ceph-mon[31636]: pgmap v14620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27243.856574 secs 2024-04-21T17:58:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:53 smithi170 ceph-mon[31212]: pgmap v14620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27243.856574 secs 2024-04-21T17:58:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:53 smithi077 ceph-mon[27902]: pgmap v14620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:54.447 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.448+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T17:58:54.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.448+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T17:58:54.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.448+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:58:54.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.448+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T17:58:54.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.449+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:58:54.448 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.449+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T17:58:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.449+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T17:58:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T17:58:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T17:58:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd70062000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T17:58:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd70062000 comp rx=0 tx=0).stop 2024-04-21T17:58:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T17:58:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T17:58:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T17:58:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T17:58:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T17:58:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:54.495+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd7002b070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T17:58:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:58:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27245.615786 secs 2024-04-21T17:58:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:55 smithi191 ceph-mon[31636]: pgmap v14621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27245.615786 secs 2024-04-21T17:58:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:55 smithi170 ceph-mon[31212]: pgmap v14621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27245.615786 secs 2024-04-21T17:58:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:55 smithi077 ceph-mon[27902]: pgmap v14621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:57 smithi191 ceph-mon[31636]: pgmap v14622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:57 smithi170 ceph-mon[31212]: pgmap v14622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:57 smithi077 ceph-mon[27902]: pgmap v14622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:58:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:58.121+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:58:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:58.121+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:58:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:58.121+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T17:58:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T17:58:58.121+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T17:58:58.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27248.856691 secs 2024-04-21T17:58:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27248.856691 secs 2024-04-21T17:58:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27248.856691 secs 2024-04-21T17:58:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:58:59 smithi170 ceph-mon[31212]: pgmap v14623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:58:59 smithi077 ceph-mon[27902]: pgmap v14623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:58:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:58:59 smithi191 ceph-mon[31636]: pgmap v14623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:00.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27250.615890 secs 2024-04-21T17:59:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27250.615890 secs 2024-04-21T17:59:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27250.615890 secs 2024-04-21T17:59:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:01 smithi170 ceph-mon[31212]: pgmap v14624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:01 smithi077 ceph-mon[27902]: pgmap v14624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:01 smithi191 ceph-mon[31636]: pgmap v14624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27253.856808 secs 2024-04-21T17:59:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:03 smithi170 ceph-mon[31212]: pgmap v14625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27253.856808 secs 2024-04-21T17:59:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:03 smithi077 ceph-mon[27902]: pgmap v14625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27253.856808 secs 2024-04-21T17:59:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:03 smithi191 ceph-mon[31636]: pgmap v14625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27255.615979 secs 2024-04-21T17:59:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:05 smithi170 ceph-mon[31212]: pgmap v14626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:05 smithi170 ceph-mon[31212]: osdmap e986: 12 total, 12 up, 12 in 2024-04-21T17:59:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27255.615979 secs 2024-04-21T17:59:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:05 smithi077 ceph-mon[27902]: pgmap v14626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:05 smithi077 ceph-mon[27902]: osdmap e986: 12 total, 12 up, 12 in 2024-04-21T17:59:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27255.615979 secs 2024-04-21T17:59:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:05 smithi191 ceph-mon[31636]: pgmap v14626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:05 smithi191 ceph-mon[31636]: osdmap e986: 12 total, 12 up, 12 in 2024-04-21T17:59:07.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:07 smithi170 ceph-mon[31212]: pgmap v14628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:59:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:07 smithi077 ceph-mon[27902]: pgmap v14628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:59:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:07 smithi191 ceph-mon[31636]: pgmap v14628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T17:59:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27258.856926 secs 2024-04-21T17:59:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:08 smithi077 ceph-mon[27902]: osdmap e987: 12 total, 12 up, 12 in 2024-04-21T17:59:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:08 smithi077 ceph-mon[27902]: pgmap v14630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:59:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27258.856926 secs 2024-04-21T17:59:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:08 smithi191 ceph-mon[31636]: osdmap e987: 12 total, 12 up, 12 in 2024-04-21T17:59:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:08 smithi191 ceph-mon[31636]: pgmap v14630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:59:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27258.856926 secs 2024-04-21T17:59:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:08 smithi170 ceph-mon[31212]: osdmap e987: 12 total, 12 up, 12 in 2024-04-21T17:59:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:08 smithi170 ceph-mon[31212]: pgmap v14630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T17:59:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27260.616054 secs 2024-04-21T17:59:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27260.616054 secs 2024-04-21T17:59:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27260.616054 secs 2024-04-21T17:59:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:10 smithi077 ceph-mon[27902]: pgmap v14631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:59:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:10 smithi191 ceph-mon[31636]: pgmap v14631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:59:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:10 smithi170 ceph-mon[31212]: pgmap v14631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T17:59:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27263.857039 secs 2024-04-21T17:59:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:13 smithi077 ceph-mon[27902]: pgmap v14632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:59:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27263.857039 secs 2024-04-21T17:59:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:13 smithi191 ceph-mon[31636]: pgmap v14632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:59:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27263.857039 secs 2024-04-21T17:59:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:13 smithi170 ceph-mon[31212]: pgmap v14632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T17:59:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27265.616132 secs 2024-04-21T17:59:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:15 smithi077 ceph-mon[27902]: pgmap v14633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:59:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27265.616132 secs 2024-04-21T17:59:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:15 smithi191 ceph-mon[31636]: pgmap v14633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:59:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27265.616132 secs 2024-04-21T17:59:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:15 smithi170 ceph-mon[31212]: pgmap v14633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T17:59:17.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:17 smithi077 ceph-mon[27902]: pgmap v14634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:59:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:17 smithi191 ceph-mon[31636]: pgmap v14634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:59:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:17 smithi170 ceph-mon[31212]: pgmap v14634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T17:59:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27268.857167 secs 2024-04-21T17:59:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:18 smithi077 ceph-mon[27902]: pgmap v14635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:59:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27268.857167 secs 2024-04-21T17:59:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:18 smithi191 ceph-mon[31636]: pgmap v14635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:59:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27268.857167 secs 2024-04-21T17:59:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:18 smithi170 ceph-mon[31212]: pgmap v14635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T17:59:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27270.616230 secs 2024-04-21T17:59:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27270.616230 secs 2024-04-21T17:59:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27270.616230 secs 2024-04-21T17:59:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:20 smithi077 ceph-mon[27902]: pgmap v14636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:59:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:20 smithi191 ceph-mon[31636]: pgmap v14636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:59:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:20 smithi170 ceph-mon[31212]: pgmap v14636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T17:59:23.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27273.857299 secs 2024-04-21T17:59:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:23 smithi077 ceph-mon[27902]: pgmap v14637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:59:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27273.857299 secs 2024-04-21T17:59:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:23 smithi191 ceph-mon[31636]: pgmap v14637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:59:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27273.857299 secs 2024-04-21T17:59:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:23 smithi170 ceph-mon[31212]: pgmap v14637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T17:59:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27275.616370 secs 2024-04-21T17:59:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:25 smithi077 ceph-mon[27902]: pgmap v14638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:25.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:59:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27275.616370 secs 2024-04-21T17:59:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:25 smithi191 ceph-mon[31636]: pgmap v14638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:59:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27275.616370 secs 2024-04-21T17:59:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:25 smithi170 ceph-mon[31212]: pgmap v14638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T17:59:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:59:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:59:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:59:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:59:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:59:26.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:59:26.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T17:59:26.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T17:59:26.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T17:59:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:27 smithi077 ceph-mon[27902]: pgmap v14639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:27 smithi191 ceph-mon[31636]: pgmap v14639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:27 smithi170 ceph-mon[31212]: pgmap v14639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:28.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27278.857423 secs 2024-04-21T17:59:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27278.857423 secs 2024-04-21T17:59:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27278.857423 secs 2024-04-21T17:59:29.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:29 smithi077 ceph-mon[27902]: pgmap v14640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:29 smithi191 ceph-mon[31636]: pgmap v14640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:29 smithi170 ceph-mon[31212]: pgmap v14640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27280.616494 secs 2024-04-21T17:59:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27280.616494 secs 2024-04-21T17:59:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27280.616494 secs 2024-04-21T17:59:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:31 smithi191 ceph-mon[31636]: pgmap v14641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:31 smithi170 ceph-mon[31212]: pgmap v14641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:31 smithi077 ceph-mon[27902]: pgmap v14641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27283.857537 secs 2024-04-21T17:59:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:33 smithi191 ceph-mon[31636]: pgmap v14642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27283.857537 secs 2024-04-21T17:59:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:33 smithi170 ceph-mon[31212]: pgmap v14642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27283.857537 secs 2024-04-21T17:59:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:33 smithi077 ceph-mon[27902]: pgmap v14642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27285.616603 secs 2024-04-21T17:59:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:35 smithi191 ceph-mon[31636]: pgmap v14643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27285.616603 secs 2024-04-21T17:59:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:35 smithi170 ceph-mon[31212]: pgmap v14643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27285.616603 secs 2024-04-21T17:59:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:35 smithi077 ceph-mon[27902]: pgmap v14643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:37 smithi191 ceph-mon[31636]: pgmap v14644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:37 smithi170 ceph-mon[31212]: pgmap v14644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:37 smithi077 ceph-mon[27902]: pgmap v14644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27288.857661 secs 2024-04-21T17:59:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27288.857661 secs 2024-04-21T17:59:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27288.857661 secs 2024-04-21T17:59:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:39 smithi191 ceph-mon[31636]: pgmap v14645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:39 smithi170 ceph-mon[31212]: pgmap v14645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:39 smithi077 ceph-mon[27902]: pgmap v14645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27290.616726 secs 2024-04-21T17:59:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27290.616726 secs 2024-04-21T17:59:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27290.616726 secs 2024-04-21T17:59:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:41 smithi191 ceph-mon[31636]: pgmap v14646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:41 smithi170 ceph-mon[31212]: pgmap v14646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:41 smithi077 ceph-mon[27902]: pgmap v14646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27293.857816 secs 2024-04-21T17:59:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:43 smithi191 ceph-mon[31636]: pgmap v14647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27293.857816 secs 2024-04-21T17:59:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:43 smithi170 ceph-mon[31212]: pgmap v14647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27293.857816 secs 2024-04-21T17:59:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:43 smithi077 ceph-mon[27902]: pgmap v14647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27295.616844 secs 2024-04-21T17:59:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:45 smithi191 ceph-mon[31636]: pgmap v14648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27295.616844 secs 2024-04-21T17:59:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:45 smithi170 ceph-mon[31212]: pgmap v14648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27295.616844 secs 2024-04-21T17:59:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:45 smithi077 ceph-mon[27902]: pgmap v14648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:47 smithi191 ceph-mon[31636]: pgmap v14649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:47 smithi170 ceph-mon[31212]: pgmap v14649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:47 smithi077 ceph-mon[27902]: pgmap v14649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27298.857940 secs 2024-04-21T17:59:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27298.857940 secs 2024-04-21T17:59:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27298.857940 secs 2024-04-21T17:59:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:49 smithi191 ceph-mon[31636]: pgmap v14650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:49 smithi170 ceph-mon[31212]: pgmap v14650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:49 smithi077 ceph-mon[27902]: pgmap v14650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27300.616959 secs 2024-04-21T17:59:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27300.616959 secs 2024-04-21T17:59:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27300.616959 secs 2024-04-21T17:59:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:51 smithi191 ceph-mon[31636]: pgmap v14651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:51 smithi170 ceph-mon[31212]: pgmap v14651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:51 smithi077 ceph-mon[27902]: pgmap v14651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27303.858019 secs 2024-04-21T17:59:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:53 smithi191 ceph-mon[31636]: pgmap v14652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27303.858019 secs 2024-04-21T17:59:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:53 smithi170 ceph-mon[31212]: pgmap v14652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27303.858019 secs 2024-04-21T17:59:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:53 smithi077 ceph-mon[27902]: pgmap v14652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T17:59:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27305.617052 secs 2024-04-21T17:59:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:55 smithi191 ceph-mon[31636]: pgmap v14653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27305.617052 secs 2024-04-21T17:59:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:55 smithi170 ceph-mon[31212]: pgmap v14653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27305.617052 secs 2024-04-21T17:59:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:55 smithi077 ceph-mon[27902]: pgmap v14653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:57 smithi191 ceph-mon[31636]: pgmap v14654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:57 smithi170 ceph-mon[31212]: pgmap v14654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:57 smithi077 ceph-mon[27902]: pgmap v14654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T17:59:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27308.858135 secs 2024-04-21T17:59:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:58 smithi077 ceph-mon[27902]: pgmap v14655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27308.858135 secs 2024-04-21T17:59:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:58 smithi191 ceph-mon[31636]: pgmap v14655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27308.858135 secs 2024-04-21T17:59:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:58 smithi170 ceph-mon[31212]: pgmap v14655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T17:59:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 17:59:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27310.617197 secs 2024-04-21T17:59:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 17:59:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27310.617197 secs 2024-04-21T17:59:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 17:59:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27310.617197 secs 2024-04-21T18:00:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:00:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:00 smithi191 ceph-mon[31636]: pgmap v14656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:00:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:00 smithi170 ceph-mon[31212]: pgmap v14656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:00:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:00 smithi077 ceph-mon[27902]: pgmap v14656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27313.858273 secs 2024-04-21T18:00:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:03 smithi077 ceph-mon[27902]: pgmap v14657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27313.858273 secs 2024-04-21T18:00:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:03 smithi191 ceph-mon[31636]: pgmap v14657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27313.858273 secs 2024-04-21T18:00:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:03 smithi170 ceph-mon[31212]: pgmap v14657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27315.617292 secs 2024-04-21T18:00:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:05 smithi191 ceph-mon[31636]: pgmap v14658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:05.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:05 smithi191 ceph-mon[31636]: osdmap e988: 12 total, 12 up, 12 in 2024-04-21T18:00:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27315.617292 secs 2024-04-21T18:00:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:05 smithi170 ceph-mon[31212]: pgmap v14658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:05 smithi170 ceph-mon[31212]: osdmap e988: 12 total, 12 up, 12 in 2024-04-21T18:00:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27315.617292 secs 2024-04-21T18:00:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:05 smithi077 ceph-mon[27902]: pgmap v14658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:05 smithi077 ceph-mon[27902]: osdmap e988: 12 total, 12 up, 12 in 2024-04-21T18:00:07.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:07 smithi191 ceph-mon[31636]: pgmap v14660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:00:07.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:07 smithi170 ceph-mon[31212]: pgmap v14660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:00:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:07 smithi077 ceph-mon[27902]: pgmap v14660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:00:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27318.858426 secs 2024-04-21T18:00:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:08 smithi077 ceph-mon[27902]: osdmap e989: 12 total, 12 up, 12 in 2024-04-21T18:00:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:08 smithi077 ceph-mon[27902]: pgmap v14662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:00:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27318.858426 secs 2024-04-21T18:00:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:08 smithi191 ceph-mon[31636]: osdmap e989: 12 total, 12 up, 12 in 2024-04-21T18:00:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:08 smithi191 ceph-mon[31636]: pgmap v14662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:00:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27318.858426 secs 2024-04-21T18:00:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:08 smithi170 ceph-mon[31212]: osdmap e989: 12 total, 12 up, 12 in 2024-04-21T18:00:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:08 smithi170 ceph-mon[31212]: pgmap v14662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:00:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27320.617411 secs 2024-04-21T18:00:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27320.617411 secs 2024-04-21T18:00:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27320.617411 secs 2024-04-21T18:00:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:10 smithi077 ceph-mon[27902]: pgmap v14663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:00:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:10 smithi191 ceph-mon[31636]: pgmap v14663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:00:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:10 smithi170 ceph-mon[31212]: pgmap v14663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:00:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27323.858543 secs 2024-04-21T18:00:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:13 smithi077 ceph-mon[27902]: pgmap v14664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:00:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27323.858543 secs 2024-04-21T18:00:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:13 smithi191 ceph-mon[31636]: pgmap v14664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:00:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27323.858543 secs 2024-04-21T18:00:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:13 smithi170 ceph-mon[31212]: pgmap v14664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:00:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27325.617531 secs 2024-04-21T18:00:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:15 smithi191 ceph-mon[31636]: pgmap v14665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:00:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27325.617531 secs 2024-04-21T18:00:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:15 smithi170 ceph-mon[31212]: pgmap v14665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:00:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27325.617531 secs 2024-04-21T18:00:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:15 smithi077 ceph-mon[27902]: pgmap v14665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:00:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:17 smithi191 ceph-mon[31636]: pgmap v14666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:00:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:17 smithi170 ceph-mon[31212]: pgmap v14666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:00:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:17 smithi077 ceph-mon[27902]: pgmap v14666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:00:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27328.858675 secs 2024-04-21T18:00:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27328.858675 secs 2024-04-21T18:00:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27328.858675 secs 2024-04-21T18:00:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:19 smithi191 ceph-mon[31636]: pgmap v14667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:00:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:19 smithi170 ceph-mon[31212]: pgmap v14667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:00:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:19 smithi077 ceph-mon[27902]: pgmap v14667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:00:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27330.617649 secs 2024-04-21T18:00:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27330.617649 secs 2024-04-21T18:00:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27330.617649 secs 2024-04-21T18:00:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:21 smithi191 ceph-mon[31636]: pgmap v14668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:00:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:21 smithi170 ceph-mon[31212]: pgmap v14668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:00:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:21 smithi077 ceph-mon[27902]: pgmap v14668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:00:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27333.858834 secs 2024-04-21T18:00:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:23 smithi191 ceph-mon[31636]: pgmap v14669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:00:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27333.858834 secs 2024-04-21T18:00:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:23 smithi170 ceph-mon[31212]: pgmap v14669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:00:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27333.858834 secs 2024-04-21T18:00:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:23 smithi077 ceph-mon[27902]: pgmap v14669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:00:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27335.617769 secs 2024-04-21T18:00:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:25 smithi191 ceph-mon[31636]: pgmap v14670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27335.617769 secs 2024-04-21T18:00:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:25 smithi170 ceph-mon[31212]: pgmap v14670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27335.617769 secs 2024-04-21T18:00:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:25 smithi077 ceph-mon[27902]: pgmap v14670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:26.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:00:26.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:00:26.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:00:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:27 smithi191 ceph-mon[31636]: pgmap v14671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:00:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:00:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:00:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:27 smithi170 ceph-mon[31212]: pgmap v14671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:00:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:00:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:00:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:27 smithi077 ceph-mon[27902]: pgmap v14671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:00:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:00:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:00:28.457 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27338.858907 secs 2024-04-21T18:00:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27338.858907 secs 2024-04-21T18:00:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27338.858907 secs 2024-04-21T18:00:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:29 smithi191 ceph-mon[31636]: pgmap v14672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:29 smithi170 ceph-mon[31212]: pgmap v14672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:29 smithi077 ceph-mon[27902]: pgmap v14672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27340.617912 secs 2024-04-21T18:00:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27340.617912 secs 2024-04-21T18:00:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27340.617912 secs 2024-04-21T18:00:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:31 smithi191 ceph-mon[31636]: pgmap v14673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:31 smithi170 ceph-mon[31212]: pgmap v14673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:31 smithi077 ceph-mon[27902]: pgmap v14673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27343.859022 secs 2024-04-21T18:00:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:33 smithi191 ceph-mon[31636]: pgmap v14674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27343.859022 secs 2024-04-21T18:00:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:33 smithi170 ceph-mon[31212]: pgmap v14674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27343.859022 secs 2024-04-21T18:00:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:33 smithi077 ceph-mon[27902]: pgmap v14674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27345.618000 secs 2024-04-21T18:00:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:35 smithi191 ceph-mon[31636]: pgmap v14675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27345.618000 secs 2024-04-21T18:00:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:35 smithi170 ceph-mon[31212]: pgmap v14675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27345.618000 secs 2024-04-21T18:00:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:35 smithi077 ceph-mon[27902]: pgmap v14675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:37 smithi191 ceph-mon[31636]: pgmap v14676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:37 smithi170 ceph-mon[31212]: pgmap v14676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:37 smithi077 ceph-mon[27902]: pgmap v14676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27348.859143 secs 2024-04-21T18:00:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27348.859143 secs 2024-04-21T18:00:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27348.859143 secs 2024-04-21T18:00:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:39 smithi191 ceph-mon[31636]: pgmap v14677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:39 smithi170 ceph-mon[31212]: pgmap v14677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:39 smithi077 ceph-mon[27902]: pgmap v14677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27350.618136 secs 2024-04-21T18:00:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27350.618136 secs 2024-04-21T18:00:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27350.618136 secs 2024-04-21T18:00:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:41 smithi191 ceph-mon[31636]: pgmap v14678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:41 smithi170 ceph-mon[31212]: pgmap v14678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:41 smithi077 ceph-mon[27902]: pgmap v14678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27353.859229 secs 2024-04-21T18:00:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:43 smithi191 ceph-mon[31636]: pgmap v14679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27353.859229 secs 2024-04-21T18:00:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:43 smithi170 ceph-mon[31212]: pgmap v14679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27353.859229 secs 2024-04-21T18:00:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:43 smithi077 ceph-mon[27902]: pgmap v14679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27355.618247 secs 2024-04-21T18:00:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:45 smithi191 ceph-mon[31636]: pgmap v14680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27355.618247 secs 2024-04-21T18:00:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:45 smithi170 ceph-mon[31212]: pgmap v14680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27355.618247 secs 2024-04-21T18:00:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:45 smithi077 ceph-mon[27902]: pgmap v14680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:47 smithi170 ceph-mon[31212]: pgmap v14681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:47 smithi077 ceph-mon[27902]: pgmap v14681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:47 smithi191 ceph-mon[31636]: pgmap v14681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27358.859354 secs 2024-04-21T18:00:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27358.859354 secs 2024-04-21T18:00:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27358.859354 secs 2024-04-21T18:00:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:49 smithi170 ceph-mon[31212]: pgmap v14682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:49 smithi077 ceph-mon[27902]: pgmap v14682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:49 smithi191 ceph-mon[31636]: pgmap v14682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27360.618367 secs 2024-04-21T18:00:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27360.618367 secs 2024-04-21T18:00:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27360.618367 secs 2024-04-21T18:00:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:51 smithi170 ceph-mon[31212]: pgmap v14683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:51 smithi077 ceph-mon[27902]: pgmap v14683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:51 smithi191 ceph-mon[31636]: pgmap v14683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27363.859485 secs 2024-04-21T18:00:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:53 smithi170 ceph-mon[31212]: pgmap v14684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27363.859485 secs 2024-04-21T18:00:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:53 smithi077 ceph-mon[27902]: pgmap v14684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27363.859485 secs 2024-04-21T18:00:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:53 smithi191 ceph-mon[31636]: pgmap v14684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:00:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27365.618465 secs 2024-04-21T18:00:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:55 smithi170 ceph-mon[31212]: pgmap v14685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27365.618465 secs 2024-04-21T18:00:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:55 smithi077 ceph-mon[27902]: pgmap v14685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27365.618465 secs 2024-04-21T18:00:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:55 smithi191 ceph-mon[31636]: pgmap v14685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:57 smithi170 ceph-mon[31212]: pgmap v14686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:57 smithi077 ceph-mon[27902]: pgmap v14686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:57 smithi191 ceph-mon[31636]: pgmap v14686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:00:58.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27368.859624 secs 2024-04-21T18:00:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27368.859624 secs 2024-04-21T18:00:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27368.859624 secs 2024-04-21T18:00:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:00:59 smithi170 ceph-mon[31212]: pgmap v14687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:00:59 smithi077 ceph-mon[27902]: pgmap v14687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:00:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:00:59 smithi191 ceph-mon[31636]: pgmap v14687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:00.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27370.618581 secs 2024-04-21T18:01:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27370.618581 secs 2024-04-21T18:01:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27370.618581 secs 2024-04-21T18:01:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:01 smithi170 ceph-mon[31212]: pgmap v14688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:01 smithi077 ceph-mon[27902]: pgmap v14688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:01 smithi191 ceph-mon[31636]: pgmap v14688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27373.859779 secs 2024-04-21T18:01:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:03 smithi170 ceph-mon[31212]: pgmap v14689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T18:01:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27373.859779 secs 2024-04-21T18:01:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:03 smithi077 ceph-mon[27902]: pgmap v14689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T18:01:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27373.859779 secs 2024-04-21T18:01:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:03 smithi191 ceph-mon[31636]: pgmap v14689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-21T18:01:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27375.618717 secs 2024-04-21T18:01:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:05 smithi170 ceph-mon[31212]: pgmap v14690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:01:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:05 smithi170 ceph-mon[31212]: osdmap e990: 12 total, 12 up, 12 in 2024-04-21T18:01:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27375.618717 secs 2024-04-21T18:01:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:05 smithi077 ceph-mon[27902]: pgmap v14690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:01:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:05 smithi077 ceph-mon[27902]: osdmap e990: 12 total, 12 up, 12 in 2024-04-21T18:01:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27375.618717 secs 2024-04-21T18:01:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:05 smithi191 ceph-mon[31636]: pgmap v14690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:01:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:05 smithi191 ceph-mon[31636]: osdmap e990: 12 total, 12 up, 12 in 2024-04-21T18:01:07.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:07 smithi170 ceph-mon[31212]: pgmap v14692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:01:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:07 smithi077 ceph-mon[27902]: pgmap v14692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:01:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:07 smithi191 ceph-mon[31636]: pgmap v14692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:01:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27378.859866 secs 2024-04-21T18:01:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:08 smithi191 ceph-mon[31636]: osdmap e991: 12 total, 12 up, 12 in 2024-04-21T18:01:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:08 smithi191 ceph-mon[31636]: pgmap v14694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:01:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27378.859866 secs 2024-04-21T18:01:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:08 smithi170 ceph-mon[31212]: osdmap e991: 12 total, 12 up, 12 in 2024-04-21T18:01:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:08 smithi170 ceph-mon[31212]: pgmap v14694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:01:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27378.859866 secs 2024-04-21T18:01:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:08 smithi077 ceph-mon[27902]: osdmap e991: 12 total, 12 up, 12 in 2024-04-21T18:01:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:08 smithi077 ceph-mon[27902]: pgmap v14694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:01:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27380.618841 secs 2024-04-21T18:01:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27380.618841 secs 2024-04-21T18:01:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27380.618841 secs 2024-04-21T18:01:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:10 smithi191 ceph-mon[31636]: pgmap v14695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 33 KiB/s wr, 25 op/s 2024-04-21T18:01:10.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:10 smithi170 ceph-mon[31212]: pgmap v14695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 33 KiB/s wr, 25 op/s 2024-04-21T18:01:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:10 smithi077 ceph-mon[27902]: pgmap v14695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 33 KiB/s wr, 25 op/s 2024-04-21T18:01:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27383.859998 secs 2024-04-21T18:01:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:13 smithi191 ceph-mon[31636]: pgmap v14696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-04-21T18:01:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27383.859998 secs 2024-04-21T18:01:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:13 smithi170 ceph-mon[31212]: pgmap v14696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-04-21T18:01:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27383.859998 secs 2024-04-21T18:01:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:13 smithi077 ceph-mon[27902]: pgmap v14696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-04-21T18:01:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27385.618976 secs 2024-04-21T18:01:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:15 smithi191 ceph-mon[31636]: pgmap v14697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T18:01:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27385.618976 secs 2024-04-21T18:01:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:15 smithi170 ceph-mon[31212]: pgmap v14697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T18:01:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27385.618976 secs 2024-04-21T18:01:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:15 smithi077 ceph-mon[27902]: pgmap v14697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-04-21T18:01:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:17 smithi191 ceph-mon[31636]: pgmap v14698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:01:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:17 smithi170 ceph-mon[31212]: pgmap v14698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:01:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:17 smithi077 ceph-mon[27902]: pgmap v14698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:01:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27388.860110 secs 2024-04-21T18:01:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27388.860110 secs 2024-04-21T18:01:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27388.860110 secs 2024-04-21T18:01:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:19 smithi191 ceph-mon[31636]: pgmap v14699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:01:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:19 smithi170 ceph-mon[31212]: pgmap v14699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:01:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:19 smithi077 ceph-mon[27902]: pgmap v14699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:01:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27390.619056 secs 2024-04-21T18:01:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27390.619056 secs 2024-04-21T18:01:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27390.619056 secs 2024-04-21T18:01:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:21 smithi191 ceph-mon[31636]: pgmap v14700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:01:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:21 smithi170 ceph-mon[31212]: pgmap v14700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:01:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:21 smithi077 ceph-mon[27902]: pgmap v14700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:01:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27393.860220 secs 2024-04-21T18:01:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:23 smithi191 ceph-mon[31636]: pgmap v14701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:01:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27393.860220 secs 2024-04-21T18:01:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:23 smithi170 ceph-mon[31212]: pgmap v14701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:01:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27393.860220 secs 2024-04-21T18:01:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:23 smithi077 ceph-mon[27902]: pgmap v14701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:01:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27395.619177 secs 2024-04-21T18:01:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:25 smithi191 ceph-mon[31636]: pgmap v14702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27395.619177 secs 2024-04-21T18:01:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:25 smithi170 ceph-mon[31212]: pgmap v14702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27395.619177 secs 2024-04-21T18:01:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:25 smithi077 ceph-mon[27902]: pgmap v14702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:27.430 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:27 smithi170 ceph-mon[31212]: pgmap v14703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:27.430 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:01:27.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:27 smithi191 ceph-mon[31636]: pgmap v14703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:27.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:01:27.592 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:27 smithi077 ceph-mon[27902]: pgmap v14703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:27.592 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:01:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27398.860288 secs 2024-04-21T18:01:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27398.860288 secs 2024-04-21T18:01:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27398.860288 secs 2024-04-21T18:01:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: pgmap v14704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27400.619235 secs 2024-04-21T18:01:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: pgmap v14704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27400.619235 secs 2024-04-21T18:01:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: pgmap v14704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27400.619235 secs 2024-04-21T18:01:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:30 smithi170 ceph-mon[31212]: pgmap v14705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:01:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:01:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:30 smithi077 ceph-mon[27902]: pgmap v14705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:01:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:01:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:30 smithi191 ceph-mon[31636]: pgmap v14705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27403.860399 secs 2024-04-21T18:01:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:33 smithi191 ceph-mon[31636]: pgmap v14706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27403.860399 secs 2024-04-21T18:01:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:33 smithi170 ceph-mon[31212]: pgmap v14706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27403.860399 secs 2024-04-21T18:01:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:33 smithi077 ceph-mon[27902]: pgmap v14706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27405.619367 secs 2024-04-21T18:01:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:35 smithi191 ceph-mon[31636]: pgmap v14707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27405.619367 secs 2024-04-21T18:01:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:35 smithi170 ceph-mon[31212]: pgmap v14707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27405.619367 secs 2024-04-21T18:01:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:35 smithi077 ceph-mon[27902]: pgmap v14707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:37 smithi191 ceph-mon[31636]: pgmap v14708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:37 smithi170 ceph-mon[31212]: pgmap v14708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:37 smithi077 ceph-mon[27902]: pgmap v14708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27408.860510 secs 2024-04-21T18:01:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27408.860510 secs 2024-04-21T18:01:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27408.860510 secs 2024-04-21T18:01:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:39 smithi191 ceph-mon[31636]: pgmap v14709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:39 smithi170 ceph-mon[31212]: pgmap v14709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:39 smithi077 ceph-mon[27902]: pgmap v14709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27410.619475 secs 2024-04-21T18:01:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27410.619475 secs 2024-04-21T18:01:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27410.619475 secs 2024-04-21T18:01:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:41 smithi191 ceph-mon[31636]: pgmap v14710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:41 smithi170 ceph-mon[31212]: pgmap v14710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:41 smithi077 ceph-mon[27902]: pgmap v14710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27413.860620 secs 2024-04-21T18:01:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:43 smithi191 ceph-mon[31636]: pgmap v14711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27413.860620 secs 2024-04-21T18:01:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:43 smithi170 ceph-mon[31212]: pgmap v14711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27413.860620 secs 2024-04-21T18:01:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:43 smithi077 ceph-mon[27902]: pgmap v14711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27415.619592 secs 2024-04-21T18:01:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:45 smithi191 ceph-mon[31636]: pgmap v14712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27415.619592 secs 2024-04-21T18:01:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:45 smithi170 ceph-mon[31212]: pgmap v14712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27415.619592 secs 2024-04-21T18:01:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:45 smithi077 ceph-mon[27902]: pgmap v14712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:47 smithi191 ceph-mon[31636]: pgmap v14713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:47 smithi170 ceph-mon[31212]: pgmap v14713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:47 smithi077 ceph-mon[27902]: pgmap v14713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:48.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27418.860711 secs 2024-04-21T18:01:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27418.860711 secs 2024-04-21T18:01:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27418.860711 secs 2024-04-21T18:01:49.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:49 smithi191 ceph-mon[31636]: pgmap v14714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:49 smithi170 ceph-mon[31212]: pgmap v14714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:49 smithi077 ceph-mon[27902]: pgmap v14714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:50.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27420.619724 secs 2024-04-21T18:01:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27420.619724 secs 2024-04-21T18:01:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27420.619724 secs 2024-04-21T18:01:51.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:51 smithi191 ceph-mon[31636]: pgmap v14715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:51 smithi170 ceph-mon[31212]: pgmap v14715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:51 smithi077 ceph-mon[27902]: pgmap v14715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27423.860772 secs 2024-04-21T18:01:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:53 smithi191 ceph-mon[31636]: pgmap v14716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27423.860772 secs 2024-04-21T18:01:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:53 smithi170 ceph-mon[31212]: pgmap v14716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27423.860772 secs 2024-04-21T18:01:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:53 smithi077 ceph-mon[27902]: pgmap v14716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:01:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27425.619849 secs 2024-04-21T18:01:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:55 smithi191 ceph-mon[31636]: pgmap v14717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27425.619849 secs 2024-04-21T18:01:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:55 smithi170 ceph-mon[31212]: pgmap v14717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27425.619849 secs 2024-04-21T18:01:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:55 smithi077 ceph-mon[27902]: pgmap v14717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:57.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:57 smithi191 ceph-mon[31636]: pgmap v14718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:57 smithi170 ceph-mon[31212]: pgmap v14718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:57 smithi077 ceph-mon[27902]: pgmap v14718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:01:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:01:58.145+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:01:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:01:58.145+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:01:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:01:58.145+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:01:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:01:58.145+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:01:58.473 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27428.860888 secs 2024-04-21T18:01:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27428.860888 secs 2024-04-21T18:01:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27428.860888 secs 2024-04-21T18:01:59.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:01:59 smithi170 ceph-mon[31212]: pgmap v14719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:01:59 smithi077 ceph-mon[27902]: pgmap v14719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:01:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:01:59 smithi191 ceph-mon[31636]: pgmap v14719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:00.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27430.619948 secs 2024-04-21T18:02:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27430.619948 secs 2024-04-21T18:02:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27430.619948 secs 2024-04-21T18:02:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:01 smithi170 ceph-mon[31212]: pgmap v14720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:01 smithi077 ceph-mon[27902]: pgmap v14720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:01 smithi191 ceph-mon[31636]: pgmap v14720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27433.861011 secs 2024-04-21T18:02:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:03 smithi170 ceph-mon[31212]: pgmap v14721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27433.861011 secs 2024-04-21T18:02:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:03 smithi077 ceph-mon[27902]: pgmap v14721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27433.861011 secs 2024-04-21T18:02:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:03 smithi191 ceph-mon[31636]: pgmap v14721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27435.620013 secs 2024-04-21T18:02:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:05 smithi170 ceph-mon[31212]: pgmap v14722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:05 smithi170 ceph-mon[31212]: osdmap e992: 12 total, 12 up, 12 in 2024-04-21T18:02:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27435.620013 secs 2024-04-21T18:02:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:05 smithi077 ceph-mon[27902]: pgmap v14722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:05 smithi077 ceph-mon[27902]: osdmap e992: 12 total, 12 up, 12 in 2024-04-21T18:02:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27435.620013 secs 2024-04-21T18:02:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:05 smithi191 ceph-mon[31636]: pgmap v14722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:05 smithi191 ceph-mon[31636]: osdmap e992: 12 total, 12 up, 12 in 2024-04-21T18:02:07.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:07 smithi170 ceph-mon[31212]: pgmap v14724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:02:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:07 smithi077 ceph-mon[27902]: pgmap v14724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:02:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:07 smithi191 ceph-mon[31636]: pgmap v14724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:02:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27438.861121 secs 2024-04-21T18:02:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:08 smithi191 ceph-mon[31636]: osdmap e993: 12 total, 12 up, 12 in 2024-04-21T18:02:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:08 smithi191 ceph-mon[31636]: pgmap v14726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:02:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27438.861121 secs 2024-04-21T18:02:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:08 smithi170 ceph-mon[31212]: osdmap e993: 12 total, 12 up, 12 in 2024-04-21T18:02:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:08 smithi170 ceph-mon[31212]: pgmap v14726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:02:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27438.861121 secs 2024-04-21T18:02:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:08 smithi077 ceph-mon[27902]: osdmap e993: 12 total, 12 up, 12 in 2024-04-21T18:02:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:08 smithi077 ceph-mon[27902]: pgmap v14726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:02:09.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27440.620130 secs 2024-04-21T18:02:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27440.620130 secs 2024-04-21T18:02:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27440.620130 secs 2024-04-21T18:02:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:10 smithi191 ceph-mon[31636]: pgmap v14727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:02:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:10 smithi170 ceph-mon[31212]: pgmap v14727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:02:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:10 smithi077 ceph-mon[27902]: pgmap v14727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:02:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27443.861239 secs 2024-04-21T18:02:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:13 smithi191 ceph-mon[31636]: pgmap v14728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:02:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27443.861239 secs 2024-04-21T18:02:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:13 smithi170 ceph-mon[31212]: pgmap v14728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:02:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27443.861239 secs 2024-04-21T18:02:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:13 smithi077 ceph-mon[27902]: pgmap v14728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:02:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27445.620236 secs 2024-04-21T18:02:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:15 smithi191 ceph-mon[31636]: pgmap v14729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:02:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27445.620236 secs 2024-04-21T18:02:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:15 smithi170 ceph-mon[31212]: pgmap v14729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:02:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27445.620236 secs 2024-04-21T18:02:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:15 smithi077 ceph-mon[27902]: pgmap v14729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:02:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:17 smithi191 ceph-mon[31636]: pgmap v14730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:02:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:17 smithi170 ceph-mon[31212]: pgmap v14730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:02:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:17 smithi077 ceph-mon[27902]: pgmap v14730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:02:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27448.861369 secs 2024-04-21T18:02:18.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27448.861369 secs 2024-04-21T18:02:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27448.861369 secs 2024-04-21T18:02:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:19 smithi191 ceph-mon[31636]: pgmap v14731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:02:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:19 smithi170 ceph-mon[31212]: pgmap v14731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:02:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:19 smithi077 ceph-mon[27902]: pgmap v14731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:02:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27450.620333 secs 2024-04-21T18:02:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27450.620333 secs 2024-04-21T18:02:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27450.620333 secs 2024-04-21T18:02:21.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:21 smithi191 ceph-mon[31636]: pgmap v14732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:02:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:21 smithi170 ceph-mon[31212]: pgmap v14732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:02:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:21 smithi077 ceph-mon[27902]: pgmap v14732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:02:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27453.861499 secs 2024-04-21T18:02:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:23 smithi191 ceph-mon[31636]: pgmap v14733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:02:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27453.861499 secs 2024-04-21T18:02:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:23 smithi170 ceph-mon[31212]: pgmap v14733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:02:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27453.861499 secs 2024-04-21T18:02:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:23 smithi077 ceph-mon[27902]: pgmap v14733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:02:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27455.620441 secs 2024-04-21T18:02:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:25 smithi191 ceph-mon[31636]: pgmap v14734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27455.620441 secs 2024-04-21T18:02:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:25 smithi170 ceph-mon[31212]: pgmap v14734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27455.620441 secs 2024-04-21T18:02:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:25 smithi077 ceph-mon[27902]: pgmap v14734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:27 smithi191 ceph-mon[31636]: pgmap v14735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:27 smithi170 ceph-mon[31212]: pgmap v14735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:27 smithi077 ceph-mon[27902]: pgmap v14735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27458.861628 secs 2024-04-21T18:02:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27458.861628 secs 2024-04-21T18:02:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27458.861628 secs 2024-04-21T18:02:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:29 smithi191 ceph-mon[31636]: pgmap v14736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:29 smithi170 ceph-mon[31212]: pgmap v14736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:29 smithi077 ceph-mon[27902]: pgmap v14736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27460.620558 secs 2024-04-21T18:02:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:02:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27460.620558 secs 2024-04-21T18:02:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:02:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27460.620558 secs 2024-04-21T18:02:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:02:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:31 smithi170 ceph-mon[31212]: pgmap v14737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:02:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:02:31.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:31 smithi077 ceph-mon[27902]: pgmap v14737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:02:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:02:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:31 smithi191 ceph-mon[31636]: pgmap v14737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:02:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:02:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:02:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27463.861751 secs 2024-04-21T18:02:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:33 smithi170 ceph-mon[31212]: pgmap v14738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27463.861751 secs 2024-04-21T18:02:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:33 smithi077 ceph-mon[27902]: pgmap v14738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27463.861751 secs 2024-04-21T18:02:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:33 smithi191 ceph-mon[31636]: pgmap v14738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27465.620694 secs 2024-04-21T18:02:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:35 smithi170 ceph-mon[31212]: pgmap v14739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27465.620694 secs 2024-04-21T18:02:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:35 smithi077 ceph-mon[27902]: pgmap v14739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27465.620694 secs 2024-04-21T18:02:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:35 smithi191 ceph-mon[31636]: pgmap v14739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:37 smithi170 ceph-mon[31212]: pgmap v14740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:37 smithi077 ceph-mon[27902]: pgmap v14740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:37 smithi191 ceph-mon[31636]: pgmap v14740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27468.861786 secs 2024-04-21T18:02:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27468.861786 secs 2024-04-21T18:02:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27468.861786 secs 2024-04-21T18:02:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:39 smithi170 ceph-mon[31212]: pgmap v14741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:39 smithi077 ceph-mon[27902]: pgmap v14741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:39 smithi191 ceph-mon[31636]: pgmap v14741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27470.620784 secs 2024-04-21T18:02:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27470.620784 secs 2024-04-21T18:02:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27470.620784 secs 2024-04-21T18:02:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:41 smithi170 ceph-mon[31212]: pgmap v14742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:41 smithi077 ceph-mon[27902]: pgmap v14742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:41 smithi191 ceph-mon[31636]: pgmap v14742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:02:43.152+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:02:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:02:43.152+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:02:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:02:43.152+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:02:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:02:43.153+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:02:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27473.861903 secs 2024-04-21T18:02:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:43 smithi170 ceph-mon[31212]: pgmap v14743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27473.861903 secs 2024-04-21T18:02:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:43 smithi077 ceph-mon[27902]: pgmap v14743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27473.861903 secs 2024-04-21T18:02:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:43 smithi191 ceph-mon[31636]: pgmap v14743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27475.620906 secs 2024-04-21T18:02:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:45 smithi170 ceph-mon[31212]: pgmap v14744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27475.620906 secs 2024-04-21T18:02:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:45 smithi077 ceph-mon[27902]: pgmap v14744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27475.620906 secs 2024-04-21T18:02:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:45 smithi191 ceph-mon[31636]: pgmap v14744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:47 smithi170 ceph-mon[31212]: pgmap v14745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:47 smithi077 ceph-mon[27902]: pgmap v14745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:47 smithi191 ceph-mon[31636]: pgmap v14745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27478.861968 secs 2024-04-21T18:02:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27478.861968 secs 2024-04-21T18:02:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27478.861968 secs 2024-04-21T18:02:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:49 smithi170 ceph-mon[31212]: pgmap v14746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:49 smithi077 ceph-mon[27902]: pgmap v14746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:49 smithi191 ceph-mon[31636]: pgmap v14746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27480.621017 secs 2024-04-21T18:02:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27480.621017 secs 2024-04-21T18:02:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27480.621017 secs 2024-04-21T18:02:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:51 smithi170 ceph-mon[31212]: pgmap v14747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:51 smithi077 ceph-mon[27902]: pgmap v14747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:51 smithi191 ceph-mon[31636]: pgmap v14747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27483.862082 secs 2024-04-21T18:02:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:53 smithi170 ceph-mon[31212]: pgmap v14748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27483.862082 secs 2024-04-21T18:02:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:53 smithi077 ceph-mon[27902]: pgmap v14748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27483.862082 secs 2024-04-21T18:02:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:53 smithi191 ceph-mon[31636]: pgmap v14748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:54.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27485.621094 secs 2024-04-21T18:02:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27485.621094 secs 2024-04-21T18:02:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27485.621094 secs 2024-04-21T18:02:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:02:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:55 smithi170 ceph-mon[31212]: pgmap v14749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:55 smithi077 ceph-mon[27902]: pgmap v14749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:55 smithi191 ceph-mon[31636]: pgmap v14749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:57 smithi170 ceph-mon[31212]: pgmap v14750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:57 smithi077 ceph-mon[27902]: pgmap v14750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:57 smithi191 ceph-mon[31636]: pgmap v14750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:02:58.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27488.862204 secs 2024-04-21T18:02:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27488.862204 secs 2024-04-21T18:02:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27488.862204 secs 2024-04-21T18:02:59.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:59 smithi170 ceph-mon[31212]: pgmap v14751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:02:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27490.621156 secs 2024-04-21T18:02:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:59 smithi077 ceph-mon[27902]: pgmap v14751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:02:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27490.621156 secs 2024-04-21T18:02:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:59 smithi191 ceph-mon[31636]: pgmap v14751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:02:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:02:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27490.621156 secs 2024-04-21T18:03:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:01 smithi170 ceph-mon[31212]: pgmap v14752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:01 smithi077 ceph-mon[27902]: pgmap v14752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:01 smithi191 ceph-mon[31636]: pgmap v14752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27493.862328 secs 2024-04-21T18:03:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:03 smithi077 ceph-mon[27902]: pgmap v14753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27493.862328 secs 2024-04-21T18:03:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:03 smithi191 ceph-mon[31636]: pgmap v14753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27493.862328 secs 2024-04-21T18:03:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:03 smithi170 ceph-mon[31212]: pgmap v14753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27495.621311 secs 2024-04-21T18:03:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27495.621311 secs 2024-04-21T18:03:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27495.621311 secs 2024-04-21T18:03:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:05 smithi077 ceph-mon[27902]: pgmap v14754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:03:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:05 smithi077 ceph-mon[27902]: osdmap e994: 12 total, 12 up, 12 in 2024-04-21T18:03:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:05 smithi191 ceph-mon[31636]: pgmap v14754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:03:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:05 smithi191 ceph-mon[31636]: osdmap e994: 12 total, 12 up, 12 in 2024-04-21T18:03:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:05 smithi170 ceph-mon[31212]: pgmap v14754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:03:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:05 smithi170 ceph-mon[31212]: osdmap e994: 12 total, 12 up, 12 in 2024-04-21T18:03:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:07 smithi077 ceph-mon[27902]: pgmap v14756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:03:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:07 smithi191 ceph-mon[31636]: pgmap v14756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:03:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:07 smithi170 ceph-mon[31212]: pgmap v14756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:03:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27498.862440 secs 2024-04-21T18:03:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:08 smithi191 ceph-mon[31636]: osdmap e995: 12 total, 12 up, 12 in 2024-04-21T18:03:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:08 smithi191 ceph-mon[31636]: pgmap v14758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:03:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27498.862440 secs 2024-04-21T18:03:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:08 smithi170 ceph-mon[31212]: osdmap e995: 12 total, 12 up, 12 in 2024-04-21T18:03:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:08 smithi170 ceph-mon[31212]: pgmap v14758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:03:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27498.862440 secs 2024-04-21T18:03:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:08 smithi077 ceph-mon[27902]: osdmap e995: 12 total, 12 up, 12 in 2024-04-21T18:03:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:08 smithi077 ceph-mon[27902]: pgmap v14758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:03:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27500.621373 secs 2024-04-21T18:03:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27500.621373 secs 2024-04-21T18:03:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27500.621373 secs 2024-04-21T18:03:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:10 smithi191 ceph-mon[31636]: pgmap v14759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:03:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:10 smithi170 ceph-mon[31212]: pgmap v14759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:03:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:10 smithi077 ceph-mon[27902]: pgmap v14759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:03:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27503.862559 secs 2024-04-21T18:03:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:13 smithi191 ceph-mon[31636]: pgmap v14760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:03:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27503.862559 secs 2024-04-21T18:03:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:13 smithi170 ceph-mon[31212]: pgmap v14760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:03:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27503.862559 secs 2024-04-21T18:03:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:13 smithi077 ceph-mon[27902]: pgmap v14760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:03:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27505.621478 secs 2024-04-21T18:03:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:15 smithi191 ceph-mon[31636]: pgmap v14761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:03:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27505.621478 secs 2024-04-21T18:03:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:15 smithi170 ceph-mon[31212]: pgmap v14761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:03:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27505.621478 secs 2024-04-21T18:03:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:15 smithi077 ceph-mon[27902]: pgmap v14761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:03:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:17 smithi191 ceph-mon[31636]: pgmap v14762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T18:03:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:17 smithi170 ceph-mon[31212]: pgmap v14762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T18:03:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:17 smithi077 ceph-mon[27902]: pgmap v14762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T18:03:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27508.862696 secs 2024-04-21T18:03:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27508.862696 secs 2024-04-21T18:03:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27508.862696 secs 2024-04-21T18:03:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:19 smithi191 ceph-mon[31636]: pgmap v14763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:03:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:19 smithi170 ceph-mon[31212]: pgmap v14763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:03:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:19 smithi077 ceph-mon[27902]: pgmap v14763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:03:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27510.621595 secs 2024-04-21T18:03:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27510.621595 secs 2024-04-21T18:03:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27510.621595 secs 2024-04-21T18:03:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:21 smithi191 ceph-mon[31636]: pgmap v14764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T18:03:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:21 smithi170 ceph-mon[31212]: pgmap v14764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T18:03:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:21 smithi077 ceph-mon[27902]: pgmap v14764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-21T18:03:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27513.862789 secs 2024-04-21T18:03:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:23 smithi191 ceph-mon[31636]: pgmap v14765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:03:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27513.862789 secs 2024-04-21T18:03:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:23 smithi170 ceph-mon[31212]: pgmap v14765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:03:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27513.862789 secs 2024-04-21T18:03:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:23 smithi077 ceph-mon[27902]: pgmap v14765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:03:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27515.621721 secs 2024-04-21T18:03:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:25 smithi191 ceph-mon[31636]: pgmap v14766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:03:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27515.621721 secs 2024-04-21T18:03:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:25 smithi170 ceph-mon[31212]: pgmap v14766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:03:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27515.621721 secs 2024-04-21T18:03:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:25 smithi077 ceph-mon[27902]: pgmap v14766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:03:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:27 smithi191 ceph-mon[31636]: pgmap v14767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:03:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:27 smithi170 ceph-mon[31212]: pgmap v14767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:03:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:27 smithi077 ceph-mon[27902]: pgmap v14767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:03:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27518.862914 secs 2024-04-21T18:03:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27518.862914 secs 2024-04-21T18:03:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27518.862914 secs 2024-04-21T18:03:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:29 smithi170 ceph-mon[31212]: pgmap v14768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:29 smithi077 ceph-mon[27902]: pgmap v14768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:29 smithi191 ceph-mon[31636]: pgmap v14768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27520.621808 secs 2024-04-21T18:03:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27520.621808 secs 2024-04-21T18:03:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27520.621808 secs 2024-04-21T18:03:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:31 smithi170 ceph-mon[31212]: pgmap v14769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:03:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:31 smithi077 ceph-mon[27902]: pgmap v14769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:03:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:31 smithi191 ceph-mon[31636]: pgmap v14769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:03:32.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27523.862981 secs 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: pgmap v14770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:03:32.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27523.862981 secs 2024-04-21T18:03:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: pgmap v14770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:03:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:03:32.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27523.862981 secs 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: pgmap v14770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:03:33.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:03:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:03:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27525.621933 secs 2024-04-21T18:03:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:35 smithi191 ceph-mon[31636]: pgmap v14771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27525.621933 secs 2024-04-21T18:03:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:35 smithi170 ceph-mon[31212]: pgmap v14771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27525.621933 secs 2024-04-21T18:03:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:35 smithi077 ceph-mon[27902]: pgmap v14771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:37 smithi191 ceph-mon[31636]: pgmap v14772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:37 smithi170 ceph-mon[31212]: pgmap v14772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:37 smithi077 ceph-mon[27902]: pgmap v14772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:38.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27528.863092 secs 2024-04-21T18:03:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27528.863092 secs 2024-04-21T18:03:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27528.863092 secs 2024-04-21T18:03:39.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:39 smithi191 ceph-mon[31636]: pgmap v14773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:39 smithi170 ceph-mon[31212]: pgmap v14773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:39 smithi077 ceph-mon[27902]: pgmap v14773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27530.622045 secs 2024-04-21T18:03:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27530.622045 secs 2024-04-21T18:03:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27530.622045 secs 2024-04-21T18:03:41.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:41 smithi191 ceph-mon[31636]: pgmap v14774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:41 smithi170 ceph-mon[31212]: pgmap v14774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:41 smithi077 ceph-mon[27902]: pgmap v14774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27533.863199 secs 2024-04-21T18:03:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:43 smithi191 ceph-mon[31636]: pgmap v14775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27533.863199 secs 2024-04-21T18:03:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:43 smithi170 ceph-mon[31212]: pgmap v14775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27533.863199 secs 2024-04-21T18:03:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:43 smithi077 ceph-mon[27902]: pgmap v14775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27535.622146 secs 2024-04-21T18:03:45.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:45 smithi191 ceph-mon[31636]: pgmap v14776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27535.622146 secs 2024-04-21T18:03:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:45 smithi170 ceph-mon[31212]: pgmap v14776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27535.622146 secs 2024-04-21T18:03:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:45 smithi077 ceph-mon[27902]: pgmap v14776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:47.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:47 smithi191 ceph-mon[31636]: pgmap v14777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:47 smithi170 ceph-mon[31212]: pgmap v14777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:47 smithi077 ceph-mon[27902]: pgmap v14777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:48.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27538.863315 secs 2024-04-21T18:03:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27538.863315 secs 2024-04-21T18:03:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27538.863315 secs 2024-04-21T18:03:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:49 smithi170 ceph-mon[31212]: pgmap v14778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:49 smithi077 ceph-mon[27902]: pgmap v14778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:49 smithi191 ceph-mon[31636]: pgmap v14778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27540.622232 secs 2024-04-21T18:03:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27540.622232 secs 2024-04-21T18:03:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27540.622232 secs 2024-04-21T18:03:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:51 smithi170 ceph-mon[31212]: pgmap v14779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:51 smithi077 ceph-mon[27902]: pgmap v14779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:51 smithi191 ceph-mon[31636]: pgmap v14779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27543.863391 secs 2024-04-21T18:03:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:53 smithi170 ceph-mon[31212]: pgmap v14780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27543.863391 secs 2024-04-21T18:03:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:53 smithi077 ceph-mon[27902]: pgmap v14780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27543.863391 secs 2024-04-21T18:03:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:53 smithi191 ceph-mon[31636]: pgmap v14780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:03:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27545.622376 secs 2024-04-21T18:03:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:55 smithi170 ceph-mon[31212]: pgmap v14781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27545.622376 secs 2024-04-21T18:03:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:55 smithi077 ceph-mon[27902]: pgmap v14781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27545.622376 secs 2024-04-21T18:03:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:55 smithi191 ceph-mon[31636]: pgmap v14781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:57 smithi170 ceph-mon[31212]: pgmap v14782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:57 smithi077 ceph-mon[27902]: pgmap v14782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:57 smithi191 ceph-mon[31636]: pgmap v14782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:03:58.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27548.863532 secs 2024-04-21T18:03:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27548.863532 secs 2024-04-21T18:03:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27548.863532 secs 2024-04-21T18:03:59.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:03:59 smithi170 ceph-mon[31212]: pgmap v14783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:03:59 smithi077 ceph-mon[27902]: pgmap v14783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:03:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:03:59 smithi191 ceph-mon[31636]: pgmap v14783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27550.622468 secs 2024-04-21T18:04:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27550.622468 secs 2024-04-21T18:04:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27550.622468 secs 2024-04-21T18:04:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:01 smithi170 ceph-mon[31212]: pgmap v14784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:01 smithi077 ceph-mon[27902]: pgmap v14784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:01 smithi191 ceph-mon[31636]: pgmap v14784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27553.863663 secs 2024-04-21T18:04:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:03 smithi170 ceph-mon[31212]: pgmap v14785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27553.863663 secs 2024-04-21T18:04:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:03 smithi077 ceph-mon[27902]: pgmap v14785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27553.863663 secs 2024-04-21T18:04:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:03 smithi191 ceph-mon[31636]: pgmap v14785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27555.622611 secs 2024-04-21T18:04:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:05 smithi170 ceph-mon[31212]: pgmap v14786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:05.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:05 smithi170 ceph-mon[31212]: osdmap e996: 12 total, 12 up, 12 in 2024-04-21T18:04:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27555.622611 secs 2024-04-21T18:04:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:05 smithi077 ceph-mon[27902]: pgmap v14786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:05 smithi077 ceph-mon[27902]: osdmap e996: 12 total, 12 up, 12 in 2024-04-21T18:04:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27555.622611 secs 2024-04-21T18:04:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:05 smithi191 ceph-mon[31636]: pgmap v14786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:05 smithi191 ceph-mon[31636]: osdmap e996: 12 total, 12 up, 12 in 2024-04-21T18:04:07.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:07 smithi170 ceph-mon[31212]: pgmap v14788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:04:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:07 smithi077 ceph-mon[27902]: pgmap v14788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:04:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:07 smithi191 ceph-mon[31636]: pgmap v14788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:04:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27558.863815 secs 2024-04-21T18:04:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:08 smithi191 ceph-mon[31636]: osdmap e997: 12 total, 12 up, 12 in 2024-04-21T18:04:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:08 smithi191 ceph-mon[31636]: pgmap v14790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:04:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27558.863815 secs 2024-04-21T18:04:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:08 smithi170 ceph-mon[31212]: osdmap e997: 12 total, 12 up, 12 in 2024-04-21T18:04:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:08 smithi170 ceph-mon[31212]: pgmap v14790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:04:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27558.863815 secs 2024-04-21T18:04:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:08 smithi077 ceph-mon[27902]: osdmap e997: 12 total, 12 up, 12 in 2024-04-21T18:04:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:08 smithi077 ceph-mon[27902]: pgmap v14790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:04:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27560.622730 secs 2024-04-21T18:04:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27560.622730 secs 2024-04-21T18:04:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27560.622730 secs 2024-04-21T18:04:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:10 smithi191 ceph-mon[31636]: pgmap v14791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:04:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:10 smithi170 ceph-mon[31212]: pgmap v14791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:04:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:10 smithi077 ceph-mon[27902]: pgmap v14791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:04:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27563.863933 secs 2024-04-21T18:04:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:13 smithi191 ceph-mon[31636]: pgmap v14792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:04:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27563.863933 secs 2024-04-21T18:04:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:13 smithi170 ceph-mon[31212]: pgmap v14792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:04:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27563.863933 secs 2024-04-21T18:04:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:13 smithi077 ceph-mon[27902]: pgmap v14792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:04:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27565.622842 secs 2024-04-21T18:04:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:15 smithi191 ceph-mon[31636]: pgmap v14793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:04:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27565.622842 secs 2024-04-21T18:04:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:15 smithi170 ceph-mon[31212]: pgmap v14793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:04:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27565.622842 secs 2024-04-21T18:04:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:15 smithi077 ceph-mon[27902]: pgmap v14793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:04:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:17 smithi191 ceph-mon[31636]: pgmap v14794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:04:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:17 smithi170 ceph-mon[31212]: pgmap v14794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:04:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:17 smithi077 ceph-mon[27902]: pgmap v14794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:04:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27568.864051 secs 2024-04-21T18:04:18.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27568.864051 secs 2024-04-21T18:04:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27568.864051 secs 2024-04-21T18:04:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:19 smithi191 ceph-mon[31636]: pgmap v14795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:04:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:19 smithi170 ceph-mon[31212]: pgmap v14795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:04:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:19 smithi077 ceph-mon[27902]: pgmap v14795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:04:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27570.622953 secs 2024-04-21T18:04:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27570.622953 secs 2024-04-21T18:04:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27570.622953 secs 2024-04-21T18:04:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:21 smithi170 ceph-mon[31212]: pgmap v14796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:04:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:21 smithi077 ceph-mon[27902]: pgmap v14796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:04:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:21 smithi191 ceph-mon[31636]: pgmap v14796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:04:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27573.864166 secs 2024-04-21T18:04:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:23 smithi170 ceph-mon[31212]: pgmap v14797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:04:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27573.864166 secs 2024-04-21T18:04:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:23 smithi077 ceph-mon[27902]: pgmap v14797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:04:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27573.864166 secs 2024-04-21T18:04:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:23 smithi191 ceph-mon[31636]: pgmap v14797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:04:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27575.623047 secs 2024-04-21T18:04:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:25 smithi170 ceph-mon[31212]: pgmap v14798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27575.623047 secs 2024-04-21T18:04:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:25 smithi077 ceph-mon[27902]: pgmap v14798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27575.623047 secs 2024-04-21T18:04:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:25 smithi191 ceph-mon[31636]: pgmap v14798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:27 smithi170 ceph-mon[31212]: pgmap v14799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:27 smithi077 ceph-mon[27902]: pgmap v14799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:27 smithi191 ceph-mon[31636]: pgmap v14799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27578.864288 secs 2024-04-21T18:04:28.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27578.864288 secs 2024-04-21T18:04:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27578.864288 secs 2024-04-21T18:04:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:29 smithi170 ceph-mon[31212]: pgmap v14800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:29 smithi077 ceph-mon[27902]: pgmap v14800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:29 smithi191 ceph-mon[31636]: pgmap v14800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27580.623114 secs 2024-04-21T18:04:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27580.623114 secs 2024-04-21T18:04:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27580.623114 secs 2024-04-21T18:04:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:31 smithi170 ceph-mon[31212]: pgmap v14801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:31 smithi077 ceph-mon[27902]: pgmap v14801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:31 smithi191 ceph-mon[31636]: pgmap v14801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27583.864420 secs 2024-04-21T18:04:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:33 smithi170 ceph-mon[31212]: pgmap v14802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:04:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:04:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:04:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:04:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27583.864420 secs 2024-04-21T18:04:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:33 smithi077 ceph-mon[27902]: pgmap v14802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:04:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:04:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:04:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:04:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27583.864420 secs 2024-04-21T18:04:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:33 smithi191 ceph-mon[31636]: pgmap v14802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:04:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:04:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:04:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:04:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27585.623240 secs 2024-04-21T18:04:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:35 smithi170 ceph-mon[31212]: pgmap v14803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27585.623240 secs 2024-04-21T18:04:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:35 smithi077 ceph-mon[27902]: pgmap v14803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27585.623240 secs 2024-04-21T18:04:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:35 smithi191 ceph-mon[31636]: pgmap v14803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:37.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:37 smithi170 ceph-mon[31212]: pgmap v14804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:37 smithi077 ceph-mon[27902]: pgmap v14804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:37 smithi191 ceph-mon[31636]: pgmap v14804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27588.864500 secs 2024-04-21T18:04:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27588.864500 secs 2024-04-21T18:04:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27588.864500 secs 2024-04-21T18:04:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:39 smithi170 ceph-mon[31212]: pgmap v14805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:39 smithi077 ceph-mon[27902]: pgmap v14805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:39 smithi191 ceph-mon[31636]: pgmap v14805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27590.623382 secs 2024-04-21T18:04:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27590.623382 secs 2024-04-21T18:04:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27590.623382 secs 2024-04-21T18:04:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:41 smithi170 ceph-mon[31212]: pgmap v14806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:41 smithi077 ceph-mon[27902]: pgmap v14806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:41 smithi191 ceph-mon[31636]: pgmap v14806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27593.864616 secs 2024-04-21T18:04:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:43 smithi170 ceph-mon[31212]: pgmap v14807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27593.864616 secs 2024-04-21T18:04:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:43 smithi077 ceph-mon[27902]: pgmap v14807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27593.864616 secs 2024-04-21T18:04:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:43 smithi191 ceph-mon[31636]: pgmap v14807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27595.623516 secs 2024-04-21T18:04:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:45 smithi170 ceph-mon[31212]: pgmap v14808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27595.623516 secs 2024-04-21T18:04:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:45 smithi077 ceph-mon[27902]: pgmap v14808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27595.623516 secs 2024-04-21T18:04:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:45 smithi191 ceph-mon[31636]: pgmap v14808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:47 smithi170 ceph-mon[31212]: pgmap v14809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:47 smithi077 ceph-mon[27902]: pgmap v14809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:47 smithi191 ceph-mon[31636]: pgmap v14809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27598.864719 secs 2024-04-21T18:04:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27598.864719 secs 2024-04-21T18:04:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27598.864719 secs 2024-04-21T18:04:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:49 smithi170 ceph-mon[31212]: pgmap v14810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:49 smithi077 ceph-mon[27902]: pgmap v14810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:49 smithi191 ceph-mon[31636]: pgmap v14810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27600.623636 secs 2024-04-21T18:04:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27600.623636 secs 2024-04-21T18:04:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27600.623636 secs 2024-04-21T18:04:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:51 smithi170 ceph-mon[31212]: pgmap v14811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:51 smithi077 ceph-mon[27902]: pgmap v14811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:51 smithi191 ceph-mon[31636]: pgmap v14811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27603.864840 secs 2024-04-21T18:04:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:53 smithi170 ceph-mon[31212]: pgmap v14812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27603.864840 secs 2024-04-21T18:04:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:53 smithi077 ceph-mon[27902]: pgmap v14812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27603.864840 secs 2024-04-21T18:04:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:53 smithi191 ceph-mon[31636]: pgmap v14812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27605.623755 secs 2024-04-21T18:04:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27605.623755 secs 2024-04-21T18:04:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27605.623755 secs 2024-04-21T18:04:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:04:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:55 smithi077 ceph-mon[27902]: pgmap v14813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:55 smithi191 ceph-mon[31636]: pgmap v14813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:55 smithi170 ceph-mon[31212]: pgmap v14813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:57 smithi077 ceph-mon[27902]: pgmap v14814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:57 smithi191 ceph-mon[31636]: pgmap v14814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:57 smithi170 ceph-mon[31212]: pgmap v14814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:04:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:04:58.170+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:04:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:04:58.170+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:04:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:04:58.170+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:04:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:04:58.170+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:04:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27608.864935 secs 2024-04-21T18:04:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27608.864935 secs 2024-04-21T18:04:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27608.864935 secs 2024-04-21T18:04:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:59 smithi077 ceph-mon[27902]: pgmap v14815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:04:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27610.623878 secs 2024-04-21T18:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:59 smithi191 ceph-mon[31636]: pgmap v14815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:04:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27610.623878 secs 2024-04-21T18:04:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:59 smithi170 ceph-mon[31212]: pgmap v14815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:04:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:04:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27610.623878 secs 2024-04-21T18:05:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:01 smithi077 ceph-mon[27902]: pgmap v14816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:01 smithi191 ceph-mon[31636]: pgmap v14816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:01 smithi170 ceph-mon[31212]: pgmap v14816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27613.864999 secs 2024-04-21T18:05:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:03 smithi077 ceph-mon[27902]: pgmap v14817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27613.864999 secs 2024-04-21T18:05:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:03 smithi191 ceph-mon[31636]: pgmap v14817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27613.864999 secs 2024-04-21T18:05:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:03 smithi170 ceph-mon[31212]: pgmap v14817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27615.623968 secs 2024-04-21T18:05:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27615.623968 secs 2024-04-21T18:05:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27615.623968 secs 2024-04-21T18:05:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:05 smithi077 ceph-mon[27902]: pgmap v14818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:05 smithi077 ceph-mon[27902]: osdmap e998: 12 total, 12 up, 12 in 2024-04-21T18:05:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:05 smithi191 ceph-mon[31636]: pgmap v14818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:05 smithi191 ceph-mon[31636]: osdmap e998: 12 total, 12 up, 12 in 2024-04-21T18:05:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:05 smithi170 ceph-mon[31212]: pgmap v14818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:05 smithi170 ceph-mon[31212]: osdmap e998: 12 total, 12 up, 12 in 2024-04-21T18:05:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:07 smithi077 ceph-mon[27902]: pgmap v14820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:05:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:07 smithi191 ceph-mon[31636]: pgmap v14820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:05:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:07 smithi170 ceph-mon[31212]: pgmap v14820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:05:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27618.865119 secs 2024-04-21T18:05:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:08 smithi191 ceph-mon[31636]: osdmap e999: 12 total, 12 up, 12 in 2024-04-21T18:05:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:08 smithi191 ceph-mon[31636]: pgmap v14822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:05:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27618.865119 secs 2024-04-21T18:05:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:08 smithi170 ceph-mon[31212]: osdmap e999: 12 total, 12 up, 12 in 2024-04-21T18:05:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:08 smithi170 ceph-mon[31212]: pgmap v14822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:05:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27618.865119 secs 2024-04-21T18:05:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:08 smithi077 ceph-mon[27902]: osdmap e999: 12 total, 12 up, 12 in 2024-04-21T18:05:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:08 smithi077 ceph-mon[27902]: pgmap v14822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:05:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27620.624080 secs 2024-04-21T18:05:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27620.624080 secs 2024-04-21T18:05:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27620.624080 secs 2024-04-21T18:05:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:10 smithi191 ceph-mon[31636]: pgmap v14823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:05:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:10 smithi170 ceph-mon[31212]: pgmap v14823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:05:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:10 smithi077 ceph-mon[27902]: pgmap v14823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:05:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27623.865234 secs 2024-04-21T18:05:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:13 smithi170 ceph-mon[31212]: pgmap v14824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:05:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27623.865234 secs 2024-04-21T18:05:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:13 smithi077 ceph-mon[27902]: pgmap v14824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:05:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27623.865234 secs 2024-04-21T18:05:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:13 smithi191 ceph-mon[31636]: pgmap v14824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:05:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27625.624190 secs 2024-04-21T18:05:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:15 smithi170 ceph-mon[31212]: pgmap v14825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:05:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27625.624190 secs 2024-04-21T18:05:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:15 smithi077 ceph-mon[27902]: pgmap v14825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:05:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27625.624190 secs 2024-04-21T18:05:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:15 smithi191 ceph-mon[31636]: pgmap v14825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:05:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:17 smithi170 ceph-mon[31212]: pgmap v14826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:05:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:17 smithi077 ceph-mon[27902]: pgmap v14826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:05:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:17 smithi191 ceph-mon[31636]: pgmap v14826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:05:18.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27628.865335 secs 2024-04-21T18:05:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27628.865335 secs 2024-04-21T18:05:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27628.865335 secs 2024-04-21T18:05:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:19 smithi170 ceph-mon[31212]: pgmap v14827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:05:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:19 smithi077 ceph-mon[27902]: pgmap v14827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:05:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:19 smithi191 ceph-mon[31636]: pgmap v14827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:05:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27630.624300 secs 2024-04-21T18:05:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27630.624300 secs 2024-04-21T18:05:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27630.624300 secs 2024-04-21T18:05:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:21 smithi170 ceph-mon[31212]: pgmap v14828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:05:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:21 smithi077 ceph-mon[27902]: pgmap v14828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:05:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:21 smithi191 ceph-mon[31636]: pgmap v14828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:05:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27633.865469 secs 2024-04-21T18:05:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:23 smithi170 ceph-mon[31212]: pgmap v14829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:05:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27633.865469 secs 2024-04-21T18:05:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:23 smithi077 ceph-mon[27902]: pgmap v14829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:05:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27633.865469 secs 2024-04-21T18:05:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:23 smithi191 ceph-mon[31636]: pgmap v14829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:05:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27635.624416 secs 2024-04-21T18:05:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:25 smithi170 ceph-mon[31212]: pgmap v14830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27635.624416 secs 2024-04-21T18:05:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:25 smithi077 ceph-mon[27902]: pgmap v14830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27635.624416 secs 2024-04-21T18:05:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:25 smithi191 ceph-mon[31636]: pgmap v14830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:27 smithi170 ceph-mon[31212]: pgmap v14831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:27 smithi077 ceph-mon[27902]: pgmap v14831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:27 smithi191 ceph-mon[31636]: pgmap v14831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27638.865586 secs 2024-04-21T18:05:28.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27638.865586 secs 2024-04-21T18:05:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27638.865586 secs 2024-04-21T18:05:29.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:29 smithi170 ceph-mon[31212]: pgmap v14832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:29 smithi077 ceph-mon[27902]: pgmap v14832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:29 smithi191 ceph-mon[31636]: pgmap v14832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27640.624533 secs 2024-04-21T18:05:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27640.624533 secs 2024-04-21T18:05:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27640.624533 secs 2024-04-21T18:05:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:31 smithi170 ceph-mon[31212]: pgmap v14833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:31 smithi077 ceph-mon[27902]: pgmap v14833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:31 smithi191 ceph-mon[31636]: pgmap v14833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27643.865686 secs 2024-04-21T18:05:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:33 smithi170 ceph-mon[31212]: pgmap v14834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:05:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27643.865686 secs 2024-04-21T18:05:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:33 smithi077 ceph-mon[27902]: pgmap v14834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:05:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27643.865686 secs 2024-04-21T18:05:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:33 smithi191 ceph-mon[31636]: pgmap v14834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:05:34.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:05:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:05:34.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:05:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:05:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:05:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:05:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:05:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:05:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:05:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27645.624645 secs 2024-04-21T18:05:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:35 smithi170 ceph-mon[31212]: pgmap v14835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27645.624645 secs 2024-04-21T18:05:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:35 smithi077 ceph-mon[27902]: pgmap v14835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27645.624645 secs 2024-04-21T18:05:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:35 smithi191 ceph-mon[31636]: pgmap v14835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:37 smithi170 ceph-mon[31212]: pgmap v14836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:37 smithi077 ceph-mon[27902]: pgmap v14836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:37 smithi191 ceph-mon[31636]: pgmap v14836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27648.865780 secs 2024-04-21T18:05:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27648.865780 secs 2024-04-21T18:05:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27648.865780 secs 2024-04-21T18:05:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:39 smithi170 ceph-mon[31212]: pgmap v14837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:39 smithi077 ceph-mon[27902]: pgmap v14837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:39 smithi191 ceph-mon[31636]: pgmap v14837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:40.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27650.624788 secs 2024-04-21T18:05:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27650.624788 secs 2024-04-21T18:05:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27650.624788 secs 2024-04-21T18:05:41.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:41 smithi170 ceph-mon[31212]: pgmap v14838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:41 smithi077 ceph-mon[27902]: pgmap v14838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:41 smithi191 ceph-mon[31636]: pgmap v14838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27653.865890 secs 2024-04-21T18:05:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:43 smithi170 ceph-mon[31212]: pgmap v14839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27653.865890 secs 2024-04-21T18:05:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:43 smithi077 ceph-mon[27902]: pgmap v14839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27653.865890 secs 2024-04-21T18:05:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:43 smithi191 ceph-mon[31636]: pgmap v14839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27655.624900 secs 2024-04-21T18:05:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:45 smithi170 ceph-mon[31212]: pgmap v14840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27655.624900 secs 2024-04-21T18:05:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:45 smithi077 ceph-mon[27902]: pgmap v14840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27655.624900 secs 2024-04-21T18:05:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:45 smithi191 ceph-mon[31636]: pgmap v14840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:47 smithi170 ceph-mon[31212]: pgmap v14841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:47 smithi077 ceph-mon[27902]: pgmap v14841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:47 smithi191 ceph-mon[31636]: pgmap v14841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27658.865990 secs 2024-04-21T18:05:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27658.865990 secs 2024-04-21T18:05:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27658.865990 secs 2024-04-21T18:05:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:49 smithi077 ceph-mon[27902]: pgmap v14842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:49 smithi191 ceph-mon[31636]: pgmap v14842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:49 smithi170 ceph-mon[31212]: pgmap v14842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:50.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27660.624994 secs 2024-04-21T18:05:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27660.624994 secs 2024-04-21T18:05:50.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27660.624994 secs 2024-04-21T18:05:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:51 smithi077 ceph-mon[27902]: pgmap v14843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:51 smithi191 ceph-mon[31636]: pgmap v14843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:51 smithi170 ceph-mon[31212]: pgmap v14843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27663.866100 secs 2024-04-21T18:05:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:53 smithi077 ceph-mon[27902]: pgmap v14844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27663.866100 secs 2024-04-21T18:05:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:53 smithi191 ceph-mon[31636]: pgmap v14844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27663.866100 secs 2024-04-21T18:05:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:53 smithi170 ceph-mon[31212]: pgmap v14844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27665.625110 secs 2024-04-21T18:05:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27665.625110 secs 2024-04-21T18:05:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27665.625110 secs 2024-04-21T18:05:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:05:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:55 smithi077 ceph-mon[27902]: pgmap v14845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:55 smithi191 ceph-mon[31636]: pgmap v14845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:55 smithi170 ceph-mon[31212]: pgmap v14845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:57 smithi077 ceph-mon[27902]: pgmap v14846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:57 smithi191 ceph-mon[31636]: pgmap v14846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:57 smithi170 ceph-mon[31212]: pgmap v14846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:05:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27668.866246 secs 2024-04-21T18:05:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27668.866246 secs 2024-04-21T18:05:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27668.866246 secs 2024-04-21T18:05:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:59 smithi077 ceph-mon[27902]: pgmap v14847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:05:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27670.625232 secs 2024-04-21T18:05:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:59 smithi191 ceph-mon[31636]: pgmap v14847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:05:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27670.625232 secs 2024-04-21T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:59 smithi170 ceph-mon[31212]: pgmap v14847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:05:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27670.625232 secs 2024-04-21T18:06:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:01 smithi077 ceph-mon[27902]: pgmap v14848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:01 smithi191 ceph-mon[31636]: pgmap v14848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:01 smithi170 ceph-mon[31212]: pgmap v14848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27673.866377 secs 2024-04-21T18:06:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:03 smithi077 ceph-mon[27902]: pgmap v14849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27673.866377 secs 2024-04-21T18:06:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:03 smithi191 ceph-mon[31636]: pgmap v14849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27673.866377 secs 2024-04-21T18:06:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:03 smithi170 ceph-mon[31212]: pgmap v14849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27675.625303 secs 2024-04-21T18:06:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27675.625303 secs 2024-04-21T18:06:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27675.625303 secs 2024-04-21T18:06:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:05 smithi077 ceph-mon[27902]: pgmap v14850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:05 smithi077 ceph-mon[27902]: osdmap e1000: 12 total, 12 up, 12 in 2024-04-21T18:06:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:05 smithi191 ceph-mon[31636]: pgmap v14850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:05 smithi191 ceph-mon[31636]: osdmap e1000: 12 total, 12 up, 12 in 2024-04-21T18:06:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:05 smithi170 ceph-mon[31212]: pgmap v14850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:05 smithi170 ceph-mon[31212]: osdmap e1000: 12 total, 12 up, 12 in 2024-04-21T18:06:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:07 smithi077 ceph-mon[27902]: pgmap v14852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:06:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:07 smithi191 ceph-mon[31636]: pgmap v14852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:06:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:07 smithi170 ceph-mon[31212]: pgmap v14852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:06:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27678.866483 secs 2024-04-21T18:06:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:08 smithi191 ceph-mon[31636]: osdmap e1001: 12 total, 12 up, 12 in 2024-04-21T18:06:08.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:08 smithi191 ceph-mon[31636]: pgmap v14854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:06:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27678.866483 secs 2024-04-21T18:06:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:08 smithi170 ceph-mon[31212]: osdmap e1001: 12 total, 12 up, 12 in 2024-04-21T18:06:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:08 smithi170 ceph-mon[31212]: pgmap v14854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:06:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27678.866483 secs 2024-04-21T18:06:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:08 smithi077 ceph-mon[27902]: osdmap e1001: 12 total, 12 up, 12 in 2024-04-21T18:06:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:08 smithi077 ceph-mon[27902]: pgmap v14854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:06:09.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27680.625412 secs 2024-04-21T18:06:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27680.625412 secs 2024-04-21T18:06:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27680.625412 secs 2024-04-21T18:06:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:10.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:10 smithi191 ceph-mon[31636]: pgmap v14855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:06:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:10 smithi170 ceph-mon[31212]: pgmap v14855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:06:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:10 smithi077 ceph-mon[27902]: pgmap v14855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:06:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27683.866604 secs 2024-04-21T18:06:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:13 smithi170 ceph-mon[31212]: pgmap v14856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:06:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27683.866604 secs 2024-04-21T18:06:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:13 smithi077 ceph-mon[27902]: pgmap v14856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:06:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27683.866604 secs 2024-04-21T18:06:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:13 smithi191 ceph-mon[31636]: pgmap v14856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:06:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27685.625529 secs 2024-04-21T18:06:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:15 smithi170 ceph-mon[31212]: pgmap v14857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:06:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27685.625529 secs 2024-04-21T18:06:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:15 smithi077 ceph-mon[27902]: pgmap v14857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:06:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27685.625529 secs 2024-04-21T18:06:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:15 smithi191 ceph-mon[31636]: pgmap v14857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:06:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:17 smithi170 ceph-mon[31212]: pgmap v14858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:06:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:17 smithi077 ceph-mon[27902]: pgmap v14858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:06:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:17 smithi191 ceph-mon[31636]: pgmap v14858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:06:18.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27688.866721 secs 2024-04-21T18:06:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27688.866721 secs 2024-04-21T18:06:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27688.866721 secs 2024-04-21T18:06:19.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:19 smithi170 ceph-mon[31212]: pgmap v14859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:06:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:19 smithi077 ceph-mon[27902]: pgmap v14859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:06:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:19 smithi191 ceph-mon[31636]: pgmap v14859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:06:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:20.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27690.625673 secs 2024-04-21T18:06:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27690.625673 secs 2024-04-21T18:06:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27690.625673 secs 2024-04-21T18:06:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:21 smithi170 ceph-mon[31212]: pgmap v14860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:06:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:21 smithi077 ceph-mon[27902]: pgmap v14860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:06:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:21 smithi191 ceph-mon[31636]: pgmap v14860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:06:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27693.866843 secs 2024-04-21T18:06:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:23 smithi170 ceph-mon[31212]: pgmap v14861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:06:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27693.866843 secs 2024-04-21T18:06:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:23 smithi077 ceph-mon[27902]: pgmap v14861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:06:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27693.866843 secs 2024-04-21T18:06:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:23 smithi191 ceph-mon[31636]: pgmap v14861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:06:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27695.625790 secs 2024-04-21T18:06:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:25 smithi170 ceph-mon[31212]: pgmap v14862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27695.625790 secs 2024-04-21T18:06:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:25 smithi077 ceph-mon[27902]: pgmap v14862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27695.625790 secs 2024-04-21T18:06:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:25 smithi191 ceph-mon[31636]: pgmap v14862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:27.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:27 smithi170 ceph-mon[31212]: pgmap v14863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:27 smithi077 ceph-mon[27902]: pgmap v14863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:27 smithi191 ceph-mon[31636]: pgmap v14863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27698.866944 secs 2024-04-21T18:06:28.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27698.866944 secs 2024-04-21T18:06:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27698.866944 secs 2024-04-21T18:06:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:29 smithi170 ceph-mon[31212]: pgmap v14864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:29 smithi077 ceph-mon[27902]: pgmap v14864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:29 smithi191 ceph-mon[31636]: pgmap v14864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27700.625922 secs 2024-04-21T18:06:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27700.625922 secs 2024-04-21T18:06:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27700.625922 secs 2024-04-21T18:06:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:31 smithi170 ceph-mon[31212]: pgmap v14865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:31 smithi077 ceph-mon[27902]: pgmap v14865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:31 smithi191 ceph-mon[31636]: pgmap v14865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27703.867050 secs 2024-04-21T18:06:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:33 smithi170 ceph-mon[31212]: pgmap v14866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27703.867050 secs 2024-04-21T18:06:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:33 smithi077 ceph-mon[27902]: pgmap v14866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27703.867050 secs 2024-04-21T18:06:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:33 smithi191 ceph-mon[31636]: pgmap v14866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:34.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:06:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:06:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:06:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27705.626025 secs 2024-04-21T18:06:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:35 smithi170 ceph-mon[31212]: pgmap v14867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:06:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:06:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:06:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27705.626025 secs 2024-04-21T18:06:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:35 smithi077 ceph-mon[27902]: pgmap v14867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:06:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:06:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:06:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27705.626025 secs 2024-04-21T18:06:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:35 smithi191 ceph-mon[31636]: pgmap v14867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:06:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:06:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:06:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:37 smithi170 ceph-mon[31212]: pgmap v14868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:37 smithi077 ceph-mon[27902]: pgmap v14868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:37 smithi191 ceph-mon[31636]: pgmap v14868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:38.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27708.867169 secs 2024-04-21T18:06:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27708.867169 secs 2024-04-21T18:06:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27708.867169 secs 2024-04-21T18:06:39.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:39 smithi170 ceph-mon[31212]: pgmap v14869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:39 smithi077 ceph-mon[27902]: pgmap v14869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:39 smithi191 ceph-mon[31636]: pgmap v14869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27710.626138 secs 2024-04-21T18:06:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27710.626138 secs 2024-04-21T18:06:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27710.626138 secs 2024-04-21T18:06:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:41 smithi077 ceph-mon[27902]: pgmap v14870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:41 smithi191 ceph-mon[31636]: pgmap v14870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:41 smithi170 ceph-mon[31212]: pgmap v14870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27713.867282 secs 2024-04-21T18:06:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:43 smithi077 ceph-mon[27902]: pgmap v14871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:06:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27713.867282 secs 2024-04-21T18:06:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:43 smithi191 ceph-mon[31636]: pgmap v14871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:06:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27713.867282 secs 2024-04-21T18:06:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:43 smithi170 ceph-mon[31212]: pgmap v14871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:06:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27715.626243 secs 2024-04-21T18:06:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:45 smithi077 ceph-mon[27902]: pgmap v14872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27715.626243 secs 2024-04-21T18:06:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:45 smithi191 ceph-mon[31636]: pgmap v14872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27715.626243 secs 2024-04-21T18:06:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:45 smithi170 ceph-mon[31212]: pgmap v14872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:47 smithi077 ceph-mon[27902]: pgmap v14873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:47 smithi191 ceph-mon[31636]: pgmap v14873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:47 smithi170 ceph-mon[31212]: pgmap v14873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27718.867406 secs 2024-04-21T18:06:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27718.867406 secs 2024-04-21T18:06:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27718.867406 secs 2024-04-21T18:06:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:49 smithi077 ceph-mon[27902]: pgmap v14874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27720.626357 secs 2024-04-21T18:06:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:49 smithi191 ceph-mon[31636]: pgmap v14874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27720.626357 secs 2024-04-21T18:06:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:49 smithi170 ceph-mon[31212]: pgmap v14874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27720.626357 secs 2024-04-21T18:06:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:51 smithi077 ceph-mon[27902]: pgmap v14875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:51 smithi191 ceph-mon[31636]: pgmap v14875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:51 smithi170 ceph-mon[31212]: pgmap v14875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:06:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27723.867524 secs 2024-04-21T18:06:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:53 smithi077 ceph-mon[27902]: pgmap v14876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:06:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27723.867524 secs 2024-04-21T18:06:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:53 smithi191 ceph-mon[31636]: pgmap v14876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:06:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27723.867524 secs 2024-04-21T18:06:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:53 smithi170 ceph-mon[31212]: pgmap v14876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:06:54.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27725.626473 secs 2024-04-21T18:06:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27725.626473 secs 2024-04-21T18:06:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27725.626473 secs 2024-04-21T18:06:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:06:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:55 smithi077 ceph-mon[27902]: pgmap v14877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:55 smithi191 ceph-mon[31636]: pgmap v14877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:55 smithi170 ceph-mon[31212]: pgmap v14877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:57 smithi077 ceph-mon[27902]: pgmap v14878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:57 smithi191 ceph-mon[31636]: pgmap v14878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:57 smithi170 ceph-mon[31212]: pgmap v14878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:06:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27728.867659 secs 2024-04-21T18:06:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27728.867659 secs 2024-04-21T18:06:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27728.867659 secs 2024-04-21T18:06:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:59 smithi077 ceph-mon[27902]: pgmap v14879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:06:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27730.626601 secs 2024-04-21T18:06:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:59 smithi191 ceph-mon[31636]: pgmap v14879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:06:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27730.626601 secs 2024-04-21T18:06:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:59 smithi170 ceph-mon[31212]: pgmap v14879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:06:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:06:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27730.626601 secs 2024-04-21T18:07:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:01 smithi077 ceph-mon[27902]: pgmap v14880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-21T18:07:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:01 smithi191 ceph-mon[31636]: pgmap v14880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-21T18:07:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:01 smithi170 ceph-mon[31212]: pgmap v14880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-21T18:07:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27733.867795 secs 2024-04-21T18:07:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:03 smithi077 ceph-mon[27902]: pgmap v14881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:07:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27733.867795 secs 2024-04-21T18:07:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:03 smithi191 ceph-mon[31636]: pgmap v14881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:07:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27733.867795 secs 2024-04-21T18:07:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:03 smithi170 ceph-mon[31212]: pgmap v14881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:07:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27735.626700 secs 2024-04-21T18:07:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27735.626700 secs 2024-04-21T18:07:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27735.626700 secs 2024-04-21T18:07:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:05 smithi077 ceph-mon[27902]: pgmap v14882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-04-21T18:07:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:05 smithi077 ceph-mon[27902]: osdmap e1002: 12 total, 12 up, 12 in 2024-04-21T18:07:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:05 smithi191 ceph-mon[31636]: pgmap v14882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-04-21T18:07:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:05 smithi191 ceph-mon[31636]: osdmap e1002: 12 total, 12 up, 12 in 2024-04-21T18:07:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:05 smithi170 ceph-mon[31212]: pgmap v14882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-04-21T18:07:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:05 smithi170 ceph-mon[31212]: osdmap e1002: 12 total, 12 up, 12 in 2024-04-21T18:07:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:07 smithi077 ceph-mon[27902]: pgmap v14884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:07:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:07 smithi191 ceph-mon[31636]: pgmap v14884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:07:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:07 smithi170 ceph-mon[31212]: pgmap v14884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:07:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27738.867903 secs 2024-04-21T18:07:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:08 smithi170 ceph-mon[31212]: osdmap e1003: 12 total, 12 up, 12 in 2024-04-21T18:07:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:08 smithi170 ceph-mon[31212]: pgmap v14886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 31 op/s 2024-04-21T18:07:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27738.867903 secs 2024-04-21T18:07:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:08 smithi077 ceph-mon[27902]: osdmap e1003: 12 total, 12 up, 12 in 2024-04-21T18:07:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:08 smithi077 ceph-mon[27902]: pgmap v14886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 31 op/s 2024-04-21T18:07:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27738.867903 secs 2024-04-21T18:07:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:08 smithi191 ceph-mon[31636]: osdmap e1003: 12 total, 12 up, 12 in 2024-04-21T18:07:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:08 smithi191 ceph-mon[31636]: pgmap v14886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 31 op/s 2024-04-21T18:07:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27740.626816 secs 2024-04-21T18:07:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27740.626816 secs 2024-04-21T18:07:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27740.626816 secs 2024-04-21T18:07:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:10 smithi170 ceph-mon[31212]: pgmap v14887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-04-21T18:07:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:10 smithi077 ceph-mon[27902]: pgmap v14887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-04-21T18:07:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:10 smithi191 ceph-mon[31636]: pgmap v14887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-04-21T18:07:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27743.868049 secs 2024-04-21T18:07:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:13 smithi170 ceph-mon[31212]: pgmap v14888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 42 KiB/s wr, 18 op/s 2024-04-21T18:07:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27743.868049 secs 2024-04-21T18:07:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:13 smithi077 ceph-mon[27902]: pgmap v14888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 42 KiB/s wr, 18 op/s 2024-04-21T18:07:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27743.868049 secs 2024-04-21T18:07:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:13 smithi191 ceph-mon[31636]: pgmap v14888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 42 KiB/s wr, 18 op/s 2024-04-21T18:07:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27745.626938 secs 2024-04-21T18:07:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:15 smithi170 ceph-mon[31212]: pgmap v14889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-04-21T18:07:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27745.626938 secs 2024-04-21T18:07:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:15 smithi077 ceph-mon[27902]: pgmap v14889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-04-21T18:07:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27745.626938 secs 2024-04-21T18:07:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:15 smithi191 ceph-mon[31636]: pgmap v14889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-04-21T18:07:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:17 smithi170 ceph-mon[31212]: pgmap v14890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:07:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:17 smithi077 ceph-mon[27902]: pgmap v14890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:07:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:17 smithi191 ceph-mon[31636]: pgmap v14890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:07:18.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27748.868191 secs 2024-04-21T18:07:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27748.868191 secs 2024-04-21T18:07:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27748.868191 secs 2024-04-21T18:07:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:19 smithi170 ceph-mon[31212]: pgmap v14891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:07:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:19 smithi077 ceph-mon[27902]: pgmap v14891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:07:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:19 smithi191 ceph-mon[31636]: pgmap v14891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:07:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27750.627045 secs 2024-04-21T18:07:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27750.627045 secs 2024-04-21T18:07:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27750.627045 secs 2024-04-21T18:07:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:21 smithi170 ceph-mon[31212]: pgmap v14892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:07:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:21 smithi077 ceph-mon[27902]: pgmap v14892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:07:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:21 smithi191 ceph-mon[31636]: pgmap v14892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:07:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27753.868289 secs 2024-04-21T18:07:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:23 smithi170 ceph-mon[31212]: pgmap v14893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T18:07:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27753.868289 secs 2024-04-21T18:07:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:23 smithi077 ceph-mon[27902]: pgmap v14893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T18:07:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27753.868289 secs 2024-04-21T18:07:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:23 smithi191 ceph-mon[31636]: pgmap v14893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T18:07:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27755.627123 secs 2024-04-21T18:07:25.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:25 smithi170 ceph-mon[31212]: pgmap v14894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27755.627123 secs 2024-04-21T18:07:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:25 smithi077 ceph-mon[27902]: pgmap v14894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27755.627123 secs 2024-04-21T18:07:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:25 smithi191 ceph-mon[31636]: pgmap v14894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:27 smithi170 ceph-mon[31212]: pgmap v14895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:27 smithi077 ceph-mon[27902]: pgmap v14895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:27 smithi191 ceph-mon[31636]: pgmap v14895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:28.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27758.868424 secs 2024-04-21T18:07:28.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27758.868424 secs 2024-04-21T18:07:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27758.868424 secs 2024-04-21T18:07:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:29 smithi170 ceph-mon[31212]: pgmap v14896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:29 smithi077 ceph-mon[27902]: pgmap v14896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:29 smithi191 ceph-mon[31636]: pgmap v14896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27760.627226 secs 2024-04-21T18:07:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27760.627226 secs 2024-04-21T18:07:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27760.627226 secs 2024-04-21T18:07:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:31 smithi170 ceph-mon[31212]: pgmap v14897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:31 smithi077 ceph-mon[27902]: pgmap v14897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:31 smithi191 ceph-mon[31636]: pgmap v14897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27763.868540 secs 2024-04-21T18:07:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:33 smithi170 ceph-mon[31212]: pgmap v14898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27763.868540 secs 2024-04-21T18:07:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:33 smithi077 ceph-mon[27902]: pgmap v14898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27763.868540 secs 2024-04-21T18:07:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:33 smithi191 ceph-mon[31636]: pgmap v14898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27765.627319 secs 2024-04-21T18:07:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:35 smithi077 ceph-mon[27902]: pgmap v14899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:07:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27765.627319 secs 2024-04-21T18:07:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:35 smithi191 ceph-mon[31636]: pgmap v14899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:07:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27765.627319 secs 2024-04-21T18:07:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:35 smithi170 ceph-mon[31212]: pgmap v14899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:07:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:07:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:07:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:07:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:07:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:07:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:07:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:07:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:07:36.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:07:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:37 smithi077 ceph-mon[27902]: pgmap v14900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:37 smithi191 ceph-mon[31636]: pgmap v14900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:37 smithi170 ceph-mon[31212]: pgmap v14900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27768.868659 secs 2024-04-21T18:07:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27768.868659 secs 2024-04-21T18:07:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27768.868659 secs 2024-04-21T18:07:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:39 smithi077 ceph-mon[27902]: pgmap v14901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27770.627459 secs 2024-04-21T18:07:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:39 smithi191 ceph-mon[31636]: pgmap v14901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27770.627459 secs 2024-04-21T18:07:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:39 smithi170 ceph-mon[31212]: pgmap v14901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27770.627459 secs 2024-04-21T18:07:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:41 smithi077 ceph-mon[27902]: pgmap v14902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:41 smithi191 ceph-mon[31636]: pgmap v14902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:41 smithi170 ceph-mon[31212]: pgmap v14902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27773.868796 secs 2024-04-21T18:07:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:43 smithi077 ceph-mon[27902]: pgmap v14903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27773.868796 secs 2024-04-21T18:07:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:43 smithi191 ceph-mon[31636]: pgmap v14903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27773.868796 secs 2024-04-21T18:07:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:43 smithi170 ceph-mon[31212]: pgmap v14903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27775.627580 secs 2024-04-21T18:07:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27775.627580 secs 2024-04-21T18:07:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27775.627580 secs 2024-04-21T18:07:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:45 smithi077 ceph-mon[27902]: pgmap v14904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:45 smithi191 ceph-mon[31636]: pgmap v14904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:45 smithi170 ceph-mon[31212]: pgmap v14904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:47 smithi077 ceph-mon[27902]: pgmap v14905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:47 smithi191 ceph-mon[31636]: pgmap v14905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:47 smithi170 ceph-mon[31212]: pgmap v14905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27778.868902 secs 2024-04-21T18:07:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27778.868902 secs 2024-04-21T18:07:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27778.868902 secs 2024-04-21T18:07:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:49 smithi077 ceph-mon[27902]: pgmap v14906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27780.627674 secs 2024-04-21T18:07:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:49 smithi191 ceph-mon[31636]: pgmap v14906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27780.627674 secs 2024-04-21T18:07:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:49 smithi170 ceph-mon[31212]: pgmap v14906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27780.627674 secs 2024-04-21T18:07:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:51 smithi191 ceph-mon[31636]: pgmap v14907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:51 smithi170 ceph-mon[31212]: pgmap v14907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:51 smithi077 ceph-mon[27902]: pgmap v14907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:07:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27783.869020 secs 2024-04-21T18:07:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:53 smithi191 ceph-mon[31636]: pgmap v14908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27783.869020 secs 2024-04-21T18:07:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:53 smithi170 ceph-mon[31212]: pgmap v14908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27783.869020 secs 2024-04-21T18:07:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:53 smithi077 ceph-mon[27902]: pgmap v14908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:07:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27785.627784 secs 2024-04-21T18:07:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27785.627784 secs 2024-04-21T18:07:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27785.627784 secs 2024-04-21T18:07:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:07:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:55 smithi191 ceph-mon[31636]: pgmap v14909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:55 smithi170 ceph-mon[31212]: pgmap v14909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:55 smithi077 ceph-mon[27902]: pgmap v14909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:57 smithi191 ceph-mon[31636]: pgmap v14910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:57 smithi170 ceph-mon[31212]: pgmap v14910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:57 smithi077 ceph-mon[27902]: pgmap v14910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:07:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:07:58.195+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:07:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:07:58.195+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:07:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:07:58.195+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:07:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:07:58.195+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:07:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27788.869136 secs 2024-04-21T18:07:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27788.869136 secs 2024-04-21T18:07:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27788.869136 secs 2024-04-21T18:07:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:59 smithi191 ceph-mon[31636]: pgmap v14911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27790.627920 secs 2024-04-21T18:07:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:59 smithi170 ceph-mon[31212]: pgmap v14911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27790.627920 secs 2024-04-21T18:07:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:59 smithi077 ceph-mon[27902]: pgmap v14911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:07:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27790.627920 secs 2024-04-21T18:08:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:01 smithi191 ceph-mon[31636]: pgmap v14912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:08:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:01 smithi170 ceph-mon[31212]: pgmap v14912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:08:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:01 smithi077 ceph-mon[27902]: pgmap v14912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:08:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27793.869207 secs 2024-04-21T18:08:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:03 smithi191 ceph-mon[31636]: pgmap v14913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27793.869207 secs 2024-04-21T18:08:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:03 smithi170 ceph-mon[31212]: pgmap v14913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27793.869207 secs 2024-04-21T18:08:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:03 smithi077 ceph-mon[27902]: pgmap v14913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27795.627985 secs 2024-04-21T18:08:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27795.627985 secs 2024-04-21T18:08:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27795.627985 secs 2024-04-21T18:08:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:05 smithi191 ceph-mon[31636]: pgmap v14914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:05 smithi191 ceph-mon[31636]: osdmap e1004: 12 total, 12 up, 12 in 2024-04-21T18:08:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:05 smithi170 ceph-mon[31212]: pgmap v14914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:05 smithi170 ceph-mon[31212]: osdmap e1004: 12 total, 12 up, 12 in 2024-04-21T18:08:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:05 smithi077 ceph-mon[27902]: pgmap v14914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:05 smithi077 ceph-mon[27902]: osdmap e1004: 12 total, 12 up, 12 in 2024-04-21T18:08:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:07 smithi191 ceph-mon[31636]: pgmap v14916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:08:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:07 smithi170 ceph-mon[31212]: pgmap v14916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:08:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:07 smithi077 ceph-mon[27902]: pgmap v14916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:08:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27798.869320 secs 2024-04-21T18:08:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:08 smithi170 ceph-mon[31212]: osdmap e1005: 12 total, 12 up, 12 in 2024-04-21T18:08:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:08 smithi170 ceph-mon[31212]: pgmap v14918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T18:08:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27798.869320 secs 2024-04-21T18:08:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:08 smithi077 ceph-mon[27902]: osdmap e1005: 12 total, 12 up, 12 in 2024-04-21T18:08:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:08 smithi077 ceph-mon[27902]: pgmap v14918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T18:08:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27798.869320 secs 2024-04-21T18:08:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:08 smithi191 ceph-mon[31636]: osdmap e1005: 12 total, 12 up, 12 in 2024-04-21T18:08:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:08 smithi191 ceph-mon[31636]: pgmap v14918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T18:08:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27800.628119 secs 2024-04-21T18:08:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27800.628119 secs 2024-04-21T18:08:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27800.628119 secs 2024-04-21T18:08:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:10 smithi170 ceph-mon[31212]: pgmap v14919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T18:08:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:10 smithi077 ceph-mon[27902]: pgmap v14919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T18:08:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:10 smithi191 ceph-mon[31636]: pgmap v14919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T18:08:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27803.869427 secs 2024-04-21T18:08:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:13 smithi170 ceph-mon[31212]: pgmap v14920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:08:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27803.869427 secs 2024-04-21T18:08:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:13 smithi077 ceph-mon[27902]: pgmap v14920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:08:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27803.869427 secs 2024-04-21T18:08:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:13 smithi191 ceph-mon[31636]: pgmap v14920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:08:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27805.628194 secs 2024-04-21T18:08:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:15 smithi170 ceph-mon[31212]: pgmap v14921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T18:08:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27805.628194 secs 2024-04-21T18:08:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:15 smithi077 ceph-mon[27902]: pgmap v14921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T18:08:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27805.628194 secs 2024-04-21T18:08:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:15 smithi191 ceph-mon[31636]: pgmap v14921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T18:08:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:17 smithi170 ceph-mon[31212]: pgmap v14922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:08:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:17 smithi077 ceph-mon[27902]: pgmap v14922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:08:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:17 smithi191 ceph-mon[31636]: pgmap v14922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:08:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27808.869566 secs 2024-04-21T18:08:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:18 smithi170 ceph-mon[31212]: pgmap v14923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:08:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27808.869566 secs 2024-04-21T18:08:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:18 smithi077 ceph-mon[27902]: pgmap v14923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:08:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27808.869566 secs 2024-04-21T18:08:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:18 smithi191 ceph-mon[31636]: pgmap v14923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:08:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27810.628313 secs 2024-04-21T18:08:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27810.628313 secs 2024-04-21T18:08:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27810.628313 secs 2024-04-21T18:08:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 27995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:20 smithi170 ceph-mon[31212]: pgmap v14924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:08:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:20 smithi077 ceph-mon[27902]: pgmap v14924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:08:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:20 smithi191 ceph-mon[31636]: pgmap v14924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:08:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27813.869681 secs 2024-04-21T18:08:23.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:23 smithi170 ceph-mon[31212]: pgmap v14925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T18:08:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27813.869681 secs 2024-04-21T18:08:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:23 smithi077 ceph-mon[27902]: pgmap v14925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T18:08:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27813.869681 secs 2024-04-21T18:08:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:23 smithi191 ceph-mon[31636]: pgmap v14925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T18:08:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27815.628378 secs 2024-04-21T18:08:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:25 smithi170 ceph-mon[31212]: pgmap v14926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27815.628378 secs 2024-04-21T18:08:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:25 smithi077 ceph-mon[27902]: pgmap v14926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27815.628378 secs 2024-04-21T18:08:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:25 smithi191 ceph-mon[31636]: pgmap v14926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:27 smithi170 ceph-mon[31212]: pgmap v14927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:27 smithi077 ceph-mon[27902]: pgmap v14927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:27 smithi191 ceph-mon[31636]: pgmap v14927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27818.869799 secs 2024-04-21T18:08:28.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27818.869799 secs 2024-04-21T18:08:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27818.869799 secs 2024-04-21T18:08:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:29 smithi170 ceph-mon[31212]: pgmap v14928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:29 smithi077 ceph-mon[27902]: pgmap v14928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:29 smithi191 ceph-mon[31636]: pgmap v14928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:30.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27820.628491 secs 2024-04-21T18:08:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27820.628491 secs 2024-04-21T18:08:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27820.628491 secs 2024-04-21T18:08:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:31 smithi170 ceph-mon[31212]: pgmap v14929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:31 smithi077 ceph-mon[27902]: pgmap v14929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:31 smithi191 ceph-mon[31636]: pgmap v14929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27823.869909 secs 2024-04-21T18:08:33.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:33 smithi170 ceph-mon[31212]: pgmap v14930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27823.869909 secs 2024-04-21T18:08:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:33 smithi077 ceph-mon[27902]: pgmap v14930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27823.869909 secs 2024-04-21T18:08:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:33 smithi191 ceph-mon[31636]: pgmap v14930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27825.628607 secs 2024-04-21T18:08:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:35 smithi170 ceph-mon[31212]: pgmap v14931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27825.628607 secs 2024-04-21T18:08:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:35 smithi077 ceph-mon[27902]: pgmap v14931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27825.628607 secs 2024-04-21T18:08:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:35 smithi191 ceph-mon[31636]: pgmap v14931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:36.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:08:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:08:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:08:36.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:08:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:08:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:08:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:08:36.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:08:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:08:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:08:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:08:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:08:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:37 smithi077 ceph-mon[27902]: pgmap v14932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:37 smithi191 ceph-mon[31636]: pgmap v14932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:37 smithi170 ceph-mon[31212]: pgmap v14932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27828.870016 secs 2024-04-21T18:08:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27828.870016 secs 2024-04-21T18:08:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27828.870016 secs 2024-04-21T18:08:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:39 smithi077 ceph-mon[27902]: pgmap v14933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:39 smithi191 ceph-mon[31636]: pgmap v14933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:39 smithi170 ceph-mon[31212]: pgmap v14933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:40.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27830.628737 secs 2024-04-21T18:08:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27830.628737 secs 2024-04-21T18:08:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27830.628737 secs 2024-04-21T18:08:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:41 smithi077 ceph-mon[27902]: pgmap v14934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:41 smithi191 ceph-mon[31636]: pgmap v14934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:41 smithi170 ceph-mon[31212]: pgmap v14934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27833.870130 secs 2024-04-21T18:08:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:43 smithi077 ceph-mon[27902]: pgmap v14935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27833.870130 secs 2024-04-21T18:08:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:43 smithi191 ceph-mon[31636]: pgmap v14935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27833.870130 secs 2024-04-21T18:08:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:43 smithi170 ceph-mon[31212]: pgmap v14935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27835.628838 secs 2024-04-21T18:08:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:45 smithi077 ceph-mon[27902]: pgmap v14936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27835.628838 secs 2024-04-21T18:08:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:45 smithi191 ceph-mon[31636]: pgmap v14936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27835.628838 secs 2024-04-21T18:08:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:45 smithi170 ceph-mon[31212]: pgmap v14936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:47 smithi077 ceph-mon[27902]: pgmap v14937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:47 smithi191 ceph-mon[31636]: pgmap v14937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:47 smithi170 ceph-mon[31212]: pgmap v14937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27838.870201 secs 2024-04-21T18:08:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27838.870201 secs 2024-04-21T18:08:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27838.870201 secs 2024-04-21T18:08:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:49 smithi077 ceph-mon[27902]: pgmap v14938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27840.628955 secs 2024-04-21T18:08:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:49 smithi191 ceph-mon[31636]: pgmap v14938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27840.628955 secs 2024-04-21T18:08:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:49 smithi170 ceph-mon[31212]: pgmap v14938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27840.628955 secs 2024-04-21T18:08:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:51 smithi077 ceph-mon[27902]: pgmap v14939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:51 smithi191 ceph-mon[31636]: pgmap v14939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:51 smithi170 ceph-mon[31212]: pgmap v14939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:08:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27843.870335 secs 2024-04-21T18:08:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:53 smithi077 ceph-mon[27902]: pgmap v14940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27843.870335 secs 2024-04-21T18:08:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:53 smithi191 ceph-mon[31636]: pgmap v14940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27843.870335 secs 2024-04-21T18:08:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:53 smithi170 ceph-mon[31212]: pgmap v14940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:08:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27845.629063 secs 2024-04-21T18:08:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27845.629063 secs 2024-04-21T18:08:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27845.629063 secs 2024-04-21T18:08:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:08:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:55 smithi077 ceph-mon[27902]: pgmap v14941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:55 smithi191 ceph-mon[31636]: pgmap v14941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:55 smithi170 ceph-mon[31212]: pgmap v14941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:57 smithi077 ceph-mon[27902]: pgmap v14942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:57 smithi191 ceph-mon[31636]: pgmap v14942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:57 smithi170 ceph-mon[31212]: pgmap v14942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:08:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27848.870449 secs 2024-04-21T18:08:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27848.870449 secs 2024-04-21T18:08:58.706 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27848.870449 secs 2024-04-21T18:08:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:59 smithi077 ceph-mon[27902]: pgmap v14943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27850.629182 secs 2024-04-21T18:08:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:59 smithi191 ceph-mon[31636]: pgmap v14943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27850.629182 secs 2024-04-21T18:08:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:59 smithi170 ceph-mon[31212]: pgmap v14943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:08:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27850.629182 secs 2024-04-21T18:09:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:01 smithi077 ceph-mon[27902]: pgmap v14944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:09:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:01 smithi191 ceph-mon[31636]: pgmap v14944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:09:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:01 smithi170 ceph-mon[31212]: pgmap v14944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T18:09:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27853.870568 secs 2024-04-21T18:09:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:03 smithi077 ceph-mon[27902]: pgmap v14945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:09:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27853.870568 secs 2024-04-21T18:09:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:03 smithi191 ceph-mon[31636]: pgmap v14945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:09:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27853.870568 secs 2024-04-21T18:09:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:03 smithi170 ceph-mon[31212]: pgmap v14945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T18:09:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27855.629297 secs 2024-04-21T18:09:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27855.629297 secs 2024-04-21T18:09:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27855.629297 secs 2024-04-21T18:09:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:05 smithi077 ceph-mon[27902]: pgmap v14946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:05 smithi077 ceph-mon[27902]: osdmap e1006: 12 total, 12 up, 12 in 2024-04-21T18:09:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:05 smithi191 ceph-mon[31636]: pgmap v14946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:05 smithi191 ceph-mon[31636]: osdmap e1006: 12 total, 12 up, 12 in 2024-04-21T18:09:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:05 smithi170 ceph-mon[31212]: pgmap v14946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:05 smithi170 ceph-mon[31212]: osdmap e1006: 12 total, 12 up, 12 in 2024-04-21T18:09:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:07 smithi077 ceph-mon[27902]: pgmap v14948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:09:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:07 smithi191 ceph-mon[31636]: pgmap v14948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:09:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:07 smithi170 ceph-mon[31212]: pgmap v14948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:09:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27858.870702 secs 2024-04-21T18:09:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:08 smithi170 ceph-mon[31212]: osdmap e1007: 12 total, 12 up, 12 in 2024-04-21T18:09:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:08 smithi170 ceph-mon[31212]: pgmap v14950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T18:09:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27858.870702 secs 2024-04-21T18:09:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:08 smithi077 ceph-mon[27902]: osdmap e1007: 12 total, 12 up, 12 in 2024-04-21T18:09:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:08 smithi077 ceph-mon[27902]: pgmap v14950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T18:09:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27858.870702 secs 2024-04-21T18:09:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:08 smithi191 ceph-mon[31636]: osdmap e1007: 12 total, 12 up, 12 in 2024-04-21T18:09:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:08 smithi191 ceph-mon[31636]: pgmap v14950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 31 op/s 2024-04-21T18:09:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27860.629433 secs 2024-04-21T18:09:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27860.629433 secs 2024-04-21T18:09:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27860.629433 secs 2024-04-21T18:09:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:10 smithi170 ceph-mon[31212]: pgmap v14951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:09:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:10 smithi077 ceph-mon[27902]: pgmap v14951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:09:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:10 smithi191 ceph-mon[31636]: pgmap v14951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:09:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27863.870832 secs 2024-04-21T18:09:13.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:13 smithi170 ceph-mon[31212]: pgmap v14952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:09:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27863.870832 secs 2024-04-21T18:09:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:13 smithi077 ceph-mon[27902]: pgmap v14952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:09:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27863.870832 secs 2024-04-21T18:09:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:13 smithi191 ceph-mon[31636]: pgmap v14952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:09:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27865.629569 secs 2024-04-21T18:09:15.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:15 smithi170 ceph-mon[31212]: pgmap v14953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:09:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27865.629569 secs 2024-04-21T18:09:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:15 smithi077 ceph-mon[27902]: pgmap v14953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:09:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27865.629569 secs 2024-04-21T18:09:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:15 smithi191 ceph-mon[31636]: pgmap v14953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:09:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:17 smithi170 ceph-mon[31212]: pgmap v14954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:09:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:17 smithi077 ceph-mon[27902]: pgmap v14954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:09:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:17 smithi191 ceph-mon[31636]: pgmap v14954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:09:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27868.870960 secs 2024-04-21T18:09:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27868.870960 secs 2024-04-21T18:09:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27868.870960 secs 2024-04-21T18:09:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:19 smithi170 ceph-mon[31212]: pgmap v14955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:09:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:19 smithi077 ceph-mon[27902]: pgmap v14955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:09:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:19 smithi191 ceph-mon[31636]: pgmap v14955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:09:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27870.629688 secs 2024-04-21T18:09:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27870.629688 secs 2024-04-21T18:09:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27870.629688 secs 2024-04-21T18:09:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:21 smithi077 ceph-mon[27902]: pgmap v14956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:09:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:21 smithi191 ceph-mon[31636]: pgmap v14956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:09:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:21 smithi170 ceph-mon[31212]: pgmap v14956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:09:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27873.871077 secs 2024-04-21T18:09:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:23 smithi077 ceph-mon[27902]: pgmap v14957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:09:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27873.871077 secs 2024-04-21T18:09:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:23 smithi191 ceph-mon[31636]: pgmap v14957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:09:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27873.871077 secs 2024-04-21T18:09:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:23 smithi170 ceph-mon[31212]: pgmap v14957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-21T18:09:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27875.629825 secs 2024-04-21T18:09:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:25 smithi077 ceph-mon[27902]: pgmap v14958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27875.629825 secs 2024-04-21T18:09:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:25 smithi191 ceph-mon[31636]: pgmap v14958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27875.629825 secs 2024-04-21T18:09:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:25 smithi170 ceph-mon[31212]: pgmap v14958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:27 smithi077 ceph-mon[27902]: pgmap v14959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:27 smithi191 ceph-mon[31636]: pgmap v14959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:27 smithi170 ceph-mon[31212]: pgmap v14959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:28.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27878.871170 secs 2024-04-21T18:09:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27878.871170 secs 2024-04-21T18:09:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27878.871170 secs 2024-04-21T18:09:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:29 smithi077 ceph-mon[27902]: pgmap v14960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:29 smithi191 ceph-mon[31636]: pgmap v14960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:29 smithi170 ceph-mon[31212]: pgmap v14960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27880.629948 secs 2024-04-21T18:09:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27880.629948 secs 2024-04-21T18:09:30.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27880.629948 secs 2024-04-21T18:09:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:31 smithi077 ceph-mon[27902]: pgmap v14961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:31 smithi191 ceph-mon[31636]: pgmap v14961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:31.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:31 smithi170 ceph-mon[31212]: pgmap v14961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27883.871307 secs 2024-04-21T18:09:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:33 smithi077 ceph-mon[27902]: pgmap v14962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27883.871307 secs 2024-04-21T18:09:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:33 smithi191 ceph-mon[31636]: pgmap v14962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27883.871307 secs 2024-04-21T18:09:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:33 smithi170 ceph-mon[31212]: pgmap v14962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27885.630062 secs 2024-04-21T18:09:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27885.630062 secs 2024-04-21T18:09:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27885.630062 secs 2024-04-21T18:09:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:35 smithi077 ceph-mon[27902]: pgmap v14963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:35 smithi191 ceph-mon[31636]: pgmap v14963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:35 smithi170 ceph-mon[31212]: pgmap v14963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:36.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:09:36.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:09:36.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:09:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:37 smithi077 ceph-mon[27902]: pgmap v14964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:09:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:09:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:09:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:37 smithi191 ceph-mon[31636]: pgmap v14964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:09:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:09:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:09:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:37 smithi170 ceph-mon[31212]: pgmap v14964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:09:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:09:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:09:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27888.871436 secs 2024-04-21T18:09:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27888.871436 secs 2024-04-21T18:09:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27888.871436 secs 2024-04-21T18:09:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:39 smithi077 ceph-mon[27902]: pgmap v14965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27890.630170 secs 2024-04-21T18:09:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:39 smithi191 ceph-mon[31636]: pgmap v14965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27890.630170 secs 2024-04-21T18:09:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:39 smithi170 ceph-mon[31212]: pgmap v14965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27890.630170 secs 2024-04-21T18:09:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:41 smithi077 ceph-mon[27902]: pgmap v14966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:41 smithi191 ceph-mon[31636]: pgmap v14966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:41 smithi170 ceph-mon[31212]: pgmap v14966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27893.871511 secs 2024-04-21T18:09:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:43 smithi077 ceph-mon[27902]: pgmap v14967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27893.871511 secs 2024-04-21T18:09:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:43 smithi191 ceph-mon[31636]: pgmap v14967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27893.871511 secs 2024-04-21T18:09:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:43 smithi170 ceph-mon[31212]: pgmap v14967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:44.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27895.630261 secs 2024-04-21T18:09:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27895.630261 secs 2024-04-21T18:09:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27895.630261 secs 2024-04-21T18:09:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:45 smithi077 ceph-mon[27902]: pgmap v14968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:45 smithi191 ceph-mon[31636]: pgmap v14968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:45 smithi170 ceph-mon[31212]: pgmap v14968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:47 smithi077 ceph-mon[27902]: pgmap v14969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:47 smithi191 ceph-mon[31636]: pgmap v14969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:47 smithi170 ceph-mon[31212]: pgmap v14969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27898.871628 secs 2024-04-21T18:09:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27898.871628 secs 2024-04-21T18:09:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27898.871628 secs 2024-04-21T18:09:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:49 smithi191 ceph-mon[31636]: pgmap v14970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27900.630374 secs 2024-04-21T18:09:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:49 smithi170 ceph-mon[31212]: pgmap v14970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27900.630374 secs 2024-04-21T18:09:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:49 smithi077 ceph-mon[27902]: pgmap v14970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27900.630374 secs 2024-04-21T18:09:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:51 smithi191 ceph-mon[31636]: pgmap v14971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:51 smithi170 ceph-mon[31212]: pgmap v14971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:51 smithi077 ceph-mon[27902]: pgmap v14971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27903.871748 secs 2024-04-21T18:09:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:53 smithi191 ceph-mon[31636]: pgmap v14972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27903.871748 secs 2024-04-21T18:09:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:53 smithi170 ceph-mon[31212]: pgmap v14972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27903.871748 secs 2024-04-21T18:09:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:53 smithi077 ceph-mon[27902]: pgmap v14972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:09:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27905.630505 secs 2024-04-21T18:09:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27905.630505 secs 2024-04-21T18:09:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27905.630505 secs 2024-04-21T18:09:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:09:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:55 smithi191 ceph-mon[31636]: pgmap v14973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:55 smithi170 ceph-mon[31212]: pgmap v14973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:55 smithi077 ceph-mon[27902]: pgmap v14973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:57 smithi191 ceph-mon[31636]: pgmap v14974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:57 smithi170 ceph-mon[31212]: pgmap v14974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:57 smithi077 ceph-mon[27902]: pgmap v14974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:09:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27908.871871 secs 2024-04-21T18:09:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27908.871871 secs 2024-04-21T18:09:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27908.871871 secs 2024-04-21T18:09:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:59 smithi191 ceph-mon[31636]: pgmap v14975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27910.630619 secs 2024-04-21T18:09:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:59 smithi170 ceph-mon[31212]: pgmap v14975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27910.630619 secs 2024-04-21T18:09:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:59 smithi077 ceph-mon[27902]: pgmap v14975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:09:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27910.630619 secs 2024-04-21T18:10:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:10:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:10:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:10:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:01 smithi191 ceph-mon[31636]: pgmap v14976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:01 smithi170 ceph-mon[31212]: pgmap v14976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:01 smithi077 ceph-mon[27902]: pgmap v14976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27913.871992 secs 2024-04-21T18:10:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:03 smithi191 ceph-mon[31636]: pgmap v14977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:10:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27913.871992 secs 2024-04-21T18:10:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:03 smithi170 ceph-mon[31212]: pgmap v14977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:10:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27913.871992 secs 2024-04-21T18:10:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:03 smithi077 ceph-mon[27902]: pgmap v14977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:10:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27915.630730 secs 2024-04-21T18:10:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27915.630730 secs 2024-04-21T18:10:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27915.630730 secs 2024-04-21T18:10:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:05 smithi191 ceph-mon[31636]: pgmap v14978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:05 smithi191 ceph-mon[31636]: osdmap e1008: 12 total, 12 up, 12 in 2024-04-21T18:10:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:05 smithi170 ceph-mon[31212]: pgmap v14978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:05 smithi170 ceph-mon[31212]: osdmap e1008: 12 total, 12 up, 12 in 2024-04-21T18:10:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:05 smithi077 ceph-mon[27902]: pgmap v14978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:05 smithi077 ceph-mon[27902]: osdmap e1008: 12 total, 12 up, 12 in 2024-04-21T18:10:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:07 smithi191 ceph-mon[31636]: pgmap v14980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:10:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:07 smithi170 ceph-mon[31212]: pgmap v14980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:10:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:07 smithi077 ceph-mon[27902]: pgmap v14980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:10:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27918.872109 secs 2024-04-21T18:10:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:08 smithi170 ceph-mon[31212]: osdmap e1009: 12 total, 12 up, 12 in 2024-04-21T18:10:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:08 smithi170 ceph-mon[31212]: pgmap v14982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:10:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27918.872109 secs 2024-04-21T18:10:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:08 smithi077 ceph-mon[27902]: osdmap e1009: 12 total, 12 up, 12 in 2024-04-21T18:10:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:08 smithi077 ceph-mon[27902]: pgmap v14982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:10:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27918.872109 secs 2024-04-21T18:10:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:08 smithi191 ceph-mon[31636]: osdmap e1009: 12 total, 12 up, 12 in 2024-04-21T18:10:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:08 smithi191 ceph-mon[31636]: pgmap v14982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:10:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27920.630872 secs 2024-04-21T18:10:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27920.630872 secs 2024-04-21T18:10:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27920.630872 secs 2024-04-21T18:10:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:10 smithi170 ceph-mon[31212]: pgmap v14983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:10:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:10 smithi077 ceph-mon[27902]: pgmap v14983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:10:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:10 smithi191 ceph-mon[31636]: pgmap v14983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:10:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27923.872185 secs 2024-04-21T18:10:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:13 smithi170 ceph-mon[31212]: pgmap v14984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:10:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27923.872185 secs 2024-04-21T18:10:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:13 smithi077 ceph-mon[27902]: pgmap v14984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:10:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27923.872185 secs 2024-04-21T18:10:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:13 smithi191 ceph-mon[31636]: pgmap v14984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:10:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27925.630946 secs 2024-04-21T18:10:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:15 smithi077 ceph-mon[27902]: pgmap v14985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:10:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27925.630946 secs 2024-04-21T18:10:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:15 smithi191 ceph-mon[31636]: pgmap v14985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:10:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27925.630946 secs 2024-04-21T18:10:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:15 smithi170 ceph-mon[31212]: pgmap v14985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:10:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:17 smithi077 ceph-mon[27902]: pgmap v14986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:10:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:17 smithi191 ceph-mon[31636]: pgmap v14986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:10:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:17 smithi170 ceph-mon[31212]: pgmap v14986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:10:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27928.872317 secs 2024-04-21T18:10:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27928.872317 secs 2024-04-21T18:10:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27928.872317 secs 2024-04-21T18:10:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:19 smithi077 ceph-mon[27902]: pgmap v14987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:10:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:19 smithi191 ceph-mon[31636]: pgmap v14987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:10:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:19 smithi170 ceph-mon[31212]: pgmap v14987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:10:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27930.631012 secs 2024-04-21T18:10:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27930.631012 secs 2024-04-21T18:10:20.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27930.631012 secs 2024-04-21T18:10:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:21 smithi077 ceph-mon[27902]: pgmap v14988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:10:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:21 smithi191 ceph-mon[31636]: pgmap v14988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:10:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:21 smithi170 ceph-mon[31212]: pgmap v14988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:10:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27933.872450 secs 2024-04-21T18:10:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:23 smithi077 ceph-mon[27902]: pgmap v14989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27933.872450 secs 2024-04-21T18:10:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:23 smithi191 ceph-mon[31636]: pgmap v14989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27933.872450 secs 2024-04-21T18:10:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:23 smithi170 ceph-mon[31212]: pgmap v14989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27935.631120 secs 2024-04-21T18:10:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:25 smithi077 ceph-mon[27902]: pgmap v14990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27935.631120 secs 2024-04-21T18:10:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:25 smithi191 ceph-mon[31636]: pgmap v14990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27935.631120 secs 2024-04-21T18:10:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:25 smithi170 ceph-mon[31212]: pgmap v14990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:27 smithi077 ceph-mon[27902]: pgmap v14991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:27 smithi191 ceph-mon[31636]: pgmap v14991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:27 smithi170 ceph-mon[31212]: pgmap v14991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:28.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27938.872568 secs 2024-04-21T18:10:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27938.872568 secs 2024-04-21T18:10:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27938.872568 secs 2024-04-21T18:10:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:29 smithi077 ceph-mon[27902]: pgmap v14992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:29 smithi191 ceph-mon[31636]: pgmap v14992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:29 smithi170 ceph-mon[31212]: pgmap v14992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27940.631238 secs 2024-04-21T18:10:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27940.631238 secs 2024-04-21T18:10:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27940.631238 secs 2024-04-21T18:10:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:31 smithi077 ceph-mon[27902]: pgmap v14993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:31 smithi191 ceph-mon[31636]: pgmap v14993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:31.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:31 smithi170 ceph-mon[31212]: pgmap v14993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27943.872688 secs 2024-04-21T18:10:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:33 smithi077 ceph-mon[27902]: pgmap v14994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27943.872688 secs 2024-04-21T18:10:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:33 smithi191 ceph-mon[31636]: pgmap v14994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27943.872688 secs 2024-04-21T18:10:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:33 smithi170 ceph-mon[31212]: pgmap v14994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27945.631354 secs 2024-04-21T18:10:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27945.631354 secs 2024-04-21T18:10:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27945.631354 secs 2024-04-21T18:10:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:35 smithi077 ceph-mon[27902]: pgmap v14995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:35 smithi191 ceph-mon[31636]: pgmap v14995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:35 smithi170 ceph-mon[31212]: pgmap v14995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:37 smithi077 ceph-mon[27902]: pgmap v14996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:10:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:37 smithi191 ceph-mon[31636]: pgmap v14996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:10:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:37 smithi170 ceph-mon[31212]: pgmap v14996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:10:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27948.872806 secs 2024-04-21T18:10:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:10:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:10:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:10:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27948.872806 secs 2024-04-21T18:10:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:10:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:10:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:10:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27948.872806 secs 2024-04-21T18:10:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:10:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:10:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:10:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:39 smithi077 ceph-mon[27902]: pgmap v14997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27950.631487 secs 2024-04-21T18:10:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:39 smithi191 ceph-mon[31636]: pgmap v14997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27950.631487 secs 2024-04-21T18:10:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:39 smithi170 ceph-mon[31212]: pgmap v14997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27950.631487 secs 2024-04-21T18:10:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:41 smithi077 ceph-mon[27902]: pgmap v14998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:41 smithi191 ceph-mon[31636]: pgmap v14998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:41 smithi170 ceph-mon[31212]: pgmap v14998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27953.872882 secs 2024-04-21T18:10:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:43 smithi077 ceph-mon[27902]: pgmap v14999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:43.673 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27953.872882 secs 2024-04-21T18:10:43.673 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:43 smithi170 ceph-mon[31212]: pgmap v14999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27953.872882 secs 2024-04-21T18:10:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:43 smithi191 ceph-mon[31636]: pgmap v14999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27955.631605 secs 2024-04-21T18:10:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27955.631605 secs 2024-04-21T18:10:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27955.631605 secs 2024-04-21T18:10:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:45 smithi077 ceph-mon[27902]: pgmap v15000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:45 smithi191 ceph-mon[31636]: pgmap v15000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:45 smithi170 ceph-mon[31212]: pgmap v15000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:47 smithi077 ceph-mon[27902]: pgmap v15001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:47 smithi191 ceph-mon[31636]: pgmap v15001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:47 smithi170 ceph-mon[31212]: pgmap v15001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27958.872970 secs 2024-04-21T18:10:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27958.872970 secs 2024-04-21T18:10:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27958.872970 secs 2024-04-21T18:10:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:49 smithi191 ceph-mon[31636]: pgmap v15002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27960.631733 secs 2024-04-21T18:10:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:49 smithi170 ceph-mon[31212]: pgmap v15002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27960.631733 secs 2024-04-21T18:10:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:49 smithi077 ceph-mon[27902]: pgmap v15002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27960.631733 secs 2024-04-21T18:10:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:51 smithi191 ceph-mon[31636]: pgmap v15003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:51 smithi170 ceph-mon[31212]: pgmap v15003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:51 smithi077 ceph-mon[27902]: pgmap v15003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27963.873106 secs 2024-04-21T18:10:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:53 smithi191 ceph-mon[31636]: pgmap v15004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27963.873106 secs 2024-04-21T18:10:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:53 smithi170 ceph-mon[31212]: pgmap v15004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27963.873106 secs 2024-04-21T18:10:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:53 smithi077 ceph-mon[27902]: pgmap v15004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27965.631849 secs 2024-04-21T18:10:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27965.631849 secs 2024-04-21T18:10:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27965.631849 secs 2024-04-21T18:10:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:10:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:55 smithi191 ceph-mon[31636]: pgmap v15005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:55 smithi170 ceph-mon[31212]: pgmap v15005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:55 smithi077 ceph-mon[27902]: pgmap v15005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:57 smithi191 ceph-mon[31636]: pgmap v15006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:57 smithi170 ceph-mon[31212]: pgmap v15006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:57 smithi077 ceph-mon[27902]: pgmap v15006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:10:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.219+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:10:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.219+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:10:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.220+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:10:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.220+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:10:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.220+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:10:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.220+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:10:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.220+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:10:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:10:58.220+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:10:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27968.873225 secs 2024-04-21T18:10:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27968.873225 secs 2024-04-21T18:10:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27968.873225 secs 2024-04-21T18:10:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:59 smithi191 ceph-mon[31636]: pgmap v15007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27970.631967 secs 2024-04-21T18:10:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:59 smithi170 ceph-mon[31212]: pgmap v15007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27970.631967 secs 2024-04-21T18:10:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:59 smithi077 ceph-mon[27902]: pgmap v15007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:10:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27970.631967 secs 2024-04-21T18:11:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:01 smithi191 ceph-mon[31636]: pgmap v15008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:01 smithi170 ceph-mon[31212]: pgmap v15008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:01 smithi077 ceph-mon[27902]: pgmap v15008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27973.873317 secs 2024-04-21T18:11:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:03 smithi191 ceph-mon[31636]: pgmap v15009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27973.873317 secs 2024-04-21T18:11:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:03 smithi170 ceph-mon[31212]: pgmap v15009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27973.873317 secs 2024-04-21T18:11:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:03 smithi077 ceph-mon[27902]: pgmap v15009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27975.632116 secs 2024-04-21T18:11:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27975.632116 secs 2024-04-21T18:11:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27975.632116 secs 2024-04-21T18:11:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:05 smithi191 ceph-mon[31636]: pgmap v15010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:05 smithi191 ceph-mon[31636]: osdmap e1010: 12 total, 12 up, 12 in 2024-04-21T18:11:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:05 smithi170 ceph-mon[31212]: pgmap v15010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:05 smithi170 ceph-mon[31212]: osdmap e1010: 12 total, 12 up, 12 in 2024-04-21T18:11:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:05 smithi077 ceph-mon[27902]: pgmap v15010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:05 smithi077 ceph-mon[27902]: osdmap e1010: 12 total, 12 up, 12 in 2024-04-21T18:11:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:07 smithi191 ceph-mon[31636]: pgmap v15012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:11:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:07 smithi170 ceph-mon[31212]: pgmap v15012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:11:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:07 smithi077 ceph-mon[27902]: pgmap v15012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:11:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27978.873439 secs 2024-04-21T18:11:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:08 smithi170 ceph-mon[31212]: osdmap e1011: 12 total, 12 up, 12 in 2024-04-21T18:11:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:08 smithi170 ceph-mon[31212]: pgmap v15014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:11:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27978.873439 secs 2024-04-21T18:11:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:08 smithi077 ceph-mon[27902]: osdmap e1011: 12 total, 12 up, 12 in 2024-04-21T18:11:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:08 smithi077 ceph-mon[27902]: pgmap v15014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:11:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27978.873439 secs 2024-04-21T18:11:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:08 smithi191 ceph-mon[31636]: osdmap e1011: 12 total, 12 up, 12 in 2024-04-21T18:11:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:08 smithi191 ceph-mon[31636]: pgmap v15014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:11:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27980.632229 secs 2024-04-21T18:11:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27980.632229 secs 2024-04-21T18:11:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27980.632229 secs 2024-04-21T18:11:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:10 smithi170 ceph-mon[31212]: pgmap v15015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:11:10.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:10 smithi077 ceph-mon[27902]: pgmap v15015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:11:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:10 smithi191 ceph-mon[31636]: pgmap v15015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:11:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27983.873566 secs 2024-04-21T18:11:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:13 smithi077 ceph-mon[27902]: pgmap v15016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:11:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27983.873566 secs 2024-04-21T18:11:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:13 smithi191 ceph-mon[31636]: pgmap v15016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:11:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27983.873566 secs 2024-04-21T18:11:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:13 smithi170 ceph-mon[31212]: pgmap v15016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:11:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27985.632323 secs 2024-04-21T18:11:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:15 smithi077 ceph-mon[27902]: pgmap v15017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:11:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27985.632323 secs 2024-04-21T18:11:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:15 smithi191 ceph-mon[31636]: pgmap v15017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:11:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27985.632323 secs 2024-04-21T18:11:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:15 smithi170 ceph-mon[31212]: pgmap v15017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:11:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:17 smithi077 ceph-mon[27902]: pgmap v15018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:11:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:17 smithi191 ceph-mon[31636]: pgmap v15018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:11:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:17 smithi170 ceph-mon[31212]: pgmap v15018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:11:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27988.873687 secs 2024-04-21T18:11:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:18 smithi170 ceph-mon[31212]: pgmap v15019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:11:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27988.873687 secs 2024-04-21T18:11:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:18 smithi077 ceph-mon[27902]: pgmap v15019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:11:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27988.873687 secs 2024-04-21T18:11:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:18 smithi191 ceph-mon[31636]: pgmap v15019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:11:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27990.632455 secs 2024-04-21T18:11:19.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27990.632455 secs 2024-04-21T18:11:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27990.632455 secs 2024-04-21T18:11:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:20 smithi170 ceph-mon[31212]: pgmap v15020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:11:20.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:20 smithi077 ceph-mon[27902]: pgmap v15020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:11:20.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:20 smithi191 ceph-mon[31636]: pgmap v15020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:11:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27993.873834 secs 2024-04-21T18:11:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:23 smithi077 ceph-mon[27902]: pgmap v15021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27993.873834 secs 2024-04-21T18:11:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:23 smithi191 ceph-mon[31636]: pgmap v15021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27993.873834 secs 2024-04-21T18:11:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:23 smithi170 ceph-mon[31212]: pgmap v15021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 27995.632596 secs 2024-04-21T18:11:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:25 smithi077 ceph-mon[27902]: pgmap v15022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 27995.632596 secs 2024-04-21T18:11:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:25 smithi191 ceph-mon[31636]: pgmap v15022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 27995.632596 secs 2024-04-21T18:11:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:25 smithi170 ceph-mon[31212]: pgmap v15022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:27 smithi077 ceph-mon[27902]: pgmap v15023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:27 smithi191 ceph-mon[31636]: pgmap v15023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:27 smithi170 ceph-mon[31212]: pgmap v15023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:28.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 27998.873976 secs 2024-04-21T18:11:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 27998.873976 secs 2024-04-21T18:11:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 27998.873976 secs 2024-04-21T18:11:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:29 smithi077 ceph-mon[27902]: pgmap v15024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:29 smithi191 ceph-mon[31636]: pgmap v15024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:29 smithi170 ceph-mon[31212]: pgmap v15024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28000.632700 secs 2024-04-21T18:11:30.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28000.632700 secs 2024-04-21T18:11:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28000.632700 secs 2024-04-21T18:11:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:31 smithi077 ceph-mon[27902]: pgmap v15025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:31 smithi191 ceph-mon[31636]: pgmap v15025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:31 smithi170 ceph-mon[31212]: pgmap v15025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28003.874089 secs 2024-04-21T18:11:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:33 smithi077 ceph-mon[27902]: pgmap v15026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28003.874089 secs 2024-04-21T18:11:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:33 smithi191 ceph-mon[31636]: pgmap v15026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28003.874089 secs 2024-04-21T18:11:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:33 smithi170 ceph-mon[31212]: pgmap v15026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28005.632819 secs 2024-04-21T18:11:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:35 smithi077 ceph-mon[27902]: pgmap v15027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28005.632819 secs 2024-04-21T18:11:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:35 smithi191 ceph-mon[31636]: pgmap v15027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28005.632819 secs 2024-04-21T18:11:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:35 smithi170 ceph-mon[31212]: pgmap v15027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:37 smithi077 ceph-mon[27902]: pgmap v15028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:37 smithi191 ceph-mon[31636]: pgmap v15028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:37 smithi170 ceph-mon[31212]: pgmap v15028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28008.874207 secs 2024-04-21T18:11:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:11:38.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28008.874207 secs 2024-04-21T18:11:38.658 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:11:38.738 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28008.874207 secs 2024-04-21T18:11:38.738 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:11:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:39 smithi077 ceph-mon[27902]: pgmap v15029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:39 smithi191 ceph-mon[31636]: pgmap v15029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:39 smithi170 ceph-mon[31212]: pgmap v15029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28010.633090 secs 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:11:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28010.633090 secs 2024-04-21T18:11:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:11:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:11:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28010.633090 secs 2024-04-21T18:11:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:11:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:11:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:11:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:11:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:11:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:11:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:11:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:11:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:11:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:11:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:41 smithi077 ceph-mon[27902]: pgmap v15030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:11:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:11:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:11:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:11:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:11:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:11:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:41 smithi191 ceph-mon[31636]: pgmap v15030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:11:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:11:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:11:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:11:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:11:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:11:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:41 smithi170 ceph-mon[31212]: pgmap v15030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28013.874336 secs 2024-04-21T18:11:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:43 smithi077 ceph-mon[27902]: pgmap v15031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28013.874336 secs 2024-04-21T18:11:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:43 smithi191 ceph-mon[31636]: pgmap v15031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28013.874336 secs 2024-04-21T18:11:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:43 smithi170 ceph-mon[31212]: pgmap v15031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28015.633213 secs 2024-04-21T18:11:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28015.633213 secs 2024-04-21T18:11:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28015.633213 secs 2024-04-21T18:11:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:45 smithi077 ceph-mon[27902]: pgmap v15032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:45 smithi191 ceph-mon[31636]: pgmap v15032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:45 smithi170 ceph-mon[31212]: pgmap v15032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:11:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:47 smithi077 ceph-mon[27902]: pgmap v15033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:47 smithi191 ceph-mon[31636]: pgmap v15033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:47 smithi170 ceph-mon[31212]: pgmap v15033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28018.874470 secs 2024-04-21T18:11:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28018.874470 secs 2024-04-21T18:11:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28018.874470 secs 2024-04-21T18:11:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:49 smithi077 ceph-mon[27902]: pgmap v15034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28020.633325 secs 2024-04-21T18:11:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:49 smithi191 ceph-mon[31636]: pgmap v15034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28020.633325 secs 2024-04-21T18:11:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:49 smithi170 ceph-mon[31212]: pgmap v15034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28020.633325 secs 2024-04-21T18:11:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:51 smithi191 ceph-mon[31636]: pgmap v15035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:51 smithi170 ceph-mon[31212]: pgmap v15035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:51 smithi077 ceph-mon[27902]: pgmap v15035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28023.874590 secs 2024-04-21T18:11:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:53 smithi191 ceph-mon[31636]: pgmap v15036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28023.874590 secs 2024-04-21T18:11:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:53 smithi170 ceph-mon[31212]: pgmap v15036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28023.874590 secs 2024-04-21T18:11:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:53 smithi077 ceph-mon[27902]: pgmap v15036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28025.633388 secs 2024-04-21T18:11:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28025.633388 secs 2024-04-21T18:11:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28025.633388 secs 2024-04-21T18:11:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:11:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:55 smithi191 ceph-mon[31636]: pgmap v15037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:55 smithi170 ceph-mon[31212]: pgmap v15037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:55 smithi077 ceph-mon[27902]: pgmap v15037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:57 smithi191 ceph-mon[31636]: pgmap v15038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:57 smithi170 ceph-mon[31212]: pgmap v15038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:57 smithi077 ceph-mon[27902]: pgmap v15038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:11:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28028.874707 secs 2024-04-21T18:11:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28028.874707 secs 2024-04-21T18:11:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28028.874707 secs 2024-04-21T18:11:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:59 smithi191 ceph-mon[31636]: pgmap v15039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28030.633513 secs 2024-04-21T18:11:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:59 smithi170 ceph-mon[31212]: pgmap v15039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28030.633513 secs 2024-04-21T18:11:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:59 smithi077 ceph-mon[27902]: pgmap v15039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:11:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28030.633513 secs 2024-04-21T18:12:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:01 smithi191 ceph-mon[31636]: pgmap v15040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:01 smithi170 ceph-mon[31212]: pgmap v15040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:01 smithi077 ceph-mon[27902]: pgmap v15040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28033.874839 secs 2024-04-21T18:12:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:03 smithi191 ceph-mon[31636]: pgmap v15041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28033.874839 secs 2024-04-21T18:12:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:03 smithi170 ceph-mon[31212]: pgmap v15041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28033.874839 secs 2024-04-21T18:12:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:03 smithi077 ceph-mon[27902]: pgmap v15041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28035.633662 secs 2024-04-21T18:12:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28035.633662 secs 2024-04-21T18:12:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28035.633662 secs 2024-04-21T18:12:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:05 smithi191 ceph-mon[31636]: pgmap v15042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:05 smithi191 ceph-mon[31636]: osdmap e1012: 12 total, 12 up, 12 in 2024-04-21T18:12:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:05 smithi170 ceph-mon[31212]: pgmap v15042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:05 smithi170 ceph-mon[31212]: osdmap e1012: 12 total, 12 up, 12 in 2024-04-21T18:12:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:05 smithi077 ceph-mon[27902]: pgmap v15042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:05 smithi077 ceph-mon[27902]: osdmap e1012: 12 total, 12 up, 12 in 2024-04-21T18:12:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:07 smithi191 ceph-mon[31636]: pgmap v15044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:12:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:07 smithi170 ceph-mon[31212]: pgmap v15044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:12:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:07 smithi077 ceph-mon[27902]: pgmap v15044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:12:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28038.874905 secs 2024-04-21T18:12:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:08 smithi170 ceph-mon[31212]: osdmap e1013: 12 total, 12 up, 12 in 2024-04-21T18:12:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:08 smithi170 ceph-mon[31212]: pgmap v15046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:12:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28038.874905 secs 2024-04-21T18:12:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:08 smithi077 ceph-mon[27902]: osdmap e1013: 12 total, 12 up, 12 in 2024-04-21T18:12:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:08 smithi077 ceph-mon[27902]: pgmap v15046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:12:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28038.874905 secs 2024-04-21T18:12:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:08 smithi191 ceph-mon[31636]: osdmap e1013: 12 total, 12 up, 12 in 2024-04-21T18:12:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:08 smithi191 ceph-mon[31636]: pgmap v15046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:12:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28040.633764 secs 2024-04-21T18:12:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28040.633764 secs 2024-04-21T18:12:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28040.633764 secs 2024-04-21T18:12:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:10.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:10 smithi170 ceph-mon[31212]: pgmap v15047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:12:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:10 smithi077 ceph-mon[27902]: pgmap v15047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:12:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:10 smithi191 ceph-mon[31636]: pgmap v15047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:12:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28043.875039 secs 2024-04-21T18:12:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:13 smithi077 ceph-mon[27902]: pgmap v15048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:12:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28043.875039 secs 2024-04-21T18:12:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:13 smithi191 ceph-mon[31636]: pgmap v15048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:12:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28043.875039 secs 2024-04-21T18:12:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:13 smithi170 ceph-mon[31212]: pgmap v15048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:12:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28045.633879 secs 2024-04-21T18:12:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:15 smithi077 ceph-mon[27902]: pgmap v15049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:12:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28045.633879 secs 2024-04-21T18:12:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:15 smithi191 ceph-mon[31636]: pgmap v15049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:12:15.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28045.633879 secs 2024-04-21T18:12:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:15 smithi170 ceph-mon[31212]: pgmap v15049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:12:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:17 smithi077 ceph-mon[27902]: pgmap v15050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:12:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:17 smithi191 ceph-mon[31636]: pgmap v15050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:12:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:17 smithi170 ceph-mon[31212]: pgmap v15050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:12:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28048.875159 secs 2024-04-21T18:12:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28048.875159 secs 2024-04-21T18:12:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28048.875159 secs 2024-04-21T18:12:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:19 smithi077 ceph-mon[27902]: pgmap v15051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:12:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:19 smithi191 ceph-mon[31636]: pgmap v15051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:12:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:19 smithi170 ceph-mon[31212]: pgmap v15051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:12:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28050.633984 secs 2024-04-21T18:12:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28050.633984 secs 2024-04-21T18:12:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28050.633984 secs 2024-04-21T18:12:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:21 smithi077 ceph-mon[27902]: pgmap v15052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:12:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:21 smithi191 ceph-mon[31636]: pgmap v15052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:12:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:21 smithi170 ceph-mon[31212]: pgmap v15052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:12:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28053.875271 secs 2024-04-21T18:12:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:23 smithi077 ceph-mon[27902]: pgmap v15053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28053.875271 secs 2024-04-21T18:12:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:23 smithi191 ceph-mon[31636]: pgmap v15053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28053.875271 secs 2024-04-21T18:12:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:23 smithi170 ceph-mon[31212]: pgmap v15053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28055.634074 secs 2024-04-21T18:12:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:25 smithi077 ceph-mon[27902]: pgmap v15054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28055.634074 secs 2024-04-21T18:12:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:25 smithi191 ceph-mon[31636]: pgmap v15054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28055.634074 secs 2024-04-21T18:12:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:25 smithi170 ceph-mon[31212]: pgmap v15054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:27 smithi077 ceph-mon[27902]: pgmap v15055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:27 smithi191 ceph-mon[31636]: pgmap v15055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:27 smithi170 ceph-mon[31212]: pgmap v15055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28058.875387 secs 2024-04-21T18:12:28.637 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28058.875387 secs 2024-04-21T18:12:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28058.875387 secs 2024-04-21T18:12:29.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:29 smithi077 ceph-mon[27902]: pgmap v15056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28060.634186 secs 2024-04-21T18:12:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:29 smithi191 ceph-mon[31636]: pgmap v15056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28060.634186 secs 2024-04-21T18:12:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:29 smithi170 ceph-mon[31212]: pgmap v15056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28060.634186 secs 2024-04-21T18:12:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:31 smithi077 ceph-mon[27902]: pgmap v15057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:31 smithi191 ceph-mon[31636]: pgmap v15057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:31.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:31 smithi170 ceph-mon[31212]: pgmap v15057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28063.875514 secs 2024-04-21T18:12:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:33 smithi077 ceph-mon[27902]: pgmap v15058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28063.875514 secs 2024-04-21T18:12:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:33 smithi191 ceph-mon[31636]: pgmap v15058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28063.875514 secs 2024-04-21T18:12:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:33 smithi170 ceph-mon[31212]: pgmap v15058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28065.634291 secs 2024-04-21T18:12:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28065.634291 secs 2024-04-21T18:12:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28065.634291 secs 2024-04-21T18:12:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:35 smithi191 ceph-mon[31636]: pgmap v15059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:35 smithi170 ceph-mon[31212]: pgmap v15059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:35 smithi077 ceph-mon[27902]: pgmap v15059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:37 smithi191 ceph-mon[31636]: pgmap v15060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:37 smithi170 ceph-mon[31212]: pgmap v15060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:37 smithi077 ceph-mon[27902]: pgmap v15060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28068.875667 secs 2024-04-21T18:12:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28068.875667 secs 2024-04-21T18:12:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28068.875667 secs 2024-04-21T18:12:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:39 smithi191 ceph-mon[31636]: pgmap v15061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28070.634424 secs 2024-04-21T18:12:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:39 smithi170 ceph-mon[31212]: pgmap v15061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28070.634424 secs 2024-04-21T18:12:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:39 smithi077 ceph-mon[27902]: pgmap v15061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28070.634424 secs 2024-04-21T18:12:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:40.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:12:40.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:12:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:12:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:41 smithi191 ceph-mon[31636]: pgmap v15062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:41 smithi170 ceph-mon[31212]: pgmap v15062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:41 smithi077 ceph-mon[27902]: pgmap v15062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:12:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:12:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:42.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:12:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:12:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:12:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:12:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:12:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28073.875799 secs 2024-04-21T18:12:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:43 smithi170 ceph-mon[31212]: pgmap v15063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28073.875799 secs 2024-04-21T18:12:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:43 smithi077 ceph-mon[27902]: pgmap v15063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28073.875799 secs 2024-04-21T18:12:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:43 smithi191 ceph-mon[31636]: pgmap v15063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28075.634546 secs 2024-04-21T18:12:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28075.634546 secs 2024-04-21T18:12:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28075.634546 secs 2024-04-21T18:12:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:45 smithi170 ceph-mon[31212]: pgmap v15064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:45 smithi077 ceph-mon[27902]: pgmap v15064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:45 smithi191 ceph-mon[31636]: pgmap v15064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:12:46.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:46 smithi170 ceph-mon[31212]: pgmap v15065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:46 smithi077 ceph-mon[27902]: pgmap v15065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:46 smithi191 ceph-mon[31636]: pgmap v15065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28078.875861 secs 2024-04-21T18:12:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28078.875861 secs 2024-04-21T18:12:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28078.875861 secs 2024-04-21T18:12:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:48 smithi191 ceph-mon[31636]: pgmap v15066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:48 smithi077 ceph-mon[27902]: pgmap v15066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:48 smithi170 ceph-mon[31212]: pgmap v15066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28080.634700 secs 2024-04-21T18:12:50.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28080.634700 secs 2024-04-21T18:12:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:50.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28080.634700 secs 2024-04-21T18:12:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:50 smithi191 ceph-mon[31636]: pgmap v15067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:51.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:50 smithi170 ceph-mon[31212]: pgmap v15067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:51.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:50 smithi077 ceph-mon[27902]: pgmap v15067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28083.875978 secs 2024-04-21T18:12:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:53 smithi077 ceph-mon[27902]: pgmap v15068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28083.875978 secs 2024-04-21T18:12:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:53 smithi191 ceph-mon[31636]: pgmap v15068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28083.875978 secs 2024-04-21T18:12:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:53 smithi170 ceph-mon[31212]: pgmap v15068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:12:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28085.634843 secs 2024-04-21T18:12:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:55 smithi077 ceph-mon[27902]: pgmap v15069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28085.634843 secs 2024-04-21T18:12:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:55 smithi191 ceph-mon[31636]: pgmap v15069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28085.634843 secs 2024-04-21T18:12:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:55 smithi170 ceph-mon[31212]: pgmap v15069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:57 smithi077 ceph-mon[27902]: pgmap v15070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:57 smithi191 ceph-mon[31636]: pgmap v15070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:57 smithi170 ceph-mon[31212]: pgmap v15070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:12:58.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28088.876089 secs 2024-04-21T18:12:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28088.876089 secs 2024-04-21T18:12:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28088.876089 secs 2024-04-21T18:12:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:12:59 smithi077 ceph-mon[27902]: pgmap v15071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:12:59 smithi191 ceph-mon[31636]: pgmap v15071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:12:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:12:59 smithi170 ceph-mon[31212]: pgmap v15071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28090.634938 secs 2024-04-21T18:13:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28090.634938 secs 2024-04-21T18:13:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28090.634938 secs 2024-04-21T18:13:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:01 smithi077 ceph-mon[27902]: pgmap v15072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T18:13:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:01 smithi191 ceph-mon[31636]: pgmap v15072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T18:13:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:01 smithi170 ceph-mon[31212]: pgmap v15072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T18:13:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28093.876198 secs 2024-04-21T18:13:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:03 smithi077 ceph-mon[27902]: pgmap v15073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T18:13:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28093.876198 secs 2024-04-21T18:13:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:03 smithi191 ceph-mon[31636]: pgmap v15073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T18:13:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28093.876198 secs 2024-04-21T18:13:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:03 smithi170 ceph-mon[31212]: pgmap v15073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T18:13:04.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28095.635006 secs 2024-04-21T18:13:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28095.635006 secs 2024-04-21T18:13:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28095.635006 secs 2024-04-21T18:13:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:05 smithi077 ceph-mon[27902]: pgmap v15074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T18:13:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:05 smithi077 ceph-mon[27902]: osdmap e1014: 12 total, 12 up, 12 in 2024-04-21T18:13:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:05 smithi191 ceph-mon[31636]: pgmap v15074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T18:13:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:05 smithi191 ceph-mon[31636]: osdmap e1014: 12 total, 12 up, 12 in 2024-04-21T18:13:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:05 smithi170 ceph-mon[31212]: pgmap v15074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T18:13:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:05 smithi170 ceph-mon[31212]: osdmap e1014: 12 total, 12 up, 12 in 2024-04-21T18:13:07.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:07 smithi077 ceph-mon[27902]: pgmap v15076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:13:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:07 smithi191 ceph-mon[31636]: pgmap v15076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:13:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:07 smithi170 ceph-mon[31212]: pgmap v15076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:13:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28098.876313 secs 2024-04-21T18:13:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:08 smithi170 ceph-mon[31212]: osdmap e1015: 12 total, 12 up, 12 in 2024-04-21T18:13:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:08 smithi170 ceph-mon[31212]: pgmap v15078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 33 KiB/s wr, 6 op/s 2024-04-21T18:13:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28098.876313 secs 2024-04-21T18:13:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:08 smithi077 ceph-mon[27902]: osdmap e1015: 12 total, 12 up, 12 in 2024-04-21T18:13:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:08 smithi077 ceph-mon[27902]: pgmap v15078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 33 KiB/s wr, 6 op/s 2024-04-21T18:13:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28098.876313 secs 2024-04-21T18:13:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:08 smithi191 ceph-mon[31636]: osdmap e1015: 12 total, 12 up, 12 in 2024-04-21T18:13:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:08 smithi191 ceph-mon[31636]: pgmap v15078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 33 KiB/s wr, 6 op/s 2024-04-21T18:13:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28100.635118 secs 2024-04-21T18:13:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28100.635118 secs 2024-04-21T18:13:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28100.635118 secs 2024-04-21T18:13:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:10 smithi077 ceph-mon[27902]: pgmap v15079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T18:13:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:10 smithi191 ceph-mon[31636]: pgmap v15079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T18:13:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:10 smithi170 ceph-mon[31212]: pgmap v15079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T18:13:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28103.876442 secs 2024-04-21T18:13:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:13 smithi077 ceph-mon[27902]: pgmap v15080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T18:13:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28103.876442 secs 2024-04-21T18:13:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:13 smithi191 ceph-mon[31636]: pgmap v15080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T18:13:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28103.876442 secs 2024-04-21T18:13:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:13 smithi170 ceph-mon[31212]: pgmap v15080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T18:13:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28105.635224 secs 2024-04-21T18:13:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:15 smithi077 ceph-mon[27902]: pgmap v15081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T18:13:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28105.635224 secs 2024-04-21T18:13:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:15 smithi191 ceph-mon[31636]: pgmap v15081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T18:13:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28105.635224 secs 2024-04-21T18:13:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:15 smithi170 ceph-mon[31212]: pgmap v15081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T18:13:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:17 smithi077 ceph-mon[27902]: pgmap v15082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:13:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:17 smithi191 ceph-mon[31636]: pgmap v15082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:13:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:17 smithi170 ceph-mon[31212]: pgmap v15082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:13:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28108.876566 secs 2024-04-21T18:13:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28108.876566 secs 2024-04-21T18:13:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28108.876566 secs 2024-04-21T18:13:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:19 smithi077 ceph-mon[27902]: pgmap v15083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:13:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:19 smithi191 ceph-mon[31636]: pgmap v15083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:13:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:19 smithi170 ceph-mon[31212]: pgmap v15083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:13:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28110.635339 secs 2024-04-21T18:13:20.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28110.635339 secs 2024-04-21T18:13:20.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28110.635339 secs 2024-04-21T18:13:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:21 smithi077 ceph-mon[27902]: pgmap v15084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:13:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:21 smithi191 ceph-mon[31636]: pgmap v15084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:13:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:21 smithi170 ceph-mon[31212]: pgmap v15084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:13:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28113.876686 secs 2024-04-21T18:13:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:23 smithi077 ceph-mon[27902]: pgmap v15085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28113.876686 secs 2024-04-21T18:13:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:23 smithi191 ceph-mon[31636]: pgmap v15085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28113.876686 secs 2024-04-21T18:13:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:23 smithi170 ceph-mon[31212]: pgmap v15085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28115.635476 secs 2024-04-21T18:13:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28115.635476 secs 2024-04-21T18:13:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28115.635476 secs 2024-04-21T18:13:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:25 smithi191 ceph-mon[31636]: pgmap v15086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:25 smithi170 ceph-mon[31212]: pgmap v15086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:25 smithi077 ceph-mon[27902]: pgmap v15086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:27 smithi191 ceph-mon[31636]: pgmap v15087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:27 smithi170 ceph-mon[31212]: pgmap v15087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:27 smithi077 ceph-mon[27902]: pgmap v15087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28118.876804 secs 2024-04-21T18:13:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28118.876804 secs 2024-04-21T18:13:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28118.876804 secs 2024-04-21T18:13:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:29 smithi191 ceph-mon[31636]: pgmap v15088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28120.635583 secs 2024-04-21T18:13:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:29 smithi170 ceph-mon[31212]: pgmap v15088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28120.635583 secs 2024-04-21T18:13:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:29 smithi077 ceph-mon[27902]: pgmap v15088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28120.635583 secs 2024-04-21T18:13:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:31 smithi191 ceph-mon[31636]: pgmap v15089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:31.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:31 smithi170 ceph-mon[31212]: pgmap v15089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:31 smithi077 ceph-mon[27902]: pgmap v15089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28123.876924 secs 2024-04-21T18:13:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:33 smithi191 ceph-mon[31636]: pgmap v15090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28123.876924 secs 2024-04-21T18:13:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:33 smithi170 ceph-mon[31212]: pgmap v15090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28123.876924 secs 2024-04-21T18:13:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:33 smithi077 ceph-mon[27902]: pgmap v15090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28125.635704 secs 2024-04-21T18:13:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28125.635704 secs 2024-04-21T18:13:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28125.635704 secs 2024-04-21T18:13:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:35 smithi191 ceph-mon[31636]: pgmap v15091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:35 smithi170 ceph-mon[31212]: pgmap v15091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:35 smithi077 ceph-mon[27902]: pgmap v15091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:37 smithi191 ceph-mon[31636]: pgmap v15092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:37 smithi170 ceph-mon[31212]: pgmap v15092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:37 smithi077 ceph-mon[27902]: pgmap v15092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28128.877048 secs 2024-04-21T18:13:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28128.877048 secs 2024-04-21T18:13:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28128.877048 secs 2024-04-21T18:13:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:39 smithi191 ceph-mon[31636]: pgmap v15093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28130.635820 secs 2024-04-21T18:13:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:39 smithi170 ceph-mon[31212]: pgmap v15093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28130.635820 secs 2024-04-21T18:13:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:39 smithi077 ceph-mon[27902]: pgmap v15093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28130.635820 secs 2024-04-21T18:13:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:41 smithi191 ceph-mon[31636]: pgmap v15094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:41 smithi170 ceph-mon[31212]: pgmap v15094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:41 smithi077 ceph-mon[27902]: pgmap v15094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:13:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:13:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:13:42.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:42.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28133.877127 secs 2024-04-21T18:13:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:43 smithi191 ceph-mon[31636]: pgmap v15095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:13:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:13:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28133.877127 secs 2024-04-21T18:13:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:43 smithi170 ceph-mon[31212]: pgmap v15095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:13:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:13:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28133.877127 secs 2024-04-21T18:13:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:43 smithi077 ceph-mon[27902]: pgmap v15095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:13:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:13:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:13:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28135.635957 secs 2024-04-21T18:13:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28135.635957 secs 2024-04-21T18:13:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28135.635957 secs 2024-04-21T18:13:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:45 smithi191 ceph-mon[31636]: pgmap v15096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:45 smithi170 ceph-mon[31212]: pgmap v15096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:45 smithi077 ceph-mon[27902]: pgmap v15096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:47 smithi191 ceph-mon[31636]: pgmap v15097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:47 smithi170 ceph-mon[31212]: pgmap v15097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:47 smithi077 ceph-mon[27902]: pgmap v15097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28138.877246 secs 2024-04-21T18:13:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28138.877246 secs 2024-04-21T18:13:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28138.877246 secs 2024-04-21T18:13:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:49 smithi191 ceph-mon[31636]: pgmap v15098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28140.636071 secs 2024-04-21T18:13:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:49 smithi077 ceph-mon[27902]: pgmap v15098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28140.636071 secs 2024-04-21T18:13:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:49 smithi170 ceph-mon[31212]: pgmap v15098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28140.636071 secs 2024-04-21T18:13:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:51 smithi191 ceph-mon[31636]: pgmap v15099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:51 smithi170 ceph-mon[31212]: pgmap v15099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:51 smithi077 ceph-mon[27902]: pgmap v15099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28143.877385 secs 2024-04-21T18:13:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:53 smithi191 ceph-mon[31636]: pgmap v15100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28143.877385 secs 2024-04-21T18:13:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:53 smithi170 ceph-mon[31212]: pgmap v15100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28143.877385 secs 2024-04-21T18:13:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:53 smithi077 ceph-mon[27902]: pgmap v15100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T18:13:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T18:13:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:13:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T18:13:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:13:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T18:13:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.450+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd7002b070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7efd70012bf0 tx=0x7efd7002b070 comp rx=0 tx=0).stop 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 msgr2=0x7efd640a5cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a49e0 0x7efd640a5cd0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:13:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:54.499+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efd70020640 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T18:13:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28145.636132 secs 2024-04-21T18:13:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28145.636132 secs 2024-04-21T18:13:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28145.636132 secs 2024-04-21T18:13:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:13:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:55 smithi191 ceph-mon[31636]: pgmap v15101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:55 smithi170 ceph-mon[31212]: pgmap v15101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:55 smithi077 ceph-mon[27902]: pgmap v15101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:57 smithi170 ceph-mon[31212]: pgmap v15102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:57 smithi077 ceph-mon[27902]: pgmap v15102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:57 smithi191 ceph-mon[31636]: pgmap v15102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:13:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:58.244+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:13:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:58.244+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:13:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:58.244+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:13:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:13:58.244+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:13:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28148.877504 secs 2024-04-21T18:13:58.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28148.877504 secs 2024-04-21T18:13:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28148.877504 secs 2024-04-21T18:13:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:59 smithi170 ceph-mon[31212]: pgmap v15103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28150.636250 secs 2024-04-21T18:13:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:59 smithi077 ceph-mon[27902]: pgmap v15103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28150.636250 secs 2024-04-21T18:13:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:59 smithi191 ceph-mon[31636]: pgmap v15103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:13:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28150.636250 secs 2024-04-21T18:14:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:01 smithi170 ceph-mon[31212]: pgmap v15104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T18:14:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:01 smithi077 ceph-mon[27902]: pgmap v15104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T18:14:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:01 smithi191 ceph-mon[31636]: pgmap v15104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T18:14:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28153.877601 secs 2024-04-21T18:14:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:03 smithi170 ceph-mon[31212]: pgmap v15105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:14:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28153.877601 secs 2024-04-21T18:14:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:03 smithi077 ceph-mon[27902]: pgmap v15105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:14:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28153.877601 secs 2024-04-21T18:14:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:03 smithi191 ceph-mon[31636]: pgmap v15105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:14:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28155.636369 secs 2024-04-21T18:14:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28155.636369 secs 2024-04-21T18:14:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28155.636369 secs 2024-04-21T18:14:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:05 smithi170 ceph-mon[31212]: pgmap v15106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:14:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:05 smithi170 ceph-mon[31212]: osdmap e1016: 12 total, 12 up, 12 in 2024-04-21T18:14:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:05 smithi077 ceph-mon[27902]: pgmap v15106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:14:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:05 smithi077 ceph-mon[27902]: osdmap e1016: 12 total, 12 up, 12 in 2024-04-21T18:14:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:05 smithi191 ceph-mon[31636]: pgmap v15106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:14:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:05 smithi191 ceph-mon[31636]: osdmap e1016: 12 total, 12 up, 12 in 2024-04-21T18:14:06.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:06 smithi170 ceph-mon[31212]: pgmap v15108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:14:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:06 smithi077 ceph-mon[27902]: pgmap v15108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:14:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:06 smithi191 ceph-mon[31636]: pgmap v15108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:14:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28158.877713 secs 2024-04-21T18:14:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:08 smithi077 ceph-mon[27902]: osdmap e1017: 12 total, 12 up, 12 in 2024-04-21T18:14:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:08 smithi077 ceph-mon[27902]: pgmap v15110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T18:14:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28158.877713 secs 2024-04-21T18:14:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:08 smithi191 ceph-mon[31636]: osdmap e1017: 12 total, 12 up, 12 in 2024-04-21T18:14:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:08 smithi191 ceph-mon[31636]: pgmap v15110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T18:14:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28158.877713 secs 2024-04-21T18:14:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:08 smithi170 ceph-mon[31212]: osdmap e1017: 12 total, 12 up, 12 in 2024-04-21T18:14:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:08 smithi170 ceph-mon[31212]: pgmap v15110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T18:14:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28160.636510 secs 2024-04-21T18:14:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28160.636510 secs 2024-04-21T18:14:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28160.636510 secs 2024-04-21T18:14:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:10 smithi077 ceph-mon[27902]: pgmap v15111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:14:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:10 smithi191 ceph-mon[31636]: pgmap v15111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:14:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:10 smithi170 ceph-mon[31212]: pgmap v15111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:14:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28163.877835 secs 2024-04-21T18:14:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:13 smithi077 ceph-mon[27902]: pgmap v15112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:14:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28163.877835 secs 2024-04-21T18:14:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:13 smithi191 ceph-mon[31636]: pgmap v15112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:14:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28163.877835 secs 2024-04-21T18:14:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:13 smithi170 ceph-mon[31212]: pgmap v15112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:14:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28165.636626 secs 2024-04-21T18:14:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:15 smithi077 ceph-mon[27902]: pgmap v15113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T18:14:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28165.636626 secs 2024-04-21T18:14:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:15 smithi191 ceph-mon[31636]: pgmap v15113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T18:14:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28165.636626 secs 2024-04-21T18:14:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:15 smithi170 ceph-mon[31212]: pgmap v15113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-04-21T18:14:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:17 smithi077 ceph-mon[27902]: pgmap v15114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:14:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:17 smithi191 ceph-mon[31636]: pgmap v15114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:14:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:17 smithi170 ceph-mon[31212]: pgmap v15114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:14:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28168.877977 secs 2024-04-21T18:14:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28168.877977 secs 2024-04-21T18:14:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28168.877977 secs 2024-04-21T18:14:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:19 smithi191 ceph-mon[31636]: pgmap v15115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:14:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28170.636758 secs 2024-04-21T18:14:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:19 smithi077 ceph-mon[27902]: pgmap v15115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:14:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28170.636758 secs 2024-04-21T18:14:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:19 smithi170 ceph-mon[31212]: pgmap v15115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:14:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28170.636758 secs 2024-04-21T18:14:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:21 smithi191 ceph-mon[31636]: pgmap v15116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:14:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:21 smithi170 ceph-mon[31212]: pgmap v15116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:14:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:21 smithi077 ceph-mon[27902]: pgmap v15116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:14:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28173.878084 secs 2024-04-21T18:14:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:23 smithi191 ceph-mon[31636]: pgmap v15117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28173.878084 secs 2024-04-21T18:14:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:23 smithi170 ceph-mon[31212]: pgmap v15117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28173.878084 secs 2024-04-21T18:14:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:23 smithi077 ceph-mon[27902]: pgmap v15117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28175.636893 secs 2024-04-21T18:14:24.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28175.636893 secs 2024-04-21T18:14:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28175.636893 secs 2024-04-21T18:14:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:25 smithi191 ceph-mon[31636]: pgmap v15118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:25 smithi170 ceph-mon[31212]: pgmap v15118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:25 smithi077 ceph-mon[27902]: pgmap v15118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:27 smithi191 ceph-mon[31636]: pgmap v15119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:27 smithi170 ceph-mon[31212]: pgmap v15119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:27 smithi077 ceph-mon[27902]: pgmap v15119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28178.878185 secs 2024-04-21T18:14:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28178.878185 secs 2024-04-21T18:14:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28178.878185 secs 2024-04-21T18:14:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:29 smithi191 ceph-mon[31636]: pgmap v15120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28180.637003 secs 2024-04-21T18:14:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:29 smithi170 ceph-mon[31212]: pgmap v15120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28180.637003 secs 2024-04-21T18:14:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:29 smithi077 ceph-mon[27902]: pgmap v15120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28180.637003 secs 2024-04-21T18:14:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:31 smithi191 ceph-mon[31636]: pgmap v15121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:31 smithi170 ceph-mon[31212]: pgmap v15121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:31 smithi077 ceph-mon[27902]: pgmap v15121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28183.878300 secs 2024-04-21T18:14:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:33 smithi191 ceph-mon[31636]: pgmap v15122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28183.878300 secs 2024-04-21T18:14:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:33 smithi170 ceph-mon[31212]: pgmap v15122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28183.878300 secs 2024-04-21T18:14:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:33 smithi077 ceph-mon[27902]: pgmap v15122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28185.637143 secs 2024-04-21T18:14:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28185.637143 secs 2024-04-21T18:14:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28185.637143 secs 2024-04-21T18:14:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:35 smithi191 ceph-mon[31636]: pgmap v15123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:35 smithi170 ceph-mon[31212]: pgmap v15123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:35 smithi077 ceph-mon[27902]: pgmap v15123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:37 smithi191 ceph-mon[31636]: pgmap v15124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:37 smithi170 ceph-mon[31212]: pgmap v15124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:37 smithi077 ceph-mon[27902]: pgmap v15124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28188.878440 secs 2024-04-21T18:14:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28188.878440 secs 2024-04-21T18:14:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28188.878440 secs 2024-04-21T18:14:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:39 smithi191 ceph-mon[31636]: pgmap v15125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28190.637256 secs 2024-04-21T18:14:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:39 smithi170 ceph-mon[31212]: pgmap v15125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28190.637256 secs 2024-04-21T18:14:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:39 smithi077 ceph-mon[27902]: pgmap v15125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28190.637256 secs 2024-04-21T18:14:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:41 smithi191 ceph-mon[31636]: pgmap v15126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:41 smithi170 ceph-mon[31212]: pgmap v15126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:41 smithi077 ceph-mon[27902]: pgmap v15126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28193.878549 secs 2024-04-21T18:14:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:43 smithi191 ceph-mon[31636]: pgmap v15127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:14:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28193.878549 secs 2024-04-21T18:14:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:43 smithi170 ceph-mon[31212]: pgmap v15127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:14:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28193.878549 secs 2024-04-21T18:14:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:43 smithi077 ceph-mon[27902]: pgmap v15127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:14:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:14:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:14:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:14:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28195.637407 secs 2024-04-21T18:14:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:14:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28195.637407 secs 2024-04-21T18:14:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:14:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:14:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:14:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28195.637407 secs 2024-04-21T18:14:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:45 smithi191 ceph-mon[31636]: pgmap v15128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:45 smithi170 ceph-mon[31212]: pgmap v15128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:45 smithi077 ceph-mon[27902]: pgmap v15128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:47 smithi191 ceph-mon[31636]: pgmap v15129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:47 smithi170 ceph-mon[31212]: pgmap v15129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:47 smithi077 ceph-mon[27902]: pgmap v15129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28198.878644 secs 2024-04-21T18:14:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28198.878644 secs 2024-04-21T18:14:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28198.878644 secs 2024-04-21T18:14:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:49 smithi191 ceph-mon[31636]: pgmap v15130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28200.637540 secs 2024-04-21T18:14:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:49 smithi077 ceph-mon[27902]: pgmap v15130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28200.637540 secs 2024-04-21T18:14:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:49 smithi170 ceph-mon[31212]: pgmap v15130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28200.637540 secs 2024-04-21T18:14:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:51 smithi170 ceph-mon[31212]: pgmap v15131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:51 smithi077 ceph-mon[27902]: pgmap v15131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:51 smithi191 ceph-mon[31636]: pgmap v15131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28203.878723 secs 2024-04-21T18:14:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:53 smithi170 ceph-mon[31212]: pgmap v15132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28203.878723 secs 2024-04-21T18:14:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:53 smithi077 ceph-mon[27902]: pgmap v15132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28203.878723 secs 2024-04-21T18:14:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:53 smithi191 ceph-mon[31636]: pgmap v15132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28205.637671 secs 2024-04-21T18:14:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28205.637671 secs 2024-04-21T18:14:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28205.637671 secs 2024-04-21T18:14:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:14:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:55 smithi170 ceph-mon[31212]: pgmap v15133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:55 smithi077 ceph-mon[27902]: pgmap v15133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:55.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:55 smithi191 ceph-mon[31636]: pgmap v15133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:57 smithi170 ceph-mon[31212]: pgmap v15134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:57 smithi077 ceph-mon[27902]: pgmap v15134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:57 smithi191 ceph-mon[31636]: pgmap v15134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:14:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28208.878816 secs 2024-04-21T18:14:58.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28208.878816 secs 2024-04-21T18:14:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28208.878816 secs 2024-04-21T18:14:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:59 smithi170 ceph-mon[31212]: pgmap v15135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28210.637779 secs 2024-04-21T18:14:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:59 smithi077 ceph-mon[27902]: pgmap v15135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28210.637779 secs 2024-04-21T18:14:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:59 smithi191 ceph-mon[31636]: pgmap v15135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:14:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28210.637779 secs 2024-04-21T18:15:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:01 smithi170 ceph-mon[31212]: pgmap v15136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:01 smithi077 ceph-mon[27902]: pgmap v15136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:01 smithi191 ceph-mon[31636]: pgmap v15136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28213.878957 secs 2024-04-21T18:15:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:03 smithi170 ceph-mon[31212]: pgmap v15137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28213.878957 secs 2024-04-21T18:15:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:03 smithi077 ceph-mon[27902]: pgmap v15137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28213.878957 secs 2024-04-21T18:15:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:03 smithi191 ceph-mon[31636]: pgmap v15137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28215.637892 secs 2024-04-21T18:15:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28215.637892 secs 2024-04-21T18:15:04.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28215.637892 secs 2024-04-21T18:15:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:05 smithi170 ceph-mon[31212]: pgmap v15138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:05 smithi170 ceph-mon[31212]: osdmap e1018: 12 total, 12 up, 12 in 2024-04-21T18:15:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:05 smithi077 ceph-mon[27902]: pgmap v15138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:05 smithi077 ceph-mon[27902]: osdmap e1018: 12 total, 12 up, 12 in 2024-04-21T18:15:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:05 smithi191 ceph-mon[31636]: pgmap v15138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:05 smithi191 ceph-mon[31636]: osdmap e1018: 12 total, 12 up, 12 in 2024-04-21T18:15:06.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:06 smithi170 ceph-mon[31212]: pgmap v15140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:15:06.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:06 smithi077 ceph-mon[27902]: pgmap v15140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:15:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:06 smithi191 ceph-mon[31636]: pgmap v15140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:15:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28218.879022 secs 2024-04-21T18:15:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:08 smithi077 ceph-mon[27902]: osdmap e1019: 12 total, 12 up, 12 in 2024-04-21T18:15:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:08 smithi077 ceph-mon[27902]: pgmap v15142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:15:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28218.879022 secs 2024-04-21T18:15:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:08 smithi191 ceph-mon[31636]: osdmap e1019: 12 total, 12 up, 12 in 2024-04-21T18:15:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:08 smithi191 ceph-mon[31636]: pgmap v15142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:15:09.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28218.879022 secs 2024-04-21T18:15:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:08 smithi170 ceph-mon[31212]: osdmap e1019: 12 total, 12 up, 12 in 2024-04-21T18:15:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:08 smithi170 ceph-mon[31212]: pgmap v15142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:15:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28220.637980 secs 2024-04-21T18:15:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28220.637980 secs 2024-04-21T18:15:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28220.637980 secs 2024-04-21T18:15:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:10 smithi077 ceph-mon[27902]: pgmap v15143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:15:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:10 smithi191 ceph-mon[31636]: pgmap v15143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:15:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:10 smithi170 ceph-mon[31212]: pgmap v15143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:15:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28223.879137 secs 2024-04-21T18:15:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:13 smithi191 ceph-mon[31636]: pgmap v15144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:15:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28223.879137 secs 2024-04-21T18:15:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:13 smithi170 ceph-mon[31212]: pgmap v15144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:15:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28223.879137 secs 2024-04-21T18:15:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:13 smithi077 ceph-mon[27902]: pgmap v15144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:15:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28225.638094 secs 2024-04-21T18:15:14.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28225.638094 secs 2024-04-21T18:15:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28225.638094 secs 2024-04-21T18:15:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:15 smithi191 ceph-mon[31636]: pgmap v15145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:15:15.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:15 smithi170 ceph-mon[31212]: pgmap v15145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:15:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:15 smithi077 ceph-mon[27902]: pgmap v15145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:15:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:17 smithi191 ceph-mon[31636]: pgmap v15146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:15:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:17 smithi170 ceph-mon[31212]: pgmap v15146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:15:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:17 smithi077 ceph-mon[27902]: pgmap v15146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:15:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28228.879204 secs 2024-04-21T18:15:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28228.879204 secs 2024-04-21T18:15:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28228.879204 secs 2024-04-21T18:15:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:19 smithi191 ceph-mon[31636]: pgmap v15147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:15:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28230.638158 secs 2024-04-21T18:15:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:19 smithi077 ceph-mon[27902]: pgmap v15147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:15:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28230.638158 secs 2024-04-21T18:15:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:19 smithi170 ceph-mon[31212]: pgmap v15147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:15:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28230.638158 secs 2024-04-21T18:15:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:21 smithi191 ceph-mon[31636]: pgmap v15148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:15:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:21 smithi170 ceph-mon[31212]: pgmap v15148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:15:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:21 smithi077 ceph-mon[27902]: pgmap v15148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:15:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28233.879344 secs 2024-04-21T18:15:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:23 smithi191 ceph-mon[31636]: pgmap v15149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28233.879344 secs 2024-04-21T18:15:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:23 smithi170 ceph-mon[31212]: pgmap v15149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28233.879344 secs 2024-04-21T18:15:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:23 smithi077 ceph-mon[27902]: pgmap v15149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28235.638282 secs 2024-04-21T18:15:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28235.638282 secs 2024-04-21T18:15:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28235.638282 secs 2024-04-21T18:15:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:25 smithi191 ceph-mon[31636]: pgmap v15150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:25 smithi170 ceph-mon[31212]: pgmap v15150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:25 smithi077 ceph-mon[27902]: pgmap v15150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:27 smithi191 ceph-mon[31636]: pgmap v15151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:27 smithi170 ceph-mon[31212]: pgmap v15151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:27 smithi077 ceph-mon[27902]: pgmap v15151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28238.879461 secs 2024-04-21T18:15:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28238.879461 secs 2024-04-21T18:15:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28238.879461 secs 2024-04-21T18:15:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:29 smithi191 ceph-mon[31636]: pgmap v15152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28240.638396 secs 2024-04-21T18:15:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:29 smithi170 ceph-mon[31212]: pgmap v15152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28240.638396 secs 2024-04-21T18:15:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:29 smithi077 ceph-mon[27902]: pgmap v15152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28240.638396 secs 2024-04-21T18:15:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:31 smithi191 ceph-mon[31636]: pgmap v15153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:31.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:31 smithi170 ceph-mon[31212]: pgmap v15153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:31 smithi077 ceph-mon[27902]: pgmap v15153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28243.879574 secs 2024-04-21T18:15:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:33 smithi191 ceph-mon[31636]: pgmap v15154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28243.879574 secs 2024-04-21T18:15:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:33 smithi170 ceph-mon[31212]: pgmap v15154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28243.879574 secs 2024-04-21T18:15:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:33 smithi077 ceph-mon[27902]: pgmap v15154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28245.638513 secs 2024-04-21T18:15:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28245.638513 secs 2024-04-21T18:15:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28245.638513 secs 2024-04-21T18:15:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:35 smithi191 ceph-mon[31636]: pgmap v15155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:35 smithi170 ceph-mon[31212]: pgmap v15155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:35 smithi077 ceph-mon[27902]: pgmap v15155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:37 smithi191 ceph-mon[31636]: pgmap v15156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:37.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:37 smithi170 ceph-mon[31212]: pgmap v15156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:37 smithi077 ceph-mon[27902]: pgmap v15156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28248.879668 secs 2024-04-21T18:15:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28248.879668 secs 2024-04-21T18:15:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28248.879668 secs 2024-04-21T18:15:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:39 smithi191 ceph-mon[31636]: pgmap v15157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28250.638630 secs 2024-04-21T18:15:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:39 smithi170 ceph-mon[31212]: pgmap v15157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28250.638630 secs 2024-04-21T18:15:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:39 smithi077 ceph-mon[27902]: pgmap v15157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28250.638630 secs 2024-04-21T18:15:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:41 smithi170 ceph-mon[31212]: pgmap v15158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:41 smithi077 ceph-mon[27902]: pgmap v15158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:41 smithi191 ceph-mon[31636]: pgmap v15158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28253.879831 secs 2024-04-21T18:15:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:43 smithi170 ceph-mon[31212]: pgmap v15159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28253.879831 secs 2024-04-21T18:15:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:43 smithi077 ceph-mon[27902]: pgmap v15159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28253.879831 secs 2024-04-21T18:15:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:43 smithi191 ceph-mon[31636]: pgmap v15159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:15:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28255.638712 secs 2024-04-21T18:15:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:15:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:15:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:15:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:15:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28255.638712 secs 2024-04-21T18:15:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:15:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:15:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:15:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:15:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28255.638712 secs 2024-04-21T18:15:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:15:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:15:44.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:15:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:45 smithi170 ceph-mon[31212]: pgmap v15160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:45 smithi077 ceph-mon[27902]: pgmap v15160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:45 smithi191 ceph-mon[31636]: pgmap v15160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:47 smithi170 ceph-mon[31212]: pgmap v15161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:47 smithi077 ceph-mon[27902]: pgmap v15161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:47 smithi191 ceph-mon[31636]: pgmap v15161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28258.879951 secs 2024-04-21T18:15:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28258.879951 secs 2024-04-21T18:15:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28258.879951 secs 2024-04-21T18:15:49.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:49 smithi077 ceph-mon[27902]: pgmap v15162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:49.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28260.638847 secs 2024-04-21T18:15:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:49 smithi170 ceph-mon[31212]: pgmap v15162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28260.638847 secs 2024-04-21T18:15:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:49 smithi191 ceph-mon[31636]: pgmap v15162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28260.638847 secs 2024-04-21T18:15:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:51 smithi170 ceph-mon[31212]: pgmap v15163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:51 smithi077 ceph-mon[27902]: pgmap v15163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:51 smithi191 ceph-mon[31636]: pgmap v15163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28263.880075 secs 2024-04-21T18:15:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:53 smithi170 ceph-mon[31212]: pgmap v15164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28263.880075 secs 2024-04-21T18:15:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:53 smithi077 ceph-mon[27902]: pgmap v15164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28263.880075 secs 2024-04-21T18:15:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:53 smithi191 ceph-mon[31636]: pgmap v15164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28265.638954 secs 2024-04-21T18:15:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28265.638954 secs 2024-04-21T18:15:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28265.638954 secs 2024-04-21T18:15:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:15:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:55 smithi170 ceph-mon[31212]: pgmap v15165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:55 smithi077 ceph-mon[27902]: pgmap v15165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:55 smithi191 ceph-mon[31636]: pgmap v15165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:57 smithi170 ceph-mon[31212]: pgmap v15166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:57 smithi077 ceph-mon[27902]: pgmap v15166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:57 smithi191 ceph-mon[31636]: pgmap v15166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:15:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28268.880194 secs 2024-04-21T18:15:58.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28268.880194 secs 2024-04-21T18:15:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28268.880194 secs 2024-04-21T18:15:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:59 smithi170 ceph-mon[31212]: pgmap v15167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28270.639065 secs 2024-04-21T18:15:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:59 smithi077 ceph-mon[27902]: pgmap v15167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28270.639065 secs 2024-04-21T18:15:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:59 smithi191 ceph-mon[31636]: pgmap v15167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:15:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28270.639065 secs 2024-04-21T18:16:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:00.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:00 smithi170 ceph-mon[31212]: pgmap v15168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:00 smithi077 ceph-mon[27902]: pgmap v15168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:00 smithi191 ceph-mon[31636]: pgmap v15168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28273.880321 secs 2024-04-21T18:16:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:03 smithi191 ceph-mon[31636]: pgmap v15169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28273.880321 secs 2024-04-21T18:16:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:03 smithi170 ceph-mon[31212]: pgmap v15169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28273.880321 secs 2024-04-21T18:16:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:03 smithi077 ceph-mon[27902]: pgmap v15169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:04.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28275.639177 secs 2024-04-21T18:16:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28275.639177 secs 2024-04-21T18:16:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28275.639177 secs 2024-04-21T18:16:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:05 smithi191 ceph-mon[31636]: pgmap v15170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:05.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:05 smithi191 ceph-mon[31636]: osdmap e1020: 12 total, 12 up, 12 in 2024-04-21T18:16:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:05 smithi170 ceph-mon[31212]: pgmap v15170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:05 smithi170 ceph-mon[31212]: osdmap e1020: 12 total, 12 up, 12 in 2024-04-21T18:16:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:05 smithi077 ceph-mon[27902]: pgmap v15170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:05 smithi077 ceph-mon[27902]: osdmap e1020: 12 total, 12 up, 12 in 2024-04-21T18:16:07.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:07 smithi191 ceph-mon[31636]: pgmap v15172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:16:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:07 smithi170 ceph-mon[31212]: pgmap v15172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:16:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:07 smithi077 ceph-mon[27902]: pgmap v15172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:16:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28278.880460 secs 2024-04-21T18:16:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:08 smithi077 ceph-mon[27902]: osdmap e1021: 12 total, 12 up, 12 in 2024-04-21T18:16:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:08 smithi077 ceph-mon[27902]: pgmap v15174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:16:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28278.880460 secs 2024-04-21T18:16:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:08 smithi191 ceph-mon[31636]: osdmap e1021: 12 total, 12 up, 12 in 2024-04-21T18:16:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:08 smithi191 ceph-mon[31636]: pgmap v15174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:16:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28278.880460 secs 2024-04-21T18:16:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:08 smithi170 ceph-mon[31212]: osdmap e1021: 12 total, 12 up, 12 in 2024-04-21T18:16:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:08 smithi170 ceph-mon[31212]: pgmap v15174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:16:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28280.639285 secs 2024-04-21T18:16:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28280.639285 secs 2024-04-21T18:16:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28280.639285 secs 2024-04-21T18:16:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:10.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:10 smithi077 ceph-mon[27902]: pgmap v15175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:16:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:10 smithi191 ceph-mon[31636]: pgmap v15175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:16:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:10 smithi170 ceph-mon[31212]: pgmap v15175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:16:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28283.880579 secs 2024-04-21T18:16:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:13 smithi191 ceph-mon[31636]: pgmap v15176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:16:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28283.880579 secs 2024-04-21T18:16:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:13 smithi170 ceph-mon[31212]: pgmap v15176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:16:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28283.880579 secs 2024-04-21T18:16:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:13 smithi077 ceph-mon[27902]: pgmap v15176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:16:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28285.639419 secs 2024-04-21T18:16:14.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28285.639419 secs 2024-04-21T18:16:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28285.639419 secs 2024-04-21T18:16:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:15 smithi191 ceph-mon[31636]: pgmap v15177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:16:15.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:15 smithi170 ceph-mon[31212]: pgmap v15177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:16:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:15 smithi077 ceph-mon[27902]: pgmap v15177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:16:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:17 smithi191 ceph-mon[31636]: pgmap v15178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:16:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:17 smithi170 ceph-mon[31212]: pgmap v15178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:16:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:17 smithi077 ceph-mon[27902]: pgmap v15178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:16:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28288.880645 secs 2024-04-21T18:16:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28288.880645 secs 2024-04-21T18:16:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28288.880645 secs 2024-04-21T18:16:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:19 smithi191 ceph-mon[31636]: pgmap v15179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:16:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28290.639569 secs 2024-04-21T18:16:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:19 smithi077 ceph-mon[27902]: pgmap v15179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:16:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28290.639569 secs 2024-04-21T18:16:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:19 smithi170 ceph-mon[31212]: pgmap v15179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:16:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28290.639569 secs 2024-04-21T18:16:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:21 smithi191 ceph-mon[31636]: pgmap v15180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:16:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:21 smithi170 ceph-mon[31212]: pgmap v15180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:16:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:21 smithi077 ceph-mon[27902]: pgmap v15180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:16:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28293.880790 secs 2024-04-21T18:16:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:23 smithi191 ceph-mon[31636]: pgmap v15181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28293.880790 secs 2024-04-21T18:16:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:23 smithi170 ceph-mon[31212]: pgmap v15181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28293.880790 secs 2024-04-21T18:16:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:23 smithi077 ceph-mon[27902]: pgmap v15181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:24.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28295.639684 secs 2024-04-21T18:16:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28295.639684 secs 2024-04-21T18:16:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28295.639684 secs 2024-04-21T18:16:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:25.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:25 smithi191 ceph-mon[31636]: pgmap v15182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:25 smithi170 ceph-mon[31212]: pgmap v15182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:25 smithi077 ceph-mon[27902]: pgmap v15182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:27.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:27 smithi191 ceph-mon[31636]: pgmap v15183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:27 smithi170 ceph-mon[31212]: pgmap v15183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:27 smithi077 ceph-mon[27902]: pgmap v15183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:28.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28298.880836 secs 2024-04-21T18:16:28.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28298.880836 secs 2024-04-21T18:16:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28298.880836 secs 2024-04-21T18:16:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:29 smithi191 ceph-mon[31636]: pgmap v15184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:29.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28300.639801 secs 2024-04-21T18:16:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:29 smithi170 ceph-mon[31212]: pgmap v15184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28300.639801 secs 2024-04-21T18:16:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:29 smithi077 ceph-mon[27902]: pgmap v15184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28300.639801 secs 2024-04-21T18:16:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:31.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:31 smithi191 ceph-mon[31636]: pgmap v15185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:31 smithi170 ceph-mon[31212]: pgmap v15185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:31 smithi077 ceph-mon[27902]: pgmap v15185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28303.880946 secs 2024-04-21T18:16:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:33 smithi191 ceph-mon[31636]: pgmap v15186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28303.880946 secs 2024-04-21T18:16:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:33 smithi170 ceph-mon[31212]: pgmap v15186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28303.880946 secs 2024-04-21T18:16:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:33 smithi077 ceph-mon[27902]: pgmap v15186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28305.639936 secs 2024-04-21T18:16:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28305.639936 secs 2024-04-21T18:16:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28305.639936 secs 2024-04-21T18:16:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:35 smithi191 ceph-mon[31636]: pgmap v15187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:35 smithi170 ceph-mon[31212]: pgmap v15187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:35 smithi077 ceph-mon[27902]: pgmap v15187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:37 smithi170 ceph-mon[31212]: pgmap v15188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:37 smithi077 ceph-mon[27902]: pgmap v15188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:37 smithi191 ceph-mon[31636]: pgmap v15188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28308.881058 secs 2024-04-21T18:16:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:38 smithi077 ceph-mon[27902]: pgmap v15189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28308.881058 secs 2024-04-21T18:16:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:38 smithi191 ceph-mon[31636]: pgmap v15189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:39.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28308.881058 secs 2024-04-21T18:16:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:38 smithi170 ceph-mon[31212]: pgmap v15189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28310.640063 secs 2024-04-21T18:16:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28310.640063 secs 2024-04-21T18:16:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28310.640063 secs 2024-04-21T18:16:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:40 smithi077 ceph-mon[27902]: pgmap v15190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:40 smithi191 ceph-mon[31636]: pgmap v15190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:41.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:40 smithi170 ceph-mon[31212]: pgmap v15190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28313.881150 secs 2024-04-21T18:16:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:43 smithi191 ceph-mon[31636]: pgmap v15191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28313.881150 secs 2024-04-21T18:16:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:43 smithi170 ceph-mon[31212]: pgmap v15191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28313.881150 secs 2024-04-21T18:16:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:43 smithi077 ceph-mon[27902]: pgmap v15191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28315.640176 secs 2024-04-21T18:16:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28315.640176 secs 2024-04-21T18:16:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28315.640176 secs 2024-04-21T18:16:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:45 smithi191 ceph-mon[31636]: pgmap v15192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:16:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:16:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:16:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:16:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:45 smithi170 ceph-mon[31212]: pgmap v15192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:16:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:16:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:16:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:16:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:45 smithi077 ceph-mon[27902]: pgmap v15192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:16:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:16:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:16:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:16:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:47 smithi191 ceph-mon[31636]: pgmap v15193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:47 smithi170 ceph-mon[31212]: pgmap v15193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:47 smithi077 ceph-mon[27902]: pgmap v15193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28318.881231 secs 2024-04-21T18:16:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28318.881231 secs 2024-04-21T18:16:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28318.881231 secs 2024-04-21T18:16:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:49 smithi191 ceph-mon[31636]: pgmap v15194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28320.640249 secs 2024-04-21T18:16:49.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:49 smithi077 ceph-mon[27902]: pgmap v15194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:49.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28320.640249 secs 2024-04-21T18:16:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:49 smithi170 ceph-mon[31212]: pgmap v15194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28320.640249 secs 2024-04-21T18:16:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:51 smithi191 ceph-mon[31636]: pgmap v15195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:51 smithi170 ceph-mon[31212]: pgmap v15195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:51 smithi077 ceph-mon[27902]: pgmap v15195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28323.881349 secs 2024-04-21T18:16:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:53 smithi191 ceph-mon[31636]: pgmap v15196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28323.881349 secs 2024-04-21T18:16:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:53 smithi170 ceph-mon[31212]: pgmap v15196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28323.881349 secs 2024-04-21T18:16:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:53 smithi077 ceph-mon[27902]: pgmap v15196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28325.640364 secs 2024-04-21T18:16:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28325.640364 secs 2024-04-21T18:16:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28325.640364 secs 2024-04-21T18:16:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:16:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:55 smithi191 ceph-mon[31636]: pgmap v15197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:55 smithi170 ceph-mon[31212]: pgmap v15197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:55 smithi077 ceph-mon[27902]: pgmap v15197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:57 smithi191 ceph-mon[31636]: pgmap v15198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:57 smithi170 ceph-mon[31212]: pgmap v15198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:57 smithi077 ceph-mon[27902]: pgmap v15198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:16:58.268+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:16:58.268+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:16:58.269+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:16:58.269+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:16:58.707 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28328.881486 secs 2024-04-21T18:16:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28328.881486 secs 2024-04-21T18:16:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28328.881486 secs 2024-04-21T18:16:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:59 smithi191 ceph-mon[31636]: pgmap v15199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28330.640473 secs 2024-04-21T18:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:59 smithi170 ceph-mon[31212]: pgmap v15199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28330.640473 secs 2024-04-21T18:16:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:59 smithi077 ceph-mon[27902]: pgmap v15199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:16:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28330.640473 secs 2024-04-21T18:17:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:01.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:01 smithi191 ceph-mon[31636]: pgmap v15200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:01 smithi170 ceph-mon[31212]: pgmap v15200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:01 smithi077 ceph-mon[27902]: pgmap v15200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28333.881606 secs 2024-04-21T18:17:03.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:03 smithi191 ceph-mon[31636]: pgmap v15201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28333.881606 secs 2024-04-21T18:17:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:03 smithi170 ceph-mon[31212]: pgmap v15201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28333.881606 secs 2024-04-21T18:17:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:03 smithi077 ceph-mon[27902]: pgmap v15201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28335.640612 secs 2024-04-21T18:17:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28335.640612 secs 2024-04-21T18:17:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28335.640612 secs 2024-04-21T18:17:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:05 smithi170 ceph-mon[31212]: pgmap v15202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:05 smithi170 ceph-mon[31212]: osdmap e1022: 12 total, 12 up, 12 in 2024-04-21T18:17:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:05 smithi077 ceph-mon[27902]: pgmap v15202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:05 smithi077 ceph-mon[27902]: osdmap e1022: 12 total, 12 up, 12 in 2024-04-21T18:17:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:05 smithi191 ceph-mon[31636]: pgmap v15202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:05 smithi191 ceph-mon[31636]: osdmap e1022: 12 total, 12 up, 12 in 2024-04-21T18:17:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:07 smithi170 ceph-mon[31212]: pgmap v15204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:17:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:07 smithi077 ceph-mon[27902]: pgmap v15204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:17:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:07 smithi191 ceph-mon[31636]: pgmap v15204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:17:08.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28338.881722 secs 2024-04-21T18:17:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28338.881722 secs 2024-04-21T18:17:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28338.881722 secs 2024-04-21T18:17:09.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:09 smithi170 ceph-mon[31212]: pgmap v15205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:17:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28340.640735 secs 2024-04-21T18:17:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:09 smithi077 ceph-mon[27902]: pgmap v15205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:17:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28340.640735 secs 2024-04-21T18:17:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:09 smithi191 ceph-mon[31636]: pgmap v15205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:17:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28340.640735 secs 2024-04-21T18:17:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:11.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:11 smithi170 ceph-mon[31212]: pgmap v15206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:17:11.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:11 smithi077 ceph-mon[27902]: pgmap v15206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:17:11.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:11 smithi191 ceph-mon[31636]: pgmap v15206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:17:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28343.881835 secs 2024-04-21T18:17:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:13 smithi170 ceph-mon[31212]: pgmap v15207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:17:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:13 smithi170 ceph-mon[31212]: osdmap e1023: 12 total, 12 up, 12 in 2024-04-21T18:17:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28343.881835 secs 2024-04-21T18:17:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:13 smithi077 ceph-mon[27902]: pgmap v15207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:17:13.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:13 smithi077 ceph-mon[27902]: osdmap e1023: 12 total, 12 up, 12 in 2024-04-21T18:17:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28343.881835 secs 2024-04-21T18:17:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:13 smithi191 ceph-mon[31636]: pgmap v15207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:17:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:13 smithi191 ceph-mon[31636]: osdmap e1023: 12 total, 12 up, 12 in 2024-04-21T18:17:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28345.640887 secs 2024-04-21T18:17:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28345.640887 secs 2024-04-21T18:17:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28345.640887 secs 2024-04-21T18:17:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:15 smithi170 ceph-mon[31212]: pgmap v15209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:17:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:15 smithi077 ceph-mon[27902]: pgmap v15209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:17:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:15 smithi191 ceph-mon[31636]: pgmap v15209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:17:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:17 smithi170 ceph-mon[31212]: pgmap v15210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:17:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:17 smithi077 ceph-mon[27902]: pgmap v15210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:17:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:17 smithi191 ceph-mon[31636]: pgmap v15210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:17:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28348.881953 secs 2024-04-21T18:17:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28348.881953 secs 2024-04-21T18:17:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28348.881953 secs 2024-04-21T18:17:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:19 smithi077 ceph-mon[27902]: pgmap v15211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:17:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28350.641002 secs 2024-04-21T18:17:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:19 smithi170 ceph-mon[31212]: pgmap v15211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:17:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28350.641002 secs 2024-04-21T18:17:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:19 smithi191 ceph-mon[31636]: pgmap v15211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:17:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28350.641002 secs 2024-04-21T18:17:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:21 smithi170 ceph-mon[31212]: pgmap v15212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:17:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:21 smithi077 ceph-mon[27902]: pgmap v15212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:17:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:21 smithi191 ceph-mon[31636]: pgmap v15212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:17:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28353.882083 secs 2024-04-21T18:17:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:23 smithi170 ceph-mon[31212]: pgmap v15213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:17:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28353.882083 secs 2024-04-21T18:17:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:23 smithi077 ceph-mon[27902]: pgmap v15213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:17:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28353.882083 secs 2024-04-21T18:17:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:23 smithi191 ceph-mon[31636]: pgmap v15213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:17:24.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28355.641069 secs 2024-04-21T18:17:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28355.641069 secs 2024-04-21T18:17:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28355.641069 secs 2024-04-21T18:17:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:25.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:25 smithi170 ceph-mon[31212]: pgmap v15214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:17:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:25 smithi077 ceph-mon[27902]: pgmap v15214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:17:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:25 smithi191 ceph-mon[31636]: pgmap v15214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:17:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:27 smithi170 ceph-mon[31212]: pgmap v15215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:27 smithi077 ceph-mon[27902]: pgmap v15215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:27 smithi191 ceph-mon[31636]: pgmap v15215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28358.882188 secs 2024-04-21T18:17:28.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28358.882188 secs 2024-04-21T18:17:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28358.882188 secs 2024-04-21T18:17:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:29 smithi170 ceph-mon[31212]: pgmap v15216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28360.641192 secs 2024-04-21T18:17:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:29 smithi077 ceph-mon[27902]: pgmap v15216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28360.641192 secs 2024-04-21T18:17:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:29 smithi191 ceph-mon[31636]: pgmap v15216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28360.641192 secs 2024-04-21T18:17:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:30.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:30 smithi170 ceph-mon[31212]: pgmap v15217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:30.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:30 smithi077 ceph-mon[27902]: pgmap v15217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:30.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:30 smithi191 ceph-mon[31636]: pgmap v15217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28363.882325 secs 2024-04-21T18:17:33.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:33 smithi191 ceph-mon[31636]: pgmap v15218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28363.882325 secs 2024-04-21T18:17:33.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:33 smithi170 ceph-mon[31212]: pgmap v15218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28363.882325 secs 2024-04-21T18:17:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:33 smithi077 ceph-mon[27902]: pgmap v15218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:34.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28365.641309 secs 2024-04-21T18:17:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28365.641309 secs 2024-04-21T18:17:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28365.641309 secs 2024-04-21T18:17:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:35.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:35 smithi191 ceph-mon[31636]: pgmap v15219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:35 smithi170 ceph-mon[31212]: pgmap v15219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:35 smithi077 ceph-mon[27902]: pgmap v15219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:37.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:37 smithi191 ceph-mon[31636]: pgmap v15220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:37 smithi170 ceph-mon[31212]: pgmap v15220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:37 smithi077 ceph-mon[27902]: pgmap v15220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28368.882392 secs 2024-04-21T18:17:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28368.882392 secs 2024-04-21T18:17:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28368.882392 secs 2024-04-21T18:17:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:39 smithi191 ceph-mon[31636]: pgmap v15221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:39.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28370.641440 secs 2024-04-21T18:17:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:39 smithi170 ceph-mon[31212]: pgmap v15221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28370.641440 secs 2024-04-21T18:17:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:39 smithi077 ceph-mon[27902]: pgmap v15221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28370.641440 secs 2024-04-21T18:17:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:41 smithi191 ceph-mon[31636]: pgmap v15222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:41 smithi170 ceph-mon[31212]: pgmap v15222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:41 smithi077 ceph-mon[27902]: pgmap v15222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28373.882509 secs 2024-04-21T18:17:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:43 smithi191 ceph-mon[31636]: pgmap v15223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28373.882509 secs 2024-04-21T18:17:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:43 smithi170 ceph-mon[31212]: pgmap v15223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28373.882509 secs 2024-04-21T18:17:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:43 smithi077 ceph-mon[27902]: pgmap v15223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28375.641564 secs 2024-04-21T18:17:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28375.641564 secs 2024-04-21T18:17:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28375.641564 secs 2024-04-21T18:17:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:45 smithi191 ceph-mon[31636]: pgmap v15224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:17:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:45 smithi170 ceph-mon[31212]: pgmap v15224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:17:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:45 smithi077 ceph-mon[27902]: pgmap v15224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:17:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:17:46.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:17:46.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:17:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:17:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:17:46.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:17:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:17:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:17:46.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:17:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:47 smithi191 ceph-mon[31636]: pgmap v15225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:47 smithi170 ceph-mon[31212]: pgmap v15225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:47 smithi077 ceph-mon[27902]: pgmap v15225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28378.882620 secs 2024-04-21T18:17:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28378.882620 secs 2024-04-21T18:17:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28378.882620 secs 2024-04-21T18:17:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:49 smithi077 ceph-mon[27902]: pgmap v15226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:49.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28380.641682 secs 2024-04-21T18:17:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:49 smithi170 ceph-mon[31212]: pgmap v15226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28380.641682 secs 2024-04-21T18:17:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:49 smithi191 ceph-mon[31636]: pgmap v15226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28380.641682 secs 2024-04-21T18:17:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:51 smithi170 ceph-mon[31212]: pgmap v15227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:51 smithi077 ceph-mon[27902]: pgmap v15227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:51 smithi191 ceph-mon[31636]: pgmap v15227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28383.882755 secs 2024-04-21T18:17:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:53 smithi170 ceph-mon[31212]: pgmap v15228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28383.882755 secs 2024-04-21T18:17:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:53 smithi077 ceph-mon[27902]: pgmap v15228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28383.882755 secs 2024-04-21T18:17:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:53 smithi191 ceph-mon[31636]: pgmap v15228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28385.641820 secs 2024-04-21T18:17:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28385.641820 secs 2024-04-21T18:17:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28385.641820 secs 2024-04-21T18:17:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:17:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:55 smithi170 ceph-mon[31212]: pgmap v15229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:55 smithi077 ceph-mon[27902]: pgmap v15229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:55 smithi191 ceph-mon[31636]: pgmap v15229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:57 smithi170 ceph-mon[31212]: pgmap v15230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:57 smithi077 ceph-mon[27902]: pgmap v15230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:57 smithi191 ceph-mon[31636]: pgmap v15230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:17:58.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28388.882878 secs 2024-04-21T18:17:58.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28388.882878 secs 2024-04-21T18:17:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28388.882878 secs 2024-04-21T18:17:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:59 smithi170 ceph-mon[31212]: pgmap v15231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28390.641962 secs 2024-04-21T18:17:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:59 smithi077 ceph-mon[27902]: pgmap v15231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28390.641962 secs 2024-04-21T18:17:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:59 smithi191 ceph-mon[31636]: pgmap v15231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:17:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28390.641962 secs 2024-04-21T18:18:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:01 smithi170 ceph-mon[31212]: pgmap v15232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:01 smithi077 ceph-mon[27902]: pgmap v15232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:01 smithi191 ceph-mon[31636]: pgmap v15232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28393.882955 secs 2024-04-21T18:18:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:03 smithi170 ceph-mon[31212]: pgmap v15233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28393.882955 secs 2024-04-21T18:18:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:03 smithi077 ceph-mon[27902]: pgmap v15233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28393.882955 secs 2024-04-21T18:18:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:03 smithi191 ceph-mon[31636]: pgmap v15233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28395.642078 secs 2024-04-21T18:18:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28395.642078 secs 2024-04-21T18:18:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28395.642078 secs 2024-04-21T18:18:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:05 smithi170 ceph-mon[31212]: pgmap v15234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:05 smithi170 ceph-mon[31212]: osdmap e1024: 12 total, 12 up, 12 in 2024-04-21T18:18:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:05 smithi077 ceph-mon[27902]: pgmap v15234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:05 smithi077 ceph-mon[27902]: osdmap e1024: 12 total, 12 up, 12 in 2024-04-21T18:18:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:05 smithi191 ceph-mon[31636]: pgmap v15234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:05 smithi191 ceph-mon[31636]: osdmap e1024: 12 total, 12 up, 12 in 2024-04-21T18:18:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:07 smithi170 ceph-mon[31212]: pgmap v15236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:18:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:07 smithi077 ceph-mon[27902]: pgmap v15236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:18:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:07 smithi191 ceph-mon[31636]: pgmap v15236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:18:08.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28398.883102 secs 2024-04-21T18:18:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:08 smithi077 ceph-mon[27902]: osdmap e1025: 12 total, 12 up, 12 in 2024-04-21T18:18:08.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:08 smithi077 ceph-mon[27902]: pgmap v15238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:18:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28398.883102 secs 2024-04-21T18:18:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:08 smithi191 ceph-mon[31636]: osdmap e1025: 12 total, 12 up, 12 in 2024-04-21T18:18:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:08 smithi191 ceph-mon[31636]: pgmap v15238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:18:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28398.883102 secs 2024-04-21T18:18:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:08 smithi170 ceph-mon[31212]: osdmap e1025: 12 total, 12 up, 12 in 2024-04-21T18:18:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:08 smithi170 ceph-mon[31212]: pgmap v15238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:18:09.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28400.642159 secs 2024-04-21T18:18:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28400.642159 secs 2024-04-21T18:18:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28400.642159 secs 2024-04-21T18:18:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:10 smithi191 ceph-mon[31636]: pgmap v15239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:18:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:10 smithi170 ceph-mon[31212]: pgmap v15239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:18:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:10 smithi077 ceph-mon[27902]: pgmap v15239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:18:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28403.883221 secs 2024-04-21T18:18:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:13 smithi191 ceph-mon[31636]: pgmap v15240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:18:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28403.883221 secs 2024-04-21T18:18:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:13 smithi170 ceph-mon[31212]: pgmap v15240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:18:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28403.883221 secs 2024-04-21T18:18:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:13 smithi077 ceph-mon[27902]: pgmap v15240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:18:14.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28405.642271 secs 2024-04-21T18:18:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28405.642271 secs 2024-04-21T18:18:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28405.642271 secs 2024-04-21T18:18:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:15.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:15 smithi191 ceph-mon[31636]: pgmap v15241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:18:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:15 smithi170 ceph-mon[31212]: pgmap v15241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:18:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:15 smithi077 ceph-mon[27902]: pgmap v15241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:18:17.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:17 smithi191 ceph-mon[31636]: pgmap v15242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:18:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:17 smithi170 ceph-mon[31212]: pgmap v15242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:18:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:17 smithi077 ceph-mon[27902]: pgmap v15242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:18:18.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28408.883336 secs 2024-04-21T18:18:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28408.883336 secs 2024-04-21T18:18:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28408.883336 secs 2024-04-21T18:18:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:19 smithi191 ceph-mon[31636]: pgmap v15243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:18:19.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28410.642377 secs 2024-04-21T18:18:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:19 smithi077 ceph-mon[27902]: pgmap v15243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:18:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28410.642377 secs 2024-04-21T18:18:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:19 smithi170 ceph-mon[31212]: pgmap v15243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:18:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28410.642377 secs 2024-04-21T18:18:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:21.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:21 smithi191 ceph-mon[31636]: pgmap v15244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:18:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:21 smithi170 ceph-mon[31212]: pgmap v15244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:18:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:21 smithi077 ceph-mon[27902]: pgmap v15244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:18:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28413.883453 secs 2024-04-21T18:18:23.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:23 smithi191 ceph-mon[31636]: pgmap v15245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28413.883453 secs 2024-04-21T18:18:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:23 smithi170 ceph-mon[31212]: pgmap v15245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28413.883453 secs 2024-04-21T18:18:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:23 smithi077 ceph-mon[27902]: pgmap v15245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:24.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28415.642493 secs 2024-04-21T18:18:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28415.642493 secs 2024-04-21T18:18:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28415.642493 secs 2024-04-21T18:18:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:25 smithi170 ceph-mon[31212]: pgmap v15246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:25 smithi077 ceph-mon[27902]: pgmap v15246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:25 smithi191 ceph-mon[31636]: pgmap v15246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:27 smithi170 ceph-mon[31212]: pgmap v15247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:27 smithi077 ceph-mon[27902]: pgmap v15247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:27 smithi191 ceph-mon[31636]: pgmap v15247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:28.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28418.883570 secs 2024-04-21T18:18:28.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28418.883570 secs 2024-04-21T18:18:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28418.883570 secs 2024-04-21T18:18:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:29 smithi170 ceph-mon[31212]: pgmap v15248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28420.642626 secs 2024-04-21T18:18:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:29 smithi077 ceph-mon[27902]: pgmap v15248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28420.642626 secs 2024-04-21T18:18:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:29 smithi191 ceph-mon[31636]: pgmap v15248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28420.642626 secs 2024-04-21T18:18:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:31 smithi170 ceph-mon[31212]: pgmap v15249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:31 smithi077 ceph-mon[27902]: pgmap v15249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:31 smithi191 ceph-mon[31636]: pgmap v15249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28423.883676 secs 2024-04-21T18:18:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:33 smithi170 ceph-mon[31212]: pgmap v15250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28423.883676 secs 2024-04-21T18:18:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:33 smithi077 ceph-mon[27902]: pgmap v15250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28423.883676 secs 2024-04-21T18:18:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:33 smithi191 ceph-mon[31636]: pgmap v15250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28425.642747 secs 2024-04-21T18:18:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28425.642747 secs 2024-04-21T18:18:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28425.642747 secs 2024-04-21T18:18:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:35 smithi170 ceph-mon[31212]: pgmap v15251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:35 smithi077 ceph-mon[27902]: pgmap v15251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:35 smithi191 ceph-mon[31636]: pgmap v15251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:37 smithi170 ceph-mon[31212]: pgmap v15252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:37 smithi077 ceph-mon[27902]: pgmap v15252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:37 smithi191 ceph-mon[31636]: pgmap v15252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:38.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28428.883757 secs 2024-04-21T18:18:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28428.883757 secs 2024-04-21T18:18:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28428.883757 secs 2024-04-21T18:18:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:39 smithi170 ceph-mon[31212]: pgmap v15253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28430.642886 secs 2024-04-21T18:18:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:39 smithi077 ceph-mon[27902]: pgmap v15253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28430.642886 secs 2024-04-21T18:18:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:39 smithi191 ceph-mon[31636]: pgmap v15253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28430.642886 secs 2024-04-21T18:18:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:41 smithi170 ceph-mon[31212]: pgmap v15254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:41 smithi077 ceph-mon[27902]: pgmap v15254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:41 smithi191 ceph-mon[31636]: pgmap v15254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28433.883871 secs 2024-04-21T18:18:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:43 smithi170 ceph-mon[31212]: pgmap v15255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28433.883871 secs 2024-04-21T18:18:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:43 smithi077 ceph-mon[27902]: pgmap v15255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28433.883871 secs 2024-04-21T18:18:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:43 smithi191 ceph-mon[31636]: pgmap v15255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28435.642943 secs 2024-04-21T18:18:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28435.642943 secs 2024-04-21T18:18:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28435.642943 secs 2024-04-21T18:18:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:45.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:45 smithi170 ceph-mon[31212]: pgmap v15256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:45 smithi077 ceph-mon[27902]: pgmap v15256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:45 smithi191 ceph-mon[31636]: pgmap v15256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:46.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:18:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:18:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:18:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:47 smithi170 ceph-mon[31212]: pgmap v15257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:18:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:18:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:18:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:47 smithi077 ceph-mon[27902]: pgmap v15257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:18:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:18:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:18:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:47 smithi191 ceph-mon[31636]: pgmap v15257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:18:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:18:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:18:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28438.883930 secs 2024-04-21T18:18:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28438.883930 secs 2024-04-21T18:18:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28438.883930 secs 2024-04-21T18:18:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:49 smithi170 ceph-mon[31212]: pgmap v15258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28440.643045 secs 2024-04-21T18:18:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:49 smithi077 ceph-mon[27902]: pgmap v15258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28440.643045 secs 2024-04-21T18:18:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:49 smithi191 ceph-mon[31636]: pgmap v15258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28440.643045 secs 2024-04-21T18:18:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:50.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:50 smithi170 ceph-mon[31212]: pgmap v15259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:50 smithi077 ceph-mon[27902]: pgmap v15259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:50 smithi191 ceph-mon[31636]: pgmap v15259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28443.884008 secs 2024-04-21T18:18:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:53 smithi191 ceph-mon[31636]: pgmap v15260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28443.884008 secs 2024-04-21T18:18:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:53 smithi170 ceph-mon[31212]: pgmap v15260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28443.884008 secs 2024-04-21T18:18:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:53 smithi077 ceph-mon[27902]: pgmap v15260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28445.643161 secs 2024-04-21T18:18:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28445.643161 secs 2024-04-21T18:18:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28445.643161 secs 2024-04-21T18:18:55.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:18:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:55 smithi191 ceph-mon[31636]: pgmap v15261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:55 smithi170 ceph-mon[31212]: pgmap v15261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:55 smithi077 ceph-mon[27902]: pgmap v15261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:57 smithi191 ceph-mon[31636]: pgmap v15262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:57 smithi170 ceph-mon[31212]: pgmap v15262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:57 smithi077 ceph-mon[27902]: pgmap v15262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:18:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28448.884110 secs 2024-04-21T18:18:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28448.884110 secs 2024-04-21T18:18:58.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28448.884110 secs 2024-04-21T18:18:59.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:59 smithi170 ceph-mon[31212]: pgmap v15263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28450.643279 secs 2024-04-21T18:18:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:59 smithi077 ceph-mon[27902]: pgmap v15263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28450.643279 secs 2024-04-21T18:18:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:59 smithi191 ceph-mon[31636]: pgmap v15263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:18:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28450.643279 secs 2024-04-21T18:19:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:01 smithi170 ceph-mon[31212]: pgmap v15264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:19:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:01 smithi077 ceph-mon[27902]: pgmap v15264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:19:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:01 smithi191 ceph-mon[31636]: pgmap v15264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:19:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28453.884207 secs 2024-04-21T18:19:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:03 smithi170 ceph-mon[31212]: pgmap v15265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:19:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28453.884207 secs 2024-04-21T18:19:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:03 smithi077 ceph-mon[27902]: pgmap v15265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28453.884207 secs 2024-04-21T18:19:03.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:03 smithi191 ceph-mon[31636]: pgmap v15265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:19:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28455.643389 secs 2024-04-21T18:19:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28455.643389 secs 2024-04-21T18:19:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28455.643389 secs 2024-04-21T18:19:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:05 smithi170 ceph-mon[31212]: pgmap v15266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:19:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:05 smithi170 ceph-mon[31212]: osdmap e1026: 12 total, 12 up, 12 in 2024-04-21T18:19:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:05 smithi077 ceph-mon[27902]: pgmap v15266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:19:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:05 smithi077 ceph-mon[27902]: osdmap e1026: 12 total, 12 up, 12 in 2024-04-21T18:19:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:05 smithi191 ceph-mon[31636]: pgmap v15266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:19:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:05 smithi191 ceph-mon[31636]: osdmap e1026: 12 total, 12 up, 12 in 2024-04-21T18:19:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:07 smithi170 ceph-mon[31212]: pgmap v15268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:19:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:07 smithi077 ceph-mon[27902]: pgmap v15268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:19:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:07 smithi191 ceph-mon[31636]: pgmap v15268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:19:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28458.884351 secs 2024-04-21T18:19:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:08 smithi191 ceph-mon[31636]: osdmap e1027: 12 total, 12 up, 12 in 2024-04-21T18:19:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:08 smithi191 ceph-mon[31636]: pgmap v15270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T18:19:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28458.884351 secs 2024-04-21T18:19:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:08 smithi170 ceph-mon[31212]: osdmap e1027: 12 total, 12 up, 12 in 2024-04-21T18:19:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:08 smithi170 ceph-mon[31212]: pgmap v15270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T18:19:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28458.884351 secs 2024-04-21T18:19:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:08 smithi077 ceph-mon[27902]: osdmap e1027: 12 total, 12 up, 12 in 2024-04-21T18:19:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:08 smithi077 ceph-mon[27902]: pgmap v15270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T18:19:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28460.643505 secs 2024-04-21T18:19:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28460.643505 secs 2024-04-21T18:19:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28460.643505 secs 2024-04-21T18:19:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:10 smithi191 ceph-mon[31636]: pgmap v15271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:19:11.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:10 smithi170 ceph-mon[31212]: pgmap v15271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:19:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:10 smithi077 ceph-mon[27902]: pgmap v15271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:19:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:13.287+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:19:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:13.287+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:19:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:13.288+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:19:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:13.288+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:19:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28463.884468 secs 2024-04-21T18:19:13.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:13 smithi191 ceph-mon[31636]: pgmap v15272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:19:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28463.884468 secs 2024-04-21T18:19:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:13 smithi170 ceph-mon[31212]: pgmap v15272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:19:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28463.884468 secs 2024-04-21T18:19:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:13 smithi077 ceph-mon[27902]: pgmap v15272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:19:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28465.643620 secs 2024-04-21T18:19:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28465.643620 secs 2024-04-21T18:19:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28465.643620 secs 2024-04-21T18:19:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:15 smithi170 ceph-mon[31212]: pgmap v15273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T18:19:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:15 smithi077 ceph-mon[27902]: pgmap v15273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T18:19:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:15 smithi191 ceph-mon[31636]: pgmap v15273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T18:19:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:17 smithi170 ceph-mon[31212]: pgmap v15274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:19:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:17 smithi077 ceph-mon[27902]: pgmap v15274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:19:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:17 smithi191 ceph-mon[31636]: pgmap v15274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:19:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28468.884577 secs 2024-04-21T18:19:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28468.884577 secs 2024-04-21T18:19:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28468.884577 secs 2024-04-21T18:19:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:19 smithi077 ceph-mon[27902]: pgmap v15275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:19:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28470.643707 secs 2024-04-21T18:19:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:19 smithi170 ceph-mon[31212]: pgmap v15275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:19:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28470.643707 secs 2024-04-21T18:19:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:19 smithi191 ceph-mon[31636]: pgmap v15275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2024-04-21T18:19:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28470.643707 secs 2024-04-21T18:19:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:21 smithi170 ceph-mon[31212]: pgmap v15276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:19:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:21 smithi077 ceph-mon[27902]: pgmap v15276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:19:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:21 smithi191 ceph-mon[31636]: pgmap v15276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:19:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28473.884680 secs 2024-04-21T18:19:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:23 smithi170 ceph-mon[31212]: pgmap v15277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28473.884680 secs 2024-04-21T18:19:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:23 smithi077 ceph-mon[27902]: pgmap v15277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28473.884680 secs 2024-04-21T18:19:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:23 smithi191 ceph-mon[31636]: pgmap v15277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:24.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28475.643771 secs 2024-04-21T18:19:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28475.643771 secs 2024-04-21T18:19:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28475.643771 secs 2024-04-21T18:19:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:25 smithi170 ceph-mon[31212]: pgmap v15278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:25 smithi077 ceph-mon[27902]: pgmap v15278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:25 smithi191 ceph-mon[31636]: pgmap v15278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:27.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:27 smithi170 ceph-mon[31212]: pgmap v15279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:27 smithi077 ceph-mon[27902]: pgmap v15279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:27 smithi191 ceph-mon[31636]: pgmap v15279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28478.884828 secs 2024-04-21T18:19:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28478.884828 secs 2024-04-21T18:19:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28478.884828 secs 2024-04-21T18:19:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:29 smithi170 ceph-mon[31212]: pgmap v15280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28480.643886 secs 2024-04-21T18:19:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:29 smithi077 ceph-mon[27902]: pgmap v15280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28480.643886 secs 2024-04-21T18:19:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:29 smithi191 ceph-mon[31636]: pgmap v15280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28480.643886 secs 2024-04-21T18:19:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:31 smithi170 ceph-mon[31212]: pgmap v15281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:31 smithi077 ceph-mon[27902]: pgmap v15281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:31 smithi191 ceph-mon[31636]: pgmap v15281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28483.884922 secs 2024-04-21T18:19:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:33 smithi170 ceph-mon[31212]: pgmap v15282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28483.884922 secs 2024-04-21T18:19:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:33 smithi077 ceph-mon[27902]: pgmap v15282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28483.884922 secs 2024-04-21T18:19:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:33 smithi191 ceph-mon[31636]: pgmap v15282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28485.644010 secs 2024-04-21T18:19:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28485.644010 secs 2024-04-21T18:19:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28485.644010 secs 2024-04-21T18:19:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:35 smithi170 ceph-mon[31212]: pgmap v15283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:35 smithi077 ceph-mon[27902]: pgmap v15283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:35 smithi191 ceph-mon[31636]: pgmap v15283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:37 smithi170 ceph-mon[31212]: pgmap v15284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:37 smithi077 ceph-mon[27902]: pgmap v15284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:37 smithi191 ceph-mon[31636]: pgmap v15284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28488.884987 secs 2024-04-21T18:19:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28488.884987 secs 2024-04-21T18:19:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28488.884987 secs 2024-04-21T18:19:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:39 smithi170 ceph-mon[31212]: pgmap v15285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28490.644121 secs 2024-04-21T18:19:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:39 smithi077 ceph-mon[27902]: pgmap v15285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28490.644121 secs 2024-04-21T18:19:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:39 smithi191 ceph-mon[31636]: pgmap v15285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28490.644121 secs 2024-04-21T18:19:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:41.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:41 smithi170 ceph-mon[31212]: pgmap v15286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:41 smithi077 ceph-mon[27902]: pgmap v15286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:41 smithi191 ceph-mon[31636]: pgmap v15286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:43.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28493.885097 secs 2024-04-21T18:19:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:43 smithi170 ceph-mon[31212]: pgmap v15287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28493.885097 secs 2024-04-21T18:19:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:43 smithi077 ceph-mon[27902]: pgmap v15287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28493.885097 secs 2024-04-21T18:19:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:43 smithi191 ceph-mon[31636]: pgmap v15287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28495.644235 secs 2024-04-21T18:19:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28495.644235 secs 2024-04-21T18:19:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28495.644235 secs 2024-04-21T18:19:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:45 smithi170 ceph-mon[31212]: pgmap v15288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:45 smithi077 ceph-mon[27902]: pgmap v15288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:45 smithi191 ceph-mon[31636]: pgmap v15288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:47 smithi170 ceph-mon[31212]: pgmap v15289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:19:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:19:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:19:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:19:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:47 smithi077 ceph-mon[27902]: pgmap v15289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:19:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:19:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:19:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:19:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:47 smithi191 ceph-mon[31636]: pgmap v15289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:19:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:19:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:19:47.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:19:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28498.885185 secs 2024-04-21T18:19:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28498.885185 secs 2024-04-21T18:19:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28498.885185 secs 2024-04-21T18:19:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:49 smithi170 ceph-mon[31212]: pgmap v15290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28500.644349 secs 2024-04-21T18:19:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:49 smithi077 ceph-mon[27902]: pgmap v15290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28500.644349 secs 2024-04-21T18:19:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:49 smithi191 ceph-mon[31636]: pgmap v15290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28500.644349 secs 2024-04-21T18:19:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:50 smithi077 ceph-mon[27902]: pgmap v15291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:50.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:50 smithi191 ceph-mon[31636]: pgmap v15291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:50 smithi170 ceph-mon[31212]: pgmap v15291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28503.885295 secs 2024-04-21T18:19:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:53 smithi170 ceph-mon[31212]: pgmap v15292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28503.885295 secs 2024-04-21T18:19:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:53 smithi077 ceph-mon[27902]: pgmap v15292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28503.885295 secs 2024-04-21T18:19:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:53 smithi191 ceph-mon[31636]: pgmap v15292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28505.644472 secs 2024-04-21T18:19:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28505.644472 secs 2024-04-21T18:19:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28505.644472 secs 2024-04-21T18:19:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:19:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:55 smithi170 ceph-mon[31212]: pgmap v15293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:55 smithi077 ceph-mon[27902]: pgmap v15293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:55 smithi191 ceph-mon[31636]: pgmap v15293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:57.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:57 smithi170 ceph-mon[31212]: pgmap v15294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:57 smithi077 ceph-mon[27902]: pgmap v15294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:57 smithi191 ceph-mon[31636]: pgmap v15294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:19:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:58.294+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:19:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:58.294+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:19:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:58.294+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:19:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:19:58.294+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:19:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28508.885367 secs 2024-04-21T18:19:58.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28508.885367 secs 2024-04-21T18:19:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28508.885367 secs 2024-04-21T18:19:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:59 smithi170 ceph-mon[31212]: pgmap v15295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28510.644583 secs 2024-04-21T18:19:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:59 smithi077 ceph-mon[27902]: pgmap v15295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28510.644583 secs 2024-04-21T18:19:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:59 smithi191 ceph-mon[31636]: pgmap v15295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:19:59.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28510.644583 secs 2024-04-21T18:20:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:00.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:20:00.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:20:00.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:20:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:01 smithi170 ceph-mon[31212]: pgmap v15296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T18:20:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:01 smithi077 ceph-mon[27902]: pgmap v15296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T18:20:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:01 smithi191 ceph-mon[31636]: pgmap v15296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T18:20:03.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28513.885427 secs 2024-04-21T18:20:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:03 smithi170 ceph-mon[31212]: pgmap v15297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:20:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28513.885427 secs 2024-04-21T18:20:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:03 smithi077 ceph-mon[27902]: pgmap v15297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:20:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28513.885427 secs 2024-04-21T18:20:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:03 smithi191 ceph-mon[31636]: pgmap v15297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:20:04.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28515.644717 secs 2024-04-21T18:20:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28515.644717 secs 2024-04-21T18:20:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28515.644717 secs 2024-04-21T18:20:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:05 smithi170 ceph-mon[31212]: pgmap v15298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:20:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:05 smithi170 ceph-mon[31212]: osdmap e1028: 12 total, 12 up, 12 in 2024-04-21T18:20:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:05 smithi077 ceph-mon[27902]: pgmap v15298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:20:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:05 smithi077 ceph-mon[27902]: osdmap e1028: 12 total, 12 up, 12 in 2024-04-21T18:20:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:05 smithi191 ceph-mon[31636]: pgmap v15298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:20:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:05 smithi191 ceph-mon[31636]: osdmap e1028: 12 total, 12 up, 12 in 2024-04-21T18:20:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:07 smithi170 ceph-mon[31212]: pgmap v15300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:20:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:07 smithi077 ceph-mon[27902]: pgmap v15300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:20:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:07 smithi191 ceph-mon[31636]: pgmap v15300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:20:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28518.885525 secs 2024-04-21T18:20:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:08 smithi191 ceph-mon[31636]: osdmap e1029: 12 total, 12 up, 12 in 2024-04-21T18:20:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:08 smithi191 ceph-mon[31636]: pgmap v15302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T18:20:09.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28518.885525 secs 2024-04-21T18:20:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:08 smithi170 ceph-mon[31212]: osdmap e1029: 12 total, 12 up, 12 in 2024-04-21T18:20:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:08 smithi170 ceph-mon[31212]: pgmap v15302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T18:20:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28518.885525 secs 2024-04-21T18:20:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:08 smithi077 ceph-mon[27902]: osdmap e1029: 12 total, 12 up, 12 in 2024-04-21T18:20:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:08 smithi077 ceph-mon[27902]: pgmap v15302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T18:20:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28520.644827 secs 2024-04-21T18:20:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28520.644827 secs 2024-04-21T18:20:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28520.644827 secs 2024-04-21T18:20:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:10 smithi191 ceph-mon[31636]: pgmap v15303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:20:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:10 smithi170 ceph-mon[31212]: pgmap v15303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:20:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:10 smithi077 ceph-mon[27902]: pgmap v15303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:20:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28523.885644 secs 2024-04-21T18:20:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:13 smithi170 ceph-mon[31212]: pgmap v15304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:20:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28523.885644 secs 2024-04-21T18:20:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:13 smithi077 ceph-mon[27902]: pgmap v15304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:20:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28523.885644 secs 2024-04-21T18:20:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:13 smithi191 ceph-mon[31636]: pgmap v15304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:20:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28525.644945 secs 2024-04-21T18:20:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28525.644945 secs 2024-04-21T18:20:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28525.644945 secs 2024-04-21T18:20:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:15 smithi170 ceph-mon[31212]: pgmap v15305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-04-21T18:20:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:15 smithi077 ceph-mon[27902]: pgmap v15305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-04-21T18:20:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:15 smithi191 ceph-mon[31636]: pgmap v15305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-04-21T18:20:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:17 smithi170 ceph-mon[31212]: pgmap v15306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:20:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:17 smithi077 ceph-mon[27902]: pgmap v15306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:20:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:17 smithi191 ceph-mon[31636]: pgmap v15306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:20:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28528.885778 secs 2024-04-21T18:20:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28528.885778 secs 2024-04-21T18:20:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28528.885778 secs 2024-04-21T18:20:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:19 smithi077 ceph-mon[27902]: pgmap v15307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:20:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28530.645061 secs 2024-04-21T18:20:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:19 smithi170 ceph-mon[31212]: pgmap v15307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:20:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28530.645061 secs 2024-04-21T18:20:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:19 smithi191 ceph-mon[31636]: pgmap v15307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:20:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28530.645061 secs 2024-04-21T18:20:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:21.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:21 smithi170 ceph-mon[31212]: pgmap v15308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:20:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:21 smithi077 ceph-mon[27902]: pgmap v15308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:20:21.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:21 smithi191 ceph-mon[31636]: pgmap v15308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:20:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28533.885889 secs 2024-04-21T18:20:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:23 smithi170 ceph-mon[31212]: pgmap v15309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28533.885889 secs 2024-04-21T18:20:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:23 smithi077 ceph-mon[27902]: pgmap v15309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28533.885889 secs 2024-04-21T18:20:23.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:23 smithi191 ceph-mon[31636]: pgmap v15309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28535.645183 secs 2024-04-21T18:20:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28535.645183 secs 2024-04-21T18:20:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28535.645183 secs 2024-04-21T18:20:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:25 smithi170 ceph-mon[31212]: pgmap v15310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:25 smithi077 ceph-mon[27902]: pgmap v15310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:25 smithi191 ceph-mon[31636]: pgmap v15310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:27 smithi170 ceph-mon[31212]: pgmap v15311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:27 smithi077 ceph-mon[27902]: pgmap v15311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:27 smithi191 ceph-mon[31636]: pgmap v15311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28538.885978 secs 2024-04-21T18:20:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28538.885978 secs 2024-04-21T18:20:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28538.885978 secs 2024-04-21T18:20:29.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:29 smithi170 ceph-mon[31212]: pgmap v15312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28540.645294 secs 2024-04-21T18:20:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:29 smithi077 ceph-mon[27902]: pgmap v15312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28540.645294 secs 2024-04-21T18:20:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:29 smithi191 ceph-mon[31636]: pgmap v15312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28540.645294 secs 2024-04-21T18:20:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:31.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:31 smithi170 ceph-mon[31212]: pgmap v15313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:31 smithi077 ceph-mon[27902]: pgmap v15313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:31 smithi191 ceph-mon[31636]: pgmap v15313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28543.886116 secs 2024-04-21T18:20:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:33 smithi170 ceph-mon[31212]: pgmap v15314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28543.886116 secs 2024-04-21T18:20:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:33 smithi077 ceph-mon[27902]: pgmap v15314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28543.886116 secs 2024-04-21T18:20:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:33 smithi191 ceph-mon[31636]: pgmap v15314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:34.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28545.645409 secs 2024-04-21T18:20:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28545.645409 secs 2024-04-21T18:20:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28545.645409 secs 2024-04-21T18:20:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:35.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:35 smithi170 ceph-mon[31212]: pgmap v15315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:35 smithi077 ceph-mon[27902]: pgmap v15315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:35 smithi191 ceph-mon[31636]: pgmap v15315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:37.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:37 smithi170 ceph-mon[31212]: pgmap v15316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:37 smithi077 ceph-mon[27902]: pgmap v15316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:37 smithi191 ceph-mon[31636]: pgmap v15316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28548.886232 secs 2024-04-21T18:20:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28548.886232 secs 2024-04-21T18:20:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28548.886232 secs 2024-04-21T18:20:39.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:39 smithi170 ceph-mon[31212]: pgmap v15317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:39.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28550.645525 secs 2024-04-21T18:20:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:39 smithi077 ceph-mon[27902]: pgmap v15317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28550.645525 secs 2024-04-21T18:20:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:39 smithi191 ceph-mon[31636]: pgmap v15317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28550.645525 secs 2024-04-21T18:20:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:41.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:41 smithi170 ceph-mon[31212]: pgmap v15318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:41.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:41 smithi077 ceph-mon[27902]: pgmap v15318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:41.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:41 smithi191 ceph-mon[31636]: pgmap v15318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28553.886345 secs 2024-04-21T18:20:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:43 smithi170 ceph-mon[31212]: pgmap v15319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28553.886345 secs 2024-04-21T18:20:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:43 smithi077 ceph-mon[27902]: pgmap v15319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28553.886345 secs 2024-04-21T18:20:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:43 smithi191 ceph-mon[31636]: pgmap v15319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28555.645599 secs 2024-04-21T18:20:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28555.645599 secs 2024-04-21T18:20:45.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28555.645599 secs 2024-04-21T18:20:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:45 smithi077 ceph-mon[27902]: pgmap v15320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:45 smithi191 ceph-mon[31636]: pgmap v15320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:46.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:45 smithi170 ceph-mon[31212]: pgmap v15320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:46.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:46 smithi077 ceph-mon[27902]: pgmap v15321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:46.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:46 smithi191 ceph-mon[31636]: pgmap v15321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:47.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:46 smithi170 ceph-mon[31212]: pgmap v15321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:20:48.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:20:48.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:20:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28558.886464 secs 2024-04-21T18:20:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:20:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:20:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:20:48.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:48 smithi191 ceph-mon[31636]: pgmap v15322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28558.886464 secs 2024-04-21T18:20:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:20:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:20:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:20:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:48 smithi077 ceph-mon[27902]: pgmap v15322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:49.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28558.886464 secs 2024-04-21T18:20:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:20:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:20:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:20:49.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:48 smithi170 ceph-mon[31212]: pgmap v15322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:50.315 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28560.645690 secs 2024-04-21T18:20:50.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28560.645690 secs 2024-04-21T18:20:50.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28560.645690 secs 2024-04-21T18:20:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:51 smithi170 ceph-mon[31212]: pgmap v15323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:51 smithi077 ceph-mon[27902]: pgmap v15323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:51 smithi191 ceph-mon[31636]: pgmap v15323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28563.886587 secs 2024-04-21T18:20:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:53 smithi170 ceph-mon[31212]: pgmap v15324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28563.886587 secs 2024-04-21T18:20:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:53 smithi077 ceph-mon[27902]: pgmap v15324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28563.886587 secs 2024-04-21T18:20:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:53 smithi191 ceph-mon[31636]: pgmap v15324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:54.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28565.645805 secs 2024-04-21T18:20:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28565.645805 secs 2024-04-21T18:20:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28565.645805 secs 2024-04-21T18:20:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:20:55.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:55 smithi170 ceph-mon[31212]: pgmap v15325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:55 smithi077 ceph-mon[27902]: pgmap v15325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:55 smithi191 ceph-mon[31636]: pgmap v15325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:57 smithi170 ceph-mon[31212]: pgmap v15326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:57 smithi077 ceph-mon[27902]: pgmap v15326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:57 smithi191 ceph-mon[31636]: pgmap v15326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:20:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28568.886696 secs 2024-04-21T18:20:58.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28568.886696 secs 2024-04-21T18:20:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28568.886696 secs 2024-04-21T18:20:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:59 smithi170 ceph-mon[31212]: pgmap v15327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28570.645889 secs 2024-04-21T18:20:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:59 smithi077 ceph-mon[27902]: pgmap v15327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28570.645889 secs 2024-04-21T18:20:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:59 smithi191 ceph-mon[31636]: pgmap v15327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:20:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28570.645889 secs 2024-04-21T18:21:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:01.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:01 smithi077 ceph-mon[27902]: pgmap v15328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:01.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:01 smithi170 ceph-mon[31212]: pgmap v15328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:01 smithi191 ceph-mon[31636]: pgmap v15328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28573.886815 secs 2024-04-21T18:21:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:03 smithi170 ceph-mon[31212]: pgmap v15329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28573.886815 secs 2024-04-21T18:21:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:03 smithi077 ceph-mon[27902]: pgmap v15329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28573.886815 secs 2024-04-21T18:21:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:03 smithi191 ceph-mon[31636]: pgmap v15329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28575.645948 secs 2024-04-21T18:21:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28575.645948 secs 2024-04-21T18:21:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28575.645948 secs 2024-04-21T18:21:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:05 smithi170 ceph-mon[31212]: pgmap v15330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:05 smithi170 ceph-mon[31212]: osdmap e1030: 12 total, 12 up, 12 in 2024-04-21T18:21:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:05 smithi077 ceph-mon[27902]: pgmap v15330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:05 smithi077 ceph-mon[27902]: osdmap e1030: 12 total, 12 up, 12 in 2024-04-21T18:21:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:05 smithi191 ceph-mon[31636]: pgmap v15330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:05 smithi191 ceph-mon[31636]: osdmap e1030: 12 total, 12 up, 12 in 2024-04-21T18:21:07.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:07 smithi170 ceph-mon[31212]: pgmap v15332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:21:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:07 smithi077 ceph-mon[27902]: pgmap v15332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:21:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:07 smithi191 ceph-mon[31636]: pgmap v15332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:21:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28578.886926 secs 2024-04-21T18:21:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:08 smithi191 ceph-mon[31636]: osdmap e1031: 12 total, 12 up, 12 in 2024-04-21T18:21:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:08 smithi191 ceph-mon[31636]: pgmap v15334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:21:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28578.886926 secs 2024-04-21T18:21:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:08 smithi170 ceph-mon[31212]: osdmap e1031: 12 total, 12 up, 12 in 2024-04-21T18:21:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:08 smithi170 ceph-mon[31212]: pgmap v15334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:21:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28578.886926 secs 2024-04-21T18:21:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:08 smithi077 ceph-mon[27902]: osdmap e1031: 12 total, 12 up, 12 in 2024-04-21T18:21:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:08 smithi077 ceph-mon[27902]: pgmap v15334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:21:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28580.646055 secs 2024-04-21T18:21:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28580.646055 secs 2024-04-21T18:21:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28580.646055 secs 2024-04-21T18:21:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:10 smithi191 ceph-mon[31636]: pgmap v15335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:21:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:10 smithi170 ceph-mon[31212]: pgmap v15335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:21:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:10 smithi077 ceph-mon[27902]: pgmap v15335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:21:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28583.887033 secs 2024-04-21T18:21:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:13 smithi170 ceph-mon[31212]: pgmap v15336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:21:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28583.887033 secs 2024-04-21T18:21:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:13 smithi077 ceph-mon[27902]: pgmap v15336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:21:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28583.887033 secs 2024-04-21T18:21:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:13 smithi191 ceph-mon[31636]: pgmap v15336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:21:14.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28585.646121 secs 2024-04-21T18:21:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28585.646121 secs 2024-04-21T18:21:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28585.646121 secs 2024-04-21T18:21:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:15.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:15 smithi170 ceph-mon[31212]: pgmap v15337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:21:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:15 smithi077 ceph-mon[27902]: pgmap v15337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:21:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:15 smithi191 ceph-mon[31636]: pgmap v15337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:21:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:17 smithi170 ceph-mon[31212]: pgmap v15338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:21:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:17 smithi077 ceph-mon[27902]: pgmap v15338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:21:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:17 smithi191 ceph-mon[31636]: pgmap v15338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:21:18.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28588.887153 secs 2024-04-21T18:21:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28588.887153 secs 2024-04-21T18:21:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28588.887153 secs 2024-04-21T18:21:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:19 smithi077 ceph-mon[27902]: pgmap v15339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:21:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28590.646220 secs 2024-04-21T18:21:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:19 smithi170 ceph-mon[31212]: pgmap v15339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:21:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28590.646220 secs 2024-04-21T18:21:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:19 smithi191 ceph-mon[31636]: pgmap v15339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:21:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28590.646220 secs 2024-04-21T18:21:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:21 smithi170 ceph-mon[31212]: pgmap v15340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:21:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:21 smithi077 ceph-mon[27902]: pgmap v15340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:21:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:21 smithi191 ceph-mon[31636]: pgmap v15340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:21:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28593.887239 secs 2024-04-21T18:21:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:23 smithi170 ceph-mon[31212]: pgmap v15341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28593.887239 secs 2024-04-21T18:21:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:23 smithi077 ceph-mon[27902]: pgmap v15341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28593.887239 secs 2024-04-21T18:21:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:23 smithi191 ceph-mon[31636]: pgmap v15341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:24.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28595.646287 secs 2024-04-21T18:21:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28595.646287 secs 2024-04-21T18:21:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28595.646287 secs 2024-04-21T18:21:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:25 smithi170 ceph-mon[31212]: pgmap v15342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:25 smithi077 ceph-mon[27902]: pgmap v15342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:25 smithi191 ceph-mon[31636]: pgmap v15342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:27 smithi170 ceph-mon[31212]: pgmap v15343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:27 smithi077 ceph-mon[27902]: pgmap v15343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:27 smithi191 ceph-mon[31636]: pgmap v15343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28598.887334 secs 2024-04-21T18:21:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28598.887334 secs 2024-04-21T18:21:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28598.887334 secs 2024-04-21T18:21:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:29 smithi170 ceph-mon[31212]: pgmap v15344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28600.646422 secs 2024-04-21T18:21:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:29 smithi077 ceph-mon[27902]: pgmap v15344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:29.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28600.646422 secs 2024-04-21T18:21:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:29 smithi191 ceph-mon[31636]: pgmap v15344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28600.646422 secs 2024-04-21T18:21:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:31 smithi170 ceph-mon[31212]: pgmap v15345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:31 smithi077 ceph-mon[27902]: pgmap v15345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:31 smithi191 ceph-mon[31636]: pgmap v15345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28603.887445 secs 2024-04-21T18:21:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:33 smithi170 ceph-mon[31212]: pgmap v15346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28603.887445 secs 2024-04-21T18:21:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:33 smithi077 ceph-mon[27902]: pgmap v15346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28603.887445 secs 2024-04-21T18:21:33.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:33 smithi191 ceph-mon[31636]: pgmap v15346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28605.646497 secs 2024-04-21T18:21:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28605.646497 secs 2024-04-21T18:21:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28605.646497 secs 2024-04-21T18:21:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:35.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:35 smithi170 ceph-mon[31212]: pgmap v15347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:35 smithi077 ceph-mon[27902]: pgmap v15347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:35 smithi191 ceph-mon[31636]: pgmap v15347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:21:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:37 smithi077 ceph-mon[27902]: pgmap v15348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:37 smithi191 ceph-mon[31636]: pgmap v15348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:38.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:37 smithi170 ceph-mon[31212]: pgmap v15348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:21:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28608.887562 secs 2024-04-21T18:21:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28608.887562 secs 2024-04-21T18:21:39.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28608.887562 secs 2024-04-21T18:21:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:39 smithi077 ceph-mon[27902]: pgmap v15349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28610.646646 secs 2024-04-21T18:21:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:39 smithi191 ceph-mon[31636]: pgmap v15349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28610.646646 secs 2024-04-21T18:21:40.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:39 smithi170 ceph-mon[31212]: pgmap v15349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28610.646646 secs 2024-04-21T18:21:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:40 smithi077 ceph-mon[27902]: pgmap v15350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:40 smithi191 ceph-mon[31636]: pgmap v15350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:40 smithi170 ceph-mon[31212]: pgmap v15350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28613.887679 secs 2024-04-21T18:21:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:43 smithi170 ceph-mon[31212]: pgmap v15351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28613.887679 secs 2024-04-21T18:21:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:43 smithi077 ceph-mon[27902]: pgmap v15351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28613.887679 secs 2024-04-21T18:21:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:43 smithi191 ceph-mon[31636]: pgmap v15351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:44.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28615.646764 secs 2024-04-21T18:21:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28615.646764 secs 2024-04-21T18:21:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28615.646764 secs 2024-04-21T18:21:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:45 smithi170 ceph-mon[31212]: pgmap v15352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:45 smithi077 ceph-mon[27902]: pgmap v15352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:45 smithi191 ceph-mon[31636]: pgmap v15352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:47.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:47 smithi170 ceph-mon[31212]: pgmap v15353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:47 smithi077 ceph-mon[27902]: pgmap v15353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:47 smithi191 ceph-mon[31636]: pgmap v15353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28618.887810 secs 2024-04-21T18:21:48.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:21:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28618.887810 secs 2024-04-21T18:21:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:21:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28618.887810 secs 2024-04-21T18:21:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:21:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:49 smithi191 ceph-mon[31636]: pgmap v15354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28620.646834 secs 2024-04-21T18:21:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:49 smithi170 ceph-mon[31212]: pgmap v15354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:49.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28620.646834 secs 2024-04-21T18:21:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:49 smithi077 ceph-mon[27902]: pgmap v15354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28620.646834 secs 2024-04-21T18:21:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: pgmap v15355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:21:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: pgmap v15355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:21:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: pgmap v15355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:21:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:52 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:21:52.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:52 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:21:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:21:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:21:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:21:52.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:52 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:21:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:21:52.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:52 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:21:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:21:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:21:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:21:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:52 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:21:52.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:21:52.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:52 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:21:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28623.887927 secs 2024-04-21T18:21:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:53 smithi170 ceph-mon[31212]: pgmap v15356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28623.887927 secs 2024-04-21T18:21:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:53 smithi077 ceph-mon[27902]: pgmap v15356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28623.887927 secs 2024-04-21T18:21:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:53 smithi191 ceph-mon[31636]: pgmap v15356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28625.646943 secs 2024-04-21T18:21:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28625.646943 secs 2024-04-21T18:21:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28625.646943 secs 2024-04-21T18:21:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:21:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:55 smithi170 ceph-mon[31212]: pgmap v15357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:55 smithi077 ceph-mon[27902]: pgmap v15357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:55 smithi191 ceph-mon[31636]: pgmap v15357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:21:57.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:57 smithi170 ceph-mon[31212]: pgmap v15358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:57 smithi077 ceph-mon[27902]: pgmap v15358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:57 smithi191 ceph-mon[31636]: pgmap v15358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:21:58.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28628.888045 secs 2024-04-21T18:21:58.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28628.888045 secs 2024-04-21T18:21:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28628.888045 secs 2024-04-21T18:21:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:59 smithi170 ceph-mon[31212]: pgmap v15359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:59.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28630.647061 secs 2024-04-21T18:21:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:59 smithi077 ceph-mon[27902]: pgmap v15359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28630.647061 secs 2024-04-21T18:21:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:59 smithi191 ceph-mon[31636]: pgmap v15359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:21:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28630.647061 secs 2024-04-21T18:22:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:01.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:01 smithi170 ceph-mon[31212]: pgmap v15360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:01 smithi077 ceph-mon[27902]: pgmap v15360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:01 smithi191 ceph-mon[31636]: pgmap v15360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28633.888161 secs 2024-04-21T18:22:03.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:03 smithi170 ceph-mon[31212]: pgmap v15361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28633.888161 secs 2024-04-21T18:22:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:03 smithi077 ceph-mon[27902]: pgmap v15361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28633.888161 secs 2024-04-21T18:22:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:03 smithi191 ceph-mon[31636]: pgmap v15361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:04.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28635.647176 secs 2024-04-21T18:22:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28635.647176 secs 2024-04-21T18:22:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28635.647176 secs 2024-04-21T18:22:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:05.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:05 smithi170 ceph-mon[31212]: pgmap v15362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:05 smithi170 ceph-mon[31212]: osdmap e1032: 12 total, 12 up, 12 in 2024-04-21T18:22:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:05 smithi077 ceph-mon[27902]: pgmap v15362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:05 smithi077 ceph-mon[27902]: osdmap e1032: 12 total, 12 up, 12 in 2024-04-21T18:22:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:05 smithi191 ceph-mon[31636]: pgmap v15362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:05 smithi191 ceph-mon[31636]: osdmap e1032: 12 total, 12 up, 12 in 2024-04-21T18:22:07.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:07 smithi170 ceph-mon[31212]: pgmap v15364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:22:07.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:07 smithi077 ceph-mon[27902]: pgmap v15364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:22:07.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:07 smithi191 ceph-mon[31636]: pgmap v15364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:22:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28638.888273 secs 2024-04-21T18:22:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:08 smithi191 ceph-mon[31636]: osdmap e1033: 12 total, 12 up, 12 in 2024-04-21T18:22:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:08 smithi191 ceph-mon[31636]: pgmap v15366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:22:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28638.888273 secs 2024-04-21T18:22:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:08 smithi170 ceph-mon[31212]: osdmap e1033: 12 total, 12 up, 12 in 2024-04-21T18:22:09.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:08 smithi170 ceph-mon[31212]: pgmap v15366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:22:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28638.888273 secs 2024-04-21T18:22:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:08 smithi077 ceph-mon[27902]: osdmap e1033: 12 total, 12 up, 12 in 2024-04-21T18:22:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:08 smithi077 ceph-mon[27902]: pgmap v15366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:22:09.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28640.647290 secs 2024-04-21T18:22:10.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28640.647290 secs 2024-04-21T18:22:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:10.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28640.647290 secs 2024-04-21T18:22:10.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:10 smithi191 ceph-mon[31636]: pgmap v15367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:22:10.980 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:10 smithi170 ceph-mon[31212]: pgmap v15367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:22:11.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:10 smithi077 ceph-mon[27902]: pgmap v15367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:22:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28643.888364 secs 2024-04-21T18:22:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:13 smithi170 ceph-mon[31212]: pgmap v15368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:22:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28643.888364 secs 2024-04-21T18:22:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:13 smithi077 ceph-mon[27902]: pgmap v15368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:22:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28643.888364 secs 2024-04-21T18:22:13.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:13 smithi191 ceph-mon[31636]: pgmap v15368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:22:14.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28645.647409 secs 2024-04-21T18:22:14.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28645.647409 secs 2024-04-21T18:22:14.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28645.647409 secs 2024-04-21T18:22:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:15.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:15 smithi170 ceph-mon[31212]: pgmap v15369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:22:15.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:15 smithi077 ceph-mon[27902]: pgmap v15369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:22:15.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:15 smithi191 ceph-mon[31636]: pgmap v15369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:22:17.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:17 smithi170 ceph-mon[31212]: pgmap v15370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:22:17.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:17 smithi077 ceph-mon[27902]: pgmap v15370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:22:17.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:17 smithi191 ceph-mon[31636]: pgmap v15370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:22:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28648.888482 secs 2024-04-21T18:22:18.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28648.888482 secs 2024-04-21T18:22:18.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28648.888482 secs 2024-04-21T18:22:19.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:19 smithi077 ceph-mon[27902]: pgmap v15371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:22:19.786 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28650.647527 secs 2024-04-21T18:22:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:19 smithi170 ceph-mon[31212]: pgmap v15371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:22:19.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28650.647527 secs 2024-04-21T18:22:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:19 smithi191 ceph-mon[31636]: pgmap v15371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:22:19.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28650.647527 secs 2024-04-21T18:22:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:21.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:21 smithi170 ceph-mon[31212]: pgmap v15372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:22:21.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:21 smithi077 ceph-mon[27902]: pgmap v15372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:22:21.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:21 smithi191 ceph-mon[31636]: pgmap v15372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:22:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28653.888576 secs 2024-04-21T18:22:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:23 smithi170 ceph-mon[31212]: pgmap v15373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28653.888576 secs 2024-04-21T18:22:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:23 smithi077 ceph-mon[27902]: pgmap v15373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28653.888576 secs 2024-04-21T18:22:23.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:23 smithi191 ceph-mon[31636]: pgmap v15373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:24.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28655.647654 secs 2024-04-21T18:22:24.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28655.647654 secs 2024-04-21T18:22:24.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28655.647654 secs 2024-04-21T18:22:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:25.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:25 smithi170 ceph-mon[31212]: pgmap v15374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:25.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:25 smithi077 ceph-mon[27902]: pgmap v15374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:25.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:25 smithi191 ceph-mon[31636]: pgmap v15374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:27.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:27 smithi170 ceph-mon[31212]: pgmap v15375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:27.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:27 smithi077 ceph-mon[27902]: pgmap v15375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:27.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:27 smithi191 ceph-mon[31636]: pgmap v15375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:28.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28658.888690 secs 2024-04-21T18:22:28.869 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28658.888690 secs 2024-04-21T18:22:28.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28658.888690 secs 2024-04-21T18:22:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:29 smithi170 ceph-mon[31212]: pgmap v15376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:29.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28660.647774 secs 2024-04-21T18:22:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:29 smithi077 ceph-mon[27902]: pgmap v15376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:29.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28660.647774 secs 2024-04-21T18:22:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:29 smithi191 ceph-mon[31636]: pgmap v15376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:29.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28660.647774 secs 2024-04-21T18:22:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:31.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:31 smithi077 ceph-mon[27902]: pgmap v15377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:31.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:31 smithi191 ceph-mon[31636]: pgmap v15377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:32.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:31 smithi170 ceph-mon[31212]: pgmap v15377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:33.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28663.888806 secs 2024-04-21T18:22:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:33 smithi077 ceph-mon[27902]: pgmap v15378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28663.888806 secs 2024-04-21T18:22:33.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:33 smithi191 ceph-mon[31636]: pgmap v15378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:34.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28663.888806 secs 2024-04-21T18:22:34.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:33 smithi170 ceph-mon[31212]: pgmap v15378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:34.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28665.647903 secs 2024-04-21T18:22:34.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28665.647903 secs 2024-04-21T18:22:35.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28665.647903 secs 2024-04-21T18:22:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:35.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:35 smithi077 ceph-mon[27902]: pgmap v15379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:35.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:35 smithi191 ceph-mon[31636]: pgmap v15379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:36.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:35 smithi170 ceph-mon[31212]: pgmap v15379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:37.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:37 smithi077 ceph-mon[27902]: pgmap v15380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:37.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:37 smithi191 ceph-mon[31636]: pgmap v15380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:38.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:37 smithi170 ceph-mon[31212]: pgmap v15380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28668.888871 secs 2024-04-21T18:22:38.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28668.888871 secs 2024-04-21T18:22:39.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28668.888871 secs 2024-04-21T18:22:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:39 smithi077 ceph-mon[27902]: pgmap v15381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:39.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28670.647957 secs 2024-04-21T18:22:39.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:39 smithi191 ceph-mon[31636]: pgmap v15381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:39.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28670.647957 secs 2024-04-21T18:22:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:39 smithi170 ceph-mon[31212]: pgmap v15381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:40.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28670.647957 secs 2024-04-21T18:22:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:40.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:40 smithi077 ceph-mon[27902]: pgmap v15382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:40.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:40 smithi191 ceph-mon[31636]: pgmap v15382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:41.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:40 smithi170 ceph-mon[31212]: pgmap v15382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28673.889005 secs 2024-04-21T18:22:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:43 smithi170 ceph-mon[31212]: pgmap v15383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28673.889005 secs 2024-04-21T18:22:43.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:43 smithi077 ceph-mon[27902]: pgmap v15383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:43.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28673.889005 secs 2024-04-21T18:22:43.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:43 smithi191 ceph-mon[31636]: pgmap v15383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:44.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28675.648066 secs 2024-04-21T18:22:44.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28675.648066 secs 2024-04-21T18:22:44.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28675.648066 secs 2024-04-21T18:22:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:45.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:45 smithi170 ceph-mon[31212]: pgmap v15384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:45.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:45 smithi077 ceph-mon[27902]: pgmap v15384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:45.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:45 smithi191 ceph-mon[31636]: pgmap v15384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:47.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:47 smithi170 ceph-mon[31212]: pgmap v15385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:47 smithi077 ceph-mon[27902]: pgmap v15385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:47.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:47 smithi191 ceph-mon[31636]: pgmap v15385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:48.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28678.889118 secs 2024-04-21T18:22:48.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28678.889118 secs 2024-04-21T18:22:48.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28678.889118 secs 2024-04-21T18:22:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:49 smithi170 ceph-mon[31212]: pgmap v15386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:49.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28680.648184 secs 2024-04-21T18:22:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:49 smithi077 ceph-mon[27902]: pgmap v15386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:49.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28680.648184 secs 2024-04-21T18:22:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:49 smithi191 ceph-mon[31636]: pgmap v15386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:49.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28680.648184 secs 2024-04-21T18:22:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:51.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:51 smithi170 ceph-mon[31212]: pgmap v15387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:51.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:51 smithi077 ceph-mon[27902]: pgmap v15387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:22:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:51.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:51 smithi191 ceph-mon[31636]: pgmap v15387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:22:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:51.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:52.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:22:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:22:52.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:22:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:22:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:22:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:22:52.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:22:53.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28683.889236 secs 2024-04-21T18:22:53.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:53 smithi170 ceph-mon[31212]: pgmap v15388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28683.889236 secs 2024-04-21T18:22:53.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:53 smithi077 ceph-mon[27902]: pgmap v15388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28683.889236 secs 2024-04-21T18:22:53.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:53 smithi191 ceph-mon[31636]: pgmap v15388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:54.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28685.648259 secs 2024-04-21T18:22:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28685.648259 secs 2024-04-21T18:22:54.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28685.648259 secs 2024-04-21T18:22:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:22:55.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:55 smithi170 ceph-mon[31212]: pgmap v15389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:55.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:55 smithi077 ceph-mon[27902]: pgmap v15389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:55.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:55 smithi191 ceph-mon[31636]: pgmap v15389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:57.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:57 smithi077 ceph-mon[27902]: pgmap v15390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:57.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:57 smithi191 ceph-mon[31636]: pgmap v15390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:58.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:57 smithi170 ceph-mon[31212]: pgmap v15390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:22:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:22:58.320+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:22:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:22:58.320+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:22:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:22:58.320+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:22:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:22:58.320+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:22:58.868 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28688.889327 secs 2024-04-21T18:22:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28688.889327 secs 2024-04-21T18:22:58.956 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28688.889327 secs 2024-04-21T18:22:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:59 smithi077 ceph-mon[27902]: pgmap v15391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:59.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28690.648332 secs 2024-04-21T18:22:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:59 smithi191 ceph-mon[31636]: pgmap v15391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:22:59.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28690.648332 secs 2024-04-21T18:23:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:59 smithi170 ceph-mon[31212]: pgmap v15391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:00.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28690.648332 secs 2024-04-21T18:23:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:01.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:01 smithi077 ceph-mon[27902]: pgmap v15392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:01.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:01 smithi191 ceph-mon[31636]: pgmap v15392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:02.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:01 smithi170 ceph-mon[31212]: pgmap v15392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28693.889461 secs 2024-04-21T18:23:03.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:03 smithi077 ceph-mon[27902]: pgmap v15393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28693.889461 secs 2024-04-21T18:23:03.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:03 smithi191 ceph-mon[31636]: pgmap v15393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:04.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28693.889461 secs 2024-04-21T18:23:04.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:03 smithi170 ceph-mon[31212]: pgmap v15393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:04.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28695.648467 secs 2024-04-21T18:23:04.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28695.648467 secs 2024-04-21T18:23:05.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28695.648467 secs 2024-04-21T18:23:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:05 smithi077 ceph-mon[27902]: pgmap v15394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:05 smithi077 ceph-mon[27902]: osdmap e1034: 12 total, 12 up, 12 in 2024-04-21T18:23:05.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:05 smithi191 ceph-mon[31636]: pgmap v15394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:05.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:05 smithi191 ceph-mon[31636]: osdmap e1034: 12 total, 12 up, 12 in 2024-04-21T18:23:06.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:05 smithi170 ceph-mon[31212]: pgmap v15394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:06.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:05 smithi170 ceph-mon[31212]: osdmap e1034: 12 total, 12 up, 12 in 2024-04-21T18:23:06.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:06 smithi077 ceph-mon[27902]: pgmap v15396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:23:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:06 smithi191 ceph-mon[31636]: pgmap v15396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:23:07.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:06 smithi170 ceph-mon[31212]: pgmap v15396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:23:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28698.889577 secs 2024-04-21T18:23:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:08 smithi191 ceph-mon[31636]: osdmap e1035: 12 total, 12 up, 12 in 2024-04-21T18:23:08.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:08 smithi191 ceph-mon[31636]: pgmap v15398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:23:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28698.889577 secs 2024-04-21T18:23:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:08 smithi170 ceph-mon[31212]: osdmap e1035: 12 total, 12 up, 12 in 2024-04-21T18:23:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:08 smithi170 ceph-mon[31212]: pgmap v15398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:23:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28698.889577 secs 2024-04-21T18:23:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:08 smithi077 ceph-mon[27902]: osdmap e1035: 12 total, 12 up, 12 in 2024-04-21T18:23:09.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:08 smithi077 ceph-mon[27902]: pgmap v15398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:23:09.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28700.648601 secs 2024-04-21T18:23:10.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28700.648601 secs 2024-04-21T18:23:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:10.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28700.648601 secs 2024-04-21T18:23:10.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:10 smithi191 ceph-mon[31636]: pgmap v15399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:23:11.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:10 smithi170 ceph-mon[31212]: pgmap v15399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:23:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:10 smithi077 ceph-mon[27902]: pgmap v15399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:23:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28703.889692 secs 2024-04-21T18:23:13.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:13 smithi170 ceph-mon[31212]: pgmap v15400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:23:13.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28703.889692 secs 2024-04-21T18:23:13.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:13 smithi077 ceph-mon[27902]: pgmap v15400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:23:13.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28703.889692 secs 2024-04-21T18:23:13.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:13 smithi191 ceph-mon[31636]: pgmap v15400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:23:14.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28705.648735 secs 2024-04-21T18:23:14.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28705.648735 secs 2024-04-21T18:23:14.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28705.648735 secs 2024-04-21T18:23:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:15.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:15 smithi170 ceph-mon[31212]: pgmap v15401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:23:15.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:15 smithi077 ceph-mon[27902]: pgmap v15401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:23:15.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:15 smithi191 ceph-mon[31636]: pgmap v15401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:23:17.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:17 smithi170 ceph-mon[31212]: pgmap v15402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:23:17.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:17 smithi077 ceph-mon[27902]: pgmap v15402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:23:17.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:17 smithi191 ceph-mon[31636]: pgmap v15402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:23:18.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28708.889788 secs 2024-04-21T18:23:18.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28708.889788 secs 2024-04-21T18:23:18.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28708.889788 secs 2024-04-21T18:23:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:19 smithi170 ceph-mon[31212]: pgmap v15403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:23:19.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28710.648851 secs 2024-04-21T18:23:19.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:19 smithi077 ceph-mon[27902]: pgmap v15403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:23:19.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28710.648851 secs 2024-04-21T18:23:19.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:19 smithi191 ceph-mon[31636]: pgmap v15403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:23:19.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28710.648851 secs 2024-04-21T18:23:20.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:21.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:21 smithi170 ceph-mon[31212]: pgmap v15404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:23:21.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:21 smithi077 ceph-mon[27902]: pgmap v15404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:23:21.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:21 smithi191 ceph-mon[31636]: pgmap v15404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:23:23.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28713.889907 secs 2024-04-21T18:23:23.805 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:23 smithi170 ceph-mon[31212]: pgmap v15405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:23.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28713.889907 secs 2024-04-21T18:23:23.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:23 smithi077 ceph-mon[27902]: pgmap v15405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:23.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28713.889907 secs 2024-04-21T18:23:23.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:23 smithi191 ceph-mon[31636]: pgmap v15405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28715.648963 secs 2024-04-21T18:23:24.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28715.648963 secs 2024-04-21T18:23:25.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28715.648963 secs 2024-04-21T18:23:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:25.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:25 smithi077 ceph-mon[27902]: pgmap v15406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:25.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:25 smithi191 ceph-mon[31636]: pgmap v15406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:26.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:25 smithi170 ceph-mon[31212]: pgmap v15406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:27.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:27 smithi077 ceph-mon[27902]: pgmap v15407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:27.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:27 smithi191 ceph-mon[31636]: pgmap v15407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:28.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:27 smithi170 ceph-mon[31212]: pgmap v15407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:28.867 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28718.890000 secs 2024-04-21T18:23:28.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28718.890000 secs 2024-04-21T18:23:28.956 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28718.890000 secs 2024-04-21T18:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:29 smithi077 ceph-mon[27902]: pgmap v15408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28720.649044 secs 2024-04-21T18:23:29.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:29 smithi191 ceph-mon[31636]: pgmap v15408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:29.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28720.649044 secs 2024-04-21T18:23:30.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:29 smithi170 ceph-mon[31212]: pgmap v15408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:30.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28720.649044 secs 2024-04-21T18:23:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:31.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:31 smithi077 ceph-mon[27902]: pgmap v15409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:31.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:31 smithi191 ceph-mon[31636]: pgmap v15409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:32.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:31 smithi170 ceph-mon[31212]: pgmap v15409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:33.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28723.890134 secs 2024-04-21T18:23:33.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:33 smithi077 ceph-mon[27902]: pgmap v15410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:33.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28723.890134 secs 2024-04-21T18:23:33.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:33 smithi191 ceph-mon[31636]: pgmap v15410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:34.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28723.890134 secs 2024-04-21T18:23:34.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:33 smithi170 ceph-mon[31212]: pgmap v15410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:34.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28725.649153 secs 2024-04-21T18:23:34.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28725.649153 secs 2024-04-21T18:23:35.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28725.649153 secs 2024-04-21T18:23:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:35.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:35 smithi077 ceph-mon[27902]: pgmap v15411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:35.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:35 smithi191 ceph-mon[31636]: pgmap v15411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:36.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:35 smithi170 ceph-mon[31212]: pgmap v15411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:36 smithi077 ceph-mon[27902]: pgmap v15412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:36.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:36 smithi191 ceph-mon[31636]: pgmap v15412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:37.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:36 smithi170 ceph-mon[31212]: pgmap v15412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:38.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28728.890266 secs 2024-04-21T18:23:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28728.890266 secs 2024-04-21T18:23:38.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28728.890266 secs 2024-04-21T18:23:39.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:38 smithi170 ceph-mon[31212]: pgmap v15413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:38 smithi077 ceph-mon[27902]: pgmap v15413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:39.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:38 smithi191 ceph-mon[31636]: pgmap v15413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:40.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28730.649235 secs 2024-04-21T18:23:40.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:40.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28730.649235 secs 2024-04-21T18:23:40.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28730.649235 secs 2024-04-21T18:23:41.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:40 smithi170 ceph-mon[31212]: pgmap v15414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:41.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:40 smithi077 ceph-mon[27902]: pgmap v15414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:41.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:40 smithi191 ceph-mon[31636]: pgmap v15414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:43.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28733.890376 secs 2024-04-21T18:23:43.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:43 smithi170 ceph-mon[31212]: pgmap v15415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:43.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28733.890376 secs 2024-04-21T18:23:43.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:43 smithi077 ceph-mon[27902]: pgmap v15415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:43.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28733.890376 secs 2024-04-21T18:23:43.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:43 smithi191 ceph-mon[31636]: pgmap v15415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:44.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28735.649344 secs 2024-04-21T18:23:44.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28735.649344 secs 2024-04-21T18:23:44.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28735.649344 secs 2024-04-21T18:23:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:45.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:45 smithi170 ceph-mon[31212]: pgmap v15416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:45.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:45 smithi077 ceph-mon[27902]: pgmap v15416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:45.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:45 smithi191 ceph-mon[31636]: pgmap v15416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:47.804 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:47 smithi170 ceph-mon[31212]: pgmap v15417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:47.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:47 smithi077 ceph-mon[27902]: pgmap v15417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:47.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:47 smithi191 ceph-mon[31636]: pgmap v15417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:48.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28738.890491 secs 2024-04-21T18:23:48.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28738.890491 secs 2024-04-21T18:23:48.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28738.890491 secs 2024-04-21T18:23:49.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:49 smithi077 ceph-mon[27902]: pgmap v15418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:49.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28740.649448 secs 2024-04-21T18:23:49.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:49 smithi191 ceph-mon[31636]: pgmap v15418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:49.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28740.649448 secs 2024-04-21T18:23:50.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:49 smithi170 ceph-mon[31212]: pgmap v15418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:50.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28740.649448 secs 2024-04-21T18:23:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:51.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:51 smithi077 ceph-mon[27902]: pgmap v15419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:51.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:51 smithi191 ceph-mon[31636]: pgmap v15419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:52.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:51 smithi170 ceph-mon[31212]: pgmap v15419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:52.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:23:52.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:23:53.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:23:53.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28743.890606 secs 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: pgmap v15420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:23:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28743.890606 secs 2024-04-21T18:23:53.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: pgmap v15420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:53.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:53.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:23:53.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:23:53.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28743.890606 secs 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: pgmap v15420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:23:54.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:23:54.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28745.649571 secs 2024-04-21T18:23:54.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28745.649571 secs 2024-04-21T18:23:55.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28745.649571 secs 2024-04-21T18:23:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:23:55.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:55 smithi077 ceph-mon[27902]: pgmap v15421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:55.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:55 smithi191 ceph-mon[31636]: pgmap v15421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:56.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:55 smithi170 ceph-mon[31212]: pgmap v15421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:57.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:57 smithi077 ceph-mon[27902]: pgmap v15422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:57.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:57 smithi191 ceph-mon[31636]: pgmap v15422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:58.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:57 smithi170 ceph-mon[31212]: pgmap v15422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:23:58.866 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28748.890747 secs 2024-04-21T18:23:58.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28748.890747 secs 2024-04-21T18:23:58.955 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28748.890747 secs 2024-04-21T18:23:59.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:59 smithi191 ceph-mon[31636]: pgmap v15423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:59.881 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28750.649691 secs 2024-04-21T18:23:59.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:59 smithi077 ceph-mon[27902]: pgmap v15423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:23:59.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28750.649691 secs 2024-04-21T18:24:00.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:59 smithi170 ceph-mon[31212]: pgmap v15423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:00.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28750.649691 secs 2024-04-21T18:24:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:00.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:00 smithi077 ceph-mon[27902]: pgmap v15424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:00.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:00 smithi191 ceph-mon[31636]: pgmap v15424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:01.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:00 smithi170 ceph-mon[31212]: pgmap v15424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:03.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28753.890811 secs 2024-04-21T18:24:03.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:03 smithi170 ceph-mon[31212]: pgmap v15425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:03.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28753.890811 secs 2024-04-21T18:24:03.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:03 smithi077 ceph-mon[27902]: pgmap v15425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:03.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28753.890811 secs 2024-04-21T18:24:03.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:03 smithi191 ceph-mon[31636]: pgmap v15425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:04.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28755.649800 secs 2024-04-21T18:24:04.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28755.649800 secs 2024-04-21T18:24:04.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28755.649800 secs 2024-04-21T18:24:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:05.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:05 smithi170 ceph-mon[31212]: pgmap v15426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:05.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:05 smithi170 ceph-mon[31212]: osdmap e1036: 12 total, 12 up, 12 in 2024-04-21T18:24:05.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:05 smithi077 ceph-mon[27902]: pgmap v15426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:05.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:05 smithi077 ceph-mon[27902]: osdmap e1036: 12 total, 12 up, 12 in 2024-04-21T18:24:05.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:05 smithi191 ceph-mon[31636]: pgmap v15426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:05.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:05 smithi191 ceph-mon[31636]: osdmap e1036: 12 total, 12 up, 12 in 2024-04-21T18:24:07.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:07 smithi170 ceph-mon[31212]: pgmap v15428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:24:07.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:07 smithi077 ceph-mon[27902]: pgmap v15428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:24:07.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:07 smithi191 ceph-mon[31636]: pgmap v15428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:24:08.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28758.890881 secs 2024-04-21T18:24:08.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28758.890881 secs 2024-04-21T18:24:09.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28758.890881 secs 2024-04-21T18:24:09.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:09 smithi077 ceph-mon[27902]: pgmap v15429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:24:09.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28760.649917 secs 2024-04-21T18:24:09.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:09 smithi191 ceph-mon[31636]: pgmap v15429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:24:09.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28760.649917 secs 2024-04-21T18:24:10.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:09 smithi170 ceph-mon[31212]: pgmap v15429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:24:10.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28760.649917 secs 2024-04-21T18:24:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:11.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:11 smithi077 ceph-mon[27902]: pgmap v15430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:24:11.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:11 smithi191 ceph-mon[31636]: pgmap v15430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:24:12.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:11 smithi170 ceph-mon[31212]: pgmap v15430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:24:13.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28763.890980 secs 2024-04-21T18:24:13.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:13 smithi077 ceph-mon[27902]: pgmap v15431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:24:13.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:13 smithi077 ceph-mon[27902]: osdmap e1037: 12 total, 12 up, 12 in 2024-04-21T18:24:13.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28763.890980 secs 2024-04-21T18:24:13.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:13 smithi191 ceph-mon[31636]: pgmap v15431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:24:13.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:13 smithi191 ceph-mon[31636]: osdmap e1037: 12 total, 12 up, 12 in 2024-04-21T18:24:14.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28763.890980 secs 2024-04-21T18:24:14.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:13 smithi170 ceph-mon[31212]: pgmap v15431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:24:14.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:13 smithi170 ceph-mon[31212]: osdmap e1037: 12 total, 12 up, 12 in 2024-04-21T18:24:14.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28765.650025 secs 2024-04-21T18:24:14.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28765.650025 secs 2024-04-21T18:24:15.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28765.650025 secs 2024-04-21T18:24:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:15.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:15 smithi077 ceph-mon[27902]: pgmap v15433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:24:15.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:15 smithi191 ceph-mon[31636]: pgmap v15433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:24:16.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:15 smithi170 ceph-mon[31212]: pgmap v15433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:24:17.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:17 smithi077 ceph-mon[27902]: pgmap v15434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:24:17.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:17 smithi191 ceph-mon[31636]: pgmap v15434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:24:18.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:17 smithi170 ceph-mon[31212]: pgmap v15434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:24:18.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28768.891097 secs 2024-04-21T18:24:18.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28768.891097 secs 2024-04-21T18:24:19.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28768.891097 secs 2024-04-21T18:24:19.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:19 smithi077 ceph-mon[27902]: pgmap v15435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:24:19.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28770.650111 secs 2024-04-21T18:24:19.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:19 smithi191 ceph-mon[31636]: pgmap v15435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:24:19.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28770.650111 secs 2024-04-21T18:24:20.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:19 smithi170 ceph-mon[31212]: pgmap v15435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:24:20.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28770.650111 secs 2024-04-21T18:24:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:20.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:20 smithi077 ceph-mon[27902]: pgmap v15436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:24:20.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:20 smithi191 ceph-mon[31636]: pgmap v15436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:24:21.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:20 smithi170 ceph-mon[31212]: pgmap v15436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:24:23.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28773.891218 secs 2024-04-21T18:24:23.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:23 smithi170 ceph-mon[31212]: pgmap v15437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:24:23.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28773.891218 secs 2024-04-21T18:24:23.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:23 smithi077 ceph-mon[27902]: pgmap v15437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:24:23.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28773.891218 secs 2024-04-21T18:24:23.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:23 smithi191 ceph-mon[31636]: pgmap v15437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:24:24.803 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28775.650214 secs 2024-04-21T18:24:24.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28775.650214 secs 2024-04-21T18:24:24.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28775.650214 secs 2024-04-21T18:24:25.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:25.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:25 smithi077 ceph-mon[27902]: pgmap v15438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:24:25.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:25 smithi191 ceph-mon[31636]: pgmap v15438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:24:26.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:25 smithi170 ceph-mon[31212]: pgmap v15438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:24:27.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:27 smithi077 ceph-mon[27902]: pgmap v15439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:27.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:27 smithi191 ceph-mon[31636]: pgmap v15439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:28.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:27 smithi170 ceph-mon[31212]: pgmap v15439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:28.866 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28778.891336 secs 2024-04-21T18:24:28.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28778.891336 secs 2024-04-21T18:24:28.954 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28778.891336 secs 2024-04-21T18:24:29.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:29 smithi077 ceph-mon[27902]: pgmap v15440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:29.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28780.650338 secs 2024-04-21T18:24:29.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:29 smithi191 ceph-mon[31636]: pgmap v15440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:29.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28780.650338 secs 2024-04-21T18:24:30.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:29 smithi170 ceph-mon[31212]: pgmap v15440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:30.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28780.650338 secs 2024-04-21T18:24:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:31.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:31 smithi077 ceph-mon[27902]: pgmap v15441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:31.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:31 smithi191 ceph-mon[31636]: pgmap v15441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:32.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:31 smithi170 ceph-mon[31212]: pgmap v15441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:33.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28783.891432 secs 2024-04-21T18:24:33.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:33 smithi077 ceph-mon[27902]: pgmap v15442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:33.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28783.891432 secs 2024-04-21T18:24:33.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:33 smithi191 ceph-mon[31636]: pgmap v15442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:34.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28783.891432 secs 2024-04-21T18:24:34.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:33 smithi170 ceph-mon[31212]: pgmap v15442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:34.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28785.650459 secs 2024-04-21T18:24:34.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28785.650459 secs 2024-04-21T18:24:35.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28785.650459 secs 2024-04-21T18:24:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:35.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:35 smithi077 ceph-mon[27902]: pgmap v15443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:35.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:35 smithi191 ceph-mon[31636]: pgmap v15443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:36.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:35 smithi170 ceph-mon[31212]: pgmap v15443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:37.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:37 smithi077 ceph-mon[27902]: pgmap v15444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:37.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:37 smithi191 ceph-mon[31636]: pgmap v15444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:38.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:37 smithi170 ceph-mon[31212]: pgmap v15444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:38.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28788.891566 secs 2024-04-21T18:24:38.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28788.891566 secs 2024-04-21T18:24:39.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28788.891566 secs 2024-04-21T18:24:39.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:39 smithi077 ceph-mon[27902]: pgmap v15445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:39.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28790.650566 secs 2024-04-21T18:24:39.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:39 smithi191 ceph-mon[31636]: pgmap v15445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:39.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28790.650566 secs 2024-04-21T18:24:40.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:39 smithi170 ceph-mon[31212]: pgmap v15445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:40.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28790.650566 secs 2024-04-21T18:24:40.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:40.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:40 smithi077 ceph-mon[27902]: pgmap v15446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:40.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:40 smithi191 ceph-mon[31636]: pgmap v15446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:41.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:40 smithi170 ceph-mon[31212]: pgmap v15446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:43.802 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28793.891686 secs 2024-04-21T18:24:43.802 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:43 smithi170 ceph-mon[31212]: pgmap v15447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:43.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28793.891686 secs 2024-04-21T18:24:43.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:43 smithi077 ceph-mon[27902]: pgmap v15447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:43.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28793.891686 secs 2024-04-21T18:24:43.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:43 smithi191 ceph-mon[31636]: pgmap v15447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:44.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28795.650664 secs 2024-04-21T18:24:44.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28795.650664 secs 2024-04-21T18:24:45.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28795.650664 secs 2024-04-21T18:24:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:45.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:45 smithi077 ceph-mon[27902]: pgmap v15448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:45.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:45 smithi191 ceph-mon[31636]: pgmap v15448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:46.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:45 smithi170 ceph-mon[31212]: pgmap v15448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:47.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:47 smithi077 ceph-mon[27902]: pgmap v15449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:47.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:47 smithi191 ceph-mon[31636]: pgmap v15449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:48.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:47 smithi170 ceph-mon[31212]: pgmap v15449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:48.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28798.891829 secs 2024-04-21T18:24:48.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28798.891829 secs 2024-04-21T18:24:49.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28798.891829 secs 2024-04-21T18:24:49.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:49 smithi077 ceph-mon[27902]: pgmap v15450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:49.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28800.650795 secs 2024-04-21T18:24:49.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:49 smithi191 ceph-mon[31636]: pgmap v15450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:49.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28800.650795 secs 2024-04-21T18:24:50.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:49 smithi170 ceph-mon[31212]: pgmap v15450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:50.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28800.650795 secs 2024-04-21T18:24:50.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:51.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:51 smithi077 ceph-mon[27902]: pgmap v15451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:51.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:51 smithi191 ceph-mon[31636]: pgmap v15451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:52.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:51 smithi170 ceph-mon[31212]: pgmap v15451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:53.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28803.891946 secs 2024-04-21T18:24:53.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:53 smithi077 ceph-mon[27902]: pgmap v15452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:53.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:24:53.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28803.891946 secs 2024-04-21T18:24:53.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:53 smithi191 ceph-mon[31636]: pgmap v15452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:53.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:24:54.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28803.891946 secs 2024-04-21T18:24:54.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:53 smithi170 ceph-mon[31212]: pgmap v15452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:54.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:24:54.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28805.650883 secs 2024-04-21T18:24:54.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:24:54.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:24:54.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:24:54.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28805.650883 secs 2024-04-21T18:24:54.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:24:54.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:24:54.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:24:55.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28805.650883 secs 2024-04-21T18:24:55.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:24:55.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:24:55.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:24:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:24:55.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:55 smithi077 ceph-mon[27902]: pgmap v15453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:55.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:55 smithi191 ceph-mon[31636]: pgmap v15453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:56.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:55 smithi170 ceph-mon[31212]: pgmap v15453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:57.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:57 smithi077 ceph-mon[27902]: pgmap v15454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:57.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:57 smithi191 ceph-mon[31636]: pgmap v15454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:58.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:57 smithi170 ceph-mon[31212]: pgmap v15454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:24:59.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28808.892012 secs 2024-04-21T18:24:59.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:58 smithi170 ceph-mon[31212]: pgmap v15455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:59.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28808.892012 secs 2024-04-21T18:24:59.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:58 smithi077 ceph-mon[27902]: pgmap v15455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:24:59.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28808.892012 secs 2024-04-21T18:24:59.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:58 smithi191 ceph-mon[31636]: pgmap v15455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:00.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28810.650948 secs 2024-04-21T18:25:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 28995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:00.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28810.650948 secs 2024-04-21T18:25:00.214 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28810.650948 secs 2024-04-21T18:25:01.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:00 smithi170 ceph-mon[31212]: pgmap v15456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:01.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:00 smithi077 ceph-mon[27902]: pgmap v15456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:01.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:00 smithi191 ceph-mon[31636]: pgmap v15456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:03.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28813.892123 secs 2024-04-21T18:25:03.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:03 smithi077 ceph-mon[27902]: pgmap v15457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:03.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28813.892123 secs 2024-04-21T18:25:03.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:03 smithi191 ceph-mon[31636]: pgmap v15457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:04.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28813.892123 secs 2024-04-21T18:25:04.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:03 smithi170 ceph-mon[31212]: pgmap v15457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:04.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28815.651020 secs 2024-04-21T18:25:04.992 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28815.651020 secs 2024-04-21T18:25:05.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28815.651020 secs 2024-04-21T18:25:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:05.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:05 smithi077 ceph-mon[27902]: pgmap v15458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:05.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:05 smithi077 ceph-mon[27902]: osdmap e1038: 12 total, 12 up, 12 in 2024-04-21T18:25:05.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:05 smithi191 ceph-mon[31636]: pgmap v15458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:05.964 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:05 smithi191 ceph-mon[31636]: osdmap e1038: 12 total, 12 up, 12 in 2024-04-21T18:25:06.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:05 smithi170 ceph-mon[31212]: pgmap v15458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:06.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:05 smithi170 ceph-mon[31212]: osdmap e1038: 12 total, 12 up, 12 in 2024-04-21T18:25:07.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:07 smithi077 ceph-mon[27902]: pgmap v15460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:25:07.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:07 smithi191 ceph-mon[31636]: pgmap v15460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:25:08.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:07 smithi170 ceph-mon[31212]: pgmap v15460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:25:08.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28818.892242 secs 2024-04-21T18:25:08.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:08 smithi191 ceph-mon[31636]: osdmap e1039: 12 total, 12 up, 12 in 2024-04-21T18:25:08.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:08 smithi191 ceph-mon[31636]: pgmap v15462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:25:09.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28818.892242 secs 2024-04-21T18:25:09.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:08 smithi170 ceph-mon[31212]: osdmap e1039: 12 total, 12 up, 12 in 2024-04-21T18:25:09.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:08 smithi170 ceph-mon[31212]: pgmap v15462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:25:09.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28818.892242 secs 2024-04-21T18:25:09.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:08 smithi077 ceph-mon[27902]: osdmap e1039: 12 total, 12 up, 12 in 2024-04-21T18:25:09.131 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:08 smithi077 ceph-mon[27902]: pgmap v15462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:25:10.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28820.651098 secs 2024-04-21T18:25:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:10.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28820.651098 secs 2024-04-21T18:25:10.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28820.651098 secs 2024-04-21T18:25:11.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:10 smithi170 ceph-mon[31212]: pgmap v15463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:25:11.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:10 smithi077 ceph-mon[27902]: pgmap v15463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:25:11.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:10 smithi191 ceph-mon[31636]: pgmap v15463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:25:13.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28823.892385 secs 2024-04-21T18:25:13.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:13 smithi077 ceph-mon[27902]: pgmap v15464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:25:13.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28823.892385 secs 2024-04-21T18:25:13.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:13 smithi191 ceph-mon[31636]: pgmap v15464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:25:14.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28823.892385 secs 2024-04-21T18:25:14.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:13 smithi170 ceph-mon[31212]: pgmap v15464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:25:14.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28825.651218 secs 2024-04-21T18:25:14.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28825.651218 secs 2024-04-21T18:25:15.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28825.651218 secs 2024-04-21T18:25:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:15.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:15 smithi077 ceph-mon[27902]: pgmap v15465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:25:15.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:15 smithi191 ceph-mon[31636]: pgmap v15465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:25:16.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:15 smithi170 ceph-mon[31212]: pgmap v15465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:25:17.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:17 smithi077 ceph-mon[27902]: pgmap v15466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:25:17.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:17 smithi191 ceph-mon[31636]: pgmap v15466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:25:18.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:17 smithi170 ceph-mon[31212]: pgmap v15466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:25:18.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28828.892505 secs 2024-04-21T18:25:18.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28828.892505 secs 2024-04-21T18:25:19.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28828.892505 secs 2024-04-21T18:25:19.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:19 smithi077 ceph-mon[27902]: pgmap v15467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:25:19.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28830.651338 secs 2024-04-21T18:25:19.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:19 smithi191 ceph-mon[31636]: pgmap v15467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:25:19.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28830.651338 secs 2024-04-21T18:25:20.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:19 smithi170 ceph-mon[31212]: pgmap v15467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:25:20.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28830.651338 secs 2024-04-21T18:25:20.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:21.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:21 smithi077 ceph-mon[27902]: pgmap v15468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:25:21.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:21 smithi191 ceph-mon[31636]: pgmap v15468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:25:22.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:21 smithi170 ceph-mon[31212]: pgmap v15468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:25:23.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28833.892618 secs 2024-04-21T18:25:23.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:23 smithi077 ceph-mon[27902]: pgmap v15469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:23.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28833.892618 secs 2024-04-21T18:25:23.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:23 smithi191 ceph-mon[31636]: pgmap v15469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:24.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28833.892618 secs 2024-04-21T18:25:24.052 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:23 smithi170 ceph-mon[31212]: pgmap v15469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:24.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28835.651450 secs 2024-04-21T18:25:24.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28835.651450 secs 2024-04-21T18:25:25.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28835.651450 secs 2024-04-21T18:25:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:25.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:25 smithi077 ceph-mon[27902]: pgmap v15470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:25.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:25 smithi191 ceph-mon[31636]: pgmap v15470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:26.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:25 smithi170 ceph-mon[31212]: pgmap v15470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:27.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:27 smithi077 ceph-mon[27902]: pgmap v15471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:27.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:27 smithi191 ceph-mon[31636]: pgmap v15471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:28.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:27 smithi170 ceph-mon[31212]: pgmap v15471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:28.864 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28838.892805 secs 2024-04-21T18:25:28.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28838.892805 secs 2024-04-21T18:25:28.953 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28838.892805 secs 2024-04-21T18:25:29.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:29 smithi077 ceph-mon[27902]: pgmap v15472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:29.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28840.651600 secs 2024-04-21T18:25:29.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:29 smithi191 ceph-mon[31636]: pgmap v15472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:29.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28840.651600 secs 2024-04-21T18:25:30.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:29 smithi170 ceph-mon[31212]: pgmap v15472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:30.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28840.651600 secs 2024-04-21T18:25:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:30.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:30 smithi077 ceph-mon[27902]: pgmap v15473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:30.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:30 smithi191 ceph-mon[31636]: pgmap v15473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:31.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:30 smithi170 ceph-mon[31212]: pgmap v15473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:33.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28843.892855 secs 2024-04-21T18:25:33.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:33 smithi077 ceph-mon[27902]: pgmap v15474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:33.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28843.892855 secs 2024-04-21T18:25:33.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:33 smithi191 ceph-mon[31636]: pgmap v15474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:34.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28843.892855 secs 2024-04-21T18:25:34.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:33 smithi170 ceph-mon[31212]: pgmap v15474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:34.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28845.651717 secs 2024-04-21T18:25:34.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28845.651717 secs 2024-04-21T18:25:35.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28845.651717 secs 2024-04-21T18:25:35.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:35.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:35 smithi077 ceph-mon[27902]: pgmap v15475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:35.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:35 smithi191 ceph-mon[31636]: pgmap v15475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:36.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:35 smithi170 ceph-mon[31212]: pgmap v15475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:37.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:37 smithi077 ceph-mon[27902]: pgmap v15476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:37.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:37 smithi191 ceph-mon[31636]: pgmap v15476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:38.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:37 smithi170 ceph-mon[31212]: pgmap v15476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:38.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28848.892957 secs 2024-04-21T18:25:38.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28848.892957 secs 2024-04-21T18:25:39.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28848.892957 secs 2024-04-21T18:25:39.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:39 smithi077 ceph-mon[27902]: pgmap v15477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:39.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28850.651838 secs 2024-04-21T18:25:39.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:39 smithi191 ceph-mon[31636]: pgmap v15477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:39.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28850.651838 secs 2024-04-21T18:25:40.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:39 smithi170 ceph-mon[31212]: pgmap v15477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:40.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28850.651838 secs 2024-04-21T18:25:40.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:41.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:41 smithi077 ceph-mon[27902]: pgmap v15478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:41.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:41 smithi191 ceph-mon[31636]: pgmap v15478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:42.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:41 smithi170 ceph-mon[31212]: pgmap v15478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:43.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28853.893081 secs 2024-04-21T18:25:43.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:43 smithi077 ceph-mon[27902]: pgmap v15479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:43.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28853.893081 secs 2024-04-21T18:25:43.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:43 smithi191 ceph-mon[31636]: pgmap v15479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:44.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28853.893081 secs 2024-04-21T18:25:44.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:43 smithi170 ceph-mon[31212]: pgmap v15479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:44.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28855.651954 secs 2024-04-21T18:25:44.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28855.651954 secs 2024-04-21T18:25:45.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28855.651954 secs 2024-04-21T18:25:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:45.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:45 smithi077 ceph-mon[27902]: pgmap v15480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:45.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:45 smithi191 ceph-mon[31636]: pgmap v15480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:46.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:45 smithi170 ceph-mon[31212]: pgmap v15480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:47.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:47 smithi077 ceph-mon[27902]: pgmap v15481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:47.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:47 smithi191 ceph-mon[31636]: pgmap v15481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:48.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:47 smithi170 ceph-mon[31212]: pgmap v15481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:48.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28858.893198 secs 2024-04-21T18:25:48.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28858.893198 secs 2024-04-21T18:25:49.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28858.893198 secs 2024-04-21T18:25:49.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:49 smithi077 ceph-mon[27902]: pgmap v15482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:49.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28860.652076 secs 2024-04-21T18:25:49.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:49 smithi191 ceph-mon[31636]: pgmap v15482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:49.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28860.652076 secs 2024-04-21T18:25:50.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:49 smithi170 ceph-mon[31212]: pgmap v15482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:50.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28860.652076 secs 2024-04-21T18:25:50.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:50.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:50 smithi077 ceph-mon[27902]: pgmap v15483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:50.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:50 smithi191 ceph-mon[31636]: pgmap v15483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:51.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:50 smithi170 ceph-mon[31212]: pgmap v15483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:53.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28863.893292 secs 2024-04-21T18:25:53.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:53 smithi077 ceph-mon[27902]: pgmap v15484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:53.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28863.893292 secs 2024-04-21T18:25:53.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:53 smithi191 ceph-mon[31636]: pgmap v15484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:54.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28863.893292 secs 2024-04-21T18:25:54.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:53 smithi170 ceph-mon[31212]: pgmap v15484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:54.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28865.652178 secs 2024-04-21T18:25:54.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:25:54.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28865.652178 secs 2024-04-21T18:25:54.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:25:55.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28865.652178 secs 2024-04-21T18:25:55.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:25:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:25:55.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:55 smithi077 ceph-mon[27902]: pgmap v15485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:55.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:25:55.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:25:55.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:25:55.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:55 smithi191 ceph-mon[31636]: pgmap v15485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:55.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:25:55.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:25:55.963 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:25:56.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:55 smithi170 ceph-mon[31212]: pgmap v15485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:56.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:25:56.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:25:56.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:25:57.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:57 smithi077 ceph-mon[27902]: pgmap v15486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:57.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:57 smithi191 ceph-mon[31636]: pgmap v15486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:58.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:57 smithi170 ceph-mon[31212]: pgmap v15486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:25:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:25:58.345+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:25:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:25:58.345+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:25:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:25:58.345+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:25:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:25:58.345+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:25:58.863 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28868.893411 secs 2024-04-21T18:25:58.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28868.893411 secs 2024-04-21T18:25:58.952 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28868.893411 secs 2024-04-21T18:25:59.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:59 smithi077 ceph-mon[27902]: pgmap v15487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:59.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28870.652292 secs 2024-04-21T18:25:59.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:59 smithi191 ceph-mon[31636]: pgmap v15487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:25:59.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28870.652292 secs 2024-04-21T18:26:00.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:59 smithi170 ceph-mon[31212]: pgmap v15487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:00.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28870.652292 secs 2024-04-21T18:26:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:01.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:01 smithi077 ceph-mon[27902]: pgmap v15488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T18:26:01.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:01 smithi191 ceph-mon[31636]: pgmap v15488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T18:26:02.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:01 smithi170 ceph-mon[31212]: pgmap v15488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T18:26:03.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28873.893532 secs 2024-04-21T18:26:03.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:03 smithi077 ceph-mon[27902]: pgmap v15489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:26:03.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28873.893532 secs 2024-04-21T18:26:03.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:03 smithi191 ceph-mon[31636]: pgmap v15489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:26:04.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28873.893532 secs 2024-04-21T18:26:04.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:03 smithi170 ceph-mon[31212]: pgmap v15489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:26:04.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28875.652408 secs 2024-04-21T18:26:04.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28875.652408 secs 2024-04-21T18:26:05.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28875.652408 secs 2024-04-21T18:26:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:05.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:05 smithi077 ceph-mon[27902]: pgmap v15490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:26:05.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:05 smithi077 ceph-mon[27902]: osdmap e1040: 12 total, 12 up, 12 in 2024-04-21T18:26:05.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:05 smithi191 ceph-mon[31636]: pgmap v15490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:26:05.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:05 smithi191 ceph-mon[31636]: osdmap e1040: 12 total, 12 up, 12 in 2024-04-21T18:26:06.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:05 smithi170 ceph-mon[31212]: pgmap v15490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T18:26:06.051 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:05 smithi170 ceph-mon[31212]: osdmap e1040: 12 total, 12 up, 12 in 2024-04-21T18:26:06.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:06 smithi077 ceph-mon[27902]: pgmap v15492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:26:06.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:06 smithi191 ceph-mon[31636]: pgmap v15492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:26:07.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:06 smithi170 ceph-mon[31212]: pgmap v15492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:26:09.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28878.893654 secs 2024-04-21T18:26:09.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:08 smithi170 ceph-mon[31212]: osdmap e1041: 12 total, 12 up, 12 in 2024-04-21T18:26:09.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:08 smithi170 ceph-mon[31212]: pgmap v15494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T18:26:09.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28878.893654 secs 2024-04-21T18:26:09.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:08 smithi077 ceph-mon[27902]: osdmap e1041: 12 total, 12 up, 12 in 2024-04-21T18:26:09.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:08 smithi077 ceph-mon[27902]: pgmap v15494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T18:26:09.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28878.893654 secs 2024-04-21T18:26:09.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:08 smithi191 ceph-mon[31636]: osdmap e1041: 12 total, 12 up, 12 in 2024-04-21T18:26:09.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:08 smithi191 ceph-mon[31636]: pgmap v15494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-04-21T18:26:10.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28880.652486 secs 2024-04-21T18:26:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:10.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28880.652486 secs 2024-04-21T18:26:10.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28880.652486 secs 2024-04-21T18:26:11.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:10 smithi170 ceph-mon[31212]: pgmap v15495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:26:11.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:10 smithi077 ceph-mon[27902]: pgmap v15495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:26:11.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:10 smithi191 ceph-mon[31636]: pgmap v15495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:26:13.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28883.893793 secs 2024-04-21T18:26:13.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:13 smithi077 ceph-mon[27902]: pgmap v15496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:26:13.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28883.893793 secs 2024-04-21T18:26:13.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:13 smithi191 ceph-mon[31636]: pgmap v15496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:26:14.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28883.893793 secs 2024-04-21T18:26:14.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:13 smithi170 ceph-mon[31212]: pgmap v15496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T18:26:14.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28885.652621 secs 2024-04-21T18:26:14.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28885.652621 secs 2024-04-21T18:26:15.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28885.652621 secs 2024-04-21T18:26:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:15.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:15 smithi077 ceph-mon[27902]: pgmap v15497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T18:26:15.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:15 smithi191 ceph-mon[31636]: pgmap v15497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T18:26:16.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:15 smithi170 ceph-mon[31212]: pgmap v15497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T18:26:17.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:17 smithi077 ceph-mon[27902]: pgmap v15498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:26:17.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:17 smithi191 ceph-mon[31636]: pgmap v15498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:26:18.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:17 smithi170 ceph-mon[31212]: pgmap v15498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:26:18.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28888.893844 secs 2024-04-21T18:26:18.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28888.893844 secs 2024-04-21T18:26:19.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28888.893844 secs 2024-04-21T18:26:19.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:19 smithi077 ceph-mon[27902]: pgmap v15499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:26:19.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28890.652736 secs 2024-04-21T18:26:19.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:19 smithi191 ceph-mon[31636]: pgmap v15499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:26:19.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28890.652736 secs 2024-04-21T18:26:20.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:19 smithi170 ceph-mon[31212]: pgmap v15499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:26:20.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28890.652736 secs 2024-04-21T18:26:20.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:21.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:21 smithi077 ceph-mon[27902]: pgmap v15500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:26:21.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:21 smithi191 ceph-mon[31636]: pgmap v15500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:26:22.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:21 smithi170 ceph-mon[31212]: pgmap v15500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:26:23.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28893.893954 secs 2024-04-21T18:26:23.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:23 smithi077 ceph-mon[27902]: pgmap v15501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:23.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28893.893954 secs 2024-04-21T18:26:23.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:23 smithi191 ceph-mon[31636]: pgmap v15501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:24.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28893.893954 secs 2024-04-21T18:26:24.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:23 smithi170 ceph-mon[31212]: pgmap v15501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:24.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28895.652844 secs 2024-04-21T18:26:24.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28895.652844 secs 2024-04-21T18:26:25.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28895.652844 secs 2024-04-21T18:26:25.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:25.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:25 smithi077 ceph-mon[27902]: pgmap v15502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:25.962 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:25 smithi191 ceph-mon[31636]: pgmap v15502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:26.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:25 smithi170 ceph-mon[31212]: pgmap v15502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:26.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:26 smithi077 ceph-mon[27902]: pgmap v15503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:26.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:26 smithi191 ceph-mon[31636]: pgmap v15503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:27.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:26 smithi170 ceph-mon[31212]: pgmap v15503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:28.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28898.894063 secs 2024-04-21T18:26:28.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28898.894063 secs 2024-04-21T18:26:28.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28898.894063 secs 2024-04-21T18:26:29.113 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:28 smithi191 ceph-mon[31636]: pgmap v15504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:29.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:28 smithi077 ceph-mon[27902]: pgmap v15504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:29.201 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:28 smithi170 ceph-mon[31212]: pgmap v15504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:30.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28900.652934 secs 2024-04-21T18:26:30.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28900.652934 secs 2024-04-21T18:26:30.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28900.652934 secs 2024-04-21T18:26:31.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:30 smithi077 ceph-mon[27902]: pgmap v15505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:31.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:30 smithi191 ceph-mon[31636]: pgmap v15505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:31.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:30 smithi170 ceph-mon[31212]: pgmap v15505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:33.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28903.894197 secs 2024-04-21T18:26:33.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:33 smithi077 ceph-mon[27902]: pgmap v15506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:33.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28903.894197 secs 2024-04-21T18:26:33.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:33 smithi191 ceph-mon[31636]: pgmap v15506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:34.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28903.894197 secs 2024-04-21T18:26:34.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:33 smithi170 ceph-mon[31212]: pgmap v15506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:34.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28905.652998 secs 2024-04-21T18:26:34.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28905.652998 secs 2024-04-21T18:26:35.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28905.652998 secs 2024-04-21T18:26:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:35.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:35 smithi077 ceph-mon[27902]: pgmap v15507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:35.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:35 smithi191 ceph-mon[31636]: pgmap v15507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:36.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:35 smithi170 ceph-mon[31212]: pgmap v15507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:37.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:37 smithi077 ceph-mon[27902]: pgmap v15508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:37.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:37 smithi191 ceph-mon[31636]: pgmap v15508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:38.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:37 smithi170 ceph-mon[31212]: pgmap v15508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:38.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28908.894294 secs 2024-04-21T18:26:38.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28908.894294 secs 2024-04-21T18:26:39.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28908.894294 secs 2024-04-21T18:26:39.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:39 smithi077 ceph-mon[27902]: pgmap v15509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:39.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28910.653121 secs 2024-04-21T18:26:39.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:39 smithi191 ceph-mon[31636]: pgmap v15509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:39.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28910.653121 secs 2024-04-21T18:26:40.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:39 smithi170 ceph-mon[31212]: pgmap v15509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:40.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28910.653121 secs 2024-04-21T18:26:40.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:41.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:41 smithi077 ceph-mon[27902]: pgmap v15510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:41.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:41 smithi191 ceph-mon[31636]: pgmap v15510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:42.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:41 smithi170 ceph-mon[31212]: pgmap v15510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:42.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:42 smithi191 ceph-mon[31636]: pgmap v15511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:43.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:42 smithi170 ceph-mon[31212]: pgmap v15511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:43.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:42 smithi077 ceph-mon[27902]: pgmap v15511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:43.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28913.894413 secs 2024-04-21T18:26:44.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28913.894413 secs 2024-04-21T18:26:44.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28913.894413 secs 2024-04-21T18:26:44.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28915.653218 secs 2024-04-21T18:26:44.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:44 smithi191 ceph-mon[31636]: pgmap v15512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:45.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28915.653218 secs 2024-04-21T18:26:45.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:44 smithi170 ceph-mon[31212]: pgmap v15512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:45.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28915.653218 secs 2024-04-21T18:26:45.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:44 smithi077 ceph-mon[27902]: pgmap v15512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:47.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:47 smithi077 ceph-mon[27902]: pgmap v15513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:47.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:47 smithi191 ceph-mon[31636]: pgmap v15513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:48.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:47 smithi170 ceph-mon[31212]: pgmap v15513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:48.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28918.894532 secs 2024-04-21T18:26:48.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28918.894532 secs 2024-04-21T18:26:49.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28918.894532 secs 2024-04-21T18:26:49.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:49 smithi077 ceph-mon[27902]: pgmap v15514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:49.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28920.653313 secs 2024-04-21T18:26:49.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:49 smithi191 ceph-mon[31636]: pgmap v15514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:49.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28920.653313 secs 2024-04-21T18:26:50.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:49 smithi170 ceph-mon[31212]: pgmap v15514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:50.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28920.653313 secs 2024-04-21T18:26:50.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:51.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:51 smithi077 ceph-mon[27902]: pgmap v15515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:51.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:51 smithi191 ceph-mon[31636]: pgmap v15515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:52.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:51 smithi170 ceph-mon[31212]: pgmap v15515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:53.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28923.894667 secs 2024-04-21T18:26:53.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:53 smithi077 ceph-mon[27902]: pgmap v15516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:53.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28923.894667 secs 2024-04-21T18:26:53.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:53 smithi191 ceph-mon[31636]: pgmap v15516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:54.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28923.894667 secs 2024-04-21T18:26:54.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:53 smithi170 ceph-mon[31212]: pgmap v15516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:54.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28925.653445 secs 2024-04-21T18:26:54.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28925.653445 secs 2024-04-21T18:26:55.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28925.653445 secs 2024-04-21T18:26:55.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:26:55.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:55 smithi077 ceph-mon[27902]: pgmap v15517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:55.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:26:55.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:55 smithi191 ceph-mon[31636]: pgmap v15517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:55.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:26:56.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:55 smithi170 ceph-mon[31212]: pgmap v15517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:56.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:26:56.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:26:56.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:26:56.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:26:56.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:56 smithi077 ceph-mon[27902]: pgmap v15518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:56.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:26:56.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:26:56.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:26:56.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:56 smithi191 ceph-mon[31636]: pgmap v15518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:57.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:26:57.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:26:57.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:26:57.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:56 smithi170 ceph-mon[31212]: pgmap v15518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:26:58.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28928.894805 secs 2024-04-21T18:26:58.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28928.894805 secs 2024-04-21T18:26:58.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28928.894805 secs 2024-04-21T18:26:59.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:58 smithi170 ceph-mon[31212]: pgmap v15519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:59.112 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:58 smithi191 ceph-mon[31636]: pgmap v15519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:26:59.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:58 smithi077 ceph-mon[27902]: pgmap v15519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:00.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28930.653508 secs 2024-04-21T18:27:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:00.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28930.653508 secs 2024-04-21T18:27:00.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28930.653508 secs 2024-04-21T18:27:01.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:00 smithi077 ceph-mon[27902]: pgmap v15520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:01.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:00 smithi191 ceph-mon[31636]: pgmap v15520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:01.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:00 smithi170 ceph-mon[31212]: pgmap v15520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:03.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28933.894915 secs 2024-04-21T18:27:03.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:03 smithi077 ceph-mon[27902]: pgmap v15521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:03.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28933.894915 secs 2024-04-21T18:27:03.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:03 smithi191 ceph-mon[31636]: pgmap v15521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:04.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28933.894915 secs 2024-04-21T18:27:04.050 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:03 smithi170 ceph-mon[31212]: pgmap v15521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:04.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28935.653625 secs 2024-04-21T18:27:04.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28935.653625 secs 2024-04-21T18:27:05.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28935.653625 secs 2024-04-21T18:27:05.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:05.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:05 smithi077 ceph-mon[27902]: pgmap v15522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:05.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:05 smithi077 ceph-mon[27902]: osdmap e1042: 12 total, 12 up, 12 in 2024-04-21T18:27:05.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:05 smithi191 ceph-mon[31636]: pgmap v15522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:05.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:05 smithi191 ceph-mon[31636]: osdmap e1042: 12 total, 12 up, 12 in 2024-04-21T18:27:06.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:05 smithi170 ceph-mon[31212]: pgmap v15522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:06.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:05 smithi170 ceph-mon[31212]: osdmap e1042: 12 total, 12 up, 12 in 2024-04-21T18:27:07.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:07 smithi077 ceph-mon[27902]: pgmap v15524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:27:07.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:07 smithi191 ceph-mon[31636]: pgmap v15524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:27:08.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:07 smithi170 ceph-mon[31212]: pgmap v15524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:27:09.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28938.895051 secs 2024-04-21T18:27:09.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:08 smithi170 ceph-mon[31212]: osdmap e1043: 12 total, 12 up, 12 in 2024-04-21T18:27:09.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:08 smithi170 ceph-mon[31212]: pgmap v15526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:27:09.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28938.895051 secs 2024-04-21T18:27:09.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:08 smithi077 ceph-mon[27902]: osdmap e1043: 12 total, 12 up, 12 in 2024-04-21T18:27:09.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:08 smithi077 ceph-mon[27902]: pgmap v15526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:27:09.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28938.895051 secs 2024-04-21T18:27:09.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:08 smithi191 ceph-mon[31636]: osdmap e1043: 12 total, 12 up, 12 in 2024-04-21T18:27:09.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:08 smithi191 ceph-mon[31636]: pgmap v15526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:27:10.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28940.653741 secs 2024-04-21T18:27:10.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:10.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28940.653741 secs 2024-04-21T18:27:10.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28940.653741 secs 2024-04-21T18:27:11.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:10 smithi170 ceph-mon[31212]: pgmap v15527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:27:11.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:10 smithi077 ceph-mon[27902]: pgmap v15527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:27:11.211 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:10 smithi191 ceph-mon[31636]: pgmap v15527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:27:13.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28943.895116 secs 2024-04-21T18:27:13.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:13 smithi077 ceph-mon[27902]: pgmap v15528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:27:13.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28943.895116 secs 2024-04-21T18:27:13.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:13 smithi191 ceph-mon[31636]: pgmap v15528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:27:14.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28943.895116 secs 2024-04-21T18:27:14.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:13 smithi170 ceph-mon[31212]: pgmap v15528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:27:14.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28945.653834 secs 2024-04-21T18:27:14.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28945.653834 secs 2024-04-21T18:27:15.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28945.653834 secs 2024-04-21T18:27:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:15.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:15 smithi077 ceph-mon[27902]: pgmap v15529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:27:15.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:15 smithi191 ceph-mon[31636]: pgmap v15529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:27:16.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:15 smithi170 ceph-mon[31212]: pgmap v15529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:27:17.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:17 smithi077 ceph-mon[27902]: pgmap v15530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:27:17.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:17 smithi191 ceph-mon[31636]: pgmap v15530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:27:18.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:17 smithi170 ceph-mon[31212]: pgmap v15530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:27:18.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28948.895249 secs 2024-04-21T18:27:18.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28948.895249 secs 2024-04-21T18:27:19.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28948.895249 secs 2024-04-21T18:27:19.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:19 smithi077 ceph-mon[27902]: pgmap v15531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:27:19.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28950.653950 secs 2024-04-21T18:27:19.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:19 smithi191 ceph-mon[31636]: pgmap v15531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:27:19.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28950.653950 secs 2024-04-21T18:27:20.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:19 smithi170 ceph-mon[31212]: pgmap v15531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:27:20.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28950.653950 secs 2024-04-21T18:27:20.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:20.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:20 smithi077 ceph-mon[27902]: pgmap v15532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:27:20.961 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:20 smithi191 ceph-mon[31636]: pgmap v15532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:27:21.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:20 smithi170 ceph-mon[31212]: pgmap v15532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:27:23.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28953.895371 secs 2024-04-21T18:27:23.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:23 smithi077 ceph-mon[27902]: pgmap v15533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:23.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28953.895371 secs 2024-04-21T18:27:23.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:23 smithi191 ceph-mon[31636]: pgmap v15533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:24.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28953.895371 secs 2024-04-21T18:27:24.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:23 smithi170 ceph-mon[31212]: pgmap v15533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:24.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28955.654073 secs 2024-04-21T18:27:24.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28955.654073 secs 2024-04-21T18:27:25.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28955.654073 secs 2024-04-21T18:27:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:25.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:25 smithi077 ceph-mon[27902]: pgmap v15534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:25.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:25 smithi191 ceph-mon[31636]: pgmap v15534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:26.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:25 smithi170 ceph-mon[31212]: pgmap v15534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:27.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:27 smithi077 ceph-mon[27902]: pgmap v15535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:27.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:27 smithi191 ceph-mon[31636]: pgmap v15535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:28.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:27 smithi170 ceph-mon[31212]: pgmap v15535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:27:28.358+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:27:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:27:28.358+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:27:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:27:28.358+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:27:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:27:28.358+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:27:28.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28958.895490 secs 2024-04-21T18:27:28.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28958.895490 secs 2024-04-21T18:27:29.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28958.895490 secs 2024-04-21T18:27:29.862 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:29 smithi191 ceph-mon[31636]: pgmap v15536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:29.862 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28960.654147 secs 2024-04-21T18:27:29.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:29 smithi077 ceph-mon[27902]: pgmap v15536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:29.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28960.654147 secs 2024-04-21T18:27:29.950 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:29 smithi170 ceph-mon[31212]: pgmap v15536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:29.950 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28960.654147 secs 2024-04-21T18:27:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:30.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:30 smithi077 ceph-mon[27902]: pgmap v15537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:30.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:30 smithi191 ceph-mon[31636]: pgmap v15537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:31.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:30 smithi170 ceph-mon[31212]: pgmap v15537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:33.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28963.895612 secs 2024-04-21T18:27:33.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:33 smithi077 ceph-mon[27902]: pgmap v15538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:33.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28963.895612 secs 2024-04-21T18:27:33.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:33 smithi191 ceph-mon[31636]: pgmap v15538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:34.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28963.895612 secs 2024-04-21T18:27:34.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:33 smithi170 ceph-mon[31212]: pgmap v15538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:34.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28965.654239 secs 2024-04-21T18:27:34.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28965.654239 secs 2024-04-21T18:27:35.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28965.654239 secs 2024-04-21T18:27:35.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:35.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:35 smithi077 ceph-mon[27902]: pgmap v15539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:35.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:35 smithi191 ceph-mon[31636]: pgmap v15539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:36.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:35 smithi170 ceph-mon[31212]: pgmap v15539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:36.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:36 smithi077 ceph-mon[27902]: pgmap v15540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:36.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:36 smithi191 ceph-mon[31636]: pgmap v15540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:37.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:36 smithi170 ceph-mon[31212]: pgmap v15540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:38.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28968.895732 secs 2024-04-21T18:27:38.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28968.895732 secs 2024-04-21T18:27:38.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28968.895732 secs 2024-04-21T18:27:39.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:38 smithi077 ceph-mon[27902]: pgmap v15541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:39.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:38 smithi191 ceph-mon[31636]: pgmap v15541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:39.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:38 smithi170 ceph-mon[31212]: pgmap v15541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:40.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:40.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28970.654361 secs 2024-04-21T18:27:40.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28970.654361 secs 2024-04-21T18:27:40.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28970.654361 secs 2024-04-21T18:27:41.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:40 smithi077 ceph-mon[27902]: pgmap v15542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:41.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:40 smithi191 ceph-mon[31636]: pgmap v15542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:41.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:40 smithi170 ceph-mon[31212]: pgmap v15542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:43.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28973.895844 secs 2024-04-21T18:27:43.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:43 smithi077 ceph-mon[27902]: pgmap v15543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:43.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28973.895844 secs 2024-04-21T18:27:43.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:43 smithi191 ceph-mon[31636]: pgmap v15543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:44.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28973.895844 secs 2024-04-21T18:27:44.049 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:43 smithi170 ceph-mon[31212]: pgmap v15543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:44.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28975.654491 secs 2024-04-21T18:27:44.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28975.654491 secs 2024-04-21T18:27:45.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28975.654491 secs 2024-04-21T18:27:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:45.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:45 smithi077 ceph-mon[27902]: pgmap v15544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:45.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:45 smithi191 ceph-mon[31636]: pgmap v15544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:46.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:45 smithi170 ceph-mon[31212]: pgmap v15544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:47.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:47 smithi077 ceph-mon[27902]: pgmap v15545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:47.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:47 smithi191 ceph-mon[31636]: pgmap v15545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:48.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:47 smithi170 ceph-mon[31212]: pgmap v15545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:48.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28978.895961 secs 2024-04-21T18:27:48.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:48 smithi077 ceph-mon[27902]: pgmap v15546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:48.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28978.895961 secs 2024-04-21T18:27:48.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:48 smithi191 ceph-mon[31636]: pgmap v15546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:49.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28978.895961 secs 2024-04-21T18:27:49.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:48 smithi170 ceph-mon[31212]: pgmap v15546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:49.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28980.654607 secs 2024-04-21T18:27:49.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28980.654607 secs 2024-04-21T18:27:50.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28980.654607 secs 2024-04-21T18:27:50.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:50.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:50 smithi077 ceph-mon[27902]: pgmap v15547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:50.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:50 smithi191 ceph-mon[31636]: pgmap v15547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:51.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:50 smithi170 ceph-mon[31212]: pgmap v15547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:53.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28983.896056 secs 2024-04-21T18:27:53.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:53 smithi077 ceph-mon[27902]: pgmap v15548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:53.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28983.896056 secs 2024-04-21T18:27:53.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:53 smithi191 ceph-mon[31636]: pgmap v15548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:54.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28983.896056 secs 2024-04-21T18:27:54.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:53 smithi170 ceph-mon[31212]: pgmap v15548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:54.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28985.654719 secs 2024-04-21T18:27:54.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28985.654719 secs 2024-04-21T18:27:55.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28985.654719 secs 2024-04-21T18:27:55.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:27:55.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:55 smithi077 ceph-mon[27902]: pgmap v15549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:55.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:55 smithi191 ceph-mon[31636]: pgmap v15549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:56.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:55 smithi170 ceph-mon[31212]: pgmap v15549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:56.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:27:56.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:27:57.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:27:57.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:57 smithi077 ceph-mon[27902]: pgmap v15550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:57.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:57 smithi191 ceph-mon[31636]: pgmap v15550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:58.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:57 smithi170 ceph-mon[31212]: pgmap v15550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:27:58.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28988.896181 secs 2024-04-21T18:27:58.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:58 smithi077 ceph-mon[27902]: pgmap v15551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:58.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28988.896181 secs 2024-04-21T18:27:59.079 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:58 smithi191 ceph-mon[31636]: pgmap v15551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:59.080 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28988.896181 secs 2024-04-21T18:27:59.080 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:58 smithi170 ceph-mon[31212]: pgmap v15551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:27:59.837 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28990.654835 secs 2024-04-21T18:27:59.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28990.654835 secs 2024-04-21T18:27:59.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28990.654835 secs 2024-04-21T18:28:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:01.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:28:01.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:28:01.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:01 smithi077 ceph-mon[27902]: pgmap v15552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:01.710 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.710 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.710 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:28:01.710 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:28:01.711 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.711 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:01 smithi191 ceph-mon[31636]: pgmap v15552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:01.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.798 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.799 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:28:01.799 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:28:01.799 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:28:01.799 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:01 smithi170 ceph-mon[31212]: pgmap v15552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:03.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28993.896330 secs 2024-04-21T18:28:03.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:03 smithi077 ceph-mon[27902]: pgmap v15553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:03.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28993.896330 secs 2024-04-21T18:28:03.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:03 smithi191 ceph-mon[31636]: pgmap v15553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:04.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28993.896330 secs 2024-04-21T18:28:04.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:03 smithi170 ceph-mon[31212]: pgmap v15553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:04.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 28995.654938 secs 2024-04-21T18:28:04.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 28995.654938 secs 2024-04-21T18:28:05.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 28995.654938 secs 2024-04-21T18:28:05.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:05.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:05 smithi077 ceph-mon[27902]: pgmap v15554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:05.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:05 smithi077 ceph-mon[27902]: osdmap e1044: 12 total, 12 up, 12 in 2024-04-21T18:28:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:05 smithi191 ceph-mon[31636]: pgmap v15554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:05.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:05 smithi191 ceph-mon[31636]: osdmap e1044: 12 total, 12 up, 12 in 2024-04-21T18:28:06.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:05 smithi170 ceph-mon[31212]: pgmap v15554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:06.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:05 smithi170 ceph-mon[31212]: osdmap e1044: 12 total, 12 up, 12 in 2024-04-21T18:28:06.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:06 smithi077 ceph-mon[27902]: pgmap v15556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:28:06.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:06 smithi191 ceph-mon[31636]: pgmap v15556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:28:07.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:06 smithi170 ceph-mon[31212]: pgmap v15556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:28:09.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 28998.896453 secs 2024-04-21T18:28:09.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:08 smithi170 ceph-mon[31212]: osdmap e1045: 12 total, 12 up, 12 in 2024-04-21T18:28:09.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:08 smithi170 ceph-mon[31212]: pgmap v15558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:28:09.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 28998.896453 secs 2024-04-21T18:28:09.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:08 smithi077 ceph-mon[27902]: osdmap e1045: 12 total, 12 up, 12 in 2024-04-21T18:28:09.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:08 smithi077 ceph-mon[27902]: pgmap v15558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:28:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 28998.896453 secs 2024-04-21T18:28:09.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:08 smithi191 ceph-mon[31636]: osdmap e1045: 12 total, 12 up, 12 in 2024-04-21T18:28:09.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:08 smithi191 ceph-mon[31636]: pgmap v15558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:28:10.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29000.655055 secs 2024-04-21T18:28:10.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:10.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29000.655055 secs 2024-04-21T18:28:10.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29000.655055 secs 2024-04-21T18:28:11.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:10 smithi170 ceph-mon[31212]: pgmap v15559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:28:11.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:10 smithi077 ceph-mon[27902]: pgmap v15559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:28:11.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:10 smithi191 ceph-mon[31636]: pgmap v15559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:28:13.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29003.896517 secs 2024-04-21T18:28:13.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:13 smithi077 ceph-mon[27902]: pgmap v15560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:28:13.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29003.896517 secs 2024-04-21T18:28:13.960 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:13 smithi191 ceph-mon[31636]: pgmap v15560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:28:14.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29003.896517 secs 2024-04-21T18:28:14.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:13 smithi170 ceph-mon[31212]: pgmap v15560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:28:14.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29005.655169 secs 2024-04-21T18:28:14.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29005.655169 secs 2024-04-21T18:28:15.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29005.655169 secs 2024-04-21T18:28:15.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:15.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:15 smithi077 ceph-mon[27902]: pgmap v15561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:28:15.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:15 smithi191 ceph-mon[31636]: pgmap v15561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:28:16.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:15 smithi170 ceph-mon[31212]: pgmap v15561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:28:16.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:16 smithi077 ceph-mon[27902]: pgmap v15562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:28:16.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:16 smithi191 ceph-mon[31636]: pgmap v15562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:28:17.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:16 smithi170 ceph-mon[31212]: pgmap v15562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:28:18.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29008.896595 secs 2024-04-21T18:28:18.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29008.896595 secs 2024-04-21T18:28:18.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29008.896595 secs 2024-04-21T18:28:19.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:18 smithi077 ceph-mon[27902]: pgmap v15563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:28:19.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:18 smithi191 ceph-mon[31636]: pgmap v15563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:28:19.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:18 smithi170 ceph-mon[31212]: pgmap v15563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:28:20.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:20.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29010.655285 secs 2024-04-21T18:28:20.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29010.655285 secs 2024-04-21T18:28:20.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29010.655285 secs 2024-04-21T18:28:21.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:20 smithi077 ceph-mon[27902]: pgmap v15564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:28:21.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:20 smithi191 ceph-mon[31636]: pgmap v15564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:28:21.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:20 smithi170 ceph-mon[31212]: pgmap v15564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:28:23.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29013.896721 secs 2024-04-21T18:28:23.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:23 smithi077 ceph-mon[27902]: pgmap v15565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:23.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29013.896721 secs 2024-04-21T18:28:23.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:23 smithi191 ceph-mon[31636]: pgmap v15565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:24.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29013.896721 secs 2024-04-21T18:28:24.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:23 smithi170 ceph-mon[31212]: pgmap v15565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:24.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29015.655356 secs 2024-04-21T18:28:24.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29015.655356 secs 2024-04-21T18:28:25.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29015.655356 secs 2024-04-21T18:28:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:25.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:25 smithi077 ceph-mon[27902]: pgmap v15566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:25.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:25 smithi191 ceph-mon[31636]: pgmap v15566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:26.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:25 smithi170 ceph-mon[31212]: pgmap v15566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:26.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:26 smithi077 ceph-mon[27902]: pgmap v15567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:26.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:26 smithi191 ceph-mon[31636]: pgmap v15567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:27.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:26 smithi170 ceph-mon[31212]: pgmap v15567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:28.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29018.896835 secs 2024-04-21T18:28:28.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29018.896835 secs 2024-04-21T18:28:28.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29018.896835 secs 2024-04-21T18:28:29.110 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:28 smithi191 ceph-mon[31636]: pgmap v15568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:29.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:28 smithi077 ceph-mon[27902]: pgmap v15568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:29.199 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:28 smithi170 ceph-mon[31212]: pgmap v15568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:30.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:30.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29020.655493 secs 2024-04-21T18:28:30.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29020.655493 secs 2024-04-21T18:28:30.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29020.655493 secs 2024-04-21T18:28:31.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:30 smithi077 ceph-mon[27902]: pgmap v15569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:31.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:30 smithi191 ceph-mon[31636]: pgmap v15569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:31.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:30 smithi170 ceph-mon[31212]: pgmap v15569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:33.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29023.896953 secs 2024-04-21T18:28:33.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:33 smithi077 ceph-mon[27902]: pgmap v15570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:33.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29023.896953 secs 2024-04-21T18:28:33.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:33 smithi191 ceph-mon[31636]: pgmap v15570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:34.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29023.896953 secs 2024-04-21T18:28:34.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:33 smithi170 ceph-mon[31212]: pgmap v15570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:34.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29025.655589 secs 2024-04-21T18:28:34.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29025.655589 secs 2024-04-21T18:28:35.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29025.655589 secs 2024-04-21T18:28:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:35.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:35 smithi077 ceph-mon[27902]: pgmap v15571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:35.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:35 smithi191 ceph-mon[31636]: pgmap v15571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:36.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:35 smithi170 ceph-mon[31212]: pgmap v15571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:36.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:36 smithi191 ceph-mon[31636]: pgmap v15572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:37.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:36 smithi170 ceph-mon[31212]: pgmap v15572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:37.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:36 smithi077 ceph-mon[27902]: pgmap v15572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:38.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29028.897116 secs 2024-04-21T18:28:38.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29028.897116 secs 2024-04-21T18:28:38.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29028.897116 secs 2024-04-21T18:28:39.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:38 smithi077 ceph-mon[27902]: pgmap v15573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:39.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:38 smithi191 ceph-mon[31636]: pgmap v15573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:39.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:38 smithi170 ceph-mon[31212]: pgmap v15573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:40.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:40.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29030.655706 secs 2024-04-21T18:28:40.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29030.655706 secs 2024-04-21T18:28:40.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29030.655706 secs 2024-04-21T18:28:41.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:40 smithi077 ceph-mon[27902]: pgmap v15574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:41.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:40 smithi191 ceph-mon[31636]: pgmap v15574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:41.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:40 smithi170 ceph-mon[31212]: pgmap v15574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:43.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29033.897184 secs 2024-04-21T18:28:43.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:43 smithi077 ceph-mon[27902]: pgmap v15575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:43.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29033.897184 secs 2024-04-21T18:28:43.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:43 smithi191 ceph-mon[31636]: pgmap v15575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:44.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29033.897184 secs 2024-04-21T18:28:44.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:43 smithi170 ceph-mon[31212]: pgmap v15575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:44.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29035.655822 secs 2024-04-21T18:28:44.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29035.655822 secs 2024-04-21T18:28:45.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29035.655822 secs 2024-04-21T18:28:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:45.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:45 smithi077 ceph-mon[27902]: pgmap v15576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:45.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:45 smithi191 ceph-mon[31636]: pgmap v15576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:46.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:45 smithi170 ceph-mon[31212]: pgmap v15576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:46.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:46 smithi077 ceph-mon[27902]: pgmap v15577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:46.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:46 smithi191 ceph-mon[31636]: pgmap v15577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:47.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:46 smithi170 ceph-mon[31212]: pgmap v15577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:49.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29038.897332 secs 2024-04-21T18:28:49.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:48 smithi170 ceph-mon[31212]: pgmap v15578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:49.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29038.897332 secs 2024-04-21T18:28:49.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:48 smithi077 ceph-mon[27902]: pgmap v15578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:49.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29038.897332 secs 2024-04-21T18:28:49.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:48 smithi191 ceph-mon[31636]: pgmap v15578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:50.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29040.655946 secs 2024-04-21T18:28:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:50.171 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29040.655946 secs 2024-04-21T18:28:50.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29040.655946 secs 2024-04-21T18:28:51.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:50 smithi170 ceph-mon[31212]: pgmap v15579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:51.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:50 smithi077 ceph-mon[27902]: pgmap v15579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:51.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:50 smithi191 ceph-mon[31636]: pgmap v15579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:53.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29043.897427 secs 2024-04-21T18:28:53.879 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:53 smithi077 ceph-mon[27902]: pgmap v15580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:53.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29043.897427 secs 2024-04-21T18:28:53.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:53 smithi191 ceph-mon[31636]: pgmap v15580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:54.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29043.897427 secs 2024-04-21T18:28:54.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:53 smithi170 ceph-mon[31212]: pgmap v15580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.450+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T18:28:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.450+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T18:28:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:28:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T18:28:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.450+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:28:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.451+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T18:28:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.451+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T18:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T18:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T18:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efd70020640 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efd70020640 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T18:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T18:28:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T18:28:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T18:28:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T18:28:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.503+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:28:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:54.504+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7005b000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T18:28:54.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29045.656086 secs 2024-04-21T18:28:54.876 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:54 smithi077 ceph-mon[27902]: pgmap v15581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:54.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29045.656086 secs 2024-04-21T18:28:54.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:54 smithi191 ceph-mon[31636]: pgmap v15581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:55.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29045.656086 secs 2024-04-21T18:28:55.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:54 smithi170 ceph-mon[31212]: pgmap v15581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:55.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:28:56.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:56 smithi191 ceph-mon[31636]: pgmap v15582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:57.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:56 smithi170 ceph-mon[31212]: pgmap v15582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:57.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:56 smithi077 ceph-mon[27902]: pgmap v15582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:28:58.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29048.897553 secs 2024-04-21T18:28:58.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29048.897553 secs 2024-04-21T18:28:58.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29048.897553 secs 2024-04-21T18:28:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:58.371+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:28:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:58.371+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:28:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:58.371+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:28:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:28:58.371+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:28:59.110 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:58 smithi191 ceph-mon[31636]: pgmap v15583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:59.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:58 smithi077 ceph-mon[27902]: pgmap v15583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:28:59.198 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:58 smithi170 ceph-mon[31212]: pgmap v15583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:00.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:00.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29050.656208 secs 2024-04-21T18:29:00.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29050.656208 secs 2024-04-21T18:29:00.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29050.656208 secs 2024-04-21T18:29:01.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:29:01.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:00 smithi077 ceph-mon[27902]: pgmap v15584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:01.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:29:01.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:00 smithi191 ceph-mon[31636]: pgmap v15584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:01.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:29:01.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:00 smithi170 ceph-mon[31212]: pgmap v15584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:02.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:02 smithi170 ceph-mon[31212]: pgmap v15585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:02.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:02 smithi191 ceph-mon[31636]: pgmap v15585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:03.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:02 smithi077 ceph-mon[27902]: pgmap v15585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:03.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29053.897677 secs 2024-04-21T18:29:03.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29053.897677 secs 2024-04-21T18:29:04.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29053.897677 secs 2024-04-21T18:29:04.708 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29055.656291 secs 2024-04-21T18:29:04.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:04 smithi191 ceph-mon[31636]: pgmap v15586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:04.910 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29055.656291 secs 2024-04-21T18:29:04.910 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:04 smithi170 ceph-mon[31212]: pgmap v15586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:05.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:05.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29055.656291 secs 2024-04-21T18:29:05.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:04 smithi077 ceph-mon[27902]: pgmap v15586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: osdmap e1046: 12 total, 12 up, 12 in 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:29:05.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: osdmap e1046: 12 total, 12 up, 12 in 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:29:05.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: osdmap e1046: 12 total, 12 up, 12 in 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:29:06.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:29:06.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:06 smithi191 ceph-mon[31636]: pgmap v15588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:29:07.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:06 smithi170 ceph-mon[31212]: pgmap v15588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:29:07.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:06 smithi077 ceph-mon[27902]: pgmap v15588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:29:09.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29058.897800 secs 2024-04-21T18:29:09.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:08 smithi170 ceph-mon[31212]: osdmap e1047: 12 total, 12 up, 12 in 2024-04-21T18:29:09.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:08 smithi170 ceph-mon[31212]: pgmap v15590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:29:09.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29058.897800 secs 2024-04-21T18:29:09.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:08 smithi077 ceph-mon[27902]: osdmap e1047: 12 total, 12 up, 12 in 2024-04-21T18:29:09.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:08 smithi077 ceph-mon[27902]: pgmap v15590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:29:09.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29058.897800 secs 2024-04-21T18:29:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:08 smithi191 ceph-mon[31636]: osdmap e1047: 12 total, 12 up, 12 in 2024-04-21T18:29:09.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:08 smithi191 ceph-mon[31636]: pgmap v15590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:29:10.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29060.656361 secs 2024-04-21T18:29:10.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:10.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29060.656361 secs 2024-04-21T18:29:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29060.656361 secs 2024-04-21T18:29:11.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:10 smithi170 ceph-mon[31212]: pgmap v15591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:29:11.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:10 smithi077 ceph-mon[27902]: pgmap v15591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:29:11.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:10 smithi191 ceph-mon[31636]: pgmap v15591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:29:12.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:12 smithi191 ceph-mon[31636]: pgmap v15592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:29:13.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:12 smithi170 ceph-mon[31212]: pgmap v15592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:29:13.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:12 smithi077 ceph-mon[27902]: pgmap v15592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:29:13.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29063.897877 secs 2024-04-21T18:29:14.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29063.897877 secs 2024-04-21T18:29:14.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29063.897877 secs 2024-04-21T18:29:14.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29065.656437 secs 2024-04-21T18:29:14.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:14 smithi191 ceph-mon[31636]: pgmap v15593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:29:15.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29065.656437 secs 2024-04-21T18:29:15.027 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:14 smithi170 ceph-mon[31212]: pgmap v15593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:29:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:15.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29065.656437 secs 2024-04-21T18:29:15.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:14 smithi077 ceph-mon[27902]: pgmap v15593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:29:16.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:16 smithi191 ceph-mon[31636]: pgmap v15594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:29:17.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:16 smithi170 ceph-mon[31212]: pgmap v15594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:29:17.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:16 smithi077 ceph-mon[27902]: pgmap v15594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:29:18.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29068.897961 secs 2024-04-21T18:29:18.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29068.897961 secs 2024-04-21T18:29:18.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29068.897961 secs 2024-04-21T18:29:19.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:18 smithi077 ceph-mon[27902]: pgmap v15595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:29:19.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:18 smithi191 ceph-mon[31636]: pgmap v15595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:29:19.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:18 smithi170 ceph-mon[31212]: pgmap v15595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:29:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:20.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29070.656587 secs 2024-04-21T18:29:20.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29070.656587 secs 2024-04-21T18:29:20.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29070.656587 secs 2024-04-21T18:29:21.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:20 smithi077 ceph-mon[27902]: pgmap v15596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:29:21.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:20 smithi191 ceph-mon[31636]: pgmap v15596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:29:21.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:20 smithi170 ceph-mon[31212]: pgmap v15596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:29:22.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:22 smithi191 ceph-mon[31636]: pgmap v15597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:23.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:22 smithi170 ceph-mon[31212]: pgmap v15597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:23.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:22 smithi077 ceph-mon[27902]: pgmap v15597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:23.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29073.898022 secs 2024-04-21T18:29:24.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29073.898022 secs 2024-04-21T18:29:24.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29073.898022 secs 2024-04-21T18:29:24.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29075.656651 secs 2024-04-21T18:29:24.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:24 smithi191 ceph-mon[31636]: pgmap v15598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:25.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29075.656651 secs 2024-04-21T18:29:25.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:24 smithi170 ceph-mon[31212]: pgmap v15598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:25.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29075.656651 secs 2024-04-21T18:29:25.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:24 smithi077 ceph-mon[27902]: pgmap v15598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:26.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:26 smithi191 ceph-mon[31636]: pgmap v15599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:27.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:26 smithi170 ceph-mon[31212]: pgmap v15599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:27.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:26 smithi077 ceph-mon[27902]: pgmap v15599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:28.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29078.898139 secs 2024-04-21T18:29:28.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29078.898139 secs 2024-04-21T18:29:28.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29078.898139 secs 2024-04-21T18:29:29.109 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:28 smithi191 ceph-mon[31636]: pgmap v15600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:29.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:28 smithi077 ceph-mon[27902]: pgmap v15600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:29.198 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:28 smithi170 ceph-mon[31212]: pgmap v15600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:30.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:30.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29080.656774 secs 2024-04-21T18:29:30.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29080.656774 secs 2024-04-21T18:29:30.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29080.656774 secs 2024-04-21T18:29:31.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:30 smithi077 ceph-mon[27902]: pgmap v15601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:31.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:30 smithi191 ceph-mon[31636]: pgmap v15601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:31.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:30 smithi170 ceph-mon[31212]: pgmap v15601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:32.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:32 smithi191 ceph-mon[31636]: pgmap v15602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:33.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:32 smithi170 ceph-mon[31212]: pgmap v15602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:33.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:32 smithi077 ceph-mon[27902]: pgmap v15602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:33.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29083.898264 secs 2024-04-21T18:29:34.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29083.898264 secs 2024-04-21T18:29:34.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29083.898264 secs 2024-04-21T18:29:34.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29085.656920 secs 2024-04-21T18:29:34.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:34 smithi191 ceph-mon[31636]: pgmap v15603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:35.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29085.656920 secs 2024-04-21T18:29:35.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:34 smithi170 ceph-mon[31212]: pgmap v15603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:35.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:35.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29085.656920 secs 2024-04-21T18:29:35.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:34 smithi077 ceph-mon[27902]: pgmap v15603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:36.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:36 smithi191 ceph-mon[31636]: pgmap v15604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:37.047 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:36 smithi170 ceph-mon[31212]: pgmap v15604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:37.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:36 smithi077 ceph-mon[27902]: pgmap v15604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:38.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29088.898332 secs 2024-04-21T18:29:38.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29088.898332 secs 2024-04-21T18:29:38.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29088.898332 secs 2024-04-21T18:29:39.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:38 smithi077 ceph-mon[27902]: pgmap v15605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:39.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:38 smithi191 ceph-mon[31636]: pgmap v15605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:39.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:38 smithi170 ceph-mon[31212]: pgmap v15605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:40.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:40.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29090.657032 secs 2024-04-21T18:29:40.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29090.657032 secs 2024-04-21T18:29:40.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29090.657032 secs 2024-04-21T18:29:41.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:40 smithi077 ceph-mon[27902]: pgmap v15606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:41.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:40 smithi191 ceph-mon[31636]: pgmap v15606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:41.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:40 smithi170 ceph-mon[31212]: pgmap v15606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:42.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:42 smithi191 ceph-mon[31636]: pgmap v15607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:43.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:42 smithi170 ceph-mon[31212]: pgmap v15607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:43.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:42 smithi077 ceph-mon[27902]: pgmap v15607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:43.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29093.898473 secs 2024-04-21T18:29:44.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29093.898473 secs 2024-04-21T18:29:44.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29093.898473 secs 2024-04-21T18:29:44.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29095.657129 secs 2024-04-21T18:29:44.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:44 smithi191 ceph-mon[31636]: pgmap v15608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:45.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29095.657129 secs 2024-04-21T18:29:45.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:44 smithi170 ceph-mon[31212]: pgmap v15608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:45.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29095.657129 secs 2024-04-21T18:29:45.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:44 smithi077 ceph-mon[27902]: pgmap v15608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:46.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:46 smithi191 ceph-mon[31636]: pgmap v15609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:47.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:46 smithi170 ceph-mon[31212]: pgmap v15609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:47.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:46 smithi077 ceph-mon[27902]: pgmap v15609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:48.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29098.898567 secs 2024-04-21T18:29:48.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29098.898567 secs 2024-04-21T18:29:48.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29098.898567 secs 2024-04-21T18:29:49.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:48 smithi077 ceph-mon[27902]: pgmap v15610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:49.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:48 smithi191 ceph-mon[31636]: pgmap v15610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:49.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:48 smithi170 ceph-mon[31212]: pgmap v15610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:50.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:50.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29100.657251 secs 2024-04-21T18:29:50.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29100.657251 secs 2024-04-21T18:29:50.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29100.657251 secs 2024-04-21T18:29:51.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:50 smithi077 ceph-mon[27902]: pgmap v15611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:51.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:50 smithi191 ceph-mon[31636]: pgmap v15611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:51.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:50 smithi170 ceph-mon[31212]: pgmap v15611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:52.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:52 smithi191 ceph-mon[31636]: pgmap v15612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:53.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:52 smithi170 ceph-mon[31212]: pgmap v15612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:53.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:52 smithi077 ceph-mon[27902]: pgmap v15612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:53.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29103.898668 secs 2024-04-21T18:29:54.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29103.898668 secs 2024-04-21T18:29:54.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29103.898668 secs 2024-04-21T18:29:54.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29105.657367 secs 2024-04-21T18:29:54.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:54 smithi191 ceph-mon[31636]: pgmap v15613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:55.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29105.657367 secs 2024-04-21T18:29:55.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:54 smithi170 ceph-mon[31212]: pgmap v15613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:55.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:29:55.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29105.657367 secs 2024-04-21T18:29:55.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:54 smithi077 ceph-mon[27902]: pgmap v15613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:56.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:56 smithi191 ceph-mon[31636]: pgmap v15614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:57.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:56 smithi170 ceph-mon[31212]: pgmap v15614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:57.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:56 smithi077 ceph-mon[27902]: pgmap v15614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:29:58.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29108.898812 secs 2024-04-21T18:29:58.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29108.898812 secs 2024-04-21T18:29:58.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29108.898812 secs 2024-04-21T18:29:59.109 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:58 smithi191 ceph-mon[31636]: pgmap v15615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:59.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:58 smithi077 ceph-mon[27902]: pgmap v15615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:29:59.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:58 smithi170 ceph-mon[31212]: pgmap v15615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:00.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:00.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29110.657490 secs 2024-04-21T18:30:00.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29110.657490 secs 2024-04-21T18:30:00.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29110.657490 secs 2024-04-21T18:30:01.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:30:01.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:00 smithi077 ceph-mon[27902]: pgmap v15616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:01.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:30:01.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:00 smithi191 ceph-mon[31636]: pgmap v15616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:01.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:30:01.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:00 smithi170 ceph-mon[31212]: pgmap v15616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:02.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:02 smithi191 ceph-mon[31636]: pgmap v15617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:03.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:02 smithi170 ceph-mon[31212]: pgmap v15617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:03.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:02 smithi077 ceph-mon[27902]: pgmap v15617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:03.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29113.898928 secs 2024-04-21T18:30:04.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29113.898928 secs 2024-04-21T18:30:04.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29113.898928 secs 2024-04-21T18:30:04.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29115.657608 secs 2024-04-21T18:30:04.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:04 smithi191 ceph-mon[31636]: pgmap v15618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:05.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29115.657608 secs 2024-04-21T18:30:05.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:04 smithi170 ceph-mon[31212]: pgmap v15618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:05.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:05.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29115.657608 secs 2024-04-21T18:30:05.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:04 smithi077 ceph-mon[27902]: pgmap v15618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:05.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:05 smithi191 ceph-mon[31636]: osdmap e1048: 12 total, 12 up, 12 in 2024-04-21T18:30:05.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:30:06.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:05 smithi170 ceph-mon[31212]: osdmap e1048: 12 total, 12 up, 12 in 2024-04-21T18:30:06.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:30:06.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:05 smithi077 ceph-mon[27902]: osdmap e1048: 12 total, 12 up, 12 in 2024-04-21T18:30:06.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:30:06.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:30:06.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:30:06.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:30:06.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:06 smithi191 ceph-mon[31636]: pgmap v15620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:30:07.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:30:07.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:30:07.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:30:07.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:06 smithi170 ceph-mon[31212]: pgmap v15620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:30:07.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:30:07.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:30:07.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:30:07.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:06 smithi077 ceph-mon[27902]: pgmap v15620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:30:08.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29118.899027 secs 2024-04-21T18:30:08.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29118.899027 secs 2024-04-21T18:30:08.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29118.899027 secs 2024-04-21T18:30:09.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:08 smithi077 ceph-mon[27902]: pgmap v15621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:30:09.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:08 smithi191 ceph-mon[31636]: pgmap v15621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:30:09.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:08 smithi170 ceph-mon[31212]: pgmap v15621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:30:10.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29120.657727 secs 2024-04-21T18:30:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29120.657727 secs 2024-04-21T18:30:10.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29120.657727 secs 2024-04-21T18:30:11.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:10 smithi077 ceph-mon[27902]: pgmap v15622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:30:11.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:10 smithi191 ceph-mon[31636]: pgmap v15622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:30:11.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:10 smithi170 ceph-mon[31212]: pgmap v15622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:30:12.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:12 smithi191 ceph-mon[31636]: pgmap v15623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:30:13.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:12 smithi170 ceph-mon[31212]: pgmap v15623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:30:13.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:12 smithi077 ceph-mon[27902]: pgmap v15623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:30:14.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29123.899137 secs 2024-04-21T18:30:14.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:13 smithi170 ceph-mon[31212]: osdmap e1049: 12 total, 12 up, 12 in 2024-04-21T18:30:14.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29123.899137 secs 2024-04-21T18:30:14.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:13 smithi077 ceph-mon[27902]: osdmap e1049: 12 total, 12 up, 12 in 2024-04-21T18:30:14.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29123.899137 secs 2024-04-21T18:30:14.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:13 smithi191 ceph-mon[31636]: osdmap e1049: 12 total, 12 up, 12 in 2024-04-21T18:30:15.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29125.657869 secs 2024-04-21T18:30:15.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:14 smithi170 ceph-mon[31212]: pgmap v15625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:30:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:15.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29125.657869 secs 2024-04-21T18:30:15.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:14 smithi077 ceph-mon[27902]: pgmap v15625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:30:15.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29125.657869 secs 2024-04-21T18:30:15.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:14 smithi191 ceph-mon[31636]: pgmap v15625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:30:16.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:16 smithi191 ceph-mon[31636]: pgmap v15626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:30:17.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:16 smithi170 ceph-mon[31212]: pgmap v15626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:30:17.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:16 smithi077 ceph-mon[27902]: pgmap v15626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:30:18.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29128.899253 secs 2024-04-21T18:30:18.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29128.899253 secs 2024-04-21T18:30:18.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29128.899253 secs 2024-04-21T18:30:19.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:18 smithi077 ceph-mon[27902]: pgmap v15627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:30:19.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:18 smithi191 ceph-mon[31636]: pgmap v15627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:30:19.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:18 smithi170 ceph-mon[31212]: pgmap v15627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:30:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:20.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29130.657996 secs 2024-04-21T18:30:20.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29130.657996 secs 2024-04-21T18:30:20.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29130.657996 secs 2024-04-21T18:30:21.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:20 smithi077 ceph-mon[27902]: pgmap v15628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:30:21.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:20 smithi191 ceph-mon[31636]: pgmap v15628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:30:21.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:20 smithi170 ceph-mon[31212]: pgmap v15628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:30:22.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:22 smithi191 ceph-mon[31636]: pgmap v15629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:30:23.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:22 smithi170 ceph-mon[31212]: pgmap v15629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:30:23.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:22 smithi077 ceph-mon[27902]: pgmap v15629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:30:23.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29133.899369 secs 2024-04-21T18:30:24.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29133.899369 secs 2024-04-21T18:30:24.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29133.899369 secs 2024-04-21T18:30:24.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29135.658127 secs 2024-04-21T18:30:24.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:24 smithi191 ceph-mon[31636]: pgmap v15630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:30:25.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29135.658127 secs 2024-04-21T18:30:25.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:24 smithi170 ceph-mon[31212]: pgmap v15630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:30:25.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:25.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29135.658127 secs 2024-04-21T18:30:25.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:24 smithi077 ceph-mon[27902]: pgmap v15630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:30:26.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:26 smithi191 ceph-mon[31636]: pgmap v15631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:27.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:26 smithi170 ceph-mon[31212]: pgmap v15631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:27.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:26 smithi077 ceph-mon[27902]: pgmap v15631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:28.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29138.899488 secs 2024-04-21T18:30:28.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29138.899488 secs 2024-04-21T18:30:28.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29138.899488 secs 2024-04-21T18:30:29.109 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:28 smithi191 ceph-mon[31636]: pgmap v15632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:29.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:28 smithi077 ceph-mon[27902]: pgmap v15632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:29.197 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:28 smithi170 ceph-mon[31212]: pgmap v15632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:30.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:30.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29140.658174 secs 2024-04-21T18:30:30.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29140.658174 secs 2024-04-21T18:30:30.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29140.658174 secs 2024-04-21T18:30:31.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:30 smithi077 ceph-mon[27902]: pgmap v15633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:31.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:30 smithi191 ceph-mon[31636]: pgmap v15633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:31.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:30 smithi170 ceph-mon[31212]: pgmap v15633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:32.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:32 smithi191 ceph-mon[31636]: pgmap v15634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:33.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:32 smithi170 ceph-mon[31212]: pgmap v15634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:33.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:32 smithi077 ceph-mon[27902]: pgmap v15634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:33.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29143.899597 secs 2024-04-21T18:30:34.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29143.899597 secs 2024-04-21T18:30:34.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29143.899597 secs 2024-04-21T18:30:34.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29145.658307 secs 2024-04-21T18:30:34.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:34 smithi191 ceph-mon[31636]: pgmap v15635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:35.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29145.658307 secs 2024-04-21T18:30:35.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:34 smithi170 ceph-mon[31212]: pgmap v15635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:35.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29145.658307 secs 2024-04-21T18:30:35.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:34 smithi077 ceph-mon[27902]: pgmap v15635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:36.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:36 smithi191 ceph-mon[31636]: pgmap v15636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:37.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:36 smithi170 ceph-mon[31212]: pgmap v15636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:37.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:36 smithi077 ceph-mon[27902]: pgmap v15636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:38.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29148.899718 secs 2024-04-21T18:30:38.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29148.899718 secs 2024-04-21T18:30:38.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29148.899718 secs 2024-04-21T18:30:39.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:38 smithi077 ceph-mon[27902]: pgmap v15637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:39.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:38 smithi191 ceph-mon[31636]: pgmap v15637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:39.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:38 smithi170 ceph-mon[31212]: pgmap v15637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:40.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:40.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29150.658400 secs 2024-04-21T18:30:40.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29150.658400 secs 2024-04-21T18:30:40.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29150.658400 secs 2024-04-21T18:30:41.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:40 smithi077 ceph-mon[27902]: pgmap v15638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:41.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:40 smithi191 ceph-mon[31636]: pgmap v15638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:41.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:40 smithi170 ceph-mon[31212]: pgmap v15638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:42.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:42 smithi191 ceph-mon[31636]: pgmap v15639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:43.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:42 smithi170 ceph-mon[31212]: pgmap v15639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:43.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:42 smithi077 ceph-mon[27902]: pgmap v15639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:43.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29153.899849 secs 2024-04-21T18:30:44.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29153.899849 secs 2024-04-21T18:30:44.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29153.899849 secs 2024-04-21T18:30:44.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29155.658543 secs 2024-04-21T18:30:44.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:44 smithi191 ceph-mon[31636]: pgmap v15640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:45.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29155.658543 secs 2024-04-21T18:30:45.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:44 smithi170 ceph-mon[31212]: pgmap v15640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:45.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29155.658543 secs 2024-04-21T18:30:45.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:44 smithi077 ceph-mon[27902]: pgmap v15640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:46.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:46 smithi191 ceph-mon[31636]: pgmap v15641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:47.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:46 smithi170 ceph-mon[31212]: pgmap v15641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:47.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:46 smithi077 ceph-mon[27902]: pgmap v15641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:48.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29158.899959 secs 2024-04-21T18:30:48.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29158.899959 secs 2024-04-21T18:30:48.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29158.899959 secs 2024-04-21T18:30:49.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:48 smithi077 ceph-mon[27902]: pgmap v15642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:49.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:48 smithi191 ceph-mon[31636]: pgmap v15642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:49.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:48 smithi170 ceph-mon[31212]: pgmap v15642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:50.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29160.658665 secs 2024-04-21T18:30:50.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29160.658665 secs 2024-04-21T18:30:50.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29160.658665 secs 2024-04-21T18:30:51.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:50 smithi077 ceph-mon[27902]: pgmap v15643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:51.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:50 smithi191 ceph-mon[31636]: pgmap v15643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:51.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:50 smithi170 ceph-mon[31212]: pgmap v15643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:52.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:52 smithi191 ceph-mon[31636]: pgmap v15644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:53.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:52 smithi170 ceph-mon[31212]: pgmap v15644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:53.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:52 smithi077 ceph-mon[27902]: pgmap v15644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:53.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29163.900105 secs 2024-04-21T18:30:54.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29163.900105 secs 2024-04-21T18:30:54.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29163.900105 secs 2024-04-21T18:30:54.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29165.658781 secs 2024-04-21T18:30:54.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:54 smithi191 ceph-mon[31636]: pgmap v15645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:55.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29165.658781 secs 2024-04-21T18:30:55.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:54 smithi170 ceph-mon[31212]: pgmap v15645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:55.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:30:55.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29165.658781 secs 2024-04-21T18:30:55.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:54 smithi077 ceph-mon[27902]: pgmap v15645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:30:56.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:56 smithi191 ceph-mon[31636]: pgmap v15646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:57.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:56 smithi170 ceph-mon[31212]: pgmap v15646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:57.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:56 smithi077 ceph-mon[27902]: pgmap v15646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:30:58.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29168.900221 secs 2024-04-21T18:30:58.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29168.900221 secs 2024-04-21T18:30:58.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29168.900221 secs 2024-04-21T18:30:59.108 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:58 smithi191 ceph-mon[31636]: pgmap v15647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:59.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:58 smithi077 ceph-mon[27902]: pgmap v15647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:30:59.196 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:58 smithi170 ceph-mon[31212]: pgmap v15647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:00.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29170.658874 secs 2024-04-21T18:31:00.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29170.658874 secs 2024-04-21T18:31:00.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29170.658874 secs 2024-04-21T18:31:01.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:00 smithi077 ceph-mon[27902]: pgmap v15648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:01.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:00 smithi191 ceph-mon[31636]: pgmap v15648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:01.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:00 smithi170 ceph-mon[31212]: pgmap v15648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:02.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:02 smithi191 ceph-mon[31636]: pgmap v15649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:03.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:02 smithi170 ceph-mon[31212]: pgmap v15649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:03.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:02 smithi077 ceph-mon[27902]: pgmap v15649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:03.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29173.900330 secs 2024-04-21T18:31:04.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29173.900330 secs 2024-04-21T18:31:04.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29173.900330 secs 2024-04-21T18:31:04.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29175.658933 secs 2024-04-21T18:31:04.959 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:04 smithi191 ceph-mon[31636]: pgmap v15650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:05.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29175.658933 secs 2024-04-21T18:31:05.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:04 smithi170 ceph-mon[31212]: pgmap v15650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:05.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:05.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29175.658933 secs 2024-04-21T18:31:05.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:04 smithi077 ceph-mon[27902]: pgmap v15650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:05.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:05 smithi191 ceph-mon[31636]: osdmap e1050: 12 total, 12 up, 12 in 2024-04-21T18:31:06.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:05 smithi170 ceph-mon[31212]: osdmap e1050: 12 total, 12 up, 12 in 2024-04-21T18:31:06.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:05 smithi077 ceph-mon[27902]: osdmap e1050: 12 total, 12 up, 12 in 2024-04-21T18:31:06.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:31:06.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:06 smithi191 ceph-mon[31636]: pgmap v15652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:06.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:31:06.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:31:06.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:31:07.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:31:07.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:06 smithi170 ceph-mon[31212]: pgmap v15652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:07.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:31:07.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:31:07.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:31:07.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:31:07.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:06 smithi077 ceph-mon[27902]: pgmap v15652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:07.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:31:07.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:31:07.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:31:08.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29178.900440 secs 2024-04-21T18:31:08.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29178.900440 secs 2024-04-21T18:31:08.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29178.900440 secs 2024-04-21T18:31:09.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:08 smithi077 ceph-mon[27902]: pgmap v15653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:09.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:08 smithi191 ceph-mon[31636]: pgmap v15653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:09.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:08 smithi170 ceph-mon[31212]: pgmap v15653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:10.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29180.659055 secs 2024-04-21T18:31:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29180.659055 secs 2024-04-21T18:31:10.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29180.659055 secs 2024-04-21T18:31:11.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:10 smithi077 ceph-mon[27902]: pgmap v15654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:11.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:10 smithi191 ceph-mon[31636]: pgmap v15654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:11.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:10 smithi170 ceph-mon[31212]: pgmap v15654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:12.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:12 smithi191 ceph-mon[31636]: pgmap v15655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:13.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:12 smithi170 ceph-mon[31212]: pgmap v15655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:13.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:12 smithi077 ceph-mon[27902]: pgmap v15655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:31:14.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29183.900580 secs 2024-04-21T18:31:14.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:13 smithi170 ceph-mon[31212]: osdmap e1051: 12 total, 12 up, 12 in 2024-04-21T18:31:14.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29183.900580 secs 2024-04-21T18:31:14.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:13 smithi077 ceph-mon[27902]: osdmap e1051: 12 total, 12 up, 12 in 2024-04-21T18:31:14.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29183.900580 secs 2024-04-21T18:31:14.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:13 smithi191 ceph-mon[31636]: osdmap e1051: 12 total, 12 up, 12 in 2024-04-21T18:31:15.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29185.659164 secs 2024-04-21T18:31:15.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:14 smithi170 ceph-mon[31212]: pgmap v15657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:31:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:15.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29185.659164 secs 2024-04-21T18:31:15.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:14 smithi077 ceph-mon[27902]: pgmap v15657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:31:15.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29185.659164 secs 2024-04-21T18:31:15.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:14 smithi191 ceph-mon[31636]: pgmap v15657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:31:16.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:16 smithi191 ceph-mon[31636]: pgmap v15658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:31:17.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:16 smithi170 ceph-mon[31212]: pgmap v15658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:31:17.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:16 smithi077 ceph-mon[27902]: pgmap v15658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:31:18.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29188.900721 secs 2024-04-21T18:31:18.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29188.900721 secs 2024-04-21T18:31:18.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29188.900721 secs 2024-04-21T18:31:19.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:18 smithi077 ceph-mon[27902]: pgmap v15659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:31:19.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:18 smithi191 ceph-mon[31636]: pgmap v15659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:31:19.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:18 smithi170 ceph-mon[31212]: pgmap v15659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:31:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:20.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29190.659302 secs 2024-04-21T18:31:20.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29190.659302 secs 2024-04-21T18:31:20.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29190.659302 secs 2024-04-21T18:31:21.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:20 smithi077 ceph-mon[27902]: pgmap v15660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:31:21.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:20 smithi191 ceph-mon[31636]: pgmap v15660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:31:21.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:20 smithi170 ceph-mon[31212]: pgmap v15660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:31:22.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:22 smithi191 ceph-mon[31636]: pgmap v15661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:31:23.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:22 smithi170 ceph-mon[31212]: pgmap v15661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:31:23.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:22 smithi077 ceph-mon[27902]: pgmap v15661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T18:31:24.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29193.900840 secs 2024-04-21T18:31:24.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29193.900840 secs 2024-04-21T18:31:24.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29193.900840 secs 2024-04-21T18:31:25.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29195.659441 secs 2024-04-21T18:31:25.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:24 smithi170 ceph-mon[31212]: pgmap v15662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:25.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29195.659441 secs 2024-04-21T18:31:25.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:24 smithi077 ceph-mon[27902]: pgmap v15662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:25.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29195.659441 secs 2024-04-21T18:31:25.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:24 smithi191 ceph-mon[31636]: pgmap v15662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:26.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:26 smithi191 ceph-mon[31636]: pgmap v15663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:27.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:26 smithi170 ceph-mon[31212]: pgmap v15663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:27.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:26 smithi077 ceph-mon[27902]: pgmap v15663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:28.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29198.900966 secs 2024-04-21T18:31:28.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29198.900966 secs 2024-04-21T18:31:28.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29198.900966 secs 2024-04-21T18:31:29.108 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:28 smithi191 ceph-mon[31636]: pgmap v15664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:29.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:28 smithi077 ceph-mon[27902]: pgmap v15664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:29.196 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:28 smithi170 ceph-mon[31212]: pgmap v15664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:30.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29200.659578 secs 2024-04-21T18:31:30.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29200.659578 secs 2024-04-21T18:31:30.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29200.659578 secs 2024-04-21T18:31:31.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:30 smithi077 ceph-mon[27902]: pgmap v15665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:31.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:30 smithi191 ceph-mon[31636]: pgmap v15665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:31.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:30 smithi170 ceph-mon[31212]: pgmap v15665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:32.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:32 smithi191 ceph-mon[31636]: pgmap v15666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:33.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:32 smithi170 ceph-mon[31212]: pgmap v15666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:33.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:32 smithi077 ceph-mon[27902]: pgmap v15666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:33.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29203.901052 secs 2024-04-21T18:31:34.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29203.901052 secs 2024-04-21T18:31:34.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29203.901052 secs 2024-04-21T18:31:34.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29205.659676 secs 2024-04-21T18:31:34.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:34 smithi191 ceph-mon[31636]: pgmap v15667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:35.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29205.659676 secs 2024-04-21T18:31:35.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:34 smithi170 ceph-mon[31212]: pgmap v15667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:35.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29205.659676 secs 2024-04-21T18:31:35.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:34 smithi077 ceph-mon[27902]: pgmap v15667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:36.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:36 smithi191 ceph-mon[31636]: pgmap v15668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:37.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:36 smithi170 ceph-mon[31212]: pgmap v15668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:37.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:36 smithi077 ceph-mon[27902]: pgmap v15668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:38.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29208.901170 secs 2024-04-21T18:31:38.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29208.901170 secs 2024-04-21T18:31:38.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29208.901170 secs 2024-04-21T18:31:39.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:38 smithi077 ceph-mon[27902]: pgmap v15669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:39.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:38 smithi191 ceph-mon[31636]: pgmap v15669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:39.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:38 smithi170 ceph-mon[31212]: pgmap v15669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:40.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:40.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29210.659789 secs 2024-04-21T18:31:40.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29210.659789 secs 2024-04-21T18:31:40.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29210.659789 secs 2024-04-21T18:31:41.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:40 smithi077 ceph-mon[27902]: pgmap v15670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:41.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:40 smithi191 ceph-mon[31636]: pgmap v15670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:41.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:40 smithi170 ceph-mon[31212]: pgmap v15670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:42.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:42 smithi191 ceph-mon[31636]: pgmap v15671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:43.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:42 smithi170 ceph-mon[31212]: pgmap v15671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:43.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:42 smithi077 ceph-mon[27902]: pgmap v15671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:43.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29213.901291 secs 2024-04-21T18:31:44.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29213.901291 secs 2024-04-21T18:31:44.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29213.901291 secs 2024-04-21T18:31:44.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29215.659926 secs 2024-04-21T18:31:44.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:44 smithi191 ceph-mon[31636]: pgmap v15672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:45.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29215.659926 secs 2024-04-21T18:31:45.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:44 smithi170 ceph-mon[31212]: pgmap v15672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:45.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29215.659926 secs 2024-04-21T18:31:45.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:44 smithi077 ceph-mon[27902]: pgmap v15672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:46.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:46 smithi191 ceph-mon[31636]: pgmap v15673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:47.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:46 smithi170 ceph-mon[31212]: pgmap v15673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:47.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:46 smithi077 ceph-mon[27902]: pgmap v15673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:48.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29218.901422 secs 2024-04-21T18:31:48.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29218.901422 secs 2024-04-21T18:31:48.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29218.901422 secs 2024-04-21T18:31:49.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:48 smithi077 ceph-mon[27902]: pgmap v15674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:49.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:48 smithi191 ceph-mon[31636]: pgmap v15674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:49.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:48 smithi170 ceph-mon[31212]: pgmap v15674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:31:50.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:50.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29220.660072 secs 2024-04-21T18:31:50.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29220.660072 secs 2024-04-21T18:31:50.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29220.660072 secs 2024-04-21T18:31:51.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:50 smithi077 ceph-mon[27902]: pgmap v15675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:51.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:50 smithi191 ceph-mon[31636]: pgmap v15675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:51.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:50 smithi170 ceph-mon[31212]: pgmap v15675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:52.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:52 smithi191 ceph-mon[31636]: pgmap v15676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:53.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:52 smithi170 ceph-mon[31212]: pgmap v15676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:53.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:52 smithi077 ceph-mon[27902]: pgmap v15676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:53.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29223.901541 secs 2024-04-21T18:31:54.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29223.901541 secs 2024-04-21T18:31:54.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29223.901541 secs 2024-04-21T18:31:54.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29225.660206 secs 2024-04-21T18:31:54.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:54 smithi191 ceph-mon[31636]: pgmap v15677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:55.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29225.660206 secs 2024-04-21T18:31:55.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:54 smithi170 ceph-mon[31212]: pgmap v15677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:55.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:31:55.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29225.660206 secs 2024-04-21T18:31:55.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:54 smithi077 ceph-mon[27902]: pgmap v15677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:56.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:56 smithi191 ceph-mon[31636]: pgmap v15678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:57.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:56 smithi170 ceph-mon[31212]: pgmap v15678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:57.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:56 smithi077 ceph-mon[27902]: pgmap v15678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:31:58.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29228.901670 secs 2024-04-21T18:31:58.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29228.901670 secs 2024-04-21T18:31:58.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29228.901670 secs 2024-04-21T18:31:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:31:58.396+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:31:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:31:58.396+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:31:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:31:58.396+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:31:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:31:58.396+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:31:59.107 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:58 smithi191 ceph-mon[31636]: pgmap v15679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:59.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:58 smithi077 ceph-mon[27902]: pgmap v15679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:31:59.196 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:58 smithi170 ceph-mon[31212]: pgmap v15679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:00.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:00.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29230.660322 secs 2024-04-21T18:32:00.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29230.660322 secs 2024-04-21T18:32:00.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29230.660322 secs 2024-04-21T18:32:01.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:00 smithi077 ceph-mon[27902]: pgmap v15680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T18:32:01.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:00 smithi191 ceph-mon[31636]: pgmap v15680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T18:32:01.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:00 smithi170 ceph-mon[31212]: pgmap v15680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T18:32:02.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:02 smithi191 ceph-mon[31636]: pgmap v15681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:32:03.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:02 smithi170 ceph-mon[31212]: pgmap v15681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:32:03.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:02 smithi077 ceph-mon[27902]: pgmap v15681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:32:03.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29233.901793 secs 2024-04-21T18:32:04.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29233.901793 secs 2024-04-21T18:32:04.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29233.901793 secs 2024-04-21T18:32:04.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29235.660464 secs 2024-04-21T18:32:04.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:04 smithi191 ceph-mon[31636]: pgmap v15682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:32:05.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29235.660464 secs 2024-04-21T18:32:05.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:04 smithi170 ceph-mon[31212]: pgmap v15682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:32:05.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:05.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29235.660464 secs 2024-04-21T18:32:05.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:04 smithi077 ceph-mon[27902]: pgmap v15682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-21T18:32:05.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:05 smithi191 ceph-mon[31636]: osdmap e1052: 12 total, 12 up, 12 in 2024-04-21T18:32:06.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:05 smithi170 ceph-mon[31212]: osdmap e1052: 12 total, 12 up, 12 in 2024-04-21T18:32:06.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:05 smithi077 ceph-mon[27902]: osdmap e1052: 12 total, 12 up, 12 in 2024-04-21T18:32:06.958 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:06 smithi191 ceph-mon[31636]: pgmap v15684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:32:07.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:06 smithi170 ceph-mon[31212]: pgmap v15684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:32:07.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:06 smithi077 ceph-mon[27902]: pgmap v15684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:32:07.873 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:32:07.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:32:08.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:32:09.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29238.901860 secs 2024-04-21T18:32:09.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:08 smithi170 ceph-mon[31212]: pgmap v15685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:32:09.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29238.901860 secs 2024-04-21T18:32:09.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:08 smithi077 ceph-mon[27902]: pgmap v15685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29238.901860 secs 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:08 smithi191 ceph-mon[31636]: pgmap v15685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:32:10.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29240.660588 secs 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.045 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:32:10.046 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29240.660588 secs 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:32:10.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:32:10.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29240.660588 secs 2024-04-21T18:32:10.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:32:10.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:32:10.208 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:32:11.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:10 smithi170 ceph-mon[31212]: pgmap v15686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:11.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:10 smithi077 ceph-mon[27902]: pgmap v15686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:11.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:10 smithi191 ceph-mon[31636]: pgmap v15686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:12.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:12 smithi191 ceph-mon[31636]: pgmap v15687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:13.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:12 smithi170 ceph-mon[31212]: pgmap v15687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:13.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:12 smithi077 ceph-mon[27902]: pgmap v15687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:14.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29243.901970 secs 2024-04-21T18:32:14.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:13 smithi077 ceph-mon[27902]: osdmap e1053: 12 total, 12 up, 12 in 2024-04-21T18:32:14.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29243.901970 secs 2024-04-21T18:32:14.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:13 smithi191 ceph-mon[31636]: osdmap e1053: 12 total, 12 up, 12 in 2024-04-21T18:32:14.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29243.901970 secs 2024-04-21T18:32:14.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:13 smithi170 ceph-mon[31212]: osdmap e1053: 12 total, 12 up, 12 in 2024-04-21T18:32:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:15.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29245.660706 secs 2024-04-21T18:32:15.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:14 smithi077 ceph-mon[27902]: pgmap v15689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:15.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29245.660706 secs 2024-04-21T18:32:15.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:14 smithi191 ceph-mon[31636]: pgmap v15689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:15.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29245.660706 secs 2024-04-21T18:32:15.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:14 smithi170 ceph-mon[31212]: pgmap v15689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T18:32:16.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:16 smithi191 ceph-mon[31636]: pgmap v15690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:32:17.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:16 smithi170 ceph-mon[31212]: pgmap v15690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:32:17.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:16 smithi077 ceph-mon[27902]: pgmap v15690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:32:18.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29248.902106 secs 2024-04-21T18:32:18.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29248.902106 secs 2024-04-21T18:32:18.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29248.902106 secs 2024-04-21T18:32:19.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:18 smithi077 ceph-mon[27902]: pgmap v15691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:32:19.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:18 smithi191 ceph-mon[31636]: pgmap v15691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:32:19.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:18 smithi170 ceph-mon[31212]: pgmap v15691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:32:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:20.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29250.660839 secs 2024-04-21T18:32:20.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29250.660839 secs 2024-04-21T18:32:20.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29250.660839 secs 2024-04-21T18:32:21.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:20 smithi077 ceph-mon[27902]: pgmap v15692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:32:21.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:20 smithi191 ceph-mon[31636]: pgmap v15692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:32:21.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:20 smithi170 ceph-mon[31212]: pgmap v15692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:32:22.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:22 smithi191 ceph-mon[31636]: pgmap v15693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:32:23.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:22 smithi170 ceph-mon[31212]: pgmap v15693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:32:23.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:22 smithi077 ceph-mon[27902]: pgmap v15693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:32:23.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29253.902205 secs 2024-04-21T18:32:24.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29253.902205 secs 2024-04-21T18:32:24.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29253.902205 secs 2024-04-21T18:32:24.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29255.660968 secs 2024-04-21T18:32:24.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:24 smithi191 ceph-mon[31636]: pgmap v15694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:32:25.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29255.660968 secs 2024-04-21T18:32:25.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:24 smithi170 ceph-mon[31212]: pgmap v15694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:32:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:25.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29255.660968 secs 2024-04-21T18:32:25.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:24 smithi077 ceph-mon[27902]: pgmap v15694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:32:26.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:26 smithi191 ceph-mon[31636]: pgmap v15695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:27.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:26 smithi170 ceph-mon[31212]: pgmap v15695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:27.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:26 smithi077 ceph-mon[27902]: pgmap v15695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:28.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29258.902324 secs 2024-04-21T18:32:28.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29258.902324 secs 2024-04-21T18:32:28.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29258.902324 secs 2024-04-21T18:32:29.107 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:28 smithi191 ceph-mon[31636]: pgmap v15696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:29.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:28 smithi077 ceph-mon[27902]: pgmap v15696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:29.194 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:28 smithi170 ceph-mon[31212]: pgmap v15696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:30.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:30.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29260.661093 secs 2024-04-21T18:32:30.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29260.661093 secs 2024-04-21T18:32:30.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29260.661093 secs 2024-04-21T18:32:31.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:30 smithi077 ceph-mon[27902]: pgmap v15697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:31.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:30 smithi191 ceph-mon[31636]: pgmap v15697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:31.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:30 smithi170 ceph-mon[31212]: pgmap v15697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:32.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:32 smithi191 ceph-mon[31636]: pgmap v15698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:33.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:32 smithi170 ceph-mon[31212]: pgmap v15698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:33.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:32 smithi077 ceph-mon[27902]: pgmap v15698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:33.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29263.902463 secs 2024-04-21T18:32:34.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29263.902463 secs 2024-04-21T18:32:34.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29263.902463 secs 2024-04-21T18:32:34.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29265.661199 secs 2024-04-21T18:32:34.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:34 smithi191 ceph-mon[31636]: pgmap v15699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:35.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29265.661199 secs 2024-04-21T18:32:35.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:34 smithi170 ceph-mon[31212]: pgmap v15699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:35.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29265.661199 secs 2024-04-21T18:32:35.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:34 smithi077 ceph-mon[27902]: pgmap v15699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:36.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:36 smithi191 ceph-mon[31636]: pgmap v15700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:37.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:36 smithi170 ceph-mon[31212]: pgmap v15700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:37.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:36 smithi077 ceph-mon[27902]: pgmap v15700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:38.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29268.902588 secs 2024-04-21T18:32:38.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29268.902588 secs 2024-04-21T18:32:38.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29268.902588 secs 2024-04-21T18:32:39.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:38 smithi077 ceph-mon[27902]: pgmap v15701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:39.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:38 smithi191 ceph-mon[31636]: pgmap v15701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:39.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:38 smithi170 ceph-mon[31212]: pgmap v15701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:40.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:40.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29270.661320 secs 2024-04-21T18:32:40.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29270.661320 secs 2024-04-21T18:32:40.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29270.661320 secs 2024-04-21T18:32:41.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:40 smithi077 ceph-mon[27902]: pgmap v15702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:41.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:40 smithi191 ceph-mon[31636]: pgmap v15702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:41.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:40 smithi170 ceph-mon[31212]: pgmap v15702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:42.957 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:42 smithi191 ceph-mon[31636]: pgmap v15703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:43.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:42 smithi170 ceph-mon[31212]: pgmap v15703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:43.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:42 smithi077 ceph-mon[27902]: pgmap v15703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:43.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29273.902664 secs 2024-04-21T18:32:44.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29273.902664 secs 2024-04-21T18:32:44.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29273.902664 secs 2024-04-21T18:32:44.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29275.661413 secs 2024-04-21T18:32:44.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:44 smithi191 ceph-mon[31636]: pgmap v15704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:45.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29275.661413 secs 2024-04-21T18:32:45.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:44 smithi170 ceph-mon[31212]: pgmap v15704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:45.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29275.661413 secs 2024-04-21T18:32:45.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:44 smithi077 ceph-mon[27902]: pgmap v15704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:46.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:46 smithi191 ceph-mon[31636]: pgmap v15705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:47.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:46 smithi170 ceph-mon[31212]: pgmap v15705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:47.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:46 smithi077 ceph-mon[27902]: pgmap v15705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:48.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29278.902790 secs 2024-04-21T18:32:48.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29278.902790 secs 2024-04-21T18:32:48.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29278.902790 secs 2024-04-21T18:32:49.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:48 smithi077 ceph-mon[27902]: pgmap v15706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:49.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:48 smithi191 ceph-mon[31636]: pgmap v15706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:49.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:48 smithi170 ceph-mon[31212]: pgmap v15706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:50.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:50.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29280.661525 secs 2024-04-21T18:32:50.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29280.661525 secs 2024-04-21T18:32:50.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29280.661525 secs 2024-04-21T18:32:51.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:50 smithi077 ceph-mon[27902]: pgmap v15707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:51.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:50 smithi191 ceph-mon[31636]: pgmap v15707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:51.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:50 smithi170 ceph-mon[31212]: pgmap v15707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:52.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:52 smithi191 ceph-mon[31636]: pgmap v15708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:53.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:52 smithi170 ceph-mon[31212]: pgmap v15708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:53.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:52 smithi077 ceph-mon[27902]: pgmap v15708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:53.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29283.902853 secs 2024-04-21T18:32:54.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29283.902853 secs 2024-04-21T18:32:54.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29283.902853 secs 2024-04-21T18:32:54.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29285.661645 secs 2024-04-21T18:32:54.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:54 smithi191 ceph-mon[31636]: pgmap v15709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:55.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29285.661645 secs 2024-04-21T18:32:55.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:54 smithi170 ceph-mon[31212]: pgmap v15709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:55.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:32:55.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29285.661645 secs 2024-04-21T18:32:55.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:54 smithi077 ceph-mon[27902]: pgmap v15709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:56.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:56 smithi191 ceph-mon[31636]: pgmap v15710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:57.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:56 smithi170 ceph-mon[31212]: pgmap v15710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:57.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:56 smithi077 ceph-mon[27902]: pgmap v15710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:32:58.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29288.902995 secs 2024-04-21T18:32:58.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29288.902995 secs 2024-04-21T18:32:58.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29288.902995 secs 2024-04-21T18:32:59.107 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:58 smithi191 ceph-mon[31636]: pgmap v15711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:59.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:58 smithi077 ceph-mon[27902]: pgmap v15711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:32:59.195 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:58 smithi170 ceph-mon[31212]: pgmap v15711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:00.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29290.661761 secs 2024-04-21T18:33:00.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29290.661761 secs 2024-04-21T18:33:00.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29290.661761 secs 2024-04-21T18:33:01.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:00 smithi077 ceph-mon[27902]: pgmap v15712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T18:33:01.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:00 smithi191 ceph-mon[31636]: pgmap v15712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T18:33:01.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:00 smithi170 ceph-mon[31212]: pgmap v15712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T18:33:02.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:02 smithi191 ceph-mon[31636]: pgmap v15713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T18:33:03.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:02 smithi170 ceph-mon[31212]: pgmap v15713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T18:33:03.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:02 smithi077 ceph-mon[27902]: pgmap v15713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T18:33:03.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29293.903109 secs 2024-04-21T18:33:04.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29293.903109 secs 2024-04-21T18:33:04.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29293.903109 secs 2024-04-21T18:33:05.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29295.661931 secs 2024-04-21T18:33:05.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:04 smithi170 ceph-mon[31212]: pgmap v15714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T18:33:05.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:05.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29295.661931 secs 2024-04-21T18:33:05.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:04 smithi077 ceph-mon[27902]: pgmap v15714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T18:33:05.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29295.661931 secs 2024-04-21T18:33:05.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:04 smithi191 ceph-mon[31636]: pgmap v15714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T18:33:06.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:05 smithi170 ceph-mon[31212]: osdmap e1054: 12 total, 12 up, 12 in 2024-04-21T18:33:06.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:05 smithi077 ceph-mon[27902]: osdmap e1054: 12 total, 12 up, 12 in 2024-04-21T18:33:06.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:05 smithi191 ceph-mon[31636]: osdmap e1054: 12 total, 12 up, 12 in 2024-04-21T18:33:07.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:06 smithi170 ceph-mon[31212]: pgmap v15716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:33:07.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:06 smithi077 ceph-mon[27902]: pgmap v15716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:33:07.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:06 smithi191 ceph-mon[31636]: pgmap v15716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:33:08.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29298.903228 secs 2024-04-21T18:33:08.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:07 smithi077 ceph-mon[27902]: osdmap e1055: 12 total, 12 up, 12 in 2024-04-21T18:33:08.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29298.903228 secs 2024-04-21T18:33:08.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:07 smithi191 ceph-mon[31636]: osdmap e1055: 12 total, 12 up, 12 in 2024-04-21T18:33:08.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29298.903228 secs 2024-04-21T18:33:08.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:07 smithi170 ceph-mon[31212]: osdmap e1055: 12 total, 12 up, 12 in 2024-04-21T18:33:09.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:08 smithi077 ceph-mon[27902]: pgmap v15718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:33:09.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:08 smithi191 ceph-mon[31636]: pgmap v15718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:33:09.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:08 smithi170 ceph-mon[31212]: pgmap v15718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:33:10.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:10.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29300.662055 secs 2024-04-21T18:33:10.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:33:10.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29300.662055 secs 2024-04-21T18:33:10.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:33:10.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29300.662055 secs 2024-04-21T18:33:10.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:33:11.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:11 smithi170 ceph-mon[31212]: pgmap v15719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:33:11.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:33:11.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:33:11.544 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:11 smithi077 ceph-mon[27902]: pgmap v15719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:33:11.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:33:11.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:33:11.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:11.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:11 smithi191 ceph-mon[31636]: pgmap v15719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:33:11.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:33:11.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:33:11.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:33:12.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:12 smithi191 ceph-mon[31636]: pgmap v15720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:33:13.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:12 smithi170 ceph-mon[31212]: pgmap v15720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:33:13.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:12 smithi077 ceph-mon[27902]: pgmap v15720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:33:13.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29303.903306 secs 2024-04-21T18:33:14.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29303.903306 secs 2024-04-21T18:33:14.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29303.903306 secs 2024-04-21T18:33:15.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29305.662137 secs 2024-04-21T18:33:15.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:14 smithi170 ceph-mon[31212]: pgmap v15721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:33:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:15.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29305.662137 secs 2024-04-21T18:33:15.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:14 smithi077 ceph-mon[27902]: pgmap v15721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:33:15.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29305.662137 secs 2024-04-21T18:33:15.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:14 smithi191 ceph-mon[31636]: pgmap v15721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:33:16.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:16 smithi191 ceph-mon[31636]: pgmap v15722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:33:17.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:16 smithi170 ceph-mon[31212]: pgmap v15722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:33:17.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:16 smithi077 ceph-mon[27902]: pgmap v15722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:33:18.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29308.903394 secs 2024-04-21T18:33:18.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29308.903394 secs 2024-04-21T18:33:18.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29308.903394 secs 2024-04-21T18:33:19.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:18 smithi077 ceph-mon[27902]: pgmap v15723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:33:19.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:18 smithi191 ceph-mon[31636]: pgmap v15723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:33:19.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:18 smithi170 ceph-mon[31212]: pgmap v15723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:33:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:20.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29310.662275 secs 2024-04-21T18:33:20.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29310.662275 secs 2024-04-21T18:33:20.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29310.662275 secs 2024-04-21T18:33:21.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:20 smithi077 ceph-mon[27902]: pgmap v15724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:33:21.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:20 smithi191 ceph-mon[31636]: pgmap v15724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:33:21.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:20 smithi170 ceph-mon[31212]: pgmap v15724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:33:22.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:22 smithi191 ceph-mon[31636]: pgmap v15725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:23.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:22 smithi170 ceph-mon[31212]: pgmap v15725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:23.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:22 smithi077 ceph-mon[27902]: pgmap v15725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:23.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29313.903502 secs 2024-04-21T18:33:24.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29313.903502 secs 2024-04-21T18:33:24.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29313.903502 secs 2024-04-21T18:33:25.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29315.662395 secs 2024-04-21T18:33:25.044 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:24 smithi170 ceph-mon[31212]: pgmap v15726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:25.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29315.662395 secs 2024-04-21T18:33:25.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:24 smithi077 ceph-mon[27902]: pgmap v15726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:25.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29315.662395 secs 2024-04-21T18:33:25.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:24 smithi191 ceph-mon[31636]: pgmap v15726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:26.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:26 smithi191 ceph-mon[31636]: pgmap v15727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:27.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:26 smithi170 ceph-mon[31212]: pgmap v15727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:27.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:26 smithi077 ceph-mon[27902]: pgmap v15727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:28.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29318.903625 secs 2024-04-21T18:33:28.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29318.903625 secs 2024-04-21T18:33:28.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29318.903625 secs 2024-04-21T18:33:29.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:28 smithi077 ceph-mon[27902]: pgmap v15728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:29.195 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:28 smithi170 ceph-mon[31212]: pgmap v15728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:29.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:28 smithi191 ceph-mon[31636]: pgmap v15728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:30.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29320.662529 secs 2024-04-21T18:33:30.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29320.662529 secs 2024-04-21T18:33:30.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29320.662529 secs 2024-04-21T18:33:31.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:30 smithi077 ceph-mon[27902]: pgmap v15729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:31.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:30 smithi191 ceph-mon[31636]: pgmap v15729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:31.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:30 smithi170 ceph-mon[31212]: pgmap v15729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:32.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:32 smithi191 ceph-mon[31636]: pgmap v15730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:33.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:32 smithi170 ceph-mon[31212]: pgmap v15730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:32 smithi077 ceph-mon[27902]: pgmap v15730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:34.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29323.903782 secs 2024-04-21T18:33:34.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29323.903782 secs 2024-04-21T18:33:34.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29323.903782 secs 2024-04-21T18:33:35.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29325.662612 secs 2024-04-21T18:33:35.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:34 smithi170 ceph-mon[31212]: pgmap v15731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:35.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29325.662612 secs 2024-04-21T18:33:35.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:34 smithi077 ceph-mon[27902]: pgmap v15731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:35.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29325.662612 secs 2024-04-21T18:33:35.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:34 smithi191 ceph-mon[31636]: pgmap v15731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:36.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:36 smithi191 ceph-mon[31636]: pgmap v15732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:37.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:36 smithi170 ceph-mon[31212]: pgmap v15732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:37.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:36 smithi077 ceph-mon[27902]: pgmap v15732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:38.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29328.903883 secs 2024-04-21T18:33:38.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29328.903883 secs 2024-04-21T18:33:38.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29328.903883 secs 2024-04-21T18:33:39.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:38 smithi077 ceph-mon[27902]: pgmap v15733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:39.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:38 smithi191 ceph-mon[31636]: pgmap v15733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:39.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:38 smithi170 ceph-mon[31212]: pgmap v15733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:40.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:40.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29330.662721 secs 2024-04-21T18:33:40.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29330.662721 secs 2024-04-21T18:33:40.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29330.662721 secs 2024-04-21T18:33:41.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:40 smithi077 ceph-mon[27902]: pgmap v15734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:41.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:40 smithi191 ceph-mon[31636]: pgmap v15734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:41.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:40 smithi170 ceph-mon[31212]: pgmap v15734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:42.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:42 smithi191 ceph-mon[31636]: pgmap v15735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:43.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:42 smithi170 ceph-mon[31212]: pgmap v15735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:43.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:42 smithi077 ceph-mon[27902]: pgmap v15735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:43.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29333.903999 secs 2024-04-21T18:33:44.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29333.903999 secs 2024-04-21T18:33:44.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29333.903999 secs 2024-04-21T18:33:45.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29335.662835 secs 2024-04-21T18:33:45.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:44 smithi170 ceph-mon[31212]: pgmap v15736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:45.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29335.662835 secs 2024-04-21T18:33:45.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:44 smithi077 ceph-mon[27902]: pgmap v15736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:45.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29335.662835 secs 2024-04-21T18:33:45.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:44 smithi191 ceph-mon[31636]: pgmap v15736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:46.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:46 smithi191 ceph-mon[31636]: pgmap v15737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:47.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:46 smithi170 ceph-mon[31212]: pgmap v15737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:47.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:46 smithi077 ceph-mon[27902]: pgmap v15737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:48.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29338.904117 secs 2024-04-21T18:33:48.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29338.904117 secs 2024-04-21T18:33:48.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29338.904117 secs 2024-04-21T18:33:49.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:48 smithi077 ceph-mon[27902]: pgmap v15738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:49.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:48 smithi191 ceph-mon[31636]: pgmap v15738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:49.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:48 smithi170 ceph-mon[31212]: pgmap v15738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:50.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:50.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29340.662953 secs 2024-04-21T18:33:50.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29340.662953 secs 2024-04-21T18:33:50.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29340.662953 secs 2024-04-21T18:33:51.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:50 smithi191 ceph-mon[31636]: pgmap v15739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:51.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:50 smithi170 ceph-mon[31212]: pgmap v15739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:51.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:50 smithi077 ceph-mon[27902]: pgmap v15739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:52.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:52 smithi191 ceph-mon[31636]: pgmap v15740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:53.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:52 smithi170 ceph-mon[31212]: pgmap v15740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:53.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:52 smithi077 ceph-mon[27902]: pgmap v15740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:54.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29343.904233 secs 2024-04-21T18:33:54.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29343.904233 secs 2024-04-21T18:33:54.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29343.904233 secs 2024-04-21T18:33:55.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29345.663066 secs 2024-04-21T18:33:55.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:54 smithi170 ceph-mon[31212]: pgmap v15741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:33:55.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29345.663066 secs 2024-04-21T18:33:55.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:54 smithi077 ceph-mon[27902]: pgmap v15741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:55.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29345.663066 secs 2024-04-21T18:33:55.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:54 smithi191 ceph-mon[31636]: pgmap v15741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:56.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:56 smithi191 ceph-mon[31636]: pgmap v15742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:57.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:56 smithi170 ceph-mon[31212]: pgmap v15742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:57.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:56 smithi077 ceph-mon[27902]: pgmap v15742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:33:58.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29348.904357 secs 2024-04-21T18:33:58.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29348.904357 secs 2024-04-21T18:33:58.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29348.904357 secs 2024-04-21T18:33:59.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:58 smithi191 ceph-mon[31636]: pgmap v15743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:59.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:58 smithi077 ceph-mon[27902]: pgmap v15743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:33:59.194 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:58 smithi170 ceph-mon[31212]: pgmap v15743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:00.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:00.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:33:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29350.663215 secs 2024-04-21T18:34:00.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:33:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29350.663215 secs 2024-04-21T18:34:00.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:33:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29350.663215 secs 2024-04-21T18:34:01.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:00 smithi191 ceph-mon[31636]: pgmap v15744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:01.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:00 smithi170 ceph-mon[31212]: pgmap v15744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:01.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:00 smithi077 ceph-mon[27902]: pgmap v15744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:02.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:02 smithi191 ceph-mon[31636]: pgmap v15745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:03.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:02 smithi170 ceph-mon[31212]: pgmap v15745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:03.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:02 smithi077 ceph-mon[27902]: pgmap v15745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:04.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29353.904477 secs 2024-04-21T18:34:04.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29353.904477 secs 2024-04-21T18:34:04.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29353.904477 secs 2024-04-21T18:34:05.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29355.663334 secs 2024-04-21T18:34:05.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:04 smithi170 ceph-mon[31212]: pgmap v15746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:05.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:05.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29355.663334 secs 2024-04-21T18:34:05.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:04 smithi077 ceph-mon[27902]: pgmap v15746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:05.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29355.663334 secs 2024-04-21T18:34:05.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:04 smithi191 ceph-mon[31636]: pgmap v15746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:06.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:05 smithi170 ceph-mon[31212]: osdmap e1056: 12 total, 12 up, 12 in 2024-04-21T18:34:06.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:05 smithi077 ceph-mon[27902]: osdmap e1056: 12 total, 12 up, 12 in 2024-04-21T18:34:06.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:05 smithi191 ceph-mon[31636]: osdmap e1056: 12 total, 12 up, 12 in 2024-04-21T18:34:07.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:06 smithi170 ceph-mon[31212]: pgmap v15748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:34:07.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:06 smithi077 ceph-mon[27902]: pgmap v15748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:34:07.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:06 smithi191 ceph-mon[31636]: pgmap v15748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:34:08.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29358.904598 secs 2024-04-21T18:34:08.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:07 smithi077 ceph-mon[27902]: osdmap e1057: 12 total, 12 up, 12 in 2024-04-21T18:34:08.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29358.904598 secs 2024-04-21T18:34:08.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:07 smithi191 ceph-mon[31636]: osdmap e1057: 12 total, 12 up, 12 in 2024-04-21T18:34:08.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29358.904598 secs 2024-04-21T18:34:08.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:07 smithi170 ceph-mon[31212]: osdmap e1057: 12 total, 12 up, 12 in 2024-04-21T18:34:09.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:08 smithi077 ceph-mon[27902]: pgmap v15750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:34:09.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:08 smithi191 ceph-mon[31636]: pgmap v15750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:34:09.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:08 smithi170 ceph-mon[31212]: pgmap v15750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:34:10.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:10.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29360.663447 secs 2024-04-21T18:34:10.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29360.663447 secs 2024-04-21T18:34:10.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29360.663447 secs 2024-04-21T18:34:11.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:10 smithi191 ceph-mon[31636]: pgmap v15751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:34:11.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:10 smithi170 ceph-mon[31212]: pgmap v15751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:34:11.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:10 smithi077 ceph-mon[27902]: pgmap v15751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:34:12.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:34:12.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:34:12.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:34:12.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:12.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:13.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29363.904665 secs 2024-04-21T18:34:13.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:34:13.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:34:13.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:13.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:12 smithi191 ceph-mon[31636]: pgmap v15752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:34:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29363.904665 secs 2024-04-21T18:34:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:34:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:34:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:12 smithi170 ceph-mon[31212]: pgmap v15752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:34:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29363.904665 secs 2024-04-21T18:34:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:34:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:34:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:34:13.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:12 smithi077 ceph-mon[27902]: pgmap v15752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:34:14.872 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29365.663560 secs 2024-04-21T18:34:14.954 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29365.663560 secs 2024-04-21T18:34:15.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29365.663560 secs 2024-04-21T18:34:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:15.871 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:15 smithi077 ceph-mon[27902]: pgmap v15753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:34:15.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:15 smithi191 ceph-mon[31636]: pgmap v15753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:34:16.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:15 smithi170 ceph-mon[31212]: pgmap v15753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T18:34:17.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:16 smithi170 ceph-mon[31212]: pgmap v15754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:34:17.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:16 smithi077 ceph-mon[27902]: pgmap v15754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:34:17.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:16 smithi191 ceph-mon[31636]: pgmap v15754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:34:18.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29368.904799 secs 2024-04-21T18:34:18.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29368.904799 secs 2024-04-21T18:34:18.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29368.904799 secs 2024-04-21T18:34:19.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:18 smithi077 ceph-mon[27902]: pgmap v15755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:34:19.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:18 smithi191 ceph-mon[31636]: pgmap v15755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:34:19.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:18 smithi170 ceph-mon[31212]: pgmap v15755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:34:20.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:20.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29370.663653 secs 2024-04-21T18:34:20.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29370.663653 secs 2024-04-21T18:34:20.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29370.663653 secs 2024-04-21T18:34:21.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:20 smithi191 ceph-mon[31636]: pgmap v15756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:34:21.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:20 smithi170 ceph-mon[31212]: pgmap v15756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:34:21.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:20 smithi077 ceph-mon[27902]: pgmap v15756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:34:23.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:22 smithi170 ceph-mon[31212]: pgmap v15757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:23.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:22 smithi077 ceph-mon[27902]: pgmap v15757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:23.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:22 smithi191 ceph-mon[31636]: pgmap v15757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:24.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29373.904929 secs 2024-04-21T18:34:24.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29373.904929 secs 2024-04-21T18:34:24.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29373.904929 secs 2024-04-21T18:34:25.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29375.663795 secs 2024-04-21T18:34:25.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:24 smithi170 ceph-mon[31212]: pgmap v15758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:25.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29375.663795 secs 2024-04-21T18:34:25.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:24 smithi077 ceph-mon[27902]: pgmap v15758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:25.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29375.663795 secs 2024-04-21T18:34:25.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:24 smithi191 ceph-mon[31636]: pgmap v15758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:27.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:26 smithi170 ceph-mon[31212]: pgmap v15759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:27.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:26 smithi077 ceph-mon[27902]: pgmap v15759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:27.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:26 smithi191 ceph-mon[31636]: pgmap v15759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:28.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29378.905052 secs 2024-04-21T18:34:28.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29378.905052 secs 2024-04-21T18:34:28.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29378.905052 secs 2024-04-21T18:34:29.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:28 smithi077 ceph-mon[27902]: pgmap v15760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:29.194 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:28 smithi170 ceph-mon[31212]: pgmap v15760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:29.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:28 smithi191 ceph-mon[31636]: pgmap v15760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:30.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29380.663914 secs 2024-04-21T18:34:30.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29380.663914 secs 2024-04-21T18:34:30.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29380.663914 secs 2024-04-21T18:34:31.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:30 smithi191 ceph-mon[31636]: pgmap v15761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:31.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:30 smithi170 ceph-mon[31212]: pgmap v15761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:31.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:30 smithi077 ceph-mon[27902]: pgmap v15761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:33.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:32 smithi170 ceph-mon[31212]: pgmap v15762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:33.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:32 smithi077 ceph-mon[27902]: pgmap v15762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:33.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:32 smithi191 ceph-mon[31636]: pgmap v15762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:34.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29383.905175 secs 2024-04-21T18:34:34.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29383.905175 secs 2024-04-21T18:34:34.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29383.905175 secs 2024-04-21T18:34:35.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29385.664061 secs 2024-04-21T18:34:35.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:34 smithi170 ceph-mon[31212]: pgmap v15763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:35.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29385.664061 secs 2024-04-21T18:34:35.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:34 smithi077 ceph-mon[27902]: pgmap v15763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:35.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29385.664061 secs 2024-04-21T18:34:35.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:34 smithi191 ceph-mon[31636]: pgmap v15763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:37.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:36 smithi170 ceph-mon[31212]: pgmap v15764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:37.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:36 smithi077 ceph-mon[27902]: pgmap v15764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:37.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:36 smithi191 ceph-mon[31636]: pgmap v15764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:38.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29388.905295 secs 2024-04-21T18:34:38.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29388.905295 secs 2024-04-21T18:34:38.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29388.905295 secs 2024-04-21T18:34:39.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:38 smithi191 ceph-mon[31636]: pgmap v15765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:39.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:38 smithi170 ceph-mon[31212]: pgmap v15765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:39.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:38 smithi077 ceph-mon[27902]: pgmap v15765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:40.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:40.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29390.664157 secs 2024-04-21T18:34:40.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29390.664157 secs 2024-04-21T18:34:40.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29390.664157 secs 2024-04-21T18:34:42.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:41 smithi191 ceph-mon[31636]: pgmap v15766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:42.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:41 smithi170 ceph-mon[31212]: pgmap v15766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:42.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:41 smithi077 ceph-mon[27902]: pgmap v15766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:43.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29393.905410 secs 2024-04-21T18:34:43.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29393.905410 secs 2024-04-21T18:34:43.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29393.905410 secs 2024-04-21T18:34:44.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:43 smithi191 ceph-mon[31636]: pgmap v15767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:44.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:43 smithi170 ceph-mon[31212]: pgmap v15767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:44.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:43 smithi077 ceph-mon[27902]: pgmap v15767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:45.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:45.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29395.664267 secs 2024-04-21T18:34:45.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29395.664267 secs 2024-04-21T18:34:45.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29395.664267 secs 2024-04-21T18:34:46.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:45 smithi191 ceph-mon[31636]: pgmap v15768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:46.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:45 smithi170 ceph-mon[31212]: pgmap v15768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:45 smithi077 ceph-mon[27902]: pgmap v15768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:48.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:47 smithi191 ceph-mon[31636]: pgmap v15769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:48.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29398.905522 secs 2024-04-21T18:34:48.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:47 smithi170 ceph-mon[31212]: pgmap v15769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:48.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29398.905522 secs 2024-04-21T18:34:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:47 smithi077 ceph-mon[27902]: pgmap v15769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29398.905522 secs 2024-04-21T18:34:50.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:50.173 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:49 smithi077 ceph-mon[27902]: pgmap v15770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:50.174 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29400.664384 secs 2024-04-21T18:34:50.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:49 smithi191 ceph-mon[31636]: pgmap v15770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:50.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29400.664384 secs 2024-04-21T18:34:50.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:49 smithi170 ceph-mon[31212]: pgmap v15770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:50.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29400.664384 secs 2024-04-21T18:34:52.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:51 smithi191 ceph-mon[31636]: pgmap v15771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:52.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:51 smithi170 ceph-mon[31212]: pgmap v15771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:52.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:51 smithi077 ceph-mon[27902]: pgmap v15771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:53.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29403.905639 secs 2024-04-21T18:34:53.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29403.905639 secs 2024-04-21T18:34:53.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29403.905639 secs 2024-04-21T18:34:54.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:53 smithi191 ceph-mon[31636]: pgmap v15772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:54.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:53 smithi170 ceph-mon[31212]: pgmap v15772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:54.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:53 smithi077 ceph-mon[27902]: pgmap v15772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:34:55.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29405.664502 secs 2024-04-21T18:34:55.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29405.664502 secs 2024-04-21T18:34:55.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29405.664502 secs 2024-04-21T18:34:56.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:55 smithi191 ceph-mon[31636]: pgmap v15773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:56.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:55 smithi170 ceph-mon[31212]: pgmap v15773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:56.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:55 smithi077 ceph-mon[27902]: pgmap v15773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:34:58.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:57 smithi191 ceph-mon[31636]: pgmap v15774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:58.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29408.905777 secs 2024-04-21T18:34:58.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:57 smithi170 ceph-mon[31212]: pgmap v15774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:58.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29408.905777 secs 2024-04-21T18:34:58.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:57 smithi077 ceph-mon[27902]: pgmap v15774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:34:58.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29408.905777 secs 2024-04-21T18:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:34:58.421+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:34:58.421+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:34:58.421+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:34:58.421+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:35:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:00.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:59 smithi191 ceph-mon[31636]: pgmap v15775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:00.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29410.664658 secs 2024-04-21T18:35:00.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:59 smithi170 ceph-mon[31212]: pgmap v15775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:00.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29410.664658 secs 2024-04-21T18:35:00.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:59 smithi077 ceph-mon[27902]: pgmap v15775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:00.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29410.664658 secs 2024-04-21T18:35:02.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:01 smithi191 ceph-mon[31636]: pgmap v15776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:02.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:01 smithi170 ceph-mon[31212]: pgmap v15776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:02.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:01 smithi077 ceph-mon[27902]: pgmap v15776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:03.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29413.905860 secs 2024-04-21T18:35:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29413.905860 secs 2024-04-21T18:35:03.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29413.905860 secs 2024-04-21T18:35:04.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:03 smithi191 ceph-mon[31636]: pgmap v15777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:04.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:03 smithi170 ceph-mon[31212]: pgmap v15777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:04.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:03 smithi077 ceph-mon[27902]: pgmap v15777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:05.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:05.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29415.664805 secs 2024-04-21T18:35:05.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:04 smithi191 ceph-mon[31636]: osdmap e1058: 12 total, 12 up, 12 in 2024-04-21T18:35:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29415.664805 secs 2024-04-21T18:35:05.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:04 smithi170 ceph-mon[31212]: osdmap e1058: 12 total, 12 up, 12 in 2024-04-21T18:35:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29415.664805 secs 2024-04-21T18:35:05.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:04 smithi077 ceph-mon[27902]: osdmap e1058: 12 total, 12 up, 12 in 2024-04-21T18:35:06.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:05 smithi170 ceph-mon[31212]: pgmap v15779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:35:06.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:05 smithi077 ceph-mon[27902]: pgmap v15779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:35:06.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:05 smithi191 ceph-mon[31636]: pgmap v15779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:35:08.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:07 smithi170 ceph-mon[31212]: pgmap v15780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:35:08.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29418.905980 secs 2024-04-21T18:35:08.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:07 smithi170 ceph-mon[31212]: osdmap e1059: 12 total, 12 up, 12 in 2024-04-21T18:35:08.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:07 smithi077 ceph-mon[27902]: pgmap v15780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:35:08.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29418.905980 secs 2024-04-21T18:35:08.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:07 smithi077 ceph-mon[27902]: osdmap e1059: 12 total, 12 up, 12 in 2024-04-21T18:35:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:07 smithi191 ceph-mon[31636]: pgmap v15780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:35:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29418.905980 secs 2024-04-21T18:35:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:07 smithi191 ceph-mon[31636]: osdmap e1059: 12 total, 12 up, 12 in 2024-04-21T18:35:10.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:10.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:09 smithi170 ceph-mon[31212]: pgmap v15782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:35:10.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29420.664926 secs 2024-04-21T18:35:10.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:09 smithi077 ceph-mon[27902]: pgmap v15782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:35:10.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29420.664926 secs 2024-04-21T18:35:10.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:09 smithi191 ceph-mon[31636]: pgmap v15782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:35:10.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29420.664926 secs 2024-04-21T18:35:12.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:11 smithi170 ceph-mon[31212]: pgmap v15783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:35:12.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:11 smithi077 ceph-mon[27902]: pgmap v15783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:35:12.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:11 smithi191 ceph-mon[31636]: pgmap v15783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:35:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29423.906129 secs 2024-04-21T18:35:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:35:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29423.906129 secs 2024-04-21T18:35:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:35:13.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29423.906129 secs 2024-04-21T18:35:13.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:35:14.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:13 smithi170 ceph-mon[31212]: pgmap v15784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T18:35:14.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:35:14.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:35:14.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:35:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:13 smithi077 ceph-mon[27902]: pgmap v15784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T18:35:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:35:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:35:14.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:35:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:13 smithi191 ceph-mon[31636]: pgmap v15784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T18:35:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:35:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:35:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:35:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:15.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29425.664950 secs 2024-04-21T18:35:15.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29425.664950 secs 2024-04-21T18:35:15.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29425.664950 secs 2024-04-21T18:35:16.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:15 smithi170 ceph-mon[31212]: pgmap v15785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:35:16.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:15 smithi077 ceph-mon[27902]: pgmap v15785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:35:16.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:15 smithi191 ceph-mon[31636]: pgmap v15785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:35:18.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:18 smithi170 ceph-mon[31212]: pgmap v15786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:35:18.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29428.906263 secs 2024-04-21T18:35:18.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:18 smithi077 ceph-mon[27902]: pgmap v15786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:35:18.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29428.906263 secs 2024-04-21T18:35:18.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:18 smithi191 ceph-mon[31636]: pgmap v15786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:35:18.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29428.906263 secs 2024-04-21T18:35:20.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:20.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:20 smithi170 ceph-mon[31212]: pgmap v15787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:35:20.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29430.665063 secs 2024-04-21T18:35:20.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:20 smithi077 ceph-mon[27902]: pgmap v15787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:35:20.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29430.665063 secs 2024-04-21T18:35:20.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:20 smithi191 ceph-mon[31636]: pgmap v15787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:35:20.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29430.665063 secs 2024-04-21T18:35:22.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:22 smithi170 ceph-mon[31212]: pgmap v15788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:35:22.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:22 smithi077 ceph-mon[27902]: pgmap v15788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:35:22.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:22 smithi191 ceph-mon[31636]: pgmap v15788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:35:23.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29433.906381 secs 2024-04-21T18:35:23.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29433.906381 secs 2024-04-21T18:35:23.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29433.906381 secs 2024-04-21T18:35:24.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:24 smithi170 ceph-mon[31212]: pgmap v15789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:24.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:24 smithi077 ceph-mon[27902]: pgmap v15789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:24.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:24 smithi191 ceph-mon[31636]: pgmap v15789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:25.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29435.665182 secs 2024-04-21T18:35:25.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29435.665182 secs 2024-04-21T18:35:25.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29435.665182 secs 2024-04-21T18:35:26.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:26 smithi170 ceph-mon[31212]: pgmap v15790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:26.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:26 smithi077 ceph-mon[27902]: pgmap v15790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:26.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:26 smithi191 ceph-mon[31636]: pgmap v15790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:28.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:28 smithi170 ceph-mon[31212]: pgmap v15791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:28.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29438.906519 secs 2024-04-21T18:35:28.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:28 smithi077 ceph-mon[27902]: pgmap v15791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:28.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29438.906519 secs 2024-04-21T18:35:28.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:28 smithi191 ceph-mon[31636]: pgmap v15791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:28.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29438.906519 secs 2024-04-21T18:35:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:30.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:30 smithi170 ceph-mon[31212]: pgmap v15792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:30.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29440.665305 secs 2024-04-21T18:35:30.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:30 smithi077 ceph-mon[27902]: pgmap v15792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:30.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29440.665305 secs 2024-04-21T18:35:30.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:30 smithi191 ceph-mon[31636]: pgmap v15792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:30.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29440.665305 secs 2024-04-21T18:35:32.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:32 smithi170 ceph-mon[31212]: pgmap v15793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:32.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:32 smithi077 ceph-mon[27902]: pgmap v15793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:32 smithi191 ceph-mon[31636]: pgmap v15793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:33.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29443.906581 secs 2024-04-21T18:35:33.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29443.906581 secs 2024-04-21T18:35:33.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29443.906581 secs 2024-04-21T18:35:34.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:34 smithi170 ceph-mon[31212]: pgmap v15794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:34.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:34 smithi077 ceph-mon[27902]: pgmap v15794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:34.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:34 smithi191 ceph-mon[31636]: pgmap v15794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:35.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:35.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29445.665365 secs 2024-04-21T18:35:35.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29445.665365 secs 2024-04-21T18:35:35.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29445.665365 secs 2024-04-21T18:35:36.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:36 smithi170 ceph-mon[31212]: pgmap v15795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:36.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:36 smithi077 ceph-mon[27902]: pgmap v15795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:36.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:36 smithi191 ceph-mon[31636]: pgmap v15795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:38.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:38 smithi170 ceph-mon[31212]: pgmap v15796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:38.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29448.906713 secs 2024-04-21T18:35:38.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:38 smithi077 ceph-mon[27902]: pgmap v15796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:38.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29448.906713 secs 2024-04-21T18:35:38.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:38 smithi191 ceph-mon[31636]: pgmap v15796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:38.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29448.906713 secs 2024-04-21T18:35:40.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:40.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:40 smithi077 ceph-mon[27902]: pgmap v15797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:40.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29450.665462 secs 2024-04-21T18:35:40.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:40 smithi191 ceph-mon[31636]: pgmap v15797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:40.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29450.665462 secs 2024-04-21T18:35:40.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:40 smithi170 ceph-mon[31212]: pgmap v15797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:40.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29450.665462 secs 2024-04-21T18:35:42.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:42 smithi077 ceph-mon[27902]: pgmap v15798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:42.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:42 smithi191 ceph-mon[31636]: pgmap v15798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:42.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:42 smithi170 ceph-mon[31212]: pgmap v15798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:43.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29453.906832 secs 2024-04-21T18:35:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:35:43.428+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:35:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:35:43.428+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:35:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:35:43.428+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:35:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:35:43.428+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:35:43.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29453.906832 secs 2024-04-21T18:35:43.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29453.906832 secs 2024-04-21T18:35:44.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:44 smithi077 ceph-mon[27902]: pgmap v15799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:44.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:44 smithi191 ceph-mon[31636]: pgmap v15799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:44.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:44 smithi170 ceph-mon[31212]: pgmap v15799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:45.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29455.665585 secs 2024-04-21T18:35:45.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29455.665585 secs 2024-04-21T18:35:45.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29455.665585 secs 2024-04-21T18:35:46.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:46 smithi077 ceph-mon[27902]: pgmap v15800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:46.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:46 smithi191 ceph-mon[31636]: pgmap v15800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:46.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:46 smithi170 ceph-mon[31212]: pgmap v15800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:48 smithi077 ceph-mon[27902]: pgmap v15801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:48.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29458.906935 secs 2024-04-21T18:35:48.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:48 smithi191 ceph-mon[31636]: pgmap v15801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:48.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29458.906935 secs 2024-04-21T18:35:48.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:48 smithi170 ceph-mon[31212]: pgmap v15801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:48.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29458.906935 secs 2024-04-21T18:35:50.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:50.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:50 smithi077 ceph-mon[27902]: pgmap v15802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:50.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29460.665689 secs 2024-04-21T18:35:50.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:50 smithi191 ceph-mon[31636]: pgmap v15802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:50.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29460.665689 secs 2024-04-21T18:35:50.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:50 smithi170 ceph-mon[31212]: pgmap v15802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:50.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29460.665689 secs 2024-04-21T18:35:52.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:52 smithi077 ceph-mon[27902]: pgmap v15803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:52.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:52 smithi191 ceph-mon[31636]: pgmap v15803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:52.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:52 smithi170 ceph-mon[31212]: pgmap v15803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:53.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29463.907046 secs 2024-04-21T18:35:53.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29463.907046 secs 2024-04-21T18:35:53.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29463.907046 secs 2024-04-21T18:35:54.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:54 smithi077 ceph-mon[27902]: pgmap v15804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:54.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:54 smithi191 ceph-mon[31636]: pgmap v15804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:54.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:54 smithi170 ceph-mon[31212]: pgmap v15804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:55.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:35:55.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29465.665762 secs 2024-04-21T18:35:55.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29465.665762 secs 2024-04-21T18:35:55.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29465.665762 secs 2024-04-21T18:35:56.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:56 smithi077 ceph-mon[27902]: pgmap v15805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:56.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:56 smithi191 ceph-mon[31636]: pgmap v15805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:56.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:56 smithi170 ceph-mon[31212]: pgmap v15805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:35:58.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:58 smithi077 ceph-mon[27902]: pgmap v15806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:58.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:35:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29468.907165 secs 2024-04-21T18:35:58.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:58 smithi191 ceph-mon[31636]: pgmap v15806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:58.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:35:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29468.907165 secs 2024-04-21T18:35:58.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:58 smithi170 ceph-mon[31212]: pgmap v15806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:35:58.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:35:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29468.907165 secs 2024-04-21T18:36:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:00.344 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:00 smithi170 ceph-mon[31212]: pgmap v15807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:00.344 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29470.665883 secs 2024-04-21T18:36:00.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:00 smithi077 ceph-mon[27902]: pgmap v15807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:00.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29470.665883 secs 2024-04-21T18:36:00.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:00 smithi191 ceph-mon[31636]: pgmap v15807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:00.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29470.665883 secs 2024-04-21T18:36:02.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:02 smithi077 ceph-mon[27902]: pgmap v15808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:02.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:02 smithi191 ceph-mon[31636]: pgmap v15808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:02.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:02 smithi170 ceph-mon[31212]: pgmap v15808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:03.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29473.907272 secs 2024-04-21T18:36:03.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29473.907272 secs 2024-04-21T18:36:03.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29473.907272 secs 2024-04-21T18:36:04.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:04 smithi077 ceph-mon[27902]: pgmap v15809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:04.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:04 smithi191 ceph-mon[31636]: pgmap v15809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:04.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:04 smithi170 ceph-mon[31212]: pgmap v15809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:05.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:05.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29475.666015 secs 2024-04-21T18:36:05.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:05 smithi077 ceph-mon[27902]: osdmap e1060: 12 total, 12 up, 12 in 2024-04-21T18:36:05.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29475.666015 secs 2024-04-21T18:36:05.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:05 smithi191 ceph-mon[31636]: osdmap e1060: 12 total, 12 up, 12 in 2024-04-21T18:36:05.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29475.666015 secs 2024-04-21T18:36:05.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:05 smithi170 ceph-mon[31212]: osdmap e1060: 12 total, 12 up, 12 in 2024-04-21T18:36:06.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:06 smithi191 ceph-mon[31636]: pgmap v15811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:36:06.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:06 smithi170 ceph-mon[31212]: pgmap v15811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:36:06.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:06 smithi077 ceph-mon[27902]: pgmap v15811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:36:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:08 smithi191 ceph-mon[31636]: pgmap v15812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:36:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29478.907388 secs 2024-04-21T18:36:08.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:08 smithi191 ceph-mon[31636]: osdmap e1061: 12 total, 12 up, 12 in 2024-04-21T18:36:08.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:08 smithi170 ceph-mon[31212]: pgmap v15812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:36:08.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29478.907388 secs 2024-04-21T18:36:08.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:08 smithi170 ceph-mon[31212]: osdmap e1061: 12 total, 12 up, 12 in 2024-04-21T18:36:08.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:08 smithi077 ceph-mon[27902]: pgmap v15812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:36:08.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29478.907388 secs 2024-04-21T18:36:08.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:08 smithi077 ceph-mon[27902]: osdmap e1061: 12 total, 12 up, 12 in 2024-04-21T18:36:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:10.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:10 smithi191 ceph-mon[31636]: pgmap v15814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:36:10.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29480.666130 secs 2024-04-21T18:36:10.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:10 smithi170 ceph-mon[31212]: pgmap v15814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:36:10.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29480.666130 secs 2024-04-21T18:36:10.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:10 smithi077 ceph-mon[27902]: pgmap v15814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:36:10.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29480.666130 secs 2024-04-21T18:36:12.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:12 smithi191 ceph-mon[31636]: pgmap v15815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:36:12.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:12 smithi170 ceph-mon[31212]: pgmap v15815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:36:12.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:12 smithi077 ceph-mon[27902]: pgmap v15815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:36:13.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29483.907504 secs 2024-04-21T18:36:13.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:36:13.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29483.907504 secs 2024-04-21T18:36:13.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:36:13.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29483.907504 secs 2024-04-21T18:36:13.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:36:14.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:14 smithi191 ceph-mon[31636]: pgmap v15816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T18:36:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:36:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:36:14.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:36:14.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:14 smithi170 ceph-mon[31212]: pgmap v15816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T18:36:14.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:36:14.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:36:14.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:36:14.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:14 smithi077 ceph-mon[27902]: pgmap v15816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T18:36:14.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:36:14.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:36:14.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:36:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:15.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29485.666212 secs 2024-04-21T18:36:15.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29485.666212 secs 2024-04-21T18:36:15.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29485.666212 secs 2024-04-21T18:36:16.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:16 smithi191 ceph-mon[31636]: pgmap v15817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:36:16.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:16 smithi170 ceph-mon[31212]: pgmap v15817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:36:16.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:16 smithi077 ceph-mon[27902]: pgmap v15817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:36:18.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:18 smithi191 ceph-mon[31636]: pgmap v15818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:36:18.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29488.907617 secs 2024-04-21T18:36:18.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:18 smithi170 ceph-mon[31212]: pgmap v15818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:36:18.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29488.907617 secs 2024-04-21T18:36:18.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:18 smithi077 ceph-mon[27902]: pgmap v15818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:36:18.621 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29488.907617 secs 2024-04-21T18:36:20.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:20.423 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:20 smithi077 ceph-mon[27902]: pgmap v15819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:36:20.423 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29490.666332 secs 2024-04-21T18:36:20.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:20 smithi191 ceph-mon[31636]: pgmap v15819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:36:20.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29490.666332 secs 2024-04-21T18:36:20.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:20 smithi170 ceph-mon[31212]: pgmap v15819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:36:20.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29490.666332 secs 2024-04-21T18:36:22.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:22 smithi191 ceph-mon[31636]: pgmap v15820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:36:22.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:22 smithi170 ceph-mon[31212]: pgmap v15820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:36:22.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:22 smithi077 ceph-mon[27902]: pgmap v15820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:36:23.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29493.907706 secs 2024-04-21T18:36:23.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29493.907706 secs 2024-04-21T18:36:23.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29493.907706 secs 2024-04-21T18:36:24.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:24 smithi191 ceph-mon[31636]: pgmap v15821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:24.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:24 smithi170 ceph-mon[31212]: pgmap v15821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:24.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:24 smithi077 ceph-mon[27902]: pgmap v15821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:25.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29495.666454 secs 2024-04-21T18:36:25.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29495.666454 secs 2024-04-21T18:36:25.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29495.666454 secs 2024-04-21T18:36:26.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:26 smithi191 ceph-mon[31636]: pgmap v15822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:26.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:26 smithi170 ceph-mon[31212]: pgmap v15822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:26.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:26 smithi077 ceph-mon[27902]: pgmap v15822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:28.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:28 smithi191 ceph-mon[31636]: pgmap v15823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:28.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29498.907842 secs 2024-04-21T18:36:28.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:28 smithi170 ceph-mon[31212]: pgmap v15823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:28.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29498.907842 secs 2024-04-21T18:36:28.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:28 smithi077 ceph-mon[27902]: pgmap v15823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:28.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29498.907842 secs 2024-04-21T18:36:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:30.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:30 smithi191 ceph-mon[31636]: pgmap v15824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:30.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29500.666570 secs 2024-04-21T18:36:30.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:30 smithi170 ceph-mon[31212]: pgmap v15824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:30.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29500.666570 secs 2024-04-21T18:36:30.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:30 smithi077 ceph-mon[27902]: pgmap v15824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:30.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29500.666570 secs 2024-04-21T18:36:32.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:32 smithi191 ceph-mon[31636]: pgmap v15825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:32 smithi170 ceph-mon[31212]: pgmap v15825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:32 smithi077 ceph-mon[27902]: pgmap v15825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:33.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29503.907957 secs 2024-04-21T18:36:33.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29503.907957 secs 2024-04-21T18:36:33.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29503.907957 secs 2024-04-21T18:36:34.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:34 smithi191 ceph-mon[31636]: pgmap v15826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:34.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:34 smithi170 ceph-mon[31212]: pgmap v15826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:34.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:34 smithi077 ceph-mon[27902]: pgmap v15826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:35.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:35.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29505.666632 secs 2024-04-21T18:36:35.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29505.666632 secs 2024-04-21T18:36:35.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29505.666632 secs 2024-04-21T18:36:36.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:36 smithi191 ceph-mon[31636]: pgmap v15827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:36.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:36 smithi170 ceph-mon[31212]: pgmap v15827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:36.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:36 smithi077 ceph-mon[27902]: pgmap v15827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:38.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:38 smithi191 ceph-mon[31636]: pgmap v15828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:38.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29508.908026 secs 2024-04-21T18:36:38.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:38 smithi170 ceph-mon[31212]: pgmap v15828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:38.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29508.908026 secs 2024-04-21T18:36:38.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:38 smithi077 ceph-mon[27902]: pgmap v15828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:38.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29508.908026 secs 2024-04-21T18:36:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:40.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:40 smithi170 ceph-mon[31212]: pgmap v15829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:40.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29510.666773 secs 2024-04-21T18:36:40.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:40 smithi077 ceph-mon[27902]: pgmap v15829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:40.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29510.666773 secs 2024-04-21T18:36:40.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:40 smithi191 ceph-mon[31636]: pgmap v15829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:40.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29510.666773 secs 2024-04-21T18:36:42.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:42 smithi170 ceph-mon[31212]: pgmap v15830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:42.622 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:42 smithi077 ceph-mon[27902]: pgmap v15830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:42.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:42 smithi191 ceph-mon[31636]: pgmap v15830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:43.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29513.908141 secs 2024-04-21T18:36:43.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29513.908141 secs 2024-04-21T18:36:43.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29513.908141 secs 2024-04-21T18:36:44.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:44 smithi170 ceph-mon[31212]: pgmap v15831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:44.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:44 smithi077 ceph-mon[27902]: pgmap v15831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:44.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:44 smithi191 ceph-mon[31636]: pgmap v15831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:45.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:45.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29515.666895 secs 2024-04-21T18:36:45.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29515.666895 secs 2024-04-21T18:36:45.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29515.666895 secs 2024-04-21T18:36:46.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:46 smithi170 ceph-mon[31212]: pgmap v15832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:46.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:46 smithi077 ceph-mon[27902]: pgmap v15832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:46.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:46 smithi191 ceph-mon[31636]: pgmap v15832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:48.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:48 smithi170 ceph-mon[31212]: pgmap v15833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:48.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29518.908251 secs 2024-04-21T18:36:48.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:48 smithi077 ceph-mon[27902]: pgmap v15833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:48.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29518.908251 secs 2024-04-21T18:36:48.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:48 smithi191 ceph-mon[31636]: pgmap v15833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:48.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29518.908251 secs 2024-04-21T18:36:50.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:50.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:50 smithi170 ceph-mon[31212]: pgmap v15834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:50.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29520.666999 secs 2024-04-21T18:36:50.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:50 smithi077 ceph-mon[27902]: pgmap v15834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:50.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29520.666999 secs 2024-04-21T18:36:50.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:50 smithi191 ceph-mon[31636]: pgmap v15834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:50.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29520.666999 secs 2024-04-21T18:36:52.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:52 smithi170 ceph-mon[31212]: pgmap v15835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:52.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:52 smithi077 ceph-mon[27902]: pgmap v15835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:52.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:52 smithi191 ceph-mon[31636]: pgmap v15835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:53.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29523.908386 secs 2024-04-21T18:36:53.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29523.908386 secs 2024-04-21T18:36:53.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29523.908386 secs 2024-04-21T18:36:54.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:54 smithi170 ceph-mon[31212]: pgmap v15836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:54.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:54 smithi077 ceph-mon[27902]: pgmap v15836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:54.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:54 smithi191 ceph-mon[31636]: pgmap v15836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:36:55.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29525.667065 secs 2024-04-21T18:36:55.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29525.667065 secs 2024-04-21T18:36:55.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29525.667065 secs 2024-04-21T18:36:56.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:56 smithi170 ceph-mon[31212]: pgmap v15837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:56.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:56 smithi077 ceph-mon[27902]: pgmap v15837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:56.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:56 smithi191 ceph-mon[31636]: pgmap v15837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:36:58.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:58 smithi170 ceph-mon[31212]: pgmap v15838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:58.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:36:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29528.908515 secs 2024-04-21T18:36:58.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:58 smithi077 ceph-mon[27902]: pgmap v15838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:58.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:36:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29528.908515 secs 2024-04-21T18:36:58.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:58 smithi191 ceph-mon[31636]: pgmap v15838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:36:58.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:36:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29528.908515 secs 2024-04-21T18:37:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:00.505 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:00 smithi191 ceph-mon[31636]: pgmap v15839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:00.505 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29530.667139 secs 2024-04-21T18:37:00.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:00 smithi170 ceph-mon[31212]: pgmap v15839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:00.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29530.667139 secs 2024-04-21T18:37:00.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:00 smithi077 ceph-mon[27902]: pgmap v15839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:00.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29530.667139 secs 2024-04-21T18:37:02.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:02 smithi170 ceph-mon[31212]: pgmap v15840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:02.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:02 smithi077 ceph-mon[27902]: pgmap v15840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:02.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:02 smithi191 ceph-mon[31636]: pgmap v15840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:03.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29533.908643 secs 2024-04-21T18:37:03.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29533.908643 secs 2024-04-21T18:37:03.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29533.908643 secs 2024-04-21T18:37:04.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:04 smithi170 ceph-mon[31212]: pgmap v15841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:04.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:04 smithi077 ceph-mon[27902]: pgmap v15841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:04.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:04 smithi191 ceph-mon[31636]: pgmap v15841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:05.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:05.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29535.667203 secs 2024-04-21T18:37:05.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:05 smithi170 ceph-mon[31212]: osdmap e1062: 12 total, 12 up, 12 in 2024-04-21T18:37:05.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29535.667203 secs 2024-04-21T18:37:05.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:05 smithi077 ceph-mon[27902]: osdmap e1062: 12 total, 12 up, 12 in 2024-04-21T18:37:05.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29535.667203 secs 2024-04-21T18:37:05.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:05 smithi191 ceph-mon[31636]: osdmap e1062: 12 total, 12 up, 12 in 2024-04-21T18:37:06.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:06 smithi170 ceph-mon[31212]: pgmap v15843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:37:06.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:06 smithi077 ceph-mon[27902]: pgmap v15843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:37:06.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:06 smithi191 ceph-mon[31636]: pgmap v15843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:37:08.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:08 smithi170 ceph-mon[31212]: pgmap v15844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:37:08.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29538.908795 secs 2024-04-21T18:37:08.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:08 smithi170 ceph-mon[31212]: osdmap e1063: 12 total, 12 up, 12 in 2024-04-21T18:37:08.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:08 smithi077 ceph-mon[27902]: pgmap v15844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:37:08.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29538.908795 secs 2024-04-21T18:37:08.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:08 smithi077 ceph-mon[27902]: osdmap e1063: 12 total, 12 up, 12 in 2024-04-21T18:37:08.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:08 smithi191 ceph-mon[31636]: pgmap v15844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:37:08.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29538.908795 secs 2024-04-21T18:37:08.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:08 smithi191 ceph-mon[31636]: osdmap e1063: 12 total, 12 up, 12 in 2024-04-21T18:37:10.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:10.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:10 smithi170 ceph-mon[31212]: pgmap v15846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:37:10.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29540.667283 secs 2024-04-21T18:37:10.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:10 smithi077 ceph-mon[27902]: pgmap v15846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:37:10.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29540.667283 secs 2024-04-21T18:37:10.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:10 smithi191 ceph-mon[31636]: pgmap v15846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:37:10.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29540.667283 secs 2024-04-21T18:37:12.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:12 smithi170 ceph-mon[31212]: pgmap v15847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:37:12.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:12 smithi077 ceph-mon[27902]: pgmap v15847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:37:12.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:12 smithi191 ceph-mon[31636]: pgmap v15847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:37:13.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29543.908909 secs 2024-04-21T18:37:13.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29543.908909 secs 2024-04-21T18:37:13.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29543.908909 secs 2024-04-21T18:37:14.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:14 smithi077 ceph-mon[27902]: pgmap v15848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:37:14.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:37:14.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:14 smithi191 ceph-mon[31636]: pgmap v15848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:37:14.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:37:14.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:14 smithi170 ceph-mon[31212]: pgmap v15848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:37:14.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:37:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:15.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29545.667417 secs 2024-04-21T18:37:15.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:37:15.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:37:15.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:37:15.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29545.667417 secs 2024-04-21T18:37:15.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:37:15.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:37:15.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:37:15.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29545.667417 secs 2024-04-21T18:37:15.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:37:15.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:37:15.792 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:37:16.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:16 smithi077 ceph-mon[27902]: pgmap v15849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:37:16.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:16 smithi191 ceph-mon[31636]: pgmap v15849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:37:17.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:16 smithi170 ceph-mon[31212]: pgmap v15849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:37:18.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:18 smithi077 ceph-mon[27902]: pgmap v15850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:37:18.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29548.909000 secs 2024-04-21T18:37:18.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:18 smithi191 ceph-mon[31636]: pgmap v15850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:37:18.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29548.909000 secs 2024-04-21T18:37:19.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:18 smithi170 ceph-mon[31212]: pgmap v15850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:37:19.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29548.909000 secs 2024-04-21T18:37:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:20.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:20 smithi077 ceph-mon[27902]: pgmap v15851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:37:20.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29550.667541 secs 2024-04-21T18:37:20.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:20 smithi191 ceph-mon[31636]: pgmap v15851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:37:20.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29550.667541 secs 2024-04-21T18:37:21.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:20 smithi170 ceph-mon[31212]: pgmap v15851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:37:21.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29550.667541 secs 2024-04-21T18:37:22.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:22 smithi077 ceph-mon[27902]: pgmap v15852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:37:22.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:22 smithi191 ceph-mon[31636]: pgmap v15852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:37:23.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:22 smithi170 ceph-mon[31212]: pgmap v15852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:37:23.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29553.909115 secs 2024-04-21T18:37:23.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29553.909115 secs 2024-04-21T18:37:24.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29553.909115 secs 2024-04-21T18:37:24.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:24 smithi077 ceph-mon[27902]: pgmap v15853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:24.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:24 smithi191 ceph-mon[31636]: pgmap v15853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:25.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:24 smithi170 ceph-mon[31212]: pgmap v15853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:25.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29555.667682 secs 2024-04-21T18:37:25.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29555.667682 secs 2024-04-21T18:37:26.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29555.667682 secs 2024-04-21T18:37:26.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:26 smithi077 ceph-mon[27902]: pgmap v15854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:26.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:26 smithi191 ceph-mon[31636]: pgmap v15854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:27.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:26 smithi170 ceph-mon[31212]: pgmap v15854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:28.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:28 smithi077 ceph-mon[27902]: pgmap v15855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:28.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29558.909230 secs 2024-04-21T18:37:28.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:28 smithi191 ceph-mon[31636]: pgmap v15855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:28.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29558.909230 secs 2024-04-21T18:37:29.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:28 smithi170 ceph-mon[31212]: pgmap v15855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:29.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29558.909230 secs 2024-04-21T18:37:29.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29560.667821 secs 2024-04-21T18:37:29.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29560.667821 secs 2024-04-21T18:37:30.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29560.667821 secs 2024-04-21T18:37:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:30.854 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:30 smithi191 ceph-mon[31636]: pgmap v15856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:30.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:30 smithi077 ceph-mon[27902]: pgmap v15856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:30.943 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:30 smithi170 ceph-mon[31212]: pgmap v15856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:32.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:32 smithi077 ceph-mon[27902]: pgmap v15857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:32.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:32 smithi191 ceph-mon[31636]: pgmap v15857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:33.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:32 smithi170 ceph-mon[31212]: pgmap v15857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:33.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29563.909340 secs 2024-04-21T18:37:33.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29563.909340 secs 2024-04-21T18:37:34.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29563.909340 secs 2024-04-21T18:37:34.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:34 smithi077 ceph-mon[27902]: pgmap v15858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:34.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29565.667942 secs 2024-04-21T18:37:34.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:34 smithi191 ceph-mon[31636]: pgmap v15858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:34.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29565.667942 secs 2024-04-21T18:37:35.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:34 smithi170 ceph-mon[31212]: pgmap v15858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:35.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29565.667942 secs 2024-04-21T18:37:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:36.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:36 smithi077 ceph-mon[27902]: pgmap v15859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:36.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:36 smithi191 ceph-mon[31636]: pgmap v15859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:37.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:36 smithi170 ceph-mon[31212]: pgmap v15859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:38.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:38 smithi077 ceph-mon[27902]: pgmap v15860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:38.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29568.909463 secs 2024-04-21T18:37:38.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:38 smithi191 ceph-mon[31636]: pgmap v15860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:38.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29568.909463 secs 2024-04-21T18:37:39.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:38 smithi170 ceph-mon[31212]: pgmap v15860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:39.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29568.909463 secs 2024-04-21T18:37:39.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29570.668068 secs 2024-04-21T18:37:39.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29570.668068 secs 2024-04-21T18:37:40.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29570.668068 secs 2024-04-21T18:37:40.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:40.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:40 smithi077 ceph-mon[27902]: pgmap v15861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:40.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:40 smithi191 ceph-mon[31636]: pgmap v15861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:41.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:40 smithi170 ceph-mon[31212]: pgmap v15861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:42.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:42 smithi077 ceph-mon[27902]: pgmap v15862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:42.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:42 smithi191 ceph-mon[31636]: pgmap v15862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:43.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:42 smithi170 ceph-mon[31212]: pgmap v15862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:43.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29573.909574 secs 2024-04-21T18:37:44.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29573.909574 secs 2024-04-21T18:37:44.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29573.909574 secs 2024-04-21T18:37:44.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:44 smithi191 ceph-mon[31636]: pgmap v15863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:44.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29575.668204 secs 2024-04-21T18:37:45.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:44 smithi170 ceph-mon[31212]: pgmap v15863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:45.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29575.668204 secs 2024-04-21T18:37:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:45.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:44 smithi077 ceph-mon[27902]: pgmap v15863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:45.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29575.668204 secs 2024-04-21T18:37:46.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:46 smithi191 ceph-mon[31636]: pgmap v15864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:47.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:46 smithi170 ceph-mon[31212]: pgmap v15864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:47.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:46 smithi077 ceph-mon[27902]: pgmap v15864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:48.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:48 smithi191 ceph-mon[31636]: pgmap v15865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:48.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29578.909690 secs 2024-04-21T18:37:49.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:48 smithi170 ceph-mon[31212]: pgmap v15865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:49.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29578.909690 secs 2024-04-21T18:37:49.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:48 smithi077 ceph-mon[27902]: pgmap v15865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:49.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29578.909690 secs 2024-04-21T18:37:49.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29580.668331 secs 2024-04-21T18:37:50.020 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29580.668331 secs 2024-04-21T18:37:50.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29580.668331 secs 2024-04-21T18:37:50.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:50.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:50 smithi191 ceph-mon[31636]: pgmap v15866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:51.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:50 smithi170 ceph-mon[31212]: pgmap v15866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:51.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:50 smithi077 ceph-mon[27902]: pgmap v15866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:52.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:52 smithi191 ceph-mon[31636]: pgmap v15867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:53.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:52 smithi170 ceph-mon[31212]: pgmap v15867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:53.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:52 smithi077 ceph-mon[27902]: pgmap v15867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:53.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29583.909817 secs 2024-04-21T18:37:54.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29583.909817 secs 2024-04-21T18:37:54.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29583.909817 secs 2024-04-21T18:37:54.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:54 smithi191 ceph-mon[31636]: pgmap v15868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:54.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29585.668455 secs 2024-04-21T18:37:55.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:54 smithi170 ceph-mon[31212]: pgmap v15868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:55.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29585.668455 secs 2024-04-21T18:37:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:37:55.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:54 smithi077 ceph-mon[27902]: pgmap v15868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:55.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29585.668455 secs 2024-04-21T18:37:56.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:56 smithi191 ceph-mon[31636]: pgmap v15869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:57.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:56 smithi170 ceph-mon[31212]: pgmap v15869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:57.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:56 smithi077 ceph-mon[27902]: pgmap v15869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:37:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:37:58.446+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:37:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:37:58.446+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:37:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:37:58.447+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:37:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:37:58.447+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:37:58.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:58 smithi191 ceph-mon[31636]: pgmap v15870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:58.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29588.909884 secs 2024-04-21T18:37:59.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:58 smithi170 ceph-mon[31212]: pgmap v15870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:59.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29588.909884 secs 2024-04-21T18:37:59.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:58 smithi077 ceph-mon[27902]: pgmap v15870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:37:59.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29588.909884 secs 2024-04-21T18:37:59.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29590.668550 secs 2024-04-21T18:38:00.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29590.668550 secs 2024-04-21T18:38:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:00.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29590.668550 secs 2024-04-21T18:38:00.942 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:00 smithi170 ceph-mon[31212]: pgmap v15871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:00.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:00 smithi191 ceph-mon[31636]: pgmap v15871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:01.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:00 smithi077 ceph-mon[27902]: pgmap v15871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:02.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:02 smithi191 ceph-mon[31636]: pgmap v15872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T18:38:03.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:02 smithi170 ceph-mon[31212]: pgmap v15872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T18:38:03.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:02 smithi077 ceph-mon[27902]: pgmap v15872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-04-21T18:38:03.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29593.909994 secs 2024-04-21T18:38:04.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29593.909994 secs 2024-04-21T18:38:04.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29593.909994 secs 2024-04-21T18:38:04.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:04 smithi191 ceph-mon[31636]: pgmap v15873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:38:04.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29595.668678 secs 2024-04-21T18:38:05.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:04 smithi170 ceph-mon[31212]: pgmap v15873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:38:05.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29595.668678 secs 2024-04-21T18:38:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:05.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:04 smithi077 ceph-mon[27902]: pgmap v15873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-04-21T18:38:05.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29595.668678 secs 2024-04-21T18:38:05.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:05 smithi191 ceph-mon[31636]: osdmap e1064: 12 total, 12 up, 12 in 2024-04-21T18:38:06.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:05 smithi170 ceph-mon[31212]: osdmap e1064: 12 total, 12 up, 12 in 2024-04-21T18:38:06.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:05 smithi077 ceph-mon[27902]: osdmap e1064: 12 total, 12 up, 12 in 2024-04-21T18:38:06.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:06 smithi191 ceph-mon[31636]: pgmap v15875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-04-21T18:38:07.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:06 smithi170 ceph-mon[31212]: pgmap v15875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-04-21T18:38:07.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:06 smithi077 ceph-mon[27902]: pgmap v15875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-04-21T18:38:07.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:07 smithi191 ceph-mon[31636]: pgmap v15876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:38:08.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:07 smithi170 ceph-mon[31212]: pgmap v15876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:38:08.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:07 smithi077 ceph-mon[27902]: pgmap v15876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:38:08.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29598.910130 secs 2024-04-21T18:38:08.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:08 smithi191 ceph-mon[31636]: osdmap e1065: 12 total, 12 up, 12 in 2024-04-21T18:38:09.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29598.910130 secs 2024-04-21T18:38:09.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:08 smithi170 ceph-mon[31212]: osdmap e1065: 12 total, 12 up, 12 in 2024-04-21T18:38:09.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29598.910130 secs 2024-04-21T18:38:09.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:08 smithi077 ceph-mon[27902]: osdmap e1065: 12 total, 12 up, 12 in 2024-04-21T18:38:09.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:09 smithi191 ceph-mon[31636]: pgmap v15878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T18:38:09.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29600.668802 secs 2024-04-21T18:38:10.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:09 smithi170 ceph-mon[31212]: pgmap v15878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T18:38:10.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29600.668802 secs 2024-04-21T18:38:10.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:10.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:09 smithi077 ceph-mon[27902]: pgmap v15878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-04-21T18:38:10.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29600.668802 secs 2024-04-21T18:38:12.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:11 smithi170 ceph-mon[31212]: pgmap v15879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:38:12.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:11 smithi077 ceph-mon[27902]: pgmap v15879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:38:12.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:11 smithi191 ceph-mon[31636]: pgmap v15879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:38:14.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29603.910202 secs 2024-04-21T18:38:14.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:13 smithi170 ceph-mon[31212]: pgmap v15880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:38:14.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29603.910202 secs 2024-04-21T18:38:14.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:13 smithi077 ceph-mon[27902]: pgmap v15880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:38:14.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29603.910202 secs 2024-04-21T18:38:14.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:13 smithi191 ceph-mon[31636]: pgmap v15880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-21T18:38:15.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29605.668897 secs 2024-04-21T18:38:15.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:38:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:15.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29605.668897 secs 2024-04-21T18:38:15.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:38:15.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29605.668897 secs 2024-04-21T18:38:15.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:38:16.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:15 smithi170 ceph-mon[31212]: pgmap v15881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T18:38:16.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:38:16.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:38:16.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:38:16.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:15 smithi077 ceph-mon[27902]: pgmap v15881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T18:38:16.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:38:16.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:38:16.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:38:16.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:15 smithi191 ceph-mon[31636]: pgmap v15881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T18:38:16.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:38:16.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:38:16.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:38:18.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:17 smithi170 ceph-mon[31212]: pgmap v15882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:38:18.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:17 smithi077 ceph-mon[27902]: pgmap v15882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:38:18.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:17 smithi191 ceph-mon[31636]: pgmap v15882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:38:19.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29608.910279 secs 2024-04-21T18:38:19.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29608.910279 secs 2024-04-21T18:38:19.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29608.910279 secs 2024-04-21T18:38:20.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:19 smithi170 ceph-mon[31212]: pgmap v15883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:38:20.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29610.668965 secs 2024-04-21T18:38:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:20.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:19 smithi077 ceph-mon[27902]: pgmap v15883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:38:20.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29610.668965 secs 2024-04-21T18:38:20.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:19 smithi191 ceph-mon[31636]: pgmap v15883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:38:20.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29610.668965 secs 2024-04-21T18:38:22.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:21 smithi077 ceph-mon[27902]: pgmap v15884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:38:22.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:21 smithi191 ceph-mon[31636]: pgmap v15884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:38:22.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:21 smithi170 ceph-mon[31212]: pgmap v15884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:38:24.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29613.910404 secs 2024-04-21T18:38:24.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:23 smithi077 ceph-mon[27902]: pgmap v15885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:24.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29613.910404 secs 2024-04-21T18:38:24.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:23 smithi191 ceph-mon[31636]: pgmap v15885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:24.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29613.910404 secs 2024-04-21T18:38:24.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:23 smithi170 ceph-mon[31212]: pgmap v15885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:25.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29615.669056 secs 2024-04-21T18:38:25.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29615.669056 secs 2024-04-21T18:38:25.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29615.669056 secs 2024-04-21T18:38:26.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:25 smithi077 ceph-mon[27902]: pgmap v15886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:26.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:25 smithi191 ceph-mon[31636]: pgmap v15886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:26.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:25 smithi170 ceph-mon[31212]: pgmap v15886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:28.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:27 smithi077 ceph-mon[27902]: pgmap v15887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:28.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:27 smithi191 ceph-mon[31636]: pgmap v15887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:28.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:27 smithi170 ceph-mon[31212]: pgmap v15887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:29.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29618.910483 secs 2024-04-21T18:38:29.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29618.910483 secs 2024-04-21T18:38:29.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29618.910483 secs 2024-04-21T18:38:30.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:29 smithi191 ceph-mon[31636]: pgmap v15888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:30.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29620.669209 secs 2024-04-21T18:38:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:30.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:29 smithi077 ceph-mon[27902]: pgmap v15888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:30.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29620.669209 secs 2024-04-21T18:38:30.192 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:29 smithi170 ceph-mon[31212]: pgmap v15888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:30.192 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29620.669209 secs 2024-04-21T18:38:32.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:31 smithi077 ceph-mon[27902]: pgmap v15889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:32.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:31 smithi191 ceph-mon[31636]: pgmap v15889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:32.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:31 smithi170 ceph-mon[31212]: pgmap v15889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:34.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29623.910622 secs 2024-04-21T18:38:34.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:33 smithi077 ceph-mon[27902]: pgmap v15890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:34.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29623.910622 secs 2024-04-21T18:38:34.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:33 smithi191 ceph-mon[31636]: pgmap v15890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:34.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29623.910622 secs 2024-04-21T18:38:34.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:33 smithi170 ceph-mon[31212]: pgmap v15890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:35.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29625.669337 secs 2024-04-21T18:38:35.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29625.669337 secs 2024-04-21T18:38:35.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29625.669337 secs 2024-04-21T18:38:36.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:35 smithi077 ceph-mon[27902]: pgmap v15891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:36.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:35 smithi191 ceph-mon[31636]: pgmap v15891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:36.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:35 smithi170 ceph-mon[31212]: pgmap v15891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:38.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:37 smithi077 ceph-mon[27902]: pgmap v15892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:38.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:37 smithi191 ceph-mon[31636]: pgmap v15892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:38.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:37 smithi170 ceph-mon[31212]: pgmap v15892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:39.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29628.910737 secs 2024-04-21T18:38:39.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29628.910737 secs 2024-04-21T18:38:39.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29628.910737 secs 2024-04-21T18:38:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:40.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:39 smithi077 ceph-mon[27902]: pgmap v15893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:40.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29630.669471 secs 2024-04-21T18:38:40.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:39 smithi191 ceph-mon[31636]: pgmap v15893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:40.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29630.669471 secs 2024-04-21T18:38:40.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:39 smithi170 ceph-mon[31212]: pgmap v15893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:40.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29630.669471 secs 2024-04-21T18:38:42.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:41 smithi077 ceph-mon[27902]: pgmap v15894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:42.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:41 smithi191 ceph-mon[31636]: pgmap v15894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:42.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:41 smithi170 ceph-mon[31212]: pgmap v15894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:44.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29633.910852 secs 2024-04-21T18:38:44.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:43 smithi077 ceph-mon[27902]: pgmap v15895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:44.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29633.910852 secs 2024-04-21T18:38:44.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:43 smithi191 ceph-mon[31636]: pgmap v15895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:44.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29633.910852 secs 2024-04-21T18:38:44.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:43 smithi170 ceph-mon[31212]: pgmap v15895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:45.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29635.669573 secs 2024-04-21T18:38:45.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29635.669573 secs 2024-04-21T18:38:45.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29635.669573 secs 2024-04-21T18:38:46.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:45 smithi077 ceph-mon[27902]: pgmap v15896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:46.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:45 smithi191 ceph-mon[31636]: pgmap v15896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:46.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:45 smithi170 ceph-mon[31212]: pgmap v15896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:48.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:47 smithi077 ceph-mon[27902]: pgmap v15897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:48.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29638.910963 secs 2024-04-21T18:38:48.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:47 smithi191 ceph-mon[31636]: pgmap v15897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:48.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29638.910963 secs 2024-04-21T18:38:48.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:47 smithi170 ceph-mon[31212]: pgmap v15897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:48.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29638.910963 secs 2024-04-21T18:38:50.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:50.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:49 smithi077 ceph-mon[27902]: pgmap v15898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:50.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29640.669702 secs 2024-04-21T18:38:50.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:49 smithi191 ceph-mon[31636]: pgmap v15898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:50.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29640.669702 secs 2024-04-21T18:38:50.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:49 smithi170 ceph-mon[31212]: pgmap v15898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:50.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29640.669702 secs 2024-04-21T18:38:52.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:51 smithi077 ceph-mon[27902]: pgmap v15899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:52.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:51 smithi191 ceph-mon[31636]: pgmap v15899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:52.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:51 smithi170 ceph-mon[31212]: pgmap v15899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:53.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29643.911076 secs 2024-04-21T18:38:53.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29643.911076 secs 2024-04-21T18:38:53.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29643.911076 secs 2024-04-21T18:38:54.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:53 smithi077 ceph-mon[27902]: pgmap v15900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:54.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:53 smithi191 ceph-mon[31636]: pgmap v15900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:54.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:53 smithi170 ceph-mon[31212]: pgmap v15900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:38:55.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29645.669816 secs 2024-04-21T18:38:55.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29645.669816 secs 2024-04-21T18:38:55.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29645.669816 secs 2024-04-21T18:38:56.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:55 smithi191 ceph-mon[31636]: pgmap v15901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:56.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:55 smithi170 ceph-mon[31212]: pgmap v15901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:56.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:55 smithi077 ceph-mon[27902]: pgmap v15901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:38:58.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:57 smithi191 ceph-mon[31636]: pgmap v15902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:58.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29648.911199 secs 2024-04-21T18:38:58.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:57 smithi170 ceph-mon[31212]: pgmap v15902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:58.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29648.911199 secs 2024-04-21T18:38:58.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:57 smithi077 ceph-mon[27902]: pgmap v15902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:38:58.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29648.911199 secs 2024-04-21T18:39:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:00.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:59 smithi191 ceph-mon[31636]: pgmap v15903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:00.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29650.669931 secs 2024-04-21T18:39:00.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:59 smithi170 ceph-mon[31212]: pgmap v15903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:00.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29650.669931 secs 2024-04-21T18:39:00.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:59 smithi077 ceph-mon[27902]: pgmap v15903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:00.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29650.669931 secs 2024-04-21T18:39:02.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:01 smithi191 ceph-mon[31636]: pgmap v15904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:02.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:01 smithi170 ceph-mon[31212]: pgmap v15904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:02.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:01 smithi077 ceph-mon[27902]: pgmap v15904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:03.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29653.911320 secs 2024-04-21T18:39:03.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29653.911320 secs 2024-04-21T18:39:03.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29653.911320 secs 2024-04-21T18:39:04.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:03 smithi191 ceph-mon[31636]: pgmap v15905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:04.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:03 smithi170 ceph-mon[31212]: pgmap v15905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:04.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:03 smithi077 ceph-mon[27902]: pgmap v15905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:05.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:05.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29655.670020 secs 2024-04-21T18:39:05.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:04 smithi191 ceph-mon[31636]: osdmap e1066: 12 total, 12 up, 12 in 2024-04-21T18:39:05.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29655.670020 secs 2024-04-21T18:39:05.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:04 smithi170 ceph-mon[31212]: osdmap e1066: 12 total, 12 up, 12 in 2024-04-21T18:39:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29655.670020 secs 2024-04-21T18:39:05.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:04 smithi077 ceph-mon[27902]: osdmap e1066: 12 total, 12 up, 12 in 2024-04-21T18:39:06.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:05 smithi191 ceph-mon[31636]: pgmap v15907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:39:06.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:05 smithi170 ceph-mon[31212]: pgmap v15907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:39:06.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:05 smithi077 ceph-mon[27902]: pgmap v15907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:39:08.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:07 smithi191 ceph-mon[31636]: pgmap v15908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:39:08.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29658.911436 secs 2024-04-21T18:39:08.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:07 smithi191 ceph-mon[31636]: osdmap e1067: 12 total, 12 up, 12 in 2024-04-21T18:39:08.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:07 smithi170 ceph-mon[31212]: pgmap v15908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:39:08.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29658.911436 secs 2024-04-21T18:39:08.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:07 smithi170 ceph-mon[31212]: osdmap e1067: 12 total, 12 up, 12 in 2024-04-21T18:39:08.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:07 smithi077 ceph-mon[27902]: pgmap v15908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:39:08.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29658.911436 secs 2024-04-21T18:39:08.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:07 smithi077 ceph-mon[27902]: osdmap e1067: 12 total, 12 up, 12 in 2024-04-21T18:39:10.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:10.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:09 smithi191 ceph-mon[31636]: pgmap v15910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:39:10.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29660.670136 secs 2024-04-21T18:39:10.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:09 smithi170 ceph-mon[31212]: pgmap v15910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:39:10.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29660.670136 secs 2024-04-21T18:39:10.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:09 smithi077 ceph-mon[27902]: pgmap v15910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:39:10.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29660.670136 secs 2024-04-21T18:39:12.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:11 smithi191 ceph-mon[31636]: pgmap v15911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:39:12.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:11 smithi170 ceph-mon[31212]: pgmap v15911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:39:12.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:11 smithi077 ceph-mon[27902]: pgmap v15911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:39:13.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29663.911531 secs 2024-04-21T18:39:13.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29663.911531 secs 2024-04-21T18:39:13.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29663.911531 secs 2024-04-21T18:39:14.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:13 smithi191 ceph-mon[31636]: pgmap v15912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:39:14.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:13 smithi170 ceph-mon[31212]: pgmap v15912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:39:14.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:13 smithi077 ceph-mon[27902]: pgmap v15912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:39:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:15.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29665.670256 secs 2024-04-21T18:39:15.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29665.670256 secs 2024-04-21T18:39:15.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29665.670256 secs 2024-04-21T18:39:16.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:15 smithi191 ceph-mon[31636]: pgmap v15913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:39:16.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:39:16.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:15 smithi170 ceph-mon[31212]: pgmap v15913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:39:16.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:39:16.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:15 smithi077 ceph-mon[27902]: pgmap v15913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:39:16.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:39:17.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:39:17.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:39:17.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:39:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:39:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:39:17.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:39:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:39:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:39:17.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:39:18.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:18 smithi077 ceph-mon[27902]: pgmap v15914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:39:18.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29668.911670 secs 2024-04-21T18:39:18.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:18 smithi191 ceph-mon[31636]: pgmap v15914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:39:18.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29668.911670 secs 2024-04-21T18:39:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:18 smithi170 ceph-mon[31212]: pgmap v15914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:39:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29668.911670 secs 2024-04-21T18:39:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:20.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:20 smithi077 ceph-mon[27902]: pgmap v15915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:39:20.369 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29670.670378 secs 2024-04-21T18:39:20.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:20 smithi191 ceph-mon[31636]: pgmap v15915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:39:20.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29670.670378 secs 2024-04-21T18:39:20.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:20 smithi170 ceph-mon[31212]: pgmap v15915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:39:20.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29670.670378 secs 2024-04-21T18:39:22.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:22 smithi191 ceph-mon[31636]: pgmap v15916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:39:22.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:22 smithi170 ceph-mon[31212]: pgmap v15916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:39:22.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:22 smithi077 ceph-mon[27902]: pgmap v15916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:39:23.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29673.911820 secs 2024-04-21T18:39:23.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29673.911820 secs 2024-04-21T18:39:23.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29673.911820 secs 2024-04-21T18:39:24.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:24 smithi191 ceph-mon[31636]: pgmap v15917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:24.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:24 smithi170 ceph-mon[31212]: pgmap v15917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:24.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:24 smithi077 ceph-mon[27902]: pgmap v15917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:25.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29675.670459 secs 2024-04-21T18:39:25.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29675.670459 secs 2024-04-21T18:39:25.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29675.670459 secs 2024-04-21T18:39:26.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:26 smithi191 ceph-mon[31636]: pgmap v15918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:26.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:26 smithi170 ceph-mon[31212]: pgmap v15918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:26.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:26 smithi077 ceph-mon[27902]: pgmap v15918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:28.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:28 smithi191 ceph-mon[31636]: pgmap v15919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:28.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29678.911917 secs 2024-04-21T18:39:28.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:28 smithi170 ceph-mon[31212]: pgmap v15919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:28.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29678.911917 secs 2024-04-21T18:39:28.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:28 smithi077 ceph-mon[27902]: pgmap v15919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:28.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29678.911917 secs 2024-04-21T18:39:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:30.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:30 smithi191 ceph-mon[31636]: pgmap v15920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:30.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29680.670581 secs 2024-04-21T18:39:30.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:30 smithi170 ceph-mon[31212]: pgmap v15920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:30.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29680.670581 secs 2024-04-21T18:39:30.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:30 smithi077 ceph-mon[27902]: pgmap v15920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:30.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29680.670581 secs 2024-04-21T18:39:32.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:32 smithi191 ceph-mon[31636]: pgmap v15921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:32.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:32 smithi170 ceph-mon[31212]: pgmap v15921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:32.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:32 smithi077 ceph-mon[27902]: pgmap v15921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:33.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29683.912028 secs 2024-04-21T18:39:33.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29683.912028 secs 2024-04-21T18:39:33.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29683.912028 secs 2024-04-21T18:39:34.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:34 smithi191 ceph-mon[31636]: pgmap v15922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:34.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:34 smithi170 ceph-mon[31212]: pgmap v15922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:34.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:34 smithi077 ceph-mon[27902]: pgmap v15922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:35.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29685.670654 secs 2024-04-21T18:39:35.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29685.670654 secs 2024-04-21T18:39:35.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29685.670654 secs 2024-04-21T18:39:36.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:36 smithi191 ceph-mon[31636]: pgmap v15923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:36.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:36 smithi170 ceph-mon[31212]: pgmap v15923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:36.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:36 smithi077 ceph-mon[27902]: pgmap v15923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:38.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:38 smithi191 ceph-mon[31636]: pgmap v15924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:38.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29688.912137 secs 2024-04-21T18:39:38.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:38 smithi170 ceph-mon[31212]: pgmap v15924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:38.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29688.912137 secs 2024-04-21T18:39:38.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:38 smithi077 ceph-mon[27902]: pgmap v15924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:38.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29688.912137 secs 2024-04-21T18:39:40.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:40.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:40 smithi191 ceph-mon[31636]: pgmap v15925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:40.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29690.670791 secs 2024-04-21T18:39:40.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:40 smithi170 ceph-mon[31212]: pgmap v15925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:40.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29690.670791 secs 2024-04-21T18:39:40.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:40 smithi077 ceph-mon[27902]: pgmap v15925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:40.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29690.670791 secs 2024-04-21T18:39:42.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:42 smithi191 ceph-mon[31636]: pgmap v15926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:42.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:42 smithi170 ceph-mon[31212]: pgmap v15926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:42.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:42 smithi077 ceph-mon[27902]: pgmap v15926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:43.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29693.912249 secs 2024-04-21T18:39:43.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29693.912249 secs 2024-04-21T18:39:43.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29693.912249 secs 2024-04-21T18:39:44.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:44 smithi191 ceph-mon[31636]: pgmap v15927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:44.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:44 smithi170 ceph-mon[31212]: pgmap v15927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:44.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:44 smithi077 ceph-mon[27902]: pgmap v15927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:45.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29695.670882 secs 2024-04-21T18:39:45.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29695.670882 secs 2024-04-21T18:39:45.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29695.670882 secs 2024-04-21T18:39:46.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:46 smithi191 ceph-mon[31636]: pgmap v15928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:46.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:46 smithi170 ceph-mon[31212]: pgmap v15928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:46.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:46 smithi077 ceph-mon[27902]: pgmap v15928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:48.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:48 smithi191 ceph-mon[31636]: pgmap v15929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:48.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29698.912369 secs 2024-04-21T18:39:48.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:48 smithi170 ceph-mon[31212]: pgmap v15929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:48.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29698.912369 secs 2024-04-21T18:39:48.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:48 smithi077 ceph-mon[27902]: pgmap v15929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:48.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29698.912369 secs 2024-04-21T18:39:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:50.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:50 smithi191 ceph-mon[31636]: pgmap v15930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:50.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29700.670980 secs 2024-04-21T18:39:50.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:50 smithi170 ceph-mon[31212]: pgmap v15930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:50.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29700.670980 secs 2024-04-21T18:39:50.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:50 smithi077 ceph-mon[27902]: pgmap v15930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:50.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29700.670980 secs 2024-04-21T18:39:52.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:52 smithi191 ceph-mon[31636]: pgmap v15931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:52.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:52 smithi170 ceph-mon[31212]: pgmap v15931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:52.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:52 smithi077 ceph-mon[27902]: pgmap v15931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:53.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29703.912483 secs 2024-04-21T18:39:53.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29703.912483 secs 2024-04-21T18:39:53.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29703.912483 secs 2024-04-21T18:39:54.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:54 smithi170 ceph-mon[31212]: pgmap v15932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:54.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:54 smithi077 ceph-mon[27902]: pgmap v15932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:54.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:54 smithi191 ceph-mon[31636]: pgmap v15932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:39:55.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29705.671097 secs 2024-04-21T18:39:55.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29705.671097 secs 2024-04-21T18:39:55.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29705.671097 secs 2024-04-21T18:39:56.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:56 smithi170 ceph-mon[31212]: pgmap v15933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:56.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:56 smithi077 ceph-mon[27902]: pgmap v15933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:56.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:56 smithi191 ceph-mon[31636]: pgmap v15933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:39:58.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:58 smithi170 ceph-mon[31212]: pgmap v15934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:58.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:39:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29708.912594 secs 2024-04-21T18:39:58.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:58 smithi077 ceph-mon[27902]: pgmap v15934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:58.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:39:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29708.912594 secs 2024-04-21T18:39:58.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:58 smithi191 ceph-mon[31636]: pgmap v15934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:39:58.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:39:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29708.912594 secs 2024-04-21T18:40:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:00.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:00 smithi191 ceph-mon[31636]: pgmap v15935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:00.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29710.671189 secs 2024-04-21T18:40:00.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:40:00.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:00 smithi170 ceph-mon[31212]: pgmap v15935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:00.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29710.671189 secs 2024-04-21T18:40:00.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:40:00.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:00 smithi077 ceph-mon[27902]: pgmap v15935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:00.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29710.671189 secs 2024-04-21T18:40:00.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:40:02.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:02 smithi170 ceph-mon[31212]: pgmap v15936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:02.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:02 smithi077 ceph-mon[27902]: pgmap v15936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:02.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:02 smithi191 ceph-mon[31636]: pgmap v15936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:03.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29713.912707 secs 2024-04-21T18:40:03.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29713.912707 secs 2024-04-21T18:40:03.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29713.912707 secs 2024-04-21T18:40:04.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:04 smithi170 ceph-mon[31212]: pgmap v15937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:04.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:04 smithi077 ceph-mon[27902]: pgmap v15937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:04.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:04 smithi191 ceph-mon[31636]: pgmap v15937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:05.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29715.671314 secs 2024-04-21T18:40:05.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:05 smithi170 ceph-mon[31212]: osdmap e1068: 12 total, 12 up, 12 in 2024-04-21T18:40:05.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29715.671314 secs 2024-04-21T18:40:05.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:05 smithi077 ceph-mon[27902]: osdmap e1068: 12 total, 12 up, 12 in 2024-04-21T18:40:05.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29715.671314 secs 2024-04-21T18:40:05.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:05 smithi191 ceph-mon[31636]: osdmap e1068: 12 total, 12 up, 12 in 2024-04-21T18:40:06.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:06 smithi170 ceph-mon[31212]: pgmap v15939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:40:06.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:06 smithi077 ceph-mon[27902]: pgmap v15939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:40:06.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:06 smithi191 ceph-mon[31636]: pgmap v15939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:40:08.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:08 smithi170 ceph-mon[31212]: pgmap v15940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:40:08.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29718.912829 secs 2024-04-21T18:40:08.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:08 smithi170 ceph-mon[31212]: osdmap e1069: 12 total, 12 up, 12 in 2024-04-21T18:40:08.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:08 smithi077 ceph-mon[27902]: pgmap v15940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:40:08.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29718.912829 secs 2024-04-21T18:40:08.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:08 smithi077 ceph-mon[27902]: osdmap e1069: 12 total, 12 up, 12 in 2024-04-21T18:40:08.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:08 smithi191 ceph-mon[31636]: pgmap v15940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:40:08.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29718.912829 secs 2024-04-21T18:40:08.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:08 smithi191 ceph-mon[31636]: osdmap e1069: 12 total, 12 up, 12 in 2024-04-21T18:40:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:10.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:10 smithi170 ceph-mon[31212]: pgmap v15942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:40:10.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29720.671431 secs 2024-04-21T18:40:10.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:10 smithi077 ceph-mon[27902]: pgmap v15942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:40:10.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29720.671431 secs 2024-04-21T18:40:10.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:10 smithi191 ceph-mon[31636]: pgmap v15942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:40:10.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29720.671431 secs 2024-04-21T18:40:12.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:12 smithi170 ceph-mon[31212]: pgmap v15943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:40:12.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:12 smithi077 ceph-mon[27902]: pgmap v15943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:40:12.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:12 smithi191 ceph-mon[31636]: pgmap v15943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:40:13.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29723.912960 secs 2024-04-21T18:40:13.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29723.912960 secs 2024-04-21T18:40:13.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29723.912960 secs 2024-04-21T18:40:14.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:14 smithi170 ceph-mon[31212]: pgmap v15944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T18:40:14.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:14 smithi077 ceph-mon[27902]: pgmap v15944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T18:40:14.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:14 smithi191 ceph-mon[31636]: pgmap v15944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T18:40:15.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:15.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29725.671547 secs 2024-04-21T18:40:15.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29725.671547 secs 2024-04-21T18:40:15.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29725.671547 secs 2024-04-21T18:40:16.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:16 smithi170 ceph-mon[31212]: pgmap v15945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:40:16.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:40:16.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:16 smithi077 ceph-mon[27902]: pgmap v15945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:40:16.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:40:16.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:16 smithi191 ceph-mon[31636]: pgmap v15945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:40:16.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:40:17.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:40:17.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:40:17.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:40:17.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:40:17.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:40:17.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:40:17.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:40:17.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:40:17.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:40:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:18 smithi170 ceph-mon[31212]: pgmap v15946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:40:18.540 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29728.913070 secs 2024-04-21T18:40:18.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:18 smithi077 ceph-mon[27902]: pgmap v15946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:40:18.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29728.913070 secs 2024-04-21T18:40:18.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:18 smithi191 ceph-mon[31636]: pgmap v15946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:40:18.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29728.913070 secs 2024-04-21T18:40:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:20.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:20 smithi077 ceph-mon[27902]: pgmap v15947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:40:20.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29730.671669 secs 2024-04-21T18:40:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:20 smithi191 ceph-mon[31636]: pgmap v15947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:40:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29730.671669 secs 2024-04-21T18:40:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:20 smithi170 ceph-mon[31212]: pgmap v15947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:40:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29730.671669 secs 2024-04-21T18:40:22.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:22 smithi077 ceph-mon[27902]: pgmap v15948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:40:22.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:22 smithi191 ceph-mon[31636]: pgmap v15948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:40:22.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:22 smithi170 ceph-mon[31212]: pgmap v15948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:40:23.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29733.913131 secs 2024-04-21T18:40:23.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29733.913131 secs 2024-04-21T18:40:23.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29733.913131 secs 2024-04-21T18:40:24.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:24 smithi077 ceph-mon[27902]: pgmap v15949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:40:24.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:24 smithi191 ceph-mon[31636]: pgmap v15949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:40:24.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:24 smithi170 ceph-mon[31212]: pgmap v15949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:40:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:25.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29735.671794 secs 2024-04-21T18:40:25.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29735.671794 secs 2024-04-21T18:40:25.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29735.671794 secs 2024-04-21T18:40:26.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:26 smithi077 ceph-mon[27902]: pgmap v15950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:40:26.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:26 smithi191 ceph-mon[31636]: pgmap v15950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:40:26.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:26 smithi170 ceph-mon[31212]: pgmap v15950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:40:28.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:28 smithi077 ceph-mon[27902]: pgmap v15951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:28.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29738.913255 secs 2024-04-21T18:40:28.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:28 smithi191 ceph-mon[31636]: pgmap v15951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:28.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29738.913255 secs 2024-04-21T18:40:28.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:28 smithi170 ceph-mon[31212]: pgmap v15951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:28.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29738.913255 secs 2024-04-21T18:40:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:30.591 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:30 smithi170 ceph-mon[31212]: pgmap v15952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:30.591 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29740.671914 secs 2024-04-21T18:40:30.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:30 smithi077 ceph-mon[27902]: pgmap v15952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:30.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29740.671914 secs 2024-04-21T18:40:30.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:30 smithi191 ceph-mon[31636]: pgmap v15952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:30.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29740.671914 secs 2024-04-21T18:40:32.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:32 smithi077 ceph-mon[27902]: pgmap v15953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:32.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:32 smithi191 ceph-mon[31636]: pgmap v15953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:32.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:32 smithi170 ceph-mon[31212]: pgmap v15953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:33.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29743.913391 secs 2024-04-21T18:40:33.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29743.913391 secs 2024-04-21T18:40:33.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29743.913391 secs 2024-04-21T18:40:34.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:34 smithi077 ceph-mon[27902]: pgmap v15954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:34.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:34 smithi191 ceph-mon[31636]: pgmap v15954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:34.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:34 smithi170 ceph-mon[31212]: pgmap v15954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:35.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:35.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29745.671989 secs 2024-04-21T18:40:35.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29745.671989 secs 2024-04-21T18:40:35.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29745.671989 secs 2024-04-21T18:40:36.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:36 smithi077 ceph-mon[27902]: pgmap v15955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:36.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:36 smithi191 ceph-mon[31636]: pgmap v15955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:36.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:36 smithi170 ceph-mon[31212]: pgmap v15955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:38.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:38 smithi077 ceph-mon[27902]: pgmap v15956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:38.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29748.913513 secs 2024-04-21T18:40:38.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:38 smithi191 ceph-mon[31636]: pgmap v15956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:38.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29748.913513 secs 2024-04-21T18:40:38.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:38 smithi170 ceph-mon[31212]: pgmap v15956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:38.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29748.913513 secs 2024-04-21T18:40:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:40.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:40 smithi077 ceph-mon[27902]: pgmap v15957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:40.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29750.672106 secs 2024-04-21T18:40:40.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:40 smithi191 ceph-mon[31636]: pgmap v15957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:40.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29750.672106 secs 2024-04-21T18:40:40.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:40 smithi170 ceph-mon[31212]: pgmap v15957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:40.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29750.672106 secs 2024-04-21T18:40:42.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:42 smithi077 ceph-mon[27902]: pgmap v15958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:42.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:42 smithi191 ceph-mon[31636]: pgmap v15958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:42.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:42 smithi170 ceph-mon[31212]: pgmap v15958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:43.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29753.913626 secs 2024-04-21T18:40:43.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29753.913626 secs 2024-04-21T18:40:43.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29753.913626 secs 2024-04-21T18:40:44.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:44 smithi077 ceph-mon[27902]: pgmap v15959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:44.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:44 smithi191 ceph-mon[31636]: pgmap v15959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:44.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:44 smithi170 ceph-mon[31212]: pgmap v15959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:45.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29755.672223 secs 2024-04-21T18:40:45.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29755.672223 secs 2024-04-21T18:40:45.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29755.672223 secs 2024-04-21T18:40:46.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:46 smithi077 ceph-mon[27902]: pgmap v15960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:46.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:46 smithi191 ceph-mon[31636]: pgmap v15960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:46.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:46 smithi170 ceph-mon[31212]: pgmap v15960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:48.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:48 smithi077 ceph-mon[27902]: pgmap v15961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:48.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29758.913741 secs 2024-04-21T18:40:48.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:48 smithi191 ceph-mon[31636]: pgmap v15961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:48.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29758.913741 secs 2024-04-21T18:40:48.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:48 smithi170 ceph-mon[31212]: pgmap v15961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:48.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29758.913741 secs 2024-04-21T18:40:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:50.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:50 smithi077 ceph-mon[27902]: pgmap v15962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:50.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29760.672315 secs 2024-04-21T18:40:50.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:50 smithi191 ceph-mon[31636]: pgmap v15962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:50.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29760.672315 secs 2024-04-21T18:40:50.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:50 smithi170 ceph-mon[31212]: pgmap v15962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:50.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29760.672315 secs 2024-04-21T18:40:52.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:52 smithi191 ceph-mon[31636]: pgmap v15963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:52.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:52 smithi170 ceph-mon[31212]: pgmap v15963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:52.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:52 smithi077 ceph-mon[27902]: pgmap v15963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:53.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29763.913819 secs 2024-04-21T18:40:53.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29763.913819 secs 2024-04-21T18:40:53.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29763.913819 secs 2024-04-21T18:40:54.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:54 smithi191 ceph-mon[31636]: pgmap v15964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:54.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:54 smithi170 ceph-mon[31212]: pgmap v15964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:54.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:54 smithi077 ceph-mon[27902]: pgmap v15964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:55.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:40:55.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29765.672453 secs 2024-04-21T18:40:55.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29765.672453 secs 2024-04-21T18:40:55.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29765.672453 secs 2024-04-21T18:40:56.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:56 smithi191 ceph-mon[31636]: pgmap v15965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:56.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:56 smithi170 ceph-mon[31212]: pgmap v15965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:56.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:56 smithi077 ceph-mon[27902]: pgmap v15965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:40:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:40:58.472+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:40:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:40:58.472+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:40:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:40:58.472+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:40:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:40:58.472+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:40:58.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:58 smithi191 ceph-mon[31636]: pgmap v15966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:58.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:40:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29768.913936 secs 2024-04-21T18:40:58.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:58 smithi170 ceph-mon[31212]: pgmap v15966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:58.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:40:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29768.913936 secs 2024-04-21T18:40:58.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:58 smithi077 ceph-mon[27902]: pgmap v15966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:40:58.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:40:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29768.913936 secs 2024-04-21T18:41:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:00.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:00 smithi191 ceph-mon[31636]: pgmap v15967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:00.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29770.672593 secs 2024-04-21T18:41:00.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:00 smithi170 ceph-mon[31212]: pgmap v15967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:00.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29770.672593 secs 2024-04-21T18:41:00.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:00 smithi077 ceph-mon[27902]: pgmap v15967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:00.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29770.672593 secs 2024-04-21T18:41:02.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:02 smithi191 ceph-mon[31636]: pgmap v15968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:02.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:02 smithi170 ceph-mon[31212]: pgmap v15968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:02.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:02 smithi077 ceph-mon[27902]: pgmap v15968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:03.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29773.914051 secs 2024-04-21T18:41:03.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29773.914051 secs 2024-04-21T18:41:03.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29773.914051 secs 2024-04-21T18:41:04.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:04 smithi191 ceph-mon[31636]: pgmap v15969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:04.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:04 smithi170 ceph-mon[31212]: pgmap v15969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:04.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:04 smithi077 ceph-mon[27902]: pgmap v15969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:05.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29775.672727 secs 2024-04-21T18:41:05.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:05 smithi191 ceph-mon[31636]: osdmap e1070: 12 total, 12 up, 12 in 2024-04-21T18:41:05.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29775.672727 secs 2024-04-21T18:41:05.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:05 smithi170 ceph-mon[31212]: osdmap e1070: 12 total, 12 up, 12 in 2024-04-21T18:41:05.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29775.672727 secs 2024-04-21T18:41:05.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:05 smithi077 ceph-mon[27902]: osdmap e1070: 12 total, 12 up, 12 in 2024-04-21T18:41:06.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:06 smithi191 ceph-mon[31636]: pgmap v15971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:41:06.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:06 smithi170 ceph-mon[31212]: pgmap v15971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:41:06.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:06 smithi077 ceph-mon[27902]: pgmap v15971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:41:08.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:08 smithi191 ceph-mon[31636]: pgmap v15972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:41:08.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29778.914202 secs 2024-04-21T18:41:08.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:08 smithi191 ceph-mon[31636]: osdmap e1071: 12 total, 12 up, 12 in 2024-04-21T18:41:08.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:08 smithi170 ceph-mon[31212]: pgmap v15972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:41:08.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29778.914202 secs 2024-04-21T18:41:08.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:08 smithi170 ceph-mon[31212]: osdmap e1071: 12 total, 12 up, 12 in 2024-04-21T18:41:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:08 smithi077 ceph-mon[27902]: pgmap v15972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:41:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29778.914202 secs 2024-04-21T18:41:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:08 smithi077 ceph-mon[27902]: osdmap e1071: 12 total, 12 up, 12 in 2024-04-21T18:41:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:10.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:10 smithi191 ceph-mon[31636]: pgmap v15974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:41:10.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29780.672844 secs 2024-04-21T18:41:10.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:10 smithi170 ceph-mon[31212]: pgmap v15974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:41:10.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29780.672844 secs 2024-04-21T18:41:10.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:10 smithi077 ceph-mon[27902]: pgmap v15974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:41:10.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29780.672844 secs 2024-04-21T18:41:12.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:12 smithi191 ceph-mon[31636]: pgmap v15975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:41:12.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:12 smithi170 ceph-mon[31212]: pgmap v15975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:41:12.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:12 smithi077 ceph-mon[27902]: pgmap v15975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:41:13.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29783.914334 secs 2024-04-21T18:41:13.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29783.914334 secs 2024-04-21T18:41:13.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29783.914334 secs 2024-04-21T18:41:14.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:14 smithi191 ceph-mon[31636]: pgmap v15976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T18:41:14.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:14 smithi170 ceph-mon[31212]: pgmap v15976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T18:41:14.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:14 smithi077 ceph-mon[27902]: pgmap v15976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T18:41:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:15.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29785.672908 secs 2024-04-21T18:41:15.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29785.672908 secs 2024-04-21T18:41:15.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29785.672908 secs 2024-04-21T18:41:16.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:16 smithi191 ceph-mon[31636]: pgmap v15977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:41:16.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:16 smithi170 ceph-mon[31212]: pgmap v15977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:41:16.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:16 smithi077 ceph-mon[27902]: pgmap v15977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:41:17.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:41:17.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:41:17.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:41:18.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:18 smithi191 ceph-mon[31636]: pgmap v15978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T18:41:18.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29788.914406 secs 2024-04-21T18:41:18.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:41:18.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:41:18.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:41:18.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:18 smithi170 ceph-mon[31212]: pgmap v15978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T18:41:18.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29788.914406 secs 2024-04-21T18:41:18.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:41:18.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:41:18.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:41:18.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:18 smithi077 ceph-mon[27902]: pgmap v15978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T18:41:18.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29788.914406 secs 2024-04-21T18:41:18.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:41:18.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:41:18.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:41:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:20.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:20 smithi170 ceph-mon[31212]: pgmap v15979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:41:20.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29790.673030 secs 2024-04-21T18:41:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:20 smithi077 ceph-mon[27902]: pgmap v15979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:41:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29790.673030 secs 2024-04-21T18:41:20.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:20 smithi191 ceph-mon[31636]: pgmap v15979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:41:20.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29790.673030 secs 2024-04-21T18:41:22.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:22 smithi170 ceph-mon[31212]: pgmap v15980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:41:22.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:22 smithi077 ceph-mon[27902]: pgmap v15980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:41:22.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:22 smithi191 ceph-mon[31636]: pgmap v15980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:41:23.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29793.914523 secs 2024-04-21T18:41:23.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29793.914523 secs 2024-04-21T18:41:23.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29793.914523 secs 2024-04-21T18:41:24.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:24 smithi170 ceph-mon[31212]: pgmap v15981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:41:24.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:24 smithi077 ceph-mon[27902]: pgmap v15981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:41:24.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:24 smithi191 ceph-mon[31636]: pgmap v15981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:41:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:25.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29795.673147 secs 2024-04-21T18:41:25.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29795.673147 secs 2024-04-21T18:41:25.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29795.673147 secs 2024-04-21T18:41:26.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:26 smithi170 ceph-mon[31212]: pgmap v15982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:41:26.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:26 smithi077 ceph-mon[27902]: pgmap v15982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:41:26.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:26 smithi191 ceph-mon[31636]: pgmap v15982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:41:28.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:28 smithi170 ceph-mon[31212]: pgmap v15983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:41:28.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29798.914657 secs 2024-04-21T18:41:28.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:28 smithi077 ceph-mon[27902]: pgmap v15983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:41:28.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29798.914657 secs 2024-04-21T18:41:28.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:28 smithi191 ceph-mon[31636]: pgmap v15983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:41:28.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29798.914657 secs 2024-04-21T18:41:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:30.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:30 smithi191 ceph-mon[31636]: pgmap v15984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:30.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29800.673262 secs 2024-04-21T18:41:30.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:30 smithi170 ceph-mon[31212]: pgmap v15984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:30.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29800.673262 secs 2024-04-21T18:41:30.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:30 smithi077 ceph-mon[27902]: pgmap v15984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:30.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29800.673262 secs 2024-04-21T18:41:32.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:32 smithi170 ceph-mon[31212]: pgmap v15985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:32.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:32 smithi077 ceph-mon[27902]: pgmap v15985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:32.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:32 smithi191 ceph-mon[31636]: pgmap v15985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:33.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29803.914806 secs 2024-04-21T18:41:33.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29803.914806 secs 2024-04-21T18:41:33.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29803.914806 secs 2024-04-21T18:41:34.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:34 smithi170 ceph-mon[31212]: pgmap v15986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:34.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:34 smithi077 ceph-mon[27902]: pgmap v15986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:34.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:34 smithi191 ceph-mon[31636]: pgmap v15986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:35.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29805.673378 secs 2024-04-21T18:41:35.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29805.673378 secs 2024-04-21T18:41:35.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29805.673378 secs 2024-04-21T18:41:36.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:36 smithi170 ceph-mon[31212]: pgmap v15987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:36.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:36 smithi077 ceph-mon[27902]: pgmap v15987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:36.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:36 smithi191 ceph-mon[31636]: pgmap v15987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:38.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:38 smithi170 ceph-mon[31212]: pgmap v15988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:38.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29808.914829 secs 2024-04-21T18:41:38.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:38 smithi077 ceph-mon[27902]: pgmap v15988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:38.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29808.914829 secs 2024-04-21T18:41:38.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:38 smithi191 ceph-mon[31636]: pgmap v15988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:38.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29808.914829 secs 2024-04-21T18:41:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 29995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:40.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:40 smithi170 ceph-mon[31212]: pgmap v15989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:40.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29810.673493 secs 2024-04-21T18:41:40.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:40 smithi077 ceph-mon[27902]: pgmap v15989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:40.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29810.673493 secs 2024-04-21T18:41:40.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:40 smithi191 ceph-mon[31636]: pgmap v15989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:40.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29810.673493 secs 2024-04-21T18:41:42.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:42 smithi170 ceph-mon[31212]: pgmap v15990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:42.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:42 smithi077 ceph-mon[27902]: pgmap v15990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:42.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:42 smithi191 ceph-mon[31636]: pgmap v15990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:43.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29813.914889 secs 2024-04-21T18:41:43.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29813.914889 secs 2024-04-21T18:41:43.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29813.914889 secs 2024-04-21T18:41:44.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:44 smithi170 ceph-mon[31212]: pgmap v15991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:44.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:44 smithi077 ceph-mon[27902]: pgmap v15991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:44.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:44 smithi191 ceph-mon[31636]: pgmap v15991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:45.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29815.673609 secs 2024-04-21T18:41:45.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29815.673609 secs 2024-04-21T18:41:45.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29815.673609 secs 2024-04-21T18:41:46.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:46 smithi170 ceph-mon[31212]: pgmap v15992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:46.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:46 smithi077 ceph-mon[27902]: pgmap v15992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:46.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:46 smithi191 ceph-mon[31636]: pgmap v15992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:48.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:48 smithi170 ceph-mon[31212]: pgmap v15993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:48.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29818.915004 secs 2024-04-21T18:41:48.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:48 smithi077 ceph-mon[27902]: pgmap v15993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:48.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29818.915004 secs 2024-04-21T18:41:48.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:48 smithi191 ceph-mon[31636]: pgmap v15993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:48.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29818.915004 secs 2024-04-21T18:41:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:50.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:50 smithi170 ceph-mon[31212]: pgmap v15994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:50.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29820.673743 secs 2024-04-21T18:41:50.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:50 smithi077 ceph-mon[27902]: pgmap v15994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:50.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29820.673743 secs 2024-04-21T18:41:50.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:50 smithi191 ceph-mon[31636]: pgmap v15994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:50.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29820.673743 secs 2024-04-21T18:41:52.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:52 smithi170 ceph-mon[31212]: pgmap v15995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:52.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:52 smithi077 ceph-mon[27902]: pgmap v15995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:52.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:52 smithi191 ceph-mon[31636]: pgmap v15995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:53.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29823.915118 secs 2024-04-21T18:41:53.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29823.915118 secs 2024-04-21T18:41:54.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29823.915118 secs 2024-04-21T18:41:54.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:54 smithi077 ceph-mon[27902]: pgmap v15996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:54.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:54 smithi191 ceph-mon[31636]: pgmap v15996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:55.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:54 smithi170 ceph-mon[31212]: pgmap v15996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:55.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:41:55.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29825.673878 secs 2024-04-21T18:41:55.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29825.673878 secs 2024-04-21T18:41:56.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29825.673878 secs 2024-04-21T18:41:56.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:56 smithi077 ceph-mon[27902]: pgmap v15997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:56.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:56 smithi191 ceph-mon[31636]: pgmap v15997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:57.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:56 smithi170 ceph-mon[31212]: pgmap v15997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:41:58.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:58 smithi077 ceph-mon[27902]: pgmap v15998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:58.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:41:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29828.915205 secs 2024-04-21T18:41:58.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:58 smithi191 ceph-mon[31636]: pgmap v15998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:58.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:41:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29828.915205 secs 2024-04-21T18:41:59.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:58 smithi170 ceph-mon[31212]: pgmap v15998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:41:59.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:41:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29828.915205 secs 2024-04-21T18:42:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:00.841 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:00 smithi170 ceph-mon[31212]: pgmap v15999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:00.842 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29830.673985 secs 2024-04-21T18:42:00.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:00 smithi077 ceph-mon[27902]: pgmap v15999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:00.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29830.673985 secs 2024-04-21T18:42:00.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:00 smithi191 ceph-mon[31636]: pgmap v15999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:00.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29830.673985 secs 2024-04-21T18:42:02.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:02 smithi077 ceph-mon[27902]: pgmap v16000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:02.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:02 smithi191 ceph-mon[31636]: pgmap v16000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:03.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:02 smithi170 ceph-mon[31212]: pgmap v16000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:03.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29833.915339 secs 2024-04-21T18:42:03.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29833.915339 secs 2024-04-21T18:42:04.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29833.915339 secs 2024-04-21T18:42:04.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:04 smithi077 ceph-mon[27902]: pgmap v16001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:04.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:04 smithi191 ceph-mon[31636]: pgmap v16001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:05.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:04 smithi170 ceph-mon[31212]: pgmap v16001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:05.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29835.674067 secs 2024-04-21T18:42:05.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:05 smithi077 ceph-mon[27902]: osdmap e1072: 12 total, 12 up, 12 in 2024-04-21T18:42:05.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29835.674067 secs 2024-04-21T18:42:05.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:05 smithi191 ceph-mon[31636]: osdmap e1072: 12 total, 12 up, 12 in 2024-04-21T18:42:06.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29835.674067 secs 2024-04-21T18:42:06.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:05 smithi170 ceph-mon[31212]: osdmap e1072: 12 total, 12 up, 12 in 2024-04-21T18:42:06.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:06 smithi077 ceph-mon[27902]: pgmap v16003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:06.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:06 smithi191 ceph-mon[31636]: pgmap v16003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:07.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:06 smithi170 ceph-mon[31212]: pgmap v16003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:08 smithi077 ceph-mon[27902]: pgmap v16004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:42:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29838.915434 secs 2024-04-21T18:42:08.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:08 smithi191 ceph-mon[31636]: pgmap v16004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:42:08.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29838.915434 secs 2024-04-21T18:42:09.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:08 smithi170 ceph-mon[31212]: pgmap v16004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:42:09.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29838.915434 secs 2024-04-21T18:42:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:10.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:10 smithi077 ceph-mon[27902]: pgmap v16005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:42:10.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29840.674158 secs 2024-04-21T18:42:10.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:10 smithi191 ceph-mon[31636]: pgmap v16005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:42:10.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29840.674158 secs 2024-04-21T18:42:11.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:10 smithi170 ceph-mon[31212]: pgmap v16005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:42:11.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29840.674158 secs 2024-04-21T18:42:12.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:12 smithi077 ceph-mon[27902]: pgmap v16006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:12.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:12 smithi191 ceph-mon[31636]: pgmap v16006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:13.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:12 smithi170 ceph-mon[31212]: pgmap v16006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:13.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29843.915554 secs 2024-04-21T18:42:13.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:13 smithi077 ceph-mon[27902]: osdmap e1073: 12 total, 12 up, 12 in 2024-04-21T18:42:13.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29843.915554 secs 2024-04-21T18:42:13.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:13 smithi191 ceph-mon[31636]: osdmap e1073: 12 total, 12 up, 12 in 2024-04-21T18:42:14.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29843.915554 secs 2024-04-21T18:42:14.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:13 smithi170 ceph-mon[31212]: osdmap e1073: 12 total, 12 up, 12 in 2024-04-21T18:42:14.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:14 smithi077 ceph-mon[27902]: pgmap v16007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:14.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:14 smithi191 ceph-mon[31636]: pgmap v16007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:15.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:14 smithi170 ceph-mon[31212]: pgmap v16007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:15.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29845.674227 secs 2024-04-21T18:42:15.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29845.674227 secs 2024-04-21T18:42:16.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29845.674227 secs 2024-04-21T18:42:16.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:16 smithi077 ceph-mon[27902]: pgmap v16009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:16.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:16 smithi191 ceph-mon[31636]: pgmap v16009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:17.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:16 smithi170 ceph-mon[31212]: pgmap v16009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:42:18.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:18 smithi077 ceph-mon[27902]: pgmap v16010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:42:18.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29848.915688 secs 2024-04-21T18:42:18.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:42:18.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:18 smithi191 ceph-mon[31636]: pgmap v16010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:42:18.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29848.915688 secs 2024-04-21T18:42:18.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:42:18.953 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:18 smithi170 ceph-mon[31212]: pgmap v16010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:42:18.953 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29848.915688 secs 2024-04-21T18:42:18.953 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:42:20.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: pgmap v16011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29850.674304 secs 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.702 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:42:20.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:42:20.703 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: pgmap v16011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:42:20.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29850.674304 secs 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:42:20.791 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: pgmap v16011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:42:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29850.674304 secs 2024-04-21T18:42:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:42:20.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:42:20.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:42:20.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:42:21.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:42:21.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:42:21.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:42:21.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:42:21.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:42:21.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:42:21.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:42:21.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:42:21.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:42:21.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:42:21.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:42:21.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:42:21.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:42:21.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:42:21.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:42:21.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:42:21.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:42:21.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:42:22.769 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:22 smithi077 ceph-mon[27902]: pgmap v16012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:22.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:22 smithi170 ceph-mon[31212]: pgmap v16012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:22.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:22 smithi191 ceph-mon[31636]: pgmap v16012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:23.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29853.915846 secs 2024-04-21T18:42:23.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29853.915846 secs 2024-04-21T18:42:23.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29853.915846 secs 2024-04-21T18:42:24.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:24 smithi170 ceph-mon[31212]: pgmap v16013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:24.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:24 smithi077 ceph-mon[27902]: pgmap v16013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:24.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:24 smithi191 ceph-mon[31636]: pgmap v16013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:42:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:25.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29855.674452 secs 2024-04-21T18:42:25.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29855.674452 secs 2024-04-21T18:42:25.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29855.674452 secs 2024-04-21T18:42:26.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:26 smithi170 ceph-mon[31212]: pgmap v16014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:42:26.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:26 smithi077 ceph-mon[27902]: pgmap v16014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:42:26.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:26 smithi191 ceph-mon[31636]: pgmap v16014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:42:28.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:28 smithi170 ceph-mon[31212]: pgmap v16015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:28.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29858.915947 secs 2024-04-21T18:42:28.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:28 smithi077 ceph-mon[27902]: pgmap v16015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:28.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29858.915947 secs 2024-04-21T18:42:28.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:28 smithi191 ceph-mon[31636]: pgmap v16015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:28.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29858.915947 secs 2024-04-21T18:42:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:30.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:30 smithi191 ceph-mon[31636]: pgmap v16016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:30.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29860.674569 secs 2024-04-21T18:42:30.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:30 smithi170 ceph-mon[31212]: pgmap v16016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:30.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29860.674569 secs 2024-04-21T18:42:30.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:30 smithi077 ceph-mon[27902]: pgmap v16016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:30.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29860.674569 secs 2024-04-21T18:42:32.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:32 smithi170 ceph-mon[31212]: pgmap v16017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:32.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:32 smithi077 ceph-mon[27902]: pgmap v16017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:32.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:32 smithi191 ceph-mon[31636]: pgmap v16017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:33.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29863.916054 secs 2024-04-21T18:42:33.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29863.916054 secs 2024-04-21T18:42:33.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29863.916054 secs 2024-04-21T18:42:34.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:34 smithi170 ceph-mon[31212]: pgmap v16018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:34.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:34 smithi077 ceph-mon[27902]: pgmap v16018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:34.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:34 smithi191 ceph-mon[31636]: pgmap v16018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:35.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29865.674699 secs 2024-04-21T18:42:35.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29865.674699 secs 2024-04-21T18:42:35.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29865.674699 secs 2024-04-21T18:42:36.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:36 smithi170 ceph-mon[31212]: pgmap v16019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:36.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:36 smithi077 ceph-mon[27902]: pgmap v16019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:36.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:36 smithi191 ceph-mon[31636]: pgmap v16019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:38.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:38 smithi170 ceph-mon[31212]: pgmap v16020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:38.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29868.916149 secs 2024-04-21T18:42:38.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:38 smithi077 ceph-mon[27902]: pgmap v16020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:38.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29868.916149 secs 2024-04-21T18:42:38.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:38 smithi191 ceph-mon[31636]: pgmap v16020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:38.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29868.916149 secs 2024-04-21T18:42:40.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:40.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29870.674813 secs 2024-04-21T18:42:40.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:40 smithi170 ceph-mon[31212]: pgmap v16021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:40.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29870.674813 secs 2024-04-21T18:42:40.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:40 smithi077 ceph-mon[27902]: pgmap v16021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:40.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29870.674813 secs 2024-04-21T18:42:40.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:40 smithi191 ceph-mon[31636]: pgmap v16021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:42.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:42 smithi170 ceph-mon[31212]: pgmap v16022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:42.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:42 smithi077 ceph-mon[27902]: pgmap v16022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:42.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:42 smithi191 ceph-mon[31636]: pgmap v16022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:43.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29873.916263 secs 2024-04-21T18:42:43.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29873.916263 secs 2024-04-21T18:42:43.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29873.916263 secs 2024-04-21T18:42:44.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:44 smithi170 ceph-mon[31212]: pgmap v16023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:44.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:44 smithi077 ceph-mon[27902]: pgmap v16023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:44.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:44 smithi191 ceph-mon[31636]: pgmap v16023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:45.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29875.674922 secs 2024-04-21T18:42:45.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29875.674922 secs 2024-04-21T18:42:45.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29875.674922 secs 2024-04-21T18:42:46.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:46 smithi170 ceph-mon[31212]: pgmap v16024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:46.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:46 smithi077 ceph-mon[27902]: pgmap v16024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:46.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:46 smithi191 ceph-mon[31636]: pgmap v16024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:48.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:48 smithi170 ceph-mon[31212]: pgmap v16025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:48.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29878.916375 secs 2024-04-21T18:42:48.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:48 smithi077 ceph-mon[27902]: pgmap v16025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:48.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29878.916375 secs 2024-04-21T18:42:48.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:48 smithi191 ceph-mon[31636]: pgmap v16025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:48.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29878.916375 secs 2024-04-21T18:42:50.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:50.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29880.674984 secs 2024-04-21T18:42:50.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:50 smithi170 ceph-mon[31212]: pgmap v16026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:50.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29880.674984 secs 2024-04-21T18:42:50.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:50 smithi077 ceph-mon[27902]: pgmap v16026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:50.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29880.674984 secs 2024-04-21T18:42:50.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:50 smithi191 ceph-mon[31636]: pgmap v16026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:52.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:52 smithi170 ceph-mon[31212]: pgmap v16027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:52.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:52 smithi077 ceph-mon[27902]: pgmap v16027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:52.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:52 smithi191 ceph-mon[31636]: pgmap v16027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:53.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29883.916490 secs 2024-04-21T18:42:53.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29883.916490 secs 2024-04-21T18:42:54.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29883.916490 secs 2024-04-21T18:42:54.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:54 smithi077 ceph-mon[27902]: pgmap v16028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:54.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:54 smithi191 ceph-mon[31636]: pgmap v16028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:55.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:54 smithi170 ceph-mon[31212]: pgmap v16028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:42:55.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29885.675076 secs 2024-04-21T18:42:55.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29885.675076 secs 2024-04-21T18:42:56.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29885.675076 secs 2024-04-21T18:42:56.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:56 smithi077 ceph-mon[27902]: pgmap v16029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:56.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:56 smithi191 ceph-mon[31636]: pgmap v16029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:57.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:56 smithi170 ceph-mon[31212]: pgmap v16029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:42:58.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:58 smithi077 ceph-mon[27902]: pgmap v16030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:58.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:42:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29888.916610 secs 2024-04-21T18:42:58.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:58 smithi191 ceph-mon[31636]: pgmap v16030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:58.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:42:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29888.916610 secs 2024-04-21T18:42:59.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:58 smithi170 ceph-mon[31212]: pgmap v16030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:42:59.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:42:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29888.916610 secs 2024-04-21T18:43:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:00.841 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29890.675187 secs 2024-04-21T18:43:00.841 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:00 smithi170 ceph-mon[31212]: pgmap v16031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:00.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29890.675187 secs 2024-04-21T18:43:00.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:00 smithi077 ceph-mon[27902]: pgmap v16031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:00.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29890.675187 secs 2024-04-21T18:43:00.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:00 smithi191 ceph-mon[31636]: pgmap v16031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:02.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:02 smithi077 ceph-mon[27902]: pgmap v16032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:02.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:02 smithi191 ceph-mon[31636]: pgmap v16032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:03.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:02 smithi170 ceph-mon[31212]: pgmap v16032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:03.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29893.916732 secs 2024-04-21T18:43:03.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29893.916732 secs 2024-04-21T18:43:04.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29893.916732 secs 2024-04-21T18:43:04.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:04 smithi077 ceph-mon[27902]: pgmap v16033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:04.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:04 smithi191 ceph-mon[31636]: pgmap v16033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:05.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:04 smithi170 ceph-mon[31212]: pgmap v16033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:05.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29895.675311 secs 2024-04-21T18:43:05.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:05 smithi077 ceph-mon[27902]: osdmap e1074: 12 total, 12 up, 12 in 2024-04-21T18:43:05.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29895.675311 secs 2024-04-21T18:43:05.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:05 smithi191 ceph-mon[31636]: osdmap e1074: 12 total, 12 up, 12 in 2024-04-21T18:43:06.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29895.675311 secs 2024-04-21T18:43:06.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:05 smithi170 ceph-mon[31212]: osdmap e1074: 12 total, 12 up, 12 in 2024-04-21T18:43:06.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:06 smithi077 ceph-mon[27902]: pgmap v16035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:06.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:06 smithi191 ceph-mon[31636]: pgmap v16035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:07.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:06 smithi170 ceph-mon[31212]: pgmap v16035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:08.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:08 smithi077 ceph-mon[27902]: pgmap v16036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:08.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29898.916866 secs 2024-04-21T18:43:08.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:08 smithi191 ceph-mon[31636]: pgmap v16036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:08.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29898.916866 secs 2024-04-21T18:43:09.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:08 smithi170 ceph-mon[31212]: pgmap v16036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:09.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29898.916866 secs 2024-04-21T18:43:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:10.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29900.675421 secs 2024-04-21T18:43:10.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:10 smithi077 ceph-mon[27902]: pgmap v16037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:10.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29900.675421 secs 2024-04-21T18:43:10.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:10 smithi191 ceph-mon[31636]: pgmap v16037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:11.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29900.675421 secs 2024-04-21T18:43:11.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:10 smithi170 ceph-mon[31212]: pgmap v16037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:12.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:12 smithi077 ceph-mon[27902]: pgmap v16038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:12.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:12 smithi191 ceph-mon[31636]: pgmap v16038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:13.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:12 smithi170 ceph-mon[31212]: pgmap v16038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:13.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29903.916985 secs 2024-04-21T18:43:13.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:13 smithi077 ceph-mon[27902]: osdmap e1075: 12 total, 12 up, 12 in 2024-04-21T18:43:13.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29903.916985 secs 2024-04-21T18:43:13.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:13 smithi191 ceph-mon[31636]: osdmap e1075: 12 total, 12 up, 12 in 2024-04-21T18:43:14.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29903.916985 secs 2024-04-21T18:43:14.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:13 smithi170 ceph-mon[31212]: osdmap e1075: 12 total, 12 up, 12 in 2024-04-21T18:43:14.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:14 smithi077 ceph-mon[27902]: pgmap v16039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:14.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:14 smithi191 ceph-mon[31636]: pgmap v16039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:15.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:14 smithi170 ceph-mon[31212]: pgmap v16039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:15.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29905.675521 secs 2024-04-21T18:43:15.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29905.675521 secs 2024-04-21T18:43:16.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29905.675521 secs 2024-04-21T18:43:16.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:16 smithi077 ceph-mon[27902]: pgmap v16041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:16.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:16 smithi191 ceph-mon[31636]: pgmap v16041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:17.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:16 smithi170 ceph-mon[31212]: pgmap v16041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:43:18.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:18 smithi077 ceph-mon[27902]: pgmap v16042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:43:18.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29908.917100 secs 2024-04-21T18:43:18.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:18 smithi191 ceph-mon[31636]: pgmap v16042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:43:18.951 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29908.917100 secs 2024-04-21T18:43:19.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:18 smithi170 ceph-mon[31212]: pgmap v16042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:43:19.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29908.917100 secs 2024-04-21T18:43:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:20.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29910.675666 secs 2024-04-21T18:43:20.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:20 smithi077 ceph-mon[27902]: pgmap v16043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:43:20.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:43:20.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29910.675666 secs 2024-04-21T18:43:20.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:20 smithi191 ceph-mon[31636]: pgmap v16043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:43:20.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:43:21.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29910.675666 secs 2024-04-21T18:43:21.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:20 smithi170 ceph-mon[31212]: pgmap v16043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:43:21.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:43:22.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:21 smithi077 ceph-mon[27902]: pgmap v16044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:22.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:43:22.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:43:22.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:21 smithi191 ceph-mon[31636]: pgmap v16044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:22.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:43:22.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:43:22.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:21 smithi170 ceph-mon[31212]: pgmap v16044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:22.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:22.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:43:22.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:43:22.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:43:24.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29913.917212 secs 2024-04-21T18:43:24.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:23 smithi077 ceph-mon[27902]: pgmap v16045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:24.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29913.917212 secs 2024-04-21T18:43:24.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:23 smithi191 ceph-mon[31636]: pgmap v16045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:24.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29913.917212 secs 2024-04-21T18:43:24.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:23 smithi170 ceph-mon[31212]: pgmap v16045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:43:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:25.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29915.675803 secs 2024-04-21T18:43:25.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29915.675803 secs 2024-04-21T18:43:25.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29915.675803 secs 2024-04-21T18:43:26.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:25 smithi077 ceph-mon[27902]: pgmap v16046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:43:26.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:25 smithi191 ceph-mon[31636]: pgmap v16046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:43:26.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:25 smithi170 ceph-mon[31212]: pgmap v16046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:43:28.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:27 smithi077 ceph-mon[27902]: pgmap v16047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:28.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:27 smithi191 ceph-mon[31636]: pgmap v16047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:28.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:27 smithi170 ceph-mon[31212]: pgmap v16047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:29.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29918.917329 secs 2024-04-21T18:43:29.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29918.917329 secs 2024-04-21T18:43:29.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29918.917329 secs 2024-04-21T18:43:30.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29920.675868 secs 2024-04-21T18:43:30.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:29 smithi191 ceph-mon[31636]: pgmap v16048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:30.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29920.675868 secs 2024-04-21T18:43:30.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:29 smithi077 ceph-mon[27902]: pgmap v16048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:30.190 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29920.675868 secs 2024-04-21T18:43:30.190 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:29 smithi170 ceph-mon[31212]: pgmap v16048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:32.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:31 smithi077 ceph-mon[27902]: pgmap v16049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:32.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:31 smithi191 ceph-mon[31636]: pgmap v16049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:32.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:31 smithi170 ceph-mon[31212]: pgmap v16049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:34.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29923.917425 secs 2024-04-21T18:43:34.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:33 smithi077 ceph-mon[27902]: pgmap v16050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:34.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29923.917425 secs 2024-04-21T18:43:34.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:33 smithi191 ceph-mon[31636]: pgmap v16050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:34.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29923.917425 secs 2024-04-21T18:43:34.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:33 smithi170 ceph-mon[31212]: pgmap v16050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:35.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29925.675960 secs 2024-04-21T18:43:35.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29925.675960 secs 2024-04-21T18:43:35.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29925.675960 secs 2024-04-21T18:43:36.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:35 smithi077 ceph-mon[27902]: pgmap v16051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:36.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:35 smithi191 ceph-mon[31636]: pgmap v16051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:36.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:35 smithi170 ceph-mon[31212]: pgmap v16051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:38.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:37 smithi077 ceph-mon[27902]: pgmap v16052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:38.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:37 smithi191 ceph-mon[31636]: pgmap v16052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:38.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:37 smithi170 ceph-mon[31212]: pgmap v16052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:39.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29928.917528 secs 2024-04-21T18:43:39.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29928.917528 secs 2024-04-21T18:43:39.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29928.917528 secs 2024-04-21T18:43:40.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:40.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29930.676072 secs 2024-04-21T18:43:40.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:39 smithi077 ceph-mon[27902]: pgmap v16053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:40.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29930.676072 secs 2024-04-21T18:43:40.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:39 smithi191 ceph-mon[31636]: pgmap v16053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:40.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29930.676072 secs 2024-04-21T18:43:40.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:39 smithi170 ceph-mon[31212]: pgmap v16053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:42.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:41 smithi077 ceph-mon[27902]: pgmap v16054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:42.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:41 smithi191 ceph-mon[31636]: pgmap v16054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:42.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:41 smithi170 ceph-mon[31212]: pgmap v16054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:44.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29933.917648 secs 2024-04-21T18:43:44.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:43 smithi191 ceph-mon[31636]: pgmap v16055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:44.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29933.917648 secs 2024-04-21T18:43:44.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:43 smithi170 ceph-mon[31212]: pgmap v16055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:44.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29933.917648 secs 2024-04-21T18:43:44.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:43 smithi077 ceph-mon[27902]: pgmap v16055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:45.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29935.676184 secs 2024-04-21T18:43:45.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29935.676184 secs 2024-04-21T18:43:45.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29935.676184 secs 2024-04-21T18:43:46.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:45 smithi191 ceph-mon[31636]: pgmap v16056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:46.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:45 smithi170 ceph-mon[31212]: pgmap v16056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:46.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:45 smithi077 ceph-mon[27902]: pgmap v16056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:48.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:47 smithi191 ceph-mon[31636]: pgmap v16057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:48.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:47 smithi170 ceph-mon[31212]: pgmap v16057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:48.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:47 smithi077 ceph-mon[27902]: pgmap v16057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:49.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29938.917757 secs 2024-04-21T18:43:49.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29938.917757 secs 2024-04-21T18:43:49.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29938.917757 secs 2024-04-21T18:43:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:50.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29940.676279 secs 2024-04-21T18:43:50.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:49 smithi191 ceph-mon[31636]: pgmap v16058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:50.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29940.676279 secs 2024-04-21T18:43:50.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:49 smithi170 ceph-mon[31212]: pgmap v16058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:50.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29940.676279 secs 2024-04-21T18:43:50.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:49 smithi077 ceph-mon[27902]: pgmap v16058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:52.170 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:51 smithi077 ceph-mon[27902]: pgmap v16059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:52.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:51 smithi191 ceph-mon[31636]: pgmap v16059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:52.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:51 smithi170 ceph-mon[31212]: pgmap v16059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:54.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29943.917880 secs 2024-04-21T18:43:54.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:53 smithi191 ceph-mon[31636]: pgmap v16060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:54.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29943.917880 secs 2024-04-21T18:43:54.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:53 smithi170 ceph-mon[31212]: pgmap v16060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:54.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29943.917880 secs 2024-04-21T18:43:54.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:53 smithi077 ceph-mon[27902]: pgmap v16060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.452+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T18:43:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.452+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T18:43:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.452+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:43:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.452+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T18:43:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.452+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:43:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.453+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T18:43:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.453+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7005b000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d10 tx=0x7efd7005b000 comp rx=0 tx=0).stop 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:43:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:54.508+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efd70034010 tx=0x7efd70054040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T18:43:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:43:55.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29945.676398 secs 2024-04-21T18:43:55.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29945.676398 secs 2024-04-21T18:43:55.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29945.676398 secs 2024-04-21T18:43:56.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:55 smithi191 ceph-mon[31636]: pgmap v16061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:56.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:55 smithi170 ceph-mon[31212]: pgmap v16061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:56.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:55 smithi077 ceph-mon[27902]: pgmap v16061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:43:58.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:57 smithi191 ceph-mon[31636]: pgmap v16062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:58.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29948.918015 secs 2024-04-21T18:43:58.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:57 smithi170 ceph-mon[31212]: pgmap v16062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:58.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29948.918015 secs 2024-04-21T18:43:58.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:57 smithi077 ceph-mon[27902]: pgmap v16062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:43:58.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29948.918015 secs 2024-04-21T18:43:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:43:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:43:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T18:43:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:43:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T18:43:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:43:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:43:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:43:58.495+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:44:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:00.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29950.676511 secs 2024-04-21T18:44:00.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:43:59 smithi191 ceph-mon[31636]: pgmap v16063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:00.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29950.676511 secs 2024-04-21T18:44:00.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:43:59 smithi170 ceph-mon[31212]: pgmap v16063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:00.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29950.676511 secs 2024-04-21T18:44:00.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:43:59 smithi077 ceph-mon[27902]: pgmap v16063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:02.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:01 smithi191 ceph-mon[31636]: pgmap v16064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:44:02.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:01 smithi170 ceph-mon[31212]: pgmap v16064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:44:02.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:01 smithi077 ceph-mon[27902]: pgmap v16064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:44:03.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29953.918132 secs 2024-04-21T18:44:03.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29953.918132 secs 2024-04-21T18:44:03.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29953.918132 secs 2024-04-21T18:44:04.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:03 smithi191 ceph-mon[31636]: pgmap v16065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T18:44:04.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:03 smithi170 ceph-mon[31212]: pgmap v16065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T18:44:04.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:03 smithi077 ceph-mon[27902]: pgmap v16065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T18:44:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:05.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29955.676643 secs 2024-04-21T18:44:05.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:04 smithi191 ceph-mon[31636]: osdmap e1076: 12 total, 12 up, 12 in 2024-04-21T18:44:05.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29955.676643 secs 2024-04-21T18:44:05.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:04 smithi170 ceph-mon[31212]: osdmap e1076: 12 total, 12 up, 12 in 2024-04-21T18:44:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29955.676643 secs 2024-04-21T18:44:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:04 smithi077 ceph-mon[27902]: osdmap e1076: 12 total, 12 up, 12 in 2024-04-21T18:44:06.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:05 smithi191 ceph-mon[31636]: pgmap v16067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T18:44:06.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:05 smithi170 ceph-mon[31212]: pgmap v16067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T18:44:06.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:05 smithi077 ceph-mon[27902]: pgmap v16067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T18:44:08.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:07 smithi191 ceph-mon[31636]: pgmap v16068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:44:08.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29958.918247 secs 2024-04-21T18:44:08.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:07 smithi170 ceph-mon[31212]: pgmap v16068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:44:08.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29958.918247 secs 2024-04-21T18:44:08.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:07 smithi077 ceph-mon[27902]: pgmap v16068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:44:08.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29958.918247 secs 2024-04-21T18:44:09.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:08 smithi170 ceph-mon[31212]: osdmap e1077: 12 total, 12 up, 12 in 2024-04-21T18:44:09.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:08 smithi077 ceph-mon[27902]: osdmap e1077: 12 total, 12 up, 12 in 2024-04-21T18:44:09.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:08 smithi191 ceph-mon[31636]: osdmap e1077: 12 total, 12 up, 12 in 2024-04-21T18:44:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:10.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29960.676763 secs 2024-04-21T18:44:10.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:09 smithi170 ceph-mon[31212]: pgmap v16070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T18:44:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29960.676763 secs 2024-04-21T18:44:10.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:09 smithi077 ceph-mon[27902]: pgmap v16070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T18:44:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29960.676763 secs 2024-04-21T18:44:10.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:09 smithi191 ceph-mon[31636]: pgmap v16070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-04-21T18:44:12.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:11 smithi170 ceph-mon[31212]: pgmap v16071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-21T18:44:12.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:11 smithi077 ceph-mon[27902]: pgmap v16071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-21T18:44:12.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:11 smithi191 ceph-mon[31636]: pgmap v16071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-21T18:44:13.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29963.918327 secs 2024-04-21T18:44:13.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29963.918327 secs 2024-04-21T18:44:13.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29963.918327 secs 2024-04-21T18:44:14.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:13 smithi170 ceph-mon[31212]: pgmap v16072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-21T18:44:14.370 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:13 smithi077 ceph-mon[27902]: pgmap v16072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-21T18:44:14.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:13 smithi191 ceph-mon[31636]: pgmap v16072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-21T18:44:15.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:15.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29965.676886 secs 2024-04-21T18:44:15.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29965.676886 secs 2024-04-21T18:44:15.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29965.676886 secs 2024-04-21T18:44:16.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:16 smithi170 ceph-mon[31212]: pgmap v16073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-21T18:44:16.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:16 smithi077 ceph-mon[27902]: pgmap v16073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-21T18:44:16.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:16 smithi191 ceph-mon[31636]: pgmap v16073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-21T18:44:18.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:18 smithi170 ceph-mon[31212]: pgmap v16074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:44:18.289 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29968.918434 secs 2024-04-21T18:44:18.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:18 smithi077 ceph-mon[27902]: pgmap v16074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:44:18.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29968.918434 secs 2024-04-21T18:44:18.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:18 smithi191 ceph-mon[31636]: pgmap v16074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:44:18.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29968.918434 secs 2024-04-21T18:44:20.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:20.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29970.677001 secs 2024-04-21T18:44:20.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:20 smithi170 ceph-mon[31212]: pgmap v16075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:44:20.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29970.677001 secs 2024-04-21T18:44:20.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:20 smithi077 ceph-mon[27902]: pgmap v16075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:44:20.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29970.677001 secs 2024-04-21T18:44:20.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:20 smithi191 ceph-mon[31636]: pgmap v16075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:44:22.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:22 smithi170 ceph-mon[31212]: pgmap v16076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:44:22.288 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:44:22.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:22 smithi077 ceph-mon[27902]: pgmap v16076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:44:22.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:44:22.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:22 smithi191 ceph-mon[31636]: pgmap v16076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:44:22.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:44:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29973.918520 secs 2024-04-21T18:44:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:44:23.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:44:23.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29973.918520 secs 2024-04-21T18:44:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:44:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:44:23.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29973.918520 secs 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:44:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:44:23.618 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:44:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:24 smithi191 ceph-mon[31636]: pgmap v16077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:24.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:24 smithi170 ceph-mon[31212]: pgmap v16077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:24 smithi077 ceph-mon[27902]: pgmap v16077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:25.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29975.677108 secs 2024-04-21T18:44:25.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29975.677108 secs 2024-04-21T18:44:25.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29975.677108 secs 2024-04-21T18:44:26.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:26 smithi191 ceph-mon[31636]: pgmap v16078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:26.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:26 smithi170 ceph-mon[31212]: pgmap v16078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:26.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:26 smithi077 ceph-mon[27902]: pgmap v16078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:28.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:28 smithi170 ceph-mon[31212]: pgmap v16079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:28.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29978.918598 secs 2024-04-21T18:44:28.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:28 smithi077 ceph-mon[27902]: pgmap v16079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:28.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29978.918598 secs 2024-04-21T18:44:28.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:28 smithi191 ceph-mon[31636]: pgmap v16079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:28.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29978.918598 secs 2024-04-21T18:44:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:30.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29980.677203 secs 2024-04-21T18:44:30.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:30 smithi191 ceph-mon[31636]: pgmap v16080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29980.677203 secs 2024-04-21T18:44:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:30 smithi170 ceph-mon[31212]: pgmap v16080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:30.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29980.677203 secs 2024-04-21T18:44:30.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:30 smithi077 ceph-mon[27902]: pgmap v16080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:32.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:32 smithi170 ceph-mon[31212]: pgmap v16081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:32.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:32 smithi077 ceph-mon[27902]: pgmap v16081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:32.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:32 smithi191 ceph-mon[31636]: pgmap v16081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:33.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29983.918717 secs 2024-04-21T18:44:33.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29983.918717 secs 2024-04-21T18:44:33.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29983.918717 secs 2024-04-21T18:44:34.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:34 smithi170 ceph-mon[31212]: pgmap v16082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:34.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:34 smithi077 ceph-mon[27902]: pgmap v16082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:34.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:34 smithi191 ceph-mon[31636]: pgmap v16082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:35.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29985.677322 secs 2024-04-21T18:44:35.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29985.677322 secs 2024-04-21T18:44:35.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29985.677322 secs 2024-04-21T18:44:36.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:36 smithi170 ceph-mon[31212]: pgmap v16083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:36.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:36 smithi077 ceph-mon[27902]: pgmap v16083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:36.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:36 smithi191 ceph-mon[31636]: pgmap v16083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:38.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:38 smithi170 ceph-mon[31212]: pgmap v16084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:38.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29988.918841 secs 2024-04-21T18:44:38.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:38 smithi077 ceph-mon[27902]: pgmap v16084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:38.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29988.918841 secs 2024-04-21T18:44:38.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:38 smithi191 ceph-mon[31636]: pgmap v16084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:38.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29988.918841 secs 2024-04-21T18:44:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:40.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29990.677438 secs 2024-04-21T18:44:40.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:40 smithi170 ceph-mon[31212]: pgmap v16085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:40.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29990.677438 secs 2024-04-21T18:44:40.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:40 smithi077 ceph-mon[27902]: pgmap v16085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:40.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29990.677438 secs 2024-04-21T18:44:40.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:40 smithi191 ceph-mon[31636]: pgmap v16085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:42.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:42 smithi170 ceph-mon[31212]: pgmap v16086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:42.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:42 smithi077 ceph-mon[27902]: pgmap v16086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:42.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:42 smithi191 ceph-mon[31636]: pgmap v16086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:43.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29993.918958 secs 2024-04-21T18:44:43.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29993.918958 secs 2024-04-21T18:44:43.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29993.918958 secs 2024-04-21T18:44:44.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:44 smithi170 ceph-mon[31212]: pgmap v16087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:44.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:44 smithi077 ceph-mon[27902]: pgmap v16087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:44.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:44 smithi191 ceph-mon[31636]: pgmap v16087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:45.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 29995.677554 secs 2024-04-21T18:44:45.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 29995.677554 secs 2024-04-21T18:44:45.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 29995.677554 secs 2024-04-21T18:44:46.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:46 smithi170 ceph-mon[31212]: pgmap v16088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:46.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:46 smithi077 ceph-mon[27902]: pgmap v16088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:46.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:46 smithi191 ceph-mon[31636]: pgmap v16088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:48.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:48 smithi170 ceph-mon[31212]: pgmap v16089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:48.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 29998.919069 secs 2024-04-21T18:44:48.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:48 smithi077 ceph-mon[27902]: pgmap v16089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:48.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 29998.919069 secs 2024-04-21T18:44:48.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:48 smithi191 ceph-mon[31636]: pgmap v16089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:48.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 29998.919069 secs 2024-04-21T18:44:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:50.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30000.677669 secs 2024-04-21T18:44:50.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:50 smithi170 ceph-mon[31212]: pgmap v16090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:50.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30000.677669 secs 2024-04-21T18:44:50.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:50 smithi077 ceph-mon[27902]: pgmap v16090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:50.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30000.677669 secs 2024-04-21T18:44:50.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:50 smithi191 ceph-mon[31636]: pgmap v16090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:52.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:52 smithi170 ceph-mon[31212]: pgmap v16091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:52.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:52 smithi077 ceph-mon[27902]: pgmap v16091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:52.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:52 smithi191 ceph-mon[31636]: pgmap v16091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:53.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30003.919196 secs 2024-04-21T18:44:53.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30003.919196 secs 2024-04-21T18:44:53.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30003.919196 secs 2024-04-21T18:44:54.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:54 smithi170 ceph-mon[31212]: pgmap v16092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:54.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:54 smithi077 ceph-mon[27902]: pgmap v16092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:54.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:54 smithi191 ceph-mon[31636]: pgmap v16092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:55.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:44:55.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30005.677784 secs 2024-04-21T18:44:55.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30005.677784 secs 2024-04-21T18:44:55.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30005.677784 secs 2024-04-21T18:44:56.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:56 smithi170 ceph-mon[31212]: pgmap v16093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:56.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:56 smithi077 ceph-mon[27902]: pgmap v16093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:56.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:56 smithi191 ceph-mon[31636]: pgmap v16093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:44:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:58 smithi170 ceph-mon[31212]: pgmap v16094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:58.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:44:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30008.919311 secs 2024-04-21T18:44:58.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:58 smithi077 ceph-mon[27902]: pgmap v16094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:58.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:44:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30008.919311 secs 2024-04-21T18:44:58.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:58 smithi191 ceph-mon[31636]: pgmap v16094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:44:58.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:44:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30008.919311 secs 2024-04-21T18:45:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30010.677849 secs 2024-04-21T18:45:00.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:00 smithi170 ceph-mon[31212]: pgmap v16095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:00.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30010.677849 secs 2024-04-21T18:45:00.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:00 smithi077 ceph-mon[27902]: pgmap v16095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:00.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30010.677849 secs 2024-04-21T18:45:00.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:00 smithi191 ceph-mon[31636]: pgmap v16095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:02.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:02 smithi170 ceph-mon[31212]: pgmap v16096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-21T18:45:02.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:02 smithi077 ceph-mon[27902]: pgmap v16096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-21T18:45:02.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:02 smithi191 ceph-mon[31636]: pgmap v16096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-21T18:45:03.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30013.919424 secs 2024-04-21T18:45:03.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30013.919424 secs 2024-04-21T18:45:03.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30013.919424 secs 2024-04-21T18:45:04.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:04 smithi077 ceph-mon[27902]: pgmap v16097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-04-21T18:45:04.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:04 smithi191 ceph-mon[31636]: pgmap v16097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-04-21T18:45:04.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:04 smithi170 ceph-mon[31212]: pgmap v16097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-04-21T18:45:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:05.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30015.677962 secs 2024-04-21T18:45:05.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:05 smithi077 ceph-mon[27902]: osdmap e1078: 12 total, 12 up, 12 in 2024-04-21T18:45:05.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30015.677962 secs 2024-04-21T18:45:05.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:05 smithi191 ceph-mon[31636]: osdmap e1078: 12 total, 12 up, 12 in 2024-04-21T18:45:05.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30015.677962 secs 2024-04-21T18:45:05.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:05 smithi170 ceph-mon[31212]: osdmap e1078: 12 total, 12 up, 12 in 2024-04-21T18:45:06.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:06 smithi077 ceph-mon[27902]: pgmap v16099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 409 B/s wr, 8 op/s 2024-04-21T18:45:06.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:06 smithi191 ceph-mon[31636]: pgmap v16099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 409 B/s wr, 8 op/s 2024-04-21T18:45:06.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:06 smithi170 ceph-mon[31212]: pgmap v16099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 409 B/s wr, 8 op/s 2024-04-21T18:45:08.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:08 smithi077 ceph-mon[27902]: pgmap v16100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:45:08.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30018.919489 secs 2024-04-21T18:45:08.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:08 smithi077 ceph-mon[27902]: osdmap e1079: 12 total, 12 up, 12 in 2024-04-21T18:45:08.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:08 smithi191 ceph-mon[31636]: pgmap v16100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:45:08.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30018.919489 secs 2024-04-21T18:45:08.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:08 smithi191 ceph-mon[31636]: osdmap e1079: 12 total, 12 up, 12 in 2024-04-21T18:45:08.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:08 smithi170 ceph-mon[31212]: pgmap v16100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:45:08.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30018.919489 secs 2024-04-21T18:45:08.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:08 smithi170 ceph-mon[31212]: osdmap e1079: 12 total, 12 up, 12 in 2024-04-21T18:45:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:10.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30020.678076 secs 2024-04-21T18:45:10.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:10 smithi077 ceph-mon[27902]: pgmap v16102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 66 KiB/s wr, 26 op/s 2024-04-21T18:45:10.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30020.678076 secs 2024-04-21T18:45:10.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:10 smithi191 ceph-mon[31636]: pgmap v16102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 66 KiB/s wr, 26 op/s 2024-04-21T18:45:10.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30020.678076 secs 2024-04-21T18:45:10.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:10 smithi170 ceph-mon[31212]: pgmap v16102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 66 KiB/s wr, 26 op/s 2024-04-21T18:45:12.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:12 smithi077 ceph-mon[27902]: pgmap v16103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-04-21T18:45:12.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:12 smithi191 ceph-mon[31636]: pgmap v16103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-04-21T18:45:12.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:12 smithi170 ceph-mon[31212]: pgmap v16103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 30 op/s 2024-04-21T18:45:13.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30023.919610 secs 2024-04-21T18:45:13.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30023.919610 secs 2024-04-21T18:45:13.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30023.919610 secs 2024-04-21T18:45:14.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:14 smithi077 ceph-mon[27902]: pgmap v16104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 62 KiB/s wr, 28 op/s 2024-04-21T18:45:14.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:14 smithi191 ceph-mon[31636]: pgmap v16104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 62 KiB/s wr, 28 op/s 2024-04-21T18:45:14.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:14 smithi170 ceph-mon[31212]: pgmap v16104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 62 KiB/s wr, 28 op/s 2024-04-21T18:45:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:15.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30025.678156 secs 2024-04-21T18:45:15.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30025.678156 secs 2024-04-21T18:45:15.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30025.678156 secs 2024-04-21T18:45:16.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:16 smithi077 ceph-mon[27902]: pgmap v16105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-04-21T18:45:16.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:16 smithi191 ceph-mon[31636]: pgmap v16105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-04-21T18:45:16.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:16 smithi170 ceph-mon[31212]: pgmap v16105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-04-21T18:45:18.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:18 smithi077 ceph-mon[27902]: pgmap v16106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:45:18.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30028.919726 secs 2024-04-21T18:45:18.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:18 smithi191 ceph-mon[31636]: pgmap v16106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:45:18.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30028.919726 secs 2024-04-21T18:45:18.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:18 smithi170 ceph-mon[31212]: pgmap v16106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:45:18.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30028.919726 secs 2024-04-21T18:45:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:20.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30030.678277 secs 2024-04-21T18:45:20.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:20 smithi077 ceph-mon[27902]: pgmap v16107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:45:20.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30030.678277 secs 2024-04-21T18:45:20.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:20 smithi191 ceph-mon[31636]: pgmap v16107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:45:20.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30030.678277 secs 2024-04-21T18:45:20.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:20 smithi170 ceph-mon[31212]: pgmap v16107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:45:22.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:22 smithi077 ceph-mon[27902]: pgmap v16108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:45:22.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:22 smithi191 ceph-mon[31636]: pgmap v16108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:45:22.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:22 smithi170 ceph-mon[31212]: pgmap v16108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:45:23.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30033.919843 secs 2024-04-21T18:45:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:45:23.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30033.919843 secs 2024-04-21T18:45:23.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:45:23.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30033.919843 secs 2024-04-21T18:45:23.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:45:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:24 smithi077 ceph-mon[27902]: pgmap v16109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:45:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:45:24.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:45:24.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:24 smithi191 ceph-mon[31636]: pgmap v16109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:24.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:45:24.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:45:24.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:45:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:24 smithi170 ceph-mon[31212]: pgmap v16109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:45:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:45:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:45:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:25.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30035.678366 secs 2024-04-21T18:45:25.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30035.678366 secs 2024-04-21T18:45:25.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30035.678366 secs 2024-04-21T18:45:26.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:26 smithi077 ceph-mon[27902]: pgmap v16110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:26.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:26 smithi191 ceph-mon[31636]: pgmap v16110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:26.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:26 smithi170 ceph-mon[31212]: pgmap v16110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:28.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:28 smithi191 ceph-mon[31636]: pgmap v16111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:28.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30038.919960 secs 2024-04-21T18:45:28.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:28 smithi170 ceph-mon[31212]: pgmap v16111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:28.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30038.919960 secs 2024-04-21T18:45:28.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:28 smithi077 ceph-mon[27902]: pgmap v16111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:28.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30038.919960 secs 2024-04-21T18:45:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:30.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30040.678520 secs 2024-04-21T18:45:30.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:30 smithi191 ceph-mon[31636]: pgmap v16112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:30.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30040.678520 secs 2024-04-21T18:45:30.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:30 smithi170 ceph-mon[31212]: pgmap v16112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:30.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30040.678520 secs 2024-04-21T18:45:30.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:30 smithi077 ceph-mon[27902]: pgmap v16112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:32.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:32 smithi191 ceph-mon[31636]: pgmap v16113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:32.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:32 smithi170 ceph-mon[31212]: pgmap v16113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:32.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:32 smithi077 ceph-mon[27902]: pgmap v16113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:33.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30043.920024 secs 2024-04-21T18:45:33.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30043.920024 secs 2024-04-21T18:45:33.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30043.920024 secs 2024-04-21T18:45:34.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:34 smithi191 ceph-mon[31636]: pgmap v16114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:34.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:34 smithi170 ceph-mon[31212]: pgmap v16114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:34.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:34 smithi077 ceph-mon[27902]: pgmap v16114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:35.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:35.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30045.678634 secs 2024-04-21T18:45:35.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30045.678634 secs 2024-04-21T18:45:35.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30045.678634 secs 2024-04-21T18:45:36.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:36 smithi191 ceph-mon[31636]: pgmap v16115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:36.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:36 smithi170 ceph-mon[31212]: pgmap v16115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:36.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:36 smithi077 ceph-mon[27902]: pgmap v16115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:38.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:38 smithi191 ceph-mon[31636]: pgmap v16116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:38.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30048.920166 secs 2024-04-21T18:45:38.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:38 smithi170 ceph-mon[31212]: pgmap v16116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:38.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30048.920166 secs 2024-04-21T18:45:38.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:38 smithi077 ceph-mon[27902]: pgmap v16116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:38.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30048.920166 secs 2024-04-21T18:45:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:40.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30050.678751 secs 2024-04-21T18:45:40.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:40 smithi191 ceph-mon[31636]: pgmap v16117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:40.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30050.678751 secs 2024-04-21T18:45:40.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:40 smithi170 ceph-mon[31212]: pgmap v16117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30050.678751 secs 2024-04-21T18:45:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:40 smithi077 ceph-mon[27902]: pgmap v16117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:42.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:42 smithi191 ceph-mon[31636]: pgmap v16118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:42.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:42 smithi170 ceph-mon[31212]: pgmap v16118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:42.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:42 smithi077 ceph-mon[27902]: pgmap v16118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:43.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30053.920251 secs 2024-04-21T18:45:43.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30053.920251 secs 2024-04-21T18:45:43.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30053.920251 secs 2024-04-21T18:45:44.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:44 smithi191 ceph-mon[31636]: pgmap v16119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:44.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:44 smithi170 ceph-mon[31212]: pgmap v16119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:44.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:44 smithi077 ceph-mon[27902]: pgmap v16119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:45.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30055.678847 secs 2024-04-21T18:45:45.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30055.678847 secs 2024-04-21T18:45:45.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30055.678847 secs 2024-04-21T18:45:46.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:46 smithi191 ceph-mon[31636]: pgmap v16120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:46.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:46 smithi170 ceph-mon[31212]: pgmap v16120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:46.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:46 smithi077 ceph-mon[27902]: pgmap v16120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:48.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:48 smithi191 ceph-mon[31636]: pgmap v16121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:48.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30058.920345 secs 2024-04-21T18:45:48.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:48 smithi170 ceph-mon[31212]: pgmap v16121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:48.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30058.920345 secs 2024-04-21T18:45:48.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:48 smithi077 ceph-mon[27902]: pgmap v16121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:48.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30058.920345 secs 2024-04-21T18:45:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:50.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30060.678951 secs 2024-04-21T18:45:50.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:50 smithi191 ceph-mon[31636]: pgmap v16122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30060.678951 secs 2024-04-21T18:45:50.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:50 smithi170 ceph-mon[31212]: pgmap v16122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:50.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30060.678951 secs 2024-04-21T18:45:50.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:50 smithi077 ceph-mon[27902]: pgmap v16122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:52.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:52 smithi191 ceph-mon[31636]: pgmap v16123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:52.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:52 smithi170 ceph-mon[31212]: pgmap v16123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:52.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:52 smithi077 ceph-mon[27902]: pgmap v16123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:53.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30063.920462 secs 2024-04-21T18:45:53.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30063.920462 secs 2024-04-21T18:45:53.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30063.920462 secs 2024-04-21T18:45:54.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:54 smithi191 ceph-mon[31636]: pgmap v16124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:54.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:54 smithi170 ceph-mon[31212]: pgmap v16124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:54.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:54 smithi077 ceph-mon[27902]: pgmap v16124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:55.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:45:55.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30065.679049 secs 2024-04-21T18:45:55.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30065.679049 secs 2024-04-21T18:45:55.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30065.679049 secs 2024-04-21T18:45:56.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:56 smithi191 ceph-mon[31636]: pgmap v16125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:56.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:56 smithi170 ceph-mon[31212]: pgmap v16125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:56.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:56 smithi077 ceph-mon[27902]: pgmap v16125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:45:58.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:58 smithi191 ceph-mon[31636]: pgmap v16126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:58.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:45:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30068.920595 secs 2024-04-21T18:45:58.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:58 smithi170 ceph-mon[31212]: pgmap v16126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:58.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:45:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30068.920595 secs 2024-04-21T18:45:58.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:58 smithi077 ceph-mon[27902]: pgmap v16126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:45:58.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:45:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30068.920595 secs 2024-04-21T18:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:00.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30070.679165 secs 2024-04-21T18:46:00.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:00 smithi170 ceph-mon[31212]: pgmap v16127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:00.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30070.679165 secs 2024-04-21T18:46:00.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:00 smithi077 ceph-mon[27902]: pgmap v16127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:00.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30070.679165 secs 2024-04-21T18:46:00.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:00 smithi191 ceph-mon[31636]: pgmap v16127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:02.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:02 smithi170 ceph-mon[31212]: pgmap v16128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:02.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:02 smithi077 ceph-mon[27902]: pgmap v16128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:02.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:02 smithi191 ceph-mon[31636]: pgmap v16128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:03.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30073.920712 secs 2024-04-21T18:46:03.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30073.920712 secs 2024-04-21T18:46:03.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30073.920712 secs 2024-04-21T18:46:04.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:04 smithi170 ceph-mon[31212]: pgmap v16129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:04.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:04 smithi077 ceph-mon[27902]: pgmap v16129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:04.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:04 smithi191 ceph-mon[31636]: pgmap v16129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:05.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30075.679282 secs 2024-04-21T18:46:05.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:05 smithi170 ceph-mon[31212]: osdmap e1080: 12 total, 12 up, 12 in 2024-04-21T18:46:05.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30075.679282 secs 2024-04-21T18:46:05.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:05 smithi077 ceph-mon[27902]: osdmap e1080: 12 total, 12 up, 12 in 2024-04-21T18:46:05.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30075.679282 secs 2024-04-21T18:46:05.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:05 smithi191 ceph-mon[31636]: osdmap e1080: 12 total, 12 up, 12 in 2024-04-21T18:46:06.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:06 smithi170 ceph-mon[31212]: pgmap v16131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:46:06.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:06 smithi077 ceph-mon[27902]: pgmap v16131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:46:06.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:06 smithi191 ceph-mon[31636]: pgmap v16131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:46:08.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:08 smithi170 ceph-mon[31212]: pgmap v16132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:46:08.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30078.920836 secs 2024-04-21T18:46:08.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:08 smithi170 ceph-mon[31212]: osdmap e1081: 12 total, 12 up, 12 in 2024-04-21T18:46:08.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:08 smithi077 ceph-mon[27902]: pgmap v16132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:46:08.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30078.920836 secs 2024-04-21T18:46:08.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:08 smithi077 ceph-mon[27902]: osdmap e1081: 12 total, 12 up, 12 in 2024-04-21T18:46:08.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:08 smithi191 ceph-mon[31636]: pgmap v16132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:46:08.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30078.920836 secs 2024-04-21T18:46:08.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:08 smithi191 ceph-mon[31636]: osdmap e1081: 12 total, 12 up, 12 in 2024-04-21T18:46:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:10.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30080.679397 secs 2024-04-21T18:46:10.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:10 smithi170 ceph-mon[31212]: pgmap v16134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:46:10.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30080.679397 secs 2024-04-21T18:46:10.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:10 smithi077 ceph-mon[27902]: pgmap v16134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:46:10.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30080.679397 secs 2024-04-21T18:46:10.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:10 smithi191 ceph-mon[31636]: pgmap v16134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:46:12.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:12 smithi170 ceph-mon[31212]: pgmap v16135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:46:12.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:12 smithi077 ceph-mon[27902]: pgmap v16135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:46:12.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:12 smithi191 ceph-mon[31636]: pgmap v16135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:46:13.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30083.920955 secs 2024-04-21T18:46:13.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30083.920955 secs 2024-04-21T18:46:13.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30083.920955 secs 2024-04-21T18:46:14.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:14 smithi170 ceph-mon[31212]: pgmap v16136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T18:46:14.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:14 smithi077 ceph-mon[27902]: pgmap v16136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T18:46:14.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:14 smithi191 ceph-mon[31636]: pgmap v16136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T18:46:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:15.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30085.679521 secs 2024-04-21T18:46:15.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30085.679521 secs 2024-04-21T18:46:15.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30085.679521 secs 2024-04-21T18:46:16.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:16 smithi170 ceph-mon[31212]: pgmap v16137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:46:16.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:16 smithi077 ceph-mon[27902]: pgmap v16137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:46:16.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:16 smithi191 ceph-mon[31636]: pgmap v16137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:46:18.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:18 smithi170 ceph-mon[31212]: pgmap v16138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:46:18.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30088.921079 secs 2024-04-21T18:46:18.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:18 smithi077 ceph-mon[27902]: pgmap v16138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:46:18.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30088.921079 secs 2024-04-21T18:46:18.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:18 smithi191 ceph-mon[31636]: pgmap v16138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:46:18.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30088.921079 secs 2024-04-21T18:46:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:20.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30090.679668 secs 2024-04-21T18:46:20.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:20 smithi170 ceph-mon[31212]: pgmap v16139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:46:20.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30090.679668 secs 2024-04-21T18:46:20.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:20 smithi077 ceph-mon[27902]: pgmap v16139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:46:20.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30090.679668 secs 2024-04-21T18:46:20.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:20 smithi191 ceph-mon[31636]: pgmap v16139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:46:22.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:22 smithi170 ceph-mon[31212]: pgmap v16140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:46:22.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:22 smithi077 ceph-mon[27902]: pgmap v16140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:46:22.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:22 smithi191 ceph-mon[31636]: pgmap v16140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:46:23.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30093.921197 secs 2024-04-21T18:46:23.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30093.921197 secs 2024-04-21T18:46:23.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30093.921197 secs 2024-04-21T18:46:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:24 smithi170 ceph-mon[31212]: pgmap v16141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:46:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:46:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:46:24.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:46:24.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:24 smithi077 ceph-mon[27902]: pgmap v16141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:24.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:46:24.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:46:24.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:46:24.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:46:24.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:24 smithi191 ceph-mon[31636]: pgmap v16141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:24.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:46:24.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:46:24.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:46:24.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:46:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:25.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30095.679766 secs 2024-04-21T18:46:25.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30095.679766 secs 2024-04-21T18:46:25.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30095.679766 secs 2024-04-21T18:46:26.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:26 smithi077 ceph-mon[27902]: pgmap v16142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:26.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:26 smithi191 ceph-mon[31636]: pgmap v16142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:27.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:26 smithi170 ceph-mon[31212]: pgmap v16142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:28.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:28 smithi077 ceph-mon[27902]: pgmap v16143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:28.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30098.921313 secs 2024-04-21T18:46:28.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:28 smithi191 ceph-mon[31636]: pgmap v16143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:28.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30098.921313 secs 2024-04-21T18:46:29.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:28 smithi170 ceph-mon[31212]: pgmap v16143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:29.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30098.921313 secs 2024-04-21T18:46:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:30.840 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30100.679881 secs 2024-04-21T18:46:30.840 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:30 smithi170 ceph-mon[31212]: pgmap v16144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:30.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30100.679881 secs 2024-04-21T18:46:30.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:30 smithi077 ceph-mon[27902]: pgmap v16144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:30.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30100.679881 secs 2024-04-21T18:46:30.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:30 smithi191 ceph-mon[31636]: pgmap v16144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:32.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:32 smithi077 ceph-mon[27902]: pgmap v16145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:32.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:32 smithi191 ceph-mon[31636]: pgmap v16145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:33.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:32 smithi170 ceph-mon[31212]: pgmap v16145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:33.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30103.921428 secs 2024-04-21T18:46:33.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30103.921428 secs 2024-04-21T18:46:34.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30103.921428 secs 2024-04-21T18:46:34.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:34 smithi077 ceph-mon[27902]: pgmap v16146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:34.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:34 smithi191 ceph-mon[31636]: pgmap v16146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:35.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:34 smithi170 ceph-mon[31212]: pgmap v16146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:35.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:35.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30105.680003 secs 2024-04-21T18:46:35.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30105.680003 secs 2024-04-21T18:46:36.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30105.680003 secs 2024-04-21T18:46:36.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:36 smithi077 ceph-mon[27902]: pgmap v16147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:36.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:36 smithi191 ceph-mon[31636]: pgmap v16147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:37.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:36 smithi170 ceph-mon[31212]: pgmap v16147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:38.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:38 smithi077 ceph-mon[27902]: pgmap v16148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:38.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30108.921561 secs 2024-04-21T18:46:38.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:38 smithi191 ceph-mon[31636]: pgmap v16148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:38.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30108.921561 secs 2024-04-21T18:46:39.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:38 smithi170 ceph-mon[31212]: pgmap v16148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:39.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30108.921561 secs 2024-04-21T18:46:40.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30110.680066 secs 2024-04-21T18:46:40.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:40 smithi077 ceph-mon[27902]: pgmap v16149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:40.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30110.680066 secs 2024-04-21T18:46:40.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:40 smithi191 ceph-mon[31636]: pgmap v16149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:41.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30110.680066 secs 2024-04-21T18:46:41.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:40 smithi170 ceph-mon[31212]: pgmap v16149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:42.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:42 smithi077 ceph-mon[27902]: pgmap v16150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:42.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:42 smithi191 ceph-mon[31636]: pgmap v16150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:43.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:42 smithi170 ceph-mon[31212]: pgmap v16150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:43.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30113.921677 secs 2024-04-21T18:46:43.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30113.921677 secs 2024-04-21T18:46:44.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30113.921677 secs 2024-04-21T18:46:44.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:44 smithi077 ceph-mon[27902]: pgmap v16151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:44.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:44 smithi191 ceph-mon[31636]: pgmap v16151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:45.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:44 smithi170 ceph-mon[31212]: pgmap v16151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:45.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30115.680164 secs 2024-04-21T18:46:45.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30115.680164 secs 2024-04-21T18:46:46.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30115.680164 secs 2024-04-21T18:46:46.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:46 smithi077 ceph-mon[27902]: pgmap v16152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:46.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:46 smithi191 ceph-mon[31636]: pgmap v16152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:47.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:46 smithi170 ceph-mon[31212]: pgmap v16152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:48.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:48 smithi077 ceph-mon[27902]: pgmap v16153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:48.909 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30118.921798 secs 2024-04-21T18:46:48.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:48 smithi191 ceph-mon[31636]: pgmap v16153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:48.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30118.921798 secs 2024-04-21T18:46:49.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:48 smithi170 ceph-mon[31212]: pgmap v16153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:49.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30118.921798 secs 2024-04-21T18:46:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:50.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30120.680284 secs 2024-04-21T18:46:50.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:50 smithi077 ceph-mon[27902]: pgmap v16154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:50.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30120.680284 secs 2024-04-21T18:46:50.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:50 smithi191 ceph-mon[31636]: pgmap v16154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:51.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30120.680284 secs 2024-04-21T18:46:51.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:50 smithi170 ceph-mon[31212]: pgmap v16154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:52.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:52 smithi077 ceph-mon[27902]: pgmap v16155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:52.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:52 smithi191 ceph-mon[31636]: pgmap v16155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:53.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:52 smithi170 ceph-mon[31212]: pgmap v16155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:53.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30123.921934 secs 2024-04-21T18:46:53.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30123.921934 secs 2024-04-21T18:46:54.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30123.921934 secs 2024-04-21T18:46:54.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:54 smithi077 ceph-mon[27902]: pgmap v16156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:54.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:54 smithi191 ceph-mon[31636]: pgmap v16156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:55.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:54 smithi170 ceph-mon[31212]: pgmap v16156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:55.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:46:55.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30125.680369 secs 2024-04-21T18:46:55.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30125.680369 secs 2024-04-21T18:46:56.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30125.680369 secs 2024-04-21T18:46:56.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:56 smithi077 ceph-mon[27902]: pgmap v16157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:56.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:56 smithi191 ceph-mon[31636]: pgmap v16157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:57.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:56 smithi170 ceph-mon[31212]: pgmap v16157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:46:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:46:58.520+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:46:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:46:58.520+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:46:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:46:58.520+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:46:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:46:58.520+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:46:58.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:58 smithi077 ceph-mon[27902]: pgmap v16158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:58.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:46:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30128.922071 secs 2024-04-21T18:46:58.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:58 smithi191 ceph-mon[31636]: pgmap v16158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:58.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:46:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30128.922071 secs 2024-04-21T18:46:59.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:58 smithi170 ceph-mon[31212]: pgmap v16158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:46:59.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:46:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30128.922071 secs 2024-04-21T18:47:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:00.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30130.680489 secs 2024-04-21T18:47:00.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:00 smithi077 ceph-mon[27902]: pgmap v16159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:00.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30130.680489 secs 2024-04-21T18:47:00.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:00 smithi191 ceph-mon[31636]: pgmap v16159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:01.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30130.680489 secs 2024-04-21T18:47:01.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:00 smithi170 ceph-mon[31212]: pgmap v16159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:02.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:02 smithi191 ceph-mon[31636]: pgmap v16160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:03.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:02 smithi170 ceph-mon[31212]: pgmap v16160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:03.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:02 smithi077 ceph-mon[27902]: pgmap v16160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:03.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30133.922134 secs 2024-04-21T18:47:04.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30133.922134 secs 2024-04-21T18:47:04.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30133.922134 secs 2024-04-21T18:47:04.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:04 smithi191 ceph-mon[31636]: pgmap v16161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:05.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:04 smithi170 ceph-mon[31212]: pgmap v16161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:05.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:04 smithi077 ceph-mon[27902]: pgmap v16161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:05.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30135.680633 secs 2024-04-21T18:47:05.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:05 smithi191 ceph-mon[31636]: osdmap e1082: 12 total, 12 up, 12 in 2024-04-21T18:47:06.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30135.680633 secs 2024-04-21T18:47:06.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:05 smithi170 ceph-mon[31212]: osdmap e1082: 12 total, 12 up, 12 in 2024-04-21T18:47:06.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30135.680633 secs 2024-04-21T18:47:06.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:05 smithi077 ceph-mon[27902]: osdmap e1082: 12 total, 12 up, 12 in 2024-04-21T18:47:06.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:06 smithi191 ceph-mon[31636]: pgmap v16163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:47:07.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:06 smithi170 ceph-mon[31212]: pgmap v16163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:47:07.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:06 smithi077 ceph-mon[27902]: pgmap v16163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:47:08.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:08 smithi191 ceph-mon[31636]: pgmap v16164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:47:08.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30138.922239 secs 2024-04-21T18:47:08.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:08 smithi191 ceph-mon[31636]: osdmap e1083: 12 total, 12 up, 12 in 2024-04-21T18:47:09.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:08 smithi170 ceph-mon[31212]: pgmap v16164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:47:09.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30138.922239 secs 2024-04-21T18:47:09.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:08 smithi170 ceph-mon[31212]: osdmap e1083: 12 total, 12 up, 12 in 2024-04-21T18:47:09.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:08 smithi077 ceph-mon[27902]: pgmap v16164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:47:09.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30138.922239 secs 2024-04-21T18:47:09.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:08 smithi077 ceph-mon[27902]: osdmap e1083: 12 total, 12 up, 12 in 2024-04-21T18:47:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:10.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30140.680771 secs 2024-04-21T18:47:10.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:10 smithi191 ceph-mon[31636]: pgmap v16166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:47:11.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30140.680771 secs 2024-04-21T18:47:11.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:10 smithi170 ceph-mon[31212]: pgmap v16166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:47:11.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30140.680771 secs 2024-04-21T18:47:11.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:10 smithi077 ceph-mon[27902]: pgmap v16166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:47:12.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:12 smithi191 ceph-mon[31636]: pgmap v16167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:47:13.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:12 smithi170 ceph-mon[31212]: pgmap v16167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:47:13.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:12 smithi077 ceph-mon[27902]: pgmap v16167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:47:13.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30143.922318 secs 2024-04-21T18:47:14.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30143.922318 secs 2024-04-21T18:47:14.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30143.922318 secs 2024-04-21T18:47:14.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:14 smithi191 ceph-mon[31636]: pgmap v16168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T18:47:15.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:14 smithi170 ceph-mon[31212]: pgmap v16168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T18:47:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:15.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:14 smithi077 ceph-mon[27902]: pgmap v16168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-04-21T18:47:15.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30145.680833 secs 2024-04-21T18:47:16.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30145.680833 secs 2024-04-21T18:47:16.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30145.680833 secs 2024-04-21T18:47:16.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:16 smithi191 ceph-mon[31636]: pgmap v16169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:47:17.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:16 smithi170 ceph-mon[31212]: pgmap v16169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:47:17.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:16 smithi077 ceph-mon[27902]: pgmap v16169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:47:18.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:18 smithi191 ceph-mon[31636]: pgmap v16170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:47:18.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30148.922423 secs 2024-04-21T18:47:19.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:18 smithi170 ceph-mon[31212]: pgmap v16170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:47:19.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30148.922423 secs 2024-04-21T18:47:19.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:18 smithi077 ceph-mon[27902]: pgmap v16170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:47:19.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30148.922423 secs 2024-04-21T18:47:19.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30150.680956 secs 2024-04-21T18:47:20.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30150.680956 secs 2024-04-21T18:47:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:20.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30150.680956 secs 2024-04-21T18:47:20.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:20 smithi191 ceph-mon[31636]: pgmap v16171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:47:21.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:20 smithi170 ceph-mon[31212]: pgmap v16171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:47:21.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:20 smithi077 ceph-mon[27902]: pgmap v16171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:47:22.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:22 smithi191 ceph-mon[31636]: pgmap v16172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:47:23.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:22 smithi170 ceph-mon[31212]: pgmap v16172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:47:23.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:22 smithi077 ceph-mon[27902]: pgmap v16172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:47:23.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30153.922541 secs 2024-04-21T18:47:24.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30153.922541 secs 2024-04-21T18:47:24.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30153.922541 secs 2024-04-21T18:47:24.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:24 smithi191 ceph-mon[31636]: pgmap v16173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:24.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30155.681039 secs 2024-04-21T18:47:24.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:47:25.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:24 smithi170 ceph-mon[31212]: pgmap v16173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:25.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30155.681039 secs 2024-04-21T18:47:25.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:47:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:25.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:24 smithi077 ceph-mon[27902]: pgmap v16173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:25.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30155.681039 secs 2024-04-21T18:47:25.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:47:25.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:47:25.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:47:25.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:47:26.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:47:26.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:47:26.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:47:26.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:47:26.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:47:26.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:47:26.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:26 smithi191 ceph-mon[31636]: pgmap v16174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:27.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:26 smithi170 ceph-mon[31212]: pgmap v16174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:27.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:26 smithi077 ceph-mon[27902]: pgmap v16174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:28.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:28 smithi191 ceph-mon[31636]: pgmap v16175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:28.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30158.922669 secs 2024-04-21T18:47:29.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:28 smithi170 ceph-mon[31212]: pgmap v16175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:29.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30158.922669 secs 2024-04-21T18:47:29.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:28 smithi077 ceph-mon[27902]: pgmap v16175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:29.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30158.922669 secs 2024-04-21T18:47:30.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30160.681157 secs 2024-04-21T18:47:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:30.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30160.681157 secs 2024-04-21T18:47:30.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30160.681157 secs 2024-04-21T18:47:31.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:30 smithi170 ceph-mon[31212]: pgmap v16176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:31.100 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:30 smithi191 ceph-mon[31636]: pgmap v16176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:31.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:30 smithi077 ceph-mon[27902]: pgmap v16176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:33.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:32 smithi170 ceph-mon[31212]: pgmap v16177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:33.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:32 smithi077 ceph-mon[27902]: pgmap v16177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:33.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:32 smithi191 ceph-mon[31636]: pgmap v16177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:34.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30163.922787 secs 2024-04-21T18:47:34.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30163.922787 secs 2024-04-21T18:47:34.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30163.922787 secs 2024-04-21T18:47:35.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:34 smithi170 ceph-mon[31212]: pgmap v16178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:35.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30165.681282 secs 2024-04-21T18:47:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:35.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:34 smithi077 ceph-mon[27902]: pgmap v16178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:35.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30165.681282 secs 2024-04-21T18:47:35.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:34 smithi191 ceph-mon[31636]: pgmap v16178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:35.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30165.681282 secs 2024-04-21T18:47:37.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:36 smithi170 ceph-mon[31212]: pgmap v16179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:37.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:36 smithi077 ceph-mon[27902]: pgmap v16179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:37.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:36 smithi191 ceph-mon[31636]: pgmap v16179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:39.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:38 smithi170 ceph-mon[31212]: pgmap v16180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:39.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30168.922834 secs 2024-04-21T18:47:39.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:38 smithi077 ceph-mon[27902]: pgmap v16180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:39.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30168.922834 secs 2024-04-21T18:47:39.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:38 smithi191 ceph-mon[31636]: pgmap v16180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:39.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30168.922834 secs 2024-04-21T18:47:40.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30170.681420 secs 2024-04-21T18:47:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:40.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30170.681420 secs 2024-04-21T18:47:40.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30170.681420 secs 2024-04-21T18:47:41.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:40 smithi170 ceph-mon[31212]: pgmap v16181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:41.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:40 smithi077 ceph-mon[27902]: pgmap v16181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:41.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:40 smithi191 ceph-mon[31636]: pgmap v16181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:43.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:42 smithi170 ceph-mon[31212]: pgmap v16182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:43.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:42 smithi077 ceph-mon[27902]: pgmap v16182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:43.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:42 smithi191 ceph-mon[31636]: pgmap v16182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:44.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30173.922897 secs 2024-04-21T18:47:44.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30173.922897 secs 2024-04-21T18:47:44.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30173.922897 secs 2024-04-21T18:47:45.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:44 smithi170 ceph-mon[31212]: pgmap v16183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:45.038 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30175.681545 secs 2024-04-21T18:47:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:45.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:44 smithi077 ceph-mon[27902]: pgmap v16183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:45.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30175.681545 secs 2024-04-21T18:47:45.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:44 smithi191 ceph-mon[31636]: pgmap v16183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:45.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30175.681545 secs 2024-04-21T18:47:47.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:46 smithi170 ceph-mon[31212]: pgmap v16184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:47.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:46 smithi077 ceph-mon[27902]: pgmap v16184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:47.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:46 smithi191 ceph-mon[31636]: pgmap v16184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:49.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:48 smithi170 ceph-mon[31212]: pgmap v16185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:49.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30178.923015 secs 2024-04-21T18:47:49.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:48 smithi077 ceph-mon[27902]: pgmap v16185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:49.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30178.923015 secs 2024-04-21T18:47:49.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:48 smithi191 ceph-mon[31636]: pgmap v16185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:49.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30178.923015 secs 2024-04-21T18:47:50.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30180.681663 secs 2024-04-21T18:47:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:50.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30180.681663 secs 2024-04-21T18:47:50.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30180.681663 secs 2024-04-21T18:47:51.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:50 smithi170 ceph-mon[31212]: pgmap v16186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:51.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:50 smithi077 ceph-mon[27902]: pgmap v16186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:51.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:50 smithi191 ceph-mon[31636]: pgmap v16186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:53.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:52 smithi170 ceph-mon[31212]: pgmap v16187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:53.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:52 smithi077 ceph-mon[27902]: pgmap v16187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:53.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:52 smithi191 ceph-mon[31636]: pgmap v16187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:54.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30183.923125 secs 2024-04-21T18:47:54.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30183.923125 secs 2024-04-21T18:47:54.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30183.923125 secs 2024-04-21T18:47:55.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:54 smithi170 ceph-mon[31212]: pgmap v16188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:55.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30185.681778 secs 2024-04-21T18:47:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:47:55.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:54 smithi077 ceph-mon[27902]: pgmap v16188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:55.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30185.681778 secs 2024-04-21T18:47:55.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:54 smithi191 ceph-mon[31636]: pgmap v16188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:55.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30185.681778 secs 2024-04-21T18:47:57.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:56 smithi170 ceph-mon[31212]: pgmap v16189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:57.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:56 smithi077 ceph-mon[27902]: pgmap v16189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:57.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:56 smithi191 ceph-mon[31636]: pgmap v16189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:47:58.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:57 smithi170 ceph-mon[31212]: pgmap v16190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:58.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:57 smithi077 ceph-mon[27902]: pgmap v16190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:58.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:57 smithi191 ceph-mon[31636]: pgmap v16190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:47:59.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30188.923242 secs 2024-04-21T18:47:59.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30188.923242 secs 2024-04-21T18:47:59.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30188.923242 secs 2024-04-21T18:48:00.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30190.681877 secs 2024-04-21T18:48:00.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:47:59 smithi170 ceph-mon[31212]: pgmap v16191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:00.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30190.681877 secs 2024-04-21T18:48:00.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:47:59 smithi077 ceph-mon[27902]: pgmap v16191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:00.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30190.681877 secs 2024-04-21T18:48:00.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:47:59 smithi191 ceph-mon[31636]: pgmap v16191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:02.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:01 smithi191 ceph-mon[31636]: pgmap v16192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:02.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:01 smithi170 ceph-mon[31212]: pgmap v16192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:02.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:01 smithi077 ceph-mon[27902]: pgmap v16192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:03.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30193.923308 secs 2024-04-21T18:48:03.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30193.923308 secs 2024-04-21T18:48:03.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30193.923308 secs 2024-04-21T18:48:04.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:03 smithi170 ceph-mon[31212]: pgmap v16193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:04.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:03 smithi077 ceph-mon[27902]: pgmap v16193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:03 smithi191 ceph-mon[31636]: pgmap v16193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:05.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30195.681923 secs 2024-04-21T18:48:05.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:04 smithi170 ceph-mon[31212]: osdmap e1084: 12 total, 12 up, 12 in 2024-04-21T18:48:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30195.681923 secs 2024-04-21T18:48:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:04 smithi077 ceph-mon[27902]: osdmap e1084: 12 total, 12 up, 12 in 2024-04-21T18:48:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30195.681923 secs 2024-04-21T18:48:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:04 smithi191 ceph-mon[31636]: osdmap e1084: 12 total, 12 up, 12 in 2024-04-21T18:48:06.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:05 smithi170 ceph-mon[31212]: pgmap v16195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:48:06.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:05 smithi077 ceph-mon[27902]: pgmap v16195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:48:06.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:05 smithi191 ceph-mon[31636]: pgmap v16195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:48:08.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:07 smithi170 ceph-mon[31212]: pgmap v16196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:48:08.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30198.923428 secs 2024-04-21T18:48:08.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:07 smithi077 ceph-mon[27902]: pgmap v16196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:48:08.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30198.923428 secs 2024-04-21T18:48:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:07 smithi191 ceph-mon[31636]: pgmap v16196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:48:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30198.923428 secs 2024-04-21T18:48:09.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:09 smithi170 ceph-mon[31212]: osdmap e1085: 12 total, 12 up, 12 in 2024-04-21T18:48:09.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:09 smithi077 ceph-mon[27902]: osdmap e1085: 12 total, 12 up, 12 in 2024-04-21T18:48:09.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:09 smithi191 ceph-mon[31636]: osdmap e1085: 12 total, 12 up, 12 in 2024-04-21T18:48:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:10.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30200.681986 secs 2024-04-21T18:48:10.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:10 smithi170 ceph-mon[31212]: pgmap v16198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:48:10.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30200.681986 secs 2024-04-21T18:48:10.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:10 smithi077 ceph-mon[27902]: pgmap v16198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:48:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30200.681986 secs 2024-04-21T18:48:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:10 smithi191 ceph-mon[31636]: pgmap v16198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:48:12.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:12 smithi170 ceph-mon[31212]: pgmap v16199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:48:12.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:12 smithi077 ceph-mon[27902]: pgmap v16199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:48:12.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:12 smithi191 ceph-mon[31636]: pgmap v16199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:48:13.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30203.923545 secs 2024-04-21T18:48:13.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30203.923545 secs 2024-04-21T18:48:13.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30203.923545 secs 2024-04-21T18:48:14.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:14 smithi170 ceph-mon[31212]: pgmap v16200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:48:14.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:14 smithi077 ceph-mon[27902]: pgmap v16200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:48:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:14 smithi191 ceph-mon[31636]: pgmap v16200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:48:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:15.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30205.682102 secs 2024-04-21T18:48:15.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30205.682102 secs 2024-04-21T18:48:15.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30205.682102 secs 2024-04-21T18:48:16.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:16 smithi170 ceph-mon[31212]: pgmap v16201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:48:16.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:16 smithi077 ceph-mon[27902]: pgmap v16201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:48:16.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:16 smithi191 ceph-mon[31636]: pgmap v16201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:48:18.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:18 smithi077 ceph-mon[27902]: pgmap v16202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:48:18.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30208.923608 secs 2024-04-21T18:48:18.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:18 smithi191 ceph-mon[31636]: pgmap v16202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:48:18.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30208.923608 secs 2024-04-21T18:48:18.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:18 smithi170 ceph-mon[31212]: pgmap v16202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:48:18.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30208.923608 secs 2024-04-21T18:48:20.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:20.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30210.682182 secs 2024-04-21T18:48:20.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:20 smithi077 ceph-mon[27902]: pgmap v16203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:48:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30210.682182 secs 2024-04-21T18:48:20.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:20 smithi191 ceph-mon[31636]: pgmap v16203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:48:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30210.682182 secs 2024-04-21T18:48:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:20 smithi170 ceph-mon[31212]: pgmap v16203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:48:22.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:22 smithi077 ceph-mon[27902]: pgmap v16204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:48:22.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:22 smithi191 ceph-mon[31636]: pgmap v16204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:48:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:22 smithi170 ceph-mon[31212]: pgmap v16204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:48:23.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30213.923720 secs 2024-04-21T18:48:23.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30213.923720 secs 2024-04-21T18:48:23.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30213.923720 secs 2024-04-21T18:48:24.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:24 smithi077 ceph-mon[27902]: pgmap v16205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:24 smithi191 ceph-mon[31636]: pgmap v16205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:24 smithi170 ceph-mon[31212]: pgmap v16205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:25.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30215.682318 secs 2024-04-21T18:48:25.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30215.682318 secs 2024-04-21T18:48:25.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30215.682318 secs 2024-04-21T18:48:26.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:26 smithi077 ceph-mon[27902]: pgmap v16206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:26.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:48:26.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:48:26.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:48:26.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:48:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:26 smithi191 ceph-mon[31636]: pgmap v16206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:48:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:48:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:48:26.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:48:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:26 smithi170 ceph-mon[31212]: pgmap v16206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:48:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:48:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:48:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:48:28.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:28 smithi077 ceph-mon[27902]: pgmap v16207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:28.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30218.923833 secs 2024-04-21T18:48:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:28 smithi191 ceph-mon[31636]: pgmap v16207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30218.923833 secs 2024-04-21T18:48:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:28 smithi170 ceph-mon[31212]: pgmap v16207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30218.923833 secs 2024-04-21T18:48:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30220.682450 secs 2024-04-21T18:48:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:30 smithi077 ceph-mon[27902]: pgmap v16208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30220.682450 secs 2024-04-21T18:48:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:30 smithi191 ceph-mon[31636]: pgmap v16208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:30.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30220.682450 secs 2024-04-21T18:48:30.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:30 smithi170 ceph-mon[31212]: pgmap v16208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:32.339 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:32 smithi170 ceph-mon[31212]: pgmap v16209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:32.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:32 smithi077 ceph-mon[27902]: pgmap v16209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:32.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:32 smithi191 ceph-mon[31636]: pgmap v16209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:33.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30223.923906 secs 2024-04-21T18:48:33.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30223.923906 secs 2024-04-21T18:48:33.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30223.923906 secs 2024-04-21T18:48:34.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:34 smithi077 ceph-mon[27902]: pgmap v16210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:34.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:34 smithi191 ceph-mon[31636]: pgmap v16210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:34.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:34 smithi170 ceph-mon[31212]: pgmap v16210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:35.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:35.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30225.682574 secs 2024-04-21T18:48:35.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30225.682574 secs 2024-04-21T18:48:35.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30225.682574 secs 2024-04-21T18:48:36.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:36 smithi077 ceph-mon[27902]: pgmap v16211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:36.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:36 smithi191 ceph-mon[31636]: pgmap v16211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:36.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:36 smithi170 ceph-mon[31212]: pgmap v16211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:38.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:38 smithi077 ceph-mon[27902]: pgmap v16212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:38.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30228.924022 secs 2024-04-21T18:48:38.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:38 smithi191 ceph-mon[31636]: pgmap v16212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:38.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30228.924022 secs 2024-04-21T18:48:38.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:38 smithi170 ceph-mon[31212]: pgmap v16212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:38.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30228.924022 secs 2024-04-21T18:48:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:40.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30230.682672 secs 2024-04-21T18:48:40.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:40 smithi077 ceph-mon[27902]: pgmap v16213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:40.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30230.682672 secs 2024-04-21T18:48:40.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:40 smithi191 ceph-mon[31636]: pgmap v16213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:40.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30230.682672 secs 2024-04-21T18:48:40.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:40 smithi170 ceph-mon[31212]: pgmap v16213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:42.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:42 smithi077 ceph-mon[27902]: pgmap v16214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:42.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:42 smithi191 ceph-mon[31636]: pgmap v16214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:42.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:42 smithi170 ceph-mon[31212]: pgmap v16214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:43.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30233.924095 secs 2024-04-21T18:48:43.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30233.924095 secs 2024-04-21T18:48:43.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30233.924095 secs 2024-04-21T18:48:44.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:44 smithi077 ceph-mon[27902]: pgmap v16215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:44.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:44 smithi191 ceph-mon[31636]: pgmap v16215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:44.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:44 smithi170 ceph-mon[31212]: pgmap v16215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:45.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30235.682805 secs 2024-04-21T18:48:45.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30235.682805 secs 2024-04-21T18:48:45.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30235.682805 secs 2024-04-21T18:48:46.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:46 smithi077 ceph-mon[27902]: pgmap v16216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:46.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:46 smithi191 ceph-mon[31636]: pgmap v16216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:46.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:46 smithi170 ceph-mon[31212]: pgmap v16216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:48.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:48 smithi077 ceph-mon[27902]: pgmap v16217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:48.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30238.924210 secs 2024-04-21T18:48:48.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:48 smithi191 ceph-mon[31636]: pgmap v16217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:48.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30238.924210 secs 2024-04-21T18:48:48.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:48 smithi170 ceph-mon[31212]: pgmap v16217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:48.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30238.924210 secs 2024-04-21T18:48:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:50.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30240.682945 secs 2024-04-21T18:48:50.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:50 smithi191 ceph-mon[31636]: pgmap v16218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:50.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30240.682945 secs 2024-04-21T18:48:50.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:50 smithi170 ceph-mon[31212]: pgmap v16218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:50.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30240.682945 secs 2024-04-21T18:48:50.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:50 smithi077 ceph-mon[27902]: pgmap v16218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:52.417 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:52 smithi077 ceph-mon[27902]: pgmap v16219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:52.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:52 smithi191 ceph-mon[31636]: pgmap v16219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:52.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:52 smithi170 ceph-mon[31212]: pgmap v16219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:53.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30243.924319 secs 2024-04-21T18:48:53.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30243.924319 secs 2024-04-21T18:48:53.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30243.924319 secs 2024-04-21T18:48:54.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:54 smithi191 ceph-mon[31636]: pgmap v16220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:54.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:54 smithi170 ceph-mon[31212]: pgmap v16220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:54 smithi077 ceph-mon[27902]: pgmap v16220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:48:55.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30245.683090 secs 2024-04-21T18:48:55.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30245.683090 secs 2024-04-21T18:48:55.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30245.683090 secs 2024-04-21T18:48:56.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:56 smithi191 ceph-mon[31636]: pgmap v16221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:56.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:56 smithi170 ceph-mon[31212]: pgmap v16221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:56.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:56 smithi077 ceph-mon[27902]: pgmap v16221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:48:58.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:58 smithi191 ceph-mon[31636]: pgmap v16222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:58.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:48:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30248.924423 secs 2024-04-21T18:48:58.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:58 smithi170 ceph-mon[31212]: pgmap v16222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:58.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:48:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30248.924423 secs 2024-04-21T18:48:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:58 smithi077 ceph-mon[27902]: pgmap v16222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:48:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:48:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30248.924423 secs 2024-04-21T18:49:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30250.683209 secs 2024-04-21T18:49:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:00 smithi191 ceph-mon[31636]: pgmap v16223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30250.683209 secs 2024-04-21T18:49:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:00 smithi170 ceph-mon[31212]: pgmap v16223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:00.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30250.683209 secs 2024-04-21T18:49:00.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:00 smithi077 ceph-mon[27902]: pgmap v16223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:02.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:02 smithi191 ceph-mon[31636]: pgmap v16224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:02.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:02 smithi170 ceph-mon[31212]: pgmap v16224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:02.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:02 smithi077 ceph-mon[27902]: pgmap v16224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:03.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30253.924537 secs 2024-04-21T18:49:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30253.924537 secs 2024-04-21T18:49:03.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30253.924537 secs 2024-04-21T18:49:04.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:04 smithi191 ceph-mon[31636]: pgmap v16225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:04 smithi170 ceph-mon[31212]: pgmap v16225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:04 smithi077 ceph-mon[27902]: pgmap v16225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:05.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30255.683324 secs 2024-04-21T18:49:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:05 smithi191 ceph-mon[31636]: osdmap e1086: 12 total, 12 up, 12 in 2024-04-21T18:49:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30255.683324 secs 2024-04-21T18:49:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:05 smithi170 ceph-mon[31212]: osdmap e1086: 12 total, 12 up, 12 in 2024-04-21T18:49:05.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30255.683324 secs 2024-04-21T18:49:05.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:05 smithi077 ceph-mon[27902]: osdmap e1086: 12 total, 12 up, 12 in 2024-04-21T18:49:06.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:06 smithi191 ceph-mon[31636]: pgmap v16227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:49:06.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:06 smithi170 ceph-mon[31212]: pgmap v16227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:49:06.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:06 smithi077 ceph-mon[27902]: pgmap v16227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:49:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:08 smithi191 ceph-mon[31636]: pgmap v16228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:49:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30258.924662 secs 2024-04-21T18:49:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:08 smithi191 ceph-mon[31636]: osdmap e1087: 12 total, 12 up, 12 in 2024-04-21T18:49:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:08 smithi170 ceph-mon[31212]: pgmap v16228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:49:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30258.924662 secs 2024-04-21T18:49:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:08 smithi170 ceph-mon[31212]: osdmap e1087: 12 total, 12 up, 12 in 2024-04-21T18:49:08.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:08 smithi077 ceph-mon[27902]: pgmap v16228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:49:08.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30258.924662 secs 2024-04-21T18:49:08.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:08 smithi077 ceph-mon[27902]: osdmap e1087: 12 total, 12 up, 12 in 2024-04-21T18:49:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30260.683444 secs 2024-04-21T18:49:10.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:10 smithi191 ceph-mon[31636]: pgmap v16230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:49:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30260.683444 secs 2024-04-21T18:49:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:10 smithi170 ceph-mon[31212]: pgmap v16230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:49:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30260.683444 secs 2024-04-21T18:49:10.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:10 smithi077 ceph-mon[27902]: pgmap v16230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T18:49:12.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:12 smithi191 ceph-mon[31636]: pgmap v16231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:49:12.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:12 smithi170 ceph-mon[31212]: pgmap v16231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:49:12.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:12 smithi077 ceph-mon[27902]: pgmap v16231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T18:49:13.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30263.924794 secs 2024-04-21T18:49:13.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30263.924794 secs 2024-04-21T18:49:13.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30263.924794 secs 2024-04-21T18:49:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:14 smithi191 ceph-mon[31636]: pgmap v16232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T18:49:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:14 smithi170 ceph-mon[31212]: pgmap v16232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T18:49:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:14 smithi077 ceph-mon[27902]: pgmap v16232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T18:49:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:15.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30265.683582 secs 2024-04-21T18:49:15.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30265.683582 secs 2024-04-21T18:49:15.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30265.683582 secs 2024-04-21T18:49:16.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:16 smithi170 ceph-mon[31212]: pgmap v16233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:49:16.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:16 smithi077 ceph-mon[27902]: pgmap v16233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:49:16.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:16 smithi191 ceph-mon[31636]: pgmap v16233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:49:18.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:18 smithi170 ceph-mon[31212]: pgmap v16234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:49:18.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30268.924908 secs 2024-04-21T18:49:18.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:18 smithi077 ceph-mon[27902]: pgmap v16234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:49:18.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30268.924908 secs 2024-04-21T18:49:18.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:18 smithi191 ceph-mon[31636]: pgmap v16234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:49:18.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30268.924908 secs 2024-04-21T18:49:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30270.683714 secs 2024-04-21T18:49:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:20 smithi170 ceph-mon[31212]: pgmap v16235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:49:20.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30270.683714 secs 2024-04-21T18:49:20.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:20 smithi077 ceph-mon[27902]: pgmap v16235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:49:20.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30270.683714 secs 2024-04-21T18:49:20.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:20 smithi191 ceph-mon[31636]: pgmap v16235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:49:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:22 smithi170 ceph-mon[31212]: pgmap v16236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:49:22.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:22 smithi077 ceph-mon[27902]: pgmap v16236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:49:22.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:22 smithi191 ceph-mon[31636]: pgmap v16236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:49:23.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30273.925003 secs 2024-04-21T18:49:23.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30273.925003 secs 2024-04-21T18:49:23.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30273.925003 secs 2024-04-21T18:49:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:24 smithi170 ceph-mon[31212]: pgmap v16237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:24.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:24 smithi077 ceph-mon[27902]: pgmap v16237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:24.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:24 smithi191 ceph-mon[31636]: pgmap v16237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:25.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30275.683851 secs 2024-04-21T18:49:25.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30275.683851 secs 2024-04-21T18:49:25.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30275.683851 secs 2024-04-21T18:49:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:26 smithi170 ceph-mon[31212]: pgmap v16238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:26.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:49:26.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:26 smithi077 ceph-mon[27902]: pgmap v16238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:26.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:49:26.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:26 smithi191 ceph-mon[31636]: pgmap v16238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:26.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:49:27.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:49:27.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:49:27.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:49:27.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:49:27.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:49:27.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:49:27.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:49:27.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:49:27.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:49:29.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:28 smithi170 ceph-mon[31212]: pgmap v16239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:29.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30278.925060 secs 2024-04-21T18:49:29.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:28 smithi077 ceph-mon[27902]: pgmap v16239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:29.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30278.925060 secs 2024-04-21T18:49:29.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:28 smithi191 ceph-mon[31636]: pgmap v16239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:29.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30278.925060 secs 2024-04-21T18:49:30.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30280.683972 secs 2024-04-21T18:49:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:30.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30280.683972 secs 2024-04-21T18:49:30.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30280.683972 secs 2024-04-21T18:49:31.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:30 smithi170 ceph-mon[31212]: pgmap v16240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:31.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:30 smithi077 ceph-mon[27902]: pgmap v16240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:31.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:30 smithi191 ceph-mon[31636]: pgmap v16240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:33.001 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:32 smithi191 ceph-mon[31636]: pgmap v16241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:33.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:32 smithi170 ceph-mon[31212]: pgmap v16241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:33.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:32 smithi077 ceph-mon[27902]: pgmap v16241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:34.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30283.925178 secs 2024-04-21T18:49:34.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30283.925178 secs 2024-04-21T18:49:34.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30283.925178 secs 2024-04-21T18:49:35.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:34 smithi170 ceph-mon[31212]: pgmap v16242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:35.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30285.684085 secs 2024-04-21T18:49:35.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:35.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:34 smithi077 ceph-mon[27902]: pgmap v16242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:35.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30285.684085 secs 2024-04-21T18:49:35.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:34 smithi191 ceph-mon[31636]: pgmap v16242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:35.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30285.684085 secs 2024-04-21T18:49:37.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:36 smithi170 ceph-mon[31212]: pgmap v16243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:37.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:36 smithi077 ceph-mon[27902]: pgmap v16243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:37.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:36 smithi191 ceph-mon[31636]: pgmap v16243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:39.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:38 smithi170 ceph-mon[31212]: pgmap v16244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:39.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30288.925295 secs 2024-04-21T18:49:39.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:38 smithi077 ceph-mon[27902]: pgmap v16244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:39.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30288.925295 secs 2024-04-21T18:49:39.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:38 smithi191 ceph-mon[31636]: pgmap v16244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:39.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30288.925295 secs 2024-04-21T18:49:40.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30290.684200 secs 2024-04-21T18:49:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:40.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30290.684200 secs 2024-04-21T18:49:40.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30290.684200 secs 2024-04-21T18:49:41.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:40 smithi170 ceph-mon[31212]: pgmap v16245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:41.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:40 smithi077 ceph-mon[27902]: pgmap v16245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:41.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:40 smithi191 ceph-mon[31636]: pgmap v16245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:43.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:42 smithi170 ceph-mon[31212]: pgmap v16246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:43.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:42 smithi077 ceph-mon[27902]: pgmap v16246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:43.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:42 smithi191 ceph-mon[31636]: pgmap v16246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:44.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30293.925376 secs 2024-04-21T18:49:44.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30293.925376 secs 2024-04-21T18:49:44.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30293.925376 secs 2024-04-21T18:49:45.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:44 smithi170 ceph-mon[31212]: pgmap v16247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:45.037 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30295.684369 secs 2024-04-21T18:49:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:45.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:44 smithi077 ceph-mon[27902]: pgmap v16247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:45.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30295.684369 secs 2024-04-21T18:49:45.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:44 smithi191 ceph-mon[31636]: pgmap v16247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:45.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30295.684369 secs 2024-04-21T18:49:46.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:45 smithi077 ceph-mon[27902]: pgmap v16248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:46.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:45 smithi191 ceph-mon[31636]: pgmap v16248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:46.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:45 smithi170 ceph-mon[31212]: pgmap v16248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:48.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:47 smithi170 ceph-mon[31212]: pgmap v16249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:48.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30298.925491 secs 2024-04-21T18:49:48.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:47 smithi077 ceph-mon[27902]: pgmap v16249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:48.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30298.925491 secs 2024-04-21T18:49:48.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:47 smithi191 ceph-mon[31636]: pgmap v16249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:48.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30298.925491 secs 2024-04-21T18:49:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:50.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30300.684523 secs 2024-04-21T18:49:50.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:49 smithi170 ceph-mon[31212]: pgmap v16250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:50.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30300.684523 secs 2024-04-21T18:49:50.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:49 smithi077 ceph-mon[27902]: pgmap v16250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:50.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30300.684523 secs 2024-04-21T18:49:50.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:49 smithi191 ceph-mon[31636]: pgmap v16250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:52.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:51 smithi170 ceph-mon[31212]: pgmap v16251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:52.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:51 smithi077 ceph-mon[27902]: pgmap v16251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:52.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:51 smithi191 ceph-mon[31636]: pgmap v16251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:53.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30303.925611 secs 2024-04-21T18:49:53.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30303.925611 secs 2024-04-21T18:49:53.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30303.925611 secs 2024-04-21T18:49:54.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:54 smithi170 ceph-mon[31212]: pgmap v16252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:54.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:54 smithi077 ceph-mon[27902]: pgmap v16252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:54.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:54 smithi191 ceph-mon[31636]: pgmap v16252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:49:55.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30305.684640 secs 2024-04-21T18:49:55.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30305.684640 secs 2024-04-21T18:49:55.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30305.684640 secs 2024-04-21T18:49:56.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:56 smithi170 ceph-mon[31212]: pgmap v16253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:56.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:56 smithi077 ceph-mon[27902]: pgmap v16253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:56.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:56 smithi191 ceph-mon[31636]: pgmap v16253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:49:58.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:58 smithi170 ceph-mon[31212]: pgmap v16254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:58.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:49:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30308.925756 secs 2024-04-21T18:49:58.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:58 smithi077 ceph-mon[27902]: pgmap v16254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:58.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:49:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30308.925756 secs 2024-04-21T18:49:58.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:58 smithi191 ceph-mon[31636]: pgmap v16254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:49:58.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:49:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30308.925756 secs 2024-04-21T18:49:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:49:58.547+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:49:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:49:58.547+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:49:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:49:58.547+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:49:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:49:58.547+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:50:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:00.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30310.684761 secs 2024-04-21T18:50:00.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:00 smithi077 ceph-mon[27902]: pgmap v16255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:00.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:50:00.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30310.684761 secs 2024-04-21T18:50:00.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:00 smithi191 ceph-mon[31636]: pgmap v16255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:00.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:50:00.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30310.684761 secs 2024-04-21T18:50:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:00 smithi170 ceph-mon[31212]: pgmap v16255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T18:50:02.339 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:02 smithi170 ceph-mon[31212]: pgmap v16256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:50:02.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:02 smithi077 ceph-mon[27902]: pgmap v16256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:50:02.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:02 smithi191 ceph-mon[31636]: pgmap v16256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T18:50:03.350 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30313.925831 secs 2024-04-21T18:50:03.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30313.925831 secs 2024-04-21T18:50:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30313.925831 secs 2024-04-21T18:50:04.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:04 smithi077 ceph-mon[27902]: pgmap v16257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:50:04.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:04 smithi191 ceph-mon[31636]: pgmap v16257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:50:04.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:04 smithi170 ceph-mon[31212]: pgmap v16257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T18:50:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:05.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30315.684897 secs 2024-04-21T18:50:05.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:05 smithi077 ceph-mon[27902]: osdmap e1088: 12 total, 12 up, 12 in 2024-04-21T18:50:05.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30315.684897 secs 2024-04-21T18:50:05.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:05 smithi191 ceph-mon[31636]: osdmap e1088: 12 total, 12 up, 12 in 2024-04-21T18:50:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30315.684897 secs 2024-04-21T18:50:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:05 smithi170 ceph-mon[31212]: osdmap e1088: 12 total, 12 up, 12 in 2024-04-21T18:50:06.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:06 smithi077 ceph-mon[27902]: pgmap v16259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T18:50:06.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:06 smithi191 ceph-mon[31636]: pgmap v16259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T18:50:06.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:06 smithi170 ceph-mon[31212]: pgmap v16259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T18:50:08.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:08 smithi077 ceph-mon[27902]: pgmap v16260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:50:08.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30318.925924 secs 2024-04-21T18:50:08.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:08 smithi077 ceph-mon[27902]: osdmap e1089: 12 total, 12 up, 12 in 2024-04-21T18:50:08.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:08 smithi191 ceph-mon[31636]: pgmap v16260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:50:08.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30318.925924 secs 2024-04-21T18:50:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:08 smithi191 ceph-mon[31636]: osdmap e1089: 12 total, 12 up, 12 in 2024-04-21T18:50:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:08 smithi170 ceph-mon[31212]: pgmap v16260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:50:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30318.925924 secs 2024-04-21T18:50:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:08 smithi170 ceph-mon[31212]: osdmap e1089: 12 total, 12 up, 12 in 2024-04-21T18:50:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:10.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30320.685020 secs 2024-04-21T18:50:10.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:10 smithi077 ceph-mon[27902]: pgmap v16262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T18:50:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30320.685020 secs 2024-04-21T18:50:10.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:10 smithi191 ceph-mon[31636]: pgmap v16262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T18:50:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30320.685020 secs 2024-04-21T18:50:10.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:10 smithi170 ceph-mon[31212]: pgmap v16262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T18:50:12.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:12 smithi077 ceph-mon[27902]: pgmap v16263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:50:12.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:12 smithi191 ceph-mon[31636]: pgmap v16263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:50:12.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:12 smithi170 ceph-mon[31212]: pgmap v16263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T18:50:13.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30323.926012 secs 2024-04-21T18:50:13.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30323.926012 secs 2024-04-21T18:50:13.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30323.926012 secs 2024-04-21T18:50:14.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:14 smithi077 ceph-mon[27902]: pgmap v16264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T18:50:14.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:14 smithi191 ceph-mon[31636]: pgmap v16264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T18:50:14.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:14 smithi170 ceph-mon[31212]: pgmap v16264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T18:50:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:15.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30325.685165 secs 2024-04-21T18:50:15.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30325.685165 secs 2024-04-21T18:50:15.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30325.685165 secs 2024-04-21T18:50:16.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:16 smithi077 ceph-mon[27902]: pgmap v16265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T18:50:16.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:16 smithi191 ceph-mon[31636]: pgmap v16265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T18:50:16.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:16 smithi170 ceph-mon[31212]: pgmap v16265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T18:50:18.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:18 smithi077 ceph-mon[27902]: pgmap v16266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:50:18.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30328.926078 secs 2024-04-21T18:50:18.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:18 smithi191 ceph-mon[31636]: pgmap v16266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:50:18.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30328.926078 secs 2024-04-21T18:50:18.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:18 smithi170 ceph-mon[31212]: pgmap v16266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:50:18.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30328.926078 secs 2024-04-21T18:50:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:20.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30330.685277 secs 2024-04-21T18:50:20.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:20 smithi077 ceph-mon[27902]: pgmap v16267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:50:20.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30330.685277 secs 2024-04-21T18:50:20.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:20 smithi191 ceph-mon[31636]: pgmap v16267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:50:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30330.685277 secs 2024-04-21T18:50:20.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:20 smithi170 ceph-mon[31212]: pgmap v16267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:50:22.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:22 smithi077 ceph-mon[27902]: pgmap v16268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:50:22.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:22 smithi191 ceph-mon[31636]: pgmap v16268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:50:22.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:22 smithi170 ceph-mon[31212]: pgmap v16268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:50:23.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30333.926196 secs 2024-04-21T18:50:23.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30333.926196 secs 2024-04-21T18:50:23.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30333.926196 secs 2024-04-21T18:50:24.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:24 smithi077 ceph-mon[27902]: pgmap v16269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:24.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:24 smithi191 ceph-mon[31636]: pgmap v16269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:24.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:24 smithi170 ceph-mon[31212]: pgmap v16269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:25.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30335.685391 secs 2024-04-21T18:50:25.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30335.685391 secs 2024-04-21T18:50:25.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30335.685391 secs 2024-04-21T18:50:26.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:26 smithi191 ceph-mon[31636]: pgmap v16270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:26.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:26 smithi170 ceph-mon[31212]: pgmap v16270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:26.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:26 smithi077 ceph-mon[27902]: pgmap v16270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:27.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:50:27.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:50:27.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:50:28.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:28 smithi191 ceph-mon[31636]: pgmap v16271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:28.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30338.926282 secs 2024-04-21T18:50:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:50:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:50:28.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:50:28.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:28 smithi170 ceph-mon[31212]: pgmap v16271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30338.926282 secs 2024-04-21T18:50:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:50:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:50:28.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:50:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:28 smithi077 ceph-mon[27902]: pgmap v16271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30338.926282 secs 2024-04-21T18:50:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:50:28.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:50:28.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:50:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30340.685509 secs 2024-04-21T18:50:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:30 smithi191 ceph-mon[31636]: pgmap v16272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:30.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30340.685509 secs 2024-04-21T18:50:30.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:30 smithi170 ceph-mon[31212]: pgmap v16272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:30.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30340.685509 secs 2024-04-21T18:50:30.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:30 smithi077 ceph-mon[27902]: pgmap v16272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:32.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:32 smithi191 ceph-mon[31636]: pgmap v16273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:32.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:32 smithi170 ceph-mon[31212]: pgmap v16273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:32.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:32 smithi077 ceph-mon[27902]: pgmap v16273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:33.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30343.926392 secs 2024-04-21T18:50:33.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30343.926392 secs 2024-04-21T18:50:33.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30343.926392 secs 2024-04-21T18:50:34.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:34 smithi191 ceph-mon[31636]: pgmap v16274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:34.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:34 smithi170 ceph-mon[31212]: pgmap v16274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:34 smithi077 ceph-mon[27902]: pgmap v16274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:35.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:35.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30345.685654 secs 2024-04-21T18:50:35.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30345.685654 secs 2024-04-21T18:50:35.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30345.685654 secs 2024-04-21T18:50:36.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:36 smithi191 ceph-mon[31636]: pgmap v16275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:36.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:36 smithi170 ceph-mon[31212]: pgmap v16275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:36.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:36 smithi077 ceph-mon[27902]: pgmap v16275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:38.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:38 smithi191 ceph-mon[31636]: pgmap v16276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:38.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30348.926504 secs 2024-04-21T18:50:38.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:38 smithi170 ceph-mon[31212]: pgmap v16276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:38.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30348.926504 secs 2024-04-21T18:50:38.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:38 smithi077 ceph-mon[27902]: pgmap v16276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:38.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30348.926504 secs 2024-04-21T18:50:40.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:40.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30350.685780 secs 2024-04-21T18:50:40.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:40 smithi191 ceph-mon[31636]: pgmap v16277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:40.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30350.685780 secs 2024-04-21T18:50:40.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:40 smithi170 ceph-mon[31212]: pgmap v16277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:40.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30350.685780 secs 2024-04-21T18:50:40.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:40 smithi077 ceph-mon[27902]: pgmap v16277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:42.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:42 smithi191 ceph-mon[31636]: pgmap v16278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:42.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:42 smithi170 ceph-mon[31212]: pgmap v16278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:42.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:42 smithi077 ceph-mon[27902]: pgmap v16278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:43.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30353.926655 secs 2024-04-21T18:50:43.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30353.926655 secs 2024-04-21T18:50:43.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30353.926655 secs 2024-04-21T18:50:44.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:44 smithi191 ceph-mon[31636]: pgmap v16279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:44.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:44 smithi170 ceph-mon[31212]: pgmap v16279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:44 smithi077 ceph-mon[27902]: pgmap v16279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:45.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30355.685908 secs 2024-04-21T18:50:45.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30355.685908 secs 2024-04-21T18:50:45.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30355.685908 secs 2024-04-21T18:50:46.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:46 smithi191 ceph-mon[31636]: pgmap v16280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:46.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:46 smithi170 ceph-mon[31212]: pgmap v16280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:46.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:46 smithi077 ceph-mon[27902]: pgmap v16280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:48.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:48 smithi191 ceph-mon[31636]: pgmap v16281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:48.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30358.926791 secs 2024-04-21T18:50:48.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:48 smithi170 ceph-mon[31212]: pgmap v16281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:48.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30358.926791 secs 2024-04-21T18:50:48.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:48 smithi077 ceph-mon[27902]: pgmap v16281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:48.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30358.926791 secs 2024-04-21T18:50:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:50.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30360.686036 secs 2024-04-21T18:50:50.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:50 smithi191 ceph-mon[31636]: pgmap v16282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30360.686036 secs 2024-04-21T18:50:50.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:50 smithi170 ceph-mon[31212]: pgmap v16282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30360.686036 secs 2024-04-21T18:50:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:50 smithi077 ceph-mon[27902]: pgmap v16282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:52.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:52 smithi191 ceph-mon[31636]: pgmap v16283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:52.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:52 smithi170 ceph-mon[31212]: pgmap v16283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:52.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:52 smithi077 ceph-mon[27902]: pgmap v16283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:53.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30363.926850 secs 2024-04-21T18:50:53.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30363.926850 secs 2024-04-21T18:50:53.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30363.926850 secs 2024-04-21T18:50:54.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:54 smithi191 ceph-mon[31636]: pgmap v16284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:54 smithi170 ceph-mon[31212]: pgmap v16284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:54.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:54 smithi077 ceph-mon[27902]: pgmap v16284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:50:55.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30365.686157 secs 2024-04-21T18:50:55.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30365.686157 secs 2024-04-21T18:50:55.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30365.686157 secs 2024-04-21T18:50:56.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:56 smithi191 ceph-mon[31636]: pgmap v16285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:56.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:56 smithi170 ceph-mon[31212]: pgmap v16285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:56.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:56 smithi077 ceph-mon[27902]: pgmap v16285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:50:58.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:58 smithi170 ceph-mon[31212]: pgmap v16286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:58.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:50:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30368.926970 secs 2024-04-21T18:50:58.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:58 smithi077 ceph-mon[27902]: pgmap v16286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:58.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:50:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30368.926970 secs 2024-04-21T18:50:58.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:58 smithi191 ceph-mon[31636]: pgmap v16286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:50:58.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:50:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30368.926970 secs 2024-04-21T18:51:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:00.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30370.686278 secs 2024-04-21T18:51:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:00 smithi170 ceph-mon[31212]: pgmap v16287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:00.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30370.686278 secs 2024-04-21T18:51:00.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:00 smithi077 ceph-mon[27902]: pgmap v16287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:00.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30370.686278 secs 2024-04-21T18:51:00.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:00 smithi191 ceph-mon[31636]: pgmap v16287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:02.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:02 smithi170 ceph-mon[31212]: pgmap v16288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-04-21T18:51:02.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:02 smithi077 ceph-mon[27902]: pgmap v16288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-04-21T18:51:02.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:02 smithi191 ceph-mon[31636]: pgmap v16288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-04-21T18:51:03.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30373.927090 secs 2024-04-21T18:51:03.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30373.927090 secs 2024-04-21T18:51:03.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30373.927090 secs 2024-04-21T18:51:04.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:04 smithi170 ceph-mon[31212]: pgmap v16289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-04-21T18:51:04.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:04 smithi077 ceph-mon[27902]: pgmap v16289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-04-21T18:51:04.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:04 smithi191 ceph-mon[31636]: pgmap v16289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-04-21T18:51:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30375.686405 secs 2024-04-21T18:51:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:05 smithi170 ceph-mon[31212]: osdmap e1090: 12 total, 12 up, 12 in 2024-04-21T18:51:05.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30375.686405 secs 2024-04-21T18:51:05.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:05 smithi077 ceph-mon[27902]: osdmap e1090: 12 total, 12 up, 12 in 2024-04-21T18:51:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30375.686405 secs 2024-04-21T18:51:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:05 smithi191 ceph-mon[31636]: osdmap e1090: 12 total, 12 up, 12 in 2024-04-21T18:51:06.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:06 smithi170 ceph-mon[31212]: pgmap v16291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-04-21T18:51:06.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:06 smithi077 ceph-mon[27902]: pgmap v16291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-04-21T18:51:06.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:06 smithi191 ceph-mon[31636]: pgmap v16291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-04-21T18:51:08.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:08 smithi170 ceph-mon[31212]: pgmap v16292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:51:08.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30378.927154 secs 2024-04-21T18:51:08.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:08 smithi170 ceph-mon[31212]: osdmap e1091: 12 total, 12 up, 12 in 2024-04-21T18:51:08.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:08 smithi077 ceph-mon[27902]: pgmap v16292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:51:08.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30378.927154 secs 2024-04-21T18:51:08.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:08 smithi077 ceph-mon[27902]: osdmap e1091: 12 total, 12 up, 12 in 2024-04-21T18:51:08.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:08 smithi191 ceph-mon[31636]: pgmap v16292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:51:08.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30378.927154 secs 2024-04-21T18:51:08.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:08 smithi191 ceph-mon[31636]: osdmap e1091: 12 total, 12 up, 12 in 2024-04-21T18:51:10.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30380.686543 secs 2024-04-21T18:51:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:10 smithi170 ceph-mon[31212]: pgmap v16294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-04-21T18:51:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30380.686543 secs 2024-04-21T18:51:10.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:10 smithi077 ceph-mon[27902]: pgmap v16294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-04-21T18:51:10.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30380.686543 secs 2024-04-21T18:51:10.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:10 smithi191 ceph-mon[31636]: pgmap v16294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-04-21T18:51:12.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:12 smithi170 ceph-mon[31212]: pgmap v16295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-04-21T18:51:12.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:12 smithi077 ceph-mon[27902]: pgmap v16295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-04-21T18:51:12.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:12 smithi191 ceph-mon[31636]: pgmap v16295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-04-21T18:51:13.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30383.927270 secs 2024-04-21T18:51:13.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30383.927270 secs 2024-04-21T18:51:13.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30383.927270 secs 2024-04-21T18:51:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:14 smithi170 ceph-mon[31212]: pgmap v16296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 46 KiB/s wr, 20 op/s 2024-04-21T18:51:14.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:14 smithi077 ceph-mon[27902]: pgmap v16296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 46 KiB/s wr, 20 op/s 2024-04-21T18:51:14.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:14 smithi191 ceph-mon[31636]: pgmap v16296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 46 KiB/s wr, 20 op/s 2024-04-21T18:51:15.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:15.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30385.686672 secs 2024-04-21T18:51:15.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30385.686672 secs 2024-04-21T18:51:15.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30385.686672 secs 2024-04-21T18:51:16.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:16 smithi170 ceph-mon[31212]: pgmap v16297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 40 KiB/s wr, 18 op/s 2024-04-21T18:51:16.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:16 smithi077 ceph-mon[27902]: pgmap v16297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 40 KiB/s wr, 18 op/s 2024-04-21T18:51:16.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:16 smithi191 ceph-mon[31636]: pgmap v16297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 40 KiB/s wr, 18 op/s 2024-04-21T18:51:18.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:18 smithi170 ceph-mon[31212]: pgmap v16298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:51:18.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30388.927406 secs 2024-04-21T18:51:18.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:18 smithi077 ceph-mon[27902]: pgmap v16298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:51:18.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30388.927406 secs 2024-04-21T18:51:18.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:18 smithi191 ceph-mon[31636]: pgmap v16298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:51:18.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30388.927406 secs 2024-04-21T18:51:20.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:20.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30390.686825 secs 2024-04-21T18:51:20.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:20 smithi170 ceph-mon[31212]: pgmap v16299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:51:20.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30390.686825 secs 2024-04-21T18:51:20.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:20 smithi077 ceph-mon[27902]: pgmap v16299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:51:20.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30390.686825 secs 2024-04-21T18:51:20.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:20 smithi191 ceph-mon[31636]: pgmap v16299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:51:22.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:22 smithi170 ceph-mon[31212]: pgmap v16300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:51:22.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:22 smithi077 ceph-mon[27902]: pgmap v16300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:51:22.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:22 smithi191 ceph-mon[31636]: pgmap v16300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:51:23.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30393.927544 secs 2024-04-21T18:51:23.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30393.927544 secs 2024-04-21T18:51:23.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30393.927544 secs 2024-04-21T18:51:24.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:24 smithi170 ceph-mon[31212]: pgmap v16301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:24.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:24 smithi077 ceph-mon[27902]: pgmap v16301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:24.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:24 smithi191 ceph-mon[31636]: pgmap v16301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:25.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30395.686928 secs 2024-04-21T18:51:25.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30395.686928 secs 2024-04-21T18:51:25.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30395.686928 secs 2024-04-21T18:51:26.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:26 smithi170 ceph-mon[31212]: pgmap v16302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:26.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:26 smithi077 ceph-mon[27902]: pgmap v16302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:26.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:26 smithi191 ceph-mon[31636]: pgmap v16302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:28 smithi077 ceph-mon[27902]: pgmap v16303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30398.927677 secs 2024-04-21T18:51:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:51:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:51:28.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:51:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:28 smithi191 ceph-mon[31636]: pgmap v16303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30398.927677 secs 2024-04-21T18:51:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:51:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:51:28.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:51:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:28 smithi170 ceph-mon[31212]: pgmap v16303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:28.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30398.927677 secs 2024-04-21T18:51:28.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:51:28.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:51:28.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:51:29.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:51:29.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:51:29.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:51:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:30.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30400.687090 secs 2024-04-21T18:51:30.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:30 smithi077 ceph-mon[27902]: pgmap v16304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:30.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30400.687090 secs 2024-04-21T18:51:30.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:30 smithi191 ceph-mon[31636]: pgmap v16304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:30.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30400.687090 secs 2024-04-21T18:51:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:30 smithi170 ceph-mon[31212]: pgmap v16304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:32.589 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:32 smithi170 ceph-mon[31212]: pgmap v16305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:32.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:32 smithi077 ceph-mon[27902]: pgmap v16305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:32.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:32 smithi191 ceph-mon[31636]: pgmap v16305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:33.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30403.927799 secs 2024-04-21T18:51:33.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30403.927799 secs 2024-04-21T18:51:33.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30403.927799 secs 2024-04-21T18:51:34.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:34 smithi077 ceph-mon[27902]: pgmap v16306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:34.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:34 smithi191 ceph-mon[31636]: pgmap v16306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:34.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:34 smithi170 ceph-mon[31212]: pgmap v16306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:35.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:35.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30405.687181 secs 2024-04-21T18:51:35.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30405.687181 secs 2024-04-21T18:51:35.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30405.687181 secs 2024-04-21T18:51:36.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:36 smithi077 ceph-mon[27902]: pgmap v16307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:36.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:36 smithi191 ceph-mon[31636]: pgmap v16307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:36.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:36 smithi170 ceph-mon[31212]: pgmap v16307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T18:51:38.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:38 smithi077 ceph-mon[27902]: pgmap v16308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:38.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30408.927899 secs 2024-04-21T18:51:38.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:38 smithi191 ceph-mon[31636]: pgmap v16308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:38.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30408.927899 secs 2024-04-21T18:51:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:38 smithi170 ceph-mon[31212]: pgmap v16308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30408.927899 secs 2024-04-21T18:51:40.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:40.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30410.687293 secs 2024-04-21T18:51:40.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:40 smithi077 ceph-mon[27902]: pgmap v16309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:40.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30410.687293 secs 2024-04-21T18:51:40.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:40 smithi191 ceph-mon[31636]: pgmap v16309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30410.687293 secs 2024-04-21T18:51:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:40 smithi170 ceph-mon[31212]: pgmap v16309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:42.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:42 smithi077 ceph-mon[27902]: pgmap v16310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:42.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:42 smithi191 ceph-mon[31636]: pgmap v16310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:42.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:42 smithi170 ceph-mon[31212]: pgmap v16310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:43.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30413.928015 secs 2024-04-21T18:51:43.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30413.928015 secs 2024-04-21T18:51:43.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30413.928015 secs 2024-04-21T18:51:44.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:44 smithi077 ceph-mon[27902]: pgmap v16311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:44.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:44 smithi191 ceph-mon[31636]: pgmap v16311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:44.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:44 smithi170 ceph-mon[31212]: pgmap v16311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:45.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30415.687379 secs 2024-04-21T18:51:45.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30415.687379 secs 2024-04-21T18:51:45.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30415.687379 secs 2024-04-21T18:51:46.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:46 smithi077 ceph-mon[27902]: pgmap v16312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:46.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:46 smithi191 ceph-mon[31636]: pgmap v16312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:46.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:46 smithi170 ceph-mon[31212]: pgmap v16312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:48.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:48 smithi077 ceph-mon[27902]: pgmap v16313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:48.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30418.928157 secs 2024-04-21T18:51:48.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:48 smithi191 ceph-mon[31636]: pgmap v16313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:48.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30418.928157 secs 2024-04-21T18:51:48.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:48 smithi170 ceph-mon[31212]: pgmap v16313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:48.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30418.928157 secs 2024-04-21T18:51:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30420.687504 secs 2024-04-21T18:51:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:50 smithi077 ceph-mon[27902]: pgmap v16314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30420.687504 secs 2024-04-21T18:51:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:50 smithi191 ceph-mon[31636]: pgmap v16314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30420.687504 secs 2024-04-21T18:51:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:50 smithi170 ceph-mon[31212]: pgmap v16314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:52.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:52 smithi077 ceph-mon[27902]: pgmap v16315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:52.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:52 smithi191 ceph-mon[31636]: pgmap v16315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:52.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:52 smithi170 ceph-mon[31212]: pgmap v16315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:53.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30423.928291 secs 2024-04-21T18:51:53.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30423.928291 secs 2024-04-21T18:51:53.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30423.928291 secs 2024-04-21T18:51:54.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:54 smithi191 ceph-mon[31636]: pgmap v16316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:54 smithi170 ceph-mon[31212]: pgmap v16316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:54.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:54 smithi077 ceph-mon[27902]: pgmap v16316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:51:55.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30425.687603 secs 2024-04-21T18:51:55.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30425.687603 secs 2024-04-21T18:51:55.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30425.687603 secs 2024-04-21T18:51:56.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:56 smithi191 ceph-mon[31636]: pgmap v16317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:56.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:56 smithi170 ceph-mon[31212]: pgmap v16317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:56.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:56 smithi077 ceph-mon[27902]: pgmap v16317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:51:58.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:58 smithi191 ceph-mon[31636]: pgmap v16318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:58.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:51:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30428.928414 secs 2024-04-21T18:51:58.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:58 smithi170 ceph-mon[31212]: pgmap v16318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:58.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:51:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30428.928414 secs 2024-04-21T18:51:58.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:58 smithi077 ceph-mon[27902]: pgmap v16318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:51:58.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:51:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30428.928414 secs 2024-04-21T18:52:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:00.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30430.687722 secs 2024-04-21T18:52:00.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:00 smithi191 ceph-mon[31636]: pgmap v16319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:00.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30430.687722 secs 2024-04-21T18:52:00.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:00 smithi170 ceph-mon[31212]: pgmap v16319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:00.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30430.687722 secs 2024-04-21T18:52:00.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:00 smithi077 ceph-mon[27902]: pgmap v16319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:02.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:02 smithi191 ceph-mon[31636]: pgmap v16320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:02.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:02 smithi170 ceph-mon[31212]: pgmap v16320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:02.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:02 smithi077 ceph-mon[27902]: pgmap v16320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:03.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30433.928535 secs 2024-04-21T18:52:03.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30433.928535 secs 2024-04-21T18:52:03.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30433.928535 secs 2024-04-21T18:52:04.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:04 smithi191 ceph-mon[31636]: pgmap v16321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:04.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:04 smithi170 ceph-mon[31212]: pgmap v16321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:04.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:04 smithi077 ceph-mon[27902]: pgmap v16321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30435.687845 secs 2024-04-21T18:52:05.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:05 smithi191 ceph-mon[31636]: osdmap e1092: 12 total, 12 up, 12 in 2024-04-21T18:52:05.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30435.687845 secs 2024-04-21T18:52:05.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:05 smithi170 ceph-mon[31212]: osdmap e1092: 12 total, 12 up, 12 in 2024-04-21T18:52:05.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30435.687845 secs 2024-04-21T18:52:05.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:05 smithi077 ceph-mon[27902]: osdmap e1092: 12 total, 12 up, 12 in 2024-04-21T18:52:06.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:06 smithi191 ceph-mon[31636]: pgmap v16323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:52:06.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:06 smithi170 ceph-mon[31212]: pgmap v16323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:52:06.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:06 smithi077 ceph-mon[27902]: pgmap v16323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:52:08.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:08 smithi191 ceph-mon[31636]: pgmap v16324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:52:08.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30438.928653 secs 2024-04-21T18:52:08.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:08 smithi191 ceph-mon[31636]: osdmap e1093: 12 total, 12 up, 12 in 2024-04-21T18:52:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:08 smithi170 ceph-mon[31212]: pgmap v16324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:52:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30438.928653 secs 2024-04-21T18:52:08.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:08 smithi170 ceph-mon[31212]: osdmap e1093: 12 total, 12 up, 12 in 2024-04-21T18:52:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:08 smithi077 ceph-mon[27902]: pgmap v16324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:52:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30438.928653 secs 2024-04-21T18:52:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:08 smithi077 ceph-mon[27902]: osdmap e1093: 12 total, 12 up, 12 in 2024-04-21T18:52:10.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:10.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30440.687955 secs 2024-04-21T18:52:10.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:10 smithi191 ceph-mon[31636]: pgmap v16326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:52:10.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30440.687955 secs 2024-04-21T18:52:10.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:10 smithi170 ceph-mon[31212]: pgmap v16326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:52:10.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30440.687955 secs 2024-04-21T18:52:10.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:10 smithi077 ceph-mon[27902]: pgmap v16326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:52:12.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:12 smithi191 ceph-mon[31636]: pgmap v16327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:52:12.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:12 smithi170 ceph-mon[31212]: pgmap v16327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:52:12.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:12 smithi077 ceph-mon[27902]: pgmap v16327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:52:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:13.565+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:52:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:13.565+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:52:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:13.565+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:52:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:13.566+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:52:13.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30443.928791 secs 2024-04-21T18:52:13.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30443.928791 secs 2024-04-21T18:52:13.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30443.928791 secs 2024-04-21T18:52:14.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:14 smithi191 ceph-mon[31636]: pgmap v16328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T18:52:14.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:14 smithi170 ceph-mon[31212]: pgmap v16328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T18:52:14.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:14 smithi077 ceph-mon[27902]: pgmap v16328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T18:52:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:15.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30445.688068 secs 2024-04-21T18:52:15.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30445.688068 secs 2024-04-21T18:52:15.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30445.688068 secs 2024-04-21T18:52:16.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:16 smithi191 ceph-mon[31636]: pgmap v16329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:52:16.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:16 smithi170 ceph-mon[31212]: pgmap v16329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:52:16.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:16 smithi077 ceph-mon[27902]: pgmap v16329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:52:18.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:18 smithi191 ceph-mon[31636]: pgmap v16330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:52:18.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30448.928908 secs 2024-04-21T18:52:18.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:18 smithi170 ceph-mon[31212]: pgmap v16330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:52:18.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30448.928908 secs 2024-04-21T18:52:18.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:18 smithi077 ceph-mon[27902]: pgmap v16330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:52:18.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30448.928908 secs 2024-04-21T18:52:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:20.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30450.688186 secs 2024-04-21T18:52:20.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:20 smithi191 ceph-mon[31636]: pgmap v16331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:52:20.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30450.688186 secs 2024-04-21T18:52:20.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:20 smithi170 ceph-mon[31212]: pgmap v16331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:52:20.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30450.688186 secs 2024-04-21T18:52:20.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:20 smithi077 ceph-mon[27902]: pgmap v16331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-21T18:52:22.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:22 smithi191 ceph-mon[31636]: pgmap v16332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:52:22.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:22 smithi170 ceph-mon[31212]: pgmap v16332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:52:22.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:22 smithi077 ceph-mon[27902]: pgmap v16332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:52:23.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30453.929016 secs 2024-04-21T18:52:23.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30453.929016 secs 2024-04-21T18:52:23.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30453.929016 secs 2024-04-21T18:52:24.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:24 smithi170 ceph-mon[31212]: pgmap v16333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:24.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:24 smithi077 ceph-mon[27902]: pgmap v16333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:24.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:24 smithi191 ceph-mon[31636]: pgmap v16333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:25.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30455.688311 secs 2024-04-21T18:52:25.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30455.688311 secs 2024-04-21T18:52:25.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30455.688311 secs 2024-04-21T18:52:26.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:26 smithi170 ceph-mon[31212]: pgmap v16334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:26.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:26 smithi077 ceph-mon[27902]: pgmap v16334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:26.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:26 smithi191 ceph-mon[31636]: pgmap v16334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:28 smithi170 ceph-mon[31212]: pgmap v16335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30458.929130 secs 2024-04-21T18:52:28.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:52:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:28 smithi077 ceph-mon[27902]: pgmap v16335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:28.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30458.929130 secs 2024-04-21T18:52:28.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:52:28.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:28 smithi191 ceph-mon[31636]: pgmap v16335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:28.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30458.929130 secs 2024-04-21T18:52:28.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:52:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:30.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30460.688377 secs 2024-04-21T18:52:30.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: pgmap v16336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:30.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30460.688377 secs 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: pgmap v16336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30460.688377 secs 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: pgmap v16336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:30.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:31.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:52:31.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:52:31.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:52:31.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:52:31.788 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:52:31.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:52:31.949 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:52:32.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:32 smithi170 ceph-mon[31212]: pgmap v16337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:32.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:32 smithi077 ceph-mon[27902]: pgmap v16337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:32.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:32 smithi191 ceph-mon[31636]: pgmap v16337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:33.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30463.929255 secs 2024-04-21T18:52:33.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30463.929255 secs 2024-04-21T18:52:33.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30463.929255 secs 2024-04-21T18:52:34.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:34 smithi170 ceph-mon[31212]: pgmap v16338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:34.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:34 smithi077 ceph-mon[27902]: pgmap v16338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:34.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:34 smithi191 ceph-mon[31636]: pgmap v16338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:35.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30465.688502 secs 2024-04-21T18:52:35.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30465.688502 secs 2024-04-21T18:52:35.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30465.688502 secs 2024-04-21T18:52:36.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:36 smithi170 ceph-mon[31212]: pgmap v16339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:36.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:36 smithi077 ceph-mon[27902]: pgmap v16339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:36.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:36 smithi191 ceph-mon[31636]: pgmap v16339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:38 smithi170 ceph-mon[31212]: pgmap v16340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:38.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30468.929396 secs 2024-04-21T18:52:38.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:38 smithi077 ceph-mon[27902]: pgmap v16340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:38.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30468.929396 secs 2024-04-21T18:52:38.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:38 smithi191 ceph-mon[31636]: pgmap v16340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:38.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30468.929396 secs 2024-04-21T18:52:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30470.688591 secs 2024-04-21T18:52:40.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:40 smithi170 ceph-mon[31212]: pgmap v16341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:40.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30470.688591 secs 2024-04-21T18:52:40.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:40 smithi077 ceph-mon[27902]: pgmap v16341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30470.688591 secs 2024-04-21T18:52:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:40 smithi191 ceph-mon[31636]: pgmap v16341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:42.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:42 smithi170 ceph-mon[31212]: pgmap v16342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:42.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:42 smithi077 ceph-mon[27902]: pgmap v16342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:42.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:42 smithi191 ceph-mon[31636]: pgmap v16342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:43.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30473.929506 secs 2024-04-21T18:52:43.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30473.929506 secs 2024-04-21T18:52:43.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30473.929506 secs 2024-04-21T18:52:44.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:44 smithi170 ceph-mon[31212]: pgmap v16343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:44.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:44 smithi077 ceph-mon[27902]: pgmap v16343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:44 smithi191 ceph-mon[31636]: pgmap v16343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:45.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30475.688726 secs 2024-04-21T18:52:45.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30475.688726 secs 2024-04-21T18:52:45.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30475.688726 secs 2024-04-21T18:52:46.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:46 smithi170 ceph-mon[31212]: pgmap v16344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:46.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:46 smithi077 ceph-mon[27902]: pgmap v16344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:46.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:46 smithi191 ceph-mon[31636]: pgmap v16344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:48.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:48 smithi170 ceph-mon[31212]: pgmap v16345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:48.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30478.929617 secs 2024-04-21T18:52:48.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:48 smithi077 ceph-mon[27902]: pgmap v16345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:48.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30478.929617 secs 2024-04-21T18:52:48.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:48 smithi191 ceph-mon[31636]: pgmap v16345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:48.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30478.929617 secs 2024-04-21T18:52:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30480.688876 secs 2024-04-21T18:52:50.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:50 smithi170 ceph-mon[31212]: pgmap v16346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30480.688876 secs 2024-04-21T18:52:50.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:50 smithi077 ceph-mon[27902]: pgmap v16346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:50.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30480.688876 secs 2024-04-21T18:52:50.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:50 smithi191 ceph-mon[31636]: pgmap v16346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:52.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:52 smithi170 ceph-mon[31212]: pgmap v16347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:52.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:52 smithi077 ceph-mon[27902]: pgmap v16347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:52.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:52 smithi191 ceph-mon[31636]: pgmap v16347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:53.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30483.929735 secs 2024-04-21T18:52:53.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30483.929735 secs 2024-04-21T18:52:53.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30483.929735 secs 2024-04-21T18:52:54.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:54 smithi170 ceph-mon[31212]: pgmap v16348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:54.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:54 smithi077 ceph-mon[27902]: pgmap v16348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:54.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:54 smithi191 ceph-mon[31636]: pgmap v16348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:52:55.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30485.688971 secs 2024-04-21T18:52:55.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30485.688971 secs 2024-04-21T18:52:55.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30485.688971 secs 2024-04-21T18:52:56.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:56 smithi170 ceph-mon[31212]: pgmap v16349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:56.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:56 smithi077 ceph-mon[27902]: pgmap v16349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:56.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:56 smithi191 ceph-mon[31636]: pgmap v16349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:52:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:58.571+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:52:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:58.571+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:52:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:58.572+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:52:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:52:58.572+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:52:58.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:58 smithi170 ceph-mon[31212]: pgmap v16350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:58.786 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:52:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30488.929872 secs 2024-04-21T18:52:58.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:58 smithi077 ceph-mon[27902]: pgmap v16350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:58.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:52:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30488.929872 secs 2024-04-21T18:52:58.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:58 smithi191 ceph-mon[31636]: pgmap v16350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:52:58.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:52:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30488.929872 secs 2024-04-21T18:53:00.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:00.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30490.689108 secs 2024-04-21T18:53:00.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:00 smithi077 ceph-mon[27902]: pgmap v16351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:00.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30490.689108 secs 2024-04-21T18:53:00.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:00 smithi191 ceph-mon[31636]: pgmap v16351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:01.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30490.689108 secs 2024-04-21T18:53:01.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:00 smithi170 ceph-mon[31212]: pgmap v16351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:02.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:02 smithi170 ceph-mon[31212]: pgmap v16352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:02.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:02 smithi077 ceph-mon[27902]: pgmap v16352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:02.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:02 smithi191 ceph-mon[31636]: pgmap v16352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:03.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30493.929994 secs 2024-04-21T18:53:03.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30493.929994 secs 2024-04-21T18:53:04.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30493.929994 secs 2024-04-21T18:53:04.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:04 smithi077 ceph-mon[27902]: pgmap v16353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:04.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:04 smithi191 ceph-mon[31636]: pgmap v16353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:05.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:04 smithi170 ceph-mon[31212]: pgmap v16353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:05.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30495.689225 secs 2024-04-21T18:53:05.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:05 smithi077 ceph-mon[27902]: osdmap e1094: 12 total, 12 up, 12 in 2024-04-21T18:53:05.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30495.689225 secs 2024-04-21T18:53:05.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:05 smithi191 ceph-mon[31636]: osdmap e1094: 12 total, 12 up, 12 in 2024-04-21T18:53:06.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30495.689225 secs 2024-04-21T18:53:06.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:05 smithi170 ceph-mon[31212]: osdmap e1094: 12 total, 12 up, 12 in 2024-04-21T18:53:06.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:06 smithi077 ceph-mon[27902]: pgmap v16355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:53:06.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:06 smithi191 ceph-mon[31636]: pgmap v16355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:53:07.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:06 smithi170 ceph-mon[31212]: pgmap v16355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:53:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:08 smithi077 ceph-mon[27902]: pgmap v16356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:53:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30498.930073 secs 2024-04-21T18:53:08.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:08 smithi077 ceph-mon[27902]: osdmap e1095: 12 total, 12 up, 12 in 2024-04-21T18:53:08.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:08 smithi191 ceph-mon[31636]: pgmap v16356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:53:08.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30498.930073 secs 2024-04-21T18:53:08.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:08 smithi191 ceph-mon[31636]: osdmap e1095: 12 total, 12 up, 12 in 2024-04-21T18:53:09.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:08 smithi170 ceph-mon[31212]: pgmap v16356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:53:09.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30498.930073 secs 2024-04-21T18:53:09.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:08 smithi170 ceph-mon[31212]: osdmap e1095: 12 total, 12 up, 12 in 2024-04-21T18:53:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:10.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30500.689342 secs 2024-04-21T18:53:10.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:10 smithi077 ceph-mon[27902]: pgmap v16358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:53:10.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30500.689342 secs 2024-04-21T18:53:10.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:10 smithi191 ceph-mon[31636]: pgmap v16358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:53:11.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30500.689342 secs 2024-04-21T18:53:11.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:10 smithi170 ceph-mon[31212]: pgmap v16358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:53:12.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:12 smithi077 ceph-mon[27902]: pgmap v16359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:53:12.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:12 smithi191 ceph-mon[31636]: pgmap v16359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:53:13.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:12 smithi170 ceph-mon[31212]: pgmap v16359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:53:13.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30503.930206 secs 2024-04-21T18:53:13.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30503.930206 secs 2024-04-21T18:53:14.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30503.930206 secs 2024-04-21T18:53:14.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:14 smithi077 ceph-mon[27902]: pgmap v16360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:53:14.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:14 smithi191 ceph-mon[31636]: pgmap v16360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:53:15.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:14 smithi170 ceph-mon[31212]: pgmap v16360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:53:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:15.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30505.689475 secs 2024-04-21T18:53:15.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30505.689475 secs 2024-04-21T18:53:16.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30505.689475 secs 2024-04-21T18:53:16.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:16 smithi077 ceph-mon[27902]: pgmap v16361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:53:16.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:16 smithi191 ceph-mon[31636]: pgmap v16361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:53:17.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:16 smithi170 ceph-mon[31212]: pgmap v16361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:53:18.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:18 smithi077 ceph-mon[27902]: pgmap v16362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:53:18.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30508.930339 secs 2024-04-21T18:53:18.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:18 smithi191 ceph-mon[31636]: pgmap v16362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:53:18.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30508.930339 secs 2024-04-21T18:53:19.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:18 smithi170 ceph-mon[31212]: pgmap v16362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:53:19.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30508.930339 secs 2024-04-21T18:53:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:20.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30510.689609 secs 2024-04-21T18:53:20.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:20 smithi077 ceph-mon[27902]: pgmap v16363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:53:20.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30510.689609 secs 2024-04-21T18:53:20.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:20 smithi191 ceph-mon[31636]: pgmap v16363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:53:21.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30510.689609 secs 2024-04-21T18:53:21.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:20 smithi170 ceph-mon[31212]: pgmap v16363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:53:22.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:22 smithi077 ceph-mon[27902]: pgmap v16364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:53:22.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:22 smithi191 ceph-mon[31636]: pgmap v16364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:53:23.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:22 smithi170 ceph-mon[31212]: pgmap v16364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:53:23.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30513.930512 secs 2024-04-21T18:53:23.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30513.930512 secs 2024-04-21T18:53:24.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30513.930512 secs 2024-04-21T18:53:24.865 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:24 smithi077 ceph-mon[27902]: pgmap v16365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:24.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:24 smithi191 ceph-mon[31636]: pgmap v16365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:25.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:24 smithi170 ceph-mon[31212]: pgmap v16365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:25.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30515.689676 secs 2024-04-21T18:53:25.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30515.689676 secs 2024-04-21T18:53:26.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30515.689676 secs 2024-04-21T18:53:26.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:26 smithi077 ceph-mon[27902]: pgmap v16366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:26.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:26 smithi191 ceph-mon[31636]: pgmap v16366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:27.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:26 smithi170 ceph-mon[31212]: pgmap v16366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:28 smithi191 ceph-mon[31636]: pgmap v16367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:28.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30518.930651 secs 2024-04-21T18:53:29.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:28 smithi170 ceph-mon[31212]: pgmap v16367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:29.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30518.930651 secs 2024-04-21T18:53:29.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:28 smithi077 ceph-mon[27902]: pgmap v16367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:29.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30518.930651 secs 2024-04-21T18:53:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30520.689811 secs 2024-04-21T18:53:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:30 smithi191 ceph-mon[31636]: pgmap v16368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30520.689811 secs 2024-04-21T18:53:31.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:30 smithi170 ceph-mon[31212]: pgmap v16368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:31.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30520.689811 secs 2024-04-21T18:53:31.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:30 smithi077 ceph-mon[27902]: pgmap v16368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:53:31.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:31.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:53:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:32.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:32.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:53:32.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:32.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:32.937 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:32 smithi170 ceph-mon[31212]: pgmap v16369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:32.937 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:53:32.937 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:53:32.937 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:32 smithi191 ceph-mon[31636]: pgmap v16369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:32.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:53:32.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:53:32.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:32 smithi077 ceph-mon[27902]: pgmap v16369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:53:33.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:53:33.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:53:33.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30523.930711 secs 2024-04-21T18:53:34.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30523.930711 secs 2024-04-21T18:53:34.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30523.930711 secs 2024-04-21T18:53:34.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:34 smithi191 ceph-mon[31636]: pgmap v16370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:35.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:34 smithi170 ceph-mon[31212]: pgmap v16370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:35.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:34 smithi077 ceph-mon[27902]: pgmap v16370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:35.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30525.689889 secs 2024-04-21T18:53:36.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30525.689889 secs 2024-04-21T18:53:36.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30525.689889 secs 2024-04-21T18:53:36.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:36 smithi191 ceph-mon[31636]: pgmap v16371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:37.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:36 smithi170 ceph-mon[31212]: pgmap v16371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:37.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:36 smithi077 ceph-mon[27902]: pgmap v16371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:38.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:38 smithi191 ceph-mon[31636]: pgmap v16372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:38.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30528.930835 secs 2024-04-21T18:53:39.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:38 smithi170 ceph-mon[31212]: pgmap v16372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:39.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30528.930835 secs 2024-04-21T18:53:39.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:38 smithi077 ceph-mon[27902]: pgmap v16372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:39.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30528.930835 secs 2024-04-21T18:53:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30530.690012 secs 2024-04-21T18:53:40.948 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:40 smithi191 ceph-mon[31636]: pgmap v16373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:41.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30530.690012 secs 2024-04-21T18:53:41.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:40 smithi170 ceph-mon[31212]: pgmap v16373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30530.690012 secs 2024-04-21T18:53:41.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:40 smithi077 ceph-mon[27902]: pgmap v16373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:42.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:42 smithi191 ceph-mon[31636]: pgmap v16374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:43.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:42 smithi170 ceph-mon[31212]: pgmap v16374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:43.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:42 smithi077 ceph-mon[27902]: pgmap v16374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:43.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30533.930968 secs 2024-04-21T18:53:44.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30533.930968 secs 2024-04-21T18:53:44.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30533.930968 secs 2024-04-21T18:53:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:44 smithi191 ceph-mon[31636]: pgmap v16375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:45.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:44 smithi170 ceph-mon[31212]: pgmap v16375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:45.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:45.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:44 smithi077 ceph-mon[27902]: pgmap v16375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:45.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30535.690092 secs 2024-04-21T18:53:46.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30535.690092 secs 2024-04-21T18:53:46.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30535.690092 secs 2024-04-21T18:53:46.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:46 smithi191 ceph-mon[31636]: pgmap v16376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:47.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:46 smithi170 ceph-mon[31212]: pgmap v16376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:47.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:46 smithi077 ceph-mon[27902]: pgmap v16376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:48.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:48 smithi191 ceph-mon[31636]: pgmap v16377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:48.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30538.931052 secs 2024-04-21T18:53:49.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:48 smithi170 ceph-mon[31212]: pgmap v16377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:49.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30538.931052 secs 2024-04-21T18:53:49.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:48 smithi077 ceph-mon[27902]: pgmap v16377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:49.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30538.931052 secs 2024-04-21T18:53:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:50.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30540.690172 secs 2024-04-21T18:53:50.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:50 smithi191 ceph-mon[31636]: pgmap v16378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:51.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30540.690172 secs 2024-04-21T18:53:51.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:50 smithi170 ceph-mon[31212]: pgmap v16378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:51.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30540.690172 secs 2024-04-21T18:53:51.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:50 smithi077 ceph-mon[27902]: pgmap v16378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:52.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:52 smithi191 ceph-mon[31636]: pgmap v16379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:53.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:52 smithi170 ceph-mon[31212]: pgmap v16379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:53.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:52 smithi077 ceph-mon[27902]: pgmap v16379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:53.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30543.931161 secs 2024-04-21T18:53:54.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30543.931161 secs 2024-04-21T18:53:54.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30543.931161 secs 2024-04-21T18:53:54.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:54 smithi191 ceph-mon[31636]: pgmap v16380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:55.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:54 smithi170 ceph-mon[31212]: pgmap v16380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:53:55.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:54 smithi077 ceph-mon[27902]: pgmap v16380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:55.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30545.690260 secs 2024-04-21T18:53:56.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30545.690260 secs 2024-04-21T18:53:56.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30545.690260 secs 2024-04-21T18:53:56.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:56 smithi191 ceph-mon[31636]: pgmap v16381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:57.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:56 smithi170 ceph-mon[31212]: pgmap v16381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:57.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:56 smithi077 ceph-mon[27902]: pgmap v16381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:53:59.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:58 smithi170 ceph-mon[31212]: pgmap v16382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:59.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:53:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30548.931247 secs 2024-04-21T18:53:59.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:58 smithi077 ceph-mon[27902]: pgmap v16382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:59.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:53:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30548.931247 secs 2024-04-21T18:53:59.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:58 smithi191 ceph-mon[31636]: pgmap v16382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:53:59.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:53:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30548.931247 secs 2024-04-21T18:54:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:01.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30550.690400 secs 2024-04-21T18:54:01.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:00 smithi170 ceph-mon[31212]: pgmap v16383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:01.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30550.690400 secs 2024-04-21T18:54:01.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:00 smithi077 ceph-mon[27902]: pgmap v16383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:01.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30550.690400 secs 2024-04-21T18:54:01.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:00 smithi191 ceph-mon[31636]: pgmap v16383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:03.000 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:02 smithi191 ceph-mon[31636]: pgmap v16384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:03.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:02 smithi170 ceph-mon[31212]: pgmap v16384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:03.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:02 smithi077 ceph-mon[27902]: pgmap v16384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:04.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30553.931385 secs 2024-04-21T18:54:04.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30553.931385 secs 2024-04-21T18:54:04.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30553.931385 secs 2024-04-21T18:54:05.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:04 smithi170 ceph-mon[31212]: pgmap v16385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:05.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:04 smithi077 ceph-mon[27902]: pgmap v16385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:05.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:04 smithi191 ceph-mon[31636]: pgmap v16385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:06.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30555.690537 secs 2024-04-21T18:54:06.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:05 smithi170 ceph-mon[31212]: osdmap e1096: 12 total, 12 up, 12 in 2024-04-21T18:54:06.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30555.690537 secs 2024-04-21T18:54:06.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:05 smithi077 ceph-mon[27902]: osdmap e1096: 12 total, 12 up, 12 in 2024-04-21T18:54:06.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30555.690537 secs 2024-04-21T18:54:06.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:05 smithi191 ceph-mon[31636]: osdmap e1096: 12 total, 12 up, 12 in 2024-04-21T18:54:07.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:06 smithi170 ceph-mon[31212]: pgmap v16387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:07.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:06 smithi077 ceph-mon[27902]: pgmap v16387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:07.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:06 smithi191 ceph-mon[31636]: pgmap v16387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:09.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:08 smithi170 ceph-mon[31212]: pgmap v16388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:54:09.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30558.931507 secs 2024-04-21T18:54:09.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:08 smithi077 ceph-mon[27902]: pgmap v16388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:54:09.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30558.931507 secs 2024-04-21T18:54:09.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:08 smithi191 ceph-mon[31636]: pgmap v16388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:54:09.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30558.931507 secs 2024-04-21T18:54:10.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30560.690668 secs 2024-04-21T18:54:10.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:10.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30560.690668 secs 2024-04-21T18:54:10.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30560.690668 secs 2024-04-21T18:54:11.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:10 smithi170 ceph-mon[31212]: pgmap v16389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:54:11.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:10 smithi077 ceph-mon[27902]: pgmap v16389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:54:11.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:10 smithi191 ceph-mon[31636]: pgmap v16389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:54:13.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:12 smithi170 ceph-mon[31212]: pgmap v16390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:13.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:12 smithi077 ceph-mon[27902]: pgmap v16390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:13.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:12 smithi191 ceph-mon[31636]: pgmap v16390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:14.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30563.931628 secs 2024-04-21T18:54:14.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:13 smithi170 ceph-mon[31212]: osdmap e1097: 12 total, 12 up, 12 in 2024-04-21T18:54:14.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30563.931628 secs 2024-04-21T18:54:14.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:13 smithi077 ceph-mon[27902]: osdmap e1097: 12 total, 12 up, 12 in 2024-04-21T18:54:14.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30563.931628 secs 2024-04-21T18:54:14.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:13 smithi191 ceph-mon[31636]: osdmap e1097: 12 total, 12 up, 12 in 2024-04-21T18:54:15.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:14 smithi170 ceph-mon[31212]: pgmap v16391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:15.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30565.690743 secs 2024-04-21T18:54:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:15.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:14 smithi077 ceph-mon[27902]: pgmap v16391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:15.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30565.690743 secs 2024-04-21T18:54:15.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:14 smithi191 ceph-mon[31636]: pgmap v16391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:15.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30565.690743 secs 2024-04-21T18:54:17.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:16 smithi170 ceph-mon[31212]: pgmap v16393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:17.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:16 smithi077 ceph-mon[27902]: pgmap v16393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:17.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:16 smithi191 ceph-mon[31636]: pgmap v16393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:54:19.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:18 smithi170 ceph-mon[31212]: pgmap v16394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:54:19.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30568.931782 secs 2024-04-21T18:54:19.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:18 smithi077 ceph-mon[27902]: pgmap v16394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:54:19.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30568.931782 secs 2024-04-21T18:54:19.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:18 smithi191 ceph-mon[31636]: pgmap v16394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:54:19.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30568.931782 secs 2024-04-21T18:54:20.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30570.690878 secs 2024-04-21T18:54:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:20.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30570.690878 secs 2024-04-21T18:54:20.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30570.690878 secs 2024-04-21T18:54:21.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:20 smithi170 ceph-mon[31212]: pgmap v16395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:54:21.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:20 smithi077 ceph-mon[27902]: pgmap v16395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:54:21.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:20 smithi191 ceph-mon[31636]: pgmap v16395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:54:23.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:22 smithi170 ceph-mon[31212]: pgmap v16396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:23.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:22 smithi077 ceph-mon[27902]: pgmap v16396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:23.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:22 smithi191 ceph-mon[31636]: pgmap v16396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:24.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30573.931909 secs 2024-04-21T18:54:24.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30573.931909 secs 2024-04-21T18:54:24.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30573.931909 secs 2024-04-21T18:54:25.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:24 smithi170 ceph-mon[31212]: pgmap v16397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:25.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30575.690996 secs 2024-04-21T18:54:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:25.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:24 smithi077 ceph-mon[27902]: pgmap v16397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:25.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30575.690996 secs 2024-04-21T18:54:25.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:24 smithi191 ceph-mon[31636]: pgmap v16397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:54:25.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30575.690996 secs 2024-04-21T18:54:27.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:26 smithi170 ceph-mon[31212]: pgmap v16398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:54:27.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:26 smithi077 ceph-mon[27902]: pgmap v16398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:54:27.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:26 smithi191 ceph-mon[31636]: pgmap v16398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:54:29.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:28 smithi170 ceph-mon[31212]: pgmap v16399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:29.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30578.931989 secs 2024-04-21T18:54:29.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:28 smithi077 ceph-mon[27902]: pgmap v16399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:29.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30578.931989 secs 2024-04-21T18:54:29.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:28 smithi191 ceph-mon[31636]: pgmap v16399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:29.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30578.931989 secs 2024-04-21T18:54:30.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30580.691085 secs 2024-04-21T18:54:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:30.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30580.691085 secs 2024-04-21T18:54:30.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30580.691085 secs 2024-04-21T18:54:31.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:30 smithi170 ceph-mon[31212]: pgmap v16400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:31.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:30 smithi077 ceph-mon[27902]: pgmap v16400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:31.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:30 smithi191 ceph-mon[31636]: pgmap v16400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:32 smithi077 ceph-mon[27902]: pgmap v16401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:54:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:32 smithi191 ceph-mon[31636]: pgmap v16401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:33.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:54:33.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:32 smithi170 ceph-mon[31212]: pgmap v16401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:33.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:54:33.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:33.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:34.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30583.932069 secs 2024-04-21T18:54:34.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:34.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:54:34.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:54:34.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30583.932069 secs 2024-04-21T18:54:34.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:34.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:54:34.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:54:34.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30583.932069 secs 2024-04-21T18:54:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:34.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:54:34.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:54:34.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:54:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:35.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:34 smithi077 ceph-mon[27902]: pgmap v16402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:35.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30585.691162 secs 2024-04-21T18:54:35.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:34 smithi191 ceph-mon[31636]: pgmap v16402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:35.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30585.691162 secs 2024-04-21T18:54:35.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:34 smithi170 ceph-mon[31212]: pgmap v16402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:35.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30585.691162 secs 2024-04-21T18:54:37.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:36 smithi077 ceph-mon[27902]: pgmap v16403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:37.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:36 smithi191 ceph-mon[31636]: pgmap v16403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:37.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:36 smithi170 ceph-mon[31212]: pgmap v16403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:39.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:38 smithi077 ceph-mon[27902]: pgmap v16404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:39.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30588.932148 secs 2024-04-21T18:54:39.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:38 smithi191 ceph-mon[31636]: pgmap v16404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:39.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30588.932148 secs 2024-04-21T18:54:39.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:38 smithi170 ceph-mon[31212]: pgmap v16404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:39.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30588.932148 secs 2024-04-21T18:54:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:40.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30590.691228 secs 2024-04-21T18:54:40.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30590.691228 secs 2024-04-21T18:54:40.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30590.691228 secs 2024-04-21T18:54:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:40 smithi077 ceph-mon[27902]: pgmap v16405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:41.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:40 smithi191 ceph-mon[31636]: pgmap v16405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:41.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:40 smithi170 ceph-mon[31212]: pgmap v16405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:43.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:42 smithi077 ceph-mon[27902]: pgmap v16406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:43.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:42 smithi191 ceph-mon[31636]: pgmap v16406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:43.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:42 smithi170 ceph-mon[31212]: pgmap v16406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:44.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30593.932262 secs 2024-04-21T18:54:44.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30593.932262 secs 2024-04-21T18:54:44.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30593.932262 secs 2024-04-21T18:54:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:45.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:44 smithi077 ceph-mon[27902]: pgmap v16407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:45.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30595.691322 secs 2024-04-21T18:54:45.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:44 smithi191 ceph-mon[31636]: pgmap v16407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:45.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30595.691322 secs 2024-04-21T18:54:45.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:44 smithi170 ceph-mon[31212]: pgmap v16407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:45.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30595.691322 secs 2024-04-21T18:54:46.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:45 smithi191 ceph-mon[31636]: pgmap v16408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:46.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:45 smithi170 ceph-mon[31212]: pgmap v16408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:46.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:45 smithi077 ceph-mon[27902]: pgmap v16408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:48.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:48 smithi077 ceph-mon[27902]: pgmap v16409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:48.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30598.932381 secs 2024-04-21T18:54:48.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:48 smithi191 ceph-mon[31636]: pgmap v16409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:48.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30598.932381 secs 2024-04-21T18:54:48.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:48 smithi170 ceph-mon[31212]: pgmap v16409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:48.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30598.932381 secs 2024-04-21T18:54:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:50.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30600.691394 secs 2024-04-21T18:54:50.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:50 smithi077 ceph-mon[27902]: pgmap v16410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:50.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30600.691394 secs 2024-04-21T18:54:50.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:50 smithi191 ceph-mon[31636]: pgmap v16410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30600.691394 secs 2024-04-21T18:54:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:50 smithi170 ceph-mon[31212]: pgmap v16410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:52.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:52 smithi077 ceph-mon[27902]: pgmap v16411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:52.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:52 smithi191 ceph-mon[31636]: pgmap v16411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:52.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:52 smithi170 ceph-mon[31212]: pgmap v16411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:53.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30603.932494 secs 2024-04-21T18:54:53.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30603.932494 secs 2024-04-21T18:54:53.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30603.932494 secs 2024-04-21T18:54:54.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:54 smithi077 ceph-mon[27902]: pgmap v16412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:54.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:54 smithi191 ceph-mon[31636]: pgmap v16412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:54.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:54 smithi170 ceph-mon[31212]: pgmap v16412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:54:55.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30605.691530 secs 2024-04-21T18:54:55.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30605.691530 secs 2024-04-21T18:54:55.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30605.691530 secs 2024-04-21T18:54:56.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:56 smithi077 ceph-mon[27902]: pgmap v16413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:56.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:56 smithi191 ceph-mon[31636]: pgmap v16413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:56.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:56 smithi170 ceph-mon[31212]: pgmap v16413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:54:58.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:58 smithi077 ceph-mon[27902]: pgmap v16414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:58.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:54:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30608.932589 secs 2024-04-21T18:54:58.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:58 smithi191 ceph-mon[31636]: pgmap v16414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:58.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:54:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30608.932589 secs 2024-04-21T18:54:58.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:58 smithi170 ceph-mon[31212]: pgmap v16414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:54:58.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:54:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30608.932589 secs 2024-04-21T18:55:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:00.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30610.691651 secs 2024-04-21T18:55:00.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:00 smithi077 ceph-mon[27902]: pgmap v16415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:00.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30610.691651 secs 2024-04-21T18:55:00.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:00 smithi191 ceph-mon[31636]: pgmap v16415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:00.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30610.691651 secs 2024-04-21T18:55:00.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:00 smithi170 ceph-mon[31212]: pgmap v16415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:02.338 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:02 smithi170 ceph-mon[31212]: pgmap v16416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:02.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:02 smithi077 ceph-mon[27902]: pgmap v16416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:02.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:02 smithi191 ceph-mon[31636]: pgmap v16416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:03.348 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30613.932702 secs 2024-04-21T18:55:03.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30613.932702 secs 2024-04-21T18:55:03.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30613.932702 secs 2024-04-21T18:55:04.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:04 smithi077 ceph-mon[27902]: pgmap v16417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:04.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:04 smithi191 ceph-mon[31636]: pgmap v16417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:04.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:04 smithi170 ceph-mon[31212]: pgmap v16417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30615.691762 secs 2024-04-21T18:55:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:05 smithi077 ceph-mon[27902]: osdmap e1098: 12 total, 12 up, 12 in 2024-04-21T18:55:05.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30615.691762 secs 2024-04-21T18:55:05.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:05 smithi191 ceph-mon[31636]: osdmap e1098: 12 total, 12 up, 12 in 2024-04-21T18:55:05.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30615.691762 secs 2024-04-21T18:55:05.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:05 smithi170 ceph-mon[31212]: osdmap e1098: 12 total, 12 up, 12 in 2024-04-21T18:55:06.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:06 smithi077 ceph-mon[27902]: pgmap v16419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:55:06.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:06 smithi191 ceph-mon[31636]: pgmap v16419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:55:06.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:06 smithi170 ceph-mon[31212]: pgmap v16419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:55:08.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:08 smithi077 ceph-mon[27902]: pgmap v16420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:55:08.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30618.932816 secs 2024-04-21T18:55:08.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:08 smithi191 ceph-mon[31636]: pgmap v16420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:55:08.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30618.932816 secs 2024-04-21T18:55:08.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:08 smithi170 ceph-mon[31212]: pgmap v16420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:55:08.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30618.932816 secs 2024-04-21T18:55:09.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:09 smithi191 ceph-mon[31636]: osdmap e1099: 12 total, 12 up, 12 in 2024-04-21T18:55:09.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:09 smithi170 ceph-mon[31212]: osdmap e1099: 12 total, 12 up, 12 in 2024-04-21T18:55:09.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:09 smithi077 ceph-mon[27902]: osdmap e1099: 12 total, 12 up, 12 in 2024-04-21T18:55:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:10.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30620.691877 secs 2024-04-21T18:55:10.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:10 smithi191 ceph-mon[31636]: pgmap v16422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:55:10.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30620.691877 secs 2024-04-21T18:55:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:10 smithi170 ceph-mon[31212]: pgmap v16422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:55:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30620.691877 secs 2024-04-21T18:55:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:10 smithi077 ceph-mon[27902]: pgmap v16422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:55:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:12 smithi191 ceph-mon[31636]: pgmap v16423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:55:12.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:12 smithi170 ceph-mon[31212]: pgmap v16423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:55:12.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:12 smithi077 ceph-mon[27902]: pgmap v16423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:55:13.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30623.932893 secs 2024-04-21T18:55:13.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30623.932893 secs 2024-04-21T18:55:13.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30623.932893 secs 2024-04-21T18:55:14.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:14 smithi191 ceph-mon[31636]: pgmap v16424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:55:14.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:14 smithi170 ceph-mon[31212]: pgmap v16424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:55:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:14 smithi077 ceph-mon[27902]: pgmap v16424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T18:55:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:15.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30625.691982 secs 2024-04-21T18:55:15.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30625.691982 secs 2024-04-21T18:55:15.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30625.691982 secs 2024-04-21T18:55:16.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:16 smithi191 ceph-mon[31636]: pgmap v16425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:55:16.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:16 smithi170 ceph-mon[31212]: pgmap v16425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:55:16.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:16 smithi077 ceph-mon[27902]: pgmap v16425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:55:18.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:18 smithi191 ceph-mon[31636]: pgmap v16426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:55:18.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30628.932969 secs 2024-04-21T18:55:18.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:18 smithi170 ceph-mon[31212]: pgmap v16426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:55:18.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30628.932969 secs 2024-04-21T18:55:18.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:18 smithi077 ceph-mon[27902]: pgmap v16426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:55:18.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30628.932969 secs 2024-04-21T18:55:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:20.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30630.692099 secs 2024-04-21T18:55:20.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:20 smithi191 ceph-mon[31636]: pgmap v16427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:55:20.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30630.692099 secs 2024-04-21T18:55:20.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:20 smithi170 ceph-mon[31212]: pgmap v16427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:55:20.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30630.692099 secs 2024-04-21T18:55:20.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:20 smithi077 ceph-mon[27902]: pgmap v16427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:55:22.415 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:22 smithi077 ceph-mon[27902]: pgmap v16428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:55:22.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:22 smithi191 ceph-mon[31636]: pgmap v16428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:55:22.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:22 smithi170 ceph-mon[31212]: pgmap v16428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:55:23.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30633.933038 secs 2024-04-21T18:55:23.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30633.933038 secs 2024-04-21T18:55:23.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30633.933038 secs 2024-04-21T18:55:24.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:24 smithi191 ceph-mon[31636]: pgmap v16429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:24.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:24 smithi170 ceph-mon[31212]: pgmap v16429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:24.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:24 smithi077 ceph-mon[27902]: pgmap v16429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:25.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30635.692178 secs 2024-04-21T18:55:25.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30635.692178 secs 2024-04-21T18:55:25.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30635.692178 secs 2024-04-21T18:55:26.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:26 smithi191 ceph-mon[31636]: pgmap v16430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:26.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:26 smithi170 ceph-mon[31212]: pgmap v16430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:26.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:26 smithi077 ceph-mon[27902]: pgmap v16430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:28.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:28 smithi191 ceph-mon[31636]: pgmap v16431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:28.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30638.933152 secs 2024-04-21T18:55:28.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:28 smithi170 ceph-mon[31212]: pgmap v16431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:28.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30638.933152 secs 2024-04-21T18:55:28.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:28 smithi077 ceph-mon[27902]: pgmap v16431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:28.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30638.933152 secs 2024-04-21T18:55:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:30.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30640.692251 secs 2024-04-21T18:55:30.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:30 smithi191 ceph-mon[31636]: pgmap v16432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:30.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30640.692251 secs 2024-04-21T18:55:30.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:30 smithi170 ceph-mon[31212]: pgmap v16432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:30.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30640.692251 secs 2024-04-21T18:55:30.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:30 smithi077 ceph-mon[27902]: pgmap v16432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:32.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:32 smithi191 ceph-mon[31636]: pgmap v16433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:32.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:32 smithi170 ceph-mon[31212]: pgmap v16433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:32.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:32 smithi077 ceph-mon[27902]: pgmap v16433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:33.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30643.933270 secs 2024-04-21T18:55:33.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30643.933270 secs 2024-04-21T18:55:33.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30643.933270 secs 2024-04-21T18:55:34.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:34 smithi191 ceph-mon[31636]: pgmap v16434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:34.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:55:34.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:34 smithi170 ceph-mon[31212]: pgmap v16434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:34.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:55:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:34 smithi077 ceph-mon[27902]: pgmap v16434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:55:35.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:35.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30645.692340 secs 2024-04-21T18:55:35.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:55:35.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:55:35.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:55:35.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30645.692340 secs 2024-04-21T18:55:35.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:55:35.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:55:35.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:55:35.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30645.692340 secs 2024-04-21T18:55:35.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:55:35.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:55:35.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:55:36.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:36 smithi191 ceph-mon[31636]: pgmap v16435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:36.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:36 smithi170 ceph-mon[31212]: pgmap v16435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:36.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:36 smithi077 ceph-mon[27902]: pgmap v16435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:38.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:38 smithi191 ceph-mon[31636]: pgmap v16436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:38.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30648.933386 secs 2024-04-21T18:55:38.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:38 smithi170 ceph-mon[31212]: pgmap v16436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:38.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30648.933386 secs 2024-04-21T18:55:38.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:38 smithi077 ceph-mon[27902]: pgmap v16436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:38.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30648.933386 secs 2024-04-21T18:55:40.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:40.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30650.692435 secs 2024-04-21T18:55:40.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:40 smithi170 ceph-mon[31212]: pgmap v16437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:40.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30650.692435 secs 2024-04-21T18:55:40.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:40 smithi077 ceph-mon[27902]: pgmap v16437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:40.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30650.692435 secs 2024-04-21T18:55:40.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:40 smithi191 ceph-mon[31636]: pgmap v16437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:42.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:42 smithi170 ceph-mon[31212]: pgmap v16438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:42.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:42 smithi077 ceph-mon[27902]: pgmap v16438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:42.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:42 smithi191 ceph-mon[31636]: pgmap v16438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:43.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30653.933505 secs 2024-04-21T18:55:43.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30653.933505 secs 2024-04-21T18:55:43.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30653.933505 secs 2024-04-21T18:55:44.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:44 smithi170 ceph-mon[31212]: pgmap v16439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:44.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:44 smithi077 ceph-mon[27902]: pgmap v16439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:44 smithi191 ceph-mon[31636]: pgmap v16439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:45.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30655.692551 secs 2024-04-21T18:55:45.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30655.692551 secs 2024-04-21T18:55:45.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30655.692551 secs 2024-04-21T18:55:46.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:46 smithi170 ceph-mon[31212]: pgmap v16440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:46.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:46 smithi077 ceph-mon[27902]: pgmap v16440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:46.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:46 smithi191 ceph-mon[31636]: pgmap v16440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:48.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:48 smithi170 ceph-mon[31212]: pgmap v16441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:48.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30658.933569 secs 2024-04-21T18:55:48.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:48 smithi077 ceph-mon[27902]: pgmap v16441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:48.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30658.933569 secs 2024-04-21T18:55:48.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:48 smithi191 ceph-mon[31636]: pgmap v16441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:48.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30658.933569 secs 2024-04-21T18:55:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30660.692669 secs 2024-04-21T18:55:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:50 smithi170 ceph-mon[31212]: pgmap v16442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30660.692669 secs 2024-04-21T18:55:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:50 smithi077 ceph-mon[27902]: pgmap v16442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30660.692669 secs 2024-04-21T18:55:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:50 smithi191 ceph-mon[31636]: pgmap v16442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:52.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:52 smithi170 ceph-mon[31212]: pgmap v16443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:52.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:52 smithi077 ceph-mon[27902]: pgmap v16443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:52.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:52 smithi191 ceph-mon[31636]: pgmap v16443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:53.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30663.933692 secs 2024-04-21T18:55:53.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30663.933692 secs 2024-04-21T18:55:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30663.933692 secs 2024-04-21T18:55:54.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:54 smithi170 ceph-mon[31212]: pgmap v16444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:54.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:54 smithi077 ceph-mon[27902]: pgmap v16444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:54.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:54 smithi191 ceph-mon[31636]: pgmap v16444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:55:55.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30665.692802 secs 2024-04-21T18:55:55.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30665.692802 secs 2024-04-21T18:55:55.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30665.692802 secs 2024-04-21T18:55:56.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:56 smithi170 ceph-mon[31212]: pgmap v16445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:56.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:56 smithi077 ceph-mon[27902]: pgmap v16445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:56.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:56 smithi191 ceph-mon[31636]: pgmap v16445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:55:58.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:58 smithi170 ceph-mon[31212]: pgmap v16446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:58.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:55:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30668.933858 secs 2024-04-21T18:55:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:55:58.597+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:55:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:55:58.597+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:55:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:55:58.597+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:55:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:55:58.597+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:55:58.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:58 smithi077 ceph-mon[27902]: pgmap v16446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:58.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:55:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30668.933858 secs 2024-04-21T18:55:58.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:58 smithi191 ceph-mon[31636]: pgmap v16446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:55:58.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:55:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30668.933858 secs 2024-04-21T18:56:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:00.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30670.692886 secs 2024-04-21T18:56:00.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:00 smithi170 ceph-mon[31212]: pgmap v16447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:00.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30670.692886 secs 2024-04-21T18:56:00.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:00 smithi077 ceph-mon[27902]: pgmap v16447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:00.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30670.692886 secs 2024-04-21T18:56:00.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:00 smithi191 ceph-mon[31636]: pgmap v16447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:02.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:02 smithi170 ceph-mon[31212]: pgmap v16448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T18:56:02.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:02 smithi077 ceph-mon[27902]: pgmap v16448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T18:56:02.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:02 smithi191 ceph-mon[31636]: pgmap v16448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T18:56:03.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30673.933936 secs 2024-04-21T18:56:03.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30673.933936 secs 2024-04-21T18:56:03.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30673.933936 secs 2024-04-21T18:56:04.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:04 smithi170 ceph-mon[31212]: pgmap v16449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T18:56:04.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:04 smithi077 ceph-mon[27902]: pgmap v16449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T18:56:04.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:04 smithi191 ceph-mon[31636]: pgmap v16449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T18:56:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:05.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30675.692994 secs 2024-04-21T18:56:05.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:05 smithi170 ceph-mon[31212]: osdmap e1100: 12 total, 12 up, 12 in 2024-04-21T18:56:05.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30675.692994 secs 2024-04-21T18:56:05.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:05 smithi077 ceph-mon[27902]: osdmap e1100: 12 total, 12 up, 12 in 2024-04-21T18:56:05.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30675.692994 secs 2024-04-21T18:56:05.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:05 smithi191 ceph-mon[31636]: osdmap e1100: 12 total, 12 up, 12 in 2024-04-21T18:56:06.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:06 smithi170 ceph-mon[31212]: pgmap v16451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-04-21T18:56:06.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:06 smithi077 ceph-mon[27902]: pgmap v16451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-04-21T18:56:06.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:06 smithi191 ceph-mon[31636]: pgmap v16451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-04-21T18:56:08.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:08 smithi170 ceph-mon[31212]: pgmap v16452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:56:08.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30678.934011 secs 2024-04-21T18:56:08.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:08 smithi170 ceph-mon[31212]: osdmap e1101: 12 total, 12 up, 12 in 2024-04-21T18:56:08.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:08 smithi077 ceph-mon[27902]: pgmap v16452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:56:08.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30678.934011 secs 2024-04-21T18:56:08.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:08 smithi077 ceph-mon[27902]: osdmap e1101: 12 total, 12 up, 12 in 2024-04-21T18:56:08.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:08 smithi191 ceph-mon[31636]: pgmap v16452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:56:08.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30678.934011 secs 2024-04-21T18:56:08.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:08 smithi191 ceph-mon[31636]: osdmap e1101: 12 total, 12 up, 12 in 2024-04-21T18:56:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:10.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30680.693085 secs 2024-04-21T18:56:10.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:10 smithi170 ceph-mon[31212]: pgmap v16454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-04-21T18:56:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30680.693085 secs 2024-04-21T18:56:10.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:10 smithi077 ceph-mon[27902]: pgmap v16454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-04-21T18:56:10.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30680.693085 secs 2024-04-21T18:56:10.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:10 smithi191 ceph-mon[31636]: pgmap v16454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-04-21T18:56:12.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:12 smithi170 ceph-mon[31212]: pgmap v16455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T18:56:12.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:12 smithi077 ceph-mon[27902]: pgmap v16455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T18:56:12.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:12 smithi191 ceph-mon[31636]: pgmap v16455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T18:56:13.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30683.934092 secs 2024-04-21T18:56:13.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30683.934092 secs 2024-04-21T18:56:13.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30683.934092 secs 2024-04-21T18:56:14.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:14 smithi077 ceph-mon[27902]: pgmap v16456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-04-21T18:56:14.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:14 smithi191 ceph-mon[31636]: pgmap v16456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-04-21T18:56:14.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:14 smithi170 ceph-mon[31212]: pgmap v16456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-04-21T18:56:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:15.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30685.693198 secs 2024-04-21T18:56:15.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30685.693198 secs 2024-04-21T18:56:15.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30685.693198 secs 2024-04-21T18:56:16.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:16 smithi077 ceph-mon[27902]: pgmap v16457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-04-21T18:56:16.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:16 smithi191 ceph-mon[31636]: pgmap v16457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-04-21T18:56:16.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:16 smithi170 ceph-mon[31212]: pgmap v16457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-04-21T18:56:18.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:18 smithi077 ceph-mon[27902]: pgmap v16458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:56:18.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30688.934207 secs 2024-04-21T18:56:18.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:18 smithi191 ceph-mon[31636]: pgmap v16458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:56:18.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30688.934207 secs 2024-04-21T18:56:18.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:18 smithi170 ceph-mon[31212]: pgmap v16458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:56:18.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30688.934207 secs 2024-04-21T18:56:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:20.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30690.693315 secs 2024-04-21T18:56:20.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:20 smithi077 ceph-mon[27902]: pgmap v16459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:56:20.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30690.693315 secs 2024-04-21T18:56:20.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:20 smithi191 ceph-mon[31636]: pgmap v16459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:56:20.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30690.693315 secs 2024-04-21T18:56:20.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:20 smithi170 ceph-mon[31212]: pgmap v16459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:56:22.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:22 smithi077 ceph-mon[27902]: pgmap v16460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:56:22.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:22 smithi191 ceph-mon[31636]: pgmap v16460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:56:22.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:22 smithi170 ceph-mon[31212]: pgmap v16460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:56:23.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30693.934316 secs 2024-04-21T18:56:23.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30693.934316 secs 2024-04-21T18:56:23.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30693.934316 secs 2024-04-21T18:56:24.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:24 smithi077 ceph-mon[27902]: pgmap v16461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:24.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:24 smithi191 ceph-mon[31636]: pgmap v16461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:24.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:24 smithi170 ceph-mon[31212]: pgmap v16461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:25.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30695.693432 secs 2024-04-21T18:56:25.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30695.693432 secs 2024-04-21T18:56:25.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30695.693432 secs 2024-04-21T18:56:26.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:26 smithi077 ceph-mon[27902]: pgmap v16462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:26.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:26 smithi191 ceph-mon[31636]: pgmap v16462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:26.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:26 smithi170 ceph-mon[31212]: pgmap v16462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:28.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:28 smithi077 ceph-mon[27902]: pgmap v16463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:28.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30698.934450 secs 2024-04-21T18:56:28.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:28 smithi191 ceph-mon[31636]: pgmap v16463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:28.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30698.934450 secs 2024-04-21T18:56:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:28 smithi170 ceph-mon[31212]: pgmap v16463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30698.934450 secs 2024-04-21T18:56:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:30.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30700.693544 secs 2024-04-21T18:56:30.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:30 smithi077 ceph-mon[27902]: pgmap v16464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:30.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30700.693544 secs 2024-04-21T18:56:30.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:30 smithi191 ceph-mon[31636]: pgmap v16464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:30.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30700.693544 secs 2024-04-21T18:56:30.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:30 smithi170 ceph-mon[31212]: pgmap v16464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:32.587 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:32 smithi170 ceph-mon[31212]: pgmap v16465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:32.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:32 smithi077 ceph-mon[27902]: pgmap v16465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:32.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:32 smithi191 ceph-mon[31636]: pgmap v16465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:33.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30703.934580 secs 2024-04-21T18:56:33.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30703.934580 secs 2024-04-21T18:56:33.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30703.934580 secs 2024-04-21T18:56:34.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:34 smithi077 ceph-mon[27902]: pgmap v16466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:34.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:56:34.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:34 smithi191 ceph-mon[31636]: pgmap v16466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:34.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:56:34.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:34 smithi170 ceph-mon[31212]: pgmap v16466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:34.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:56:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30705.693664 secs 2024-04-21T18:56:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:56:35.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:56:35.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:56:35.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30705.693664 secs 2024-04-21T18:56:35.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:56:35.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:56:35.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:56:35.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30705.693664 secs 2024-04-21T18:56:35.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:56:35.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:56:35.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:56:36.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:36 smithi077 ceph-mon[27902]: pgmap v16467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:36.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:36 smithi191 ceph-mon[31636]: pgmap v16467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:36.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:36 smithi170 ceph-mon[31212]: pgmap v16467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:38.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:38 smithi077 ceph-mon[27902]: pgmap v16468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:38.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30708.934733 secs 2024-04-21T18:56:38.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:38 smithi191 ceph-mon[31636]: pgmap v16468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:38.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30708.934733 secs 2024-04-21T18:56:38.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:38 smithi170 ceph-mon[31212]: pgmap v16468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:38.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30708.934733 secs 2024-04-21T18:56:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:40.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30710.693784 secs 2024-04-21T18:56:40.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:40 smithi077 ceph-mon[27902]: pgmap v16469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:40.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30710.693784 secs 2024-04-21T18:56:40.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:40 smithi191 ceph-mon[31636]: pgmap v16469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:40.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30710.693784 secs 2024-04-21T18:56:40.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:40 smithi170 ceph-mon[31212]: pgmap v16469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:42.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:42 smithi077 ceph-mon[27902]: pgmap v16470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:42.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:42 smithi191 ceph-mon[31636]: pgmap v16470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:42.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:42 smithi170 ceph-mon[31212]: pgmap v16470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:43.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30713.934831 secs 2024-04-21T18:56:43.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30713.934831 secs 2024-04-21T18:56:43.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30713.934831 secs 2024-04-21T18:56:44.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:44 smithi077 ceph-mon[27902]: pgmap v16471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:44.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:44 smithi191 ceph-mon[31636]: pgmap v16471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:44.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:44 smithi170 ceph-mon[31212]: pgmap v16471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:45.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30715.693903 secs 2024-04-21T18:56:45.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30715.693903 secs 2024-04-21T18:56:45.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30715.693903 secs 2024-04-21T18:56:46.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:46 smithi077 ceph-mon[27902]: pgmap v16472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:46.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:46 smithi191 ceph-mon[31636]: pgmap v16472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:46.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:46 smithi170 ceph-mon[31212]: pgmap v16472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:48.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:48 smithi077 ceph-mon[27902]: pgmap v16473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:48.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30718.934920 secs 2024-04-21T18:56:48.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:48 smithi191 ceph-mon[31636]: pgmap v16473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:48.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30718.934920 secs 2024-04-21T18:56:48.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:48 smithi170 ceph-mon[31212]: pgmap v16473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:48.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30718.934920 secs 2024-04-21T18:56:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30720.694044 secs 2024-04-21T18:56:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:50 smithi191 ceph-mon[31636]: pgmap v16474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:50.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30720.694044 secs 2024-04-21T18:56:50.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:50 smithi170 ceph-mon[31212]: pgmap v16474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30720.694044 secs 2024-04-21T18:56:50.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:50 smithi077 ceph-mon[27902]: pgmap v16474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:52.666 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:52 smithi077 ceph-mon[27902]: pgmap v16475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:52.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:52 smithi191 ceph-mon[31636]: pgmap v16475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:52.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:52 smithi170 ceph-mon[31212]: pgmap v16475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:53.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30723.934999 secs 2024-04-21T18:56:53.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30723.934999 secs 2024-04-21T18:56:53.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30723.934999 secs 2024-04-21T18:56:54.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:54 smithi191 ceph-mon[31636]: pgmap v16476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:54.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:54 smithi170 ceph-mon[31212]: pgmap v16476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:54.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:54 smithi077 ceph-mon[27902]: pgmap v16476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:56:55.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30725.694127 secs 2024-04-21T18:56:55.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30725.694127 secs 2024-04-21T18:56:55.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30725.694127 secs 2024-04-21T18:56:56.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:56 smithi191 ceph-mon[31636]: pgmap v16477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:56.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:56 smithi170 ceph-mon[31212]: pgmap v16477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:56.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:56 smithi077 ceph-mon[27902]: pgmap v16477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:56:58.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:58 smithi191 ceph-mon[31636]: pgmap v16478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:58.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:56:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30728.935060 secs 2024-04-21T18:56:58.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:58 smithi170 ceph-mon[31212]: pgmap v16478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:58.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:56:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30728.935060 secs 2024-04-21T18:56:58.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:58 smithi077 ceph-mon[27902]: pgmap v16478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:56:58.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:56:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30728.935060 secs 2024-04-21T18:57:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:00.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30730.694240 secs 2024-04-21T18:57:00.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:00 smithi191 ceph-mon[31636]: pgmap v16479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:00.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30730.694240 secs 2024-04-21T18:57:00.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:00 smithi170 ceph-mon[31212]: pgmap v16479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:00.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30730.694240 secs 2024-04-21T18:57:00.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:00 smithi077 ceph-mon[27902]: pgmap v16479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:02.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:02 smithi191 ceph-mon[31636]: pgmap v16480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T18:57:02.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:02 smithi170 ceph-mon[31212]: pgmap v16480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T18:57:02.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:02 smithi077 ceph-mon[27902]: pgmap v16480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T18:57:03.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30733.935173 secs 2024-04-21T18:57:03.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30733.935173 secs 2024-04-21T18:57:03.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30733.935173 secs 2024-04-21T18:57:04.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:04 smithi191 ceph-mon[31636]: pgmap v16481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T18:57:04.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:04 smithi170 ceph-mon[31212]: pgmap v16481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T18:57:04.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:04 smithi077 ceph-mon[27902]: pgmap v16481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T18:57:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:05.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30735.694332 secs 2024-04-21T18:57:05.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:05 smithi191 ceph-mon[31636]: osdmap e1102: 12 total, 12 up, 12 in 2024-04-21T18:57:05.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30735.694332 secs 2024-04-21T18:57:05.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:05 smithi170 ceph-mon[31212]: osdmap e1102: 12 total, 12 up, 12 in 2024-04-21T18:57:05.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30735.694332 secs 2024-04-21T18:57:05.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:05 smithi077 ceph-mon[27902]: osdmap e1102: 12 total, 12 up, 12 in 2024-04-21T18:57:06.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:06 smithi191 ceph-mon[31636]: pgmap v16483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T18:57:06.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:06 smithi170 ceph-mon[31212]: pgmap v16483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T18:57:06.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:06 smithi077 ceph-mon[27902]: pgmap v16483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T18:57:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:08 smithi191 ceph-mon[31636]: pgmap v16484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:57:08.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30738.935295 secs 2024-04-21T18:57:08.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:08 smithi191 ceph-mon[31636]: osdmap e1103: 12 total, 12 up, 12 in 2024-04-21T18:57:08.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:08 smithi170 ceph-mon[31212]: pgmap v16484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:57:08.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30738.935295 secs 2024-04-21T18:57:08.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:08 smithi170 ceph-mon[31212]: osdmap e1103: 12 total, 12 up, 12 in 2024-04-21T18:57:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:08 smithi077 ceph-mon[27902]: pgmap v16484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:57:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30738.935295 secs 2024-04-21T18:57:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:08 smithi077 ceph-mon[27902]: osdmap e1103: 12 total, 12 up, 12 in 2024-04-21T18:57:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:10.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30740.694451 secs 2024-04-21T18:57:10.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:10 smithi191 ceph-mon[31636]: pgmap v16486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T18:57:10.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30740.694451 secs 2024-04-21T18:57:10.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:10 smithi170 ceph-mon[31212]: pgmap v16486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T18:57:10.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30740.694451 secs 2024-04-21T18:57:10.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:10 smithi077 ceph-mon[27902]: pgmap v16486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T18:57:12.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:12 smithi191 ceph-mon[31636]: pgmap v16487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T18:57:12.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:12 smithi170 ceph-mon[31212]: pgmap v16487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T18:57:12.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:12 smithi077 ceph-mon[27902]: pgmap v16487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T18:57:13.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30743.935427 secs 2024-04-21T18:57:13.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30743.935427 secs 2024-04-21T18:57:13.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30743.935427 secs 2024-04-21T18:57:14.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:14 smithi191 ceph-mon[31636]: pgmap v16488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 46 KiB/s wr, 30 op/s 2024-04-21T18:57:14.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:14 smithi170 ceph-mon[31212]: pgmap v16488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 46 KiB/s wr, 30 op/s 2024-04-21T18:57:14.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:14 smithi077 ceph-mon[27902]: pgmap v16488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 46 KiB/s wr, 30 op/s 2024-04-21T18:57:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:15.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30745.694565 secs 2024-04-21T18:57:15.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30745.694565 secs 2024-04-21T18:57:15.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30745.694565 secs 2024-04-21T18:57:16.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:16 smithi191 ceph-mon[31636]: pgmap v16489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-21T18:57:16.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:16 smithi170 ceph-mon[31212]: pgmap v16489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-21T18:57:16.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:16 smithi077 ceph-mon[27902]: pgmap v16489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-21T18:57:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:18 smithi191 ceph-mon[31636]: pgmap v16490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:57:18.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30748.935538 secs 2024-04-21T18:57:18.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:18 smithi170 ceph-mon[31212]: pgmap v16490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:57:18.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30748.935538 secs 2024-04-21T18:57:18.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:18 smithi077 ceph-mon[27902]: pgmap v16490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:57:18.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30748.935538 secs 2024-04-21T18:57:20.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:20.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30750.694693 secs 2024-04-21T18:57:20.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:20 smithi191 ceph-mon[31636]: pgmap v16491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:57:20.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30750.694693 secs 2024-04-21T18:57:20.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:20 smithi170 ceph-mon[31212]: pgmap v16491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:57:20.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30750.694693 secs 2024-04-21T18:57:20.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:20 smithi077 ceph-mon[27902]: pgmap v16491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:57:22.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:22 smithi191 ceph-mon[31636]: pgmap v16492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:57:22.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:22 smithi170 ceph-mon[31212]: pgmap v16492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:57:22.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:22 smithi077 ceph-mon[27902]: pgmap v16492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:57:23.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30753.935654 secs 2024-04-21T18:57:23.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30753.935654 secs 2024-04-21T18:57:23.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30753.935654 secs 2024-04-21T18:57:24.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:24 smithi170 ceph-mon[31212]: pgmap v16493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:24.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:24 smithi077 ceph-mon[27902]: pgmap v16493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:24.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:24 smithi191 ceph-mon[31636]: pgmap v16493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:25.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30755.694808 secs 2024-04-21T18:57:25.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30755.694808 secs 2024-04-21T18:57:25.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30755.694808 secs 2024-04-21T18:57:26.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:26 smithi170 ceph-mon[31212]: pgmap v16494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:26.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:26 smithi077 ceph-mon[27902]: pgmap v16494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:26.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:26 smithi191 ceph-mon[31636]: pgmap v16494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30758.935783 secs 2024-04-21T18:57:28.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:28 smithi170 ceph-mon[31212]: pgmap v16495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30758.935783 secs 2024-04-21T18:57:28.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:28 smithi077 ceph-mon[27902]: pgmap v16495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:28.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30758.935783 secs 2024-04-21T18:57:28.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:28 smithi191 ceph-mon[31636]: pgmap v16495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:30.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30760.694926 secs 2024-04-21T18:57:30.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:30 smithi170 ceph-mon[31212]: pgmap v16496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:30.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30760.694926 secs 2024-04-21T18:57:30.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:30 smithi077 ceph-mon[27902]: pgmap v16496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:30.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30760.694926 secs 2024-04-21T18:57:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:30 smithi191 ceph-mon[31636]: pgmap v16496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:32.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:32 smithi170 ceph-mon[31212]: pgmap v16497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:32.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:32 smithi077 ceph-mon[27902]: pgmap v16497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:32.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:32 smithi191 ceph-mon[31636]: pgmap v16497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:33.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30763.935899 secs 2024-04-21T18:57:33.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30763.935899 secs 2024-04-21T18:57:33.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30763.935899 secs 2024-04-21T18:57:34.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:34 smithi170 ceph-mon[31212]: pgmap v16498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:34.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:34 smithi077 ceph-mon[27902]: pgmap v16498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:34.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:34 smithi191 ceph-mon[31636]: pgmap v16498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:35.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30765.695059 secs 2024-04-21T18:57:35.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:57:35.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30765.695059 secs 2024-04-21T18:57:35.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:57:35.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30765.695059 secs 2024-04-21T18:57:35.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:57:36.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:36 smithi170 ceph-mon[31212]: pgmap v16499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:36.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:57:36.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:57:36.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:57:36.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:36 smithi077 ceph-mon[27902]: pgmap v16499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:36.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:57:36.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:57:36.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:57:36.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:36 smithi191 ceph-mon[31636]: pgmap v16499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:36.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:57:36.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:57:36.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:57:38.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30768.936012 secs 2024-04-21T18:57:38.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:38 smithi170 ceph-mon[31212]: pgmap v16500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:38.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30768.936012 secs 2024-04-21T18:57:38.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:38 smithi077 ceph-mon[27902]: pgmap v16500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:38.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30768.936012 secs 2024-04-21T18:57:38.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:38 smithi191 ceph-mon[31636]: pgmap v16500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:40.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30770.695165 secs 2024-04-21T18:57:40.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:40 smithi170 ceph-mon[31212]: pgmap v16501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:40.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30770.695165 secs 2024-04-21T18:57:40.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:40 smithi077 ceph-mon[27902]: pgmap v16501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:40.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30770.695165 secs 2024-04-21T18:57:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:40 smithi191 ceph-mon[31636]: pgmap v16501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:42.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:42 smithi170 ceph-mon[31212]: pgmap v16502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:42.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:42 smithi077 ceph-mon[27902]: pgmap v16502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:42.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:42 smithi191 ceph-mon[31636]: pgmap v16502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:43.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30773.936124 secs 2024-04-21T18:57:43.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30773.936124 secs 2024-04-21T18:57:43.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30773.936124 secs 2024-04-21T18:57:44.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:44 smithi170 ceph-mon[31212]: pgmap v16503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:44.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:44 smithi077 ceph-mon[27902]: pgmap v16503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:44 smithi191 ceph-mon[31636]: pgmap v16503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:45.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30775.695264 secs 2024-04-21T18:57:45.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30775.695264 secs 2024-04-21T18:57:45.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30775.695264 secs 2024-04-21T18:57:46.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:46 smithi170 ceph-mon[31212]: pgmap v16504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:46.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:46 smithi077 ceph-mon[27902]: pgmap v16504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:46.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:46 smithi191 ceph-mon[31636]: pgmap v16504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:48.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30778.936197 secs 2024-04-21T18:57:48.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:48 smithi170 ceph-mon[31212]: pgmap v16505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30778.936197 secs 2024-04-21T18:57:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:48 smithi077 ceph-mon[27902]: pgmap v16505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:48.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30778.936197 secs 2024-04-21T18:57:48.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:48 smithi191 ceph-mon[31636]: pgmap v16505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:50.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30780.695367 secs 2024-04-21T18:57:50.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:50 smithi170 ceph-mon[31212]: pgmap v16506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30780.695367 secs 2024-04-21T18:57:50.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:50 smithi077 ceph-mon[27902]: pgmap v16506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30780.695367 secs 2024-04-21T18:57:50.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:50 smithi191 ceph-mon[31636]: pgmap v16506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:52.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:52 smithi077 ceph-mon[27902]: pgmap v16507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:52.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:52 smithi191 ceph-mon[31636]: pgmap v16507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:53.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:52 smithi170 ceph-mon[31212]: pgmap v16507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:53.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30783.936313 secs 2024-04-21T18:57:53.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30783.936313 secs 2024-04-21T18:57:54.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30783.936313 secs 2024-04-21T18:57:54.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:54 smithi077 ceph-mon[27902]: pgmap v16508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:54.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:54 smithi191 ceph-mon[31636]: pgmap v16508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:55.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:54 smithi170 ceph-mon[31212]: pgmap v16508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:57:55.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30785.695491 secs 2024-04-21T18:57:55.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30785.695491 secs 2024-04-21T18:57:56.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30785.695491 secs 2024-04-21T18:57:56.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:56 smithi077 ceph-mon[27902]: pgmap v16509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:56.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:56 smithi191 ceph-mon[31636]: pgmap v16509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:57.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:56 smithi170 ceph-mon[31212]: pgmap v16509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:57:58.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30788.936453 secs 2024-04-21T18:57:58.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:57:58 smithi077 ceph-mon[27902]: pgmap v16510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:58.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30788.936453 secs 2024-04-21T18:57:58.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:57:58 smithi191 ceph-mon[31636]: pgmap v16510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:57:59.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30788.936453 secs 2024-04-21T18:57:59.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:57:58 smithi170 ceph-mon[31212]: pgmap v16510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:00.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30790.695607 secs 2024-04-21T18:58:00.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:00 smithi077 ceph-mon[27902]: pgmap v16511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:00.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30790.695607 secs 2024-04-21T18:58:00.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:00 smithi191 ceph-mon[31636]: pgmap v16511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:01.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30790.695607 secs 2024-04-21T18:58:01.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:00 smithi170 ceph-mon[31212]: pgmap v16511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:02.837 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:02 smithi170 ceph-mon[31212]: pgmap v16512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:02.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:02 smithi077 ceph-mon[27902]: pgmap v16512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:02.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:02 smithi191 ceph-mon[31636]: pgmap v16512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:03.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30793.936568 secs 2024-04-21T18:58:03.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30793.936568 secs 2024-04-21T18:58:04.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30793.936568 secs 2024-04-21T18:58:04.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:04 smithi077 ceph-mon[27902]: pgmap v16513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:04.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:04 smithi191 ceph-mon[31636]: pgmap v16513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:05.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:04 smithi170 ceph-mon[31212]: pgmap v16513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:05.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30795.695724 secs 2024-04-21T18:58:05.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:05 smithi077 ceph-mon[27902]: osdmap e1104: 12 total, 12 up, 12 in 2024-04-21T18:58:05.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30795.695724 secs 2024-04-21T18:58:05.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:05 smithi191 ceph-mon[31636]: osdmap e1104: 12 total, 12 up, 12 in 2024-04-21T18:58:06.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30795.695724 secs 2024-04-21T18:58:06.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:05 smithi170 ceph-mon[31212]: osdmap e1104: 12 total, 12 up, 12 in 2024-04-21T18:58:06.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:06 smithi077 ceph-mon[27902]: pgmap v16515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:58:06.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:06 smithi191 ceph-mon[31636]: pgmap v16515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:58:07.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:06 smithi170 ceph-mon[31212]: pgmap v16515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:58:08.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30798.936711 secs 2024-04-21T18:58:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:08 smithi077 ceph-mon[27902]: pgmap v16516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:58:08.864 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:08 smithi077 ceph-mon[27902]: osdmap e1105: 12 total, 12 up, 12 in 2024-04-21T18:58:08.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30798.936711 secs 2024-04-21T18:58:08.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:08 smithi191 ceph-mon[31636]: pgmap v16516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:58:08.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:08 smithi191 ceph-mon[31636]: osdmap e1105: 12 total, 12 up, 12 in 2024-04-21T18:58:09.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30798.936711 secs 2024-04-21T18:58:09.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:08 smithi170 ceph-mon[31212]: pgmap v16516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:58:09.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:08 smithi170 ceph-mon[31212]: osdmap e1105: 12 total, 12 up, 12 in 2024-04-21T18:58:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:10.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30800.695887 secs 2024-04-21T18:58:10.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:10 smithi077 ceph-mon[27902]: pgmap v16518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:58:10.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30800.695887 secs 2024-04-21T18:58:10.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:10 smithi191 ceph-mon[31636]: pgmap v16518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:58:11.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30800.695887 secs 2024-04-21T18:58:11.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:10 smithi170 ceph-mon[31212]: pgmap v16518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T18:58:12.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:12 smithi077 ceph-mon[27902]: pgmap v16519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:58:12.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:12 smithi191 ceph-mon[31636]: pgmap v16519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:58:13.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:12 smithi170 ceph-mon[31212]: pgmap v16519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T18:58:13.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30803.936827 secs 2024-04-21T18:58:13.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30803.936827 secs 2024-04-21T18:58:14.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30803.936827 secs 2024-04-21T18:58:14.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:14 smithi077 ceph-mon[27902]: pgmap v16520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:58:14.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:14 smithi191 ceph-mon[31636]: pgmap v16520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:58:15.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:14 smithi170 ceph-mon[31212]: pgmap v16520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T18:58:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:15.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30805.696017 secs 2024-04-21T18:58:15.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30805.696017 secs 2024-04-21T18:58:16.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30805.696017 secs 2024-04-21T18:58:16.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:16 smithi077 ceph-mon[27902]: pgmap v16521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:58:16.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:16 smithi191 ceph-mon[31636]: pgmap v16521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:58:17.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:16 smithi170 ceph-mon[31212]: pgmap v16521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:58:18.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30808.936962 secs 2024-04-21T18:58:18.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:18 smithi191 ceph-mon[31636]: pgmap v16522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:58:19.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30808.936962 secs 2024-04-21T18:58:19.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:18 smithi170 ceph-mon[31212]: pgmap v16522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:58:19.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30808.936962 secs 2024-04-21T18:58:19.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:18 smithi077 ceph-mon[27902]: pgmap v16522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:58:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 30995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:20.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30810.696079 secs 2024-04-21T18:58:20.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:20 smithi191 ceph-mon[31636]: pgmap v16523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:58:21.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30810.696079 secs 2024-04-21T18:58:21.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:20 smithi170 ceph-mon[31212]: pgmap v16523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:58:21.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30810.696079 secs 2024-04-21T18:58:21.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:20 smithi077 ceph-mon[27902]: pgmap v16523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T18:58:22.915 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:22 smithi077 ceph-mon[27902]: pgmap v16524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:58:22.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:22 smithi191 ceph-mon[31636]: pgmap v16524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:58:23.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:22 smithi170 ceph-mon[31212]: pgmap v16524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T18:58:23.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30813.937027 secs 2024-04-21T18:58:24.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30813.937027 secs 2024-04-21T18:58:24.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30813.937027 secs 2024-04-21T18:58:24.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:24 smithi191 ceph-mon[31636]: pgmap v16525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:25.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:24 smithi170 ceph-mon[31212]: pgmap v16525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:25.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:24 smithi077 ceph-mon[27902]: pgmap v16525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:25.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30815.696194 secs 2024-04-21T18:58:26.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30815.696194 secs 2024-04-21T18:58:26.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30815.696194 secs 2024-04-21T18:58:26.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:26 smithi191 ceph-mon[31636]: pgmap v16526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:27.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:26 smithi170 ceph-mon[31212]: pgmap v16526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:27.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:26 smithi077 ceph-mon[27902]: pgmap v16526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:28.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30818.937106 secs 2024-04-21T18:58:28.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:28 smithi191 ceph-mon[31636]: pgmap v16527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:29.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30818.937106 secs 2024-04-21T18:58:29.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:28 smithi170 ceph-mon[31212]: pgmap v16527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:29.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30818.937106 secs 2024-04-21T18:58:29.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:28 smithi077 ceph-mon[27902]: pgmap v16527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:30.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30820.696315 secs 2024-04-21T18:58:30.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:30 smithi191 ceph-mon[31636]: pgmap v16528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:31.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30820.696315 secs 2024-04-21T18:58:31.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:30 smithi170 ceph-mon[31212]: pgmap v16528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:31.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30820.696315 secs 2024-04-21T18:58:31.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:30 smithi077 ceph-mon[27902]: pgmap v16528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:32.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:32 smithi191 ceph-mon[31636]: pgmap v16529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:33.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:32 smithi170 ceph-mon[31212]: pgmap v16529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:33.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:32 smithi077 ceph-mon[27902]: pgmap v16529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:33.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30823.937255 secs 2024-04-21T18:58:34.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30823.937255 secs 2024-04-21T18:58:34.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30823.937255 secs 2024-04-21T18:58:34.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:34 smithi191 ceph-mon[31636]: pgmap v16530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:35.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:34 smithi170 ceph-mon[31212]: pgmap v16530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:35.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:34 smithi077 ceph-mon[27902]: pgmap v16530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:35.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30825.696419 secs 2024-04-21T18:58:36.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30825.696419 secs 2024-04-21T18:58:36.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30825.696419 secs 2024-04-21T18:58:36.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:36 smithi191 ceph-mon[31636]: pgmap v16531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:36.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:58:37.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:36 smithi170 ceph-mon[31212]: pgmap v16531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:37.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:58:37.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:36 smithi077 ceph-mon[27902]: pgmap v16531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:37.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:58:38.740 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30828.937333 secs 2024-04-21T18:58:38.740 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:38 smithi077 ceph-mon[27902]: pgmap v16532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:38.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30828.937333 secs 2024-04-21T18:58:38.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:38 smithi191 ceph-mon[31636]: pgmap v16532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:39.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30828.937333 secs 2024-04-21T18:58:39.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:38 smithi170 ceph-mon[31212]: pgmap v16532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:40.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30830.696533 secs 2024-04-21T18:58:40.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: pgmap v16533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:58:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:58:40.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:41.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30830.696533 secs 2024-04-21T18:58:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: pgmap v16533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:58:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:58:41.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:41.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30830.696533 secs 2024-04-21T18:58:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: pgmap v16533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:58:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:58:41.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:58:42.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:42 smithi191 ceph-mon[31636]: pgmap v16534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:43.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:42 smithi170 ceph-mon[31212]: pgmap v16534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:43.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:42 smithi077 ceph-mon[27902]: pgmap v16534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:43.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30833.937445 secs 2024-04-21T18:58:44.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30833.937445 secs 2024-04-21T18:58:44.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30833.937445 secs 2024-04-21T18:58:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:44 smithi191 ceph-mon[31636]: pgmap v16535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:45.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:44 smithi170 ceph-mon[31212]: pgmap v16535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:44 smithi077 ceph-mon[27902]: pgmap v16535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:45.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30835.696651 secs 2024-04-21T18:58:46.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30835.696651 secs 2024-04-21T18:58:46.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30835.696651 secs 2024-04-21T18:58:46.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:46 smithi191 ceph-mon[31636]: pgmap v16536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:47.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:46 smithi170 ceph-mon[31212]: pgmap v16536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:47.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:46 smithi077 ceph-mon[27902]: pgmap v16536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:48.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30838.937581 secs 2024-04-21T18:58:48.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:48 smithi191 ceph-mon[31636]: pgmap v16537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:49.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30838.937581 secs 2024-04-21T18:58:49.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:48 smithi170 ceph-mon[31212]: pgmap v16537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:49.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30838.937581 secs 2024-04-21T18:58:49.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:48 smithi077 ceph-mon[27902]: pgmap v16537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30840.696794 secs 2024-04-21T18:58:50.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:50 smithi191 ceph-mon[31636]: pgmap v16538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:51.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30840.696794 secs 2024-04-21T18:58:51.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:50 smithi170 ceph-mon[31212]: pgmap v16538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:51.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30840.696794 secs 2024-04-21T18:58:51.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:50 smithi077 ceph-mon[27902]: pgmap v16538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:52.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:52 smithi191 ceph-mon[31636]: pgmap v16539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:53.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:52 smithi170 ceph-mon[31212]: pgmap v16539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:53.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:52 smithi077 ceph-mon[27902]: pgmap v16539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:54.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30843.937716 secs 2024-04-21T18:58:54.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30843.937716 secs 2024-04-21T18:58:54.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30843.937716 secs 2024-04-21T18:58:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.454+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T18:58:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.454+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T18:58:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.454+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:58:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.454+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T18:58:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.454+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:58:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.455+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T18:58:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.455+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efd70034010 tx=0x7efd70054040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efd70034010 tx=0x7efd70054040 comp rx=0 tx=0).stop 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T18:58:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T18:58:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:54.512+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd70034040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T18:58:55.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:54 smithi170 ceph-mon[31212]: pgmap v16540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:58:55.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:54 smithi077 ceph-mon[27902]: pgmap v16540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:55.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:54 smithi191 ceph-mon[31636]: pgmap v16540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:56.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30845.696938 secs 2024-04-21T18:58:56.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30845.696938 secs 2024-04-21T18:58:56.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30845.696938 secs 2024-04-21T18:58:57.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:56 smithi170 ceph-mon[31212]: pgmap v16541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:57.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:56 smithi077 ceph-mon[27902]: pgmap v16541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:57.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:56 smithi191 ceph-mon[31636]: pgmap v16541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:58:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:58.620+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:58:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:58.620+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:58:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:58.621+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T18:58:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T18:58:58.621+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T18:58:59.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30848.937857 secs 2024-04-21T18:58:59.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:58:58 smithi170 ceph-mon[31212]: pgmap v16542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:59.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30848.937857 secs 2024-04-21T18:58:59.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:58:58 smithi077 ceph-mon[27902]: pgmap v16542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:58:59.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30848.937857 secs 2024-04-21T18:58:59.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:58:58 smithi191 ceph-mon[31636]: pgmap v16542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:01.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30850.697015 secs 2024-04-21T18:59:01.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:00 smithi170 ceph-mon[31212]: pgmap v16543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:01.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30850.697015 secs 2024-04-21T18:59:01.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:00 smithi077 ceph-mon[27902]: pgmap v16543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:01.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30850.697015 secs 2024-04-21T18:59:01.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:00 smithi191 ceph-mon[31636]: pgmap v16543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:02.998 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:02 smithi191 ceph-mon[31636]: pgmap v16544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:03.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:02 smithi170 ceph-mon[31212]: pgmap v16544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:03.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:02 smithi077 ceph-mon[27902]: pgmap v16544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:04.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30853.937968 secs 2024-04-21T18:59:04.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30853.937968 secs 2024-04-21T18:59:04.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30853.937968 secs 2024-04-21T18:59:05.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:04 smithi170 ceph-mon[31212]: pgmap v16545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:05.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:04 smithi077 ceph-mon[27902]: pgmap v16545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:05.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:04 smithi191 ceph-mon[31636]: pgmap v16545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:06.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30855.697097 secs 2024-04-21T18:59:06.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:05 smithi170 ceph-mon[31212]: osdmap e1106: 12 total, 12 up, 12 in 2024-04-21T18:59:06.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30855.697097 secs 2024-04-21T18:59:06.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:05 smithi077 ceph-mon[27902]: osdmap e1106: 12 total, 12 up, 12 in 2024-04-21T18:59:06.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30855.697097 secs 2024-04-21T18:59:06.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:05 smithi191 ceph-mon[31636]: osdmap e1106: 12 total, 12 up, 12 in 2024-04-21T18:59:07.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:06 smithi170 ceph-mon[31212]: pgmap v16547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:07.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:06 smithi077 ceph-mon[27902]: pgmap v16547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:07.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:06 smithi191 ceph-mon[31636]: pgmap v16547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:09.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30858.938048 secs 2024-04-21T18:59:09.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:08 smithi170 ceph-mon[31212]: pgmap v16548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:59:09.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30858.938048 secs 2024-04-21T18:59:09.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:08 smithi077 ceph-mon[27902]: pgmap v16548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:59:09.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30858.938048 secs 2024-04-21T18:59:09.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:08 smithi191 ceph-mon[31636]: pgmap v16548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:59:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:11.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30860.697219 secs 2024-04-21T18:59:11.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:10 smithi170 ceph-mon[31212]: pgmap v16549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:59:11.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30860.697219 secs 2024-04-21T18:59:11.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:10 smithi077 ceph-mon[27902]: pgmap v16549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:59:11.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30860.697219 secs 2024-04-21T18:59:11.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:10 smithi191 ceph-mon[31636]: pgmap v16549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T18:59:13.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:12 smithi170 ceph-mon[31212]: pgmap v16550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:13.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:12 smithi077 ceph-mon[27902]: pgmap v16550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:13.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:12 smithi191 ceph-mon[31636]: pgmap v16550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:14.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30863.938168 secs 2024-04-21T18:59:14.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:13 smithi170 ceph-mon[31212]: osdmap e1107: 12 total, 12 up, 12 in 2024-04-21T18:59:14.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30863.938168 secs 2024-04-21T18:59:14.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:13 smithi077 ceph-mon[27902]: osdmap e1107: 12 total, 12 up, 12 in 2024-04-21T18:59:14.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30863.938168 secs 2024-04-21T18:59:14.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:13 smithi191 ceph-mon[31636]: osdmap e1107: 12 total, 12 up, 12 in 2024-04-21T18:59:15.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:14 smithi170 ceph-mon[31212]: pgmap v16551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:15.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:14 smithi077 ceph-mon[27902]: pgmap v16551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:15.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:14 smithi191 ceph-mon[31636]: pgmap v16551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:16.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30865.697371 secs 2024-04-21T18:59:16.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30865.697371 secs 2024-04-21T18:59:16.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30865.697371 secs 2024-04-21T18:59:17.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:16 smithi170 ceph-mon[31212]: pgmap v16553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:17.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:16 smithi077 ceph-mon[27902]: pgmap v16553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:17.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:16 smithi191 ceph-mon[31636]: pgmap v16553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T18:59:19.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30868.938285 secs 2024-04-21T18:59:19.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:18 smithi170 ceph-mon[31212]: pgmap v16554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:59:19.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30868.938285 secs 2024-04-21T18:59:19.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:18 smithi077 ceph-mon[27902]: pgmap v16554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:59:19.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30868.938285 secs 2024-04-21T18:59:19.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:18 smithi191 ceph-mon[31636]: pgmap v16554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:59:20.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30870.697512 secs 2024-04-21T18:59:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:20.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30870.697512 secs 2024-04-21T18:59:20.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30870.697512 secs 2024-04-21T18:59:21.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:20 smithi170 ceph-mon[31212]: pgmap v16555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:59:21.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:20 smithi077 ceph-mon[27902]: pgmap v16555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:59:21.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:20 smithi191 ceph-mon[31636]: pgmap v16555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T18:59:23.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:22 smithi077 ceph-mon[27902]: pgmap v16556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:23.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:22 smithi191 ceph-mon[31636]: pgmap v16556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:23.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:22 smithi170 ceph-mon[31212]: pgmap v16556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:24.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30873.938407 secs 2024-04-21T18:59:24.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30873.938407 secs 2024-04-21T18:59:24.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30873.938407 secs 2024-04-21T18:59:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:25.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:24 smithi077 ceph-mon[27902]: pgmap v16557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:25.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30875.697670 secs 2024-04-21T18:59:25.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:24 smithi191 ceph-mon[31636]: pgmap v16557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:25.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30875.697670 secs 2024-04-21T18:59:25.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:24 smithi170 ceph-mon[31212]: pgmap v16557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T18:59:25.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30875.697670 secs 2024-04-21T18:59:27.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:26 smithi077 ceph-mon[27902]: pgmap v16558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:59:27.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:26 smithi191 ceph-mon[31636]: pgmap v16558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:59:27.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:26 smithi170 ceph-mon[31212]: pgmap v16558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T18:59:29.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30878.938501 secs 2024-04-21T18:59:29.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:28 smithi077 ceph-mon[27902]: pgmap v16559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:29.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30878.938501 secs 2024-04-21T18:59:29.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:28 smithi191 ceph-mon[31636]: pgmap v16559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:29.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30878.938501 secs 2024-04-21T18:59:29.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:28 smithi170 ceph-mon[31212]: pgmap v16559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:30.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30880.697768 secs 2024-04-21T18:59:30.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30880.697768 secs 2024-04-21T18:59:30.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30880.697768 secs 2024-04-21T18:59:31.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:30 smithi077 ceph-mon[27902]: pgmap v16560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:31.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:30 smithi191 ceph-mon[31636]: pgmap v16560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:31.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:30 smithi170 ceph-mon[31212]: pgmap v16560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:33.087 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:32 smithi170 ceph-mon[31212]: pgmap v16561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:33.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:32 smithi077 ceph-mon[27902]: pgmap v16561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:33.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:32 smithi191 ceph-mon[31636]: pgmap v16561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:34.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30883.938659 secs 2024-04-21T18:59:34.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30883.938659 secs 2024-04-21T18:59:34.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30883.938659 secs 2024-04-21T18:59:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:35.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:34 smithi077 ceph-mon[27902]: pgmap v16562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:35.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30885.697900 secs 2024-04-21T18:59:35.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:34 smithi191 ceph-mon[31636]: pgmap v16562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:35.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30885.697900 secs 2024-04-21T18:59:35.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:34 smithi170 ceph-mon[31212]: pgmap v16562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:35.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30885.697900 secs 2024-04-21T18:59:37.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:36 smithi077 ceph-mon[27902]: pgmap v16563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:37.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:36 smithi191 ceph-mon[31636]: pgmap v16563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:36 smithi170 ceph-mon[31212]: pgmap v16563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:39.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30888.938802 secs 2024-04-21T18:59:39.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:38 smithi077 ceph-mon[27902]: pgmap v16564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:39.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30888.938802 secs 2024-04-21T18:59:39.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:38 smithi191 ceph-mon[31636]: pgmap v16564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:39.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30888.938802 secs 2024-04-21T18:59:39.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:38 smithi170 ceph-mon[31212]: pgmap v16564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:40.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:40.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30890.698014 secs 2024-04-21T18:59:40.198 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30890.698014 secs 2024-04-21T18:59:40.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30890.698014 secs 2024-04-21T18:59:41.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:40 smithi077 ceph-mon[27902]: pgmap v16565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:41.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:59:41.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:40 smithi191 ceph-mon[31636]: pgmap v16565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:41.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:59:41.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:40 smithi170 ceph-mon[31212]: pgmap v16565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T18:59:41.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T18:59:43.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:42 smithi170 ceph-mon[31212]: pgmap v16566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:43.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:42 smithi077 ceph-mon[27902]: pgmap v16566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:43.147 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:42 smithi191 ceph-mon[31636]: pgmap v16566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T18:59:44.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30893.938889 secs 2024-04-21T18:59:44.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30893.938889 secs 2024-04-21T18:59:44.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30893.938889 secs 2024-04-21T18:59:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: pgmap v16567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30895.698078 secs 2024-04-21T18:59:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:44.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:59:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:59:44.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: pgmap v16567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30895.698078 secs 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:59:45.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: pgmap v16567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30895.698078 secs 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T18:59:45.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T18:59:47.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:46 smithi077 ceph-mon[27902]: pgmap v16568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:47.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:46 smithi191 ceph-mon[31636]: pgmap v16568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:47.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:46 smithi170 ceph-mon[31212]: pgmap v16568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:49.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30898.938972 secs 2024-04-21T18:59:49.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:48 smithi077 ceph-mon[27902]: pgmap v16569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:49.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30898.938972 secs 2024-04-21T18:59:49.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:48 smithi191 ceph-mon[31636]: pgmap v16569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:49.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30898.938972 secs 2024-04-21T18:59:49.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:48 smithi170 ceph-mon[31212]: pgmap v16569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:50.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:50.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30900.698154 secs 2024-04-21T18:59:50.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30900.698154 secs 2024-04-21T18:59:50.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30900.698154 secs 2024-04-21T18:59:51.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:50 smithi077 ceph-mon[27902]: pgmap v16570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:51.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:50 smithi191 ceph-mon[31636]: pgmap v16570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:51.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:50 smithi170 ceph-mon[31212]: pgmap v16570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:52.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:51 smithi191 ceph-mon[31636]: pgmap v16571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:52.284 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:51 smithi170 ceph-mon[31212]: pgmap v16571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:52.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:51 smithi077 ceph-mon[27902]: pgmap v16571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:53.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30903.939110 secs 2024-04-21T18:59:53.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30903.939110 secs 2024-04-21T18:59:53.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30903.939110 secs 2024-04-21T18:59:54.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:54 smithi077 ceph-mon[27902]: pgmap v16572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:54.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:54 smithi191 ceph-mon[31636]: pgmap v16572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:54.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:54 smithi170 ceph-mon[31212]: pgmap v16572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T18:59:55.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30905.698284 secs 2024-04-21T18:59:55.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30905.698284 secs 2024-04-21T18:59:55.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30905.698284 secs 2024-04-21T18:59:56.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:56 smithi077 ceph-mon[27902]: pgmap v16573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:56.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:56 smithi191 ceph-mon[31636]: pgmap v16573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:56.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:56 smithi170 ceph-mon[31212]: pgmap v16573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T18:59:58.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30908.939173 secs 2024-04-21T18:59:58.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 18:59:58 smithi077 ceph-mon[27902]: pgmap v16574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:58.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30908.939173 secs 2024-04-21T18:59:58.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 18:59:58 smithi191 ceph-mon[31636]: pgmap v16574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T18:59:58.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30908.939173 secs 2024-04-21T18:59:58.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 18:59:58 smithi170 ceph-mon[31212]: pgmap v16574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:00.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30910.698351 secs 2024-04-21T19:00:00.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:00 smithi077 ceph-mon[27902]: pgmap v16575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:00.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:00:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30910.698351 secs 2024-04-21T19:00:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:00 smithi191 ceph-mon[31636]: pgmap v16575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:00.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:00:00.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30910.698351 secs 2024-04-21T19:00:00.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:00 smithi170 ceph-mon[31212]: pgmap v16575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:00.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:00:02.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:02 smithi077 ceph-mon[27902]: pgmap v16576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:02.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:02 smithi191 ceph-mon[31636]: pgmap v16576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:02.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:02 smithi170 ceph-mon[31212]: pgmap v16576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:03.436 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30913.939247 secs 2024-04-21T19:00:03.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30913.939247 secs 2024-04-21T19:00:03.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30913.939247 secs 2024-04-21T19:00:04.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:04 smithi191 ceph-mon[31636]: pgmap v16577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:04.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:04 smithi170 ceph-mon[31212]: pgmap v16577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:04.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:04 smithi077 ceph-mon[27902]: pgmap v16577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:05.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30915.698507 secs 2024-04-21T19:00:05.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:05 smithi191 ceph-mon[31636]: osdmap e1108: 12 total, 12 up, 12 in 2024-04-21T19:00:05.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30915.698507 secs 2024-04-21T19:00:05.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:05 smithi170 ceph-mon[31212]: osdmap e1108: 12 total, 12 up, 12 in 2024-04-21T19:00:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30915.698507 secs 2024-04-21T19:00:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:05 smithi077 ceph-mon[27902]: osdmap e1108: 12 total, 12 up, 12 in 2024-04-21T19:00:06.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:06 smithi191 ceph-mon[31636]: pgmap v16579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:00:06.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:06 smithi170 ceph-mon[31212]: pgmap v16579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:00:06.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:06 smithi077 ceph-mon[27902]: pgmap v16579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:00:08.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30918.939375 secs 2024-04-21T19:00:08.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:08 smithi191 ceph-mon[31636]: pgmap v16580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:00:08.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30918.939375 secs 2024-04-21T19:00:08.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:08 smithi170 ceph-mon[31212]: pgmap v16580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:00:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30918.939375 secs 2024-04-21T19:00:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:08 smithi077 ceph-mon[27902]: pgmap v16580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:00:09.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:09 smithi191 ceph-mon[31636]: osdmap e1109: 12 total, 12 up, 12 in 2024-04-21T19:00:09.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:09 smithi170 ceph-mon[31212]: osdmap e1109: 12 total, 12 up, 12 in 2024-04-21T19:00:09.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:09 smithi077 ceph-mon[27902]: osdmap e1109: 12 total, 12 up, 12 in 2024-04-21T19:00:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30920.698625 secs 2024-04-21T19:00:10.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:10 smithi191 ceph-mon[31636]: pgmap v16582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:00:10.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30920.698625 secs 2024-04-21T19:00:10.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:10 smithi170 ceph-mon[31212]: pgmap v16582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:00:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30920.698625 secs 2024-04-21T19:00:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:10 smithi077 ceph-mon[27902]: pgmap v16582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:00:12.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:12 smithi191 ceph-mon[31636]: pgmap v16583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:00:12.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:12 smithi170 ceph-mon[31212]: pgmap v16583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:00:12.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:12 smithi077 ceph-mon[27902]: pgmap v16583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:00:13.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30923.939492 secs 2024-04-21T19:00:13.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30923.939492 secs 2024-04-21T19:00:13.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30923.939492 secs 2024-04-21T19:00:14.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:14 smithi191 ceph-mon[31636]: pgmap v16584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:00:14.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:14 smithi170 ceph-mon[31212]: pgmap v16584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:00:14.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:14 smithi077 ceph-mon[27902]: pgmap v16584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:00:15.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:15.446 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30925.698724 secs 2024-04-21T19:00:15.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30925.698724 secs 2024-04-21T19:00:15.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30925.698724 secs 2024-04-21T19:00:16.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:16 smithi170 ceph-mon[31212]: pgmap v16585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:00:16.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:16 smithi077 ceph-mon[27902]: pgmap v16585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:00:16.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:16 smithi191 ceph-mon[31636]: pgmap v16585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:00:18.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30928.939605 secs 2024-04-21T19:00:18.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:18 smithi170 ceph-mon[31212]: pgmap v16586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:00:18.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30928.939605 secs 2024-04-21T19:00:18.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:18 smithi077 ceph-mon[27902]: pgmap v16586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:00:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30928.939605 secs 2024-04-21T19:00:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:18 smithi191 ceph-mon[31636]: pgmap v16586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:00:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:20.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30930.698844 secs 2024-04-21T19:00:20.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:20 smithi170 ceph-mon[31212]: pgmap v16587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:00:20.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30930.698844 secs 2024-04-21T19:00:20.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:20 smithi077 ceph-mon[27902]: pgmap v16587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:00:20.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30930.698844 secs 2024-04-21T19:00:20.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:20 smithi191 ceph-mon[31636]: pgmap v16587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:00:22.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:22 smithi170 ceph-mon[31212]: pgmap v16588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:00:22.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:22 smithi077 ceph-mon[27902]: pgmap v16588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:00:22.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:22 smithi191 ceph-mon[31636]: pgmap v16588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:00:23.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30933.939720 secs 2024-04-21T19:00:23.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30933.939720 secs 2024-04-21T19:00:23.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30933.939720 secs 2024-04-21T19:00:24.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:24 smithi170 ceph-mon[31212]: pgmap v16589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:24.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:24 smithi077 ceph-mon[27902]: pgmap v16589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:24.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:24 smithi191 ceph-mon[31636]: pgmap v16589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:25.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30935.698936 secs 2024-04-21T19:00:25.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30935.698936 secs 2024-04-21T19:00:25.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30935.698936 secs 2024-04-21T19:00:26.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:26 smithi170 ceph-mon[31212]: pgmap v16590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:26.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:26 smithi077 ceph-mon[27902]: pgmap v16590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:26.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:26 smithi191 ceph-mon[31636]: pgmap v16590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:28.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30938.939805 secs 2024-04-21T19:00:28.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:28 smithi170 ceph-mon[31212]: pgmap v16591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:00:28.633+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:00:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:00:28.633+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:00:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:00:28.633+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:00:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:00:28.633+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:00:28.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30938.939805 secs 2024-04-21T19:00:28.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:28 smithi077 ceph-mon[27902]: pgmap v16591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:28.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30938.939805 secs 2024-04-21T19:00:28.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:28 smithi191 ceph-mon[31636]: pgmap v16591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:30.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30940.699051 secs 2024-04-21T19:00:30.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:30 smithi170 ceph-mon[31212]: pgmap v16592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:30.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30940.699051 secs 2024-04-21T19:00:30.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:30 smithi077 ceph-mon[27902]: pgmap v16592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:30.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30940.699051 secs 2024-04-21T19:00:30.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:30 smithi191 ceph-mon[31636]: pgmap v16592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:32.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:32 smithi170 ceph-mon[31212]: pgmap v16593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:32.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:32 smithi077 ceph-mon[27902]: pgmap v16593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:32.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:32 smithi191 ceph-mon[31636]: pgmap v16593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:33.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30943.939925 secs 2024-04-21T19:00:33.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30943.939925 secs 2024-04-21T19:00:33.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30943.939925 secs 2024-04-21T19:00:34.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:34 smithi170 ceph-mon[31212]: pgmap v16594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:34.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:34 smithi077 ceph-mon[27902]: pgmap v16594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:34.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:34 smithi191 ceph-mon[31636]: pgmap v16594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:35.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30945.699168 secs 2024-04-21T19:00:35.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30945.699168 secs 2024-04-21T19:00:35.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30945.699168 secs 2024-04-21T19:00:36.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:36 smithi170 ceph-mon[31212]: pgmap v16595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:36.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:36 smithi077 ceph-mon[27902]: pgmap v16595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:36.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:36 smithi191 ceph-mon[31636]: pgmap v16595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:38.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30948.940044 secs 2024-04-21T19:00:38.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:38 smithi170 ceph-mon[31212]: pgmap v16596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:38.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30948.940044 secs 2024-04-21T19:00:38.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:38 smithi077 ceph-mon[27902]: pgmap v16596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:38.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30948.940044 secs 2024-04-21T19:00:38.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:38 smithi191 ceph-mon[31636]: pgmap v16596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:40.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30950.699287 secs 2024-04-21T19:00:40.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:40 smithi170 ceph-mon[31212]: pgmap v16597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:40.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30950.699287 secs 2024-04-21T19:00:40.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:40 smithi077 ceph-mon[27902]: pgmap v16597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:40.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30950.699287 secs 2024-04-21T19:00:40.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:40 smithi191 ceph-mon[31636]: pgmap v16597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:42.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:42 smithi170 ceph-mon[31212]: pgmap v16598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:42.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:42 smithi077 ceph-mon[27902]: pgmap v16598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:42.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:42 smithi191 ceph-mon[31636]: pgmap v16598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:43.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30953.940120 secs 2024-04-21T19:00:43.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30953.940120 secs 2024-04-21T19:00:43.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30953.940120 secs 2024-04-21T19:00:44.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:44 smithi170 ceph-mon[31212]: pgmap v16599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:44.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:44 smithi077 ceph-mon[27902]: pgmap v16599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:44.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:44 smithi191 ceph-mon[31636]: pgmap v16599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:45.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30955.699409 secs 2024-04-21T19:00:45.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:00:45.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30955.699409 secs 2024-04-21T19:00:45.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:00:45.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30955.699409 secs 2024-04-21T19:00:45.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:00:46.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:46 smithi170 ceph-mon[31212]: pgmap v16600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:46.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:00:46.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:00:46.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:00:46.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:46 smithi077 ceph-mon[27902]: pgmap v16600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:46.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:00:46.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:00:46.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:00:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:46 smithi191 ceph-mon[31636]: pgmap v16600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:00:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:00:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:00:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:00:48.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30958.940235 secs 2024-04-21T19:00:48.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:48 smithi170 ceph-mon[31212]: pgmap v16601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:48.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30958.940235 secs 2024-04-21T19:00:48.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:48 smithi077 ceph-mon[27902]: pgmap v16601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:48.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30958.940235 secs 2024-04-21T19:00:48.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:48 smithi191 ceph-mon[31636]: pgmap v16601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:50.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30960.699523 secs 2024-04-21T19:00:50.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:50 smithi170 ceph-mon[31212]: pgmap v16602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:50.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30960.699523 secs 2024-04-21T19:00:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:50 smithi077 ceph-mon[27902]: pgmap v16602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30960.699523 secs 2024-04-21T19:00:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:50 smithi191 ceph-mon[31636]: pgmap v16602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:52 smithi170 ceph-mon[31212]: pgmap v16603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:52 smithi077 ceph-mon[27902]: pgmap v16603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:52.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:52 smithi191 ceph-mon[31636]: pgmap v16603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:53.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30963.940351 secs 2024-04-21T19:00:53.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30963.940351 secs 2024-04-21T19:00:53.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30963.940351 secs 2024-04-21T19:00:54.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:54 smithi077 ceph-mon[27902]: pgmap v16604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:54.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:54 smithi191 ceph-mon[31636]: pgmap v16604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:54.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:54 smithi170 ceph-mon[31212]: pgmap v16604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:00:55.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30965.699665 secs 2024-04-21T19:00:55.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30965.699665 secs 2024-04-21T19:00:55.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30965.699665 secs 2024-04-21T19:00:56.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:56 smithi077 ceph-mon[27902]: pgmap v16605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:56.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:56 smithi191 ceph-mon[31636]: pgmap v16605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:56.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:56 smithi170 ceph-mon[31212]: pgmap v16605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:00:58.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30968.940487 secs 2024-04-21T19:00:58.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:00:58 smithi077 ceph-mon[27902]: pgmap v16606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:58.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30968.940487 secs 2024-04-21T19:00:58.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:00:58 smithi191 ceph-mon[31636]: pgmap v16606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:00:58.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30968.940487 secs 2024-04-21T19:00:58.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:00:58 smithi170 ceph-mon[31212]: pgmap v16606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:00.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30970.699779 secs 2024-04-21T19:01:00.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:00 smithi077 ceph-mon[27902]: pgmap v16607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:00.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30970.699779 secs 2024-04-21T19:01:00.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:00 smithi191 ceph-mon[31636]: pgmap v16607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30970.699779 secs 2024-04-21T19:01:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:00 smithi170 ceph-mon[31212]: pgmap v16607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:02.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:02 smithi077 ceph-mon[27902]: pgmap v16608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:02.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:02 smithi191 ceph-mon[31636]: pgmap v16608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:02.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:02 smithi170 ceph-mon[31212]: pgmap v16608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:03.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30973.940582 secs 2024-04-21T19:01:03.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30973.940582 secs 2024-04-21T19:01:03.685 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30973.940582 secs 2024-04-21T19:01:04.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:04 smithi191 ceph-mon[31636]: pgmap v16609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:04.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:04 smithi077 ceph-mon[27902]: pgmap v16609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:04.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:04 smithi170 ceph-mon[31212]: pgmap v16609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30975.699893 secs 2024-04-21T19:01:05.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:05 smithi077 ceph-mon[27902]: osdmap e1110: 12 total, 12 up, 12 in 2024-04-21T19:01:05.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30975.699893 secs 2024-04-21T19:01:05.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:05 smithi191 ceph-mon[31636]: osdmap e1110: 12 total, 12 up, 12 in 2024-04-21T19:01:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30975.699893 secs 2024-04-21T19:01:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:05 smithi170 ceph-mon[31212]: osdmap e1110: 12 total, 12 up, 12 in 2024-04-21T19:01:06.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:06 smithi077 ceph-mon[27902]: pgmap v16611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:01:06.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:06 smithi191 ceph-mon[31636]: pgmap v16611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:01:06.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:06 smithi170 ceph-mon[31212]: pgmap v16611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:01:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30978.940674 secs 2024-04-21T19:01:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:08 smithi077 ceph-mon[27902]: pgmap v16612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:01:08.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:08 smithi077 ceph-mon[27902]: osdmap e1111: 12 total, 12 up, 12 in 2024-04-21T19:01:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30978.940674 secs 2024-04-21T19:01:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:08 smithi191 ceph-mon[31636]: pgmap v16612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:01:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:08 smithi191 ceph-mon[31636]: osdmap e1111: 12 total, 12 up, 12 in 2024-04-21T19:01:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30978.940674 secs 2024-04-21T19:01:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:08 smithi170 ceph-mon[31212]: pgmap v16612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:01:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:08 smithi170 ceph-mon[31212]: osdmap e1111: 12 total, 12 up, 12 in 2024-04-21T19:01:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30980.700002 secs 2024-04-21T19:01:10.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:10 smithi077 ceph-mon[27902]: pgmap v16614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:01:10.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30980.700002 secs 2024-04-21T19:01:10.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:10 smithi191 ceph-mon[31636]: pgmap v16614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:01:10.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30980.700002 secs 2024-04-21T19:01:10.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:10 smithi170 ceph-mon[31212]: pgmap v16614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:01:12.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:12 smithi077 ceph-mon[27902]: pgmap v16615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:01:12.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:12 smithi191 ceph-mon[31636]: pgmap v16615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:01:12.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:12 smithi170 ceph-mon[31212]: pgmap v16615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:01:13.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30983.940801 secs 2024-04-21T19:01:13.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30983.940801 secs 2024-04-21T19:01:13.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30983.940801 secs 2024-04-21T19:01:14.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:14 smithi077 ceph-mon[27902]: pgmap v16616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T19:01:14.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:14 smithi191 ceph-mon[31636]: pgmap v16616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T19:01:14.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:14 smithi170 ceph-mon[31212]: pgmap v16616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T19:01:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:15.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30985.700086 secs 2024-04-21T19:01:15.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30985.700086 secs 2024-04-21T19:01:15.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30985.700086 secs 2024-04-21T19:01:16.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:16 smithi077 ceph-mon[27902]: pgmap v16617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:01:16.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:16 smithi191 ceph-mon[31636]: pgmap v16617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:01:16.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:16 smithi170 ceph-mon[31212]: pgmap v16617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:01:18.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30988.940930 secs 2024-04-21T19:01:18.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:18 smithi077 ceph-mon[27902]: pgmap v16618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:01:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30988.940930 secs 2024-04-21T19:01:18.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:18 smithi191 ceph-mon[31636]: pgmap v16618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:01:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30988.940930 secs 2024-04-21T19:01:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:18 smithi170 ceph-mon[31212]: pgmap v16618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:01:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:20.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30990.700205 secs 2024-04-21T19:01:20.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:20 smithi077 ceph-mon[27902]: pgmap v16619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:01:20.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30990.700205 secs 2024-04-21T19:01:20.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:20 smithi191 ceph-mon[31636]: pgmap v16619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:01:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30990.700205 secs 2024-04-21T19:01:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:20 smithi170 ceph-mon[31212]: pgmap v16619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:01:22.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:22 smithi077 ceph-mon[27902]: pgmap v16620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:01:22.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:22 smithi191 ceph-mon[31636]: pgmap v16620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:01:22.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:22 smithi170 ceph-mon[31212]: pgmap v16620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:01:23.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30993.941061 secs 2024-04-21T19:01:23.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30993.941061 secs 2024-04-21T19:01:23.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30993.941061 secs 2024-04-21T19:01:24.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:24 smithi191 ceph-mon[31636]: pgmap v16621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:24.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:24 smithi170 ceph-mon[31212]: pgmap v16621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:24.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:24 smithi077 ceph-mon[27902]: pgmap v16621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:25.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 30995.700271 secs 2024-04-21T19:01:25.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 30995.700271 secs 2024-04-21T19:01:25.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 30995.700271 secs 2024-04-21T19:01:26.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:26 smithi191 ceph-mon[31636]: pgmap v16622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:26.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:26 smithi170 ceph-mon[31212]: pgmap v16622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:26.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:26 smithi077 ceph-mon[27902]: pgmap v16622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:28.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 30998.941184 secs 2024-04-21T19:01:28.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:28 smithi191 ceph-mon[31636]: pgmap v16623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:28.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 30998.941184 secs 2024-04-21T19:01:28.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:28 smithi170 ceph-mon[31212]: pgmap v16623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:28.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 30998.941184 secs 2024-04-21T19:01:28.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:28 smithi077 ceph-mon[27902]: pgmap v16623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:30.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31000.700408 secs 2024-04-21T19:01:30.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:30 smithi191 ceph-mon[31636]: pgmap v16624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:30.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31000.700408 secs 2024-04-21T19:01:30.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:30 smithi170 ceph-mon[31212]: pgmap v16624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31000.700408 secs 2024-04-21T19:01:30.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:30 smithi077 ceph-mon[27902]: pgmap v16624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:32.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:32 smithi191 ceph-mon[31636]: pgmap v16625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:32.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:32 smithi170 ceph-mon[31212]: pgmap v16625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:32.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:32 smithi077 ceph-mon[27902]: pgmap v16625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:33.685 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31003.941246 secs 2024-04-21T19:01:33.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31003.941246 secs 2024-04-21T19:01:33.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31003.941246 secs 2024-04-21T19:01:34.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:34 smithi191 ceph-mon[31636]: pgmap v16626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:34.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:34 smithi170 ceph-mon[31212]: pgmap v16626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:34.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:34 smithi077 ceph-mon[27902]: pgmap v16626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:35.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31005.700536 secs 2024-04-21T19:01:35.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31005.700536 secs 2024-04-21T19:01:35.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31005.700536 secs 2024-04-21T19:01:36.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:36 smithi191 ceph-mon[31636]: pgmap v16627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:36.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:36 smithi170 ceph-mon[31212]: pgmap v16627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:36 smithi077 ceph-mon[27902]: pgmap v16627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:38.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31008.941368 secs 2024-04-21T19:01:38.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:38 smithi191 ceph-mon[31636]: pgmap v16628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:38.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31008.941368 secs 2024-04-21T19:01:38.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:38 smithi170 ceph-mon[31212]: pgmap v16628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:38.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31008.941368 secs 2024-04-21T19:01:38.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:38 smithi077 ceph-mon[27902]: pgmap v16628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:40.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31010.700653 secs 2024-04-21T19:01:40.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:40 smithi191 ceph-mon[31636]: pgmap v16629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:40.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31010.700653 secs 2024-04-21T19:01:40.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:40 smithi170 ceph-mon[31212]: pgmap v16629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:40.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31010.700653 secs 2024-04-21T19:01:40.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:40 smithi077 ceph-mon[27902]: pgmap v16629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:42.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:42 smithi191 ceph-mon[31636]: pgmap v16630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:42.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:42 smithi170 ceph-mon[31212]: pgmap v16630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:42 smithi077 ceph-mon[27902]: pgmap v16630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:43.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31013.941488 secs 2024-04-21T19:01:43.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31013.941488 secs 2024-04-21T19:01:43.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31013.941488 secs 2024-04-21T19:01:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:44 smithi191 ceph-mon[31636]: pgmap v16631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:44.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:44 smithi170 ceph-mon[31212]: pgmap v16631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:44 smithi077 ceph-mon[27902]: pgmap v16631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:45.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31015.700781 secs 2024-04-21T19:01:45.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31015.700781 secs 2024-04-21T19:01:45.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31015.700781 secs 2024-04-21T19:01:46.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:46 smithi191 ceph-mon[31636]: pgmap v16632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:01:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:01:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:01:46.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:01:46.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:46 smithi170 ceph-mon[31212]: pgmap v16632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:46.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:01:46.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:01:46.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:01:46.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:01:46.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:46 smithi077 ceph-mon[27902]: pgmap v16632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:46.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:01:46.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:01:46.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:01:46.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:01:48.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31018.941626 secs 2024-04-21T19:01:48.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:48 smithi191 ceph-mon[31636]: pgmap v16633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:48.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31018.941626 secs 2024-04-21T19:01:48.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:48 smithi170 ceph-mon[31212]: pgmap v16633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31018.941626 secs 2024-04-21T19:01:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:48 smithi077 ceph-mon[27902]: pgmap v16633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:50.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31020.700906 secs 2024-04-21T19:01:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:50 smithi191 ceph-mon[31636]: pgmap v16634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:50.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31020.700906 secs 2024-04-21T19:01:50.785 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:50 smithi170 ceph-mon[31212]: pgmap v16634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31020.700906 secs 2024-04-21T19:01:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:50 smithi077 ceph-mon[27902]: pgmap v16634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:52 smithi191 ceph-mon[31636]: pgmap v16635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:52.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:52 smithi170 ceph-mon[31212]: pgmap v16635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:52.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:52 smithi077 ceph-mon[27902]: pgmap v16635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31023.941726 secs 2024-04-21T19:01:53.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31023.941726 secs 2024-04-21T19:01:53.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31023.941726 secs 2024-04-21T19:01:54.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:54 smithi191 ceph-mon[31636]: pgmap v16636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:54.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:54 smithi170 ceph-mon[31212]: pgmap v16636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:54.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:54 smithi077 ceph-mon[27902]: pgmap v16636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:01:55.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31025.701017 secs 2024-04-21T19:01:55.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31025.701017 secs 2024-04-21T19:01:55.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31025.701017 secs 2024-04-21T19:01:56.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:56 smithi191 ceph-mon[31636]: pgmap v16637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:56.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:56 smithi170 ceph-mon[31212]: pgmap v16637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:56.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:56 smithi077 ceph-mon[27902]: pgmap v16637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:01:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:01:58.645+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:01:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:01:58.645+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:01:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:01:58.645+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:01:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:01:58.645+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:01:58.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31028.941833 secs 2024-04-21T19:01:58.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:01:58 smithi170 ceph-mon[31212]: pgmap v16638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:58.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31028.941833 secs 2024-04-21T19:01:58.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:01:58 smithi077 ceph-mon[27902]: pgmap v16638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:01:58.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31028.941833 secs 2024-04-21T19:01:58.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:01:58 smithi191 ceph-mon[31636]: pgmap v16638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31030.701126 secs 2024-04-21T19:02:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:00 smithi170 ceph-mon[31212]: pgmap v16639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31030.701126 secs 2024-04-21T19:02:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:00 smithi077 ceph-mon[27902]: pgmap v16639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31030.701126 secs 2024-04-21T19:02:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:00 smithi191 ceph-mon[31636]: pgmap v16639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:02.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:02 smithi170 ceph-mon[31212]: pgmap v16640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T19:02:02.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:02 smithi077 ceph-mon[27902]: pgmap v16640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T19:02:02.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:02 smithi191 ceph-mon[31636]: pgmap v16640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T19:02:03.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31033.941961 secs 2024-04-21T19:02:03.847 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31033.941961 secs 2024-04-21T19:02:03.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31033.941961 secs 2024-04-21T19:02:04.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:04 smithi170 ceph-mon[31212]: pgmap v16641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T19:02:04.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:04 smithi077 ceph-mon[27902]: pgmap v16641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T19:02:04.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:04 smithi191 ceph-mon[31636]: pgmap v16641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T19:02:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31035.701197 secs 2024-04-21T19:02:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:05 smithi170 ceph-mon[31212]: osdmap e1112: 12 total, 12 up, 12 in 2024-04-21T19:02:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31035.701197 secs 2024-04-21T19:02:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:05 smithi077 ceph-mon[27902]: osdmap e1112: 12 total, 12 up, 12 in 2024-04-21T19:02:05.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31035.701197 secs 2024-04-21T19:02:05.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:05 smithi191 ceph-mon[31636]: osdmap e1112: 12 total, 12 up, 12 in 2024-04-21T19:02:06.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:06 smithi170 ceph-mon[31212]: pgmap v16643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T19:02:06.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:06 smithi077 ceph-mon[27902]: pgmap v16643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T19:02:06.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:06 smithi191 ceph-mon[31636]: pgmap v16643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T19:02:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31038.942067 secs 2024-04-21T19:02:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:08 smithi170 ceph-mon[31212]: pgmap v16644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:02:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:08 smithi170 ceph-mon[31212]: osdmap e1113: 12 total, 12 up, 12 in 2024-04-21T19:02:08.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31038.942067 secs 2024-04-21T19:02:08.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:08 smithi077 ceph-mon[27902]: pgmap v16644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:02:08.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:08 smithi077 ceph-mon[27902]: osdmap e1113: 12 total, 12 up, 12 in 2024-04-21T19:02:08.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31038.942067 secs 2024-04-21T19:02:08.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:08 smithi191 ceph-mon[31636]: pgmap v16644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:02:08.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:08 smithi191 ceph-mon[31636]: osdmap e1113: 12 total, 12 up, 12 in 2024-04-21T19:02:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:10.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31040.701336 secs 2024-04-21T19:02:10.787 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:10 smithi170 ceph-mon[31212]: pgmap v16646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T19:02:10.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31040.701336 secs 2024-04-21T19:02:10.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:10 smithi077 ceph-mon[27902]: pgmap v16646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T19:02:10.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31040.701336 secs 2024-04-21T19:02:10.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:10 smithi191 ceph-mon[31636]: pgmap v16646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T19:02:12.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:12 smithi170 ceph-mon[31212]: pgmap v16647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:02:12.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:12 smithi077 ceph-mon[27902]: pgmap v16647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:02:12.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:12 smithi191 ceph-mon[31636]: pgmap v16647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:02:13.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31043.942183 secs 2024-04-21T19:02:13.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31043.942183 secs 2024-04-21T19:02:13.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31043.942183 secs 2024-04-21T19:02:14.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:14 smithi170 ceph-mon[31212]: pgmap v16648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T19:02:14.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:14 smithi077 ceph-mon[27902]: pgmap v16648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T19:02:14.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:14 smithi191 ceph-mon[31636]: pgmap v16648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-04-21T19:02:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:15.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31045.701471 secs 2024-04-21T19:02:15.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31045.701471 secs 2024-04-21T19:02:15.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31045.701471 secs 2024-04-21T19:02:16.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:16 smithi170 ceph-mon[31212]: pgmap v16649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T19:02:16.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:16 smithi077 ceph-mon[27902]: pgmap v16649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T19:02:16.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:16 smithi191 ceph-mon[31636]: pgmap v16649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T19:02:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31048.942299 secs 2024-04-21T19:02:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:18 smithi170 ceph-mon[31212]: pgmap v16650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:02:18.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31048.942299 secs 2024-04-21T19:02:18.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:18 smithi077 ceph-mon[27902]: pgmap v16650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:02:18.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31048.942299 secs 2024-04-21T19:02:18.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:18 smithi191 ceph-mon[31636]: pgmap v16650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:02:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31050.701612 secs 2024-04-21T19:02:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:20 smithi170 ceph-mon[31212]: pgmap v16651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:02:20.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31050.701612 secs 2024-04-21T19:02:20.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:20 smithi077 ceph-mon[27902]: pgmap v16651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:02:20.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31050.701612 secs 2024-04-21T19:02:20.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:20 smithi191 ceph-mon[31636]: pgmap v16651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:02:22.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:22 smithi170 ceph-mon[31212]: pgmap v16652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:02:22.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31053.942436 secs 2024-04-21T19:02:22.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:22 smithi077 ceph-mon[27902]: pgmap v16652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:02:22.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31053.942436 secs 2024-04-21T19:02:22.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:22 smithi191 ceph-mon[31636]: pgmap v16652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:02:22.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31053.942436 secs 2024-04-21T19:02:24.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:24 smithi170 ceph-mon[31212]: pgmap v16653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:24.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:24 smithi077 ceph-mon[27902]: pgmap v16653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:24.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:24 smithi191 ceph-mon[31636]: pgmap v16653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:25.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31055.701719 secs 2024-04-21T19:02:25.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31055.701719 secs 2024-04-21T19:02:25.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31055.701719 secs 2024-04-21T19:02:26.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:26 smithi170 ceph-mon[31212]: pgmap v16654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:26.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:26 smithi077 ceph-mon[27902]: pgmap v16654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:26.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:26 smithi191 ceph-mon[31636]: pgmap v16654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:27.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31058.942575 secs 2024-04-21T19:02:27.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31058.942575 secs 2024-04-21T19:02:27.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31058.942575 secs 2024-04-21T19:02:28.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:28 smithi170 ceph-mon[31212]: pgmap v16655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:28.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:28 smithi077 ceph-mon[27902]: pgmap v16655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:28.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:28 smithi191 ceph-mon[31636]: pgmap v16655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:30.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31060.701836 secs 2024-04-21T19:02:30.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:30 smithi170 ceph-mon[31212]: pgmap v16656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31060.701836 secs 2024-04-21T19:02:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:30 smithi077 ceph-mon[27902]: pgmap v16656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:30.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31060.701836 secs 2024-04-21T19:02:30.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:30 smithi191 ceph-mon[31636]: pgmap v16656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:32.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:32 smithi077 ceph-mon[27902]: pgmap v16657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:32.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31063.942715 secs 2024-04-21T19:02:32.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:32 smithi191 ceph-mon[31636]: pgmap v16657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:32.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31063.942715 secs 2024-04-21T19:02:33.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:32 smithi170 ceph-mon[31212]: pgmap v16657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:33.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31063.942715 secs 2024-04-21T19:02:34.836 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:34 smithi170 ceph-mon[31212]: pgmap v16658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:34.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:34 smithi077 ceph-mon[27902]: pgmap v16658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:34.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:34 smithi191 ceph-mon[31636]: pgmap v16658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:35.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:35.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31065.701887 secs 2024-04-21T19:02:35.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31065.701887 secs 2024-04-21T19:02:36.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31065.701887 secs 2024-04-21T19:02:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:36 smithi077 ceph-mon[27902]: pgmap v16659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:36.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:36 smithi191 ceph-mon[31636]: pgmap v16659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:37.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:36 smithi170 ceph-mon[31212]: pgmap v16659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:37.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31068.942839 secs 2024-04-21T19:02:37.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31068.942839 secs 2024-04-21T19:02:38.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31068.942839 secs 2024-04-21T19:02:38.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:38 smithi077 ceph-mon[27902]: pgmap v16660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:38.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:38 smithi191 ceph-mon[31636]: pgmap v16660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:39.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:38 smithi170 ceph-mon[31212]: pgmap v16660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:40.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31070.702014 secs 2024-04-21T19:02:40.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:40 smithi077 ceph-mon[27902]: pgmap v16661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:40.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31070.702014 secs 2024-04-21T19:02:40.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:40 smithi191 ceph-mon[31636]: pgmap v16661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:41.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31070.702014 secs 2024-04-21T19:02:41.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:40 smithi170 ceph-mon[31212]: pgmap v16661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:42 smithi077 ceph-mon[27902]: pgmap v16662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31073.942976 secs 2024-04-21T19:02:42.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:42 smithi191 ceph-mon[31636]: pgmap v16662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:42.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31073.942976 secs 2024-04-21T19:02:43.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:42 smithi170 ceph-mon[31212]: pgmap v16662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:43.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31073.942976 secs 2024-04-21T19:02:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:44 smithi077 ceph-mon[27902]: pgmap v16663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:44.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:44 smithi191 ceph-mon[31636]: pgmap v16663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:45.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:44 smithi170 ceph-mon[31212]: pgmap v16663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:45.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31075.702077 secs 2024-04-21T19:02:45.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31075.702077 secs 2024-04-21T19:02:46.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31075.702077 secs 2024-04-21T19:02:46.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:46 smithi077 ceph-mon[27902]: pgmap v16664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:46.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:02:46.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:46 smithi191 ceph-mon[31636]: pgmap v16664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:46.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:02:47.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:46 smithi170 ceph-mon[31212]: pgmap v16664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:47.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:02:47.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31078.943042 secs 2024-04-21T19:02:47.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31078.943042 secs 2024-04-21T19:02:48.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31078.943042 secs 2024-04-21T19:02:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: pgmap v16665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: pgmap v16665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:48.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:48.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: pgmap v16665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:50.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31080.702140 secs 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: pgmap v16666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.535 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:02:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:02:50.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31080.702140 secs 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: pgmap v16666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.614 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:02:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:02:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:02:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:02:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:02:50.615 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31080.702140 secs 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: pgmap v16666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.697 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:02:50.698 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:02:50.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:02:50.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:02:50.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:02:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:52 smithi170 ceph-mon[31212]: pgmap v16667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31083.943171 secs 2024-04-21T19:02:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:52 smithi077 ceph-mon[27902]: pgmap v16667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31083.943171 secs 2024-04-21T19:02:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:52 smithi191 ceph-mon[31636]: pgmap v16667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31083.943171 secs 2024-04-21T19:02:54.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:54 smithi170 ceph-mon[31212]: pgmap v16668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:54.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:54 smithi077 ceph-mon[27902]: pgmap v16668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:54.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:54 smithi191 ceph-mon[31636]: pgmap v16668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:02:55.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31085.702256 secs 2024-04-21T19:02:55.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31085.702256 secs 2024-04-21T19:02:55.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31085.702256 secs 2024-04-21T19:02:56.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:56 smithi170 ceph-mon[31212]: pgmap v16669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:56.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:56 smithi077 ceph-mon[27902]: pgmap v16669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:56.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:56 smithi191 ceph-mon[31636]: pgmap v16669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:02:57.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31088.943289 secs 2024-04-21T19:02:57.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31088.943289 secs 2024-04-21T19:02:57.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31088.943289 secs 2024-04-21T19:02:58.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:02:58 smithi170 ceph-mon[31212]: pgmap v16670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:58.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:02:58 smithi077 ceph-mon[27902]: pgmap v16670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:02:58.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:02:58 smithi191 ceph-mon[31636]: pgmap v16670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:00.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31090.702360 secs 2024-04-21T19:03:00.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:00 smithi077 ceph-mon[27902]: pgmap v16671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:00.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31090.702360 secs 2024-04-21T19:03:00.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:00 smithi191 ceph-mon[31636]: pgmap v16671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31090.702360 secs 2024-04-21T19:03:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:00 smithi170 ceph-mon[31212]: pgmap v16671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:02.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:02 smithi077 ceph-mon[27902]: pgmap v16672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T19:03:02.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31093.943403 secs 2024-04-21T19:03:02.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:02 smithi191 ceph-mon[31636]: pgmap v16672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T19:03:02.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31093.943403 secs 2024-04-21T19:03:02.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:02 smithi170 ceph-mon[31212]: pgmap v16672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T19:03:02.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31093.943403 secs 2024-04-21T19:03:04.585 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:04 smithi170 ceph-mon[31212]: pgmap v16673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:03:04.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:04 smithi077 ceph-mon[27902]: pgmap v16673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:03:04.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:04 smithi191 ceph-mon[31636]: pgmap v16673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:03:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:05.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31095.702504 secs 2024-04-21T19:03:05.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:05 smithi077 ceph-mon[27902]: osdmap e1114: 12 total, 12 up, 12 in 2024-04-21T19:03:05.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31095.702504 secs 2024-04-21T19:03:05.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:05 smithi191 ceph-mon[31636]: osdmap e1114: 12 total, 12 up, 12 in 2024-04-21T19:03:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31095.702504 secs 2024-04-21T19:03:05.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:05 smithi170 ceph-mon[31212]: osdmap e1114: 12 total, 12 up, 12 in 2024-04-21T19:03:06.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:06 smithi077 ceph-mon[27902]: pgmap v16675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T19:03:06.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:06 smithi191 ceph-mon[31636]: pgmap v16675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T19:03:06.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:06 smithi170 ceph-mon[31212]: pgmap v16675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-04-21T19:03:07.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31098.943518 secs 2024-04-21T19:03:07.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31098.943518 secs 2024-04-21T19:03:07.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31098.943518 secs 2024-04-21T19:03:08.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:08 smithi077 ceph-mon[27902]: pgmap v16676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:03:08.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:08 smithi077 ceph-mon[27902]: osdmap e1115: 12 total, 12 up, 12 in 2024-04-21T19:03:08.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:08 smithi191 ceph-mon[31636]: pgmap v16676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:03:08.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:08 smithi191 ceph-mon[31636]: osdmap e1115: 12 total, 12 up, 12 in 2024-04-21T19:03:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:08 smithi170 ceph-mon[31212]: pgmap v16676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:03:08.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:08 smithi170 ceph-mon[31212]: osdmap e1115: 12 total, 12 up, 12 in 2024-04-21T19:03:10.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:10.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31100.702625 secs 2024-04-21T19:03:10.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:10 smithi077 ceph-mon[27902]: pgmap v16678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 24 op/s 2024-04-21T19:03:10.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31100.702625 secs 2024-04-21T19:03:10.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:10 smithi191 ceph-mon[31636]: pgmap v16678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 24 op/s 2024-04-21T19:03:10.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31100.702625 secs 2024-04-21T19:03:10.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:10 smithi170 ceph-mon[31212]: pgmap v16678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 24 op/s 2024-04-21T19:03:12.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:12 smithi077 ceph-mon[27902]: pgmap v16679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T19:03:12.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31103.943651 secs 2024-04-21T19:03:12.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:12 smithi191 ceph-mon[31636]: pgmap v16679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T19:03:12.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31103.943651 secs 2024-04-21T19:03:12.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:12 smithi170 ceph-mon[31212]: pgmap v16679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T19:03:12.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31103.943651 secs 2024-04-21T19:03:14.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:14 smithi077 ceph-mon[27902]: pgmap v16680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T19:03:14.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:14 smithi191 ceph-mon[31636]: pgmap v16680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T19:03:14.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:14 smithi170 ceph-mon[31212]: pgmap v16680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T19:03:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:15.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31105.702737 secs 2024-04-21T19:03:15.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31105.702737 secs 2024-04-21T19:03:15.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31105.702737 secs 2024-04-21T19:03:16.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:16 smithi077 ceph-mon[27902]: pgmap v16681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T19:03:16.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:16 smithi191 ceph-mon[31636]: pgmap v16681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T19:03:16.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:16 smithi170 ceph-mon[31212]: pgmap v16681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-04-21T19:03:17.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31108.943783 secs 2024-04-21T19:03:17.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31108.943783 secs 2024-04-21T19:03:17.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31108.943783 secs 2024-04-21T19:03:18.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:18 smithi077 ceph-mon[27902]: pgmap v16682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:03:18.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:18 smithi191 ceph-mon[31636]: pgmap v16682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:03:18.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:18 smithi170 ceph-mon[31212]: pgmap v16682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:03:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:20.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31110.702887 secs 2024-04-21T19:03:20.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:20 smithi077 ceph-mon[27902]: pgmap v16683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:03:20.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31110.702887 secs 2024-04-21T19:03:20.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:20 smithi191 ceph-mon[31636]: pgmap v16683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:03:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31110.702887 secs 2024-04-21T19:03:20.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:20 smithi170 ceph-mon[31212]: pgmap v16683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:03:22.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:22 smithi077 ceph-mon[27902]: pgmap v16684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:03:22.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31113.943893 secs 2024-04-21T19:03:22.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:22 smithi191 ceph-mon[31636]: pgmap v16684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:03:22.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31113.943893 secs 2024-04-21T19:03:22.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:22 smithi170 ceph-mon[31212]: pgmap v16684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:03:22.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31113.943893 secs 2024-04-21T19:03:24.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:24 smithi077 ceph-mon[27902]: pgmap v16685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:24.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:24 smithi191 ceph-mon[31636]: pgmap v16685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:24.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:24 smithi170 ceph-mon[31212]: pgmap v16685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:25.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31115.702948 secs 2024-04-21T19:03:25.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31115.702948 secs 2024-04-21T19:03:25.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31115.702948 secs 2024-04-21T19:03:26.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:26 smithi077 ceph-mon[27902]: pgmap v16686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:26.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:26 smithi191 ceph-mon[31636]: pgmap v16686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:26.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:26 smithi170 ceph-mon[31212]: pgmap v16686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:27.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31118.944011 secs 2024-04-21T19:03:27.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31118.944011 secs 2024-04-21T19:03:27.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31118.944011 secs 2024-04-21T19:03:28.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:28 smithi077 ceph-mon[27902]: pgmap v16687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:28.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:28 smithi191 ceph-mon[31636]: pgmap v16687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:28.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:28 smithi170 ceph-mon[31212]: pgmap v16687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:30.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31120.703028 secs 2024-04-21T19:03:30.696 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:30 smithi191 ceph-mon[31636]: pgmap v16688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:30.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31120.703028 secs 2024-04-21T19:03:30.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:30 smithi170 ceph-mon[31212]: pgmap v16688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31120.703028 secs 2024-04-21T19:03:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:30 smithi077 ceph-mon[27902]: pgmap v16688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:32.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:32 smithi191 ceph-mon[31636]: pgmap v16689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:32.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31123.944083 secs 2024-04-21T19:03:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:32 smithi170 ceph-mon[31212]: pgmap v16689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:32.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31123.944083 secs 2024-04-21T19:03:32.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:32 smithi077 ceph-mon[27902]: pgmap v16689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:32.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31123.944083 secs 2024-04-21T19:03:34.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:34 smithi191 ceph-mon[31636]: pgmap v16690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:34.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:34 smithi170 ceph-mon[31212]: pgmap v16690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:34.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:34 smithi077 ceph-mon[27902]: pgmap v16690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:35.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31125.703109 secs 2024-04-21T19:03:35.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31125.703109 secs 2024-04-21T19:03:35.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31125.703109 secs 2024-04-21T19:03:36.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:36 smithi191 ceph-mon[31636]: pgmap v16691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:36.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:36 smithi170 ceph-mon[31212]: pgmap v16691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:36 smithi077 ceph-mon[27902]: pgmap v16691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:37.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31128.944197 secs 2024-04-21T19:03:37.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31128.944197 secs 2024-04-21T19:03:37.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31128.944197 secs 2024-04-21T19:03:38.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:38 smithi191 ceph-mon[31636]: pgmap v16692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:38.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:38 smithi170 ceph-mon[31212]: pgmap v16692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:38.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:38 smithi077 ceph-mon[27902]: pgmap v16692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:40.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31130.703228 secs 2024-04-21T19:03:40.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:40 smithi191 ceph-mon[31636]: pgmap v16693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:40.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31130.703228 secs 2024-04-21T19:03:40.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:40 smithi170 ceph-mon[31212]: pgmap v16693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:40.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31130.703228 secs 2024-04-21T19:03:40.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:40 smithi077 ceph-mon[27902]: pgmap v16693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:42.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:42 smithi191 ceph-mon[31636]: pgmap v16694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:42.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31133.944309 secs 2024-04-21T19:03:42.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:42 smithi170 ceph-mon[31212]: pgmap v16694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:42.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31133.944309 secs 2024-04-21T19:03:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:42 smithi077 ceph-mon[27902]: pgmap v16694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31133.944309 secs 2024-04-21T19:03:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:44 smithi191 ceph-mon[31636]: pgmap v16695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:44 smithi170 ceph-mon[31212]: pgmap v16695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:44 smithi077 ceph-mon[27902]: pgmap v16695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:45.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31135.703289 secs 2024-04-21T19:03:45.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31135.703289 secs 2024-04-21T19:03:45.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31135.703289 secs 2024-04-21T19:03:46.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:46 smithi191 ceph-mon[31636]: pgmap v16696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:46.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:46 smithi170 ceph-mon[31212]: pgmap v16696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:46.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:46 smithi077 ceph-mon[27902]: pgmap v16696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:47.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31138.944423 secs 2024-04-21T19:03:47.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31138.944423 secs 2024-04-21T19:03:47.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31138.944423 secs 2024-04-21T19:03:48.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:48 smithi191 ceph-mon[31636]: pgmap v16697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:48.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:48 smithi170 ceph-mon[31212]: pgmap v16697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:48.863 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:48 smithi077 ceph-mon[27902]: pgmap v16697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:49.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:03:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:03:49.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:03:50.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:50.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31140.703408 secs 2024-04-21T19:03:50.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:50 smithi191 ceph-mon[31636]: pgmap v16698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:50.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:50.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:50.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31140.703408 secs 2024-04-21T19:03:50.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:50 smithi170 ceph-mon[31212]: pgmap v16698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:50.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:50.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31140.703408 secs 2024-04-21T19:03:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:50 smithi077 ceph-mon[27902]: pgmap v16698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:51.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:03:51.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:03:51.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:51.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:03:51.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:03:51.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:51.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:03:51.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:03:51.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:03:52.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:52 smithi077 ceph-mon[27902]: pgmap v16699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:52.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31143.944523 secs 2024-04-21T19:03:52.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:52 smithi191 ceph-mon[31636]: pgmap v16699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:52.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31143.944523 secs 2024-04-21T19:03:53.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:52 smithi170 ceph-mon[31212]: pgmap v16699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:53.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31143.944523 secs 2024-04-21T19:03:54.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:54 smithi077 ceph-mon[27902]: pgmap v16700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:54.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:54 smithi191 ceph-mon[31636]: pgmap v16700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:55.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:54 smithi170 ceph-mon[31212]: pgmap v16700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:03:55.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31145.703526 secs 2024-04-21T19:03:55.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31145.703526 secs 2024-04-21T19:03:56.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31145.703526 secs 2024-04-21T19:03:56.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:56 smithi191 ceph-mon[31636]: pgmap v16701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:57.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:56 smithi170 ceph-mon[31212]: pgmap v16701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:57.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:56 smithi077 ceph-mon[27902]: pgmap v16701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:03:57.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31148.944662 secs 2024-04-21T19:03:58.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31148.944662 secs 2024-04-21T19:03:58.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31148.944662 secs 2024-04-21T19:03:58.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:03:58 smithi191 ceph-mon[31636]: pgmap v16702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:59.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:03:58 smithi170 ceph-mon[31212]: pgmap v16702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:03:59.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:03:58 smithi077 ceph-mon[27902]: pgmap v16702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31150.703658 secs 2024-04-21T19:04:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:00 smithi191 ceph-mon[31636]: pgmap v16703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:01.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31150.703658 secs 2024-04-21T19:04:01.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:00 smithi170 ceph-mon[31212]: pgmap v16703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:01.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31150.703658 secs 2024-04-21T19:04:01.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:00 smithi077 ceph-mon[27902]: pgmap v16703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:02.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:02 smithi191 ceph-mon[31636]: pgmap v16704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:02.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31153.944801 secs 2024-04-21T19:04:03.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:02 smithi170 ceph-mon[31212]: pgmap v16704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:03.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31153.944801 secs 2024-04-21T19:04:03.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:02 smithi077 ceph-mon[27902]: pgmap v16704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:03.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31153.944801 secs 2024-04-21T19:04:04.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:04 smithi191 ceph-mon[31636]: pgmap v16705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:05.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:04 smithi170 ceph-mon[31212]: pgmap v16705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:05.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:04 smithi077 ceph-mon[27902]: pgmap v16705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:05.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31155.703720 secs 2024-04-21T19:04:05.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:05 smithi191 ceph-mon[31636]: osdmap e1116: 12 total, 12 up, 12 in 2024-04-21T19:04:06.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31155.703720 secs 2024-04-21T19:04:06.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:05 smithi170 ceph-mon[31212]: osdmap e1116: 12 total, 12 up, 12 in 2024-04-21T19:04:06.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31155.703720 secs 2024-04-21T19:04:06.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:05 smithi077 ceph-mon[27902]: osdmap e1116: 12 total, 12 up, 12 in 2024-04-21T19:04:06.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:06 smithi191 ceph-mon[31636]: pgmap v16707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:04:07.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:06 smithi170 ceph-mon[31212]: pgmap v16707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:04:07.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:06 smithi077 ceph-mon[27902]: pgmap v16707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:04:07.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31158.944856 secs 2024-04-21T19:04:08.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31158.944856 secs 2024-04-21T19:04:08.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31158.944856 secs 2024-04-21T19:04:08.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:08 smithi191 ceph-mon[31636]: pgmap v16708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:04:08.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:08 smithi191 ceph-mon[31636]: osdmap e1117: 12 total, 12 up, 12 in 2024-04-21T19:04:09.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:08 smithi170 ceph-mon[31212]: pgmap v16708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:04:09.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:08 smithi170 ceph-mon[31212]: osdmap e1117: 12 total, 12 up, 12 in 2024-04-21T19:04:09.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:08 smithi077 ceph-mon[27902]: pgmap v16708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:04:09.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:08 smithi077 ceph-mon[27902]: osdmap e1117: 12 total, 12 up, 12 in 2024-04-21T19:04:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:10.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31160.703835 secs 2024-04-21T19:04:10.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:10 smithi191 ceph-mon[31636]: pgmap v16710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:04:11.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31160.703835 secs 2024-04-21T19:04:11.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:10 smithi170 ceph-mon[31212]: pgmap v16710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:04:11.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31160.703835 secs 2024-04-21T19:04:11.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:10 smithi077 ceph-mon[27902]: pgmap v16710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:04:12.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:12 smithi191 ceph-mon[31636]: pgmap v16711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:04:12.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31163.944970 secs 2024-04-21T19:04:13.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:12 smithi170 ceph-mon[31212]: pgmap v16711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:04:13.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31163.944970 secs 2024-04-21T19:04:13.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:12 smithi077 ceph-mon[27902]: pgmap v16711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:04:13.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31163.944970 secs 2024-04-21T19:04:14.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:14 smithi191 ceph-mon[31636]: pgmap v16712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T19:04:15.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:14 smithi170 ceph-mon[31212]: pgmap v16712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T19:04:15.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:15.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:14 smithi077 ceph-mon[27902]: pgmap v16712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T19:04:15.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31165.703953 secs 2024-04-21T19:04:16.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31165.703953 secs 2024-04-21T19:04:16.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31165.703953 secs 2024-04-21T19:04:16.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:16 smithi191 ceph-mon[31636]: pgmap v16713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:04:17.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:16 smithi170 ceph-mon[31212]: pgmap v16713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:04:17.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:16 smithi077 ceph-mon[27902]: pgmap v16713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:04:17.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31168.945034 secs 2024-04-21T19:04:18.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31168.945034 secs 2024-04-21T19:04:18.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31168.945034 secs 2024-04-21T19:04:18.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:18 smithi191 ceph-mon[31636]: pgmap v16714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:04:19.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:18 smithi170 ceph-mon[31212]: pgmap v16714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:04:19.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:18 smithi077 ceph-mon[27902]: pgmap v16714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:04:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:20.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31170.704061 secs 2024-04-21T19:04:20.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:20 smithi191 ceph-mon[31636]: pgmap v16715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:04:21.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31170.704061 secs 2024-04-21T19:04:21.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:20 smithi170 ceph-mon[31212]: pgmap v16715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:04:21.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31170.704061 secs 2024-04-21T19:04:21.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:20 smithi077 ceph-mon[27902]: pgmap v16715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:04:22.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:22 smithi191 ceph-mon[31636]: pgmap v16716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:04:22.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31173.945153 secs 2024-04-21T19:04:23.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:22 smithi170 ceph-mon[31212]: pgmap v16716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:04:23.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31173.945153 secs 2024-04-21T19:04:23.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:22 smithi077 ceph-mon[27902]: pgmap v16716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:04:23.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31173.945153 secs 2024-04-21T19:04:24.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:24 smithi191 ceph-mon[31636]: pgmap v16717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:25.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:24 smithi170 ceph-mon[31212]: pgmap v16717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:25.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:24 smithi077 ceph-mon[27902]: pgmap v16717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:25.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31175.704147 secs 2024-04-21T19:04:26.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31175.704147 secs 2024-04-21T19:04:26.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31175.704147 secs 2024-04-21T19:04:27.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:26 smithi170 ceph-mon[31212]: pgmap v16718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:27.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:26 smithi077 ceph-mon[27902]: pgmap v16718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:27.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:26 smithi191 ceph-mon[31636]: pgmap v16718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:28.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31178.945276 secs 2024-04-21T19:04:28.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31178.945276 secs 2024-04-21T19:04:28.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31178.945276 secs 2024-04-21T19:04:29.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:28 smithi170 ceph-mon[31212]: pgmap v16719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:29.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:28 smithi077 ceph-mon[27902]: pgmap v16719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:29.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:28 smithi191 ceph-mon[31636]: pgmap v16719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:30.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:31.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31180.704242 secs 2024-04-21T19:04:31.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:30 smithi170 ceph-mon[31212]: pgmap v16720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:31.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31180.704242 secs 2024-04-21T19:04:31.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:30 smithi077 ceph-mon[27902]: pgmap v16720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:31.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31180.704242 secs 2024-04-21T19:04:31.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:30 smithi191 ceph-mon[31636]: pgmap v16720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:33.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:32 smithi170 ceph-mon[31212]: pgmap v16721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:33.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31183.945371 secs 2024-04-21T19:04:33.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:32 smithi077 ceph-mon[27902]: pgmap v16721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:33.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31183.945371 secs 2024-04-21T19:04:33.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:32 smithi191 ceph-mon[31636]: pgmap v16721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:33.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31183.945371 secs 2024-04-21T19:04:34.997 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:34 smithi191 ceph-mon[31636]: pgmap v16722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:35.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:34 smithi170 ceph-mon[31212]: pgmap v16722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:35.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:34 smithi077 ceph-mon[27902]: pgmap v16722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:36.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31185.704374 secs 2024-04-21T19:04:36.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31185.704374 secs 2024-04-21T19:04:36.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31185.704374 secs 2024-04-21T19:04:37.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:36 smithi170 ceph-mon[31212]: pgmap v16723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:37.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:36 smithi077 ceph-mon[27902]: pgmap v16723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:37.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:36 smithi191 ceph-mon[31636]: pgmap v16723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:38.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31188.945490 secs 2024-04-21T19:04:38.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31188.945490 secs 2024-04-21T19:04:38.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31188.945490 secs 2024-04-21T19:04:39.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:38 smithi170 ceph-mon[31212]: pgmap v16724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:39.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:38 smithi077 ceph-mon[27902]: pgmap v16724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:39.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:38 smithi191 ceph-mon[31636]: pgmap v16724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:41.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31190.704491 secs 2024-04-21T19:04:41.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:40 smithi170 ceph-mon[31212]: pgmap v16725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:41.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31190.704491 secs 2024-04-21T19:04:41.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:40 smithi077 ceph-mon[27902]: pgmap v16725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:41.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31190.704491 secs 2024-04-21T19:04:41.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:40 smithi191 ceph-mon[31636]: pgmap v16725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:43.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:42 smithi170 ceph-mon[31212]: pgmap v16726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:43.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31193.945633 secs 2024-04-21T19:04:43.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:42 smithi077 ceph-mon[27902]: pgmap v16726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:43.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31193.945633 secs 2024-04-21T19:04:43.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:42 smithi191 ceph-mon[31636]: pgmap v16726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:43.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31193.945633 secs 2024-04-21T19:04:45.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:44 smithi170 ceph-mon[31212]: pgmap v16727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:45.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:44 smithi077 ceph-mon[27902]: pgmap v16727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:45.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:44 smithi191 ceph-mon[31636]: pgmap v16727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:46.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31195.704559 secs 2024-04-21T19:04:46.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31195.704559 secs 2024-04-21T19:04:46.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31195.704559 secs 2024-04-21T19:04:47.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:46 smithi170 ceph-mon[31212]: pgmap v16728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:47.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:46 smithi077 ceph-mon[27902]: pgmap v16728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:47.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:46 smithi191 ceph-mon[31636]: pgmap v16728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:48.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31198.945725 secs 2024-04-21T19:04:48.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31198.945725 secs 2024-04-21T19:04:48.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31198.945725 secs 2024-04-21T19:04:49.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:48 smithi170 ceph-mon[31212]: pgmap v16729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:49.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:48 smithi077 ceph-mon[27902]: pgmap v16729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:49.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:48 smithi191 ceph-mon[31636]: pgmap v16729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:51.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31200.704682 secs 2024-04-21T19:04:51.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:50 smithi170 ceph-mon[31212]: pgmap v16730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:51.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:04:51.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31200.704682 secs 2024-04-21T19:04:51.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:50 smithi077 ceph-mon[27902]: pgmap v16730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:51.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:04:51.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31200.704682 secs 2024-04-21T19:04:51.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:50 smithi191 ceph-mon[31636]: pgmap v16730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:51.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:04:52.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: pgmap v16731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:52.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:04:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:04:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.534 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31203.945828 secs 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: pgmap v16731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:04:52.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:04:52.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31203.945828 secs 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: pgmap v16731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:04:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31203.945828 secs 2024-04-21T19:04:54.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:54 smithi170 ceph-mon[31212]: pgmap v16732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:54.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:54 smithi077 ceph-mon[27902]: pgmap v16732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:54.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:54 smithi191 ceph-mon[31636]: pgmap v16732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:04:55.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31205.704820 secs 2024-04-21T19:04:55.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31205.704820 secs 2024-04-21T19:04:55.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31205.704820 secs 2024-04-21T19:04:56.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:56 smithi170 ceph-mon[31212]: pgmap v16733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:56.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:56 smithi077 ceph-mon[27902]: pgmap v16733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:56.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:56 smithi191 ceph-mon[31636]: pgmap v16733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:04:57.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31208.945952 secs 2024-04-21T19:04:57.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31208.945952 secs 2024-04-21T19:04:57.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31208.945952 secs 2024-04-21T19:04:58.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:04:58 smithi170 ceph-mon[31212]: pgmap v16734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:58.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:04:58 smithi077 ceph-mon[27902]: pgmap v16734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:04:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:04:58.670+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:04:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:04:58.670+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:04:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:04:58.670+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:04:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:04:58.670+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:04:58.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:04:58 smithi191 ceph-mon[31636]: pgmap v16734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:00.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31210.704928 secs 2024-04-21T19:05:00.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:00 smithi170 ceph-mon[31212]: pgmap v16735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:00.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31210.704928 secs 2024-04-21T19:05:00.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:00 smithi077 ceph-mon[27902]: pgmap v16735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:00.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31210.704928 secs 2024-04-21T19:05:00.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:00 smithi191 ceph-mon[31636]: pgmap v16735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:02.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:02 smithi170 ceph-mon[31212]: pgmap v16736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:02.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31213.946034 secs 2024-04-21T19:05:02.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:02 smithi077 ceph-mon[27902]: pgmap v16736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:02.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31213.946034 secs 2024-04-21T19:05:02.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:02 smithi191 ceph-mon[31636]: pgmap v16736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:02.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31213.946034 secs 2024-04-21T19:05:04.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:04 smithi170 ceph-mon[31212]: pgmap v16737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:04.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:04 smithi077 ceph-mon[27902]: pgmap v16737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:04.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:04 smithi191 ceph-mon[31636]: pgmap v16737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:05.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31215.705023 secs 2024-04-21T19:05:05.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:05 smithi191 ceph-mon[31636]: osdmap e1118: 12 total, 12 up, 12 in 2024-04-21T19:05:05.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31215.705023 secs 2024-04-21T19:05:05.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:05 smithi077 ceph-mon[27902]: osdmap e1118: 12 total, 12 up, 12 in 2024-04-21T19:05:05.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31215.705023 secs 2024-04-21T19:05:05.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:05 smithi170 ceph-mon[31212]: osdmap e1118: 12 total, 12 up, 12 in 2024-04-21T19:05:06.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:06 smithi077 ceph-mon[27902]: pgmap v16739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:05:06.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:06 smithi191 ceph-mon[31636]: pgmap v16739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:05:06.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:06 smithi170 ceph-mon[31212]: pgmap v16739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:05:07.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31218.946151 secs 2024-04-21T19:05:07.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31218.946151 secs 2024-04-21T19:05:07.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31218.946151 secs 2024-04-21T19:05:08.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:08 smithi077 ceph-mon[27902]: pgmap v16740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:05:08.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:08 smithi077 ceph-mon[27902]: osdmap e1119: 12 total, 12 up, 12 in 2024-04-21T19:05:08.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:08 smithi191 ceph-mon[31636]: pgmap v16740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:05:08.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:08 smithi191 ceph-mon[31636]: osdmap e1119: 12 total, 12 up, 12 in 2024-04-21T19:05:08.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:08 smithi170 ceph-mon[31212]: pgmap v16740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:05:08.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:08 smithi170 ceph-mon[31212]: osdmap e1119: 12 total, 12 up, 12 in 2024-04-21T19:05:09.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31220.705139 secs 2024-04-21T19:05:09.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31220.705139 secs 2024-04-21T19:05:09.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31220.705139 secs 2024-04-21T19:05:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:10.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:10 smithi077 ceph-mon[27902]: pgmap v16742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:05:10.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:10 smithi191 ceph-mon[31636]: pgmap v16742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:05:10.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:10 smithi170 ceph-mon[31212]: pgmap v16742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:05:12.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:12 smithi077 ceph-mon[27902]: pgmap v16743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:05:12.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31223.946265 secs 2024-04-21T19:05:12.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:12 smithi191 ceph-mon[31636]: pgmap v16743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:05:12.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31223.946265 secs 2024-04-21T19:05:12.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:12 smithi170 ceph-mon[31212]: pgmap v16743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:05:12.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31223.946265 secs 2024-04-21T19:05:14.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:14 smithi077 ceph-mon[27902]: pgmap v16744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:05:14.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31225.705256 secs 2024-04-21T19:05:14.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:14 smithi191 ceph-mon[31636]: pgmap v16744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:05:14.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31225.705256 secs 2024-04-21T19:05:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:14 smithi170 ceph-mon[31212]: pgmap v16744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:05:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31225.705256 secs 2024-04-21T19:05:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:16.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:16 smithi077 ceph-mon[27902]: pgmap v16745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:05:16.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:16 smithi191 ceph-mon[31636]: pgmap v16745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:05:16.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:16 smithi170 ceph-mon[31212]: pgmap v16745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:05:17.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31228.946383 secs 2024-04-21T19:05:17.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31228.946383 secs 2024-04-21T19:05:17.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31228.946383 secs 2024-04-21T19:05:18.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:18 smithi077 ceph-mon[27902]: pgmap v16746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:05:18.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:18 smithi191 ceph-mon[31636]: pgmap v16746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:05:18.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:18 smithi170 ceph-mon[31212]: pgmap v16746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:05:19.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31230.705375 secs 2024-04-21T19:05:19.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31230.705375 secs 2024-04-21T19:05:19.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31230.705375 secs 2024-04-21T19:05:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:20.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:20 smithi077 ceph-mon[27902]: pgmap v16747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:05:20.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:20 smithi191 ceph-mon[31636]: pgmap v16747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:05:20.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:20 smithi170 ceph-mon[31212]: pgmap v16747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:05:22.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:22 smithi077 ceph-mon[27902]: pgmap v16748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:05:22.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31233.946490 secs 2024-04-21T19:05:22.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:22 smithi191 ceph-mon[31636]: pgmap v16748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:05:22.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31233.946490 secs 2024-04-21T19:05:22.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:22 smithi170 ceph-mon[31212]: pgmap v16748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:05:22.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31233.946490 secs 2024-04-21T19:05:24.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:24 smithi077 ceph-mon[27902]: pgmap v16749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:24.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31235.705444 secs 2024-04-21T19:05:24.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:24 smithi191 ceph-mon[31636]: pgmap v16749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:24.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31235.705444 secs 2024-04-21T19:05:24.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:24 smithi170 ceph-mon[31212]: pgmap v16749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:24.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31235.705444 secs 2024-04-21T19:05:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:26.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:26 smithi077 ceph-mon[27902]: pgmap v16750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:26.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:26 smithi191 ceph-mon[31636]: pgmap v16750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:26.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:26 smithi170 ceph-mon[31212]: pgmap v16750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:27.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31238.946609 secs 2024-04-21T19:05:27.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31238.946609 secs 2024-04-21T19:05:27.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31238.946609 secs 2024-04-21T19:05:28.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:28 smithi077 ceph-mon[27902]: pgmap v16751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:28.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:28 smithi191 ceph-mon[31636]: pgmap v16751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:28.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:28 smithi170 ceph-mon[31212]: pgmap v16751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:29.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31240.705555 secs 2024-04-21T19:05:29.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31240.705555 secs 2024-04-21T19:05:29.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31240.705555 secs 2024-04-21T19:05:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:30.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:30 smithi191 ceph-mon[31636]: pgmap v16752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:30.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:30 smithi170 ceph-mon[31212]: pgmap v16752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:30.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:30 smithi077 ceph-mon[27902]: pgmap v16752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:32.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:32 smithi191 ceph-mon[31636]: pgmap v16753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:32.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31243.946730 secs 2024-04-21T19:05:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:32 smithi170 ceph-mon[31212]: pgmap v16753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31243.946730 secs 2024-04-21T19:05:32.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:32 smithi077 ceph-mon[27902]: pgmap v16753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:32.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31243.946730 secs 2024-04-21T19:05:34.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:34 smithi191 ceph-mon[31636]: pgmap v16754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:34.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31245.705668 secs 2024-04-21T19:05:34.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:34 smithi170 ceph-mon[31212]: pgmap v16754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:34.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31245.705668 secs 2024-04-21T19:05:34.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:34 smithi077 ceph-mon[27902]: pgmap v16754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:34.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31245.705668 secs 2024-04-21T19:05:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:36.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:36 smithi191 ceph-mon[31636]: pgmap v16755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:36.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:36 smithi170 ceph-mon[31212]: pgmap v16755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:36.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:36 smithi077 ceph-mon[27902]: pgmap v16755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:37.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31248.946840 secs 2024-04-21T19:05:37.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31248.946840 secs 2024-04-21T19:05:37.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31248.946840 secs 2024-04-21T19:05:38.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:38 smithi191 ceph-mon[31636]: pgmap v16756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:38.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:38 smithi170 ceph-mon[31212]: pgmap v16756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:38.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:38 smithi077 ceph-mon[27902]: pgmap v16756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:39.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31250.705803 secs 2024-04-21T19:05:39.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31250.705803 secs 2024-04-21T19:05:39.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31250.705803 secs 2024-04-21T19:05:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:40.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:40 smithi191 ceph-mon[31636]: pgmap v16757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:40.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:40 smithi170 ceph-mon[31212]: pgmap v16757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:40.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:40 smithi077 ceph-mon[27902]: pgmap v16757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:42.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:42 smithi191 ceph-mon[31636]: pgmap v16758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:42.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31253.946954 secs 2024-04-21T19:05:42.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:42 smithi170 ceph-mon[31212]: pgmap v16758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:42.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31253.946954 secs 2024-04-21T19:05:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:42 smithi077 ceph-mon[27902]: pgmap v16758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:42.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31253.946954 secs 2024-04-21T19:05:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:44 smithi191 ceph-mon[31636]: pgmap v16759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31255.705921 secs 2024-04-21T19:05:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:44 smithi170 ceph-mon[31212]: pgmap v16759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31255.705921 secs 2024-04-21T19:05:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:44 smithi077 ceph-mon[27902]: pgmap v16759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:44.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31255.705921 secs 2024-04-21T19:05:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:46.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:46 smithi191 ceph-mon[31636]: pgmap v16760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:05:46.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:46 smithi170 ceph-mon[31212]: pgmap v16760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:05:46.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:46 smithi077 ceph-mon[27902]: pgmap v16760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:05:47.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31258.947079 secs 2024-04-21T19:05:47.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31258.947079 secs 2024-04-21T19:05:47.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31258.947079 secs 2024-04-21T19:05:48.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:48 smithi191 ceph-mon[31636]: pgmap v16761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:48.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:48 smithi170 ceph-mon[31212]: pgmap v16761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:48.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:48 smithi077 ceph-mon[27902]: pgmap v16761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:49.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31260.706067 secs 2024-04-21T19:05:49.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31260.706067 secs 2024-04-21T19:05:49.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31260.706067 secs 2024-04-21T19:05:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:50.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:50 smithi191 ceph-mon[31636]: pgmap v16762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:50.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:50 smithi170 ceph-mon[31212]: pgmap v16762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:50.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:50 smithi077 ceph-mon[27902]: pgmap v16762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:52 smithi191 ceph-mon[31636]: pgmap v16763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:05:52.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31263.947150 secs 2024-04-21T19:05:52.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:52 smithi170 ceph-mon[31212]: pgmap v16763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:52.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:05:52.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31263.947150 secs 2024-04-21T19:05:52.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:52 smithi077 ceph-mon[27902]: pgmap v16763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:52.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:05:52.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31263.947150 secs 2024-04-21T19:05:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:05:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:05:53.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:05:53.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:05:53.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:05:53.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:05:53.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:05:53.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:05:53.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:05:54.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:54 smithi191 ceph-mon[31636]: pgmap v16764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:54.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31265.706186 secs 2024-04-21T19:05:55.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:54 smithi170 ceph-mon[31212]: pgmap v16764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:55.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31265.706186 secs 2024-04-21T19:05:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:05:55.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:54 smithi077 ceph-mon[27902]: pgmap v16764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:05:55.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31265.706186 secs 2024-04-21T19:05:56.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:56 smithi191 ceph-mon[31636]: pgmap v16765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:05:57.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:56 smithi170 ceph-mon[31212]: pgmap v16765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:05:57.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:56 smithi077 ceph-mon[27902]: pgmap v16765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:05:57.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31268.947272 secs 2024-04-21T19:05:58.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31268.947272 secs 2024-04-21T19:05:58.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31268.947272 secs 2024-04-21T19:05:59.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:58 smithi170 ceph-mon[31212]: pgmap v16766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:59.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:58 smithi077 ceph-mon[27902]: pgmap v16766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:05:59.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:58 smithi191 ceph-mon[31636]: pgmap v16766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:00.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:05:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31270.706279 secs 2024-04-21T19:06:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:00.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:05:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31270.706279 secs 2024-04-21T19:06:00.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:05:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31270.706279 secs 2024-04-21T19:06:01.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:00 smithi170 ceph-mon[31212]: pgmap v16767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:01.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:00 smithi077 ceph-mon[27902]: pgmap v16767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:01.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:00 smithi191 ceph-mon[31636]: pgmap v16767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:03.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:02 smithi170 ceph-mon[31212]: pgmap v16768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:03.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31273.947407 secs 2024-04-21T19:06:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:02 smithi077 ceph-mon[27902]: pgmap v16768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:03.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31273.947407 secs 2024-04-21T19:06:03.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:02 smithi191 ceph-mon[31636]: pgmap v16768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:03.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31273.947407 secs 2024-04-21T19:06:05.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:04 smithi170 ceph-mon[31212]: pgmap v16769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:05.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31275.706353 secs 2024-04-21T19:06:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:05.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:04 smithi077 ceph-mon[27902]: pgmap v16769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:05.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31275.706353 secs 2024-04-21T19:06:05.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:04 smithi191 ceph-mon[31636]: pgmap v16769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:05.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31275.706353 secs 2024-04-21T19:06:06.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:05 smithi170 ceph-mon[31212]: osdmap e1120: 12 total, 12 up, 12 in 2024-04-21T19:06:06.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:05 smithi191 ceph-mon[31636]: osdmap e1120: 12 total, 12 up, 12 in 2024-04-21T19:06:06.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:05 smithi077 ceph-mon[27902]: osdmap e1120: 12 total, 12 up, 12 in 2024-04-21T19:06:07.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:06 smithi170 ceph-mon[31212]: pgmap v16771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:06:07.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:06 smithi077 ceph-mon[27902]: pgmap v16771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:06:07.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:06 smithi191 ceph-mon[31636]: pgmap v16771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:06:08.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31278.947539 secs 2024-04-21T19:06:08.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31278.947539 secs 2024-04-21T19:06:08.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31278.947539 secs 2024-04-21T19:06:09.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:08 smithi170 ceph-mon[31212]: pgmap v16772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:06:09.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:08 smithi170 ceph-mon[31212]: osdmap e1121: 12 total, 12 up, 12 in 2024-04-21T19:06:09.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:08 smithi077 ceph-mon[27902]: pgmap v16772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:06:09.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:08 smithi077 ceph-mon[27902]: osdmap e1121: 12 total, 12 up, 12 in 2024-04-21T19:06:09.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:08 smithi191 ceph-mon[31636]: pgmap v16772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:06:09.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:08 smithi191 ceph-mon[31636]: osdmap e1121: 12 total, 12 up, 12 in 2024-04-21T19:06:10.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31280.706478 secs 2024-04-21T19:06:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:10.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31280.706478 secs 2024-04-21T19:06:10.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31280.706478 secs 2024-04-21T19:06:11.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:10 smithi170 ceph-mon[31212]: pgmap v16774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:06:11.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:10 smithi077 ceph-mon[27902]: pgmap v16774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:06:11.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:10 smithi191 ceph-mon[31636]: pgmap v16774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:06:13.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:12 smithi170 ceph-mon[31212]: pgmap v16775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:06:13.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31283.947629 secs 2024-04-21T19:06:13.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:12 smithi077 ceph-mon[27902]: pgmap v16775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:06:13.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31283.947629 secs 2024-04-21T19:06:13.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:12 smithi191 ceph-mon[31636]: pgmap v16775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:06:13.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31283.947629 secs 2024-04-21T19:06:15.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:14 smithi170 ceph-mon[31212]: pgmap v16776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T19:06:15.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31285.706607 secs 2024-04-21T19:06:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:15.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:14 smithi077 ceph-mon[27902]: pgmap v16776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T19:06:15.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31285.706607 secs 2024-04-21T19:06:15.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:14 smithi191 ceph-mon[31636]: pgmap v16776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T19:06:15.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31285.706607 secs 2024-04-21T19:06:17.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:16 smithi170 ceph-mon[31212]: pgmap v16777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:06:17.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:16 smithi077 ceph-mon[27902]: pgmap v16777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:06:17.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:16 smithi191 ceph-mon[31636]: pgmap v16777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:06:18.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31288.947782 secs 2024-04-21T19:06:18.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31288.947782 secs 2024-04-21T19:06:18.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31288.947782 secs 2024-04-21T19:06:19.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:18 smithi170 ceph-mon[31212]: pgmap v16778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:06:19.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:18 smithi077 ceph-mon[27902]: pgmap v16778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:06:19.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:18 smithi191 ceph-mon[31636]: pgmap v16778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:06:20.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31290.706723 secs 2024-04-21T19:06:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:20.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31290.706723 secs 2024-04-21T19:06:20.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31290.706723 secs 2024-04-21T19:06:21.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:20 smithi170 ceph-mon[31212]: pgmap v16779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:06:21.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:20 smithi077 ceph-mon[27902]: pgmap v16779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:06:21.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:20 smithi191 ceph-mon[31636]: pgmap v16779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:06:23.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:22 smithi170 ceph-mon[31212]: pgmap v16780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:06:23.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31293.947899 secs 2024-04-21T19:06:23.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:22 smithi077 ceph-mon[27902]: pgmap v16780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:06:23.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31293.947899 secs 2024-04-21T19:06:23.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:22 smithi191 ceph-mon[31636]: pgmap v16780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:06:23.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31293.947899 secs 2024-04-21T19:06:25.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:24 smithi170 ceph-mon[31212]: pgmap v16781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:25.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31295.706840 secs 2024-04-21T19:06:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:25.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:24 smithi077 ceph-mon[27902]: pgmap v16781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:25.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31295.706840 secs 2024-04-21T19:06:25.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:24 smithi191 ceph-mon[31636]: pgmap v16781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:25.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31295.706840 secs 2024-04-21T19:06:27.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:26 smithi170 ceph-mon[31212]: pgmap v16782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:27.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:26 smithi077 ceph-mon[27902]: pgmap v16782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:27.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:26 smithi191 ceph-mon[31636]: pgmap v16782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:28.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31298.948009 secs 2024-04-21T19:06:28.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31298.948009 secs 2024-04-21T19:06:28.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31298.948009 secs 2024-04-21T19:06:29.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:28 smithi077 ceph-mon[27902]: pgmap v16783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:29.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:28 smithi191 ceph-mon[31636]: pgmap v16783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:29.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:28 smithi170 ceph-mon[31212]: pgmap v16783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:30.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31300.706956 secs 2024-04-21T19:06:30.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31300.706956 secs 2024-04-21T19:06:30.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31300.706956 secs 2024-04-21T19:06:31.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:30 smithi077 ceph-mon[27902]: pgmap v16784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:31.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:30 smithi191 ceph-mon[31636]: pgmap v16784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:31.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:30 smithi170 ceph-mon[31212]: pgmap v16784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:33.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:32 smithi077 ceph-mon[27902]: pgmap v16785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:33.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31303.948126 secs 2024-04-21T19:06:33.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:32 smithi191 ceph-mon[31636]: pgmap v16785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:33.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31303.948126 secs 2024-04-21T19:06:33.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:32 smithi170 ceph-mon[31212]: pgmap v16785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:33.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31303.948126 secs 2024-04-21T19:06:35.085 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:34 smithi170 ceph-mon[31212]: pgmap v16786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:35.085 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31305.707049 secs 2024-04-21T19:06:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:34 smithi077 ceph-mon[27902]: pgmap v16786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31305.707049 secs 2024-04-21T19:06:35.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:34 smithi191 ceph-mon[31636]: pgmap v16786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:35.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31305.707049 secs 2024-04-21T19:06:37.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:36 smithi077 ceph-mon[27902]: pgmap v16787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:37.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:36 smithi191 ceph-mon[31636]: pgmap v16787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:37.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:36 smithi170 ceph-mon[31212]: pgmap v16787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:38.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31308.948247 secs 2024-04-21T19:06:38.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31308.948247 secs 2024-04-21T19:06:38.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31308.948247 secs 2024-04-21T19:06:39.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:38 smithi077 ceph-mon[27902]: pgmap v16788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:06:39.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:38 smithi191 ceph-mon[31636]: pgmap v16788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:06:39.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:38 smithi170 ceph-mon[31212]: pgmap v16788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:06:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:40.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31310.707137 secs 2024-04-21T19:06:40.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31310.707137 secs 2024-04-21T19:06:40.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31310.707137 secs 2024-04-21T19:06:41.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:40 smithi077 ceph-mon[27902]: pgmap v16789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:41.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:40 smithi191 ceph-mon[31636]: pgmap v16789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:41.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:40 smithi170 ceph-mon[31212]: pgmap v16789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:43.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:42 smithi077 ceph-mon[27902]: pgmap v16790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:43.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31313.948357 secs 2024-04-21T19:06:43.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:42 smithi191 ceph-mon[31636]: pgmap v16790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:43.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31313.948357 secs 2024-04-21T19:06:43.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:42 smithi170 ceph-mon[31212]: pgmap v16790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:43.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31313.948357 secs 2024-04-21T19:06:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:45.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:44 smithi077 ceph-mon[27902]: pgmap v16791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:45.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31315.707248 secs 2024-04-21T19:06:45.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:44 smithi191 ceph-mon[31636]: pgmap v16791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:45.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31315.707248 secs 2024-04-21T19:06:45.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:44 smithi170 ceph-mon[31212]: pgmap v16791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:45.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31315.707248 secs 2024-04-21T19:06:47.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:46 smithi077 ceph-mon[27902]: pgmap v16792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:47.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:46 smithi191 ceph-mon[31636]: pgmap v16792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:47.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:46 smithi170 ceph-mon[31212]: pgmap v16792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:48.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31318.948476 secs 2024-04-21T19:06:48.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31318.948476 secs 2024-04-21T19:06:48.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31318.948476 secs 2024-04-21T19:06:49.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:48 smithi077 ceph-mon[27902]: pgmap v16793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:06:49.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:48 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31320.707363 secs 2024-04-21T19:06:49.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:48 smithi191 ceph-mon[31636]: pgmap v16793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:06:49.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:48 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31320.707363 secs 2024-04-21T19:06:49.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:48 smithi170 ceph-mon[31212]: pgmap v16793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T19:06:49.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:48 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31320.707363 secs 2024-04-21T19:06:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:51.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:50 smithi077 ceph-mon[27902]: pgmap v16794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:51.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:50 smithi191 ceph-mon[31636]: pgmap v16794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:51.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:50 smithi170 ceph-mon[31212]: pgmap v16794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:53.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:52 smithi077 ceph-mon[27902]: pgmap v16795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:53.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31323.948571 secs 2024-04-21T19:06:53.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:06:53.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:52 smithi191 ceph-mon[31636]: pgmap v16795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:53.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31323.948571 secs 2024-04-21T19:06:53.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:06:53.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:52 smithi170 ceph-mon[31212]: pgmap v16795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:53.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31323.948571 secs 2024-04-21T19:06:53.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:06:54.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:06:54.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:06:54.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:06:54.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31325.707477 secs 2024-04-21T19:06:54.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:06:54.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:06:54.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:06:54.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31325.707477 secs 2024-04-21T19:06:54.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:06:54.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:06:54.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:06:54.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31325.707477 secs 2024-04-21T19:06:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:06:55.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:54 smithi077 ceph-mon[27902]: pgmap v16796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:55.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:54 smithi191 ceph-mon[31636]: pgmap v16796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:55.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:54 smithi170 ceph-mon[31212]: pgmap v16796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:57.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:56 smithi077 ceph-mon[27902]: pgmap v16797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:57.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:56 smithi191 ceph-mon[31636]: pgmap v16797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:57.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:56 smithi170 ceph-mon[31212]: pgmap v16797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:06:58.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31328.948692 secs 2024-04-21T19:06:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31328.948692 secs 2024-04-21T19:06:58.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31328.948692 secs 2024-04-21T19:06:59.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:58 smithi077 ceph-mon[27902]: pgmap v16798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:59.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:06:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31330.707589 secs 2024-04-21T19:06:59.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:58 smithi191 ceph-mon[31636]: pgmap v16798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:59.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:06:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31330.707589 secs 2024-04-21T19:06:59.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:58 smithi170 ceph-mon[31212]: pgmap v16798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:06:59.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:06:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31330.707589 secs 2024-04-21T19:07:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:01.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:00 smithi191 ceph-mon[31636]: pgmap v16799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:01.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:00 smithi170 ceph-mon[31212]: pgmap v16799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:01.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:00 smithi077 ceph-mon[27902]: pgmap v16799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:02 smithi191 ceph-mon[31636]: pgmap v16800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:03.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31333.948805 secs 2024-04-21T19:07:03.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:02 smithi170 ceph-mon[31212]: pgmap v16800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:03.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31333.948805 secs 2024-04-21T19:07:03.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:02 smithi077 ceph-mon[27902]: pgmap v16800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:03.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31333.948805 secs 2024-04-21T19:07:04.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31335.707702 secs 2024-04-21T19:07:04.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31335.707702 secs 2024-04-21T19:07:04.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31335.707702 secs 2024-04-21T19:07:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:05.184 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:04 smithi170 ceph-mon[31212]: pgmap v16801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:05.185 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:04 smithi170 ceph-mon[31212]: osdmap e1122: 12 total, 12 up, 12 in 2024-04-21T19:07:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:04 smithi191 ceph-mon[31636]: pgmap v16801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:05.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:04 smithi191 ceph-mon[31636]: osdmap e1122: 12 total, 12 up, 12 in 2024-04-21T19:07:05.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:04 smithi077 ceph-mon[27902]: pgmap v16801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:05.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:04 smithi077 ceph-mon[27902]: osdmap e1122: 12 total, 12 up, 12 in 2024-04-21T19:07:07.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:06 smithi191 ceph-mon[31636]: pgmap v16803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:07:07.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:06 smithi170 ceph-mon[31212]: pgmap v16803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:07:07.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:06 smithi077 ceph-mon[27902]: pgmap v16803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:07:08.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31338.948893 secs 2024-04-21T19:07:08.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31338.948893 secs 2024-04-21T19:07:08.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31338.948893 secs 2024-04-21T19:07:09.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:08 smithi191 ceph-mon[31636]: pgmap v16804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:07:09.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:08 smithi191 ceph-mon[31636]: osdmap e1123: 12 total, 12 up, 12 in 2024-04-21T19:07:09.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:08 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31340.707843 secs 2024-04-21T19:07:09.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:08 smithi170 ceph-mon[31212]: pgmap v16804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:07:09.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:08 smithi170 ceph-mon[31212]: osdmap e1123: 12 total, 12 up, 12 in 2024-04-21T19:07:09.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:08 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31340.707843 secs 2024-04-21T19:07:09.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:08 smithi077 ceph-mon[27902]: pgmap v16804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:07:09.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:08 smithi077 ceph-mon[27902]: osdmap e1123: 12 total, 12 up, 12 in 2024-04-21T19:07:09.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:08 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31340.707843 secs 2024-04-21T19:07:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:11.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:10 smithi191 ceph-mon[31636]: pgmap v16806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:07:11.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:10 smithi170 ceph-mon[31212]: pgmap v16806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:07:11.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:10 smithi077 ceph-mon[27902]: pgmap v16806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:07:13.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:12 smithi191 ceph-mon[31636]: pgmap v16807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:07:13.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31343.949010 secs 2024-04-21T19:07:13.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:12 smithi170 ceph-mon[31212]: pgmap v16807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:07:13.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31343.949010 secs 2024-04-21T19:07:13.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:12 smithi077 ceph-mon[27902]: pgmap v16807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:07:13.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31343.949010 secs 2024-04-21T19:07:14.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:13 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31345.707948 secs 2024-04-21T19:07:14.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:13 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31345.707948 secs 2024-04-21T19:07:14.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:13 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31345.707948 secs 2024-04-21T19:07:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:15.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:14 smithi191 ceph-mon[31636]: pgmap v16808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T19:07:15.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:14 smithi170 ceph-mon[31212]: pgmap v16808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T19:07:15.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:14 smithi077 ceph-mon[27902]: pgmap v16808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2024-04-21T19:07:17.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:16 smithi191 ceph-mon[31636]: pgmap v16809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:07:17.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:16 smithi170 ceph-mon[31212]: pgmap v16809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:07:17.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:16 smithi077 ceph-mon[27902]: pgmap v16809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:07:18.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31348.949084 secs 2024-04-21T19:07:18.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31348.949084 secs 2024-04-21T19:07:18.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31348.949084 secs 2024-04-21T19:07:19.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:18 smithi191 ceph-mon[31636]: pgmap v16810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:07:19.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:18 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31350.708064 secs 2024-04-21T19:07:19.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:18 smithi170 ceph-mon[31212]: pgmap v16810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:07:19.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:18 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31350.708064 secs 2024-04-21T19:07:19.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:18 smithi077 ceph-mon[27902]: pgmap v16810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:07:19.362 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:18 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31350.708064 secs 2024-04-21T19:07:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:21.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:20 smithi191 ceph-mon[31636]: pgmap v16811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:07:21.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:20 smithi170 ceph-mon[31212]: pgmap v16811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:07:21.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:20 smithi077 ceph-mon[27902]: pgmap v16811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:07:23.164 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:22 smithi077 ceph-mon[27902]: pgmap v16812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:07:23.165 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31353.949197 secs 2024-04-21T19:07:23.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:22 smithi191 ceph-mon[31636]: pgmap v16812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:07:23.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31353.949197 secs 2024-04-21T19:07:23.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:22 smithi170 ceph-mon[31212]: pgmap v16812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:07:23.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31353.949197 secs 2024-04-21T19:07:24.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:24 smithi170 ceph-mon[31212]: pgmap v16813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:24.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31355.708176 secs 2024-04-21T19:07:24.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:24 smithi077 ceph-mon[27902]: pgmap v16813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:24.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31355.708176 secs 2024-04-21T19:07:24.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:24 smithi191 ceph-mon[31636]: pgmap v16813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:24.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31355.708176 secs 2024-04-21T19:07:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:26.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:26 smithi170 ceph-mon[31212]: pgmap v16814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:26.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:26 smithi077 ceph-mon[27902]: pgmap v16814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:26.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:26 smithi191 ceph-mon[31636]: pgmap v16814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:27.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31358.949273 secs 2024-04-21T19:07:27.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31358.949273 secs 2024-04-21T19:07:27.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31358.949273 secs 2024-04-21T19:07:28.533 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:28 smithi170 ceph-mon[31212]: pgmap v16815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:28.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:28 smithi077 ceph-mon[27902]: pgmap v16815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:28.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:28 smithi191 ceph-mon[31636]: pgmap v16815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:29.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31360.708287 secs 2024-04-21T19:07:29.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31360.708287 secs 2024-04-21T19:07:29.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31360.708287 secs 2024-04-21T19:07:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:30.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:30 smithi077 ceph-mon[27902]: pgmap v16816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:30.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:30 smithi191 ceph-mon[31636]: pgmap v16816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:30.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:30 smithi170 ceph-mon[31212]: pgmap v16816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:32.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:32 smithi077 ceph-mon[27902]: pgmap v16817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:32.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31363.949358 secs 2024-04-21T19:07:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:32 smithi191 ceph-mon[31636]: pgmap v16817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31363.949358 secs 2024-04-21T19:07:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:32 smithi170 ceph-mon[31212]: pgmap v16817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31363.949358 secs 2024-04-21T19:07:34.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:34 smithi077 ceph-mon[27902]: pgmap v16818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:34.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31365.708422 secs 2024-04-21T19:07:34.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:34 smithi191 ceph-mon[31636]: pgmap v16818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:34.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31365.708422 secs 2024-04-21T19:07:34.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:34 smithi170 ceph-mon[31212]: pgmap v16818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:34.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31365.708422 secs 2024-04-21T19:07:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:36.585 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:36 smithi170 ceph-mon[31212]: pgmap v16819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:36.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:36 smithi077 ceph-mon[27902]: pgmap v16819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:36.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:36 smithi191 ceph-mon[31636]: pgmap v16819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31368.949482 secs 2024-04-21T19:07:37.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31368.949482 secs 2024-04-21T19:07:37.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31368.949482 secs 2024-04-21T19:07:38.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:38 smithi077 ceph-mon[27902]: pgmap v16820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:38.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:38 smithi191 ceph-mon[31636]: pgmap v16820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:38.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:38 smithi170 ceph-mon[31212]: pgmap v16820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:39.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31370.708558 secs 2024-04-21T19:07:39.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31370.708558 secs 2024-04-21T19:07:39.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31370.708558 secs 2024-04-21T19:07:40.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:40.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:40 smithi077 ceph-mon[27902]: pgmap v16821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:40.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:40 smithi191 ceph-mon[31636]: pgmap v16821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:40.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:40 smithi170 ceph-mon[31212]: pgmap v16821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:42.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:42 smithi077 ceph-mon[27902]: pgmap v16822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:42.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31373.949600 secs 2024-04-21T19:07:42.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:42 smithi191 ceph-mon[31636]: pgmap v16822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:42.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31373.949600 secs 2024-04-21T19:07:42.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:42 smithi170 ceph-mon[31212]: pgmap v16822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:42.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31373.949600 secs 2024-04-21T19:07:44.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:44 smithi077 ceph-mon[27902]: pgmap v16823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:44.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31375.708672 secs 2024-04-21T19:07:44.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:44 smithi191 ceph-mon[31636]: pgmap v16823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:44.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31375.708672 secs 2024-04-21T19:07:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:44 smithi170 ceph-mon[31212]: pgmap v16823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31375.708672 secs 2024-04-21T19:07:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:46.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:46 smithi077 ceph-mon[27902]: pgmap v16824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:46.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:46 smithi191 ceph-mon[31636]: pgmap v16824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:46.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:46 smithi170 ceph-mon[31212]: pgmap v16824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:47.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31378.949718 secs 2024-04-21T19:07:47.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31378.949718 secs 2024-04-21T19:07:47.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31378.949718 secs 2024-04-21T19:07:48.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:48 smithi077 ceph-mon[27902]: pgmap v16825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:48.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:48 smithi191 ceph-mon[31636]: pgmap v16825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:48.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:48 smithi170 ceph-mon[31212]: pgmap v16825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:49.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31380.708806 secs 2024-04-21T19:07:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31380.708806 secs 2024-04-21T19:07:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31380.708806 secs 2024-04-21T19:07:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:50.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:50 smithi077 ceph-mon[27902]: pgmap v16826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:50.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:50 smithi191 ceph-mon[31636]: pgmap v16826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:50.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:50 smithi170 ceph-mon[31212]: pgmap v16826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:52.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:52 smithi077 ceph-mon[27902]: pgmap v16827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:52.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31383.949832 secs 2024-04-21T19:07:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:52 smithi191 ceph-mon[31636]: pgmap v16827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31383.949832 secs 2024-04-21T19:07:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:52 smithi170 ceph-mon[31212]: pgmap v16827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31383.949832 secs 2024-04-21T19:07:54.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:54 smithi077 ceph-mon[27902]: pgmap v16828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:54.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:07:54.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31385.708897 secs 2024-04-21T19:07:54.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:07:54.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:07:54.612 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:07:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:54 smithi191 ceph-mon[31636]: pgmap v16828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:07:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31385.708897 secs 2024-04-21T19:07:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:07:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:07:54.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:07:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:54 smithi170 ceph-mon[31212]: pgmap v16828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:07:54.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31385.708897 secs 2024-04-21T19:07:54.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:07:54.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:07:54.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:07:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:07:56.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:56 smithi077 ceph-mon[27902]: pgmap v16829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:56.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:56 smithi191 ceph-mon[31636]: pgmap v16829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:56.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:56 smithi170 ceph-mon[31212]: pgmap v16829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:07:57.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31388.949948 secs 2024-04-21T19:07:57.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31388.949948 secs 2024-04-21T19:07:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31388.949948 secs 2024-04-21T19:07:58.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:58 smithi077 ceph-mon[27902]: pgmap v16830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:07:58.695+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:07:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:07:58.695+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:07:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:07:58.695+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:07:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:07:58.695+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:07:58.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:58 smithi191 ceph-mon[31636]: pgmap v16830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:58.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:58 smithi170 ceph-mon[31212]: pgmap v16830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:07:59.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:07:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31390.708989 secs 2024-04-21T19:07:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:07:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31390.708989 secs 2024-04-21T19:07:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:07:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31390.708989 secs 2024-04-21T19:08:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:00.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:00 smithi191 ceph-mon[31636]: pgmap v16831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:00 smithi170 ceph-mon[31212]: pgmap v16831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:00 smithi077 ceph-mon[27902]: pgmap v16831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:02.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:02 smithi191 ceph-mon[31636]: pgmap v16832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:02.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31393.950010 secs 2024-04-21T19:08:02.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:02 smithi170 ceph-mon[31212]: pgmap v16832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:02.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31393.950010 secs 2024-04-21T19:08:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:02 smithi077 ceph-mon[27902]: pgmap v16832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31393.950010 secs 2024-04-21T19:08:04.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:04 smithi191 ceph-mon[31636]: pgmap v16833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:04.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31395.709051 secs 2024-04-21T19:08:04.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:04 smithi170 ceph-mon[31212]: pgmap v16833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:04.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31395.709051 secs 2024-04-21T19:08:04.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:04 smithi077 ceph-mon[27902]: pgmap v16833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:04.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31395.709051 secs 2024-04-21T19:08:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:05.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:05 smithi191 ceph-mon[31636]: osdmap e1124: 12 total, 12 up, 12 in 2024-04-21T19:08:05.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:05 smithi170 ceph-mon[31212]: osdmap e1124: 12 total, 12 up, 12 in 2024-04-21T19:08:05.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:05 smithi077 ceph-mon[27902]: osdmap e1124: 12 total, 12 up, 12 in 2024-04-21T19:08:06.684 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:06 smithi170 ceph-mon[31212]: pgmap v16835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:08:06.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:06 smithi191 ceph-mon[31636]: pgmap v16835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:08:06.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:06 smithi077 ceph-mon[27902]: pgmap v16835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:08:07.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31398.950110 secs 2024-04-21T19:08:07.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31398.950110 secs 2024-04-21T19:08:07.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31398.950110 secs 2024-04-21T19:08:08.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:08 smithi191 ceph-mon[31636]: pgmap v16836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:08:08.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:08 smithi191 ceph-mon[31636]: osdmap e1125: 12 total, 12 up, 12 in 2024-04-21T19:08:08.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:08 smithi170 ceph-mon[31212]: pgmap v16836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:08:08.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:08 smithi170 ceph-mon[31212]: osdmap e1125: 12 total, 12 up, 12 in 2024-04-21T19:08:08.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:08 smithi077 ceph-mon[27902]: pgmap v16836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:08:08.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:08 smithi077 ceph-mon[27902]: osdmap e1125: 12 total, 12 up, 12 in 2024-04-21T19:08:09.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31400.709164 secs 2024-04-21T19:08:09.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31400.709164 secs 2024-04-21T19:08:09.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31400.709164 secs 2024-04-21T19:08:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:10.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:10 smithi191 ceph-mon[31636]: pgmap v16838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:08:10.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:10 smithi170 ceph-mon[31212]: pgmap v16838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:08:10.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:10 smithi077 ceph-mon[27902]: pgmap v16838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:08:12.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:12 smithi191 ceph-mon[31636]: pgmap v16839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:08:12.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31403.950183 secs 2024-04-21T19:08:12.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:12 smithi170 ceph-mon[31212]: pgmap v16839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:08:12.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31403.950183 secs 2024-04-21T19:08:12.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:12 smithi077 ceph-mon[27902]: pgmap v16839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:08:12.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31403.950183 secs 2024-04-21T19:08:14.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:14 smithi191 ceph-mon[31636]: pgmap v16840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:08:14.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31405.709262 secs 2024-04-21T19:08:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:14 smithi170 ceph-mon[31212]: pgmap v16840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:08:14.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31405.709262 secs 2024-04-21T19:08:14.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:14 smithi077 ceph-mon[27902]: pgmap v16840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:08:14.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31405.709262 secs 2024-04-21T19:08:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:16.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:16 smithi191 ceph-mon[31636]: pgmap v16841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:08:16.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:16 smithi170 ceph-mon[31212]: pgmap v16841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:08:16.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:16 smithi077 ceph-mon[27902]: pgmap v16841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:08:17.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31408.950246 secs 2024-04-21T19:08:17.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31408.950246 secs 2024-04-21T19:08:17.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31408.950246 secs 2024-04-21T19:08:18.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:18 smithi191 ceph-mon[31636]: pgmap v16842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:08:18.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:18 smithi170 ceph-mon[31212]: pgmap v16842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:08:18.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:18 smithi077 ceph-mon[27902]: pgmap v16842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:08:19.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31410.709331 secs 2024-04-21T19:08:19.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31410.709331 secs 2024-04-21T19:08:19.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31410.709331 secs 2024-04-21T19:08:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:20.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:20 smithi191 ceph-mon[31636]: pgmap v16843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:08:20.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:20 smithi170 ceph-mon[31212]: pgmap v16843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:08:20.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:20 smithi077 ceph-mon[27902]: pgmap v16843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:08:22.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:22 smithi191 ceph-mon[31636]: pgmap v16844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:08:22.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31413.950317 secs 2024-04-21T19:08:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:22 smithi170 ceph-mon[31212]: pgmap v16844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:08:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31413.950317 secs 2024-04-21T19:08:22.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:22 smithi077 ceph-mon[27902]: pgmap v16844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:08:22.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31413.950317 secs 2024-04-21T19:08:24.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:24 smithi191 ceph-mon[31636]: pgmap v16845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:24.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31415.709451 secs 2024-04-21T19:08:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:24 smithi170 ceph-mon[31212]: pgmap v16845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31415.709451 secs 2024-04-21T19:08:24.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:24 smithi077 ceph-mon[27902]: pgmap v16845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:24.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31415.709451 secs 2024-04-21T19:08:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:26.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:26 smithi191 ceph-mon[31636]: pgmap v16846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:26.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:26 smithi170 ceph-mon[31212]: pgmap v16846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:26.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:26 smithi077 ceph-mon[27902]: pgmap v16846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:27.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31418.950439 secs 2024-04-21T19:08:27.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31418.950439 secs 2024-04-21T19:08:27.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31418.950439 secs 2024-04-21T19:08:28.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:28 smithi170 ceph-mon[31212]: pgmap v16847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:28.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:28 smithi077 ceph-mon[27902]: pgmap v16847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:28.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:28 smithi191 ceph-mon[31636]: pgmap v16847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:29.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31420.709599 secs 2024-04-21T19:08:29.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31420.709599 secs 2024-04-21T19:08:29.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31420.709599 secs 2024-04-21T19:08:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:30.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:30 smithi170 ceph-mon[31212]: pgmap v16848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:30.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:30 smithi077 ceph-mon[27902]: pgmap v16848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:30.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:30 smithi191 ceph-mon[31636]: pgmap v16848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:32 smithi170 ceph-mon[31212]: pgmap v16849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:32.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31423.950553 secs 2024-04-21T19:08:32.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:32 smithi077 ceph-mon[27902]: pgmap v16849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:32.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31423.950553 secs 2024-04-21T19:08:32.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:32 smithi191 ceph-mon[31636]: pgmap v16849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:32.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31423.950553 secs 2024-04-21T19:08:34.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:34 smithi170 ceph-mon[31212]: pgmap v16850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:34.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31425.709722 secs 2024-04-21T19:08:34.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:34 smithi077 ceph-mon[27902]: pgmap v16850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:34.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31425.709722 secs 2024-04-21T19:08:34.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:34 smithi191 ceph-mon[31636]: pgmap v16850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:34.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31425.709722 secs 2024-04-21T19:08:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:36.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:36 smithi170 ceph-mon[31212]: pgmap v16851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:36.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:36 smithi077 ceph-mon[27902]: pgmap v16851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:36.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:36 smithi191 ceph-mon[31636]: pgmap v16851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:37.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31428.950671 secs 2024-04-21T19:08:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31428.950671 secs 2024-04-21T19:08:37.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31428.950671 secs 2024-04-21T19:08:38.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:38 smithi170 ceph-mon[31212]: pgmap v16852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:38.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:38 smithi077 ceph-mon[27902]: pgmap v16852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:38.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:38 smithi191 ceph-mon[31636]: pgmap v16852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:39.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31430.709842 secs 2024-04-21T19:08:39.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31430.709842 secs 2024-04-21T19:08:39.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31430.709842 secs 2024-04-21T19:08:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:40.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:40 smithi170 ceph-mon[31212]: pgmap v16853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:40.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:40 smithi077 ceph-mon[27902]: pgmap v16853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:40.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:40 smithi191 ceph-mon[31636]: pgmap v16853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:42.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:42 smithi170 ceph-mon[31212]: pgmap v16854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:42.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31433.950812 secs 2024-04-21T19:08:42.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:42 smithi077 ceph-mon[27902]: pgmap v16854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:42.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31433.950812 secs 2024-04-21T19:08:42.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:42 smithi191 ceph-mon[31636]: pgmap v16854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:42.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31433.950812 secs 2024-04-21T19:08:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:08:43.701+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:08:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:08:43.701+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:08:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:08:43.701+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:08:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:08:43.702+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:08:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:44 smithi170 ceph-mon[31212]: pgmap v16855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:44.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31435.709965 secs 2024-04-21T19:08:44.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:44 smithi077 ceph-mon[27902]: pgmap v16855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:44.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31435.709965 secs 2024-04-21T19:08:44.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:44 smithi191 ceph-mon[31636]: pgmap v16855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:44.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31435.709965 secs 2024-04-21T19:08:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:46.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:46 smithi170 ceph-mon[31212]: pgmap v16856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:46.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:46 smithi077 ceph-mon[27902]: pgmap v16856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:46.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:46 smithi191 ceph-mon[31636]: pgmap v16856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:47.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31438.950942 secs 2024-04-21T19:08:47.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31438.950942 secs 2024-04-21T19:08:47.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31438.950942 secs 2024-04-21T19:08:48.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:48 smithi170 ceph-mon[31212]: pgmap v16857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:48.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:48 smithi077 ceph-mon[27902]: pgmap v16857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:48.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:48 smithi191 ceph-mon[31636]: pgmap v16857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31440.710084 secs 2024-04-21T19:08:49.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31440.710084 secs 2024-04-21T19:08:49.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31440.710084 secs 2024-04-21T19:08:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:50.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:50 smithi170 ceph-mon[31212]: pgmap v16858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:50.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:50 smithi077 ceph-mon[27902]: pgmap v16858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:50.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:50 smithi191 ceph-mon[31636]: pgmap v16858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:08:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:52 smithi170 ceph-mon[31212]: pgmap v16859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:52.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31443.951065 secs 2024-04-21T19:08:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:52 smithi077 ceph-mon[27902]: pgmap v16859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31443.951065 secs 2024-04-21T19:08:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:52 smithi191 ceph-mon[31636]: pgmap v16859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31443.951065 secs 2024-04-21T19:08:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:54 smithi170 ceph-mon[31212]: pgmap v16860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31445.710157 secs 2024-04-21T19:08:54.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:08:54.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:54 smithi077 ceph-mon[27902]: pgmap v16860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:54.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31445.710157 secs 2024-04-21T19:08:54.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:08:54.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:54 smithi191 ceph-mon[31636]: pgmap v16860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:54.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31445.710157 secs 2024-04-21T19:08:54.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:08:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:08:55.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:08:55.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:08:55.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:08:55.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:08:55.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:08:55.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:08:55.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:08:55.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:08:55.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:08:56.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:56 smithi170 ceph-mon[31212]: pgmap v16861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:56.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:56 smithi077 ceph-mon[27902]: pgmap v16861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:56.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:56 smithi191 ceph-mon[31636]: pgmap v16861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:08:57.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31448.951180 secs 2024-04-21T19:08:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31448.951180 secs 2024-04-21T19:08:57.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31448.951180 secs 2024-04-21T19:08:58.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:58 smithi170 ceph-mon[31212]: pgmap v16862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:58.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:58 smithi077 ceph-mon[27902]: pgmap v16862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:58.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:58 smithi191 ceph-mon[31636]: pgmap v16862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:08:59.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:08:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31450.710242 secs 2024-04-21T19:08:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:08:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31450.710242 secs 2024-04-21T19:08:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:08:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31450.710242 secs 2024-04-21T19:09:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:00 smithi170 ceph-mon[31212]: pgmap v16863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:00 smithi077 ceph-mon[27902]: pgmap v16863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:00 smithi191 ceph-mon[31636]: pgmap v16863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:02 smithi077 ceph-mon[27902]: pgmap v16864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T19:09:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31453.951244 secs 2024-04-21T19:09:02.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:02 smithi191 ceph-mon[31636]: pgmap v16864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T19:09:02.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31453.951244 secs 2024-04-21T19:09:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:02 smithi170 ceph-mon[31212]: pgmap v16864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T19:09:03.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31453.951244 secs 2024-04-21T19:09:04.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:04 smithi077 ceph-mon[27902]: pgmap v16865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:09:04.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31455.710380 secs 2024-04-21T19:09:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:04 smithi191 ceph-mon[31636]: pgmap v16865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:09:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31455.710380 secs 2024-04-21T19:09:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:04 smithi170 ceph-mon[31212]: pgmap v16865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:09:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31455.710380 secs 2024-04-21T19:09:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:05.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:05 smithi077 ceph-mon[27902]: osdmap e1126: 12 total, 12 up, 12 in 2024-04-21T19:09:05.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:05 smithi191 ceph-mon[31636]: osdmap e1126: 12 total, 12 up, 12 in 2024-04-21T19:09:06.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:05 smithi170 ceph-mon[31212]: osdmap e1126: 12 total, 12 up, 12 in 2024-04-21T19:09:06.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:06 smithi077 ceph-mon[27902]: pgmap v16867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:09:06.934 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:06 smithi170 ceph-mon[31212]: pgmap v16867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:09:06.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:06 smithi191 ceph-mon[31636]: pgmap v16867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:09:07.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31458.951359 secs 2024-04-21T19:09:07.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31458.951359 secs 2024-04-21T19:09:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31458.951359 secs 2024-04-21T19:09:08.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:08 smithi077 ceph-mon[27902]: pgmap v16868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:09:08.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:08 smithi077 ceph-mon[27902]: osdmap e1127: 12 total, 12 up, 12 in 2024-04-21T19:09:08.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:08 smithi191 ceph-mon[31636]: pgmap v16868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:09:08.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:08 smithi191 ceph-mon[31636]: osdmap e1127: 12 total, 12 up, 12 in 2024-04-21T19:09:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:08 smithi170 ceph-mon[31212]: pgmap v16868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:09:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:08 smithi170 ceph-mon[31212]: osdmap e1127: 12 total, 12 up, 12 in 2024-04-21T19:09:09.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31460.710445 secs 2024-04-21T19:09:09.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31460.710445 secs 2024-04-21T19:09:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31460.710445 secs 2024-04-21T19:09:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:10.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:10 smithi077 ceph-mon[27902]: pgmap v16870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-04-21T19:09:10.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:10 smithi191 ceph-mon[31636]: pgmap v16870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-04-21T19:09:11.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:10 smithi170 ceph-mon[31212]: pgmap v16870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-04-21T19:09:12.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:12 smithi077 ceph-mon[27902]: pgmap v16871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-21T19:09:12.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31463.951474 secs 2024-04-21T19:09:12.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:12 smithi191 ceph-mon[31636]: pgmap v16871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-21T19:09:12.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31463.951474 secs 2024-04-21T19:09:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:12 smithi170 ceph-mon[31212]: pgmap v16871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-21T19:09:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31463.951474 secs 2024-04-21T19:09:14.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:14 smithi077 ceph-mon[27902]: pgmap v16872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-04-21T19:09:14.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31465.710585 secs 2024-04-21T19:09:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:14 smithi191 ceph-mon[31636]: pgmap v16872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-04-21T19:09:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31465.710585 secs 2024-04-21T19:09:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:14 smithi170 ceph-mon[31212]: pgmap v16872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-04-21T19:09:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31465.710585 secs 2024-04-21T19:09:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:16.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:16 smithi077 ceph-mon[27902]: pgmap v16873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:09:16.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:16 smithi191 ceph-mon[31636]: pgmap v16873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:09:17.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:16 smithi170 ceph-mon[31212]: pgmap v16873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:09:17.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31468.951574 secs 2024-04-21T19:09:17.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31468.951574 secs 2024-04-21T19:09:18.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31468.951574 secs 2024-04-21T19:09:18.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:18 smithi077 ceph-mon[27902]: pgmap v16874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:09:18.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:18 smithi191 ceph-mon[31636]: pgmap v16874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:09:19.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:18 smithi170 ceph-mon[31212]: pgmap v16874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:09:19.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31470.710664 secs 2024-04-21T19:09:19.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31470.710664 secs 2024-04-21T19:09:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31470.710664 secs 2024-04-21T19:09:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:20.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:20 smithi077 ceph-mon[27902]: pgmap v16875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:09:20.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:20 smithi191 ceph-mon[31636]: pgmap v16875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:09:21.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:20 smithi170 ceph-mon[31212]: pgmap v16875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:09:22.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:22 smithi077 ceph-mon[27902]: pgmap v16876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:09:22.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31473.951690 secs 2024-04-21T19:09:22.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:22 smithi191 ceph-mon[31636]: pgmap v16876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:09:22.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31473.951690 secs 2024-04-21T19:09:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:22 smithi170 ceph-mon[31212]: pgmap v16876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:09:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31473.951690 secs 2024-04-21T19:09:24.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:24 smithi077 ceph-mon[27902]: pgmap v16877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:24.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31475.710785 secs 2024-04-21T19:09:24.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:24 smithi191 ceph-mon[31636]: pgmap v16877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:24.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31475.710785 secs 2024-04-21T19:09:25.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:24 smithi170 ceph-mon[31212]: pgmap v16877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:25.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31475.710785 secs 2024-04-21T19:09:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:26.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:26 smithi077 ceph-mon[27902]: pgmap v16878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:26.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:26 smithi191 ceph-mon[31636]: pgmap v16878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:27.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:26 smithi170 ceph-mon[31212]: pgmap v16878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:27.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31478.951841 secs 2024-04-21T19:09:27.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31478.951841 secs 2024-04-21T19:09:28.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31478.951841 secs 2024-04-21T19:09:28.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:28 smithi077 ceph-mon[27902]: pgmap v16879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:28.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:28 smithi191 ceph-mon[31636]: pgmap v16879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:29.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:28 smithi170 ceph-mon[31212]: pgmap v16879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:29.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31480.710847 secs 2024-04-21T19:09:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31480.710847 secs 2024-04-21T19:09:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:30.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31480.710847 secs 2024-04-21T19:09:30.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:30 smithi191 ceph-mon[31636]: pgmap v16880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:31.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:30 smithi170 ceph-mon[31212]: pgmap v16880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:31.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:30 smithi077 ceph-mon[27902]: pgmap v16880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:32.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:32 smithi191 ceph-mon[31636]: pgmap v16881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:32.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31483.951952 secs 2024-04-21T19:09:33.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:32 smithi170 ceph-mon[31212]: pgmap v16881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:33.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31483.951952 secs 2024-04-21T19:09:33.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:32 smithi077 ceph-mon[27902]: pgmap v16881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:33.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31483.951952 secs 2024-04-21T19:09:34.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:34 smithi191 ceph-mon[31636]: pgmap v16882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:34.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31485.710949 secs 2024-04-21T19:09:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:34 smithi170 ceph-mon[31212]: pgmap v16882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31485.710949 secs 2024-04-21T19:09:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:34 smithi077 ceph-mon[27902]: pgmap v16882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31485.710949 secs 2024-04-21T19:09:36.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:36 smithi191 ceph-mon[31636]: pgmap v16883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:37.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:36 smithi170 ceph-mon[31212]: pgmap v16883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:37.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:36 smithi077 ceph-mon[27902]: pgmap v16883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:37.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31488.952049 secs 2024-04-21T19:09:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31488.952049 secs 2024-04-21T19:09:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31488.952049 secs 2024-04-21T19:09:38.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:38 smithi191 ceph-mon[31636]: pgmap v16884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:39.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:38 smithi170 ceph-mon[31212]: pgmap v16884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:39.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:38 smithi077 ceph-mon[27902]: pgmap v16884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:39.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31490.711073 secs 2024-04-21T19:09:40.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31490.711073 secs 2024-04-21T19:09:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:40.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31490.711073 secs 2024-04-21T19:09:40.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:40 smithi191 ceph-mon[31636]: pgmap v16885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:41.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:40 smithi170 ceph-mon[31212]: pgmap v16885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:41.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:40 smithi077 ceph-mon[27902]: pgmap v16885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:42.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:42 smithi191 ceph-mon[31636]: pgmap v16886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:42.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31493.952165 secs 2024-04-21T19:09:43.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:42 smithi170 ceph-mon[31212]: pgmap v16886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:43.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31493.952165 secs 2024-04-21T19:09:43.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:42 smithi077 ceph-mon[27902]: pgmap v16886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:43.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31493.952165 secs 2024-04-21T19:09:44.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:44 smithi191 ceph-mon[31636]: pgmap v16887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:44.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31495.711195 secs 2024-04-21T19:09:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:44 smithi170 ceph-mon[31212]: pgmap v16887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31495.711195 secs 2024-04-21T19:09:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:45.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:44 smithi077 ceph-mon[27902]: pgmap v16887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:45.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31495.711195 secs 2024-04-21T19:09:46.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:46 smithi191 ceph-mon[31636]: pgmap v16888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:47.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:46 smithi170 ceph-mon[31212]: pgmap v16888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:47.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:46 smithi077 ceph-mon[27902]: pgmap v16888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:09:47.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31498.952231 secs 2024-04-21T19:09:48.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31498.952231 secs 2024-04-21T19:09:48.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31498.952231 secs 2024-04-21T19:09:48.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:48 smithi191 ceph-mon[31636]: pgmap v16889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:49.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:48 smithi170 ceph-mon[31212]: pgmap v16889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:49.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:48 smithi077 ceph-mon[27902]: pgmap v16889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:49.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31500.711315 secs 2024-04-21T19:09:50.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31500.711315 secs 2024-04-21T19:09:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31500.711315 secs 2024-04-21T19:09:50.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:50 smithi191 ceph-mon[31636]: pgmap v16890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:51.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:50 smithi170 ceph-mon[31212]: pgmap v16890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:51.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:50 smithi077 ceph-mon[27902]: pgmap v16890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:09:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:52 smithi191 ceph-mon[31636]: pgmap v16891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:09:52.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31503.952346 secs 2024-04-21T19:09:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:52 smithi170 ceph-mon[31212]: pgmap v16891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:09:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31503.952346 secs 2024-04-21T19:09:53.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:52 smithi077 ceph-mon[27902]: pgmap v16891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:09:53.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31503.952346 secs 2024-04-21T19:09:54.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:54 smithi191 ceph-mon[31636]: pgmap v16892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:09:54.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31505.711457 secs 2024-04-21T19:09:55.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:54 smithi170 ceph-mon[31212]: pgmap v16892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:09:55.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31505.711457 secs 2024-04-21T19:09:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:09:55.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:54 smithi077 ceph-mon[27902]: pgmap v16892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:09:55.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31505.711457 secs 2024-04-21T19:09:55.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:09:56.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:09:56.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:09:56.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:56 smithi191 ceph-mon[31636]: pgmap v16893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:09:56.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:09:56.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:09:56.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:09:57.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:56 smithi170 ceph-mon[31212]: pgmap v16893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:09:57.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:09:57.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:09:57.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:09:57.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:56 smithi077 ceph-mon[27902]: pgmap v16893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:09:57.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:09:57.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:09:57.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:09:57.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31508.952462 secs 2024-04-21T19:09:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31508.952462 secs 2024-04-21T19:09:58.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31508.952462 secs 2024-04-21T19:09:58.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:58 smithi191 ceph-mon[31636]: pgmap v16894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:09:59.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:58 smithi170 ceph-mon[31212]: pgmap v16894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:09:59.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:58 smithi077 ceph-mon[27902]: pgmap v16894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:09:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31510.711579 secs 2024-04-21T19:10:00.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31510.711579 secs 2024-04-21T19:10:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:00.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31510.711579 secs 2024-04-21T19:10:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:00 smithi191 ceph-mon[31636]: pgmap v16895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:10:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:10:01.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:00 smithi170 ceph-mon[31212]: pgmap v16895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:10:01.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:10:01.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:00 smithi077 ceph-mon[27902]: pgmap v16895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:10:01.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:10:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:02 smithi170 ceph-mon[31212]: pgmap v16896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:10:03.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31513.952587 secs 2024-04-21T19:10:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:02 smithi077 ceph-mon[27902]: pgmap v16896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:10:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31513.952587 secs 2024-04-21T19:10:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:02 smithi191 ceph-mon[31636]: pgmap v16896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:10:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31513.952587 secs 2024-04-21T19:10:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:04 smithi170 ceph-mon[31212]: pgmap v16897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31515.711716 secs 2024-04-21T19:10:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:05.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:04 smithi077 ceph-mon[27902]: pgmap v16897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:05.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31515.711716 secs 2024-04-21T19:10:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:04 smithi191 ceph-mon[31636]: pgmap v16897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31515.711716 secs 2024-04-21T19:10:06.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:05 smithi170 ceph-mon[31212]: osdmap e1128: 12 total, 12 up, 12 in 2024-04-21T19:10:06.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:05 smithi077 ceph-mon[27902]: osdmap e1128: 12 total, 12 up, 12 in 2024-04-21T19:10:06.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:05 smithi191 ceph-mon[31636]: osdmap e1128: 12 total, 12 up, 12 in 2024-04-21T19:10:07.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:06 smithi170 ceph-mon[31212]: pgmap v16899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:07.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:06 smithi191 ceph-mon[31636]: pgmap v16899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:07.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:06 smithi077 ceph-mon[27902]: pgmap v16899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31518.952724 secs 2024-04-21T19:10:08.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31518.952724 secs 2024-04-21T19:10:08.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31518.952724 secs 2024-04-21T19:10:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:08 smithi170 ceph-mon[31212]: pgmap v16900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:09.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:08 smithi077 ceph-mon[27902]: pgmap v16900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:09.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:08 smithi191 ceph-mon[31636]: pgmap v16900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31520.711837 secs 2024-04-21T19:10:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31520.711837 secs 2024-04-21T19:10:10.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31520.711837 secs 2024-04-21T19:10:11.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:10 smithi170 ceph-mon[31212]: pgmap v16901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:11.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:10 smithi077 ceph-mon[27902]: pgmap v16901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:10 smithi191 ceph-mon[31636]: pgmap v16901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:10:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:12 smithi170 ceph-mon[31212]: pgmap v16902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:10:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31523.952836 secs 2024-04-21T19:10:13.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:12 smithi077 ceph-mon[27902]: pgmap v16902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:10:13.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31523.952836 secs 2024-04-21T19:10:13.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:12 smithi191 ceph-mon[31636]: pgmap v16902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:10:13.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31523.952836 secs 2024-04-21T19:10:14.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:14 smithi077 ceph-mon[27902]: pgmap v16903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:10:14.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:14 smithi077 ceph-mon[27902]: osdmap e1129: 12 total, 12 up, 12 in 2024-04-21T19:10:14.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31525.711930 secs 2024-04-21T19:10:14.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:14 smithi191 ceph-mon[31636]: pgmap v16903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:10:14.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:14 smithi191 ceph-mon[31636]: osdmap e1129: 12 total, 12 up, 12 in 2024-04-21T19:10:14.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31525.711930 secs 2024-04-21T19:10:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:14 smithi170 ceph-mon[31212]: pgmap v16903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:10:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:14 smithi170 ceph-mon[31212]: osdmap e1129: 12 total, 12 up, 12 in 2024-04-21T19:10:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31525.711930 secs 2024-04-21T19:10:15.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:16.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:16 smithi077 ceph-mon[27902]: pgmap v16905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:16.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:16 smithi191 ceph-mon[31636]: pgmap v16905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:16.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:16 smithi170 ceph-mon[31212]: pgmap v16905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:17.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31528.952951 secs 2024-04-21T19:10:17.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31528.952951 secs 2024-04-21T19:10:17.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31528.952951 secs 2024-04-21T19:10:18.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:18 smithi077 ceph-mon[27902]: pgmap v16906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:18.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:18 smithi191 ceph-mon[31636]: pgmap v16906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:18.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:18 smithi170 ceph-mon[31212]: pgmap v16906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:19.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31530.712048 secs 2024-04-21T19:10:19.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31530.712048 secs 2024-04-21T19:10:19.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31530.712048 secs 2024-04-21T19:10:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:20.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:20 smithi077 ceph-mon[27902]: pgmap v16907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:20.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:20 smithi191 ceph-mon[31636]: pgmap v16907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:20.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:20 smithi170 ceph-mon[31212]: pgmap v16907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:10:22.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:22 smithi077 ceph-mon[27902]: pgmap v16908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:10:22.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31533.953091 secs 2024-04-21T19:10:22.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:22 smithi191 ceph-mon[31636]: pgmap v16908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:10:22.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31533.953091 secs 2024-04-21T19:10:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:22 smithi170 ceph-mon[31212]: pgmap v16908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:10:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31533.953091 secs 2024-04-21T19:10:24.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:24 smithi077 ceph-mon[27902]: pgmap v16909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:10:24.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31535.712120 secs 2024-04-21T19:10:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:24 smithi191 ceph-mon[31636]: pgmap v16909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:10:24.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31535.712120 secs 2024-04-21T19:10:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:24 smithi170 ceph-mon[31212]: pgmap v16909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:10:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31535.712120 secs 2024-04-21T19:10:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:26.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:26 smithi077 ceph-mon[27902]: pgmap v16910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:10:26.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:26 smithi191 ceph-mon[31636]: pgmap v16910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:10:26.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:26 smithi170 ceph-mon[31212]: pgmap v16910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:10:27.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31538.953190 secs 2024-04-21T19:10:27.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31538.953190 secs 2024-04-21T19:10:27.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31538.953190 secs 2024-04-21T19:10:28.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:28 smithi077 ceph-mon[27902]: pgmap v16911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:28.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:28 smithi191 ceph-mon[31636]: pgmap v16911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:28.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:28 smithi170 ceph-mon[31212]: pgmap v16911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:29.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31540.712197 secs 2024-04-21T19:10:29.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31540.712197 secs 2024-04-21T19:10:29.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31540.712197 secs 2024-04-21T19:10:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:30.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:30 smithi077 ceph-mon[27902]: pgmap v16912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:30.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:30 smithi191 ceph-mon[31636]: pgmap v16912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:30.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:30 smithi170 ceph-mon[31212]: pgmap v16912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:32.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:32 smithi077 ceph-mon[27902]: pgmap v16913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:32.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31543.953310 secs 2024-04-21T19:10:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:32 smithi191 ceph-mon[31636]: pgmap v16913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:32.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31543.953310 secs 2024-04-21T19:10:32.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:32 smithi170 ceph-mon[31212]: pgmap v16913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:32.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31543.953310 secs 2024-04-21T19:10:34.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:34 smithi077 ceph-mon[27902]: pgmap v16914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:34.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31545.712310 secs 2024-04-21T19:10:34.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:34 smithi191 ceph-mon[31636]: pgmap v16914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:34.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31545.712310 secs 2024-04-21T19:10:34.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:34 smithi170 ceph-mon[31212]: pgmap v16914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:34.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31545.712310 secs 2024-04-21T19:10:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:36.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:36 smithi191 ceph-mon[31636]: pgmap v16915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:36.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:36 smithi170 ceph-mon[31212]: pgmap v16915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:36.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:36 smithi077 ceph-mon[27902]: pgmap v16915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:37.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31548.953448 secs 2024-04-21T19:10:37.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31548.953448 secs 2024-04-21T19:10:37.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31548.953448 secs 2024-04-21T19:10:38.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:38 smithi191 ceph-mon[31636]: pgmap v16916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:38.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:38 smithi170 ceph-mon[31212]: pgmap v16916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:38.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:38 smithi077 ceph-mon[27902]: pgmap v16916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:39.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31550.712372 secs 2024-04-21T19:10:39.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31550.712372 secs 2024-04-21T19:10:39.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31550.712372 secs 2024-04-21T19:10:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:40.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:40 smithi191 ceph-mon[31636]: pgmap v16917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:40.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:40 smithi170 ceph-mon[31212]: pgmap v16917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:40.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:40 smithi077 ceph-mon[27902]: pgmap v16917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:42.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:42 smithi191 ceph-mon[31636]: pgmap v16918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:42.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31553.953585 secs 2024-04-21T19:10:42.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:42 smithi170 ceph-mon[31212]: pgmap v16918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:42.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31553.953585 secs 2024-04-21T19:10:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:42 smithi077 ceph-mon[27902]: pgmap v16918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31553.953585 secs 2024-04-21T19:10:44.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:44 smithi191 ceph-mon[31636]: pgmap v16919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:44.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31555.712487 secs 2024-04-21T19:10:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:44 smithi170 ceph-mon[31212]: pgmap v16919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31555.712487 secs 2024-04-21T19:10:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:44 smithi077 ceph-mon[27902]: pgmap v16919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:44.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31555.712487 secs 2024-04-21T19:10:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:46.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:46 smithi191 ceph-mon[31636]: pgmap v16920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:46.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:46 smithi170 ceph-mon[31212]: pgmap v16920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:46.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:46 smithi077 ceph-mon[27902]: pgmap v16920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:47.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31558.953697 secs 2024-04-21T19:10:47.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31558.953697 secs 2024-04-21T19:10:47.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31558.953697 secs 2024-04-21T19:10:48.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:48 smithi191 ceph-mon[31636]: pgmap v16921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:48.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:48 smithi170 ceph-mon[31212]: pgmap v16921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:48.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:48 smithi077 ceph-mon[27902]: pgmap v16921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:49.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31560.712579 secs 2024-04-21T19:10:49.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31560.712579 secs 2024-04-21T19:10:49.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31560.712579 secs 2024-04-21T19:10:50.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:50.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:50 smithi191 ceph-mon[31636]: pgmap v16922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:50.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:50 smithi170 ceph-mon[31212]: pgmap v16922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:50.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:50 smithi077 ceph-mon[27902]: pgmap v16922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:52 smithi191 ceph-mon[31636]: pgmap v16923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31563.953820 secs 2024-04-21T19:10:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:52 smithi170 ceph-mon[31212]: pgmap v16923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31563.953820 secs 2024-04-21T19:10:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:52 smithi077 ceph-mon[27902]: pgmap v16923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:52.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31563.953820 secs 2024-04-21T19:10:54.662 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:54 smithi077 ceph-mon[27902]: pgmap v16924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:54.663 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31565.712686 secs 2024-04-21T19:10:54.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:54 smithi191 ceph-mon[31636]: pgmap v16924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:54.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31565.712686 secs 2024-04-21T19:10:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:54 smithi170 ceph-mon[31212]: pgmap v16924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31565.712686 secs 2024-04-21T19:10:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:10:56.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:56 smithi191 ceph-mon[31636]: pgmap v16925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:56.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:10:56.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:56 smithi170 ceph-mon[31212]: pgmap v16925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:56.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:10:56.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:56 smithi077 ceph-mon[27902]: pgmap v16925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:10:56.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:10:57.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:10:57.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:10:57.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:10:57.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31568.953933 secs 2024-04-21T19:10:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:10:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:10:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:10:57.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31568.953933 secs 2024-04-21T19:10:57.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:10:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:10:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:10:57.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31568.953933 secs 2024-04-21T19:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:10:58.721+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:10:58.721+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:10:58.721+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:10:58.721+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:10:58.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:58 smithi077 ceph-mon[27902]: pgmap v16926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:58.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:58 smithi191 ceph-mon[31636]: pgmap v16926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:59.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:58 smithi170 ceph-mon[31212]: pgmap v16926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:10:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31570.712794 secs 2024-04-21T19:10:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31570.712794 secs 2024-04-21T19:11:00.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31570.712794 secs 2024-04-21T19:11:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:00.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:00 smithi077 ceph-mon[27902]: pgmap v16927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:00 smithi191 ceph-mon[31636]: pgmap v16927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:01.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:00 smithi170 ceph-mon[31212]: pgmap v16927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:02 smithi077 ceph-mon[27902]: pgmap v16928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:02.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31573.954053 secs 2024-04-21T19:11:02.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:02 smithi191 ceph-mon[31636]: pgmap v16928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:02.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31573.954053 secs 2024-04-21T19:11:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:02 smithi170 ceph-mon[31212]: pgmap v16928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31573.954053 secs 2024-04-21T19:11:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:04 smithi191 ceph-mon[31636]: pgmap v16929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:04.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31575.712906 secs 2024-04-21T19:11:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:04 smithi170 ceph-mon[31212]: pgmap v16929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31575.712906 secs 2024-04-21T19:11:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:04 smithi077 ceph-mon[27902]: pgmap v16929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31575.712906 secs 2024-04-21T19:11:05.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:05 smithi191 ceph-mon[31636]: osdmap e1130: 12 total, 12 up, 12 in 2024-04-21T19:11:06.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:05 smithi170 ceph-mon[31212]: osdmap e1130: 12 total, 12 up, 12 in 2024-04-21T19:11:06.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:05 smithi077 ceph-mon[27902]: osdmap e1130: 12 total, 12 up, 12 in 2024-04-21T19:11:06.933 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:06 smithi170 ceph-mon[31212]: pgmap v16931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:11:06.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:06 smithi191 ceph-mon[31636]: pgmap v16931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:11:07.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:06 smithi077 ceph-mon[27902]: pgmap v16931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:11:07.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31578.954169 secs 2024-04-21T19:11:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31578.954169 secs 2024-04-21T19:11:08.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31578.954169 secs 2024-04-21T19:11:08.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:08 smithi191 ceph-mon[31636]: pgmap v16932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:11:08.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:08 smithi191 ceph-mon[31636]: osdmap e1131: 12 total, 12 up, 12 in 2024-04-21T19:11:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:08 smithi170 ceph-mon[31212]: pgmap v16932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:11:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:08 smithi170 ceph-mon[31212]: osdmap e1131: 12 total, 12 up, 12 in 2024-04-21T19:11:09.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:08 smithi077 ceph-mon[27902]: pgmap v16932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:11:09.146 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:08 smithi077 ceph-mon[27902]: osdmap e1131: 12 total, 12 up, 12 in 2024-04-21T19:11:09.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31580.712989 secs 2024-04-21T19:11:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31580.712989 secs 2024-04-21T19:11:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31580.712989 secs 2024-04-21T19:11:10.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:10 smithi191 ceph-mon[31636]: pgmap v16934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:11:11.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:10 smithi170 ceph-mon[31212]: pgmap v16934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:11:11.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:10 smithi077 ceph-mon[27902]: pgmap v16934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:11:12.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:12 smithi191 ceph-mon[31636]: pgmap v16935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:11:12.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31583.954263 secs 2024-04-21T19:11:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:12 smithi170 ceph-mon[31212]: pgmap v16935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:11:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31583.954263 secs 2024-04-21T19:11:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:12 smithi077 ceph-mon[27902]: pgmap v16935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:11:13.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31583.954263 secs 2024-04-21T19:11:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:14 smithi191 ceph-mon[31636]: pgmap v16936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T19:11:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31585.713066 secs 2024-04-21T19:11:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:14 smithi170 ceph-mon[31212]: pgmap v16936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T19:11:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31585.713066 secs 2024-04-21T19:11:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:15.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:14 smithi077 ceph-mon[27902]: pgmap v16936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T19:11:15.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31585.713066 secs 2024-04-21T19:11:16.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:16 smithi191 ceph-mon[31636]: pgmap v16937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:11:17.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:16 smithi170 ceph-mon[31212]: pgmap v16937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:11:17.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:16 smithi077 ceph-mon[27902]: pgmap v16937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:11:17.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31588.954383 secs 2024-04-21T19:11:18.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31588.954383 secs 2024-04-21T19:11:18.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31588.954383 secs 2024-04-21T19:11:18.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:18 smithi191 ceph-mon[31636]: pgmap v16938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:11:19.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:18 smithi170 ceph-mon[31212]: pgmap v16938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:11:19.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:18 smithi077 ceph-mon[27902]: pgmap v16938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:11:19.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31590.713180 secs 2024-04-21T19:11:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31590.713180 secs 2024-04-21T19:11:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:20.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31590.713180 secs 2024-04-21T19:11:20.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:20 smithi191 ceph-mon[31636]: pgmap v16939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:11:21.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:20 smithi170 ceph-mon[31212]: pgmap v16939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:11:21.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:20 smithi077 ceph-mon[27902]: pgmap v16939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:11:22.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:22 smithi191 ceph-mon[31636]: pgmap v16940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:11:22.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31593.954497 secs 2024-04-21T19:11:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:22 smithi170 ceph-mon[31212]: pgmap v16940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:11:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31593.954497 secs 2024-04-21T19:11:23.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:22 smithi077 ceph-mon[27902]: pgmap v16940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:11:23.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31593.954497 secs 2024-04-21T19:11:24.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:24 smithi191 ceph-mon[31636]: pgmap v16941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:24.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31595.713293 secs 2024-04-21T19:11:25.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:24 smithi170 ceph-mon[31212]: pgmap v16941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:25.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31595.713293 secs 2024-04-21T19:11:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:25.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:24 smithi077 ceph-mon[27902]: pgmap v16941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:25.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31595.713293 secs 2024-04-21T19:11:26.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:26 smithi191 ceph-mon[31636]: pgmap v16942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:27.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:26 smithi170 ceph-mon[31212]: pgmap v16942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:27.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:26 smithi077 ceph-mon[27902]: pgmap v16942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:27.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31598.954621 secs 2024-04-21T19:11:28.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31598.954621 secs 2024-04-21T19:11:28.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31598.954621 secs 2024-04-21T19:11:28.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:28 smithi191 ceph-mon[31636]: pgmap v16943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:29.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:28 smithi170 ceph-mon[31212]: pgmap v16943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:29.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:28 smithi077 ceph-mon[27902]: pgmap v16943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:29.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31600.713365 secs 2024-04-21T19:11:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31600.713365 secs 2024-04-21T19:11:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:30.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31600.713365 secs 2024-04-21T19:11:30.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:30 smithi191 ceph-mon[31636]: pgmap v16944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:31.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:30 smithi170 ceph-mon[31212]: pgmap v16944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:31.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:30 smithi077 ceph-mon[27902]: pgmap v16944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:32.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:32 smithi191 ceph-mon[31636]: pgmap v16945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:32.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31603.954740 secs 2024-04-21T19:11:33.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:32 smithi170 ceph-mon[31212]: pgmap v16945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:33.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31603.954740 secs 2024-04-21T19:11:33.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:32 smithi077 ceph-mon[27902]: pgmap v16945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:33.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31603.954740 secs 2024-04-21T19:11:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:34 smithi170 ceph-mon[31212]: pgmap v16946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31605.713481 secs 2024-04-21T19:11:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:35.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:34 smithi077 ceph-mon[27902]: pgmap v16946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:35.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31605.713481 secs 2024-04-21T19:11:35.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:34 smithi191 ceph-mon[31636]: pgmap v16946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:35.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31605.713481 secs 2024-04-21T19:11:36.996 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:36 smithi191 ceph-mon[31636]: pgmap v16947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:37.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:36 smithi170 ceph-mon[31212]: pgmap v16947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:37.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:36 smithi077 ceph-mon[27902]: pgmap v16947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:38.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31608.954860 secs 2024-04-21T19:11:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31608.954860 secs 2024-04-21T19:11:38.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31608.954860 secs 2024-04-21T19:11:39.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:38 smithi170 ceph-mon[31212]: pgmap v16948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:39.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:38 smithi077 ceph-mon[27902]: pgmap v16948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:39.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:38 smithi191 ceph-mon[31636]: pgmap v16948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:40.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31610.713597 secs 2024-04-21T19:11:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31610.713597 secs 2024-04-21T19:11:40.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31610.713597 secs 2024-04-21T19:11:41.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:40 smithi170 ceph-mon[31212]: pgmap v16949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:41.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:40 smithi077 ceph-mon[27902]: pgmap v16949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:41.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:40 smithi191 ceph-mon[31636]: pgmap v16949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:43.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:42 smithi170 ceph-mon[31212]: pgmap v16950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:43.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31613.954965 secs 2024-04-21T19:11:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:42 smithi077 ceph-mon[27902]: pgmap v16950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:43.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31613.954965 secs 2024-04-21T19:11:43.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:42 smithi191 ceph-mon[31636]: pgmap v16950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:43.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31613.954965 secs 2024-04-21T19:11:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:44 smithi170 ceph-mon[31212]: pgmap v16951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31615.713712 secs 2024-04-21T19:11:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:45.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:44 smithi077 ceph-mon[27902]: pgmap v16951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:45.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31615.713712 secs 2024-04-21T19:11:45.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:44 smithi191 ceph-mon[31636]: pgmap v16951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:45.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31615.713712 secs 2024-04-21T19:11:47.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:46 smithi170 ceph-mon[31212]: pgmap v16952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:47.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:46 smithi077 ceph-mon[27902]: pgmap v16952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:47.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:46 smithi191 ceph-mon[31636]: pgmap v16952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:48.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31618.955070 secs 2024-04-21T19:11:48.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31618.955070 secs 2024-04-21T19:11:48.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31618.955070 secs 2024-04-21T19:11:49.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:48 smithi170 ceph-mon[31212]: pgmap v16953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:49.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:48 smithi077 ceph-mon[27902]: pgmap v16953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:49.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:48 smithi191 ceph-mon[31636]: pgmap v16953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:50.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31620.713802 secs 2024-04-21T19:11:50.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31620.713802 secs 2024-04-21T19:11:50.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31620.713802 secs 2024-04-21T19:11:51.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:50 smithi170 ceph-mon[31212]: pgmap v16954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:51.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:50 smithi077 ceph-mon[27902]: pgmap v16954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:51.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:50 smithi191 ceph-mon[31636]: pgmap v16954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:52 smithi170 ceph-mon[31212]: pgmap v16955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31623.955190 secs 2024-04-21T19:11:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:52 smithi077 ceph-mon[27902]: pgmap v16955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31623.955190 secs 2024-04-21T19:11:53.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:52 smithi191 ceph-mon[31636]: pgmap v16955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:53.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31623.955190 secs 2024-04-21T19:11:55.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:54 smithi170 ceph-mon[31212]: pgmap v16956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:55.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31625.713916 secs 2024-04-21T19:11:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:11:55.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:54 smithi077 ceph-mon[27902]: pgmap v16956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:55.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31625.713916 secs 2024-04-21T19:11:55.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:54 smithi191 ceph-mon[31636]: pgmap v16956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:55.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31625.713916 secs 2024-04-21T19:11:57.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:56 smithi170 ceph-mon[31212]: pgmap v16957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:57.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:11:57.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:56 smithi077 ceph-mon[27902]: pgmap v16957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:57.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:11:57.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:56 smithi191 ceph-mon[31636]: pgmap v16957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:11:57.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:11:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31628.955277 secs 2024-04-21T19:11:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:11:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:11:58.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:11:58.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31628.955277 secs 2024-04-21T19:11:58.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:11:58.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:11:58.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:11:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31628.955277 secs 2024-04-21T19:11:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:11:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:11:58.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:11:59.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:58 smithi170 ceph-mon[31212]: pgmap v16958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:59.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:58 smithi077 ceph-mon[27902]: pgmap v16958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:11:59.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:58 smithi191 ceph-mon[31636]: pgmap v16958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:00.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31630.714008 secs 2024-04-21T19:12:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:00.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31630.714008 secs 2024-04-21T19:12:00.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31630.714008 secs 2024-04-21T19:12:01.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:00 smithi170 ceph-mon[31212]: pgmap v16959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:00 smithi077 ceph-mon[27902]: pgmap v16959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:01.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:00 smithi191 ceph-mon[31636]: pgmap v16959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:02 smithi170 ceph-mon[31212]: pgmap v16960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31633.955400 secs 2024-04-21T19:12:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:02 smithi077 ceph-mon[27902]: pgmap v16960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31633.955400 secs 2024-04-21T19:12:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:02 smithi191 ceph-mon[31636]: pgmap v16960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31633.955400 secs 2024-04-21T19:12:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:04 smithi077 ceph-mon[27902]: pgmap v16961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31635.714123 secs 2024-04-21T19:12:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:04 smithi191 ceph-mon[31636]: pgmap v16961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:05.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31635.714123 secs 2024-04-21T19:12:05.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:04 smithi170 ceph-mon[31212]: pgmap v16961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:05.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31635.714123 secs 2024-04-21T19:12:06.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:05 smithi077 ceph-mon[27902]: osdmap e1132: 12 total, 12 up, 12 in 2024-04-21T19:12:06.183 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:05 smithi170 ceph-mon[31212]: osdmap e1132: 12 total, 12 up, 12 in 2024-04-21T19:12:06.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:05 smithi191 ceph-mon[31636]: osdmap e1132: 12 total, 12 up, 12 in 2024-04-21T19:12:07.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:06 smithi191 ceph-mon[31636]: pgmap v16963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:07.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:06 smithi077 ceph-mon[27902]: pgmap v16963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:07.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:06 smithi170 ceph-mon[31212]: pgmap v16963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:08.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31638.955517 secs 2024-04-21T19:12:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31638.955517 secs 2024-04-21T19:12:08.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31638.955517 secs 2024-04-21T19:12:09.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:08 smithi077 ceph-mon[27902]: pgmap v16964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:09.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:08 smithi191 ceph-mon[31636]: pgmap v16964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:09.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:08 smithi170 ceph-mon[31212]: pgmap v16964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31640.714218 secs 2024-04-21T19:12:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31640.714218 secs 2024-04-21T19:12:10.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31640.714218 secs 2024-04-21T19:12:11.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:10 smithi077 ceph-mon[27902]: pgmap v16965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:10 smithi191 ceph-mon[31636]: pgmap v16965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:11.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:10 smithi170 ceph-mon[31212]: pgmap v16965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:12:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:12 smithi077 ceph-mon[27902]: pgmap v16966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:12:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31643.955633 secs 2024-04-21T19:12:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:12 smithi191 ceph-mon[31636]: pgmap v16966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:12:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31643.955633 secs 2024-04-21T19:12:13.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:12 smithi170 ceph-mon[31212]: pgmap v16966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:12:13.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31643.955633 secs 2024-04-21T19:12:14.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:14 smithi077 ceph-mon[27902]: pgmap v16967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:12:14.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:14 smithi077 ceph-mon[27902]: osdmap e1133: 12 total, 12 up, 12 in 2024-04-21T19:12:14.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31645.714297 secs 2024-04-21T19:12:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:14 smithi191 ceph-mon[31636]: pgmap v16967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:12:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:14 smithi191 ceph-mon[31636]: osdmap e1133: 12 total, 12 up, 12 in 2024-04-21T19:12:14.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31645.714297 secs 2024-04-21T19:12:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:14 smithi170 ceph-mon[31212]: pgmap v16967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:12:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:14 smithi170 ceph-mon[31212]: osdmap e1133: 12 total, 12 up, 12 in 2024-04-21T19:12:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31645.714297 secs 2024-04-21T19:12:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:16.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:16 smithi077 ceph-mon[27902]: pgmap v16969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:16.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:16 smithi191 ceph-mon[31636]: pgmap v16969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:16.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:16 smithi170 ceph-mon[31212]: pgmap v16969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:17.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31648.955746 secs 2024-04-21T19:12:17.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31648.955746 secs 2024-04-21T19:12:17.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31648.955746 secs 2024-04-21T19:12:18.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:18 smithi077 ceph-mon[27902]: pgmap v16970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:18.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:18 smithi191 ceph-mon[31636]: pgmap v16970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:18.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:18 smithi170 ceph-mon[31212]: pgmap v16970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:19.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31650.714410 secs 2024-04-21T19:12:19.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31650.714410 secs 2024-04-21T19:12:19.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31650.714410 secs 2024-04-21T19:12:20.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:20.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:20 smithi077 ceph-mon[27902]: pgmap v16971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:20.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:20 smithi191 ceph-mon[31636]: pgmap v16971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:20.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:20 smithi170 ceph-mon[31212]: pgmap v16971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:12:22.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:22 smithi077 ceph-mon[27902]: pgmap v16972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:12:22.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31653.955877 secs 2024-04-21T19:12:22.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:22 smithi191 ceph-mon[31636]: pgmap v16972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:12:22.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31653.955877 secs 2024-04-21T19:12:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:22 smithi170 ceph-mon[31212]: pgmap v16972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:12:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31653.955877 secs 2024-04-21T19:12:24.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:24 smithi077 ceph-mon[27902]: pgmap v16973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:12:24.611 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31655.714526 secs 2024-04-21T19:12:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:24 smithi191 ceph-mon[31636]: pgmap v16973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:12:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31655.714526 secs 2024-04-21T19:12:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:24 smithi170 ceph-mon[31212]: pgmap v16973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:12:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31655.714526 secs 2024-04-21T19:12:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:26.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:26 smithi191 ceph-mon[31636]: pgmap v16974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:12:26.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:26 smithi170 ceph-mon[31212]: pgmap v16974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:12:26.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:26 smithi077 ceph-mon[27902]: pgmap v16974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:12:27.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31658.955991 secs 2024-04-21T19:12:27.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31658.955991 secs 2024-04-21T19:12:27.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31658.955991 secs 2024-04-21T19:12:28.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:28 smithi191 ceph-mon[31636]: pgmap v16975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:28.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:28 smithi170 ceph-mon[31212]: pgmap v16975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:28.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:28 smithi077 ceph-mon[27902]: pgmap v16975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:29.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31660.714641 secs 2024-04-21T19:12:29.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31660.714641 secs 2024-04-21T19:12:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31660.714641 secs 2024-04-21T19:12:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:30.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:30 smithi191 ceph-mon[31636]: pgmap v16976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:30.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:30 smithi170 ceph-mon[31212]: pgmap v16976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:30.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:30 smithi077 ceph-mon[27902]: pgmap v16976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:32 smithi191 ceph-mon[31636]: pgmap v16977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31663.956141 secs 2024-04-21T19:12:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:32 smithi170 ceph-mon[31212]: pgmap v16977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:32.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31663.956141 secs 2024-04-21T19:12:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:32 smithi077 ceph-mon[27902]: pgmap v16977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31663.956141 secs 2024-04-21T19:12:34.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:34 smithi191 ceph-mon[31636]: pgmap v16978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:34.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31665.714751 secs 2024-04-21T19:12:34.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:34 smithi170 ceph-mon[31212]: pgmap v16978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:34.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31665.714751 secs 2024-04-21T19:12:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:34 smithi077 ceph-mon[27902]: pgmap v16978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31665.714751 secs 2024-04-21T19:12:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:36.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:36 smithi191 ceph-mon[31636]: pgmap v16979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:36.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:36 smithi170 ceph-mon[31212]: pgmap v16979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:36.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:36 smithi077 ceph-mon[27902]: pgmap v16979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:37.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31668.956257 secs 2024-04-21T19:12:37.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31668.956257 secs 2024-04-21T19:12:37.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31668.956257 secs 2024-04-21T19:12:38.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:38 smithi191 ceph-mon[31636]: pgmap v16980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:38.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:38 smithi170 ceph-mon[31212]: pgmap v16980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:38.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:38 smithi077 ceph-mon[27902]: pgmap v16980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:39.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31670.714887 secs 2024-04-21T19:12:39.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31670.714887 secs 2024-04-21T19:12:39.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31670.714887 secs 2024-04-21T19:12:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:40.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:40 smithi191 ceph-mon[31636]: pgmap v16981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:40.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:40 smithi170 ceph-mon[31212]: pgmap v16981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:40.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:40 smithi077 ceph-mon[27902]: pgmap v16981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:42.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:42 smithi191 ceph-mon[31636]: pgmap v16982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:42.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31673.956373 secs 2024-04-21T19:12:42.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:42 smithi170 ceph-mon[31212]: pgmap v16982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:42.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31673.956373 secs 2024-04-21T19:12:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:42 smithi077 ceph-mon[27902]: pgmap v16982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31673.956373 secs 2024-04-21T19:12:44.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:44 smithi191 ceph-mon[31636]: pgmap v16983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:44.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31675.714998 secs 2024-04-21T19:12:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:44 smithi170 ceph-mon[31212]: pgmap v16983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:44.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31675.714998 secs 2024-04-21T19:12:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:44 smithi077 ceph-mon[27902]: pgmap v16983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31675.714998 secs 2024-04-21T19:12:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:46.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:46 smithi191 ceph-mon[31636]: pgmap v16984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:46.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:46 smithi170 ceph-mon[31212]: pgmap v16984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:46.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:46 smithi077 ceph-mon[27902]: pgmap v16984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:47.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31678.956449 secs 2024-04-21T19:12:47.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31678.956449 secs 2024-04-21T19:12:47.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31678.956449 secs 2024-04-21T19:12:48.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:48 smithi191 ceph-mon[31636]: pgmap v16985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:48.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:48 smithi170 ceph-mon[31212]: pgmap v16985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:48.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:48 smithi077 ceph-mon[27902]: pgmap v16985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:49.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31680.715114 secs 2024-04-21T19:12:49.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31680.715114 secs 2024-04-21T19:12:49.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31680.715114 secs 2024-04-21T19:12:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:50.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:50 smithi191 ceph-mon[31636]: pgmap v16986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:50.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:50 smithi170 ceph-mon[31212]: pgmap v16986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:50.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:50 smithi077 ceph-mon[27902]: pgmap v16986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:52.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:52 smithi191 ceph-mon[31636]: pgmap v16987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:52.694 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31683.956566 secs 2024-04-21T19:12:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:52 smithi170 ceph-mon[31212]: pgmap v16987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:52.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31683.956566 secs 2024-04-21T19:12:52.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:52 smithi077 ceph-mon[27902]: pgmap v16987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:52.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31683.956566 secs 2024-04-21T19:12:54.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:54 smithi191 ceph-mon[31636]: pgmap v16988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:54.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31685.715173 secs 2024-04-21T19:12:54.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:54 smithi170 ceph-mon[31212]: pgmap v16988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:54.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31685.715173 secs 2024-04-21T19:12:54.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:54 smithi077 ceph-mon[27902]: pgmap v16988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:54.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31685.715173 secs 2024-04-21T19:12:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:12:56.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:56 smithi191 ceph-mon[31636]: pgmap v16989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:56.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:56 smithi170 ceph-mon[31212]: pgmap v16989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:56.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:56 smithi077 ceph-mon[27902]: pgmap v16989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:12:57.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31688.956680 secs 2024-04-21T19:12:57.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31688.956680 secs 2024-04-21T19:12:57.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31688.956680 secs 2024-04-21T19:12:58.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:58 smithi077 ceph-mon[27902]: pgmap v16990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:58.610 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:58 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:12:58.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:58 smithi191 ceph-mon[31636]: pgmap v16990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:58.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:58 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:12:58.700 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:58 smithi170 ceph-mon[31212]: pgmap v16990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:12:58.700 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:58 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31690.715241 secs 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:12:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31690.715241 secs 2024-04-21T19:12:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:12:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31690.715241 secs 2024-04-21T19:12:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:12:59.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:12:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:13:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: pgmap v16991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:13:00.783 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:13:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:13:00.784 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:13:00.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: pgmap v16991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:00.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:13:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:13:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:13:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:13:00.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:13:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: pgmap v16991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:13:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:13:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:13:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:13:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:13:00.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:13:02.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:02 smithi170 ceph-mon[31212]: pgmap v16992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:02.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31693.956803 secs 2024-04-21T19:13:02.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:02 smithi077 ceph-mon[27902]: pgmap v16992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:02.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31693.956803 secs 2024-04-21T19:13:02.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:02 smithi191 ceph-mon[31636]: pgmap v16992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:02.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31693.956803 secs 2024-04-21T19:13:04.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:04 smithi170 ceph-mon[31212]: pgmap v16993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:04.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31695.715302 secs 2024-04-21T19:13:04.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:04 smithi077 ceph-mon[27902]: pgmap v16993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:04.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31695.715302 secs 2024-04-21T19:13:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:04 smithi191 ceph-mon[31636]: pgmap v16993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31695.715302 secs 2024-04-21T19:13:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:05.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:05 smithi170 ceph-mon[31212]: osdmap e1134: 12 total, 12 up, 12 in 2024-04-21T19:13:05.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:05 smithi077 ceph-mon[27902]: osdmap e1134: 12 total, 12 up, 12 in 2024-04-21T19:13:05.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:05 smithi191 ceph-mon[31636]: osdmap e1134: 12 total, 12 up, 12 in 2024-04-21T19:13:06.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:06 smithi170 ceph-mon[31212]: pgmap v16995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:13:06.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:06 smithi077 ceph-mon[27902]: pgmap v16995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:13:06.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:06 smithi191 ceph-mon[31636]: pgmap v16995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:13:07.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31698.956920 secs 2024-04-21T19:13:07.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31698.956920 secs 2024-04-21T19:13:07.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31698.956920 secs 2024-04-21T19:13:08.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:08 smithi170 ceph-mon[31212]: pgmap v16996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:13:08.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:08 smithi170 ceph-mon[31212]: osdmap e1135: 12 total, 12 up, 12 in 2024-04-21T19:13:08.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:08 smithi077 ceph-mon[27902]: pgmap v16996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:13:08.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:08 smithi077 ceph-mon[27902]: osdmap e1135: 12 total, 12 up, 12 in 2024-04-21T19:13:08.861 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:08 smithi191 ceph-mon[31636]: pgmap v16996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:13:08.861 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:08 smithi191 ceph-mon[31636]: osdmap e1135: 12 total, 12 up, 12 in 2024-04-21T19:13:09.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31700.715420 secs 2024-04-21T19:13:09.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31700.715420 secs 2024-04-21T19:13:09.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31700.715420 secs 2024-04-21T19:13:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:10.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:10 smithi170 ceph-mon[31212]: pgmap v16998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:13:10.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:10 smithi077 ceph-mon[27902]: pgmap v16998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:13:10.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:10 smithi191 ceph-mon[31636]: pgmap v16998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:13:12.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:12 smithi170 ceph-mon[31212]: pgmap v16999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:13:12.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31703.957040 secs 2024-04-21T19:13:12.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:12 smithi077 ceph-mon[27902]: pgmap v16999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:13:12.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31703.957040 secs 2024-04-21T19:13:12.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:12 smithi191 ceph-mon[31636]: pgmap v16999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:13:12.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31703.957040 secs 2024-04-21T19:13:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:14 smithi170 ceph-mon[31212]: pgmap v17000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:13:14.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31705.715531 secs 2024-04-21T19:13:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:14 smithi077 ceph-mon[27902]: pgmap v17000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:13:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31705.715531 secs 2024-04-21T19:13:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:14 smithi191 ceph-mon[31636]: pgmap v17000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:13:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31705.715531 secs 2024-04-21T19:13:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:16.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:16 smithi170 ceph-mon[31212]: pgmap v17001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:13:16.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:16 smithi077 ceph-mon[27902]: pgmap v17001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:13:16.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:16 smithi191 ceph-mon[31636]: pgmap v17001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:13:17.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31708.957190 secs 2024-04-21T19:13:17.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31708.957190 secs 2024-04-21T19:13:17.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31708.957190 secs 2024-04-21T19:13:18.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:18 smithi170 ceph-mon[31212]: pgmap v17002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:13:18.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:18 smithi077 ceph-mon[27902]: pgmap v17002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:13:18.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:18 smithi191 ceph-mon[31636]: pgmap v17002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:13:19.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31710.715653 secs 2024-04-21T19:13:19.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31710.715653 secs 2024-04-21T19:13:19.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31710.715653 secs 2024-04-21T19:13:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:20.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:20 smithi170 ceph-mon[31212]: pgmap v17003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:13:20.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:20 smithi077 ceph-mon[27902]: pgmap v17003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:13:20.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:20 smithi191 ceph-mon[31636]: pgmap v17003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:13:22.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:22 smithi170 ceph-mon[31212]: pgmap v17004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:13:22.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31713.957308 secs 2024-04-21T19:13:22.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:22 smithi077 ceph-mon[27902]: pgmap v17004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:13:22.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31713.957308 secs 2024-04-21T19:13:22.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:22 smithi191 ceph-mon[31636]: pgmap v17004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:13:22.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31713.957308 secs 2024-04-21T19:13:24.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:24 smithi170 ceph-mon[31212]: pgmap v17005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:24.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31715.715769 secs 2024-04-21T19:13:24.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:24 smithi077 ceph-mon[27902]: pgmap v17005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:24.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31715.715769 secs 2024-04-21T19:13:24.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:24 smithi191 ceph-mon[31636]: pgmap v17005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:24.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31715.715769 secs 2024-04-21T19:13:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:26.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:26 smithi170 ceph-mon[31212]: pgmap v17006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:26.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:26 smithi077 ceph-mon[27902]: pgmap v17006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:26.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:26 smithi191 ceph-mon[31636]: pgmap v17006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:27.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31718.957461 secs 2024-04-21T19:13:27.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31718.957461 secs 2024-04-21T19:13:27.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31718.957461 secs 2024-04-21T19:13:28.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:28 smithi170 ceph-mon[31212]: pgmap v17007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:28.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:28 smithi077 ceph-mon[27902]: pgmap v17007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:28.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:28 smithi191 ceph-mon[31636]: pgmap v17007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31720.715868 secs 2024-04-21T19:13:29.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31720.715868 secs 2024-04-21T19:13:30.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31720.715868 secs 2024-04-21T19:13:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:30.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:30 smithi077 ceph-mon[27902]: pgmap v17008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:30.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:30 smithi191 ceph-mon[31636]: pgmap v17008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:31.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:30 smithi170 ceph-mon[31212]: pgmap v17008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:32 smithi077 ceph-mon[27902]: pgmap v17009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31723.957605 secs 2024-04-21T19:13:32.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:32 smithi191 ceph-mon[31636]: pgmap v17009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:32.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31723.957605 secs 2024-04-21T19:13:33.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:32 smithi170 ceph-mon[31212]: pgmap v17009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:33.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31723.957605 secs 2024-04-21T19:13:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:34 smithi077 ceph-mon[27902]: pgmap v17010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31725.715945 secs 2024-04-21T19:13:34.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:34 smithi191 ceph-mon[31636]: pgmap v17010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:34.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31725.715945 secs 2024-04-21T19:13:35.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:34 smithi170 ceph-mon[31212]: pgmap v17010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:35.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31725.715945 secs 2024-04-21T19:13:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:36.834 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:36 smithi170 ceph-mon[31212]: pgmap v17011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:36.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:36 smithi077 ceph-mon[27902]: pgmap v17011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:36.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:36 smithi191 ceph-mon[31636]: pgmap v17011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:37.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31728.957748 secs 2024-04-21T19:13:37.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31728.957748 secs 2024-04-21T19:13:38.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31728.957748 secs 2024-04-21T19:13:38.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:38 smithi077 ceph-mon[27902]: pgmap v17012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:38.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:38 smithi191 ceph-mon[31636]: pgmap v17012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:39.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:38 smithi170 ceph-mon[31212]: pgmap v17012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:39.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31730.716040 secs 2024-04-21T19:13:39.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31730.716040 secs 2024-04-21T19:13:40.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31730.716040 secs 2024-04-21T19:13:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:40.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:40 smithi077 ceph-mon[27902]: pgmap v17013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:40.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:40 smithi191 ceph-mon[31636]: pgmap v17013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:41.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:40 smithi170 ceph-mon[31212]: pgmap v17013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:42 smithi077 ceph-mon[27902]: pgmap v17014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31733.957782 secs 2024-04-21T19:13:42.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:42 smithi191 ceph-mon[31636]: pgmap v17014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:42.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31733.957782 secs 2024-04-21T19:13:43.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:42 smithi170 ceph-mon[31212]: pgmap v17014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:43.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31733.957782 secs 2024-04-21T19:13:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:44 smithi077 ceph-mon[27902]: pgmap v17015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31735.716164 secs 2024-04-21T19:13:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:44 smithi191 ceph-mon[31636]: pgmap v17015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:44.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31735.716164 secs 2024-04-21T19:13:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:44 smithi170 ceph-mon[31212]: pgmap v17015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:45.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31735.716164 secs 2024-04-21T19:13:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:46.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:46 smithi077 ceph-mon[27902]: pgmap v17016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:46.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:46 smithi191 ceph-mon[31636]: pgmap v17016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:47.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:46 smithi170 ceph-mon[31212]: pgmap v17016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:47.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31738.957902 secs 2024-04-21T19:13:47.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31738.957902 secs 2024-04-21T19:13:48.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31738.957902 secs 2024-04-21T19:13:48.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:48 smithi077 ceph-mon[27902]: pgmap v17017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:48.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:48 smithi191 ceph-mon[31636]: pgmap v17017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:49.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:48 smithi170 ceph-mon[31212]: pgmap v17017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:49.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31740.716288 secs 2024-04-21T19:13:49.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31740.716288 secs 2024-04-21T19:13:50.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31740.716288 secs 2024-04-21T19:13:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:50.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:50 smithi077 ceph-mon[27902]: pgmap v17018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:50.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:50 smithi191 ceph-mon[31636]: pgmap v17018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:51.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:50 smithi170 ceph-mon[31212]: pgmap v17018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:52.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:52 smithi077 ceph-mon[27902]: pgmap v17019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:52.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31743.958012 secs 2024-04-21T19:13:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:52 smithi191 ceph-mon[31636]: pgmap v17019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31743.958012 secs 2024-04-21T19:13:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:52 smithi170 ceph-mon[31212]: pgmap v17019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:53.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31743.958012 secs 2024-04-21T19:13:54.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.455+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T19:13:54.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.455+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T19:13:54.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.455+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:13:54.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.455+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T19:13:54.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.455+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:13:54.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.456+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T19:13:54.431 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.456+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd70034040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd70034040 comp rx=0 tx=0).stop 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 msgr2=0x7efd640a60b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T19:13:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a5cd0 0x7efd640a60b0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T19:13:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T19:13:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:13:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:54.517+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efd70034010 tx=0x7efd7003e070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T19:13:54.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:54 smithi077 ceph-mon[27902]: pgmap v17020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:54.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31745.716406 secs 2024-04-21T19:13:54.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:54 smithi191 ceph-mon[31636]: pgmap v17020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:54.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31745.716406 secs 2024-04-21T19:13:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:54 smithi170 ceph-mon[31212]: pgmap v17020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31745.716406 secs 2024-04-21T19:13:55.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:13:56.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:56 smithi077 ceph-mon[27902]: pgmap v17021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:56.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:56 smithi191 ceph-mon[31636]: pgmap v17021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:57.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:56 smithi170 ceph-mon[31212]: pgmap v17021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:13:57.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31748.958129 secs 2024-04-21T19:13:57.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31748.958129 secs 2024-04-21T19:13:58.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31748.958129 secs 2024-04-21T19:13:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:58.745+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:13:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:58.745+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:13:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:58.746+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:13:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:13:58.746+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:13:58.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:58 smithi077 ceph-mon[27902]: pgmap v17022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:58.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:58 smithi191 ceph-mon[31636]: pgmap v17022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:59.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:58 smithi170 ceph-mon[31212]: pgmap v17022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:13:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31750.716503 secs 2024-04-21T19:13:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31750.716503 secs 2024-04-21T19:14:00.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31750.716503 secs 2024-04-21T19:14:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:00 smithi191 ceph-mon[31636]: pgmap v17023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:14:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:00.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:01.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:00 smithi170 ceph-mon[31212]: pgmap v17023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:01.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:14:01.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:01.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:00 smithi077 ceph-mon[27902]: pgmap v17023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:14:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:01.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:14:01.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:14:01.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:02.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:14:02.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:14:02.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:02.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:14:02.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:14:02.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:14:02.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:02 smithi191 ceph-mon[31636]: pgmap v17024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:02.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31753.958196 secs 2024-04-21T19:14:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:02 smithi170 ceph-mon[31212]: pgmap v17024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31753.958196 secs 2024-04-21T19:14:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:02 smithi077 ceph-mon[27902]: pgmap v17024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31753.958196 secs 2024-04-21T19:14:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:04 smithi191 ceph-mon[31636]: pgmap v17025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31755.716602 secs 2024-04-21T19:14:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:04 smithi170 ceph-mon[31212]: pgmap v17025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31755.716602 secs 2024-04-21T19:14:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:04 smithi077 ceph-mon[27902]: pgmap v17025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31755.716602 secs 2024-04-21T19:14:05.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:05 smithi191 ceph-mon[31636]: osdmap e1136: 12 total, 12 up, 12 in 2024-04-21T19:14:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:05 smithi170 ceph-mon[31212]: osdmap e1136: 12 total, 12 up, 12 in 2024-04-21T19:14:06.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:05 smithi077 ceph-mon[27902]: osdmap e1136: 12 total, 12 up, 12 in 2024-04-21T19:14:06.933 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:06 smithi170 ceph-mon[31212]: pgmap v17027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:14:06.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:06 smithi191 ceph-mon[31636]: pgmap v17027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:14:07.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:06 smithi077 ceph-mon[27902]: pgmap v17027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:14:07.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31758.958342 secs 2024-04-21T19:14:08.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31758.958342 secs 2024-04-21T19:14:08.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31758.958342 secs 2024-04-21T19:14:08.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:08 smithi191 ceph-mon[31636]: pgmap v17028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:14:08.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:08 smithi191 ceph-mon[31636]: osdmap e1137: 12 total, 12 up, 12 in 2024-04-21T19:14:09.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:08 smithi170 ceph-mon[31212]: pgmap v17028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:14:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:08 smithi170 ceph-mon[31212]: osdmap e1137: 12 total, 12 up, 12 in 2024-04-21T19:14:09.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:08 smithi077 ceph-mon[27902]: pgmap v17028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:14:09.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:08 smithi077 ceph-mon[27902]: osdmap e1137: 12 total, 12 up, 12 in 2024-04-21T19:14:09.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31760.716724 secs 2024-04-21T19:14:10.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31760.716724 secs 2024-04-21T19:14:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31760.716724 secs 2024-04-21T19:14:10.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:10 smithi191 ceph-mon[31636]: pgmap v17030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:14:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:10 smithi170 ceph-mon[31212]: pgmap v17030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:14:11.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:10 smithi077 ceph-mon[27902]: pgmap v17030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:14:12.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:12 smithi191 ceph-mon[31636]: pgmap v17031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:14:12.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31763.958453 secs 2024-04-21T19:14:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:12 smithi170 ceph-mon[31212]: pgmap v17031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:14:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31763.958453 secs 2024-04-21T19:14:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:12 smithi077 ceph-mon[27902]: pgmap v17031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:14:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31763.958453 secs 2024-04-21T19:14:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:14 smithi191 ceph-mon[31636]: pgmap v17032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T19:14:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31765.716820 secs 2024-04-21T19:14:15.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:14 smithi170 ceph-mon[31212]: pgmap v17032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T19:14:15.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31765.716820 secs 2024-04-21T19:14:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:15.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:14 smithi077 ceph-mon[27902]: pgmap v17032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T19:14:15.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31765.716820 secs 2024-04-21T19:14:16.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:16 smithi191 ceph-mon[31636]: pgmap v17033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:14:17.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:16 smithi170 ceph-mon[31212]: pgmap v17033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:14:17.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:16 smithi077 ceph-mon[27902]: pgmap v17033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:14:17.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31768.958571 secs 2024-04-21T19:14:18.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31768.958571 secs 2024-04-21T19:14:18.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31768.958571 secs 2024-04-21T19:14:18.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:18 smithi191 ceph-mon[31636]: pgmap v17034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:14:19.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:18 smithi170 ceph-mon[31212]: pgmap v17034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:14:19.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:18 smithi077 ceph-mon[27902]: pgmap v17034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:14:19.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31770.716945 secs 2024-04-21T19:14:20.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31770.716945 secs 2024-04-21T19:14:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:20.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31770.716945 secs 2024-04-21T19:14:20.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:20 smithi191 ceph-mon[31636]: pgmap v17035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:14:21.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:20 smithi170 ceph-mon[31212]: pgmap v17035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:14:21.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:20 smithi077 ceph-mon[27902]: pgmap v17035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:14:22.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:22 smithi191 ceph-mon[31636]: pgmap v17036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:14:22.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31773.958677 secs 2024-04-21T19:14:23.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:22 smithi170 ceph-mon[31212]: pgmap v17036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:14:23.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31773.958677 secs 2024-04-21T19:14:23.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:22 smithi077 ceph-mon[27902]: pgmap v17036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:14:23.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31773.958677 secs 2024-04-21T19:14:24.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:24 smithi191 ceph-mon[31636]: pgmap v17037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:24.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31775.717082 secs 2024-04-21T19:14:25.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:24 smithi170 ceph-mon[31212]: pgmap v17037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:25.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31775.717082 secs 2024-04-21T19:14:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:25.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:24 smithi077 ceph-mon[27902]: pgmap v17037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:25.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31775.717082 secs 2024-04-21T19:14:26.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:26 smithi191 ceph-mon[31636]: pgmap v17038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:27.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:26 smithi170 ceph-mon[31212]: pgmap v17038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:27.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:26 smithi077 ceph-mon[27902]: pgmap v17038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:27.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31778.958796 secs 2024-04-21T19:14:28.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31778.958796 secs 2024-04-21T19:14:28.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31778.958796 secs 2024-04-21T19:14:28.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:28 smithi191 ceph-mon[31636]: pgmap v17039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:29.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:28 smithi170 ceph-mon[31212]: pgmap v17039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:29.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:28 smithi077 ceph-mon[27902]: pgmap v17039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:29.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31780.717167 secs 2024-04-21T19:14:30.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31780.717167 secs 2024-04-21T19:14:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:30.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31780.717167 secs 2024-04-21T19:14:31.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:30 smithi170 ceph-mon[31212]: pgmap v17040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:31.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:30 smithi077 ceph-mon[27902]: pgmap v17040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:31.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:30 smithi191 ceph-mon[31636]: pgmap v17040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:33.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:32 smithi170 ceph-mon[31212]: pgmap v17041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:33.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31783.958918 secs 2024-04-21T19:14:33.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:32 smithi077 ceph-mon[27902]: pgmap v17041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:33.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31783.958918 secs 2024-04-21T19:14:33.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:32 smithi191 ceph-mon[31636]: pgmap v17041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:33.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31783.958918 secs 2024-04-21T19:14:35.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:34 smithi170 ceph-mon[31212]: pgmap v17042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:35.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31785.717288 secs 2024-04-21T19:14:35.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:35.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:34 smithi077 ceph-mon[27902]: pgmap v17042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:35.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31785.717288 secs 2024-04-21T19:14:35.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:34 smithi191 ceph-mon[31636]: pgmap v17042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:35.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31785.717288 secs 2024-04-21T19:14:36.995 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:36 smithi191 ceph-mon[31636]: pgmap v17043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:37.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:36 smithi170 ceph-mon[31212]: pgmap v17043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:37.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:36 smithi077 ceph-mon[27902]: pgmap v17043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:38.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31788.959035 secs 2024-04-21T19:14:38.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31788.959035 secs 2024-04-21T19:14:38.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31788.959035 secs 2024-04-21T19:14:39.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:38 smithi170 ceph-mon[31212]: pgmap v17044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:39.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:38 smithi077 ceph-mon[27902]: pgmap v17044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:39.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:38 smithi191 ceph-mon[31636]: pgmap v17044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:40.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31790.717389 secs 2024-04-21T19:14:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:40.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31790.717389 secs 2024-04-21T19:14:40.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31790.717389 secs 2024-04-21T19:14:41.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:40 smithi170 ceph-mon[31212]: pgmap v17045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:41.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:40 smithi077 ceph-mon[27902]: pgmap v17045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:41.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:40 smithi191 ceph-mon[31636]: pgmap v17045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:43.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:42 smithi170 ceph-mon[31212]: pgmap v17046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:43.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31793.959099 secs 2024-04-21T19:14:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:42 smithi077 ceph-mon[27902]: pgmap v17046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31793.959099 secs 2024-04-21T19:14:43.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:42 smithi191 ceph-mon[31636]: pgmap v17046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:43.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31793.959099 secs 2024-04-21T19:14:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:44 smithi170 ceph-mon[31212]: pgmap v17047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31795.717516 secs 2024-04-21T19:14:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:45.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:44 smithi077 ceph-mon[27902]: pgmap v17047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:45.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31795.717516 secs 2024-04-21T19:14:45.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:44 smithi191 ceph-mon[31636]: pgmap v17047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:45.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31795.717516 secs 2024-04-21T19:14:47.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:46 smithi170 ceph-mon[31212]: pgmap v17048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:47.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:46 smithi077 ceph-mon[27902]: pgmap v17048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:47.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:46 smithi191 ceph-mon[31636]: pgmap v17048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:48.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31798.959216 secs 2024-04-21T19:14:48.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31798.959216 secs 2024-04-21T19:14:48.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31798.959216 secs 2024-04-21T19:14:49.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:48 smithi170 ceph-mon[31212]: pgmap v17049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:49.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:48 smithi077 ceph-mon[27902]: pgmap v17049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:49.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:48 smithi191 ceph-mon[31636]: pgmap v17049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:50.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31800.717637 secs 2024-04-21T19:14:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:50.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31800.717637 secs 2024-04-21T19:14:50.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31800.717637 secs 2024-04-21T19:14:51.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:50 smithi170 ceph-mon[31212]: pgmap v17050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:51.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:50 smithi077 ceph-mon[27902]: pgmap v17050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:51.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:50 smithi191 ceph-mon[31636]: pgmap v17050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:52 smithi170 ceph-mon[31212]: pgmap v17051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31803.959359 secs 2024-04-21T19:14:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:52 smithi077 ceph-mon[27902]: pgmap v17051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31803.959359 secs 2024-04-21T19:14:53.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:52 smithi191 ceph-mon[31636]: pgmap v17051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:53.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31803.959359 secs 2024-04-21T19:14:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:54 smithi170 ceph-mon[31212]: pgmap v17052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31805.717758 secs 2024-04-21T19:14:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:14:55.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:54 smithi077 ceph-mon[27902]: pgmap v17052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:55.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31805.717758 secs 2024-04-21T19:14:55.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:54 smithi191 ceph-mon[31636]: pgmap v17052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:55.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31805.717758 secs 2024-04-21T19:14:57.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:56 smithi170 ceph-mon[31212]: pgmap v17053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:57.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:56 smithi077 ceph-mon[27902]: pgmap v17053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:57.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:56 smithi191 ceph-mon[31636]: pgmap v17053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:14:58.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31808.959489 secs 2024-04-21T19:14:58.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31808.959489 secs 2024-04-21T19:14:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31808.959489 secs 2024-04-21T19:14:59.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:58 smithi170 ceph-mon[31212]: pgmap v17054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:59.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:58 smithi077 ceph-mon[27902]: pgmap v17054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:14:59.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:58 smithi191 ceph-mon[31636]: pgmap v17054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:00.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31810.717877 secs 2024-04-21T19:15:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 31995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:00.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31810.717877 secs 2024-04-21T19:15:00.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31810.717877 secs 2024-04-21T19:15:01.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:00 smithi170 ceph-mon[31212]: pgmap v17055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:00 smithi077 ceph-mon[27902]: pgmap v17055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:01.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:00 smithi191 ceph-mon[31636]: pgmap v17055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:02.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:15:02.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:15:02.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:15:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: pgmap v17056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T19:15:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31813.959534 secs 2024-04-21T19:15:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:15:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:15:03.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: pgmap v17056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31813.959534 secs 2024-04-21T19:15:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:15:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:15:03.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: pgmap v17056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T19:15:03.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31813.959534 secs 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:15:03.282 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:15:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:04 smithi077 ceph-mon[27902]: pgmap v17057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T19:15:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31815.718002 secs 2024-04-21T19:15:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:04 smithi191 ceph-mon[31636]: pgmap v17057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T19:15:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31815.718002 secs 2024-04-21T19:15:05.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:04 smithi170 ceph-mon[31212]: pgmap v17057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T19:15:05.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31815.718002 secs 2024-04-21T19:15:06.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:05 smithi077 ceph-mon[27902]: osdmap e1138: 12 total, 12 up, 12 in 2024-04-21T19:15:06.182 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:05 smithi170 ceph-mon[31212]: osdmap e1138: 12 total, 12 up, 12 in 2024-04-21T19:15:06.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:05 smithi191 ceph-mon[31636]: osdmap e1138: 12 total, 12 up, 12 in 2024-04-21T19:15:07.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:06 smithi191 ceph-mon[31636]: pgmap v17059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:07.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:06 smithi077 ceph-mon[27902]: pgmap v17059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:07.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:06 smithi170 ceph-mon[31212]: pgmap v17059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:08.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31818.959660 secs 2024-04-21T19:15:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31818.959660 secs 2024-04-21T19:15:08.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31818.959660 secs 2024-04-21T19:15:09.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:08 smithi077 ceph-mon[27902]: pgmap v17060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:09.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:08 smithi191 ceph-mon[31636]: pgmap v17060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:09.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:08 smithi170 ceph-mon[31212]: pgmap v17060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:10.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31820.718081 secs 2024-04-21T19:15:10.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31820.718081 secs 2024-04-21T19:15:10.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31820.718081 secs 2024-04-21T19:15:11.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:10 smithi077 ceph-mon[27902]: pgmap v17061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:10 smithi191 ceph-mon[31636]: pgmap v17061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:11.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:10 smithi170 ceph-mon[31212]: pgmap v17061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:15:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:12 smithi077 ceph-mon[27902]: pgmap v17062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:15:13.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31823.959813 secs 2024-04-21T19:15:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:12 smithi191 ceph-mon[31636]: pgmap v17062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:15:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31823.959813 secs 2024-04-21T19:15:13.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:12 smithi170 ceph-mon[31212]: pgmap v17062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:15:13.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31823.959813 secs 2024-04-21T19:15:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:14 smithi191 ceph-mon[31636]: pgmap v17063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:15:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:14 smithi191 ceph-mon[31636]: osdmap e1139: 12 total, 12 up, 12 in 2024-04-21T19:15:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31825.718205 secs 2024-04-21T19:15:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:14 smithi170 ceph-mon[31212]: pgmap v17063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:15:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:14 smithi170 ceph-mon[31212]: osdmap e1139: 12 total, 12 up, 12 in 2024-04-21T19:15:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31825.718205 secs 2024-04-21T19:15:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:14 smithi077 ceph-mon[27902]: pgmap v17063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:15:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:14 smithi077 ceph-mon[27902]: osdmap e1139: 12 total, 12 up, 12 in 2024-04-21T19:15:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31825.718205 secs 2024-04-21T19:15:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:16.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:16 smithi191 ceph-mon[31636]: pgmap v17065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:16.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:16 smithi170 ceph-mon[31212]: pgmap v17065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:16.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:16 smithi077 ceph-mon[27902]: pgmap v17065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:17.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31828.959908 secs 2024-04-21T19:15:17.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31828.959908 secs 2024-04-21T19:15:17.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31828.959908 secs 2024-04-21T19:15:18.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:18 smithi191 ceph-mon[31636]: pgmap v17066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:18.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:18 smithi170 ceph-mon[31212]: pgmap v17066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:18.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:18 smithi077 ceph-mon[27902]: pgmap v17066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:19.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31830.718321 secs 2024-04-21T19:15:19.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31830.718321 secs 2024-04-21T19:15:19.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31830.718321 secs 2024-04-21T19:15:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:20.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:20 smithi191 ceph-mon[31636]: pgmap v17067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:20.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:20 smithi170 ceph-mon[31212]: pgmap v17067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:20.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:20 smithi077 ceph-mon[27902]: pgmap v17067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:15:22.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:22 smithi191 ceph-mon[31636]: pgmap v17068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:15:22.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31833.960025 secs 2024-04-21T19:15:22.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:22 smithi170 ceph-mon[31212]: pgmap v17068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:15:22.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31833.960025 secs 2024-04-21T19:15:22.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:22 smithi077 ceph-mon[27902]: pgmap v17068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:15:22.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31833.960025 secs 2024-04-21T19:15:24.662 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:24 smithi077 ceph-mon[27902]: pgmap v17069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:15:24.662 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31835.718443 secs 2024-04-21T19:15:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:24 smithi191 ceph-mon[31636]: pgmap v17069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:15:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31835.718443 secs 2024-04-21T19:15:24.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:24 smithi170 ceph-mon[31212]: pgmap v17069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:15:24.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31835.718443 secs 2024-04-21T19:15:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:26.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:26 smithi191 ceph-mon[31636]: pgmap v17070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:15:26.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:26 smithi170 ceph-mon[31212]: pgmap v17070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:15:26.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:26 smithi077 ceph-mon[27902]: pgmap v17070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:15:27.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31838.960134 secs 2024-04-21T19:15:27.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31838.960134 secs 2024-04-21T19:15:27.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31838.960134 secs 2024-04-21T19:15:28.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:28 smithi191 ceph-mon[31636]: pgmap v17071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:28.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:28 smithi170 ceph-mon[31212]: pgmap v17071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:28.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:28 smithi077 ceph-mon[27902]: pgmap v17071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:29.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31840.718560 secs 2024-04-21T19:15:29.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31840.718560 secs 2024-04-21T19:15:29.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31840.718560 secs 2024-04-21T19:15:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:30.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:30 smithi191 ceph-mon[31636]: pgmap v17072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:30.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:30 smithi170 ceph-mon[31212]: pgmap v17072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:30.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:30 smithi077 ceph-mon[27902]: pgmap v17072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:32 smithi191 ceph-mon[31636]: pgmap v17073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:32.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31843.960251 secs 2024-04-21T19:15:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:32 smithi170 ceph-mon[31212]: pgmap v17073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31843.960251 secs 2024-04-21T19:15:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:32 smithi077 ceph-mon[27902]: pgmap v17073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31843.960251 secs 2024-04-21T19:15:34.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:34 smithi191 ceph-mon[31636]: pgmap v17074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:34.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31845.718694 secs 2024-04-21T19:15:34.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:34 smithi170 ceph-mon[31212]: pgmap v17074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:34.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31845.718694 secs 2024-04-21T19:15:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:34 smithi077 ceph-mon[27902]: pgmap v17074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31845.718694 secs 2024-04-21T19:15:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:36.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:36 smithi191 ceph-mon[31636]: pgmap v17075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:36.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:36 smithi170 ceph-mon[31212]: pgmap v17075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:36.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:36 smithi077 ceph-mon[27902]: pgmap v17075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:37.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31848.960344 secs 2024-04-21T19:15:37.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31848.960344 secs 2024-04-21T19:15:37.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31848.960344 secs 2024-04-21T19:15:38.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:38 smithi170 ceph-mon[31212]: pgmap v17076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:38.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:38 smithi077 ceph-mon[27902]: pgmap v17076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:38.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:38 smithi191 ceph-mon[31636]: pgmap v17076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:39.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31850.718792 secs 2024-04-21T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31850.718792 secs 2024-04-21T19:15:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31850.718792 secs 2024-04-21T19:15:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:40.782 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:40 smithi170 ceph-mon[31212]: pgmap v17077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:40.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:40 smithi077 ceph-mon[27902]: pgmap v17077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:40.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:40 smithi191 ceph-mon[31636]: pgmap v17077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:42.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:42 smithi170 ceph-mon[31212]: pgmap v17078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:42.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31853.960461 secs 2024-04-21T19:15:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:42 smithi077 ceph-mon[27902]: pgmap v17078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:42.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31853.960461 secs 2024-04-21T19:15:42.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:42 smithi191 ceph-mon[31636]: pgmap v17078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:42.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31853.960461 secs 2024-04-21T19:15:44.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:44 smithi170 ceph-mon[31212]: pgmap v17079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:44.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31855.718911 secs 2024-04-21T19:15:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:44 smithi077 ceph-mon[27902]: pgmap v17079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:44.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31855.718911 secs 2024-04-21T19:15:44.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:44 smithi191 ceph-mon[31636]: pgmap v17079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31855.718911 secs 2024-04-21T19:15:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:46.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:46 smithi170 ceph-mon[31212]: pgmap v17080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:46.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:46 smithi077 ceph-mon[27902]: pgmap v17080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:46.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:46 smithi191 ceph-mon[31636]: pgmap v17080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:47.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31858.960581 secs 2024-04-21T19:15:47.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31858.960581 secs 2024-04-21T19:15:47.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31858.960581 secs 2024-04-21T19:15:48.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:48 smithi170 ceph-mon[31212]: pgmap v17081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:48.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:48 smithi077 ceph-mon[27902]: pgmap v17081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:48.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:48 smithi191 ceph-mon[31636]: pgmap v17081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:49.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31860.719028 secs 2024-04-21T19:15:49.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31860.719028 secs 2024-04-21T19:15:49.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31860.719028 secs 2024-04-21T19:15:50.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:50.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:50 smithi170 ceph-mon[31212]: pgmap v17082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:50.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:50 smithi077 ceph-mon[27902]: pgmap v17082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:50.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:50 smithi191 ceph-mon[31636]: pgmap v17082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:52.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:52 smithi170 ceph-mon[31212]: pgmap v17083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:52.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31863.960697 secs 2024-04-21T19:15:52.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:52 smithi077 ceph-mon[27902]: pgmap v17083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:52.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31863.960697 secs 2024-04-21T19:15:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:52 smithi191 ceph-mon[31636]: pgmap v17083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31863.960697 secs 2024-04-21T19:15:54.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:54 smithi170 ceph-mon[31212]: pgmap v17084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:54.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31865.719141 secs 2024-04-21T19:15:54.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:54 smithi077 ceph-mon[27902]: pgmap v17084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:54.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31865.719141 secs 2024-04-21T19:15:54.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:54 smithi191 ceph-mon[31636]: pgmap v17084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:54.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31865.719141 secs 2024-04-21T19:15:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:15:56.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:56 smithi170 ceph-mon[31212]: pgmap v17085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:56.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:56 smithi077 ceph-mon[27902]: pgmap v17085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:56.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:56 smithi191 ceph-mon[31636]: pgmap v17085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:15:57.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31868.960828 secs 2024-04-21T19:15:57.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31868.960828 secs 2024-04-21T19:15:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31868.960828 secs 2024-04-21T19:15:58.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:58 smithi170 ceph-mon[31212]: pgmap v17086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:58.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:58 smithi077 ceph-mon[27902]: pgmap v17086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:58 smithi191 ceph-mon[31636]: pgmap v17086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:15:59.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31870.719258 secs 2024-04-21T19:15:59.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31870.719258 secs 2024-04-21T19:15:59.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31870.719258 secs 2024-04-21T19:16:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:00.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:00 smithi170 ceph-mon[31212]: pgmap v17087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:00.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:00 smithi077 ceph-mon[27902]: pgmap v17087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:00.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:00 smithi191 ceph-mon[31636]: pgmap v17087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:02.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:02 smithi170 ceph-mon[31212]: pgmap v17088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:02.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31873.960945 secs 2024-04-21T19:16:02.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:02 smithi077 ceph-mon[27902]: pgmap v17088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:02.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31873.960945 secs 2024-04-21T19:16:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:02 smithi191 ceph-mon[31636]: pgmap v17088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:02.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31873.960945 secs 2024-04-21T19:16:03.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:16:03.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:16:03.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:16:03.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:16:03.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:16:03.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:16:03.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:16:03.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:16:03.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:16:03.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:16:03.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:16:03.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:16:04.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:04 smithi170 ceph-mon[31212]: pgmap v17089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:04.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31875.719336 secs 2024-04-21T19:16:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:04 smithi077 ceph-mon[27902]: pgmap v17089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31875.719336 secs 2024-04-21T19:16:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:04 smithi191 ceph-mon[31636]: pgmap v17089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31875.719336 secs 2024-04-21T19:16:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:05.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:05 smithi170 ceph-mon[31212]: osdmap e1140: 12 total, 12 up, 12 in 2024-04-21T19:16:05.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:05 smithi077 ceph-mon[27902]: osdmap e1140: 12 total, 12 up, 12 in 2024-04-21T19:16:05.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:05 smithi191 ceph-mon[31636]: osdmap e1140: 12 total, 12 up, 12 in 2024-04-21T19:16:06.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:06 smithi170 ceph-mon[31212]: pgmap v17091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:16:06.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:06 smithi077 ceph-mon[27902]: pgmap v17091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:16:06.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:06 smithi191 ceph-mon[31636]: pgmap v17091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:16:07.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31878.961066 secs 2024-04-21T19:16:07.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31878.961066 secs 2024-04-21T19:16:08.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31878.961066 secs 2024-04-21T19:16:08.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:08 smithi077 ceph-mon[27902]: pgmap v17092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:16:08.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:08 smithi077 ceph-mon[27902]: osdmap e1141: 12 total, 12 up, 12 in 2024-04-21T19:16:08.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:08 smithi191 ceph-mon[31636]: pgmap v17092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:16:08.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:08 smithi191 ceph-mon[31636]: osdmap e1141: 12 total, 12 up, 12 in 2024-04-21T19:16:09.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:08 smithi170 ceph-mon[31212]: pgmap v17092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:16:09.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:08 smithi170 ceph-mon[31212]: osdmap e1141: 12 total, 12 up, 12 in 2024-04-21T19:16:09.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31880.719490 secs 2024-04-21T19:16:09.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31880.719490 secs 2024-04-21T19:16:10.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31880.719490 secs 2024-04-21T19:16:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:10.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:10 smithi077 ceph-mon[27902]: pgmap v17094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:16:10.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:10 smithi191 ceph-mon[31636]: pgmap v17094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:16:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:10 smithi170 ceph-mon[31212]: pgmap v17094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:16:12.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:12 smithi077 ceph-mon[27902]: pgmap v17095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:16:12.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31883.961184 secs 2024-04-21T19:16:12.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:12 smithi191 ceph-mon[31636]: pgmap v17095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:16:12.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31883.961184 secs 2024-04-21T19:16:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:12 smithi170 ceph-mon[31212]: pgmap v17095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:16:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31883.961184 secs 2024-04-21T19:16:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:14 smithi077 ceph-mon[27902]: pgmap v17096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:16:14.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31885.719612 secs 2024-04-21T19:16:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:14 smithi191 ceph-mon[31636]: pgmap v17096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:16:14.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31885.719612 secs 2024-04-21T19:16:15.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:14 smithi170 ceph-mon[31212]: pgmap v17096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:16:15.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31885.719612 secs 2024-04-21T19:16:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:16.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:16 smithi077 ceph-mon[27902]: pgmap v17097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:16:16.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:16 smithi191 ceph-mon[31636]: pgmap v17097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:16:17.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:16 smithi170 ceph-mon[31212]: pgmap v17097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:16:17.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31888.961284 secs 2024-04-21T19:16:17.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31888.961284 secs 2024-04-21T19:16:18.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31888.961284 secs 2024-04-21T19:16:18.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:18 smithi077 ceph-mon[27902]: pgmap v17098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:16:18.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:18 smithi191 ceph-mon[31636]: pgmap v17098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:16:19.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:18 smithi170 ceph-mon[31212]: pgmap v17098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:16:19.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31890.719713 secs 2024-04-21T19:16:19.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31890.719713 secs 2024-04-21T19:16:20.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31890.719713 secs 2024-04-21T19:16:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:20.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:20 smithi077 ceph-mon[27902]: pgmap v17099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:16:20.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:20 smithi191 ceph-mon[31636]: pgmap v17099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:16:21.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:20 smithi170 ceph-mon[31212]: pgmap v17099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:16:22.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:22 smithi077 ceph-mon[27902]: pgmap v17100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:16:22.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31893.961396 secs 2024-04-21T19:16:22.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:22 smithi191 ceph-mon[31636]: pgmap v17100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:16:22.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31893.961396 secs 2024-04-21T19:16:23.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:22 smithi170 ceph-mon[31212]: pgmap v17100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:16:23.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31893.961396 secs 2024-04-21T19:16:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:24 smithi077 ceph-mon[27902]: pgmap v17101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31895.719848 secs 2024-04-21T19:16:24.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:24 smithi191 ceph-mon[31636]: pgmap v17101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:24.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31895.719848 secs 2024-04-21T19:16:25.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:24 smithi170 ceph-mon[31212]: pgmap v17101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:25.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31895.719848 secs 2024-04-21T19:16:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:26.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:26 smithi077 ceph-mon[27902]: pgmap v17102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:26.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:26 smithi191 ceph-mon[31636]: pgmap v17102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:27.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:26 smithi170 ceph-mon[31212]: pgmap v17102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:27.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31898.961508 secs 2024-04-21T19:16:27.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31898.961508 secs 2024-04-21T19:16:28.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31898.961508 secs 2024-04-21T19:16:28.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:28 smithi077 ceph-mon[27902]: pgmap v17103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:28.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:28 smithi191 ceph-mon[31636]: pgmap v17103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:29.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:28 smithi170 ceph-mon[31212]: pgmap v17103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:29.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31900.719961 secs 2024-04-21T19:16:29.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31900.719961 secs 2024-04-21T19:16:30.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31900.719961 secs 2024-04-21T19:16:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:30.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:30 smithi077 ceph-mon[27902]: pgmap v17104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:30.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:30 smithi191 ceph-mon[31636]: pgmap v17104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:31.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:30 smithi170 ceph-mon[31212]: pgmap v17104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:32 smithi077 ceph-mon[27902]: pgmap v17105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:32.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31903.961647 secs 2024-04-21T19:16:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:32 smithi191 ceph-mon[31636]: pgmap v17105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:32.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31903.961647 secs 2024-04-21T19:16:33.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:32 smithi170 ceph-mon[31212]: pgmap v17105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:33.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31903.961647 secs 2024-04-21T19:16:34.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:34 smithi077 ceph-mon[27902]: pgmap v17106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:34.860 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31905.720068 secs 2024-04-21T19:16:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:34 smithi191 ceph-mon[31636]: pgmap v17106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:34.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31905.720068 secs 2024-04-21T19:16:35.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:34 smithi170 ceph-mon[31212]: pgmap v17106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:35.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31905.720068 secs 2024-04-21T19:16:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:36.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:36 smithi077 ceph-mon[27902]: pgmap v17107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:36.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:36 smithi191 ceph-mon[31636]: pgmap v17107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:37.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:36 smithi170 ceph-mon[31212]: pgmap v17107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:37.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31908.961791 secs 2024-04-21T19:16:37.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31908.961791 secs 2024-04-21T19:16:38.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31908.961791 secs 2024-04-21T19:16:38.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:38 smithi077 ceph-mon[27902]: pgmap v17108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:38.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:38 smithi191 ceph-mon[31636]: pgmap v17108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:39.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:38 smithi170 ceph-mon[31212]: pgmap v17108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31910.720188 secs 2024-04-21T19:16:40.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31910.720188 secs 2024-04-21T19:16:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:40.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31910.720188 secs 2024-04-21T19:16:40.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:40 smithi191 ceph-mon[31636]: pgmap v17109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:41.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:40 smithi170 ceph-mon[31212]: pgmap v17109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:41.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:40 smithi077 ceph-mon[27902]: pgmap v17109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:42 smithi191 ceph-mon[31636]: pgmap v17110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:42.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31913.961872 secs 2024-04-21T19:16:43.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:42 smithi170 ceph-mon[31212]: pgmap v17110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:43.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31913.961872 secs 2024-04-21T19:16:43.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:42 smithi077 ceph-mon[27902]: pgmap v17110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:43.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31913.961872 secs 2024-04-21T19:16:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:44 smithi191 ceph-mon[31636]: pgmap v17111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31915.720302 secs 2024-04-21T19:16:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:44 smithi170 ceph-mon[31212]: pgmap v17111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31915.720302 secs 2024-04-21T19:16:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:45.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:44 smithi077 ceph-mon[27902]: pgmap v17111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:45.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31915.720302 secs 2024-04-21T19:16:46.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:46 smithi191 ceph-mon[31636]: pgmap v17112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:47.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:46 smithi170 ceph-mon[31212]: pgmap v17112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:47.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:46 smithi077 ceph-mon[27902]: pgmap v17112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:47.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31918.961983 secs 2024-04-21T19:16:48.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31918.961983 secs 2024-04-21T19:16:48.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31918.961983 secs 2024-04-21T19:16:48.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:48 smithi191 ceph-mon[31636]: pgmap v17113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:49.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:48 smithi170 ceph-mon[31212]: pgmap v17113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:49.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:48 smithi077 ceph-mon[27902]: pgmap v17113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:49.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31920.720428 secs 2024-04-21T19:16:50.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31920.720428 secs 2024-04-21T19:16:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:50.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31920.720428 secs 2024-04-21T19:16:50.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:50 smithi191 ceph-mon[31636]: pgmap v17114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:51.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:50 smithi170 ceph-mon[31212]: pgmap v17114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:51.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:50 smithi077 ceph-mon[27902]: pgmap v17114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:52 smithi191 ceph-mon[31636]: pgmap v17115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31923.962064 secs 2024-04-21T19:16:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:52 smithi170 ceph-mon[31212]: pgmap v17115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31923.962064 secs 2024-04-21T19:16:53.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:52 smithi077 ceph-mon[27902]: pgmap v17115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:53.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31923.962064 secs 2024-04-21T19:16:54.912 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:54 smithi077 ceph-mon[27902]: pgmap v17116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:54.913 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31925.720546 secs 2024-04-21T19:16:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:54 smithi191 ceph-mon[31636]: pgmap v17116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31925.720546 secs 2024-04-21T19:16:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:54 smithi170 ceph-mon[31212]: pgmap v17116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31925.720546 secs 2024-04-21T19:16:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:16:56.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:56 smithi191 ceph-mon[31636]: pgmap v17117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:57.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:56 smithi170 ceph-mon[31212]: pgmap v17117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:57.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:56 smithi077 ceph-mon[27902]: pgmap v17117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:16:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31928.962185 secs 2024-04-21T19:16:58.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31928.962185 secs 2024-04-21T19:16:58.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31928.962185 secs 2024-04-21T19:16:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:16:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:16:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:16:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:16:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:16:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:16:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:16:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:16:58.771+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:16:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:58 smithi191 ceph-mon[31636]: pgmap v17118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:59.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:58 smithi170 ceph-mon[31212]: pgmap v17118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:59.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:58 smithi077 ceph-mon[27902]: pgmap v17118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:16:59.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31930.720670 secs 2024-04-21T19:17:00.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31930.720670 secs 2024-04-21T19:17:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:00.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31930.720670 secs 2024-04-21T19:17:00.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:00 smithi191 ceph-mon[31636]: pgmap v17119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:01.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:00 smithi170 ceph-mon[31212]: pgmap v17119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:01.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:00 smithi077 ceph-mon[27902]: pgmap v17119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:02 smithi191 ceph-mon[31636]: pgmap v17120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31933.962255 secs 2024-04-21T19:17:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:02 smithi170 ceph-mon[31212]: pgmap v17120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31933.962255 secs 2024-04-21T19:17:03.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:02 smithi077 ceph-mon[27902]: pgmap v17120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:03.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31933.962255 secs 2024-04-21T19:17:03.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:17:04.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:17:04.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:17:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:04 smithi191 ceph-mon[31636]: pgmap v17121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31935.720763 secs 2024-04-21T19:17:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:17:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:17:04.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:17:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:04 smithi170 ceph-mon[31212]: pgmap v17121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31935.720763 secs 2024-04-21T19:17:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:17:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:17:05.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:17:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:05.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:04 smithi077 ceph-mon[27902]: pgmap v17121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:05.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31935.720763 secs 2024-04-21T19:17:05.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:17:05.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:17:05.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:17:05.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:05 smithi191 ceph-mon[31636]: osdmap e1142: 12 total, 12 up, 12 in 2024-04-21T19:17:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:05 smithi170 ceph-mon[31212]: osdmap e1142: 12 total, 12 up, 12 in 2024-04-21T19:17:06.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:05 smithi077 ceph-mon[27902]: osdmap e1142: 12 total, 12 up, 12 in 2024-04-21T19:17:06.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:06 smithi191 ceph-mon[31636]: pgmap v17123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:07.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:06 smithi170 ceph-mon[31212]: pgmap v17123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:07.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:06 smithi077 ceph-mon[27902]: pgmap v17123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:08.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31938.962388 secs 2024-04-21T19:17:08.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31938.962388 secs 2024-04-21T19:17:08.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31938.962388 secs 2024-04-21T19:17:09.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:08 smithi170 ceph-mon[31212]: pgmap v17124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:08 smithi077 ceph-mon[27902]: pgmap v17124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:09.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:08 smithi191 ceph-mon[31636]: pgmap v17124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:10.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31940.720883 secs 2024-04-21T19:17:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:10.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31940.720883 secs 2024-04-21T19:17:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31940.720883 secs 2024-04-21T19:17:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:10 smithi170 ceph-mon[31212]: pgmap v17125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:10 smithi077 ceph-mon[27902]: pgmap v17125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:10 smithi191 ceph-mon[31636]: pgmap v17125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:17:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:12 smithi170 ceph-mon[31212]: pgmap v17126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:17:13.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31943.962442 secs 2024-04-21T19:17:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:12 smithi077 ceph-mon[27902]: pgmap v17126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:17:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31943.962442 secs 2024-04-21T19:17:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:12 smithi191 ceph-mon[31636]: pgmap v17126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:17:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31943.962442 secs 2024-04-21T19:17:14.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:14 smithi191 ceph-mon[31636]: pgmap v17127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:17:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:14 smithi191 ceph-mon[31636]: osdmap e1143: 12 total, 12 up, 12 in 2024-04-21T19:17:14.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31945.720996 secs 2024-04-21T19:17:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:14 smithi170 ceph-mon[31212]: pgmap v17127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:17:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:14 smithi170 ceph-mon[31212]: osdmap e1143: 12 total, 12 up, 12 in 2024-04-21T19:17:14.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31945.720996 secs 2024-04-21T19:17:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:14 smithi077 ceph-mon[27902]: pgmap v17127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:17:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:14 smithi077 ceph-mon[27902]: osdmap e1143: 12 total, 12 up, 12 in 2024-04-21T19:17:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31945.720996 secs 2024-04-21T19:17:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:16.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:16 smithi191 ceph-mon[31636]: pgmap v17129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:16.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:16 smithi170 ceph-mon[31212]: pgmap v17129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:16.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:16 smithi077 ceph-mon[27902]: pgmap v17129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:17.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31948.962517 secs 2024-04-21T19:17:17.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31948.962517 secs 2024-04-21T19:17:17.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31948.962517 secs 2024-04-21T19:17:18.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:18 smithi191 ceph-mon[31636]: pgmap v17130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:18.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:18 smithi170 ceph-mon[31212]: pgmap v17130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:18.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:18 smithi077 ceph-mon[27902]: pgmap v17130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:19.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31950.721116 secs 2024-04-21T19:17:19.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31950.721116 secs 2024-04-21T19:17:19.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31950.721116 secs 2024-04-21T19:17:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:20.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:20 smithi191 ceph-mon[31636]: pgmap v17131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:20.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:20 smithi170 ceph-mon[31212]: pgmap v17131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:20.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:20 smithi077 ceph-mon[27902]: pgmap v17131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:17:22.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:22 smithi191 ceph-mon[31636]: pgmap v17132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:17:22.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31953.962639 secs 2024-04-21T19:17:22.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:22 smithi170 ceph-mon[31212]: pgmap v17132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:17:22.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31953.962639 secs 2024-04-21T19:17:22.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:22 smithi077 ceph-mon[27902]: pgmap v17132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:17:22.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31953.962639 secs 2024-04-21T19:17:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:24 smithi191 ceph-mon[31636]: pgmap v17133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:17:24.693 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31955.721205 secs 2024-04-21T19:17:24.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:24 smithi170 ceph-mon[31212]: pgmap v17133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:17:24.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31955.721205 secs 2024-04-21T19:17:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:24 smithi077 ceph-mon[27902]: pgmap v17133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:17:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31955.721205 secs 2024-04-21T19:17:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:26.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:26 smithi191 ceph-mon[31636]: pgmap v17134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:17:26.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:26 smithi170 ceph-mon[31212]: pgmap v17134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:17:26.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:26 smithi077 ceph-mon[27902]: pgmap v17134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T19:17:27.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31958.962758 secs 2024-04-21T19:17:27.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31958.962758 secs 2024-04-21T19:17:27.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31958.962758 secs 2024-04-21T19:17:28.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:28 smithi170 ceph-mon[31212]: pgmap v17135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:28.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:28 smithi077 ceph-mon[27902]: pgmap v17135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:28.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:28 smithi191 ceph-mon[31636]: pgmap v17135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:29.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31960.721348 secs 2024-04-21T19:17:29.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31960.721348 secs 2024-04-21T19:17:29.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31960.721348 secs 2024-04-21T19:17:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:30.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:30 smithi170 ceph-mon[31212]: pgmap v17136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:30.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:30 smithi077 ceph-mon[27902]: pgmap v17136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:30.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:30 smithi191 ceph-mon[31636]: pgmap v17136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:32.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:32 smithi170 ceph-mon[31212]: pgmap v17137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:32.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31963.962855 secs 2024-04-21T19:17:32.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:32 smithi077 ceph-mon[27902]: pgmap v17137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:32.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31963.962855 secs 2024-04-21T19:17:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:32 smithi191 ceph-mon[31636]: pgmap v17137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31963.962855 secs 2024-04-21T19:17:34.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:34 smithi170 ceph-mon[31212]: pgmap v17138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:34.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31965.721483 secs 2024-04-21T19:17:34.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:34 smithi077 ceph-mon[27902]: pgmap v17138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:34.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31965.721483 secs 2024-04-21T19:17:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:34 smithi191 ceph-mon[31636]: pgmap v17138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31965.721483 secs 2024-04-21T19:17:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:36.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:36 smithi170 ceph-mon[31212]: pgmap v17139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:36.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:36 smithi077 ceph-mon[27902]: pgmap v17139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:36.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:36 smithi191 ceph-mon[31636]: pgmap v17139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:37.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31968.962949 secs 2024-04-21T19:17:37.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31968.962949 secs 2024-04-21T19:17:37.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31968.962949 secs 2024-04-21T19:17:38.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:38 smithi170 ceph-mon[31212]: pgmap v17140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:38.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:38 smithi077 ceph-mon[27902]: pgmap v17140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:38.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:38 smithi191 ceph-mon[31636]: pgmap v17140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:39.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31970.721600 secs 2024-04-21T19:17:39.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31970.721600 secs 2024-04-21T19:17:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31970.721600 secs 2024-04-21T19:17:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:40.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:40 smithi170 ceph-mon[31212]: pgmap v17141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:40.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:40 smithi077 ceph-mon[27902]: pgmap v17141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:40.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:40 smithi191 ceph-mon[31636]: pgmap v17141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:42.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:42 smithi170 ceph-mon[31212]: pgmap v17142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:42.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31973.963064 secs 2024-04-21T19:17:42.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:42 smithi077 ceph-mon[27902]: pgmap v17142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:42.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31973.963064 secs 2024-04-21T19:17:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:42 smithi191 ceph-mon[31636]: pgmap v17142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31973.963064 secs 2024-04-21T19:17:44.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:44 smithi170 ceph-mon[31212]: pgmap v17143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:44.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31975.721730 secs 2024-04-21T19:17:44.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:44 smithi077 ceph-mon[27902]: pgmap v17143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:44.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31975.721730 secs 2024-04-21T19:17:44.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:44 smithi191 ceph-mon[31636]: pgmap v17143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:44.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31975.721730 secs 2024-04-21T19:17:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:46.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:46 smithi170 ceph-mon[31212]: pgmap v17144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:46.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:46 smithi077 ceph-mon[27902]: pgmap v17144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:46.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:46 smithi191 ceph-mon[31636]: pgmap v17144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:47.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31978.963175 secs 2024-04-21T19:17:47.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31978.963175 secs 2024-04-21T19:17:47.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31978.963175 secs 2024-04-21T19:17:48.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:48 smithi170 ceph-mon[31212]: pgmap v17145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:48.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:48 smithi077 ceph-mon[27902]: pgmap v17145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:48.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:48 smithi191 ceph-mon[31636]: pgmap v17145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:49.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31980.721845 secs 2024-04-21T19:17:49.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31980.721845 secs 2024-04-21T19:17:49.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31980.721845 secs 2024-04-21T19:17:50.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:50.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:50 smithi170 ceph-mon[31212]: pgmap v17146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:50.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:50 smithi077 ceph-mon[27902]: pgmap v17146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:50.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:50 smithi191 ceph-mon[31636]: pgmap v17146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:52.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:52 smithi170 ceph-mon[31212]: pgmap v17147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:52.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31983.963286 secs 2024-04-21T19:17:52.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:52 smithi077 ceph-mon[27902]: pgmap v17147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:52.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31983.963286 secs 2024-04-21T19:17:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:52 smithi191 ceph-mon[31636]: pgmap v17147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31983.963286 secs 2024-04-21T19:17:54.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:54 smithi170 ceph-mon[31212]: pgmap v17148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:54.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31985.721959 secs 2024-04-21T19:17:54.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:54 smithi077 ceph-mon[27902]: pgmap v17148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:54.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31985.721959 secs 2024-04-21T19:17:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:54 smithi191 ceph-mon[31636]: pgmap v17148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31985.721959 secs 2024-04-21T19:17:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:17:56.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:56 smithi170 ceph-mon[31212]: pgmap v17149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:56.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:56 smithi077 ceph-mon[27902]: pgmap v17149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:56.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:56 smithi191 ceph-mon[31636]: pgmap v17149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:17:57.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31988.963428 secs 2024-04-21T19:17:57.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31988.963428 secs 2024-04-21T19:17:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31988.963428 secs 2024-04-21T19:17:58.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:58 smithi170 ceph-mon[31212]: pgmap v17150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:58.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:58 smithi077 ceph-mon[27902]: pgmap v17150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:58 smithi191 ceph-mon[31636]: pgmap v17150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:17:59.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31990.722067 secs 2024-04-21T19:17:59.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31990.722067 secs 2024-04-21T19:17:59.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31990.722067 secs 2024-04-21T19:18:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:00.781 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:00 smithi170 ceph-mon[31212]: pgmap v17151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:00.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:00 smithi077 ceph-mon[27902]: pgmap v17151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:00.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:00 smithi191 ceph-mon[31636]: pgmap v17151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:02.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:02 smithi077 ceph-mon[27902]: pgmap v17152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:02.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31993.963540 secs 2024-04-21T19:18:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:02 smithi191 ceph-mon[31636]: pgmap v17152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31993.963540 secs 2024-04-21T19:18:03.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:02 smithi170 ceph-mon[31212]: pgmap v17152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31993.963540 secs 2024-04-21T19:18:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:04 smithi077 ceph-mon[27902]: pgmap v17153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 31995.722138 secs 2024-04-21T19:18:04.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:18:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:04 smithi191 ceph-mon[31636]: pgmap v17153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 31995.722138 secs 2024-04-21T19:18:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:18:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:04 smithi170 ceph-mon[31212]: pgmap v17153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 31995.722138 secs 2024-04-21T19:18:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:18:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:05.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:05 smithi077 ceph-mon[27902]: osdmap e1144: 12 total, 12 up, 12 in 2024-04-21T19:18:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:18:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:18:05.862 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:18:05.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:05 smithi191 ceph-mon[31636]: osdmap e1144: 12 total, 12 up, 12 in 2024-04-21T19:18:05.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:18:05.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:18:05.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:18:06.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:05 smithi170 ceph-mon[31212]: osdmap e1144: 12 total, 12 up, 12 in 2024-04-21T19:18:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:18:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:18:06.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:18:07.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:06 smithi077 ceph-mon[27902]: pgmap v17155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:18:07.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:06 smithi191 ceph-mon[31636]: pgmap v17155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:18:07.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:06 smithi170 ceph-mon[31212]: pgmap v17155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:18:08.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 31998.963659 secs 2024-04-21T19:18:08.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 31998.963659 secs 2024-04-21T19:18:08.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 31998.963659 secs 2024-04-21T19:18:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:08 smithi077 ceph-mon[27902]: pgmap v17156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:18:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:08 smithi077 ceph-mon[27902]: osdmap e1145: 12 total, 12 up, 12 in 2024-04-21T19:18:09.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:08 smithi191 ceph-mon[31636]: pgmap v17156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:18:09.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:08 smithi191 ceph-mon[31636]: osdmap e1145: 12 total, 12 up, 12 in 2024-04-21T19:18:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:08 smithi170 ceph-mon[31212]: pgmap v17156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:18:09.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:08 smithi170 ceph-mon[31212]: osdmap e1145: 12 total, 12 up, 12 in 2024-04-21T19:18:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:10.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32000.722257 secs 2024-04-21T19:18:10.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32000.722257 secs 2024-04-21T19:18:10.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32000.722257 secs 2024-04-21T19:18:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:10 smithi077 ceph-mon[27902]: pgmap v17158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:18:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:10 smithi191 ceph-mon[31636]: pgmap v17158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:18:11.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:10 smithi170 ceph-mon[31212]: pgmap v17158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:18:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:12 smithi077 ceph-mon[27902]: pgmap v17159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:18:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32003.963791 secs 2024-04-21T19:18:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:12 smithi191 ceph-mon[31636]: pgmap v17159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:18:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32003.963791 secs 2024-04-21T19:18:13.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:12 smithi170 ceph-mon[31212]: pgmap v17159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:18:13.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32003.963791 secs 2024-04-21T19:18:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:15.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:14 smithi077 ceph-mon[27902]: pgmap v17160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:18:15.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32005.722365 secs 2024-04-21T19:18:15.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:14 smithi191 ceph-mon[31636]: pgmap v17160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:18:15.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32005.722365 secs 2024-04-21T19:18:15.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:14 smithi170 ceph-mon[31212]: pgmap v17160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:18:15.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32005.722365 secs 2024-04-21T19:18:17.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:16 smithi077 ceph-mon[27902]: pgmap v17161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:18:17.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:16 smithi191 ceph-mon[31636]: pgmap v17161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:18:17.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:16 smithi170 ceph-mon[31212]: pgmap v17161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:18:18.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32008.963888 secs 2024-04-21T19:18:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32008.963888 secs 2024-04-21T19:18:18.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32008.963888 secs 2024-04-21T19:18:19.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:18 smithi077 ceph-mon[27902]: pgmap v17162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:18:19.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:18 smithi191 ceph-mon[31636]: pgmap v17162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:18:19.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:18 smithi170 ceph-mon[31212]: pgmap v17162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:18:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:20.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32010.722489 secs 2024-04-21T19:18:20.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32010.722489 secs 2024-04-21T19:18:20.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32010.722489 secs 2024-04-21T19:18:21.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:20 smithi077 ceph-mon[27902]: pgmap v17163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:18:21.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:20 smithi191 ceph-mon[31636]: pgmap v17163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:18:21.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:20 smithi170 ceph-mon[31212]: pgmap v17163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:18:23.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:22 smithi077 ceph-mon[27902]: pgmap v17164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:18:23.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32013.963983 secs 2024-04-21T19:18:23.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:22 smithi191 ceph-mon[31636]: pgmap v17164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:18:23.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32013.963983 secs 2024-04-21T19:18:23.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:22 smithi170 ceph-mon[31212]: pgmap v17164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:18:23.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32013.963983 secs 2024-04-21T19:18:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:25.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:24 smithi077 ceph-mon[27902]: pgmap v17165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:25.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32015.722621 secs 2024-04-21T19:18:25.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:24 smithi191 ceph-mon[31636]: pgmap v17165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:25.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32015.722621 secs 2024-04-21T19:18:25.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:24 smithi170 ceph-mon[31212]: pgmap v17165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:25.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32015.722621 secs 2024-04-21T19:18:27.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:26 smithi077 ceph-mon[27902]: pgmap v17166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:27.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:26 smithi191 ceph-mon[31636]: pgmap v17166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:27.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:26 smithi170 ceph-mon[31212]: pgmap v17166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:28.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32018.964050 secs 2024-04-21T19:18:28.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32018.964050 secs 2024-04-21T19:18:28.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32018.964050 secs 2024-04-21T19:18:29.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:28 smithi191 ceph-mon[31636]: pgmap v17167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:29.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:28 smithi170 ceph-mon[31212]: pgmap v17167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:29.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:28 smithi077 ceph-mon[27902]: pgmap v17167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:30.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32020.722749 secs 2024-04-21T19:18:30.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32020.722749 secs 2024-04-21T19:18:30.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32020.722749 secs 2024-04-21T19:18:31.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:30 smithi191 ceph-mon[31636]: pgmap v17168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:31.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:30 smithi170 ceph-mon[31212]: pgmap v17168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:31.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:30 smithi077 ceph-mon[27902]: pgmap v17168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:33.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:32 smithi191 ceph-mon[31636]: pgmap v17169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:33.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32023.964124 secs 2024-04-21T19:18:33.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:32 smithi170 ceph-mon[31212]: pgmap v17169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:33.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32023.964124 secs 2024-04-21T19:18:33.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:32 smithi077 ceph-mon[27902]: pgmap v17169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:33.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32023.964124 secs 2024-04-21T19:18:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:35.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:34 smithi191 ceph-mon[31636]: pgmap v17170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:35.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32025.722893 secs 2024-04-21T19:18:35.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:34 smithi170 ceph-mon[31212]: pgmap v17170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:35.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32025.722893 secs 2024-04-21T19:18:35.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:34 smithi077 ceph-mon[27902]: pgmap v17170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:35.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32025.722893 secs 2024-04-21T19:18:37.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:36 smithi191 ceph-mon[31636]: pgmap v17171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:37.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:36 smithi170 ceph-mon[31212]: pgmap v17171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:37.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:36 smithi077 ceph-mon[27902]: pgmap v17171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:38.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32028.964237 secs 2024-04-21T19:18:38.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32028.964237 secs 2024-04-21T19:18:38.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32028.964237 secs 2024-04-21T19:18:39.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:38 smithi191 ceph-mon[31636]: pgmap v17172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:39.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:38 smithi170 ceph-mon[31212]: pgmap v17172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:39.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:38 smithi077 ceph-mon[27902]: pgmap v17172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:40.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32030.723012 secs 2024-04-21T19:18:40.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32030.723012 secs 2024-04-21T19:18:40.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32030.723012 secs 2024-04-21T19:18:41.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:40 smithi191 ceph-mon[31636]: pgmap v17173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:41.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:40 smithi170 ceph-mon[31212]: pgmap v17173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:41.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:40 smithi077 ceph-mon[27902]: pgmap v17173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:43.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:42 smithi191 ceph-mon[31636]: pgmap v17174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:43.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32033.964337 secs 2024-04-21T19:18:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:42 smithi170 ceph-mon[31212]: pgmap v17174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32033.964337 secs 2024-04-21T19:18:43.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:42 smithi077 ceph-mon[27902]: pgmap v17174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:43.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32033.964337 secs 2024-04-21T19:18:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:45.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:44 smithi191 ceph-mon[31636]: pgmap v17175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:45.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32035.723092 secs 2024-04-21T19:18:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:44 smithi170 ceph-mon[31212]: pgmap v17175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32035.723092 secs 2024-04-21T19:18:45.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:44 smithi077 ceph-mon[27902]: pgmap v17175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:45.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32035.723092 secs 2024-04-21T19:18:47.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:46 smithi191 ceph-mon[31636]: pgmap v17176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:47.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:46 smithi170 ceph-mon[31212]: pgmap v17176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:47.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:46 smithi077 ceph-mon[27902]: pgmap v17176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:48.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32038.964455 secs 2024-04-21T19:18:48.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32038.964455 secs 2024-04-21T19:18:48.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32038.964455 secs 2024-04-21T19:18:49.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:48 smithi191 ceph-mon[31636]: pgmap v17177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:49.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:48 smithi170 ceph-mon[31212]: pgmap v17177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:49.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:48 smithi077 ceph-mon[27902]: pgmap v17177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:50.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:50.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32040.723211 secs 2024-04-21T19:18:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32040.723211 secs 2024-04-21T19:18:50.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32040.723211 secs 2024-04-21T19:18:51.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:50 smithi191 ceph-mon[31636]: pgmap v17178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:51.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:50 smithi170 ceph-mon[31212]: pgmap v17178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:51.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:50 smithi077 ceph-mon[27902]: pgmap v17178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:53.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:52 smithi191 ceph-mon[31636]: pgmap v17179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:53.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32043.964577 secs 2024-04-21T19:18:53.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:52 smithi170 ceph-mon[31212]: pgmap v17179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:53.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32043.964577 secs 2024-04-21T19:18:53.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:52 smithi077 ceph-mon[27902]: pgmap v17179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:53.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32043.964577 secs 2024-04-21T19:18:54.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:53 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32045.723271 secs 2024-04-21T19:18:54.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:53 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32045.723271 secs 2024-04-21T19:18:54.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:53 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32045.723271 secs 2024-04-21T19:18:55.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:18:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:54 smithi170 ceph-mon[31212]: pgmap v17180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:55.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:54 smithi077 ceph-mon[27902]: pgmap v17180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:55.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:54 smithi191 ceph-mon[31636]: pgmap v17180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:57.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:56 smithi170 ceph-mon[31212]: pgmap v17181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:57.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:56 smithi077 ceph-mon[27902]: pgmap v17181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:57.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:56 smithi191 ceph-mon[31636]: pgmap v17181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:18:58.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32048.964643 secs 2024-04-21T19:18:58.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32048.964643 secs 2024-04-21T19:18:58.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32048.964643 secs 2024-04-21T19:18:59.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:58 smithi170 ceph-mon[31212]: pgmap v17182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:59.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:18:58 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32050.723390 secs 2024-04-21T19:18:59.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:58 smithi077 ceph-mon[27902]: pgmap v17182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:59.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:18:58 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32050.723390 secs 2024-04-21T19:18:59.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:58 smithi191 ceph-mon[31636]: pgmap v17182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:18:59.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:18:58 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32050.723390 secs 2024-04-21T19:19:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:00 smithi170 ceph-mon[31212]: pgmap v17183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:01.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:00 smithi077 ceph-mon[27902]: pgmap v17183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:01.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:00 smithi191 ceph-mon[31636]: pgmap v17183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:03.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:02 smithi170 ceph-mon[31212]: pgmap v17184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:03.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32053.964734 secs 2024-04-21T19:19:03.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:02 smithi077 ceph-mon[27902]: pgmap v17184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:03.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32053.964734 secs 2024-04-21T19:19:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:02 smithi191 ceph-mon[31636]: pgmap v17184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:03.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32053.964734 secs 2024-04-21T19:19:04.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:03 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32055.723480 secs 2024-04-21T19:19:04.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:03 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32055.723480 secs 2024-04-21T19:19:04.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:03 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32055.723480 secs 2024-04-21T19:19:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:04 smithi170 ceph-mon[31212]: pgmap v17185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:04 smithi170 ceph-mon[31212]: osdmap e1146: 12 total, 12 up, 12 in 2024-04-21T19:19:05.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:19:05.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:04 smithi077 ceph-mon[27902]: pgmap v17185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:05.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:04 smithi077 ceph-mon[27902]: osdmap e1146: 12 total, 12 up, 12 in 2024-04-21T19:19:05.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:19:05.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:04 smithi191 ceph-mon[31636]: pgmap v17185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:05.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:04 smithi191 ceph-mon[31636]: osdmap e1146: 12 total, 12 up, 12 in 2024-04-21T19:19:05.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:19:06.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:19:06.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:19:06.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:19:06.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:19:06.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:19:06.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:19:06.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:19:06.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:19:06.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:19:07.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:07 smithi170 ceph-mon[31212]: pgmap v17187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:19:07.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:07 smithi077 ceph-mon[27902]: pgmap v17187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:19:07.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:07 smithi191 ceph-mon[31636]: pgmap v17187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:19:08.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32058.964851 secs 2024-04-21T19:19:08.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32058.964851 secs 2024-04-21T19:19:08.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32058.964851 secs 2024-04-21T19:19:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:09 smithi170 ceph-mon[31212]: pgmap v17188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:19:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:09 smithi170 ceph-mon[31212]: osdmap e1147: 12 total, 12 up, 12 in 2024-04-21T19:19:09.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32060.723596 secs 2024-04-21T19:19:09.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:09 smithi077 ceph-mon[27902]: pgmap v17188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:19:09.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:09 smithi077 ceph-mon[27902]: osdmap e1147: 12 total, 12 up, 12 in 2024-04-21T19:19:09.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32060.723596 secs 2024-04-21T19:19:09.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:09 smithi191 ceph-mon[31636]: pgmap v17188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:19:09.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:09 smithi191 ceph-mon[31636]: osdmap e1147: 12 total, 12 up, 12 in 2024-04-21T19:19:09.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32060.723596 secs 2024-04-21T19:19:10.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:11.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:11 smithi170 ceph-mon[31212]: pgmap v17190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:19:11.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:11 smithi077 ceph-mon[27902]: pgmap v17190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:19:11.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:11 smithi191 ceph-mon[31636]: pgmap v17190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:19:13.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:13 smithi170 ceph-mon[31212]: pgmap v17191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:19:13.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32063.964933 secs 2024-04-21T19:19:13.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:13 smithi077 ceph-mon[27902]: pgmap v17191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:19:13.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32063.964933 secs 2024-04-21T19:19:13.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:13 smithi191 ceph-mon[31636]: pgmap v17191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:19:13.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32063.964933 secs 2024-04-21T19:19:14.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32065.723671 secs 2024-04-21T19:19:14.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32065.723671 secs 2024-04-21T19:19:14.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32065.723671 secs 2024-04-21T19:19:15.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:15.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:15 smithi170 ceph-mon[31212]: pgmap v17192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T19:19:15.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:15 smithi077 ceph-mon[27902]: pgmap v17192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T19:19:15.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:15 smithi191 ceph-mon[31636]: pgmap v17192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2024-04-21T19:19:17.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:17 smithi170 ceph-mon[31212]: pgmap v17193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:19:17.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:17 smithi077 ceph-mon[27902]: pgmap v17193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:19:17.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:17 smithi191 ceph-mon[31636]: pgmap v17193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:19:18.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32068.965027 secs 2024-04-21T19:19:18.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32068.965027 secs 2024-04-21T19:19:18.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32068.965027 secs 2024-04-21T19:19:19.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:19 smithi170 ceph-mon[31212]: pgmap v17194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:19:19.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32070.723786 secs 2024-04-21T19:19:19.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:19 smithi077 ceph-mon[27902]: pgmap v17194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:19:19.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32070.723786 secs 2024-04-21T19:19:19.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:19 smithi191 ceph-mon[31636]: pgmap v17194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:19:19.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32070.723786 secs 2024-04-21T19:19:20.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:21.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:21 smithi170 ceph-mon[31212]: pgmap v17195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:19:21.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:21 smithi077 ceph-mon[27902]: pgmap v17195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:19:21.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:21 smithi191 ceph-mon[31636]: pgmap v17195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:19:23.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:23 smithi170 ceph-mon[31212]: pgmap v17196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:19:23.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32073.965144 secs 2024-04-21T19:19:23.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:23 smithi077 ceph-mon[27902]: pgmap v17196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:19:23.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32073.965144 secs 2024-04-21T19:19:23.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:23 smithi191 ceph-mon[31636]: pgmap v17196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:19:23.442 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32073.965144 secs 2024-04-21T19:19:24.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:24 smithi191 ceph-mon[31636]: pgmap v17197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:24.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32075.723938 secs 2024-04-21T19:19:24.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:24 smithi170 ceph-mon[31212]: pgmap v17197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:24.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32075.723938 secs 2024-04-21T19:19:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:24 smithi077 ceph-mon[27902]: pgmap v17197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32075.723938 secs 2024-04-21T19:19:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:26.692 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:26 smithi191 ceph-mon[31636]: pgmap v17198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:26.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:26 smithi170 ceph-mon[31212]: pgmap v17198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:26.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:26 smithi077 ceph-mon[27902]: pgmap v17198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:27.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32078.965284 secs 2024-04-21T19:19:27.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32078.965284 secs 2024-04-21T19:19:27.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32078.965284 secs 2024-04-21T19:19:28.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:28 smithi170 ceph-mon[31212]: pgmap v17199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:28.861 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:28 smithi077 ceph-mon[27902]: pgmap v17199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:28.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:28 smithi191 ceph-mon[31636]: pgmap v17199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:29.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32080.724083 secs 2024-04-21T19:19:29.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32080.724083 secs 2024-04-21T19:19:29.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32080.724083 secs 2024-04-21T19:19:30.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:30.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:30 smithi170 ceph-mon[31212]: pgmap v17200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:30.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:30 smithi077 ceph-mon[27902]: pgmap v17200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:30.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:30 smithi191 ceph-mon[31636]: pgmap v17200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:32.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:32 smithi170 ceph-mon[31212]: pgmap v17201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:32.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32083.965422 secs 2024-04-21T19:19:32.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:32 smithi077 ceph-mon[27902]: pgmap v17201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:32.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32083.965422 secs 2024-04-21T19:19:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:32 smithi191 ceph-mon[31636]: pgmap v17201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32083.965422 secs 2024-04-21T19:19:34.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:34 smithi170 ceph-mon[31212]: pgmap v17202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:34.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32085.724159 secs 2024-04-21T19:19:34.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:34 smithi077 ceph-mon[27902]: pgmap v17202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:34.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32085.724159 secs 2024-04-21T19:19:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:34 smithi191 ceph-mon[31636]: pgmap v17202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32085.724159 secs 2024-04-21T19:19:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:36.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:36 smithi170 ceph-mon[31212]: pgmap v17203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:36.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:36 smithi077 ceph-mon[27902]: pgmap v17203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:36.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:36 smithi191 ceph-mon[31636]: pgmap v17203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:37.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32088.965495 secs 2024-04-21T19:19:37.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32088.965495 secs 2024-04-21T19:19:37.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32088.965495 secs 2024-04-21T19:19:38.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:38 smithi170 ceph-mon[31212]: pgmap v17204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:38.843 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:38 smithi191 ceph-mon[31636]: pgmap v17204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:38.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:38 smithi077 ceph-mon[27902]: pgmap v17204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:39.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32090.724275 secs 2024-04-21T19:19:39.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32090.724275 secs 2024-04-21T19:19:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32090.724275 secs 2024-04-21T19:19:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:40.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:40 smithi170 ceph-mon[31212]: pgmap v17205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:40.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:40 smithi077 ceph-mon[27902]: pgmap v17205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:40.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:40 smithi191 ceph-mon[31636]: pgmap v17205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:42.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:42 smithi170 ceph-mon[31212]: pgmap v17206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:42.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32093.965606 secs 2024-04-21T19:19:42.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:42 smithi077 ceph-mon[27902]: pgmap v17206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:42.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32093.965606 secs 2024-04-21T19:19:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:42 smithi191 ceph-mon[31636]: pgmap v17206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32093.965606 secs 2024-04-21T19:19:44.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:44 smithi170 ceph-mon[31212]: pgmap v17207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:44.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32095.724395 secs 2024-04-21T19:19:44.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:44 smithi077 ceph-mon[27902]: pgmap v17207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:44.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32095.724395 secs 2024-04-21T19:19:44.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:44 smithi191 ceph-mon[31636]: pgmap v17207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:44.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32095.724395 secs 2024-04-21T19:19:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:46.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:46 smithi170 ceph-mon[31212]: pgmap v17208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:46.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:46 smithi077 ceph-mon[27902]: pgmap v17208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:46.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:46 smithi191 ceph-mon[31636]: pgmap v17208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:47.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32098.965720 secs 2024-04-21T19:19:47.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32098.965720 secs 2024-04-21T19:19:47.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32098.965720 secs 2024-04-21T19:19:48.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:48 smithi170 ceph-mon[31212]: pgmap v17209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:48.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:48 smithi077 ceph-mon[27902]: pgmap v17209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:48.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:48 smithi191 ceph-mon[31636]: pgmap v17209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:49.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32100.724512 secs 2024-04-21T19:19:49.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32100.724512 secs 2024-04-21T19:19:49.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32100.724512 secs 2024-04-21T19:19:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:50.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:50 smithi170 ceph-mon[31212]: pgmap v17210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:50.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:50 smithi077 ceph-mon[27902]: pgmap v17210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:50.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:50 smithi191 ceph-mon[31636]: pgmap v17210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:19:52.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:52 smithi170 ceph-mon[31212]: pgmap v17211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:52.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32103.965834 secs 2024-04-21T19:19:52.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:52 smithi077 ceph-mon[27902]: pgmap v17211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:52.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32103.965834 secs 2024-04-21T19:19:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:52 smithi191 ceph-mon[31636]: pgmap v17211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32103.965834 secs 2024-04-21T19:19:54.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:54 smithi170 ceph-mon[31212]: pgmap v17212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:54.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32105.724659 secs 2024-04-21T19:19:54.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:54 smithi077 ceph-mon[27902]: pgmap v17212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:54.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32105.724659 secs 2024-04-21T19:19:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:54 smithi191 ceph-mon[31636]: pgmap v17212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32105.724659 secs 2024-04-21T19:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:19:56.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:56 smithi170 ceph-mon[31212]: pgmap v17213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:56.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:56 smithi077 ceph-mon[27902]: pgmap v17213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:56.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:56 smithi191 ceph-mon[31636]: pgmap v17213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:19:57.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32108.965952 secs 2024-04-21T19:19:57.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32108.965952 secs 2024-04-21T19:19:57.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32108.965952 secs 2024-04-21T19:19:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:19:58.796+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:19:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:19:58.796+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:19:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:19:58.797+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:19:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:19:58.797+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:19:58.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:58 smithi170 ceph-mon[31212]: pgmap v17214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:58.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:58 smithi077 ceph-mon[27902]: pgmap v17214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:58 smithi191 ceph-mon[31636]: pgmap v17214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:19:59.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32110.724776 secs 2024-04-21T19:19:59.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32110.724776 secs 2024-04-21T19:19:59.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32110.724776 secs 2024-04-21T19:20:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:00.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:00 smithi170 ceph-mon[31212]: pgmap v17215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:20:00.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:20:00.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:00 smithi077 ceph-mon[27902]: pgmap v17215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:20:00.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:20:00.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:00 smithi191 ceph-mon[31636]: pgmap v17215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:20:00.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:20:02.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:02 smithi170 ceph-mon[31212]: pgmap v17216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:02.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32113.966033 secs 2024-04-21T19:20:02.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:02 smithi077 ceph-mon[27902]: pgmap v17216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:02.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32113.966033 secs 2024-04-21T19:20:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:02 smithi191 ceph-mon[31636]: pgmap v17216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32113.966033 secs 2024-04-21T19:20:04.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:04 smithi170 ceph-mon[31212]: pgmap v17217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:04.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32115.724902 secs 2024-04-21T19:20:04.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:04 smithi077 ceph-mon[27902]: pgmap v17217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:04.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32115.724902 secs 2024-04-21T19:20:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:04 smithi191 ceph-mon[31636]: pgmap v17217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32115.724902 secs 2024-04-21T19:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:05.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:05 smithi077 ceph-mon[27902]: osdmap e1148: 12 total, 12 up, 12 in 2024-04-21T19:20:05.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:05 smithi191 ceph-mon[31636]: osdmap e1148: 12 total, 12 up, 12 in 2024-04-21T19:20:06.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:05 smithi170 ceph-mon[31212]: osdmap e1148: 12 total, 12 up, 12 in 2024-04-21T19:20:06.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:06 smithi077 ceph-mon[27902]: pgmap v17219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:20:06.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:20:06.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:20:06.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:20:06.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:20:06.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:06 smithi191 ceph-mon[31636]: pgmap v17219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:20:06.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:20:06.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:20:06.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:20:06.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:20:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:06 smithi170 ceph-mon[31212]: pgmap v17219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:20:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:20:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:20:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:20:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:20:07.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32118.966173 secs 2024-04-21T19:20:07.931 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32118.966173 secs 2024-04-21T19:20:07.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32118.966173 secs 2024-04-21T19:20:08.843 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:08 smithi191 ceph-mon[31636]: pgmap v17220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:20:08.843 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:08 smithi191 ceph-mon[31636]: osdmap e1149: 12 total, 12 up, 12 in 2024-04-21T19:20:08.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:08 smithi077 ceph-mon[27902]: pgmap v17220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:20:08.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:08 smithi077 ceph-mon[27902]: osdmap e1149: 12 total, 12 up, 12 in 2024-04-21T19:20:09.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:08 smithi170 ceph-mon[31212]: pgmap v17220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:20:09.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:08 smithi170 ceph-mon[31212]: osdmap e1149: 12 total, 12 up, 12 in 2024-04-21T19:20:09.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32120.724970 secs 2024-04-21T19:20:09.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32120.724970 secs 2024-04-21T19:20:10.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32120.724970 secs 2024-04-21T19:20:10.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:10.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:10 smithi077 ceph-mon[27902]: pgmap v17222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:20:10.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:10 smithi191 ceph-mon[31636]: pgmap v17222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:20:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:10 smithi170 ceph-mon[31212]: pgmap v17222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:20:12.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:12 smithi077 ceph-mon[27902]: pgmap v17223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:20:12.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32123.966299 secs 2024-04-21T19:20:12.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:12 smithi191 ceph-mon[31636]: pgmap v17223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:20:12.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32123.966299 secs 2024-04-21T19:20:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:12 smithi170 ceph-mon[31212]: pgmap v17223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:20:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32123.966299 secs 2024-04-21T19:20:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:14 smithi077 ceph-mon[27902]: pgmap v17224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:20:14.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32125.725082 secs 2024-04-21T19:20:14.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:14 smithi191 ceph-mon[31636]: pgmap v17224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:20:14.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32125.725082 secs 2024-04-21T19:20:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:14 smithi170 ceph-mon[31212]: pgmap v17224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:20:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32125.725082 secs 2024-04-21T19:20:15.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:16.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:16 smithi077 ceph-mon[27902]: pgmap v17225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:20:16.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:16 smithi191 ceph-mon[31636]: pgmap v17225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:20:17.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:16 smithi170 ceph-mon[31212]: pgmap v17225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:20:17.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32128.966412 secs 2024-04-21T19:20:17.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32128.966412 secs 2024-04-21T19:20:18.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32128.966412 secs 2024-04-21T19:20:18.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:18 smithi077 ceph-mon[27902]: pgmap v17226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:20:18.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:18 smithi191 ceph-mon[31636]: pgmap v17226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:20:19.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:18 smithi170 ceph-mon[31212]: pgmap v17226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:20:19.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32130.725203 secs 2024-04-21T19:20:19.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32130.725203 secs 2024-04-21T19:20:20.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32130.725203 secs 2024-04-21T19:20:20.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:20.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:20 smithi077 ceph-mon[27902]: pgmap v17227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:20:20.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:20 smithi191 ceph-mon[31636]: pgmap v17227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:20:21.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:20 smithi170 ceph-mon[31212]: pgmap v17227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:20:22.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:22 smithi077 ceph-mon[27902]: pgmap v17228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:20:22.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32133.966542 secs 2024-04-21T19:20:22.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:22 smithi191 ceph-mon[31636]: pgmap v17228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:20:22.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32133.966542 secs 2024-04-21T19:20:23.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:22 smithi170 ceph-mon[31212]: pgmap v17228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:20:23.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32133.966542 secs 2024-04-21T19:20:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:24 smithi077 ceph-mon[27902]: pgmap v17229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:24.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32135.725324 secs 2024-04-21T19:20:24.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:24 smithi191 ceph-mon[31636]: pgmap v17229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:24.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32135.725324 secs 2024-04-21T19:20:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:24 smithi170 ceph-mon[31212]: pgmap v17229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32135.725324 secs 2024-04-21T19:20:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:26.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:26 smithi077 ceph-mon[27902]: pgmap v17230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:26.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:26 smithi191 ceph-mon[31636]: pgmap v17230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:27.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:26 smithi170 ceph-mon[31212]: pgmap v17230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:27.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32138.966680 secs 2024-04-21T19:20:27.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32138.966680 secs 2024-04-21T19:20:28.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32138.966680 secs 2024-04-21T19:20:28.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:28 smithi077 ceph-mon[27902]: pgmap v17231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:28.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:28 smithi191 ceph-mon[31636]: pgmap v17231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:29.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:28 smithi170 ceph-mon[31212]: pgmap v17231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:29.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32140.725442 secs 2024-04-21T19:20:29.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32140.725442 secs 2024-04-21T19:20:30.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32140.725442 secs 2024-04-21T19:20:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:30.859 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:30 smithi077 ceph-mon[27902]: pgmap v17232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:30.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:30 smithi191 ceph-mon[31636]: pgmap v17232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:31.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:30 smithi170 ceph-mon[31212]: pgmap v17232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:32 smithi191 ceph-mon[31636]: pgmap v17233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:32.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32143.966776 secs 2024-04-21T19:20:33.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:32 smithi170 ceph-mon[31212]: pgmap v17233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:33.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32143.966776 secs 2024-04-21T19:20:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:32 smithi077 ceph-mon[27902]: pgmap v17233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:33.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32143.966776 secs 2024-04-21T19:20:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:34 smithi191 ceph-mon[31636]: pgmap v17234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32145.725546 secs 2024-04-21T19:20:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:34 smithi170 ceph-mon[31212]: pgmap v17234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32145.725546 secs 2024-04-21T19:20:35.047 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:34 smithi077 ceph-mon[27902]: pgmap v17234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:35.047 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32145.725546 secs 2024-04-21T19:20:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:36.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:36 smithi191 ceph-mon[31636]: pgmap v17235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:37.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:36 smithi170 ceph-mon[31212]: pgmap v17235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:37.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:36 smithi077 ceph-mon[27902]: pgmap v17235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:37.931 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32148.966892 secs 2024-04-21T19:20:37.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32148.966892 secs 2024-04-21T19:20:38.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32148.966892 secs 2024-04-21T19:20:38.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:38 smithi191 ceph-mon[31636]: pgmap v17236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:39.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:38 smithi170 ceph-mon[31212]: pgmap v17236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:39.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:38 smithi077 ceph-mon[27902]: pgmap v17236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:39.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32150.725628 secs 2024-04-21T19:20:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32150.725628 secs 2024-04-21T19:20:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32150.725628 secs 2024-04-21T19:20:40.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:40 smithi191 ceph-mon[31636]: pgmap v17237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:41.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:40 smithi170 ceph-mon[31212]: pgmap v17237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:41.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:40 smithi077 ceph-mon[27902]: pgmap v17237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:42 smithi191 ceph-mon[31636]: pgmap v17238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32153.966962 secs 2024-04-21T19:20:43.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:42 smithi170 ceph-mon[31212]: pgmap v17238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:43.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32153.966962 secs 2024-04-21T19:20:43.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:42 smithi077 ceph-mon[27902]: pgmap v17238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:43.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32153.966962 secs 2024-04-21T19:20:44.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:44 smithi191 ceph-mon[31636]: pgmap v17239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:44.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32155.725743 secs 2024-04-21T19:20:45.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:44 smithi170 ceph-mon[31212]: pgmap v17239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:45.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32155.725743 secs 2024-04-21T19:20:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:44 smithi077 ceph-mon[27902]: pgmap v17239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32155.725743 secs 2024-04-21T19:20:46.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:46 smithi191 ceph-mon[31636]: pgmap v17240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:47.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:46 smithi170 ceph-mon[31212]: pgmap v17240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:47.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:46 smithi077 ceph-mon[27902]: pgmap v17240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:47.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32158.967069 secs 2024-04-21T19:20:48.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32158.967069 secs 2024-04-21T19:20:48.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32158.967069 secs 2024-04-21T19:20:48.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:48 smithi191 ceph-mon[31636]: pgmap v17241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:49.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:48 smithi170 ceph-mon[31212]: pgmap v17241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:49.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:48 smithi077 ceph-mon[27902]: pgmap v17241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:49.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32160.725838 secs 2024-04-21T19:20:50.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32160.725838 secs 2024-04-21T19:20:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:50.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32160.725838 secs 2024-04-21T19:20:50.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:50 smithi191 ceph-mon[31636]: pgmap v17242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:51.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:50 smithi170 ceph-mon[31212]: pgmap v17242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:51.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:50 smithi077 ceph-mon[27902]: pgmap v17242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:52.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:52 smithi191 ceph-mon[31636]: pgmap v17243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:52.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32163.967191 secs 2024-04-21T19:20:53.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:52 smithi170 ceph-mon[31212]: pgmap v17243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:53.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32163.967191 secs 2024-04-21T19:20:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:52 smithi077 ceph-mon[27902]: pgmap v17243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:53.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32163.967191 secs 2024-04-21T19:20:54.910 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:54 smithi077 ceph-mon[27902]: pgmap v17244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:54.911 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32165.725960 secs 2024-04-21T19:20:54.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:54 smithi191 ceph-mon[31636]: pgmap v17244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:54.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32165.725960 secs 2024-04-21T19:20:55.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:54 smithi170 ceph-mon[31212]: pgmap v17244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:55.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32165.725960 secs 2024-04-21T19:20:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:20:56.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:56 smithi191 ceph-mon[31636]: pgmap v17245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:57.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:56 smithi170 ceph-mon[31212]: pgmap v17245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:57.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:56 smithi077 ceph-mon[27902]: pgmap v17245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:20:57.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32168.967309 secs 2024-04-21T19:20:58.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32168.967309 secs 2024-04-21T19:20:58.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32168.967309 secs 2024-04-21T19:20:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:58 smithi191 ceph-mon[31636]: pgmap v17246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:59.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:58 smithi170 ceph-mon[31212]: pgmap v17246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:59.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:58 smithi077 ceph-mon[27902]: pgmap v17246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:20:59.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32170.726075 secs 2024-04-21T19:21:00.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32170.726075 secs 2024-04-21T19:21:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:00.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32170.726075 secs 2024-04-21T19:21:00.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:00 smithi191 ceph-mon[31636]: pgmap v17247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:01.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:00 smithi170 ceph-mon[31212]: pgmap v17247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:01.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:00 smithi077 ceph-mon[27902]: pgmap v17247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:02 smithi191 ceph-mon[31636]: pgmap v17248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T19:21:02.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32173.967443 secs 2024-04-21T19:21:03.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:02 smithi170 ceph-mon[31212]: pgmap v17248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T19:21:03.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32173.967443 secs 2024-04-21T19:21:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:02 smithi077 ceph-mon[27902]: pgmap v17248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T19:21:03.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32173.967443 secs 2024-04-21T19:21:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:04 smithi191 ceph-mon[31636]: pgmap v17249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T19:21:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32175.726193 secs 2024-04-21T19:21:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:04 smithi170 ceph-mon[31212]: pgmap v17249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T19:21:05.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32175.726193 secs 2024-04-21T19:21:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:04 smithi077 ceph-mon[27902]: pgmap v17249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T19:21:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32175.726193 secs 2024-04-21T19:21:06.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:05 smithi170 ceph-mon[31212]: osdmap e1150: 12 total, 12 up, 12 in 2024-04-21T19:21:06.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:05 smithi077 ceph-mon[27902]: osdmap e1150: 12 total, 12 up, 12 in 2024-04-21T19:21:06.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:05 smithi191 ceph-mon[31636]: osdmap e1150: 12 total, 12 up, 12 in 2024-04-21T19:21:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:06 smithi170 ceph-mon[31212]: pgmap v17251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:21:07.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:21:07.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:06 smithi077 ceph-mon[27902]: pgmap v17251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:21:07.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:21:07.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:06 smithi191 ceph-mon[31636]: pgmap v17251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:21:07.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:21:08.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32178.967537 secs 2024-04-21T19:21:08.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:21:08.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:21:08.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:21:08.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32178.967537 secs 2024-04-21T19:21:08.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:21:08.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:21:08.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:21:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32178.967537 secs 2024-04-21T19:21:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:21:08.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:21:08.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:21:09.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:08 smithi170 ceph-mon[31212]: pgmap v17252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:21:09.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:08 smithi170 ceph-mon[31212]: osdmap e1151: 12 total, 12 up, 12 in 2024-04-21T19:21:09.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:08 smithi077 ceph-mon[27902]: pgmap v17252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:21:09.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:08 smithi077 ceph-mon[27902]: osdmap e1151: 12 total, 12 up, 12 in 2024-04-21T19:21:09.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:08 smithi191 ceph-mon[31636]: pgmap v17252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:21:09.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:08 smithi191 ceph-mon[31636]: osdmap e1151: 12 total, 12 up, 12 in 2024-04-21T19:21:10.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32180.726317 secs 2024-04-21T19:21:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:10.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32180.726317 secs 2024-04-21T19:21:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32180.726317 secs 2024-04-21T19:21:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:10 smithi170 ceph-mon[31212]: pgmap v17254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T19:21:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:10 smithi077 ceph-mon[27902]: pgmap v17254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T19:21:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:10 smithi191 ceph-mon[31636]: pgmap v17254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 17 KiB/s wr, 5 op/s 2024-04-21T19:21:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:12 smithi170 ceph-mon[31212]: pgmap v17255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T19:21:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32183.967673 secs 2024-04-21T19:21:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:12 smithi077 ceph-mon[27902]: pgmap v17255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T19:21:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32183.967673 secs 2024-04-21T19:21:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:12 smithi191 ceph-mon[31636]: pgmap v17255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T19:21:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32183.967673 secs 2024-04-21T19:21:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:14 smithi170 ceph-mon[31212]: pgmap v17256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:21:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32185.726417 secs 2024-04-21T19:21:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:15.231 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:14 smithi191 ceph-mon[31636]: pgmap v17256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:21:15.232 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32185.726417 secs 2024-04-21T19:21:15.232 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:14 smithi077 ceph-mon[27902]: pgmap v17256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:21:15.232 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32185.726417 secs 2024-04-21T19:21:17.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:16 smithi170 ceph-mon[31212]: pgmap v17257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:21:17.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:16 smithi077 ceph-mon[27902]: pgmap v17257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:21:17.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:16 smithi191 ceph-mon[31636]: pgmap v17257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:21:18.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32188.967792 secs 2024-04-21T19:21:18.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32188.967792 secs 2024-04-21T19:21:18.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32188.967792 secs 2024-04-21T19:21:19.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:18 smithi170 ceph-mon[31212]: pgmap v17258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:21:19.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:18 smithi077 ceph-mon[27902]: pgmap v17258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:21:19.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:18 smithi191 ceph-mon[31636]: pgmap v17258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:21:20.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32190.726534 secs 2024-04-21T19:21:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:20.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32190.726534 secs 2024-04-21T19:21:20.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32190.726534 secs 2024-04-21T19:21:21.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:20 smithi170 ceph-mon[31212]: pgmap v17259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:21:21.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:20 smithi077 ceph-mon[27902]: pgmap v17259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:21:21.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:20 smithi191 ceph-mon[31636]: pgmap v17259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:21:23.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:22 smithi170 ceph-mon[31212]: pgmap v17260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:21:23.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32193.967903 secs 2024-04-21T19:21:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:22 smithi077 ceph-mon[27902]: pgmap v17260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:21:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32193.967903 secs 2024-04-21T19:21:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:22 smithi191 ceph-mon[31636]: pgmap v17260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:21:23.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32193.967903 secs 2024-04-21T19:21:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:24 smithi170 ceph-mon[31212]: pgmap v17261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32195.726647 secs 2024-04-21T19:21:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:24 smithi077 ceph-mon[27902]: pgmap v17261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32195.726647 secs 2024-04-21T19:21:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:24 smithi191 ceph-mon[31636]: pgmap v17261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32195.726647 secs 2024-04-21T19:21:27.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:26 smithi170 ceph-mon[31212]: pgmap v17262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:27.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:26 smithi077 ceph-mon[27902]: pgmap v17262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:27.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:26 smithi191 ceph-mon[31636]: pgmap v17262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:28.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32198.968020 secs 2024-04-21T19:21:28.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32198.968020 secs 2024-04-21T19:21:28.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32198.968020 secs 2024-04-21T19:21:29.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:28 smithi170 ceph-mon[31212]: pgmap v17263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:29.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:28 smithi077 ceph-mon[27902]: pgmap v17263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:29.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:28 smithi191 ceph-mon[31636]: pgmap v17263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:30.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32200.726770 secs 2024-04-21T19:21:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:30.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32200.726770 secs 2024-04-21T19:21:30.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32200.726770 secs 2024-04-21T19:21:31.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:30 smithi170 ceph-mon[31212]: pgmap v17264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:31.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:30 smithi077 ceph-mon[27902]: pgmap v17264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:31.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:30 smithi191 ceph-mon[31636]: pgmap v17264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:33.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:32 smithi170 ceph-mon[31212]: pgmap v17265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:33.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32203.968120 secs 2024-04-21T19:21:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:32 smithi077 ceph-mon[27902]: pgmap v17265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:33.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32203.968120 secs 2024-04-21T19:21:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:32 smithi191 ceph-mon[31636]: pgmap v17265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32203.968120 secs 2024-04-21T19:21:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:34 smithi170 ceph-mon[31212]: pgmap v17266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32205.726904 secs 2024-04-21T19:21:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:35.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:34 smithi077 ceph-mon[27902]: pgmap v17266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:35.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32205.726904 secs 2024-04-21T19:21:35.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:34 smithi191 ceph-mon[31636]: pgmap v17266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:35.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32205.726904 secs 2024-04-21T19:21:37.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:36 smithi170 ceph-mon[31212]: pgmap v17267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:37.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:36 smithi077 ceph-mon[27902]: pgmap v17267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:37.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:36 smithi191 ceph-mon[31636]: pgmap v17267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:38.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32208.968239 secs 2024-04-21T19:21:38.093 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32208.968239 secs 2024-04-21T19:21:38.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32208.968239 secs 2024-04-21T19:21:39.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:38 smithi170 ceph-mon[31212]: pgmap v17268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:39.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:38 smithi077 ceph-mon[27902]: pgmap v17268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:39.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:38 smithi191 ceph-mon[31636]: pgmap v17268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32210.727017 secs 2024-04-21T19:21:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32210.727017 secs 2024-04-21T19:21:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32210.727017 secs 2024-04-21T19:21:41.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:40 smithi170 ceph-mon[31212]: pgmap v17269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:41.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:40 smithi077 ceph-mon[27902]: pgmap v17269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:41.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:40 smithi191 ceph-mon[31636]: pgmap v17269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:42 smithi077 ceph-mon[27902]: pgmap v17270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:43.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32213.968358 secs 2024-04-21T19:21:43.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:42 smithi191 ceph-mon[31636]: pgmap v17270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:43.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32213.968358 secs 2024-04-21T19:21:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:42 smithi170 ceph-mon[31212]: pgmap v17270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32213.968358 secs 2024-04-21T19:21:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:44 smithi077 ceph-mon[27902]: pgmap v17271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32215.727132 secs 2024-04-21T19:21:45.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:44 smithi191 ceph-mon[31636]: pgmap v17271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:45.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32215.727132 secs 2024-04-21T19:21:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:44 smithi170 ceph-mon[31212]: pgmap v17271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32215.727132 secs 2024-04-21T19:21:47.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:46 smithi077 ceph-mon[27902]: pgmap v17272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:47.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:46 smithi191 ceph-mon[31636]: pgmap v17272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:47.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:46 smithi170 ceph-mon[31212]: pgmap v17272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:48.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32218.968478 secs 2024-04-21T19:21:48.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32218.968478 secs 2024-04-21T19:21:48.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32218.968478 secs 2024-04-21T19:21:49.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:48 smithi077 ceph-mon[27902]: pgmap v17273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:49.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:48 smithi191 ceph-mon[31636]: pgmap v17273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:49.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:48 smithi170 ceph-mon[31212]: pgmap v17273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:50.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32220.727252 secs 2024-04-21T19:21:50.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32220.727252 secs 2024-04-21T19:21:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32220.727252 secs 2024-04-21T19:21:51.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:50 smithi077 ceph-mon[27902]: pgmap v17274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:51.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:50 smithi191 ceph-mon[31636]: pgmap v17274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:51.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:50 smithi170 ceph-mon[31212]: pgmap v17274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:52 smithi077 ceph-mon[27902]: pgmap v17275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32223.968600 secs 2024-04-21T19:21:53.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:52 smithi191 ceph-mon[31636]: pgmap v17275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:53.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32223.968600 secs 2024-04-21T19:21:53.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:52 smithi170 ceph-mon[31212]: pgmap v17275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:53.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32223.968600 secs 2024-04-21T19:21:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:21:55.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:54 smithi077 ceph-mon[27902]: pgmap v17276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:55.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32225.727365 secs 2024-04-21T19:21:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:54 smithi191 ceph-mon[31636]: pgmap v17276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32225.727365 secs 2024-04-21T19:21:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:54 smithi170 ceph-mon[31212]: pgmap v17276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32225.727365 secs 2024-04-21T19:21:57.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:56 smithi077 ceph-mon[27902]: pgmap v17277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:57.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:56 smithi191 ceph-mon[31636]: pgmap v17277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:57.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:56 smithi170 ceph-mon[31212]: pgmap v17277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:21:58.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32228.968725 secs 2024-04-21T19:21:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32228.968725 secs 2024-04-21T19:21:58.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32228.968725 secs 2024-04-21T19:21:59.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:58 smithi077 ceph-mon[27902]: pgmap v17278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:59.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:58 smithi191 ceph-mon[31636]: pgmap v17278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:21:59.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:58 smithi170 ceph-mon[31212]: pgmap v17278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:00.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32230.727458 secs 2024-04-21T19:22:00.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32230.727458 secs 2024-04-21T19:22:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32230.727458 secs 2024-04-21T19:22:01.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:00 smithi077 ceph-mon[27902]: pgmap v17279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:01.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:00 smithi191 ceph-mon[31636]: pgmap v17279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:00 smithi170 ceph-mon[31212]: pgmap v17279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:02 smithi077 ceph-mon[27902]: pgmap v17280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:03.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32233.968854 secs 2024-04-21T19:22:03.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:02 smithi191 ceph-mon[31636]: pgmap v17280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:03.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32233.968854 secs 2024-04-21T19:22:03.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:02 smithi170 ceph-mon[31212]: pgmap v17280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:03.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32233.968854 secs 2024-04-21T19:22:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:04 smithi077 ceph-mon[27902]: pgmap v17281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32235.727579 secs 2024-04-21T19:22:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:04 smithi077 ceph-mon[27902]: osdmap e1152: 12 total, 12 up, 12 in 2024-04-21T19:22:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:04 smithi191 ceph-mon[31636]: pgmap v17281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32235.727579 secs 2024-04-21T19:22:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:04 smithi191 ceph-mon[31636]: osdmap e1152: 12 total, 12 up, 12 in 2024-04-21T19:22:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:04 smithi170 ceph-mon[31212]: pgmap v17281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32235.727579 secs 2024-04-21T19:22:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:04 smithi170 ceph-mon[31212]: osdmap e1152: 12 total, 12 up, 12 in 2024-04-21T19:22:07.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:06 smithi077 ceph-mon[27902]: pgmap v17283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:22:07.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:06 smithi191 ceph-mon[31636]: pgmap v17283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:22:07.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:06 smithi170 ceph-mon[31212]: pgmap v17283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:22:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32238.968980 secs 2024-04-21T19:22:08.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:22:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32238.968980 secs 2024-04-21T19:22:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:22:08.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32238.968980 secs 2024-04-21T19:22:08.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:22:09.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:08 smithi077 ceph-mon[27902]: pgmap v17284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:22:09.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:22:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:22:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:22:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:08 smithi077 ceph-mon[27902]: osdmap e1153: 12 total, 12 up, 12 in 2024-04-21T19:22:09.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:08 smithi191 ceph-mon[31636]: pgmap v17284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:22:09.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:22:09.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:22:09.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:22:09.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:08 smithi191 ceph-mon[31636]: osdmap e1153: 12 total, 12 up, 12 in 2024-04-21T19:22:09.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:08 smithi170 ceph-mon[31212]: pgmap v17284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:22:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:22:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:22:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:22:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:08 smithi170 ceph-mon[31212]: osdmap e1153: 12 total, 12 up, 12 in 2024-04-21T19:22:10.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32240.727717 secs 2024-04-21T19:22:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32240.727717 secs 2024-04-21T19:22:10.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32240.727717 secs 2024-04-21T19:22:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:10 smithi191 ceph-mon[31636]: pgmap v17286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:22:11.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:10 smithi170 ceph-mon[31212]: pgmap v17286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:22:11.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:10 smithi077 ceph-mon[27902]: pgmap v17286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:22:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:12 smithi191 ceph-mon[31636]: pgmap v17287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:22:13.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32243.969080 secs 2024-04-21T19:22:13.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:12 smithi170 ceph-mon[31212]: pgmap v17287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:22:13.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32243.969080 secs 2024-04-21T19:22:13.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:12 smithi077 ceph-mon[27902]: pgmap v17287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:22:13.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32243.969080 secs 2024-04-21T19:22:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:14 smithi191 ceph-mon[31636]: pgmap v17288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:22:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32245.727830 secs 2024-04-21T19:22:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:14 smithi170 ceph-mon[31212]: pgmap v17288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:22:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32245.727830 secs 2024-04-21T19:22:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:14 smithi077 ceph-mon[27902]: pgmap v17288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:22:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32245.727830 secs 2024-04-21T19:22:17.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:16 smithi191 ceph-mon[31636]: pgmap v17289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:22:17.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:16 smithi170 ceph-mon[31212]: pgmap v17289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:22:17.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:16 smithi077 ceph-mon[27902]: pgmap v17289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:22:18.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32248.969178 secs 2024-04-21T19:22:18.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32248.969178 secs 2024-04-21T19:22:18.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32248.969178 secs 2024-04-21T19:22:19.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:18 smithi191 ceph-mon[31636]: pgmap v17290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:22:19.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:18 smithi170 ceph-mon[31212]: pgmap v17290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:22:19.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:18 smithi077 ceph-mon[27902]: pgmap v17290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:22:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:20.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32250.727950 secs 2024-04-21T19:22:20.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32250.727950 secs 2024-04-21T19:22:20.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32250.727950 secs 2024-04-21T19:22:21.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:20 smithi191 ceph-mon[31636]: pgmap v17291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:22:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:20 smithi170 ceph-mon[31212]: pgmap v17291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:22:21.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:20 smithi077 ceph-mon[27902]: pgmap v17291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:22:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:22 smithi191 ceph-mon[31636]: pgmap v17292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:22:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32253.969317 secs 2024-04-21T19:22:23.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:22 smithi170 ceph-mon[31212]: pgmap v17292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:22:23.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32253.969317 secs 2024-04-21T19:22:23.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:22 smithi077 ceph-mon[27902]: pgmap v17292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:22:23.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32253.969317 secs 2024-04-21T19:22:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:25.160 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:24 smithi077 ceph-mon[27902]: pgmap v17293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:25.161 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32255.728065 secs 2024-04-21T19:22:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:24 smithi191 ceph-mon[31636]: pgmap v17293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32255.728065 secs 2024-04-21T19:22:25.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:24 smithi170 ceph-mon[31212]: pgmap v17293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:25.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32255.728065 secs 2024-04-21T19:22:27.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:26 smithi191 ceph-mon[31636]: pgmap v17294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:27.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:26 smithi170 ceph-mon[31212]: pgmap v17294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:27.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:26 smithi077 ceph-mon[27902]: pgmap v17294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:28.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32258.969430 secs 2024-04-21T19:22:28.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32258.969430 secs 2024-04-21T19:22:28.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32258.969430 secs 2024-04-21T19:22:29.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:28 smithi191 ceph-mon[31636]: pgmap v17295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:29.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:28 smithi170 ceph-mon[31212]: pgmap v17295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:29.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:28 smithi077 ceph-mon[27902]: pgmap v17295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:30.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32260.728154 secs 2024-04-21T19:22:30.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32260.728154 secs 2024-04-21T19:22:30.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32260.728154 secs 2024-04-21T19:22:31.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:30 smithi191 ceph-mon[31636]: pgmap v17296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:31.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:30 smithi170 ceph-mon[31212]: pgmap v17296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:31.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:30 smithi077 ceph-mon[27902]: pgmap v17296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:32 smithi191 ceph-mon[31636]: pgmap v17297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:33.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32263.969576 secs 2024-04-21T19:22:33.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:32 smithi170 ceph-mon[31212]: pgmap v17297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:33.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32263.969576 secs 2024-04-21T19:22:33.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:32 smithi077 ceph-mon[27902]: pgmap v17297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:33.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32263.969576 secs 2024-04-21T19:22:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:35.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:34 smithi191 ceph-mon[31636]: pgmap v17298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:35.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32265.728264 secs 2024-04-21T19:22:35.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:34 smithi170 ceph-mon[31212]: pgmap v17298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:35.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32265.728264 secs 2024-04-21T19:22:35.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:34 smithi077 ceph-mon[27902]: pgmap v17298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:35.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32265.728264 secs 2024-04-21T19:22:37.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:36 smithi191 ceph-mon[31636]: pgmap v17299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:37.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:36 smithi170 ceph-mon[31212]: pgmap v17299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:37.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:36 smithi077 ceph-mon[27902]: pgmap v17299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:38.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32268.969699 secs 2024-04-21T19:22:38.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32268.969699 secs 2024-04-21T19:22:38.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32268.969699 secs 2024-04-21T19:22:39.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:38 smithi191 ceph-mon[31636]: pgmap v17300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:39.281 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:38 smithi170 ceph-mon[31212]: pgmap v17300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:39.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:38 smithi077 ceph-mon[27902]: pgmap v17300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32270.728341 secs 2024-04-21T19:22:40.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32270.728341 secs 2024-04-21T19:22:40.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32270.728341 secs 2024-04-21T19:22:41.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:40 smithi191 ceph-mon[31636]: pgmap v17301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:41.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:40 smithi170 ceph-mon[31212]: pgmap v17301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:41.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:40 smithi077 ceph-mon[27902]: pgmap v17301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:43.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:42 smithi170 ceph-mon[31212]: pgmap v17302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:43.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32273.969819 secs 2024-04-21T19:22:43.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:42 smithi077 ceph-mon[27902]: pgmap v17302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:43.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32273.969819 secs 2024-04-21T19:22:43.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:42 smithi191 ceph-mon[31636]: pgmap v17302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:43.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32273.969819 secs 2024-04-21T19:22:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:45.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:44 smithi170 ceph-mon[31212]: pgmap v17303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32275.728418 secs 2024-04-21T19:22:45.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:44 smithi077 ceph-mon[27902]: pgmap v17303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:45.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32275.728418 secs 2024-04-21T19:22:45.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:44 smithi191 ceph-mon[31636]: pgmap v17303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:45.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32275.728418 secs 2024-04-21T19:22:47.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:46 smithi170 ceph-mon[31212]: pgmap v17304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:47.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:46 smithi077 ceph-mon[27902]: pgmap v17304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:47.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:46 smithi191 ceph-mon[31636]: pgmap v17304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:48.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32278.969938 secs 2024-04-21T19:22:48.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32278.969938 secs 2024-04-21T19:22:48.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32278.969938 secs 2024-04-21T19:22:49.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:48 smithi170 ceph-mon[31212]: pgmap v17305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:49.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:48 smithi077 ceph-mon[27902]: pgmap v17305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:49.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:48 smithi191 ceph-mon[31636]: pgmap v17305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:50.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32280.728556 secs 2024-04-21T19:22:50.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32280.728556 secs 2024-04-21T19:22:50.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32280.728556 secs 2024-04-21T19:22:51.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:50 smithi170 ceph-mon[31212]: pgmap v17306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:51.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:50 smithi077 ceph-mon[27902]: pgmap v17306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:51.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:50 smithi191 ceph-mon[31636]: pgmap v17306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:53.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:52 smithi170 ceph-mon[31212]: pgmap v17307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:53.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32283.970079 secs 2024-04-21T19:22:53.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:52 smithi077 ceph-mon[27902]: pgmap v17307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:53.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32283.970079 secs 2024-04-21T19:22:53.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:52 smithi191 ceph-mon[31636]: pgmap v17307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:53.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32283.970079 secs 2024-04-21T19:22:55.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:22:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:54 smithi170 ceph-mon[31212]: pgmap v17308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32285.728689 secs 2024-04-21T19:22:55.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:54 smithi077 ceph-mon[27902]: pgmap v17308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:55.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32285.728689 secs 2024-04-21T19:22:55.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:54 smithi191 ceph-mon[31636]: pgmap v17308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:55.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32285.728689 secs 2024-04-21T19:22:57.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:57 smithi170 ceph-mon[31212]: pgmap v17309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:57.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:57 smithi077 ceph-mon[27902]: pgmap v17309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:57.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:57 smithi191 ceph-mon[31636]: pgmap v17309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:22:58.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32288.970206 secs 2024-04-21T19:22:58.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32288.970206 secs 2024-04-21T19:22:58.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32288.970206 secs 2024-04-21T19:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:22:58.820+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:22:58.820+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:22:58.821+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:22:58.821+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:22:59.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:59 smithi170 ceph-mon[31212]: pgmap v17310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:59.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32290.728820 secs 2024-04-21T19:22:59.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:59 smithi077 ceph-mon[27902]: pgmap v17310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:59.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32290.728820 secs 2024-04-21T19:22:59.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:59 smithi191 ceph-mon[31636]: pgmap v17310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:22:59.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32290.728820 secs 2024-04-21T19:23:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:01.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:01 smithi170 ceph-mon[31212]: pgmap v17311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:01.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:01 smithi077 ceph-mon[27902]: pgmap v17311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:01.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:01 smithi191 ceph-mon[31636]: pgmap v17311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:03.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:03 smithi170 ceph-mon[31212]: pgmap v17312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:03.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32293.970348 secs 2024-04-21T19:23:03.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:03 smithi077 ceph-mon[27902]: pgmap v17312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:03.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32293.970348 secs 2024-04-21T19:23:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:03 smithi191 ceph-mon[31636]: pgmap v17312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:03.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32293.970348 secs 2024-04-21T19:23:04.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32295.728934 secs 2024-04-21T19:23:04.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32295.728934 secs 2024-04-21T19:23:04.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32295.728934 secs 2024-04-21T19:23:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:05 smithi170 ceph-mon[31212]: pgmap v17313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:05 smithi170 ceph-mon[31212]: osdmap e1154: 12 total, 12 up, 12 in 2024-04-21T19:23:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:05 smithi077 ceph-mon[27902]: pgmap v17313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:05 smithi077 ceph-mon[27902]: osdmap e1154: 12 total, 12 up, 12 in 2024-04-21T19:23:05.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:05 smithi191 ceph-mon[31636]: pgmap v17313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:05.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:05 smithi191 ceph-mon[31636]: osdmap e1154: 12 total, 12 up, 12 in 2024-04-21T19:23:07.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:07 smithi170 ceph-mon[31212]: pgmap v17315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:23:07.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:07 smithi077 ceph-mon[27902]: pgmap v17315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:23:07.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:07 smithi191 ceph-mon[31636]: pgmap v17315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:23:08.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32298.970496 secs 2024-04-21T19:23:08.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32298.970496 secs 2024-04-21T19:23:08.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32298.970496 secs 2024-04-21T19:23:09.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:09 smithi077 ceph-mon[27902]: pgmap v17316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:23:09.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:23:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:09 smithi077 ceph-mon[27902]: osdmap e1155: 12 total, 12 up, 12 in 2024-04-21T19:23:09.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32300.729003 secs 2024-04-21T19:23:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:09 smithi170 ceph-mon[31212]: pgmap v17316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:23:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:23:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:09 smithi170 ceph-mon[31212]: osdmap e1155: 12 total, 12 up, 12 in 2024-04-21T19:23:09.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32300.729003 secs 2024-04-21T19:23:09.281 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:09 smithi191 ceph-mon[31636]: pgmap v17316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:23:09.281 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:23:09.281 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:09 smithi191 ceph-mon[31636]: osdmap e1155: 12 total, 12 up, 12 in 2024-04-21T19:23:09.281 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32300.729003 secs 2024-04-21T19:23:10.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: pgmap v17318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:23:11.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: pgmap v17318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:23:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:23:11.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:23:11.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: pgmap v17318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:23:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:23:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:23:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:23:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:23:12.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:11 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:23:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:11 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:23:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:11 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:23:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:11 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:23:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:11 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:23:12.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:11 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:23:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:11 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:23:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:11 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:23:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:11 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:23:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:11 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:23:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:11 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:23:12.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:11 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:23:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:11 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:23:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:11 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:23:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:11 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:23:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:11 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:23:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:11 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:23:12.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:11 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:23:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:12 smithi170 ceph-mon[31212]: pgmap v17319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:23:13.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32303.970617 secs 2024-04-21T19:23:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:12 smithi077 ceph-mon[27902]: pgmap v17319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:23:13.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32303.970617 secs 2024-04-21T19:23:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:12 smithi191 ceph-mon[31636]: pgmap v17319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:23:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32303.970617 secs 2024-04-21T19:23:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:14 smithi170 ceph-mon[31212]: pgmap v17320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:23:15.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32305.729116 secs 2024-04-21T19:23:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:14 smithi077 ceph-mon[27902]: pgmap v17320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:23:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32305.729116 secs 2024-04-21T19:23:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:14 smithi191 ceph-mon[31636]: pgmap v17320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:23:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32305.729116 secs 2024-04-21T19:23:17.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:16 smithi170 ceph-mon[31212]: pgmap v17321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:23:17.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:16 smithi077 ceph-mon[27902]: pgmap v17321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:23:17.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:16 smithi191 ceph-mon[31636]: pgmap v17321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:23:18.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32308.970738 secs 2024-04-21T19:23:18.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32308.970738 secs 2024-04-21T19:23:18.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32308.970738 secs 2024-04-21T19:23:19.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:18 smithi170 ceph-mon[31212]: pgmap v17322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:23:19.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:18 smithi077 ceph-mon[27902]: pgmap v17322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:23:19.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:18 smithi191 ceph-mon[31636]: pgmap v17322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:23:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:20.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32310.729230 secs 2024-04-21T19:23:20.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32310.729230 secs 2024-04-21T19:23:20.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32310.729230 secs 2024-04-21T19:23:21.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:20 smithi077 ceph-mon[27902]: pgmap v17323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:23:21.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:20 smithi191 ceph-mon[31636]: pgmap v17323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:23:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:20 smithi170 ceph-mon[31212]: pgmap v17323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:23:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:22 smithi077 ceph-mon[27902]: pgmap v17324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:23:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32313.970851 secs 2024-04-21T19:23:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:22 smithi191 ceph-mon[31636]: pgmap v17324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:23:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32313.970851 secs 2024-04-21T19:23:23.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:22 smithi170 ceph-mon[31212]: pgmap v17324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:23:23.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32313.970851 secs 2024-04-21T19:23:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:24 smithi077 ceph-mon[27902]: pgmap v17325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32315.729340 secs 2024-04-21T19:23:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:24 smithi191 ceph-mon[31636]: pgmap v17325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32315.729340 secs 2024-04-21T19:23:25.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:24 smithi170 ceph-mon[31212]: pgmap v17325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:25.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32315.729340 secs 2024-04-21T19:23:27.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:26 smithi077 ceph-mon[27902]: pgmap v17326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:27.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:26 smithi191 ceph-mon[31636]: pgmap v17326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:27.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:26 smithi170 ceph-mon[31212]: pgmap v17326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:28.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32318.970971 secs 2024-04-21T19:23:28.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32318.970971 secs 2024-04-21T19:23:28.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32318.970971 secs 2024-04-21T19:23:29.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:28 smithi077 ceph-mon[27902]: pgmap v17327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:29.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:28 smithi191 ceph-mon[31636]: pgmap v17327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:29.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:28 smithi170 ceph-mon[31212]: pgmap v17327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:30.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:30.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32320.729457 secs 2024-04-21T19:23:30.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32320.729457 secs 2024-04-21T19:23:30.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32320.729457 secs 2024-04-21T19:23:31.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:30 smithi077 ceph-mon[27902]: pgmap v17328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:31.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:30 smithi191 ceph-mon[31636]: pgmap v17328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:31.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:30 smithi170 ceph-mon[31212]: pgmap v17328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:32 smithi077 ceph-mon[27902]: pgmap v17329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32323.971091 secs 2024-04-21T19:23:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:32 smithi191 ceph-mon[31636]: pgmap v17329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32323.971091 secs 2024-04-21T19:23:33.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:32 smithi170 ceph-mon[31212]: pgmap v17329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:33.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32323.971091 secs 2024-04-21T19:23:35.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:35.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:34 smithi077 ceph-mon[27902]: pgmap v17330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:35.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32325.729572 secs 2024-04-21T19:23:35.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:34 smithi191 ceph-mon[31636]: pgmap v17330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:35.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32325.729572 secs 2024-04-21T19:23:35.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:34 smithi170 ceph-mon[31212]: pgmap v17330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:35.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32325.729572 secs 2024-04-21T19:23:37.082 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:36 smithi170 ceph-mon[31212]: pgmap v17331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:37.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:36 smithi077 ceph-mon[27902]: pgmap v17331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:37.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:36 smithi191 ceph-mon[31636]: pgmap v17331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:38.092 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32328.971227 secs 2024-04-21T19:23:38.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32328.971227 secs 2024-04-21T19:23:38.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32328.971227 secs 2024-04-21T19:23:39.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:38 smithi077 ceph-mon[27902]: pgmap v17332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:39.108 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:38 smithi191 ceph-mon[31636]: pgmap v17332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:39.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:38 smithi170 ceph-mon[31212]: pgmap v17332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:40.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32330.729669 secs 2024-04-21T19:23:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32330.729669 secs 2024-04-21T19:23:40.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32330.729669 secs 2024-04-21T19:23:41.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:40 smithi077 ceph-mon[27902]: pgmap v17333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:41.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:40 smithi191 ceph-mon[31636]: pgmap v17333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:41.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:40 smithi170 ceph-mon[31212]: pgmap v17333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:42 smithi077 ceph-mon[27902]: pgmap v17334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32333.971341 secs 2024-04-21T19:23:43.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:42 smithi191 ceph-mon[31636]: pgmap v17334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:43.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32333.971341 secs 2024-04-21T19:23:43.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:42 smithi170 ceph-mon[31212]: pgmap v17334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:43.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32333.971341 secs 2024-04-21T19:23:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:44 smithi077 ceph-mon[27902]: pgmap v17335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32335.729765 secs 2024-04-21T19:23:45.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:44 smithi191 ceph-mon[31636]: pgmap v17335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:45.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32335.729765 secs 2024-04-21T19:23:45.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:44 smithi170 ceph-mon[31212]: pgmap v17335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:45.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32335.729765 secs 2024-04-21T19:23:47.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:46 smithi077 ceph-mon[27902]: pgmap v17336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:47.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:46 smithi191 ceph-mon[31636]: pgmap v17336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:47.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:46 smithi170 ceph-mon[31212]: pgmap v17336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:48.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32338.971456 secs 2024-04-21T19:23:48.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32338.971456 secs 2024-04-21T19:23:48.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32338.971456 secs 2024-04-21T19:23:49.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:48 smithi077 ceph-mon[27902]: pgmap v17337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:49.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:48 smithi191 ceph-mon[31636]: pgmap v17337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:49.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:48 smithi170 ceph-mon[31212]: pgmap v17337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:50.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32340.729881 secs 2024-04-21T19:23:50.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32340.729881 secs 2024-04-21T19:23:50.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32340.729881 secs 2024-04-21T19:23:51.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:50 smithi191 ceph-mon[31636]: pgmap v17338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:51.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:50 smithi170 ceph-mon[31212]: pgmap v17338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:51.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:50 smithi077 ceph-mon[27902]: pgmap v17338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:53.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:52 smithi191 ceph-mon[31636]: pgmap v17339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:53.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32343.971576 secs 2024-04-21T19:23:53.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:52 smithi170 ceph-mon[31212]: pgmap v17339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:53.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32343.971576 secs 2024-04-21T19:23:53.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:52 smithi077 ceph-mon[27902]: pgmap v17339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:53.359 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32343.971576 secs 2024-04-21T19:23:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:23:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:54 smithi191 ceph-mon[31636]: pgmap v17340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32345.729989 secs 2024-04-21T19:23:55.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:54 smithi170 ceph-mon[31212]: pgmap v17340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32345.729989 secs 2024-04-21T19:23:55.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:54 smithi077 ceph-mon[27902]: pgmap v17340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:55.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32345.729989 secs 2024-04-21T19:23:57.161 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:56 smithi077 ceph-mon[27902]: pgmap v17341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:57.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:56 smithi191 ceph-mon[31636]: pgmap v17341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:57.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:56 smithi170 ceph-mon[31212]: pgmap v17341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:23:58.177 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32348.971693 secs 2024-04-21T19:23:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32348.971693 secs 2024-04-21T19:23:58.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32348.971693 secs 2024-04-21T19:23:59.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:58 smithi191 ceph-mon[31636]: pgmap v17342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:59.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:58 smithi170 ceph-mon[31212]: pgmap v17342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:23:59.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:58 smithi077 ceph-mon[27902]: pgmap v17342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:00.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32350.730069 secs 2024-04-21T19:24:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32350.730069 secs 2024-04-21T19:24:00.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32350.730069 secs 2024-04-21T19:24:01.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:00 smithi191 ceph-mon[31636]: pgmap v17343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:01.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:00 smithi170 ceph-mon[31212]: pgmap v17343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:01.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:00 smithi077 ceph-mon[27902]: pgmap v17343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:03.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:02 smithi191 ceph-mon[31636]: pgmap v17344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:03.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32353.971805 secs 2024-04-21T19:24:03.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:02 smithi170 ceph-mon[31212]: pgmap v17344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:03.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32353.971805 secs 2024-04-21T19:24:03.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:02 smithi077 ceph-mon[27902]: pgmap v17344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:03.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32353.971805 secs 2024-04-21T19:24:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:04 smithi191 ceph-mon[31636]: pgmap v17345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32355.730146 secs 2024-04-21T19:24:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:04 smithi191 ceph-mon[31636]: osdmap e1156: 12 total, 12 up, 12 in 2024-04-21T19:24:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:04 smithi170 ceph-mon[31212]: pgmap v17345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32355.730146 secs 2024-04-21T19:24:05.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:04 smithi170 ceph-mon[31212]: osdmap e1156: 12 total, 12 up, 12 in 2024-04-21T19:24:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:04 smithi077 ceph-mon[27902]: pgmap v17345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32355.730146 secs 2024-04-21T19:24:05.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:04 smithi077 ceph-mon[27902]: osdmap e1156: 12 total, 12 up, 12 in 2024-04-21T19:24:07.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:06 smithi191 ceph-mon[31636]: pgmap v17347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:24:07.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:06 smithi170 ceph-mon[31212]: pgmap v17347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:24:07.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:06 smithi077 ceph-mon[27902]: pgmap v17347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:24:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32358.971939 secs 2024-04-21T19:24:08.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32358.971939 secs 2024-04-21T19:24:08.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32358.971939 secs 2024-04-21T19:24:09.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:08 smithi191 ceph-mon[31636]: pgmap v17348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:24:09.269 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:08 smithi191 ceph-mon[31636]: osdmap e1157: 12 total, 12 up, 12 in 2024-04-21T19:24:09.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:08 smithi170 ceph-mon[31212]: pgmap v17348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:24:09.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:08 smithi170 ceph-mon[31212]: osdmap e1157: 12 total, 12 up, 12 in 2024-04-21T19:24:09.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:08 smithi077 ceph-mon[27902]: pgmap v17348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:24:09.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:08 smithi077 ceph-mon[27902]: osdmap e1157: 12 total, 12 up, 12 in 2024-04-21T19:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32360.730261 secs 2024-04-21T19:24:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32360.730261 secs 2024-04-21T19:24:10.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32360.730261 secs 2024-04-21T19:24:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:10 smithi191 ceph-mon[31636]: pgmap v17350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:24:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:24:11.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:10 smithi170 ceph-mon[31212]: pgmap v17350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:24:11.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:24:11.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:10 smithi077 ceph-mon[27902]: pgmap v17350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:24:11.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:24:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:12 smithi170 ceph-mon[31212]: pgmap v17351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:24:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:24:12.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:24:12.530 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:12 smithi077 ceph-mon[27902]: pgmap v17351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:24:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:24:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:24:12.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:12 smithi191 ceph-mon[31636]: pgmap v17351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:24:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:24:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:24:12.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:24:13.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32363.972004 secs 2024-04-21T19:24:13.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32363.972004 secs 2024-04-21T19:24:13.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32363.972004 secs 2024-04-21T19:24:14.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:14 smithi170 ceph-mon[31212]: pgmap v17352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:24:14.529 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32365.730377 secs 2024-04-21T19:24:14.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:14 smithi077 ceph-mon[27902]: pgmap v17352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:24:14.608 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32365.730377 secs 2024-04-21T19:24:14.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:14 smithi191 ceph-mon[31636]: pgmap v17352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:24:14.691 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32365.730377 secs 2024-04-21T19:24:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:16.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:16 smithi077 ceph-mon[27902]: pgmap v17353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:24:16.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:16 smithi191 ceph-mon[31636]: pgmap v17353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:24:17.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:16 smithi170 ceph-mon[31212]: pgmap v17353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:24:17.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32368.972127 secs 2024-04-21T19:24:17.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32368.972127 secs 2024-04-21T19:24:18.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32368.972127 secs 2024-04-21T19:24:18.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:18 smithi077 ceph-mon[27902]: pgmap v17354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:24:18.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:18 smithi191 ceph-mon[31636]: pgmap v17354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:24:19.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:18 smithi170 ceph-mon[31212]: pgmap v17354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:24:19.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32370.730479 secs 2024-04-21T19:24:19.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32370.730479 secs 2024-04-21T19:24:20.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32370.730479 secs 2024-04-21T19:24:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:20.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:20 smithi077 ceph-mon[27902]: pgmap v17355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:24:20.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:20 smithi191 ceph-mon[31636]: pgmap v17355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:24:21.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:20 smithi170 ceph-mon[31212]: pgmap v17355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:24:22.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:22 smithi077 ceph-mon[27902]: pgmap v17356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:24:22.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32373.972246 secs 2024-04-21T19:24:22.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:22 smithi191 ceph-mon[31636]: pgmap v17356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:24:22.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32373.972246 secs 2024-04-21T19:24:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:22 smithi170 ceph-mon[31212]: pgmap v17356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:24:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32373.972246 secs 2024-04-21T19:24:24.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:24 smithi077 ceph-mon[27902]: pgmap v17357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:24.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32375.730574 secs 2024-04-21T19:24:24.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:24 smithi191 ceph-mon[31636]: pgmap v17357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:24.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32375.730574 secs 2024-04-21T19:24:25.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:24 smithi170 ceph-mon[31212]: pgmap v17357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:25.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32375.730574 secs 2024-04-21T19:24:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:26.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:26 smithi077 ceph-mon[27902]: pgmap v17358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:26.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:26 smithi191 ceph-mon[31636]: pgmap v17358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:27.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:26 smithi170 ceph-mon[31212]: pgmap v17358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:27.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32378.972364 secs 2024-04-21T19:24:27.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32378.972364 secs 2024-04-21T19:24:28.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32378.972364 secs 2024-04-21T19:24:28.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:28 smithi077 ceph-mon[27902]: pgmap v17359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:28.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:28 smithi191 ceph-mon[31636]: pgmap v17359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:29.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:28 smithi170 ceph-mon[31212]: pgmap v17359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:29.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32380.730692 secs 2024-04-21T19:24:29.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32380.730692 secs 2024-04-21T19:24:30.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32380.730692 secs 2024-04-21T19:24:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:30.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:30 smithi077 ceph-mon[27902]: pgmap v17360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:30.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:30 smithi191 ceph-mon[31636]: pgmap v17360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:31.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:30 smithi170 ceph-mon[31212]: pgmap v17360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:32.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:32 smithi077 ceph-mon[27902]: pgmap v17361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:32.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32383.972429 secs 2024-04-21T19:24:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:32 smithi191 ceph-mon[31636]: pgmap v17361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32383.972429 secs 2024-04-21T19:24:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:32 smithi170 ceph-mon[31212]: pgmap v17361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32383.972429 secs 2024-04-21T19:24:34.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:34 smithi077 ceph-mon[27902]: pgmap v17362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:34.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32385.730786 secs 2024-04-21T19:24:34.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:34 smithi191 ceph-mon[31636]: pgmap v17362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:34.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32385.730786 secs 2024-04-21T19:24:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:34 smithi170 ceph-mon[31212]: pgmap v17362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32385.730786 secs 2024-04-21T19:24:35.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:36.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:36 smithi077 ceph-mon[27902]: pgmap v17363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:36.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:36 smithi191 ceph-mon[31636]: pgmap v17363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:37.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:36 smithi170 ceph-mon[31212]: pgmap v17363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:37.930 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32388.972535 secs 2024-04-21T19:24:37.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32388.972535 secs 2024-04-21T19:24:38.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32388.972535 secs 2024-04-21T19:24:38.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:38 smithi191 ceph-mon[31636]: pgmap v17364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:39.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:38 smithi170 ceph-mon[31212]: pgmap v17364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:39.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:38 smithi077 ceph-mon[27902]: pgmap v17364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:39.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32390.730910 secs 2024-04-21T19:24:40.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32390.730910 secs 2024-04-21T19:24:40.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:40.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32390.730910 secs 2024-04-21T19:24:40.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:40 smithi191 ceph-mon[31636]: pgmap v17365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:41.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:40 smithi170 ceph-mon[31212]: pgmap v17365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:41.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:40 smithi077 ceph-mon[27902]: pgmap v17365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:42.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:42 smithi191 ceph-mon[31636]: pgmap v17366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:42.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32393.972649 secs 2024-04-21T19:24:43.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:42 smithi170 ceph-mon[31212]: pgmap v17366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:43.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32393.972649 secs 2024-04-21T19:24:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:42 smithi077 ceph-mon[27902]: pgmap v17366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32393.972649 secs 2024-04-21T19:24:44.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:44 smithi191 ceph-mon[31636]: pgmap v17367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:44.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32395.731031 secs 2024-04-21T19:24:45.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:44 smithi170 ceph-mon[31212]: pgmap v17367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:45.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32395.731031 secs 2024-04-21T19:24:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:44 smithi077 ceph-mon[27902]: pgmap v17367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:45.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32395.731031 secs 2024-04-21T19:24:46.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:46 smithi191 ceph-mon[31636]: pgmap v17368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:47.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:46 smithi170 ceph-mon[31212]: pgmap v17368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:47.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:46 smithi077 ceph-mon[27902]: pgmap v17368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:47.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32398.972805 secs 2024-04-21T19:24:48.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32398.972805 secs 2024-04-21T19:24:48.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32398.972805 secs 2024-04-21T19:24:48.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:48 smithi191 ceph-mon[31636]: pgmap v17369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:49.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:48 smithi170 ceph-mon[31212]: pgmap v17369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:49.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:48 smithi077 ceph-mon[27902]: pgmap v17369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:49.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32400.731152 secs 2024-04-21T19:24:50.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32400.731152 secs 2024-04-21T19:24:50.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:50.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32400.731152 secs 2024-04-21T19:24:50.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:50 smithi191 ceph-mon[31636]: pgmap v17370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:51.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:50 smithi170 ceph-mon[31212]: pgmap v17370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:51.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:50 smithi077 ceph-mon[27902]: pgmap v17370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:52.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:52 smithi191 ceph-mon[31636]: pgmap v17371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:52.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32403.972924 secs 2024-04-21T19:24:53.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:52 smithi170 ceph-mon[31212]: pgmap v17371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:53.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32403.972924 secs 2024-04-21T19:24:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:52 smithi077 ceph-mon[27902]: pgmap v17371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32403.972924 secs 2024-04-21T19:24:54.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:54 smithi191 ceph-mon[31636]: pgmap v17372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:54.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32405.731222 secs 2024-04-21T19:24:55.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:54 smithi170 ceph-mon[31212]: pgmap v17372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:55.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32405.731222 secs 2024-04-21T19:24:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:24:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:54 smithi077 ceph-mon[27902]: pgmap v17372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:55.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32405.731222 secs 2024-04-21T19:24:56.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:56 smithi191 ceph-mon[31636]: pgmap v17373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:57.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:56 smithi170 ceph-mon[31212]: pgmap v17373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:57.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:56 smithi077 ceph-mon[27902]: pgmap v17373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:24:57.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32408.973047 secs 2024-04-21T19:24:58.009 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32408.973047 secs 2024-04-21T19:24:58.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32408.973047 secs 2024-04-21T19:24:58.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:58 smithi191 ceph-mon[31636]: pgmap v17374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:59.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:58 smithi170 ceph-mon[31212]: pgmap v17374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:59.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:58 smithi077 ceph-mon[27902]: pgmap v17374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:24:59.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32410.731339 secs 2024-04-21T19:25:00.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32410.731339 secs 2024-04-21T19:25:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:00.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32410.731339 secs 2024-04-21T19:25:00.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:00 smithi191 ceph-mon[31636]: pgmap v17375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:01.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:00 smithi170 ceph-mon[31212]: pgmap v17375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:01.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:00 smithi077 ceph-mon[27902]: pgmap v17375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:02.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:02 smithi191 ceph-mon[31636]: pgmap v17376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:02.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32413.973145 secs 2024-04-21T19:25:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:02 smithi170 ceph-mon[31212]: pgmap v17376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32413.973145 secs 2024-04-21T19:25:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:02 smithi077 ceph-mon[27902]: pgmap v17376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32413.973145 secs 2024-04-21T19:25:04.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:04 smithi191 ceph-mon[31636]: pgmap v17377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:04.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32415.731402 secs 2024-04-21T19:25:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:04 smithi170 ceph-mon[31212]: pgmap v17377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32415.731402 secs 2024-04-21T19:25:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:04 smithi077 ceph-mon[27902]: pgmap v17377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:05.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32415.731402 secs 2024-04-21T19:25:05.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:05 smithi191 ceph-mon[31636]: osdmap e1158: 12 total, 12 up, 12 in 2024-04-21T19:25:06.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:05 smithi170 ceph-mon[31212]: osdmap e1158: 12 total, 12 up, 12 in 2024-04-21T19:25:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:05 smithi077 ceph-mon[27902]: osdmap e1158: 12 total, 12 up, 12 in 2024-04-21T19:25:06.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:06 smithi191 ceph-mon[31636]: pgmap v17379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:07.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:06 smithi170 ceph-mon[31212]: pgmap v17379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:07.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:06 smithi077 ceph-mon[27902]: pgmap v17379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:08.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32418.973243 secs 2024-04-21T19:25:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32418.973243 secs 2024-04-21T19:25:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32418.973243 secs 2024-04-21T19:25:09.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:08 smithi170 ceph-mon[31212]: pgmap v17380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:09.092 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:08 smithi191 ceph-mon[31636]: pgmap v17380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:08 smithi077 ceph-mon[27902]: pgmap v17380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:10.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32420.731525 secs 2024-04-21T19:25:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32420.731525 secs 2024-04-21T19:25:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32420.731525 secs 2024-04-21T19:25:11.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:10 smithi170 ceph-mon[31212]: pgmap v17381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:11.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:10 smithi077 ceph-mon[27902]: pgmap v17381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:10 smithi191 ceph-mon[31636]: pgmap v17381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: pgmap v17382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32423.973336 secs 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: pgmap v17382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:25:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:25:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32423.973336 secs 2024-04-21T19:25:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: pgmap v17382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:25:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:25:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32423.973336 secs 2024-04-21T19:25:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:13.838+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:25:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:13.838+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:25:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:13.838+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:25:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:13.838+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:25:14.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:25:14.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:25:14.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:14.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:13 smithi170 ceph-mon[31212]: osdmap e1159: 12 total, 12 up, 12 in 2024-04-21T19:25:14.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:25:14.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:25:14.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:14.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:13 smithi077 ceph-mon[27902]: osdmap e1159: 12 total, 12 up, 12 in 2024-04-21T19:25:14.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:25:14.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:25:14.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:25:14.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:13 smithi191 ceph-mon[31636]: osdmap e1159: 12 total, 12 up, 12 in 2024-04-21T19:25:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:14 smithi170 ceph-mon[31212]: pgmap v17383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:25:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32425.731680 secs 2024-04-21T19:25:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:14 smithi077 ceph-mon[27902]: pgmap v17383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:25:15.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32425.731680 secs 2024-04-21T19:25:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:14 smithi191 ceph-mon[31636]: pgmap v17383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:25:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32425.731680 secs 2024-04-21T19:25:17.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:16 smithi170 ceph-mon[31212]: pgmap v17385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:17.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:16 smithi077 ceph-mon[27902]: pgmap v17385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:17.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:16 smithi191 ceph-mon[31636]: pgmap v17385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:18.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32428.973479 secs 2024-04-21T19:25:18.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32428.973479 secs 2024-04-21T19:25:18.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32428.973479 secs 2024-04-21T19:25:19.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:18 smithi170 ceph-mon[31212]: pgmap v17386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:19.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:18 smithi077 ceph-mon[27902]: pgmap v17386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:19.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:18 smithi191 ceph-mon[31636]: pgmap v17386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:20.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32430.731796 secs 2024-04-21T19:25:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:20.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32430.731796 secs 2024-04-21T19:25:20.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32430.731796 secs 2024-04-21T19:25:21.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:20 smithi170 ceph-mon[31212]: pgmap v17387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:21.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:20 smithi077 ceph-mon[27902]: pgmap v17387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:21.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:20 smithi191 ceph-mon[31636]: pgmap v17387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:25:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:22 smithi170 ceph-mon[31212]: pgmap v17388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:25:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32433.973551 secs 2024-04-21T19:25:23.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:22 smithi077 ceph-mon[27902]: pgmap v17388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:25:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32433.973551 secs 2024-04-21T19:25:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:22 smithi191 ceph-mon[31636]: pgmap v17388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:25:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32433.973551 secs 2024-04-21T19:25:25.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:24 smithi170 ceph-mon[31212]: pgmap v17389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:25:25.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32435.731918 secs 2024-04-21T19:25:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:24 smithi077 ceph-mon[27902]: pgmap v17389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:25:25.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32435.731918 secs 2024-04-21T19:25:25.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:24 smithi191 ceph-mon[31636]: pgmap v17389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:25:25.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32435.731918 secs 2024-04-21T19:25:27.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:26 smithi170 ceph-mon[31212]: pgmap v17390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:27.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:26 smithi077 ceph-mon[27902]: pgmap v17390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:26 smithi191 ceph-mon[31636]: pgmap v17390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:28.008 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32438.973689 secs 2024-04-21T19:25:28.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32438.973689 secs 2024-04-21T19:25:28.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32438.973689 secs 2024-04-21T19:25:29.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:28 smithi170 ceph-mon[31212]: pgmap v17391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:29.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:28 smithi077 ceph-mon[27902]: pgmap v17391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:29.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:28 smithi191 ceph-mon[31636]: pgmap v17391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:30.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32440.732015 secs 2024-04-21T19:25:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:30.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32440.732015 secs 2024-04-21T19:25:30.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32440.732015 secs 2024-04-21T19:25:31.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:30 smithi170 ceph-mon[31212]: pgmap v17392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:31.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:30 smithi077 ceph-mon[27902]: pgmap v17392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:31.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:30 smithi191 ceph-mon[31636]: pgmap v17392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:32 smithi170 ceph-mon[31212]: pgmap v17393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32443.973828 secs 2024-04-21T19:25:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:32 smithi077 ceph-mon[27902]: pgmap v17393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32443.973828 secs 2024-04-21T19:25:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:32 smithi191 ceph-mon[31636]: pgmap v17393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32443.973828 secs 2024-04-21T19:25:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:34 smithi170 ceph-mon[31212]: pgmap v17394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32445.732088 secs 2024-04-21T19:25:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:34 smithi077 ceph-mon[27902]: pgmap v17394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32445.732088 secs 2024-04-21T19:25:35.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:34 smithi191 ceph-mon[31636]: pgmap v17394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:35.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32445.732088 secs 2024-04-21T19:25:37.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:36 smithi170 ceph-mon[31212]: pgmap v17395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:37.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:36 smithi077 ceph-mon[27902]: pgmap v17395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:37.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:36 smithi191 ceph-mon[31636]: pgmap v17395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:38.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32448.973948 secs 2024-04-21T19:25:38.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32448.973948 secs 2024-04-21T19:25:38.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32448.973948 secs 2024-04-21T19:25:39.092 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:38 smithi191 ceph-mon[31636]: pgmap v17396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:39.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:38 smithi077 ceph-mon[27902]: pgmap v17396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:39.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:38 smithi170 ceph-mon[31212]: pgmap v17396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:40.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32450.732211 secs 2024-04-21T19:25:40.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32450.732211 secs 2024-04-21T19:25:40.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32450.732211 secs 2024-04-21T19:25:41.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:40 smithi077 ceph-mon[27902]: pgmap v17397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:41.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:40 smithi191 ceph-mon[31636]: pgmap v17397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:41.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:40 smithi170 ceph-mon[31212]: pgmap v17397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:42 smithi077 ceph-mon[27902]: pgmap v17398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:43.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32453.974092 secs 2024-04-21T19:25:43.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:42 smithi191 ceph-mon[31636]: pgmap v17398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:43.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32453.974092 secs 2024-04-21T19:25:43.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:42 smithi170 ceph-mon[31212]: pgmap v17398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:43.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32453.974092 secs 2024-04-21T19:25:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:44 smithi077 ceph-mon[27902]: pgmap v17399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32455.732325 secs 2024-04-21T19:25:45.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:44 smithi191 ceph-mon[31636]: pgmap v17399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:45.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32455.732325 secs 2024-04-21T19:25:45.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:44 smithi170 ceph-mon[31212]: pgmap v17399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:45.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32455.732325 secs 2024-04-21T19:25:47.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:46 smithi077 ceph-mon[27902]: pgmap v17400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:47.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:46 smithi191 ceph-mon[31636]: pgmap v17400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:47.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:46 smithi170 ceph-mon[31212]: pgmap v17400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:48.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32458.974159 secs 2024-04-21T19:25:48.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32458.974159 secs 2024-04-21T19:25:48.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32458.974159 secs 2024-04-21T19:25:49.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:48 smithi077 ceph-mon[27902]: pgmap v17401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:49.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:48 smithi191 ceph-mon[31636]: pgmap v17401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:49.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:48 smithi170 ceph-mon[31212]: pgmap v17401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:50.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:50.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32460.732441 secs 2024-04-21T19:25:50.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32460.732441 secs 2024-04-21T19:25:50.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32460.732441 secs 2024-04-21T19:25:51.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:50 smithi077 ceph-mon[27902]: pgmap v17402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:51.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:50 smithi191 ceph-mon[31636]: pgmap v17402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:51.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:50 smithi170 ceph-mon[31212]: pgmap v17402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:53.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:52 smithi077 ceph-mon[27902]: pgmap v17403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:53.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32463.974311 secs 2024-04-21T19:25:53.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:52 smithi191 ceph-mon[31636]: pgmap v17403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:53.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32463.974311 secs 2024-04-21T19:25:53.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:52 smithi170 ceph-mon[31212]: pgmap v17403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:53.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32463.974311 secs 2024-04-21T19:25:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:25:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:54 smithi077 ceph-mon[27902]: pgmap v17404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32465.732554 secs 2024-04-21T19:25:55.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:54 smithi191 ceph-mon[31636]: pgmap v17404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:55.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32465.732554 secs 2024-04-21T19:25:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:54 smithi170 ceph-mon[31212]: pgmap v17404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:55.280 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32465.732554 secs 2024-04-21T19:25:57.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:56 smithi077 ceph-mon[27902]: pgmap v17405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:57.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:56 smithi191 ceph-mon[31636]: pgmap v17405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:57.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:56 smithi170 ceph-mon[31212]: pgmap v17405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:25:58.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32468.974373 secs 2024-04-21T19:25:58.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32468.974373 secs 2024-04-21T19:25:58.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32468.974373 secs 2024-04-21T19:25:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:58.844+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:25:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:58.844+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:25:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:58.845+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:25:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:25:58.845+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:25:59.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:58 smithi077 ceph-mon[27902]: pgmap v17406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:59.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:58 smithi191 ceph-mon[31636]: pgmap v17406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:25:59.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:58 smithi170 ceph-mon[31212]: pgmap v17406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:00.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32470.732618 secs 2024-04-21T19:26:00.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32470.732618 secs 2024-04-21T19:26:00.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32470.732618 secs 2024-04-21T19:26:01.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:00 smithi077 ceph-mon[27902]: pgmap v17407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:01.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:00 smithi191 ceph-mon[31636]: pgmap v17407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:01.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:00 smithi170 ceph-mon[31212]: pgmap v17407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:02 smithi077 ceph-mon[27902]: pgmap v17408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:03.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32473.974493 secs 2024-04-21T19:26:03.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:02 smithi191 ceph-mon[31636]: pgmap v17408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:03.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32473.974493 secs 2024-04-21T19:26:03.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:02 smithi170 ceph-mon[31212]: pgmap v17408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:03.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32473.974493 secs 2024-04-21T19:26:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:04 smithi077 ceph-mon[27902]: pgmap v17409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32475.732706 secs 2024-04-21T19:26:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:04 smithi077 ceph-mon[27902]: osdmap e1160: 12 total, 12 up, 12 in 2024-04-21T19:26:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:04 smithi191 ceph-mon[31636]: pgmap v17409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32475.732706 secs 2024-04-21T19:26:05.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:04 smithi191 ceph-mon[31636]: osdmap e1160: 12 total, 12 up, 12 in 2024-04-21T19:26:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:04 smithi170 ceph-mon[31212]: pgmap v17409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32475.732706 secs 2024-04-21T19:26:05.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:04 smithi170 ceph-mon[31212]: osdmap e1160: 12 total, 12 up, 12 in 2024-04-21T19:26:07.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:06 smithi077 ceph-mon[27902]: pgmap v17411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:26:07.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:06 smithi191 ceph-mon[31636]: pgmap v17411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:26:07.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:06 smithi170 ceph-mon[31212]: pgmap v17411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:26:08.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32478.974613 secs 2024-04-21T19:26:08.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32478.974613 secs 2024-04-21T19:26:08.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32478.974613 secs 2024-04-21T19:26:09.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:08 smithi191 ceph-mon[31636]: pgmap v17412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:26:09.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:08 smithi191 ceph-mon[31636]: osdmap e1161: 12 total, 12 up, 12 in 2024-04-21T19:26:09.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:08 smithi170 ceph-mon[31212]: pgmap v17412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:26:09.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:08 smithi170 ceph-mon[31212]: osdmap e1161: 12 total, 12 up, 12 in 2024-04-21T19:26:09.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:08 smithi077 ceph-mon[27902]: pgmap v17412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:26:09.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:08 smithi077 ceph-mon[27902]: osdmap e1161: 12 total, 12 up, 12 in 2024-04-21T19:26:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:10.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32480.732772 secs 2024-04-21T19:26:10.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32480.732772 secs 2024-04-21T19:26:10.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32480.732772 secs 2024-04-21T19:26:11.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:10 smithi191 ceph-mon[31636]: pgmap v17414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:26:11.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:10 smithi170 ceph-mon[31212]: pgmap v17414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:26:11.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:10 smithi077 ceph-mon[27902]: pgmap v17414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:26:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:12 smithi191 ceph-mon[31636]: pgmap v17415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:26:13.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32483.974751 secs 2024-04-21T19:26:13.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:12 smithi170 ceph-mon[31212]: pgmap v17415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:26:13.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32483.974751 secs 2024-04-21T19:26:13.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:12 smithi077 ceph-mon[27902]: pgmap v17415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:26:13.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32483.974751 secs 2024-04-21T19:26:14.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:26:14.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:26:14.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:26:15.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:15.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:14 smithi191 ceph-mon[31636]: pgmap v17416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:26:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32485.732889 secs 2024-04-21T19:26:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:26:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:26:15.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:26:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:14 smithi170 ceph-mon[31212]: pgmap v17416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:26:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32485.732889 secs 2024-04-21T19:26:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:26:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:26:15.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:26:15.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:14 smithi077 ceph-mon[27902]: pgmap v17416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:26:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32485.732889 secs 2024-04-21T19:26:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:26:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:26:15.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:26:17.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:16 smithi191 ceph-mon[31636]: pgmap v17417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:26:17.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:16 smithi170 ceph-mon[31212]: pgmap v17417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:26:17.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:16 smithi077 ceph-mon[27902]: pgmap v17417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:26:18.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32488.974867 secs 2024-04-21T19:26:18.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32488.974867 secs 2024-04-21T19:26:18.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32488.974867 secs 2024-04-21T19:26:19.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:18 smithi191 ceph-mon[31636]: pgmap v17418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:26:19.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:18 smithi170 ceph-mon[31212]: pgmap v17418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:26:19.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:18 smithi077 ceph-mon[27902]: pgmap v17418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:26:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:20.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32490.733004 secs 2024-04-21T19:26:20.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32490.733004 secs 2024-04-21T19:26:20.358 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32490.733004 secs 2024-04-21T19:26:21.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:20 smithi191 ceph-mon[31636]: pgmap v17419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:26:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:20 smithi170 ceph-mon[31212]: pgmap v17419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:26:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:20 smithi077 ceph-mon[27902]: pgmap v17419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:26:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:22 smithi191 ceph-mon[31636]: pgmap v17420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:26:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32493.974933 secs 2024-04-21T19:26:23.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:22 smithi170 ceph-mon[31212]: pgmap v17420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:26:23.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32493.974933 secs 2024-04-21T19:26:23.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:22 smithi077 ceph-mon[27902]: pgmap v17420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:26:23.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32493.974933 secs 2024-04-21T19:26:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:25.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:24 smithi191 ceph-mon[31636]: pgmap v17421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:25.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32495.733098 secs 2024-04-21T19:26:25.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:24 smithi170 ceph-mon[31212]: pgmap v17421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:25.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32495.733098 secs 2024-04-21T19:26:25.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:24 smithi077 ceph-mon[27902]: pgmap v17421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:25.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32495.733098 secs 2024-04-21T19:26:27.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:26 smithi191 ceph-mon[31636]: pgmap v17422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:27.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:26 smithi170 ceph-mon[31212]: pgmap v17422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:27.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:26 smithi077 ceph-mon[27902]: pgmap v17422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:28.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32498.975039 secs 2024-04-21T19:26:28.259 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32498.975039 secs 2024-04-21T19:26:28.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32498.975039 secs 2024-04-21T19:26:29.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:28 smithi191 ceph-mon[31636]: pgmap v17423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:29.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:28 smithi170 ceph-mon[31212]: pgmap v17423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:29.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:28 smithi077 ceph-mon[27902]: pgmap v17423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:30.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:30.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32500.733236 secs 2024-04-21T19:26:30.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32500.733236 secs 2024-04-21T19:26:30.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32500.733236 secs 2024-04-21T19:26:31.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:30 smithi191 ceph-mon[31636]: pgmap v17424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:31.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:30 smithi170 ceph-mon[31212]: pgmap v17424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:31.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:30 smithi077 ceph-mon[27902]: pgmap v17424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:33.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:32 smithi191 ceph-mon[31636]: pgmap v17425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:33.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32503.975102 secs 2024-04-21T19:26:33.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:32 smithi170 ceph-mon[31212]: pgmap v17425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:33.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32503.975102 secs 2024-04-21T19:26:33.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:32 smithi077 ceph-mon[27902]: pgmap v17425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:33.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32503.975102 secs 2024-04-21T19:26:34.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:34 smithi077 ceph-mon[27902]: pgmap v17426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:34.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32505.733316 secs 2024-04-21T19:26:34.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:34 smithi191 ceph-mon[31636]: pgmap v17426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:34.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32505.733316 secs 2024-04-21T19:26:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:34 smithi170 ceph-mon[31212]: pgmap v17426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32505.733316 secs 2024-04-21T19:26:35.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:36.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:36 smithi077 ceph-mon[27902]: pgmap v17427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:36.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:36 smithi191 ceph-mon[31636]: pgmap v17427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:37.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:36 smithi170 ceph-mon[31212]: pgmap v17427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:37.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32508.975213 secs 2024-04-21T19:26:37.930 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32508.975213 secs 2024-04-21T19:26:37.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32508.975213 secs 2024-04-21T19:26:38.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:38 smithi077 ceph-mon[27902]: pgmap v17428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:38.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:38 smithi191 ceph-mon[31636]: pgmap v17428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:39.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:38 smithi170 ceph-mon[31212]: pgmap v17428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:39.842 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32510.733426 secs 2024-04-21T19:26:39.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32510.733426 secs 2024-04-21T19:26:40.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32510.733426 secs 2024-04-21T19:26:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:40.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:40 smithi077 ceph-mon[27902]: pgmap v17429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:40.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:40 smithi191 ceph-mon[31636]: pgmap v17429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:41.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:40 smithi170 ceph-mon[31212]: pgmap v17429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:42.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:42 smithi077 ceph-mon[27902]: pgmap v17430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:42.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32513.975326 secs 2024-04-21T19:26:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:42 smithi191 ceph-mon[31636]: pgmap v17430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32513.975326 secs 2024-04-21T19:26:43.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:42 smithi170 ceph-mon[31212]: pgmap v17430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:43.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32513.975326 secs 2024-04-21T19:26:44.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:44 smithi077 ceph-mon[27902]: pgmap v17431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:44.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32515.733550 secs 2024-04-21T19:26:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:44 smithi191 ceph-mon[31636]: pgmap v17431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32515.733550 secs 2024-04-21T19:26:45.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:44 smithi170 ceph-mon[31212]: pgmap v17431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:45.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32515.733550 secs 2024-04-21T19:26:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:46.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:46 smithi077 ceph-mon[27902]: pgmap v17432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:46 smithi191 ceph-mon[31636]: pgmap v17432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:47.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:46 smithi170 ceph-mon[31212]: pgmap v17432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:47.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32518.975448 secs 2024-04-21T19:26:47.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32518.975448 secs 2024-04-21T19:26:48.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32518.975448 secs 2024-04-21T19:26:48.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:48 smithi077 ceph-mon[27902]: pgmap v17433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:48.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:48 smithi191 ceph-mon[31636]: pgmap v17433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:49.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:48 smithi170 ceph-mon[31212]: pgmap v17433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:49.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32520.733647 secs 2024-04-21T19:26:49.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32520.733647 secs 2024-04-21T19:26:50.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32520.733647 secs 2024-04-21T19:26:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:50.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:50 smithi077 ceph-mon[27902]: pgmap v17434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:50.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:50 smithi191 ceph-mon[31636]: pgmap v17434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:51.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:50 smithi170 ceph-mon[31212]: pgmap v17434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:52.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:52 smithi077 ceph-mon[27902]: pgmap v17435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:52.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32523.975551 secs 2024-04-21T19:26:52.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:52 smithi191 ceph-mon[31636]: pgmap v17435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:52.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32523.975551 secs 2024-04-21T19:26:53.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:52 smithi170 ceph-mon[31212]: pgmap v17435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:53.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32523.975551 secs 2024-04-21T19:26:54.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:54 smithi077 ceph-mon[27902]: pgmap v17436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:54.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32525.733757 secs 2024-04-21T19:26:54.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:54 smithi191 ceph-mon[31636]: pgmap v17436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:54.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32525.733757 secs 2024-04-21T19:26:55.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:54 smithi170 ceph-mon[31212]: pgmap v17436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:26:55.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32525.733757 secs 2024-04-21T19:26:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:26:56.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:56 smithi077 ceph-mon[27902]: pgmap v17437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:56.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:56 smithi191 ceph-mon[31636]: pgmap v17437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:57.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:56 smithi170 ceph-mon[31212]: pgmap v17437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:26:57.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32528.975685 secs 2024-04-21T19:26:57.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32528.975685 secs 2024-04-21T19:26:58.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32528.975685 secs 2024-04-21T19:26:58.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:58 smithi077 ceph-mon[27902]: pgmap v17438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:26:58.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:58 smithi191 ceph-mon[31636]: pgmap v17438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:26:59.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:58 smithi170 ceph-mon[31212]: pgmap v17438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:26:59.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32530.733920 secs 2024-04-21T19:26:59.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32530.733920 secs 2024-04-21T19:27:00.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32530.733920 secs 2024-04-21T19:27:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:00.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:00 smithi077 ceph-mon[27902]: pgmap v17439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:00.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:00 smithi191 ceph-mon[31636]: pgmap v17439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:01.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:00 smithi170 ceph-mon[31212]: pgmap v17439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:02.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:02 smithi077 ceph-mon[27902]: pgmap v17440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T19:27:02.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32533.975799 secs 2024-04-21T19:27:02.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:02 smithi191 ceph-mon[31636]: pgmap v17440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T19:27:02.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32533.975799 secs 2024-04-21T19:27:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:02 smithi170 ceph-mon[31212]: pgmap v17440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T19:27:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32533.975799 secs 2024-04-21T19:27:04.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:04 smithi191 ceph-mon[31636]: pgmap v17441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T19:27:04.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32535.734036 secs 2024-04-21T19:27:05.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:04 smithi170 ceph-mon[31212]: pgmap v17441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T19:27:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32535.734036 secs 2024-04-21T19:27:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:04 smithi077 ceph-mon[27902]: pgmap v17441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T19:27:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32535.734036 secs 2024-04-21T19:27:05.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:05 smithi191 ceph-mon[31636]: osdmap e1162: 12 total, 12 up, 12 in 2024-04-21T19:27:06.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:05 smithi170 ceph-mon[31212]: osdmap e1162: 12 total, 12 up, 12 in 2024-04-21T19:27:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:05 smithi077 ceph-mon[27902]: osdmap e1162: 12 total, 12 up, 12 in 2024-04-21T19:27:06.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:06 smithi191 ceph-mon[31636]: pgmap v17443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:27:07.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:06 smithi170 ceph-mon[31212]: pgmap v17443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:27:07.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:06 smithi077 ceph-mon[27902]: pgmap v17443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:27:07.930 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32538.975919 secs 2024-04-21T19:27:07.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32538.975919 secs 2024-04-21T19:27:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32538.975919 secs 2024-04-21T19:27:08.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:08 smithi191 ceph-mon[31636]: pgmap v17444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:27:08.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:08 smithi191 ceph-mon[31636]: osdmap e1163: 12 total, 12 up, 12 in 2024-04-21T19:27:09.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:08 smithi170 ceph-mon[31212]: pgmap v17444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:27:09.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:08 smithi170 ceph-mon[31212]: osdmap e1163: 12 total, 12 up, 12 in 2024-04-21T19:27:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:08 smithi077 ceph-mon[27902]: pgmap v17444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:27:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:08 smithi077 ceph-mon[27902]: osdmap e1163: 12 total, 12 up, 12 in 2024-04-21T19:27:09.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32540.734147 secs 2024-04-21T19:27:10.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32540.734147 secs 2024-04-21T19:27:10.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32540.734147 secs 2024-04-21T19:27:10.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:10 smithi191 ceph-mon[31636]: pgmap v17446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T19:27:11.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:10 smithi170 ceph-mon[31212]: pgmap v17446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T19:27:11.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:10 smithi077 ceph-mon[27902]: pgmap v17446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T19:27:12.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:12 smithi191 ceph-mon[31636]: pgmap v17447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 26 op/s 2024-04-21T19:27:12.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32543.975982 secs 2024-04-21T19:27:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:12 smithi170 ceph-mon[31212]: pgmap v17447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 26 op/s 2024-04-21T19:27:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32543.975982 secs 2024-04-21T19:27:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:12 smithi077 ceph-mon[27902]: pgmap v17447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 26 op/s 2024-04-21T19:27:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32543.975982 secs 2024-04-21T19:27:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:14 smithi191 ceph-mon[31636]: pgmap v17448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-04-21T19:27:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32545.734264 secs 2024-04-21T19:27:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:27:15.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:14 smithi170 ceph-mon[31212]: pgmap v17448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-04-21T19:27:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32545.734264 secs 2024-04-21T19:27:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:27:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:14 smithi077 ceph-mon[27902]: pgmap v17448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-04-21T19:27:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32545.734264 secs 2024-04-21T19:27:15.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:27:15.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:27:15.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:27:15.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:27:16.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:27:16.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:27:16.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:27:16.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:27:16.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:27:16.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:27:16.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:16 smithi191 ceph-mon[31636]: pgmap v17449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:27:17.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:16 smithi170 ceph-mon[31212]: pgmap v17449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:27:17.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:16 smithi077 ceph-mon[27902]: pgmap v17449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:27:17.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32548.976102 secs 2024-04-21T19:27:18.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32548.976102 secs 2024-04-21T19:27:18.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32548.976102 secs 2024-04-21T19:27:18.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:18 smithi191 ceph-mon[31636]: pgmap v17450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:27:19.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:18 smithi170 ceph-mon[31212]: pgmap v17450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:27:19.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:18 smithi077 ceph-mon[27902]: pgmap v17450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:27:20.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32550.734372 secs 2024-04-21T19:27:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:20.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32550.734372 secs 2024-04-21T19:27:20.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32550.734372 secs 2024-04-21T19:27:21.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:20 smithi170 ceph-mon[31212]: pgmap v17451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:27:21.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:20 smithi077 ceph-mon[27902]: pgmap v17451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:27:21.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:20 smithi191 ceph-mon[31636]: pgmap v17451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 93 B/s wr, 5 op/s 2024-04-21T19:27:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:22 smithi170 ceph-mon[31212]: pgmap v17452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:27:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32553.976216 secs 2024-04-21T19:27:23.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:22 smithi077 ceph-mon[27902]: pgmap v17452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:27:23.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32553.976216 secs 2024-04-21T19:27:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:22 smithi191 ceph-mon[31636]: pgmap v17452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:27:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32553.976216 secs 2024-04-21T19:27:24.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:24 smithi077 ceph-mon[27902]: pgmap v17453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:24.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32555.734466 secs 2024-04-21T19:27:24.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:24 smithi191 ceph-mon[31636]: pgmap v17453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:24.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32555.734466 secs 2024-04-21T19:27:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:24 smithi170 ceph-mon[31212]: pgmap v17453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:25.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32555.734466 secs 2024-04-21T19:27:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:26.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:26 smithi077 ceph-mon[27902]: pgmap v17454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:26.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:26 smithi191 ceph-mon[31636]: pgmap v17454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:27.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:26 smithi170 ceph-mon[31212]: pgmap v17454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32558.976295 secs 2024-04-21T19:27:28.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32558.976295 secs 2024-04-21T19:27:28.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32558.976295 secs 2024-04-21T19:27:28.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:28 smithi191 ceph-mon[31636]: pgmap v17455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:29.008 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:28 smithi077 ceph-mon[27902]: pgmap v17455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:29.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:28 smithi170 ceph-mon[31212]: pgmap v17455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:29.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32560.734600 secs 2024-04-21T19:27:30.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32560.734600 secs 2024-04-21T19:27:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:30.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32560.734600 secs 2024-04-21T19:27:30.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:30 smithi191 ceph-mon[31636]: pgmap v17456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:31.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:30 smithi170 ceph-mon[31212]: pgmap v17456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:31.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:30 smithi077 ceph-mon[27902]: pgmap v17456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:32.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:32 smithi191 ceph-mon[31636]: pgmap v17457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:32.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32563.976419 secs 2024-04-21T19:27:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:32 smithi170 ceph-mon[31212]: pgmap v17457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32563.976419 secs 2024-04-21T19:27:33.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:32 smithi077 ceph-mon[27902]: pgmap v17457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:33.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32563.976419 secs 2024-04-21T19:27:34.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:34 smithi191 ceph-mon[31636]: pgmap v17458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:34.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32565.734716 secs 2024-04-21T19:27:35.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:34 smithi170 ceph-mon[31212]: pgmap v17458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:35.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32565.734716 secs 2024-04-21T19:27:35.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:34 smithi077 ceph-mon[27902]: pgmap v17458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32565.734716 secs 2024-04-21T19:27:36.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:36 smithi191 ceph-mon[31636]: pgmap v17459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:37.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:36 smithi170 ceph-mon[31212]: pgmap v17459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:37.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:36 smithi077 ceph-mon[27902]: pgmap v17459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:37.930 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32568.976532 secs 2024-04-21T19:27:37.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32568.976532 secs 2024-04-21T19:27:38.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32568.976532 secs 2024-04-21T19:27:38.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:38 smithi191 ceph-mon[31636]: pgmap v17460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:39.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:38 smithi170 ceph-mon[31212]: pgmap v17460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:39.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:38 smithi077 ceph-mon[27902]: pgmap v17460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:39.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32570.734832 secs 2024-04-21T19:27:40.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32570.734832 secs 2024-04-21T19:27:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:40.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32570.734832 secs 2024-04-21T19:27:40.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:40 smithi191 ceph-mon[31636]: pgmap v17461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:41.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:40 smithi170 ceph-mon[31212]: pgmap v17461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:41.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:40 smithi077 ceph-mon[27902]: pgmap v17461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:42 smithi191 ceph-mon[31636]: pgmap v17462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:42.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32573.976645 secs 2024-04-21T19:27:43.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:42 smithi170 ceph-mon[31212]: pgmap v17462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:43.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32573.976645 secs 2024-04-21T19:27:43.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:42 smithi077 ceph-mon[27902]: pgmap v17462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:43.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32573.976645 secs 2024-04-21T19:27:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:44 smithi191 ceph-mon[31636]: pgmap v17463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32575.734948 secs 2024-04-21T19:27:45.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:44 smithi170 ceph-mon[31212]: pgmap v17463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:45.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32575.734948 secs 2024-04-21T19:27:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:44 smithi077 ceph-mon[27902]: pgmap v17463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:27:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32575.734948 secs 2024-04-21T19:27:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:46 smithi191 ceph-mon[31636]: pgmap v17464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:47.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:46 smithi170 ceph-mon[31212]: pgmap v17464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:47.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:46 smithi077 ceph-mon[27902]: pgmap v17464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:47.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32578.976756 secs 2024-04-21T19:27:48.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32578.976756 secs 2024-04-21T19:27:48.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32578.976756 secs 2024-04-21T19:27:48.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:48 smithi191 ceph-mon[31636]: pgmap v17465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:49.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:48 smithi170 ceph-mon[31212]: pgmap v17465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:49.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:48 smithi077 ceph-mon[27902]: pgmap v17465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:49.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32580.735068 secs 2024-04-21T19:27:50.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32580.735068 secs 2024-04-21T19:27:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:50.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32580.735068 secs 2024-04-21T19:27:50.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:50 smithi191 ceph-mon[31636]: pgmap v17466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:51.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:50 smithi170 ceph-mon[31212]: pgmap v17466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:51.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:50 smithi077 ceph-mon[27902]: pgmap v17466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:52.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:52 smithi191 ceph-mon[31636]: pgmap v17467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:52.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32583.976837 secs 2024-04-21T19:27:53.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:52 smithi170 ceph-mon[31212]: pgmap v17467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:53.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32583.976837 secs 2024-04-21T19:27:53.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:52 smithi077 ceph-mon[27902]: pgmap v17467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:27:53.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32583.976837 secs 2024-04-21T19:27:54.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:54 smithi191 ceph-mon[31636]: pgmap v17468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:54.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32585.735159 secs 2024-04-21T19:27:55.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:54 smithi170 ceph-mon[31212]: pgmap v17468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:55.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32585.735159 secs 2024-04-21T19:27:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:27:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:54 smithi077 ceph-mon[27902]: pgmap v17468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32585.735159 secs 2024-04-21T19:27:56.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:56 smithi191 ceph-mon[31636]: pgmap v17469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:27:57.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:56 smithi170 ceph-mon[31212]: pgmap v17469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:27:57.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:56 smithi077 ceph-mon[27902]: pgmap v17469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:27:57.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32588.976957 secs 2024-04-21T19:27:58.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32588.976957 secs 2024-04-21T19:27:58.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32588.976957 secs 2024-04-21T19:27:58.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:58 smithi191 ceph-mon[31636]: pgmap v17470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:59.008 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:58 smithi077 ceph-mon[27902]: pgmap v17470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:27:59.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:58 smithi170 ceph-mon[31212]: pgmap v17470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:00.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32590.735278 secs 2024-04-21T19:28:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:00.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32590.735278 secs 2024-04-21T19:28:00.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32590.735278 secs 2024-04-21T19:28:01.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:00 smithi170 ceph-mon[31212]: pgmap v17471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:01.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:00 smithi077 ceph-mon[27902]: pgmap v17471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:01.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:00 smithi191 ceph-mon[31636]: pgmap v17471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:03.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:02 smithi170 ceph-mon[31212]: pgmap v17472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:03.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32593.977067 secs 2024-04-21T19:28:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:02 smithi077 ceph-mon[27902]: pgmap v17472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32593.977067 secs 2024-04-21T19:28:03.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:02 smithi191 ceph-mon[31636]: pgmap v17472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:03.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32593.977067 secs 2024-04-21T19:28:05.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:04 smithi170 ceph-mon[31212]: pgmap v17473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32595.735340 secs 2024-04-21T19:28:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:04 smithi077 ceph-mon[27902]: pgmap v17473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32595.735340 secs 2024-04-21T19:28:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:04 smithi191 ceph-mon[31636]: pgmap v17473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:28:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32595.735340 secs 2024-04-21T19:28:06.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:05 smithi170 ceph-mon[31212]: osdmap e1164: 12 total, 12 up, 12 in 2024-04-21T19:28:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:05 smithi077 ceph-mon[27902]: osdmap e1164: 12 total, 12 up, 12 in 2024-04-21T19:28:06.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:05 smithi191 ceph-mon[31636]: osdmap e1164: 12 total, 12 up, 12 in 2024-04-21T19:28:07.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:06 smithi170 ceph-mon[31212]: pgmap v17475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:07.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:06 smithi077 ceph-mon[27902]: pgmap v17475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:07.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:06 smithi191 ceph-mon[31636]: pgmap v17475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:08.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32598.977164 secs 2024-04-21T19:28:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32598.977164 secs 2024-04-21T19:28:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32598.977164 secs 2024-04-21T19:28:09.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:08 smithi170 ceph-mon[31212]: pgmap v17476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:09.091 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:08 smithi191 ceph-mon[31636]: pgmap v17476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:08 smithi077 ceph-mon[27902]: pgmap v17476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:10.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32600.735459 secs 2024-04-21T19:28:10.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32600.735459 secs 2024-04-21T19:28:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32600.735459 secs 2024-04-21T19:28:11.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:10 smithi170 ceph-mon[31212]: pgmap v17477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:11.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:10 smithi077 ceph-mon[27902]: pgmap v17477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:11.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:10 smithi191 ceph-mon[31636]: pgmap v17477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:28:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:12 smithi170 ceph-mon[31212]: pgmap v17478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:28:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32603.977299 secs 2024-04-21T19:28:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:12 smithi077 ceph-mon[27902]: pgmap v17478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:28:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32603.977299 secs 2024-04-21T19:28:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:12 smithi191 ceph-mon[31636]: pgmap v17478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:28:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32603.977299 secs 2024-04-21T19:28:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:14 smithi077 ceph-mon[27902]: osdmap e1165: 12 total, 12 up, 12 in 2024-04-21T19:28:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:14 smithi077 ceph-mon[27902]: pgmap v17480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:28:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32605.735578 secs 2024-04-21T19:28:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:14 smithi191 ceph-mon[31636]: osdmap e1165: 12 total, 12 up, 12 in 2024-04-21T19:28:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:14 smithi191 ceph-mon[31636]: pgmap v17480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:28:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32605.735578 secs 2024-04-21T19:28:15.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:14 smithi170 ceph-mon[31212]: osdmap e1165: 12 total, 12 up, 12 in 2024-04-21T19:28:15.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:14 smithi170 ceph-mon[31212]: pgmap v17480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:28:15.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32605.735578 secs 2024-04-21T19:28:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:15.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:28:15.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:28:15.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:28:15.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:28:15.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:28:15.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:28:15.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:28:15.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:28:16.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:28:16.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:28:16.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:28:16.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:28:16.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:16 smithi077 ceph-mon[27902]: pgmap v17481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:16.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:16 smithi191 ceph-mon[31636]: pgmap v17481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:17.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:16 smithi170 ceph-mon[31212]: pgmap v17481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:17.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32608.977432 secs 2024-04-21T19:28:17.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32608.977432 secs 2024-04-21T19:28:18.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32608.977432 secs 2024-04-21T19:28:18.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:18 smithi077 ceph-mon[27902]: pgmap v17482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:18.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:18 smithi191 ceph-mon[31636]: pgmap v17482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:19.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:18 smithi170 ceph-mon[31212]: pgmap v17482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:19.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32610.735703 secs 2024-04-21T19:28:19.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32610.735703 secs 2024-04-21T19:28:20.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32610.735703 secs 2024-04-21T19:28:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:20.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:20 smithi077 ceph-mon[27902]: pgmap v17483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:20.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:20 smithi191 ceph-mon[31636]: pgmap v17483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:21.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:20 smithi170 ceph-mon[31212]: pgmap v17483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:28:22.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:22 smithi077 ceph-mon[27902]: pgmap v17484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:28:22.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32613.977559 secs 2024-04-21T19:28:22.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:22 smithi191 ceph-mon[31636]: pgmap v17484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:28:22.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32613.977559 secs 2024-04-21T19:28:23.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:22 smithi170 ceph-mon[31212]: pgmap v17484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:28:23.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32613.977559 secs 2024-04-21T19:28:24.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:24 smithi077 ceph-mon[27902]: pgmap v17485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:28:24.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32615.735818 secs 2024-04-21T19:28:24.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:24 smithi191 ceph-mon[31636]: pgmap v17485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:28:24.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32615.735818 secs 2024-04-21T19:28:25.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:24 smithi170 ceph-mon[31212]: pgmap v17485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:28:25.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32615.735818 secs 2024-04-21T19:28:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:26.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:26 smithi077 ceph-mon[27902]: pgmap v17486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:26.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:26 smithi191 ceph-mon[31636]: pgmap v17486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:27.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:26 smithi170 ceph-mon[31212]: pgmap v17486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:27.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32618.977696 secs 2024-04-21T19:28:27.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32618.977696 secs 2024-04-21T19:28:28.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32618.977696 secs 2024-04-21T19:28:28.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:28 smithi077 ceph-mon[27902]: pgmap v17487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:28.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:28 smithi191 ceph-mon[31636]: pgmap v17487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:29.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:28 smithi170 ceph-mon[31212]: pgmap v17487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:29.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32620.735934 secs 2024-04-21T19:28:29.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32620.735934 secs 2024-04-21T19:28:30.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32620.735934 secs 2024-04-21T19:28:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:30.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:30 smithi191 ceph-mon[31636]: pgmap v17488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:31.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:30 smithi170 ceph-mon[31212]: pgmap v17488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:31.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:30 smithi077 ceph-mon[27902]: pgmap v17488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:32.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:32 smithi191 ceph-mon[31636]: pgmap v17489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:32.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32623.977815 secs 2024-04-21T19:28:33.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:32 smithi170 ceph-mon[31212]: pgmap v17489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:33.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32623.977815 secs 2024-04-21T19:28:33.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:32 smithi077 ceph-mon[27902]: pgmap v17489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:33.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32623.977815 secs 2024-04-21T19:28:34.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:34 smithi191 ceph-mon[31636]: pgmap v17490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:34.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32625.736012 secs 2024-04-21T19:28:35.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:34 smithi170 ceph-mon[31212]: pgmap v17490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:35.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32625.736012 secs 2024-04-21T19:28:35.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:34 smithi077 ceph-mon[27902]: pgmap v17490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:35.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32625.736012 secs 2024-04-21T19:28:36.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:36 smithi191 ceph-mon[31636]: pgmap v17491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:37.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:36 smithi170 ceph-mon[31212]: pgmap v17491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:37.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:36 smithi077 ceph-mon[27902]: pgmap v17491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:37.930 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32628.977938 secs 2024-04-21T19:28:37.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32628.977938 secs 2024-04-21T19:28:38.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32628.977938 secs 2024-04-21T19:28:38.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:38 smithi191 ceph-mon[31636]: pgmap v17492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:39.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:38 smithi170 ceph-mon[31212]: pgmap v17492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:39.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:38 smithi077 ceph-mon[27902]: pgmap v17492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:39.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32630.736130 secs 2024-04-21T19:28:40.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32630.736130 secs 2024-04-21T19:28:40.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:40.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32630.736130 secs 2024-04-21T19:28:40.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:40 smithi191 ceph-mon[31636]: pgmap v17493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:41.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:40 smithi170 ceph-mon[31212]: pgmap v17493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:41.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:40 smithi077 ceph-mon[27902]: pgmap v17493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:42 smithi191 ceph-mon[31636]: pgmap v17494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32633.978052 secs 2024-04-21T19:28:43.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:42 smithi170 ceph-mon[31212]: pgmap v17494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:43.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32633.978052 secs 2024-04-21T19:28:43.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:42 smithi077 ceph-mon[27902]: pgmap v17494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:43.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32633.978052 secs 2024-04-21T19:28:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:44 smithi191 ceph-mon[31636]: pgmap v17495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32635.736191 secs 2024-04-21T19:28:45.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:44 smithi170 ceph-mon[31212]: pgmap v17495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:45.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32635.736191 secs 2024-04-21T19:28:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:44 smithi077 ceph-mon[27902]: pgmap v17495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:45.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32635.736191 secs 2024-04-21T19:28:46.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:46 smithi191 ceph-mon[31636]: pgmap v17496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:47.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:46 smithi170 ceph-mon[31212]: pgmap v17496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:47.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:46 smithi077 ceph-mon[27902]: pgmap v17496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:47.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32638.978203 secs 2024-04-21T19:28:48.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32638.978203 secs 2024-04-21T19:28:48.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32638.978203 secs 2024-04-21T19:28:48.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:48 smithi191 ceph-mon[31636]: pgmap v17497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:49.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:48 smithi170 ceph-mon[31212]: pgmap v17497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:49.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:48 smithi077 ceph-mon[27902]: pgmap v17497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:49.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32640.736308 secs 2024-04-21T19:28:50.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32640.736308 secs 2024-04-21T19:28:50.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:50.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32640.736308 secs 2024-04-21T19:28:50.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:50 smithi191 ceph-mon[31636]: pgmap v17498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:51.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:50 smithi170 ceph-mon[31212]: pgmap v17498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:51.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:50 smithi077 ceph-mon[27902]: pgmap v17498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:52.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:52 smithi191 ceph-mon[31636]: pgmap v17499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:52.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32643.978322 secs 2024-04-21T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:52 smithi170 ceph-mon[31212]: pgmap v17499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32643.978322 secs 2024-04-21T19:28:53.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:52 smithi077 ceph-mon[27902]: pgmap v17499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:53.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32643.978322 secs 2024-04-21T19:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.457+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T19:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.457+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T19:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.457+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.457+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T19:28:54.429 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.457+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:28:54.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.458+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T19:28:54.430 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.458+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T19:28:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efd70034010 tx=0x7efd7003e070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efd70034010 tx=0x7efd7003e070 comp rx=0 tx=0).stop 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T19:28:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:28:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:54.522+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd70069000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T19:28:54.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:54 smithi191 ceph-mon[31636]: pgmap v17500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:54.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32645.736442 secs 2024-04-21T19:28:55.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:54 smithi170 ceph-mon[31212]: pgmap v17500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:55.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32645.736442 secs 2024-04-21T19:28:55.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:28:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:54 smithi077 ceph-mon[27902]: pgmap v17500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:55.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32645.736442 secs 2024-04-21T19:28:56.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:56 smithi191 ceph-mon[31636]: pgmap v17501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:57.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:56 smithi170 ceph-mon[31212]: pgmap v17501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:57.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:56 smithi077 ceph-mon[27902]: pgmap v17501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:28:57.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32648.978441 secs 2024-04-21T19:28:58.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32648.978441 secs 2024-04-21T19:28:58.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32648.978441 secs 2024-04-21T19:28:58.841 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:58.869+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:28:58.841 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:58.869+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:28:58.841 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:58.869+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:28:58.841 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:28:58.869+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:28:58.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:58 smithi191 ceph-mon[31636]: pgmap v17502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:59.008 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:58 smithi077 ceph-mon[27902]: pgmap v17502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:59.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:58 smithi170 ceph-mon[31212]: pgmap v17502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:28:59.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32650.736560 secs 2024-04-21T19:29:00.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32650.736560 secs 2024-04-21T19:29:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:00.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32650.736560 secs 2024-04-21T19:29:00.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:00 smithi191 ceph-mon[31636]: pgmap v17503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:01.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:00 smithi170 ceph-mon[31212]: pgmap v17503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:01.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:00 smithi077 ceph-mon[27902]: pgmap v17503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:02.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:02 smithi191 ceph-mon[31636]: pgmap v17504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:02.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32653.978575 secs 2024-04-21T19:29:03.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:02 smithi170 ceph-mon[31212]: pgmap v17504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:03.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32653.978575 secs 2024-04-21T19:29:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:02 smithi077 ceph-mon[27902]: pgmap v17504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32653.978575 secs 2024-04-21T19:29:04.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:04 smithi191 ceph-mon[31636]: pgmap v17505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:04.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32655.736695 secs 2024-04-21T19:29:05.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:04 smithi170 ceph-mon[31212]: pgmap v17505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:05.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32655.736695 secs 2024-04-21T19:29:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:04 smithi077 ceph-mon[27902]: pgmap v17505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32655.736695 secs 2024-04-21T19:29:06.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:05 smithi170 ceph-mon[31212]: osdmap e1166: 12 total, 12 up, 12 in 2024-04-21T19:29:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:05 smithi077 ceph-mon[27902]: osdmap e1166: 12 total, 12 up, 12 in 2024-04-21T19:29:06.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:05 smithi191 ceph-mon[31636]: osdmap e1166: 12 total, 12 up, 12 in 2024-04-21T19:29:07.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:06 smithi170 ceph-mon[31212]: pgmap v17507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:07.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:06 smithi077 ceph-mon[27902]: pgmap v17507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:07.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:06 smithi191 ceph-mon[31636]: pgmap v17507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:08.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32658.978686 secs 2024-04-21T19:29:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32658.978686 secs 2024-04-21T19:29:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32658.978686 secs 2024-04-21T19:29:09.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:08 smithi170 ceph-mon[31212]: pgmap v17508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:09.091 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:08 smithi191 ceph-mon[31636]: pgmap v17508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:08 smithi077 ceph-mon[27902]: pgmap v17508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:10.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32660.736811 secs 2024-04-21T19:29:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32660.736811 secs 2024-04-21T19:29:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32660.736811 secs 2024-04-21T19:29:11.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:10 smithi170 ceph-mon[31212]: pgmap v17509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:11.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:10 smithi077 ceph-mon[27902]: pgmap v17509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:11.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:10 smithi191 ceph-mon[31636]: pgmap v17509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:29:13.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:12 smithi170 ceph-mon[31212]: pgmap v17510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:29:13.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32663.978818 secs 2024-04-21T19:29:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:12 smithi077 ceph-mon[27902]: pgmap v17510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:29:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32663.978818 secs 2024-04-21T19:29:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:12 smithi191 ceph-mon[31636]: pgmap v17510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:29:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32663.978818 secs 2024-04-21T19:29:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:14 smithi077 ceph-mon[27902]: osdmap e1167: 12 total, 12 up, 12 in 2024-04-21T19:29:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:14 smithi077 ceph-mon[27902]: pgmap v17512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:29:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32665.736944 secs 2024-04-21T19:29:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:14 smithi191 ceph-mon[31636]: osdmap e1167: 12 total, 12 up, 12 in 2024-04-21T19:29:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:14 smithi191 ceph-mon[31636]: pgmap v17512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:29:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32665.736944 secs 2024-04-21T19:29:15.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:14 smithi170 ceph-mon[31212]: osdmap e1167: 12 total, 12 up, 12 in 2024-04-21T19:29:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:14 smithi170 ceph-mon[31212]: pgmap v17512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:29:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32665.736944 secs 2024-04-21T19:29:15.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:15.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:29:15.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:29:16.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:29:16.845 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:16 smithi077 ceph-mon[27902]: pgmap v17513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:16.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:16 smithi191 ceph-mon[31636]: pgmap v17513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:17.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:16 smithi170 ceph-mon[31212]: pgmap v17513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:17.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32668.978952 secs 2024-04-21T19:29:17.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32668.978952 secs 2024-04-21T19:29:18.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32668.978952 secs 2024-04-21T19:29:18.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:18 smithi077 ceph-mon[27902]: pgmap v17514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:18.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:18 smithi191 ceph-mon[31636]: pgmap v17514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:19.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:18 smithi170 ceph-mon[31212]: pgmap v17514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:19.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32670.737058 secs 2024-04-21T19:29:19.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32670.737058 secs 2024-04-21T19:29:20.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32670.737058 secs 2024-04-21T19:29:20.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:21.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:20 smithi170 ceph-mon[31212]: pgmap v17515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:21.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:29:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:29:21.279 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:20 smithi077 ceph-mon[27902]: pgmap v17515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:29:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:29:21.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:20 smithi191 ceph-mon[31636]: pgmap v17515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:29:21.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:21.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:29:21.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:29:21.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:29:23.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:22 smithi170 ceph-mon[31212]: pgmap v17516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:29:23.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32673.979050 secs 2024-04-21T19:29:23.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:22 smithi077 ceph-mon[27902]: pgmap v17516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:29:23.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32673.979050 secs 2024-04-21T19:29:23.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:22 smithi191 ceph-mon[31636]: pgmap v17516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:29:23.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32673.979050 secs 2024-04-21T19:29:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:24 smithi170 ceph-mon[31212]: pgmap v17517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:29:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32675.737126 secs 2024-04-21T19:29:25.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:24 smithi077 ceph-mon[27902]: pgmap v17517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:29:25.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32675.737126 secs 2024-04-21T19:29:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:24 smithi191 ceph-mon[31636]: pgmap v17517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:29:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32675.737126 secs 2024-04-21T19:29:27.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:26 smithi170 ceph-mon[31212]: pgmap v17518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:27.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:26 smithi077 ceph-mon[27902]: pgmap v17518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:27.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:26 smithi191 ceph-mon[31636]: pgmap v17518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:28.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32678.979133 secs 2024-04-21T19:29:28.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32678.979133 secs 2024-04-21T19:29:28.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32678.979133 secs 2024-04-21T19:29:29.258 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:29 smithi077 ceph-mon[27902]: pgmap v17519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:29.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:29 smithi170 ceph-mon[31212]: pgmap v17519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:29.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:29 smithi191 ceph-mon[31636]: pgmap v17519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:30.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:30.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32680.737240 secs 2024-04-21T19:29:30.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32680.737240 secs 2024-04-21T19:29:30.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32680.737240 secs 2024-04-21T19:29:31.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:31 smithi170 ceph-mon[31212]: pgmap v17520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:31.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:31 smithi077 ceph-mon[27902]: pgmap v17520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:31.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:31 smithi191 ceph-mon[31636]: pgmap v17520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:33.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:33 smithi170 ceph-mon[31212]: pgmap v17521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:33.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32683.979250 secs 2024-04-21T19:29:33.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:33 smithi077 ceph-mon[27902]: pgmap v17521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:33.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32683.979250 secs 2024-04-21T19:29:33.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:33 smithi191 ceph-mon[31636]: pgmap v17521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:33.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32683.979250 secs 2024-04-21T19:29:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:35.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:35 smithi170 ceph-mon[31212]: pgmap v17522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:35.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32685.737354 secs 2024-04-21T19:29:35.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:35 smithi077 ceph-mon[27902]: pgmap v17522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:35.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32685.737354 secs 2024-04-21T19:29:35.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:35 smithi191 ceph-mon[31636]: pgmap v17522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:35.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32685.737354 secs 2024-04-21T19:29:37.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:37 smithi170 ceph-mon[31212]: pgmap v17523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:37.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:37 smithi077 ceph-mon[27902]: pgmap v17523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:37.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:37 smithi191 ceph-mon[31636]: pgmap v17523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:38.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32688.979312 secs 2024-04-21T19:29:38.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32688.979312 secs 2024-04-21T19:29:38.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32688.979312 secs 2024-04-21T19:29:39.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:39 smithi170 ceph-mon[31212]: pgmap v17524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:39.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:39 smithi191 ceph-mon[31636]: pgmap v17524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:39.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:39 smithi077 ceph-mon[27902]: pgmap v17524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:40.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32690.737472 secs 2024-04-21T19:29:40.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32690.737472 secs 2024-04-21T19:29:40.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32690.737472 secs 2024-04-21T19:29:41.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:41 smithi170 ceph-mon[31212]: pgmap v17525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:41.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:41 smithi077 ceph-mon[27902]: pgmap v17525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:41.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:41 smithi191 ceph-mon[31636]: pgmap v17525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:43.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:43 smithi170 ceph-mon[31212]: pgmap v17526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:43.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32693.979438 secs 2024-04-21T19:29:43.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:43 smithi077 ceph-mon[27902]: pgmap v17526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:43.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32693.979438 secs 2024-04-21T19:29:43.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:43 smithi191 ceph-mon[31636]: pgmap v17526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:43.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32693.979438 secs 2024-04-21T19:29:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:45.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:45 smithi170 ceph-mon[31212]: pgmap v17527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:45.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32695.737627 secs 2024-04-21T19:29:45.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:45 smithi077 ceph-mon[27902]: pgmap v17527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:45.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32695.737627 secs 2024-04-21T19:29:45.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:45 smithi191 ceph-mon[31636]: pgmap v17527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:45.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32695.737627 secs 2024-04-21T19:29:47.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:47 smithi170 ceph-mon[31212]: pgmap v17528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:47.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:47 smithi077 ceph-mon[27902]: pgmap v17528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:47.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:47 smithi191 ceph-mon[31636]: pgmap v17528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:48.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32698.979537 secs 2024-04-21T19:29:48.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32698.979537 secs 2024-04-21T19:29:48.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32698.979537 secs 2024-04-21T19:29:49.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:49 smithi170 ceph-mon[31212]: pgmap v17529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:49.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:49 smithi077 ceph-mon[27902]: pgmap v17529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:49.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:49 smithi191 ceph-mon[31636]: pgmap v17529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:50.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32700.737739 secs 2024-04-21T19:29:50.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32700.737739 secs 2024-04-21T19:29:50.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32700.737739 secs 2024-04-21T19:29:51.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:51 smithi077 ceph-mon[27902]: pgmap v17530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:51.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:51 smithi191 ceph-mon[31636]: pgmap v17530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:51.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:51 smithi170 ceph-mon[31212]: pgmap v17530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:53.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:53 smithi077 ceph-mon[27902]: pgmap v17531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:53.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32703.979654 secs 2024-04-21T19:29:53.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:53 smithi191 ceph-mon[31636]: pgmap v17531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:53.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32703.979654 secs 2024-04-21T19:29:53.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:53 smithi170 ceph-mon[31212]: pgmap v17531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:53.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32703.979654 secs 2024-04-21T19:29:54.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32705.737829 secs 2024-04-21T19:29:54.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32705.737829 secs 2024-04-21T19:29:54.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32705.737829 secs 2024-04-21T19:29:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:29:55.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:55 smithi077 ceph-mon[27902]: pgmap v17532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:55.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:55 smithi191 ceph-mon[31636]: pgmap v17532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:55.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:55 smithi170 ceph-mon[31212]: pgmap v17532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:57.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:57 smithi077 ceph-mon[27902]: pgmap v17533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:57.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:57 smithi191 ceph-mon[31636]: pgmap v17533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:57.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:57 smithi170 ceph-mon[31212]: pgmap v17533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:29:58.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32708.979778 secs 2024-04-21T19:29:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32708.979778 secs 2024-04-21T19:29:58.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32708.979778 secs 2024-04-21T19:29:59.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:59 smithi077 ceph-mon[27902]: pgmap v17534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:59.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32710.737947 secs 2024-04-21T19:29:59.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:59 smithi191 ceph-mon[31636]: pgmap v17534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:59.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32710.737947 secs 2024-04-21T19:29:59.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:59 smithi170 ceph-mon[31212]: pgmap v17534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:29:59.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32710.737947 secs 2024-04-21T19:30:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:00.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:30:00.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:30:00.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:30:01.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:01 smithi077 ceph-mon[27902]: pgmap v17535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:01.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:01 smithi191 ceph-mon[31636]: pgmap v17535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:01.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:01 smithi170 ceph-mon[31212]: pgmap v17535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:03.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:03 smithi077 ceph-mon[27902]: pgmap v17536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:03.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32713.979884 secs 2024-04-21T19:30:03.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:03 smithi191 ceph-mon[31636]: pgmap v17536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:03.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32713.979884 secs 2024-04-21T19:30:03.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:03 smithi170 ceph-mon[31212]: pgmap v17536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:03.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32713.979884 secs 2024-04-21T19:30:04.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32715.738093 secs 2024-04-21T19:30:04.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32715.738093 secs 2024-04-21T19:30:04.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32715.738093 secs 2024-04-21T19:30:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:05 smithi077 ceph-mon[27902]: pgmap v17537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:05.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:05 smithi077 ceph-mon[27902]: osdmap e1168: 12 total, 12 up, 12 in 2024-04-21T19:30:05.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:05 smithi191 ceph-mon[31636]: pgmap v17537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:05.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:05 smithi191 ceph-mon[31636]: osdmap e1168: 12 total, 12 up, 12 in 2024-04-21T19:30:05.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:05 smithi170 ceph-mon[31212]: pgmap v17537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:05.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:05 smithi170 ceph-mon[31212]: osdmap e1168: 12 total, 12 up, 12 in 2024-04-21T19:30:07.329 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:07 smithi170 ceph-mon[31212]: pgmap v17539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:30:07.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:07 smithi077 ceph-mon[27902]: pgmap v17539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:30:07.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:07 smithi191 ceph-mon[31636]: pgmap v17539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:30:08.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32718.979996 secs 2024-04-21T19:30:08.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32718.979996 secs 2024-04-21T19:30:08.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32718.979996 secs 2024-04-21T19:30:09.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:09 smithi191 ceph-mon[31636]: pgmap v17540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:30:09.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:09 smithi191 ceph-mon[31636]: osdmap e1169: 12 total, 12 up, 12 in 2024-04-21T19:30:09.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32720.738159 secs 2024-04-21T19:30:09.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:09 smithi077 ceph-mon[27902]: pgmap v17540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:30:09.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:09 smithi077 ceph-mon[27902]: osdmap e1169: 12 total, 12 up, 12 in 2024-04-21T19:30:09.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32720.738159 secs 2024-04-21T19:30:09.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:09 smithi170 ceph-mon[31212]: pgmap v17540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:30:09.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:09 smithi170 ceph-mon[31212]: osdmap e1169: 12 total, 12 up, 12 in 2024-04-21T19:30:09.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32720.738159 secs 2024-04-21T19:30:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:11.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:11 smithi077 ceph-mon[27902]: pgmap v17542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:30:11.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:11 smithi191 ceph-mon[31636]: pgmap v17542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:30:11.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:11 smithi170 ceph-mon[31212]: pgmap v17542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:30:13.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:13 smithi077 ceph-mon[27902]: pgmap v17543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:30:13.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32723.980110 secs 2024-04-21T19:30:13.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:13 smithi191 ceph-mon[31636]: pgmap v17543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:30:13.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32723.980110 secs 2024-04-21T19:30:13.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:13 smithi170 ceph-mon[31212]: pgmap v17543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:30:13.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32723.980110 secs 2024-04-21T19:30:14.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32725.738293 secs 2024-04-21T19:30:14.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32725.738293 secs 2024-04-21T19:30:14.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32725.738293 secs 2024-04-21T19:30:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:15.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:15 smithi077 ceph-mon[27902]: pgmap v17544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:30:15.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:15 smithi191 ceph-mon[31636]: pgmap v17544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:30:15.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:15 smithi170 ceph-mon[31212]: pgmap v17544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:30:17.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:17 smithi077 ceph-mon[27902]: pgmap v17545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:30:17.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:17 smithi191 ceph-mon[31636]: pgmap v17545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:30:17.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:17 smithi170 ceph-mon[31212]: pgmap v17545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:30:18.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32728.980244 secs 2024-04-21T19:30:18.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32728.980244 secs 2024-04-21T19:30:18.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32728.980244 secs 2024-04-21T19:30:19.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:19 smithi077 ceph-mon[27902]: pgmap v17546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:30:19.357 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32730.738366 secs 2024-04-21T19:30:19.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:19 smithi191 ceph-mon[31636]: pgmap v17546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:30:19.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32730.738366 secs 2024-04-21T19:30:19.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:19 smithi170 ceph-mon[31212]: pgmap v17546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:30:19.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32730.738366 secs 2024-04-21T19:30:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:21.422 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:21 smithi191 ceph-mon[31636]: pgmap v17547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:30:21.422 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:30:21.423 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:21 smithi170 ceph-mon[31212]: pgmap v17547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:30:21.423 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:30:21.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:21 smithi077 ceph-mon[27902]: pgmap v17547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:30:21.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:30:23.262 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:23 smithi191 ceph-mon[31636]: pgmap v17548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:30:23.262 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32733.980310 secs 2024-04-21T19:30:23.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:23 smithi170 ceph-mon[31212]: pgmap v17548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:30:23.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32733.980310 secs 2024-04-21T19:30:23.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:23 smithi077 ceph-mon[27902]: pgmap v17548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:30:23.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32733.980310 secs 2024-04-21T19:30:24.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32735.738454 secs 2024-04-21T19:30:24.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32735.738454 secs 2024-04-21T19:30:24.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32735.738454 secs 2024-04-21T19:30:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: pgmap v17549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:30:25.278 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: pgmap v17549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:25.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:30:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:30:25.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: pgmap v17549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:25.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:30:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:30:25.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:30:26.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:26 smithi191 ceph-mon[31636]: pgmap v17550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:26.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:26 smithi170 ceph-mon[31212]: pgmap v17550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:26.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:26 smithi077 ceph-mon[27902]: pgmap v17550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:27.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32738.980425 secs 2024-04-21T19:30:27.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32738.980425 secs 2024-04-21T19:30:27.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32738.980425 secs 2024-04-21T19:30:28.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:28 smithi077 ceph-mon[27902]: pgmap v17551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:28.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:28 smithi191 ceph-mon[31636]: pgmap v17551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:28.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:28 smithi170 ceph-mon[31212]: pgmap v17551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:29.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32740.738578 secs 2024-04-21T19:30:29.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32740.738578 secs 2024-04-21T19:30:29.856 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32740.738578 secs 2024-04-21T19:30:30.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:30.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:30 smithi191 ceph-mon[31636]: pgmap v17552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:30.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:30 smithi170 ceph-mon[31212]: pgmap v17552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:30.785 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:30 smithi077 ceph-mon[27902]: pgmap v17552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:32.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:32 smithi191 ceph-mon[31636]: pgmap v17553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:32.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32743.980539 secs 2024-04-21T19:30:33.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:32 smithi170 ceph-mon[31212]: pgmap v17553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:33.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32743.980539 secs 2024-04-21T19:30:33.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:32 smithi077 ceph-mon[27902]: pgmap v17553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:33.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32743.980539 secs 2024-04-21T19:30:34.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:34 smithi170 ceph-mon[31212]: pgmap v17554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:34.778 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32745.738689 secs 2024-04-21T19:30:34.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:34 smithi191 ceph-mon[31636]: pgmap v17554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:34.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32745.738689 secs 2024-04-21T19:30:35.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:35.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:34 smithi077 ceph-mon[27902]: pgmap v17554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:35.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32745.738689 secs 2024-04-21T19:30:36.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:36 smithi191 ceph-mon[31636]: pgmap v17555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:37.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:36 smithi170 ceph-mon[31212]: pgmap v17555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:37.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:36 smithi077 ceph-mon[27902]: pgmap v17555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:37.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32748.980633 secs 2024-04-21T19:30:38.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32748.980633 secs 2024-04-21T19:30:38.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32748.980633 secs 2024-04-21T19:30:38.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:38 smithi191 ceph-mon[31636]: pgmap v17556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:39.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:38 smithi170 ceph-mon[31212]: pgmap v17556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:39.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:38 smithi077 ceph-mon[27902]: pgmap v17556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:39.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32750.738826 secs 2024-04-21T19:30:40.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32750.738826 secs 2024-04-21T19:30:40.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:40.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32750.738826 secs 2024-04-21T19:30:40.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:40 smithi191 ceph-mon[31636]: pgmap v17557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:41.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:40 smithi170 ceph-mon[31212]: pgmap v17557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:41.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:40 smithi077 ceph-mon[27902]: pgmap v17557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:42 smithi191 ceph-mon[31636]: pgmap v17558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:42.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32753.980738 secs 2024-04-21T19:30:43.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:42 smithi170 ceph-mon[31212]: pgmap v17558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:43.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32753.980738 secs 2024-04-21T19:30:43.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:42 smithi077 ceph-mon[27902]: pgmap v17558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:43.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32753.980738 secs 2024-04-21T19:30:44.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:44 smithi191 ceph-mon[31636]: pgmap v17559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:44.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32755.738938 secs 2024-04-21T19:30:45.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:44 smithi170 ceph-mon[31212]: pgmap v17559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:45.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32755.738938 secs 2024-04-21T19:30:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:45.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:44 smithi077 ceph-mon[27902]: pgmap v17559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:45.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32755.738938 secs 2024-04-21T19:30:46.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:46 smithi191 ceph-mon[31636]: pgmap v17560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:47.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:46 smithi170 ceph-mon[31212]: pgmap v17560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:47.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:46 smithi077 ceph-mon[27902]: pgmap v17560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:48.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32758.980866 secs 2024-04-21T19:30:48.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32758.980866 secs 2024-04-21T19:30:48.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32758.980866 secs 2024-04-21T19:30:49.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:48 smithi170 ceph-mon[31212]: pgmap v17561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:49.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:48 smithi077 ceph-mon[27902]: pgmap v17561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:49.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:48 smithi191 ceph-mon[31636]: pgmap v17561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:50.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32760.739057 secs 2024-04-21T19:30:50.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:50.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32760.739057 secs 2024-04-21T19:30:50.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32760.739057 secs 2024-04-21T19:30:51.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:50 smithi170 ceph-mon[31212]: pgmap v17562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:51.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:50 smithi077 ceph-mon[27902]: pgmap v17562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:51.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:50 smithi191 ceph-mon[31636]: pgmap v17562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:53.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:52 smithi170 ceph-mon[31212]: pgmap v17563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:53.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32763.980945 secs 2024-04-21T19:30:53.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:52 smithi077 ceph-mon[27902]: pgmap v17563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:53.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32763.980945 secs 2024-04-21T19:30:53.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:52 smithi191 ceph-mon[31636]: pgmap v17563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:53.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32763.980945 secs 2024-04-21T19:30:55.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:54 smithi170 ceph-mon[31212]: pgmap v17564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:55.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32765.739134 secs 2024-04-21T19:30:55.100 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:30:55.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:54 smithi077 ceph-mon[27902]: pgmap v17564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:55.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32765.739134 secs 2024-04-21T19:30:55.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:54 smithi191 ceph-mon[31636]: pgmap v17564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:55.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32765.739134 secs 2024-04-21T19:30:57.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:56 smithi170 ceph-mon[31212]: pgmap v17565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:57.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:56 smithi077 ceph-mon[27902]: pgmap v17565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:57.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:56 smithi191 ceph-mon[31636]: pgmap v17565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:30:58.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32768.981063 secs 2024-04-21T19:30:58.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32768.981063 secs 2024-04-21T19:30:58.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32768.981063 secs 2024-04-21T19:30:59.008 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:58 smithi077 ceph-mon[27902]: pgmap v17566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:59.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:58 smithi170 ceph-mon[31212]: pgmap v17566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:30:59.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:58 smithi191 ceph-mon[31636]: pgmap v17566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:00.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32770.739215 secs 2024-04-21T19:31:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:00.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32770.739215 secs 2024-04-21T19:31:00.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32770.739215 secs 2024-04-21T19:31:01.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:00 smithi170 ceph-mon[31212]: pgmap v17567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:01.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:00 smithi077 ceph-mon[27902]: pgmap v17567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:01.189 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:00 smithi191 ceph-mon[31636]: pgmap v17567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:03.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:02 smithi170 ceph-mon[31212]: pgmap v17568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:03.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32773.981180 secs 2024-04-21T19:31:03.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:02 smithi077 ceph-mon[27902]: pgmap v17568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:03.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32773.981180 secs 2024-04-21T19:31:03.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:02 smithi191 ceph-mon[31636]: pgmap v17568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:03.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32773.981180 secs 2024-04-21T19:31:05.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:04 smithi170 ceph-mon[31212]: pgmap v17569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:05.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32775.739327 secs 2024-04-21T19:31:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:05.106 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:04 smithi077 ceph-mon[27902]: pgmap v17569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:05.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32775.739327 secs 2024-04-21T19:31:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:04 smithi191 ceph-mon[31636]: pgmap v17569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:05.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32775.739327 secs 2024-04-21T19:31:06.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:05 smithi170 ceph-mon[31212]: osdmap e1170: 12 total, 12 up, 12 in 2024-04-21T19:31:06.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:05 smithi077 ceph-mon[27902]: osdmap e1170: 12 total, 12 up, 12 in 2024-04-21T19:31:06.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:05 smithi191 ceph-mon[31636]: osdmap e1170: 12 total, 12 up, 12 in 2024-04-21T19:31:07.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:06 smithi170 ceph-mon[31212]: pgmap v17571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:07.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:06 smithi077 ceph-mon[27902]: pgmap v17571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:07.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:06 smithi191 ceph-mon[31636]: pgmap v17571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:08.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32778.981315 secs 2024-04-21T19:31:08.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32778.981315 secs 2024-04-21T19:31:08.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32778.981315 secs 2024-04-21T19:31:09.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:08 smithi170 ceph-mon[31212]: pgmap v17572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:09.091 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:08 smithi191 ceph-mon[31636]: pgmap v17572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:09.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:08 smithi077 ceph-mon[27902]: pgmap v17572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:10.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32780.739461 secs 2024-04-21T19:31:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:10.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32780.739461 secs 2024-04-21T19:31:10.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32780.739461 secs 2024-04-21T19:31:11.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:10 smithi170 ceph-mon[31212]: pgmap v17573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:11.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:10 smithi077 ceph-mon[27902]: pgmap v17573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:11.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:10 smithi191 ceph-mon[31636]: pgmap v17573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:31:13.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:12 smithi170 ceph-mon[31212]: pgmap v17574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:31:13.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32783.981449 secs 2024-04-21T19:31:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:12 smithi077 ceph-mon[27902]: pgmap v17574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:31:13.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32783.981449 secs 2024-04-21T19:31:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:12 smithi191 ceph-mon[31636]: pgmap v17574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:31:13.190 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32783.981449 secs 2024-04-21T19:31:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:14 smithi077 ceph-mon[27902]: osdmap e1171: 12 total, 12 up, 12 in 2024-04-21T19:31:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:14 smithi077 ceph-mon[27902]: pgmap v17576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:31:14.857 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32785.739524 secs 2024-04-21T19:31:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:14 smithi191 ceph-mon[31636]: osdmap e1171: 12 total, 12 up, 12 in 2024-04-21T19:31:14.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:14 smithi191 ceph-mon[31636]: pgmap v17576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:31:14.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32785.739524 secs 2024-04-21T19:31:15.028 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:14 smithi170 ceph-mon[31212]: osdmap e1171: 12 total, 12 up, 12 in 2024-04-21T19:31:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:14 smithi170 ceph-mon[31212]: pgmap v17576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:31:15.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32785.739524 secs 2024-04-21T19:31:15.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:16.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:16 smithi191 ceph-mon[31636]: pgmap v17577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:17.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:16 smithi170 ceph-mon[31212]: pgmap v17577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:17.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:16 smithi077 ceph-mon[27902]: pgmap v17577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:17.940 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32788.981563 secs 2024-04-21T19:31:18.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32788.981563 secs 2024-04-21T19:31:18.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32788.981563 secs 2024-04-21T19:31:18.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:18 smithi191 ceph-mon[31636]: pgmap v17578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:19.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:18 smithi170 ceph-mon[31212]: pgmap v17578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:19.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:18 smithi077 ceph-mon[27902]: pgmap v17578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:19.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32790.739658 secs 2024-04-21T19:31:20.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32790.739658 secs 2024-04-21T19:31:20.101 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:20.107 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32790.739658 secs 2024-04-21T19:31:21.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:20 smithi170 ceph-mon[31212]: pgmap v17579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:21.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:20 smithi077 ceph-mon[27902]: pgmap v17579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:21.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:20 smithi191 ceph-mon[31636]: pgmap v17579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:31:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:22 smithi170 ceph-mon[31212]: pgmap v17580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:31:23.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32793.981695 secs 2024-04-21T19:31:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:22 smithi077 ceph-mon[27902]: pgmap v17580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:31:23.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32793.981695 secs 2024-04-21T19:31:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:22 smithi191 ceph-mon[31636]: pgmap v17580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:31:23.191 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32793.981695 secs 2024-04-21T19:31:24.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:24 smithi077 ceph-mon[27902]: pgmap v17581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:31:24.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32795.739803 secs 2024-04-21T19:31:24.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:24 smithi191 ceph-mon[31636]: pgmap v17581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:31:24.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32795.739803 secs 2024-04-21T19:31:25.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:24 smithi170 ceph-mon[31212]: pgmap v17581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:31:25.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32795.739803 secs 2024-04-21T19:31:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:25.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:31:25.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:31:25.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:31:25.858 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:31:25.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:31:25.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:31:25.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:31:25.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:31:26.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:31:26.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:31:26.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:31:26.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:31:26.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:26 smithi191 ceph-mon[31636]: pgmap v17582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:27.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:26 smithi170 ceph-mon[31212]: pgmap v17582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:27.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:26 smithi077 ceph-mon[27902]: pgmap v17582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:27.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32798.981812 secs 2024-04-21T19:31:28.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32798.981812 secs 2024-04-21T19:31:28.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32798.981812 secs 2024-04-21T19:31:28.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:28 smithi191 ceph-mon[31636]: pgmap v17583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:29.010 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:28 smithi077 ceph-mon[27902]: pgmap v17583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:29.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:28 smithi170 ceph-mon[31212]: pgmap v17583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:29.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32800.739918 secs 2024-04-21T19:31:30.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32800.739918 secs 2024-04-21T19:31:30.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:30.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32800.739918 secs 2024-04-21T19:31:30.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:30 smithi191 ceph-mon[31636]: pgmap v17584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:31.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:30 smithi170 ceph-mon[31212]: pgmap v17584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:31.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:30 smithi077 ceph-mon[27902]: pgmap v17584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:32 smithi191 ceph-mon[31636]: pgmap v17585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32803.981892 secs 2024-04-21T19:31:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:32 smithi170 ceph-mon[31212]: pgmap v17585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:33.029 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32803.981892 secs 2024-04-21T19:31:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:32 smithi077 ceph-mon[27902]: pgmap v17585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:33.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32803.981892 secs 2024-04-21T19:31:34.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:34 smithi191 ceph-mon[31636]: pgmap v17586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:34.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32805.740034 secs 2024-04-21T19:31:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:34 smithi170 ceph-mon[31212]: pgmap v17586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:35.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32805.740034 secs 2024-04-21T19:31:35.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:35.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:34 smithi077 ceph-mon[27902]: pgmap v17586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:35.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32805.740034 secs 2024-04-21T19:31:36.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:36 smithi191 ceph-mon[31636]: pgmap v17587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:37.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:36 smithi170 ceph-mon[31212]: pgmap v17587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:37.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:36 smithi077 ceph-mon[27902]: pgmap v17587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:37.931 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32808.981973 secs 2024-04-21T19:31:37.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32808.981973 secs 2024-04-21T19:31:38.108 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32808.981973 secs 2024-04-21T19:31:38.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:38 smithi191 ceph-mon[31636]: pgmap v17588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:39.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:38 smithi170 ceph-mon[31212]: pgmap v17588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:39.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:38 smithi077 ceph-mon[27902]: pgmap v17588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:39.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32810.740125 secs 2024-04-21T19:31:40.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32810.740125 secs 2024-04-21T19:31:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 32995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:40.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32810.740125 secs 2024-04-21T19:31:40.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:40 smithi191 ceph-mon[31636]: pgmap v17589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:41.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:40 smithi170 ceph-mon[31212]: pgmap v17589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:41.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:40 smithi077 ceph-mon[27902]: pgmap v17589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:42 smithi191 ceph-mon[31636]: pgmap v17590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:42.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32813.982056 secs 2024-04-21T19:31:43.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:42 smithi170 ceph-mon[31212]: pgmap v17590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:43.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32813.982056 secs 2024-04-21T19:31:43.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:42 smithi077 ceph-mon[27902]: pgmap v17590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:43.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32813.982056 secs 2024-04-21T19:31:44.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:44 smithi191 ceph-mon[31636]: pgmap v17591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:44.950 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32815.740192 secs 2024-04-21T19:31:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:44 smithi170 ceph-mon[31212]: pgmap v17591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:45.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32815.740192 secs 2024-04-21T19:31:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:45.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:44 smithi077 ceph-mon[27902]: pgmap v17591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:45.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32815.740192 secs 2024-04-21T19:31:46.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:46 smithi191 ceph-mon[31636]: pgmap v17592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:47.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:46 smithi170 ceph-mon[31212]: pgmap v17592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:47.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:46 smithi077 ceph-mon[27902]: pgmap v17592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:47.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32818.982185 secs 2024-04-21T19:31:48.030 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32818.982185 secs 2024-04-21T19:31:48.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32818.982185 secs 2024-04-21T19:31:48.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:48 smithi191 ceph-mon[31636]: pgmap v17593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:49.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:48 smithi170 ceph-mon[31212]: pgmap v17593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:49.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:48 smithi077 ceph-mon[27902]: pgmap v17593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:49.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32820.740309 secs 2024-04-21T19:31:50.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32820.740309 secs 2024-04-21T19:31:50.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:50.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32820.740309 secs 2024-04-21T19:31:50.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:50 smithi191 ceph-mon[31636]: pgmap v17594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:51.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:50 smithi170 ceph-mon[31212]: pgmap v17594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:51.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:50 smithi077 ceph-mon[27902]: pgmap v17594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:52 smithi191 ceph-mon[31636]: pgmap v17595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:52.943 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32823.982274 secs 2024-04-21T19:31:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:52 smithi170 ceph-mon[31212]: pgmap v17595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:53.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32823.982274 secs 2024-04-21T19:31:53.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:52 smithi077 ceph-mon[27902]: pgmap v17595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:53.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32823.982274 secs 2024-04-21T19:31:54.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:54 smithi191 ceph-mon[31636]: pgmap v17596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:54.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32825.740441 secs 2024-04-21T19:31:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:54 smithi170 ceph-mon[31212]: pgmap v17596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:55.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32825.740441 secs 2024-04-21T19:31:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:31:55.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:54 smithi077 ceph-mon[27902]: pgmap v17596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:55.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32825.740441 secs 2024-04-21T19:31:56.972 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:56 smithi077 ceph-mon[27902]: pgmap v17597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:57.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:56 smithi170 ceph-mon[31212]: pgmap v17597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:57.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:56 smithi191 ceph-mon[31636]: pgmap v17597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:31:58.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32828.982391 secs 2024-04-21T19:31:58.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32828.982391 secs 2024-04-21T19:31:58.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32828.982391 secs 2024-04-21T19:31:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:31:58.894+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:31:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:31:58.894+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:31:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:31:58.894+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:31:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:31:58.894+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:31:59.011 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:58 smithi077 ceph-mon[27902]: pgmap v17598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:59.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:58 smithi170 ceph-mon[31212]: pgmap v17598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:31:59.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:58 smithi191 ceph-mon[31636]: pgmap v17598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:00.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32830.740583 secs 2024-04-21T19:32:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:00.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32830.740583 secs 2024-04-21T19:32:00.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32830.740583 secs 2024-04-21T19:32:01.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:00 smithi170 ceph-mon[31212]: pgmap v17599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:01.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:00 smithi077 ceph-mon[27902]: pgmap v17599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:01.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:00 smithi191 ceph-mon[31636]: pgmap v17599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:03.031 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:02 smithi170 ceph-mon[31212]: pgmap v17600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:03.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32833.982481 secs 2024-04-21T19:32:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:02 smithi077 ceph-mon[27902]: pgmap v17600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:03.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32833.982481 secs 2024-04-21T19:32:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:02 smithi191 ceph-mon[31636]: pgmap v17600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:03.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32833.982481 secs 2024-04-21T19:32:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:04 smithi170 ceph-mon[31212]: pgmap v17601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:05.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32835.740701 secs 2024-04-21T19:32:05.104 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:04 smithi077 ceph-mon[27902]: pgmap v17601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:05.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32835.740701 secs 2024-04-21T19:32:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:04 smithi191 ceph-mon[31636]: pgmap v17601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:05.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32835.740701 secs 2024-04-21T19:32:06.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:05 smithi170 ceph-mon[31212]: osdmap e1172: 12 total, 12 up, 12 in 2024-04-21T19:32:06.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:05 smithi077 ceph-mon[27902]: osdmap e1172: 12 total, 12 up, 12 in 2024-04-21T19:32:06.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:05 smithi191 ceph-mon[31636]: osdmap e1172: 12 total, 12 up, 12 in 2024-04-21T19:32:07.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:06 smithi170 ceph-mon[31212]: pgmap v17603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:07.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:06 smithi077 ceph-mon[27902]: pgmap v17603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:07.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:06 smithi191 ceph-mon[31636]: pgmap v17603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:08.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32838.982613 secs 2024-04-21T19:32:08.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32838.982613 secs 2024-04-21T19:32:08.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32838.982613 secs 2024-04-21T19:32:09.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:08 smithi170 ceph-mon[31212]: pgmap v17604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:09.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:08 smithi191 ceph-mon[31636]: pgmap v17604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:09.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:08 smithi077 ceph-mon[27902]: pgmap v17604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:10.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32840.740812 secs 2024-04-21T19:32:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:10.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32840.740812 secs 2024-04-21T19:32:10.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32840.740812 secs 2024-04-21T19:32:11.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:10 smithi170 ceph-mon[31212]: pgmap v17605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:11.110 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:10 smithi077 ceph-mon[27902]: pgmap v17605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:11.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:10 smithi191 ceph-mon[31636]: pgmap v17605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:32:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:12 smithi170 ceph-mon[31212]: pgmap v17606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:32:13.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32843.982757 secs 2024-04-21T19:32:13.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:12 smithi077 ceph-mon[27902]: pgmap v17606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:32:13.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32843.982757 secs 2024-04-21T19:32:13.193 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:12 smithi191 ceph-mon[31636]: pgmap v17606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:32:13.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32843.982757 secs 2024-04-21T19:32:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:14 smithi191 ceph-mon[31636]: osdmap e1173: 12 total, 12 up, 12 in 2024-04-21T19:32:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:14 smithi191 ceph-mon[31636]: pgmap v17608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:32:14.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32845.740933 secs 2024-04-21T19:32:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:14 smithi170 ceph-mon[31212]: osdmap e1173: 12 total, 12 up, 12 in 2024-04-21T19:32:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:14 smithi170 ceph-mon[31212]: pgmap v17608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:32:15.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32845.740933 secs 2024-04-21T19:32:15.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:15.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:14 smithi077 ceph-mon[27902]: osdmap e1173: 12 total, 12 up, 12 in 2024-04-21T19:32:15.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:14 smithi077 ceph-mon[27902]: pgmap v17608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:32:15.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32845.740933 secs 2024-04-21T19:32:16.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:16 smithi191 ceph-mon[31636]: pgmap v17609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:17.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:16 smithi170 ceph-mon[31212]: pgmap v17609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:17.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:16 smithi077 ceph-mon[27902]: pgmap v17609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:18.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32848.982879 secs 2024-04-21T19:32:18.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32848.982879 secs 2024-04-21T19:32:18.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32848.982879 secs 2024-04-21T19:32:19.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:18 smithi170 ceph-mon[31212]: pgmap v17610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:19.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:18 smithi077 ceph-mon[27902]: pgmap v17610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:19.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:18 smithi191 ceph-mon[31636]: pgmap v17610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:20.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32850.741041 secs 2024-04-21T19:32:20.105 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:20.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32850.741041 secs 2024-04-21T19:32:20.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32850.741041 secs 2024-04-21T19:32:21.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:20 smithi170 ceph-mon[31212]: pgmap v17611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:21.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:20 smithi077 ceph-mon[27902]: pgmap v17611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:21.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:20 smithi191 ceph-mon[31636]: pgmap v17611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:32:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:22 smithi170 ceph-mon[31212]: pgmap v17612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:32:23.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32853.982996 secs 2024-04-21T19:32:23.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:22 smithi077 ceph-mon[27902]: pgmap v17612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:32:23.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32853.982996 secs 2024-04-21T19:32:23.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:22 smithi191 ceph-mon[31636]: pgmap v17612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:32:23.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32853.982996 secs 2024-04-21T19:32:24.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:24 smithi191 ceph-mon[31636]: pgmap v17613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:32:24.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32855.741284 secs 2024-04-21T19:32:25.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:24 smithi170 ceph-mon[31212]: pgmap v17613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:32:25.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32855.741284 secs 2024-04-21T19:32:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:25.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:24 smithi077 ceph-mon[27902]: pgmap v17613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:32:25.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32855.741284 secs 2024-04-21T19:32:25.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:32:26.032 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:32:26.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:32:26.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:26 smithi191 ceph-mon[31636]: pgmap v17614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:26.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:32:26.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:32:26.946 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:32:27.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:26 smithi170 ceph-mon[31212]: pgmap v17614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:27.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:32:27.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:32:27.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:32:27.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:26 smithi077 ceph-mon[27902]: pgmap v17614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:27.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:32:27.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:32:27.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:32:27.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32858.983077 secs 2024-04-21T19:32:28.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32858.983077 secs 2024-04-21T19:32:28.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32858.983077 secs 2024-04-21T19:32:28.945 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:28 smithi191 ceph-mon[31636]: pgmap v17615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:29.013 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:28 smithi077 ceph-mon[27902]: pgmap v17615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:29.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:28 smithi170 ceph-mon[31212]: pgmap v17615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:29.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32860.741353 secs 2024-04-21T19:32:30.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32860.741353 secs 2024-04-21T19:32:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:30.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32860.741353 secs 2024-04-21T19:32:31.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:30 smithi170 ceph-mon[31212]: pgmap v17616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:31.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:30 smithi077 ceph-mon[27902]: pgmap v17616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:31.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:30 smithi191 ceph-mon[31636]: pgmap v17616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:33.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:32 smithi170 ceph-mon[31212]: pgmap v17617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:33.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32863.983155 secs 2024-04-21T19:32:33.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:32 smithi077 ceph-mon[27902]: pgmap v17617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:33.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32863.983155 secs 2024-04-21T19:32:33.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:32 smithi191 ceph-mon[31636]: pgmap v17617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:33.194 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32863.983155 secs 2024-04-21T19:32:35.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:34 smithi170 ceph-mon[31212]: pgmap v17618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:35.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32865.741418 secs 2024-04-21T19:32:35.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:34 smithi077 ceph-mon[27902]: pgmap v17618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:35.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32865.741418 secs 2024-04-21T19:32:35.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:34 smithi191 ceph-mon[31636]: pgmap v17618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:35.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32865.741418 secs 2024-04-21T19:32:37.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:36 smithi170 ceph-mon[31212]: pgmap v17619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:37.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:36 smithi077 ceph-mon[27902]: pgmap v17619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:37.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:36 smithi191 ceph-mon[31636]: pgmap v17619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:38.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32868.983270 secs 2024-04-21T19:32:38.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32868.983270 secs 2024-04-21T19:32:38.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32868.983270 secs 2024-04-21T19:32:39.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:38 smithi170 ceph-mon[31212]: pgmap v17620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:38 smithi191 ceph-mon[31636]: pgmap v17620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:39.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:38 smithi077 ceph-mon[27902]: pgmap v17620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:40.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32870.741530 secs 2024-04-21T19:32:40.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:40.111 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32870.741530 secs 2024-04-21T19:32:40.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32870.741530 secs 2024-04-21T19:32:41.033 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:40 smithi170 ceph-mon[31212]: pgmap v17621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:41.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:40 smithi077 ceph-mon[27902]: pgmap v17621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:41.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:40 smithi191 ceph-mon[31636]: pgmap v17621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:43.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:42 smithi170 ceph-mon[31212]: pgmap v17622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:43.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32873.983404 secs 2024-04-21T19:32:43.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:42 smithi077 ceph-mon[27902]: pgmap v17622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:43.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32873.983404 secs 2024-04-21T19:32:43.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:42 smithi191 ceph-mon[31636]: pgmap v17622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:43.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32873.983404 secs 2024-04-21T19:32:45.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:44 smithi170 ceph-mon[31212]: pgmap v17623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:45.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32875.741672 secs 2024-04-21T19:32:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:45.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:44 smithi077 ceph-mon[27902]: pgmap v17623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:45.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32875.741672 secs 2024-04-21T19:32:45.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:44 smithi191 ceph-mon[31636]: pgmap v17623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:45.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32875.741672 secs 2024-04-21T19:32:47.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:46 smithi170 ceph-mon[31212]: pgmap v17624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:47.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:46 smithi077 ceph-mon[27902]: pgmap v17624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:47.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:46 smithi191 ceph-mon[31636]: pgmap v17624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:48.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32878.983514 secs 2024-04-21T19:32:48.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32878.983514 secs 2024-04-21T19:32:48.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32878.983514 secs 2024-04-21T19:32:49.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:48 smithi170 ceph-mon[31212]: pgmap v17625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:49.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:48 smithi077 ceph-mon[27902]: pgmap v17625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:49.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:48 smithi191 ceph-mon[31636]: pgmap v17625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:50.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32880.741789 secs 2024-04-21T19:32:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:50.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32880.741789 secs 2024-04-21T19:32:50.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32880.741789 secs 2024-04-21T19:32:51.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:50 smithi170 ceph-mon[31212]: pgmap v17626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:51.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:50 smithi077 ceph-mon[27902]: pgmap v17626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:51.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:50 smithi191 ceph-mon[31636]: pgmap v17626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:53.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:52 smithi170 ceph-mon[31212]: pgmap v17627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:53.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32883.983629 secs 2024-04-21T19:32:53.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:52 smithi077 ceph-mon[27902]: pgmap v17627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:53.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32883.983629 secs 2024-04-21T19:32:53.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:52 smithi191 ceph-mon[31636]: pgmap v17627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:53.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32883.983629 secs 2024-04-21T19:32:55.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:54 smithi170 ceph-mon[31212]: pgmap v17628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:55.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32885.741917 secs 2024-04-21T19:32:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:32:55.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:54 smithi077 ceph-mon[27902]: pgmap v17628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:55.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32885.741917 secs 2024-04-21T19:32:55.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:54 smithi191 ceph-mon[31636]: pgmap v17628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:55.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32885.741917 secs 2024-04-21T19:32:57.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:56 smithi170 ceph-mon[31212]: pgmap v17629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:57.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:56 smithi077 ceph-mon[27902]: pgmap v17629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:57.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:56 smithi191 ceph-mon[31636]: pgmap v17629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:32:58.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32888.983749 secs 2024-04-21T19:32:58.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32888.983749 secs 2024-04-21T19:32:58.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32888.983749 secs 2024-04-21T19:32:59.014 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:58 smithi077 ceph-mon[27902]: pgmap v17630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:59.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:58 smithi170 ceph-mon[31212]: pgmap v17630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:32:59.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:58 smithi191 ceph-mon[31636]: pgmap v17630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:00.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32890.741995 secs 2024-04-21T19:33:00.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:00.112 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32890.741995 secs 2024-04-21T19:33:00.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32890.741995 secs 2024-04-21T19:33:01.034 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:00 smithi170 ceph-mon[31212]: pgmap v17631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:01.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:00 smithi077 ceph-mon[27902]: pgmap v17631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:01.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:00 smithi191 ceph-mon[31636]: pgmap v17631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:03.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:02 smithi170 ceph-mon[31212]: pgmap v17632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T19:33:03.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32893.983877 secs 2024-04-21T19:33:03.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:02 smithi077 ceph-mon[27902]: pgmap v17632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T19:33:03.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32893.983877 secs 2024-04-21T19:33:03.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:02 smithi191 ceph-mon[31636]: pgmap v17632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T19:33:03.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32893.983877 secs 2024-04-21T19:33:05.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:04 smithi170 ceph-mon[31212]: pgmap v17633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T19:33:05.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32895.742059 secs 2024-04-21T19:33:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:05.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:04 smithi077 ceph-mon[27902]: pgmap v17633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T19:33:05.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32895.742059 secs 2024-04-21T19:33:05.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:04 smithi191 ceph-mon[31636]: pgmap v17633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T19:33:05.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32895.742059 secs 2024-04-21T19:33:06.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:05 smithi077 ceph-mon[27902]: osdmap e1174: 12 total, 12 up, 12 in 2024-04-21T19:33:06.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:05 smithi191 ceph-mon[31636]: osdmap e1174: 12 total, 12 up, 12 in 2024-04-21T19:33:06.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:05 smithi170 ceph-mon[31212]: osdmap e1174: 12 total, 12 up, 12 in 2024-04-21T19:33:07.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:06 smithi077 ceph-mon[27902]: pgmap v17635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:07.186 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:06 smithi170 ceph-mon[31212]: pgmap v17635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:07.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:06 smithi191 ceph-mon[31636]: pgmap v17635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:08.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32898.983943 secs 2024-04-21T19:33:08.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32898.983943 secs 2024-04-21T19:33:08.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32898.983943 secs 2024-04-21T19:33:09.098 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:08 smithi191 ceph-mon[31636]: pgmap v17636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:09.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:08 smithi077 ceph-mon[27902]: pgmap v17636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:09.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:08 smithi170 ceph-mon[31212]: pgmap v17636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:10.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32900.742130 secs 2024-04-21T19:33:10.196 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32900.742130 secs 2024-04-21T19:33:10.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32900.742130 secs 2024-04-21T19:33:11.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:10 smithi077 ceph-mon[27902]: pgmap v17637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:11.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:10 smithi191 ceph-mon[31636]: pgmap v17637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:11.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:10 smithi170 ceph-mon[31212]: pgmap v17637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:33:13.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:12 smithi077 ceph-mon[27902]: pgmap v17638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:33:13.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32903.984063 secs 2024-04-21T19:33:13.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:12 smithi191 ceph-mon[31636]: pgmap v17638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:33:13.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32903.984063 secs 2024-04-21T19:33:13.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:12 smithi170 ceph-mon[31212]: pgmap v17638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T19:33:13.285 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32903.984063 secs 2024-04-21T19:33:14.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:14 smithi191 ceph-mon[31636]: osdmap e1175: 12 total, 12 up, 12 in 2024-04-21T19:33:14.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:14 smithi191 ceph-mon[31636]: pgmap v17640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-04-21T19:33:14.947 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32905.742206 secs 2024-04-21T19:33:15.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:14 smithi170 ceph-mon[31212]: osdmap e1175: 12 total, 12 up, 12 in 2024-04-21T19:33:15.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:14 smithi170 ceph-mon[31212]: pgmap v17640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-04-21T19:33:15.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32905.742206 secs 2024-04-21T19:33:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:15.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:14 smithi077 ceph-mon[27902]: osdmap e1175: 12 total, 12 up, 12 in 2024-04-21T19:33:15.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:14 smithi077 ceph-mon[27902]: pgmap v17640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-04-21T19:33:15.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32905.742206 secs 2024-04-21T19:33:17.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:16 smithi170 ceph-mon[31212]: pgmap v17641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:17.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:16 smithi077 ceph-mon[27902]: pgmap v17641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:17.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:16 smithi191 ceph-mon[31636]: pgmap v17641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:18.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32908.984188 secs 2024-04-21T19:33:18.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32908.984188 secs 2024-04-21T19:33:18.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32908.984188 secs 2024-04-21T19:33:19.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:18 smithi170 ceph-mon[31212]: pgmap v17642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:19.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:18 smithi077 ceph-mon[27902]: pgmap v17642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:19.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:18 smithi191 ceph-mon[31636]: pgmap v17642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:20.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32910.742343 secs 2024-04-21T19:33:20.109 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:20.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32910.742343 secs 2024-04-21T19:33:20.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32910.742343 secs 2024-04-21T19:33:21.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:20 smithi170 ceph-mon[31212]: pgmap v17643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:21.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:20 smithi077 ceph-mon[27902]: pgmap v17643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:21.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:20 smithi191 ceph-mon[31636]: pgmap v17643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:33:23.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:22 smithi170 ceph-mon[31212]: pgmap v17644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:33:23.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32913.984309 secs 2024-04-21T19:33:23.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:22 smithi077 ceph-mon[27902]: pgmap v17644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:33:23.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32913.984309 secs 2024-04-21T19:33:23.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:22 smithi191 ceph-mon[31636]: pgmap v17644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:33:23.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32913.984309 secs 2024-04-21T19:33:25.035 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:24 smithi170 ceph-mon[31212]: pgmap v17645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:33:25.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32915.742436 secs 2024-04-21T19:33:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:25.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:24 smithi077 ceph-mon[27902]: pgmap v17645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:33:25.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32915.742436 secs 2024-04-21T19:33:25.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:24 smithi191 ceph-mon[31636]: pgmap v17645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:33:25.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32915.742436 secs 2024-04-21T19:33:27.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:26 smithi170 ceph-mon[31212]: pgmap v17646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:27.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:33:27.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:26 smithi077 ceph-mon[27902]: pgmap v17646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:27.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:33:27.143 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:26 smithi191 ceph-mon[31636]: pgmap v17646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:27.143 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:33:28.036 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32918.984412 secs 2024-04-21T19:33:28.114 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32918.984412 secs 2024-04-21T19:33:28.197 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32918.984412 secs 2024-04-21T19:33:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:33:28.906+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:33:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:33:28.906+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:33:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:33:28.907+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:33:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:33:28.907+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: pgmap v17647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: pgmap v17647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:29.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: pgmap v17647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:29.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:29.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32920.742523 secs 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:33:30.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32920.742523 secs 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:33:30.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32920.742523 secs 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:33:30.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:33:31.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:31 smithi170 ceph-mon[31212]: pgmap v17648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:31.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:33:31.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:33:31.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:33:31.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:33:31.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:33:31.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:33:31.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:31 smithi077 ceph-mon[27902]: pgmap v17648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:31.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:33:31.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:33:31.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:33:31.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:33:31.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:33:31.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:33:31.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:31 smithi191 ceph-mon[31636]: pgmap v17648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:33.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:33 smithi170 ceph-mon[31212]: pgmap v17649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:33.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32923.984548 secs 2024-04-21T19:33:33.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:33 smithi077 ceph-mon[27902]: pgmap v17649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:33.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32923.984548 secs 2024-04-21T19:33:33.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:33 smithi191 ceph-mon[31636]: pgmap v17649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:33.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32923.984548 secs 2024-04-21T19:33:35.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:35.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:35 smithi170 ceph-mon[31212]: pgmap v17650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:35.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32925.742635 secs 2024-04-21T19:33:35.364 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:35 smithi077 ceph-mon[27902]: pgmap v17650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:35.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32925.742635 secs 2024-04-21T19:33:35.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:35 smithi191 ceph-mon[31636]: pgmap v17650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:35.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32925.742635 secs 2024-04-21T19:33:37.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:37 smithi170 ceph-mon[31212]: pgmap v17651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:37.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:37 smithi077 ceph-mon[27902]: pgmap v17651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:37.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:37 smithi191 ceph-mon[31636]: pgmap v17651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:38.271 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32928.984683 secs 2024-04-21T19:33:38.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32928.984683 secs 2024-04-21T19:33:38.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32928.984683 secs 2024-04-21T19:33:39.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:39 smithi170 ceph-mon[31212]: pgmap v17652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:39.349 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:39 smithi191 ceph-mon[31636]: pgmap v17652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:39.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:39 smithi077 ceph-mon[27902]: pgmap v17652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:40.108 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:40.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32930.742768 secs 2024-04-21T19:33:40.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32930.742768 secs 2024-04-21T19:33:40.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32930.742768 secs 2024-04-21T19:33:41.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:41 smithi170 ceph-mon[31212]: pgmap v17653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:41.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:41 smithi077 ceph-mon[27902]: pgmap v17653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:41.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:41 smithi191 ceph-mon[31636]: pgmap v17653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:43.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:43 smithi170 ceph-mon[31212]: pgmap v17654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:43.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32933.984830 secs 2024-04-21T19:33:43.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:43 smithi077 ceph-mon[27902]: pgmap v17654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:43.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32933.984830 secs 2024-04-21T19:33:43.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:43 smithi191 ceph-mon[31636]: pgmap v17654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:43.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32933.984830 secs 2024-04-21T19:33:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:45.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:45 smithi170 ceph-mon[31212]: pgmap v17655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:45.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32935.742911 secs 2024-04-21T19:33:45.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:45 smithi077 ceph-mon[27902]: pgmap v17655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:45.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32935.742911 secs 2024-04-21T19:33:45.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:45 smithi191 ceph-mon[31636]: pgmap v17655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:45.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32935.742911 secs 2024-04-21T19:33:47.287 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:47 smithi170 ceph-mon[31212]: pgmap v17656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:47.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:47 smithi077 ceph-mon[27902]: pgmap v17656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:47.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:47 smithi191 ceph-mon[31636]: pgmap v17656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:48.286 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32938.984948 secs 2024-04-21T19:33:48.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32938.984948 secs 2024-04-21T19:33:48.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32938.984948 secs 2024-04-21T19:33:49.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:49 smithi077 ceph-mon[27902]: pgmap v17657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:49.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:49 smithi191 ceph-mon[31636]: pgmap v17657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:49.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:49 smithi170 ceph-mon[31212]: pgmap v17657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:50.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32940.743015 secs 2024-04-21T19:33:50.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32940.743015 secs 2024-04-21T19:33:50.536 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32940.743015 secs 2024-04-21T19:33:51.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:51 smithi077 ceph-mon[27902]: pgmap v17658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:51.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:51 smithi191 ceph-mon[31636]: pgmap v17658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:51.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:51 smithi170 ceph-mon[31212]: pgmap v17658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:53.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:53 smithi077 ceph-mon[27902]: pgmap v17659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:53.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32943.985069 secs 2024-04-21T19:33:53.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:53 smithi191 ceph-mon[31636]: pgmap v17659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:53.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32943.985069 secs 2024-04-21T19:33:53.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:53 smithi170 ceph-mon[31212]: pgmap v17659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:53.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32943.985069 secs 2024-04-21T19:33:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:33:55.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:55 smithi077 ceph-mon[27902]: pgmap v17660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:55.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32945.743130 secs 2024-04-21T19:33:55.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:55 smithi191 ceph-mon[31636]: pgmap v17660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:55.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32945.743130 secs 2024-04-21T19:33:55.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:55 smithi170 ceph-mon[31212]: pgmap v17660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:55.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32945.743130 secs 2024-04-21T19:33:57.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:57 smithi077 ceph-mon[27902]: pgmap v17661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:57.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:57 smithi191 ceph-mon[31636]: pgmap v17661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:57.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:57 smithi170 ceph-mon[31212]: pgmap v17661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:33:58.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32948.985192 secs 2024-04-21T19:33:58.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32948.985192 secs 2024-04-21T19:33:58.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32948.985192 secs 2024-04-21T19:33:59.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:33:59 smithi077 ceph-mon[27902]: pgmap v17662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:59.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:33:59 smithi191 ceph-mon[31636]: pgmap v17662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:33:59.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:33:59 smithi170 ceph-mon[31212]: pgmap v17662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:00.365 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32950.743266 secs 2024-04-21T19:34:00.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32950.743266 secs 2024-04-21T19:34:00.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32950.743266 secs 2024-04-21T19:34:01.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:01 smithi077 ceph-mon[27902]: pgmap v17663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:01.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:01 smithi191 ceph-mon[31636]: pgmap v17663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:01.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:01 smithi170 ceph-mon[31212]: pgmap v17663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:03.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:03 smithi077 ceph-mon[27902]: pgmap v17664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:03.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32953.985305 secs 2024-04-21T19:34:03.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:03 smithi191 ceph-mon[31636]: pgmap v17664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:03.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32953.985305 secs 2024-04-21T19:34:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:03 smithi170 ceph-mon[31212]: pgmap v17664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:03.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32953.985305 secs 2024-04-21T19:34:05.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:05 smithi077 ceph-mon[27902]: pgmap v17665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:05.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32955.743383 secs 2024-04-21T19:34:05.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:05 smithi077 ceph-mon[27902]: osdmap e1176: 12 total, 12 up, 12 in 2024-04-21T19:34:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:05 smithi191 ceph-mon[31636]: pgmap v17665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32955.743383 secs 2024-04-21T19:34:05.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:05 smithi191 ceph-mon[31636]: osdmap e1176: 12 total, 12 up, 12 in 2024-04-21T19:34:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:05 smithi170 ceph-mon[31212]: pgmap v17665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:05.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32955.743383 secs 2024-04-21T19:34:05.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:05 smithi170 ceph-mon[31212]: osdmap e1176: 12 total, 12 up, 12 in 2024-04-21T19:34:07.340 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:07 smithi170 ceph-mon[31212]: pgmap v17667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:34:07.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:07 smithi077 ceph-mon[27902]: pgmap v17667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:34:07.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:07 smithi191 ceph-mon[31636]: pgmap v17667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:34:08.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32958.985443 secs 2024-04-21T19:34:08.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32958.985443 secs 2024-04-21T19:34:08.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32958.985443 secs 2024-04-21T19:34:09.350 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:09 smithi191 ceph-mon[31636]: pgmap v17668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:34:09.351 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:09 smithi191 ceph-mon[31636]: osdmap e1177: 12 total, 12 up, 12 in 2024-04-21T19:34:09.351 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32960.743467 secs 2024-04-21T19:34:09.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:09 smithi077 ceph-mon[27902]: pgmap v17668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:34:09.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:09 smithi077 ceph-mon[27902]: osdmap e1177: 12 total, 12 up, 12 in 2024-04-21T19:34:09.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32960.743467 secs 2024-04-21T19:34:09.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:09 smithi170 ceph-mon[31212]: pgmap v17668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:34:09.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:09 smithi170 ceph-mon[31212]: osdmap e1177: 12 total, 12 up, 12 in 2024-04-21T19:34:09.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32960.743467 secs 2024-04-21T19:34:10.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:11.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:11 smithi077 ceph-mon[27902]: pgmap v17670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:34:11.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:11 smithi191 ceph-mon[31636]: pgmap v17670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:34:11.537 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:11 smithi170 ceph-mon[31212]: pgmap v17670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:34:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:13 smithi077 ceph-mon[27902]: pgmap v17671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:34:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32963.985511 secs 2024-04-21T19:34:13.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:13 smithi191 ceph-mon[31636]: pgmap v17671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:34:13.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32963.985511 secs 2024-04-21T19:34:13.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:13 smithi170 ceph-mon[31212]: pgmap v17671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:34:13.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32963.985511 secs 2024-04-21T19:34:14.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32965.743586 secs 2024-04-21T19:34:14.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32965.743586 secs 2024-04-21T19:34:14.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32965.743586 secs 2024-04-21T19:34:15.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:15.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:15 smithi077 ceph-mon[27902]: pgmap v17672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:34:15.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:15 smithi191 ceph-mon[31636]: pgmap v17672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:34:15.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:15 smithi170 ceph-mon[31212]: pgmap v17672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:34:17.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:17 smithi077 ceph-mon[27902]: pgmap v17673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:34:17.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:17 smithi191 ceph-mon[31636]: pgmap v17673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:34:17.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:17 smithi170 ceph-mon[31212]: pgmap v17673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:34:18.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32968.985629 secs 2024-04-21T19:34:18.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32968.985629 secs 2024-04-21T19:34:18.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32968.985629 secs 2024-04-21T19:34:19.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:19 smithi077 ceph-mon[27902]: pgmap v17674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:34:19.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32970.743705 secs 2024-04-21T19:34:19.449 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:19 smithi191 ceph-mon[31636]: pgmap v17674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:34:19.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32970.743705 secs 2024-04-21T19:34:19.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:19 smithi170 ceph-mon[31212]: pgmap v17674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:34:19.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32970.743705 secs 2024-04-21T19:34:20.110 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:21.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:21 smithi191 ceph-mon[31636]: pgmap v17675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:34:21.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:21 smithi170 ceph-mon[31212]: pgmap v17675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:34:21.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:21 smithi077 ceph-mon[27902]: pgmap v17675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:34:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:23 smithi191 ceph-mon[31636]: pgmap v17676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:34:23.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32973.985756 secs 2024-04-21T19:34:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:23 smithi170 ceph-mon[31212]: pgmap v17676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:34:23.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32973.985756 secs 2024-04-21T19:34:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:23 smithi077 ceph-mon[27902]: pgmap v17676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:34:23.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32973.985756 secs 2024-04-21T19:34:24.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32975.743824 secs 2024-04-21T19:34:24.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32975.743824 secs 2024-04-21T19:34:24.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32975.743824 secs 2024-04-21T19:34:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:25.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:25 smithi191 ceph-mon[31636]: pgmap v17677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:25.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:25 smithi170 ceph-mon[31212]: pgmap v17677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:25.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:25 smithi077 ceph-mon[27902]: pgmap v17677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:27.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:27 smithi191 ceph-mon[31636]: pgmap v17678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:27.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:27 smithi170 ceph-mon[31212]: pgmap v17678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:27.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:27 smithi077 ceph-mon[27902]: pgmap v17678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:28.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32978.985853 secs 2024-04-21T19:34:28.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32978.985853 secs 2024-04-21T19:34:28.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32978.985853 secs 2024-04-21T19:34:29.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:29 smithi191 ceph-mon[31636]: pgmap v17679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:29.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32980.743900 secs 2024-04-21T19:34:29.518 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:29 smithi077 ceph-mon[27902]: pgmap v17679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:29.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32980.743900 secs 2024-04-21T19:34:29.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:29 smithi170 ceph-mon[31212]: pgmap v17679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:29.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32980.743900 secs 2024-04-21T19:34:30.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:30.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:34:30.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:30.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:30.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:34:30.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:30.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:34:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:30.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:31.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:31 smithi077 ceph-mon[27902]: pgmap v17680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:31.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:34:31.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:34:31.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:31.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:31 smithi191 ceph-mon[31636]: pgmap v17680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:31.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:34:31.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:34:31.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:31.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:31 smithi170 ceph-mon[31212]: pgmap v17680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:31.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:34:31.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:34:31.538 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:34:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:33 smithi191 ceph-mon[31636]: pgmap v17681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:33.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32983.985949 secs 2024-04-21T19:34:33.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:33 smithi170 ceph-mon[31212]: pgmap v17681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:33.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32983.985949 secs 2024-04-21T19:34:33.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:33 smithi077 ceph-mon[27902]: pgmap v17681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:33.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32983.985949 secs 2024-04-21T19:34:34.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32985.743978 secs 2024-04-21T19:34:34.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32985.743978 secs 2024-04-21T19:34:34.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32985.743978 secs 2024-04-21T19:34:35.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:35.451 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:35 smithi191 ceph-mon[31636]: pgmap v17682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:35.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:35 smithi170 ceph-mon[31212]: pgmap v17682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:35.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:35 smithi077 ceph-mon[27902]: pgmap v17682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:36.539 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:36 smithi170 ceph-mon[31212]: pgmap v17683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:36.617 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:36 smithi077 ceph-mon[27902]: pgmap v17683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:36.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:36 smithi191 ceph-mon[31636]: pgmap v17683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:37.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32988.986014 secs 2024-04-21T19:34:37.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32988.986014 secs 2024-04-21T19:34:37.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32988.986014 secs 2024-04-21T19:34:38.700 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:38 smithi191 ceph-mon[31636]: pgmap v17684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:38.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:38 smithi170 ceph-mon[31212]: pgmap v17684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:38.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:38 smithi077 ceph-mon[27902]: pgmap v17684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:39.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32990.744107 secs 2024-04-21T19:34:39.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32990.744107 secs 2024-04-21T19:34:39.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32990.744107 secs 2024-04-21T19:34:40.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:40.701 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:40 smithi191 ceph-mon[31636]: pgmap v17685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:40.789 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:40 smithi170 ceph-mon[31212]: pgmap v17685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:40.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:40 smithi077 ceph-mon[27902]: pgmap v17685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:43.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:42 smithi170 ceph-mon[31212]: pgmap v17686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:43.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32993.986106 secs 2024-04-21T19:34:43.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:42 smithi077 ceph-mon[27902]: pgmap v17686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:43.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32993.986106 secs 2024-04-21T19:34:43.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:42 smithi191 ceph-mon[31636]: pgmap v17686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:43.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32993.986106 secs 2024-04-21T19:34:45.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:44 smithi170 ceph-mon[31212]: pgmap v17687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:45.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 32995.744193 secs 2024-04-21T19:34:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:45.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:44 smithi077 ceph-mon[27902]: pgmap v17687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:45.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 32995.744193 secs 2024-04-21T19:34:45.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:44 smithi191 ceph-mon[31636]: pgmap v17687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:45.200 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 32995.744193 secs 2024-04-21T19:34:47.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:46 smithi170 ceph-mon[31212]: pgmap v17688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:47.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:46 smithi077 ceph-mon[27902]: pgmap v17688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:47.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:46 smithi191 ceph-mon[31636]: pgmap v17688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:48.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 32998.986224 secs 2024-04-21T19:34:48.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 32998.986224 secs 2024-04-21T19:34:48.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 32998.986224 secs 2024-04-21T19:34:49.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:48 smithi170 ceph-mon[31212]: pgmap v17689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:49.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:48 smithi077 ceph-mon[27902]: pgmap v17689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:49.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:48 smithi191 ceph-mon[31636]: pgmap v17689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:50.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33000.744330 secs 2024-04-21T19:34:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:50.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33000.744330 secs 2024-04-21T19:34:50.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33000.744330 secs 2024-04-21T19:34:51.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:50 smithi170 ceph-mon[31212]: pgmap v17690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:51.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:50 smithi077 ceph-mon[27902]: pgmap v17690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:51.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:50 smithi191 ceph-mon[31636]: pgmap v17690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:53.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:52 smithi170 ceph-mon[31212]: pgmap v17691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:53.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33003.986354 secs 2024-04-21T19:34:53.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:52 smithi077 ceph-mon[27902]: pgmap v17691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:53.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33003.986354 secs 2024-04-21T19:34:53.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:52 smithi191 ceph-mon[31636]: pgmap v17691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:53.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33003.986354 secs 2024-04-21T19:34:55.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:54 smithi170 ceph-mon[31212]: pgmap v17692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:55.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33005.744477 secs 2024-04-21T19:34:55.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:34:55.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:54 smithi077 ceph-mon[27902]: pgmap v17692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:55.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33005.744477 secs 2024-04-21T19:34:55.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:54 smithi191 ceph-mon[31636]: pgmap v17692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:55.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33005.744477 secs 2024-04-21T19:34:57.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:56 smithi170 ceph-mon[31212]: pgmap v17693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:57.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:56 smithi077 ceph-mon[27902]: pgmap v17693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:57.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:56 smithi191 ceph-mon[31636]: pgmap v17693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:34:58.039 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33008.986481 secs 2024-04-21T19:34:58.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33008.986481 secs 2024-04-21T19:34:58.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33008.986481 secs 2024-04-21T19:34:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:34:58.918+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:34:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:34:58.918+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:34:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:34:58.919+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:34:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:34:58.919+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:34:59.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:58 smithi170 ceph-mon[31212]: pgmap v17694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:59.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:58 smithi077 ceph-mon[27902]: pgmap v17694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:34:59.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:58 smithi191 ceph-mon[31636]: pgmap v17694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:00.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33010.744556 secs 2024-04-21T19:35:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:00.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33010.744556 secs 2024-04-21T19:35:00.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33010.744556 secs 2024-04-21T19:35:01.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:00 smithi170 ceph-mon[31212]: pgmap v17695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:01.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:00 smithi077 ceph-mon[27902]: pgmap v17695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:01.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:00 smithi191 ceph-mon[31636]: pgmap v17695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:03.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:02 smithi077 ceph-mon[27902]: pgmap v17696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:03.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33013.986572 secs 2024-04-21T19:35:03.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:02 smithi191 ceph-mon[31636]: pgmap v17696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:03.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33013.986572 secs 2024-04-21T19:35:03.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:02 smithi170 ceph-mon[31212]: pgmap v17696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:03.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33013.986572 secs 2024-04-21T19:35:05.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:05.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:04 smithi077 ceph-mon[27902]: pgmap v17697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:05.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33015.744696 secs 2024-04-21T19:35:05.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:04 smithi191 ceph-mon[31636]: pgmap v17697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:05.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33015.744696 secs 2024-04-21T19:35:05.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:04 smithi170 ceph-mon[31212]: pgmap v17697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:05.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33015.744696 secs 2024-04-21T19:35:06.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:05 smithi077 ceph-mon[27902]: osdmap e1178: 12 total, 12 up, 12 in 2024-04-21T19:35:06.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:05 smithi191 ceph-mon[31636]: osdmap e1178: 12 total, 12 up, 12 in 2024-04-21T19:35:06.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:05 smithi170 ceph-mon[31212]: osdmap e1178: 12 total, 12 up, 12 in 2024-04-21T19:35:07.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:06 smithi077 ceph-mon[27902]: pgmap v17699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:07.191 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:06 smithi170 ceph-mon[31212]: pgmap v17699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:07.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:06 smithi191 ceph-mon[31636]: pgmap v17699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:08.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33018.986709 secs 2024-04-21T19:35:08.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33018.986709 secs 2024-04-21T19:35:08.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33018.986709 secs 2024-04-21T19:35:09.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:08 smithi191 ceph-mon[31636]: pgmap v17700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:09.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:08 smithi077 ceph-mon[27902]: pgmap v17700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:09.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:08 smithi170 ceph-mon[31212]: pgmap v17700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:10.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:10.118 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33020.744773 secs 2024-04-21T19:35:10.201 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33020.744773 secs 2024-04-21T19:35:10.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33020.744773 secs 2024-04-21T19:35:11.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:10 smithi077 ceph-mon[27902]: pgmap v17701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:11.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:10 smithi191 ceph-mon[31636]: pgmap v17701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:11.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:10 smithi170 ceph-mon[31212]: pgmap v17701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:35:13.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:12 smithi077 ceph-mon[27902]: pgmap v17702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:35:13.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33023.986816 secs 2024-04-21T19:35:13.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:12 smithi191 ceph-mon[31636]: pgmap v17702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:35:13.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33023.986816 secs 2024-04-21T19:35:13.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:12 smithi170 ceph-mon[31212]: pgmap v17702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:35:13.290 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33023.986816 secs 2024-04-21T19:35:14.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:14 smithi191 ceph-mon[31636]: osdmap e1179: 12 total, 12 up, 12 in 2024-04-21T19:35:14.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:14 smithi191 ceph-mon[31636]: pgmap v17704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:35:14.953 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33025.744882 secs 2024-04-21T19:35:15.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:14 smithi170 ceph-mon[31212]: osdmap e1179: 12 total, 12 up, 12 in 2024-04-21T19:35:15.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:14 smithi170 ceph-mon[31212]: pgmap v17704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:35:15.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33025.744882 secs 2024-04-21T19:35:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:15.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:14 smithi077 ceph-mon[27902]: osdmap e1179: 12 total, 12 up, 12 in 2024-04-21T19:35:15.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:14 smithi077 ceph-mon[27902]: pgmap v17704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:35:15.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33025.744882 secs 2024-04-21T19:35:17.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:16 smithi170 ceph-mon[31212]: pgmap v17705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:17.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:16 smithi077 ceph-mon[27902]: pgmap v17705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:17.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:16 smithi191 ceph-mon[31636]: pgmap v17705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:18.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33028.986933 secs 2024-04-21T19:35:18.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33028.986933 secs 2024-04-21T19:35:18.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33028.986933 secs 2024-04-21T19:35:19.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:18 smithi170 ceph-mon[31212]: pgmap v17706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:19.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:18 smithi077 ceph-mon[27902]: pgmap v17706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:19.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:18 smithi191 ceph-mon[31636]: pgmap v17706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:20.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33030.744977 secs 2024-04-21T19:35:20.112 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:20.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33030.744977 secs 2024-04-21T19:35:20.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33030.744977 secs 2024-04-21T19:35:21.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:20 smithi170 ceph-mon[31212]: pgmap v17707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:21.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:20 smithi077 ceph-mon[27902]: pgmap v17707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:21.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:20 smithi191 ceph-mon[31636]: pgmap v17707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:35:23.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:22 smithi170 ceph-mon[31212]: pgmap v17708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:35:23.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33033.987050 secs 2024-04-21T19:35:23.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:22 smithi077 ceph-mon[27902]: pgmap v17708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:35:23.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33033.987050 secs 2024-04-21T19:35:23.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:22 smithi191 ceph-mon[31636]: pgmap v17708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:35:23.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33033.987050 secs 2024-04-21T19:35:24.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:24 smithi191 ceph-mon[31636]: pgmap v17709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:35:24.952 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33035.745088 secs 2024-04-21T19:35:25.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:24 smithi170 ceph-mon[31212]: pgmap v17709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:35:25.040 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33035.745088 secs 2024-04-21T19:35:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:25.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:24 smithi077 ceph-mon[27902]: pgmap v17709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:35:25.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33035.745088 secs 2024-04-21T19:35:27.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:26 smithi170 ceph-mon[31212]: pgmap v17710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:27.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:26 smithi077 ceph-mon[27902]: pgmap v17710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:27.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:26 smithi191 ceph-mon[31636]: pgmap v17710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:28.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33038.987152 secs 2024-04-21T19:35:28.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33038.987152 secs 2024-04-21T19:35:28.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33038.987152 secs 2024-04-21T19:35:29.021 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:28 smithi077 ceph-mon[27902]: pgmap v17711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:29.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:28 smithi170 ceph-mon[31212]: pgmap v17711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:29.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:28 smithi191 ceph-mon[31636]: pgmap v17711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:30.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33040.745209 secs 2024-04-21T19:35:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:30.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33040.745209 secs 2024-04-21T19:35:30.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33040.745209 secs 2024-04-21T19:35:31.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:30 smithi170 ceph-mon[31212]: pgmap v17712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:31.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:35:31.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:30 smithi077 ceph-mon[27902]: pgmap v17712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:31.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:35:31.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:30 smithi191 ceph-mon[31636]: pgmap v17712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:31.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:35:32.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: pgmap v17713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:35:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:35:32.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: pgmap v17713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:32.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:35:32.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:35:32.542 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: pgmap v17713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:35:32.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:35:33.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33043.987266 secs 2024-04-21T19:35:33.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33043.987266 secs 2024-04-21T19:35:33.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33043.987266 secs 2024-04-21T19:35:34.452 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:34 smithi191 ceph-mon[31636]: pgmap v17714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:34.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33045.745317 secs 2024-04-21T19:35:34.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:34 smithi170 ceph-mon[31212]: pgmap v17714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:34.541 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33045.745317 secs 2024-04-21T19:35:34.619 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:34 smithi077 ceph-mon[27902]: pgmap v17714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:34.620 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33045.745317 secs 2024-04-21T19:35:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:37.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:36 smithi170 ceph-mon[31212]: pgmap v17715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:37.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:36 smithi077 ceph-mon[27902]: pgmap v17715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:37.202 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:36 smithi191 ceph-mon[31636]: pgmap v17715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:38.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33048.987376 secs 2024-04-21T19:35:38.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33048.987376 secs 2024-04-21T19:35:38.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33048.987376 secs 2024-04-21T19:35:39.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:38 smithi170 ceph-mon[31212]: pgmap v17716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:39.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:38 smithi191 ceph-mon[31636]: pgmap v17716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:39.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:38 smithi077 ceph-mon[27902]: pgmap v17716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:40.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33050.745458 secs 2024-04-21T19:35:40.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:40.119 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33050.745458 secs 2024-04-21T19:35:40.123 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33050.745458 secs 2024-04-21T19:35:41.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:40 smithi170 ceph-mon[31212]: pgmap v17717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:41.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:40 smithi077 ceph-mon[27902]: pgmap v17717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:41.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:40 smithi191 ceph-mon[31636]: pgmap v17717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:43.042 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:42 smithi170 ceph-mon[31212]: pgmap v17718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:43.042 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33053.987477 secs 2024-04-21T19:35:43.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:42 smithi077 ceph-mon[27902]: pgmap v17718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:43.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33053.987477 secs 2024-04-21T19:35:43.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:42 smithi191 ceph-mon[31636]: pgmap v17718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:43.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33053.987477 secs 2024-04-21T19:35:45.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:44 smithi170 ceph-mon[31212]: pgmap v17719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:45.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33055.745601 secs 2024-04-21T19:35:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:45.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:44 smithi077 ceph-mon[27902]: pgmap v17719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:45.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33055.745601 secs 2024-04-21T19:35:45.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:44 smithi191 ceph-mon[31636]: pgmap v17719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:45.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33055.745601 secs 2024-04-21T19:35:47.041 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:46 smithi170 ceph-mon[31212]: pgmap v17720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:47.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:46 smithi077 ceph-mon[27902]: pgmap v17720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:47.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:46 smithi191 ceph-mon[31636]: pgmap v17720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:48.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33058.987588 secs 2024-04-21T19:35:48.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33058.987588 secs 2024-04-21T19:35:48.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33058.987588 secs 2024-04-21T19:35:49.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:48 smithi077 ceph-mon[27902]: pgmap v17721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:49.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:48 smithi191 ceph-mon[31636]: pgmap v17721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:49.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:48 smithi170 ceph-mon[31212]: pgmap v17721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:50.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33060.745713 secs 2024-04-21T19:35:50.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33060.745713 secs 2024-04-21T19:35:50.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33060.745713 secs 2024-04-21T19:35:51.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:50 smithi077 ceph-mon[27902]: pgmap v17722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:51.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:50 smithi191 ceph-mon[31636]: pgmap v17722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:51.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:50 smithi170 ceph-mon[31212]: pgmap v17722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:53.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:52 smithi077 ceph-mon[27902]: pgmap v17723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:53.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33063.987702 secs 2024-04-21T19:35:53.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:52 smithi191 ceph-mon[31636]: pgmap v17723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:53.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33063.987702 secs 2024-04-21T19:35:53.291 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:52 smithi170 ceph-mon[31212]: pgmap v17723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:53.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33063.987702 secs 2024-04-21T19:35:55.114 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:54 smithi077 ceph-mon[27902]: pgmap v17724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:55.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33065.745846 secs 2024-04-21T19:35:55.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:54 smithi191 ceph-mon[31636]: pgmap v17724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:55.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33065.745846 secs 2024-04-21T19:35:55.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:54 smithi170 ceph-mon[31212]: pgmap v17724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:55.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33065.745846 secs 2024-04-21T19:35:57.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:56 smithi077 ceph-mon[27902]: pgmap v17725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:57.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:56 smithi191 ceph-mon[31636]: pgmap v17725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:57.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:56 smithi170 ceph-mon[31212]: pgmap v17725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:35:58.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33068.987818 secs 2024-04-21T19:35:58.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33068.987818 secs 2024-04-21T19:35:58.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33068.987818 secs 2024-04-21T19:35:59.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:58 smithi077 ceph-mon[27902]: pgmap v17726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:59.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:58 smithi191 ceph-mon[31636]: pgmap v17726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:35:59.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:58 smithi170 ceph-mon[31212]: pgmap v17726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:00.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33070.745977 secs 2024-04-21T19:36:00.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33070.745977 secs 2024-04-21T19:36:00.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33070.745977 secs 2024-04-21T19:36:01.120 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:00 smithi077 ceph-mon[27902]: pgmap v17727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:01.203 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:00 smithi191 ceph-mon[31636]: pgmap v17727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:01.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:00 smithi170 ceph-mon[31212]: pgmap v17727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:03.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:02 smithi077 ceph-mon[27902]: pgmap v17728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:03.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33073.987863 secs 2024-04-21T19:36:03.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:02 smithi191 ceph-mon[31636]: pgmap v17728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:03.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33073.987863 secs 2024-04-21T19:36:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:02 smithi170 ceph-mon[31212]: pgmap v17728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:03.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33073.987863 secs 2024-04-21T19:36:05.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:05.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:04 smithi077 ceph-mon[27902]: pgmap v17729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:05.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33075.746055 secs 2024-04-21T19:36:05.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:04 smithi191 ceph-mon[31636]: pgmap v17729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:05.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33075.746055 secs 2024-04-21T19:36:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:04 smithi170 ceph-mon[31212]: pgmap v17729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:05.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33075.746055 secs 2024-04-21T19:36:06.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:05 smithi077 ceph-mon[27902]: osdmap e1180: 12 total, 12 up, 12 in 2024-04-21T19:36:06.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:05 smithi191 ceph-mon[31636]: osdmap e1180: 12 total, 12 up, 12 in 2024-04-21T19:36:06.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:05 smithi170 ceph-mon[31212]: osdmap e1180: 12 total, 12 up, 12 in 2024-04-21T19:36:07.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:06 smithi077 ceph-mon[27902]: pgmap v17731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:07.193 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:06 smithi170 ceph-mon[31212]: pgmap v17731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:07.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:06 smithi191 ceph-mon[31636]: pgmap v17731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:08.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33078.987964 secs 2024-04-21T19:36:08.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33078.987964 secs 2024-04-21T19:36:08.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33078.987964 secs 2024-04-21T19:36:09.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:08 smithi077 ceph-mon[27902]: pgmap v17732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:09.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:08 smithi191 ceph-mon[31636]: pgmap v17732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:09.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:08 smithi170 ceph-mon[31212]: pgmap v17732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:10.115 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:10.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33080.746122 secs 2024-04-21T19:36:10.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33080.746122 secs 2024-04-21T19:36:10.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33080.746122 secs 2024-04-21T19:36:11.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:10 smithi077 ceph-mon[27902]: pgmap v17733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:11.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:10 smithi191 ceph-mon[31636]: pgmap v17733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:11.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:10 smithi170 ceph-mon[31212]: pgmap v17733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:36:13.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:12 smithi191 ceph-mon[31636]: pgmap v17734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:36:13.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33083.988082 secs 2024-04-21T19:36:13.292 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:12 smithi170 ceph-mon[31212]: pgmap v17734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:36:13.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33083.988082 secs 2024-04-21T19:36:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:12 smithi077 ceph-mon[27902]: pgmap v17734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:36:13.371 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33083.988082 secs 2024-04-21T19:36:14.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:14 smithi191 ceph-mon[31636]: osdmap e1181: 12 total, 12 up, 12 in 2024-04-21T19:36:14.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:14 smithi191 ceph-mon[31636]: pgmap v17736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:36:14.955 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33085.746234 secs 2024-04-21T19:36:15.042 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:14 smithi170 ceph-mon[31212]: osdmap e1181: 12 total, 12 up, 12 in 2024-04-21T19:36:15.042 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:14 smithi170 ceph-mon[31212]: pgmap v17736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:36:15.042 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33085.746234 secs 2024-04-21T19:36:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:15.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:14 smithi077 ceph-mon[27902]: osdmap e1181: 12 total, 12 up, 12 in 2024-04-21T19:36:15.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:14 smithi077 ceph-mon[27902]: pgmap v17736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T19:36:15.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33085.746234 secs 2024-04-21T19:36:17.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:16 smithi170 ceph-mon[31212]: pgmap v17737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:17.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:16 smithi077 ceph-mon[27902]: pgmap v17737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:17.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:16 smithi191 ceph-mon[31636]: pgmap v17737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:18.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33088.988206 secs 2024-04-21T19:36:18.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33088.988206 secs 2024-04-21T19:36:18.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33088.988206 secs 2024-04-21T19:36:19.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:18 smithi170 ceph-mon[31212]: pgmap v17738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:19.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:18 smithi077 ceph-mon[27902]: pgmap v17738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:19.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:18 smithi191 ceph-mon[31636]: pgmap v17738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:20.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33090.746377 secs 2024-04-21T19:36:20.117 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:20.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33090.746377 secs 2024-04-21T19:36:20.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33090.746377 secs 2024-04-21T19:36:21.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:20 smithi170 ceph-mon[31212]: pgmap v17739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:21.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:20 smithi077 ceph-mon[27902]: pgmap v17739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:21.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:20 smithi191 ceph-mon[31636]: pgmap v17739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:36:23.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:22 smithi170 ceph-mon[31212]: pgmap v17740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:36:23.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33093.988323 secs 2024-04-21T19:36:23.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:22 smithi077 ceph-mon[27902]: pgmap v17740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:36:23.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33093.988323 secs 2024-04-21T19:36:23.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:22 smithi191 ceph-mon[31636]: pgmap v17740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:36:23.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33093.988323 secs 2024-04-21T19:36:25.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:24 smithi170 ceph-mon[31212]: pgmap v17741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:36:25.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33095.746486 secs 2024-04-21T19:36:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:25.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:24 smithi077 ceph-mon[27902]: pgmap v17741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:36:25.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33095.746486 secs 2024-04-21T19:36:25.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:24 smithi191 ceph-mon[31636]: pgmap v17741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T19:36:25.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33095.746486 secs 2024-04-21T19:36:27.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:26 smithi077 ceph-mon[27902]: pgmap v17742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:27.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:26 smithi191 ceph-mon[31636]: pgmap v17742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:27.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:26 smithi170 ceph-mon[31212]: pgmap v17742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:28.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33098.988432 secs 2024-04-21T19:36:28.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33098.988432 secs 2024-04-21T19:36:28.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33098.988432 secs 2024-04-21T19:36:29.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:28 smithi077 ceph-mon[27902]: pgmap v17743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:29.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:28 smithi191 ceph-mon[31636]: pgmap v17743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:29.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:28 smithi170 ceph-mon[31212]: pgmap v17743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:30.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33100.746597 secs 2024-04-21T19:36:30.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33100.746597 secs 2024-04-21T19:36:30.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33100.746597 secs 2024-04-21T19:36:31.121 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:30 smithi077 ceph-mon[27902]: pgmap v17744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:31.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:30 smithi191 ceph-mon[31636]: pgmap v17744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:31.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:30 smithi170 ceph-mon[31212]: pgmap v17744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:32 smithi077 ceph-mon[27902]: pgmap v17745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:36:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33103.988519 secs 2024-04-21T19:36:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:36:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:36:33.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:36:33.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:32 smithi191 ceph-mon[31636]: pgmap v17745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:33.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:36:33.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33103.988519 secs 2024-04-21T19:36:33.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:36:33.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:36:33.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:36:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:32 smithi170 ceph-mon[31212]: pgmap v17745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:36:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33103.988519 secs 2024-04-21T19:36:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:36:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:36:33.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:36:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:35.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:34 smithi077 ceph-mon[27902]: pgmap v17746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:35.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33105.746706 secs 2024-04-21T19:36:35.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:34 smithi191 ceph-mon[31636]: pgmap v17746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:35.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33105.746706 secs 2024-04-21T19:36:35.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:34 smithi170 ceph-mon[31212]: pgmap v17746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:35.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33105.746706 secs 2024-04-21T19:36:37.096 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:36 smithi170 ceph-mon[31212]: pgmap v17747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:37.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:36 smithi077 ceph-mon[27902]: pgmap v17747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:37.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:36 smithi191 ceph-mon[31636]: pgmap v17747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:38.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33108.988599 secs 2024-04-21T19:36:38.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33108.988599 secs 2024-04-21T19:36:38.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33108.988599 secs 2024-04-21T19:36:39.106 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:38 smithi191 ceph-mon[31636]: pgmap v17748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:39.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:38 smithi077 ceph-mon[27902]: pgmap v17748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:39.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:38 smithi170 ceph-mon[31212]: pgmap v17748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:40.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:40.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33110.746878 secs 2024-04-21T19:36:40.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33110.746878 secs 2024-04-21T19:36:40.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33110.746878 secs 2024-04-21T19:36:41.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:40 smithi077 ceph-mon[27902]: pgmap v17749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:41.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:40 smithi191 ceph-mon[31636]: pgmap v17749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:41.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:40 smithi170 ceph-mon[31212]: pgmap v17749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:43.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:42 smithi077 ceph-mon[27902]: pgmap v17750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:43.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33113.988663 secs 2024-04-21T19:36:43.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:42 smithi191 ceph-mon[31636]: pgmap v17750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:43.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33113.988663 secs 2024-04-21T19:36:43.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:42 smithi170 ceph-mon[31212]: pgmap v17750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:43.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33113.988663 secs 2024-04-21T19:36:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:45.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:44 smithi077 ceph-mon[27902]: pgmap v17751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:45.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33115.746925 secs 2024-04-21T19:36:45.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:44 smithi191 ceph-mon[31636]: pgmap v17751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:45.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33115.746925 secs 2024-04-21T19:36:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:44 smithi170 ceph-mon[31212]: pgmap v17751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:45.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33115.746925 secs 2024-04-21T19:36:47.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:46 smithi077 ceph-mon[27902]: pgmap v17752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:47.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:46 smithi191 ceph-mon[31636]: pgmap v17752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:47.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:46 smithi170 ceph-mon[31212]: pgmap v17752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:48.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33118.988726 secs 2024-04-21T19:36:48.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33118.988726 secs 2024-04-21T19:36:48.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33118.988726 secs 2024-04-21T19:36:49.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:48 smithi077 ceph-mon[27902]: pgmap v17753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:49.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:48 smithi191 ceph-mon[31636]: pgmap v17753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:49.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:48 smithi170 ceph-mon[31212]: pgmap v17753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:50.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:50.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33120.747021 secs 2024-04-21T19:36:50.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33120.747021 secs 2024-04-21T19:36:50.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33120.747021 secs 2024-04-21T19:36:51.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:50 smithi077 ceph-mon[27902]: pgmap v17754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:51.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:50 smithi191 ceph-mon[31636]: pgmap v17754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:51.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:50 smithi170 ceph-mon[31212]: pgmap v17754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:53.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:52 smithi077 ceph-mon[27902]: pgmap v17755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:53.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33123.988821 secs 2024-04-21T19:36:53.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:52 smithi191 ceph-mon[31636]: pgmap v17755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:53.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33123.988821 secs 2024-04-21T19:36:53.293 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:52 smithi170 ceph-mon[31212]: pgmap v17755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:53.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33123.988821 secs 2024-04-21T19:36:55.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:36:55.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:54 smithi077 ceph-mon[27902]: pgmap v17756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:55.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33125.747085 secs 2024-04-21T19:36:55.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:54 smithi191 ceph-mon[31636]: pgmap v17756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:55.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33125.747085 secs 2024-04-21T19:36:55.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:54 smithi170 ceph-mon[31212]: pgmap v17756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:36:55.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33125.747085 secs 2024-04-21T19:36:57.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:56 smithi077 ceph-mon[27902]: pgmap v17757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:57.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:56 smithi191 ceph-mon[31636]: pgmap v17757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:57.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:56 smithi170 ceph-mon[31212]: pgmap v17757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:36:58.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33128.988942 secs 2024-04-21T19:36:58.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33128.988942 secs 2024-04-21T19:36:58.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33128.988942 secs 2024-04-21T19:36:59.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:58 smithi191 ceph-mon[31636]: pgmap v17758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:59.274 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:58 smithi077 ceph-mon[27902]: pgmap v17758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:36:59.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:58 smithi170 ceph-mon[31212]: pgmap v17758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:00.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:00.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:36:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33130.747172 secs 2024-04-21T19:37:00.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:36:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33130.747172 secs 2024-04-21T19:37:00.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:36:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33130.747172 secs 2024-04-21T19:37:01.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:00 smithi191 ceph-mon[31636]: pgmap v17759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:01.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:00 smithi170 ceph-mon[31212]: pgmap v17759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:01.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:00 smithi077 ceph-mon[27902]: pgmap v17759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:03.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:02 smithi191 ceph-mon[31636]: pgmap v17760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:03.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33133.989063 secs 2024-04-21T19:37:03.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:02 smithi170 ceph-mon[31212]: pgmap v17760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:03.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33133.989063 secs 2024-04-21T19:37:03.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:02 smithi077 ceph-mon[27902]: pgmap v17760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:03.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33133.989063 secs 2024-04-21T19:37:05.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:05.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:04 smithi191 ceph-mon[31636]: pgmap v17761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:05.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33135.747261 secs 2024-04-21T19:37:05.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:04 smithi191 ceph-mon[31636]: osdmap e1182: 12 total, 12 up, 12 in 2024-04-21T19:37:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:04 smithi170 ceph-mon[31212]: pgmap v17761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33135.747261 secs 2024-04-21T19:37:05.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:04 smithi170 ceph-mon[31212]: osdmap e1182: 12 total, 12 up, 12 in 2024-04-21T19:37:05.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:04 smithi077 ceph-mon[27902]: pgmap v17761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:05.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33135.747261 secs 2024-04-21T19:37:05.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:04 smithi077 ceph-mon[27902]: osdmap e1182: 12 total, 12 up, 12 in 2024-04-21T19:37:07.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:06 smithi191 ceph-mon[31636]: pgmap v17763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:37:07.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:06 smithi170 ceph-mon[31212]: pgmap v17763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:37:07.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:06 smithi077 ceph-mon[27902]: pgmap v17763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:37:08.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33138.989144 secs 2024-04-21T19:37:08.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33138.989144 secs 2024-04-21T19:37:08.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33138.989144 secs 2024-04-21T19:37:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:08 smithi191 ceph-mon[31636]: pgmap v17764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:37:09.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:08 smithi191 ceph-mon[31636]: osdmap e1183: 12 total, 12 up, 12 in 2024-04-21T19:37:09.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:08 smithi170 ceph-mon[31212]: pgmap v17764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:37:09.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:08 smithi170 ceph-mon[31212]: osdmap e1183: 12 total, 12 up, 12 in 2024-04-21T19:37:09.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:08 smithi077 ceph-mon[27902]: pgmap v17764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:37:09.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:08 smithi077 ceph-mon[27902]: osdmap e1183: 12 total, 12 up, 12 in 2024-04-21T19:37:10.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:10.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33140.747379 secs 2024-04-21T19:37:10.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33140.747379 secs 2024-04-21T19:37:10.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33140.747379 secs 2024-04-21T19:37:11.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:10 smithi191 ceph-mon[31636]: pgmap v17766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:37:11.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:10 smithi170 ceph-mon[31212]: pgmap v17766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:37:11.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:10 smithi077 ceph-mon[27902]: pgmap v17766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:37:13.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:12 smithi191 ceph-mon[31636]: pgmap v17767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:37:13.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33143.989280 secs 2024-04-21T19:37:13.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:12 smithi170 ceph-mon[31212]: pgmap v17767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:37:13.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33143.989280 secs 2024-04-21T19:37:13.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:12 smithi077 ceph-mon[27902]: pgmap v17767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:37:13.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33143.989280 secs 2024-04-21T19:37:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:15.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:14 smithi191 ceph-mon[31636]: pgmap v17768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:37:15.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33145.747498 secs 2024-04-21T19:37:15.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:14 smithi170 ceph-mon[31212]: pgmap v17768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:37:15.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33145.747498 secs 2024-04-21T19:37:15.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:14 smithi077 ceph-mon[27902]: pgmap v17768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:37:15.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33145.747498 secs 2024-04-21T19:37:17.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:16 smithi191 ceph-mon[31636]: pgmap v17769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:37:17.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:16 smithi170 ceph-mon[31212]: pgmap v17769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:37:17.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:16 smithi077 ceph-mon[27902]: pgmap v17769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:37:18.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33148.989419 secs 2024-04-21T19:37:18.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33148.989419 secs 2024-04-21T19:37:18.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33148.989419 secs 2024-04-21T19:37:19.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:18 smithi191 ceph-mon[31636]: pgmap v17770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:37:19.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:18 smithi170 ceph-mon[31212]: pgmap v17770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:37:19.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:18 smithi077 ceph-mon[27902]: pgmap v17770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:37:20.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:20.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33150.747646 secs 2024-04-21T19:37:20.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33150.747646 secs 2024-04-21T19:37:20.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33150.747646 secs 2024-04-21T19:37:21.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:20 smithi191 ceph-mon[31636]: pgmap v17771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:37:21.294 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:20 smithi170 ceph-mon[31212]: pgmap v17771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:37:21.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:20 smithi077 ceph-mon[27902]: pgmap v17771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:37:23.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:22 smithi191 ceph-mon[31636]: pgmap v17772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:37:23.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33153.989540 secs 2024-04-21T19:37:23.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:22 smithi170 ceph-mon[31212]: pgmap v17772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:37:23.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33153.989540 secs 2024-04-21T19:37:23.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:22 smithi077 ceph-mon[27902]: pgmap v17772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:37:23.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33153.989540 secs 2024-04-21T19:37:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:25.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:24 smithi191 ceph-mon[31636]: pgmap v17773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:25.206 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33155.747764 secs 2024-04-21T19:37:25.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:24 smithi170 ceph-mon[31212]: pgmap v17773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:25.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33155.747764 secs 2024-04-21T19:37:25.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:24 smithi077 ceph-mon[27902]: pgmap v17773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:25.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33155.747764 secs 2024-04-21T19:37:27.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:26 smithi191 ceph-mon[31636]: pgmap v17774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:27.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:26 smithi170 ceph-mon[31212]: pgmap v17774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:27.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:26 smithi077 ceph-mon[27902]: pgmap v17774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:28.207 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33158.989679 secs 2024-04-21T19:37:28.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33158.989679 secs 2024-04-21T19:37:28.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33158.989679 secs 2024-04-21T19:37:29.275 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:28 smithi077 ceph-mon[27902]: pgmap v17775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:29.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:28 smithi170 ceph-mon[31212]: pgmap v17775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:29.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:28 smithi191 ceph-mon[31636]: pgmap v17775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:30.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33160.747883 secs 2024-04-21T19:37:30.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33160.747883 secs 2024-04-21T19:37:30.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33160.747883 secs 2024-04-21T19:37:31.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:30 smithi170 ceph-mon[31212]: pgmap v17776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:31.373 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:30 smithi077 ceph-mon[27902]: pgmap v17776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:31.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:30 smithi191 ceph-mon[31636]: pgmap v17776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:33.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:32 smithi170 ceph-mon[31212]: pgmap v17777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:33.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33163.989800 secs 2024-04-21T19:37:33.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:37:33.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:32 smithi077 ceph-mon[27902]: pgmap v17777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:33.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33163.989800 secs 2024-04-21T19:37:33.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:37:33.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:32 smithi191 ceph-mon[31636]: pgmap v17777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:33.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33163.989800 secs 2024-04-21T19:37:33.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:37:34.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:37:34.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:37:34.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:37:34.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:37:34.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:37:34.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:37:34.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:37:34.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:37:34.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:37:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:35.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:34 smithi170 ceph-mon[31212]: pgmap v17778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:35.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33165.748023 secs 2024-04-21T19:37:35.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:34 smithi077 ceph-mon[27902]: pgmap v17778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:35.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33165.748023 secs 2024-04-21T19:37:35.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:34 smithi191 ceph-mon[31636]: pgmap v17778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:35.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33165.748023 secs 2024-04-21T19:37:37.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:36 smithi170 ceph-mon[31212]: pgmap v17779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:37.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:36 smithi077 ceph-mon[27902]: pgmap v17779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:37.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:36 smithi191 ceph-mon[31636]: pgmap v17779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:38.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33168.989920 secs 2024-04-21T19:37:38.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33168.989920 secs 2024-04-21T19:37:38.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33168.989920 secs 2024-04-21T19:37:39.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:38 smithi170 ceph-mon[31212]: pgmap v17780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:39.358 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:38 smithi191 ceph-mon[31636]: pgmap v17780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:39.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:38 smithi077 ceph-mon[27902]: pgmap v17780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:40.118 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:40.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33170.748119 secs 2024-04-21T19:37:40.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33170.748119 secs 2024-04-21T19:37:40.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33170.748119 secs 2024-04-21T19:37:41.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:41 smithi170 ceph-mon[31212]: pgmap v17781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:41.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:41 smithi077 ceph-mon[27902]: pgmap v17781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:41.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:41 smithi191 ceph-mon[31636]: pgmap v17781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:43.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:43 smithi170 ceph-mon[31212]: pgmap v17782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:43.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33173.990030 secs 2024-04-21T19:37:43.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:43 smithi077 ceph-mon[27902]: pgmap v17782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:43.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33173.990030 secs 2024-04-21T19:37:43.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:43 smithi191 ceph-mon[31636]: pgmap v17782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:43.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33173.990030 secs 2024-04-21T19:37:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:45.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:45 smithi170 ceph-mon[31212]: pgmap v17783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:45.297 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33175.748197 secs 2024-04-21T19:37:45.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:45 smithi077 ceph-mon[27902]: pgmap v17783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:45.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33175.748197 secs 2024-04-21T19:37:45.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:45 smithi191 ceph-mon[31636]: pgmap v17783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:45.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33175.748197 secs 2024-04-21T19:37:47.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:47 smithi170 ceph-mon[31212]: pgmap v17784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:47.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:47 smithi077 ceph-mon[27902]: pgmap v17784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:47.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:47 smithi191 ceph-mon[31636]: pgmap v17784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:48.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33178.990151 secs 2024-04-21T19:37:48.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33178.990151 secs 2024-04-21T19:37:48.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33178.990151 secs 2024-04-21T19:37:49.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:49 smithi170 ceph-mon[31212]: pgmap v17785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:49.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:49 smithi077 ceph-mon[27902]: pgmap v17785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:49.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:49 smithi191 ceph-mon[31636]: pgmap v17785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:50.120 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:50.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33180.748313 secs 2024-04-21T19:37:50.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33180.748313 secs 2024-04-21T19:37:50.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33180.748313 secs 2024-04-21T19:37:51.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:51 smithi170 ceph-mon[31212]: pgmap v17786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:51.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:51 smithi077 ceph-mon[27902]: pgmap v17786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:51.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:51 smithi191 ceph-mon[31636]: pgmap v17786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:37:53.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:53 smithi170 ceph-mon[31212]: pgmap v17787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:53.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33183.990264 secs 2024-04-21T19:37:53.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:53 smithi077 ceph-mon[27902]: pgmap v17787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:53.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33183.990264 secs 2024-04-21T19:37:53.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:53 smithi191 ceph-mon[31636]: pgmap v17787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:53.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33183.990264 secs 2024-04-21T19:37:55.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:37:55.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:55 smithi170 ceph-mon[31212]: pgmap v17788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:37:55.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33185.748427 secs 2024-04-21T19:37:55.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:55 smithi077 ceph-mon[27902]: pgmap v17788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:37:55.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33185.748427 secs 2024-04-21T19:37:55.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:55 smithi191 ceph-mon[31636]: pgmap v17788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:37:55.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33185.748427 secs 2024-04-21T19:37:57.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:57 smithi170 ceph-mon[31212]: pgmap v17789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:57.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:57 smithi077 ceph-mon[27902]: pgmap v17789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:57.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:57 smithi191 ceph-mon[31636]: pgmap v17789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:37:58.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33188.990403 secs 2024-04-21T19:37:58.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33188.990403 secs 2024-04-21T19:37:58.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33188.990403 secs 2024-04-21T19:37:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:37:58.944+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:37:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:37:58.944+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:37:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:37:58.944+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:37:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:37:58.944+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:37:59.295 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:37:59 smithi170 ceph-mon[31212]: pgmap v17790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:37:59.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:37:59 smithi077 ceph-mon[27902]: pgmap v17790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:37:59.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:37:59 smithi191 ceph-mon[31636]: pgmap v17790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:38:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:00.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33190.748578 secs 2024-04-21T19:38:00.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33190.748578 secs 2024-04-21T19:38:00.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33190.748578 secs 2024-04-21T19:38:01.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:01 smithi170 ceph-mon[31212]: pgmap v17791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:38:01.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:01 smithi077 ceph-mon[27902]: pgmap v17791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:38:01.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:01 smithi191 ceph-mon[31636]: pgmap v17791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:38:03.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:03 smithi170 ceph-mon[31212]: pgmap v17792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:03.296 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33193.990520 secs 2024-04-21T19:38:03.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:03 smithi077 ceph-mon[27902]: pgmap v17792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:03.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33193.990520 secs 2024-04-21T19:38:03.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:03 smithi191 ceph-mon[31636]: pgmap v17792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:03.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33193.990520 secs 2024-04-21T19:38:05.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:05.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:05 smithi077 ceph-mon[27902]: pgmap v17793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:05.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33195.748692 secs 2024-04-21T19:38:05.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:05 smithi077 ceph-mon[27902]: osdmap e1184: 12 total, 12 up, 12 in 2024-04-21T19:38:05.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:05 smithi191 ceph-mon[31636]: pgmap v17793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:05.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33195.748692 secs 2024-04-21T19:38:05.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:05 smithi191 ceph-mon[31636]: osdmap e1184: 12 total, 12 up, 12 in 2024-04-21T19:38:05.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:05 smithi170 ceph-mon[31212]: pgmap v17793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:05.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33195.748692 secs 2024-04-21T19:38:05.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:05 smithi170 ceph-mon[31212]: osdmap e1184: 12 total, 12 up, 12 in 2024-04-21T19:38:07.348 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:07 smithi170 ceph-mon[31212]: pgmap v17795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:38:07.374 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:07 smithi077 ceph-mon[27902]: pgmap v17795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:38:07.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:07 smithi191 ceph-mon[31636]: pgmap v17795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:38:08.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33198.990637 secs 2024-04-21T19:38:08.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33198.990637 secs 2024-04-21T19:38:08.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33198.990637 secs 2024-04-21T19:38:09.359 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:09 smithi191 ceph-mon[31636]: pgmap v17796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:38:09.359 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:09 smithi191 ceph-mon[31636]: osdmap e1185: 12 total, 12 up, 12 in 2024-04-21T19:38:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:09 smithi077 ceph-mon[27902]: pgmap v17796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:38:09.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:09 smithi077 ceph-mon[27902]: osdmap e1185: 12 total, 12 up, 12 in 2024-04-21T19:38:09.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:09 smithi170 ceph-mon[31212]: pgmap v17796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:38:09.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:09 smithi170 ceph-mon[31212]: osdmap e1185: 12 total, 12 up, 12 in 2024-04-21T19:38:10.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:10.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33200.748839 secs 2024-04-21T19:38:10.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33200.748839 secs 2024-04-21T19:38:10.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33200.748839 secs 2024-04-21T19:38:11.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:11 smithi077 ceph-mon[27902]: pgmap v17798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:38:11.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:11 smithi191 ceph-mon[31636]: pgmap v17798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:38:11.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:11 smithi170 ceph-mon[31212]: pgmap v17798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:38:13.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:13 smithi077 ceph-mon[27902]: pgmap v17799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:38:13.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33203.990754 secs 2024-04-21T19:38:13.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:13 smithi191 ceph-mon[31636]: pgmap v17799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:38:13.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33203.990754 secs 2024-04-21T19:38:13.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:13 smithi170 ceph-mon[31212]: pgmap v17799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:38:13.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33203.990754 secs 2024-04-21T19:38:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:15.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:15 smithi077 ceph-mon[27902]: pgmap v17800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:38:15.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33205.748958 secs 2024-04-21T19:38:15.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:15 smithi191 ceph-mon[31636]: pgmap v17800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:38:15.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33205.748958 secs 2024-04-21T19:38:15.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:15 smithi170 ceph-mon[31212]: pgmap v17800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:38:15.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33205.748958 secs 2024-04-21T19:38:17.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:17 smithi077 ceph-mon[27902]: pgmap v17801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:38:17.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:17 smithi191 ceph-mon[31636]: pgmap v17801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:38:17.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:17 smithi170 ceph-mon[31212]: pgmap v17801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:38:18.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33208.990851 secs 2024-04-21T19:38:18.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33208.990851 secs 2024-04-21T19:38:18.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33208.990851 secs 2024-04-21T19:38:19.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:19 smithi077 ceph-mon[27902]: pgmap v17802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:38:19.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:19 smithi191 ceph-mon[31636]: pgmap v17802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:38:19.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:19 smithi170 ceph-mon[31212]: pgmap v17802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:38:20.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:20.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33210.749077 secs 2024-04-21T19:38:20.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33210.749077 secs 2024-04-21T19:38:20.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33210.749077 secs 2024-04-21T19:38:21.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:21 smithi077 ceph-mon[27902]: pgmap v17803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:38:21.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:21 smithi191 ceph-mon[31636]: pgmap v17803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:38:21.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:21 smithi170 ceph-mon[31212]: pgmap v17803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:38:23.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:23 smithi077 ceph-mon[27902]: pgmap v17804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:38:23.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33213.990979 secs 2024-04-21T19:38:23.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:23 smithi191 ceph-mon[31636]: pgmap v17804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:38:23.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33213.990979 secs 2024-04-21T19:38:23.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:23 smithi170 ceph-mon[31212]: pgmap v17804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:38:23.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33213.990979 secs 2024-04-21T19:38:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:25.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:25 smithi077 ceph-mon[27902]: pgmap v17805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:25.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33215.749186 secs 2024-04-21T19:38:25.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:25 smithi191 ceph-mon[31636]: pgmap v17805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:25.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33215.749186 secs 2024-04-21T19:38:25.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:25 smithi170 ceph-mon[31212]: pgmap v17805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:25.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33215.749186 secs 2024-04-21T19:38:27.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:27 smithi077 ceph-mon[27902]: pgmap v17806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:27.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:27 smithi191 ceph-mon[31636]: pgmap v17806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:27.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:27 smithi170 ceph-mon[31212]: pgmap v17806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:28.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33218.991047 secs 2024-04-21T19:38:28.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33218.991047 secs 2024-04-21T19:38:28.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33218.991047 secs 2024-04-21T19:38:29.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:29 smithi077 ceph-mon[27902]: pgmap v17807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:29.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:29 smithi191 ceph-mon[31636]: pgmap v17807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:29.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:29 smithi170 ceph-mon[31212]: pgmap v17807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:30.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:30.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33220.749304 secs 2024-04-21T19:38:30.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33220.749304 secs 2024-04-21T19:38:30.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33220.749304 secs 2024-04-21T19:38:31.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:31 smithi077 ceph-mon[27902]: pgmap v17808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:31.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:31 smithi191 ceph-mon[31636]: pgmap v17808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:31.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:31 smithi170 ceph-mon[31212]: pgmap v17808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:33.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:33 smithi077 ceph-mon[27902]: pgmap v17809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:33.376 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33223.991189 secs 2024-04-21T19:38:33.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:33 smithi191 ceph-mon[31636]: pgmap v17809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:33.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33223.991189 secs 2024-04-21T19:38:33.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:33 smithi170 ceph-mon[31212]: pgmap v17809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:33.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33223.991189 secs 2024-04-21T19:38:34.375 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:38:34.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:38:34.546 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:38:35.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:35.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:35 smithi191 ceph-mon[31636]: pgmap v17810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:35.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33225.749412 secs 2024-04-21T19:38:35.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:38:35.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:38:35.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:38:35.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:35 smithi170 ceph-mon[31212]: pgmap v17810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:35.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33225.749412 secs 2024-04-21T19:38:35.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:38:35.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:38:35.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:38:35.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:35 smithi077 ceph-mon[27902]: pgmap v17810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:35.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33225.749412 secs 2024-04-21T19:38:35.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:38:35.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:38:35.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:38:37.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:37 smithi191 ceph-mon[31636]: pgmap v17811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:37.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:37 smithi170 ceph-mon[31212]: pgmap v17811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:37.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:37 smithi077 ceph-mon[27902]: pgmap v17811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:38.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33228.991302 secs 2024-04-21T19:38:38.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33228.991302 secs 2024-04-21T19:38:38.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33228.991302 secs 2024-04-21T19:38:39.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:39 smithi191 ceph-mon[31636]: pgmap v17812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:39.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33230.749530 secs 2024-04-21T19:38:39.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:39 smithi170 ceph-mon[31212]: pgmap v17812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:39.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33230.749530 secs 2024-04-21T19:38:39.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:39 smithi077 ceph-mon[27902]: pgmap v17812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:39.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33230.749530 secs 2024-04-21T19:38:40.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:41.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:41 smithi191 ceph-mon[31636]: pgmap v17813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:41.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:41 smithi170 ceph-mon[31212]: pgmap v17813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:41.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:41 smithi077 ceph-mon[27902]: pgmap v17813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:43.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:43 smithi191 ceph-mon[31636]: pgmap v17814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:43.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33233.991411 secs 2024-04-21T19:38:43.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:43 smithi170 ceph-mon[31212]: pgmap v17814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:43.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33233.991411 secs 2024-04-21T19:38:43.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:43 smithi077 ceph-mon[27902]: pgmap v17814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:43.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33233.991411 secs 2024-04-21T19:38:44.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33235.749640 secs 2024-04-21T19:38:44.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33235.749640 secs 2024-04-21T19:38:44.625 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33235.749640 secs 2024-04-21T19:38:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:45.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:45 smithi191 ceph-mon[31636]: pgmap v17815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:45.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:45 smithi170 ceph-mon[31212]: pgmap v17815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:45.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:45 smithi077 ceph-mon[27902]: pgmap v17815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:47.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:47 smithi191 ceph-mon[31636]: pgmap v17816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:47.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:47 smithi170 ceph-mon[31212]: pgmap v17816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:47.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:47 smithi077 ceph-mon[27902]: pgmap v17816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:48.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33238.991487 secs 2024-04-21T19:38:48.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33238.991487 secs 2024-04-21T19:38:48.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33238.991487 secs 2024-04-21T19:38:49.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:49 smithi191 ceph-mon[31636]: pgmap v17817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:49.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33240.749785 secs 2024-04-21T19:38:49.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:49 smithi170 ceph-mon[31212]: pgmap v17817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:49.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33240.749785 secs 2024-04-21T19:38:49.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:49 smithi077 ceph-mon[27902]: pgmap v17817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:49.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33240.749785 secs 2024-04-21T19:38:50.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:51.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:51 smithi191 ceph-mon[31636]: pgmap v17818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:51.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:51 smithi170 ceph-mon[31212]: pgmap v17818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:51.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:51 smithi077 ceph-mon[27902]: pgmap v17818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:53.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:53 smithi191 ceph-mon[31636]: pgmap v17819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:53.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33243.991636 secs 2024-04-21T19:38:53.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:53 smithi170 ceph-mon[31212]: pgmap v17819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:53.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33243.991636 secs 2024-04-21T19:38:53.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:53 smithi077 ceph-mon[27902]: pgmap v17819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:53.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33243.991636 secs 2024-04-21T19:38:54.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33245.749882 secs 2024-04-21T19:38:54.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33245.749882 secs 2024-04-21T19:38:54.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33245.749882 secs 2024-04-21T19:38:55.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:38:55.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:55 smithi191 ceph-mon[31636]: pgmap v17820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:55.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:55 smithi170 ceph-mon[31212]: pgmap v17820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:55.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:55 smithi077 ceph-mon[27902]: pgmap v17820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:57.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:57 smithi191 ceph-mon[31636]: pgmap v17821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:57.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:57 smithi170 ceph-mon[31212]: pgmap v17821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:57.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:57 smithi077 ceph-mon[27902]: pgmap v17821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:38:58.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33248.991721 secs 2024-04-21T19:38:58.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33248.991721 secs 2024-04-21T19:38:58.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33248.991721 secs 2024-04-21T19:38:59.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:59 smithi191 ceph-mon[31636]: pgmap v17822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:59.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33250.749951 secs 2024-04-21T19:38:59.527 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:59 smithi077 ceph-mon[27902]: pgmap v17822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:59.527 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33250.749951 secs 2024-04-21T19:38:59.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:59 smithi170 ceph-mon[31212]: pgmap v17822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:38:59.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33250.749951 secs 2024-04-21T19:39:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:01.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:01 smithi191 ceph-mon[31636]: pgmap v17823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:01.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:01 smithi170 ceph-mon[31212]: pgmap v17823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:01.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:01 smithi077 ceph-mon[27902]: pgmap v17823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:03.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:03 smithi191 ceph-mon[31636]: pgmap v17824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T19:39:03.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33253.991805 secs 2024-04-21T19:39:03.547 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:03 smithi170 ceph-mon[31212]: pgmap v17824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T19:39:03.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33253.991805 secs 2024-04-21T19:39:03.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:03 smithi077 ceph-mon[27902]: pgmap v17824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-21T19:39:03.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33253.991805 secs 2024-04-21T19:39:04.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33255.750073 secs 2024-04-21T19:39:04.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33255.750073 secs 2024-04-21T19:39:04.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33255.750073 secs 2024-04-21T19:39:05.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:05.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:05 smithi191 ceph-mon[31636]: pgmap v17825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T19:39:05.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:05 smithi191 ceph-mon[31636]: osdmap e1186: 12 total, 12 up, 12 in 2024-04-21T19:39:05.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:05 smithi170 ceph-mon[31212]: pgmap v17825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T19:39:05.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:05 smithi170 ceph-mon[31212]: osdmap e1186: 12 total, 12 up, 12 in 2024-04-21T19:39:05.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:05 smithi077 ceph-mon[27902]: pgmap v17825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-04-21T19:39:05.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:05 smithi077 ceph-mon[27902]: osdmap e1186: 12 total, 12 up, 12 in 2024-04-21T19:39:07.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:07 smithi191 ceph-mon[31636]: pgmap v17827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:39:07.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:07 smithi170 ceph-mon[31212]: pgmap v17827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:39:07.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:07 smithi077 ceph-mon[27902]: pgmap v17827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:39:08.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33258.991923 secs 2024-04-21T19:39:08.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33258.991923 secs 2024-04-21T19:39:08.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33258.991923 secs 2024-04-21T19:39:09.459 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:09 smithi191 ceph-mon[31636]: pgmap v17828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:39:09.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:09 smithi191 ceph-mon[31636]: osdmap e1187: 12 total, 12 up, 12 in 2024-04-21T19:39:09.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33260.750181 secs 2024-04-21T19:39:09.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:09 smithi170 ceph-mon[31212]: pgmap v17828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:39:09.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:09 smithi170 ceph-mon[31212]: osdmap e1187: 12 total, 12 up, 12 in 2024-04-21T19:39:09.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33260.750181 secs 2024-04-21T19:39:09.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:09 smithi077 ceph-mon[27902]: pgmap v17828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:39:09.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:09 smithi077 ceph-mon[27902]: osdmap e1187: 12 total, 12 up, 12 in 2024-04-21T19:39:09.627 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33260.750181 secs 2024-04-21T19:39:10.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:10.548 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:10 smithi170 ceph-mon[31212]: pgmap v17830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T19:39:10.626 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:10 smithi077 ceph-mon[27902]: pgmap v17830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T19:39:10.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:10 smithi191 ceph-mon[31636]: pgmap v17830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-04-21T19:39:13.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:12 smithi077 ceph-mon[27902]: pgmap v17831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-04-21T19:39:13.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33263.992036 secs 2024-04-21T19:39:13.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:12 smithi191 ceph-mon[31636]: pgmap v17831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-04-21T19:39:13.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33263.992036 secs 2024-04-21T19:39:13.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:12 smithi170 ceph-mon[31212]: pgmap v17831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-04-21T19:39:13.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33263.992036 secs 2024-04-21T19:39:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:15.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:14 smithi077 ceph-mon[27902]: pgmap v17832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-04-21T19:39:15.126 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33265.750293 secs 2024-04-21T19:39:15.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:14 smithi191 ceph-mon[31636]: pgmap v17832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-04-21T19:39:15.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33265.750293 secs 2024-04-21T19:39:15.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:14 smithi170 ceph-mon[31212]: pgmap v17832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-04-21T19:39:15.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33265.750293 secs 2024-04-21T19:39:17.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:16 smithi077 ceph-mon[27902]: pgmap v17833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:39:17.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:16 smithi191 ceph-mon[31636]: pgmap v17833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:39:17.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:16 smithi170 ceph-mon[31212]: pgmap v17833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:39:18.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33268.992154 secs 2024-04-21T19:39:18.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33268.992154 secs 2024-04-21T19:39:18.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33268.992154 secs 2024-04-21T19:39:19.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:18 smithi077 ceph-mon[27902]: pgmap v17834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:39:19.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:18 smithi191 ceph-mon[31636]: pgmap v17834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:39:19.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:18 smithi170 ceph-mon[31212]: pgmap v17834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:39:20.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:20.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33270.750410 secs 2024-04-21T19:39:20.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33270.750410 secs 2024-04-21T19:39:20.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33270.750410 secs 2024-04-21T19:39:21.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:20 smithi077 ceph-mon[27902]: pgmap v17835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:39:21.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:20 smithi191 ceph-mon[31636]: pgmap v17835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:39:21.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:20 smithi170 ceph-mon[31212]: pgmap v17835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:39:23.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:22 smithi077 ceph-mon[27902]: pgmap v17836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:39:23.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33273.992279 secs 2024-04-21T19:39:23.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:22 smithi191 ceph-mon[31636]: pgmap v17836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:39:23.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33273.992279 secs 2024-04-21T19:39:23.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:22 smithi170 ceph-mon[31212]: pgmap v17836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:39:23.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33273.992279 secs 2024-04-21T19:39:25.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:24 smithi170 ceph-mon[31212]: pgmap v17837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:25.048 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33275.750480 secs 2024-04-21T19:39:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:25.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:24 smithi077 ceph-mon[27902]: pgmap v17837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:25.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33275.750480 secs 2024-04-21T19:39:25.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:24 smithi191 ceph-mon[31636]: pgmap v17837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:25.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33275.750480 secs 2024-04-21T19:39:27.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:26 smithi077 ceph-mon[27902]: pgmap v17838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:27.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:26 smithi191 ceph-mon[31636]: pgmap v17838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:27.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:26 smithi170 ceph-mon[31212]: pgmap v17838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:28.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33278.992424 secs 2024-04-21T19:39:28.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33278.992424 secs 2024-04-21T19:39:28.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33278.992424 secs 2024-04-21T19:39:29.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:28 smithi077 ceph-mon[27902]: pgmap v17839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:29.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:28 smithi191 ceph-mon[31636]: pgmap v17839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:29.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:28 smithi170 ceph-mon[31212]: pgmap v17839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:30.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:30.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33280.750617 secs 2024-04-21T19:39:30.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33280.750617 secs 2024-04-21T19:39:30.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33280.750617 secs 2024-04-21T19:39:31.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:30 smithi077 ceph-mon[27902]: pgmap v17840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:31.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:30 smithi191 ceph-mon[31636]: pgmap v17840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:31.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:30 smithi170 ceph-mon[31212]: pgmap v17840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:33.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:32 smithi077 ceph-mon[27902]: pgmap v17841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:33.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33283.992541 secs 2024-04-21T19:39:33.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:32 smithi191 ceph-mon[31636]: pgmap v17841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:33.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33283.992541 secs 2024-04-21T19:39:33.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:32 smithi170 ceph-mon[31212]: pgmap v17841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:33.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33283.992541 secs 2024-04-21T19:39:35.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:35.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:34 smithi077 ceph-mon[27902]: pgmap v17842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:35.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33285.750734 secs 2024-04-21T19:39:35.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:39:35.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:34 smithi191 ceph-mon[31636]: pgmap v17842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:35.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33285.750734 secs 2024-04-21T19:39:35.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:39:35.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:34 smithi170 ceph-mon[31212]: pgmap v17842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:35.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33285.750734 secs 2024-04-21T19:39:35.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:39:36.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:39:36.127 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:39:36.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:39:36.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:39:36.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:39:36.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:39:36.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:39:36.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:39:36.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:39:37.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:36 smithi191 ceph-mon[31636]: pgmap v17843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:37.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:36 smithi170 ceph-mon[31212]: pgmap v17843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:37.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:36 smithi077 ceph-mon[27902]: pgmap v17843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:38.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33288.992677 secs 2024-04-21T19:39:38.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33288.992677 secs 2024-04-21T19:39:38.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33288.992677 secs 2024-04-21T19:39:39.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:38 smithi170 ceph-mon[31212]: pgmap v17844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:38 smithi191 ceph-mon[31636]: pgmap v17844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:39.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:38 smithi077 ceph-mon[27902]: pgmap v17844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:40.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:40.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33290.750860 secs 2024-04-21T19:39:40.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33290.750860 secs 2024-04-21T19:39:40.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33290.750860 secs 2024-04-21T19:39:41.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:40 smithi170 ceph-mon[31212]: pgmap v17845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:41.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:40 smithi077 ceph-mon[27902]: pgmap v17845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:41.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:40 smithi191 ceph-mon[31636]: pgmap v17845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:43.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:42 smithi170 ceph-mon[31212]: pgmap v17846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:43.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33293.992780 secs 2024-04-21T19:39:43.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:42 smithi077 ceph-mon[27902]: pgmap v17846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:43.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33293.992780 secs 2024-04-21T19:39:43.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:42 smithi191 ceph-mon[31636]: pgmap v17846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:43.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33293.992780 secs 2024-04-21T19:39:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:45.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:44 smithi170 ceph-mon[31212]: pgmap v17847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:45.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33295.750987 secs 2024-04-21T19:39:45.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:44 smithi077 ceph-mon[27902]: pgmap v17847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:45.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33295.750987 secs 2024-04-21T19:39:45.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:44 smithi191 ceph-mon[31636]: pgmap v17847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:45.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33295.750987 secs 2024-04-21T19:39:47.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:46 smithi170 ceph-mon[31212]: pgmap v17848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:47.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:46 smithi077 ceph-mon[27902]: pgmap v17848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:47.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:46 smithi191 ceph-mon[31636]: pgmap v17848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:48.298 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33298.992908 secs 2024-04-21T19:39:48.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33298.992908 secs 2024-04-21T19:39:48.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33298.992908 secs 2024-04-21T19:39:49.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:48 smithi170 ceph-mon[31212]: pgmap v17849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:49.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:48 smithi077 ceph-mon[27902]: pgmap v17849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:49.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:48 smithi191 ceph-mon[31636]: pgmap v17849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:50.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33300.751083 secs 2024-04-21T19:39:50.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33300.751083 secs 2024-04-21T19:39:50.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33300.751083 secs 2024-04-21T19:39:51.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:51 smithi170 ceph-mon[31212]: pgmap v17850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:51.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:51 smithi077 ceph-mon[27902]: pgmap v17850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:51.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:51 smithi191 ceph-mon[31636]: pgmap v17850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:53.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:53 smithi170 ceph-mon[31212]: pgmap v17851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:53.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33303.993036 secs 2024-04-21T19:39:53.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:53 smithi077 ceph-mon[27902]: pgmap v17851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:53.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33303.993036 secs 2024-04-21T19:39:53.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:53 smithi191 ceph-mon[31636]: pgmap v17851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:53.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33303.993036 secs 2024-04-21T19:39:55.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:39:55.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:55 smithi170 ceph-mon[31212]: pgmap v17852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:55.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33305.751212 secs 2024-04-21T19:39:55.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:55 smithi077 ceph-mon[27902]: pgmap v17852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:55.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33305.751212 secs 2024-04-21T19:39:55.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:55 smithi191 ceph-mon[31636]: pgmap v17852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:55.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33305.751212 secs 2024-04-21T19:39:57.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:57 smithi170 ceph-mon[31212]: pgmap v17853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:57.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:57 smithi077 ceph-mon[27902]: pgmap v17853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:57.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:57 smithi191 ceph-mon[31636]: pgmap v17853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:39:58.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33308.993186 secs 2024-04-21T19:39:58.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33308.993186 secs 2024-04-21T19:39:58.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33308.993186 secs 2024-04-21T19:39:59.279 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:39:59 smithi077 ceph-mon[27902]: pgmap v17854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:59.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:39:59 smithi170 ceph-mon[31212]: pgmap v17854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:39:59.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:39:59 smithi191 ceph-mon[31636]: pgmap v17854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:00.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33310.751294 secs 2024-04-21T19:40:00.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:40:00.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33310.751294 secs 2024-04-21T19:40:00.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:40:00.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33310.751294 secs 2024-04-21T19:40:00.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:40:01.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:01 smithi170 ceph-mon[31212]: pgmap v17855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:01.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:01 smithi077 ceph-mon[27902]: pgmap v17855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:01.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:01 smithi191 ceph-mon[31636]: pgmap v17855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:03.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:03 smithi170 ceph-mon[31212]: pgmap v17856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-04-21T19:40:03.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33313.993333 secs 2024-04-21T19:40:03.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:03 smithi077 ceph-mon[27902]: pgmap v17856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-04-21T19:40:03.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33313.993333 secs 2024-04-21T19:40:03.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:03 smithi191 ceph-mon[31636]: pgmap v17856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-04-21T19:40:03.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33313.993333 secs 2024-04-21T19:40:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:05 smithi170 ceph-mon[31212]: pgmap v17857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-04-21T19:40:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33315.751369 secs 2024-04-21T19:40:05.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:05 smithi170 ceph-mon[31212]: osdmap e1188: 12 total, 12 up, 12 in 2024-04-21T19:40:05.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:05 smithi077 ceph-mon[27902]: pgmap v17857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-04-21T19:40:05.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33315.751369 secs 2024-04-21T19:40:05.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:05 smithi077 ceph-mon[27902]: osdmap e1188: 12 total, 12 up, 12 in 2024-04-21T19:40:05.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:05 smithi191 ceph-mon[31636]: pgmap v17857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-04-21T19:40:05.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33315.751369 secs 2024-04-21T19:40:05.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:05 smithi191 ceph-mon[31636]: osdmap e1188: 12 total, 12 up, 12 in 2024-04-21T19:40:07.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:07 smithi170 ceph-mon[31212]: pgmap v17859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:40:07.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:07 smithi077 ceph-mon[27902]: pgmap v17859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:40:07.460 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:07 smithi191 ceph-mon[31636]: pgmap v17859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:40:08.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33318.993506 secs 2024-04-21T19:40:08.377 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33318.993506 secs 2024-04-21T19:40:08.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33318.993506 secs 2024-04-21T19:40:09.299 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:09 smithi170 ceph-mon[31212]: pgmap v17860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:40:09.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:09 smithi170 ceph-mon[31212]: osdmap e1189: 12 total, 12 up, 12 in 2024-04-21T19:40:09.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:09 smithi191 ceph-mon[31636]: pgmap v17860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:40:09.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:09 smithi191 ceph-mon[31636]: osdmap e1189: 12 total, 12 up, 12 in 2024-04-21T19:40:09.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:09 smithi077 ceph-mon[27902]: pgmap v17860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:40:09.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:09 smithi077 ceph-mon[27902]: osdmap e1189: 12 total, 12 up, 12 in 2024-04-21T19:40:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:10.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33320.751506 secs 2024-04-21T19:40:10.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33320.751506 secs 2024-04-21T19:40:10.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33320.751506 secs 2024-04-21T19:40:11.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:11 smithi077 ceph-mon[27902]: pgmap v17862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T19:40:11.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:11 smithi191 ceph-mon[31636]: pgmap v17862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T19:40:11.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:11 smithi170 ceph-mon[31212]: pgmap v17862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T19:40:13.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:13 smithi077 ceph-mon[27902]: pgmap v17863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 33 op/s 2024-04-21T19:40:13.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33323.993646 secs 2024-04-21T19:40:13.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:13 smithi191 ceph-mon[31636]: pgmap v17863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 33 op/s 2024-04-21T19:40:13.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33323.993646 secs 2024-04-21T19:40:13.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:13 smithi170 ceph-mon[31212]: pgmap v17863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 33 op/s 2024-04-21T19:40:13.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33323.993646 secs 2024-04-21T19:40:15.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:15.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:15 smithi077 ceph-mon[27902]: pgmap v17864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 KiB/s wr, 27 op/s 2024-04-21T19:40:15.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33325.751620 secs 2024-04-21T19:40:15.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:15 smithi191 ceph-mon[31636]: pgmap v17864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 KiB/s wr, 27 op/s 2024-04-21T19:40:15.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33325.751620 secs 2024-04-21T19:40:15.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:15 smithi170 ceph-mon[31212]: pgmap v17864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 KiB/s wr, 27 op/s 2024-04-21T19:40:15.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33325.751620 secs 2024-04-21T19:40:17.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:17 smithi077 ceph-mon[27902]: pgmap v17865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:40:17.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:17 smithi191 ceph-mon[31636]: pgmap v17865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:40:17.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:17 smithi170 ceph-mon[31212]: pgmap v17865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:40:18.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33328.993813 secs 2024-04-21T19:40:18.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33328.993813 secs 2024-04-21T19:40:18.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33328.993813 secs 2024-04-21T19:40:19.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:19 smithi077 ceph-mon[27902]: pgmap v17866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:40:19.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:19 smithi191 ceph-mon[31636]: pgmap v17866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:40:19.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:19 smithi170 ceph-mon[31212]: pgmap v17866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:40:20.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:20.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33330.751735 secs 2024-04-21T19:40:20.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33330.751735 secs 2024-04-21T19:40:20.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33330.751735 secs 2024-04-21T19:40:21.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:21 smithi077 ceph-mon[27902]: pgmap v17867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:40:21.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:21 smithi191 ceph-mon[31636]: pgmap v17867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:40:21.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:21 smithi170 ceph-mon[31212]: pgmap v17867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:40:23.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:23 smithi077 ceph-mon[27902]: pgmap v17868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:40:23.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33333.993936 secs 2024-04-21T19:40:23.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:23 smithi191 ceph-mon[31636]: pgmap v17868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:40:23.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33333.993936 secs 2024-04-21T19:40:23.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:23 smithi170 ceph-mon[31212]: pgmap v17868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:40:23.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33333.993936 secs 2024-04-21T19:40:25.122 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:25.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:25 smithi077 ceph-mon[27902]: pgmap v17869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:25.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33335.751851 secs 2024-04-21T19:40:25.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:25 smithi191 ceph-mon[31636]: pgmap v17869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:25.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33335.751851 secs 2024-04-21T19:40:25.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:25 smithi170 ceph-mon[31212]: pgmap v17869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:25.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33335.751851 secs 2024-04-21T19:40:27.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:27 smithi077 ceph-mon[27902]: pgmap v17870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:27.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:27 smithi191 ceph-mon[31636]: pgmap v17870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:27.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:27 smithi170 ceph-mon[31212]: pgmap v17870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:28.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33338.994069 secs 2024-04-21T19:40:28.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33338.994069 secs 2024-04-21T19:40:28.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33338.994069 secs 2024-04-21T19:40:29.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:29 smithi077 ceph-mon[27902]: pgmap v17871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:29.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:29 smithi191 ceph-mon[31636]: pgmap v17871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:29.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:29 smithi170 ceph-mon[31212]: pgmap v17871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:30.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33340.751961 secs 2024-04-21T19:40:30.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33340.751961 secs 2024-04-21T19:40:30.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33340.751961 secs 2024-04-21T19:40:31.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:31 smithi077 ceph-mon[27902]: pgmap v17872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:31.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:31 smithi191 ceph-mon[31636]: pgmap v17872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:31.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:31 smithi170 ceph-mon[31212]: pgmap v17872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:33.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:33 smithi077 ceph-mon[27902]: pgmap v17873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:33.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33343.994200 secs 2024-04-21T19:40:33.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:33 smithi191 ceph-mon[31636]: pgmap v17873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:33.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33343.994200 secs 2024-04-21T19:40:33.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:33 smithi170 ceph-mon[31212]: pgmap v17873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:33.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33343.994200 secs 2024-04-21T19:40:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:35.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:35 smithi077 ceph-mon[27902]: pgmap v17874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:35.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33345.752069 secs 2024-04-21T19:40:35.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:40:35.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:35 smithi191 ceph-mon[31636]: pgmap v17874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:35.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33345.752069 secs 2024-04-21T19:40:35.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:40:35.549 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:35 smithi170 ceph-mon[31212]: pgmap v17874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:35.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33345.752069 secs 2024-04-21T19:40:35.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:40:36.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:40:36.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:40:36.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:40:36.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:40:36.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:40:36.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:40:36.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:40:36.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:40:36.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:40:37.378 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:37 smithi077 ceph-mon[27902]: pgmap v17875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:37.451 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:37 smithi170 ceph-mon[31212]: pgmap v17875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:37.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:37 smithi191 ceph-mon[31636]: pgmap v17875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:38.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33348.994270 secs 2024-04-21T19:40:38.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33348.994270 secs 2024-04-21T19:40:38.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33348.994270 secs 2024-04-21T19:40:39.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:39 smithi077 ceph-mon[27902]: pgmap v17876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:39.461 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:39 smithi191 ceph-mon[31636]: pgmap v17876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:39.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:39 smithi170 ceph-mon[31212]: pgmap v17876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:40.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:40.379 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33350.752162 secs 2024-04-21T19:40:40.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33350.752162 secs 2024-04-21T19:40:40.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33350.752162 secs 2024-04-21T19:40:41.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:41 smithi191 ceph-mon[31636]: pgmap v17877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:41.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:41 smithi170 ceph-mon[31212]: pgmap v17877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:41.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:41 smithi077 ceph-mon[27902]: pgmap v17877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:43.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:43 smithi191 ceph-mon[31636]: pgmap v17878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:43.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33353.994397 secs 2024-04-21T19:40:43.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:43 smithi170 ceph-mon[31212]: pgmap v17878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:43.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33353.994397 secs 2024-04-21T19:40:43.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:43 smithi077 ceph-mon[27902]: pgmap v17878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:43.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33353.994397 secs 2024-04-21T19:40:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:45.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:45 smithi191 ceph-mon[31636]: pgmap v17879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:45.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33355.752290 secs 2024-04-21T19:40:45.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:45 smithi170 ceph-mon[31212]: pgmap v17879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:45.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33355.752290 secs 2024-04-21T19:40:45.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:45 smithi077 ceph-mon[27902]: pgmap v17879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:45.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33355.752290 secs 2024-04-21T19:40:47.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:47 smithi191 ceph-mon[31636]: pgmap v17880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:47.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:47 smithi170 ceph-mon[31212]: pgmap v17880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:47.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:47 smithi077 ceph-mon[27902]: pgmap v17880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:48.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33358.994521 secs 2024-04-21T19:40:48.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33358.994521 secs 2024-04-21T19:40:48.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33358.994521 secs 2024-04-21T19:40:49.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:49 smithi191 ceph-mon[31636]: pgmap v17881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:49.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:49 smithi170 ceph-mon[31212]: pgmap v17881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:49.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:49 smithi077 ceph-mon[27902]: pgmap v17881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:50.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33360.752408 secs 2024-04-21T19:40:50.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33360.752408 secs 2024-04-21T19:40:50.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33360.752408 secs 2024-04-21T19:40:51.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:51 smithi191 ceph-mon[31636]: pgmap v17882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:51.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:51 smithi170 ceph-mon[31212]: pgmap v17882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:51.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:51 smithi077 ceph-mon[27902]: pgmap v17882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:53.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:53 smithi191 ceph-mon[31636]: pgmap v17883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:53.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33363.994646 secs 2024-04-21T19:40:53.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:53 smithi170 ceph-mon[31212]: pgmap v17883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:53.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33363.994646 secs 2024-04-21T19:40:53.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:53 smithi077 ceph-mon[27902]: pgmap v17883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:53.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33363.994646 secs 2024-04-21T19:40:54.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33365.752527 secs 2024-04-21T19:40:54.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33365.752527 secs 2024-04-21T19:40:54.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33365.752527 secs 2024-04-21T19:40:55.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:40:55.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:55 smithi191 ceph-mon[31636]: pgmap v17884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:55.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:55 smithi170 ceph-mon[31212]: pgmap v17884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:55.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:55 smithi077 ceph-mon[27902]: pgmap v17884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:57.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:57 smithi191 ceph-mon[31636]: pgmap v17885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:57.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:57 smithi170 ceph-mon[31212]: pgmap v17885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:57.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:57 smithi077 ceph-mon[27902]: pgmap v17885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:40:58.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33368.994801 secs 2024-04-21T19:40:58.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33368.994801 secs 2024-04-21T19:40:58.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33368.994801 secs 2024-04-21T19:40:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:40:58.968+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:40:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:40:58.968+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:40:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:40:58.969+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:40:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:40:58.969+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:40:59.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:59 smithi191 ceph-mon[31636]: pgmap v17886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:59.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33370.752650 secs 2024-04-21T19:40:59.531 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:59 smithi077 ceph-mon[27902]: pgmap v17886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:59.531 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33370.752650 secs 2024-04-21T19:40:59.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:59 smithi170 ceph-mon[31212]: pgmap v17886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:40:59.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33370.752650 secs 2024-04-21T19:41:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:01.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:01 smithi191 ceph-mon[31636]: pgmap v17887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:01.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:01 smithi170 ceph-mon[31212]: pgmap v17887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:01.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:01 smithi077 ceph-mon[27902]: pgmap v17887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:03.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:03 smithi191 ceph-mon[31636]: pgmap v17888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:03.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33373.994885 secs 2024-04-21T19:41:03.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:03 smithi170 ceph-mon[31212]: pgmap v17888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:03.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33373.994885 secs 2024-04-21T19:41:03.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:03 smithi077 ceph-mon[27902]: pgmap v17888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:03.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33373.994885 secs 2024-04-21T19:41:04.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33375.752788 secs 2024-04-21T19:41:04.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33375.752788 secs 2024-04-21T19:41:04.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33375.752788 secs 2024-04-21T19:41:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:05.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:05 smithi191 ceph-mon[31636]: pgmap v17889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:05.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:05 smithi191 ceph-mon[31636]: osdmap e1190: 12 total, 12 up, 12 in 2024-04-21T19:41:05.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:05 smithi170 ceph-mon[31212]: pgmap v17889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:05.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:05 smithi170 ceph-mon[31212]: osdmap e1190: 12 total, 12 up, 12 in 2024-04-21T19:41:05.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:05 smithi077 ceph-mon[27902]: pgmap v17889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:05.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:05 smithi077 ceph-mon[27902]: osdmap e1190: 12 total, 12 up, 12 in 2024-04-21T19:41:07.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:07 smithi191 ceph-mon[31636]: pgmap v17891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:41:07.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:07 smithi170 ceph-mon[31212]: pgmap v17891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:41:07.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:07 smithi077 ceph-mon[27902]: pgmap v17891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:41:08.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33378.995005 secs 2024-04-21T19:41:08.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33378.995005 secs 2024-04-21T19:41:08.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33378.995005 secs 2024-04-21T19:41:09.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:09 smithi191 ceph-mon[31636]: pgmap v17892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:41:09.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:09 smithi191 ceph-mon[31636]: osdmap e1191: 12 total, 12 up, 12 in 2024-04-21T19:41:09.462 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33380.752877 secs 2024-04-21T19:41:09.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:09 smithi170 ceph-mon[31212]: pgmap v17892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:41:09.550 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:09 smithi170 ceph-mon[31212]: osdmap e1191: 12 total, 12 up, 12 in 2024-04-21T19:41:09.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33380.752877 secs 2024-04-21T19:41:09.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:09 smithi077 ceph-mon[27902]: pgmap v17892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:41:09.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:09 smithi077 ceph-mon[27902]: osdmap e1191: 12 total, 12 up, 12 in 2024-04-21T19:41:09.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33380.752877 secs 2024-04-21T19:41:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:11.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:11 smithi170 ceph-mon[31212]: pgmap v17894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:41:11.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:11 smithi077 ceph-mon[27902]: pgmap v17894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:41:11.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:11 smithi191 ceph-mon[31636]: pgmap v17894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:41:13.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:13 smithi170 ceph-mon[31212]: pgmap v17895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:41:13.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33383.995076 secs 2024-04-21T19:41:13.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:13 smithi077 ceph-mon[27902]: pgmap v17895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:41:13.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33383.995076 secs 2024-04-21T19:41:13.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:13 smithi191 ceph-mon[31636]: pgmap v17895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:41:13.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33383.995076 secs 2024-04-21T19:41:14.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33385.752937 secs 2024-04-21T19:41:14.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33385.752937 secs 2024-04-21T19:41:14.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33385.752937 secs 2024-04-21T19:41:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:15.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:15 smithi170 ceph-mon[31212]: pgmap v17896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:41:15.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:15 smithi077 ceph-mon[27902]: pgmap v17896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:41:15.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:15 smithi191 ceph-mon[31636]: pgmap v17896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T19:41:17.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:17 smithi170 ceph-mon[31212]: pgmap v17897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:41:17.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:17 smithi077 ceph-mon[27902]: pgmap v17897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:41:17.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:17 smithi191 ceph-mon[31636]: pgmap v17897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:41:18.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33388.995203 secs 2024-04-21T19:41:18.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33388.995203 secs 2024-04-21T19:41:18.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33388.995203 secs 2024-04-21T19:41:19.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:19 smithi170 ceph-mon[31212]: pgmap v17898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:41:19.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33390.753046 secs 2024-04-21T19:41:19.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:19 smithi077 ceph-mon[27902]: pgmap v17898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:41:19.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33390.753046 secs 2024-04-21T19:41:19.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:19 smithi191 ceph-mon[31636]: pgmap v17898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:41:19.713 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33390.753046 secs 2024-04-21T19:41:20.124 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:20.551 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:20 smithi170 ceph-mon[31212]: pgmap v17899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:41:20.629 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:20 smithi077 ceph-mon[27902]: pgmap v17899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:41:20.712 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:20 smithi191 ceph-mon[31636]: pgmap v17899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:41:23.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:22 smithi077 ceph-mon[27902]: pgmap v17900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:41:23.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33393.995302 secs 2024-04-21T19:41:23.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:22 smithi191 ceph-mon[31636]: pgmap v17900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:41:23.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33393.995302 secs 2024-04-21T19:41:23.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:22 smithi170 ceph-mon[31212]: pgmap v17900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:41:23.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33393.995302 secs 2024-04-21T19:41:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:25.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:24 smithi077 ceph-mon[27902]: pgmap v17901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:25.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33395.753157 secs 2024-04-21T19:41:25.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:24 smithi191 ceph-mon[31636]: pgmap v17901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:25.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33395.753157 secs 2024-04-21T19:41:25.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:24 smithi170 ceph-mon[31212]: pgmap v17901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:25.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33395.753157 secs 2024-04-21T19:41:27.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:26 smithi077 ceph-mon[27902]: pgmap v17902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:27.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:26 smithi191 ceph-mon[31636]: pgmap v17902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:27.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:26 smithi170 ceph-mon[31212]: pgmap v17902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:28.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33398.995430 secs 2024-04-21T19:41:28.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33398.995430 secs 2024-04-21T19:41:28.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33398.995430 secs 2024-04-21T19:41:29.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:28 smithi077 ceph-mon[27902]: pgmap v17903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:29.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:28 smithi191 ceph-mon[31636]: pgmap v17903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:29.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:28 smithi170 ceph-mon[31212]: pgmap v17903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:30.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33400.753220 secs 2024-04-21T19:41:30.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33400.753220 secs 2024-04-21T19:41:30.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33400.753220 secs 2024-04-21T19:41:31.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:30 smithi191 ceph-mon[31636]: pgmap v17904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:31.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:30 smithi170 ceph-mon[31212]: pgmap v17904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:31.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:30 smithi077 ceph-mon[27902]: pgmap v17904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:33.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:32 smithi191 ceph-mon[31636]: pgmap v17905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:33.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33403.995492 secs 2024-04-21T19:41:33.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:32 smithi170 ceph-mon[31212]: pgmap v17905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:33.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33403.995492 secs 2024-04-21T19:41:33.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:32 smithi077 ceph-mon[27902]: pgmap v17905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:33.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33403.995492 secs 2024-04-21T19:41:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:35.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:34 smithi191 ceph-mon[31636]: pgmap v17906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:35.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33405.753315 secs 2024-04-21T19:41:35.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:34 smithi170 ceph-mon[31212]: pgmap v17906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:35.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33405.753315 secs 2024-04-21T19:41:35.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:34 smithi077 ceph-mon[27902]: pgmap v17906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:35.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33405.753315 secs 2024-04-21T19:41:36.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:41:36.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:41:36.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:41:37.202 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:36 smithi170 ceph-mon[31212]: pgmap v17907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:37.202 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:41:37.202 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:41:37.202 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:41:37.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:36 smithi191 ceph-mon[31636]: pgmap v17907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:37.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:41:37.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:41:37.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:41:37.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:36 smithi077 ceph-mon[27902]: pgmap v17907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:37.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:41:37.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:41:37.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:41:38.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33408.995609 secs 2024-04-21T19:41:38.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33408.995609 secs 2024-04-21T19:41:38.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33408.995609 secs 2024-04-21T19:41:39.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:38 smithi191 ceph-mon[31636]: pgmap v17908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:39.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:38 smithi170 ceph-mon[31212]: pgmap v17908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:39.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:38 smithi077 ceph-mon[27902]: pgmap v17908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:40.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:40.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33410.753432 secs 2024-04-21T19:41:40.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33410.753432 secs 2024-04-21T19:41:40.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33410.753432 secs 2024-04-21T19:41:41.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:40 smithi191 ceph-mon[31636]: pgmap v17909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:41.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:40 smithi170 ceph-mon[31212]: pgmap v17909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:41.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:40 smithi077 ceph-mon[27902]: pgmap v17909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:43.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:42 smithi191 ceph-mon[31636]: pgmap v17910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:43.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33413.995728 secs 2024-04-21T19:41:43.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:42 smithi170 ceph-mon[31212]: pgmap v17910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:43.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33413.995728 secs 2024-04-21T19:41:43.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:42 smithi077 ceph-mon[27902]: pgmap v17910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:43.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33413.995728 secs 2024-04-21T19:41:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:41:43.975+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:41:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:41:43.975+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:41:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:41:43.975+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:41:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:41:43.975+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:41:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:45.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:44 smithi191 ceph-mon[31636]: pgmap v17911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:45.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33415.753543 secs 2024-04-21T19:41:45.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:44 smithi170 ceph-mon[31212]: pgmap v17911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:45.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33415.753543 secs 2024-04-21T19:41:45.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:44 smithi077 ceph-mon[27902]: pgmap v17911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:45.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33415.753543 secs 2024-04-21T19:41:47.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:46 smithi191 ceph-mon[31636]: pgmap v17912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:47.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:46 smithi170 ceph-mon[31212]: pgmap v17912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:47.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:46 smithi077 ceph-mon[27902]: pgmap v17912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:48.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33418.995868 secs 2024-04-21T19:41:48.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33418.995868 secs 2024-04-21T19:41:48.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33418.995868 secs 2024-04-21T19:41:49.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:48 smithi191 ceph-mon[31636]: pgmap v17913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:49.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:48 smithi170 ceph-mon[31212]: pgmap v17913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:49.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:48 smithi077 ceph-mon[27902]: pgmap v17913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:50.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33420.753677 secs 2024-04-21T19:41:50.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33420.753677 secs 2024-04-21T19:41:50.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33420.753677 secs 2024-04-21T19:41:51.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:50 smithi191 ceph-mon[31636]: pgmap v17914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:51.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:50 smithi170 ceph-mon[31212]: pgmap v17914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:51.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:50 smithi077 ceph-mon[27902]: pgmap v17914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:53.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:52 smithi191 ceph-mon[31636]: pgmap v17915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:53.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33423.995968 secs 2024-04-21T19:41:53.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:52 smithi170 ceph-mon[31212]: pgmap v17915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:53.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33423.995968 secs 2024-04-21T19:41:53.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:52 smithi077 ceph-mon[27902]: pgmap v17915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:53.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33423.995968 secs 2024-04-21T19:41:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:41:55.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:54 smithi191 ceph-mon[31636]: pgmap v17916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:55.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33425.753770 secs 2024-04-21T19:41:55.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:54 smithi170 ceph-mon[31212]: pgmap v17916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:55.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33425.753770 secs 2024-04-21T19:41:55.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:54 smithi077 ceph-mon[27902]: pgmap v17916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:55.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33425.753770 secs 2024-04-21T19:41:57.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:56 smithi191 ceph-mon[31636]: pgmap v17917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:57.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:56 smithi170 ceph-mon[31212]: pgmap v17917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:57.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:56 smithi077 ceph-mon[27902]: pgmap v17917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:41:58.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33428.996094 secs 2024-04-21T19:41:58.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33428.996094 secs 2024-04-21T19:41:58.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33428.996094 secs 2024-04-21T19:41:59.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:58 smithi191 ceph-mon[31636]: pgmap v17918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:59.282 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:58 smithi077 ceph-mon[27902]: pgmap v17918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:41:59.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:58 smithi170 ceph-mon[31212]: pgmap v17918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:00.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:41:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33430.753898 secs 2024-04-21T19:42:00.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:41:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33430.753898 secs 2024-04-21T19:42:00.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:41:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33430.753898 secs 2024-04-21T19:42:01.301 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:00 smithi170 ceph-mon[31212]: pgmap v17919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:01.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:00 smithi077 ceph-mon[27902]: pgmap v17919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:01.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:00 smithi191 ceph-mon[31636]: pgmap v17919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:03.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:02 smithi170 ceph-mon[31212]: pgmap v17920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:03.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33433.996220 secs 2024-04-21T19:42:03.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:02 smithi077 ceph-mon[27902]: pgmap v17920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:03.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33433.996220 secs 2024-04-21T19:42:03.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:02 smithi191 ceph-mon[31636]: pgmap v17920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:03.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33433.996220 secs 2024-04-21T19:42:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:05.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:04 smithi170 ceph-mon[31212]: pgmap v17921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:05.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33435.754007 secs 2024-04-21T19:42:05.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:04 smithi170 ceph-mon[31212]: osdmap e1192: 12 total, 12 up, 12 in 2024-04-21T19:42:05.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:04 smithi077 ceph-mon[27902]: pgmap v17921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:05.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33435.754007 secs 2024-04-21T19:42:05.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:04 smithi077 ceph-mon[27902]: osdmap e1192: 12 total, 12 up, 12 in 2024-04-21T19:42:05.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:04 smithi191 ceph-mon[31636]: pgmap v17921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:05.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33435.754007 secs 2024-04-21T19:42:05.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:04 smithi191 ceph-mon[31636]: osdmap e1192: 12 total, 12 up, 12 in 2024-04-21T19:42:07.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:06 smithi170 ceph-mon[31212]: pgmap v17923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:42:07.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:06 smithi077 ceph-mon[27902]: pgmap v17923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:42:07.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:06 smithi191 ceph-mon[31636]: pgmap v17923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:42:08.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33438.996326 secs 2024-04-21T19:42:08.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33438.996326 secs 2024-04-21T19:42:08.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33438.996326 secs 2024-04-21T19:42:09.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:08 smithi170 ceph-mon[31212]: pgmap v17924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:42:09.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:08 smithi170 ceph-mon[31212]: osdmap e1193: 12 total, 12 up, 12 in 2024-04-21T19:42:09.365 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:08 smithi191 ceph-mon[31636]: pgmap v17924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:42:09.365 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:08 smithi191 ceph-mon[31636]: osdmap e1193: 12 total, 12 up, 12 in 2024-04-21T19:42:09.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:08 smithi077 ceph-mon[27902]: pgmap v17924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:42:09.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:08 smithi077 ceph-mon[27902]: osdmap e1193: 12 total, 12 up, 12 in 2024-04-21T19:42:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:10.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33440.754122 secs 2024-04-21T19:42:10.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33440.754122 secs 2024-04-21T19:42:10.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33440.754122 secs 2024-04-21T19:42:11.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:11 smithi170 ceph-mon[31212]: pgmap v17926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:42:11.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:10 smithi077 ceph-mon[27902]: pgmap v17926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:42:11.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:11 smithi191 ceph-mon[31636]: pgmap v17926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:42:13.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:13 smithi170 ceph-mon[31212]: pgmap v17927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:42:13.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33443.996475 secs 2024-04-21T19:42:13.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:13 smithi077 ceph-mon[27902]: pgmap v17927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:42:13.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33443.996475 secs 2024-04-21T19:42:13.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:13 smithi191 ceph-mon[31636]: pgmap v17927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:42:13.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33443.996475 secs 2024-04-21T19:42:15.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:15.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:15 smithi170 ceph-mon[31212]: pgmap v17928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:42:15.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33445.754237 secs 2024-04-21T19:42:15.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:15 smithi077 ceph-mon[27902]: pgmap v17928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:42:15.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33445.754237 secs 2024-04-21T19:42:15.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:15 smithi191 ceph-mon[31636]: pgmap v17928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:42:15.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33445.754237 secs 2024-04-21T19:42:17.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:17 smithi170 ceph-mon[31212]: pgmap v17929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:42:17.380 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:17 smithi077 ceph-mon[27902]: pgmap v17929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:42:17.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:17 smithi191 ceph-mon[31636]: pgmap v17929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:42:18.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33448.996595 secs 2024-04-21T19:42:18.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33448.996595 secs 2024-04-21T19:42:18.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33448.996595 secs 2024-04-21T19:42:19.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:19 smithi170 ceph-mon[31212]: pgmap v17930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:42:19.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:19 smithi077 ceph-mon[27902]: pgmap v17930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:42:19.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:19 smithi191 ceph-mon[31636]: pgmap v17930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:42:20.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:20.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33450.754317 secs 2024-04-21T19:42:20.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33450.754317 secs 2024-04-21T19:42:20.463 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33450.754317 secs 2024-04-21T19:42:21.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:21 smithi170 ceph-mon[31212]: pgmap v17931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:42:21.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:21 smithi077 ceph-mon[27902]: pgmap v17931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:42:21.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:21 smithi191 ceph-mon[31636]: pgmap v17931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:42:23.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:23 smithi170 ceph-mon[31212]: pgmap v17932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:42:23.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33453.996729 secs 2024-04-21T19:42:23.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:23 smithi077 ceph-mon[27902]: pgmap v17932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:42:23.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33453.996729 secs 2024-04-21T19:42:23.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:23 smithi191 ceph-mon[31636]: pgmap v17932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:42:23.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33453.996729 secs 2024-04-21T19:42:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:25.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:25 smithi170 ceph-mon[31212]: pgmap v17933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:25.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33455.754433 secs 2024-04-21T19:42:25.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:25 smithi077 ceph-mon[27902]: pgmap v17933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:25.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33455.754433 secs 2024-04-21T19:42:25.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:25 smithi191 ceph-mon[31636]: pgmap v17933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:25.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33455.754433 secs 2024-04-21T19:42:27.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:27 smithi170 ceph-mon[31212]: pgmap v17934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:27.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:27 smithi077 ceph-mon[27902]: pgmap v17934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:27.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:27 smithi191 ceph-mon[31636]: pgmap v17934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:28.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33458.996869 secs 2024-04-21T19:42:28.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33458.996869 secs 2024-04-21T19:42:28.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33458.996869 secs 2024-04-21T19:42:29.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:29 smithi170 ceph-mon[31212]: pgmap v17935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:29.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:29 smithi077 ceph-mon[27902]: pgmap v17935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:29.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:29 smithi191 ceph-mon[31636]: pgmap v17935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:30.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:30.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33460.754543 secs 2024-04-21T19:42:30.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33460.754543 secs 2024-04-21T19:42:30.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33460.754543 secs 2024-04-21T19:42:31.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:31 smithi170 ceph-mon[31212]: pgmap v17936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:31.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:31 smithi077 ceph-mon[27902]: pgmap v17936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:31.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:31 smithi191 ceph-mon[31636]: pgmap v17936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:33.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:33 smithi170 ceph-mon[31212]: pgmap v17937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:33.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33463.996995 secs 2024-04-21T19:42:33.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:33 smithi077 ceph-mon[27902]: pgmap v17937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:33.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33463.996995 secs 2024-04-21T19:42:33.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:33 smithi191 ceph-mon[31636]: pgmap v17937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:33.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33463.996995 secs 2024-04-21T19:42:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:35.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:35 smithi170 ceph-mon[31212]: pgmap v17938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:35.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33465.754676 secs 2024-04-21T19:42:35.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:35 smithi077 ceph-mon[27902]: pgmap v17938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:35.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33465.754676 secs 2024-04-21T19:42:35.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:35 smithi191 ceph-mon[31636]: pgmap v17938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:35.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33465.754676 secs 2024-04-21T19:42:37.302 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:37 smithi170 ceph-mon[31212]: pgmap v17939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:37.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:42:37.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:37 smithi077 ceph-mon[27902]: pgmap v17939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:37.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:42:37.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:37 smithi191 ceph-mon[31636]: pgmap v17939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:37.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:42:38.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33468.997063 secs 2024-04-21T19:42:38.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:42:38.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:42:38.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:38 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:42:38.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33468.997063 secs 2024-04-21T19:42:38.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:42:38.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:42:38.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:38 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:42:38.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33468.997063 secs 2024-04-21T19:42:38.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:42:38.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:42:38.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:38 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:42:39.366 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:39 smithi191 ceph-mon[31636]: pgmap v17940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:39.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:39 smithi077 ceph-mon[27902]: pgmap v17940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:39.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:39 smithi170 ceph-mon[31212]: pgmap v17940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:40.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33470.754787 secs 2024-04-21T19:42:40.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33470.754787 secs 2024-04-21T19:42:40.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33470.754787 secs 2024-04-21T19:42:41.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:41 smithi077 ceph-mon[27902]: pgmap v17941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:41.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:41 smithi191 ceph-mon[31636]: pgmap v17941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:41.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:41 smithi170 ceph-mon[31212]: pgmap v17941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:43.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:43 smithi077 ceph-mon[27902]: pgmap v17942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:43.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33473.997190 secs 2024-04-21T19:42:43.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:43 smithi191 ceph-mon[31636]: pgmap v17942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:43.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33473.997190 secs 2024-04-21T19:42:43.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:43 smithi170 ceph-mon[31212]: pgmap v17942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:43.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33473.997190 secs 2024-04-21T19:42:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:45.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:45 smithi077 ceph-mon[27902]: pgmap v17943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:45.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33475.754887 secs 2024-04-21T19:42:45.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:45 smithi191 ceph-mon[31636]: pgmap v17943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:45.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33475.754887 secs 2024-04-21T19:42:45.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:45 smithi170 ceph-mon[31212]: pgmap v17943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:45.552 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33475.754887 secs 2024-04-21T19:42:47.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:47 smithi077 ceph-mon[27902]: pgmap v17944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:47.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:47 smithi191 ceph-mon[31636]: pgmap v17944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:47.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:47 smithi170 ceph-mon[31212]: pgmap v17944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:48.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33478.997331 secs 2024-04-21T19:42:48.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33478.997331 secs 2024-04-21T19:42:48.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33478.997331 secs 2024-04-21T19:42:49.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:49 smithi077 ceph-mon[27902]: pgmap v17945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:49.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:49 smithi191 ceph-mon[31636]: pgmap v17945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:49.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:49 smithi170 ceph-mon[31212]: pgmap v17945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:50.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33480.754960 secs 2024-04-21T19:42:50.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33480.754960 secs 2024-04-21T19:42:50.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33480.754960 secs 2024-04-21T19:42:51.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:51 smithi077 ceph-mon[27902]: pgmap v17946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:51.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:51 smithi191 ceph-mon[31636]: pgmap v17946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:51.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:51 smithi170 ceph-mon[31212]: pgmap v17946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:53.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:53 smithi077 ceph-mon[27902]: pgmap v17947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:53.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33483.997469 secs 2024-04-21T19:42:53.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:53 smithi191 ceph-mon[31636]: pgmap v17947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:53.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33483.997469 secs 2024-04-21T19:42:53.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:53 smithi170 ceph-mon[31212]: pgmap v17947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:53.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33483.997469 secs 2024-04-21T19:42:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:42:55.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:55 smithi077 ceph-mon[27902]: pgmap v17948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:55.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33485.755069 secs 2024-04-21T19:42:55.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:55 smithi191 ceph-mon[31636]: pgmap v17948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:55.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33485.755069 secs 2024-04-21T19:42:55.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:55 smithi170 ceph-mon[31212]: pgmap v17948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:55.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33485.755069 secs 2024-04-21T19:42:57.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:57 smithi077 ceph-mon[27902]: pgmap v17949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:57.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:57 smithi191 ceph-mon[31636]: pgmap v17949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:57.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:57 smithi170 ceph-mon[31212]: pgmap v17949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:42:58.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33488.997617 secs 2024-04-21T19:42:58.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33488.997617 secs 2024-04-21T19:42:58.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33488.997617 secs 2024-04-21T19:42:59.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:42:59 smithi077 ceph-mon[27902]: pgmap v17950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:59.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:42:59 smithi191 ceph-mon[31636]: pgmap v17950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:42:59.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:42:59 smithi170 ceph-mon[31212]: pgmap v17950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:00.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33490.755199 secs 2024-04-21T19:43:00.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33490.755199 secs 2024-04-21T19:43:00.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33490.755199 secs 2024-04-21T19:43:01.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:01 smithi077 ceph-mon[27902]: pgmap v17951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:01.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:01 smithi191 ceph-mon[31636]: pgmap v17951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:01.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:01 smithi170 ceph-mon[31212]: pgmap v17951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:03.381 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:03 smithi077 ceph-mon[27902]: pgmap v17952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:03.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33493.997742 secs 2024-04-21T19:43:03.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:03 smithi191 ceph-mon[31636]: pgmap v17952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:03.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33493.997742 secs 2024-04-21T19:43:03.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:03 smithi170 ceph-mon[31212]: pgmap v17952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:03.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33493.997742 secs 2024-04-21T19:43:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:05.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:05 smithi077 ceph-mon[27902]: pgmap v17953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:05.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33495.755262 secs 2024-04-21T19:43:05.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:05 smithi077 ceph-mon[27902]: osdmap e1194: 12 total, 12 up, 12 in 2024-04-21T19:43:05.464 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:05 smithi191 ceph-mon[31636]: pgmap v17953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:05.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33495.755262 secs 2024-04-21T19:43:05.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:05 smithi191 ceph-mon[31636]: osdmap e1194: 12 total, 12 up, 12 in 2024-04-21T19:43:05.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:05 smithi170 ceph-mon[31212]: pgmap v17953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:05.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33495.755262 secs 2024-04-21T19:43:05.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:05 smithi170 ceph-mon[31212]: osdmap e1194: 12 total, 12 up, 12 in 2024-04-21T19:43:07.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:07 smithi077 ceph-mon[27902]: pgmap v17955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:43:07.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:07 smithi191 ceph-mon[31636]: pgmap v17955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:43:07.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:07 smithi170 ceph-mon[31212]: pgmap v17955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:43:08.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33498.997803 secs 2024-04-21T19:43:08.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33498.997803 secs 2024-04-21T19:43:08.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33498.997803 secs 2024-04-21T19:43:09.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:09 smithi191 ceph-mon[31636]: pgmap v17956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:43:09.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:09 smithi191 ceph-mon[31636]: osdmap e1195: 12 total, 12 up, 12 in 2024-04-21T19:43:09.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:09 smithi170 ceph-mon[31212]: pgmap v17956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:43:09.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:09 smithi170 ceph-mon[31212]: osdmap e1195: 12 total, 12 up, 12 in 2024-04-21T19:43:09.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:09 smithi077 ceph-mon[27902]: pgmap v17956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:43:09.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:09 smithi077 ceph-mon[27902]: osdmap e1195: 12 total, 12 up, 12 in 2024-04-21T19:43:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:10.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33500.755326 secs 2024-04-21T19:43:10.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33500.755326 secs 2024-04-21T19:43:10.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33500.755326 secs 2024-04-21T19:43:11.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:11 smithi191 ceph-mon[31636]: pgmap v17958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:43:11.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:11 smithi170 ceph-mon[31212]: pgmap v17958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:43:11.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:11 smithi077 ceph-mon[27902]: pgmap v17958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:43:13.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:13 smithi191 ceph-mon[31636]: pgmap v17959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:43:13.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33503.997922 secs 2024-04-21T19:43:13.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:13 smithi170 ceph-mon[31212]: pgmap v17959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:43:13.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33503.997922 secs 2024-04-21T19:43:13.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:13 smithi077 ceph-mon[27902]: pgmap v17959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:43:13.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33503.997922 secs 2024-04-21T19:43:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:15.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:15 smithi191 ceph-mon[31636]: pgmap v17960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:43:15.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33505.755454 secs 2024-04-21T19:43:15.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:15 smithi170 ceph-mon[31212]: pgmap v17960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:43:15.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33505.755454 secs 2024-04-21T19:43:15.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:15 smithi077 ceph-mon[27902]: pgmap v17960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:43:15.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33505.755454 secs 2024-04-21T19:43:17.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:17 smithi191 ceph-mon[31636]: pgmap v17961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:43:17.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:17 smithi170 ceph-mon[31212]: pgmap v17961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:43:17.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:17 smithi077 ceph-mon[27902]: pgmap v17961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:43:18.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33508.997992 secs 2024-04-21T19:43:18.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33508.997992 secs 2024-04-21T19:43:18.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33508.997992 secs 2024-04-21T19:43:19.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:19 smithi191 ceph-mon[31636]: pgmap v17962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:43:19.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:19 smithi170 ceph-mon[31212]: pgmap v17962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:43:19.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:19 smithi077 ceph-mon[27902]: pgmap v17962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:43:20.126 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:20.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33510.755571 secs 2024-04-21T19:43:20.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33510.755571 secs 2024-04-21T19:43:20.631 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33510.755571 secs 2024-04-21T19:43:21.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:21 smithi191 ceph-mon[31636]: pgmap v17963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:43:21.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:21 smithi170 ceph-mon[31212]: pgmap v17963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:43:21.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:21 smithi077 ceph-mon[27902]: pgmap v17963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:43:23.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:23 smithi191 ceph-mon[31636]: pgmap v17964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:43:23.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33513.998070 secs 2024-04-21T19:43:23.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:23 smithi170 ceph-mon[31212]: pgmap v17964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:43:23.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33513.998070 secs 2024-04-21T19:43:23.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:23 smithi077 ceph-mon[27902]: pgmap v17964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:43:23.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33513.998070 secs 2024-04-21T19:43:25.053 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:24 smithi170 ceph-mon[31212]: pgmap v17965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:25.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33515.755686 secs 2024-04-21T19:43:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:25.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:24 smithi077 ceph-mon[27902]: pgmap v17965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:25.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33515.755686 secs 2024-04-21T19:43:25.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:24 smithi191 ceph-mon[31636]: pgmap v17965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:25.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33515.755686 secs 2024-04-21T19:43:27.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:26 smithi191 ceph-mon[31636]: pgmap v17966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:27.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:26 smithi170 ceph-mon[31212]: pgmap v17966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:27.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:26 smithi077 ceph-mon[27902]: pgmap v17966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:28.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33518.998233 secs 2024-04-21T19:43:28.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33518.998233 secs 2024-04-21T19:43:28.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33518.998233 secs 2024-04-21T19:43:29.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:28 smithi191 ceph-mon[31636]: pgmap v17967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:29.284 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:28 smithi077 ceph-mon[27902]: pgmap v17967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:29.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:28 smithi170 ceph-mon[31212]: pgmap v17967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:30.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33520.755802 secs 2024-04-21T19:43:30.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33520.755802 secs 2024-04-21T19:43:30.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33520.755802 secs 2024-04-21T19:43:31.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:30 smithi191 ceph-mon[31636]: pgmap v17968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:31.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:30 smithi170 ceph-mon[31212]: pgmap v17968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:31.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:30 smithi077 ceph-mon[27902]: pgmap v17968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:33.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:32 smithi191 ceph-mon[31636]: pgmap v17969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:33.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33523.998324 secs 2024-04-21T19:43:33.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:32 smithi170 ceph-mon[31212]: pgmap v17969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:33.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33523.998324 secs 2024-04-21T19:43:33.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:32 smithi077 ceph-mon[27902]: pgmap v17969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:33.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33523.998324 secs 2024-04-21T19:43:35.125 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:35.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:34 smithi191 ceph-mon[31636]: pgmap v17970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:35.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33525.755932 secs 2024-04-21T19:43:35.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:34 smithi170 ceph-mon[31212]: pgmap v17970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:35.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33525.755932 secs 2024-04-21T19:43:35.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:34 smithi077 ceph-mon[27902]: pgmap v17970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:35.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33525.755932 secs 2024-04-21T19:43:37.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:36 smithi191 ceph-mon[31636]: pgmap v17971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:37.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:36 smithi170 ceph-mon[31212]: pgmap v17971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:37.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:36 smithi077 ceph-mon[27902]: pgmap v17971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:38.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33528.998467 secs 2024-04-21T19:43:38.208 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:43:38.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33528.998467 secs 2024-04-21T19:43:38.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:43:38.221 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33528.998467 secs 2024-04-21T19:43:38.221 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:43:39.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:38 smithi191 ceph-mon[31636]: pgmap v17972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:39.303 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:38 smithi170 ceph-mon[31212]: pgmap v17972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:39.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:38 smithi077 ceph-mon[27902]: pgmap v17972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:40.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33530.755999 secs 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33530.755999 secs 2024-04-21T19:43:40.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:43:40.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33530.755999 secs 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:43:40.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:43:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:43:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:43:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:43:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:43:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:43:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:43:41.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:41 smithi077 ceph-mon[27902]: pgmap v17973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:43:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:41 smithi191 ceph-mon[31636]: pgmap v17973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:43:41.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:41 smithi170 ceph-mon[31212]: pgmap v17973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:43 smithi077 ceph-mon[27902]: pgmap v17974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:43.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33533.998581 secs 2024-04-21T19:43:43.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:43 smithi191 ceph-mon[31636]: pgmap v17974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33533.998581 secs 2024-04-21T19:43:43.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:43 smithi170 ceph-mon[31212]: pgmap v17974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:43.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33533.998581 secs 2024-04-21T19:43:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:45.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:45 smithi077 ceph-mon[27902]: pgmap v17975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:45.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33535.756107 secs 2024-04-21T19:43:45.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:45 smithi191 ceph-mon[31636]: pgmap v17975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:45.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33535.756107 secs 2024-04-21T19:43:45.553 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:45 smithi170 ceph-mon[31212]: pgmap v17975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:45.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33535.756107 secs 2024-04-21T19:43:47.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:47 smithi077 ceph-mon[27902]: pgmap v17976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:47.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:47 smithi191 ceph-mon[31636]: pgmap v17976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:47.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:47 smithi170 ceph-mon[31212]: pgmap v17976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:48.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33538.998709 secs 2024-04-21T19:43:48.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33538.998709 secs 2024-04-21T19:43:48.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33538.998709 secs 2024-04-21T19:43:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:49 smithi077 ceph-mon[27902]: pgmap v17977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:49.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:49 smithi191 ceph-mon[31636]: pgmap v17977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:49.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:49 smithi170 ceph-mon[31212]: pgmap v17977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:50.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33540.756226 secs 2024-04-21T19:43:50.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33540.756226 secs 2024-04-21T19:43:50.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33540.756226 secs 2024-04-21T19:43:51.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:51 smithi077 ceph-mon[27902]: pgmap v17978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:51.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:51 smithi191 ceph-mon[31636]: pgmap v17978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:51.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:51 smithi170 ceph-mon[31212]: pgmap v17978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:53.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:53 smithi077 ceph-mon[27902]: pgmap v17979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:53.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33543.998835 secs 2024-04-21T19:43:53.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:53 smithi191 ceph-mon[31636]: pgmap v17979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:53.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33543.998835 secs 2024-04-21T19:43:53.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:53 smithi170 ceph-mon[31212]: pgmap v17979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:53.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33543.998835 secs 2024-04-21T19:43:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T19:43:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T19:43:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:43:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T19:43:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T19:43:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.459+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd70069000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd70069000 comp rx=0 tx=0).stop 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640b2780 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640b2780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T19:43:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:43:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:54.527+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd70054070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T19:43:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:43:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:55 smithi077 ceph-mon[27902]: pgmap v17980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33545.756318 secs 2024-04-21T19:43:55.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:55 smithi191 ceph-mon[31636]: pgmap v17980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:55.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33545.756318 secs 2024-04-21T19:43:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:55 smithi170 ceph-mon[31212]: pgmap v17980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33545.756318 secs 2024-04-21T19:43:57.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:57 smithi077 ceph-mon[27902]: pgmap v17981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:57.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:57 smithi191 ceph-mon[31636]: pgmap v17981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:57.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:57 smithi170 ceph-mon[31212]: pgmap v17981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:43:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33548.998931 secs 2024-04-21T19:43:58.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33548.998931 secs 2024-04-21T19:43:58.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33548.998931 secs 2024-04-21T19:43:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:58.994+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:43:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:58.994+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:43:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:58.995+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:43:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:43:58.995+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:43:59.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:43:59 smithi077 ceph-mon[27902]: pgmap v17982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:59.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:43:59 smithi191 ceph-mon[31636]: pgmap v17982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:43:59.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:43:59 smithi170 ceph-mon[31212]: pgmap v17982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33550.756436 secs 2024-04-21T19:44:00.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33550.756436 secs 2024-04-21T19:44:00.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33550.756436 secs 2024-04-21T19:44:01.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:01 smithi077 ceph-mon[27902]: pgmap v17983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:01.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:01 smithi191 ceph-mon[31636]: pgmap v17983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:01.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:01 smithi170 ceph-mon[31212]: pgmap v17983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:03.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:03 smithi191 ceph-mon[31636]: pgmap v17984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:03.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33553.999055 secs 2024-04-21T19:44:03.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:03 smithi170 ceph-mon[31212]: pgmap v17984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:03.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33553.999055 secs 2024-04-21T19:44:03.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:03 smithi077 ceph-mon[27902]: pgmap v17984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:03.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33553.999055 secs 2024-04-21T19:44:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:05.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:04 smithi077 ceph-mon[27902]: pgmap v17985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33555.756592 secs 2024-04-21T19:44:05.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:04 smithi191 ceph-mon[31636]: pgmap v17985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:05.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33555.756592 secs 2024-04-21T19:44:05.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:04 smithi170 ceph-mon[31212]: pgmap v17985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:05.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33555.756592 secs 2024-04-21T19:44:06.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:05 smithi077 ceph-mon[27902]: osdmap e1196: 12 total, 12 up, 12 in 2024-04-21T19:44:06.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:05 smithi191 ceph-mon[31636]: osdmap e1196: 12 total, 12 up, 12 in 2024-04-21T19:44:06.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:05 smithi170 ceph-mon[31212]: osdmap e1196: 12 total, 12 up, 12 in 2024-04-21T19:44:07.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:06 smithi077 ceph-mon[27902]: pgmap v17987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:44:07.205 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:06 smithi170 ceph-mon[31212]: pgmap v17987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:44:07.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:06 smithi191 ceph-mon[31636]: pgmap v17987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:44:08.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33558.999184 secs 2024-04-21T19:44:08.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33558.999184 secs 2024-04-21T19:44:08.225 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33558.999184 secs 2024-04-21T19:44:09.117 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:08 smithi191 ceph-mon[31636]: pgmap v17988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:44:09.117 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:08 smithi191 ceph-mon[31636]: osdmap e1197: 12 total, 12 up, 12 in 2024-04-21T19:44:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:08 smithi077 ceph-mon[27902]: pgmap v17988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:44:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:08 smithi077 ceph-mon[27902]: osdmap e1197: 12 total, 12 up, 12 in 2024-04-21T19:44:09.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:08 smithi170 ceph-mon[31212]: pgmap v17988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:44:09.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:08 smithi170 ceph-mon[31212]: osdmap e1197: 12 total, 12 up, 12 in 2024-04-21T19:44:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:10.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33560.756717 secs 2024-04-21T19:44:10.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33560.756717 secs 2024-04-21T19:44:10.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33560.756717 secs 2024-04-21T19:44:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:10 smithi077 ceph-mon[27902]: pgmap v17990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:44:11.215 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:10 smithi191 ceph-mon[31636]: pgmap v17990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:44:11.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:10 smithi170 ceph-mon[31212]: pgmap v17990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:44:13.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:12 smithi191 ceph-mon[31636]: pgmap v17991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:44:13.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33563.999306 secs 2024-04-21T19:44:13.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:12 smithi170 ceph-mon[31212]: pgmap v17991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:44:13.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33563.999306 secs 2024-04-21T19:44:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:12 smithi077 ceph-mon[27902]: pgmap v17991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:44:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33563.999306 secs 2024-04-21T19:44:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:15.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:14 smithi191 ceph-mon[31636]: pgmap v17992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-04-21T19:44:15.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33565.756816 secs 2024-04-21T19:44:15.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:14 smithi170 ceph-mon[31212]: pgmap v17992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-04-21T19:44:15.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33565.756816 secs 2024-04-21T19:44:15.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:14 smithi077 ceph-mon[27902]: pgmap v17992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-04-21T19:44:15.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33565.756816 secs 2024-04-21T19:44:17.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:16 smithi191 ceph-mon[31636]: pgmap v17993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:44:17.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:16 smithi170 ceph-mon[31212]: pgmap v17993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:44:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:16 smithi077 ceph-mon[27902]: pgmap v17993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:44:18.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33568.999428 secs 2024-04-21T19:44:18.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33568.999428 secs 2024-04-21T19:44:18.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33568.999428 secs 2024-04-21T19:44:19.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:18 smithi191 ceph-mon[31636]: pgmap v17994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:44:19.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:18 smithi170 ceph-mon[31212]: pgmap v17994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:44:19.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:18 smithi077 ceph-mon[27902]: pgmap v17994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:44:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:20.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33570.756927 secs 2024-04-21T19:44:20.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33570.756927 secs 2024-04-21T19:44:20.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33570.756927 secs 2024-04-21T19:44:21.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:20 smithi191 ceph-mon[31636]: pgmap v17995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:44:21.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:20 smithi170 ceph-mon[31212]: pgmap v17995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:44:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:20 smithi077 ceph-mon[27902]: pgmap v17995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:44:23.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:22 smithi191 ceph-mon[31636]: pgmap v17996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:44:23.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33573.999510 secs 2024-04-21T19:44:23.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:22 smithi170 ceph-mon[31212]: pgmap v17996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:44:23.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33573.999510 secs 2024-04-21T19:44:23.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:22 smithi077 ceph-mon[27902]: pgmap v17996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:44:23.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33573.999510 secs 2024-04-21T19:44:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:25.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:24 smithi191 ceph-mon[31636]: pgmap v17997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:25.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33575.757042 secs 2024-04-21T19:44:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:24 smithi170 ceph-mon[31212]: pgmap v17997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:25.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33575.757042 secs 2024-04-21T19:44:25.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:24 smithi077 ceph-mon[27902]: pgmap v17997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:25.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33575.757042 secs 2024-04-21T19:44:27.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:26 smithi191 ceph-mon[31636]: pgmap v17998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:27.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:26 smithi170 ceph-mon[31212]: pgmap v17998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:27.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:26 smithi077 ceph-mon[27902]: pgmap v17998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:28.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33578.999634 secs 2024-04-21T19:44:28.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33578.999634 secs 2024-04-21T19:44:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33578.999634 secs 2024-04-21T19:44:29.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:28 smithi191 ceph-mon[31636]: pgmap v17999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:29.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:28 smithi077 ceph-mon[27902]: pgmap v17999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:29.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:28 smithi170 ceph-mon[31212]: pgmap v17999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:30.216 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33580.757151 secs 2024-04-21T19:44:30.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33580.757151 secs 2024-04-21T19:44:30.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33580.757151 secs 2024-04-21T19:44:31.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:30 smithi191 ceph-mon[31636]: pgmap v18000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:31.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:30 smithi170 ceph-mon[31212]: pgmap v18000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:31.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:30 smithi077 ceph-mon[27902]: pgmap v18000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:32 smithi170 ceph-mon[31212]: pgmap v18001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:33.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33583.999754 secs 2024-04-21T19:44:33.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:32 smithi077 ceph-mon[27902]: pgmap v18001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:33.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33583.999754 secs 2024-04-21T19:44:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:32 smithi191 ceph-mon[31636]: pgmap v18001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33583.999754 secs 2024-04-21T19:44:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:34 smithi170 ceph-mon[31212]: pgmap v18002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:35.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33585.757265 secs 2024-04-21T19:44:35.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:34 smithi077 ceph-mon[27902]: pgmap v18002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:35.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33585.757265 secs 2024-04-21T19:44:35.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:34 smithi191 ceph-mon[31636]: pgmap v18002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:35.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33585.757265 secs 2024-04-21T19:44:37.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:36 smithi170 ceph-mon[31212]: pgmap v18003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:37.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:36 smithi077 ceph-mon[27902]: pgmap v18003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:37.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:36 smithi191 ceph-mon[31636]: pgmap v18003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:38.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33588.999874 secs 2024-04-21T19:44:38.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33588.999874 secs 2024-04-21T19:44:38.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33588.999874 secs 2024-04-21T19:44:39.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:38 smithi170 ceph-mon[31212]: pgmap v18004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:39.367 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:38 smithi191 ceph-mon[31636]: pgmap v18004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:39.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:38 smithi077 ceph-mon[27902]: pgmap v18004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:40.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33590.757377 secs 2024-04-21T19:44:40.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:39 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:44:40.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33590.757377 secs 2024-04-21T19:44:40.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:39 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:44:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33590.757377 secs 2024-04-21T19:44:40.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:39 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:44:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:40 smithi170 ceph-mon[31212]: pgmap v18005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:41.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:40 smithi077 ceph-mon[27902]: pgmap v18005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:40 smithi191 ceph-mon[31636]: pgmap v18005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:41.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:42.304 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:44:42.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:44:42.305 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:42.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:44:42.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:44:42.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:42.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:44:42.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:44:42.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:44:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:43 smithi077 ceph-mon[27902]: pgmap v18006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33593.999996 secs 2024-04-21T19:44:43.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:43 smithi191 ceph-mon[31636]: pgmap v18006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:43.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33593.999996 secs 2024-04-21T19:44:43.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:43 smithi170 ceph-mon[31212]: pgmap v18006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:43.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33593.999996 secs 2024-04-21T19:44:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:45.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:45 smithi077 ceph-mon[27902]: pgmap v18007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33595.757494 secs 2024-04-21T19:44:45.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:45 smithi191 ceph-mon[31636]: pgmap v18007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:45.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33595.757494 secs 2024-04-21T19:44:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:45 smithi170 ceph-mon[31212]: pgmap v18007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:45.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33595.757494 secs 2024-04-21T19:44:47.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:47 smithi077 ceph-mon[27902]: pgmap v18008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:47.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:47 smithi191 ceph-mon[31636]: pgmap v18008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:47.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:47 smithi170 ceph-mon[31212]: pgmap v18008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33599.000137 secs 2024-04-21T19:44:48.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33599.000137 secs 2024-04-21T19:44:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33599.000137 secs 2024-04-21T19:44:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:49 smithi077 ceph-mon[27902]: pgmap v18009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:49.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:49 smithi191 ceph-mon[31636]: pgmap v18009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:49.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:49 smithi170 ceph-mon[31212]: pgmap v18009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:50.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33600.757627 secs 2024-04-21T19:44:50.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33600.757627 secs 2024-04-21T19:44:50.554 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33600.757627 secs 2024-04-21T19:44:51.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:51 smithi077 ceph-mon[27902]: pgmap v18010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:51.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:51 smithi191 ceph-mon[31636]: pgmap v18010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:51.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:51 smithi170 ceph-mon[31212]: pgmap v18010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:53 smithi077 ceph-mon[27902]: pgmap v18011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:53.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33604.000269 secs 2024-04-21T19:44:53.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:53 smithi191 ceph-mon[31636]: pgmap v18011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:53.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33604.000269 secs 2024-04-21T19:44:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:53 smithi170 ceph-mon[31212]: pgmap v18011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:53.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33604.000269 secs 2024-04-21T19:44:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:44:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:55 smithi077 ceph-mon[27902]: pgmap v18012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:55.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33605.757741 secs 2024-04-21T19:44:55.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:55 smithi191 ceph-mon[31636]: pgmap v18012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:55.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33605.757741 secs 2024-04-21T19:44:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:55 smithi170 ceph-mon[31212]: pgmap v18012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:55.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33605.757741 secs 2024-04-21T19:44:57.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:57 smithi077 ceph-mon[27902]: pgmap v18013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:57.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:57 smithi191 ceph-mon[31636]: pgmap v18013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:57.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:57 smithi170 ceph-mon[31212]: pgmap v18013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:44:58.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33609.000397 secs 2024-04-21T19:44:58.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33609.000397 secs 2024-04-21T19:44:58.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33609.000397 secs 2024-04-21T19:44:59.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:44:59 smithi077 ceph-mon[27902]: pgmap v18014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:59.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:44:59 smithi191 ceph-mon[31636]: pgmap v18014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:44:59.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:44:59 smithi170 ceph-mon[31212]: pgmap v18014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33610.757877 secs 2024-04-21T19:45:00.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33610.757877 secs 2024-04-21T19:45:00.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33610.757877 secs 2024-04-21T19:45:01.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:01 smithi077 ceph-mon[27902]: pgmap v18015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:01.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:01 smithi191 ceph-mon[31636]: pgmap v18015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:01.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:01 smithi170 ceph-mon[31212]: pgmap v18015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:03 smithi077 ceph-mon[27902]: pgmap v18016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T19:45:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33614.000476 secs 2024-04-21T19:45:03.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:03 smithi191 ceph-mon[31636]: pgmap v18016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T19:45:03.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33614.000476 secs 2024-04-21T19:45:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:03 smithi170 ceph-mon[31212]: pgmap v18016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T19:45:03.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33614.000476 secs 2024-04-21T19:45:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:05 smithi077 ceph-mon[27902]: pgmap v18017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T19:45:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33615.757923 secs 2024-04-21T19:45:05.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:05 smithi077 ceph-mon[27902]: osdmap e1198: 12 total, 12 up, 12 in 2024-04-21T19:45:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:05 smithi191 ceph-mon[31636]: pgmap v18017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T19:45:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33615.757923 secs 2024-04-21T19:45:05.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:05 smithi191 ceph-mon[31636]: osdmap e1198: 12 total, 12 up, 12 in 2024-04-21T19:45:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:05 smithi170 ceph-mon[31212]: pgmap v18017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 18 op/s 2024-04-21T19:45:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33615.757923 secs 2024-04-21T19:45:05.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:05 smithi170 ceph-mon[31212]: osdmap e1198: 12 total, 12 up, 12 in 2024-04-21T19:45:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:07 smithi077 ceph-mon[27902]: pgmap v18019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:45:07.466 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:07 smithi191 ceph-mon[31636]: pgmap v18019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:45:07.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:07 smithi170 ceph-mon[31212]: pgmap v18019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:45:08.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33619.000540 secs 2024-04-21T19:45:08.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33619.000540 secs 2024-04-21T19:45:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33619.000540 secs 2024-04-21T19:45:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:09 smithi191 ceph-mon[31636]: pgmap v18020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:45:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:09 smithi191 ceph-mon[31636]: osdmap e1199: 12 total, 12 up, 12 in 2024-04-21T19:45:09.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:09 smithi170 ceph-mon[31212]: pgmap v18020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:45:09.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:09 smithi170 ceph-mon[31212]: osdmap e1199: 12 total, 12 up, 12 in 2024-04-21T19:45:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:09 smithi077 ceph-mon[27902]: pgmap v18020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:45:09.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:09 smithi077 ceph-mon[27902]: osdmap e1199: 12 total, 12 up, 12 in 2024-04-21T19:45:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33620.758011 secs 2024-04-21T19:45:10.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33620.758011 secs 2024-04-21T19:45:10.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33620.758011 secs 2024-04-21T19:45:11.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:11 smithi191 ceph-mon[31636]: pgmap v18022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-21T19:45:11.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:11 smithi170 ceph-mon[31212]: pgmap v18022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-21T19:45:11.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:11 smithi077 ceph-mon[27902]: pgmap v18022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-21T19:45:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:13 smithi191 ceph-mon[31636]: pgmap v18023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-04-21T19:45:13.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33624.000659 secs 2024-04-21T19:45:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:13 smithi170 ceph-mon[31212]: pgmap v18023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-04-21T19:45:13.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33624.000659 secs 2024-04-21T19:45:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:13 smithi077 ceph-mon[27902]: pgmap v18023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-04-21T19:45:13.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33624.000659 secs 2024-04-21T19:45:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:15 smithi191 ceph-mon[31636]: pgmap v18024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-04-21T19:45:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33625.758171 secs 2024-04-21T19:45:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:15 smithi170 ceph-mon[31212]: pgmap v18024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-04-21T19:45:15.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33625.758171 secs 2024-04-21T19:45:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:15 smithi077 ceph-mon[27902]: pgmap v18024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-04-21T19:45:15.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33625.758171 secs 2024-04-21T19:45:17.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:17 smithi191 ceph-mon[31636]: pgmap v18025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:45:17.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:17 smithi170 ceph-mon[31212]: pgmap v18025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:45:17.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:17 smithi077 ceph-mon[27902]: pgmap v18025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:45:18.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33629.000802 secs 2024-04-21T19:45:18.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33629.000802 secs 2024-04-21T19:45:18.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33629.000802 secs 2024-04-21T19:45:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:19 smithi191 ceph-mon[31636]: pgmap v18026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:45:19.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:19 smithi170 ceph-mon[31212]: pgmap v18026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:45:19.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:19 smithi077 ceph-mon[27902]: pgmap v18026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:45:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33630.758264 secs 2024-04-21T19:45:20.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33630.758264 secs 2024-04-21T19:45:20.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33630.758264 secs 2024-04-21T19:45:21.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:21 smithi191 ceph-mon[31636]: pgmap v18027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:45:21.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:21 smithi170 ceph-mon[31212]: pgmap v18027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:45:21.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:21 smithi077 ceph-mon[27902]: pgmap v18027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:45:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:23 smithi191 ceph-mon[31636]: pgmap v18028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:45:23.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33634.000924 secs 2024-04-21T19:45:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:23 smithi170 ceph-mon[31212]: pgmap v18028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:45:23.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33634.000924 secs 2024-04-21T19:45:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:23 smithi077 ceph-mon[27902]: pgmap v18028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:45:23.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33634.000924 secs 2024-04-21T19:45:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:25 smithi191 ceph-mon[31636]: pgmap v18029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33635.758357 secs 2024-04-21T19:45:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:25 smithi170 ceph-mon[31212]: pgmap v18029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:25.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33635.758357 secs 2024-04-21T19:45:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:25 smithi077 ceph-mon[27902]: pgmap v18029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:25.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33635.758357 secs 2024-04-21T19:45:27.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:27 smithi191 ceph-mon[31636]: pgmap v18030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:27.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:27 smithi170 ceph-mon[31212]: pgmap v18030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:27 smithi077 ceph-mon[27902]: pgmap v18030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:28.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33639.001004 secs 2024-04-21T19:45:28.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33639.001004 secs 2024-04-21T19:45:28.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33639.001004 secs 2024-04-21T19:45:29.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:29 smithi191 ceph-mon[31636]: pgmap v18031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:29.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:29 smithi077 ceph-mon[27902]: pgmap v18031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:29.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:29 smithi170 ceph-mon[31212]: pgmap v18031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:30.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33640.758456 secs 2024-04-21T19:45:30.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33640.758456 secs 2024-04-21T19:45:30.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33640.758456 secs 2024-04-21T19:45:31.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:31 smithi191 ceph-mon[31636]: pgmap v18032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:31.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:31 smithi170 ceph-mon[31212]: pgmap v18032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:31.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:31 smithi077 ceph-mon[27902]: pgmap v18032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:33 smithi191 ceph-mon[31636]: pgmap v18033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:33.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33644.001122 secs 2024-04-21T19:45:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:33 smithi170 ceph-mon[31212]: pgmap v18033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:33.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33644.001122 secs 2024-04-21T19:45:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:33 smithi077 ceph-mon[27902]: pgmap v18033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:33.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33644.001122 secs 2024-04-21T19:45:34.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33645.758571 secs 2024-04-21T19:45:34.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33645.758571 secs 2024-04-21T19:45:34.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33645.758571 secs 2024-04-21T19:45:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:35.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:35 smithi191 ceph-mon[31636]: pgmap v18034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:35.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:35 smithi170 ceph-mon[31212]: pgmap v18034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:35.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:35 smithi077 ceph-mon[27902]: pgmap v18034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:37.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:37 smithi191 ceph-mon[31636]: pgmap v18035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:37.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:37 smithi170 ceph-mon[31212]: pgmap v18035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:37.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:37 smithi077 ceph-mon[27902]: pgmap v18035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:38.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33649.001239 secs 2024-04-21T19:45:38.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33649.001239 secs 2024-04-21T19:45:38.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33649.001239 secs 2024-04-21T19:45:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:39 smithi170 ceph-mon[31212]: pgmap v18036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:39.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33650.758697 secs 2024-04-21T19:45:39.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:39 smithi191 ceph-mon[31636]: pgmap v18036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:39.619 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33650.758697 secs 2024-04-21T19:45:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:39 smithi077 ceph-mon[27902]: pgmap v18036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33650.758697 secs 2024-04-21T19:45:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:41.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:41 smithi170 ceph-mon[31212]: pgmap v18037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:41.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:41 smithi077 ceph-mon[27902]: pgmap v18037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:41.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:41 smithi191 ceph-mon[31636]: pgmap v18037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:45:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:45:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:42.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:43 smithi170 ceph-mon[31212]: pgmap v18038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33654.001329 secs 2024-04-21T19:45:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:45:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:45:43.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:43 smithi077 ceph-mon[27902]: pgmap v18038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33654.001329 secs 2024-04-21T19:45:43.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:45:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:45:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:43 smithi191 ceph-mon[31636]: pgmap v18038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33654.001329 secs 2024-04-21T19:45:43.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:45:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:45:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:45:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33655.758809 secs 2024-04-21T19:45:44.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33655.758809 secs 2024-04-21T19:45:44.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33655.758809 secs 2024-04-21T19:45:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:45 smithi170 ceph-mon[31212]: pgmap v18039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:45.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:45 smithi077 ceph-mon[27902]: pgmap v18039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:45.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:45 smithi191 ceph-mon[31636]: pgmap v18039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:47 smithi170 ceph-mon[31212]: pgmap v18040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:47.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:47 smithi077 ceph-mon[27902]: pgmap v18040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:47.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:47 smithi191 ceph-mon[31636]: pgmap v18040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:48.555 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33659.001411 secs 2024-04-21T19:45:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33659.001411 secs 2024-04-21T19:45:48.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33659.001411 secs 2024-04-21T19:45:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:49 smithi170 ceph-mon[31212]: pgmap v18041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33660.758922 secs 2024-04-21T19:45:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:49 smithi077 ceph-mon[27902]: pgmap v18041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:49.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33660.758922 secs 2024-04-21T19:45:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:49 smithi191 ceph-mon[31636]: pgmap v18041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:49.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33660.758922 secs 2024-04-21T19:45:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:51 smithi170 ceph-mon[31212]: pgmap v18042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:51.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:51 smithi077 ceph-mon[27902]: pgmap v18042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:51.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:51 smithi191 ceph-mon[31636]: pgmap v18042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:53 smithi170 ceph-mon[31212]: pgmap v18043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33664.001546 secs 2024-04-21T19:45:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:53 smithi077 ceph-mon[27902]: pgmap v18043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:53.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33664.001546 secs 2024-04-21T19:45:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:53 smithi191 ceph-mon[31636]: pgmap v18043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:53.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33664.001546 secs 2024-04-21T19:45:54.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33665.759001 secs 2024-04-21T19:45:54.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33665.759001 secs 2024-04-21T19:45:54.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33665.759001 secs 2024-04-21T19:45:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:45:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:55 smithi170 ceph-mon[31212]: pgmap v18044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:55.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:55 smithi077 ceph-mon[27902]: pgmap v18044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:55.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:55 smithi191 ceph-mon[31636]: pgmap v18044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:57 smithi170 ceph-mon[31212]: pgmap v18045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:57.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:57 smithi077 ceph-mon[27902]: pgmap v18045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:57.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:57 smithi191 ceph-mon[31636]: pgmap v18045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:45:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33669.001671 secs 2024-04-21T19:45:58.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33669.001671 secs 2024-04-21T19:45:58.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33669.001671 secs 2024-04-21T19:45:59.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:59 smithi077 ceph-mon[27902]: pgmap v18046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:59.535 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33670.759140 secs 2024-04-21T19:45:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:59 smithi170 ceph-mon[31212]: pgmap v18046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33670.759140 secs 2024-04-21T19:45:59.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:59 smithi191 ceph-mon[31636]: pgmap v18046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:45:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33670.759140 secs 2024-04-21T19:46:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:00.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:00 smithi170 ceph-mon[31212]: pgmap v18047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:00.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:00 smithi077 ceph-mon[27902]: pgmap v18047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:00.717 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:00 smithi191 ceph-mon[31636]: pgmap v18047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:02 smithi191 ceph-mon[31636]: pgmap v18048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:46:03.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33674.001814 secs 2024-04-21T19:46:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:02 smithi170 ceph-mon[31212]: pgmap v18048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:46:03.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33674.001814 secs 2024-04-21T19:46:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:02 smithi077 ceph-mon[27902]: pgmap v18048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T19:46:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33674.001814 secs 2024-04-21T19:46:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33675.759222 secs 2024-04-21T19:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:04 smithi191 ceph-mon[31636]: pgmap v18049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T19:46:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:04 smithi191 ceph-mon[31636]: osdmap e1200: 12 total, 12 up, 12 in 2024-04-21T19:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33675.759222 secs 2024-04-21T19:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:04 smithi170 ceph-mon[31212]: pgmap v18049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T19:46:05.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:04 smithi170 ceph-mon[31212]: osdmap e1200: 12 total, 12 up, 12 in 2024-04-21T19:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33675.759222 secs 2024-04-21T19:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:04 smithi077 ceph-mon[27902]: pgmap v18049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T19:46:05.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:04 smithi077 ceph-mon[27902]: osdmap e1200: 12 total, 12 up, 12 in 2024-04-21T19:46:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:06 smithi191 ceph-mon[31636]: pgmap v18051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:46:07.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:06 smithi170 ceph-mon[31212]: pgmap v18051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:46:07.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:06 smithi077 ceph-mon[27902]: pgmap v18051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:46:08.217 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33679.001938 secs 2024-04-21T19:46:08.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33679.001938 secs 2024-04-21T19:46:08.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33679.001938 secs 2024-04-21T19:46:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:08 smithi170 ceph-mon[31212]: pgmap v18052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:46:09.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:08 smithi170 ceph-mon[31212]: osdmap e1201: 12 total, 12 up, 12 in 2024-04-21T19:46:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:08 smithi077 ceph-mon[27902]: pgmap v18052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:46:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:08 smithi077 ceph-mon[27902]: osdmap e1201: 12 total, 12 up, 12 in 2024-04-21T19:46:09.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:08 smithi191 ceph-mon[31636]: pgmap v18052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:46:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:08 smithi191 ceph-mon[31636]: osdmap e1201: 12 total, 12 up, 12 in 2024-04-21T19:46:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:10.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33680.759341 secs 2024-04-21T19:46:10.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33680.759341 secs 2024-04-21T19:46:10.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33680.759341 secs 2024-04-21T19:46:11.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:10 smithi170 ceph-mon[31212]: pgmap v18054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T19:46:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:10 smithi077 ceph-mon[27902]: pgmap v18054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T19:46:11.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:10 smithi191 ceph-mon[31636]: pgmap v18054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-04-21T19:46:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:12 smithi170 ceph-mon[31212]: pgmap v18055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T19:46:13.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33684.002056 secs 2024-04-21T19:46:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:12 smithi077 ceph-mon[27902]: pgmap v18055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T19:46:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33684.002056 secs 2024-04-21T19:46:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:12 smithi191 ceph-mon[31636]: pgmap v18055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-04-21T19:46:13.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33684.002056 secs 2024-04-21T19:46:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33685.759489 secs 2024-04-21T19:46:15.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:14 smithi170 ceph-mon[31212]: pgmap v18056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T19:46:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33685.759489 secs 2024-04-21T19:46:15.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:14 smithi077 ceph-mon[27902]: pgmap v18056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T19:46:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33685.759489 secs 2024-04-21T19:46:15.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:14 smithi191 ceph-mon[31636]: pgmap v18056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T19:46:17.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:16 smithi170 ceph-mon[31212]: pgmap v18057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:46:17.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:16 smithi077 ceph-mon[27902]: pgmap v18057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:46:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:16 smithi191 ceph-mon[31636]: pgmap v18057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:46:18.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33689.002158 secs 2024-04-21T19:46:18.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33689.002158 secs 2024-04-21T19:46:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33689.002158 secs 2024-04-21T19:46:19.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:18 smithi170 ceph-mon[31212]: pgmap v18058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:46:19.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:18 smithi077 ceph-mon[27902]: pgmap v18058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:46:19.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:18 smithi191 ceph-mon[31636]: pgmap v18058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:46:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:20.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33690.759620 secs 2024-04-21T19:46:20.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33690.759620 secs 2024-04-21T19:46:20.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33690.759620 secs 2024-04-21T19:46:21.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:21 smithi170 ceph-mon[31212]: pgmap v18059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:46:21.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:21 smithi077 ceph-mon[27902]: pgmap v18059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:46:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:21 smithi191 ceph-mon[31636]: pgmap v18059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:46:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:23 smithi170 ceph-mon[31212]: pgmap v18060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:46:23.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33694.002280 secs 2024-04-21T19:46:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:23 smithi077 ceph-mon[27902]: pgmap v18060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:46:23.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33694.002280 secs 2024-04-21T19:46:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:23 smithi191 ceph-mon[31636]: pgmap v18060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:46:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33694.002280 secs 2024-04-21T19:46:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33695.759743 secs 2024-04-21T19:46:25.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:25 smithi170 ceph-mon[31212]: pgmap v18061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33695.759743 secs 2024-04-21T19:46:25.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:25 smithi077 ceph-mon[27902]: pgmap v18061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:25.467 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33695.759743 secs 2024-04-21T19:46:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:25 smithi191 ceph-mon[31636]: pgmap v18061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:27.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:27 smithi170 ceph-mon[31212]: pgmap v18062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:27.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:27 smithi077 ceph-mon[27902]: pgmap v18062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:27 smithi191 ceph-mon[31636]: pgmap v18062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:28.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33699.002421 secs 2024-04-21T19:46:28.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33699.002421 secs 2024-04-21T19:46:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33699.002421 secs 2024-04-21T19:46:29.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:29 smithi077 ceph-mon[27902]: pgmap v18063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:29.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:29 smithi170 ceph-mon[31212]: pgmap v18063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:29 smithi191 ceph-mon[31636]: pgmap v18063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:30.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33700.759879 secs 2024-04-21T19:46:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33700.759879 secs 2024-04-21T19:46:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33700.759879 secs 2024-04-21T19:46:31.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:31 smithi170 ceph-mon[31212]: pgmap v18064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:31.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:31 smithi077 ceph-mon[27902]: pgmap v18064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:31 smithi191 ceph-mon[31636]: pgmap v18064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:33.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:33 smithi170 ceph-mon[31212]: pgmap v18065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33704.002559 secs 2024-04-21T19:46:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:33 smithi077 ceph-mon[27902]: pgmap v18065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:33.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33704.002559 secs 2024-04-21T19:46:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:33 smithi191 ceph-mon[31636]: pgmap v18065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33704.002559 secs 2024-04-21T19:46:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33705.760037 secs 2024-04-21T19:46:35.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:35 smithi170 ceph-mon[31212]: pgmap v18066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33705.760037 secs 2024-04-21T19:46:35.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:35 smithi077 ceph-mon[27902]: pgmap v18066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33705.760037 secs 2024-04-21T19:46:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:35 smithi191 ceph-mon[31636]: pgmap v18066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:37.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:37 smithi170 ceph-mon[31212]: pgmap v18067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:37.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:37 smithi077 ceph-mon[27902]: pgmap v18067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:37 smithi191 ceph-mon[31636]: pgmap v18067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:38.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33709.002690 secs 2024-04-21T19:46:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33709.002690 secs 2024-04-21T19:46:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33709.002690 secs 2024-04-21T19:46:39.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:39 smithi170 ceph-mon[31212]: pgmap v18068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:39.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:39 smithi191 ceph-mon[31636]: pgmap v18068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:39.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:39 smithi077 ceph-mon[27902]: pgmap v18068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:40.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33710.760149 secs 2024-04-21T19:46:40.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33710.760149 secs 2024-04-21T19:46:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33710.760149 secs 2024-04-21T19:46:41.306 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:41 smithi170 ceph-mon[31212]: pgmap v18069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:41.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:41 smithi077 ceph-mon[27902]: pgmap v18069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:41.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:41 smithi191 ceph-mon[31636]: pgmap v18069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:43 smithi170 ceph-mon[31212]: pgmap v18070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33714.002811 secs 2024-04-21T19:46:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:43 smithi077 ceph-mon[27902]: pgmap v18070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33714.002811 secs 2024-04-21T19:46:43.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:46:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:43 smithi191 ceph-mon[31636]: pgmap v18070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33714.002811 secs 2024-04-21T19:46:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:46:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:46:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:46:44.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:46:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:46:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:46:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:46:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:46:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:46:44.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:46:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33715.760236 secs 2024-04-21T19:46:45.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:45 smithi191 ceph-mon[31636]: pgmap v18071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33715.760236 secs 2024-04-21T19:46:45.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:45 smithi170 ceph-mon[31212]: pgmap v18071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33715.760236 secs 2024-04-21T19:46:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:45 smithi077 ceph-mon[27902]: pgmap v18071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:47 smithi191 ceph-mon[31636]: pgmap v18072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:47.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:47 smithi170 ceph-mon[31212]: pgmap v18072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:47 smithi077 ceph-mon[27902]: pgmap v18072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33719.002931 secs 2024-04-21T19:46:48.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33719.002931 secs 2024-04-21T19:46:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33719.002931 secs 2024-04-21T19:46:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:49 smithi191 ceph-mon[31636]: pgmap v18073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:49.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:49 smithi170 ceph-mon[31212]: pgmap v18073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:49 smithi077 ceph-mon[27902]: pgmap v18073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33720.760391 secs 2024-04-21T19:46:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33720.760391 secs 2024-04-21T19:46:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33720.760391 secs 2024-04-21T19:46:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:51 smithi191 ceph-mon[31636]: pgmap v18074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:51.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:51 smithi170 ceph-mon[31212]: pgmap v18074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:51 smithi077 ceph-mon[27902]: pgmap v18074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:53.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:53 smithi191 ceph-mon[31636]: pgmap v18075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33724.003056 secs 2024-04-21T19:46:53.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:53 smithi170 ceph-mon[31212]: pgmap v18075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33724.003056 secs 2024-04-21T19:46:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:53 smithi077 ceph-mon[27902]: pgmap v18075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33724.003056 secs 2024-04-21T19:46:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:46:55.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33725.760530 secs 2024-04-21T19:46:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:55 smithi191 ceph-mon[31636]: pgmap v18076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33725.760530 secs 2024-04-21T19:46:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:55 smithi170 ceph-mon[31212]: pgmap v18076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33725.760530 secs 2024-04-21T19:46:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:55 smithi077 ceph-mon[27902]: pgmap v18076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:57.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:57 smithi191 ceph-mon[31636]: pgmap v18077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:57.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:57 smithi170 ceph-mon[31212]: pgmap v18077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:57 smithi077 ceph-mon[27902]: pgmap v18077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:46:58.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33729.003169 secs 2024-04-21T19:46:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33729.003169 secs 2024-04-21T19:46:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33729.003169 secs 2024-04-21T19:46:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:46:59.017+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:46:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:46:59.017+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:46:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:46:59.017+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:46:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:46:59.017+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:46:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:59 smithi191 ceph-mon[31636]: pgmap v18078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:59.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33730.760666 secs 2024-04-21T19:46:59.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:59 smithi077 ceph-mon[27902]: pgmap v18078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:59.536 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33730.760666 secs 2024-04-21T19:46:59.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:59 smithi170 ceph-mon[31212]: pgmap v18078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:46:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33730.760666 secs 2024-04-21T19:47:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:01 smithi170 ceph-mon[31212]: pgmap v18079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:01 smithi077 ceph-mon[27902]: pgmap v18079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:01 smithi191 ceph-mon[31636]: pgmap v18079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:03 smithi170 ceph-mon[31212]: pgmap v18080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33734.003264 secs 2024-04-21T19:47:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:03 smithi077 ceph-mon[27902]: pgmap v18080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33734.003264 secs 2024-04-21T19:47:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:03 smithi191 ceph-mon[31636]: pgmap v18080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33734.003264 secs 2024-04-21T19:47:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33735.760760 secs 2024-04-21T19:47:04.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33735.760760 secs 2024-04-21T19:47:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33735.760760 secs 2024-04-21T19:47:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:05 smithi170 ceph-mon[31212]: pgmap v18081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:05 smithi170 ceph-mon[31212]: osdmap e1202: 12 total, 12 up, 12 in 2024-04-21T19:47:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:05 smithi077 ceph-mon[27902]: pgmap v18081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:05 smithi077 ceph-mon[27902]: osdmap e1202: 12 total, 12 up, 12 in 2024-04-21T19:47:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:05 smithi191 ceph-mon[31636]: pgmap v18081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:05 smithi191 ceph-mon[31636]: osdmap e1202: 12 total, 12 up, 12 in 2024-04-21T19:47:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:07 smithi170 ceph-mon[31212]: pgmap v18083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:47:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:07 smithi077 ceph-mon[27902]: pgmap v18083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:47:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:07 smithi191 ceph-mon[31636]: pgmap v18083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:47:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33739.003344 secs 2024-04-21T19:47:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33739.003344 secs 2024-04-21T19:47:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33739.003344 secs 2024-04-21T19:47:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:09 smithi170 ceph-mon[31212]: pgmap v18084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:47:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:09 smithi170 ceph-mon[31212]: osdmap e1203: 12 total, 12 up, 12 in 2024-04-21T19:47:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33740.760911 secs 2024-04-21T19:47:09.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:09 smithi191 ceph-mon[31636]: pgmap v18084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:47:09.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:09 smithi191 ceph-mon[31636]: osdmap e1203: 12 total, 12 up, 12 in 2024-04-21T19:47:09.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33740.760911 secs 2024-04-21T19:47:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:09 smithi077 ceph-mon[27902]: pgmap v18084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:47:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:09 smithi077 ceph-mon[27902]: osdmap e1203: 12 total, 12 up, 12 in 2024-04-21T19:47:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33740.760911 secs 2024-04-21T19:47:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:11 smithi170 ceph-mon[31212]: pgmap v18086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:47:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:11 smithi077 ceph-mon[27902]: pgmap v18086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:47:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:11 smithi191 ceph-mon[31636]: pgmap v18086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:47:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:13 smithi170 ceph-mon[31212]: pgmap v18087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:47:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33744.003479 secs 2024-04-21T19:47:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:13 smithi077 ceph-mon[27902]: pgmap v18087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:47:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33744.003479 secs 2024-04-21T19:47:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:13 smithi191 ceph-mon[31636]: pgmap v18087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:47:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33744.003479 secs 2024-04-21T19:47:14.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33745.761035 secs 2024-04-21T19:47:14.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33745.761035 secs 2024-04-21T19:47:14.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33745.761035 secs 2024-04-21T19:47:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:15 smithi170 ceph-mon[31212]: pgmap v18088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:47:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:15 smithi077 ceph-mon[27902]: pgmap v18088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:47:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:15 smithi191 ceph-mon[31636]: pgmap v18088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:47:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:17 smithi170 ceph-mon[31212]: pgmap v18089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:47:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:17 smithi077 ceph-mon[27902]: pgmap v18089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:47:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:17 smithi191 ceph-mon[31636]: pgmap v18089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:47:18.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33749.003596 secs 2024-04-21T19:47:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33749.003596 secs 2024-04-21T19:47:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33749.003596 secs 2024-04-21T19:47:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:19 smithi170 ceph-mon[31212]: pgmap v18090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:47:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33750.761148 secs 2024-04-21T19:47:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:19 smithi077 ceph-mon[27902]: pgmap v18090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:47:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33750.761148 secs 2024-04-21T19:47:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:19 smithi191 ceph-mon[31636]: pgmap v18090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:47:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33750.761148 secs 2024-04-21T19:47:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:21 smithi170 ceph-mon[31212]: pgmap v18091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:47:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:21 smithi077 ceph-mon[27902]: pgmap v18091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:47:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:21 smithi191 ceph-mon[31636]: pgmap v18091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:47:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:23 smithi170 ceph-mon[31212]: pgmap v18092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:47:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33754.003678 secs 2024-04-21T19:47:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:23 smithi077 ceph-mon[27902]: pgmap v18092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:47:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33754.003678 secs 2024-04-21T19:47:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:23 smithi191 ceph-mon[31636]: pgmap v18092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:47:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33754.003678 secs 2024-04-21T19:47:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33755.761266 secs 2024-04-21T19:47:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:24 smithi077 ceph-mon[27902]: pgmap v18093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33755.761266 secs 2024-04-21T19:47:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:24 smithi191 ceph-mon[31636]: pgmap v18093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33755.761266 secs 2024-04-21T19:47:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:24 smithi170 ceph-mon[31212]: pgmap v18093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:26 smithi170 ceph-mon[31212]: pgmap v18094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:26 smithi077 ceph-mon[27902]: pgmap v18094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:26 smithi191 ceph-mon[31636]: pgmap v18094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33759.003797 secs 2024-04-21T19:47:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33759.003797 secs 2024-04-21T19:47:28.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33759.003797 secs 2024-04-21T19:47:29.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:28 smithi077 ceph-mon[27902]: pgmap v18095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:28 smithi170 ceph-mon[31212]: pgmap v18095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:28 smithi191 ceph-mon[31636]: pgmap v18095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33760.761332 secs 2024-04-21T19:47:30.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33760.761332 secs 2024-04-21T19:47:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33760.761332 secs 2024-04-21T19:47:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:30 smithi170 ceph-mon[31212]: pgmap v18096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:30 smithi077 ceph-mon[27902]: pgmap v18096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:30 smithi191 ceph-mon[31636]: pgmap v18096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:32 smithi170 ceph-mon[31212]: pgmap v18097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33764.003870 secs 2024-04-21T19:47:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:32 smithi077 ceph-mon[27902]: pgmap v18097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33764.003870 secs 2024-04-21T19:47:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:32 smithi191 ceph-mon[31636]: pgmap v18097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33764.003870 secs 2024-04-21T19:47:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33765.761452 secs 2024-04-21T19:47:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:34 smithi170 ceph-mon[31212]: pgmap v18098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33765.761452 secs 2024-04-21T19:47:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:34 smithi077 ceph-mon[27902]: pgmap v18098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33765.761452 secs 2024-04-21T19:47:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:34 smithi191 ceph-mon[31636]: pgmap v18098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:36 smithi170 ceph-mon[31212]: pgmap v18099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:36 smithi077 ceph-mon[27902]: pgmap v18099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:36 smithi191 ceph-mon[31636]: pgmap v18099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33769.003991 secs 2024-04-21T19:47:38.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33769.003991 secs 2024-04-21T19:47:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33769.003991 secs 2024-04-21T19:47:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:39 smithi170 ceph-mon[31212]: pgmap v18100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:39.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:39 smithi191 ceph-mon[31636]: pgmap v18100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:39 smithi077 ceph-mon[27902]: pgmap v18100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33770.761587 secs 2024-04-21T19:47:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33770.761587 secs 2024-04-21T19:47:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33770.761587 secs 2024-04-21T19:47:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:41 smithi170 ceph-mon[31212]: pgmap v18101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:41 smithi077 ceph-mon[27902]: pgmap v18101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:41 smithi191 ceph-mon[31636]: pgmap v18101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:43 smithi170 ceph-mon[31212]: pgmap v18102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33774.004100 secs 2024-04-21T19:47:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:43 smithi077 ceph-mon[27902]: pgmap v18102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33774.004100 secs 2024-04-21T19:47:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:43 smithi191 ceph-mon[31636]: pgmap v18102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33774.004100 secs 2024-04-21T19:47:44.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:47:44.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:47:44.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:47:44.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:47:44.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:47:44.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:47:44.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:47:44.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:47:44.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:47:44.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:47:44.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:47:44.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:47:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33775.761800 secs 2024-04-21T19:47:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:45 smithi170 ceph-mon[31212]: pgmap v18103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33775.761800 secs 2024-04-21T19:47:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:45 smithi077 ceph-mon[27902]: pgmap v18103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33775.761800 secs 2024-04-21T19:47:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:45 smithi191 ceph-mon[31636]: pgmap v18103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:47 smithi170 ceph-mon[31212]: pgmap v18104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:47 smithi077 ceph-mon[27902]: pgmap v18104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:47 smithi191 ceph-mon[31636]: pgmap v18104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33779.004198 secs 2024-04-21T19:47:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33779.004198 secs 2024-04-21T19:47:48.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33779.004198 secs 2024-04-21T19:47:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:49 smithi170 ceph-mon[31212]: pgmap v18105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:49 smithi077 ceph-mon[27902]: pgmap v18105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:49 smithi191 ceph-mon[31636]: pgmap v18105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33780.761923 secs 2024-04-21T19:47:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33780.761923 secs 2024-04-21T19:47:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33780.761923 secs 2024-04-21T19:47:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:51 smithi170 ceph-mon[31212]: pgmap v18106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:51 smithi077 ceph-mon[27902]: pgmap v18106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:51 smithi191 ceph-mon[31636]: pgmap v18106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:47:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:53 smithi170 ceph-mon[31212]: pgmap v18107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33784.004311 secs 2024-04-21T19:47:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:53 smithi077 ceph-mon[27902]: pgmap v18107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33784.004311 secs 2024-04-21T19:47:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:53 smithi191 ceph-mon[31636]: pgmap v18107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33784.004311 secs 2024-04-21T19:47:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:47:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33785.762047 secs 2024-04-21T19:47:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:55 smithi170 ceph-mon[31212]: pgmap v18108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33785.762047 secs 2024-04-21T19:47:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:55 smithi077 ceph-mon[27902]: pgmap v18108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33785.762047 secs 2024-04-21T19:47:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:55 smithi191 ceph-mon[31636]: pgmap v18108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:57.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:57 smithi170 ceph-mon[31212]: pgmap v18109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:57 smithi077 ceph-mon[27902]: pgmap v18109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:57 smithi191 ceph-mon[31636]: pgmap v18109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:47:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33789.004421 secs 2024-04-21T19:47:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33789.004421 secs 2024-04-21T19:47:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33789.004421 secs 2024-04-21T19:47:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:47:59 smithi077 ceph-mon[27902]: pgmap v18110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:47:59 smithi191 ceph-mon[31636]: pgmap v18110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:47:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:47:59 smithi170 ceph-mon[31212]: pgmap v18110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33790.762139 secs 2024-04-21T19:48:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33790.762139 secs 2024-04-21T19:48:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33790.762139 secs 2024-04-21T19:48:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:01 smithi077 ceph-mon[27902]: pgmap v18111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:01 smithi191 ceph-mon[31636]: pgmap v18111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:01.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:01 smithi170 ceph-mon[31212]: pgmap v18111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:03 smithi077 ceph-mon[27902]: pgmap v18112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:03.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33794.004539 secs 2024-04-21T19:48:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:03 smithi191 ceph-mon[31636]: pgmap v18112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33794.004539 secs 2024-04-21T19:48:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:03 smithi170 ceph-mon[31212]: pgmap v18112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33794.004539 secs 2024-04-21T19:48:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33795.762251 secs 2024-04-21T19:48:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:05 smithi077 ceph-mon[27902]: pgmap v18113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:05 smithi077 ceph-mon[27902]: osdmap e1204: 12 total, 12 up, 12 in 2024-04-21T19:48:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33795.762251 secs 2024-04-21T19:48:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:05 smithi191 ceph-mon[31636]: pgmap v18113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:05 smithi191 ceph-mon[31636]: osdmap e1204: 12 total, 12 up, 12 in 2024-04-21T19:48:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33795.762251 secs 2024-04-21T19:48:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:05 smithi170 ceph-mon[31212]: pgmap v18113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:05 smithi170 ceph-mon[31212]: osdmap e1204: 12 total, 12 up, 12 in 2024-04-21T19:48:07.360 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:07 smithi170 ceph-mon[31212]: pgmap v18115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:48:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:07 smithi077 ceph-mon[27902]: pgmap v18115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:48:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:07 smithi191 ceph-mon[31636]: pgmap v18115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:48:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33799.004675 secs 2024-04-21T19:48:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33799.004675 secs 2024-04-21T19:48:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33799.004675 secs 2024-04-21T19:48:09.371 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:09 smithi191 ceph-mon[31636]: pgmap v18116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:48:09.371 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:09 smithi191 ceph-mon[31636]: osdmap e1205: 12 total, 12 up, 12 in 2024-04-21T19:48:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:09 smithi077 ceph-mon[27902]: pgmap v18116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:48:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:09 smithi077 ceph-mon[27902]: osdmap e1205: 12 total, 12 up, 12 in 2024-04-21T19:48:09.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:09 smithi170 ceph-mon[31212]: pgmap v18116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:48:09.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:09 smithi170 ceph-mon[31212]: osdmap e1205: 12 total, 12 up, 12 in 2024-04-21T19:48:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33800.762377 secs 2024-04-21T19:48:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33800.762377 secs 2024-04-21T19:48:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33800.762377 secs 2024-04-21T19:48:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:11 smithi077 ceph-mon[27902]: pgmap v18118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:48:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:11 smithi191 ceph-mon[31636]: pgmap v18118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:48:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:11 smithi170 ceph-mon[31212]: pgmap v18118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:48:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:13 smithi077 ceph-mon[27902]: pgmap v18119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:48:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33804.004798 secs 2024-04-21T19:48:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:13 smithi191 ceph-mon[31636]: pgmap v18119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:48:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33804.004798 secs 2024-04-21T19:48:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:13 smithi170 ceph-mon[31212]: pgmap v18119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:48:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33804.004798 secs 2024-04-21T19:48:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33805.762527 secs 2024-04-21T19:48:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:15 smithi077 ceph-mon[27902]: pgmap v18120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:48:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33805.762527 secs 2024-04-21T19:48:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:15 smithi191 ceph-mon[31636]: pgmap v18120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:48:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33805.762527 secs 2024-04-21T19:48:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:15 smithi170 ceph-mon[31212]: pgmap v18120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:48:17.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:17 smithi077 ceph-mon[27902]: pgmap v18121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:48:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:17 smithi191 ceph-mon[31636]: pgmap v18121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:48:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:17 smithi170 ceph-mon[31212]: pgmap v18121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:48:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33809.004909 secs 2024-04-21T19:48:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33809.004909 secs 2024-04-21T19:48:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33809.004909 secs 2024-04-21T19:48:19.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:19 smithi077 ceph-mon[27902]: pgmap v18122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:48:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:19 smithi191 ceph-mon[31636]: pgmap v18122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:48:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:19 smithi170 ceph-mon[31212]: pgmap v18122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:48:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 33995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33810.762623 secs 2024-04-21T19:48:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33810.762623 secs 2024-04-21T19:48:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33810.762623 secs 2024-04-21T19:48:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:21 smithi077 ceph-mon[27902]: pgmap v18123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:48:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:21 smithi191 ceph-mon[31636]: pgmap v18123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:48:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:21 smithi170 ceph-mon[31212]: pgmap v18123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:48:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:23 smithi077 ceph-mon[27902]: pgmap v18124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:48:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33814.005028 secs 2024-04-21T19:48:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:23 smithi191 ceph-mon[31636]: pgmap v18124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:48:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33814.005028 secs 2024-04-21T19:48:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:23 smithi170 ceph-mon[31212]: pgmap v18124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:48:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33814.005028 secs 2024-04-21T19:48:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33815.762749 secs 2024-04-21T19:48:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:25 smithi077 ceph-mon[27902]: pgmap v18125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33815.762749 secs 2024-04-21T19:48:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:25 smithi191 ceph-mon[31636]: pgmap v18125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33815.762749 secs 2024-04-21T19:48:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:25 smithi170 ceph-mon[31212]: pgmap v18125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:27 smithi077 ceph-mon[27902]: pgmap v18126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:27 smithi191 ceph-mon[31636]: pgmap v18126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:27 smithi170 ceph-mon[31212]: pgmap v18126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33819.005098 secs 2024-04-21T19:48:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33819.005098 secs 2024-04-21T19:48:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33819.005098 secs 2024-04-21T19:48:29.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:29 smithi191 ceph-mon[31636]: pgmap v18127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:29.538 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:29 smithi077 ceph-mon[27902]: pgmap v18127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:29 smithi170 ceph-mon[31212]: pgmap v18127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33820.762893 secs 2024-04-21T19:48:30.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33820.762893 secs 2024-04-21T19:48:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33820.762893 secs 2024-04-21T19:48:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:31 smithi191 ceph-mon[31636]: pgmap v18128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:31.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:31 smithi170 ceph-mon[31212]: pgmap v18128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:31 smithi077 ceph-mon[27902]: pgmap v18128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:33 smithi191 ceph-mon[31636]: pgmap v18129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:33.493 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33824.005208 secs 2024-04-21T19:48:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:33 smithi170 ceph-mon[31212]: pgmap v18129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33824.005208 secs 2024-04-21T19:48:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:33 smithi077 ceph-mon[27902]: pgmap v18129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33824.005208 secs 2024-04-21T19:48:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33825.762986 secs 2024-04-21T19:48:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:35 smithi191 ceph-mon[31636]: pgmap v18130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33825.762986 secs 2024-04-21T19:48:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:35 smithi170 ceph-mon[31212]: pgmap v18130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33825.762986 secs 2024-04-21T19:48:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:35 smithi077 ceph-mon[27902]: pgmap v18130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:37 smithi191 ceph-mon[31636]: pgmap v18131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:37.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:37 smithi170 ceph-mon[31212]: pgmap v18131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:37 smithi077 ceph-mon[27902]: pgmap v18131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33829.005339 secs 2024-04-21T19:48:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33829.005339 secs 2024-04-21T19:48:38.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33829.005339 secs 2024-04-21T19:48:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:39 smithi191 ceph-mon[31636]: pgmap v18132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:39.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:39 smithi170 ceph-mon[31212]: pgmap v18132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:39 smithi077 ceph-mon[27902]: pgmap v18132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33830.763105 secs 2024-04-21T19:48:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33830.763105 secs 2024-04-21T19:48:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33830.763105 secs 2024-04-21T19:48:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:41 smithi191 ceph-mon[31636]: pgmap v18133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:41.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:41 smithi170 ceph-mon[31212]: pgmap v18133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:41 smithi077 ceph-mon[27902]: pgmap v18133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:43 smithi191 ceph-mon[31636]: pgmap v18134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33834.005469 secs 2024-04-21T19:48:43.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:43 smithi170 ceph-mon[31212]: pgmap v18134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:43.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33834.005469 secs 2024-04-21T19:48:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:43 smithi077 ceph-mon[27902]: pgmap v18134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33834.005469 secs 2024-04-21T19:48:44.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:48:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:48:44.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:48:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33835.763227 secs 2024-04-21T19:48:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:45 smithi191 ceph-mon[31636]: pgmap v18135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:48:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:48:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:48:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33835.763227 secs 2024-04-21T19:48:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:45 smithi170 ceph-mon[31212]: pgmap v18135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:48:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:48:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:48:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33835.763227 secs 2024-04-21T19:48:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:45 smithi077 ceph-mon[27902]: pgmap v18135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:48:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:48:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:48:47.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:47 smithi191 ceph-mon[31636]: pgmap v18136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:47.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:47 smithi170 ceph-mon[31212]: pgmap v18136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:47 smithi077 ceph-mon[27902]: pgmap v18136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33839.005601 secs 2024-04-21T19:48:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33839.005601 secs 2024-04-21T19:48:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33839.005601 secs 2024-04-21T19:48:49.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:49 smithi191 ceph-mon[31636]: pgmap v18137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:49.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:49 smithi170 ceph-mon[31212]: pgmap v18137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:49.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:49 smithi077 ceph-mon[27902]: pgmap v18137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33840.763344 secs 2024-04-21T19:48:50.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33840.763344 secs 2024-04-21T19:48:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33840.763344 secs 2024-04-21T19:48:51.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:51 smithi191 ceph-mon[31636]: pgmap v18138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:51.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:51 smithi170 ceph-mon[31212]: pgmap v18138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:51.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:51 smithi077 ceph-mon[27902]: pgmap v18138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:53 smithi191 ceph-mon[31636]: pgmap v18139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33844.005720 secs 2024-04-21T19:48:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:53 smithi170 ceph-mon[31212]: pgmap v18139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33844.005720 secs 2024-04-21T19:48:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:53 smithi077 ceph-mon[27902]: pgmap v18139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33844.005720 secs 2024-04-21T19:48:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:48:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33845.763461 secs 2024-04-21T19:48:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:55 smithi191 ceph-mon[31636]: pgmap v18140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33845.763461 secs 2024-04-21T19:48:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:55 smithi170 ceph-mon[31212]: pgmap v18140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33845.763461 secs 2024-04-21T19:48:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:55 smithi077 ceph-mon[27902]: pgmap v18140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:57.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:57 smithi170 ceph-mon[31212]: pgmap v18141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:57.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:57 smithi077 ceph-mon[27902]: pgmap v18141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:57.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:57 smithi191 ceph-mon[31636]: pgmap v18141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:48:58.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33849.005778 secs 2024-04-21T19:48:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33849.005778 secs 2024-04-21T19:48:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33849.005778 secs 2024-04-21T19:48:59.538 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:48:59 smithi077 ceph-mon[27902]: pgmap v18142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:59.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:48:59 smithi170 ceph-mon[31212]: pgmap v18142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:48:59.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:48:59 smithi191 ceph-mon[31636]: pgmap v18142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33850.763582 secs 2024-04-21T19:49:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33850.763582 secs 2024-04-21T19:49:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33850.763582 secs 2024-04-21T19:49:01.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:01 smithi170 ceph-mon[31212]: pgmap v18143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:01.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:01 smithi077 ceph-mon[27902]: pgmap v18143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:01.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:01 smithi191 ceph-mon[31636]: pgmap v18143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:03 smithi170 ceph-mon[31212]: pgmap v18144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33854.005890 secs 2024-04-21T19:49:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:03 smithi077 ceph-mon[27902]: pgmap v18144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33854.005890 secs 2024-04-21T19:49:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:03 smithi191 ceph-mon[31636]: pgmap v18144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33854.005890 secs 2024-04-21T19:49:04.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33855.763700 secs 2024-04-21T19:49:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33855.763700 secs 2024-04-21T19:49:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33855.763700 secs 2024-04-21T19:49:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:05 smithi170 ceph-mon[31212]: pgmap v18145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:05 smithi170 ceph-mon[31212]: osdmap e1206: 12 total, 12 up, 12 in 2024-04-21T19:49:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:05 smithi077 ceph-mon[27902]: pgmap v18145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:05 smithi077 ceph-mon[27902]: osdmap e1206: 12 total, 12 up, 12 in 2024-04-21T19:49:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:05 smithi191 ceph-mon[31636]: pgmap v18145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:05 smithi191 ceph-mon[31636]: osdmap e1206: 12 total, 12 up, 12 in 2024-04-21T19:49:07.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:07 smithi170 ceph-mon[31212]: pgmap v18147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:49:07.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:07 smithi077 ceph-mon[27902]: pgmap v18147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:49:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:07 smithi191 ceph-mon[31636]: pgmap v18147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:49:08.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33859.005979 secs 2024-04-21T19:49:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33859.005979 secs 2024-04-21T19:49:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33859.005979 secs 2024-04-21T19:49:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:09 smithi170 ceph-mon[31212]: pgmap v18148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:49:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:09 smithi170 ceph-mon[31212]: osdmap e1207: 12 total, 12 up, 12 in 2024-04-21T19:49:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33860.763824 secs 2024-04-21T19:49:09.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:09 smithi191 ceph-mon[31636]: pgmap v18148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:49:09.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:09 smithi191 ceph-mon[31636]: osdmap e1207: 12 total, 12 up, 12 in 2024-04-21T19:49:09.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33860.763824 secs 2024-04-21T19:49:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:09 smithi077 ceph-mon[27902]: pgmap v18148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:49:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:09 smithi077 ceph-mon[27902]: osdmap e1207: 12 total, 12 up, 12 in 2024-04-21T19:49:09.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33860.763824 secs 2024-04-21T19:49:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:11.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:11 smithi170 ceph-mon[31212]: pgmap v18150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:49:11.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:11 smithi077 ceph-mon[27902]: pgmap v18150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:49:11.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:11 smithi191 ceph-mon[31636]: pgmap v18150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:49:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:13 smithi170 ceph-mon[31212]: pgmap v18151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:49:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33864.006052 secs 2024-04-21T19:49:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:13 smithi077 ceph-mon[27902]: pgmap v18151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:49:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33864.006052 secs 2024-04-21T19:49:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:13 smithi191 ceph-mon[31636]: pgmap v18151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:49:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33864.006052 secs 2024-04-21T19:49:14.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33865.763937 secs 2024-04-21T19:49:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33865.763937 secs 2024-04-21T19:49:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33865.763937 secs 2024-04-21T19:49:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:15 smithi170 ceph-mon[31212]: pgmap v18152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:49:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:15 smithi077 ceph-mon[27902]: pgmap v18152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:49:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:15 smithi191 ceph-mon[31636]: pgmap v18152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:49:17.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:17 smithi170 ceph-mon[31212]: pgmap v18153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:49:17.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:17 smithi077 ceph-mon[27902]: pgmap v18153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:49:17.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:17 smithi191 ceph-mon[31636]: pgmap v18153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:49:18.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33869.006181 secs 2024-04-21T19:49:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33869.006181 secs 2024-04-21T19:49:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33869.006181 secs 2024-04-21T19:49:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:19 smithi170 ceph-mon[31212]: pgmap v18154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:49:19.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33870.764050 secs 2024-04-21T19:49:19.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:19 smithi077 ceph-mon[27902]: pgmap v18154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:49:19.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33870.764050 secs 2024-04-21T19:49:19.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:19 smithi191 ceph-mon[31636]: pgmap v18154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:49:19.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33870.764050 secs 2024-04-21T19:49:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:21 smithi170 ceph-mon[31212]: pgmap v18155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:49:21.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:21 smithi077 ceph-mon[27902]: pgmap v18155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:49:21.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:21 smithi191 ceph-mon[31636]: pgmap v18155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:49:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:23 smithi170 ceph-mon[31212]: pgmap v18156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:49:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33874.006293 secs 2024-04-21T19:49:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:23 smithi077 ceph-mon[27902]: pgmap v18156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:49:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33874.006293 secs 2024-04-21T19:49:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:23 smithi191 ceph-mon[31636]: pgmap v18156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:49:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33874.006293 secs 2024-04-21T19:49:24.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33875.764211 secs 2024-04-21T19:49:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33875.764211 secs 2024-04-21T19:49:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33875.764211 secs 2024-04-21T19:49:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:25 smithi170 ceph-mon[31212]: pgmap v18157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:25 smithi077 ceph-mon[27902]: pgmap v18157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:25 smithi191 ceph-mon[31636]: pgmap v18157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:27 smithi170 ceph-mon[31212]: pgmap v18158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:27.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:27 smithi077 ceph-mon[27902]: pgmap v18158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:27.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:27 smithi191 ceph-mon[31636]: pgmap v18158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33879.006424 secs 2024-04-21T19:49:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33879.006424 secs 2024-04-21T19:49:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33879.006424 secs 2024-04-21T19:49:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:29 smithi170 ceph-mon[31212]: pgmap v18159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:29.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33880.764330 secs 2024-04-21T19:49:29.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:29 smithi077 ceph-mon[27902]: pgmap v18159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:29.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33880.764330 secs 2024-04-21T19:49:29.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:29 smithi191 ceph-mon[31636]: pgmap v18159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:29.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33880.764330 secs 2024-04-21T19:49:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:30 smithi077 ceph-mon[27902]: pgmap v18160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:30 smithi191 ceph-mon[31636]: pgmap v18160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:30 smithi170 ceph-mon[31212]: pgmap v18160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:33 smithi170 ceph-mon[31212]: pgmap v18161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33884.006559 secs 2024-04-21T19:49:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:33 smithi077 ceph-mon[27902]: pgmap v18161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33884.006559 secs 2024-04-21T19:49:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:33 smithi191 ceph-mon[31636]: pgmap v18161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33884.006559 secs 2024-04-21T19:49:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33885.764441 secs 2024-04-21T19:49:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:35 smithi170 ceph-mon[31212]: pgmap v18162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33885.764441 secs 2024-04-21T19:49:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:35 smithi077 ceph-mon[27902]: pgmap v18162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33885.764441 secs 2024-04-21T19:49:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:35 smithi191 ceph-mon[31636]: pgmap v18162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:37.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:37 smithi170 ceph-mon[31212]: pgmap v18163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:37.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:37 smithi077 ceph-mon[27902]: pgmap v18163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:37.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:37 smithi191 ceph-mon[31636]: pgmap v18163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:38.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33889.006698 secs 2024-04-21T19:49:38.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33889.006698 secs 2024-04-21T19:49:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33889.006698 secs 2024-04-21T19:49:39.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:39 smithi170 ceph-mon[31212]: pgmap v18164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:39.371 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:39 smithi191 ceph-mon[31636]: pgmap v18164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:39 smithi077 ceph-mon[27902]: pgmap v18164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33890.764508 secs 2024-04-21T19:49:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33890.764508 secs 2024-04-21T19:49:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33890.764508 secs 2024-04-21T19:49:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:41 smithi170 ceph-mon[31212]: pgmap v18165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:41.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:41 smithi077 ceph-mon[27902]: pgmap v18165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:41 smithi191 ceph-mon[31636]: pgmap v18165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:43 smithi170 ceph-mon[31212]: pgmap v18166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33894.006805 secs 2024-04-21T19:49:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:43 smithi077 ceph-mon[27902]: pgmap v18166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33894.006805 secs 2024-04-21T19:49:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:43 smithi191 ceph-mon[31636]: pgmap v18166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33894.006805 secs 2024-04-21T19:49:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33895.764649 secs 2024-04-21T19:49:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:45 smithi170 ceph-mon[31212]: pgmap v18167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:49:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33895.764649 secs 2024-04-21T19:49:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:45 smithi077 ceph-mon[27902]: pgmap v18167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:49:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33895.764649 secs 2024-04-21T19:49:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:45 smithi191 ceph-mon[31636]: pgmap v18167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:49:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:49:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:49:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:49:46.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:49:46.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:49:46.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:49:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:49:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:49:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:49:47.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:47 smithi170 ceph-mon[31212]: pgmap v18168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:47.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:47 smithi077 ceph-mon[27902]: pgmap v18168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:47.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:47 smithi191 ceph-mon[31636]: pgmap v18168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33899.006914 secs 2024-04-21T19:49:48.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33899.006914 secs 2024-04-21T19:49:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33899.006914 secs 2024-04-21T19:49:49.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:49 smithi170 ceph-mon[31212]: pgmap v18169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:49 smithi077 ceph-mon[27902]: pgmap v18169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:49.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:49 smithi191 ceph-mon[31636]: pgmap v18169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33900.764784 secs 2024-04-21T19:49:50.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33900.764784 secs 2024-04-21T19:49:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33900.764784 secs 2024-04-21T19:49:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:51 smithi170 ceph-mon[31212]: pgmap v18170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:51 smithi077 ceph-mon[27902]: pgmap v18170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:51.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:51 smithi191 ceph-mon[31636]: pgmap v18170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:53.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:53 smithi077 ceph-mon[27902]: pgmap v18171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:53.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33904.007032 secs 2024-04-21T19:49:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:53 smithi191 ceph-mon[31636]: pgmap v18171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33904.007032 secs 2024-04-21T19:49:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:53 smithi170 ceph-mon[31212]: pgmap v18171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33904.007032 secs 2024-04-21T19:49:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:49:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33905.764903 secs 2024-04-21T19:49:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:54 smithi191 ceph-mon[31636]: pgmap v18172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33905.764903 secs 2024-04-21T19:49:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:54 smithi170 ceph-mon[31212]: pgmap v18172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33905.764903 secs 2024-04-21T19:49:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:54 smithi077 ceph-mon[27902]: pgmap v18172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:57.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:57 smithi170 ceph-mon[31212]: pgmap v18173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:57.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:57 smithi077 ceph-mon[27902]: pgmap v18173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:57.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:57 smithi191 ceph-mon[31636]: pgmap v18173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:49:58.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33909.007144 secs 2024-04-21T19:49:58.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33909.007144 secs 2024-04-21T19:49:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33909.007144 secs 2024-04-21T19:49:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.042+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:49:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.042+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:49:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.042+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T19:49:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.043+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:49:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.043+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T19:49:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.043+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:49:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.043+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:49:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:49:59.043+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:49:59.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:49:59 smithi077 ceph-mon[27902]: pgmap v18174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:59.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:49:59 smithi170 ceph-mon[31212]: pgmap v18174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:49:59.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:49:59 smithi191 ceph-mon[31636]: pgmap v18174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33910.764979 secs 2024-04-21T19:50:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:50:00.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33910.764979 secs 2024-04-21T19:50:00.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:50:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33910.764979 secs 2024-04-21T19:50:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T19:50:01.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:01 smithi170 ceph-mon[31212]: pgmap v18175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:01.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:01 smithi077 ceph-mon[27902]: pgmap v18175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:01.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:01 smithi191 ceph-mon[31636]: pgmap v18175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:03 smithi170 ceph-mon[31212]: pgmap v18176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33914.007222 secs 2024-04-21T19:50:03.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:03 smithi077 ceph-mon[27902]: pgmap v18176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33914.007222 secs 2024-04-21T19:50:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:03 smithi191 ceph-mon[31636]: pgmap v18176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:03.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33914.007222 secs 2024-04-21T19:50:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33915.765059 secs 2024-04-21T19:50:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:05 smithi170 ceph-mon[31212]: pgmap v18177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:05 smithi170 ceph-mon[31212]: osdmap e1208: 12 total, 12 up, 12 in 2024-04-21T19:50:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33915.765059 secs 2024-04-21T19:50:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:05 smithi077 ceph-mon[27902]: pgmap v18177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:05 smithi077 ceph-mon[27902]: osdmap e1208: 12 total, 12 up, 12 in 2024-04-21T19:50:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33915.765059 secs 2024-04-21T19:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:05 smithi191 ceph-mon[31636]: pgmap v18177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:05 smithi191 ceph-mon[31636]: osdmap e1208: 12 total, 12 up, 12 in 2024-04-21T19:50:07.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:07 smithi170 ceph-mon[31212]: pgmap v18179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:50:07.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:07 smithi077 ceph-mon[27902]: pgmap v18179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:50:07.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:07 smithi191 ceph-mon[31636]: pgmap v18179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:50:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33919.007304 secs 2024-04-21T19:50:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33919.007304 secs 2024-04-21T19:50:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33919.007304 secs 2024-04-21T19:50:09.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:09 smithi191 ceph-mon[31636]: pgmap v18180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:50:09.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:09 smithi191 ceph-mon[31636]: osdmap e1209: 12 total, 12 up, 12 in 2024-04-21T19:50:09.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:09 smithi077 ceph-mon[27902]: pgmap v18180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:50:09.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:09 smithi077 ceph-mon[27902]: osdmap e1209: 12 total, 12 up, 12 in 2024-04-21T19:50:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:09 smithi170 ceph-mon[31212]: pgmap v18180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:50:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:09 smithi170 ceph-mon[31212]: osdmap e1209: 12 total, 12 up, 12 in 2024-04-21T19:50:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33920.765125 secs 2024-04-21T19:50:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33920.765125 secs 2024-04-21T19:50:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33920.765125 secs 2024-04-21T19:50:11.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:11 smithi077 ceph-mon[27902]: pgmap v18182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:50:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:11 smithi191 ceph-mon[31636]: pgmap v18182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:50:11.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:11 smithi170 ceph-mon[31212]: pgmap v18182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:50:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:13 smithi077 ceph-mon[27902]: pgmap v18183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:50:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33924.007440 secs 2024-04-21T19:50:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:13 smithi191 ceph-mon[31636]: pgmap v18183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:50:13.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33924.007440 secs 2024-04-21T19:50:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:13 smithi170 ceph-mon[31212]: pgmap v18183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:50:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33924.007440 secs 2024-04-21T19:50:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33925.765261 secs 2024-04-21T19:50:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:15 smithi077 ceph-mon[27902]: pgmap v18184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:50:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33925.765261 secs 2024-04-21T19:50:15.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:15 smithi191 ceph-mon[31636]: pgmap v18184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:50:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33925.765261 secs 2024-04-21T19:50:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:15 smithi170 ceph-mon[31212]: pgmap v18184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:50:17.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:17 smithi077 ceph-mon[27902]: pgmap v18185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:50:17.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:17 smithi191 ceph-mon[31636]: pgmap v18185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:50:17.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:17 smithi170 ceph-mon[31212]: pgmap v18185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:50:18.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33929.007563 secs 2024-04-21T19:50:18.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33929.007563 secs 2024-04-21T19:50:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33929.007563 secs 2024-04-21T19:50:19.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:19 smithi077 ceph-mon[27902]: pgmap v18186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:50:19.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:19 smithi191 ceph-mon[31636]: pgmap v18186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:50:19.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:19 smithi170 ceph-mon[31212]: pgmap v18186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:50:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:20.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33930.765338 secs 2024-04-21T19:50:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33930.765338 secs 2024-04-21T19:50:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33930.765338 secs 2024-04-21T19:50:21.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:21 smithi077 ceph-mon[27902]: pgmap v18187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:50:21.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:21 smithi191 ceph-mon[31636]: pgmap v18187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:50:21.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:21 smithi170 ceph-mon[31212]: pgmap v18187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:50:23.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:23 smithi077 ceph-mon[27902]: pgmap v18188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:50:23.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33934.007703 secs 2024-04-21T19:50:23.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:23 smithi191 ceph-mon[31636]: pgmap v18188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:50:23.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33934.007703 secs 2024-04-21T19:50:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:23 smithi170 ceph-mon[31212]: pgmap v18188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:50:23.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33934.007703 secs 2024-04-21T19:50:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33935.765437 secs 2024-04-21T19:50:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:25 smithi077 ceph-mon[27902]: pgmap v18189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33935.765437 secs 2024-04-21T19:50:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:25 smithi191 ceph-mon[31636]: pgmap v18189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33935.765437 secs 2024-04-21T19:50:25.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:25 smithi170 ceph-mon[31212]: pgmap v18189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:27.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:27 smithi077 ceph-mon[27902]: pgmap v18190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:27.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:27 smithi191 ceph-mon[31636]: pgmap v18190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:27.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:27 smithi170 ceph-mon[31212]: pgmap v18190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:28.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33939.007818 secs 2024-04-21T19:50:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33939.007818 secs 2024-04-21T19:50:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33939.007818 secs 2024-04-21T19:50:29.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:29 smithi077 ceph-mon[27902]: pgmap v18191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:29.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:29 smithi191 ceph-mon[31636]: pgmap v18191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:29.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:29 smithi170 ceph-mon[31212]: pgmap v18191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33940.765573 secs 2024-04-21T19:50:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33940.765573 secs 2024-04-21T19:50:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33940.765573 secs 2024-04-21T19:50:31.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:31 smithi077 ceph-mon[27902]: pgmap v18192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:31.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:31 smithi191 ceph-mon[31636]: pgmap v18192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:31.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:31 smithi170 ceph-mon[31212]: pgmap v18192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:33.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:33 smithi077 ceph-mon[27902]: pgmap v18193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:33.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33944.007937 secs 2024-04-21T19:50:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:33 smithi191 ceph-mon[31636]: pgmap v18193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33944.007937 secs 2024-04-21T19:50:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:33 smithi170 ceph-mon[31212]: pgmap v18193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33944.007937 secs 2024-04-21T19:50:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33945.765682 secs 2024-04-21T19:50:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:35 smithi077 ceph-mon[27902]: pgmap v18194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:35.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33945.765682 secs 2024-04-21T19:50:35.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:35 smithi191 ceph-mon[31636]: pgmap v18194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33945.765682 secs 2024-04-21T19:50:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:35 smithi170 ceph-mon[31212]: pgmap v18194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:37.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:37 smithi077 ceph-mon[27902]: pgmap v18195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:37.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:37 smithi191 ceph-mon[31636]: pgmap v18195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:37.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:37 smithi170 ceph-mon[31212]: pgmap v18195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33949.008004 secs 2024-04-21T19:50:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33949.008004 secs 2024-04-21T19:50:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33949.008004 secs 2024-04-21T19:50:39.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:39 smithi191 ceph-mon[31636]: pgmap v18196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:39.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:39 smithi170 ceph-mon[31212]: pgmap v18196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:39.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:39 smithi077 ceph-mon[27902]: pgmap v18196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33950.765822 secs 2024-04-21T19:50:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33950.765822 secs 2024-04-21T19:50:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33950.765822 secs 2024-04-21T19:50:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:41 smithi191 ceph-mon[31636]: pgmap v18197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:41.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:41 smithi170 ceph-mon[31212]: pgmap v18197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:41.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:41 smithi077 ceph-mon[27902]: pgmap v18197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:43.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:43 smithi191 ceph-mon[31636]: pgmap v18198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33954.008110 secs 2024-04-21T19:50:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:43 smithi170 ceph-mon[31212]: pgmap v18198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33954.008110 secs 2024-04-21T19:50:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:43 smithi077 ceph-mon[27902]: pgmap v18198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33954.008110 secs 2024-04-21T19:50:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33955.765929 secs 2024-04-21T19:50:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:45 smithi191 ceph-mon[31636]: pgmap v18199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33955.765929 secs 2024-04-21T19:50:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:45 smithi170 ceph-mon[31212]: pgmap v18199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33955.765929 secs 2024-04-21T19:50:45.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:45 smithi077 ceph-mon[27902]: pgmap v18199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:46.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:50:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:50:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:50:47.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:47 smithi191 ceph-mon[31636]: pgmap v18200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:47.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:50:47.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:50:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:50:47.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:47 smithi170 ceph-mon[31212]: pgmap v18200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:50:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:50:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:50:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:47 smithi077 ceph-mon[27902]: pgmap v18200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:50:47.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:50:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:50:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33959.008194 secs 2024-04-21T19:50:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33959.008194 secs 2024-04-21T19:50:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33959.008194 secs 2024-04-21T19:50:49.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:49 smithi191 ceph-mon[31636]: pgmap v18201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:49.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:49 smithi170 ceph-mon[31212]: pgmap v18201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:49.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:49 smithi077 ceph-mon[27902]: pgmap v18201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33960.766007 secs 2024-04-21T19:50:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33960.766007 secs 2024-04-21T19:50:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33960.766007 secs 2024-04-21T19:50:51.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:51 smithi191 ceph-mon[31636]: pgmap v18202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:51.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:51 smithi170 ceph-mon[31212]: pgmap v18202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:51.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:51 smithi077 ceph-mon[27902]: pgmap v18202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:53.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:53 smithi191 ceph-mon[31636]: pgmap v18203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33964.008310 secs 2024-04-21T19:50:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:53 smithi170 ceph-mon[31212]: pgmap v18203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33964.008310 secs 2024-04-21T19:50:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:53 smithi077 ceph-mon[27902]: pgmap v18203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33964.008310 secs 2024-04-21T19:50:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:50:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33965.766069 secs 2024-04-21T19:50:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:55 smithi191 ceph-mon[31636]: pgmap v18204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33965.766069 secs 2024-04-21T19:50:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:55 smithi170 ceph-mon[31212]: pgmap v18204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33965.766069 secs 2024-04-21T19:50:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:55 smithi077 ceph-mon[27902]: pgmap v18204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:57.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:57 smithi191 ceph-mon[31636]: pgmap v18205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:57.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:57 smithi170 ceph-mon[31212]: pgmap v18205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:57.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:57 smithi077 ceph-mon[27902]: pgmap v18205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:50:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33969.008423 secs 2024-04-21T19:50:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33969.008423 secs 2024-04-21T19:50:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33969.008423 secs 2024-04-21T19:50:59.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:50:59 smithi191 ceph-mon[31636]: pgmap v18206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:59.539 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:50:59 smithi077 ceph-mon[27902]: pgmap v18206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:50:59.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:50:59 smithi170 ceph-mon[31212]: pgmap v18206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33970.766186 secs 2024-04-21T19:51:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33970.766186 secs 2024-04-21T19:51:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33970.766186 secs 2024-04-21T19:51:01.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:01 smithi191 ceph-mon[31636]: pgmap v18207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:01.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:01 smithi170 ceph-mon[31212]: pgmap v18207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:01.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:01 smithi077 ceph-mon[27902]: pgmap v18207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:03.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:03 smithi191 ceph-mon[31636]: pgmap v18208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T19:51:03.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33974.008540 secs 2024-04-21T19:51:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:03 smithi170 ceph-mon[31212]: pgmap v18208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T19:51:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33974.008540 secs 2024-04-21T19:51:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:03 smithi077 ceph-mon[27902]: pgmap v18208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T19:51:03.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33974.008540 secs 2024-04-21T19:51:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33975.766287 secs 2024-04-21T19:51:05.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:05 smithi191 ceph-mon[31636]: pgmap v18209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T19:51:05.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:05 smithi191 ceph-mon[31636]: osdmap e1210: 12 total, 12 up, 12 in 2024-04-21T19:51:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33975.766287 secs 2024-04-21T19:51:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:05 smithi170 ceph-mon[31212]: pgmap v18209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T19:51:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:05 smithi170 ceph-mon[31212]: osdmap e1210: 12 total, 12 up, 12 in 2024-04-21T19:51:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33975.766287 secs 2024-04-21T19:51:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:05 smithi077 ceph-mon[27902]: pgmap v18209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T19:51:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:05 smithi077 ceph-mon[27902]: osdmap e1210: 12 total, 12 up, 12 in 2024-04-21T19:51:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:07 smithi191 ceph-mon[31636]: pgmap v18211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:51:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:07 smithi170 ceph-mon[31212]: pgmap v18211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:51:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:07 smithi077 ceph-mon[27902]: pgmap v18211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:51:08.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33979.008657 secs 2024-04-21T19:51:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33979.008657 secs 2024-04-21T19:51:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33979.008657 secs 2024-04-21T19:51:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:09 smithi170 ceph-mon[31212]: pgmap v18212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:51:09.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:09 smithi170 ceph-mon[31212]: osdmap e1211: 12 total, 12 up, 12 in 2024-04-21T19:51:09.623 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:09 smithi191 ceph-mon[31636]: pgmap v18212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:51:09.623 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:09 smithi191 ceph-mon[31636]: osdmap e1211: 12 total, 12 up, 12 in 2024-04-21T19:51:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:09 smithi077 ceph-mon[27902]: pgmap v18212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:51:09.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:09 smithi077 ceph-mon[27902]: osdmap e1211: 12 total, 12 up, 12 in 2024-04-21T19:51:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33980.766386 secs 2024-04-21T19:51:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33980.766386 secs 2024-04-21T19:51:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33980.766386 secs 2024-04-21T19:51:11.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:11 smithi170 ceph-mon[31212]: pgmap v18214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T19:51:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:11 smithi077 ceph-mon[27902]: pgmap v18214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T19:51:11.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:11 smithi191 ceph-mon[31636]: pgmap v18214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-04-21T19:51:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:13 smithi170 ceph-mon[31212]: pgmap v18215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:51:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33984.008795 secs 2024-04-21T19:51:13.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:13 smithi077 ceph-mon[27902]: pgmap v18215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:51:13.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33984.008795 secs 2024-04-21T19:51:13.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:13 smithi191 ceph-mon[31636]: pgmap v18215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T19:51:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33984.008795 secs 2024-04-21T19:51:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33985.766500 secs 2024-04-21T19:51:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:15 smithi170 ceph-mon[31212]: pgmap v18216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T19:51:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33985.766500 secs 2024-04-21T19:51:15.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:15 smithi077 ceph-mon[27902]: pgmap v18216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T19:51:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33985.766500 secs 2024-04-21T19:51:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:15 smithi191 ceph-mon[31636]: pgmap v18216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T19:51:17.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:17 smithi170 ceph-mon[31212]: pgmap v18217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:51:17.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:17 smithi077 ceph-mon[27902]: pgmap v18217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:51:17.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:17 smithi191 ceph-mon[31636]: pgmap v18217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:51:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33989.008896 secs 2024-04-21T19:51:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33989.008896 secs 2024-04-21T19:51:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33989.008896 secs 2024-04-21T19:51:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:19 smithi170 ceph-mon[31212]: pgmap v18218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:51:19.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:19 smithi077 ceph-mon[27902]: pgmap v18218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:51:19.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:19 smithi191 ceph-mon[31636]: pgmap v18218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:51:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33990.766619 secs 2024-04-21T19:51:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33990.766619 secs 2024-04-21T19:51:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33990.766619 secs 2024-04-21T19:51:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:21 smithi170 ceph-mon[31212]: pgmap v18219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:51:21.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:21 smithi077 ceph-mon[27902]: pgmap v18219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:51:21.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:21 smithi191 ceph-mon[31636]: pgmap v18219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:51:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:23 smithi170 ceph-mon[31212]: pgmap v18220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:51:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33994.009047 secs 2024-04-21T19:51:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:23 smithi077 ceph-mon[27902]: pgmap v18220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:51:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33994.009047 secs 2024-04-21T19:51:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:23 smithi191 ceph-mon[31636]: pgmap v18220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:51:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33994.009047 secs 2024-04-21T19:51:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 33995.766734 secs 2024-04-21T19:51:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:24 smithi191 ceph-mon[31636]: pgmap v18221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 33995.766734 secs 2024-04-21T19:51:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:24 smithi170 ceph-mon[31212]: pgmap v18221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 33995.766734 secs 2024-04-21T19:51:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:24 smithi077 ceph-mon[27902]: pgmap v18221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:27.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:27 smithi170 ceph-mon[31212]: pgmap v18222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:27.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:27 smithi077 ceph-mon[27902]: pgmap v18222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:27.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:27 smithi191 ceph-mon[31636]: pgmap v18222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:28.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 33999.009167 secs 2024-04-21T19:51:28.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 33999.009167 secs 2024-04-21T19:51:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 33999.009167 secs 2024-04-21T19:51:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:29 smithi170 ceph-mon[31212]: pgmap v18223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:29 smithi077 ceph-mon[27902]: pgmap v18223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:29.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:29 smithi191 ceph-mon[31636]: pgmap v18223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34000.766846 secs 2024-04-21T19:51:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34000.766846 secs 2024-04-21T19:51:30.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34000.766846 secs 2024-04-21T19:51:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:31 smithi077 ceph-mon[27902]: pgmap v18224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:31.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:31 smithi191 ceph-mon[31636]: pgmap v18224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:31.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:31 smithi170 ceph-mon[31212]: pgmap v18224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:33.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:33 smithi077 ceph-mon[27902]: pgmap v18225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34004.009287 secs 2024-04-21T19:51:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:33 smithi191 ceph-mon[31636]: pgmap v18225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34004.009287 secs 2024-04-21T19:51:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:33 smithi170 ceph-mon[31212]: pgmap v18225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34004.009287 secs 2024-04-21T19:51:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34005.766928 secs 2024-04-21T19:51:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:35 smithi077 ceph-mon[27902]: pgmap v18226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:35.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34005.766928 secs 2024-04-21T19:51:35.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:35 smithi191 ceph-mon[31636]: pgmap v18226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34005.766928 secs 2024-04-21T19:51:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:35 smithi170 ceph-mon[31212]: pgmap v18226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:37.363 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:37 smithi170 ceph-mon[31212]: pgmap v18227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:37.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:37 smithi077 ceph-mon[27902]: pgmap v18227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:37 smithi191 ceph-mon[31636]: pgmap v18227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:38.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34009.009424 secs 2024-04-21T19:51:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34009.009424 secs 2024-04-21T19:51:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34009.009424 secs 2024-04-21T19:51:39.373 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:39 smithi191 ceph-mon[31636]: pgmap v18228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:39.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:39 smithi077 ceph-mon[27902]: pgmap v18228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:39 smithi170 ceph-mon[31212]: pgmap v18228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34010.767040 secs 2024-04-21T19:51:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34010.767040 secs 2024-04-21T19:51:40.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34010.767040 secs 2024-04-21T19:51:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:41 smithi077 ceph-mon[27902]: pgmap v18229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:41 smithi191 ceph-mon[31636]: pgmap v18229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:41.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:41 smithi170 ceph-mon[31212]: pgmap v18229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:43.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:43 smithi077 ceph-mon[27902]: pgmap v18230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34014.009563 secs 2024-04-21T19:51:43.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:43 smithi191 ceph-mon[31636]: pgmap v18230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:43.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34014.009563 secs 2024-04-21T19:51:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:43 smithi170 ceph-mon[31212]: pgmap v18230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:43.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34014.009563 secs 2024-04-21T19:51:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:45.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34015.767154 secs 2024-04-21T19:51:45.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:45 smithi077 ceph-mon[27902]: pgmap v18231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34015.767154 secs 2024-04-21T19:51:45.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:45 smithi191 ceph-mon[31636]: pgmap v18231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34015.767154 secs 2024-04-21T19:51:45.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:45 smithi170 ceph-mon[31212]: pgmap v18231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:47 smithi077 ceph-mon[27902]: pgmap v18232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:51:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:51:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:51:47.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:51:47.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:47 smithi191 ceph-mon[31636]: pgmap v18232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:51:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:51:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:51:47.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:51:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:47 smithi170 ceph-mon[31212]: pgmap v18232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:51:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:51:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:51:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:51:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34019.009640 secs 2024-04-21T19:51:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34019.009640 secs 2024-04-21T19:51:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34019.009640 secs 2024-04-21T19:51:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:49 smithi077 ceph-mon[27902]: pgmap v18233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:49.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:49 smithi191 ceph-mon[31636]: pgmap v18233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:49 smithi170 ceph-mon[31212]: pgmap v18233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34020.767290 secs 2024-04-21T19:51:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34020.767290 secs 2024-04-21T19:51:50.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34020.767290 secs 2024-04-21T19:51:51.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:51 smithi077 ceph-mon[27902]: pgmap v18234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:51.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:51 smithi191 ceph-mon[31636]: pgmap v18234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:51.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:51 smithi170 ceph-mon[31212]: pgmap v18234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:53 smithi077 ceph-mon[27902]: pgmap v18235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:53.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34024.009750 secs 2024-04-21T19:51:53.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:53 smithi191 ceph-mon[31636]: pgmap v18235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:53.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34024.009750 secs 2024-04-21T19:51:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:53 smithi170 ceph-mon[31212]: pgmap v18235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:53.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34024.009750 secs 2024-04-21T19:51:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:51:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34025.767364 secs 2024-04-21T19:51:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:55 smithi077 ceph-mon[27902]: pgmap v18236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34025.767364 secs 2024-04-21T19:51:55.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:55 smithi191 ceph-mon[31636]: pgmap v18236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34025.767364 secs 2024-04-21T19:51:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:55 smithi170 ceph-mon[31212]: pgmap v18236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:57 smithi077 ceph-mon[27902]: pgmap v18237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:57.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:57 smithi191 ceph-mon[31636]: pgmap v18237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:57.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:57 smithi170 ceph-mon[31212]: pgmap v18237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:51:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34029.009841 secs 2024-04-21T19:51:58.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34029.009841 secs 2024-04-21T19:51:58.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34029.009841 secs 2024-04-21T19:51:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:51:59 smithi077 ceph-mon[27902]: pgmap v18238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:59.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:51:59 smithi191 ceph-mon[31636]: pgmap v18238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:51:59.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:51:59 smithi170 ceph-mon[31212]: pgmap v18238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34030.767497 secs 2024-04-21T19:52:00.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34030.767497 secs 2024-04-21T19:52:00.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34030.767497 secs 2024-04-21T19:52:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:01 smithi077 ceph-mon[27902]: pgmap v18239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:01.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:01 smithi191 ceph-mon[31636]: pgmap v18239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:01 smithi170 ceph-mon[31212]: pgmap v18239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:03 smithi191 ceph-mon[31636]: pgmap v18240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34034.009912 secs 2024-04-21T19:52:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:03 smithi170 ceph-mon[31212]: pgmap v18240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34034.009912 secs 2024-04-21T19:52:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:03 smithi077 ceph-mon[27902]: pgmap v18240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34034.009912 secs 2024-04-21T19:52:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:05.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34035.767629 secs 2024-04-21T19:52:05.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:05 smithi191 ceph-mon[31636]: pgmap v18241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:05.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:05 smithi191 ceph-mon[31636]: osdmap e1212: 12 total, 12 up, 12 in 2024-04-21T19:52:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34035.767629 secs 2024-04-21T19:52:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:05 smithi170 ceph-mon[31212]: pgmap v18241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:05 smithi170 ceph-mon[31212]: osdmap e1212: 12 total, 12 up, 12 in 2024-04-21T19:52:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34035.767629 secs 2024-04-21T19:52:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:05 smithi077 ceph-mon[27902]: pgmap v18241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:05 smithi077 ceph-mon[27902]: osdmap e1212: 12 total, 12 up, 12 in 2024-04-21T19:52:07.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:07 smithi191 ceph-mon[31636]: pgmap v18243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:52:07.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:07 smithi170 ceph-mon[31212]: pgmap v18243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:52:07.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:07 smithi077 ceph-mon[27902]: pgmap v18243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:52:08.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34039.010032 secs 2024-04-21T19:52:08.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34039.010032 secs 2024-04-21T19:52:08.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34039.010032 secs 2024-04-21T19:52:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:09 smithi191 ceph-mon[31636]: pgmap v18244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:52:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:09 smithi191 ceph-mon[31636]: osdmap e1213: 12 total, 12 up, 12 in 2024-04-21T19:52:09.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:09 smithi170 ceph-mon[31212]: pgmap v18244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:52:09.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:09 smithi170 ceph-mon[31212]: osdmap e1213: 12 total, 12 up, 12 in 2024-04-21T19:52:09.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:09 smithi077 ceph-mon[27902]: pgmap v18244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:52:09.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:09 smithi077 ceph-mon[27902]: osdmap e1213: 12 total, 12 up, 12 in 2024-04-21T19:52:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34040.767721 secs 2024-04-21T19:52:10.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34040.767721 secs 2024-04-21T19:52:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34040.767721 secs 2024-04-21T19:52:11.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:11 smithi191 ceph-mon[31636]: pgmap v18246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:52:11.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:11 smithi170 ceph-mon[31212]: pgmap v18246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:52:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:11 smithi077 ceph-mon[27902]: pgmap v18246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:52:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:13 smithi191 ceph-mon[31636]: pgmap v18247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:52:13.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34044.010150 secs 2024-04-21T19:52:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:13 smithi170 ceph-mon[31212]: pgmap v18247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:52:13.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34044.010150 secs 2024-04-21T19:52:13.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:13 smithi077 ceph-mon[27902]: pgmap v18247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:52:13.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34044.010150 secs 2024-04-21T19:52:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34045.767877 secs 2024-04-21T19:52:15.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:15 smithi191 ceph-mon[31636]: pgmap v18248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:52:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34045.767877 secs 2024-04-21T19:52:15.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:15 smithi170 ceph-mon[31212]: pgmap v18248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:52:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34045.767877 secs 2024-04-21T19:52:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:15 smithi077 ceph-mon[27902]: pgmap v18248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:52:17.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:17 smithi191 ceph-mon[31636]: pgmap v18249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:52:17.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:17 smithi170 ceph-mon[31212]: pgmap v18249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:52:17.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:17 smithi077 ceph-mon[27902]: pgmap v18249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:52:18.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34049.010264 secs 2024-04-21T19:52:18.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34049.010264 secs 2024-04-21T19:52:18.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34049.010264 secs 2024-04-21T19:52:19.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:19 smithi191 ceph-mon[31636]: pgmap v18250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:52:19.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:19 smithi170 ceph-mon[31212]: pgmap v18250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:52:19.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:19 smithi077 ceph-mon[27902]: pgmap v18250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:52:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:20.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34050.767993 secs 2024-04-21T19:52:20.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34050.767993 secs 2024-04-21T19:52:20.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34050.767993 secs 2024-04-21T19:52:21.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:21 smithi191 ceph-mon[31636]: pgmap v18251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:52:21.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:21 smithi170 ceph-mon[31212]: pgmap v18251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:52:21.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:21 smithi077 ceph-mon[27902]: pgmap v18251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:52:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:23 smithi191 ceph-mon[31636]: pgmap v18252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:52:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34054.010372 secs 2024-04-21T19:52:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:23 smithi170 ceph-mon[31212]: pgmap v18252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:52:23.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34054.010372 secs 2024-04-21T19:52:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:23 smithi077 ceph-mon[27902]: pgmap v18252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:52:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34054.010372 secs 2024-04-21T19:52:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34055.768107 secs 2024-04-21T19:52:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:25 smithi191 ceph-mon[31636]: pgmap v18253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34055.768107 secs 2024-04-21T19:52:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:25 smithi170 ceph-mon[31212]: pgmap v18253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34055.768107 secs 2024-04-21T19:52:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:25 smithi077 ceph-mon[27902]: pgmap v18253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:27.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:27 smithi191 ceph-mon[31636]: pgmap v18254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:27.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:27 smithi170 ceph-mon[31212]: pgmap v18254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:27.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:27 smithi077 ceph-mon[27902]: pgmap v18254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34059.010503 secs 2024-04-21T19:52:28.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34059.010503 secs 2024-04-21T19:52:28.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34059.010503 secs 2024-04-21T19:52:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:29 smithi191 ceph-mon[31636]: pgmap v18255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:29.540 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:29 smithi077 ceph-mon[27902]: pgmap v18255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:29.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:29 smithi170 ceph-mon[31212]: pgmap v18255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34060.768221 secs 2024-04-21T19:52:30.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34060.768221 secs 2024-04-21T19:52:30.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34060.768221 secs 2024-04-21T19:52:31.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:31 smithi170 ceph-mon[31212]: pgmap v18256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:31.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:31 smithi077 ceph-mon[27902]: pgmap v18256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:31.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:31 smithi191 ceph-mon[31636]: pgmap v18256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:33 smithi170 ceph-mon[31212]: pgmap v18257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:33.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34064.010617 secs 2024-04-21T19:52:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:33 smithi077 ceph-mon[27902]: pgmap v18257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34064.010617 secs 2024-04-21T19:52:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:33 smithi191 ceph-mon[31636]: pgmap v18257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:33.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34064.010617 secs 2024-04-21T19:52:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34065.768335 secs 2024-04-21T19:52:35.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:35 smithi170 ceph-mon[31212]: pgmap v18258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:35.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34065.768335 secs 2024-04-21T19:52:35.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:35 smithi077 ceph-mon[27902]: pgmap v18258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34065.768335 secs 2024-04-21T19:52:35.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:35 smithi191 ceph-mon[31636]: pgmap v18258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:37.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:37 smithi170 ceph-mon[31212]: pgmap v18259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:37.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:37 smithi077 ceph-mon[27902]: pgmap v18259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:37.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:37 smithi191 ceph-mon[31636]: pgmap v18259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34069.010728 secs 2024-04-21T19:52:38.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34069.010728 secs 2024-04-21T19:52:38.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34069.010728 secs 2024-04-21T19:52:39.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:39 smithi170 ceph-mon[31212]: pgmap v18260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:39.623 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:39 smithi191 ceph-mon[31636]: pgmap v18260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:39.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:39 smithi077 ceph-mon[27902]: pgmap v18260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:40.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34070.768464 secs 2024-04-21T19:52:40.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34070.768464 secs 2024-04-21T19:52:40.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34070.768464 secs 2024-04-21T19:52:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:41 smithi170 ceph-mon[31212]: pgmap v18261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:41.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:41 smithi077 ceph-mon[27902]: pgmap v18261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:41.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:41 smithi191 ceph-mon[31636]: pgmap v18261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:43 smithi170 ceph-mon[31212]: pgmap v18262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34074.010846 secs 2024-04-21T19:52:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:43 smithi077 ceph-mon[27902]: pgmap v18262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:43.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34074.010846 secs 2024-04-21T19:52:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:43 smithi191 ceph-mon[31636]: pgmap v18262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:43.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34074.010846 secs 2024-04-21T19:52:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34075.768592 secs 2024-04-21T19:52:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:45 smithi170 ceph-mon[31212]: pgmap v18263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:45.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34075.768592 secs 2024-04-21T19:52:45.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:45 smithi077 ceph-mon[27902]: pgmap v18263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34075.768592 secs 2024-04-21T19:52:45.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:45 smithi191 ceph-mon[31636]: pgmap v18263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:47.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:47 smithi170 ceph-mon[31212]: pgmap v18264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:52:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:47 smithi077 ceph-mon[27902]: pgmap v18264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:52:47.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:47 smithi191 ceph-mon[31636]: pgmap v18264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:47.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:52:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34079.010956 secs 2024-04-21T19:52:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:52:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:52:48.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:52:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34079.010956 secs 2024-04-21T19:52:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:52:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:52:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:52:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34079.010956 secs 2024-04-21T19:52:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:52:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:52:48.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:52:49.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:49 smithi170 ceph-mon[31212]: pgmap v18265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:49.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:49 smithi077 ceph-mon[27902]: pgmap v18265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:49.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:49 smithi191 ceph-mon[31636]: pgmap v18265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34080.768731 secs 2024-04-21T19:52:50.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34080.768731 secs 2024-04-21T19:52:50.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34080.768731 secs 2024-04-21T19:52:51.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:51 smithi170 ceph-mon[31212]: pgmap v18266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:51.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:51 smithi077 ceph-mon[27902]: pgmap v18266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:51.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:51 smithi191 ceph-mon[31636]: pgmap v18266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:53 smithi170 ceph-mon[31212]: pgmap v18267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34084.011076 secs 2024-04-21T19:52:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:53 smithi077 ceph-mon[27902]: pgmap v18267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34084.011076 secs 2024-04-21T19:52:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:53 smithi191 ceph-mon[31636]: pgmap v18267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:53.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34084.011076 secs 2024-04-21T19:52:54.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34085.768862 secs 2024-04-21T19:52:54.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34085.768862 secs 2024-04-21T19:52:54.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34085.768862 secs 2024-04-21T19:52:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:52:55.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:55 smithi170 ceph-mon[31212]: pgmap v18268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:55.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:55 smithi077 ceph-mon[27902]: pgmap v18268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:55.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:55 smithi191 ceph-mon[31636]: pgmap v18268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:57 smithi170 ceph-mon[31212]: pgmap v18269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:57.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:57 smithi077 ceph-mon[27902]: pgmap v18269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:57.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:57 smithi191 ceph-mon[31636]: pgmap v18269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:52:58.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34089.011200 secs 2024-04-21T19:52:58.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34089.011200 secs 2024-04-21T19:52:58.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34089.011200 secs 2024-04-21T19:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:52:59.067+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:52:59.067+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:52:59.067+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:52:59.067+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:52:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:59 smithi170 ceph-mon[31212]: pgmap v18270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:52:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34090.768982 secs 2024-04-21T19:52:59.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:59 smithi077 ceph-mon[27902]: pgmap v18270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:59.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:52:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34090.768982 secs 2024-04-21T19:52:59.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:59 smithi191 ceph-mon[31636]: pgmap v18270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:52:59.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:52:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34090.768982 secs 2024-04-21T19:53:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:01.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:01 smithi170 ceph-mon[31212]: pgmap v18271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:01.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:01 smithi077 ceph-mon[27902]: pgmap v18271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:01.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:01 smithi191 ceph-mon[31636]: pgmap v18271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:03 smithi170 ceph-mon[31212]: pgmap v18272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34094.011348 secs 2024-04-21T19:53:03.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:03 smithi077 ceph-mon[27902]: pgmap v18272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34094.011348 secs 2024-04-21T19:53:03.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:03 smithi191 ceph-mon[31636]: pgmap v18272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34094.011348 secs 2024-04-21T19:53:04.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34095.769059 secs 2024-04-21T19:53:04.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34095.769059 secs 2024-04-21T19:53:04.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34095.769059 secs 2024-04-21T19:53:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:05.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:05 smithi077 ceph-mon[27902]: pgmap v18273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:05 smithi077 ceph-mon[27902]: osdmap e1214: 12 total, 12 up, 12 in 2024-04-21T19:53:05.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:05 smithi191 ceph-mon[31636]: pgmap v18273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:05 smithi191 ceph-mon[31636]: osdmap e1214: 12 total, 12 up, 12 in 2024-04-21T19:53:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:05 smithi170 ceph-mon[31212]: pgmap v18273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:05 smithi170 ceph-mon[31212]: osdmap e1214: 12 total, 12 up, 12 in 2024-04-21T19:53:07.613 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:07 smithi170 ceph-mon[31212]: pgmap v18275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:53:07.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:07 smithi077 ceph-mon[27902]: pgmap v18275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:53:07.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:07 smithi191 ceph-mon[31636]: pgmap v18275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:53:08.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34099.011457 secs 2024-04-21T19:53:08.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34099.011457 secs 2024-04-21T19:53:08.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34099.011457 secs 2024-04-21T19:53:09.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:09 smithi191 ceph-mon[31636]: pgmap v18276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:53:09.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34100.769182 secs 2024-04-21T19:53:09.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:09 smithi191 ceph-mon[31636]: osdmap e1215: 12 total, 12 up, 12 in 2024-04-21T19:53:09.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:09 smithi077 ceph-mon[27902]: pgmap v18276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:53:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34100.769182 secs 2024-04-21T19:53:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:09 smithi077 ceph-mon[27902]: osdmap e1215: 12 total, 12 up, 12 in 2024-04-21T19:53:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:09 smithi170 ceph-mon[31212]: pgmap v18276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:53:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34100.769182 secs 2024-04-21T19:53:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:09 smithi170 ceph-mon[31212]: osdmap e1215: 12 total, 12 up, 12 in 2024-04-21T19:53:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:11 smithi077 ceph-mon[27902]: pgmap v18278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:53:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:11 smithi191 ceph-mon[31636]: pgmap v18278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:53:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:11 smithi170 ceph-mon[31212]: pgmap v18278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:53:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:13 smithi077 ceph-mon[27902]: pgmap v18279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:53:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34104.011539 secs 2024-04-21T19:53:13.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:13 smithi191 ceph-mon[31636]: pgmap v18279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:53:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34104.011539 secs 2024-04-21T19:53:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:13 smithi170 ceph-mon[31212]: pgmap v18279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:53:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34104.011539 secs 2024-04-21T19:53:14.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34105.769301 secs 2024-04-21T19:53:14.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34105.769301 secs 2024-04-21T19:53:14.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34105.769301 secs 2024-04-21T19:53:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:15.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:15 smithi077 ceph-mon[27902]: pgmap v18280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:53:15.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:15 smithi191 ceph-mon[31636]: pgmap v18280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:53:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:15 smithi170 ceph-mon[31212]: pgmap v18280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:53:16.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:16 smithi191 ceph-mon[31636]: pgmap v18281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:53:16.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:16 smithi170 ceph-mon[31212]: pgmap v18281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:53:16.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:16 smithi077 ceph-mon[27902]: pgmap v18281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:53:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34109.011675 secs 2024-04-21T19:53:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34109.011675 secs 2024-04-21T19:53:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34109.011675 secs 2024-04-21T19:53:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:18 smithi077 ceph-mon[27902]: pgmap v18282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:53:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:18 smithi191 ceph-mon[31636]: pgmap v18282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:53:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:18 smithi170 ceph-mon[31212]: pgmap v18282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:53:19.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34110.769362 secs 2024-04-21T19:53:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34110.769362 secs 2024-04-21T19:53:20.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34110.769362 secs 2024-04-21T19:53:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:20.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:20 smithi077 ceph-mon[27902]: pgmap v18283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:53:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:20 smithi191 ceph-mon[31636]: pgmap v18283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:53:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:20 smithi170 ceph-mon[31212]: pgmap v18283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:53:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:23 smithi077 ceph-mon[27902]: pgmap v18284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:53:23.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34114.011808 secs 2024-04-21T19:53:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:23 smithi191 ceph-mon[31636]: pgmap v18284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:53:23.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34114.011808 secs 2024-04-21T19:53:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:23 smithi170 ceph-mon[31212]: pgmap v18284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:53:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34114.011808 secs 2024-04-21T19:53:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34115.769476 secs 2024-04-21T19:53:25.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:25 smithi077 ceph-mon[27902]: pgmap v18285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34115.769476 secs 2024-04-21T19:53:25.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:25 smithi191 ceph-mon[31636]: pgmap v18285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:25.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34115.769476 secs 2024-04-21T19:53:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:25 smithi170 ceph-mon[31212]: pgmap v18285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:27 smithi077 ceph-mon[27902]: pgmap v18286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:27.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:27 smithi191 ceph-mon[31636]: pgmap v18286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:27 smithi170 ceph-mon[31212]: pgmap v18286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34119.011932 secs 2024-04-21T19:53:28.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34119.011932 secs 2024-04-21T19:53:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34119.011932 secs 2024-04-21T19:53:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:29 smithi077 ceph-mon[27902]: pgmap v18287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:29 smithi191 ceph-mon[31636]: pgmap v18287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:29 smithi170 ceph-mon[31212]: pgmap v18287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34120.769593 secs 2024-04-21T19:53:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34120.769593 secs 2024-04-21T19:53:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34120.769593 secs 2024-04-21T19:53:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:31 smithi077 ceph-mon[27902]: pgmap v18288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:31 smithi191 ceph-mon[31636]: pgmap v18288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:31 smithi170 ceph-mon[31212]: pgmap v18288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:33 smithi077 ceph-mon[27902]: pgmap v18289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34124.012002 secs 2024-04-21T19:53:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:33 smithi191 ceph-mon[31636]: pgmap v18289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34124.012002 secs 2024-04-21T19:53:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:33 smithi170 ceph-mon[31212]: pgmap v18289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34124.012002 secs 2024-04-21T19:53:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:35.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34125.769740 secs 2024-04-21T19:53:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:35 smithi077 ceph-mon[27902]: pgmap v18290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34125.769740 secs 2024-04-21T19:53:35.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:35 smithi191 ceph-mon[31636]: pgmap v18290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34125.769740 secs 2024-04-21T19:53:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:35 smithi170 ceph-mon[31212]: pgmap v18290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:37 smithi077 ceph-mon[27902]: pgmap v18291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:37.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:37 smithi191 ceph-mon[31636]: pgmap v18291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:37 smithi170 ceph-mon[31212]: pgmap v18291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34129.012120 secs 2024-04-21T19:53:38.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34129.012120 secs 2024-04-21T19:53:38.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34129.012120 secs 2024-04-21T19:53:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:39 smithi077 ceph-mon[27902]: pgmap v18292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:39.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:39 smithi191 ceph-mon[31636]: pgmap v18292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:39 smithi170 ceph-mon[31212]: pgmap v18292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34130.769806 secs 2024-04-21T19:53:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34130.769806 secs 2024-04-21T19:53:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34130.769806 secs 2024-04-21T19:53:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:41 smithi077 ceph-mon[27902]: pgmap v18293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:41.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:41 smithi191 ceph-mon[31636]: pgmap v18293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:41 smithi170 ceph-mon[31212]: pgmap v18293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:43 smithi191 ceph-mon[31636]: pgmap v18294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34134.012232 secs 2024-04-21T19:53:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:43 smithi170 ceph-mon[31212]: pgmap v18294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34134.012232 secs 2024-04-21T19:53:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:43 smithi077 ceph-mon[27902]: pgmap v18294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34134.012232 secs 2024-04-21T19:53:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:45.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34135.769922 secs 2024-04-21T19:53:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:45 smithi191 ceph-mon[31636]: pgmap v18295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34135.769922 secs 2024-04-21T19:53:45.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:45 smithi170 ceph-mon[31212]: pgmap v18295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34135.769922 secs 2024-04-21T19:53:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:45 smithi077 ceph-mon[27902]: pgmap v18295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:47.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:47 smithi191 ceph-mon[31636]: pgmap v18296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:47.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:47 smithi170 ceph-mon[31212]: pgmap v18296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:47.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:47 smithi077 ceph-mon[27902]: pgmap v18296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34139.012329 secs 2024-04-21T19:53:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:53:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34139.012329 secs 2024-04-21T19:53:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:53:48.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34139.012329 secs 2024-04-21T19:53:48.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:53:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:49 smithi191 ceph-mon[31636]: pgmap v18297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:49 smithi170 ceph-mon[31212]: pgmap v18297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:49 smithi077 ceph-mon[27902]: pgmap v18297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34140.770092 secs 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34140.770092 secs 2024-04-21T19:53:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34140.770092 secs 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: pgmap v18298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:53:51.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:53:51.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:53:51.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:53:51.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:53:51.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:53:51.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: pgmap v18298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:53:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:53:51.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:53:51.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:53:51.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:53:51.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:53:51.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: pgmap v18298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:53:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:53:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:53 smithi191 ceph-mon[31636]: pgmap v18299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34144.012448 secs 2024-04-21T19:53:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:53 smithi170 ceph-mon[31212]: pgmap v18299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34144.012448 secs 2024-04-21T19:53:53.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:53 smithi077 ceph-mon[27902]: pgmap v18299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34144.012448 secs 2024-04-21T19:53:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:53:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34145.770161 secs 2024-04-21T19:53:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:55 smithi191 ceph-mon[31636]: pgmap v18300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34145.770161 secs 2024-04-21T19:53:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:55 smithi170 ceph-mon[31212]: pgmap v18300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34145.770161 secs 2024-04-21T19:53:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:55 smithi077 ceph-mon[27902]: pgmap v18300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:57 smithi191 ceph-mon[31636]: pgmap v18301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:57 smithi170 ceph-mon[31212]: pgmap v18301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:57 smithi077 ceph-mon[27902]: pgmap v18301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:53:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34149.012585 secs 2024-04-21T19:53:58.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34149.012585 secs 2024-04-21T19:53:58.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34149.012585 secs 2024-04-21T19:53:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:53:59 smithi191 ceph-mon[31636]: pgmap v18302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:59.541 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:53:59 smithi077 ceph-mon[27902]: pgmap v18302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:53:59.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:53:59 smithi170 ceph-mon[31212]: pgmap v18302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:00.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34150.770269 secs 2024-04-21T19:54:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34150.770269 secs 2024-04-21T19:54:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34150.770269 secs 2024-04-21T19:54:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:01 smithi191 ceph-mon[31636]: pgmap v18303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:01.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:01 smithi170 ceph-mon[31212]: pgmap v18303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:01 smithi077 ceph-mon[27902]: pgmap v18303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:03 smithi191 ceph-mon[31636]: pgmap v18304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34154.012706 secs 2024-04-21T19:54:03.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:03 smithi170 ceph-mon[31212]: pgmap v18304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34154.012706 secs 2024-04-21T19:54:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:03 smithi077 ceph-mon[27902]: pgmap v18304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34154.012706 secs 2024-04-21T19:54:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34155.770345 secs 2024-04-21T19:54:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:05 smithi191 ceph-mon[31636]: pgmap v18305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:05 smithi191 ceph-mon[31636]: osdmap e1216: 12 total, 12 up, 12 in 2024-04-21T19:54:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34155.770345 secs 2024-04-21T19:54:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:05 smithi170 ceph-mon[31212]: pgmap v18305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:05 smithi170 ceph-mon[31212]: osdmap e1216: 12 total, 12 up, 12 in 2024-04-21T19:54:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34155.770345 secs 2024-04-21T19:54:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:05 smithi077 ceph-mon[27902]: pgmap v18305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:05 smithi077 ceph-mon[27902]: osdmap e1216: 12 total, 12 up, 12 in 2024-04-21T19:54:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:07 smithi191 ceph-mon[31636]: pgmap v18307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:54:07.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:07 smithi170 ceph-mon[31212]: pgmap v18307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:54:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:07 smithi077 ceph-mon[27902]: pgmap v18307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:54:08.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34159.012824 secs 2024-04-21T19:54:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34159.012824 secs 2024-04-21T19:54:08.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34159.012824 secs 2024-04-21T19:54:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:09 smithi191 ceph-mon[31636]: pgmap v18308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:54:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:09 smithi191 ceph-mon[31636]: osdmap e1217: 12 total, 12 up, 12 in 2024-04-21T19:54:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:09 smithi170 ceph-mon[31212]: pgmap v18308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:54:09.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:09 smithi170 ceph-mon[31212]: osdmap e1217: 12 total, 12 up, 12 in 2024-04-21T19:54:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:09 smithi077 ceph-mon[27902]: pgmap v18308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:54:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:09 smithi077 ceph-mon[27902]: osdmap e1217: 12 total, 12 up, 12 in 2024-04-21T19:54:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34160.770432 secs 2024-04-21T19:54:10.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34160.770432 secs 2024-04-21T19:54:10.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34160.770432 secs 2024-04-21T19:54:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:11 smithi191 ceph-mon[31636]: pgmap v18310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:54:11.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:11 smithi170 ceph-mon[31212]: pgmap v18310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:54:11.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:11 smithi077 ceph-mon[27902]: pgmap v18310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:54:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:13 smithi191 ceph-mon[31636]: pgmap v18311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:54:13.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34164.012937 secs 2024-04-21T19:54:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:13 smithi170 ceph-mon[31212]: pgmap v18311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:54:13.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34164.012937 secs 2024-04-21T19:54:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:13 smithi077 ceph-mon[27902]: pgmap v18311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:54:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34164.012937 secs 2024-04-21T19:54:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:15.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34165.770569 secs 2024-04-21T19:54:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:15 smithi170 ceph-mon[31212]: pgmap v18312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:54:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34165.770569 secs 2024-04-21T19:54:15.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:15 smithi077 ceph-mon[27902]: pgmap v18312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:54:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34165.770569 secs 2024-04-21T19:54:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:15 smithi191 ceph-mon[31636]: pgmap v18312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:54:17.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:17 smithi170 ceph-mon[31212]: pgmap v18313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:54:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:17 smithi077 ceph-mon[27902]: pgmap v18313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:54:17.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:17 smithi191 ceph-mon[31636]: pgmap v18313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:54:18.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34169.013056 secs 2024-04-21T19:54:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34169.013056 secs 2024-04-21T19:54:18.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34169.013056 secs 2024-04-21T19:54:19.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:19 smithi170 ceph-mon[31212]: pgmap v18314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:54:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:19 smithi077 ceph-mon[27902]: pgmap v18314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:54:19.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:19 smithi191 ceph-mon[31636]: pgmap v18314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:54:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:20.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34170.770690 secs 2024-04-21T19:54:20.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34170.770690 secs 2024-04-21T19:54:20.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34170.770690 secs 2024-04-21T19:54:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:21 smithi170 ceph-mon[31212]: pgmap v18315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:54:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:21 smithi077 ceph-mon[27902]: pgmap v18315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:54:21.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:21 smithi191 ceph-mon[31636]: pgmap v18315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:54:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:23 smithi170 ceph-mon[31212]: pgmap v18316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:54:23.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34174.013175 secs 2024-04-21T19:54:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:23 smithi077 ceph-mon[27902]: pgmap v18316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:54:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34174.013175 secs 2024-04-21T19:54:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:23 smithi191 ceph-mon[31636]: pgmap v18316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:54:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34174.013175 secs 2024-04-21T19:54:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34175.770804 secs 2024-04-21T19:54:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:24 smithi191 ceph-mon[31636]: pgmap v18317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34175.770804 secs 2024-04-21T19:54:25.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:24 smithi170 ceph-mon[31212]: pgmap v18317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34175.770804 secs 2024-04-21T19:54:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:24 smithi077 ceph-mon[27902]: pgmap v18317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:27.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:27 smithi077 ceph-mon[27902]: pgmap v18318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:27 smithi191 ceph-mon[31636]: pgmap v18318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:27.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:27 smithi170 ceph-mon[31212]: pgmap v18318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:28.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34179.013258 secs 2024-04-21T19:54:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34179.013258 secs 2024-04-21T19:54:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34179.013258 secs 2024-04-21T19:54:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:29 smithi077 ceph-mon[27902]: pgmap v18319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:29 smithi191 ceph-mon[31636]: pgmap v18319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:29 smithi170 ceph-mon[31212]: pgmap v18319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34180.770949 secs 2024-04-21T19:54:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34180.770949 secs 2024-04-21T19:54:30.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34180.770949 secs 2024-04-21T19:54:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:31 smithi077 ceph-mon[27902]: pgmap v18320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:31.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:31 smithi191 ceph-mon[31636]: pgmap v18320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:31 smithi170 ceph-mon[31212]: pgmap v18320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:33 smithi077 ceph-mon[27902]: pgmap v18321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34184.013335 secs 2024-04-21T19:54:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:33 smithi191 ceph-mon[31636]: pgmap v18321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34184.013335 secs 2024-04-21T19:54:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:33 smithi170 ceph-mon[31212]: pgmap v18321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34184.013335 secs 2024-04-21T19:54:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34185.771028 secs 2024-04-21T19:54:35.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:35 smithi077 ceph-mon[27902]: pgmap v18322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34185.771028 secs 2024-04-21T19:54:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:35 smithi191 ceph-mon[31636]: pgmap v18322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:35.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34185.771028 secs 2024-04-21T19:54:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:35 smithi170 ceph-mon[31212]: pgmap v18322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:37.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:37 smithi077 ceph-mon[27902]: pgmap v18323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:37.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:37 smithi191 ceph-mon[31636]: pgmap v18323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:37.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:37 smithi170 ceph-mon[31212]: pgmap v18323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34189.013472 secs 2024-04-21T19:54:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34189.013472 secs 2024-04-21T19:54:38.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34189.013472 secs 2024-04-21T19:54:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:39 smithi077 ceph-mon[27902]: pgmap v18324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:39 smithi191 ceph-mon[31636]: pgmap v18324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:39.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:39 smithi170 ceph-mon[31212]: pgmap v18324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34190.771105 secs 2024-04-21T19:54:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34190.771105 secs 2024-04-21T19:54:40.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34190.771105 secs 2024-04-21T19:54:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:41 smithi191 ceph-mon[31636]: pgmap v18325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:41.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:41 smithi170 ceph-mon[31212]: pgmap v18325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:41.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:41 smithi077 ceph-mon[27902]: pgmap v18325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:43 smithi191 ceph-mon[31636]: pgmap v18326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:43.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34194.013613 secs 2024-04-21T19:54:43.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:43 smithi170 ceph-mon[31212]: pgmap v18326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34194.013613 secs 2024-04-21T19:54:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:43 smithi077 ceph-mon[27902]: pgmap v18326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:43.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34194.013613 secs 2024-04-21T19:54:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34195.771181 secs 2024-04-21T19:54:45.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:45 smithi191 ceph-mon[31636]: pgmap v18327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34195.771181 secs 2024-04-21T19:54:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:45 smithi170 ceph-mon[31212]: pgmap v18327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34195.771181 secs 2024-04-21T19:54:45.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:45 smithi077 ceph-mon[27902]: pgmap v18327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:47 smithi191 ceph-mon[31636]: pgmap v18328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:47 smithi170 ceph-mon[31212]: pgmap v18328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:47.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:47 smithi077 ceph-mon[27902]: pgmap v18328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:48.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34199.013703 secs 2024-04-21T19:54:48.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34199.013703 secs 2024-04-21T19:54:48.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34199.013703 secs 2024-04-21T19:54:49.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:49 smithi191 ceph-mon[31636]: pgmap v18329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:49.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:49 smithi170 ceph-mon[31212]: pgmap v18329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:49 smithi077 ceph-mon[27902]: pgmap v18329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:50.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34200.771302 secs 2024-04-21T19:54:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34200.771302 secs 2024-04-21T19:54:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34200.771302 secs 2024-04-21T19:54:51.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:51 smithi191 ceph-mon[31636]: pgmap v18330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:54:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:51.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:51 smithi170 ceph-mon[31212]: pgmap v18330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:54:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:51 smithi077 ceph-mon[27902]: pgmap v18330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:54:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:51.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:54:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:54:52.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:52.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:54:52.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:54:52.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:52.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:54:52.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:54:52.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:54:53.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:53 smithi191 ceph-mon[31636]: pgmap v18331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34204.013849 secs 2024-04-21T19:54:53.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:53 smithi170 ceph-mon[31212]: pgmap v18331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34204.013849 secs 2024-04-21T19:54:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:53 smithi077 ceph-mon[27902]: pgmap v18331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:53.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34204.013849 secs 2024-04-21T19:54:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:54:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34205.771430 secs 2024-04-21T19:54:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:55 smithi191 ceph-mon[31636]: pgmap v18332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:55.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34205.771430 secs 2024-04-21T19:54:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:55 smithi170 ceph-mon[31212]: pgmap v18332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34205.771430 secs 2024-04-21T19:54:55.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:55 smithi077 ceph-mon[27902]: pgmap v18332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:57.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:57 smithi191 ceph-mon[31636]: pgmap v18333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:57.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:57 smithi170 ceph-mon[31212]: pgmap v18333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:57.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:57 smithi077 ceph-mon[27902]: pgmap v18333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:54:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34209.013961 secs 2024-04-21T19:54:58.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34209.013961 secs 2024-04-21T19:54:58.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34209.013961 secs 2024-04-21T19:54:59.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:54:59 smithi191 ceph-mon[31636]: pgmap v18334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:59.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:54:59 smithi077 ceph-mon[27902]: pgmap v18334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:54:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:54:59 smithi170 ceph-mon[31212]: pgmap v18334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:00.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34210.771526 secs 2024-04-21T19:55:00.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34210.771526 secs 2024-04-21T19:55:00.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34210.771526 secs 2024-04-21T19:55:01.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:01 smithi191 ceph-mon[31636]: pgmap v18335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:01 smithi170 ceph-mon[31212]: pgmap v18335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:01.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:01 smithi077 ceph-mon[27902]: pgmap v18335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:03.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:03 smithi191 ceph-mon[31636]: pgmap v18336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34214.014027 secs 2024-04-21T19:55:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:03 smithi170 ceph-mon[31212]: pgmap v18336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34214.014027 secs 2024-04-21T19:55:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:03 smithi077 ceph-mon[27902]: pgmap v18336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:03.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34214.014027 secs 2024-04-21T19:55:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34215.771650 secs 2024-04-21T19:55:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:05 smithi191 ceph-mon[31636]: pgmap v18337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:05.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:05 smithi191 ceph-mon[31636]: osdmap e1218: 12 total, 12 up, 12 in 2024-04-21T19:55:05.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34215.771650 secs 2024-04-21T19:55:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:05 smithi170 ceph-mon[31212]: pgmap v18337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:05 smithi170 ceph-mon[31212]: osdmap e1218: 12 total, 12 up, 12 in 2024-04-21T19:55:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34215.771650 secs 2024-04-21T19:55:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:05 smithi077 ceph-mon[27902]: pgmap v18337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:05 smithi077 ceph-mon[27902]: osdmap e1218: 12 total, 12 up, 12 in 2024-04-21T19:55:07.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:07 smithi191 ceph-mon[31636]: pgmap v18339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:55:07.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:07 smithi170 ceph-mon[31212]: pgmap v18339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:55:07.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:07 smithi077 ceph-mon[27902]: pgmap v18339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:55:08.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34219.014147 secs 2024-04-21T19:55:08.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34219.014147 secs 2024-04-21T19:55:08.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34219.014147 secs 2024-04-21T19:55:09.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:09 smithi191 ceph-mon[31636]: pgmap v18340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:55:09.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:09 smithi191 ceph-mon[31636]: osdmap e1219: 12 total, 12 up, 12 in 2024-04-21T19:55:09.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:09 smithi170 ceph-mon[31212]: pgmap v18340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:55:09.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:09 smithi170 ceph-mon[31212]: osdmap e1219: 12 total, 12 up, 12 in 2024-04-21T19:55:09.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:09 smithi077 ceph-mon[27902]: pgmap v18340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:55:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:09 smithi077 ceph-mon[27902]: osdmap e1219: 12 total, 12 up, 12 in 2024-04-21T19:55:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:10.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34220.771769 secs 2024-04-21T19:55:10.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34220.771769 secs 2024-04-21T19:55:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34220.771769 secs 2024-04-21T19:55:11.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:11 smithi191 ceph-mon[31636]: pgmap v18342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:55:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:11 smithi170 ceph-mon[31212]: pgmap v18342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:55:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:11 smithi077 ceph-mon[27902]: pgmap v18342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:55:13.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:13 smithi191 ceph-mon[31636]: pgmap v18343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:55:13.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34224.014272 secs 2024-04-21T19:55:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:13 smithi170 ceph-mon[31212]: pgmap v18343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:55:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34224.014272 secs 2024-04-21T19:55:13.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:13 smithi077 ceph-mon[27902]: pgmap v18343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:55:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34224.014272 secs 2024-04-21T19:55:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34225.771898 secs 2024-04-21T19:55:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:15 smithi170 ceph-mon[31212]: pgmap v18344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:55:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34225.771898 secs 2024-04-21T19:55:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:15 smithi077 ceph-mon[27902]: pgmap v18344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:55:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34225.771898 secs 2024-04-21T19:55:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:15 smithi191 ceph-mon[31636]: pgmap v18344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T19:55:17.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:17 smithi170 ceph-mon[31212]: pgmap v18345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:55:17.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:17 smithi077 ceph-mon[27902]: pgmap v18345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:55:17.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:17 smithi191 ceph-mon[31636]: pgmap v18345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:55:18.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34229.014409 secs 2024-04-21T19:55:18.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34229.014409 secs 2024-04-21T19:55:18.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34229.014409 secs 2024-04-21T19:55:19.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:19 smithi170 ceph-mon[31212]: pgmap v18346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:55:19.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:19 smithi077 ceph-mon[27902]: pgmap v18346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:55:19.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:19 smithi191 ceph-mon[31636]: pgmap v18346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:55:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:20.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34230.771963 secs 2024-04-21T19:55:20.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34230.771963 secs 2024-04-21T19:55:20.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34230.771963 secs 2024-04-21T19:55:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:21 smithi170 ceph-mon[31212]: pgmap v18347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:55:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:21 smithi077 ceph-mon[27902]: pgmap v18347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:55:21.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:21 smithi191 ceph-mon[31636]: pgmap v18347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:55:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:23 smithi170 ceph-mon[31212]: pgmap v18348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:55:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34234.014543 secs 2024-04-21T19:55:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:23 smithi077 ceph-mon[27902]: pgmap v18348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:55:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34234.014543 secs 2024-04-21T19:55:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:23 smithi191 ceph-mon[31636]: pgmap v18348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:55:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34234.014543 secs 2024-04-21T19:55:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34235.772081 secs 2024-04-21T19:55:25.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:24 smithi191 ceph-mon[31636]: pgmap v18349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:25.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34235.772081 secs 2024-04-21T19:55:25.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:24 smithi170 ceph-mon[31212]: pgmap v18349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:25.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34235.772081 secs 2024-04-21T19:55:25.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:24 smithi077 ceph-mon[27902]: pgmap v18349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:27.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:27 smithi077 ceph-mon[27902]: pgmap v18350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:27.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:27 smithi191 ceph-mon[31636]: pgmap v18350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:27.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:27 smithi170 ceph-mon[31212]: pgmap v18350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:28.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34239.014656 secs 2024-04-21T19:55:28.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34239.014656 secs 2024-04-21T19:55:28.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34239.014656 secs 2024-04-21T19:55:29.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:29 smithi077 ceph-mon[27902]: pgmap v18351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:29.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:29 smithi191 ceph-mon[31636]: pgmap v18351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:29.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:29 smithi170 ceph-mon[31212]: pgmap v18351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34240.772200 secs 2024-04-21T19:55:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34240.772200 secs 2024-04-21T19:55:30.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34240.772200 secs 2024-04-21T19:55:31.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:31 smithi077 ceph-mon[27902]: pgmap v18352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:31.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:31 smithi191 ceph-mon[31636]: pgmap v18352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:31.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:31 smithi170 ceph-mon[31212]: pgmap v18352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:33.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:33 smithi077 ceph-mon[27902]: pgmap v18353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:33.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34244.014796 secs 2024-04-21T19:55:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:33 smithi191 ceph-mon[31636]: pgmap v18353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34244.014796 secs 2024-04-21T19:55:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:33 smithi170 ceph-mon[31212]: pgmap v18353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34244.014796 secs 2024-04-21T19:55:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:35.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34245.772318 secs 2024-04-21T19:55:35.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:35 smithi077 ceph-mon[27902]: pgmap v18354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:35.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34245.772318 secs 2024-04-21T19:55:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:35 smithi191 ceph-mon[31636]: pgmap v18354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34245.772318 secs 2024-04-21T19:55:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:35 smithi170 ceph-mon[31212]: pgmap v18354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:37.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:37 smithi191 ceph-mon[31636]: pgmap v18355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:37.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:37 smithi170 ceph-mon[31212]: pgmap v18355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:37.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:37 smithi077 ceph-mon[27902]: pgmap v18355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:38.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34249.014860 secs 2024-04-21T19:55:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34249.014860 secs 2024-04-21T19:55:38.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34249.014860 secs 2024-04-21T19:55:39.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:39 smithi191 ceph-mon[31636]: pgmap v18356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:39.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:39 smithi170 ceph-mon[31212]: pgmap v18356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:39.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:39 smithi077 ceph-mon[27902]: pgmap v18356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:40.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34250.772434 secs 2024-04-21T19:55:40.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34250.772434 secs 2024-04-21T19:55:40.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34250.772434 secs 2024-04-21T19:55:41.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:41 smithi077 ceph-mon[27902]: pgmap v18357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:41.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:41 smithi191 ceph-mon[31636]: pgmap v18357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:41.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:41 smithi170 ceph-mon[31212]: pgmap v18357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:43 smithi191 ceph-mon[31636]: pgmap v18358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34254.014950 secs 2024-04-21T19:55:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:43 smithi170 ceph-mon[31212]: pgmap v18358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34254.014950 secs 2024-04-21T19:55:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:43 smithi077 ceph-mon[27902]: pgmap v18358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:55:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34254.014950 secs 2024-04-21T19:55:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34255.772529 secs 2024-04-21T19:55:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:45 smithi191 ceph-mon[31636]: pgmap v18359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34255.772529 secs 2024-04-21T19:55:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:45 smithi170 ceph-mon[31212]: pgmap v18359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34255.772529 secs 2024-04-21T19:55:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:45 smithi077 ceph-mon[27902]: pgmap v18359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:47 smithi191 ceph-mon[31636]: pgmap v18360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:47 smithi170 ceph-mon[31212]: pgmap v18360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:47.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:47 smithi077 ceph-mon[27902]: pgmap v18360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:48.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34259.015063 secs 2024-04-21T19:55:48.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34259.015063 secs 2024-04-21T19:55:48.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34259.015063 secs 2024-04-21T19:55:49.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:49 smithi191 ceph-mon[31636]: pgmap v18361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:49 smithi170 ceph-mon[31212]: pgmap v18361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:49.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:49 smithi077 ceph-mon[27902]: pgmap v18361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34260.772629 secs 2024-04-21T19:55:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34260.772629 secs 2024-04-21T19:55:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34260.772629 secs 2024-04-21T19:55:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:51 smithi191 ceph-mon[31636]: pgmap v18362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:51 smithi170 ceph-mon[31212]: pgmap v18362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:51 smithi077 ceph-mon[27902]: pgmap v18362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:55:52.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:55:52.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:55:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: pgmap v18363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34264.015126 secs 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:55:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: pgmap v18363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34264.015126 secs 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:55:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:55:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: pgmap v18363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34264.015126 secs 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:55:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:55:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:55:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:55:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34265.772738 secs 2024-04-21T19:55:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:55 smithi170 ceph-mon[31212]: pgmap v18364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34265.772738 secs 2024-04-21T19:55:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:55 smithi077 ceph-mon[27902]: pgmap v18364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:55.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34265.772738 secs 2024-04-21T19:55:55.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:55 smithi191 ceph-mon[31636]: pgmap v18364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T19:55:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:57 smithi170 ceph-mon[31212]: pgmap v18365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:57.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:57 smithi077 ceph-mon[27902]: pgmap v18365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:57.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:57 smithi191 ceph-mon[31636]: pgmap v18365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T19:55:58.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34269.015246 secs 2024-04-21T19:55:58.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34269.015246 secs 2024-04-21T19:55:58.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34269.015246 secs 2024-04-21T19:55:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:55:59.092+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:55:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:55:59.092+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:55:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:55:59.092+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:55:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:55:59.092+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:55:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:59 smithi170 ceph-mon[31212]: pgmap v18366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:55:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34270.772880 secs 2024-04-21T19:55:59.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:59 smithi077 ceph-mon[27902]: pgmap v18366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:59.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:55:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34270.772880 secs 2024-04-21T19:55:59.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:59 smithi191 ceph-mon[31636]: pgmap v18366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:55:59.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:55:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34270.772880 secs 2024-04-21T19:56:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:01 smithi170 ceph-mon[31212]: pgmap v18367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:01.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:01 smithi077 ceph-mon[27902]: pgmap v18367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:01 smithi191 ceph-mon[31636]: pgmap v18367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:03 smithi077 ceph-mon[27902]: pgmap v18368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34274.015381 secs 2024-04-21T19:56:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:03 smithi191 ceph-mon[31636]: pgmap v18368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34274.015381 secs 2024-04-21T19:56:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:03 smithi170 ceph-mon[31212]: pgmap v18368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34274.015381 secs 2024-04-21T19:56:04.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34275.773001 secs 2024-04-21T19:56:04.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34275.773001 secs 2024-04-21T19:56:04.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34275.773001 secs 2024-04-21T19:56:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:05.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:05 smithi077 ceph-mon[27902]: pgmap v18369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:05 smithi077 ceph-mon[27902]: osdmap e1220: 12 total, 12 up, 12 in 2024-04-21T19:56:05.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:05 smithi191 ceph-mon[31636]: pgmap v18369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:05.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:05 smithi191 ceph-mon[31636]: osdmap e1220: 12 total, 12 up, 12 in 2024-04-21T19:56:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:05 smithi170 ceph-mon[31212]: pgmap v18369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:05 smithi170 ceph-mon[31212]: osdmap e1220: 12 total, 12 up, 12 in 2024-04-21T19:56:07.615 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:07 smithi170 ceph-mon[31212]: pgmap v18371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:56:07.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:07 smithi077 ceph-mon[27902]: pgmap v18371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:56:07.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:07 smithi191 ceph-mon[31636]: pgmap v18371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:56:08.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34279.015476 secs 2024-04-21T19:56:08.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34279.015476 secs 2024-04-21T19:56:08.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34279.015476 secs 2024-04-21T19:56:09.625 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:09 smithi191 ceph-mon[31636]: pgmap v18372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:56:09.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34280.773070 secs 2024-04-21T19:56:09.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:09 smithi191 ceph-mon[31636]: osdmap e1221: 12 total, 12 up, 12 in 2024-04-21T19:56:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:09 smithi077 ceph-mon[27902]: pgmap v18372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:56:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34280.773070 secs 2024-04-21T19:56:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:09 smithi077 ceph-mon[27902]: osdmap e1221: 12 total, 12 up, 12 in 2024-04-21T19:56:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:09 smithi170 ceph-mon[31212]: pgmap v18372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:56:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34280.773070 secs 2024-04-21T19:56:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:09 smithi170 ceph-mon[31212]: osdmap e1221: 12 total, 12 up, 12 in 2024-04-21T19:56:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:11 smithi077 ceph-mon[27902]: pgmap v18374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:56:11.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:11 smithi191 ceph-mon[31636]: pgmap v18374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:56:11.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:11 smithi170 ceph-mon[31212]: pgmap v18374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:56:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:13 smithi077 ceph-mon[27902]: pgmap v18375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:56:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34284.015554 secs 2024-04-21T19:56:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:13 smithi191 ceph-mon[31636]: pgmap v18375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:56:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34284.015554 secs 2024-04-21T19:56:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:13 smithi170 ceph-mon[31212]: pgmap v18375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:56:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34284.015554 secs 2024-04-21T19:56:14.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34285.773150 secs 2024-04-21T19:56:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34285.773150 secs 2024-04-21T19:56:14.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34285.773150 secs 2024-04-21T19:56:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:15 smithi077 ceph-mon[27902]: pgmap v18376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:56:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:15 smithi191 ceph-mon[31636]: pgmap v18376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:56:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:15 smithi170 ceph-mon[31212]: pgmap v18376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:56:17.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:17 smithi077 ceph-mon[27902]: pgmap v18377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:56:17.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:17 smithi191 ceph-mon[31636]: pgmap v18377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:56:17.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:17 smithi170 ceph-mon[31212]: pgmap v18377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:56:18.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34289.015669 secs 2024-04-21T19:56:18.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34289.015669 secs 2024-04-21T19:56:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34289.015669 secs 2024-04-21T19:56:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:19 smithi077 ceph-mon[27902]: pgmap v18378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:56:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34290.773262 secs 2024-04-21T19:56:19.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:19 smithi191 ceph-mon[31636]: pgmap v18378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:56:19.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34290.773262 secs 2024-04-21T19:56:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:19 smithi170 ceph-mon[31212]: pgmap v18378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:56:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34290.773262 secs 2024-04-21T19:56:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:21.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:21 smithi077 ceph-mon[27902]: pgmap v18379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:56:21.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:21 smithi191 ceph-mon[31636]: pgmap v18379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:56:21.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:21 smithi170 ceph-mon[31212]: pgmap v18379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:56:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:23 smithi077 ceph-mon[27902]: pgmap v18380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:56:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34294.015746 secs 2024-04-21T19:56:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:23 smithi191 ceph-mon[31636]: pgmap v18380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:56:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34294.015746 secs 2024-04-21T19:56:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:23 smithi170 ceph-mon[31212]: pgmap v18380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:56:23.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34294.015746 secs 2024-04-21T19:56:24.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34295.773343 secs 2024-04-21T19:56:24.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34295.773343 secs 2024-04-21T19:56:24.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34295.773343 secs 2024-04-21T19:56:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:25 smithi077 ceph-mon[27902]: pgmap v18381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:25.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:25 smithi191 ceph-mon[31636]: pgmap v18381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:25.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:25 smithi170 ceph-mon[31212]: pgmap v18381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:26.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:26 smithi077 ceph-mon[27902]: pgmap v18382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:26.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:26 smithi191 ceph-mon[31636]: pgmap v18382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:26.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:26 smithi170 ceph-mon[31212]: pgmap v18382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:27.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34299.015861 secs 2024-04-21T19:56:27.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34299.015861 secs 2024-04-21T19:56:28.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34299.015861 secs 2024-04-21T19:56:28.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:28 smithi077 ceph-mon[27902]: pgmap v18383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:28 smithi191 ceph-mon[31636]: pgmap v18383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:28 smithi170 ceph-mon[31212]: pgmap v18383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:29.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34300.773462 secs 2024-04-21T19:56:29.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34300.773462 secs 2024-04-21T19:56:30.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34300.773462 secs 2024-04-21T19:56:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:30 smithi077 ceph-mon[27902]: pgmap v18384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:30 smithi191 ceph-mon[31636]: pgmap v18384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:30 smithi170 ceph-mon[31212]: pgmap v18384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:33.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:33 smithi077 ceph-mon[27902]: pgmap v18385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:33.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34304.015934 secs 2024-04-21T19:56:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:33 smithi191 ceph-mon[31636]: pgmap v18385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:33.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34304.015934 secs 2024-04-21T19:56:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:33 smithi170 ceph-mon[31212]: pgmap v18385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34304.015934 secs 2024-04-21T19:56:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:35.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34305.773592 secs 2024-04-21T19:56:35.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:35 smithi077 ceph-mon[27902]: pgmap v18386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34305.773592 secs 2024-04-21T19:56:35.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:35 smithi191 ceph-mon[31636]: pgmap v18386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34305.773592 secs 2024-04-21T19:56:35.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:35 smithi170 ceph-mon[31212]: pgmap v18386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:37.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:37 smithi191 ceph-mon[31636]: pgmap v18387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:37.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:37 smithi170 ceph-mon[31212]: pgmap v18387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:37.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:37 smithi077 ceph-mon[27902]: pgmap v18387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:38.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34309.016015 secs 2024-04-21T19:56:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34309.016015 secs 2024-04-21T19:56:38.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34309.016015 secs 2024-04-21T19:56:39.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:39 smithi191 ceph-mon[31636]: pgmap v18388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:39.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:39 smithi170 ceph-mon[31212]: pgmap v18388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:39.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:39 smithi077 ceph-mon[27902]: pgmap v18388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:40.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34310.773703 secs 2024-04-21T19:56:40.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34310.773703 secs 2024-04-21T19:56:40.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34310.773703 secs 2024-04-21T19:56:41.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:41 smithi191 ceph-mon[31636]: pgmap v18389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:41.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:41 smithi170 ceph-mon[31212]: pgmap v18389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:41.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:41 smithi077 ceph-mon[27902]: pgmap v18389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:43.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:43 smithi191 ceph-mon[31636]: pgmap v18390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:43.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34314.016092 secs 2024-04-21T19:56:43.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:43 smithi170 ceph-mon[31212]: pgmap v18390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:43.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34314.016092 secs 2024-04-21T19:56:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:43 smithi077 ceph-mon[27902]: pgmap v18390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34314.016092 secs 2024-04-21T19:56:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34315.773813 secs 2024-04-21T19:56:45.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:45 smithi191 ceph-mon[31636]: pgmap v18391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:45.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34315.773813 secs 2024-04-21T19:56:45.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:45 smithi170 ceph-mon[31212]: pgmap v18391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34315.773813 secs 2024-04-21T19:56:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:45 smithi077 ceph-mon[27902]: pgmap v18391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:47.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:47 smithi191 ceph-mon[31636]: pgmap v18392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:47.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:47 smithi170 ceph-mon[31212]: pgmap v18392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:47.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:47 smithi077 ceph-mon[27902]: pgmap v18392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:48.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34319.016202 secs 2024-04-21T19:56:48.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34319.016202 secs 2024-04-21T19:56:48.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34319.016202 secs 2024-04-21T19:56:49.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:49 smithi191 ceph-mon[31636]: pgmap v18393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:49.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:49 smithi170 ceph-mon[31212]: pgmap v18393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:49.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:49 smithi077 ceph-mon[27902]: pgmap v18393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:50.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34320.773920 secs 2024-04-21T19:56:50.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34320.773920 secs 2024-04-21T19:56:50.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34320.773920 secs 2024-04-21T19:56:51.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:51 smithi191 ceph-mon[31636]: pgmap v18394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:51.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:51 smithi170 ceph-mon[31212]: pgmap v18394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:51.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:51 smithi077 ceph-mon[27902]: pgmap v18394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:56:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:53 smithi191 ceph-mon[31636]: pgmap v18395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:53.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34324.016264 secs 2024-04-21T19:56:53.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:56:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:53 smithi170 ceph-mon[31212]: pgmap v18395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:53.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34324.016264 secs 2024-04-21T19:56:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:56:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:53 smithi077 ceph-mon[27902]: pgmap v18395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34324.016264 secs 2024-04-21T19:56:53.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:56:54.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:56:54.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:56:54.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:56:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:56:54.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:56:54.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:56:54.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:56:54.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:56:54.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:56:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:56:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34325.773999 secs 2024-04-21T19:56:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:55 smithi191 ceph-mon[31636]: pgmap v18396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:56:55.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34325.773999 secs 2024-04-21T19:56:55.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:55 smithi170 ceph-mon[31212]: pgmap v18396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:56:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34325.773999 secs 2024-04-21T19:56:55.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:55 smithi077 ceph-mon[27902]: pgmap v18396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:56:57.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:57 smithi191 ceph-mon[31636]: pgmap v18397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:57.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:57 smithi170 ceph-mon[31212]: pgmap v18397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:57.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:57 smithi077 ceph-mon[27902]: pgmap v18397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:56:58.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34329.016405 secs 2024-04-21T19:56:58.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34329.016405 secs 2024-04-21T19:56:58.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34329.016405 secs 2024-04-21T19:56:59.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:56:59 smithi191 ceph-mon[31636]: pgmap v18398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:56:59.542 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:56:59 smithi077 ceph-mon[27902]: pgmap v18398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:56:59.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:56:59 smithi170 ceph-mon[31212]: pgmap v18398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:57:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:00.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34330.774135 secs 2024-04-21T19:57:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34330.774135 secs 2024-04-21T19:57:00.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34330.774135 secs 2024-04-21T19:57:01.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:01 smithi191 ceph-mon[31636]: pgmap v18399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:57:01.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:01 smithi170 ceph-mon[31212]: pgmap v18399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:57:01.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:01 smithi077 ceph-mon[27902]: pgmap v18399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T19:57:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:03 smithi191 ceph-mon[31636]: pgmap v18400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T19:57:03.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34334.016542 secs 2024-04-21T19:57:03.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:03 smithi170 ceph-mon[31212]: pgmap v18400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T19:57:03.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34334.016542 secs 2024-04-21T19:57:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:03 smithi077 ceph-mon[27902]: pgmap v18400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T19:57:03.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34334.016542 secs 2024-04-21T19:57:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34335.774267 secs 2024-04-21T19:57:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:05 smithi191 ceph-mon[31636]: pgmap v18401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T19:57:05.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:05 smithi191 ceph-mon[31636]: osdmap e1222: 12 total, 12 up, 12 in 2024-04-21T19:57:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34335.774267 secs 2024-04-21T19:57:05.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:05 smithi170 ceph-mon[31212]: pgmap v18401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T19:57:05.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:05 smithi170 ceph-mon[31212]: osdmap e1222: 12 total, 12 up, 12 in 2024-04-21T19:57:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34335.774267 secs 2024-04-21T19:57:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:05 smithi077 ceph-mon[27902]: pgmap v18401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-04-21T19:57:05.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:05 smithi077 ceph-mon[27902]: osdmap e1222: 12 total, 12 up, 12 in 2024-04-21T19:57:07.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:07 smithi170 ceph-mon[31212]: pgmap v18403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:57:07.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:07 smithi077 ceph-mon[27902]: pgmap v18403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:57:07.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:07 smithi191 ceph-mon[31636]: pgmap v18403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:57:08.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34339.016664 secs 2024-04-21T19:57:08.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34339.016664 secs 2024-04-21T19:57:08.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34339.016664 secs 2024-04-21T19:57:09.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:09 smithi170 ceph-mon[31212]: pgmap v18404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:57:09.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:09 smithi170 ceph-mon[31212]: osdmap e1223: 12 total, 12 up, 12 in 2024-04-21T19:57:09.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:09 smithi191 ceph-mon[31636]: pgmap v18404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:57:09.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:09 smithi191 ceph-mon[31636]: osdmap e1223: 12 total, 12 up, 12 in 2024-04-21T19:57:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:09 smithi077 ceph-mon[27902]: pgmap v18404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:57:09.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:09 smithi077 ceph-mon[27902]: osdmap e1223: 12 total, 12 up, 12 in 2024-04-21T19:57:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:10.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34340.774406 secs 2024-04-21T19:57:10.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34340.774406 secs 2024-04-21T19:57:10.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34340.774406 secs 2024-04-21T19:57:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:11 smithi170 ceph-mon[31212]: pgmap v18406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T19:57:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:11 smithi077 ceph-mon[27902]: pgmap v18406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T19:57:11.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:11 smithi191 ceph-mon[31636]: pgmap v18406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T19:57:13.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:13 smithi170 ceph-mon[31212]: pgmap v18407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-21T19:57:13.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34344.016786 secs 2024-04-21T19:57:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:13 smithi077 ceph-mon[27902]: pgmap v18407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-21T19:57:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34344.016786 secs 2024-04-21T19:57:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:13 smithi191 ceph-mon[31636]: pgmap v18407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-21T19:57:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34344.016786 secs 2024-04-21T19:57:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:15.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34345.774535 secs 2024-04-21T19:57:15.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:15 smithi170 ceph-mon[31212]: pgmap v18408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T19:57:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34345.774535 secs 2024-04-21T19:57:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:15 smithi077 ceph-mon[27902]: pgmap v18408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T19:57:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34345.774535 secs 2024-04-21T19:57:15.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:15 smithi191 ceph-mon[31636]: pgmap v18408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T19:57:17.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:17 smithi170 ceph-mon[31212]: pgmap v18409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:57:17.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:17 smithi077 ceph-mon[27902]: pgmap v18409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:57:17.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:17 smithi191 ceph-mon[31636]: pgmap v18409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:57:18.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34349.016902 secs 2024-04-21T19:57:18.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34349.016902 secs 2024-04-21T19:57:18.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34349.016902 secs 2024-04-21T19:57:19.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:19 smithi170 ceph-mon[31212]: pgmap v18410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:57:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:19 smithi077 ceph-mon[27902]: pgmap v18410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:57:19.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:19 smithi191 ceph-mon[31636]: pgmap v18410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:57:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:20.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34350.774596 secs 2024-04-21T19:57:20.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34350.774596 secs 2024-04-21T19:57:20.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34350.774596 secs 2024-04-21T19:57:21.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:21 smithi170 ceph-mon[31212]: pgmap v18411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:57:21.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:21 smithi077 ceph-mon[27902]: pgmap v18411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:57:21.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:21 smithi191 ceph-mon[31636]: pgmap v18411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:57:23.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:23 smithi170 ceph-mon[31212]: pgmap v18412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:57:23.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34354.017017 secs 2024-04-21T19:57:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:23 smithi077 ceph-mon[27902]: pgmap v18412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:57:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34354.017017 secs 2024-04-21T19:57:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:23 smithi191 ceph-mon[31636]: pgmap v18412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:57:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34354.017017 secs 2024-04-21T19:57:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:25.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34355.774708 secs 2024-04-21T19:57:25.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:25 smithi170 ceph-mon[31212]: pgmap v18413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34355.774708 secs 2024-04-21T19:57:25.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:25 smithi077 ceph-mon[27902]: pgmap v18413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:25.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34355.774708 secs 2024-04-21T19:57:25.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:25 smithi191 ceph-mon[31636]: pgmap v18413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:27.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:27 smithi170 ceph-mon[31212]: pgmap v18414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:27.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:27 smithi077 ceph-mon[27902]: pgmap v18414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:27.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:27 smithi191 ceph-mon[31636]: pgmap v18414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:28.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34359.017129 secs 2024-04-21T19:57:28.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34359.017129 secs 2024-04-21T19:57:28.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34359.017129 secs 2024-04-21T19:57:29.543 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:29 smithi077 ceph-mon[27902]: pgmap v18415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:29.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:29 smithi170 ceph-mon[31212]: pgmap v18415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:29.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:29 smithi191 ceph-mon[31636]: pgmap v18415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:30.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34360.774824 secs 2024-04-21T19:57:30.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34360.774824 secs 2024-04-21T19:57:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34360.774824 secs 2024-04-21T19:57:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:31 smithi170 ceph-mon[31212]: pgmap v18416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:31.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:31 smithi077 ceph-mon[27902]: pgmap v18416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:31.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:31 smithi191 ceph-mon[31636]: pgmap v18416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:33.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:33 smithi170 ceph-mon[31212]: pgmap v18417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:33.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34364.017265 secs 2024-04-21T19:57:33.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:33 smithi077 ceph-mon[27902]: pgmap v18417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:33.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34364.017265 secs 2024-04-21T19:57:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:33 smithi191 ceph-mon[31636]: pgmap v18417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:33.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34364.017265 secs 2024-04-21T19:57:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:35.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34365.774936 secs 2024-04-21T19:57:35.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:35 smithi170 ceph-mon[31212]: pgmap v18418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:35.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34365.774936 secs 2024-04-21T19:57:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:35 smithi077 ceph-mon[27902]: pgmap v18418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:35.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34365.774936 secs 2024-04-21T19:57:35.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:35 smithi191 ceph-mon[31636]: pgmap v18418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:37.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:37 smithi170 ceph-mon[31212]: pgmap v18419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:37.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:37 smithi077 ceph-mon[27902]: pgmap v18419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:37.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:37 smithi191 ceph-mon[31636]: pgmap v18419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:38.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34369.017338 secs 2024-04-21T19:57:38.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34369.017338 secs 2024-04-21T19:57:38.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34369.017338 secs 2024-04-21T19:57:39.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:39 smithi170 ceph-mon[31212]: pgmap v18420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:39.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:39 smithi191 ceph-mon[31636]: pgmap v18420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:39.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:39 smithi077 ceph-mon[27902]: pgmap v18420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:40.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34370.775090 secs 2024-04-21T19:57:40.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34370.775090 secs 2024-04-21T19:57:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34370.775090 secs 2024-04-21T19:57:41.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:41 smithi077 ceph-mon[27902]: pgmap v18421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:41.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:41 smithi191 ceph-mon[31636]: pgmap v18421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:41.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:41 smithi170 ceph-mon[31212]: pgmap v18421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:43.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:43 smithi077 ceph-mon[27902]: pgmap v18422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34374.017486 secs 2024-04-21T19:57:43.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:43 smithi191 ceph-mon[31636]: pgmap v18422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34374.017486 secs 2024-04-21T19:57:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:43 smithi170 ceph-mon[31212]: pgmap v18422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34374.017486 secs 2024-04-21T19:57:44.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34375.775167 secs 2024-04-21T19:57:44.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34375.775167 secs 2024-04-21T19:57:44.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34375.775167 secs 2024-04-21T19:57:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:45.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:45 smithi077 ceph-mon[27902]: pgmap v18423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:45.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:45 smithi191 ceph-mon[31636]: pgmap v18423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:45.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:45 smithi170 ceph-mon[31212]: pgmap v18423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:47.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:47 smithi077 ceph-mon[27902]: pgmap v18424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:47.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:47 smithi191 ceph-mon[31636]: pgmap v18424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:47.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:47 smithi170 ceph-mon[31212]: pgmap v18424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:48.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34379.017581 secs 2024-04-21T19:57:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34379.017581 secs 2024-04-21T19:57:48.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34379.017581 secs 2024-04-21T19:57:49.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:49 smithi077 ceph-mon[27902]: pgmap v18425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:49.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34380.775285 secs 2024-04-21T19:57:49.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:49 smithi191 ceph-mon[31636]: pgmap v18425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:49.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34380.775285 secs 2024-04-21T19:57:49.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:49 smithi170 ceph-mon[31212]: pgmap v18425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:49.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34380.775285 secs 2024-04-21T19:57:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:51 smithi077 ceph-mon[27902]: pgmap v18426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:51.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:51 smithi191 ceph-mon[31636]: pgmap v18426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:51.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:51 smithi170 ceph-mon[31212]: pgmap v18426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:53 smithi077 ceph-mon[27902]: pgmap v18427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34384.017698 secs 2024-04-21T19:57:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:53 smithi191 ceph-mon[31636]: pgmap v18427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34384.017698 secs 2024-04-21T19:57:53.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:53 smithi170 ceph-mon[31212]: pgmap v18427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:53.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34384.017698 secs 2024-04-21T19:57:54.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:57:54.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34385.775353 secs 2024-04-21T19:57:54.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:57:54.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34385.775353 secs 2024-04-21T19:57:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:57:54.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34385.775353 secs 2024-04-21T19:57:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:57:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:55 smithi077 ceph-mon[27902]: pgmap v18428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:57:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:57:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:57:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:55 smithi191 ceph-mon[31636]: pgmap v18428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:57:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:57:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:57:55.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:55 smithi170 ceph-mon[31212]: pgmap v18428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:55.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:57:55.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:57:55.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:57:57.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:57 smithi077 ceph-mon[27902]: pgmap v18429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:57.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:57 smithi191 ceph-mon[31636]: pgmap v18429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:57.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:57 smithi170 ceph-mon[31212]: pgmap v18429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:57:58.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34389.017822 secs 2024-04-21T19:57:58.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34389.017822 secs 2024-04-21T19:57:58.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34389.017822 secs 2024-04-21T19:57:59.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:59 smithi077 ceph-mon[27902]: pgmap v18430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:59.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:57:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34390.775487 secs 2024-04-21T19:57:59.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:59 smithi191 ceph-mon[31636]: pgmap v18430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:59.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:57:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34390.775487 secs 2024-04-21T19:57:59.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:59 smithi170 ceph-mon[31212]: pgmap v18430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:57:59.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:57:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34390.775487 secs 2024-04-21T19:58:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:01.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:01 smithi077 ceph-mon[27902]: pgmap v18431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:01.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:01 smithi191 ceph-mon[31636]: pgmap v18431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:01.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:01 smithi170 ceph-mon[31212]: pgmap v18431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:03.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:03 smithi077 ceph-mon[27902]: pgmap v18432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:03.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34394.017941 secs 2024-04-21T19:58:03.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:03 smithi191 ceph-mon[31636]: pgmap v18432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:03.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34394.017941 secs 2024-04-21T19:58:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:03 smithi170 ceph-mon[31212]: pgmap v18432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34394.017941 secs 2024-04-21T19:58:04.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34395.775602 secs 2024-04-21T19:58:04.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34395.775602 secs 2024-04-21T19:58:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34395.775602 secs 2024-04-21T19:58:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:05.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:05 smithi077 ceph-mon[27902]: pgmap v18433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:05.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:05 smithi077 ceph-mon[27902]: osdmap e1224: 12 total, 12 up, 12 in 2024-04-21T19:58:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:05 smithi191 ceph-mon[31636]: pgmap v18433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:05 smithi191 ceph-mon[31636]: osdmap e1224: 12 total, 12 up, 12 in 2024-04-21T19:58:05.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:05 smithi170 ceph-mon[31212]: pgmap v18433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:05.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:05 smithi170 ceph-mon[31212]: osdmap e1224: 12 total, 12 up, 12 in 2024-04-21T19:58:07.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:07 smithi077 ceph-mon[27902]: pgmap v18435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:58:07.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:07 smithi191 ceph-mon[31636]: pgmap v18435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:58:07.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:07 smithi170 ceph-mon[31212]: pgmap v18435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:58:08.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34399.018074 secs 2024-04-21T19:58:08.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34399.018074 secs 2024-04-21T19:58:08.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34399.018074 secs 2024-04-21T19:58:09.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:09 smithi077 ceph-mon[27902]: pgmap v18436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:58:09.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34400.775700 secs 2024-04-21T19:58:09.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:09 smithi077 ceph-mon[27902]: osdmap e1225: 12 total, 12 up, 12 in 2024-04-21T19:58:09.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:09 smithi191 ceph-mon[31636]: pgmap v18436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:58:09.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34400.775700 secs 2024-04-21T19:58:09.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:09 smithi191 ceph-mon[31636]: osdmap e1225: 12 total, 12 up, 12 in 2024-04-21T19:58:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:09 smithi170 ceph-mon[31212]: pgmap v18436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T19:58:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34400.775700 secs 2024-04-21T19:58:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:09 smithi170 ceph-mon[31212]: osdmap e1225: 12 total, 12 up, 12 in 2024-04-21T19:58:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:10.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:10 smithi077 ceph-mon[27902]: pgmap v18438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:58:10.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:10 smithi191 ceph-mon[31636]: pgmap v18438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:58:10.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:10 smithi170 ceph-mon[31212]: pgmap v18438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T19:58:13.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:13 smithi191 ceph-mon[31636]: pgmap v18439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:58:13.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34404.018159 secs 2024-04-21T19:58:13.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:13 smithi170 ceph-mon[31212]: pgmap v18439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:58:13.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34404.018159 secs 2024-04-21T19:58:13.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:13 smithi077 ceph-mon[27902]: pgmap v18439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T19:58:13.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34404.018159 secs 2024-04-21T19:58:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:14.110+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:58:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:14.110+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:58:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:14.110+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:58:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:14.110+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:58:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:15.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34405.775832 secs 2024-04-21T19:58:15.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:15 smithi191 ceph-mon[31636]: pgmap v18440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:58:15.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34405.775832 secs 2024-04-21T19:58:15.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:15 smithi170 ceph-mon[31212]: pgmap v18440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:58:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34405.775832 secs 2024-04-21T19:58:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:15 smithi077 ceph-mon[27902]: pgmap v18440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-21T19:58:17.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:17 smithi191 ceph-mon[31636]: pgmap v18441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:58:17.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:17 smithi170 ceph-mon[31212]: pgmap v18441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:58:17.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:17 smithi077 ceph-mon[27902]: pgmap v18441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:58:18.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34409.018282 secs 2024-04-21T19:58:18.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34409.018282 secs 2024-04-21T19:58:18.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34409.018282 secs 2024-04-21T19:58:19.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:19 smithi191 ceph-mon[31636]: pgmap v18442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:58:19.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:19 smithi170 ceph-mon[31212]: pgmap v18442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:58:19.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:19 smithi077 ceph-mon[27902]: pgmap v18442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:58:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:20.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34410.775950 secs 2024-04-21T19:58:20.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34410.775950 secs 2024-04-21T19:58:20.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34410.775950 secs 2024-04-21T19:58:21.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:21 smithi191 ceph-mon[31636]: pgmap v18443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:58:21.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:21 smithi170 ceph-mon[31212]: pgmap v18443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:58:21.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:21 smithi077 ceph-mon[27902]: pgmap v18443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:58:23.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:23 smithi191 ceph-mon[31636]: pgmap v18444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:58:23.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34414.018374 secs 2024-04-21T19:58:23.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:23 smithi170 ceph-mon[31212]: pgmap v18444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:58:23.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34414.018374 secs 2024-04-21T19:58:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:23 smithi077 ceph-mon[27902]: pgmap v18444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:58:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34414.018374 secs 2024-04-21T19:58:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:25.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34415.776069 secs 2024-04-21T19:58:25.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:25 smithi191 ceph-mon[31636]: pgmap v18445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:25.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34415.776069 secs 2024-04-21T19:58:25.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:25 smithi170 ceph-mon[31212]: pgmap v18445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:25.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34415.776069 secs 2024-04-21T19:58:25.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:25 smithi077 ceph-mon[27902]: pgmap v18445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:27.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:27 smithi191 ceph-mon[31636]: pgmap v18446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:27.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:27 smithi170 ceph-mon[31212]: pgmap v18446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:27.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:27 smithi077 ceph-mon[27902]: pgmap v18446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:28.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34419.018491 secs 2024-04-21T19:58:28.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34419.018491 secs 2024-04-21T19:58:28.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34419.018491 secs 2024-04-21T19:58:29.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:29 smithi191 ceph-mon[31636]: pgmap v18447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:29.543 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:29 smithi077 ceph-mon[27902]: pgmap v18447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:29.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:29 smithi170 ceph-mon[31212]: pgmap v18447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:30.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34420.776205 secs 2024-04-21T19:58:30.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34420.776205 secs 2024-04-21T19:58:30.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34420.776205 secs 2024-04-21T19:58:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:31 smithi191 ceph-mon[31636]: pgmap v18448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:31 smithi170 ceph-mon[31212]: pgmap v18448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:31.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:31 smithi077 ceph-mon[27902]: pgmap v18448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:33.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:33 smithi191 ceph-mon[31636]: pgmap v18449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:33.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34424.018586 secs 2024-04-21T19:58:33.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:33 smithi170 ceph-mon[31212]: pgmap v18449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:33.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34424.018586 secs 2024-04-21T19:58:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:33 smithi077 ceph-mon[27902]: pgmap v18449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34424.018586 secs 2024-04-21T19:58:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:35.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34425.776280 secs 2024-04-21T19:58:35.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:35 smithi191 ceph-mon[31636]: pgmap v18450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:35.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34425.776280 secs 2024-04-21T19:58:35.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:35 smithi170 ceph-mon[31212]: pgmap v18450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34425.776280 secs 2024-04-21T19:58:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:35 smithi077 ceph-mon[27902]: pgmap v18450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:37.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:37 smithi191 ceph-mon[31636]: pgmap v18451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:37.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:37 smithi170 ceph-mon[31212]: pgmap v18451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:37.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:37 smithi077 ceph-mon[27902]: pgmap v18451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:38.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34429.018700 secs 2024-04-21T19:58:38.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34429.018700 secs 2024-04-21T19:58:38.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34429.018700 secs 2024-04-21T19:58:39.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:39 smithi170 ceph-mon[31212]: pgmap v18452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:39.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:39 smithi191 ceph-mon[31636]: pgmap v18452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:39.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:39 smithi077 ceph-mon[27902]: pgmap v18452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:40.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34430.776414 secs 2024-04-21T19:58:40.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34430.776414 secs 2024-04-21T19:58:40.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34430.776414 secs 2024-04-21T19:58:41.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:41 smithi170 ceph-mon[31212]: pgmap v18453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:41.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:41 smithi077 ceph-mon[27902]: pgmap v18453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:41.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:41 smithi191 ceph-mon[31636]: pgmap v18453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:43.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:43 smithi170 ceph-mon[31212]: pgmap v18454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:43.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34434.018816 secs 2024-04-21T19:58:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:43 smithi077 ceph-mon[27902]: pgmap v18454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34434.018816 secs 2024-04-21T19:58:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:43 smithi191 ceph-mon[31636]: pgmap v18454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34434.018816 secs 2024-04-21T19:58:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:45.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34435.776517 secs 2024-04-21T19:58:45.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:45 smithi170 ceph-mon[31212]: pgmap v18455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:45.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34435.776517 secs 2024-04-21T19:58:45.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:45 smithi077 ceph-mon[27902]: pgmap v18455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34435.776517 secs 2024-04-21T19:58:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:45 smithi191 ceph-mon[31636]: pgmap v18455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:47.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:47 smithi170 ceph-mon[31212]: pgmap v18456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:47.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:47 smithi077 ceph-mon[27902]: pgmap v18456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:47.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:47 smithi191 ceph-mon[31636]: pgmap v18456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:48.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34439.018926 secs 2024-04-21T19:58:48.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34439.018926 secs 2024-04-21T19:58:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34439.018926 secs 2024-04-21T19:58:49.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:49 smithi170 ceph-mon[31212]: pgmap v18457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:49.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:49 smithi077 ceph-mon[27902]: pgmap v18457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:49.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:49 smithi191 ceph-mon[31636]: pgmap v18457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:50.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:50.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34440.776629 secs 2024-04-21T19:58:50.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34440.776629 secs 2024-04-21T19:58:50.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34440.776629 secs 2024-04-21T19:58:51.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:51 smithi170 ceph-mon[31212]: pgmap v18458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:51 smithi077 ceph-mon[27902]: pgmap v18458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:51.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:51 smithi191 ceph-mon[31636]: pgmap v18458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:53.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:53 smithi170 ceph-mon[31212]: pgmap v18459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:53.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34444.019040 secs 2024-04-21T19:58:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:53 smithi077 ceph-mon[27902]: pgmap v18459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34444.019040 secs 2024-04-21T19:58:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:53 smithi191 ceph-mon[31636]: pgmap v18459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34444.019040 secs 2024-04-21T19:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.461+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T19:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.461+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T19:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.461+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.461+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T19:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.461+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.462+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T19:58:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.462+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T19:58:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T19:58:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T19:58:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd70054070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T19:58:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd70054070 comp rx=0 tx=0).stop 2024-04-21T19:58:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T19:58:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T19:58:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T19:58:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T19:58:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.532+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T19:58:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:54.533+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7efd70012b00 tx=0x7efd70034040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T19:58:55.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:58:55.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34445.776742 secs 2024-04-21T19:58:55.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:55 smithi170 ceph-mon[31212]: pgmap v18460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:55.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:58:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34445.776742 secs 2024-04-21T19:58:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:55 smithi077 ceph-mon[27902]: pgmap v18460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:58:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34445.776742 secs 2024-04-21T19:58:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:55 smithi191 ceph-mon[31636]: pgmap v18460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:58:56.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:58:56.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:58:56.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:58:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:58:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:58:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:58:56.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T19:58:56.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T19:58:56.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T19:58:57.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:57 smithi170 ceph-mon[31212]: pgmap v18461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:57.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:57 smithi077 ceph-mon[27902]: pgmap v18461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:57.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:57 smithi191 ceph-mon[31636]: pgmap v18461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:58:58.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34449.019155 secs 2024-04-21T19:58:58.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34449.019155 secs 2024-04-21T19:58:58.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34449.019155 secs 2024-04-21T19:58:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:59.115+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:58:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:59.115+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:58:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:59.116+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T19:58:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T19:58:59.116+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T19:58:59.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:58:59 smithi077 ceph-mon[27902]: pgmap v18462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:59.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:58:59 smithi191 ceph-mon[31636]: pgmap v18462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:58:59.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:58:59 smithi170 ceph-mon[31212]: pgmap v18462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:00.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34450.776879 secs 2024-04-21T19:59:00.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34450.776879 secs 2024-04-21T19:59:00.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34450.776879 secs 2024-04-21T19:59:01.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:01 smithi077 ceph-mon[27902]: pgmap v18463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:01.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:01 smithi191 ceph-mon[31636]: pgmap v18463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:01.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:01 smithi170 ceph-mon[31212]: pgmap v18463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:03 smithi077 ceph-mon[27902]: pgmap v18464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34454.019233 secs 2024-04-21T19:59:03.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:03 smithi191 ceph-mon[31636]: pgmap v18464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:03.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34454.019233 secs 2024-04-21T19:59:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:03 smithi170 ceph-mon[31212]: pgmap v18464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34454.019233 secs 2024-04-21T19:59:04.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34455.776970 secs 2024-04-21T19:59:04.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34455.776970 secs 2024-04-21T19:59:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34455.776970 secs 2024-04-21T19:59:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:05.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:05 smithi077 ceph-mon[27902]: pgmap v18465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:05.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:05 smithi077 ceph-mon[27902]: osdmap e1226: 12 total, 12 up, 12 in 2024-04-21T19:59:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:05 smithi191 ceph-mon[31636]: pgmap v18465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:05 smithi191 ceph-mon[31636]: osdmap e1226: 12 total, 12 up, 12 in 2024-04-21T19:59:05.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:05 smithi170 ceph-mon[31212]: pgmap v18465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:05.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:05 smithi170 ceph-mon[31212]: osdmap e1226: 12 total, 12 up, 12 in 2024-04-21T19:59:07.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:07 smithi170 ceph-mon[31212]: pgmap v18467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:59:07.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:07 smithi077 ceph-mon[27902]: pgmap v18467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:59:07.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:07 smithi191 ceph-mon[31636]: pgmap v18467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:59:08.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34459.019349 secs 2024-04-21T19:59:08.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34459.019349 secs 2024-04-21T19:59:08.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34459.019349 secs 2024-04-21T19:59:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:09 smithi191 ceph-mon[31636]: pgmap v18468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:59:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34460.777037 secs 2024-04-21T19:59:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:09 smithi191 ceph-mon[31636]: osdmap e1227: 12 total, 12 up, 12 in 2024-04-21T19:59:09.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:09 smithi077 ceph-mon[27902]: pgmap v18468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:59:09.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34460.777037 secs 2024-04-21T19:59:09.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:09 smithi077 ceph-mon[27902]: osdmap e1227: 12 total, 12 up, 12 in 2024-04-21T19:59:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:09 smithi170 ceph-mon[31212]: pgmap v18468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T19:59:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34460.777037 secs 2024-04-21T19:59:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:09 smithi170 ceph-mon[31212]: osdmap e1227: 12 total, 12 up, 12 in 2024-04-21T19:59:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:11.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:11 smithi077 ceph-mon[27902]: pgmap v18470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:59:11.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:11 smithi191 ceph-mon[31636]: pgmap v18470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:59:11.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:11 smithi170 ceph-mon[31212]: pgmap v18470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T19:59:13.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:13 smithi077 ceph-mon[27902]: pgmap v18471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:59:13.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34464.019467 secs 2024-04-21T19:59:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:13 smithi191 ceph-mon[31636]: pgmap v18471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:59:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34464.019467 secs 2024-04-21T19:59:13.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:13 smithi170 ceph-mon[31212]: pgmap v18471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T19:59:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34464.019467 secs 2024-04-21T19:59:14.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34465.777154 secs 2024-04-21T19:59:14.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34465.777154 secs 2024-04-21T19:59:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34465.777154 secs 2024-04-21T19:59:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:15 smithi077 ceph-mon[27902]: pgmap v18472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:59:15.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:15 smithi191 ceph-mon[31636]: pgmap v18472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:59:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:15 smithi170 ceph-mon[31212]: pgmap v18472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T19:59:17.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:17 smithi077 ceph-mon[27902]: pgmap v18473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:59:17.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:17 smithi191 ceph-mon[31636]: pgmap v18473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:59:17.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:17 smithi170 ceph-mon[31212]: pgmap v18473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:59:18.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34469.019585 secs 2024-04-21T19:59:18.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34469.019585 secs 2024-04-21T19:59:18.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34469.019585 secs 2024-04-21T19:59:19.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:19 smithi077 ceph-mon[27902]: pgmap v18474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:59:19.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34470.777273 secs 2024-04-21T19:59:19.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:19 smithi191 ceph-mon[31636]: pgmap v18474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:59:19.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34470.777273 secs 2024-04-21T19:59:19.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:19 smithi170 ceph-mon[31212]: pgmap v18474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T19:59:19.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34470.777273 secs 2024-04-21T19:59:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:21.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:21 smithi077 ceph-mon[27902]: pgmap v18475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:59:21.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:21 smithi191 ceph-mon[31636]: pgmap v18475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:59:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:21 smithi170 ceph-mon[31212]: pgmap v18475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T19:59:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:23 smithi077 ceph-mon[27902]: pgmap v18476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:59:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34474.019694 secs 2024-04-21T19:59:23.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:23 smithi191 ceph-mon[31636]: pgmap v18476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:59:23.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34474.019694 secs 2024-04-21T19:59:23.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:23 smithi170 ceph-mon[31212]: pgmap v18476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T19:59:23.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34474.019694 secs 2024-04-21T19:59:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:25.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34475.777383 secs 2024-04-21T19:59:25.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:25 smithi170 ceph-mon[31212]: pgmap v18477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:25.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34475.777383 secs 2024-04-21T19:59:25.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:25 smithi077 ceph-mon[27902]: pgmap v18477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:25.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34475.777383 secs 2024-04-21T19:59:25.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:25 smithi191 ceph-mon[31636]: pgmap v18477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:27.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:27 smithi191 ceph-mon[31636]: pgmap v18478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:27.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:27 smithi170 ceph-mon[31212]: pgmap v18478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:27.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:27 smithi077 ceph-mon[27902]: pgmap v18478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:28.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34479.019807 secs 2024-04-21T19:59:28.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34479.019807 secs 2024-04-21T19:59:28.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34479.019807 secs 2024-04-21T19:59:29.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:29 smithi191 ceph-mon[31636]: pgmap v18479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:29.544 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:29 smithi077 ceph-mon[27902]: pgmap v18479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:29.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:29 smithi170 ceph-mon[31212]: pgmap v18479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:30.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34480.777505 secs 2024-04-21T19:59:30.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34480.777505 secs 2024-04-21T19:59:30.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34480.777505 secs 2024-04-21T19:59:31.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:31 smithi191 ceph-mon[31636]: pgmap v18480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:31.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:31 smithi170 ceph-mon[31212]: pgmap v18480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:31.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:31 smithi077 ceph-mon[27902]: pgmap v18480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:33.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:33 smithi191 ceph-mon[31636]: pgmap v18481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:33.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34484.019916 secs 2024-04-21T19:59:33.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:33 smithi170 ceph-mon[31212]: pgmap v18481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:33.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34484.019916 secs 2024-04-21T19:59:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:33 smithi077 ceph-mon[27902]: pgmap v18481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34484.019916 secs 2024-04-21T19:59:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:35.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34485.777637 secs 2024-04-21T19:59:35.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:35 smithi191 ceph-mon[31636]: pgmap v18482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34485.777637 secs 2024-04-21T19:59:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:35 smithi170 ceph-mon[31212]: pgmap v18482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34485.777637 secs 2024-04-21T19:59:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:35 smithi077 ceph-mon[27902]: pgmap v18482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:37.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:37 smithi191 ceph-mon[31636]: pgmap v18483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:37.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:37 smithi170 ceph-mon[31212]: pgmap v18483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:37.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:37 smithi077 ceph-mon[27902]: pgmap v18483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:38.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34489.019995 secs 2024-04-21T19:59:38.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34489.019995 secs 2024-04-21T19:59:38.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34489.019995 secs 2024-04-21T19:59:39.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:39 smithi191 ceph-mon[31636]: pgmap v18484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:39.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:39 smithi170 ceph-mon[31212]: pgmap v18484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:39.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:39 smithi077 ceph-mon[27902]: pgmap v18484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:40.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34490.777733 secs 2024-04-21T19:59:40.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34490.777733 secs 2024-04-21T19:59:40.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34490.777733 secs 2024-04-21T19:59:41.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:41 smithi170 ceph-mon[31212]: pgmap v18485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:41.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:41 smithi077 ceph-mon[27902]: pgmap v18485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:41.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:41 smithi191 ceph-mon[31636]: pgmap v18485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:43.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:43 smithi170 ceph-mon[31212]: pgmap v18486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:43.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34494.020109 secs 2024-04-21T19:59:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:43 smithi077 ceph-mon[27902]: pgmap v18486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34494.020109 secs 2024-04-21T19:59:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:43 smithi191 ceph-mon[31636]: pgmap v18486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34494.020109 secs 2024-04-21T19:59:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:45.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34495.777847 secs 2024-04-21T19:59:45.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:45 smithi170 ceph-mon[31212]: pgmap v18487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:45.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34495.777847 secs 2024-04-21T19:59:45.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:45 smithi077 ceph-mon[27902]: pgmap v18487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:45.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34495.777847 secs 2024-04-21T19:59:45.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:45 smithi191 ceph-mon[31636]: pgmap v18487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:47.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:47 smithi170 ceph-mon[31212]: pgmap v18488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:47.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:47 smithi077 ceph-mon[27902]: pgmap v18488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:47.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:47 smithi191 ceph-mon[31636]: pgmap v18488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:48.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34499.020222 secs 2024-04-21T19:59:48.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34499.020222 secs 2024-04-21T19:59:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34499.020222 secs 2024-04-21T19:59:49.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:49 smithi170 ceph-mon[31212]: pgmap v18489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:49.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:49 smithi077 ceph-mon[27902]: pgmap v18489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:49.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:49 smithi191 ceph-mon[31636]: pgmap v18489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:50.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34500.777986 secs 2024-04-21T19:59:50.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34500.777986 secs 2024-04-21T19:59:50.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34500.777986 secs 2024-04-21T19:59:51.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:51 smithi170 ceph-mon[31212]: pgmap v18490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:51.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:51 smithi077 ceph-mon[27902]: pgmap v18490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:51.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:51 smithi191 ceph-mon[31636]: pgmap v18490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:53.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:53 smithi170 ceph-mon[31212]: pgmap v18491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:53.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34504.020335 secs 2024-04-21T19:59:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:53 smithi077 ceph-mon[27902]: pgmap v18491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34504.020335 secs 2024-04-21T19:59:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:53 smithi191 ceph-mon[31636]: pgmap v18491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34504.020335 secs 2024-04-21T19:59:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T19:59:55.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34505.778105 secs 2024-04-21T19:59:55.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:55 smithi170 ceph-mon[31212]: pgmap v18492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34505.778105 secs 2024-04-21T19:59:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:55 smithi077 ceph-mon[27902]: pgmap v18492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34505.778105 secs 2024-04-21T19:59:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:55 smithi191 ceph-mon[31636]: pgmap v18492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:56.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:59:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:59:56.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T19:59:57.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:57 smithi170 ceph-mon[31212]: pgmap v18493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:57.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:57 smithi077 ceph-mon[27902]: pgmap v18493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:57.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:57 smithi191 ceph-mon[31636]: pgmap v18493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T19:59:58.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34509.020484 secs 2024-04-21T19:59:58.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34509.020484 secs 2024-04-21T19:59:58.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34509.020484 secs 2024-04-21T19:59:59.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 19:59:59 smithi077 ceph-mon[27902]: pgmap v18494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:59.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 19:59:59 smithi170 ceph-mon[31212]: pgmap v18494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T19:59:59.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 19:59:59 smithi191 ceph-mon[31636]: pgmap v18494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34510.778221 secs 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34510.778221 secs 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:00:00.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34510.778221 secs 2024-04-21T20:00:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:00:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:00:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:00:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:00:01.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:01 smithi170 ceph-mon[31212]: pgmap v18495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:01.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:01 smithi077 ceph-mon[27902]: pgmap v18495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:01.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:01 smithi191 ceph-mon[31636]: pgmap v18495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:03.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:03 smithi170 ceph-mon[31212]: pgmap v18496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:03.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34514.020598 secs 2024-04-21T20:00:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:03 smithi077 ceph-mon[27902]: pgmap v18496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34514.020598 secs 2024-04-21T20:00:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:03 smithi191 ceph-mon[31636]: pgmap v18496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34514.020598 secs 2024-04-21T20:00:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:05.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34515.778335 secs 2024-04-21T20:00:05.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:05 smithi170 ceph-mon[31212]: pgmap v18497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:05.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:05 smithi170 ceph-mon[31212]: osdmap e1228: 12 total, 12 up, 12 in 2024-04-21T20:00:05.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34515.778335 secs 2024-04-21T20:00:05.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:05 smithi077 ceph-mon[27902]: pgmap v18497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:05.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:05 smithi077 ceph-mon[27902]: osdmap e1228: 12 total, 12 up, 12 in 2024-04-21T20:00:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34515.778335 secs 2024-04-21T20:00:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:05 smithi191 ceph-mon[31636]: pgmap v18497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:05 smithi191 ceph-mon[31636]: osdmap e1228: 12 total, 12 up, 12 in 2024-04-21T20:00:07.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:07 smithi170 ceph-mon[31212]: pgmap v18499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:00:07.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:07 smithi077 ceph-mon[27902]: pgmap v18499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:00:07.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:07 smithi191 ceph-mon[31636]: pgmap v18499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:00:08.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34519.020734 secs 2024-04-21T20:00:08.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34519.020734 secs 2024-04-21T20:00:08.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34519.020734 secs 2024-04-21T20:00:09.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:09 smithi170 ceph-mon[31212]: pgmap v18500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:00:09.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:09 smithi170 ceph-mon[31212]: osdmap e1229: 12 total, 12 up, 12 in 2024-04-21T20:00:09.566 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:09 smithi077 ceph-mon[27902]: pgmap v18500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:00:09.566 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:09 smithi077 ceph-mon[27902]: osdmap e1229: 12 total, 12 up, 12 in 2024-04-21T20:00:09.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:09 smithi191 ceph-mon[31636]: pgmap v18500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:00:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:09 smithi191 ceph-mon[31636]: osdmap e1229: 12 total, 12 up, 12 in 2024-04-21T20:00:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:10.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34520.778411 secs 2024-04-21T20:00:10.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34520.778411 secs 2024-04-21T20:00:10.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34520.778411 secs 2024-04-21T20:00:11.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:11 smithi170 ceph-mon[31212]: pgmap v18502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:00:11.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:11 smithi077 ceph-mon[27902]: pgmap v18502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:00:11.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:11 smithi191 ceph-mon[31636]: pgmap v18502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:00:13.571 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:13 smithi170 ceph-mon[31212]: pgmap v18503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:00:13.571 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34524.020842 secs 2024-04-21T20:00:13.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:13 smithi077 ceph-mon[27902]: pgmap v18503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:00:13.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34524.020842 secs 2024-04-21T20:00:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:13 smithi191 ceph-mon[31636]: pgmap v18503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:00:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34524.020842 secs 2024-04-21T20:00:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34525.778520 secs 2024-04-21T20:00:15.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:15 smithi077 ceph-mon[27902]: pgmap v18504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:00:15.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34525.778520 secs 2024-04-21T20:00:15.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:15 smithi191 ceph-mon[31636]: pgmap v18504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:00:15.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34525.778520 secs 2024-04-21T20:00:15.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:15 smithi170 ceph-mon[31212]: pgmap v18504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:00:17.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:17 smithi077 ceph-mon[27902]: pgmap v18505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:00:17.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:17 smithi191 ceph-mon[31636]: pgmap v18505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:00:17.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:17 smithi170 ceph-mon[31212]: pgmap v18505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:00:18.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34529.020955 secs 2024-04-21T20:00:18.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34529.020955 secs 2024-04-21T20:00:18.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34529.020955 secs 2024-04-21T20:00:19.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:19 smithi077 ceph-mon[27902]: pgmap v18506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:00:19.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:19 smithi191 ceph-mon[31636]: pgmap v18506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:00:19.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:19 smithi170 ceph-mon[31212]: pgmap v18506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:00:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:20.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34530.778643 secs 2024-04-21T20:00:20.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34530.778643 secs 2024-04-21T20:00:20.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34530.778643 secs 2024-04-21T20:00:21.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:21 smithi077 ceph-mon[27902]: pgmap v18507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:00:21.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:21 smithi191 ceph-mon[31636]: pgmap v18507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:00:21.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:21 smithi170 ceph-mon[31212]: pgmap v18507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:00:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:23 smithi077 ceph-mon[27902]: pgmap v18508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:00:23.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34534.021074 secs 2024-04-21T20:00:23.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:23 smithi191 ceph-mon[31636]: pgmap v18508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:00:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34534.021074 secs 2024-04-21T20:00:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:23 smithi170 ceph-mon[31212]: pgmap v18508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:00:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34534.021074 secs 2024-04-21T20:00:24.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34535.778775 secs 2024-04-21T20:00:24.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34535.778775 secs 2024-04-21T20:00:24.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34535.778775 secs 2024-04-21T20:00:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:25.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:25 smithi077 ceph-mon[27902]: pgmap v18509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:25.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:25 smithi191 ceph-mon[31636]: pgmap v18509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:25.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:25 smithi170 ceph-mon[31212]: pgmap v18509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:27.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:27 smithi191 ceph-mon[31636]: pgmap v18510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:27.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:27 smithi170 ceph-mon[31212]: pgmap v18510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:27.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:27 smithi077 ceph-mon[27902]: pgmap v18510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:28.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34539.021186 secs 2024-04-21T20:00:28.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34539.021186 secs 2024-04-21T20:00:28.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34539.021186 secs 2024-04-21T20:00:29.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:29 smithi191 ceph-mon[31636]: pgmap v18511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:29.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34540.778902 secs 2024-04-21T20:00:29.794 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:29 smithi077 ceph-mon[27902]: pgmap v18511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:29.794 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34540.778902 secs 2024-04-21T20:00:29.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:29 smithi170 ceph-mon[31212]: pgmap v18511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:29.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34540.778902 secs 2024-04-21T20:00:30.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:30.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:30 smithi191 ceph-mon[31636]: pgmap v18512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:30.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:30 smithi170 ceph-mon[31212]: pgmap v18512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:30.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:30 smithi077 ceph-mon[27902]: pgmap v18512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:33.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:33 smithi191 ceph-mon[31636]: pgmap v18513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:33.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34544.021319 secs 2024-04-21T20:00:33.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:33 smithi170 ceph-mon[31212]: pgmap v18513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:33.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34544.021319 secs 2024-04-21T20:00:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:33 smithi077 ceph-mon[27902]: pgmap v18513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34544.021319 secs 2024-04-21T20:00:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:35.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34545.779035 secs 2024-04-21T20:00:35.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:35 smithi191 ceph-mon[31636]: pgmap v18514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34545.779035 secs 2024-04-21T20:00:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:35 smithi170 ceph-mon[31212]: pgmap v18514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34545.779035 secs 2024-04-21T20:00:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:35 smithi077 ceph-mon[27902]: pgmap v18514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:37.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:37 smithi191 ceph-mon[31636]: pgmap v18515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:37.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:37 smithi170 ceph-mon[31212]: pgmap v18515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:37.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:37 smithi077 ceph-mon[27902]: pgmap v18515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:38.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34549.021464 secs 2024-04-21T20:00:38.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34549.021464 secs 2024-04-21T20:00:38.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34549.021464 secs 2024-04-21T20:00:39.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:39 smithi191 ceph-mon[31636]: pgmap v18516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:39.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:39 smithi170 ceph-mon[31212]: pgmap v18516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:39.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:39 smithi077 ceph-mon[27902]: pgmap v18516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:40.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:40.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34550.779154 secs 2024-04-21T20:00:40.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34550.779154 secs 2024-04-21T20:00:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34550.779154 secs 2024-04-21T20:00:41.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:41 smithi170 ceph-mon[31212]: pgmap v18517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:41.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:41 smithi077 ceph-mon[27902]: pgmap v18517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:41.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:41 smithi191 ceph-mon[31636]: pgmap v18517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:43.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:43 smithi170 ceph-mon[31212]: pgmap v18518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:43.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34554.021584 secs 2024-04-21T20:00:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:43 smithi077 ceph-mon[27902]: pgmap v18518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:43.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34554.021584 secs 2024-04-21T20:00:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:43 smithi191 ceph-mon[31636]: pgmap v18518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34554.021584 secs 2024-04-21T20:00:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:45.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34555.779266 secs 2024-04-21T20:00:45.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:45 smithi170 ceph-mon[31212]: pgmap v18519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:45.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34555.779266 secs 2024-04-21T20:00:45.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:45 smithi077 ceph-mon[27902]: pgmap v18519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34555.779266 secs 2024-04-21T20:00:45.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:45 smithi191 ceph-mon[31636]: pgmap v18519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:47.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:47 smithi170 ceph-mon[31212]: pgmap v18520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:47.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:47 smithi077 ceph-mon[27902]: pgmap v18520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:47.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:47 smithi191 ceph-mon[31636]: pgmap v18520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:48.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34559.021705 secs 2024-04-21T20:00:48.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34559.021705 secs 2024-04-21T20:00:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34559.021705 secs 2024-04-21T20:00:49.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:49 smithi170 ceph-mon[31212]: pgmap v18521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:49.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:49 smithi077 ceph-mon[27902]: pgmap v18521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:49.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:49 smithi191 ceph-mon[31636]: pgmap v18521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:50.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34560.779386 secs 2024-04-21T20:00:50.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34560.779386 secs 2024-04-21T20:00:50.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34560.779386 secs 2024-04-21T20:00:51.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:51 smithi170 ceph-mon[31212]: pgmap v18522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:51.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:51 smithi077 ceph-mon[27902]: pgmap v18522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:51.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:51 smithi191 ceph-mon[31636]: pgmap v18522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:53.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:53 smithi170 ceph-mon[31212]: pgmap v18523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:53.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34564.021776 secs 2024-04-21T20:00:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:53 smithi077 ceph-mon[27902]: pgmap v18523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34564.021776 secs 2024-04-21T20:00:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:53 smithi191 ceph-mon[31636]: pgmap v18523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34564.021776 secs 2024-04-21T20:00:55.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:00:55.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34565.779505 secs 2024-04-21T20:00:55.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:55 smithi170 ceph-mon[31212]: pgmap v18524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34565.779505 secs 2024-04-21T20:00:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:55 smithi077 ceph-mon[27902]: pgmap v18524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:55.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34565.779505 secs 2024-04-21T20:00:55.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:55 smithi191 ceph-mon[31636]: pgmap v18524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:57.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:57 smithi170 ceph-mon[31212]: pgmap v18525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:57.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:57 smithi077 ceph-mon[27902]: pgmap v18525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:57.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:57 smithi191 ceph-mon[31636]: pgmap v18525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:00:58.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34569.021884 secs 2024-04-21T20:00:58.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34569.021884 secs 2024-04-21T20:00:58.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34569.021884 secs 2024-04-21T20:00:59.544 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:00:59 smithi077 ceph-mon[27902]: pgmap v18526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:59.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:00:59 smithi170 ceph-mon[31212]: pgmap v18526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:00:59.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:00:59 smithi191 ceph-mon[31636]: pgmap v18526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34570.779622 secs 2024-04-21T20:01:00.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:01:00.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34570.779622 secs 2024-04-21T20:01:00.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:01:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34570.779622 secs 2024-04-21T20:01:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:01:01.392 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:01 smithi170 ceph-mon[31212]: pgmap v18527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:01.393 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:01 smithi191 ceph-mon[31636]: pgmap v18527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:01.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:01 smithi077 ceph-mon[27902]: pgmap v18527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34574.021950 secs 2024-04-21T20:01:03.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:03 smithi170 ceph-mon[31212]: pgmap v18528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34574.021950 secs 2024-04-21T20:01:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:03 smithi077 ceph-mon[27902]: pgmap v18528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34574.021950 secs 2024-04-21T20:01:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:03 smithi191 ceph-mon[31636]: pgmap v18528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:05.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:05.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34575.779689 secs 2024-04-21T20:01:05.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: pgmap v18529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:04 smithi170 ceph-mon[31212]: osdmap e1230: 12 total, 12 up, 12 in 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34575.779689 secs 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: pgmap v18529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:01:05.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:01:05.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:04 smithi077 ceph-mon[27902]: osdmap e1230: 12 total, 12 up, 12 in 2024-04-21T20:01:05.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34575.779689 secs 2024-04-21T20:01:05.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: pgmap v18529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:05.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:01:05.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:01:05.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:01:05.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:04 smithi191 ceph-mon[31636]: osdmap e1230: 12 total, 12 up, 12 in 2024-04-21T20:01:07.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:07 smithi191 ceph-mon[31636]: pgmap v18531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:01:07.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:07 smithi170 ceph-mon[31212]: pgmap v18531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:01:07.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:07 smithi077 ceph-mon[27902]: pgmap v18531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:01:08.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34579.022076 secs 2024-04-21T20:01:08.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34579.022076 secs 2024-04-21T20:01:08.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34579.022076 secs 2024-04-21T20:01:09.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:09 smithi191 ceph-mon[31636]: pgmap v18532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:01:09.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:09 smithi191 ceph-mon[31636]: osdmap e1231: 12 total, 12 up, 12 in 2024-04-21T20:01:09.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:09 smithi170 ceph-mon[31212]: pgmap v18532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:01:09.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:09 smithi170 ceph-mon[31212]: osdmap e1231: 12 total, 12 up, 12 in 2024-04-21T20:01:09.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:09 smithi077 ceph-mon[27902]: pgmap v18532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:01:09.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:09 smithi077 ceph-mon[27902]: osdmap e1231: 12 total, 12 up, 12 in 2024-04-21T20:01:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:10.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34580.779805 secs 2024-04-21T20:01:10.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34580.779805 secs 2024-04-21T20:01:10.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34580.779805 secs 2024-04-21T20:01:11.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:11 smithi170 ceph-mon[31212]: pgmap v18534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:01:11.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:11 smithi077 ceph-mon[27902]: pgmap v18534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:01:11.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:11 smithi191 ceph-mon[31636]: pgmap v18534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:01:13.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34584.022215 secs 2024-04-21T20:01:13.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:13 smithi170 ceph-mon[31212]: pgmap v18535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:01:13.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34584.022215 secs 2024-04-21T20:01:13.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:13 smithi077 ceph-mon[27902]: pgmap v18535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:01:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34584.022215 secs 2024-04-21T20:01:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:13 smithi191 ceph-mon[31636]: pgmap v18535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:01:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:15.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34585.779920 secs 2024-04-21T20:01:15.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:15 smithi170 ceph-mon[31212]: pgmap v18536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:01:15.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34585.779920 secs 2024-04-21T20:01:15.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:15 smithi077 ceph-mon[27902]: pgmap v18536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:01:15.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34585.779920 secs 2024-04-21T20:01:15.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:15 smithi191 ceph-mon[31636]: pgmap v18536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:01:17.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:17 smithi170 ceph-mon[31212]: pgmap v18537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:01:17.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:17 smithi077 ceph-mon[27902]: pgmap v18537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:01:17.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:17 smithi191 ceph-mon[31636]: pgmap v18537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:01:18.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34589.022341 secs 2024-04-21T20:01:18.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34589.022341 secs 2024-04-21T20:01:18.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34589.022341 secs 2024-04-21T20:01:19.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:19 smithi170 ceph-mon[31212]: pgmap v18538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:01:19.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:19 smithi077 ceph-mon[27902]: pgmap v18538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:01:19.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:19 smithi191 ceph-mon[31636]: pgmap v18538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:01:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:20.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34590.779984 secs 2024-04-21T20:01:20.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34590.779984 secs 2024-04-21T20:01:20.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34590.779984 secs 2024-04-21T20:01:21.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:21 smithi170 ceph-mon[31212]: pgmap v18539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:01:21.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:21 smithi077 ceph-mon[27902]: pgmap v18539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:01:21.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:21 smithi191 ceph-mon[31636]: pgmap v18539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:01:23.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34594.022490 secs 2024-04-21T20:01:23.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:23 smithi170 ceph-mon[31212]: pgmap v18540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:01:23.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34594.022490 secs 2024-04-21T20:01:23.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:23 smithi077 ceph-mon[27902]: pgmap v18540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:01:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34594.022490 secs 2024-04-21T20:01:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:23 smithi191 ceph-mon[31636]: pgmap v18540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:01:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:25.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34595.780104 secs 2024-04-21T20:01:25.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:25 smithi170 ceph-mon[31212]: pgmap v18541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:25.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34595.780104 secs 2024-04-21T20:01:25.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:25 smithi077 ceph-mon[27902]: pgmap v18541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:25.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34595.780104 secs 2024-04-21T20:01:25.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:25 smithi191 ceph-mon[31636]: pgmap v18541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:27.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:27 smithi170 ceph-mon[31212]: pgmap v18542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:27.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:27 smithi077 ceph-mon[27902]: pgmap v18542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:27.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:27 smithi191 ceph-mon[31636]: pgmap v18542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:28.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34599.022605 secs 2024-04-21T20:01:28.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34599.022605 secs 2024-04-21T20:01:28.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34599.022605 secs 2024-04-21T20:01:29.544 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:29 smithi077 ceph-mon[27902]: pgmap v18543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:29.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:29 smithi170 ceph-mon[31212]: pgmap v18543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:29.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:29 smithi191 ceph-mon[31636]: pgmap v18543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:30.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:30.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34600.780183 secs 2024-04-21T20:01:30.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34600.780183 secs 2024-04-21T20:01:30.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34600.780183 secs 2024-04-21T20:01:31.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:31 smithi170 ceph-mon[31212]: pgmap v18544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:31.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:31 smithi077 ceph-mon[27902]: pgmap v18544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:31.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:31 smithi191 ceph-mon[31636]: pgmap v18544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:33.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34604.022700 secs 2024-04-21T20:01:33.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:33 smithi170 ceph-mon[31212]: pgmap v18545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34604.022700 secs 2024-04-21T20:01:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:33 smithi077 ceph-mon[27902]: pgmap v18545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:33.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34604.022700 secs 2024-04-21T20:01:33.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:33 smithi191 ceph-mon[31636]: pgmap v18545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34605.780295 secs 2024-04-21T20:01:35.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:35 smithi170 ceph-mon[31212]: pgmap v18546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34605.780295 secs 2024-04-21T20:01:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:35 smithi077 ceph-mon[27902]: pgmap v18546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:35.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34605.780295 secs 2024-04-21T20:01:35.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:35 smithi191 ceph-mon[31636]: pgmap v18546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:37.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:37 smithi170 ceph-mon[31212]: pgmap v18547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:37.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:37 smithi077 ceph-mon[27902]: pgmap v18547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:37.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:37 smithi191 ceph-mon[31636]: pgmap v18547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:38.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34609.022796 secs 2024-04-21T20:01:38.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34609.022796 secs 2024-04-21T20:01:38.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34609.022796 secs 2024-04-21T20:01:39.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:39 smithi170 ceph-mon[31212]: pgmap v18548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:39.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:39 smithi191 ceph-mon[31636]: pgmap v18548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:39.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:39 smithi077 ceph-mon[27902]: pgmap v18548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:40.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:40.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34610.780431 secs 2024-04-21T20:01:40.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34610.780431 secs 2024-04-21T20:01:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34610.780431 secs 2024-04-21T20:01:41.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:41 smithi170 ceph-mon[31212]: pgmap v18549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:41.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:41 smithi077 ceph-mon[27902]: pgmap v18549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:41.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:41 smithi191 ceph-mon[31636]: pgmap v18549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:43.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34614.022914 secs 2024-04-21T20:01:43.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:43 smithi170 ceph-mon[31212]: pgmap v18550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:43.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34614.022914 secs 2024-04-21T20:01:43.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:43 smithi077 ceph-mon[27902]: pgmap v18550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34614.022914 secs 2024-04-21T20:01:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:43 smithi191 ceph-mon[31636]: pgmap v18550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:45.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34615.780562 secs 2024-04-21T20:01:45.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:45 smithi170 ceph-mon[31212]: pgmap v18551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:45.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34615.780562 secs 2024-04-21T20:01:45.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:45 smithi077 ceph-mon[27902]: pgmap v18551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:45.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34615.780562 secs 2024-04-21T20:01:45.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:45 smithi191 ceph-mon[31636]: pgmap v18551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:47.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:47 smithi170 ceph-mon[31212]: pgmap v18552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:47.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:47 smithi077 ceph-mon[27902]: pgmap v18552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:47.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:47 smithi191 ceph-mon[31636]: pgmap v18552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:48.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34619.023034 secs 2024-04-21T20:01:48.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34619.023034 secs 2024-04-21T20:01:48.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34619.023034 secs 2024-04-21T20:01:49.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:49 smithi170 ceph-mon[31212]: pgmap v18553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:49.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:49 smithi077 ceph-mon[27902]: pgmap v18553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:49.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:49 smithi191 ceph-mon[31636]: pgmap v18553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:50.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34620.780708 secs 2024-04-21T20:01:50.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34620.780708 secs 2024-04-21T20:01:50.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34620.780708 secs 2024-04-21T20:01:51.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:51 smithi170 ceph-mon[31212]: pgmap v18554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:51.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:51 smithi077 ceph-mon[27902]: pgmap v18554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:51.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:51 smithi191 ceph-mon[31636]: pgmap v18554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:53.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34624.023152 secs 2024-04-21T20:01:53.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:53 smithi170 ceph-mon[31212]: pgmap v18555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34624.023152 secs 2024-04-21T20:01:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:53 smithi077 ceph-mon[27902]: pgmap v18555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34624.023152 secs 2024-04-21T20:01:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:53 smithi191 ceph-mon[31636]: pgmap v18555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:01:55.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34625.780823 secs 2024-04-21T20:01:55.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:55 smithi170 ceph-mon[31212]: pgmap v18556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34625.780823 secs 2024-04-21T20:01:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:55 smithi077 ceph-mon[27902]: pgmap v18556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:55.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34625.780823 secs 2024-04-21T20:01:55.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:55 smithi191 ceph-mon[31636]: pgmap v18556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:57.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:57 smithi170 ceph-mon[31212]: pgmap v18557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:57.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:57 smithi077 ceph-mon[27902]: pgmap v18557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:57.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:57 smithi191 ceph-mon[31636]: pgmap v18557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:01:58.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34629.023270 secs 2024-04-21T20:01:58.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34629.023270 secs 2024-04-21T20:01:58.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34629.023270 secs 2024-04-21T20:01:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:01:59.142+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:01:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:01:59.142+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:01:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:01:59.142+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:01:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:01:59.142+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:01:59.545 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:01:59 smithi077 ceph-mon[27902]: pgmap v18558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:59.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:01:59 smithi170 ceph-mon[31212]: pgmap v18558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:01:59.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:01:59 smithi191 ceph-mon[31636]: pgmap v18558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:00.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34630.780935 secs 2024-04-21T20:02:00.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34630.780935 secs 2024-04-21T20:02:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34630.780935 secs 2024-04-21T20:02:01.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:01 smithi170 ceph-mon[31212]: pgmap v18559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:01.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:01 smithi077 ceph-mon[27902]: pgmap v18559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:01.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:01 smithi191 ceph-mon[31636]: pgmap v18559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:03.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34634.023388 secs 2024-04-21T20:02:03.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:03 smithi170 ceph-mon[31212]: pgmap v18560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:03.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34634.023388 secs 2024-04-21T20:02:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:03 smithi077 ceph-mon[27902]: pgmap v18560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34634.023388 secs 2024-04-21T20:02:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:03 smithi191 ceph-mon[31636]: pgmap v18560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34635.781050 secs 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: pgmap v18561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: osdmap e1232: 12 total, 12 up, 12 in 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:02:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:02:05.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34635.781050 secs 2024-04-21T20:02:05.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: pgmap v18561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: osdmap e1232: 12 total, 12 up, 12 in 2024-04-21T20:02:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:02:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:02:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:02:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:02:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34635.781050 secs 2024-04-21T20:02:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: pgmap v18561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: osdmap e1232: 12 total, 12 up, 12 in 2024-04-21T20:02:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:02:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:02:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:02:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:02:07.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:07 smithi170 ceph-mon[31212]: pgmap v18563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:02:07.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:07 smithi077 ceph-mon[27902]: pgmap v18563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:02:07.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:07 smithi191 ceph-mon[31636]: pgmap v18563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:02:08.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34639.023523 secs 2024-04-21T20:02:08.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34639.023523 secs 2024-04-21T20:02:08.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34639.023523 secs 2024-04-21T20:02:09.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:09 smithi170 ceph-mon[31212]: pgmap v18564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:02:09.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:09 smithi170 ceph-mon[31212]: osdmap e1233: 12 total, 12 up, 12 in 2024-04-21T20:02:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:09 smithi191 ceph-mon[31636]: pgmap v18564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:02:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:09 smithi191 ceph-mon[31636]: osdmap e1233: 12 total, 12 up, 12 in 2024-04-21T20:02:09.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:09 smithi077 ceph-mon[27902]: pgmap v18564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:02:09.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:09 smithi077 ceph-mon[27902]: osdmap e1233: 12 total, 12 up, 12 in 2024-04-21T20:02:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:10.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34640.781167 secs 2024-04-21T20:02:10.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34640.781167 secs 2024-04-21T20:02:10.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34640.781167 secs 2024-04-21T20:02:11.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:11 smithi170 ceph-mon[31212]: pgmap v18566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:02:11.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:11 smithi077 ceph-mon[27902]: pgmap v18566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:02:11.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:11 smithi191 ceph-mon[31636]: pgmap v18566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 29 op/s 2024-04-21T20:02:13.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34644.023655 secs 2024-04-21T20:02:13.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:13 smithi077 ceph-mon[27902]: pgmap v18567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:02:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34644.023655 secs 2024-04-21T20:02:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:13 smithi191 ceph-mon[31636]: pgmap v18567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:02:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34644.023655 secs 2024-04-21T20:02:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:13 smithi170 ceph-mon[31212]: pgmap v18567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:02:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:15.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34645.781291 secs 2024-04-21T20:02:15.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:15 smithi077 ceph-mon[27902]: pgmap v18568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:02:15.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34645.781291 secs 2024-04-21T20:02:15.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:15 smithi191 ceph-mon[31636]: pgmap v18568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:02:15.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34645.781291 secs 2024-04-21T20:02:15.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:15 smithi170 ceph-mon[31212]: pgmap v18568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:02:17.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:17 smithi077 ceph-mon[27902]: pgmap v18569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:02:17.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:17 smithi191 ceph-mon[31636]: pgmap v18569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:02:17.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:17 smithi170 ceph-mon[31212]: pgmap v18569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:02:18.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34649.023747 secs 2024-04-21T20:02:18.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34649.023747 secs 2024-04-21T20:02:18.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34649.023747 secs 2024-04-21T20:02:19.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:19 smithi077 ceph-mon[27902]: pgmap v18570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:02:19.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:19 smithi191 ceph-mon[31636]: pgmap v18570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:02:19.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:19 smithi170 ceph-mon[31212]: pgmap v18570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:02:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:20.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34650.781411 secs 2024-04-21T20:02:20.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34650.781411 secs 2024-04-21T20:02:20.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34650.781411 secs 2024-04-21T20:02:21.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:21 smithi077 ceph-mon[27902]: pgmap v18571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:02:21.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:21 smithi191 ceph-mon[31636]: pgmap v18571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:02:21.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:21 smithi170 ceph-mon[31212]: pgmap v18571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:02:23.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34654.023861 secs 2024-04-21T20:02:23.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:23 smithi077 ceph-mon[27902]: pgmap v18572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:02:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34654.023861 secs 2024-04-21T20:02:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:23 smithi191 ceph-mon[31636]: pgmap v18572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:02:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34654.023861 secs 2024-04-21T20:02:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:23 smithi170 ceph-mon[31212]: pgmap v18572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:02:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:25.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34655.781501 secs 2024-04-21T20:02:25.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:25 smithi077 ceph-mon[27902]: pgmap v18573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:25.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34655.781501 secs 2024-04-21T20:02:25.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:25 smithi191 ceph-mon[31636]: pgmap v18573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:25.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34655.781501 secs 2024-04-21T20:02:25.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:25 smithi170 ceph-mon[31212]: pgmap v18573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:27.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:27 smithi077 ceph-mon[27902]: pgmap v18574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:27.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:27 smithi191 ceph-mon[31636]: pgmap v18574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:27.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:27 smithi170 ceph-mon[31212]: pgmap v18574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:28.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34659.023981 secs 2024-04-21T20:02:28.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34659.023981 secs 2024-04-21T20:02:28.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34659.023981 secs 2024-04-21T20:02:29.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:29 smithi077 ceph-mon[27902]: pgmap v18575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:29.730 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:29 smithi191 ceph-mon[31636]: pgmap v18575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:29.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:29 smithi170 ceph-mon[31212]: pgmap v18575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:30.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34660.781615 secs 2024-04-21T20:02:30.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34660.781615 secs 2024-04-21T20:02:30.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34660.781615 secs 2024-04-21T20:02:31.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:31 smithi077 ceph-mon[27902]: pgmap v18576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:31.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:31 smithi191 ceph-mon[31636]: pgmap v18576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:31.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:31 smithi170 ceph-mon[31212]: pgmap v18576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:33.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34664.024096 secs 2024-04-21T20:02:33.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:33 smithi077 ceph-mon[27902]: pgmap v18577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:33.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34664.024096 secs 2024-04-21T20:02:33.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:33 smithi191 ceph-mon[31636]: pgmap v18577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:33.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34664.024096 secs 2024-04-21T20:02:33.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:33 smithi170 ceph-mon[31212]: pgmap v18577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:34.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34665.781686 secs 2024-04-21T20:02:34.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34665.781686 secs 2024-04-21T20:02:34.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34665.781686 secs 2024-04-21T20:02:35.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:35 smithi077 ceph-mon[27902]: pgmap v18578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:35.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:35 smithi191 ceph-mon[31636]: pgmap v18578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:35.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:35 smithi170 ceph-mon[31212]: pgmap v18578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:37.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:37 smithi077 ceph-mon[27902]: pgmap v18579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:37.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:37 smithi191 ceph-mon[31636]: pgmap v18579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:37.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:37 smithi170 ceph-mon[31212]: pgmap v18579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:38.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34669.024196 secs 2024-04-21T20:02:38.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34669.024196 secs 2024-04-21T20:02:38.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34669.024196 secs 2024-04-21T20:02:39.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:39 smithi077 ceph-mon[27902]: pgmap v18580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:39.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34670.781820 secs 2024-04-21T20:02:39.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:39 smithi191 ceph-mon[31636]: pgmap v18580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:39.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34670.781820 secs 2024-04-21T20:02:39.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:39 smithi170 ceph-mon[31212]: pgmap v18580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:39.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34670.781820 secs 2024-04-21T20:02:40.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:41.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:41 smithi077 ceph-mon[27902]: pgmap v18581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:41.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:41 smithi191 ceph-mon[31636]: pgmap v18581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:41.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:41 smithi170 ceph-mon[31212]: pgmap v18581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34674.024328 secs 2024-04-21T20:02:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:43 smithi077 ceph-mon[27902]: pgmap v18582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34674.024328 secs 2024-04-21T20:02:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:43 smithi191 ceph-mon[31636]: pgmap v18582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:43.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34674.024328 secs 2024-04-21T20:02:43.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:43 smithi170 ceph-mon[31212]: pgmap v18582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:44.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34675.781871 secs 2024-04-21T20:02:44.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34675.781871 secs 2024-04-21T20:02:44.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34675.781871 secs 2024-04-21T20:02:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:45.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:45 smithi191 ceph-mon[31636]: pgmap v18583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:45.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:45 smithi170 ceph-mon[31212]: pgmap v18583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:45.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:45 smithi077 ceph-mon[27902]: pgmap v18583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:47.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:47 smithi191 ceph-mon[31636]: pgmap v18584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:47.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:47 smithi170 ceph-mon[31212]: pgmap v18584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:47.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:47 smithi077 ceph-mon[27902]: pgmap v18584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:48.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34679.024432 secs 2024-04-21T20:02:48.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34679.024432 secs 2024-04-21T20:02:48.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34679.024432 secs 2024-04-21T20:02:49.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:49 smithi191 ceph-mon[31636]: pgmap v18585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:49.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34680.781990 secs 2024-04-21T20:02:49.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:49 smithi170 ceph-mon[31212]: pgmap v18585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:49.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34680.781990 secs 2024-04-21T20:02:49.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:49 smithi077 ceph-mon[27902]: pgmap v18585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:49.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34680.781990 secs 2024-04-21T20:02:50.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:51.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:51 smithi191 ceph-mon[31636]: pgmap v18586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:51.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:51 smithi170 ceph-mon[31212]: pgmap v18586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:51.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:51 smithi077 ceph-mon[27902]: pgmap v18586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34684.024566 secs 2024-04-21T20:02:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:53 smithi191 ceph-mon[31636]: pgmap v18587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:53.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34684.024566 secs 2024-04-21T20:02:53.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:53 smithi170 ceph-mon[31212]: pgmap v18587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:53.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34684.024566 secs 2024-04-21T20:02:53.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:53 smithi077 ceph-mon[27902]: pgmap v18587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:54.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34685.782106 secs 2024-04-21T20:02:54.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34685.782106 secs 2024-04-21T20:02:54.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34685.782106 secs 2024-04-21T20:02:55.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:02:55.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:55 smithi191 ceph-mon[31636]: pgmap v18588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:55.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:55 smithi170 ceph-mon[31212]: pgmap v18588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:55.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:55 smithi077 ceph-mon[27902]: pgmap v18588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:57.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:57 smithi191 ceph-mon[31636]: pgmap v18589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:57.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:57 smithi170 ceph-mon[31212]: pgmap v18589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:57.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:57 smithi077 ceph-mon[27902]: pgmap v18589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:02:58.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34689.024670 secs 2024-04-21T20:02:58.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:58 smithi191 ceph-mon[31636]: pgmap v18590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:58.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34689.024670 secs 2024-04-21T20:02:58.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:58 smithi170 ceph-mon[31212]: pgmap v18590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:58.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34689.024670 secs 2024-04-21T20:02:58.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:58 smithi077 ceph-mon[27902]: pgmap v18590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:02:59.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:02:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34690.782184 secs 2024-04-21T20:02:59.795 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:02:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34690.782184 secs 2024-04-21T20:02:59.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:02:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34690.782184 secs 2024-04-21T20:03:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:00 smithi191 ceph-mon[31636]: pgmap v18591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:00 smithi170 ceph-mon[31212]: pgmap v18591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:00.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:00 smithi077 ceph-mon[27902]: pgmap v18591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:03.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34694.024793 secs 2024-04-21T20:03:03.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:03 smithi170 ceph-mon[31212]: pgmap v18592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34694.024793 secs 2024-04-21T20:03:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:03 smithi077 ceph-mon[27902]: pgmap v18592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34694.024793 secs 2024-04-21T20:03:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:03 smithi191 ceph-mon[31636]: pgmap v18592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:05.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34695.782243 secs 2024-04-21T20:03:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:05 smithi170 ceph-mon[31212]: pgmap v18593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:05 smithi170 ceph-mon[31212]: osdmap e1234: 12 total, 12 up, 12 in 2024-04-21T20:03:05.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:03:05.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34695.782243 secs 2024-04-21T20:03:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:05 smithi077 ceph-mon[27902]: pgmap v18593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:05 smithi077 ceph-mon[27902]: osdmap e1234: 12 total, 12 up, 12 in 2024-04-21T20:03:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:03:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34695.782243 secs 2024-04-21T20:03:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:05 smithi191 ceph-mon[31636]: pgmap v18593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:05 smithi191 ceph-mon[31636]: osdmap e1234: 12 total, 12 up, 12 in 2024-04-21T20:03:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:03:06.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:03:06.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:03:06.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:03:06.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:03:06.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:03:06.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:03:06.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:03:06.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:03:06.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:03:07.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:07 smithi170 ceph-mon[31212]: pgmap v18595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:03:07.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:07 smithi077 ceph-mon[27902]: pgmap v18595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:03:07.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:07 smithi191 ceph-mon[31636]: pgmap v18595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:03:08.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34699.024946 secs 2024-04-21T20:03:08.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34699.024946 secs 2024-04-21T20:03:08.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34699.024946 secs 2024-04-21T20:03:09.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:09 smithi170 ceph-mon[31212]: pgmap v18596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:03:09.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:09 smithi170 ceph-mon[31212]: osdmap e1235: 12 total, 12 up, 12 in 2024-04-21T20:03:09.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:09 smithi191 ceph-mon[31636]: pgmap v18596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:03:09.628 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:09 smithi191 ceph-mon[31636]: osdmap e1235: 12 total, 12 up, 12 in 2024-04-21T20:03:09.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:09 smithi077 ceph-mon[27902]: pgmap v18596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:03:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:09 smithi077 ceph-mon[27902]: osdmap e1235: 12 total, 12 up, 12 in 2024-04-21T20:03:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:10.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34700.782363 secs 2024-04-21T20:03:10.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34700.782363 secs 2024-04-21T20:03:10.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34700.782363 secs 2024-04-21T20:03:11.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:11 smithi170 ceph-mon[31212]: pgmap v18598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T20:03:11.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:11 smithi077 ceph-mon[27902]: pgmap v18598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T20:03:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:11 smithi191 ceph-mon[31636]: pgmap v18598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-04-21T20:03:13.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34704.025042 secs 2024-04-21T20:03:13.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:13 smithi170 ceph-mon[31212]: pgmap v18599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:03:13.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34704.025042 secs 2024-04-21T20:03:13.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:13 smithi077 ceph-mon[27902]: pgmap v18599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:03:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34704.025042 secs 2024-04-21T20:03:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:13 smithi191 ceph-mon[31636]: pgmap v18599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:03:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:15.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34705.782477 secs 2024-04-21T20:03:15.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:15 smithi170 ceph-mon[31212]: pgmap v18600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:03:15.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34705.782477 secs 2024-04-21T20:03:15.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:15 smithi077 ceph-mon[27902]: pgmap v18600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:03:15.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34705.782477 secs 2024-04-21T20:03:15.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:15 smithi191 ceph-mon[31636]: pgmap v18600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:03:17.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:17 smithi170 ceph-mon[31212]: pgmap v18601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:03:17.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:17 smithi077 ceph-mon[27902]: pgmap v18601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:03:17.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:17 smithi191 ceph-mon[31636]: pgmap v18601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:03:18.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34709.025153 secs 2024-04-21T20:03:18.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34709.025153 secs 2024-04-21T20:03:18.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34709.025153 secs 2024-04-21T20:03:19.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:19 smithi170 ceph-mon[31212]: pgmap v18602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:03:19.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:19 smithi077 ceph-mon[27902]: pgmap v18602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:03:19.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:19 smithi191 ceph-mon[31636]: pgmap v18602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:03:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:20.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34710.782593 secs 2024-04-21T20:03:20.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34710.782593 secs 2024-04-21T20:03:20.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34710.782593 secs 2024-04-21T20:03:21.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:21 smithi170 ceph-mon[31212]: pgmap v18603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:03:21.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:21 smithi077 ceph-mon[27902]: pgmap v18603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:03:21.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:21 smithi191 ceph-mon[31636]: pgmap v18603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 5 op/s 2024-04-21T20:03:23.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34714.025288 secs 2024-04-21T20:03:23.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:23 smithi170 ceph-mon[31212]: pgmap v18604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:03:23.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34714.025288 secs 2024-04-21T20:03:23.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:23 smithi077 ceph-mon[27902]: pgmap v18604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:03:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34714.025288 secs 2024-04-21T20:03:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:23 smithi191 ceph-mon[31636]: pgmap v18604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T20:03:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:25.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34715.782705 secs 2024-04-21T20:03:25.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:25 smithi077 ceph-mon[27902]: pgmap v18605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:25.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34715.782705 secs 2024-04-21T20:03:25.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:25 smithi191 ceph-mon[31636]: pgmap v18605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:25.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34715.782705 secs 2024-04-21T20:03:25.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:25 smithi170 ceph-mon[31212]: pgmap v18605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:27.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:27 smithi170 ceph-mon[31212]: pgmap v18606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:27.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:27 smithi077 ceph-mon[27902]: pgmap v18606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:27.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:27 smithi191 ceph-mon[31636]: pgmap v18606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:28.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34719.025422 secs 2024-04-21T20:03:28.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34719.025422 secs 2024-04-21T20:03:28.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34719.025422 secs 2024-04-21T20:03:29.545 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:29 smithi077 ceph-mon[27902]: pgmap v18607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:29.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:29 smithi170 ceph-mon[31212]: pgmap v18607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:29.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:29 smithi191 ceph-mon[31636]: pgmap v18607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:30.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34720.782820 secs 2024-04-21T20:03:30.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34720.782820 secs 2024-04-21T20:03:30.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34720.782820 secs 2024-04-21T20:03:31.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:31 smithi170 ceph-mon[31212]: pgmap v18608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:31.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:31 smithi077 ceph-mon[27902]: pgmap v18608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:31.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:31 smithi191 ceph-mon[31636]: pgmap v18608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:33.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34724.025560 secs 2024-04-21T20:03:33.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:33 smithi170 ceph-mon[31212]: pgmap v18609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:33.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34724.025560 secs 2024-04-21T20:03:33.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:33 smithi077 ceph-mon[27902]: pgmap v18609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:33.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34724.025560 secs 2024-04-21T20:03:33.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:33 smithi191 ceph-mon[31636]: pgmap v18609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:35.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:35.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34725.782920 secs 2024-04-21T20:03:35.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:35 smithi170 ceph-mon[31212]: pgmap v18610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:35.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34725.782920 secs 2024-04-21T20:03:35.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:35 smithi077 ceph-mon[27902]: pgmap v18610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:35.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34725.782920 secs 2024-04-21T20:03:35.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:35 smithi191 ceph-mon[31636]: pgmap v18610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:37.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:37 smithi170 ceph-mon[31212]: pgmap v18611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:37.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:37 smithi077 ceph-mon[27902]: pgmap v18611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:37.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:37 smithi191 ceph-mon[31636]: pgmap v18611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:38.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34729.025675 secs 2024-04-21T20:03:38.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34729.025675 secs 2024-04-21T20:03:38.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34729.025675 secs 2024-04-21T20:03:39.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:39 smithi170 ceph-mon[31212]: pgmap v18612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:39.628 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:39 smithi191 ceph-mon[31636]: pgmap v18612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:39.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:39 smithi077 ceph-mon[27902]: pgmap v18612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:40.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:40.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34730.782984 secs 2024-04-21T20:03:40.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34730.782984 secs 2024-04-21T20:03:40.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34730.782984 secs 2024-04-21T20:03:41.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:41 smithi170 ceph-mon[31212]: pgmap v18613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:41.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:41 smithi077 ceph-mon[27902]: pgmap v18613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:41.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:41 smithi191 ceph-mon[31636]: pgmap v18613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:43.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34734.025830 secs 2024-04-21T20:03:43.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:43 smithi170 ceph-mon[31212]: pgmap v18614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34734.025830 secs 2024-04-21T20:03:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:43 smithi077 ceph-mon[27902]: pgmap v18614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34734.025830 secs 2024-04-21T20:03:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:43 smithi191 ceph-mon[31636]: pgmap v18614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:45.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34735.783106 secs 2024-04-21T20:03:45.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:45 smithi170 ceph-mon[31212]: pgmap v18615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:45.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34735.783106 secs 2024-04-21T20:03:45.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:45 smithi077 ceph-mon[27902]: pgmap v18615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:45.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34735.783106 secs 2024-04-21T20:03:45.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:45 smithi191 ceph-mon[31636]: pgmap v18615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:47.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:47 smithi170 ceph-mon[31212]: pgmap v18616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:47.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:47 smithi077 ceph-mon[27902]: pgmap v18616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:47.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:47 smithi191 ceph-mon[31636]: pgmap v18616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:48.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34739.025906 secs 2024-04-21T20:03:48.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34739.025906 secs 2024-04-21T20:03:48.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34739.025906 secs 2024-04-21T20:03:49.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:49 smithi077 ceph-mon[27902]: pgmap v18617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:49.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:49 smithi191 ceph-mon[31636]: pgmap v18617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:49.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:49 smithi170 ceph-mon[31212]: pgmap v18617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:50.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34740.783229 secs 2024-04-21T20:03:50.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34740.783229 secs 2024-04-21T20:03:50.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34740.783229 secs 2024-04-21T20:03:51.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:51 smithi077 ceph-mon[27902]: pgmap v18618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:51.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:51 smithi191 ceph-mon[31636]: pgmap v18618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:51.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:51 smithi170 ceph-mon[31212]: pgmap v18618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:03:53.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34744.025990 secs 2024-04-21T20:03:53.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:53 smithi077 ceph-mon[27902]: pgmap v18619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34744.025990 secs 2024-04-21T20:03:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:53 smithi191 ceph-mon[31636]: pgmap v18619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:53.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34744.025990 secs 2024-04-21T20:03:53.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:53 smithi170 ceph-mon[31212]: pgmap v18619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:03:55.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34745.783364 secs 2024-04-21T20:03:55.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:55 smithi077 ceph-mon[27902]: pgmap v18620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:55.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34745.783364 secs 2024-04-21T20:03:55.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:55 smithi191 ceph-mon[31636]: pgmap v18620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:55.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34745.783364 secs 2024-04-21T20:03:55.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:55 smithi170 ceph-mon[31212]: pgmap v18620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:57.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:57 smithi077 ceph-mon[27902]: pgmap v18621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:57.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:57 smithi191 ceph-mon[31636]: pgmap v18621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:57.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:57 smithi170 ceph-mon[31212]: pgmap v18621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:03:58.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34749.026166 secs 2024-04-21T20:03:58.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34749.026166 secs 2024-04-21T20:03:58.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34749.026166 secs 2024-04-21T20:03:59.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:03:59 smithi077 ceph-mon[27902]: pgmap v18622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:59.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:03:59 smithi191 ceph-mon[31636]: pgmap v18622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:03:59.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:03:59 smithi170 ceph-mon[31212]: pgmap v18622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:00.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:00.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34750.783454 secs 2024-04-21T20:04:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34750.783454 secs 2024-04-21T20:04:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34750.783454 secs 2024-04-21T20:04:01.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:01 smithi077 ceph-mon[27902]: pgmap v18623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:04:01.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:01 smithi191 ceph-mon[31636]: pgmap v18623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:04:01.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:01 smithi170 ceph-mon[31212]: pgmap v18623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T20:04:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34754.026284 secs 2024-04-21T20:04:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:03 smithi077 ceph-mon[27902]: pgmap v18624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.0 KiB/s wr, 9 op/s 2024-04-21T20:04:03.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34754.026284 secs 2024-04-21T20:04:03.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:03 smithi191 ceph-mon[31636]: pgmap v18624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.0 KiB/s wr, 9 op/s 2024-04-21T20:04:03.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34754.026284 secs 2024-04-21T20:04:03.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:03 smithi170 ceph-mon[31212]: pgmap v18624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.0 KiB/s wr, 9 op/s 2024-04-21T20:04:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34755.783568 secs 2024-04-21T20:04:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:05 smithi077 ceph-mon[27902]: pgmap v18625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-21T20:04:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:05 smithi077 ceph-mon[27902]: osdmap e1236: 12 total, 12 up, 12 in 2024-04-21T20:04:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34755.783568 secs 2024-04-21T20:04:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:05 smithi191 ceph-mon[31636]: pgmap v18625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-21T20:04:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:05 smithi191 ceph-mon[31636]: osdmap e1236: 12 total, 12 up, 12 in 2024-04-21T20:04:05.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34755.783568 secs 2024-04-21T20:04:05.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:05 smithi170 ceph-mon[31212]: pgmap v18625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-21T20:04:05.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:05 smithi170 ceph-mon[31212]: osdmap e1236: 12 total, 12 up, 12 in 2024-04-21T20:04:06.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:04:06.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:04:06.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:04:07.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:07 smithi077 ceph-mon[27902]: pgmap v18627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:04:07.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:07 smithi191 ceph-mon[31636]: pgmap v18627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:04:07.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:07 smithi170 ceph-mon[31212]: pgmap v18627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:04:08.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34759.026399 secs 2024-04-21T20:04:08.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34759.026399 secs 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34759.026399 secs 2024-04-21T20:04:08.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:08.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: pgmap v18628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:04:09.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:04:09.631 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.631 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:09 smithi191 ceph-mon[31636]: osdmap e1237: 12 total, 12 up, 12 in 2024-04-21T20:04:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: pgmap v18628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:04:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.646 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.646 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:04:09.646 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:04:09.646 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.646 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:09 smithi077 ceph-mon[27902]: osdmap e1237: 12 total, 12 up, 12 in 2024-04-21T20:04:09.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: pgmap v18628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:04:09.817 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:09 smithi170 ceph-mon[31212]: osdmap e1237: 12 total, 12 up, 12 in 2024-04-21T20:04:10.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:10.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:04:10.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:04:10.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:04:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:04:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:04:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:04:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34760.783663 secs 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:04:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34760.783663 secs 2024-04-21T20:04:10.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:04:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:04:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:04:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:04:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:04:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:04:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34760.783663 secs 2024-04-21T20:04:11.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:11 smithi077 ceph-mon[27902]: pgmap v18630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-04-21T20:04:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:11 smithi191 ceph-mon[31636]: pgmap v18630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-04-21T20:04:11.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:11 smithi170 ceph-mon[31212]: pgmap v18630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-04-21T20:04:13.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34764.026531 secs 2024-04-21T20:04:13.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:13 smithi077 ceph-mon[27902]: pgmap v18631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T20:04:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34764.026531 secs 2024-04-21T20:04:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:13 smithi191 ceph-mon[31636]: pgmap v18631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T20:04:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34764.026531 secs 2024-04-21T20:04:13.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:13 smithi170 ceph-mon[31212]: pgmap v18631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2024-04-21T20:04:14.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34765.783780 secs 2024-04-21T20:04:14.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34765.783780 secs 2024-04-21T20:04:14.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34765.783780 secs 2024-04-21T20:04:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:15.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:15 smithi077 ceph-mon[27902]: pgmap v18632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 24 op/s 2024-04-21T20:04:15.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:15 smithi191 ceph-mon[31636]: pgmap v18632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 24 op/s 2024-04-21T20:04:15.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:15 smithi170 ceph-mon[31212]: pgmap v18632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 KiB/s wr, 24 op/s 2024-04-21T20:04:17.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:17 smithi077 ceph-mon[27902]: pgmap v18633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:04:17.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:17 smithi191 ceph-mon[31636]: pgmap v18633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:04:17.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:17 smithi170 ceph-mon[31212]: pgmap v18633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:04:18.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34769.026629 secs 2024-04-21T20:04:18.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34769.026629 secs 2024-04-21T20:04:18.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34769.026629 secs 2024-04-21T20:04:19.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:19 smithi191 ceph-mon[31636]: pgmap v18634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:04:19.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34770.783896 secs 2024-04-21T20:04:19.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:19 smithi170 ceph-mon[31212]: pgmap v18634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:04:19.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34770.783896 secs 2024-04-21T20:04:19.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:19 smithi077 ceph-mon[27902]: pgmap v18634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:04:19.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34770.783896 secs 2024-04-21T20:04:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:21.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:21 smithi191 ceph-mon[31636]: pgmap v18635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 92 B/s wr, 6 op/s 2024-04-21T20:04:21.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:21 smithi170 ceph-mon[31212]: pgmap v18635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 92 B/s wr, 6 op/s 2024-04-21T20:04:21.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:21 smithi077 ceph-mon[27902]: pgmap v18635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 92 B/s wr, 6 op/s 2024-04-21T20:04:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34774.026748 secs 2024-04-21T20:04:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:23 smithi191 ceph-mon[31636]: pgmap v18636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T20:04:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34774.026748 secs 2024-04-21T20:04:23.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:23 smithi170 ceph-mon[31212]: pgmap v18636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T20:04:23.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34774.026748 secs 2024-04-21T20:04:23.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:23 smithi077 ceph-mon[27902]: pgmap v18636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-21T20:04:24.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34775.784010 secs 2024-04-21T20:04:24.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34775.784010 secs 2024-04-21T20:04:24.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34775.784010 secs 2024-04-21T20:04:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:25.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:25 smithi191 ceph-mon[31636]: pgmap v18637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:25.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:25 smithi170 ceph-mon[31212]: pgmap v18637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:25.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:25 smithi077 ceph-mon[27902]: pgmap v18637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:27.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:27 smithi191 ceph-mon[31636]: pgmap v18638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:27.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:27 smithi170 ceph-mon[31212]: pgmap v18638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:27.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:27 smithi077 ceph-mon[27902]: pgmap v18638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:28.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34779.026864 secs 2024-04-21T20:04:28.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34779.026864 secs 2024-04-21T20:04:28.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34779.026864 secs 2024-04-21T20:04:29.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:29 smithi191 ceph-mon[31636]: pgmap v18639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:29.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34780.784082 secs 2024-04-21T20:04:29.795 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:29 smithi077 ceph-mon[27902]: pgmap v18639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:29.795 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34780.784082 secs 2024-04-21T20:04:29.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:29 smithi170 ceph-mon[31212]: pgmap v18639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:29.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34780.784082 secs 2024-04-21T20:04:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:31.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:31 smithi191 ceph-mon[31636]: pgmap v18640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:31.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:31 smithi170 ceph-mon[31212]: pgmap v18640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:31.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:31 smithi077 ceph-mon[27902]: pgmap v18640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:33.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34784.026980 secs 2024-04-21T20:04:33.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:33 smithi191 ceph-mon[31636]: pgmap v18641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:33.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34784.026980 secs 2024-04-21T20:04:33.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:33 smithi170 ceph-mon[31212]: pgmap v18641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:33.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34784.026980 secs 2024-04-21T20:04:33.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:33 smithi077 ceph-mon[27902]: pgmap v18641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:34.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34785.784195 secs 2024-04-21T20:04:34.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34785.784195 secs 2024-04-21T20:04:34.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34785.784195 secs 2024-04-21T20:04:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:35.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:35 smithi191 ceph-mon[31636]: pgmap v18642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:35.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:35 smithi170 ceph-mon[31212]: pgmap v18642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:35.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:35 smithi077 ceph-mon[27902]: pgmap v18642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:36.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:36 smithi170 ceph-mon[31212]: pgmap v18643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:36.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:36 smithi077 ceph-mon[27902]: pgmap v18643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:36.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:36 smithi191 ceph-mon[31636]: pgmap v18643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:37.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34789.027096 secs 2024-04-21T20:04:38.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34789.027096 secs 2024-04-21T20:04:38.145 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34789.027096 secs 2024-04-21T20:04:38.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:38 smithi191 ceph-mon[31636]: pgmap v18644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:39.065 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:38 smithi170 ceph-mon[31212]: pgmap v18644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:39.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:38 smithi077 ceph-mon[27902]: pgmap v18644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:39.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34790.784324 secs 2024-04-21T20:04:40.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34790.784324 secs 2024-04-21T20:04:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:40.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34790.784324 secs 2024-04-21T20:04:40.977 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:40 smithi191 ceph-mon[31636]: pgmap v18645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:41.066 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:40 smithi170 ceph-mon[31212]: pgmap v18645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:41.144 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:40 smithi077 ceph-mon[27902]: pgmap v18645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:43.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34794.027212 secs 2024-04-21T20:04:43.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:43 smithi170 ceph-mon[31212]: pgmap v18646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34794.027212 secs 2024-04-21T20:04:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:43 smithi077 ceph-mon[27902]: pgmap v18646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34794.027212 secs 2024-04-21T20:04:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:43 smithi191 ceph-mon[31636]: pgmap v18646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:45.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34795.784430 secs 2024-04-21T20:04:45.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:45 smithi170 ceph-mon[31212]: pgmap v18647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:45.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34795.784430 secs 2024-04-21T20:04:45.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:45 smithi077 ceph-mon[27902]: pgmap v18647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:45.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34795.784430 secs 2024-04-21T20:04:45.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:45 smithi191 ceph-mon[31636]: pgmap v18647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:47.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:47 smithi170 ceph-mon[31212]: pgmap v18648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:47.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:47 smithi077 ceph-mon[27902]: pgmap v18648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:47.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:47 smithi191 ceph-mon[31636]: pgmap v18648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:48.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34799.027289 secs 2024-04-21T20:04:48.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34799.027289 secs 2024-04-21T20:04:48.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34799.027289 secs 2024-04-21T20:04:49.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:49 smithi170 ceph-mon[31212]: pgmap v18649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:49.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:49 smithi077 ceph-mon[27902]: pgmap v18649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:49.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:49 smithi191 ceph-mon[31636]: pgmap v18649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:50.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:50.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34800.784544 secs 2024-04-21T20:04:50.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34800.784544 secs 2024-04-21T20:04:50.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34800.784544 secs 2024-04-21T20:04:51.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:51 smithi170 ceph-mon[31212]: pgmap v18650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:51.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:51 smithi077 ceph-mon[27902]: pgmap v18650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:51.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:51 smithi191 ceph-mon[31636]: pgmap v18650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:04:53.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34804.027408 secs 2024-04-21T20:04:53.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:53 smithi170 ceph-mon[31212]: pgmap v18651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:53.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34804.027408 secs 2024-04-21T20:04:53.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:53 smithi077 ceph-mon[27902]: pgmap v18651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34804.027408 secs 2024-04-21T20:04:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:53 smithi191 ceph-mon[31636]: pgmap v18651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T20:04:55.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:04:55.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34805.784664 secs 2024-04-21T20:04:55.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:55 smithi170 ceph-mon[31212]: pgmap v18652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:55.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34805.784664 secs 2024-04-21T20:04:55.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:55 smithi077 ceph-mon[27902]: pgmap v18652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:55.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34805.784664 secs 2024-04-21T20:04:55.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:55 smithi191 ceph-mon[31636]: pgmap v18652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:57.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:57 smithi170 ceph-mon[31212]: pgmap v18653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:57.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:57 smithi077 ceph-mon[27902]: pgmap v18653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:57.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:57 smithi191 ceph-mon[31636]: pgmap v18653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:04:58.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34809.027541 secs 2024-04-21T20:04:58.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34809.027541 secs 2024-04-21T20:04:58.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34809.027541 secs 2024-04-21T20:04:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:04:59.166+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:04:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:04:59.166+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:04:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:04:59.167+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:04:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:04:59.167+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:04:59.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:04:59 smithi077 ceph-mon[27902]: pgmap v18654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:59.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:04:59 smithi191 ceph-mon[31636]: pgmap v18654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:04:59.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:04:59 smithi170 ceph-mon[31212]: pgmap v18654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:00.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 34995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:00.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34810.784768 secs 2024-04-21T20:05:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34810.784768 secs 2024-04-21T20:05:00.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34810.784768 secs 2024-04-21T20:05:01.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:01 smithi077 ceph-mon[27902]: pgmap v18655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:05:01.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:01 smithi191 ceph-mon[31636]: pgmap v18655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:05:01.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:01 smithi170 ceph-mon[31212]: pgmap v18655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T20:05:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34814.027675 secs 2024-04-21T20:05:03.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:03 smithi077 ceph-mon[27902]: pgmap v18656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:03.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34814.027675 secs 2024-04-21T20:05:03.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:03 smithi191 ceph-mon[31636]: pgmap v18656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:03.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34814.027675 secs 2024-04-21T20:05:03.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:03 smithi170 ceph-mon[31212]: pgmap v18656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34815.784881 secs 2024-04-21T20:05:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:05 smithi077 ceph-mon[27902]: pgmap v18657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:05.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:05 smithi077 ceph-mon[27902]: osdmap e1238: 12 total, 12 up, 12 in 2024-04-21T20:05:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34815.784881 secs 2024-04-21T20:05:05.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:05 smithi191 ceph-mon[31636]: pgmap v18657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:05.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:05 smithi191 ceph-mon[31636]: osdmap e1238: 12 total, 12 up, 12 in 2024-04-21T20:05:05.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34815.784881 secs 2024-04-21T20:05:05.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:05 smithi170 ceph-mon[31212]: pgmap v18657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:05.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:05 smithi170 ceph-mon[31212]: osdmap e1238: 12 total, 12 up, 12 in 2024-04-21T20:05:07.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:07 smithi170 ceph-mon[31212]: pgmap v18659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:05:07.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:07 smithi077 ceph-mon[27902]: pgmap v18659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:05:07.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:07 smithi191 ceph-mon[31636]: pgmap v18659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:05:08.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34819.027816 secs 2024-04-21T20:05:08.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34819.027816 secs 2024-04-21T20:05:08.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34819.027816 secs 2024-04-21T20:05:09.355 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:09 smithi077 ceph-mon[27902]: pgmap v18660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:05:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:09 smithi191 ceph-mon[31636]: pgmap v18660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:05:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:05:09.629 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:09 smithi191 ceph-mon[31636]: osdmap e1239: 12 total, 12 up, 12 in 2024-04-21T20:05:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:05:09.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:09 smithi077 ceph-mon[27902]: osdmap e1239: 12 total, 12 up, 12 in 2024-04-21T20:05:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:09 smithi170 ceph-mon[31212]: pgmap v18660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:05:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:05:09.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:09 smithi170 ceph-mon[31212]: osdmap e1239: 12 total, 12 up, 12 in 2024-04-21T20:05:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:10.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34820.784995 secs 2024-04-21T20:05:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:05:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:05:10.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34820.784995 secs 2024-04-21T20:05:10.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:05:10.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:05:10.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34820.784995 secs 2024-04-21T20:05:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:05:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:05:10.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:05:11.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:11 smithi077 ceph-mon[27902]: pgmap v18662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:05:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:11 smithi191 ceph-mon[31636]: pgmap v18662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:05:11.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:11 smithi170 ceph-mon[31212]: pgmap v18662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:05:13.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34824.027931 secs 2024-04-21T20:05:13.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:13 smithi077 ceph-mon[27902]: pgmap v18663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:05:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34824.027931 secs 2024-04-21T20:05:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:13 smithi191 ceph-mon[31636]: pgmap v18663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:05:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34824.027931 secs 2024-04-21T20:05:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:13 smithi170 ceph-mon[31212]: pgmap v18663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:05:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:15.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34825.785107 secs 2024-04-21T20:05:15.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:15 smithi077 ceph-mon[27902]: pgmap v18664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:05:15.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34825.785107 secs 2024-04-21T20:05:15.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:15 smithi191 ceph-mon[31636]: pgmap v18664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:05:15.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34825.785107 secs 2024-04-21T20:05:15.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:15 smithi170 ceph-mon[31212]: pgmap v18664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:05:17.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:17 smithi077 ceph-mon[27902]: pgmap v18665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:05:17.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:17 smithi191 ceph-mon[31636]: pgmap v18665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:05:17.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:17 smithi170 ceph-mon[31212]: pgmap v18665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:05:18.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34829.028048 secs 2024-04-21T20:05:18.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34829.028048 secs 2024-04-21T20:05:18.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34829.028048 secs 2024-04-21T20:05:19.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:19 smithi077 ceph-mon[27902]: pgmap v18666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:05:19.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:19 smithi191 ceph-mon[31636]: pgmap v18666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:05:19.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:19 smithi170 ceph-mon[31212]: pgmap v18666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:05:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:20.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34830.785238 secs 2024-04-21T20:05:20.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34830.785238 secs 2024-04-21T20:05:20.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34830.785238 secs 2024-04-21T20:05:21.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:21 smithi077 ceph-mon[27902]: pgmap v18667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 92 B/s wr, 7 op/s 2024-04-21T20:05:21.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:21 smithi191 ceph-mon[31636]: pgmap v18667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 92 B/s wr, 7 op/s 2024-04-21T20:05:21.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:21 smithi170 ceph-mon[31212]: pgmap v18667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 92 B/s wr, 7 op/s 2024-04-21T20:05:23.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34834.028156 secs 2024-04-21T20:05:23.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:23 smithi077 ceph-mon[27902]: pgmap v18668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34834.028156 secs 2024-04-21T20:05:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:23 smithi191 ceph-mon[31636]: pgmap v18668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34834.028156 secs 2024-04-21T20:05:23.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:23 smithi170 ceph-mon[31212]: pgmap v18668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:25.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34835.785351 secs 2024-04-21T20:05:25.394 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:25 smithi077 ceph-mon[27902]: pgmap v18669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:25.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34835.785351 secs 2024-04-21T20:05:25.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:25 smithi191 ceph-mon[31636]: pgmap v18669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:25.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34835.785351 secs 2024-04-21T20:05:25.566 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:25 smithi170 ceph-mon[31212]: pgmap v18669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:27.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:27 smithi170 ceph-mon[31212]: pgmap v18670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:27.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:27 smithi077 ceph-mon[27902]: pgmap v18670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:27.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:27 smithi191 ceph-mon[31636]: pgmap v18670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:28.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34839.028275 secs 2024-04-21T20:05:28.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34839.028275 secs 2024-04-21T20:05:28.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34839.028275 secs 2024-04-21T20:05:29.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:29 smithi170 ceph-mon[31212]: pgmap v18671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:29.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:29 smithi077 ceph-mon[27902]: pgmap v18671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:29.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:29 smithi191 ceph-mon[31636]: pgmap v18671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:30.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34840.785471 secs 2024-04-21T20:05:30.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34840.785471 secs 2024-04-21T20:05:30.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34840.785471 secs 2024-04-21T20:05:31.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:31 smithi170 ceph-mon[31212]: pgmap v18672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:31.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:31 smithi077 ceph-mon[27902]: pgmap v18672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:31.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:31 smithi191 ceph-mon[31636]: pgmap v18672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:33.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34844.028338 secs 2024-04-21T20:05:33.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:33 smithi077 ceph-mon[27902]: pgmap v18673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:33.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34844.028338 secs 2024-04-21T20:05:33.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:33 smithi191 ceph-mon[31636]: pgmap v18673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:33.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34844.028338 secs 2024-04-21T20:05:33.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:33 smithi170 ceph-mon[31212]: pgmap v18673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:35.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:35.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34845.785574 secs 2024-04-21T20:05:35.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:35 smithi077 ceph-mon[27902]: pgmap v18674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:35.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34845.785574 secs 2024-04-21T20:05:35.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:35 smithi191 ceph-mon[31636]: pgmap v18674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:35.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34845.785574 secs 2024-04-21T20:05:35.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:35 smithi170 ceph-mon[31212]: pgmap v18674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:37.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:37 smithi170 ceph-mon[31212]: pgmap v18675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:37.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:37 smithi077 ceph-mon[27902]: pgmap v18675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:37.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:37 smithi191 ceph-mon[31636]: pgmap v18675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:38.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34849.028441 secs 2024-04-21T20:05:38.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34849.028441 secs 2024-04-21T20:05:38.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34849.028441 secs 2024-04-21T20:05:39.628 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:39 smithi191 ceph-mon[31636]: pgmap v18676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:39.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:39 smithi077 ceph-mon[27902]: pgmap v18676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:39.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:39 smithi170 ceph-mon[31212]: pgmap v18676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:40.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:40.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34850.785693 secs 2024-04-21T20:05:40.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34850.785693 secs 2024-04-21T20:05:40.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34850.785693 secs 2024-04-21T20:05:41.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:41 smithi077 ceph-mon[27902]: pgmap v18677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:41.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:41 smithi191 ceph-mon[31636]: pgmap v18677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:41.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:41 smithi170 ceph-mon[31212]: pgmap v18677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34854.028558 secs 2024-04-21T20:05:43.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:43 smithi077 ceph-mon[27902]: pgmap v18678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34854.028558 secs 2024-04-21T20:05:43.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:43 smithi191 ceph-mon[31636]: pgmap v18678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:43.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34854.028558 secs 2024-04-21T20:05:43.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:43 smithi170 ceph-mon[31212]: pgmap v18678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:45.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34855.785807 secs 2024-04-21T20:05:45.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:45 smithi077 ceph-mon[27902]: pgmap v18679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:45.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34855.785807 secs 2024-04-21T20:05:45.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:45 smithi191 ceph-mon[31636]: pgmap v18679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:45.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34855.785807 secs 2024-04-21T20:05:45.816 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:45 smithi170 ceph-mon[31212]: pgmap v18679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:47.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:47 smithi077 ceph-mon[27902]: pgmap v18680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:47.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:47 smithi191 ceph-mon[31636]: pgmap v18680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:47.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:47 smithi170 ceph-mon[31212]: pgmap v18680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:48.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34859.028674 secs 2024-04-21T20:05:48.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34859.028674 secs 2024-04-21T20:05:48.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34859.028674 secs 2024-04-21T20:05:49.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:49 smithi077 ceph-mon[27902]: pgmap v18681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:49.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:49 smithi191 ceph-mon[31636]: pgmap v18681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:49.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:49 smithi170 ceph-mon[31212]: pgmap v18681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:50.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:50.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34860.785922 secs 2024-04-21T20:05:50.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34860.785922 secs 2024-04-21T20:05:50.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34860.785922 secs 2024-04-21T20:05:51.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:51 smithi077 ceph-mon[27902]: pgmap v18682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:51.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:51 smithi191 ceph-mon[31636]: pgmap v18682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:51.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:51 smithi170 ceph-mon[31212]: pgmap v18682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:05:53.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34864.028793 secs 2024-04-21T20:05:53.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:53 smithi077 ceph-mon[27902]: pgmap v18683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34864.028793 secs 2024-04-21T20:05:53.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:53 smithi191 ceph-mon[31636]: pgmap v18683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:53.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34864.028793 secs 2024-04-21T20:05:53.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:53 smithi170 ceph-mon[31212]: pgmap v18683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:05:55.142 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:05:55.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34865.786015 secs 2024-04-21T20:05:55.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:55 smithi077 ceph-mon[27902]: pgmap v18684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:55.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34865.786015 secs 2024-04-21T20:05:55.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:55 smithi191 ceph-mon[31636]: pgmap v18684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:55.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34865.786015 secs 2024-04-21T20:05:55.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:55 smithi170 ceph-mon[31212]: pgmap v18684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:57.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:57 smithi077 ceph-mon[27902]: pgmap v18685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:57.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:57 smithi191 ceph-mon[31636]: pgmap v18685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:57.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:57 smithi170 ceph-mon[31212]: pgmap v18685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:05:58.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34869.028860 secs 2024-04-21T20:05:58.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34869.028860 secs 2024-04-21T20:05:58.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34869.028860 secs 2024-04-21T20:05:59.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:05:59 smithi077 ceph-mon[27902]: pgmap v18686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:59.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:05:59 smithi191 ceph-mon[31636]: pgmap v18686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:05:59.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:05:59 smithi170 ceph-mon[31212]: pgmap v18686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:00.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34870.786124 secs 2024-04-21T20:06:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34870.786124 secs 2024-04-21T20:06:00.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34870.786124 secs 2024-04-21T20:06:01.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:01 smithi077 ceph-mon[27902]: pgmap v18687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:06:01.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:01 smithi191 ceph-mon[31636]: pgmap v18687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:06:01.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:01 smithi170 ceph-mon[31212]: pgmap v18687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T20:06:03.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34874.028998 secs 2024-04-21T20:06:03.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:03 smithi191 ceph-mon[31636]: pgmap v18688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:06:03.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34874.028998 secs 2024-04-21T20:06:03.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:03 smithi170 ceph-mon[31212]: pgmap v18688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:06:03.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34874.028998 secs 2024-04-21T20:06:03.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:03 smithi077 ceph-mon[27902]: pgmap v18688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:06:04.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34875.786238 secs 2024-04-21T20:06:04.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34875.786238 secs 2024-04-21T20:06:04.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34875.786238 secs 2024-04-21T20:06:05.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:05 smithi191 ceph-mon[31636]: pgmap v18689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:05.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:05 smithi191 ceph-mon[31636]: osdmap e1240: 12 total, 12 up, 12 in 2024-04-21T20:06:05.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:05 smithi170 ceph-mon[31212]: pgmap v18689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:05.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:05 smithi170 ceph-mon[31212]: osdmap e1240: 12 total, 12 up, 12 in 2024-04-21T20:06:05.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:05 smithi077 ceph-mon[27902]: pgmap v18689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:05.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:05 smithi077 ceph-mon[27902]: osdmap e1240: 12 total, 12 up, 12 in 2024-04-21T20:06:07.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:07 smithi191 ceph-mon[31636]: pgmap v18691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:06:07.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:07 smithi170 ceph-mon[31212]: pgmap v18691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:06:07.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:07 smithi077 ceph-mon[27902]: pgmap v18691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:06:08.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34879.029109 secs 2024-04-21T20:06:08.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34879.029109 secs 2024-04-21T20:06:08.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34879.029109 secs 2024-04-21T20:06:09.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:09 smithi191 ceph-mon[31636]: pgmap v18692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:06:09.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34880.786313 secs 2024-04-21T20:06:09.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:09 smithi191 ceph-mon[31636]: osdmap e1241: 12 total, 12 up, 12 in 2024-04-21T20:06:09.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:09 smithi170 ceph-mon[31212]: pgmap v18692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:06:09.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34880.786313 secs 2024-04-21T20:06:09.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:09 smithi170 ceph-mon[31212]: osdmap e1241: 12 total, 12 up, 12 in 2024-04-21T20:06:09.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:09 smithi077 ceph-mon[27902]: pgmap v18692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:06:09.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34880.786313 secs 2024-04-21T20:06:09.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:09 smithi077 ceph-mon[27902]: osdmap e1241: 12 total, 12 up, 12 in 2024-04-21T20:06:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:10.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:06:10.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:06:10.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:06:11.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:11 smithi191 ceph-mon[31636]: pgmap v18694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:06:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:11 smithi170 ceph-mon[31212]: pgmap v18694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:06:11.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:11 smithi077 ceph-mon[27902]: pgmap v18694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:06:11.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:11.894 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:12.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:06:12.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:06:12.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:12.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:06:12.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:06:12.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:12.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:06:12.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:06:12.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:06:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34884.029213 secs 2024-04-21T20:06:13.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:13 smithi191 ceph-mon[31636]: pgmap v18695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:06:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34884.029213 secs 2024-04-21T20:06:13.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:13 smithi170 ceph-mon[31212]: pgmap v18695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:06:13.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34884.029213 secs 2024-04-21T20:06:13.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:13 smithi077 ceph-mon[27902]: pgmap v18695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:06:14.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34885.786372 secs 2024-04-21T20:06:14.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34885.786372 secs 2024-04-21T20:06:14.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34885.786372 secs 2024-04-21T20:06:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:15.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:15 smithi191 ceph-mon[31636]: pgmap v18696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:06:15.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:15 smithi170 ceph-mon[31212]: pgmap v18696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:06:15.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:15 smithi077 ceph-mon[27902]: pgmap v18696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:06:17.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:17 smithi191 ceph-mon[31636]: pgmap v18697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T20:06:17.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:17 smithi170 ceph-mon[31212]: pgmap v18697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T20:06:17.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:17 smithi077 ceph-mon[27902]: pgmap v18697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T20:06:18.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34889.029321 secs 2024-04-21T20:06:18.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34889.029321 secs 2024-04-21T20:06:18.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34889.029321 secs 2024-04-21T20:06:19.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:19 smithi191 ceph-mon[31636]: pgmap v18698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T20:06:19.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34890.786506 secs 2024-04-21T20:06:19.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:19 smithi170 ceph-mon[31212]: pgmap v18698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T20:06:19.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34890.786506 secs 2024-04-21T20:06:19.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:19 smithi077 ceph-mon[27902]: pgmap v18698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T20:06:19.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34890.786506 secs 2024-04-21T20:06:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:21.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:21 smithi191 ceph-mon[31636]: pgmap v18699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 91 B/s wr, 7 op/s 2024-04-21T20:06:21.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:21 smithi170 ceph-mon[31212]: pgmap v18699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 91 B/s wr, 7 op/s 2024-04-21T20:06:21.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:21 smithi077 ceph-mon[27902]: pgmap v18699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 91 B/s wr, 7 op/s 2024-04-21T20:06:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34894.029450 secs 2024-04-21T20:06:23.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:23 smithi191 ceph-mon[31636]: pgmap v18700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:06:23.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34894.029450 secs 2024-04-21T20:06:23.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:23 smithi170 ceph-mon[31212]: pgmap v18700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:06:23.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34894.029450 secs 2024-04-21T20:06:23.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:23 smithi077 ceph-mon[27902]: pgmap v18700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:06:24.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34895.786643 secs 2024-04-21T20:06:24.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34895.786643 secs 2024-04-21T20:06:24.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34895.786643 secs 2024-04-21T20:06:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:25.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:25 smithi191 ceph-mon[31636]: pgmap v18701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:25.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:25 smithi170 ceph-mon[31212]: pgmap v18701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:25.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:25 smithi077 ceph-mon[27902]: pgmap v18701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:26.815 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:26 smithi170 ceph-mon[31212]: pgmap v18702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:26.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:26 smithi077 ceph-mon[27902]: pgmap v18702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:26.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:26 smithi191 ceph-mon[31636]: pgmap v18702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:27.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34899.029586 secs 2024-04-21T20:06:28.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34899.029586 secs 2024-04-21T20:06:28.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34899.029586 secs 2024-04-21T20:06:28.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:28 smithi191 ceph-mon[31636]: pgmap v18703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:06:29.044 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:28 smithi077 ceph-mon[27902]: pgmap v18703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:06:29.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:28 smithi170 ceph-mon[31212]: pgmap v18703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:06:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:06:29.179+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:06:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:06:29.179+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:06:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:06:29.179+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:06:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:06:29.179+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:06:29.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34900.786759 secs 2024-04-21T20:06:30.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34900.786759 secs 2024-04-21T20:06:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:30.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34900.786759 secs 2024-04-21T20:06:31.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:30 smithi170 ceph-mon[31212]: pgmap v18704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:31.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:30 smithi077 ceph-mon[27902]: pgmap v18704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:31.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:30 smithi191 ceph-mon[31636]: pgmap v18704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:33.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34904.029700 secs 2024-04-21T20:06:33.565 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:33 smithi170 ceph-mon[31212]: pgmap v18705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T20:06:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34904.029700 secs 2024-04-21T20:06:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:33 smithi077 ceph-mon[27902]: pgmap v18705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T20:06:33.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34904.029700 secs 2024-04-21T20:06:33.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:33 smithi191 ceph-mon[31636]: pgmap v18705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T20:06:35.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34905.786913 secs 2024-04-21T20:06:35.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:35 smithi077 ceph-mon[27902]: pgmap v18706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:06:35.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34905.786913 secs 2024-04-21T20:06:35.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:35 smithi191 ceph-mon[31636]: pgmap v18706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:06:35.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34905.786913 secs 2024-04-21T20:06:35.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:35 smithi170 ceph-mon[31212]: pgmap v18706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:06:37.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:37 smithi170 ceph-mon[31212]: pgmap v18707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:37.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:37 smithi077 ceph-mon[27902]: pgmap v18707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:37.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:37 smithi191 ceph-mon[31636]: pgmap v18707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:38.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34909.029823 secs 2024-04-21T20:06:38.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34909.029823 secs 2024-04-21T20:06:38.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34909.029823 secs 2024-04-21T20:06:39.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:39 smithi191 ceph-mon[31636]: pgmap v18708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:39.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:39 smithi077 ceph-mon[27902]: pgmap v18708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:39.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:39 smithi170 ceph-mon[31212]: pgmap v18708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:40.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:40.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34910.787003 secs 2024-04-21T20:06:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34910.787003 secs 2024-04-21T20:06:40.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34910.787003 secs 2024-04-21T20:06:41.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:41 smithi077 ceph-mon[27902]: pgmap v18709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:41.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:41 smithi191 ceph-mon[31636]: pgmap v18709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:41.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:41 smithi170 ceph-mon[31212]: pgmap v18709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:43.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34914.029958 secs 2024-04-21T20:06:43.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:43 smithi077 ceph-mon[27902]: pgmap v18710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34914.029958 secs 2024-04-21T20:06:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:43 smithi191 ceph-mon[31636]: pgmap v18710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:43.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34914.029958 secs 2024-04-21T20:06:43.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:43 smithi170 ceph-mon[31212]: pgmap v18710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:45.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34915.787112 secs 2024-04-21T20:06:45.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:45 smithi077 ceph-mon[27902]: pgmap v18711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:45.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34915.787112 secs 2024-04-21T20:06:45.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:45 smithi191 ceph-mon[31636]: pgmap v18711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:45.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34915.787112 secs 2024-04-21T20:06:45.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:45 smithi170 ceph-mon[31212]: pgmap v18711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:47.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:47 smithi077 ceph-mon[27902]: pgmap v18712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:47.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:47 smithi191 ceph-mon[31636]: pgmap v18712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:47.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:47 smithi170 ceph-mon[31212]: pgmap v18712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:48.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34919.030083 secs 2024-04-21T20:06:48.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34919.030083 secs 2024-04-21T20:06:48.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34919.030083 secs 2024-04-21T20:06:49.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:49 smithi077 ceph-mon[27902]: pgmap v18713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:49.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:49 smithi191 ceph-mon[31636]: pgmap v18713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:49.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:49 smithi170 ceph-mon[31212]: pgmap v18713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:50.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:50.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34920.787226 secs 2024-04-21T20:06:50.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34920.787226 secs 2024-04-21T20:06:50.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34920.787226 secs 2024-04-21T20:06:51.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:51 smithi077 ceph-mon[27902]: pgmap v18714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:51.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:51 smithi191 ceph-mon[31636]: pgmap v18714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:51.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:51 smithi170 ceph-mon[31212]: pgmap v18714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34924.030159 secs 2024-04-21T20:06:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:53 smithi077 ceph-mon[27902]: pgmap v18715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34924.030159 secs 2024-04-21T20:06:53.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:53 smithi191 ceph-mon[31636]: pgmap v18715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:53.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34924.030159 secs 2024-04-21T20:06:53.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:53 smithi170 ceph-mon[31212]: pgmap v18715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:55.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:06:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34925.787314 secs 2024-04-21T20:06:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:55 smithi077 ceph-mon[27902]: pgmap v18716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:55.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34925.787314 secs 2024-04-21T20:06:55.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:55 smithi191 ceph-mon[31636]: pgmap v18716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:55.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34925.787314 secs 2024-04-21T20:06:55.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:55 smithi170 ceph-mon[31212]: pgmap v18716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:57.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:57 smithi077 ceph-mon[27902]: pgmap v18717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:57.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:57 smithi191 ceph-mon[31636]: pgmap v18717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:57.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:57 smithi170 ceph-mon[31212]: pgmap v18717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:06:58.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34929.030273 secs 2024-04-21T20:06:58.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34929.030273 secs 2024-04-21T20:06:58.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34929.030273 secs 2024-04-21T20:06:59.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:06:59 smithi077 ceph-mon[27902]: pgmap v18718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:59.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:06:59 smithi191 ceph-mon[31636]: pgmap v18718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:06:59.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:06:59 smithi170 ceph-mon[31212]: pgmap v18718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:00.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34930.787432 secs 2024-04-21T20:07:00.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34930.787432 secs 2024-04-21T20:07:00.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34930.787432 secs 2024-04-21T20:07:01.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:01 smithi191 ceph-mon[31636]: pgmap v18719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:01.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:01 smithi170 ceph-mon[31212]: pgmap v18719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:01.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:01 smithi077 ceph-mon[27902]: pgmap v18719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34934.030387 secs 2024-04-21T20:07:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:03 smithi191 ceph-mon[31636]: pgmap v18720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:03.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34934.030387 secs 2024-04-21T20:07:03.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:03 smithi170 ceph-mon[31212]: pgmap v18720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:03.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34934.030387 secs 2024-04-21T20:07:03.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:03 smithi077 ceph-mon[27902]: pgmap v18720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:04.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34935.787541 secs 2024-04-21T20:07:04.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:04 smithi191 ceph-mon[31636]: osdmap e1242: 12 total, 12 up, 12 in 2024-04-21T20:07:04.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34935.787541 secs 2024-04-21T20:07:04.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:04 smithi170 ceph-mon[31212]: osdmap e1242: 12 total, 12 up, 12 in 2024-04-21T20:07:04.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34935.787541 secs 2024-04-21T20:07:04.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:04 smithi077 ceph-mon[27902]: osdmap e1242: 12 total, 12 up, 12 in 2024-04-21T20:07:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:05 smithi191 ceph-mon[31636]: pgmap v18721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:05.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:05 smithi170 ceph-mon[31212]: pgmap v18721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:05.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:05 smithi077 ceph-mon[27902]: pgmap v18721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:07.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:07 smithi191 ceph-mon[31636]: pgmap v18723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:07:07.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:07 smithi170 ceph-mon[31212]: pgmap v18723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:07:07.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:07 smithi077 ceph-mon[27902]: pgmap v18723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:07:08.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34939.030523 secs 2024-04-21T20:07:08.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34939.030523 secs 2024-04-21T20:07:08.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34939.030523 secs 2024-04-21T20:07:09.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:09 smithi191 ceph-mon[31636]: pgmap v18724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:07:09.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34940.787658 secs 2024-04-21T20:07:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:09 smithi170 ceph-mon[31212]: pgmap v18724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:07:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34940.787658 secs 2024-04-21T20:07:09.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:09 smithi077 ceph-mon[27902]: pgmap v18724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:07:09.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34940.787658 secs 2024-04-21T20:07:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:10.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:10 smithi191 ceph-mon[31636]: pgmap v18725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:07:10.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:10 smithi170 ceph-mon[31212]: pgmap v18725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:07:10.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:10 smithi077 ceph-mon[27902]: pgmap v18725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:07:11.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:07:12.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:07:12.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:07:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34944.030587 secs 2024-04-21T20:07:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:12 smithi191 ceph-mon[31636]: pgmap v18726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:07:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:07:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:07:12.976 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:07:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34944.030587 secs 2024-04-21T20:07:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:12 smithi170 ceph-mon[31212]: pgmap v18726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:07:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:07:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:07:13.064 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:07:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34944.030587 secs 2024-04-21T20:07:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:12 smithi077 ceph-mon[27902]: pgmap v18726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:07:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:07:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:07:13.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:07:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:15.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34945.787775 secs 2024-04-21T20:07:15.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:15 smithi077 ceph-mon[27902]: osdmap e1243: 12 total, 12 up, 12 in 2024-04-21T20:07:15.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:15 smithi077 ceph-mon[27902]: pgmap v18728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:07:15.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34945.787775 secs 2024-04-21T20:07:15.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:15 smithi191 ceph-mon[31636]: osdmap e1243: 12 total, 12 up, 12 in 2024-04-21T20:07:15.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:15 smithi191 ceph-mon[31636]: pgmap v18728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:07:15.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34945.787775 secs 2024-04-21T20:07:15.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:15 smithi170 ceph-mon[31212]: osdmap e1243: 12 total, 12 up, 12 in 2024-04-21T20:07:15.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:15 smithi170 ceph-mon[31212]: pgmap v18728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:07:17.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:17 smithi077 ceph-mon[27902]: pgmap v18729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:07:17.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:17 smithi191 ceph-mon[31636]: pgmap v18729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:07:17.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:17 smithi170 ceph-mon[31212]: pgmap v18729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:07:18.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34949.030728 secs 2024-04-21T20:07:18.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34949.030728 secs 2024-04-21T20:07:18.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34949.030728 secs 2024-04-21T20:07:19.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:19 smithi077 ceph-mon[27902]: pgmap v18730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:07:19.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:19 smithi191 ceph-mon[31636]: pgmap v18730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:07:19.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:19 smithi170 ceph-mon[31212]: pgmap v18730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:07:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:20.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34950.787880 secs 2024-04-21T20:07:20.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34950.787880 secs 2024-04-21T20:07:20.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34950.787880 secs 2024-04-21T20:07:21.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:21 smithi077 ceph-mon[27902]: pgmap v18731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:21.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:21 smithi191 ceph-mon[31636]: pgmap v18731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:21.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:21 smithi170 ceph-mon[31212]: pgmap v18731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34954.030841 secs 2024-04-21T20:07:23.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:23 smithi077 ceph-mon[27902]: pgmap v18732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:23.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34954.030841 secs 2024-04-21T20:07:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:23 smithi191 ceph-mon[31636]: pgmap v18732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:23.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34954.030841 secs 2024-04-21T20:07:23.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:23 smithi170 ceph-mon[31212]: pgmap v18732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:25.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34955.787993 secs 2024-04-21T20:07:25.393 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:25 smithi077 ceph-mon[27902]: pgmap v18733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:25.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34955.787993 secs 2024-04-21T20:07:25.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:25 smithi191 ceph-mon[31636]: pgmap v18733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:25.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34955.787993 secs 2024-04-21T20:07:25.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:25 smithi170 ceph-mon[31212]: pgmap v18733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:07:27.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:27 smithi077 ceph-mon[27902]: pgmap v18734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:27.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:27 smithi191 ceph-mon[31636]: pgmap v18734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:27.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:27 smithi170 ceph-mon[31212]: pgmap v18734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:28.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34959.030918 secs 2024-04-21T20:07:28.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34959.030918 secs 2024-04-21T20:07:28.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34959.030918 secs 2024-04-21T20:07:29.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:29 smithi077 ceph-mon[27902]: pgmap v18735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:29.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:29 smithi191 ceph-mon[31636]: pgmap v18735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:29.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:29 smithi170 ceph-mon[31212]: pgmap v18735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:30.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34960.788073 secs 2024-04-21T20:07:30.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34960.788073 secs 2024-04-21T20:07:30.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34960.788073 secs 2024-04-21T20:07:31.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:31 smithi077 ceph-mon[27902]: pgmap v18736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:31.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:31 smithi191 ceph-mon[31636]: pgmap v18736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:31.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:31 smithi170 ceph-mon[31212]: pgmap v18736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34964.031051 secs 2024-04-21T20:07:33.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:33 smithi077 ceph-mon[27902]: pgmap v18737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:33.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34964.031051 secs 2024-04-21T20:07:33.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:33 smithi191 ceph-mon[31636]: pgmap v18737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:33.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34964.031051 secs 2024-04-21T20:07:33.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:33 smithi170 ceph-mon[31212]: pgmap v18737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:35.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:35.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34965.788181 secs 2024-04-21T20:07:35.475 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:35 smithi191 ceph-mon[31636]: pgmap v18738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34965.788181 secs 2024-04-21T20:07:35.564 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:35 smithi170 ceph-mon[31212]: pgmap v18738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34965.788181 secs 2024-04-21T20:07:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:35 smithi077 ceph-mon[27902]: pgmap v18738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:37.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:37 smithi077 ceph-mon[27902]: pgmap v18739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:37.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:37 smithi191 ceph-mon[31636]: pgmap v18739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:37.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:37 smithi170 ceph-mon[31212]: pgmap v18739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:38.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34969.031165 secs 2024-04-21T20:07:38.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34969.031165 secs 2024-04-21T20:07:38.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34969.031165 secs 2024-04-21T20:07:39.627 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:39 smithi191 ceph-mon[31636]: pgmap v18740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:39.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:39 smithi077 ceph-mon[27902]: pgmap v18740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:39.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:39 smithi170 ceph-mon[31212]: pgmap v18740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:40.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34970.788293 secs 2024-04-21T20:07:40.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34970.788293 secs 2024-04-21T20:07:40.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34970.788293 secs 2024-04-21T20:07:41.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:41 smithi077 ceph-mon[27902]: pgmap v18741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:41.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:41 smithi191 ceph-mon[31636]: pgmap v18741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:41.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:41 smithi170 ceph-mon[31212]: pgmap v18741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34974.031287 secs 2024-04-21T20:07:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:43 smithi077 ceph-mon[27902]: pgmap v18742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34974.031287 secs 2024-04-21T20:07:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:43 smithi191 ceph-mon[31636]: pgmap v18742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:43.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34974.031287 secs 2024-04-21T20:07:43.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:43 smithi170 ceph-mon[31212]: pgmap v18742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:45.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34975.788411 secs 2024-04-21T20:07:45.645 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:45 smithi077 ceph-mon[27902]: pgmap v18743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34975.788411 secs 2024-04-21T20:07:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:45 smithi191 ceph-mon[31636]: pgmap v18743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:45.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34975.788411 secs 2024-04-21T20:07:45.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:45 smithi170 ceph-mon[31212]: pgmap v18743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:47.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:47 smithi077 ceph-mon[27902]: pgmap v18744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:47.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:47 smithi191 ceph-mon[31636]: pgmap v18744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:47.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:47 smithi170 ceph-mon[31212]: pgmap v18744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:48.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34979.031419 secs 2024-04-21T20:07:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34979.031419 secs 2024-04-21T20:07:48.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34979.031419 secs 2024-04-21T20:07:49.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:49 smithi077 ceph-mon[27902]: pgmap v18745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:49.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:49 smithi191 ceph-mon[31636]: pgmap v18745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:49.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:49 smithi170 ceph-mon[31212]: pgmap v18745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:50.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34980.788529 secs 2024-04-21T20:07:50.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34980.788529 secs 2024-04-21T20:07:50.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34980.788529 secs 2024-04-21T20:07:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:51 smithi077 ceph-mon[27902]: pgmap v18746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:51.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:51 smithi191 ceph-mon[31636]: pgmap v18746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:51.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:51 smithi170 ceph-mon[31212]: pgmap v18746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34984.031562 secs 2024-04-21T20:07:53.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:53 smithi077 ceph-mon[27902]: pgmap v18747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34984.031562 secs 2024-04-21T20:07:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:53 smithi191 ceph-mon[31636]: pgmap v18747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:53.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34984.031562 secs 2024-04-21T20:07:53.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:53 smithi170 ceph-mon[31212]: pgmap v18747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:55.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:07:55.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34985.788649 secs 2024-04-21T20:07:55.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:55 smithi077 ceph-mon[27902]: pgmap v18748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34985.788649 secs 2024-04-21T20:07:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:55 smithi191 ceph-mon[31636]: pgmap v18748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:55.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34985.788649 secs 2024-04-21T20:07:55.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:55 smithi170 ceph-mon[31212]: pgmap v18748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:57.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:57 smithi077 ceph-mon[27902]: pgmap v18749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:57.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:57 smithi191 ceph-mon[31636]: pgmap v18749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:57.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:57 smithi170 ceph-mon[31212]: pgmap v18749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:07:58.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34989.031613 secs 2024-04-21T20:07:58.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34989.031613 secs 2024-04-21T20:07:58.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34989.031613 secs 2024-04-21T20:07:59.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:07:59.192+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:07:59.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:07:59.192+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:07:59.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:07:59.192+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:07:59.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:07:59.192+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:07:59.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:07:59 smithi077 ceph-mon[27902]: pgmap v18750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:59.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:07:59 smithi191 ceph-mon[31636]: pgmap v18750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:07:59.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:07:59 smithi170 ceph-mon[31212]: pgmap v18750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:00.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34990.788764 secs 2024-04-21T20:08:00.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34990.788764 secs 2024-04-21T20:08:00.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34990.788764 secs 2024-04-21T20:08:01.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:01 smithi191 ceph-mon[31636]: pgmap v18751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:01.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:01 smithi170 ceph-mon[31212]: pgmap v18751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:01.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:01 smithi077 ceph-mon[27902]: pgmap v18751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:03.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34994.031725 secs 2024-04-21T20:08:03.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:03 smithi191 ceph-mon[31636]: pgmap v18752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34994.031725 secs 2024-04-21T20:08:03.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:03 smithi170 ceph-mon[31212]: pgmap v18752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:03.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34994.031725 secs 2024-04-21T20:08:03.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:03 smithi077 ceph-mon[27902]: pgmap v18752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:05.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:05.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 34995.788882 secs 2024-04-21T20:08:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:05 smithi191 ceph-mon[31636]: pgmap v18753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:05.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:05 smithi191 ceph-mon[31636]: osdmap e1244: 12 total, 12 up, 12 in 2024-04-21T20:08:05.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 34995.788882 secs 2024-04-21T20:08:05.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:05 smithi170 ceph-mon[31212]: pgmap v18753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:05.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:05 smithi170 ceph-mon[31212]: osdmap e1244: 12 total, 12 up, 12 in 2024-04-21T20:08:05.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 34995.788882 secs 2024-04-21T20:08:05.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:05 smithi077 ceph-mon[27902]: pgmap v18753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:05.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:05 smithi077 ceph-mon[27902]: osdmap e1244: 12 total, 12 up, 12 in 2024-04-21T20:08:07.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:07 smithi191 ceph-mon[31636]: pgmap v18755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:08:07.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:07 smithi170 ceph-mon[31212]: pgmap v18755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:08:07.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:07 smithi077 ceph-mon[27902]: pgmap v18755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:08:08.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 34999.031840 secs 2024-04-21T20:08:08.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 34999.031840 secs 2024-04-21T20:08:08.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 34999.031840 secs 2024-04-21T20:08:09.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:09 smithi191 ceph-mon[31636]: pgmap v18756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:08:09.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35000.788995 secs 2024-04-21T20:08:09.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:09 smithi191 ceph-mon[31636]: osdmap e1245: 12 total, 12 up, 12 in 2024-04-21T20:08:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:09 smithi170 ceph-mon[31212]: pgmap v18756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:08:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35000.788995 secs 2024-04-21T20:08:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:09 smithi170 ceph-mon[31212]: osdmap e1245: 12 total, 12 up, 12 in 2024-04-21T20:08:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:09 smithi077 ceph-mon[27902]: pgmap v18756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:08:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35000.788995 secs 2024-04-21T20:08:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:09 smithi077 ceph-mon[27902]: osdmap e1245: 12 total, 12 up, 12 in 2024-04-21T20:08:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:11.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:11 smithi191 ceph-mon[31636]: pgmap v18758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:08:11.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:11 smithi170 ceph-mon[31212]: pgmap v18758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:08:11.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:11 smithi077 ceph-mon[27902]: pgmap v18758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:08:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35004.031953 secs 2024-04-21T20:08:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:13 smithi191 ceph-mon[31636]: pgmap v18759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:08:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:08:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:08:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:08:13.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:08:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35004.031953 secs 2024-04-21T20:08:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:13 smithi170 ceph-mon[31212]: pgmap v18759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:08:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:08:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:08:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:08:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:08:13.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35004.031953 secs 2024-04-21T20:08:13.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:13 smithi077 ceph-mon[27902]: pgmap v18759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:08:13.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:08:13.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:08:13.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:08:13.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:08:14.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35005.789106 secs 2024-04-21T20:08:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35005.789106 secs 2024-04-21T20:08:14.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35005.789106 secs 2024-04-21T20:08:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:15.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:15 smithi191 ceph-mon[31636]: pgmap v18760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:08:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:15 smithi170 ceph-mon[31212]: pgmap v18760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:08:15.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:15 smithi077 ceph-mon[27902]: pgmap v18760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:08:17.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:17 smithi191 ceph-mon[31636]: pgmap v18761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:08:17.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:17 smithi170 ceph-mon[31212]: pgmap v18761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:08:17.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:17 smithi077 ceph-mon[27902]: pgmap v18761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:08:18.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35009.032068 secs 2024-04-21T20:08:18.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35009.032068 secs 2024-04-21T20:08:18.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35009.032068 secs 2024-04-21T20:08:19.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:19 smithi191 ceph-mon[31636]: pgmap v18762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:08:19.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35010.789258 secs 2024-04-21T20:08:19.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:19 smithi170 ceph-mon[31212]: pgmap v18762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:08:19.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35010.789258 secs 2024-04-21T20:08:19.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:19 smithi077 ceph-mon[27902]: pgmap v18762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:08:19.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35010.789258 secs 2024-04-21T20:08:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:21.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:21 smithi191 ceph-mon[31636]: pgmap v18763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:08:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:21 smithi170 ceph-mon[31212]: pgmap v18763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:08:21.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:21 smithi077 ceph-mon[27902]: pgmap v18763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:08:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35014.032183 secs 2024-04-21T20:08:23.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:23 smithi191 ceph-mon[31636]: pgmap v18764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:23.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35014.032183 secs 2024-04-21T20:08:23.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:23 smithi170 ceph-mon[31212]: pgmap v18764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:23.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35014.032183 secs 2024-04-21T20:08:23.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:23 smithi077 ceph-mon[27902]: pgmap v18764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:24.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35015.789399 secs 2024-04-21T20:08:24.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35015.789399 secs 2024-04-21T20:08:24.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35015.789399 secs 2024-04-21T20:08:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:25.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:25 smithi191 ceph-mon[31636]: pgmap v18765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:25.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:25 smithi170 ceph-mon[31212]: pgmap v18765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:25.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:25 smithi077 ceph-mon[27902]: pgmap v18765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:27.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:27 smithi191 ceph-mon[31636]: pgmap v18766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:27.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:27 smithi170 ceph-mon[31212]: pgmap v18766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:27.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:27 smithi077 ceph-mon[27902]: pgmap v18766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:28.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35019.032318 secs 2024-04-21T20:08:28.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35019.032318 secs 2024-04-21T20:08:28.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35019.032318 secs 2024-04-21T20:08:29.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:29 smithi191 ceph-mon[31636]: pgmap v18767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:29.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35020.789467 secs 2024-04-21T20:08:29.793 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:29 smithi077 ceph-mon[27902]: pgmap v18767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:29.793 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35020.789467 secs 2024-04-21T20:08:29.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:29 smithi170 ceph-mon[31212]: pgmap v18767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:29.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35020.789467 secs 2024-04-21T20:08:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:30 smithi170 ceph-mon[31212]: pgmap v18768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:30.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:30 smithi077 ceph-mon[27902]: pgmap v18768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:30.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:30 smithi191 ceph-mon[31636]: pgmap v18768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35024.032433 secs 2024-04-21T20:08:33.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:33 smithi077 ceph-mon[27902]: pgmap v18769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:33.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35024.032433 secs 2024-04-21T20:08:33.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:33 smithi191 ceph-mon[31636]: pgmap v18769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:33.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35024.032433 secs 2024-04-21T20:08:33.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:33 smithi170 ceph-mon[31212]: pgmap v18769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35025.789609 secs 2024-04-21T20:08:35.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:35 smithi077 ceph-mon[27902]: pgmap v18770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:35.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35025.789609 secs 2024-04-21T20:08:35.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:35 smithi191 ceph-mon[31636]: pgmap v18770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:35.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35025.789609 secs 2024-04-21T20:08:35.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:35 smithi170 ceph-mon[31212]: pgmap v18770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:37.615 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:37 smithi170 ceph-mon[31212]: pgmap v18771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:37.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:37 smithi077 ceph-mon[27902]: pgmap v18771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:37.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:37 smithi191 ceph-mon[31636]: pgmap v18771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:38.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35029.032549 secs 2024-04-21T20:08:38.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35029.032549 secs 2024-04-21T20:08:38.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35029.032549 secs 2024-04-21T20:08:39.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:39 smithi191 ceph-mon[31636]: pgmap v18772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:39.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:39 smithi077 ceph-mon[27902]: pgmap v18772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:39.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:39 smithi170 ceph-mon[31212]: pgmap v18772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:40.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:40.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35030.789734 secs 2024-04-21T20:08:40.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35030.789734 secs 2024-04-21T20:08:40.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35030.789734 secs 2024-04-21T20:08:41.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:41 smithi077 ceph-mon[27902]: pgmap v18773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:41.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:41 smithi191 ceph-mon[31636]: pgmap v18773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:41.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:41 smithi170 ceph-mon[31212]: pgmap v18773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35034.032687 secs 2024-04-21T20:08:43.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:43 smithi077 ceph-mon[27902]: pgmap v18774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35034.032687 secs 2024-04-21T20:08:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:43 smithi191 ceph-mon[31636]: pgmap v18774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35034.032687 secs 2024-04-21T20:08:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:43 smithi170 ceph-mon[31212]: pgmap v18774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:45.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35035.789831 secs 2024-04-21T20:08:45.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:45 smithi077 ceph-mon[27902]: pgmap v18775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35035.789831 secs 2024-04-21T20:08:45.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:45 smithi191 ceph-mon[31636]: pgmap v18775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:45.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35035.789831 secs 2024-04-21T20:08:45.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:45 smithi170 ceph-mon[31212]: pgmap v18775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:47.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:47 smithi077 ceph-mon[27902]: pgmap v18776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:47.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:47 smithi191 ceph-mon[31636]: pgmap v18776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:47.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:47 smithi170 ceph-mon[31212]: pgmap v18776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:48.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35039.032802 secs 2024-04-21T20:08:48.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35039.032802 secs 2024-04-21T20:08:48.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35039.032802 secs 2024-04-21T20:08:49.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:49 smithi077 ceph-mon[27902]: pgmap v18777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:49.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:49 smithi191 ceph-mon[31636]: pgmap v18777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:49.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:49 smithi170 ceph-mon[31212]: pgmap v18777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:50.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35040.789956 secs 2024-04-21T20:08:50.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35040.789956 secs 2024-04-21T20:08:50.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35040.789956 secs 2024-04-21T20:08:51.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:51 smithi077 ceph-mon[27902]: pgmap v18778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:51.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:51 smithi191 ceph-mon[31636]: pgmap v18778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:51.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:51 smithi170 ceph-mon[31212]: pgmap v18778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35044.032926 secs 2024-04-21T20:08:53.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:53 smithi077 ceph-mon[27902]: pgmap v18779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35044.032926 secs 2024-04-21T20:08:53.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:53 smithi191 ceph-mon[31636]: pgmap v18779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:53.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35044.032926 secs 2024-04-21T20:08:53.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:53 smithi170 ceph-mon[31212]: pgmap v18779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:55.140 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:08:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35045.790080 secs 2024-04-21T20:08:55.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:55 smithi191 ceph-mon[31636]: pgmap v18780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:55.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35045.790080 secs 2024-04-21T20:08:55.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:55 smithi170 ceph-mon[31212]: pgmap v18780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:55.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35045.790080 secs 2024-04-21T20:08:55.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:55 smithi077 ceph-mon[27902]: pgmap v18780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:57.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:57 smithi191 ceph-mon[31636]: pgmap v18781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:57.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:57 smithi170 ceph-mon[31212]: pgmap v18781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:57.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:57 smithi077 ceph-mon[27902]: pgmap v18781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:08:58.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35049.033046 secs 2024-04-21T20:08:58.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35049.033046 secs 2024-04-21T20:08:58.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35049.033046 secs 2024-04-21T20:08:59.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:08:59 smithi191 ceph-mon[31636]: pgmap v18782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:59.793 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:08:59 smithi077 ceph-mon[27902]: pgmap v18782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:08:59.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:08:59 smithi170 ceph-mon[31212]: pgmap v18782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:00.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35050.790209 secs 2024-04-21T20:09:00.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35050.790209 secs 2024-04-21T20:09:00.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35050.790209 secs 2024-04-21T20:09:01.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:01 smithi191 ceph-mon[31636]: pgmap v18783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:01.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:01 smithi170 ceph-mon[31212]: pgmap v18783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:01.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:01 smithi077 ceph-mon[27902]: pgmap v18783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:03.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35054.033163 secs 2024-04-21T20:09:03.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:03 smithi191 ceph-mon[31636]: pgmap v18784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35054.033163 secs 2024-04-21T20:09:03.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:03 smithi170 ceph-mon[31212]: pgmap v18784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:03.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35054.033163 secs 2024-04-21T20:09:03.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:03 smithi077 ceph-mon[27902]: pgmap v18784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:04.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35055.790329 secs 2024-04-21T20:09:04.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:04 smithi191 ceph-mon[31636]: osdmap e1246: 12 total, 12 up, 12 in 2024-04-21T20:09:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35055.790329 secs 2024-04-21T20:09:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:04 smithi170 ceph-mon[31212]: osdmap e1246: 12 total, 12 up, 12 in 2024-04-21T20:09:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35055.790329 secs 2024-04-21T20:09:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:04 smithi077 ceph-mon[27902]: osdmap e1246: 12 total, 12 up, 12 in 2024-04-21T20:09:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:05.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:05 smithi191 ceph-mon[31636]: pgmap v18785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:05.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:05 smithi170 ceph-mon[31212]: pgmap v18785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:05 smithi077 ceph-mon[27902]: pgmap v18785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:07.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:07 smithi191 ceph-mon[31636]: pgmap v18787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:09:07.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:07 smithi170 ceph-mon[31212]: pgmap v18787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:09:07.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:07 smithi077 ceph-mon[27902]: pgmap v18787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:09:08.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35059.033298 secs 2024-04-21T20:09:08.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35059.033298 secs 2024-04-21T20:09:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35059.033298 secs 2024-04-21T20:09:09.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:09 smithi170 ceph-mon[31212]: pgmap v18788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:09:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35060.790453 secs 2024-04-21T20:09:09.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:09 smithi170 ceph-mon[31212]: osdmap e1247: 12 total, 12 up, 12 in 2024-04-21T20:09:09.876 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:09 smithi191 ceph-mon[31636]: pgmap v18788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:09:09.876 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35060.790453 secs 2024-04-21T20:09:09.876 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:09 smithi191 ceph-mon[31636]: osdmap e1247: 12 total, 12 up, 12 in 2024-04-21T20:09:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:09 smithi077 ceph-mon[27902]: pgmap v18788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:09:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35060.790453 secs 2024-04-21T20:09:09.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:09 smithi077 ceph-mon[27902]: osdmap e1247: 12 total, 12 up, 12 in 2024-04-21T20:09:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:10.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:10 smithi170 ceph-mon[31212]: pgmap v18790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:09:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:10 smithi077 ceph-mon[27902]: pgmap v18790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:09:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:10 smithi191 ceph-mon[31636]: pgmap v18790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:09:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35064.033386 secs 2024-04-21T20:09:13.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:13 smithi077 ceph-mon[27902]: pgmap v18791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:09:13.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:09:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35064.033386 secs 2024-04-21T20:09:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:13 smithi191 ceph-mon[31636]: pgmap v18791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:09:13.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:09:13.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35064.033386 secs 2024-04-21T20:09:13.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:13 smithi170 ceph-mon[31212]: pgmap v18791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:09:13.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:09:14.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:09:14.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:09:14.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:09:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:09:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:09:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:09:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:09:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:09:14.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:09:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35065.790541 secs 2024-04-21T20:09:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:15 smithi077 ceph-mon[27902]: pgmap v18792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:09:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35065.790541 secs 2024-04-21T20:09:15.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:15 smithi191 ceph-mon[31636]: pgmap v18792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:09:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35065.790541 secs 2024-04-21T20:09:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:15 smithi170 ceph-mon[31212]: pgmap v18792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:09:17.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:17 smithi077 ceph-mon[27902]: pgmap v18793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:09:17.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:17 smithi191 ceph-mon[31636]: pgmap v18793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:09:17.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:17 smithi170 ceph-mon[31212]: pgmap v18793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:09:18.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35069.033509 secs 2024-04-21T20:09:18.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35069.033509 secs 2024-04-21T20:09:18.820 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35069.033509 secs 2024-04-21T20:09:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:19 smithi077 ceph-mon[27902]: pgmap v18794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:09:19.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:19 smithi191 ceph-mon[31636]: pgmap v18794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:09:19.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:19 smithi170 ceph-mon[31212]: pgmap v18794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:09:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:20.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35070.790685 secs 2024-04-21T20:09:20.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35070.790685 secs 2024-04-21T20:09:20.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35070.790685 secs 2024-04-21T20:09:21.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:21 smithi077 ceph-mon[27902]: pgmap v18795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:09:21.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:21 smithi191 ceph-mon[31636]: pgmap v18795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:09:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:21 smithi170 ceph-mon[31212]: pgmap v18795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:09:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35074.033623 secs 2024-04-21T20:09:23.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:23 smithi077 ceph-mon[27902]: pgmap v18796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35074.033623 secs 2024-04-21T20:09:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:23 smithi191 ceph-mon[31636]: pgmap v18796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35074.033623 secs 2024-04-21T20:09:23.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:23 smithi170 ceph-mon[31212]: pgmap v18796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35075.790826 secs 2024-04-21T20:09:25.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:25 smithi077 ceph-mon[27902]: pgmap v18797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:25.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35075.790826 secs 2024-04-21T20:09:25.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:25 smithi191 ceph-mon[31636]: pgmap v18797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:25.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35075.790826 secs 2024-04-21T20:09:25.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:25 smithi170 ceph-mon[31212]: pgmap v18797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:27.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:27 smithi077 ceph-mon[27902]: pgmap v18798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:27.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:27 smithi191 ceph-mon[31636]: pgmap v18798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:27.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:27 smithi170 ceph-mon[31212]: pgmap v18798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:28.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35079.033755 secs 2024-04-21T20:09:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35079.033755 secs 2024-04-21T20:09:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35079.033755 secs 2024-04-21T20:09:29.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:29 smithi191 ceph-mon[31636]: pgmap v18799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:29.793 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:29 smithi077 ceph-mon[27902]: pgmap v18799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:29.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:29 smithi170 ceph-mon[31212]: pgmap v18799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35080.790945 secs 2024-04-21T20:09:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35080.790945 secs 2024-04-21T20:09:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35080.790945 secs 2024-04-21T20:09:31.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:31 smithi191 ceph-mon[31636]: pgmap v18800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:31.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:31 smithi170 ceph-mon[31212]: pgmap v18800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:31.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:31 smithi077 ceph-mon[27902]: pgmap v18800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35084.033800 secs 2024-04-21T20:09:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:33 smithi191 ceph-mon[31636]: pgmap v18801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:33.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35084.033800 secs 2024-04-21T20:09:33.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:33 smithi170 ceph-mon[31212]: pgmap v18801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35084.033800 secs 2024-04-21T20:09:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:33 smithi077 ceph-mon[27902]: pgmap v18801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:35.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35085.791005 secs 2024-04-21T20:09:35.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:35 smithi191 ceph-mon[31636]: pgmap v18802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:35.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35085.791005 secs 2024-04-21T20:09:35.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:35 smithi170 ceph-mon[31212]: pgmap v18802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35085.791005 secs 2024-04-21T20:09:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:35 smithi077 ceph-mon[27902]: pgmap v18802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:37.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:37 smithi191 ceph-mon[31636]: pgmap v18803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:37.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:37 smithi170 ceph-mon[31212]: pgmap v18803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:37.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:37 smithi077 ceph-mon[27902]: pgmap v18803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:38.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35089.033914 secs 2024-04-21T20:09:38.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35089.033914 secs 2024-04-21T20:09:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35089.033914 secs 2024-04-21T20:09:39.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:39 smithi191 ceph-mon[31636]: pgmap v18804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:39.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:39 smithi170 ceph-mon[31212]: pgmap v18804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:39.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:39 smithi077 ceph-mon[27902]: pgmap v18804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:40.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35090.791122 secs 2024-04-21T20:09:40.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35090.791122 secs 2024-04-21T20:09:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35090.791122 secs 2024-04-21T20:09:41.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:41 smithi191 ceph-mon[31636]: pgmap v18805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:41.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:41 smithi170 ceph-mon[31212]: pgmap v18805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:41.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:41 smithi077 ceph-mon[27902]: pgmap v18805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:43.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35094.033992 secs 2024-04-21T20:09:43.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:43 smithi191 ceph-mon[31636]: pgmap v18806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:43.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35094.033992 secs 2024-04-21T20:09:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:43 smithi170 ceph-mon[31212]: pgmap v18806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:43.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35094.033992 secs 2024-04-21T20:09:43.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:43 smithi077 ceph-mon[27902]: pgmap v18806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:44.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35095.791184 secs 2024-04-21T20:09:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35095.791184 secs 2024-04-21T20:09:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35095.791184 secs 2024-04-21T20:09:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:45.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:45 smithi191 ceph-mon[31636]: pgmap v18807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:45.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:45 smithi170 ceph-mon[31212]: pgmap v18807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:45.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:45 smithi077 ceph-mon[27902]: pgmap v18807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:47.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:47 smithi191 ceph-mon[31636]: pgmap v18808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:47.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:47 smithi170 ceph-mon[31212]: pgmap v18808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:47.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:47 smithi077 ceph-mon[27902]: pgmap v18808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:48.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35099.034077 secs 2024-04-21T20:09:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35099.034077 secs 2024-04-21T20:09:48.896 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35099.034077 secs 2024-04-21T20:09:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:49 smithi191 ceph-mon[31636]: pgmap v18809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35100.791337 secs 2024-04-21T20:09:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:49 smithi170 ceph-mon[31212]: pgmap v18809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:49.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35100.791337 secs 2024-04-21T20:09:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:49 smithi077 ceph-mon[27902]: pgmap v18809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35100.791337 secs 2024-04-21T20:09:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:51.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:51 smithi191 ceph-mon[31636]: pgmap v18810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:51.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:51 smithi170 ceph-mon[31212]: pgmap v18810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:51.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:51 smithi077 ceph-mon[27902]: pgmap v18810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35104.034215 secs 2024-04-21T20:09:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:53 smithi191 ceph-mon[31636]: pgmap v18811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:53.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35104.034215 secs 2024-04-21T20:09:53.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:53 smithi170 ceph-mon[31212]: pgmap v18811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:53.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35104.034215 secs 2024-04-21T20:09:53.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:53 smithi077 ceph-mon[27902]: pgmap v18811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:54.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35105.791437 secs 2024-04-21T20:09:54.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35105.791437 secs 2024-04-21T20:09:54.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35105.791437 secs 2024-04-21T20:09:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:09:55.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:55 smithi191 ceph-mon[31636]: pgmap v18812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:55.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:55 smithi170 ceph-mon[31212]: pgmap v18812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:55.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:55 smithi077 ceph-mon[27902]: pgmap v18812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:57.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:57 smithi191 ceph-mon[31636]: pgmap v18813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:57.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:57 smithi170 ceph-mon[31212]: pgmap v18813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:57.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:57 smithi077 ceph-mon[27902]: pgmap v18813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:09:58.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35109.034296 secs 2024-04-21T20:09:58.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35109.034296 secs 2024-04-21T20:09:58.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35109.034296 secs 2024-04-21T20:09:59.793 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:59 smithi077 ceph-mon[27902]: pgmap v18814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:59.793 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:09:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35110.791551 secs 2024-04-21T20:09:59.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:59 smithi170 ceph-mon[31212]: pgmap v18814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:59.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:09:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35110.791551 secs 2024-04-21T20:09:59.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:59 smithi191 ceph-mon[31636]: pgmap v18814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:09:59.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:09:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35110.791551 secs 2024-04-21T20:10:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:00.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:10:00.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:10:00.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:10:01.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:01 smithi170 ceph-mon[31212]: pgmap v18815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T20:10:01.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:01 smithi077 ceph-mon[27902]: pgmap v18815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T20:10:01.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:01 smithi191 ceph-mon[31636]: pgmap v18815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T20:10:02.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:02 smithi170 ceph-mon[31212]: pgmap v18816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:10:02.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:02 smithi077 ceph-mon[27902]: pgmap v18816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:10:02.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:02 smithi191 ceph-mon[31636]: pgmap v18816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:10:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35114.034358 secs 2024-04-21T20:10:03.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35114.034358 secs 2024-04-21T20:10:03.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35114.034358 secs 2024-04-21T20:10:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35115.791650 secs 2024-04-21T20:10:04.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:04 smithi170 ceph-mon[31212]: pgmap v18817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:10:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35115.791650 secs 2024-04-21T20:10:04.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:04 smithi077 ceph-mon[27902]: pgmap v18817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:10:04.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35115.791650 secs 2024-04-21T20:10:04.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:04 smithi191 ceph-mon[31636]: pgmap v18817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:10:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:05 smithi170 ceph-mon[31212]: osdmap e1248: 12 total, 12 up, 12 in 2024-04-21T20:10:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:05 smithi077 ceph-mon[27902]: osdmap e1248: 12 total, 12 up, 12 in 2024-04-21T20:10:05.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:05 smithi191 ceph-mon[31636]: osdmap e1248: 12 total, 12 up, 12 in 2024-04-21T20:10:06.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:06 smithi170 ceph-mon[31212]: pgmap v18819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:10:06.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:06 smithi077 ceph-mon[27902]: pgmap v18819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:10:06.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:06 smithi191 ceph-mon[31636]: pgmap v18819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:10:08.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35119.034435 secs 2024-04-21T20:10:08.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35119.034435 secs 2024-04-21T20:10:08.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35119.034435 secs 2024-04-21T20:10:09.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:08 smithi170 ceph-mon[31212]: pgmap v18820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:10:09.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:08 smithi191 ceph-mon[31636]: pgmap v18820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:10:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:08 smithi077 ceph-mon[27902]: pgmap v18820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:10:10.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35120.791765 secs 2024-04-21T20:10:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:10.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35120.791765 secs 2024-04-21T20:10:10.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35120.791765 secs 2024-04-21T20:10:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:10 smithi170 ceph-mon[31212]: pgmap v18821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:11.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:10 smithi077 ceph-mon[27902]: pgmap v18821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:11.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:10 smithi191 ceph-mon[31636]: pgmap v18821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35124.034534 secs 2024-04-21T20:10:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:13 smithi077 ceph-mon[27902]: pgmap v18822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35124.034534 secs 2024-04-21T20:10:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:13 smithi191 ceph-mon[31636]: pgmap v18822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35124.034534 secs 2024-04-21T20:10:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:13 smithi170 ceph-mon[31212]: pgmap v18822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:14.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:10:14.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:14 smithi077 ceph-mon[27902]: osdmap e1249: 12 total, 12 up, 12 in 2024-04-21T20:10:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:10:14.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:14 smithi191 ceph-mon[31636]: osdmap e1249: 12 total, 12 up, 12 in 2024-04-21T20:10:14.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:10:14.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:14 smithi170 ceph-mon[31212]: osdmap e1249: 12 total, 12 up, 12 in 2024-04-21T20:10:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35125.791881 secs 2024-04-21T20:10:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:15 smithi077 ceph-mon[27902]: pgmap v18824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:10:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:10:15.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:10:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35125.791881 secs 2024-04-21T20:10:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:15 smithi191 ceph-mon[31636]: pgmap v18824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:10:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:10:15.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:10:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35125.791881 secs 2024-04-21T20:10:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:15 smithi170 ceph-mon[31212]: pgmap v18824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:10:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:10:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:10:15.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:10:17.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:17 smithi077 ceph-mon[27902]: pgmap v18825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:10:17.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:17 smithi191 ceph-mon[31636]: pgmap v18825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:10:17.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:17 smithi170 ceph-mon[31212]: pgmap v18825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:10:18.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35129.034596 secs 2024-04-21T20:10:18.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35129.034596 secs 2024-04-21T20:10:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35129.034596 secs 2024-04-21T20:10:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:19 smithi077 ceph-mon[27902]: pgmap v18826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:10:19.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:19 smithi191 ceph-mon[31636]: pgmap v18826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:10:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:19 smithi170 ceph-mon[31212]: pgmap v18826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:10:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:20.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35130.791994 secs 2024-04-21T20:10:20.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35130.791994 secs 2024-04-21T20:10:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35130.791994 secs 2024-04-21T20:10:21.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:21 smithi191 ceph-mon[31636]: pgmap v18827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:21.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:21 smithi170 ceph-mon[31212]: pgmap v18827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:21.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:21 smithi077 ceph-mon[27902]: pgmap v18827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35134.034692 secs 2024-04-21T20:10:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:23 smithi191 ceph-mon[31636]: pgmap v18828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35134.034692 secs 2024-04-21T20:10:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:23 smithi170 ceph-mon[31212]: pgmap v18828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35134.034692 secs 2024-04-21T20:10:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:23 smithi077 ceph-mon[27902]: pgmap v18828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:25.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35135.792054 secs 2024-04-21T20:10:25.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:25 smithi191 ceph-mon[31636]: pgmap v18829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:25.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35135.792054 secs 2024-04-21T20:10:25.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:25 smithi170 ceph-mon[31212]: pgmap v18829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:25.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35135.792054 secs 2024-04-21T20:10:25.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:25 smithi077 ceph-mon[27902]: pgmap v18829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:10:27.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:27 smithi191 ceph-mon[31636]: pgmap v18830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:27.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:27 smithi170 ceph-mon[31212]: pgmap v18830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:27.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:27 smithi077 ceph-mon[27902]: pgmap v18830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:28.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35139.034850 secs 2024-04-21T20:10:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35139.034850 secs 2024-04-21T20:10:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35139.034850 secs 2024-04-21T20:10:29.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:29 smithi191 ceph-mon[31636]: pgmap v18831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:29.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:29 smithi077 ceph-mon[27902]: pgmap v18831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:29 smithi170 ceph-mon[31212]: pgmap v18831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35140.792145 secs 2024-04-21T20:10:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35140.792145 secs 2024-04-21T20:10:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35140.792145 secs 2024-04-21T20:10:31.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:31 smithi191 ceph-mon[31636]: pgmap v18832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:31.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:31 smithi170 ceph-mon[31212]: pgmap v18832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:31.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:31 smithi077 ceph-mon[27902]: pgmap v18832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35144.034931 secs 2024-04-21T20:10:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:33 smithi191 ceph-mon[31636]: pgmap v18833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:33.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35144.034931 secs 2024-04-21T20:10:33.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:33 smithi170 ceph-mon[31212]: pgmap v18833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35144.034931 secs 2024-04-21T20:10:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:33 smithi077 ceph-mon[27902]: pgmap v18833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:35.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35145.792211 secs 2024-04-21T20:10:35.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:35 smithi191 ceph-mon[31636]: pgmap v18834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:35.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35145.792211 secs 2024-04-21T20:10:35.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:35 smithi170 ceph-mon[31212]: pgmap v18834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35145.792211 secs 2024-04-21T20:10:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:35 smithi077 ceph-mon[27902]: pgmap v18834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:37.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:37 smithi191 ceph-mon[31636]: pgmap v18835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:37.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:37 smithi170 ceph-mon[31212]: pgmap v18835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:37.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:37 smithi077 ceph-mon[27902]: pgmap v18835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:38.714 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35149.035010 secs 2024-04-21T20:10:38.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35149.035010 secs 2024-04-21T20:10:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35149.035010 secs 2024-04-21T20:10:39.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:39 smithi191 ceph-mon[31636]: pgmap v18836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:39.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35150.792308 secs 2024-04-21T20:10:39.733 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:39 smithi170 ceph-mon[31212]: pgmap v18836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:39.733 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35150.792308 secs 2024-04-21T20:10:39.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:39 smithi077 ceph-mon[27902]: pgmap v18836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:39.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35150.792308 secs 2024-04-21T20:10:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:41.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:41 smithi191 ceph-mon[31636]: pgmap v18837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:41.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:41 smithi170 ceph-mon[31212]: pgmap v18837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:41.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:41 smithi077 ceph-mon[27902]: pgmap v18837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:43.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35154.035124 secs 2024-04-21T20:10:43.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:43 smithi191 ceph-mon[31636]: pgmap v18838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:43.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35154.035124 secs 2024-04-21T20:10:43.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:43 smithi170 ceph-mon[31212]: pgmap v18838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:43.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35154.035124 secs 2024-04-21T20:10:43.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:43 smithi077 ceph-mon[27902]: pgmap v18838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:44.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35155.792447 secs 2024-04-21T20:10:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35155.792447 secs 2024-04-21T20:10:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35155.792447 secs 2024-04-21T20:10:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:45.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:45 smithi191 ceph-mon[31636]: pgmap v18839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:45.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:45 smithi170 ceph-mon[31212]: pgmap v18839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:45.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:45 smithi077 ceph-mon[27902]: pgmap v18839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:47.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:47 smithi191 ceph-mon[31636]: pgmap v18840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:47.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:47 smithi170 ceph-mon[31212]: pgmap v18840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:47.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:47 smithi077 ceph-mon[27902]: pgmap v18840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:48.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35159.035206 secs 2024-04-21T20:10:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35159.035206 secs 2024-04-21T20:10:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35159.035206 secs 2024-04-21T20:10:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:49 smithi191 ceph-mon[31636]: pgmap v18841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35160.792560 secs 2024-04-21T20:10:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:49 smithi170 ceph-mon[31212]: pgmap v18841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35160.792560 secs 2024-04-21T20:10:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:49 smithi077 ceph-mon[27902]: pgmap v18841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35160.792560 secs 2024-04-21T20:10:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:51.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:51 smithi191 ceph-mon[31636]: pgmap v18842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:51 smithi170 ceph-mon[31212]: pgmap v18842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:51.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:51 smithi077 ceph-mon[27902]: pgmap v18842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35164.035267 secs 2024-04-21T20:10:53.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:53 smithi191 ceph-mon[31636]: pgmap v18843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:53.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35164.035267 secs 2024-04-21T20:10:53.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:53 smithi170 ceph-mon[31212]: pgmap v18843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:53.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35164.035267 secs 2024-04-21T20:10:53.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:53 smithi077 ceph-mon[27902]: pgmap v18843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35165.792676 secs 2024-04-21T20:10:54.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35165.792676 secs 2024-04-21T20:10:54.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35165.792676 secs 2024-04-21T20:10:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:10:55.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:55 smithi191 ceph-mon[31636]: pgmap v18844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:55.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:55 smithi170 ceph-mon[31212]: pgmap v18844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:55.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:55 smithi077 ceph-mon[27902]: pgmap v18844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:57.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:57 smithi191 ceph-mon[31636]: pgmap v18845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:57.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:57 smithi170 ceph-mon[31212]: pgmap v18845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:57.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:57 smithi077 ceph-mon[27902]: pgmap v18845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:10:58.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35169.035384 secs 2024-04-21T20:10:58.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35169.035384 secs 2024-04-21T20:10:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35169.035384 secs 2024-04-21T20:10:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:10:59.216+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:10:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:10:59.216+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:10:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:10:59.216+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:10:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:10:59.216+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:10:59.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:59 smithi077 ceph-mon[27902]: pgmap v18846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:59.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:10:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35170.792788 secs 2024-04-21T20:10:59.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:59 smithi170 ceph-mon[31212]: pgmap v18846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:59.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:10:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35170.792788 secs 2024-04-21T20:10:59.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:59 smithi191 ceph-mon[31636]: pgmap v18846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:10:59.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:10:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35170.792788 secs 2024-04-21T20:11:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:01.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:01 smithi170 ceph-mon[31212]: pgmap v18847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:01.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:01 smithi077 ceph-mon[27902]: pgmap v18847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:01.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:01 smithi191 ceph-mon[31636]: pgmap v18847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35174.035496 secs 2024-04-21T20:11:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:03 smithi170 ceph-mon[31212]: pgmap v18848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:03.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35174.035496 secs 2024-04-21T20:11:03.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:03 smithi077 ceph-mon[27902]: pgmap v18848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:03.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35174.035496 secs 2024-04-21T20:11:03.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:03 smithi191 ceph-mon[31636]: pgmap v18848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:04.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35175.792890 secs 2024-04-21T20:11:04.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35175.792890 secs 2024-04-21T20:11:04.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35175.792890 secs 2024-04-21T20:11:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:05 smithi170 ceph-mon[31212]: pgmap v18849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:05 smithi170 ceph-mon[31212]: osdmap e1250: 12 total, 12 up, 12 in 2024-04-21T20:11:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:05 smithi077 ceph-mon[27902]: pgmap v18849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:05 smithi077 ceph-mon[27902]: osdmap e1250: 12 total, 12 up, 12 in 2024-04-21T20:11:05.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:05 smithi191 ceph-mon[31636]: pgmap v18849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:05.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:05 smithi191 ceph-mon[31636]: osdmap e1250: 12 total, 12 up, 12 in 2024-04-21T20:11:06.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:06 smithi170 ceph-mon[31212]: pgmap v18851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:11:06.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:06 smithi077 ceph-mon[27902]: pgmap v18851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:11:06.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:06 smithi191 ceph-mon[31636]: pgmap v18851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:11:08.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35179.035617 secs 2024-04-21T20:11:08.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35179.035617 secs 2024-04-21T20:11:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35179.035617 secs 2024-04-21T20:11:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:08 smithi170 ceph-mon[31212]: pgmap v18852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:11:09.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:08 smithi191 ceph-mon[31636]: pgmap v18852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:11:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:08 smithi077 ceph-mon[27902]: pgmap v18852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:11:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:10.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35180.792951 secs 2024-04-21T20:11:10.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:10 smithi191 ceph-mon[31636]: osdmap e1251: 12 total, 12 up, 12 in 2024-04-21T20:11:10.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35180.792951 secs 2024-04-21T20:11:10.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:10 smithi170 ceph-mon[31212]: osdmap e1251: 12 total, 12 up, 12 in 2024-04-21T20:11:10.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35180.792951 secs 2024-04-21T20:11:10.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:10 smithi077 ceph-mon[27902]: osdmap e1251: 12 total, 12 up, 12 in 2024-04-21T20:11:11.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:11 smithi191 ceph-mon[31636]: pgmap v18854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:11:11.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:11 smithi170 ceph-mon[31212]: pgmap v18854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:11:11.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:11 smithi077 ceph-mon[27902]: pgmap v18854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:11:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35184.035750 secs 2024-04-21T20:11:13.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:13 smithi077 ceph-mon[27902]: pgmap v18855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:11:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35184.035750 secs 2024-04-21T20:11:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:13 smithi191 ceph-mon[31636]: pgmap v18855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:11:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35184.035750 secs 2024-04-21T20:11:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:13 smithi170 ceph-mon[31212]: pgmap v18855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:11:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35185.793025 secs 2024-04-21T20:11:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:15 smithi191 ceph-mon[31636]: pgmap v18856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:11:15.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:11:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35185.793025 secs 2024-04-21T20:11:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:15 smithi170 ceph-mon[31212]: pgmap v18856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:11:15.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:11:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35185.793025 secs 2024-04-21T20:11:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:15 smithi077 ceph-mon[27902]: pgmap v18856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:11:15.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:11:16.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:11:16.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:11:16.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:11:16.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:11:16.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:11:16.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:11:16.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:11:16.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:11:16.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:11:17.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:17 smithi191 ceph-mon[31636]: pgmap v18857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:11:17.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:17 smithi170 ceph-mon[31212]: pgmap v18857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:11:17.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:17 smithi077 ceph-mon[27902]: pgmap v18857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:11:18.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35189.035842 secs 2024-04-21T20:11:18.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35189.035842 secs 2024-04-21T20:11:18.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35189.035842 secs 2024-04-21T20:11:19.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:19 smithi191 ceph-mon[31636]: pgmap v18858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:11:19.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:19 smithi170 ceph-mon[31212]: pgmap v18858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:11:19.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:19 smithi077 ceph-mon[27902]: pgmap v18858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:11:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:20.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35190.793106 secs 2024-04-21T20:11:20.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35190.793106 secs 2024-04-21T20:11:20.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35190.793106 secs 2024-04-21T20:11:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:21 smithi170 ceph-mon[31212]: pgmap v18859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:11:21.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:21 smithi077 ceph-mon[27902]: pgmap v18859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:11:21.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:21 smithi191 ceph-mon[31636]: pgmap v18859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:11:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35194.035956 secs 2024-04-21T20:11:23.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:23 smithi077 ceph-mon[27902]: pgmap v18860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35194.035956 secs 2024-04-21T20:11:23.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:23 smithi191 ceph-mon[31636]: pgmap v18860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35194.035956 secs 2024-04-21T20:11:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:23 smithi170 ceph-mon[31212]: pgmap v18860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35195.793183 secs 2024-04-21T20:11:25.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:25 smithi191 ceph-mon[31636]: pgmap v18861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35195.793183 secs 2024-04-21T20:11:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:25 smithi170 ceph-mon[31212]: pgmap v18861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35195.793183 secs 2024-04-21T20:11:25.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:25 smithi077 ceph-mon[27902]: pgmap v18861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:27.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:27 smithi191 ceph-mon[31636]: pgmap v18862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:27.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:27 smithi170 ceph-mon[31212]: pgmap v18862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:27.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:27 smithi077 ceph-mon[27902]: pgmap v18862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:28.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35199.036065 secs 2024-04-21T20:11:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35199.036065 secs 2024-04-21T20:11:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35199.036065 secs 2024-04-21T20:11:29.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:29 smithi191 ceph-mon[31636]: pgmap v18863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:29.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:29 smithi077 ceph-mon[27902]: pgmap v18863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:29 smithi170 ceph-mon[31212]: pgmap v18863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35200.793261 secs 2024-04-21T20:11:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35200.793261 secs 2024-04-21T20:11:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35200.793261 secs 2024-04-21T20:11:31.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:31 smithi191 ceph-mon[31636]: pgmap v18864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:31.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:31 smithi170 ceph-mon[31212]: pgmap v18864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:31.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:31 smithi077 ceph-mon[27902]: pgmap v18864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35204.036181 secs 2024-04-21T20:11:33.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:33 smithi191 ceph-mon[31636]: pgmap v18865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:33.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35204.036181 secs 2024-04-21T20:11:33.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:33 smithi170 ceph-mon[31212]: pgmap v18865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35204.036181 secs 2024-04-21T20:11:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:33 smithi077 ceph-mon[27902]: pgmap v18865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:35.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35205.793375 secs 2024-04-21T20:11:35.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:35 smithi191 ceph-mon[31636]: pgmap v18866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:35.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35205.793375 secs 2024-04-21T20:11:35.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:35 smithi170 ceph-mon[31212]: pgmap v18866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35205.793375 secs 2024-04-21T20:11:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:35 smithi077 ceph-mon[27902]: pgmap v18866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:37.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:37 smithi191 ceph-mon[31636]: pgmap v18867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:37.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:37 smithi170 ceph-mon[31212]: pgmap v18867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:37 smithi077 ceph-mon[27902]: pgmap v18867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:38.712 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35209.036316 secs 2024-04-21T20:11:38.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35209.036316 secs 2024-04-21T20:11:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35209.036316 secs 2024-04-21T20:11:39.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:39 smithi191 ceph-mon[31636]: pgmap v18868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:39.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:39 smithi170 ceph-mon[31212]: pgmap v18868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:39 smithi077 ceph-mon[27902]: pgmap v18868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:40.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35210.793509 secs 2024-04-21T20:11:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35210.793509 secs 2024-04-21T20:11:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35210.793509 secs 2024-04-21T20:11:41.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:41 smithi191 ceph-mon[31636]: pgmap v18869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:41.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:41 smithi170 ceph-mon[31212]: pgmap v18869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:41.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:41 smithi077 ceph-mon[27902]: pgmap v18869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:43.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35214.036446 secs 2024-04-21T20:11:43.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:43 smithi191 ceph-mon[31636]: pgmap v18870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:43.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35214.036446 secs 2024-04-21T20:11:43.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:43 smithi170 ceph-mon[31212]: pgmap v18870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35214.036446 secs 2024-04-21T20:11:43.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:43 smithi077 ceph-mon[27902]: pgmap v18870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:45.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35215.793658 secs 2024-04-21T20:11:45.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:45 smithi191 ceph-mon[31636]: pgmap v18871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:45.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35215.793658 secs 2024-04-21T20:11:45.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:45 smithi170 ceph-mon[31212]: pgmap v18871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:45.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35215.793658 secs 2024-04-21T20:11:45.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:45 smithi077 ceph-mon[27902]: pgmap v18871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:47.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:47 smithi191 ceph-mon[31636]: pgmap v18872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:47.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:47 smithi170 ceph-mon[31212]: pgmap v18872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:47.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:47 smithi077 ceph-mon[27902]: pgmap v18872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:48.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35219.036593 secs 2024-04-21T20:11:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35219.036593 secs 2024-04-21T20:11:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35219.036593 secs 2024-04-21T20:11:49.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:49 smithi191 ceph-mon[31636]: pgmap v18873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:49.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35220.793793 secs 2024-04-21T20:11:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:49 smithi170 ceph-mon[31212]: pgmap v18873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35220.793793 secs 2024-04-21T20:11:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:49 smithi077 ceph-mon[27902]: pgmap v18873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:49.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35220.793793 secs 2024-04-21T20:11:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:51 smithi191 ceph-mon[31636]: pgmap v18874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:51.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:51 smithi170 ceph-mon[31212]: pgmap v18874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:51 smithi077 ceph-mon[27902]: pgmap v18874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:53.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35224.036724 secs 2024-04-21T20:11:53.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:53 smithi191 ceph-mon[31636]: pgmap v18875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:53.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35224.036724 secs 2024-04-21T20:11:53.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:53 smithi170 ceph-mon[31212]: pgmap v18875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35224.036724 secs 2024-04-21T20:11:53.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:53 smithi077 ceph-mon[27902]: pgmap v18875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35225.793887 secs 2024-04-21T20:11:54.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35225.793887 secs 2024-04-21T20:11:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35225.793887 secs 2024-04-21T20:11:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:11:55.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:55 smithi191 ceph-mon[31636]: pgmap v18876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:55.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:55 smithi170 ceph-mon[31212]: pgmap v18876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:55 smithi077 ceph-mon[27902]: pgmap v18876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:57.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:57 smithi191 ceph-mon[31636]: pgmap v18877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:57.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:57 smithi170 ceph-mon[31212]: pgmap v18877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:57.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:57 smithi077 ceph-mon[27902]: pgmap v18877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:11:58.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35229.036841 secs 2024-04-21T20:11:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35229.036841 secs 2024-04-21T20:11:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35229.036841 secs 2024-04-21T20:11:59.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:59 smithi077 ceph-mon[27902]: pgmap v18878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:59.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:11:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35230.793966 secs 2024-04-21T20:11:59.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:59 smithi170 ceph-mon[31212]: pgmap v18878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:59.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:11:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35230.793966 secs 2024-04-21T20:11:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:59 smithi191 ceph-mon[31636]: pgmap v18878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:11:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:11:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35230.793966 secs 2024-04-21T20:12:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:01.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:01 smithi170 ceph-mon[31212]: pgmap v18879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:01.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:01 smithi077 ceph-mon[27902]: pgmap v18879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:01.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:01 smithi191 ceph-mon[31636]: pgmap v18879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35234.036958 secs 2024-04-21T20:12:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:03 smithi170 ceph-mon[31212]: pgmap v18880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:03.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35234.036958 secs 2024-04-21T20:12:03.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:03 smithi077 ceph-mon[27902]: pgmap v18880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35234.036958 secs 2024-04-21T20:12:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:03 smithi191 ceph-mon[31636]: pgmap v18880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:04.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35235.794048 secs 2024-04-21T20:12:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35235.794048 secs 2024-04-21T20:12:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35235.794048 secs 2024-04-21T20:12:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:05 smithi170 ceph-mon[31212]: pgmap v18881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:05 smithi170 ceph-mon[31212]: osdmap e1252: 12 total, 12 up, 12 in 2024-04-21T20:12:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:05 smithi077 ceph-mon[27902]: pgmap v18881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:05 smithi077 ceph-mon[27902]: osdmap e1252: 12 total, 12 up, 12 in 2024-04-21T20:12:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:05 smithi191 ceph-mon[31636]: pgmap v18881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:05.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:05 smithi191 ceph-mon[31636]: osdmap e1252: 12 total, 12 up, 12 in 2024-04-21T20:12:07.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:07 smithi170 ceph-mon[31212]: pgmap v18883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:12:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:07 smithi077 ceph-mon[27902]: pgmap v18883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:12:07.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:07 smithi191 ceph-mon[31636]: pgmap v18883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:12:08.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35239.037040 secs 2024-04-21T20:12:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35239.037040 secs 2024-04-21T20:12:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35239.037040 secs 2024-04-21T20:12:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:09 smithi170 ceph-mon[31212]: pgmap v18884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:12:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35240.794144 secs 2024-04-21T20:12:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:09 smithi170 ceph-mon[31212]: osdmap e1253: 12 total, 12 up, 12 in 2024-04-21T20:12:09.875 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:09 smithi191 ceph-mon[31636]: pgmap v18884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:12:09.875 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35240.794144 secs 2024-04-21T20:12:09.875 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:09 smithi191 ceph-mon[31636]: osdmap e1253: 12 total, 12 up, 12 in 2024-04-21T20:12:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:09 smithi077 ceph-mon[27902]: pgmap v18884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:12:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35240.794144 secs 2024-04-21T20:12:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:09 smithi077 ceph-mon[27902]: osdmap e1253: 12 total, 12 up, 12 in 2024-04-21T20:12:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:10 smithi170 ceph-mon[31212]: pgmap v18886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:12:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:10 smithi077 ceph-mon[27902]: pgmap v18886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:12:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:10 smithi191 ceph-mon[31636]: pgmap v18886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:12:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35244.037176 secs 2024-04-21T20:12:13.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:13 smithi191 ceph-mon[31636]: pgmap v18887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:12:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35244.037176 secs 2024-04-21T20:12:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:13 smithi170 ceph-mon[31212]: pgmap v18887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:12:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35244.037176 secs 2024-04-21T20:12:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:13 smithi077 ceph-mon[27902]: pgmap v18887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:12:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35245.794220 secs 2024-04-21T20:12:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:15 smithi191 ceph-mon[31636]: pgmap v18888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:12:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35245.794220 secs 2024-04-21T20:12:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:15 smithi170 ceph-mon[31212]: pgmap v18888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:12:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35245.794220 secs 2024-04-21T20:12:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:15 smithi077 ceph-mon[27902]: pgmap v18888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:12:16.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:12:16.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:12:16.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:12:16.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:12:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:12:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:12:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:12:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:12:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:12:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:12:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:12:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:12:17.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:17 smithi191 ceph-mon[31636]: pgmap v18889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:12:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:17 smithi170 ceph-mon[31212]: pgmap v18889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:12:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:17 smithi077 ceph-mon[27902]: pgmap v18889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:12:18.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35249.037314 secs 2024-04-21T20:12:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35249.037314 secs 2024-04-21T20:12:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35249.037314 secs 2024-04-21T20:12:19.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:19 smithi191 ceph-mon[31636]: pgmap v18890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:12:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:19 smithi170 ceph-mon[31212]: pgmap v18890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:12:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:19 smithi077 ceph-mon[27902]: pgmap v18890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:12:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:20.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35250.794330 secs 2024-04-21T20:12:20.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35250.794330 secs 2024-04-21T20:12:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35250.794330 secs 2024-04-21T20:12:21.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:21 smithi191 ceph-mon[31636]: pgmap v18891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:12:21.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:21 smithi170 ceph-mon[31212]: pgmap v18891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:12:21.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:21 smithi077 ceph-mon[27902]: pgmap v18891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:12:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35254.037417 secs 2024-04-21T20:12:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:23 smithi191 ceph-mon[31636]: pgmap v18892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35254.037417 secs 2024-04-21T20:12:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:23 smithi170 ceph-mon[31212]: pgmap v18892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35254.037417 secs 2024-04-21T20:12:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:23 smithi077 ceph-mon[27902]: pgmap v18892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35255.794464 secs 2024-04-21T20:12:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:25 smithi191 ceph-mon[31636]: pgmap v18893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:25.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35255.794464 secs 2024-04-21T20:12:25.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:25 smithi170 ceph-mon[31212]: pgmap v18893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35255.794464 secs 2024-04-21T20:12:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:25 smithi077 ceph-mon[27902]: pgmap v18893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:27.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:27 smithi191 ceph-mon[31636]: pgmap v18894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:27 smithi170 ceph-mon[31212]: pgmap v18894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:27.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:27 smithi077 ceph-mon[27902]: pgmap v18894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:28.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35259.037516 secs 2024-04-21T20:12:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35259.037516 secs 2024-04-21T20:12:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35259.037516 secs 2024-04-21T20:12:29.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:29 smithi191 ceph-mon[31636]: pgmap v18895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:29.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35260.794541 secs 2024-04-21T20:12:29.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:29 smithi077 ceph-mon[27902]: pgmap v18895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:29.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35260.794541 secs 2024-04-21T20:12:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:29 smithi170 ceph-mon[31212]: pgmap v18895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35260.794541 secs 2024-04-21T20:12:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:31 smithi191 ceph-mon[31636]: pgmap v18896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:31 smithi170 ceph-mon[31212]: pgmap v18896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:31 smithi077 ceph-mon[27902]: pgmap v18896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:33.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35264.037654 secs 2024-04-21T20:12:33.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:33 smithi191 ceph-mon[31636]: pgmap v18897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35264.037654 secs 2024-04-21T20:12:33.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:33 smithi170 ceph-mon[31212]: pgmap v18897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35264.037654 secs 2024-04-21T20:12:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:33 smithi077 ceph-mon[27902]: pgmap v18897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:34.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35265.794656 secs 2024-04-21T20:12:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35265.794656 secs 2024-04-21T20:12:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35265.794656 secs 2024-04-21T20:12:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:35.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:35 smithi191 ceph-mon[31636]: pgmap v18898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:35 smithi170 ceph-mon[31212]: pgmap v18898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:35 smithi077 ceph-mon[27902]: pgmap v18898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:37.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:37 smithi191 ceph-mon[31636]: pgmap v18899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:37 smithi170 ceph-mon[31212]: pgmap v18899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:37 smithi077 ceph-mon[27902]: pgmap v18899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:38.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35269.037796 secs 2024-04-21T20:12:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35269.037796 secs 2024-04-21T20:12:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35269.037796 secs 2024-04-21T20:12:39.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:39 smithi191 ceph-mon[31636]: pgmap v18900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:39.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35270.794808 secs 2024-04-21T20:12:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:39 smithi170 ceph-mon[31212]: pgmap v18900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:39.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35270.794808 secs 2024-04-21T20:12:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:39 smithi077 ceph-mon[27902]: pgmap v18900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35270.794808 secs 2024-04-21T20:12:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:41 smithi170 ceph-mon[31212]: pgmap v18901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:41.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:41 smithi077 ceph-mon[27902]: pgmap v18901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:41.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:41 smithi191 ceph-mon[31636]: pgmap v18901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35274.037912 secs 2024-04-21T20:12:43.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:43 smithi170 ceph-mon[31212]: pgmap v18902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35274.037912 secs 2024-04-21T20:12:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:43 smithi077 ceph-mon[27902]: pgmap v18902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35274.037912 secs 2024-04-21T20:12:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:43 smithi191 ceph-mon[31636]: pgmap v18902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:44.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35275.794948 secs 2024-04-21T20:12:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35275.794948 secs 2024-04-21T20:12:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35275.794948 secs 2024-04-21T20:12:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:45.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:45 smithi170 ceph-mon[31212]: pgmap v18903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:45 smithi077 ceph-mon[27902]: pgmap v18903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:45 smithi191 ceph-mon[31636]: pgmap v18903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:47 smithi170 ceph-mon[31212]: pgmap v18904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:47 smithi077 ceph-mon[27902]: pgmap v18904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:47.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:47 smithi191 ceph-mon[31636]: pgmap v18904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35279.037987 secs 2024-04-21T20:12:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35279.037987 secs 2024-04-21T20:12:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35279.037987 secs 2024-04-21T20:12:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:49 smithi170 ceph-mon[31212]: pgmap v18905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:49.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35280.795010 secs 2024-04-21T20:12:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:49 smithi077 ceph-mon[27902]: pgmap v18905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35280.795010 secs 2024-04-21T20:12:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:49 smithi191 ceph-mon[31636]: pgmap v18905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35280.795010 secs 2024-04-21T20:12:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:51.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:51 smithi170 ceph-mon[31212]: pgmap v18906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:51 smithi077 ceph-mon[27902]: pgmap v18906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:51.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:51 smithi191 ceph-mon[31636]: pgmap v18906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:52.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:52 smithi170 ceph-mon[31212]: pgmap v18907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:52 smithi077 ceph-mon[27902]: pgmap v18907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:52 smithi191 ceph-mon[31636]: pgmap v18907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35284.038109 secs 2024-04-21T20:12:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35284.038109 secs 2024-04-21T20:12:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35284.038109 secs 2024-04-21T20:12:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35285.795160 secs 2024-04-21T20:12:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:54 smithi077 ceph-mon[27902]: pgmap v18908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35285.795160 secs 2024-04-21T20:12:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:54 smithi191 ceph-mon[31636]: pgmap v18908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35285.795160 secs 2024-04-21T20:12:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:54 smithi170 ceph-mon[31212]: pgmap v18908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:12:57.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:57 smithi191 ceph-mon[31636]: pgmap v18909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:57.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:57 smithi170 ceph-mon[31212]: pgmap v18909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:57.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:57 smithi077 ceph-mon[27902]: pgmap v18909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:12:58.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35289.038242 secs 2024-04-21T20:12:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35289.038242 secs 2024-04-21T20:12:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35289.038242 secs 2024-04-21T20:12:59.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:12:59 smithi191 ceph-mon[31636]: pgmap v18910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:59.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:12:59 smithi077 ceph-mon[27902]: pgmap v18910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:12:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:12:59 smithi170 ceph-mon[31212]: pgmap v18910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35290.795260 secs 2024-04-21T20:13:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35290.795260 secs 2024-04-21T20:13:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35290.795260 secs 2024-04-21T20:13:01.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:01 smithi191 ceph-mon[31636]: pgmap v18911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:01.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:01 smithi170 ceph-mon[31212]: pgmap v18911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:01.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:01 smithi077 ceph-mon[27902]: pgmap v18911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35294.038355 secs 2024-04-21T20:13:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:03 smithi191 ceph-mon[31636]: pgmap v18912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35294.038355 secs 2024-04-21T20:13:03.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:03 smithi170 ceph-mon[31212]: pgmap v18912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35294.038355 secs 2024-04-21T20:13:03.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:03 smithi077 ceph-mon[27902]: pgmap v18912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35295.795371 secs 2024-04-21T20:13:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:05 smithi191 ceph-mon[31636]: pgmap v18913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:05 smithi191 ceph-mon[31636]: osdmap e1254: 12 total, 12 up, 12 in 2024-04-21T20:13:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35295.795371 secs 2024-04-21T20:13:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:05 smithi170 ceph-mon[31212]: pgmap v18913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:05 smithi170 ceph-mon[31212]: osdmap e1254: 12 total, 12 up, 12 in 2024-04-21T20:13:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35295.795371 secs 2024-04-21T20:13:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:05 smithi077 ceph-mon[27902]: pgmap v18913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:05.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:05 smithi077 ceph-mon[27902]: osdmap e1254: 12 total, 12 up, 12 in 2024-04-21T20:13:07.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:07 smithi191 ceph-mon[31636]: pgmap v18915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:13:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:07 smithi170 ceph-mon[31212]: pgmap v18915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:13:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:07 smithi077 ceph-mon[27902]: pgmap v18915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:13:08.713 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35299.038462 secs 2024-04-21T20:13:08.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35299.038462 secs 2024-04-21T20:13:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35299.038462 secs 2024-04-21T20:13:09.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:09 smithi191 ceph-mon[31636]: pgmap v18916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:13:09.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35300.795486 secs 2024-04-21T20:13:09.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:09 smithi191 ceph-mon[31636]: osdmap e1255: 12 total, 12 up, 12 in 2024-04-21T20:13:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:09 smithi170 ceph-mon[31212]: pgmap v18916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:13:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35300.795486 secs 2024-04-21T20:13:09.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:09 smithi170 ceph-mon[31212]: osdmap e1255: 12 total, 12 up, 12 in 2024-04-21T20:13:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:09 smithi077 ceph-mon[27902]: pgmap v18916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:13:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35300.795486 secs 2024-04-21T20:13:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:09 smithi077 ceph-mon[27902]: osdmap e1255: 12 total, 12 up, 12 in 2024-04-21T20:13:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:11.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:11 smithi191 ceph-mon[31636]: pgmap v18918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:13:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:11 smithi170 ceph-mon[31212]: pgmap v18918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:13:11.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:11 smithi077 ceph-mon[27902]: pgmap v18918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:13:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35304.038594 secs 2024-04-21T20:13:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:13 smithi191 ceph-mon[31636]: pgmap v18919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:13:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35304.038594 secs 2024-04-21T20:13:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:13 smithi170 ceph-mon[31212]: pgmap v18919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:13:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35304.038594 secs 2024-04-21T20:13:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:13 smithi077 ceph-mon[27902]: pgmap v18919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:13:14.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35305.795562 secs 2024-04-21T20:13:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35305.795562 secs 2024-04-21T20:13:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35305.795562 secs 2024-04-21T20:13:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:15 smithi170 ceph-mon[31212]: pgmap v18920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:13:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:15 smithi077 ceph-mon[27902]: pgmap v18920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:13:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:15 smithi191 ceph-mon[31636]: pgmap v18920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:13:16.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:13:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:13:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:13:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:17 smithi170 ceph-mon[31212]: pgmap v18921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:13:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:13:17.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:13:17.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:13:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:17 smithi077 ceph-mon[27902]: pgmap v18921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:13:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:13:17.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:13:17.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:13:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:17 smithi191 ceph-mon[31636]: pgmap v18921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:13:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:13:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:13:17.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:13:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35309.038706 secs 2024-04-21T20:13:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35309.038706 secs 2024-04-21T20:13:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35309.038706 secs 2024-04-21T20:13:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:19 smithi170 ceph-mon[31212]: pgmap v18922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:13:19.837 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35310.795678 secs 2024-04-21T20:13:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:19 smithi077 ceph-mon[27902]: pgmap v18922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:13:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35310.795678 secs 2024-04-21T20:13:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:19 smithi191 ceph-mon[31636]: pgmap v18922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:13:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35310.795678 secs 2024-04-21T20:13:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:21.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:21 smithi170 ceph-mon[31212]: pgmap v18923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:13:21.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:21 smithi077 ceph-mon[27902]: pgmap v18923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:13:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:21 smithi191 ceph-mon[31636]: pgmap v18923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:13:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35314.038823 secs 2024-04-21T20:13:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:23 smithi170 ceph-mon[31212]: pgmap v18924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35314.038823 secs 2024-04-21T20:13:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:23 smithi077 ceph-mon[27902]: pgmap v18924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35314.038823 secs 2024-04-21T20:13:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:23 smithi191 ceph-mon[31636]: pgmap v18924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35315.795793 secs 2024-04-21T20:13:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:25 smithi170 ceph-mon[31212]: pgmap v18925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35315.795793 secs 2024-04-21T20:13:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:25 smithi077 ceph-mon[27902]: pgmap v18925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35315.795793 secs 2024-04-21T20:13:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:25 smithi191 ceph-mon[31636]: pgmap v18925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:27.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:27 smithi191 ceph-mon[31636]: pgmap v18926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:27 smithi170 ceph-mon[31212]: pgmap v18926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:27 smithi077 ceph-mon[27902]: pgmap v18926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:28.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35319.038930 secs 2024-04-21T20:13:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35319.038930 secs 2024-04-21T20:13:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35319.038930 secs 2024-04-21T20:13:29.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:29 smithi191 ceph-mon[31636]: pgmap v18927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:29.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:29 smithi077 ceph-mon[27902]: pgmap v18927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:29 smithi170 ceph-mon[31212]: pgmap v18927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35320.795908 secs 2024-04-21T20:13:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35320.795908 secs 2024-04-21T20:13:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35320.795908 secs 2024-04-21T20:13:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:31 smithi191 ceph-mon[31636]: pgmap v18928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:31 smithi170 ceph-mon[31212]: pgmap v18928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:31 smithi077 ceph-mon[27902]: pgmap v18928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:33.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35324.039059 secs 2024-04-21T20:13:33.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:33 smithi191 ceph-mon[31636]: pgmap v18929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:33.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35324.039059 secs 2024-04-21T20:13:33.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:33 smithi170 ceph-mon[31212]: pgmap v18929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35324.039059 secs 2024-04-21T20:13:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:33 smithi077 ceph-mon[27902]: pgmap v18929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:35.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35325.795970 secs 2024-04-21T20:13:35.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:35 smithi191 ceph-mon[31636]: pgmap v18930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35325.795970 secs 2024-04-21T20:13:35.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:35 smithi170 ceph-mon[31212]: pgmap v18930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35325.795970 secs 2024-04-21T20:13:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:35 smithi077 ceph-mon[27902]: pgmap v18930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:37.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:37 smithi191 ceph-mon[31636]: pgmap v18931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:37 smithi170 ceph-mon[31212]: pgmap v18931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:37 smithi077 ceph-mon[27902]: pgmap v18931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:38.713 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35329.039171 secs 2024-04-21T20:13:38.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35329.039171 secs 2024-04-21T20:13:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35329.039171 secs 2024-04-21T20:13:39.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:39 smithi191 ceph-mon[31636]: pgmap v18932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:39.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35330.796087 secs 2024-04-21T20:13:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:39 smithi170 ceph-mon[31212]: pgmap v18932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:39.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35330.796087 secs 2024-04-21T20:13:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:39 smithi077 ceph-mon[27902]: pgmap v18932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35330.796087 secs 2024-04-21T20:13:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:41 smithi170 ceph-mon[31212]: pgmap v18933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:41.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:41 smithi077 ceph-mon[27902]: pgmap v18933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:41.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:41 smithi191 ceph-mon[31636]: pgmap v18933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35334.039286 secs 2024-04-21T20:13:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:43 smithi170 ceph-mon[31212]: pgmap v18934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35334.039286 secs 2024-04-21T20:13:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:43 smithi077 ceph-mon[27902]: pgmap v18934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35334.039286 secs 2024-04-21T20:13:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:43 smithi191 ceph-mon[31636]: pgmap v18934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35335.796206 secs 2024-04-21T20:13:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35335.796206 secs 2024-04-21T20:13:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35335.796206 secs 2024-04-21T20:13:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:45 smithi170 ceph-mon[31212]: pgmap v18935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:45 smithi077 ceph-mon[27902]: pgmap v18935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:45 smithi191 ceph-mon[31636]: pgmap v18935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:47 smithi170 ceph-mon[31212]: pgmap v18936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:47 smithi077 ceph-mon[27902]: pgmap v18936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:47.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:47 smithi191 ceph-mon[31636]: pgmap v18936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:48.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35339.039422 secs 2024-04-21T20:13:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35339.039422 secs 2024-04-21T20:13:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35339.039422 secs 2024-04-21T20:13:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:49 smithi170 ceph-mon[31212]: pgmap v18937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35340.796324 secs 2024-04-21T20:13:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:49 smithi077 ceph-mon[27902]: pgmap v18937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35340.796324 secs 2024-04-21T20:13:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:49 smithi191 ceph-mon[31636]: pgmap v18937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35340.796324 secs 2024-04-21T20:13:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:51 smithi170 ceph-mon[31212]: pgmap v18938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:51 smithi077 ceph-mon[27902]: pgmap v18938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:51.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:51 smithi191 ceph-mon[31636]: pgmap v18938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35344.039554 secs 2024-04-21T20:13:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:53 smithi170 ceph-mon[31212]: pgmap v18939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35344.039554 secs 2024-04-21T20:13:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:53 smithi077 ceph-mon[27902]: pgmap v18939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35344.039554 secs 2024-04-21T20:13:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:53 smithi191 ceph-mon[31636]: pgmap v18939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.461+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T20:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.462+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T20:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.462+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.462+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T20:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.462+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:13:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.463+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T20:13:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.463+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T20:13:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7efd70012b00 tx=0x7efd70034040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7efd70012b00 tx=0x7efd70034040 comp rx=0 tx=0).stop 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T20:13:54.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.535+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:13:54.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:54.536+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7002b070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T20:13:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35345.796419 secs 2024-04-21T20:13:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35345.796419 secs 2024-04-21T20:13:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35345.796419 secs 2024-04-21T20:13:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:13:55.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:55 smithi170 ceph-mon[31212]: pgmap v18940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:55 smithi077 ceph-mon[27902]: pgmap v18940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:55.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:55 smithi191 ceph-mon[31636]: pgmap v18940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:57.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:57 smithi170 ceph-mon[31212]: pgmap v18941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:57.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:57 smithi077 ceph-mon[27902]: pgmap v18941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:57.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:57 smithi191 ceph-mon[31636]: pgmap v18941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:13:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35349.039653 secs 2024-04-21T20:13:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35349.039653 secs 2024-04-21T20:13:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35349.039653 secs 2024-04-21T20:13:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:59.240+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:13:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:59.240+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:13:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:59.240+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:13:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:13:59.240+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:13:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:59 smithi077 ceph-mon[27902]: pgmap v18942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:59.792 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:13:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35350.796533 secs 2024-04-21T20:13:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:59 smithi170 ceph-mon[31212]: pgmap v18942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:13:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35350.796533 secs 2024-04-21T20:13:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:59 smithi191 ceph-mon[31636]: pgmap v18942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:13:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:13:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35350.796533 secs 2024-04-21T20:14:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:00 smithi170 ceph-mon[31212]: pgmap v18943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:00 smithi077 ceph-mon[27902]: pgmap v18943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:00 smithi191 ceph-mon[31636]: pgmap v18943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35354.039793 secs 2024-04-21T20:14:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:03 smithi191 ceph-mon[31636]: pgmap v18944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35354.039793 secs 2024-04-21T20:14:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:03 smithi170 ceph-mon[31212]: pgmap v18944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35354.039793 secs 2024-04-21T20:14:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:03 smithi077 ceph-mon[27902]: pgmap v18944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35355.796646 secs 2024-04-21T20:14:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:05 smithi191 ceph-mon[31636]: pgmap v18945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:05.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:05 smithi191 ceph-mon[31636]: osdmap e1256: 12 total, 12 up, 12 in 2024-04-21T20:14:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35355.796646 secs 2024-04-21T20:14:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:05 smithi170 ceph-mon[31212]: pgmap v18945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:05 smithi170 ceph-mon[31212]: osdmap e1256: 12 total, 12 up, 12 in 2024-04-21T20:14:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35355.796646 secs 2024-04-21T20:14:05.914 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:05 smithi077 ceph-mon[27902]: pgmap v18945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:05.914 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:05 smithi077 ceph-mon[27902]: osdmap e1256: 12 total, 12 up, 12 in 2024-04-21T20:14:07.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:07 smithi191 ceph-mon[31636]: pgmap v18947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:14:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:07 smithi170 ceph-mon[31212]: pgmap v18947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:14:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:07 smithi077 ceph-mon[27902]: pgmap v18947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:14:08.713 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35359.039913 secs 2024-04-21T20:14:08.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35359.039913 secs 2024-04-21T20:14:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35359.039913 secs 2024-04-21T20:14:09.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:09 smithi191 ceph-mon[31636]: pgmap v18948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:14:09.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:09 smithi191 ceph-mon[31636]: osdmap e1257: 12 total, 12 up, 12 in 2024-04-21T20:14:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:09 smithi170 ceph-mon[31212]: pgmap v18948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:14:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:09 smithi170 ceph-mon[31212]: osdmap e1257: 12 total, 12 up, 12 in 2024-04-21T20:14:09.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:09 smithi077 ceph-mon[27902]: pgmap v18948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:14:09.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:09 smithi077 ceph-mon[27902]: osdmap e1257: 12 total, 12 up, 12 in 2024-04-21T20:14:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35360.796759 secs 2024-04-21T20:14:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35360.796759 secs 2024-04-21T20:14:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35360.796759 secs 2024-04-21T20:14:11.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:11 smithi191 ceph-mon[31636]: pgmap v18950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:14:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:11 smithi170 ceph-mon[31212]: pgmap v18950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:14:11.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:11 smithi077 ceph-mon[27902]: pgmap v18950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:14:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35364.039989 secs 2024-04-21T20:14:13.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:13 smithi191 ceph-mon[31636]: pgmap v18951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:14:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35364.039989 secs 2024-04-21T20:14:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:13 smithi170 ceph-mon[31212]: pgmap v18951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:14:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35364.039989 secs 2024-04-21T20:14:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:13 smithi077 ceph-mon[27902]: pgmap v18951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:14:14.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35365.796879 secs 2024-04-21T20:14:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35365.796879 secs 2024-04-21T20:14:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35365.796879 secs 2024-04-21T20:14:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:15 smithi170 ceph-mon[31212]: pgmap v18952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:14:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:15 smithi077 ceph-mon[27902]: pgmap v18952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:14:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:15 smithi191 ceph-mon[31636]: pgmap v18952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:14:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:17 smithi170 ceph-mon[31212]: pgmap v18953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:14:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:14:17.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:17 smithi077 ceph-mon[27902]: pgmap v18953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:14:17.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:14:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:17 smithi191 ceph-mon[31636]: pgmap v18953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:14:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:14:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35369.040074 secs 2024-04-21T20:14:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35369.040074 secs 2024-04-21T20:14:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35369.040074 secs 2024-04-21T20:14:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: pgmap v18954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35370.796949 secs 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: pgmap v18954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:14:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35370.796949 secs 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: pgmap v18954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:14:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35370.796949 secs 2024-04-21T20:14:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:19.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:20.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:14:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:14:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:14:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:14:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:14:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:14:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:14:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:14:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:14:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:14:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:14:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:14:21.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:21 smithi170 ceph-mon[31212]: pgmap v18955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:14:21.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:14:21.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:14:21.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:14:21.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:14:21.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:21 smithi077 ceph-mon[27902]: pgmap v18955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:14:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:14:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:14:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:14:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:14:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:21 smithi191 ceph-mon[31636]: pgmap v18955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:14:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35374.040188 secs 2024-04-21T20:14:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:23 smithi170 ceph-mon[31212]: pgmap v18956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35374.040188 secs 2024-04-21T20:14:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:23 smithi077 ceph-mon[27902]: pgmap v18956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35374.040188 secs 2024-04-21T20:14:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:23 smithi191 ceph-mon[31636]: pgmap v18956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35375.797094 secs 2024-04-21T20:14:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35375.797094 secs 2024-04-21T20:14:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35375.797094 secs 2024-04-21T20:14:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:25.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:25 smithi170 ceph-mon[31212]: pgmap v18957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:25 smithi077 ceph-mon[27902]: pgmap v18957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:25 smithi191 ceph-mon[31636]: pgmap v18957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:27 smithi170 ceph-mon[31212]: pgmap v18958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:27 smithi077 ceph-mon[27902]: pgmap v18958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:27.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:27 smithi191 ceph-mon[31636]: pgmap v18958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35379.040296 secs 2024-04-21T20:14:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35379.040296 secs 2024-04-21T20:14:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35379.040296 secs 2024-04-21T20:14:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:29 smithi077 ceph-mon[27902]: pgmap v18959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35380.797212 secs 2024-04-21T20:14:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:29 smithi170 ceph-mon[31212]: pgmap v18959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35380.797212 secs 2024-04-21T20:14:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:29 smithi191 ceph-mon[31636]: pgmap v18959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35380.797212 secs 2024-04-21T20:14:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:31 smithi170 ceph-mon[31212]: pgmap v18960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:31 smithi077 ceph-mon[27902]: pgmap v18960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:31.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:31 smithi191 ceph-mon[31636]: pgmap v18960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35384.040407 secs 2024-04-21T20:14:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:33 smithi170 ceph-mon[31212]: pgmap v18961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35384.040407 secs 2024-04-21T20:14:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:33 smithi077 ceph-mon[27902]: pgmap v18961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35384.040407 secs 2024-04-21T20:14:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:33 smithi191 ceph-mon[31636]: pgmap v18961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35385.797270 secs 2024-04-21T20:14:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35385.797270 secs 2024-04-21T20:14:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35385.797270 secs 2024-04-21T20:14:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:35 smithi170 ceph-mon[31212]: pgmap v18962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:35 smithi077 ceph-mon[27902]: pgmap v18962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:35 smithi191 ceph-mon[31636]: pgmap v18962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:36.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:36 smithi170 ceph-mon[31212]: pgmap v18963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:36.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:36 smithi077 ceph-mon[27902]: pgmap v18963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:36 smithi191 ceph-mon[31636]: pgmap v18963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:38.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35389.040546 secs 2024-04-21T20:14:38.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35389.040546 secs 2024-04-21T20:14:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35389.040546 secs 2024-04-21T20:14:39.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:38 smithi170 ceph-mon[31212]: pgmap v18964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:39.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:38 smithi191 ceph-mon[31636]: pgmap v18964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:38 smithi077 ceph-mon[27902]: pgmap v18964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:40.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35390.797388 secs 2024-04-21T20:14:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:40.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35390.797388 secs 2024-04-21T20:14:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35390.797388 secs 2024-04-21T20:14:41.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:40 smithi170 ceph-mon[31212]: pgmap v18965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:41.064 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:40 smithi077 ceph-mon[27902]: pgmap v18965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:40 smithi191 ceph-mon[31636]: pgmap v18965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35394.040662 secs 2024-04-21T20:14:43.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:43 smithi191 ceph-mon[31636]: pgmap v18966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35394.040662 secs 2024-04-21T20:14:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:43 smithi170 ceph-mon[31212]: pgmap v18966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35394.040662 secs 2024-04-21T20:14:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:43 smithi077 ceph-mon[27902]: pgmap v18966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:14:44.246+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:14:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:14:44.246+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:14:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:14:44.247+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:14:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:14:44.247+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:14:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:45.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35395.797502 secs 2024-04-21T20:14:45.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:45 smithi191 ceph-mon[31636]: pgmap v18967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35395.797502 secs 2024-04-21T20:14:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:45 smithi170 ceph-mon[31212]: pgmap v18967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35395.797502 secs 2024-04-21T20:14:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:45 smithi077 ceph-mon[27902]: pgmap v18967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:47.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:47 smithi191 ceph-mon[31636]: pgmap v18968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:47 smithi170 ceph-mon[31212]: pgmap v18968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:47 smithi077 ceph-mon[27902]: pgmap v18968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:48.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35399.040794 secs 2024-04-21T20:14:48.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35399.040794 secs 2024-04-21T20:14:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35399.040794 secs 2024-04-21T20:14:49.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:49 smithi191 ceph-mon[31636]: pgmap v18969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:49 smithi170 ceph-mon[31212]: pgmap v18969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:49 smithi077 ceph-mon[27902]: pgmap v18969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:50.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35400.797611 secs 2024-04-21T20:14:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35400.797611 secs 2024-04-21T20:14:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35400.797611 secs 2024-04-21T20:14:51.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:51 smithi191 ceph-mon[31636]: pgmap v18970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:51 smithi170 ceph-mon[31212]: pgmap v18970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:51 smithi077 ceph-mon[27902]: pgmap v18970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:53.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35404.040909 secs 2024-04-21T20:14:53.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:53 smithi191 ceph-mon[31636]: pgmap v18971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35404.040909 secs 2024-04-21T20:14:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:53 smithi170 ceph-mon[31212]: pgmap v18971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35404.040909 secs 2024-04-21T20:14:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:53 smithi077 ceph-mon[27902]: pgmap v18971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:54.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35405.797729 secs 2024-04-21T20:14:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35405.797729 secs 2024-04-21T20:14:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35405.797729 secs 2024-04-21T20:14:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:14:55.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:55 smithi170 ceph-mon[31212]: pgmap v18972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:55 smithi077 ceph-mon[27902]: pgmap v18972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:55.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:55 smithi191 ceph-mon[31636]: pgmap v18972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:57.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:57 smithi170 ceph-mon[31212]: pgmap v18973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:57.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:57 smithi077 ceph-mon[27902]: pgmap v18973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:57.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:57 smithi191 ceph-mon[31636]: pgmap v18973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:14:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35409.041027 secs 2024-04-21T20:14:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35409.041027 secs 2024-04-21T20:14:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35409.041027 secs 2024-04-21T20:14:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:59 smithi077 ceph-mon[27902]: pgmap v18974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:14:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35410.797817 secs 2024-04-21T20:14:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:59 smithi170 ceph-mon[31212]: pgmap v18974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:14:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35410.797817 secs 2024-04-21T20:14:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:59 smithi191 ceph-mon[31636]: pgmap v18974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:14:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:14:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35410.797817 secs 2024-04-21T20:15:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:01.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:01 smithi170 ceph-mon[31212]: pgmap v18975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:01.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:01 smithi077 ceph-mon[27902]: pgmap v18975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:01.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:01 smithi191 ceph-mon[31636]: pgmap v18975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35414.041160 secs 2024-04-21T20:15:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:03 smithi170 ceph-mon[31212]: pgmap v18976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35414.041160 secs 2024-04-21T20:15:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:03 smithi077 ceph-mon[27902]: pgmap v18976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35414.041160 secs 2024-04-21T20:15:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:03 smithi191 ceph-mon[31636]: pgmap v18976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35415.797928 secs 2024-04-21T20:15:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35415.797928 secs 2024-04-21T20:15:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35415.797928 secs 2024-04-21T20:15:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:05 smithi170 ceph-mon[31212]: pgmap v18977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:05 smithi170 ceph-mon[31212]: osdmap e1258: 12 total, 12 up, 12 in 2024-04-21T20:15:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:05 smithi077 ceph-mon[27902]: pgmap v18977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:05 smithi077 ceph-mon[27902]: osdmap e1258: 12 total, 12 up, 12 in 2024-04-21T20:15:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:05 smithi191 ceph-mon[31636]: pgmap v18977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:05 smithi191 ceph-mon[31636]: osdmap e1258: 12 total, 12 up, 12 in 2024-04-21T20:15:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:07 smithi170 ceph-mon[31212]: pgmap v18979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:15:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:07 smithi077 ceph-mon[27902]: pgmap v18979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:15:07.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:07 smithi191 ceph-mon[31636]: pgmap v18979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:15:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35419.041291 secs 2024-04-21T20:15:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35419.041291 secs 2024-04-21T20:15:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35419.041291 secs 2024-04-21T20:15:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:09 smithi170 ceph-mon[31212]: pgmap v18980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:15:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35420.798041 secs 2024-04-21T20:15:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:09 smithi170 ceph-mon[31212]: osdmap e1259: 12 total, 12 up, 12 in 2024-04-21T20:15:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:09 smithi191 ceph-mon[31636]: pgmap v18980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:15:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35420.798041 secs 2024-04-21T20:15:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:09 smithi191 ceph-mon[31636]: osdmap e1259: 12 total, 12 up, 12 in 2024-04-21T20:15:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:09 smithi077 ceph-mon[27902]: pgmap v18980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:15:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35420.798041 secs 2024-04-21T20:15:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:09 smithi077 ceph-mon[27902]: osdmap e1259: 12 total, 12 up, 12 in 2024-04-21T20:15:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:11 smithi170 ceph-mon[31212]: pgmap v18982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:15:11.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:11 smithi077 ceph-mon[27902]: pgmap v18982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:15:11.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:11 smithi191 ceph-mon[31636]: pgmap v18982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:15:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35424.041407 secs 2024-04-21T20:15:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:13 smithi170 ceph-mon[31212]: pgmap v18983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:15:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35424.041407 secs 2024-04-21T20:15:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:13 smithi077 ceph-mon[27902]: pgmap v18983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:15:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35424.041407 secs 2024-04-21T20:15:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:13 smithi191 ceph-mon[31636]: pgmap v18983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:15:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35425.798100 secs 2024-04-21T20:15:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35425.798100 secs 2024-04-21T20:15:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35425.798100 secs 2024-04-21T20:15:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:15 smithi170 ceph-mon[31212]: pgmap v18984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:15:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:15 smithi077 ceph-mon[27902]: pgmap v18984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:15:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:15 smithi191 ceph-mon[31636]: pgmap v18984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:15:16.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:16 smithi170 ceph-mon[31212]: pgmap v18985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:15:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:16 smithi077 ceph-mon[27902]: pgmap v18985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:15:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:16 smithi191 ceph-mon[31636]: pgmap v18985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:15:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35429.041521 secs 2024-04-21T20:15:18.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35429.041521 secs 2024-04-21T20:15:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35429.041521 secs 2024-04-21T20:15:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:18 smithi170 ceph-mon[31212]: pgmap v18986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:15:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:18 smithi077 ceph-mon[27902]: pgmap v18986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:15:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:18 smithi191 ceph-mon[31636]: pgmap v18986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:15:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35430.798171 secs 2024-04-21T20:15:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:15:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35430.798171 secs 2024-04-21T20:15:20.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:15:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35430.798171 secs 2024-04-21T20:15:20.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:15:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:21 smithi191 ceph-mon[31636]: pgmap v18987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:15:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:15:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:15:21.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:21 smithi170 ceph-mon[31212]: pgmap v18987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:15:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:15:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:15:21.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:21 smithi077 ceph-mon[27902]: pgmap v18987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:15:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:15:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:15:21.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:15:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35434.041634 secs 2024-04-21T20:15:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:23 smithi191 ceph-mon[31636]: pgmap v18988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35434.041634 secs 2024-04-21T20:15:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:23 smithi170 ceph-mon[31212]: pgmap v18988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35434.041634 secs 2024-04-21T20:15:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:23 smithi077 ceph-mon[27902]: pgmap v18988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35435.798287 secs 2024-04-21T20:15:25.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:25 smithi170 ceph-mon[31212]: pgmap v18989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35435.798287 secs 2024-04-21T20:15:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:25 smithi077 ceph-mon[27902]: pgmap v18989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35435.798287 secs 2024-04-21T20:15:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:25 smithi191 ceph-mon[31636]: pgmap v18989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:27.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:27 smithi191 ceph-mon[31636]: pgmap v18990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:27 smithi170 ceph-mon[31212]: pgmap v18990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:27 smithi077 ceph-mon[27902]: pgmap v18990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:28.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35439.041726 secs 2024-04-21T20:15:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35439.041726 secs 2024-04-21T20:15:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35439.041726 secs 2024-04-21T20:15:29.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:29 smithi191 ceph-mon[31636]: pgmap v18991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:29 smithi077 ceph-mon[27902]: pgmap v18991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:29 smithi170 ceph-mon[31212]: pgmap v18991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35440.798408 secs 2024-04-21T20:15:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35440.798408 secs 2024-04-21T20:15:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35440.798408 secs 2024-04-21T20:15:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:31 smithi170 ceph-mon[31212]: pgmap v18992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:31 smithi077 ceph-mon[27902]: pgmap v18992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:31.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:31 smithi191 ceph-mon[31636]: pgmap v18992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35444.041846 secs 2024-04-21T20:15:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:33 smithi170 ceph-mon[31212]: pgmap v18993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35444.041846 secs 2024-04-21T20:15:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:33 smithi077 ceph-mon[27902]: pgmap v18993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35444.041846 secs 2024-04-21T20:15:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:33 smithi191 ceph-mon[31636]: pgmap v18993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35445.798501 secs 2024-04-21T20:15:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35445.798501 secs 2024-04-21T20:15:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35445.798501 secs 2024-04-21T20:15:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:35 smithi170 ceph-mon[31212]: pgmap v18994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:35 smithi077 ceph-mon[27902]: pgmap v18994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:35 smithi191 ceph-mon[31636]: pgmap v18994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:37 smithi170 ceph-mon[31212]: pgmap v18995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:37 smithi077 ceph-mon[27902]: pgmap v18995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:37.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:37 smithi191 ceph-mon[31636]: pgmap v18995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35449.041944 secs 2024-04-21T20:15:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35449.041944 secs 2024-04-21T20:15:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35449.041944 secs 2024-04-21T20:15:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:39 smithi170 ceph-mon[31212]: pgmap v18996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35450.798599 secs 2024-04-21T20:15:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:39 smithi191 ceph-mon[31636]: pgmap v18996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35450.798599 secs 2024-04-21T20:15:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:39 smithi077 ceph-mon[27902]: pgmap v18996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35450.798599 secs 2024-04-21T20:15:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:41 smithi170 ceph-mon[31212]: pgmap v18997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:41.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:41 smithi077 ceph-mon[27902]: pgmap v18997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:41.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:41 smithi191 ceph-mon[31636]: pgmap v18997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35454.042056 secs 2024-04-21T20:15:43.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:43 smithi170 ceph-mon[31212]: pgmap v18998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35454.042056 secs 2024-04-21T20:15:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:43 smithi077 ceph-mon[27902]: pgmap v18998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35454.042056 secs 2024-04-21T20:15:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:43 smithi191 ceph-mon[31636]: pgmap v18998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35455.798714 secs 2024-04-21T20:15:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35455.798714 secs 2024-04-21T20:15:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35455.798714 secs 2024-04-21T20:15:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:45 smithi170 ceph-mon[31212]: pgmap v18999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:45 smithi077 ceph-mon[27902]: pgmap v18999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:45 smithi191 ceph-mon[31636]: pgmap v18999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:47 smithi170 ceph-mon[31212]: pgmap v19000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:47 smithi077 ceph-mon[27902]: pgmap v19000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:47 smithi191 ceph-mon[31636]: pgmap v19000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:48.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35459.042210 secs 2024-04-21T20:15:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35459.042210 secs 2024-04-21T20:15:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35459.042210 secs 2024-04-21T20:15:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:49 smithi170 ceph-mon[31212]: pgmap v19001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35460.798832 secs 2024-04-21T20:15:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:49 smithi077 ceph-mon[27902]: pgmap v19001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35460.798832 secs 2024-04-21T20:15:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:49 smithi191 ceph-mon[31636]: pgmap v19001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35460.798832 secs 2024-04-21T20:15:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:51 smithi170 ceph-mon[31212]: pgmap v19002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:51.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:51 smithi077 ceph-mon[27902]: pgmap v19002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:51.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:51 smithi191 ceph-mon[31636]: pgmap v19002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35464.042324 secs 2024-04-21T20:15:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:53 smithi170 ceph-mon[31212]: pgmap v19003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35464.042324 secs 2024-04-21T20:15:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:53 smithi077 ceph-mon[27902]: pgmap v19003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35464.042324 secs 2024-04-21T20:15:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:53 smithi191 ceph-mon[31636]: pgmap v19003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35465.798946 secs 2024-04-21T20:15:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35465.798946 secs 2024-04-21T20:15:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35465.798946 secs 2024-04-21T20:15:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:15:55.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:55 smithi170 ceph-mon[31212]: pgmap v19004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:55 smithi077 ceph-mon[27902]: pgmap v19004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:55 smithi191 ceph-mon[31636]: pgmap v19004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:15:56.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:56 smithi170 ceph-mon[31212]: pgmap v19005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:56.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:56 smithi077 ceph-mon[27902]: pgmap v19005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:56.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:56 smithi191 ceph-mon[31636]: pgmap v19005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:15:58.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35469.042471 secs 2024-04-21T20:15:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35469.042471 secs 2024-04-21T20:15:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35469.042471 secs 2024-04-21T20:15:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:58 smithi170 ceph-mon[31212]: pgmap v19006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:58 smithi077 ceph-mon[27902]: pgmap v19006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:15:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:58 smithi191 ceph-mon[31636]: pgmap v19006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:15:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35470.799025 secs 2024-04-21T20:16:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:15:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35470.799025 secs 2024-04-21T20:16:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:15:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35470.799025 secs 2024-04-21T20:16:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:00 smithi170 ceph-mon[31212]: pgmap v19007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:16:01.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:00 smithi077 ceph-mon[27902]: pgmap v19007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:16:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:00 smithi191 ceph-mon[31636]: pgmap v19007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:16:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35474.042594 secs 2024-04-21T20:16:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:03 smithi191 ceph-mon[31636]: pgmap v19008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T20:16:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35474.042594 secs 2024-04-21T20:16:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:03 smithi170 ceph-mon[31212]: pgmap v19008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T20:16:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35474.042594 secs 2024-04-21T20:16:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:03 smithi077 ceph-mon[27902]: pgmap v19008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T20:16:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35475.799140 secs 2024-04-21T20:16:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:05 smithi170 ceph-mon[31212]: pgmap v19009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T20:16:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:05 smithi170 ceph-mon[31212]: osdmap e1260: 12 total, 12 up, 12 in 2024-04-21T20:16:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35475.799140 secs 2024-04-21T20:16:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:05 smithi077 ceph-mon[27902]: pgmap v19009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T20:16:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:05 smithi077 ceph-mon[27902]: osdmap e1260: 12 total, 12 up, 12 in 2024-04-21T20:16:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35475.799140 secs 2024-04-21T20:16:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:05 smithi191 ceph-mon[31636]: pgmap v19009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T20:16:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:05 smithi191 ceph-mon[31636]: osdmap e1260: 12 total, 12 up, 12 in 2024-04-21T20:16:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:07 smithi170 ceph-mon[31212]: pgmap v19011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:16:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:07 smithi077 ceph-mon[27902]: pgmap v19011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:16:07.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:07 smithi191 ceph-mon[31636]: pgmap v19011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:16:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35479.042726 secs 2024-04-21T20:16:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35479.042726 secs 2024-04-21T20:16:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35479.042726 secs 2024-04-21T20:16:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:09 smithi170 ceph-mon[31212]: pgmap v19012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:16:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35480.799236 secs 2024-04-21T20:16:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:09 smithi170 ceph-mon[31212]: osdmap e1261: 12 total, 12 up, 12 in 2024-04-21T20:16:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:09 smithi191 ceph-mon[31636]: pgmap v19012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:16:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35480.799236 secs 2024-04-21T20:16:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:09 smithi191 ceph-mon[31636]: osdmap e1261: 12 total, 12 up, 12 in 2024-04-21T20:16:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:09 smithi077 ceph-mon[27902]: pgmap v19012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:16:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35480.799236 secs 2024-04-21T20:16:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:09 smithi077 ceph-mon[27902]: osdmap e1261: 12 total, 12 up, 12 in 2024-04-21T20:16:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:11 smithi170 ceph-mon[31212]: pgmap v19014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T20:16:11.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:11 smithi077 ceph-mon[27902]: pgmap v19014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T20:16:11.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:11 smithi191 ceph-mon[31636]: pgmap v19014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T20:16:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35484.042859 secs 2024-04-21T20:16:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:13 smithi170 ceph-mon[31212]: pgmap v19015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T20:16:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35484.042859 secs 2024-04-21T20:16:13.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:13 smithi077 ceph-mon[27902]: pgmap v19015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T20:16:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35484.042859 secs 2024-04-21T20:16:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:13 smithi191 ceph-mon[31636]: pgmap v19015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-04-21T20:16:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35485.799351 secs 2024-04-21T20:16:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35485.799351 secs 2024-04-21T20:16:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35485.799351 secs 2024-04-21T20:16:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:15 smithi170 ceph-mon[31212]: pgmap v19016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T20:16:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:15 smithi077 ceph-mon[27902]: pgmap v19016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T20:16:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:15 smithi191 ceph-mon[31636]: pgmap v19016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T20:16:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:17 smithi170 ceph-mon[31212]: pgmap v19017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:16:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:17 smithi077 ceph-mon[27902]: pgmap v19017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:16:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:17 smithi191 ceph-mon[31636]: pgmap v19017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:16:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35489.042986 secs 2024-04-21T20:16:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35489.042986 secs 2024-04-21T20:16:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35489.042986 secs 2024-04-21T20:16:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:19 smithi170 ceph-mon[31212]: pgmap v19018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:16:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35490.799486 secs 2024-04-21T20:16:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:19 smithi077 ceph-mon[27902]: pgmap v19018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:16:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35490.799486 secs 2024-04-21T20:16:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:19 smithi191 ceph-mon[31636]: pgmap v19018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:16:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35490.799486 secs 2024-04-21T20:16:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:21.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:21 smithi170 ceph-mon[31212]: pgmap v19019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:16:21.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:16:21.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:21 smithi077 ceph-mon[27902]: pgmap v19019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:16:21.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:16:21.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:21 smithi191 ceph-mon[31636]: pgmap v19019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:16:21.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:16:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:22 smithi077 ceph-mon[27902]: pgmap v19020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:22.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:22 smithi191 ceph-mon[31636]: pgmap v19020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:16:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:16:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:16:23.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:22 smithi170 ceph-mon[31212]: pgmap v19020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35494.043093 secs 2024-04-21T20:16:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35494.043093 secs 2024-04-21T20:16:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35494.043093 secs 2024-04-21T20:16:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35495.799613 secs 2024-04-21T20:16:25.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:25 smithi170 ceph-mon[31212]: pgmap v19021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35495.799613 secs 2024-04-21T20:16:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:25 smithi077 ceph-mon[27902]: pgmap v19021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35495.799613 secs 2024-04-21T20:16:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:25 smithi191 ceph-mon[31636]: pgmap v19021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:27 smithi170 ceph-mon[31212]: pgmap v19022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:27 smithi077 ceph-mon[27902]: pgmap v19022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:27.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:27 smithi191 ceph-mon[31636]: pgmap v19022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35499.043175 secs 2024-04-21T20:16:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35499.043175 secs 2024-04-21T20:16:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35499.043175 secs 2024-04-21T20:16:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:29 smithi077 ceph-mon[27902]: pgmap v19023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35500.799737 secs 2024-04-21T20:16:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:29 smithi170 ceph-mon[31212]: pgmap v19023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35500.799737 secs 2024-04-21T20:16:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:29 smithi191 ceph-mon[31636]: pgmap v19023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35500.799737 secs 2024-04-21T20:16:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:31 smithi170 ceph-mon[31212]: pgmap v19024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:31 smithi077 ceph-mon[27902]: pgmap v19024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:31.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:31 smithi191 ceph-mon[31636]: pgmap v19024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35504.043278 secs 2024-04-21T20:16:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:33 smithi170 ceph-mon[31212]: pgmap v19025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35504.043278 secs 2024-04-21T20:16:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:33 smithi077 ceph-mon[27902]: pgmap v19025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35504.043278 secs 2024-04-21T20:16:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:33 smithi191 ceph-mon[31636]: pgmap v19025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35505.799833 secs 2024-04-21T20:16:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35505.799833 secs 2024-04-21T20:16:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35505.799833 secs 2024-04-21T20:16:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:35 smithi170 ceph-mon[31212]: pgmap v19026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:35 smithi077 ceph-mon[27902]: pgmap v19026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:35 smithi191 ceph-mon[31636]: pgmap v19026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:37 smithi170 ceph-mon[31212]: pgmap v19027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:37 smithi077 ceph-mon[27902]: pgmap v19027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:37.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:37 smithi191 ceph-mon[31636]: pgmap v19027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35509.043412 secs 2024-04-21T20:16:38.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35509.043412 secs 2024-04-21T20:16:38.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35509.043412 secs 2024-04-21T20:16:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:39 smithi170 ceph-mon[31212]: pgmap v19028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35510.799988 secs 2024-04-21T20:16:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:39 smithi191 ceph-mon[31636]: pgmap v19028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35510.799988 secs 2024-04-21T20:16:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:39 smithi077 ceph-mon[27902]: pgmap v19028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35510.799988 secs 2024-04-21T20:16:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:41.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:41 smithi170 ceph-mon[31212]: pgmap v19029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:41.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:41 smithi077 ceph-mon[27902]: pgmap v19029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:41.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:41 smithi191 ceph-mon[31636]: pgmap v19029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:16:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35514.043547 secs 2024-04-21T20:16:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:43 smithi170 ceph-mon[31212]: pgmap v19030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35514.043547 secs 2024-04-21T20:16:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:43 smithi077 ceph-mon[27902]: pgmap v19030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35514.043547 secs 2024-04-21T20:16:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:43 smithi191 ceph-mon[31636]: pgmap v19030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35515.800099 secs 2024-04-21T20:16:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35515.800099 secs 2024-04-21T20:16:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35515.800099 secs 2024-04-21T20:16:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:45 smithi170 ceph-mon[31212]: pgmap v19031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:45 smithi077 ceph-mon[27902]: pgmap v19031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:45.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:45 smithi191 ceph-mon[31636]: pgmap v19031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:47 smithi170 ceph-mon[31212]: pgmap v19032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:47 smithi077 ceph-mon[27902]: pgmap v19032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:47 smithi191 ceph-mon[31636]: pgmap v19032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:48.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35519.043684 secs 2024-04-21T20:16:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35519.043684 secs 2024-04-21T20:16:48.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35519.043684 secs 2024-04-21T20:16:49.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:49 smithi170 ceph-mon[31212]: pgmap v19033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:49.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35520.800212 secs 2024-04-21T20:16:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:49 smithi077 ceph-mon[27902]: pgmap v19033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35520.800212 secs 2024-04-21T20:16:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:49 smithi191 ceph-mon[31636]: pgmap v19033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35520.800212 secs 2024-04-21T20:16:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:51 smithi170 ceph-mon[31212]: pgmap v19034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:51 smithi077 ceph-mon[27902]: pgmap v19034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:51.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:51 smithi191 ceph-mon[31636]: pgmap v19034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:52 smithi077 ceph-mon[27902]: pgmap v19035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:52.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:52 smithi191 ceph-mon[31636]: pgmap v19035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:52 smithi170 ceph-mon[31212]: pgmap v19035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35524.043808 secs 2024-04-21T20:16:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35524.043808 secs 2024-04-21T20:16:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35524.043808 secs 2024-04-21T20:16:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35525.800323 secs 2024-04-21T20:16:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:54 smithi077 ceph-mon[27902]: pgmap v19036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35525.800323 secs 2024-04-21T20:16:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:54 smithi191 ceph-mon[31636]: pgmap v19036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35525.800323 secs 2024-04-21T20:16:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:54 smithi170 ceph-mon[31212]: pgmap v19036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-21T20:16:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:16:57.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:57 smithi170 ceph-mon[31212]: pgmap v19037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:57.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:57 smithi077 ceph-mon[27902]: pgmap v19037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:57.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:57 smithi191 ceph-mon[31636]: pgmap v19037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T20:16:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35529.043916 secs 2024-04-21T20:16:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35529.043916 secs 2024-04-21T20:16:58.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35529.043916 secs 2024-04-21T20:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:16:59.264+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:16:59.264+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:16:59.264+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:16:59.264+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:16:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:59 smithi077 ceph-mon[27902]: pgmap v19038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35530.800439 secs 2024-04-21T20:16:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:59 smithi170 ceph-mon[31212]: pgmap v19038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35530.800439 secs 2024-04-21T20:16:59.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:59 smithi191 ceph-mon[31636]: pgmap v19038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:16:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35530.800439 secs 2024-04-21T20:17:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:01.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:01 smithi170 ceph-mon[31212]: pgmap v19039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:01.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:01 smithi077 ceph-mon[27902]: pgmap v19039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:01.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:01 smithi191 ceph-mon[31636]: pgmap v19039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35534.043990 secs 2024-04-21T20:17:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:03 smithi170 ceph-mon[31212]: pgmap v19040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35534.043990 secs 2024-04-21T20:17:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:03 smithi077 ceph-mon[27902]: pgmap v19040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35534.043990 secs 2024-04-21T20:17:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:03 smithi191 ceph-mon[31636]: pgmap v19040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35535.800550 secs 2024-04-21T20:17:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35535.800550 secs 2024-04-21T20:17:04.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35535.800550 secs 2024-04-21T20:17:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:05 smithi170 ceph-mon[31212]: pgmap v19041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:05 smithi170 ceph-mon[31212]: osdmap e1262: 12 total, 12 up, 12 in 2024-04-21T20:17:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:05 smithi077 ceph-mon[27902]: pgmap v19041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:05 smithi077 ceph-mon[27902]: osdmap e1262: 12 total, 12 up, 12 in 2024-04-21T20:17:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:05 smithi191 ceph-mon[31636]: pgmap v19041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:05 smithi191 ceph-mon[31636]: osdmap e1262: 12 total, 12 up, 12 in 2024-04-21T20:17:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:07 smithi170 ceph-mon[31212]: pgmap v19043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:17:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:07 smithi077 ceph-mon[27902]: pgmap v19043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:17:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:07 smithi191 ceph-mon[31636]: pgmap v19043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:17:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35539.044149 secs 2024-04-21T20:17:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35539.044149 secs 2024-04-21T20:17:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35539.044149 secs 2024-04-21T20:17:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:09 smithi170 ceph-mon[31212]: pgmap v19044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:17:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35540.800643 secs 2024-04-21T20:17:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:09 smithi170 ceph-mon[31212]: osdmap e1263: 12 total, 12 up, 12 in 2024-04-21T20:17:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:09 smithi191 ceph-mon[31636]: pgmap v19044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:17:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35540.800643 secs 2024-04-21T20:17:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:09 smithi191 ceph-mon[31636]: osdmap e1263: 12 total, 12 up, 12 in 2024-04-21T20:17:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:09 smithi077 ceph-mon[27902]: pgmap v19044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:17:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35540.800643 secs 2024-04-21T20:17:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:09 smithi077 ceph-mon[27902]: osdmap e1263: 12 total, 12 up, 12 in 2024-04-21T20:17:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:11 smithi170 ceph-mon[31212]: pgmap v19046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:17:11.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:11 smithi077 ceph-mon[27902]: pgmap v19046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:17:11.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:11 smithi191 ceph-mon[31636]: pgmap v19046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:17:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35544.044276 secs 2024-04-21T20:17:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:13 smithi170 ceph-mon[31212]: pgmap v19047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:17:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35544.044276 secs 2024-04-21T20:17:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:13 smithi077 ceph-mon[27902]: pgmap v19047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:17:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35544.044276 secs 2024-04-21T20:17:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:13 smithi191 ceph-mon[31636]: pgmap v19047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:17:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35545.800747 secs 2024-04-21T20:17:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35545.800747 secs 2024-04-21T20:17:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35545.800747 secs 2024-04-21T20:17:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:15 smithi170 ceph-mon[31212]: pgmap v19048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:17:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:15 smithi077 ceph-mon[27902]: pgmap v19048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:17:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:15 smithi191 ceph-mon[31636]: pgmap v19048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:17:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:17 smithi170 ceph-mon[31212]: pgmap v19049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:17:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:17 smithi077 ceph-mon[27902]: pgmap v19049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:17:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:17 smithi191 ceph-mon[31636]: pgmap v19049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:17:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35549.044407 secs 2024-04-21T20:17:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35549.044407 secs 2024-04-21T20:17:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35549.044407 secs 2024-04-21T20:17:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:19 smithi170 ceph-mon[31212]: pgmap v19050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:17:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35550.800891 secs 2024-04-21T20:17:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:19 smithi077 ceph-mon[27902]: pgmap v19050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:17:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35550.800891 secs 2024-04-21T20:17:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:19 smithi191 ceph-mon[31636]: pgmap v19050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:17:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35550.800891 secs 2024-04-21T20:17:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:20.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:20 smithi077 ceph-mon[27902]: pgmap v19051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:17:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:20 smithi191 ceph-mon[31636]: pgmap v19051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:17:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:20 smithi170 ceph-mon[31212]: pgmap v19051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:17:22.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:17:22.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:17:22.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:17:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35554.044557 secs 2024-04-21T20:17:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:23 smithi077 ceph-mon[27902]: pgmap v19052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:17:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:17:23.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:17:23.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35554.044557 secs 2024-04-21T20:17:23.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:23 smithi191 ceph-mon[31636]: pgmap v19052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:17:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:17:23.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:17:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35554.044557 secs 2024-04-21T20:17:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:23 smithi170 ceph-mon[31212]: pgmap v19052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:17:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:17:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:17:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35555.801033 secs 2024-04-21T20:17:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35555.801033 secs 2024-04-21T20:17:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35555.801033 secs 2024-04-21T20:17:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:25 smithi170 ceph-mon[31212]: pgmap v19053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:25 smithi077 ceph-mon[27902]: pgmap v19053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:25 smithi191 ceph-mon[31636]: pgmap v19053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:27 smithi170 ceph-mon[31212]: pgmap v19054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:27 smithi077 ceph-mon[27902]: pgmap v19054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:27.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:27 smithi191 ceph-mon[31636]: pgmap v19054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35559.044692 secs 2024-04-21T20:17:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:28 smithi170 ceph-mon[31212]: pgmap v19055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35559.044692 secs 2024-04-21T20:17:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:28 smithi077 ceph-mon[27902]: pgmap v19055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35559.044692 secs 2024-04-21T20:17:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:28 smithi191 ceph-mon[31636]: pgmap v19055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35560.801154 secs 2024-04-21T20:17:29.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35560.801154 secs 2024-04-21T20:17:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35560.801154 secs 2024-04-21T20:17:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:30 smithi077 ceph-mon[27902]: pgmap v19056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:30 smithi191 ceph-mon[31636]: pgmap v19056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:30 smithi170 ceph-mon[31212]: pgmap v19056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35564.044831 secs 2024-04-21T20:17:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:33 smithi170 ceph-mon[31212]: pgmap v19057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35564.044831 secs 2024-04-21T20:17:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:33 smithi077 ceph-mon[27902]: pgmap v19057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35564.044831 secs 2024-04-21T20:17:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:33 smithi191 ceph-mon[31636]: pgmap v19057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35565.801279 secs 2024-04-21T20:17:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35565.801279 secs 2024-04-21T20:17:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35565.801279 secs 2024-04-21T20:17:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:35 smithi170 ceph-mon[31212]: pgmap v19058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:35 smithi077 ceph-mon[27902]: pgmap v19058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:35 smithi191 ceph-mon[31636]: pgmap v19058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:37 smithi170 ceph-mon[31212]: pgmap v19059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:37 smithi077 ceph-mon[27902]: pgmap v19059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:37.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:37 smithi191 ceph-mon[31636]: pgmap v19059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35569.044914 secs 2024-04-21T20:17:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35569.044914 secs 2024-04-21T20:17:38.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35569.044914 secs 2024-04-21T20:17:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:39 smithi170 ceph-mon[31212]: pgmap v19060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35570.801426 secs 2024-04-21T20:17:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:39 smithi191 ceph-mon[31636]: pgmap v19060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35570.801426 secs 2024-04-21T20:17:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:39 smithi077 ceph-mon[27902]: pgmap v19060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35570.801426 secs 2024-04-21T20:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:41 smithi170 ceph-mon[31212]: pgmap v19061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:41.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:41 smithi077 ceph-mon[27902]: pgmap v19061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:41.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:41 smithi191 ceph-mon[31636]: pgmap v19061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35574.045038 secs 2024-04-21T20:17:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:43 smithi170 ceph-mon[31212]: pgmap v19062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35574.045038 secs 2024-04-21T20:17:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:43 smithi077 ceph-mon[27902]: pgmap v19062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35574.045038 secs 2024-04-21T20:17:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:43 smithi191 ceph-mon[31636]: pgmap v19062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35575.801488 secs 2024-04-21T20:17:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35575.801488 secs 2024-04-21T20:17:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35575.801488 secs 2024-04-21T20:17:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:45 smithi170 ceph-mon[31212]: pgmap v19063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:45.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:45 smithi077 ceph-mon[27902]: pgmap v19063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:45.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:45 smithi191 ceph-mon[31636]: pgmap v19063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:47 smithi170 ceph-mon[31212]: pgmap v19064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:47.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:47 smithi077 ceph-mon[27902]: pgmap v19064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:47 smithi191 ceph-mon[31636]: pgmap v19064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:48.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35579.045160 secs 2024-04-21T20:17:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35579.045160 secs 2024-04-21T20:17:48.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35579.045160 secs 2024-04-21T20:17:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:49 smithi170 ceph-mon[31212]: pgmap v19065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35580.801631 secs 2024-04-21T20:17:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:49 smithi077 ceph-mon[27902]: pgmap v19065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35580.801631 secs 2024-04-21T20:17:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:49 smithi191 ceph-mon[31636]: pgmap v19065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35580.801631 secs 2024-04-21T20:17:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:51 smithi170 ceph-mon[31212]: pgmap v19066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:51 smithi077 ceph-mon[27902]: pgmap v19066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:51.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:51 smithi191 ceph-mon[31636]: pgmap v19066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35584.045303 secs 2024-04-21T20:17:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:53 smithi170 ceph-mon[31212]: pgmap v19067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35584.045303 secs 2024-04-21T20:17:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:53 smithi077 ceph-mon[27902]: pgmap v19067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35584.045303 secs 2024-04-21T20:17:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:53 smithi191 ceph-mon[31636]: pgmap v19067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35585.801724 secs 2024-04-21T20:17:54.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35585.801724 secs 2024-04-21T20:17:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35585.801724 secs 2024-04-21T20:17:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:17:55.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:55 smithi170 ceph-mon[31212]: pgmap v19068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:55 smithi077 ceph-mon[27902]: pgmap v19068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:55 smithi191 ceph-mon[31636]: pgmap v19068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:57.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:57 smithi170 ceph-mon[31212]: pgmap v19069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:57.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:57 smithi077 ceph-mon[27902]: pgmap v19069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:57.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:57 smithi191 ceph-mon[31636]: pgmap v19069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:17:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35589.045448 secs 2024-04-21T20:17:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:58 smithi170 ceph-mon[31212]: pgmap v19070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:58.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35589.045448 secs 2024-04-21T20:17:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:58 smithi077 ceph-mon[27902]: pgmap v19070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:58.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35589.045448 secs 2024-04-21T20:17:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:58 smithi191 ceph-mon[31636]: pgmap v19070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:17:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35590.801841 secs 2024-04-21T20:17:59.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35590.801841 secs 2024-04-21T20:17:59.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35590.801841 secs 2024-04-21T20:18:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:00 smithi170 ceph-mon[31212]: pgmap v19071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:00.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:00 smithi077 ceph-mon[27902]: pgmap v19071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:00.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:00 smithi191 ceph-mon[31636]: pgmap v19071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35594.045566 secs 2024-04-21T20:18:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:03 smithi170 ceph-mon[31212]: pgmap v19072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35594.045566 secs 2024-04-21T20:18:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:03 smithi077 ceph-mon[27902]: pgmap v19072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35594.045566 secs 2024-04-21T20:18:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:03 smithi191 ceph-mon[31636]: pgmap v19072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35595.801956 secs 2024-04-21T20:18:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35595.801956 secs 2024-04-21T20:18:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35595.801956 secs 2024-04-21T20:18:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:05.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:05 smithi170 ceph-mon[31212]: pgmap v19073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:05.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:05 smithi170 ceph-mon[31212]: osdmap e1264: 12 total, 12 up, 12 in 2024-04-21T20:18:05.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:05 smithi077 ceph-mon[27902]: pgmap v19073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:05 smithi077 ceph-mon[27902]: osdmap e1264: 12 total, 12 up, 12 in 2024-04-21T20:18:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:05 smithi191 ceph-mon[31636]: pgmap v19073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:05 smithi191 ceph-mon[31636]: osdmap e1264: 12 total, 12 up, 12 in 2024-04-21T20:18:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:07 smithi170 ceph-mon[31212]: pgmap v19075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:18:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:07 smithi077 ceph-mon[27902]: pgmap v19075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:18:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:07 smithi191 ceph-mon[31636]: pgmap v19075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:18:08.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35599.045708 secs 2024-04-21T20:18:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35599.045708 secs 2024-04-21T20:18:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35599.045708 secs 2024-04-21T20:18:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:09 smithi170 ceph-mon[31212]: pgmap v19076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:18:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35600.802024 secs 2024-04-21T20:18:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:09 smithi170 ceph-mon[31212]: osdmap e1265: 12 total, 12 up, 12 in 2024-04-21T20:18:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:09 smithi191 ceph-mon[31636]: pgmap v19076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:18:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35600.802024 secs 2024-04-21T20:18:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:09 smithi191 ceph-mon[31636]: osdmap e1265: 12 total, 12 up, 12 in 2024-04-21T20:18:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:09 smithi077 ceph-mon[27902]: pgmap v19076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:18:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35600.802024 secs 2024-04-21T20:18:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:09 smithi077 ceph-mon[27902]: osdmap e1265: 12 total, 12 up, 12 in 2024-04-21T20:18:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:11 smithi170 ceph-mon[31212]: pgmap v19078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:18:11.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:11 smithi077 ceph-mon[27902]: pgmap v19078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:18:11.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:11 smithi191 ceph-mon[31636]: pgmap v19078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:18:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35604.045801 secs 2024-04-21T20:18:13.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:13 smithi170 ceph-mon[31212]: pgmap v19079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:18:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35604.045801 secs 2024-04-21T20:18:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:13 smithi077 ceph-mon[27902]: pgmap v19079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:18:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35604.045801 secs 2024-04-21T20:18:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:13 smithi191 ceph-mon[31636]: pgmap v19079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:18:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35605.802128 secs 2024-04-21T20:18:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35605.802128 secs 2024-04-21T20:18:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35605.802128 secs 2024-04-21T20:18:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:15 smithi170 ceph-mon[31212]: pgmap v19080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:18:15.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:15 smithi077 ceph-mon[27902]: pgmap v19080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:18:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:15 smithi191 ceph-mon[31636]: pgmap v19080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:18:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:17 smithi170 ceph-mon[31212]: pgmap v19081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:18:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:17 smithi077 ceph-mon[27902]: pgmap v19081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:18:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:17 smithi191 ceph-mon[31636]: pgmap v19081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:18:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35609.045927 secs 2024-04-21T20:18:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35609.045927 secs 2024-04-21T20:18:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35609.045927 secs 2024-04-21T20:18:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:19 smithi170 ceph-mon[31212]: pgmap v19082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:18:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35610.802245 secs 2024-04-21T20:18:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:19 smithi077 ceph-mon[27902]: pgmap v19082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:18:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35610.802245 secs 2024-04-21T20:18:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:19 smithi191 ceph-mon[31636]: pgmap v19082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:18:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35610.802245 secs 2024-04-21T20:18:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:21.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:21 smithi170 ceph-mon[31212]: pgmap v19083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:18:21.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:21 smithi077 ceph-mon[27902]: pgmap v19083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:18:21.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:21 smithi191 ceph-mon[31636]: pgmap v19083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:18:23.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35614.046006 secs 2024-04-21T20:18:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:23 smithi170 ceph-mon[31212]: pgmap v19084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:18:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35614.046006 secs 2024-04-21T20:18:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:23 smithi077 ceph-mon[27902]: pgmap v19084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:18:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35614.046006 secs 2024-04-21T20:18:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:23 smithi191 ceph-mon[31636]: pgmap v19084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35615.802370 secs 2024-04-21T20:18:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:24 smithi170 ceph-mon[31212]: pgmap v19085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:18:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:18:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:18:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35615.802370 secs 2024-04-21T20:18:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:24 smithi077 ceph-mon[27902]: pgmap v19085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:18:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:18:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:18:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35615.802370 secs 2024-04-21T20:18:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:24 smithi191 ceph-mon[31636]: pgmap v19085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:27 smithi170 ceph-mon[31212]: pgmap v19086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:27 smithi077 ceph-mon[27902]: pgmap v19086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:27.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:27 smithi191 ceph-mon[31636]: pgmap v19086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35619.046121 secs 2024-04-21T20:18:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35619.046121 secs 2024-04-21T20:18:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35619.046121 secs 2024-04-21T20:18:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:29 smithi077 ceph-mon[27902]: pgmap v19087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:29.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35620.802481 secs 2024-04-21T20:18:29.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:29 smithi170 ceph-mon[31212]: pgmap v19087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35620.802481 secs 2024-04-21T20:18:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:29 smithi191 ceph-mon[31636]: pgmap v19087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35620.802481 secs 2024-04-21T20:18:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:31 smithi170 ceph-mon[31212]: pgmap v19088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:31.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:31 smithi077 ceph-mon[27902]: pgmap v19088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:31.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:31 smithi191 ceph-mon[31636]: pgmap v19088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35624.046249 secs 2024-04-21T20:18:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:33 smithi170 ceph-mon[31212]: pgmap v19089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:33.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35624.046249 secs 2024-04-21T20:18:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:33 smithi077 ceph-mon[27902]: pgmap v19089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35624.046249 secs 2024-04-21T20:18:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:33 smithi191 ceph-mon[31636]: pgmap v19089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35625.802598 secs 2024-04-21T20:18:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35625.802598 secs 2024-04-21T20:18:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35625.802598 secs 2024-04-21T20:18:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:35 smithi170 ceph-mon[31212]: pgmap v19090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:35 smithi077 ceph-mon[27902]: pgmap v19090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:35 smithi191 ceph-mon[31636]: pgmap v19090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:37.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:37 smithi170 ceph-mon[31212]: pgmap v19091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:37.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:37 smithi077 ceph-mon[27902]: pgmap v19091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:37.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:37 smithi191 ceph-mon[31636]: pgmap v19091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35629.046371 secs 2024-04-21T20:18:38.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35629.046371 secs 2024-04-21T20:18:38.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35629.046371 secs 2024-04-21T20:18:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:39 smithi170 ceph-mon[31212]: pgmap v19092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:39.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35630.802712 secs 2024-04-21T20:18:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:39 smithi191 ceph-mon[31636]: pgmap v19092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35630.802712 secs 2024-04-21T20:18:39.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:39 smithi077 ceph-mon[27902]: pgmap v19092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:39.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35630.802712 secs 2024-04-21T20:18:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:41.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:41 smithi170 ceph-mon[31212]: pgmap v19093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:41.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:41 smithi077 ceph-mon[27902]: pgmap v19093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:41.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:41 smithi191 ceph-mon[31636]: pgmap v19093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35634.046492 secs 2024-04-21T20:18:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:43 smithi170 ceph-mon[31212]: pgmap v19094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35634.046492 secs 2024-04-21T20:18:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:43 smithi077 ceph-mon[27902]: pgmap v19094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35634.046492 secs 2024-04-21T20:18:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:43 smithi191 ceph-mon[31636]: pgmap v19094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:44.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35635.802825 secs 2024-04-21T20:18:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35635.802825 secs 2024-04-21T20:18:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35635.802825 secs 2024-04-21T20:18:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:45 smithi170 ceph-mon[31212]: pgmap v19095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:45 smithi077 ceph-mon[27902]: pgmap v19095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:45.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:45 smithi191 ceph-mon[31636]: pgmap v19095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:46.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:46 smithi077 ceph-mon[27902]: pgmap v19096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:46.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:46 smithi191 ceph-mon[31636]: pgmap v19096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:46 smithi170 ceph-mon[31212]: pgmap v19096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35639.046616 secs 2024-04-21T20:18:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35639.046616 secs 2024-04-21T20:18:48.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35639.046616 secs 2024-04-21T20:18:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:48 smithi077 ceph-mon[27902]: pgmap v19097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:48 smithi191 ceph-mon[31636]: pgmap v19097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:48 smithi170 ceph-mon[31212]: pgmap v19097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35640.802929 secs 2024-04-21T20:18:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35640.802929 secs 2024-04-21T20:18:50.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35640.802929 secs 2024-04-21T20:18:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:50 smithi077 ceph-mon[27902]: pgmap v19098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:50 smithi191 ceph-mon[31636]: pgmap v19098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:50 smithi170 ceph-mon[31212]: pgmap v19098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35644.046734 secs 2024-04-21T20:18:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:53 smithi170 ceph-mon[31212]: pgmap v19099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35644.046734 secs 2024-04-21T20:18:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:53 smithi077 ceph-mon[27902]: pgmap v19099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35644.046734 secs 2024-04-21T20:18:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:53 smithi191 ceph-mon[31636]: pgmap v19099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:54.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35645.803062 secs 2024-04-21T20:18:54.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35645.803062 secs 2024-04-21T20:18:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35645.803062 secs 2024-04-21T20:18:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:18:55.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:55 smithi170 ceph-mon[31212]: pgmap v19100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:55.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:55 smithi077 ceph-mon[27902]: pgmap v19100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:55 smithi191 ceph-mon[31636]: pgmap v19100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:57.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:57 smithi170 ceph-mon[31212]: pgmap v19101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:57.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:57 smithi077 ceph-mon[27902]: pgmap v19101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:57.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:57 smithi191 ceph-mon[31636]: pgmap v19101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:18:58.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35649.046854 secs 2024-04-21T20:18:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35649.046854 secs 2024-04-21T20:18:58.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35649.046854 secs 2024-04-21T20:18:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:59 smithi077 ceph-mon[27902]: pgmap v19102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:59.791 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35650.803160 secs 2024-04-21T20:18:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:59 smithi170 ceph-mon[31212]: pgmap v19102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:59.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35650.803160 secs 2024-04-21T20:18:59.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:59 smithi191 ceph-mon[31636]: pgmap v19102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:18:59.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35650.803160 secs 2024-04-21T20:19:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:01.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:01 smithi170 ceph-mon[31212]: pgmap v19103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:01.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:01 smithi077 ceph-mon[27902]: pgmap v19103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:01.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:01 smithi191 ceph-mon[31636]: pgmap v19103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35654.046954 secs 2024-04-21T20:19:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:03 smithi170 ceph-mon[31212]: pgmap v19104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35654.046954 secs 2024-04-21T20:19:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:03 smithi077 ceph-mon[27902]: pgmap v19104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35654.046954 secs 2024-04-21T20:19:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:03 smithi191 ceph-mon[31636]: pgmap v19104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35655.803268 secs 2024-04-21T20:19:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35655.803268 secs 2024-04-21T20:19:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35655.803268 secs 2024-04-21T20:19:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:05 smithi170 ceph-mon[31212]: pgmap v19105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:05 smithi170 ceph-mon[31212]: osdmap e1266: 12 total, 12 up, 12 in 2024-04-21T20:19:05.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:05 smithi077 ceph-mon[27902]: pgmap v19105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:05 smithi077 ceph-mon[27902]: osdmap e1266: 12 total, 12 up, 12 in 2024-04-21T20:19:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:05 smithi191 ceph-mon[31636]: pgmap v19105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:05 smithi191 ceph-mon[31636]: osdmap e1266: 12 total, 12 up, 12 in 2024-04-21T20:19:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:07 smithi170 ceph-mon[31212]: pgmap v19107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:19:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:07 smithi077 ceph-mon[27902]: pgmap v19107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:19:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:07 smithi191 ceph-mon[31636]: pgmap v19107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:19:08.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35659.047091 secs 2024-04-21T20:19:08.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35659.047091 secs 2024-04-21T20:19:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35659.047091 secs 2024-04-21T20:19:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:09 smithi170 ceph-mon[31212]: pgmap v19108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:19:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35660.803402 secs 2024-04-21T20:19:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:09 smithi170 ceph-mon[31212]: osdmap e1267: 12 total, 12 up, 12 in 2024-04-21T20:19:09.873 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:09 smithi191 ceph-mon[31636]: pgmap v19108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:19:09.873 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35660.803402 secs 2024-04-21T20:19:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:09 smithi191 ceph-mon[31636]: osdmap e1267: 12 total, 12 up, 12 in 2024-04-21T20:19:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:09 smithi077 ceph-mon[27902]: pgmap v19108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:19:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35660.803402 secs 2024-04-21T20:19:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:09 smithi077 ceph-mon[27902]: osdmap e1267: 12 total, 12 up, 12 in 2024-04-21T20:19:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:11 smithi170 ceph-mon[31212]: pgmap v19110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:19:11.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:11 smithi077 ceph-mon[27902]: pgmap v19110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:19:11.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:11 smithi191 ceph-mon[31636]: pgmap v19110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:19:12.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:12 smithi077 ceph-mon[27902]: pgmap v19111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:19:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:12 smithi191 ceph-mon[31636]: pgmap v19111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:19:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:12 smithi170 ceph-mon[31212]: pgmap v19111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:19:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35664.047209 secs 2024-04-21T20:19:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35664.047209 secs 2024-04-21T20:19:14.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35664.047209 secs 2024-04-21T20:19:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35665.803463 secs 2024-04-21T20:19:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:14 smithi077 ceph-mon[27902]: pgmap v19112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:19:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35665.803463 secs 2024-04-21T20:19:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:14 smithi191 ceph-mon[31636]: pgmap v19112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:19:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35665.803463 secs 2024-04-21T20:19:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:14 smithi170 ceph-mon[31212]: pgmap v19112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:19:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:17 smithi170 ceph-mon[31212]: pgmap v19113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:19:17.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:17 smithi077 ceph-mon[27902]: pgmap v19113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:19:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:17 smithi191 ceph-mon[31636]: pgmap v19113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:19:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35669.047351 secs 2024-04-21T20:19:18.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35669.047351 secs 2024-04-21T20:19:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35669.047351 secs 2024-04-21T20:19:19.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:19 smithi170 ceph-mon[31212]: pgmap v19114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:19:19.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35670.803585 secs 2024-04-21T20:19:19.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:19 smithi077 ceph-mon[27902]: pgmap v19114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:19:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35670.803585 secs 2024-04-21T20:19:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:19 smithi191 ceph-mon[31636]: pgmap v19114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:19:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35670.803585 secs 2024-04-21T20:19:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:21.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:21 smithi170 ceph-mon[31212]: pgmap v19115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:19:21.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:21 smithi077 ceph-mon[27902]: pgmap v19115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:19:21.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:21 smithi191 ceph-mon[31636]: pgmap v19115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:19:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35674.047466 secs 2024-04-21T20:19:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:23 smithi170 ceph-mon[31212]: pgmap v19116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35674.047466 secs 2024-04-21T20:19:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:23 smithi077 ceph-mon[27902]: pgmap v19116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35674.047466 secs 2024-04-21T20:19:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:23 smithi191 ceph-mon[31636]: pgmap v19116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:24.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:19:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35675.803689 secs 2024-04-21T20:19:24.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:19:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35675.803689 secs 2024-04-21T20:19:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:19:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35675.803689 secs 2024-04-21T20:19:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:25 smithi170 ceph-mon[31212]: pgmap v19117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:19:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:19:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:19:25.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:25 smithi077 ceph-mon[27902]: pgmap v19117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:19:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:19:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:19:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:25 smithi191 ceph-mon[31636]: pgmap v19117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:19:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:19:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:19:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:27 smithi170 ceph-mon[31212]: pgmap v19118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:27.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:27 smithi077 ceph-mon[27902]: pgmap v19118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:27.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:27 smithi191 ceph-mon[31636]: pgmap v19118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:28.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35679.047598 secs 2024-04-21T20:19:28.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35679.047598 secs 2024-04-21T20:19:28.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35679.047598 secs 2024-04-21T20:19:29.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:29 smithi170 ceph-mon[31212]: pgmap v19119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35680.803819 secs 2024-04-21T20:19:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:29 smithi077 ceph-mon[27902]: pgmap v19119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35680.803819 secs 2024-04-21T20:19:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:29 smithi191 ceph-mon[31636]: pgmap v19119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35680.803819 secs 2024-04-21T20:19:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:31 smithi170 ceph-mon[31212]: pgmap v19120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:31.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:31 smithi077 ceph-mon[27902]: pgmap v19120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:31.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:31 smithi191 ceph-mon[31636]: pgmap v19120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35684.047729 secs 2024-04-21T20:19:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:33 smithi170 ceph-mon[31212]: pgmap v19121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:33.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35684.047729 secs 2024-04-21T20:19:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:33 smithi077 ceph-mon[27902]: pgmap v19121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35684.047729 secs 2024-04-21T20:19:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:33 smithi191 ceph-mon[31636]: pgmap v19121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35685.803889 secs 2024-04-21T20:19:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35685.803889 secs 2024-04-21T20:19:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35685.803889 secs 2024-04-21T20:19:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:35.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:35 smithi077 ceph-mon[27902]: pgmap v19122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:35 smithi191 ceph-mon[31636]: pgmap v19122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:35 smithi170 ceph-mon[31212]: pgmap v19122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:36.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:36 smithi077 ceph-mon[27902]: pgmap v19123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:36 smithi191 ceph-mon[31636]: pgmap v19123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:36 smithi170 ceph-mon[31212]: pgmap v19123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35689.047849 secs 2024-04-21T20:19:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35689.047849 secs 2024-04-21T20:19:38.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35689.047849 secs 2024-04-21T20:19:39.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:38 smithi191 ceph-mon[31636]: pgmap v19124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:38 smithi077 ceph-mon[27902]: pgmap v19124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:39.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:38 smithi170 ceph-mon[31212]: pgmap v19124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35690.804023 secs 2024-04-21T20:19:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35690.804023 secs 2024-04-21T20:19:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35690.804023 secs 2024-04-21T20:19:41.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:40 smithi077 ceph-mon[27902]: pgmap v19125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:40 smithi191 ceph-mon[31636]: pgmap v19125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:40 smithi170 ceph-mon[31212]: pgmap v19125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35694.047969 secs 2024-04-21T20:19:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:43 smithi170 ceph-mon[31212]: pgmap v19126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:43.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35694.047969 secs 2024-04-21T20:19:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:43 smithi077 ceph-mon[27902]: pgmap v19126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35694.047969 secs 2024-04-21T20:19:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:43 smithi191 ceph-mon[31636]: pgmap v19126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35695.804133 secs 2024-04-21T20:19:44.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35695.804133 secs 2024-04-21T20:19:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35695.804133 secs 2024-04-21T20:19:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:45 smithi170 ceph-mon[31212]: pgmap v19127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:45.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:45 smithi077 ceph-mon[27902]: pgmap v19127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:45.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:45 smithi191 ceph-mon[31636]: pgmap v19127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:47.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:47 smithi170 ceph-mon[31212]: pgmap v19128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:47 smithi077 ceph-mon[27902]: pgmap v19128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:47 smithi191 ceph-mon[31636]: pgmap v19128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:48.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35699.048073 secs 2024-04-21T20:19:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35699.048073 secs 2024-04-21T20:19:48.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35699.048073 secs 2024-04-21T20:19:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:49 smithi170 ceph-mon[31212]: pgmap v19129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:49.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35700.804245 secs 2024-04-21T20:19:49.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:49 smithi077 ceph-mon[27902]: pgmap v19129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35700.804245 secs 2024-04-21T20:19:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:49 smithi191 ceph-mon[31636]: pgmap v19129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35700.804245 secs 2024-04-21T20:19:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:51.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:51 smithi170 ceph-mon[31212]: pgmap v19130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:51 smithi077 ceph-mon[27902]: pgmap v19130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:51.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:51 smithi191 ceph-mon[31636]: pgmap v19130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35704.048156 secs 2024-04-21T20:19:53.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:53 smithi170 ceph-mon[31212]: pgmap v19131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35704.048156 secs 2024-04-21T20:19:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:53 smithi077 ceph-mon[27902]: pgmap v19131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35704.048156 secs 2024-04-21T20:19:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:53 smithi191 ceph-mon[31636]: pgmap v19131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35705.804361 secs 2024-04-21T20:19:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35705.804361 secs 2024-04-21T20:19:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35705.804361 secs 2024-04-21T20:19:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:19:55.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:55 smithi077 ceph-mon[27902]: pgmap v19132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:55 smithi191 ceph-mon[31636]: pgmap v19132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:55 smithi170 ceph-mon[31212]: pgmap v19132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:56.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:56 smithi077 ceph-mon[27902]: pgmap v19133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:56.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:56 smithi191 ceph-mon[31636]: pgmap v19133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:56 smithi170 ceph-mon[31212]: pgmap v19133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:19:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35709.048238 secs 2024-04-21T20:19:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35709.048238 secs 2024-04-21T20:19:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35709.048238 secs 2024-04-21T20:19:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:58 smithi077 ceph-mon[27902]: pgmap v19134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:58 smithi191 ceph-mon[31636]: pgmap v19134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:19:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:19:59.289+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:19:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:19:59.289+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:19:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:19:59.289+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:19:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:19:59.289+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:19:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:58 smithi170 ceph-mon[31212]: pgmap v19134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35710.804489 secs 2024-04-21T20:20:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35710.804489 secs 2024-04-21T20:20:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35710.804489 secs 2024-04-21T20:20:01.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:20:01.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:00 smithi077 ceph-mon[27902]: pgmap v19135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:20:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:00 smithi191 ceph-mon[31636]: pgmap v19135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:01.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:20:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:00 smithi170 ceph-mon[31212]: pgmap v19135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35714.048314 secs 2024-04-21T20:20:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:03 smithi170 ceph-mon[31212]: pgmap v19136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35714.048314 secs 2024-04-21T20:20:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:03 smithi077 ceph-mon[27902]: pgmap v19136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35714.048314 secs 2024-04-21T20:20:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:03 smithi191 ceph-mon[31636]: pgmap v19136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35715.804629 secs 2024-04-21T20:20:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35715.804629 secs 2024-04-21T20:20:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35715.804629 secs 2024-04-21T20:20:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:05 smithi170 ceph-mon[31212]: pgmap v19137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:05 smithi170 ceph-mon[31212]: osdmap e1268: 12 total, 12 up, 12 in 2024-04-21T20:20:05.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:05 smithi077 ceph-mon[27902]: pgmap v19137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:05 smithi077 ceph-mon[27902]: osdmap e1268: 12 total, 12 up, 12 in 2024-04-21T20:20:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:05 smithi191 ceph-mon[31636]: pgmap v19137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:05 smithi191 ceph-mon[31636]: osdmap e1268: 12 total, 12 up, 12 in 2024-04-21T20:20:07.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:07 smithi170 ceph-mon[31212]: pgmap v19139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:20:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:07 smithi077 ceph-mon[27902]: pgmap v19139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:20:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:07 smithi191 ceph-mon[31636]: pgmap v19139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:20:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35719.048444 secs 2024-04-21T20:20:08.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35719.048444 secs 2024-04-21T20:20:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35719.048444 secs 2024-04-21T20:20:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:09 smithi170 ceph-mon[31212]: pgmap v19140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:20:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35720.804750 secs 2024-04-21T20:20:09.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:09 smithi170 ceph-mon[31212]: osdmap e1269: 12 total, 12 up, 12 in 2024-04-21T20:20:09.873 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:09 smithi191 ceph-mon[31636]: pgmap v19140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:20:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35720.804750 secs 2024-04-21T20:20:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:09 smithi191 ceph-mon[31636]: osdmap e1269: 12 total, 12 up, 12 in 2024-04-21T20:20:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:09 smithi077 ceph-mon[27902]: pgmap v19140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:20:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35720.804750 secs 2024-04-21T20:20:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:09 smithi077 ceph-mon[27902]: osdmap e1269: 12 total, 12 up, 12 in 2024-04-21T20:20:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:11 smithi170 ceph-mon[31212]: pgmap v19142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:20:11.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:11 smithi077 ceph-mon[27902]: pgmap v19142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:20:11.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:11 smithi191 ceph-mon[31636]: pgmap v19142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:20:13.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35724.048590 secs 2024-04-21T20:20:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:13 smithi170 ceph-mon[31212]: pgmap v19143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:20:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35724.048590 secs 2024-04-21T20:20:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:13 smithi077 ceph-mon[27902]: pgmap v19143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:20:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35724.048590 secs 2024-04-21T20:20:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:13 smithi191 ceph-mon[31636]: pgmap v19143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:20:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35725.804880 secs 2024-04-21T20:20:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35725.804880 secs 2024-04-21T20:20:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35725.804880 secs 2024-04-21T20:20:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:15.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:15 smithi077 ceph-mon[27902]: pgmap v19144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:20:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:15 smithi191 ceph-mon[31636]: pgmap v19144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:20:16.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:15 smithi170 ceph-mon[31212]: pgmap v19144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:20:17.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:17 smithi077 ceph-mon[27902]: pgmap v19145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:20:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:17 smithi191 ceph-mon[31636]: pgmap v19145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:20:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:17 smithi170 ceph-mon[31212]: pgmap v19145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:20:18.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35729.048720 secs 2024-04-21T20:20:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:18 smithi077 ceph-mon[27902]: pgmap v19146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:20:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35729.048720 secs 2024-04-21T20:20:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:18 smithi191 ceph-mon[31636]: pgmap v19146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:20:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35729.048720 secs 2024-04-21T20:20:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:18 smithi170 ceph-mon[31212]: pgmap v19146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:20:19.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35730.804993 secs 2024-04-21T20:20:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35730.804993 secs 2024-04-21T20:20:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35730.804993 secs 2024-04-21T20:20:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:20.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:20 smithi077 ceph-mon[27902]: pgmap v19147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:20:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:20 smithi191 ceph-mon[31636]: pgmap v19147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:20:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:20 smithi170 ceph-mon[31212]: pgmap v19147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:20:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35734.048791 secs 2024-04-21T20:20:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:23 smithi170 ceph-mon[31212]: pgmap v19148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35734.048791 secs 2024-04-21T20:20:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:23 smithi077 ceph-mon[27902]: pgmap v19148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35734.048791 secs 2024-04-21T20:20:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:23 smithi191 ceph-mon[31636]: pgmap v19148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:24.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35735.805073 secs 2024-04-21T20:20:24.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35735.805073 secs 2024-04-21T20:20:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35735.805073 secs 2024-04-21T20:20:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:25 smithi170 ceph-mon[31212]: pgmap v19149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:20:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:20:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:20:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:20:25.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:25 smithi077 ceph-mon[27902]: pgmap v19149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:20:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:20:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:20:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:20:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:25 smithi191 ceph-mon[31636]: pgmap v19149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:20:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:20:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:20:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:20:27.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:27 smithi170 ceph-mon[31212]: pgmap v19150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:27.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:27 smithi077 ceph-mon[27902]: pgmap v19150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:27.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:27 smithi191 ceph-mon[31636]: pgmap v19150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35739.048915 secs 2024-04-21T20:20:28.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35739.048915 secs 2024-04-21T20:20:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35739.048915 secs 2024-04-21T20:20:29.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:29 smithi170 ceph-mon[31212]: pgmap v19151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:29.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35740.805189 secs 2024-04-21T20:20:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:29 smithi077 ceph-mon[27902]: pgmap v19151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35740.805189 secs 2024-04-21T20:20:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:29 smithi191 ceph-mon[31636]: pgmap v19151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:29.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35740.805189 secs 2024-04-21T20:20:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:31 smithi170 ceph-mon[31212]: pgmap v19152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:31 smithi077 ceph-mon[27902]: pgmap v19152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:31.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:31 smithi191 ceph-mon[31636]: pgmap v19152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35744.049030 secs 2024-04-21T20:20:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:33 smithi077 ceph-mon[27902]: pgmap v19153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35744.049030 secs 2024-04-21T20:20:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:33 smithi191 ceph-mon[31636]: pgmap v19153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35744.049030 secs 2024-04-21T20:20:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:33 smithi170 ceph-mon[31212]: pgmap v19153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35745.805260 secs 2024-04-21T20:20:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35745.805260 secs 2024-04-21T20:20:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35745.805260 secs 2024-04-21T20:20:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:35.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:35 smithi077 ceph-mon[27902]: pgmap v19154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:35 smithi191 ceph-mon[31636]: pgmap v19154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:35 smithi170 ceph-mon[31212]: pgmap v19154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:36.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:36 smithi077 ceph-mon[27902]: pgmap v19155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:36 smithi191 ceph-mon[31636]: pgmap v19155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:36 smithi170 ceph-mon[31212]: pgmap v19155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35749.049161 secs 2024-04-21T20:20:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35749.049161 secs 2024-04-21T20:20:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35749.049161 secs 2024-04-21T20:20:39.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:38 smithi191 ceph-mon[31636]: pgmap v19156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:38 smithi077 ceph-mon[27902]: pgmap v19156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:39.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:38 smithi170 ceph-mon[31212]: pgmap v19156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35750.805354 secs 2024-04-21T20:20:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35750.805354 secs 2024-04-21T20:20:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35750.805354 secs 2024-04-21T20:20:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:40 smithi077 ceph-mon[27902]: pgmap v19157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:40 smithi191 ceph-mon[31636]: pgmap v19157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:40 smithi170 ceph-mon[31212]: pgmap v19157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35754.049261 secs 2024-04-21T20:20:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:43 smithi170 ceph-mon[31212]: pgmap v19158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:43.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35754.049261 secs 2024-04-21T20:20:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:43 smithi077 ceph-mon[27902]: pgmap v19158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35754.049261 secs 2024-04-21T20:20:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:43 smithi191 ceph-mon[31636]: pgmap v19158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:44.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35755.805489 secs 2024-04-21T20:20:44.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35755.805489 secs 2024-04-21T20:20:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35755.805489 secs 2024-04-21T20:20:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:45.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:45 smithi170 ceph-mon[31212]: pgmap v19159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:45 smithi077 ceph-mon[27902]: pgmap v19159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:45.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:45 smithi191 ceph-mon[31636]: pgmap v19159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:47.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:47 smithi170 ceph-mon[31212]: pgmap v19160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:47.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:47 smithi077 ceph-mon[27902]: pgmap v19160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:47 smithi191 ceph-mon[31636]: pgmap v19160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35759.049334 secs 2024-04-21T20:20:48.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35759.049334 secs 2024-04-21T20:20:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35759.049334 secs 2024-04-21T20:20:49.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:49 smithi077 ceph-mon[27902]: pgmap v19161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35760.805606 secs 2024-04-21T20:20:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:49 smithi191 ceph-mon[31636]: pgmap v19161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35760.805606 secs 2024-04-21T20:20:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:49 smithi170 ceph-mon[31212]: pgmap v19161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35760.805606 secs 2024-04-21T20:20:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:51.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:51 smithi077 ceph-mon[27902]: pgmap v19162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:51.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:51 smithi191 ceph-mon[31636]: pgmap v19162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:52.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:51 smithi170 ceph-mon[31212]: pgmap v19162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35764.049478 secs 2024-04-21T20:20:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:53 smithi077 ceph-mon[27902]: pgmap v19163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35764.049478 secs 2024-04-21T20:20:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:53 smithi191 ceph-mon[31636]: pgmap v19163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35764.049478 secs 2024-04-21T20:20:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:53 smithi170 ceph-mon[31212]: pgmap v19163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:54.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35765.805722 secs 2024-04-21T20:20:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35765.805722 secs 2024-04-21T20:20:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35765.805722 secs 2024-04-21T20:20:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:20:55.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:55 smithi077 ceph-mon[27902]: pgmap v19164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:55 smithi191 ceph-mon[31636]: pgmap v19164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:55 smithi170 ceph-mon[31212]: pgmap v19164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:56.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:56 smithi077 ceph-mon[27902]: pgmap v19165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:56.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:56 smithi191 ceph-mon[31636]: pgmap v19165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:57.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:56 smithi170 ceph-mon[31212]: pgmap v19165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:20:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35769.049617 secs 2024-04-21T20:20:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35769.049617 secs 2024-04-21T20:20:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35769.049617 secs 2024-04-21T20:20:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:58 smithi077 ceph-mon[27902]: pgmap v19166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:58 smithi191 ceph-mon[31636]: pgmap v19166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:20:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:58 smithi170 ceph-mon[31212]: pgmap v19166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35770.805839 secs 2024-04-21T20:21:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35770.805839 secs 2024-04-21T20:21:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35770.805839 secs 2024-04-21T20:21:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:00 smithi077 ceph-mon[27902]: pgmap v19167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:00 smithi191 ceph-mon[31636]: pgmap v19167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:01.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:00 smithi170 ceph-mon[31212]: pgmap v19167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35774.049738 secs 2024-04-21T20:21:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:03 smithi170 ceph-mon[31212]: pgmap v19168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35774.049738 secs 2024-04-21T20:21:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:03 smithi077 ceph-mon[27902]: pgmap v19168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35774.049738 secs 2024-04-21T20:21:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:03 smithi191 ceph-mon[31636]: pgmap v19168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35775.805965 secs 2024-04-21T20:21:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35775.805965 secs 2024-04-21T20:21:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35775.805965 secs 2024-04-21T20:21:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:05 smithi170 ceph-mon[31212]: pgmap v19169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:05 smithi170 ceph-mon[31212]: osdmap e1270: 12 total, 12 up, 12 in 2024-04-21T20:21:05.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:05 smithi077 ceph-mon[27902]: pgmap v19169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:05.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:05 smithi077 ceph-mon[27902]: osdmap e1270: 12 total, 12 up, 12 in 2024-04-21T20:21:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:05 smithi191 ceph-mon[31636]: pgmap v19169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:05 smithi191 ceph-mon[31636]: osdmap e1270: 12 total, 12 up, 12 in 2024-04-21T20:21:07.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:07 smithi077 ceph-mon[27902]: pgmap v19171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:21:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:07 smithi191 ceph-mon[31636]: pgmap v19171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:21:08.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:07 smithi170 ceph-mon[31212]: pgmap v19171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:21:08.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35779.049849 secs 2024-04-21T20:21:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35779.049849 secs 2024-04-21T20:21:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35779.049849 secs 2024-04-21T20:21:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:09 smithi191 ceph-mon[31636]: pgmap v19172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:21:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35780.806104 secs 2024-04-21T20:21:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:09 smithi191 ceph-mon[31636]: osdmap e1271: 12 total, 12 up, 12 in 2024-04-21T20:21:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:09 smithi077 ceph-mon[27902]: pgmap v19172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:21:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35780.806104 secs 2024-04-21T20:21:09.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:09 smithi077 ceph-mon[27902]: osdmap e1271: 12 total, 12 up, 12 in 2024-04-21T20:21:09.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:09 smithi170 ceph-mon[31212]: pgmap v19172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:21:09.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35780.806104 secs 2024-04-21T20:21:09.963 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:09 smithi170 ceph-mon[31212]: osdmap e1271: 12 total, 12 up, 12 in 2024-04-21T20:21:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:11.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:11 smithi077 ceph-mon[27902]: pgmap v19174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:21:11.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:11 smithi191 ceph-mon[31636]: pgmap v19174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:21:12.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:11 smithi170 ceph-mon[31212]: pgmap v19174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:21:13.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35784.050002 secs 2024-04-21T20:21:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:13 smithi077 ceph-mon[27902]: pgmap v19175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:21:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35784.050002 secs 2024-04-21T20:21:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:13 smithi191 ceph-mon[31636]: pgmap v19175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:21:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35784.050002 secs 2024-04-21T20:21:14.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:13 smithi170 ceph-mon[31212]: pgmap v19175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T20:21:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35785.806237 secs 2024-04-21T20:21:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:14 smithi077 ceph-mon[27902]: pgmap v19176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:21:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35785.806237 secs 2024-04-21T20:21:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:14 smithi191 ceph-mon[31636]: pgmap v19176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:21:15.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35785.806237 secs 2024-04-21T20:21:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:14 smithi170 ceph-mon[31212]: pgmap v19176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:21:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:17.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:17 smithi170 ceph-mon[31212]: pgmap v19177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:21:17.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:17 smithi077 ceph-mon[27902]: pgmap v19177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:21:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:17 smithi191 ceph-mon[31636]: pgmap v19177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:21:18.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35789.050123 secs 2024-04-21T20:21:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35789.050123 secs 2024-04-21T20:21:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35789.050123 secs 2024-04-21T20:21:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:19 smithi077 ceph-mon[27902]: pgmap v19178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:21:19.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35790.806353 secs 2024-04-21T20:21:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:19 smithi191 ceph-mon[31636]: pgmap v19178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:21:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35790.806353 secs 2024-04-21T20:21:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:19 smithi170 ceph-mon[31212]: pgmap v19178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:21:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35790.806353 secs 2024-04-21T20:21:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:21.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:21 smithi077 ceph-mon[27902]: pgmap v19179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:21:21.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:21 smithi191 ceph-mon[31636]: pgmap v19179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:21:22.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:21 smithi170 ceph-mon[31212]: pgmap v19179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:21:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35794.050188 secs 2024-04-21T20:21:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:23 smithi077 ceph-mon[27902]: pgmap v19180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35794.050188 secs 2024-04-21T20:21:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:23 smithi191 ceph-mon[31636]: pgmap v19180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35794.050188 secs 2024-04-21T20:21:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:23 smithi170 ceph-mon[31212]: pgmap v19180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:24.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35795.806464 secs 2024-04-21T20:21:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35795.806464 secs 2024-04-21T20:21:25.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35795.806464 secs 2024-04-21T20:21:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:25.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:25 smithi077 ceph-mon[27902]: pgmap v19181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:25.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:21:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:25 smithi191 ceph-mon[31636]: pgmap v19181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:21:26.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:25 smithi170 ceph-mon[31212]: pgmap v19181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:26.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:21:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:21:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:21:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:21:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:26 smithi077 ceph-mon[27902]: pgmap v19182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:21:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:21:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:21:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:26 smithi191 ceph-mon[31636]: pgmap v19182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:21:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:21:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:21:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:26 smithi170 ceph-mon[31212]: pgmap v19182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35799.050310 secs 2024-04-21T20:21:28.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35799.050310 secs 2024-04-21T20:21:28.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35799.050310 secs 2024-04-21T20:21:29.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:29 smithi077 ceph-mon[27902]: pgmap v19183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:29.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:29 smithi191 ceph-mon[31636]: pgmap v19183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:29.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:29 smithi170 ceph-mon[31212]: pgmap v19183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35800.806580 secs 2024-04-21T20:21:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35800.806580 secs 2024-04-21T20:21:30.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35800.806580 secs 2024-04-21T20:21:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:31 smithi077 ceph-mon[27902]: pgmap v19184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:31.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:31 smithi191 ceph-mon[31636]: pgmap v19184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:31.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:31 smithi170 ceph-mon[31212]: pgmap v19184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35804.050444 secs 2024-04-21T20:21:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:33 smithi170 ceph-mon[31212]: pgmap v19185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:33.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35804.050444 secs 2024-04-21T20:21:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:33 smithi077 ceph-mon[27902]: pgmap v19185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35804.050444 secs 2024-04-21T20:21:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:33 smithi191 ceph-mon[31636]: pgmap v19185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35805.806690 secs 2024-04-21T20:21:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35805.806690 secs 2024-04-21T20:21:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35805.806690 secs 2024-04-21T20:21:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:35.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:35 smithi077 ceph-mon[27902]: pgmap v19186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:35 smithi191 ceph-mon[31636]: pgmap v19186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:35 smithi170 ceph-mon[31212]: pgmap v19186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:37.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:37 smithi077 ceph-mon[27902]: pgmap v19187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:37.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:37 smithi191 ceph-mon[31636]: pgmap v19187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:38.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:37 smithi170 ceph-mon[31212]: pgmap v19187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:38.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35809.050568 secs 2024-04-21T20:21:38.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35809.050568 secs 2024-04-21T20:21:39.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35809.050568 secs 2024-04-21T20:21:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:39 smithi191 ceph-mon[31636]: pgmap v19188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:39.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35810.806815 secs 2024-04-21T20:21:39.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:39 smithi077 ceph-mon[27902]: pgmap v19188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:39.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35810.806815 secs 2024-04-21T20:21:39.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:39 smithi170 ceph-mon[31212]: pgmap v19188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:39.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35810.806815 secs 2024-04-21T20:21:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 35995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:40.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:40 smithi077 ceph-mon[27902]: pgmap v19189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:40.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:40 smithi191 ceph-mon[31636]: pgmap v19189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:40 smithi170 ceph-mon[31212]: pgmap v19189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35814.050688 secs 2024-04-21T20:21:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:43 smithi077 ceph-mon[27902]: pgmap v19190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35814.050688 secs 2024-04-21T20:21:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:43 smithi191 ceph-mon[31636]: pgmap v19190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35814.050688 secs 2024-04-21T20:21:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:43 smithi170 ceph-mon[31212]: pgmap v19190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:44.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35815.806919 secs 2024-04-21T20:21:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35815.806919 secs 2024-04-21T20:21:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35815.806919 secs 2024-04-21T20:21:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:45.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:45 smithi077 ceph-mon[27902]: pgmap v19191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:45.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:45 smithi191 ceph-mon[31636]: pgmap v19191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:46.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:45 smithi170 ceph-mon[31212]: pgmap v19191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:47.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:47 smithi077 ceph-mon[27902]: pgmap v19192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:47 smithi191 ceph-mon[31636]: pgmap v19192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:48.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:47 smithi170 ceph-mon[31212]: pgmap v19192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35819.050746 secs 2024-04-21T20:21:48.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35819.050746 secs 2024-04-21T20:21:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35819.050746 secs 2024-04-21T20:21:49.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:49 smithi077 ceph-mon[27902]: pgmap v19193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:49.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35820.806983 secs 2024-04-21T20:21:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:49 smithi191 ceph-mon[31636]: pgmap v19193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35820.806983 secs 2024-04-21T20:21:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:49 smithi170 ceph-mon[31212]: pgmap v19193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35820.806983 secs 2024-04-21T20:21:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:50 smithi077 ceph-mon[27902]: pgmap v19194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:50.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:50 smithi191 ceph-mon[31636]: pgmap v19194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:50 smithi170 ceph-mon[31212]: pgmap v19194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35824.050877 secs 2024-04-21T20:21:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:53 smithi077 ceph-mon[27902]: pgmap v19195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35824.050877 secs 2024-04-21T20:21:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:53 smithi191 ceph-mon[31636]: pgmap v19195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35824.050877 secs 2024-04-21T20:21:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:53 smithi170 ceph-mon[31212]: pgmap v19195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:54.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35825.807059 secs 2024-04-21T20:21:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35825.807059 secs 2024-04-21T20:21:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35825.807059 secs 2024-04-21T20:21:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:21:55.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:55 smithi077 ceph-mon[27902]: pgmap v19196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:55 smithi191 ceph-mon[31636]: pgmap v19196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:56.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:55 smithi170 ceph-mon[31212]: pgmap v19196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:57.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:57 smithi077 ceph-mon[27902]: pgmap v19197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:57.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:57 smithi191 ceph-mon[31636]: pgmap v19197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:58.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:57 smithi170 ceph-mon[31212]: pgmap v19197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:21:58.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35829.050947 secs 2024-04-21T20:21:58.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35829.050947 secs 2024-04-21T20:21:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35829.050947 secs 2024-04-21T20:21:59.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:59 smithi077 ceph-mon[27902]: pgmap v19198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:59.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35830.807158 secs 2024-04-21T20:21:59.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:59 smithi191 ceph-mon[31636]: pgmap v19198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:21:59.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35830.807158 secs 2024-04-21T20:22:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:59 smithi170 ceph-mon[31212]: pgmap v19198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35830.807158 secs 2024-04-21T20:22:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:00.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:00 smithi077 ceph-mon[27902]: pgmap v19199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:00.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:00 smithi191 ceph-mon[31636]: pgmap v19199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:00 smithi170 ceph-mon[31212]: pgmap v19199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35834.051085 secs 2024-04-21T20:22:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:03 smithi077 ceph-mon[27902]: pgmap v19200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35834.051085 secs 2024-04-21T20:22:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:03 smithi191 ceph-mon[31636]: pgmap v19200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35834.051085 secs 2024-04-21T20:22:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:03 smithi170 ceph-mon[31212]: pgmap v19200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35835.807273 secs 2024-04-21T20:22:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35835.807273 secs 2024-04-21T20:22:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35835.807273 secs 2024-04-21T20:22:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:05.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:05 smithi077 ceph-mon[27902]: pgmap v19201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:05 smithi077 ceph-mon[27902]: osdmap e1272: 12 total, 12 up, 12 in 2024-04-21T20:22:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:05 smithi191 ceph-mon[31636]: pgmap v19201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:05 smithi191 ceph-mon[31636]: osdmap e1272: 12 total, 12 up, 12 in 2024-04-21T20:22:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:05 smithi170 ceph-mon[31212]: pgmap v19201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:05 smithi170 ceph-mon[31212]: osdmap e1272: 12 total, 12 up, 12 in 2024-04-21T20:22:07.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:07 smithi077 ceph-mon[27902]: pgmap v19203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:22:07.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:07 smithi191 ceph-mon[31636]: pgmap v19203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:22:08.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:07 smithi170 ceph-mon[31212]: pgmap v19203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:22:08.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35839.051165 secs 2024-04-21T20:22:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35839.051165 secs 2024-04-21T20:22:09.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35839.051165 secs 2024-04-21T20:22:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:09 smithi191 ceph-mon[31636]: pgmap v19204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:22:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35840.807384 secs 2024-04-21T20:22:09.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:09 smithi191 ceph-mon[31636]: osdmap e1273: 12 total, 12 up, 12 in 2024-04-21T20:22:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:09 smithi077 ceph-mon[27902]: pgmap v19204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:22:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35840.807384 secs 2024-04-21T20:22:09.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:09 smithi077 ceph-mon[27902]: osdmap e1273: 12 total, 12 up, 12 in 2024-04-21T20:22:09.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:09 smithi170 ceph-mon[31212]: pgmap v19204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:22:09.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35840.807384 secs 2024-04-21T20:22:09.962 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:09 smithi170 ceph-mon[31212]: osdmap e1273: 12 total, 12 up, 12 in 2024-04-21T20:22:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:10 smithi077 ceph-mon[27902]: pgmap v19206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:22:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:10 smithi191 ceph-mon[31636]: pgmap v19206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:22:11.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:10 smithi170 ceph-mon[31212]: pgmap v19206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:22:13.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35844.051284 secs 2024-04-21T20:22:13.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:13 smithi077 ceph-mon[27902]: pgmap v19207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:22:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35844.051284 secs 2024-04-21T20:22:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:13 smithi191 ceph-mon[31636]: pgmap v19207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:22:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35844.051284 secs 2024-04-21T20:22:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:13 smithi170 ceph-mon[31212]: pgmap v19207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:22:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35845.807453 secs 2024-04-21T20:22:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35845.807453 secs 2024-04-21T20:22:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35845.807453 secs 2024-04-21T20:22:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:15.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:15 smithi077 ceph-mon[27902]: pgmap v19208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:22:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:15 smithi191 ceph-mon[31636]: pgmap v19208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:22:16.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:15 smithi170 ceph-mon[31212]: pgmap v19208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:22:17.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:17 smithi077 ceph-mon[27902]: pgmap v19209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:22:17.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:17 smithi191 ceph-mon[31636]: pgmap v19209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:22:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:17 smithi170 ceph-mon[31212]: pgmap v19209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:22:18.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35849.051399 secs 2024-04-21T20:22:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35849.051399 secs 2024-04-21T20:22:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35849.051399 secs 2024-04-21T20:22:19.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:19 smithi077 ceph-mon[27902]: pgmap v19210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:22:19.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35850.807588 secs 2024-04-21T20:22:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:19 smithi191 ceph-mon[31636]: pgmap v19210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:22:19.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35850.807588 secs 2024-04-21T20:22:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:19 smithi170 ceph-mon[31212]: pgmap v19210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:22:20.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35850.807588 secs 2024-04-21T20:22:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:20.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:20 smithi077 ceph-mon[27902]: pgmap v19211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:22:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:20 smithi191 ceph-mon[31636]: pgmap v19211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:22:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:20 smithi170 ceph-mon[31212]: pgmap v19211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:22:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35854.051518 secs 2024-04-21T20:22:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:23 smithi077 ceph-mon[27902]: pgmap v19212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35854.051518 secs 2024-04-21T20:22:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:23 smithi191 ceph-mon[31636]: pgmap v19212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35854.051518 secs 2024-04-21T20:22:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:23 smithi170 ceph-mon[31212]: pgmap v19212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:24.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35855.807696 secs 2024-04-21T20:22:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35855.807696 secs 2024-04-21T20:22:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35855.807696 secs 2024-04-21T20:22:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:25.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:25 smithi077 ceph-mon[27902]: pgmap v19213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:25 smithi191 ceph-mon[31636]: pgmap v19213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:26.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:25 smithi170 ceph-mon[31212]: pgmap v19213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:26.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:22:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:22:27.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:22:27.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:27 smithi077 ceph-mon[27902]: pgmap v19214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:27.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:22:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:22:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:22:27.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:27 smithi191 ceph-mon[31636]: pgmap v19214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:27.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:22:27.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:22:27.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:22:28.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:27 smithi170 ceph-mon[31212]: pgmap v19214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:28.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:22:28.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:22:28.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:22:28.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35859.051640 secs 2024-04-21T20:22:28.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:28 smithi077 ceph-mon[27902]: pgmap v19215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35859.051640 secs 2024-04-21T20:22:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:28 smithi191 ceph-mon[31636]: pgmap v19215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35859.051640 secs 2024-04-21T20:22:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:28 smithi170 ceph-mon[31212]: pgmap v19215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35860.807812 secs 2024-04-21T20:22:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35860.807812 secs 2024-04-21T20:22:30.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35860.807812 secs 2024-04-21T20:22:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:30 smithi077 ceph-mon[27902]: pgmap v19216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:30 smithi191 ceph-mon[31636]: pgmap v19216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:30 smithi170 ceph-mon[31212]: pgmap v19216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:33.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35864.051753 secs 2024-04-21T20:22:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:33 smithi077 ceph-mon[27902]: pgmap v19217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35864.051753 secs 2024-04-21T20:22:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:33 smithi191 ceph-mon[31636]: pgmap v19217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35864.051753 secs 2024-04-21T20:22:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:33 smithi170 ceph-mon[31212]: pgmap v19217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35865.807926 secs 2024-04-21T20:22:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35865.807926 secs 2024-04-21T20:22:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35865.807926 secs 2024-04-21T20:22:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:35.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:35 smithi077 ceph-mon[27902]: pgmap v19218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:35 smithi191 ceph-mon[31636]: pgmap v19218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:36.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:35 smithi170 ceph-mon[31212]: pgmap v19218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:36.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:36 smithi077 ceph-mon[27902]: pgmap v19219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:36 smithi191 ceph-mon[31636]: pgmap v19219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:36 smithi170 ceph-mon[31212]: pgmap v19219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35869.051912 secs 2024-04-21T20:22:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35869.051912 secs 2024-04-21T20:22:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35869.051912 secs 2024-04-21T20:22:39.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:38 smithi191 ceph-mon[31636]: pgmap v19220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:38 smithi077 ceph-mon[27902]: pgmap v19220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:39.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:38 smithi170 ceph-mon[31212]: pgmap v19220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35870.808045 secs 2024-04-21T20:22:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35870.808045 secs 2024-04-21T20:22:40.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35870.808045 secs 2024-04-21T20:22:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:40 smithi077 ceph-mon[27902]: pgmap v19221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:40 smithi191 ceph-mon[31636]: pgmap v19221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:41.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:40 smithi170 ceph-mon[31212]: pgmap v19221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:43.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35874.052043 secs 2024-04-21T20:22:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:43 smithi077 ceph-mon[27902]: pgmap v19222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35874.052043 secs 2024-04-21T20:22:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:43 smithi191 ceph-mon[31636]: pgmap v19222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35874.052043 secs 2024-04-21T20:22:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:43 smithi170 ceph-mon[31212]: pgmap v19222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:44.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35875.808132 secs 2024-04-21T20:22:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35875.808132 secs 2024-04-21T20:22:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35875.808132 secs 2024-04-21T20:22:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:45.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:45 smithi077 ceph-mon[27902]: pgmap v19223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:45.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:45 smithi191 ceph-mon[31636]: pgmap v19223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:46.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:45 smithi170 ceph-mon[31212]: pgmap v19223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:47.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:47 smithi077 ceph-mon[27902]: pgmap v19224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:47.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:47 smithi191 ceph-mon[31636]: pgmap v19224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:48.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:47 smithi170 ceph-mon[31212]: pgmap v19224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:48.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35879.052168 secs 2024-04-21T20:22:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:48 smithi077 ceph-mon[27902]: pgmap v19225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:48.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35879.052168 secs 2024-04-21T20:22:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:48 smithi191 ceph-mon[31636]: pgmap v19225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35879.052168 secs 2024-04-21T20:22:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:48 smithi170 ceph-mon[31212]: pgmap v19225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:49.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35880.808194 secs 2024-04-21T20:22:49.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35880.808194 secs 2024-04-21T20:22:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35880.808194 secs 2024-04-21T20:22:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:50.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:50 smithi077 ceph-mon[27902]: pgmap v19226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:50.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:50 smithi191 ceph-mon[31636]: pgmap v19226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:50 smithi170 ceph-mon[31212]: pgmap v19226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35884.052298 secs 2024-04-21T20:22:53.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:53 smithi077 ceph-mon[27902]: pgmap v19227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35884.052298 secs 2024-04-21T20:22:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:53 smithi191 ceph-mon[31636]: pgmap v19227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35884.052298 secs 2024-04-21T20:22:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:53 smithi170 ceph-mon[31212]: pgmap v19227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:54.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35885.808309 secs 2024-04-21T20:22:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35885.808309 secs 2024-04-21T20:22:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35885.808309 secs 2024-04-21T20:22:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:22:55.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:55 smithi077 ceph-mon[27902]: pgmap v19228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:55.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:55 smithi191 ceph-mon[31636]: pgmap v19228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:56.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:55 smithi170 ceph-mon[31212]: pgmap v19228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:56.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:56 smithi077 ceph-mon[27902]: pgmap v19229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:56.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:56 smithi191 ceph-mon[31636]: pgmap v19229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:57.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:56 smithi170 ceph-mon[31212]: pgmap v19229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:22:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35889.052420 secs 2024-04-21T20:22:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35889.052420 secs 2024-04-21T20:22:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35889.052420 secs 2024-04-21T20:22:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:58 smithi077 ceph-mon[27902]: pgmap v19230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:58 smithi191 ceph-mon[31636]: pgmap v19230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:58 smithi170 ceph-mon[31212]: pgmap v19230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:22:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.314+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:22:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.314+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:22:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.314+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:22:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.314+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:22:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.314+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:22:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.315+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:22:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.315+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:22:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:22:59.315+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:23:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35890.808426 secs 2024-04-21T20:23:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35890.808426 secs 2024-04-21T20:23:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35890.808426 secs 2024-04-21T20:23:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:00 smithi077 ceph-mon[27902]: pgmap v19231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:00 smithi191 ceph-mon[31636]: pgmap v19231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:00 smithi170 ceph-mon[31212]: pgmap v19231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:03.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35894.052558 secs 2024-04-21T20:23:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:03 smithi077 ceph-mon[27902]: pgmap v19232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35894.052558 secs 2024-04-21T20:23:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:03 smithi191 ceph-mon[31636]: pgmap v19232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35894.052558 secs 2024-04-21T20:23:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:03 smithi170 ceph-mon[31212]: pgmap v19232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:04.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35895.808543 secs 2024-04-21T20:23:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35895.808543 secs 2024-04-21T20:23:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35895.808543 secs 2024-04-21T20:23:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:05 smithi077 ceph-mon[27902]: pgmap v19233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:05 smithi077 ceph-mon[27902]: osdmap e1274: 12 total, 12 up, 12 in 2024-04-21T20:23:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:05 smithi191 ceph-mon[31636]: pgmap v19233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:05 smithi191 ceph-mon[31636]: osdmap e1274: 12 total, 12 up, 12 in 2024-04-21T20:23:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:05 smithi170 ceph-mon[31212]: pgmap v19233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:05 smithi170 ceph-mon[31212]: osdmap e1274: 12 total, 12 up, 12 in 2024-04-21T20:23:06.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:06 smithi077 ceph-mon[27902]: pgmap v19235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:23:06.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:06 smithi191 ceph-mon[31636]: pgmap v19235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:23:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:06 smithi170 ceph-mon[31212]: pgmap v19235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:23:08.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35899.052682 secs 2024-04-21T20:23:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35899.052682 secs 2024-04-21T20:23:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35899.052682 secs 2024-04-21T20:23:09.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:08 smithi191 ceph-mon[31636]: pgmap v19236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:23:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:08 smithi077 ceph-mon[27902]: pgmap v19236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:23:09.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:08 smithi170 ceph-mon[31212]: pgmap v19236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:23:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:10.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35900.808667 secs 2024-04-21T20:23:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:10 smithi077 ceph-mon[27902]: osdmap e1275: 12 total, 12 up, 12 in 2024-04-21T20:23:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35900.808667 secs 2024-04-21T20:23:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:10 smithi191 ceph-mon[31636]: osdmap e1275: 12 total, 12 up, 12 in 2024-04-21T20:23:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35900.808667 secs 2024-04-21T20:23:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:10 smithi170 ceph-mon[31212]: osdmap e1275: 12 total, 12 up, 12 in 2024-04-21T20:23:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:11 smithi077 ceph-mon[27902]: pgmap v19238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:23:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:11 smithi191 ceph-mon[31636]: pgmap v19238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:23:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:11 smithi170 ceph-mon[31212]: pgmap v19238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:23:13.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35904.052806 secs 2024-04-21T20:23:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:13 smithi077 ceph-mon[27902]: pgmap v19239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:23:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35904.052806 secs 2024-04-21T20:23:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:13 smithi191 ceph-mon[31636]: pgmap v19239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:23:14.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35904.052806 secs 2024-04-21T20:23:14.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:13 smithi170 ceph-mon[31212]: pgmap v19239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:23:14.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35905.808792 secs 2024-04-21T20:23:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35905.808792 secs 2024-04-21T20:23:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35905.808792 secs 2024-04-21T20:23:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:15.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:15 smithi077 ceph-mon[27902]: pgmap v19240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:23:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:15 smithi191 ceph-mon[31636]: pgmap v19240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:23:16.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:15 smithi170 ceph-mon[31212]: pgmap v19240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:23:16.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:16 smithi077 ceph-mon[27902]: pgmap v19241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:23:16.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:16 smithi191 ceph-mon[31636]: pgmap v19241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:23:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:16 smithi170 ceph-mon[31212]: pgmap v19241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:23:18.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35909.052933 secs 2024-04-21T20:23:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35909.052933 secs 2024-04-21T20:23:18.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35909.052933 secs 2024-04-21T20:23:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:18 smithi077 ceph-mon[27902]: pgmap v19242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:23:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:18 smithi191 ceph-mon[31636]: pgmap v19242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:23:19.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:18 smithi170 ceph-mon[31212]: pgmap v19242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:23:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35910.808906 secs 2024-04-21T20:23:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35910.808906 secs 2024-04-21T20:23:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35910.808906 secs 2024-04-21T20:23:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:20 smithi077 ceph-mon[27902]: pgmap v19243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:23:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:20 smithi191 ceph-mon[31636]: pgmap v19243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:23:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:20 smithi170 ceph-mon[31212]: pgmap v19243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:23:23.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35914.053016 secs 2024-04-21T20:23:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:23 smithi077 ceph-mon[27902]: pgmap v19244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35914.053016 secs 2024-04-21T20:23:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:23 smithi191 ceph-mon[31636]: pgmap v19244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35914.053016 secs 2024-04-21T20:23:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:23 smithi170 ceph-mon[31212]: pgmap v19244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:25.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35915.809016 secs 2024-04-21T20:23:25.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:25 smithi077 ceph-mon[27902]: pgmap v19245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35915.809016 secs 2024-04-21T20:23:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:25 smithi191 ceph-mon[31636]: pgmap v19245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35915.809016 secs 2024-04-21T20:23:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:25 smithi170 ceph-mon[31212]: pgmap v19245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:27.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:27 smithi077 ceph-mon[27902]: pgmap v19246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:27.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:23:27.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:27 smithi191 ceph-mon[31636]: pgmap v19246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:27.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:23:28.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:27 smithi170 ceph-mon[31212]: pgmap v19246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:28.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:23:28.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35919.053102 secs 2024-04-21T20:23:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:23:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:23:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:23:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35919.053102 secs 2024-04-21T20:23:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:23:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:23:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:23:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35919.053102 secs 2024-04-21T20:23:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:23:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:23:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:23:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:29 smithi077 ceph-mon[27902]: pgmap v19247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:29.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35920.809124 secs 2024-04-21T20:23:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:29 smithi191 ceph-mon[31636]: pgmap v19247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:29.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35920.809124 secs 2024-04-21T20:23:30.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:29 smithi170 ceph-mon[31212]: pgmap v19247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:30.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35920.809124 secs 2024-04-21T20:23:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:30.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:30 smithi077 ceph-mon[27902]: pgmap v19248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:30 smithi191 ceph-mon[31636]: pgmap v19248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:30 smithi170 ceph-mon[31212]: pgmap v19248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:32.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:32 smithi191 ceph-mon[31636]: pgmap v19249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:33.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:32 smithi170 ceph-mon[31212]: pgmap v19249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:32 smithi077 ceph-mon[27902]: pgmap v19249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35924.053205 secs 2024-04-21T20:23:34.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35924.053205 secs 2024-04-21T20:23:34.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35924.053205 secs 2024-04-21T20:23:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35925.809228 secs 2024-04-21T20:23:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:34 smithi191 ceph-mon[31636]: pgmap v19250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35925.809228 secs 2024-04-21T20:23:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:34 smithi170 ceph-mon[31212]: pgmap v19250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35925.809228 secs 2024-04-21T20:23:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:34 smithi077 ceph-mon[27902]: pgmap v19250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:36 smithi191 ceph-mon[31636]: pgmap v19251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:36 smithi170 ceph-mon[31212]: pgmap v19251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:36 smithi077 ceph-mon[27902]: pgmap v19251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35929.053329 secs 2024-04-21T20:23:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35929.053329 secs 2024-04-21T20:23:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35929.053329 secs 2024-04-21T20:23:39.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:38 smithi191 ceph-mon[31636]: pgmap v19252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:38 smithi077 ceph-mon[27902]: pgmap v19252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:39.211 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:38 smithi170 ceph-mon[31212]: pgmap v19252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35930.809292 secs 2024-04-21T20:23:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35930.809292 secs 2024-04-21T20:23:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35930.809292 secs 2024-04-21T20:23:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:40 smithi077 ceph-mon[27902]: pgmap v19253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:40 smithi191 ceph-mon[31636]: pgmap v19253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:40 smithi170 ceph-mon[31212]: pgmap v19253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:42.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:42 smithi191 ceph-mon[31636]: pgmap v19254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:42 smithi170 ceph-mon[31212]: pgmap v19254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:42 smithi077 ceph-mon[27902]: pgmap v19254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35934.053466 secs 2024-04-21T20:23:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35934.053466 secs 2024-04-21T20:23:44.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35934.053466 secs 2024-04-21T20:23:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35935.809409 secs 2024-04-21T20:23:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:44 smithi191 ceph-mon[31636]: pgmap v19255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35935.809409 secs 2024-04-21T20:23:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:44 smithi170 ceph-mon[31212]: pgmap v19255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35935.809409 secs 2024-04-21T20:23:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:44 smithi077 ceph-mon[27902]: pgmap v19255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:46.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:46 smithi191 ceph-mon[31636]: pgmap v19256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:46 smithi170 ceph-mon[31212]: pgmap v19256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:46 smithi077 ceph-mon[27902]: pgmap v19256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35939.053606 secs 2024-04-21T20:23:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35939.053606 secs 2024-04-21T20:23:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35939.053606 secs 2024-04-21T20:23:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:48 smithi077 ceph-mon[27902]: pgmap v19257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:48 smithi191 ceph-mon[31636]: pgmap v19257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:48 smithi170 ceph-mon[31212]: pgmap v19257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35940.809538 secs 2024-04-21T20:23:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35940.809538 secs 2024-04-21T20:23:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35940.809538 secs 2024-04-21T20:23:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:50 smithi077 ceph-mon[27902]: pgmap v19258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:50 smithi191 ceph-mon[31636]: pgmap v19258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:50 smithi170 ceph-mon[31212]: pgmap v19258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:52.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:52 smithi191 ceph-mon[31636]: pgmap v19259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:52 smithi170 ceph-mon[31212]: pgmap v19259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:52 smithi077 ceph-mon[27902]: pgmap v19259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35944.053743 secs 2024-04-21T20:23:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35944.053743 secs 2024-04-21T20:23:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35944.053743 secs 2024-04-21T20:23:54.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35945.809652 secs 2024-04-21T20:23:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:54 smithi191 ceph-mon[31636]: pgmap v19260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35945.809652 secs 2024-04-21T20:23:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:54 smithi170 ceph-mon[31212]: pgmap v19260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:23:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35945.809652 secs 2024-04-21T20:23:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:54 smithi077 ceph-mon[27902]: pgmap v19260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:56.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:56 smithi191 ceph-mon[31636]: pgmap v19261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:57.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:56 smithi170 ceph-mon[31212]: pgmap v19261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:56 smithi077 ceph-mon[27902]: pgmap v19261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:23:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35949.053855 secs 2024-04-21T20:23:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35949.053855 secs 2024-04-21T20:23:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35949.053855 secs 2024-04-21T20:23:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:58 smithi077 ceph-mon[27902]: pgmap v19262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:58 smithi191 ceph-mon[31636]: pgmap v19262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:23:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:58 smithi170 ceph-mon[31212]: pgmap v19262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35950.809763 secs 2024-04-21T20:24:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35950.809763 secs 2024-04-21T20:24:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35950.809763 secs 2024-04-21T20:24:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:00 smithi077 ceph-mon[27902]: pgmap v19263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:00 smithi191 ceph-mon[31636]: pgmap v19263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:00 smithi170 ceph-mon[31212]: pgmap v19263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:02.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:02 smithi191 ceph-mon[31636]: pgmap v19264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:02 smithi170 ceph-mon[31212]: pgmap v19264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:02 smithi077 ceph-mon[27902]: pgmap v19264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35954.053982 secs 2024-04-21T20:24:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35954.053982 secs 2024-04-21T20:24:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35954.053982 secs 2024-04-21T20:24:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35955.809884 secs 2024-04-21T20:24:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:04 smithi191 ceph-mon[31636]: pgmap v19265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35955.809884 secs 2024-04-21T20:24:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:04 smithi170 ceph-mon[31212]: pgmap v19265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35955.809884 secs 2024-04-21T20:24:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:04 smithi077 ceph-mon[27902]: pgmap v19265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:05 smithi191 ceph-mon[31636]: osdmap e1276: 12 total, 12 up, 12 in 2024-04-21T20:24:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:05 smithi170 ceph-mon[31212]: osdmap e1276: 12 total, 12 up, 12 in 2024-04-21T20:24:06.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:05 smithi077 ceph-mon[27902]: osdmap e1276: 12 total, 12 up, 12 in 2024-04-21T20:24:06.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:06 smithi191 ceph-mon[31636]: pgmap v19267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:24:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:06 smithi170 ceph-mon[31212]: pgmap v19267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:24:07.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:06 smithi077 ceph-mon[27902]: pgmap v19267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:24:08.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35959.054088 secs 2024-04-21T20:24:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35959.054088 secs 2024-04-21T20:24:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35959.054088 secs 2024-04-21T20:24:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:08 smithi077 ceph-mon[27902]: pgmap v19268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:24:09.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:08 smithi170 ceph-mon[31212]: pgmap v19268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:24:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:08 smithi191 ceph-mon[31636]: pgmap v19268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:24:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:10.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35960.810005 secs 2024-04-21T20:24:10.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:10 smithi077 ceph-mon[27902]: osdmap e1277: 12 total, 12 up, 12 in 2024-04-21T20:24:10.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35960.810005 secs 2024-04-21T20:24:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:10 smithi191 ceph-mon[31636]: osdmap e1277: 12 total, 12 up, 12 in 2024-04-21T20:24:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35960.810005 secs 2024-04-21T20:24:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:10 smithi170 ceph-mon[31212]: osdmap e1277: 12 total, 12 up, 12 in 2024-04-21T20:24:11.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:11 smithi077 ceph-mon[27902]: pgmap v19270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:24:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:11 smithi191 ceph-mon[31636]: pgmap v19270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:24:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:11 smithi170 ceph-mon[31212]: pgmap v19270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:24:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:12 smithi191 ceph-mon[31636]: pgmap v19271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:24:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:12 smithi170 ceph-mon[31212]: pgmap v19271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:24:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:12 smithi077 ceph-mon[27902]: pgmap v19271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:24:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35964.054233 secs 2024-04-21T20:24:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35964.054233 secs 2024-04-21T20:24:14.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35964.054233 secs 2024-04-21T20:24:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35965.810121 secs 2024-04-21T20:24:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:14 smithi191 ceph-mon[31636]: pgmap v19272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:24:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35965.810121 secs 2024-04-21T20:24:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:14 smithi170 ceph-mon[31212]: pgmap v19272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:24:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35965.810121 secs 2024-04-21T20:24:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:14 smithi077 ceph-mon[27902]: pgmap v19272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:24:16.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:16 smithi191 ceph-mon[31636]: pgmap v19273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:24:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:16 smithi170 ceph-mon[31212]: pgmap v19273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:24:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:16 smithi077 ceph-mon[27902]: pgmap v19273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:24:18.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35969.054343 secs 2024-04-21T20:24:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35969.054343 secs 2024-04-21T20:24:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35969.054343 secs 2024-04-21T20:24:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:18 smithi077 ceph-mon[27902]: pgmap v19274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:24:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:18 smithi191 ceph-mon[31636]: pgmap v19274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:24:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:18 smithi170 ceph-mon[31212]: pgmap v19274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:24:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:20.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35970.810240 secs 2024-04-21T20:24:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35970.810240 secs 2024-04-21T20:24:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35970.810240 secs 2024-04-21T20:24:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:20 smithi077 ceph-mon[27902]: pgmap v19275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:24:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:20 smithi191 ceph-mon[31636]: pgmap v19275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:24:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:20 smithi170 ceph-mon[31212]: pgmap v19275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:24:22.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:22 smithi191 ceph-mon[31636]: pgmap v19276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:22 smithi170 ceph-mon[31212]: pgmap v19276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:22 smithi077 ceph-mon[27902]: pgmap v19276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35974.054459 secs 2024-04-21T20:24:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35974.054459 secs 2024-04-21T20:24:24.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35974.054459 secs 2024-04-21T20:24:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35975.810355 secs 2024-04-21T20:24:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:24 smithi191 ceph-mon[31636]: pgmap v19277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35975.810355 secs 2024-04-21T20:24:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:24 smithi170 ceph-mon[31212]: pgmap v19277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35975.810355 secs 2024-04-21T20:24:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:24 smithi077 ceph-mon[27902]: pgmap v19277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:26 smithi191 ceph-mon[31636]: pgmap v19278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:26 smithi170 ceph-mon[31212]: pgmap v19278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:26 smithi077 ceph-mon[27902]: pgmap v19278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:28.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35979.054575 secs 2024-04-21T20:24:28.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:24:28.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35979.054575 secs 2024-04-21T20:24:28.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:24:28.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35979.054575 secs 2024-04-21T20:24:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:24:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:28 smithi191 ceph-mon[31636]: pgmap v19279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:28 smithi170 ceph-mon[31212]: pgmap v19279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:28 smithi077 ceph-mon[27902]: pgmap v19279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35980.810460 secs 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:24:30.724 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:24:30.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35980.810460 secs 2024-04-21T20:24:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:24:30.813 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35980.810460 secs 2024-04-21T20:24:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:24:30.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:24:30.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:24:30.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:24:31.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:24:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:24:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:24:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:24:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:24:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:24:31.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:31 smithi191 ceph-mon[31636]: pgmap v19280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:24:31.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:31 smithi170 ceph-mon[31212]: pgmap v19280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:24:31.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:31 smithi077 ceph-mon[27902]: pgmap v19280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:32 smithi191 ceph-mon[31636]: pgmap v19281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:33.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:32 smithi170 ceph-mon[31212]: pgmap v19281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:32 smithi077 ceph-mon[27902]: pgmap v19281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35984.054679 secs 2024-04-21T20:24:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35984.054679 secs 2024-04-21T20:24:34.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35984.054679 secs 2024-04-21T20:24:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35985.810564 secs 2024-04-21T20:24:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:34 smithi191 ceph-mon[31636]: pgmap v19282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35985.810564 secs 2024-04-21T20:24:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:34 smithi170 ceph-mon[31212]: pgmap v19282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35985.810564 secs 2024-04-21T20:24:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:34 smithi077 ceph-mon[27902]: pgmap v19282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:36 smithi191 ceph-mon[31636]: pgmap v19283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:36 smithi170 ceph-mon[31212]: pgmap v19283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:36 smithi077 ceph-mon[27902]: pgmap v19283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35989.054798 secs 2024-04-21T20:24:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35989.054798 secs 2024-04-21T20:24:38.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35989.054798 secs 2024-04-21T20:24:39.134 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:38 smithi191 ceph-mon[31636]: pgmap v19284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:38 smithi077 ceph-mon[27902]: pgmap v19284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:39.211 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:38 smithi170 ceph-mon[31212]: pgmap v19284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35990.810666 secs 2024-04-21T20:24:40.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35990.810666 secs 2024-04-21T20:24:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35990.810666 secs 2024-04-21T20:24:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:40 smithi077 ceph-mon[27902]: pgmap v19285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:40 smithi191 ceph-mon[31636]: pgmap v19285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:40 smithi170 ceph-mon[31212]: pgmap v19285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:42 smithi191 ceph-mon[31636]: pgmap v19286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:42 smithi170 ceph-mon[31212]: pgmap v19286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:42 smithi077 ceph-mon[27902]: pgmap v19286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35994.054912 secs 2024-04-21T20:24:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35994.054912 secs 2024-04-21T20:24:44.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35994.054912 secs 2024-04-21T20:24:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 35995.810805 secs 2024-04-21T20:24:44.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:44 smithi191 ceph-mon[31636]: pgmap v19287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 35995.810805 secs 2024-04-21T20:24:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:44 smithi170 ceph-mon[31212]: pgmap v19287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 35995.810805 secs 2024-04-21T20:24:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:44 smithi077 ceph-mon[27902]: pgmap v19287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:24:46.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:46 smithi191 ceph-mon[31636]: pgmap v19288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:46 smithi170 ceph-mon[31212]: pgmap v19288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:46 smithi077 ceph-mon[27902]: pgmap v19288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 35999.054991 secs 2024-04-21T20:24:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 35999.054991 secs 2024-04-21T20:24:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 35999.054991 secs 2024-04-21T20:24:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:48 smithi077 ceph-mon[27902]: pgmap v19289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:48 smithi191 ceph-mon[31636]: pgmap v19289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:48 smithi170 ceph-mon[31212]: pgmap v19289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36000.810951 secs 2024-04-21T20:24:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36000.810951 secs 2024-04-21T20:24:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36000.810951 secs 2024-04-21T20:24:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:50 smithi191 ceph-mon[31636]: pgmap v19290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:50 smithi170 ceph-mon[31212]: pgmap v19290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:51.396 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:50 smithi077 ceph-mon[27902]: pgmap v19290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:52 smithi191 ceph-mon[31636]: pgmap v19291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:52 smithi170 ceph-mon[31212]: pgmap v19291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:52 smithi077 ceph-mon[27902]: pgmap v19291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:53.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36004.055110 secs 2024-04-21T20:24:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36004.055110 secs 2024-04-21T20:24:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36004.055110 secs 2024-04-21T20:24:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:24:55.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36005.811067 secs 2024-04-21T20:24:55.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:55 smithi191 ceph-mon[31636]: pgmap v19292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:55.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36005.811067 secs 2024-04-21T20:24:55.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:55 smithi170 ceph-mon[31212]: pgmap v19292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:55.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36005.811067 secs 2024-04-21T20:24:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:55 smithi077 ceph-mon[27902]: pgmap v19292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:56 smithi191 ceph-mon[31636]: pgmap v19293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:56 smithi170 ceph-mon[31212]: pgmap v19293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:56 smithi077 ceph-mon[27902]: pgmap v19293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:24:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36009.055194 secs 2024-04-21T20:24:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36009.055194 secs 2024-04-21T20:24:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36009.055194 secs 2024-04-21T20:24:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:58 smithi077 ceph-mon[27902]: pgmap v19294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:58 smithi191 ceph-mon[31636]: pgmap v19294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:24:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:58 smithi170 ceph-mon[31212]: pgmap v19294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:00.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36010.811231 secs 2024-04-21T20:25:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36010.811231 secs 2024-04-21T20:25:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36010.811231 secs 2024-04-21T20:25:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:00 smithi191 ceph-mon[31636]: pgmap v19295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:00 smithi170 ceph-mon[31212]: pgmap v19295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:00 smithi077 ceph-mon[27902]: pgmap v19295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:02 smithi191 ceph-mon[31636]: pgmap v19296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:02 smithi170 ceph-mon[31212]: pgmap v19296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:02 smithi077 ceph-mon[27902]: pgmap v19296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36014.055343 secs 2024-04-21T20:25:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36014.055343 secs 2024-04-21T20:25:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36014.055343 secs 2024-04-21T20:25:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36015.811337 secs 2024-04-21T20:25:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:04 smithi191 ceph-mon[31636]: pgmap v19297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36015.811337 secs 2024-04-21T20:25:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:04 smithi170 ceph-mon[31212]: pgmap v19297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36015.811337 secs 2024-04-21T20:25:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:04 smithi077 ceph-mon[27902]: pgmap v19297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:05.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:05 smithi191 ceph-mon[31636]: osdmap e1278: 12 total, 12 up, 12 in 2024-04-21T20:25:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:05 smithi170 ceph-mon[31212]: osdmap e1278: 12 total, 12 up, 12 in 2024-04-21T20:25:06.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:05 smithi077 ceph-mon[27902]: osdmap e1278: 12 total, 12 up, 12 in 2024-04-21T20:25:06.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:06 smithi191 ceph-mon[31636]: pgmap v19299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:25:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:06 smithi170 ceph-mon[31212]: pgmap v19299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:25:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:06 smithi077 ceph-mon[27902]: pgmap v19299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:25:08.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36019.055478 secs 2024-04-21T20:25:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36019.055478 secs 2024-04-21T20:25:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36019.055478 secs 2024-04-21T20:25:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:08 smithi077 ceph-mon[27902]: pgmap v19300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:25:09.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:08 smithi170 ceph-mon[31212]: pgmap v19300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:25:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:08 smithi191 ceph-mon[31636]: pgmap v19300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:25:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36020.811457 secs 2024-04-21T20:25:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:10 smithi191 ceph-mon[31636]: osdmap e1279: 12 total, 12 up, 12 in 2024-04-21T20:25:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36020.811457 secs 2024-04-21T20:25:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:10 smithi170 ceph-mon[31212]: osdmap e1279: 12 total, 12 up, 12 in 2024-04-21T20:25:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36020.811457 secs 2024-04-21T20:25:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:10 smithi077 ceph-mon[27902]: osdmap e1279: 12 total, 12 up, 12 in 2024-04-21T20:25:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:11 smithi191 ceph-mon[31636]: pgmap v19302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:25:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:11 smithi170 ceph-mon[31212]: pgmap v19302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:25:11.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:11 smithi077 ceph-mon[27902]: pgmap v19302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:25:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:12 smithi191 ceph-mon[31636]: pgmap v19303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:25:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:12 smithi170 ceph-mon[31212]: pgmap v19303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:25:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:12 smithi077 ceph-mon[27902]: pgmap v19303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:25:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36024.055563 secs 2024-04-21T20:25:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36024.055563 secs 2024-04-21T20:25:14.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36024.055563 secs 2024-04-21T20:25:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36025.811590 secs 2024-04-21T20:25:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:14 smithi191 ceph-mon[31636]: pgmap v19304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:25:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36025.811590 secs 2024-04-21T20:25:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:14 smithi170 ceph-mon[31212]: pgmap v19304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:25:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36025.811590 secs 2024-04-21T20:25:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:14 smithi077 ceph-mon[27902]: pgmap v19304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:25:16.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:16 smithi191 ceph-mon[31636]: pgmap v19305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:25:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:16 smithi170 ceph-mon[31212]: pgmap v19305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:25:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:16 smithi077 ceph-mon[27902]: pgmap v19305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:25:18.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36029.055687 secs 2024-04-21T20:25:18.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36029.055687 secs 2024-04-21T20:25:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36029.055687 secs 2024-04-21T20:25:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:18 smithi077 ceph-mon[27902]: pgmap v19306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:25:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:18 smithi191 ceph-mon[31636]: pgmap v19306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:25:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:18 smithi170 ceph-mon[31212]: pgmap v19306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:25:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36030.811710 secs 2024-04-21T20:25:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36030.811710 secs 2024-04-21T20:25:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36030.811710 secs 2024-04-21T20:25:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:20 smithi191 ceph-mon[31636]: pgmap v19307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:25:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:20 smithi170 ceph-mon[31212]: pgmap v19307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:25:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:20 smithi077 ceph-mon[27902]: pgmap v19307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:25:22.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:22 smithi191 ceph-mon[31636]: pgmap v19308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:22 smithi170 ceph-mon[31212]: pgmap v19308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:22 smithi077 ceph-mon[27902]: pgmap v19308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36034.055782 secs 2024-04-21T20:25:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36034.055782 secs 2024-04-21T20:25:24.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36034.055782 secs 2024-04-21T20:25:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36035.811826 secs 2024-04-21T20:25:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:24 smithi191 ceph-mon[31636]: pgmap v19309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36035.811826 secs 2024-04-21T20:25:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:24 smithi170 ceph-mon[31212]: pgmap v19309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36035.811826 secs 2024-04-21T20:25:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:24 smithi077 ceph-mon[27902]: pgmap v19309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:26 smithi191 ceph-mon[31636]: pgmap v19310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:26 smithi170 ceph-mon[31212]: pgmap v19310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:26 smithi077 ceph-mon[27902]: pgmap v19310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:28.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36039.055886 secs 2024-04-21T20:25:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36039.055886 secs 2024-04-21T20:25:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36039.055886 secs 2024-04-21T20:25:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:28 smithi077 ceph-mon[27902]: pgmap v19311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:28 smithi191 ceph-mon[31636]: pgmap v19311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:28 smithi170 ceph-mon[31212]: pgmap v19311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:30.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36040.811944 secs 2024-04-21T20:25:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36040.811944 secs 2024-04-21T20:25:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36040.811944 secs 2024-04-21T20:25:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:25:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:30 smithi191 ceph-mon[31636]: pgmap v19312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:25:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:30 smithi170 ceph-mon[31212]: pgmap v19312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:25:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:30 smithi077 ceph-mon[27902]: pgmap v19312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:32.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:25:32.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:25:32.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:32.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:25:32.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:25:32.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:32.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:25:32.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:25:32.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:25:33.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36044.055964 secs 2024-04-21T20:25:33.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:32 smithi191 ceph-mon[31636]: pgmap v19313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36044.055964 secs 2024-04-21T20:25:33.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:32 smithi170 ceph-mon[31212]: pgmap v19313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:33.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36044.055964 secs 2024-04-21T20:25:33.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:32 smithi077 ceph-mon[27902]: pgmap v19313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36045.812060 secs 2024-04-21T20:25:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:34 smithi077 ceph-mon[27902]: pgmap v19314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36045.812060 secs 2024-04-21T20:25:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:34 smithi191 ceph-mon[31636]: pgmap v19314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36045.812060 secs 2024-04-21T20:25:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:34 smithi170 ceph-mon[31212]: pgmap v19314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:36 smithi191 ceph-mon[31636]: pgmap v19315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:36 smithi170 ceph-mon[31212]: pgmap v19315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:36 smithi077 ceph-mon[27902]: pgmap v19315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:38.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36049.056064 secs 2024-04-21T20:25:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36049.056064 secs 2024-04-21T20:25:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36049.056064 secs 2024-04-21T20:25:39.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:38 smithi170 ceph-mon[31212]: pgmap v19316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:38 smithi191 ceph-mon[31636]: pgmap v19316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:38 smithi077 ceph-mon[27902]: pgmap v19316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36050.812197 secs 2024-04-21T20:25:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36050.812197 secs 2024-04-21T20:25:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36050.812197 secs 2024-04-21T20:25:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:40 smithi191 ceph-mon[31636]: pgmap v19317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:40 smithi170 ceph-mon[31212]: pgmap v19317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:40 smithi077 ceph-mon[27902]: pgmap v19317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:42.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:42 smithi191 ceph-mon[31636]: pgmap v19318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:42 smithi170 ceph-mon[31212]: pgmap v19318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:42 smithi077 ceph-mon[27902]: pgmap v19318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:43.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36054.056123 secs 2024-04-21T20:25:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36054.056123 secs 2024-04-21T20:25:44.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36054.056123 secs 2024-04-21T20:25:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36055.812311 secs 2024-04-21T20:25:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:44 smithi191 ceph-mon[31636]: pgmap v19319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36055.812311 secs 2024-04-21T20:25:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:44 smithi170 ceph-mon[31212]: pgmap v19319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36055.812311 secs 2024-04-21T20:25:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:44 smithi077 ceph-mon[27902]: pgmap v19319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:46.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:46 smithi191 ceph-mon[31636]: pgmap v19320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:46 smithi170 ceph-mon[31212]: pgmap v19320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:46 smithi077 ceph-mon[27902]: pgmap v19320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:48.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36059.056264 secs 2024-04-21T20:25:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36059.056264 secs 2024-04-21T20:25:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36059.056264 secs 2024-04-21T20:25:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:48 smithi191 ceph-mon[31636]: pgmap v19321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:48 smithi170 ceph-mon[31212]: pgmap v19321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:48 smithi077 ceph-mon[27902]: pgmap v19321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36060.812436 secs 2024-04-21T20:25:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36060.812436 secs 2024-04-21T20:25:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36060.812436 secs 2024-04-21T20:25:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:50 smithi191 ceph-mon[31636]: pgmap v19322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:50 smithi170 ceph-mon[31212]: pgmap v19322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:50 smithi077 ceph-mon[27902]: pgmap v19322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:52.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:52 smithi191 ceph-mon[31636]: pgmap v19323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:52 smithi170 ceph-mon[31212]: pgmap v19323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:52 smithi077 ceph-mon[27902]: pgmap v19323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36064.056377 secs 2024-04-21T20:25:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36064.056377 secs 2024-04-21T20:25:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36064.056377 secs 2024-04-21T20:25:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36065.812544 secs 2024-04-21T20:25:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:54 smithi191 ceph-mon[31636]: pgmap v19324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36065.812544 secs 2024-04-21T20:25:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:54 smithi170 ceph-mon[31212]: pgmap v19324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:25:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36065.812544 secs 2024-04-21T20:25:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:54 smithi077 ceph-mon[27902]: pgmap v19324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:25:56.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:56 smithi191 ceph-mon[31636]: pgmap v19325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:56 smithi170 ceph-mon[31212]: pgmap v19325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:56 smithi077 ceph-mon[27902]: pgmap v19325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:25:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36069.056501 secs 2024-04-21T20:25:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36069.056501 secs 2024-04-21T20:25:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36069.056501 secs 2024-04-21T20:25:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:58 smithi191 ceph-mon[31636]: pgmap v19326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:58 smithi170 ceph-mon[31212]: pgmap v19326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:25:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:25:59.340+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:25:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:25:59.340+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:25:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:25:59.340+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:25:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:25:59.340+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:25:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:58 smithi077 ceph-mon[27902]: pgmap v19326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36070.812666 secs 2024-04-21T20:26:00.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36070.812666 secs 2024-04-21T20:26:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36070.812666 secs 2024-04-21T20:26:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:00 smithi191 ceph-mon[31636]: pgmap v19327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:00 smithi170 ceph-mon[31212]: pgmap v19327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:00 smithi077 ceph-mon[27902]: pgmap v19327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:02.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:02 smithi191 ceph-mon[31636]: pgmap v19328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:02 smithi170 ceph-mon[31212]: pgmap v19328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:02 smithi077 ceph-mon[27902]: pgmap v19328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36074.056626 secs 2024-04-21T20:26:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36074.056626 secs 2024-04-21T20:26:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36074.056626 secs 2024-04-21T20:26:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36075.812780 secs 2024-04-21T20:26:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:04 smithi191 ceph-mon[31636]: pgmap v19329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36075.812780 secs 2024-04-21T20:26:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:04 smithi170 ceph-mon[31212]: pgmap v19329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36075.812780 secs 2024-04-21T20:26:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:04 smithi077 ceph-mon[27902]: pgmap v19329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:05 smithi191 ceph-mon[31636]: osdmap e1280: 12 total, 12 up, 12 in 2024-04-21T20:26:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:05 smithi170 ceph-mon[31212]: osdmap e1280: 12 total, 12 up, 12 in 2024-04-21T20:26:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:05 smithi077 ceph-mon[27902]: osdmap e1280: 12 total, 12 up, 12 in 2024-04-21T20:26:06.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:06 smithi191 ceph-mon[31636]: pgmap v19331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:26:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:06 smithi170 ceph-mon[31212]: pgmap v19331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:26:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:06 smithi077 ceph-mon[27902]: pgmap v19331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:26:08.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36079.056732 secs 2024-04-21T20:26:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36079.056732 secs 2024-04-21T20:26:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36079.056732 secs 2024-04-21T20:26:09.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:08 smithi170 ceph-mon[31212]: pgmap v19332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:26:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:08 smithi191 ceph-mon[31636]: pgmap v19332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:26:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:08 smithi077 ceph-mon[27902]: pgmap v19332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:26:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36080.812911 secs 2024-04-21T20:26:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:10 smithi191 ceph-mon[31636]: osdmap e1281: 12 total, 12 up, 12 in 2024-04-21T20:26:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36080.812911 secs 2024-04-21T20:26:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:10 smithi170 ceph-mon[31212]: osdmap e1281: 12 total, 12 up, 12 in 2024-04-21T20:26:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36080.812911 secs 2024-04-21T20:26:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:10 smithi077 ceph-mon[27902]: osdmap e1281: 12 total, 12 up, 12 in 2024-04-21T20:26:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:11 smithi191 ceph-mon[31636]: pgmap v19334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:26:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:11 smithi170 ceph-mon[31212]: pgmap v19334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:26:11.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:11 smithi077 ceph-mon[27902]: pgmap v19334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:26:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:12 smithi191 ceph-mon[31636]: pgmap v19335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:26:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:12 smithi170 ceph-mon[31212]: pgmap v19335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:26:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:12 smithi077 ceph-mon[27902]: pgmap v19335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:26:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36084.056833 secs 2024-04-21T20:26:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36084.056833 secs 2024-04-21T20:26:14.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36084.056833 secs 2024-04-21T20:26:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36085.813030 secs 2024-04-21T20:26:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:14 smithi191 ceph-mon[31636]: pgmap v19336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:26:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36085.813030 secs 2024-04-21T20:26:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:14 smithi170 ceph-mon[31212]: pgmap v19336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:26:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36085.813030 secs 2024-04-21T20:26:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:14 smithi077 ceph-mon[27902]: pgmap v19336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:26:16.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:16 smithi191 ceph-mon[31636]: pgmap v19337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:26:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:16 smithi170 ceph-mon[31212]: pgmap v19337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:26:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:16 smithi077 ceph-mon[27902]: pgmap v19337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:26:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36089.056936 secs 2024-04-21T20:26:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36089.056936 secs 2024-04-21T20:26:18.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36089.056936 secs 2024-04-21T20:26:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:18 smithi191 ceph-mon[31636]: pgmap v19338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:26:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:18 smithi170 ceph-mon[31212]: pgmap v19338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:26:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:18 smithi077 ceph-mon[27902]: pgmap v19338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:26:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36090.813154 secs 2024-04-21T20:26:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36090.813154 secs 2024-04-21T20:26:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36090.813154 secs 2024-04-21T20:26:21.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:20 smithi191 ceph-mon[31636]: pgmap v19339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:26:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:20 smithi170 ceph-mon[31212]: pgmap v19339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:26:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:20 smithi077 ceph-mon[27902]: pgmap v19339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:26:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:22 smithi191 ceph-mon[31636]: pgmap v19340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:22 smithi170 ceph-mon[31212]: pgmap v19340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:22 smithi077 ceph-mon[27902]: pgmap v19340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36094.057022 secs 2024-04-21T20:26:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36094.057022 secs 2024-04-21T20:26:24.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36094.057022 secs 2024-04-21T20:26:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36095.813277 secs 2024-04-21T20:26:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:24 smithi191 ceph-mon[31636]: pgmap v19341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36095.813277 secs 2024-04-21T20:26:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:24 smithi170 ceph-mon[31212]: pgmap v19341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36095.813277 secs 2024-04-21T20:26:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:24 smithi077 ceph-mon[27902]: pgmap v19341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:26 smithi191 ceph-mon[31636]: pgmap v19342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:26 smithi170 ceph-mon[31212]: pgmap v19342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:26 smithi077 ceph-mon[27902]: pgmap v19342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36099.057149 secs 2024-04-21T20:26:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36099.057149 secs 2024-04-21T20:26:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36099.057149 secs 2024-04-21T20:26:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:28 smithi191 ceph-mon[31636]: pgmap v19343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:28 smithi170 ceph-mon[31212]: pgmap v19343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:28 smithi077 ceph-mon[27902]: pgmap v19343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:30.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36100.813401 secs 2024-04-21T20:26:30.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36100.813401 secs 2024-04-21T20:26:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36100.813401 secs 2024-04-21T20:26:31.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:30 smithi191 ceph-mon[31636]: pgmap v19344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:30 smithi170 ceph-mon[31212]: pgmap v19344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:30 smithi077 ceph-mon[27902]: pgmap v19344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:32.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:26:32.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:26:32.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36104.057215 secs 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: pgmap v19345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:26:33.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36104.057215 secs 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: pgmap v19345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:33.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:26:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:26:33.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36104.057215 secs 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: pgmap v19345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:26:33.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:26:34.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36105.813523 secs 2024-04-21T20:26:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:34 smithi077 ceph-mon[27902]: pgmap v19346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36105.813523 secs 2024-04-21T20:26:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:34 smithi191 ceph-mon[31636]: pgmap v19346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36105.813523 secs 2024-04-21T20:26:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:34 smithi170 ceph-mon[31212]: pgmap v19346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:36 smithi191 ceph-mon[31636]: pgmap v19347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:36 smithi170 ceph-mon[31212]: pgmap v19347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:36 smithi077 ceph-mon[27902]: pgmap v19347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36109.057326 secs 2024-04-21T20:26:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36109.057326 secs 2024-04-21T20:26:38.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36109.057326 secs 2024-04-21T20:26:39.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:38 smithi170 ceph-mon[31212]: pgmap v19348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:38 smithi191 ceph-mon[31636]: pgmap v19348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:38 smithi077 ceph-mon[27902]: pgmap v19348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36110.813647 secs 2024-04-21T20:26:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36110.813647 secs 2024-04-21T20:26:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36110.813647 secs 2024-04-21T20:26:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:40 smithi191 ceph-mon[31636]: pgmap v19349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:40 smithi170 ceph-mon[31212]: pgmap v19349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:41.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:40 smithi077 ceph-mon[27902]: pgmap v19349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:42 smithi191 ceph-mon[31636]: pgmap v19350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:42 smithi170 ceph-mon[31212]: pgmap v19350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:42 smithi077 ceph-mon[27902]: pgmap v19350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36114.057458 secs 2024-04-21T20:26:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36114.057458 secs 2024-04-21T20:26:44.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36114.057458 secs 2024-04-21T20:26:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36115.813740 secs 2024-04-21T20:26:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:44 smithi191 ceph-mon[31636]: pgmap v19351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36115.813740 secs 2024-04-21T20:26:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:44 smithi170 ceph-mon[31212]: pgmap v19351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36115.813740 secs 2024-04-21T20:26:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:44 smithi077 ceph-mon[27902]: pgmap v19351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:46.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:46 smithi191 ceph-mon[31636]: pgmap v19352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:46 smithi170 ceph-mon[31212]: pgmap v19352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:46 smithi077 ceph-mon[27902]: pgmap v19352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:48.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36119.057569 secs 2024-04-21T20:26:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36119.057569 secs 2024-04-21T20:26:48.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36119.057569 secs 2024-04-21T20:26:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:48 smithi191 ceph-mon[31636]: pgmap v19353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:48 smithi170 ceph-mon[31212]: pgmap v19353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:49.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:48 smithi077 ceph-mon[27902]: pgmap v19353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36120.813896 secs 2024-04-21T20:26:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36120.813896 secs 2024-04-21T20:26:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36120.813896 secs 2024-04-21T20:26:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:50 smithi191 ceph-mon[31636]: pgmap v19354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:50 smithi170 ceph-mon[31212]: pgmap v19354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:50 smithi077 ceph-mon[27902]: pgmap v19354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:52 smithi191 ceph-mon[31636]: pgmap v19355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:52 smithi170 ceph-mon[31212]: pgmap v19355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:52 smithi077 ceph-mon[27902]: pgmap v19355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36124.057678 secs 2024-04-21T20:26:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36124.057678 secs 2024-04-21T20:26:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36124.057678 secs 2024-04-21T20:26:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36125.814009 secs 2024-04-21T20:26:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:54 smithi191 ceph-mon[31636]: pgmap v19356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36125.814009 secs 2024-04-21T20:26:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:54 smithi170 ceph-mon[31212]: pgmap v19356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:26:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36125.814009 secs 2024-04-21T20:26:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:54 smithi077 ceph-mon[27902]: pgmap v19356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:56 smithi191 ceph-mon[31636]: pgmap v19357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:56 smithi170 ceph-mon[31212]: pgmap v19357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:56 smithi077 ceph-mon[27902]: pgmap v19357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:26:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36129.057800 secs 2024-04-21T20:26:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36129.057800 secs 2024-04-21T20:26:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36129.057800 secs 2024-04-21T20:26:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:58 smithi191 ceph-mon[31636]: pgmap v19358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:58 smithi170 ceph-mon[31212]: pgmap v19358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:26:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:58 smithi077 ceph-mon[27902]: pgmap v19358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36130.814100 secs 2024-04-21T20:27:00.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36130.814100 secs 2024-04-21T20:27:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36130.814100 secs 2024-04-21T20:27:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:00 smithi191 ceph-mon[31636]: pgmap v19359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:27:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:00 smithi170 ceph-mon[31212]: pgmap v19359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:27:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:00 smithi077 ceph-mon[27902]: pgmap v19359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:27:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:02 smithi191 ceph-mon[31636]: pgmap v19360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:27:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:02 smithi170 ceph-mon[31212]: pgmap v19360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:27:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:02 smithi077 ceph-mon[27902]: pgmap v19360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:27:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36134.057924 secs 2024-04-21T20:27:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36134.057924 secs 2024-04-21T20:27:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36134.057924 secs 2024-04-21T20:27:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36135.814246 secs 2024-04-21T20:27:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:04 smithi191 ceph-mon[31636]: pgmap v19361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:27:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36135.814246 secs 2024-04-21T20:27:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:04 smithi170 ceph-mon[31212]: pgmap v19361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:27:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36135.814246 secs 2024-04-21T20:27:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:04 smithi077 ceph-mon[27902]: pgmap v19361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T20:27:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:05 smithi191 ceph-mon[31636]: osdmap e1282: 12 total, 12 up, 12 in 2024-04-21T20:27:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:05 smithi170 ceph-mon[31212]: osdmap e1282: 12 total, 12 up, 12 in 2024-04-21T20:27:06.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:05 smithi077 ceph-mon[27902]: osdmap e1282: 12 total, 12 up, 12 in 2024-04-21T20:27:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:06 smithi191 ceph-mon[31636]: pgmap v19363: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:27:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:06 smithi170 ceph-mon[31212]: pgmap v19363: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:27:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:06 smithi077 ceph-mon[27902]: pgmap v19363: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:27:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36139.058071 secs 2024-04-21T20:27:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36139.058071 secs 2024-04-21T20:27:08.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36139.058071 secs 2024-04-21T20:27:09.211 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:08 smithi170 ceph-mon[31212]: pgmap v19364: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:27:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:08 smithi191 ceph-mon[31636]: pgmap v19364: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:27:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:08 smithi077 ceph-mon[27902]: pgmap v19364: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:27:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36140.814365 secs 2024-04-21T20:27:10.227 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36140.814365 secs 2024-04-21T20:27:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36140.814365 secs 2024-04-21T20:27:11.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:10 smithi191 ceph-mon[31636]: pgmap v19365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:10 smithi170 ceph-mon[31212]: pgmap v19365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:10 smithi077 ceph-mon[27902]: pgmap v19365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:12 smithi191 ceph-mon[31636]: pgmap v19366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:12 smithi170 ceph-mon[31212]: pgmap v19366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:12 smithi077 ceph-mon[27902]: pgmap v19366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36144.058173 secs 2024-04-21T20:27:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36144.058173 secs 2024-04-21T20:27:14.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36144.058173 secs 2024-04-21T20:27:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36145.814478 secs 2024-04-21T20:27:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:15 smithi191 ceph-mon[31636]: osdmap e1283: 12 total, 12 up, 12 in 2024-04-21T20:27:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:15 smithi191 ceph-mon[31636]: pgmap v19368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36145.814478 secs 2024-04-21T20:27:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:15 smithi170 ceph-mon[31212]: osdmap e1283: 12 total, 12 up, 12 in 2024-04-21T20:27:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:15 smithi170 ceph-mon[31212]: pgmap v19368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36145.814478 secs 2024-04-21T20:27:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:15 smithi077 ceph-mon[27902]: osdmap e1283: 12 total, 12 up, 12 in 2024-04-21T20:27:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:15 smithi077 ceph-mon[27902]: pgmap v19368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T20:27:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:16 smithi191 ceph-mon[31636]: pgmap v19369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:27:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:16 smithi170 ceph-mon[31212]: pgmap v19369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:27:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:16 smithi077 ceph-mon[27902]: pgmap v19369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:27:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36149.058259 secs 2024-04-21T20:27:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36149.058259 secs 2024-04-21T20:27:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36149.058259 secs 2024-04-21T20:27:19.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:18 smithi191 ceph-mon[31636]: pgmap v19370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:27:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:18 smithi170 ceph-mon[31212]: pgmap v19370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:27:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:18 smithi077 ceph-mon[27902]: pgmap v19370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:27:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:20.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36150.814631 secs 2024-04-21T20:27:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36150.814631 secs 2024-04-21T20:27:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36150.814631 secs 2024-04-21T20:27:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:20 smithi191 ceph-mon[31636]: pgmap v19371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:27:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:20 smithi170 ceph-mon[31212]: pgmap v19371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:27:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:20 smithi077 ceph-mon[27902]: pgmap v19371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:27:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:22 smithi191 ceph-mon[31636]: pgmap v19372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:27:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:22 smithi170 ceph-mon[31212]: pgmap v19372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:27:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:22 smithi077 ceph-mon[27902]: pgmap v19372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:27:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36154.058327 secs 2024-04-21T20:27:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36154.058327 secs 2024-04-21T20:27:24.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36154.058327 secs 2024-04-21T20:27:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36155.814755 secs 2024-04-21T20:27:25.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:25 smithi191 ceph-mon[31636]: pgmap v19373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:27:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36155.814755 secs 2024-04-21T20:27:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:25 smithi170 ceph-mon[31212]: pgmap v19373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:27:25.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36155.814755 secs 2024-04-21T20:27:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:25 smithi077 ceph-mon[27902]: pgmap v19373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:27:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:26 smithi191 ceph-mon[31636]: pgmap v19374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:26 smithi170 ceph-mon[31212]: pgmap v19374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:26 smithi077 ceph-mon[27902]: pgmap v19374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36159.058481 secs 2024-04-21T20:27:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36159.058481 secs 2024-04-21T20:27:28.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36159.058481 secs 2024-04-21T20:27:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:28 smithi191 ceph-mon[31636]: pgmap v19375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:28 smithi170 ceph-mon[31212]: pgmap v19375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:28 smithi077 ceph-mon[27902]: pgmap v19375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36160.814898 secs 2024-04-21T20:27:30.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36160.814898 secs 2024-04-21T20:27:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36160.814898 secs 2024-04-21T20:27:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:30 smithi191 ceph-mon[31636]: pgmap v19376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:30 smithi170 ceph-mon[31212]: pgmap v19376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:30 smithi077 ceph-mon[27902]: pgmap v19376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:32 smithi191 ceph-mon[31636]: pgmap v19377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:33.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:32 smithi170 ceph-mon[31212]: pgmap v19377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:32 smithi077 ceph-mon[27902]: pgmap v19377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36164.058622 secs 2024-04-21T20:27:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:27:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:27:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:27:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:27:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36164.058622 secs 2024-04-21T20:27:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:27:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:27:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:27:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:27:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36164.058622 secs 2024-04-21T20:27:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:27:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:27:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:27:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:27:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36165.814974 secs 2024-04-21T20:27:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:34 smithi191 ceph-mon[31636]: pgmap v19378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36165.814974 secs 2024-04-21T20:27:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:34 smithi170 ceph-mon[31212]: pgmap v19378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36165.814974 secs 2024-04-21T20:27:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:34 smithi077 ceph-mon[27902]: pgmap v19378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:36 smithi191 ceph-mon[31636]: pgmap v19379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:36 smithi170 ceph-mon[31212]: pgmap v19379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:37.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:36 smithi077 ceph-mon[27902]: pgmap v19379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36169.058740 secs 2024-04-21T20:27:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36169.058740 secs 2024-04-21T20:27:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36169.058740 secs 2024-04-21T20:27:39.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:38 smithi170 ceph-mon[31212]: pgmap v19380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:38 smithi191 ceph-mon[31636]: pgmap v19380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:38 smithi077 ceph-mon[27902]: pgmap v19380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36170.815055 secs 2024-04-21T20:27:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36170.815055 secs 2024-04-21T20:27:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36170.815055 secs 2024-04-21T20:27:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:40 smithi191 ceph-mon[31636]: pgmap v19381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:40 smithi170 ceph-mon[31212]: pgmap v19381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:40 smithi077 ceph-mon[27902]: pgmap v19381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:42 smithi191 ceph-mon[31636]: pgmap v19382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:42 smithi170 ceph-mon[31212]: pgmap v19382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:42 smithi077 ceph-mon[27902]: pgmap v19382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36174.058896 secs 2024-04-21T20:27:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36174.058896 secs 2024-04-21T20:27:44.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36174.058896 secs 2024-04-21T20:27:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36175.815162 secs 2024-04-21T20:27:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:44 smithi191 ceph-mon[31636]: pgmap v19383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36175.815162 secs 2024-04-21T20:27:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:44 smithi170 ceph-mon[31212]: pgmap v19383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36175.815162 secs 2024-04-21T20:27:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:44 smithi077 ceph-mon[27902]: pgmap v19383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:46 smithi191 ceph-mon[31636]: pgmap v19384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:46 smithi170 ceph-mon[31212]: pgmap v19384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:46 smithi077 ceph-mon[27902]: pgmap v19384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36179.059012 secs 2024-04-21T20:27:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36179.059012 secs 2024-04-21T20:27:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36179.059012 secs 2024-04-21T20:27:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:48 smithi191 ceph-mon[31636]: pgmap v19385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:48 smithi170 ceph-mon[31212]: pgmap v19385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:48 smithi077 ceph-mon[27902]: pgmap v19385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36180.815231 secs 2024-04-21T20:27:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36180.815231 secs 2024-04-21T20:27:50.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36180.815231 secs 2024-04-21T20:27:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:50 smithi191 ceph-mon[31636]: pgmap v19386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:50 smithi170 ceph-mon[31212]: pgmap v19386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:51.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:50 smithi077 ceph-mon[27902]: pgmap v19386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:52 smithi191 ceph-mon[31636]: pgmap v19387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:52 smithi170 ceph-mon[31212]: pgmap v19387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:52 smithi077 ceph-mon[27902]: pgmap v19387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36184.059128 secs 2024-04-21T20:27:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36184.059128 secs 2024-04-21T20:27:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36184.059128 secs 2024-04-21T20:27:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36185.815361 secs 2024-04-21T20:27:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:54 smithi191 ceph-mon[31636]: pgmap v19388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36185.815361 secs 2024-04-21T20:27:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:54 smithi170 ceph-mon[31212]: pgmap v19388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:27:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36185.815361 secs 2024-04-21T20:27:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:54 smithi077 ceph-mon[27902]: pgmap v19388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:56 smithi191 ceph-mon[31636]: pgmap v19389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:56 smithi170 ceph-mon[31212]: pgmap v19389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:56 smithi077 ceph-mon[27902]: pgmap v19389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:27:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36189.059191 secs 2024-04-21T20:27:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36189.059191 secs 2024-04-21T20:27:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36189.059191 secs 2024-04-21T20:27:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:58 smithi191 ceph-mon[31636]: pgmap v19390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:58 smithi170 ceph-mon[31212]: pgmap v19390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:27:59.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:58 smithi077 ceph-mon[27902]: pgmap v19390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36190.815502 secs 2024-04-21T20:28:00.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36190.815502 secs 2024-04-21T20:28:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36190.815502 secs 2024-04-21T20:28:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:00 smithi191 ceph-mon[31636]: pgmap v19391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:00 smithi170 ceph-mon[31212]: pgmap v19391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:01.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:00 smithi077 ceph-mon[27902]: pgmap v19391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:02 smithi191 ceph-mon[31636]: pgmap v19392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:02 smithi170 ceph-mon[31212]: pgmap v19392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:02 smithi077 ceph-mon[27902]: pgmap v19392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36194.059316 secs 2024-04-21T20:28:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36194.059316 secs 2024-04-21T20:28:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36194.059316 secs 2024-04-21T20:28:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36195.815561 secs 2024-04-21T20:28:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:04 smithi191 ceph-mon[31636]: pgmap v19393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36195.815561 secs 2024-04-21T20:28:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:04 smithi170 ceph-mon[31212]: pgmap v19393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36195.815561 secs 2024-04-21T20:28:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:04 smithi077 ceph-mon[27902]: pgmap v19393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:05 smithi191 ceph-mon[31636]: osdmap e1284: 12 total, 12 up, 12 in 2024-04-21T20:28:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:05 smithi170 ceph-mon[31212]: osdmap e1284: 12 total, 12 up, 12 in 2024-04-21T20:28:06.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:05 smithi077 ceph-mon[27902]: osdmap e1284: 12 total, 12 up, 12 in 2024-04-21T20:28:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:06 smithi191 ceph-mon[31636]: pgmap v19395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:28:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:06 smithi170 ceph-mon[31212]: pgmap v19395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:28:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:06 smithi077 ceph-mon[27902]: pgmap v19395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:28:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36199.059452 secs 2024-04-21T20:28:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36199.059452 secs 2024-04-21T20:28:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36199.059452 secs 2024-04-21T20:28:09.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:08 smithi170 ceph-mon[31212]: pgmap v19396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:28:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:08 smithi191 ceph-mon[31636]: pgmap v19396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:28:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:08 smithi077 ceph-mon[27902]: pgmap v19396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:28:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36200.815680 secs 2024-04-21T20:28:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:10 smithi191 ceph-mon[31636]: osdmap e1285: 12 total, 12 up, 12 in 2024-04-21T20:28:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36200.815680 secs 2024-04-21T20:28:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:10 smithi170 ceph-mon[31212]: osdmap e1285: 12 total, 12 up, 12 in 2024-04-21T20:28:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36200.815680 secs 2024-04-21T20:28:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:10 smithi077 ceph-mon[27902]: osdmap e1285: 12 total, 12 up, 12 in 2024-04-21T20:28:11.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:11 smithi191 ceph-mon[31636]: pgmap v19398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:28:11.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:11 smithi170 ceph-mon[31212]: pgmap v19398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:28:11.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:11 smithi077 ceph-mon[27902]: pgmap v19398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:28:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:12 smithi191 ceph-mon[31636]: pgmap v19399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:28:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:12 smithi170 ceph-mon[31212]: pgmap v19399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:28:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:12 smithi077 ceph-mon[27902]: pgmap v19399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:28:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36204.059563 secs 2024-04-21T20:28:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36204.059563 secs 2024-04-21T20:28:14.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36204.059563 secs 2024-04-21T20:28:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36205.815791 secs 2024-04-21T20:28:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:14 smithi191 ceph-mon[31636]: pgmap v19400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:28:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36205.815791 secs 2024-04-21T20:28:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:14 smithi170 ceph-mon[31212]: pgmap v19400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:28:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36205.815791 secs 2024-04-21T20:28:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:14 smithi077 ceph-mon[27902]: pgmap v19400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:28:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:16 smithi191 ceph-mon[31636]: pgmap v19401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:28:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:16 smithi170 ceph-mon[31212]: pgmap v19401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:28:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:16 smithi077 ceph-mon[27902]: pgmap v19401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:28:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36209.059646 secs 2024-04-21T20:28:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36209.059646 secs 2024-04-21T20:28:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36209.059646 secs 2024-04-21T20:28:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:18 smithi191 ceph-mon[31636]: pgmap v19402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:28:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:18 smithi170 ceph-mon[31212]: pgmap v19402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:28:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:18 smithi077 ceph-mon[27902]: pgmap v19402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:28:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36210.815909 secs 2024-04-21T20:28:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36210.815909 secs 2024-04-21T20:28:20.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36210.815909 secs 2024-04-21T20:28:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:20 smithi191 ceph-mon[31636]: pgmap v19403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:28:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:20 smithi170 ceph-mon[31212]: pgmap v19403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:28:21.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:20 smithi077 ceph-mon[27902]: pgmap v19403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:28:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:22 smithi191 ceph-mon[31636]: pgmap v19404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:22 smithi170 ceph-mon[31212]: pgmap v19404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:22 smithi077 ceph-mon[27902]: pgmap v19404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36214.059802 secs 2024-04-21T20:28:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36214.059802 secs 2024-04-21T20:28:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36214.059802 secs 2024-04-21T20:28:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36215.816023 secs 2024-04-21T20:28:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:24 smithi191 ceph-mon[31636]: pgmap v19405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36215.816023 secs 2024-04-21T20:28:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:24 smithi170 ceph-mon[31212]: pgmap v19405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36215.816023 secs 2024-04-21T20:28:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:24 smithi077 ceph-mon[27902]: pgmap v19405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:26 smithi191 ceph-mon[31636]: pgmap v19406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:26 smithi170 ceph-mon[31212]: pgmap v19406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:26 smithi077 ceph-mon[27902]: pgmap v19406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36219.059917 secs 2024-04-21T20:28:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36219.059917 secs 2024-04-21T20:28:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36219.059917 secs 2024-04-21T20:28:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:28 smithi191 ceph-mon[31636]: pgmap v19407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:28 smithi170 ceph-mon[31212]: pgmap v19407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:28 smithi077 ceph-mon[27902]: pgmap v19407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:30.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36220.816135 secs 2024-04-21T20:28:30.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36220.816135 secs 2024-04-21T20:28:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36220.816135 secs 2024-04-21T20:28:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:30 smithi191 ceph-mon[31636]: pgmap v19408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:30 smithi170 ceph-mon[31212]: pgmap v19408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:31.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:30 smithi077 ceph-mon[27902]: pgmap v19408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:32 smithi191 ceph-mon[31636]: pgmap v19409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:33.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:32 smithi170 ceph-mon[31212]: pgmap v19409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:32 smithi077 ceph-mon[27902]: pgmap v19409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36224.060020 secs 2024-04-21T20:28:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:28:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36224.060020 secs 2024-04-21T20:28:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:28:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36224.060020 secs 2024-04-21T20:28:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:28:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36225.816199 secs 2024-04-21T20:28:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:28:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:28:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:28:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:34 smithi191 ceph-mon[31636]: pgmap v19410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36225.816199 secs 2024-04-21T20:28:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:28:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:28:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:28:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:34 smithi170 ceph-mon[31212]: pgmap v19410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36225.816199 secs 2024-04-21T20:28:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:28:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:28:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:28:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:34 smithi077 ceph-mon[27902]: pgmap v19410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:36 smithi191 ceph-mon[31636]: pgmap v19411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:36 smithi170 ceph-mon[31212]: pgmap v19411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:37.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:36 smithi077 ceph-mon[27902]: pgmap v19411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36229.060101 secs 2024-04-21T20:28:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36229.060101 secs 2024-04-21T20:28:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36229.060101 secs 2024-04-21T20:28:39.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:38 smithi170 ceph-mon[31212]: pgmap v19412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:38 smithi191 ceph-mon[31636]: pgmap v19412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:38 smithi077 ceph-mon[27902]: pgmap v19412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36230.816317 secs 2024-04-21T20:28:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36230.816317 secs 2024-04-21T20:28:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36230.816317 secs 2024-04-21T20:28:41.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:40 smithi191 ceph-mon[31636]: pgmap v19413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:41.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:40 smithi170 ceph-mon[31212]: pgmap v19413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:41.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:40 smithi077 ceph-mon[27902]: pgmap v19413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:42 smithi191 ceph-mon[31636]: pgmap v19414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:42 smithi170 ceph-mon[31212]: pgmap v19414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:42 smithi077 ceph-mon[27902]: pgmap v19414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36234.060210 secs 2024-04-21T20:28:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36234.060210 secs 2024-04-21T20:28:44.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36234.060210 secs 2024-04-21T20:28:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36235.816403 secs 2024-04-21T20:28:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:44 smithi191 ceph-mon[31636]: pgmap v19415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36235.816403 secs 2024-04-21T20:28:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:44 smithi170 ceph-mon[31212]: pgmap v19415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36235.816403 secs 2024-04-21T20:28:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:44 smithi077 ceph-mon[27902]: pgmap v19415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:46 smithi191 ceph-mon[31636]: pgmap v19416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:46 smithi170 ceph-mon[31212]: pgmap v19416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:46 smithi077 ceph-mon[27902]: pgmap v19416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36239.060327 secs 2024-04-21T20:28:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36239.060327 secs 2024-04-21T20:28:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36239.060327 secs 2024-04-21T20:28:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:48 smithi191 ceph-mon[31636]: pgmap v19417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:49.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:48 smithi170 ceph-mon[31212]: pgmap v19417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:49.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:48 smithi077 ceph-mon[27902]: pgmap v19417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36240.816543 secs 2024-04-21T20:28:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36240.816543 secs 2024-04-21T20:28:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36240.816543 secs 2024-04-21T20:28:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:50 smithi191 ceph-mon[31636]: pgmap v19418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:51.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:50 smithi170 ceph-mon[31212]: pgmap v19418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:51.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:50 smithi077 ceph-mon[27902]: pgmap v19418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:52 smithi191 ceph-mon[31636]: pgmap v19419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:52 smithi170 ceph-mon[31212]: pgmap v19419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:52 smithi077 ceph-mon[27902]: pgmap v19419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36244.060410 secs 2024-04-21T20:28:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36244.060410 secs 2024-04-21T20:28:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36244.060410 secs 2024-04-21T20:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.462+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T20:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.462+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T20:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.462+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.462+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T20:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.463+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.463+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T20:28:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.463+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T20:28:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T20:28:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T20:28:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7002b070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:28:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7002b070 comp rx=0 tx=0).stop 2024-04-21T20:28:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T20:28:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T20:28:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T20:28:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T20:28:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.540+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:28:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:54.541+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7003d000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T20:28:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36245.816684 secs 2024-04-21T20:28:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:54 smithi191 ceph-mon[31636]: pgmap v19420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36245.816684 secs 2024-04-21T20:28:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:54 smithi170 ceph-mon[31212]: pgmap v19420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:28:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36245.816684 secs 2024-04-21T20:28:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:54 smithi077 ceph-mon[27902]: pgmap v19420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:56 smithi191 ceph-mon[31636]: pgmap v19421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:56 smithi170 ceph-mon[31212]: pgmap v19421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:56 smithi077 ceph-mon[27902]: pgmap v19421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:28:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36249.060530 secs 2024-04-21T20:28:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36249.060530 secs 2024-04-21T20:28:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36249.060530 secs 2024-04-21T20:28:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:58 smithi191 ceph-mon[31636]: pgmap v19422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:59.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:58 smithi170 ceph-mon[31212]: pgmap v19422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:28:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:59.364+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:28:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:59.364+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:28:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:59.365+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:28:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:28:59.365+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:28:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:58 smithi077 ceph-mon[27902]: pgmap v19422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36250.816802 secs 2024-04-21T20:29:00.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36250.816802 secs 2024-04-21T20:29:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36250.816802 secs 2024-04-21T20:29:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:00 smithi191 ceph-mon[31636]: pgmap v19423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:01.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:00 smithi170 ceph-mon[31212]: pgmap v19423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:01.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:00 smithi077 ceph-mon[27902]: pgmap v19423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:02 smithi191 ceph-mon[31636]: pgmap v19424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:03.072 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:02 smithi170 ceph-mon[31212]: pgmap v19424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:03.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:02 smithi077 ceph-mon[27902]: pgmap v19424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36254.060643 secs 2024-04-21T20:29:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36254.060643 secs 2024-04-21T20:29:04.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36254.060643 secs 2024-04-21T20:29:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36255.816918 secs 2024-04-21T20:29:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:04 smithi191 ceph-mon[31636]: pgmap v19425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36255.816918 secs 2024-04-21T20:29:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:04 smithi170 ceph-mon[31212]: pgmap v19425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36255.816918 secs 2024-04-21T20:29:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:04 smithi077 ceph-mon[27902]: pgmap v19425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:05 smithi191 ceph-mon[31636]: osdmap e1286: 12 total, 12 up, 12 in 2024-04-21T20:29:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:05 smithi170 ceph-mon[31212]: osdmap e1286: 12 total, 12 up, 12 in 2024-04-21T20:29:06.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:05 smithi077 ceph-mon[27902]: osdmap e1286: 12 total, 12 up, 12 in 2024-04-21T20:29:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:06 smithi191 ceph-mon[31636]: pgmap v19427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:29:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:06 smithi170 ceph-mon[31212]: pgmap v19427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:29:07.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:06 smithi077 ceph-mon[27902]: pgmap v19427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:29:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36259.060778 secs 2024-04-21T20:29:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36259.060778 secs 2024-04-21T20:29:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36259.060778 secs 2024-04-21T20:29:09.213 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:08 smithi170 ceph-mon[31212]: pgmap v19428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:29:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:08 smithi191 ceph-mon[31636]: pgmap v19428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:29:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:08 smithi077 ceph-mon[27902]: pgmap v19428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:29:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:10.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36260.817042 secs 2024-04-21T20:29:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36260.817042 secs 2024-04-21T20:29:10.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36260.817042 secs 2024-04-21T20:29:11.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:10 smithi191 ceph-mon[31636]: pgmap v19429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:29:11.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:10 smithi170 ceph-mon[31212]: pgmap v19429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:29:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:10 smithi077 ceph-mon[27902]: pgmap v19429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:29:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:12 smithi191 ceph-mon[31636]: pgmap v19430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:29:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:12 smithi170 ceph-mon[31212]: pgmap v19430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:29:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:12 smithi077 ceph-mon[27902]: pgmap v19430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:29:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36264.060871 secs 2024-04-21T20:29:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36264.060871 secs 2024-04-21T20:29:14.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36264.060871 secs 2024-04-21T20:29:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36265.817103 secs 2024-04-21T20:29:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:15 smithi191 ceph-mon[31636]: osdmap e1287: 12 total, 12 up, 12 in 2024-04-21T20:29:15.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:15 smithi191 ceph-mon[31636]: pgmap v19432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:29:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36265.817103 secs 2024-04-21T20:29:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:15 smithi170 ceph-mon[31212]: osdmap e1287: 12 total, 12 up, 12 in 2024-04-21T20:29:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:15 smithi170 ceph-mon[31212]: pgmap v19432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:29:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36265.817103 secs 2024-04-21T20:29:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:15 smithi077 ceph-mon[27902]: osdmap e1287: 12 total, 12 up, 12 in 2024-04-21T20:29:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:15 smithi077 ceph-mon[27902]: pgmap v19432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:29:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:16 smithi191 ceph-mon[31636]: pgmap v19433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:29:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:16 smithi170 ceph-mon[31212]: pgmap v19433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:29:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:16 smithi077 ceph-mon[27902]: pgmap v19433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:29:18.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36269.060933 secs 2024-04-21T20:29:18.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36269.060933 secs 2024-04-21T20:29:18.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36269.060933 secs 2024-04-21T20:29:19.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:18 smithi191 ceph-mon[31636]: pgmap v19434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:29:19.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:18 smithi170 ceph-mon[31212]: pgmap v19434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:29:19.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:18 smithi077 ceph-mon[27902]: pgmap v19434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:29:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:20.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36270.817209 secs 2024-04-21T20:29:20.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36270.817209 secs 2024-04-21T20:29:20.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36270.817209 secs 2024-04-21T20:29:21.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:20 smithi191 ceph-mon[31636]: pgmap v19435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:29:21.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:20 smithi170 ceph-mon[31212]: pgmap v19435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:29:21.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:20 smithi077 ceph-mon[27902]: pgmap v19435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:29:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:22 smithi191 ceph-mon[31636]: pgmap v19436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:29:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:22 smithi170 ceph-mon[31212]: pgmap v19436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:29:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:22 smithi077 ceph-mon[27902]: pgmap v19436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:29:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36274.061027 secs 2024-04-21T20:29:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36274.061027 secs 2024-04-21T20:29:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36274.061027 secs 2024-04-21T20:29:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36275.817349 secs 2024-04-21T20:29:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:24 smithi191 ceph-mon[31636]: pgmap v19437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:29:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36275.817349 secs 2024-04-21T20:29:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:24 smithi170 ceph-mon[31212]: pgmap v19437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:29:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36275.817349 secs 2024-04-21T20:29:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:24 smithi077 ceph-mon[27902]: pgmap v19437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:29:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:26 smithi191 ceph-mon[31636]: pgmap v19438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:26 smithi170 ceph-mon[31212]: pgmap v19438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:26 smithi077 ceph-mon[27902]: pgmap v19438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36279.061126 secs 2024-04-21T20:29:28.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36279.061126 secs 2024-04-21T20:29:28.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36279.061126 secs 2024-04-21T20:29:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:28 smithi191 ceph-mon[31636]: pgmap v19439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:28 smithi170 ceph-mon[31212]: pgmap v19439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:29.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:28 smithi077 ceph-mon[27902]: pgmap v19439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36280.817493 secs 2024-04-21T20:29:30.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36280.817493 secs 2024-04-21T20:29:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36280.817493 secs 2024-04-21T20:29:31.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:30 smithi191 ceph-mon[31636]: pgmap v19440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:31.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:30 smithi170 ceph-mon[31212]: pgmap v19440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:31.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:30 smithi077 ceph-mon[27902]: pgmap v19440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:32 smithi191 ceph-mon[31636]: pgmap v19441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:32 smithi170 ceph-mon[31212]: pgmap v19441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:32 smithi077 ceph-mon[27902]: pgmap v19441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36284.061243 secs 2024-04-21T20:29:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36284.061243 secs 2024-04-21T20:29:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36284.061243 secs 2024-04-21T20:29:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36285.817625 secs 2024-04-21T20:29:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:29:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:34 smithi191 ceph-mon[31636]: pgmap v19442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36285.817625 secs 2024-04-21T20:29:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:29:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:34 smithi170 ceph-mon[31212]: pgmap v19442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36285.817625 secs 2024-04-21T20:29:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:29:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:34 smithi077 ceph-mon[27902]: pgmap v19442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:29:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:29:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:29:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:29:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:29:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:29:36.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:29:36.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:29:36.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:29:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:36 smithi191 ceph-mon[31636]: pgmap v19443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:36 smithi170 ceph-mon[31212]: pgmap v19443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:37.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:36 smithi077 ceph-mon[27902]: pgmap v19443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36289.061390 secs 2024-04-21T20:29:38.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36289.061390 secs 2024-04-21T20:29:38.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36289.061390 secs 2024-04-21T20:29:39.212 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:38 smithi170 ceph-mon[31212]: pgmap v19444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:38 smithi191 ceph-mon[31636]: pgmap v19444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:39.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:38 smithi077 ceph-mon[27902]: pgmap v19444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:40.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36290.817741 secs 2024-04-21T20:29:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36290.817741 secs 2024-04-21T20:29:40.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36290.817741 secs 2024-04-21T20:29:42.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:41 smithi191 ceph-mon[31636]: pgmap v19445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:42.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:41 smithi170 ceph-mon[31212]: pgmap v19445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:42.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:41 smithi077 ceph-mon[27902]: pgmap v19445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:43.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36294.061461 secs 2024-04-21T20:29:43.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36294.061461 secs 2024-04-21T20:29:43.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36294.061461 secs 2024-04-21T20:29:44.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:43 smithi191 ceph-mon[31636]: pgmap v19446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:44.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:43 smithi170 ceph-mon[31212]: pgmap v19446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:44.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:43 smithi077 ceph-mon[27902]: pgmap v19446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36295.817895 secs 2024-04-21T20:29:45.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36295.817895 secs 2024-04-21T20:29:45.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36295.817895 secs 2024-04-21T20:29:46.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:45 smithi191 ceph-mon[31636]: pgmap v19447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:46.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:45 smithi170 ceph-mon[31212]: pgmap v19447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:46.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:45 smithi077 ceph-mon[27902]: pgmap v19447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:47 smithi191 ceph-mon[31636]: pgmap v19448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36299.061601 secs 2024-04-21T20:29:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:47 smithi170 ceph-mon[31212]: pgmap v19448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:48.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36299.061601 secs 2024-04-21T20:29:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:47 smithi077 ceph-mon[27902]: pgmap v19448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:48.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36299.061601 secs 2024-04-21T20:29:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:49 smithi191 ceph-mon[31636]: pgmap v19449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36300.817956 secs 2024-04-21T20:29:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:49 smithi170 ceph-mon[31212]: pgmap v19449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:50.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36300.817956 secs 2024-04-21T20:29:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:49 smithi077 ceph-mon[27902]: pgmap v19449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:50.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36300.817956 secs 2024-04-21T20:29:52.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:51 smithi191 ceph-mon[31636]: pgmap v19450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:52.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:51 smithi170 ceph-mon[31212]: pgmap v19450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:52.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:51 smithi077 ceph-mon[27902]: pgmap v19450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36304.061698 secs 2024-04-21T20:29:53.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36304.061698 secs 2024-04-21T20:29:53.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36304.061698 secs 2024-04-21T20:29:54.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:53 smithi191 ceph-mon[31636]: pgmap v19451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:54.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:53 smithi170 ceph-mon[31212]: pgmap v19451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:54.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:53 smithi077 ceph-mon[27902]: pgmap v19451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:29:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36305.818033 secs 2024-04-21T20:29:55.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36305.818033 secs 2024-04-21T20:29:55.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36305.818033 secs 2024-04-21T20:29:56.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:55 smithi170 ceph-mon[31212]: pgmap v19452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:56.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:55 smithi077 ceph-mon[27902]: pgmap v19452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:56.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:55 smithi191 ceph-mon[31636]: pgmap v19452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:29:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:57 smithi170 ceph-mon[31212]: pgmap v19453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:58.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36309.061844 secs 2024-04-21T20:29:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:57 smithi077 ceph-mon[27902]: pgmap v19453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:58.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36309.061844 secs 2024-04-21T20:29:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:57 smithi191 ceph-mon[31636]: pgmap v19453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:29:58.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36309.061844 secs 2024-04-21T20:30:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:00 smithi191 ceph-mon[31636]: pgmap v19454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36310.818150 secs 2024-04-21T20:30:00.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:30:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:00 smithi170 ceph-mon[31212]: pgmap v19454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36310.818150 secs 2024-04-21T20:30:00.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:30:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:00 smithi077 ceph-mon[27902]: pgmap v19454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36310.818150 secs 2024-04-21T20:30:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:30:02.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:02 smithi191 ceph-mon[31636]: pgmap v19455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:02.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:02 smithi170 ceph-mon[31212]: pgmap v19455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:02 smithi077 ceph-mon[27902]: pgmap v19455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:03.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36314.061925 secs 2024-04-21T20:30:03.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36314.061925 secs 2024-04-21T20:30:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36314.061925 secs 2024-04-21T20:30:04.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:04 smithi191 ceph-mon[31636]: pgmap v19456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:04.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:04 smithi170 ceph-mon[31212]: pgmap v19456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:04 smithi077 ceph-mon[27902]: pgmap v19456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:05.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36315.818262 secs 2024-04-21T20:30:05.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:05 smithi170 ceph-mon[31212]: osdmap e1288: 12 total, 12 up, 12 in 2024-04-21T20:30:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36315.818262 secs 2024-04-21T20:30:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:05 smithi077 ceph-mon[27902]: osdmap e1288: 12 total, 12 up, 12 in 2024-04-21T20:30:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36315.818262 secs 2024-04-21T20:30:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:05 smithi191 ceph-mon[31636]: osdmap e1288: 12 total, 12 up, 12 in 2024-04-21T20:30:06.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:06 smithi170 ceph-mon[31212]: pgmap v19458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:30:06.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:06 smithi077 ceph-mon[27902]: pgmap v19458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:30:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:06 smithi191 ceph-mon[31636]: pgmap v19458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:30:08.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:08 smithi170 ceph-mon[31212]: pgmap v19459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:30:08.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36319.062004 secs 2024-04-21T20:30:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:08 smithi077 ceph-mon[27902]: pgmap v19459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:30:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36319.062004 secs 2024-04-21T20:30:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:08 smithi191 ceph-mon[31636]: pgmap v19459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:30:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36319.062004 secs 2024-04-21T20:30:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:10 smithi191 ceph-mon[31636]: pgmap v19460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:30:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36320.818350 secs 2024-04-21T20:30:10.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:10 smithi191 ceph-mon[31636]: osdmap e1289: 12 total, 12 up, 12 in 2024-04-21T20:30:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:10 smithi170 ceph-mon[31212]: pgmap v19460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:30:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36320.818350 secs 2024-04-21T20:30:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:10 smithi170 ceph-mon[31212]: osdmap e1289: 12 total, 12 up, 12 in 2024-04-21T20:30:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:10 smithi077 ceph-mon[27902]: pgmap v19460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:30:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36320.818350 secs 2024-04-21T20:30:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:10 smithi077 ceph-mon[27902]: osdmap e1289: 12 total, 12 up, 12 in 2024-04-21T20:30:12.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:12 smithi170 ceph-mon[31212]: pgmap v19462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:30:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:12 smithi077 ceph-mon[27902]: pgmap v19462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:30:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:12 smithi191 ceph-mon[31636]: pgmap v19462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:30:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36324.062078 secs 2024-04-21T20:30:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36324.062078 secs 2024-04-21T20:30:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36324.062078 secs 2024-04-21T20:30:14.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:14 smithi170 ceph-mon[31212]: pgmap v19463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:30:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:14 smithi077 ceph-mon[27902]: pgmap v19463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:30:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:14 smithi191 ceph-mon[31636]: pgmap v19463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:30:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36325.818482 secs 2024-04-21T20:30:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36325.818482 secs 2024-04-21T20:30:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36325.818482 secs 2024-04-21T20:30:16.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:16 smithi170 ceph-mon[31212]: pgmap v19464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:30:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:16 smithi077 ceph-mon[27902]: pgmap v19464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:30:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:16 smithi191 ceph-mon[31636]: pgmap v19464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:30:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:18 smithi170 ceph-mon[31212]: pgmap v19465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:30:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36329.062226 secs 2024-04-21T20:30:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:18 smithi077 ceph-mon[27902]: pgmap v19465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:30:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36329.062226 secs 2024-04-21T20:30:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:18 smithi191 ceph-mon[31636]: pgmap v19465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:30:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36329.062226 secs 2024-04-21T20:30:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:20.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:20 smithi170 ceph-mon[31212]: pgmap v19466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:30:20.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36330.818598 secs 2024-04-21T20:30:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:20 smithi077 ceph-mon[27902]: pgmap v19466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:30:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36330.818598 secs 2024-04-21T20:30:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:20 smithi191 ceph-mon[31636]: pgmap v19466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:30:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36330.818598 secs 2024-04-21T20:30:22.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:22 smithi170 ceph-mon[31212]: pgmap v19467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:30:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:22 smithi077 ceph-mon[27902]: pgmap v19467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:30:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:22 smithi191 ceph-mon[31636]: pgmap v19467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:30:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36334.062366 secs 2024-04-21T20:30:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36334.062366 secs 2024-04-21T20:30:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36334.062366 secs 2024-04-21T20:30:24.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:24 smithi170 ceph-mon[31212]: pgmap v19468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:24 smithi077 ceph-mon[27902]: pgmap v19468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:24 smithi191 ceph-mon[31636]: pgmap v19468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36335.818756 secs 2024-04-21T20:30:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36335.818756 secs 2024-04-21T20:30:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36335.818756 secs 2024-04-21T20:30:26.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:26 smithi170 ceph-mon[31212]: pgmap v19469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:26 smithi077 ceph-mon[27902]: pgmap v19469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:26 smithi191 ceph-mon[31636]: pgmap v19469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:28 smithi170 ceph-mon[31212]: pgmap v19470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36339.062507 secs 2024-04-21T20:30:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:28 smithi077 ceph-mon[27902]: pgmap v19470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36339.062507 secs 2024-04-21T20:30:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:28 smithi191 ceph-mon[31636]: pgmap v19470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36339.062507 secs 2024-04-21T20:30:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:30 smithi170 ceph-mon[31212]: pgmap v19471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36340.818887 secs 2024-04-21T20:30:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:30 smithi077 ceph-mon[27902]: pgmap v19471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36340.818887 secs 2024-04-21T20:30:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:30 smithi191 ceph-mon[31636]: pgmap v19471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36340.818887 secs 2024-04-21T20:30:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:32 smithi170 ceph-mon[31212]: pgmap v19472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:32 smithi077 ceph-mon[27902]: pgmap v19472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:32 smithi191 ceph-mon[31636]: pgmap v19472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36344.062617 secs 2024-04-21T20:30:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36344.062617 secs 2024-04-21T20:30:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36344.062617 secs 2024-04-21T20:30:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:34 smithi170 ceph-mon[31212]: pgmap v19473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:34 smithi077 ceph-mon[27902]: pgmap v19473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:34 smithi191 ceph-mon[31636]: pgmap v19473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36345.819000 secs 2024-04-21T20:30:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:30:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36345.819000 secs 2024-04-21T20:30:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:30:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36345.819000 secs 2024-04-21T20:30:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:30:36.760 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:36 smithi077 ceph-mon[27902]: pgmap v19474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:36.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:36 smithi170 ceph-mon[31212]: pgmap v19474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:36 smithi191 ceph-mon[31636]: pgmap v19474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:38.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:38 smithi077 ceph-mon[27902]: pgmap v19475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:38.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36349.062751 secs 2024-04-21T20:30:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:38 smithi170 ceph-mon[31212]: pgmap v19475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36349.062751 secs 2024-04-21T20:30:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:38 smithi191 ceph-mon[31636]: pgmap v19475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36349.062751 secs 2024-04-21T20:30:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:40.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: pgmap v19476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36350.819118 secs 2024-04-21T20:30:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:30:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:30:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: pgmap v19476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36350.819118 secs 2024-04-21T20:30:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:30:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:30:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: pgmap v19476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36350.819118 secs 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:30:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:30:42.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:42 smithi170 ceph-mon[31212]: pgmap v19477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:42 smithi077 ceph-mon[27902]: pgmap v19477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:42 smithi191 ceph-mon[31636]: pgmap v19477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:43.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36354.062864 secs 2024-04-21T20:30:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36354.062864 secs 2024-04-21T20:30:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36354.062864 secs 2024-04-21T20:30:44.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:44 smithi170 ceph-mon[31212]: pgmap v19478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:44 smithi077 ceph-mon[27902]: pgmap v19478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:44 smithi191 ceph-mon[31636]: pgmap v19478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36355.819233 secs 2024-04-21T20:30:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36355.819233 secs 2024-04-21T20:30:46.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36355.819233 secs 2024-04-21T20:30:46.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:46 smithi077 ceph-mon[27902]: pgmap v19479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:46 smithi191 ceph-mon[31636]: pgmap v19479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:46 smithi170 ceph-mon[31212]: pgmap v19479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:48 smithi077 ceph-mon[27902]: pgmap v19480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36359.062979 secs 2024-04-21T20:30:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:48 smithi191 ceph-mon[31636]: pgmap v19480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36359.062979 secs 2024-04-21T20:30:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:48 smithi170 ceph-mon[31212]: pgmap v19480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36359.062979 secs 2024-04-21T20:30:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:50 smithi077 ceph-mon[27902]: pgmap v19481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:50.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36360.819350 secs 2024-04-21T20:30:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:50 smithi191 ceph-mon[31636]: pgmap v19481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36360.819350 secs 2024-04-21T20:30:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:50 smithi170 ceph-mon[31212]: pgmap v19481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36360.819350 secs 2024-04-21T20:30:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:52 smithi077 ceph-mon[27902]: pgmap v19482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:52 smithi191 ceph-mon[31636]: pgmap v19482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:52 smithi170 ceph-mon[31212]: pgmap v19482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36364.063110 secs 2024-04-21T20:30:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36364.063110 secs 2024-04-21T20:30:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36364.063110 secs 2024-04-21T20:30:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:54 smithi077 ceph-mon[27902]: pgmap v19483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:54 smithi191 ceph-mon[31636]: pgmap v19483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:54 smithi170 ceph-mon[31212]: pgmap v19483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:30:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36365.819489 secs 2024-04-21T20:30:55.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36365.819489 secs 2024-04-21T20:30:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36365.819489 secs 2024-04-21T20:30:56.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:56 smithi077 ceph-mon[27902]: pgmap v19484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:56.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:56 smithi191 ceph-mon[31636]: pgmap v19484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:56 smithi170 ceph-mon[31212]: pgmap v19484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:30:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:58 smithi077 ceph-mon[27902]: pgmap v19485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:30:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36369.063249 secs 2024-04-21T20:30:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:58 smithi191 ceph-mon[31636]: pgmap v19485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:30:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36369.063249 secs 2024-04-21T20:30:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:58 smithi170 ceph-mon[31212]: pgmap v19485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:30:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:30:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36369.063249 secs 2024-04-21T20:31:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:00 smithi077 ceph-mon[27902]: pgmap v19486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36370.819577 secs 2024-04-21T20:31:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:00 smithi191 ceph-mon[31636]: pgmap v19486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36370.819577 secs 2024-04-21T20:31:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:00 smithi170 ceph-mon[31212]: pgmap v19486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36370.819577 secs 2024-04-21T20:31:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:02 smithi077 ceph-mon[27902]: pgmap v19487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:02 smithi191 ceph-mon[31636]: pgmap v19487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:02 smithi170 ceph-mon[31212]: pgmap v19487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36374.063378 secs 2024-04-21T20:31:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36374.063378 secs 2024-04-21T20:31:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36374.063378 secs 2024-04-21T20:31:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:04 smithi077 ceph-mon[27902]: pgmap v19488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:04 smithi191 ceph-mon[31636]: pgmap v19488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:04 smithi170 ceph-mon[31212]: pgmap v19488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36375.819689 secs 2024-04-21T20:31:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:05 smithi077 ceph-mon[27902]: osdmap e1290: 12 total, 12 up, 12 in 2024-04-21T20:31:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36375.819689 secs 2024-04-21T20:31:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:05 smithi191 ceph-mon[31636]: osdmap e1290: 12 total, 12 up, 12 in 2024-04-21T20:31:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36375.819689 secs 2024-04-21T20:31:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:05 smithi170 ceph-mon[31212]: osdmap e1290: 12 total, 12 up, 12 in 2024-04-21T20:31:06.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:06 smithi077 ceph-mon[27902]: pgmap v19490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:31:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:06 smithi191 ceph-mon[31636]: pgmap v19490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:31:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:06 smithi170 ceph-mon[31212]: pgmap v19490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:31:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:08 smithi077 ceph-mon[27902]: pgmap v19491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:31:08.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36379.063517 secs 2024-04-21T20:31:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:08 smithi191 ceph-mon[31636]: pgmap v19491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:31:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36379.063517 secs 2024-04-21T20:31:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:08 smithi170 ceph-mon[31212]: pgmap v19491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:31:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36379.063517 secs 2024-04-21T20:31:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:10.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:10 smithi191 ceph-mon[31636]: pgmap v19492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:31:10.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36380.819803 secs 2024-04-21T20:31:10.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:10 smithi191 ceph-mon[31636]: osdmap e1291: 12 total, 12 up, 12 in 2024-04-21T20:31:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:10 smithi170 ceph-mon[31212]: pgmap v19492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:31:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36380.819803 secs 2024-04-21T20:31:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:10 smithi170 ceph-mon[31212]: osdmap e1291: 12 total, 12 up, 12 in 2024-04-21T20:31:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:10 smithi077 ceph-mon[27902]: pgmap v19492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:31:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36380.819803 secs 2024-04-21T20:31:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:10 smithi077 ceph-mon[27902]: osdmap e1291: 12 total, 12 up, 12 in 2024-04-21T20:31:12.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:12 smithi170 ceph-mon[31212]: pgmap v19494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:31:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:12 smithi077 ceph-mon[27902]: pgmap v19494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:31:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:12 smithi191 ceph-mon[31636]: pgmap v19494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:31:13.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36384.063619 secs 2024-04-21T20:31:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36384.063619 secs 2024-04-21T20:31:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36384.063619 secs 2024-04-21T20:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:14.382+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:14.382+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:14.382+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:14.382+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:31:14.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:14 smithi170 ceph-mon[31212]: pgmap v19495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:31:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:14 smithi077 ceph-mon[27902]: pgmap v19495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:31:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:14 smithi191 ceph-mon[31636]: pgmap v19495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:31:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:15.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36385.819941 secs 2024-04-21T20:31:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36385.819941 secs 2024-04-21T20:31:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36385.819941 secs 2024-04-21T20:31:16.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:16 smithi170 ceph-mon[31212]: pgmap v19496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:31:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:16 smithi077 ceph-mon[27902]: pgmap v19496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:31:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:16 smithi191 ceph-mon[31636]: pgmap v19496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:31:18.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:18 smithi170 ceph-mon[31212]: pgmap v19497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:31:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36389.063686 secs 2024-04-21T20:31:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:18 smithi077 ceph-mon[27902]: pgmap v19497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:31:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36389.063686 secs 2024-04-21T20:31:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:18 smithi191 ceph-mon[31636]: pgmap v19497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:31:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36389.063686 secs 2024-04-21T20:31:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:20 smithi170 ceph-mon[31212]: pgmap v19498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:31:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36390.820083 secs 2024-04-21T20:31:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:20 smithi077 ceph-mon[27902]: pgmap v19498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:31:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36390.820083 secs 2024-04-21T20:31:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:20 smithi191 ceph-mon[31636]: pgmap v19498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:31:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36390.820083 secs 2024-04-21T20:31:22.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:22 smithi170 ceph-mon[31212]: pgmap v19499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:31:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:22 smithi077 ceph-mon[27902]: pgmap v19499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:31:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:22 smithi191 ceph-mon[31636]: pgmap v19499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:31:23.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36394.063781 secs 2024-04-21T20:31:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36394.063781 secs 2024-04-21T20:31:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36394.063781 secs 2024-04-21T20:31:24.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:24 smithi170 ceph-mon[31212]: pgmap v19500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:24 smithi077 ceph-mon[27902]: pgmap v19500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:24 smithi191 ceph-mon[31636]: pgmap v19500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:25.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36395.820194 secs 2024-04-21T20:31:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36395.820194 secs 2024-04-21T20:31:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36395.820194 secs 2024-04-21T20:31:26.814 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:26 smithi170 ceph-mon[31212]: pgmap v19501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:26 smithi077 ceph-mon[27902]: pgmap v19501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:26 smithi191 ceph-mon[31636]: pgmap v19501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:28 smithi170 ceph-mon[31212]: pgmap v19502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:28.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36399.063864 secs 2024-04-21T20:31:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:28 smithi077 ceph-mon[27902]: pgmap v19502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36399.063864 secs 2024-04-21T20:31:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:28 smithi191 ceph-mon[31636]: pgmap v19502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36399.063864 secs 2024-04-21T20:31:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:30.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:30 smithi170 ceph-mon[31212]: pgmap v19503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36400.820312 secs 2024-04-21T20:31:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:30 smithi077 ceph-mon[27902]: pgmap v19503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36400.820312 secs 2024-04-21T20:31:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:30 smithi191 ceph-mon[31636]: pgmap v19503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36400.820312 secs 2024-04-21T20:31:32.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:32 smithi170 ceph-mon[31212]: pgmap v19504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:32 smithi077 ceph-mon[27902]: pgmap v19504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:32 smithi191 ceph-mon[31636]: pgmap v19504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:33.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36404.063935 secs 2024-04-21T20:31:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36404.063935 secs 2024-04-21T20:31:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36404.063935 secs 2024-04-21T20:31:34.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:34 smithi170 ceph-mon[31212]: pgmap v19505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:34 smithi077 ceph-mon[27902]: pgmap v19505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:34 smithi191 ceph-mon[31636]: pgmap v19505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:35.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36405.820432 secs 2024-04-21T20:31:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36405.820432 secs 2024-04-21T20:31:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36405.820432 secs 2024-04-21T20:31:36.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:36 smithi170 ceph-mon[31212]: pgmap v19506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:36.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:36 smithi077 ceph-mon[27902]: pgmap v19506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:36 smithi191 ceph-mon[31636]: pgmap v19506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:38.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:38 smithi170 ceph-mon[31212]: pgmap v19507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:38.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36409.064054 secs 2024-04-21T20:31:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:38 smithi077 ceph-mon[27902]: pgmap v19507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36409.064054 secs 2024-04-21T20:31:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:38 smithi191 ceph-mon[31636]: pgmap v19507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36409.064054 secs 2024-04-21T20:31:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:40.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:40 smithi170 ceph-mon[31212]: pgmap v19508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:40.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36410.820519 secs 2024-04-21T20:31:40.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:31:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:40 smithi077 ceph-mon[27902]: pgmap v19508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36410.820519 secs 2024-04-21T20:31:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:31:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:40 smithi191 ceph-mon[31636]: pgmap v19508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36410.820519 secs 2024-04-21T20:31:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:31:42.715 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:42 smithi191 ceph-mon[31636]: pgmap v19509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:42.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:42 smithi170 ceph-mon[31212]: pgmap v19509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:42 smithi077 ceph-mon[27902]: pgmap v19509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:43.723 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36414.064171 secs 2024-04-21T20:31:43.823 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36414.064171 secs 2024-04-21T20:31:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36414.064171 secs 2024-04-21T20:31:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: pgmap v19510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:31:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:31:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: pgmap v19510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:31:44.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:31:44.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: pgmap v19510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:31:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:31:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36415.820612 secs 2024-04-21T20:31:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36415.820612 secs 2024-04-21T20:31:46.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36415.820612 secs 2024-04-21T20:31:46.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:46 smithi077 ceph-mon[27902]: pgmap v19511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:46 smithi191 ceph-mon[31636]: pgmap v19511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:46 smithi170 ceph-mon[31212]: pgmap v19511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:48 smithi077 ceph-mon[27902]: pgmap v19512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36419.064291 secs 2024-04-21T20:31:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:48 smithi191 ceph-mon[31636]: pgmap v19512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36419.064291 secs 2024-04-21T20:31:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:48 smithi170 ceph-mon[31212]: pgmap v19512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36419.064291 secs 2024-04-21T20:31:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:50 smithi077 ceph-mon[27902]: pgmap v19513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36420.820707 secs 2024-04-21T20:31:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:50 smithi191 ceph-mon[31636]: pgmap v19513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36420.820707 secs 2024-04-21T20:31:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:50 smithi170 ceph-mon[31212]: pgmap v19513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36420.820707 secs 2024-04-21T20:31:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:52 smithi077 ceph-mon[27902]: pgmap v19514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:52.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:52 smithi191 ceph-mon[31636]: pgmap v19514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:52 smithi170 ceph-mon[31212]: pgmap v19514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36424.064425 secs 2024-04-21T20:31:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36424.064425 secs 2024-04-21T20:31:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36424.064425 secs 2024-04-21T20:31:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:54 smithi077 ceph-mon[27902]: pgmap v19515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:54 smithi191 ceph-mon[31636]: pgmap v19515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:54 smithi170 ceph-mon[31212]: pgmap v19515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:31:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36425.820840 secs 2024-04-21T20:31:55.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36425.820840 secs 2024-04-21T20:31:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36425.820840 secs 2024-04-21T20:31:56.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:56 smithi077 ceph-mon[27902]: pgmap v19516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:56 smithi191 ceph-mon[31636]: pgmap v19516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:56 smithi170 ceph-mon[31212]: pgmap v19516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:31:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:58 smithi077 ceph-mon[27902]: pgmap v19517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:31:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36429.064544 secs 2024-04-21T20:31:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:58 smithi191 ceph-mon[31636]: pgmap v19517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:31:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36429.064544 secs 2024-04-21T20:31:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:58 smithi170 ceph-mon[31212]: pgmap v19517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:31:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:31:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36429.064544 secs 2024-04-21T20:31:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:59.388+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:31:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:59.388+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:31:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:59.388+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:31:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:31:59.388+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:32:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:00 smithi077 ceph-mon[27902]: pgmap v19518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36430.820949 secs 2024-04-21T20:32:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:00 smithi191 ceph-mon[31636]: pgmap v19518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36430.820949 secs 2024-04-21T20:32:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:00 smithi170 ceph-mon[31212]: pgmap v19518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36430.820949 secs 2024-04-21T20:32:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:02 smithi077 ceph-mon[27902]: pgmap v19519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:02 smithi191 ceph-mon[31636]: pgmap v19519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:02 smithi170 ceph-mon[31212]: pgmap v19519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36434.064683 secs 2024-04-21T20:32:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36434.064683 secs 2024-04-21T20:32:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36434.064683 secs 2024-04-21T20:32:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:04 smithi077 ceph-mon[27902]: pgmap v19520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36435.821037 secs 2024-04-21T20:32:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:04 smithi191 ceph-mon[31636]: pgmap v19520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36435.821037 secs 2024-04-21T20:32:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:04 smithi170 ceph-mon[31212]: pgmap v19520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36435.821037 secs 2024-04-21T20:32:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:05.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:05 smithi077 ceph-mon[27902]: osdmap e1292: 12 total, 12 up, 12 in 2024-04-21T20:32:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:05 smithi191 ceph-mon[31636]: osdmap e1292: 12 total, 12 up, 12 in 2024-04-21T20:32:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:05 smithi170 ceph-mon[31212]: osdmap e1292: 12 total, 12 up, 12 in 2024-04-21T20:32:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:06 smithi191 ceph-mon[31636]: pgmap v19522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:06 smithi170 ceph-mon[31212]: pgmap v19522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:06 smithi077 ceph-mon[27902]: pgmap v19522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:08 smithi191 ceph-mon[31636]: pgmap v19523: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:32:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36439.064837 secs 2024-04-21T20:32:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:08 smithi170 ceph-mon[31212]: pgmap v19523: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:32:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36439.064837 secs 2024-04-21T20:32:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:08 smithi077 ceph-mon[27902]: pgmap v19523: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:32:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36439.064837 secs 2024-04-21T20:32:09.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36440.821153 secs 2024-04-21T20:32:10.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36440.821153 secs 2024-04-21T20:32:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36440.821153 secs 2024-04-21T20:32:10.963 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:10 smithi170 ceph-mon[31212]: pgmap v19524: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:32:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:10 smithi191 ceph-mon[31636]: pgmap v19524: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:32:11.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:10 smithi077 ceph-mon[27902]: pgmap v19524: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:32:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:12 smithi191 ceph-mon[31636]: pgmap v19525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:12 smithi170 ceph-mon[31212]: pgmap v19525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:12 smithi077 ceph-mon[27902]: pgmap v19525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36444.064899 secs 2024-04-21T20:32:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36444.064899 secs 2024-04-21T20:32:14.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36444.064899 secs 2024-04-21T20:32:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:14 smithi191 ceph-mon[31636]: pgmap v19526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36445.821267 secs 2024-04-21T20:32:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:14 smithi191 ceph-mon[31636]: osdmap e1293: 12 total, 12 up, 12 in 2024-04-21T20:32:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:14 smithi170 ceph-mon[31212]: pgmap v19526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36445.821267 secs 2024-04-21T20:32:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:14 smithi170 ceph-mon[31212]: osdmap e1293: 12 total, 12 up, 12 in 2024-04-21T20:32:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:14 smithi077 ceph-mon[27902]: pgmap v19526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36445.821267 secs 2024-04-21T20:32:15.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:14 smithi077 ceph-mon[27902]: osdmap e1293: 12 total, 12 up, 12 in 2024-04-21T20:32:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:16 smithi191 ceph-mon[31636]: pgmap v19528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:16 smithi170 ceph-mon[31212]: pgmap v19528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:16 smithi077 ceph-mon[27902]: pgmap v19528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:32:17.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:17 smithi191 ceph-mon[31636]: pgmap v19529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:32:18.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:17 smithi170 ceph-mon[31212]: pgmap v19529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:32:18.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:17 smithi077 ceph-mon[27902]: pgmap v19529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:32:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36449.064963 secs 2024-04-21T20:32:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36449.064963 secs 2024-04-21T20:32:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36449.064963 secs 2024-04-21T20:32:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:19 smithi191 ceph-mon[31636]: pgmap v19530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:32:19.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36450.821392 secs 2024-04-21T20:32:20.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:19 smithi170 ceph-mon[31212]: pgmap v19530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:32:20.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36450.821392 secs 2024-04-21T20:32:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:20.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:19 smithi077 ceph-mon[27902]: pgmap v19530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:32:20.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36450.821392 secs 2024-04-21T20:32:22.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:21 smithi170 ceph-mon[31212]: pgmap v19531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:22.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:21 smithi077 ceph-mon[27902]: pgmap v19531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:22.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:21 smithi191 ceph-mon[31636]: pgmap v19531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36454.065045 secs 2024-04-21T20:32:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:23 smithi170 ceph-mon[31212]: pgmap v19532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36454.065045 secs 2024-04-21T20:32:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:23 smithi077 ceph-mon[27902]: pgmap v19532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36454.065045 secs 2024-04-21T20:32:24.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:23 smithi191 ceph-mon[31636]: pgmap v19532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:32:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36455.821526 secs 2024-04-21T20:32:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36455.821526 secs 2024-04-21T20:32:25.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36455.821526 secs 2024-04-21T20:32:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:25 smithi170 ceph-mon[31212]: pgmap v19533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:32:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:25 smithi077 ceph-mon[27902]: pgmap v19533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:32:26.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:25 smithi191 ceph-mon[31636]: pgmap v19533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:32:28.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:27 smithi170 ceph-mon[31212]: pgmap v19534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:28.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:27 smithi077 ceph-mon[27902]: pgmap v19534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:28.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:27 smithi191 ceph-mon[31636]: pgmap v19534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36459.065166 secs 2024-04-21T20:32:29.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36459.065166 secs 2024-04-21T20:32:29.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36459.065166 secs 2024-04-21T20:32:30.042 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:29 smithi077 ceph-mon[27902]: pgmap v19535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:30.042 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36460.821641 secs 2024-04-21T20:32:30.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:29 smithi170 ceph-mon[31212]: pgmap v19535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:30.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36460.821641 secs 2024-04-21T20:32:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:29 smithi191 ceph-mon[31636]: pgmap v19535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:30.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36460.821641 secs 2024-04-21T20:32:32.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:31 smithi170 ceph-mon[31212]: pgmap v19536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:32.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:31 smithi077 ceph-mon[27902]: pgmap v19536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:32.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:31 smithi191 ceph-mon[31636]: pgmap v19536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36464.065286 secs 2024-04-21T20:32:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:33 smithi170 ceph-mon[31212]: pgmap v19537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36464.065286 secs 2024-04-21T20:32:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:33 smithi077 ceph-mon[27902]: pgmap v19537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:34.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36464.065286 secs 2024-04-21T20:32:34.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:33 smithi191 ceph-mon[31636]: pgmap v19537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36465.821770 secs 2024-04-21T20:32:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36465.821770 secs 2024-04-21T20:32:35.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36465.821770 secs 2024-04-21T20:32:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:35 smithi170 ceph-mon[31212]: pgmap v19538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:36.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:35 smithi077 ceph-mon[27902]: pgmap v19538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:36.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:35 smithi191 ceph-mon[31636]: pgmap v19538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:38.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:37 smithi170 ceph-mon[31212]: pgmap v19539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:38.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:37 smithi077 ceph-mon[27902]: pgmap v19539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:38.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:37 smithi191 ceph-mon[31636]: pgmap v19539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36469.065439 secs 2024-04-21T20:32:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36469.065439 secs 2024-04-21T20:32:39.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36469.065439 secs 2024-04-21T20:32:40.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:39 smithi170 ceph-mon[31212]: pgmap v19540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:40.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36470.821887 secs 2024-04-21T20:32:40.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:39 smithi191 ceph-mon[31636]: pgmap v19540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:40.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36470.821887 secs 2024-04-21T20:32:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:40.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:39 smithi077 ceph-mon[27902]: pgmap v19540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:40.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36470.821887 secs 2024-04-21T20:32:42.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:41 smithi170 ceph-mon[31212]: pgmap v19541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:42.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:41 smithi077 ceph-mon[27902]: pgmap v19541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:42.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:41 smithi191 ceph-mon[31636]: pgmap v19541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36474.065579 secs 2024-04-21T20:32:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:43 smithi170 ceph-mon[31212]: pgmap v19542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:44.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36474.065579 secs 2024-04-21T20:32:44.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:43 smithi077 ceph-mon[27902]: pgmap v19542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:44.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36474.065579 secs 2024-04-21T20:32:44.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:43 smithi191 ceph-mon[31636]: pgmap v19542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36475.822001 secs 2024-04-21T20:32:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:32:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36475.822001 secs 2024-04-21T20:32:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:32:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36475.822001 secs 2024-04-21T20:32:45.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:32:46.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:45 smithi170 ceph-mon[31212]: pgmap v19543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:32:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:32:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:32:46.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:45 smithi077 ceph-mon[27902]: pgmap v19543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:46.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:32:46.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:32:46.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:32:46.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:45 smithi191 ceph-mon[31636]: pgmap v19543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:46.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:32:46.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:32:46.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:32:48.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:47 smithi077 ceph-mon[27902]: pgmap v19544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:48.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:47 smithi191 ceph-mon[31636]: pgmap v19544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:48.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:47 smithi170 ceph-mon[31212]: pgmap v19544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36479.065707 secs 2024-04-21T20:32:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36479.065707 secs 2024-04-21T20:32:49.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36479.065707 secs 2024-04-21T20:32:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:49 smithi077 ceph-mon[27902]: pgmap v19545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36480.822147 secs 2024-04-21T20:32:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:49 smithi191 ceph-mon[31636]: pgmap v19545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36480.822147 secs 2024-04-21T20:32:50.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:49 smithi170 ceph-mon[31212]: pgmap v19545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:50.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36480.822147 secs 2024-04-21T20:32:52.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:51 smithi077 ceph-mon[27902]: pgmap v19546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:52.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:51 smithi191 ceph-mon[31636]: pgmap v19546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:52.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:51 smithi170 ceph-mon[31212]: pgmap v19546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36484.065846 secs 2024-04-21T20:32:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:53 smithi077 ceph-mon[27902]: pgmap v19547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:54.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36484.065846 secs 2024-04-21T20:32:54.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:53 smithi191 ceph-mon[31636]: pgmap v19547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:54.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36484.065846 secs 2024-04-21T20:32:54.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:53 smithi170 ceph-mon[31212]: pgmap v19547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:32:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36485.822280 secs 2024-04-21T20:32:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36485.822280 secs 2024-04-21T20:32:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36485.822280 secs 2024-04-21T20:32:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:55 smithi077 ceph-mon[27902]: pgmap v19548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:55 smithi191 ceph-mon[31636]: pgmap v19548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:56.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:55 smithi170 ceph-mon[31212]: pgmap v19548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:32:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:57 smithi077 ceph-mon[27902]: pgmap v19549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:57 smithi191 ceph-mon[31636]: pgmap v19549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:57 smithi170 ceph-mon[31212]: pgmap v19549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:32:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36489.065910 secs 2024-04-21T20:32:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36489.065910 secs 2024-04-21T20:32:59.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36489.065910 secs 2024-04-21T20:33:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:00.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:59 smithi077 ceph-mon[27902]: pgmap v19550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:00.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36490.822414 secs 2024-04-21T20:33:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:59 smithi191 ceph-mon[31636]: pgmap v19550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36490.822414 secs 2024-04-21T20:33:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:59 smithi170 ceph-mon[31212]: pgmap v19550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36490.822414 secs 2024-04-21T20:33:02.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:01 smithi077 ceph-mon[27902]: pgmap v19551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T20:33:02.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:01 smithi191 ceph-mon[31636]: pgmap v19551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T20:33:02.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:01 smithi170 ceph-mon[31212]: pgmap v19551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T20:33:04.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36494.066025 secs 2024-04-21T20:33:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:03 smithi077 ceph-mon[27902]: pgmap v19552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:33:04.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36494.066025 secs 2024-04-21T20:33:04.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:03 smithi191 ceph-mon[31636]: pgmap v19552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:33:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36494.066025 secs 2024-04-21T20:33:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:03 smithi170 ceph-mon[31212]: pgmap v19552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:33:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36495.822527 secs 2024-04-21T20:33:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36495.822527 secs 2024-04-21T20:33:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36495.822527 secs 2024-04-21T20:33:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:05 smithi077 ceph-mon[27902]: pgmap v19553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:33:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:05 smithi077 ceph-mon[27902]: osdmap e1294: 12 total, 12 up, 12 in 2024-04-21T20:33:06.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:05 smithi191 ceph-mon[31636]: pgmap v19553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:33:06.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:05 smithi191 ceph-mon[31636]: osdmap e1294: 12 total, 12 up, 12 in 2024-04-21T20:33:06.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:05 smithi170 ceph-mon[31212]: pgmap v19553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T20:33:06.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:05 smithi170 ceph-mon[31212]: osdmap e1294: 12 total, 12 up, 12 in 2024-04-21T20:33:08.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:07 smithi077 ceph-mon[27902]: pgmap v19555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:33:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:07 smithi191 ceph-mon[31636]: pgmap v19555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:33:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:07 smithi170 ceph-mon[31212]: pgmap v19555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:33:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36499.066123 secs 2024-04-21T20:33:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36499.066123 secs 2024-04-21T20:33:09.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36499.066123 secs 2024-04-21T20:33:10.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:09 smithi191 ceph-mon[31636]: pgmap v19556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:33:10.125 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36500.822640 secs 2024-04-21T20:33:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:09 smithi077 ceph-mon[27902]: pgmap v19556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:33:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36500.822640 secs 2024-04-21T20:33:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:09 smithi170 ceph-mon[31212]: pgmap v19556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:33:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36500.822640 secs 2024-04-21T20:33:12.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:11 smithi077 ceph-mon[27902]: pgmap v19557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:12.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:11 smithi191 ceph-mon[31636]: pgmap v19557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:12.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:11 smithi170 ceph-mon[31212]: pgmap v19557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:14.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36504.066253 secs 2024-04-21T20:33:14.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:13 smithi077 ceph-mon[27902]: pgmap v19558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:14.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36504.066253 secs 2024-04-21T20:33:14.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:13 smithi191 ceph-mon[31636]: pgmap v19558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:14.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36504.066253 secs 2024-04-21T20:33:14.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:13 smithi170 ceph-mon[31212]: pgmap v19558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36505.822760 secs 2024-04-21T20:33:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:15 smithi170 ceph-mon[31212]: osdmap e1295: 12 total, 12 up, 12 in 2024-04-21T20:33:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36505.822760 secs 2024-04-21T20:33:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:15 smithi077 ceph-mon[27902]: osdmap e1295: 12 total, 12 up, 12 in 2024-04-21T20:33:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36505.822760 secs 2024-04-21T20:33:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:15 smithi191 ceph-mon[31636]: osdmap e1295: 12 total, 12 up, 12 in 2024-04-21T20:33:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:16 smithi170 ceph-mon[31212]: pgmap v19560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:16 smithi077 ceph-mon[27902]: pgmap v19560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:16 smithi191 ceph-mon[31636]: pgmap v19560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-04-21T20:33:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:18 smithi170 ceph-mon[31212]: pgmap v19561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:33:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36509.066373 secs 2024-04-21T20:33:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:18 smithi077 ceph-mon[27902]: pgmap v19561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:33:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36509.066373 secs 2024-04-21T20:33:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:18 smithi191 ceph-mon[31636]: pgmap v19561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:33:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36509.066373 secs 2024-04-21T20:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:20 smithi170 ceph-mon[31212]: pgmap v19562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:33:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36510.822887 secs 2024-04-21T20:33:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:20 smithi077 ceph-mon[27902]: pgmap v19562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:33:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36510.822887 secs 2024-04-21T20:33:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:20 smithi191 ceph-mon[31636]: pgmap v19562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:33:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36510.822887 secs 2024-04-21T20:33:22.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:22 smithi170 ceph-mon[31212]: pgmap v19563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:33:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:22 smithi077 ceph-mon[27902]: pgmap v19563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:33:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:22 smithi191 ceph-mon[31636]: pgmap v19563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:33:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36514.066525 secs 2024-04-21T20:33:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36514.066525 secs 2024-04-21T20:33:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36514.066525 secs 2024-04-21T20:33:24.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:24 smithi170 ceph-mon[31212]: pgmap v19564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:33:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:24 smithi077 ceph-mon[27902]: pgmap v19564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:33:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:24 smithi191 ceph-mon[31636]: pgmap v19564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:33:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:25.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36515.823035 secs 2024-04-21T20:33:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36515.823035 secs 2024-04-21T20:33:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36515.823035 secs 2024-04-21T20:33:26.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:26 smithi170 ceph-mon[31212]: pgmap v19565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:33:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:26 smithi077 ceph-mon[27902]: pgmap v19565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:33:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:26 smithi191 ceph-mon[31636]: pgmap v19565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:33:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:28 smithi170 ceph-mon[31212]: pgmap v19566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:28.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36519.066638 secs 2024-04-21T20:33:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:28 smithi077 ceph-mon[27902]: pgmap v19566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36519.066638 secs 2024-04-21T20:33:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:28 smithi191 ceph-mon[31636]: pgmap v19566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36519.066638 secs 2024-04-21T20:33:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:30 smithi170 ceph-mon[31212]: pgmap v19567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:30.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36520.823155 secs 2024-04-21T20:33:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:30 smithi077 ceph-mon[27902]: pgmap v19567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36520.823155 secs 2024-04-21T20:33:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:30 smithi191 ceph-mon[31636]: pgmap v19567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36520.823155 secs 2024-04-21T20:33:32.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:32 smithi170 ceph-mon[31212]: pgmap v19568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:32 smithi077 ceph-mon[27902]: pgmap v19568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:32 smithi191 ceph-mon[31636]: pgmap v19568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:33.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36524.066795 secs 2024-04-21T20:33:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36524.066795 secs 2024-04-21T20:33:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36524.066795 secs 2024-04-21T20:33:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:34 smithi077 ceph-mon[27902]: pgmap v19569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:34 smithi191 ceph-mon[31636]: pgmap v19569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:34 smithi170 ceph-mon[31212]: pgmap v19569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36525.823279 secs 2024-04-21T20:33:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36525.823279 secs 2024-04-21T20:33:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36525.823279 secs 2024-04-21T20:33:36.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:36 smithi077 ceph-mon[27902]: pgmap v19570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:36 smithi191 ceph-mon[31636]: pgmap v19570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:36 smithi170 ceph-mon[31212]: pgmap v19570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:38 smithi077 ceph-mon[27902]: pgmap v19571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36529.066908 secs 2024-04-21T20:33:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:38 smithi191 ceph-mon[31636]: pgmap v19571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36529.066908 secs 2024-04-21T20:33:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:38 smithi170 ceph-mon[31212]: pgmap v19571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36529.066908 secs 2024-04-21T20:33:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:40 smithi077 ceph-mon[27902]: pgmap v19572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36530.823397 secs 2024-04-21T20:33:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:40 smithi191 ceph-mon[31636]: pgmap v19572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36530.823397 secs 2024-04-21T20:33:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:40 smithi170 ceph-mon[31212]: pgmap v19572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36530.823397 secs 2024-04-21T20:33:42.864 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:42 smithi170 ceph-mon[31212]: pgmap v19573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:42 smithi077 ceph-mon[27902]: pgmap v19573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:42 smithi191 ceph-mon[31636]: pgmap v19573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36534.067018 secs 2024-04-21T20:33:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36534.067018 secs 2024-04-21T20:33:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36534.067018 secs 2024-04-21T20:33:44.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:44 smithi077 ceph-mon[27902]: pgmap v19574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:44 smithi191 ceph-mon[31636]: pgmap v19574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:44 smithi170 ceph-mon[31212]: pgmap v19574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36535.823512 secs 2024-04-21T20:33:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:33:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36535.823512 secs 2024-04-21T20:33:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:33:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36535.823512 secs 2024-04-21T20:33:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:33:46.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:46 smithi077 ceph-mon[27902]: pgmap v19575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:46.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:33:46.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:33:46.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:33:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:46 smithi191 ceph-mon[31636]: pgmap v19575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:33:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:33:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:33:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:46 smithi170 ceph-mon[31212]: pgmap v19575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:33:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:33:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:33:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:48 smithi077 ceph-mon[27902]: pgmap v19576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36539.067142 secs 2024-04-21T20:33:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:48 smithi191 ceph-mon[31636]: pgmap v19576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36539.067142 secs 2024-04-21T20:33:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:48 smithi170 ceph-mon[31212]: pgmap v19576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36539.067142 secs 2024-04-21T20:33:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:50.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:50 smithi077 ceph-mon[27902]: pgmap v19577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36540.823631 secs 2024-04-21T20:33:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:50 smithi191 ceph-mon[31636]: pgmap v19577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36540.823631 secs 2024-04-21T20:33:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:50 smithi170 ceph-mon[31212]: pgmap v19577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36540.823631 secs 2024-04-21T20:33:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:52 smithi077 ceph-mon[27902]: pgmap v19578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:52 smithi191 ceph-mon[31636]: pgmap v19578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:52 smithi170 ceph-mon[31212]: pgmap v19578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:53.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36544.067281 secs 2024-04-21T20:33:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36544.067281 secs 2024-04-21T20:33:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36544.067281 secs 2024-04-21T20:33:54.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:54 smithi077 ceph-mon[27902]: pgmap v19579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:54 smithi191 ceph-mon[31636]: pgmap v19579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:54 smithi170 ceph-mon[31212]: pgmap v19579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:33:55.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36545.823743 secs 2024-04-21T20:33:55.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36545.823743 secs 2024-04-21T20:33:56.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36545.823743 secs 2024-04-21T20:33:56.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:56 smithi077 ceph-mon[27902]: pgmap v19580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:56 smithi191 ceph-mon[31636]: pgmap v19580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:57.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:56 smithi170 ceph-mon[31212]: pgmap v19580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:33:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:58 smithi077 ceph-mon[27902]: pgmap v19581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:58.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:33:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36549.067382 secs 2024-04-21T20:33:58.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:58 smithi191 ceph-mon[31636]: pgmap v19581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:33:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36549.067382 secs 2024-04-21T20:33:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:58 smithi170 ceph-mon[31212]: pgmap v19581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:33:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:33:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36549.067382 secs 2024-04-21T20:34:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:00 smithi077 ceph-mon[27902]: pgmap v19582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:00.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36550.823871 secs 2024-04-21T20:34:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:00 smithi191 ceph-mon[31636]: pgmap v19582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36550.823871 secs 2024-04-21T20:34:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:00 smithi170 ceph-mon[31212]: pgmap v19582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36550.823871 secs 2024-04-21T20:34:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:02 smithi077 ceph-mon[27902]: pgmap v19583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T20:34:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:02 smithi191 ceph-mon[31636]: pgmap v19583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T20:34:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:02 smithi170 ceph-mon[31212]: pgmap v19583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-21T20:34:03.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36554.067499 secs 2024-04-21T20:34:03.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36554.067499 secs 2024-04-21T20:34:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36554.067499 secs 2024-04-21T20:34:04.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:04 smithi077 ceph-mon[27902]: pgmap v19584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-21T20:34:04.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:04 smithi191 ceph-mon[31636]: pgmap v19584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-21T20:34:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:04 smithi170 ceph-mon[31212]: pgmap v19584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-21T20:34:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36555.823971 secs 2024-04-21T20:34:05.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:05 smithi191 ceph-mon[31636]: osdmap e1296: 12 total, 12 up, 12 in 2024-04-21T20:34:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36555.823971 secs 2024-04-21T20:34:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:05 smithi170 ceph-mon[31212]: osdmap e1296: 12 total, 12 up, 12 in 2024-04-21T20:34:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36555.823971 secs 2024-04-21T20:34:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:05 smithi077 ceph-mon[27902]: osdmap e1296: 12 total, 12 up, 12 in 2024-04-21T20:34:06.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:06 smithi191 ceph-mon[31636]: pgmap v19586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T20:34:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:06 smithi170 ceph-mon[31212]: pgmap v19586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T20:34:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:06 smithi077 ceph-mon[27902]: pgmap v19586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-21T20:34:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:08 smithi191 ceph-mon[31636]: pgmap v19587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:34:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36559.067627 secs 2024-04-21T20:34:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:08 smithi170 ceph-mon[31212]: pgmap v19587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:34:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36559.067627 secs 2024-04-21T20:34:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:08 smithi077 ceph-mon[27902]: pgmap v19587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:34:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36559.067627 secs 2024-04-21T20:34:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:10.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:10 smithi191 ceph-mon[31636]: pgmap v19588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:34:10.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36560.824092 secs 2024-04-21T20:34:10.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:10 smithi191 ceph-mon[31636]: osdmap e1297: 12 total, 12 up, 12 in 2024-04-21T20:34:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:10 smithi170 ceph-mon[31212]: pgmap v19588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:34:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36560.824092 secs 2024-04-21T20:34:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:10 smithi170 ceph-mon[31212]: osdmap e1297: 12 total, 12 up, 12 in 2024-04-21T20:34:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:10 smithi077 ceph-mon[27902]: pgmap v19588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:34:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36560.824092 secs 2024-04-21T20:34:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:10 smithi077 ceph-mon[27902]: osdmap e1297: 12 total, 12 up, 12 in 2024-04-21T20:34:12.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:12 smithi170 ceph-mon[31212]: pgmap v19590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:34:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:12 smithi077 ceph-mon[27902]: pgmap v19590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:34:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:12 smithi191 ceph-mon[31636]: pgmap v19590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 67 KiB/s wr, 32 op/s 2024-04-21T20:34:13.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36564.067770 secs 2024-04-21T20:34:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36564.067770 secs 2024-04-21T20:34:13.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36564.067770 secs 2024-04-21T20:34:14.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:14 smithi170 ceph-mon[31212]: pgmap v19591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 32 op/s 2024-04-21T20:34:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:14 smithi077 ceph-mon[27902]: pgmap v19591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 32 op/s 2024-04-21T20:34:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:14 smithi191 ceph-mon[31636]: pgmap v19591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 66 KiB/s wr, 32 op/s 2024-04-21T20:34:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36565.824200 secs 2024-04-21T20:34:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36565.824200 secs 2024-04-21T20:34:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36565.824200 secs 2024-04-21T20:34:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:16 smithi170 ceph-mon[31212]: pgmap v19592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T20:34:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:16 smithi077 ceph-mon[27902]: pgmap v19592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T20:34:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:16 smithi191 ceph-mon[31636]: pgmap v19592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-04-21T20:34:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:18 smithi170 ceph-mon[31212]: pgmap v19593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:34:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36569.067879 secs 2024-04-21T20:34:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:18 smithi077 ceph-mon[27902]: pgmap v19593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:34:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36569.067879 secs 2024-04-21T20:34:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:18 smithi191 ceph-mon[31636]: pgmap v19593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:34:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36569.067879 secs 2024-04-21T20:34:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:20 smithi170 ceph-mon[31212]: pgmap v19594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:34:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36570.824315 secs 2024-04-21T20:34:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:20 smithi077 ceph-mon[27902]: pgmap v19594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:34:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36570.824315 secs 2024-04-21T20:34:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:20 smithi191 ceph-mon[31636]: pgmap v19594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:34:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36570.824315 secs 2024-04-21T20:34:22.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:22 smithi170 ceph-mon[31212]: pgmap v19595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:34:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:22 smithi077 ceph-mon[27902]: pgmap v19595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:34:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:22 smithi191 ceph-mon[31636]: pgmap v19595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:34:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36574.067998 secs 2024-04-21T20:34:23.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36574.067998 secs 2024-04-21T20:34:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36574.067998 secs 2024-04-21T20:34:24.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:24 smithi170 ceph-mon[31212]: pgmap v19596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:24 smithi077 ceph-mon[27902]: pgmap v19596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:24 smithi191 ceph-mon[31636]: pgmap v19596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36575.824372 secs 2024-04-21T20:34:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36575.824372 secs 2024-04-21T20:34:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36575.824372 secs 2024-04-21T20:34:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:26 smithi077 ceph-mon[27902]: pgmap v19597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:26 smithi191 ceph-mon[31636]: pgmap v19597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:26 smithi170 ceph-mon[31212]: pgmap v19597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:28 smithi077 ceph-mon[27902]: pgmap v19598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36579.068116 secs 2024-04-21T20:34:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:28 smithi191 ceph-mon[31636]: pgmap v19598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36579.068116 secs 2024-04-21T20:34:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:28 smithi170 ceph-mon[31212]: pgmap v19598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36579.068116 secs 2024-04-21T20:34:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:30 smithi077 ceph-mon[27902]: pgmap v19599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36580.824484 secs 2024-04-21T20:34:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:30 smithi191 ceph-mon[31636]: pgmap v19599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36580.824484 secs 2024-04-21T20:34:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:30 smithi170 ceph-mon[31212]: pgmap v19599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36580.824484 secs 2024-04-21T20:34:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:32 smithi077 ceph-mon[27902]: pgmap v19600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:32 smithi191 ceph-mon[31636]: pgmap v19600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:32 smithi170 ceph-mon[31212]: pgmap v19600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36584.068236 secs 2024-04-21T20:34:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36584.068236 secs 2024-04-21T20:34:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36584.068236 secs 2024-04-21T20:34:34.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:34 smithi077 ceph-mon[27902]: pgmap v19601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:34 smithi191 ceph-mon[31636]: pgmap v19601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:34 smithi170 ceph-mon[31212]: pgmap v19601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36585.824617 secs 2024-04-21T20:34:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36585.824617 secs 2024-04-21T20:34:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36585.824617 secs 2024-04-21T20:34:36.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:36 smithi077 ceph-mon[27902]: pgmap v19602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:36.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:36 smithi191 ceph-mon[31636]: pgmap v19602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:36 smithi170 ceph-mon[31212]: pgmap v19602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:38 smithi077 ceph-mon[27902]: pgmap v19603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36589.068359 secs 2024-04-21T20:34:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:38 smithi191 ceph-mon[31636]: pgmap v19603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36589.068359 secs 2024-04-21T20:34:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:38 smithi170 ceph-mon[31212]: pgmap v19603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36589.068359 secs 2024-04-21T20:34:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:40 smithi077 ceph-mon[27902]: pgmap v19604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:40.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36590.824742 secs 2024-04-21T20:34:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:40 smithi191 ceph-mon[31636]: pgmap v19604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36590.824742 secs 2024-04-21T20:34:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:40 smithi170 ceph-mon[31212]: pgmap v19604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36590.824742 secs 2024-04-21T20:34:42.864 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:42 smithi170 ceph-mon[31212]: pgmap v19605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:42 smithi077 ceph-mon[27902]: pgmap v19605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:42 smithi191 ceph-mon[31636]: pgmap v19605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:43.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36594.068482 secs 2024-04-21T20:34:43.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36594.068482 secs 2024-04-21T20:34:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36594.068482 secs 2024-04-21T20:34:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:44 smithi077 ceph-mon[27902]: pgmap v19606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:44 smithi191 ceph-mon[31636]: pgmap v19606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:44 smithi170 ceph-mon[31212]: pgmap v19606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:45.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36595.824871 secs 2024-04-21T20:34:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36595.824871 secs 2024-04-21T20:34:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36595.824871 secs 2024-04-21T20:34:46.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:46 smithi170 ceph-mon[31212]: pgmap v19607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:46.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:34:46.877 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:46 smithi077 ceph-mon[27902]: pgmap v19607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:46.878 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:34:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:46 smithi191 ceph-mon[31636]: pgmap v19607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:34:48.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: pgmap v19608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36599.068540 secs 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: pgmap v19608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36599.068540 secs 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: pgmap v19608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36599.068540 secs 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: pgmap v19609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36600.824944 secs 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:34:50.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: pgmap v19609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36600.824944 secs 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:34:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:34:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:34:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:34:50.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: pgmap v19609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:34:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:34:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36600.824944 secs 2024-04-21T20:34:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:50.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:34:50.315 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:34:52.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:51 smithi077 ceph-mon[27902]: pgmap v19610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:52.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:51 smithi191 ceph-mon[31636]: pgmap v19610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:52.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:51 smithi170 ceph-mon[31212]: pgmap v19610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36604.068682 secs 2024-04-21T20:34:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:53 smithi077 ceph-mon[27902]: pgmap v19611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:54.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36604.068682 secs 2024-04-21T20:34:54.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:53 smithi191 ceph-mon[31636]: pgmap v19611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:54.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36604.068682 secs 2024-04-21T20:34:54.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:53 smithi170 ceph-mon[31212]: pgmap v19611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:34:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36605.825071 secs 2024-04-21T20:34:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36605.825071 secs 2024-04-21T20:34:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36605.825071 secs 2024-04-21T20:34:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:55 smithi077 ceph-mon[27902]: pgmap v19612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:55 smithi191 ceph-mon[31636]: pgmap v19612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:56.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:55 smithi170 ceph-mon[31212]: pgmap v19612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:34:58.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:57 smithi077 ceph-mon[27902]: pgmap v19613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:57 smithi191 ceph-mon[31636]: pgmap v19613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:57 smithi170 ceph-mon[31212]: pgmap v19613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:34:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36609.068842 secs 2024-04-21T20:34:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36609.068842 secs 2024-04-21T20:34:59.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36609.068842 secs 2024-04-21T20:34:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:34:59.413+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:34:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:34:59.413+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:34:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:34:59.413+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:34:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:34:59.413+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:35:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:00.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:59 smithi077 ceph-mon[27902]: pgmap v19614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:00.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36610.825187 secs 2024-04-21T20:35:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:59 smithi191 ceph-mon[31636]: pgmap v19614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36610.825187 secs 2024-04-21T20:35:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:59 smithi170 ceph-mon[31212]: pgmap v19614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36610.825187 secs 2024-04-21T20:35:02.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:01 smithi077 ceph-mon[27902]: pgmap v19615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:02.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:01 smithi191 ceph-mon[31636]: pgmap v19615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:02.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:01 smithi170 ceph-mon[31212]: pgmap v19615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36614.068983 secs 2024-04-21T20:35:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:03 smithi077 ceph-mon[27902]: pgmap v19616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:04.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36614.068983 secs 2024-04-21T20:35:04.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:03 smithi191 ceph-mon[31636]: pgmap v19616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36614.068983 secs 2024-04-21T20:35:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:03 smithi170 ceph-mon[31212]: pgmap v19616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36615.825296 secs 2024-04-21T20:35:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36615.825296 secs 2024-04-21T20:35:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36615.825296 secs 2024-04-21T20:35:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:05 smithi077 ceph-mon[27902]: pgmap v19617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:05 smithi077 ceph-mon[27902]: osdmap e1298: 12 total, 12 up, 12 in 2024-04-21T20:35:06.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:05 smithi191 ceph-mon[31636]: pgmap v19617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:05 smithi191 ceph-mon[31636]: osdmap e1298: 12 total, 12 up, 12 in 2024-04-21T20:35:06.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:05 smithi170 ceph-mon[31212]: pgmap v19617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:06.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:05 smithi170 ceph-mon[31212]: osdmap e1298: 12 total, 12 up, 12 in 2024-04-21T20:35:08.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:07 smithi077 ceph-mon[27902]: pgmap v19619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:07 smithi191 ceph-mon[31636]: pgmap v19619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:07 smithi170 ceph-mon[31212]: pgmap v19619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36619.069117 secs 2024-04-21T20:35:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36619.069117 secs 2024-04-21T20:35:09.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36619.069117 secs 2024-04-21T20:35:10.135 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:09 smithi191 ceph-mon[31636]: pgmap v19620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:10.135 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36620.825408 secs 2024-04-21T20:35:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:09 smithi077 ceph-mon[27902]: pgmap v19620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:10.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36620.825408 secs 2024-04-21T20:35:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:09 smithi170 ceph-mon[31212]: pgmap v19620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36620.825408 secs 2024-04-21T20:35:12.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:11 smithi077 ceph-mon[27902]: pgmap v19621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:12.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:11 smithi191 ceph-mon[31636]: pgmap v19621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:12.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:11 smithi170 ceph-mon[31212]: pgmap v19621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:14.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36624.069186 secs 2024-04-21T20:35:14.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:13 smithi077 ceph-mon[27902]: pgmap v19622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:14.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36624.069186 secs 2024-04-21T20:35:14.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:13 smithi191 ceph-mon[31636]: pgmap v19622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:14.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36624.069186 secs 2024-04-21T20:35:14.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:13 smithi170 ceph-mon[31212]: pgmap v19622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:35:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36625.825524 secs 2024-04-21T20:35:15.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:15 smithi170 ceph-mon[31212]: osdmap e1299: 12 total, 12 up, 12 in 2024-04-21T20:35:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36625.825524 secs 2024-04-21T20:35:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:15 smithi077 ceph-mon[27902]: osdmap e1299: 12 total, 12 up, 12 in 2024-04-21T20:35:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36625.825524 secs 2024-04-21T20:35:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:15 smithi191 ceph-mon[31636]: osdmap e1299: 12 total, 12 up, 12 in 2024-04-21T20:35:16.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:16 smithi170 ceph-mon[31212]: pgmap v19624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:35:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:16 smithi077 ceph-mon[27902]: pgmap v19624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:35:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:16 smithi191 ceph-mon[31636]: pgmap v19624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:35:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:18 smithi170 ceph-mon[31212]: pgmap v19625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:35:18.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36629.069252 secs 2024-04-21T20:35:18.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:18 smithi077 ceph-mon[27902]: pgmap v19625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:35:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36629.069252 secs 2024-04-21T20:35:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:18 smithi191 ceph-mon[31636]: pgmap v19625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:35:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36629.069252 secs 2024-04-21T20:35:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:20 smithi170 ceph-mon[31212]: pgmap v19626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:35:20.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36630.825645 secs 2024-04-21T20:35:20.825 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:20 smithi191 ceph-mon[31636]: pgmap v19626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:35:20.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36630.825645 secs 2024-04-21T20:35:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:20 smithi077 ceph-mon[27902]: pgmap v19626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:35:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36630.825645 secs 2024-04-21T20:35:22.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:22 smithi170 ceph-mon[31212]: pgmap v19627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:35:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:22 smithi077 ceph-mon[27902]: pgmap v19627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:35:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:22 smithi191 ceph-mon[31636]: pgmap v19627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:35:23.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36634.069373 secs 2024-04-21T20:35:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36634.069373 secs 2024-04-21T20:35:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36634.069373 secs 2024-04-21T20:35:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:24 smithi077 ceph-mon[27902]: pgmap v19628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:35:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:24 smithi191 ceph-mon[31636]: pgmap v19628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:35:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:24 smithi170 ceph-mon[31212]: pgmap v19628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:35:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:25.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36635.825776 secs 2024-04-21T20:35:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36635.825776 secs 2024-04-21T20:35:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36635.825776 secs 2024-04-21T20:35:26.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:26 smithi077 ceph-mon[27902]: pgmap v19629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T20:35:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:26 smithi191 ceph-mon[31636]: pgmap v19629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T20:35:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:26 smithi170 ceph-mon[31212]: pgmap v19629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T20:35:28.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:28 smithi077 ceph-mon[27902]: pgmap v19630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36639.069503 secs 2024-04-21T20:35:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:28 smithi191 ceph-mon[31636]: pgmap v19630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36639.069503 secs 2024-04-21T20:35:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:28 smithi170 ceph-mon[31212]: pgmap v19630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36639.069503 secs 2024-04-21T20:35:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:30.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:30 smithi077 ceph-mon[27902]: pgmap v19631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36640.825905 secs 2024-04-21T20:35:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:30 smithi191 ceph-mon[31636]: pgmap v19631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36640.825905 secs 2024-04-21T20:35:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:30 smithi170 ceph-mon[31212]: pgmap v19631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:35:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36640.825905 secs 2024-04-21T20:35:32.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:32 smithi077 ceph-mon[27902]: pgmap v19632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:32.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:32 smithi191 ceph-mon[31636]: pgmap v19632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:32 smithi170 ceph-mon[31212]: pgmap v19632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:33.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36644.069653 secs 2024-04-21T20:35:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36644.069653 secs 2024-04-21T20:35:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36644.069653 secs 2024-04-21T20:35:34.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:34 smithi077 ceph-mon[27902]: pgmap v19633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:34 smithi191 ceph-mon[31636]: pgmap v19633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:34 smithi170 ceph-mon[31212]: pgmap v19633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36645.826019 secs 2024-04-21T20:35:35.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36645.826019 secs 2024-04-21T20:35:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36645.826019 secs 2024-04-21T20:35:36.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:36 smithi077 ceph-mon[27902]: pgmap v19634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:36 smithi191 ceph-mon[31636]: pgmap v19634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:36 smithi170 ceph-mon[31212]: pgmap v19634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:38.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:38 smithi077 ceph-mon[27902]: pgmap v19635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36649.069794 secs 2024-04-21T20:35:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:38 smithi191 ceph-mon[31636]: pgmap v19635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36649.069794 secs 2024-04-21T20:35:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:38 smithi170 ceph-mon[31212]: pgmap v19635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36649.069794 secs 2024-04-21T20:35:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:40 smithi077 ceph-mon[27902]: pgmap v19636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36650.826139 secs 2024-04-21T20:35:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:40 smithi191 ceph-mon[31636]: pgmap v19636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36650.826139 secs 2024-04-21T20:35:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:40 smithi170 ceph-mon[31212]: pgmap v19636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36650.826139 secs 2024-04-21T20:35:42.864 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:42 smithi170 ceph-mon[31212]: pgmap v19637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:42 smithi077 ceph-mon[27902]: pgmap v19637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:42 smithi191 ceph-mon[31636]: pgmap v19637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:43.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36654.069899 secs 2024-04-21T20:35:43.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36654.069899 secs 2024-04-21T20:35:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36654.069899 secs 2024-04-21T20:35:44.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:44 smithi077 ceph-mon[27902]: pgmap v19638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:44 smithi191 ceph-mon[31636]: pgmap v19638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:44 smithi170 ceph-mon[31212]: pgmap v19638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:45.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36655.826207 secs 2024-04-21T20:35:45.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36655.826207 secs 2024-04-21T20:35:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36655.826207 secs 2024-04-21T20:35:46.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:46 smithi077 ceph-mon[27902]: pgmap v19639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:46 smithi191 ceph-mon[31636]: pgmap v19639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:46 smithi170 ceph-mon[31212]: pgmap v19639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:48 smithi077 ceph-mon[27902]: pgmap v19640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:48.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36659.070016 secs 2024-04-21T20:35:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:48 smithi191 ceph-mon[31636]: pgmap v19640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36659.070016 secs 2024-04-21T20:35:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:48 smithi170 ceph-mon[31212]: pgmap v19640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36659.070016 secs 2024-04-21T20:35:49.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:35:49.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:35:50.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:35:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: pgmap v19641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36660.826323 secs 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:35:50.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: pgmap v19641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36660.826323 secs 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:35:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: pgmap v19641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36660.826323 secs 2024-04-21T20:35:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:35:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:35:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:35:52.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:52 smithi077 ceph-mon[27902]: pgmap v19642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:52 smithi191 ceph-mon[31636]: pgmap v19642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:52 smithi170 ceph-mon[31212]: pgmap v19642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:53.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36664.070112 secs 2024-04-21T20:35:53.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36664.070112 secs 2024-04-21T20:35:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36664.070112 secs 2024-04-21T20:35:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:54 smithi191 ceph-mon[31636]: pgmap v19643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:54 smithi170 ceph-mon[31212]: pgmap v19643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:35:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:54 smithi077 ceph-mon[27902]: pgmap v19643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:55.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36665.826400 secs 2024-04-21T20:35:56.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36665.826400 secs 2024-04-21T20:35:56.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36665.826400 secs 2024-04-21T20:35:56.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:56 smithi191 ceph-mon[31636]: pgmap v19644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:57.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:56 smithi170 ceph-mon[31212]: pgmap v19644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:57.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:56 smithi077 ceph-mon[27902]: pgmap v19644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:35:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:58 smithi191 ceph-mon[31636]: pgmap v19645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:35:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36669.070243 secs 2024-04-21T20:35:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:58 smithi170 ceph-mon[31212]: pgmap v19645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:35:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36669.070243 secs 2024-04-21T20:35:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:58 smithi077 ceph-mon[27902]: pgmap v19645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:35:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:35:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36669.070243 secs 2024-04-21T20:36:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:00.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:00 smithi077 ceph-mon[27902]: pgmap v19646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:00.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36670.826537 secs 2024-04-21T20:36:00.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:00 smithi191 ceph-mon[31636]: pgmap v19646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:00.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36670.826537 secs 2024-04-21T20:36:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:00 smithi170 ceph-mon[31212]: pgmap v19646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36670.826537 secs 2024-04-21T20:36:02.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:02 smithi191 ceph-mon[31636]: pgmap v19647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:02 smithi170 ceph-mon[31212]: pgmap v19647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:03.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:02 smithi077 ceph-mon[27902]: pgmap v19647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:03.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36674.070363 secs 2024-04-21T20:36:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36674.070363 secs 2024-04-21T20:36:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36674.070363 secs 2024-04-21T20:36:04.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:04 smithi191 ceph-mon[31636]: pgmap v19648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:04.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36675.826652 secs 2024-04-21T20:36:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:04 smithi170 ceph-mon[31212]: pgmap v19648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36675.826652 secs 2024-04-21T20:36:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:04 smithi077 ceph-mon[27902]: pgmap v19648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36675.826652 secs 2024-04-21T20:36:05.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:05 smithi191 ceph-mon[31636]: osdmap e1300: 12 total, 12 up, 12 in 2024-04-21T20:36:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:05 smithi170 ceph-mon[31212]: osdmap e1300: 12 total, 12 up, 12 in 2024-04-21T20:36:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:05 smithi077 ceph-mon[27902]: osdmap e1300: 12 total, 12 up, 12 in 2024-04-21T20:36:06.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:06 smithi191 ceph-mon[31636]: pgmap v19650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:36:07.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:06 smithi170 ceph-mon[31212]: pgmap v19650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:36:07.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:06 smithi077 ceph-mon[27902]: pgmap v19650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:36:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:08 smithi191 ceph-mon[31636]: pgmap v19651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:36:08.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36679.070482 secs 2024-04-21T20:36:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:08 smithi170 ceph-mon[31212]: pgmap v19651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:36:09.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36679.070482 secs 2024-04-21T20:36:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:08 smithi077 ceph-mon[27902]: pgmap v19651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:36:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36679.070482 secs 2024-04-21T20:36:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:10 smithi170 ceph-mon[31212]: pgmap v19652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:36:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36680.826785 secs 2024-04-21T20:36:10.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:10 smithi170 ceph-mon[31212]: osdmap e1301: 12 total, 12 up, 12 in 2024-04-21T20:36:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:10 smithi077 ceph-mon[27902]: pgmap v19652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:36:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36680.826785 secs 2024-04-21T20:36:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:10 smithi077 ceph-mon[27902]: osdmap e1301: 12 total, 12 up, 12 in 2024-04-21T20:36:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:10 smithi191 ceph-mon[31636]: pgmap v19652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:36:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36680.826785 secs 2024-04-21T20:36:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:10 smithi191 ceph-mon[31636]: osdmap e1301: 12 total, 12 up, 12 in 2024-04-21T20:36:12.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:12 smithi170 ceph-mon[31212]: pgmap v19654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:36:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:12 smithi077 ceph-mon[27902]: pgmap v19654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:36:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:12 smithi191 ceph-mon[31636]: pgmap v19654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:36:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36684.070595 secs 2024-04-21T20:36:13.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36684.070595 secs 2024-04-21T20:36:14.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36684.070595 secs 2024-04-21T20:36:14.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:14 smithi077 ceph-mon[27902]: pgmap v19655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:36:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:14 smithi191 ceph-mon[31636]: pgmap v19655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:36:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:14 smithi170 ceph-mon[31212]: pgmap v19655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:36:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36685.826900 secs 2024-04-21T20:36:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36685.826900 secs 2024-04-21T20:36:16.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36685.826900 secs 2024-04-21T20:36:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:16 smithi077 ceph-mon[27902]: pgmap v19656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:36:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:16 smithi191 ceph-mon[31636]: pgmap v19656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:36:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:16 smithi170 ceph-mon[31212]: pgmap v19656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:36:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:18 smithi077 ceph-mon[27902]: pgmap v19657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:36:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36689.070728 secs 2024-04-21T20:36:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:18 smithi191 ceph-mon[31636]: pgmap v19657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:36:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36689.070728 secs 2024-04-21T20:36:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:18 smithi170 ceph-mon[31212]: pgmap v19657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:36:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36689.070728 secs 2024-04-21T20:36:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:20 smithi077 ceph-mon[27902]: pgmap v19658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:36:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36690.827043 secs 2024-04-21T20:36:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:20 smithi191 ceph-mon[31636]: pgmap v19658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:36:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36690.827043 secs 2024-04-21T20:36:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:20 smithi170 ceph-mon[31212]: pgmap v19658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:36:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36690.827043 secs 2024-04-21T20:36:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:22 smithi077 ceph-mon[27902]: pgmap v19659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:36:22.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:22 smithi191 ceph-mon[31636]: pgmap v19659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:36:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:22 smithi170 ceph-mon[31212]: pgmap v19659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:36:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36694.070843 secs 2024-04-21T20:36:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36694.070843 secs 2024-04-21T20:36:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36694.070843 secs 2024-04-21T20:36:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:24 smithi077 ceph-mon[27902]: pgmap v19660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:24.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:24 smithi191 ceph-mon[31636]: pgmap v19660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:24 smithi170 ceph-mon[31212]: pgmap v19660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:25.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36695.827113 secs 2024-04-21T20:36:25.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36695.827113 secs 2024-04-21T20:36:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36695.827113 secs 2024-04-21T20:36:26.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:26 smithi077 ceph-mon[27902]: pgmap v19661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:26 smithi191 ceph-mon[31636]: pgmap v19661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:26 smithi170 ceph-mon[31212]: pgmap v19661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:28 smithi077 ceph-mon[27902]: pgmap v19662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36699.070958 secs 2024-04-21T20:36:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:28 smithi191 ceph-mon[31636]: pgmap v19662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36699.070958 secs 2024-04-21T20:36:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:28 smithi170 ceph-mon[31212]: pgmap v19662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36699.070958 secs 2024-04-21T20:36:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:30 smithi077 ceph-mon[27902]: pgmap v19663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36700.827257 secs 2024-04-21T20:36:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:30 smithi191 ceph-mon[31636]: pgmap v19663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36700.827257 secs 2024-04-21T20:36:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:30 smithi170 ceph-mon[31212]: pgmap v19663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:31.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36700.827257 secs 2024-04-21T20:36:32.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:32 smithi077 ceph-mon[27902]: pgmap v19664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:32.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:32 smithi191 ceph-mon[31636]: pgmap v19664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:32 smithi170 ceph-mon[31212]: pgmap v19664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:33.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36704.071020 secs 2024-04-21T20:36:33.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36704.071020 secs 2024-04-21T20:36:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36704.071020 secs 2024-04-21T20:36:34.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:34 smithi077 ceph-mon[27902]: pgmap v19665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:34.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:34 smithi191 ceph-mon[31636]: pgmap v19665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:34 smithi170 ceph-mon[31212]: pgmap v19665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36705.827364 secs 2024-04-21T20:36:35.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36705.827364 secs 2024-04-21T20:36:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36705.827364 secs 2024-04-21T20:36:36.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:36 smithi077 ceph-mon[27902]: pgmap v19666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:36.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:36 smithi191 ceph-mon[31636]: pgmap v19666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:36 smithi170 ceph-mon[31212]: pgmap v19666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:38 smithi077 ceph-mon[27902]: pgmap v19667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36709.071159 secs 2024-04-21T20:36:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:38 smithi191 ceph-mon[31636]: pgmap v19667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36709.071159 secs 2024-04-21T20:36:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:38 smithi170 ceph-mon[31212]: pgmap v19667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36709.071159 secs 2024-04-21T20:36:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:40 smithi077 ceph-mon[27902]: pgmap v19668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:40.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36710.827481 secs 2024-04-21T20:36:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:40 smithi191 ceph-mon[31636]: pgmap v19668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36710.827481 secs 2024-04-21T20:36:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:40 smithi170 ceph-mon[31212]: pgmap v19668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:41.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36710.827481 secs 2024-04-21T20:36:42.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:42 smithi077 ceph-mon[27902]: pgmap v19669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:42.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:42 smithi191 ceph-mon[31636]: pgmap v19669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:42 smithi170 ceph-mon[31212]: pgmap v19669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:43.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36714.071247 secs 2024-04-21T20:36:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36714.071247 secs 2024-04-21T20:36:44.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36714.071247 secs 2024-04-21T20:36:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:44 smithi191 ceph-mon[31636]: pgmap v19670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:44 smithi170 ceph-mon[31212]: pgmap v19670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:44 smithi077 ceph-mon[27902]: pgmap v19670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:45.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36715.827592 secs 2024-04-21T20:36:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36715.827592 secs 2024-04-21T20:36:46.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36715.827592 secs 2024-04-21T20:36:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:46 smithi191 ceph-mon[31636]: pgmap v19671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:46 smithi170 ceph-mon[31212]: pgmap v19671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:47.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:46 smithi077 ceph-mon[27902]: pgmap v19671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:48 smithi191 ceph-mon[31636]: pgmap v19672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36719.071339 secs 2024-04-21T20:36:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:48 smithi170 ceph-mon[31212]: pgmap v19672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36719.071339 secs 2024-04-21T20:36:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:48 smithi077 ceph-mon[27902]: pgmap v19672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36719.071339 secs 2024-04-21T20:36:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:50 smithi191 ceph-mon[31636]: pgmap v19673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36720.827708 secs 2024-04-21T20:36:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:36:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:50 smithi170 ceph-mon[31212]: pgmap v19673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36720.827708 secs 2024-04-21T20:36:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:36:51.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:50 smithi077 ceph-mon[27902]: pgmap v19673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:51.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36720.827708 secs 2024-04-21T20:36:51.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:36:52.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: pgmap v19674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:52.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:36:52.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:36:52.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: pgmap v19674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:36:52.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: pgmap v19674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:36:52.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:36:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36724.071444 secs 2024-04-21T20:36:53.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36724.071444 secs 2024-04-21T20:36:53.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36724.071444 secs 2024-04-21T20:36:54.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:53 smithi170 ceph-mon[31212]: pgmap v19675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:54.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:53 smithi077 ceph-mon[27902]: pgmap v19675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:54.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:53 smithi191 ceph-mon[31636]: pgmap v19675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:36:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36725.827823 secs 2024-04-21T20:36:55.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36725.827823 secs 2024-04-21T20:36:55.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36725.827823 secs 2024-04-21T20:36:56.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:56 smithi170 ceph-mon[31212]: pgmap v19676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:56.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:56 smithi077 ceph-mon[27902]: pgmap v19676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:56.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:56 smithi191 ceph-mon[31636]: pgmap v19676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:36:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:58 smithi170 ceph-mon[31212]: pgmap v19677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:36:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36729.071508 secs 2024-04-21T20:36:58.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:58 smithi077 ceph-mon[27902]: pgmap v19677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:58.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:36:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36729.071508 secs 2024-04-21T20:36:58.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:58 smithi191 ceph-mon[31636]: pgmap v19677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:36:58.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:36:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36729.071508 secs 2024-04-21T20:37:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:00 smithi170 ceph-mon[31212]: pgmap v19678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36730.827940 secs 2024-04-21T20:37:00.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:00 smithi077 ceph-mon[27902]: pgmap v19678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:00.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36730.827940 secs 2024-04-21T20:37:00.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:00 smithi191 ceph-mon[31636]: pgmap v19678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:00.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36730.827940 secs 2024-04-21T20:37:02.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:02 smithi170 ceph-mon[31212]: pgmap v19679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:02.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:02 smithi077 ceph-mon[27902]: pgmap v19679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:02.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:02 smithi191 ceph-mon[31636]: pgmap v19679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:03.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36734.071626 secs 2024-04-21T20:37:03.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36734.071626 secs 2024-04-21T20:37:03.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36734.071626 secs 2024-04-21T20:37:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:04 smithi170 ceph-mon[31212]: pgmap v19680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:04.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:04 smithi077 ceph-mon[27902]: pgmap v19680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:04.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:04 smithi191 ceph-mon[31636]: pgmap v19680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36735.828054 secs 2024-04-21T20:37:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:05 smithi170 ceph-mon[31212]: osdmap e1302: 12 total, 12 up, 12 in 2024-04-21T20:37:05.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36735.828054 secs 2024-04-21T20:37:05.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:05 smithi077 ceph-mon[27902]: osdmap e1302: 12 total, 12 up, 12 in 2024-04-21T20:37:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36735.828054 secs 2024-04-21T20:37:05.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:05 smithi191 ceph-mon[31636]: osdmap e1302: 12 total, 12 up, 12 in 2024-04-21T20:37:06.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:06 smithi170 ceph-mon[31212]: pgmap v19682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:37:06.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:06 smithi077 ceph-mon[27902]: pgmap v19682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:37:06.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:06 smithi191 ceph-mon[31636]: pgmap v19682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:37:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:08 smithi170 ceph-mon[31212]: pgmap v19683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:37:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36739.071798 secs 2024-04-21T20:37:08.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:08 smithi077 ceph-mon[27902]: pgmap v19683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:37:08.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36739.071798 secs 2024-04-21T20:37:08.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:08 smithi191 ceph-mon[31636]: pgmap v19683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:37:08.474 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36739.071798 secs 2024-04-21T20:37:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:10 smithi077 ceph-mon[27902]: pgmap v19684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:37:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36740.828165 secs 2024-04-21T20:37:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:10 smithi077 ceph-mon[27902]: osdmap e1303: 12 total, 12 up, 12 in 2024-04-21T20:37:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:10 smithi191 ceph-mon[31636]: pgmap v19684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:37:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36740.828165 secs 2024-04-21T20:37:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:10 smithi191 ceph-mon[31636]: osdmap e1303: 12 total, 12 up, 12 in 2024-04-21T20:37:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:10 smithi170 ceph-mon[31212]: pgmap v19684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:37:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36740.828165 secs 2024-04-21T20:37:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:10 smithi170 ceph-mon[31212]: osdmap e1303: 12 total, 12 up, 12 in 2024-04-21T20:37:12.865 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:12 smithi170 ceph-mon[31212]: pgmap v19686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:37:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:12 smithi077 ceph-mon[27902]: pgmap v19686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:37:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:12 smithi191 ceph-mon[31636]: pgmap v19686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:37:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36744.071910 secs 2024-04-21T20:37:13.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36744.071910 secs 2024-04-21T20:37:14.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36744.071910 secs 2024-04-21T20:37:14.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:14 smithi077 ceph-mon[27902]: pgmap v19687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T20:37:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:14 smithi191 ceph-mon[31636]: pgmap v19687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T20:37:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:14 smithi170 ceph-mon[31212]: pgmap v19687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T20:37:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36745.828260 secs 2024-04-21T20:37:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36745.828260 secs 2024-04-21T20:37:16.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36745.828260 secs 2024-04-21T20:37:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:16 smithi077 ceph-mon[27902]: pgmap v19688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:37:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:16 smithi191 ceph-mon[31636]: pgmap v19688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:37:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:16 smithi170 ceph-mon[31212]: pgmap v19688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:37:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:18 smithi077 ceph-mon[27902]: pgmap v19689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:37:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36749.072040 secs 2024-04-21T20:37:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:18 smithi191 ceph-mon[31636]: pgmap v19689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:37:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36749.072040 secs 2024-04-21T20:37:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:18 smithi170 ceph-mon[31212]: pgmap v19689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:37:19.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36749.072040 secs 2024-04-21T20:37:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:20 smithi077 ceph-mon[27902]: pgmap v19690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:37:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36750.828376 secs 2024-04-21T20:37:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:20 smithi191 ceph-mon[31636]: pgmap v19690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:37:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36750.828376 secs 2024-04-21T20:37:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:20 smithi170 ceph-mon[31212]: pgmap v19690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:37:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36750.828376 secs 2024-04-21T20:37:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:22 smithi077 ceph-mon[27902]: pgmap v19691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:37:22.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:22 smithi191 ceph-mon[31636]: pgmap v19691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:37:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:22 smithi170 ceph-mon[31212]: pgmap v19691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:37:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36754.072123 secs 2024-04-21T20:37:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36754.072123 secs 2024-04-21T20:37:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36754.072123 secs 2024-04-21T20:37:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:24 smithi077 ceph-mon[27902]: pgmap v19692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:24.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:24 smithi191 ceph-mon[31636]: pgmap v19692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:24 smithi170 ceph-mon[31212]: pgmap v19692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:25.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36755.828446 secs 2024-04-21T20:37:25.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36755.828446 secs 2024-04-21T20:37:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36755.828446 secs 2024-04-21T20:37:26.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:26 smithi077 ceph-mon[27902]: pgmap v19693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:26 smithi191 ceph-mon[31636]: pgmap v19693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:26 smithi170 ceph-mon[31212]: pgmap v19693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:28 smithi077 ceph-mon[27902]: pgmap v19694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36759.072249 secs 2024-04-21T20:37:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:28 smithi191 ceph-mon[31636]: pgmap v19694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36759.072249 secs 2024-04-21T20:37:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:28 smithi170 ceph-mon[31212]: pgmap v19694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36759.072249 secs 2024-04-21T20:37:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:30 smithi077 ceph-mon[27902]: pgmap v19695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:30.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36760.828584 secs 2024-04-21T20:37:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:30 smithi191 ceph-mon[31636]: pgmap v19695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36760.828584 secs 2024-04-21T20:37:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:30 smithi170 ceph-mon[31212]: pgmap v19695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36760.828584 secs 2024-04-21T20:37:32.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:32 smithi077 ceph-mon[27902]: pgmap v19696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:32.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:32 smithi191 ceph-mon[31636]: pgmap v19696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:32 smithi170 ceph-mon[31212]: pgmap v19696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:33.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36764.072377 secs 2024-04-21T20:37:33.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36764.072377 secs 2024-04-21T20:37:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36764.072377 secs 2024-04-21T20:37:34.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:34 smithi077 ceph-mon[27902]: pgmap v19697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:34.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:34 smithi191 ceph-mon[31636]: pgmap v19697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:34 smithi170 ceph-mon[31212]: pgmap v19697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:35.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36765.828658 secs 2024-04-21T20:37:35.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36765.828658 secs 2024-04-21T20:37:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36765.828658 secs 2024-04-21T20:37:36.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:36 smithi077 ceph-mon[27902]: pgmap v19698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:36.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:36 smithi191 ceph-mon[31636]: pgmap v19698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:36 smithi170 ceph-mon[31212]: pgmap v19698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:38 smithi077 ceph-mon[27902]: pgmap v19699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:38.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36769.072507 secs 2024-04-21T20:37:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:38 smithi191 ceph-mon[31636]: pgmap v19699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36769.072507 secs 2024-04-21T20:37:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:38 smithi170 ceph-mon[31212]: pgmap v19699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:39.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36769.072507 secs 2024-04-21T20:37:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:40 smithi191 ceph-mon[31636]: pgmap v19700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36770.828770 secs 2024-04-21T20:37:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:40 smithi170 ceph-mon[31212]: pgmap v19700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36770.828770 secs 2024-04-21T20:37:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:40 smithi077 ceph-mon[27902]: pgmap v19700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36770.828770 secs 2024-04-21T20:37:42.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:42 smithi191 ceph-mon[31636]: pgmap v19701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:42 smithi170 ceph-mon[31212]: pgmap v19701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:43.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:42 smithi077 ceph-mon[27902]: pgmap v19701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:43.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36774.072568 secs 2024-04-21T20:37:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36774.072568 secs 2024-04-21T20:37:44.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36774.072568 secs 2024-04-21T20:37:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:44 smithi191 ceph-mon[31636]: pgmap v19702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:44 smithi170 ceph-mon[31212]: pgmap v19702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:44 smithi077 ceph-mon[27902]: pgmap v19702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:45.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36775.828888 secs 2024-04-21T20:37:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36775.828888 secs 2024-04-21T20:37:46.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36775.828888 secs 2024-04-21T20:37:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:46 smithi191 ceph-mon[31636]: pgmap v19703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:46 smithi170 ceph-mon[31212]: pgmap v19703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:47.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:46 smithi077 ceph-mon[27902]: pgmap v19703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:48 smithi191 ceph-mon[31636]: pgmap v19704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36779.072634 secs 2024-04-21T20:37:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:48 smithi170 ceph-mon[31212]: pgmap v19704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:49.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36779.072634 secs 2024-04-21T20:37:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:48 smithi077 ceph-mon[27902]: pgmap v19704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36779.072634 secs 2024-04-21T20:37:50.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:49 smithi170 ceph-mon[31212]: pgmap v19705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:50.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36780.829010 secs 2024-04-21T20:37:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:49 smithi077 ceph-mon[27902]: pgmap v19705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36780.829010 secs 2024-04-21T20:37:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:49 smithi191 ceph-mon[31636]: pgmap v19705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:50.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36780.829010 secs 2024-04-21T20:37:52.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:51 smithi077 ceph-mon[27902]: pgmap v19706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:52.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:37:52.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:51 smithi191 ceph-mon[31636]: pgmap v19706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:52.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:37:52.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:51 smithi170 ceph-mon[31212]: pgmap v19706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:52.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:37:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:37:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:37:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:37:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:37:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:37:53.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:37:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:37:53.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:37:53.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:37:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36784.072700 secs 2024-04-21T20:37:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:53 smithi077 ceph-mon[27902]: pgmap v19707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:54.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36784.072700 secs 2024-04-21T20:37:54.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:53 smithi191 ceph-mon[31636]: pgmap v19707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:54.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36784.072700 secs 2024-04-21T20:37:54.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:53 smithi170 ceph-mon[31212]: pgmap v19707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:55.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:37:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36785.829115 secs 2024-04-21T20:37:55.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36785.829115 secs 2024-04-21T20:37:55.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36785.829115 secs 2024-04-21T20:37:56.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:55 smithi077 ceph-mon[27902]: pgmap v19708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:56.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:55 smithi191 ceph-mon[31636]: pgmap v19708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:56.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:55 smithi170 ceph-mon[31212]: pgmap v19708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:37:58.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:57 smithi077 ceph-mon[27902]: pgmap v19709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:58.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:57 smithi191 ceph-mon[31636]: pgmap v19709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:58.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:57 smithi170 ceph-mon[31212]: pgmap v19709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:37:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36789.072828 secs 2024-04-21T20:37:59.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36789.072828 secs 2024-04-21T20:37:59.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36789.072828 secs 2024-04-21T20:37:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:37:59.438+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:37:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:37:59.438+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:37:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:37:59.438+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:37:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:37:59.439+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:38:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:00.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:59 smithi077 ceph-mon[27902]: pgmap v19710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:00.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36790.829249 secs 2024-04-21T20:38:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:59 smithi191 ceph-mon[31636]: pgmap v19710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36790.829249 secs 2024-04-21T20:38:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:59 smithi170 ceph-mon[31212]: pgmap v19710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36790.829249 secs 2024-04-21T20:38:02.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:01 smithi077 ceph-mon[27902]: pgmap v19711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:02.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:01 smithi191 ceph-mon[31636]: pgmap v19711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:02.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:01 smithi170 ceph-mon[31212]: pgmap v19711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36794.072982 secs 2024-04-21T20:38:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:03 smithi077 ceph-mon[27902]: pgmap v19712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:04.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36794.072982 secs 2024-04-21T20:38:04.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:03 smithi191 ceph-mon[31636]: pgmap v19712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36794.072982 secs 2024-04-21T20:38:04.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:03 smithi170 ceph-mon[31212]: pgmap v19712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36795.829364 secs 2024-04-21T20:38:05.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36795.829364 secs 2024-04-21T20:38:05.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36795.829364 secs 2024-04-21T20:38:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:05 smithi077 ceph-mon[27902]: pgmap v19713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:05 smithi077 ceph-mon[27902]: osdmap e1304: 12 total, 12 up, 12 in 2024-04-21T20:38:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:05 smithi191 ceph-mon[31636]: pgmap v19713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:05 smithi191 ceph-mon[31636]: osdmap e1304: 12 total, 12 up, 12 in 2024-04-21T20:38:06.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:05 smithi170 ceph-mon[31212]: pgmap v19713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:06.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:05 smithi170 ceph-mon[31212]: osdmap e1304: 12 total, 12 up, 12 in 2024-04-21T20:38:08.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:07 smithi077 ceph-mon[27902]: pgmap v19715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:38:08.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:07 smithi191 ceph-mon[31636]: pgmap v19715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:38:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:07 smithi170 ceph-mon[31212]: pgmap v19715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:38:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36799.073085 secs 2024-04-21T20:38:09.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36799.073085 secs 2024-04-21T20:38:09.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36799.073085 secs 2024-04-21T20:38:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:10 smithi077 ceph-mon[27902]: pgmap v19716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:38:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36800.829505 secs 2024-04-21T20:38:10.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:10 smithi077 ceph-mon[27902]: osdmap e1305: 12 total, 12 up, 12 in 2024-04-21T20:38:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:10 smithi191 ceph-mon[31636]: pgmap v19716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:38:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36800.829505 secs 2024-04-21T20:38:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:10 smithi191 ceph-mon[31636]: osdmap e1305: 12 total, 12 up, 12 in 2024-04-21T20:38:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:10 smithi170 ceph-mon[31212]: pgmap v19716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:38:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36800.829505 secs 2024-04-21T20:38:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:10 smithi170 ceph-mon[31212]: osdmap e1305: 12 total, 12 up, 12 in 2024-04-21T20:38:12.865 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:12 smithi170 ceph-mon[31212]: pgmap v19718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:38:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:12 smithi077 ceph-mon[27902]: pgmap v19718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:38:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:12 smithi191 ceph-mon[31636]: pgmap v19718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:38:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36804.073163 secs 2024-04-21T20:38:13.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36804.073163 secs 2024-04-21T20:38:14.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36804.073163 secs 2024-04-21T20:38:14.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:14 smithi077 ceph-mon[27902]: pgmap v19719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:38:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:14 smithi191 ceph-mon[31636]: pgmap v19719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:38:15.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:14 smithi170 ceph-mon[31212]: pgmap v19719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:38:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36805.829625 secs 2024-04-21T20:38:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36805.829625 secs 2024-04-21T20:38:16.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36805.829625 secs 2024-04-21T20:38:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:16 smithi077 ceph-mon[27902]: pgmap v19720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:38:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:16 smithi191 ceph-mon[31636]: pgmap v19720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:38:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:16 smithi170 ceph-mon[31212]: pgmap v19720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:38:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:18 smithi077 ceph-mon[27902]: pgmap v19721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:38:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36809.073245 secs 2024-04-21T20:38:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:18 smithi191 ceph-mon[31636]: pgmap v19721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:38:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36809.073245 secs 2024-04-21T20:38:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:18 smithi170 ceph-mon[31212]: pgmap v19721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:38:19.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36809.073245 secs 2024-04-21T20:38:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 36995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:20 smithi077 ceph-mon[27902]: pgmap v19722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:38:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36810.829746 secs 2024-04-21T20:38:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:20 smithi191 ceph-mon[31636]: pgmap v19722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:38:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36810.829746 secs 2024-04-21T20:38:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:20 smithi170 ceph-mon[31212]: pgmap v19722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:38:21.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36810.829746 secs 2024-04-21T20:38:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:22 smithi077 ceph-mon[27902]: pgmap v19723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:38:22.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:22 smithi191 ceph-mon[31636]: pgmap v19723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:38:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:22 smithi170 ceph-mon[31212]: pgmap v19723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:38:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36814.073364 secs 2024-04-21T20:38:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36814.073364 secs 2024-04-21T20:38:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36814.073364 secs 2024-04-21T20:38:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:24 smithi077 ceph-mon[27902]: pgmap v19724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:24.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:24 smithi191 ceph-mon[31636]: pgmap v19724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:24 smithi170 ceph-mon[31212]: pgmap v19724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:25.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36815.829878 secs 2024-04-21T20:38:25.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36815.829878 secs 2024-04-21T20:38:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36815.829878 secs 2024-04-21T20:38:26.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:26 smithi077 ceph-mon[27902]: pgmap v19725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:26 smithi191 ceph-mon[31636]: pgmap v19725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:26 smithi170 ceph-mon[31212]: pgmap v19725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:28 smithi077 ceph-mon[27902]: pgmap v19726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:28.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36819.073493 secs 2024-04-21T20:38:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:28 smithi191 ceph-mon[31636]: pgmap v19726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36819.073493 secs 2024-04-21T20:38:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:28 smithi170 ceph-mon[31212]: pgmap v19726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:29.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36819.073493 secs 2024-04-21T20:38:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:30 smithi191 ceph-mon[31636]: pgmap v19727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36820.829926 secs 2024-04-21T20:38:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:30 smithi170 ceph-mon[31212]: pgmap v19727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:31.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36820.829926 secs 2024-04-21T20:38:31.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:30 smithi077 ceph-mon[27902]: pgmap v19727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:31.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36820.829926 secs 2024-04-21T20:38:32.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:32 smithi191 ceph-mon[31636]: pgmap v19728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:32 smithi170 ceph-mon[31212]: pgmap v19728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:33.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:32 smithi077 ceph-mon[27902]: pgmap v19728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:33.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36824.073596 secs 2024-04-21T20:38:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36824.073596 secs 2024-04-21T20:38:34.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36824.073596 secs 2024-04-21T20:38:34.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:34 smithi191 ceph-mon[31636]: pgmap v19729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:34 smithi170 ceph-mon[31212]: pgmap v19729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:35.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:34 smithi077 ceph-mon[27902]: pgmap v19729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:35.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36825.830038 secs 2024-04-21T20:38:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36825.830038 secs 2024-04-21T20:38:36.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36825.830038 secs 2024-04-21T20:38:36.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:36 smithi191 ceph-mon[31636]: pgmap v19730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:37.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:36 smithi170 ceph-mon[31212]: pgmap v19730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:37.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:36 smithi077 ceph-mon[27902]: pgmap v19730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:38 smithi191 ceph-mon[31636]: pgmap v19731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36829.073718 secs 2024-04-21T20:38:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:38 smithi170 ceph-mon[31212]: pgmap v19731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:39.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36829.073718 secs 2024-04-21T20:38:39.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:38 smithi077 ceph-mon[27902]: pgmap v19731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:39.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36829.073718 secs 2024-04-21T20:38:40.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:40 smithi191 ceph-mon[31636]: pgmap v19732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36830.830154 secs 2024-04-21T20:38:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:40 smithi170 ceph-mon[31212]: pgmap v19732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36830.830154 secs 2024-04-21T20:38:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:40 smithi077 ceph-mon[27902]: pgmap v19732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36830.830154 secs 2024-04-21T20:38:42.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:42 smithi191 ceph-mon[31636]: pgmap v19733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:42 smithi170 ceph-mon[31212]: pgmap v19733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:43.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:42 smithi077 ceph-mon[27902]: pgmap v19733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:43.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36834.073811 secs 2024-04-21T20:38:44.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36834.073811 secs 2024-04-21T20:38:44.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36834.073811 secs 2024-04-21T20:38:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:44 smithi191 ceph-mon[31636]: pgmap v19734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36835.830270 secs 2024-04-21T20:38:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:44 smithi170 ceph-mon[31212]: pgmap v19734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:45.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36835.830270 secs 2024-04-21T20:38:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:44 smithi077 ceph-mon[27902]: pgmap v19734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36835.830270 secs 2024-04-21T20:38:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:46 smithi191 ceph-mon[31636]: pgmap v19735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:46 smithi170 ceph-mon[31212]: pgmap v19735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:47.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:46 smithi077 ceph-mon[27902]: pgmap v19735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:48 smithi191 ceph-mon[31636]: pgmap v19736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36839.073902 secs 2024-04-21T20:38:49.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:48 smithi170 ceph-mon[31212]: pgmap v19736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:49.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36839.073902 secs 2024-04-21T20:38:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:48 smithi077 ceph-mon[27902]: pgmap v19736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:49.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36839.073902 secs 2024-04-21T20:38:49.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36840.830377 secs 2024-04-21T20:38:50.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36840.830377 secs 2024-04-21T20:38:50.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36840.830377 secs 2024-04-21T20:38:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:50 smithi191 ceph-mon[31636]: pgmap v19737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:51.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:50 smithi170 ceph-mon[31212]: pgmap v19737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:51.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:50 smithi077 ceph-mon[27902]: pgmap v19737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:52 smithi191 ceph-mon[31636]: pgmap v19738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:38:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:52 smithi170 ceph-mon[31212]: pgmap v19738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:53.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:38:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:52 smithi077 ceph-mon[27902]: pgmap v19738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:38:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36844.074058 secs 2024-04-21T20:38:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:38:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:38:53.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:38:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36844.074058 secs 2024-04-21T20:38:54.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:38:54.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:38:54.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:38:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36844.074058 secs 2024-04-21T20:38:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:38:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:38:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:38:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:54 smithi191 ceph-mon[31636]: pgmap v19739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36845.830488 secs 2024-04-21T20:38:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:54 smithi170 ceph-mon[31212]: pgmap v19739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36845.830488 secs 2024-04-21T20:38:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:38:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:54 smithi077 ceph-mon[27902]: pgmap v19739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36845.830488 secs 2024-04-21T20:38:56.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:56 smithi191 ceph-mon[31636]: pgmap v19740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:57.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:56 smithi170 ceph-mon[31212]: pgmap v19740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:57.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:56 smithi077 ceph-mon[27902]: pgmap v19740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:38:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:58 smithi191 ceph-mon[31636]: pgmap v19741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36849.074174 secs 2024-04-21T20:38:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:58 smithi170 ceph-mon[31212]: pgmap v19741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36849.074174 secs 2024-04-21T20:38:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:58 smithi077 ceph-mon[27902]: pgmap v19741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:38:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36849.074174 secs 2024-04-21T20:38:59.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36850.830550 secs 2024-04-21T20:39:00.042 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36850.830550 secs 2024-04-21T20:39:00.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36850.830550 secs 2024-04-21T20:39:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:00.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:00 smithi191 ceph-mon[31636]: pgmap v19742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:00 smithi170 ceph-mon[31212]: pgmap v19742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:01.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:00 smithi077 ceph-mon[27902]: pgmap v19742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:02.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:02 smithi191 ceph-mon[31636]: pgmap v19743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T20:39:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:02 smithi170 ceph-mon[31212]: pgmap v19743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T20:39:03.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:02 smithi077 ceph-mon[27902]: pgmap v19743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T20:39:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36854.074237 secs 2024-04-21T20:39:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36854.074237 secs 2024-04-21T20:39:04.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36854.074237 secs 2024-04-21T20:39:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:04 smithi170 ceph-mon[31212]: pgmap v19744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T20:39:05.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36855.830702 secs 2024-04-21T20:39:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:04 smithi077 ceph-mon[27902]: pgmap v19744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T20:39:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36855.830702 secs 2024-04-21T20:39:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:04 smithi191 ceph-mon[31636]: pgmap v19744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T20:39:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36855.830702 secs 2024-04-21T20:39:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:05 smithi170 ceph-mon[31212]: osdmap e1306: 12 total, 12 up, 12 in 2024-04-21T20:39:06.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:05 smithi170 ceph-mon[31212]: pgmap v19746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T20:39:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:05 smithi077 ceph-mon[27902]: osdmap e1306: 12 total, 12 up, 12 in 2024-04-21T20:39:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:05 smithi077 ceph-mon[27902]: pgmap v19746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T20:39:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:05 smithi191 ceph-mon[31636]: osdmap e1306: 12 total, 12 up, 12 in 2024-04-21T20:39:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:05 smithi191 ceph-mon[31636]: pgmap v19746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T20:39:08.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:07 smithi077 ceph-mon[27902]: pgmap v19747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:39:08.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:07 smithi191 ceph-mon[31636]: pgmap v19747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:39:08.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:07 smithi170 ceph-mon[31212]: pgmap v19747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:39:09.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36859.074336 secs 2024-04-21T20:39:09.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36859.074336 secs 2024-04-21T20:39:09.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36859.074336 secs 2024-04-21T20:39:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:10.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:10 smithi077 ceph-mon[27902]: pgmap v19748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:39:10.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36860.830825 secs 2024-04-21T20:39:10.892 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:10 smithi077 ceph-mon[27902]: osdmap e1307: 12 total, 12 up, 12 in 2024-04-21T20:39:10.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:10 smithi191 ceph-mon[31636]: pgmap v19748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:39:10.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36860.830825 secs 2024-04-21T20:39:10.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:10 smithi191 ceph-mon[31636]: osdmap e1307: 12 total, 12 up, 12 in 2024-04-21T20:39:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:10 smithi170 ceph-mon[31212]: pgmap v19748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:39:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36860.830825 secs 2024-04-21T20:39:11.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:10 smithi170 ceph-mon[31212]: osdmap e1307: 12 total, 12 up, 12 in 2024-04-21T20:39:12.865 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:12 smithi170 ceph-mon[31212]: pgmap v19750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T20:39:12.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:12 smithi077 ceph-mon[27902]: pgmap v19750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T20:39:12.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:12 smithi191 ceph-mon[31636]: pgmap v19750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T20:39:13.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36864.074457 secs 2024-04-21T20:39:13.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36864.074457 secs 2024-04-21T20:39:14.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36864.074457 secs 2024-04-21T20:39:14.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:14 smithi077 ceph-mon[27902]: pgmap v19751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T20:39:14.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:14 smithi191 ceph-mon[31636]: pgmap v19751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T20:39:15.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:14 smithi170 ceph-mon[31212]: pgmap v19751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T20:39:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36865.830940 secs 2024-04-21T20:39:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36865.830940 secs 2024-04-21T20:39:16.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36865.830940 secs 2024-04-21T20:39:16.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:16 smithi077 ceph-mon[27902]: pgmap v19752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T20:39:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:16 smithi191 ceph-mon[31636]: pgmap v19752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T20:39:17.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:16 smithi170 ceph-mon[31212]: pgmap v19752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T20:39:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:18 smithi077 ceph-mon[27902]: pgmap v19753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:39:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36869.074596 secs 2024-04-21T20:39:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:18 smithi191 ceph-mon[31636]: pgmap v19753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:39:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36869.074596 secs 2024-04-21T20:39:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:18 smithi170 ceph-mon[31212]: pgmap v19753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:39:19.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36869.074596 secs 2024-04-21T20:39:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:20 smithi077 ceph-mon[27902]: pgmap v19754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:39:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36870.831057 secs 2024-04-21T20:39:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:20 smithi191 ceph-mon[31636]: pgmap v19754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:39:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36870.831057 secs 2024-04-21T20:39:21.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:20 smithi170 ceph-mon[31212]: pgmap v19754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:39:21.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36870.831057 secs 2024-04-21T20:39:22.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:22 smithi077 ceph-mon[27902]: pgmap v19755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:39:22.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:22 smithi191 ceph-mon[31636]: pgmap v19755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:39:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:22 smithi170 ceph-mon[31212]: pgmap v19755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:39:23.893 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36874.074717 secs 2024-04-21T20:39:23.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36874.074717 secs 2024-04-21T20:39:24.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36874.074717 secs 2024-04-21T20:39:24.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:24 smithi077 ceph-mon[27902]: pgmap v19756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:24.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:24 smithi191 ceph-mon[31636]: pgmap v19756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:24 smithi170 ceph-mon[31212]: pgmap v19756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:25.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36875.831151 secs 2024-04-21T20:39:25.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36875.831151 secs 2024-04-21T20:39:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36875.831151 secs 2024-04-21T20:39:26.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:26 smithi191 ceph-mon[31636]: pgmap v19757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:26 smithi170 ceph-mon[31212]: pgmap v19757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:27.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:26 smithi077 ceph-mon[27902]: pgmap v19757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:28 smithi191 ceph-mon[31636]: pgmap v19758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36879.074832 secs 2024-04-21T20:39:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:28 smithi170 ceph-mon[31212]: pgmap v19758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:29.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36879.074832 secs 2024-04-21T20:39:29.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:28 smithi077 ceph-mon[27902]: pgmap v19758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:29.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36879.074832 secs 2024-04-21T20:39:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:39:29.452+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:39:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:39:29.452+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:39:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:39:29.452+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:39:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:39:29.452+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:39:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:30.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:30 smithi077 ceph-mon[27902]: pgmap v19759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:30.944 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36880.831242 secs 2024-04-21T20:39:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:30 smithi191 ceph-mon[31636]: pgmap v19759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36880.831242 secs 2024-04-21T20:39:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:30 smithi170 ceph-mon[31212]: pgmap v19759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:31.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36880.831242 secs 2024-04-21T20:39:32.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:32 smithi191 ceph-mon[31636]: pgmap v19760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:32 smithi170 ceph-mon[31212]: pgmap v19760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:33.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:32 smithi077 ceph-mon[27902]: pgmap v19760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:33.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36884.074952 secs 2024-04-21T20:39:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36884.074952 secs 2024-04-21T20:39:34.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36884.074952 secs 2024-04-21T20:39:34.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:34 smithi191 ceph-mon[31636]: pgmap v19761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:34 smithi170 ceph-mon[31212]: pgmap v19761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:35.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:35.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:34 smithi077 ceph-mon[27902]: pgmap v19761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:35.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36885.831382 secs 2024-04-21T20:39:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36885.831382 secs 2024-04-21T20:39:36.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36885.831382 secs 2024-04-21T20:39:36.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:36 smithi191 ceph-mon[31636]: pgmap v19762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:36 smithi170 ceph-mon[31212]: pgmap v19762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:37.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:36 smithi077 ceph-mon[27902]: pgmap v19762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:38 smithi191 ceph-mon[31636]: pgmap v19763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36889.075067 secs 2024-04-21T20:39:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:38 smithi170 ceph-mon[31212]: pgmap v19763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36889.075067 secs 2024-04-21T20:39:39.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:38 smithi077 ceph-mon[27902]: pgmap v19763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:39.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36889.075067 secs 2024-04-21T20:39:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:40 smithi191 ceph-mon[31636]: pgmap v19764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36890.831505 secs 2024-04-21T20:39:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:40 smithi170 ceph-mon[31212]: pgmap v19764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36890.831505 secs 2024-04-21T20:39:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:40 smithi077 ceph-mon[27902]: pgmap v19764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36890.831505 secs 2024-04-21T20:39:42.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:42 smithi191 ceph-mon[31636]: pgmap v19765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:42 smithi170 ceph-mon[31212]: pgmap v19765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:43.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:42 smithi077 ceph-mon[27902]: pgmap v19765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:43.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36894.075150 secs 2024-04-21T20:39:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36894.075150 secs 2024-04-21T20:39:44.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36894.075150 secs 2024-04-21T20:39:44.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:44 smithi191 ceph-mon[31636]: pgmap v19766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:44 smithi170 ceph-mon[31212]: pgmap v19766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:45.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:44 smithi077 ceph-mon[27902]: pgmap v19766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:45.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36895.831626 secs 2024-04-21T20:39:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36895.831626 secs 2024-04-21T20:39:46.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36895.831626 secs 2024-04-21T20:39:46.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:46 smithi191 ceph-mon[31636]: pgmap v19767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:46 smithi170 ceph-mon[31212]: pgmap v19767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:47.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:46 smithi077 ceph-mon[27902]: pgmap v19767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:48 smithi191 ceph-mon[31636]: pgmap v19768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:48.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36899.075269 secs 2024-04-21T20:39:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:48 smithi170 ceph-mon[31212]: pgmap v19768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36899.075269 secs 2024-04-21T20:39:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:48 smithi077 ceph-mon[27902]: pgmap v19768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36899.075269 secs 2024-04-21T20:39:49.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36900.831765 secs 2024-04-21T20:39:50.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36900.831765 secs 2024-04-21T20:39:50.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:50.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36900.831765 secs 2024-04-21T20:39:50.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:50 smithi191 ceph-mon[31636]: pgmap v19769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:50 smithi170 ceph-mon[31212]: pgmap v19769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:51.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:50 smithi077 ceph-mon[27902]: pgmap v19769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:52 smithi191 ceph-mon[31636]: pgmap v19770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:53.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:52 smithi170 ceph-mon[31212]: pgmap v19770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:53.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:52 smithi077 ceph-mon[27902]: pgmap v19770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36904.075383 secs 2024-04-21T20:39:53.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:39:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36904.075383 secs 2024-04-21T20:39:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:39:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36904.075383 secs 2024-04-21T20:39:54.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:39:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:54 smithi191 ceph-mon[31636]: pgmap v19771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:39:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:39:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36905.831849 secs 2024-04-21T20:39:54.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:39:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:54 smithi170 ceph-mon[31212]: pgmap v19771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:39:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:39:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36905.831849 secs 2024-04-21T20:39:55.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:39:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:39:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:54 smithi077 ceph-mon[27902]: pgmap v19771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:39:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:39:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36905.831849 secs 2024-04-21T20:39:55.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:39:56.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:56 smithi191 ceph-mon[31636]: pgmap v19772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:57.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:56 smithi170 ceph-mon[31212]: pgmap v19772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:57.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:56 smithi077 ceph-mon[27902]: pgmap v19772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:39:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:58 smithi191 ceph-mon[31636]: pgmap v19773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:58.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36909.075519 secs 2024-04-21T20:39:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:58 smithi170 ceph-mon[31212]: pgmap v19773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36909.075519 secs 2024-04-21T20:39:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:58 smithi077 ceph-mon[27902]: pgmap v19773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:39:59.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36909.075519 secs 2024-04-21T20:40:00.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36910.831959 secs 2024-04-21T20:40:00.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36910.831959 secs 2024-04-21T20:40:00.139 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36910.831959 secs 2024-04-21T20:40:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:00 smithi170 ceph-mon[31212]: pgmap v19774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:40:01.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:00 smithi077 ceph-mon[27902]: pgmap v19774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:01.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:40:01.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:00 smithi191 ceph-mon[31636]: pgmap v19774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:01.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:40:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:02 smithi170 ceph-mon[31212]: pgmap v19775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T20:40:03.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:02 smithi077 ceph-mon[27902]: pgmap v19775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T20:40:03.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:02 smithi191 ceph-mon[31636]: pgmap v19775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-21T20:40:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36914.075632 secs 2024-04-21T20:40:04.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36914.075632 secs 2024-04-21T20:40:04.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36914.075632 secs 2024-04-21T20:40:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:04 smithi170 ceph-mon[31212]: pgmap v19776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T20:40:05.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36915.832073 secs 2024-04-21T20:40:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:04 smithi077 ceph-mon[27902]: pgmap v19776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T20:40:05.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36915.832073 secs 2024-04-21T20:40:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:04 smithi191 ceph-mon[31636]: pgmap v19776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T20:40:05.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36915.832073 secs 2024-04-21T20:40:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:05 smithi170 ceph-mon[31212]: osdmap e1308: 12 total, 12 up, 12 in 2024-04-21T20:40:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:05 smithi170 ceph-mon[31212]: pgmap v19778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T20:40:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:05 smithi077 ceph-mon[27902]: osdmap e1308: 12 total, 12 up, 12 in 2024-04-21T20:40:06.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:05 smithi077 ceph-mon[27902]: pgmap v19778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T20:40:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:05 smithi191 ceph-mon[31636]: osdmap e1308: 12 total, 12 up, 12 in 2024-04-21T20:40:06.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:05 smithi191 ceph-mon[31636]: pgmap v19778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-21T20:40:08.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:07 smithi077 ceph-mon[27902]: pgmap v19779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:40:08.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:07 smithi191 ceph-mon[31636]: pgmap v19779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:40:08.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:07 smithi170 ceph-mon[31212]: pgmap v19779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:40:09.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36919.075747 secs 2024-04-21T20:40:09.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36919.075747 secs 2024-04-21T20:40:09.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36919.075747 secs 2024-04-21T20:40:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:09 smithi077 ceph-mon[27902]: pgmap v19780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:40:10.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36920.832149 secs 2024-04-21T20:40:10.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:09 smithi191 ceph-mon[31636]: pgmap v19780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:40:10.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36920.832149 secs 2024-04-21T20:40:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:09 smithi170 ceph-mon[31212]: pgmap v19780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:40:10.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36920.832149 secs 2024-04-21T20:40:12.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:11 smithi077 ceph-mon[27902]: pgmap v19781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:12.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:11 smithi191 ceph-mon[31636]: pgmap v19781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:12.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:11 smithi170 ceph-mon[31212]: pgmap v19781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:14.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36924.075860 secs 2024-04-21T20:40:14.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:13 smithi077 ceph-mon[27902]: pgmap v19782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:14.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36924.075860 secs 2024-04-21T20:40:14.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:13 smithi191 ceph-mon[31636]: pgmap v19782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:14.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36924.075860 secs 2024-04-21T20:40:14.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:13 smithi170 ceph-mon[31212]: pgmap v19782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36925.832296 secs 2024-04-21T20:40:15.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:15 smithi077 ceph-mon[27902]: osdmap e1309: 12 total, 12 up, 12 in 2024-04-21T20:40:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36925.832296 secs 2024-04-21T20:40:15.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:15 smithi191 ceph-mon[31636]: osdmap e1309: 12 total, 12 up, 12 in 2024-04-21T20:40:16.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36925.832296 secs 2024-04-21T20:40:16.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:15 smithi170 ceph-mon[31212]: osdmap e1309: 12 total, 12 up, 12 in 2024-04-21T20:40:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:16 smithi077 ceph-mon[27902]: pgmap v19784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:16 smithi191 ceph-mon[31636]: pgmap v19784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:17.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:16 smithi170 ceph-mon[31212]: pgmap v19784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T20:40:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:18 smithi077 ceph-mon[27902]: pgmap v19785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:40:18.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36929.075977 secs 2024-04-21T20:40:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:18 smithi191 ceph-mon[31636]: pgmap v19785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:40:18.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36929.075977 secs 2024-04-21T20:40:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:18 smithi170 ceph-mon[31212]: pgmap v19785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:40:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36929.075977 secs 2024-04-21T20:40:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:20.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:20 smithi077 ceph-mon[27902]: pgmap v19786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:40:20.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36930.832375 secs 2024-04-21T20:40:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:20 smithi191 ceph-mon[31636]: pgmap v19786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:40:20.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36930.832375 secs 2024-04-21T20:40:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:20 smithi170 ceph-mon[31212]: pgmap v19786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:40:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36930.832375 secs 2024-04-21T20:40:22.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:22 smithi077 ceph-mon[27902]: pgmap v19787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:40:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:22 smithi191 ceph-mon[31636]: pgmap v19787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:40:23.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:22 smithi170 ceph-mon[31212]: pgmap v19787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:40:23.891 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36934.076095 secs 2024-04-21T20:40:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36934.076095 secs 2024-04-21T20:40:24.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36934.076095 secs 2024-04-21T20:40:24.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:24 smithi077 ceph-mon[27902]: pgmap v19788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:40:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:24 smithi191 ceph-mon[31636]: pgmap v19788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:40:25.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:24 smithi170 ceph-mon[31212]: pgmap v19788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:40:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36935.832516 secs 2024-04-21T20:40:26.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36935.832516 secs 2024-04-21T20:40:26.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36935.832516 secs 2024-04-21T20:40:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:26 smithi191 ceph-mon[31636]: pgmap v19789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:40:27.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:26 smithi170 ceph-mon[31212]: pgmap v19789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:40:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:26 smithi077 ceph-mon[27902]: pgmap v19789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:40:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:28 smithi191 ceph-mon[31636]: pgmap v19790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:28.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36939.076198 secs 2024-04-21T20:40:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:28 smithi170 ceph-mon[31212]: pgmap v19790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36939.076198 secs 2024-04-21T20:40:29.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:28 smithi077 ceph-mon[27902]: pgmap v19790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:29.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36939.076198 secs 2024-04-21T20:40:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:30.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:30 smithi077 ceph-mon[27902]: pgmap v19791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:30.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36940.832631 secs 2024-04-21T20:40:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:30 smithi191 ceph-mon[31636]: pgmap v19791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:30.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36940.832631 secs 2024-04-21T20:40:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:30 smithi170 ceph-mon[31212]: pgmap v19791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:31.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36940.832631 secs 2024-04-21T20:40:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:32 smithi191 ceph-mon[31636]: pgmap v19792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:32 smithi170 ceph-mon[31212]: pgmap v19792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:32 smithi077 ceph-mon[27902]: pgmap v19792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36944.076307 secs 2024-04-21T20:40:34.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36944.076307 secs 2024-04-21T20:40:34.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36944.076307 secs 2024-04-21T20:40:34.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:34 smithi191 ceph-mon[31636]: pgmap v19793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:35.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:34 smithi170 ceph-mon[31212]: pgmap v19793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:34 smithi077 ceph-mon[27902]: pgmap v19793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:35.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36945.832748 secs 2024-04-21T20:40:36.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36945.832748 secs 2024-04-21T20:40:36.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36945.832748 secs 2024-04-21T20:40:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:36 smithi191 ceph-mon[31636]: pgmap v19794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:36 smithi170 ceph-mon[31212]: pgmap v19794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:37.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:36 smithi077 ceph-mon[27902]: pgmap v19794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:38 smithi191 ceph-mon[31636]: pgmap v19795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36949.076444 secs 2024-04-21T20:40:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:38 smithi170 ceph-mon[31212]: pgmap v19795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:39.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36949.076444 secs 2024-04-21T20:40:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:38 smithi077 ceph-mon[27902]: pgmap v19795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:39.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36949.076444 secs 2024-04-21T20:40:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:40 smithi191 ceph-mon[31636]: pgmap v19796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:40.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36950.832876 secs 2024-04-21T20:40:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:40 smithi170 ceph-mon[31212]: pgmap v19796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:41.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36950.832876 secs 2024-04-21T20:40:41.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:40 smithi077 ceph-mon[27902]: pgmap v19796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:41.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36950.832876 secs 2024-04-21T20:40:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:42 smithi191 ceph-mon[31636]: pgmap v19797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:43.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:42 smithi170 ceph-mon[31212]: pgmap v19797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:42 smithi077 ceph-mon[27902]: pgmap v19797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36954.076558 secs 2024-04-21T20:40:44.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36954.076558 secs 2024-04-21T20:40:44.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36954.076558 secs 2024-04-21T20:40:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:44 smithi191 ceph-mon[31636]: pgmap v19798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:45.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:44 smithi170 ceph-mon[31212]: pgmap v19798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:44 smithi077 ceph-mon[27902]: pgmap v19798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:45.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36955.832991 secs 2024-04-21T20:40:46.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36955.832991 secs 2024-04-21T20:40:46.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36955.832991 secs 2024-04-21T20:40:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:46 smithi191 ceph-mon[31636]: pgmap v19799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:47.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:46 smithi170 ceph-mon[31212]: pgmap v19799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:46 smithi077 ceph-mon[27902]: pgmap v19799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:48 smithi191 ceph-mon[31636]: pgmap v19800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36959.076696 secs 2024-04-21T20:40:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:48 smithi170 ceph-mon[31212]: pgmap v19800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:49.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36959.076696 secs 2024-04-21T20:40:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:48 smithi077 ceph-mon[27902]: pgmap v19800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36959.076696 secs 2024-04-21T20:40:49.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36960.833106 secs 2024-04-21T20:40:50.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36960.833106 secs 2024-04-21T20:40:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36960.833106 secs 2024-04-21T20:40:50.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:50 smithi191 ceph-mon[31636]: pgmap v19801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:51.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:50 smithi170 ceph-mon[31212]: pgmap v19801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:51.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:50 smithi077 ceph-mon[27902]: pgmap v19801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:52.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:52 smithi191 ceph-mon[31636]: pgmap v19802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:52 smithi170 ceph-mon[31212]: pgmap v19802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:52 smithi077 ceph-mon[27902]: pgmap v19802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:54.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36964.076812 secs 2024-04-21T20:40:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36964.076812 secs 2024-04-21T20:40:54.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36964.076812 secs 2024-04-21T20:40:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:54 smithi191 ceph-mon[31636]: pgmap v19803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36965.833223 secs 2024-04-21T20:40:54.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:40:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:54 smithi170 ceph-mon[31212]: pgmap v19803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36965.833223 secs 2024-04-21T20:40:55.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:40:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:40:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:54 smithi077 ceph-mon[27902]: pgmap v19803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36965.833223 secs 2024-04-21T20:40:55.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:40:56.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:40:56.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:40:56.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:40:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:40:56.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:40:56.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:40:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:40:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:40:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:40:57.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:56 smithi170 ceph-mon[31212]: pgmap v19804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:56 smithi077 ceph-mon[27902]: pgmap v19804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:56 smithi191 ceph-mon[31636]: pgmap v19804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:40:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:58 smithi170 ceph-mon[31212]: pgmap v19805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:59.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36969.076943 secs 2024-04-21T20:40:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:58 smithi077 ceph-mon[27902]: pgmap v19805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36969.076943 secs 2024-04-21T20:40:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:58 smithi191 ceph-mon[31636]: pgmap v19805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:40:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36969.076943 secs 2024-04-21T20:40:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:40:59.464+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:40:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:40:59.464+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:40:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:40:59.464+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:40:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:40:59.464+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:41:00.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36970.833313 secs 2024-04-21T20:41:00.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36970.833313 secs 2024-04-21T20:41:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36970.833313 secs 2024-04-21T20:41:01.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:00 smithi170 ceph-mon[31212]: pgmap v19806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:01.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:00 smithi077 ceph-mon[27902]: pgmap v19806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:01.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:00 smithi191 ceph-mon[31636]: pgmap v19806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:03.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:02 smithi170 ceph-mon[31212]: pgmap v19807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:03.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:02 smithi077 ceph-mon[27902]: pgmap v19807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:03.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:02 smithi191 ceph-mon[31636]: pgmap v19807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36974.077058 secs 2024-04-21T20:41:04.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:03 smithi170 ceph-mon[31212]: pgmap v19808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:04.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36974.077058 secs 2024-04-21T20:41:04.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:03 smithi077 ceph-mon[27902]: pgmap v19808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:04.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36974.077058 secs 2024-04-21T20:41:04.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:03 smithi191 ceph-mon[31636]: pgmap v19808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36975.833445 secs 2024-04-21T20:41:05.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:05.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36975.833445 secs 2024-04-21T20:41:05.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36975.833445 secs 2024-04-21T20:41:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:05 smithi170 ceph-mon[31212]: osdmap e1310: 12 total, 12 up, 12 in 2024-04-21T20:41:06.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:05 smithi170 ceph-mon[31212]: pgmap v19810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:41:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:05 smithi077 ceph-mon[27902]: osdmap e1310: 12 total, 12 up, 12 in 2024-04-21T20:41:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:05 smithi077 ceph-mon[27902]: pgmap v19810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:41:06.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:05 smithi191 ceph-mon[31636]: osdmap e1310: 12 total, 12 up, 12 in 2024-04-21T20:41:06.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:05 smithi191 ceph-mon[31636]: pgmap v19810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:41:08.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:07 smithi191 ceph-mon[31636]: pgmap v19811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:41:08.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:07 smithi170 ceph-mon[31212]: pgmap v19811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:41:08.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:07 smithi077 ceph-mon[27902]: pgmap v19811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:41:09.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36979.077167 secs 2024-04-21T20:41:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36979.077167 secs 2024-04-21T20:41:09.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36979.077167 secs 2024-04-21T20:41:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:10 smithi077 ceph-mon[27902]: pgmap v19812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:41:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36980.833564 secs 2024-04-21T20:41:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:10 smithi077 ceph-mon[27902]: osdmap e1311: 12 total, 12 up, 12 in 2024-04-21T20:41:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:10 smithi191 ceph-mon[31636]: pgmap v19812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:41:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36980.833564 secs 2024-04-21T20:41:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:10 smithi191 ceph-mon[31636]: osdmap e1311: 12 total, 12 up, 12 in 2024-04-21T20:41:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:10 smithi170 ceph-mon[31212]: pgmap v19812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:41:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36980.833564 secs 2024-04-21T20:41:11.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:10 smithi170 ceph-mon[31212]: osdmap e1311: 12 total, 12 up, 12 in 2024-04-21T20:41:12.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:12 smithi077 ceph-mon[27902]: pgmap v19814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:41:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:12 smithi191 ceph-mon[31636]: pgmap v19814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:41:13.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:12 smithi170 ceph-mon[31212]: pgmap v19814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:41:13.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36984.077280 secs 2024-04-21T20:41:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36984.077280 secs 2024-04-21T20:41:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36984.077280 secs 2024-04-21T20:41:14.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:14 smithi077 ceph-mon[27902]: pgmap v19815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:41:14.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:14 smithi191 ceph-mon[31636]: pgmap v19815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:41:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:14 smithi170 ceph-mon[31212]: pgmap v19815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 33 op/s 2024-04-21T20:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36985.833675 secs 2024-04-21T20:41:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36985.833675 secs 2024-04-21T20:41:16.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36985.833675 secs 2024-04-21T20:41:16.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:16 smithi077 ceph-mon[27902]: pgmap v19816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:41:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:16 smithi191 ceph-mon[31636]: pgmap v19816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:41:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:16 smithi170 ceph-mon[31212]: pgmap v19816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:41:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:18 smithi191 ceph-mon[31636]: pgmap v19817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:41:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36989.077353 secs 2024-04-21T20:41:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:18 smithi170 ceph-mon[31212]: pgmap v19817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:41:19.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36989.077353 secs 2024-04-21T20:41:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:18 smithi077 ceph-mon[27902]: pgmap v19817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:41:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36989.077353 secs 2024-04-21T20:41:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:20 smithi191 ceph-mon[31636]: pgmap v19818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:41:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36990.833739 secs 2024-04-21T20:41:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:20 smithi170 ceph-mon[31212]: pgmap v19818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:41:21.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36990.833739 secs 2024-04-21T20:41:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:20 smithi077 ceph-mon[27902]: pgmap v19818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:41:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36990.833739 secs 2024-04-21T20:41:22.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:22 smithi191 ceph-mon[31636]: pgmap v19819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:41:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:22 smithi170 ceph-mon[31212]: pgmap v19819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:41:23.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:22 smithi077 ceph-mon[27902]: pgmap v19819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:41:23.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36994.077488 secs 2024-04-21T20:41:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36994.077488 secs 2024-04-21T20:41:24.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36994.077488 secs 2024-04-21T20:41:24.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:24 smithi191 ceph-mon[31636]: pgmap v19820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:24 smithi170 ceph-mon[31212]: pgmap v19820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:25.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:24 smithi077 ceph-mon[27902]: pgmap v19820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:25.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 36995.833888 secs 2024-04-21T20:41:26.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 36995.833888 secs 2024-04-21T20:41:26.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 36995.833888 secs 2024-04-21T20:41:26.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:26 smithi191 ceph-mon[31636]: pgmap v19821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:26 smithi170 ceph-mon[31212]: pgmap v19821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:27.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:26 smithi077 ceph-mon[27902]: pgmap v19821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:28 smithi191 ceph-mon[31636]: pgmap v19822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:28.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 36999.077636 secs 2024-04-21T20:41:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:28 smithi170 ceph-mon[31212]: pgmap v19822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:29.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 36999.077636 secs 2024-04-21T20:41:29.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:28 smithi077 ceph-mon[27902]: pgmap v19822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:29.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 36999.077636 secs 2024-04-21T20:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:30.942 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:30 smithi077 ceph-mon[27902]: pgmap v19823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:30.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37000.833956 secs 2024-04-21T20:41:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:30 smithi191 ceph-mon[31636]: pgmap v19823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37000.833956 secs 2024-04-21T20:41:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:30 smithi170 ceph-mon[31212]: pgmap v19823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37000.833956 secs 2024-04-21T20:41:32.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:32 smithi191 ceph-mon[31636]: pgmap v19824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:33.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:32 smithi170 ceph-mon[31212]: pgmap v19824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:32 smithi077 ceph-mon[27902]: pgmap v19824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:33.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37004.077755 secs 2024-04-21T20:41:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37004.077755 secs 2024-04-21T20:41:34.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37004.077755 secs 2024-04-21T20:41:34.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:34 smithi191 ceph-mon[31636]: pgmap v19825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:34 smithi170 ceph-mon[31212]: pgmap v19825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:35.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:34 smithi077 ceph-mon[27902]: pgmap v19825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:35.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37005.834019 secs 2024-04-21T20:41:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37005.834019 secs 2024-04-21T20:41:36.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37005.834019 secs 2024-04-21T20:41:36.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:36 smithi191 ceph-mon[31636]: pgmap v19826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:36 smithi170 ceph-mon[31212]: pgmap v19826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:37.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:36 smithi077 ceph-mon[27902]: pgmap v19826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:38 smithi191 ceph-mon[31636]: pgmap v19827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:38.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37009.077861 secs 2024-04-21T20:41:39.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:38 smithi170 ceph-mon[31212]: pgmap v19827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:39.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37009.077861 secs 2024-04-21T20:41:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:38 smithi077 ceph-mon[27902]: pgmap v19827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:39.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37009.077861 secs 2024-04-21T20:41:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:40 smithi191 ceph-mon[31636]: pgmap v19828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:40.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37010.834138 secs 2024-04-21T20:41:41.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:40 smithi170 ceph-mon[31212]: pgmap v19828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:41.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37010.834138 secs 2024-04-21T20:41:41.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:40 smithi077 ceph-mon[27902]: pgmap v19828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:41.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37010.834138 secs 2024-04-21T20:41:42.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:42 smithi191 ceph-mon[31636]: pgmap v19829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:42 smithi170 ceph-mon[31212]: pgmap v19829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:43.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:42 smithi077 ceph-mon[27902]: pgmap v19829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:43.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37014.077982 secs 2024-04-21T20:41:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37014.077982 secs 2024-04-21T20:41:44.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37014.077982 secs 2024-04-21T20:41:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:44 smithi191 ceph-mon[31636]: pgmap v19830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:44.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37015.834214 secs 2024-04-21T20:41:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:44 smithi170 ceph-mon[31212]: pgmap v19830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37015.834214 secs 2024-04-21T20:41:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:44 smithi077 ceph-mon[27902]: pgmap v19830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:45.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37015.834214 secs 2024-04-21T20:41:46.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:46 smithi191 ceph-mon[31636]: pgmap v19831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:47.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:46 smithi170 ceph-mon[31212]: pgmap v19831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:47.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:46 smithi077 ceph-mon[27902]: pgmap v19831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:48 smithi191 ceph-mon[31636]: pgmap v19832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:48.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37019.078076 secs 2024-04-21T20:41:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:48 smithi170 ceph-mon[31212]: pgmap v19832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37019.078076 secs 2024-04-21T20:41:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:48 smithi077 ceph-mon[27902]: pgmap v19832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:49.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37019.078076 secs 2024-04-21T20:41:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37020.834328 secs 2024-04-21T20:41:50.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:50.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37020.834328 secs 2024-04-21T20:41:50.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37020.834328 secs 2024-04-21T20:41:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:50 smithi170 ceph-mon[31212]: pgmap v19833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:51.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:50 smithi077 ceph-mon[27902]: pgmap v19833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:51.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:50 smithi191 ceph-mon[31636]: pgmap v19833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:52 smithi170 ceph-mon[31212]: pgmap v19834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:53.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:52 smithi077 ceph-mon[27902]: pgmap v19834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:53.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:52 smithi191 ceph-mon[31636]: pgmap v19834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37024.078216 secs 2024-04-21T20:41:54.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37024.078216 secs 2024-04-21T20:41:54.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37024.078216 secs 2024-04-21T20:41:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:54 smithi170 ceph-mon[31212]: pgmap v19835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37025.834395 secs 2024-04-21T20:41:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:41:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:54 smithi077 ceph-mon[27902]: pgmap v19835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37025.834395 secs 2024-04-21T20:41:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:54 smithi191 ceph-mon[31636]: pgmap v19835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37025.834395 secs 2024-04-21T20:41:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:41:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:41:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:41:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:41:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:41:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:41:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:41:56.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:41:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:41:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:41:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:41:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:41:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:56 smithi170 ceph-mon[31212]: pgmap v19836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:56 smithi077 ceph-mon[27902]: pgmap v19836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:56 smithi191 ceph-mon[31636]: pgmap v19836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:41:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:58 smithi170 ceph-mon[31212]: pgmap v19837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:59.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:41:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37029.078316 secs 2024-04-21T20:41:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:58 smithi077 ceph-mon[27902]: pgmap v19837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:59.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:41:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37029.078316 secs 2024-04-21T20:41:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:58 smithi191 ceph-mon[31636]: pgmap v19837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:41:59.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:41:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37029.078316 secs 2024-04-21T20:42:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:00 smithi077 ceph-mon[27902]: pgmap v19838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:00.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37030.834529 secs 2024-04-21T20:42:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:00 smithi191 ceph-mon[31636]: pgmap v19838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:00.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37030.834529 secs 2024-04-21T20:42:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:00 smithi170 ceph-mon[31212]: pgmap v19838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:01.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37030.834529 secs 2024-04-21T20:42:02.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:02 smithi077 ceph-mon[27902]: pgmap v19839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:02.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:02 smithi191 ceph-mon[31636]: pgmap v19839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:03.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:02 smithi170 ceph-mon[31212]: pgmap v19839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:03.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37034.078402 secs 2024-04-21T20:42:04.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37034.078402 secs 2024-04-21T20:42:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37034.078402 secs 2024-04-21T20:42:04.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:04 smithi191 ceph-mon[31636]: pgmap v19840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:05.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:04 smithi170 ceph-mon[31212]: pgmap v19840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:05.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:04 smithi077 ceph-mon[27902]: pgmap v19840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37035.834669 secs 2024-04-21T20:42:05.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:05 smithi191 ceph-mon[31636]: osdmap e1312: 12 total, 12 up, 12 in 2024-04-21T20:42:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37035.834669 secs 2024-04-21T20:42:06.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:05 smithi170 ceph-mon[31212]: osdmap e1312: 12 total, 12 up, 12 in 2024-04-21T20:42:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37035.834669 secs 2024-04-21T20:42:06.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:05 smithi077 ceph-mon[27902]: osdmap e1312: 12 total, 12 up, 12 in 2024-04-21T20:42:06.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:06 smithi191 ceph-mon[31636]: pgmap v19842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:42:07.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:06 smithi170 ceph-mon[31212]: pgmap v19842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:42:07.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:06 smithi077 ceph-mon[27902]: pgmap v19842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:42:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:08 smithi191 ceph-mon[31636]: pgmap v19843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:42:08.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37039.078518 secs 2024-04-21T20:42:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:08 smithi170 ceph-mon[31212]: pgmap v19843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:42:09.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37039.078518 secs 2024-04-21T20:42:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:08 smithi077 ceph-mon[27902]: pgmap v19843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:42:09.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37039.078518 secs 2024-04-21T20:42:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:10 smithi077 ceph-mon[27902]: pgmap v19844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:42:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37040.834781 secs 2024-04-21T20:42:10.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:10 smithi077 ceph-mon[27902]: osdmap e1313: 12 total, 12 up, 12 in 2024-04-21T20:42:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:10 smithi191 ceph-mon[31636]: pgmap v19844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:42:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37040.834781 secs 2024-04-21T20:42:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:10 smithi191 ceph-mon[31636]: osdmap e1313: 12 total, 12 up, 12 in 2024-04-21T20:42:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:10 smithi170 ceph-mon[31212]: pgmap v19844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:42:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37040.834781 secs 2024-04-21T20:42:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:10 smithi170 ceph-mon[31212]: osdmap e1313: 12 total, 12 up, 12 in 2024-04-21T20:42:12.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:12 smithi191 ceph-mon[31636]: pgmap v19846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:42:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:12 smithi170 ceph-mon[31212]: pgmap v19846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:42:13.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:12 smithi077 ceph-mon[27902]: pgmap v19846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:42:13.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37044.078608 secs 2024-04-21T20:42:14.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37044.078608 secs 2024-04-21T20:42:14.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37044.078608 secs 2024-04-21T20:42:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:14 smithi191 ceph-mon[31636]: pgmap v19847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:42:15.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:14 smithi170 ceph-mon[31212]: pgmap v19847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:42:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:14 smithi077 ceph-mon[27902]: pgmap v19847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:42:15.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37045.834901 secs 2024-04-21T20:42:16.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37045.834901 secs 2024-04-21T20:42:16.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37045.834901 secs 2024-04-21T20:42:16.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:16 smithi191 ceph-mon[31636]: pgmap v19848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:42:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:16 smithi170 ceph-mon[31212]: pgmap v19848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:42:17.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:16 smithi077 ceph-mon[27902]: pgmap v19848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:42:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:18 smithi191 ceph-mon[31636]: pgmap v19849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:42:18.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37049.078755 secs 2024-04-21T20:42:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:18 smithi170 ceph-mon[31212]: pgmap v19849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:42:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37049.078755 secs 2024-04-21T20:42:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:18 smithi077 ceph-mon[27902]: pgmap v19849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:42:19.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37049.078755 secs 2024-04-21T20:42:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:20 smithi191 ceph-mon[31636]: pgmap v19850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:42:20.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37050.835017 secs 2024-04-21T20:42:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:20 smithi170 ceph-mon[31212]: pgmap v19850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:42:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37050.835017 secs 2024-04-21T20:42:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:20 smithi077 ceph-mon[27902]: pgmap v19850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:42:21.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37050.835017 secs 2024-04-21T20:42:22.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:22 smithi191 ceph-mon[31636]: pgmap v19851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:42:23.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:22 smithi170 ceph-mon[31212]: pgmap v19851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:42:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:22 smithi077 ceph-mon[27902]: pgmap v19851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:42:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37054.078832 secs 2024-04-21T20:42:24.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37054.078832 secs 2024-04-21T20:42:24.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37054.078832 secs 2024-04-21T20:42:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:24 smithi191 ceph-mon[31636]: pgmap v19852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:25.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:24 smithi170 ceph-mon[31212]: pgmap v19852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:24 smithi077 ceph-mon[27902]: pgmap v19852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37055.835136 secs 2024-04-21T20:42:26.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37055.835136 secs 2024-04-21T20:42:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37055.835136 secs 2024-04-21T20:42:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:26 smithi191 ceph-mon[31636]: pgmap v19853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:27.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:26 smithi170 ceph-mon[31212]: pgmap v19853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:26 smithi077 ceph-mon[27902]: pgmap v19853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:28 smithi191 ceph-mon[31636]: pgmap v19854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37059.078914 secs 2024-04-21T20:42:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:28 smithi170 ceph-mon[31212]: pgmap v19854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37059.078914 secs 2024-04-21T20:42:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:28 smithi077 ceph-mon[27902]: pgmap v19854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:29.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37059.078914 secs 2024-04-21T20:42:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:30 smithi191 ceph-mon[31636]: pgmap v19855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:30.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37060.835254 secs 2024-04-21T20:42:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:30 smithi170 ceph-mon[31212]: pgmap v19855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:31.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37060.835254 secs 2024-04-21T20:42:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:30 smithi077 ceph-mon[27902]: pgmap v19855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37060.835254 secs 2024-04-21T20:42:32.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:32 smithi191 ceph-mon[31636]: pgmap v19856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:33.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:32 smithi170 ceph-mon[31212]: pgmap v19856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:33.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:32 smithi077 ceph-mon[27902]: pgmap v19856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37064.079029 secs 2024-04-21T20:42:34.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37064.079029 secs 2024-04-21T20:42:34.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37064.079029 secs 2024-04-21T20:42:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:34 smithi191 ceph-mon[31636]: pgmap v19857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:34 smithi170 ceph-mon[31212]: pgmap v19857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:34 smithi077 ceph-mon[27902]: pgmap v19857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37065.835368 secs 2024-04-21T20:42:36.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37065.835368 secs 2024-04-21T20:42:36.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37065.835368 secs 2024-04-21T20:42:36.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:36 smithi191 ceph-mon[31636]: pgmap v19858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:37.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:36 smithi170 ceph-mon[31212]: pgmap v19858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:36 smithi077 ceph-mon[27902]: pgmap v19858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:38.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:38 smithi191 ceph-mon[31636]: pgmap v19859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:38.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37069.079170 secs 2024-04-21T20:42:39.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:38 smithi170 ceph-mon[31212]: pgmap v19859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:39.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37069.079170 secs 2024-04-21T20:42:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:38 smithi077 ceph-mon[27902]: pgmap v19859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37069.079170 secs 2024-04-21T20:42:39.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37070.835483 secs 2024-04-21T20:42:40.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37070.835483 secs 2024-04-21T20:42:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37070.835483 secs 2024-04-21T20:42:41.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:40 smithi170 ceph-mon[31212]: pgmap v19860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:40 smithi077 ceph-mon[27902]: pgmap v19860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:40 smithi191 ceph-mon[31636]: pgmap v19860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:43.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:42 smithi170 ceph-mon[31212]: pgmap v19861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:42 smithi077 ceph-mon[27902]: pgmap v19861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:42 smithi191 ceph-mon[31636]: pgmap v19861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:44.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37074.079281 secs 2024-04-21T20:42:44.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37074.079281 secs 2024-04-21T20:42:44.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37074.079281 secs 2024-04-21T20:42:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:44 smithi170 ceph-mon[31212]: pgmap v19862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37075.835599 secs 2024-04-21T20:42:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:44 smithi077 ceph-mon[27902]: pgmap v19862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37075.835599 secs 2024-04-21T20:42:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:44 smithi191 ceph-mon[31636]: pgmap v19862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:45.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37075.835599 secs 2024-04-21T20:42:47.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:46 smithi170 ceph-mon[31212]: pgmap v19863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:46 smithi077 ceph-mon[27902]: pgmap v19863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:46 smithi191 ceph-mon[31636]: pgmap v19863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:48 smithi170 ceph-mon[31212]: pgmap v19864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37079.079403 secs 2024-04-21T20:42:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:48 smithi077 ceph-mon[27902]: pgmap v19864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37079.079403 secs 2024-04-21T20:42:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:48 smithi191 ceph-mon[31636]: pgmap v19864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37079.079403 secs 2024-04-21T20:42:50.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37080.835731 secs 2024-04-21T20:42:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37080.835731 secs 2024-04-21T20:42:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37080.835731 secs 2024-04-21T20:42:51.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:50 smithi170 ceph-mon[31212]: pgmap v19865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:50 smithi077 ceph-mon[27902]: pgmap v19865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:50 smithi191 ceph-mon[31636]: pgmap v19865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:42:53.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:52 smithi170 ceph-mon[31212]: pgmap v19866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:52 smithi077 ceph-mon[27902]: pgmap v19866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:52 smithi191 ceph-mon[31636]: pgmap v19866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:54.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37084.079522 secs 2024-04-21T20:42:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37084.079522 secs 2024-04-21T20:42:54.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37084.079522 secs 2024-04-21T20:42:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:54 smithi170 ceph-mon[31212]: pgmap v19867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:42:55.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37085.835844 secs 2024-04-21T20:42:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:42:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:54 smithi077 ceph-mon[27902]: pgmap v19867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:42:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37085.835844 secs 2024-04-21T20:42:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:54 smithi191 ceph-mon[31636]: pgmap v19867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:42:55.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37085.835844 secs 2024-04-21T20:42:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:55 smithi170 ceph-mon[31212]: pgmap v19868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:42:56.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:42:56.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:55 smithi077 ceph-mon[27902]: pgmap v19868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:42:56.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:42:56.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:55 smithi191 ceph-mon[31636]: pgmap v19868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:42:56.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:42:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:42:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:42:57.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:42:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:42:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:42:57.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:42:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:42:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:42:57.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:42:58.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:57 smithi170 ceph-mon[31212]: pgmap v19869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:58.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:57 smithi077 ceph-mon[27902]: pgmap v19869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:57 smithi191 ceph-mon[31636]: pgmap v19869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:42:59.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37089.079669 secs 2024-04-21T20:42:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37089.079669 secs 2024-04-21T20:42:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37089.079669 secs 2024-04-21T20:43:00.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:59 smithi077 ceph-mon[27902]: pgmap v19870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:00.041 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:42:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37090.835964 secs 2024-04-21T20:43:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:59 smithi170 ceph-mon[31212]: pgmap v19870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:00.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:42:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37090.835964 secs 2024-04-21T20:43:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:59 smithi191 ceph-mon[31636]: pgmap v19870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:42:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37090.835964 secs 2024-04-21T20:43:02.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:01 smithi191 ceph-mon[31636]: pgmap v19871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:02.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:01 smithi170 ceph-mon[31212]: pgmap v19871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:02.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:01 smithi077 ceph-mon[27902]: pgmap v19871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:04.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37094.079780 secs 2024-04-21T20:43:04.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:03 smithi191 ceph-mon[31636]: pgmap v19872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37094.079780 secs 2024-04-21T20:43:04.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:03 smithi170 ceph-mon[31212]: pgmap v19872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37094.079780 secs 2024-04-21T20:43:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:03 smithi077 ceph-mon[27902]: pgmap v19872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37095.836070 secs 2024-04-21T20:43:05.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37095.836070 secs 2024-04-21T20:43:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37095.836070 secs 2024-04-21T20:43:06.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:05 smithi191 ceph-mon[31636]: pgmap v19873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:06.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:05 smithi191 ceph-mon[31636]: osdmap e1314: 12 total, 12 up, 12 in 2024-04-21T20:43:06.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:05 smithi170 ceph-mon[31212]: pgmap v19873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:06.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:05 smithi170 ceph-mon[31212]: osdmap e1314: 12 total, 12 up, 12 in 2024-04-21T20:43:06.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:05 smithi077 ceph-mon[27902]: pgmap v19873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:06.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:05 smithi077 ceph-mon[27902]: osdmap e1314: 12 total, 12 up, 12 in 2024-04-21T20:43:08.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:07 smithi191 ceph-mon[31636]: pgmap v19875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:43:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:07 smithi170 ceph-mon[31212]: pgmap v19875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:43:08.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:07 smithi077 ceph-mon[27902]: pgmap v19875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:43:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37099.079870 secs 2024-04-21T20:43:09.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37099.079870 secs 2024-04-21T20:43:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37099.079870 secs 2024-04-21T20:43:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:10 smithi191 ceph-mon[31636]: pgmap v19876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:43:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37100.836178 secs 2024-04-21T20:43:10.973 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:10 smithi191 ceph-mon[31636]: osdmap e1315: 12 total, 12 up, 12 in 2024-04-21T20:43:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:10 smithi170 ceph-mon[31212]: pgmap v19876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:43:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37100.836178 secs 2024-04-21T20:43:11.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:10 smithi170 ceph-mon[31212]: osdmap e1315: 12 total, 12 up, 12 in 2024-04-21T20:43:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:10 smithi077 ceph-mon[27902]: pgmap v19876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:43:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37100.836178 secs 2024-04-21T20:43:11.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:10 smithi077 ceph-mon[27902]: osdmap e1315: 12 total, 12 up, 12 in 2024-04-21T20:43:12.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:12 smithi191 ceph-mon[31636]: pgmap v19878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:43:13.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:12 smithi170 ceph-mon[31212]: pgmap v19878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:43:13.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:12 smithi077 ceph-mon[27902]: pgmap v19878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:43:13.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37104.079944 secs 2024-04-21T20:43:14.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37104.079944 secs 2024-04-21T20:43:14.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37104.079944 secs 2024-04-21T20:43:14.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:14 smithi191 ceph-mon[31636]: pgmap v19879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:43:15.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:14 smithi170 ceph-mon[31212]: pgmap v19879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:43:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:15.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:14 smithi077 ceph-mon[27902]: pgmap v19879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:43:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37105.836323 secs 2024-04-21T20:43:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37105.836323 secs 2024-04-21T20:43:16.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37105.836323 secs 2024-04-21T20:43:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:16 smithi191 ceph-mon[31636]: pgmap v19880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:43:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:16 smithi170 ceph-mon[31212]: pgmap v19880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:43:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:16 smithi077 ceph-mon[27902]: pgmap v19880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:43:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:18 smithi191 ceph-mon[31636]: pgmap v19881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:43:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37109.080062 secs 2024-04-21T20:43:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:18 smithi170 ceph-mon[31212]: pgmap v19881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:43:19.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37109.080062 secs 2024-04-21T20:43:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:18 smithi077 ceph-mon[27902]: pgmap v19881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:43:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37109.080062 secs 2024-04-21T20:43:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:20 smithi191 ceph-mon[31636]: pgmap v19882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:43:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37110.836441 secs 2024-04-21T20:43:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:20 smithi170 ceph-mon[31212]: pgmap v19882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:43:21.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37110.836441 secs 2024-04-21T20:43:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:20 smithi077 ceph-mon[27902]: pgmap v19882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:43:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37110.836441 secs 2024-04-21T20:43:22.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:22 smithi191 ceph-mon[31636]: pgmap v19883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:43:23.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:22 smithi170 ceph-mon[31212]: pgmap v19883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:43:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:22 smithi077 ceph-mon[27902]: pgmap v19883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:43:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37114.080137 secs 2024-04-21T20:43:24.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37114.080137 secs 2024-04-21T20:43:24.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37114.080137 secs 2024-04-21T20:43:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:24 smithi191 ceph-mon[31636]: pgmap v19884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:25.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:24 smithi170 ceph-mon[31212]: pgmap v19884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:25.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:24 smithi077 ceph-mon[27902]: pgmap v19884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37115.836555 secs 2024-04-21T20:43:26.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37115.836555 secs 2024-04-21T20:43:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37115.836555 secs 2024-04-21T20:43:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:26 smithi191 ceph-mon[31636]: pgmap v19885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:27.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:26 smithi170 ceph-mon[31212]: pgmap v19885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:26 smithi077 ceph-mon[27902]: pgmap v19885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:28 smithi191 ceph-mon[31636]: pgmap v19886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37119.080248 secs 2024-04-21T20:43:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:28 smithi170 ceph-mon[31212]: pgmap v19886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:29.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37119.080248 secs 2024-04-21T20:43:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:28 smithi077 ceph-mon[27902]: pgmap v19886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37119.080248 secs 2024-04-21T20:43:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:30 smithi191 ceph-mon[31636]: pgmap v19887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37120.836626 secs 2024-04-21T20:43:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:30 smithi170 ceph-mon[31212]: pgmap v19887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37120.836626 secs 2024-04-21T20:43:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:30 smithi077 ceph-mon[27902]: pgmap v19887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37120.836626 secs 2024-04-21T20:43:32.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:32 smithi191 ceph-mon[31636]: pgmap v19888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:33.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:32 smithi170 ceph-mon[31212]: pgmap v19888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:32 smithi077 ceph-mon[27902]: pgmap v19888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37124.080363 secs 2024-04-21T20:43:34.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37124.080363 secs 2024-04-21T20:43:34.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37124.080363 secs 2024-04-21T20:43:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:34 smithi191 ceph-mon[31636]: pgmap v19889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:35.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:34 smithi170 ceph-mon[31212]: pgmap v19889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:34 smithi077 ceph-mon[27902]: pgmap v19889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:36.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37125.836738 secs 2024-04-21T20:43:36.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37125.836738 secs 2024-04-21T20:43:36.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37125.836738 secs 2024-04-21T20:43:37.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:36 smithi170 ceph-mon[31212]: pgmap v19890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:36 smithi077 ceph-mon[27902]: pgmap v19890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:37.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:36 smithi191 ceph-mon[31636]: pgmap v19890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:38 smithi170 ceph-mon[31212]: pgmap v19891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37129.080478 secs 2024-04-21T20:43:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:38 smithi077 ceph-mon[27902]: pgmap v19891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37129.080478 secs 2024-04-21T20:43:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:38 smithi191 ceph-mon[31636]: pgmap v19891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37129.080478 secs 2024-04-21T20:43:40.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37130.836875 secs 2024-04-21T20:43:40.123 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37130.836875 secs 2024-04-21T20:43:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:40.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37130.836875 secs 2024-04-21T20:43:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:40 smithi170 ceph-mon[31212]: pgmap v19892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:40 smithi077 ceph-mon[27902]: pgmap v19892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:41.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:40 smithi191 ceph-mon[31636]: pgmap v19892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:43:43.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:42 smithi170 ceph-mon[31212]: pgmap v19893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:42 smithi077 ceph-mon[27902]: pgmap v19893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:42 smithi191 ceph-mon[31636]: pgmap v19893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:44.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37134.080596 secs 2024-04-21T20:43:44.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37134.080596 secs 2024-04-21T20:43:44.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37134.080596 secs 2024-04-21T20:43:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:44 smithi170 ceph-mon[31212]: pgmap v19894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:45.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37135.836990 secs 2024-04-21T20:43:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:44 smithi077 ceph-mon[27902]: pgmap v19894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37135.836990 secs 2024-04-21T20:43:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:44 smithi191 ceph-mon[31636]: pgmap v19894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37135.836990 secs 2024-04-21T20:43:47.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:46 smithi170 ceph-mon[31212]: pgmap v19895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:46 smithi077 ceph-mon[27902]: pgmap v19895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:46 smithi191 ceph-mon[31636]: pgmap v19895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:48 smithi170 ceph-mon[31212]: pgmap v19896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:49.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37139.080672 secs 2024-04-21T20:43:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:48 smithi077 ceph-mon[27902]: pgmap v19896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:49.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37139.080672 secs 2024-04-21T20:43:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:48 smithi191 ceph-mon[31636]: pgmap v19896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37139.080672 secs 2024-04-21T20:43:50.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37140.837124 secs 2024-04-21T20:43:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:50.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37140.837124 secs 2024-04-21T20:43:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37140.837124 secs 2024-04-21T20:43:51.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:50 smithi170 ceph-mon[31212]: pgmap v19897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:50 smithi077 ceph-mon[27902]: pgmap v19897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:50 smithi191 ceph-mon[31636]: pgmap v19897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:52.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:51 smithi170 ceph-mon[31212]: pgmap v19898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:52.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:51 smithi077 ceph-mon[27902]: pgmap v19898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:52.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:51 smithi191 ceph-mon[31636]: pgmap v19898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:54.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37144.080794 secs 2024-04-21T20:43:54.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:53 smithi191 ceph-mon[31636]: pgmap v19899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:54.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37144.080794 secs 2024-04-21T20:43:54.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:53 smithi170 ceph-mon[31212]: pgmap v19899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:54.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37144.080794 secs 2024-04-21T20:43:54.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:53 smithi077 ceph-mon[27902]: pgmap v19899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.463+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T20:43:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.463+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T20:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.463+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.463+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T20:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T20:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.464+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T20:43:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T20:43:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T20:43:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7003d000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:43:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7003d000 comp rx=0 tx=0).stop 2024-04-21T20:43:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T20:43:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T20:43:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T20:43:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T20:43:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.543+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:43:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:54.544+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7005c000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T20:43:55.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:43:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37145.837242 secs 2024-04-21T20:43:55.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37145.837242 secs 2024-04-21T20:43:55.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37145.837242 secs 2024-04-21T20:43:56.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:55 smithi191 ceph-mon[31636]: pgmap v19900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:56.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:55 smithi170 ceph-mon[31212]: pgmap v19900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:56.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:55 smithi077 ceph-mon[27902]: pgmap v19900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:43:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:56 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:43:57.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:56 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:43:57.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:56 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:43:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:57 smithi191 ceph-mon[31636]: pgmap v19901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:43:58.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:43:58.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:43:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:57 smithi170 ceph-mon[31212]: pgmap v19901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:43:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:43:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:43:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:57 smithi077 ceph-mon[27902]: pgmap v19901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:43:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:43:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:43:58.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:43:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37149.080927 secs 2024-04-21T20:43:59.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37149.080927 secs 2024-04-21T20:43:59.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37149.080927 secs 2024-04-21T20:43:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:59.489+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:43:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:59.489+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:43:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:59.489+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:43:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:43:59.489+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:44:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:59 smithi191 ceph-mon[31636]: pgmap v19902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:43:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37150.837364 secs 2024-04-21T20:44:00.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:59 smithi077 ceph-mon[27902]: pgmap v19902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:00.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:43:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37150.837364 secs 2024-04-21T20:44:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:59 smithi170 ceph-mon[31212]: pgmap v19902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:43:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37150.837364 secs 2024-04-21T20:44:02.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:01 smithi191 ceph-mon[31636]: pgmap v19903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:02.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:01 smithi170 ceph-mon[31212]: pgmap v19903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:02.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:01 smithi077 ceph-mon[27902]: pgmap v19903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:04.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37154.081044 secs 2024-04-21T20:44:04.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:03 smithi191 ceph-mon[31636]: pgmap v19904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37154.081044 secs 2024-04-21T20:44:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:03 smithi170 ceph-mon[31212]: pgmap v19904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37154.081044 secs 2024-04-21T20:44:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:03 smithi077 ceph-mon[27902]: pgmap v19904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:05.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37155.837439 secs 2024-04-21T20:44:05.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37155.837439 secs 2024-04-21T20:44:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37155.837439 secs 2024-04-21T20:44:06.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:05 smithi191 ceph-mon[31636]: pgmap v19905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:06.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:05 smithi191 ceph-mon[31636]: osdmap e1316: 12 total, 12 up, 12 in 2024-04-21T20:44:06.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:05 smithi170 ceph-mon[31212]: pgmap v19905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:06.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:05 smithi170 ceph-mon[31212]: osdmap e1316: 12 total, 12 up, 12 in 2024-04-21T20:44:06.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:05 smithi077 ceph-mon[27902]: pgmap v19905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:06.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:05 smithi077 ceph-mon[27902]: osdmap e1316: 12 total, 12 up, 12 in 2024-04-21T20:44:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:07 smithi170 ceph-mon[31212]: pgmap v19907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:44:08.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:07 smithi077 ceph-mon[27902]: pgmap v19907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:44:08.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:07 smithi191 ceph-mon[31636]: pgmap v19907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:44:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37159.081160 secs 2024-04-21T20:44:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37159.081160 secs 2024-04-21T20:44:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37159.081160 secs 2024-04-21T20:44:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:09 smithi170 ceph-mon[31212]: pgmap v19908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:44:10.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37160.837573 secs 2024-04-21T20:44:10.373 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:09 smithi191 ceph-mon[31636]: pgmap v19908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:44:10.373 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37160.837573 secs 2024-04-21T20:44:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:09 smithi077 ceph-mon[27902]: pgmap v19908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:44:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37160.837573 secs 2024-04-21T20:44:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:11 smithi170 ceph-mon[31212]: pgmap v19909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:44:12.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:11 smithi077 ceph-mon[27902]: pgmap v19909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:44:12.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:11 smithi191 ceph-mon[31636]: pgmap v19909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:44:14.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37164.081280 secs 2024-04-21T20:44:14.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:13 smithi170 ceph-mon[31212]: pgmap v19910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:44:14.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37164.081280 secs 2024-04-21T20:44:14.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:13 smithi077 ceph-mon[27902]: pgmap v19910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:44:14.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37164.081280 secs 2024-04-21T20:44:14.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:13 smithi191 ceph-mon[31636]: pgmap v19910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:44:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37165.837708 secs 2024-04-21T20:44:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:15 smithi191 ceph-mon[31636]: osdmap e1317: 12 total, 12 up, 12 in 2024-04-21T20:44:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37165.837708 secs 2024-04-21T20:44:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:15 smithi170 ceph-mon[31212]: osdmap e1317: 12 total, 12 up, 12 in 2024-04-21T20:44:16.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37165.837708 secs 2024-04-21T20:44:16.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:15 smithi077 ceph-mon[27902]: osdmap e1317: 12 total, 12 up, 12 in 2024-04-21T20:44:16.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:16 smithi191 ceph-mon[31636]: pgmap v19912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:44:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:16 smithi170 ceph-mon[31212]: pgmap v19912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:44:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:16 smithi077 ceph-mon[27902]: pgmap v19912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T20:44:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:18 smithi191 ceph-mon[31636]: pgmap v19913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:44:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37169.081392 secs 2024-04-21T20:44:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:18 smithi170 ceph-mon[31212]: pgmap v19913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:44:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37169.081392 secs 2024-04-21T20:44:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:18 smithi077 ceph-mon[27902]: pgmap v19913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:44:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37169.081392 secs 2024-04-21T20:44:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:20 smithi191 ceph-mon[31636]: pgmap v19914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:44:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37170.837786 secs 2024-04-21T20:44:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:20 smithi170 ceph-mon[31212]: pgmap v19914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:44:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37170.837786 secs 2024-04-21T20:44:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:20 smithi077 ceph-mon[27902]: pgmap v19914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:44:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37170.837786 secs 2024-04-21T20:44:22.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:22 smithi191 ceph-mon[31636]: pgmap v19915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:44:23.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:22 smithi170 ceph-mon[31212]: pgmap v19915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:44:23.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:22 smithi077 ceph-mon[27902]: pgmap v19915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:44:23.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37174.081528 secs 2024-04-21T20:44:24.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37174.081528 secs 2024-04-21T20:44:24.141 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37174.081528 secs 2024-04-21T20:44:24.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:24 smithi191 ceph-mon[31636]: pgmap v19916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:44:25.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:24 smithi170 ceph-mon[31212]: pgmap v19916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:44:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:24 smithi077 ceph-mon[27902]: pgmap v19916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:44:25.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37175.837883 secs 2024-04-21T20:44:26.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37175.837883 secs 2024-04-21T20:44:26.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37175.837883 secs 2024-04-21T20:44:26.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:26 smithi191 ceph-mon[31636]: pgmap v19917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:44:27.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:26 smithi170 ceph-mon[31212]: pgmap v19917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:44:27.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:26 smithi077 ceph-mon[27902]: pgmap v19917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:44:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:28 smithi191 ceph-mon[31636]: pgmap v19918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37179.081663 secs 2024-04-21T20:44:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:28 smithi170 ceph-mon[31212]: pgmap v19918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37179.081663 secs 2024-04-21T20:44:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:28 smithi077 ceph-mon[27902]: pgmap v19918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37179.081663 secs 2024-04-21T20:44:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:30 smithi191 ceph-mon[31636]: pgmap v19919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37180.837960 secs 2024-04-21T20:44:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:30 smithi170 ceph-mon[31212]: pgmap v19919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37180.837960 secs 2024-04-21T20:44:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:30 smithi077 ceph-mon[27902]: pgmap v19919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37180.837960 secs 2024-04-21T20:44:32.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:32 smithi191 ceph-mon[31636]: pgmap v19920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:33.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:32 smithi170 ceph-mon[31212]: pgmap v19920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:32 smithi077 ceph-mon[27902]: pgmap v19920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:33.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37184.081744 secs 2024-04-21T20:44:34.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37184.081744 secs 2024-04-21T20:44:34.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37184.081744 secs 2024-04-21T20:44:34.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:34 smithi191 ceph-mon[31636]: pgmap v19921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:35.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:34 smithi170 ceph-mon[31212]: pgmap v19921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:35.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:34 smithi077 ceph-mon[27902]: pgmap v19921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:35.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37185.838034 secs 2024-04-21T20:44:36.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37185.838034 secs 2024-04-21T20:44:36.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37185.838034 secs 2024-04-21T20:44:37.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:36 smithi170 ceph-mon[31212]: pgmap v19922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:37.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:36 smithi077 ceph-mon[27902]: pgmap v19922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:37.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:36 smithi191 ceph-mon[31636]: pgmap v19922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:38 smithi170 ceph-mon[31212]: pgmap v19923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37189.081873 secs 2024-04-21T20:44:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:38 smithi077 ceph-mon[27902]: pgmap v19923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:39.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37189.081873 secs 2024-04-21T20:44:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:38 smithi191 ceph-mon[31636]: pgmap v19923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37189.081873 secs 2024-04-21T20:44:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:41.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:40 smithi191 ceph-mon[31636]: pgmap v19924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:41.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37190.838145 secs 2024-04-21T20:44:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:40 smithi170 ceph-mon[31212]: pgmap v19924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37190.838145 secs 2024-04-21T20:44:41.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:40 smithi077 ceph-mon[27902]: pgmap v19924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:41.142 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37190.838145 secs 2024-04-21T20:44:43.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:42 smithi170 ceph-mon[31212]: pgmap v19925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:42 smithi077 ceph-mon[27902]: pgmap v19925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:42 smithi191 ceph-mon[31636]: pgmap v19925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:44.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37194.081969 secs 2024-04-21T20:44:44.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37194.081969 secs 2024-04-21T20:44:44.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37194.081969 secs 2024-04-21T20:44:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:44 smithi170 ceph-mon[31212]: pgmap v19926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37195.838228 secs 2024-04-21T20:44:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:44 smithi077 ceph-mon[27902]: pgmap v19926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37195.838228 secs 2024-04-21T20:44:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:44 smithi191 ceph-mon[31636]: pgmap v19926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:45.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37195.838228 secs 2024-04-21T20:44:47.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:46 smithi170 ceph-mon[31212]: pgmap v19927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:47.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:46 smithi077 ceph-mon[27902]: pgmap v19927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:47.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:46 smithi191 ceph-mon[31636]: pgmap v19927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:48 smithi170 ceph-mon[31212]: pgmap v19928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37199.082086 secs 2024-04-21T20:44:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:48 smithi077 ceph-mon[27902]: pgmap v19928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37199.082086 secs 2024-04-21T20:44:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:48 smithi191 ceph-mon[31636]: pgmap v19928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37199.082086 secs 2024-04-21T20:44:50.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37200.838306 secs 2024-04-21T20:44:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:50.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37200.838306 secs 2024-04-21T20:44:50.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37200.838306 secs 2024-04-21T20:44:51.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:50 smithi170 ceph-mon[31212]: pgmap v19929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:51.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:50 smithi077 ceph-mon[27902]: pgmap v19929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:51.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:50 smithi191 ceph-mon[31636]: pgmap v19929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:53.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:52 smithi170 ceph-mon[31212]: pgmap v19930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:53.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:52 smithi077 ceph-mon[27902]: pgmap v19930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:53.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:52 smithi191 ceph-mon[31636]: pgmap v19930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:54.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37204.082163 secs 2024-04-21T20:44:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37204.082163 secs 2024-04-21T20:44:54.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37204.082163 secs 2024-04-21T20:44:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:54 smithi170 ceph-mon[31212]: pgmap v19931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37205.838376 secs 2024-04-21T20:44:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:44:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:54 smithi077 ceph-mon[27902]: pgmap v19931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:55.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37205.838376 secs 2024-04-21T20:44:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:54 smithi191 ceph-mon[31636]: pgmap v19931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37205.838376 secs 2024-04-21T20:44:57.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:56 smithi170 ceph-mon[31212]: pgmap v19932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:57.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:56 smithi077 ceph-mon[27902]: pgmap v19932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:56 smithi191 ceph-mon[31636]: pgmap v19932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:44:58.044 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:57 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:44:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:57 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:44:58.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:57 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:44:59.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:58 smithi170 ceph-mon[31212]: pgmap v19933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:59.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37209.082254 secs 2024-04-21T20:44:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:58 smithi077 ceph-mon[27902]: pgmap v19933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37209.082254 secs 2024-04-21T20:44:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:58 smithi191 ceph-mon[31636]: pgmap v19933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:44:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37209.082254 secs 2024-04-21T20:45:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: pgmap v19934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:00.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37210.838444 secs 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:45:00.224 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:44:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: pgmap v19934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37210.838444 secs 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:45:00.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:45:00.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:45:00.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:45:00.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:44:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: pgmap v19934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:00.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.398 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37210.838444 secs 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.399 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:45:00.400 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:44:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:45:02.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:01 smithi191 ceph-mon[31636]: pgmap v19935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T20:45:02.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:01 smithi170 ceph-mon[31212]: pgmap v19935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T20:45:02.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:01 smithi077 ceph-mon[27902]: pgmap v19935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T20:45:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37214.082367 secs 2024-04-21T20:45:04.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:03 smithi191 ceph-mon[31636]: pgmap v19936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T20:45:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37214.082367 secs 2024-04-21T20:45:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:03 smithi170 ceph-mon[31212]: pgmap v19936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T20:45:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37214.082367 secs 2024-04-21T20:45:04.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:03 smithi077 ceph-mon[27902]: pgmap v19936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T20:45:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37215.838579 secs 2024-04-21T20:45:05.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37215.838579 secs 2024-04-21T20:45:05.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37215.838579 secs 2024-04-21T20:45:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:05 smithi191 ceph-mon[31636]: pgmap v19937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T20:45:06.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:05 smithi191 ceph-mon[31636]: osdmap e1318: 12 total, 12 up, 12 in 2024-04-21T20:45:06.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:05 smithi170 ceph-mon[31212]: pgmap v19937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T20:45:06.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:05 smithi170 ceph-mon[31212]: osdmap e1318: 12 total, 12 up, 12 in 2024-04-21T20:45:06.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:05 smithi077 ceph-mon[27902]: pgmap v19937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-04-21T20:45:06.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:05 smithi077 ceph-mon[27902]: osdmap e1318: 12 total, 12 up, 12 in 2024-04-21T20:45:08.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:07 smithi191 ceph-mon[31636]: pgmap v19939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:45:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:07 smithi170 ceph-mon[31212]: pgmap v19939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:45:08.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:07 smithi077 ceph-mon[27902]: pgmap v19939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:45:09.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37219.082485 secs 2024-04-21T20:45:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37219.082485 secs 2024-04-21T20:45:09.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37219.082485 secs 2024-04-21T20:45:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:10.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:09 smithi191 ceph-mon[31636]: pgmap v19940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:45:10.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37220.838695 secs 2024-04-21T20:45:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:09 smithi170 ceph-mon[31212]: pgmap v19940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:45:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37220.838695 secs 2024-04-21T20:45:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:09 smithi077 ceph-mon[27902]: pgmap v19940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:45:10.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37220.838695 secs 2024-04-21T20:45:12.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:11 smithi191 ceph-mon[31636]: pgmap v19941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:45:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:11 smithi170 ceph-mon[31212]: pgmap v19941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:45:12.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:11 smithi077 ceph-mon[27902]: pgmap v19941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:45:14.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37224.082576 secs 2024-04-21T20:45:14.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:13 smithi191 ceph-mon[31636]: pgmap v19942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:45:14.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37224.082576 secs 2024-04-21T20:45:14.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:13 smithi170 ceph-mon[31212]: pgmap v19942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:45:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37224.082576 secs 2024-04-21T20:45:14.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:13 smithi077 ceph-mon[27902]: pgmap v19942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:45:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37225.838806 secs 2024-04-21T20:45:15.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:15 smithi191 ceph-mon[31636]: osdmap e1319: 12 total, 12 up, 12 in 2024-04-21T20:45:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37225.838806 secs 2024-04-21T20:45:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:15 smithi170 ceph-mon[31212]: osdmap e1319: 12 total, 12 up, 12 in 2024-04-21T20:45:16.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37225.838806 secs 2024-04-21T20:45:16.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:15 smithi077 ceph-mon[27902]: osdmap e1319: 12 total, 12 up, 12 in 2024-04-21T20:45:16.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:16 smithi191 ceph-mon[31636]: pgmap v19944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 308 B/s wr, 6 op/s 2024-04-21T20:45:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:16 smithi170 ceph-mon[31212]: pgmap v19944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 308 B/s wr, 6 op/s 2024-04-21T20:45:17.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:16 smithi077 ceph-mon[27902]: pgmap v19944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 308 B/s wr, 6 op/s 2024-04-21T20:45:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:18 smithi191 ceph-mon[31636]: pgmap v19945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:45:18.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37229.082673 secs 2024-04-21T20:45:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:18 smithi170 ceph-mon[31212]: pgmap v19945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:45:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37229.082673 secs 2024-04-21T20:45:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:18 smithi077 ceph-mon[27902]: pgmap v19945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:45:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37229.082673 secs 2024-04-21T20:45:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:20 smithi191 ceph-mon[31636]: pgmap v19946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:45:20.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37230.838886 secs 2024-04-21T20:45:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:20 smithi170 ceph-mon[31212]: pgmap v19946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:45:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37230.838886 secs 2024-04-21T20:45:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:20 smithi077 ceph-mon[27902]: pgmap v19946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:45:21.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37230.838886 secs 2024-04-21T20:45:22.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:22 smithi191 ceph-mon[31636]: pgmap v19947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:45:23.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:22 smithi170 ceph-mon[31212]: pgmap v19947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:45:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:22 smithi077 ceph-mon[27902]: pgmap v19947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:45:23.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37234.082807 secs 2024-04-21T20:45:24.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37234.082807 secs 2024-04-21T20:45:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37234.082807 secs 2024-04-21T20:45:24.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:24 smithi191 ceph-mon[31636]: pgmap v19948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:45:25.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:24 smithi170 ceph-mon[31212]: pgmap v19948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:45:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:24 smithi077 ceph-mon[27902]: pgmap v19948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:45:25.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37235.838947 secs 2024-04-21T20:45:26.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37235.838947 secs 2024-04-21T20:45:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37235.838947 secs 2024-04-21T20:45:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:26 smithi191 ceph-mon[31636]: pgmap v19949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:45:27.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:26 smithi170 ceph-mon[31212]: pgmap v19949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:45:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:26 smithi077 ceph-mon[27902]: pgmap v19949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:45:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:28 smithi191 ceph-mon[31636]: pgmap v19950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:28.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37239.082926 secs 2024-04-21T20:45:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:28 smithi170 ceph-mon[31212]: pgmap v19950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37239.082926 secs 2024-04-21T20:45:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:28 smithi077 ceph-mon[27902]: pgmap v19950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37239.082926 secs 2024-04-21T20:45:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:30 smithi191 ceph-mon[31636]: pgmap v19951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:30.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37240.839039 secs 2024-04-21T20:45:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:30 smithi170 ceph-mon[31212]: pgmap v19951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37240.839039 secs 2024-04-21T20:45:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:30 smithi077 ceph-mon[27902]: pgmap v19951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:31.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37240.839039 secs 2024-04-21T20:45:32.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:32 smithi191 ceph-mon[31636]: pgmap v19952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:33.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:32 smithi170 ceph-mon[31212]: pgmap v19952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:33.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:32 smithi077 ceph-mon[27902]: pgmap v19952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:34.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37244.083039 secs 2024-04-21T20:45:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37244.083039 secs 2024-04-21T20:45:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37244.083039 secs 2024-04-21T20:45:35.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:34 smithi170 ceph-mon[31212]: pgmap v19953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:34 smithi077 ceph-mon[27902]: pgmap v19953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:34 smithi191 ceph-mon[31636]: pgmap v19953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:36.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37245.839158 secs 2024-04-21T20:45:36.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37245.839158 secs 2024-04-21T20:45:36.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37245.839158 secs 2024-04-21T20:45:37.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:36 smithi170 ceph-mon[31212]: pgmap v19954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:36 smithi077 ceph-mon[27902]: pgmap v19954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:36 smithi191 ceph-mon[31636]: pgmap v19954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:38 smithi170 ceph-mon[31212]: pgmap v19955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37249.083159 secs 2024-04-21T20:45:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:38 smithi077 ceph-mon[27902]: pgmap v19955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37249.083159 secs 2024-04-21T20:45:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:38 smithi191 ceph-mon[31636]: pgmap v19955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:39.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37249.083159 secs 2024-04-21T20:45:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:40 smithi170 ceph-mon[31212]: pgmap v19956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37250.839237 secs 2024-04-21T20:45:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:40 smithi077 ceph-mon[27902]: pgmap v19956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:41.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37250.839237 secs 2024-04-21T20:45:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:40 smithi191 ceph-mon[31636]: pgmap v19956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37250.839237 secs 2024-04-21T20:45:43.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:42 smithi191 ceph-mon[31636]: pgmap v19957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:43.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:42 smithi170 ceph-mon[31212]: pgmap v19957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:42 smithi077 ceph-mon[27902]: pgmap v19957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:44.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37254.083268 secs 2024-04-21T20:45:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37254.083268 secs 2024-04-21T20:45:44.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37254.083268 secs 2024-04-21T20:45:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:44 smithi170 ceph-mon[31212]: pgmap v19958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37255.839343 secs 2024-04-21T20:45:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:44 smithi077 ceph-mon[27902]: pgmap v19958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37255.839343 secs 2024-04-21T20:45:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:44 smithi191 ceph-mon[31636]: pgmap v19958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37255.839343 secs 2024-04-21T20:45:47.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:46 smithi170 ceph-mon[31212]: pgmap v19959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:46 smithi077 ceph-mon[27902]: pgmap v19959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:47.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:46 smithi191 ceph-mon[31636]: pgmap v19959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:48 smithi170 ceph-mon[31212]: pgmap v19960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37259.083380 secs 2024-04-21T20:45:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:48 smithi077 ceph-mon[27902]: pgmap v19960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37259.083380 secs 2024-04-21T20:45:49.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:48 smithi191 ceph-mon[31636]: pgmap v19960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:49.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37259.083380 secs 2024-04-21T20:45:50.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37260.839407 secs 2024-04-21T20:45:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:50.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37260.839407 secs 2024-04-21T20:45:50.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37260.839407 secs 2024-04-21T20:45:51.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:50 smithi170 ceph-mon[31212]: pgmap v19961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:50 smithi077 ceph-mon[27902]: pgmap v19961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:50 smithi191 ceph-mon[31636]: pgmap v19961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:53.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:52 smithi170 ceph-mon[31212]: pgmap v19962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:52 smithi077 ceph-mon[27902]: pgmap v19962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:53.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:52 smithi191 ceph-mon[31636]: pgmap v19962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:54.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37264.083490 secs 2024-04-21T20:45:54.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37264.083490 secs 2024-04-21T20:45:54.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37264.083490 secs 2024-04-21T20:45:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:54 smithi170 ceph-mon[31212]: pgmap v19963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37265.839541 secs 2024-04-21T20:45:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:45:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:54 smithi077 ceph-mon[27902]: pgmap v19963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37265.839541 secs 2024-04-21T20:45:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:54 smithi191 ceph-mon[31636]: pgmap v19963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:55.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37265.839541 secs 2024-04-21T20:45:57.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:56 smithi170 ceph-mon[31212]: pgmap v19964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:57.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:56 smithi077 ceph-mon[27902]: pgmap v19964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:57.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:56 smithi191 ceph-mon[31636]: pgmap v19964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:45:59.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:58 smithi170 ceph-mon[31212]: pgmap v19965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:59.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37269.083631 secs 2024-04-21T20:45:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:58 smithi077 ceph-mon[27902]: pgmap v19965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:59.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37269.083631 secs 2024-04-21T20:45:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:58 smithi191 ceph-mon[31636]: pgmap v19965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:45:59.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37269.083631 secs 2024-04-21T20:46:00.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37270.839633 secs 2024-04-21T20:46:00.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:45:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:46:00.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37270.839633 secs 2024-04-21T20:46:00.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:45:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:46:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:00.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37270.839633 secs 2024-04-21T20:46:00.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:45:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:46:01.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:00 smithi170 ceph-mon[31212]: pgmap v19966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:01.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:01.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:00 smithi077 ceph-mon[27902]: pgmap v19966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:01.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:00 smithi191 ceph-mon[31636]: pgmap v19966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:01.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:02.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:01 smithi170 ceph-mon[31212]: pgmap v19967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T20:46:02.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:46:02.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:46:02.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:02.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:01 smithi077 ceph-mon[27902]: pgmap v19967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T20:46:02.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:46:02.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:46:02.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:02.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:01 smithi191 ceph-mon[31636]: pgmap v19967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T20:46:02.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:46:02.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:46:02.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:46:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37274.083746 secs 2024-04-21T20:46:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:03 smithi191 ceph-mon[31636]: pgmap v19968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:46:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37274.083746 secs 2024-04-21T20:46:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:03 smithi170 ceph-mon[31212]: pgmap v19968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:46:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37274.083746 secs 2024-04-21T20:46:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:03 smithi077 ceph-mon[27902]: pgmap v19968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:46:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:05.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37275.839701 secs 2024-04-21T20:46:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37275.839701 secs 2024-04-21T20:46:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37275.839701 secs 2024-04-21T20:46:06.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:05 smithi170 ceph-mon[31212]: pgmap v19969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:46:06.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:05 smithi170 ceph-mon[31212]: osdmap e1320: 12 total, 12 up, 12 in 2024-04-21T20:46:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:05 smithi077 ceph-mon[27902]: pgmap v19969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:46:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:05 smithi077 ceph-mon[27902]: osdmap e1320: 12 total, 12 up, 12 in 2024-04-21T20:46:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:05 smithi191 ceph-mon[31636]: pgmap v19969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:46:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:05 smithi191 ceph-mon[31636]: osdmap e1320: 12 total, 12 up, 12 in 2024-04-21T20:46:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:07 smithi170 ceph-mon[31212]: pgmap v19971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:46:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:07 smithi077 ceph-mon[27902]: pgmap v19971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:46:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:07 smithi191 ceph-mon[31636]: pgmap v19971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:46:09.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37279.083881 secs 2024-04-21T20:46:09.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37279.083881 secs 2024-04-21T20:46:09.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37279.083881 secs 2024-04-21T20:46:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:09 smithi170 ceph-mon[31212]: pgmap v19972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:46:10.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37280.839825 secs 2024-04-21T20:46:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:09 smithi077 ceph-mon[27902]: pgmap v19972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:46:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37280.839825 secs 2024-04-21T20:46:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:09 smithi191 ceph-mon[31636]: pgmap v19972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:46:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37280.839825 secs 2024-04-21T20:46:12.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:11 smithi170 ceph-mon[31212]: pgmap v19973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:46:12.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:11 smithi077 ceph-mon[27902]: pgmap v19973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:46:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:11 smithi191 ceph-mon[31636]: pgmap v19973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:46:14.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37284.084016 secs 2024-04-21T20:46:14.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:13 smithi191 ceph-mon[31636]: pgmap v19974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:46:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37284.084016 secs 2024-04-21T20:46:14.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:13 smithi170 ceph-mon[31212]: pgmap v19974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:46:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37284.084016 secs 2024-04-21T20:46:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:13 smithi077 ceph-mon[27902]: pgmap v19974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:46:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:15.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37285.839921 secs 2024-04-21T20:46:15.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:15 smithi191 ceph-mon[31636]: osdmap e1321: 12 total, 12 up, 12 in 2024-04-21T20:46:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37285.839921 secs 2024-04-21T20:46:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:15 smithi170 ceph-mon[31212]: osdmap e1321: 12 total, 12 up, 12 in 2024-04-21T20:46:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37285.839921 secs 2024-04-21T20:46:16.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:15 smithi077 ceph-mon[27902]: osdmap e1321: 12 total, 12 up, 12 in 2024-04-21T20:46:16.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:16 smithi191 ceph-mon[31636]: pgmap v19976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T20:46:17.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:16 smithi170 ceph-mon[31212]: pgmap v19976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T20:46:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:16 smithi077 ceph-mon[27902]: pgmap v19976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 22 op/s 2024-04-21T20:46:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:18 smithi191 ceph-mon[31636]: pgmap v19977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:46:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37289.084089 secs 2024-04-21T20:46:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:18 smithi170 ceph-mon[31212]: pgmap v19977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:46:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37289.084089 secs 2024-04-21T20:46:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:18 smithi077 ceph-mon[27902]: pgmap v19977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:46:19.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37289.084089 secs 2024-04-21T20:46:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:20 smithi191 ceph-mon[31636]: pgmap v19978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:46:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37290.839989 secs 2024-04-21T20:46:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:20 smithi170 ceph-mon[31212]: pgmap v19978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:46:21.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37290.839989 secs 2024-04-21T20:46:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:20 smithi077 ceph-mon[27902]: pgmap v19978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:46:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37290.839989 secs 2024-04-21T20:46:22.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:22 smithi191 ceph-mon[31636]: pgmap v19979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:46:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:22 smithi170 ceph-mon[31212]: pgmap v19979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:46:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:22 smithi077 ceph-mon[27902]: pgmap v19979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:46:23.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37294.084209 secs 2024-04-21T20:46:24.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37294.084209 secs 2024-04-21T20:46:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37294.084209 secs 2024-04-21T20:46:24.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:24 smithi191 ceph-mon[31636]: pgmap v19980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:46:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:24 smithi170 ceph-mon[31212]: pgmap v19980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:46:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:24 smithi077 ceph-mon[27902]: pgmap v19980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:46:26.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37295.840052 secs 2024-04-21T20:46:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37295.840052 secs 2024-04-21T20:46:26.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37295.840052 secs 2024-04-21T20:46:27.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:26 smithi170 ceph-mon[31212]: pgmap v19981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:46:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:26 smithi077 ceph-mon[27902]: pgmap v19981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:46:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:26 smithi191 ceph-mon[31636]: pgmap v19981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:46:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:28 smithi170 ceph-mon[31212]: pgmap v19982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37299.084328 secs 2024-04-21T20:46:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:28 smithi077 ceph-mon[27902]: pgmap v19982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37299.084328 secs 2024-04-21T20:46:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:28 smithi191 ceph-mon[31636]: pgmap v19982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:29.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37299.084328 secs 2024-04-21T20:46:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:30 smithi170 ceph-mon[31212]: pgmap v19983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37300.840173 secs 2024-04-21T20:46:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:30 smithi077 ceph-mon[27902]: pgmap v19983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37300.840173 secs 2024-04-21T20:46:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:30 smithi191 ceph-mon[31636]: pgmap v19983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37300.840173 secs 2024-04-21T20:46:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:32 smithi170 ceph-mon[31212]: pgmap v19984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:32 smithi077 ceph-mon[27902]: pgmap v19984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:32 smithi191 ceph-mon[31636]: pgmap v19984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:34.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37304.084460 secs 2024-04-21T20:46:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37304.084460 secs 2024-04-21T20:46:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37304.084460 secs 2024-04-21T20:46:35.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:34 smithi170 ceph-mon[31212]: pgmap v19985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:34 smithi077 ceph-mon[27902]: pgmap v19985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:34 smithi191 ceph-mon[31636]: pgmap v19985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:36.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37305.840247 secs 2024-04-21T20:46:36.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37305.840247 secs 2024-04-21T20:46:36.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37305.840247 secs 2024-04-21T20:46:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:36 smithi170 ceph-mon[31212]: pgmap v19986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:36 smithi077 ceph-mon[27902]: pgmap v19986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:36 smithi191 ceph-mon[31636]: pgmap v19986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:38 smithi170 ceph-mon[31212]: pgmap v19987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:39.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37309.084578 secs 2024-04-21T20:46:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:38 smithi077 ceph-mon[27902]: pgmap v19987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37309.084578 secs 2024-04-21T20:46:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:38 smithi191 ceph-mon[31636]: pgmap v19987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37309.084578 secs 2024-04-21T20:46:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37310.840345 secs 2024-04-21T20:46:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:40.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37310.840345 secs 2024-04-21T20:46:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37310.840345 secs 2024-04-21T20:46:41.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:40 smithi170 ceph-mon[31212]: pgmap v19988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:40 smithi077 ceph-mon[27902]: pgmap v19988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:40 smithi191 ceph-mon[31636]: pgmap v19988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:42 smithi170 ceph-mon[31212]: pgmap v19989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:42 smithi077 ceph-mon[27902]: pgmap v19989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:42 smithi191 ceph-mon[31636]: pgmap v19989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:44.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37314.084716 secs 2024-04-21T20:46:44.123 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37314.084716 secs 2024-04-21T20:46:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37314.084716 secs 2024-04-21T20:46:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:44 smithi170 ceph-mon[31212]: pgmap v19990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:45.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37315.840399 secs 2024-04-21T20:46:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:44 smithi077 ceph-mon[27902]: pgmap v19990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37315.840399 secs 2024-04-21T20:46:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:44 smithi191 ceph-mon[31636]: pgmap v19990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37315.840399 secs 2024-04-21T20:46:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:46 smithi170 ceph-mon[31212]: pgmap v19991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:46 smithi077 ceph-mon[27902]: pgmap v19991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:47.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:46 smithi191 ceph-mon[31636]: pgmap v19991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:48 smithi170 ceph-mon[31212]: pgmap v19992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37319.084839 secs 2024-04-21T20:46:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:48 smithi077 ceph-mon[27902]: pgmap v19992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:49.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37319.084839 secs 2024-04-21T20:46:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:48 smithi191 ceph-mon[31636]: pgmap v19992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37319.084839 secs 2024-04-21T20:46:50.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37320.840518 secs 2024-04-21T20:46:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:50.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37320.840518 secs 2024-04-21T20:46:50.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37320.840518 secs 2024-04-21T20:46:51.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:50 smithi170 ceph-mon[31212]: pgmap v19993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:50 smithi077 ceph-mon[27902]: pgmap v19993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:50 smithi191 ceph-mon[31636]: pgmap v19993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:52 smithi170 ceph-mon[31212]: pgmap v19994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:52 smithi077 ceph-mon[27902]: pgmap v19994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:53.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:52 smithi191 ceph-mon[31636]: pgmap v19994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:54.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37324.084953 secs 2024-04-21T20:46:54.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37324.084953 secs 2024-04-21T20:46:54.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37324.084953 secs 2024-04-21T20:46:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:54 smithi170 ceph-mon[31212]: pgmap v19995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:55.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37325.840589 secs 2024-04-21T20:46:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:46:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:54 smithi077 ceph-mon[27902]: pgmap v19995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37325.840589 secs 2024-04-21T20:46:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:54 smithi191 ceph-mon[31636]: pgmap v19995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37325.840589 secs 2024-04-21T20:46:56.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:55 smithi077 ceph-mon[27902]: pgmap v19996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:56.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:55 smithi191 ceph-mon[31636]: pgmap v19996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:56.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:55 smithi170 ceph-mon[31212]: pgmap v19996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:46:58.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:57 smithi170 ceph-mon[31212]: pgmap v19997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:57 smithi077 ceph-mon[27902]: pgmap v19997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:57 smithi191 ceph-mon[31636]: pgmap v19997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:46:59.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37329.085016 secs 2024-04-21T20:46:59.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37329.085016 secs 2024-04-21T20:46:59.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37329.085016 secs 2024-04-21T20:46:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:46:59.515+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:46:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:46:59.515+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:46:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:46:59.515+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:46:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:46:59.515+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:47:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:00.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:59 smithi077 ceph-mon[27902]: pgmap v19998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:00.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:46:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37330.840702 secs 2024-04-21T20:47:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:59 smithi170 ceph-mon[31212]: pgmap v19998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:00.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:46:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37330.840702 secs 2024-04-21T20:47:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:59 smithi191 ceph-mon[31636]: pgmap v19998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:46:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37330.840702 secs 2024-04-21T20:47:02.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:01 smithi170 ceph-mon[31212]: pgmap v19999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:02.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:47:02.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:01 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:01 smithi077 ceph-mon[27902]: pgmap v19999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:47:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:01 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:01 smithi191 ceph-mon[31636]: pgmap v19999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:47:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:02.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:01 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:47:03.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:47:03.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:47:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:47:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:03.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:47:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:47:03.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:47:04.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37334.085128 secs 2024-04-21T20:47:04.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:03 smithi170 ceph-mon[31212]: pgmap v20000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37334.085128 secs 2024-04-21T20:47:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:03 smithi077 ceph-mon[27902]: pgmap v20000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37334.085128 secs 2024-04-21T20:47:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:03 smithi191 ceph-mon[31636]: pgmap v20000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37335.840834 secs 2024-04-21T20:47:05.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:05 smithi170 ceph-mon[31212]: osdmap e1322: 12 total, 12 up, 12 in 2024-04-21T20:47:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37335.840834 secs 2024-04-21T20:47:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:05 smithi077 ceph-mon[27902]: osdmap e1322: 12 total, 12 up, 12 in 2024-04-21T20:47:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37335.840834 secs 2024-04-21T20:47:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:05 smithi191 ceph-mon[31636]: osdmap e1322: 12 total, 12 up, 12 in 2024-04-21T20:47:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:06 smithi170 ceph-mon[31212]: pgmap v20002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:47:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:06 smithi077 ceph-mon[27902]: pgmap v20002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:47:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:06 smithi191 ceph-mon[31636]: pgmap v20002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:47:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:08 smithi170 ceph-mon[31212]: pgmap v20003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:47:08.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37339.085243 secs 2024-04-21T20:47:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:08 smithi077 ceph-mon[27902]: pgmap v20003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:47:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37339.085243 secs 2024-04-21T20:47:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:08 smithi191 ceph-mon[31636]: pgmap v20003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:47:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37339.085243 secs 2024-04-21T20:47:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:10 smithi191 ceph-mon[31636]: pgmap v20004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:47:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37340.840950 secs 2024-04-21T20:47:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:10 smithi191 ceph-mon[31636]: osdmap e1323: 12 total, 12 up, 12 in 2024-04-21T20:47:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:10 smithi170 ceph-mon[31212]: pgmap v20004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:47:11.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37340.840950 secs 2024-04-21T20:47:11.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:10 smithi170 ceph-mon[31212]: osdmap e1323: 12 total, 12 up, 12 in 2024-04-21T20:47:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:10 smithi077 ceph-mon[27902]: pgmap v20004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:47:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37340.840950 secs 2024-04-21T20:47:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:10 smithi077 ceph-mon[27902]: osdmap e1323: 12 total, 12 up, 12 in 2024-04-21T20:47:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:12 smithi191 ceph-mon[31636]: pgmap v20006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:47:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:12 smithi170 ceph-mon[31212]: pgmap v20006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:47:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:12 smithi077 ceph-mon[27902]: pgmap v20006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:47:13.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37344.085352 secs 2024-04-21T20:47:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37344.085352 secs 2024-04-21T20:47:14.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37344.085352 secs 2024-04-21T20:47:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:14 smithi191 ceph-mon[31636]: pgmap v20007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T20:47:15.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:14 smithi170 ceph-mon[31212]: pgmap v20007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T20:47:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:14 smithi077 ceph-mon[27902]: pgmap v20007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T20:47:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37345.841048 secs 2024-04-21T20:47:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37345.841048 secs 2024-04-21T20:47:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37345.841048 secs 2024-04-21T20:47:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:16 smithi170 ceph-mon[31212]: pgmap v20008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:47:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:16 smithi077 ceph-mon[27902]: pgmap v20008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:47:17.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:16 smithi191 ceph-mon[31636]: pgmap v20008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:47:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:18 smithi170 ceph-mon[31212]: pgmap v20009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:47:19.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37349.085500 secs 2024-04-21T20:47:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:18 smithi077 ceph-mon[27902]: pgmap v20009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:47:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37349.085500 secs 2024-04-21T20:47:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:18 smithi191 ceph-mon[31636]: pgmap v20009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:47:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37349.085500 secs 2024-04-21T20:47:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:20 smithi170 ceph-mon[31212]: pgmap v20010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:47:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37350.841174 secs 2024-04-21T20:47:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:20 smithi077 ceph-mon[27902]: pgmap v20010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:47:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37350.841174 secs 2024-04-21T20:47:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:20 smithi191 ceph-mon[31636]: pgmap v20010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:47:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37350.841174 secs 2024-04-21T20:47:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:22 smithi170 ceph-mon[31212]: pgmap v20011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:47:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:22 smithi077 ceph-mon[27902]: pgmap v20011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:47:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:22 smithi191 ceph-mon[31636]: pgmap v20011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:47:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37354.085649 secs 2024-04-21T20:47:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37354.085649 secs 2024-04-21T20:47:24.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37354.085649 secs 2024-04-21T20:47:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:24 smithi170 ceph-mon[31212]: pgmap v20012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:24 smithi077 ceph-mon[27902]: pgmap v20012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:24 smithi191 ceph-mon[31636]: pgmap v20012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37355.841284 secs 2024-04-21T20:47:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37355.841284 secs 2024-04-21T20:47:26.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37355.841284 secs 2024-04-21T20:47:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:26 smithi170 ceph-mon[31212]: pgmap v20013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:26 smithi077 ceph-mon[27902]: pgmap v20013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:26 smithi191 ceph-mon[31636]: pgmap v20013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:28 smithi170 ceph-mon[31212]: pgmap v20014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:29.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37359.085744 secs 2024-04-21T20:47:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:28 smithi077 ceph-mon[27902]: pgmap v20014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37359.085744 secs 2024-04-21T20:47:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:28 smithi191 ceph-mon[31636]: pgmap v20014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37359.085744 secs 2024-04-21T20:47:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:30 smithi170 ceph-mon[31212]: pgmap v20015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37360.841373 secs 2024-04-21T20:47:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:30 smithi077 ceph-mon[27902]: pgmap v20015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37360.841373 secs 2024-04-21T20:47:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:30 smithi191 ceph-mon[31636]: pgmap v20015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37360.841373 secs 2024-04-21T20:47:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:32 smithi170 ceph-mon[31212]: pgmap v20016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:32 smithi077 ceph-mon[27902]: pgmap v20016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:32 smithi191 ceph-mon[31636]: pgmap v20016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37364.085828 secs 2024-04-21T20:47:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37364.085828 secs 2024-04-21T20:47:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37364.085828 secs 2024-04-21T20:47:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:34 smithi170 ceph-mon[31212]: pgmap v20017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37365.841492 secs 2024-04-21T20:47:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:34 smithi077 ceph-mon[27902]: pgmap v20017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37365.841492 secs 2024-04-21T20:47:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:34 smithi191 ceph-mon[31636]: pgmap v20017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37365.841492 secs 2024-04-21T20:47:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:36 smithi170 ceph-mon[31212]: pgmap v20018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:36 smithi077 ceph-mon[27902]: pgmap v20018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:36 smithi191 ceph-mon[31636]: pgmap v20018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:38 smithi170 ceph-mon[31212]: pgmap v20019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37369.085906 secs 2024-04-21T20:47:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:38 smithi077 ceph-mon[27902]: pgmap v20019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37369.085906 secs 2024-04-21T20:47:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:38 smithi191 ceph-mon[31636]: pgmap v20019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37369.085906 secs 2024-04-21T20:47:40.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37370.841609 secs 2024-04-21T20:47:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:40.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37370.841609 secs 2024-04-21T20:47:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37370.841609 secs 2024-04-21T20:47:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:40 smithi170 ceph-mon[31212]: pgmap v20020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:40 smithi077 ceph-mon[27902]: pgmap v20020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:40 smithi191 ceph-mon[31636]: pgmap v20020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:42 smithi170 ceph-mon[31212]: pgmap v20021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:42 smithi077 ceph-mon[27902]: pgmap v20021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:42 smithi191 ceph-mon[31636]: pgmap v20021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:44.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37374.085965 secs 2024-04-21T20:47:44.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37374.085965 secs 2024-04-21T20:47:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37374.085965 secs 2024-04-21T20:47:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:47:44.521+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:47:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:47:44.521+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:47:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:47:44.521+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:47:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:47:44.521+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:47:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:44 smithi170 ceph-mon[31212]: pgmap v20022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37375.841725 secs 2024-04-21T20:47:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:44 smithi077 ceph-mon[27902]: pgmap v20022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37375.841725 secs 2024-04-21T20:47:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:44 smithi191 ceph-mon[31636]: pgmap v20022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37375.841725 secs 2024-04-21T20:47:47.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:46 smithi170 ceph-mon[31212]: pgmap v20023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:46 smithi077 ceph-mon[27902]: pgmap v20023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:47.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:46 smithi191 ceph-mon[31636]: pgmap v20023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:48 smithi170 ceph-mon[31212]: pgmap v20024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37379.086042 secs 2024-04-21T20:47:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:48 smithi077 ceph-mon[27902]: pgmap v20024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37379.086042 secs 2024-04-21T20:47:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:48 smithi191 ceph-mon[31636]: pgmap v20024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37379.086042 secs 2024-04-21T20:47:50.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37380.841847 secs 2024-04-21T20:47:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:50.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37380.841847 secs 2024-04-21T20:47:50.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37380.841847 secs 2024-04-21T20:47:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:50 smithi170 ceph-mon[31212]: pgmap v20025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:50 smithi077 ceph-mon[27902]: pgmap v20025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:50 smithi191 ceph-mon[31636]: pgmap v20025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:52.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:51 smithi170 ceph-mon[31212]: pgmap v20026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:52.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:51 smithi077 ceph-mon[27902]: pgmap v20026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:52.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:51 smithi191 ceph-mon[31636]: pgmap v20026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:54.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37384.086119 secs 2024-04-21T20:47:54.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:53 smithi170 ceph-mon[31212]: pgmap v20027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:54.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37384.086119 secs 2024-04-21T20:47:54.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:53 smithi077 ceph-mon[27902]: pgmap v20027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:54.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37384.086119 secs 2024-04-21T20:47:54.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:53 smithi191 ceph-mon[31636]: pgmap v20027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:47:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37385.841947 secs 2024-04-21T20:47:56.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37385.841947 secs 2024-04-21T20:47:56.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37385.841947 secs 2024-04-21T20:47:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:56 smithi170 ceph-mon[31212]: pgmap v20028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:57.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:56 smithi077 ceph-mon[27902]: pgmap v20028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:57.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:56 smithi191 ceph-mon[31636]: pgmap v20028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:47:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:58 smithi170 ceph-mon[31212]: pgmap v20029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:47:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37389.086235 secs 2024-04-21T20:47:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:58 smithi077 ceph-mon[27902]: pgmap v20029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:47:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37389.086235 secs 2024-04-21T20:47:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:58 smithi191 ceph-mon[31636]: pgmap v20029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:47:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:47:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37389.086235 secs 2024-04-21T20:48:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:00 smithi170 ceph-mon[31212]: pgmap v20030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:01.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37390.842026 secs 2024-04-21T20:48:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:00 smithi077 ceph-mon[27902]: pgmap v20030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37390.842026 secs 2024-04-21T20:48:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:00 smithi191 ceph-mon[31636]: pgmap v20030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37390.842026 secs 2024-04-21T20:48:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:02 smithi170 ceph-mon[31212]: pgmap v20031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:02 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:48:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:02 smithi077 ceph-mon[27902]: pgmap v20031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:02 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:48:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:02 smithi191 ceph-mon[31636]: pgmap v20031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:02 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:48:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37394.086347 secs 2024-04-21T20:48:04.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:48:04.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:48:04.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:03 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:48:04.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37394.086347 secs 2024-04-21T20:48:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:48:04.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:48:04.140 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:03 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:48:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37394.086347 secs 2024-04-21T20:48:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:48:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:48:04.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:03 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:48:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:04 smithi170 ceph-mon[31212]: pgmap v20032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:05.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:04 smithi077 ceph-mon[27902]: pgmap v20032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:04 smithi191 ceph-mon[31636]: pgmap v20032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37395.842088 secs 2024-04-21T20:48:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:05 smithi170 ceph-mon[31212]: osdmap e1324: 12 total, 12 up, 12 in 2024-04-21T20:48:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37395.842088 secs 2024-04-21T20:48:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:05 smithi077 ceph-mon[27902]: osdmap e1324: 12 total, 12 up, 12 in 2024-04-21T20:48:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37395.842088 secs 2024-04-21T20:48:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:05 smithi191 ceph-mon[31636]: osdmap e1324: 12 total, 12 up, 12 in 2024-04-21T20:48:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:06 smithi170 ceph-mon[31212]: pgmap v20034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:07.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:06 smithi077 ceph-mon[27902]: pgmap v20034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:07.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:06 smithi191 ceph-mon[31636]: pgmap v20034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:08 smithi170 ceph-mon[31212]: pgmap v20035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:48:09.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37399.086462 secs 2024-04-21T20:48:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:08 smithi077 ceph-mon[27902]: pgmap v20035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:48:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37399.086462 secs 2024-04-21T20:48:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:08 smithi191 ceph-mon[31636]: pgmap v20035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:48:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37399.086462 secs 2024-04-21T20:48:10.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37400.842209 secs 2024-04-21T20:48:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:10.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37400.842209 secs 2024-04-21T20:48:10.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37400.842209 secs 2024-04-21T20:48:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:10 smithi170 ceph-mon[31212]: pgmap v20036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:48:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:10 smithi077 ceph-mon[27902]: pgmap v20036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:48:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:10 smithi191 ceph-mon[31636]: pgmap v20036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:48:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:12 smithi170 ceph-mon[31212]: pgmap v20037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:12 smithi077 ceph-mon[27902]: pgmap v20037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:12 smithi191 ceph-mon[31636]: pgmap v20037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37404.086598 secs 2024-04-21T20:48:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37404.086598 secs 2024-04-21T20:48:14.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37404.086598 secs 2024-04-21T20:48:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:14 smithi170 ceph-mon[31212]: pgmap v20038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37405.842319 secs 2024-04-21T20:48:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:14 smithi170 ceph-mon[31212]: osdmap e1325: 12 total, 12 up, 12 in 2024-04-21T20:48:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:14 smithi077 ceph-mon[27902]: pgmap v20038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37405.842319 secs 2024-04-21T20:48:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:14 smithi077 ceph-mon[27902]: osdmap e1325: 12 total, 12 up, 12 in 2024-04-21T20:48:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:14 smithi191 ceph-mon[31636]: pgmap v20038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37405.842319 secs 2024-04-21T20:48:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:14 smithi191 ceph-mon[31636]: osdmap e1325: 12 total, 12 up, 12 in 2024-04-21T20:48:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:16 smithi170 ceph-mon[31212]: pgmap v20040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:16 smithi077 ceph-mon[27902]: pgmap v20040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:17.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:16 smithi191 ceph-mon[31636]: pgmap v20040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:48:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:18 smithi170 ceph-mon[31212]: pgmap v20041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:48:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37409.086703 secs 2024-04-21T20:48:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:18 smithi077 ceph-mon[27902]: pgmap v20041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:48:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37409.086703 secs 2024-04-21T20:48:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:18 smithi191 ceph-mon[31636]: pgmap v20041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:48:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37409.086703 secs 2024-04-21T20:48:20.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37410.842458 secs 2024-04-21T20:48:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:20.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37410.842458 secs 2024-04-21T20:48:20.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37410.842458 secs 2024-04-21T20:48:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:20 smithi170 ceph-mon[31212]: pgmap v20042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:48:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:20 smithi077 ceph-mon[27902]: pgmap v20042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:48:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:20 smithi191 ceph-mon[31636]: pgmap v20042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:48:22.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:21 smithi170 ceph-mon[31212]: pgmap v20043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:22.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:21 smithi077 ceph-mon[27902]: pgmap v20043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:22.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:21 smithi191 ceph-mon[31636]: pgmap v20043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:24.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:24 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37414.086827 secs 2024-04-21T20:48:24.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:24 smithi170 ceph-mon[31212]: pgmap v20044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:24.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:24 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37414.086827 secs 2024-04-21T20:48:24.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:24 smithi077 ceph-mon[27902]: pgmap v20044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:24 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37414.086827 secs 2024-04-21T20:48:24.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:24 smithi191 ceph-mon[31636]: pgmap v20044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:48:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37415.842577 secs 2024-04-21T20:48:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37415.842577 secs 2024-04-21T20:48:25.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37415.842577 secs 2024-04-21T20:48:26.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:26 smithi170 ceph-mon[31212]: pgmap v20045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:48:26.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:26 smithi077 ceph-mon[27902]: pgmap v20045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:48:26.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:26 smithi191 ceph-mon[31636]: pgmap v20045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:48:28.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:28 smithi170 ceph-mon[31212]: pgmap v20046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:28.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:28 smithi077 ceph-mon[27902]: pgmap v20046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:28.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:28 smithi191 ceph-mon[31636]: pgmap v20046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:29 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37419.086892 secs 2024-04-21T20:48:29.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:29 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37419.086892 secs 2024-04-21T20:48:29.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:29 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37419.086892 secs 2024-04-21T20:48:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:30.289 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:30 smithi077 ceph-mon[27902]: pgmap v20047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:30.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37420.842692 secs 2024-04-21T20:48:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:30 smithi170 ceph-mon[31212]: pgmap v20047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37420.842692 secs 2024-04-21T20:48:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:30 smithi191 ceph-mon[31636]: pgmap v20047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37420.842692 secs 2024-04-21T20:48:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:32 smithi170 ceph-mon[31212]: pgmap v20048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:32 smithi077 ceph-mon[27902]: pgmap v20048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:32 smithi191 ceph-mon[31636]: pgmap v20048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:34 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37424.087017 secs 2024-04-21T20:48:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:34 smithi170 ceph-mon[31212]: pgmap v20049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:34.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:34 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37424.087017 secs 2024-04-21T20:48:34.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:34 smithi077 ceph-mon[27902]: pgmap v20049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:34.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:34 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37424.087017 secs 2024-04-21T20:48:34.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:34 smithi191 ceph-mon[31636]: pgmap v20049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37425.842828 secs 2024-04-21T20:48:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37425.842828 secs 2024-04-21T20:48:35.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37425.842828 secs 2024-04-21T20:48:36.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:36 smithi170 ceph-mon[31212]: pgmap v20050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:36.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:36 smithi077 ceph-mon[27902]: pgmap v20050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:36.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:36 smithi191 ceph-mon[31636]: pgmap v20050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:38 smithi170 ceph-mon[31212]: pgmap v20051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37429.087084 secs 2024-04-21T20:48:38.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:38 smithi077 ceph-mon[27902]: pgmap v20051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:38.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37429.087084 secs 2024-04-21T20:48:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:38 smithi191 ceph-mon[31636]: pgmap v20051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37429.087084 secs 2024-04-21T20:48:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:40 smithi170 ceph-mon[31212]: pgmap v20052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37430.842944 secs 2024-04-21T20:48:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:40 smithi077 ceph-mon[27902]: pgmap v20052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37430.842944 secs 2024-04-21T20:48:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:40 smithi191 ceph-mon[31636]: pgmap v20052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37430.842944 secs 2024-04-21T20:48:42.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:42 smithi170 ceph-mon[31212]: pgmap v20053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:42 smithi077 ceph-mon[27902]: pgmap v20053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:42.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:42 smithi191 ceph-mon[31636]: pgmap v20053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37434.087211 secs 2024-04-21T20:48:43.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37434.087211 secs 2024-04-21T20:48:43.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37434.087211 secs 2024-04-21T20:48:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:44 smithi170 ceph-mon[31212]: pgmap v20054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:44.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:44 smithi191 ceph-mon[31636]: pgmap v20054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:44.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:44 smithi077 ceph-mon[27902]: pgmap v20054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:45.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37435.843049 secs 2024-04-21T20:48:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37435.843049 secs 2024-04-21T20:48:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37435.843049 secs 2024-04-21T20:48:46.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:46 smithi077 ceph-mon[27902]: pgmap v20055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:46.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:46 smithi191 ceph-mon[31636]: pgmap v20055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:46 smithi170 ceph-mon[31212]: pgmap v20055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:48 smithi077 ceph-mon[27902]: pgmap v20056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37439.087272 secs 2024-04-21T20:48:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:48 smithi191 ceph-mon[31636]: pgmap v20056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37439.087272 secs 2024-04-21T20:48:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:48 smithi170 ceph-mon[31212]: pgmap v20056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37439.087272 secs 2024-04-21T20:48:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:50 smithi077 ceph-mon[27902]: pgmap v20057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37440.843172 secs 2024-04-21T20:48:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:50 smithi191 ceph-mon[31636]: pgmap v20057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37440.843172 secs 2024-04-21T20:48:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:50 smithi170 ceph-mon[31212]: pgmap v20057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37440.843172 secs 2024-04-21T20:48:52.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:52 smithi077 ceph-mon[27902]: pgmap v20058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:52.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:52 smithi191 ceph-mon[31636]: pgmap v20058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:52 smithi170 ceph-mon[31212]: pgmap v20058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:53.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37444.087397 secs 2024-04-21T20:48:53.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37444.087397 secs 2024-04-21T20:48:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37444.087397 secs 2024-04-21T20:48:54.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:54 smithi077 ceph-mon[27902]: pgmap v20059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:54.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:54 smithi191 ceph-mon[31636]: pgmap v20059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:54 smithi170 ceph-mon[31212]: pgmap v20059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:48:55.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37445.843256 secs 2024-04-21T20:48:55.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37445.843256 secs 2024-04-21T20:48:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37445.843256 secs 2024-04-21T20:48:56.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:56 smithi077 ceph-mon[27902]: pgmap v20060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:56.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:56 smithi191 ceph-mon[31636]: pgmap v20060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:56 smithi170 ceph-mon[31212]: pgmap v20060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:48:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:58 smithi077 ceph-mon[27902]: pgmap v20061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:48:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37449.087546 secs 2024-04-21T20:48:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:58 smithi191 ceph-mon[31636]: pgmap v20061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:48:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37449.087546 secs 2024-04-21T20:48:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:58 smithi170 ceph-mon[31212]: pgmap v20061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:48:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:48:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37449.087546 secs 2024-04-21T20:49:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:00 smithi077 ceph-mon[27902]: pgmap v20062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37450.843350 secs 2024-04-21T20:49:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:00 smithi191 ceph-mon[31636]: pgmap v20062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37450.843350 secs 2024-04-21T20:49:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:00 smithi170 ceph-mon[31212]: pgmap v20062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37450.843350 secs 2024-04-21T20:49:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:02 smithi077 ceph-mon[27902]: pgmap v20063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:02 smithi191 ceph-mon[31636]: pgmap v20063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:02 smithi170 ceph-mon[31212]: pgmap v20063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37454.087685 secs 2024-04-21T20:49:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37454.087685 secs 2024-04-21T20:49:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37454.087685 secs 2024-04-21T20:49:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:04 smithi077 ceph-mon[27902]: pgmap v20064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:49:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:49:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:49:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:49:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:04 smithi191 ceph-mon[31636]: pgmap v20064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:49:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:49:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:49:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:49:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:04 smithi170 ceph-mon[31212]: pgmap v20064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:49:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:49:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:49:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:49:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37455.843469 secs 2024-04-21T20:49:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:05 smithi077 ceph-mon[27902]: osdmap e1326: 12 total, 12 up, 12 in 2024-04-21T20:49:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37455.843469 secs 2024-04-21T20:49:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:05 smithi191 ceph-mon[31636]: osdmap e1326: 12 total, 12 up, 12 in 2024-04-21T20:49:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37455.843469 secs 2024-04-21T20:49:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:05 smithi170 ceph-mon[31212]: osdmap e1326: 12 total, 12 up, 12 in 2024-04-21T20:49:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:06 smithi077 ceph-mon[27902]: pgmap v20066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:49:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:06 smithi191 ceph-mon[31636]: pgmap v20066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:49:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:06 smithi170 ceph-mon[31212]: pgmap v20066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:49:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:08 smithi077 ceph-mon[27902]: pgmap v20067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:49:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37459.087793 secs 2024-04-21T20:49:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:08 smithi191 ceph-mon[31636]: pgmap v20067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:49:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37459.087793 secs 2024-04-21T20:49:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:08 smithi170 ceph-mon[31212]: pgmap v20067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:49:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37459.087793 secs 2024-04-21T20:49:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:10 smithi170 ceph-mon[31212]: pgmap v20068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:49:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37460.843587 secs 2024-04-21T20:49:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:10 smithi170 ceph-mon[31212]: osdmap e1327: 12 total, 12 up, 12 in 2024-04-21T20:49:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:10 smithi077 ceph-mon[27902]: pgmap v20068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:49:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37460.843587 secs 2024-04-21T20:49:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:10 smithi077 ceph-mon[27902]: osdmap e1327: 12 total, 12 up, 12 in 2024-04-21T20:49:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:10 smithi191 ceph-mon[31636]: pgmap v20068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:49:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37460.843587 secs 2024-04-21T20:49:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:10 smithi191 ceph-mon[31636]: osdmap e1327: 12 total, 12 up, 12 in 2024-04-21T20:49:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:12 smithi170 ceph-mon[31212]: pgmap v20070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:49:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:12 smithi077 ceph-mon[27902]: pgmap v20070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:49:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:12 smithi191 ceph-mon[31636]: pgmap v20070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:49:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37464.087920 secs 2024-04-21T20:49:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37464.087920 secs 2024-04-21T20:49:14.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37464.087920 secs 2024-04-21T20:49:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:14 smithi170 ceph-mon[31212]: pgmap v20071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:49:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:14 smithi077 ceph-mon[27902]: pgmap v20071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:49:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:14 smithi191 ceph-mon[31636]: pgmap v20071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 65 KiB/s wr, 33 op/s 2024-04-21T20:49:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37465.843718 secs 2024-04-21T20:49:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37465.843718 secs 2024-04-21T20:49:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37465.843718 secs 2024-04-21T20:49:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:16 smithi170 ceph-mon[31212]: pgmap v20072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:49:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:16 smithi077 ceph-mon[27902]: pgmap v20072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:49:17.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:16 smithi191 ceph-mon[31636]: pgmap v20072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:49:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:18 smithi170 ceph-mon[31212]: pgmap v20073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:49:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37469.088048 secs 2024-04-21T20:49:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:18 smithi077 ceph-mon[27902]: pgmap v20073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:49:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37469.088048 secs 2024-04-21T20:49:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:18 smithi191 ceph-mon[31636]: pgmap v20073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:49:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37469.088048 secs 2024-04-21T20:49:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:20 smithi170 ceph-mon[31212]: pgmap v20074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:49:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37470.843869 secs 2024-04-21T20:49:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:20 smithi077 ceph-mon[27902]: pgmap v20074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:49:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37470.843869 secs 2024-04-21T20:49:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:20 smithi191 ceph-mon[31636]: pgmap v20074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:49:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37470.843869 secs 2024-04-21T20:49:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:22 smithi170 ceph-mon[31212]: pgmap v20075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:49:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:22 smithi077 ceph-mon[27902]: pgmap v20075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:49:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:22 smithi191 ceph-mon[31636]: pgmap v20075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:49:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37474.088169 secs 2024-04-21T20:49:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37474.088169 secs 2024-04-21T20:49:24.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37474.088169 secs 2024-04-21T20:49:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:24 smithi170 ceph-mon[31212]: pgmap v20076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37475.843971 secs 2024-04-21T20:49:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:24 smithi077 ceph-mon[27902]: pgmap v20076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37475.843971 secs 2024-04-21T20:49:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:24 smithi191 ceph-mon[31636]: pgmap v20076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37475.843971 secs 2024-04-21T20:49:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:26 smithi170 ceph-mon[31212]: pgmap v20077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:26 smithi077 ceph-mon[27902]: pgmap v20077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:26 smithi191 ceph-mon[31636]: pgmap v20077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:28 smithi170 ceph-mon[31212]: pgmap v20078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37479.088291 secs 2024-04-21T20:49:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:28 smithi077 ceph-mon[27902]: pgmap v20078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37479.088291 secs 2024-04-21T20:49:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:28 smithi191 ceph-mon[31636]: pgmap v20078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37479.088291 secs 2024-04-21T20:49:30.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37480.844107 secs 2024-04-21T20:49:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37480.844107 secs 2024-04-21T20:49:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37480.844107 secs 2024-04-21T20:49:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:30 smithi170 ceph-mon[31212]: pgmap v20079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:30 smithi077 ceph-mon[27902]: pgmap v20079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:30 smithi191 ceph-mon[31636]: pgmap v20079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:33.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:32 smithi170 ceph-mon[31212]: pgmap v20080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:32 smithi077 ceph-mon[27902]: pgmap v20080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:32 smithi191 ceph-mon[31636]: pgmap v20080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37484.088411 secs 2024-04-21T20:49:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37484.088411 secs 2024-04-21T20:49:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37484.088411 secs 2024-04-21T20:49:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:34 smithi170 ceph-mon[31212]: pgmap v20081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37485.844242 secs 2024-04-21T20:49:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:34 smithi077 ceph-mon[27902]: pgmap v20081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37485.844242 secs 2024-04-21T20:49:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:34 smithi191 ceph-mon[31636]: pgmap v20081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37485.844242 secs 2024-04-21T20:49:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:36 smithi077 ceph-mon[27902]: pgmap v20082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:36 smithi191 ceph-mon[31636]: pgmap v20082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:36 smithi170 ceph-mon[31212]: pgmap v20082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:38.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:37 smithi077 ceph-mon[27902]: pgmap v20083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:37 smithi191 ceph-mon[31636]: pgmap v20083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:37 smithi170 ceph-mon[31212]: pgmap v20083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37489.088511 secs 2024-04-21T20:49:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37489.088511 secs 2024-04-21T20:49:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37489.088511 secs 2024-04-21T20:49:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:39 smithi077 ceph-mon[27902]: pgmap v20084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:40.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37490.844357 secs 2024-04-21T20:49:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:39 smithi191 ceph-mon[31636]: pgmap v20084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37490.844357 secs 2024-04-21T20:49:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:39 smithi170 ceph-mon[31212]: pgmap v20084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37490.844357 secs 2024-04-21T20:49:42.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:42 smithi170 ceph-mon[31212]: pgmap v20085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:42 smithi077 ceph-mon[27902]: pgmap v20085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:42.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:42 smithi191 ceph-mon[31636]: pgmap v20085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:44 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37494.088650 secs 2024-04-21T20:49:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:44 smithi170 ceph-mon[31212]: pgmap v20086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:44.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:44 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37494.088650 secs 2024-04-21T20:49:44.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:44 smithi077 ceph-mon[27902]: pgmap v20086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:44 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37494.088650 secs 2024-04-21T20:49:44.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:44 smithi191 ceph-mon[31636]: pgmap v20086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37495.844470 secs 2024-04-21T20:49:45.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37495.844470 secs 2024-04-21T20:49:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37495.844470 secs 2024-04-21T20:49:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:46 smithi170 ceph-mon[31212]: pgmap v20087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:46.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:46 smithi077 ceph-mon[27902]: pgmap v20087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:46.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:46 smithi191 ceph-mon[31636]: pgmap v20087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:48 smithi170 ceph-mon[31212]: pgmap v20088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:48 smithi077 ceph-mon[27902]: pgmap v20088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:48 smithi191 ceph-mon[31636]: pgmap v20088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:49.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:49 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37499.088787 secs 2024-04-21T20:49:49.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:49 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37499.088787 secs 2024-04-21T20:49:49.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:49 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37499.088787 secs 2024-04-21T20:49:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37500.844593 secs 2024-04-21T20:49:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:50 smithi170 ceph-mon[31212]: pgmap v20089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37500.844593 secs 2024-04-21T20:49:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:50 smithi077 ceph-mon[27902]: pgmap v20089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37500.844593 secs 2024-04-21T20:49:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:50 smithi191 ceph-mon[31636]: pgmap v20089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:52.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:52 smithi170 ceph-mon[31212]: pgmap v20090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:52.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:52 smithi077 ceph-mon[27902]: pgmap v20090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:52.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:52 smithi191 ceph-mon[31636]: pgmap v20090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:53.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37504.088904 secs 2024-04-21T20:49:53.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37504.088904 secs 2024-04-21T20:49:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37504.088904 secs 2024-04-21T20:49:54.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:54 smithi077 ceph-mon[27902]: pgmap v20091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:54.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:54 smithi191 ceph-mon[31636]: pgmap v20091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:54 smithi170 ceph-mon[31212]: pgmap v20091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:49:55.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37505.844677 secs 2024-04-21T20:49:55.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37505.844677 secs 2024-04-21T20:49:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37505.844677 secs 2024-04-21T20:49:56.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:56 smithi077 ceph-mon[27902]: pgmap v20092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:56.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:56 smithi191 ceph-mon[31636]: pgmap v20092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:56 smithi170 ceph-mon[31212]: pgmap v20092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:49:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:58 smithi077 ceph-mon[27902]: pgmap v20093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:49:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37509.088990 secs 2024-04-21T20:49:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:58 smithi191 ceph-mon[31636]: pgmap v20093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:49:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37509.088990 secs 2024-04-21T20:49:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:58 smithi170 ceph-mon[31212]: pgmap v20093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:49:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:49:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37509.088990 secs 2024-04-21T20:49:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:49:59.540+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:49:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:49:59.540+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:49:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:49:59.540+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:49:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:49:59.540+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:50:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37510.844796 secs 2024-04-21T20:50:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:00 smithi077 ceph-mon[27902]: pgmap v20094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:50:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37510.844796 secs 2024-04-21T20:50:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:00 smithi191 ceph-mon[31636]: pgmap v20094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:50:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37510.844796 secs 2024-04-21T20:50:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:00 smithi170 ceph-mon[31212]: pgmap v20094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T20:50:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:02 smithi077 ceph-mon[27902]: pgmap v20095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:02.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:02 smithi191 ceph-mon[31636]: pgmap v20095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:02 smithi170 ceph-mon[31212]: pgmap v20095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37514.089092 secs 2024-04-21T20:50:03.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37514.089092 secs 2024-04-21T20:50:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37514.089092 secs 2024-04-21T20:50:04.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:04 smithi077 ceph-mon[27902]: pgmap v20096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:50:04.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:04 smithi191 ceph-mon[31636]: pgmap v20096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:50:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:04 smithi170 ceph-mon[31212]: pgmap v20096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:50:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37515.844873 secs 2024-04-21T20:50:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:05 smithi077 ceph-mon[27902]: osdmap e1328: 12 total, 12 up, 12 in 2024-04-21T20:50:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:50:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:50:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37515.844873 secs 2024-04-21T20:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:05 smithi191 ceph-mon[31636]: osdmap e1328: 12 total, 12 up, 12 in 2024-04-21T20:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:50:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:50:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37515.844873 secs 2024-04-21T20:50:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:05 smithi170 ceph-mon[31212]: osdmap e1328: 12 total, 12 up, 12 in 2024-04-21T20:50:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:50:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:50:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:50:06.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:06 smithi077 ceph-mon[27902]: pgmap v20098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:50:06.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:06 smithi191 ceph-mon[31636]: pgmap v20098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:50:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:06 smithi170 ceph-mon[31212]: pgmap v20098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:50:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:08 smithi077 ceph-mon[27902]: pgmap v20099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:50:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37519.089208 secs 2024-04-21T20:50:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:08 smithi191 ceph-mon[31636]: pgmap v20099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:50:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37519.089208 secs 2024-04-21T20:50:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:08 smithi170 ceph-mon[31212]: pgmap v20099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:50:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37519.089208 secs 2024-04-21T20:50:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37520.844929 secs 2024-04-21T20:50:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:10 smithi170 ceph-mon[31212]: pgmap v20100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:50:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:10 smithi170 ceph-mon[31212]: osdmap e1329: 12 total, 12 up, 12 in 2024-04-21T20:50:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37520.844929 secs 2024-04-21T20:50:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:10 smithi077 ceph-mon[27902]: pgmap v20100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:50:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:10 smithi077 ceph-mon[27902]: osdmap e1329: 12 total, 12 up, 12 in 2024-04-21T20:50:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37520.844929 secs 2024-04-21T20:50:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:10 smithi191 ceph-mon[31636]: pgmap v20100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:50:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:10 smithi191 ceph-mon[31636]: osdmap e1329: 12 total, 12 up, 12 in 2024-04-21T20:50:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:12 smithi170 ceph-mon[31212]: pgmap v20102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:50:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:12 smithi077 ceph-mon[27902]: pgmap v20102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:50:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:12 smithi191 ceph-mon[31636]: pgmap v20102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:50:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37524.089365 secs 2024-04-21T20:50:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37524.089365 secs 2024-04-21T20:50:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37524.089365 secs 2024-04-21T20:50:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:14 smithi170 ceph-mon[31212]: pgmap v20103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:50:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:14 smithi077 ceph-mon[27902]: pgmap v20103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:50:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:14 smithi191 ceph-mon[31636]: pgmap v20103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:50:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37525.845038 secs 2024-04-21T20:50:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37525.845038 secs 2024-04-21T20:50:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37525.845038 secs 2024-04-21T20:50:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:16 smithi170 ceph-mon[31212]: pgmap v20104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:50:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:16 smithi077 ceph-mon[27902]: pgmap v20104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:50:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:16 smithi191 ceph-mon[31636]: pgmap v20104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:50:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:18 smithi170 ceph-mon[31212]: pgmap v20105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:50:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37529.089454 secs 2024-04-21T20:50:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:18 smithi077 ceph-mon[27902]: pgmap v20105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:50:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37529.089454 secs 2024-04-21T20:50:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:18 smithi191 ceph-mon[31636]: pgmap v20105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:50:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37529.089454 secs 2024-04-21T20:50:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37530.845150 secs 2024-04-21T20:50:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:20 smithi170 ceph-mon[31212]: pgmap v20106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:50:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37530.845150 secs 2024-04-21T20:50:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:20 smithi077 ceph-mon[27902]: pgmap v20106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:50:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37530.845150 secs 2024-04-21T20:50:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:20 smithi191 ceph-mon[31636]: pgmap v20106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:50:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:22 smithi170 ceph-mon[31212]: pgmap v20107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:50:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:22 smithi077 ceph-mon[27902]: pgmap v20107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:50:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:22 smithi191 ceph-mon[31636]: pgmap v20107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:50:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37534.089587 secs 2024-04-21T20:50:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37534.089587 secs 2024-04-21T20:50:24.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37534.089587 secs 2024-04-21T20:50:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:24 smithi170 ceph-mon[31212]: pgmap v20108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37535.845263 secs 2024-04-21T20:50:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:24 smithi077 ceph-mon[27902]: pgmap v20108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37535.845263 secs 2024-04-21T20:50:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:24 smithi191 ceph-mon[31636]: pgmap v20108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37535.845263 secs 2024-04-21T20:50:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:26 smithi170 ceph-mon[31212]: pgmap v20109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:26 smithi077 ceph-mon[27902]: pgmap v20109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:26 smithi191 ceph-mon[31636]: pgmap v20109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:28 smithi170 ceph-mon[31212]: pgmap v20110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37539.089700 secs 2024-04-21T20:50:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:28 smithi077 ceph-mon[27902]: pgmap v20110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37539.089700 secs 2024-04-21T20:50:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:28 smithi191 ceph-mon[31636]: pgmap v20110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37539.089700 secs 2024-04-21T20:50:30.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37540.845378 secs 2024-04-21T20:50:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37540.845378 secs 2024-04-21T20:50:30.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37540.845378 secs 2024-04-21T20:50:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:30 smithi170 ceph-mon[31212]: pgmap v20111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:30 smithi077 ceph-mon[27902]: pgmap v20111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:30 smithi191 ceph-mon[31636]: pgmap v20111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:32 smithi170 ceph-mon[31212]: pgmap v20112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:32 smithi077 ceph-mon[27902]: pgmap v20112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:32 smithi191 ceph-mon[31636]: pgmap v20112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37544.089810 secs 2024-04-21T20:50:34.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37544.089810 secs 2024-04-21T20:50:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37544.089810 secs 2024-04-21T20:50:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:34 smithi077 ceph-mon[27902]: pgmap v20113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37545.845501 secs 2024-04-21T20:50:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:34 smithi191 ceph-mon[31636]: pgmap v20113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37545.845501 secs 2024-04-21T20:50:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:34 smithi170 ceph-mon[31212]: pgmap v20113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37545.845501 secs 2024-04-21T20:50:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:36 smithi077 ceph-mon[27902]: pgmap v20114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:36 smithi191 ceph-mon[31636]: pgmap v20114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:36 smithi170 ceph-mon[31212]: pgmap v20114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:38 smithi077 ceph-mon[27902]: pgmap v20115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37549.089933 secs 2024-04-21T20:50:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:38 smithi191 ceph-mon[31636]: pgmap v20115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37549.089933 secs 2024-04-21T20:50:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:38 smithi170 ceph-mon[31212]: pgmap v20115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37549.089933 secs 2024-04-21T20:50:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37550.845642 secs 2024-04-21T20:50:40.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37550.845642 secs 2024-04-21T20:50:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37550.845642 secs 2024-04-21T20:50:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:40 smithi077 ceph-mon[27902]: pgmap v20116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:40 smithi191 ceph-mon[31636]: pgmap v20116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:40 smithi170 ceph-mon[31212]: pgmap v20116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:42.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:41 smithi077 ceph-mon[27902]: pgmap v20117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:42.210 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:41 smithi170 ceph-mon[31212]: pgmap v20117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:42.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:41 smithi191 ceph-mon[31636]: pgmap v20117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:44 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37554.090011 secs 2024-04-21T20:50:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:44 smithi170 ceph-mon[31212]: pgmap v20118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:44.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:44 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37554.090011 secs 2024-04-21T20:50:44.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:44 smithi077 ceph-mon[27902]: pgmap v20118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:44 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37554.090011 secs 2024-04-21T20:50:44.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:44 smithi191 ceph-mon[31636]: pgmap v20118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37555.845761 secs 2024-04-21T20:50:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37555.845761 secs 2024-04-21T20:50:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37555.845761 secs 2024-04-21T20:50:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:46 smithi170 ceph-mon[31212]: pgmap v20119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:46.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:46 smithi077 ceph-mon[27902]: pgmap v20119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:46 smithi191 ceph-mon[31636]: pgmap v20119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:48 smithi077 ceph-mon[27902]: pgmap v20120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37559.090090 secs 2024-04-21T20:50:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:48 smithi191 ceph-mon[31636]: pgmap v20120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37559.090090 secs 2024-04-21T20:50:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:48 smithi170 ceph-mon[31212]: pgmap v20120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37559.090090 secs 2024-04-21T20:50:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37560.845890 secs 2024-04-21T20:50:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:50 smithi077 ceph-mon[27902]: pgmap v20121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37560.845890 secs 2024-04-21T20:50:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:50 smithi191 ceph-mon[31636]: pgmap v20121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37560.845890 secs 2024-04-21T20:50:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:50 smithi170 ceph-mon[31212]: pgmap v20121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:52.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:52 smithi077 ceph-mon[27902]: pgmap v20122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:52 smithi191 ceph-mon[31636]: pgmap v20122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:52 smithi170 ceph-mon[31212]: pgmap v20122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:53.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37564.090199 secs 2024-04-21T20:50:53.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37564.090199 secs 2024-04-21T20:50:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37564.090199 secs 2024-04-21T20:50:54.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:54 smithi077 ceph-mon[27902]: pgmap v20123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:54 smithi191 ceph-mon[31636]: pgmap v20123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:54 smithi170 ceph-mon[31212]: pgmap v20123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:50:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37565.846005 secs 2024-04-21T20:50:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37565.846005 secs 2024-04-21T20:50:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37565.846005 secs 2024-04-21T20:50:56.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:56 smithi077 ceph-mon[27902]: pgmap v20124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:56 smithi191 ceph-mon[31636]: pgmap v20124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:56 smithi170 ceph-mon[31212]: pgmap v20124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:50:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:58 smithi077 ceph-mon[27902]: pgmap v20125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:50:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37569.090293 secs 2024-04-21T20:50:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:58 smithi191 ceph-mon[31636]: pgmap v20125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:50:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37569.090293 secs 2024-04-21T20:50:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:58 smithi170 ceph-mon[31212]: pgmap v20125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:50:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:50:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37569.090293 secs 2024-04-21T20:51:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37570.846124 secs 2024-04-21T20:51:00.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:00 smithi077 ceph-mon[27902]: pgmap v20126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37570.846124 secs 2024-04-21T20:51:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:00 smithi191 ceph-mon[31636]: pgmap v20126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37570.846124 secs 2024-04-21T20:51:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:00 smithi170 ceph-mon[31212]: pgmap v20126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:02.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:02 smithi077 ceph-mon[27902]: pgmap v20127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T20:51:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:02 smithi191 ceph-mon[31636]: pgmap v20127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T20:51:02.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:02 smithi170 ceph-mon[31212]: pgmap v20127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-21T20:51:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37574.090401 secs 2024-04-21T20:51:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37574.090401 secs 2024-04-21T20:51:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37574.090401 secs 2024-04-21T20:51:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:04 smithi077 ceph-mon[27902]: pgmap v20128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T20:51:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:04 smithi191 ceph-mon[31636]: pgmap v20128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T20:51:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:04 smithi170 ceph-mon[31212]: pgmap v20128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-21T20:51:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37575.846201 secs 2024-04-21T20:51:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:05 smithi077 ceph-mon[27902]: osdmap e1330: 12 total, 12 up, 12 in 2024-04-21T20:51:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:51:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37575.846201 secs 2024-04-21T20:51:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:05 smithi191 ceph-mon[31636]: osdmap e1330: 12 total, 12 up, 12 in 2024-04-21T20:51:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:51:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37575.846201 secs 2024-04-21T20:51:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:05 smithi170 ceph-mon[31212]: osdmap e1330: 12 total, 12 up, 12 in 2024-04-21T20:51:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:51:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:06 smithi077 ceph-mon[27902]: pgmap v20130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:51:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:51:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:51:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:51:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:06 smithi191 ceph-mon[31636]: pgmap v20130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:51:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:51:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:51:06.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:51:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:06 smithi170 ceph-mon[31212]: pgmap v20130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:51:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:51:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:51:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:51:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:08 smithi077 ceph-mon[27902]: pgmap v20131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:51:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37579.090523 secs 2024-04-21T20:51:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:08 smithi191 ceph-mon[31636]: pgmap v20131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:51:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37579.090523 secs 2024-04-21T20:51:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:08 smithi170 ceph-mon[31212]: pgmap v20131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:51:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37579.090523 secs 2024-04-21T20:51:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37580.846277 secs 2024-04-21T20:51:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:10 smithi170 ceph-mon[31212]: pgmap v20132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:51:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:10 smithi170 ceph-mon[31212]: osdmap e1331: 12 total, 12 up, 12 in 2024-04-21T20:51:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37580.846277 secs 2024-04-21T20:51:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:10 smithi077 ceph-mon[27902]: pgmap v20132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:51:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:10 smithi077 ceph-mon[27902]: osdmap e1331: 12 total, 12 up, 12 in 2024-04-21T20:51:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37580.846277 secs 2024-04-21T20:51:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:10 smithi191 ceph-mon[31636]: pgmap v20132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:51:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:10 smithi191 ceph-mon[31636]: osdmap e1331: 12 total, 12 up, 12 in 2024-04-21T20:51:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:12 smithi170 ceph-mon[31212]: pgmap v20134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T20:51:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:12 smithi077 ceph-mon[27902]: pgmap v20134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T20:51:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:12 smithi191 ceph-mon[31636]: pgmap v20134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-21T20:51:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37584.090661 secs 2024-04-21T20:51:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37584.090661 secs 2024-04-21T20:51:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37584.090661 secs 2024-04-21T20:51:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:14 smithi170 ceph-mon[31212]: pgmap v20135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 345 B/s wr, 7 op/s 2024-04-21T20:51:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:14 smithi077 ceph-mon[27902]: pgmap v20135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 345 B/s wr, 7 op/s 2024-04-21T20:51:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:14 smithi191 ceph-mon[31636]: pgmap v20135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 345 B/s wr, 7 op/s 2024-04-21T20:51:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37585.846399 secs 2024-04-21T20:51:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37585.846399 secs 2024-04-21T20:51:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37585.846399 secs 2024-04-21T20:51:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:16 smithi170 ceph-mon[31212]: pgmap v20136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:51:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:16 smithi077 ceph-mon[27902]: pgmap v20136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:51:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:16 smithi191 ceph-mon[31636]: pgmap v20136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-21T20:51:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:18 smithi170 ceph-mon[31212]: pgmap v20137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:51:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37589.090807 secs 2024-04-21T20:51:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:18 smithi077 ceph-mon[27902]: pgmap v20137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:51:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37589.090807 secs 2024-04-21T20:51:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:18 smithi191 ceph-mon[31636]: pgmap v20137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:51:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37589.090807 secs 2024-04-21T20:51:20.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37590.846515 secs 2024-04-21T20:51:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37590.846515 secs 2024-04-21T20:51:20.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37590.846515 secs 2024-04-21T20:51:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:20 smithi170 ceph-mon[31212]: pgmap v20138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:51:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:20 smithi077 ceph-mon[27902]: pgmap v20138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:51:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:20 smithi191 ceph-mon[31636]: pgmap v20138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:51:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:22 smithi170 ceph-mon[31212]: pgmap v20139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:51:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:22 smithi077 ceph-mon[27902]: pgmap v20139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:51:23.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:22 smithi191 ceph-mon[31636]: pgmap v20139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:51:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37594.090930 secs 2024-04-21T20:51:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37594.090930 secs 2024-04-21T20:51:24.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37594.090930 secs 2024-04-21T20:51:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:24 smithi170 ceph-mon[31212]: pgmap v20140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37595.846602 secs 2024-04-21T20:51:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:24 smithi077 ceph-mon[27902]: pgmap v20140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37595.846602 secs 2024-04-21T20:51:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:24 smithi191 ceph-mon[31636]: pgmap v20140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37595.846602 secs 2024-04-21T20:51:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:26 smithi170 ceph-mon[31212]: pgmap v20141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:26 smithi077 ceph-mon[27902]: pgmap v20141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:26 smithi191 ceph-mon[31636]: pgmap v20141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:28 smithi077 ceph-mon[27902]: pgmap v20142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37599.091016 secs 2024-04-21T20:51:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:28 smithi191 ceph-mon[31636]: pgmap v20142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37599.091016 secs 2024-04-21T20:51:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:28 smithi170 ceph-mon[31212]: pgmap v20142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37599.091016 secs 2024-04-21T20:51:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:30.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37600.846696 secs 2024-04-21T20:51:30.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37600.846696 secs 2024-04-21T20:51:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37600.846696 secs 2024-04-21T20:51:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:30 smithi077 ceph-mon[27902]: pgmap v20143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:30 smithi191 ceph-mon[31636]: pgmap v20143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:30 smithi170 ceph-mon[31212]: pgmap v20143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:32 smithi077 ceph-mon[27902]: pgmap v20144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:32 smithi191 ceph-mon[31636]: pgmap v20144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:32 smithi170 ceph-mon[31212]: pgmap v20144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:34.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37604.091156 secs 2024-04-21T20:51:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37604.091156 secs 2024-04-21T20:51:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37604.091156 secs 2024-04-21T20:51:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:34 smithi077 ceph-mon[27902]: pgmap v20145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37605.846792 secs 2024-04-21T20:51:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:34 smithi191 ceph-mon[31636]: pgmap v20145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37605.846792 secs 2024-04-21T20:51:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:34 smithi170 ceph-mon[31212]: pgmap v20145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37605.846792 secs 2024-04-21T20:51:36.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:35 smithi077 ceph-mon[27902]: pgmap v20146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:36.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:35 smithi191 ceph-mon[31636]: pgmap v20146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:36.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:35 smithi170 ceph-mon[31212]: pgmap v20146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:51:38.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:38 smithi077 ceph-mon[27902]: pgmap v20147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:38 smithi191 ceph-mon[31636]: pgmap v20147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:38 smithi170 ceph-mon[31212]: pgmap v20147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:39.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:39 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37609.091275 secs 2024-04-21T20:51:39.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:39 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37609.091275 secs 2024-04-21T20:51:39.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:39 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37609.091275 secs 2024-04-21T20:51:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37610.846923 secs 2024-04-21T20:51:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:40 smithi077 ceph-mon[27902]: pgmap v20148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37610.846923 secs 2024-04-21T20:51:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:40 smithi191 ceph-mon[31636]: pgmap v20148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37610.846923 secs 2024-04-21T20:51:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:40 smithi170 ceph-mon[31212]: pgmap v20148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:42.361 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:42 smithi170 ceph-mon[31212]: pgmap v20149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:42.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:42 smithi077 ceph-mon[27902]: pgmap v20149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:42 smithi191 ceph-mon[31636]: pgmap v20149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37614.091401 secs 2024-04-21T20:51:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37614.091401 secs 2024-04-21T20:51:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37614.091401 secs 2024-04-21T20:51:44.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:44 smithi191 ceph-mon[31636]: pgmap v20150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:44.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:44 smithi077 ceph-mon[27902]: pgmap v20150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:44 smithi170 ceph-mon[31212]: pgmap v20150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37615.847039 secs 2024-04-21T20:51:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37615.847039 secs 2024-04-21T20:51:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37615.847039 secs 2024-04-21T20:51:46.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:46 smithi077 ceph-mon[27902]: pgmap v20151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:46.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:46 smithi191 ceph-mon[31636]: pgmap v20151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:46.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:46 smithi170 ceph-mon[31212]: pgmap v20151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:48 smithi077 ceph-mon[27902]: pgmap v20152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:48.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37619.091527 secs 2024-04-21T20:51:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:48 smithi191 ceph-mon[31636]: pgmap v20152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37619.091527 secs 2024-04-21T20:51:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:48 smithi170 ceph-mon[31212]: pgmap v20152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37619.091527 secs 2024-04-21T20:51:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37620.847157 secs 2024-04-21T20:51:50.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:50 smithi077 ceph-mon[27902]: pgmap v20153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37620.847157 secs 2024-04-21T20:51:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:50 smithi191 ceph-mon[31636]: pgmap v20153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37620.847157 secs 2024-04-21T20:51:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:50 smithi170 ceph-mon[31212]: pgmap v20153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:52.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:52 smithi077 ceph-mon[27902]: pgmap v20154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:52 smithi191 ceph-mon[31636]: pgmap v20154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:52 smithi170 ceph-mon[31212]: pgmap v20154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:53.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37624.091618 secs 2024-04-21T20:51:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37624.091618 secs 2024-04-21T20:51:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37624.091618 secs 2024-04-21T20:51:54.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:54 smithi077 ceph-mon[27902]: pgmap v20155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:54 smithi191 ceph-mon[31636]: pgmap v20155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:54 smithi170 ceph-mon[31212]: pgmap v20155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:51:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37625.847272 secs 2024-04-21T20:51:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37625.847272 secs 2024-04-21T20:51:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37625.847272 secs 2024-04-21T20:51:56.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:56 smithi077 ceph-mon[27902]: pgmap v20156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:56 smithi191 ceph-mon[31636]: pgmap v20156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:56 smithi170 ceph-mon[31212]: pgmap v20156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:51:58.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:58 smithi077 ceph-mon[27902]: pgmap v20157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:58.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:51:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37629.091788 secs 2024-04-21T20:51:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:58 smithi191 ceph-mon[31636]: pgmap v20157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:51:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37629.091788 secs 2024-04-21T20:51:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:58 smithi170 ceph-mon[31212]: pgmap v20157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:51:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:51:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37629.091788 secs 2024-04-21T20:52:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:00.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37630.847409 secs 2024-04-21T20:52:00.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:00 smithi077 ceph-mon[27902]: pgmap v20158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37630.847409 secs 2024-04-21T20:52:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:00 smithi191 ceph-mon[31636]: pgmap v20158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37630.847409 secs 2024-04-21T20:52:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:00 smithi170 ceph-mon[31212]: pgmap v20158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:02.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:02 smithi077 ceph-mon[27902]: pgmap v20159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:02 smithi191 ceph-mon[31636]: pgmap v20159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:02 smithi170 ceph-mon[31212]: pgmap v20159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37634.091853 secs 2024-04-21T20:52:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37634.091853 secs 2024-04-21T20:52:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37634.091853 secs 2024-04-21T20:52:04.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:04 smithi077 ceph-mon[27902]: pgmap v20160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:04.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:04 smithi191 ceph-mon[31636]: pgmap v20160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:04 smithi170 ceph-mon[31212]: pgmap v20160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37635.847513 secs 2024-04-21T20:52:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:05 smithi191 ceph-mon[31636]: osdmap e1332: 12 total, 12 up, 12 in 2024-04-21T20:52:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37635.847513 secs 2024-04-21T20:52:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:05 smithi170 ceph-mon[31212]: osdmap e1332: 12 total, 12 up, 12 in 2024-04-21T20:52:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37635.847513 secs 2024-04-21T20:52:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:05 smithi077 ceph-mon[27902]: osdmap e1332: 12 total, 12 up, 12 in 2024-04-21T20:52:06.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:06 smithi191 ceph-mon[31636]: pgmap v20162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:52:06.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:52:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:06 smithi170 ceph-mon[31212]: pgmap v20162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:52:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:52:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:06 smithi077 ceph-mon[27902]: pgmap v20162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:52:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:52:07.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:52:07.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:52:07.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:52:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:52:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:52:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:52:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:52:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:52:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:52:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:08 smithi191 ceph-mon[31636]: pgmap v20163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37639.091979 secs 2024-04-21T20:52:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:08 smithi170 ceph-mon[31212]: pgmap v20163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37639.091979 secs 2024-04-21T20:52:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:08 smithi077 ceph-mon[27902]: pgmap v20163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37639.091979 secs 2024-04-21T20:52:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37640.847631 secs 2024-04-21T20:52:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:10 smithi170 ceph-mon[31212]: pgmap v20164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:10 smithi170 ceph-mon[31212]: osdmap e1333: 12 total, 12 up, 12 in 2024-04-21T20:52:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37640.847631 secs 2024-04-21T20:52:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:10 smithi077 ceph-mon[27902]: pgmap v20164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:10 smithi077 ceph-mon[27902]: osdmap e1333: 12 total, 12 up, 12 in 2024-04-21T20:52:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37640.847631 secs 2024-04-21T20:52:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:10 smithi191 ceph-mon[31636]: pgmap v20164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:10 smithi191 ceph-mon[31636]: osdmap e1333: 12 total, 12 up, 12 in 2024-04-21T20:52:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:12 smithi170 ceph-mon[31212]: pgmap v20166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:52:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:12 smithi077 ceph-mon[27902]: pgmap v20166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:52:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:12 smithi191 ceph-mon[31636]: pgmap v20166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:52:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37644.092082 secs 2024-04-21T20:52:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37644.092082 secs 2024-04-21T20:52:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37644.092082 secs 2024-04-21T20:52:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:14 smithi170 ceph-mon[31212]: pgmap v20167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:52:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37645.847764 secs 2024-04-21T20:52:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:14 smithi077 ceph-mon[27902]: pgmap v20167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:52:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37645.847764 secs 2024-04-21T20:52:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:14 smithi191 ceph-mon[31636]: pgmap v20167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:52:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37645.847764 secs 2024-04-21T20:52:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:16 smithi170 ceph-mon[31212]: pgmap v20168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:16 smithi077 ceph-mon[27902]: pgmap v20168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:16 smithi191 ceph-mon[31636]: pgmap v20168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:52:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:18 smithi170 ceph-mon[31212]: pgmap v20169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:52:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37649.092206 secs 2024-04-21T20:52:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:18 smithi077 ceph-mon[27902]: pgmap v20169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:52:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37649.092206 secs 2024-04-21T20:52:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:18 smithi191 ceph-mon[31636]: pgmap v20169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:52:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37649.092206 secs 2024-04-21T20:52:20.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37650.847884 secs 2024-04-21T20:52:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37650.847884 secs 2024-04-21T20:52:20.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37650.847884 secs 2024-04-21T20:52:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:20 smithi077 ceph-mon[27902]: pgmap v20170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:52:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:20 smithi191 ceph-mon[31636]: pgmap v20170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:52:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:20 smithi170 ceph-mon[31212]: pgmap v20170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:52:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:22 smithi077 ceph-mon[27902]: pgmap v20171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:52:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:22 smithi191 ceph-mon[31636]: pgmap v20171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:52:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:22 smithi170 ceph-mon[31212]: pgmap v20171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:52:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37654.092327 secs 2024-04-21T20:52:24.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37654.092327 secs 2024-04-21T20:52:24.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37654.092327 secs 2024-04-21T20:52:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:24 smithi077 ceph-mon[27902]: pgmap v20172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37655.848012 secs 2024-04-21T20:52:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:24 smithi191 ceph-mon[31636]: pgmap v20172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37655.848012 secs 2024-04-21T20:52:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:24 smithi170 ceph-mon[31212]: pgmap v20172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:25.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37655.848012 secs 2024-04-21T20:52:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:26 smithi077 ceph-mon[27902]: pgmap v20173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:26 smithi191 ceph-mon[31636]: pgmap v20173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:26 smithi170 ceph-mon[31212]: pgmap v20173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:28 smithi077 ceph-mon[27902]: pgmap v20174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37659.092425 secs 2024-04-21T20:52:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:28 smithi191 ceph-mon[31636]: pgmap v20174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37659.092425 secs 2024-04-21T20:52:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:28 smithi170 ceph-mon[31212]: pgmap v20174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:29.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37659.092425 secs 2024-04-21T20:52:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37660.848128 secs 2024-04-21T20:52:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37660.848128 secs 2024-04-21T20:52:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37660.848128 secs 2024-04-21T20:52:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:30 smithi077 ceph-mon[27902]: pgmap v20175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:30 smithi191 ceph-mon[31636]: pgmap v20175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:30 smithi170 ceph-mon[31212]: pgmap v20175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:31 smithi077 ceph-mon[27902]: pgmap v20176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:31 smithi191 ceph-mon[31636]: pgmap v20176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:31 smithi170 ceph-mon[31212]: pgmap v20176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37664.092564 secs 2024-04-21T20:52:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37664.092564 secs 2024-04-21T20:52:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37664.092564 secs 2024-04-21T20:52:34.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:34 smithi077 ceph-mon[27902]: pgmap v20177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:34 smithi191 ceph-mon[31636]: pgmap v20177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:34 smithi170 ceph-mon[31212]: pgmap v20177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37665.848205 secs 2024-04-21T20:52:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37665.848205 secs 2024-04-21T20:52:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37665.848205 secs 2024-04-21T20:52:36.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:36 smithi077 ceph-mon[27902]: pgmap v20178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:36 smithi191 ceph-mon[31636]: pgmap v20178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:36 smithi170 ceph-mon[31212]: pgmap v20178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:38.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:38 smithi077 ceph-mon[27902]: pgmap v20179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:38.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37669.092680 secs 2024-04-21T20:52:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:38 smithi191 ceph-mon[31636]: pgmap v20179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37669.092680 secs 2024-04-21T20:52:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:38 smithi170 ceph-mon[31212]: pgmap v20179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37669.092680 secs 2024-04-21T20:52:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37670.848312 secs 2024-04-21T20:52:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:40 smithi191 ceph-mon[31636]: pgmap v20180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37670.848312 secs 2024-04-21T20:52:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:40 smithi170 ceph-mon[31212]: pgmap v20180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37670.848312 secs 2024-04-21T20:52:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:40 smithi077 ceph-mon[27902]: pgmap v20180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:42 smithi191 ceph-mon[31636]: pgmap v20181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:42 smithi170 ceph-mon[31212]: pgmap v20181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:42 smithi077 ceph-mon[27902]: pgmap v20181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37674.092801 secs 2024-04-21T20:52:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37674.092801 secs 2024-04-21T20:52:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37674.092801 secs 2024-04-21T20:52:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:44 smithi191 ceph-mon[31636]: pgmap v20182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:44 smithi170 ceph-mon[31212]: pgmap v20182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:44 smithi077 ceph-mon[27902]: pgmap v20182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37675.848431 secs 2024-04-21T20:52:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37675.848431 secs 2024-04-21T20:52:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37675.848431 secs 2024-04-21T20:52:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:46 smithi191 ceph-mon[31636]: pgmap v20183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:46 smithi170 ceph-mon[31212]: pgmap v20183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:46 smithi077 ceph-mon[27902]: pgmap v20183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:48 smithi191 ceph-mon[31636]: pgmap v20184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37679.092920 secs 2024-04-21T20:52:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:48 smithi170 ceph-mon[31212]: pgmap v20184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37679.092920 secs 2024-04-21T20:52:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:48 smithi077 ceph-mon[27902]: pgmap v20184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37679.092920 secs 2024-04-21T20:52:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37680.848548 secs 2024-04-21T20:52:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:50 smithi191 ceph-mon[31636]: pgmap v20185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37680.848548 secs 2024-04-21T20:52:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:50 smithi170 ceph-mon[31212]: pgmap v20185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37680.848548 secs 2024-04-21T20:52:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:50 smithi077 ceph-mon[27902]: pgmap v20185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:52.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:52 smithi191 ceph-mon[31636]: pgmap v20186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:52 smithi170 ceph-mon[31212]: pgmap v20186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:52 smithi077 ceph-mon[27902]: pgmap v20186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37684.093046 secs 2024-04-21T20:52:53.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37684.093046 secs 2024-04-21T20:52:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37684.093046 secs 2024-04-21T20:52:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:54 smithi191 ceph-mon[31636]: pgmap v20187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:54 smithi170 ceph-mon[31212]: pgmap v20187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:54 smithi077 ceph-mon[27902]: pgmap v20187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:52:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37685.848666 secs 2024-04-21T20:52:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37685.848666 secs 2024-04-21T20:52:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37685.848666 secs 2024-04-21T20:52:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:56 smithi191 ceph-mon[31636]: pgmap v20188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:56 smithi170 ceph-mon[31212]: pgmap v20188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:56 smithi077 ceph-mon[27902]: pgmap v20188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:52:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:58 smithi191 ceph-mon[31636]: pgmap v20189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:52:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37689.093149 secs 2024-04-21T20:52:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:58 smithi170 ceph-mon[31212]: pgmap v20189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:52:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37689.093149 secs 2024-04-21T20:52:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:58 smithi077 ceph-mon[27902]: pgmap v20189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:52:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:52:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37689.093149 secs 2024-04-21T20:52:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:52:59.565+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:52:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:52:59.565+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:52:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:52:59.565+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:52:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:52:59.565+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:53:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:00.439 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37690.848789 secs 2024-04-21T20:53:00.439 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:00 smithi077 ceph-mon[27902]: pgmap v20190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37690.848789 secs 2024-04-21T20:53:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:00 smithi191 ceph-mon[31636]: pgmap v20190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37690.848789 secs 2024-04-21T20:53:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:00 smithi170 ceph-mon[31212]: pgmap v20190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:02 smithi191 ceph-mon[31636]: pgmap v20191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:02.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:02 smithi170 ceph-mon[31212]: pgmap v20191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:02 smithi077 ceph-mon[27902]: pgmap v20191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37694.093271 secs 2024-04-21T20:53:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37694.093271 secs 2024-04-21T20:53:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37694.093271 secs 2024-04-21T20:53:04.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:04 smithi191 ceph-mon[31636]: pgmap v20192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:53:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:04 smithi170 ceph-mon[31212]: pgmap v20192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:53:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:04 smithi077 ceph-mon[27902]: pgmap v20192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T20:53:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37695.848862 secs 2024-04-21T20:53:05.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:05 smithi191 ceph-mon[31636]: osdmap e1334: 12 total, 12 up, 12 in 2024-04-21T20:53:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37695.848862 secs 2024-04-21T20:53:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:05 smithi170 ceph-mon[31212]: osdmap e1334: 12 total, 12 up, 12 in 2024-04-21T20:53:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37695.848862 secs 2024-04-21T20:53:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:05 smithi077 ceph-mon[27902]: osdmap e1334: 12 total, 12 up, 12 in 2024-04-21T20:53:06.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:06 smithi191 ceph-mon[31636]: pgmap v20194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:53:06.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:06 smithi170 ceph-mon[31212]: pgmap v20194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:53:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:06 smithi077 ceph-mon[27902]: pgmap v20194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:53:07.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:53:07.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:53:07.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:53:07.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:53:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:53:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:53:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:53:07.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:53:07.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:53:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:53:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:53:07.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:53:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:08 smithi191 ceph-mon[31636]: pgmap v20195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37699.093408 secs 2024-04-21T20:53:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:08 smithi170 ceph-mon[31212]: pgmap v20195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37699.093408 secs 2024-04-21T20:53:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:08 smithi077 ceph-mon[27902]: pgmap v20195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37699.093408 secs 2024-04-21T20:53:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37700.848936 secs 2024-04-21T20:53:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:10 smithi170 ceph-mon[31212]: pgmap v20196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:10 smithi170 ceph-mon[31212]: osdmap e1335: 12 total, 12 up, 12 in 2024-04-21T20:53:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37700.848936 secs 2024-04-21T20:53:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:10 smithi077 ceph-mon[27902]: pgmap v20196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:10 smithi077 ceph-mon[27902]: osdmap e1335: 12 total, 12 up, 12 in 2024-04-21T20:53:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37700.848936 secs 2024-04-21T20:53:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:10 smithi191 ceph-mon[31636]: pgmap v20196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:10 smithi191 ceph-mon[31636]: osdmap e1335: 12 total, 12 up, 12 in 2024-04-21T20:53:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:12 smithi170 ceph-mon[31212]: pgmap v20198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:53:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:12 smithi077 ceph-mon[27902]: pgmap v20198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:53:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:12 smithi191 ceph-mon[31636]: pgmap v20198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:53:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37704.093556 secs 2024-04-21T20:53:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37704.093556 secs 2024-04-21T20:53:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37704.093556 secs 2024-04-21T20:53:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:14 smithi170 ceph-mon[31212]: pgmap v20199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:53:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37705.849006 secs 2024-04-21T20:53:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:14 smithi077 ceph-mon[27902]: pgmap v20199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:53:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37705.849006 secs 2024-04-21T20:53:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:14 smithi191 ceph-mon[31636]: pgmap v20199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:53:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37705.849006 secs 2024-04-21T20:53:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:16 smithi170 ceph-mon[31212]: pgmap v20200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:16 smithi077 ceph-mon[27902]: pgmap v20200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:16 smithi191 ceph-mon[31636]: pgmap v20200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:53:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:18 smithi077 ceph-mon[27902]: pgmap v20201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:53:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37709.093701 secs 2024-04-21T20:53:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:18 smithi191 ceph-mon[31636]: pgmap v20201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:53:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37709.093701 secs 2024-04-21T20:53:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:18 smithi170 ceph-mon[31212]: pgmap v20201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:53:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37709.093701 secs 2024-04-21T20:53:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37710.849100 secs 2024-04-21T20:53:20.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37710.849100 secs 2024-04-21T20:53:20.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37710.849100 secs 2024-04-21T20:53:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:20 smithi077 ceph-mon[27902]: pgmap v20202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:53:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:20 smithi191 ceph-mon[31636]: pgmap v20202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:53:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:20 smithi170 ceph-mon[31212]: pgmap v20202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:53:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:22 smithi077 ceph-mon[27902]: pgmap v20203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:53:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:22 smithi191 ceph-mon[31636]: pgmap v20203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:53:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:22 smithi170 ceph-mon[31212]: pgmap v20203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:53:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37714.093814 secs 2024-04-21T20:53:24.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37714.093814 secs 2024-04-21T20:53:24.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37714.093814 secs 2024-04-21T20:53:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:24 smithi077 ceph-mon[27902]: pgmap v20204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37715.849219 secs 2024-04-21T20:53:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:24 smithi191 ceph-mon[31636]: pgmap v20204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37715.849219 secs 2024-04-21T20:53:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:24 smithi170 ceph-mon[31212]: pgmap v20204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37715.849219 secs 2024-04-21T20:53:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:26 smithi077 ceph-mon[27902]: pgmap v20205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:26 smithi191 ceph-mon[31636]: pgmap v20205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:26 smithi170 ceph-mon[31212]: pgmap v20205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:28 smithi077 ceph-mon[27902]: pgmap v20206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37719.093958 secs 2024-04-21T20:53:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:28 smithi191 ceph-mon[31636]: pgmap v20206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37719.093958 secs 2024-04-21T20:53:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:28 smithi170 ceph-mon[31212]: pgmap v20206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37719.093958 secs 2024-04-21T20:53:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37720.849331 secs 2024-04-21T20:53:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37720.849331 secs 2024-04-21T20:53:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37720.849331 secs 2024-04-21T20:53:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:30 smithi077 ceph-mon[27902]: pgmap v20207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:30 smithi191 ceph-mon[31636]: pgmap v20207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:30 smithi170 ceph-mon[31212]: pgmap v20207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:32.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:31 smithi191 ceph-mon[31636]: pgmap v20208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:31 smithi170 ceph-mon[31212]: pgmap v20208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:31 smithi077 ceph-mon[27902]: pgmap v20208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:33.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37724.094083 secs 2024-04-21T20:53:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37724.094083 secs 2024-04-21T20:53:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37724.094083 secs 2024-04-21T20:53:34.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:34 smithi077 ceph-mon[27902]: pgmap v20209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:34 smithi191 ceph-mon[31636]: pgmap v20209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:34 smithi170 ceph-mon[31212]: pgmap v20209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:35.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37725.849470 secs 2024-04-21T20:53:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37725.849470 secs 2024-04-21T20:53:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37725.849470 secs 2024-04-21T20:53:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:36 smithi191 ceph-mon[31636]: pgmap v20210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:36 smithi170 ceph-mon[31212]: pgmap v20210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:36.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:36 smithi077 ceph-mon[27902]: pgmap v20210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:38 smithi191 ceph-mon[31636]: pgmap v20211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37729.094203 secs 2024-04-21T20:53:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:38 smithi170 ceph-mon[31212]: pgmap v20211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37729.094203 secs 2024-04-21T20:53:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:38 smithi077 ceph-mon[27902]: pgmap v20211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37729.094203 secs 2024-04-21T20:53:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37730.849535 secs 2024-04-21T20:53:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:40 smithi191 ceph-mon[31636]: pgmap v20212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37730.849535 secs 2024-04-21T20:53:40.560 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:40 smithi170 ceph-mon[31212]: pgmap v20212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37730.849535 secs 2024-04-21T20:53:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:40 smithi077 ceph-mon[27902]: pgmap v20212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:42 smithi191 ceph-mon[31636]: pgmap v20213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:42 smithi170 ceph-mon[31212]: pgmap v20213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:42 smithi077 ceph-mon[27902]: pgmap v20213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37734.094340 secs 2024-04-21T20:53:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37734.094340 secs 2024-04-21T20:53:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37734.094340 secs 2024-04-21T20:53:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:44 smithi191 ceph-mon[31636]: pgmap v20214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:44 smithi170 ceph-mon[31212]: pgmap v20214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:44 smithi077 ceph-mon[27902]: pgmap v20214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:45.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37735.849654 secs 2024-04-21T20:53:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37735.849654 secs 2024-04-21T20:53:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37735.849654 secs 2024-04-21T20:53:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:46 smithi191 ceph-mon[31636]: pgmap v20215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:46.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:46 smithi170 ceph-mon[31212]: pgmap v20215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:46 smithi077 ceph-mon[27902]: pgmap v20215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:48 smithi191 ceph-mon[31636]: pgmap v20216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37739.094436 secs 2024-04-21T20:53:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:48 smithi170 ceph-mon[31212]: pgmap v20216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37739.094436 secs 2024-04-21T20:53:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:48 smithi077 ceph-mon[27902]: pgmap v20216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37739.094436 secs 2024-04-21T20:53:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37740.849767 secs 2024-04-21T20:53:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:50 smithi170 ceph-mon[31212]: pgmap v20217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37740.849767 secs 2024-04-21T20:53:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:50 smithi077 ceph-mon[27902]: pgmap v20217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37740.849767 secs 2024-04-21T20:53:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:50 smithi191 ceph-mon[31636]: pgmap v20217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:53.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:52 smithi077 ceph-mon[27902]: pgmap v20218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:52 smithi191 ceph-mon[31636]: pgmap v20218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:53.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:52 smithi170 ceph-mon[31212]: pgmap v20218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:54.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37744.094513 secs 2024-04-21T20:53:54.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37744.094513 secs 2024-04-21T20:53:54.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37744.094513 secs 2024-04-21T20:53:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:53:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:54 smithi077 ceph-mon[27902]: pgmap v20219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37745.849893 secs 2024-04-21T20:53:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:54 smithi191 ceph-mon[31636]: pgmap v20219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37745.849893 secs 2024-04-21T20:53:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:54 smithi170 ceph-mon[31212]: pgmap v20219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37745.849893 secs 2024-04-21T20:53:57.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:56 smithi077 ceph-mon[27902]: pgmap v20220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:56 smithi191 ceph-mon[31636]: pgmap v20220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:57.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:56 smithi170 ceph-mon[31212]: pgmap v20220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:53:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:58 smithi077 ceph-mon[27902]: pgmap v20221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37749.094658 secs 2024-04-21T20:53:59.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:58 smithi191 ceph-mon[31636]: pgmap v20221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37749.094658 secs 2024-04-21T20:53:59.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:58 smithi170 ceph-mon[31212]: pgmap v20221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:53:59.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37749.094658 secs 2024-04-21T20:54:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:00.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:53:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37750.850008 secs 2024-04-21T20:54:00.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:53:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37750.850008 secs 2024-04-21T20:54:00.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:53:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37750.850008 secs 2024-04-21T20:54:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:00 smithi077 ceph-mon[27902]: pgmap v20222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:00 smithi191 ceph-mon[31636]: pgmap v20222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:01.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:00 smithi170 ceph-mon[31212]: pgmap v20222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:02 smithi077 ceph-mon[27902]: pgmap v20223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:02 smithi191 ceph-mon[31636]: pgmap v20223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:02 smithi170 ceph-mon[31212]: pgmap v20223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:04.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37754.094798 secs 2024-04-21T20:54:04.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37754.094798 secs 2024-04-21T20:54:04.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37754.094798 secs 2024-04-21T20:54:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:04 smithi077 ceph-mon[27902]: pgmap v20224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37755.850133 secs 2024-04-21T20:54:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:04 smithi191 ceph-mon[31636]: pgmap v20224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37755.850133 secs 2024-04-21T20:54:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:04 smithi170 ceph-mon[31212]: pgmap v20224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37755.850133 secs 2024-04-21T20:54:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:05 smithi077 ceph-mon[27902]: osdmap e1336: 12 total, 12 up, 12 in 2024-04-21T20:54:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:05 smithi077 ceph-mon[27902]: pgmap v20226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:05 smithi191 ceph-mon[31636]: osdmap e1336: 12 total, 12 up, 12 in 2024-04-21T20:54:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:05 smithi191 ceph-mon[31636]: pgmap v20226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:05 smithi170 ceph-mon[31212]: osdmap e1336: 12 total, 12 up, 12 in 2024-04-21T20:54:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:05 smithi170 ceph-mon[31212]: pgmap v20226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:07.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:54:07.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:54:07.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:54:08.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:08 smithi077 ceph-mon[27902]: pgmap v20227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:54:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37759.094893 secs 2024-04-21T20:54:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:54:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:54:08.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:54:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:08 smithi191 ceph-mon[31636]: pgmap v20227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:54:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37759.094893 secs 2024-04-21T20:54:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:54:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:54:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:54:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:08 smithi170 ceph-mon[31212]: pgmap v20227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:54:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37759.094893 secs 2024-04-21T20:54:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:54:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:54:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:54:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37760.850250 secs 2024-04-21T20:54:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:10 smithi077 ceph-mon[27902]: pgmap v20228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:54:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37760.850250 secs 2024-04-21T20:54:10.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:10 smithi191 ceph-mon[31636]: pgmap v20228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:54:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37760.850250 secs 2024-04-21T20:54:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:10 smithi170 ceph-mon[31212]: pgmap v20228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:54:12.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:12 smithi077 ceph-mon[27902]: pgmap v20229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:12.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:12 smithi191 ceph-mon[31636]: pgmap v20229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:12 smithi170 ceph-mon[31212]: pgmap v20229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37764.095017 secs 2024-04-21T20:54:13.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37764.095017 secs 2024-04-21T20:54:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37764.095017 secs 2024-04-21T20:54:14.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:14 smithi077 ceph-mon[27902]: pgmap v20230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:14.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:14 smithi191 ceph-mon[31636]: pgmap v20230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:14 smithi170 ceph-mon[31212]: pgmap v20230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37765.850359 secs 2024-04-21T20:54:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:15 smithi077 ceph-mon[27902]: osdmap e1337: 12 total, 12 up, 12 in 2024-04-21T20:54:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37765.850359 secs 2024-04-21T20:54:15.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:15 smithi191 ceph-mon[31636]: osdmap e1337: 12 total, 12 up, 12 in 2024-04-21T20:54:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37765.850359 secs 2024-04-21T20:54:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:15 smithi170 ceph-mon[31212]: osdmap e1337: 12 total, 12 up, 12 in 2024-04-21T20:54:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:16 smithi077 ceph-mon[27902]: pgmap v20232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:16 smithi191 ceph-mon[31636]: pgmap v20232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:17.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:16 smithi170 ceph-mon[31212]: pgmap v20232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:54:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:18 smithi077 ceph-mon[27902]: pgmap v20233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:54:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37769.095144 secs 2024-04-21T20:54:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:18 smithi191 ceph-mon[31636]: pgmap v20233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:54:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37769.095144 secs 2024-04-21T20:54:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:18 smithi170 ceph-mon[31212]: pgmap v20233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:54:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37769.095144 secs 2024-04-21T20:54:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:20.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37770.850440 secs 2024-04-21T20:54:20.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37770.850440 secs 2024-04-21T20:54:20.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37770.850440 secs 2024-04-21T20:54:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:20 smithi077 ceph-mon[27902]: pgmap v20234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:54:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:20 smithi191 ceph-mon[31636]: pgmap v20234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:54:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:20 smithi170 ceph-mon[31212]: pgmap v20234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:54:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:22 smithi077 ceph-mon[27902]: pgmap v20235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:22 smithi191 ceph-mon[31636]: pgmap v20235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:22 smithi170 ceph-mon[31212]: pgmap v20235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37774.095265 secs 2024-04-21T20:54:24.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37774.095265 secs 2024-04-21T20:54:24.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37774.095265 secs 2024-04-21T20:54:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:24 smithi077 ceph-mon[27902]: pgmap v20236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37775.850580 secs 2024-04-21T20:54:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:24 smithi191 ceph-mon[31636]: pgmap v20236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37775.850580 secs 2024-04-21T20:54:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:24 smithi170 ceph-mon[31212]: pgmap v20236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:54:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37775.850580 secs 2024-04-21T20:54:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:26 smithi077 ceph-mon[27902]: pgmap v20237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:54:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:26 smithi191 ceph-mon[31636]: pgmap v20237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:54:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:26 smithi170 ceph-mon[31212]: pgmap v20237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T20:54:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:28 smithi077 ceph-mon[27902]: pgmap v20238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37779.095388 secs 2024-04-21T20:54:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:28 smithi191 ceph-mon[31636]: pgmap v20238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37779.095388 secs 2024-04-21T20:54:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:28 smithi170 ceph-mon[31212]: pgmap v20238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37779.095388 secs 2024-04-21T20:54:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37780.850707 secs 2024-04-21T20:54:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37780.850707 secs 2024-04-21T20:54:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37780.850707 secs 2024-04-21T20:54:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:30 smithi077 ceph-mon[27902]: pgmap v20239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:30 smithi191 ceph-mon[31636]: pgmap v20239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:30 smithi170 ceph-mon[31212]: pgmap v20239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:32.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:31 smithi077 ceph-mon[27902]: pgmap v20240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:31 smithi191 ceph-mon[31636]: pgmap v20240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:31 smithi170 ceph-mon[31212]: pgmap v20240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37784.095508 secs 2024-04-21T20:54:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37784.095508 secs 2024-04-21T20:54:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37784.095508 secs 2024-04-21T20:54:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:34 smithi191 ceph-mon[31636]: pgmap v20241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:34 smithi170 ceph-mon[31212]: pgmap v20241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:34 smithi077 ceph-mon[27902]: pgmap v20241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37785.850846 secs 2024-04-21T20:54:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37785.850846 secs 2024-04-21T20:54:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37785.850846 secs 2024-04-21T20:54:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:36 smithi191 ceph-mon[31636]: pgmap v20242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:36.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:36 smithi170 ceph-mon[31212]: pgmap v20242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:36 smithi077 ceph-mon[27902]: pgmap v20242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:38 smithi191 ceph-mon[31636]: pgmap v20243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:38.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37789.095582 secs 2024-04-21T20:54:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:38 smithi170 ceph-mon[31212]: pgmap v20243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:38.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37789.095582 secs 2024-04-21T20:54:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:38 smithi077 ceph-mon[27902]: pgmap v20243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37789.095582 secs 2024-04-21T20:54:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37790.850895 secs 2024-04-21T20:54:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:40 smithi191 ceph-mon[31636]: pgmap v20244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37790.850895 secs 2024-04-21T20:54:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:40 smithi170 ceph-mon[31212]: pgmap v20244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37790.850895 secs 2024-04-21T20:54:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:40 smithi077 ceph-mon[27902]: pgmap v20244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:42.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:42 smithi191 ceph-mon[31636]: pgmap v20245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:42 smithi170 ceph-mon[31212]: pgmap v20245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:42 smithi077 ceph-mon[27902]: pgmap v20245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37794.095708 secs 2024-04-21T20:54:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37794.095708 secs 2024-04-21T20:54:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37794.095708 secs 2024-04-21T20:54:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:44 smithi191 ceph-mon[31636]: pgmap v20246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:44 smithi170 ceph-mon[31212]: pgmap v20246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:44 smithi077 ceph-mon[27902]: pgmap v20246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37795.851012 secs 2024-04-21T20:54:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37795.851012 secs 2024-04-21T20:54:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37795.851012 secs 2024-04-21T20:54:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:46 smithi191 ceph-mon[31636]: pgmap v20247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:46 smithi170 ceph-mon[31212]: pgmap v20247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:46.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:46 smithi077 ceph-mon[27902]: pgmap v20247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:48 smithi191 ceph-mon[31636]: pgmap v20248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:48.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37799.095826 secs 2024-04-21T20:54:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:48 smithi170 ceph-mon[31212]: pgmap v20248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37799.095826 secs 2024-04-21T20:54:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:48 smithi077 ceph-mon[27902]: pgmap v20248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37799.095826 secs 2024-04-21T20:54:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37800.851123 secs 2024-04-21T20:54:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:50 smithi191 ceph-mon[31636]: pgmap v20249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37800.851123 secs 2024-04-21T20:54:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:50 smithi170 ceph-mon[31212]: pgmap v20249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37800.851123 secs 2024-04-21T20:54:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:50 smithi077 ceph-mon[27902]: pgmap v20249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:52 smithi191 ceph-mon[31636]: pgmap v20250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:52 smithi170 ceph-mon[31212]: pgmap v20250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:52 smithi077 ceph-mon[27902]: pgmap v20250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37804.095958 secs 2024-04-21T20:54:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37804.095958 secs 2024-04-21T20:54:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37804.095958 secs 2024-04-21T20:54:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:54 smithi191 ceph-mon[31636]: pgmap v20251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:54 smithi170 ceph-mon[31212]: pgmap v20251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:54 smithi077 ceph-mon[27902]: pgmap v20251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:54:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37805.851241 secs 2024-04-21T20:54:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37805.851241 secs 2024-04-21T20:54:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37805.851241 secs 2024-04-21T20:54:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:56 smithi191 ceph-mon[31636]: pgmap v20252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:56 smithi170 ceph-mon[31212]: pgmap v20252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:56 smithi077 ceph-mon[27902]: pgmap v20252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:54:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:58 smithi191 ceph-mon[31636]: pgmap v20253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:54:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37809.096084 secs 2024-04-21T20:54:58.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:58 smithi170 ceph-mon[31212]: pgmap v20253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:54:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37809.096084 secs 2024-04-21T20:54:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:58 smithi077 ceph-mon[27902]: pgmap v20253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:54:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:54:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37809.096084 secs 2024-04-21T20:55:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 37995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37810.851348 secs 2024-04-21T20:55:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:00 smithi191 ceph-mon[31636]: pgmap v20254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37810.851348 secs 2024-04-21T20:55:00.562 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:00 smithi170 ceph-mon[31212]: pgmap v20254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37810.851348 secs 2024-04-21T20:55:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:00 smithi077 ceph-mon[27902]: pgmap v20254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:02 smithi191 ceph-mon[31636]: pgmap v20255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:02.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:02 smithi170 ceph-mon[31212]: pgmap v20255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:02 smithi077 ceph-mon[27902]: pgmap v20255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37814.096226 secs 2024-04-21T20:55:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37814.096226 secs 2024-04-21T20:55:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37814.096226 secs 2024-04-21T20:55:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:04 smithi170 ceph-mon[31212]: pgmap v20256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:04 smithi077 ceph-mon[27902]: pgmap v20256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:04 smithi191 ceph-mon[31636]: pgmap v20256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37815.851420 secs 2024-04-21T20:55:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:05 smithi170 ceph-mon[31212]: osdmap e1338: 12 total, 12 up, 12 in 2024-04-21T20:55:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37815.851420 secs 2024-04-21T20:55:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:05 smithi077 ceph-mon[27902]: osdmap e1338: 12 total, 12 up, 12 in 2024-04-21T20:55:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37815.851420 secs 2024-04-21T20:55:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:05 smithi191 ceph-mon[31636]: osdmap e1338: 12 total, 12 up, 12 in 2024-04-21T20:55:07.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:06 smithi077 ceph-mon[27902]: pgmap v20258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:55:07.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:06 smithi191 ceph-mon[31636]: pgmap v20258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:55:07.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:06 smithi170 ceph-mon[31212]: pgmap v20258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:55:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:55:08.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:55:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:55:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:08 smithi077 ceph-mon[27902]: pgmap v20259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:55:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37819.096317 secs 2024-04-21T20:55:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:08 smithi191 ceph-mon[31636]: pgmap v20259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:55:08.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37819.096317 secs 2024-04-21T20:55:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:08 smithi170 ceph-mon[31212]: pgmap v20259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:55:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37819.096317 secs 2024-04-21T20:55:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37820.851536 secs 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: pgmap v20260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: osdmap e1339: 12 total, 12 up, 12 in 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:55:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:55:10.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37820.851536 secs 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: pgmap v20260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: osdmap e1339: 12 total, 12 up, 12 in 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:55:10.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37820.851536 secs 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: pgmap v20260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: osdmap e1339: 12 total, 12 up, 12 in 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:55:10.972 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:55:11.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:11 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:55:11.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:11 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:55:11.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:11 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:55:11.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:11 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:55:11.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:11 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:55:11.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:11 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:55:11.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:11 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:55:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:11 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:55:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:11 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:55:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:11 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:55:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:11 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:55:11.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:11 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:55:12.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:11 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T20:55:12.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:11 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T20:55:12.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:11 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T20:55:12.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:11 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T20:55:12.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:11 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T20:55:12.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:11 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T20:55:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:12 smithi077 ceph-mon[27902]: pgmap v20262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:55:12.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:12 smithi170 ceph-mon[31212]: pgmap v20262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:55:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:12 smithi191 ceph-mon[31636]: pgmap v20262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:55:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37824.096474 secs 2024-04-21T20:55:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37824.096474 secs 2024-04-21T20:55:13.974 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37824.096474 secs 2024-04-21T20:55:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:14 smithi191 ceph-mon[31636]: pgmap v20263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:55:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:14 smithi077 ceph-mon[27902]: pgmap v20263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:55:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:14 smithi170 ceph-mon[31212]: pgmap v20263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:55:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37825.851650 secs 2024-04-21T20:55:15.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37825.851650 secs 2024-04-21T20:55:16.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37825.851650 secs 2024-04-21T20:55:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:16 smithi077 ceph-mon[27902]: pgmap v20264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:55:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:16 smithi191 ceph-mon[31636]: pgmap v20264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:55:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:16 smithi170 ceph-mon[31212]: pgmap v20264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:55:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:18 smithi077 ceph-mon[27902]: pgmap v20265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:55:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37829.096618 secs 2024-04-21T20:55:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:18 smithi191 ceph-mon[31636]: pgmap v20265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:55:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37829.096618 secs 2024-04-21T20:55:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:18 smithi170 ceph-mon[31212]: pgmap v20265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:55:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37829.096618 secs 2024-04-21T20:55:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37830.851762 secs 2024-04-21T20:55:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:20 smithi077 ceph-mon[27902]: pgmap v20266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:55:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37830.851762 secs 2024-04-21T20:55:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:20 smithi191 ceph-mon[31636]: pgmap v20266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:55:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37830.851762 secs 2024-04-21T20:55:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:20 smithi170 ceph-mon[31212]: pgmap v20266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:55:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:22 smithi077 ceph-mon[27902]: pgmap v20267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:55:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:22 smithi191 ceph-mon[31636]: pgmap v20267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:55:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:22 smithi170 ceph-mon[31212]: pgmap v20267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:55:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37834.096757 secs 2024-04-21T20:55:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37834.096757 secs 2024-04-21T20:55:24.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37834.096757 secs 2024-04-21T20:55:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:24 smithi077 ceph-mon[27902]: pgmap v20268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:24 smithi191 ceph-mon[31636]: pgmap v20268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:24 smithi170 ceph-mon[31212]: pgmap v20268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37835.851892 secs 2024-04-21T20:55:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37835.851892 secs 2024-04-21T20:55:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37835.851892 secs 2024-04-21T20:55:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:26 smithi077 ceph-mon[27902]: pgmap v20269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:26 smithi191 ceph-mon[31636]: pgmap v20269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:26 smithi170 ceph-mon[31212]: pgmap v20269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:28 smithi077 ceph-mon[27902]: pgmap v20270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37839.096830 secs 2024-04-21T20:55:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:28 smithi191 ceph-mon[31636]: pgmap v20270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37839.096830 secs 2024-04-21T20:55:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:28 smithi170 ceph-mon[31212]: pgmap v20270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37839.096830 secs 2024-04-21T20:55:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:30.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37840.852035 secs 2024-04-21T20:55:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37840.852035 secs 2024-04-21T20:55:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37840.852035 secs 2024-04-21T20:55:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:30 smithi077 ceph-mon[27902]: pgmap v20271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:30 smithi191 ceph-mon[31636]: pgmap v20271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:30 smithi170 ceph-mon[31212]: pgmap v20271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:32 smithi077 ceph-mon[27902]: pgmap v20272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:32 smithi191 ceph-mon[31636]: pgmap v20272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:32 smithi170 ceph-mon[31212]: pgmap v20272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:34.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37844.096906 secs 2024-04-21T20:55:34.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37844.096906 secs 2024-04-21T20:55:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37844.096906 secs 2024-04-21T20:55:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:34 smithi077 ceph-mon[27902]: pgmap v20273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37845.852173 secs 2024-04-21T20:55:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:34 smithi191 ceph-mon[31636]: pgmap v20273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37845.852173 secs 2024-04-21T20:55:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:34 smithi170 ceph-mon[31212]: pgmap v20273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37845.852173 secs 2024-04-21T20:55:37.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:36 smithi077 ceph-mon[27902]: pgmap v20274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:36 smithi191 ceph-mon[31636]: pgmap v20274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:36 smithi170 ceph-mon[31212]: pgmap v20274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:38 smithi077 ceph-mon[27902]: pgmap v20275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37849.096988 secs 2024-04-21T20:55:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:38 smithi191 ceph-mon[31636]: pgmap v20275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37849.096988 secs 2024-04-21T20:55:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:38 smithi170 ceph-mon[31212]: pgmap v20275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37849.096988 secs 2024-04-21T20:55:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:40.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37850.852293 secs 2024-04-21T20:55:40.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37850.852293 secs 2024-04-21T20:55:40.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37850.852293 secs 2024-04-21T20:55:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:40 smithi077 ceph-mon[27902]: pgmap v20276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:40 smithi191 ceph-mon[31636]: pgmap v20276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:40 smithi170 ceph-mon[31212]: pgmap v20276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:42.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:41 smithi077 ceph-mon[27902]: pgmap v20277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:42.210 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:41 smithi170 ceph-mon[31212]: pgmap v20277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:42.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:41 smithi191 ceph-mon[31636]: pgmap v20277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37854.097097 secs 2024-04-21T20:55:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37854.097097 secs 2024-04-21T20:55:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37854.097097 secs 2024-04-21T20:55:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:44 smithi191 ceph-mon[31636]: pgmap v20278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:44 smithi170 ceph-mon[31212]: pgmap v20278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:44 smithi077 ceph-mon[27902]: pgmap v20278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37855.852412 secs 2024-04-21T20:55:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37855.852412 secs 2024-04-21T20:55:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37855.852412 secs 2024-04-21T20:55:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:46 smithi191 ceph-mon[31636]: pgmap v20279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:46 smithi170 ceph-mon[31212]: pgmap v20279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:46 smithi077 ceph-mon[27902]: pgmap v20279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:48 smithi191 ceph-mon[31636]: pgmap v20280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:48.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37859.097160 secs 2024-04-21T20:55:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:48 smithi170 ceph-mon[31212]: pgmap v20280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37859.097160 secs 2024-04-21T20:55:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:48 smithi077 ceph-mon[27902]: pgmap v20280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37859.097160 secs 2024-04-21T20:55:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:50.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37860.852528 secs 2024-04-21T20:55:50.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:50 smithi191 ceph-mon[31636]: pgmap v20281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37860.852528 secs 2024-04-21T20:55:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:50 smithi170 ceph-mon[31212]: pgmap v20281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37860.852528 secs 2024-04-21T20:55:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:50 smithi077 ceph-mon[27902]: pgmap v20281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:52.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:52 smithi191 ceph-mon[31636]: pgmap v20282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:52 smithi170 ceph-mon[31212]: pgmap v20282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:52 smithi077 ceph-mon[27902]: pgmap v20282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:53.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37864.097286 secs 2024-04-21T20:55:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37864.097286 secs 2024-04-21T20:55:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37864.097286 secs 2024-04-21T20:55:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:54 smithi191 ceph-mon[31636]: pgmap v20283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:54 smithi170 ceph-mon[31212]: pgmap v20283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:54 smithi077 ceph-mon[27902]: pgmap v20283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:55:55.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37865.852622 secs 2024-04-21T20:55:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37865.852622 secs 2024-04-21T20:55:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37865.852622 secs 2024-04-21T20:55:56.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:56 smithi191 ceph-mon[31636]: pgmap v20284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:56.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:56 smithi170 ceph-mon[31212]: pgmap v20284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:56 smithi077 ceph-mon[27902]: pgmap v20284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:55:58.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:58 smithi191 ceph-mon[31636]: pgmap v20285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:58.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:55:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37869.097363 secs 2024-04-21T20:55:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:58 smithi170 ceph-mon[31212]: pgmap v20285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:55:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37869.097363 secs 2024-04-21T20:55:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:58 smithi077 ceph-mon[27902]: pgmap v20285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:55:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:55:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37869.097363 secs 2024-04-21T20:55:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:55:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:55:59.590+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:56:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:00.439 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37870.852737 secs 2024-04-21T20:56:00.439 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:00 smithi077 ceph-mon[27902]: pgmap v20286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:00.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37870.852737 secs 2024-04-21T20:56:00.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:00 smithi191 ceph-mon[31636]: pgmap v20286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37870.852737 secs 2024-04-21T20:56:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:00 smithi170 ceph-mon[31212]: pgmap v20286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:02.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:02 smithi191 ceph-mon[31636]: pgmap v20287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:02 smithi170 ceph-mon[31212]: pgmap v20287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:02 smithi077 ceph-mon[27902]: pgmap v20287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:03.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37874.097429 secs 2024-04-21T20:56:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37874.097429 secs 2024-04-21T20:56:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37874.097429 secs 2024-04-21T20:56:04.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:04 smithi191 ceph-mon[31636]: pgmap v20288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:04 smithi170 ceph-mon[31212]: pgmap v20288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:04 smithi077 ceph-mon[27902]: pgmap v20288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37875.852850 secs 2024-04-21T20:56:05.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:05 smithi191 ceph-mon[31636]: osdmap e1340: 12 total, 12 up, 12 in 2024-04-21T20:56:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37875.852850 secs 2024-04-21T20:56:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:05 smithi170 ceph-mon[31212]: osdmap e1340: 12 total, 12 up, 12 in 2024-04-21T20:56:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37875.852850 secs 2024-04-21T20:56:05.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:05 smithi077 ceph-mon[27902]: osdmap e1340: 12 total, 12 up, 12 in 2024-04-21T20:56:06.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:06 smithi191 ceph-mon[31636]: pgmap v20290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:56:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:06 smithi170 ceph-mon[31212]: pgmap v20290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:56:06.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:06 smithi077 ceph-mon[27902]: pgmap v20290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:56:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:08 smithi191 ceph-mon[31636]: pgmap v20291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:56:08.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37879.097569 secs 2024-04-21T20:56:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:08 smithi170 ceph-mon[31212]: pgmap v20291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:56:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37879.097569 secs 2024-04-21T20:56:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:08 smithi077 ceph-mon[27902]: pgmap v20291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:56:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37879.097569 secs 2024-04-21T20:56:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37880.852944 secs 2024-04-21T20:56:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:10 smithi191 ceph-mon[31636]: pgmap v20292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:56:10.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:10 smithi191 ceph-mon[31636]: osdmap e1341: 12 total, 12 up, 12 in 2024-04-21T20:56:10.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37880.852944 secs 2024-04-21T20:56:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:10 smithi170 ceph-mon[31212]: pgmap v20292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:56:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:10 smithi170 ceph-mon[31212]: osdmap e1341: 12 total, 12 up, 12 in 2024-04-21T20:56:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37880.852944 secs 2024-04-21T20:56:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:10 smithi077 ceph-mon[27902]: pgmap v20292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:56:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:10 smithi077 ceph-mon[27902]: osdmap e1341: 12 total, 12 up, 12 in 2024-04-21T20:56:11.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:56:11.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:11.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:11.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:56:11.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:11.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:11.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:56:11.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:11.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:12 smithi191 ceph-mon[31636]: pgmap v20294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:56:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:56:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:56:12.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:12 smithi170 ceph-mon[31212]: pgmap v20294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:56:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:56:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:56:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:12 smithi077 ceph-mon[27902]: pgmap v20294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:56:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:56:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:56:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:56:13.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37884.097712 secs 2024-04-21T20:56:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37884.097712 secs 2024-04-21T20:56:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37884.097712 secs 2024-04-21T20:56:14.563 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:14 smithi170 ceph-mon[31212]: pgmap v20295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:56:14.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:14 smithi191 ceph-mon[31636]: pgmap v20295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:56:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:14 smithi077 ceph-mon[27902]: pgmap v20295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T20:56:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37885.853061 secs 2024-04-21T20:56:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37885.853061 secs 2024-04-21T20:56:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37885.853061 secs 2024-04-21T20:56:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:16 smithi170 ceph-mon[31212]: pgmap v20296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:56:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:16 smithi077 ceph-mon[27902]: pgmap v20296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:56:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:16 smithi191 ceph-mon[31636]: pgmap v20296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:56:18.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:18 smithi170 ceph-mon[31212]: pgmap v20297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:56:18.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37889.097864 secs 2024-04-21T20:56:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:18 smithi077 ceph-mon[27902]: pgmap v20297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:56:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37889.097864 secs 2024-04-21T20:56:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:18 smithi191 ceph-mon[31636]: pgmap v20297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:56:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37889.097864 secs 2024-04-21T20:56:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37890.853153 secs 2024-04-21T20:56:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:20 smithi170 ceph-mon[31212]: pgmap v20298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:56:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37890.853153 secs 2024-04-21T20:56:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:20 smithi077 ceph-mon[27902]: pgmap v20298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:56:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37890.853153 secs 2024-04-21T20:56:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:20 smithi191 ceph-mon[31636]: pgmap v20298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:56:22.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:22 smithi170 ceph-mon[31212]: pgmap v20299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:56:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:22 smithi077 ceph-mon[27902]: pgmap v20299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:56:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:22 smithi191 ceph-mon[31636]: pgmap v20299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 B/s wr, 8 op/s 2024-04-21T20:56:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37894.097967 secs 2024-04-21T20:56:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37894.097967 secs 2024-04-21T20:56:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37894.097967 secs 2024-04-21T20:56:24.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:24 smithi170 ceph-mon[31212]: pgmap v20300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:24 smithi077 ceph-mon[27902]: pgmap v20300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:24 smithi191 ceph-mon[31636]: pgmap v20300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37895.853229 secs 2024-04-21T20:56:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37895.853229 secs 2024-04-21T20:56:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37895.853229 secs 2024-04-21T20:56:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:26 smithi170 ceph-mon[31212]: pgmap v20301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:26 smithi077 ceph-mon[27902]: pgmap v20301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:26 smithi191 ceph-mon[31636]: pgmap v20301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:28 smithi170 ceph-mon[31212]: pgmap v20302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:28.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37899.098083 secs 2024-04-21T20:56:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:28 smithi077 ceph-mon[27902]: pgmap v20302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37899.098083 secs 2024-04-21T20:56:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:28 smithi191 ceph-mon[31636]: pgmap v20302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37899.098083 secs 2024-04-21T20:56:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37900.853344 secs 2024-04-21T20:56:30.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:30 smithi170 ceph-mon[31212]: pgmap v20303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37900.853344 secs 2024-04-21T20:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:30 smithi077 ceph-mon[27902]: pgmap v20303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37900.853344 secs 2024-04-21T20:56:30.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:30 smithi191 ceph-mon[31636]: pgmap v20303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:32.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:32 smithi170 ceph-mon[31212]: pgmap v20304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:32 smithi077 ceph-mon[27902]: pgmap v20304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:32 smithi191 ceph-mon[31636]: pgmap v20304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37904.098189 secs 2024-04-21T20:56:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37904.098189 secs 2024-04-21T20:56:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37904.098189 secs 2024-04-21T20:56:34.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:34 smithi170 ceph-mon[31212]: pgmap v20305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:34 smithi077 ceph-mon[27902]: pgmap v20305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:34 smithi191 ceph-mon[31636]: pgmap v20305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37905.853482 secs 2024-04-21T20:56:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37905.853482 secs 2024-04-21T20:56:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37905.853482 secs 2024-04-21T20:56:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:36 smithi170 ceph-mon[31212]: pgmap v20306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:36 smithi077 ceph-mon[27902]: pgmap v20306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:36 smithi191 ceph-mon[31636]: pgmap v20306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:38 smithi170 ceph-mon[31212]: pgmap v20307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37909.098255 secs 2024-04-21T20:56:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:38 smithi077 ceph-mon[27902]: pgmap v20307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37909.098255 secs 2024-04-21T20:56:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:38 smithi191 ceph-mon[31636]: pgmap v20307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37909.098255 secs 2024-04-21T20:56:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37910.853598 secs 2024-04-21T20:56:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:40 smithi170 ceph-mon[31212]: pgmap v20308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37910.853598 secs 2024-04-21T20:56:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:40 smithi077 ceph-mon[27902]: pgmap v20308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37910.853598 secs 2024-04-21T20:56:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:40 smithi191 ceph-mon[31636]: pgmap v20308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:42 smithi170 ceph-mon[31212]: pgmap v20309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:42 smithi077 ceph-mon[27902]: pgmap v20309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:42 smithi191 ceph-mon[31636]: pgmap v20309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37914.098374 secs 2024-04-21T20:56:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37914.098374 secs 2024-04-21T20:56:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37914.098374 secs 2024-04-21T20:56:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:44 smithi170 ceph-mon[31212]: pgmap v20310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:44.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:44 smithi191 ceph-mon[31636]: pgmap v20310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:44 smithi077 ceph-mon[27902]: pgmap v20310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37915.853733 secs 2024-04-21T20:56:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37915.853733 secs 2024-04-21T20:56:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37915.853733 secs 2024-04-21T20:56:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:46 smithi170 ceph-mon[31212]: pgmap v20311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:46 smithi077 ceph-mon[27902]: pgmap v20311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:46 smithi191 ceph-mon[31636]: pgmap v20311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:48 smithi077 ceph-mon[27902]: pgmap v20312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37919.098495 secs 2024-04-21T20:56:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:48 smithi191 ceph-mon[31636]: pgmap v20312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37919.098495 secs 2024-04-21T20:56:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:48 smithi170 ceph-mon[31212]: pgmap v20312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37919.098495 secs 2024-04-21T20:56:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37920.853885 secs 2024-04-21T20:56:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:50 smithi077 ceph-mon[27902]: pgmap v20313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37920.853885 secs 2024-04-21T20:56:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:50 smithi191 ceph-mon[31636]: pgmap v20313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37920.853885 secs 2024-04-21T20:56:50.811 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:50 smithi170 ceph-mon[31212]: pgmap v20313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:52 smithi077 ceph-mon[27902]: pgmap v20314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:52 smithi191 ceph-mon[31636]: pgmap v20314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:52 smithi170 ceph-mon[31212]: pgmap v20314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37924.098621 secs 2024-04-21T20:56:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37924.098621 secs 2024-04-21T20:56:53.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37924.098621 secs 2024-04-21T20:56:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:54 smithi077 ceph-mon[27902]: pgmap v20315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:54 smithi191 ceph-mon[31636]: pgmap v20315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:54 smithi170 ceph-mon[31212]: pgmap v20315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:56:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37925.853996 secs 2024-04-21T20:56:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37925.853996 secs 2024-04-21T20:56:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37925.853996 secs 2024-04-21T20:56:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:56 smithi077 ceph-mon[27902]: pgmap v20316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:56 smithi191 ceph-mon[31636]: pgmap v20316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:56 smithi170 ceph-mon[31212]: pgmap v20316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:56:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:58 smithi077 ceph-mon[27902]: pgmap v20317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:56:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37929.098705 secs 2024-04-21T20:56:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:58 smithi191 ceph-mon[31636]: pgmap v20317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:56:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37929.098705 secs 2024-04-21T20:56:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:58 smithi170 ceph-mon[31212]: pgmap v20317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:56:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:56:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37929.098705 secs 2024-04-21T20:57:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37930.854111 secs 2024-04-21T20:57:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:00 smithi077 ceph-mon[27902]: pgmap v20318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37930.854111 secs 2024-04-21T20:57:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:00 smithi191 ceph-mon[31636]: pgmap v20318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37930.854111 secs 2024-04-21T20:57:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:00 smithi170 ceph-mon[31212]: pgmap v20318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:02 smithi077 ceph-mon[27902]: pgmap v20319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T20:57:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:02 smithi191 ceph-mon[31636]: pgmap v20319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T20:57:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:02 smithi170 ceph-mon[31212]: pgmap v20319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T20:57:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37934.098820 secs 2024-04-21T20:57:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37934.098820 secs 2024-04-21T20:57:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37934.098820 secs 2024-04-21T20:57:04.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:04 smithi077 ceph-mon[27902]: pgmap v20320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:57:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:04 smithi191 ceph-mon[31636]: pgmap v20320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:57:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:04 smithi170 ceph-mon[31212]: pgmap v20320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T20:57:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37935.854220 secs 2024-04-21T20:57:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:05 smithi077 ceph-mon[27902]: osdmap e1342: 12 total, 12 up, 12 in 2024-04-21T20:57:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37935.854220 secs 2024-04-21T20:57:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:05 smithi191 ceph-mon[31636]: osdmap e1342: 12 total, 12 up, 12 in 2024-04-21T20:57:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37935.854220 secs 2024-04-21T20:57:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:05 smithi170 ceph-mon[31212]: osdmap e1342: 12 total, 12 up, 12 in 2024-04-21T20:57:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:06 smithi077 ceph-mon[27902]: pgmap v20322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T20:57:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:06 smithi191 ceph-mon[31636]: pgmap v20322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T20:57:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:06 smithi170 ceph-mon[31212]: pgmap v20322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-04-21T20:57:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:08 smithi077 ceph-mon[27902]: pgmap v20323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:57:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37939.098880 secs 2024-04-21T20:57:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:08 smithi191 ceph-mon[31636]: pgmap v20323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:57:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37939.098880 secs 2024-04-21T20:57:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:08 smithi170 ceph-mon[31212]: pgmap v20323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:57:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37939.098880 secs 2024-04-21T20:57:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37940.854332 secs 2024-04-21T20:57:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:10 smithi077 ceph-mon[27902]: pgmap v20324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:57:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:10 smithi077 ceph-mon[27902]: osdmap e1343: 12 total, 12 up, 12 in 2024-04-21T20:57:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37940.854332 secs 2024-04-21T20:57:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:10 smithi191 ceph-mon[31636]: pgmap v20324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:57:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:10 smithi191 ceph-mon[31636]: osdmap e1343: 12 total, 12 up, 12 in 2024-04-21T20:57:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37940.854332 secs 2024-04-21T20:57:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:10 smithi170 ceph-mon[31212]: pgmap v20324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:57:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:10 smithi170 ceph-mon[31212]: osdmap e1343: 12 total, 12 up, 12 in 2024-04-21T20:57:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:12 smithi077 ceph-mon[27902]: pgmap v20326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-04-21T20:57:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:57:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:12 smithi191 ceph-mon[31636]: pgmap v20326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-04-21T20:57:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:57:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:12 smithi170 ceph-mon[31212]: pgmap v20326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-04-21T20:57:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:57:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37944.098973 secs 2024-04-21T20:57:13.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:57:13.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:57:13.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37944.098973 secs 2024-04-21T20:57:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:57:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:57:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37944.098973 secs 2024-04-21T20:57:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:57:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:57:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:57:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:14 smithi077 ceph-mon[27902]: pgmap v20327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 KiB/s wr, 24 op/s 2024-04-21T20:57:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:14 smithi191 ceph-mon[31636]: pgmap v20327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 KiB/s wr, 24 op/s 2024-04-21T20:57:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:14 smithi170 ceph-mon[31212]: pgmap v20327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 KiB/s wr, 24 op/s 2024-04-21T20:57:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37945.854451 secs 2024-04-21T20:57:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37945.854451 secs 2024-04-21T20:57:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37945.854451 secs 2024-04-21T20:57:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:16 smithi077 ceph-mon[27902]: pgmap v20328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:57:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:16 smithi191 ceph-mon[31636]: pgmap v20328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:57:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:16 smithi170 ceph-mon[31212]: pgmap v20328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T20:57:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:18 smithi077 ceph-mon[27902]: pgmap v20329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:57:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37949.099040 secs 2024-04-21T20:57:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:18 smithi191 ceph-mon[31636]: pgmap v20329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:57:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37949.099040 secs 2024-04-21T20:57:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:18 smithi170 ceph-mon[31212]: pgmap v20329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:57:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37949.099040 secs 2024-04-21T20:57:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37950.854565 secs 2024-04-21T20:57:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:20 smithi191 ceph-mon[31636]: pgmap v20330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:57:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37950.854565 secs 2024-04-21T20:57:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:20 smithi170 ceph-mon[31212]: pgmap v20330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:57:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37950.854565 secs 2024-04-21T20:57:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:20 smithi077 ceph-mon[27902]: pgmap v20330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:57:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:22 smithi191 ceph-mon[31636]: pgmap v20331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:57:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:22 smithi170 ceph-mon[31212]: pgmap v20331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:57:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:22 smithi077 ceph-mon[27902]: pgmap v20331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:57:23.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37954.099161 secs 2024-04-21T20:57:23.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37954.099161 secs 2024-04-21T20:57:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37954.099161 secs 2024-04-21T20:57:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:24 smithi191 ceph-mon[31636]: pgmap v20332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:24 smithi170 ceph-mon[31212]: pgmap v20332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:24 smithi077 ceph-mon[27902]: pgmap v20332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37955.854662 secs 2024-04-21T20:57:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37955.854662 secs 2024-04-21T20:57:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37955.854662 secs 2024-04-21T20:57:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:26 smithi191 ceph-mon[31636]: pgmap v20333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:26 smithi170 ceph-mon[31212]: pgmap v20333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:26 smithi077 ceph-mon[27902]: pgmap v20333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:28 smithi191 ceph-mon[31636]: pgmap v20334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37959.099277 secs 2024-04-21T20:57:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:28 smithi170 ceph-mon[31212]: pgmap v20334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37959.099277 secs 2024-04-21T20:57:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:28 smithi077 ceph-mon[27902]: pgmap v20334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37959.099277 secs 2024-04-21T20:57:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:30.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37960.854797 secs 2024-04-21T20:57:30.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:30 smithi077 ceph-mon[27902]: pgmap v20335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37960.854797 secs 2024-04-21T20:57:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:30 smithi191 ceph-mon[31636]: pgmap v20335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37960.854797 secs 2024-04-21T20:57:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:30 smithi170 ceph-mon[31212]: pgmap v20335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:32 smithi191 ceph-mon[31636]: pgmap v20336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:32 smithi170 ceph-mon[31212]: pgmap v20336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:32 smithi077 ceph-mon[27902]: pgmap v20336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37964.099395 secs 2024-04-21T20:57:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37964.099395 secs 2024-04-21T20:57:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37964.099395 secs 2024-04-21T20:57:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:34 smithi191 ceph-mon[31636]: pgmap v20337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:34 smithi170 ceph-mon[31212]: pgmap v20337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:34 smithi077 ceph-mon[27902]: pgmap v20337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37965.854897 secs 2024-04-21T20:57:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37965.854897 secs 2024-04-21T20:57:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37965.854897 secs 2024-04-21T20:57:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:36 smithi191 ceph-mon[31636]: pgmap v20338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:36 smithi170 ceph-mon[31212]: pgmap v20338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:36 smithi077 ceph-mon[27902]: pgmap v20338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:38 smithi191 ceph-mon[31636]: pgmap v20339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37969.099495 secs 2024-04-21T20:57:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:38 smithi170 ceph-mon[31212]: pgmap v20339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:38.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37969.099495 secs 2024-04-21T20:57:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:38 smithi077 ceph-mon[27902]: pgmap v20339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37969.099495 secs 2024-04-21T20:57:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37970.855007 secs 2024-04-21T20:57:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:40 smithi191 ceph-mon[31636]: pgmap v20340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37970.855007 secs 2024-04-21T20:57:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:40 smithi170 ceph-mon[31212]: pgmap v20340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37970.855007 secs 2024-04-21T20:57:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:40 smithi077 ceph-mon[27902]: pgmap v20340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:42 smithi191 ceph-mon[31636]: pgmap v20341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:42 smithi170 ceph-mon[31212]: pgmap v20341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:42 smithi077 ceph-mon[27902]: pgmap v20341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37974.099590 secs 2024-04-21T20:57:43.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37974.099590 secs 2024-04-21T20:57:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37974.099590 secs 2024-04-21T20:57:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:44 smithi191 ceph-mon[31636]: pgmap v20342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:44 smithi170 ceph-mon[31212]: pgmap v20342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:44 smithi077 ceph-mon[27902]: pgmap v20342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37975.855123 secs 2024-04-21T20:57:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37975.855123 secs 2024-04-21T20:57:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37975.855123 secs 2024-04-21T20:57:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:46 smithi191 ceph-mon[31636]: pgmap v20343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:46.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:46 smithi170 ceph-mon[31212]: pgmap v20343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:46 smithi077 ceph-mon[27902]: pgmap v20343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:48 smithi191 ceph-mon[31636]: pgmap v20344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37979.099716 secs 2024-04-21T20:57:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:48 smithi170 ceph-mon[31212]: pgmap v20344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37979.099716 secs 2024-04-21T20:57:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:48 smithi077 ceph-mon[27902]: pgmap v20344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37979.099716 secs 2024-04-21T20:57:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37980.855228 secs 2024-04-21T20:57:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:50 smithi191 ceph-mon[31636]: pgmap v20345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37980.855228 secs 2024-04-21T20:57:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:50 smithi170 ceph-mon[31212]: pgmap v20345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37980.855228 secs 2024-04-21T20:57:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:50 smithi077 ceph-mon[27902]: pgmap v20345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:52 smithi191 ceph-mon[31636]: pgmap v20346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:52 smithi170 ceph-mon[31212]: pgmap v20346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:52 smithi077 ceph-mon[27902]: pgmap v20346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37984.099878 secs 2024-04-21T20:57:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37984.099878 secs 2024-04-21T20:57:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37984.099878 secs 2024-04-21T20:57:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:54 smithi170 ceph-mon[31212]: pgmap v20347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:54 smithi077 ceph-mon[27902]: pgmap v20347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:54 smithi191 ceph-mon[31636]: pgmap v20347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:57:55.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37985.855306 secs 2024-04-21T20:57:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37985.855306 secs 2024-04-21T20:57:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37985.855306 secs 2024-04-21T20:57:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:56 smithi170 ceph-mon[31212]: pgmap v20348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:56 smithi077 ceph-mon[27902]: pgmap v20348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:56 smithi191 ceph-mon[31636]: pgmap v20348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:57:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:58 smithi170 ceph-mon[31212]: pgmap v20349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:57:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37989.099944 secs 2024-04-21T20:57:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:58 smithi077 ceph-mon[27902]: pgmap v20349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:57:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37989.099944 secs 2024-04-21T20:57:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:58 smithi191 ceph-mon[31636]: pgmap v20349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:57:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:57:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37989.099944 secs 2024-04-21T20:58:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37990.855427 secs 2024-04-21T20:58:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:00 smithi170 ceph-mon[31212]: pgmap v20350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37990.855427 secs 2024-04-21T20:58:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:00 smithi077 ceph-mon[27902]: pgmap v20350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37990.855427 secs 2024-04-21T20:58:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:00 smithi191 ceph-mon[31636]: pgmap v20350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:02 smithi170 ceph-mon[31212]: pgmap v20351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:02 smithi077 ceph-mon[27902]: pgmap v20351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:02 smithi191 ceph-mon[31636]: pgmap v20351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37994.100065 secs 2024-04-21T20:58:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37994.100065 secs 2024-04-21T20:58:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37994.100065 secs 2024-04-21T20:58:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:04 smithi170 ceph-mon[31212]: pgmap v20352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:04 smithi077 ceph-mon[27902]: pgmap v20352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:04 smithi191 ceph-mon[31636]: pgmap v20352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 37995.855543 secs 2024-04-21T20:58:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:05 smithi170 ceph-mon[31212]: osdmap e1344: 12 total, 12 up, 12 in 2024-04-21T20:58:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 37995.855543 secs 2024-04-21T20:58:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:05 smithi077 ceph-mon[27902]: osdmap e1344: 12 total, 12 up, 12 in 2024-04-21T20:58:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 37995.855543 secs 2024-04-21T20:58:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:05 smithi191 ceph-mon[31636]: osdmap e1344: 12 total, 12 up, 12 in 2024-04-21T20:58:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:06 smithi170 ceph-mon[31212]: pgmap v20354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:58:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:06 smithi077 ceph-mon[27902]: pgmap v20354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:58:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:06 smithi191 ceph-mon[31636]: pgmap v20354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:58:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:08 smithi170 ceph-mon[31212]: pgmap v20355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:58:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 37999.100225 secs 2024-04-21T20:58:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:08 smithi077 ceph-mon[27902]: pgmap v20355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:58:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 37999.100225 secs 2024-04-21T20:58:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:08 smithi191 ceph-mon[31636]: pgmap v20355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:58:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 37999.100225 secs 2024-04-21T20:58:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38000.855680 secs 2024-04-21T20:58:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:10 smithi170 ceph-mon[31212]: pgmap v20356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:58:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:10 smithi170 ceph-mon[31212]: osdmap e1345: 12 total, 12 up, 12 in 2024-04-21T20:58:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38000.855680 secs 2024-04-21T20:58:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:10 smithi077 ceph-mon[27902]: pgmap v20356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:58:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:10 smithi077 ceph-mon[27902]: osdmap e1345: 12 total, 12 up, 12 in 2024-04-21T20:58:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38000.855680 secs 2024-04-21T20:58:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:10 smithi191 ceph-mon[31636]: pgmap v20356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:58:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:10 smithi191 ceph-mon[31636]: osdmap e1345: 12 total, 12 up, 12 in 2024-04-21T20:58:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:12 smithi170 ceph-mon[31212]: pgmap v20358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:58:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:12 smithi077 ceph-mon[27902]: pgmap v20358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:58:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:12 smithi191 ceph-mon[31636]: pgmap v20358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:58:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38004.100311 secs 2024-04-21T20:58:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:58:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38004.100311 secs 2024-04-21T20:58:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:58:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38004.100311 secs 2024-04-21T20:58:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:58:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:14 smithi170 ceph-mon[31212]: pgmap v20359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T20:58:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:58:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:58:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:58:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:14 smithi191 ceph-mon[31636]: pgmap v20359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T20:58:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:58:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:58:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:58:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:14 smithi077 ceph-mon[27902]: pgmap v20359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T20:58:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:58:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:58:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:58:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38005.855799 secs 2024-04-21T20:58:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38005.855799 secs 2024-04-21T20:58:15.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38005.855799 secs 2024-04-21T20:58:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:16 smithi170 ceph-mon[31212]: pgmap v20360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:58:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:16 smithi077 ceph-mon[27902]: pgmap v20360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:58:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:16 smithi191 ceph-mon[31636]: pgmap v20360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:58:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:18 smithi170 ceph-mon[31212]: pgmap v20361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:58:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38009.100434 secs 2024-04-21T20:58:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:18 smithi077 ceph-mon[27902]: pgmap v20361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:58:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38009.100434 secs 2024-04-21T20:58:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:18 smithi191 ceph-mon[31636]: pgmap v20361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:58:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38009.100434 secs 2024-04-21T20:58:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38010.855955 secs 2024-04-21T20:58:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:20 smithi170 ceph-mon[31212]: pgmap v20362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:58:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38010.855955 secs 2024-04-21T20:58:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:20 smithi077 ceph-mon[27902]: pgmap v20362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:58:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38010.855955 secs 2024-04-21T20:58:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:20 smithi191 ceph-mon[31636]: pgmap v20362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:58:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:22 smithi170 ceph-mon[31212]: pgmap v20363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:58:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:22 smithi077 ceph-mon[27902]: pgmap v20363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:58:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:22 smithi191 ceph-mon[31636]: pgmap v20363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:58:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38014.100520 secs 2024-04-21T20:58:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38014.100520 secs 2024-04-21T20:58:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38014.100520 secs 2024-04-21T20:58:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:24 smithi170 ceph-mon[31212]: pgmap v20364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:24 smithi077 ceph-mon[27902]: pgmap v20364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:24 smithi191 ceph-mon[31636]: pgmap v20364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38015.856025 secs 2024-04-21T20:58:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38015.856025 secs 2024-04-21T20:58:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38015.856025 secs 2024-04-21T20:58:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:26 smithi077 ceph-mon[27902]: pgmap v20365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:26 smithi191 ceph-mon[31636]: pgmap v20365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:26 smithi170 ceph-mon[31212]: pgmap v20365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:28 smithi077 ceph-mon[27902]: pgmap v20366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38019.100666 secs 2024-04-21T20:58:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:28 smithi191 ceph-mon[31636]: pgmap v20366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38019.100666 secs 2024-04-21T20:58:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:28 smithi170 ceph-mon[31212]: pgmap v20366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38019.100666 secs 2024-04-21T20:58:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38020.856136 secs 2024-04-21T20:58:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:30 smithi077 ceph-mon[27902]: pgmap v20367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38020.856136 secs 2024-04-21T20:58:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:30 smithi191 ceph-mon[31636]: pgmap v20367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38020.856136 secs 2024-04-21T20:58:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:30 smithi170 ceph-mon[31212]: pgmap v20367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:32 smithi077 ceph-mon[27902]: pgmap v20368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:32 smithi191 ceph-mon[31636]: pgmap v20368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:32 smithi170 ceph-mon[31212]: pgmap v20368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38024.100805 secs 2024-04-21T20:58:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38024.100805 secs 2024-04-21T20:58:34.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38024.100805 secs 2024-04-21T20:58:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:34 smithi077 ceph-mon[27902]: pgmap v20369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:34 smithi191 ceph-mon[31636]: pgmap v20369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:34 smithi170 ceph-mon[31212]: pgmap v20369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38025.856238 secs 2024-04-21T20:58:35.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38025.856238 secs 2024-04-21T20:58:36.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38025.856238 secs 2024-04-21T20:58:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:36 smithi077 ceph-mon[27902]: pgmap v20370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:36.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:36 smithi191 ceph-mon[31636]: pgmap v20370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:36 smithi170 ceph-mon[31212]: pgmap v20370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:38 smithi077 ceph-mon[27902]: pgmap v20371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38029.101012 secs 2024-04-21T20:58:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:38 smithi191 ceph-mon[31636]: pgmap v20371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38029.101012 secs 2024-04-21T20:58:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:38 smithi170 ceph-mon[31212]: pgmap v20371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38029.101012 secs 2024-04-21T20:58:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38030.856354 secs 2024-04-21T20:58:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:40 smithi077 ceph-mon[27902]: pgmap v20372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38030.856354 secs 2024-04-21T20:58:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:40 smithi191 ceph-mon[31636]: pgmap v20372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38030.856354 secs 2024-04-21T20:58:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:40 smithi170 ceph-mon[31212]: pgmap v20372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:42.861 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:42 smithi170 ceph-mon[31212]: pgmap v20373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:42 smithi077 ceph-mon[27902]: pgmap v20373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:42 smithi191 ceph-mon[31636]: pgmap v20373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38034.101088 secs 2024-04-21T20:58:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38034.101088 secs 2024-04-21T20:58:44.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38034.101088 secs 2024-04-21T20:58:44.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:44 smithi191 ceph-mon[31636]: pgmap v20374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:44 smithi077 ceph-mon[27902]: pgmap v20374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:44 smithi170 ceph-mon[31212]: pgmap v20374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38035.856471 secs 2024-04-21T20:58:45.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38035.856471 secs 2024-04-21T20:58:46.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38035.856471 secs 2024-04-21T20:58:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:46 smithi077 ceph-mon[27902]: pgmap v20375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:46.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:46 smithi191 ceph-mon[31636]: pgmap v20375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:46 smithi170 ceph-mon[31212]: pgmap v20375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:48 smithi077 ceph-mon[27902]: pgmap v20376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38039.101206 secs 2024-04-21T20:58:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:48 smithi191 ceph-mon[31636]: pgmap v20376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38039.101206 secs 2024-04-21T20:58:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:48 smithi170 ceph-mon[31212]: pgmap v20376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38039.101206 secs 2024-04-21T20:58:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38040.856539 secs 2024-04-21T20:58:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:50 smithi077 ceph-mon[27902]: pgmap v20377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38040.856539 secs 2024-04-21T20:58:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:50 smithi191 ceph-mon[31636]: pgmap v20377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38040.856539 secs 2024-04-21T20:58:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:50 smithi170 ceph-mon[31212]: pgmap v20377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:52 smithi077 ceph-mon[27902]: pgmap v20378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:52 smithi191 ceph-mon[31636]: pgmap v20378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:52 smithi170 ceph-mon[31212]: pgmap v20378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38044.101326 secs 2024-04-21T20:58:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38044.101326 secs 2024-04-21T20:58:54.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38044.101326 secs 2024-04-21T20:58:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.464+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T20:58:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.464+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T20:58:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:58:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T20:58:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:58:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.465+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T20:58:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.465+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T20:58:54.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T20:58:54.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T20:58:54.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7005c000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T20:58:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7efd70010970 tx=0x7efd7005c000 comp rx=0 tx=0).stop 2024-04-21T20:58:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T20:58:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T20:58:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T20:58:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T20:58:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T20:58:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:54.550+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7003e040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T20:58:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:54 smithi077 ceph-mon[27902]: pgmap v20379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:54 smithi191 ceph-mon[31636]: pgmap v20379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:54 smithi170 ceph-mon[31212]: pgmap v20379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:58:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38045.856676 secs 2024-04-21T20:58:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38045.856676 secs 2024-04-21T20:58:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38045.856676 secs 2024-04-21T20:58:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:56 smithi077 ceph-mon[27902]: pgmap v20380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:56 smithi191 ceph-mon[31636]: pgmap v20380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:56 smithi170 ceph-mon[31212]: pgmap v20380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:58:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:58 smithi191 ceph-mon[31636]: pgmap v20381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38049.101445 secs 2024-04-21T20:58:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:58 smithi170 ceph-mon[31212]: pgmap v20381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38049.101445 secs 2024-04-21T20:58:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:58 smithi077 ceph-mon[27902]: pgmap v20381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:58:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38049.101445 secs 2024-04-21T20:58:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:59.615+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:58:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:59.615+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:58:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:59.615+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T20:58:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T20:58:59.615+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T20:59:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:00.939 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38050.856811 secs 2024-04-21T20:59:00.939 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:00 smithi077 ceph-mon[27902]: pgmap v20382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38050.856811 secs 2024-04-21T20:59:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:00 smithi191 ceph-mon[31636]: pgmap v20382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38050.856811 secs 2024-04-21T20:59:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:00 smithi170 ceph-mon[31212]: pgmap v20382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:02 smithi191 ceph-mon[31636]: pgmap v20383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:02 smithi170 ceph-mon[31212]: pgmap v20383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:02 smithi077 ceph-mon[27902]: pgmap v20383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38054.101591 secs 2024-04-21T20:59:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38054.101591 secs 2024-04-21T20:59:04.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38054.101591 secs 2024-04-21T20:59:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:04 smithi191 ceph-mon[31636]: pgmap v20384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:04 smithi170 ceph-mon[31212]: pgmap v20384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:04 smithi077 ceph-mon[27902]: pgmap v20384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38055.856946 secs 2024-04-21T20:59:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:05 smithi191 ceph-mon[31636]: osdmap e1346: 12 total, 12 up, 12 in 2024-04-21T20:59:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38055.856946 secs 2024-04-21T20:59:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:05 smithi170 ceph-mon[31212]: osdmap e1346: 12 total, 12 up, 12 in 2024-04-21T20:59:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38055.856946 secs 2024-04-21T20:59:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:05 smithi077 ceph-mon[27902]: osdmap e1346: 12 total, 12 up, 12 in 2024-04-21T20:59:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:06 smithi191 ceph-mon[31636]: pgmap v20386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:59:07.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:06 smithi170 ceph-mon[31212]: pgmap v20386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:59:07.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:06 smithi077 ceph-mon[27902]: pgmap v20386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T20:59:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:08 smithi191 ceph-mon[31636]: pgmap v20387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:59:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38059.101733 secs 2024-04-21T20:59:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:08 smithi170 ceph-mon[31212]: pgmap v20387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:59:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38059.101733 secs 2024-04-21T20:59:09.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:08 smithi077 ceph-mon[27902]: pgmap v20387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:59:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38059.101733 secs 2024-04-21T20:59:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38060.857070 secs 2024-04-21T20:59:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:10 smithi191 ceph-mon[31636]: pgmap v20388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:59:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:10 smithi191 ceph-mon[31636]: osdmap e1347: 12 total, 12 up, 12 in 2024-04-21T20:59:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38060.857070 secs 2024-04-21T20:59:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:10 smithi170 ceph-mon[31212]: pgmap v20388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:59:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:10 smithi170 ceph-mon[31212]: osdmap e1347: 12 total, 12 up, 12 in 2024-04-21T20:59:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38060.857070 secs 2024-04-21T20:59:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:10 smithi077 ceph-mon[27902]: pgmap v20388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T20:59:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:10 smithi077 ceph-mon[27902]: osdmap e1347: 12 total, 12 up, 12 in 2024-04-21T20:59:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:12 smithi191 ceph-mon[31636]: pgmap v20390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:59:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:12 smithi170 ceph-mon[31212]: pgmap v20390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:59:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:12 smithi077 ceph-mon[27902]: pgmap v20390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T20:59:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38064.101854 secs 2024-04-21T20:59:14.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38064.101854 secs 2024-04-21T20:59:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38064.101854 secs 2024-04-21T20:59:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:14 smithi191 ceph-mon[31636]: pgmap v20391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T20:59:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:59:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:59:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:59:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:59:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:14 smithi170 ceph-mon[31212]: pgmap v20391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T20:59:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:59:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:59:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:59:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:59:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:14 smithi077 ceph-mon[27902]: pgmap v20391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-04-21T20:59:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T20:59:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T20:59:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T20:59:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T20:59:15.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38065.857182 secs 2024-04-21T20:59:16.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38065.857182 secs 2024-04-21T20:59:16.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38065.857182 secs 2024-04-21T20:59:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:16 smithi191 ceph-mon[31636]: pgmap v20392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:59:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:16 smithi170 ceph-mon[31212]: pgmap v20392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:59:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:16 smithi077 ceph-mon[27902]: pgmap v20392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T20:59:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:18 smithi191 ceph-mon[31636]: pgmap v20393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:59:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38069.101926 secs 2024-04-21T20:59:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:18 smithi170 ceph-mon[31212]: pgmap v20393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:59:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38069.101926 secs 2024-04-21T20:59:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:18 smithi077 ceph-mon[27902]: pgmap v20393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:59:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38069.101926 secs 2024-04-21T20:59:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38070.857299 secs 2024-04-21T20:59:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:20 smithi191 ceph-mon[31636]: pgmap v20394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:59:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38070.857299 secs 2024-04-21T20:59:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:20 smithi170 ceph-mon[31212]: pgmap v20394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:59:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38070.857299 secs 2024-04-21T20:59:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:20 smithi077 ceph-mon[27902]: pgmap v20394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T20:59:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:22 smithi191 ceph-mon[31636]: pgmap v20395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:59:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:22 smithi170 ceph-mon[31212]: pgmap v20395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:59:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:22 smithi077 ceph-mon[27902]: pgmap v20395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T20:59:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38074.102004 secs 2024-04-21T20:59:24.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38074.102004 secs 2024-04-21T20:59:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38074.102004 secs 2024-04-21T20:59:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:24 smithi191 ceph-mon[31636]: pgmap v20396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:24 smithi170 ceph-mon[31212]: pgmap v20396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:24 smithi077 ceph-mon[27902]: pgmap v20396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:25.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38075.857379 secs 2024-04-21T20:59:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38075.857379 secs 2024-04-21T20:59:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38075.857379 secs 2024-04-21T20:59:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:26 smithi077 ceph-mon[27902]: pgmap v20397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:26 smithi191 ceph-mon[31636]: pgmap v20397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:26 smithi170 ceph-mon[31212]: pgmap v20397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:28 smithi191 ceph-mon[31636]: pgmap v20398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38079.102124 secs 2024-04-21T20:59:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:28 smithi170 ceph-mon[31212]: pgmap v20398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38079.102124 secs 2024-04-21T20:59:29.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:28 smithi077 ceph-mon[27902]: pgmap v20398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:29.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38079.102124 secs 2024-04-21T20:59:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38080.857514 secs 2024-04-21T20:59:30.288 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38080.857514 secs 2024-04-21T20:59:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38080.857514 secs 2024-04-21T20:59:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:30 smithi191 ceph-mon[31636]: pgmap v20399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:30 smithi170 ceph-mon[31212]: pgmap v20399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:31.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:30 smithi077 ceph-mon[27902]: pgmap v20399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:32.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:31 smithi191 ceph-mon[31636]: pgmap v20400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:32.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:31 smithi170 ceph-mon[31212]: pgmap v20400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:31 smithi077 ceph-mon[27902]: pgmap v20400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38084.102202 secs 2024-04-21T20:59:33.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38084.102202 secs 2024-04-21T20:59:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38084.102202 secs 2024-04-21T20:59:34.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:34 smithi191 ceph-mon[31636]: pgmap v20401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:34 smithi170 ceph-mon[31212]: pgmap v20401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:34 smithi077 ceph-mon[27902]: pgmap v20401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38085.857647 secs 2024-04-21T20:59:35.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38085.857647 secs 2024-04-21T20:59:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38085.857647 secs 2024-04-21T20:59:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:36 smithi191 ceph-mon[31636]: pgmap v20402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:36 smithi170 ceph-mon[31212]: pgmap v20402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:36 smithi077 ceph-mon[27902]: pgmap v20402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:38 smithi191 ceph-mon[31636]: pgmap v20403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:38.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38089.102319 secs 2024-04-21T20:59:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:38 smithi170 ceph-mon[31212]: pgmap v20403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38089.102319 secs 2024-04-21T20:59:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:38 smithi077 ceph-mon[27902]: pgmap v20403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38089.102319 secs 2024-04-21T20:59:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38090.857757 secs 2024-04-21T20:59:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:40 smithi191 ceph-mon[31636]: pgmap v20404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38090.857757 secs 2024-04-21T20:59:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:40 smithi170 ceph-mon[31212]: pgmap v20404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38090.857757 secs 2024-04-21T20:59:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:40 smithi077 ceph-mon[27902]: pgmap v20404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:42 smithi191 ceph-mon[31636]: pgmap v20405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:42.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:42 smithi170 ceph-mon[31212]: pgmap v20405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:42 smithi077 ceph-mon[27902]: pgmap v20405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38094.102456 secs 2024-04-21T20:59:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38094.102456 secs 2024-04-21T20:59:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38094.102456 secs 2024-04-21T20:59:44.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:44 smithi170 ceph-mon[31212]: pgmap v20406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:44.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:44 smithi191 ceph-mon[31636]: pgmap v20406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:44 smithi077 ceph-mon[27902]: pgmap v20406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38095.857882 secs 2024-04-21T20:59:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38095.857882 secs 2024-04-21T20:59:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38095.857882 secs 2024-04-21T20:59:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:46 smithi170 ceph-mon[31212]: pgmap v20407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:46 smithi077 ceph-mon[27902]: pgmap v20407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:46 smithi191 ceph-mon[31636]: pgmap v20407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:48 smithi170 ceph-mon[31212]: pgmap v20408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38099.102547 secs 2024-04-21T20:59:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:48 smithi077 ceph-mon[27902]: pgmap v20408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38099.102547 secs 2024-04-21T20:59:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:48 smithi191 ceph-mon[31636]: pgmap v20408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38099.102547 secs 2024-04-21T20:59:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38100.857993 secs 2024-04-21T20:59:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:50 smithi170 ceph-mon[31212]: pgmap v20409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38100.857993 secs 2024-04-21T20:59:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:50 smithi077 ceph-mon[27902]: pgmap v20409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38100.857993 secs 2024-04-21T20:59:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:50 smithi191 ceph-mon[31636]: pgmap v20409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:52.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:52 smithi170 ceph-mon[31212]: pgmap v20410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:52 smithi077 ceph-mon[27902]: pgmap v20410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:52 smithi191 ceph-mon[31636]: pgmap v20410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38104.102660 secs 2024-04-21T20:59:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38104.102660 secs 2024-04-21T20:59:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38104.102660 secs 2024-04-21T20:59:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:54 smithi170 ceph-mon[31212]: pgmap v20411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:54 smithi077 ceph-mon[27902]: pgmap v20411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:54 smithi191 ceph-mon[31636]: pgmap v20411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T20:59:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38105.858100 secs 2024-04-21T20:59:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38105.858100 secs 2024-04-21T20:59:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38105.858100 secs 2024-04-21T20:59:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:56 smithi170 ceph-mon[31212]: pgmap v20412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:56 smithi077 ceph-mon[27902]: pgmap v20412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:56 smithi191 ceph-mon[31636]: pgmap v20412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T20:59:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:58 smithi170 ceph-mon[31212]: pgmap v20413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 20:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38109.103138 secs 2024-04-21T20:59:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:58 smithi077 ceph-mon[27902]: pgmap v20413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 20:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38109.103138 secs 2024-04-21T20:59:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:58 smithi191 ceph-mon[31636]: pgmap v20413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T20:59:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 20:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38109.103138 secs 2024-04-21T21:00:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38110.858161 secs 2024-04-21T21:00:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:00 smithi170 ceph-mon[31212]: pgmap v20414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:00:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38110.858161 secs 2024-04-21T21:00:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:00 smithi077 ceph-mon[27902]: pgmap v20414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:00:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38110.858161 secs 2024-04-21T21:00:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:00 smithi191 ceph-mon[31636]: pgmap v20414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:00:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:02 smithi170 ceph-mon[31212]: pgmap v20415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:02 smithi077 ceph-mon[27902]: pgmap v20415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:02 smithi191 ceph-mon[31636]: pgmap v20415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38114.103252 secs 2024-04-21T21:00:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38114.103252 secs 2024-04-21T21:00:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38114.103252 secs 2024-04-21T21:00:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:04 smithi170 ceph-mon[31212]: pgmap v20416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:04 smithi077 ceph-mon[27902]: pgmap v20416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:04 smithi191 ceph-mon[31636]: pgmap v20416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38115.858283 secs 2024-04-21T21:00:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:05 smithi170 ceph-mon[31212]: osdmap e1348: 12 total, 12 up, 12 in 2024-04-21T21:00:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38115.858283 secs 2024-04-21T21:00:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:05 smithi077 ceph-mon[27902]: osdmap e1348: 12 total, 12 up, 12 in 2024-04-21T21:00:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38115.858283 secs 2024-04-21T21:00:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:05 smithi191 ceph-mon[31636]: osdmap e1348: 12 total, 12 up, 12 in 2024-04-21T21:00:06.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:06 smithi170 ceph-mon[31212]: pgmap v20418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:00:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:06 smithi077 ceph-mon[27902]: pgmap v20418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:00:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:06 smithi191 ceph-mon[31636]: pgmap v20418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:00:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:08 smithi170 ceph-mon[31212]: pgmap v20419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:00:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38119.103343 secs 2024-04-21T21:00:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:08 smithi077 ceph-mon[27902]: pgmap v20419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:00:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38119.103343 secs 2024-04-21T21:00:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:08 smithi191 ceph-mon[31636]: pgmap v20419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:00:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38119.103343 secs 2024-04-21T21:00:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38120.858440 secs 2024-04-21T21:00:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:10 smithi170 ceph-mon[31212]: pgmap v20420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:00:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:10 smithi170 ceph-mon[31212]: osdmap e1349: 12 total, 12 up, 12 in 2024-04-21T21:00:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38120.858440 secs 2024-04-21T21:00:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:10 smithi077 ceph-mon[27902]: pgmap v20420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:00:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:10 smithi077 ceph-mon[27902]: osdmap e1349: 12 total, 12 up, 12 in 2024-04-21T21:00:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38120.858440 secs 2024-04-21T21:00:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:10 smithi191 ceph-mon[31636]: pgmap v20420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:00:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:10 smithi191 ceph-mon[31636]: osdmap e1349: 12 total, 12 up, 12 in 2024-04-21T21:00:12.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:12 smithi170 ceph-mon[31212]: pgmap v20422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:00:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:12 smithi077 ceph-mon[27902]: pgmap v20422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:00:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:12 smithi191 ceph-mon[31636]: pgmap v20422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:00:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38124.103471 secs 2024-04-21T21:00:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38124.103471 secs 2024-04-21T21:00:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38124.103471 secs 2024-04-21T21:00:14.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:14 smithi170 ceph-mon[31212]: pgmap v20423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:00:14.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:14 smithi191 ceph-mon[31636]: pgmap v20423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:00:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:14 smithi077 ceph-mon[27902]: pgmap v20423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:00:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38125.858565 secs 2024-04-21T21:00:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:00:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:00:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:00:15.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:00:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38125.858565 secs 2024-04-21T21:00:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:00:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:00:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:00:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:00:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38125.858565 secs 2024-04-21T21:00:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:00:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:00:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:00:15.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:00:16.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:16 smithi170 ceph-mon[31212]: pgmap v20424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:00:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:16 smithi077 ceph-mon[27902]: pgmap v20424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:00:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:16 smithi191 ceph-mon[31636]: pgmap v20424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:00:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:18 smithi077 ceph-mon[27902]: pgmap v20425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:00:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38129.103605 secs 2024-04-21T21:00:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:18 smithi191 ceph-mon[31636]: pgmap v20425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:00:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38129.103605 secs 2024-04-21T21:00:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:18 smithi170 ceph-mon[31212]: pgmap v20425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:00:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38129.103605 secs 2024-04-21T21:00:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38130.858661 secs 2024-04-21T21:00:20.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:20 smithi077 ceph-mon[27902]: pgmap v20426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:00:20.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38130.858661 secs 2024-04-21T21:00:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:20 smithi191 ceph-mon[31636]: pgmap v20426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:00:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38130.858661 secs 2024-04-21T21:00:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:20 smithi170 ceph-mon[31212]: pgmap v20426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:00:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:22 smithi077 ceph-mon[27902]: pgmap v20427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 90 B/s wr, 7 op/s 2024-04-21T21:00:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:22 smithi191 ceph-mon[31636]: pgmap v20427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 90 B/s wr, 7 op/s 2024-04-21T21:00:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:22 smithi170 ceph-mon[31212]: pgmap v20427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 90 B/s wr, 7 op/s 2024-04-21T21:00:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38134.103720 secs 2024-04-21T21:00:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38134.103720 secs 2024-04-21T21:00:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38134.103720 secs 2024-04-21T21:00:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:24 smithi077 ceph-mon[27902]: pgmap v20428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:24 smithi191 ceph-mon[31636]: pgmap v20428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:24 smithi170 ceph-mon[31212]: pgmap v20428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38135.858754 secs 2024-04-21T21:00:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38135.858754 secs 2024-04-21T21:00:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38135.858754 secs 2024-04-21T21:00:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:26 smithi191 ceph-mon[31636]: pgmap v20429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:26 smithi170 ceph-mon[31212]: pgmap v20429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:26 smithi077 ceph-mon[27902]: pgmap v20429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:27 smithi191 ceph-mon[31636]: pgmap v20430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:27 smithi170 ceph-mon[31212]: pgmap v20430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:27 smithi077 ceph-mon[27902]: pgmap v20430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38139.103840 secs 2024-04-21T21:00:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38139.103840 secs 2024-04-21T21:00:29.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38139.103840 secs 2024-04-21T21:00:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38140.858890 secs 2024-04-21T21:00:30.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:29 smithi191 ceph-mon[31636]: pgmap v20431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:30.288 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38140.858890 secs 2024-04-21T21:00:30.288 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:29 smithi077 ceph-mon[27902]: pgmap v20431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:30.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38140.858890 secs 2024-04-21T21:00:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:29 smithi170 ceph-mon[31212]: pgmap v20431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:00:32.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:32 smithi191 ceph-mon[31636]: pgmap v20432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:32 smithi170 ceph-mon[31212]: pgmap v20432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:32.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:32 smithi077 ceph-mon[27902]: pgmap v20432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38144.103976 secs 2024-04-21T21:00:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38144.103976 secs 2024-04-21T21:00:33.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38144.103976 secs 2024-04-21T21:00:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:34 smithi170 ceph-mon[31212]: pgmap v20433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:34 smithi077 ceph-mon[27902]: pgmap v20433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:34 smithi191 ceph-mon[31636]: pgmap v20433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38145.859005 secs 2024-04-21T21:00:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38145.859005 secs 2024-04-21T21:00:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38145.859005 secs 2024-04-21T21:00:36.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:36 smithi170 ceph-mon[31212]: pgmap v20434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:36 smithi077 ceph-mon[27902]: pgmap v20434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:36.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:36 smithi191 ceph-mon[31636]: pgmap v20434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:38.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:38 smithi170 ceph-mon[31212]: pgmap v20435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:38.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38149.104045 secs 2024-04-21T21:00:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:38 smithi077 ceph-mon[27902]: pgmap v20435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38149.104045 secs 2024-04-21T21:00:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:38 smithi191 ceph-mon[31636]: pgmap v20435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38149.104045 secs 2024-04-21T21:00:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38150.859119 secs 2024-04-21T21:00:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:40 smithi170 ceph-mon[31212]: pgmap v20436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38150.859119 secs 2024-04-21T21:00:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:40 smithi077 ceph-mon[27902]: pgmap v20436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38150.859119 secs 2024-04-21T21:00:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:40 smithi191 ceph-mon[31636]: pgmap v20436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:42.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:42 smithi077 ceph-mon[27902]: pgmap v20437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:42 smithi170 ceph-mon[31212]: pgmap v20437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:42 smithi191 ceph-mon[31636]: pgmap v20437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38154.104192 secs 2024-04-21T21:00:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38154.104192 secs 2024-04-21T21:00:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38154.104192 secs 2024-04-21T21:00:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:44 smithi170 ceph-mon[31212]: pgmap v20438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:44.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:44 smithi191 ceph-mon[31636]: pgmap v20438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:44 smithi077 ceph-mon[27902]: pgmap v20438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:45.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38155.859239 secs 2024-04-21T21:00:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38155.859239 secs 2024-04-21T21:00:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38155.859239 secs 2024-04-21T21:00:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:46 smithi170 ceph-mon[31212]: pgmap v20439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:46 smithi077 ceph-mon[27902]: pgmap v20439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:46 smithi191 ceph-mon[31636]: pgmap v20439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:48 smithi170 ceph-mon[31212]: pgmap v20440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:48.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38159.104308 secs 2024-04-21T21:00:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:48 smithi077 ceph-mon[27902]: pgmap v20440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38159.104308 secs 2024-04-21T21:00:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:48 smithi191 ceph-mon[31636]: pgmap v20440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38159.104308 secs 2024-04-21T21:00:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38160.859318 secs 2024-04-21T21:00:50.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:50 smithi170 ceph-mon[31212]: pgmap v20441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38160.859318 secs 2024-04-21T21:00:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:50 smithi077 ceph-mon[27902]: pgmap v20441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38160.859318 secs 2024-04-21T21:00:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:50 smithi191 ceph-mon[31636]: pgmap v20441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:52 smithi170 ceph-mon[31212]: pgmap v20442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:52 smithi077 ceph-mon[27902]: pgmap v20442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:52 smithi191 ceph-mon[31636]: pgmap v20442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38164.104445 secs 2024-04-21T21:00:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38164.104445 secs 2024-04-21T21:00:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38164.104445 secs 2024-04-21T21:00:54.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:54 smithi170 ceph-mon[31212]: pgmap v20443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:54 smithi077 ceph-mon[27902]: pgmap v20443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:54 smithi191 ceph-mon[31636]: pgmap v20443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:00:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38165.859452 secs 2024-04-21T21:00:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38165.859452 secs 2024-04-21T21:00:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38165.859452 secs 2024-04-21T21:00:56.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:56 smithi170 ceph-mon[31212]: pgmap v20444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:56 smithi077 ceph-mon[27902]: pgmap v20444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:56 smithi191 ceph-mon[31636]: pgmap v20444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:00:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:58 smithi170 ceph-mon[31212]: pgmap v20445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38169.104506 secs 2024-04-21T21:00:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:58 smithi077 ceph-mon[27902]: pgmap v20445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38169.104506 secs 2024-04-21T21:00:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:58 smithi191 ceph-mon[31636]: pgmap v20445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:00:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38169.104506 secs 2024-04-21T21:01:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38170.859513 secs 2024-04-21T21:01:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:00 smithi170 ceph-mon[31212]: pgmap v20446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38170.859513 secs 2024-04-21T21:01:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:00 smithi077 ceph-mon[27902]: pgmap v20446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38170.859513 secs 2024-04-21T21:01:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:00 smithi191 ceph-mon[31636]: pgmap v20446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:02.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:02 smithi170 ceph-mon[31212]: pgmap v20447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:02 smithi077 ceph-mon[27902]: pgmap v20447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:02 smithi191 ceph-mon[31636]: pgmap v20447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38174.104622 secs 2024-04-21T21:01:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38174.104622 secs 2024-04-21T21:01:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38174.104622 secs 2024-04-21T21:01:04.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:04 smithi170 ceph-mon[31212]: pgmap v20448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:04 smithi077 ceph-mon[27902]: pgmap v20448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:04 smithi191 ceph-mon[31636]: pgmap v20448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38175.859593 secs 2024-04-21T21:01:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:05 smithi170 ceph-mon[31212]: osdmap e1350: 12 total, 12 up, 12 in 2024-04-21T21:01:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38175.859593 secs 2024-04-21T21:01:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:05 smithi077 ceph-mon[27902]: osdmap e1350: 12 total, 12 up, 12 in 2024-04-21T21:01:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38175.859593 secs 2024-04-21T21:01:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:05 smithi191 ceph-mon[31636]: osdmap e1350: 12 total, 12 up, 12 in 2024-04-21T21:01:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:06 smithi077 ceph-mon[27902]: pgmap v20450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:01:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:06 smithi191 ceph-mon[31636]: pgmap v20450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:01:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:06 smithi170 ceph-mon[31212]: pgmap v20450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:01:08.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:08 smithi077 ceph-mon[27902]: pgmap v20451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:01:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38179.104739 secs 2024-04-21T21:01:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:08 smithi191 ceph-mon[31636]: pgmap v20451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:01:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38179.104739 secs 2024-04-21T21:01:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:08 smithi170 ceph-mon[31212]: pgmap v20451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:01:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38179.104739 secs 2024-04-21T21:01:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38180.859727 secs 2024-04-21T21:01:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:10 smithi077 ceph-mon[27902]: pgmap v20452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:01:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:10 smithi077 ceph-mon[27902]: osdmap e1351: 12 total, 12 up, 12 in 2024-04-21T21:01:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38180.859727 secs 2024-04-21T21:01:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:10 smithi191 ceph-mon[31636]: pgmap v20452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:01:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:10 smithi191 ceph-mon[31636]: osdmap e1351: 12 total, 12 up, 12 in 2024-04-21T21:01:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38180.859727 secs 2024-04-21T21:01:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:10 smithi170 ceph-mon[31212]: pgmap v20452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:01:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:10 smithi170 ceph-mon[31212]: osdmap e1351: 12 total, 12 up, 12 in 2024-04-21T21:01:12.611 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:12 smithi170 ceph-mon[31212]: pgmap v20454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:01:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:12 smithi077 ceph-mon[27902]: pgmap v20454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:01:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:12 smithi191 ceph-mon[31636]: pgmap v20454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:01:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38184.104864 secs 2024-04-21T21:01:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38184.104864 secs 2024-04-21T21:01:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38184.104864 secs 2024-04-21T21:01:14.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:14 smithi191 ceph-mon[31636]: pgmap v20455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:01:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:14 smithi077 ceph-mon[27902]: pgmap v20455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:01:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:14 smithi170 ceph-mon[31212]: pgmap v20455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:01:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38185.859845 secs 2024-04-21T21:01:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38185.859845 secs 2024-04-21T21:01:15.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38185.859845 secs 2024-04-21T21:01:16.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:16 smithi077 ceph-mon[27902]: pgmap v20456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:01:16.630 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:01:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:16 smithi191 ceph-mon[31636]: pgmap v20456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:01:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:01:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:16 smithi170 ceph-mon[31212]: pgmap v20456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:01:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:01:18.468 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:18 smithi077 ceph-mon[27902]: pgmap v20457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:01:18.468 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38189.104991 secs 2024-04-21T21:01:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:18 smithi191 ceph-mon[31636]: pgmap v20457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:01:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38189.104991 secs 2024-04-21T21:01:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:18 smithi170 ceph-mon[31212]: pgmap v20457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:01:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38189.104991 secs 2024-04-21T21:01:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38190.859954 secs 2024-04-21T21:01:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: pgmap v20458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:01:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:01:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:01:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38190.859954 secs 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: pgmap v20458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:01:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38190.859954 secs 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: pgmap v20458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:01:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:01:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:22 smithi191 ceph-mon[31636]: pgmap v20459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:01:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:22 smithi170 ceph-mon[31212]: pgmap v20459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:01:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:22 smithi077 ceph-mon[27902]: pgmap v20459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:01:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38194.105075 secs 2024-04-21T21:01:24.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38194.105075 secs 2024-04-21T21:01:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38194.105075 secs 2024-04-21T21:01:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:24 smithi191 ceph-mon[31636]: pgmap v20460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:24 smithi170 ceph-mon[31212]: pgmap v20460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:24 smithi077 ceph-mon[27902]: pgmap v20460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38195.860020 secs 2024-04-21T21:01:26.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38195.860020 secs 2024-04-21T21:01:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38195.860020 secs 2024-04-21T21:01:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:26 smithi191 ceph-mon[31636]: pgmap v20461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:26 smithi170 ceph-mon[31212]: pgmap v20461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:26 smithi077 ceph-mon[27902]: pgmap v20461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:28 smithi191 ceph-mon[31636]: pgmap v20462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38199.105214 secs 2024-04-21T21:01:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:28 smithi170 ceph-mon[31212]: pgmap v20462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38199.105214 secs 2024-04-21T21:01:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:28 smithi077 ceph-mon[27902]: pgmap v20462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38199.105214 secs 2024-04-21T21:01:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38200.860150 secs 2024-04-21T21:01:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:30 smithi170 ceph-mon[31212]: pgmap v20463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:31.061 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38200.860150 secs 2024-04-21T21:01:31.061 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:30 smithi077 ceph-mon[27902]: pgmap v20463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38200.860150 secs 2024-04-21T21:01:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:30 smithi191 ceph-mon[31636]: pgmap v20463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:32 smithi170 ceph-mon[31212]: pgmap v20464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:32 smithi077 ceph-mon[27902]: pgmap v20464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:32 smithi191 ceph-mon[31636]: pgmap v20464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:34.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38204.105330 secs 2024-04-21T21:01:34.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38204.105330 secs 2024-04-21T21:01:34.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38204.105330 secs 2024-04-21T21:01:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:34 smithi170 ceph-mon[31212]: pgmap v20465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:34 smithi077 ceph-mon[27902]: pgmap v20465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:34 smithi191 ceph-mon[31636]: pgmap v20465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:36.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38205.860217 secs 2024-04-21T21:01:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38205.860217 secs 2024-04-21T21:01:36.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38205.860217 secs 2024-04-21T21:01:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:36 smithi170 ceph-mon[31212]: pgmap v20466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:37.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:36 smithi077 ceph-mon[27902]: pgmap v20466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:36 smithi191 ceph-mon[31636]: pgmap v20466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:38 smithi170 ceph-mon[31212]: pgmap v20467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38209.105439 secs 2024-04-21T21:01:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:38 smithi077 ceph-mon[27902]: pgmap v20467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38209.105439 secs 2024-04-21T21:01:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:38 smithi191 ceph-mon[31636]: pgmap v20467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38209.105439 secs 2024-04-21T21:01:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38210.860321 secs 2024-04-21T21:01:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:40 smithi170 ceph-mon[31212]: pgmap v20468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38210.860321 secs 2024-04-21T21:01:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:40 smithi077 ceph-mon[27902]: pgmap v20468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38210.860321 secs 2024-04-21T21:01:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:40 smithi191 ceph-mon[31636]: pgmap v20468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:42 smithi170 ceph-mon[31212]: pgmap v20469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:43.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:42 smithi077 ceph-mon[27902]: pgmap v20469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:43.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:42 smithi191 ceph-mon[31636]: pgmap v20469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:44.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38214.105509 secs 2024-04-21T21:01:44.121 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38214.105509 secs 2024-04-21T21:01:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38214.105509 secs 2024-04-21T21:01:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:44 smithi170 ceph-mon[31212]: pgmap v20470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:45.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:44 smithi077 ceph-mon[27902]: pgmap v20470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:44 smithi191 ceph-mon[31636]: pgmap v20470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:46.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38215.860465 secs 2024-04-21T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38215.860465 secs 2024-04-21T21:01:46.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38215.860465 secs 2024-04-21T21:01:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:46 smithi170 ceph-mon[31212]: pgmap v20471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:47.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:46 smithi077 ceph-mon[27902]: pgmap v20471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:47.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:46 smithi191 ceph-mon[31636]: pgmap v20471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:01:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:48 smithi170 ceph-mon[31212]: pgmap v20472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38219.105662 secs 2024-04-21T21:01:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:48 smithi077 ceph-mon[27902]: pgmap v20472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38219.105662 secs 2024-04-21T21:01:49.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:48 smithi191 ceph-mon[31636]: pgmap v20472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38219.105662 secs 2024-04-21T21:01:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38220.860578 secs 2024-04-21T21:01:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:50 smithi170 ceph-mon[31212]: pgmap v20473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38220.860578 secs 2024-04-21T21:01:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:50 smithi077 ceph-mon[27902]: pgmap v20473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38220.860578 secs 2024-04-21T21:01:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:50 smithi191 ceph-mon[31636]: pgmap v20473: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:52 smithi170 ceph-mon[31212]: pgmap v20474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:53.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:52 smithi077 ceph-mon[27902]: pgmap v20474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:52 smithi191 ceph-mon[31636]: pgmap v20474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38224.105803 secs 2024-04-21T21:01:54.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38224.105803 secs 2024-04-21T21:01:54.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38224.105803 secs 2024-04-21T21:01:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:54 smithi170 ceph-mon[31212]: pgmap v20475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:01:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:54 smithi077 ceph-mon[27902]: pgmap v20475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:54 smithi191 ceph-mon[31636]: pgmap v20475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38225.860700 secs 2024-04-21T21:01:56.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38225.860700 secs 2024-04-21T21:01:56.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38225.860700 secs 2024-04-21T21:01:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:56 smithi170 ceph-mon[31212]: pgmap v20476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:57.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:56 smithi077 ceph-mon[27902]: pgmap v20476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:56 smithi191 ceph-mon[31636]: pgmap v20476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:01:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:58 smithi170 ceph-mon[31212]: pgmap v20477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:01:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38229.105899 secs 2024-04-21T21:01:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:58 smithi077 ceph-mon[27902]: pgmap v20477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:01:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38229.105899 secs 2024-04-21T21:01:59.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:58 smithi191 ceph-mon[31636]: pgmap v20477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:01:59.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:01:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38229.105899 secs 2024-04-21T21:01:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:01:59.640+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:01:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:01:59.640+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:01:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:01:59.640+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:01:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:01:59.640+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:02:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38230.860835 secs 2024-04-21T21:02:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:00 smithi170 ceph-mon[31212]: pgmap v20478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38230.860835 secs 2024-04-21T21:02:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:00 smithi077 ceph-mon[27902]: pgmap v20478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38230.860835 secs 2024-04-21T21:02:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:00 smithi191 ceph-mon[31636]: pgmap v20478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:02 smithi170 ceph-mon[31212]: pgmap v20479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:02 smithi077 ceph-mon[27902]: pgmap v20479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:02 smithi191 ceph-mon[31636]: pgmap v20479: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38234.106021 secs 2024-04-21T21:02:04.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38234.106021 secs 2024-04-21T21:02:04.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38234.106021 secs 2024-04-21T21:02:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:04 smithi077 ceph-mon[27902]: pgmap v20480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:04 smithi191 ceph-mon[31636]: pgmap v20480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:04 smithi170 ceph-mon[31212]: pgmap v20480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38235.860927 secs 2024-04-21T21:02:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:05 smithi077 ceph-mon[27902]: osdmap e1352: 12 total, 12 up, 12 in 2024-04-21T21:02:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38235.860927 secs 2024-04-21T21:02:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:05 smithi191 ceph-mon[31636]: osdmap e1352: 12 total, 12 up, 12 in 2024-04-21T21:02:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38235.860927 secs 2024-04-21T21:02:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:05 smithi170 ceph-mon[31212]: osdmap e1352: 12 total, 12 up, 12 in 2024-04-21T21:02:07.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:06 smithi077 ceph-mon[27902]: pgmap v20482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:02:07.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:06 smithi191 ceph-mon[31636]: pgmap v20482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:02:07.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:06 smithi170 ceph-mon[31212]: pgmap v20482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:02:09.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:08 smithi077 ceph-mon[27902]: pgmap v20483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:02:09.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38239.106100 secs 2024-04-21T21:02:09.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:08 smithi191 ceph-mon[31636]: pgmap v20483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:02:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38239.106100 secs 2024-04-21T21:02:09.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:08 smithi170 ceph-mon[31212]: pgmap v20483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:02:09.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38239.106100 secs 2024-04-21T21:02:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38240.861028 secs 2024-04-21T21:02:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:10 smithi077 ceph-mon[27902]: pgmap v20484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:02:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:10 smithi077 ceph-mon[27902]: osdmap e1353: 12 total, 12 up, 12 in 2024-04-21T21:02:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38240.861028 secs 2024-04-21T21:02:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:10 smithi191 ceph-mon[31636]: pgmap v20484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:02:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:10 smithi191 ceph-mon[31636]: osdmap e1353: 12 total, 12 up, 12 in 2024-04-21T21:02:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38240.861028 secs 2024-04-21T21:02:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:10 smithi170 ceph-mon[31212]: pgmap v20484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:02:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:10 smithi170 ceph-mon[31212]: osdmap e1353: 12 total, 12 up, 12 in 2024-04-21T21:02:13.111 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:12 smithi170 ceph-mon[31212]: pgmap v20486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:02:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:12 smithi077 ceph-mon[27902]: pgmap v20486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:02:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:12 smithi191 ceph-mon[31636]: pgmap v20486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:02:14.121 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38244.106178 secs 2024-04-21T21:02:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38244.106178 secs 2024-04-21T21:02:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38244.106178 secs 2024-04-21T21:02:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:14 smithi077 ceph-mon[27902]: pgmap v20487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T21:02:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:14 smithi191 ceph-mon[31636]: pgmap v20487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T21:02:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:14 smithi170 ceph-mon[31212]: pgmap v20487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-04-21T21:02:16.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38245.861169 secs 2024-04-21T21:02:16.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38245.861169 secs 2024-04-21T21:02:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38245.861169 secs 2024-04-21T21:02:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:16 smithi077 ceph-mon[27902]: pgmap v20488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:02:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:16 smithi191 ceph-mon[31636]: pgmap v20488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:02:17.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:16 smithi170 ceph-mon[31212]: pgmap v20488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:02:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:18 smithi077 ceph-mon[27902]: pgmap v20489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:02:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38249.106322 secs 2024-04-21T21:02:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:18 smithi191 ceph-mon[31636]: pgmap v20489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:02:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38249.106322 secs 2024-04-21T21:02:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:18 smithi170 ceph-mon[31212]: pgmap v20489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:02:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38249.106322 secs 2024-04-21T21:02:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38250.861307 secs 2024-04-21T21:02:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:20 smithi077 ceph-mon[27902]: pgmap v20490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:02:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:02:21.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38250.861307 secs 2024-04-21T21:02:21.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:20 smithi191 ceph-mon[31636]: pgmap v20490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:02:21.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:02:21.158 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38250.861307 secs 2024-04-21T21:02:21.159 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:20 smithi170 ceph-mon[31212]: pgmap v20490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:02:21.159 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:02:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:22 smithi170 ceph-mon[31212]: pgmap v20491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:02:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:22 smithi077 ceph-mon[27902]: pgmap v20491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:02:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:22 smithi191 ceph-mon[31636]: pgmap v20491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:02:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38254.106444 secs 2024-04-21T21:02:24.147 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38254.106444 secs 2024-04-21T21:02:24.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38254.106444 secs 2024-04-21T21:02:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: pgmap v20492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:02:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:02:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: pgmap v20492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:02:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:02:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: pgmap v20492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:02:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:02:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38255.861396 secs 2024-04-21T21:02:26.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38255.861396 secs 2024-04-21T21:02:26.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38255.861396 secs 2024-04-21T21:02:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:26 smithi077 ceph-mon[27902]: pgmap v20493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:26 smithi191 ceph-mon[31636]: pgmap v20493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:26 smithi170 ceph-mon[31212]: pgmap v20493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:28 smithi077 ceph-mon[27902]: pgmap v20494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38259.106571 secs 2024-04-21T21:02:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:28 smithi191 ceph-mon[31636]: pgmap v20494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38259.106571 secs 2024-04-21T21:02:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:28 smithi170 ceph-mon[31212]: pgmap v20494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38259.106571 secs 2024-04-21T21:02:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38260.861521 secs 2024-04-21T21:02:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:30 smithi077 ceph-mon[27902]: pgmap v20495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38260.861521 secs 2024-04-21T21:02:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:30 smithi191 ceph-mon[31636]: pgmap v20495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38260.861521 secs 2024-04-21T21:02:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:30 smithi170 ceph-mon[31212]: pgmap v20495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:32 smithi077 ceph-mon[27902]: pgmap v20496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:32 smithi191 ceph-mon[31636]: pgmap v20496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:32 smithi170 ceph-mon[31212]: pgmap v20496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38264.106634 secs 2024-04-21T21:02:34.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38264.106634 secs 2024-04-21T21:02:34.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38264.106634 secs 2024-04-21T21:02:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:34 smithi191 ceph-mon[31636]: pgmap v20497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38265.861648 secs 2024-04-21T21:02:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:34 smithi170 ceph-mon[31212]: pgmap v20497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38265.861648 secs 2024-04-21T21:02:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:34 smithi077 ceph-mon[27902]: pgmap v20497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38265.861648 secs 2024-04-21T21:02:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:36 smithi191 ceph-mon[31636]: pgmap v20498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:36 smithi170 ceph-mon[31212]: pgmap v20498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:37.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:36 smithi077 ceph-mon[27902]: pgmap v20498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:38 smithi191 ceph-mon[31636]: pgmap v20499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38269.106729 secs 2024-04-21T21:02:39.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:38 smithi170 ceph-mon[31212]: pgmap v20499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38269.106729 secs 2024-04-21T21:02:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:38 smithi077 ceph-mon[27902]: pgmap v20499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38269.106729 secs 2024-04-21T21:02:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:40.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38270.861763 secs 2024-04-21T21:02:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38270.861763 secs 2024-04-21T21:02:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38270.861763 secs 2024-04-21T21:02:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:40 smithi191 ceph-mon[31636]: pgmap v20500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:40 smithi170 ceph-mon[31212]: pgmap v20500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:41.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:40 smithi077 ceph-mon[27902]: pgmap v20500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:43.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:42 smithi191 ceph-mon[31636]: pgmap v20501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:42 smithi170 ceph-mon[31212]: pgmap v20501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:42 smithi077 ceph-mon[27902]: pgmap v20501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:44.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38274.106822 secs 2024-04-21T21:02:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38274.106822 secs 2024-04-21T21:02:44.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38274.106822 secs 2024-04-21T21:02:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:44 smithi191 ceph-mon[31636]: pgmap v20502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38275.861880 secs 2024-04-21T21:02:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:44 smithi170 ceph-mon[31212]: pgmap v20502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38275.861880 secs 2024-04-21T21:02:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:44 smithi077 ceph-mon[27902]: pgmap v20502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38275.861880 secs 2024-04-21T21:02:47.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:46 smithi191 ceph-mon[31636]: pgmap v20503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:47.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:46 smithi170 ceph-mon[31212]: pgmap v20503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:47.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:46 smithi077 ceph-mon[27902]: pgmap v20503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:49.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:48 smithi191 ceph-mon[31636]: pgmap v20504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:49.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38279.106934 secs 2024-04-21T21:02:49.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:48 smithi170 ceph-mon[31212]: pgmap v20504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:49.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38279.106934 secs 2024-04-21T21:02:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:48 smithi077 ceph-mon[27902]: pgmap v20504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38279.106934 secs 2024-04-21T21:02:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:50.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38280.861999 secs 2024-04-21T21:02:50.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:49 smithi191 ceph-mon[31636]: pgmap v20505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38280.861999 secs 2024-04-21T21:02:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:49 smithi170 ceph-mon[31212]: pgmap v20505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:50.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38280.861999 secs 2024-04-21T21:02:50.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:49 smithi077 ceph-mon[27902]: pgmap v20505: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:52.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:52 smithi170 ceph-mon[31212]: pgmap v20506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:52 smithi077 ceph-mon[27902]: pgmap v20506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:52 smithi191 ceph-mon[31636]: pgmap v20506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:53.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38284.107067 secs 2024-04-21T21:02:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38284.107067 secs 2024-04-21T21:02:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38284.107067 secs 2024-04-21T21:02:54.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:54 smithi170 ceph-mon[31212]: pgmap v20507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:54 smithi077 ceph-mon[27902]: pgmap v20507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:54 smithi191 ceph-mon[31636]: pgmap v20507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:02:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:02:55.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38285.862119 secs 2024-04-21T21:02:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38285.862119 secs 2024-04-21T21:02:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38285.862119 secs 2024-04-21T21:02:56.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:56 smithi170 ceph-mon[31212]: pgmap v20508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T21:02:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:56 smithi077 ceph-mon[27902]: pgmap v20508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T21:02:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:56 smithi191 ceph-mon[31636]: pgmap v20508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T21:02:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:58 smithi170 ceph-mon[31212]: pgmap v20509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:58.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:02:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38289.107156 secs 2024-04-21T21:02:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:58 smithi077 ceph-mon[27902]: pgmap v20509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:02:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38289.107156 secs 2024-04-21T21:02:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:58 smithi191 ceph-mon[31636]: pgmap v20509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:02:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:02:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38289.107156 secs 2024-04-21T21:03:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:00.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38290.862231 secs 2024-04-21T21:03:00.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:00 smithi170 ceph-mon[31212]: pgmap v20510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38290.862231 secs 2024-04-21T21:03:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:00 smithi077 ceph-mon[27902]: pgmap v20510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38290.862231 secs 2024-04-21T21:03:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:00 smithi191 ceph-mon[31636]: pgmap v20510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:02.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:02 smithi170 ceph-mon[31212]: pgmap v20511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T21:03:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:02 smithi077 ceph-mon[27902]: pgmap v20511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T21:03:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:02 smithi191 ceph-mon[31636]: pgmap v20511: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-04-21T21:03:03.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38294.107290 secs 2024-04-21T21:03:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38294.107290 secs 2024-04-21T21:03:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38294.107290 secs 2024-04-21T21:03:04.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:04 smithi170 ceph-mon[31212]: pgmap v20512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T21:03:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:04 smithi077 ceph-mon[27902]: pgmap v20512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T21:03:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:04 smithi191 ceph-mon[31636]: pgmap v20512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-21T21:03:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38295.862348 secs 2024-04-21T21:03:05.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:05 smithi170 ceph-mon[31212]: osdmap e1354: 12 total, 12 up, 12 in 2024-04-21T21:03:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38295.862348 secs 2024-04-21T21:03:05.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:05 smithi077 ceph-mon[27902]: osdmap e1354: 12 total, 12 up, 12 in 2024-04-21T21:03:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38295.862348 secs 2024-04-21T21:03:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:05 smithi191 ceph-mon[31636]: osdmap e1354: 12 total, 12 up, 12 in 2024-04-21T21:03:06.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:06 smithi170 ceph-mon[31212]: pgmap v20514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T21:03:06.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:06 smithi077 ceph-mon[27902]: pgmap v20514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T21:03:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:06 smithi191 ceph-mon[31636]: pgmap v20514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-21T21:03:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:08 smithi170 ceph-mon[31212]: pgmap v20515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:03:08.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38299.107441 secs 2024-04-21T21:03:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:08 smithi077 ceph-mon[27902]: pgmap v20515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:03:08.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38299.107441 secs 2024-04-21T21:03:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:08 smithi191 ceph-mon[31636]: pgmap v20515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:03:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38299.107441 secs 2024-04-21T21:03:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38300.862461 secs 2024-04-21T21:03:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:10 smithi170 ceph-mon[31212]: pgmap v20516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:03:10.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:10 smithi170 ceph-mon[31212]: osdmap e1355: 12 total, 12 up, 12 in 2024-04-21T21:03:10.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38300.862461 secs 2024-04-21T21:03:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:10 smithi077 ceph-mon[27902]: pgmap v20516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:03:10.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:10 smithi077 ceph-mon[27902]: osdmap e1355: 12 total, 12 up, 12 in 2024-04-21T21:03:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38300.862461 secs 2024-04-21T21:03:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:10 smithi191 ceph-mon[31636]: pgmap v20516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:03:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:10 smithi191 ceph-mon[31636]: osdmap e1355: 12 total, 12 up, 12 in 2024-04-21T21:03:12.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:12 smithi170 ceph-mon[31212]: pgmap v20518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T21:03:12.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:12 smithi077 ceph-mon[27902]: pgmap v20518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T21:03:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:12 smithi191 ceph-mon[31636]: pgmap v20518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-04-21T21:03:13.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38304.107534 secs 2024-04-21T21:03:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38304.107534 secs 2024-04-21T21:03:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38304.107534 secs 2024-04-21T21:03:14.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:14 smithi191 ceph-mon[31636]: pgmap v20519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-04-21T21:03:14.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:14 smithi077 ceph-mon[27902]: pgmap v20519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-04-21T21:03:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:14 smithi170 ceph-mon[31212]: pgmap v20519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-04-21T21:03:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38305.862571 secs 2024-04-21T21:03:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38305.862571 secs 2024-04-21T21:03:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38305.862571 secs 2024-04-21T21:03:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:16 smithi077 ceph-mon[27902]: pgmap v20520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T21:03:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:16 smithi191 ceph-mon[31636]: pgmap v20520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T21:03:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:16 smithi170 ceph-mon[31212]: pgmap v20520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-04-21T21:03:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:18 smithi077 ceph-mon[27902]: pgmap v20521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:03:18.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38309.107600 secs 2024-04-21T21:03:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:18 smithi191 ceph-mon[31636]: pgmap v20521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:03:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38309.107600 secs 2024-04-21T21:03:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:18 smithi170 ceph-mon[31212]: pgmap v20521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:03:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38309.107600 secs 2024-04-21T21:03:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38310.862682 secs 2024-04-21T21:03:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:20 smithi077 ceph-mon[27902]: pgmap v20522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:03:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38310.862682 secs 2024-04-21T21:03:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:20 smithi191 ceph-mon[31636]: pgmap v20522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:03:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38310.862682 secs 2024-04-21T21:03:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:20 smithi170 ceph-mon[31212]: pgmap v20522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:03:22.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:22 smithi077 ceph-mon[27902]: pgmap v20523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:03:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:22 smithi191 ceph-mon[31636]: pgmap v20523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:03:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:22 smithi170 ceph-mon[31212]: pgmap v20523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:03:23.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38314.107710 secs 2024-04-21T21:03:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38314.107710 secs 2024-04-21T21:03:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38314.107710 secs 2024-04-21T21:03:24.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:24 smithi077 ceph-mon[27902]: pgmap v20524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:24 smithi191 ceph-mon[31636]: pgmap v20524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:24 smithi170 ceph-mon[31212]: pgmap v20524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38315.862796 secs 2024-04-21T21:03:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:03:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:03:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:03:25.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:03:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38315.862796 secs 2024-04-21T21:03:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:03:25.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:03:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:03:25.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:03:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38315.862796 secs 2024-04-21T21:03:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:03:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:03:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:03:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:03:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:26 smithi077 ceph-mon[27902]: pgmap v20525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:26 smithi191 ceph-mon[31636]: pgmap v20525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:26 smithi170 ceph-mon[31212]: pgmap v20525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:28 smithi077 ceph-mon[27902]: pgmap v20526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:28.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38319.107850 secs 2024-04-21T21:03:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:28 smithi191 ceph-mon[31636]: pgmap v20526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38319.107850 secs 2024-04-21T21:03:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:28 smithi170 ceph-mon[31212]: pgmap v20526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38319.107850 secs 2024-04-21T21:03:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38320.862924 secs 2024-04-21T21:03:30.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:30 smithi077 ceph-mon[27902]: pgmap v20527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38320.862924 secs 2024-04-21T21:03:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:30 smithi191 ceph-mon[31636]: pgmap v20527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38320.862924 secs 2024-04-21T21:03:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:30 smithi170 ceph-mon[31212]: pgmap v20527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:32 smithi077 ceph-mon[27902]: pgmap v20528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:32.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:32 smithi191 ceph-mon[31636]: pgmap v20528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:32 smithi170 ceph-mon[31212]: pgmap v20528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38324.107966 secs 2024-04-21T21:03:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38324.107966 secs 2024-04-21T21:03:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38324.107966 secs 2024-04-21T21:03:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:34 smithi077 ceph-mon[27902]: pgmap v20529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:34 smithi191 ceph-mon[31636]: pgmap v20529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:34 smithi170 ceph-mon[31212]: pgmap v20529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38325.863038 secs 2024-04-21T21:03:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38325.863038 secs 2024-04-21T21:03:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38325.863038 secs 2024-04-21T21:03:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:36 smithi077 ceph-mon[27902]: pgmap v20530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:36 smithi191 ceph-mon[31636]: pgmap v20530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:36 smithi170 ceph-mon[31212]: pgmap v20530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:38 smithi077 ceph-mon[27902]: pgmap v20531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38329.108088 secs 2024-04-21T21:03:38.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:38 smithi191 ceph-mon[31636]: pgmap v20531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38329.108088 secs 2024-04-21T21:03:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:38 smithi170 ceph-mon[31212]: pgmap v20531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38329.108088 secs 2024-04-21T21:03:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38330.863166 secs 2024-04-21T21:03:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:40 smithi077 ceph-mon[27902]: pgmap v20532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38330.863166 secs 2024-04-21T21:03:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:40 smithi191 ceph-mon[31636]: pgmap v20532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38330.863166 secs 2024-04-21T21:03:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:40 smithi170 ceph-mon[31212]: pgmap v20532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:42 smithi077 ceph-mon[27902]: pgmap v20533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:42 smithi191 ceph-mon[31636]: pgmap v20533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:42 smithi170 ceph-mon[31212]: pgmap v20533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38334.108201 secs 2024-04-21T21:03:43.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38334.108201 secs 2024-04-21T21:03:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38334.108201 secs 2024-04-21T21:03:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:44 smithi077 ceph-mon[27902]: pgmap v20534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:44.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:44 smithi191 ceph-mon[31636]: pgmap v20534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:44 smithi170 ceph-mon[31212]: pgmap v20534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38335.863261 secs 2024-04-21T21:03:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38335.863261 secs 2024-04-21T21:03:45.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38335.863261 secs 2024-04-21T21:03:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:46 smithi191 ceph-mon[31636]: pgmap v20535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:46 smithi170 ceph-mon[31212]: pgmap v20535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:46 smithi077 ceph-mon[27902]: pgmap v20535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:48 smithi191 ceph-mon[31636]: pgmap v20536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38339.108321 secs 2024-04-21T21:03:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:48 smithi170 ceph-mon[31212]: pgmap v20536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38339.108321 secs 2024-04-21T21:03:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:48 smithi077 ceph-mon[27902]: pgmap v20536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38339.108321 secs 2024-04-21T21:03:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38340.863397 secs 2024-04-21T21:03:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:50 smithi191 ceph-mon[31636]: pgmap v20537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38340.863397 secs 2024-04-21T21:03:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:50 smithi170 ceph-mon[31212]: pgmap v20537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38340.863397 secs 2024-04-21T21:03:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:50 smithi077 ceph-mon[27902]: pgmap v20537: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:52 smithi191 ceph-mon[31636]: pgmap v20538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:52 smithi170 ceph-mon[31212]: pgmap v20538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:52 smithi077 ceph-mon[27902]: pgmap v20538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:03:53.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38344.108409 secs 2024-04-21T21:03:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38344.108409 secs 2024-04-21T21:03:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38344.108409 secs 2024-04-21T21:03:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:54 smithi191 ceph-mon[31636]: pgmap v20539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:54 smithi170 ceph-mon[31212]: pgmap v20539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:54 smithi077 ceph-mon[27902]: pgmap v20539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:03:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:03:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38345.863513 secs 2024-04-21T21:03:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38345.863513 secs 2024-04-21T21:03:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38345.863513 secs 2024-04-21T21:03:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:56 smithi191 ceph-mon[31636]: pgmap v20540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:56 smithi170 ceph-mon[31212]: pgmap v20540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:56 smithi077 ceph-mon[27902]: pgmap v20540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T21:03:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:58 smithi191 ceph-mon[31636]: pgmap v20541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:03:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38349.108541 secs 2024-04-21T21:03:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:58 smithi170 ceph-mon[31212]: pgmap v20541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:03:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38349.108541 secs 2024-04-21T21:03:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:58 smithi077 ceph-mon[27902]: pgmap v20541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:03:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:03:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38349.108541 secs 2024-04-21T21:04:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:00.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38350.863630 secs 2024-04-21T21:04:00.689 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:00 smithi077 ceph-mon[27902]: pgmap v20542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38350.863630 secs 2024-04-21T21:04:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:00 smithi191 ceph-mon[31636]: pgmap v20542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38350.863630 secs 2024-04-21T21:04:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:00 smithi170 ceph-mon[31212]: pgmap v20542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:02 smithi191 ceph-mon[31636]: pgmap v20543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:02 smithi170 ceph-mon[31212]: pgmap v20543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:02 smithi077 ceph-mon[27902]: pgmap v20543: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38354.108644 secs 2024-04-21T21:04:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38354.108644 secs 2024-04-21T21:04:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38354.108644 secs 2024-04-21T21:04:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:04 smithi191 ceph-mon[31636]: pgmap v20544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:04 smithi170 ceph-mon[31212]: pgmap v20544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:04 smithi077 ceph-mon[27902]: pgmap v20544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38355.863693 secs 2024-04-21T21:04:05.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:05 smithi191 ceph-mon[31636]: osdmap e1356: 12 total, 12 up, 12 in 2024-04-21T21:04:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38355.863693 secs 2024-04-21T21:04:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:05 smithi170 ceph-mon[31212]: osdmap e1356: 12 total, 12 up, 12 in 2024-04-21T21:04:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38355.863693 secs 2024-04-21T21:04:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:05 smithi077 ceph-mon[27902]: osdmap e1356: 12 total, 12 up, 12 in 2024-04-21T21:04:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:06 smithi191 ceph-mon[31636]: pgmap v20546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T21:04:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:06 smithi170 ceph-mon[31212]: pgmap v20546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T21:04:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:06 smithi077 ceph-mon[27902]: pgmap v20546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-21T21:04:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:08 smithi191 ceph-mon[31636]: pgmap v20547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:04:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38359.108770 secs 2024-04-21T21:04:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:08 smithi170 ceph-mon[31212]: pgmap v20547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:04:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38359.108770 secs 2024-04-21T21:04:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:08 smithi077 ceph-mon[27902]: pgmap v20547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:04:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38359.108770 secs 2024-04-21T21:04:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:10.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38360.863790 secs 2024-04-21T21:04:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:10 smithi191 ceph-mon[31636]: pgmap v20548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:04:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:10 smithi191 ceph-mon[31636]: osdmap e1357: 12 total, 12 up, 12 in 2024-04-21T21:04:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38360.863790 secs 2024-04-21T21:04:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:10 smithi170 ceph-mon[31212]: pgmap v20548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:04:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:10 smithi170 ceph-mon[31212]: osdmap e1357: 12 total, 12 up, 12 in 2024-04-21T21:04:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38360.863790 secs 2024-04-21T21:04:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:10 smithi077 ceph-mon[27902]: pgmap v20548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:04:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:10 smithi077 ceph-mon[27902]: osdmap e1357: 12 total, 12 up, 12 in 2024-04-21T21:04:12.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:12 smithi191 ceph-mon[31636]: pgmap v20550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:04:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:12 smithi170 ceph-mon[31212]: pgmap v20550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:04:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:12 smithi077 ceph-mon[27902]: pgmap v20550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:04:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38364.108873 secs 2024-04-21T21:04:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38364.108873 secs 2024-04-21T21:04:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38364.108873 secs 2024-04-21T21:04:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:14.659+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:04:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:14.659+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:04:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:14.659+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:04:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:14.659+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:04:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:14 smithi191 ceph-mon[31636]: pgmap v20551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T21:04:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:14 smithi170 ceph-mon[31212]: pgmap v20551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T21:04:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:14 smithi077 ceph-mon[27902]: pgmap v20551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 30 op/s 2024-04-21T21:04:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38365.863919 secs 2024-04-21T21:04:15.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38365.863919 secs 2024-04-21T21:04:15.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38365.863919 secs 2024-04-21T21:04:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:16 smithi170 ceph-mon[31212]: pgmap v20552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T21:04:16.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:16 smithi077 ceph-mon[27902]: pgmap v20552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T21:04:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:16 smithi191 ceph-mon[31636]: pgmap v20552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T21:04:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:18 smithi170 ceph-mon[31212]: pgmap v20553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:04:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38369.108954 secs 2024-04-21T21:04:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:18 smithi077 ceph-mon[27902]: pgmap v20553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:04:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38369.108954 secs 2024-04-21T21:04:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:18 smithi191 ceph-mon[31636]: pgmap v20553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:04:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38369.108954 secs 2024-04-21T21:04:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38370.864032 secs 2024-04-21T21:04:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:20 smithi170 ceph-mon[31212]: pgmap v20554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:04:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38370.864032 secs 2024-04-21T21:04:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:20 smithi077 ceph-mon[27902]: pgmap v20554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:04:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38370.864032 secs 2024-04-21T21:04:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:20 smithi191 ceph-mon[31636]: pgmap v20554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:04:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:22 smithi170 ceph-mon[31212]: pgmap v20555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:04:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:22 smithi077 ceph-mon[27902]: pgmap v20555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:04:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:22 smithi191 ceph-mon[31636]: pgmap v20555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:04:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38374.109069 secs 2024-04-21T21:04:23.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38374.109069 secs 2024-04-21T21:04:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38374.109069 secs 2024-04-21T21:04:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:24 smithi170 ceph-mon[31212]: pgmap v20556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:24 smithi077 ceph-mon[27902]: pgmap v20556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:24 smithi191 ceph-mon[31636]: pgmap v20556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38375.864126 secs 2024-04-21T21:04:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:04:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38375.864126 secs 2024-04-21T21:04:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:04:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38375.864126 secs 2024-04-21T21:04:25.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:04:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:26 smithi170 ceph-mon[31212]: pgmap v20557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:04:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:04:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:04:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:26 smithi077 ceph-mon[27902]: pgmap v20557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:26.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:04:26.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:04:26.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:04:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:26 smithi191 ceph-mon[31636]: pgmap v20557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:04:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:04:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:04:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:28 smithi170 ceph-mon[31212]: pgmap v20558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38379.109174 secs 2024-04-21T21:04:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:28 smithi077 ceph-mon[27902]: pgmap v20558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38379.109174 secs 2024-04-21T21:04:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:28 smithi191 ceph-mon[31636]: pgmap v20558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38379.109174 secs 2024-04-21T21:04:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38380.864188 secs 2024-04-21T21:04:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:30 smithi170 ceph-mon[31212]: pgmap v20559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38380.864188 secs 2024-04-21T21:04:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:30 smithi077 ceph-mon[27902]: pgmap v20559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38380.864188 secs 2024-04-21T21:04:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:30 smithi191 ceph-mon[31636]: pgmap v20559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:32 smithi170 ceph-mon[31212]: pgmap v20560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:32 smithi077 ceph-mon[27902]: pgmap v20560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:32 smithi191 ceph-mon[31636]: pgmap v20560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38384.109289 secs 2024-04-21T21:04:33.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38384.109289 secs 2024-04-21T21:04:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38384.109289 secs 2024-04-21T21:04:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:34 smithi170 ceph-mon[31212]: pgmap v20561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:34 smithi077 ceph-mon[27902]: pgmap v20561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:34 smithi191 ceph-mon[31636]: pgmap v20561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38385.864286 secs 2024-04-21T21:04:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38385.864286 secs 2024-04-21T21:04:35.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38385.864286 secs 2024-04-21T21:04:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:36 smithi170 ceph-mon[31212]: pgmap v20562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:36 smithi077 ceph-mon[27902]: pgmap v20562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:36.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:36 smithi191 ceph-mon[31636]: pgmap v20562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:38 smithi170 ceph-mon[31212]: pgmap v20563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38389.109407 secs 2024-04-21T21:04:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:38 smithi077 ceph-mon[27902]: pgmap v20563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38389.109407 secs 2024-04-21T21:04:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:38 smithi191 ceph-mon[31636]: pgmap v20563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38389.109407 secs 2024-04-21T21:04:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38390.864398 secs 2024-04-21T21:04:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:40 smithi170 ceph-mon[31212]: pgmap v20564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38390.864398 secs 2024-04-21T21:04:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:40 smithi077 ceph-mon[27902]: pgmap v20564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38390.864398 secs 2024-04-21T21:04:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:40 smithi191 ceph-mon[31636]: pgmap v20564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:42 smithi170 ceph-mon[31212]: pgmap v20565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:42.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:42 smithi077 ceph-mon[27902]: pgmap v20565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:42 smithi191 ceph-mon[31636]: pgmap v20565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38394.109522 secs 2024-04-21T21:04:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38394.109522 secs 2024-04-21T21:04:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38394.109522 secs 2024-04-21T21:04:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:44 smithi170 ceph-mon[31212]: pgmap v20566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:44.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:44 smithi191 ceph-mon[31636]: pgmap v20566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:44 smithi077 ceph-mon[27902]: pgmap v20566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38395.864515 secs 2024-04-21T21:04:45.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38395.864515 secs 2024-04-21T21:04:45.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38395.864515 secs 2024-04-21T21:04:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:46 smithi077 ceph-mon[27902]: pgmap v20567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:46.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:46 smithi191 ceph-mon[31636]: pgmap v20567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:46 smithi170 ceph-mon[31212]: pgmap v20567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:48.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:48 smithi077 ceph-mon[27902]: pgmap v20568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38399.109655 secs 2024-04-21T21:04:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:48 smithi191 ceph-mon[31636]: pgmap v20568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38399.109655 secs 2024-04-21T21:04:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:48 smithi170 ceph-mon[31212]: pgmap v20568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38399.109655 secs 2024-04-21T21:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38400.864654 secs 2024-04-21T21:04:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:50 smithi077 ceph-mon[27902]: pgmap v20569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38400.864654 secs 2024-04-21T21:04:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:50 smithi191 ceph-mon[31636]: pgmap v20569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38400.864654 secs 2024-04-21T21:04:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:50 smithi170 ceph-mon[31212]: pgmap v20569: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:52 smithi077 ceph-mon[27902]: pgmap v20570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:52 smithi191 ceph-mon[31636]: pgmap v20570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:52 smithi170 ceph-mon[31212]: pgmap v20570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:04:53.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38404.109791 secs 2024-04-21T21:04:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38404.109791 secs 2024-04-21T21:04:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38404.109791 secs 2024-04-21T21:04:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:54 smithi077 ceph-mon[27902]: pgmap v20571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:54 smithi191 ceph-mon[31636]: pgmap v20571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:54 smithi170 ceph-mon[31212]: pgmap v20571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:04:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:04:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38405.864732 secs 2024-04-21T21:04:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38405.864732 secs 2024-04-21T21:04:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38405.864732 secs 2024-04-21T21:04:56.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:56 smithi077 ceph-mon[27902]: pgmap v20572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:56 smithi191 ceph-mon[31636]: pgmap v20572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:56 smithi170 ceph-mon[31212]: pgmap v20572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:04:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:58 smithi077 ceph-mon[27902]: pgmap v20573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:04:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38409.109871 secs 2024-04-21T21:04:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:58 smithi191 ceph-mon[31636]: pgmap v20573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:04:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38409.109871 secs 2024-04-21T21:04:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:58 smithi170 ceph-mon[31212]: pgmap v20573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:04:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:04:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38409.109871 secs 2024-04-21T21:04:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:59.666+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:04:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:59.666+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:04:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:59.666+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:04:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:04:59.666+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:05:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38410.864825 secs 2024-04-21T21:05:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:00 smithi077 ceph-mon[27902]: pgmap v20574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38410.864825 secs 2024-04-21T21:05:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:00 smithi191 ceph-mon[31636]: pgmap v20574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38410.864825 secs 2024-04-21T21:05:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:00 smithi170 ceph-mon[31212]: pgmap v20574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:02 smithi077 ceph-mon[27902]: pgmap v20575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:02 smithi191 ceph-mon[31636]: pgmap v20575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:02 smithi170 ceph-mon[31212]: pgmap v20575: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38414.109945 secs 2024-04-21T21:05:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38414.109945 secs 2024-04-21T21:05:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38414.109945 secs 2024-04-21T21:05:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:04 smithi077 ceph-mon[27902]: pgmap v20576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:04 smithi191 ceph-mon[31636]: pgmap v20576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:04 smithi170 ceph-mon[31212]: pgmap v20576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38415.864935 secs 2024-04-21T21:05:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:05 smithi077 ceph-mon[27902]: osdmap e1358: 12 total, 12 up, 12 in 2024-04-21T21:05:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38415.864935 secs 2024-04-21T21:05:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:05 smithi191 ceph-mon[31636]: osdmap e1358: 12 total, 12 up, 12 in 2024-04-21T21:05:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38415.864935 secs 2024-04-21T21:05:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:05 smithi170 ceph-mon[31212]: osdmap e1358: 12 total, 12 up, 12 in 2024-04-21T21:05:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:06 smithi077 ceph-mon[27902]: pgmap v20578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:06 smithi191 ceph-mon[31636]: pgmap v20578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:06 smithi170 ceph-mon[31212]: pgmap v20578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:08 smithi077 ceph-mon[27902]: pgmap v20579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38419.110028 secs 2024-04-21T21:05:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:08 smithi191 ceph-mon[31636]: pgmap v20579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38419.110028 secs 2024-04-21T21:05:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:08 smithi170 ceph-mon[31212]: pgmap v20579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38419.110028 secs 2024-04-21T21:05:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38420.865014 secs 2024-04-21T21:05:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:10 smithi077 ceph-mon[27902]: pgmap v20580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:10 smithi077 ceph-mon[27902]: osdmap e1359: 12 total, 12 up, 12 in 2024-04-21T21:05:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38420.865014 secs 2024-04-21T21:05:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:10 smithi191 ceph-mon[31636]: pgmap v20580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:10 smithi191 ceph-mon[31636]: osdmap e1359: 12 total, 12 up, 12 in 2024-04-21T21:05:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38420.865014 secs 2024-04-21T21:05:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:10 smithi170 ceph-mon[31212]: pgmap v20580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:05:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:10 smithi170 ceph-mon[31212]: osdmap e1359: 12 total, 12 up, 12 in 2024-04-21T21:05:12.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:12 smithi077 ceph-mon[27902]: pgmap v20582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:05:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:12 smithi191 ceph-mon[31636]: pgmap v20582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:05:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:12 smithi170 ceph-mon[31212]: pgmap v20582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:05:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38424.110145 secs 2024-04-21T21:05:13.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38424.110145 secs 2024-04-21T21:05:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38424.110145 secs 2024-04-21T21:05:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:14 smithi077 ceph-mon[27902]: pgmap v20583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T21:05:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:14 smithi191 ceph-mon[31636]: pgmap v20583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T21:05:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:14 smithi170 ceph-mon[31212]: pgmap v20583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T21:05:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38425.865130 secs 2024-04-21T21:05:15.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38425.865130 secs 2024-04-21T21:05:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38425.865130 secs 2024-04-21T21:05:16.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:16 smithi191 ceph-mon[31636]: pgmap v20584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:16 smithi170 ceph-mon[31212]: pgmap v20584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:16 smithi077 ceph-mon[27902]: pgmap v20584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:18 smithi191 ceph-mon[31636]: pgmap v20585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38429.110276 secs 2024-04-21T21:05:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:18 smithi170 ceph-mon[31212]: pgmap v20585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38429.110276 secs 2024-04-21T21:05:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:18 smithi077 ceph-mon[27902]: pgmap v20585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38429.110276 secs 2024-04-21T21:05:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38430.865199 secs 2024-04-21T21:05:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:20 smithi191 ceph-mon[31636]: pgmap v20586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38430.865199 secs 2024-04-21T21:05:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:20 smithi170 ceph-mon[31212]: pgmap v20586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38430.865199 secs 2024-04-21T21:05:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:20 smithi077 ceph-mon[27902]: pgmap v20586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:05:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:22 smithi191 ceph-mon[31636]: pgmap v20587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:05:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:22 smithi170 ceph-mon[31212]: pgmap v20587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:05:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:22 smithi077 ceph-mon[27902]: pgmap v20587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:05:23.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38434.110402 secs 2024-04-21T21:05:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38434.110402 secs 2024-04-21T21:05:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38434.110402 secs 2024-04-21T21:05:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:24 smithi191 ceph-mon[31636]: pgmap v20588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:24 smithi170 ceph-mon[31212]: pgmap v20588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:24 smithi077 ceph-mon[27902]: pgmap v20588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38435.865260 secs 2024-04-21T21:05:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38435.865260 secs 2024-04-21T21:05:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38435.865260 secs 2024-04-21T21:05:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:26 smithi191 ceph-mon[31636]: pgmap v20589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:05:26.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:26 smithi077 ceph-mon[27902]: pgmap v20589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:26.938 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:05:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:26 smithi170 ceph-mon[31212]: pgmap v20589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:05:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38439.110482 secs 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: pgmap v20590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38439.110482 secs 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: pgmap v20590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38439.110482 secs 2024-04-21T21:05:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: pgmap v20590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:29.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38440.865364 secs 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:05:30.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.313 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:05:30.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:05:30.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:05:30.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:05:30.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.314 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:29 smithi170 ceph-mon[31212]: pgmap v20591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38440.865364 secs 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:05:30.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:05:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:05:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:05:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:05:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:05:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.391 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:29 smithi077 ceph-mon[27902]: pgmap v20591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38440.865364 secs 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:05:30.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:29 smithi191 ceph-mon[31636]: pgmap v20591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:32.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:32 smithi170 ceph-mon[31212]: pgmap v20592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:32.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:32 smithi077 ceph-mon[27902]: pgmap v20592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:32.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:32 smithi191 ceph-mon[31636]: pgmap v20592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38444.110595 secs 2024-04-21T21:05:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38444.110595 secs 2024-04-21T21:05:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38444.110595 secs 2024-04-21T21:05:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:34 smithi170 ceph-mon[31212]: pgmap v20593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:34 smithi077 ceph-mon[27902]: pgmap v20593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:34.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:34 smithi191 ceph-mon[31636]: pgmap v20593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38445.865484 secs 2024-04-21T21:05:35.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38445.865484 secs 2024-04-21T21:05:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38445.865484 secs 2024-04-21T21:05:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:36 smithi077 ceph-mon[27902]: pgmap v20594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:36 smithi191 ceph-mon[31636]: pgmap v20594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:36 smithi170 ceph-mon[31212]: pgmap v20594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:38.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38449.110691 secs 2024-04-21T21:05:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:38 smithi077 ceph-mon[27902]: pgmap v20595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38449.110691 secs 2024-04-21T21:05:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:38 smithi191 ceph-mon[31636]: pgmap v20595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38449.110691 secs 2024-04-21T21:05:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:38 smithi170 ceph-mon[31212]: pgmap v20595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38450.865582 secs 2024-04-21T21:05:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:40 smithi077 ceph-mon[27902]: pgmap v20596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38450.865582 secs 2024-04-21T21:05:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:40 smithi191 ceph-mon[31636]: pgmap v20596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38450.865582 secs 2024-04-21T21:05:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:40 smithi170 ceph-mon[31212]: pgmap v20596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:42.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:42 smithi077 ceph-mon[27902]: pgmap v20597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:42.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:42 smithi191 ceph-mon[31636]: pgmap v20597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:42 smithi170 ceph-mon[31212]: pgmap v20597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:43.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38454.110821 secs 2024-04-21T21:05:43.709 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38454.110821 secs 2024-04-21T21:05:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38454.110821 secs 2024-04-21T21:05:44.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:44 smithi191 ceph-mon[31636]: pgmap v20598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:44 smithi077 ceph-mon[27902]: pgmap v20598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:44.734 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:44 smithi170 ceph-mon[31212]: pgmap v20598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38455.865713 secs 2024-04-21T21:05:45.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38455.865713 secs 2024-04-21T21:05:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38455.865713 secs 2024-04-21T21:05:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:46 smithi077 ceph-mon[27902]: pgmap v20599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:46.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:46 smithi191 ceph-mon[31636]: pgmap v20599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:46 smithi170 ceph-mon[31212]: pgmap v20599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38459.110953 secs 2024-04-21T21:05:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:48 smithi077 ceph-mon[27902]: pgmap v20600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38459.110953 secs 2024-04-21T21:05:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:48 smithi191 ceph-mon[31636]: pgmap v20600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38459.110953 secs 2024-04-21T21:05:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:48 smithi170 ceph-mon[31212]: pgmap v20600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38460.865834 secs 2024-04-21T21:05:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:50 smithi077 ceph-mon[27902]: pgmap v20601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38460.865834 secs 2024-04-21T21:05:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:50 smithi191 ceph-mon[31636]: pgmap v20601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38460.865834 secs 2024-04-21T21:05:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:50 smithi170 ceph-mon[31212]: pgmap v20601: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:52.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:52 smithi077 ceph-mon[27902]: pgmap v20602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:52.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:52 smithi191 ceph-mon[31636]: pgmap v20602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:52 smithi170 ceph-mon[31212]: pgmap v20602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:05:53.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38464.111067 secs 2024-04-21T21:05:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38464.111067 secs 2024-04-21T21:05:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38464.111067 secs 2024-04-21T21:05:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:54 smithi077 ceph-mon[27902]: pgmap v20603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:54.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:54 smithi191 ceph-mon[31636]: pgmap v20603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:54 smithi170 ceph-mon[31212]: pgmap v20603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:05:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:05:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38465.865974 secs 2024-04-21T21:05:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38465.865974 secs 2024-04-21T21:05:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38465.865974 secs 2024-04-21T21:05:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:56 smithi077 ceph-mon[27902]: pgmap v20604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:56 smithi191 ceph-mon[31636]: pgmap v20604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:56 smithi170 ceph-mon[31212]: pgmap v20604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-21T21:05:58.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38469.111212 secs 2024-04-21T21:05:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:05:58 smithi077 ceph-mon[27902]: pgmap v20605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:58.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38469.111212 secs 2024-04-21T21:05:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:05:58 smithi191 ceph-mon[31636]: pgmap v20605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:05:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38469.111212 secs 2024-04-21T21:05:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:05:58 smithi170 ceph-mon[31212]: pgmap v20605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:06:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38470.866094 secs 2024-04-21T21:06:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:00 smithi077 ceph-mon[27902]: pgmap v20606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38470.866094 secs 2024-04-21T21:06:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:00 smithi191 ceph-mon[31636]: pgmap v20606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38470.866094 secs 2024-04-21T21:06:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:00 smithi170 ceph-mon[31212]: pgmap v20606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:02.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:02 smithi077 ceph-mon[27902]: pgmap v20607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:02 smithi191 ceph-mon[31636]: pgmap v20607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:02 smithi170 ceph-mon[31212]: pgmap v20607: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:03.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38474.111347 secs 2024-04-21T21:06:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38474.111347 secs 2024-04-21T21:06:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38474.111347 secs 2024-04-21T21:06:04.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:04 smithi077 ceph-mon[27902]: pgmap v20608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:04 smithi191 ceph-mon[31636]: pgmap v20608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:04 smithi170 ceph-mon[31212]: pgmap v20608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38475.866175 secs 2024-04-21T21:06:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:05 smithi191 ceph-mon[31636]: osdmap e1360: 12 total, 12 up, 12 in 2024-04-21T21:06:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38475.866175 secs 2024-04-21T21:06:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:05 smithi170 ceph-mon[31212]: osdmap e1360: 12 total, 12 up, 12 in 2024-04-21T21:06:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38475.866175 secs 2024-04-21T21:06:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:05 smithi077 ceph-mon[27902]: osdmap e1360: 12 total, 12 up, 12 in 2024-04-21T21:06:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:06 smithi191 ceph-mon[31636]: pgmap v20610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:06 smithi170 ceph-mon[31212]: pgmap v20610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:06 smithi077 ceph-mon[27902]: pgmap v20610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:08.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38479.111491 secs 2024-04-21T21:06:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:08 smithi191 ceph-mon[31636]: pgmap v20611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38479.111491 secs 2024-04-21T21:06:08.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:08 smithi170 ceph-mon[31212]: pgmap v20611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38479.111491 secs 2024-04-21T21:06:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:08 smithi077 ceph-mon[27902]: pgmap v20611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38480.866298 secs 2024-04-21T21:06:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:10 smithi191 ceph-mon[31636]: pgmap v20612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:10 smithi191 ceph-mon[31636]: osdmap e1361: 12 total, 12 up, 12 in 2024-04-21T21:06:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38480.866298 secs 2024-04-21T21:06:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:10 smithi170 ceph-mon[31212]: pgmap v20612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:10 smithi170 ceph-mon[31212]: osdmap e1361: 12 total, 12 up, 12 in 2024-04-21T21:06:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38480.866298 secs 2024-04-21T21:06:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:10 smithi077 ceph-mon[27902]: pgmap v20612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:06:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:10 smithi077 ceph-mon[27902]: osdmap e1361: 12 total, 12 up, 12 in 2024-04-21T21:06:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:12 smithi191 ceph-mon[31636]: pgmap v20614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:06:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:12 smithi170 ceph-mon[31212]: pgmap v20614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:06:12.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:12 smithi077 ceph-mon[27902]: pgmap v20614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:06:13.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38484.111628 secs 2024-04-21T21:06:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38484.111628 secs 2024-04-21T21:06:13.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38484.111628 secs 2024-04-21T21:06:14.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:14 smithi191 ceph-mon[31636]: pgmap v20615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:06:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:14 smithi170 ceph-mon[31212]: pgmap v20615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:06:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:14 smithi077 ceph-mon[27902]: pgmap v20615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:06:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38485.866407 secs 2024-04-21T21:06:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38485.866407 secs 2024-04-21T21:06:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38485.866407 secs 2024-04-21T21:06:16.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:16 smithi191 ceph-mon[31636]: pgmap v20616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:16 smithi170 ceph-mon[31212]: pgmap v20616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:16 smithi077 ceph-mon[27902]: pgmap v20616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38489.111745 secs 2024-04-21T21:06:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:18 smithi191 ceph-mon[31636]: pgmap v20617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38489.111745 secs 2024-04-21T21:06:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:18 smithi170 ceph-mon[31212]: pgmap v20617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38489.111745 secs 2024-04-21T21:06:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:18 smithi077 ceph-mon[27902]: pgmap v20617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38490.866528 secs 2024-04-21T21:06:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:20 smithi191 ceph-mon[31636]: pgmap v20618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38490.866528 secs 2024-04-21T21:06:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:20 smithi170 ceph-mon[31212]: pgmap v20618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38490.866528 secs 2024-04-21T21:06:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:20 smithi077 ceph-mon[27902]: pgmap v20618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:06:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:22 smithi191 ceph-mon[31636]: pgmap v20619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:06:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:22 smithi170 ceph-mon[31212]: pgmap v20619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:06:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:22 smithi077 ceph-mon[27902]: pgmap v20619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:06:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38494.111853 secs 2024-04-21T21:06:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38494.111853 secs 2024-04-21T21:06:23.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38494.111853 secs 2024-04-21T21:06:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:24 smithi191 ceph-mon[31636]: pgmap v20620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:24 smithi170 ceph-mon[31212]: pgmap v20620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:24 smithi077 ceph-mon[27902]: pgmap v20620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38495.866626 secs 2024-04-21T21:06:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38495.866626 secs 2024-04-21T21:06:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38495.866626 secs 2024-04-21T21:06:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:26 smithi191 ceph-mon[31636]: pgmap v20621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:26 smithi170 ceph-mon[31212]: pgmap v20621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:26 smithi077 ceph-mon[27902]: pgmap v20621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:28.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38499.111965 secs 2024-04-21T21:06:28.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:28 smithi191 ceph-mon[31636]: pgmap v20622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:06:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38499.111965 secs 2024-04-21T21:06:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:28 smithi170 ceph-mon[31212]: pgmap v20622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:06:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38499.111965 secs 2024-04-21T21:06:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:28 smithi077 ceph-mon[27902]: pgmap v20622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:06:29.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:29 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:06:29.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:29 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:06:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:29 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:06:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38500.866743 secs 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: pgmap v20623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:06:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38500.866743 secs 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: pgmap v20623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:06:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38500.866743 secs 2024-04-21T21:06:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: pgmap v20623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:06:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:06:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:06:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:32 smithi191 ceph-mon[31636]: pgmap v20624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:32 smithi170 ceph-mon[31212]: pgmap v20624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:32 smithi077 ceph-mon[27902]: pgmap v20624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38504.112027 secs 2024-04-21T21:06:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38504.112027 secs 2024-04-21T21:06:34.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38504.112027 secs 2024-04-21T21:06:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:34 smithi191 ceph-mon[31636]: pgmap v20625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:35.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:34 smithi170 ceph-mon[31212]: pgmap v20625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:34 smithi077 ceph-mon[27902]: pgmap v20625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:35.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38505.866884 secs 2024-04-21T21:06:36.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38505.866884 secs 2024-04-21T21:06:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38505.866884 secs 2024-04-21T21:06:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:36 smithi191 ceph-mon[31636]: pgmap v20626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:36 smithi170 ceph-mon[31212]: pgmap v20626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:36 smithi077 ceph-mon[27902]: pgmap v20626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38509.112120 secs 2024-04-21T21:06:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:38 smithi191 ceph-mon[31636]: pgmap v20627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38509.112120 secs 2024-04-21T21:06:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:38 smithi170 ceph-mon[31212]: pgmap v20627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38509.112120 secs 2024-04-21T21:06:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:38 smithi077 ceph-mon[27902]: pgmap v20627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38510.866983 secs 2024-04-21T21:06:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:40 smithi191 ceph-mon[31636]: pgmap v20628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38510.866983 secs 2024-04-21T21:06:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:40 smithi170 ceph-mon[31212]: pgmap v20628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38510.866983 secs 2024-04-21T21:06:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:40 smithi077 ceph-mon[27902]: pgmap v20628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:42 smithi191 ceph-mon[31636]: pgmap v20629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:42 smithi170 ceph-mon[31212]: pgmap v20629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:42 smithi077 ceph-mon[27902]: pgmap v20629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:43.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38514.112192 secs 2024-04-21T21:06:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38514.112192 secs 2024-04-21T21:06:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38514.112192 secs 2024-04-21T21:06:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:44 smithi191 ceph-mon[31636]: pgmap v20630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:44 smithi170 ceph-mon[31212]: pgmap v20630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:45.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:44 smithi077 ceph-mon[27902]: pgmap v20630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:45.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38515.867082 secs 2024-04-21T21:06:46.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38515.867082 secs 2024-04-21T21:06:46.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38515.867082 secs 2024-04-21T21:06:46.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:46 smithi191 ceph-mon[31636]: pgmap v20631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:46 smithi170 ceph-mon[31212]: pgmap v20631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:46 smithi077 ceph-mon[27902]: pgmap v20631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38519.112269 secs 2024-04-21T21:06:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:48 smithi191 ceph-mon[31636]: pgmap v20632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38519.112269 secs 2024-04-21T21:06:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:48 smithi170 ceph-mon[31212]: pgmap v20632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38519.112269 secs 2024-04-21T21:06:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:48 smithi077 ceph-mon[27902]: pgmap v20632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38520.867207 secs 2024-04-21T21:06:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:50 smithi191 ceph-mon[31636]: pgmap v20633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38520.867207 secs 2024-04-21T21:06:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:50 smithi170 ceph-mon[31212]: pgmap v20633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38520.867207 secs 2024-04-21T21:06:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:50 smithi077 ceph-mon[27902]: pgmap v20633: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:52.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:52 smithi191 ceph-mon[31636]: pgmap v20634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:52 smithi170 ceph-mon[31212]: pgmap v20634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:52 smithi077 ceph-mon[27902]: pgmap v20634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38524.112405 secs 2024-04-21T21:06:54.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38524.112405 secs 2024-04-21T21:06:54.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38524.112405 secs 2024-04-21T21:06:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:54 smithi170 ceph-mon[31212]: pgmap v20635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:06:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:54 smithi077 ceph-mon[27902]: pgmap v20635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:54 smithi191 ceph-mon[31636]: pgmap v20635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38525.867323 secs 2024-04-21T21:06:56.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38525.867323 secs 2024-04-21T21:06:56.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38525.867323 secs 2024-04-21T21:06:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:56 smithi170 ceph-mon[31212]: pgmap v20636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:57.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:56 smithi077 ceph-mon[27902]: pgmap v20636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:57.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:56 smithi191 ceph-mon[31636]: pgmap v20636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:06:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38529.112479 secs 2024-04-21T21:06:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:06:58 smithi170 ceph-mon[31212]: pgmap v20637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38529.112479 secs 2024-04-21T21:06:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:06:58 smithi077 ceph-mon[27902]: pgmap v20637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:06:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38529.112479 secs 2024-04-21T21:06:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:06:58 smithi191 ceph-mon[31636]: pgmap v20637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38530.867438 secs 2024-04-21T21:07:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:00 smithi170 ceph-mon[31212]: pgmap v20638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38530.867438 secs 2024-04-21T21:07:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:00 smithi077 ceph-mon[27902]: pgmap v20638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38530.867438 secs 2024-04-21T21:07:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:00 smithi191 ceph-mon[31636]: pgmap v20638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:02 smithi170 ceph-mon[31212]: pgmap v20639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:02 smithi077 ceph-mon[27902]: pgmap v20639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:02 smithi191 ceph-mon[31636]: pgmap v20639: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38534.112607 secs 2024-04-21T21:07:04.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38534.112607 secs 2024-04-21T21:07:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38534.112607 secs 2024-04-21T21:07:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:04 smithi170 ceph-mon[31212]: pgmap v20640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:04 smithi077 ceph-mon[27902]: pgmap v20640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:04 smithi191 ceph-mon[31636]: pgmap v20640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38535.867509 secs 2024-04-21T21:07:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:05 smithi170 ceph-mon[31212]: osdmap e1362: 12 total, 12 up, 12 in 2024-04-21T21:07:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38535.867509 secs 2024-04-21T21:07:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:05 smithi077 ceph-mon[27902]: osdmap e1362: 12 total, 12 up, 12 in 2024-04-21T21:07:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38535.867509 secs 2024-04-21T21:07:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:05 smithi191 ceph-mon[31636]: osdmap e1362: 12 total, 12 up, 12 in 2024-04-21T21:07:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:06 smithi170 ceph-mon[31212]: pgmap v20642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:07.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:06 smithi077 ceph-mon[27902]: pgmap v20642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:07.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:06 smithi191 ceph-mon[31636]: pgmap v20642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38539.112724 secs 2024-04-21T21:07:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:08 smithi170 ceph-mon[31212]: pgmap v20643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38539.112724 secs 2024-04-21T21:07:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:08 smithi077 ceph-mon[27902]: pgmap v20643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38539.112724 secs 2024-04-21T21:07:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:08 smithi191 ceph-mon[31636]: pgmap v20643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38540.867643 secs 2024-04-21T21:07:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:10 smithi170 ceph-mon[31212]: pgmap v20644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:10 smithi170 ceph-mon[31212]: osdmap e1363: 12 total, 12 up, 12 in 2024-04-21T21:07:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38540.867643 secs 2024-04-21T21:07:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:10 smithi077 ceph-mon[27902]: pgmap v20644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:10 smithi077 ceph-mon[27902]: osdmap e1363: 12 total, 12 up, 12 in 2024-04-21T21:07:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38540.867643 secs 2024-04-21T21:07:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:10 smithi191 ceph-mon[31636]: pgmap v20644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:07:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:10 smithi191 ceph-mon[31636]: osdmap e1363: 12 total, 12 up, 12 in 2024-04-21T21:07:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:12 smithi170 ceph-mon[31212]: pgmap v20646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:07:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:12 smithi077 ceph-mon[27902]: pgmap v20646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:07:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:12 smithi191 ceph-mon[31636]: pgmap v20646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:07:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38544.112841 secs 2024-04-21T21:07:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38544.112841 secs 2024-04-21T21:07:14.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38544.112841 secs 2024-04-21T21:07:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:14 smithi170 ceph-mon[31212]: pgmap v20647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T21:07:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:14 smithi077 ceph-mon[27902]: pgmap v20647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T21:07:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:14 smithi191 ceph-mon[31636]: pgmap v20647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-21T21:07:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38545.867750 secs 2024-04-21T21:07:16.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38545.867750 secs 2024-04-21T21:07:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38545.867750 secs 2024-04-21T21:07:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:16 smithi170 ceph-mon[31212]: pgmap v20648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:16 smithi077 ceph-mon[27902]: pgmap v20648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:17.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:16 smithi191 ceph-mon[31636]: pgmap v20648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38549.112968 secs 2024-04-21T21:07:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:18 smithi170 ceph-mon[31212]: pgmap v20649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38549.112968 secs 2024-04-21T21:07:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:18 smithi077 ceph-mon[27902]: pgmap v20649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38549.112968 secs 2024-04-21T21:07:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:18 smithi191 ceph-mon[31636]: pgmap v20649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38550.867870 secs 2024-04-21T21:07:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:20 smithi170 ceph-mon[31212]: pgmap v20650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38550.867870 secs 2024-04-21T21:07:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:20 smithi077 ceph-mon[27902]: pgmap v20650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38550.867870 secs 2024-04-21T21:07:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:20 smithi191 ceph-mon[31636]: pgmap v20650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:07:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:22 smithi170 ceph-mon[31212]: pgmap v20651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:07:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:22 smithi077 ceph-mon[27902]: pgmap v20651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:07:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:22 smithi191 ceph-mon[31636]: pgmap v20651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:07:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38554.113098 secs 2024-04-21T21:07:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38554.113098 secs 2024-04-21T21:07:24.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38554.113098 secs 2024-04-21T21:07:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:24 smithi170 ceph-mon[31212]: pgmap v20652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:24 smithi077 ceph-mon[27902]: pgmap v20652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:24 smithi191 ceph-mon[31636]: pgmap v20652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38555.867951 secs 2024-04-21T21:07:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38555.867951 secs 2024-04-21T21:07:26.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38555.867951 secs 2024-04-21T21:07:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:26 smithi077 ceph-mon[27902]: pgmap v20653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:26 smithi191 ceph-mon[31636]: pgmap v20653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:26 smithi170 ceph-mon[31212]: pgmap v20653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38559.113190 secs 2024-04-21T21:07:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:28 smithi077 ceph-mon[27902]: pgmap v20654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38559.113190 secs 2024-04-21T21:07:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:28 smithi191 ceph-mon[31636]: pgmap v20654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38559.113190 secs 2024-04-21T21:07:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:28 smithi170 ceph-mon[31212]: pgmap v20654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38560.868074 secs 2024-04-21T21:07:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:30 smithi077 ceph-mon[27902]: pgmap v20655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:07:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38560.868074 secs 2024-04-21T21:07:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:30 smithi191 ceph-mon[31636]: pgmap v20655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:07:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38560.868074 secs 2024-04-21T21:07:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:30 smithi170 ceph-mon[31212]: pgmap v20655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:07:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: pgmap v20656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:32.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:07:32.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:07:32.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: pgmap v20656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:07:32.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: pgmap v20656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:32.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:07:32.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:07:32.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:07:33.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38564.113263 secs 2024-04-21T21:07:33.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38564.113263 secs 2024-04-21T21:07:33.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38564.113263 secs 2024-04-21T21:07:34.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:34 smithi170 ceph-mon[31212]: pgmap v20657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:34.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:34 smithi077 ceph-mon[27902]: pgmap v20657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:34.722 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:34 smithi191 ceph-mon[31636]: pgmap v20657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:35.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38565.868197 secs 2024-04-21T21:07:35.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38565.868197 secs 2024-04-21T21:07:35.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38565.868197 secs 2024-04-21T21:07:36.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:36 smithi170 ceph-mon[31212]: pgmap v20658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:36.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:36 smithi077 ceph-mon[27902]: pgmap v20658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:36.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:36 smithi191 ceph-mon[31636]: pgmap v20658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38569.113376 secs 2024-04-21T21:07:38.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:38 smithi077 ceph-mon[27902]: pgmap v20659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38569.113376 secs 2024-04-21T21:07:38.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:38 smithi191 ceph-mon[31636]: pgmap v20659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38569.113376 secs 2024-04-21T21:07:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:38 smithi170 ceph-mon[31212]: pgmap v20659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:40.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38570.868263 secs 2024-04-21T21:07:40.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:40 smithi077 ceph-mon[27902]: pgmap v20660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:40.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38570.868263 secs 2024-04-21T21:07:40.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:40 smithi191 ceph-mon[31636]: pgmap v20660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38570.868263 secs 2024-04-21T21:07:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:40 smithi170 ceph-mon[31212]: pgmap v20660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:42.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:42 smithi077 ceph-mon[27902]: pgmap v20661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:42 smithi191 ceph-mon[31636]: pgmap v20661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:42 smithi170 ceph-mon[31212]: pgmap v20661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:43.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38574.113491 secs 2024-04-21T21:07:43.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38574.113491 secs 2024-04-21T21:07:43.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38574.113491 secs 2024-04-21T21:07:44.622 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:44 smithi191 ceph-mon[31636]: pgmap v20662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:44.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:44 smithi077 ceph-mon[27902]: pgmap v20662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:44 smithi170 ceph-mon[31212]: pgmap v20662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:45.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38575.868336 secs 2024-04-21T21:07:45.638 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38575.868336 secs 2024-04-21T21:07:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38575.868336 secs 2024-04-21T21:07:46.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:46 smithi077 ceph-mon[27902]: pgmap v20663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:46 smithi191 ceph-mon[31636]: pgmap v20663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:46 smithi170 ceph-mon[31212]: pgmap v20663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38579.113629 secs 2024-04-21T21:07:48.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:48 smithi077 ceph-mon[27902]: pgmap v20664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38579.113629 secs 2024-04-21T21:07:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:48 smithi191 ceph-mon[31636]: pgmap v20664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38579.113629 secs 2024-04-21T21:07:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:48 smithi170 ceph-mon[31212]: pgmap v20664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38580.868470 secs 2024-04-21T21:07:50.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:50 smithi077 ceph-mon[27902]: pgmap v20665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38580.868470 secs 2024-04-21T21:07:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:50 smithi191 ceph-mon[31636]: pgmap v20665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38580.868470 secs 2024-04-21T21:07:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:50 smithi170 ceph-mon[31212]: pgmap v20665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:52.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:52 smithi077 ceph-mon[27902]: pgmap v20666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:52 smithi191 ceph-mon[31636]: pgmap v20666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:52 smithi170 ceph-mon[31212]: pgmap v20666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:53.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38584.113789 secs 2024-04-21T21:07:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38584.113789 secs 2024-04-21T21:07:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38584.113789 secs 2024-04-21T21:07:54.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:54 smithi077 ceph-mon[27902]: pgmap v20667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:54 smithi191 ceph-mon[31636]: pgmap v20667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:54 smithi170 ceph-mon[31212]: pgmap v20667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:07:55.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38585.868590 secs 2024-04-21T21:07:55.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38585.868590 secs 2024-04-21T21:07:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38585.868590 secs 2024-04-21T21:07:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:56 smithi077 ceph-mon[27902]: pgmap v20668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:56.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:56 smithi191 ceph-mon[31636]: pgmap v20668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:56 smithi170 ceph-mon[31212]: pgmap v20668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:07:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38589.113859 secs 2024-04-21T21:07:58.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:07:58 smithi077 ceph-mon[27902]: pgmap v20669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38589.113859 secs 2024-04-21T21:07:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:07:58 smithi191 ceph-mon[31636]: pgmap v20669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38589.113859 secs 2024-04-21T21:07:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:07:58 smithi170 ceph-mon[31212]: pgmap v20669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:07:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:07:59.690+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:07:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:07:59.690+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:07:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:07:59.690+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:07:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:07:59.690+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:08:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:00.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38590.868652 secs 2024-04-21T21:08:00.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:00 smithi077 ceph-mon[27902]: pgmap v20670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:00.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38590.868652 secs 2024-04-21T21:08:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:00 smithi191 ceph-mon[31636]: pgmap v20670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38590.868652 secs 2024-04-21T21:08:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:00 smithi170 ceph-mon[31212]: pgmap v20670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:02.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:02 smithi191 ceph-mon[31636]: pgmap v20671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:02 smithi170 ceph-mon[31212]: pgmap v20671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:02 smithi077 ceph-mon[27902]: pgmap v20671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:03.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38594.113967 secs 2024-04-21T21:08:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38594.113967 secs 2024-04-21T21:08:03.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38594.113967 secs 2024-04-21T21:08:04.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:04 smithi191 ceph-mon[31636]: pgmap v20672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:04 smithi170 ceph-mon[31212]: pgmap v20672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:04 smithi077 ceph-mon[27902]: pgmap v20672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38595.868717 secs 2024-04-21T21:08:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:05 smithi191 ceph-mon[31636]: osdmap e1364: 12 total, 12 up, 12 in 2024-04-21T21:08:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38595.868717 secs 2024-04-21T21:08:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:05 smithi170 ceph-mon[31212]: osdmap e1364: 12 total, 12 up, 12 in 2024-04-21T21:08:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38595.868717 secs 2024-04-21T21:08:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:05 smithi077 ceph-mon[27902]: osdmap e1364: 12 total, 12 up, 12 in 2024-04-21T21:08:06.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:06 smithi191 ceph-mon[31636]: pgmap v20674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:06 smithi170 ceph-mon[31212]: pgmap v20674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:06 smithi077 ceph-mon[27902]: pgmap v20674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38599.114085 secs 2024-04-21T21:08:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:08 smithi191 ceph-mon[31636]: pgmap v20675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38599.114085 secs 2024-04-21T21:08:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:08 smithi170 ceph-mon[31212]: pgmap v20675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38599.114085 secs 2024-04-21T21:08:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:08 smithi077 ceph-mon[27902]: pgmap v20675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38600.868833 secs 2024-04-21T21:08:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:10 smithi191 ceph-mon[31636]: pgmap v20676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:10.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:10 smithi191 ceph-mon[31636]: osdmap e1365: 12 total, 12 up, 12 in 2024-04-21T21:08:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38600.868833 secs 2024-04-21T21:08:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:10 smithi170 ceph-mon[31212]: pgmap v20676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:10 smithi170 ceph-mon[31212]: osdmap e1365: 12 total, 12 up, 12 in 2024-04-21T21:08:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38600.868833 secs 2024-04-21T21:08:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:10 smithi077 ceph-mon[27902]: pgmap v20676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:08:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:10 smithi077 ceph-mon[27902]: osdmap e1365: 12 total, 12 up, 12 in 2024-04-21T21:08:12.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:12 smithi191 ceph-mon[31636]: pgmap v20678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:08:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:12 smithi170 ceph-mon[31212]: pgmap v20678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:08:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:12 smithi077 ceph-mon[27902]: pgmap v20678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:08:13.710 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38604.114199 secs 2024-04-21T21:08:13.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38604.114199 secs 2024-04-21T21:08:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38604.114199 secs 2024-04-21T21:08:14.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:14 smithi191 ceph-mon[31636]: pgmap v20679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:08:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:14 smithi170 ceph-mon[31212]: pgmap v20679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:08:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:14 smithi077 ceph-mon[27902]: pgmap v20679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:08:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:15.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38605.868949 secs 2024-04-21T21:08:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38605.868949 secs 2024-04-21T21:08:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38605.868949 secs 2024-04-21T21:08:16.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:16 smithi191 ceph-mon[31636]: pgmap v20680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:16 smithi170 ceph-mon[31212]: pgmap v20680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:16 smithi077 ceph-mon[27902]: pgmap v20680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:18.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38609.114286 secs 2024-04-21T21:08:18.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:18 smithi191 ceph-mon[31636]: pgmap v20681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38609.114286 secs 2024-04-21T21:08:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:18 smithi170 ceph-mon[31212]: pgmap v20681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38609.114286 secs 2024-04-21T21:08:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:18 smithi077 ceph-mon[27902]: pgmap v20681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38610.869027 secs 2024-04-21T21:08:20.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:20 smithi191 ceph-mon[31636]: pgmap v20682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38610.869027 secs 2024-04-21T21:08:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:20 smithi170 ceph-mon[31212]: pgmap v20682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38610.869027 secs 2024-04-21T21:08:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:20 smithi077 ceph-mon[27902]: pgmap v20682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:08:22.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:22 smithi191 ceph-mon[31636]: pgmap v20683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:08:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:22 smithi170 ceph-mon[31212]: pgmap v20683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:08:22.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:22 smithi077 ceph-mon[27902]: pgmap v20683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:08:23.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38614.114404 secs 2024-04-21T21:08:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38614.114404 secs 2024-04-21T21:08:23.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38614.114404 secs 2024-04-21T21:08:24.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:24 smithi191 ceph-mon[31636]: pgmap v20684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:24 smithi170 ceph-mon[31212]: pgmap v20684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:24 smithi077 ceph-mon[27902]: pgmap v20684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:25.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38615.869141 secs 2024-04-21T21:08:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38615.869141 secs 2024-04-21T21:08:25.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38615.869141 secs 2024-04-21T21:08:26.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:26 smithi191 ceph-mon[31636]: pgmap v20685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:26 smithi170 ceph-mon[31212]: pgmap v20685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:26.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:26 smithi077 ceph-mon[27902]: pgmap v20685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38619.114523 secs 2024-04-21T21:08:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:28 smithi170 ceph-mon[31212]: pgmap v20686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38619.114523 secs 2024-04-21T21:08:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:28 smithi077 ceph-mon[27902]: pgmap v20686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38619.114523 secs 2024-04-21T21:08:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:28 smithi191 ceph-mon[31636]: pgmap v20686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38620.869243 secs 2024-04-21T21:08:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:30 smithi170 ceph-mon[31212]: pgmap v20687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38620.869243 secs 2024-04-21T21:08:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:30 smithi077 ceph-mon[27902]: pgmap v20687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38620.869243 secs 2024-04-21T21:08:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:30 smithi191 ceph-mon[31636]: pgmap v20687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:32 smithi170 ceph-mon[31212]: pgmap v20688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:08:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:32 smithi077 ceph-mon[27902]: pgmap v20688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:32.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:08:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:32 smithi191 ceph-mon[31636]: pgmap v20688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:08:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38624.114608 secs 2024-04-21T21:08:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:08:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:08:33.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:08:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38624.114608 secs 2024-04-21T21:08:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:08:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:08:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:08:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38624.114608 secs 2024-04-21T21:08:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:08:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:08:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:08:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:34 smithi170 ceph-mon[31212]: pgmap v20689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:34.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:34 smithi077 ceph-mon[27902]: pgmap v20689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:34 smithi191 ceph-mon[31636]: pgmap v20689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38625.869379 secs 2024-04-21T21:08:35.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38625.869379 secs 2024-04-21T21:08:35.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38625.869379 secs 2024-04-21T21:08:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:36 smithi170 ceph-mon[31212]: pgmap v20690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:36.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:36 smithi077 ceph-mon[27902]: pgmap v20690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:36 smithi191 ceph-mon[31636]: pgmap v20690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38629.114771 secs 2024-04-21T21:08:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:38 smithi170 ceph-mon[31212]: pgmap v20691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38629.114771 secs 2024-04-21T21:08:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:38 smithi077 ceph-mon[27902]: pgmap v20691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38629.114771 secs 2024-04-21T21:08:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:38 smithi191 ceph-mon[31636]: pgmap v20691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38630.869516 secs 2024-04-21T21:08:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:40 smithi170 ceph-mon[31212]: pgmap v20692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38630.869516 secs 2024-04-21T21:08:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:40 smithi077 ceph-mon[27902]: pgmap v20692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38630.869516 secs 2024-04-21T21:08:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:40 smithi191 ceph-mon[31636]: pgmap v20692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:42 smithi170 ceph-mon[31212]: pgmap v20693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:42.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:42 smithi077 ceph-mon[27902]: pgmap v20693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:42 smithi191 ceph-mon[31636]: pgmap v20693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38634.114887 secs 2024-04-21T21:08:43.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38634.114887 secs 2024-04-21T21:08:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38634.114887 secs 2024-04-21T21:08:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:44 smithi170 ceph-mon[31212]: pgmap v20694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:44.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:44 smithi191 ceph-mon[31636]: pgmap v20694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:44 smithi077 ceph-mon[27902]: pgmap v20694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38635.869635 secs 2024-04-21T21:08:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38635.869635 secs 2024-04-21T21:08:45.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38635.869635 secs 2024-04-21T21:08:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:46 smithi170 ceph-mon[31212]: pgmap v20695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:46.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:46 smithi077 ceph-mon[27902]: pgmap v20695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:46.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:46 smithi191 ceph-mon[31636]: pgmap v20695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38639.115010 secs 2024-04-21T21:08:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:48 smithi170 ceph-mon[31212]: pgmap v20696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38639.115010 secs 2024-04-21T21:08:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:48 smithi077 ceph-mon[27902]: pgmap v20696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:48.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38639.115010 secs 2024-04-21T21:08:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:48 smithi191 ceph-mon[31636]: pgmap v20696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38640.869752 secs 2024-04-21T21:08:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:50 smithi170 ceph-mon[31212]: pgmap v20697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38640.869752 secs 2024-04-21T21:08:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:50 smithi077 ceph-mon[27902]: pgmap v20697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38640.869752 secs 2024-04-21T21:08:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:50 smithi191 ceph-mon[31636]: pgmap v20697: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:52.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:52 smithi077 ceph-mon[27902]: pgmap v20698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:52 smithi191 ceph-mon[31636]: pgmap v20698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:52 smithi170 ceph-mon[31212]: pgmap v20698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:53.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38644.115124 secs 2024-04-21T21:08:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38644.115124 secs 2024-04-21T21:08:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38644.115124 secs 2024-04-21T21:08:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:54 smithi077 ceph-mon[27902]: pgmap v20699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:54 smithi191 ceph-mon[31636]: pgmap v20699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:54 smithi170 ceph-mon[31212]: pgmap v20699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:08:55.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38645.869888 secs 2024-04-21T21:08:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38645.869888 secs 2024-04-21T21:08:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38645.869888 secs 2024-04-21T21:08:56.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:56 smithi077 ceph-mon[27902]: pgmap v20700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:56.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:56 smithi191 ceph-mon[31636]: pgmap v20700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:56 smithi170 ceph-mon[31212]: pgmap v20700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:08:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38649.115243 secs 2024-04-21T21:08:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:08:58 smithi077 ceph-mon[27902]: pgmap v20701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38649.115243 secs 2024-04-21T21:08:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:08:58 smithi191 ceph-mon[31636]: pgmap v20701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:08:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38649.115243 secs 2024-04-21T21:08:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:08:58 smithi170 ceph-mon[31212]: pgmap v20701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:00.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38650.870008 secs 2024-04-21T21:09:00.889 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:00 smithi077 ceph-mon[27902]: pgmap v20702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38650.870008 secs 2024-04-21T21:09:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:00 smithi191 ceph-mon[31636]: pgmap v20702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38650.870008 secs 2024-04-21T21:09:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:00 smithi170 ceph-mon[31212]: pgmap v20702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:02 smithi077 ceph-mon[27902]: pgmap v20703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T21:09:02.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:02 smithi191 ceph-mon[31636]: pgmap v20703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T21:09:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:02 smithi170 ceph-mon[31212]: pgmap v20703: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T21:09:03.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38654.115403 secs 2024-04-21T21:09:03.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38654.115403 secs 2024-04-21T21:09:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38654.115403 secs 2024-04-21T21:09:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:04 smithi077 ceph-mon[27902]: pgmap v20704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:09:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:04 smithi191 ceph-mon[31636]: pgmap v20704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:09:05.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:04 smithi170 ceph-mon[31212]: pgmap v20704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:09:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38655.870124 secs 2024-04-21T21:09:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:05 smithi077 ceph-mon[27902]: osdmap e1366: 12 total, 12 up, 12 in 2024-04-21T21:09:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38655.870124 secs 2024-04-21T21:09:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:05 smithi191 ceph-mon[31636]: osdmap e1366: 12 total, 12 up, 12 in 2024-04-21T21:09:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38655.870124 secs 2024-04-21T21:09:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:05 smithi170 ceph-mon[31212]: osdmap e1366: 12 total, 12 up, 12 in 2024-04-21T21:09:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:06 smithi077 ceph-mon[27902]: pgmap v20706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:06.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:06 smithi191 ceph-mon[31636]: pgmap v20706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:06 smithi170 ceph-mon[31212]: pgmap v20706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38659.115527 secs 2024-04-21T21:09:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:08 smithi077 ceph-mon[27902]: pgmap v20707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38659.115527 secs 2024-04-21T21:09:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:08 smithi191 ceph-mon[31636]: pgmap v20707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38659.115527 secs 2024-04-21T21:09:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:08 smithi170 ceph-mon[31212]: pgmap v20707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38660.870272 secs 2024-04-21T21:09:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:10 smithi077 ceph-mon[27902]: pgmap v20708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:10 smithi077 ceph-mon[27902]: osdmap e1367: 12 total, 12 up, 12 in 2024-04-21T21:09:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38660.870272 secs 2024-04-21T21:09:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:10 smithi191 ceph-mon[31636]: pgmap v20708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:10 smithi191 ceph-mon[31636]: osdmap e1367: 12 total, 12 up, 12 in 2024-04-21T21:09:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38660.870272 secs 2024-04-21T21:09:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:10 smithi170 ceph-mon[31212]: pgmap v20708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:09:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:10 smithi170 ceph-mon[31212]: osdmap e1367: 12 total, 12 up, 12 in 2024-04-21T21:09:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:12 smithi077 ceph-mon[27902]: pgmap v20710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T21:09:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:12 smithi191 ceph-mon[31636]: pgmap v20710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T21:09:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:12 smithi170 ceph-mon[31212]: pgmap v20710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T21:09:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38664.115653 secs 2024-04-21T21:09:13.961 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38664.115653 secs 2024-04-21T21:09:13.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38664.115653 secs 2024-04-21T21:09:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:14 smithi191 ceph-mon[31636]: pgmap v20711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-21T21:09:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:14 smithi077 ceph-mon[27902]: pgmap v20711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-21T21:09:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:14 smithi170 ceph-mon[31212]: pgmap v20711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-21T21:09:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38665.870411 secs 2024-04-21T21:09:15.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38665.870411 secs 2024-04-21T21:09:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38665.870411 secs 2024-04-21T21:09:16.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:16 smithi077 ceph-mon[27902]: pgmap v20712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:16.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:16 smithi191 ceph-mon[31636]: pgmap v20712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:17.061 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:16 smithi170 ceph-mon[31212]: pgmap v20712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38669.115798 secs 2024-04-21T21:09:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:18 smithi077 ceph-mon[27902]: pgmap v20713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38669.115798 secs 2024-04-21T21:09:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:18 smithi191 ceph-mon[31636]: pgmap v20713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38669.115798 secs 2024-04-21T21:09:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:18 smithi170 ceph-mon[31212]: pgmap v20713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38670.870537 secs 2024-04-21T21:09:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:20 smithi191 ceph-mon[31636]: pgmap v20714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38670.870537 secs 2024-04-21T21:09:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:20 smithi170 ceph-mon[31212]: pgmap v20714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38670.870537 secs 2024-04-21T21:09:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:20 smithi077 ceph-mon[27902]: pgmap v20714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:09:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:22 smithi191 ceph-mon[31636]: pgmap v20715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:09:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:22 smithi170 ceph-mon[31212]: pgmap v20715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:09:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:22 smithi077 ceph-mon[27902]: pgmap v20715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:09:23.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38674.115913 secs 2024-04-21T21:09:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38674.115913 secs 2024-04-21T21:09:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38674.115913 secs 2024-04-21T21:09:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:24 smithi191 ceph-mon[31636]: pgmap v20716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:24 smithi170 ceph-mon[31212]: pgmap v20716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:24 smithi077 ceph-mon[27902]: pgmap v20716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38675.870679 secs 2024-04-21T21:09:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38675.870679 secs 2024-04-21T21:09:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38675.870679 secs 2024-04-21T21:09:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:26 smithi191 ceph-mon[31636]: pgmap v20717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:26 smithi170 ceph-mon[31212]: pgmap v20717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:26 smithi077 ceph-mon[27902]: pgmap v20717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38679.116051 secs 2024-04-21T21:09:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:28 smithi191 ceph-mon[31636]: pgmap v20718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38679.116051 secs 2024-04-21T21:09:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:28 smithi170 ceph-mon[31212]: pgmap v20718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38679.116051 secs 2024-04-21T21:09:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:28 smithi077 ceph-mon[27902]: pgmap v20718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:30.940 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38680.870801 secs 2024-04-21T21:09:30.940 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:30 smithi077 ceph-mon[27902]: pgmap v20719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38680.870801 secs 2024-04-21T21:09:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:30 smithi191 ceph-mon[31636]: pgmap v20719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38680.870801 secs 2024-04-21T21:09:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:30 smithi170 ceph-mon[31212]: pgmap v20719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:32 smithi191 ceph-mon[31636]: pgmap v20720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:09:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:32 smithi170 ceph-mon[31212]: pgmap v20720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:09:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:32 smithi077 ceph-mon[27902]: pgmap v20720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:09:33.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38684.116180 secs 2024-04-21T21:09:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:09:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:09:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:09:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38684.116180 secs 2024-04-21T21:09:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:09:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:09:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:09:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38684.116180 secs 2024-04-21T21:09:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:09:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:09:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:09:34.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:34 smithi191 ceph-mon[31636]: pgmap v20721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:34 smithi170 ceph-mon[31212]: pgmap v20721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:34 smithi077 ceph-mon[27902]: pgmap v20721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:35.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38685.870922 secs 2024-04-21T21:09:36.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38685.870922 secs 2024-04-21T21:09:36.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38685.870922 secs 2024-04-21T21:09:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:36 smithi191 ceph-mon[31636]: pgmap v20722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:36 smithi170 ceph-mon[31212]: pgmap v20722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:37.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:36 smithi077 ceph-mon[27902]: pgmap v20722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38689.116255 secs 2024-04-21T21:09:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:38 smithi191 ceph-mon[31636]: pgmap v20723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38689.116255 secs 2024-04-21T21:09:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:38 smithi170 ceph-mon[31212]: pgmap v20723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38689.116255 secs 2024-04-21T21:09:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:38 smithi077 ceph-mon[27902]: pgmap v20723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38690.871001 secs 2024-04-21T21:09:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:40 smithi191 ceph-mon[31636]: pgmap v20724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38690.871001 secs 2024-04-21T21:09:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:40 smithi170 ceph-mon[31212]: pgmap v20724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38690.871001 secs 2024-04-21T21:09:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:40 smithi077 ceph-mon[27902]: pgmap v20724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:42 smithi191 ceph-mon[31636]: pgmap v20725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:42 smithi170 ceph-mon[31212]: pgmap v20725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:42 smithi077 ceph-mon[27902]: pgmap v20725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:43.960 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38694.116396 secs 2024-04-21T21:09:43.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38694.116396 secs 2024-04-21T21:09:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38694.116396 secs 2024-04-21T21:09:44.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:44 smithi191 ceph-mon[31636]: pgmap v20726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:44 smithi170 ceph-mon[31212]: pgmap v20726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:44 smithi077 ceph-mon[27902]: pgmap v20726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:09:45.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38695.871111 secs 2024-04-21T21:09:46.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38695.871111 secs 2024-04-21T21:09:46.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38695.871111 secs 2024-04-21T21:09:46.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:46 smithi191 ceph-mon[31636]: pgmap v20727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:46 smithi170 ceph-mon[31212]: pgmap v20727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:46 smithi077 ceph-mon[27902]: pgmap v20727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38699.116514 secs 2024-04-21T21:09:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:48 smithi191 ceph-mon[31636]: pgmap v20728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38699.116514 secs 2024-04-21T21:09:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:48 smithi170 ceph-mon[31212]: pgmap v20728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38699.116514 secs 2024-04-21T21:09:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:48 smithi077 ceph-mon[27902]: pgmap v20728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38700.871230 secs 2024-04-21T21:09:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:50 smithi191 ceph-mon[31636]: pgmap v20729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38700.871230 secs 2024-04-21T21:09:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:50 smithi170 ceph-mon[31212]: pgmap v20729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38700.871230 secs 2024-04-21T21:09:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:50 smithi077 ceph-mon[27902]: pgmap v20729: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:52.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:52 smithi191 ceph-mon[31636]: pgmap v20730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:52 smithi170 ceph-mon[31212]: pgmap v20730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:52 smithi077 ceph-mon[27902]: pgmap v20730: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:53.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38704.116579 secs 2024-04-21T21:09:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38704.116579 secs 2024-04-21T21:09:54.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38704.116579 secs 2024-04-21T21:09:54.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:54 smithi191 ceph-mon[31636]: pgmap v20731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:54 smithi170 ceph-mon[31212]: pgmap v20731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:09:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:54 smithi077 ceph-mon[27902]: pgmap v20731: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38705.871341 secs 2024-04-21T21:09:56.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38705.871341 secs 2024-04-21T21:09:56.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38705.871341 secs 2024-04-21T21:09:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:56 smithi170 ceph-mon[31212]: pgmap v20732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:57.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:56 smithi077 ceph-mon[27902]: pgmap v20732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:57.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:56 smithi191 ceph-mon[31636]: pgmap v20732: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:09:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38709.116690 secs 2024-04-21T21:09:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:09:58 smithi170 ceph-mon[31212]: pgmap v20733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38709.116690 secs 2024-04-21T21:09:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:09:58 smithi077 ceph-mon[27902]: pgmap v20733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:09:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38709.116690 secs 2024-04-21T21:09:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:09:58 smithi191 ceph-mon[31636]: pgmap v20733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38710.871414 secs 2024-04-21T21:10:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:00 smithi170 ceph-mon[31212]: pgmap v20734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:01.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:10:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38710.871414 secs 2024-04-21T21:10:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:00 smithi077 ceph-mon[27902]: pgmap v20734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:10:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38710.871414 secs 2024-04-21T21:10:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:00 smithi191 ceph-mon[31636]: pgmap v20734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:10:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:02 smithi170 ceph-mon[31212]: pgmap v20735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:02 smithi077 ceph-mon[27902]: pgmap v20735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:02 smithi191 ceph-mon[31636]: pgmap v20735: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38714.116829 secs 2024-04-21T21:10:04.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38714.116829 secs 2024-04-21T21:10:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38714.116829 secs 2024-04-21T21:10:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:04 smithi170 ceph-mon[31212]: pgmap v20736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:05.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:05.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:04 smithi077 ceph-mon[27902]: pgmap v20736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:04 smithi191 ceph-mon[31636]: pgmap v20736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38715.871549 secs 2024-04-21T21:10:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:05 smithi170 ceph-mon[31212]: osdmap e1368: 12 total, 12 up, 12 in 2024-04-21T21:10:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38715.871549 secs 2024-04-21T21:10:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:05 smithi077 ceph-mon[27902]: osdmap e1368: 12 total, 12 up, 12 in 2024-04-21T21:10:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38715.871549 secs 2024-04-21T21:10:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:05 smithi191 ceph-mon[31636]: osdmap e1368: 12 total, 12 up, 12 in 2024-04-21T21:10:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:06 smithi170 ceph-mon[31212]: pgmap v20738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:07.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:06 smithi077 ceph-mon[27902]: pgmap v20738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:07.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:06 smithi191 ceph-mon[31636]: pgmap v20738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38719.116920 secs 2024-04-21T21:10:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:08 smithi170 ceph-mon[31212]: pgmap v20739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38719.116920 secs 2024-04-21T21:10:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:08 smithi077 ceph-mon[27902]: pgmap v20739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38719.116920 secs 2024-04-21T21:10:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:08 smithi191 ceph-mon[31636]: pgmap v20739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38720.871698 secs 2024-04-21T21:10:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:10 smithi170 ceph-mon[31212]: pgmap v20740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38720.871698 secs 2024-04-21T21:10:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:10 smithi077 ceph-mon[27902]: pgmap v20740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38720.871698 secs 2024-04-21T21:10:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:10 smithi191 ceph-mon[31636]: pgmap v20740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:10:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:12 smithi170 ceph-mon[31212]: pgmap v20741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:10:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:12 smithi077 ceph-mon[27902]: pgmap v20741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:10:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:12 smithi191 ceph-mon[31636]: pgmap v20741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:10:14.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38724.117047 secs 2024-04-21T21:10:14.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38724.117047 secs 2024-04-21T21:10:14.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38724.117047 secs 2024-04-21T21:10:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:14 smithi170 ceph-mon[31212]: pgmap v20742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:10:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:14 smithi077 ceph-mon[27902]: pgmap v20742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:10:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:14 smithi191 ceph-mon[31636]: pgmap v20742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:10:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38725.871816 secs 2024-04-21T21:10:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:15 smithi170 ceph-mon[31212]: osdmap e1369: 12 total, 12 up, 12 in 2024-04-21T21:10:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38725.871816 secs 2024-04-21T21:10:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:15 smithi077 ceph-mon[27902]: osdmap e1369: 12 total, 12 up, 12 in 2024-04-21T21:10:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38725.871816 secs 2024-04-21T21:10:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:15 smithi191 ceph-mon[31636]: osdmap e1369: 12 total, 12 up, 12 in 2024-04-21T21:10:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:16 smithi170 ceph-mon[31212]: pgmap v20744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:16 smithi077 ceph-mon[27902]: pgmap v20744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:17.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:16 smithi191 ceph-mon[31636]: pgmap v20744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38729.117183 secs 2024-04-21T21:10:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:18 smithi170 ceph-mon[31212]: pgmap v20745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38729.117183 secs 2024-04-21T21:10:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:18 smithi077 ceph-mon[27902]: pgmap v20745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38729.117183 secs 2024-04-21T21:10:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:18 smithi191 ceph-mon[31636]: pgmap v20745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38730.871929 secs 2024-04-21T21:10:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:20 smithi170 ceph-mon[31212]: pgmap v20746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38730.871929 secs 2024-04-21T21:10:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:20 smithi077 ceph-mon[27902]: pgmap v20746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38730.871929 secs 2024-04-21T21:10:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:20 smithi191 ceph-mon[31636]: pgmap v20746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:10:23.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:22 smithi170 ceph-mon[31212]: pgmap v20747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:10:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:22 smithi077 ceph-mon[27902]: pgmap v20747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:10:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:22 smithi191 ceph-mon[31636]: pgmap v20747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:10:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38734.117311 secs 2024-04-21T21:10:24.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38734.117311 secs 2024-04-21T21:10:24.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38734.117311 secs 2024-04-21T21:10:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:24 smithi170 ceph-mon[31212]: pgmap v20748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:10:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:24 smithi077 ceph-mon[27902]: pgmap v20748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:10:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:24 smithi191 ceph-mon[31636]: pgmap v20748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:10:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38735.872045 secs 2024-04-21T21:10:26.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38735.872045 secs 2024-04-21T21:10:26.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38735.872045 secs 2024-04-21T21:10:27.063 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:26 smithi170 ceph-mon[31212]: pgmap v20749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:10:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:26 smithi077 ceph-mon[27902]: pgmap v20749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:10:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:26 smithi191 ceph-mon[31636]: pgmap v20749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:10:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38739.117427 secs 2024-04-21T21:10:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:28 smithi170 ceph-mon[31212]: pgmap v20750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38739.117427 secs 2024-04-21T21:10:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:28 smithi077 ceph-mon[27902]: pgmap v20750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38739.117427 secs 2024-04-21T21:10:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:28 smithi191 ceph-mon[31636]: pgmap v20750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38740.872122 secs 2024-04-21T21:10:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:30 smithi170 ceph-mon[31212]: pgmap v20751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38740.872122 secs 2024-04-21T21:10:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:30 smithi077 ceph-mon[27902]: pgmap v20751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38740.872122 secs 2024-04-21T21:10:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:30 smithi191 ceph-mon[31636]: pgmap v20751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:32 smithi077 ceph-mon[27902]: pgmap v20752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:32 smithi191 ceph-mon[31636]: pgmap v20752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:32 smithi170 ceph-mon[31212]: pgmap v20752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38744.117497 secs 2024-04-21T21:10:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:10:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38744.117497 secs 2024-04-21T21:10:34.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:10:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38744.117497 secs 2024-04-21T21:10:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:10:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:34 smithi077 ceph-mon[27902]: pgmap v20753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:10:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:10:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:10:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:34 smithi191 ceph-mon[31636]: pgmap v20753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:10:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:10:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:10:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:34 smithi170 ceph-mon[31212]: pgmap v20753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:35.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:10:35.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:10:35.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:10:36.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38745.872232 secs 2024-04-21T21:10:36.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38745.872232 secs 2024-04-21T21:10:36.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38745.872232 secs 2024-04-21T21:10:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:36 smithi077 ceph-mon[27902]: pgmap v20754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:36 smithi191 ceph-mon[31636]: pgmap v20754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:36 smithi170 ceph-mon[31212]: pgmap v20754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38749.117639 secs 2024-04-21T21:10:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:38 smithi077 ceph-mon[27902]: pgmap v20755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38749.117639 secs 2024-04-21T21:10:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:38 smithi191 ceph-mon[31636]: pgmap v20755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38749.117639 secs 2024-04-21T21:10:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:38 smithi170 ceph-mon[31212]: pgmap v20755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38750.872372 secs 2024-04-21T21:10:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:40 smithi077 ceph-mon[27902]: pgmap v20756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38750.872372 secs 2024-04-21T21:10:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:40 smithi191 ceph-mon[31636]: pgmap v20756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38750.872372 secs 2024-04-21T21:10:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:40 smithi170 ceph-mon[31212]: pgmap v20756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:43.111 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:42 smithi170 ceph-mon[31212]: pgmap v20757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:43.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:42 smithi077 ceph-mon[27902]: pgmap v20757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:42 smithi191 ceph-mon[31636]: pgmap v20757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:44.122 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38754.117786 secs 2024-04-21T21:10:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38754.117786 secs 2024-04-21T21:10:44.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38754.117786 secs 2024-04-21T21:10:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:45.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:44 smithi077 ceph-mon[27902]: pgmap v20758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:45.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:44 smithi191 ceph-mon[31636]: pgmap v20758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:44 smithi170 ceph-mon[31212]: pgmap v20758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:46.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38755.872474 secs 2024-04-21T21:10:46.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38755.872474 secs 2024-04-21T21:10:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38755.872474 secs 2024-04-21T21:10:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:46 smithi077 ceph-mon[27902]: pgmap v20759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:47.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:46 smithi191 ceph-mon[31636]: pgmap v20759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:47.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:46 smithi170 ceph-mon[31212]: pgmap v20759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38759.117908 secs 2024-04-21T21:10:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:48 smithi077 ceph-mon[27902]: pgmap v20760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38759.117908 secs 2024-04-21T21:10:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:48 smithi191 ceph-mon[31636]: pgmap v20760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:49.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38759.117908 secs 2024-04-21T21:10:49.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:48 smithi170 ceph-mon[31212]: pgmap v20760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38760.872599 secs 2024-04-21T21:10:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:50 smithi077 ceph-mon[27902]: pgmap v20761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38760.872599 secs 2024-04-21T21:10:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:50 smithi191 ceph-mon[31636]: pgmap v20761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38760.872599 secs 2024-04-21T21:10:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:50 smithi170 ceph-mon[31212]: pgmap v20761: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:52 smithi077 ceph-mon[27902]: pgmap v20762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:53.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:52 smithi191 ceph-mon[31636]: pgmap v20762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:53.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:52 smithi170 ceph-mon[31212]: pgmap v20762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:54.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38764.117985 secs 2024-04-21T21:10:54.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38764.117985 secs 2024-04-21T21:10:54.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38764.117985 secs 2024-04-21T21:10:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:10:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:54 smithi077 ceph-mon[27902]: pgmap v20763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:54 smithi191 ceph-mon[31636]: pgmap v20763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:54 smithi170 ceph-mon[31212]: pgmap v20763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:56.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38765.872722 secs 2024-04-21T21:10:56.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38765.872722 secs 2024-04-21T21:10:56.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38765.872722 secs 2024-04-21T21:10:57.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:56 smithi077 ceph-mon[27902]: pgmap v20764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:57.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:56 smithi191 ceph-mon[31636]: pgmap v20764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:57.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:56 smithi170 ceph-mon[31212]: pgmap v20764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:10:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38769.118095 secs 2024-04-21T21:10:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:10:58 smithi077 ceph-mon[27902]: pgmap v20765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38769.118095 secs 2024-04-21T21:10:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:10:58 smithi191 ceph-mon[31636]: pgmap v20765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:59.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38769.118095 secs 2024-04-21T21:10:59.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:10:58 smithi170 ceph-mon[31212]: pgmap v20765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:10:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:10:59.716+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:10:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:10:59.716+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:10:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:10:59.717+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:10:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:10:59.717+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:11:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38770.872869 secs 2024-04-21T21:11:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:00 smithi191 ceph-mon[31636]: pgmap v20766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:01.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38770.872869 secs 2024-04-21T21:11:01.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:00 smithi170 ceph-mon[31212]: pgmap v20766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:01.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38770.872869 secs 2024-04-21T21:11:01.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:00 smithi077 ceph-mon[27902]: pgmap v20766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:02 smithi191 ceph-mon[31636]: pgmap v20767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:02 smithi170 ceph-mon[31212]: pgmap v20767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:03.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:02 smithi077 ceph-mon[27902]: pgmap v20767: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38774.118243 secs 2024-04-21T21:11:04.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38774.118243 secs 2024-04-21T21:11:04.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38774.118243 secs 2024-04-21T21:11:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:05.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:04 smithi191 ceph-mon[31636]: pgmap v20768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:04 smithi170 ceph-mon[31212]: pgmap v20768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:05.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:04 smithi077 ceph-mon[27902]: pgmap v20768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38775.872965 secs 2024-04-21T21:11:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:05 smithi191 ceph-mon[31636]: osdmap e1370: 12 total, 12 up, 12 in 2024-04-21T21:11:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38775.872965 secs 2024-04-21T21:11:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:05 smithi170 ceph-mon[31212]: osdmap e1370: 12 total, 12 up, 12 in 2024-04-21T21:11:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38775.872965 secs 2024-04-21T21:11:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:05 smithi077 ceph-mon[27902]: osdmap e1370: 12 total, 12 up, 12 in 2024-04-21T21:11:07.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:06 smithi191 ceph-mon[31636]: pgmap v20770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:07.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:06 smithi170 ceph-mon[31212]: pgmap v20770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:07.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:06 smithi077 ceph-mon[27902]: pgmap v20770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38779.118383 secs 2024-04-21T21:11:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:08 smithi191 ceph-mon[31636]: pgmap v20771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:09.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38779.118383 secs 2024-04-21T21:11:09.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:08 smithi170 ceph-mon[31212]: pgmap v20771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:09.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38779.118383 secs 2024-04-21T21:11:09.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:08 smithi077 ceph-mon[27902]: pgmap v20771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38780.873045 secs 2024-04-21T21:11:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:10 smithi191 ceph-mon[31636]: pgmap v20772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38780.873045 secs 2024-04-21T21:11:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:10 smithi170 ceph-mon[31212]: pgmap v20772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:11.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38780.873045 secs 2024-04-21T21:11:11.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:10 smithi077 ceph-mon[27902]: pgmap v20772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:11:13.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:12 smithi191 ceph-mon[31636]: pgmap v20773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:11:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:12 smithi170 ceph-mon[31212]: pgmap v20773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:11:13.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:12 smithi077 ceph-mon[27902]: pgmap v20773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:11:14.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38784.118479 secs 2024-04-21T21:11:14.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38784.118479 secs 2024-04-21T21:11:14.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38784.118479 secs 2024-04-21T21:11:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:14 smithi191 ceph-mon[31636]: pgmap v20774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:11:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:14 smithi170 ceph-mon[31212]: pgmap v20774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:11:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:14 smithi077 ceph-mon[27902]: pgmap v20774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:11:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38785.873162 secs 2024-04-21T21:11:16.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:15 smithi191 ceph-mon[31636]: osdmap e1371: 12 total, 12 up, 12 in 2024-04-21T21:11:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38785.873162 secs 2024-04-21T21:11:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:15 smithi170 ceph-mon[31212]: osdmap e1371: 12 total, 12 up, 12 in 2024-04-21T21:11:16.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38785.873162 secs 2024-04-21T21:11:16.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:15 smithi077 ceph-mon[27902]: osdmap e1371: 12 total, 12 up, 12 in 2024-04-21T21:11:17.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:16 smithi191 ceph-mon[31636]: pgmap v20776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:17.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:16 smithi170 ceph-mon[31212]: pgmap v20776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:17.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:16 smithi077 ceph-mon[27902]: pgmap v20776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38789.118629 secs 2024-04-21T21:11:19.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:18 smithi191 ceph-mon[31636]: pgmap v20777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:19.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38789.118629 secs 2024-04-21T21:11:19.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:18 smithi170 ceph-mon[31212]: pgmap v20777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:19.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38789.118629 secs 2024-04-21T21:11:19.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:18 smithi077 ceph-mon[27902]: pgmap v20777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38790.873277 secs 2024-04-21T21:11:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:20 smithi191 ceph-mon[31636]: pgmap v20778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38790.873277 secs 2024-04-21T21:11:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:20 smithi170 ceph-mon[31212]: pgmap v20778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:21.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38790.873277 secs 2024-04-21T21:11:21.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:20 smithi077 ceph-mon[27902]: pgmap v20778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:11:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:22 smithi191 ceph-mon[31636]: pgmap v20779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:11:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:22 smithi170 ceph-mon[31212]: pgmap v20779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:11:23.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:22 smithi077 ceph-mon[27902]: pgmap v20779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:11:24.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38794.118743 secs 2024-04-21T21:11:24.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38794.118743 secs 2024-04-21T21:11:24.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38794.118743 secs 2024-04-21T21:11:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:24 smithi191 ceph-mon[31636]: pgmap v20780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:11:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:24 smithi170 ceph-mon[31212]: pgmap v20780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:11:25.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:24 smithi077 ceph-mon[27902]: pgmap v20780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:11:26.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38795.873389 secs 2024-04-21T21:11:26.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38795.873389 secs 2024-04-21T21:11:26.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38795.873389 secs 2024-04-21T21:11:27.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:26 smithi191 ceph-mon[31636]: pgmap v20781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:11:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:26 smithi170 ceph-mon[31212]: pgmap v20781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:11:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:26 smithi077 ceph-mon[27902]: pgmap v20781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:11:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38799.118861 secs 2024-04-21T21:11:29.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:28 smithi191 ceph-mon[31636]: pgmap v20782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38799.118861 secs 2024-04-21T21:11:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:28 smithi170 ceph-mon[31212]: pgmap v20782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:29.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38799.118861 secs 2024-04-21T21:11:29.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:28 smithi077 ceph-mon[27902]: pgmap v20782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38800.873502 secs 2024-04-21T21:11:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:30 smithi191 ceph-mon[31636]: pgmap v20783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38800.873502 secs 2024-04-21T21:11:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:30 smithi170 ceph-mon[31212]: pgmap v20783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:31.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38800.873502 secs 2024-04-21T21:11:31.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:30 smithi077 ceph-mon[27902]: pgmap v20783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:32 smithi191 ceph-mon[31636]: pgmap v20784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:32 smithi170 ceph-mon[31212]: pgmap v20784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:33.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:32 smithi077 ceph-mon[27902]: pgmap v20784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:34.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38804.118973 secs 2024-04-21T21:11:34.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38804.118973 secs 2024-04-21T21:11:34.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38804.118973 secs 2024-04-21T21:11:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:34 smithi191 ceph-mon[31636]: pgmap v20785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:11:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:11:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:11:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:11:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:34 smithi170 ceph-mon[31212]: pgmap v20785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:11:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:11:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:11:35.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:11:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:34 smithi077 ceph-mon[27902]: pgmap v20785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:11:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:11:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:11:35.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:11:36.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38805.873621 secs 2024-04-21T21:11:36.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38805.873621 secs 2024-04-21T21:11:36.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38805.873621 secs 2024-04-21T21:11:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:36 smithi191 ceph-mon[31636]: pgmap v20786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:36 smithi170 ceph-mon[31212]: pgmap v20786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:37.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:36 smithi077 ceph-mon[27902]: pgmap v20786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38809.119089 secs 2024-04-21T21:11:39.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:38 smithi191 ceph-mon[31636]: pgmap v20787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:39.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38809.119089 secs 2024-04-21T21:11:39.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:38 smithi170 ceph-mon[31212]: pgmap v20787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:39.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38809.119089 secs 2024-04-21T21:11:39.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:38 smithi077 ceph-mon[27902]: pgmap v20787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 38995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38810.873743 secs 2024-04-21T21:11:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:40 smithi170 ceph-mon[31212]: pgmap v20788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38810.873743 secs 2024-04-21T21:11:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:40 smithi077 ceph-mon[27902]: pgmap v20788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38810.873743 secs 2024-04-21T21:11:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:40 smithi191 ceph-mon[31636]: pgmap v20788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:42.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:42 smithi191 ceph-mon[31636]: pgmap v20789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:42 smithi170 ceph-mon[31212]: pgmap v20789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:42.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:42 smithi077 ceph-mon[27902]: pgmap v20789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:43.711 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38814.119206 secs 2024-04-21T21:11:43.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38814.119206 secs 2024-04-21T21:11:43.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38814.119206 secs 2024-04-21T21:11:44.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:44 smithi191 ceph-mon[31636]: pgmap v20790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:44 smithi170 ceph-mon[31212]: pgmap v20790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:44.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:44 smithi077 ceph-mon[27902]: pgmap v20790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:45.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38815.873879 secs 2024-04-21T21:11:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38815.873879 secs 2024-04-21T21:11:45.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38815.873879 secs 2024-04-21T21:11:46.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:46 smithi191 ceph-mon[31636]: pgmap v20791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:46.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:46 smithi170 ceph-mon[31212]: pgmap v20791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:46.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:46 smithi077 ceph-mon[27902]: pgmap v20791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38819.119320 secs 2024-04-21T21:11:48.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:48 smithi191 ceph-mon[31636]: pgmap v20792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38819.119320 secs 2024-04-21T21:11:48.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:48 smithi170 ceph-mon[31212]: pgmap v20792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38819.119320 secs 2024-04-21T21:11:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:48 smithi077 ceph-mon[27902]: pgmap v20792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38820.873941 secs 2024-04-21T21:11:50.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:50 smithi191 ceph-mon[31636]: pgmap v20793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38820.873941 secs 2024-04-21T21:11:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:50 smithi170 ceph-mon[31212]: pgmap v20793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38820.873941 secs 2024-04-21T21:11:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:50 smithi077 ceph-mon[27902]: pgmap v20793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:52.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:52 smithi191 ceph-mon[31636]: pgmap v20794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:52 smithi170 ceph-mon[31212]: pgmap v20794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:52.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:52 smithi077 ceph-mon[27902]: pgmap v20794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:53.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38824.119433 secs 2024-04-21T21:11:53.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38824.119433 secs 2024-04-21T21:11:53.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38824.119433 secs 2024-04-21T21:11:54.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:54 smithi191 ceph-mon[31636]: pgmap v20795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:54.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:54 smithi170 ceph-mon[31212]: pgmap v20795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:54 smithi077 ceph-mon[27902]: pgmap v20795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:11:55.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38825.874002 secs 2024-04-21T21:11:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38825.874002 secs 2024-04-21T21:11:55.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38825.874002 secs 2024-04-21T21:11:56.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:56 smithi191 ceph-mon[31636]: pgmap v20796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:56 smithi170 ceph-mon[31212]: pgmap v20796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:56.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:56 smithi077 ceph-mon[27902]: pgmap v20796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:11:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38829.119550 secs 2024-04-21T21:11:58.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:11:58 smithi191 ceph-mon[31636]: pgmap v20797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38829.119550 secs 2024-04-21T21:11:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:11:58 smithi170 ceph-mon[31212]: pgmap v20797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:11:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38829.119550 secs 2024-04-21T21:11:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:11:58 smithi077 ceph-mon[27902]: pgmap v20797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38830.874109 secs 2024-04-21T21:12:00.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:00 smithi191 ceph-mon[31636]: pgmap v20798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38830.874109 secs 2024-04-21T21:12:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:00 smithi170 ceph-mon[31212]: pgmap v20798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38830.874109 secs 2024-04-21T21:12:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:00 smithi077 ceph-mon[27902]: pgmap v20798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:02.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:02 smithi191 ceph-mon[31636]: pgmap v20799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:02 smithi170 ceph-mon[31212]: pgmap v20799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:02.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:02 smithi077 ceph-mon[27902]: pgmap v20799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:03.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38834.119669 secs 2024-04-21T21:12:03.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38834.119669 secs 2024-04-21T21:12:03.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38834.119669 secs 2024-04-21T21:12:04.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:04 smithi191 ceph-mon[31636]: pgmap v20800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:04.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:04 smithi170 ceph-mon[31212]: pgmap v20800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:04 smithi077 ceph-mon[27902]: pgmap v20800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38835.874181 secs 2024-04-21T21:12:05.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:05 smithi191 ceph-mon[31636]: osdmap e1372: 12 total, 12 up, 12 in 2024-04-21T21:12:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38835.874181 secs 2024-04-21T21:12:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:05 smithi170 ceph-mon[31212]: osdmap e1372: 12 total, 12 up, 12 in 2024-04-21T21:12:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38835.874181 secs 2024-04-21T21:12:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:05 smithi077 ceph-mon[27902]: osdmap e1372: 12 total, 12 up, 12 in 2024-04-21T21:12:06.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:06 smithi191 ceph-mon[31636]: pgmap v20802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:06 smithi170 ceph-mon[31212]: pgmap v20802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:06.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:06 smithi077 ceph-mon[27902]: pgmap v20802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38839.119795 secs 2024-04-21T21:12:08.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:08 smithi191 ceph-mon[31636]: pgmap v20803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38839.119795 secs 2024-04-21T21:12:08.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:08 smithi170 ceph-mon[31212]: pgmap v20803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38839.119795 secs 2024-04-21T21:12:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:08 smithi077 ceph-mon[27902]: pgmap v20803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38840.874292 secs 2024-04-21T21:12:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:10 smithi170 ceph-mon[31212]: pgmap v20804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:10.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:10 smithi170 ceph-mon[31212]: osdmap e1373: 12 total, 12 up, 12 in 2024-04-21T21:12:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38840.874292 secs 2024-04-21T21:12:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:10 smithi077 ceph-mon[27902]: pgmap v20804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:10 smithi077 ceph-mon[27902]: osdmap e1373: 12 total, 12 up, 12 in 2024-04-21T21:12:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38840.874292 secs 2024-04-21T21:12:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:10 smithi191 ceph-mon[31636]: pgmap v20804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:12:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:10 smithi191 ceph-mon[31636]: osdmap e1373: 12 total, 12 up, 12 in 2024-04-21T21:12:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:12 smithi170 ceph-mon[31212]: pgmap v20806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:12:12.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:12 smithi077 ceph-mon[27902]: pgmap v20806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:12:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:12 smithi191 ceph-mon[31636]: pgmap v20806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:12:13.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38844.119910 secs 2024-04-21T21:12:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38844.119910 secs 2024-04-21T21:12:13.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38844.119910 secs 2024-04-21T21:12:14.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:14 smithi170 ceph-mon[31212]: pgmap v20807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:12:14.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:14 smithi191 ceph-mon[31636]: pgmap v20807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:12:14.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:14 smithi077 ceph-mon[27902]: pgmap v20807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:12:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38845.874380 secs 2024-04-21T21:12:15.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38845.874380 secs 2024-04-21T21:12:15.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38845.874380 secs 2024-04-21T21:12:16.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:16 smithi170 ceph-mon[31212]: pgmap v20808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:16.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:16 smithi077 ceph-mon[27902]: pgmap v20808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:16.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:16 smithi191 ceph-mon[31636]: pgmap v20808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:18.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38849.119973 secs 2024-04-21T21:12:18.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:18 smithi170 ceph-mon[31212]: pgmap v20809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38849.119973 secs 2024-04-21T21:12:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:18 smithi077 ceph-mon[27902]: pgmap v20809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38849.119973 secs 2024-04-21T21:12:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:18 smithi191 ceph-mon[31636]: pgmap v20809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38850.874493 secs 2024-04-21T21:12:20.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:20 smithi170 ceph-mon[31212]: pgmap v20810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38850.874493 secs 2024-04-21T21:12:20.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:20 smithi077 ceph-mon[27902]: pgmap v20810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38850.874493 secs 2024-04-21T21:12:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:20 smithi191 ceph-mon[31636]: pgmap v20810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:12:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:22 smithi170 ceph-mon[31212]: pgmap v20811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:12:22.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:22 smithi077 ceph-mon[27902]: pgmap v20811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:12:22.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:22 smithi191 ceph-mon[31636]: pgmap v20811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:12:23.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38854.120091 secs 2024-04-21T21:12:23.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38854.120091 secs 2024-04-21T21:12:23.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38854.120091 secs 2024-04-21T21:12:24.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:24 smithi170 ceph-mon[31212]: pgmap v20812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:24.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:24 smithi077 ceph-mon[27902]: pgmap v20812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:24 smithi191 ceph-mon[31636]: pgmap v20812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38855.874608 secs 2024-04-21T21:12:25.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38855.874608 secs 2024-04-21T21:12:25.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38855.874608 secs 2024-04-21T21:12:26.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:26 smithi170 ceph-mon[31212]: pgmap v20813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:26.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:26 smithi077 ceph-mon[27902]: pgmap v20813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:26 smithi191 ceph-mon[31636]: pgmap v20813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38859.120227 secs 2024-04-21T21:12:28.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:28 smithi170 ceph-mon[31212]: pgmap v20814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38859.120227 secs 2024-04-21T21:12:28.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:28 smithi077 ceph-mon[27902]: pgmap v20814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38859.120227 secs 2024-04-21T21:12:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:28 smithi191 ceph-mon[31636]: pgmap v20814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:12:29.729+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:12:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:12:29.729+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:12:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:12:29.729+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:12:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:12:29.729+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:12:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38860.874721 secs 2024-04-21T21:12:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:30 smithi170 ceph-mon[31212]: pgmap v20815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38860.874721 secs 2024-04-21T21:12:30.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:30 smithi077 ceph-mon[27902]: pgmap v20815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38860.874721 secs 2024-04-21T21:12:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:30 smithi191 ceph-mon[31636]: pgmap v20815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:32.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:32 smithi170 ceph-mon[31212]: pgmap v20816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:32.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:32 smithi077 ceph-mon[27902]: pgmap v20816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:32 smithi191 ceph-mon[31636]: pgmap v20816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:33.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38864.120366 secs 2024-04-21T21:12:33.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38864.120366 secs 2024-04-21T21:12:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38864.120366 secs 2024-04-21T21:12:34.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:34 smithi170 ceph-mon[31212]: pgmap v20817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:34.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:34 smithi077 ceph-mon[27902]: pgmap v20817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:34.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:34 smithi191 ceph-mon[31636]: pgmap v20817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38865.874865 secs 2024-04-21T21:12:35.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:12:35.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38865.874865 secs 2024-04-21T21:12:35.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:12:35.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38865.874865 secs 2024-04-21T21:12:35.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:12:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:36 smithi170 ceph-mon[31212]: pgmap v20818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:12:36.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:12:36.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:12:36.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:36 smithi077 ceph-mon[27902]: pgmap v20818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:36.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:12:36.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:12:36.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:12:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:36 smithi191 ceph-mon[31636]: pgmap v20818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:12:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:12:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:12:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38869.120469 secs 2024-04-21T21:12:38.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:38 smithi170 ceph-mon[31212]: pgmap v20819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38869.120469 secs 2024-04-21T21:12:38.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:38 smithi077 ceph-mon[27902]: pgmap v20819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38869.120469 secs 2024-04-21T21:12:38.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:38 smithi191 ceph-mon[31636]: pgmap v20819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:40.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38870.874974 secs 2024-04-21T21:12:40.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:40 smithi170 ceph-mon[31212]: pgmap v20820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38870.874974 secs 2024-04-21T21:12:40.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:40 smithi077 ceph-mon[27902]: pgmap v20820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38870.874974 secs 2024-04-21T21:12:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:40 smithi191 ceph-mon[31636]: pgmap v20820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:42.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:42 smithi170 ceph-mon[31212]: pgmap v20821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:42.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:42 smithi077 ceph-mon[27902]: pgmap v20821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:42 smithi191 ceph-mon[31636]: pgmap v20821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:43.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38874.120585 secs 2024-04-21T21:12:43.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38874.120585 secs 2024-04-21T21:12:43.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38874.120585 secs 2024-04-21T21:12:44.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:44 smithi170 ceph-mon[31212]: pgmap v20822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:44.872 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:44 smithi191 ceph-mon[31636]: pgmap v20822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:44.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:44 smithi077 ceph-mon[27902]: pgmap v20822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:45.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38875.875038 secs 2024-04-21T21:12:45.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38875.875038 secs 2024-04-21T21:12:45.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38875.875038 secs 2024-04-21T21:12:46.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:46 smithi077 ceph-mon[27902]: pgmap v20823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:46.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:46 smithi191 ceph-mon[31636]: pgmap v20823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:46 smithi170 ceph-mon[31212]: pgmap v20823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38879.120684 secs 2024-04-21T21:12:48.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:48 smithi077 ceph-mon[27902]: pgmap v20824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38879.120684 secs 2024-04-21T21:12:48.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:48 smithi191 ceph-mon[31636]: pgmap v20824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38879.120684 secs 2024-04-21T21:12:49.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:48 smithi170 ceph-mon[31212]: pgmap v20824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38880.875175 secs 2024-04-21T21:12:50.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:50 smithi077 ceph-mon[27902]: pgmap v20825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38880.875175 secs 2024-04-21T21:12:50.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:50 smithi191 ceph-mon[31636]: pgmap v20825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38880.875175 secs 2024-04-21T21:12:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:50 smithi170 ceph-mon[31212]: pgmap v20825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:52.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:52 smithi077 ceph-mon[27902]: pgmap v20826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:52.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:52 smithi191 ceph-mon[31636]: pgmap v20826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:52 smithi170 ceph-mon[31212]: pgmap v20826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:53.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38884.120783 secs 2024-04-21T21:12:53.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38884.120783 secs 2024-04-21T21:12:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38884.120783 secs 2024-04-21T21:12:54.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:54 smithi077 ceph-mon[27902]: pgmap v20827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:54.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:54 smithi191 ceph-mon[31636]: pgmap v20827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:54 smithi170 ceph-mon[31212]: pgmap v20827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:12:55.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38885.875304 secs 2024-04-21T21:12:55.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38885.875304 secs 2024-04-21T21:12:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38885.875304 secs 2024-04-21T21:12:56.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:56 smithi077 ceph-mon[27902]: pgmap v20828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:56.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:56 smithi191 ceph-mon[31636]: pgmap v20828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:56 smithi170 ceph-mon[31212]: pgmap v20828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:12:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38889.120907 secs 2024-04-21T21:12:58.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:12:58 smithi077 ceph-mon[27902]: pgmap v20829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38889.120907 secs 2024-04-21T21:12:58.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:12:58 smithi191 ceph-mon[31636]: pgmap v20829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:12:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38889.120907 secs 2024-04-21T21:12:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:12:58 smithi170 ceph-mon[31212]: pgmap v20829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38890.875400 secs 2024-04-21T21:13:00.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:00 smithi077 ceph-mon[27902]: pgmap v20830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38890.875400 secs 2024-04-21T21:13:00.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:00 smithi191 ceph-mon[31636]: pgmap v20830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38890.875400 secs 2024-04-21T21:13:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:00 smithi170 ceph-mon[31212]: pgmap v20830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:02.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:02 smithi077 ceph-mon[27902]: pgmap v20831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:02.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:02 smithi191 ceph-mon[31636]: pgmap v20831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:02 smithi170 ceph-mon[31212]: pgmap v20831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:03.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38894.120993 secs 2024-04-21T21:13:03.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38894.120993 secs 2024-04-21T21:13:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38894.120993 secs 2024-04-21T21:13:04.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:04 smithi077 ceph-mon[27902]: pgmap v20832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:13:04.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:04 smithi191 ceph-mon[31636]: pgmap v20832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:13:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:04 smithi170 ceph-mon[31212]: pgmap v20832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:13:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38895.875531 secs 2024-04-21T21:13:05.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:05 smithi077 ceph-mon[27902]: osdmap e1374: 12 total, 12 up, 12 in 2024-04-21T21:13:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38895.875531 secs 2024-04-21T21:13:05.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:05 smithi191 ceph-mon[31636]: osdmap e1374: 12 total, 12 up, 12 in 2024-04-21T21:13:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38895.875531 secs 2024-04-21T21:13:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:05 smithi170 ceph-mon[31212]: osdmap e1374: 12 total, 12 up, 12 in 2024-04-21T21:13:06.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:06 smithi077 ceph-mon[27902]: pgmap v20834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:06.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:06 smithi191 ceph-mon[31636]: pgmap v20834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:06 smithi170 ceph-mon[31212]: pgmap v20834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38899.121112 secs 2024-04-21T21:13:08.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:08 smithi077 ceph-mon[27902]: pgmap v20835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38899.121112 secs 2024-04-21T21:13:08.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:08 smithi191 ceph-mon[31636]: pgmap v20835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38899.121112 secs 2024-04-21T21:13:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:08 smithi170 ceph-mon[31212]: pgmap v20835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38900.875626 secs 2024-04-21T21:13:10.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:10 smithi077 ceph-mon[27902]: pgmap v20836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38900.875626 secs 2024-04-21T21:13:10.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:10 smithi191 ceph-mon[31636]: pgmap v20836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38900.875626 secs 2024-04-21T21:13:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:10 smithi170 ceph-mon[31212]: pgmap v20836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:12.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:12 smithi077 ceph-mon[27902]: pgmap v20837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:12.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:12 smithi191 ceph-mon[31636]: pgmap v20837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:12 smithi170 ceph-mon[31212]: pgmap v20837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:13.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38904.121226 secs 2024-04-21T21:13:13.961 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38904.121226 secs 2024-04-21T21:13:13.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38904.121226 secs 2024-04-21T21:13:14.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:14 smithi191 ceph-mon[31636]: pgmap v20838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:14 smithi170 ceph-mon[31212]: pgmap v20838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:15.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:14 smithi077 ceph-mon[27902]: pgmap v20838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:13:15.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38905.875759 secs 2024-04-21T21:13:15.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:15 smithi191 ceph-mon[31636]: osdmap e1375: 12 total, 12 up, 12 in 2024-04-21T21:13:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38905.875759 secs 2024-04-21T21:13:16.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:15 smithi170 ceph-mon[31212]: osdmap e1375: 12 total, 12 up, 12 in 2024-04-21T21:13:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38905.875759 secs 2024-04-21T21:13:16.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:15 smithi077 ceph-mon[27902]: osdmap e1375: 12 total, 12 up, 12 in 2024-04-21T21:13:16.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:16 smithi191 ceph-mon[31636]: pgmap v20840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:16 smithi170 ceph-mon[31212]: pgmap v20840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:16 smithi077 ceph-mon[27902]: pgmap v20840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38909.121303 secs 2024-04-21T21:13:18.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:18 smithi191 ceph-mon[31636]: pgmap v20841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38909.121303 secs 2024-04-21T21:13:19.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:18 smithi170 ceph-mon[31212]: pgmap v20841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38909.121303 secs 2024-04-21T21:13:19.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:18 smithi077 ceph-mon[27902]: pgmap v20841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38910.875899 secs 2024-04-21T21:13:20.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:20 smithi191 ceph-mon[31636]: pgmap v20842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38910.875899 secs 2024-04-21T21:13:21.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:20 smithi170 ceph-mon[31212]: pgmap v20842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38910.875899 secs 2024-04-21T21:13:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:20 smithi077 ceph-mon[27902]: pgmap v20842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:13:22.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:22 smithi191 ceph-mon[31636]: pgmap v20843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:13:23.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:22 smithi170 ceph-mon[31212]: pgmap v20843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:13:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:22 smithi077 ceph-mon[27902]: pgmap v20843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:13:23.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38914.121414 secs 2024-04-21T21:13:24.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38914.121414 secs 2024-04-21T21:13:24.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38914.121414 secs 2024-04-21T21:13:24.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:24 smithi191 ceph-mon[31636]: pgmap v20844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:13:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:24 smithi170 ceph-mon[31212]: pgmap v20844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:13:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:25.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:24 smithi077 ceph-mon[27902]: pgmap v20844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:13:25.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38915.876019 secs 2024-04-21T21:13:26.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38915.876019 secs 2024-04-21T21:13:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38915.876019 secs 2024-04-21T21:13:26.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:26 smithi191 ceph-mon[31636]: pgmap v20845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:13:27.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:26 smithi170 ceph-mon[31212]: pgmap v20845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:13:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:26 smithi077 ceph-mon[27902]: pgmap v20845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:13:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38919.121532 secs 2024-04-21T21:13:28.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:28 smithi191 ceph-mon[31636]: pgmap v20846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38919.121532 secs 2024-04-21T21:13:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:28 smithi170 ceph-mon[31212]: pgmap v20846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:29.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38919.121532 secs 2024-04-21T21:13:29.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:28 smithi077 ceph-mon[27902]: pgmap v20846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38920.876140 secs 2024-04-21T21:13:30.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:30 smithi191 ceph-mon[31636]: pgmap v20847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38920.876140 secs 2024-04-21T21:13:31.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:30 smithi170 ceph-mon[31212]: pgmap v20847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38920.876140 secs 2024-04-21T21:13:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:30 smithi077 ceph-mon[27902]: pgmap v20847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:32.940 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:32 smithi077 ceph-mon[27902]: pgmap v20848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:32.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:32 smithi191 ceph-mon[31636]: pgmap v20848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:32 smithi170 ceph-mon[31212]: pgmap v20848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:33.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38924.121663 secs 2024-04-21T21:13:34.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38924.121663 secs 2024-04-21T21:13:34.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38924.121663 secs 2024-04-21T21:13:34.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:34 smithi191 ceph-mon[31636]: pgmap v20849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:34 smithi170 ceph-mon[31212]: pgmap v20849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:34 smithi077 ceph-mon[27902]: pgmap v20849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:35.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38925.876259 secs 2024-04-21T21:13:36.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38925.876259 secs 2024-04-21T21:13:36.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38925.876259 secs 2024-04-21T21:13:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:36 smithi191 ceph-mon[31636]: pgmap v20850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:13:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:13:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:13:36.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:13:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:36 smithi170 ceph-mon[31212]: pgmap v20850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:37.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:13:37.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:13:37.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:13:37.060 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:13:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:36 smithi077 ceph-mon[27902]: pgmap v20850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:13:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:13:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:13:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:13:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38929.121795 secs 2024-04-21T21:13:38.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:38 smithi191 ceph-mon[31636]: pgmap v20851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38929.121795 secs 2024-04-21T21:13:39.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:38 smithi170 ceph-mon[31212]: pgmap v20851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38929.121795 secs 2024-04-21T21:13:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:38 smithi077 ceph-mon[27902]: pgmap v20851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38930.876386 secs 2024-04-21T21:13:40.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:40 smithi191 ceph-mon[31636]: pgmap v20852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38930.876386 secs 2024-04-21T21:13:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:40 smithi170 ceph-mon[31212]: pgmap v20852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38930.876386 secs 2024-04-21T21:13:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:40 smithi077 ceph-mon[27902]: pgmap v20852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:42 smithi191 ceph-mon[31636]: pgmap v20853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:42 smithi170 ceph-mon[31212]: pgmap v20853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:42 smithi077 ceph-mon[27902]: pgmap v20853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:43.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38934.121910 secs 2024-04-21T21:13:44.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38934.121910 secs 2024-04-21T21:13:44.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38934.121910 secs 2024-04-21T21:13:44.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:44 smithi191 ceph-mon[31636]: pgmap v20854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:45.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:44 smithi170 ceph-mon[31212]: pgmap v20854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:45.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:44 smithi077 ceph-mon[27902]: pgmap v20854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:45.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38935.876518 secs 2024-04-21T21:13:46.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38935.876518 secs 2024-04-21T21:13:46.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38935.876518 secs 2024-04-21T21:13:47.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:46 smithi170 ceph-mon[31212]: pgmap v20855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:46 smithi077 ceph-mon[27902]: pgmap v20855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:47.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:46 smithi191 ceph-mon[31636]: pgmap v20855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38939.122028 secs 2024-04-21T21:13:49.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:48 smithi170 ceph-mon[31212]: pgmap v20856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38939.122028 secs 2024-04-21T21:13:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:48 smithi077 ceph-mon[27902]: pgmap v20856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38939.122028 secs 2024-04-21T21:13:49.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:48 smithi191 ceph-mon[31636]: pgmap v20856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:50.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38940.876617 secs 2024-04-21T21:13:51.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:50 smithi170 ceph-mon[31212]: pgmap v20857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38940.876617 secs 2024-04-21T21:13:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:50 smithi077 ceph-mon[27902]: pgmap v20857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38940.876617 secs 2024-04-21T21:13:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:50 smithi191 ceph-mon[31636]: pgmap v20857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:53.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:52 smithi170 ceph-mon[31212]: pgmap v20858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:52 smithi077 ceph-mon[27902]: pgmap v20858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:52 smithi191 ceph-mon[31636]: pgmap v20858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:54.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38944.122130 secs 2024-04-21T21:13:54.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38944.122130 secs 2024-04-21T21:13:54.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38944.122130 secs 2024-04-21T21:13:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.464+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T21:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.464+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T21:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T21:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.464+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T21:13:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.465+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:13:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.465+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T21:13:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.465+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T21:13:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T21:13:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T21:13:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7003e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T21:13:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7efd70012670 tx=0x7efd7003e040 comp rx=0 tx=0).stop 2024-04-21T21:13:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T21:13:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T21:13:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T21:13:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T21:13:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.553+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:13:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:54.554+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d70 tx=0x7efd70034040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T21:13:55.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:54 smithi170 ceph-mon[31212]: pgmap v20859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:55.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:13:55.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:54 smithi077 ceph-mon[27902]: pgmap v20859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:54 smithi191 ceph-mon[31636]: pgmap v20859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:56.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38945.876729 secs 2024-04-21T21:13:56.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38945.876729 secs 2024-04-21T21:13:56.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38945.876729 secs 2024-04-21T21:13:57.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:56 smithi170 ceph-mon[31212]: pgmap v20860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:57.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:56 smithi077 ceph-mon[27902]: pgmap v20860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:57.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:56 smithi191 ceph-mon[31636]: pgmap v20860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:13:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38949.122246 secs 2024-04-21T21:13:59.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:13:58 smithi170 ceph-mon[31212]: pgmap v20861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38949.122246 secs 2024-04-21T21:13:59.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:13:58 smithi077 ceph-mon[27902]: pgmap v20861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38949.122246 secs 2024-04-21T21:13:59.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:13:58 smithi191 ceph-mon[31636]: pgmap v20861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:13:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:59.741+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:13:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:59.741+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:13:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:59.741+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:13:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:13:59.741+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:14:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38950.876847 secs 2024-04-21T21:14:01.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:00 smithi170 ceph-mon[31212]: pgmap v20862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38950.876847 secs 2024-04-21T21:14:01.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:00 smithi077 ceph-mon[27902]: pgmap v20862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38950.876847 secs 2024-04-21T21:14:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:00 smithi191 ceph-mon[31636]: pgmap v20862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:02 smithi170 ceph-mon[31212]: pgmap v20863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:03.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:02 smithi077 ceph-mon[27902]: pgmap v20863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:02 smithi191 ceph-mon[31636]: pgmap v20863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:04.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38954.122338 secs 2024-04-21T21:14:04.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38954.122338 secs 2024-04-21T21:14:04.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38954.122338 secs 2024-04-21T21:14:05.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:04 smithi170 ceph-mon[31212]: pgmap v20864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:04 smithi077 ceph-mon[27902]: pgmap v20864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:04 smithi191 ceph-mon[31636]: pgmap v20864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38955.876974 secs 2024-04-21T21:14:06.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:05 smithi170 ceph-mon[31212]: osdmap e1376: 12 total, 12 up, 12 in 2024-04-21T21:14:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38955.876974 secs 2024-04-21T21:14:06.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:05 smithi077 ceph-mon[27902]: osdmap e1376: 12 total, 12 up, 12 in 2024-04-21T21:14:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38955.876974 secs 2024-04-21T21:14:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:05 smithi191 ceph-mon[31636]: osdmap e1376: 12 total, 12 up, 12 in 2024-04-21T21:14:07.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:06 smithi170 ceph-mon[31212]: pgmap v20866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:07.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:06 smithi077 ceph-mon[27902]: pgmap v20866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:07.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:06 smithi191 ceph-mon[31636]: pgmap v20866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38959.122452 secs 2024-04-21T21:14:09.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:08 smithi170 ceph-mon[31212]: pgmap v20867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:09.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38959.122452 secs 2024-04-21T21:14:09.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:08 smithi077 ceph-mon[27902]: pgmap v20867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38959.122452 secs 2024-04-21T21:14:09.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:08 smithi191 ceph-mon[31636]: pgmap v20867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38960.877098 secs 2024-04-21T21:14:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:10 smithi170 ceph-mon[31212]: pgmap v20868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:11.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:10 smithi170 ceph-mon[31212]: osdmap e1377: 12 total, 12 up, 12 in 2024-04-21T21:14:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38960.877098 secs 2024-04-21T21:14:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:10 smithi077 ceph-mon[27902]: pgmap v20868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:11.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:10 smithi077 ceph-mon[27902]: osdmap e1377: 12 total, 12 up, 12 in 2024-04-21T21:14:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38960.877098 secs 2024-04-21T21:14:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:10 smithi191 ceph-mon[31636]: pgmap v20868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:14:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:10 smithi191 ceph-mon[31636]: osdmap e1377: 12 total, 12 up, 12 in 2024-04-21T21:14:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:12 smithi170 ceph-mon[31212]: pgmap v20870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:14:13.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38964.122561 secs 2024-04-21T21:14:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:12 smithi077 ceph-mon[27902]: pgmap v20870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:14:13.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38964.122561 secs 2024-04-21T21:14:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:12 smithi191 ceph-mon[31636]: pgmap v20870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:14:13.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38964.122561 secs 2024-04-21T21:14:15.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:14 smithi170 ceph-mon[31212]: pgmap v20871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T21:14:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:14 smithi077 ceph-mon[27902]: pgmap v20871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T21:14:15.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:14 smithi191 ceph-mon[31636]: pgmap v20871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-21T21:14:16.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38965.877224 secs 2024-04-21T21:14:16.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38965.877224 secs 2024-04-21T21:14:16.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38965.877224 secs 2024-04-21T21:14:17.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:16 smithi170 ceph-mon[31212]: pgmap v20872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:17.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:16 smithi077 ceph-mon[27902]: pgmap v20872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:16 smithi191 ceph-mon[31636]: pgmap v20872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:18.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38969.122660 secs 2024-04-21T21:14:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38969.122660 secs 2024-04-21T21:14:18.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38969.122660 secs 2024-04-21T21:14:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:18 smithi077 ceph-mon[27902]: pgmap v20873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:18 smithi191 ceph-mon[31636]: pgmap v20873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:18 smithi170 ceph-mon[31212]: pgmap v20873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38970.877325 secs 2024-04-21T21:14:21.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:20 smithi077 ceph-mon[27902]: pgmap v20874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38970.877325 secs 2024-04-21T21:14:21.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:20 smithi191 ceph-mon[31636]: pgmap v20874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38970.877325 secs 2024-04-21T21:14:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:20 smithi170 ceph-mon[31212]: pgmap v20874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:14:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:22 smithi077 ceph-mon[27902]: pgmap v20875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:14:23.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38974.122809 secs 2024-04-21T21:14:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:22 smithi191 ceph-mon[31636]: pgmap v20875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:14:23.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38974.122809 secs 2024-04-21T21:14:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:22 smithi170 ceph-mon[31212]: pgmap v20875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:14:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38974.122809 secs 2024-04-21T21:14:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:25.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:24 smithi077 ceph-mon[27902]: pgmap v20876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:25.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:24 smithi191 ceph-mon[31636]: pgmap v20876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:24 smithi170 ceph-mon[31212]: pgmap v20876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:26.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38975.877426 secs 2024-04-21T21:14:26.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38975.877426 secs 2024-04-21T21:14:26.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38975.877426 secs 2024-04-21T21:14:27.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:26 smithi077 ceph-mon[27902]: pgmap v20877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:26 smithi191 ceph-mon[31636]: pgmap v20877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:26 smithi170 ceph-mon[31212]: pgmap v20877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38979.122910 secs 2024-04-21T21:14:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38979.122910 secs 2024-04-21T21:14:28.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38979.122910 secs 2024-04-21T21:14:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:28 smithi077 ceph-mon[27902]: pgmap v20878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:28 smithi191 ceph-mon[31636]: pgmap v20878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:28 smithi170 ceph-mon[31212]: pgmap v20878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38980.877571 secs 2024-04-21T21:14:31.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:30 smithi077 ceph-mon[27902]: pgmap v20879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38980.877571 secs 2024-04-21T21:14:31.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:30 smithi191 ceph-mon[31636]: pgmap v20879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38980.877571 secs 2024-04-21T21:14:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:30 smithi170 ceph-mon[31212]: pgmap v20879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:32 smithi077 ceph-mon[27902]: pgmap v20880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:33.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38984.123020 secs 2024-04-21T21:14:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:32 smithi191 ceph-mon[31636]: pgmap v20880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:33.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38984.123020 secs 2024-04-21T21:14:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:32 smithi170 ceph-mon[31212]: pgmap v20880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38984.123020 secs 2024-04-21T21:14:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:35.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:34 smithi077 ceph-mon[27902]: pgmap v20881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:35.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:34 smithi191 ceph-mon[31636]: pgmap v20881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:34 smithi170 ceph-mon[31212]: pgmap v20881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:36.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38985.877689 secs 2024-04-21T21:14:36.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38985.877689 secs 2024-04-21T21:14:36.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38985.877689 secs 2024-04-21T21:14:37.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:36 smithi077 ceph-mon[27902]: pgmap v20882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:37.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:36 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:14:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:36 smithi191 ceph-mon[31636]: pgmap v20882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:37.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:36 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:14:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:36 smithi170 ceph-mon[31212]: pgmap v20882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:36 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:14:38.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:14:38.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:14:38.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:14:38.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38989.123142 secs 2024-04-21T21:14:38.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:14:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:14:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:14:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38989.123142 secs 2024-04-21T21:14:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:14:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:14:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:14:38.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38989.123142 secs 2024-04-21T21:14:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:38 smithi077 ceph-mon[27902]: pgmap v20883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:38 smithi191 ceph-mon[31636]: pgmap v20883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:38 smithi170 ceph-mon[31212]: pgmap v20883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38990.877811 secs 2024-04-21T21:14:41.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:40 smithi077 ceph-mon[27902]: pgmap v20884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38990.877811 secs 2024-04-21T21:14:41.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:40 smithi191 ceph-mon[31636]: pgmap v20884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38990.877811 secs 2024-04-21T21:14:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:40 smithi170 ceph-mon[31212]: pgmap v20884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:43.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:42 smithi077 ceph-mon[27902]: pgmap v20885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:43.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38994.123253 secs 2024-04-21T21:14:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:42 smithi191 ceph-mon[31636]: pgmap v20885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:43.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38994.123253 secs 2024-04-21T21:14:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:42 smithi170 ceph-mon[31212]: pgmap v20885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38994.123253 secs 2024-04-21T21:14:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:45.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:44 smithi077 ceph-mon[27902]: pgmap v20886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:44 smithi191 ceph-mon[31636]: pgmap v20886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:45.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:44 smithi170 ceph-mon[31212]: pgmap v20886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:46.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 38995.877931 secs 2024-04-21T21:14:46.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 38995.877931 secs 2024-04-21T21:14:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 38995.877931 secs 2024-04-21T21:14:47.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:46 smithi077 ceph-mon[27902]: pgmap v20887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:47.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:46 smithi191 ceph-mon[31636]: pgmap v20887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:47.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:46 smithi170 ceph-mon[31212]: pgmap v20887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:48.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 38999.123393 secs 2024-04-21T21:14:48.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 38999.123393 secs 2024-04-21T21:14:48.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 38999.123393 secs 2024-04-21T21:14:49.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:48 smithi077 ceph-mon[27902]: pgmap v20888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:49.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:48 smithi191 ceph-mon[31636]: pgmap v20888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:49.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:48 smithi170 ceph-mon[31212]: pgmap v20888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:50.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39000.878022 secs 2024-04-21T21:14:51.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:50 smithi077 ceph-mon[27902]: pgmap v20889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39000.878022 secs 2024-04-21T21:14:51.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:50 smithi191 ceph-mon[31636]: pgmap v20889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39000.878022 secs 2024-04-21T21:14:51.341 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:50 smithi170 ceph-mon[31212]: pgmap v20889: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:52 smithi077 ceph-mon[27902]: pgmap v20890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:53.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39004.123505 secs 2024-04-21T21:14:53.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:52 smithi191 ceph-mon[31636]: pgmap v20890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:53.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39004.123505 secs 2024-04-21T21:14:53.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:52 smithi170 ceph-mon[31212]: pgmap v20890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:53.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39004.123505 secs 2024-04-21T21:14:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:14:55.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:54 smithi191 ceph-mon[31636]: pgmap v20891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:55.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:54 smithi170 ceph-mon[31212]: pgmap v20891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:54 smithi077 ceph-mon[27902]: pgmap v20891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:56.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39005.878140 secs 2024-04-21T21:14:56.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39005.878140 secs 2024-04-21T21:14:56.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39005.878140 secs 2024-04-21T21:14:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:56 smithi191 ceph-mon[31636]: pgmap v20892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:57.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:56 smithi170 ceph-mon[31212]: pgmap v20892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:57.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:56 smithi077 ceph-mon[27902]: pgmap v20892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:14:58.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39009.123619 secs 2024-04-21T21:14:58.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39009.123619 secs 2024-04-21T21:14:58.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39009.123619 secs 2024-04-21T21:14:59.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:14:58 smithi191 ceph-mon[31636]: pgmap v20893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:59.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:14:58 smithi170 ceph-mon[31212]: pgmap v20893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:14:59.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:14:58 smithi077 ceph-mon[27902]: pgmap v20893: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39010.878215 secs 2024-04-21T21:15:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:00 smithi191 ceph-mon[31636]: pgmap v20894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:01.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39010.878215 secs 2024-04-21T21:15:01.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:00 smithi170 ceph-mon[31212]: pgmap v20894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:01.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39010.878215 secs 2024-04-21T21:15:01.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:00 smithi077 ceph-mon[27902]: pgmap v20894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:03.189 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:02 smithi077 ceph-mon[27902]: pgmap v20895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T21:15:03.190 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39014.123734 secs 2024-04-21T21:15:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:02 smithi191 ceph-mon[31636]: pgmap v20895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T21:15:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39014.123734 secs 2024-04-21T21:15:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:02 smithi170 ceph-mon[31212]: pgmap v20895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-04-21T21:15:03.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39014.123734 secs 2024-04-21T21:15:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:04 smithi191 ceph-mon[31636]: pgmap v20896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T21:15:05.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:04 smithi170 ceph-mon[31212]: pgmap v20896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T21:15:05.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:04 smithi077 ceph-mon[27902]: pgmap v20896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-21T21:15:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39015.878331 secs 2024-04-21T21:15:06.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:05 smithi191 ceph-mon[31636]: osdmap e1378: 12 total, 12 up, 12 in 2024-04-21T21:15:06.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39015.878331 secs 2024-04-21T21:15:06.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:05 smithi170 ceph-mon[31212]: osdmap e1378: 12 total, 12 up, 12 in 2024-04-21T21:15:06.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39015.878331 secs 2024-04-21T21:15:06.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:05 smithi077 ceph-mon[27902]: osdmap e1378: 12 total, 12 up, 12 in 2024-04-21T21:15:07.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:06 smithi191 ceph-mon[31636]: pgmap v20898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:07.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:06 smithi170 ceph-mon[31212]: pgmap v20898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:07.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:06 smithi077 ceph-mon[27902]: pgmap v20898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:08.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39019.123850 secs 2024-04-21T21:15:08.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39019.123850 secs 2024-04-21T21:15:08.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39019.123850 secs 2024-04-21T21:15:09.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:08 smithi191 ceph-mon[31636]: pgmap v20899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:09.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:08 smithi170 ceph-mon[31212]: pgmap v20899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:09.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:08 smithi077 ceph-mon[27902]: pgmap v20899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39020.878409 secs 2024-04-21T21:15:11.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:10 smithi191 ceph-mon[31636]: pgmap v20900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39020.878409 secs 2024-04-21T21:15:11.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:10 smithi170 ceph-mon[31212]: pgmap v20900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39020.878409 secs 2024-04-21T21:15:11.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:10 smithi077 ceph-mon[27902]: pgmap v20900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:15:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:12 smithi191 ceph-mon[31636]: pgmap v20901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T21:15:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39024.123956 secs 2024-04-21T21:15:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:12 smithi170 ceph-mon[31212]: pgmap v20901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T21:15:13.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39024.123956 secs 2024-04-21T21:15:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:12 smithi077 ceph-mon[27902]: pgmap v20901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T21:15:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39024.123956 secs 2024-04-21T21:15:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:14 smithi191 ceph-mon[31636]: pgmap v20902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T21:15:15.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:14 smithi170 ceph-mon[31212]: pgmap v20902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T21:15:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:14 smithi077 ceph-mon[27902]: pgmap v20902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-04-21T21:15:16.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39025.878524 secs 2024-04-21T21:15:16.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:15 smithi191 ceph-mon[31636]: osdmap e1379: 12 total, 12 up, 12 in 2024-04-21T21:15:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39025.878524 secs 2024-04-21T21:15:16.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:15 smithi170 ceph-mon[31212]: osdmap e1379: 12 total, 12 up, 12 in 2024-04-21T21:15:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39025.878524 secs 2024-04-21T21:15:16.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:15 smithi077 ceph-mon[27902]: osdmap e1379: 12 total, 12 up, 12 in 2024-04-21T21:15:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:16 smithi191 ceph-mon[31636]: pgmap v20904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:17.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:16 smithi170 ceph-mon[31212]: pgmap v20904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:17.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:16 smithi077 ceph-mon[27902]: pgmap v20904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:18.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39029.124094 secs 2024-04-21T21:15:18.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39029.124094 secs 2024-04-21T21:15:18.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39029.124094 secs 2024-04-21T21:15:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:18 smithi191 ceph-mon[31636]: pgmap v20905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:19.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:18 smithi170 ceph-mon[31212]: pgmap v20905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:19.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:18 smithi077 ceph-mon[27902]: pgmap v20905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39030.878643 secs 2024-04-21T21:15:21.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:20 smithi191 ceph-mon[31636]: pgmap v20906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39030.878643 secs 2024-04-21T21:15:21.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:20 smithi170 ceph-mon[31212]: pgmap v20906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39030.878643 secs 2024-04-21T21:15:21.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:20 smithi077 ceph-mon[27902]: pgmap v20906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:15:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:22 smithi191 ceph-mon[31636]: pgmap v20907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:15:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39034.124212 secs 2024-04-21T21:15:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:22 smithi170 ceph-mon[31212]: pgmap v20907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:15:23.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39034.124212 secs 2024-04-21T21:15:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:22 smithi077 ceph-mon[27902]: pgmap v20907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:15:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39034.124212 secs 2024-04-21T21:15:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:24 smithi191 ceph-mon[31636]: pgmap v20908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:15:25.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:24 smithi170 ceph-mon[31212]: pgmap v20908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:15:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:24 smithi077 ceph-mon[27902]: pgmap v20908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:15:26.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39035.878770 secs 2024-04-21T21:15:26.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39035.878770 secs 2024-04-21T21:15:26.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39035.878770 secs 2024-04-21T21:15:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:26 smithi191 ceph-mon[31636]: pgmap v20909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:15:27.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:26 smithi170 ceph-mon[31212]: pgmap v20909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:15:27.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:26 smithi077 ceph-mon[27902]: pgmap v20909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:15:28.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39039.124327 secs 2024-04-21T21:15:28.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39039.124327 secs 2024-04-21T21:15:28.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39039.124327 secs 2024-04-21T21:15:29.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:28 smithi170 ceph-mon[31212]: pgmap v20910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:29.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:28 smithi077 ceph-mon[27902]: pgmap v20910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:29.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:28 smithi191 ceph-mon[31636]: pgmap v20910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39040.878889 secs 2024-04-21T21:15:31.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:30 smithi170 ceph-mon[31212]: pgmap v20911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:31.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39040.878889 secs 2024-04-21T21:15:31.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:30 smithi077 ceph-mon[27902]: pgmap v20911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:31.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39040.878889 secs 2024-04-21T21:15:31.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:30 smithi191 ceph-mon[31636]: pgmap v20911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:32 smithi170 ceph-mon[31212]: pgmap v20912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:33.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39044.124446 secs 2024-04-21T21:15:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:32 smithi077 ceph-mon[27902]: pgmap v20912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:33.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39044.124446 secs 2024-04-21T21:15:33.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:32 smithi191 ceph-mon[31636]: pgmap v20912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:33.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39044.124446 secs 2024-04-21T21:15:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:35.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:34 smithi170 ceph-mon[31212]: pgmap v20913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:35.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:34 smithi077 ceph-mon[27902]: pgmap v20913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:34 smithi191 ceph-mon[31636]: pgmap v20913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:36.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39045.879009 secs 2024-04-21T21:15:36.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39045.879009 secs 2024-04-21T21:15:36.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39045.879009 secs 2024-04-21T21:15:37.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:36 smithi170 ceph-mon[31212]: pgmap v20914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:37.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:36 smithi077 ceph-mon[27902]: pgmap v20914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:37.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:36 smithi191 ceph-mon[31636]: pgmap v20914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:38.296 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39049.124562 secs 2024-04-21T21:15:38.296 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:37 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:15:38.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39049.124562 secs 2024-04-21T21:15:38.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:37 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:15:38.339 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39049.124562 secs 2024-04-21T21:15:38.339 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:37 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:15:39.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:38 smithi170 ceph-mon[31212]: pgmap v20915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:39.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:38 smithi077 ceph-mon[27902]: pgmap v20915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:39.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:38 smithi191 ceph-mon[31636]: pgmap v20915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39050.879075 secs 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:15:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:15:40.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39050.879075 secs 2024-04-21T21:15:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:15:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:15:40.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39050.879075 secs 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:15:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:15:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:15:40.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: pgmap v20916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:15:41.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:41 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: pgmap v20916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:15:41.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:41 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:15:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: pgmap v20916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:15:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:15:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:15:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:15:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:15:41.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:41 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:15:42.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:42 smithi077 ceph-mon[27902]: pgmap v20917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:42.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:42 smithi191 ceph-mon[31636]: pgmap v20917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:42.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:42 smithi170 ceph-mon[31212]: pgmap v20917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39054.124680 secs 2024-04-21T21:15:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39054.124680 secs 2024-04-21T21:15:43.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39054.124680 secs 2024-04-21T21:15:44.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:44 smithi077 ceph-mon[27902]: pgmap v20918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:44 smithi191 ceph-mon[31636]: pgmap v20918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:44.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:44 smithi170 ceph-mon[31212]: pgmap v20918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:45.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39055.879223 secs 2024-04-21T21:15:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39055.879223 secs 2024-04-21T21:15:45.459 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39055.879223 secs 2024-04-21T21:15:46.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:46 smithi077 ceph-mon[27902]: pgmap v20919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:46 smithi191 ceph-mon[31636]: pgmap v20919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:46.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:46 smithi170 ceph-mon[31212]: pgmap v20919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39059.124803 secs 2024-04-21T21:15:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39059.124803 secs 2024-04-21T21:15:47.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39059.124803 secs 2024-04-21T21:15:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:48 smithi077 ceph-mon[27902]: pgmap v20920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:48 smithi191 ceph-mon[31636]: pgmap v20920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:48 smithi170 ceph-mon[31212]: pgmap v20920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39060.879320 secs 2024-04-21T21:15:50.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:50 smithi170 ceph-mon[31212]: pgmap v20921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39060.879320 secs 2024-04-21T21:15:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:50 smithi077 ceph-mon[27902]: pgmap v20921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39060.879320 secs 2024-04-21T21:15:50.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:50 smithi191 ceph-mon[31636]: pgmap v20921: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:52 smithi170 ceph-mon[31212]: pgmap v20922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:52.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39064.124889 secs 2024-04-21T21:15:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:52 smithi077 ceph-mon[27902]: pgmap v20922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39064.124889 secs 2024-04-21T21:15:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:52 smithi191 ceph-mon[31636]: pgmap v20922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39064.124889 secs 2024-04-21T21:15:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:54 smithi170 ceph-mon[31212]: pgmap v20923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:54 smithi077 ceph-mon[27902]: pgmap v20923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:54 smithi191 ceph-mon[31636]: pgmap v20923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:15:55.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39065.879439 secs 2024-04-21T21:15:55.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39065.879439 secs 2024-04-21T21:15:55.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39065.879439 secs 2024-04-21T21:15:56.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:56 smithi170 ceph-mon[31212]: pgmap v20924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:56 smithi077 ceph-mon[27902]: pgmap v20924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:56 smithi191 ceph-mon[31636]: pgmap v20924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:15:57.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39069.125006 secs 2024-04-21T21:15:57.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39069.125006 secs 2024-04-21T21:15:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39069.125006 secs 2024-04-21T21:15:58.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:15:58 smithi170 ceph-mon[31212]: pgmap v20925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:15:58 smithi077 ceph-mon[27902]: pgmap v20925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:15:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:15:58 smithi191 ceph-mon[31636]: pgmap v20925: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39070.879510 secs 2024-04-21T21:16:00.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:00 smithi170 ceph-mon[31212]: pgmap v20926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39070.879510 secs 2024-04-21T21:16:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:00 smithi077 ceph-mon[27902]: pgmap v20926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39070.879510 secs 2024-04-21T21:16:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:00 smithi191 ceph-mon[31636]: pgmap v20926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:02 smithi170 ceph-mon[31212]: pgmap v20927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T21:16:02.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39074.125080 secs 2024-04-21T21:16:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:02 smithi077 ceph-mon[27902]: pgmap v20927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T21:16:02.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39074.125080 secs 2024-04-21T21:16:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:02 smithi191 ceph-mon[31636]: pgmap v20927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-21T21:16:02.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39074.125080 secs 2024-04-21T21:16:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:04 smithi170 ceph-mon[31212]: pgmap v20928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:16:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:04 smithi077 ceph-mon[27902]: pgmap v20928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:16:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:04 smithi191 ceph-mon[31636]: pgmap v20928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:16:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39075.879654 secs 2024-04-21T21:16:05.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:05 smithi170 ceph-mon[31212]: osdmap e1380: 12 total, 12 up, 12 in 2024-04-21T21:16:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39075.879654 secs 2024-04-21T21:16:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:05 smithi077 ceph-mon[27902]: osdmap e1380: 12 total, 12 up, 12 in 2024-04-21T21:16:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39075.879654 secs 2024-04-21T21:16:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:05 smithi191 ceph-mon[31636]: osdmap e1380: 12 total, 12 up, 12 in 2024-04-21T21:16:06.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:06 smithi170 ceph-mon[31212]: pgmap v20930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:06 smithi077 ceph-mon[27902]: pgmap v20930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:06 smithi191 ceph-mon[31636]: pgmap v20930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:07.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39079.125196 secs 2024-04-21T21:16:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39079.125196 secs 2024-04-21T21:16:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39079.125196 secs 2024-04-21T21:16:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:08 smithi170 ceph-mon[31212]: pgmap v20931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:08 smithi077 ceph-mon[27902]: pgmap v20931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:08 smithi191 ceph-mon[31636]: pgmap v20931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39080.879771 secs 2024-04-21T21:16:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:10 smithi170 ceph-mon[31212]: pgmap v20932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:10.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:10 smithi170 ceph-mon[31212]: osdmap e1381: 12 total, 12 up, 12 in 2024-04-21T21:16:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39080.879771 secs 2024-04-21T21:16:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:10 smithi077 ceph-mon[27902]: pgmap v20932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:10 smithi077 ceph-mon[27902]: osdmap e1381: 12 total, 12 up, 12 in 2024-04-21T21:16:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39080.879771 secs 2024-04-21T21:16:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:10 smithi191 ceph-mon[31636]: pgmap v20932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:16:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:10 smithi191 ceph-mon[31636]: osdmap e1381: 12 total, 12 up, 12 in 2024-04-21T21:16:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:12 smithi170 ceph-mon[31212]: pgmap v20934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:16:12.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39084.125313 secs 2024-04-21T21:16:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:12 smithi077 ceph-mon[27902]: pgmap v20934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:16:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39084.125313 secs 2024-04-21T21:16:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:12 smithi191 ceph-mon[31636]: pgmap v20934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:16:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39084.125313 secs 2024-04-21T21:16:14.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:14 smithi170 ceph-mon[31212]: pgmap v20935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:16:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:14 smithi077 ceph-mon[27902]: pgmap v20935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:16:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:14 smithi191 ceph-mon[31636]: pgmap v20935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:16:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39085.879893 secs 2024-04-21T21:16:15.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39085.879893 secs 2024-04-21T21:16:15.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39085.879893 secs 2024-04-21T21:16:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:16 smithi170 ceph-mon[31212]: pgmap v20936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:16 smithi077 ceph-mon[27902]: pgmap v20936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:16 smithi191 ceph-mon[31636]: pgmap v20936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39089.125435 secs 2024-04-21T21:16:17.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39089.125435 secs 2024-04-21T21:16:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39089.125435 secs 2024-04-21T21:16:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:18 smithi170 ceph-mon[31212]: pgmap v20937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:18.888 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:18 smithi077 ceph-mon[27902]: pgmap v20937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:18 smithi191 ceph-mon[31636]: pgmap v20937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:20.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39090.879927 secs 2024-04-21T21:16:20.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:20 smithi170 ceph-mon[31212]: pgmap v20938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39090.879927 secs 2024-04-21T21:16:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:20 smithi077 ceph-mon[27902]: pgmap v20938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39090.879927 secs 2024-04-21T21:16:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:20 smithi191 ceph-mon[31636]: pgmap v20938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:16:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:22 smithi170 ceph-mon[31212]: pgmap v20939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:16:22.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39094.125530 secs 2024-04-21T21:16:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:22 smithi077 ceph-mon[27902]: pgmap v20939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:16:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39094.125530 secs 2024-04-21T21:16:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:22 smithi191 ceph-mon[31636]: pgmap v20939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:16:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39094.125530 secs 2024-04-21T21:16:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:24 smithi077 ceph-mon[27902]: pgmap v20940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:24 smithi191 ceph-mon[31636]: pgmap v20940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:24 smithi170 ceph-mon[31212]: pgmap v20940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:25.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39095.880034 secs 2024-04-21T21:16:25.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39095.880034 secs 2024-04-21T21:16:26.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39095.880034 secs 2024-04-21T21:16:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:26 smithi077 ceph-mon[27902]: pgmap v20941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:26 smithi191 ceph-mon[31636]: pgmap v20941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:26 smithi170 ceph-mon[31212]: pgmap v20941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:27.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39099.125673 secs 2024-04-21T21:16:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39099.125673 secs 2024-04-21T21:16:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39099.125673 secs 2024-04-21T21:16:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:28 smithi077 ceph-mon[27902]: pgmap v20942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:28 smithi191 ceph-mon[31636]: pgmap v20942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:29.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:28 smithi170 ceph-mon[31212]: pgmap v20942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39100.880146 secs 2024-04-21T21:16:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:30 smithi077 ceph-mon[27902]: pgmap v20943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39100.880146 secs 2024-04-21T21:16:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:30 smithi191 ceph-mon[31636]: pgmap v20943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39100.880146 secs 2024-04-21T21:16:31.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:30 smithi170 ceph-mon[31212]: pgmap v20943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:32 smithi077 ceph-mon[27902]: pgmap v20944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39104.125813 secs 2024-04-21T21:16:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:32 smithi191 ceph-mon[31636]: pgmap v20944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39104.125813 secs 2024-04-21T21:16:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:32 smithi170 ceph-mon[31212]: pgmap v20944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:33.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39104.125813 secs 2024-04-21T21:16:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:34 smithi077 ceph-mon[27902]: pgmap v20945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39105.880258 secs 2024-04-21T21:16:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:34 smithi191 ceph-mon[31636]: pgmap v20945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39105.880258 secs 2024-04-21T21:16:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:34 smithi170 ceph-mon[31212]: pgmap v20945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:35.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39105.880258 secs 2024-04-21T21:16:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:36 smithi077 ceph-mon[27902]: pgmap v20946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:36.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:36 smithi191 ceph-mon[31636]: pgmap v20946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:37.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:36 smithi170 ceph-mon[31212]: pgmap v20946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:37.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39109.125895 secs 2024-04-21T21:16:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39109.125895 secs 2024-04-21T21:16:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39109.125895 secs 2024-04-21T21:16:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:38 smithi077 ceph-mon[27902]: pgmap v20947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:38 smithi191 ceph-mon[31636]: pgmap v20947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:38 smithi170 ceph-mon[31212]: pgmap v20947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:39.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39110.880375 secs 2024-04-21T21:16:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39110.880375 secs 2024-04-21T21:16:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39110.880375 secs 2024-04-21T21:16:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:40 smithi077 ceph-mon[27902]: pgmap v20948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:16:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:40 smithi191 ceph-mon[31636]: pgmap v20948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:16:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:40 smithi170 ceph-mon[31212]: pgmap v20948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:16:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:41.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:41.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:16:41.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:16:41.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:41.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:16:41.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:16:41.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:42.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:16:42.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:16:42.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:16:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:43 smithi170 ceph-mon[31212]: pgmap v20949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:43.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39114.126015 secs 2024-04-21T21:16:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:43 smithi077 ceph-mon[27902]: pgmap v20949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:43.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39114.126015 secs 2024-04-21T21:16:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:43 smithi191 ceph-mon[31636]: pgmap v20949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:43.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39114.126015 secs 2024-04-21T21:16:44.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39115.880491 secs 2024-04-21T21:16:44.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39115.880491 secs 2024-04-21T21:16:44.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39115.880491 secs 2024-04-21T21:16:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:45.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:45 smithi170 ceph-mon[31212]: pgmap v20950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:45.371 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:45 smithi191 ceph-mon[31636]: pgmap v20950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:45 smithi077 ceph-mon[27902]: pgmap v20950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:46.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:46 smithi170 ceph-mon[31212]: pgmap v20951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:46.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:46 smithi077 ceph-mon[27902]: pgmap v20951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:46.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:46 smithi191 ceph-mon[31636]: pgmap v20951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:47.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39119.126138 secs 2024-04-21T21:16:47.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39119.126138 secs 2024-04-21T21:16:47.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39119.126138 secs 2024-04-21T21:16:48.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:48 smithi077 ceph-mon[27902]: pgmap v20952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:48.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:48 smithi191 ceph-mon[31636]: pgmap v20952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:48.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:48 smithi170 ceph-mon[31212]: pgmap v20952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:49.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39120.880630 secs 2024-04-21T21:16:49.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39120.880630 secs 2024-04-21T21:16:49.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39120.880630 secs 2024-04-21T21:16:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:50.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:50 smithi077 ceph-mon[27902]: pgmap v20953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:50.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:50 smithi191 ceph-mon[31636]: pgmap v20953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:50.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:50 smithi170 ceph-mon[31212]: pgmap v20953: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:52 smithi170 ceph-mon[31212]: pgmap v20954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:52.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39124.126275 secs 2024-04-21T21:16:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:52 smithi077 ceph-mon[27902]: pgmap v20954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:52.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39124.126275 secs 2024-04-21T21:16:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:52 smithi191 ceph-mon[31636]: pgmap v20954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39124.126275 secs 2024-04-21T21:16:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:54 smithi170 ceph-mon[31212]: pgmap v20955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:54.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39125.880721 secs 2024-04-21T21:16:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:54 smithi077 ceph-mon[27902]: pgmap v20955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39125.880721 secs 2024-04-21T21:16:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:54 smithi191 ceph-mon[31636]: pgmap v20955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39125.880721 secs 2024-04-21T21:16:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:16:56.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:56 smithi170 ceph-mon[31212]: pgmap v20956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:56.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:56 smithi077 ceph-mon[27902]: pgmap v20956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:56.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:56 smithi191 ceph-mon[31636]: pgmap v20956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:16:57.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39129.126395 secs 2024-04-21T21:16:57.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39129.126395 secs 2024-04-21T21:16:57.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39129.126395 secs 2024-04-21T21:16:58.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:58 smithi170 ceph-mon[31212]: pgmap v20957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:58.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:58 smithi077 ceph-mon[27902]: pgmap v20957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:58.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:58 smithi191 ceph-mon[31636]: pgmap v20957: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:16:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:16:59.767+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:16:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:16:59.767+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:16:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:16:59.767+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:16:59.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:16:59.768+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:16:59.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:16:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39130.880897 secs 2024-04-21T21:16:59.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:16:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39130.880897 secs 2024-04-21T21:16:59.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:16:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39130.880897 secs 2024-04-21T21:17:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:00.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:00 smithi170 ceph-mon[31212]: pgmap v20958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:00 smithi077 ceph-mon[27902]: pgmap v20958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:00.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:00 smithi191 ceph-mon[31636]: pgmap v20958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:02 smithi170 ceph-mon[31212]: pgmap v20959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:02.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39134.126497 secs 2024-04-21T21:17:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:02 smithi077 ceph-mon[27902]: pgmap v20959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39134.126497 secs 2024-04-21T21:17:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:02 smithi191 ceph-mon[31636]: pgmap v20959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39134.126497 secs 2024-04-21T21:17:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:04 smithi170 ceph-mon[31212]: pgmap v20960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:04.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39135.880999 secs 2024-04-21T21:17:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:04 smithi077 ceph-mon[27902]: pgmap v20960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39135.880999 secs 2024-04-21T21:17:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:04 smithi191 ceph-mon[31636]: pgmap v20960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39135.880999 secs 2024-04-21T21:17:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:05.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:05 smithi170 ceph-mon[31212]: osdmap e1382: 12 total, 12 up, 12 in 2024-04-21T21:17:05.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:05 smithi077 ceph-mon[27902]: osdmap e1382: 12 total, 12 up, 12 in 2024-04-21T21:17:05.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:05 smithi191 ceph-mon[31636]: osdmap e1382: 12 total, 12 up, 12 in 2024-04-21T21:17:06.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:06 smithi170 ceph-mon[31212]: pgmap v20962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:06.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:06 smithi077 ceph-mon[27902]: pgmap v20962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:06.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:06 smithi191 ceph-mon[31636]: pgmap v20962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:07.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39139.126618 secs 2024-04-21T21:17:07.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39139.126618 secs 2024-04-21T21:17:07.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39139.126618 secs 2024-04-21T21:17:08.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:08 smithi170 ceph-mon[31212]: pgmap v20963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:08.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:08 smithi077 ceph-mon[27902]: pgmap v20963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:08.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:08 smithi191 ceph-mon[31636]: pgmap v20963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:09.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39140.881112 secs 2024-04-21T21:17:09.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39140.881112 secs 2024-04-21T21:17:09.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39140.881112 secs 2024-04-21T21:17:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:10 smithi170 ceph-mon[31212]: pgmap v20964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:10.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:10 smithi170 ceph-mon[31212]: osdmap e1383: 12 total, 12 up, 12 in 2024-04-21T21:17:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:10 smithi077 ceph-mon[27902]: pgmap v20964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:10.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:10 smithi077 ceph-mon[27902]: osdmap e1383: 12 total, 12 up, 12 in 2024-04-21T21:17:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:10 smithi191 ceph-mon[31636]: pgmap v20964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:17:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:10 smithi191 ceph-mon[31636]: osdmap e1383: 12 total, 12 up, 12 in 2024-04-21T21:17:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:12 smithi170 ceph-mon[31212]: pgmap v20966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:17:12.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39144.126739 secs 2024-04-21T21:17:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:12 smithi077 ceph-mon[27902]: pgmap v20966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:17:12.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39144.126739 secs 2024-04-21T21:17:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:12 smithi191 ceph-mon[31636]: pgmap v20966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:17:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39144.126739 secs 2024-04-21T21:17:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:14 smithi077 ceph-mon[27902]: pgmap v20967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:17:14.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39145.881231 secs 2024-04-21T21:17:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:14 smithi191 ceph-mon[31636]: pgmap v20967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:17:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39145.881231 secs 2024-04-21T21:17:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:14 smithi170 ceph-mon[31212]: pgmap v20967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:17:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39145.881231 secs 2024-04-21T21:17:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:16.861 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:16 smithi170 ceph-mon[31212]: pgmap v20968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:16.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:16 smithi077 ceph-mon[27902]: pgmap v20968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:16.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:16 smithi191 ceph-mon[31636]: pgmap v20968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:17.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39149.126858 secs 2024-04-21T21:17:17.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39149.126858 secs 2024-04-21T21:17:18.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39149.126858 secs 2024-04-21T21:17:18.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:18 smithi077 ceph-mon[27902]: pgmap v20969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:18.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:18 smithi191 ceph-mon[31636]: pgmap v20969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:18 smithi170 ceph-mon[31212]: pgmap v20969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:19.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39150.881306 secs 2024-04-21T21:17:19.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39150.881306 secs 2024-04-21T21:17:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39150.881306 secs 2024-04-21T21:17:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:20.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:20 smithi077 ceph-mon[27902]: pgmap v20970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:20.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:20 smithi191 ceph-mon[31636]: pgmap v20970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:20 smithi170 ceph-mon[31212]: pgmap v20970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:17:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:22 smithi077 ceph-mon[27902]: pgmap v20971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:17:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39154.126973 secs 2024-04-21T21:17:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:22 smithi191 ceph-mon[31636]: pgmap v20971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:17:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39154.126973 secs 2024-04-21T21:17:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:22 smithi170 ceph-mon[31212]: pgmap v20971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:17:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39154.126973 secs 2024-04-21T21:17:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:24 smithi077 ceph-mon[27902]: pgmap v20972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39155.881393 secs 2024-04-21T21:17:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:24 smithi191 ceph-mon[31636]: pgmap v20972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39155.881393 secs 2024-04-21T21:17:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:24 smithi170 ceph-mon[31212]: pgmap v20972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39155.881393 secs 2024-04-21T21:17:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:26.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:26 smithi077 ceph-mon[27902]: pgmap v20973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:26.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:26 smithi191 ceph-mon[31636]: pgmap v20973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:26 smithi170 ceph-mon[31212]: pgmap v20973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:27.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39159.127089 secs 2024-04-21T21:17:27.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39159.127089 secs 2024-04-21T21:17:28.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39159.127089 secs 2024-04-21T21:17:28.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:28 smithi077 ceph-mon[27902]: pgmap v20974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:28.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:28 smithi191 ceph-mon[31636]: pgmap v20974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:29.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:28 smithi170 ceph-mon[31212]: pgmap v20974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:29.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39160.881508 secs 2024-04-21T21:17:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39160.881508 secs 2024-04-21T21:17:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39160.881508 secs 2024-04-21T21:17:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:30.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:30 smithi077 ceph-mon[27902]: pgmap v20975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:30.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:30 smithi191 ceph-mon[31636]: pgmap v20975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:30 smithi170 ceph-mon[31212]: pgmap v20975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:32 smithi077 ceph-mon[27902]: pgmap v20976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:32.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39164.127209 secs 2024-04-21T21:17:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:32 smithi191 ceph-mon[31636]: pgmap v20976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:32.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39164.127209 secs 2024-04-21T21:17:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:32 smithi170 ceph-mon[31212]: pgmap v20976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39164.127209 secs 2024-04-21T21:17:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:34 smithi077 ceph-mon[27902]: pgmap v20977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39165.881622 secs 2024-04-21T21:17:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:34 smithi191 ceph-mon[31636]: pgmap v20977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39165.881622 secs 2024-04-21T21:17:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:34 smithi170 ceph-mon[31212]: pgmap v20977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39165.881622 secs 2024-04-21T21:17:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:36.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:36 smithi077 ceph-mon[27902]: pgmap v20978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:36.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:36 smithi191 ceph-mon[31636]: pgmap v20978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:37.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:36 smithi170 ceph-mon[31212]: pgmap v20978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:37.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39169.127330 secs 2024-04-21T21:17:37.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39169.127330 secs 2024-04-21T21:17:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39169.127330 secs 2024-04-21T21:17:38.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:38 smithi077 ceph-mon[27902]: pgmap v20979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:38.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:38 smithi191 ceph-mon[31636]: pgmap v20979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:38 smithi170 ceph-mon[31212]: pgmap v20979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:39.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39170.881735 secs 2024-04-21T21:17:39.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39170.881735 secs 2024-04-21T21:17:40.062 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39170.881735 secs 2024-04-21T21:17:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:40.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:40 smithi077 ceph-mon[27902]: pgmap v20980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:40.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:40 smithi191 ceph-mon[31636]: pgmap v20980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:40 smithi170 ceph-mon[31212]: pgmap v20980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:41.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:41 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:17:41.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:41 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:17:42.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:41 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: pgmap v20981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39174.127399 secs 2024-04-21T21:17:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:17:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:17:42.971 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: pgmap v20981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39174.127399 secs 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:17:43.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: pgmap v20981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39174.127399 secs 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:17:43.139 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:17:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:44 smithi191 ceph-mon[31636]: pgmap v20982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39175.881871 secs 2024-04-21T21:17:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:44 smithi170 ceph-mon[31212]: pgmap v20982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39175.881871 secs 2024-04-21T21:17:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:44 smithi077 ceph-mon[27902]: pgmap v20982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39175.881871 secs 2024-04-21T21:17:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:46 smithi170 ceph-mon[31212]: pgmap v20983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:47.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:46 smithi077 ceph-mon[27902]: pgmap v20983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:47.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:46 smithi191 ceph-mon[31636]: pgmap v20983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:48.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39179.127553 secs 2024-04-21T21:17:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39179.127553 secs 2024-04-21T21:17:48.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39179.127553 secs 2024-04-21T21:17:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:48 smithi170 ceph-mon[31212]: pgmap v20984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:49.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:48 smithi077 ceph-mon[27902]: pgmap v20984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:49.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:48 smithi191 ceph-mon[31636]: pgmap v20984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39180.881949 secs 2024-04-21T21:17:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39180.881949 secs 2024-04-21T21:17:50.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39180.881949 secs 2024-04-21T21:17:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:50 smithi170 ceph-mon[31212]: pgmap v20985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:50 smithi077 ceph-mon[27902]: pgmap v20985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:50 smithi191 ceph-mon[31636]: pgmap v20985: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:52 smithi170 ceph-mon[31212]: pgmap v20986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39184.127667 secs 2024-04-21T21:17:53.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:52 smithi077 ceph-mon[27902]: pgmap v20986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:53.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39184.127667 secs 2024-04-21T21:17:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:52 smithi191 ceph-mon[31636]: pgmap v20986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39184.127667 secs 2024-04-21T21:17:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:54 smithi170 ceph-mon[31212]: pgmap v20987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39185.882091 secs 2024-04-21T21:17:55.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:17:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:54 smithi077 ceph-mon[27902]: pgmap v20987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:55.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39185.882091 secs 2024-04-21T21:17:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:54 smithi191 ceph-mon[31636]: pgmap v20987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39185.882091 secs 2024-04-21T21:17:57.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:56 smithi170 ceph-mon[31212]: pgmap v20988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:56 smithi077 ceph-mon[27902]: pgmap v20988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:56 smithi191 ceph-mon[31636]: pgmap v20988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:17:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39189.127785 secs 2024-04-21T21:17:58.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39189.127785 secs 2024-04-21T21:17:58.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39189.127785 secs 2024-04-21T21:17:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:58 smithi170 ceph-mon[31212]: pgmap v20989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:59.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:58 smithi077 ceph-mon[27902]: pgmap v20989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:17:59.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:58 smithi191 ceph-mon[31636]: pgmap v20989: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:17:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39190.882229 secs 2024-04-21T21:18:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:17:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39190.882229 secs 2024-04-21T21:18:00.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:17:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39190.882229 secs 2024-04-21T21:18:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:00 smithi170 ceph-mon[31212]: pgmap v20990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:01.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:00 smithi077 ceph-mon[27902]: pgmap v20990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:00 smithi191 ceph-mon[31636]: pgmap v20990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:02 smithi170 ceph-mon[31212]: pgmap v20991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:03.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39194.127893 secs 2024-04-21T21:18:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:02 smithi077 ceph-mon[27902]: pgmap v20991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:03.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39194.127893 secs 2024-04-21T21:18:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:02 smithi191 ceph-mon[31636]: pgmap v20991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39194.127893 secs 2024-04-21T21:18:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:04 smithi170 ceph-mon[31212]: pgmap v20992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39195.882312 secs 2024-04-21T21:18:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:04 smithi077 ceph-mon[27902]: pgmap v20992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39195.882312 secs 2024-04-21T21:18:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:04 smithi191 ceph-mon[31636]: pgmap v20992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39195.882312 secs 2024-04-21T21:18:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:05 smithi170 ceph-mon[31212]: osdmap e1384: 12 total, 12 up, 12 in 2024-04-21T21:18:06.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:05 smithi077 ceph-mon[27902]: osdmap e1384: 12 total, 12 up, 12 in 2024-04-21T21:18:06.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:05 smithi191 ceph-mon[31636]: osdmap e1384: 12 total, 12 up, 12 in 2024-04-21T21:18:07.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:06 smithi170 ceph-mon[31212]: pgmap v20994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:07.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:06 smithi077 ceph-mon[27902]: pgmap v20994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:07.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:06 smithi191 ceph-mon[31636]: pgmap v20994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39199.128009 secs 2024-04-21T21:18:08.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39199.128009 secs 2024-04-21T21:18:08.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39199.128009 secs 2024-04-21T21:18:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:08 smithi170 ceph-mon[31212]: pgmap v20995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:09.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:08 smithi077 ceph-mon[27902]: pgmap v20995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:09.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:08 smithi191 ceph-mon[31636]: pgmap v20995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39200.882455 secs 2024-04-21T21:18:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39200.882455 secs 2024-04-21T21:18:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39200.882455 secs 2024-04-21T21:18:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:10 smithi170 ceph-mon[31212]: pgmap v20996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:10 smithi170 ceph-mon[31212]: osdmap e1385: 12 total, 12 up, 12 in 2024-04-21T21:18:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:10 smithi077 ceph-mon[27902]: pgmap v20996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:10 smithi077 ceph-mon[27902]: osdmap e1385: 12 total, 12 up, 12 in 2024-04-21T21:18:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:10 smithi191 ceph-mon[31636]: pgmap v20996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:18:11.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:10 smithi191 ceph-mon[31636]: osdmap e1385: 12 total, 12 up, 12 in 2024-04-21T21:18:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:12 smithi170 ceph-mon[31212]: pgmap v20998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:18:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39204.128101 secs 2024-04-21T21:18:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:12 smithi077 ceph-mon[27902]: pgmap v20998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:18:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39204.128101 secs 2024-04-21T21:18:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:12 smithi191 ceph-mon[31636]: pgmap v20998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:18:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39204.128101 secs 2024-04-21T21:18:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:14 smithi170 ceph-mon[31212]: pgmap v20999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T21:18:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39205.882548 secs 2024-04-21T21:18:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:14 smithi077 ceph-mon[27902]: pgmap v20999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T21:18:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39205.882548 secs 2024-04-21T21:18:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:14 smithi191 ceph-mon[31636]: pgmap v20999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2024-04-21T21:18:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39205.882548 secs 2024-04-21T21:18:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:16 smithi170 ceph-mon[31212]: pgmap v21000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:17.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:16 smithi077 ceph-mon[27902]: pgmap v21000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:17.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:16 smithi191 ceph-mon[31636]: pgmap v21000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:18.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39209.128224 secs 2024-04-21T21:18:18.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39209.128224 secs 2024-04-21T21:18:18.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39209.128224 secs 2024-04-21T21:18:19.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:18 smithi077 ceph-mon[27902]: pgmap v21001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:19.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:18 smithi191 ceph-mon[31636]: pgmap v21001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:19.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:18 smithi170 ceph-mon[31212]: pgmap v21001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39210.882671 secs 2024-04-21T21:18:20.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39210.882671 secs 2024-04-21T21:18:20.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39210.882671 secs 2024-04-21T21:18:21.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:20 smithi077 ceph-mon[27902]: pgmap v21002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:20 smithi191 ceph-mon[31636]: pgmap v21002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:21.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:20 smithi170 ceph-mon[31212]: pgmap v21002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:18:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:22 smithi077 ceph-mon[27902]: pgmap v21003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:18:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39214.128362 secs 2024-04-21T21:18:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:22 smithi191 ceph-mon[31636]: pgmap v21003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:18:23.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39214.128362 secs 2024-04-21T21:18:23.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:22 smithi170 ceph-mon[31212]: pgmap v21003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:18:23.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39214.128362 secs 2024-04-21T21:18:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:24 smithi077 ceph-mon[27902]: pgmap v21004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39215.882792 secs 2024-04-21T21:18:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:24 smithi191 ceph-mon[31636]: pgmap v21004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39215.882792 secs 2024-04-21T21:18:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:24 smithi170 ceph-mon[31212]: pgmap v21004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39215.882792 secs 2024-04-21T21:18:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:26 smithi077 ceph-mon[27902]: pgmap v21005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:27.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:26 smithi191 ceph-mon[31636]: pgmap v21005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:27.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:26 smithi170 ceph-mon[31212]: pgmap v21005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39219.128460 secs 2024-04-21T21:18:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39219.128460 secs 2024-04-21T21:18:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39219.128460 secs 2024-04-21T21:18:29.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:28 smithi077 ceph-mon[27902]: pgmap v21006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:29.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:28 smithi191 ceph-mon[31636]: pgmap v21006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:29.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:28 smithi170 ceph-mon[31212]: pgmap v21006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39220.882940 secs 2024-04-21T21:18:30.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39220.882940 secs 2024-04-21T21:18:30.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39220.882940 secs 2024-04-21T21:18:31.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:30 smithi077 ceph-mon[27902]: pgmap v21007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:31.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:30 smithi191 ceph-mon[31636]: pgmap v21007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:31.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:30 smithi170 ceph-mon[31212]: pgmap v21007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:32 smithi077 ceph-mon[27902]: pgmap v21008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39224.128576 secs 2024-04-21T21:18:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:32 smithi191 ceph-mon[31636]: pgmap v21008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:33.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39224.128576 secs 2024-04-21T21:18:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:32 smithi170 ceph-mon[31212]: pgmap v21008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39224.128576 secs 2024-04-21T21:18:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:34 smithi077 ceph-mon[27902]: pgmap v21009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39225.883004 secs 2024-04-21T21:18:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:34 smithi191 ceph-mon[31636]: pgmap v21009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39225.883004 secs 2024-04-21T21:18:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:34 smithi170 ceph-mon[31212]: pgmap v21009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39225.883004 secs 2024-04-21T21:18:37.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:36 smithi077 ceph-mon[27902]: pgmap v21010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:37.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:36 smithi191 ceph-mon[31636]: pgmap v21010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:37.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:36 smithi170 ceph-mon[31212]: pgmap v21010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39229.128715 secs 2024-04-21T21:18:38.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39229.128715 secs 2024-04-21T21:18:38.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39229.128715 secs 2024-04-21T21:18:39.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:38 smithi077 ceph-mon[27902]: pgmap v21011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:39.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:38 smithi191 ceph-mon[31636]: pgmap v21011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:39.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:38 smithi170 ceph-mon[31212]: pgmap v21011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39230.883095 secs 2024-04-21T21:18:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39230.883095 secs 2024-04-21T21:18:40.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39230.883095 secs 2024-04-21T21:18:41.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:40 smithi077 ceph-mon[27902]: pgmap v21012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:41.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:40 smithi191 ceph-mon[31636]: pgmap v21012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:41.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:40 smithi170 ceph-mon[31212]: pgmap v21012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:18:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:42 smithi077 ceph-mon[27902]: pgmap v21013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:43.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39234.128836 secs 2024-04-21T21:18:43.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:42 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:18:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:42 smithi191 ceph-mon[31636]: pgmap v21013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39234.128836 secs 2024-04-21T21:18:43.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:42 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:18:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:42 smithi170 ceph-mon[31212]: pgmap v21013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39234.128836 secs 2024-04-21T21:18:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:42 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:18:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:18:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:18:44.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:18:44.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:18:44.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:18:44.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:18:44.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:18:44.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:18:44.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:18:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:44 smithi077 ceph-mon[27902]: pgmap v21014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:45.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39235.883175 secs 2024-04-21T21:18:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:44 smithi191 ceph-mon[31636]: pgmap v21014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39235.883175 secs 2024-04-21T21:18:45.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:44 smithi170 ceph-mon[31212]: pgmap v21014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:45.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39235.883175 secs 2024-04-21T21:18:47.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:46 smithi077 ceph-mon[27902]: pgmap v21015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:47.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:46 smithi191 ceph-mon[31636]: pgmap v21015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:47.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:46 smithi170 ceph-mon[31212]: pgmap v21015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39239.128936 secs 2024-04-21T21:18:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39239.128936 secs 2024-04-21T21:18:48.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39239.128936 secs 2024-04-21T21:18:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:48 smithi077 ceph-mon[27902]: pgmap v21016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:48 smithi191 ceph-mon[31636]: pgmap v21016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:49.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:48 smithi170 ceph-mon[31212]: pgmap v21016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:50.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39240.883254 secs 2024-04-21T21:18:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39240.883254 secs 2024-04-21T21:18:50.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39240.883254 secs 2024-04-21T21:18:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:50 smithi191 ceph-mon[31636]: pgmap v21017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:50 smithi170 ceph-mon[31212]: pgmap v21017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:51.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:50 smithi077 ceph-mon[27902]: pgmap v21017: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:52 smithi191 ceph-mon[31636]: pgmap v21018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39244.129059 secs 2024-04-21T21:18:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:52 smithi170 ceph-mon[31212]: pgmap v21018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39244.129059 secs 2024-04-21T21:18:53.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:52 smithi077 ceph-mon[27902]: pgmap v21018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:53.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39244.129059 secs 2024-04-21T21:18:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:18:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:54 smithi191 ceph-mon[31636]: pgmap v21019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:55.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39245.883373 secs 2024-04-21T21:18:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:54 smithi170 ceph-mon[31212]: pgmap v21019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39245.883373 secs 2024-04-21T21:18:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:54 smithi077 ceph-mon[27902]: pgmap v21019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39245.883373 secs 2024-04-21T21:18:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:56 smithi191 ceph-mon[31636]: pgmap v21020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:57.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:56 smithi170 ceph-mon[31212]: pgmap v21020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:57.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:56 smithi077 ceph-mon[27902]: pgmap v21020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:18:58.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39249.129173 secs 2024-04-21T21:18:58.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39249.129173 secs 2024-04-21T21:18:58.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39249.129173 secs 2024-04-21T21:18:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:58 smithi191 ceph-mon[31636]: pgmap v21021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:59.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:58 smithi170 ceph-mon[31212]: pgmap v21021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:18:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:58 smithi077 ceph-mon[27902]: pgmap v21021: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:18:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39250.883492 secs 2024-04-21T21:19:00.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:18:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39250.883492 secs 2024-04-21T21:19:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:18:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39250.883492 secs 2024-04-21T21:19:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:00 smithi191 ceph-mon[31636]: pgmap v21022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:00 smithi170 ceph-mon[31212]: pgmap v21022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:01.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:00 smithi077 ceph-mon[27902]: pgmap v21022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:02 smithi191 ceph-mon[31636]: pgmap v21023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:03.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39254.129303 secs 2024-04-21T21:19:03.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:02 smithi170 ceph-mon[31212]: pgmap v21023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:03.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39254.129303 secs 2024-04-21T21:19:03.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:02 smithi077 ceph-mon[27902]: pgmap v21023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:03.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39254.129303 secs 2024-04-21T21:19:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:05.188 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:04 smithi077 ceph-mon[27902]: pgmap v21024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:19:05.188 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39255.883593 secs 2024-04-21T21:19:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:04 smithi191 ceph-mon[31636]: pgmap v21024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:19:05.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39255.883593 secs 2024-04-21T21:19:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:04 smithi170 ceph-mon[31212]: pgmap v21024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:19:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39255.883593 secs 2024-04-21T21:19:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:05 smithi191 ceph-mon[31636]: osdmap e1386: 12 total, 12 up, 12 in 2024-04-21T21:19:06.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:05 smithi170 ceph-mon[31212]: osdmap e1386: 12 total, 12 up, 12 in 2024-04-21T21:19:06.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:05 smithi077 ceph-mon[27902]: osdmap e1386: 12 total, 12 up, 12 in 2024-04-21T21:19:07.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:06 smithi191 ceph-mon[31636]: pgmap v21026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:07.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:06 smithi170 ceph-mon[31212]: pgmap v21026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:07.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:06 smithi077 ceph-mon[27902]: pgmap v21026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39259.129421 secs 2024-04-21T21:19:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39259.129421 secs 2024-04-21T21:19:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39259.129421 secs 2024-04-21T21:19:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:08 smithi191 ceph-mon[31636]: pgmap v21027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:08 smithi170 ceph-mon[31212]: pgmap v21027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:08 smithi077 ceph-mon[27902]: pgmap v21027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39260.883717 secs 2024-04-21T21:19:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39260.883717 secs 2024-04-21T21:19:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39260.883717 secs 2024-04-21T21:19:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:10 smithi191 ceph-mon[31636]: pgmap v21028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:10 smithi170 ceph-mon[31212]: pgmap v21028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:11.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:10 smithi077 ceph-mon[27902]: pgmap v21028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:19:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:12 smithi191 ceph-mon[31636]: pgmap v21029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:19:13.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39264.129536 secs 2024-04-21T21:19:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:12 smithi170 ceph-mon[31212]: pgmap v21029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:19:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39264.129536 secs 2024-04-21T21:19:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:12 smithi077 ceph-mon[27902]: pgmap v21029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:19:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39264.129536 secs 2024-04-21T21:19:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:14 smithi191 ceph-mon[31636]: pgmap v21030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:19:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39265.883841 secs 2024-04-21T21:19:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:14 smithi170 ceph-mon[31212]: pgmap v21030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:19:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39265.883841 secs 2024-04-21T21:19:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:14 smithi077 ceph-mon[27902]: pgmap v21030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:19:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39265.883841 secs 2024-04-21T21:19:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:16 smithi191 ceph-mon[31636]: osdmap e1387: 12 total, 12 up, 12 in 2024-04-21T21:19:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:16 smithi191 ceph-mon[31636]: pgmap v21032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:16 smithi170 ceph-mon[31212]: osdmap e1387: 12 total, 12 up, 12 in 2024-04-21T21:19:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:16 smithi170 ceph-mon[31212]: pgmap v21032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:16 smithi077 ceph-mon[27902]: osdmap e1387: 12 total, 12 up, 12 in 2024-04-21T21:19:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:16 smithi077 ceph-mon[27902]: pgmap v21032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39269.129655 secs 2024-04-21T21:19:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39269.129655 secs 2024-04-21T21:19:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39269.129655 secs 2024-04-21T21:19:18.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:18 smithi077 ceph-mon[27902]: pgmap v21033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:18 smithi191 ceph-mon[31636]: pgmap v21033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:18 smithi170 ceph-mon[31212]: pgmap v21033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39270.883964 secs 2024-04-21T21:19:19.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39270.883964 secs 2024-04-21T21:19:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39270.883964 secs 2024-04-21T21:19:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:20 smithi077 ceph-mon[27902]: pgmap v21034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:20 smithi191 ceph-mon[31636]: pgmap v21034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:20 smithi170 ceph-mon[31212]: pgmap v21034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:19:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:22 smithi170 ceph-mon[31212]: pgmap v21035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:19:22.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39274.129792 secs 2024-04-21T21:19:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:22 smithi077 ceph-mon[27902]: pgmap v21035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:19:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39274.129792 secs 2024-04-21T21:19:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:22 smithi191 ceph-mon[31636]: pgmap v21035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:19:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39274.129792 secs 2024-04-21T21:19:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:24 smithi170 ceph-mon[31212]: pgmap v21036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:19:24.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39275.884071 secs 2024-04-21T21:19:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:24 smithi077 ceph-mon[27902]: pgmap v21036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:19:24.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39275.884071 secs 2024-04-21T21:19:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:24 smithi191 ceph-mon[31636]: pgmap v21036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:19:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39275.884071 secs 2024-04-21T21:19:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:26.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:26 smithi191 ceph-mon[31636]: pgmap v21037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:19:26.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:26 smithi170 ceph-mon[31212]: pgmap v21037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:19:26.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:26 smithi077 ceph-mon[27902]: pgmap v21037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T21:19:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39279.129950 secs 2024-04-21T21:19:27.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39279.129950 secs 2024-04-21T21:19:27.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39279.129950 secs 2024-04-21T21:19:28.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:28 smithi077 ceph-mon[27902]: pgmap v21038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:28 smithi191 ceph-mon[31636]: pgmap v21038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:28.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:28 smithi170 ceph-mon[31212]: pgmap v21038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:29.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39280.884187 secs 2024-04-21T21:19:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39280.884187 secs 2024-04-21T21:19:29.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39280.884187 secs 2024-04-21T21:19:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:30 smithi077 ceph-mon[27902]: pgmap v21039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:30 smithi191 ceph-mon[31636]: pgmap v21039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:30 smithi170 ceph-mon[31212]: pgmap v21039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:32 smithi170 ceph-mon[31212]: pgmap v21040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:32.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39284.130072 secs 2024-04-21T21:19:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:32 smithi077 ceph-mon[27902]: pgmap v21040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39284.130072 secs 2024-04-21T21:19:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:32 smithi191 ceph-mon[31636]: pgmap v21040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39284.130072 secs 2024-04-21T21:19:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:34 smithi170 ceph-mon[31212]: pgmap v21041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:34.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39285.884269 secs 2024-04-21T21:19:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:34 smithi077 ceph-mon[27902]: pgmap v21041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:34.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39285.884269 secs 2024-04-21T21:19:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:34 smithi191 ceph-mon[31636]: pgmap v21041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39285.884269 secs 2024-04-21T21:19:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:36.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:36 smithi170 ceph-mon[31212]: pgmap v21042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:36 smithi077 ceph-mon[27902]: pgmap v21042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:36 smithi191 ceph-mon[31636]: pgmap v21042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:37.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39289.130185 secs 2024-04-21T21:19:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39289.130185 secs 2024-04-21T21:19:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39289.130185 secs 2024-04-21T21:19:38.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:38 smithi170 ceph-mon[31212]: pgmap v21043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:38 smithi077 ceph-mon[27902]: pgmap v21043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:38 smithi191 ceph-mon[31636]: pgmap v21043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39290.884391 secs 2024-04-21T21:19:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39290.884391 secs 2024-04-21T21:19:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39290.884391 secs 2024-04-21T21:19:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:40 smithi077 ceph-mon[27902]: pgmap v21044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:40 smithi191 ceph-mon[31636]: pgmap v21044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:40 smithi170 ceph-mon[31212]: pgmap v21044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:42 smithi077 ceph-mon[27902]: pgmap v21045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:42.890 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39294.130302 secs 2024-04-21T21:19:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:42 smithi191 ceph-mon[31636]: pgmap v21045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:42.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39294.130302 secs 2024-04-21T21:19:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:42 smithi170 ceph-mon[31212]: pgmap v21045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39294.130302 secs 2024-04-21T21:19:43.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:43 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:19:43.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:43 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:19:44.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:43 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:19:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:44 smithi077 ceph-mon[27902]: pgmap v21046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:19:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:19:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:19:44.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39295.884483 secs 2024-04-21T21:19:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:44 smithi191 ceph-mon[31636]: pgmap v21046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:19:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:19:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:19:44.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39295.884483 secs 2024-04-21T21:19:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:44 smithi170 ceph-mon[31212]: pgmap v21046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:19:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:19:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:19:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39295.884483 secs 2024-04-21T21:19:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:46 smithi077 ceph-mon[27902]: pgmap v21047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:46 smithi191 ceph-mon[31636]: pgmap v21047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:46 smithi170 ceph-mon[31212]: pgmap v21047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:47.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39299.130418 secs 2024-04-21T21:19:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39299.130418 secs 2024-04-21T21:19:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39299.130418 secs 2024-04-21T21:19:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:48 smithi077 ceph-mon[27902]: pgmap v21048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:48 smithi191 ceph-mon[31636]: pgmap v21048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:48 smithi170 ceph-mon[31212]: pgmap v21048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39300.884610 secs 2024-04-21T21:19:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39300.884610 secs 2024-04-21T21:19:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39300.884610 secs 2024-04-21T21:19:50.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:50.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:50 smithi077 ceph-mon[27902]: pgmap v21049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:50 smithi191 ceph-mon[31636]: pgmap v21049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:50 smithi170 ceph-mon[31212]: pgmap v21049: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:52 smithi077 ceph-mon[27902]: pgmap v21050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:52.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39304.130537 secs 2024-04-21T21:19:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:52 smithi191 ceph-mon[31636]: pgmap v21050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:52.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39304.130537 secs 2024-04-21T21:19:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:52 smithi170 ceph-mon[31212]: pgmap v21050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39304.130537 secs 2024-04-21T21:19:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:54 smithi077 ceph-mon[27902]: pgmap v21051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:54.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39305.884738 secs 2024-04-21T21:19:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:54 smithi191 ceph-mon[31636]: pgmap v21051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:54.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39305.884738 secs 2024-04-21T21:19:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:54 smithi170 ceph-mon[31212]: pgmap v21051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39305.884738 secs 2024-04-21T21:19:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:19:56.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:56 smithi077 ceph-mon[27902]: pgmap v21052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:56 smithi191 ceph-mon[31636]: pgmap v21052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:57.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:56 smithi170 ceph-mon[31212]: pgmap v21052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:19:57.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39309.130671 secs 2024-04-21T21:19:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39309.130671 secs 2024-04-21T21:19:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39309.130671 secs 2024-04-21T21:19:58.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:58 smithi077 ceph-mon[27902]: pgmap v21053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:58 smithi191 ceph-mon[31636]: pgmap v21053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:58 smithi170 ceph-mon[31212]: pgmap v21053: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:19:59.792 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:19:59.791+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:19:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:19:59.791+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:19:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:19:59.792+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:19:59.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:19:59.792+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:19:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:19:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39310.884882 secs 2024-04-21T21:19:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:19:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39310.884882 secs 2024-04-21T21:20:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:19:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39310.884882 secs 2024-04-21T21:20:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:00 smithi077 ceph-mon[27902]: pgmap v21054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:00.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:20:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:00 smithi191 ceph-mon[31636]: pgmap v21054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:20:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:00 smithi170 ceph-mon[31212]: pgmap v21054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:20:02.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:02 smithi077 ceph-mon[27902]: pgmap v21055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:02.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39314.130816 secs 2024-04-21T21:20:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:02 smithi191 ceph-mon[31636]: pgmap v21055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:02.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39314.130816 secs 2024-04-21T21:20:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:02 smithi170 ceph-mon[31212]: pgmap v21055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39314.130816 secs 2024-04-21T21:20:04.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:04 smithi077 ceph-mon[27902]: pgmap v21056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:04.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39315.884970 secs 2024-04-21T21:20:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:04 smithi191 ceph-mon[31636]: pgmap v21056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:04.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39315.884970 secs 2024-04-21T21:20:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:04 smithi170 ceph-mon[31212]: pgmap v21056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39315.884970 secs 2024-04-21T21:20:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:05 smithi077 ceph-mon[27902]: osdmap e1388: 12 total, 12 up, 12 in 2024-04-21T21:20:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:05 smithi191 ceph-mon[31636]: osdmap e1388: 12 total, 12 up, 12 in 2024-04-21T21:20:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:05 smithi170 ceph-mon[31212]: osdmap e1388: 12 total, 12 up, 12 in 2024-04-21T21:20:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:06 smithi077 ceph-mon[27902]: pgmap v21058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:06 smithi191 ceph-mon[31636]: pgmap v21058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:07.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:06 smithi170 ceph-mon[31212]: pgmap v21058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39319.130888 secs 2024-04-21T21:20:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39319.130888 secs 2024-04-21T21:20:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39319.130888 secs 2024-04-21T21:20:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:08 smithi191 ceph-mon[31636]: pgmap v21059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:08 smithi170 ceph-mon[31212]: pgmap v21059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:09.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:08 smithi077 ceph-mon[27902]: pgmap v21059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39320.885065 secs 2024-04-21T21:20:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39320.885065 secs 2024-04-21T21:20:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39320.885065 secs 2024-04-21T21:20:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:10 smithi191 ceph-mon[31636]: pgmap v21060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:10.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:10 smithi191 ceph-mon[31636]: osdmap e1389: 12 total, 12 up, 12 in 2024-04-21T21:20:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:10 smithi170 ceph-mon[31212]: pgmap v21060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:10 smithi170 ceph-mon[31212]: osdmap e1389: 12 total, 12 up, 12 in 2024-04-21T21:20:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:10 smithi077 ceph-mon[27902]: pgmap v21060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:20:11.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:10 smithi077 ceph-mon[27902]: osdmap e1389: 12 total, 12 up, 12 in 2024-04-21T21:20:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:12 smithi191 ceph-mon[31636]: pgmap v21062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:20:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39324.131003 secs 2024-04-21T21:20:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:12 smithi170 ceph-mon[31212]: pgmap v21062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:20:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39324.131003 secs 2024-04-21T21:20:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:12 smithi077 ceph-mon[27902]: pgmap v21062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:20:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39324.131003 secs 2024-04-21T21:20:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:14 smithi191 ceph-mon[31636]: pgmap v21063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:20:14.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39325.885157 secs 2024-04-21T21:20:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:14 smithi170 ceph-mon[31212]: pgmap v21063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:20:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39325.885157 secs 2024-04-21T21:20:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:14 smithi077 ceph-mon[27902]: pgmap v21063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:20:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39325.885157 secs 2024-04-21T21:20:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:16 smithi191 ceph-mon[31636]: pgmap v21064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:17.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:16 smithi170 ceph-mon[31212]: pgmap v21064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:16 smithi077 ceph-mon[27902]: pgmap v21064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:17.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39329.131119 secs 2024-04-21T21:20:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39329.131119 secs 2024-04-21T21:20:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39329.131119 secs 2024-04-21T21:20:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:18 smithi191 ceph-mon[31636]: pgmap v21065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:19.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:18 smithi170 ceph-mon[31212]: pgmap v21065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:18 smithi077 ceph-mon[27902]: pgmap v21065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39330.885231 secs 2024-04-21T21:20:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39330.885231 secs 2024-04-21T21:20:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39330.885231 secs 2024-04-21T21:20:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:20 smithi191 ceph-mon[31636]: pgmap v21066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:20 smithi170 ceph-mon[31212]: pgmap v21066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:20 smithi077 ceph-mon[27902]: pgmap v21066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:20:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:22 smithi191 ceph-mon[31636]: pgmap v21067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:20:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39334.131216 secs 2024-04-21T21:20:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:22 smithi170 ceph-mon[31212]: pgmap v21067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:20:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39334.131216 secs 2024-04-21T21:20:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:22 smithi077 ceph-mon[27902]: pgmap v21067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 90 B/s wr, 8 op/s 2024-04-21T21:20:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39334.131216 secs 2024-04-21T21:20:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:24 smithi191 ceph-mon[31636]: pgmap v21068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:24.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39335.885325 secs 2024-04-21T21:20:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:24 smithi170 ceph-mon[31212]: pgmap v21068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39335.885325 secs 2024-04-21T21:20:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:24 smithi077 ceph-mon[27902]: pgmap v21068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39335.885325 secs 2024-04-21T21:20:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:26 smithi191 ceph-mon[31636]: pgmap v21069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:26 smithi170 ceph-mon[31212]: pgmap v21069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:26 smithi077 ceph-mon[27902]: pgmap v21069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39339.131326 secs 2024-04-21T21:20:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39339.131326 secs 2024-04-21T21:20:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39339.131326 secs 2024-04-21T21:20:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:28 smithi191 ceph-mon[31636]: pgmap v21070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:29.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:28 smithi170 ceph-mon[31212]: pgmap v21070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:28 smithi077 ceph-mon[27902]: pgmap v21070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39340.885416 secs 2024-04-21T21:20:30.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39340.885416 secs 2024-04-21T21:20:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39340.885416 secs 2024-04-21T21:20:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:30 smithi191 ceph-mon[31636]: pgmap v21071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:30 smithi170 ceph-mon[31212]: pgmap v21071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:30 smithi077 ceph-mon[27902]: pgmap v21071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:32 smithi191 ceph-mon[31636]: pgmap v21072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39344.131442 secs 2024-04-21T21:20:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:32 smithi170 ceph-mon[31212]: pgmap v21072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39344.131442 secs 2024-04-21T21:20:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:32 smithi077 ceph-mon[27902]: pgmap v21072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39344.131442 secs 2024-04-21T21:20:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:34 smithi191 ceph-mon[31636]: pgmap v21073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:34.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39345.885576 secs 2024-04-21T21:20:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:34 smithi170 ceph-mon[31212]: pgmap v21073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39345.885576 secs 2024-04-21T21:20:35.075 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:34 smithi077 ceph-mon[27902]: pgmap v21073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:35.075 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39345.885576 secs 2024-04-21T21:20:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:36 smithi191 ceph-mon[31636]: pgmap v21074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:37.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:36 smithi170 ceph-mon[31212]: pgmap v21074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:36 smithi077 ceph-mon[27902]: pgmap v21074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39349.131550 secs 2024-04-21T21:20:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39349.131550 secs 2024-04-21T21:20:38.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39349.131550 secs 2024-04-21T21:20:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:38 smithi170 ceph-mon[31212]: pgmap v21075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:38 smithi077 ceph-mon[27902]: pgmap v21075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:38 smithi191 ceph-mon[31636]: pgmap v21075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39350.885706 secs 2024-04-21T21:20:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39350.885706 secs 2024-04-21T21:20:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39350.885706 secs 2024-04-21T21:20:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:40 smithi170 ceph-mon[31212]: pgmap v21076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:40 smithi077 ceph-mon[27902]: pgmap v21076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:40 smithi191 ceph-mon[31636]: pgmap v21076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:42 smithi170 ceph-mon[31212]: pgmap v21077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39354.131663 secs 2024-04-21T21:20:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:42 smithi077 ceph-mon[27902]: pgmap v21077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39354.131663 secs 2024-04-21T21:20:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:42 smithi191 ceph-mon[31636]: pgmap v21077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39354.131663 secs 2024-04-21T21:20:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:20:44.798+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:20:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:20:44.798+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:20:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:20:44.798+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:20:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:20:44.798+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:20:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:44 smithi170 ceph-mon[31212]: pgmap v21078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39355.885851 secs 2024-04-21T21:20:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:20:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:20:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:20:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:44 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:20:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:44 smithi077 ceph-mon[27902]: pgmap v21078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39355.885851 secs 2024-04-21T21:20:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:20:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:20:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:20:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:44 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:20:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:44 smithi191 ceph-mon[31636]: pgmap v21078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39355.885851 secs 2024-04-21T21:20:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:20:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:20:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:20:45.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:44 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:20:47.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:46 smithi191 ceph-mon[31636]: pgmap v21079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:46 smithi170 ceph-mon[31212]: pgmap v21079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:46 smithi077 ceph-mon[27902]: pgmap v21079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:48.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39359.131799 secs 2024-04-21T21:20:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39359.131799 secs 2024-04-21T21:20:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39359.131799 secs 2024-04-21T21:20:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:48 smithi170 ceph-mon[31212]: pgmap v21080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:48 smithi077 ceph-mon[27902]: pgmap v21080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:48 smithi191 ceph-mon[31636]: pgmap v21080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39360.885980 secs 2024-04-21T21:20:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39360.885980 secs 2024-04-21T21:20:50.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39360.885980 secs 2024-04-21T21:20:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:50 smithi170 ceph-mon[31212]: pgmap v21081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:50 smithi077 ceph-mon[27902]: pgmap v21081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:50 smithi191 ceph-mon[31636]: pgmap v21081: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:52 smithi170 ceph-mon[31212]: pgmap v21082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39364.131907 secs 2024-04-21T21:20:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:52 smithi077 ceph-mon[27902]: pgmap v21082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39364.131907 secs 2024-04-21T21:20:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:52 smithi191 ceph-mon[31636]: pgmap v21082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:53.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39364.131907 secs 2024-04-21T21:20:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:54 smithi170 ceph-mon[31212]: pgmap v21083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39365.886080 secs 2024-04-21T21:20:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:20:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:54 smithi077 ceph-mon[27902]: pgmap v21083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39365.886080 secs 2024-04-21T21:20:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:54 smithi191 ceph-mon[31636]: pgmap v21083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39365.886080 secs 2024-04-21T21:20:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:56 smithi170 ceph-mon[31212]: pgmap v21084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:56 smithi077 ceph-mon[27902]: pgmap v21084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:56 smithi191 ceph-mon[31636]: pgmap v21084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:20:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39369.132038 secs 2024-04-21T21:20:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39369.132038 secs 2024-04-21T21:20:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39369.132038 secs 2024-04-21T21:20:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:58 smithi170 ceph-mon[31212]: pgmap v21085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:58 smithi077 ceph-mon[27902]: pgmap v21085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:20:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:58 smithi191 ceph-mon[31636]: pgmap v21085: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:00.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:20:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39370.886173 secs 2024-04-21T21:21:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:20:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39370.886173 secs 2024-04-21T21:21:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:20:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39370.886173 secs 2024-04-21T21:21:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:00 smithi170 ceph-mon[31212]: pgmap v21086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:00 smithi077 ceph-mon[27902]: pgmap v21086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:00 smithi191 ceph-mon[31636]: pgmap v21086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:02 smithi170 ceph-mon[31212]: pgmap v21087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-21T21:21:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39374.132179 secs 2024-04-21T21:21:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:02 smithi077 ceph-mon[27902]: pgmap v21087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-21T21:21:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39374.132179 secs 2024-04-21T21:21:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:02 smithi191 ceph-mon[31636]: pgmap v21087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-21T21:21:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39374.132179 secs 2024-04-21T21:21:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:04 smithi170 ceph-mon[31212]: pgmap v21088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T21:21:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39375.886282 secs 2024-04-21T21:21:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:04 smithi077 ceph-mon[27902]: pgmap v21088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T21:21:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39375.886282 secs 2024-04-21T21:21:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:04 smithi191 ceph-mon[31636]: pgmap v21088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-04-21T21:21:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39375.886282 secs 2024-04-21T21:21:06.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:05 smithi170 ceph-mon[31212]: osdmap e1390: 12 total, 12 up, 12 in 2024-04-21T21:21:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:05 smithi077 ceph-mon[27902]: osdmap e1390: 12 total, 12 up, 12 in 2024-04-21T21:21:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:05 smithi191 ceph-mon[31636]: osdmap e1390: 12 total, 12 up, 12 in 2024-04-21T21:21:07.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:06 smithi170 ceph-mon[31212]: pgmap v21090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:06 smithi077 ceph-mon[27902]: pgmap v21090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:06 smithi191 ceph-mon[31636]: pgmap v21090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39379.132298 secs 2024-04-21T21:21:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39379.132298 secs 2024-04-21T21:21:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39379.132298 secs 2024-04-21T21:21:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:08 smithi077 ceph-mon[27902]: pgmap v21091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:08 smithi191 ceph-mon[31636]: pgmap v21091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:08 smithi170 ceph-mon[31212]: pgmap v21091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39380.886374 secs 2024-04-21T21:21:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39380.886374 secs 2024-04-21T21:21:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39380.886374 secs 2024-04-21T21:21:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:10 smithi077 ceph-mon[27902]: pgmap v21092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:10 smithi191 ceph-mon[31636]: pgmap v21092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:10 smithi170 ceph-mon[31212]: pgmap v21092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:21:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:12 smithi077 ceph-mon[27902]: pgmap v21093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-04-21T21:21:13.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39384.132424 secs 2024-04-21T21:21:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:12 smithi191 ceph-mon[31636]: pgmap v21093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-04-21T21:21:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39384.132424 secs 2024-04-21T21:21:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:12 smithi170 ceph-mon[31212]: pgmap v21093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-04-21T21:21:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39384.132424 secs 2024-04-21T21:21:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:14 smithi077 ceph-mon[27902]: pgmap v21094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-04-21T21:21:15.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39385.886454 secs 2024-04-21T21:21:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:14 smithi191 ceph-mon[31636]: pgmap v21094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-04-21T21:21:15.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39385.886454 secs 2024-04-21T21:21:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:14 smithi170 ceph-mon[31212]: pgmap v21094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-04-21T21:21:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39385.886454 secs 2024-04-21T21:21:16.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:16 smithi191 ceph-mon[31636]: osdmap e1391: 12 total, 12 up, 12 in 2024-04-21T21:21:16.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:16 smithi191 ceph-mon[31636]: pgmap v21096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:16 smithi170 ceph-mon[31212]: osdmap e1391: 12 total, 12 up, 12 in 2024-04-21T21:21:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:16 smithi170 ceph-mon[31212]: pgmap v21096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:16 smithi077 ceph-mon[27902]: osdmap e1391: 12 total, 12 up, 12 in 2024-04-21T21:21:16.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:16 smithi077 ceph-mon[27902]: pgmap v21096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39389.132559 secs 2024-04-21T21:21:17.645 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39389.132559 secs 2024-04-21T21:21:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39389.132559 secs 2024-04-21T21:21:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:18 smithi077 ceph-mon[27902]: pgmap v21097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:18 smithi191 ceph-mon[31636]: pgmap v21097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:18 smithi170 ceph-mon[31212]: pgmap v21097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39390.886563 secs 2024-04-21T21:21:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39390.886563 secs 2024-04-21T21:21:19.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39390.886563 secs 2024-04-21T21:21:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:20 smithi077 ceph-mon[27902]: pgmap v21098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:20 smithi191 ceph-mon[31636]: pgmap v21098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:20.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:20 smithi170 ceph-mon[31212]: pgmap v21098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:21:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:22 smithi077 ceph-mon[27902]: pgmap v21099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:21:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39394.132707 secs 2024-04-21T21:21:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:22 smithi191 ceph-mon[31636]: pgmap v21099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:21:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39394.132707 secs 2024-04-21T21:21:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:22 smithi170 ceph-mon[31212]: pgmap v21099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:21:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39394.132707 secs 2024-04-21T21:21:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:24 smithi077 ceph-mon[27902]: pgmap v21100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:21:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39395.886664 secs 2024-04-21T21:21:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:24 smithi191 ceph-mon[31636]: pgmap v21100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:21:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39395.886664 secs 2024-04-21T21:21:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:24 smithi170 ceph-mon[31212]: pgmap v21100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:21:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39395.886664 secs 2024-04-21T21:21:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:26 smithi077 ceph-mon[27902]: pgmap v21101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T21:21:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:26 smithi191 ceph-mon[31636]: pgmap v21101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T21:21:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:26 smithi170 ceph-mon[31212]: pgmap v21101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T21:21:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39399.132823 secs 2024-04-21T21:21:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39399.132823 secs 2024-04-21T21:21:28.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39399.132823 secs 2024-04-21T21:21:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:28 smithi077 ceph-mon[27902]: pgmap v21102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:28 smithi191 ceph-mon[31636]: pgmap v21102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:29.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:28 smithi170 ceph-mon[31212]: pgmap v21102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39400.886763 secs 2024-04-21T21:21:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39400.886763 secs 2024-04-21T21:21:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39400.886763 secs 2024-04-21T21:21:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:30 smithi077 ceph-mon[27902]: pgmap v21103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:30 smithi191 ceph-mon[31636]: pgmap v21103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:31.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:30 smithi170 ceph-mon[31212]: pgmap v21103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:32 smithi077 ceph-mon[27902]: pgmap v21104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39404.132888 secs 2024-04-21T21:21:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:32 smithi191 ceph-mon[31636]: pgmap v21104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39404.132888 secs 2024-04-21T21:21:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:32 smithi170 ceph-mon[31212]: pgmap v21104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39404.132888 secs 2024-04-21T21:21:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:34 smithi077 ceph-mon[27902]: pgmap v21105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39405.886864 secs 2024-04-21T21:21:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:34 smithi191 ceph-mon[31636]: pgmap v21105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39405.886864 secs 2024-04-21T21:21:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:34 smithi170 ceph-mon[31212]: pgmap v21105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:21:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39405.886864 secs 2024-04-21T21:21:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:36 smithi077 ceph-mon[27902]: pgmap v21106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:36 smithi191 ceph-mon[31636]: pgmap v21106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:37.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:36 smithi170 ceph-mon[31212]: pgmap v21106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39409.132999 secs 2024-04-21T21:21:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39409.132999 secs 2024-04-21T21:21:38.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39409.132999 secs 2024-04-21T21:21:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:38 smithi077 ceph-mon[27902]: pgmap v21107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:38 smithi191 ceph-mon[31636]: pgmap v21107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:38 smithi170 ceph-mon[31212]: pgmap v21107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39410.886928 secs 2024-04-21T21:21:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39410.886928 secs 2024-04-21T21:21:40.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39410.886928 secs 2024-04-21T21:21:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:40 smithi077 ceph-mon[27902]: pgmap v21108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:40 smithi191 ceph-mon[31636]: pgmap v21108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:41.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:40 smithi170 ceph-mon[31212]: pgmap v21108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:42 smithi077 ceph-mon[27902]: pgmap v21109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39414.133110 secs 2024-04-21T21:21:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:42 smithi191 ceph-mon[31636]: pgmap v21109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39414.133110 secs 2024-04-21T21:21:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:42 smithi170 ceph-mon[31212]: pgmap v21109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39414.133110 secs 2024-04-21T21:21:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:44 smithi077 ceph-mon[27902]: pgmap v21110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39415.886998 secs 2024-04-21T21:21:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:44 smithi191 ceph-mon[31636]: pgmap v21110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39415.886998 secs 2024-04-21T21:21:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:44 smithi170 ceph-mon[31212]: pgmap v21110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39415.886998 secs 2024-04-21T21:21:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:21:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:21:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:21:45.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:21:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:21:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:21:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:21:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:21:46.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:21:46.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:21:46.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:21:46.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:21:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:46 smithi077 ceph-mon[27902]: pgmap v21111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:46 smithi191 ceph-mon[31636]: pgmap v21111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:46 smithi170 ceph-mon[31212]: pgmap v21111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39419.133230 secs 2024-04-21T21:21:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39419.133230 secs 2024-04-21T21:21:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39419.133230 secs 2024-04-21T21:21:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:48 smithi077 ceph-mon[27902]: pgmap v21112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:48 smithi191 ceph-mon[31636]: pgmap v21112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:48 smithi170 ceph-mon[31212]: pgmap v21112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39420.887123 secs 2024-04-21T21:21:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39420.887123 secs 2024-04-21T21:21:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39420.887123 secs 2024-04-21T21:21:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:50 smithi191 ceph-mon[31636]: pgmap v21113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:51.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:50 smithi170 ceph-mon[31212]: pgmap v21113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:50 smithi077 ceph-mon[27902]: pgmap v21113: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:52 smithi191 ceph-mon[31636]: pgmap v21114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39424.133345 secs 2024-04-21T21:21:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:52 smithi170 ceph-mon[31212]: pgmap v21114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39424.133345 secs 2024-04-21T21:21:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:52 smithi077 ceph-mon[27902]: pgmap v21114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39424.133345 secs 2024-04-21T21:21:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:54 smithi191 ceph-mon[31636]: pgmap v21115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39425.887191 secs 2024-04-21T21:21:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:54 smithi170 ceph-mon[31212]: pgmap v21115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39425.887191 secs 2024-04-21T21:21:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:21:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:54 smithi077 ceph-mon[27902]: pgmap v21115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39425.887191 secs 2024-04-21T21:21:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:56 smithi191 ceph-mon[31636]: pgmap v21116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:56 smithi170 ceph-mon[31212]: pgmap v21116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:56 smithi077 ceph-mon[27902]: pgmap v21116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:21:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39429.133436 secs 2024-04-21T21:21:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39429.133436 secs 2024-04-21T21:21:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39429.133436 secs 2024-04-21T21:21:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:58 smithi191 ceph-mon[31636]: pgmap v21117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:58 smithi170 ceph-mon[31212]: pgmap v21117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:58 smithi077 ceph-mon[27902]: pgmap v21117: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:21:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:21:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39430.887274 secs 2024-04-21T21:22:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:21:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39430.887274 secs 2024-04-21T21:22:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:21:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39430.887274 secs 2024-04-21T21:22:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:00 smithi191 ceph-mon[31636]: pgmap v21118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:00 smithi170 ceph-mon[31212]: pgmap v21118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:00 smithi077 ceph-mon[27902]: pgmap v21118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:02 smithi191 ceph-mon[31636]: pgmap v21119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39434.133554 secs 2024-04-21T21:22:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:02 smithi170 ceph-mon[31212]: pgmap v21119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39434.133554 secs 2024-04-21T21:22:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:02 smithi077 ceph-mon[27902]: pgmap v21119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39434.133554 secs 2024-04-21T21:22:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:04 smithi191 ceph-mon[31636]: pgmap v21120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39435.887353 secs 2024-04-21T21:22:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:04 smithi170 ceph-mon[31212]: pgmap v21120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39435.887353 secs 2024-04-21T21:22:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:04 smithi077 ceph-mon[27902]: pgmap v21120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39435.887353 secs 2024-04-21T21:22:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:05 smithi191 ceph-mon[31636]: osdmap e1392: 12 total, 12 up, 12 in 2024-04-21T21:22:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:05 smithi170 ceph-mon[31212]: osdmap e1392: 12 total, 12 up, 12 in 2024-04-21T21:22:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:05 smithi077 ceph-mon[27902]: osdmap e1392: 12 total, 12 up, 12 in 2024-04-21T21:22:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:06 smithi191 ceph-mon[31636]: pgmap v21122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:07.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:06 smithi077 ceph-mon[27902]: pgmap v21122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:06 smithi170 ceph-mon[31212]: pgmap v21122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39439.133623 secs 2024-04-21T21:22:08.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39439.133623 secs 2024-04-21T21:22:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39439.133623 secs 2024-04-21T21:22:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:08 smithi191 ceph-mon[31636]: pgmap v21123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:09.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:08 smithi170 ceph-mon[31212]: pgmap v21123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:08 smithi077 ceph-mon[27902]: pgmap v21123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39440.887477 secs 2024-04-21T21:22:10.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39440.887477 secs 2024-04-21T21:22:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39440.887477 secs 2024-04-21T21:22:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:10 smithi191 ceph-mon[31636]: pgmap v21124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:10 smithi191 ceph-mon[31636]: osdmap e1393: 12 total, 12 up, 12 in 2024-04-21T21:22:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:10 smithi170 ceph-mon[31212]: pgmap v21124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:10 smithi170 ceph-mon[31212]: osdmap e1393: 12 total, 12 up, 12 in 2024-04-21T21:22:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:10 smithi077 ceph-mon[27902]: pgmap v21124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:22:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:10 smithi077 ceph-mon[27902]: osdmap e1393: 12 total, 12 up, 12 in 2024-04-21T21:22:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:12 smithi191 ceph-mon[31636]: pgmap v21126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:22:12.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39444.133741 secs 2024-04-21T21:22:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:12 smithi170 ceph-mon[31212]: pgmap v21126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:22:13.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39444.133741 secs 2024-04-21T21:22:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:12 smithi077 ceph-mon[27902]: pgmap v21126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:22:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39444.133741 secs 2024-04-21T21:22:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:14 smithi191 ceph-mon[31636]: pgmap v21127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:22:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39445.887586 secs 2024-04-21T21:22:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:14 smithi170 ceph-mon[31212]: pgmap v21127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:22:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39445.887586 secs 2024-04-21T21:22:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:14 smithi077 ceph-mon[27902]: pgmap v21127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:22:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39445.887586 secs 2024-04-21T21:22:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:16 smithi191 ceph-mon[31636]: pgmap v21128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:16 smithi170 ceph-mon[31212]: pgmap v21128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:16 smithi077 ceph-mon[27902]: pgmap v21128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39449.133862 secs 2024-04-21T21:22:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39449.133862 secs 2024-04-21T21:22:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39449.133862 secs 2024-04-21T21:22:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:18 smithi191 ceph-mon[31636]: pgmap v21129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:18 smithi170 ceph-mon[31212]: pgmap v21129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:18 smithi077 ceph-mon[27902]: pgmap v21129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39450.887682 secs 2024-04-21T21:22:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39450.887682 secs 2024-04-21T21:22:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39450.887682 secs 2024-04-21T21:22:21.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:20 smithi170 ceph-mon[31212]: pgmap v21130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:20 smithi077 ceph-mon[27902]: pgmap v21130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:20 smithi191 ceph-mon[31636]: pgmap v21130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:22:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:22 smithi170 ceph-mon[31212]: pgmap v21131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:22:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39454.133971 secs 2024-04-21T21:22:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:22 smithi077 ceph-mon[27902]: pgmap v21131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:22:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39454.133971 secs 2024-04-21T21:22:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:22 smithi191 ceph-mon[31636]: pgmap v21131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:22:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39454.133971 secs 2024-04-21T21:22:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:24 smithi170 ceph-mon[31212]: pgmap v21132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39455.887801 secs 2024-04-21T21:22:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:24 smithi077 ceph-mon[27902]: pgmap v21132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39455.887801 secs 2024-04-21T21:22:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:24 smithi191 ceph-mon[31636]: pgmap v21132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39455.887801 secs 2024-04-21T21:22:26.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:26 smithi191 ceph-mon[31636]: pgmap v21133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:26 smithi170 ceph-mon[31212]: pgmap v21133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:26 smithi077 ceph-mon[27902]: pgmap v21133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39459.134106 secs 2024-04-21T21:22:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39459.134106 secs 2024-04-21T21:22:27.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39459.134106 secs 2024-04-21T21:22:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:28 smithi077 ceph-mon[27902]: pgmap v21134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:28 smithi191 ceph-mon[31636]: pgmap v21134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:28 smithi170 ceph-mon[31212]: pgmap v21134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39460.887921 secs 2024-04-21T21:22:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39460.887921 secs 2024-04-21T21:22:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39460.887921 secs 2024-04-21T21:22:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:30 smithi191 ceph-mon[31636]: pgmap v21135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:30 smithi170 ceph-mon[31212]: pgmap v21135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:30 smithi077 ceph-mon[27902]: pgmap v21135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:32 smithi077 ceph-mon[27902]: pgmap v21136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39464.134210 secs 2024-04-21T21:22:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:32 smithi191 ceph-mon[31636]: pgmap v21136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39464.134210 secs 2024-04-21T21:22:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:32 smithi170 ceph-mon[31212]: pgmap v21136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39464.134210 secs 2024-04-21T21:22:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:34 smithi077 ceph-mon[27902]: pgmap v21137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39465.888032 secs 2024-04-21T21:22:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:34 smithi191 ceph-mon[31636]: pgmap v21137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39465.888032 secs 2024-04-21T21:22:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:34 smithi170 ceph-mon[31212]: pgmap v21137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39465.888032 secs 2024-04-21T21:22:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:36 smithi077 ceph-mon[27902]: pgmap v21138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:36 smithi191 ceph-mon[31636]: pgmap v21138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:36 smithi170 ceph-mon[31212]: pgmap v21138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:37.789 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39469.134359 secs 2024-04-21T21:22:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39469.134359 secs 2024-04-21T21:22:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39469.134359 secs 2024-04-21T21:22:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:38 smithi077 ceph-mon[27902]: pgmap v21139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:38 smithi191 ceph-mon[31636]: pgmap v21139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:39.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:38 smithi170 ceph-mon[31212]: pgmap v21139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39470.888118 secs 2024-04-21T21:22:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39470.888118 secs 2024-04-21T21:22:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39470.888118 secs 2024-04-21T21:22:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:40 smithi077 ceph-mon[27902]: pgmap v21140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:40 smithi191 ceph-mon[31636]: pgmap v21140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:40 smithi170 ceph-mon[31212]: pgmap v21140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:42 smithi077 ceph-mon[27902]: pgmap v21141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:42.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39474.134452 secs 2024-04-21T21:22:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:42 smithi191 ceph-mon[31636]: pgmap v21141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39474.134452 secs 2024-04-21T21:22:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:42 smithi170 ceph-mon[31212]: pgmap v21141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39474.134452 secs 2024-04-21T21:22:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:44 smithi077 ceph-mon[27902]: pgmap v21142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:44.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39475.888201 secs 2024-04-21T21:22:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:44 smithi191 ceph-mon[31636]: pgmap v21142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39475.888201 secs 2024-04-21T21:22:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:44 smithi170 ceph-mon[31212]: pgmap v21142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39475.888201 secs 2024-04-21T21:22:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:45 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:22:45.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:45 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:22:46.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:45 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:22:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:46 smithi077 ceph-mon[27902]: pgmap v21143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:22:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:22:46.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:22:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:46 smithi191 ceph-mon[31636]: pgmap v21143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:22:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:22:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:22:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:46 smithi170 ceph-mon[31212]: pgmap v21143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:22:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:22:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:22:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39479.134594 secs 2024-04-21T21:22:47.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39479.134594 secs 2024-04-21T21:22:48.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39479.134594 secs 2024-04-21T21:22:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:48 smithi191 ceph-mon[31636]: pgmap v21144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:48 smithi170 ceph-mon[31212]: pgmap v21144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:48 smithi077 ceph-mon[27902]: pgmap v21144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39480.888320 secs 2024-04-21T21:22:50.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39480.888320 secs 2024-04-21T21:22:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39480.888320 secs 2024-04-21T21:22:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:50 smithi191 ceph-mon[31636]: pgmap v21145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:50 smithi170 ceph-mon[31212]: pgmap v21145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:50 smithi077 ceph-mon[27902]: pgmap v21145: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:52 smithi191 ceph-mon[31636]: pgmap v21146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39484.134664 secs 2024-04-21T21:22:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:52 smithi170 ceph-mon[31212]: pgmap v21146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39484.134664 secs 2024-04-21T21:22:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:52 smithi077 ceph-mon[27902]: pgmap v21146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39484.134664 secs 2024-04-21T21:22:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:54 smithi191 ceph-mon[31636]: pgmap v21147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:54.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39485.888416 secs 2024-04-21T21:22:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:54 smithi170 ceph-mon[31212]: pgmap v21147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39485.888416 secs 2024-04-21T21:22:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:22:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:54 smithi077 ceph-mon[27902]: pgmap v21147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39485.888416 secs 2024-04-21T21:22:56.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:56 smithi191 ceph-mon[31636]: pgmap v21148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:56 smithi170 ceph-mon[31212]: pgmap v21148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:56 smithi077 ceph-mon[27902]: pgmap v21148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:22:57.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39489.134782 secs 2024-04-21T21:22:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39489.134782 secs 2024-04-21T21:22:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39489.134782 secs 2024-04-21T21:22:58.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:58 smithi191 ceph-mon[31636]: pgmap v21149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:59.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:58 smithi170 ceph-mon[31212]: pgmap v21149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:58 smithi077 ceph-mon[27902]: pgmap v21149: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:22:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:22:59.817+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:22:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:22:59.817+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:22:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:22:59.826+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:22:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:22:59.826+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:22:59.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:22:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39490.888536 secs 2024-04-21T21:23:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:22:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39490.888536 secs 2024-04-21T21:23:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:22:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39490.888536 secs 2024-04-21T21:23:00.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:00 smithi191 ceph-mon[31636]: pgmap v21150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:01.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:00 smithi170 ceph-mon[31212]: pgmap v21150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:00 smithi077 ceph-mon[27902]: pgmap v21150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:02 smithi191 ceph-mon[31636]: pgmap v21151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:02.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39494.134898 secs 2024-04-21T21:23:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:02 smithi170 ceph-mon[31212]: pgmap v21151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39494.134898 secs 2024-04-21T21:23:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:02 smithi077 ceph-mon[27902]: pgmap v21151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39494.134898 secs 2024-04-21T21:23:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:04 smithi191 ceph-mon[31636]: pgmap v21152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:04.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39495.888672 secs 2024-04-21T21:23:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:04 smithi170 ceph-mon[31212]: pgmap v21152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39495.888672 secs 2024-04-21T21:23:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:04 smithi077 ceph-mon[27902]: pgmap v21152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39495.888672 secs 2024-04-21T21:23:05.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:05 smithi191 ceph-mon[31636]: osdmap e1394: 12 total, 12 up, 12 in 2024-04-21T21:23:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:05 smithi170 ceph-mon[31212]: osdmap e1394: 12 total, 12 up, 12 in 2024-04-21T21:23:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:05 smithi077 ceph-mon[27902]: osdmap e1394: 12 total, 12 up, 12 in 2024-04-21T21:23:06.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:06 smithi191 ceph-mon[31636]: pgmap v21154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:07.038 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:06 smithi077 ceph-mon[27902]: pgmap v21154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:06 smithi170 ceph-mon[31212]: pgmap v21154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:07.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39499.134989 secs 2024-04-21T21:23:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39499.134989 secs 2024-04-21T21:23:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39499.134989 secs 2024-04-21T21:23:08.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:08 smithi191 ceph-mon[31636]: pgmap v21155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:08 smithi170 ceph-mon[31212]: pgmap v21155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:08 smithi077 ceph-mon[27902]: pgmap v21155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:09.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39500.888818 secs 2024-04-21T21:23:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39500.888818 secs 2024-04-21T21:23:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39500.888818 secs 2024-04-21T21:23:10.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:10 smithi191 ceph-mon[31636]: pgmap v21156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:10 smithi170 ceph-mon[31212]: pgmap v21156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:10 smithi077 ceph-mon[27902]: pgmap v21156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:23:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:12 smithi191 ceph-mon[31636]: pgmap v21157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:23:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39504.135117 secs 2024-04-21T21:23:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:12 smithi170 ceph-mon[31212]: pgmap v21157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:23:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39504.135117 secs 2024-04-21T21:23:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:12 smithi077 ceph-mon[27902]: pgmap v21157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:23:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39504.135117 secs 2024-04-21T21:23:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:14 smithi191 ceph-mon[31636]: pgmap v21158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:23:14.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39505.888885 secs 2024-04-21T21:23:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:14 smithi170 ceph-mon[31212]: pgmap v21158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:23:15.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39505.888885 secs 2024-04-21T21:23:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:14 smithi077 ceph-mon[27902]: pgmap v21158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:23:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39505.888885 secs 2024-04-21T21:23:16.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:16 smithi191 ceph-mon[31636]: osdmap e1395: 12 total, 12 up, 12 in 2024-04-21T21:23:16.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:16 smithi191 ceph-mon[31636]: pgmap v21160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:16 smithi170 ceph-mon[31212]: osdmap e1395: 12 total, 12 up, 12 in 2024-04-21T21:23:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:16 smithi170 ceph-mon[31212]: pgmap v21160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:16 smithi077 ceph-mon[27902]: osdmap e1395: 12 total, 12 up, 12 in 2024-04-21T21:23:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:16 smithi077 ceph-mon[27902]: pgmap v21160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39509.135268 secs 2024-04-21T21:23:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39509.135268 secs 2024-04-21T21:23:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39509.135268 secs 2024-04-21T21:23:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:18 smithi191 ceph-mon[31636]: pgmap v21161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:18 smithi170 ceph-mon[31212]: pgmap v21161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:18 smithi077 ceph-mon[27902]: pgmap v21161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39510.888935 secs 2024-04-21T21:23:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39510.888935 secs 2024-04-21T21:23:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39510.888935 secs 2024-04-21T21:23:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:20 smithi191 ceph-mon[31636]: pgmap v21162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:20 smithi170 ceph-mon[31212]: pgmap v21162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:20 smithi077 ceph-mon[27902]: pgmap v21162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:23:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:22 smithi077 ceph-mon[27902]: pgmap v21163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:23:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39514.135380 secs 2024-04-21T21:23:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:22 smithi191 ceph-mon[31636]: pgmap v21163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:23:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39514.135380 secs 2024-04-21T21:23:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:22 smithi170 ceph-mon[31212]: pgmap v21163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:23:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39514.135380 secs 2024-04-21T21:23:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:24 smithi077 ceph-mon[27902]: pgmap v21164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:23:24.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39515.889048 secs 2024-04-21T21:23:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:24 smithi191 ceph-mon[31636]: pgmap v21164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:23:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39515.889048 secs 2024-04-21T21:23:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:24 smithi170 ceph-mon[31212]: pgmap v21164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:23:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39515.889048 secs 2024-04-21T21:23:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:26 smithi170 ceph-mon[31212]: pgmap v21165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:23:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:26 smithi077 ceph-mon[27902]: pgmap v21165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:23:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:26 smithi191 ceph-mon[31636]: pgmap v21165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:23:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39519.135499 secs 2024-04-21T21:23:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39519.135499 secs 2024-04-21T21:23:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39519.135499 secs 2024-04-21T21:23:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:28 smithi191 ceph-mon[31636]: pgmap v21166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:28 smithi170 ceph-mon[31212]: pgmap v21166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:28 smithi077 ceph-mon[27902]: pgmap v21166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39520.889166 secs 2024-04-21T21:23:29.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39520.889166 secs 2024-04-21T21:23:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39520.889166 secs 2024-04-21T21:23:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:30 smithi191 ceph-mon[31636]: pgmap v21167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:30 smithi170 ceph-mon[31212]: pgmap v21167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:30 smithi077 ceph-mon[27902]: pgmap v21167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:32 smithi077 ceph-mon[27902]: pgmap v21168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:32.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39524.135636 secs 2024-04-21T21:23:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:32 smithi191 ceph-mon[31636]: pgmap v21168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39524.135636 secs 2024-04-21T21:23:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:32 smithi170 ceph-mon[31212]: pgmap v21168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39524.135636 secs 2024-04-21T21:23:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:34 smithi077 ceph-mon[27902]: pgmap v21169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39525.889275 secs 2024-04-21T21:23:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:34 smithi191 ceph-mon[31636]: pgmap v21169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39525.889275 secs 2024-04-21T21:23:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:34 smithi170 ceph-mon[31212]: pgmap v21169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:35.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39525.889275 secs 2024-04-21T21:23:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:36 smithi077 ceph-mon[27902]: pgmap v21170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:36 smithi191 ceph-mon[31636]: pgmap v21170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:36 smithi170 ceph-mon[31212]: pgmap v21170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39529.135754 secs 2024-04-21T21:23:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39529.135754 secs 2024-04-21T21:23:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39529.135754 secs 2024-04-21T21:23:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:38 smithi077 ceph-mon[27902]: pgmap v21171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:38 smithi191 ceph-mon[31636]: pgmap v21171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:38 smithi170 ceph-mon[31212]: pgmap v21171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39530.889389 secs 2024-04-21T21:23:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39530.889389 secs 2024-04-21T21:23:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39530.889389 secs 2024-04-21T21:23:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:40 smithi077 ceph-mon[27902]: pgmap v21172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:40 smithi191 ceph-mon[31636]: pgmap v21172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:40 smithi170 ceph-mon[31212]: pgmap v21172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:42 smithi191 ceph-mon[31636]: pgmap v21173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39534.135862 secs 2024-04-21T21:23:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:42 smithi170 ceph-mon[31212]: pgmap v21173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39534.135862 secs 2024-04-21T21:23:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:42 smithi077 ceph-mon[27902]: pgmap v21173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39534.135862 secs 2024-04-21T21:23:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:44 smithi191 ceph-mon[31636]: pgmap v21174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39535.889518 secs 2024-04-21T21:23:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:44 smithi170 ceph-mon[31212]: pgmap v21174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39535.889518 secs 2024-04-21T21:23:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:44 smithi077 ceph-mon[27902]: pgmap v21174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39535.889518 secs 2024-04-21T21:23:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:46 smithi191 ceph-mon[31636]: pgmap v21175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:46 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:23:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:46 smithi170 ceph-mon[31212]: pgmap v21175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:47.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:46 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:23:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:46 smithi077 ceph-mon[27902]: pgmap v21175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:46 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:23:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:23:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:23:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:23:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39539.135957 secs 2024-04-21T21:23:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:23:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:23:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:23:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39539.135957 secs 2024-04-21T21:23:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:23:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:23:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:23:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39539.135957 secs 2024-04-21T21:23:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:49 smithi077 ceph-mon[27902]: pgmap v21176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:49 smithi191 ceph-mon[31636]: pgmap v21176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:49 smithi170 ceph-mon[31212]: pgmap v21176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39540.889631 secs 2024-04-21T21:23:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39540.889631 secs 2024-04-21T21:23:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39540.889631 secs 2024-04-21T21:23:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:51 smithi077 ceph-mon[27902]: pgmap v21177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:51 smithi191 ceph-mon[31636]: pgmap v21177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:51 smithi170 ceph-mon[31212]: pgmap v21177: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:53 smithi077 ceph-mon[27902]: pgmap v21178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39544.136080 secs 2024-04-21T21:23:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:53 smithi191 ceph-mon[31636]: pgmap v21178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39544.136080 secs 2024-04-21T21:23:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:53 smithi170 ceph-mon[31212]: pgmap v21178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39544.136080 secs 2024-04-21T21:23:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:23:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:55 smithi077 ceph-mon[27902]: pgmap v21179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39545.889745 secs 2024-04-21T21:23:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:55 smithi191 ceph-mon[31636]: pgmap v21179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39545.889745 secs 2024-04-21T21:23:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:55 smithi170 ceph-mon[31212]: pgmap v21179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39545.889745 secs 2024-04-21T21:23:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:57 smithi077 ceph-mon[27902]: pgmap v21180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:57 smithi191 ceph-mon[31636]: pgmap v21180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:57 smithi170 ceph-mon[31212]: pgmap v21180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:23:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39549.136202 secs 2024-04-21T21:23:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39549.136202 secs 2024-04-21T21:23:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39549.136202 secs 2024-04-21T21:23:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:59 smithi077 ceph-mon[27902]: pgmap v21181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:23:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39550.889881 secs 2024-04-21T21:23:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:59 smithi191 ceph-mon[31636]: pgmap v21181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:23:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39550.889881 secs 2024-04-21T21:23:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:59 smithi170 ceph-mon[31212]: pgmap v21181: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:23:59.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:23:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39550.889881 secs 2024-04-21T21:24:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:01 smithi077 ceph-mon[27902]: pgmap v21182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:01 smithi191 ceph-mon[31636]: pgmap v21182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:01.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:01 smithi170 ceph-mon[31212]: pgmap v21182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:03 smithi077 ceph-mon[27902]: pgmap v21183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39554.136308 secs 2024-04-21T21:24:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:03 smithi191 ceph-mon[31636]: pgmap v21183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39554.136308 secs 2024-04-21T21:24:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:03 smithi170 ceph-mon[31212]: pgmap v21183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39554.136308 secs 2024-04-21T21:24:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39555.889995 secs 2024-04-21T21:24:04.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39555.889995 secs 2024-04-21T21:24:04.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39555.889995 secs 2024-04-21T21:24:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:05 smithi077 ceph-mon[27902]: pgmap v21184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:05 smithi077 ceph-mon[27902]: osdmap e1396: 12 total, 12 up, 12 in 2024-04-21T21:24:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:05 smithi191 ceph-mon[31636]: pgmap v21184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:05 smithi191 ceph-mon[31636]: osdmap e1396: 12 total, 12 up, 12 in 2024-04-21T21:24:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:05 smithi170 ceph-mon[31212]: pgmap v21184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:05 smithi170 ceph-mon[31212]: osdmap e1396: 12 total, 12 up, 12 in 2024-04-21T21:24:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:07 smithi077 ceph-mon[27902]: pgmap v21186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:07 smithi191 ceph-mon[31636]: pgmap v21186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:07 smithi170 ceph-mon[31212]: pgmap v21186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39559.136406 secs 2024-04-21T21:24:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39559.136406 secs 2024-04-21T21:24:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39559.136406 secs 2024-04-21T21:24:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:09 smithi077 ceph-mon[27902]: pgmap v21187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39560.890058 secs 2024-04-21T21:24:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:09 smithi191 ceph-mon[31636]: pgmap v21187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39560.890058 secs 2024-04-21T21:24:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:09 smithi170 ceph-mon[31212]: pgmap v21187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:09.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39560.890058 secs 2024-04-21T21:24:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:10 smithi077 ceph-mon[27902]: pgmap v21188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:10 smithi191 ceph-mon[31636]: pgmap v21188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:10 smithi170 ceph-mon[31212]: pgmap v21188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:24:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:11 smithi170 ceph-mon[31212]: osdmap e1397: 12 total, 12 up, 12 in 2024-04-21T21:24:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:11 smithi077 ceph-mon[27902]: osdmap e1397: 12 total, 12 up, 12 in 2024-04-21T21:24:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:11 smithi191 ceph-mon[31636]: osdmap e1397: 12 total, 12 up, 12 in 2024-04-21T21:24:12.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:12 smithi170 ceph-mon[31212]: pgmap v21190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:24:12.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:12 smithi077 ceph-mon[27902]: pgmap v21190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:24:12.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:12 smithi191 ceph-mon[31636]: pgmap v21190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:24:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39564.136474 secs 2024-04-21T21:24:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39564.136474 secs 2024-04-21T21:24:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39564.136474 secs 2024-04-21T21:24:14.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:14 smithi170 ceph-mon[31212]: pgmap v21191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T21:24:14.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39565.890115 secs 2024-04-21T21:24:14.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:14 smithi077 ceph-mon[27902]: pgmap v21191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T21:24:14.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39565.890115 secs 2024-04-21T21:24:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:14 smithi191 ceph-mon[31636]: pgmap v21191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 56 KiB/s wr, 28 op/s 2024-04-21T21:24:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39565.890115 secs 2024-04-21T21:24:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:16 smithi077 ceph-mon[27902]: pgmap v21192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:16 smithi191 ceph-mon[31636]: pgmap v21192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:16 smithi170 ceph-mon[31212]: pgmap v21192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:17.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39569.136612 secs 2024-04-21T21:24:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39569.136612 secs 2024-04-21T21:24:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39569.136612 secs 2024-04-21T21:24:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:18 smithi077 ceph-mon[27902]: pgmap v21193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:18 smithi191 ceph-mon[31636]: pgmap v21193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:18 smithi170 ceph-mon[31212]: pgmap v21193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39570.890206 secs 2024-04-21T21:24:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39570.890206 secs 2024-04-21T21:24:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39570.890206 secs 2024-04-21T21:24:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:20 smithi191 ceph-mon[31636]: pgmap v21194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:20 smithi170 ceph-mon[31212]: pgmap v21194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:20 smithi077 ceph-mon[27902]: pgmap v21194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:24:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:22 smithi191 ceph-mon[31636]: pgmap v21195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:24:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39574.136726 secs 2024-04-21T21:24:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:22 smithi170 ceph-mon[31212]: pgmap v21195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:24:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39574.136726 secs 2024-04-21T21:24:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:22 smithi077 ceph-mon[27902]: pgmap v21195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:24:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39574.136726 secs 2024-04-21T21:24:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:24 smithi191 ceph-mon[31636]: pgmap v21196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39575.890331 secs 2024-04-21T21:24:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:24 smithi170 ceph-mon[31212]: pgmap v21196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39575.890331 secs 2024-04-21T21:24:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:24 smithi077 ceph-mon[27902]: pgmap v21196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39575.890331 secs 2024-04-21T21:24:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:26 smithi191 ceph-mon[31636]: pgmap v21197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:26 smithi170 ceph-mon[31212]: pgmap v21197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:26 smithi077 ceph-mon[27902]: pgmap v21197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39579.136844 secs 2024-04-21T21:24:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39579.136844 secs 2024-04-21T21:24:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39579.136844 secs 2024-04-21T21:24:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:28 smithi191 ceph-mon[31636]: pgmap v21198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:28 smithi170 ceph-mon[31212]: pgmap v21198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:28 smithi077 ceph-mon[27902]: pgmap v21198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39580.890397 secs 2024-04-21T21:24:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39580.890397 secs 2024-04-21T21:24:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39580.890397 secs 2024-04-21T21:24:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:30 smithi191 ceph-mon[31636]: pgmap v21199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:31.204 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:30 smithi077 ceph-mon[27902]: pgmap v21199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:31.205 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:30 smithi170 ceph-mon[31212]: pgmap v21199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:32 smithi191 ceph-mon[31636]: pgmap v21200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39584.136958 secs 2024-04-21T21:24:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:32 smithi170 ceph-mon[31212]: pgmap v21200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39584.136958 secs 2024-04-21T21:24:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:32 smithi077 ceph-mon[27902]: pgmap v21200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39584.136958 secs 2024-04-21T21:24:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:34 smithi191 ceph-mon[31636]: pgmap v21201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39585.890513 secs 2024-04-21T21:24:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:34 smithi170 ceph-mon[31212]: pgmap v21201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39585.890513 secs 2024-04-21T21:24:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:34 smithi077 ceph-mon[27902]: pgmap v21201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39585.890513 secs 2024-04-21T21:24:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:36 smithi191 ceph-mon[31636]: pgmap v21202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:36 smithi170 ceph-mon[31212]: pgmap v21202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:36 smithi077 ceph-mon[27902]: pgmap v21202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39589.137079 secs 2024-04-21T21:24:38.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39589.137079 secs 2024-04-21T21:24:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39589.137079 secs 2024-04-21T21:24:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:38 smithi191 ceph-mon[31636]: pgmap v21203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:38 smithi170 ceph-mon[31212]: pgmap v21203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:38 smithi077 ceph-mon[27902]: pgmap v21203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39590.890650 secs 2024-04-21T21:24:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39590.890650 secs 2024-04-21T21:24:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39590.890650 secs 2024-04-21T21:24:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:40 smithi191 ceph-mon[31636]: pgmap v21204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:40 smithi170 ceph-mon[31212]: pgmap v21204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:40 smithi077 ceph-mon[27902]: pgmap v21204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:42 smithi191 ceph-mon[31636]: pgmap v21205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39594.137142 secs 2024-04-21T21:24:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:42 smithi170 ceph-mon[31212]: pgmap v21205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:43.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39594.137142 secs 2024-04-21T21:24:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:42 smithi077 ceph-mon[27902]: pgmap v21205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39594.137142 secs 2024-04-21T21:24:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:44 smithi191 ceph-mon[31636]: pgmap v21206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39595.890759 secs 2024-04-21T21:24:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:44 smithi170 ceph-mon[31212]: pgmap v21206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39595.890759 secs 2024-04-21T21:24:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:44 smithi077 ceph-mon[27902]: pgmap v21206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39595.890759 secs 2024-04-21T21:24:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:46 smithi191 ceph-mon[31636]: pgmap v21207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:46 smithi170 ceph-mon[31212]: pgmap v21207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:46 smithi077 ceph-mon[27902]: pgmap v21207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:47 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:24:47.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39599.137207 secs 2024-04-21T21:24:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:47 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:24:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39599.137207 secs 2024-04-21T21:24:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:47 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:24:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39599.137207 secs 2024-04-21T21:24:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:48 smithi191 ceph-mon[31636]: pgmap v21208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:24:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:24:48.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:24:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:48 smithi170 ceph-mon[31212]: pgmap v21208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:24:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:24:49.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:24:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:48 smithi077 ceph-mon[27902]: pgmap v21208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:24:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:24:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:24:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39600.890893 secs 2024-04-21T21:24:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39600.890893 secs 2024-04-21T21:24:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39600.890893 secs 2024-04-21T21:24:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:50 smithi191 ceph-mon[31636]: pgmap v21209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:50 smithi170 ceph-mon[31212]: pgmap v21209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:50 smithi077 ceph-mon[27902]: pgmap v21209: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:52 smithi191 ceph-mon[31636]: pgmap v21210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:52.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39604.137321 secs 2024-04-21T21:24:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:52 smithi170 ceph-mon[31212]: pgmap v21210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39604.137321 secs 2024-04-21T21:24:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:52 smithi077 ceph-mon[27902]: pgmap v21210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39604.137321 secs 2024-04-21T21:24:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:54 smithi170 ceph-mon[31212]: pgmap v21211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39605.890981 secs 2024-04-21T21:24:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:24:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:54 smithi077 ceph-mon[27902]: pgmap v21211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39605.890981 secs 2024-04-21T21:24:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:54 smithi191 ceph-mon[31636]: pgmap v21211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39605.890981 secs 2024-04-21T21:24:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:56 smithi170 ceph-mon[31212]: pgmap v21212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:56 smithi077 ceph-mon[27902]: pgmap v21212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:56 smithi191 ceph-mon[31636]: pgmap v21212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:24:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39609.137470 secs 2024-04-21T21:24:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39609.137470 secs 2024-04-21T21:24:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39609.137470 secs 2024-04-21T21:24:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:58 smithi170 ceph-mon[31212]: pgmap v21213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:58 smithi077 ceph-mon[27902]: pgmap v21213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:24:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:58 smithi191 ceph-mon[31636]: pgmap v21213: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:24:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39610.891139 secs 2024-04-21T21:25:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:24:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39610.891139 secs 2024-04-21T21:25:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:24:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39610.891139 secs 2024-04-21T21:25:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:00 smithi170 ceph-mon[31212]: pgmap v21214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:00 smithi077 ceph-mon[27902]: pgmap v21214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:00 smithi191 ceph-mon[31636]: pgmap v21214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:02 smithi170 ceph-mon[31212]: pgmap v21215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:03.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39614.137586 secs 2024-04-21T21:25:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:02 smithi077 ceph-mon[27902]: pgmap v21215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39614.137586 secs 2024-04-21T21:25:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:02 smithi191 ceph-mon[31636]: pgmap v21215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39614.137586 secs 2024-04-21T21:25:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:04 smithi170 ceph-mon[31212]: pgmap v21216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:05.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39615.891242 secs 2024-04-21T21:25:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:04 smithi077 ceph-mon[27902]: pgmap v21216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39615.891242 secs 2024-04-21T21:25:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:04 smithi191 ceph-mon[31636]: pgmap v21216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39615.891242 secs 2024-04-21T21:25:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:05 smithi170 ceph-mon[31212]: osdmap e1398: 12 total, 12 up, 12 in 2024-04-21T21:25:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:05 smithi077 ceph-mon[27902]: osdmap e1398: 12 total, 12 up, 12 in 2024-04-21T21:25:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:05 smithi191 ceph-mon[31636]: osdmap e1398: 12 total, 12 up, 12 in 2024-04-21T21:25:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:06 smithi170 ceph-mon[31212]: pgmap v21218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:06 smithi077 ceph-mon[27902]: pgmap v21218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:06 smithi191 ceph-mon[31636]: pgmap v21218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:08.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39619.137709 secs 2024-04-21T21:25:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39619.137709 secs 2024-04-21T21:25:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39619.137709 secs 2024-04-21T21:25:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:08 smithi170 ceph-mon[31212]: pgmap v21219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:08 smithi077 ceph-mon[27902]: pgmap v21219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:08 smithi191 ceph-mon[31636]: pgmap v21219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39620.891324 secs 2024-04-21T21:25:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:10.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39620.891324 secs 2024-04-21T21:25:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39620.891324 secs 2024-04-21T21:25:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:10 smithi170 ceph-mon[31212]: pgmap v21220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:11.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:10 smithi170 ceph-mon[31212]: osdmap e1399: 12 total, 12 up, 12 in 2024-04-21T21:25:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:10 smithi077 ceph-mon[27902]: pgmap v21220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:10 smithi077 ceph-mon[27902]: osdmap e1399: 12 total, 12 up, 12 in 2024-04-21T21:25:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:10 smithi191 ceph-mon[31636]: pgmap v21220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:25:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:10 smithi191 ceph-mon[31636]: osdmap e1399: 12 total, 12 up, 12 in 2024-04-21T21:25:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:12 smithi170 ceph-mon[31212]: pgmap v21222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:25:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39624.137825 secs 2024-04-21T21:25:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:12 smithi077 ceph-mon[27902]: pgmap v21222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:25:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39624.137825 secs 2024-04-21T21:25:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:12 smithi191 ceph-mon[31636]: pgmap v21222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:25:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39624.137825 secs 2024-04-21T21:25:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:14 smithi170 ceph-mon[31212]: pgmap v21223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:25:15.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39625.891460 secs 2024-04-21T21:25:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:14 smithi077 ceph-mon[27902]: pgmap v21223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:25:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39625.891460 secs 2024-04-21T21:25:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:14 smithi191 ceph-mon[31636]: pgmap v21223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 30 op/s 2024-04-21T21:25:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39625.891460 secs 2024-04-21T21:25:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:16 smithi170 ceph-mon[31212]: pgmap v21224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:17.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:16 smithi077 ceph-mon[27902]: pgmap v21224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:17.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:16 smithi191 ceph-mon[31636]: pgmap v21224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39629.137889 secs 2024-04-21T21:25:18.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39629.137889 secs 2024-04-21T21:25:18.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39629.137889 secs 2024-04-21T21:25:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:18 smithi170 ceph-mon[31212]: pgmap v21225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:19.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:18 smithi077 ceph-mon[27902]: pgmap v21225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:19.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:18 smithi191 ceph-mon[31636]: pgmap v21225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39630.891597 secs 2024-04-21T21:25:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:20.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39630.891597 secs 2024-04-21T21:25:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39630.891597 secs 2024-04-21T21:25:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:20 smithi170 ceph-mon[31212]: pgmap v21226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:20 smithi077 ceph-mon[27902]: pgmap v21226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:21.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:20 smithi191 ceph-mon[31636]: pgmap v21226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:25:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:22 smithi170 ceph-mon[31212]: pgmap v21227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:25:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39634.138013 secs 2024-04-21T21:25:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:22 smithi077 ceph-mon[27902]: pgmap v21227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:25:23.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39634.138013 secs 2024-04-21T21:25:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:22 smithi191 ceph-mon[31636]: pgmap v21227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-21T21:25:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39634.138013 secs 2024-04-21T21:25:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:24 smithi077 ceph-mon[27902]: pgmap v21228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39635.891714 secs 2024-04-21T21:25:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:24 smithi191 ceph-mon[31636]: pgmap v21228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39635.891714 secs 2024-04-21T21:25:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:24 smithi170 ceph-mon[31212]: pgmap v21228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39635.891714 secs 2024-04-21T21:25:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:26 smithi077 ceph-mon[27902]: pgmap v21229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:26 smithi191 ceph-mon[31636]: pgmap v21229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:26 smithi170 ceph-mon[31212]: pgmap v21229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:28.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39639.138079 secs 2024-04-21T21:25:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39639.138079 secs 2024-04-21T21:25:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39639.138079 secs 2024-04-21T21:25:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:28 smithi077 ceph-mon[27902]: pgmap v21230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:28 smithi191 ceph-mon[31636]: pgmap v21230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:28 smithi170 ceph-mon[31212]: pgmap v21230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39640.891836 secs 2024-04-21T21:25:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39640.891836 secs 2024-04-21T21:25:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39640.891836 secs 2024-04-21T21:25:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:30 smithi077 ceph-mon[27902]: pgmap v21231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:30 smithi191 ceph-mon[31636]: pgmap v21231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:30 smithi170 ceph-mon[31212]: pgmap v21231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:32 smithi077 ceph-mon[27902]: pgmap v21232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:33.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39644.138173 secs 2024-04-21T21:25:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:32 smithi191 ceph-mon[31636]: pgmap v21232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39644.138173 secs 2024-04-21T21:25:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:32 smithi170 ceph-mon[31212]: pgmap v21232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39644.138173 secs 2024-04-21T21:25:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:34 smithi077 ceph-mon[27902]: pgmap v21233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39645.891933 secs 2024-04-21T21:25:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:34 smithi191 ceph-mon[31636]: pgmap v21233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39645.891933 secs 2024-04-21T21:25:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:34 smithi170 ceph-mon[31212]: pgmap v21233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39645.891933 secs 2024-04-21T21:25:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:36 smithi077 ceph-mon[27902]: pgmap v21234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:36 smithi191 ceph-mon[31636]: pgmap v21234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:36 smithi170 ceph-mon[31212]: pgmap v21234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39649.138252 secs 2024-04-21T21:25:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39649.138252 secs 2024-04-21T21:25:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39649.138252 secs 2024-04-21T21:25:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:38 smithi077 ceph-mon[27902]: pgmap v21235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:38 smithi191 ceph-mon[31636]: pgmap v21235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:38 smithi170 ceph-mon[31212]: pgmap v21235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39650.892052 secs 2024-04-21T21:25:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39650.892052 secs 2024-04-21T21:25:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39650.892052 secs 2024-04-21T21:25:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:40 smithi077 ceph-mon[27902]: pgmap v21236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:40 smithi191 ceph-mon[31636]: pgmap v21236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:40 smithi170 ceph-mon[31212]: pgmap v21236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:42 smithi077 ceph-mon[27902]: pgmap v21237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39654.138371 secs 2024-04-21T21:25:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:42 smithi191 ceph-mon[31636]: pgmap v21237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39654.138371 secs 2024-04-21T21:25:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:42 smithi170 ceph-mon[31212]: pgmap v21237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39654.138371 secs 2024-04-21T21:25:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:44 smithi077 ceph-mon[27902]: pgmap v21238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39655.892119 secs 2024-04-21T21:25:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:44 smithi191 ceph-mon[31636]: pgmap v21238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39655.892119 secs 2024-04-21T21:25:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:44 smithi170 ceph-mon[31212]: pgmap v21238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39655.892119 secs 2024-04-21T21:25:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:46 smithi077 ceph-mon[27902]: pgmap v21239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:46 smithi191 ceph-mon[31636]: pgmap v21239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:46 smithi170 ceph-mon[31212]: pgmap v21239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39659.138501 secs 2024-04-21T21:25:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39659.138501 secs 2024-04-21T21:25:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39659.138501 secs 2024-04-21T21:25:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:48 smithi170 ceph-mon[31212]: pgmap v21240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:48 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:25:49.074 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:48 smithi191 ceph-mon[31636]: pgmap v21240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:49.074 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:48 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:25:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:48 smithi077 ceph-mon[27902]: pgmap v21240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:48 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:25:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39660.892198 secs 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:49 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39660.892198 secs 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:49 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39660.892198 secs 2024-04-21T21:25:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:50.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:49 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: pgmap v21241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:25:51.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: pgmap v21241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:25:51.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: pgmap v21241: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:25:51.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:25:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:25:52.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:25:52.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:25:52.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:25:52.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:25:52.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:51 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:25:52.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:51 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:25:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:25:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:25:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:25:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:25:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:51 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:25:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:51 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:25:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:25:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:25:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:25:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:25:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:51 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:25:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:51 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:25:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:52 smithi077 ceph-mon[27902]: pgmap v21242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39664.138647 secs 2024-04-21T21:25:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:52 smithi191 ceph-mon[31636]: pgmap v21242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39664.138647 secs 2024-04-21T21:25:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:52 smithi170 ceph-mon[31212]: pgmap v21242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39664.138647 secs 2024-04-21T21:25:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:25:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:54 smithi191 ceph-mon[31636]: pgmap v21243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39665.892292 secs 2024-04-21T21:25:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:54 smithi170 ceph-mon[31212]: pgmap v21243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39665.892292 secs 2024-04-21T21:25:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:54 smithi077 ceph-mon[27902]: pgmap v21243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39665.892292 secs 2024-04-21T21:25:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:56 smithi191 ceph-mon[31636]: pgmap v21244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:56 smithi170 ceph-mon[31212]: pgmap v21244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:56 smithi077 ceph-mon[27902]: pgmap v21244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:25:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39669.138811 secs 2024-04-21T21:25:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39669.138811 secs 2024-04-21T21:25:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39669.138811 secs 2024-04-21T21:25:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:58 smithi191 ceph-mon[31636]: pgmap v21245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:58 smithi170 ceph-mon[31212]: pgmap v21245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:58 smithi077 ceph-mon[27902]: pgmap v21245: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:25:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:25:59.841+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:25:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:25:59.841+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:25:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:25:59.848+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:25:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:25:59.848+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:26:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:25:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39670.892374 secs 2024-04-21T21:26:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:25:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39670.892374 secs 2024-04-21T21:26:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:25:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39670.892374 secs 2024-04-21T21:26:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:00 smithi191 ceph-mon[31636]: pgmap v21246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:00 smithi170 ceph-mon[31212]: pgmap v21246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:00 smithi077 ceph-mon[27902]: pgmap v21246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:02 smithi191 ceph-mon[31636]: pgmap v21247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39674.138876 secs 2024-04-21T21:26:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:02 smithi170 ceph-mon[31212]: pgmap v21247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39674.138876 secs 2024-04-21T21:26:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:02 smithi077 ceph-mon[27902]: pgmap v21247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39674.138876 secs 2024-04-21T21:26:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:04 smithi191 ceph-mon[31636]: pgmap v21248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39675.892492 secs 2024-04-21T21:26:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:04 smithi170 ceph-mon[31212]: pgmap v21248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39675.892492 secs 2024-04-21T21:26:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:04 smithi077 ceph-mon[27902]: pgmap v21248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39675.892492 secs 2024-04-21T21:26:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:05 smithi191 ceph-mon[31636]: osdmap e1400: 12 total, 12 up, 12 in 2024-04-21T21:26:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:05 smithi170 ceph-mon[31212]: osdmap e1400: 12 total, 12 up, 12 in 2024-04-21T21:26:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:05 smithi077 ceph-mon[27902]: osdmap e1400: 12 total, 12 up, 12 in 2024-04-21T21:26:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:06 smithi191 ceph-mon[31636]: pgmap v21250: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:06 smithi170 ceph-mon[31212]: pgmap v21250: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:06 smithi077 ceph-mon[27902]: pgmap v21250: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39679.138992 secs 2024-04-21T21:26:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39679.138992 secs 2024-04-21T21:26:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39679.138992 secs 2024-04-21T21:26:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:08 smithi191 ceph-mon[31636]: pgmap v21251: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:08 smithi170 ceph-mon[31212]: pgmap v21251: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:08 smithi077 ceph-mon[27902]: pgmap v21251: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39680.892565 secs 2024-04-21T21:26:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39680.892565 secs 2024-04-21T21:26:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39680.892565 secs 2024-04-21T21:26:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:10 smithi191 ceph-mon[31636]: pgmap v21252: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:10 smithi170 ceph-mon[31212]: pgmap v21252: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:10 smithi077 ceph-mon[27902]: pgmap v21252: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:26:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:12 smithi191 ceph-mon[31636]: pgmap v21253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:26:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39684.139084 secs 2024-04-21T21:26:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:12 smithi170 ceph-mon[31212]: pgmap v21253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:26:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39684.139084 secs 2024-04-21T21:26:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:12 smithi077 ceph-mon[27902]: pgmap v21253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:26:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39684.139084 secs 2024-04-21T21:26:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:14 smithi191 ceph-mon[31636]: pgmap v21254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:26:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39685.892686 secs 2024-04-21T21:26:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:14 smithi170 ceph-mon[31212]: pgmap v21254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:26:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39685.892686 secs 2024-04-21T21:26:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:14 smithi077 ceph-mon[27902]: pgmap v21254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:26:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39685.892686 secs 2024-04-21T21:26:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:16 smithi170 ceph-mon[31212]: osdmap e1401: 12 total, 12 up, 12 in 2024-04-21T21:26:16.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:16 smithi170 ceph-mon[31212]: pgmap v21256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:16 smithi077 ceph-mon[27902]: osdmap e1401: 12 total, 12 up, 12 in 2024-04-21T21:26:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:16 smithi077 ceph-mon[27902]: pgmap v21256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:16 smithi191 ceph-mon[31636]: osdmap e1401: 12 total, 12 up, 12 in 2024-04-21T21:26:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:16 smithi191 ceph-mon[31636]: pgmap v21256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39689.139208 secs 2024-04-21T21:26:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39689.139208 secs 2024-04-21T21:26:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39689.139208 secs 2024-04-21T21:26:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:18 smithi191 ceph-mon[31636]: pgmap v21257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:18 smithi170 ceph-mon[31212]: pgmap v21257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:18 smithi077 ceph-mon[27902]: pgmap v21257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39690.892792 secs 2024-04-21T21:26:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39690.892792 secs 2024-04-21T21:26:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39690.892792 secs 2024-04-21T21:26:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:20 smithi191 ceph-mon[31636]: pgmap v21258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:20 smithi170 ceph-mon[31212]: pgmap v21258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:20 smithi077 ceph-mon[27902]: pgmap v21258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:26:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:22 smithi191 ceph-mon[31636]: pgmap v21259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:26:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39694.139322 secs 2024-04-21T21:26:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:22 smithi170 ceph-mon[31212]: pgmap v21259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:26:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39694.139322 secs 2024-04-21T21:26:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:22 smithi077 ceph-mon[27902]: pgmap v21259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:26:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39694.139322 secs 2024-04-21T21:26:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:24 smithi191 ceph-mon[31636]: pgmap v21260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:26:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39695.892903 secs 2024-04-21T21:26:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:24 smithi170 ceph-mon[31212]: pgmap v21260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:26:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39695.892903 secs 2024-04-21T21:26:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:24 smithi077 ceph-mon[27902]: pgmap v21260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:26:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39695.892903 secs 2024-04-21T21:26:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:26 smithi191 ceph-mon[31636]: pgmap v21261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:26:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:26 smithi170 ceph-mon[31212]: pgmap v21261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:26:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:26 smithi077 ceph-mon[27902]: pgmap v21261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:26:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39699.139389 secs 2024-04-21T21:26:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39699.139389 secs 2024-04-21T21:26:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39699.139389 secs 2024-04-21T21:26:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:28 smithi191 ceph-mon[31636]: pgmap v21262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:28 smithi170 ceph-mon[31212]: pgmap v21262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:28 smithi077 ceph-mon[27902]: pgmap v21262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39700.893030 secs 2024-04-21T21:26:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39700.893030 secs 2024-04-21T21:26:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39700.893030 secs 2024-04-21T21:26:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:30 smithi191 ceph-mon[31636]: pgmap v21263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:30 smithi170 ceph-mon[31212]: pgmap v21263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:30 smithi077 ceph-mon[27902]: pgmap v21263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:32 smithi191 ceph-mon[31636]: pgmap v21264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39704.139502 secs 2024-04-21T21:26:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:32 smithi170 ceph-mon[31212]: pgmap v21264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39704.139502 secs 2024-04-21T21:26:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:32 smithi077 ceph-mon[27902]: pgmap v21264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39704.139502 secs 2024-04-21T21:26:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:34 smithi191 ceph-mon[31636]: pgmap v21265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39705.893165 secs 2024-04-21T21:26:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:34 smithi170 ceph-mon[31212]: pgmap v21265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39705.893165 secs 2024-04-21T21:26:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:34 smithi077 ceph-mon[27902]: pgmap v21265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39705.893165 secs 2024-04-21T21:26:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:36 smithi191 ceph-mon[31636]: pgmap v21266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:36 smithi170 ceph-mon[31212]: pgmap v21266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:36 smithi077 ceph-mon[27902]: pgmap v21266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39709.139623 secs 2024-04-21T21:26:38.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39709.139623 secs 2024-04-21T21:26:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39709.139623 secs 2024-04-21T21:26:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:38 smithi191 ceph-mon[31636]: pgmap v21267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:38 smithi170 ceph-mon[31212]: pgmap v21267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:38 smithi077 ceph-mon[27902]: pgmap v21267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39710.893286 secs 2024-04-21T21:26:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39710.893286 secs 2024-04-21T21:26:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39710.893286 secs 2024-04-21T21:26:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:40 smithi191 ceph-mon[31636]: pgmap v21268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:40 smithi170 ceph-mon[31212]: pgmap v21268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:40 smithi077 ceph-mon[27902]: pgmap v21268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:42 smithi191 ceph-mon[31636]: pgmap v21269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39714.139734 secs 2024-04-21T21:26:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:42 smithi170 ceph-mon[31212]: pgmap v21269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39714.139734 secs 2024-04-21T21:26:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:42 smithi077 ceph-mon[27902]: pgmap v21269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39714.139734 secs 2024-04-21T21:26:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:44 smithi191 ceph-mon[31636]: pgmap v21270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39715.893354 secs 2024-04-21T21:26:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:44 smithi170 ceph-mon[31212]: pgmap v21270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:45.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39715.893354 secs 2024-04-21T21:26:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:44 smithi077 ceph-mon[27902]: pgmap v21270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39715.893354 secs 2024-04-21T21:26:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:46 smithi170 ceph-mon[31212]: pgmap v21271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:46 smithi077 ceph-mon[27902]: pgmap v21271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:46 smithi191 ceph-mon[31636]: pgmap v21271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39719.139876 secs 2024-04-21T21:26:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39719.139876 secs 2024-04-21T21:26:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39719.139876 secs 2024-04-21T21:26:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:48 smithi170 ceph-mon[31212]: pgmap v21272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:48 smithi077 ceph-mon[27902]: pgmap v21272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:48 smithi191 ceph-mon[31636]: pgmap v21272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39720.893462 secs 2024-04-21T21:26:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39720.893462 secs 2024-04-21T21:26:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39720.893462 secs 2024-04-21T21:26:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:50 smithi170 ceph-mon[31212]: pgmap v21273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:50 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:26:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:50 smithi077 ceph-mon[27902]: pgmap v21273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:50 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:26:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:50 smithi191 ceph-mon[31636]: pgmap v21273: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:26:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:50 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:26:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:26:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:26:52.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:51 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:26:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:26:52.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:51 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:26:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:26:52.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:51 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:26:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:52 smithi191 ceph-mon[31636]: pgmap v21274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39724.139988 secs 2024-04-21T21:26:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:52 smithi170 ceph-mon[31212]: pgmap v21274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39724.139988 secs 2024-04-21T21:26:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:52 smithi077 ceph-mon[27902]: pgmap v21274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39724.139988 secs 2024-04-21T21:26:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:26:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:54 smithi191 ceph-mon[31636]: pgmap v21275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:26:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39725.893580 secs 2024-04-21T21:26:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:54 smithi170 ceph-mon[31212]: pgmap v21275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:26:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39725.893580 secs 2024-04-21T21:26:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:54 smithi077 ceph-mon[27902]: pgmap v21275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:26:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39725.893580 secs 2024-04-21T21:26:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:56 smithi191 ceph-mon[31636]: pgmap v21276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:56 smithi170 ceph-mon[31212]: pgmap v21276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:56 smithi077 ceph-mon[27902]: pgmap v21276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:26:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39729.140106 secs 2024-04-21T21:26:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39729.140106 secs 2024-04-21T21:26:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39729.140106 secs 2024-04-21T21:26:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:58 smithi191 ceph-mon[31636]: pgmap v21277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:26:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:58 smithi170 ceph-mon[31212]: pgmap v21277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:26:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:58 smithi077 ceph-mon[27902]: pgmap v21277: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:27:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:26:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39730.893708 secs 2024-04-21T21:27:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:26:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39730.893708 secs 2024-04-21T21:27:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:26:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39730.893708 secs 2024-04-21T21:27:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:00 smithi170 ceph-mon[31212]: pgmap v21278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:27:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:00 smithi077 ceph-mon[27902]: pgmap v21278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:27:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:00 smithi191 ceph-mon[31636]: pgmap v21278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:27:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:02 smithi170 ceph-mon[31212]: pgmap v21279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T21:27:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39734.140166 secs 2024-04-21T21:27:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:02 smithi077 ceph-mon[27902]: pgmap v21279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T21:27:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39734.140166 secs 2024-04-21T21:27:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:02 smithi191 ceph-mon[31636]: pgmap v21279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-04-21T21:27:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39734.140166 secs 2024-04-21T21:27:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:04 smithi170 ceph-mon[31212]: pgmap v21280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T21:27:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39735.893795 secs 2024-04-21T21:27:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:04 smithi077 ceph-mon[27902]: pgmap v21280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T21:27:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39735.893795 secs 2024-04-21T21:27:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:04 smithi191 ceph-mon[31636]: pgmap v21280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-04-21T21:27:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39735.893795 secs 2024-04-21T21:27:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:05 smithi170 ceph-mon[31212]: osdmap e1402: 12 total, 12 up, 12 in 2024-04-21T21:27:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:05 smithi077 ceph-mon[27902]: osdmap e1402: 12 total, 12 up, 12 in 2024-04-21T21:27:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:05 smithi191 ceph-mon[31636]: osdmap e1402: 12 total, 12 up, 12 in 2024-04-21T21:27:07.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:06 smithi170 ceph-mon[31212]: pgmap v21282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:06 smithi077 ceph-mon[27902]: pgmap v21282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:06 smithi191 ceph-mon[31636]: pgmap v21282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39739.140294 secs 2024-04-21T21:27:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39739.140294 secs 2024-04-21T21:27:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39739.140294 secs 2024-04-21T21:27:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:09 smithi170 ceph-mon[31212]: pgmap v21283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:09 smithi077 ceph-mon[27902]: pgmap v21283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:09 smithi191 ceph-mon[31636]: pgmap v21283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39740.893942 secs 2024-04-21T21:27:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39740.893942 secs 2024-04-21T21:27:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39740.893942 secs 2024-04-21T21:27:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:11 smithi170 ceph-mon[31212]: pgmap v21284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:11 smithi077 ceph-mon[27902]: pgmap v21284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:11 smithi191 ceph-mon[31636]: pgmap v21284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:27:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:13 smithi170 ceph-mon[31212]: pgmap v21285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T21:27:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39744.140410 secs 2024-04-21T21:27:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:13 smithi077 ceph-mon[27902]: pgmap v21285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T21:27:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39744.140410 secs 2024-04-21T21:27:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:13 smithi191 ceph-mon[31636]: pgmap v21285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T21:27:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39744.140410 secs 2024-04-21T21:27:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:15 smithi170 ceph-mon[31212]: pgmap v21286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T21:27:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39745.894061 secs 2024-04-21T21:27:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:15 smithi077 ceph-mon[27902]: pgmap v21286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T21:27:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39745.894061 secs 2024-04-21T21:27:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:15 smithi191 ceph-mon[31636]: pgmap v21286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-21T21:27:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39745.894061 secs 2024-04-21T21:27:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:16 smithi170 ceph-mon[31212]: osdmap e1403: 12 total, 12 up, 12 in 2024-04-21T21:27:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:16 smithi170 ceph-mon[31212]: pgmap v21288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:16 smithi077 ceph-mon[27902]: osdmap e1403: 12 total, 12 up, 12 in 2024-04-21T21:27:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:16 smithi077 ceph-mon[27902]: pgmap v21288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:16 smithi191 ceph-mon[31636]: osdmap e1403: 12 total, 12 up, 12 in 2024-04-21T21:27:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:16 smithi191 ceph-mon[31636]: pgmap v21288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:17.723 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39749.140530 secs 2024-04-21T21:27:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39749.140530 secs 2024-04-21T21:27:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39749.140530 secs 2024-04-21T21:27:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:18 smithi191 ceph-mon[31636]: pgmap v21289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:18 smithi170 ceph-mon[31212]: pgmap v21289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:18 smithi077 ceph-mon[27902]: pgmap v21289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39750.894183 secs 2024-04-21T21:27:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39750.894183 secs 2024-04-21T21:27:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39750.894183 secs 2024-04-21T21:27:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:20 smithi191 ceph-mon[31636]: pgmap v21290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:20 smithi170 ceph-mon[31212]: pgmap v21290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:20 smithi077 ceph-mon[27902]: pgmap v21290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:27:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:22 smithi191 ceph-mon[31636]: pgmap v21291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:27:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39754.140661 secs 2024-04-21T21:27:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:22 smithi170 ceph-mon[31212]: pgmap v21291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:27:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39754.140661 secs 2024-04-21T21:27:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:22 smithi077 ceph-mon[27902]: pgmap v21291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:27:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39754.140661 secs 2024-04-21T21:27:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:24 smithi191 ceph-mon[31636]: pgmap v21292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:27:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39755.894279 secs 2024-04-21T21:27:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:24 smithi170 ceph-mon[31212]: pgmap v21292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:27:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39755.894279 secs 2024-04-21T21:27:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:24 smithi077 ceph-mon[27902]: pgmap v21292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:27:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39755.894279 secs 2024-04-21T21:27:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:26 smithi170 ceph-mon[31212]: pgmap v21293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:27:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:26 smithi077 ceph-mon[27902]: pgmap v21293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:27:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:26 smithi191 ceph-mon[31636]: pgmap v21293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T21:27:27.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39759.140787 secs 2024-04-21T21:27:27.821 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39759.140787 secs 2024-04-21T21:27:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39759.140787 secs 2024-04-21T21:27:28.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:28 smithi191 ceph-mon[31636]: pgmap v21294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:28 smithi170 ceph-mon[31212]: pgmap v21294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:28 smithi077 ceph-mon[27902]: pgmap v21294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39760.894379 secs 2024-04-21T21:27:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39760.894379 secs 2024-04-21T21:27:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39760.894379 secs 2024-04-21T21:27:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:30 smithi191 ceph-mon[31636]: pgmap v21295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:30 smithi170 ceph-mon[31212]: pgmap v21295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:30 smithi077 ceph-mon[27902]: pgmap v21295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:32 smithi191 ceph-mon[31636]: pgmap v21296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39764.140893 secs 2024-04-21T21:27:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:32 smithi170 ceph-mon[31212]: pgmap v21296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39764.140893 secs 2024-04-21T21:27:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:32 smithi077 ceph-mon[27902]: pgmap v21296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39764.140893 secs 2024-04-21T21:27:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:34 smithi191 ceph-mon[31636]: pgmap v21297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39765.894458 secs 2024-04-21T21:27:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:34 smithi170 ceph-mon[31212]: pgmap v21297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39765.894458 secs 2024-04-21T21:27:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:34 smithi077 ceph-mon[27902]: pgmap v21297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:35.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39765.894458 secs 2024-04-21T21:27:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:36 smithi191 ceph-mon[31636]: pgmap v21298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:36 smithi170 ceph-mon[31212]: pgmap v21298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:36 smithi077 ceph-mon[27902]: pgmap v21298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39769.140961 secs 2024-04-21T21:27:38.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39769.140961 secs 2024-04-21T21:27:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39769.140961 secs 2024-04-21T21:27:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:38 smithi191 ceph-mon[31636]: pgmap v21299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:38 smithi170 ceph-mon[31212]: pgmap v21299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:38 smithi077 ceph-mon[27902]: pgmap v21299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39770.894582 secs 2024-04-21T21:27:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39770.894582 secs 2024-04-21T21:27:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39770.894582 secs 2024-04-21T21:27:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:40 smithi191 ceph-mon[31636]: pgmap v21300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:40 smithi170 ceph-mon[31212]: pgmap v21300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:40 smithi077 ceph-mon[27902]: pgmap v21300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:42 smithi191 ceph-mon[31636]: pgmap v21301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:42.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39774.141023 secs 2024-04-21T21:27:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:42 smithi170 ceph-mon[31212]: pgmap v21301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39774.141023 secs 2024-04-21T21:27:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:42 smithi077 ceph-mon[27902]: pgmap v21301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39774.141023 secs 2024-04-21T21:27:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:44 smithi191 ceph-mon[31636]: pgmap v21302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:44.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39775.894720 secs 2024-04-21T21:27:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:44 smithi170 ceph-mon[31212]: pgmap v21302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39775.894720 secs 2024-04-21T21:27:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:44 smithi077 ceph-mon[27902]: pgmap v21302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39775.894720 secs 2024-04-21T21:27:46.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:46 smithi191 ceph-mon[31636]: pgmap v21303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:46 smithi170 ceph-mon[31212]: pgmap v21303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:46 smithi077 ceph-mon[27902]: pgmap v21303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39779.141145 secs 2024-04-21T21:27:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39779.141145 secs 2024-04-21T21:27:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39779.141145 secs 2024-04-21T21:27:48.971 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:48 smithi170 ceph-mon[31212]: pgmap v21304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:48 smithi077 ceph-mon[27902]: pgmap v21304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:48 smithi191 ceph-mon[31636]: pgmap v21304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39780.894900 secs 2024-04-21T21:27:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39780.894900 secs 2024-04-21T21:27:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39780.894900 secs 2024-04-21T21:27:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:50 smithi170 ceph-mon[31212]: pgmap v21305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:50 smithi077 ceph-mon[27902]: pgmap v21305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:50 smithi191 ceph-mon[31636]: pgmap v21305: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: pgmap v21306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:27:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39784.141212 secs 2024-04-21T21:27:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:52 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: pgmap v21306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39784.141212 secs 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:52 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: pgmap v21306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39784.141212 secs 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:52 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:27:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:27:54.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:27:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:27:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:27:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:27:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:27:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:27:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:54 smithi191 ceph-mon[31636]: pgmap v21307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39785.895016 secs 2024-04-21T21:27:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:54 smithi170 ceph-mon[31212]: pgmap v21307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39785.895016 secs 2024-04-21T21:27:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:54 smithi077 ceph-mon[27902]: pgmap v21307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39785.895016 secs 2024-04-21T21:27:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:56 smithi191 ceph-mon[31636]: pgmap v21308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:56 smithi170 ceph-mon[31212]: pgmap v21308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:56 smithi077 ceph-mon[27902]: pgmap v21308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:27:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39789.141332 secs 2024-04-21T21:27:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39789.141332 secs 2024-04-21T21:27:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39789.141332 secs 2024-04-21T21:27:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:58 smithi170 ceph-mon[31212]: pgmap v21309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:58 smithi077 ceph-mon[27902]: pgmap v21309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:27:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:58 smithi191 ceph-mon[31636]: pgmap v21309: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:00.230 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:27:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39790.895139 secs 2024-04-21T21:28:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:27:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39790.895139 secs 2024-04-21T21:28:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:27:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39790.895139 secs 2024-04-21T21:28:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:00 smithi170 ceph-mon[31212]: pgmap v21310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:00 smithi077 ceph-mon[27902]: pgmap v21310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:00 smithi191 ceph-mon[31636]: pgmap v21310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:02 smithi170 ceph-mon[31212]: pgmap v21311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39794.141446 secs 2024-04-21T21:28:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:02 smithi077 ceph-mon[27902]: pgmap v21311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39794.141446 secs 2024-04-21T21:28:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:02 smithi191 ceph-mon[31636]: pgmap v21311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39794.141446 secs 2024-04-21T21:28:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:04 smithi170 ceph-mon[31212]: pgmap v21312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39795.895215 secs 2024-04-21T21:28:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:04 smithi077 ceph-mon[27902]: pgmap v21312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39795.895215 secs 2024-04-21T21:28:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:04 smithi191 ceph-mon[31636]: pgmap v21312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39795.895215 secs 2024-04-21T21:28:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:05 smithi170 ceph-mon[31212]: osdmap e1404: 12 total, 12 up, 12 in 2024-04-21T21:28:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:05 smithi077 ceph-mon[27902]: osdmap e1404: 12 total, 12 up, 12 in 2024-04-21T21:28:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:05 smithi191 ceph-mon[31636]: osdmap e1404: 12 total, 12 up, 12 in 2024-04-21T21:28:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:06 smithi170 ceph-mon[31212]: pgmap v21314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:06 smithi077 ceph-mon[27902]: pgmap v21314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:06 smithi191 ceph-mon[31636]: pgmap v21314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39799.141520 secs 2024-04-21T21:28:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39799.141520 secs 2024-04-21T21:28:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39799.141520 secs 2024-04-21T21:28:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:09 smithi170 ceph-mon[31212]: pgmap v21315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:09 smithi077 ceph-mon[27902]: pgmap v21315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:09 smithi191 ceph-mon[31636]: pgmap v21315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39800.895347 secs 2024-04-21T21:28:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39800.895347 secs 2024-04-21T21:28:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39800.895347 secs 2024-04-21T21:28:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:11 smithi170 ceph-mon[31212]: pgmap v21316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:11 smithi077 ceph-mon[27902]: pgmap v21316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:11 smithi191 ceph-mon[31636]: pgmap v21316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:28:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:13 smithi170 ceph-mon[31212]: pgmap v21317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:28:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39804.141634 secs 2024-04-21T21:28:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:13 smithi077 ceph-mon[27902]: pgmap v21317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:28:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39804.141634 secs 2024-04-21T21:28:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:13 smithi191 ceph-mon[31636]: pgmap v21317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:28:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39804.141634 secs 2024-04-21T21:28:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:15 smithi170 ceph-mon[31212]: pgmap v21318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:28:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39805.895455 secs 2024-04-21T21:28:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:15 smithi077 ceph-mon[27902]: pgmap v21318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:28:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39805.895455 secs 2024-04-21T21:28:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:15 smithi191 ceph-mon[31636]: pgmap v21318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:28:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39805.895455 secs 2024-04-21T21:28:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:16 smithi170 ceph-mon[31212]: osdmap e1405: 12 total, 12 up, 12 in 2024-04-21T21:28:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:16 smithi170 ceph-mon[31212]: pgmap v21320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:16 smithi077 ceph-mon[27902]: osdmap e1405: 12 total, 12 up, 12 in 2024-04-21T21:28:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:16 smithi077 ceph-mon[27902]: pgmap v21320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:16 smithi191 ceph-mon[31636]: osdmap e1405: 12 total, 12 up, 12 in 2024-04-21T21:28:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:16 smithi191 ceph-mon[31636]: pgmap v21320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39809.141793 secs 2024-04-21T21:28:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39809.141793 secs 2024-04-21T21:28:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39809.141793 secs 2024-04-21T21:28:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:18 smithi191 ceph-mon[31636]: pgmap v21321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:18 smithi170 ceph-mon[31212]: pgmap v21321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:18 smithi077 ceph-mon[27902]: pgmap v21321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39810.895585 secs 2024-04-21T21:28:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39810.895585 secs 2024-04-21T21:28:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39810.895585 secs 2024-04-21T21:28:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 39995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:20 smithi191 ceph-mon[31636]: pgmap v21322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:20 smithi170 ceph-mon[31212]: pgmap v21322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:20 smithi077 ceph-mon[27902]: pgmap v21322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:28:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:22 smithi191 ceph-mon[31636]: pgmap v21323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:28:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39814.141864 secs 2024-04-21T21:28:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:22 smithi170 ceph-mon[31212]: pgmap v21323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:28:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39814.141864 secs 2024-04-21T21:28:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:22 smithi077 ceph-mon[27902]: pgmap v21323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:28:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39814.141864 secs 2024-04-21T21:28:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:24 smithi191 ceph-mon[31636]: pgmap v21324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:28:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39815.895686 secs 2024-04-21T21:28:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:24 smithi170 ceph-mon[31212]: pgmap v21324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:28:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39815.895686 secs 2024-04-21T21:28:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:24 smithi077 ceph-mon[27902]: pgmap v21324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:28:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39815.895686 secs 2024-04-21T21:28:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:26 smithi170 ceph-mon[31212]: pgmap v21325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:28:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:26 smithi077 ceph-mon[27902]: pgmap v21325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:28:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:26 smithi191 ceph-mon[31636]: pgmap v21325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:28:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39819.141963 secs 2024-04-21T21:28:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39819.141963 secs 2024-04-21T21:28:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39819.141963 secs 2024-04-21T21:28:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:28 smithi191 ceph-mon[31636]: pgmap v21326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:28 smithi170 ceph-mon[31212]: pgmap v21326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:28 smithi077 ceph-mon[27902]: pgmap v21326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39820.895804 secs 2024-04-21T21:28:29.812 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39820.895804 secs 2024-04-21T21:28:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39820.895804 secs 2024-04-21T21:28:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:30 smithi191 ceph-mon[31636]: pgmap v21327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:30 smithi170 ceph-mon[31212]: pgmap v21327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:30 smithi077 ceph-mon[27902]: pgmap v21327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:32 smithi191 ceph-mon[31636]: pgmap v21328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:32.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39824.142076 secs 2024-04-21T21:28:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:32 smithi170 ceph-mon[31212]: pgmap v21328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39824.142076 secs 2024-04-21T21:28:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:32 smithi077 ceph-mon[27902]: pgmap v21328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39824.142076 secs 2024-04-21T21:28:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:34 smithi191 ceph-mon[31636]: pgmap v21329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:34.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39825.895923 secs 2024-04-21T21:28:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:34 smithi170 ceph-mon[31212]: pgmap v21329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39825.895923 secs 2024-04-21T21:28:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:34 smithi077 ceph-mon[27902]: pgmap v21329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39825.895923 secs 2024-04-21T21:28:36.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:36 smithi191 ceph-mon[31636]: pgmap v21330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:36 smithi170 ceph-mon[31212]: pgmap v21330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:36 smithi077 ceph-mon[27902]: pgmap v21330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39829.142197 secs 2024-04-21T21:28:38.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39829.142197 secs 2024-04-21T21:28:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39829.142197 secs 2024-04-21T21:28:38.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:38 smithi191 ceph-mon[31636]: pgmap v21331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:38 smithi170 ceph-mon[31212]: pgmap v21331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:38 smithi077 ceph-mon[27902]: pgmap v21331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39830.896040 secs 2024-04-21T21:28:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39830.896040 secs 2024-04-21T21:28:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39830.896040 secs 2024-04-21T21:28:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:40 smithi170 ceph-mon[31212]: pgmap v21332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:40 smithi077 ceph-mon[27902]: pgmap v21332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:40 smithi191 ceph-mon[31636]: pgmap v21332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:42 smithi170 ceph-mon[31212]: pgmap v21333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39834.142311 secs 2024-04-21T21:28:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:42 smithi077 ceph-mon[27902]: pgmap v21333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39834.142311 secs 2024-04-21T21:28:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:42 smithi191 ceph-mon[31636]: pgmap v21333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39834.142311 secs 2024-04-21T21:28:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:44 smithi170 ceph-mon[31212]: pgmap v21334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39835.896156 secs 2024-04-21T21:28:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:44 smithi077 ceph-mon[27902]: pgmap v21334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39835.896156 secs 2024-04-21T21:28:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:44 smithi191 ceph-mon[31636]: pgmap v21334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39835.896156 secs 2024-04-21T21:28:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:46 smithi170 ceph-mon[31212]: pgmap v21335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:46 smithi077 ceph-mon[27902]: pgmap v21335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:46 smithi191 ceph-mon[31636]: pgmap v21335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39839.142430 secs 2024-04-21T21:28:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39839.142430 secs 2024-04-21T21:28:48.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39839.142430 secs 2024-04-21T21:28:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:48 smithi170 ceph-mon[31212]: pgmap v21336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:48 smithi077 ceph-mon[27902]: pgmap v21336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:48 smithi191 ceph-mon[31636]: pgmap v21336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39840.896267 secs 2024-04-21T21:28:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:50.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39840.896267 secs 2024-04-21T21:28:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39840.896267 secs 2024-04-21T21:28:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:50 smithi170 ceph-mon[31212]: pgmap v21337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:50 smithi077 ceph-mon[27902]: pgmap v21337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:50 smithi191 ceph-mon[31636]: pgmap v21337: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:52 smithi170 ceph-mon[31212]: pgmap v21338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39844.142520 secs 2024-04-21T21:28:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:52 smithi077 ceph-mon[27902]: pgmap v21338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39844.142520 secs 2024-04-21T21:28:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:52 smithi191 ceph-mon[31636]: pgmap v21338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39844.142520 secs 2024-04-21T21:28:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:28:54.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:28:54.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:28:54.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:53 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:28:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:28:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:28:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:28:54.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:53 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:28:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:28:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:28:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:28:54.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:53 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:28:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.466+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000397) for more than 900000000 us, fault. 2024-04-21T21:28:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.466+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T21:28:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.466+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.467+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T21:28:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.467+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d70 tx=0x7efd70034040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efd70005d70 tx=0x7efd70034040 comp rx=0 tx=0).stop 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.558+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:28:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7004a000 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T21:28:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:54 smithi170 ceph-mon[31212]: pgmap v21339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39845.896382 secs 2024-04-21T21:28:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:28:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:54 smithi077 ceph-mon[27902]: pgmap v21339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39845.896382 secs 2024-04-21T21:28:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:54 smithi191 ceph-mon[31636]: pgmap v21339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39845.896382 secs 2024-04-21T21:28:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:56 smithi170 ceph-mon[31212]: pgmap v21340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:56 smithi077 ceph-mon[27902]: pgmap v21340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:56 smithi191 ceph-mon[31636]: pgmap v21340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:28:58.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39849.142637 secs 2024-04-21T21:28:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39849.142637 secs 2024-04-21T21:28:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39849.142637 secs 2024-04-21T21:28:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:58 smithi170 ceph-mon[31212]: pgmap v21341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:58 smithi077 ceph-mon[27902]: pgmap v21341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:58 smithi191 ceph-mon[31636]: pgmap v21341: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:28:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.865+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:28:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.866+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T21:28:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.866+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:28:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.866+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:28:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.870+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:28:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.870+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T21:28:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.870+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:28:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:28:59.871+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:29:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:28:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39850.896511 secs 2024-04-21T21:29:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:28:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39850.896511 secs 2024-04-21T21:29:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:28:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39850.896511 secs 2024-04-21T21:29:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:00 smithi170 ceph-mon[31212]: pgmap v21342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:00 smithi077 ceph-mon[27902]: pgmap v21342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:00 smithi191 ceph-mon[31636]: pgmap v21342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:02 smithi170 ceph-mon[31212]: pgmap v21343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39854.142790 secs 2024-04-21T21:29:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:02 smithi077 ceph-mon[27902]: pgmap v21343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39854.142790 secs 2024-04-21T21:29:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:02 smithi191 ceph-mon[31636]: pgmap v21343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39854.142790 secs 2024-04-21T21:29:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:04 smithi170 ceph-mon[31212]: pgmap v21344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:05.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39855.896638 secs 2024-04-21T21:29:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:04 smithi077 ceph-mon[27902]: pgmap v21344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39855.896638 secs 2024-04-21T21:29:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:04 smithi191 ceph-mon[31636]: pgmap v21344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39855.896638 secs 2024-04-21T21:29:06.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:05 smithi170 ceph-mon[31212]: osdmap e1406: 12 total, 12 up, 12 in 2024-04-21T21:29:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:05 smithi077 ceph-mon[27902]: osdmap e1406: 12 total, 12 up, 12 in 2024-04-21T21:29:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:05 smithi191 ceph-mon[31636]: osdmap e1406: 12 total, 12 up, 12 in 2024-04-21T21:29:07.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:06 smithi170 ceph-mon[31212]: pgmap v21346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:06 smithi077 ceph-mon[27902]: pgmap v21346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:06 smithi191 ceph-mon[31636]: pgmap v21346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39859.142910 secs 2024-04-21T21:29:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39859.142910 secs 2024-04-21T21:29:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39859.142910 secs 2024-04-21T21:29:09.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:08 smithi077 ceph-mon[27902]: pgmap v21347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:08 smithi170 ceph-mon[31212]: pgmap v21347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:08 smithi191 ceph-mon[31636]: pgmap v21347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39860.896755 secs 2024-04-21T21:29:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39860.896755 secs 2024-04-21T21:29:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39860.896755 secs 2024-04-21T21:29:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:10 smithi077 ceph-mon[27902]: pgmap v21348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:11.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:10 smithi191 ceph-mon[31636]: pgmap v21348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:10 smithi170 ceph-mon[31212]: pgmap v21348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:29:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:12 smithi077 ceph-mon[27902]: pgmap v21349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:29:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39864.143042 secs 2024-04-21T21:29:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:12 smithi191 ceph-mon[31636]: pgmap v21349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:29:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39864.143042 secs 2024-04-21T21:29:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:12 smithi170 ceph-mon[31212]: pgmap v21349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:29:13.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39864.143042 secs 2024-04-21T21:29:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:14 smithi077 ceph-mon[27902]: pgmap v21350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:29:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39865.896893 secs 2024-04-21T21:29:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:14 smithi191 ceph-mon[31636]: pgmap v21350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:29:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39865.896893 secs 2024-04-21T21:29:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:14 smithi170 ceph-mon[31212]: pgmap v21350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:29:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39865.896893 secs 2024-04-21T21:29:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:16 smithi170 ceph-mon[31212]: osdmap e1407: 12 total, 12 up, 12 in 2024-04-21T21:29:16.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:16 smithi170 ceph-mon[31212]: pgmap v21352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:16 smithi077 ceph-mon[27902]: osdmap e1407: 12 total, 12 up, 12 in 2024-04-21T21:29:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:16 smithi077 ceph-mon[27902]: pgmap v21352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:16 smithi191 ceph-mon[31636]: osdmap e1407: 12 total, 12 up, 12 in 2024-04-21T21:29:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:16 smithi191 ceph-mon[31636]: pgmap v21352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39869.143122 secs 2024-04-21T21:29:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39869.143122 secs 2024-04-21T21:29:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39869.143122 secs 2024-04-21T21:29:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:18 smithi191 ceph-mon[31636]: pgmap v21353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:18 smithi170 ceph-mon[31212]: pgmap v21353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:18 smithi077 ceph-mon[27902]: pgmap v21353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39870.896993 secs 2024-04-21T21:29:19.753 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39870.896993 secs 2024-04-21T21:29:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39870.896993 secs 2024-04-21T21:29:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:20 smithi077 ceph-mon[27902]: pgmap v21354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:20 smithi191 ceph-mon[31636]: pgmap v21354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:20 smithi170 ceph-mon[31212]: pgmap v21354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:29:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:22 smithi191 ceph-mon[31636]: pgmap v21355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:29:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39874.143201 secs 2024-04-21T21:29:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:22 smithi170 ceph-mon[31212]: pgmap v21355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:29:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39874.143201 secs 2024-04-21T21:29:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:22 smithi077 ceph-mon[27902]: pgmap v21355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:29:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39874.143201 secs 2024-04-21T21:29:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:24 smithi191 ceph-mon[31636]: pgmap v21356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:29:24.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39875.897114 secs 2024-04-21T21:29:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:24 smithi170 ceph-mon[31212]: pgmap v21356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:29:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39875.897114 secs 2024-04-21T21:29:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:24 smithi077 ceph-mon[27902]: pgmap v21356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:29:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39875.897114 secs 2024-04-21T21:29:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:26 smithi191 ceph-mon[31636]: pgmap v21357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:29:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:26 smithi170 ceph-mon[31212]: pgmap v21357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:29:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:26 smithi077 ceph-mon[27902]: pgmap v21357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:29:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39879.143309 secs 2024-04-21T21:29:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39879.143309 secs 2024-04-21T21:29:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39879.143309 secs 2024-04-21T21:29:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:28 smithi170 ceph-mon[31212]: pgmap v21358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:28 smithi077 ceph-mon[27902]: pgmap v21358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:28 smithi191 ceph-mon[31636]: pgmap v21358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39880.897230 secs 2024-04-21T21:29:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39880.897230 secs 2024-04-21T21:29:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39880.897230 secs 2024-04-21T21:29:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:30 smithi170 ceph-mon[31212]: pgmap v21359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:30 smithi077 ceph-mon[27902]: pgmap v21359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:30 smithi191 ceph-mon[31636]: pgmap v21359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:32 smithi170 ceph-mon[31212]: pgmap v21360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39884.143458 secs 2024-04-21T21:29:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:32 smithi077 ceph-mon[27902]: pgmap v21360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39884.143458 secs 2024-04-21T21:29:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:32 smithi191 ceph-mon[31636]: pgmap v21360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39884.143458 secs 2024-04-21T21:29:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:34 smithi170 ceph-mon[31212]: pgmap v21361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39885.897340 secs 2024-04-21T21:29:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:34 smithi077 ceph-mon[27902]: pgmap v21361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39885.897340 secs 2024-04-21T21:29:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:34 smithi191 ceph-mon[31636]: pgmap v21361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39885.897340 secs 2024-04-21T21:29:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:36 smithi170 ceph-mon[31212]: pgmap v21362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:36 smithi077 ceph-mon[27902]: pgmap v21362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:36 smithi191 ceph-mon[31636]: pgmap v21362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:38.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39889.143586 secs 2024-04-21T21:29:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39889.143586 secs 2024-04-21T21:29:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39889.143586 secs 2024-04-21T21:29:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:38 smithi170 ceph-mon[31212]: pgmap v21363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:38 smithi077 ceph-mon[27902]: pgmap v21363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:38 smithi191 ceph-mon[31636]: pgmap v21363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39890.897459 secs 2024-04-21T21:29:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39890.897459 secs 2024-04-21T21:29:40.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39890.897459 secs 2024-04-21T21:29:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:40 smithi170 ceph-mon[31212]: pgmap v21364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:40 smithi077 ceph-mon[27902]: pgmap v21364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:40 smithi191 ceph-mon[31636]: pgmap v21364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:42 smithi170 ceph-mon[31212]: pgmap v21365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39894.143719 secs 2024-04-21T21:29:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:42 smithi077 ceph-mon[27902]: pgmap v21365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39894.143719 secs 2024-04-21T21:29:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:42 smithi191 ceph-mon[31636]: pgmap v21365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39894.143719 secs 2024-04-21T21:29:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:44 smithi170 ceph-mon[31212]: pgmap v21366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39895.897577 secs 2024-04-21T21:29:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:44 smithi077 ceph-mon[27902]: pgmap v21366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39895.897577 secs 2024-04-21T21:29:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:44 smithi191 ceph-mon[31636]: pgmap v21366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39895.897577 secs 2024-04-21T21:29:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:46 smithi170 ceph-mon[31212]: pgmap v21367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:46 smithi077 ceph-mon[27902]: pgmap v21367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:46 smithi191 ceph-mon[31636]: pgmap v21367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39899.143820 secs 2024-04-21T21:29:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39899.143820 secs 2024-04-21T21:29:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39899.143820 secs 2024-04-21T21:29:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:48 smithi170 ceph-mon[31212]: pgmap v21368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:48 smithi077 ceph-mon[27902]: pgmap v21368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:48 smithi191 ceph-mon[31636]: pgmap v21368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39900.897691 secs 2024-04-21T21:29:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39900.897691 secs 2024-04-21T21:29:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39900.897691 secs 2024-04-21T21:29:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:50 smithi170 ceph-mon[31212]: pgmap v21369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:50 smithi077 ceph-mon[27902]: pgmap v21369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:50 smithi191 ceph-mon[31636]: pgmap v21369: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:52 smithi170 ceph-mon[31212]: pgmap v21370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39904.143889 secs 2024-04-21T21:29:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:52 smithi077 ceph-mon[27902]: pgmap v21370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39904.143889 secs 2024-04-21T21:29:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:52 smithi191 ceph-mon[31636]: pgmap v21370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39904.143889 secs 2024-04-21T21:29:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:54 smithi170 ceph-mon[31212]: pgmap v21371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:29:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39905.897778 secs 2024-04-21T21:29:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:29:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:29:55.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:29:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:29:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:54 smithi077 ceph-mon[27902]: pgmap v21371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:29:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39905.897778 secs 2024-04-21T21:29:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:29:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:29:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:29:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:54 smithi191 ceph-mon[31636]: pgmap v21371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:29:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39905.897778 secs 2024-04-21T21:29:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:29:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:29:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:29:57.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:56 smithi170 ceph-mon[31212]: pgmap v21372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:56 smithi077 ceph-mon[27902]: pgmap v21372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:56 smithi191 ceph-mon[31636]: pgmap v21372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:29:58.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39909.144005 secs 2024-04-21T21:29:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39909.144005 secs 2024-04-21T21:29:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39909.144005 secs 2024-04-21T21:29:59.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:58 smithi170 ceph-mon[31212]: pgmap v21373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:58 smithi077 ceph-mon[27902]: pgmap v21373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:29:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:58 smithi191 ceph-mon[31636]: pgmap v21373: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:00.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:29:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39910.897914 secs 2024-04-21T21:30:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:29:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39910.897914 secs 2024-04-21T21:30:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:29:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39910.897914 secs 2024-04-21T21:30:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:00 smithi170 ceph-mon[31212]: pgmap v21374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:01.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:30:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:00 smithi077 ceph-mon[27902]: pgmap v21374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:30:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:00 smithi191 ceph-mon[31636]: pgmap v21374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:30:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:02 smithi077 ceph-mon[27902]: pgmap v21375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39914.144113 secs 2024-04-21T21:30:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:02 smithi191 ceph-mon[31636]: pgmap v21375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39914.144113 secs 2024-04-21T21:30:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:02 smithi170 ceph-mon[31212]: pgmap v21375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:03.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39914.144113 secs 2024-04-21T21:30:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:04 smithi077 ceph-mon[27902]: pgmap v21376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39915.898052 secs 2024-04-21T21:30:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:04 smithi191 ceph-mon[31636]: pgmap v21376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39915.898052 secs 2024-04-21T21:30:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:04 smithi170 ceph-mon[31212]: pgmap v21376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39915.898052 secs 2024-04-21T21:30:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:05 smithi077 ceph-mon[27902]: osdmap e1408: 12 total, 12 up, 12 in 2024-04-21T21:30:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:05 smithi191 ceph-mon[31636]: osdmap e1408: 12 total, 12 up, 12 in 2024-04-21T21:30:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:05 smithi170 ceph-mon[31212]: osdmap e1408: 12 total, 12 up, 12 in 2024-04-21T21:30:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:06 smithi077 ceph-mon[27902]: pgmap v21378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:06 smithi191 ceph-mon[31636]: pgmap v21378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:06 smithi170 ceph-mon[31212]: pgmap v21378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39919.144225 secs 2024-04-21T21:30:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39919.144225 secs 2024-04-21T21:30:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39919.144225 secs 2024-04-21T21:30:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:08 smithi077 ceph-mon[27902]: pgmap v21379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:08 smithi191 ceph-mon[31636]: pgmap v21379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:08 smithi170 ceph-mon[31212]: pgmap v21379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39920.898150 secs 2024-04-21T21:30:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39920.898150 secs 2024-04-21T21:30:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39920.898150 secs 2024-04-21T21:30:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:10 smithi077 ceph-mon[27902]: pgmap v21380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:10 smithi191 ceph-mon[31636]: pgmap v21380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:10 smithi170 ceph-mon[31212]: pgmap v21380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:30:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:12 smithi077 ceph-mon[27902]: pgmap v21381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:30:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39924.144357 secs 2024-04-21T21:30:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:12 smithi191 ceph-mon[31636]: pgmap v21381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:30:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39924.144357 secs 2024-04-21T21:30:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:12 smithi170 ceph-mon[31212]: pgmap v21381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:30:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39924.144357 secs 2024-04-21T21:30:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:14 smithi077 ceph-mon[27902]: pgmap v21382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:30:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39925.898268 secs 2024-04-21T21:30:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:14 smithi191 ceph-mon[31636]: pgmap v21382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:30:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39925.898268 secs 2024-04-21T21:30:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:14 smithi170 ceph-mon[31212]: pgmap v21382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:30:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39925.898268 secs 2024-04-21T21:30:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:16 smithi077 ceph-mon[27902]: osdmap e1409: 12 total, 12 up, 12 in 2024-04-21T21:30:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:16 smithi077 ceph-mon[27902]: pgmap v21384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:16 smithi191 ceph-mon[31636]: osdmap e1409: 12 total, 12 up, 12 in 2024-04-21T21:30:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:16 smithi191 ceph-mon[31636]: pgmap v21384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:16 smithi170 ceph-mon[31212]: osdmap e1409: 12 total, 12 up, 12 in 2024-04-21T21:30:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:16 smithi170 ceph-mon[31212]: pgmap v21384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:17.708 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39929.144476 secs 2024-04-21T21:30:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39929.144476 secs 2024-04-21T21:30:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39929.144476 secs 2024-04-21T21:30:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:18 smithi191 ceph-mon[31636]: pgmap v21385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:18 smithi170 ceph-mon[31212]: pgmap v21385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:18 smithi077 ceph-mon[27902]: pgmap v21385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39930.898355 secs 2024-04-21T21:30:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39930.898355 secs 2024-04-21T21:30:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39930.898355 secs 2024-04-21T21:30:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:20 smithi191 ceph-mon[31636]: pgmap v21386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:20 smithi170 ceph-mon[31212]: pgmap v21386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:20 smithi077 ceph-mon[27902]: pgmap v21386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:30:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:22 smithi170 ceph-mon[31212]: pgmap v21387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:30:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39934.144587 secs 2024-04-21T21:30:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:22 smithi077 ceph-mon[27902]: pgmap v21387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:30:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39934.144587 secs 2024-04-21T21:30:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:22 smithi191 ceph-mon[31636]: pgmap v21387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:30:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39934.144587 secs 2024-04-21T21:30:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:24 smithi170 ceph-mon[31212]: pgmap v21388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:30:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39935.898473 secs 2024-04-21T21:30:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:24 smithi077 ceph-mon[27902]: pgmap v21388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:30:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39935.898473 secs 2024-04-21T21:30:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:24 smithi191 ceph-mon[31636]: pgmap v21388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:30:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39935.898473 secs 2024-04-21T21:30:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:26 smithi170 ceph-mon[31212]: pgmap v21389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:30:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:26 smithi077 ceph-mon[27902]: pgmap v21389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:30:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:26 smithi191 ceph-mon[31636]: pgmap v21389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:30:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39939.144708 secs 2024-04-21T21:30:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39939.144708 secs 2024-04-21T21:30:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39939.144708 secs 2024-04-21T21:30:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:28 smithi170 ceph-mon[31212]: pgmap v21390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:28 smithi077 ceph-mon[27902]: pgmap v21390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:28 smithi191 ceph-mon[31636]: pgmap v21390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39940.898563 secs 2024-04-21T21:30:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39940.898563 secs 2024-04-21T21:30:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39940.898563 secs 2024-04-21T21:30:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:30 smithi170 ceph-mon[31212]: pgmap v21391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:30 smithi077 ceph-mon[27902]: pgmap v21391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:30 smithi191 ceph-mon[31636]: pgmap v21391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:32 smithi170 ceph-mon[31212]: pgmap v21392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39944.144841 secs 2024-04-21T21:30:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:32 smithi077 ceph-mon[27902]: pgmap v21392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39944.144841 secs 2024-04-21T21:30:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:32 smithi191 ceph-mon[31636]: pgmap v21392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39944.144841 secs 2024-04-21T21:30:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:34 smithi170 ceph-mon[31212]: pgmap v21393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39945.898683 secs 2024-04-21T21:30:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:34 smithi077 ceph-mon[27902]: pgmap v21393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39945.898683 secs 2024-04-21T21:30:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:34 smithi191 ceph-mon[31636]: pgmap v21393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39945.898683 secs 2024-04-21T21:30:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:36 smithi170 ceph-mon[31212]: pgmap v21394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:36 smithi077 ceph-mon[27902]: pgmap v21394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:36 smithi191 ceph-mon[31636]: pgmap v21394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:38.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39949.144953 secs 2024-04-21T21:30:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39949.144953 secs 2024-04-21T21:30:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39949.144953 secs 2024-04-21T21:30:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:38 smithi170 ceph-mon[31212]: pgmap v21395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:39.138 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:38 smithi077 ceph-mon[27902]: pgmap v21395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:38 smithi191 ceph-mon[31636]: pgmap v21395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39950.898818 secs 2024-04-21T21:30:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:40.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39950.898818 secs 2024-04-21T21:30:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39950.898818 secs 2024-04-21T21:30:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:40 smithi170 ceph-mon[31212]: pgmap v21396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:40 smithi077 ceph-mon[27902]: pgmap v21396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:40 smithi191 ceph-mon[31636]: pgmap v21396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:42 smithi170 ceph-mon[31212]: pgmap v21397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39954.145069 secs 2024-04-21T21:30:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:42 smithi077 ceph-mon[27902]: pgmap v21397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39954.145069 secs 2024-04-21T21:30:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:42 smithi191 ceph-mon[31636]: pgmap v21397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:43.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39954.145069 secs 2024-04-21T21:30:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:44 smithi170 ceph-mon[31212]: pgmap v21398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39955.898943 secs 2024-04-21T21:30:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:44 smithi077 ceph-mon[27902]: pgmap v21398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39955.898943 secs 2024-04-21T21:30:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:44 smithi191 ceph-mon[31636]: pgmap v21398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39955.898943 secs 2024-04-21T21:30:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:46 smithi170 ceph-mon[31212]: pgmap v21399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:46 smithi077 ceph-mon[27902]: pgmap v21399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:46 smithi191 ceph-mon[31636]: pgmap v21399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39959.145153 secs 2024-04-21T21:30:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39959.145153 secs 2024-04-21T21:30:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39959.145153 secs 2024-04-21T21:30:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:48 smithi170 ceph-mon[31212]: pgmap v21400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:48 smithi077 ceph-mon[27902]: pgmap v21400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:48 smithi191 ceph-mon[31636]: pgmap v21400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39960.899080 secs 2024-04-21T21:30:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39960.899080 secs 2024-04-21T21:30:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39960.899080 secs 2024-04-21T21:30:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:50 smithi077 ceph-mon[27902]: pgmap v21401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:50 smithi191 ceph-mon[31636]: pgmap v21401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:50 smithi170 ceph-mon[31212]: pgmap v21401: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:52 smithi077 ceph-mon[27902]: pgmap v21402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39964.145216 secs 2024-04-21T21:30:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:52 smithi191 ceph-mon[31636]: pgmap v21402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39964.145216 secs 2024-04-21T21:30:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:52 smithi170 ceph-mon[31212]: pgmap v21402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39964.145216 secs 2024-04-21T21:30:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:30:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:54 smithi077 ceph-mon[27902]: pgmap v21403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39965.899159 secs 2024-04-21T21:30:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:54 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:30:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:54 smithi191 ceph-mon[31636]: pgmap v21403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39965.899159 secs 2024-04-21T21:30:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:54 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:30:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:54 smithi170 ceph-mon[31212]: pgmap v21403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39965.899159 secs 2024-04-21T21:30:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:54 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:30:56.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:30:56.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:30:56.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:30:56.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:30:56.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:30:56.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:30:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:30:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:30:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:30:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:56 smithi077 ceph-mon[27902]: pgmap v21404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:56 smithi191 ceph-mon[31636]: pgmap v21404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:56 smithi170 ceph-mon[31212]: pgmap v21404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:30:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39969.145318 secs 2024-04-21T21:30:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39969.145318 secs 2024-04-21T21:30:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39969.145318 secs 2024-04-21T21:30:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:58 smithi077 ceph-mon[27902]: pgmap v21405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:58 smithi191 ceph-mon[31636]: pgmap v21405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:30:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:58 smithi170 ceph-mon[31212]: pgmap v21405: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:30:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39970.899278 secs 2024-04-21T21:31:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:30:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39970.899278 secs 2024-04-21T21:31:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:30:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39970.899278 secs 2024-04-21T21:31:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:00 smithi077 ceph-mon[27902]: pgmap v21406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:00 smithi191 ceph-mon[31636]: pgmap v21406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:00 smithi170 ceph-mon[31212]: pgmap v21406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:02 smithi077 ceph-mon[27902]: pgmap v21407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39974.145423 secs 2024-04-21T21:31:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:02 smithi191 ceph-mon[31636]: pgmap v21407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39974.145423 secs 2024-04-21T21:31:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:02 smithi170 ceph-mon[31212]: pgmap v21407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39974.145423 secs 2024-04-21T21:31:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:04 smithi077 ceph-mon[27902]: pgmap v21408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39975.899362 secs 2024-04-21T21:31:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:04 smithi191 ceph-mon[31636]: pgmap v21408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39975.899362 secs 2024-04-21T21:31:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:04 smithi170 ceph-mon[31212]: pgmap v21408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39975.899362 secs 2024-04-21T21:31:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:05 smithi077 ceph-mon[27902]: osdmap e1410: 12 total, 12 up, 12 in 2024-04-21T21:31:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:05 smithi191 ceph-mon[31636]: osdmap e1410: 12 total, 12 up, 12 in 2024-04-21T21:31:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:05 smithi170 ceph-mon[31212]: osdmap e1410: 12 total, 12 up, 12 in 2024-04-21T21:31:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:06 smithi077 ceph-mon[27902]: pgmap v21410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:07.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:06 smithi191 ceph-mon[31636]: pgmap v21410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:06 smithi170 ceph-mon[31212]: pgmap v21410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39979.145547 secs 2024-04-21T21:31:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39979.145547 secs 2024-04-21T21:31:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39979.145547 secs 2024-04-21T21:31:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:08 smithi077 ceph-mon[27902]: pgmap v21411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:08 smithi191 ceph-mon[31636]: pgmap v21411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:08 smithi170 ceph-mon[31212]: pgmap v21411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39980.899484 secs 2024-04-21T21:31:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39980.899484 secs 2024-04-21T21:31:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39980.899484 secs 2024-04-21T21:31:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:10 smithi077 ceph-mon[27902]: pgmap v21412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:10 smithi191 ceph-mon[31636]: pgmap v21412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:10 smithi170 ceph-mon[31212]: pgmap v21412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:31:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:12 smithi077 ceph-mon[27902]: pgmap v21413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:31:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39984.145693 secs 2024-04-21T21:31:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:12 smithi191 ceph-mon[31636]: pgmap v21413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:31:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39984.145693 secs 2024-04-21T21:31:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:12 smithi170 ceph-mon[31212]: pgmap v21413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:31:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39984.145693 secs 2024-04-21T21:31:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:14 smithi077 ceph-mon[27902]: pgmap v21414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:31:15.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39985.899620 secs 2024-04-21T21:31:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:14 smithi191 ceph-mon[31636]: pgmap v21414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:31:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39985.899620 secs 2024-04-21T21:31:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:14 smithi170 ceph-mon[31212]: pgmap v21414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:31:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39985.899620 secs 2024-04-21T21:31:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:16 smithi077 ceph-mon[27902]: osdmap e1411: 12 total, 12 up, 12 in 2024-04-21T21:31:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:16 smithi077 ceph-mon[27902]: pgmap v21416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:16 smithi191 ceph-mon[31636]: osdmap e1411: 12 total, 12 up, 12 in 2024-04-21T21:31:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:16 smithi191 ceph-mon[31636]: pgmap v21416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:16 smithi170 ceph-mon[31212]: osdmap e1411: 12 total, 12 up, 12 in 2024-04-21T21:31:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:16 smithi170 ceph-mon[31212]: pgmap v21416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:17.709 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39989.145832 secs 2024-04-21T21:31:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39989.145832 secs 2024-04-21T21:31:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39989.145832 secs 2024-04-21T21:31:18.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:18 smithi191 ceph-mon[31636]: pgmap v21417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:18 smithi170 ceph-mon[31212]: pgmap v21417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:18 smithi077 ceph-mon[27902]: pgmap v21417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39990.899735 secs 2024-04-21T21:31:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39990.899735 secs 2024-04-21T21:31:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39990.899735 secs 2024-04-21T21:31:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:20 smithi170 ceph-mon[31212]: pgmap v21418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:20 smithi077 ceph-mon[27902]: pgmap v21418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:20 smithi191 ceph-mon[31636]: pgmap v21418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:31:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:22 smithi170 ceph-mon[31212]: pgmap v21419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39994.145938 secs 2024-04-21T21:31:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:22 smithi077 ceph-mon[27902]: pgmap v21419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39994.145938 secs 2024-04-21T21:31:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:22 smithi191 ceph-mon[31636]: pgmap v21419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39994.145938 secs 2024-04-21T21:31:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:24 smithi170 ceph-mon[31212]: pgmap v21420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 39995.899872 secs 2024-04-21T21:31:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:24 smithi077 ceph-mon[27902]: pgmap v21420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 39995.899872 secs 2024-04-21T21:31:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:24 smithi191 ceph-mon[31636]: pgmap v21420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 39995.899872 secs 2024-04-21T21:31:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:26 smithi077 ceph-mon[27902]: pgmap v21421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:26 smithi191 ceph-mon[31636]: pgmap v21421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:26 smithi170 ceph-mon[31212]: pgmap v21421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:31:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 39999.146042 secs 2024-04-21T21:31:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 39999.146042 secs 2024-04-21T21:31:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 39999.146042 secs 2024-04-21T21:31:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:28 smithi191 ceph-mon[31636]: pgmap v21422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:28 smithi170 ceph-mon[31212]: pgmap v21422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:28 smithi077 ceph-mon[27902]: pgmap v21422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40000.899958 secs 2024-04-21T21:31:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40000.899958 secs 2024-04-21T21:31:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40000.899958 secs 2024-04-21T21:31:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:30 smithi170 ceph-mon[31212]: pgmap v21423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:30 smithi077 ceph-mon[27902]: pgmap v21423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:30 smithi191 ceph-mon[31636]: pgmap v21423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:32 smithi170 ceph-mon[31212]: pgmap v21424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40004.146190 secs 2024-04-21T21:31:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:32 smithi077 ceph-mon[27902]: pgmap v21424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40004.146190 secs 2024-04-21T21:31:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:32 smithi191 ceph-mon[31636]: pgmap v21424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40004.146190 secs 2024-04-21T21:31:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:34 smithi170 ceph-mon[31212]: pgmap v21425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40005.900102 secs 2024-04-21T21:31:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:34 smithi077 ceph-mon[27902]: pgmap v21425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40005.900102 secs 2024-04-21T21:31:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:34 smithi191 ceph-mon[31636]: pgmap v21425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40005.900102 secs 2024-04-21T21:31:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:36 smithi170 ceph-mon[31212]: pgmap v21426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:36 smithi077 ceph-mon[27902]: pgmap v21426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:36 smithi191 ceph-mon[31636]: pgmap v21426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:38.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40009.146291 secs 2024-04-21T21:31:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40009.146291 secs 2024-04-21T21:31:38.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40009.146291 secs 2024-04-21T21:31:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:38 smithi170 ceph-mon[31212]: pgmap v21427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:38 smithi077 ceph-mon[27902]: pgmap v21427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:38 smithi191 ceph-mon[31636]: pgmap v21427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40010.900186 secs 2024-04-21T21:31:40.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40010.900186 secs 2024-04-21T21:31:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40010.900186 secs 2024-04-21T21:31:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:40 smithi170 ceph-mon[31212]: pgmap v21428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:40 smithi077 ceph-mon[27902]: pgmap v21428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:40 smithi191 ceph-mon[31636]: pgmap v21428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:42 smithi170 ceph-mon[31212]: pgmap v21429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:43.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40014.146424 secs 2024-04-21T21:31:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:42 smithi077 ceph-mon[27902]: pgmap v21429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40014.146424 secs 2024-04-21T21:31:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:42 smithi191 ceph-mon[31636]: pgmap v21429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40014.146424 secs 2024-04-21T21:31:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:44 smithi170 ceph-mon[31212]: pgmap v21430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:45.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40015.900269 secs 2024-04-21T21:31:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:44 smithi077 ceph-mon[27902]: pgmap v21430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40015.900269 secs 2024-04-21T21:31:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:44 smithi191 ceph-mon[31636]: pgmap v21430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40015.900269 secs 2024-04-21T21:31:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:46 smithi170 ceph-mon[31212]: pgmap v21431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:46 smithi077 ceph-mon[27902]: pgmap v21431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:46 smithi191 ceph-mon[31636]: pgmap v21431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40019.146565 secs 2024-04-21T21:31:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40019.146565 secs 2024-04-21T21:31:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40019.146565 secs 2024-04-21T21:31:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:48 smithi170 ceph-mon[31212]: pgmap v21432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:48 smithi077 ceph-mon[27902]: pgmap v21432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:48 smithi191 ceph-mon[31636]: pgmap v21432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40020.900338 secs 2024-04-21T21:31:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40020.900338 secs 2024-04-21T21:31:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40020.900338 secs 2024-04-21T21:31:51.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:50 smithi170 ceph-mon[31212]: pgmap v21433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:50 smithi077 ceph-mon[27902]: pgmap v21433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:50 smithi191 ceph-mon[31636]: pgmap v21433: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:52 smithi170 ceph-mon[31212]: pgmap v21434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:53.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40024.146673 secs 2024-04-21T21:31:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:52 smithi077 ceph-mon[27902]: pgmap v21434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40024.146673 secs 2024-04-21T21:31:53.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:52 smithi191 ceph-mon[31636]: pgmap v21434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40024.146673 secs 2024-04-21T21:31:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:54 smithi170 ceph-mon[31212]: pgmap v21435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:55.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40025.900442 secs 2024-04-21T21:31:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:31:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:54 smithi077 ceph-mon[27902]: pgmap v21435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40025.900442 secs 2024-04-21T21:31:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:54 smithi191 ceph-mon[31636]: pgmap v21435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40025.900442 secs 2024-04-21T21:31:56.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:55 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:31:56.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:55 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:31:56.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:55 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:31:57.008 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:56 smithi077 ceph-mon[27902]: pgmap v21436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:56 smithi191 ceph-mon[31636]: pgmap v21436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:56 smithi170 ceph-mon[31212]: pgmap v21436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:31:58.066 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40029.146748 secs 2024-04-21T21:31:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40029.146748 secs 2024-04-21T21:31:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40029.146748 secs 2024-04-21T21:31:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:58 smithi077 ceph-mon[27902]: pgmap v21437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:58 smithi191 ceph-mon[31636]: pgmap v21437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:58 smithi170 ceph-mon[31212]: pgmap v21437: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:31:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:31:59.889+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:31:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:31:59.889+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:31:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:31:59.891+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:31:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:31:59.892+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:32:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40030.900557 secs 2024-04-21T21:32:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:32:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:32:00.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:31:59 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40030.900557 secs 2024-04-21T21:32:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:32:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:32:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:31:59 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40030.900557 secs 2024-04-21T21:32:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:32:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:32:00.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:31:59 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:32:01.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:00 smithi077 ceph-mon[27902]: pgmap v21438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:00 smithi191 ceph-mon[31636]: pgmap v21438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:00 smithi170 ceph-mon[31212]: pgmap v21438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:02 smithi077 ceph-mon[27902]: pgmap v21439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40034.146851 secs 2024-04-21T21:32:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:02 smithi191 ceph-mon[31636]: pgmap v21439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40034.146851 secs 2024-04-21T21:32:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:02 smithi170 ceph-mon[31212]: pgmap v21439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40034.146851 secs 2024-04-21T21:32:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:04 smithi077 ceph-mon[27902]: pgmap v21440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:05.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40035.900654 secs 2024-04-21T21:32:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:04 smithi191 ceph-mon[31636]: pgmap v21440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40035.900654 secs 2024-04-21T21:32:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:04 smithi170 ceph-mon[31212]: pgmap v21440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40035.900654 secs 2024-04-21T21:32:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:05 smithi077 ceph-mon[27902]: osdmap e1412: 12 total, 12 up, 12 in 2024-04-21T21:32:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:05 smithi191 ceph-mon[31636]: osdmap e1412: 12 total, 12 up, 12 in 2024-04-21T21:32:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:05 smithi170 ceph-mon[31212]: osdmap e1412: 12 total, 12 up, 12 in 2024-04-21T21:32:07.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:06 smithi077 ceph-mon[27902]: pgmap v21442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:06 smithi191 ceph-mon[31636]: pgmap v21442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:06 smithi170 ceph-mon[31212]: pgmap v21442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40039.146969 secs 2024-04-21T21:32:08.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40039.146969 secs 2024-04-21T21:32:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40039.146969 secs 2024-04-21T21:32:09.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:08 smithi077 ceph-mon[27902]: pgmap v21443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:09.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:08 smithi191 ceph-mon[31636]: pgmap v21443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:08 smithi170 ceph-mon[31212]: pgmap v21443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40040.900779 secs 2024-04-21T21:32:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40040.900779 secs 2024-04-21T21:32:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40040.900779 secs 2024-04-21T21:32:11.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:10 smithi077 ceph-mon[27902]: pgmap v21444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:10 smithi191 ceph-mon[31636]: pgmap v21444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:10 smithi170 ceph-mon[31212]: pgmap v21444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:32:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:12 smithi077 ceph-mon[27902]: pgmap v21445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:32:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40044.147108 secs 2024-04-21T21:32:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:12 smithi191 ceph-mon[31636]: pgmap v21445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:32:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40044.147108 secs 2024-04-21T21:32:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:12 smithi170 ceph-mon[31212]: pgmap v21445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:32:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40044.147108 secs 2024-04-21T21:32:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:14 smithi077 ceph-mon[27902]: pgmap v21446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:32:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40045.900903 secs 2024-04-21T21:32:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:14 smithi191 ceph-mon[31636]: pgmap v21446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:32:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40045.900903 secs 2024-04-21T21:32:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:14 smithi170 ceph-mon[31212]: pgmap v21446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:32:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40045.900903 secs 2024-04-21T21:32:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:16 smithi077 ceph-mon[27902]: osdmap e1413: 12 total, 12 up, 12 in 2024-04-21T21:32:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:16 smithi077 ceph-mon[27902]: pgmap v21448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:16 smithi191 ceph-mon[31636]: osdmap e1413: 12 total, 12 up, 12 in 2024-04-21T21:32:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:16 smithi191 ceph-mon[31636]: pgmap v21448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:16 smithi170 ceph-mon[31212]: osdmap e1413: 12 total, 12 up, 12 in 2024-04-21T21:32:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:16 smithi170 ceph-mon[31212]: pgmap v21448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:17.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40049.147227 secs 2024-04-21T21:32:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40049.147227 secs 2024-04-21T21:32:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40049.147227 secs 2024-04-21T21:32:18.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:18 smithi191 ceph-mon[31636]: pgmap v21449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:18 smithi170 ceph-mon[31212]: pgmap v21449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:18 smithi077 ceph-mon[27902]: pgmap v21449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40050.901022 secs 2024-04-21T21:32:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40050.901022 secs 2024-04-21T21:32:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40050.901022 secs 2024-04-21T21:32:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:20 smithi170 ceph-mon[31212]: pgmap v21450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:20 smithi077 ceph-mon[27902]: pgmap v21450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:20 smithi191 ceph-mon[31636]: pgmap v21450: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:32:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:22 smithi170 ceph-mon[31212]: pgmap v21451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:32:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40054.147338 secs 2024-04-21T21:32:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:22 smithi077 ceph-mon[27902]: pgmap v21451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:32:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40054.147338 secs 2024-04-21T21:32:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:22 smithi191 ceph-mon[31636]: pgmap v21451: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:32:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40054.147338 secs 2024-04-21T21:32:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:24 smithi170 ceph-mon[31212]: pgmap v21452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:32:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40055.901158 secs 2024-04-21T21:32:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:24 smithi077 ceph-mon[27902]: pgmap v21452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:32:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40055.901158 secs 2024-04-21T21:32:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:24 smithi191 ceph-mon[31636]: pgmap v21452: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:32:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40055.901158 secs 2024-04-21T21:32:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:26 smithi170 ceph-mon[31212]: pgmap v21453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:32:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:26 smithi077 ceph-mon[27902]: pgmap v21453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:32:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:26 smithi191 ceph-mon[31636]: pgmap v21453: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:32:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40059.147456 secs 2024-04-21T21:32:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40059.147456 secs 2024-04-21T21:32:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40059.147456 secs 2024-04-21T21:32:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:28 smithi170 ceph-mon[31212]: pgmap v21454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:28 smithi077 ceph-mon[27902]: pgmap v21454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:28 smithi191 ceph-mon[31636]: pgmap v21454: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40060.901279 secs 2024-04-21T21:32:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40060.901279 secs 2024-04-21T21:32:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40060.901279 secs 2024-04-21T21:32:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:30 smithi170 ceph-mon[31212]: pgmap v21455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:30 smithi077 ceph-mon[27902]: pgmap v21455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:30 smithi191 ceph-mon[31636]: pgmap v21455: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:32 smithi170 ceph-mon[31212]: pgmap v21456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40064.147566 secs 2024-04-21T21:32:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:32 smithi077 ceph-mon[27902]: pgmap v21456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40064.147566 secs 2024-04-21T21:32:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:32 smithi191 ceph-mon[31636]: pgmap v21456: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40064.147566 secs 2024-04-21T21:32:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:34 smithi170 ceph-mon[31212]: pgmap v21457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40065.901400 secs 2024-04-21T21:32:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:34 smithi077 ceph-mon[27902]: pgmap v21457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40065.901400 secs 2024-04-21T21:32:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:34 smithi191 ceph-mon[31636]: pgmap v21457: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40065.901400 secs 2024-04-21T21:32:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:36 smithi170 ceph-mon[31212]: pgmap v21458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:36 smithi077 ceph-mon[27902]: pgmap v21458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:37.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:36 smithi191 ceph-mon[31636]: pgmap v21458: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40069.147691 secs 2024-04-21T21:32:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40069.147691 secs 2024-04-21T21:32:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40069.147691 secs 2024-04-21T21:32:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:38 smithi170 ceph-mon[31212]: pgmap v21459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:38 smithi077 ceph-mon[27902]: pgmap v21459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:38 smithi191 ceph-mon[31636]: pgmap v21459: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40070.901525 secs 2024-04-21T21:32:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40070.901525 secs 2024-04-21T21:32:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40070.901525 secs 2024-04-21T21:32:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:40 smithi077 ceph-mon[27902]: pgmap v21460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:40 smithi191 ceph-mon[31636]: pgmap v21460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:40 smithi170 ceph-mon[31212]: pgmap v21460: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:42 smithi077 ceph-mon[27902]: pgmap v21461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40074.147825 secs 2024-04-21T21:32:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:42 smithi191 ceph-mon[31636]: pgmap v21461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40074.147825 secs 2024-04-21T21:32:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:42 smithi170 ceph-mon[31212]: pgmap v21461: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40074.147825 secs 2024-04-21T21:32:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:44 smithi077 ceph-mon[27902]: pgmap v21462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40075.901604 secs 2024-04-21T21:32:45.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:44 smithi191 ceph-mon[31636]: pgmap v21462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40075.901604 secs 2024-04-21T21:32:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:44 smithi170 ceph-mon[31212]: pgmap v21462: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40075.901604 secs 2024-04-21T21:32:47.109 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:46 smithi170 ceph-mon[31212]: pgmap v21463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:46 smithi077 ceph-mon[27902]: pgmap v21463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:46 smithi191 ceph-mon[31636]: pgmap v21463: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40079.147909 secs 2024-04-21T21:32:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40079.147909 secs 2024-04-21T21:32:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40079.147909 secs 2024-04-21T21:32:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:48 smithi077 ceph-mon[27902]: pgmap v21464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:48 smithi191 ceph-mon[31636]: pgmap v21464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:48 smithi170 ceph-mon[31212]: pgmap v21464: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40080.901731 secs 2024-04-21T21:32:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40080.901731 secs 2024-04-21T21:32:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40080.901731 secs 2024-04-21T21:32:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:50 smithi077 ceph-mon[27902]: pgmap v21465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:50 smithi191 ceph-mon[31636]: pgmap v21465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:50 smithi170 ceph-mon[31212]: pgmap v21465: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:52 smithi077 ceph-mon[27902]: pgmap v21466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40084.147994 secs 2024-04-21T21:32:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:52 smithi191 ceph-mon[31636]: pgmap v21466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40084.147994 secs 2024-04-21T21:32:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:52 smithi170 ceph-mon[31212]: pgmap v21466: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40084.147994 secs 2024-04-21T21:32:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:32:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:54 smithi077 ceph-mon[27902]: pgmap v21467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40085.901844 secs 2024-04-21T21:32:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:54 smithi191 ceph-mon[31636]: pgmap v21467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40085.901844 secs 2024-04-21T21:32:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:54 smithi170 ceph-mon[31212]: pgmap v21467: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40085.901844 secs 2024-04-21T21:32:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:56 smithi077 ceph-mon[27902]: pgmap v21468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:56 smithi191 ceph-mon[31636]: pgmap v21468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:56 smithi170 ceph-mon[31212]: pgmap v21468: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:32:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40089.148109 secs 2024-04-21T21:32:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40089.148109 secs 2024-04-21T21:32:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40089.148109 secs 2024-04-21T21:32:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:58 smithi077 ceph-mon[27902]: pgmap v21469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:58 smithi191 ceph-mon[31636]: pgmap v21469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:32:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:58 smithi170 ceph-mon[31212]: pgmap v21469: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:00.128 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:32:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40090.901965 secs 2024-04-21T21:33:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:32:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40090.901965 secs 2024-04-21T21:33:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:32:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40090.901965 secs 2024-04-21T21:33:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:00 smithi077 ceph-mon[27902]: pgmap v21470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:00 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:33:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:00 smithi191 ceph-mon[31636]: pgmap v21470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:00 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:33:01.237 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:00 smithi170 ceph-mon[31212]: pgmap v21470: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:01.238 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:00 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:33:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:02 smithi170 ceph-mon[31212]: pgmap v21471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T21:33:03.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40094.148181 secs 2024-04-21T21:33:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:02 smithi077 ceph-mon[27902]: pgmap v21471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T21:33:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40094.148181 secs 2024-04-21T21:33:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:02 smithi191 ceph-mon[31636]: pgmap v21471: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-04-21T21:33:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40094.148181 secs 2024-04-21T21:33:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: pgmap v21472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40095.902059 secs 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:33:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: pgmap v21472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40095.902059 secs 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:33:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: pgmap v21472: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-21T21:33:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40095.902059 secs 2024-04-21T21:33:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:33:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:33:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:33:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:05 smithi077 ceph-mon[27902]: osdmap e1414: 12 total, 12 up, 12 in 2024-04-21T21:33:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:05 smithi191 ceph-mon[31636]: osdmap e1414: 12 total, 12 up, 12 in 2024-04-21T21:33:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:05 smithi170 ceph-mon[31212]: osdmap e1414: 12 total, 12 up, 12 in 2024-04-21T21:33:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:06 smithi077 ceph-mon[27902]: pgmap v21474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:06 smithi191 ceph-mon[31636]: pgmap v21474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:06 smithi170 ceph-mon[31212]: pgmap v21474: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40099.148250 secs 2024-04-21T21:33:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40099.148250 secs 2024-04-21T21:33:08.319 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40099.148250 secs 2024-04-21T21:33:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:08 smithi191 ceph-mon[31636]: pgmap v21475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:09.252 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:08 smithi077 ceph-mon[27902]: pgmap v21475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:09.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:08 smithi170 ceph-mon[31212]: pgmap v21475: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40100.902182 secs 2024-04-21T21:33:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40100.902182 secs 2024-04-21T21:33:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40100.902182 secs 2024-04-21T21:33:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:10 smithi191 ceph-mon[31636]: pgmap v21476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:11.390 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:10 smithi077 ceph-mon[27902]: pgmap v21476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:11.390 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:10 smithi170 ceph-mon[31212]: pgmap v21476: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:33:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:12 smithi191 ceph-mon[31636]: pgmap v21477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T21:33:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40104.148354 secs 2024-04-21T21:33:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:12 smithi170 ceph-mon[31212]: pgmap v21477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T21:33:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40104.148354 secs 2024-04-21T21:33:13.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:12 smithi077 ceph-mon[27902]: pgmap v21477: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T21:33:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40104.148354 secs 2024-04-21T21:33:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:14 smithi191 ceph-mon[31636]: pgmap v21478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T21:33:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40105.902283 secs 2024-04-21T21:33:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:14 smithi170 ceph-mon[31212]: pgmap v21478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T21:33:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40105.902283 secs 2024-04-21T21:33:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:14 smithi077 ceph-mon[27902]: pgmap v21478: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-04-21T21:33:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40105.902283 secs 2024-04-21T21:33:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:16 smithi077 ceph-mon[27902]: osdmap e1415: 12 total, 12 up, 12 in 2024-04-21T21:33:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:16 smithi077 ceph-mon[27902]: pgmap v21480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:16 smithi191 ceph-mon[31636]: osdmap e1415: 12 total, 12 up, 12 in 2024-04-21T21:33:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:16 smithi191 ceph-mon[31636]: pgmap v21480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:16 smithi170 ceph-mon[31212]: osdmap e1415: 12 total, 12 up, 12 in 2024-04-21T21:33:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:16 smithi170 ceph-mon[31212]: pgmap v21480: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40109.148478 secs 2024-04-21T21:33:17.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40109.148478 secs 2024-04-21T21:33:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40109.148478 secs 2024-04-21T21:33:18.755 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:18 smithi077 ceph-mon[27902]: pgmap v21481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:18 smithi170 ceph-mon[31212]: pgmap v21481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:18 smithi191 ceph-mon[31636]: pgmap v21481: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40110.902426 secs 2024-04-21T21:33:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40110.902426 secs 2024-04-21T21:33:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40110.902426 secs 2024-04-21T21:33:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:20 smithi170 ceph-mon[31212]: pgmap v21482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:20 smithi077 ceph-mon[27902]: pgmap v21482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:20 smithi191 ceph-mon[31636]: pgmap v21482: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:33:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:22 smithi170 ceph-mon[31212]: pgmap v21483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:33:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40114.148577 secs 2024-04-21T21:33:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:22 smithi077 ceph-mon[27902]: pgmap v21483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:33:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40114.148577 secs 2024-04-21T21:33:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:22 smithi191 ceph-mon[31636]: pgmap v21483: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:33:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40114.148577 secs 2024-04-21T21:33:25.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:24 smithi170 ceph-mon[31212]: pgmap v21484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:33:25.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40115.902567 secs 2024-04-21T21:33:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:24 smithi077 ceph-mon[27902]: pgmap v21484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:33:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40115.902567 secs 2024-04-21T21:33:25.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:24 smithi191 ceph-mon[31636]: pgmap v21484: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:33:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40115.902567 secs 2024-04-21T21:33:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:26 smithi077 ceph-mon[27902]: pgmap v21485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:33:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:26 smithi191 ceph-mon[31636]: pgmap v21485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:33:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:26 smithi170 ceph-mon[31212]: pgmap v21485: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:33:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40119.148674 secs 2024-04-21T21:33:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40119.148674 secs 2024-04-21T21:33:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40119.148674 secs 2024-04-21T21:33:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:28 smithi170 ceph-mon[31212]: pgmap v21486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:28 smithi077 ceph-mon[27902]: pgmap v21486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:28 smithi191 ceph-mon[31636]: pgmap v21486: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40120.902702 secs 2024-04-21T21:33:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40120.902702 secs 2024-04-21T21:33:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40120.902702 secs 2024-04-21T21:33:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:30 smithi170 ceph-mon[31212]: pgmap v21487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:30.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:30 smithi077 ceph-mon[27902]: pgmap v21487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:30 smithi191 ceph-mon[31636]: pgmap v21487: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:33.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:32 smithi170 ceph-mon[31212]: pgmap v21488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:33.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40124.148792 secs 2024-04-21T21:33:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:32 smithi077 ceph-mon[27902]: pgmap v21488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40124.148792 secs 2024-04-21T21:33:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:32 smithi191 ceph-mon[31636]: pgmap v21488: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40124.148792 secs 2024-04-21T21:33:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:34 smithi170 ceph-mon[31212]: pgmap v21489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:35.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40125.902817 secs 2024-04-21T21:33:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:34 smithi077 ceph-mon[27902]: pgmap v21489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40125.902817 secs 2024-04-21T21:33:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:34 smithi191 ceph-mon[31636]: pgmap v21489: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40125.902817 secs 2024-04-21T21:33:37.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:36 smithi170 ceph-mon[31212]: pgmap v21490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:36 smithi077 ceph-mon[27902]: pgmap v21490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:36 smithi191 ceph-mon[31636]: pgmap v21490: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:38.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40129.148910 secs 2024-04-21T21:33:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40129.148910 secs 2024-04-21T21:33:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40129.148910 secs 2024-04-21T21:33:39.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:38 smithi170 ceph-mon[31212]: pgmap v21491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:38 smithi077 ceph-mon[27902]: pgmap v21491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:38 smithi191 ceph-mon[31636]: pgmap v21491: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:40.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40130.902929 secs 2024-04-21T21:33:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40130.902929 secs 2024-04-21T21:33:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40130.902929 secs 2024-04-21T21:33:41.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:40 smithi170 ceph-mon[31212]: pgmap v21492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:40 smithi077 ceph-mon[27902]: pgmap v21492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:40 smithi191 ceph-mon[31636]: pgmap v21492: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:42 smithi077 ceph-mon[27902]: pgmap v21493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40134.149024 secs 2024-04-21T21:33:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:42 smithi191 ceph-mon[31636]: pgmap v21493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40134.149024 secs 2024-04-21T21:33:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:42 smithi170 ceph-mon[31212]: pgmap v21493: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40134.149024 secs 2024-04-21T21:33:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:44 smithi077 ceph-mon[27902]: pgmap v21494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40135.903048 secs 2024-04-21T21:33:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:44 smithi191 ceph-mon[31636]: pgmap v21494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40135.903048 secs 2024-04-21T21:33:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:44 smithi170 ceph-mon[31212]: pgmap v21494: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40135.903048 secs 2024-04-21T21:33:47.109 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:46 smithi170 ceph-mon[31212]: pgmap v21495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:46 smithi077 ceph-mon[27902]: pgmap v21495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:46 smithi191 ceph-mon[31636]: pgmap v21495: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:48.119 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40139.149126 secs 2024-04-21T21:33:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40139.149126 secs 2024-04-21T21:33:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40139.149126 secs 2024-04-21T21:33:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:48 smithi077 ceph-mon[27902]: pgmap v21496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:48 smithi191 ceph-mon[31636]: pgmap v21496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:48 smithi170 ceph-mon[31212]: pgmap v21496: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40140.903167 secs 2024-04-21T21:33:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40140.903167 secs 2024-04-21T21:33:50.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40140.903167 secs 2024-04-21T21:33:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:50 smithi077 ceph-mon[27902]: pgmap v21497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:50 smithi191 ceph-mon[31636]: pgmap v21497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:50 smithi170 ceph-mon[31212]: pgmap v21497: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:52 smithi077 ceph-mon[27902]: pgmap v21498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40144.149247 secs 2024-04-21T21:33:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:52 smithi191 ceph-mon[31636]: pgmap v21498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40144.149247 secs 2024-04-21T21:33:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:52 smithi170 ceph-mon[31212]: pgmap v21498: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40144.149247 secs 2024-04-21T21:33:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:33:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:54 smithi077 ceph-mon[27902]: pgmap v21499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40145.903279 secs 2024-04-21T21:33:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:54 smithi191 ceph-mon[31636]: pgmap v21499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40145.903279 secs 2024-04-21T21:33:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:54 smithi170 ceph-mon[31212]: pgmap v21499: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40145.903279 secs 2024-04-21T21:33:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:56 smithi077 ceph-mon[27902]: pgmap v21500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:57.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:56 smithi191 ceph-mon[31636]: pgmap v21500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:56 smithi170 ceph-mon[31212]: pgmap v21500: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:33:58.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40149.149370 secs 2024-04-21T21:33:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40149.149370 secs 2024-04-21T21:33:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40149.149370 secs 2024-04-21T21:33:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:58 smithi077 ceph-mon[27902]: pgmap v21501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:58 smithi191 ceph-mon[31636]: pgmap v21501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:33:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:58 smithi170 ceph-mon[31212]: pgmap v21501: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:33:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40150.903368 secs 2024-04-21T21:34:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:33:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40150.903368 secs 2024-04-21T21:34:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:33:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40150.903368 secs 2024-04-21T21:34:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:00 smithi077 ceph-mon[27902]: pgmap v21502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:00 smithi191 ceph-mon[31636]: pgmap v21502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:01.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:00 smithi170 ceph-mon[31212]: pgmap v21502: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:02 smithi077 ceph-mon[27902]: pgmap v21503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40154.149465 secs 2024-04-21T21:34:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:02 smithi191 ceph-mon[31636]: pgmap v21503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40154.149465 secs 2024-04-21T21:34:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:02 smithi170 ceph-mon[31212]: pgmap v21503: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40154.149465 secs 2024-04-21T21:34:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:04 smithi077 ceph-mon[27902]: pgmap v21504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40155.903499 secs 2024-04-21T21:34:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:04 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:34:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:04 smithi191 ceph-mon[31636]: pgmap v21504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40155.903499 secs 2024-04-21T21:34:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:04 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:34:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:04 smithi170 ceph-mon[31212]: pgmap v21504: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40155.903499 secs 2024-04-21T21:34:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:04 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:34:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:05 smithi077 ceph-mon[27902]: osdmap e1416: 12 total, 12 up, 12 in 2024-04-21T21:34:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:34:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:34:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:34:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:05 smithi191 ceph-mon[31636]: osdmap e1416: 12 total, 12 up, 12 in 2024-04-21T21:34:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:34:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:34:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:34:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:05 smithi170 ceph-mon[31212]: osdmap e1416: 12 total, 12 up, 12 in 2024-04-21T21:34:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:34:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:34:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:34:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:07 smithi191 ceph-mon[31636]: pgmap v21506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:07 smithi170 ceph-mon[31212]: pgmap v21506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:07 smithi077 ceph-mon[27902]: pgmap v21506: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40159.149586 secs 2024-04-21T21:34:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40159.149586 secs 2024-04-21T21:34:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40159.149586 secs 2024-04-21T21:34:09.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:09 smithi191 ceph-mon[31636]: pgmap v21507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:09 smithi170 ceph-mon[31212]: pgmap v21507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:09 smithi077 ceph-mon[27902]: pgmap v21507: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40160.903602 secs 2024-04-21T21:34:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40160.903602 secs 2024-04-21T21:34:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40160.903602 secs 2024-04-21T21:34:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:11 smithi191 ceph-mon[31636]: pgmap v21508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:11 smithi170 ceph-mon[31212]: pgmap v21508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:11 smithi077 ceph-mon[27902]: pgmap v21508: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:34:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:13 smithi191 ceph-mon[31636]: pgmap v21509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:34:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40164.149733 secs 2024-04-21T21:34:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:13 smithi170 ceph-mon[31212]: pgmap v21509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:34:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40164.149733 secs 2024-04-21T21:34:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:13 smithi077 ceph-mon[27902]: pgmap v21509: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:34:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40164.149733 secs 2024-04-21T21:34:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:15 smithi191 ceph-mon[31636]: pgmap v21510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:34:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40165.903718 secs 2024-04-21T21:34:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:15 smithi170 ceph-mon[31212]: pgmap v21510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:34:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40165.903718 secs 2024-04-21T21:34:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:15 smithi077 ceph-mon[27902]: pgmap v21510: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:34:15.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40165.903718 secs 2024-04-21T21:34:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:16 smithi077 ceph-mon[27902]: osdmap e1417: 12 total, 12 up, 12 in 2024-04-21T21:34:16.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:16 smithi077 ceph-mon[27902]: pgmap v21512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:16 smithi191 ceph-mon[31636]: osdmap e1417: 12 total, 12 up, 12 in 2024-04-21T21:34:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:16 smithi191 ceph-mon[31636]: pgmap v21512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:16 smithi170 ceph-mon[31212]: osdmap e1417: 12 total, 12 up, 12 in 2024-04-21T21:34:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:16 smithi170 ceph-mon[31212]: pgmap v21512: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40169.149863 secs 2024-04-21T21:34:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40169.149863 secs 2024-04-21T21:34:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40169.149863 secs 2024-04-21T21:34:18.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:18 smithi170 ceph-mon[31212]: pgmap v21513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:18 smithi191 ceph-mon[31636]: pgmap v21513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:18 smithi077 ceph-mon[27902]: pgmap v21513: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40170.903803 secs 2024-04-21T21:34:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40170.903803 secs 2024-04-21T21:34:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40170.903803 secs 2024-04-21T21:34:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:20 smithi170 ceph-mon[31212]: pgmap v21514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:20 smithi077 ceph-mon[27902]: pgmap v21514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:20 smithi191 ceph-mon[31636]: pgmap v21514: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:34:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:22 smithi170 ceph-mon[31212]: pgmap v21515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:34:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40174.149965 secs 2024-04-21T21:34:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:22 smithi077 ceph-mon[27902]: pgmap v21515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:34:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40174.149965 secs 2024-04-21T21:34:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:22 smithi191 ceph-mon[31636]: pgmap v21515: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:34:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40174.149965 secs 2024-04-21T21:34:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:24 smithi170 ceph-mon[31212]: pgmap v21516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:34:25.059 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40175.903945 secs 2024-04-21T21:34:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:24 smithi077 ceph-mon[27902]: pgmap v21516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:34:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40175.903945 secs 2024-04-21T21:34:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:24 smithi191 ceph-mon[31636]: pgmap v21516: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:34:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40175.903945 secs 2024-04-21T21:34:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:26 smithi170 ceph-mon[31212]: pgmap v21517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:34:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:26 smithi077 ceph-mon[27902]: pgmap v21517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:34:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:26 smithi191 ceph-mon[31636]: pgmap v21517: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:34:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40179.150078 secs 2024-04-21T21:34:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40179.150078 secs 2024-04-21T21:34:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40179.150078 secs 2024-04-21T21:34:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:28 smithi077 ceph-mon[27902]: pgmap v21518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:28 smithi191 ceph-mon[31636]: pgmap v21518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:28 smithi170 ceph-mon[31212]: pgmap v21518: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40180.904066 secs 2024-04-21T21:34:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40180.904066 secs 2024-04-21T21:34:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40180.904066 secs 2024-04-21T21:34:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:30 smithi077 ceph-mon[27902]: pgmap v21519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:30 smithi191 ceph-mon[31636]: pgmap v21519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:30 smithi170 ceph-mon[31212]: pgmap v21519: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:32 smithi077 ceph-mon[27902]: pgmap v21520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40184.150149 secs 2024-04-21T21:34:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:32 smithi191 ceph-mon[31636]: pgmap v21520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40184.150149 secs 2024-04-21T21:34:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:32 smithi170 ceph-mon[31212]: pgmap v21520: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40184.150149 secs 2024-04-21T21:34:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:34 smithi077 ceph-mon[27902]: pgmap v21521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40185.904217 secs 2024-04-21T21:34:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:34 smithi191 ceph-mon[31636]: pgmap v21521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40185.904217 secs 2024-04-21T21:34:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:34 smithi170 ceph-mon[31212]: pgmap v21521: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40185.904217 secs 2024-04-21T21:34:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:36 smithi077 ceph-mon[27902]: pgmap v21522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:36 smithi191 ceph-mon[31636]: pgmap v21522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:36 smithi170 ceph-mon[31212]: pgmap v21522: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:38.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40189.150236 secs 2024-04-21T21:34:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40189.150236 secs 2024-04-21T21:34:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40189.150236 secs 2024-04-21T21:34:39.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:38 smithi077 ceph-mon[27902]: pgmap v21523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:38 smithi191 ceph-mon[31636]: pgmap v21523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:38 smithi170 ceph-mon[31212]: pgmap v21523: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40190.904329 secs 2024-04-21T21:34:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40190.904329 secs 2024-04-21T21:34:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40190.904329 secs 2024-04-21T21:34:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:40 smithi077 ceph-mon[27902]: pgmap v21524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:40 smithi191 ceph-mon[31636]: pgmap v21524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:40 smithi170 ceph-mon[31212]: pgmap v21524: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:42 smithi077 ceph-mon[27902]: pgmap v21525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40194.150351 secs 2024-04-21T21:34:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:42 smithi191 ceph-mon[31636]: pgmap v21525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40194.150351 secs 2024-04-21T21:34:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:42 smithi170 ceph-mon[31212]: pgmap v21525: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40194.150351 secs 2024-04-21T21:34:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:44 smithi077 ceph-mon[27902]: pgmap v21526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40195.904449 secs 2024-04-21T21:34:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:44 smithi191 ceph-mon[31636]: pgmap v21526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40195.904449 secs 2024-04-21T21:34:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:44 smithi170 ceph-mon[31212]: pgmap v21526: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40195.904449 secs 2024-04-21T21:34:47.110 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:46 smithi170 ceph-mon[31212]: pgmap v21527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:46 smithi077 ceph-mon[27902]: pgmap v21527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:46 smithi191 ceph-mon[31636]: pgmap v21527: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40199.150476 secs 2024-04-21T21:34:48.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40199.150476 secs 2024-04-21T21:34:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40199.150476 secs 2024-04-21T21:34:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:48 smithi077 ceph-mon[27902]: pgmap v21528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:48 smithi191 ceph-mon[31636]: pgmap v21528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:48 smithi170 ceph-mon[31212]: pgmap v21528: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40200.904569 secs 2024-04-21T21:34:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40200.904569 secs 2024-04-21T21:34:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40200.904569 secs 2024-04-21T21:34:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:50 smithi077 ceph-mon[27902]: pgmap v21529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:50 smithi191 ceph-mon[31636]: pgmap v21529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:50 smithi170 ceph-mon[31212]: pgmap v21529: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:52 smithi077 ceph-mon[27902]: pgmap v21530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40204.150567 secs 2024-04-21T21:34:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:52 smithi191 ceph-mon[31636]: pgmap v21530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40204.150567 secs 2024-04-21T21:34:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:52 smithi170 ceph-mon[31212]: pgmap v21530: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40204.150567 secs 2024-04-21T21:34:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:34:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:54 smithi077 ceph-mon[27902]: pgmap v21531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40205.904674 secs 2024-04-21T21:34:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:54 smithi191 ceph-mon[31636]: pgmap v21531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40205.904674 secs 2024-04-21T21:34:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:54 smithi170 ceph-mon[31212]: pgmap v21531: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40205.904674 secs 2024-04-21T21:34:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:56 smithi077 ceph-mon[27902]: pgmap v21532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:56 smithi191 ceph-mon[31636]: pgmap v21532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:56 smithi170 ceph-mon[31212]: pgmap v21532: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:34:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40209.150699 secs 2024-04-21T21:34:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40209.150699 secs 2024-04-21T21:34:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40209.150699 secs 2024-04-21T21:34:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:58 smithi191 ceph-mon[31636]: pgmap v21533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:58 smithi170 ceph-mon[31212]: pgmap v21533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:58 smithi077 ceph-mon[27902]: pgmap v21533: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:34:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:34:59.914+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:34:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:34:59.914+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:34:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:34:59.914+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:34:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:34:59.914+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:35:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:34:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40210.904793 secs 2024-04-21T21:35:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:34:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40210.904793 secs 2024-04-21T21:35:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:34:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40210.904793 secs 2024-04-21T21:35:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:00 smithi191 ceph-mon[31636]: pgmap v21534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:00 smithi170 ceph-mon[31212]: pgmap v21534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:00 smithi077 ceph-mon[27902]: pgmap v21534: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:02 smithi191 ceph-mon[31636]: pgmap v21535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40214.150794 secs 2024-04-21T21:35:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:02 smithi170 ceph-mon[31212]: pgmap v21535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40214.150794 secs 2024-04-21T21:35:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:02 smithi077 ceph-mon[27902]: pgmap v21535: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40214.150794 secs 2024-04-21T21:35:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:05.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:04 smithi191 ceph-mon[31636]: pgmap v21536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40215.904910 secs 2024-04-21T21:35:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:04 smithi170 ceph-mon[31212]: pgmap v21536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40215.904910 secs 2024-04-21T21:35:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:04 smithi077 ceph-mon[27902]: pgmap v21536: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40215.904910 secs 2024-04-21T21:35:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:05 smithi191 ceph-mon[31636]: osdmap e1418: 12 total, 12 up, 12 in 2024-04-21T21:35:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:05 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:35:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:05 smithi170 ceph-mon[31212]: osdmap e1418: 12 total, 12 up, 12 in 2024-04-21T21:35:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:05 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:35:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:05 smithi077 ceph-mon[27902]: osdmap e1418: 12 total, 12 up, 12 in 2024-04-21T21:35:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:05 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:35:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:06 smithi191 ceph-mon[31636]: pgmap v21538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:35:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:35:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:35:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:06 smithi170 ceph-mon[31212]: pgmap v21538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:35:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:35:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:35:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:06 smithi077 ceph-mon[27902]: pgmap v21538: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:35:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:35:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:35:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40219.150874 secs 2024-04-21T21:35:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40219.150874 secs 2024-04-21T21:35:08.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40219.150874 secs 2024-04-21T21:35:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:08 smithi191 ceph-mon[31636]: pgmap v21539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:08 smithi170 ceph-mon[31212]: pgmap v21539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:08 smithi077 ceph-mon[27902]: pgmap v21539: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:10.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40220.905032 secs 2024-04-21T21:35:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40220.905032 secs 2024-04-21T21:35:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40220.905032 secs 2024-04-21T21:35:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:10 smithi191 ceph-mon[31636]: pgmap v21540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:10 smithi170 ceph-mon[31212]: pgmap v21540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:10 smithi077 ceph-mon[27902]: pgmap v21540: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:35:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:12 smithi191 ceph-mon[31636]: pgmap v21541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:35:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40224.150984 secs 2024-04-21T21:35:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:12 smithi170 ceph-mon[31212]: pgmap v21541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:35:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40224.150984 secs 2024-04-21T21:35:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:12 smithi077 ceph-mon[27902]: pgmap v21541: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:35:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40224.150984 secs 2024-04-21T21:35:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:14 smithi191 ceph-mon[31636]: pgmap v21542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:35:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40225.905156 secs 2024-04-21T21:35:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:14 smithi170 ceph-mon[31212]: pgmap v21542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:35:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40225.905156 secs 2024-04-21T21:35:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:14 smithi077 ceph-mon[27902]: pgmap v21542: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:35:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40225.905156 secs 2024-04-21T21:35:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:16 smithi191 ceph-mon[31636]: osdmap e1419: 12 total, 12 up, 12 in 2024-04-21T21:35:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:16 smithi191 ceph-mon[31636]: pgmap v21544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:16 smithi170 ceph-mon[31212]: osdmap e1419: 12 total, 12 up, 12 in 2024-04-21T21:35:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:16 smithi170 ceph-mon[31212]: pgmap v21544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:16 smithi077 ceph-mon[27902]: osdmap e1419: 12 total, 12 up, 12 in 2024-04-21T21:35:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:16 smithi077 ceph-mon[27902]: pgmap v21544: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40229.151095 secs 2024-04-21T21:35:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40229.151095 secs 2024-04-21T21:35:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40229.151095 secs 2024-04-21T21:35:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:18 smithi170 ceph-mon[31212]: pgmap v21545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:18 smithi191 ceph-mon[31636]: pgmap v21545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:18 smithi077 ceph-mon[27902]: pgmap v21545: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40230.905273 secs 2024-04-21T21:35:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40230.905273 secs 2024-04-21T21:35:19.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40230.905273 secs 2024-04-21T21:35:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:20 smithi170 ceph-mon[31212]: pgmap v21546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:20.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:20 smithi077 ceph-mon[27902]: pgmap v21546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:20 smithi191 ceph-mon[31636]: pgmap v21546: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:35:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:22 smithi077 ceph-mon[27902]: pgmap v21547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:35:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40234.151219 secs 2024-04-21T21:35:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:22 smithi191 ceph-mon[31636]: pgmap v21547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:35:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40234.151219 secs 2024-04-21T21:35:23.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:22 smithi170 ceph-mon[31212]: pgmap v21547: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:35:23.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40234.151219 secs 2024-04-21T21:35:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:24 smithi077 ceph-mon[27902]: pgmap v21548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:35:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40235.905385 secs 2024-04-21T21:35:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:24 smithi191 ceph-mon[31636]: pgmap v21548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:35:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40235.905385 secs 2024-04-21T21:35:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:24 smithi170 ceph-mon[31212]: pgmap v21548: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:35:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40235.905385 secs 2024-04-21T21:35:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:26 smithi191 ceph-mon[31636]: pgmap v21549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:35:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:26 smithi170 ceph-mon[31212]: pgmap v21549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:35:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:26 smithi077 ceph-mon[27902]: pgmap v21549: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:35:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40239.151346 secs 2024-04-21T21:35:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40239.151346 secs 2024-04-21T21:35:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40239.151346 secs 2024-04-21T21:35:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:28 smithi170 ceph-mon[31212]: pgmap v21550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:28 smithi077 ceph-mon[27902]: pgmap v21550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:28 smithi191 ceph-mon[31636]: pgmap v21550: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40240.905522 secs 2024-04-21T21:35:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40240.905522 secs 2024-04-21T21:35:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40240.905522 secs 2024-04-21T21:35:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:30 smithi170 ceph-mon[31212]: pgmap v21551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:30 smithi077 ceph-mon[27902]: pgmap v21551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:30 smithi191 ceph-mon[31636]: pgmap v21551: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:32 smithi077 ceph-mon[27902]: pgmap v21552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40244.151466 secs 2024-04-21T21:35:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:32 smithi191 ceph-mon[31636]: pgmap v21552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40244.151466 secs 2024-04-21T21:35:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:32 smithi170 ceph-mon[31212]: pgmap v21552: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40244.151466 secs 2024-04-21T21:35:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:34 smithi077 ceph-mon[27902]: pgmap v21553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40245.905640 secs 2024-04-21T21:35:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:34 smithi191 ceph-mon[31636]: pgmap v21553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40245.905640 secs 2024-04-21T21:35:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:34 smithi170 ceph-mon[31212]: pgmap v21553: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40245.905640 secs 2024-04-21T21:35:37.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:36 smithi077 ceph-mon[27902]: pgmap v21554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:36 smithi191 ceph-mon[31636]: pgmap v21554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:36 smithi170 ceph-mon[31212]: pgmap v21554: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40249.151614 secs 2024-04-21T21:35:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40249.151614 secs 2024-04-21T21:35:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40249.151614 secs 2024-04-21T21:35:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:38 smithi077 ceph-mon[27902]: pgmap v21555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:38 smithi191 ceph-mon[31636]: pgmap v21555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:38 smithi170 ceph-mon[31212]: pgmap v21555: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40250.905778 secs 2024-04-21T21:35:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40250.905778 secs 2024-04-21T21:35:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40250.905778 secs 2024-04-21T21:35:41.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:40 smithi077 ceph-mon[27902]: pgmap v21556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:41.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:40 smithi191 ceph-mon[31636]: pgmap v21556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:40 smithi170 ceph-mon[31212]: pgmap v21556: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:42 smithi077 ceph-mon[27902]: pgmap v21557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:43.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40254.151729 secs 2024-04-21T21:35:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:42 smithi191 ceph-mon[31636]: pgmap v21557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40254.151729 secs 2024-04-21T21:35:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:42 smithi170 ceph-mon[31212]: pgmap v21557: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40254.151729 secs 2024-04-21T21:35:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:45.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:44 smithi077 ceph-mon[27902]: pgmap v21558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:45.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40255.905876 secs 2024-04-21T21:35:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:44 smithi191 ceph-mon[31636]: pgmap v21558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40255.905876 secs 2024-04-21T21:35:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:44 smithi170 ceph-mon[31212]: pgmap v21558: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40255.905876 secs 2024-04-21T21:35:47.110 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:46 smithi170 ceph-mon[31212]: pgmap v21559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:47.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:46 smithi077 ceph-mon[27902]: pgmap v21559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:46 smithi191 ceph-mon[31636]: pgmap v21559: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40259.151857 secs 2024-04-21T21:35:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40259.151857 secs 2024-04-21T21:35:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40259.151857 secs 2024-04-21T21:35:49.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:48 smithi077 ceph-mon[27902]: pgmap v21560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:48 smithi191 ceph-mon[31636]: pgmap v21560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:48 smithi170 ceph-mon[31212]: pgmap v21560: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40260.905959 secs 2024-04-21T21:35:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40260.905959 secs 2024-04-21T21:35:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40260.905959 secs 2024-04-21T21:35:51.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:50 smithi077 ceph-mon[27902]: pgmap v21561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:50 smithi191 ceph-mon[31636]: pgmap v21561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:51.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:50 smithi170 ceph-mon[31212]: pgmap v21561: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:52 smithi077 ceph-mon[27902]: pgmap v21562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40264.151931 secs 2024-04-21T21:35:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:52 smithi191 ceph-mon[31636]: pgmap v21562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40264.151931 secs 2024-04-21T21:35:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:52 smithi170 ceph-mon[31212]: pgmap v21562: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40264.151931 secs 2024-04-21T21:35:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:35:55.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:54 smithi077 ceph-mon[27902]: pgmap v21563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40265.906072 secs 2024-04-21T21:35:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:54 smithi191 ceph-mon[31636]: pgmap v21563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40265.906072 secs 2024-04-21T21:35:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:54 smithi170 ceph-mon[31212]: pgmap v21563: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40265.906072 secs 2024-04-21T21:35:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:56 smithi077 ceph-mon[27902]: pgmap v21564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:56 smithi191 ceph-mon[31636]: pgmap v21564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:56 smithi170 ceph-mon[31212]: pgmap v21564: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:35:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40269.151998 secs 2024-04-21T21:35:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40269.151998 secs 2024-04-21T21:35:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40269.151998 secs 2024-04-21T21:35:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:58 smithi077 ceph-mon[27902]: pgmap v21565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:58 smithi191 ceph-mon[31636]: pgmap v21565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:35:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:58 smithi170 ceph-mon[31212]: pgmap v21565: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:35:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40270.906147 secs 2024-04-21T21:36:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:35:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40270.906147 secs 2024-04-21T21:36:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:35:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40270.906147 secs 2024-04-21T21:36:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:00 smithi191 ceph-mon[31636]: pgmap v21566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:00 smithi170 ceph-mon[31212]: pgmap v21566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:00 smithi077 ceph-mon[27902]: pgmap v21566: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:02 smithi191 ceph-mon[31636]: pgmap v21567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40274.152116 secs 2024-04-21T21:36:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:02 smithi170 ceph-mon[31212]: pgmap v21567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40274.152116 secs 2024-04-21T21:36:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:02 smithi077 ceph-mon[27902]: pgmap v21567: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40274.152116 secs 2024-04-21T21:36:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:04 smithi191 ceph-mon[31636]: pgmap v21568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:36:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40275.906231 secs 2024-04-21T21:36:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:04 smithi170 ceph-mon[31212]: pgmap v21568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:36:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40275.906231 secs 2024-04-21T21:36:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:04 smithi077 ceph-mon[27902]: pgmap v21568: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:36:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40275.906231 secs 2024-04-21T21:36:06.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:05 smithi191 ceph-mon[31636]: osdmap e1420: 12 total, 12 up, 12 in 2024-04-21T21:36:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:05 smithi170 ceph-mon[31212]: osdmap e1420: 12 total, 12 up, 12 in 2024-04-21T21:36:06.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:05 smithi077 ceph-mon[27902]: osdmap e1420: 12 total, 12 up, 12 in 2024-04-21T21:36:07.127 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:06 smithi170 ceph-mon[31212]: pgmap v21570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:07.127 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:06 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:36:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:06 smithi077 ceph-mon[27902]: pgmap v21570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:06 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:36:07.204 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:06 smithi191 ceph-mon[31636]: pgmap v21570: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:07.205 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:06 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40279.152224 secs 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:07 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40279.152224 secs 2024-04-21T21:36:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:07 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40279.152224 secs 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:07 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: pgmap v21571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:08 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: pgmap v21571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:08 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: pgmap v21571: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:08 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40280.906302 secs 2024-04-21T21:36:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40280.906302 secs 2024-04-21T21:36:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:36:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:36:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:36:10.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:36:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:36:10.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40280.906302 secs 2024-04-21T21:36:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:10 smithi191 ceph-mon[31636]: pgmap v21572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:10 smithi170 ceph-mon[31212]: pgmap v21572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:10 smithi077 ceph-mon[27902]: pgmap v21572: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:13.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:12 smithi191 ceph-mon[31636]: pgmap v21573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40284.152354 secs 2024-04-21T21:36:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:12 smithi170 ceph-mon[31212]: pgmap v21573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40284.152354 secs 2024-04-21T21:36:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:12 smithi077 ceph-mon[27902]: pgmap v21573: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40284.152354 secs 2024-04-21T21:36:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:14 smithi191 ceph-mon[31636]: pgmap v21574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40285.906422 secs 2024-04-21T21:36:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:14 smithi170 ceph-mon[31212]: pgmap v21574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40285.906422 secs 2024-04-21T21:36:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:14 smithi077 ceph-mon[27902]: pgmap v21574: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:36:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40285.906422 secs 2024-04-21T21:36:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:16 smithi191 ceph-mon[31636]: osdmap e1421: 12 total, 12 up, 12 in 2024-04-21T21:36:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:16 smithi191 ceph-mon[31636]: pgmap v21576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:16 smithi170 ceph-mon[31212]: osdmap e1421: 12 total, 12 up, 12 in 2024-04-21T21:36:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:16 smithi170 ceph-mon[31212]: pgmap v21576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:16 smithi077 ceph-mon[27902]: osdmap e1421: 12 total, 12 up, 12 in 2024-04-21T21:36:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:16 smithi077 ceph-mon[27902]: pgmap v21576: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40289.152496 secs 2024-04-21T21:36:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40289.152496 secs 2024-04-21T21:36:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40289.152496 secs 2024-04-21T21:36:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:18 smithi170 ceph-mon[31212]: pgmap v21577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:18 smithi191 ceph-mon[31636]: pgmap v21577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:18 smithi077 ceph-mon[27902]: pgmap v21577: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40290.906538 secs 2024-04-21T21:36:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40290.906538 secs 2024-04-21T21:36:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40290.906538 secs 2024-04-21T21:36:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:20 smithi170 ceph-mon[31212]: pgmap v21578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:20 smithi077 ceph-mon[27902]: pgmap v21578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:20 smithi191 ceph-mon[31636]: pgmap v21578: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:36:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:22 smithi077 ceph-mon[27902]: pgmap v21579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:36:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40294.152596 secs 2024-04-21T21:36:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:22 smithi191 ceph-mon[31636]: pgmap v21579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:36:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40294.152596 secs 2024-04-21T21:36:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:22 smithi170 ceph-mon[31212]: pgmap v21579: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:36:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40294.152596 secs 2024-04-21T21:36:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:24 smithi077 ceph-mon[27902]: pgmap v21580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:36:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40295.906673 secs 2024-04-21T21:36:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:24 smithi191 ceph-mon[31636]: pgmap v21580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:36:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40295.906673 secs 2024-04-21T21:36:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:24 smithi170 ceph-mon[31212]: pgmap v21580: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:36:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40295.906673 secs 2024-04-21T21:36:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:26 smithi077 ceph-mon[27902]: pgmap v21581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:36:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:26 smithi191 ceph-mon[31636]: pgmap v21581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:36:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:26 smithi170 ceph-mon[31212]: pgmap v21581: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:36:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40299.152701 secs 2024-04-21T21:36:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40299.152701 secs 2024-04-21T21:36:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40299.152701 secs 2024-04-21T21:36:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:28 smithi077 ceph-mon[27902]: pgmap v21582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:28 smithi191 ceph-mon[31636]: pgmap v21582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:28 smithi170 ceph-mon[31212]: pgmap v21582: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40300.906800 secs 2024-04-21T21:36:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40300.906800 secs 2024-04-21T21:36:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40300.906800 secs 2024-04-21T21:36:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:30 smithi077 ceph-mon[27902]: pgmap v21583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:30 smithi191 ceph-mon[31636]: pgmap v21583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:30 smithi170 ceph-mon[31212]: pgmap v21583: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:32 smithi077 ceph-mon[27902]: pgmap v21584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40304.152831 secs 2024-04-21T21:36:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:32 smithi191 ceph-mon[31636]: pgmap v21584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40304.152831 secs 2024-04-21T21:36:33.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:32 smithi170 ceph-mon[31212]: pgmap v21584: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:33.310 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40304.152831 secs 2024-04-21T21:36:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:34 smithi077 ceph-mon[27902]: pgmap v21585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40305.906928 secs 2024-04-21T21:36:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:34 smithi191 ceph-mon[31636]: pgmap v21585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40305.906928 secs 2024-04-21T21:36:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:34 smithi170 ceph-mon[31212]: pgmap v21585: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40305.906928 secs 2024-04-21T21:36:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:36 smithi077 ceph-mon[27902]: pgmap v21586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:36 smithi191 ceph-mon[31636]: pgmap v21586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:36 smithi170 ceph-mon[31212]: pgmap v21586: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40309.152942 secs 2024-04-21T21:36:38.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40309.152942 secs 2024-04-21T21:36:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40309.152942 secs 2024-04-21T21:36:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:38 smithi077 ceph-mon[27902]: pgmap v21587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:39.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:38 smithi191 ceph-mon[31636]: pgmap v21587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:38 smithi170 ceph-mon[31212]: pgmap v21587: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:40.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40310.907082 secs 2024-04-21T21:36:40.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40310.907082 secs 2024-04-21T21:36:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40310.907082 secs 2024-04-21T21:36:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:40 smithi191 ceph-mon[31636]: pgmap v21588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:40 smithi170 ceph-mon[31212]: pgmap v21588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:40 smithi077 ceph-mon[27902]: pgmap v21588: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:42 smithi191 ceph-mon[31636]: pgmap v21589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40314.153009 secs 2024-04-21T21:36:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:42 smithi170 ceph-mon[31212]: pgmap v21589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40314.153009 secs 2024-04-21T21:36:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:42 smithi077 ceph-mon[27902]: pgmap v21589: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40314.153009 secs 2024-04-21T21:36:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:44 smithi191 ceph-mon[31636]: pgmap v21590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40315.907208 secs 2024-04-21T21:36:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:44 smithi170 ceph-mon[31212]: pgmap v21590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40315.907208 secs 2024-04-21T21:36:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:44 smithi077 ceph-mon[27902]: pgmap v21590: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40315.907208 secs 2024-04-21T21:36:46.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:46 smithi191 ceph-mon[31636]: pgmap v21591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:46.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:46 smithi170 ceph-mon[31212]: pgmap v21591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:46.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:46 smithi077 ceph-mon[27902]: pgmap v21591: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40319.153115 secs 2024-04-21T21:36:47.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40319.153115 secs 2024-04-21T21:36:47.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40319.153115 secs 2024-04-21T21:36:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:48 smithi170 ceph-mon[31212]: pgmap v21592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:48.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:48 smithi191 ceph-mon[31636]: pgmap v21592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:48.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:48 smithi077 ceph-mon[27902]: pgmap v21592: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40320.907345 secs 2024-04-21T21:36:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40320.907345 secs 2024-04-21T21:36:49.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40320.907345 secs 2024-04-21T21:36:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:50 smithi170 ceph-mon[31212]: pgmap v21593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:50.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:50 smithi077 ceph-mon[27902]: pgmap v21593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:50.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:50 smithi191 ceph-mon[31636]: pgmap v21593: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:52 smithi077 ceph-mon[27902]: pgmap v21594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:53.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40324.153237 secs 2024-04-21T21:36:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:52 smithi191 ceph-mon[31636]: pgmap v21594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40324.153237 secs 2024-04-21T21:36:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:52 smithi170 ceph-mon[31212]: pgmap v21594: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40324.153237 secs 2024-04-21T21:36:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:36:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:54 smithi077 ceph-mon[27902]: pgmap v21595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:55.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40325.907470 secs 2024-04-21T21:36:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:54 smithi191 ceph-mon[31636]: pgmap v21595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40325.907470 secs 2024-04-21T21:36:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:54 smithi170 ceph-mon[31212]: pgmap v21595: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40325.907470 secs 2024-04-21T21:36:57.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:56 smithi077 ceph-mon[27902]: pgmap v21596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:56 smithi191 ceph-mon[31636]: pgmap v21596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:56 smithi170 ceph-mon[31212]: pgmap v21596: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:36:58.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40329.153359 secs 2024-04-21T21:36:58.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40329.153359 secs 2024-04-21T21:36:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40329.153359 secs 2024-04-21T21:36:59.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:58 smithi077 ceph-mon[27902]: pgmap v21597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:59.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:58 smithi191 ceph-mon[31636]: pgmap v21597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:36:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:58 smithi170 ceph-mon[31212]: pgmap v21597: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:00.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:36:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40330.907594 secs 2024-04-21T21:37:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:36:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40330.907594 secs 2024-04-21T21:37:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:36:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40330.907594 secs 2024-04-21T21:37:01.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:00 smithi077 ceph-mon[27902]: pgmap v21598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:00 smithi191 ceph-mon[31636]: pgmap v21598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:00 smithi170 ceph-mon[31212]: pgmap v21598: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:02 smithi077 ceph-mon[27902]: pgmap v21599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:03.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40334.153476 secs 2024-04-21T21:37:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:02 smithi191 ceph-mon[31636]: pgmap v21599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40334.153476 secs 2024-04-21T21:37:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:02 smithi170 ceph-mon[31212]: pgmap v21599: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40334.153476 secs 2024-04-21T21:37:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:05.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:04 smithi077 ceph-mon[27902]: pgmap v21600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:05.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40335.907690 secs 2024-04-21T21:37:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:04 smithi191 ceph-mon[31636]: pgmap v21600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40335.907690 secs 2024-04-21T21:37:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:04 smithi170 ceph-mon[31212]: pgmap v21600: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40335.907690 secs 2024-04-21T21:37:06.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:05 smithi077 ceph-mon[27902]: osdmap e1422: 12 total, 12 up, 12 in 2024-04-21T21:37:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:05 smithi191 ceph-mon[31636]: osdmap e1422: 12 total, 12 up, 12 in 2024-04-21T21:37:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:05 smithi170 ceph-mon[31212]: osdmap e1422: 12 total, 12 up, 12 in 2024-04-21T21:37:07.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:06 smithi077 ceph-mon[27902]: pgmap v21602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:06 smithi191 ceph-mon[31636]: pgmap v21602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:06 smithi170 ceph-mon[31212]: pgmap v21602: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:08.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40339.153612 secs 2024-04-21T21:37:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40339.153612 secs 2024-04-21T21:37:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40339.153612 secs 2024-04-21T21:37:09.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:08 smithi077 ceph-mon[27902]: pgmap v21603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:08 smithi191 ceph-mon[31636]: pgmap v21603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:08 smithi170 ceph-mon[31212]: pgmap v21603: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40340.907758 secs 2024-04-21T21:37:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:37:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:10.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:09 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40340.907758 secs 2024-04-21T21:37:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:37:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:09 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40340.907758 secs 2024-04-21T21:37:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:37:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:09 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:10 smithi191 ceph-mon[31636]: pgmap v21604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:37:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:37:11.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:10 smithi170 ceph-mon[31212]: pgmap v21604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:37:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:37:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:10 smithi077 ceph-mon[27902]: pgmap v21604: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:37:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:37:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:37:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:37:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:12 smithi191 ceph-mon[31636]: pgmap v21605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:37:13.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40344.153756 secs 2024-04-21T21:37:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:12 smithi170 ceph-mon[31212]: pgmap v21605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:37:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40344.153756 secs 2024-04-21T21:37:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:12 smithi077 ceph-mon[27902]: pgmap v21605: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:37:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40344.153756 secs 2024-04-21T21:37:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:14.933+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:37:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:14.933+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:37:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:14.934+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:37:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:14.934+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:37:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:14 smithi191 ceph-mon[31636]: pgmap v21606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:37:15.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40345.907881 secs 2024-04-21T21:37:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:14 smithi170 ceph-mon[31212]: pgmap v21606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:37:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40345.907881 secs 2024-04-21T21:37:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:14 smithi077 ceph-mon[27902]: pgmap v21606: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:37:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40345.907881 secs 2024-04-21T21:37:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:16 smithi191 ceph-mon[31636]: osdmap e1423: 12 total, 12 up, 12 in 2024-04-21T21:37:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:16 smithi191 ceph-mon[31636]: pgmap v21608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:16 smithi170 ceph-mon[31212]: osdmap e1423: 12 total, 12 up, 12 in 2024-04-21T21:37:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:16 smithi170 ceph-mon[31212]: pgmap v21608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:16 smithi077 ceph-mon[27902]: osdmap e1423: 12 total, 12 up, 12 in 2024-04-21T21:37:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:16 smithi077 ceph-mon[27902]: pgmap v21608: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40349.153906 secs 2024-04-21T21:37:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40349.153906 secs 2024-04-21T21:37:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40349.153906 secs 2024-04-21T21:37:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:18 smithi170 ceph-mon[31212]: pgmap v21609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:18 smithi191 ceph-mon[31636]: pgmap v21609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:18.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:18 smithi077 ceph-mon[27902]: pgmap v21609: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:19.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40350.907998 secs 2024-04-21T21:37:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40350.907998 secs 2024-04-21T21:37:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40350.907998 secs 2024-04-21T21:37:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:20 smithi170 ceph-mon[31212]: pgmap v21610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:20 smithi077 ceph-mon[27902]: pgmap v21610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:20 smithi191 ceph-mon[31636]: pgmap v21610: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:37:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:22 smithi077 ceph-mon[27902]: pgmap v21611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:37:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40354.154026 secs 2024-04-21T21:37:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:22 smithi191 ceph-mon[31636]: pgmap v21611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:37:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40354.154026 secs 2024-04-21T21:37:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:22 smithi170 ceph-mon[31212]: pgmap v21611: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:37:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40354.154026 secs 2024-04-21T21:37:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:24 smithi077 ceph-mon[27902]: pgmap v21612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:37:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40355.908111 secs 2024-04-21T21:37:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:24 smithi191 ceph-mon[31636]: pgmap v21612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:37:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40355.908111 secs 2024-04-21T21:37:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:24 smithi170 ceph-mon[31212]: pgmap v21612: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:37:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40355.908111 secs 2024-04-21T21:37:27.137 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:26 smithi077 ceph-mon[27902]: pgmap v21613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:37:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:26 smithi191 ceph-mon[31636]: pgmap v21613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:37:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:26 smithi170 ceph-mon[31212]: pgmap v21613: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:37:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40359.154119 secs 2024-04-21T21:37:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40359.154119 secs 2024-04-21T21:37:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40359.154119 secs 2024-04-21T21:37:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:28 smithi077 ceph-mon[27902]: pgmap v21614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:28 smithi191 ceph-mon[31636]: pgmap v21614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:28 smithi170 ceph-mon[31212]: pgmap v21614: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40360.908232 secs 2024-04-21T21:37:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40360.908232 secs 2024-04-21T21:37:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40360.908232 secs 2024-04-21T21:37:31.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:30 smithi077 ceph-mon[27902]: pgmap v21615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:30 smithi191 ceph-mon[31636]: pgmap v21615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:30 smithi170 ceph-mon[31212]: pgmap v21615: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:32 smithi077 ceph-mon[27902]: pgmap v21616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40364.154239 secs 2024-04-21T21:37:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:32 smithi191 ceph-mon[31636]: pgmap v21616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40364.154239 secs 2024-04-21T21:37:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:32 smithi170 ceph-mon[31212]: pgmap v21616: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40364.154239 secs 2024-04-21T21:37:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:35.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:34 smithi077 ceph-mon[27902]: pgmap v21617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:35.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40365.908365 secs 2024-04-21T21:37:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:34 smithi191 ceph-mon[31636]: pgmap v21617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40365.908365 secs 2024-04-21T21:37:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:34 smithi170 ceph-mon[31212]: pgmap v21617: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40365.908365 secs 2024-04-21T21:37:37.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:36 smithi077 ceph-mon[27902]: pgmap v21618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:36 smithi191 ceph-mon[31636]: pgmap v21618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:36 smithi170 ceph-mon[31212]: pgmap v21618: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:38.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40369.154386 secs 2024-04-21T21:37:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40369.154386 secs 2024-04-21T21:37:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40369.154386 secs 2024-04-21T21:37:39.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:38 smithi077 ceph-mon[27902]: pgmap v21619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:38 smithi191 ceph-mon[31636]: pgmap v21619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:38 smithi170 ceph-mon[31212]: pgmap v21619: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40370.908501 secs 2024-04-21T21:37:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40370.908501 secs 2024-04-21T21:37:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40370.908501 secs 2024-04-21T21:37:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:40 smithi191 ceph-mon[31636]: pgmap v21620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:40 smithi170 ceph-mon[31212]: pgmap v21620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:40 smithi077 ceph-mon[27902]: pgmap v21620: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:42 smithi191 ceph-mon[31636]: pgmap v21621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40374.154511 secs 2024-04-21T21:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:42 smithi170 ceph-mon[31212]: pgmap v21621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40374.154511 secs 2024-04-21T21:37:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:42 smithi077 ceph-mon[27902]: pgmap v21621: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40374.154511 secs 2024-04-21T21:37:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:44 smithi191 ceph-mon[31636]: pgmap v21622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40375.908655 secs 2024-04-21T21:37:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:44 smithi170 ceph-mon[31212]: pgmap v21622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40375.908655 secs 2024-04-21T21:37:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:44 smithi077 ceph-mon[27902]: pgmap v21622: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40375.908655 secs 2024-04-21T21:37:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:46 smithi191 ceph-mon[31636]: pgmap v21623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:46 smithi170 ceph-mon[31212]: pgmap v21623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:46 smithi077 ceph-mon[27902]: pgmap v21623: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40379.154638 secs 2024-04-21T21:37:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40379.154638 secs 2024-04-21T21:37:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40379.154638 secs 2024-04-21T21:37:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:48 smithi191 ceph-mon[31636]: pgmap v21624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:48 smithi170 ceph-mon[31212]: pgmap v21624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:48 smithi077 ceph-mon[27902]: pgmap v21624: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40380.908775 secs 2024-04-21T21:37:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40380.908775 secs 2024-04-21T21:37:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40380.908775 secs 2024-04-21T21:37:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:50 smithi191 ceph-mon[31636]: pgmap v21625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:50 smithi170 ceph-mon[31212]: pgmap v21625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:50 smithi077 ceph-mon[27902]: pgmap v21625: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:52 smithi191 ceph-mon[31636]: pgmap v21626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40384.154786 secs 2024-04-21T21:37:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:52 smithi170 ceph-mon[31212]: pgmap v21626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40384.154786 secs 2024-04-21T21:37:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:52 smithi077 ceph-mon[27902]: pgmap v21626: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40384.154786 secs 2024-04-21T21:37:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:37:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:54 smithi191 ceph-mon[31636]: pgmap v21627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40385.908886 secs 2024-04-21T21:37:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:54 smithi170 ceph-mon[31212]: pgmap v21627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40385.908886 secs 2024-04-21T21:37:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:54 smithi077 ceph-mon[27902]: pgmap v21627: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40385.908886 secs 2024-04-21T21:37:57.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:56 smithi191 ceph-mon[31636]: pgmap v21628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:56 smithi170 ceph-mon[31212]: pgmap v21628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:56 smithi077 ceph-mon[27902]: pgmap v21628: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:37:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40389.154917 secs 2024-04-21T21:37:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40389.154917 secs 2024-04-21T21:37:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40389.154917 secs 2024-04-21T21:37:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:58 smithi191 ceph-mon[31636]: pgmap v21629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:58 smithi170 ceph-mon[31212]: pgmap v21629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:58 smithi077 ceph-mon[27902]: pgmap v21629: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:37:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:59.939+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:37:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:59.939+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:37:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:59.941+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:37:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:37:59.942+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:38:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:00.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:37:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40390.908917 secs 2024-04-21T21:38:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:37:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40390.908917 secs 2024-04-21T21:38:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:37:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40390.908917 secs 2024-04-21T21:38:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:00 smithi191 ceph-mon[31636]: pgmap v21630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:00 smithi170 ceph-mon[31212]: pgmap v21630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:00 smithi077 ceph-mon[27902]: pgmap v21630: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:03.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:02 smithi191 ceph-mon[31636]: pgmap v21631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:03.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40394.155005 secs 2024-04-21T21:38:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:02 smithi170 ceph-mon[31212]: pgmap v21631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40394.155005 secs 2024-04-21T21:38:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:02 smithi077 ceph-mon[27902]: pgmap v21631: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40394.155005 secs 2024-04-21T21:38:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:04 smithi191 ceph-mon[31636]: pgmap v21632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40395.909011 secs 2024-04-21T21:38:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:04 smithi170 ceph-mon[31212]: pgmap v21632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40395.909011 secs 2024-04-21T21:38:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:04 smithi077 ceph-mon[27902]: pgmap v21632: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40395.909011 secs 2024-04-21T21:38:06.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:05 smithi191 ceph-mon[31636]: osdmap e1424: 12 total, 12 up, 12 in 2024-04-21T21:38:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:05 smithi170 ceph-mon[31212]: osdmap e1424: 12 total, 12 up, 12 in 2024-04-21T21:38:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:05 smithi077 ceph-mon[27902]: osdmap e1424: 12 total, 12 up, 12 in 2024-04-21T21:38:07.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:06 smithi191 ceph-mon[31636]: pgmap v21634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:06 smithi170 ceph-mon[31212]: pgmap v21634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:06 smithi077 ceph-mon[27902]: pgmap v21634: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:08.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40399.155112 secs 2024-04-21T21:38:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40399.155112 secs 2024-04-21T21:38:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40399.155112 secs 2024-04-21T21:38:09.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:08 smithi191 ceph-mon[31636]: pgmap v21635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:08 smithi170 ceph-mon[31212]: pgmap v21635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:08 smithi077 ceph-mon[27902]: pgmap v21635: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40400.909108 secs 2024-04-21T21:38:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40400.909108 secs 2024-04-21T21:38:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40400.909108 secs 2024-04-21T21:38:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:10 smithi170 ceph-mon[31212]: pgmap v21636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:38:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:10 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:10 smithi077 ceph-mon[27902]: pgmap v21636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:38:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:10 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:10 smithi191 ceph-mon[31636]: pgmap v21636: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:38:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:38:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:10 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:12.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:38:12.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:38:12.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:12.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:38:12.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:38:12.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:12.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:38:12.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:38:12.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:38:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:12 smithi170 ceph-mon[31212]: pgmap v21637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:38:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40404.155225 secs 2024-04-21T21:38:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:12 smithi077 ceph-mon[27902]: pgmap v21637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:38:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40404.155225 secs 2024-04-21T21:38:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:12 smithi191 ceph-mon[31636]: pgmap v21637: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:38:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40404.155225 secs 2024-04-21T21:38:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:14 smithi170 ceph-mon[31212]: pgmap v21638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:38:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40405.909219 secs 2024-04-21T21:38:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:14 smithi077 ceph-mon[27902]: pgmap v21638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:38:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40405.909219 secs 2024-04-21T21:38:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:14 smithi191 ceph-mon[31636]: pgmap v21638: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:38:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40405.909219 secs 2024-04-21T21:38:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:16 smithi191 ceph-mon[31636]: osdmap e1425: 12 total, 12 up, 12 in 2024-04-21T21:38:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:16 smithi191 ceph-mon[31636]: pgmap v21640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:16 smithi170 ceph-mon[31212]: osdmap e1425: 12 total, 12 up, 12 in 2024-04-21T21:38:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:16 smithi170 ceph-mon[31212]: pgmap v21640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:16 smithi077 ceph-mon[27902]: osdmap e1425: 12 total, 12 up, 12 in 2024-04-21T21:38:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:16 smithi077 ceph-mon[27902]: pgmap v21640: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40409.155322 secs 2024-04-21T21:38:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40409.155322 secs 2024-04-21T21:38:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40409.155322 secs 2024-04-21T21:38:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:18 smithi170 ceph-mon[31212]: pgmap v21641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:18 smithi191 ceph-mon[31636]: pgmap v21641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:18 smithi077 ceph-mon[27902]: pgmap v21641: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40410.909350 secs 2024-04-21T21:38:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40410.909350 secs 2024-04-21T21:38:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40410.909350 secs 2024-04-21T21:38:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:20 smithi170 ceph-mon[31212]: pgmap v21642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:20 smithi077 ceph-mon[27902]: pgmap v21642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:20 smithi191 ceph-mon[31636]: pgmap v21642: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:38:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:22 smithi077 ceph-mon[27902]: pgmap v21643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:38:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40414.155415 secs 2024-04-21T21:38:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:22 smithi191 ceph-mon[31636]: pgmap v21643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:38:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40414.155415 secs 2024-04-21T21:38:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:22 smithi170 ceph-mon[31212]: pgmap v21643: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:38:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40414.155415 secs 2024-04-21T21:38:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:25.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:24 smithi077 ceph-mon[27902]: pgmap v21644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:38:25.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40415.909462 secs 2024-04-21T21:38:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:24 smithi191 ceph-mon[31636]: pgmap v21644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:38:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40415.909462 secs 2024-04-21T21:38:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:24 smithi170 ceph-mon[31212]: pgmap v21644: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:38:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40415.909462 secs 2024-04-21T21:38:27.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:26 smithi077 ceph-mon[27902]: pgmap v21645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:38:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:26 smithi191 ceph-mon[31636]: pgmap v21645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:38:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:26 smithi170 ceph-mon[31212]: pgmap v21645: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:38:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40419.155502 secs 2024-04-21T21:38:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40419.155502 secs 2024-04-21T21:38:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40419.155502 secs 2024-04-21T21:38:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:28 smithi077 ceph-mon[27902]: pgmap v21646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:28 smithi191 ceph-mon[31636]: pgmap v21646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:28 smithi170 ceph-mon[31212]: pgmap v21646: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40420.909584 secs 2024-04-21T21:38:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40420.909584 secs 2024-04-21T21:38:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40420.909584 secs 2024-04-21T21:38:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:30 smithi191 ceph-mon[31636]: pgmap v21647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:30 smithi170 ceph-mon[31212]: pgmap v21647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:30 smithi077 ceph-mon[27902]: pgmap v21647: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:32 smithi191 ceph-mon[31636]: pgmap v21648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40424.155600 secs 2024-04-21T21:38:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:32 smithi170 ceph-mon[31212]: pgmap v21648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40424.155600 secs 2024-04-21T21:38:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:32 smithi077 ceph-mon[27902]: pgmap v21648: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40424.155600 secs 2024-04-21T21:38:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:34 smithi191 ceph-mon[31636]: pgmap v21649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40425.909720 secs 2024-04-21T21:38:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:34 smithi170 ceph-mon[31212]: pgmap v21649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40425.909720 secs 2024-04-21T21:38:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:34 smithi077 ceph-mon[27902]: pgmap v21649: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40425.909720 secs 2024-04-21T21:38:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:36 smithi191 ceph-mon[31636]: pgmap v21650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:36 smithi170 ceph-mon[31212]: pgmap v21650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:36 smithi077 ceph-mon[27902]: pgmap v21650: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40429.155720 secs 2024-04-21T21:38:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40429.155720 secs 2024-04-21T21:38:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40429.155720 secs 2024-04-21T21:38:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:38 smithi191 ceph-mon[31636]: pgmap v21651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:38 smithi170 ceph-mon[31212]: pgmap v21651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:38 smithi077 ceph-mon[27902]: pgmap v21651: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40430.909834 secs 2024-04-21T21:38:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40430.909834 secs 2024-04-21T21:38:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40430.909834 secs 2024-04-21T21:38:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:40 smithi191 ceph-mon[31636]: pgmap v21652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:40 smithi170 ceph-mon[31212]: pgmap v21652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:40 smithi077 ceph-mon[27902]: pgmap v21652: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:42 smithi191 ceph-mon[31636]: pgmap v21653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40434.155812 secs 2024-04-21T21:38:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:42 smithi170 ceph-mon[31212]: pgmap v21653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40434.155812 secs 2024-04-21T21:38:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:42 smithi077 ceph-mon[27902]: pgmap v21653: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40434.155812 secs 2024-04-21T21:38:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:44 smithi191 ceph-mon[31636]: pgmap v21654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40435.909953 secs 2024-04-21T21:38:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:44 smithi170 ceph-mon[31212]: pgmap v21654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40435.909953 secs 2024-04-21T21:38:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:44 smithi077 ceph-mon[27902]: pgmap v21654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40435.909953 secs 2024-04-21T21:38:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:46 smithi191 ceph-mon[31636]: pgmap v21655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:46 smithi170 ceph-mon[31212]: pgmap v21655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:46 smithi077 ceph-mon[27902]: pgmap v21655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40439.155890 secs 2024-04-21T21:38:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40439.155890 secs 2024-04-21T21:38:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40439.155890 secs 2024-04-21T21:38:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:48 smithi191 ceph-mon[31636]: pgmap v21656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:48 smithi170 ceph-mon[31212]: pgmap v21656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:48 smithi077 ceph-mon[27902]: pgmap v21656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40440.910071 secs 2024-04-21T21:38:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40440.910071 secs 2024-04-21T21:38:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40440.910071 secs 2024-04-21T21:38:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:50 smithi191 ceph-mon[31636]: pgmap v21657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:50 smithi170 ceph-mon[31212]: pgmap v21657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:50 smithi077 ceph-mon[27902]: pgmap v21657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:52 smithi191 ceph-mon[31636]: pgmap v21658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40444.156010 secs 2024-04-21T21:38:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:52 smithi170 ceph-mon[31212]: pgmap v21658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40444.156010 secs 2024-04-21T21:38:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:52 smithi077 ceph-mon[27902]: pgmap v21658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40444.156010 secs 2024-04-21T21:38:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:38:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:54 smithi191 ceph-mon[31636]: pgmap v21659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40445.910188 secs 2024-04-21T21:38:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:54 smithi170 ceph-mon[31212]: pgmap v21659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40445.910188 secs 2024-04-21T21:38:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:54 smithi077 ceph-mon[27902]: pgmap v21659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40445.910188 secs 2024-04-21T21:38:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:56 smithi191 ceph-mon[31636]: pgmap v21660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:56 smithi170 ceph-mon[31212]: pgmap v21660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:56 smithi077 ceph-mon[27902]: pgmap v21660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:38:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40449.156144 secs 2024-04-21T21:38:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40449.156144 secs 2024-04-21T21:38:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40449.156144 secs 2024-04-21T21:38:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:58 smithi191 ceph-mon[31636]: pgmap v21661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:58 smithi170 ceph-mon[31212]: pgmap v21661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:38:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:58 smithi077 ceph-mon[27902]: pgmap v21661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:38:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40450.910305 secs 2024-04-21T21:39:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:38:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40450.910305 secs 2024-04-21T21:39:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:38:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40450.910305 secs 2024-04-21T21:39:01.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:00 smithi191 ceph-mon[31636]: pgmap v21662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:00 smithi170 ceph-mon[31212]: pgmap v21662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:00 smithi077 ceph-mon[27902]: pgmap v21662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:02 smithi191 ceph-mon[31636]: pgmap v21663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:39:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40454.156260 secs 2024-04-21T21:39:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:02 smithi170 ceph-mon[31212]: pgmap v21663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:39:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40454.156260 secs 2024-04-21T21:39:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:02 smithi077 ceph-mon[27902]: pgmap v21663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:39:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40454.156260 secs 2024-04-21T21:39:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:04 smithi191 ceph-mon[31636]: pgmap v21664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T21:39:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40455.910400 secs 2024-04-21T21:39:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:04 smithi170 ceph-mon[31212]: pgmap v21664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T21:39:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40455.910400 secs 2024-04-21T21:39:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:04 smithi077 ceph-mon[27902]: pgmap v21664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-04-21T21:39:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40455.910400 secs 2024-04-21T21:39:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:05 smithi170 ceph-mon[31212]: osdmap e1426: 12 total, 12 up, 12 in 2024-04-21T21:39:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:05 smithi077 ceph-mon[27902]: osdmap e1426: 12 total, 12 up, 12 in 2024-04-21T21:39:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:05 smithi191 ceph-mon[31636]: osdmap e1426: 12 total, 12 up, 12 in 2024-04-21T21:39:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:06 smithi170 ceph-mon[31212]: pgmap v21666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:06 smithi077 ceph-mon[27902]: pgmap v21666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:06 smithi191 ceph-mon[31636]: pgmap v21666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40459.156385 secs 2024-04-21T21:39:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40459.156385 secs 2024-04-21T21:39:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40459.156385 secs 2024-04-21T21:39:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:08 smithi170 ceph-mon[31212]: pgmap v21667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:08 smithi077 ceph-mon[27902]: pgmap v21667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:08 smithi191 ceph-mon[31636]: pgmap v21667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40460.910482 secs 2024-04-21T21:39:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40460.910482 secs 2024-04-21T21:39:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40460.910482 secs 2024-04-21T21:39:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:10 smithi170 ceph-mon[31212]: pgmap v21668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:10 smithi077 ceph-mon[27902]: pgmap v21668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:10 smithi191 ceph-mon[31636]: pgmap v21668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:39:12.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:11 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:39:12.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:11 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:39:12.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:11 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:39:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:13 smithi170 ceph-mon[31212]: pgmap v21669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T21:39:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40464.156501 secs 2024-04-21T21:39:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:39:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:39:13.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:39:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:13 smithi077 ceph-mon[27902]: pgmap v21669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T21:39:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40464.156501 secs 2024-04-21T21:39:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:39:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:39:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:39:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:13 smithi191 ceph-mon[31636]: pgmap v21669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T21:39:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40464.156501 secs 2024-04-21T21:39:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:39:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:39:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:39:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:15 smithi170 ceph-mon[31212]: pgmap v21670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T21:39:15.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40465.910595 secs 2024-04-21T21:39:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:15 smithi077 ceph-mon[27902]: pgmap v21670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T21:39:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40465.910595 secs 2024-04-21T21:39:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:15 smithi191 ceph-mon[31636]: pgmap v21670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T21:39:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40465.910595 secs 2024-04-21T21:39:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:16 smithi191 ceph-mon[31636]: osdmap e1427: 12 total, 12 up, 12 in 2024-04-21T21:39:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:16 smithi191 ceph-mon[31636]: pgmap v21672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:16 smithi170 ceph-mon[31212]: osdmap e1427: 12 total, 12 up, 12 in 2024-04-21T21:39:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:16 smithi170 ceph-mon[31212]: pgmap v21672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:16 smithi077 ceph-mon[27902]: osdmap e1427: 12 total, 12 up, 12 in 2024-04-21T21:39:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:16 smithi077 ceph-mon[27902]: pgmap v21672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40469.156620 secs 2024-04-21T21:39:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40469.156620 secs 2024-04-21T21:39:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40469.156620 secs 2024-04-21T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:18 smithi170 ceph-mon[31212]: pgmap v21673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:18 smithi191 ceph-mon[31636]: pgmap v21673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:18 smithi077 ceph-mon[27902]: pgmap v21673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40470.910706 secs 2024-04-21T21:39:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40470.910706 secs 2024-04-21T21:39:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40470.910706 secs 2024-04-21T21:39:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:20 smithi170 ceph-mon[31212]: pgmap v21674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:20 smithi077 ceph-mon[27902]: pgmap v21674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:20 smithi191 ceph-mon[31636]: pgmap v21674: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:39:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:22 smithi077 ceph-mon[27902]: pgmap v21675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:39:23.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40474.156735 secs 2024-04-21T21:39:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:22 smithi191 ceph-mon[31636]: pgmap v21675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:39:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40474.156735 secs 2024-04-21T21:39:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:22 smithi170 ceph-mon[31212]: pgmap v21675: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:39:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40474.156735 secs 2024-04-21T21:39:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:24 smithi191 ceph-mon[31636]: pgmap v21676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:39:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40475.910824 secs 2024-04-21T21:39:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:24 smithi170 ceph-mon[31212]: pgmap v21676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:39:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40475.910824 secs 2024-04-21T21:39:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:24 smithi077 ceph-mon[27902]: pgmap v21676: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:39:25.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40475.910824 secs 2024-04-21T21:39:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:26 smithi191 ceph-mon[31636]: pgmap v21677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:39:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:26 smithi170 ceph-mon[31212]: pgmap v21677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:39:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:26 smithi077 ceph-mon[27902]: pgmap v21677: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:39:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40479.156826 secs 2024-04-21T21:39:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40479.156826 secs 2024-04-21T21:39:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40479.156826 secs 2024-04-21T21:39:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:28 smithi170 ceph-mon[31212]: pgmap v21678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:28 smithi077 ceph-mon[27902]: pgmap v21678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:28 smithi191 ceph-mon[31636]: pgmap v21678: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40480.910921 secs 2024-04-21T21:39:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40480.910921 secs 2024-04-21T21:39:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40480.910921 secs 2024-04-21T21:39:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:30 smithi170 ceph-mon[31212]: pgmap v21679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:30 smithi077 ceph-mon[27902]: pgmap v21679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:30 smithi191 ceph-mon[31636]: pgmap v21679: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:32 smithi077 ceph-mon[27902]: pgmap v21680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:33.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40484.156940 secs 2024-04-21T21:39:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:32 smithi191 ceph-mon[31636]: pgmap v21680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40484.156940 secs 2024-04-21T21:39:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:32 smithi170 ceph-mon[31212]: pgmap v21680: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40484.156940 secs 2024-04-21T21:39:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:34 smithi191 ceph-mon[31636]: pgmap v21681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40485.911038 secs 2024-04-21T21:39:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:34 smithi170 ceph-mon[31212]: pgmap v21681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40485.911038 secs 2024-04-21T21:39:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:34 smithi077 ceph-mon[27902]: pgmap v21681: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40485.911038 secs 2024-04-21T21:39:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:36 smithi191 ceph-mon[31636]: pgmap v21682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:36 smithi170 ceph-mon[31212]: pgmap v21682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:36 smithi077 ceph-mon[27902]: pgmap v21682: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40489.157041 secs 2024-04-21T21:39:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40489.157041 secs 2024-04-21T21:39:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40489.157041 secs 2024-04-21T21:39:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:38 smithi191 ceph-mon[31636]: pgmap v21683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:38 smithi170 ceph-mon[31212]: pgmap v21683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:38 smithi077 ceph-mon[27902]: pgmap v21683: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40490.911119 secs 2024-04-21T21:39:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40490.911119 secs 2024-04-21T21:39:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40490.911119 secs 2024-04-21T21:39:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:40 smithi191 ceph-mon[31636]: pgmap v21684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:40 smithi170 ceph-mon[31212]: pgmap v21684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:40 smithi077 ceph-mon[27902]: pgmap v21684: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:42 smithi191 ceph-mon[31636]: pgmap v21685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40494.157157 secs 2024-04-21T21:39:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:42 smithi170 ceph-mon[31212]: pgmap v21685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40494.157157 secs 2024-04-21T21:39:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:42 smithi077 ceph-mon[27902]: pgmap v21685: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40494.157157 secs 2024-04-21T21:39:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:44 smithi191 ceph-mon[31636]: pgmap v21686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40495.911216 secs 2024-04-21T21:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:44 smithi170 ceph-mon[31212]: pgmap v21686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40495.911216 secs 2024-04-21T21:39:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:44 smithi077 ceph-mon[27902]: pgmap v21686: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40495.911216 secs 2024-04-21T21:39:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:46 smithi191 ceph-mon[31636]: pgmap v21687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:46 smithi170 ceph-mon[31212]: pgmap v21687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:46 smithi077 ceph-mon[27902]: pgmap v21687: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40499.157303 secs 2024-04-21T21:39:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40499.157303 secs 2024-04-21T21:39:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40499.157303 secs 2024-04-21T21:39:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:48 smithi191 ceph-mon[31636]: pgmap v21688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:48 smithi170 ceph-mon[31212]: pgmap v21688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:48 smithi077 ceph-mon[27902]: pgmap v21688: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40500.911315 secs 2024-04-21T21:39:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40500.911315 secs 2024-04-21T21:39:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40500.911315 secs 2024-04-21T21:39:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:50 smithi191 ceph-mon[31636]: pgmap v21689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:50 smithi170 ceph-mon[31212]: pgmap v21689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:50 smithi077 ceph-mon[27902]: pgmap v21689: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:52 smithi191 ceph-mon[31636]: pgmap v21690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40504.157411 secs 2024-04-21T21:39:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:52 smithi170 ceph-mon[31212]: pgmap v21690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40504.157411 secs 2024-04-21T21:39:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:52 smithi077 ceph-mon[27902]: pgmap v21690: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40504.157411 secs 2024-04-21T21:39:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:39:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:54 smithi191 ceph-mon[31636]: pgmap v21691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40505.911435 secs 2024-04-21T21:39:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:54 smithi170 ceph-mon[31212]: pgmap v21691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40505.911435 secs 2024-04-21T21:39:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:54 smithi077 ceph-mon[27902]: pgmap v21691: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40505.911435 secs 2024-04-21T21:39:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:56 smithi191 ceph-mon[31636]: pgmap v21692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:56 smithi170 ceph-mon[31212]: pgmap v21692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:56 smithi077 ceph-mon[27902]: pgmap v21692: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:39:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40509.157527 secs 2024-04-21T21:39:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40509.157527 secs 2024-04-21T21:39:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40509.157527 secs 2024-04-21T21:39:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:58 smithi191 ceph-mon[31636]: pgmap v21693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:58 smithi170 ceph-mon[31212]: pgmap v21693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:39:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:58 smithi077 ceph-mon[27902]: pgmap v21693: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:39:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40510.911542 secs 2024-04-21T21:40:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:39:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40510.911542 secs 2024-04-21T21:40:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:39:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40510.911542 secs 2024-04-21T21:40:01.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:00 smithi191 ceph-mon[31636]: pgmap v21694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:01.221 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:40:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:00 smithi170 ceph-mon[31212]: pgmap v21694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:01.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:40:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:00 smithi077 ceph-mon[27902]: pgmap v21694: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:40:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:02 smithi191 ceph-mon[31636]: pgmap v21695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40514.157631 secs 2024-04-21T21:40:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:02 smithi170 ceph-mon[31212]: pgmap v21695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40514.157631 secs 2024-04-21T21:40:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:02 smithi077 ceph-mon[27902]: pgmap v21695: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40514.157631 secs 2024-04-21T21:40:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:04 smithi191 ceph-mon[31636]: pgmap v21696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40515.911662 secs 2024-04-21T21:40:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:04 smithi170 ceph-mon[31212]: pgmap v21696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40515.911662 secs 2024-04-21T21:40:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:04 smithi077 ceph-mon[27902]: pgmap v21696: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40515.911662 secs 2024-04-21T21:40:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:05 smithi170 ceph-mon[31212]: osdmap e1428: 12 total, 12 up, 12 in 2024-04-21T21:40:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:05 smithi077 ceph-mon[27902]: osdmap e1428: 12 total, 12 up, 12 in 2024-04-21T21:40:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:05 smithi191 ceph-mon[31636]: osdmap e1428: 12 total, 12 up, 12 in 2024-04-21T21:40:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:06 smithi170 ceph-mon[31212]: pgmap v21698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:06 smithi077 ceph-mon[27902]: pgmap v21698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:06 smithi191 ceph-mon[31636]: pgmap v21698: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40519.157748 secs 2024-04-21T21:40:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40519.157748 secs 2024-04-21T21:40:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40519.157748 secs 2024-04-21T21:40:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:08 smithi170 ceph-mon[31212]: pgmap v21699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:08 smithi077 ceph-mon[27902]: pgmap v21699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:08 smithi191 ceph-mon[31636]: pgmap v21699: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40520.911798 secs 2024-04-21T21:40:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40520.911798 secs 2024-04-21T21:40:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40520.911798 secs 2024-04-21T21:40:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:10 smithi170 ceph-mon[31212]: pgmap v21700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:10 smithi077 ceph-mon[27902]: pgmap v21700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:10 smithi191 ceph-mon[31636]: pgmap v21700: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:40:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:12 smithi170 ceph-mon[31212]: pgmap v21701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:40:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40524.157896 secs 2024-04-21T21:40:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:12 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:40:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:12 smithi077 ceph-mon[27902]: pgmap v21701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:40:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40524.157896 secs 2024-04-21T21:40:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:12 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:40:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:12 smithi191 ceph-mon[31636]: pgmap v21701: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:40:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40524.157896 secs 2024-04-21T21:40:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:12 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:40:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:40:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:40:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:40:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:40:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:40:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:40:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:40:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:40:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:40:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:15 smithi191 ceph-mon[31636]: pgmap v21702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:40:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40525.911949 secs 2024-04-21T21:40:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:15 smithi170 ceph-mon[31212]: pgmap v21702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:40:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40525.911949 secs 2024-04-21T21:40:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:15 smithi077 ceph-mon[27902]: pgmap v21702: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:40:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40525.911949 secs 2024-04-21T21:40:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:16 smithi191 ceph-mon[31636]: osdmap e1429: 12 total, 12 up, 12 in 2024-04-21T21:40:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:16 smithi191 ceph-mon[31636]: pgmap v21704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:16 smithi170 ceph-mon[31212]: osdmap e1429: 12 total, 12 up, 12 in 2024-04-21T21:40:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:16 smithi170 ceph-mon[31212]: pgmap v21704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:16 smithi077 ceph-mon[27902]: osdmap e1429: 12 total, 12 up, 12 in 2024-04-21T21:40:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:16 smithi077 ceph-mon[27902]: pgmap v21704: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40529.157998 secs 2024-04-21T21:40:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40529.157998 secs 2024-04-21T21:40:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40529.157998 secs 2024-04-21T21:40:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:18 smithi170 ceph-mon[31212]: pgmap v21705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:18 smithi191 ceph-mon[31636]: pgmap v21705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:18 smithi077 ceph-mon[27902]: pgmap v21705: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40530.912014 secs 2024-04-21T21:40:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40530.912014 secs 2024-04-21T21:40:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40530.912014 secs 2024-04-21T21:40:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:20 smithi170 ceph-mon[31212]: pgmap v21706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:20 smithi077 ceph-mon[27902]: pgmap v21706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:20 smithi191 ceph-mon[31636]: pgmap v21706: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:40:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:22 smithi191 ceph-mon[31636]: pgmap v21707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:40:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40534.158104 secs 2024-04-21T21:40:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:22 smithi170 ceph-mon[31212]: pgmap v21707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:40:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40534.158104 secs 2024-04-21T21:40:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:22 smithi077 ceph-mon[27902]: pgmap v21707: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:40:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40534.158104 secs 2024-04-21T21:40:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:24 smithi191 ceph-mon[31636]: pgmap v21708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:40:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40535.912133 secs 2024-04-21T21:40:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:24 smithi170 ceph-mon[31212]: pgmap v21708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:40:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40535.912133 secs 2024-04-21T21:40:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:24 smithi077 ceph-mon[27902]: pgmap v21708: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:40:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40535.912133 secs 2024-04-21T21:40:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:26 smithi191 ceph-mon[31636]: pgmap v21709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:40:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:26 smithi170 ceph-mon[31212]: pgmap v21709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:40:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:26 smithi077 ceph-mon[27902]: pgmap v21709: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:40:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40539.158231 secs 2024-04-21T21:40:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40539.158231 secs 2024-04-21T21:40:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40539.158231 secs 2024-04-21T21:40:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:28 smithi191 ceph-mon[31636]: pgmap v21710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:28 smithi170 ceph-mon[31212]: pgmap v21710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:28 smithi077 ceph-mon[27902]: pgmap v21710: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40540.912263 secs 2024-04-21T21:40:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40540.912263 secs 2024-04-21T21:40:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40540.912263 secs 2024-04-21T21:40:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:30 smithi191 ceph-mon[31636]: pgmap v21711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:30 smithi170 ceph-mon[31212]: pgmap v21711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:30 smithi077 ceph-mon[27902]: pgmap v21711: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:32 smithi191 ceph-mon[31636]: pgmap v21712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40544.158306 secs 2024-04-21T21:40:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:32 smithi170 ceph-mon[31212]: pgmap v21712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40544.158306 secs 2024-04-21T21:40:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:32 smithi077 ceph-mon[27902]: pgmap v21712: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40544.158306 secs 2024-04-21T21:40:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:34 smithi191 ceph-mon[31636]: pgmap v21713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:35.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40545.912384 secs 2024-04-21T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:34 smithi170 ceph-mon[31212]: pgmap v21713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40545.912384 secs 2024-04-21T21:40:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:34 smithi077 ceph-mon[27902]: pgmap v21713: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40545.912384 secs 2024-04-21T21:40:36.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:36 smithi191 ceph-mon[31636]: pgmap v21714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:36.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:36 smithi170 ceph-mon[31212]: pgmap v21714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:36.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:36 smithi077 ceph-mon[27902]: pgmap v21714: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40549.158411 secs 2024-04-21T21:40:37.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40549.158411 secs 2024-04-21T21:40:37.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40549.158411 secs 2024-04-21T21:40:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:38 smithi170 ceph-mon[31212]: pgmap v21715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:38.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:38 smithi077 ceph-mon[27902]: pgmap v21715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:38.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:38 smithi191 ceph-mon[31636]: pgmap v21715: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40550.912529 secs 2024-04-21T21:40:39.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40550.912529 secs 2024-04-21T21:40:39.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40550.912529 secs 2024-04-21T21:40:40.135 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:40 smithi170 ceph-mon[31212]: pgmap v21716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:40.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:40 smithi077 ceph-mon[27902]: pgmap v21716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:40.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:40 smithi191 ceph-mon[31636]: pgmap v21716: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:43.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:42 smithi191 ceph-mon[31636]: pgmap v21717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:43.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40554.158548 secs 2024-04-21T21:40:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:42 smithi170 ceph-mon[31212]: pgmap v21717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40554.158548 secs 2024-04-21T21:40:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:42 smithi077 ceph-mon[27902]: pgmap v21717: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40554.158548 secs 2024-04-21T21:40:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:44 smithi191 ceph-mon[31636]: pgmap v21718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:45.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40555.912620 secs 2024-04-21T21:40:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:44 smithi170 ceph-mon[31212]: pgmap v21718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40555.912620 secs 2024-04-21T21:40:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:44 smithi077 ceph-mon[27902]: pgmap v21718: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40555.912620 secs 2024-04-21T21:40:47.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:46 smithi191 ceph-mon[31636]: pgmap v21719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:46 smithi170 ceph-mon[31212]: pgmap v21719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:46 smithi077 ceph-mon[27902]: pgmap v21719: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:48.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40559.158658 secs 2024-04-21T21:40:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40559.158658 secs 2024-04-21T21:40:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40559.158658 secs 2024-04-21T21:40:49.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:48 smithi191 ceph-mon[31636]: pgmap v21720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:48 smithi170 ceph-mon[31212]: pgmap v21720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:48 smithi077 ceph-mon[27902]: pgmap v21720: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:50.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40560.912729 secs 2024-04-21T21:40:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40560.912729 secs 2024-04-21T21:40:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40560.912729 secs 2024-04-21T21:40:51.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:50 smithi191 ceph-mon[31636]: pgmap v21721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:50 smithi170 ceph-mon[31212]: pgmap v21721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:50 smithi077 ceph-mon[27902]: pgmap v21721: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:52 smithi191 ceph-mon[31636]: pgmap v21722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:53.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:52 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40564.158792 secs 2024-04-21T21:40:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:52 smithi170 ceph-mon[31212]: pgmap v21722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:52 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40564.158792 secs 2024-04-21T21:40:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:52 smithi077 ceph-mon[27902]: pgmap v21722: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:52 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40564.158792 secs 2024-04-21T21:40:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:40:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:54 smithi191 ceph-mon[31636]: pgmap v21723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:55.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40565.912880 secs 2024-04-21T21:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:54 smithi170 ceph-mon[31212]: pgmap v21723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40565.912880 secs 2024-04-21T21:40:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:54 smithi077 ceph-mon[27902]: pgmap v21723: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40565.912880 secs 2024-04-21T21:40:57.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:56 smithi191 ceph-mon[31636]: pgmap v21724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:56 smithi170 ceph-mon[31212]: pgmap v21724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:56 smithi077 ceph-mon[27902]: pgmap v21724: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:40:58.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:57 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40569.158920 secs 2024-04-21T21:40:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:57 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40569.158920 secs 2024-04-21T21:40:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:57 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40569.158920 secs 2024-04-21T21:40:59.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:58 smithi191 ceph-mon[31636]: pgmap v21725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:58 smithi170 ceph-mon[31212]: pgmap v21725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:58 smithi077 ceph-mon[27902]: pgmap v21725: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:40:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:40:59.964+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:40:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:40:59.964+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:40:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:40:59.964+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:40:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:40:59.964+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:41:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:00.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:40:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40570.913006 secs 2024-04-21T21:41:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:40:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40570.913006 secs 2024-04-21T21:41:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:40:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40570.913006 secs 2024-04-21T21:41:01.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:00 smithi191 ceph-mon[31636]: pgmap v21726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:00 smithi170 ceph-mon[31212]: pgmap v21726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:00 smithi077 ceph-mon[27902]: pgmap v21726: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:02 smithi191 ceph-mon[31636]: pgmap v21727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:03.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:02 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40574.159049 secs 2024-04-21T21:41:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:02 smithi170 ceph-mon[31212]: pgmap v21727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:02 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40574.159049 secs 2024-04-21T21:41:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:02 smithi077 ceph-mon[27902]: pgmap v21727: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:02 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40574.159049 secs 2024-04-21T21:41:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:04 smithi191 ceph-mon[31636]: pgmap v21728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:05.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40575.913090 secs 2024-04-21T21:41:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:04 smithi170 ceph-mon[31212]: pgmap v21728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40575.913090 secs 2024-04-21T21:41:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:04 smithi077 ceph-mon[27902]: pgmap v21728: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40575.913090 secs 2024-04-21T21:41:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:05 smithi170 ceph-mon[31212]: osdmap e1430: 12 total, 12 up, 12 in 2024-04-21T21:41:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:05 smithi077 ceph-mon[27902]: osdmap e1430: 12 total, 12 up, 12 in 2024-04-21T21:41:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:05 smithi191 ceph-mon[31636]: osdmap e1430: 12 total, 12 up, 12 in 2024-04-21T21:41:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:06 smithi170 ceph-mon[31212]: pgmap v21730: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:06 smithi077 ceph-mon[27902]: pgmap v21730: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:06 smithi191 ceph-mon[31636]: pgmap v21730: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:08.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40579.159166 secs 2024-04-21T21:41:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40579.159166 secs 2024-04-21T21:41:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40579.159166 secs 2024-04-21T21:41:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:08 smithi170 ceph-mon[31212]: pgmap v21731: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:08 smithi077 ceph-mon[27902]: pgmap v21731: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:08 smithi191 ceph-mon[31636]: pgmap v21731: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:10.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40580.913224 secs 2024-04-21T21:41:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40580.913224 secs 2024-04-21T21:41:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40580.913224 secs 2024-04-21T21:41:11.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:10 smithi170 ceph-mon[31212]: pgmap v21732: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:10 smithi077 ceph-mon[27902]: pgmap v21732: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:10 smithi191 ceph-mon[31636]: pgmap v21732: 97 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 93 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:41:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:12 smithi170 ceph-mon[31212]: pgmap v21733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:41:13.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40584.159273 secs 2024-04-21T21:41:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:12 smithi077 ceph-mon[27902]: pgmap v21733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:41:13.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40584.159273 secs 2024-04-21T21:41:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:12 smithi191 ceph-mon[31636]: pgmap v21733: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:41:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40584.159273 secs 2024-04-21T21:41:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:41:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:41:14.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:41:14.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:13 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:41:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:41:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:41:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:41:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:13 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:41:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:41:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:41:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:41:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:13 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:41:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:15 smithi170 ceph-mon[31212]: pgmap v21734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:41:15.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40585.913290 secs 2024-04-21T21:41:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:15 smithi077 ceph-mon[27902]: pgmap v21734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:41:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40585.913290 secs 2024-04-21T21:41:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:15 smithi191 ceph-mon[31636]: pgmap v21734: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:41:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40585.913290 secs 2024-04-21T21:41:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:16 smithi170 ceph-mon[31212]: osdmap e1431: 12 total, 12 up, 12 in 2024-04-21T21:41:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:16 smithi170 ceph-mon[31212]: pgmap v21736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:16 smithi077 ceph-mon[27902]: osdmap e1431: 12 total, 12 up, 12 in 2024-04-21T21:41:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:16 smithi077 ceph-mon[27902]: pgmap v21736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:16 smithi191 ceph-mon[31636]: osdmap e1431: 12 total, 12 up, 12 in 2024-04-21T21:41:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:16 smithi191 ceph-mon[31636]: pgmap v21736: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40589.159386 secs 2024-04-21T21:41:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40589.159386 secs 2024-04-21T21:41:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40589.159386 secs 2024-04-21T21:41:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:18 smithi170 ceph-mon[31212]: pgmap v21737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:18 smithi191 ceph-mon[31636]: pgmap v21737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:18 smithi077 ceph-mon[27902]: pgmap v21737: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40590.913375 secs 2024-04-21T21:41:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40590.913375 secs 2024-04-21T21:41:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40590.913375 secs 2024-04-21T21:41:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:20 smithi077 ceph-mon[27902]: pgmap v21738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:20 smithi191 ceph-mon[31636]: pgmap v21738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:20 smithi170 ceph-mon[31212]: pgmap v21738: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:41:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:22 smithi191 ceph-mon[31636]: pgmap v21739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:41:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40594.159501 secs 2024-04-21T21:41:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:22 smithi170 ceph-mon[31212]: pgmap v21739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:41:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40594.159501 secs 2024-04-21T21:41:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:22 smithi077 ceph-mon[27902]: pgmap v21739: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:41:23.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40594.159501 secs 2024-04-21T21:41:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:24 smithi191 ceph-mon[31636]: pgmap v21740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:41:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40595.913456 secs 2024-04-21T21:41:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:24 smithi170 ceph-mon[31212]: pgmap v21740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:41:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40595.913456 secs 2024-04-21T21:41:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:24 smithi077 ceph-mon[27902]: pgmap v21740: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:41:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40595.913456 secs 2024-04-21T21:41:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:26 smithi191 ceph-mon[31636]: pgmap v21741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T21:41:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:26 smithi170 ceph-mon[31212]: pgmap v21741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T21:41:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:26 smithi077 ceph-mon[27902]: pgmap v21741: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-21T21:41:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40599.159619 secs 2024-04-21T21:41:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40599.159619 secs 2024-04-21T21:41:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40599.159619 secs 2024-04-21T21:41:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:28 smithi191 ceph-mon[31636]: pgmap v21742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:28 smithi170 ceph-mon[31212]: pgmap v21742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:28 smithi077 ceph-mon[27902]: pgmap v21742: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40600.913581 secs 2024-04-21T21:41:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40600.913581 secs 2024-04-21T21:41:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40600.913581 secs 2024-04-21T21:41:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:30 smithi191 ceph-mon[31636]: pgmap v21743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:30 smithi170 ceph-mon[31212]: pgmap v21743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:30 smithi077 ceph-mon[27902]: pgmap v21743: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:32 smithi191 ceph-mon[31636]: pgmap v21744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40604.159731 secs 2024-04-21T21:41:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:32 smithi170 ceph-mon[31212]: pgmap v21744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40604.159731 secs 2024-04-21T21:41:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:32 smithi077 ceph-mon[27902]: pgmap v21744: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40604.159731 secs 2024-04-21T21:41:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:34 smithi191 ceph-mon[31636]: pgmap v21745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40605.913724 secs 2024-04-21T21:41:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:34 smithi170 ceph-mon[31212]: pgmap v21745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40605.913724 secs 2024-04-21T21:41:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:34 smithi077 ceph-mon[27902]: pgmap v21745: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:41:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40605.913724 secs 2024-04-21T21:41:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:36 smithi191 ceph-mon[31636]: pgmap v21746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:36 smithi170 ceph-mon[31212]: pgmap v21746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:36 smithi077 ceph-mon[27902]: pgmap v21746: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40609.159793 secs 2024-04-21T21:41:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40609.159793 secs 2024-04-21T21:41:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40609.159793 secs 2024-04-21T21:41:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:38 smithi191 ceph-mon[31636]: pgmap v21747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:38 smithi170 ceph-mon[31212]: pgmap v21747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:38 smithi077 ceph-mon[27902]: pgmap v21747: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:40.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:40.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40610.913897 secs 2024-04-21T21:41:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40610.913897 secs 2024-04-21T21:41:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40610.913897 secs 2024-04-21T21:41:41.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:40 smithi191 ceph-mon[31636]: pgmap v21748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:40 smithi170 ceph-mon[31212]: pgmap v21748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:40 smithi077 ceph-mon[27902]: pgmap v21748: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:42 smithi170 ceph-mon[31212]: pgmap v21749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40614.159909 secs 2024-04-21T21:41:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:42 smithi077 ceph-mon[27902]: pgmap v21749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40614.159909 secs 2024-04-21T21:41:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:42 smithi191 ceph-mon[31636]: pgmap v21749: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40614.159909 secs 2024-04-21T21:41:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:44 smithi170 ceph-mon[31212]: pgmap v21750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40615.913966 secs 2024-04-21T21:41:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:44 smithi077 ceph-mon[27902]: pgmap v21750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40615.913966 secs 2024-04-21T21:41:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:44 smithi191 ceph-mon[31636]: pgmap v21750: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40615.913966 secs 2024-04-21T21:41:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:46 smithi170 ceph-mon[31212]: pgmap v21751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:46 smithi077 ceph-mon[27902]: pgmap v21751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:46 smithi191 ceph-mon[31636]: pgmap v21751: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40619.160025 secs 2024-04-21T21:41:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40619.160025 secs 2024-04-21T21:41:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40619.160025 secs 2024-04-21T21:41:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:48 smithi170 ceph-mon[31212]: pgmap v21752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:48 smithi077 ceph-mon[27902]: pgmap v21752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:48 smithi191 ceph-mon[31636]: pgmap v21752: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40620.914095 secs 2024-04-21T21:41:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40620.914095 secs 2024-04-21T21:41:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40620.914095 secs 2024-04-21T21:41:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:51 smithi170 ceph-mon[31212]: pgmap v21753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:51 smithi077 ceph-mon[27902]: pgmap v21753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:51 smithi191 ceph-mon[31636]: pgmap v21753: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:53 smithi170 ceph-mon[31212]: pgmap v21754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40624.160142 secs 2024-04-21T21:41:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:53 smithi077 ceph-mon[27902]: pgmap v21754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40624.160142 secs 2024-04-21T21:41:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:53 smithi191 ceph-mon[31636]: pgmap v21754: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40624.160142 secs 2024-04-21T21:41:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:41:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:55 smithi170 ceph-mon[31212]: pgmap v21755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40625.914214 secs 2024-04-21T21:41:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:55 smithi077 ceph-mon[27902]: pgmap v21755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40625.914214 secs 2024-04-21T21:41:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:55 smithi191 ceph-mon[31636]: pgmap v21755: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40625.914214 secs 2024-04-21T21:41:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:57 smithi170 ceph-mon[31212]: pgmap v21756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:57 smithi077 ceph-mon[27902]: pgmap v21756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:57 smithi191 ceph-mon[31636]: pgmap v21756: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:41:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40629.160261 secs 2024-04-21T21:41:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40629.160261 secs 2024-04-21T21:41:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40629.160261 secs 2024-04-21T21:41:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:41:59 smithi170 ceph-mon[31212]: pgmap v21757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:41:59 smithi077 ceph-mon[27902]: pgmap v21757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:41:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:41:59 smithi191 ceph-mon[31636]: pgmap v21757: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40630.914344 secs 2024-04-21T21:42:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40630.914344 secs 2024-04-21T21:42:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40630.914344 secs 2024-04-21T21:42:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:01 smithi170 ceph-mon[31212]: pgmap v21758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:01 smithi077 ceph-mon[27902]: pgmap v21758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:01 smithi191 ceph-mon[31636]: pgmap v21758: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:03 smithi170 ceph-mon[31212]: pgmap v21759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:03.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40634.160396 secs 2024-04-21T21:42:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:03 smithi077 ceph-mon[27902]: pgmap v21759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40634.160396 secs 2024-04-21T21:42:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:03 smithi191 ceph-mon[31636]: pgmap v21759: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40634.160396 secs 2024-04-21T21:42:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:05 smithi170 ceph-mon[31212]: pgmap v21760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:05.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40635.914504 secs 2024-04-21T21:42:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:05 smithi077 ceph-mon[27902]: pgmap v21760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40635.914504 secs 2024-04-21T21:42:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:05 smithi191 ceph-mon[31636]: pgmap v21760: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40635.914504 secs 2024-04-21T21:42:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:06 smithi170 ceph-mon[31212]: osdmap e1432: 12 total, 12 up, 12 in 2024-04-21T21:42:06.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:06 smithi077 ceph-mon[27902]: osdmap e1432: 12 total, 12 up, 12 in 2024-04-21T21:42:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:06 smithi191 ceph-mon[31636]: osdmap e1432: 12 total, 12 up, 12 in 2024-04-21T21:42:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:07 smithi170 ceph-mon[31212]: pgmap v21762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:07 smithi077 ceph-mon[27902]: pgmap v21762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:07 smithi191 ceph-mon[31636]: pgmap v21762: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40639.160537 secs 2024-04-21T21:42:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40639.160537 secs 2024-04-21T21:42:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40639.160537 secs 2024-04-21T21:42:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:09 smithi170 ceph-mon[31212]: pgmap v21763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:09 smithi077 ceph-mon[27902]: pgmap v21763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:09 smithi191 ceph-mon[31636]: pgmap v21763: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40640.914618 secs 2024-04-21T21:42:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40640.914618 secs 2024-04-21T21:42:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40640.914618 secs 2024-04-21T21:42:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:11 smithi077 ceph-mon[27902]: pgmap v21764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:11 smithi191 ceph-mon[31636]: pgmap v21764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:11.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:11 smithi170 ceph-mon[31212]: pgmap v21764: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:42:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:13 smithi077 ceph-mon[27902]: pgmap v21765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:42:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40644.160671 secs 2024-04-21T21:42:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:13 smithi191 ceph-mon[31636]: pgmap v21765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:42:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40644.160671 secs 2024-04-21T21:42:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:13 smithi170 ceph-mon[31212]: pgmap v21765: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:42:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40644.160671 secs 2024-04-21T21:42:14.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:14 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:42:14.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:14 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:42:14.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:14 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:42:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:15 smithi077 ceph-mon[27902]: pgmap v21766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:42:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40645.914718 secs 2024-04-21T21:42:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:42:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:42:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:42:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:15 smithi191 ceph-mon[31636]: pgmap v21766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:42:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40645.914718 secs 2024-04-21T21:42:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:42:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:42:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:42:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:15 smithi170 ceph-mon[31212]: pgmap v21766: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:42:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40645.914718 secs 2024-04-21T21:42:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:42:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:42:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:42:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:16 smithi170 ceph-mon[31212]: osdmap e1433: 12 total, 12 up, 12 in 2024-04-21T21:42:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:16 smithi170 ceph-mon[31212]: pgmap v21768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:16 smithi077 ceph-mon[27902]: osdmap e1433: 12 total, 12 up, 12 in 2024-04-21T21:42:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:16 smithi077 ceph-mon[27902]: pgmap v21768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:16 smithi191 ceph-mon[31636]: osdmap e1433: 12 total, 12 up, 12 in 2024-04-21T21:42:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:16 smithi191 ceph-mon[31636]: pgmap v21768: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40649.160788 secs 2024-04-21T21:42:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40649.160788 secs 2024-04-21T21:42:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40649.160788 secs 2024-04-21T21:42:18.871 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:18 smithi191 ceph-mon[31636]: pgmap v21769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:18 smithi077 ceph-mon[27902]: pgmap v21769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:18 smithi170 ceph-mon[31212]: pgmap v21769: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40650.914817 secs 2024-04-21T21:42:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40650.914817 secs 2024-04-21T21:42:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40650.914817 secs 2024-04-21T21:42:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:20 smithi077 ceph-mon[27902]: pgmap v21770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:20 smithi191 ceph-mon[31636]: pgmap v21770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:20 smithi170 ceph-mon[31212]: pgmap v21770: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:42:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:22 smithi191 ceph-mon[31636]: pgmap v21771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:42:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40654.160896 secs 2024-04-21T21:42:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:22 smithi170 ceph-mon[31212]: pgmap v21771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:42:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40654.160896 secs 2024-04-21T21:42:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:22 smithi077 ceph-mon[27902]: pgmap v21771: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:42:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40654.160896 secs 2024-04-21T21:42:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:25.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:24 smithi191 ceph-mon[31636]: pgmap v21772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:42:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40655.914944 secs 2024-04-21T21:42:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:24 smithi170 ceph-mon[31212]: pgmap v21772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:42:25.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40655.914944 secs 2024-04-21T21:42:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:24 smithi077 ceph-mon[27902]: pgmap v21772: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:42:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40655.914944 secs 2024-04-21T21:42:27.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:26 smithi191 ceph-mon[31636]: pgmap v21773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:42:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:26 smithi170 ceph-mon[31212]: pgmap v21773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:42:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:26 smithi077 ceph-mon[27902]: pgmap v21773: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:42:28.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40659.161009 secs 2024-04-21T21:42:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40659.161009 secs 2024-04-21T21:42:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40659.161009 secs 2024-04-21T21:42:29.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:28 smithi191 ceph-mon[31636]: pgmap v21774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:28 smithi170 ceph-mon[31212]: pgmap v21774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:28 smithi077 ceph-mon[27902]: pgmap v21774: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:30.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40660.915072 secs 2024-04-21T21:42:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40660.915072 secs 2024-04-21T21:42:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40660.915072 secs 2024-04-21T21:42:31.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:30 smithi191 ceph-mon[31636]: pgmap v21775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:30 smithi170 ceph-mon[31212]: pgmap v21775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:30 smithi077 ceph-mon[27902]: pgmap v21775: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:32 smithi191 ceph-mon[31636]: pgmap v21776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40664.161122 secs 2024-04-21T21:42:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:32 smithi170 ceph-mon[31212]: pgmap v21776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40664.161122 secs 2024-04-21T21:42:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:32 smithi077 ceph-mon[27902]: pgmap v21776: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40664.161122 secs 2024-04-21T21:42:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:34 smithi191 ceph-mon[31636]: pgmap v21777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40665.915203 secs 2024-04-21T21:42:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:34 smithi170 ceph-mon[31212]: pgmap v21777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40665.915203 secs 2024-04-21T21:42:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:34 smithi077 ceph-mon[27902]: pgmap v21777: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40665.915203 secs 2024-04-21T21:42:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:36 smithi191 ceph-mon[31636]: pgmap v21778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:36 smithi170 ceph-mon[31212]: pgmap v21778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:36 smithi077 ceph-mon[27902]: pgmap v21778: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40669.161241 secs 2024-04-21T21:42:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40669.161241 secs 2024-04-21T21:42:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40669.161241 secs 2024-04-21T21:42:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:38 smithi170 ceph-mon[31212]: pgmap v21779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:38 smithi077 ceph-mon[27902]: pgmap v21779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:38 smithi191 ceph-mon[31636]: pgmap v21779: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40670.915326 secs 2024-04-21T21:42:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40670.915326 secs 2024-04-21T21:42:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40670.915326 secs 2024-04-21T21:42:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:40 smithi170 ceph-mon[31212]: pgmap v21780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:40 smithi077 ceph-mon[27902]: pgmap v21780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:40 smithi191 ceph-mon[31636]: pgmap v21780: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:42 smithi170 ceph-mon[31212]: pgmap v21781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40674.161354 secs 2024-04-21T21:42:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:42 smithi077 ceph-mon[27902]: pgmap v21781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40674.161354 secs 2024-04-21T21:42:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:42 smithi191 ceph-mon[31636]: pgmap v21781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40674.161354 secs 2024-04-21T21:42:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:44 smithi170 ceph-mon[31212]: pgmap v21782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40675.915393 secs 2024-04-21T21:42:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:44 smithi077 ceph-mon[27902]: pgmap v21782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40675.915393 secs 2024-04-21T21:42:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:44 smithi191 ceph-mon[31636]: pgmap v21782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40675.915393 secs 2024-04-21T21:42:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:46 smithi170 ceph-mon[31212]: pgmap v21783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:46 smithi077 ceph-mon[27902]: pgmap v21783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:46 smithi191 ceph-mon[31636]: pgmap v21783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40679.161472 secs 2024-04-21T21:42:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40679.161472 secs 2024-04-21T21:42:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40679.161472 secs 2024-04-21T21:42:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:49 smithi170 ceph-mon[31212]: pgmap v21784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:49 smithi077 ceph-mon[27902]: pgmap v21784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:49 smithi191 ceph-mon[31636]: pgmap v21784: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40680.915463 secs 2024-04-21T21:42:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40680.915463 secs 2024-04-21T21:42:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40680.915463 secs 2024-04-21T21:42:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:51 smithi170 ceph-mon[31212]: pgmap v21785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:51 smithi077 ceph-mon[27902]: pgmap v21785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:51 smithi191 ceph-mon[31636]: pgmap v21785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:53 smithi170 ceph-mon[31212]: pgmap v21786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40684.161585 secs 2024-04-21T21:42:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:53 smithi077 ceph-mon[27902]: pgmap v21786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40684.161585 secs 2024-04-21T21:42:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:53 smithi191 ceph-mon[31636]: pgmap v21786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40684.161585 secs 2024-04-21T21:42:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:42:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:55 smithi170 ceph-mon[31212]: pgmap v21787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:55.311 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40685.915598 secs 2024-04-21T21:42:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:55 smithi077 ceph-mon[27902]: pgmap v21787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40685.915598 secs 2024-04-21T21:42:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:55 smithi191 ceph-mon[31636]: pgmap v21787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40685.915598 secs 2024-04-21T21:42:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:57 smithi170 ceph-mon[31212]: pgmap v21788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:57 smithi077 ceph-mon[27902]: pgmap v21788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:57 smithi191 ceph-mon[31636]: pgmap v21788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:42:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40689.161725 secs 2024-04-21T21:42:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40689.161725 secs 2024-04-21T21:42:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40689.161725 secs 2024-04-21T21:42:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:42:59 smithi170 ceph-mon[31212]: pgmap v21789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:42:59 smithi077 ceph-mon[27902]: pgmap v21789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:42:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:42:59 smithi191 ceph-mon[31636]: pgmap v21789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40690.915745 secs 2024-04-21T21:43:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40690.915745 secs 2024-04-21T21:43:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40690.915745 secs 2024-04-21T21:43:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:01 smithi170 ceph-mon[31212]: pgmap v21790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:01 smithi077 ceph-mon[27902]: pgmap v21790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:01 smithi191 ceph-mon[31636]: pgmap v21790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:03 smithi170 ceph-mon[31212]: pgmap v21791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40694.161859 secs 2024-04-21T21:43:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:03 smithi077 ceph-mon[27902]: pgmap v21791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40694.161859 secs 2024-04-21T21:43:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:03 smithi191 ceph-mon[31636]: pgmap v21791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40694.161859 secs 2024-04-21T21:43:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:05 smithi170 ceph-mon[31212]: pgmap v21792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40695.915884 secs 2024-04-21T21:43:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:05 smithi077 ceph-mon[27902]: pgmap v21792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40695.915884 secs 2024-04-21T21:43:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:05 smithi191 ceph-mon[31636]: pgmap v21792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40695.915884 secs 2024-04-21T21:43:06.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:06 smithi170 ceph-mon[31212]: osdmap e1434: 12 total, 12 up, 12 in 2024-04-21T21:43:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:06 smithi077 ceph-mon[27902]: osdmap e1434: 12 total, 12 up, 12 in 2024-04-21T21:43:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:06 smithi191 ceph-mon[31636]: osdmap e1434: 12 total, 12 up, 12 in 2024-04-21T21:43:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:07 smithi170 ceph-mon[31212]: pgmap v21794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:07 smithi077 ceph-mon[27902]: pgmap v21794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:07 smithi191 ceph-mon[31636]: pgmap v21794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40699.161927 secs 2024-04-21T21:43:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40699.161927 secs 2024-04-21T21:43:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40699.161927 secs 2024-04-21T21:43:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:09 smithi077 ceph-mon[27902]: pgmap v21795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:09 smithi191 ceph-mon[31636]: pgmap v21795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:09 smithi170 ceph-mon[31212]: pgmap v21795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40700.916002 secs 2024-04-21T21:43:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40700.916002 secs 2024-04-21T21:43:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40700.916002 secs 2024-04-21T21:43:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:11 smithi077 ceph-mon[27902]: pgmap v21796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:11 smithi191 ceph-mon[31636]: pgmap v21796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:11 smithi170 ceph-mon[31212]: pgmap v21796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:43:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:13 smithi077 ceph-mon[27902]: pgmap v21797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:43:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40704.162042 secs 2024-04-21T21:43:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:13 smithi191 ceph-mon[31636]: pgmap v21797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:43:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40704.162042 secs 2024-04-21T21:43:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:13 smithi170 ceph-mon[31212]: pgmap v21797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:43:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40704.162042 secs 2024-04-21T21:43:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:15 smithi077 ceph-mon[27902]: pgmap v21798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:43:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40705.916116 secs 2024-04-21T21:43:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:15 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:43:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:15 smithi191 ceph-mon[31636]: pgmap v21798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:43:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40705.916116 secs 2024-04-21T21:43:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:15 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:43:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:15 smithi170 ceph-mon[31212]: pgmap v21798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:43:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40705.916116 secs 2024-04-21T21:43:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:15 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:16 smithi170 ceph-mon[31212]: osdmap e1435: 12 total, 12 up, 12 in 2024-04-21T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:43:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:43:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:16 smithi170 ceph-mon[31212]: pgmap v21800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:16 smithi077 ceph-mon[27902]: osdmap e1435: 12 total, 12 up, 12 in 2024-04-21T21:43:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:43:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:43:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:43:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:16 smithi077 ceph-mon[27902]: pgmap v21800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:16 smithi191 ceph-mon[31636]: osdmap e1435: 12 total, 12 up, 12 in 2024-04-21T21:43:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:43:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:43:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:43:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:16 smithi191 ceph-mon[31636]: pgmap v21800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40709.162183 secs 2024-04-21T21:43:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40709.162183 secs 2024-04-21T21:43:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40709.162183 secs 2024-04-21T21:43:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:18 smithi191 ceph-mon[31636]: pgmap v21801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:18 smithi077 ceph-mon[27902]: pgmap v21801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:18 smithi170 ceph-mon[31212]: pgmap v21801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40710.916216 secs 2024-04-21T21:43:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40710.916216 secs 2024-04-21T21:43:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40710.916216 secs 2024-04-21T21:43:20.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:20 smithi077 ceph-mon[27902]: pgmap v21802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:20 smithi191 ceph-mon[31636]: pgmap v21802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:20 smithi170 ceph-mon[31212]: pgmap v21802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:43:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:22 smithi191 ceph-mon[31636]: pgmap v21803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:43:23.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40714.162303 secs 2024-04-21T21:43:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:22 smithi170 ceph-mon[31212]: pgmap v21803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:43:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40714.162303 secs 2024-04-21T21:43:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:22 smithi077 ceph-mon[27902]: pgmap v21803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:43:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40714.162303 secs 2024-04-21T21:43:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:24 smithi191 ceph-mon[31636]: pgmap v21804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:43:25.220 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40715.916290 secs 2024-04-21T21:43:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:24 smithi170 ceph-mon[31212]: pgmap v21804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:43:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40715.916290 secs 2024-04-21T21:43:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:24 smithi077 ceph-mon[27902]: pgmap v21804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:43:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40715.916290 secs 2024-04-21T21:43:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:26 smithi170 ceph-mon[31212]: pgmap v21805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:43:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:26 smithi077 ceph-mon[27902]: pgmap v21805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:43:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:26 smithi191 ceph-mon[31636]: pgmap v21805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:43:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40719.162387 secs 2024-04-21T21:43:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40719.162387 secs 2024-04-21T21:43:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40719.162387 secs 2024-04-21T21:43:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:28 smithi077 ceph-mon[27902]: pgmap v21806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:28 smithi191 ceph-mon[31636]: pgmap v21806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:28 smithi170 ceph-mon[31212]: pgmap v21806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40720.916362 secs 2024-04-21T21:43:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40720.916362 secs 2024-04-21T21:43:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40720.916362 secs 2024-04-21T21:43:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:30 smithi077 ceph-mon[27902]: pgmap v21807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:30 smithi191 ceph-mon[31636]: pgmap v21807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:30 smithi170 ceph-mon[31212]: pgmap v21807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:32 smithi191 ceph-mon[31636]: pgmap v21808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:33.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40724.162526 secs 2024-04-21T21:43:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:32 smithi170 ceph-mon[31212]: pgmap v21808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40724.162526 secs 2024-04-21T21:43:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:32 smithi077 ceph-mon[27902]: pgmap v21808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40724.162526 secs 2024-04-21T21:43:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:34 smithi191 ceph-mon[31636]: pgmap v21809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:35.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40725.916490 secs 2024-04-21T21:43:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:34 smithi170 ceph-mon[31212]: pgmap v21809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40725.916490 secs 2024-04-21T21:43:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:34 smithi077 ceph-mon[27902]: pgmap v21809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40725.916490 secs 2024-04-21T21:43:37.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:36 smithi191 ceph-mon[31636]: pgmap v21810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:36 smithi170 ceph-mon[31212]: pgmap v21810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:36 smithi077 ceph-mon[27902]: pgmap v21810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:38.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40729.162639 secs 2024-04-21T21:43:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40729.162639 secs 2024-04-21T21:43:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40729.162639 secs 2024-04-21T21:43:39.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:38 smithi191 ceph-mon[31636]: pgmap v21811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:39.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:38 smithi170 ceph-mon[31212]: pgmap v21811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:38 smithi077 ceph-mon[27902]: pgmap v21811: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40730.916633 secs 2024-04-21T21:43:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40730.916633 secs 2024-04-21T21:43:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40730.916633 secs 2024-04-21T21:43:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:40 smithi170 ceph-mon[31212]: pgmap v21812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:40 smithi077 ceph-mon[27902]: pgmap v21812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:40 smithi191 ceph-mon[31636]: pgmap v21812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:42 smithi170 ceph-mon[31212]: pgmap v21813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40734.162777 secs 2024-04-21T21:43:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:42 smithi077 ceph-mon[27902]: pgmap v21813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40734.162777 secs 2024-04-21T21:43:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:42 smithi191 ceph-mon[31636]: pgmap v21813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40734.162777 secs 2024-04-21T21:43:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:44 smithi170 ceph-mon[31212]: pgmap v21814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:45.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40735.916756 secs 2024-04-21T21:43:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:44 smithi077 ceph-mon[27902]: pgmap v21814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40735.916756 secs 2024-04-21T21:43:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:44 smithi191 ceph-mon[31636]: pgmap v21814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40735.916756 secs 2024-04-21T21:43:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:46 smithi170 ceph-mon[31212]: pgmap v21815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:46 smithi077 ceph-mon[27902]: pgmap v21815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:46 smithi191 ceph-mon[31636]: pgmap v21815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40739.162844 secs 2024-04-21T21:43:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40739.162844 secs 2024-04-21T21:43:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40739.162844 secs 2024-04-21T21:43:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:48 smithi170 ceph-mon[31212]: pgmap v21816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:48 smithi077 ceph-mon[27902]: pgmap v21816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:48 smithi191 ceph-mon[31636]: pgmap v21816: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40740.916884 secs 2024-04-21T21:43:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40740.916884 secs 2024-04-21T21:43:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40740.916884 secs 2024-04-21T21:43:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:50 smithi170 ceph-mon[31212]: pgmap v21817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:50 smithi077 ceph-mon[27902]: pgmap v21817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:50 smithi191 ceph-mon[31636]: pgmap v21817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:53 smithi170 ceph-mon[31212]: pgmap v21818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40744.162902 secs 2024-04-21T21:43:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:53 smithi077 ceph-mon[27902]: pgmap v21818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40744.162902 secs 2024-04-21T21:43:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:53 smithi191 ceph-mon[31636]: pgmap v21818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40744.162902 secs 2024-04-21T21:43:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.466+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T21:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.466+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T21:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.466+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T21:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.467+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T21:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.467+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.467+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T21:43:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.467+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7004a000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7004a000 comp rx=0 tx=0).stop 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 msgr2=0x7efd640a4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640a4e60 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:43:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd7002b070 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T21:43:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:43:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:55 smithi170 ceph-mon[31212]: pgmap v21819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:55.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40745.916975 secs 2024-04-21T21:43:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:55 smithi077 ceph-mon[27902]: pgmap v21819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40745.916975 secs 2024-04-21T21:43:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:55 smithi191 ceph-mon[31636]: pgmap v21819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40745.916975 secs 2024-04-21T21:43:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:57 smithi170 ceph-mon[31212]: pgmap v21820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:57 smithi077 ceph-mon[27902]: pgmap v21820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:57 smithi191 ceph-mon[31636]: pgmap v21820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:43:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40749.163021 secs 2024-04-21T21:43:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40749.163021 secs 2024-04-21T21:43:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40749.163021 secs 2024-04-21T21:43:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:43:59 smithi170 ceph-mon[31212]: pgmap v21821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:43:59 smithi077 ceph-mon[27902]: pgmap v21821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:43:59 smithi191 ceph-mon[31636]: pgmap v21821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:43:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:59.988+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:43:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:59.988+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:43:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:59.989+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:43:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:43:59.989+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:44:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40750.917094 secs 2024-04-21T21:44:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40750.917094 secs 2024-04-21T21:44:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40750.917094 secs 2024-04-21T21:44:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:01 smithi170 ceph-mon[31212]: pgmap v21822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:01 smithi077 ceph-mon[27902]: pgmap v21822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:01 smithi191 ceph-mon[31636]: pgmap v21822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:03 smithi170 ceph-mon[31212]: pgmap v21823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T21:44:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40754.163136 secs 2024-04-21T21:44:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:03 smithi077 ceph-mon[27902]: pgmap v21823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T21:44:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40754.163136 secs 2024-04-21T21:44:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:03 smithi191 ceph-mon[31636]: pgmap v21823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 23 op/s 2024-04-21T21:44:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40754.163136 secs 2024-04-21T21:44:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:05 smithi170 ceph-mon[31212]: pgmap v21824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T21:44:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40755.917238 secs 2024-04-21T21:44:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:05 smithi077 ceph-mon[27902]: pgmap v21824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T21:44:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40755.917238 secs 2024-04-21T21:44:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:05 smithi191 ceph-mon[31636]: pgmap v21824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-21T21:44:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40755.917238 secs 2024-04-21T21:44:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:06 smithi170 ceph-mon[31212]: osdmap e1436: 12 total, 12 up, 12 in 2024-04-21T21:44:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:06 smithi077 ceph-mon[27902]: osdmap e1436: 12 total, 12 up, 12 in 2024-04-21T21:44:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:06 smithi191 ceph-mon[31636]: osdmap e1436: 12 total, 12 up, 12 in 2024-04-21T21:44:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:07 smithi170 ceph-mon[31212]: pgmap v21826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:07 smithi077 ceph-mon[27902]: pgmap v21826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:07 smithi191 ceph-mon[31636]: pgmap v21826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:08.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40759.163288 secs 2024-04-21T21:44:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40759.163288 secs 2024-04-21T21:44:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40759.163288 secs 2024-04-21T21:44:09.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:09 smithi170 ceph-mon[31212]: pgmap v21827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:09 smithi077 ceph-mon[27902]: pgmap v21827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:09 smithi191 ceph-mon[31636]: pgmap v21827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40760.917353 secs 2024-04-21T21:44:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40760.917353 secs 2024-04-21T21:44:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40760.917353 secs 2024-04-21T21:44:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:11 smithi077 ceph-mon[27902]: pgmap v21828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:11 smithi191 ceph-mon[31636]: pgmap v21828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:11 smithi170 ceph-mon[31212]: pgmap v21828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:44:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:13 smithi077 ceph-mon[27902]: pgmap v21829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T21:44:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40764.163429 secs 2024-04-21T21:44:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:13 smithi191 ceph-mon[31636]: pgmap v21829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T21:44:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40764.163429 secs 2024-04-21T21:44:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:13 smithi170 ceph-mon[31212]: pgmap v21829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T21:44:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40764.163429 secs 2024-04-21T21:44:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:15 smithi077 ceph-mon[27902]: pgmap v21830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T21:44:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40765.917425 secs 2024-04-21T21:44:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:15 smithi191 ceph-mon[31636]: pgmap v21830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T21:44:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40765.917425 secs 2024-04-21T21:44:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:15 smithi170 ceph-mon[31212]: pgmap v21830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-21T21:44:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40765.917425 secs 2024-04-21T21:44:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:16 smithi170 ceph-mon[31212]: osdmap e1437: 12 total, 12 up, 12 in 2024-04-21T21:44:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:44:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:16 smithi170 ceph-mon[31212]: pgmap v21832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:44:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:44:16.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:44:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:16 smithi077 ceph-mon[27902]: osdmap e1437: 12 total, 12 up, 12 in 2024-04-21T21:44:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:44:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:16 smithi077 ceph-mon[27902]: pgmap v21832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:44:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:44:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:44:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:16 smithi191 ceph-mon[31636]: osdmap e1437: 12 total, 12 up, 12 in 2024-04-21T21:44:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:44:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:16 smithi191 ceph-mon[31636]: pgmap v21832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:44:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:44:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:44:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40769.163521 secs 2024-04-21T21:44:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40769.163521 secs 2024-04-21T21:44:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40769.163521 secs 2024-04-21T21:44:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:18 smithi191 ceph-mon[31636]: pgmap v21833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:18 smithi077 ceph-mon[27902]: pgmap v21833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:18 smithi170 ceph-mon[31212]: pgmap v21833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40770.917559 secs 2024-04-21T21:44:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40770.917559 secs 2024-04-21T21:44:20.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40770.917559 secs 2024-04-21T21:44:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:20 smithi077 ceph-mon[27902]: pgmap v21834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:20 smithi191 ceph-mon[31636]: pgmap v21834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:20 smithi170 ceph-mon[31212]: pgmap v21834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:44:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:22 smithi170 ceph-mon[31212]: pgmap v21835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:44:23.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40774.163634 secs 2024-04-21T21:44:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:22 smithi077 ceph-mon[27902]: pgmap v21835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:44:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40774.163634 secs 2024-04-21T21:44:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:22 smithi191 ceph-mon[31636]: pgmap v21835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:44:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40774.163634 secs 2024-04-21T21:44:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:24 smithi170 ceph-mon[31212]: pgmap v21836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:44:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40775.917677 secs 2024-04-21T21:44:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:24 smithi077 ceph-mon[27902]: pgmap v21836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:44:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40775.917677 secs 2024-04-21T21:44:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:24 smithi191 ceph-mon[31636]: pgmap v21836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-21T21:44:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40775.917677 secs 2024-04-21T21:44:26.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:26 smithi170 ceph-mon[31212]: pgmap v21837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:44:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:26 smithi077 ceph-mon[27902]: pgmap v21837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:44:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:26 smithi191 ceph-mon[31636]: pgmap v21837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:44:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40779.163788 secs 2024-04-21T21:44:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40779.163788 secs 2024-04-21T21:44:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40779.163788 secs 2024-04-21T21:44:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:28 smithi077 ceph-mon[27902]: pgmap v21838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:28 smithi191 ceph-mon[31636]: pgmap v21838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:29.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:28 smithi170 ceph-mon[31212]: pgmap v21838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40780.917814 secs 2024-04-21T21:44:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40780.917814 secs 2024-04-21T21:44:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40780.917814 secs 2024-04-21T21:44:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:30 smithi077 ceph-mon[27902]: pgmap v21839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:30 smithi191 ceph-mon[31636]: pgmap v21839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:30 smithi170 ceph-mon[31212]: pgmap v21839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:32 smithi170 ceph-mon[31212]: pgmap v21840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:32 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40784.163907 secs 2024-04-21T21:44:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:32 smithi077 ceph-mon[27902]: pgmap v21840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:32 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40784.163907 secs 2024-04-21T21:44:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:32 smithi191 ceph-mon[31636]: pgmap v21840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:32 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40784.163907 secs 2024-04-21T21:44:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:34 smithi170 ceph-mon[31212]: pgmap v21841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:34 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40785.917956 secs 2024-04-21T21:44:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:34 smithi077 ceph-mon[27902]: pgmap v21841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:34 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40785.917956 secs 2024-04-21T21:44:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:34 smithi191 ceph-mon[31636]: pgmap v21841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:34 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40785.917956 secs 2024-04-21T21:44:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:36 smithi170 ceph-mon[31212]: pgmap v21842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:36 smithi077 ceph-mon[27902]: pgmap v21842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:36 smithi191 ceph-mon[31636]: pgmap v21842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:37 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40789.164034 secs 2024-04-21T21:44:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:37 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40789.164034 secs 2024-04-21T21:44:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:37 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40789.164034 secs 2024-04-21T21:44:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:38 smithi170 ceph-mon[31212]: pgmap v21843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:38 smithi077 ceph-mon[27902]: pgmap v21843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:38 smithi191 ceph-mon[31636]: pgmap v21843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:40.309 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:39 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40790.918079 secs 2024-04-21T21:44:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:39 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40790.918079 secs 2024-04-21T21:44:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:39 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40790.918079 secs 2024-04-21T21:44:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:40 smithi170 ceph-mon[31212]: pgmap v21844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:40 smithi077 ceph-mon[27902]: pgmap v21844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:40 smithi191 ceph-mon[31636]: pgmap v21844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:42 smithi170 ceph-mon[31212]: pgmap v21845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:42 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40794.164131 secs 2024-04-21T21:44:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:42 smithi077 ceph-mon[27902]: pgmap v21845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:42 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40794.164131 secs 2024-04-21T21:44:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:42 smithi191 ceph-mon[31636]: pgmap v21845: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:42 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40794.164131 secs 2024-04-21T21:44:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:45 smithi170 ceph-mon[31212]: pgmap v21846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:45.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40795.918194 secs 2024-04-21T21:44:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:45 smithi077 ceph-mon[27902]: pgmap v21846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40795.918194 secs 2024-04-21T21:44:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:45 smithi191 ceph-mon[31636]: pgmap v21846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:44:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40795.918194 secs 2024-04-21T21:44:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:47 smithi170 ceph-mon[31212]: pgmap v21847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:47 smithi077 ceph-mon[27902]: pgmap v21847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:47.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:47 smithi191 ceph-mon[31636]: pgmap v21847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40799.164196 secs 2024-04-21T21:44:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40799.164196 secs 2024-04-21T21:44:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40799.164196 secs 2024-04-21T21:44:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:49 smithi170 ceph-mon[31212]: pgmap v21848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:49 smithi077 ceph-mon[27902]: pgmap v21848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:49 smithi191 ceph-mon[31636]: pgmap v21848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40800.918293 secs 2024-04-21T21:44:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40800.918293 secs 2024-04-21T21:44:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40800.918293 secs 2024-04-21T21:44:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:51 smithi170 ceph-mon[31212]: pgmap v21849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:51 smithi077 ceph-mon[27902]: pgmap v21849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:51 smithi191 ceph-mon[31636]: pgmap v21849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:53 smithi170 ceph-mon[31212]: pgmap v21850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40804.164338 secs 2024-04-21T21:44:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:53 smithi077 ceph-mon[27902]: pgmap v21850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:53.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40804.164338 secs 2024-04-21T21:44:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:53 smithi191 ceph-mon[31636]: pgmap v21850: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40804.164338 secs 2024-04-21T21:44:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:44:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:55 smithi170 ceph-mon[31212]: pgmap v21851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:55.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40805.918440 secs 2024-04-21T21:44:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:55 smithi077 ceph-mon[27902]: pgmap v21851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:55.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40805.918440 secs 2024-04-21T21:44:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:55 smithi191 ceph-mon[31636]: pgmap v21851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40805.918440 secs 2024-04-21T21:44:57.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:57 smithi170 ceph-mon[31212]: pgmap v21852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:57 smithi077 ceph-mon[27902]: pgmap v21852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:57 smithi191 ceph-mon[31636]: pgmap v21852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:44:58.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40809.164452 secs 2024-04-21T21:44:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40809.164452 secs 2024-04-21T21:44:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40809.164452 secs 2024-04-21T21:44:59.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:44:59 smithi170 ceph-mon[31212]: pgmap v21853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:44:59 smithi077 ceph-mon[27902]: pgmap v21853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:44:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:44:59 smithi191 ceph-mon[31636]: pgmap v21853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 40995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:00.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40810.918520 secs 2024-04-21T21:45:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40810.918520 secs 2024-04-21T21:45:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40810.918520 secs 2024-04-21T21:45:01.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:01 smithi170 ceph-mon[31212]: pgmap v21854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:01 smithi077 ceph-mon[27902]: pgmap v21854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:01 smithi191 ceph-mon[31636]: pgmap v21854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:03 smithi170 ceph-mon[31212]: pgmap v21855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40814.164561 secs 2024-04-21T21:45:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:03 smithi077 ceph-mon[27902]: pgmap v21855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T21:45:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40814.164561 secs 2024-04-21T21:45:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:03 smithi191 ceph-mon[31636]: pgmap v21855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T21:45:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40814.164561 secs 2024-04-21T21:45:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:05 smithi170 ceph-mon[31212]: pgmap v21856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T21:45:05.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40815.918584 secs 2024-04-21T21:45:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:05 smithi077 ceph-mon[27902]: pgmap v21856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T21:45:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40815.918584 secs 2024-04-21T21:45:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:05 smithi191 ceph-mon[31636]: pgmap v21856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T21:45:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40815.918584 secs 2024-04-21T21:45:06.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:06 smithi170 ceph-mon[31212]: osdmap e1438: 12 total, 12 up, 12 in 2024-04-21T21:45:06.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:06 smithi077 ceph-mon[27902]: osdmap e1438: 12 total, 12 up, 12 in 2024-04-21T21:45:06.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:06 smithi191 ceph-mon[31636]: osdmap e1438: 12 total, 12 up, 12 in 2024-04-21T21:45:07.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:07 smithi170 ceph-mon[31212]: pgmap v21858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:07 smithi077 ceph-mon[27902]: pgmap v21858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:07 smithi191 ceph-mon[31636]: pgmap v21858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40819.164699 secs 2024-04-21T21:45:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40819.164699 secs 2024-04-21T21:45:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40819.164699 secs 2024-04-21T21:45:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:09 smithi077 ceph-mon[27902]: pgmap v21859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:09 smithi191 ceph-mon[31636]: pgmap v21859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:09 smithi170 ceph-mon[31212]: pgmap v21859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40820.918721 secs 2024-04-21T21:45:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40820.918721 secs 2024-04-21T21:45:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40820.918721 secs 2024-04-21T21:45:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:11 smithi077 ceph-mon[27902]: pgmap v21860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:11 smithi191 ceph-mon[31636]: pgmap v21860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:11 smithi170 ceph-mon[31212]: pgmap v21860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:45:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:13 smithi077 ceph-mon[27902]: pgmap v21861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T21:45:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40824.164839 secs 2024-04-21T21:45:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:13 smithi191 ceph-mon[31636]: pgmap v21861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T21:45:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40824.164839 secs 2024-04-21T21:45:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:13 smithi170 ceph-mon[31212]: pgmap v21861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T21:45:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40824.164839 secs 2024-04-21T21:45:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:15 smithi077 ceph-mon[27902]: pgmap v21862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T21:45:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40825.918876 secs 2024-04-21T21:45:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:15 smithi191 ceph-mon[31636]: pgmap v21862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T21:45:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40825.918876 secs 2024-04-21T21:45:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:15 smithi170 ceph-mon[31212]: pgmap v21862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-04-21T21:45:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40825.918876 secs 2024-04-21T21:45:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:16 smithi170 ceph-mon[31212]: osdmap e1439: 12 total, 12 up, 12 in 2024-04-21T21:45:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:16 smithi170 ceph-mon[31212]: pgmap v21864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:16 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:45:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:16 smithi077 ceph-mon[27902]: osdmap e1439: 12 total, 12 up, 12 in 2024-04-21T21:45:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:16 smithi077 ceph-mon[27902]: pgmap v21864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:16 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:45:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:16 smithi191 ceph-mon[31636]: osdmap e1439: 12 total, 12 up, 12 in 2024-04-21T21:45:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:16 smithi191 ceph-mon[31636]: pgmap v21864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:16.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:16 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:45:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:45:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:45:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:17 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:45:17.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40829.164905 secs 2024-04-21T21:45:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:45:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:45:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:17 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:45:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40829.164905 secs 2024-04-21T21:45:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:45:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:45:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:17 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:45:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40829.164905 secs 2024-04-21T21:45:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:18 smithi170 ceph-mon[31212]: pgmap v21865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:18.870 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:18 smithi191 ceph-mon[31636]: pgmap v21865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:18 smithi077 ceph-mon[27902]: pgmap v21865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40830.918978 secs 2024-04-21T21:45:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40830.918978 secs 2024-04-21T21:45:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40830.918978 secs 2024-04-21T21:45:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:20 smithi170 ceph-mon[31212]: pgmap v21866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:20.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:20 smithi077 ceph-mon[27902]: pgmap v21866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:20 smithi191 ceph-mon[31636]: pgmap v21866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:45:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:22 smithi170 ceph-mon[31212]: pgmap v21867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:23.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40834.165030 secs 2024-04-21T21:45:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:22 smithi077 ceph-mon[27902]: pgmap v21867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40834.165030 secs 2024-04-21T21:45:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:22 smithi191 ceph-mon[31636]: pgmap v21867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40834.165030 secs 2024-04-21T21:45:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:24 smithi170 ceph-mon[31212]: pgmap v21868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:24 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40835.919134 secs 2024-04-21T21:45:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:24 smithi077 ceph-mon[27902]: pgmap v21868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:24 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40835.919134 secs 2024-04-21T21:45:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:24 smithi191 ceph-mon[31636]: pgmap v21868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:24 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40835.919134 secs 2024-04-21T21:45:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:26 smithi170 ceph-mon[31212]: pgmap v21869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:26 smithi077 ceph-mon[27902]: pgmap v21869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:26 smithi191 ceph-mon[31636]: pgmap v21869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-21T21:45:28.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40839.165142 secs 2024-04-21T21:45:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40839.165142 secs 2024-04-21T21:45:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40839.165142 secs 2024-04-21T21:45:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:29 smithi170 ceph-mon[31212]: pgmap v21870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:29 smithi077 ceph-mon[27902]: pgmap v21870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:29.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:29 smithi191 ceph-mon[31636]: pgmap v21870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:45:30.001+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:45:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:45:30.001+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:45:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:45:30.004+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:45:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:45:30.004+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:45:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40840.919249 secs 2024-04-21T21:45:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40840.919249 secs 2024-04-21T21:45:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40840.919249 secs 2024-04-21T21:45:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:31 smithi170 ceph-mon[31212]: pgmap v21871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:31 smithi077 ceph-mon[27902]: pgmap v21871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:31 smithi191 ceph-mon[31636]: pgmap v21871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:33 smithi170 ceph-mon[31212]: pgmap v21872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40844.165205 secs 2024-04-21T21:45:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:33 smithi077 ceph-mon[27902]: pgmap v21872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40844.165205 secs 2024-04-21T21:45:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:33 smithi191 ceph-mon[31636]: pgmap v21872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40844.165205 secs 2024-04-21T21:45:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:35 smithi170 ceph-mon[31212]: pgmap v21873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40845.919316 secs 2024-04-21T21:45:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:35 smithi077 ceph-mon[27902]: pgmap v21873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40845.919316 secs 2024-04-21T21:45:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:35 smithi191 ceph-mon[31636]: pgmap v21873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40845.919316 secs 2024-04-21T21:45:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:37 smithi170 ceph-mon[31212]: pgmap v21874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:37 smithi077 ceph-mon[27902]: pgmap v21874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:37 smithi191 ceph-mon[31636]: pgmap v21874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40849.165344 secs 2024-04-21T21:45:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40849.165344 secs 2024-04-21T21:45:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40849.165344 secs 2024-04-21T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:39 smithi170 ceph-mon[31212]: pgmap v21875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:39 smithi077 ceph-mon[27902]: pgmap v21875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:39 smithi191 ceph-mon[31636]: pgmap v21875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40850.919385 secs 2024-04-21T21:45:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40850.919385 secs 2024-04-21T21:45:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40850.919385 secs 2024-04-21T21:45:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:41 smithi170 ceph-mon[31212]: pgmap v21876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:41 smithi077 ceph-mon[27902]: pgmap v21876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:41 smithi191 ceph-mon[31636]: pgmap v21876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:43 smithi170 ceph-mon[31212]: pgmap v21877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40854.165476 secs 2024-04-21T21:45:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:43 smithi077 ceph-mon[27902]: pgmap v21877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40854.165476 secs 2024-04-21T21:45:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:43 smithi191 ceph-mon[31636]: pgmap v21877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40854.165476 secs 2024-04-21T21:45:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:45 smithi170 ceph-mon[31212]: pgmap v21878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:45.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40855.919514 secs 2024-04-21T21:45:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:45 smithi077 ceph-mon[27902]: pgmap v21878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40855.919514 secs 2024-04-21T21:45:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:45 smithi191 ceph-mon[31636]: pgmap v21878: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40855.919514 secs 2024-04-21T21:45:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:47 smithi170 ceph-mon[31212]: pgmap v21879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:47 smithi077 ceph-mon[27902]: pgmap v21879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:47 smithi191 ceph-mon[31636]: pgmap v21879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:48.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40859.165607 secs 2024-04-21T21:45:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40859.165607 secs 2024-04-21T21:45:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40859.165607 secs 2024-04-21T21:45:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:49 smithi170 ceph-mon[31212]: pgmap v21880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:49 smithi077 ceph-mon[27902]: pgmap v21880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:49 smithi191 ceph-mon[31636]: pgmap v21880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40860.919579 secs 2024-04-21T21:45:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40860.919579 secs 2024-04-21T21:45:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40860.919579 secs 2024-04-21T21:45:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:51 smithi077 ceph-mon[27902]: pgmap v21881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:51 smithi191 ceph-mon[31636]: pgmap v21881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:51 smithi170 ceph-mon[31212]: pgmap v21881: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:53 smithi077 ceph-mon[27902]: pgmap v21882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40864.165718 secs 2024-04-21T21:45:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:53 smithi191 ceph-mon[31636]: pgmap v21882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40864.165718 secs 2024-04-21T21:45:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:53 smithi170 ceph-mon[31212]: pgmap v21882: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40864.165718 secs 2024-04-21T21:45:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:45:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:55 smithi077 ceph-mon[27902]: pgmap v21883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40865.919681 secs 2024-04-21T21:45:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:55 smithi191 ceph-mon[31636]: pgmap v21883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40865.919681 secs 2024-04-21T21:45:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:55 smithi170 ceph-mon[31212]: pgmap v21883: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40865.919681 secs 2024-04-21T21:45:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:57 smithi077 ceph-mon[27902]: pgmap v21884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:57 smithi191 ceph-mon[31636]: pgmap v21884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:57 smithi170 ceph-mon[31212]: pgmap v21884: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:45:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40869.165868 secs 2024-04-21T21:45:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40869.165868 secs 2024-04-21T21:45:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40869.165868 secs 2024-04-21T21:45:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:45:59 smithi077 ceph-mon[27902]: pgmap v21885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:45:59 smithi191 ceph-mon[31636]: pgmap v21885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:45:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:45:59 smithi170 ceph-mon[31212]: pgmap v21885: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40870.919793 secs 2024-04-21T21:46:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40870.919793 secs 2024-04-21T21:46:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40870.919793 secs 2024-04-21T21:46:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:01 smithi077 ceph-mon[27902]: pgmap v21886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:01 smithi191 ceph-mon[31636]: pgmap v21886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:01 smithi170 ceph-mon[31212]: pgmap v21886: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:03 smithi077 ceph-mon[27902]: pgmap v21887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40874.165975 secs 2024-04-21T21:46:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:03 smithi191 ceph-mon[31636]: pgmap v21887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40874.165975 secs 2024-04-21T21:46:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:03 smithi170 ceph-mon[31212]: pgmap v21887: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40874.165975 secs 2024-04-21T21:46:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:05 smithi077 ceph-mon[27902]: pgmap v21888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40875.919905 secs 2024-04-21T21:46:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:05 smithi077 ceph-mon[27902]: osdmap e1440: 12 total, 12 up, 12 in 2024-04-21T21:46:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:05 smithi191 ceph-mon[31636]: pgmap v21888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40875.919905 secs 2024-04-21T21:46:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:05 smithi191 ceph-mon[31636]: osdmap e1440: 12 total, 12 up, 12 in 2024-04-21T21:46:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:05 smithi170 ceph-mon[31212]: pgmap v21888: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40875.919905 secs 2024-04-21T21:46:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:05 smithi170 ceph-mon[31212]: osdmap e1440: 12 total, 12 up, 12 in 2024-04-21T21:46:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:07 smithi077 ceph-mon[27902]: pgmap v21890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:07 smithi191 ceph-mon[31636]: pgmap v21890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:07.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:07 smithi170 ceph-mon[31212]: pgmap v21890: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40879.166111 secs 2024-04-21T21:46:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40879.166111 secs 2024-04-21T21:46:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40879.166111 secs 2024-04-21T21:46:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:09 smithi077 ceph-mon[27902]: pgmap v21891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:09 smithi191 ceph-mon[31636]: pgmap v21891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:09 smithi170 ceph-mon[31212]: pgmap v21891: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40880.920001 secs 2024-04-21T21:46:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40880.920001 secs 2024-04-21T21:46:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40880.920001 secs 2024-04-21T21:46:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:11 smithi077 ceph-mon[27902]: pgmap v21892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:11 smithi077 ceph-mon[27902]: osdmap e1441: 12 total, 12 up, 12 in 2024-04-21T21:46:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:11 smithi191 ceph-mon[31636]: pgmap v21892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:11 smithi191 ceph-mon[31636]: osdmap e1441: 12 total, 12 up, 12 in 2024-04-21T21:46:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:11 smithi170 ceph-mon[31212]: pgmap v21892: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:46:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:11 smithi170 ceph-mon[31212]: osdmap e1441: 12 total, 12 up, 12 in 2024-04-21T21:46:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:13 smithi077 ceph-mon[27902]: pgmap v21894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:46:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40884.166218 secs 2024-04-21T21:46:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:13 smithi191 ceph-mon[31636]: pgmap v21894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:46:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40884.166218 secs 2024-04-21T21:46:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:13 smithi170 ceph-mon[31212]: pgmap v21894: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:46:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40884.166218 secs 2024-04-21T21:46:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:15 smithi077 ceph-mon[27902]: pgmap v21895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:46:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40885.920125 secs 2024-04-21T21:46:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:15 smithi191 ceph-mon[31636]: pgmap v21895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:46:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40885.920125 secs 2024-04-21T21:46:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:15 smithi170 ceph-mon[31212]: pgmap v21895: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:46:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40885.920125 secs 2024-04-21T21:46:17.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:17 smithi077 ceph-mon[27902]: pgmap v21896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:17 smithi191 ceph-mon[31636]: pgmap v21896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:17 smithi170 ceph-mon[31212]: pgmap v21896: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:18.271 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:18 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:46:18.271 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40889.166321 secs 2024-04-21T21:46:18.271 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:18 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:46:18.272 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40889.166321 secs 2024-04-21T21:46:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:18 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:46:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40889.166321 secs 2024-04-21T21:46:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: pgmap v21897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:19 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: pgmap v21897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:19 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: pgmap v21897: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:19.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:19 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40890.920222 secs 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:46:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:46:20.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40890.920222 secs 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:46:20.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40890.920222 secs 2024-04-21T21:46:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:46:20.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:46:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:46:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:46:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:46:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:46:21.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:46:21.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:46:21.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:21 smithi191 ceph-mon[31636]: pgmap v21898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:46:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:46:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:46:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:46:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:46:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:46:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:21 smithi170 ceph-mon[31212]: pgmap v21898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:46:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:21 smithi077 ceph-mon[27902]: pgmap v21898: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:46:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:23 smithi191 ceph-mon[31636]: pgmap v21899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:46:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40894.166462 secs 2024-04-21T21:46:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:23 smithi170 ceph-mon[31212]: pgmap v21899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:46:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40894.166462 secs 2024-04-21T21:46:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:23 smithi077 ceph-mon[27902]: pgmap v21899: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:46:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40894.166462 secs 2024-04-21T21:46:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:25 smithi191 ceph-mon[31636]: pgmap v21900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40895.920339 secs 2024-04-21T21:46:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:25 smithi170 ceph-mon[31212]: pgmap v21900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:25.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40895.920339 secs 2024-04-21T21:46:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:25 smithi077 ceph-mon[27902]: pgmap v21900: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40895.920339 secs 2024-04-21T21:46:26.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:26 smithi170 ceph-mon[31212]: pgmap v21901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:26 smithi077 ceph-mon[27902]: pgmap v21901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:26 smithi191 ceph-mon[31636]: pgmap v21901: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40899.166616 secs 2024-04-21T21:46:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40899.166616 secs 2024-04-21T21:46:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40899.166616 secs 2024-04-21T21:46:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:28 smithi170 ceph-mon[31212]: pgmap v21902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:28 smithi077 ceph-mon[27902]: pgmap v21902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:28 smithi191 ceph-mon[31636]: pgmap v21902: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40900.920432 secs 2024-04-21T21:46:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40900.920432 secs 2024-04-21T21:46:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40900.920432 secs 2024-04-21T21:46:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:30 smithi077 ceph-mon[27902]: pgmap v21903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:30 smithi191 ceph-mon[31636]: pgmap v21903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:30 smithi170 ceph-mon[31212]: pgmap v21903: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:33 smithi170 ceph-mon[31212]: pgmap v21904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40904.166757 secs 2024-04-21T21:46:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:33 smithi077 ceph-mon[27902]: pgmap v21904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40904.166757 secs 2024-04-21T21:46:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:33 smithi191 ceph-mon[31636]: pgmap v21904: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40904.166757 secs 2024-04-21T21:46:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:35 smithi170 ceph-mon[31212]: pgmap v21905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40905.920546 secs 2024-04-21T21:46:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:35 smithi077 ceph-mon[27902]: pgmap v21905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40905.920546 secs 2024-04-21T21:46:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:35 smithi191 ceph-mon[31636]: pgmap v21905: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:35.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40905.920546 secs 2024-04-21T21:46:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:37 smithi170 ceph-mon[31212]: pgmap v21906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:37 smithi077 ceph-mon[27902]: pgmap v21906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:37 smithi191 ceph-mon[31636]: pgmap v21906: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:38.288 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40909.166887 secs 2024-04-21T21:46:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40909.166887 secs 2024-04-21T21:46:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40909.166887 secs 2024-04-21T21:46:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:39 smithi170 ceph-mon[31212]: pgmap v21907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:39 smithi077 ceph-mon[27902]: pgmap v21907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:39 smithi191 ceph-mon[31636]: pgmap v21907: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40910.920665 secs 2024-04-21T21:46:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40910.920665 secs 2024-04-21T21:46:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40910.920665 secs 2024-04-21T21:46:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:41 smithi170 ceph-mon[31212]: pgmap v21908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:41 smithi077 ceph-mon[27902]: pgmap v21908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:41 smithi191 ceph-mon[31636]: pgmap v21908: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:43.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:43 smithi170 ceph-mon[31212]: pgmap v21909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40914.166982 secs 2024-04-21T21:46:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:43 smithi077 ceph-mon[27902]: pgmap v21909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40914.166982 secs 2024-04-21T21:46:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:43 smithi191 ceph-mon[31636]: pgmap v21909: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40914.166982 secs 2024-04-21T21:46:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:45 smithi170 ceph-mon[31212]: pgmap v21910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40915.920774 secs 2024-04-21T21:46:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:45 smithi077 ceph-mon[27902]: pgmap v21910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:45.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40915.920774 secs 2024-04-21T21:46:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:45 smithi191 ceph-mon[31636]: pgmap v21910: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40915.920774 secs 2024-04-21T21:46:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:47 smithi170 ceph-mon[31212]: pgmap v21911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:47 smithi077 ceph-mon[27902]: pgmap v21911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:47 smithi191 ceph-mon[31636]: pgmap v21911: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:48.300 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40919.167077 secs 2024-04-21T21:46:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40919.167077 secs 2024-04-21T21:46:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40919.167077 secs 2024-04-21T21:46:49.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:49 smithi170 ceph-mon[31212]: pgmap v21912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:49.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:49 smithi077 ceph-mon[27902]: pgmap v21912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:49 smithi191 ceph-mon[31636]: pgmap v21912: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:50.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40920.920895 secs 2024-04-21T21:46:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40920.920895 secs 2024-04-21T21:46:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40920.920895 secs 2024-04-21T21:46:51.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:51 smithi170 ceph-mon[31212]: pgmap v21913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:51 smithi077 ceph-mon[27902]: pgmap v21913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:51 smithi191 ceph-mon[31636]: pgmap v21913: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:53.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:53 smithi170 ceph-mon[31212]: pgmap v21914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:53.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40924.167195 secs 2024-04-21T21:46:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:53 smithi077 ceph-mon[27902]: pgmap v21914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40924.167195 secs 2024-04-21T21:46:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:53 smithi191 ceph-mon[31636]: pgmap v21914: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40924.167195 secs 2024-04-21T21:46:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:46:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:55 smithi077 ceph-mon[27902]: pgmap v21915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40925.921057 secs 2024-04-21T21:46:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:55 smithi191 ceph-mon[31636]: pgmap v21915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40925.921057 secs 2024-04-21T21:46:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:55 smithi170 ceph-mon[31212]: pgmap v21915: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40925.921057 secs 2024-04-21T21:46:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:57 smithi077 ceph-mon[27902]: pgmap v21916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:57 smithi191 ceph-mon[31636]: pgmap v21916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:57 smithi170 ceph-mon[31212]: pgmap v21916: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:46:58.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40929.167252 secs 2024-04-21T21:46:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40929.167252 secs 2024-04-21T21:46:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40929.167252 secs 2024-04-21T21:46:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:46:59 smithi077 ceph-mon[27902]: pgmap v21917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:46:59 smithi191 ceph-mon[31636]: pgmap v21917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:46:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:46:59 smithi170 ceph-mon[31212]: pgmap v21917: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:47:00.014+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:47:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:47:00.014+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:47:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:47:00.014+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 313 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:47:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:47:00.014+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 313 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:47:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40930.921179 secs 2024-04-21T21:47:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40930.921179 secs 2024-04-21T21:47:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40930.921179 secs 2024-04-21T21:47:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:01 smithi077 ceph-mon[27902]: pgmap v21918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:01 smithi191 ceph-mon[31636]: pgmap v21918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:01 smithi170 ceph-mon[31212]: pgmap v21918: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:03 smithi077 ceph-mon[27902]: pgmap v21919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40934.167368 secs 2024-04-21T21:47:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:03 smithi191 ceph-mon[31636]: pgmap v21919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40934.167368 secs 2024-04-21T21:47:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:03 smithi170 ceph-mon[31212]: pgmap v21919: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40934.167368 secs 2024-04-21T21:47:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:05 smithi077 ceph-mon[27902]: pgmap v21920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40935.921282 secs 2024-04-21T21:47:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:05 smithi077 ceph-mon[27902]: osdmap e1442: 12 total, 12 up, 12 in 2024-04-21T21:47:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:05 smithi191 ceph-mon[31636]: pgmap v21920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40935.921282 secs 2024-04-21T21:47:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:05 smithi191 ceph-mon[31636]: osdmap e1442: 12 total, 12 up, 12 in 2024-04-21T21:47:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:05 smithi170 ceph-mon[31212]: pgmap v21920: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40935.921282 secs 2024-04-21T21:47:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:05 smithi170 ceph-mon[31212]: osdmap e1442: 12 total, 12 up, 12 in 2024-04-21T21:47:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:07 smithi077 ceph-mon[27902]: pgmap v21922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:07 smithi191 ceph-mon[31636]: pgmap v21922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:07.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:07 smithi170 ceph-mon[31212]: pgmap v21922: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40939.167489 secs 2024-04-21T21:47:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40939.167489 secs 2024-04-21T21:47:08.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40939.167489 secs 2024-04-21T21:47:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:09 smithi077 ceph-mon[27902]: pgmap v21923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:09 smithi191 ceph-mon[31636]: pgmap v21923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:09.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:09 smithi170 ceph-mon[31212]: pgmap v21923: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40940.921410 secs 2024-04-21T21:47:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40940.921410 secs 2024-04-21T21:47:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40940.921410 secs 2024-04-21T21:47:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:11 smithi077 ceph-mon[27902]: pgmap v21924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:11 smithi077 ceph-mon[27902]: osdmap e1443: 12 total, 12 up, 12 in 2024-04-21T21:47:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:11 smithi191 ceph-mon[31636]: pgmap v21924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:11 smithi191 ceph-mon[31636]: osdmap e1443: 12 total, 12 up, 12 in 2024-04-21T21:47:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:11 smithi170 ceph-mon[31212]: pgmap v21924: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:47:11.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:11 smithi170 ceph-mon[31212]: osdmap e1443: 12 total, 12 up, 12 in 2024-04-21T21:47:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:13 smithi077 ceph-mon[27902]: pgmap v21926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:47:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40944.167600 secs 2024-04-21T21:47:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:13 smithi191 ceph-mon[31636]: pgmap v21926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:47:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40944.167600 secs 2024-04-21T21:47:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:13 smithi170 ceph-mon[31212]: pgmap v21926: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:47:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40944.167600 secs 2024-04-21T21:47:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:15 smithi077 ceph-mon[27902]: pgmap v21927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:47:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40945.921554 secs 2024-04-21T21:47:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:15 smithi191 ceph-mon[31636]: pgmap v21927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:47:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40945.921554 secs 2024-04-21T21:47:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:15 smithi170 ceph-mon[31212]: pgmap v21927: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:47:15.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40945.921554 secs 2024-04-21T21:47:17.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:17 smithi077 ceph-mon[27902]: pgmap v21928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:17 smithi191 ceph-mon[31636]: pgmap v21928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:17 smithi170 ceph-mon[31212]: pgmap v21928: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:18.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40949.167677 secs 2024-04-21T21:47:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40949.167677 secs 2024-04-21T21:47:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40949.167677 secs 2024-04-21T21:47:19.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:19 smithi077 ceph-mon[27902]: pgmap v21929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:19 smithi191 ceph-mon[31636]: pgmap v21929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:19 smithi170 ceph-mon[31212]: pgmap v21929: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40950.921676 secs 2024-04-21T21:47:20.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:20 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:47:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40950.921676 secs 2024-04-21T21:47:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:20 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:47:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40950.921676 secs 2024-04-21T21:47:20.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:20 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:47:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:21 smithi191 ceph-mon[31636]: pgmap v21930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:47:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:47:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:21 smithi170 ceph-mon[31212]: pgmap v21930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:47:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:47:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:21 smithi077 ceph-mon[27902]: pgmap v21930: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:47:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:47:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:47:21.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:47:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:23 smithi191 ceph-mon[31636]: pgmap v21931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:47:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40954.167789 secs 2024-04-21T21:47:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:23 smithi170 ceph-mon[31212]: pgmap v21931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:47:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40954.167789 secs 2024-04-21T21:47:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:23 smithi077 ceph-mon[27902]: pgmap v21931: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:47:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40954.167789 secs 2024-04-21T21:47:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:25 smithi191 ceph-mon[31636]: pgmap v21932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40955.921811 secs 2024-04-21T21:47:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:25 smithi170 ceph-mon[31212]: pgmap v21932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40955.921811 secs 2024-04-21T21:47:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:25 smithi077 ceph-mon[27902]: pgmap v21932: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40955.921811 secs 2024-04-21T21:47:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:26 smithi077 ceph-mon[27902]: pgmap v21933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:26 smithi191 ceph-mon[31636]: pgmap v21933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:27.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:26 smithi170 ceph-mon[31212]: pgmap v21933: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40959.167884 secs 2024-04-21T21:47:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40959.167884 secs 2024-04-21T21:47:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40959.167884 secs 2024-04-21T21:47:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:28 smithi077 ceph-mon[27902]: pgmap v21934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:28 smithi191 ceph-mon[31636]: pgmap v21934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:28 smithi170 ceph-mon[31212]: pgmap v21934: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40960.921922 secs 2024-04-21T21:47:29.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40960.921922 secs 2024-04-21T21:47:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40960.921922 secs 2024-04-21T21:47:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:30 smithi077 ceph-mon[27902]: pgmap v21935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:30 smithi191 ceph-mon[31636]: pgmap v21935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:30 smithi170 ceph-mon[31212]: pgmap v21935: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:33.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:33 smithi170 ceph-mon[31212]: pgmap v21936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:33.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40964.167991 secs 2024-04-21T21:47:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:33 smithi077 ceph-mon[27902]: pgmap v21936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40964.167991 secs 2024-04-21T21:47:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:33 smithi191 ceph-mon[31636]: pgmap v21936: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40964.167991 secs 2024-04-21T21:47:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:35.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:35 smithi170 ceph-mon[31212]: pgmap v21937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:35.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40965.922044 secs 2024-04-21T21:47:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:35 smithi077 ceph-mon[27902]: pgmap v21937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40965.922044 secs 2024-04-21T21:47:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:35 smithi191 ceph-mon[31636]: pgmap v21937: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40965.922044 secs 2024-04-21T21:47:37.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:37 smithi170 ceph-mon[31212]: pgmap v21938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:37 smithi077 ceph-mon[27902]: pgmap v21938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:37 smithi191 ceph-mon[31636]: pgmap v21938: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:38.287 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40969.168105 secs 2024-04-21T21:47:38.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40969.168105 secs 2024-04-21T21:47:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40969.168105 secs 2024-04-21T21:47:39.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:39 smithi170 ceph-mon[31212]: pgmap v21939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:39 smithi077 ceph-mon[27902]: pgmap v21939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:39 smithi191 ceph-mon[31636]: pgmap v21939: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:40.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40970.922135 secs 2024-04-21T21:47:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40970.922135 secs 2024-04-21T21:47:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40970.922135 secs 2024-04-21T21:47:41.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:41 smithi170 ceph-mon[31212]: pgmap v21940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:41 smithi077 ceph-mon[27902]: pgmap v21940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:41 smithi191 ceph-mon[31636]: pgmap v21940: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:43 smithi170 ceph-mon[31212]: pgmap v21941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:43.308 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40974.168214 secs 2024-04-21T21:47:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:43 smithi077 ceph-mon[27902]: pgmap v21941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40974.168214 secs 2024-04-21T21:47:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:43 smithi191 ceph-mon[31636]: pgmap v21941: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40974.168214 secs 2024-04-21T21:47:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:45 smithi170 ceph-mon[31212]: pgmap v21942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:45.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40975.922234 secs 2024-04-21T21:47:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:45 smithi077 ceph-mon[27902]: pgmap v21942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40975.922234 secs 2024-04-21T21:47:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:45 smithi191 ceph-mon[31636]: pgmap v21942: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:45.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40975.922234 secs 2024-04-21T21:47:47.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:47 smithi170 ceph-mon[31212]: pgmap v21943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:47 smithi077 ceph-mon[27902]: pgmap v21943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:47 smithi191 ceph-mon[31636]: pgmap v21943: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40979.168337 secs 2024-04-21T21:47:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40979.168337 secs 2024-04-21T21:47:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40979.168337 secs 2024-04-21T21:47:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:49 smithi077 ceph-mon[27902]: pgmap v21944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:49 smithi191 ceph-mon[31636]: pgmap v21944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:49 smithi170 ceph-mon[31212]: pgmap v21944: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40980.922370 secs 2024-04-21T21:47:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40980.922370 secs 2024-04-21T21:47:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40980.922370 secs 2024-04-21T21:47:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:51 smithi077 ceph-mon[27902]: pgmap v21945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:51 smithi191 ceph-mon[31636]: pgmap v21945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:51 smithi170 ceph-mon[31212]: pgmap v21945: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:53 smithi077 ceph-mon[27902]: pgmap v21946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40984.168446 secs 2024-04-21T21:47:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:53 smithi191 ceph-mon[31636]: pgmap v21946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40984.168446 secs 2024-04-21T21:47:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:53 smithi170 ceph-mon[31212]: pgmap v21946: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40984.168446 secs 2024-04-21T21:47:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:47:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:55 smithi077 ceph-mon[27902]: pgmap v21947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40985.922508 secs 2024-04-21T21:47:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:55 smithi191 ceph-mon[31636]: pgmap v21947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40985.922508 secs 2024-04-21T21:47:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:55 smithi170 ceph-mon[31212]: pgmap v21947: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40985.922508 secs 2024-04-21T21:47:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:57 smithi077 ceph-mon[27902]: pgmap v21948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:57 smithi191 ceph-mon[31636]: pgmap v21948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:57 smithi170 ceph-mon[31212]: pgmap v21948: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:47:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40989.168587 secs 2024-04-21T21:47:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40989.168587 secs 2024-04-21T21:47:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40989.168587 secs 2024-04-21T21:47:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:47:59 smithi077 ceph-mon[27902]: pgmap v21949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:47:59 smithi191 ceph-mon[31636]: pgmap v21949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:47:59.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:47:59 smithi170 ceph-mon[31212]: pgmap v21949: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40990.922631 secs 2024-04-21T21:48:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40990.922631 secs 2024-04-21T21:48:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40990.922631 secs 2024-04-21T21:48:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:01 smithi077 ceph-mon[27902]: pgmap v21950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:01 smithi191 ceph-mon[31636]: pgmap v21950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:01 smithi170 ceph-mon[31212]: pgmap v21950: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:03 smithi077 ceph-mon[27902]: pgmap v21951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40994.168718 secs 2024-04-21T21:48:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:03 smithi191 ceph-mon[31636]: pgmap v21951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40994.168718 secs 2024-04-21T21:48:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:03 smithi170 ceph-mon[31212]: pgmap v21951: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40994.168718 secs 2024-04-21T21:48:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:05 smithi077 ceph-mon[27902]: pgmap v21952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 40995.922783 secs 2024-04-21T21:48:05.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:05 smithi077 ceph-mon[27902]: osdmap e1444: 12 total, 12 up, 12 in 2024-04-21T21:48:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:05 smithi191 ceph-mon[31636]: pgmap v21952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 40995.922783 secs 2024-04-21T21:48:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:05 smithi191 ceph-mon[31636]: osdmap e1444: 12 total, 12 up, 12 in 2024-04-21T21:48:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:05 smithi170 ceph-mon[31212]: pgmap v21952: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 40995.922783 secs 2024-04-21T21:48:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:05 smithi170 ceph-mon[31212]: osdmap e1444: 12 total, 12 up, 12 in 2024-04-21T21:48:07.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:07 smithi077 ceph-mon[27902]: pgmap v21954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:07 smithi191 ceph-mon[31636]: pgmap v21954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:07 smithi170 ceph-mon[31212]: pgmap v21954: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:08.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 40999.168786 secs 2024-04-21T21:48:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 40999.168786 secs 2024-04-21T21:48:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 40999.168786 secs 2024-04-21T21:48:09.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:09 smithi077 ceph-mon[27902]: pgmap v21955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:09 smithi191 ceph-mon[31636]: pgmap v21955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:09 smithi170 ceph-mon[31212]: pgmap v21955: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:10.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41000.922904 secs 2024-04-21T21:48:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41000.922904 secs 2024-04-21T21:48:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41000.922904 secs 2024-04-21T21:48:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:11 smithi077 ceph-mon[27902]: pgmap v21956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:11.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:11 smithi077 ceph-mon[27902]: osdmap e1445: 12 total, 12 up, 12 in 2024-04-21T21:48:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:11 smithi191 ceph-mon[31636]: pgmap v21956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:11 smithi191 ceph-mon[31636]: osdmap e1445: 12 total, 12 up, 12 in 2024-04-21T21:48:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:11 smithi170 ceph-mon[31212]: pgmap v21956: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:48:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:11 smithi170 ceph-mon[31212]: osdmap e1445: 12 total, 12 up, 12 in 2024-04-21T21:48:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:13 smithi077 ceph-mon[27902]: pgmap v21958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:48:13.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41004.168859 secs 2024-04-21T21:48:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:13 smithi191 ceph-mon[31636]: pgmap v21958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:48:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41004.168859 secs 2024-04-21T21:48:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:13 smithi170 ceph-mon[31212]: pgmap v21958: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:48:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41004.168859 secs 2024-04-21T21:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:15 smithi077 ceph-mon[27902]: pgmap v21959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:48:15.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41005.923016 secs 2024-04-21T21:48:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:15 smithi191 ceph-mon[31636]: pgmap v21959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:48:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41005.923016 secs 2024-04-21T21:48:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:15 smithi170 ceph-mon[31212]: pgmap v21959: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:48:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41005.923016 secs 2024-04-21T21:48:17.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:17 smithi077 ceph-mon[27902]: pgmap v21960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:17 smithi191 ceph-mon[31636]: pgmap v21960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:17.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:17 smithi170 ceph-mon[31212]: pgmap v21960: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41009.168978 secs 2024-04-21T21:48:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41009.168978 secs 2024-04-21T21:48:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41009.168978 secs 2024-04-21T21:48:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:19 smithi191 ceph-mon[31636]: pgmap v21961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:19 smithi170 ceph-mon[31212]: pgmap v21961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:19 smithi077 ceph-mon[27902]: pgmap v21961: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41195.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41010.923135 secs 2024-04-21T21:48:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41010.923135 secs 2024-04-21T21:48:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41010.923135 secs 2024-04-21T21:48:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:21 smithi191 ceph-mon[31636]: pgmap v21962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:21 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:48:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:21 smithi170 ceph-mon[31212]: pgmap v21962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:21.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:21 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:48:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:21 smithi077 ceph-mon[27902]: pgmap v21962: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:48:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:21 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: pgmap v21963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:48:22.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:48:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:48:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.887 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:22 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41014.169040 secs 2024-04-21T21:48:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: pgmap v21963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:22.970 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:22 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41014.169040 secs 2024-04-21T21:48:23.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: pgmap v21963: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:48:23.058 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:22 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41014.169040 secs 2024-04-21T21:48:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:25 smithi170 ceph-mon[31212]: pgmap v21964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:25.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41015.923249 secs 2024-04-21T21:48:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:25 smithi077 ceph-mon[27902]: pgmap v21964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41015.923249 secs 2024-04-21T21:48:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:25 smithi191 ceph-mon[31636]: pgmap v21964: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41015.923249 secs 2024-04-21T21:48:27.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:27 smithi170 ceph-mon[31212]: pgmap v21965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:27 smithi077 ceph-mon[27902]: pgmap v21965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:27 smithi191 ceph-mon[31636]: pgmap v21965: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:28.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41019.169109 secs 2024-04-21T21:48:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41019.169109 secs 2024-04-21T21:48:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41019.169109 secs 2024-04-21T21:48:29.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:29 smithi170 ceph-mon[31212]: pgmap v21966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:29 smithi077 ceph-mon[27902]: pgmap v21966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:29.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:29 smithi191 ceph-mon[31636]: pgmap v21966: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:30.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41020.923356 secs 2024-04-21T21:48:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41020.923356 secs 2024-04-21T21:48:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41020.923356 secs 2024-04-21T21:48:31.307 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:31 smithi170 ceph-mon[31212]: pgmap v21967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:31 smithi077 ceph-mon[27902]: pgmap v21967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:31 smithi191 ceph-mon[31636]: pgmap v21967: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:33 smithi077 ceph-mon[27902]: pgmap v21968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41024.169226 secs 2024-04-21T21:48:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:33 smithi191 ceph-mon[31636]: pgmap v21968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41024.169226 secs 2024-04-21T21:48:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:33 smithi170 ceph-mon[31212]: pgmap v21968: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41024.169226 secs 2024-04-21T21:48:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:35 smithi077 ceph-mon[27902]: pgmap v21969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41025.923474 secs 2024-04-21T21:48:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:35 smithi191 ceph-mon[31636]: pgmap v21969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41025.923474 secs 2024-04-21T21:48:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:35 smithi170 ceph-mon[31212]: pgmap v21969: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41025.923474 secs 2024-04-21T21:48:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:37 smithi077 ceph-mon[27902]: pgmap v21970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:37 smithi191 ceph-mon[31636]: pgmap v21970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:37 smithi170 ceph-mon[31212]: pgmap v21970: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:38.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41029.169337 secs 2024-04-21T21:48:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41029.169337 secs 2024-04-21T21:48:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41029.169337 secs 2024-04-21T21:48:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:39 smithi077 ceph-mon[27902]: pgmap v21971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:39 smithi191 ceph-mon[31636]: pgmap v21971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:39 smithi170 ceph-mon[31212]: pgmap v21971: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41030.923597 secs 2024-04-21T21:48:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41030.923597 secs 2024-04-21T21:48:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41030.923597 secs 2024-04-21T21:48:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:41 smithi077 ceph-mon[27902]: pgmap v21972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:41 smithi191 ceph-mon[31636]: pgmap v21972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:41 smithi170 ceph-mon[31212]: pgmap v21972: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:43 smithi077 ceph-mon[27902]: pgmap v21973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41034.169452 secs 2024-04-21T21:48:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:43 smithi191 ceph-mon[31636]: pgmap v21973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41034.169452 secs 2024-04-21T21:48:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:43 smithi170 ceph-mon[31212]: pgmap v21973: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41034.169452 secs 2024-04-21T21:48:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:45 smithi077 ceph-mon[27902]: pgmap v21974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41035.923732 secs 2024-04-21T21:48:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:45 smithi191 ceph-mon[31636]: pgmap v21974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41035.923732 secs 2024-04-21T21:48:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:45 smithi170 ceph-mon[31212]: pgmap v21974: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:45.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41035.923732 secs 2024-04-21T21:48:47.359 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:47 smithi170 ceph-mon[31212]: pgmap v21975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:47 smithi077 ceph-mon[27902]: pgmap v21975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:47 smithi191 ceph-mon[31636]: pgmap v21975: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:48.370 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41039.169577 secs 2024-04-21T21:48:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41039.169577 secs 2024-04-21T21:48:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41039.169577 secs 2024-04-21T21:48:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:49 smithi077 ceph-mon[27902]: pgmap v21976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:49 smithi191 ceph-mon[31636]: pgmap v21976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:49 smithi170 ceph-mon[31212]: pgmap v21976: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41040.923879 secs 2024-04-21T21:48:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41040.923879 secs 2024-04-21T21:48:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41040.923879 secs 2024-04-21T21:48:51.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:51 smithi077 ceph-mon[27902]: pgmap v21977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:51 smithi191 ceph-mon[31636]: pgmap v21977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:51 smithi170 ceph-mon[31212]: pgmap v21977: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:53 smithi077 ceph-mon[27902]: pgmap v21978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:53.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41044.169699 secs 2024-04-21T21:48:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:53 smithi191 ceph-mon[31636]: pgmap v21978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41044.169699 secs 2024-04-21T21:48:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:53 smithi170 ceph-mon[31212]: pgmap v21978: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41044.169699 secs 2024-04-21T21:48:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:48:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:55 smithi077 ceph-mon[27902]: pgmap v21979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:55.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41045.923974 secs 2024-04-21T21:48:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:55 smithi191 ceph-mon[31636]: pgmap v21979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41045.923974 secs 2024-04-21T21:48:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:55 smithi170 ceph-mon[31212]: pgmap v21979: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:55.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41045.923974 secs 2024-04-21T21:48:57.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:57 smithi077 ceph-mon[27902]: pgmap v21980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:57 smithi191 ceph-mon[31636]: pgmap v21980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:57 smithi170 ceph-mon[31212]: pgmap v21980: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:48:58.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41049.169840 secs 2024-04-21T21:48:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41049.169840 secs 2024-04-21T21:48:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41049.169840 secs 2024-04-21T21:48:59.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:48:59 smithi077 ceph-mon[27902]: pgmap v21981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:48:59 smithi191 ceph-mon[31636]: pgmap v21981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:48:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:48:59 smithi170 ceph-mon[31212]: pgmap v21981: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:00.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41050.924098 secs 2024-04-21T21:49:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41050.924098 secs 2024-04-21T21:49:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41050.924098 secs 2024-04-21T21:49:01.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:01 smithi077 ceph-mon[27902]: pgmap v21982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:01 smithi191 ceph-mon[31636]: pgmap v21982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:01 smithi170 ceph-mon[31212]: pgmap v21982: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:03 smithi077 ceph-mon[27902]: pgmap v21983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:03.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41054.169938 secs 2024-04-21T21:49:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:03 smithi191 ceph-mon[31636]: pgmap v21983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41054.169938 secs 2024-04-21T21:49:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:03 smithi170 ceph-mon[31212]: pgmap v21983: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41054.169938 secs 2024-04-21T21:49:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:05 smithi191 ceph-mon[31636]: pgmap v21984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41055.924214 secs 2024-04-21T21:49:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:05 smithi191 ceph-mon[31636]: osdmap e1446: 12 total, 12 up, 12 in 2024-04-21T21:49:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:05 smithi170 ceph-mon[31212]: pgmap v21984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41055.924214 secs 2024-04-21T21:49:05.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:05 smithi170 ceph-mon[31212]: osdmap e1446: 12 total, 12 up, 12 in 2024-04-21T21:49:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:05 smithi077 ceph-mon[27902]: pgmap v21984: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41055.924214 secs 2024-04-21T21:49:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:05 smithi077 ceph-mon[27902]: osdmap e1446: 12 total, 12 up, 12 in 2024-04-21T21:49:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:07 smithi191 ceph-mon[31636]: pgmap v21986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:07 smithi170 ceph-mon[31212]: pgmap v21986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:07 smithi077 ceph-mon[27902]: pgmap v21986: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41059.170077 secs 2024-04-21T21:49:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41059.170077 secs 2024-04-21T21:49:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41059.170077 secs 2024-04-21T21:49:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:09 smithi191 ceph-mon[31636]: pgmap v21987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:09 smithi170 ceph-mon[31212]: pgmap v21987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:09 smithi077 ceph-mon[27902]: pgmap v21987: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41060.924320 secs 2024-04-21T21:49:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41060.924320 secs 2024-04-21T21:49:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41060.924320 secs 2024-04-21T21:49:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:11 smithi191 ceph-mon[31636]: pgmap v21988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:11 smithi191 ceph-mon[31636]: osdmap e1447: 12 total, 12 up, 12 in 2024-04-21T21:49:11.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:11 smithi170 ceph-mon[31212]: pgmap v21988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:11.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:11 smithi170 ceph-mon[31212]: osdmap e1447: 12 total, 12 up, 12 in 2024-04-21T21:49:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:11 smithi077 ceph-mon[27902]: pgmap v21988: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:49:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:11 smithi077 ceph-mon[27902]: osdmap e1447: 12 total, 12 up, 12 in 2024-04-21T21:49:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:13 smithi191 ceph-mon[31636]: pgmap v21990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:49:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41064.170217 secs 2024-04-21T21:49:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:13 smithi170 ceph-mon[31212]: pgmap v21990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:49:13.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41064.170217 secs 2024-04-21T21:49:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:13 smithi077 ceph-mon[27902]: pgmap v21990: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:49:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41064.170217 secs 2024-04-21T21:49:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:15 smithi191 ceph-mon[31636]: pgmap v21991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:49:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41065.924433 secs 2024-04-21T21:49:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:15 smithi170 ceph-mon[31212]: pgmap v21991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:49:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41065.924433 secs 2024-04-21T21:49:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:15 smithi077 ceph-mon[27902]: pgmap v21991: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:49:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41065.924433 secs 2024-04-21T21:49:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:17 smithi191 ceph-mon[31636]: pgmap v21992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:17 smithi170 ceph-mon[31212]: pgmap v21992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:17 smithi077 ceph-mon[27902]: pgmap v21992: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41069.170352 secs 2024-04-21T21:49:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41069.170352 secs 2024-04-21T21:49:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41069.170352 secs 2024-04-21T21:49:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:19 smithi191 ceph-mon[31636]: pgmap v21993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:19 smithi170 ceph-mon[31212]: pgmap v21993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:19 smithi077 ceph-mon[27902]: pgmap v21993: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41070.924540 secs 2024-04-21T21:49:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41070.924540 secs 2024-04-21T21:49:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41070.924540 secs 2024-04-21T21:49:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:21 smithi191 ceph-mon[31636]: pgmap v21994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:21 smithi170 ceph-mon[31212]: pgmap v21994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:21 smithi077 ceph-mon[27902]: pgmap v21994: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:49:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:23 smithi191 ceph-mon[31636]: pgmap v21995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:49:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41074.170465 secs 2024-04-21T21:49:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:49:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:49:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:49:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:23 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:49:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:23 smithi170 ceph-mon[31212]: pgmap v21995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:49:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41074.170465 secs 2024-04-21T21:49:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:49:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:49:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:49:23.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:23 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:49:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:23 smithi077 ceph-mon[27902]: pgmap v21995: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:49:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41074.170465 secs 2024-04-21T21:49:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:49:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:49:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:49:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:23 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:49:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:25 smithi191 ceph-mon[31636]: pgmap v21996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41075.924648 secs 2024-04-21T21:49:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:25 smithi170 ceph-mon[31212]: pgmap v21996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41075.924648 secs 2024-04-21T21:49:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:25 smithi077 ceph-mon[27902]: pgmap v21996: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41075.924648 secs 2024-04-21T21:49:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:27 smithi191 ceph-mon[31636]: pgmap v21997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:27 smithi170 ceph-mon[31212]: pgmap v21997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:27 smithi077 ceph-mon[27902]: pgmap v21997: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41079.170612 secs 2024-04-21T21:49:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41079.170612 secs 2024-04-21T21:49:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41079.170612 secs 2024-04-21T21:49:29.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:29 smithi191 ceph-mon[31636]: pgmap v21998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:29 smithi170 ceph-mon[31212]: pgmap v21998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:29 smithi077 ceph-mon[27902]: pgmap v21998: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41080.924764 secs 2024-04-21T21:49:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41080.924764 secs 2024-04-21T21:49:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41080.924764 secs 2024-04-21T21:49:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:31 smithi191 ceph-mon[31636]: pgmap v21999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:31 smithi170 ceph-mon[31212]: pgmap v21999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:31 smithi077 ceph-mon[27902]: pgmap v21999: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:33 smithi170 ceph-mon[31212]: pgmap v22000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41084.170710 secs 2024-04-21T21:49:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:33 smithi077 ceph-mon[27902]: pgmap v22000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:33.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41084.170710 secs 2024-04-21T21:49:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:33 smithi191 ceph-mon[31636]: pgmap v22000: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41084.170710 secs 2024-04-21T21:49:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:35 smithi170 ceph-mon[31212]: pgmap v22001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41085.924891 secs 2024-04-21T21:49:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:35 smithi077 ceph-mon[27902]: pgmap v22001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41085.924891 secs 2024-04-21T21:49:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:35 smithi191 ceph-mon[31636]: pgmap v22001: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41085.924891 secs 2024-04-21T21:49:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:37 smithi170 ceph-mon[31212]: pgmap v22002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:37 smithi077 ceph-mon[27902]: pgmap v22002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:37 smithi191 ceph-mon[31636]: pgmap v22002: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:38.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41089.170866 secs 2024-04-21T21:49:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41089.170866 secs 2024-04-21T21:49:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41089.170866 secs 2024-04-21T21:49:39.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:39 smithi170 ceph-mon[31212]: pgmap v22003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:39 smithi077 ceph-mon[27902]: pgmap v22003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:39 smithi191 ceph-mon[31636]: pgmap v22003: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41090.924981 secs 2024-04-21T21:49:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41090.924981 secs 2024-04-21T21:49:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41090.924981 secs 2024-04-21T21:49:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:41 smithi170 ceph-mon[31212]: pgmap v22004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:41 smithi077 ceph-mon[27902]: pgmap v22004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:41 smithi191 ceph-mon[31636]: pgmap v22004: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:43 smithi170 ceph-mon[31212]: pgmap v22005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41094.170929 secs 2024-04-21T21:49:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:43 smithi077 ceph-mon[27902]: pgmap v22005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41094.170929 secs 2024-04-21T21:49:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:43 smithi191 ceph-mon[31636]: pgmap v22005: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41094.170929 secs 2024-04-21T21:49:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:45 smithi170 ceph-mon[31212]: pgmap v22006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41095.925073 secs 2024-04-21T21:49:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:45 smithi077 ceph-mon[27902]: pgmap v22006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41095.925073 secs 2024-04-21T21:49:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:45 smithi191 ceph-mon[31636]: pgmap v22006: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41095.925073 secs 2024-04-21T21:49:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:47 smithi170 ceph-mon[31212]: pgmap v22007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:47.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:47 smithi077 ceph-mon[27902]: pgmap v22007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:47.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:47 smithi191 ceph-mon[31636]: pgmap v22007: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41099.171058 secs 2024-04-21T21:49:48.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41099.171058 secs 2024-04-21T21:49:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41099.171058 secs 2024-04-21T21:49:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:49 smithi170 ceph-mon[31212]: pgmap v22008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:49 smithi077 ceph-mon[27902]: pgmap v22008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:49 smithi191 ceph-mon[31636]: pgmap v22008: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:50.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41100.925183 secs 2024-04-21T21:49:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41100.925183 secs 2024-04-21T21:49:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41100.925183 secs 2024-04-21T21:49:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:51 smithi170 ceph-mon[31212]: pgmap v22009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:51.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:51 smithi077 ceph-mon[27902]: pgmap v22009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:51.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:51 smithi191 ceph-mon[31636]: pgmap v22009: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:53 smithi170 ceph-mon[31212]: pgmap v22010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41104.171135 secs 2024-04-21T21:49:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:53 smithi077 ceph-mon[27902]: pgmap v22010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41104.171135 secs 2024-04-21T21:49:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:53 smithi191 ceph-mon[31636]: pgmap v22010: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41104.171135 secs 2024-04-21T21:49:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:49:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:55 smithi170 ceph-mon[31212]: pgmap v22011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41105.925296 secs 2024-04-21T21:49:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:55 smithi077 ceph-mon[27902]: pgmap v22011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41105.925296 secs 2024-04-21T21:49:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:55 smithi191 ceph-mon[31636]: pgmap v22011: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41105.925296 secs 2024-04-21T21:49:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:57 smithi170 ceph-mon[31212]: pgmap v22012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:57.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:57 smithi077 ceph-mon[27902]: pgmap v22012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:57.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:57 smithi191 ceph-mon[31636]: pgmap v22012: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:49:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41109.171266 secs 2024-04-21T21:49:58.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41109.171266 secs 2024-04-21T21:49:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41109.171266 secs 2024-04-21T21:49:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:49:59 smithi170 ceph-mon[31212]: pgmap v22013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:49:59 smithi077 ceph-mon[27902]: pgmap v22013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:49:59.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:49:59 smithi191 ceph-mon[31636]: pgmap v22013: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:50:00.039+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:50:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:50:00.039+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:50:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:50:00.039+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 314 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:50:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:50:00.039+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 314 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:50:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41295.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41110.925412 secs 2024-04-21T21:50:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:50:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41110.925412 secs 2024-04-21T21:50:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:50:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41110.925412 secs 2024-04-21T21:50:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T21:50:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:01 smithi170 ceph-mon[31212]: pgmap v22014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:01.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:01 smithi077 ceph-mon[27902]: pgmap v22014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:01.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:01 smithi191 ceph-mon[31636]: pgmap v22014: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:03 smithi170 ceph-mon[31212]: pgmap v22015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T21:50:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41114.171370 secs 2024-04-21T21:50:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:03 smithi077 ceph-mon[27902]: pgmap v22015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T21:50:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41114.171370 secs 2024-04-21T21:50:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:03 smithi191 ceph-mon[31636]: pgmap v22015: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-04-21T21:50:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41114.171370 secs 2024-04-21T21:50:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41300.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:05 smithi170 ceph-mon[31212]: pgmap v22016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T21:50:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41115.925525 secs 2024-04-21T21:50:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:05 smithi170 ceph-mon[31212]: osdmap e1448: 12 total, 12 up, 12 in 2024-04-21T21:50:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:05 smithi077 ceph-mon[27902]: pgmap v22016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T21:50:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41115.925525 secs 2024-04-21T21:50:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:05 smithi077 ceph-mon[27902]: osdmap e1448: 12 total, 12 up, 12 in 2024-04-21T21:50:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:05 smithi191 ceph-mon[31636]: pgmap v22016: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-04-21T21:50:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41115.925525 secs 2024-04-21T21:50:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:05 smithi191 ceph-mon[31636]: osdmap e1448: 12 total, 12 up, 12 in 2024-04-21T21:50:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:07 smithi170 ceph-mon[31212]: pgmap v22018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:07 smithi077 ceph-mon[27902]: pgmap v22018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:07 smithi191 ceph-mon[31636]: pgmap v22018: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:08.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41119.171454 secs 2024-04-21T21:50:08.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41119.171454 secs 2024-04-21T21:50:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41119.171454 secs 2024-04-21T21:50:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:09 smithi077 ceph-mon[27902]: pgmap v22019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:09.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:09 smithi191 ceph-mon[31636]: pgmap v22019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:09 smithi170 ceph-mon[31212]: pgmap v22019: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41120.925671 secs 2024-04-21T21:50:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41120.925671 secs 2024-04-21T21:50:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41120.925671 secs 2024-04-21T21:50:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:11 smithi077 ceph-mon[27902]: pgmap v22020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:11 smithi077 ceph-mon[27902]: osdmap e1449: 12 total, 12 up, 12 in 2024-04-21T21:50:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:11 smithi191 ceph-mon[31636]: pgmap v22020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:11 smithi191 ceph-mon[31636]: osdmap e1449: 12 total, 12 up, 12 in 2024-04-21T21:50:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:11 smithi170 ceph-mon[31212]: pgmap v22020: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:50:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:11 smithi170 ceph-mon[31212]: osdmap e1449: 12 total, 12 up, 12 in 2024-04-21T21:50:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:13 smithi077 ceph-mon[27902]: pgmap v22022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T21:50:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41124.171570 secs 2024-04-21T21:50:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:13 smithi191 ceph-mon[31636]: pgmap v22022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T21:50:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41124.171570 secs 2024-04-21T21:50:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:13 smithi170 ceph-mon[31212]: pgmap v22022: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-21T21:50:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41124.171570 secs 2024-04-21T21:50:14.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41125.925808 secs 2024-04-21T21:50:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41125.925808 secs 2024-04-21T21:50:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41125.925808 secs 2024-04-21T21:50:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:15 smithi077 ceph-mon[27902]: pgmap v22023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T21:50:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:15 smithi191 ceph-mon[31636]: pgmap v22023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T21:50:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:15 smithi170 ceph-mon[31212]: pgmap v22023: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-04-21T21:50:16.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:16 smithi191 ceph-mon[31636]: pgmap v22024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:16.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:16 smithi170 ceph-mon[31212]: pgmap v22024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:16.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:16 smithi077 ceph-mon[27902]: pgmap v22024: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:17.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41129.171653 secs 2024-04-21T21:50:17.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41129.171653 secs 2024-04-21T21:50:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41129.171653 secs 2024-04-21T21:50:18.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:18 smithi077 ceph-mon[27902]: pgmap v22025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:18.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:18 smithi191 ceph-mon[31636]: pgmap v22025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:18 smithi170 ceph-mon[31212]: pgmap v22025: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:19.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41130.925925 secs 2024-04-21T21:50:19.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41130.925925 secs 2024-04-21T21:50:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41130.925925 secs 2024-04-21T21:50:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:20.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:20 smithi191 ceph-mon[31636]: pgmap v22026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:20 smithi170 ceph-mon[31212]: pgmap v22026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:21.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:20 smithi077 ceph-mon[27902]: pgmap v22026: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:50:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:23 smithi077 ceph-mon[27902]: pgmap v22027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:50:23.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41134.171743 secs 2024-04-21T21:50:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:23 smithi191 ceph-mon[31636]: pgmap v22027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:50:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41134.171743 secs 2024-04-21T21:50:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:23 smithi170 ceph-mon[31212]: pgmap v22027: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:50:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41134.171743 secs 2024-04-21T21:50:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:50:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:50:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:50:24.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:50:24.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:50:24.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:50:24.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:50:24.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:50:24.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:50:24.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:50:24.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:50:24.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:50:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:25 smithi077 ceph-mon[27902]: pgmap v22028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:25.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41135.926018 secs 2024-04-21T21:50:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:25 smithi191 ceph-mon[31636]: pgmap v22028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41135.926018 secs 2024-04-21T21:50:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:25 smithi170 ceph-mon[31212]: pgmap v22028: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41135.926018 secs 2024-04-21T21:50:27.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:27 smithi077 ceph-mon[27902]: pgmap v22029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:27 smithi191 ceph-mon[31636]: pgmap v22029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:27 smithi170 ceph-mon[31212]: pgmap v22029: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:28.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41139.171843 secs 2024-04-21T21:50:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41139.171843 secs 2024-04-21T21:50:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41139.171843 secs 2024-04-21T21:50:29.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:29 smithi077 ceph-mon[27902]: pgmap v22030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:29.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:29 smithi191 ceph-mon[31636]: pgmap v22030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:29 smithi170 ceph-mon[31212]: pgmap v22030: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:30.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41140.926141 secs 2024-04-21T21:50:30.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41140.926141 secs 2024-04-21T21:50:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41140.926141 secs 2024-04-21T21:50:31.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:31 smithi077 ceph-mon[27902]: pgmap v22031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:31.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:31 smithi191 ceph-mon[31636]: pgmap v22031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:31 smithi170 ceph-mon[31212]: pgmap v22031: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:33 smithi077 ceph-mon[27902]: pgmap v22032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41144.171904 secs 2024-04-21T21:50:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:33 smithi191 ceph-mon[31636]: pgmap v22032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41144.171904 secs 2024-04-21T21:50:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:33 smithi170 ceph-mon[31212]: pgmap v22032: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41144.171904 secs 2024-04-21T21:50:35.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:35 smithi077 ceph-mon[27902]: pgmap v22033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41145.926236 secs 2024-04-21T21:50:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:35 smithi191 ceph-mon[31636]: pgmap v22033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41145.926236 secs 2024-04-21T21:50:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:35 smithi170 ceph-mon[31212]: pgmap v22033: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41145.926236 secs 2024-04-21T21:50:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:37 smithi077 ceph-mon[27902]: pgmap v22034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:37 smithi191 ceph-mon[31636]: pgmap v22034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:37 smithi170 ceph-mon[31212]: pgmap v22034: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:38.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41149.172030 secs 2024-04-21T21:50:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41149.172030 secs 2024-04-21T21:50:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41149.172030 secs 2024-04-21T21:50:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:39 smithi077 ceph-mon[27902]: pgmap v22035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:39 smithi191 ceph-mon[31636]: pgmap v22035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:39 smithi170 ceph-mon[31212]: pgmap v22035: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:40.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41150.926374 secs 2024-04-21T21:50:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41150.926374 secs 2024-04-21T21:50:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41150.926374 secs 2024-04-21T21:50:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:41 smithi077 ceph-mon[27902]: pgmap v22036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:41 smithi191 ceph-mon[31636]: pgmap v22036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:41 smithi170 ceph-mon[31212]: pgmap v22036: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:43 smithi077 ceph-mon[27902]: pgmap v22037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41154.172150 secs 2024-04-21T21:50:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:43 smithi191 ceph-mon[31636]: pgmap v22037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41154.172150 secs 2024-04-21T21:50:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:43 smithi170 ceph-mon[31212]: pgmap v22037: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41154.172150 secs 2024-04-21T21:50:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:45 smithi077 ceph-mon[27902]: pgmap v22038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41155.926511 secs 2024-04-21T21:50:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:45 smithi191 ceph-mon[31636]: pgmap v22038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41155.926511 secs 2024-04-21T21:50:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:45 smithi170 ceph-mon[31212]: pgmap v22038: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41155.926511 secs 2024-04-21T21:50:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:47 smithi077 ceph-mon[27902]: pgmap v22039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:47 smithi191 ceph-mon[31636]: pgmap v22039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:47 smithi170 ceph-mon[31212]: pgmap v22039: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:48.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41159.172254 secs 2024-04-21T21:50:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41159.172254 secs 2024-04-21T21:50:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41159.172254 secs 2024-04-21T21:50:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:49 smithi191 ceph-mon[31636]: pgmap v22040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:49 smithi170 ceph-mon[31212]: pgmap v22040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:49 smithi077 ceph-mon[27902]: pgmap v22040: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:50.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41160.926648 secs 2024-04-21T21:50:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41160.926648 secs 2024-04-21T21:50:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41160.926648 secs 2024-04-21T21:50:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:51 smithi191 ceph-mon[31636]: pgmap v22041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:51 smithi170 ceph-mon[31212]: pgmap v22041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:51.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:51 smithi077 ceph-mon[27902]: pgmap v22041: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:53 smithi191 ceph-mon[31636]: pgmap v22042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41164.172324 secs 2024-04-21T21:50:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:53 smithi170 ceph-mon[31212]: pgmap v22042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41164.172324 secs 2024-04-21T21:50:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:53 smithi077 ceph-mon[27902]: pgmap v22042: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41164.172324 secs 2024-04-21T21:50:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:50:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:55 smithi191 ceph-mon[31636]: pgmap v22043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41165.926768 secs 2024-04-21T21:50:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:55 smithi170 ceph-mon[31212]: pgmap v22043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41165.926768 secs 2024-04-21T21:50:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:55 smithi077 ceph-mon[27902]: pgmap v22043: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41165.926768 secs 2024-04-21T21:50:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:57 smithi191 ceph-mon[31636]: pgmap v22044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:57 smithi170 ceph-mon[31212]: pgmap v22044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:57.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:57 smithi077 ceph-mon[27902]: pgmap v22044: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:50:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41169.172433 secs 2024-04-21T21:50:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41169.172433 secs 2024-04-21T21:50:58.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41169.172433 secs 2024-04-21T21:50:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:50:59 smithi191 ceph-mon[31636]: pgmap v22045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:50:59 smithi170 ceph-mon[31212]: pgmap v22045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:50:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:50:59 smithi077 ceph-mon[27902]: pgmap v22045: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:00.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:00.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41170.926892 secs 2024-04-21T21:51:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41170.926892 secs 2024-04-21T21:51:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41170.926892 secs 2024-04-21T21:51:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:01 smithi191 ceph-mon[31636]: pgmap v22046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:01 smithi170 ceph-mon[31212]: pgmap v22046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:01.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:01 smithi077 ceph-mon[27902]: pgmap v22046: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:03 smithi191 ceph-mon[31636]: pgmap v22047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T21:51:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41174.172499 secs 2024-04-21T21:51:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:03 smithi170 ceph-mon[31212]: pgmap v22047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T21:51:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41174.172499 secs 2024-04-21T21:51:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:03 smithi077 ceph-mon[27902]: pgmap v22047: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-04-21T21:51:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41174.172499 secs 2024-04-21T21:51:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:05 smithi191 ceph-mon[31636]: pgmap v22048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:51:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41175.927002 secs 2024-04-21T21:51:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:05 smithi191 ceph-mon[31636]: osdmap e1450: 12 total, 12 up, 12 in 2024-04-21T21:51:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:05 smithi170 ceph-mon[31212]: pgmap v22048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:51:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41175.927002 secs 2024-04-21T21:51:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:05 smithi170 ceph-mon[31212]: osdmap e1450: 12 total, 12 up, 12 in 2024-04-21T21:51:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:05 smithi077 ceph-mon[27902]: pgmap v22048: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T21:51:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41175.927002 secs 2024-04-21T21:51:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:05 smithi077 ceph-mon[27902]: osdmap e1450: 12 total, 12 up, 12 in 2024-04-21T21:51:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:07 smithi191 ceph-mon[31636]: pgmap v22050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:07 smithi170 ceph-mon[31212]: pgmap v22050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:07 smithi077 ceph-mon[27902]: pgmap v22050: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:08.471 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41179.172653 secs 2024-04-21T21:51:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41179.172653 secs 2024-04-21T21:51:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41179.172653 secs 2024-04-21T21:51:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:09 smithi191 ceph-mon[31636]: pgmap v22051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:09 smithi170 ceph-mon[31212]: pgmap v22051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:09 smithi077 ceph-mon[27902]: pgmap v22051: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41180.927115 secs 2024-04-21T21:51:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41180.927115 secs 2024-04-21T21:51:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41180.927115 secs 2024-04-21T21:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:11 smithi191 ceph-mon[31636]: pgmap v22052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:11 smithi191 ceph-mon[31636]: osdmap e1451: 12 total, 12 up, 12 in 2024-04-21T21:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:11 smithi170 ceph-mon[31212]: pgmap v22052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:11 smithi170 ceph-mon[31212]: osdmap e1451: 12 total, 12 up, 12 in 2024-04-21T21:51:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:11 smithi077 ceph-mon[27902]: pgmap v22052: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:51:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:11 smithi077 ceph-mon[27902]: osdmap e1451: 12 total, 12 up, 12 in 2024-04-21T21:51:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:13 smithi191 ceph-mon[31636]: pgmap v22054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T21:51:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41184.172782 secs 2024-04-21T21:51:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:13 smithi170 ceph-mon[31212]: pgmap v22054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T21:51:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41184.172782 secs 2024-04-21T21:51:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:13 smithi077 ceph-mon[27902]: pgmap v22054: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-04-21T21:51:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41184.172782 secs 2024-04-21T21:51:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:15 smithi191 ceph-mon[31636]: pgmap v22055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T21:51:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41185.927233 secs 2024-04-21T21:51:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:15 smithi170 ceph-mon[31212]: pgmap v22055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T21:51:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41185.927233 secs 2024-04-21T21:51:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:15 smithi077 ceph-mon[27902]: pgmap v22055: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-04-21T21:51:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41185.927233 secs 2024-04-21T21:51:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:17 smithi191 ceph-mon[31636]: pgmap v22056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:17 smithi170 ceph-mon[31212]: pgmap v22056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:17 smithi077 ceph-mon[27902]: pgmap v22056: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41189.172900 secs 2024-04-21T21:51:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41189.172900 secs 2024-04-21T21:51:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41189.172900 secs 2024-04-21T21:51:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:19 smithi191 ceph-mon[31636]: pgmap v22057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:19 smithi170 ceph-mon[31212]: pgmap v22057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:19 smithi077 ceph-mon[27902]: pgmap v22057: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41190.927355 secs 2024-04-21T21:51:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41190.927355 secs 2024-04-21T21:51:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41190.927355 secs 2024-04-21T21:51:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:21 smithi170 ceph-mon[31212]: pgmap v22058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:21 smithi077 ceph-mon[27902]: pgmap v22058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:21.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:21 smithi191 ceph-mon[31636]: pgmap v22058: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:51:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:23 smithi170 ceph-mon[31212]: pgmap v22059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:51:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41194.173027 secs 2024-04-21T21:51:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:23 smithi077 ceph-mon[27902]: pgmap v22059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:51:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41194.173027 secs 2024-04-21T21:51:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:23 smithi191 ceph-mon[31636]: pgmap v22059: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:51:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41194.173027 secs 2024-04-21T21:51:24.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:24 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:51:24.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:24 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:51:24.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:24 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:51:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:25 smithi170 ceph-mon[31212]: pgmap v22060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41195.927429 secs 2024-04-21T21:51:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:51:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:51:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:51:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:25 smithi077 ceph-mon[27902]: pgmap v22060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41195.927429 secs 2024-04-21T21:51:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:51:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:51:25.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:51:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:25 smithi191 ceph-mon[31636]: pgmap v22060: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41195.927429 secs 2024-04-21T21:51:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:51:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:51:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:51:26.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:26 smithi077 ceph-mon[27902]: pgmap v22061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:26.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:26 smithi191 ceph-mon[31636]: pgmap v22061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:26 smithi170 ceph-mon[31212]: pgmap v22061: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:27.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41199.173158 secs 2024-04-21T21:51:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41199.173158 secs 2024-04-21T21:51:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41199.173158 secs 2024-04-21T21:51:28.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:28 smithi077 ceph-mon[27902]: pgmap v22062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:28 smithi191 ceph-mon[31636]: pgmap v22062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:28 smithi170 ceph-mon[31212]: pgmap v22062: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:29.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41200.927543 secs 2024-04-21T21:51:29.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41200.927543 secs 2024-04-21T21:51:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41200.927543 secs 2024-04-21T21:51:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:30 smithi077 ceph-mon[27902]: pgmap v22063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:30.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:30 smithi191 ceph-mon[31636]: pgmap v22063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:30 smithi170 ceph-mon[31212]: pgmap v22063: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:33 smithi077 ceph-mon[27902]: pgmap v22064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41204.173257 secs 2024-04-21T21:51:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:33 smithi191 ceph-mon[31636]: pgmap v22064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41204.173257 secs 2024-04-21T21:51:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:33 smithi170 ceph-mon[31212]: pgmap v22064: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41204.173257 secs 2024-04-21T21:51:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:35 smithi077 ceph-mon[27902]: pgmap v22065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41205.927663 secs 2024-04-21T21:51:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:35 smithi191 ceph-mon[31636]: pgmap v22065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41205.927663 secs 2024-04-21T21:51:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:35 smithi170 ceph-mon[31212]: pgmap v22065: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:51:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41205.927663 secs 2024-04-21T21:51:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:37 smithi077 ceph-mon[27902]: pgmap v22066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:37 smithi191 ceph-mon[31636]: pgmap v22066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:37 smithi170 ceph-mon[31212]: pgmap v22066: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:38.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41209.173383 secs 2024-04-21T21:51:38.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41209.173383 secs 2024-04-21T21:51:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41209.173383 secs 2024-04-21T21:51:39.389 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:39 smithi077 ceph-mon[27902]: pgmap v22067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:39.695 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:39 smithi170 ceph-mon[31212]: pgmap v22067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:39.695 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:39 smithi191 ceph-mon[31636]: pgmap v22067: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:40.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41210.927800 secs 2024-04-21T21:51:40.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41210.927800 secs 2024-04-21T21:51:40.559 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41210.927800 secs 2024-04-21T21:51:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:41 smithi077 ceph-mon[27902]: pgmap v22068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:41 smithi191 ceph-mon[31636]: pgmap v22068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:41 smithi170 ceph-mon[31212]: pgmap v22068: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:43 smithi077 ceph-mon[27902]: pgmap v22069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41214.173507 secs 2024-04-21T21:51:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:43 smithi191 ceph-mon[31636]: pgmap v22069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41214.173507 secs 2024-04-21T21:51:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:43 smithi170 ceph-mon[31212]: pgmap v22069: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41214.173507 secs 2024-04-21T21:51:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:45 smithi077 ceph-mon[27902]: pgmap v22070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:45.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41215.927912 secs 2024-04-21T21:51:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:45 smithi191 ceph-mon[31636]: pgmap v22070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41215.927912 secs 2024-04-21T21:51:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:45 smithi170 ceph-mon[31212]: pgmap v22070: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41215.927912 secs 2024-04-21T21:51:47.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:47 smithi077 ceph-mon[27902]: pgmap v22071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:47 smithi191 ceph-mon[31636]: pgmap v22071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:47.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:47 smithi170 ceph-mon[31212]: pgmap v22071: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:48.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41219.173617 secs 2024-04-21T21:51:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41219.173617 secs 2024-04-21T21:51:48.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41219.173617 secs 2024-04-21T21:51:49.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:49 smithi077 ceph-mon[27902]: pgmap v22072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:49.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:49 smithi191 ceph-mon[31636]: pgmap v22072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:49 smithi170 ceph-mon[31212]: pgmap v22072: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41220.928035 secs 2024-04-21T21:51:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41220.928035 secs 2024-04-21T21:51:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41220.928035 secs 2024-04-21T21:51:51.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:51 smithi191 ceph-mon[31636]: pgmap v22073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:51 smithi170 ceph-mon[31212]: pgmap v22073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:51.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:51 smithi077 ceph-mon[27902]: pgmap v22073: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:53 smithi191 ceph-mon[31636]: pgmap v22074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41224.173729 secs 2024-04-21T21:51:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:53 smithi170 ceph-mon[31212]: pgmap v22074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:53.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41224.173729 secs 2024-04-21T21:51:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:53 smithi077 ceph-mon[27902]: pgmap v22074: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41224.173729 secs 2024-04-21T21:51:55.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:51:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:55 smithi191 ceph-mon[31636]: pgmap v22075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41225.928130 secs 2024-04-21T21:51:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:55 smithi170 ceph-mon[31212]: pgmap v22075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41225.928130 secs 2024-04-21T21:51:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:55 smithi077 ceph-mon[27902]: pgmap v22075: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41225.928130 secs 2024-04-21T21:51:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:57 smithi191 ceph-mon[31636]: pgmap v22076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:57 smithi170 ceph-mon[31212]: pgmap v22076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:57.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:57 smithi077 ceph-mon[27902]: pgmap v22076: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:51:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41229.173868 secs 2024-04-21T21:51:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41229.173868 secs 2024-04-21T21:51:58.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41229.173868 secs 2024-04-21T21:51:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:51:59 smithi191 ceph-mon[31636]: pgmap v22077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:51:59 smithi170 ceph-mon[31212]: pgmap v22077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:51:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:51:59 smithi077 ceph-mon[27902]: pgmap v22077: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41230.928245 secs 2024-04-21T21:52:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41230.928245 secs 2024-04-21T21:52:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41230.928245 secs 2024-04-21T21:52:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:01 smithi191 ceph-mon[31636]: pgmap v22078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:01 smithi170 ceph-mon[31212]: pgmap v22078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:01.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:01 smithi077 ceph-mon[27902]: pgmap v22078: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:03 smithi191 ceph-mon[31636]: pgmap v22079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41234.173962 secs 2024-04-21T21:52:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:03 smithi170 ceph-mon[31212]: pgmap v22079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41234.173962 secs 2024-04-21T21:52:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:03 smithi077 ceph-mon[27902]: pgmap v22079: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41234.173962 secs 2024-04-21T21:52:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:05 smithi191 ceph-mon[31636]: pgmap v22080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41235.928357 secs 2024-04-21T21:52:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:05 smithi191 ceph-mon[31636]: osdmap e1452: 12 total, 12 up, 12 in 2024-04-21T21:52:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:05 smithi170 ceph-mon[31212]: pgmap v22080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41235.928357 secs 2024-04-21T21:52:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:05 smithi170 ceph-mon[31212]: osdmap e1452: 12 total, 12 up, 12 in 2024-04-21T21:52:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:05 smithi077 ceph-mon[27902]: pgmap v22080: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41235.928357 secs 2024-04-21T21:52:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:05 smithi077 ceph-mon[27902]: osdmap e1452: 12 total, 12 up, 12 in 2024-04-21T21:52:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:07 smithi191 ceph-mon[31636]: pgmap v22082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:07 smithi170 ceph-mon[31212]: pgmap v22082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:07 smithi077 ceph-mon[27902]: pgmap v22082: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41239.174080 secs 2024-04-21T21:52:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41239.174080 secs 2024-04-21T21:52:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41239.174080 secs 2024-04-21T21:52:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:09 smithi191 ceph-mon[31636]: pgmap v22083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:09 smithi170 ceph-mon[31212]: pgmap v22083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:09 smithi077 ceph-mon[27902]: pgmap v22083: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41240.928494 secs 2024-04-21T21:52:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41240.928494 secs 2024-04-21T21:52:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41240.928494 secs 2024-04-21T21:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:11 smithi191 ceph-mon[31636]: pgmap v22084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:11 smithi191 ceph-mon[31636]: osdmap e1453: 12 total, 12 up, 12 in 2024-04-21T21:52:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:11 smithi170 ceph-mon[31212]: pgmap v22084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:11 smithi170 ceph-mon[31212]: osdmap e1453: 12 total, 12 up, 12 in 2024-04-21T21:52:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:11 smithi077 ceph-mon[27902]: pgmap v22084: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-21T21:52:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:11 smithi077 ceph-mon[27902]: osdmap e1453: 12 total, 12 up, 12 in 2024-04-21T21:52:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:13 smithi191 ceph-mon[31636]: pgmap v22086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T21:52:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41244.174193 secs 2024-04-21T21:52:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:13 smithi170 ceph-mon[31212]: pgmap v22086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T21:52:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41244.174193 secs 2024-04-21T21:52:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:13 smithi077 ceph-mon[27902]: pgmap v22086: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 34 op/s 2024-04-21T21:52:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41244.174193 secs 2024-04-21T21:52:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:15 smithi191 ceph-mon[31636]: pgmap v22087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:52:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41245.928589 secs 2024-04-21T21:52:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:15 smithi170 ceph-mon[31212]: pgmap v22087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:52:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41245.928589 secs 2024-04-21T21:52:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:15 smithi077 ceph-mon[27902]: pgmap v22087: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:52:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41245.928589 secs 2024-04-21T21:52:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:17 smithi191 ceph-mon[31636]: pgmap v22088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:17 smithi170 ceph-mon[31212]: pgmap v22088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:17 smithi077 ceph-mon[27902]: pgmap v22088: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41249.174333 secs 2024-04-21T21:52:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41249.174333 secs 2024-04-21T21:52:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41249.174333 secs 2024-04-21T21:52:19.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:19 smithi191 ceph-mon[31636]: pgmap v22089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:19 smithi170 ceph-mon[31212]: pgmap v22089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:19 smithi077 ceph-mon[27902]: pgmap v22089: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:20.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41250.928708 secs 2024-04-21T21:52:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41250.928708 secs 2024-04-21T21:52:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41250.928708 secs 2024-04-21T21:52:21.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:21 smithi191 ceph-mon[31636]: pgmap v22090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:21 smithi170 ceph-mon[31212]: pgmap v22090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:21.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:21 smithi077 ceph-mon[27902]: pgmap v22090: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:52:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:23 smithi170 ceph-mon[31212]: pgmap v22091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:52:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41254.174425 secs 2024-04-21T21:52:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:23 smithi077 ceph-mon[27902]: pgmap v22091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:52:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41254.174425 secs 2024-04-21T21:52:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:23 smithi191 ceph-mon[31636]: pgmap v22091: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:52:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41254.174425 secs 2024-04-21T21:52:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:25 smithi170 ceph-mon[31212]: pgmap v22092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41255.928811 secs 2024-04-21T21:52:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:25 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:52:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:25 smithi077 ceph-mon[27902]: pgmap v22092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41255.928811 secs 2024-04-21T21:52:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:25 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:52:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:25 smithi191 ceph-mon[31636]: pgmap v22092: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41255.928811 secs 2024-04-21T21:52:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:25 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:52:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:52:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:52:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:52:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:52:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:52:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:52:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:52:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:52:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:52:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:27 smithi077 ceph-mon[27902]: pgmap v22093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:27.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:27 smithi191 ceph-mon[31636]: pgmap v22093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:27 smithi170 ceph-mon[31212]: pgmap v22093: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41259.174541 secs 2024-04-21T21:52:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41259.174541 secs 2024-04-21T21:52:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41259.174541 secs 2024-04-21T21:52:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:29 smithi077 ceph-mon[27902]: pgmap v22094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41260.928907 secs 2024-04-21T21:52:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:29 smithi191 ceph-mon[31636]: pgmap v22094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41260.928907 secs 2024-04-21T21:52:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:29 smithi170 ceph-mon[31212]: pgmap v22094: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41260.928907 secs 2024-04-21T21:52:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:30 smithi191 ceph-mon[31636]: pgmap v22095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:30 smithi170 ceph-mon[31212]: pgmap v22095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:30.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:30 smithi077 ceph-mon[27902]: pgmap v22095: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:33 smithi077 ceph-mon[27902]: pgmap v22096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:33.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41264.174631 secs 2024-04-21T21:52:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:33 smithi191 ceph-mon[31636]: pgmap v22096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41264.174631 secs 2024-04-21T21:52:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:33 smithi170 ceph-mon[31212]: pgmap v22096: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41264.174631 secs 2024-04-21T21:52:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:35 smithi077 ceph-mon[27902]: pgmap v22097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:35.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41265.928950 secs 2024-04-21T21:52:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:35 smithi191 ceph-mon[31636]: pgmap v22097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41265.928950 secs 2024-04-21T21:52:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:35 smithi170 ceph-mon[31212]: pgmap v22097: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41265.928950 secs 2024-04-21T21:52:37.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:37 smithi077 ceph-mon[27902]: pgmap v22098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:37 smithi191 ceph-mon[31636]: pgmap v22098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:37 smithi170 ceph-mon[31212]: pgmap v22098: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:38.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41269.174785 secs 2024-04-21T21:52:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41269.174785 secs 2024-04-21T21:52:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41269.174785 secs 2024-04-21T21:52:39.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:39 smithi077 ceph-mon[27902]: pgmap v22099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:39.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:39 smithi191 ceph-mon[31636]: pgmap v22099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:39 smithi170 ceph-mon[31212]: pgmap v22099: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:40.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41270.929048 secs 2024-04-21T21:52:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41270.929048 secs 2024-04-21T21:52:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41270.929048 secs 2024-04-21T21:52:41.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:41 smithi077 ceph-mon[27902]: pgmap v22100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:41 smithi191 ceph-mon[31636]: pgmap v22100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:41 smithi170 ceph-mon[31212]: pgmap v22100: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:43 smithi077 ceph-mon[27902]: pgmap v22101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:43.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41274.174895 secs 2024-04-21T21:52:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:43 smithi191 ceph-mon[31636]: pgmap v22101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41274.174895 secs 2024-04-21T21:52:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:43 smithi170 ceph-mon[31212]: pgmap v22101: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41274.174895 secs 2024-04-21T21:52:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:45 smithi191 ceph-mon[31636]: pgmap v22102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41275.929127 secs 2024-04-21T21:52:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:45 smithi170 ceph-mon[31212]: pgmap v22102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41275.929127 secs 2024-04-21T21:52:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:45 smithi077 ceph-mon[27902]: pgmap v22102: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41275.929127 secs 2024-04-21T21:52:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:47 smithi191 ceph-mon[31636]: pgmap v22103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:47 smithi170 ceph-mon[31212]: pgmap v22103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:47.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:47 smithi077 ceph-mon[27902]: pgmap v22103: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:48.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41279.174970 secs 2024-04-21T21:52:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41279.174970 secs 2024-04-21T21:52:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41279.174970 secs 2024-04-21T21:52:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:49 smithi191 ceph-mon[31636]: pgmap v22104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:49 smithi170 ceph-mon[31212]: pgmap v22104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:49 smithi077 ceph-mon[27902]: pgmap v22104: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:50.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:50.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41280.929242 secs 2024-04-21T21:52:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41280.929242 secs 2024-04-21T21:52:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41280.929242 secs 2024-04-21T21:52:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:51 smithi191 ceph-mon[31636]: pgmap v22105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:51 smithi170 ceph-mon[31212]: pgmap v22105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:51.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:51 smithi077 ceph-mon[27902]: pgmap v22105: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:53 smithi191 ceph-mon[31636]: pgmap v22106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:53.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41284.175080 secs 2024-04-21T21:52:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:53 smithi170 ceph-mon[31212]: pgmap v22106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41284.175080 secs 2024-04-21T21:52:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:53 smithi077 ceph-mon[27902]: pgmap v22106: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41284.175080 secs 2024-04-21T21:52:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:52:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41285.929356 secs 2024-04-21T21:52:55.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:55 smithi191 ceph-mon[31636]: pgmap v22107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41285.929356 secs 2024-04-21T21:52:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:55 smithi170 ceph-mon[31212]: pgmap v22107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41285.929356 secs 2024-04-21T21:52:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:55 smithi077 ceph-mon[27902]: pgmap v22107: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:57.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:57 smithi191 ceph-mon[31636]: pgmap v22108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:57 smithi170 ceph-mon[31212]: pgmap v22108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:57.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:57 smithi077 ceph-mon[27902]: pgmap v22108: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:52:58.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41289.175212 secs 2024-04-21T21:52:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41289.175212 secs 2024-04-21T21:52:58.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41289.175212 secs 2024-04-21T21:52:59.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:52:59 smithi191 ceph-mon[31636]: pgmap v22109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:52:59 smithi170 ceph-mon[31212]: pgmap v22109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:52:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:52:59 smithi077 ceph-mon[27902]: pgmap v22109: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:00.064+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:53:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:00.064+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:53:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:00.064+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 315 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:53:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:00.064+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 315 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:53:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:00.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41290.929473 secs 2024-04-21T21:53:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41290.929473 secs 2024-04-21T21:53:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41290.929473 secs 2024-04-21T21:53:01.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:01 smithi191 ceph-mon[31636]: pgmap v22110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:01 smithi170 ceph-mon[31212]: pgmap v22110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:01.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:01 smithi077 ceph-mon[27902]: pgmap v22110: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:03 smithi191 ceph-mon[31636]: pgmap v22111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:03.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41294.175329 secs 2024-04-21T21:53:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:03 smithi170 ceph-mon[31212]: pgmap v22111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41294.175329 secs 2024-04-21T21:53:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:03 smithi077 ceph-mon[27902]: pgmap v22111: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41294.175329 secs 2024-04-21T21:53:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41295.929560 secs 2024-04-21T21:53:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:05 smithi191 ceph-mon[31636]: pgmap v22112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:05.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:05 smithi191 ceph-mon[31636]: osdmap e1454: 12 total, 12 up, 12 in 2024-04-21T21:53:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41295.929560 secs 2024-04-21T21:53:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:05 smithi170 ceph-mon[31212]: pgmap v22112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:05 smithi170 ceph-mon[31212]: osdmap e1454: 12 total, 12 up, 12 in 2024-04-21T21:53:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41295.929560 secs 2024-04-21T21:53:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:05 smithi077 ceph-mon[27902]: pgmap v22112: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:05 smithi077 ceph-mon[27902]: osdmap e1454: 12 total, 12 up, 12 in 2024-04-21T21:53:07.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:07 smithi191 ceph-mon[31636]: pgmap v22114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:07 smithi170 ceph-mon[31212]: pgmap v22114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:07 smithi077 ceph-mon[27902]: pgmap v22114: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:08.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41299.175469 secs 2024-04-21T21:53:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41299.175469 secs 2024-04-21T21:53:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41299.175469 secs 2024-04-21T21:53:09.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:09 smithi191 ceph-mon[31636]: pgmap v22115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:09 smithi170 ceph-mon[31212]: pgmap v22115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:09 smithi077 ceph-mon[27902]: pgmap v22115: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:10.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41300.929679 secs 2024-04-21T21:53:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41300.929679 secs 2024-04-21T21:53:10.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41300.929679 secs 2024-04-21T21:53:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:11 smithi191 ceph-mon[31636]: pgmap v22116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:11.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:11 smithi191 ceph-mon[31636]: osdmap e1455: 12 total, 12 up, 12 in 2024-04-21T21:53:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:11 smithi170 ceph-mon[31212]: pgmap v22116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:11 smithi170 ceph-mon[31212]: osdmap e1455: 12 total, 12 up, 12 in 2024-04-21T21:53:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:11 smithi077 ceph-mon[27902]: pgmap v22116: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:53:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:11 smithi077 ceph-mon[27902]: osdmap e1455: 12 total, 12 up, 12 in 2024-04-21T21:53:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:13 smithi191 ceph-mon[31636]: pgmap v22118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:53:13.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41304.175583 secs 2024-04-21T21:53:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:13 smithi170 ceph-mon[31212]: pgmap v22118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:53:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41304.175583 secs 2024-04-21T21:53:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:13 smithi077 ceph-mon[27902]: pgmap v22118: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:53:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41304.175583 secs 2024-04-21T21:53:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41305.929815 secs 2024-04-21T21:53:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:15 smithi191 ceph-mon[31636]: pgmap v22119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:53:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41305.929815 secs 2024-04-21T21:53:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:15 smithi170 ceph-mon[31212]: pgmap v22119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:53:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41305.929815 secs 2024-04-21T21:53:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:15 smithi077 ceph-mon[27902]: pgmap v22119: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:53:17.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:17 smithi191 ceph-mon[31636]: pgmap v22120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:17 smithi170 ceph-mon[31212]: pgmap v22120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:17 smithi077 ceph-mon[27902]: pgmap v22120: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:18.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41309.175720 secs 2024-04-21T21:53:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41309.175720 secs 2024-04-21T21:53:18.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41309.175720 secs 2024-04-21T21:53:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:19 smithi170 ceph-mon[31212]: pgmap v22121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:19 smithi077 ceph-mon[27902]: pgmap v22121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:19 smithi191 ceph-mon[31636]: pgmap v22121: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:20.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41310.929931 secs 2024-04-21T21:53:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41310.929931 secs 2024-04-21T21:53:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41310.929931 secs 2024-04-21T21:53:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:21 smithi170 ceph-mon[31212]: pgmap v22122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:21 smithi077 ceph-mon[27902]: pgmap v22122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:21.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:21 smithi191 ceph-mon[31636]: pgmap v22122: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:53:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:23 smithi170 ceph-mon[31212]: pgmap v22123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T21:53:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41314.175837 secs 2024-04-21T21:53:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:23 smithi077 ceph-mon[27902]: pgmap v22123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T21:53:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41314.175837 secs 2024-04-21T21:53:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:23 smithi191 ceph-mon[31636]: pgmap v22123: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T21:53:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41314.175837 secs 2024-04-21T21:53:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41315.930020 secs 2024-04-21T21:53:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:25 smithi170 ceph-mon[31212]: pgmap v22124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:53:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41315.930020 secs 2024-04-21T21:53:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:25 smithi077 ceph-mon[27902]: pgmap v22124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:53:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41315.930020 secs 2024-04-21T21:53:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:25 smithi191 ceph-mon[31636]: pgmap v22124: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:53:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:53:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:53:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:53:26.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:26 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:53:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:53:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:53:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:53:26.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:26 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:53:26.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:53:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:53:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:53:26.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:26 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:53:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:27 smithi170 ceph-mon[31212]: pgmap v22125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:27 smithi077 ceph-mon[27902]: pgmap v22125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:27.721 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:27 smithi191 ceph-mon[31636]: pgmap v22125: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41319.175953 secs 2024-04-21T21:53:28.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41319.175953 secs 2024-04-21T21:53:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41319.175953 secs 2024-04-21T21:53:29.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:29 smithi170 ceph-mon[31212]: pgmap v22126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:29 smithi077 ceph-mon[27902]: pgmap v22126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:29 smithi191 ceph-mon[31636]: pgmap v22126: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41320.930093 secs 2024-04-21T21:53:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41320.930093 secs 2024-04-21T21:53:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41320.930093 secs 2024-04-21T21:53:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:31 smithi170 ceph-mon[31212]: pgmap v22127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:31 smithi077 ceph-mon[27902]: pgmap v22127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:31 smithi191 ceph-mon[31636]: pgmap v22127: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:33 smithi170 ceph-mon[31212]: pgmap v22128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41324.176040 secs 2024-04-21T21:53:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:33 smithi077 ceph-mon[27902]: pgmap v22128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41324.176040 secs 2024-04-21T21:53:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:33 smithi191 ceph-mon[31636]: pgmap v22128: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41324.176040 secs 2024-04-21T21:53:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41325.930174 secs 2024-04-21T21:53:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:35 smithi170 ceph-mon[31212]: pgmap v22129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41325.930174 secs 2024-04-21T21:53:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:35 smithi077 ceph-mon[27902]: pgmap v22129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41325.930174 secs 2024-04-21T21:53:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:35 smithi191 ceph-mon[31636]: pgmap v22129: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:37 smithi170 ceph-mon[31212]: pgmap v22130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:37 smithi077 ceph-mon[27902]: pgmap v22130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:37 smithi191 ceph-mon[31636]: pgmap v22130: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:38.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41329.176122 secs 2024-04-21T21:53:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41329.176122 secs 2024-04-21T21:53:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41329.176122 secs 2024-04-21T21:53:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:39 smithi170 ceph-mon[31212]: pgmap v22131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:39 smithi077 ceph-mon[27902]: pgmap v22131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:39 smithi191 ceph-mon[31636]: pgmap v22131: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:40.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41330.930306 secs 2024-04-21T21:53:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41330.930306 secs 2024-04-21T21:53:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41330.930306 secs 2024-04-21T21:53:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:41 smithi170 ceph-mon[31212]: pgmap v22132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:41.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:41 smithi077 ceph-mon[27902]: pgmap v22132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:41.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:41 smithi191 ceph-mon[31636]: pgmap v22132: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:43 smithi170 ceph-mon[31212]: pgmap v22133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41334.176181 secs 2024-04-21T21:53:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:43 smithi077 ceph-mon[27902]: pgmap v22133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41334.176181 secs 2024-04-21T21:53:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:43 smithi191 ceph-mon[31636]: pgmap v22133: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41334.176181 secs 2024-04-21T21:53:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:45.070+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:53:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:45.070+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:53:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:45.071+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 316 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:53:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:53:45.071+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 316 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:53:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41335.930449 secs 2024-04-21T21:53:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:45 smithi170 ceph-mon[31212]: pgmap v22134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41335.930449 secs 2024-04-21T21:53:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:45 smithi077 ceph-mon[27902]: pgmap v22134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41335.930449 secs 2024-04-21T21:53:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:45 smithi191 ceph-mon[31636]: pgmap v22134: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:47 smithi170 ceph-mon[31212]: pgmap v22135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:47.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:47 smithi077 ceph-mon[27902]: pgmap v22135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:47 smithi191 ceph-mon[31636]: pgmap v22135: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41339.176295 secs 2024-04-21T21:53:48.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41339.176295 secs 2024-04-21T21:53:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41339.176295 secs 2024-04-21T21:53:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:49 smithi170 ceph-mon[31212]: pgmap v22136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:49 smithi077 ceph-mon[27902]: pgmap v22136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:49.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:49 smithi191 ceph-mon[31636]: pgmap v22136: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41340.930565 secs 2024-04-21T21:53:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41340.930565 secs 2024-04-21T21:53:50.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41340.930565 secs 2024-04-21T21:53:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:51 smithi170 ceph-mon[31212]: pgmap v22137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:51.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:51 smithi077 ceph-mon[27902]: pgmap v22137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:51 smithi191 ceph-mon[31636]: pgmap v22137: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:53 smithi170 ceph-mon[31212]: pgmap v22138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41344.176439 secs 2024-04-21T21:53:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:53 smithi077 ceph-mon[27902]: pgmap v22138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41344.176439 secs 2024-04-21T21:53:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:53 smithi191 ceph-mon[31636]: pgmap v22138: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41344.176439 secs 2024-04-21T21:53:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:53:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41345.930713 secs 2024-04-21T21:53:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:55 smithi170 ceph-mon[31212]: pgmap v22139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41345.930713 secs 2024-04-21T21:53:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:55 smithi077 ceph-mon[27902]: pgmap v22139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41345.930713 secs 2024-04-21T21:53:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:55 smithi191 ceph-mon[31636]: pgmap v22139: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:57 smithi077 ceph-mon[27902]: pgmap v22140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:57 smithi191 ceph-mon[31636]: pgmap v22140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:57 smithi170 ceph-mon[31212]: pgmap v22140: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:53:58.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41349.176503 secs 2024-04-21T21:53:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41349.176503 secs 2024-04-21T21:53:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41349.176503 secs 2024-04-21T21:53:59.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:53:59 smithi077 ceph-mon[27902]: pgmap v22141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:53:59 smithi191 ceph-mon[31636]: pgmap v22141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:53:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:53:59 smithi170 ceph-mon[31212]: pgmap v22141: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:00.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41350.930813 secs 2024-04-21T21:54:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41350.930813 secs 2024-04-21T21:54:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41350.930813 secs 2024-04-21T21:54:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:01 smithi077 ceph-mon[27902]: pgmap v22142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:01 smithi191 ceph-mon[31636]: pgmap v22142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:01 smithi170 ceph-mon[31212]: pgmap v22142: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:03 smithi077 ceph-mon[27902]: pgmap v22143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41354.176613 secs 2024-04-21T21:54:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:03 smithi191 ceph-mon[31636]: pgmap v22143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41354.176613 secs 2024-04-21T21:54:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:03 smithi170 ceph-mon[31212]: pgmap v22143: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41354.176613 secs 2024-04-21T21:54:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41355.930901 secs 2024-04-21T21:54:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:05 smithi077 ceph-mon[27902]: pgmap v22144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:05 smithi077 ceph-mon[27902]: osdmap e1456: 12 total, 12 up, 12 in 2024-04-21T21:54:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41355.930901 secs 2024-04-21T21:54:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:05 smithi191 ceph-mon[31636]: pgmap v22144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:05 smithi191 ceph-mon[31636]: osdmap e1456: 12 total, 12 up, 12 in 2024-04-21T21:54:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41355.930901 secs 2024-04-21T21:54:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:05 smithi170 ceph-mon[31212]: pgmap v22144: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:05 smithi170 ceph-mon[31212]: osdmap e1456: 12 total, 12 up, 12 in 2024-04-21T21:54:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:07 smithi077 ceph-mon[27902]: pgmap v22146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:07 smithi191 ceph-mon[31636]: pgmap v22146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:07 smithi170 ceph-mon[31212]: pgmap v22146: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:08.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41359.176747 secs 2024-04-21T21:54:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41359.176747 secs 2024-04-21T21:54:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41359.176747 secs 2024-04-21T21:54:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:09 smithi077 ceph-mon[27902]: pgmap v22147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:09 smithi191 ceph-mon[31636]: pgmap v22147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:09 smithi170 ceph-mon[31212]: pgmap v22147: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41360.931013 secs 2024-04-21T21:54:10.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41360.931013 secs 2024-04-21T21:54:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41360.931013 secs 2024-04-21T21:54:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:11 smithi077 ceph-mon[27902]: pgmap v22148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:11 smithi077 ceph-mon[27902]: osdmap e1457: 12 total, 12 up, 12 in 2024-04-21T21:54:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:11 smithi191 ceph-mon[31636]: pgmap v22148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:11 smithi191 ceph-mon[31636]: osdmap e1457: 12 total, 12 up, 12 in 2024-04-21T21:54:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:11 smithi170 ceph-mon[31212]: pgmap v22148: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:54:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:11 smithi170 ceph-mon[31212]: osdmap e1457: 12 total, 12 up, 12 in 2024-04-21T21:54:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:13 smithi077 ceph-mon[27902]: pgmap v22150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:54:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41364.176847 secs 2024-04-21T21:54:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:13 smithi191 ceph-mon[31636]: pgmap v22150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:54:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41364.176847 secs 2024-04-21T21:54:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:13 smithi170 ceph-mon[31212]: pgmap v22150: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:54:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41364.176847 secs 2024-04-21T21:54:14.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:14 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41365.931145 secs 2024-04-21T21:54:14.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:14 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41365.931145 secs 2024-04-21T21:54:14.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:14 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41365.931145 secs 2024-04-21T21:54:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41550.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:15 smithi077 ceph-mon[27902]: pgmap v22151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T21:54:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:15 smithi191 ceph-mon[31636]: pgmap v22151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T21:54:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:15 smithi170 ceph-mon[31212]: pgmap v22151: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-04-21T21:54:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:17 smithi077 ceph-mon[27902]: pgmap v22152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:17 smithi191 ceph-mon[31636]: pgmap v22152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:17 smithi170 ceph-mon[31212]: pgmap v22152: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41369.176930 secs 2024-04-21T21:54:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41369.176930 secs 2024-04-21T21:54:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41369.176930 secs 2024-04-21T21:54:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:19 smithi077 ceph-mon[27902]: pgmap v22153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:19.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41370.931261 secs 2024-04-21T21:54:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:19 smithi191 ceph-mon[31636]: pgmap v22153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:19.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41370.931261 secs 2024-04-21T21:54:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:19 smithi170 ceph-mon[31212]: pgmap v22153: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41370.931261 secs 2024-04-21T21:54:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:20 smithi077 ceph-mon[27902]: pgmap v22154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:20 smithi191 ceph-mon[31636]: pgmap v22154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:20 smithi170 ceph-mon[31212]: pgmap v22154: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:54:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:23 smithi191 ceph-mon[31636]: pgmap v22155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:54:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41374.177049 secs 2024-04-21T21:54:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:23 smithi170 ceph-mon[31212]: pgmap v22155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:54:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41374.177049 secs 2024-04-21T21:54:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:23 smithi077 ceph-mon[27902]: pgmap v22155: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:54:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41374.177049 secs 2024-04-21T21:54:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41375.931382 secs 2024-04-21T21:54:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:25 smithi191 ceph-mon[31636]: pgmap v22156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41375.931382 secs 2024-04-21T21:54:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:25 smithi170 ceph-mon[31212]: pgmap v22156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41375.931382 secs 2024-04-21T21:54:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:25 smithi077 ceph-mon[27902]: pgmap v22156: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:27.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:27 smithi191 ceph-mon[31636]: pgmap v22157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:54:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:54:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:54:27.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:54:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:27 smithi170 ceph-mon[31212]: pgmap v22157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:54:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:54:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:54:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:54:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:27 smithi077 ceph-mon[27902]: pgmap v22157: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:54:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:54:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:54:27.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:54:28.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41379.177161 secs 2024-04-21T21:54:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41379.177161 secs 2024-04-21T21:54:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41379.177161 secs 2024-04-21T21:54:29.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:29 smithi191 ceph-mon[31636]: pgmap v22158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:29 smithi170 ceph-mon[31212]: pgmap v22158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:29.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:29 smithi077 ceph-mon[27902]: pgmap v22158: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:30.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41380.931502 secs 2024-04-21T21:54:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41380.931502 secs 2024-04-21T21:54:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41380.931502 secs 2024-04-21T21:54:31.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:31 smithi191 ceph-mon[31636]: pgmap v22159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:31 smithi170 ceph-mon[31212]: pgmap v22159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:31 smithi077 ceph-mon[27902]: pgmap v22159: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:33 smithi191 ceph-mon[31636]: pgmap v22160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41384.177231 secs 2024-04-21T21:54:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:33 smithi170 ceph-mon[31212]: pgmap v22160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41384.177231 secs 2024-04-21T21:54:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:33 smithi077 ceph-mon[27902]: pgmap v22160: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41384.177231 secs 2024-04-21T21:54:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41385.931616 secs 2024-04-21T21:54:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:35 smithi191 ceph-mon[31636]: pgmap v22161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41385.931616 secs 2024-04-21T21:54:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:35 smithi170 ceph-mon[31212]: pgmap v22161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41385.931616 secs 2024-04-21T21:54:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:35 smithi077 ceph-mon[27902]: pgmap v22161: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:37.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:37 smithi191 ceph-mon[31636]: pgmap v22162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:37 smithi170 ceph-mon[31212]: pgmap v22162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:37.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:37 smithi077 ceph-mon[27902]: pgmap v22162: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41389.177349 secs 2024-04-21T21:54:38.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41389.177349 secs 2024-04-21T21:54:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41389.177349 secs 2024-04-21T21:54:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:39 smithi191 ceph-mon[31636]: pgmap v22163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:39 smithi170 ceph-mon[31212]: pgmap v22163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:39.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:39 smithi077 ceph-mon[27902]: pgmap v22163: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41390.931758 secs 2024-04-21T21:54:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41390.931758 secs 2024-04-21T21:54:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41390.931758 secs 2024-04-21T21:54:41.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:41 smithi191 ceph-mon[31636]: pgmap v22164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:41 smithi170 ceph-mon[31212]: pgmap v22164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:41 smithi077 ceph-mon[27902]: pgmap v22164: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:43 smithi191 ceph-mon[31636]: pgmap v22165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41394.177428 secs 2024-04-21T21:54:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:43 smithi170 ceph-mon[31212]: pgmap v22165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41394.177428 secs 2024-04-21T21:54:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:43 smithi077 ceph-mon[27902]: pgmap v22165: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41394.177428 secs 2024-04-21T21:54:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41395.931878 secs 2024-04-21T21:54:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:45 smithi191 ceph-mon[31636]: pgmap v22166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41395.931878 secs 2024-04-21T21:54:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:45 smithi170 ceph-mon[31212]: pgmap v22166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41395.931878 secs 2024-04-21T21:54:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:45 smithi077 ceph-mon[27902]: pgmap v22166: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:47.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:47 smithi191 ceph-mon[31636]: pgmap v22167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:47 smithi170 ceph-mon[31212]: pgmap v22167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:47 smithi077 ceph-mon[27902]: pgmap v22167: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41399.177549 secs 2024-04-21T21:54:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41399.177549 secs 2024-04-21T21:54:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41399.177549 secs 2024-04-21T21:54:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:49 smithi191 ceph-mon[31636]: pgmap v22168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:49 smithi170 ceph-mon[31212]: pgmap v22168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:49.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:49 smithi077 ceph-mon[27902]: pgmap v22168: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:50.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41400.932000 secs 2024-04-21T21:54:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41400.932000 secs 2024-04-21T21:54:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41400.932000 secs 2024-04-21T21:54:51.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:51 smithi191 ceph-mon[31636]: pgmap v22169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:51 smithi170 ceph-mon[31212]: pgmap v22169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:51 smithi077 ceph-mon[27902]: pgmap v22169: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:53 smithi170 ceph-mon[31212]: pgmap v22170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41404.177680 secs 2024-04-21T21:54:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:53 smithi077 ceph-mon[27902]: pgmap v22170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41404.177680 secs 2024-04-21T21:54:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:53 smithi191 ceph-mon[31636]: pgmap v22170: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41404.177680 secs 2024-04-21T21:54:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:54:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41405.932138 secs 2024-04-21T21:54:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:55 smithi170 ceph-mon[31212]: pgmap v22171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41405.932138 secs 2024-04-21T21:54:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:55 smithi077 ceph-mon[27902]: pgmap v22171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41405.932138 secs 2024-04-21T21:54:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:55 smithi191 ceph-mon[31636]: pgmap v22171: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:57 smithi170 ceph-mon[31212]: pgmap v22172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:57 smithi077 ceph-mon[27902]: pgmap v22172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:57.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:57 smithi191 ceph-mon[31636]: pgmap v22172: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:54:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41409.177833 secs 2024-04-21T21:54:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41409.177833 secs 2024-04-21T21:54:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41409.177833 secs 2024-04-21T21:54:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:54:59 smithi170 ceph-mon[31212]: pgmap v22173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:54:59 smithi077 ceph-mon[27902]: pgmap v22173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:54:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:54:59 smithi191 ceph-mon[31636]: pgmap v22173: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41410.932263 secs 2024-04-21T21:55:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41410.932263 secs 2024-04-21T21:55:00.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41410.932263 secs 2024-04-21T21:55:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:01 smithi170 ceph-mon[31212]: pgmap v22174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:01 smithi077 ceph-mon[27902]: pgmap v22174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:01 smithi191 ceph-mon[31636]: pgmap v22174: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:03 smithi170 ceph-mon[31212]: pgmap v22175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41414.177946 secs 2024-04-21T21:55:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:03 smithi077 ceph-mon[27902]: pgmap v22175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41414.177946 secs 2024-04-21T21:55:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:03 smithi191 ceph-mon[31636]: pgmap v22175: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41414.177946 secs 2024-04-21T21:55:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41415.932405 secs 2024-04-21T21:55:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:05 smithi170 ceph-mon[31212]: pgmap v22176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:05 smithi170 ceph-mon[31212]: osdmap e1458: 12 total, 12 up, 12 in 2024-04-21T21:55:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41415.932405 secs 2024-04-21T21:55:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:05 smithi077 ceph-mon[27902]: pgmap v22176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:05 smithi077 ceph-mon[27902]: osdmap e1458: 12 total, 12 up, 12 in 2024-04-21T21:55:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41415.932405 secs 2024-04-21T21:55:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:05 smithi191 ceph-mon[31636]: pgmap v22176: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:05 smithi191 ceph-mon[31636]: osdmap e1458: 12 total, 12 up, 12 in 2024-04-21T21:55:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:07 smithi170 ceph-mon[31212]: pgmap v22178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:07.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:07 smithi077 ceph-mon[27902]: pgmap v22178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:07 smithi191 ceph-mon[31636]: pgmap v22178: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41419.178010 secs 2024-04-21T21:55:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41419.178010 secs 2024-04-21T21:55:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41419.178010 secs 2024-04-21T21:55:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:09 smithi170 ceph-mon[31212]: pgmap v22179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:09 smithi077 ceph-mon[27902]: pgmap v22179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:09 smithi191 ceph-mon[31636]: pgmap v22179: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41420.932540 secs 2024-04-21T21:55:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41420.932540 secs 2024-04-21T21:55:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41420.932540 secs 2024-04-21T21:55:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:11 smithi170 ceph-mon[31212]: pgmap v22180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:11 smithi170 ceph-mon[31212]: osdmap e1459: 12 total, 12 up, 12 in 2024-04-21T21:55:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:11 smithi077 ceph-mon[27902]: pgmap v22180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:11 smithi077 ceph-mon[27902]: osdmap e1459: 12 total, 12 up, 12 in 2024-04-21T21:55:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:11 smithi191 ceph-mon[31636]: pgmap v22180: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:55:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:11 smithi191 ceph-mon[31636]: osdmap e1459: 12 total, 12 up, 12 in 2024-04-21T21:55:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:13 smithi170 ceph-mon[31212]: pgmap v22182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:55:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41424.178122 secs 2024-04-21T21:55:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:13 smithi077 ceph-mon[27902]: pgmap v22182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:55:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41424.178122 secs 2024-04-21T21:55:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:13 smithi191 ceph-mon[31636]: pgmap v22182: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:55:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41424.178122 secs 2024-04-21T21:55:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41425.932666 secs 2024-04-21T21:55:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:15 smithi170 ceph-mon[31212]: pgmap v22183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:55:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41425.932666 secs 2024-04-21T21:55:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:15 smithi077 ceph-mon[27902]: pgmap v22183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:55:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41425.932666 secs 2024-04-21T21:55:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:15 smithi191 ceph-mon[31636]: pgmap v22183: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:55:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:17 smithi170 ceph-mon[31212]: pgmap v22184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:17 smithi077 ceph-mon[27902]: pgmap v22184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:17 smithi191 ceph-mon[31636]: pgmap v22184: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41429.178247 secs 2024-04-21T21:55:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41429.178247 secs 2024-04-21T21:55:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41429.178247 secs 2024-04-21T21:55:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:19 smithi170 ceph-mon[31212]: pgmap v22185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:19 smithi077 ceph-mon[27902]: pgmap v22185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:19 smithi191 ceph-mon[31636]: pgmap v22185: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41430.932806 secs 2024-04-21T21:55:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41430.932806 secs 2024-04-21T21:55:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41430.932806 secs 2024-04-21T21:55:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:21 smithi170 ceph-mon[31212]: pgmap v22186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:21 smithi077 ceph-mon[27902]: pgmap v22186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:21 smithi191 ceph-mon[31636]: pgmap v22186: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:55:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:23 smithi170 ceph-mon[31212]: pgmap v22187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:55:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41434.178382 secs 2024-04-21T21:55:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:23 smithi077 ceph-mon[27902]: pgmap v22187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:55:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41434.178382 secs 2024-04-21T21:55:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:23 smithi191 ceph-mon[31636]: pgmap v22187: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:55:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41434.178382 secs 2024-04-21T21:55:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41435.932948 secs 2024-04-21T21:55:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:25 smithi170 ceph-mon[31212]: pgmap v22188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41435.932948 secs 2024-04-21T21:55:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:25 smithi077 ceph-mon[27902]: pgmap v22188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41435.932948 secs 2024-04-21T21:55:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:25 smithi191 ceph-mon[31636]: pgmap v22188: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:26.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:26 smithi191 ceph-mon[31636]: pgmap v22189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:26 smithi170 ceph-mon[31212]: pgmap v22189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:26 smithi077 ceph-mon[27902]: pgmap v22189: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:27.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:27 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:55:27.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41439.178470 secs 2024-04-21T21:55:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:27 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:55:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41439.178470 secs 2024-04-21T21:55:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:27 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:55:28.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41439.178470 secs 2024-04-21T21:55:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:55:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:55:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:55:28.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:28 smithi191 ceph-mon[31636]: pgmap v22190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:55:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:55:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:55:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:28 smithi170 ceph-mon[31212]: pgmap v22190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:55:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:55:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:55:29.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:28 smithi077 ceph-mon[27902]: pgmap v22190: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:29.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41440.933051 secs 2024-04-21T21:55:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41440.933051 secs 2024-04-21T21:55:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41440.933051 secs 2024-04-21T21:55:30.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:30 smithi191 ceph-mon[31636]: pgmap v22191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:30 smithi170 ceph-mon[31212]: pgmap v22191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:30 smithi077 ceph-mon[27902]: pgmap v22191: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:33.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:33 smithi191 ceph-mon[31636]: pgmap v22192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:33.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41444.178562 secs 2024-04-21T21:55:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:33 smithi170 ceph-mon[31212]: pgmap v22192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41444.178562 secs 2024-04-21T21:55:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:33 smithi077 ceph-mon[27902]: pgmap v22192: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41444.178562 secs 2024-04-21T21:55:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:35.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41445.933178 secs 2024-04-21T21:55:35.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:35 smithi191 ceph-mon[31636]: pgmap v22193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41445.933178 secs 2024-04-21T21:55:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:35 smithi170 ceph-mon[31212]: pgmap v22193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41445.933178 secs 2024-04-21T21:55:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:35 smithi077 ceph-mon[27902]: pgmap v22193: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:37.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:37 smithi191 ceph-mon[31636]: pgmap v22194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:37 smithi170 ceph-mon[31212]: pgmap v22194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:37 smithi077 ceph-mon[27902]: pgmap v22194: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:38.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41449.178684 secs 2024-04-21T21:55:38.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41449.178684 secs 2024-04-21T21:55:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41449.178684 secs 2024-04-21T21:55:39.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:39 smithi191 ceph-mon[31636]: pgmap v22195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:39 smithi170 ceph-mon[31212]: pgmap v22195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:39 smithi077 ceph-mon[27902]: pgmap v22195: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:40.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41450.933303 secs 2024-04-21T21:55:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41450.933303 secs 2024-04-21T21:55:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41450.933303 secs 2024-04-21T21:55:41.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:41 smithi191 ceph-mon[31636]: pgmap v22196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:41 smithi170 ceph-mon[31212]: pgmap v22196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:41 smithi077 ceph-mon[27902]: pgmap v22196: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:43.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:43 smithi191 ceph-mon[31636]: pgmap v22197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:43.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41454.178798 secs 2024-04-21T21:55:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:43 smithi170 ceph-mon[31212]: pgmap v22197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41454.178798 secs 2024-04-21T21:55:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:43 smithi077 ceph-mon[27902]: pgmap v22197: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41454.178798 secs 2024-04-21T21:55:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41640.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41455.933427 secs 2024-04-21T21:55:45.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:45 smithi191 ceph-mon[31636]: pgmap v22198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41455.933427 secs 2024-04-21T21:55:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:45 smithi170 ceph-mon[31212]: pgmap v22198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41455.933427 secs 2024-04-21T21:55:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:45 smithi077 ceph-mon[27902]: pgmap v22198: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:47.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:47 smithi191 ceph-mon[31636]: pgmap v22199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:47 smithi170 ceph-mon[31212]: pgmap v22199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:47.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:47 smithi077 ceph-mon[27902]: pgmap v22199: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:48.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41459.178915 secs 2024-04-21T21:55:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41459.178915 secs 2024-04-21T21:55:48.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41459.178915 secs 2024-04-21T21:55:49.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:49 smithi191 ceph-mon[31636]: pgmap v22200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:49 smithi170 ceph-mon[31212]: pgmap v22200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:49 smithi077 ceph-mon[27902]: pgmap v22200: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41460.933540 secs 2024-04-21T21:55:50.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41460.933540 secs 2024-04-21T21:55:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41460.933540 secs 2024-04-21T21:55:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:51 smithi170 ceph-mon[31212]: pgmap v22201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:51 smithi077 ceph-mon[27902]: pgmap v22201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:51 smithi191 ceph-mon[31636]: pgmap v22201: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:53 smithi170 ceph-mon[31212]: pgmap v22202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41464.179028 secs 2024-04-21T21:55:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:53 smithi077 ceph-mon[27902]: pgmap v22202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41464.179028 secs 2024-04-21T21:55:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:53 smithi191 ceph-mon[31636]: pgmap v22202: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41464.179028 secs 2024-04-21T21:55:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:55:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41465.933683 secs 2024-04-21T21:55:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:55 smithi170 ceph-mon[31212]: pgmap v22203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41465.933683 secs 2024-04-21T21:55:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:55 smithi077 ceph-mon[27902]: pgmap v22203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41465.933683 secs 2024-04-21T21:55:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:55 smithi191 ceph-mon[31636]: pgmap v22203: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:57 smithi170 ceph-mon[31212]: pgmap v22204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:57 smithi077 ceph-mon[27902]: pgmap v22204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:57 smithi191 ceph-mon[31636]: pgmap v22204: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:55:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41469.179128 secs 2024-04-21T21:55:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41469.179128 secs 2024-04-21T21:55:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41469.179128 secs 2024-04-21T21:55:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:55:59 smithi170 ceph-mon[31212]: pgmap v22205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:55:59 smithi077 ceph-mon[27902]: pgmap v22205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:55:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:55:59 smithi191 ceph-mon[31636]: pgmap v22205: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:00.090 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:56:00.089+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:56:00.090 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:56:00.089+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:56:00.090 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:56:00.089+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 317 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:56:00.090 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:56:00.089+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 317 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:56:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41470.933808 secs 2024-04-21T21:56:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41470.933808 secs 2024-04-21T21:56:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41470.933808 secs 2024-04-21T21:56:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:01 smithi170 ceph-mon[31212]: pgmap v22206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:01 smithi077 ceph-mon[27902]: pgmap v22206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:01 smithi191 ceph-mon[31636]: pgmap v22206: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:03 smithi170 ceph-mon[31212]: pgmap v22207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T21:56:03.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41474.179259 secs 2024-04-21T21:56:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:03 smithi077 ceph-mon[27902]: pgmap v22207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T21:56:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41474.179259 secs 2024-04-21T21:56:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:03 smithi191 ceph-mon[31636]: pgmap v22207: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-21T21:56:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41474.179259 secs 2024-04-21T21:56:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41475.933928 secs 2024-04-21T21:56:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:05 smithi170 ceph-mon[31212]: pgmap v22208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T21:56:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:05 smithi170 ceph-mon[31212]: osdmap e1460: 12 total, 12 up, 12 in 2024-04-21T21:56:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41475.933928 secs 2024-04-21T21:56:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:05 smithi077 ceph-mon[27902]: pgmap v22208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T21:56:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:05 smithi077 ceph-mon[27902]: osdmap e1460: 12 total, 12 up, 12 in 2024-04-21T21:56:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41475.933928 secs 2024-04-21T21:56:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:05 smithi191 ceph-mon[31636]: pgmap v22208: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-21T21:56:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:05 smithi191 ceph-mon[31636]: osdmap e1460: 12 total, 12 up, 12 in 2024-04-21T21:56:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:07 smithi170 ceph-mon[31212]: pgmap v22210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:07 smithi077 ceph-mon[27902]: pgmap v22210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:07 smithi191 ceph-mon[31636]: pgmap v22210: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:08.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41479.179381 secs 2024-04-21T21:56:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41479.179381 secs 2024-04-21T21:56:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41479.179381 secs 2024-04-21T21:56:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:09 smithi170 ceph-mon[31212]: pgmap v22211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:09 smithi077 ceph-mon[27902]: pgmap v22211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:09 smithi191 ceph-mon[31636]: pgmap v22211: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41480.934031 secs 2024-04-21T21:56:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41480.934031 secs 2024-04-21T21:56:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41480.934031 secs 2024-04-21T21:56:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:11 smithi170 ceph-mon[31212]: pgmap v22212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:11.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:11 smithi170 ceph-mon[31212]: osdmap e1461: 12 total, 12 up, 12 in 2024-04-21T21:56:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:11 smithi077 ceph-mon[27902]: pgmap v22212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:11 smithi077 ceph-mon[27902]: osdmap e1461: 12 total, 12 up, 12 in 2024-04-21T21:56:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:11 smithi191 ceph-mon[31636]: pgmap v22212: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:56:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:11 smithi191 ceph-mon[31636]: osdmap e1461: 12 total, 12 up, 12 in 2024-04-21T21:56:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:13 smithi170 ceph-mon[31212]: pgmap v22214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T21:56:13.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41484.179493 secs 2024-04-21T21:56:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:13 smithi077 ceph-mon[27902]: pgmap v22214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T21:56:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41484.179493 secs 2024-04-21T21:56:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:13 smithi191 ceph-mon[31636]: pgmap v22214: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-21T21:56:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41484.179493 secs 2024-04-21T21:56:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41485.934157 secs 2024-04-21T21:56:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:15 smithi170 ceph-mon[31212]: pgmap v22215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T21:56:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41485.934157 secs 2024-04-21T21:56:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:15 smithi077 ceph-mon[27902]: pgmap v22215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T21:56:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41485.934157 secs 2024-04-21T21:56:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:15 smithi191 ceph-mon[31636]: pgmap v22215: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-04-21T21:56:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:17 smithi170 ceph-mon[31212]: pgmap v22216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:17 smithi077 ceph-mon[27902]: pgmap v22216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:17 smithi191 ceph-mon[31636]: pgmap v22216: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41489.179619 secs 2024-04-21T21:56:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41489.179619 secs 2024-04-21T21:56:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41489.179619 secs 2024-04-21T21:56:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:19 smithi170 ceph-mon[31212]: pgmap v22217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:19 smithi077 ceph-mon[27902]: pgmap v22217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:19 smithi191 ceph-mon[31636]: pgmap v22217: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41490.934296 secs 2024-04-21T21:56:20.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41490.934296 secs 2024-04-21T21:56:20.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41490.934296 secs 2024-04-21T21:56:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:21 smithi170 ceph-mon[31212]: pgmap v22218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:21 smithi077 ceph-mon[27902]: pgmap v22218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:21 smithi191 ceph-mon[31636]: pgmap v22218: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:56:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:23 smithi170 ceph-mon[31212]: pgmap v22219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:56:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41494.179735 secs 2024-04-21T21:56:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:23 smithi077 ceph-mon[27902]: pgmap v22219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:56:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41494.179735 secs 2024-04-21T21:56:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:23 smithi191 ceph-mon[31636]: pgmap v22219: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:56:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41494.179735 secs 2024-04-21T21:56:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41495.934416 secs 2024-04-21T21:56:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:25 smithi170 ceph-mon[31212]: pgmap v22220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41495.934416 secs 2024-04-21T21:56:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:25 smithi077 ceph-mon[27902]: pgmap v22220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41495.934416 secs 2024-04-21T21:56:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:25 smithi191 ceph-mon[31636]: pgmap v22220: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:27 smithi077 ceph-mon[27902]: pgmap v22221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:27 smithi191 ceph-mon[31636]: pgmap v22221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:27 smithi170 ceph-mon[31212]: pgmap v22221: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:28.593 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41499.179808 secs 2024-04-21T21:56:28.594 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:28 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:56:28.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41499.179808 secs 2024-04-21T21:56:28.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:28 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:56:28.603 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41499.179808 secs 2024-04-21T21:56:28.603 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:28 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:56:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:29 smithi077 ceph-mon[27902]: pgmap v22222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:29 smithi191 ceph-mon[31636]: pgmap v22222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:29 smithi170 ceph-mon[31212]: pgmap v22222: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41500.934506 secs 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:56:30.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:30 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41500.934506 secs 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:56:30.720 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:30 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41500.934506 secs 2024-04-21T21:56:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.808 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:56:30.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:30 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:56:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: pgmap v22223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:56:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:56:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:56:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:56:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:56:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:31 smithi077 ceph-mon[27902]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:56:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: pgmap v22223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:56:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:56:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:56:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:56:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:56:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:31 smithi191 ceph-mon[31636]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: pgmap v22223: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi077 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi191 to 176.2M 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi191 to 184791756: error parsing value: Value '184791756' is below minimum 939524096 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: Adjusting osd_memory_target on smithi170 to 176.2M 2024-04-21T21:56:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:31 smithi170 ceph-mon[31212]: Unable to set osd_memory_target on smithi170 to 184788889: error parsing value: Value '184788889' is below minimum 939524096 2024-04-21T21:56:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:33 smithi077 ceph-mon[27902]: pgmap v22224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41504.179922 secs 2024-04-21T21:56:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:33 smithi191 ceph-mon[31636]: pgmap v22224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41504.179922 secs 2024-04-21T21:56:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:33 smithi170 ceph-mon[31212]: pgmap v22224: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41504.179922 secs 2024-04-21T21:56:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41690.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41505.934633 secs 2024-04-21T21:56:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:35 smithi077 ceph-mon[27902]: pgmap v22225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41505.934633 secs 2024-04-21T21:56:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:35 smithi191 ceph-mon[31636]: pgmap v22225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41505.934633 secs 2024-04-21T21:56:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:35 smithi170 ceph-mon[31212]: pgmap v22225: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:37 smithi077 ceph-mon[27902]: pgmap v22226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:37 smithi191 ceph-mon[31636]: pgmap v22226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:37 smithi170 ceph-mon[31212]: pgmap v22226: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41509.180043 secs 2024-04-21T21:56:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41509.180043 secs 2024-04-21T21:56:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41509.180043 secs 2024-04-21T21:56:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:39 smithi077 ceph-mon[27902]: pgmap v22227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:39 smithi191 ceph-mon[31636]: pgmap v22227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:39 smithi170 ceph-mon[31212]: pgmap v22227: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41510.934768 secs 2024-04-21T21:56:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41510.934768 secs 2024-04-21T21:56:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41510.934768 secs 2024-04-21T21:56:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:41 smithi077 ceph-mon[27902]: pgmap v22228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:41 smithi191 ceph-mon[31636]: pgmap v22228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:41 smithi170 ceph-mon[31212]: pgmap v22228: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:43 smithi077 ceph-mon[27902]: pgmap v22229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41514.180163 secs 2024-04-21T21:56:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:43 smithi191 ceph-mon[31636]: pgmap v22229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41514.180163 secs 2024-04-21T21:56:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:43 smithi170 ceph-mon[31212]: pgmap v22229: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41514.180163 secs 2024-04-21T21:56:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41515.934900 secs 2024-04-21T21:56:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:45 smithi077 ceph-mon[27902]: pgmap v22230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41515.934900 secs 2024-04-21T21:56:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:45 smithi191 ceph-mon[31636]: pgmap v22230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41515.934900 secs 2024-04-21T21:56:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:45 smithi170 ceph-mon[31212]: pgmap v22230: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:47.609 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:47 smithi170 ceph-mon[31212]: pgmap v22231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:47 smithi077 ceph-mon[27902]: pgmap v22231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:47 smithi191 ceph-mon[31636]: pgmap v22231: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:48.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41519.180285 secs 2024-04-21T21:56:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41519.180285 secs 2024-04-21T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41519.180285 secs 2024-04-21T21:56:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:49 smithi077 ceph-mon[27902]: pgmap v22232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:49 smithi191 ceph-mon[31636]: pgmap v22232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:49 smithi170 ceph-mon[31212]: pgmap v22232: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41520.934989 secs 2024-04-21T21:56:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41520.934989 secs 2024-04-21T21:56:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41520.934989 secs 2024-04-21T21:56:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:51 smithi077 ceph-mon[27902]: pgmap v22233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:51 smithi191 ceph-mon[31636]: pgmap v22233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:51.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:51 smithi170 ceph-mon[31212]: pgmap v22233: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:53 smithi077 ceph-mon[27902]: pgmap v22234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41524.180398 secs 2024-04-21T21:56:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:53 smithi191 ceph-mon[31636]: pgmap v22234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41524.180398 secs 2024-04-21T21:56:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:53 smithi170 ceph-mon[31212]: pgmap v22234: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41524.180398 secs 2024-04-21T21:56:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:56:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41525.935128 secs 2024-04-21T21:56:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:55 smithi077 ceph-mon[27902]: pgmap v22235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41525.935128 secs 2024-04-21T21:56:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:55 smithi191 ceph-mon[31636]: pgmap v22235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41525.935128 secs 2024-04-21T21:56:55.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:55 smithi170 ceph-mon[31212]: pgmap v22235: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:57 smithi077 ceph-mon[27902]: pgmap v22236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:57 smithi191 ceph-mon[31636]: pgmap v22236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:57 smithi170 ceph-mon[31212]: pgmap v22236: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:56:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41529.180495 secs 2024-04-21T21:56:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41529.180495 secs 2024-04-21T21:56:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41529.180495 secs 2024-04-21T21:56:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:59 smithi191 ceph-mon[31636]: pgmap v22237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:59.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:56:59 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41530.935265 secs 2024-04-21T21:56:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:59 smithi170 ceph-mon[31212]: pgmap v22237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:56:59 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41530.935265 secs 2024-04-21T21:56:59.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:59 smithi077 ceph-mon[27902]: pgmap v22237: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:56:59.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:56:59 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41530.935265 secs 2024-04-21T21:57:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:01 smithi191 ceph-mon[31636]: pgmap v22238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:01 smithi170 ceph-mon[31212]: pgmap v22238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:01.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:01 smithi077 ceph-mon[27902]: pgmap v22238: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:03 smithi191 ceph-mon[31636]: pgmap v22239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T21:57:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41534.180607 secs 2024-04-21T21:57:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:03 smithi170 ceph-mon[31212]: pgmap v22239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T21:57:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41534.180607 secs 2024-04-21T21:57:03.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:03 smithi077 ceph-mon[27902]: pgmap v22239: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-04-21T21:57:03.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41534.180607 secs 2024-04-21T21:57:04.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:04 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41535.935411 secs 2024-04-21T21:57:04.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:04 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41535.935411 secs 2024-04-21T21:57:04.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:04 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41535.935411 secs 2024-04-21T21:57:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:05 smithi191 ceph-mon[31636]: pgmap v22240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T21:57:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:05 smithi191 ceph-mon[31636]: osdmap e1462: 12 total, 12 up, 12 in 2024-04-21T21:57:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:05 smithi170 ceph-mon[31212]: pgmap v22240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T21:57:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:05 smithi170 ceph-mon[31212]: osdmap e1462: 12 total, 12 up, 12 in 2024-04-21T21:57:05.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:05 smithi077 ceph-mon[27902]: pgmap v22240: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T21:57:05.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:05 smithi077 ceph-mon[27902]: osdmap e1462: 12 total, 12 up, 12 in 2024-04-21T21:57:06.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:06 smithi191 ceph-mon[31636]: pgmap v22242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:06.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:06 smithi170 ceph-mon[31212]: pgmap v22242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:06.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:06 smithi077 ceph-mon[27902]: pgmap v22242: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:07.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:07 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41539.180722 secs 2024-04-21T21:57:08.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:07 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41539.180722 secs 2024-04-21T21:57:08.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:07 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41539.180722 secs 2024-04-21T21:57:08.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:08 smithi191 ceph-mon[31636]: pgmap v22243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:09.037 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:08 smithi077 ceph-mon[27902]: pgmap v22243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:09.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:08 smithi170 ceph-mon[31212]: pgmap v22243: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:09.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:09 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41540.935506 secs 2024-04-21T21:57:10.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:09 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41540.935506 secs 2024-04-21T21:57:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:10.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:09 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41540.935506 secs 2024-04-21T21:57:10.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:10 smithi191 ceph-mon[31636]: pgmap v22244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:11.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:10 smithi170 ceph-mon[31212]: pgmap v22244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:11.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:10 smithi077 ceph-mon[27902]: pgmap v22244: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:57:11.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:11 smithi191 ceph-mon[31636]: osdmap e1463: 12 total, 12 up, 12 in 2024-04-21T21:57:12.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:11 smithi170 ceph-mon[31212]: osdmap e1463: 12 total, 12 up, 12 in 2024-04-21T21:57:12.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:11 smithi077 ceph-mon[27902]: osdmap e1463: 12 total, 12 up, 12 in 2024-04-21T21:57:12.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:12 smithi191 ceph-mon[31636]: pgmap v22246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T21:57:12.969 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:12 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41544.180842 secs 2024-04-21T21:57:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:12 smithi170 ceph-mon[31212]: pgmap v22246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T21:57:13.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:12 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41544.180842 secs 2024-04-21T21:57:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:12 smithi077 ceph-mon[27902]: pgmap v22246: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-04-21T21:57:13.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:12 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41544.180842 secs 2024-04-21T21:57:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:15.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41545.935623 secs 2024-04-21T21:57:15.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:15 smithi191 ceph-mon[31636]: pgmap v22247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 25 op/s 2024-04-21T21:57:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41545.935623 secs 2024-04-21T21:57:15.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:15 smithi170 ceph-mon[31212]: pgmap v22247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 25 op/s 2024-04-21T21:57:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41545.935623 secs 2024-04-21T21:57:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:15 smithi077 ceph-mon[27902]: pgmap v22247: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 25 op/s 2024-04-21T21:57:17.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:17 smithi191 ceph-mon[31636]: pgmap v22248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:17.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:17 smithi170 ceph-mon[31212]: pgmap v22248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:17 smithi077 ceph-mon[27902]: pgmap v22248: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:18.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41549.180925 secs 2024-04-21T21:57:18.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41549.180925 secs 2024-04-21T21:57:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41549.180925 secs 2024-04-21T21:57:19.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:19 smithi191 ceph-mon[31636]: pgmap v22249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:19.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:19 smithi170 ceph-mon[31212]: pgmap v22249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:19 smithi077 ceph-mon[27902]: pgmap v22249: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:20.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41550.935746 secs 2024-04-21T21:57:20.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41550.935746 secs 2024-04-21T21:57:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41550.935746 secs 2024-04-21T21:57:21.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:21 smithi191 ceph-mon[31636]: pgmap v22250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:21.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:21 smithi170 ceph-mon[31212]: pgmap v22250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:21 smithi077 ceph-mon[27902]: pgmap v22250: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:57:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:23 smithi191 ceph-mon[31636]: pgmap v22251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:57:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41554.181003 secs 2024-04-21T21:57:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:23 smithi170 ceph-mon[31212]: pgmap v22251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:57:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41554.181003 secs 2024-04-21T21:57:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:23 smithi077 ceph-mon[27902]: pgmap v22251: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:57:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41554.181003 secs 2024-04-21T21:57:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:25.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41555.935818 secs 2024-04-21T21:57:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:25 smithi191 ceph-mon[31636]: pgmap v22252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41555.935818 secs 2024-04-21T21:57:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:25 smithi170 ceph-mon[31212]: pgmap v22252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41555.935818 secs 2024-04-21T21:57:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:25 smithi077 ceph-mon[27902]: pgmap v22252: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:27 smithi170 ceph-mon[31212]: pgmap v22253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:27 smithi077 ceph-mon[27902]: pgmap v22253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:27 smithi191 ceph-mon[31636]: pgmap v22253: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41559.181118 secs 2024-04-21T21:57:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41559.181118 secs 2024-04-21T21:57:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41559.181118 secs 2024-04-21T21:57:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:29 smithi170 ceph-mon[31212]: pgmap v22254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:29 smithi077 ceph-mon[27902]: pgmap v22254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:29 smithi191 ceph-mon[31636]: pgmap v22254: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41560.935920 secs 2024-04-21T21:57:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41560.935920 secs 2024-04-21T21:57:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41560.935920 secs 2024-04-21T21:57:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:31 smithi170 ceph-mon[31212]: pgmap v22255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:31.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:57:31.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:31.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:31 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:31 smithi077 ceph-mon[27902]: pgmap v22255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:57:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:31.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:31 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:31 smithi191 ceph-mon[31636]: pgmap v22255: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:57:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:31.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:31 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:57:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:57:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:57:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:57:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:57:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:57:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:57:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:33 smithi170 ceph-mon[31212]: pgmap v22256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41564.181232 secs 2024-04-21T21:57:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:33 smithi077 ceph-mon[27902]: pgmap v22256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41564.181232 secs 2024-04-21T21:57:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:33 smithi191 ceph-mon[31636]: pgmap v22256: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41564.181232 secs 2024-04-21T21:57:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41565.935986 secs 2024-04-21T21:57:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:35 smithi170 ceph-mon[31212]: pgmap v22257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41565.935986 secs 2024-04-21T21:57:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:35 smithi077 ceph-mon[27902]: pgmap v22257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41565.935986 secs 2024-04-21T21:57:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:35 smithi191 ceph-mon[31636]: pgmap v22257: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:37 smithi170 ceph-mon[31212]: pgmap v22258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:37 smithi077 ceph-mon[27902]: pgmap v22258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:37 smithi191 ceph-mon[31636]: pgmap v22258: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41569.181348 secs 2024-04-21T21:57:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41569.181348 secs 2024-04-21T21:57:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41569.181348 secs 2024-04-21T21:57:39.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:39 smithi077 ceph-mon[27902]: pgmap v22259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:39 smithi170 ceph-mon[31212]: pgmap v22259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:39.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:39 smithi191 ceph-mon[31636]: pgmap v22259: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41570.936101 secs 2024-04-21T21:57:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41570.936101 secs 2024-04-21T21:57:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41570.936101 secs 2024-04-21T21:57:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:41 smithi170 ceph-mon[31212]: pgmap v22260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:41 smithi077 ceph-mon[27902]: pgmap v22260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:41 smithi191 ceph-mon[31636]: pgmap v22260: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:43 smithi170 ceph-mon[31212]: pgmap v22261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41574.181466 secs 2024-04-21T21:57:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:43 smithi077 ceph-mon[27902]: pgmap v22261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41574.181466 secs 2024-04-21T21:57:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:43 smithi191 ceph-mon[31636]: pgmap v22261: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41574.181466 secs 2024-04-21T21:57:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41575.936194 secs 2024-04-21T21:57:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:45 smithi170 ceph-mon[31212]: pgmap v22262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41575.936194 secs 2024-04-21T21:57:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:45 smithi077 ceph-mon[27902]: pgmap v22262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41575.936194 secs 2024-04-21T21:57:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:45 smithi191 ceph-mon[31636]: pgmap v22262: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:47 smithi170 ceph-mon[31212]: pgmap v22263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:47 smithi077 ceph-mon[27902]: pgmap v22263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:47 smithi191 ceph-mon[31636]: pgmap v22263: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41579.181580 secs 2024-04-21T21:57:48.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41579.181580 secs 2024-04-21T21:57:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41579.181580 secs 2024-04-21T21:57:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:49 smithi170 ceph-mon[31212]: pgmap v22264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:49 smithi077 ceph-mon[27902]: pgmap v22264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:49 smithi191 ceph-mon[31636]: pgmap v22264: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41580.936338 secs 2024-04-21T21:57:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41580.936338 secs 2024-04-21T21:57:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41580.936338 secs 2024-04-21T21:57:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:51 smithi170 ceph-mon[31212]: pgmap v22265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:51 smithi077 ceph-mon[27902]: pgmap v22265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:51 smithi191 ceph-mon[31636]: pgmap v22265: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:53 smithi170 ceph-mon[31212]: pgmap v22266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41584.181712 secs 2024-04-21T21:57:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:53 smithi077 ceph-mon[27902]: pgmap v22266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41584.181712 secs 2024-04-21T21:57:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:53 smithi191 ceph-mon[31636]: pgmap v22266: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41584.181712 secs 2024-04-21T21:57:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:57:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41585.936469 secs 2024-04-21T21:57:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:55 smithi170 ceph-mon[31212]: pgmap v22267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41585.936469 secs 2024-04-21T21:57:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:55 smithi077 ceph-mon[27902]: pgmap v22267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41585.936469 secs 2024-04-21T21:57:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:55 smithi191 ceph-mon[31636]: pgmap v22267: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:57 smithi170 ceph-mon[31212]: pgmap v22268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:57 smithi077 ceph-mon[27902]: pgmap v22268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:57.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:57 smithi191 ceph-mon[31636]: pgmap v22268: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:57:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41589.181833 secs 2024-04-21T21:57:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41589.181833 secs 2024-04-21T21:57:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41589.181833 secs 2024-04-21T21:57:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:57:59 smithi170 ceph-mon[31212]: pgmap v22269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:57:59 smithi077 ceph-mon[27902]: pgmap v22269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:57:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:57:59 smithi191 ceph-mon[31636]: pgmap v22269: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41590.936590 secs 2024-04-21T21:58:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41590.936590 secs 2024-04-21T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41590.936590 secs 2024-04-21T21:58:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:01 smithi077 ceph-mon[27902]: pgmap v22270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:01 smithi191 ceph-mon[31636]: pgmap v22270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:01 smithi170 ceph-mon[31212]: pgmap v22270: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:03 smithi077 ceph-mon[27902]: pgmap v22271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41594.181943 secs 2024-04-21T21:58:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:03 smithi191 ceph-mon[31636]: pgmap v22271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41594.181943 secs 2024-04-21T21:58:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:03 smithi170 ceph-mon[31212]: pgmap v22271: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41594.181943 secs 2024-04-21T21:58:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41595.936653 secs 2024-04-21T21:58:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:05 smithi077 ceph-mon[27902]: pgmap v22272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:05 smithi077 ceph-mon[27902]: osdmap e1464: 12 total, 12 up, 12 in 2024-04-21T21:58:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41595.936653 secs 2024-04-21T21:58:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:05 smithi191 ceph-mon[31636]: pgmap v22272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:05 smithi191 ceph-mon[31636]: osdmap e1464: 12 total, 12 up, 12 in 2024-04-21T21:58:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41595.936653 secs 2024-04-21T21:58:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:05 smithi170 ceph-mon[31212]: pgmap v22272: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:05 smithi170 ceph-mon[31212]: osdmap e1464: 12 total, 12 up, 12 in 2024-04-21T21:58:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:07 smithi077 ceph-mon[27902]: pgmap v22274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:07 smithi191 ceph-mon[31636]: pgmap v22274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:07 smithi170 ceph-mon[31212]: pgmap v22274: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41599.182050 secs 2024-04-21T21:58:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41599.182050 secs 2024-04-21T21:58:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41599.182050 secs 2024-04-21T21:58:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:09 smithi077 ceph-mon[27902]: pgmap v22275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:09 smithi191 ceph-mon[31636]: pgmap v22275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:09 smithi170 ceph-mon[31212]: pgmap v22275: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41600.936786 secs 2024-04-21T21:58:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41600.936786 secs 2024-04-21T21:58:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41600.936786 secs 2024-04-21T21:58:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:11 smithi077 ceph-mon[27902]: pgmap v22276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:11 smithi077 ceph-mon[27902]: osdmap e1465: 12 total, 12 up, 12 in 2024-04-21T21:58:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:11 smithi191 ceph-mon[31636]: pgmap v22276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:11 smithi191 ceph-mon[31636]: osdmap e1465: 12 total, 12 up, 12 in 2024-04-21T21:58:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:11 smithi170 ceph-mon[31212]: pgmap v22276: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:58:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:11 smithi170 ceph-mon[31212]: osdmap e1465: 12 total, 12 up, 12 in 2024-04-21T21:58:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:13 smithi077 ceph-mon[27902]: pgmap v22278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:58:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41604.182171 secs 2024-04-21T21:58:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:13 smithi191 ceph-mon[31636]: pgmap v22278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:58:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41604.182171 secs 2024-04-21T21:58:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:13 smithi170 ceph-mon[31212]: pgmap v22278: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:58:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41604.182171 secs 2024-04-21T21:58:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41605.936906 secs 2024-04-21T21:58:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:15 smithi077 ceph-mon[27902]: pgmap v22279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:58:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41605.936906 secs 2024-04-21T21:58:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:15 smithi191 ceph-mon[31636]: pgmap v22279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:58:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41605.936906 secs 2024-04-21T21:58:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:15 smithi170 ceph-mon[31212]: pgmap v22279: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:58:16.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:16 smithi191 ceph-mon[31636]: pgmap v22280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:17.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:16 smithi170 ceph-mon[31212]: pgmap v22280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:17.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:16 smithi077 ceph-mon[27902]: pgmap v22280: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:17.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:17 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41609.182251 secs 2024-04-21T21:58:18.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:17 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41609.182251 secs 2024-04-21T21:58:18.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:17 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41609.182251 secs 2024-04-21T21:58:19.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:18 smithi170 ceph-mon[31212]: pgmap v22281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:19.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:18 smithi077 ceph-mon[27902]: pgmap v22281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:19.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:18 smithi191 ceph-mon[31636]: pgmap v22281: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:20.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:19 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41610.937022 secs 2024-04-21T21:58:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:20.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:19 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41610.937022 secs 2024-04-21T21:58:20.219 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:19 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41610.937022 secs 2024-04-21T21:58:21.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:20 smithi170 ceph-mon[31212]: pgmap v22282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:21.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:20 smithi077 ceph-mon[27902]: pgmap v22282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:21.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:20 smithi191 ceph-mon[31636]: pgmap v22282: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:58:23.468 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:23 smithi191 ceph-mon[31636]: pgmap v22283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:58:23.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41614.182368 secs 2024-04-21T21:58:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:23 smithi170 ceph-mon[31212]: pgmap v22283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:58:23.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41614.182368 secs 2024-04-21T21:58:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:23 smithi077 ceph-mon[27902]: pgmap v22283: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:58:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41614.182368 secs 2024-04-21T21:58:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41615.937173 secs 2024-04-21T21:58:25.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:25 smithi191 ceph-mon[31636]: pgmap v22284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41615.937173 secs 2024-04-21T21:58:25.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:25 smithi170 ceph-mon[31212]: pgmap v22284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41615.937173 secs 2024-04-21T21:58:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:25 smithi077 ceph-mon[27902]: pgmap v22284: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:27.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:27 smithi170 ceph-mon[31212]: pgmap v22285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:27 smithi077 ceph-mon[27902]: pgmap v22285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:27 smithi191 ceph-mon[31636]: pgmap v22285: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:28.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41619.182511 secs 2024-04-21T21:58:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41619.182511 secs 2024-04-21T21:58:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41619.182511 secs 2024-04-21T21:58:29.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:29 smithi170 ceph-mon[31212]: pgmap v22286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:29 smithi077 ceph-mon[27902]: pgmap v22286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:29.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:29 smithi191 ceph-mon[31636]: pgmap v22286: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41805.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:30.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41620.937296 secs 2024-04-21T21:58:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41620.937296 secs 2024-04-21T21:58:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41620.937296 secs 2024-04-21T21:58:31.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:31 smithi170 ceph-mon[31212]: pgmap v22287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:31 smithi077 ceph-mon[27902]: pgmap v22287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:31 smithi191 ceph-mon[31636]: pgmap v22287: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:58:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:32 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:58:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:32 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:58:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:32.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:32 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:33 smithi170 ceph-mon[31212]: pgmap v22288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41624.182603 secs 2024-04-21T21:58:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:58:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:58:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:33 smithi077 ceph-mon[27902]: pgmap v22288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41624.182603 secs 2024-04-21T21:58:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:58:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:58:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:33 smithi191 ceph-mon[31636]: pgmap v22288: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41624.182603 secs 2024-04-21T21:58:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:58:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:58:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:58:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41625.937388 secs 2024-04-21T21:58:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:35 smithi170 ceph-mon[31212]: pgmap v22289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41625.937388 secs 2024-04-21T21:58:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:35 smithi077 ceph-mon[27902]: pgmap v22289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41625.937388 secs 2024-04-21T21:58:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:35 smithi191 ceph-mon[31636]: pgmap v22289: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:37 smithi170 ceph-mon[31212]: pgmap v22290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:37 smithi077 ceph-mon[27902]: pgmap v22290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:37 smithi191 ceph-mon[31636]: pgmap v22290: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41629.182726 secs 2024-04-21T21:58:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41629.182726 secs 2024-04-21T21:58:38.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41629.182726 secs 2024-04-21T21:58:39.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:39 smithi077 ceph-mon[27902]: pgmap v22291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:39 smithi170 ceph-mon[31212]: pgmap v22291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:39 smithi191 ceph-mon[31636]: pgmap v22291: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:40.558 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41630.937545 secs 2024-04-21T21:58:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41630.937545 secs 2024-04-21T21:58:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41630.937545 secs 2024-04-21T21:58:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:41 smithi170 ceph-mon[31212]: pgmap v22292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:41 smithi077 ceph-mon[27902]: pgmap v22292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:41 smithi191 ceph-mon[31636]: pgmap v22292: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:43 smithi170 ceph-mon[31212]: pgmap v22293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41634.182848 secs 2024-04-21T21:58:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:43 smithi077 ceph-mon[27902]: pgmap v22293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41634.182848 secs 2024-04-21T21:58:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:43 smithi191 ceph-mon[31636]: pgmap v22293: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41634.182848 secs 2024-04-21T21:58:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41635.937682 secs 2024-04-21T21:58:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:45 smithi170 ceph-mon[31212]: pgmap v22294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41635.937682 secs 2024-04-21T21:58:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:45 smithi077 ceph-mon[27902]: pgmap v22294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41635.937682 secs 2024-04-21T21:58:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:45 smithi191 ceph-mon[31636]: pgmap v22294: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:47 smithi170 ceph-mon[31212]: pgmap v22295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:47 smithi077 ceph-mon[27902]: pgmap v22295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:47 smithi191 ceph-mon[31636]: pgmap v22295: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41639.182916 secs 2024-04-21T21:58:48.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41639.182916 secs 2024-04-21T21:58:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41639.182916 secs 2024-04-21T21:58:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:49 smithi170 ceph-mon[31212]: pgmap v22296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:49 smithi077 ceph-mon[27902]: pgmap v22296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:49 smithi191 ceph-mon[31636]: pgmap v22296: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:50.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41640.937814 secs 2024-04-21T21:58:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41640.937814 secs 2024-04-21T21:58:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41640.937814 secs 2024-04-21T21:58:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:51 smithi170 ceph-mon[31212]: pgmap v22297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:51 smithi077 ceph-mon[27902]: pgmap v22297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:51 smithi191 ceph-mon[31636]: pgmap v22297: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:53 smithi170 ceph-mon[31212]: pgmap v22298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41644.183072 secs 2024-04-21T21:58:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:53 smithi077 ceph-mon[27902]: pgmap v22298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41644.183072 secs 2024-04-21T21:58:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:53 smithi191 ceph-mon[31636]: pgmap v22298: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41644.183072 secs 2024-04-21T21:58:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.467+0000 7efd7d509640 1 -- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 msgr2=0x563726a12c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000503) for more than 900000000 us, fault. 2024-04-21T21:58:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.467+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=READY pgs=134 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-21T21:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.467+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 unknown :-1 s=BANNER_CONNECTING pgs=134 cs=45 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:58:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.468+0000 7efd7d509640 1 --2- 172.21.15.77:0/826097124 >> [v2:172.21.15.191:6838/2863843162,v1:172.21.15.191:6839/2863843162] conn(0x563726a107e0 0x563726a12c00 crc :-1 s=READY pgs=134 cs=45 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea71e3be0c7d270 server_cookie=9ca1c0318c1d4f04 in_seq=0 out_seq=0 2024-04-21T21:58:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.468+0000 7efd60ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.191:6838/2863843162 2024-04-21T21:58:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T21:58:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T21:58:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd7002b070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7efd70032f40 tx=0x7efd7002b070 comp rx=0 tx=0).stop 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.77:6800/3868346371, fault. 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 msgr2=0x7efd640b0230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a58f0 0x7efd640b0230 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd6a7fc640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T21:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:58:54.559+0000 7efd7dd0a640 1 --2- 172.21.15.77:0/823123653 >> [v2:172.21.15.77:6800/3868346371,v1:172.21.15.77:6801/3868346371] conn(0x7efd640a60b0 0x7efd640b2780 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7efd70012060 tx=0x7efd7002b040 comp rx=0 tx=0).ready entity=mgr.15315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T21:58:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:58:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41645.937935 secs 2024-04-21T21:58:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:55 smithi170 ceph-mon[31212]: pgmap v22299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41645.937935 secs 2024-04-21T21:58:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:55 smithi077 ceph-mon[27902]: pgmap v22299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41645.937935 secs 2024-04-21T21:58:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:55 smithi191 ceph-mon[31636]: pgmap v22299: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:57 smithi077 ceph-mon[27902]: pgmap v22300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:57 smithi191 ceph-mon[31636]: pgmap v22300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:57.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:57 smithi170 ceph-mon[31212]: pgmap v22300: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:58:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41649.183150 secs 2024-04-21T21:58:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41649.183150 secs 2024-04-21T21:58:58.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41649.183150 secs 2024-04-21T21:58:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:58:59 smithi077 ceph-mon[27902]: pgmap v22301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:58:59 smithi191 ceph-mon[31636]: pgmap v22301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:58:59.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:58:59 smithi170 ceph-mon[31212]: pgmap v22301: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:59:00.115+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:59:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:59:00.115+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:59:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:59:00.116+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 318 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T21:59:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T21:59:00.116+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 318 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T21:59:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41650.937999 secs 2024-04-21T21:59:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41650.937999 secs 2024-04-21T21:59:00.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41650.937999 secs 2024-04-21T21:59:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:01 smithi077 ceph-mon[27902]: pgmap v22302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:01 smithi191 ceph-mon[31636]: pgmap v22302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:01.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:01 smithi170 ceph-mon[31212]: pgmap v22302: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:03 smithi077 ceph-mon[27902]: pgmap v22303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41654.183260 secs 2024-04-21T21:59:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:03 smithi191 ceph-mon[31636]: pgmap v22303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:03.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41654.183260 secs 2024-04-21T21:59:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:03 smithi170 ceph-mon[31212]: pgmap v22303: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41654.183260 secs 2024-04-21T21:59:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41655.938066 secs 2024-04-21T21:59:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:05 smithi077 ceph-mon[27902]: pgmap v22304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:05 smithi077 ceph-mon[27902]: osdmap e1466: 12 total, 12 up, 12 in 2024-04-21T21:59:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41655.938066 secs 2024-04-21T21:59:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:05 smithi191 ceph-mon[31636]: pgmap v22304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:05 smithi191 ceph-mon[31636]: osdmap e1466: 12 total, 12 up, 12 in 2024-04-21T21:59:05.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41655.938066 secs 2024-04-21T21:59:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:05 smithi170 ceph-mon[31212]: pgmap v22304: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:05 smithi170 ceph-mon[31212]: osdmap e1466: 12 total, 12 up, 12 in 2024-04-21T21:59:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:07 smithi077 ceph-mon[27902]: pgmap v22306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:07 smithi191 ceph-mon[31636]: pgmap v22306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:07 smithi170 ceph-mon[31212]: pgmap v22306: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41659.183361 secs 2024-04-21T21:59:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41659.183361 secs 2024-04-21T21:59:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41659.183361 secs 2024-04-21T21:59:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:09 smithi077 ceph-mon[27902]: pgmap v22307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:09 smithi191 ceph-mon[31636]: pgmap v22307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:09 smithi170 ceph-mon[31212]: pgmap v22307: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41660.938199 secs 2024-04-21T21:59:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41660.938199 secs 2024-04-21T21:59:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41660.938199 secs 2024-04-21T21:59:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:11 smithi077 ceph-mon[27902]: pgmap v22308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:11 smithi077 ceph-mon[27902]: osdmap e1467: 12 total, 12 up, 12 in 2024-04-21T21:59:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:11 smithi191 ceph-mon[31636]: pgmap v22308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:11.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:11 smithi191 ceph-mon[31636]: osdmap e1467: 12 total, 12 up, 12 in 2024-04-21T21:59:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:11 smithi170 ceph-mon[31212]: pgmap v22308: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T21:59:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:11 smithi170 ceph-mon[31212]: osdmap e1467: 12 total, 12 up, 12 in 2024-04-21T21:59:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:13 smithi077 ceph-mon[27902]: pgmap v22310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:59:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41664.183482 secs 2024-04-21T21:59:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:13 smithi191 ceph-mon[31636]: pgmap v22310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:59:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41664.183482 secs 2024-04-21T21:59:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:13 smithi170 ceph-mon[31212]: pgmap v22310: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T21:59:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41664.183482 secs 2024-04-21T21:59:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41665.938332 secs 2024-04-21T21:59:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:15 smithi077 ceph-mon[27902]: pgmap v22311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:59:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41665.938332 secs 2024-04-21T21:59:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:15 smithi191 ceph-mon[31636]: pgmap v22311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:59:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41665.938332 secs 2024-04-21T21:59:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:15 smithi170 ceph-mon[31212]: pgmap v22311: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T21:59:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:17 smithi077 ceph-mon[27902]: pgmap v22312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:17 smithi191 ceph-mon[31636]: pgmap v22312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:17.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:17 smithi170 ceph-mon[31212]: pgmap v22312: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:18.621 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41669.183595 secs 2024-04-21T21:59:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41669.183595 secs 2024-04-21T21:59:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41669.183595 secs 2024-04-21T21:59:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:19 smithi077 ceph-mon[27902]: pgmap v22313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:19 smithi191 ceph-mon[31636]: pgmap v22313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:19 smithi170 ceph-mon[31212]: pgmap v22313: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:20.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41670.938465 secs 2024-04-21T21:59:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41670.938465 secs 2024-04-21T21:59:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41670.938465 secs 2024-04-21T21:59:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:21 smithi077 ceph-mon[27902]: pgmap v22314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:21 smithi191 ceph-mon[31636]: pgmap v22314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:21.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:21 smithi170 ceph-mon[31212]: pgmap v22314: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T21:59:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:23 smithi077 ceph-mon[27902]: pgmap v22315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:59:23.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41674.183707 secs 2024-04-21T21:59:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:23 smithi191 ceph-mon[31636]: pgmap v22315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:59:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41674.183707 secs 2024-04-21T21:59:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:23 smithi170 ceph-mon[31212]: pgmap v22315: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T21:59:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41674.183707 secs 2024-04-21T21:59:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41675.938599 secs 2024-04-21T21:59:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:25 smithi077 ceph-mon[27902]: pgmap v22316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41675.938599 secs 2024-04-21T21:59:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:25 smithi191 ceph-mon[31636]: pgmap v22316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41675.938599 secs 2024-04-21T21:59:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:25 smithi170 ceph-mon[31212]: pgmap v22316: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:26 smithi170 ceph-mon[31212]: pgmap v22317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:26 smithi077 ceph-mon[27902]: pgmap v22317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:26 smithi191 ceph-mon[31636]: pgmap v22317: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41679.183796 secs 2024-04-21T21:59:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41679.183796 secs 2024-04-21T21:59:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41679.183796 secs 2024-04-21T21:59:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:28 smithi170 ceph-mon[31212]: pgmap v22318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:28 smithi077 ceph-mon[27902]: pgmap v22318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:28 smithi191 ceph-mon[31636]: pgmap v22318: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:30.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41680.938736 secs 2024-04-21T21:59:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41680.938736 secs 2024-04-21T21:59:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41680.938736 secs 2024-04-21T21:59:31.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:30 smithi170 ceph-mon[31212]: pgmap v22319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:30 smithi077 ceph-mon[27902]: pgmap v22319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:30 smithi191 ceph-mon[31636]: pgmap v22319: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:33 smithi170 ceph-mon[31212]: pgmap v22320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41684.183882 secs 2024-04-21T21:59:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:33 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:59:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:33 smithi077 ceph-mon[27902]: pgmap v22320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41684.183882 secs 2024-04-21T21:59:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:33 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:59:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:33 smithi191 ceph-mon[31636]: pgmap v22320: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41684.183882 secs 2024-04-21T21:59:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:33 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T21:59:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:59:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:59:34.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:59:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:59:34.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:59:34.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:59:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T21:59:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T21:59:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T21:59:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41685.938849 secs 2024-04-21T21:59:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:35 smithi170 ceph-mon[31212]: pgmap v22321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41685.938849 secs 2024-04-21T21:59:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:35 smithi077 ceph-mon[27902]: pgmap v22321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41685.938849 secs 2024-04-21T21:59:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:35 smithi191 ceph-mon[31636]: pgmap v22321: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:37.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:37 smithi170 ceph-mon[31212]: pgmap v22322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:37 smithi077 ceph-mon[27902]: pgmap v22322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:37 smithi191 ceph-mon[31636]: pgmap v22322: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:38.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41689.183980 secs 2024-04-21T21:59:38.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41689.183980 secs 2024-04-21T21:59:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41689.183980 secs 2024-04-21T21:59:39.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:39 smithi077 ceph-mon[27902]: pgmap v22323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:39.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:39 smithi170 ceph-mon[31212]: pgmap v22323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:39 smithi191 ceph-mon[31636]: pgmap v22323: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:40.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41690.938987 secs 2024-04-21T21:59:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41690.938987 secs 2024-04-21T21:59:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41690.938987 secs 2024-04-21T21:59:41.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:41 smithi170 ceph-mon[31212]: pgmap v22324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:41 smithi077 ceph-mon[27902]: pgmap v22324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:41 smithi191 ceph-mon[31636]: pgmap v22324: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:43 smithi170 ceph-mon[31212]: pgmap v22325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:43.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41694.184100 secs 2024-04-21T21:59:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:43 smithi077 ceph-mon[27902]: pgmap v22325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:43.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41694.184100 secs 2024-04-21T21:59:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:43 smithi191 ceph-mon[31636]: pgmap v22325: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41694.184100 secs 2024-04-21T21:59:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41695.939122 secs 2024-04-21T21:59:45.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:45 smithi170 ceph-mon[31212]: pgmap v22326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41695.939122 secs 2024-04-21T21:59:45.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:45 smithi077 ceph-mon[27902]: pgmap v22326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41695.939122 secs 2024-04-21T21:59:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:45 smithi191 ceph-mon[31636]: pgmap v22326: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:47.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:47 smithi170 ceph-mon[31212]: pgmap v22327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:47.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:47 smithi077 ceph-mon[27902]: pgmap v22327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:47 smithi191 ceph-mon[31636]: pgmap v22327: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:48.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41699.184213 secs 2024-04-21T21:59:48.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41699.184213 secs 2024-04-21T21:59:48.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41699.184213 secs 2024-04-21T21:59:49.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:49 smithi170 ceph-mon[31212]: pgmap v22328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:59:49.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:49 smithi077 ceph-mon[27902]: pgmap v22328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:59:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:49 smithi191 ceph-mon[31636]: pgmap v22328: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:59:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:50.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41700.939211 secs 2024-04-21T21:59:50.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41700.939211 secs 2024-04-21T21:59:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41700.939211 secs 2024-04-21T21:59:51.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:51 smithi170 ceph-mon[31212]: pgmap v22329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-21T21:59:51.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:51 smithi077 ceph-mon[27902]: pgmap v22329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-21T21:59:51.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:51 smithi191 ceph-mon[31636]: pgmap v22329: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-21T21:59:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:53 smithi170 ceph-mon[31212]: pgmap v22330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41704.184323 secs 2024-04-21T21:59:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:53 smithi077 ceph-mon[27902]: pgmap v22330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41704.184323 secs 2024-04-21T21:59:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:53 smithi191 ceph-mon[31636]: pgmap v22330: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41704.184323 secs 2024-04-21T21:59:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T21:59:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41705.939326 secs 2024-04-21T21:59:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:55 smithi170 ceph-mon[31212]: pgmap v22331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:59:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41705.939326 secs 2024-04-21T21:59:55.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:55 smithi077 ceph-mon[27902]: pgmap v22331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:59:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41705.939326 secs 2024-04-21T21:59:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:55 smithi191 ceph-mon[31636]: pgmap v22331: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T21:59:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:57 smithi170 ceph-mon[31212]: pgmap v22332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:57 smithi077 ceph-mon[27902]: pgmap v22332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:57 smithi191 ceph-mon[31636]: pgmap v22332: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T21:59:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41709.184421 secs 2024-04-21T21:59:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41709.184421 secs 2024-04-21T21:59:58.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41709.184421 secs 2024-04-21T21:59:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 21:59:59 smithi170 ceph-mon[31212]: pgmap v22333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 21:59:59 smithi077 ceph-mon[27902]: pgmap v22333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T21:59:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 21:59:59 smithi191 ceph-mon[31636]: pgmap v22333: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41710.939446 secs 2024-04-21T22:00:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:00 smithi170 ceph-mon[31212]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T22:00:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41710.939446 secs 2024-04-21T22:00:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:00 smithi077 ceph-mon[27902]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T22:00:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41710.939446 secs 2024-04-21T22:00:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:00 smithi191 ceph-mon[31636]: overall HEALTH_WARN 2 MDSs report slow requests 2024-04-21T22:00:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:01 smithi170 ceph-mon[31212]: pgmap v22334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:01 smithi077 ceph-mon[27902]: pgmap v22334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:01 smithi191 ceph-mon[31636]: pgmap v22334: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:03 smithi077 ceph-mon[27902]: pgmap v22335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41714.184544 secs 2024-04-21T22:00:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:03 smithi191 ceph-mon[31636]: pgmap v22335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41714.184544 secs 2024-04-21T22:00:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:03 smithi170 ceph-mon[31212]: pgmap v22335: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41714.184544 secs 2024-04-21T22:00:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41715.939588 secs 2024-04-21T22:00:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:05 smithi077 ceph-mon[27902]: pgmap v22336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:05 smithi077 ceph-mon[27902]: osdmap e1468: 12 total, 12 up, 12 in 2024-04-21T22:00:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41715.939588 secs 2024-04-21T22:00:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:05 smithi191 ceph-mon[31636]: pgmap v22336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:05 smithi191 ceph-mon[31636]: osdmap e1468: 12 total, 12 up, 12 in 2024-04-21T22:00:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41715.939588 secs 2024-04-21T22:00:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:05 smithi170 ceph-mon[31212]: pgmap v22336: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:05.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:05 smithi170 ceph-mon[31212]: osdmap e1468: 12 total, 12 up, 12 in 2024-04-21T22:00:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:07 smithi077 ceph-mon[27902]: pgmap v22338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:07.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:07 smithi191 ceph-mon[31636]: pgmap v22338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:07 smithi170 ceph-mon[31212]: pgmap v22338: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41719.184655 secs 2024-04-21T22:00:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41719.184655 secs 2024-04-21T22:00:08.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41719.184655 secs 2024-04-21T22:00:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:09 smithi077 ceph-mon[27902]: pgmap v22339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:09 smithi191 ceph-mon[31636]: pgmap v22339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:09.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:09 smithi170 ceph-mon[31212]: pgmap v22339: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41720.939700 secs 2024-04-21T22:00:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41720.939700 secs 2024-04-21T22:00:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41720.939700 secs 2024-04-21T22:00:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:11 smithi077 ceph-mon[27902]: pgmap v22340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:11.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:11 smithi077 ceph-mon[27902]: osdmap e1469: 12 total, 12 up, 12 in 2024-04-21T22:00:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:11 smithi191 ceph-mon[31636]: pgmap v22340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:11 smithi191 ceph-mon[31636]: osdmap e1469: 12 total, 12 up, 12 in 2024-04-21T22:00:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:11 smithi170 ceph-mon[31212]: pgmap v22340: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:00:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:11 smithi170 ceph-mon[31212]: osdmap e1469: 12 total, 12 up, 12 in 2024-04-21T22:00:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:13 smithi077 ceph-mon[27902]: pgmap v22342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T22:00:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41724.184792 secs 2024-04-21T22:00:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:13 smithi191 ceph-mon[31636]: pgmap v22342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T22:00:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41724.184792 secs 2024-04-21T22:00:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:13 smithi170 ceph-mon[31212]: pgmap v22342: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T22:00:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41724.184792 secs 2024-04-21T22:00:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41725.939823 secs 2024-04-21T22:00:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:15 smithi077 ceph-mon[27902]: pgmap v22343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T22:00:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41725.939823 secs 2024-04-21T22:00:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:15 smithi191 ceph-mon[31636]: pgmap v22343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T22:00:15.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41725.939823 secs 2024-04-21T22:00:15.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:15 smithi170 ceph-mon[31212]: pgmap v22343: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T22:00:17.609 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:17 smithi170 ceph-mon[31212]: pgmap v22344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:17.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:17 smithi077 ceph-mon[27902]: pgmap v22344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:17 smithi191 ceph-mon[31636]: pgmap v22344: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41729.184874 secs 2024-04-21T22:00:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41729.184874 secs 2024-04-21T22:00:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41729.184874 secs 2024-04-21T22:00:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:19 smithi077 ceph-mon[27902]: pgmap v22345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:19 smithi191 ceph-mon[31636]: pgmap v22345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:19 smithi170 ceph-mon[31212]: pgmap v22345: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41730.939901 secs 2024-04-21T22:00:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41730.939901 secs 2024-04-21T22:00:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41730.939901 secs 2024-04-21T22:00:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:21 smithi077 ceph-mon[27902]: pgmap v22346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:21 smithi191 ceph-mon[31636]: pgmap v22346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:21.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:21 smithi170 ceph-mon[31212]: pgmap v22346: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:00:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:23 smithi077 ceph-mon[27902]: pgmap v22347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:00:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41734.184992 secs 2024-04-21T22:00:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:23 smithi191 ceph-mon[31636]: pgmap v22347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:00:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41734.184992 secs 2024-04-21T22:00:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:23 smithi170 ceph-mon[31212]: pgmap v22347: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:00:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41734.184992 secs 2024-04-21T22:00:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41735.940043 secs 2024-04-21T22:00:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:25 smithi077 ceph-mon[27902]: pgmap v22348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41735.940043 secs 2024-04-21T22:00:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:25 smithi191 ceph-mon[31636]: pgmap v22348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41735.940043 secs 2024-04-21T22:00:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:25 smithi170 ceph-mon[31212]: pgmap v22348: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:27 smithi077 ceph-mon[27902]: pgmap v22349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:27 smithi191 ceph-mon[31636]: pgmap v22349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:27 smithi170 ceph-mon[31212]: pgmap v22349: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41739.185118 secs 2024-04-21T22:00:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41739.185118 secs 2024-04-21T22:00:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41739.185118 secs 2024-04-21T22:00:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:29 smithi077 ceph-mon[27902]: pgmap v22350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:29 smithi191 ceph-mon[31636]: pgmap v22350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:29 smithi170 ceph-mon[31212]: pgmap v22350: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41740.940143 secs 2024-04-21T22:00:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41740.940143 secs 2024-04-21T22:00:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41740.940143 secs 2024-04-21T22:00:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:31 smithi191 ceph-mon[31636]: pgmap v22351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:31.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:31 smithi170 ceph-mon[31212]: pgmap v22351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:31.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:31 smithi077 ceph-mon[27902]: pgmap v22351: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:33 smithi191 ceph-mon[31636]: pgmap v22352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41744.185215 secs 2024-04-21T22:00:33.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:33 smithi170 ceph-mon[31212]: pgmap v22352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41744.185215 secs 2024-04-21T22:00:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:33 smithi077 ceph-mon[27902]: pgmap v22352: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41744.185215 secs 2024-04-21T22:00:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:00:34.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:00:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:00:34.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:34 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:00:34.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:00:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:00:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:00:34.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:34 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:00:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:00:34.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:00:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:00:34.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:34 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:00:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41745.940210 secs 2024-04-21T22:00:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:35 smithi191 ceph-mon[31636]: pgmap v22353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41745.940210 secs 2024-04-21T22:00:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:35 smithi170 ceph-mon[31212]: pgmap v22353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41745.940210 secs 2024-04-21T22:00:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:35 smithi077 ceph-mon[27902]: pgmap v22353: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:37.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:37 smithi191 ceph-mon[31636]: pgmap v22354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:37 smithi170 ceph-mon[31212]: pgmap v22354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:37.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:37 smithi077 ceph-mon[27902]: pgmap v22354: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41749.185296 secs 2024-04-21T22:00:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41749.185296 secs 2024-04-21T22:00:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41749.185296 secs 2024-04-21T22:00:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:39 smithi191 ceph-mon[31636]: pgmap v22355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:39.787 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:39 smithi077 ceph-mon[27902]: pgmap v22355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:39 smithi170 ceph-mon[31212]: pgmap v22355: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41935.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41750.940336 secs 2024-04-21T22:00:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41750.940336 secs 2024-04-21T22:00:40.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41750.940336 secs 2024-04-21T22:00:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:41 smithi191 ceph-mon[31636]: pgmap v22356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:41 smithi170 ceph-mon[31212]: pgmap v22356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:41 smithi077 ceph-mon[27902]: pgmap v22356: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:43 smithi191 ceph-mon[31636]: pgmap v22357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41754.185409 secs 2024-04-21T22:00:43.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:43 smithi170 ceph-mon[31212]: pgmap v22357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41754.185409 secs 2024-04-21T22:00:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:43 smithi077 ceph-mon[27902]: pgmap v22357: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41754.185409 secs 2024-04-21T22:00:44.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:44 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41755.940425 secs 2024-04-21T22:00:44.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:44 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41755.940425 secs 2024-04-21T22:00:44.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:44 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41755.940425 secs 2024-04-21T22:00:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41940.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:45 smithi191 ceph-mon[31636]: pgmap v22358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:45 smithi170 ceph-mon[31212]: pgmap v22358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:45 smithi077 ceph-mon[27902]: pgmap v22358: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:47 smithi191 ceph-mon[31636]: pgmap v22359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:47 smithi170 ceph-mon[31212]: pgmap v22359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:47 smithi077 ceph-mon[27902]: pgmap v22359: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41759.185521 secs 2024-04-21T22:00:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41759.185521 secs 2024-04-21T22:00:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41759.185521 secs 2024-04-21T22:00:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:49 smithi191 ceph-mon[31636]: pgmap v22360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41760.940566 secs 2024-04-21T22:00:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:49 smithi170 ceph-mon[31212]: pgmap v22360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41760.940566 secs 2024-04-21T22:00:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:49 smithi077 ceph-mon[27902]: pgmap v22360: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:49.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41760.940566 secs 2024-04-21T22:00:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41945.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:50 smithi191 ceph-mon[31636]: pgmap v22361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:50 smithi170 ceph-mon[31212]: pgmap v22361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:50.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:50 smithi077 ceph-mon[27902]: pgmap v22361: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-21T22:00:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:53 smithi170 ceph-mon[31212]: pgmap v22362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41764.185656 secs 2024-04-21T22:00:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:53 smithi077 ceph-mon[27902]: pgmap v22362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41764.185656 secs 2024-04-21T22:00:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:53 smithi191 ceph-mon[31636]: pgmap v22362: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:00:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41764.185656 secs 2024-04-21T22:00:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41950.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:00:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41765.940683 secs 2024-04-21T22:00:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:55 smithi170 ceph-mon[31212]: pgmap v22363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41765.940683 secs 2024-04-21T22:00:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:55 smithi077 ceph-mon[27902]: pgmap v22363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41765.940683 secs 2024-04-21T22:00:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:55 smithi191 ceph-mon[31636]: pgmap v22363: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:57 smithi170 ceph-mon[31212]: pgmap v22364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:57 smithi077 ceph-mon[27902]: pgmap v22364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:57 smithi191 ceph-mon[31636]: pgmap v22364: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:00:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41769.185791 secs 2024-04-21T22:00:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41769.185791 secs 2024-04-21T22:00:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41769.185791 secs 2024-04-21T22:00:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:00:59 smithi170 ceph-mon[31212]: pgmap v22365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:00:59 smithi077 ceph-mon[27902]: pgmap v22365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:00:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:00:59 smithi191 ceph-mon[31636]: pgmap v22365: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41955.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41770.940826 secs 2024-04-21T22:01:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41770.940826 secs 2024-04-21T22:01:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41770.940826 secs 2024-04-21T22:01:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:01 smithi170 ceph-mon[31212]: pgmap v22366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T22:01:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:01 smithi077 ceph-mon[27902]: pgmap v22366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T22:01:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:01 smithi191 ceph-mon[31636]: pgmap v22366: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T22:01:03.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:03 smithi170 ceph-mon[31212]: pgmap v22367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:01:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41774.185903 secs 2024-04-21T22:01:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:03 smithi077 ceph-mon[27902]: pgmap v22367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:01:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41774.185903 secs 2024-04-21T22:01:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:03 smithi191 ceph-mon[31636]: pgmap v22367: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-21T22:01:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41774.185903 secs 2024-04-21T22:01:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41960.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41775.940943 secs 2024-04-21T22:01:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:05 smithi170 ceph-mon[31212]: pgmap v22368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:05 smithi170 ceph-mon[31212]: osdmap e1470: 12 total, 12 up, 12 in 2024-04-21T22:01:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41775.940943 secs 2024-04-21T22:01:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:05 smithi077 ceph-mon[27902]: pgmap v22368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:05.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:05 smithi077 ceph-mon[27902]: osdmap e1470: 12 total, 12 up, 12 in 2024-04-21T22:01:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41775.940943 secs 2024-04-21T22:01:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:05 smithi191 ceph-mon[31636]: pgmap v22368: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:05 smithi191 ceph-mon[31636]: osdmap e1470: 12 total, 12 up, 12 in 2024-04-21T22:01:07.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:07 smithi170 ceph-mon[31212]: pgmap v22370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:07 smithi077 ceph-mon[27902]: pgmap v22370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:07 smithi191 ceph-mon[31636]: pgmap v22370: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:08.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41779.186026 secs 2024-04-21T22:01:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41779.186026 secs 2024-04-21T22:01:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41779.186026 secs 2024-04-21T22:01:09.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:09 smithi170 ceph-mon[31212]: pgmap v22371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:09 smithi077 ceph-mon[27902]: pgmap v22371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:09 smithi191 ceph-mon[31636]: pgmap v22371: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41965.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:10.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41780.941066 secs 2024-04-21T22:01:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41780.941066 secs 2024-04-21T22:01:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41780.941066 secs 2024-04-21T22:01:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:11 smithi077 ceph-mon[27902]: pgmap v22372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:11 smithi077 ceph-mon[27902]: osdmap e1471: 12 total, 12 up, 12 in 2024-04-21T22:01:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:11 smithi191 ceph-mon[31636]: pgmap v22372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:11 smithi191 ceph-mon[31636]: osdmap e1471: 12 total, 12 up, 12 in 2024-04-21T22:01:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:11 smithi170 ceph-mon[31212]: pgmap v22372: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:01:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:11 smithi170 ceph-mon[31212]: osdmap e1471: 12 total, 12 up, 12 in 2024-04-21T22:01:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:13 smithi077 ceph-mon[27902]: pgmap v22374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T22:01:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41784.186137 secs 2024-04-21T22:01:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:13 smithi191 ceph-mon[31636]: pgmap v22374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T22:01:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41784.186137 secs 2024-04-21T22:01:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:13 smithi170 ceph-mon[31212]: pgmap v22374: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-21T22:01:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41784.186137 secs 2024-04-21T22:01:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41970.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41785.941184 secs 2024-04-21T22:01:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:15 smithi077 ceph-mon[27902]: pgmap v22375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T22:01:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41785.941184 secs 2024-04-21T22:01:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:15 smithi191 ceph-mon[31636]: pgmap v22375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T22:01:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41785.941184 secs 2024-04-21T22:01:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:15 smithi170 ceph-mon[31212]: pgmap v22375: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-04-21T22:01:17.609 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:17 smithi170 ceph-mon[31212]: pgmap v22376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:17 smithi077 ceph-mon[27902]: pgmap v22376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:17 smithi191 ceph-mon[31636]: pgmap v22376: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41789.186201 secs 2024-04-21T22:01:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41789.186201 secs 2024-04-21T22:01:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41789.186201 secs 2024-04-21T22:01:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:19 smithi077 ceph-mon[27902]: pgmap v22377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:19 smithi191 ceph-mon[31636]: pgmap v22377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:19 smithi170 ceph-mon[31212]: pgmap v22377: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41975.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41790.941307 secs 2024-04-21T22:01:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41790.941307 secs 2024-04-21T22:01:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41790.941307 secs 2024-04-21T22:01:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:21 smithi077 ceph-mon[27902]: pgmap v22378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:21 smithi191 ceph-mon[31636]: pgmap v22378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:21.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:21 smithi170 ceph-mon[31212]: pgmap v22378: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:01:23.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:23 smithi077 ceph-mon[27902]: pgmap v22379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:01:23.639 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41794.186337 secs 2024-04-21T22:01:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:23 smithi191 ceph-mon[31636]: pgmap v22379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:01:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41794.186337 secs 2024-04-21T22:01:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:23 smithi170 ceph-mon[31212]: pgmap v22379: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:01:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41794.186337 secs 2024-04-21T22:01:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41980.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41795.941428 secs 2024-04-21T22:01:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:25 smithi077 ceph-mon[27902]: pgmap v22380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41795.941428 secs 2024-04-21T22:01:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:25 smithi191 ceph-mon[31636]: pgmap v22380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41795.941428 secs 2024-04-21T22:01:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:25 smithi170 ceph-mon[31212]: pgmap v22380: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:27 smithi077 ceph-mon[27902]: pgmap v22381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:27 smithi191 ceph-mon[31636]: pgmap v22381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:27 smithi170 ceph-mon[31212]: pgmap v22381: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41799.186446 secs 2024-04-21T22:01:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41799.186446 secs 2024-04-21T22:01:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41799.186446 secs 2024-04-21T22:01:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:29 smithi077 ceph-mon[27902]: pgmap v22382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:29 smithi191 ceph-mon[31636]: pgmap v22382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:29 smithi170 ceph-mon[31212]: pgmap v22382: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41985.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41800.941552 secs 2024-04-21T22:01:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41800.941552 secs 2024-04-21T22:01:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41800.941552 secs 2024-04-21T22:01:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:31 smithi077 ceph-mon[27902]: pgmap v22383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:31 smithi191 ceph-mon[31636]: pgmap v22383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:31 smithi170 ceph-mon[31212]: pgmap v22383: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:33 smithi077 ceph-mon[27902]: pgmap v22384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41804.186579 secs 2024-04-21T22:01:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:33 smithi191 ceph-mon[31636]: pgmap v22384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:33.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41804.186579 secs 2024-04-21T22:01:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:33 smithi170 ceph-mon[31212]: pgmap v22384: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41804.186579 secs 2024-04-21T22:01:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41990.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41805.941695 secs 2024-04-21T22:01:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:35 smithi077 ceph-mon[27902]: pgmap v22385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:01:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:01:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:01:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:01:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41805.941695 secs 2024-04-21T22:01:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:35 smithi191 ceph-mon[31636]: pgmap v22385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:01:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:01:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:01:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:01:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41805.941695 secs 2024-04-21T22:01:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:35 smithi170 ceph-mon[31212]: pgmap v22385: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:01:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:01:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:01:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:01:37.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:37 smithi077 ceph-mon[27902]: pgmap v22386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:37 smithi191 ceph-mon[31636]: pgmap v22386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:37 smithi170 ceph-mon[31212]: pgmap v22386: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:38.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41809.186727 secs 2024-04-21T22:01:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41809.186727 secs 2024-04-21T22:01:38.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41809.186727 secs 2024-04-21T22:01:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:39 smithi077 ceph-mon[27902]: pgmap v22387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:39 smithi191 ceph-mon[31636]: pgmap v22387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:39 smithi170 ceph-mon[31212]: pgmap v22387: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:40.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 41995.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41810.941820 secs 2024-04-21T22:01:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41810.941820 secs 2024-04-21T22:01:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41810.941820 secs 2024-04-21T22:01:41.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:41 smithi077 ceph-mon[27902]: pgmap v22388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:41 smithi191 ceph-mon[31636]: pgmap v22388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:41 smithi170 ceph-mon[31212]: pgmap v22388: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:43 smithi077 ceph-mon[27902]: pgmap v22389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:43.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41814.186831 secs 2024-04-21T22:01:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:43 smithi191 ceph-mon[31636]: pgmap v22389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:43.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41814.186831 secs 2024-04-21T22:01:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:43 smithi170 ceph-mon[31212]: pgmap v22389: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41814.186831 secs 2024-04-21T22:01:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42000.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41815.941934 secs 2024-04-21T22:01:45.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:45 smithi077 ceph-mon[27902]: pgmap v22390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41815.941934 secs 2024-04-21T22:01:45.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:45 smithi191 ceph-mon[31636]: pgmap v22390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41815.941934 secs 2024-04-21T22:01:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:45 smithi170 ceph-mon[31212]: pgmap v22390: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:47.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:46 smithi170 ceph-mon[31212]: pgmap v22391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:47.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:46 smithi077 ceph-mon[27902]: pgmap v22391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:47.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:46 smithi191 ceph-mon[31636]: pgmap v22391: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:48.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:47 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41819.186915 secs 2024-04-21T22:01:48.120 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:47 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41819.186915 secs 2024-04-21T22:01:48.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:47 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41819.186915 secs 2024-04-21T22:01:49.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:48 smithi170 ceph-mon[31212]: pgmap v22392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:49.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:48 smithi077 ceph-mon[27902]: pgmap v22392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:49.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:48 smithi191 ceph-mon[31636]: pgmap v22392: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:50.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:49 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41820.942054 secs 2024-04-21T22:01:50.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42005.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:50.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:49 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41820.942054 secs 2024-04-21T22:01:50.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:49 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41820.942054 secs 2024-04-21T22:01:51.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:50 smithi170 ceph-mon[31212]: pgmap v22393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:51.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:50 smithi077 ceph-mon[27902]: pgmap v22393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:51.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:50 smithi191 ceph-mon[31636]: pgmap v22393: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:53 smithi170 ceph-mon[31212]: pgmap v22394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:53.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41824.187046 secs 2024-04-21T22:01:53.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:53 smithi077 ceph-mon[27902]: pgmap v22394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:53.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41824.187046 secs 2024-04-21T22:01:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:53 smithi191 ceph-mon[31636]: pgmap v22394: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:01:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41824.187046 secs 2024-04-21T22:01:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42010.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:01:55.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:55 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41825.942156 secs 2024-04-21T22:01:55.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:55 smithi170 ceph-mon[31212]: pgmap v22395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:55 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41825.942156 secs 2024-04-21T22:01:55.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:55 smithi077 ceph-mon[27902]: pgmap v22395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:55.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:55 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41825.942156 secs 2024-04-21T22:01:55.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:55 smithi191 ceph-mon[31636]: pgmap v22395: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:57 smithi170 ceph-mon[31212]: pgmap v22396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:57 smithi077 ceph-mon[27902]: pgmap v22396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:57 smithi191 ceph-mon[31636]: pgmap v22396: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:01:58.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41829.187200 secs 2024-04-21T22:01:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41829.187200 secs 2024-04-21T22:01:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41829.187200 secs 2024-04-21T22:01:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:01:59 smithi170 ceph-mon[31212]: pgmap v22397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:01:59 smithi077 ceph-mon[27902]: pgmap v22397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:01:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:01:59 smithi191 ceph-mon[31636]: pgmap v22397: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42015.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.140+0000 7efd577fe640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd48006630 con 0x5637269918d0 2024-04-21T22:02:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.140+0000 7efd697fa640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7efd500036c0 con 0x7efd78101130 2024-04-21T22:02:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.141+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 319 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7efd48006630 con 0x5637269918d0 2024-04-21T22:02:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.141+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd48006460 con 0x5637269918d0 2024-04-21T22:02:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.141+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 319 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7efd500036c0 con 0x7efd78101130 2024-04-21T22:02:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.141+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7efd500065d0 con 0x7efd78101130 2024-04-21T22:02:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.141+0000 7efd60ff9640 1 -- 172.21.15.77:0/826097124 <== mon.0 v2:172.21.15.77:3300/0 320 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7efd48006460 con 0x5637269918d0 2024-04-21T22:02:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-04-21T22:02:00.141+0000 7efd6a7fc640 1 -- 172.21.15.77:0/823123653 <== mon.0 v2:172.21.15.77:3300/0 320 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7efd500065d0 con 0x7efd78101130 2024-04-21T22:02:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41830.942278 secs 2024-04-21T22:02:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41830.942278 secs 2024-04-21T22:02:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41830.942278 secs 2024-04-21T22:02:01.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:01 smithi077 ceph-mon[27902]: pgmap v22398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T22:02:01.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:01 smithi170 ceph-mon[31212]: pgmap v22398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T22:02:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:01 smithi191 ceph-mon[31636]: pgmap v22398: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T22:02:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:03 smithi170 ceph-mon[31212]: pgmap v22399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T22:02:03.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41834.187307 secs 2024-04-21T22:02:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:03 smithi077 ceph-mon[27902]: pgmap v22399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T22:02:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41834.187307 secs 2024-04-21T22:02:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:03 smithi191 ceph-mon[31636]: pgmap v22399: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T22:02:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41834.187307 secs 2024-04-21T22:02:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42020.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41835.942390 secs 2024-04-21T22:02:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:05 smithi170 ceph-mon[31212]: pgmap v22400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T22:02:05.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:05 smithi170 ceph-mon[31212]: osdmap e1472: 12 total, 12 up, 12 in 2024-04-21T22:02:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41835.942390 secs 2024-04-21T22:02:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:05 smithi077 ceph-mon[27902]: pgmap v22400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T22:02:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:05 smithi077 ceph-mon[27902]: osdmap e1472: 12 total, 12 up, 12 in 2024-04-21T22:02:05.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41835.942390 secs 2024-04-21T22:02:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:05 smithi191 ceph-mon[31636]: pgmap v22400: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 KiB/s wr, 21 op/s 2024-04-21T22:02:05.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:05 smithi191 ceph-mon[31636]: osdmap e1472: 12 total, 12 up, 12 in 2024-04-21T22:02:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:07 smithi077 ceph-mon[27902]: pgmap v22402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:02:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:07 smithi191 ceph-mon[31636]: pgmap v22402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:02:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:07 smithi170 ceph-mon[31212]: pgmap v22402: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:02:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41839.187397 secs 2024-04-21T22:02:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41839.187397 secs 2024-04-21T22:02:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41839.187397 secs 2024-04-21T22:02:09.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:09 smithi077 ceph-mon[27902]: pgmap v22403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:02:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:09 smithi191 ceph-mon[31636]: pgmap v22403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:02:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:09 smithi170 ceph-mon[31212]: pgmap v22403: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:02:10.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42025.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41840.942542 secs 2024-04-21T22:02:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41840.942542 secs 2024-04-21T22:02:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41840.942542 secs 2024-04-21T22:02:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:11 smithi077 ceph-mon[27902]: pgmap v22404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T22:02:11.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:11 smithi077 ceph-mon[27902]: osdmap e1473: 12 total, 12 up, 12 in 2024-04-21T22:02:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:11 smithi191 ceph-mon[31636]: pgmap v22404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T22:02:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:11 smithi191 ceph-mon[31636]: osdmap e1473: 12 total, 12 up, 12 in 2024-04-21T22:02:11.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:11 smithi170 ceph-mon[31212]: pgmap v22404: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 40 KiB/s wr, 25 op/s 2024-04-21T22:02:11.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:11 smithi170 ceph-mon[31212]: osdmap e1473: 12 total, 12 up, 12 in 2024-04-21T22:02:13.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:13 smithi077 ceph-mon[27902]: pgmap v22406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T22:02:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41844.187532 secs 2024-04-21T22:02:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:13 smithi191 ceph-mon[31636]: pgmap v22406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T22:02:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41844.187532 secs 2024-04-21T22:02:13.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:13 smithi170 ceph-mon[31212]: pgmap v22406: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-04-21T22:02:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41844.187532 secs 2024-04-21T22:02:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42030.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41845.942661 secs 2024-04-21T22:02:15.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:15 smithi077 ceph-mon[27902]: pgmap v22407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T22:02:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41845.942661 secs 2024-04-21T22:02:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:15 smithi191 ceph-mon[31636]: pgmap v22407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T22:02:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41845.942661 secs 2024-04-21T22:02:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:15 smithi170 ceph-mon[31212]: pgmap v22407: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-04-21T22:02:17.609 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:17 smithi170 ceph-mon[31212]: pgmap v22408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:17 smithi077 ceph-mon[27902]: pgmap v22408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:17 smithi191 ceph-mon[31636]: pgmap v22408: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41849.187664 secs 2024-04-21T22:02:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41849.187664 secs 2024-04-21T22:02:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41849.187664 secs 2024-04-21T22:02:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:19 smithi077 ceph-mon[27902]: pgmap v22409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:19 smithi191 ceph-mon[31636]: pgmap v22409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:19 smithi170 ceph-mon[31212]: pgmap v22409: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42035.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41850.942798 secs 2024-04-21T22:02:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41850.942798 secs 2024-04-21T22:02:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41850.942798 secs 2024-04-21T22:02:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:21 smithi077 ceph-mon[27902]: pgmap v22410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:21 smithi191 ceph-mon[31636]: pgmap v22410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:21.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:21 smithi170 ceph-mon[31212]: pgmap v22410: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:02:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:23 smithi077 ceph-mon[27902]: pgmap v22411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:02:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41854.187740 secs 2024-04-21T22:02:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:23 smithi191 ceph-mon[31636]: pgmap v22411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:02:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41854.187740 secs 2024-04-21T22:02:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:23 smithi170 ceph-mon[31212]: pgmap v22411: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-21T22:02:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41854.187740 secs 2024-04-21T22:02:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42040.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41855.942937 secs 2024-04-21T22:02:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:25 smithi077 ceph-mon[27902]: pgmap v22412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41855.942937 secs 2024-04-21T22:02:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:25 smithi191 ceph-mon[31636]: pgmap v22412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41855.942937 secs 2024-04-21T22:02:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:25 smithi170 ceph-mon[31212]: pgmap v22412: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:27.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:27 smithi077 ceph-mon[27902]: pgmap v22413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:27.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:27 smithi191 ceph-mon[31636]: pgmap v22413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:27.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:27 smithi170 ceph-mon[31212]: pgmap v22413: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:28.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:28 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41859.187874 secs 2024-04-21T22:02:28.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:28 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41859.187874 secs 2024-04-21T22:02:28.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:28 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41859.187874 secs 2024-04-21T22:02:29.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:29 smithi077 ceph-mon[27902]: pgmap v22414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:29.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:29 smithi191 ceph-mon[31636]: pgmap v22414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:29.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:29 smithi170 ceph-mon[31212]: pgmap v22414: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42045.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:30.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:30 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41860.943053 secs 2024-04-21T22:02:30.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:30 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41860.943053 secs 2024-04-21T22:02:30.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:30 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41860.943053 secs 2024-04-21T22:02:31.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:31 smithi077 ceph-mon[27902]: pgmap v22415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:31.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:31 smithi191 ceph-mon[31636]: pgmap v22415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:31.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:31 smithi170 ceph-mon[31212]: pgmap v22415: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:33 smithi191 ceph-mon[31636]: pgmap v22416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41864.187989 secs 2024-04-21T22:02:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:33 smithi170 ceph-mon[31212]: pgmap v22416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:33.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41864.187989 secs 2024-04-21T22:02:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:33 smithi077 ceph-mon[27902]: pgmap v22416: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:33.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41864.187989 secs 2024-04-21T22:02:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42050.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41865.943162 secs 2024-04-21T22:02:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:35 smithi191 ceph-mon[31636]: pgmap v22417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:35.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:35 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:02:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41865.943162 secs 2024-04-21T22:02:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:35 smithi170 ceph-mon[31212]: pgmap v22417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:35.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:35 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:02:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41865.943162 secs 2024-04-21T22:02:35.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:35 smithi077 ceph-mon[27902]: pgmap v22417: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:35.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:35 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:02:37.697 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:37 smithi077 ceph-mon[27902]: pgmap v22418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:37.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:37 smithi191 ceph-mon[31636]: pgmap v22418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:37.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:37 smithi170 ceph-mon[31212]: pgmap v22418: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:38.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:38 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41869.188104 secs 2024-04-21T22:02:38.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:38 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41869.188104 secs 2024-04-21T22:02:38.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:38 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41869.188104 secs 2024-04-21T22:02:39.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:39 smithi191 ceph-mon[31636]: pgmap v22419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:39.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:39 smithi170 ceph-mon[31212]: pgmap v22419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:39.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:39 smithi077 ceph-mon[27902]: pgmap v22419: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:40.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42055.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:40 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41870.943264 secs 2024-04-21T22:02:40.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:02:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:02:40.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:40 smithi077 ceph-mon[27902]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:40 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41870.943264 secs 2024-04-21T22:02:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:02:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:02:40.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:40 smithi191 ceph-mon[31636]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:40 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41870.943264 secs 2024-04-21T22:02:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:02:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:02:40.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:40 smithi170 ceph-mon[31212]: from='mgr.15315 172.21.15.77:0/1838927133' entity='mgr.x' 2024-04-21T22:02:41.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:41 smithi191 ceph-mon[31636]: pgmap v22420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:41.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:41 smithi170 ceph-mon[31212]: pgmap v22420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:41.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:41 smithi077 ceph-mon[27902]: pgmap v22420: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:43 smithi191 ceph-mon[31636]: pgmap v22421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:43.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:43 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41874.188222 secs 2024-04-21T22:02:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:43 smithi170 ceph-mon[31212]: pgmap v22421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:43.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:43 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41874.188222 secs 2024-04-21T22:02:43.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:43 smithi077 ceph-mon[27902]: pgmap v22421: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:43.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:43 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41874.188222 secs 2024-04-21T22:02:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42060.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:45 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41875.943406 secs 2024-04-21T22:02:45.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:45 smithi191 ceph-mon[31636]: pgmap v22422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:45 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41875.943406 secs 2024-04-21T22:02:45.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:45 smithi170 ceph-mon[31212]: pgmap v22422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:45.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:45 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41875.943406 secs 2024-04-21T22:02:45.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:45 smithi077 ceph-mon[27902]: pgmap v22422: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:47.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:47 smithi191 ceph-mon[31636]: pgmap v22423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:47.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:47 smithi170 ceph-mon[31212]: pgmap v22423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:47.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:47 smithi077 ceph-mon[27902]: pgmap v22423: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:48.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:48 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41879.188351 secs 2024-04-21T22:02:48.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:48 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41879.188351 secs 2024-04-21T22:02:48.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:48 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41879.188351 secs 2024-04-21T22:02:49.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:49 smithi191 ceph-mon[31636]: pgmap v22424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:49.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:49 smithi170 ceph-mon[31212]: pgmap v22424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:49.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:49 smithi077 ceph-mon[27902]: pgmap v22424: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42065.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:50.714 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:50 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41880.943518 secs 2024-04-21T22:02:50.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:50 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41880.943518 secs 2024-04-21T22:02:50.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:50 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41880.943518 secs 2024-04-21T22:02:51.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:51 smithi191 ceph-mon[31636]: pgmap v22425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:51.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:51 smithi170 ceph-mon[31212]: pgmap v22425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:51.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:51 smithi077 ceph-mon[27902]: pgmap v22425: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:53.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:53 smithi191 ceph-mon[31636]: pgmap v22426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:53.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:53 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41884.188490 secs 2024-04-21T22:02:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:53 smithi170 ceph-mon[31212]: pgmap v22426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:53.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:53 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41884.188490 secs 2024-04-21T22:02:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:53 smithi077 ceph-mon[27902]: pgmap v22426: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:02:53.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:53 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41884.188490 secs 2024-04-21T22:02:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:54 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41885.943645 secs 2024-04-21T22:02:54.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:54 smithi170 ceph-mon[31212]: pgmap v22427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:54 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41885.943645 secs 2024-04-21T22:02:54.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:54 smithi077 ceph-mon[27902]: pgmap v22427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:54 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41885.943645 secs 2024-04-21T22:02:54.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:54 smithi191 ceph-mon[31636]: pgmap v22427: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:55.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42070.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:02:57.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:57 smithi170 ceph-mon[31212]: pgmap v22428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:57.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:57 smithi077 ceph-mon[27902]: pgmap v22428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:57.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:57 smithi191 ceph-mon[31636]: pgmap v22428: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:02:58.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:58 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41889.188611 secs 2024-04-21T22:02:58.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:58 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41889.188611 secs 2024-04-21T22:02:58.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:58 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41889.188611 secs 2024-04-21T22:02:59.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:02:59 smithi170 ceph-mon[31212]: pgmap v22429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:59.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:02:59 smithi077 ceph-mon[27902]: pgmap v22429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:02:59.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:02:59 smithi191 ceph-mon[31636]: pgmap v22429: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-21T22:03:00.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42075.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:00.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:00 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41890.943769 secs 2024-04-21T22:03:00.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:00 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41890.943769 secs 2024-04-21T22:03:00.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:00 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41890.943769 secs 2024-04-21T22:03:01.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:01 smithi170 ceph-mon[31212]: pgmap v22430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:03:01.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:01 smithi077 ceph-mon[27902]: pgmap v22430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:03:01.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:01 smithi191 ceph-mon[31636]: pgmap v22430: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-21T22:03:03.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:03 smithi077 ceph-mon[27902]: pgmap v22431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T22:03:03.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:03 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41894.188731 secs 2024-04-21T22:03:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:03 smithi191 ceph-mon[31636]: pgmap v22431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T22:03:03.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:03 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41894.188731 secs 2024-04-21T22:03:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:03 smithi170 ceph-mon[31212]: pgmap v22431: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-21T22:03:03.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:03 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41894.188731 secs 2024-04-21T22:03:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42080.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:05.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:05 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41895.943880 secs 2024-04-21T22:03:05.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:05 smithi077 ceph-mon[27902]: pgmap v22432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T22:03:05.943 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:05 smithi077 ceph-mon[27902]: osdmap e1474: 12 total, 12 up, 12 in 2024-04-21T22:03:05.944 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:05 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41895.943880 secs 2024-04-21T22:03:05.944 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:05 smithi170 ceph-mon[31212]: pgmap v22432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T22:03:05.944 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:05 smithi170 ceph-mon[31212]: osdmap e1474: 12 total, 12 up, 12 in 2024-04-21T22:03:05.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:05 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41895.943880 secs 2024-04-21T22:03:05.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:05 smithi191 ceph-mon[31636]: pgmap v22432: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-21T22:03:05.944 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:05 smithi191 ceph-mon[31636]: osdmap e1474: 12 total, 12 up, 12 in 2024-04-21T22:03:07.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:07 smithi077 ceph-mon[27902]: pgmap v22434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:07.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:07 smithi191 ceph-mon[31636]: pgmap v22434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:07.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:07 smithi170 ceph-mon[31212]: pgmap v22434: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:08.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:08 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41899.188813 secs 2024-04-21T22:03:08.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:08 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41899.188813 secs 2024-04-21T22:03:08.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:08 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41899.188813 secs 2024-04-21T22:03:09.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:09 smithi077 ceph-mon[27902]: pgmap v22435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:09.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:09 smithi191 ceph-mon[31636]: pgmap v22435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:09.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:09 smithi170 ceph-mon[31212]: pgmap v22435: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42085.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:10.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:10 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41900.944001 secs 2024-04-21T22:03:10.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:10 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41900.944001 secs 2024-04-21T22:03:10.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:10 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41900.944001 secs 2024-04-21T22:03:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:11 smithi077 ceph-mon[27902]: pgmap v22436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:11.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:11 smithi077 ceph-mon[27902]: osdmap e1475: 12 total, 12 up, 12 in 2024-04-21T22:03:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:11 smithi191 ceph-mon[31636]: pgmap v22436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:11.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:11 smithi191 ceph-mon[31636]: osdmap e1475: 12 total, 12 up, 12 in 2024-04-21T22:03:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:11 smithi170 ceph-mon[31212]: pgmap v22436: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-21T22:03:11.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:11 smithi170 ceph-mon[31212]: osdmap e1475: 12 total, 12 up, 12 in 2024-04-21T22:03:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:13 smithi077 ceph-mon[27902]: pgmap v22438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T22:03:13.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:13 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41904.188923 secs 2024-04-21T22:03:13.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:13 smithi191 ceph-mon[31636]: pgmap v22438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T22:03:13.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:13 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41904.188923 secs 2024-04-21T22:03:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:13 smithi170 ceph-mon[31212]: pgmap v22438: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 50 KiB/s wr, 29 op/s 2024-04-21T22:03:13.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:13 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41904.188923 secs 2024-04-21T22:03:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42090.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:15 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41905.944128 secs 2024-04-21T22:03:15.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:15 smithi077 ceph-mon[27902]: pgmap v22439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 23 op/s 2024-04-21T22:03:15.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:15 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41905.944128 secs 2024-04-21T22:03:15.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:15 smithi191 ceph-mon[31636]: pgmap v22439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 23 op/s 2024-04-21T22:03:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:15 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41905.944128 secs 2024-04-21T22:03:15.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:15 smithi170 ceph-mon[31212]: pgmap v22439: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 KiB/s wr, 23 op/s 2024-04-21T22:03:17.609 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:17 smithi170 ceph-mon[31212]: pgmap v22440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:03:17.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:17 smithi077 ceph-mon[27902]: pgmap v22440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:03:17.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:17 smithi191 ceph-mon[31636]: pgmap v22440: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:03:18.620 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:18 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41909.189010 secs 2024-04-21T22:03:18.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:18 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41909.189010 secs 2024-04-21T22:03:18.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:18 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41909.189010 secs 2024-04-21T22:03:19.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:19 smithi077 ceph-mon[27902]: pgmap v22441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:03:19.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:19 smithi191 ceph-mon[31636]: pgmap v22441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:03:19.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:19 smithi170 ceph-mon[31212]: pgmap v22441: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-21T22:03:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42095.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:20.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:20 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41910.944244 secs 2024-04-21T22:03:20.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:20 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41910.944244 secs 2024-04-21T22:03:20.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:20 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41910.944244 secs 2024-04-21T22:03:21.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:21 smithi077 ceph-mon[27902]: pgmap v22442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T22:03:21.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:21 smithi191 ceph-mon[31636]: pgmap v22442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T22:03:21.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:21 smithi170 ceph-mon[31212]: pgmap v22442: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-04-21T22:03:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:23 smithi077 ceph-mon[27902]: pgmap v22443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:03:23.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:23 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41914.189087 secs 2024-04-21T22:03:23.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:23 smithi191 ceph-mon[31636]: pgmap v22443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:03:23.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:23 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41914.189087 secs 2024-04-21T22:03:23.806 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:23 smithi170 ceph-mon[31212]: pgmap v22443: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-21T22:03:23.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:23 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41914.189087 secs 2024-04-21T22:03:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:25.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:25 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41915.944305 secs 2024-04-21T22:03:25.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:25 smithi077 ceph-mon[27902]: pgmap v22444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:25.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:25 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41915.944305 secs 2024-04-21T22:03:25.719 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:25 smithi191 ceph-mon[31636]: pgmap v22444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:25 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41915.944305 secs 2024-04-21T22:03:25.807 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:25 smithi170 ceph-mon[31212]: pgmap v22444: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:27.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:26 smithi170 ceph-mon[31212]: pgmap v22445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T22:03:27.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:26 smithi077 ceph-mon[27902]: pgmap v22445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T22:03:27.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:26 smithi191 ceph-mon[31636]: pgmap v22445: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-21T22:03:28.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:27 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41919.189236 secs 2024-04-21T22:03:28.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:27 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41919.189236 secs 2024-04-21T22:03:28.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:27 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41919.189236 secs 2024-04-21T22:03:29.057 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:28 smithi170 ceph-mon[31212]: pgmap v22446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:29.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:28 smithi077 ceph-mon[27902]: pgmap v22446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:29.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:28 smithi191 ceph-mon[31636]: pgmap v22446: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:30.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:29 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41920.944431 secs 2024-04-21T22:03:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42105.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:29 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41920.944431 secs 2024-04-21T22:03:30.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:29 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41920.944431 secs 2024-04-21T22:03:31.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:30 smithi170 ceph-mon[31212]: pgmap v22447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T22:03:31.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:30 smithi077 ceph-mon[27902]: pgmap v22447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T22:03:31.218 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:30 smithi191 ceph-mon[31636]: pgmap v22447: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-21T22:03:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:33 smithi170 ceph-mon[31212]: pgmap v22448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T22:03:33.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:33 smithi170 ceph-mon[31212]: 1 slow requests, 0 included below; oldest blocked for > 41924.189318 secs 2024-04-21T22:03:33.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:33 smithi077 ceph-mon[27902]: pgmap v22448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T22:03:33.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:33 smithi077 ceph-mon[27902]: 1 slow requests, 0 included below; oldest blocked for > 41924.189318 secs 2024-04-21T22:03:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:33 smithi191 ceph-mon[31636]: pgmap v22448: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-21T22:03:33.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:33 smithi191 ceph-mon[31636]: 1 slow requests, 0 included below; oldest blocked for > 41924.189318 secs 2024-04-21T22:03:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:progress: 42110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-21T22:03:35.556 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:35 smithi170 ceph-mon[31212]: 20 slow requests, 0 included below; oldest blocked for > 41925.944577 secs 2024-04-21T22:03:35.557 INFO:journalctl@ceph.mon.b.smithi170.stdout:Apr 21 22:03:35 smithi170 ceph-mon[31212]: pgmap v22449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:35.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:35 smithi077 ceph-mon[27902]: 20 slow requests, 0 included below; oldest blocked for > 41925.944577 secs 2024-04-21T22:03:35.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Apr 21 22:03:35 smithi077 ceph-mon[27902]: pgmap v22449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:35 smithi191 ceph-mon[31636]: 20 slow requests, 0 included below; oldest blocked for > 41925.944577 secs 2024-04-21T22:03:35.718 INFO:journalctl@ceph.mon.c.smithi191.stdout:Apr 21 22:03:35 smithi191 ceph-mon[31636]: pgmap v22449: 97 pgs: 97 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-21T22:03:36.986 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-21T22:03:36.986 DEBUG:teuthology.task.console_log:Killing console logger for smithi077 2024-04-21T22:03:36.987 DEBUG:teuthology.task.console_log:Killing console logger for smithi170 2024-04-21T22:03:36.987 DEBUG:teuthology.task.console_log:Killing console logger for smithi191 2024-04-21T22:03:36.987 DEBUG:teuthology.exit:Finished running handlers